-- Logs begin at Wed 2022-08-31 15:01:43 UTC, end at Wed 2022-08-31 17:43:38 UTC. -- Aug 31 15:38:12.169804 n-d-833090-16 systemd[1]: Starting Devstack devstack@n-api.service... Aug 31 15:38:12.179648 n-d-833090-16 devstack@n-api.service[112961]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 31 15:38:12.181660 n-d-833090-16 devstack@n-api.service[112961]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 15:38:12 2022] *** Aug 31 15:38:12.181660 n-d-833090-16 devstack@n-api.service[112961]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 15:38:12.181660 n-d-833090-16 devstack@n-api.service[112961]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 15:38:12.181660 n-d-833090-16 devstack@n-api.service[112961]: nodename: n-d-833090-16 Aug 31 15:38:12.181660 n-d-833090-16 devstack@n-api.service[112961]: machine: x86_64 Aug 31 15:38:12.181660 n-d-833090-16 devstack@n-api.service[112961]: clock source: unix Aug 31 15:38:12.181660 n-d-833090-16 devstack@n-api.service[112961]: pcre jit disabled Aug 31 15:38:12.181660 n-d-833090-16 devstack@n-api.service[112961]: detected number of CPU cores: 4 Aug 31 15:38:12.181660 n-d-833090-16 devstack@n-api.service[112961]: current working directory: / Aug 31 15:38:12.181660 n-d-833090-16 devstack@n-api.service[112961]: detected binary path: /usr/bin/uwsgi-core Aug 31 15:38:12.182320 n-d-833090-16 devstack@n-api.service[112961]: your processes number limit is 47680 Aug 31 15:38:12.182320 n-d-833090-16 devstack@n-api.service[112961]: your memory page size is 4096 bytes Aug 31 15:38:12.182320 n-d-833090-16 devstack@n-api.service[112961]: detected max file descriptor number: 2048 Aug 31 15:38:12.182320 n-d-833090-16 devstack@n-api.service[112961]: lock engine: pthread robust mutexes Aug 31 15:38:12.182320 n-d-833090-16 devstack@n-api.service[112961]: thunder lock: enabled Aug 31 15:38:12.182320 n-d-833090-16 devstack@n-api.service[112961]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 31 15:38:12.182320 n-d-833090-16 devstack@n-api.service[112961]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 15:38:12.221489 n-d-833090-16 devstack@n-api.service[112961]: Python main interpreter initialized at 0x5591849469c0 Aug 31 15:38:12.221489 n-d-833090-16 devstack@n-api.service[112961]: python threads support enabled Aug 31 15:38:12.221489 n-d-833090-16 devstack@n-api.service[112961]: your server socket listen backlog is limited to 100 connections Aug 31 15:38:12.221489 n-d-833090-16 devstack@n-api.service[112961]: your mercy for graceful operations on workers is 90 seconds Aug 31 15:38:12.221878 n-d-833090-16 devstack@n-api.service[112961]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 15:38:12.221878 n-d-833090-16 devstack@n-api.service[112961]: *** Operational MODE: preforking *** Aug 31 15:38:12.222213 n-d-833090-16 devstack@n-api.service[112961]: *** uWSGI is running in multiple interpreter mode *** Aug 31 15:38:12.222213 n-d-833090-16 devstack@n-api.service[112961]: spawned uWSGI master process (pid: 112961) Aug 31 15:38:12.222429 n-d-833090-16 systemd[1]: Started Devstack devstack@n-api.service. Aug 31 15:38:12.224838 n-d-833090-16 devstack@n-api.service[112961]: spawned uWSGI worker 1 (pid: 112969, cores: 1) Aug 31 15:38:12.224838 n-d-833090-16 devstack@n-api.service[112961]: spawned uWSGI worker 2 (pid: 112970, cores: 1) Aug 31 15:38:12.224838 n-d-833090-16 devstack@n-api.service[112961]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 15:38:12.871073 n-d-833090-16 devstack@n-api.service[112969]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 15:38:12.876353 n-d-833090-16 devstack@n-api.service[112970]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 15:38:13.947937 n-d-833090-16 devstack@n-api.service[112969]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 15:38:13.947937 n-d-833090-16 devstack@n-api.service[112969]: from cryptography.utils import int_from_bytes Aug 31 15:38:13.948596 n-d-833090-16 devstack@n-api.service[112969]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 15:38:13.948596 n-d-833090-16 devstack@n-api.service[112969]: from cryptography.utils import int_from_bytes Aug 31 15:38:13.955833 n-d-833090-16 devstack@n-api.service[112970]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 15:38:13.955833 n-d-833090-16 devstack@n-api.service[112970]: from cryptography.utils import int_from_bytes Aug 31 15:38:13.956425 n-d-833090-16 devstack@n-api.service[112970]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 15:38:13.956425 n-d-833090-16 devstack@n-api.service[112970]: from cryptography.utils import int_from_bytes Aug 31 15:38:16.450453 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 15:38:16.451157 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 15:38:16.451256 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 15:38:16.451581 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 15:38:16.451849 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 15:38:16.452232 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.452558 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.452883 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.453204 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.453353 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 15:38:16.453723 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 15:38:16.453804 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.453804 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.453994 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 15:38:16.454189 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.454356 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 15:38:16.454457 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.454613 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 15:38:16.454758 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.455004 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.455110 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.455323 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.455417 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.455632 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.455733 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-833090-16 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.455944 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.456039 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.456245 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.456341 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.456539 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.456630 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.456849 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.456940 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.457149 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.457233 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.457471 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.457571 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.457725 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.457820 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.458032 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.458305 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.458420 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-833090-16 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.458674 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.458759 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.458973 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.459065 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.459275 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.459368 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.459637 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.459847 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.459940 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.460236 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.460396 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.460533 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.460719 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.461024 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.461131 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.461329 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.461427 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.461625 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.461715 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.461928 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.462019 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.462284 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.462373 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-833090-16 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.462592 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.462685 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.462895 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.463038 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.463206 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.463300 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.463506 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.463688 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.463824 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.464003 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.464123 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.464314 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.464521 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-833090-16 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.464667 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.464826 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.464949 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.465129 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.465259 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.465436 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.465588 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.465839 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.465960 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.466167 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.466257 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.466470 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.466567 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.466784 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.466870 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.467102 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.467187 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.467403 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.467488 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.467723 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.467818 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.468026 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.468119 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.468331 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.468417 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.468582 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.468668 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.468889 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.468985 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.469212 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.469297 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.469519 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.469611 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.469829 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.469915 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.470084 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.470185 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.470359 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.470455 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.470668 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.470752 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.470968 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.471054 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.471281 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.471373 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.471589 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.471680 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.471894 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.471979 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.472144 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.472230 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.472390 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.472475 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.472703 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.472798 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.473019 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.473153 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.473360 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.473506 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.473642 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.473794 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.473926 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.474070 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.474259 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.474391 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.474541 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.474715 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.474804 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.474974 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.475145 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.475605 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.475691 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.475951 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.476079 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.476266 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.476386 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.476587 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.476765 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.476894 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.477043 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.477208 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.477357 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.477602 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.477700 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.477851 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.477990 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.478176 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.478328 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.478512 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.478639 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.478832 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.478946 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.479136 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.479266 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.479447 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.479598 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.479763 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.479902 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.480067 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.480165 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.480363 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.480451 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.480661 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.480754 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.480973 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.481060 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.481296 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.481382 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.481592 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.481684 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.481840 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.481925 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.482155 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.482245 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.482455 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.482541 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.482766 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.482852 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.483069 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.483194 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.483369 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.483468 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.483666 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.483793 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.483955 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.484099 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.484252 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.484439 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.484538 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.484778 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.484912 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.485077 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.485163 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.485401 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.485491 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.485697 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.485783 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.485994 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.486078 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.486315 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.486407 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.486612 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.486731 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.486923 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.487068 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.487234 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.487391 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.487534 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.487696 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.487829 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.488031 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.488125 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.488387 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.488499 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.488698 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.488821 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.488994 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.489133 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.489291 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.489403 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.489604 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.489700 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.489899 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.489994 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.490217 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.490327 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.490529 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.490618 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.490943 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.491054 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.491243 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.491517 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.491605 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.491841 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.491932 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.492141 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.492241 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.492451 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.492549 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.492753 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.492837 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.493051 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.493150 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.493346 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.493440 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.493640 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.493736 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.493934 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.494034 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.494256 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.494389 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.494558 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.494743 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.494845 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.495073 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.495178 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.495380 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.495467 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.495689 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.495784 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.495996 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.496092 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.496308 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.496404 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.496602 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.496698 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.496914 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:38:16.497004 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.497247 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.497338 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.497573 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.497669 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.497916 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.498007 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.498250 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.498347 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.498580 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.498669 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.498893 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.498980 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.499203 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.499295 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.499509 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.499639 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.499814 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.499901 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.500128 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.500213 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.500435 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.500529 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.500742 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.500827 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.501046 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.501131 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.501361 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.501549 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.501675 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.501771 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.502005 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.502165 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.502340 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.502609 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.502702 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.502933 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.503027 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.503246 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.503337 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.503557 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.503659 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.503878 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.503964 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.504193 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.504286 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.504541 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.504634 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.504906 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.504999 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.505225 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.505324 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.505555 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.505658 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.505878 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.505963 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.506227 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.506424 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.506595 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.506779 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.506939 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.507194 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.507357 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.507504 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.507637 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.507821 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.507963 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.508188 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.508322 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.508504 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.508636 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.508808 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.508959 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.509130 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.509262 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.509431 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.509564 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.509733 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.509876 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.510013 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.510487 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.510713 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.510845 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.510993 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.511092 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.511346 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.511489 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.511658 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.511840 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.511935 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.512025 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.512286 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.512418 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.512589 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.512721 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.512901 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.513046 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.513204 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.513347 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.513481 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.513582 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.513785 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.513892 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.514086 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.514206 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.514404 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.514498 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.514705 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.514802 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.515008 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.515094 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.515306 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.515411 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.515625 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.515726 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.515947 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.516036 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.516249 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.516343 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.516583 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.516693 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.516888 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.516983 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.517539 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.517658 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.517740 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.517819 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.517886 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.517951 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.518143 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.518249 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.518403 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.518551 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.518709 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.518866 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.519008 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.519173 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.519327 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.519501 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.519628 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.519815 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.519934 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.520131 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.520254 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.520458 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.520544 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.520769 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.520878 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.521079 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.521166 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.521397 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.521483 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.521711 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.521804 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.522048 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.522161 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.522560 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.522648 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.522941 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.523042 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.523198 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.523369 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.523502 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.523685 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.523818 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.524001 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.524145 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.524348 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.524433 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.524684 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.524782 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.524989 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.525087 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.525328 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.525411 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.525648 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.525754 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.525947 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.526035 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.526269 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.526358 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.526564 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.526650 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.526861 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.527012 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.527163 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.527258 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.527457 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.527626 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.527752 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.527839 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.528047 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.528132 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.528342 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.528443 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.528635 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.528730 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.528937 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.529022 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.529235 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.529338 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.529536 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.529623 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.529837 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.529924 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.530153 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.530257 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.530461 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.530553 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.530766 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.530857 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.531103 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.531199 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.531405 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.531491 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.531728 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.531813 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.532048 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.532144 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.532353 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.532440 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.532663 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.532757 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.532967 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.533054 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.533272 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.533361 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.533574 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.533661 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.533878 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.533973 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.534213 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.534301 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.534518 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.534607 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.534830 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.534918 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.535132 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.535220 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.535448 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.535587 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.535763 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.535912 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.536074 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.536177 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.536375 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.536472 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.536683 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.536771 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.537131 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.537229 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.537310 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.537400 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.537682 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.537791 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.538128 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.538296 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.538438 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.538721 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.538812 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.539040 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.539123 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.539342 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.539438 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.539644 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.539737 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.539947 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.540041 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.540265 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.540360 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.540567 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.540652 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.540875 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.540966 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.541173 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.541266 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.541488 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.541574 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.541789 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.541876 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.542116 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.542222 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.542416 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.542503 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.542719 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.542804 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.543041 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.543135 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.543349 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.543434 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.543660 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.543746 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.543963 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.544053 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.544275 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.544361 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.544580 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.544666 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.544884 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.544971 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.545185 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.545271 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.545484 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.545583 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.545783 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.545917 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.546083 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.546213 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.546410 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.546496 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.546712 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.546797 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.547012 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.547097 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.547303 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.547402 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.547604 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.547690 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.547910 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.547995 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.548209 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.548312 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.548507 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.548592 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.548811 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.548902 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.549119 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.549213 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.549422 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.549505 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.549732 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.549815 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.550049 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.550170 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.550379 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.550465 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.550682 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.550767 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.551001 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.551197 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.551400 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.551483 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.551594 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.551707 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.551896 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.551984 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.552195 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.552287 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.552506 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.552591 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.552810 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.552896 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.553105 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.553217 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.553440 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.553556 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.553759 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.554062 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.554219 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.554388 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.554489 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.554692 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.554779 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.554994 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.555087 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.555307 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.555394 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.555613 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.555699 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.555917 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.556062 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.556217 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.556313 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.556521 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.556612 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.556821 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.556916 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.557123 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.557224 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.557438 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.557527 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.557737 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.557837 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.558040 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.558158 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.558367 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.558454 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.558663 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.558749 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.558966 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.559060 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.559274 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.559360 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.559582 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.559843 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.559929 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.560169 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.560263 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.560476 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.560563 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.560789 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.561054 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.561148 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.561391 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.561487 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.561705 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.561801 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.562026 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.562167 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.562362 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.562450 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.562662 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.562748 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.562965 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.563060 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.563262 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.563361 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.563559 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.563645 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.563868 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.563961 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.564167 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.564262 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.564465 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.564552 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.564762 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.564848 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.565070 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.565157 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.565366 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.565453 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.565662 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.565753 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.565961 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.566125 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.566287 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.566387 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.566580 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.566667 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.566877 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.566954 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.567178 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.567253 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.567477 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.567565 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.567789 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.567866 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.568095 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.568170 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.568389 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.568475 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.568787 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.568950 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.569049 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.569132 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.569346 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.569651 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.569762 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.569973 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.570069 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.570320 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.570413 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.570625 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.570720 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.570933 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.571027 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.571231 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.571318 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.571546 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.571640 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.571847 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.571936 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.572143 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.572240 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.572438 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.572524 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.572738 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.572824 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.573036 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.573131 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.573333 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.573420 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.573637 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.573723 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.573938 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.574051 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.574263 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.574363 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.574566 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.574653 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.574862 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.574958 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.575164 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.575250 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.575461 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.575547 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.575768 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.575855 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.576067 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.576153 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.576365 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.576521 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.576680 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.576815 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.576945 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.577076 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.577236 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.577380 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.577529 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.577659 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.577819 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.577906 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.578131 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.578221 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.578443 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.578538 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.578738 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.578824 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.579032 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.579132 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.579325 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.579411 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.579627 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.579713 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.579925 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.580096 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.580219 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.580305 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.580525 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.580610 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.580824 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.580918 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.581120 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.581213 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.581414 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.581500 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.581714 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.581812 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.582011 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.582119 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.582334 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.582529 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.582633 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.582722 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.582932 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.583021 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.583238 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.583326 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.583533 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.583620 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.583834 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.583919 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.584140 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.584238 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.584421 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.584514 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.585011 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.585150 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.585396 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.585492 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.585582 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.585697 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.585784 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.585990 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.586084 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.586314 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.586405 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.586612 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.586715 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.586918 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.587004 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.587217 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.587303 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.587514 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.587600 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.587813 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.587914 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.588108 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.588203 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.588411 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.588559 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.588726 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.588817 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.589034 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.589120 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.589338 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.589424 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.589645 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.589744 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.589949 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.590036 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.590279 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.590365 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.590585 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.590681 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.590891 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.590976 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.591189 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.591275 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.591499 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.591593 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.591808 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.591894 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.592112 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.592199 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.592410 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.592505 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.592707 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.592793 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.593022 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.593108 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.593327 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.593414 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.593628 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.593714 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.593942 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.594028 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.594304 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.594397 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.594611 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.594699 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.594908 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.594993 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.595211 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.595305 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.595513 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.595600 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.595812 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.595905 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.596115 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.596202 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.596416 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.596505 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.596718 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.596812 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.597021 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.597109 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.597325 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.597411 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.597626 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.597720 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.597957 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.598225 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.598323 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.598405 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.598541 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.598638 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.598841 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.598928 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.599139 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.599226 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.599447 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.599541 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.599747 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.599841 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.600047 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.600179 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.600423 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.600704 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.600799 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.601141 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.601226 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.601456 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.601550 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.601787 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.601902 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.602135 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.602255 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.602448 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.602563 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.602761 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.602858 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.603069 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.603165 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.603384 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.603489 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.603690 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.603793 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.603994 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.604126 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.604309 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.604443 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.604702 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.604810 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.605008 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.605109 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.605343 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.605433 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.605658 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.605756 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.605975 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.606073 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.606307 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.606419 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.606730 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.606834 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.606904 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.607112 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.609553 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.609642 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.609714 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.609782 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.609858 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.609927 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.610008 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.610083 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.610179 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.610245 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.610326 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.610493 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.610586 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.610668 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.610754 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.610842 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.610931 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.611021 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.611021 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.611167 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.611246 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.611324 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.611402 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.611493 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.611587 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.611668 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.611668 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.611829 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.611909 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.612005 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.612086 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.612165 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.612267 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.612359 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.612441 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.612600 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.612737 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.612911 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.613007 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.613234 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.613322 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.613600 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.613890 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.613890 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.614191 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.614191 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.614334 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.614503 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.614608 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.614814 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.614900 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.615131 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.615226 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.615450 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.615552 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.615793 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.615943 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.616304 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.616391 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.616702 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.616924 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.617019 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.617089 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.617232 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.617351 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.617530 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.617667 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.617836 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.618017 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.618196 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.618447 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.618553 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.618774 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.618863 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.619074 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.619163 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.619382 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.619749 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.619846 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.619917 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.619992 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.620062 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.620268 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.620366 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.620565 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.620653 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.620884 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.620971 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.621175 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.621262 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.621498 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.621585 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.621805 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.621892 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.622153 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.622259 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.622447 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.622536 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.622744 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.622830 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.623050 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.623136 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.623350 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.623436 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.623649 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.623736 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.624398 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.624497 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.624584 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.624664 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.624758 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.624841 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.624921 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.625007 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.625139 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.625228 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.625464 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.625554 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.625783 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.625869 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.626086 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.626230 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.626415 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.626503 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.626723 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.626812 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.627029 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.627128 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.627335 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.627423 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.627654 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.627741 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.627951 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.628051 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.628247 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.628338 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.628549 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.628636 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.628847 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.628944 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.629144 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.629230 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.629442 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.629529 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.629777 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.629889 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.630035 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.630152 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.630355 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.630493 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.630650 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.630799 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.630971 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.631102 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.631271 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.631644 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.631766 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.631946 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.632184 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.632275 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.632505 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.632592 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.632813 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.632909 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.633123 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.633211 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.633431 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.633516 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.633725 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.633819 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.634028 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.634151 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.634370 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.634457 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.634677 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.634780 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.634991 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.635077 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.635670 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.635768 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.635972 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.636058 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.636278 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.636365 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.636586 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.636692 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.636883 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.636970 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.637188 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.637287 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.637493 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.637591 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.637798 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.637887 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.638120 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.638222 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.638455 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.638668 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.638757 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.638998 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.639086 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.639304 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.639400 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.639610 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.639704 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.639917 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.640014 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.640224 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.640321 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.640531 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.640617 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.640835 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.640923 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.641158 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.641631 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.641789 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.642007 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.642155 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.642428 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.642532 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.642758 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.642864 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.643145 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.643252 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.643488 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.643613 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.643806 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.643933 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.644357 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.644491 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.644736 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.644851 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.645139 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.645386 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.645467 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.645536 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.645791 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.645883 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.646185 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.646290 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.646527 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.646623 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.646880 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.647073 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.647268 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.647424 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.647578 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.647910 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.648065 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.648388 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.648517 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.648691 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.648784 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.648999 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.649089 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.649305 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.649400 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.649613 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.649720 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.650000 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.650118 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.650288 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.650402 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.650581 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.650684 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.650909 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.651007 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.651225 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.651313 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.651532 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.651721 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.651865 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.651953 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.652141 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.652229 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.652490 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.652669 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.652804 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.652982 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.653122 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.653320 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.653425 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.653645 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.653733 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.653964 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.654076 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.654304 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.654439 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.654620 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.654748 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.654943 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.655041 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.655245 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.655342 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.655546 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.655854 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.655946 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.656146 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.656234 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.656443 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.656570 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.656764 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.656851 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.657069 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.657164 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.657376 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.657497 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.657697 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.657803 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.658000 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.658122 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.658396 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.658575 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.658692 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.658894 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.658992 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.659206 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.659299 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.659524 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.659613 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.659847 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.659970 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.660165 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.660276 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.660473 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.660577 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.660795 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.660901 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.661099 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.661194 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.661398 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.661669 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.661763 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.662005 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.662118 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.662333 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.662464 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.662754 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.662892 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.663189 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.663349 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.663613 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.663703 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.663991 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.664092 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.664319 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.664455 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.664629 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.664895 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.664982 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.665240 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.665364 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.665553 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.665800 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.665886 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.666184 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.666285 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.666500 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.666587 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.666809 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.666901 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.667111 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.667205 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.667411 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.667497 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.667713 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.667808 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.668010 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.668156 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.668317 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.668429 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.668615 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.668728 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.668915 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.669027 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.669212 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.669288 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.669517 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.669593 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.669815 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.669891 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.670133 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.670226 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.670443 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.670529 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.670753 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.670874 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.671057 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.671134 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.671356 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.671431 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.671661 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.671737 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.671967 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.672042 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.672268 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.672352 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.672572 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.672647 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.672877 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.672952 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.673215 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.673300 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.673524 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.673599 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.673826 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.674133 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.674223 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.674434 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.674520 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.674716 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.674802 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.675042 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.675124 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.675364 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.675449 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.675664 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.675741 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.675963 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.676047 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.676262 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.676537 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.676621 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.676867 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.676942 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.677170 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.677253 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.677473 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.677549 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.677776 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.677852 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.678077 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.678217 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.678445 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.678541 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.678747 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.679015 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.679092 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.679337 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.679412 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.679675 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.680257 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.680438 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.680527 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.680609 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.680689 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.680778 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.680861 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.680956 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.681039 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.681127 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.681210 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.681421 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.681525 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.681728 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.681828 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.682071 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.682277 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.682375 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.682474 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.682700 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.682836 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.683005 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.683139 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.683303 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.683452 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.683584 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.683695 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.683909 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.684045 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.684223 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.684377 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.684516 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.684619 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.684845 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.684997 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.685102 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.685189 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.685460 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.685594 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.685768 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.685903 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.686080 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.686256 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.686408 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.686512 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.686711 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.686805 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.687024 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.687118 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.687355 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.687450 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.687672 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.687779 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.687975 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.688069 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.688305 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.688398 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.688627 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.688737 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.688959 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.689053 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.689281 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.689382 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.689624 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.689743 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.689891 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.689985 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.690198 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.690314 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.690517 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.690612 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.690857 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.691004 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.691142 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.691496 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.691601 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.691829 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.692047 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.692142 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.692473 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.692566 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.692780 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.693046 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.693137 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.693356 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.693577 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.693677 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.694030 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.694219 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.694590 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.694738 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.695067 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.695221 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.695378 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.695694 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.695800 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.696002 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.696218 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.696316 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.696598 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.696738 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.696901 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.697209 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.697295 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.697510 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.697755 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.697842 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.698110 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.698301 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.698428 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.698729 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.698821 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.699030 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.699318 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.699408 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.699670 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.699889 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.699980 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.700217 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.700419 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.700558 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.700809 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.700898 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.701150 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.701369 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.701488 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.701802 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.702000 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.702159 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.702338 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.702476 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.702680 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.702829 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.703015 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.703140 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.703332 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.703462 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.703654 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.703782 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.703965 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.704099 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.704286 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.704393 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.704593 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.704730 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.704911 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.705040 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.705227 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.705351 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.705538 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.705660 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.705841 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.705973 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.706190 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.706294 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.706604 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.706695 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.706912 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.706998 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.707221 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.707313 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.707654 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.707745 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.707814 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.707900 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.708104 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.708201 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.708430 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.708518 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.708754 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.708842 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.709058 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.709156 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.709381 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.709493 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.709735 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.710036 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.710138 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.710370 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.710530 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.710675 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.710848 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.710998 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.711163 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.711334 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.711484 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.711594 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.711803 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.711890 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.712115 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.712204 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.712428 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.712515 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.712746 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.712833 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.713062 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.713157 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.713363 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.713449 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.713672 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.713760 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.713982 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.714069 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.714329 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.714425 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.714651 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.714745 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.714952 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.715039 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.715271 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.715357 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.715592 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.715687 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.715946 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.716174 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.716262 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.716483 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.716571 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.716822 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.716910 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.717084 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 15:38:16.717171 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.717440 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.717746 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.718044 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:38:16.718307 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 15:38:16.877564 n-d-833090-16 devstack@n-api.service[112970]: INFO dbcounter [None req-8ff643dd-7525-4000-ae0c-181b151ad529 None None] Registered counter for database nova_api Aug 31 15:38:16.883132 n-d-833090-16 devstack@n-api.service[112969]: INFO dbcounter [None req-909add8c-9883-496d-b9ed-9a3cf9709695 None None] Registered counter for database nova_api Aug 31 15:38:16.899942 n-d-833090-16 devstack@n-api.service[112970]: DEBUG oslo_db.sqlalchemy.engines [None req-8ff643dd-7525-4000-ae0c-181b151ad529 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112970) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 15:38:16.903182 n-d-833090-16 devstack@n-api.service[112969]: DEBUG oslo_db.sqlalchemy.engines [None req-909add8c-9883-496d-b9ed-9a3cf9709695 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112969) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 15:38:16.907028 n-d-833090-16 devstack@n-api.service[112970]: DEBUG dbcounter [-] [112970] Writer thread running {{(pid=112970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 15:38:16.909745 n-d-833090-16 devstack@n-api.service[112969]: DEBUG dbcounter [-] [112969] Writer thread running {{(pid=112969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 15:38:16.965541 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.context [None req-8ff643dd-7525-4000-ae0c-181b151ad529 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ff6ab154-5f51-4e0d-922a-904eb5aa20da(cell1) {{(pid=112970) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 15:38:16.969152 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.context [None req-909add8c-9883-496d-b9ed-9a3cf9709695 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ff6ab154-5f51-4e0d-922a-904eb5aa20da(cell1) {{(pid=112969) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 15:38:16.969700 n-d-833090-16 devstack@n-api.service[112970]: DEBUG oslo_concurrency.lockutils [None req-8ff643dd-7525-4000-ae0c-181b151ad529 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:38:16.970199 n-d-833090-16 devstack@n-api.service[112970]: DEBUG oslo_concurrency.lockutils [None req-8ff643dd-7525-4000-ae0c-181b151ad529 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:38:16.971804 n-d-833090-16 devstack@n-api.service[112970]: DEBUG oslo_concurrency.lockutils [None req-8ff643dd-7525-4000-ae0c-181b151ad529 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:38:16.972548 n-d-833090-16 devstack@n-api.service[112970]: DEBUG oslo_concurrency.lockutils [None req-8ff643dd-7525-4000-ae0c-181b151ad529 None None] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:38:16.972991 n-d-833090-16 devstack@n-api.service[112970]: DEBUG oslo_concurrency.lockutils [None req-8ff643dd-7525-4000-ae0c-181b151ad529 None None] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:38:16.973090 n-d-833090-16 devstack@n-api.service[112969]: DEBUG oslo_concurrency.lockutils [None req-909add8c-9883-496d-b9ed-9a3cf9709695 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:38:16.973463 n-d-833090-16 devstack@n-api.service[112969]: DEBUG oslo_concurrency.lockutils [None req-909add8c-9883-496d-b9ed-9a3cf9709695 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:38:16.975030 n-d-833090-16 devstack@n-api.service[112970]: DEBUG oslo_concurrency.lockutils [None req-8ff643dd-7525-4000-ae0c-181b151ad529 None None] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:38:16.975162 n-d-833090-16 devstack@n-api.service[112969]: DEBUG oslo_concurrency.lockutils [None req-909add8c-9883-496d-b9ed-9a3cf9709695 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:38:16.976308 n-d-833090-16 devstack@n-api.service[112969]: DEBUG oslo_concurrency.lockutils [None req-909add8c-9883-496d-b9ed-9a3cf9709695 None None] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:38:16.976752 n-d-833090-16 devstack@n-api.service[112969]: DEBUG oslo_concurrency.lockutils [None req-909add8c-9883-496d-b9ed-9a3cf9709695 None None] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:38:16.978065 n-d-833090-16 devstack@n-api.service[112970]: INFO dbcounter [None req-8ff643dd-7525-4000-ae0c-181b151ad529 None None] Registered counter for database nova_cell0 Aug 31 15:38:16.978747 n-d-833090-16 devstack@n-api.service[112969]: DEBUG oslo_concurrency.lockutils [None req-909add8c-9883-496d-b9ed-9a3cf9709695 None None] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:38:16.980715 n-d-833090-16 devstack@n-api.service[112969]: INFO dbcounter [None req-909add8c-9883-496d-b9ed-9a3cf9709695 None None] Registered counter for database nova_cell0 Aug 31 15:38:16.982236 n-d-833090-16 devstack@n-api.service[112970]: INFO dbcounter [None req-8ff643dd-7525-4000-ae0c-181b151ad529 None None] Registered counter for database nova_cell1 Aug 31 15:38:16.984685 n-d-833090-16 devstack@n-api.service[112969]: INFO dbcounter [None req-909add8c-9883-496d-b9ed-9a3cf9709695 None None] Registered counter for database nova_cell1 Aug 31 15:38:16.990128 n-d-833090-16 devstack@n-api.service[112970]: DEBUG oslo_db.sqlalchemy.engines [None req-8ff643dd-7525-4000-ae0c-181b151ad529 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112970) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 15:38:16.992078 n-d-833090-16 devstack@n-api.service[112969]: DEBUG oslo_db.sqlalchemy.engines [None req-909add8c-9883-496d-b9ed-9a3cf9709695 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112969) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 15:38:16.993795 n-d-833090-16 devstack@n-api.service[112970]: DEBUG oslo_db.sqlalchemy.engines [None req-8ff643dd-7525-4000-ae0c-181b151ad529 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112970) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 15:38:16.997146 n-d-833090-16 devstack@n-api.service[112969]: DEBUG dbcounter [-] [112969] Writer thread running {{(pid=112969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 15:38:16.997761 n-d-833090-16 devstack@n-api.service[112969]: DEBUG oslo_db.sqlalchemy.engines [None req-909add8c-9883-496d-b9ed-9a3cf9709695 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112969) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 15:38:17.000751 n-d-833090-16 devstack@n-api.service[112970]: DEBUG dbcounter [-] [112970] Writer thread running {{(pid=112970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 15:38:17.002229 n-d-833090-16 devstack@n-api.service[112970]: DEBUG dbcounter [-] [112970] Writer thread running {{(pid=112970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 15:38:17.147449 n-d-833090-16 devstack@n-api.service[112969]: DEBUG dbcounter [-] [112969] Writer thread running {{(pid=112969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 15:38:17.155661 n-d-833090-16 devstack@n-api.service[112970]: INFO dbcounter [None req-8ff643dd-7525-4000-ae0c-181b151ad529 None None] Registered counter for database nova_cell0 Aug 31 15:38:17.156817 n-d-833090-16 devstack@n-api.service[112969]: INFO dbcounter [None req-909add8c-9883-496d-b9ed-9a3cf9709695 None None] Registered counter for database nova_cell0 Aug 31 15:38:17.164264 n-d-833090-16 devstack@n-api.service[112970]: DEBUG oslo_db.sqlalchemy.engines [None req-8ff643dd-7525-4000-ae0c-181b151ad529 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112970) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 15:38:17.166151 n-d-833090-16 devstack@n-api.service[112969]: DEBUG oslo_db.sqlalchemy.engines [None req-909add8c-9883-496d-b9ed-9a3cf9709695 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112969) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 15:38:17.169919 n-d-833090-16 devstack@n-api.service[112970]: DEBUG dbcounter [-] [112970] Writer thread running {{(pid=112970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 15:38:17.172293 n-d-833090-16 devstack@n-api.service[112969]: DEBUG dbcounter [-] [112969] Writer thread running {{(pid=112969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 15:38:17.506665 n-d-833090-16 devstack@n-api.service[112970]: WARNING keystonemiddleware.auth_token [None req-8ff643dd-7525-4000-ae0c-181b151ad529 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 15:38:17.509740 n-d-833090-16 devstack@n-api.service[112969]: WARNING keystonemiddleware.auth_token [None req-909add8c-9883-496d-b9ed-9a3cf9709695 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 15:38:17.514634 n-d-833090-16 devstack@n-api.service[112970]: WARNING keystonemiddleware.auth_token [None req-8ff643dd-7525-4000-ae0c-181b151ad529 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 15:38:17.517625 n-d-833090-16 devstack@n-api.service[112969]: WARNING keystonemiddleware.auth_token [None req-909add8c-9883-496d-b9ed-9a3cf9709695 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 15:38:17.859568 n-d-833090-16 devstack@n-api.service[112970]: WARNING keystonemiddleware.auth_token [None req-8ff643dd-7525-4000-ae0c-181b151ad529 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 15:38:17.865202 n-d-833090-16 devstack@n-api.service[112969]: WARNING keystonemiddleware.auth_token [None req-909add8c-9883-496d-b9ed-9a3cf9709695 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 15:38:17.865632 n-d-833090-16 devstack@n-api.service[112970]: WARNING keystonemiddleware.auth_token [None req-8ff643dd-7525-4000-ae0c-181b151ad529 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 15:38:17.870895 n-d-833090-16 devstack@n-api.service[112970]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5591849469c0 pid: 112970 (default app) Aug 31 15:38:17.871551 n-d-833090-16 devstack@n-api.service[112969]: WARNING keystonemiddleware.auth_token [None req-909add8c-9883-496d-b9ed-9a3cf9709695 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 15:38:17.873030 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi [None req-8ff643dd-7525-4000-ae0c-181b151ad529 None None] Calling method '>' {{(pid=112970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:38:17.874246 n-d-833090-16 devstack@n-api.service[112970]: INFO nova.api.openstack.requestlog [None req-8ff643dd-7525-4000-ae0c-181b151ad529 None None] 10.222.0.50 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001776 Aug 31 15:38:17.874657 n-d-833090-16 devstack@n-api.service[112970]: [pid: 112970|app: 0|req: 1/1] 10.222.0.50 () {50 vars in 788 bytes} [Wed Aug 31 15:38:17 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:38:17.876670 n-d-833090-16 devstack@n-api.service[112969]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5591849469c0 pid: 112969 (default app) Aug 31 15:39:37.923461 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi [None req-8ff643dd-7525-4000-ae0c-181b151ad529 None None] Calling method '>' {{(pid=112970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:39:37.924615 n-d-833090-16 devstack@n-api.service[112970]: INFO nova.api.openstack.requestlog [None req-8ff643dd-7525-4000-ae0c-181b151ad529 None None] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Aug 31 15:39:37.925479 n-d-833090-16 devstack@n-api.service[112970]: [pid: 112970|app: 0|req: 2/2] 10.222.0.50 () {54 vars in 931 bytes} [Wed Aug 31 15:39:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:39:37.938250 n-d-833090-16 devstack@n-api.service[112969]: DEBUG dbcounter [-] [112969] Writing DB stats nova_api:SELECT=3 {{(pid=112969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:39:37.939387 n-d-833090-16 devstack@n-api.service[112969]: DEBUG dbcounter [-] [112969] Writing DB stats nova_cell0:SELECT=3 {{(pid=112969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:39:37.940344 n-d-833090-16 devstack@n-api.service[112969]: DEBUG dbcounter [-] [112969] Writing DB stats nova_cell1:SELECT=3 {{(pid=112969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:39:37.941323 n-d-833090-16 devstack@n-api.service[112969]: DEBUG dbcounter [-] [112969] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:39:38.827416 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi [None req-76caf353-041e-4c06-b023-997d26ef0aab admin admin] Calling method '>' {{(pid=112969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:39:38.859661 n-d-833090-16 devstack@n-api.service[112969]: INFO nova.api.openstack.requestlog [None req-76caf353-041e-4c06-b023-997d26ef0aab admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.927118 Aug 31 15:39:38.862250 n-d-833090-16 devstack@n-api.service[112969]: [pid: 112969|app: 0|req: 1/3] 10.222.0.50 () {60 vars in 1292 bytes} [Wed Aug 31 15:39:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:39:41.250741 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi [None req-8ff643dd-7525-4000-ae0c-181b151ad529 None None] Calling method '>' {{(pid=112970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:39:41.251613 n-d-833090-16 devstack@n-api.service[112970]: INFO nova.api.openstack.requestlog [None req-8ff643dd-7525-4000-ae0c-181b151ad529 None None] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Aug 31 15:39:41.252106 n-d-833090-16 devstack@n-api.service[112970]: [pid: 112970|app: 0|req: 3/4] 10.222.0.50 () {54 vars in 931 bytes} [Wed Aug 31 15:39:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:39:41.697923 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi [None req-2e7fe14e-b3ce-4f97-baa9-a326f2b35b27 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "id": "c1", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "cirros256"}} {{(pid=112969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:39:41.747681 n-d-833090-16 devstack@n-api.service[112969]: INFO nova.api.openstack.requestlog [None req-2e7fe14e-b3ce-4f97-baa9-a326f2b35b27 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.483389 Aug 31 15:39:41.748618 n-d-833090-16 devstack@n-api.service[112969]: [pid: 112969|app: 0|req: 2/5] 10.222.0.50 () {64 vars in 1283 bytes} [Wed Aug 31 15:39:41 2022] POST /compute/v2.1/flavors => generated 407 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:39:41.763436 n-d-833090-16 devstack@n-api.service[112970]: DEBUG dbcounter [-] [112970] Writing DB stats nova_api:SELECT=3 {{(pid=112970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:39:41.764308 n-d-833090-16 devstack@n-api.service[112970]: DEBUG dbcounter [-] [112970] Writing DB stats nova_cell1:SELECT=3 {{(pid=112970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:39:41.765085 n-d-833090-16 devstack@n-api.service[112970]: DEBUG dbcounter [-] [112970] Writing DB stats nova_cell0:SELECT=3 {{(pid=112970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:39:41.766269 n-d-833090-16 devstack@n-api.service[112970]: DEBUG dbcounter [-] [112970] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:39:41.971905 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi [None req-8a8c1f95-6986-4c38-b337-c0561b8d03f5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:39:42.037672 n-d-833090-16 devstack@n-api.service[112970]: INFO nova.api.openstack.requestlog [None req-8a8c1f95-6986-4c38-b337-c0561b8d03f5 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.280001 Aug 31 15:39:42.038290 n-d-833090-16 devstack@n-api.service[112970]: [pid: 112970|app: 0|req: 4/6] 10.222.0.50 () {64 vars in 1336 bytes} [Wed Aug 31 15:39:41 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:39:44.436000 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi [None req-2e7fe14e-b3ce-4f97-baa9-a326f2b35b27 admin admin] Calling method '>' {{(pid=112969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:39:44.437124 n-d-833090-16 devstack@n-api.service[112969]: INFO nova.api.openstack.requestlog [None req-2e7fe14e-b3ce-4f97-baa9-a326f2b35b27 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001596 Aug 31 15:39:44.437836 n-d-833090-16 devstack@n-api.service[112969]: [pid: 112969|app: 0|req: 3/7] 10.222.0.50 () {54 vars in 931 bytes} [Wed Aug 31 15:39:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:39:45.165886 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi [None req-78bffba2-2161-4b5d-8a6f-a046d2dc3960 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "id": "d1", "disk": 5, "ram": 512}} {{(pid=112970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:39:45.208638 n-d-833090-16 devstack@n-api.service[112970]: INFO nova.api.openstack.requestlog [None req-78bffba2-2161-4b5d-8a6f-a046d2dc3960 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.763862 Aug 31 15:39:45.209954 n-d-833090-16 devstack@n-api.service[112970]: [pid: 112970|app: 0|req: 5/8] 10.222.0.50 () {64 vars in 1283 bytes} [Wed Aug 31 15:39:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 15:39:45.222025 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi [None req-82b9d56a-5031-4285-bd41-3aec75a65889 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:39:45.260747 n-d-833090-16 devstack@n-api.service[112969]: INFO nova.api.openstack.requestlog [None req-82b9d56a-5031-4285-bd41-3aec75a65889 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042761 Aug 31 15:39:45.261453 n-d-833090-16 devstack@n-api.service[112969]: [pid: 112969|app: 0|req: 4/9] 10.222.0.50 () {64 vars in 1336 bytes} [Wed Aug 31 15:39:45 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:39:47.862728 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi [None req-78bffba2-2161-4b5d-8a6f-a046d2dc3960 admin admin] Calling method '>' {{(pid=112970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:39:47.864448 n-d-833090-16 devstack@n-api.service[112970]: INFO nova.api.openstack.requestlog [None req-78bffba2-2161-4b5d-8a6f-a046d2dc3960 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002275 Aug 31 15:39:47.865626 n-d-833090-16 devstack@n-api.service[112970]: [pid: 112970|app: 0|req: 6/10] 10.222.0.50 () {54 vars in 931 bytes} [Wed Aug 31 15:39:47 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:39:48.350318 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi [None req-4d45a760-54df-4a30-a268-e5ef82497947 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "swap": 0, "vcpus": 1, "ram": 1024, "id": "d2", "disk": 10}} {{(pid=112969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:39:48.373945 n-d-833090-16 devstack@n-api.service[112969]: INFO nova.api.openstack.requestlog [None req-4d45a760-54df-4a30-a268-e5ef82497947 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.500886 Aug 31 15:39:48.383526 n-d-833090-16 devstack@n-api.service[112969]: [pid: 112969|app: 0|req: 5/11] 10.222.0.50 () {64 vars in 1283 bytes} [Wed Aug 31 15:39:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:39:48.389385 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi [None req-49c2bf7d-5c7e-45a8-99dc-205a1360e3d0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:39:48.425688 n-d-833090-16 devstack@n-api.service[112970]: INFO nova.api.openstack.requestlog [None req-49c2bf7d-5c7e-45a8-99dc-205a1360e3d0 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040432 Aug 31 15:39:48.435012 n-d-833090-16 devstack@n-api.service[112970]: [pid: 112970|app: 0|req: 7/12] 10.222.0.50 () {64 vars in 1336 bytes} [Wed Aug 31 15:39:48 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:39:50.944639 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi [None req-4d45a760-54df-4a30-a268-e5ef82497947 admin admin] Calling method '>' {{(pid=112969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:39:50.945649 n-d-833090-16 devstack@n-api.service[112969]: INFO nova.api.openstack.requestlog [None req-4d45a760-54df-4a30-a268-e5ef82497947 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Aug 31 15:39:50.946245 n-d-833090-16 devstack@n-api.service[112969]: [pid: 112969|app: 0|req: 6/13] 10.222.0.50 () {54 vars in 931 bytes} [Wed Aug 31 15:39:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:39:51.429855 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi [None req-a0fbfcd7-01e6-4974-91c8-7f334117d166 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "id": "d3", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "swap": 0, "os-flavor-access:is_public": true, "name": "ds2G", "rxtx_factor": 1.0}} {{(pid=112970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:39:51.449841 n-d-833090-16 devstack@n-api.service[112970]: INFO nova.api.openstack.requestlog [None req-a0fbfcd7-01e6-4974-91c8-7f334117d166 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.497376 Aug 31 15:39:51.450413 n-d-833090-16 devstack@n-api.service[112970]: [pid: 112970|app: 0|req: 8/14] 10.222.0.50 () {64 vars in 1283 bytes} [Wed Aug 31 15:39:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:39:51.462671 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi [None req-356f857c-e667-4391-8ebb-919326731ba3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:39:51.501932 n-d-833090-16 devstack@n-api.service[112969]: INFO nova.api.openstack.requestlog [None req-356f857c-e667-4391-8ebb-919326731ba3 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041513 Aug 31 15:39:51.510645 n-d-833090-16 devstack@n-api.service[112969]: [pid: 112969|app: 0|req: 7/15] 10.222.0.50 () {64 vars in 1336 bytes} [Wed Aug 31 15:39:51 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:39:53.907694 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi [None req-a0fbfcd7-01e6-4974-91c8-7f334117d166 admin admin] Calling method '>' {{(pid=112970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:39:53.908825 n-d-833090-16 devstack@n-api.service[112970]: INFO nova.api.openstack.requestlog [None req-a0fbfcd7-01e6-4974-91c8-7f334117d166 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001737 Aug 31 15:39:53.909219 n-d-833090-16 devstack@n-api.service[112970]: [pid: 112970|app: 0|req: 9/16] 10.222.0.50 () {54 vars in 931 bytes} [Wed Aug 31 15:39:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:39:54.388203 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi [None req-ccbaa552-6d1d-4940-8cc3-dab2cde0bfc6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds4G", "vcpus": 4, "id": "d4", "ram": 4096, "os-flavor-access:is_public": true, "disk": 20, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=112969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:39:54.420484 n-d-833090-16 devstack@n-api.service[112969]: INFO nova.api.openstack.requestlog [None req-ccbaa552-6d1d-4940-8cc3-dab2cde0bfc6 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.504701 Aug 31 15:39:54.421193 n-d-833090-16 devstack@n-api.service[112969]: [pid: 112969|app: 0|req: 8/17] 10.222.0.50 () {64 vars in 1283 bytes} [Wed Aug 31 15:39:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 15:39:54.434852 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi [None req-134529b3-b810-4d03-b063-102850f90e79 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:39:54.475935 n-d-833090-16 devstack@n-api.service[112970]: INFO nova.api.openstack.requestlog [None req-134529b3-b810-4d03-b063-102850f90e79 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045051 Aug 31 15:39:54.482855 n-d-833090-16 devstack@n-api.service[112970]: [pid: 112970|app: 0|req: 10/18] 10.222.0.50 () {64 vars in 1336 bytes} [Wed Aug 31 15:39:54 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:39:57.020731 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi [None req-ccbaa552-6d1d-4940-8cc3-dab2cde0bfc6 admin admin] Calling method '>' {{(pid=112969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:39:57.022542 n-d-833090-16 devstack@n-api.service[112969]: INFO nova.api.openstack.requestlog [None req-ccbaa552-6d1d-4940-8cc3-dab2cde0bfc6 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002185 Aug 31 15:39:57.033911 n-d-833090-16 devstack@n-api.service[112969]: [pid: 112969|app: 0|req: 9/19] 10.222.0.50 () {54 vars in 931 bytes} [Wed Aug 31 15:39:57 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:39:57.489507 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi [None req-0300191f-b997-4a1f-afe0-5003c4d2573c admin admin] Calling method '>' {{(pid=112970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:39:57.516224 n-d-833090-16 devstack@n-api.service[112970]: INFO nova.api.openstack.requestlog [None req-0300191f-b997-4a1f-afe0-5003c4d2573c admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.486744 Aug 31 15:39:57.517127 n-d-833090-16 devstack@n-api.service[112970]: [pid: 112970|app: 0|req: 11/20] 10.222.0.50 () {60 vars in 1292 bytes} [Wed Aug 31 15:39:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 15:40:00.101373 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi [None req-ccbaa552-6d1d-4940-8cc3-dab2cde0bfc6 admin admin] Calling method '>' {{(pid=112969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:40:00.102382 n-d-833090-16 devstack@n-api.service[112969]: INFO nova.api.openstack.requestlog [None req-ccbaa552-6d1d-4940-8cc3-dab2cde0bfc6 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001615 Aug 31 15:40:00.102829 n-d-833090-16 devstack@n-api.service[112969]: [pid: 112969|app: 0|req: 10/21] 10.222.0.50 () {54 vars in 931 bytes} [Wed Aug 31 15:40:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:40:00.585131 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi [None req-31e71144-636a-40a6-9b66-0252740d9dd8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 1, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "swap": 0, "rxtx_factor": 1.0, "id": "1", "name": "m1.tiny"}} {{(pid=112970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:40:00.607237 n-d-833090-16 devstack@n-api.service[112970]: INFO nova.api.openstack.requestlog [None req-31e71144-636a-40a6-9b66-0252740d9dd8 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.498013 Aug 31 15:40:00.608031 n-d-833090-16 devstack@n-api.service[112970]: [pid: 112970|app: 0|req: 12/22] 10.222.0.50 () {64 vars in 1283 bytes} [Wed Aug 31 15:40:00 2022] POST /compute/v2.1/flavors => generated 402 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:40:00.620221 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi [None req-5b0388f0-47f7-4191-957f-eb26d608fa0c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:40:00.648117 n-d-833090-16 devstack@n-api.service[112969]: INFO nova.api.openstack.requestlog [None req-5b0388f0-47f7-4191-957f-eb26d608fa0c admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031687 Aug 31 15:40:00.648723 n-d-833090-16 devstack@n-api.service[112969]: [pid: 112969|app: 0|req: 11/23] 10.222.0.50 () {64 vars in 1333 bytes} [Wed Aug 31 15:40:00 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:40:03.053812 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi [None req-31e71144-636a-40a6-9b66-0252740d9dd8 admin admin] Calling method '>' {{(pid=112970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:40:03.054898 n-d-833090-16 devstack@n-api.service[112970]: INFO nova.api.openstack.requestlog [None req-31e71144-636a-40a6-9b66-0252740d9dd8 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001637 Aug 31 15:40:03.055287 n-d-833090-16 devstack@n-api.service[112970]: [pid: 112970|app: 0|req: 13/24] 10.222.0.50 () {54 vars in 931 bytes} [Wed Aug 31 15:40:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:40:03.587608 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi [None req-f23ea515-510e-4781-a51e-74701a35f8af admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "vcpus": 1, "name": "m1.small"}} {{(pid=112969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:40:03.603954 n-d-833090-16 devstack@n-api.service[112969]: INFO nova.api.openstack.requestlog [None req-f23ea515-510e-4781-a51e-74701a35f8af admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.541785 Aug 31 15:40:03.604571 n-d-833090-16 devstack@n-api.service[112969]: [pid: 112969|app: 0|req: 12/25] 10.222.0.50 () {64 vars in 1283 bytes} [Wed Aug 31 15:40:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:40:03.620424 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi [None req-c50cc5bb-5951-47e6-8a7c-29a1a85adff5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:40:03.663843 n-d-833090-16 devstack@n-api.service[112970]: INFO nova.api.openstack.requestlog [None req-c50cc5bb-5951-47e6-8a7c-29a1a85adff5 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047014 Aug 31 15:40:03.664666 n-d-833090-16 devstack@n-api.service[112970]: [pid: 112970|app: 0|req: 14/26] 10.222.0.50 () {64 vars in 1333 bytes} [Wed Aug 31 15:40:03 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:40:06.040231 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi [None req-f23ea515-510e-4781-a51e-74701a35f8af admin admin] Calling method '>' {{(pid=112969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:40:06.041287 n-d-833090-16 devstack@n-api.service[112969]: INFO nova.api.openstack.requestlog [None req-f23ea515-510e-4781-a51e-74701a35f8af admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Aug 31 15:40:06.041685 n-d-833090-16 devstack@n-api.service[112969]: [pid: 112969|app: 0|req: 13/27] 10.222.0.50 () {54 vars in 931 bytes} [Wed Aug 31 15:40:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:40:06.492139 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi [None req-aaaa36b2-28e6-42b9-b59d-f8fcf7ad2d77 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 4096, "id": "3", "disk": 40, "vcpus": 2, "name": "m1.medium", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=112970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:40:06.513594 n-d-833090-16 devstack@n-api.service[112970]: INFO nova.api.openstack.requestlog [None req-aaaa36b2-28e6-42b9-b59d-f8fcf7ad2d77 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.465811 Aug 31 15:40:06.514424 n-d-833090-16 devstack@n-api.service[112970]: [pid: 112970|app: 0|req: 15/28] 10.222.0.50 () {64 vars in 1283 bytes} [Wed Aug 31 15:40:06 2022] POST /compute/v2.1/flavors => generated 406 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:40:06.526505 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi [None req-48dc151f-1db0-42a9-a770-df1e8975a526 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:40:06.551692 n-d-833090-16 devstack@n-api.service[112969]: INFO nova.api.openstack.requestlog [None req-48dc151f-1db0-42a9-a770-df1e8975a526 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029142 Aug 31 15:40:06.552255 n-d-833090-16 devstack@n-api.service[112969]: [pid: 112969|app: 0|req: 14/29] 10.222.0.50 () {64 vars in 1333 bytes} [Wed Aug 31 15:40:06 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:40:08.924357 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi [None req-aaaa36b2-28e6-42b9-b59d-f8fcf7ad2d77 admin admin] Calling method '>' {{(pid=112970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:40:08.925374 n-d-833090-16 devstack@n-api.service[112970]: INFO nova.api.openstack.requestlog [None req-aaaa36b2-28e6-42b9-b59d-f8fcf7ad2d77 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Aug 31 15:40:08.925972 n-d-833090-16 devstack@n-api.service[112970]: [pid: 112970|app: 0|req: 16/30] 10.222.0.50 () {54 vars in 931 bytes} [Wed Aug 31 15:40:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:40:09.332762 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi [None req-53c3c57b-6bd6-4d86-9f50-a98a3908dddb admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 8192, "name": "m1.large", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "os-flavor-access:is_public": true, "disk": 80, "swap": 0}} {{(pid=112969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:40:09.338427 n-d-833090-16 devstack@n-api.service[112969]: DEBUG dbcounter [-] [112969] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=112969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:40:09.354221 n-d-833090-16 devstack@n-api.service[112969]: INFO nova.api.openstack.requestlog [None req-53c3c57b-6bd6-4d86-9f50-a98a3908dddb admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.421093 Aug 31 15:40:09.355008 n-d-833090-16 devstack@n-api.service[112969]: [pid: 112969|app: 0|req: 15/31] 10.222.0.50 () {64 vars in 1283 bytes} [Wed Aug 31 15:40:08 2022] POST /compute/v2.1/flavors => generated 405 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 15:40:09.367751 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi [None req-3d2f6025-dee8-4c91-aa50-dfe2b5bcd830 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:40:09.396087 n-d-833090-16 devstack@n-api.service[112970]: INFO nova.api.openstack.requestlog [None req-3d2f6025-dee8-4c91-aa50-dfe2b5bcd830 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032064 Aug 31 15:40:09.396754 n-d-833090-16 devstack@n-api.service[112970]: [pid: 112970|app: 0|req: 17/32] 10.222.0.50 () {64 vars in 1333 bytes} [Wed Aug 31 15:40:09 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:40:11.930998 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi [None req-53c3c57b-6bd6-4d86-9f50-a98a3908dddb admin admin] Calling method '>' {{(pid=112969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:40:11.932751 n-d-833090-16 devstack@n-api.service[112969]: INFO nova.api.openstack.requestlog [None req-53c3c57b-6bd6-4d86-9f50-a98a3908dddb admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002254 Aug 31 15:40:11.938969 n-d-833090-16 devstack@n-api.service[112969]: [pid: 112969|app: 0|req: 16/33] 10.222.0.50 () {54 vars in 931 bytes} [Wed Aug 31 15:40:11 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:40:12.394490 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi [None req-1255b028-8bda-4597-aef8-898b7e549e2f admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.xlarge", "id": "5", "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "disk": 160, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=112970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:40:12.400699 n-d-833090-16 devstack@n-api.service[112970]: DEBUG dbcounter [-] [112970] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=112970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:40:12.421739 n-d-833090-16 devstack@n-api.service[112970]: INFO nova.api.openstack.requestlog [None req-1255b028-8bda-4597-aef8-898b7e549e2f admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.480520 Aug 31 15:40:12.422400 n-d-833090-16 devstack@n-api.service[112970]: [pid: 112970|app: 0|req: 18/34] 10.222.0.50 () {64 vars in 1283 bytes} [Wed Aug 31 15:40:11 2022] POST /compute/v2.1/flavors => generated 408 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 15:40:12.436142 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi [None req-b209413c-e58a-41a4-ba25-69b394ca3764 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:40:12.465361 n-d-833090-16 devstack@n-api.service[112969]: INFO nova.api.openstack.requestlog [None req-b209413c-e58a-41a4-ba25-69b394ca3764 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034322 Aug 31 15:40:12.478206 n-d-833090-16 devstack@n-api.service[112969]: [pid: 112969|app: 0|req: 17/35] 10.222.0.50 () {64 vars in 1333 bytes} [Wed Aug 31 15:40:12 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:40:35.144073 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi [None req-1255b028-8bda-4597-aef8-898b7e549e2f admin admin] Calling method '>' {{(pid=112970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:40:35.145755 n-d-833090-16 devstack@n-api.service[112970]: INFO nova.api.openstack.requestlog [None req-1255b028-8bda-4597-aef8-898b7e549e2f admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002473 Aug 31 15:40:35.146415 n-d-833090-16 devstack@n-api.service[112970]: [pid: 112970|app: 0|req: 19/36] 10.222.0.50 () {54 vars in 931 bytes} [Wed Aug 31 15:40:35 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:40:35.163737 n-d-833090-16 devstack@n-api.service[112969]: DEBUG dbcounter [-] [112969] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=112969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:40:35.565660 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi [None req-35850f48-9731-44ec-93c8-104fe83ae9b0 admin admin] Calling method '>' {{(pid=112969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:40:35.583648 n-d-833090-16 devstack@n-api.service[112969]: INFO nova.api.openstack.requestlog [None req-35850f48-9731-44ec-93c8-104fe83ae9b0 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.426780 Aug 31 15:40:35.584177 n-d-833090-16 devstack@n-api.service[112969]: [pid: 112969|app: 0|req: 18/37] 10.222.0.50 () {60 vars in 1292 bytes} [Wed Aug 31 15:40:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:40:36.656354 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi [None req-1255b028-8bda-4597-aef8-898b7e549e2f admin admin] Calling method '>' {{(pid=112970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:40:36.657353 n-d-833090-16 devstack@n-api.service[112970]: INFO nova.api.openstack.requestlog [None req-1255b028-8bda-4597-aef8-898b7e549e2f admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Aug 31 15:40:36.657746 n-d-833090-16 devstack@n-api.service[112970]: [pid: 112970|app: 0|req: 20/38] 10.222.0.50 () {56 vars in 1074 bytes} [Wed Aug 31 15:40:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:40:37.247375 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi [None req-cfad69bd-8f5b-475f-8102-f2139c086012 admin admin] Calling method '>' {{(pid=112969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:40:37.254782 n-d-833090-16 devstack@n-api.service[112969]: INFO nova.api.openstack.wsgi [None req-cfad69bd-8f5b-475f-8102-f2139c086012 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 31 15:40:37.259816 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi [None req-cfad69bd-8f5b-475f-8102-f2139c086012 admin admin] Request method failure captured: Aug 31 15:40:37.259816 n-d-833090-16 devstack@n-api.service[112969]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 31 15:40:37.259816 n-d-833090-16 devstack@n-api.service[112969]: Accept: application/json Aug 31 15:40:37.259816 n-d-833090-16 devstack@n-api.service[112969]: Accept-Encoding: gzip, deflate Aug 31 15:40:37.259816 n-d-833090-16 devstack@n-api.service[112969]: Connection: keep-alive Aug 31 15:40:37.259816 n-d-833090-16 devstack@n-api.service[112969]: Content-Length: 0 Aug 31 15:40:37.259816 n-d-833090-16 devstack@n-api.service[112969]: Host: 10.222.0.50 Aug 31 15:40:37.259816 n-d-833090-16 devstack@n-api.service[112969]: Openstack-Api-Version: compute 2.90 Aug 31 15:40:37.259816 n-d-833090-16 devstack@n-api.service[112969]: Openstack-System-Scope: None Aug 31 15:40:37.259816 n-d-833090-16 devstack@n-api.service[112969]: User-Agent: python-novaclient Aug 31 15:40:37.259816 n-d-833090-16 devstack@n-api.service[112969]: X-Auth-Token: gAAAAABjD4D0wsFfXF1R3UfvwjCls8FLmTmq-2AEX8jWFabpq0Q7k6f_Rfcfx7sYSaoeuq8vWWAvqDPSc_jVYYsXSBm7D05-1_jX7-vb8uTvRMMA_KCF_vJnz9q54M9MANoSUnoUwthSEpawx5AR1d_2SL0kwT_W-rdnXsYOEZjJTgf-Y3SQPaE Aug 31 15:40:37.259816 n-d-833090-16 devstack@n-api.service[112969]: X-Domain-Id: None Aug 31 15:40:37.259816 n-d-833090-16 devstack@n-api.service[112969]: X-Domain-Name: None Aug 31 15:40:37.259816 n-d-833090-16 devstack@n-api.service[112969]: X-Identity-Status: Confirmed Aug 31 15:40:37.259816 n-d-833090-16 devstack@n-api.service[112969]: X-Is-Admin-Project: True Aug 31 15:40:37.259816 n-d-833090-16 devstack@n-api.service[112969]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 15:40:37.259816 n-d-833090-16 devstack@n-api.service[112969]: X-Project-Domain-Id: default Aug 31 15:40:37.259816 n-d-833090-16 devstack@n-api.service[112969]: X-Project-Domain-Name: Default Aug 31 15:40:37.259816 n-d-833090-16 devstack@n-api.service[112969]: X-Project-Id: 321821a5d50b427c92938a2e7921c630 Aug 31 15:40:37.259816 n-d-833090-16 devstack@n-api.service[112969]: X-Project-Name: admin Aug 31 15:40:37.259816 n-d-833090-16 devstack@n-api.service[112969]: X-Role: reader,admin,member Aug 31 15:40:37.259816 n-d-833090-16 devstack@n-api.service[112969]: X-Roles: reader,admin,member Aug 31 15:40:37.261366 n-d-833090-16 devstack@n-api.service[112969]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/321821a5d50b427c92938a2e7921c630"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/321821a5d50b427c92938a2e7921c630"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/321821a5d50b427c92938a2e7921c630"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_321821a5d50b427c92938a2e7921c630", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:40:37.261366 n-d-833090-16 devstack@n-api.service[112969]: X-Tenant: admin Aug 31 15:40:37.261366 n-d-833090-16 devstack@n-api.service[112969]: X-Tenant-Id: 321821a5d50b427c92938a2e7921c630 Aug 31 15:40:37.261366 n-d-833090-16 devstack@n-api.service[112969]: X-Tenant-Name: admin Aug 31 15:40:37.261366 n-d-833090-16 devstack@n-api.service[112969]: X-User: admin Aug 31 15:40:37.261366 n-d-833090-16 devstack@n-api.service[112969]: X-User-Domain-Id: default Aug 31 15:40:37.261366 n-d-833090-16 devstack@n-api.service[112969]: X-User-Domain-Name: Default Aug 31 15:40:37.261366 n-d-833090-16 devstack@n-api.service[112969]: X-User-Id: 7c0bbe96f4914ffa83d1fa03065e7a89 Aug 31 15:40:37.261366 n-d-833090-16 devstack@n-api.service[112969]: X-User-Name: admin Aug 31 15:40:37.261366 n-d-833090-16 devstack@n-api.service[112969]: method: > Aug 31 15:40:37.261366 n-d-833090-16 devstack@n-api.service[112969]: exception: Flavor 42 could not be found. Aug 31 15:40:37.261366 n-d-833090-16 devstack@n-api.service[112969]: action_args: {'id': '42'} Aug 31 15:40:37.261366 n-d-833090-16 devstack@n-api.service[112969]: {{(pid=112969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:40:37.261366 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:40:37.262317 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 15:40:37.262317 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 15:40:37.262317 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 15:40:37.262317 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 15:40:37.262317 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 15:40:37.262317 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 15:40:37.262317 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 15:40:37.262317 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 15:40:37.262317 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 15:40:37.262317 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:40:37.262317 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 15:40:37.262317 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 15:40:37.262317 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 31 15:40:37.262317 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi Aug 31 15:40:37.262317 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:40:37.262317 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi Aug 31 15:40:37.262317 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:40:37.262317 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:40:37.262317 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:40:37.263507 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:40:37.263507 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:40:37.263507 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:40:37.263507 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:40:37.263507 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 15:40:37.263507 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:40:37.263507 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 31 15:40:37.263507 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi Aug 31 15:40:37.263507 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:40:37.263507 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi Aug 31 15:40:37.263507 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:40:37.263507 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:40:37.263507 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:40:37.263507 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:40:37.263507 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:40:37.263507 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 31 15:40:37.263507 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi Aug 31 15:40:37.263507 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi [None req-cfad69bd-8f5b-475f-8102-f2139c086012 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112969) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:40:37.264575 n-d-833090-16 devstack@n-api.service[112969]: INFO nova.api.openstack.requestlog [None req-cfad69bd-8f5b-475f-8102-f2139c086012 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.445003 Aug 31 15:40:37.264575 n-d-833090-16 devstack@n-api.service[112969]: [pid: 112969|app: 0|req: 19/39] 10.222.0.50 () {60 vars in 1190 bytes} [Wed Aug 31 15:40:36 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 447 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 15:40:37.271254 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi [None req-f6640c54-c34b-41b7-bcdf-fd2cb968ffe7 admin admin] Calling method '>' {{(pid=112970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:40:37.294067 n-d-833090-16 devstack@n-api.service[112970]: INFO nova.api.openstack.requestlog [None req-f6640c54-c34b-41b7-bcdf-fd2cb968ffe7 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026392 Aug 31 15:40:37.294628 n-d-833090-16 devstack@n-api.service[112970]: [pid: 112970|app: 0|req: 21/40] 10.222.0.50 () {60 vars in 1210 bytes} [Wed Aug 31 15:40:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:40:37.319716 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi [None req-154072e2-9558-4e26-9dd2-67e3fe71a43d admin admin] Calling method '>' {{(pid=112969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:40:37.342812 n-d-833090-16 devstack@n-api.service[112969]: INFO nova.api.openstack.requestlog [None req-154072e2-9558-4e26-9dd2-67e3fe71a43d admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026811 Aug 31 15:40:37.343352 n-d-833090-16 devstack@n-api.service[112969]: [pid: 112969|app: 0|req: 20/41] 10.222.0.50 () {60 vars in 1210 bytes} [Wed Aug 31 15:40:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:40:37.356596 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi [None req-b0afd345-d388-491a-816e-67e143904156 admin admin] Calling method '>' {{(pid=112970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:40:37.366377 n-d-833090-16 devstack@n-api.service[112970]: INFO nova.api.openstack.wsgi [None req-b0afd345-d388-491a-816e-67e143904156 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 31 15:40:37.372110 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi [None req-b0afd345-d388-491a-816e-67e143904156 admin admin] Request method failure captured: Aug 31 15:40:37.372110 n-d-833090-16 devstack@n-api.service[112970]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 31 15:40:37.372110 n-d-833090-16 devstack@n-api.service[112970]: Accept: application/json Aug 31 15:40:37.372110 n-d-833090-16 devstack@n-api.service[112970]: Accept-Encoding: gzip, deflate Aug 31 15:40:37.372110 n-d-833090-16 devstack@n-api.service[112970]: Connection: keep-alive Aug 31 15:40:37.372110 n-d-833090-16 devstack@n-api.service[112970]: Content-Length: 0 Aug 31 15:40:37.372110 n-d-833090-16 devstack@n-api.service[112970]: Host: 10.222.0.50 Aug 31 15:40:37.372110 n-d-833090-16 devstack@n-api.service[112970]: Openstack-Api-Version: compute 2.90 Aug 31 15:40:37.372110 n-d-833090-16 devstack@n-api.service[112970]: Openstack-System-Scope: None Aug 31 15:40:37.372110 n-d-833090-16 devstack@n-api.service[112970]: User-Agent: python-novaclient Aug 31 15:40:37.372110 n-d-833090-16 devstack@n-api.service[112970]: X-Auth-Token: gAAAAABjD4D0wsFfXF1R3UfvwjCls8FLmTmq-2AEX8jWFabpq0Q7k6f_Rfcfx7sYSaoeuq8vWWAvqDPSc_jVYYsXSBm7D05-1_jX7-vb8uTvRMMA_KCF_vJnz9q54M9MANoSUnoUwthSEpawx5AR1d_2SL0kwT_W-rdnXsYOEZjJTgf-Y3SQPaE Aug 31 15:40:37.372110 n-d-833090-16 devstack@n-api.service[112970]: X-Domain-Id: None Aug 31 15:40:37.372110 n-d-833090-16 devstack@n-api.service[112970]: X-Domain-Name: None Aug 31 15:40:37.372110 n-d-833090-16 devstack@n-api.service[112970]: X-Identity-Status: Confirmed Aug 31 15:40:37.372110 n-d-833090-16 devstack@n-api.service[112970]: X-Is-Admin-Project: True Aug 31 15:40:37.372110 n-d-833090-16 devstack@n-api.service[112970]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 15:40:37.372110 n-d-833090-16 devstack@n-api.service[112970]: X-Project-Domain-Id: default Aug 31 15:40:37.372110 n-d-833090-16 devstack@n-api.service[112970]: X-Project-Domain-Name: Default Aug 31 15:40:37.372110 n-d-833090-16 devstack@n-api.service[112970]: X-Project-Id: 321821a5d50b427c92938a2e7921c630 Aug 31 15:40:37.372110 n-d-833090-16 devstack@n-api.service[112970]: X-Project-Name: admin Aug 31 15:40:37.372110 n-d-833090-16 devstack@n-api.service[112970]: X-Role: reader,admin,member Aug 31 15:40:37.372110 n-d-833090-16 devstack@n-api.service[112970]: X-Roles: reader,admin,member Aug 31 15:40:37.374735 n-d-833090-16 devstack@n-api.service[112970]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/321821a5d50b427c92938a2e7921c630"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/321821a5d50b427c92938a2e7921c630"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/321821a5d50b427c92938a2e7921c630"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_321821a5d50b427c92938a2e7921c630", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:40:37.374735 n-d-833090-16 devstack@n-api.service[112970]: X-Tenant: admin Aug 31 15:40:37.374735 n-d-833090-16 devstack@n-api.service[112970]: X-Tenant-Id: 321821a5d50b427c92938a2e7921c630 Aug 31 15:40:37.374735 n-d-833090-16 devstack@n-api.service[112970]: X-Tenant-Name: admin Aug 31 15:40:37.374735 n-d-833090-16 devstack@n-api.service[112970]: X-User: admin Aug 31 15:40:37.374735 n-d-833090-16 devstack@n-api.service[112970]: X-User-Domain-Id: default Aug 31 15:40:37.374735 n-d-833090-16 devstack@n-api.service[112970]: X-User-Domain-Name: Default Aug 31 15:40:37.374735 n-d-833090-16 devstack@n-api.service[112970]: X-User-Id: 7c0bbe96f4914ffa83d1fa03065e7a89 Aug 31 15:40:37.374735 n-d-833090-16 devstack@n-api.service[112970]: X-User-Name: admin Aug 31 15:40:37.374735 n-d-833090-16 devstack@n-api.service[112970]: method: > Aug 31 15:40:37.374735 n-d-833090-16 devstack@n-api.service[112970]: exception: Flavor 42 could not be found. Aug 31 15:40:37.374735 n-d-833090-16 devstack@n-api.service[112970]: action_args: {'id': '42'} Aug 31 15:40:37.374735 n-d-833090-16 devstack@n-api.service[112970]: {{(pid=112970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:40:37.374735 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:40:37.375726 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 15:40:37.375726 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 15:40:37.375726 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 15:40:37.375726 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 15:40:37.375726 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 15:40:37.375726 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 15:40:37.375726 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 15:40:37.375726 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 15:40:37.375726 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 15:40:37.375726 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:40:37.375726 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 15:40:37.375726 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 15:40:37.375726 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 31 15:40:37.375726 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi Aug 31 15:40:37.375726 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:40:37.375726 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi Aug 31 15:40:37.375726 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:40:37.375726 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:40:37.375726 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:40:37.377032 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:40:37.377032 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:40:37.377032 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:40:37.377032 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:40:37.377032 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 15:40:37.377032 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:40:37.377032 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 31 15:40:37.377032 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi Aug 31 15:40:37.377032 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:40:37.377032 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi Aug 31 15:40:37.377032 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:40:37.377032 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:40:37.377032 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:40:37.377032 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:40:37.377032 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:40:37.377032 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 31 15:40:37.377032 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi Aug 31 15:40:37.377032 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi [None req-b0afd345-d388-491a-816e-67e143904156 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:40:37.378973 n-d-833090-16 devstack@n-api.service[112970]: INFO nova.api.openstack.requestlog [None req-b0afd345-d388-491a-816e-67e143904156 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.024251 Aug 31 15:40:37.378973 n-d-833090-16 devstack@n-api.service[112970]: [pid: 112970|app: 0|req: 22/42] 10.222.0.50 () {60 vars in 1190 bytes} [Wed Aug 31 15:40:37 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 15:40:38.408245 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi [None req-154072e2-9558-4e26-9dd2-67e3fe71a43d admin admin] Calling method '>' {{(pid=112969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:40:38.409290 n-d-833090-16 devstack@n-api.service[112969]: INFO nova.api.openstack.requestlog [None req-154072e2-9558-4e26-9dd2-67e3fe71a43d admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Aug 31 15:40:38.409856 n-d-833090-16 devstack@n-api.service[112969]: [pid: 112969|app: 0|req: 21/43] 10.222.0.50 () {56 vars in 1074 bytes} [Wed Aug 31 15:40:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:40:38.995788 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi [None req-d14b3408-56b6-4ca9-9794-2e870b1163f0 admin admin] Calling method '>' {{(pid=112970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:40:39.001269 n-d-833090-16 devstack@n-api.service[112970]: INFO nova.api.openstack.wsgi [None req-d14b3408-56b6-4ca9-9794-2e870b1163f0 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 31 15:40:39.003036 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi [None req-d14b3408-56b6-4ca9-9794-2e870b1163f0 admin admin] Request method failure captured: Aug 31 15:40:39.003036 n-d-833090-16 devstack@n-api.service[112970]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 31 15:40:39.003036 n-d-833090-16 devstack@n-api.service[112970]: Accept: application/json Aug 31 15:40:39.003036 n-d-833090-16 devstack@n-api.service[112970]: Accept-Encoding: gzip, deflate Aug 31 15:40:39.003036 n-d-833090-16 devstack@n-api.service[112970]: Connection: keep-alive Aug 31 15:40:39.003036 n-d-833090-16 devstack@n-api.service[112970]: Content-Length: 0 Aug 31 15:40:39.003036 n-d-833090-16 devstack@n-api.service[112970]: Host: 10.222.0.50 Aug 31 15:40:39.003036 n-d-833090-16 devstack@n-api.service[112970]: Openstack-Api-Version: compute 2.90 Aug 31 15:40:39.003036 n-d-833090-16 devstack@n-api.service[112970]: Openstack-System-Scope: None Aug 31 15:40:39.003036 n-d-833090-16 devstack@n-api.service[112970]: User-Agent: python-novaclient Aug 31 15:40:39.003036 n-d-833090-16 devstack@n-api.service[112970]: X-Auth-Token: gAAAAABjD4D2BXjc5pw6n2XgAK2rh3gdCSkzgVc9WsJ5-wHqg03vTjXJ105apk7vI-TS6YsrdwTH9Z-WqJu8pWfT9L1iE_ex6bCmzOqPNu7UEm3zSgbJS7wPxlBtBXUlAUd1Gj50eXuoZiPzj-Lw8f9kojwgYtBG-PIWaJUmyvja1XLOjMp8nIk Aug 31 15:40:39.003036 n-d-833090-16 devstack@n-api.service[112970]: X-Domain-Id: None Aug 31 15:40:39.003036 n-d-833090-16 devstack@n-api.service[112970]: X-Domain-Name: None Aug 31 15:40:39.003036 n-d-833090-16 devstack@n-api.service[112970]: X-Identity-Status: Confirmed Aug 31 15:40:39.003036 n-d-833090-16 devstack@n-api.service[112970]: X-Is-Admin-Project: True Aug 31 15:40:39.003036 n-d-833090-16 devstack@n-api.service[112970]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 15:40:39.003036 n-d-833090-16 devstack@n-api.service[112970]: X-Project-Domain-Id: default Aug 31 15:40:39.003036 n-d-833090-16 devstack@n-api.service[112970]: X-Project-Domain-Name: Default Aug 31 15:40:39.003036 n-d-833090-16 devstack@n-api.service[112970]: X-Project-Id: 321821a5d50b427c92938a2e7921c630 Aug 31 15:40:39.003036 n-d-833090-16 devstack@n-api.service[112970]: X-Project-Name: admin Aug 31 15:40:39.003036 n-d-833090-16 devstack@n-api.service[112970]: X-Role: reader,admin,member Aug 31 15:40:39.003036 n-d-833090-16 devstack@n-api.service[112970]: X-Roles: reader,admin,member Aug 31 15:40:39.005124 n-d-833090-16 devstack@n-api.service[112970]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/321821a5d50b427c92938a2e7921c630"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/321821a5d50b427c92938a2e7921c630"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/321821a5d50b427c92938a2e7921c630"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_321821a5d50b427c92938a2e7921c630", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:40:39.005124 n-d-833090-16 devstack@n-api.service[112970]: X-Tenant: admin Aug 31 15:40:39.005124 n-d-833090-16 devstack@n-api.service[112970]: X-Tenant-Id: 321821a5d50b427c92938a2e7921c630 Aug 31 15:40:39.005124 n-d-833090-16 devstack@n-api.service[112970]: X-Tenant-Name: admin Aug 31 15:40:39.005124 n-d-833090-16 devstack@n-api.service[112970]: X-User: admin Aug 31 15:40:39.005124 n-d-833090-16 devstack@n-api.service[112970]: X-User-Domain-Id: default Aug 31 15:40:39.005124 n-d-833090-16 devstack@n-api.service[112970]: X-User-Domain-Name: Default Aug 31 15:40:39.005124 n-d-833090-16 devstack@n-api.service[112970]: X-User-Id: 7c0bbe96f4914ffa83d1fa03065e7a89 Aug 31 15:40:39.005124 n-d-833090-16 devstack@n-api.service[112970]: X-User-Name: admin Aug 31 15:40:39.005124 n-d-833090-16 devstack@n-api.service[112970]: method: > Aug 31 15:40:39.005124 n-d-833090-16 devstack@n-api.service[112970]: exception: Flavor 84 could not be found. Aug 31 15:40:39.005124 n-d-833090-16 devstack@n-api.service[112970]: action_args: {'id': '84'} Aug 31 15:40:39.005124 n-d-833090-16 devstack@n-api.service[112970]: {{(pid=112970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:40:39.005124 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:40:39.005923 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 15:40:39.005923 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 15:40:39.005923 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 15:40:39.005923 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 15:40:39.005923 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 15:40:39.005923 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 15:40:39.005923 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 15:40:39.005923 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 15:40:39.005923 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 15:40:39.005923 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:40:39.005923 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 15:40:39.005923 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 15:40:39.005923 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 31 15:40:39.005923 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi Aug 31 15:40:39.005923 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:40:39.005923 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi Aug 31 15:40:39.005923 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:40:39.005923 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:40:39.005923 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:40:39.007021 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:40:39.007021 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:40:39.007021 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:40:39.007021 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:40:39.007021 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 15:40:39.007021 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:40:39.007021 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 31 15:40:39.007021 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi Aug 31 15:40:39.007021 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:40:39.007021 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi Aug 31 15:40:39.007021 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:40:39.007021 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:40:39.007021 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:40:39.007021 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:40:39.007021 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:40:39.007021 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 31 15:40:39.007021 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi Aug 31 15:40:39.007021 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi [None req-d14b3408-56b6-4ca9-9794-2e870b1163f0 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:40:39.008019 n-d-833090-16 devstack@n-api.service[112970]: INFO nova.api.openstack.requestlog [None req-d14b3408-56b6-4ca9-9794-2e870b1163f0 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.459826 Aug 31 15:40:39.008019 n-d-833090-16 devstack@n-api.service[112970]: [pid: 112970|app: 0|req: 23/44] 10.222.0.50 () {60 vars in 1190 bytes} [Wed Aug 31 15:40:38 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 461 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 15:40:39.014710 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi [None req-ee0196eb-2893-43c9-a06b-29543bb6710e admin admin] Calling method '>' {{(pid=112969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:40:39.030075 n-d-833090-16 devstack@n-api.service[112969]: INFO nova.api.openstack.requestlog [None req-ee0196eb-2893-43c9-a06b-29543bb6710e admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018980 Aug 31 15:40:39.030670 n-d-833090-16 devstack@n-api.service[112969]: [pid: 112969|app: 0|req: 22/45] 10.222.0.50 () {60 vars in 1210 bytes} [Wed Aug 31 15:40:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:40:39.040524 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi [None req-732f2997-fc55-4df1-aa25-e8a5c7564675 admin admin] Calling method '>' {{(pid=112970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:40:39.055936 n-d-833090-16 devstack@n-api.service[112970]: INFO nova.api.openstack.requestlog [None req-732f2997-fc55-4df1-aa25-e8a5c7564675 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019045 Aug 31 15:40:39.056486 n-d-833090-16 devstack@n-api.service[112970]: [pid: 112970|app: 0|req: 24/46] 10.222.0.50 () {60 vars in 1210 bytes} [Wed Aug 31 15:40:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:40:39.066139 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi [None req-74be5923-927c-4d1e-be7b-9b38d3b9095b admin admin] Calling method '>' {{(pid=112969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:40:39.071995 n-d-833090-16 devstack@n-api.service[112969]: INFO nova.api.openstack.wsgi [None req-74be5923-927c-4d1e-be7b-9b38d3b9095b admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 31 15:40:39.073516 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi [None req-74be5923-927c-4d1e-be7b-9b38d3b9095b admin admin] Request method failure captured: Aug 31 15:40:39.073516 n-d-833090-16 devstack@n-api.service[112969]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 31 15:40:39.073516 n-d-833090-16 devstack@n-api.service[112969]: Accept: application/json Aug 31 15:40:39.073516 n-d-833090-16 devstack@n-api.service[112969]: Accept-Encoding: gzip, deflate Aug 31 15:40:39.073516 n-d-833090-16 devstack@n-api.service[112969]: Connection: keep-alive Aug 31 15:40:39.073516 n-d-833090-16 devstack@n-api.service[112969]: Content-Length: 0 Aug 31 15:40:39.073516 n-d-833090-16 devstack@n-api.service[112969]: Host: 10.222.0.50 Aug 31 15:40:39.073516 n-d-833090-16 devstack@n-api.service[112969]: Openstack-Api-Version: compute 2.90 Aug 31 15:40:39.073516 n-d-833090-16 devstack@n-api.service[112969]: Openstack-System-Scope: None Aug 31 15:40:39.073516 n-d-833090-16 devstack@n-api.service[112969]: User-Agent: python-novaclient Aug 31 15:40:39.073516 n-d-833090-16 devstack@n-api.service[112969]: X-Auth-Token: gAAAAABjD4D2BXjc5pw6n2XgAK2rh3gdCSkzgVc9WsJ5-wHqg03vTjXJ105apk7vI-TS6YsrdwTH9Z-WqJu8pWfT9L1iE_ex6bCmzOqPNu7UEm3zSgbJS7wPxlBtBXUlAUd1Gj50eXuoZiPzj-Lw8f9kojwgYtBG-PIWaJUmyvja1XLOjMp8nIk Aug 31 15:40:39.073516 n-d-833090-16 devstack@n-api.service[112969]: X-Domain-Id: None Aug 31 15:40:39.073516 n-d-833090-16 devstack@n-api.service[112969]: X-Domain-Name: None Aug 31 15:40:39.073516 n-d-833090-16 devstack@n-api.service[112969]: X-Identity-Status: Confirmed Aug 31 15:40:39.073516 n-d-833090-16 devstack@n-api.service[112969]: X-Is-Admin-Project: True Aug 31 15:40:39.073516 n-d-833090-16 devstack@n-api.service[112969]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 15:40:39.073516 n-d-833090-16 devstack@n-api.service[112969]: X-Project-Domain-Id: default Aug 31 15:40:39.073516 n-d-833090-16 devstack@n-api.service[112969]: X-Project-Domain-Name: Default Aug 31 15:40:39.073516 n-d-833090-16 devstack@n-api.service[112969]: X-Project-Id: 321821a5d50b427c92938a2e7921c630 Aug 31 15:40:39.073516 n-d-833090-16 devstack@n-api.service[112969]: X-Project-Name: admin Aug 31 15:40:39.073516 n-d-833090-16 devstack@n-api.service[112969]: X-Role: reader,admin,member Aug 31 15:40:39.073516 n-d-833090-16 devstack@n-api.service[112969]: X-Roles: reader,admin,member Aug 31 15:40:39.075022 n-d-833090-16 devstack@n-api.service[112969]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/321821a5d50b427c92938a2e7921c630"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/321821a5d50b427c92938a2e7921c630"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/321821a5d50b427c92938a2e7921c630"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_321821a5d50b427c92938a2e7921c630", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:40:39.075022 n-d-833090-16 devstack@n-api.service[112969]: X-Tenant: admin Aug 31 15:40:39.075022 n-d-833090-16 devstack@n-api.service[112969]: X-Tenant-Id: 321821a5d50b427c92938a2e7921c630 Aug 31 15:40:39.075022 n-d-833090-16 devstack@n-api.service[112969]: X-Tenant-Name: admin Aug 31 15:40:39.075022 n-d-833090-16 devstack@n-api.service[112969]: X-User: admin Aug 31 15:40:39.075022 n-d-833090-16 devstack@n-api.service[112969]: X-User-Domain-Id: default Aug 31 15:40:39.075022 n-d-833090-16 devstack@n-api.service[112969]: X-User-Domain-Name: Default Aug 31 15:40:39.075022 n-d-833090-16 devstack@n-api.service[112969]: X-User-Id: 7c0bbe96f4914ffa83d1fa03065e7a89 Aug 31 15:40:39.075022 n-d-833090-16 devstack@n-api.service[112969]: X-User-Name: admin Aug 31 15:40:39.075022 n-d-833090-16 devstack@n-api.service[112969]: method: > Aug 31 15:40:39.075022 n-d-833090-16 devstack@n-api.service[112969]: exception: Flavor 84 could not be found. Aug 31 15:40:39.075022 n-d-833090-16 devstack@n-api.service[112969]: action_args: {'id': '84'} Aug 31 15:40:39.075022 n-d-833090-16 devstack@n-api.service[112969]: {{(pid=112969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:40:39.075022 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:40:39.075904 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 15:40:39.075904 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 15:40:39.075904 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 15:40:39.075904 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 15:40:39.075904 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 15:40:39.075904 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 15:40:39.075904 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 15:40:39.075904 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 15:40:39.075904 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 15:40:39.075904 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:40:39.075904 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 15:40:39.075904 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 15:40:39.075904 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 31 15:40:39.075904 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi Aug 31 15:40:39.075904 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:40:39.075904 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi Aug 31 15:40:39.075904 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:40:39.075904 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:40:39.075904 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:40:39.077181 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:40:39.077181 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:40:39.077181 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:40:39.077181 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:40:39.077181 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 15:40:39.077181 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:40:39.077181 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 31 15:40:39.077181 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi Aug 31 15:40:39.077181 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:40:39.077181 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi Aug 31 15:40:39.077181 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:40:39.077181 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:40:39.077181 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:40:39.077181 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:40:39.077181 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:40:39.077181 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 31 15:40:39.077181 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi Aug 31 15:40:39.077181 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi [None req-74be5923-927c-4d1e-be7b-9b38d3b9095b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112969) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:40:39.078477 n-d-833090-16 devstack@n-api.service[112969]: INFO nova.api.openstack.requestlog [None req-74be5923-927c-4d1e-be7b-9b38d3b9095b admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012435 Aug 31 15:40:39.078477 n-d-833090-16 devstack@n-api.service[112969]: [pid: 112969|app: 0|req: 23/47] 10.222.0.50 () {60 vars in 1190 bytes} [Wed Aug 31 15:40:39 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 15:40:40.103334 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi [None req-732f2997-fc55-4df1-aa25-e8a5c7564675 admin admin] Calling method '>' {{(pid=112970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:40:40.104375 n-d-833090-16 devstack@n-api.service[112970]: INFO nova.api.openstack.requestlog [None req-732f2997-fc55-4df1-aa25-e8a5c7564675 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Aug 31 15:40:40.104791 n-d-833090-16 devstack@n-api.service[112970]: [pid: 112970|app: 0|req: 25/48] 10.222.0.50 () {56 vars in 1074 bytes} [Wed Aug 31 15:40:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:40:40.684737 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi [None req-cf934726-2685-4a9e-84ee-366c09ad564f admin admin] Calling method '>' {{(pid=112969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:40:40.690644 n-d-833090-16 devstack@n-api.service[112969]: INFO nova.api.openstack.wsgi [None req-cf934726-2685-4a9e-84ee-366c09ad564f admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 31 15:40:40.692149 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi [None req-cf934726-2685-4a9e-84ee-366c09ad564f admin admin] Request method failure captured: Aug 31 15:40:40.692149 n-d-833090-16 devstack@n-api.service[112969]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 31 15:40:40.692149 n-d-833090-16 devstack@n-api.service[112969]: Accept: application/json Aug 31 15:40:40.692149 n-d-833090-16 devstack@n-api.service[112969]: Accept-Encoding: gzip, deflate Aug 31 15:40:40.692149 n-d-833090-16 devstack@n-api.service[112969]: Connection: keep-alive Aug 31 15:40:40.692149 n-d-833090-16 devstack@n-api.service[112969]: Content-Length: 0 Aug 31 15:40:40.692149 n-d-833090-16 devstack@n-api.service[112969]: Host: 10.222.0.50 Aug 31 15:40:40.692149 n-d-833090-16 devstack@n-api.service[112969]: Openstack-Api-Version: compute 2.90 Aug 31 15:40:40.692149 n-d-833090-16 devstack@n-api.service[112969]: Openstack-System-Scope: None Aug 31 15:40:40.692149 n-d-833090-16 devstack@n-api.service[112969]: User-Agent: python-novaclient Aug 31 15:40:40.692149 n-d-833090-16 devstack@n-api.service[112969]: X-Auth-Token: gAAAAABjD4D3Ns4nPvxHHpViJK-pqZivakffgIqftYjAM13iz8owEYQrTWed5EZOnldymN9Gxg4Sx89JuSfOXBrJcokaEELQAIZcUiSlrAzJTNgNQFaW1r0YKgE2gqE2R2wYRbSPGL8ThqCTZESHze5DInkxfpEyV6P8srnJ4HfIk8bTgd_8uJw Aug 31 15:40:40.692149 n-d-833090-16 devstack@n-api.service[112969]: X-Domain-Id: None Aug 31 15:40:40.692149 n-d-833090-16 devstack@n-api.service[112969]: X-Domain-Name: None Aug 31 15:40:40.692149 n-d-833090-16 devstack@n-api.service[112969]: X-Identity-Status: Confirmed Aug 31 15:40:40.692149 n-d-833090-16 devstack@n-api.service[112969]: X-Is-Admin-Project: True Aug 31 15:40:40.692149 n-d-833090-16 devstack@n-api.service[112969]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 15:40:40.692149 n-d-833090-16 devstack@n-api.service[112969]: X-Project-Domain-Id: default Aug 31 15:40:40.692149 n-d-833090-16 devstack@n-api.service[112969]: X-Project-Domain-Name: Default Aug 31 15:40:40.692149 n-d-833090-16 devstack@n-api.service[112969]: X-Project-Id: 321821a5d50b427c92938a2e7921c630 Aug 31 15:40:40.692149 n-d-833090-16 devstack@n-api.service[112969]: X-Project-Name: admin Aug 31 15:40:40.692149 n-d-833090-16 devstack@n-api.service[112969]: X-Role: reader,admin,member Aug 31 15:40:40.692149 n-d-833090-16 devstack@n-api.service[112969]: X-Roles: reader,admin,member Aug 31 15:40:40.693742 n-d-833090-16 devstack@n-api.service[112969]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/321821a5d50b427c92938a2e7921c630"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/321821a5d50b427c92938a2e7921c630"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/321821a5d50b427c92938a2e7921c630"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_321821a5d50b427c92938a2e7921c630", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:40:40.693742 n-d-833090-16 devstack@n-api.service[112969]: X-Tenant: admin Aug 31 15:40:40.693742 n-d-833090-16 devstack@n-api.service[112969]: X-Tenant-Id: 321821a5d50b427c92938a2e7921c630 Aug 31 15:40:40.693742 n-d-833090-16 devstack@n-api.service[112969]: X-Tenant-Name: admin Aug 31 15:40:40.693742 n-d-833090-16 devstack@n-api.service[112969]: X-User: admin Aug 31 15:40:40.693742 n-d-833090-16 devstack@n-api.service[112969]: X-User-Domain-Id: default Aug 31 15:40:40.693742 n-d-833090-16 devstack@n-api.service[112969]: X-User-Domain-Name: Default Aug 31 15:40:40.693742 n-d-833090-16 devstack@n-api.service[112969]: X-User-Id: 7c0bbe96f4914ffa83d1fa03065e7a89 Aug 31 15:40:40.693742 n-d-833090-16 devstack@n-api.service[112969]: X-User-Name: admin Aug 31 15:40:40.693742 n-d-833090-16 devstack@n-api.service[112969]: method: > Aug 31 15:40:40.693742 n-d-833090-16 devstack@n-api.service[112969]: exception: Flavor 451 could not be found. Aug 31 15:40:40.693742 n-d-833090-16 devstack@n-api.service[112969]: action_args: {'id': '451'} Aug 31 15:40:40.693742 n-d-833090-16 devstack@n-api.service[112969]: {{(pid=112969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:40:40.693742 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:40:40.694588 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 15:40:40.694588 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 15:40:40.694588 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 15:40:40.694588 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 15:40:40.694588 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 15:40:40.694588 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 15:40:40.694588 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 15:40:40.694588 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 15:40:40.694588 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 15:40:40.694588 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:40:40.694588 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 15:40:40.694588 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 15:40:40.694588 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 31 15:40:40.694588 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi Aug 31 15:40:40.694588 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:40:40.694588 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi Aug 31 15:40:40.694588 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:40:40.694588 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:40:40.694588 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:40:40.695863 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:40:40.695863 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:40:40.695863 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:40:40.695863 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:40:40.695863 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 15:40:40.695863 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:40:40.695863 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 31 15:40:40.695863 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi Aug 31 15:40:40.695863 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:40:40.695863 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi Aug 31 15:40:40.695863 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:40:40.695863 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:40:40.695863 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:40:40.695863 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:40:40.695863 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:40:40.695863 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 31 15:40:40.695863 n-d-833090-16 devstack@n-api.service[112969]: ERROR nova.api.openstack.wsgi Aug 31 15:40:40.695863 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi [None req-cf934726-2685-4a9e-84ee-366c09ad564f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112969) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:40:40.696886 n-d-833090-16 devstack@n-api.service[112969]: INFO nova.api.openstack.requestlog [None req-cf934726-2685-4a9e-84ee-366c09ad564f admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.447983 Aug 31 15:40:40.696886 n-d-833090-16 devstack@n-api.service[112969]: [pid: 112969|app: 0|req: 24/49] 10.222.0.50 () {60 vars in 1193 bytes} [Wed Aug 31 15:40:40 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 449 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 15:40:40.703343 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi [None req-8bb46c96-e53b-482e-a462-652b9cbc03dc admin admin] Calling method '>' {{(pid=112970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:40:40.718748 n-d-833090-16 devstack@n-api.service[112970]: INFO nova.api.openstack.requestlog [None req-8bb46c96-e53b-482e-a462-652b9cbc03dc admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018995 Aug 31 15:40:40.719282 n-d-833090-16 devstack@n-api.service[112970]: [pid: 112970|app: 0|req: 26/50] 10.222.0.50 () {60 vars in 1210 bytes} [Wed Aug 31 15:40:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:40:40.729697 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi [None req-dd6d1a08-fb3b-49f0-88f5-47a487f162b6 admin admin] Calling method '>' {{(pid=112969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:40:40.745272 n-d-833090-16 devstack@n-api.service[112969]: INFO nova.api.openstack.requestlog [None req-dd6d1a08-fb3b-49f0-88f5-47a487f162b6 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019287 Aug 31 15:40:40.745812 n-d-833090-16 devstack@n-api.service[112969]: [pid: 112969|app: 0|req: 25/51] 10.222.0.50 () {60 vars in 1210 bytes} [Wed Aug 31 15:40:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:40:40.755914 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi [None req-d40a650c-90c1-4596-ac0f-03176e1e3c5c admin admin] Calling method '>' {{(pid=112970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:40:40.761466 n-d-833090-16 devstack@n-api.service[112970]: INFO nova.api.openstack.wsgi [None req-d40a650c-90c1-4596-ac0f-03176e1e3c5c admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 31 15:40:40.763011 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi [None req-d40a650c-90c1-4596-ac0f-03176e1e3c5c admin admin] Request method failure captured: Aug 31 15:40:40.763011 n-d-833090-16 devstack@n-api.service[112970]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 31 15:40:40.763011 n-d-833090-16 devstack@n-api.service[112970]: Accept: application/json Aug 31 15:40:40.763011 n-d-833090-16 devstack@n-api.service[112970]: Accept-Encoding: gzip, deflate Aug 31 15:40:40.763011 n-d-833090-16 devstack@n-api.service[112970]: Connection: keep-alive Aug 31 15:40:40.763011 n-d-833090-16 devstack@n-api.service[112970]: Content-Length: 0 Aug 31 15:40:40.763011 n-d-833090-16 devstack@n-api.service[112970]: Host: 10.222.0.50 Aug 31 15:40:40.763011 n-d-833090-16 devstack@n-api.service[112970]: Openstack-Api-Version: compute 2.90 Aug 31 15:40:40.763011 n-d-833090-16 devstack@n-api.service[112970]: Openstack-System-Scope: None Aug 31 15:40:40.763011 n-d-833090-16 devstack@n-api.service[112970]: User-Agent: python-novaclient Aug 31 15:40:40.763011 n-d-833090-16 devstack@n-api.service[112970]: X-Auth-Token: gAAAAABjD4D3Ns4nPvxHHpViJK-pqZivakffgIqftYjAM13iz8owEYQrTWed5EZOnldymN9Gxg4Sx89JuSfOXBrJcokaEELQAIZcUiSlrAzJTNgNQFaW1r0YKgE2gqE2R2wYRbSPGL8ThqCTZESHze5DInkxfpEyV6P8srnJ4HfIk8bTgd_8uJw Aug 31 15:40:40.763011 n-d-833090-16 devstack@n-api.service[112970]: X-Domain-Id: None Aug 31 15:40:40.763011 n-d-833090-16 devstack@n-api.service[112970]: X-Domain-Name: None Aug 31 15:40:40.763011 n-d-833090-16 devstack@n-api.service[112970]: X-Identity-Status: Confirmed Aug 31 15:40:40.763011 n-d-833090-16 devstack@n-api.service[112970]: X-Is-Admin-Project: True Aug 31 15:40:40.763011 n-d-833090-16 devstack@n-api.service[112970]: X-Openstack-Nova-Api-Version: 2.90 Aug 31 15:40:40.763011 n-d-833090-16 devstack@n-api.service[112970]: X-Project-Domain-Id: default Aug 31 15:40:40.763011 n-d-833090-16 devstack@n-api.service[112970]: X-Project-Domain-Name: Default Aug 31 15:40:40.763011 n-d-833090-16 devstack@n-api.service[112970]: X-Project-Id: 321821a5d50b427c92938a2e7921c630 Aug 31 15:40:40.763011 n-d-833090-16 devstack@n-api.service[112970]: X-Project-Name: admin Aug 31 15:40:40.763011 n-d-833090-16 devstack@n-api.service[112970]: X-Role: reader,admin,member Aug 31 15:40:40.763011 n-d-833090-16 devstack@n-api.service[112970]: X-Roles: reader,admin,member Aug 31 15:40:40.764534 n-d-833090-16 devstack@n-api.service[112970]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/321821a5d50b427c92938a2e7921c630"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/321821a5d50b427c92938a2e7921c630"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/321821a5d50b427c92938a2e7921c630"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_321821a5d50b427c92938a2e7921c630", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:40:40.764534 n-d-833090-16 devstack@n-api.service[112970]: X-Tenant: admin Aug 31 15:40:40.764534 n-d-833090-16 devstack@n-api.service[112970]: X-Tenant-Id: 321821a5d50b427c92938a2e7921c630 Aug 31 15:40:40.764534 n-d-833090-16 devstack@n-api.service[112970]: X-Tenant-Name: admin Aug 31 15:40:40.764534 n-d-833090-16 devstack@n-api.service[112970]: X-User: admin Aug 31 15:40:40.764534 n-d-833090-16 devstack@n-api.service[112970]: X-User-Domain-Id: default Aug 31 15:40:40.764534 n-d-833090-16 devstack@n-api.service[112970]: X-User-Domain-Name: Default Aug 31 15:40:40.764534 n-d-833090-16 devstack@n-api.service[112970]: X-User-Id: 7c0bbe96f4914ffa83d1fa03065e7a89 Aug 31 15:40:40.764534 n-d-833090-16 devstack@n-api.service[112970]: X-User-Name: admin Aug 31 15:40:40.764534 n-d-833090-16 devstack@n-api.service[112970]: method: > Aug 31 15:40:40.764534 n-d-833090-16 devstack@n-api.service[112970]: exception: Flavor 451 could not be found. Aug 31 15:40:40.764534 n-d-833090-16 devstack@n-api.service[112970]: action_args: {'id': '451'} Aug 31 15:40:40.764534 n-d-833090-16 devstack@n-api.service[112970]: {{(pid=112970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:40:40.764534 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:40:40.765466 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 31 15:40:40.765466 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 31 15:40:40.765466 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 15:40:40.765466 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 15:40:40.765466 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 15:40:40.765466 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 15:40:40.765466 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 15:40:40.765466 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 15:40:40.765466 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 15:40:40.765466 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:40:40.765466 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 15:40:40.765466 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 15:40:40.765466 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 31 15:40:40.765466 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi Aug 31 15:40:40.765466 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:40:40.765466 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi Aug 31 15:40:40.765466 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:40:40.765466 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:40:40.765466 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:40:40.766652 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:40:40.766652 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:40:40.766652 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:40:40.766652 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:40:40.766652 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 31 15:40:40.766652 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:40:40.766652 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 31 15:40:40.766652 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi Aug 31 15:40:40.766652 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:40:40.766652 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi Aug 31 15:40:40.766652 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:40:40.766652 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:40:40.766652 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:40:40.766652 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:40:40.766652 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:40:40.766652 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 31 15:40:40.766652 n-d-833090-16 devstack@n-api.service[112970]: ERROR nova.api.openstack.wsgi Aug 31 15:40:40.766652 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi [None req-d40a650c-90c1-4596-ac0f-03176e1e3c5c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:40:40.767859 n-d-833090-16 devstack@n-api.service[112970]: INFO nova.api.openstack.requestlog [None req-d40a650c-90c1-4596-ac0f-03176e1e3c5c admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012726 Aug 31 15:40:40.767859 n-d-833090-16 devstack@n-api.service[112970]: [pid: 112970|app: 0|req: 27/52] 10.222.0.50 () {60 vars in 1193 bytes} [Wed Aug 31 15:40:40 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 15:40:41.779256 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi [None req-dd6d1a08-fb3b-49f0-88f5-47a487f162b6 admin admin] Calling method '>' {{(pid=112969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:40:41.780398 n-d-833090-16 devstack@n-api.service[112969]: INFO nova.api.openstack.requestlog [None req-dd6d1a08-fb3b-49f0-88f5-47a487f162b6 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001610 Aug 31 15:40:41.780769 n-d-833090-16 devstack@n-api.service[112969]: [pid: 112969|app: 0|req: 26/53] 10.222.0.50 () {56 vars in 1074 bytes} [Wed Aug 31 15:40:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:40:42.350342 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi [None req-558e80b5-8511-4125-b0de-2943c22af5b0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:40:42.372864 n-d-833090-16 devstack@n-api.service[112970]: INFO nova.api.openstack.requestlog [None req-558e80b5-8511-4125-b0de-2943c22af5b0 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.455693 Aug 31 15:40:42.373412 n-d-833090-16 devstack@n-api.service[112970]: [pid: 112970|app: 0|req: 28/54] 10.222.0.50 () {64 vars in 1235 bytes} [Wed Aug 31 15:40:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:40:43.367096 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi [None req-dd6d1a08-fb3b-49f0-88f5-47a487f162b6 admin admin] Calling method '>' {{(pid=112969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:40:43.368131 n-d-833090-16 devstack@n-api.service[112969]: INFO nova.api.openstack.requestlog [None req-dd6d1a08-fb3b-49f0-88f5-47a487f162b6 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 31 15:40:43.368523 n-d-833090-16 devstack@n-api.service[112969]: [pid: 112969|app: 0|req: 27/55] 10.222.0.50 () {56 vars in 1074 bytes} [Wed Aug 31 15:40:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:40:43.932568 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi [None req-762d1a56-bbc2-4da1-b1ca-2c9d037f1653 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:40:43.962307 n-d-833090-16 devstack@n-api.service[112970]: INFO nova.api.openstack.requestlog [None req-762d1a56-bbc2-4da1-b1ca-2c9d037f1653 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.457059 Aug 31 15:40:43.962991 n-d-833090-16 devstack@n-api.service[112970]: [pid: 112970|app: 0|req: 29/56] 10.222.0.50 () {64 vars in 1235 bytes} [Wed Aug 31 15:40:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:40:44.954482 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi [None req-dd6d1a08-fb3b-49f0-88f5-47a487f162b6 admin admin] Calling method '>' {{(pid=112969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:40:44.955506 n-d-833090-16 devstack@n-api.service[112969]: INFO nova.api.openstack.requestlog [None req-dd6d1a08-fb3b-49f0-88f5-47a487f162b6 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Aug 31 15:40:44.955906 n-d-833090-16 devstack@n-api.service[112969]: [pid: 112969|app: 0|req: 28/57] 10.222.0.50 () {56 vars in 1074 bytes} [Wed Aug 31 15:40:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:40:45.539629 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi [None req-9523428f-92a5-441b-909d-7dbfb5fcf7e4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:40:45.561600 n-d-833090-16 devstack@n-api.service[112970]: INFO nova.api.openstack.requestlog [None req-9523428f-92a5-441b-909d-7dbfb5fcf7e4 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.468050 Aug 31 15:40:45.562153 n-d-833090-16 devstack@n-api.service[112970]: [pid: 112970|app: 0|req: 30/58] 10.222.0.50 () {64 vars in 1235 bytes} [Wed Aug 31 15:40:45 2022] POST /compute/v2.1/flavors => generated 407 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:40:46.563142 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi [None req-dd6d1a08-fb3b-49f0-88f5-47a487f162b6 admin admin] Calling method '>' {{(pid=112969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:40:46.564200 n-d-833090-16 devstack@n-api.service[112969]: INFO nova.api.openstack.requestlog [None req-dd6d1a08-fb3b-49f0-88f5-47a487f162b6 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001536 Aug 31 15:40:46.564594 n-d-833090-16 devstack@n-api.service[112969]: [pid: 112969|app: 0|req: 29/59] 10.222.0.50 () {56 vars in 1074 bytes} [Wed Aug 31 15:40:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:40:47.151832 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi [None req-ca1ed29b-615d-438d-89df-aff2c7cc778b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:40:47.172459 n-d-833090-16 devstack@n-api.service[112970]: INFO nova.api.openstack.requestlog [None req-ca1ed29b-615d-438d-89df-aff2c7cc778b admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.465279 Aug 31 15:40:47.173003 n-d-833090-16 devstack@n-api.service[112970]: [pid: 112970|app: 0|req: 31/60] 10.222.0.50 () {64 vars in 1235 bytes} [Wed Aug 31 15:40:46 2022] POST /compute/v2.1/flavors => generated 409 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:40:48.444521 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi [None req-dd6d1a08-fb3b-49f0-88f5-47a487f162b6 admin admin] Calling method '>' {{(pid=112969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:40:48.445935 n-d-833090-16 devstack@n-api.service[112969]: INFO nova.api.openstack.requestlog [None req-dd6d1a08-fb3b-49f0-88f5-47a487f162b6 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002003 Aug 31 15:40:48.446526 n-d-833090-16 devstack@n-api.service[112969]: [pid: 112969|app: 0|req: 30/61] 10.222.0.50 () {56 vars in 1074 bytes} [Wed Aug 31 15:40:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:40:49.023662 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi [None req-47f98689-1e48-4b1d-bd8f-0a568c135b27 admin admin] Calling method '>' {{(pid=112970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:40:49.044391 n-d-833090-16 devstack@n-api.service[112970]: INFO nova.api.openstack.requestlog [None req-47f98689-1e48-4b1d-bd8f-0a568c135b27 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.454551 Aug 31 15:40:49.044950 n-d-833090-16 devstack@n-api.service[112970]: [pid: 112970|app: 0|req: 32/62] 10.222.0.50 () {60 vars in 1202 bytes} [Wed Aug 31 15:40:48 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:41:43.624289 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi [None req-dd6d1a08-fb3b-49f0-88f5-47a487f162b6 admin admin] Calling method '>' {{(pid=112969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:41:43.625216 n-d-833090-16 devstack@n-api.service[112969]: INFO nova.api.openstack.requestlog [None req-dd6d1a08-fb3b-49f0-88f5-47a487f162b6 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Aug 31 15:41:43.625874 n-d-833090-16 devstack@n-api.service[112969]: [pid: 112969|app: 0|req: 31/63] 10.222.0.50 () {54 vars in 931 bytes} [Wed Aug 31 15:41:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:41:43.639608 n-d-833090-16 devstack@n-api.service[112970]: DEBUG dbcounter [-] [112970] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=112970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:41:44.058052 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi [None req-e04afac8-8781-43f4-b1cc-54a62d38a206 admin admin] Calling method '>' {{(pid=112970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:41:44.081678 n-d-833090-16 devstack@n-api.service[112970]: INFO nova.api.openstack.requestlog [None req-e04afac8-8781-43f4-b1cc-54a62d38a206 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.446563 Aug 31 15:41:44.082238 n-d-833090-16 devstack@n-api.service[112970]: [pid: 112970|app: 0|req: 33/64] 10.222.0.50 () {60 vars in 1292 bytes} [Wed Aug 31 15:41:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 15:41:44.104822 n-d-833090-16 devstack@n-api.service[112969]: DEBUG dbcounter [-] [112969] Writing DB stats nova_api:SELECT=14 {{(pid=112969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:41:44.110238 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi [None req-ce21c6db-b4aa-4288-977f-6b67e6c7375d admin admin] Calling method '>' {{(pid=112969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:41:44.122213 n-d-833090-16 devstack@n-api.service[112969]: INFO nova.api.openstack.requestlog [None req-ce21c6db-b4aa-4288-977f-6b67e6c7375d admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.019539 Aug 31 15:41:44.122928 n-d-833090-16 devstack@n-api.service[112969]: [pid: 112969|app: 0|req: 32/65] 10.222.0.50 () {60 vars in 1283 bytes} [Wed Aug 31 15:41:44 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:41:44.136915 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi [None req-5fab4021-67d1-4415-8795-a5506508f6cc admin admin] Calling method '>' {{(pid=112970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:41:44.144661 n-d-833090-16 devstack@n-api.service[112970]: INFO nova.api.openstack.requestlog [None req-5fab4021-67d1-4415-8795-a5506508f6cc admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011322 Aug 31 15:41:44.145170 n-d-833090-16 devstack@n-api.service[112970]: [pid: 112970|app: 0|req: 34/66] 10.222.0.50 () {60 vars in 1286 bytes} [Wed Aug 31 15:41:44 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:41:44.156638 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi [None req-c065b285-8266-4242-839c-5e29b52110c6 admin admin] Calling method '>' {{(pid=112969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:41:44.165379 n-d-833090-16 devstack@n-api.service[112969]: INFO nova.api.openstack.requestlog [None req-c065b285-8266-4242-839c-5e29b52110c6 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012370 Aug 31 15:41:44.165916 n-d-833090-16 devstack@n-api.service[112969]: [pid: 112969|app: 0|req: 33/67] 10.222.0.50 () {60 vars in 1286 bytes} [Wed Aug 31 15:41:44 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:41:44.177818 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi [None req-c655d982-15bb-49d6-ba14-27902111f4a4 admin admin] Calling method '>' {{(pid=112970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:41:44.185963 n-d-833090-16 devstack@n-api.service[112970]: INFO nova.api.openstack.requestlog [None req-c655d982-15bb-49d6-ba14-27902111f4a4 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012075 Aug 31 15:41:44.186533 n-d-833090-16 devstack@n-api.service[112970]: [pid: 112970|app: 0|req: 35/68] 10.222.0.50 () {60 vars in 1283 bytes} [Wed Aug 31 15:41:44 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:47:17.102700 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi [None req-c065b285-8266-4242-839c-5e29b52110c6 admin admin] Calling method '>' {{(pid=112969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:47:17.103718 n-d-833090-16 devstack@n-api.service[112969]: INFO nova.api.openstack.requestlog [None req-c065b285-8266-4242-839c-5e29b52110c6 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Aug 31 15:47:17.104132 n-d-833090-16 devstack@n-api.service[112969]: [pid: 112969|app: 0|req: 34/69] 10.222.0.50 () {56 vars in 1074 bytes} [Wed Aug 31 15:47:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:47:17.247818 n-d-833090-16 devstack@n-api.service[112970]: DEBUG dbcounter [-] [112970] Writing DB stats nova_api:SELECT=6 {{(pid=112970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:47:17.405723 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi [None req-6e999c13-e3bb-44d3-8a90-22447c3d2d46 admin admin] Calling method '>' {{(pid=112970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:47:17.411041 n-d-833090-16 devstack@n-api.service[112970]: DEBUG oslo_concurrency.lockutils [None req-6e999c13-e3bb-44d3-8a90-22447c3d2d46 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:47:17.411565 n-d-833090-16 devstack@n-api.service[112970]: DEBUG oslo_concurrency.lockutils [None req-6e999c13-e3bb-44d3-8a90-22447c3d2d46 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:47:17.412105 n-d-833090-16 devstack@n-api.service[112970]: DEBUG oslo_concurrency.lockutils [None req-6e999c13-e3bb-44d3-8a90-22447c3d2d46 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:47:17.412822 n-d-833090-16 devstack@n-api.service[112970]: DEBUG oslo_concurrency.lockutils [None req-6e999c13-e3bb-44d3-8a90-22447c3d2d46 admin admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:47:17.413269 n-d-833090-16 devstack@n-api.service[112970]: DEBUG oslo_concurrency.lockutils [None req-6e999c13-e3bb-44d3-8a90-22447c3d2d46 admin admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:47:17.413686 n-d-833090-16 devstack@n-api.service[112970]: DEBUG oslo_concurrency.lockutils [None req-6e999c13-e3bb-44d3-8a90-22447c3d2d46 admin admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:47:17.455138 n-d-833090-16 devstack@n-api.service[112970]: INFO nova.api.openstack.requestlog [None req-6e999c13-e3bb-44d3-8a90-22447c3d2d46 admin admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.90 time: 0.210134 Aug 31 15:47:17.455692 n-d-833090-16 devstack@n-api.service[112970]: [pid: 112970|app: 0|req: 36/70] 10.222.0.50 () {60 vars in 1193 bytes} [Wed Aug 31 15:47:17 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:47:18.284131 n-d-833090-16 devstack@n-api.service[112969]: DEBUG nova.api.openstack.wsgi [None req-c065b285-8266-4242-839c-5e29b52110c6 admin admin] Calling method '>' {{(pid=112969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:47:18.285152 n-d-833090-16 devstack@n-api.service[112969]: INFO nova.api.openstack.requestlog [None req-c065b285-8266-4242-839c-5e29b52110c6 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Aug 31 15:47:18.285552 n-d-833090-16 devstack@n-api.service[112969]: [pid: 112969|app: 0|req: 35/71] 10.222.0.50 () {56 vars in 1074 bytes} [Wed Aug 31 15:47:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:47:18.483360 n-d-833090-16 devstack@n-api.service[112970]: DEBUG nova.api.openstack.wsgi [None req-f918c3d7-e706-4567-82eb-0a7f65e5d77c admin admin] Calling method '>' {{(pid=112970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:47:18.487003 n-d-833090-16 devstack@n-api.service[112970]: DEBUG oslo_concurrency.lockutils [None req-f918c3d7-e706-4567-82eb-0a7f65e5d77c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:47:18.487615 n-d-833090-16 devstack@n-api.service[112970]: DEBUG oslo_concurrency.lockutils [None req-f918c3d7-e706-4567-82eb-0a7f65e5d77c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:47:18.488042 n-d-833090-16 devstack@n-api.service[112970]: DEBUG oslo_concurrency.lockutils [None req-f918c3d7-e706-4567-82eb-0a7f65e5d77c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:47:18.489293 n-d-833090-16 devstack@n-api.service[112970]: DEBUG oslo_concurrency.lockutils [None req-f918c3d7-e706-4567-82eb-0a7f65e5d77c admin admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:47:18.489744 n-d-833090-16 devstack@n-api.service[112970]: DEBUG oslo_concurrency.lockutils [None req-f918c3d7-e706-4567-82eb-0a7f65e5d77c admin admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:47:18.491491 n-d-833090-16 devstack@n-api.service[112970]: DEBUG oslo_concurrency.lockutils [None req-f918c3d7-e706-4567-82eb-0a7f65e5d77c admin admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:47:18.515054 n-d-833090-16 devstack@n-api.service[112970]: INFO nova.api.openstack.requestlog [None req-f918c3d7-e706-4567-82eb-0a7f65e5d77c admin admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.90 time: 0.087407 Aug 31 15:47:18.515827 n-d-833090-16 devstack@n-api.service[112970]: [pid: 112970|app: 0|req: 37/72] 10.222.0.50 () {60 vars in 1193 bytes} [Wed Aug 31 15:47:18 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:48:03.730608 n-d-833090-16 devstack@n-api.service[112961]: Wed Aug 31 15:48:03 2022 - graceful shutdown triggered... Aug 31 15:48:03.730701 n-d-833090-16 systemd[1]: Stopping Devstack devstack@n-api.service... Aug 31 15:48:03.731687 n-d-833090-16 devstack@n-api.service[112969]: Gracefully killing worker 1 (pid: 112969)... Aug 31 15:48:03.732122 n-d-833090-16 devstack@n-api.service[112970]: Gracefully killing worker 2 (pid: 112970)... Aug 31 15:48:04.732475 n-d-833090-16 devstack@n-api.service[112961]: worker 1 buried after 1 seconds Aug 31 15:48:04.732475 n-d-833090-16 devstack@n-api.service[112961]: worker 2 buried after 1 seconds Aug 31 15:48:04.732475 n-d-833090-16 devstack@n-api.service[112961]: goodbye to uWSGI. Aug 31 15:48:04.735365 n-d-833090-16 systemd[1]: devstack@n-api.service: Succeeded. Aug 31 15:48:04.736372 n-d-833090-16 systemd[1]: Stopped Devstack devstack@n-api.service. Aug 31 15:48:04.741749 n-d-833090-16 systemd[1]: Starting Devstack devstack@n-api.service... Aug 31 15:48:04.759389 n-d-833090-16 devstack@n-api.service[128852]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 31 15:48:04.776546 n-d-833090-16 devstack@n-api.service[128852]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 15:48:04 2022] *** Aug 31 15:48:04.776922 n-d-833090-16 devstack@n-api.service[128852]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 15:48:04.777240 n-d-833090-16 devstack@n-api.service[128852]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 15:48:04.777515 n-d-833090-16 devstack@n-api.service[128852]: nodename: n-d-833090-16 Aug 31 15:48:04.777772 n-d-833090-16 devstack@n-api.service[128852]: machine: x86_64 Aug 31 15:48:04.778021 n-d-833090-16 devstack@n-api.service[128852]: clock source: unix Aug 31 15:48:04.778396 n-d-833090-16 devstack@n-api.service[128852]: pcre jit disabled Aug 31 15:48:04.778637 n-d-833090-16 devstack@n-api.service[128852]: detected number of CPU cores: 4 Aug 31 15:48:04.778910 n-d-833090-16 devstack@n-api.service[128852]: current working directory: / Aug 31 15:48:04.779153 n-d-833090-16 devstack@n-api.service[128852]: detected binary path: /usr/bin/uwsgi-core Aug 31 15:48:04.779419 n-d-833090-16 devstack@n-api.service[128852]: your processes number limit is 47680 Aug 31 15:48:04.779667 n-d-833090-16 devstack@n-api.service[128852]: your memory page size is 4096 bytes Aug 31 15:48:04.779912 n-d-833090-16 devstack@n-api.service[128852]: detected max file descriptor number: 2048 Aug 31 15:48:04.780155 n-d-833090-16 devstack@n-api.service[128852]: lock engine: pthread robust mutexes Aug 31 15:48:04.780705 n-d-833090-16 devstack@n-api.service[128852]: thunder lock: enabled Aug 31 15:48:04.781101 n-d-833090-16 devstack@n-api.service[128852]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 31 15:48:04.781234 n-d-833090-16 devstack@n-api.service[128852]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 15:48:04.822694 n-d-833090-16 devstack@n-api.service[128852]: Python main interpreter initialized at 0x5588bafa99c0 Aug 31 15:48:04.822694 n-d-833090-16 devstack@n-api.service[128852]: python threads support enabled Aug 31 15:48:04.822694 n-d-833090-16 devstack@n-api.service[128852]: your server socket listen backlog is limited to 100 connections Aug 31 15:48:04.822694 n-d-833090-16 devstack@n-api.service[128852]: your mercy for graceful operations on workers is 90 seconds Aug 31 15:48:04.823172 n-d-833090-16 devstack@n-api.service[128852]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 15:48:04.823172 n-d-833090-16 devstack@n-api.service[128852]: *** Operational MODE: preforking *** Aug 31 15:48:04.823366 n-d-833090-16 devstack@n-api.service[128852]: *** uWSGI is running in multiple interpreter mode *** Aug 31 15:48:04.823366 n-d-833090-16 devstack@n-api.service[128852]: spawned uWSGI master process (pid: 128852) Aug 31 15:48:04.823607 n-d-833090-16 systemd[1]: Started Devstack devstack@n-api.service. Aug 31 15:48:04.825675 n-d-833090-16 devstack@n-api.service[128852]: spawned uWSGI worker 1 (pid: 128863, cores: 1) Aug 31 15:48:04.825675 n-d-833090-16 devstack@n-api.service[128852]: spawned uWSGI worker 2 (pid: 128864, cores: 1) Aug 31 15:48:04.825675 n-d-833090-16 devstack@n-api.service[128852]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 15:48:05.475642 n-d-833090-16 devstack@n-api.service[128864]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 15:48:05.476313 n-d-833090-16 devstack@n-api.service[128863]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 31 15:48:06.637539 n-d-833090-16 devstack@n-api.service[128864]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 15:48:06.637539 n-d-833090-16 devstack@n-api.service[128864]: from cryptography.utils import int_from_bytes Aug 31 15:48:06.638147 n-d-833090-16 devstack@n-api.service[128864]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 15:48:06.638147 n-d-833090-16 devstack@n-api.service[128864]: from cryptography.utils import int_from_bytes Aug 31 15:48:06.704381 n-d-833090-16 devstack@n-api.service[128863]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 15:48:06.704381 n-d-833090-16 devstack@n-api.service[128863]: from cryptography.utils import int_from_bytes Aug 31 15:48:06.705028 n-d-833090-16 devstack@n-api.service[128863]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 15:48:06.705028 n-d-833090-16 devstack@n-api.service[128863]: from cryptography.utils import int_from_bytes Aug 31 15:48:09.060622 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 15:48:09.061208 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 15:48:09.061400 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 15:48:09.061764 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 15:48:09.062022 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 15:48:09.062445 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.062781 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.063110 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.063401 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.063751 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.064065 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.064392 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.064713 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.065049 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.065310 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.065741 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.065987 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-833090-16 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.066466 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.066789 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.067104 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.067423 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.067736 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.068063 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.068370 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.068880 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.070229 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.070229 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.070229 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.070513 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.070588 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.070904 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.071227 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.071538 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.071865 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.072177 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.072578 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-833090-16 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.072884 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.073202 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.073526 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.073944 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.074359 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.074677 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.075008 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.075338 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.075647 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.075979 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.076305 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.076629 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.076954 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.077259 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.077571 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.077883 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.078229 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.078546 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.078853 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.079104 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.079417 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.079742 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.080066 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.080392 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.080645 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.080896 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.081309 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.082011 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.082213 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.082501 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.082772 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.083085 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.083401 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.083718 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.084030 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.084340 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.084663 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.084992 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.085315 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.085628 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.085954 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.086381 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.086633 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.086945 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.087321 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.087642 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.087956 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.088281 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.088599 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.088900 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.089221 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.089528 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.089853 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.090219 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.090528 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.090757 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.091063 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.091369 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.091690 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.091996 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.092304 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.092610 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.092915 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.093224 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.093532 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.093822 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.094146 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.094458 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.094764 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.095081 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.095387 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.095692 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.096010 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.096335 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.096642 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.097003 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.097593 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.097797 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.097970 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.098268 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.098579 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.098905 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.099212 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.099521 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.099843 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.100152 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.100460 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.100784 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.101089 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.101398 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.101720 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.102033 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.102369 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.102714 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.103021 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.103324 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.103606 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.103955 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.104248 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.104555 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.104876 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.105177 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.105494 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.105808 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.106143 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.106471 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.106817 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.107154 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.107508 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.107830 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.108172 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.108511 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.108834 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.109155 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.109472 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.109805 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.110142 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.110459 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.110775 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.111097 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.111419 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.111754 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.112074 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.112394 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.113336 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.113336 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.113957 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.114259 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.114569 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.114835 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.115227 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.115582 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.115898 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.116232 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.116536 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.116851 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.117167 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.117481 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.117800 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.118157 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.118477 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.118800 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.119117 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.119447 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.119762 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.120164 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.120390 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.120703 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.121017 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.121360 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.121683 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.122011 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.122369 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.122687 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.123007 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.123325 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.123641 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.123959 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.124330 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.124614 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.124924 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.125243 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.125552 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.125878 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.126235 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.126549 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.126899 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.127199 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.127498 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.127827 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.128626 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.128964 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.129274 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.129579 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.129890 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.130251 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.130570 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.130883 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.131213 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.131524 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.131835 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.132159 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.132473 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.132793 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.133110 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.133430 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.133761 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.134082 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.134474 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.134798 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.135122 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.135434 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.135770 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.136099 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.136422 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.136733 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.137047 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.137351 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.137664 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.137973 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.138306 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.138632 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.138928 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.139255 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.139560 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.139875 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.140207 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.140508 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.140818 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.141127 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.141435 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.142034 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.142379 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.142737 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.143082 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.143413 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.143778 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.144102 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.144411 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.144736 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.145089 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.145359 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.145693 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.146011 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.146355 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.146683 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.147000 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.147334 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.147652 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.148094 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.148291 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.148618 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.148951 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.149296 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.149621 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.149951 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.150304 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.150627 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.150945 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.151263 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.151578 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.151896 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.152219 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.152534 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.152859 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.153174 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.153504 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.153820 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.154169 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.154482 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.154829 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.155160 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.155503 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.155832 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.156130 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.156459 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.156773 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.157086 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.157403 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.157715 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.158026 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.158377 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.158693 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.159012 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.159357 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.159720 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.160024 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.160344 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.160657 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.160963 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.161283 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.161616 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.161931 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.162288 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.162602 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.162915 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.163231 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.163557 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.163871 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.164182 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.164496 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.164806 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.165230 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.165552 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.165863 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.166210 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.166541 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.166857 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.167180 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.167495 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.167809 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.168139 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.168459 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.168775 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.169095 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.169411 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.169727 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.170045 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.170401 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.170720 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.171035 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.171351 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.171663 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.171978 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.172299 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.172893 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.173236 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.173555 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.173878 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.174228 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.174583 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.174948 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.176008 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.176008 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.176008 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.176301 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.176611 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.176918 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.177231 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.177539 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.177849 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.178181 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.178497 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.178802 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.179109 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.179420 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.179728 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.180048 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.180354 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.180669 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.180978 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.181305 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.181618 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.181923 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.182253 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.182563 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.182909 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.183218 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.183562 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.183896 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.184243 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.184554 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.184865 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.185195 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.185513 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.185822 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.186149 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.186467 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.186781 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.187090 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.187407 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.187725 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.188040 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.188355 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.188665 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.188978 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.189286 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.189607 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.189921 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.190254 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.190663 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.191093 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.191745 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.191995 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.192253 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.192566 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.192891 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.193204 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.193515 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.193828 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.194166 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.194481 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.194791 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.195119 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.195440 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.195756 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.196068 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.196382 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.196690 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.197000 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.197313 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.197640 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.197962 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.198294 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.198610 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.198949 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.199257 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.199567 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.199877 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.200184 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.200493 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.200798 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.201100 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.201414 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.201739 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.202052 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.202383 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.202677 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.202982 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.203330 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.203641 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.204005 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.204311 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.204629 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.204952 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.205265 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.205584 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.205898 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.206457 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.206786 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.207104 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.207423 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.207733 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.208041 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.208370 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.208686 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.209001 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.209329 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.209658 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.209988 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.210323 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.210641 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.210955 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.211270 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.211584 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.211899 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.212215 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.212531 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.212846 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.213159 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.213471 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.213783 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.214123 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.214431 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.214742 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.215071 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.215383 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.215696 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.216015 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.216363 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.216639 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.216951 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.217951 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 15:48:09.218464 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.218606 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 15:48:09.218730 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.218730 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.218956 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 15:48:09.219077 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.219189 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 15:48:09.219315 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.219434 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 15:48:09.219567 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.219659 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.219744 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.219840 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.219936 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.220029 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.220170 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.220262 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.220453 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.220636 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.220734 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.220820 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.220912 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.220999 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.221149 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.221505 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.221613 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.221710 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.221865 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.221965 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.222140 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.222391 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.222586 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.222696 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-833090-16 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.222796 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.223037 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.223191 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.223301 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.223399 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.223641 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.223782 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.223957 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.224112 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.224216 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.224313 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.224572 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.224715 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.224879 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.225034 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.225316 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.225455 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.225691 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.225833 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.225994 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.226152 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.226336 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.226477 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.226675 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.226835 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.227004 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.227100 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.227283 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.227445 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.227576 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.227699 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.227916 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.228057 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.228243 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.228393 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.228492 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.228594 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.228874 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.229023 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-833090-16 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.229169 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.229284 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.229511 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.229652 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.229802 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.229908 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.230139 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.230276 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.230452 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.230549 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.230795 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.230950 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.231125 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.231265 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.231434 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.231545 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.231721 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.231841 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.232088 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.232266 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.232363 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.232459 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.232707 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.232850 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.233032 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.233193 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.233298 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.233387 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.233628 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.233782 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.233896 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.233995 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.234264 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.234584 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.234702 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.234794 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.234896 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.234991 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.235084 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.235171 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.235401 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.235541 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.235697 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.235804 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.236043 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.236184 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.236337 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.236433 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.236605 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.236746 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.236842 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.237014 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.237155 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.237313 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.237489 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.237656 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.237799 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.238017 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.238246 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.238373 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.238465 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.238978 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.239119 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.239305 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.239443 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.239616 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.239713 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.239910 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.240053 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.240186 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.240307 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.240520 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.240716 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.240821 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.240958 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.241144 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.241299 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.241433 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.241546 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.241760 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.241906 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.242122 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.242285 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.242413 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.242514 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.242747 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.242888 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.243086 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.243244 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.243375 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.243476 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.243712 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.243871 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.243981 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.244082 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.244307 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.244427 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.244612 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.244743 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.244948 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.245234 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.245341 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.245558 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.245657 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.245870 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.245980 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.246191 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.246317 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.246458 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.246576 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.246759 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.246872 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.247063 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.247244 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.247371 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.247491 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.247673 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.247772 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.247974 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.248071 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.248264 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.248392 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.248578 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.248676 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.248882 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.248987 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.249182 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.249280 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.249499 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.249599 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.249793 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.249897 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.250082 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.250201 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.250421 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.250532 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.250714 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.250814 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.251001 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.251149 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.251321 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.251441 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.251636 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.251779 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.251957 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.252064 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.252261 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.252367 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.252566 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.252671 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.252869 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.252976 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.253252 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.253437 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.253566 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.253791 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.253888 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.254140 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.254241 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.254460 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.254573 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.254768 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.254869 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.255077 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.255336 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.255443 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.255678 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.255772 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.255983 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.256084 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.256309 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.256442 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.256614 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.256719 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.256920 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.257026 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.257237 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.257348 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.257542 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.257643 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.257846 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.257942 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.258172 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.258287 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.258478 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.258573 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.258780 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.258883 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.259086 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.259190 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.259387 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.259483 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.259688 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.259790 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.259992 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.260131 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.260308 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.260402 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.260627 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.260721 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.260938 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.261032 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.261246 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.261341 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.261551 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.261654 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.261869 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 15:48:09.261966 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.262227 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.262325 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.262559 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.262667 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.262878 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.262973 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.263190 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.263284 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.263503 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.263610 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.263821 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.263967 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.264137 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.264232 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.264447 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.264554 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.264758 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.264859 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.265072 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.265172 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.265392 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.265497 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.265704 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.265806 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.266018 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.266141 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.266441 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.266547 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.266683 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.266784 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.267005 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.267136 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.267322 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.267440 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.267638 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.267838 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.267960 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.268158 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.268274 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.268494 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.268587 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.268851 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.268943 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.269183 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.269418 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.269518 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.269739 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.269832 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.270085 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.270285 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.270453 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.270547 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.270765 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.270866 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.271080 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.271173 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.271411 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.271551 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.271689 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.271786 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.272002 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.272138 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.272309 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.272422 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.272635 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.272872 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.272980 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.273199 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.273300 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.273516 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.273619 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.273865 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.274052 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.274202 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.274435 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.274530 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.274758 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.274908 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.275089 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.275192 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.275404 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.275511 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.275713 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.275817 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.276035 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.276127 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.276347 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.276453 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.276664 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.276778 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.276974 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.277074 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.277284 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.277378 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.277596 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.277698 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.277905 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.277998 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.278237 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.278347 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.278549 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.278642 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.278858 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.278952 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.279163 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.279262 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.279464 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.279557 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.279769 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.279868 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.280070 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.280172 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.280391 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.280485 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.280700 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.280800 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.281010 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.281103 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.281313 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.281416 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.281622 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.281758 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.281930 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.282060 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.282241 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.282333 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.282556 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.282661 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.282860 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.282967 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.283168 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.283261 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.283475 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.283575 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.283781 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.283885 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.284093 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.284187 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.284453 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.284713 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.284805 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.285112 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.285214 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.285444 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.285539 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.285751 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.285858 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.286060 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.286180 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.286402 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.286495 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.286720 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.286853 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.287032 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.287135 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.287347 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.287446 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.287660 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.287802 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.287985 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.288078 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.288301 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.288394 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.288622 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.288830 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.288947 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.289168 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.289281 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.289493 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.289598 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.289828 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.289922 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.290191 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.290290 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.290505 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.290616 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.290816 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.290917 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.291127 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.291259 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.291435 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.291547 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.291740 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.291833 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.292047 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.292139 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.292358 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.292448 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.292661 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.292756 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.292968 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.293071 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.293274 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.293376 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.293583 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.293676 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.293889 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.293990 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.294225 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.294319 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.294539 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.294641 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.294846 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.294947 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.295151 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.295251 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.295455 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.295548 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.295766 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.296000 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.296095 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.296325 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.296439 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.296683 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.296808 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.297030 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.297126 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.297347 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.297449 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.297665 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.297760 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.297981 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.298118 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.298395 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.298502 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.298727 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.298868 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.299023 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.299125 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.299342 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.299434 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.299654 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.299760 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.300004 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.300239 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.300337 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.300566 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.300712 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.300895 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.301035 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.301210 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.301356 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.301540 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.301681 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.301855 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.301993 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.302223 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.302330 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.302502 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.302642 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.302821 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.302957 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.303166 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.303268 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.303503 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.303611 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.303824 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.303926 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.304150 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.304244 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.304464 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.304569 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.304782 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.304876 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.305099 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.305202 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.305412 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.305524 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.305723 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.305818 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.306042 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.306202 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.306390 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.306486 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.306702 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.306794 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.307013 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.307169 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.307322 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.307451 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.307634 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.307736 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.307942 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.308052 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.308248 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.308339 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.308554 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.308654 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.308859 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.308988 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.309173 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.309275 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.309481 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.309589 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.309787 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.309889 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.310114 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.310212 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.310425 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.310527 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.310732 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.310827 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.311039 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.311140 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.311347 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.311440 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.311651 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.311752 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.311955 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.312054 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.312259 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.312365 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.312566 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.312670 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.312872 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.313007 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.313184 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.313288 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.313497 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.313627 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.313817 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.313915 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.314153 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.314282 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.314461 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.314558 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.314768 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.314865 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.315081 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.315190 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.315405 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.315527 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.315780 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.315880 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.316105 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.316209 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.316421 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.316570 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.316755 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.316849 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.317064 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.317159 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.317376 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.317476 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.317685 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.317789 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.317992 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.318152 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.318325 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.318420 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.318631 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.318725 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.318957 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.319087 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.319272 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.319405 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.319577 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.319685 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.319895 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.319997 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.320214 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.320321 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.320531 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.320633 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.320839 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.320942 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.321149 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.321242 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.321455 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.321557 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.321777 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.321878 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.322085 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.322197 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.322419 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.322533 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.322732 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.322833 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.323041 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.323135 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.323354 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.323448 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.323663 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.323764 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.323975 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.324069 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.324282 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.324376 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.324593 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.324695 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.324905 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.325000 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.325212 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.325306 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.325522 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.325623 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.325846 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.325954 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.326195 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.326446 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.326549 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.326782 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.326878 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.327097 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.327192 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.327417 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.327511 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.327736 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.327831 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.328085 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.328234 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.328402 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.328505 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.328648 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 15:48:09.328751 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.329028 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.329331 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.329641 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.329947 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.330279 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.330591 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.330893 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.331274 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.331578 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.331890 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.332188 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.332491 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.332793 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.333096 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.333409 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.333713 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.334023 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.334356 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.334679 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.334987 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.335289 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.335590 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.335897 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.336237 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.336538 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.336876 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.337207 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.337551 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.337858 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.338187 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.338517 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.338824 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.339131 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.339438 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.339747 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.340058 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.340362 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.340676 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.340989 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.341299 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.341610 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.341914 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.342256 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.342571 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.342888 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.343199 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.343504 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.343807 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.344116 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.344426 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.344728 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.345036 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.345339 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.345659 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.345962 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.346295 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.367345 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.367345 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.367345 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.367345 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.367345 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.367345 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.367345 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.367345 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.369295 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.369295 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.369295 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.369295 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.369295 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.369295 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.369295 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.369295 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.375248 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.375248 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.375248 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.375248 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.375248 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.375248 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.375248 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.375248 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.377930 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.377930 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.377930 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.377930 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.377930 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.377930 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.377930 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.377930 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.379785 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.379785 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.379785 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.379785 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.379785 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.379785 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.379785 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.379785 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.380665 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.380665 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.380665 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.380665 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.380665 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.380665 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.380665 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.380665 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.381711 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.381711 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.381711 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.381711 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.381711 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.381711 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.381711 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.381711 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.382616 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.382616 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.382616 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.382616 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.382616 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.382616 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.382616 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.382616 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.383455 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.383455 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.383455 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.383455 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.383455 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.383455 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.383455 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.383455 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.384253 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.384253 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.384253 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.384253 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.384253 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.384253 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.384253 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.384253 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.385043 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.385043 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.385043 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.385043 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.385043 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.385043 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.385043 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.385043 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.386431 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.386431 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.386431 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.386431 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.386431 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.386431 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.386431 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.386431 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.387239 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.387239 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.387239 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.387239 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.387239 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.387239 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.387239 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.387239 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.388038 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.388038 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.388038 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.388038 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.388038 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.388038 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.388038 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.388038 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.388951 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.388951 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.388951 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.388951 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.388951 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.388951 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.388951 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.388951 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.390005 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.390005 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.390005 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.390005 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.390005 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.390005 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.390630 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.390630 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.390864 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.391177 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.391490 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.391801 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.392110 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.392414 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.392737 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.393043 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.393367 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.393792 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.394239 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.394571 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.394885 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.395215 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.395534 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.395841 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.396151 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.396464 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.396811 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.397120 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.397444 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.397777 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.398124 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.398445 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.398696 n-d-833090-16 devstack@n-api.service[128864]: INFO dbcounter [None req-104e31d9-7418-4212-9129-2a984e617a06 None None] Registered counter for database nova_api Aug 31 15:48:09.398792 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.399097 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.399418 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.399738 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.400066 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.400375 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.400684 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.400994 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.401302 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.401607 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.401914 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.402257 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.402565 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.402866 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.403169 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.403494 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.403799 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.404141 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.404451 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.404756 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.405062 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.405364 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.405705 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.406011 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.406367 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.406683 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.407007 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.407330 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.407645 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.407960 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.408275 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.408590 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.408904 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.409219 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.409563 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.409879 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.410221 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.410542 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.411102 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.411430 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.411746 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.412059 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.412369 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.412684 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.412997 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.413306 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.413894 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.413894 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.414603 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.414603 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.414919 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.415206 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.415532 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.415854 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.416174 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.416534 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.416810 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.417171 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.417487 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.417796 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.418127 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.418462 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.418762 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.418929 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_db.sqlalchemy.engines [None req-104e31d9-7418-4212-9129-2a984e617a06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128864) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 15:48:09.419114 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.419371 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.419685 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.419999 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.420333 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.420659 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.420926 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.421239 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.421564 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.421893 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.422248 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.422568 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.422884 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.423199 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.423738 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.424054 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.424388 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.424712 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.425300 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.426030 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writer thread running {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 15:48:09.426313 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.426313 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.426313 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.426887 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.426887 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.427166 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.427396 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.427704 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.428028 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.428338 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.428644 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.428962 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.429270 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.429809 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.430189 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.430516 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.431829 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.432169 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.432502 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.432825 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.433181 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.433496 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.433807 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.434152 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.434465 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.434778 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.435072 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.435384 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.435695 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.436009 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.436318 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.436621 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.436954 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.437259 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.437567 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.437875 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.438208 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.438503 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.438812 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.439119 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.439425 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.439739 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.440044 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.440354 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.440737 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.441091 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.441478 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.441792 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.442174 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.442520 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.442814 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.443121 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.443445 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.443757 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.444082 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.444399 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.444710 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.445057 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.445374 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.445919 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.446288 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.446617 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.446957 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.447289 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.447599 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.447909 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.448217 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.448543 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.448855 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.449166 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.449475 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.449790 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.450156 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.450450 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.450763 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.451074 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.451386 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.451693 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.452003 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.452310 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.452616 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.452929 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.453241 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.453584 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.453903 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.454353 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.454587 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.454899 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.455235 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.455551 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.455864 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.456314 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.456801 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.457252 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.457575 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.457889 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.458351 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.458672 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.458994 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.459320 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.459634 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.459963 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.460279 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.460591 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.460913 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.461228 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.461559 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.461904 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.462260 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.462598 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.462906 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.463211 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.463517 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.463827 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.464148 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.464454 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.464764 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.465068 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.465384 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.465689 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.465995 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.466332 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.466664 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.466945 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.467273 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.467580 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.467885 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.468188 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.468491 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.468795 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.469102 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.469406 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.469712 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.470015 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.470348 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.470654 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.470987 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.471322 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.471636 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.472036 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.472348 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.472673 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.472984 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.473307 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.473631 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.473950 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.474286 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.474622 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.474940 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.475251 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.475563 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.475877 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.476185 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.476492 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.476820 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.477147 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.477457 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.477782 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.478142 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.478447 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.478762 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.479072 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.479406 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.479719 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.480031 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.480337 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.480647 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.480955 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.481272 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.481582 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.481891 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.482233 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.482548 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.482876 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.483200 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.483513 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.483841 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.484166 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.484515 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.484833 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.485175 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.485501 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.485816 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.486147 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.486457 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 15:48:09.486700 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 15:48:09.487331 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.context [None req-104e31d9-7418-4212-9129-2a984e617a06 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ff6ab154-5f51-4e0d-922a-904eb5aa20da(cell1) {{(pid=128864) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 15:48:09.491908 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-104e31d9-7418-4212-9129-2a984e617a06 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:48:09.492333 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-104e31d9-7418-4212-9129-2a984e617a06 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:48:09.493923 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-104e31d9-7418-4212-9129-2a984e617a06 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:48:09.494674 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-104e31d9-7418-4212-9129-2a984e617a06 None None] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:48:09.495118 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-104e31d9-7418-4212-9129-2a984e617a06 None None] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:48:09.497133 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-104e31d9-7418-4212-9129-2a984e617a06 None None] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:48:09.499625 n-d-833090-16 devstack@n-api.service[128864]: INFO dbcounter [None req-104e31d9-7418-4212-9129-2a984e617a06 None None] Registered counter for database nova_cell0 Aug 31 15:48:09.505340 n-d-833090-16 devstack@n-api.service[128864]: INFO dbcounter [None req-104e31d9-7418-4212-9129-2a984e617a06 None None] Registered counter for database nova_cell1 Aug 31 15:48:09.513374 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_db.sqlalchemy.engines [None req-104e31d9-7418-4212-9129-2a984e617a06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128864) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 15:48:09.514614 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_db.sqlalchemy.engines [None req-104e31d9-7418-4212-9129-2a984e617a06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128864) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 15:48:09.521536 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writer thread running {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 15:48:09.524277 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writer thread running {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 15:48:09.549808 n-d-833090-16 devstack@n-api.service[128863]: INFO dbcounter [None req-79a137fe-e821-49eb-85ed-e746adf9ec1b None None] Registered counter for database nova_api Aug 31 15:48:09.570602 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_db.sqlalchemy.engines [None req-79a137fe-e821-49eb-85ed-e746adf9ec1b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128863) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 15:48:09.577485 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writer thread running {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 15:48:09.636619 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.context [None req-79a137fe-e821-49eb-85ed-e746adf9ec1b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ff6ab154-5f51-4e0d-922a-904eb5aa20da(cell1) {{(pid=128863) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 15:48:09.640957 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79a137fe-e821-49eb-85ed-e746adf9ec1b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:48:09.641431 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79a137fe-e821-49eb-85ed-e746adf9ec1b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:48:09.643057 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79a137fe-e821-49eb-85ed-e746adf9ec1b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:48:09.644051 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79a137fe-e821-49eb-85ed-e746adf9ec1b None None] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:48:09.644651 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79a137fe-e821-49eb-85ed-e746adf9ec1b None None] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:48:09.646707 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79a137fe-e821-49eb-85ed-e746adf9ec1b None None] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:48:09.648788 n-d-833090-16 devstack@n-api.service[128863]: INFO dbcounter [None req-79a137fe-e821-49eb-85ed-e746adf9ec1b None None] Registered counter for database nova_cell0 Aug 31 15:48:09.654735 n-d-833090-16 devstack@n-api.service[128863]: INFO dbcounter [None req-79a137fe-e821-49eb-85ed-e746adf9ec1b None None] Registered counter for database nova_cell1 Aug 31 15:48:09.662752 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_db.sqlalchemy.engines [None req-79a137fe-e821-49eb-85ed-e746adf9ec1b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128863) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 15:48:09.664936 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_db.sqlalchemy.engines [None req-79a137fe-e821-49eb-85ed-e746adf9ec1b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128863) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 15:48:09.673132 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writer thread running {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 15:48:09.673468 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writer thread running {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 15:48:09.680277 n-d-833090-16 devstack@n-api.service[128864]: INFO dbcounter [None req-104e31d9-7418-4212-9129-2a984e617a06 None None] Registered counter for database nova_cell0 Aug 31 15:48:09.687630 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_db.sqlalchemy.engines [None req-104e31d9-7418-4212-9129-2a984e617a06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128864) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 15:48:09.693264 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writer thread running {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 15:48:09.826537 n-d-833090-16 devstack@n-api.service[128863]: INFO dbcounter [None req-79a137fe-e821-49eb-85ed-e746adf9ec1b None None] Registered counter for database nova_cell0 Aug 31 15:48:09.833465 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_db.sqlalchemy.engines [None req-79a137fe-e821-49eb-85ed-e746adf9ec1b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128863) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 15:48:09.838156 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writer thread running {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 15:48:10.012134 n-d-833090-16 devstack@n-api.service[128864]: WARNING keystonemiddleware.auth_token [None req-104e31d9-7418-4212-9129-2a984e617a06 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 15:48:10.019532 n-d-833090-16 devstack@n-api.service[128864]: WARNING keystonemiddleware.auth_token [None req-104e31d9-7418-4212-9129-2a984e617a06 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 15:48:10.152602 n-d-833090-16 devstack@n-api.service[128863]: WARNING keystonemiddleware.auth_token [None req-79a137fe-e821-49eb-85ed-e746adf9ec1b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 15:48:10.160034 n-d-833090-16 devstack@n-api.service[128863]: WARNING keystonemiddleware.auth_token [None req-79a137fe-e821-49eb-85ed-e746adf9ec1b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 15:48:10.361069 n-d-833090-16 devstack@n-api.service[128864]: WARNING keystonemiddleware.auth_token [None req-104e31d9-7418-4212-9129-2a984e617a06 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 15:48:10.367630 n-d-833090-16 devstack@n-api.service[128864]: WARNING keystonemiddleware.auth_token [None req-104e31d9-7418-4212-9129-2a984e617a06 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 15:48:10.373086 n-d-833090-16 devstack@n-api.service[128864]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5588bafa99c0 pid: 128864 (default app) Aug 31 15:48:10.500465 n-d-833090-16 devstack@n-api.service[128863]: WARNING keystonemiddleware.auth_token [None req-79a137fe-e821-49eb-85ed-e746adf9ec1b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 15:48:10.506671 n-d-833090-16 devstack@n-api.service[128863]: WARNING keystonemiddleware.auth_token [None req-79a137fe-e821-49eb-85ed-e746adf9ec1b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 15:48:10.512148 n-d-833090-16 devstack@n-api.service[128863]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5588bafa99c0 pid: 128863 (default app) Aug 31 15:48:50.120037 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=3 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:48:50.120840 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=3 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:48:50.121595 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=3 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:48:50.122281 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=3 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:48:51.447877 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:48:51.448854 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:48:51.450028 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:48:51.451464 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:48:51.456950 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b50c3f05-c59f-4f8d-89b8-9589479182f7 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Calling method '.version_select at 0x7fbb483568b0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:48:51.465443 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b50c3f05-c59f-4f8d-89b8-9589479182f7 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ff6ab154-5f51-4e0d-922a-904eb5aa20da(cell1) {{(pid=128864) load_cells /opt/stack/nova/nova/compute/api.py:319}} Aug 31 15:48:51.466212 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b50c3f05-c59f-4f8d-89b8-9589479182f7 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:48:51.466883 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b50c3f05-c59f-4f8d-89b8-9589479182f7 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:48:51.467396 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b50c3f05-c59f-4f8d-89b8-9589479182f7 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:48:51.500233 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b50c3f05-c59f-4f8d-89b8-9589479182f7 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:48:51.500843 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b50c3f05-c59f-4f8d-89b8-9589479182f7 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:48:51.501433 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b50c3f05-c59f-4f8d-89b8-9589479182f7 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:48:51.514449 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b50c3f05-c59f-4f8d-89b8-9589479182f7 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:48:51.515001 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b50c3f05-c59f-4f8d-89b8-9589479182f7 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:48:51.515641 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b50c3f05-c59f-4f8d-89b8-9589479182f7 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:48:51.522401 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b50c3f05-c59f-4f8d-89b8-9589479182f7 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 1.412406 Aug 31 15:48:51.523155 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1/1] 10.222.0.50 () {58 vars in 1167 bytes} [Wed Aug 31 15:48:50 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:48:51.541711 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-205f24a1-5399-49d1-8d37-b3c93d400571 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-393179081", "name": "tempest-test_aggregate-1270530476"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:48:51.578372 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.aggregate [None req-205f24a1-5399-49d1-8d37-b3c93d400571 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Generated uuid 24745f90-7a08-4710-a0ad-0d6f7950d740 for aggregate {{(pid=128864) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 31 15:48:51.659384 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-205f24a1-5399-49d1-8d37-b3c93d400571 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.121383 Aug 31 15:48:51.660381 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2/2] 10.222.0.50 () {60 vars in 1165 bytes} [Wed Aug 31 15:48:51 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:48:52.052880 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9cbb7e00-82ab-4c27-bf38-a70f4dc51c2f tempest-AggregatesAdminTestV241-2010438165 tempest-AggregatesAdminTestV241-2010438165-project-admin] Calling method '.version_select at 0x7fbb48b82dc0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:48:52.056514 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9cbb7e00-82ab-4c27-bf38-a70f4dc51c2f tempest-AggregatesAdminTestV241-2010438165 tempest-AggregatesAdminTestV241-2010438165-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:48:52.057690 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9cbb7e00-82ab-4c27-bf38-a70f4dc51c2f tempest-AggregatesAdminTestV241-2010438165 tempest-AggregatesAdminTestV241-2010438165-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:48:52.059195 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9cbb7e00-82ab-4c27-bf38-a70f4dc51c2f tempest-AggregatesAdminTestV241-2010438165 tempest-AggregatesAdminTestV241-2010438165-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:48:52.079881 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9cbb7e00-82ab-4c27-bf38-a70f4dc51c2f tempest-AggregatesAdminTestV241-2010438165 tempest-AggregatesAdminTestV241-2010438165-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:48:52.080718 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9cbb7e00-82ab-4c27-bf38-a70f4dc51c2f tempest-AggregatesAdminTestV241-2010438165 tempest-AggregatesAdminTestV241-2010438165-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:48:52.081329 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9cbb7e00-82ab-4c27-bf38-a70f4dc51c2f tempest-AggregatesAdminTestV241-2010438165 tempest-AggregatesAdminTestV241-2010438165-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:48:52.094364 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9cbb7e00-82ab-4c27-bf38-a70f4dc51c2f tempest-AggregatesAdminTestV241-2010438165 tempest-AggregatesAdminTestV241-2010438165-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:48:52.095065 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9cbb7e00-82ab-4c27-bf38-a70f4dc51c2f tempest-AggregatesAdminTestV241-2010438165 tempest-AggregatesAdminTestV241-2010438165-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:48:52.095702 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9cbb7e00-82ab-4c27-bf38-a70f4dc51c2f tempest-AggregatesAdminTestV241-2010438165 tempest-AggregatesAdminTestV241-2010438165-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:48:52.103233 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9cbb7e00-82ab-4c27-bf38-a70f4dc51c2f tempest-AggregatesAdminTestV241-2010438165 tempest-AggregatesAdminTestV241-2010438165-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1427 microversion: 2.41 time: 0.435121 Aug 31 15:48:52.104174 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3/3] 10.222.0.50 () {60 vars in 1208 bytes} [Wed Aug 31 15:48:51 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1427 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:48:52.109688 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6040d3a8-0cdd-4f79-829e-290b9ad3002c tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:48:52.125509 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6040d3a8-0cdd-4f79-829e-290b9ad3002c tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates" status: 200 len: 301 microversion: 2.1 time: 0.019636 Aug 31 15:48:52.126120 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 4/4] 10.222.0.50 () {58 vars in 1143 bytes} [Wed Aug 31 15:48:52 2022] GET /compute/v2.1/os-aggregates => generated 301 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:48:52.445207 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ad8364d6-c7f9-401d-8ce4-a6ea5e1fa791 tempest-AZAdminV2TestJSON-1469057674 tempest-AZAdminV2TestJSON-1469057674-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:48:52.447121 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ad8364d6-c7f9-401d-8ce4-a6ea5e1fa791 tempest-AZAdminV2TestJSON-1469057674 tempest-AZAdminV2TestJSON-1469057674-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:48:52.447586 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ad8364d6-c7f9-401d-8ce4-a6ea5e1fa791 tempest-AZAdminV2TestJSON-1469057674 tempest-AZAdminV2TestJSON-1469057674-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:48:52.448102 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ad8364d6-c7f9-401d-8ce4-a6ea5e1fa791 tempest-AZAdminV2TestJSON-1469057674 tempest-AZAdminV2TestJSON-1469057674-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:48:52.449165 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ad8364d6-c7f9-401d-8ce4-a6ea5e1fa791 tempest-AZAdminV2TestJSON-1469057674 tempest-AZAdminV2TestJSON-1469057674-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:48:52.449627 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ad8364d6-c7f9-401d-8ce4-a6ea5e1fa791 tempest-AZAdminV2TestJSON-1469057674 tempest-AZAdminV2TestJSON-1469057674-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:48:52.450029 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ad8364d6-c7f9-401d-8ce4-a6ea5e1fa791 tempest-AZAdminV2TestJSON-1469057674 tempest-AZAdminV2TestJSON-1469057674-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:48:52.487001 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ad8364d6-c7f9-401d-8ce4-a6ea5e1fa791 tempest-AZAdminV2TestJSON-1469057674 tempest-AZAdminV2TestJSON-1469057674-project-admin] 10.222.0.50 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.359133 Aug 31 15:48:52.487646 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 5/5] 10.222.0.50 () {58 vars in 1164 bytes} [Wed Aug 31 15:48:52 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 15:48:52.592642 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ea224d5d-834a-4126-b761-0ca55bbb54f2 tempest-AZAdminNegativeTestJSON-1801649600 tempest-AZAdminNegativeTestJSON-1801649600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:48:52.594206 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ea224d5d-834a-4126-b761-0ca55bbb54f2 tempest-AZAdminNegativeTestJSON-1801649600 tempest-AZAdminNegativeTestJSON-1801649600-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'f51b7f0eb1324ff6a1820e5dc099243f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9f031bc0b2465aa07133cc1f90fe9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:48:52.598291 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ea224d5d-834a-4126-b761-0ca55bbb54f2 tempest-AZAdminNegativeTestJSON-1801649600 tempest-AZAdminNegativeTestJSON-1801649600-project] Request method failure captured: Aug 31 15:48:52.598291 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Aug 31 15:48:52.598291 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:48:52.598291 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:48:52.598291 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:48:52.598291 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:48:52.598291 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:48:52.598291 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:48:52.598291 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:48:52.598291 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:48:52.598291 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4LhQXtyjir4_cBehcES-wEiCZAxTLOREkIT1dmwxLHRCQ6yv2rmP1gvATl3o6cZGIDrHd-fPcoQMiImBfAJjmZcavPxL71qZMs7hUQNLlK95OCgzH7-q9kkn-fULawDl_RmSsOetghvT---PqsVwluybG8ExdyTq2Lpu_rMoily_AA Aug 31 15:48:52.598291 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:48:52.598291 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:48:52.598291 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:48:52.598291 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:48:52.598291 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:48:52.598291 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:48:52.598291 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 2b9f031bc0b2465aa07133cc1f90fe9e Aug 31 15:48:52.598291 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1801649600 Aug 31 15:48:52.598291 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:48:52.598291 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:48:52.599606 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2b9f031bc0b2465aa07133cc1f90fe9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2b9f031bc0b2465aa07133cc1f90fe9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2b9f031bc0b2465aa07133cc1f90fe9e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2b9f031bc0b2465aa07133cc1f90fe9e", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:48:52.599606 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-AZAdminNegativeTestJSON-1801649600 Aug 31 15:48:52.599606 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 2b9f031bc0b2465aa07133cc1f90fe9e Aug 31 15:48:52.599606 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1801649600 Aug 31 15:48:52.599606 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-AZAdminNegativeTestJSON-1801649600-project Aug 31 15:48:52.599606 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:48:52.599606 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:48:52.599606 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: f51b7f0eb1324ff6a1820e5dc099243f Aug 31 15:48:52.599606 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-AZAdminNegativeTestJSON-1801649600-project Aug 31 15:48:52.599606 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:48:52.599606 n-d-833090-16 devstack@n-api.service[128864]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 31 15:48:52.599606 n-d-833090-16 devstack@n-api.service[128864]: action_args: {} Aug 31 15:48:52.600298 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:48:52.600298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:48:52.600298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:48:52.600298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:48:52.600298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:48:52.600298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:48:52.600298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:48:52.600298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:48:52.600298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Aug 31 15:48:52.600298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Aug 31 15:48:52.600298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 15:48:52.600298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 15:48:52.600298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 15:48:52.600298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 15:48:52.600298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:48:52.600298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:48:52.600298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:48:52.600298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:48:52.600298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 15:48:52.601305 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 15:48:52.601305 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 15:48:52.601305 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 15:48:52.601305 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 15:48:52.601305 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 15:48:52.601305 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 31 15:48:52.601305 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:48:52.601305 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:48:52.601305 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:48:52.601305 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:48:52.601305 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:48:52.601305 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:48:52.601305 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 15:48:52.601305 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 15:48:52.601305 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 31 15:48:52.601305 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:48:52.601305 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ea224d5d-834a-4126-b761-0ca55bbb54f2 tempest-AZAdminNegativeTestJSON-1801649600 tempest-AZAdminNegativeTestJSON-1801649600-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:48:52.602132 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ea224d5d-834a-4126-b761-0ca55bbb54f2 tempest-AZAdminNegativeTestJSON-1801649600 tempest-AZAdminNegativeTestJSON-1801649600-project] 10.222.0.50 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.111178 Aug 31 15:48:52.602132 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 6/6] 10.222.0.50 () {58 vars in 1185 bytes} [Wed Aug 31 15:48:52 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 112 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:48:52.604713 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0c9524f5-bbfd-4e87-b077-4c7111a10c0b tempest-FlavorsExtraSpecsTestJSON-1326229101 tempest-FlavorsExtraSpecsTestJSON-1326229101-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1595261057", "ram": 512, "vcpus": 1, "disk": 10, "id": 1951497668, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:48:52.610706 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a631b79c-1deb-4c01-828f-a69c067d9c2a tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-833090-16"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:48:52.622611 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a631b79c-1deb-4c01-828f-a69c067d9c2a tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:48:52.623084 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a631b79c-1deb-4c01-828f-a69c067d9c2a tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:48:52.623513 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a631b79c-1deb-4c01-828f-a69c067d9c2a tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:48:52.659522 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0c9524f5-bbfd-4e87-b077-4c7111a10c0b tempest-FlavorsExtraSpecsTestJSON-1326229101 tempest-FlavorsExtraSpecsTestJSON-1326229101-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 1.222131 Aug 31 15:48:52.660222 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1/7] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:48:51 2022] POST /compute/v2.1/flavors => generated 416 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:48:52.791723 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-58998637-63ff-4545-b296-c339bd7198cc tempest-FlavorMetadataValidation-2105207388 tempest-FlavorMetadataValidation-2105207388-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-311417219", "id": 1361253194, "os-flavor-access:is_public": "True"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:48:52.816415 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-58998637-63ff-4545-b296-c339bd7198cc tempest-FlavorMetadataValidation-2105207388 tempest-FlavorMetadataValidation-2105207388-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 470 microversion: 2.86 time: 0.148929 Aug 31 15:48:52.817926 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2/8] 10.222.0.50 () {62 vars in 1188 bytes} [Wed Aug 31 15:48:52 2022] POST /compute/v2.1/flavors => generated 470 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:48:53.076403 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-19b59d82-68b9-49b2-a674-5827227a91da tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:48:53.081085 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19b59d82-68b9-49b2-a674-5827227a91da tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:48:53.081637 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19b59d82-68b9-49b2-a674-5827227a91da tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:48:53.082189 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19b59d82-68b9-49b2-a674-5827227a91da tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:48:53.083008 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19b59d82-68b9-49b2-a674-5827227a91da tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:48:53.083515 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19b59d82-68b9-49b2-a674-5827227a91da tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:48:53.084158 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19b59d82-68b9-49b2-a674-5827227a91da tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:48:53.131966 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-19b59d82-68b9-49b2-a674-5827227a91da tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 403 microversion: 2.1 time: 0.312522 Aug 31 15:48:53.132833 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3/9] 10.222.0.50 () {58 vars in 1176 bytes} [Wed Aug 31 15:48:52 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 403 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:48:53.137281 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2eabf81a-1789-47d1-8dd2-17b82c33cb31 tempest-AZAdminV2TestJSON-1469057674 tempest-AZAdminV2TestJSON-1469057674-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:48:53.139268 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2eabf81a-1789-47d1-8dd2-17b82c33cb31 tempest-AZAdminV2TestJSON-1469057674 tempest-AZAdminV2TestJSON-1469057674-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:48:53.139806 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2eabf81a-1789-47d1-8dd2-17b82c33cb31 tempest-AZAdminV2TestJSON-1469057674 tempest-AZAdminV2TestJSON-1469057674-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:48:53.140463 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2eabf81a-1789-47d1-8dd2-17b82c33cb31 tempest-AZAdminV2TestJSON-1469057674 tempest-AZAdminV2TestJSON-1469057674-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:48:53.141661 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2eabf81a-1789-47d1-8dd2-17b82c33cb31 tempest-AZAdminV2TestJSON-1469057674 tempest-AZAdminV2TestJSON-1469057674-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:48:53.142639 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2eabf81a-1789-47d1-8dd2-17b82c33cb31 tempest-AZAdminV2TestJSON-1469057674 tempest-AZAdminV2TestJSON-1469057674-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:48:53.143340 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2eabf81a-1789-47d1-8dd2-17b82c33cb31 tempest-AZAdminV2TestJSON-1469057674 tempest-AZAdminV2TestJSON-1469057674-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:48:53.154554 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a631b79c-1deb-4c01-828f-a69c067d9c2a tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 314 microversion: 2.1 time: 0.553213 Aug 31 15:48:53.155198 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 7/10] 10.222.0.50 () {60 vars in 1191 bytes} [Wed Aug 31 15:48:52 2022] POST /compute/v2.1/os-aggregates/1/action => generated 314 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:48:53.200670 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2eabf81a-1789-47d1-8dd2-17b82c33cb31 tempest-AZAdminV2TestJSON-1469057674 tempest-AZAdminV2TestJSON-1469057674-project-admin] 10.222.0.50 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 703 microversion: 2.1 time: 0.066720 Aug 31 15:48:53.206632 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 4/11] 10.222.0.50 () {58 vars in 1185 bytes} [Wed Aug 31 15:48:53 2022] GET /compute/v2.1/os-availability-zone/detail => generated 703 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:48:53.211632 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3fd70448-d7f7-4452-a29f-f76cbe433551 tempest-FlavorsExtraSpecsTestJSON-1326229101 tempest-FlavorsExtraSpecsTestJSON-1326229101-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:48:53.276150 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3fd70448-d7f7-4452-a29f-f76cbe433551 tempest-FlavorsExtraSpecsTestJSON-1326229101 tempest-FlavorsExtraSpecsTestJSON-1326229101-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/1951497668/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.068247 Aug 31 15:48:53.277389 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 5/12] 10.222.0.50 () {60 vars in 1224 bytes} [Wed Aug 31 15:48:53 2022] POST /compute/v2.1/flavors/1951497668/os-extra_specs => generated 66 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 15:48:53.282600 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ddf21c7d-e017-4999-8c47-245e58572b99 tempest-FlavorMetadataValidation-2105207388 tempest-FlavorMetadataValidation-2105207388-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:48:53.319484 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9885a367-b2ed-4c49-a4df-76634ee14550 tempest-HypervisorAdminV253TestBase-1425218253 tempest-HypervisorAdminV253TestBase-1425218253-project-admin] Calling method '.version_select at 0x7fbb482daaf0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:48:53.324159 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9885a367-b2ed-4c49-a4df-76634ee14550 tempest-HypervisorAdminV253TestBase-1425218253 tempest-HypervisorAdminV253TestBase-1425218253-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:48:53.324532 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9885a367-b2ed-4c49-a4df-76634ee14550 tempest-HypervisorAdminV253TestBase-1425218253 tempest-HypervisorAdminV253TestBase-1425218253-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:48:53.324997 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9885a367-b2ed-4c49-a4df-76634ee14550 tempest-HypervisorAdminV253TestBase-1425218253 tempest-HypervisorAdminV253TestBase-1425218253-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:48:53.343693 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9885a367-b2ed-4c49-a4df-76634ee14550 tempest-HypervisorAdminV253TestBase-1425218253 tempest-HypervisorAdminV253TestBase-1425218253-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:48:53.344293 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9885a367-b2ed-4c49-a4df-76634ee14550 tempest-HypervisorAdminV253TestBase-1425218253 tempest-HypervisorAdminV253TestBase-1425218253-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:48:53.344918 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9885a367-b2ed-4c49-a4df-76634ee14550 tempest-HypervisorAdminV253TestBase-1425218253 tempest-HypervisorAdminV253TestBase-1425218253-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:48:53.402889 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9885a367-b2ed-4c49-a4df-76634ee14550 tempest-HypervisorAdminV253TestBase-1425218253 tempest-HypervisorAdminV253TestBase-1425218253-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:48:53.404036 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9885a367-b2ed-4c49-a4df-76634ee14550 tempest-HypervisorAdminV253TestBase-1425218253 tempest-HypervisorAdminV253TestBase-1425218253-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:48:53.404526 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9885a367-b2ed-4c49-a4df-76634ee14550 tempest-HypervisorAdminV253TestBase-1425218253 tempest-HypervisorAdminV253TestBase-1425218253-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:48:53.435702 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9885a367-b2ed-4c49-a4df-76634ee14550 tempest-HypervisorAdminV253TestBase-1425218253 tempest-HypervisorAdminV253TestBase-1425218253-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:48:53.436466 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9885a367-b2ed-4c49-a4df-76634ee14550 tempest-HypervisorAdminV253TestBase-1425218253 tempest-HypervisorAdminV253TestBase-1425218253-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:48:53.437307 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9885a367-b2ed-4c49-a4df-76634ee14550 tempest-HypervisorAdminV253TestBase-1425218253 tempest-HypervisorAdminV253TestBase-1425218253-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:48:53.456162 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9885a367-b2ed-4c49-a4df-76634ee14550 tempest-HypervisorAdminV253TestBase-1425218253 tempest-HypervisorAdminV253TestBase-1425218253-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:48:53.457430 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9885a367-b2ed-4c49-a4df-76634ee14550 tempest-HypervisorAdminV253TestBase-1425218253 tempest-HypervisorAdminV253TestBase-1425218253-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:48:53.458046 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9885a367-b2ed-4c49-a4df-76634ee14550 tempest-HypervisorAdminV253TestBase-1425218253 tempest-HypervisorAdminV253TestBase-1425218253-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:48:53.475192 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9885a367-b2ed-4c49-a4df-76634ee14550 tempest-HypervisorAdminV253TestBase-1425218253 tempest-HypervisorAdminV253TestBase-1425218253-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1575 microversion: 2.53 time: 0.310272 Aug 31 15:48:53.475192 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 8/13] 10.222.0.50 () {60 vars in 1243 bytes} [Wed Aug 31 15:48:53 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1575 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:48:53.496074 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ddf21c7d-e017-4999-8c47-245e58572b99 tempest-FlavorMetadataValidation-2105207388 tempest-FlavorMetadataValidation-2105207388-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/1361253194/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.217556 Aug 31 15:48:53.497218 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 6/14] 10.222.0.50 () {62 vars in 1265 bytes} [Wed Aug 31 15:48:53 2022] POST /compute/v2.1/flavors/1361253194/os-extra_specs => generated 62 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:48:53.682515 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2b6235d9-b85e-4e9c-a836-e81c70f3d102 tempest-FlavorsExtraSpecsTestJSON-1077760895 tempest-FlavorsExtraSpecsTestJSON-1077760895-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:48:53.703019 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e8830ab4-98a3-4e20-9ed8-dd67fca3b397 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-175176208", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "availability_zone": "tempest-test_az-393179081"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:48:53.719282 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2b6235d9-b85e-4e9c-a836-e81c70f3d102 tempest-FlavorsExtraSpecsTestJSON-1077760895 tempest-FlavorsExtraSpecsTestJSON-1077760895-project] 10.222.0.50 "GET /compute/v2.1/flavors/1951497668/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.250295 Aug 31 15:48:53.730610 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 9/15] 10.222.0.50 () {58 vars in 1203 bytes} [Wed Aug 31 15:48:53 2022] GET /compute/v2.1/flavors/1951497668/os-extra_specs => generated 66 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 15:48:53.732285 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8830ab4-98a3-4e20-9ed8-dd67fca3b397 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:48:53.732923 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8830ab4-98a3-4e20-9ed8-dd67fca3b397 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:48:53.733516 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8830ab4-98a3-4e20-9ed8-dd67fca3b397 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:48:53.734846 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8830ab4-98a3-4e20-9ed8-dd67fca3b397 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:48:53.735506 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8830ab4-98a3-4e20-9ed8-dd67fca3b397 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:48:53.736103 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8830ab4-98a3-4e20-9ed8-dd67fca3b397 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:48:53.736834 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f5c61d7f-83d6-4ffc-a807-49ac398b2f97 tempest-HypervisorAdminV253TestBase-1425218253 tempest-HypervisorAdminV253TestBase-1425218253-project-admin] Calling method '.version_select at 0x7fbb47849d30>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:48:53.740997 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f5c61d7f-83d6-4ffc-a807-49ac398b2f97 tempest-HypervisorAdminV253TestBase-1425218253 tempest-HypervisorAdminV253TestBase-1425218253-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:48:53.741464 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f5c61d7f-83d6-4ffc-a807-49ac398b2f97 tempest-HypervisorAdminV253TestBase-1425218253 tempest-HypervisorAdminV253TestBase-1425218253-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:48:53.742500 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f5c61d7f-83d6-4ffc-a807-49ac398b2f97 tempest-HypervisorAdminV253TestBase-1425218253 tempest-HypervisorAdminV253TestBase-1425218253-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:48:53.759838 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f5c61d7f-83d6-4ffc-a807-49ac398b2f97 tempest-HypervisorAdminV253TestBase-1425218253 tempest-HypervisorAdminV253TestBase-1425218253-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:48:53.760797 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f5c61d7f-83d6-4ffc-a807-49ac398b2f97 tempest-HypervisorAdminV253TestBase-1425218253 tempest-HypervisorAdminV253TestBase-1425218253-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:48:53.761302 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f5c61d7f-83d6-4ffc-a807-49ac398b2f97 tempest-HypervisorAdminV253TestBase-1425218253 tempest-HypervisorAdminV253TestBase-1425218253-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:48:53.776650 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f5c61d7f-83d6-4ffc-a807-49ac398b2f97 tempest-HypervisorAdminV253TestBase-1425218253 tempest-HypervisorAdminV253TestBase-1425218253-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:48:53.777223 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f5c61d7f-83d6-4ffc-a807-49ac398b2f97 tempest-HypervisorAdminV253TestBase-1425218253 tempest-HypervisorAdminV253TestBase-1425218253-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:48:53.777683 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f5c61d7f-83d6-4ffc-a807-49ac398b2f97 tempest-HypervisorAdminV253TestBase-1425218253 tempest-HypervisorAdminV253TestBase-1425218253-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:48:53.791493 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f5c61d7f-83d6-4ffc-a807-49ac398b2f97 tempest-HypervisorAdminV253TestBase-1425218253 tempest-HypervisorAdminV253TestBase-1425218253-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:48:53.792309 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f5c61d7f-83d6-4ffc-a807-49ac398b2f97 tempest-HypervisorAdminV253TestBase-1425218253 tempest-HypervisorAdminV253TestBase-1425218253-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:48:53.793471 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f5c61d7f-83d6-4ffc-a807-49ac398b2f97 tempest-HypervisorAdminV253TestBase-1425218253 tempest-HypervisorAdminV253TestBase-1425218253-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:48:53.809791 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f5c61d7f-83d6-4ffc-a807-49ac398b2f97 tempest-HypervisorAdminV253TestBase-1425218253 tempest-HypervisorAdminV253TestBase-1425218253-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:48:53.810312 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f5c61d7f-83d6-4ffc-a807-49ac398b2f97 tempest-HypervisorAdminV253TestBase-1425218253 tempest-HypervisorAdminV253TestBase-1425218253-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:48:53.810796 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f5c61d7f-83d6-4ffc-a807-49ac398b2f97 tempest-HypervisorAdminV253TestBase-1425218253 tempest-HypervisorAdminV253TestBase-1425218253-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:48:53.817941 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f5c61d7f-83d6-4ffc-a807-49ac398b2f97 tempest-HypervisorAdminV253TestBase-1425218253 tempest-HypervisorAdminV253TestBase-1425218253-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 267 microversion: 2.53 time: 0.085925 Aug 31 15:48:53.818538 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 10/16] 10.222.0.50 () {60 vars in 1222 bytes} [Wed Aug 31 15:48:53 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 267 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:48:53.830435 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8d755667-5aea-4530-be1c-1b70c167c62d tempest-FlavorMetadataValidation-2105207388 tempest-FlavorMetadataValidation-2105207388-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:48:53.865183 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8d755667-5aea-4530-be1c-1b70c167c62d tempest-FlavorMetadataValidation-2105207388 tempest-FlavorMetadataValidation-2105207388-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1361253194" status: 202 len: 0 microversion: 2.86 time: 0.045109 Aug 31 15:48:53.866343 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 11/17] 10.222.0.50 () {60 vars in 1202 bytes} [Wed Aug 31 15:48:53 2022] DELETE /compute/v2.1/flavors/1361253194 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:48:53.875077 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b618edd4-8129-4c91-8952-556f918f0fb2 tempest-FlavorsExtraSpecsTestJSON-1326229101 tempest-FlavorsExtraSpecsTestJSON-1326229101-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:48:53.945075 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b618edd4-8129-4c91-8952-556f918f0fb2 tempest-FlavorsExtraSpecsTestJSON-1326229101 tempest-FlavorsExtraSpecsTestJSON-1326229101-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/1951497668/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.076410 Aug 31 15:48:53.946059 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 12/18] 10.222.0.50 () {60 vars in 1224 bytes} [Wed Aug 31 15:48:53 2022] POST /compute/v2.1/flavors/1951497668/os-extra_specs => generated 66 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 15:48:53.954659 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0aef7846-ef63-4c35-9c4a-c8e9591e69b6 tempest-HypervisorAdminV253TestBase-1425218253 tempest-HypervisorAdminV253TestBase-1425218253-project-admin] Calling method '.version_select at 0x7fbb4784eaf0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:48:53.958210 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0aef7846-ef63-4c35-9c4a-c8e9591e69b6 tempest-HypervisorAdminV253TestBase-1425218253 tempest-HypervisorAdminV253TestBase-1425218253-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:48:53.958907 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0aef7846-ef63-4c35-9c4a-c8e9591e69b6 tempest-HypervisorAdminV253TestBase-1425218253 tempest-HypervisorAdminV253TestBase-1425218253-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:48:53.959357 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0aef7846-ef63-4c35-9c4a-c8e9591e69b6 tempest-HypervisorAdminV253TestBase-1425218253 tempest-HypervisorAdminV253TestBase-1425218253-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:48:53.981467 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0aef7846-ef63-4c35-9c4a-c8e9591e69b6 tempest-HypervisorAdminV253TestBase-1425218253 tempest-HypervisorAdminV253TestBase-1425218253-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:48:53.981970 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0aef7846-ef63-4c35-9c4a-c8e9591e69b6 tempest-HypervisorAdminV253TestBase-1425218253 tempest-HypervisorAdminV253TestBase-1425218253-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:48:53.982501 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0aef7846-ef63-4c35-9c4a-c8e9591e69b6 tempest-HypervisorAdminV253TestBase-1425218253 tempest-HypervisorAdminV253TestBase-1425218253-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:48:53.991321 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0aef7846-ef63-4c35-9c4a-c8e9591e69b6 tempest-HypervisorAdminV253TestBase-1425218253 tempest-HypervisorAdminV253TestBase-1425218253-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/bafe1a40-2f1e-4ff8-8559-f75a87ec78be" status: 200 len: 793 microversion: 2.53 time: 0.043890 Aug 31 15:48:53.992480 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 13/19] 10.222.0.50 () {60 vars in 1298 bytes} [Wed Aug 31 15:48:53 2022] GET /compute/v2.1/os-hypervisors/bafe1a40-2f1e-4ff8-8559-f75a87ec78be => generated 793 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:48:53.997774 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b4f4b8c0-a393-4529-ba7a-55f1cdeb5b26 tempest-FlavorMetadataValidation-2105207388 tempest-FlavorMetadataValidation-2105207388-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:48:54.033553 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b4f4b8c0-a393-4529-ba7a-55f1cdeb5b26 tempest-FlavorMetadataValidation-2105207388 tempest-FlavorMetadataValidation-2105207388-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 6270 microversion: 2.86 time: 0.039586 Aug 31 15:48:54.050119 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 14/20] 10.222.0.50 () {60 vars in 1187 bytes} [Wed Aug 31 15:48:53 2022] GET /compute/v2.1/flavors/detail => generated 6270 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:48:54.050119 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a224e34e-6148-4d74-ad3c-4dbe70323ffc tempest-FlavorsExtraSpecsTestJSON-1077760895 tempest-FlavorsExtraSpecsTestJSON-1077760895-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:48:54.055744 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a224e34e-6148-4d74-ad3c-4dbe70323ffc tempest-FlavorsExtraSpecsTestJSON-1077760895 tempest-FlavorsExtraSpecsTestJSON-1077760895-project] 10.222.0.50 "GET /compute/v2.1/flavors/1951497668/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.020185 Aug 31 15:48:54.061264 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 15/21] 10.222.0.50 () {58 vars in 1245 bytes} [Wed Aug 31 15:48:54 2022] GET /compute/v2.1/flavors/1951497668/os-extra_specs/hw:numa_nodes => generated 22 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 15:48:54.070355 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0583f013-1b6f-44ea-aefd-c6e1cb1d2b63 tempest-FlavorsExtraSpecsTestJSON-1326229101 tempest-FlavorsExtraSpecsTestJSON-1326229101-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:48:54.110137 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0583f013-1b6f-44ea-aefd-c6e1cb1d2b63 tempest-FlavorsExtraSpecsTestJSON-1326229101 tempest-FlavorsExtraSpecsTestJSON-1326229101-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/1951497668/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.047159 Aug 31 15:48:54.111666 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 16/22] 10.222.0.50 () {60 vars in 1224 bytes} [Wed Aug 31 15:48:54 2022] POST /compute/v2.1/flavors/1951497668/os-extra_specs => generated 66 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 15:48:54.127096 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5740e97f-69bf-4ea2-9be1-29fe82289042 tempest-FlavorsExtraSpecsTestJSON-1326229101 tempest-FlavorsExtraSpecsTestJSON-1326229101-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:48:54.150264 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5740e97f-69bf-4ea2-9be1-29fe82289042 tempest-FlavorsExtraSpecsTestJSON-1326229101 tempest-FlavorsExtraSpecsTestJSON-1326229101-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/1951497668/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.030176 Aug 31 15:48:54.153299 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 17/23] 10.222.0.50 () {58 vars in 1203 bytes} [Wed Aug 31 15:48:54 2022] GET /compute/v2.1/flavors/1951497668/os-extra_specs => generated 66 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 15:48:54.165201 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-88ba220a-cba0-4686-9bb6-5c2056783c3d tempest-FlavorsExtraSpecsTestJSON-1326229101 tempest-FlavorsExtraSpecsTestJSON-1326229101-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:48:54.209615 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-88ba220a-cba0-4686-9bb6-5c2056783c3d tempest-FlavorsExtraSpecsTestJSON-1326229101 tempest-FlavorsExtraSpecsTestJSON-1326229101-project-admin] 10.222.0.50 "PUT /compute/v2.1/flavors/1951497668/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.049670 Aug 31 15:48:54.213016 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 18/24] 10.222.0.50 () {60 vars in 1265 bytes} [Wed Aug 31 15:48:54 2022] PUT /compute/v2.1/flavors/1951497668/os-extra_specs/hw:numa_nodes => generated 22 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 15:48:54.223696 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-27e1565d-3ab8-4086-b8c6-536ccb6a6c72 tempest-FlavorsExtraSpecsTestJSON-1326229101 tempest-FlavorsExtraSpecsTestJSON-1326229101-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:48:54.229501 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3,nova_api:DELETE=3,nova_api:SAVEPOINT=6,nova_api:RELEASE=6,nova_api:UPDATE=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:48:54.243409 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-27e1565d-3ab8-4086-b8c6-536ccb6a6c72 tempest-FlavorsExtraSpecsTestJSON-1326229101 tempest-FlavorsExtraSpecsTestJSON-1326229101-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/1951497668/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.023814 Aug 31 15:48:54.248991 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 19/25] 10.222.0.50 () {58 vars in 1203 bytes} [Wed Aug 31 15:48:54 2022] GET /compute/v2.1/flavors/1951497668/os-extra_specs => generated 66 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 15:48:54.256505 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3a098ad4-dee5-4daa-8a56-a2e405e02e9b tempest-FlavorsExtraSpecsTestJSON-1326229101 tempest-FlavorsExtraSpecsTestJSON-1326229101-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:48:54.273714 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-e8830ab4-98a3-4e20-9ed8-dd67fca3b397 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] validate_networks() for None {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:48:54.328233 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3a098ad4-dee5-4daa-8a56-a2e405e02e9b tempest-FlavorsExtraSpecsTestJSON-1326229101 tempest-FlavorsExtraSpecsTestJSON-1326229101-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1951497668/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.077177 Aug 31 15:48:54.333628 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 20/26] 10.222.0.50 () {58 vars in 1248 bytes} [Wed Aug 31 15:48:54 2022] DELETE /compute/v2.1/flavors/1951497668/os-extra_specs/hw:numa_nodes => generated 0 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 31 15:48:54.341604 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f63c6950-efa8-42cb-b99d-d93c3a11096a tempest-FlavorsExtraSpecsTestJSON-1326229101 tempest-FlavorsExtraSpecsTestJSON-1326229101-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:48:54.372660 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f63c6950-efa8-42cb-b99d-d93c3a11096a tempest-FlavorsExtraSpecsTestJSON-1326229101 tempest-FlavorsExtraSpecsTestJSON-1326229101-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1951497668/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.034527 Aug 31 15:48:54.373250 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 21/27] 10.222.0.50 () {58 vars in 1248 bytes} [Wed Aug 31 15:48:54 2022] DELETE /compute/v2.1/flavors/1951497668/os-extra_specs/hw:cpu_policy => generated 0 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 31 15:48:54.382124 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6341d5b5-972e-4a73-8598-db7649b5c9b0 tempest-FlavorsExtraSpecsTestJSON-1326229101 tempest-FlavorsExtraSpecsTestJSON-1326229101-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:48:54.390764 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6341d5b5-972e-4a73-8598-db7649b5c9b0 tempest-FlavorsExtraSpecsTestJSON-1326229101 tempest-FlavorsExtraSpecsTestJSON-1326229101-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/1951497668/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.012669 Aug 31 15:48:54.391558 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 22/28] 10.222.0.50 () {58 vars in 1203 bytes} [Wed Aug 31 15:48:54 2022] GET /compute/v2.1/flavors/1951497668/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 15:48:54.404066 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-41d037c2-b634-4203-b53b-939c30d66209 tempest-FlavorsExtraSpecsTestJSON-1326229101 tempest-FlavorsExtraSpecsTestJSON-1326229101-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:48:54.428345 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-41d037c2-b634-4203-b53b-939c30d66209 tempest-FlavorsExtraSpecsTestJSON-1326229101 tempest-FlavorsExtraSpecsTestJSON-1326229101-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1951497668" status: 202 len: 0 microversion: 2.1 time: 0.028147 Aug 31 15:48:54.429140 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 23/29] 10.222.0.50 () {58 vars in 1161 bytes} [Wed Aug 31 15:48:54 2022] DELETE /compute/v2.1/flavors/1951497668 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:48:54.437514 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3a7c50a0-3f5f-43fc-816c-fd4fa0b80874 tempest-FlavorsExtraSpecsTestJSON-1326229101 tempest-FlavorsExtraSpecsTestJSON-1326229101-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:48:54.460094 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3a7c50a0-3f5f-43fc-816c-fd4fa0b80874 tempest-FlavorsExtraSpecsTestJSON-1326229101 tempest-FlavorsExtraSpecsTestJSON-1326229101-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026392 Aug 31 15:48:54.474387 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 24/30] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 31 15:48:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:48:54.739969 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-e8830ab4-98a3-4e20-9ed8-dd67fca3b397 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:48:54.739969 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-e8830ab4-98a3-4e20-9ed8-dd67fca3b397 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:48:54.739969 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-e8830ab4-98a3-4e20-9ed8-dd67fca3b397 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:48:54.739969 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-e8830ab4-98a3-4e20-9ed8-dd67fca3b397 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:48:54.739969 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-e8830ab4-98a3-4e20-9ed8-dd67fca3b397 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:48:54.755798 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8830ab4-98a3-4e20-9ed8-dd67fca3b397 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:48:54.756282 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8830ab4-98a3-4e20-9ed8-dd67fca3b397 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:48:54.756708 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8830ab4-98a3-4e20-9ed8-dd67fca3b397 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:48:54.757584 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8830ab4-98a3-4e20-9ed8-dd67fca3b397 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:48:54.758028 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8830ab4-98a3-4e20-9ed8-dd67fca3b397 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:48:54.758452 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8830ab4-98a3-4e20-9ed8-dd67fca3b397 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:48:54.789364 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-e8830ab4-98a3-4e20-9ed8-dd67fca3b397 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Getting quotas for project 454e809640fd4c1381463bd27e69c02b. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:48:54.799516 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-e8830ab4-98a3-4e20-9ed8-dd67fca3b397 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Getting quotas for user ca35cd4f679249c2b98305e4bc1cb13e and project 454e809640fd4c1381463bd27e69c02b. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:48:54.812003 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e8830ab4-98a3-4e20-9ed8-dd67fca3b397 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:48:54.815103 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e8830ab4-98a3-4e20-9ed8-dd67fca3b397 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] [instance: e1429482-9aee-476b-a4db-585f0493cff7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:48:54.888614 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e8830ab4-98a3-4e20-9ed8-dd67fca3b397 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.389291 Aug 31 15:48:54.889652 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 7/31] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:48:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1392 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 15:48:54.901653 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e61e02d6-7ca0-4c71-bac7-fa464eb23450 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:48:54.902270 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e61e02d6-7ca0-4c71-bac7-fa464eb23450 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] [instance: e1429482-9aee-476b-a4db-585f0493cff7] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:48:55.786718 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e61e02d6-7ca0-4c71-bac7-fa464eb23450 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca35cd4f679249c2b98305e4bc1cb13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454e809640fd4c1381463bd27e69c02b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:48:55.803909 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e61e02d6-7ca0-4c71-bac7-fa464eb23450 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] 10.222.0.50 "GET /compute/v2.1/servers/e1429482-9aee-476b-a4db-585f0493cff7" status: 200 len: 1241 microversion: 2.1 time: 0.907074 Aug 31 15:48:55.805764 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 25/32] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:48:54 2022] GET /compute/v2.1/servers/e1429482-9aee-476b-a4db-585f0493cff7 => generated 1241 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:48:56.827544 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2ded7bd0-604a-433b-aebb-3c4f7c38f27d tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:48:56.831704 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2ded7bd0-604a-433b-aebb-3c4f7c38f27d tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] [instance: e1429482-9aee-476b-a4db-585f0493cff7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:48:56.857822 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ded7bd0-604a-433b-aebb-3c4f7c38f27d tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:48:56.859497 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ded7bd0-604a-433b-aebb-3c4f7c38f27d tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:48:56.860130 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ded7bd0-604a-433b-aebb-3c4f7c38f27d tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:48:56.860928 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ded7bd0-604a-433b-aebb-3c4f7c38f27d tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:48:56.863816 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ded7bd0-604a-433b-aebb-3c4f7c38f27d tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:48:56.864676 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ded7bd0-604a-433b-aebb-3c4f7c38f27d tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:48:57.082666 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2ded7bd0-604a-433b-aebb-3c4f7c38f27d tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca35cd4f679249c2b98305e4bc1cb13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454e809640fd4c1381463bd27e69c02b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:48:57.105445 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2ded7bd0-604a-433b-aebb-3c4f7c38f27d tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] 10.222.0.50 "GET /compute/v2.1/servers/e1429482-9aee-476b-a4db-585f0493cff7" status: 200 len: 1289 microversion: 2.1 time: 0.283905 Aug 31 15:48:57.122068 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 8/33] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:48:56 2022] GET /compute/v2.1/servers/e1429482-9aee-476b-a4db-585f0493cff7 => generated 1289 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:48:58.130278 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-be7f66b5-c198-4a5b-b023-79038c3b20d8 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:48:58.132181 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-be7f66b5-c198-4a5b-b023-79038c3b20d8 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] [instance: e1429482-9aee-476b-a4db-585f0493cff7] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:48:58.140148 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-be7f66b5-c198-4a5b-b023-79038c3b20d8 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:48:58.140790 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-be7f66b5-c198-4a5b-b023-79038c3b20d8 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:48:58.141443 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-be7f66b5-c198-4a5b-b023-79038c3b20d8 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:48:58.142328 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-be7f66b5-c198-4a5b-b023-79038c3b20d8 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:48:58.142956 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-be7f66b5-c198-4a5b-b023-79038c3b20d8 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:48:58.143527 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-be7f66b5-c198-4a5b-b023-79038c3b20d8 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:48:58.289128 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-be7f66b5-c198-4a5b-b023-79038c3b20d8 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca35cd4f679249c2b98305e4bc1cb13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454e809640fd4c1381463bd27e69c02b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:48:58.308486 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-be7f66b5-c198-4a5b-b023-79038c3b20d8 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] 10.222.0.50 "GET /compute/v2.1/servers/e1429482-9aee-476b-a4db-585f0493cff7" status: 200 len: 1295 microversion: 2.1 time: 0.181818 Aug 31 15:48:58.322018 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 26/34] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:48:58 2022] GET /compute/v2.1/servers/e1429482-9aee-476b-a4db-585f0493cff7 => generated 1295 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:48:59.329436 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-181da150-05ad-40d1-996a-8e62f092c470 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:48:59.330222 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-181da150-05ad-40d1-996a-8e62f092c470 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] [instance: e1429482-9aee-476b-a4db-585f0493cff7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:48:59.337024 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-181da150-05ad-40d1-996a-8e62f092c470 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:48:59.337956 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-181da150-05ad-40d1-996a-8e62f092c470 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:48:59.338636 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-181da150-05ad-40d1-996a-8e62f092c470 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:48:59.339435 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-181da150-05ad-40d1-996a-8e62f092c470 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:48:59.339990 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-181da150-05ad-40d1-996a-8e62f092c470 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:48:59.340873 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-181da150-05ad-40d1-996a-8e62f092c470 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:48:59.586343 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-181da150-05ad-40d1-996a-8e62f092c470 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca35cd4f679249c2b98305e4bc1cb13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454e809640fd4c1381463bd27e69c02b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:48:59.604344 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-181da150-05ad-40d1-996a-8e62f092c470 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] 10.222.0.50 "GET /compute/v2.1/servers/e1429482-9aee-476b-a4db-585f0493cff7" status: 200 len: 1337 microversion: 2.1 time: 0.279192 Aug 31 15:48:59.619206 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 9/35] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:48:59 2022] GET /compute/v2.1/servers/e1429482-9aee-476b-a4db-585f0493cff7 => generated 1337 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:48:59.995077 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d01e0353-d33f-47b0-b4af-c6305e721d04 tempest-FlavorsAccessTestJSON-811558336 tempest-FlavorsAccessTestJSON-811558336-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-726946025", "id": 81177273, "os-flavor-access:is_public": "False"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:00.044037 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d01e0353-d33f-47b0-b4af-c6305e721d04 tempest-FlavorsAccessTestJSON-811558336 tempest-FlavorsAccessTestJSON-811558336-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.468035 Aug 31 15:49:00.045583 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 27/36] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:48:59 2022] POST /compute/v2.1/flavors => generated 424 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:49:00.069013 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d8546b96-8b24-4878-8d27-1d99e944ee98 tempest-FlavorsAccessTestJSON-811558336 tempest-FlavorsAccessTestJSON-811558336-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "b4ffeacd9ec14a50b3dcf51e58e7b7ef"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:00.629188 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-147295ce-9a7c-4407-932c-e975d1b20005 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:00.629801 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-147295ce-9a7c-4407-932c-e975d1b20005 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] [instance: e1429482-9aee-476b-a4db-585f0493cff7] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:00.645039 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-147295ce-9a7c-4407-932c-e975d1b20005 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:00.645534 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-147295ce-9a7c-4407-932c-e975d1b20005 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:00.645970 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-147295ce-9a7c-4407-932c-e975d1b20005 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:00.646707 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-147295ce-9a7c-4407-932c-e975d1b20005 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:00.647162 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-147295ce-9a7c-4407-932c-e975d1b20005 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:00.647582 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-147295ce-9a7c-4407-932c-e975d1b20005 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:00.818623 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d8546b96-8b24-4878-8d27-1d99e944ee98 tempest-FlavorsAccessTestJSON-811558336 tempest-FlavorsAccessTestJSON-811558336-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/81177273/action" status: 200 len: 95 microversion: 2.1 time: 0.763201 Aug 31 15:49:00.822352 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-147295ce-9a7c-4407-932c-e975d1b20005 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca35cd4f679249c2b98305e4bc1cb13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454e809640fd4c1381463bd27e69c02b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:00.824868 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 10/37] 10.222.0.50 () {60 vars in 1194 bytes} [Wed Aug 31 15:49:00 2022] POST /compute/v2.1/flavors/81177273/action => generated 95 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 15:49:00.835159 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-147295ce-9a7c-4407-932c-e975d1b20005 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] 10.222.0.50 "GET /compute/v2.1/servers/e1429482-9aee-476b-a4db-585f0493cff7" status: 200 len: 1337 microversion: 2.1 time: 0.210243 Aug 31 15:49:00.836351 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 28/38] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:49:00 2022] GET /compute/v2.1/servers/e1429482-9aee-476b-a4db-585f0493cff7 => generated 1337 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:01.117408 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-29feed18-2ea4-4eef-862f-8a682b237197 tempest-QuotaClassesAdminTestJSON-507614422 tempest-QuotaClassesAdminTestJSON-507614422-project-admin] Calling method '.version_select at 0x7fbb478144c0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:01.133706 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6de17f7f-fae6-4f3f-92bf-1b0f3d1c309a tempest-FlavorsAccessTestJSON-1388100682 tempest-FlavorsAccessTestJSON-1388100682-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:01.149045 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-29feed18-2ea4-4eef-862f-8a682b237197 tempest-QuotaClassesAdminTestJSON-507614422 tempest-QuotaClassesAdminTestJSON-507614422-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.322933 Aug 31 15:49:01.149964 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 11/39] 10.222.0.50 () {58 vars in 1185 bytes} [Wed Aug 31 15:49:00 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:01.166053 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e6266dcb-0594-44e4-bd3a-b0d74cedadae tempest-QuotaClassesAdminTestJSON-507614422 tempest-QuotaClassesAdminTestJSON-507614422-project-admin] Action: 'update', calling method: .version_select at 0x7fbb477b4550>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:01.180561 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6de17f7f-fae6-4f3f-92bf-1b0f3d1c309a tempest-FlavorsAccessTestJSON-1388100682 tempest-FlavorsAccessTestJSON-1388100682-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5405 microversion: 2.1 time: 0.342921 Aug 31 15:49:01.181726 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 29/40] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 31 15:49:00 2022] GET /compute/v2.1/flavors/detail => generated 5405 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:01.200204 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f721b37d-5f0c-401c-86a4-b50b3abbe075 tempest-FlavorsAccessTestJSON-811558336 tempest-FlavorsAccessTestJSON-811558336-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "b4ffeacd9ec14a50b3dcf51e58e7b7ef"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:01.415288 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=15,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:UPDATE=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:49:01.728894 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e6266dcb-0594-44e4-bd3a-b0d74cedadae tempest-QuotaClassesAdminTestJSON-507614422 tempest-QuotaClassesAdminTestJSON-507614422-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.571210 Aug 31 15:49:01.729479 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 12/41] 10.222.0.50 () {60 vars in 1206 bytes} [Wed Aug 31 15:49:01 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:01.740812 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7a37ece3-a418-4a0e-b6cc-e70bbf203219 tempest-QuotaClassesAdminTestJSON-507614422 tempest-QuotaClassesAdminTestJSON-507614422-project-admin] Calling method '.version_select at 0x7fbb477e4670>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:01.755283 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7a37ece3-a418-4a0e-b6cc-e70bbf203219 tempest-QuotaClassesAdminTestJSON-507614422 tempest-QuotaClassesAdminTestJSON-507614422-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.017972 Aug 31 15:49:01.756194 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 13/42] 10.222.0.50 () {58 vars in 1185 bytes} [Wed Aug 31 15:49:01 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:01.768600 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f721b37d-5f0c-401c-86a4-b50b3abbe075 tempest-FlavorsAccessTestJSON-811558336 tempest-FlavorsAccessTestJSON-811558336-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/81177273/action" status: 200 len: 21 microversion: 2.1 time: 0.571765 Aug 31 15:49:01.768775 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-889f89ca-8543-47a6-932d-d170b9a22feb tempest-QuotaClassesAdminTestJSON-507614422 tempest-QuotaClassesAdminTestJSON-507614422-project-admin] Action: 'update', calling method: .version_select at 0x7fbb477d7a60>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:01.774642 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 30/43] 10.222.0.50 () {60 vars in 1194 bytes} [Wed Aug 31 15:49:01 2022] POST /compute/v2.1/flavors/81177273/action => generated 21 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 15:49:01.781601 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e81de85d-c43f-48aa-8c28-803bf976c387 tempest-FlavorsAccessTestJSON-1388100682 tempest-FlavorsAccessTestJSON-1388100682-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:01.805093 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e81de85d-c43f-48aa-8c28-803bf976c387 tempest-FlavorsAccessTestJSON-1388100682 tempest-FlavorsAccessTestJSON-1388100682-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027869 Aug 31 15:49:01.806197 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 31/44] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 31 15:49:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:49:01.831818 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0856b4d6-a499-4f58-b6be-40147408cf03 tempest-FlavorsAccessTestJSON-811558336 tempest-FlavorsAccessTestJSON-811558336-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:01.860612 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0856b4d6-a499-4f58-b6be-40147408cf03 tempest-FlavorsAccessTestJSON-811558336 tempest-FlavorsAccessTestJSON-811558336-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/81177273" status: 202 len: 0 microversion: 2.1 time: 0.036870 Aug 31 15:49:01.861851 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 32/45] 10.222.0.50 () {58 vars in 1155 bytes} [Wed Aug 31 15:49:01 2022] DELETE /compute/v2.1/flavors/81177273 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 15:49:01.871051 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3db4ac8d-d529-4045-b034-142e4ef7c091 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:01.871841 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3db4ac8d-d529-4045-b034-142e4ef7c091 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] [instance: e1429482-9aee-476b-a4db-585f0493cff7] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:01.878664 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3db4ac8d-d529-4045-b034-142e4ef7c091 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:01.879148 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3db4ac8d-d529-4045-b034-142e4ef7c091 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:01.879566 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3db4ac8d-d529-4045-b034-142e4ef7c091 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:01.880564 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3db4ac8d-d529-4045-b034-142e4ef7c091 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:01.881159 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3db4ac8d-d529-4045-b034-142e4ef7c091 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:01.882061 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3db4ac8d-d529-4045-b034-142e4ef7c091 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:01.908881 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-889f89ca-8543-47a6-932d-d170b9a22feb tempest-QuotaClassesAdminTestJSON-507614422 tempest-QuotaClassesAdminTestJSON-507614422-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.144345 Aug 31 15:49:01.910120 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 14/46] 10.222.0.50 () {60 vars in 1206 bytes} [Wed Aug 31 15:49:01 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:49:01.916845 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-becfe737-0800-4170-9d4c-c9e2d90880f0 tempest-FlavorsAccessTestJSON-811558336 tempest-FlavorsAccessTestJSON-811558336-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:01.958629 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-becfe737-0800-4170-9d4c-c9e2d90880f0 tempest-FlavorsAccessTestJSON-811558336 tempest-FlavorsAccessTestJSON-811558336-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.047326 Aug 31 15:49:01.959643 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 15/47] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 31 15:49:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:01.985907 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5a34ec6a-5409-400d-b81a-aee80d84b13e tempest-FlavorsAccessTestJSON-811558336 tempest-FlavorsAccessTestJSON-811558336-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-865063239", "id": 1542357918, "os-flavor-access:is_public": "False"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:02.035253 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5a34ec6a-5409-400d-b81a-aee80d84b13e tempest-FlavorsAccessTestJSON-811558336 tempest-FlavorsAccessTestJSON-811558336-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.058075 Aug 31 15:49:02.043842 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 16/48] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:49:01 2022] POST /compute/v2.1/flavors => generated 430 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:49:02.063344 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8448acbe-6ed1-454c-a6df-bda42ed16394 tempest-FlavorsAccessTestJSON-811558336 tempest-FlavorsAccessTestJSON-811558336-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:02.090327 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3db4ac8d-d529-4045-b034-142e4ef7c091 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca35cd4f679249c2b98305e4bc1cb13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454e809640fd4c1381463bd27e69c02b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:02.090474 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8448acbe-6ed1-454c-a6df-bda42ed16394 tempest-FlavorsAccessTestJSON-811558336 tempest-FlavorsAccessTestJSON-811558336-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/1542357918/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.034404 Aug 31 15:49:02.091397 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 17/49] 10.222.0.50 () {58 vars in 1209 bytes} [Wed Aug 31 15:49:02 2022] GET /compute/v2.1/flavors/1542357918/os-flavor-access => generated 21 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 15:49:02.106632 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3db4ac8d-d529-4045-b034-142e4ef7c091 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] 10.222.0.50 "GET /compute/v2.1/servers/e1429482-9aee-476b-a4db-585f0493cff7" status: 200 len: 1337 microversion: 2.1 time: 0.240044 Aug 31 15:49:02.107884 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 33/50] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:49:01 2022] GET /compute/v2.1/servers/e1429482-9aee-476b-a4db-585f0493cff7 => generated 1337 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:02.459427 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:49:02.465381 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a366a87f-55e4-4ec2-99dd-8d1d909cef3f tempest-HypervisorAdminNegativeUnderV252Test-810688591 tempest-HypervisorAdminNegativeUnderV252Test-810688591-project-admin] Calling method '.version_select at 0x7fbb477d7d30>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:02.472801 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3aa1a683-fd37-4ee9-8ec3-53a266144d26 tempest-InstanceUsageAuditLogTestJSON-718626496 tempest-InstanceUsageAuditLogTestJSON-718626496-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:02.474352 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a366a87f-55e4-4ec2-99dd-8d1d909cef3f tempest-HypervisorAdminNegativeUnderV252Test-810688591 tempest-HypervisorAdminNegativeUnderV252Test-810688591-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ff6ab154-5f51-4e0d-922a-904eb5aa20da(cell1) {{(pid=128863) load_cells /opt/stack/nova/nova/compute/api.py:319}} Aug 31 15:49:02.475097 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a366a87f-55e4-4ec2-99dd-8d1d909cef3f tempest-HypervisorAdminNegativeUnderV252Test-810688591 tempest-HypervisorAdminNegativeUnderV252Test-810688591-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:02.476253 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a366a87f-55e4-4ec2-99dd-8d1d909cef3f tempest-HypervisorAdminNegativeUnderV252Test-810688591 tempest-HypervisorAdminNegativeUnderV252Test-810688591-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:02.476695 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a366a87f-55e4-4ec2-99dd-8d1d909cef3f tempest-HypervisorAdminNegativeUnderV252Test-810688591 tempest-HypervisorAdminNegativeUnderV252Test-810688591-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:02.514993 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3aa1a683-fd37-4ee9-8ec3-53a266144d26 tempest-InstanceUsageAuditLogTestJSON-718626496 tempest-InstanceUsageAuditLogTestJSON-718626496-project-admin] 10.222.0.50 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-31 15:49:02" status: 200 len: 318 microversion: 2.1 time: 0.401486 Aug 31 15:49:02.523869 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 34/51] 10.222.0.50 () {58 vars in 1251 bytes} [Wed Aug 31 15:49:02 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-31%2015%3A49%3A02 => generated 318 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:02.529895 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3b3530d0-2c4b-4a8b-b90f-03835ee8cbf4 tempest-FlavorsAccessTestJSON-811558336 tempest-FlavorsAccessTestJSON-811558336-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:02.544153 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a366a87f-55e4-4ec2-99dd-8d1d909cef3f tempest-HypervisorAdminNegativeUnderV252Test-810688591 tempest-HypervisorAdminNegativeUnderV252Test-810688591-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:02.544661 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a366a87f-55e4-4ec2-99dd-8d1d909cef3f tempest-HypervisorAdminNegativeUnderV252Test-810688591 tempest-HypervisorAdminNegativeUnderV252Test-810688591-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:02.545106 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a366a87f-55e4-4ec2-99dd-8d1d909cef3f tempest-HypervisorAdminNegativeUnderV252Test-810688591 tempest-HypervisorAdminNegativeUnderV252Test-810688591-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:02.552700 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3b3530d0-2c4b-4a8b-b90f-03835ee8cbf4 tempest-FlavorsAccessTestJSON-811558336 tempest-FlavorsAccessTestJSON-811558336-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1542357918" status: 202 len: 0 microversion: 2.1 time: 0.027127 Aug 31 15:49:02.557212 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 35/52] 10.222.0.50 () {58 vars in 1161 bytes} [Wed Aug 31 15:49:02 2022] DELETE /compute/v2.1/flavors/1542357918 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:49:02.563161 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7f9d3ca9-b31d-4d2b-ab9b-8f2b90ab7ec2 tempest-InstanceUsageAuditLogTestJSON-718626496 tempest-InstanceUsageAuditLogTestJSON-718626496-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:02.580004 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7f9d3ca9-b31d-4d2b-ab9b-8f2b90ab7ec2 tempest-InstanceUsageAuditLogTestJSON-718626496 tempest-InstanceUsageAuditLogTestJSON-718626496-project-admin] 10.222.0.50 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.021257 Aug 31 15:49:02.581145 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 36/53] 10.222.0.50 () {58 vars in 1185 bytes} [Wed Aug 31 15:49:02 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:02.588080 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7f308129-beb2-4f89-8d63-1fd29d698a00 tempest-FlavorsAccessTestJSON-811558336 tempest-FlavorsAccessTestJSON-811558336-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:02.590419 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a366a87f-55e4-4ec2-99dd-8d1d909cef3f tempest-HypervisorAdminNegativeUnderV252Test-810688591 tempest-HypervisorAdminNegativeUnderV252Test-810688591-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:02.590923 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a366a87f-55e4-4ec2-99dd-8d1d909cef3f tempest-HypervisorAdminNegativeUnderV252Test-810688591 tempest-HypervisorAdminNegativeUnderV252Test-810688591-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:02.591416 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a366a87f-55e4-4ec2-99dd-8d1d909cef3f tempest-HypervisorAdminNegativeUnderV252Test-810688591 tempest-HypervisorAdminNegativeUnderV252Test-810688591-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:02.612298 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7f308129-beb2-4f89-8d63-1fd29d698a00 tempest-FlavorsAccessTestJSON-811558336 tempest-FlavorsAccessTestJSON-811558336-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029841 Aug 31 15:49:02.625903 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 37/54] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 31 15:49:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:02.626073 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a366a87f-55e4-4ec2-99dd-8d1d909cef3f tempest-HypervisorAdminNegativeUnderV252Test-810688591 tempest-HypervisorAdminNegativeUnderV252Test-810688591-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.531378 Aug 31 15:49:02.626710 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 18/55] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 31 15:49:02 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:02.656840 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a366a87f-55e4-4ec2-99dd-8d1d909cef3f tempest-HypervisorAdminNegativeUnderV252Test-810688591 tempest-HypervisorAdminNegativeUnderV252Test-810688591-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:02.658396 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a366a87f-55e4-4ec2-99dd-8d1d909cef3f tempest-HypervisorAdminNegativeUnderV252Test-810688591 tempest-HypervisorAdminNegativeUnderV252Test-810688591-project-admin] 10.222.0.50 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001976 Aug 31 15:49:02.665455 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 19/56] 10.222.0.50 () {56 vars in 886 bytes} [Wed Aug 31 15:49:02 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 31 15:49:02.990217 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f0d2892a-8076-4793-afc3-a02d3c2a7490 tempest-HypervisorAdminNegativeUnderV252Test-54845368 tempest-HypervisorAdminNegativeUnderV252Test-54845368-project] Calling method '.version_select at 0x7fbb47685ca0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:02.992727 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f0d2892a-8076-4793-afc3-a02d3c2a7490 tempest-HypervisorAdminNegativeUnderV252Test-54845368 tempest-HypervisorAdminNegativeUnderV252Test-54845368-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'ed3f1930f75a46148a54349cca1def3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76156be48b2e408191eaf1437074a95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:02.996119 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f0d2892a-8076-4793-afc3-a02d3c2a7490 tempest-HypervisorAdminNegativeUnderV252Test-54845368 tempest-HypervisorAdminNegativeUnderV252Test-54845368-project] Request method failure captured: Aug 31 15:49:02.996119 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/os-hypervisors/n-h1-833090-16/search HTTP/1.1 Aug 31 15:49:02.996119 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:49:02.996119 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:49:02.996119 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:49:02.996119 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:49:02.996119 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:49:02.996119 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:49:02.996119 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:49:02.996119 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:49:02.996119 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4Lrh8Fo7ead2nzR97Q3dLX2sBqpNcjqCiwExi2BpFRMOgMqGPZmvYx1GKXVj-Wd4mXzzIdbZ2OkD-NPXiLAHC55Hq7O2_YuzJ9lon3nUrXxguS76q-lDbz1a_3cV-E9hA8fp5OWhXhWA4VlYudZCtVgai9D_JRpAdttYMGpaF--yhs Aug 31 15:49:02.996119 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:49:02.996119 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:49:02.996119 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:49:02.996119 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:49:02.996119 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:49:02.996119 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:49:02.996119 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 76156be48b2e408191eaf1437074a95d Aug 31 15:49:02.996119 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-54845368 Aug 31 15:49:02.996119 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:49:02.996119 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:49:02.997254 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/76156be48b2e408191eaf1437074a95d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/76156be48b2e408191eaf1437074a95d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/76156be48b2e408191eaf1437074a95d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_76156be48b2e408191eaf1437074a95d", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:49:02.997254 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-54845368 Aug 31 15:49:02.997254 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 76156be48b2e408191eaf1437074a95d Aug 31 15:49:02.997254 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-54845368 Aug 31 15:49:02.997254 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-54845368-project Aug 31 15:49:02.997254 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:49:02.997254 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:49:02.997254 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: ed3f1930f75a46148a54349cca1def3d Aug 31 15:49:02.997254 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-54845368-project Aug 31 15:49:02.997254 n-d-833090-16 devstack@n-api.service[128864]: method: Aug 31 15:49:02.997254 n-d-833090-16 devstack@n-api.service[128864]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 31 15:49:02.997254 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'n-h1-833090-16'} Aug 31 15:49:02.997884 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:49:02.997884 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:02.997884 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:02.997884 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:02.997884 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:49:02.997884 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:49:02.997884 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:49:02.997884 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:49:02.997884 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:49:02.997884 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:49:02.997884 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Aug 31 15:49:02.997884 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Aug 31 15:49:02.997884 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 15:49:02.997884 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 15:49:02.997884 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 15:49:02.997884 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 15:49:02.997884 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:49:02.997884 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:49:02.997884 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:49:02.998982 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:49:02.998982 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 15:49:02.998982 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 15:49:02.998982 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 15:49:02.998982 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 15:49:02.998982 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 15:49:02.998982 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 15:49:02.998982 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 31 15:49:02.998982 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:02.998982 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:02.998982 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:02.998982 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:02.998982 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:02.998982 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:02.998982 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 15:49:02.998982 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 15:49:02.998982 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 31 15:49:02.998982 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:03.010707 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f0d2892a-8076-4793-afc3-a02d3c2a7490 tempest-HypervisorAdminNegativeUnderV252Test-54845368 tempest-HypervisorAdminNegativeUnderV252Test-54845368-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:49:03.014626 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f0d2892a-8076-4793-afc3-a02d3c2a7490 tempest-HypervisorAdminNegativeUnderV252Test-54845368 tempest-HypervisorAdminNegativeUnderV252Test-54845368-project] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/n-h1-833090-16/search" status: 403 len: 117 microversion: 2.1 time: 0.379557 Aug 31 15:49:03.016651 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 38/57] 10.222.0.50 () {58 vars in 1212 bytes} [Wed Aug 31 15:49:02 2022] GET /compute/v2.1/os-hypervisors/n-h1-833090-16/search => generated 117 bytes in 384 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:49:03.027182 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-81c15d12-ab8a-440a-850b-3f73d682c396 tempest-HypervisorAdminNegativeUnderV252Test-810688591 tempest-HypervisorAdminNegativeUnderV252Test-810688591-project-admin] Calling method '.version_select at 0x7fbb47757790>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:03.029323 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-81c15d12-ab8a-440a-850b-3f73d682c396 tempest-HypervisorAdminNegativeUnderV252Test-810688591 tempest-HypervisorAdminNegativeUnderV252Test-810688591-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:03.029806 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-81c15d12-ab8a-440a-850b-3f73d682c396 tempest-HypervisorAdminNegativeUnderV252Test-810688591 tempest-HypervisorAdminNegativeUnderV252Test-810688591-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:03.030324 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-81c15d12-ab8a-440a-850b-3f73d682c396 tempest-HypervisorAdminNegativeUnderV252Test-810688591 tempest-HypervisorAdminNegativeUnderV252Test-810688591-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:03.046459 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-81c15d12-ab8a-440a-850b-3f73d682c396 tempest-HypervisorAdminNegativeUnderV252Test-810688591 tempest-HypervisorAdminNegativeUnderV252Test-810688591-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 31 15:49:03.050274 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-81c15d12-ab8a-440a-850b-3f73d682c396 tempest-HypervisorAdminNegativeUnderV252Test-810688591 tempest-HypervisorAdminNegativeUnderV252Test-810688591-project-admin] Request method failure captured: Aug 31 15:49:03.050274 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Aug 31 15:49:03.050274 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:49:03.050274 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:49:03.050274 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:49:03.050274 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:49:03.050274 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:49:03.050274 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:49:03.050274 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:49:03.050274 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:49:03.050274 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4Ltxg7VlpUubBOfscx31tVi6PP5TL2y9P9Cifdsmncl_8oVcq6ywWZojj0ufhFwEG25fZObwyoB1j39Tyv0Ml6wJJ6vaECkIU-I8H_dFE5wL4E659EAb29GmEUJ4cKDMZ2Mm5KFnO-ksGiE9Xvg2xHNd6HHti4KCl9fTKD0fJovLr0 Aug 31 15:49:03.050274 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:49:03.050274 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:49:03.050274 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:49:03.050274 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:49:03.050274 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:49:03.050274 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:49:03.050274 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 97397e464bcd421f86ee7db03f1141fe Aug 31 15:49:03.050274 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-810688591 Aug 31 15:49:03.050274 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,admin,member Aug 31 15:49:03.050274 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,admin,member Aug 31 15:49:03.052028 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/97397e464bcd421f86ee7db03f1141fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/97397e464bcd421f86ee7db03f1141fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/97397e464bcd421f86ee7db03f1141fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_97397e464bcd421f86ee7db03f1141fe", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:49:03.052028 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-810688591 Aug 31 15:49:03.052028 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 97397e464bcd421f86ee7db03f1141fe Aug 31 15:49:03.052028 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-810688591 Aug 31 15:49:03.052028 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-810688591-project-admin Aug 31 15:49:03.052028 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:49:03.052028 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:49:03.052028 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: b0f42f6e434748549f8a516110287b2e Aug 31 15:49:03.052028 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-810688591-project-admin Aug 31 15:49:03.052028 n-d-833090-16 devstack@n-api.service[128863]: method: Aug 31 15:49:03.052028 n-d-833090-16 devstack@n-api.service[128863]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 31 15:49:03.052028 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'nonexistent_hypervisor_name'} Aug 31 15:49:03.052932 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:49:03.052932 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:03.052932 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:03.052932 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:03.052932 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:49:03.052932 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:49:03.052932 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:49:03.052932 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:49:03.052932 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:49:03.052932 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:49:03.052932 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Aug 31 15:49:03.052932 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 31 15:49:03.052932 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 31 15:49:03.052932 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 31 15:49:03.052932 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 31 15:49:03.052932 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:03.052932 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:03.052932 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:03.052932 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:03.052932 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:03.053944 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:03.053944 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:49:03.053944 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:49:03.053944 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 31 15:49:03.053944 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:03.053944 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-81c15d12-ab8a-440a-850b-3f73d682c396 tempest-HypervisorAdminNegativeUnderV252Test-810688591 tempest-HypervisorAdminNegativeUnderV252Test-810688591-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:49:03.053944 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-81c15d12-ab8a-440a-850b-3f73d682c396 tempest-HypervisorAdminNegativeUnderV252Test-810688591 tempest-HypervisorAdminNegativeUnderV252Test-810688591-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.029118 Aug 31 15:49:03.057903 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 20/58] 10.222.0.50 () {58 vars in 1251 bytes} [Wed Aug 31 15:49:03 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:49:03.064603 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e5133ff4-c899-4f43-8b9f-3cf0aeb2b2c4 tempest-HypervisorAdminNegativeUnderV252Test-810688591 tempest-HypervisorAdminNegativeUnderV252Test-810688591-project-admin] Calling method '.version_select at 0x7fbb4772a3a0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:03.067606 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e5133ff4-c899-4f43-8b9f-3cf0aeb2b2c4 tempest-HypervisorAdminNegativeUnderV252Test-810688591 tempest-HypervisorAdminNegativeUnderV252Test-810688591-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:03.068727 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e5133ff4-c899-4f43-8b9f-3cf0aeb2b2c4 tempest-HypervisorAdminNegativeUnderV252Test-810688591 tempest-HypervisorAdminNegativeUnderV252Test-810688591-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:03.069658 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e5133ff4-c899-4f43-8b9f-3cf0aeb2b2c4 tempest-HypervisorAdminNegativeUnderV252Test-810688591 tempest-HypervisorAdminNegativeUnderV252Test-810688591-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:03.086435 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e5133ff4-c899-4f43-8b9f-3cf0aeb2b2c4 tempest-HypervisorAdminNegativeUnderV252Test-810688591 tempest-HypervisorAdminNegativeUnderV252Test-810688591-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:03.086919 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e5133ff4-c899-4f43-8b9f-3cf0aeb2b2c4 tempest-HypervisorAdminNegativeUnderV252Test-810688591 tempest-HypervisorAdminNegativeUnderV252Test-810688591-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:03.087541 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e5133ff4-c899-4f43-8b9f-3cf0aeb2b2c4 tempest-HypervisorAdminNegativeUnderV252Test-810688591 tempest-HypervisorAdminNegativeUnderV252Test-810688591-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:03.099591 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e5133ff4-c899-4f43-8b9f-3cf0aeb2b2c4 tempest-HypervisorAdminNegativeUnderV252Test-810688591 tempest-HypervisorAdminNegativeUnderV252Test-810688591-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:03.100339 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e5133ff4-c899-4f43-8b9f-3cf0aeb2b2c4 tempest-HypervisorAdminNegativeUnderV252Test-810688591 tempest-HypervisorAdminNegativeUnderV252Test-810688591-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:03.101284 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e5133ff4-c899-4f43-8b9f-3cf0aeb2b2c4 tempest-HypervisorAdminNegativeUnderV252Test-810688591 tempest-HypervisorAdminNegativeUnderV252Test-810688591-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:03.109144 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e5133ff4-c899-4f43-8b9f-3cf0aeb2b2c4 tempest-HypervisorAdminNegativeUnderV252Test-810688591 tempest-HypervisorAdminNegativeUnderV252Test-810688591-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.049955 Aug 31 15:49:03.110396 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 39/59] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 31 15:49:03 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:49:03.127317 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-30a10404-d9d1-4dd1-8cad-3d60f0779502 tempest-HypervisorAdminNegativeUnderV252Test-54845368 tempest-HypervisorAdminNegativeUnderV252Test-54845368-project] Calling method '.version_select at 0x7fbb4772d3a0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:03.128577 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c64a8076-672e-4152-a5c8-6dbc88052bc9 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:03.129161 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-30a10404-d9d1-4dd1-8cad-3d60f0779502 tempest-HypervisorAdminNegativeUnderV252Test-54845368 tempest-HypervisorAdminNegativeUnderV252Test-54845368-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'ed3f1930f75a46148a54349cca1def3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76156be48b2e408191eaf1437074a95d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:03.129312 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c64a8076-672e-4152-a5c8-6dbc88052bc9 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] [instance: e1429482-9aee-476b-a4db-585f0493cff7] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:03.135727 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-30a10404-d9d1-4dd1-8cad-3d60f0779502 tempest-HypervisorAdminNegativeUnderV252Test-54845368 tempest-HypervisorAdminNegativeUnderV252Test-54845368-project] Request method failure captured: Aug 31 15:49:03.135727 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Aug 31 15:49:03.135727 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:49:03.135727 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:49:03.135727 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:49:03.135727 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:49:03.135727 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:49:03.135727 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:49:03.135727 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:49:03.135727 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:49:03.135727 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4Lrh8Fo7ead2nzR97Q3dLX2sBqpNcjqCiwExi2BpFRMOgMqGPZmvYx1GKXVj-Wd4mXzzIdbZ2OkD-NPXiLAHC55Hq7O2_YuzJ9lon3nUrXxguS76q-lDbz1a_3cV-E9hA8fp5OWhXhWA4VlYudZCtVgai9D_JRpAdttYMGpaF--yhs Aug 31 15:49:03.135727 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:49:03.135727 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:49:03.135727 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:49:03.135727 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:49:03.135727 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:49:03.135727 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:49:03.135727 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 76156be48b2e408191eaf1437074a95d Aug 31 15:49:03.135727 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-54845368 Aug 31 15:49:03.135727 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:49:03.135727 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:49:03.137403 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/76156be48b2e408191eaf1437074a95d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/76156be48b2e408191eaf1437074a95d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/76156be48b2e408191eaf1437074a95d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_76156be48b2e408191eaf1437074a95d", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:49:03.137403 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-54845368 Aug 31 15:49:03.137403 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 76156be48b2e408191eaf1437074a95d Aug 31 15:49:03.137403 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-54845368 Aug 31 15:49:03.137403 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-54845368-project Aug 31 15:49:03.137403 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:49:03.137403 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:49:03.137403 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: ed3f1930f75a46148a54349cca1def3d Aug 31 15:49:03.137403 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-54845368-project Aug 31 15:49:03.137403 n-d-833090-16 devstack@n-api.service[128863]: method: Aug 31 15:49:03.137403 n-d-833090-16 devstack@n-api.service[128863]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 31 15:49:03.137403 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '1'} Aug 31 15:49:03.138192 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:49:03.138192 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:03.138192 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:03.138192 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:03.138192 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:49:03.138192 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:49:03.138192 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:49:03.138192 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:49:03.138192 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:49:03.138192 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:49:03.138192 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Aug 31 15:49:03.138192 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Aug 31 15:49:03.138192 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 15:49:03.138192 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 15:49:03.138192 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 15:49:03.138192 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 15:49:03.138192 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:49:03.138192 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:49:03.138192 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:49:03.139729 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:49:03.139729 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 15:49:03.139729 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 15:49:03.139729 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 15:49:03.139729 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 15:49:03.139729 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 15:49:03.139729 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 15:49:03.139729 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 31 15:49:03.139729 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:03.139729 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:03.139729 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:03.139729 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:03.139729 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:03.139729 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:03.139729 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 15:49:03.139729 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 15:49:03.139729 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 31 15:49:03.139729 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:03.143830 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c64a8076-672e-4152-a5c8-6dbc88052bc9 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:03.143996 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-30a10404-d9d1-4dd1-8cad-3d60f0779502 tempest-HypervisorAdminNegativeUnderV252Test-54845368 tempest-HypervisorAdminNegativeUnderV252Test-54845368-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:49:03.144858 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-30a10404-d9d1-4dd1-8cad-3d60f0779502 tempest-HypervisorAdminNegativeUnderV252Test-54845368 tempest-HypervisorAdminNegativeUnderV252Test-54845368-project] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.023699 Aug 31 15:49:03.145249 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c64a8076-672e-4152-a5c8-6dbc88052bc9 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:03.146141 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 21/60] 10.222.0.50 () {58 vars in 1176 bytes} [Wed Aug 31 15:49:03 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:49:03.146304 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c64a8076-672e-4152-a5c8-6dbc88052bc9 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:03.147580 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c64a8076-672e-4152-a5c8-6dbc88052bc9 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:03.148450 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c64a8076-672e-4152-a5c8-6dbc88052bc9 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:03.149687 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c64a8076-672e-4152-a5c8-6dbc88052bc9 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:03.158920 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-62393328-d9b9-49a3-bdcb-e673a81635bd tempest-HypervisorAdminNegativeUnderV252Test-810688591 tempest-HypervisorAdminNegativeUnderV252Test-810688591-project-admin] Calling method '.version_select at 0x7fbb476d7e50>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:03.160923 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62393328-d9b9-49a3-bdcb-e673a81635bd tempest-HypervisorAdminNegativeUnderV252Test-810688591 tempest-HypervisorAdminNegativeUnderV252Test-810688591-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:03.161970 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62393328-d9b9-49a3-bdcb-e673a81635bd tempest-HypervisorAdminNegativeUnderV252Test-810688591 tempest-HypervisorAdminNegativeUnderV252Test-810688591-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:03.162813 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62393328-d9b9-49a3-bdcb-e673a81635bd tempest-HypervisorAdminNegativeUnderV252Test-810688591 tempest-HypervisorAdminNegativeUnderV252Test-810688591-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:03.169693 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-62393328-d9b9-49a3-bdcb-e673a81635bd tempest-HypervisorAdminNegativeUnderV252Test-810688591 tempest-HypervisorAdminNegativeUnderV252Test-810688591-project-admin] HTTP exception thrown: No hypervisor matching '60331af6-6ad7-4753-a52c-a1fa82e99c82' could be found. Aug 31 15:49:03.171216 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-62393328-d9b9-49a3-bdcb-e673a81635bd tempest-HypervisorAdminNegativeUnderV252Test-810688591 tempest-HypervisorAdminNegativeUnderV252Test-810688591-project-admin] Request method failure captured: Aug 31 15:49:03.171216 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/os-hypervisors/60331af6-6ad7-4753-a52c-a1fa82e99c82/servers HTTP/1.1 Aug 31 15:49:03.171216 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:49:03.171216 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:49:03.171216 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:49:03.171216 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:49:03.171216 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:49:03.171216 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:49:03.171216 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:49:03.171216 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:49:03.171216 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4Ltxg7VlpUubBOfscx31tVi6PP5TL2y9P9Cifdsmncl_8oVcq6ywWZojj0ufhFwEG25fZObwyoB1j39Tyv0Ml6wJJ6vaECkIU-I8H_dFE5wL4E659EAb29GmEUJ4cKDMZ2Mm5KFnO-ksGiE9Xvg2xHNd6HHti4KCl9fTKD0fJovLr0 Aug 31 15:49:03.171216 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:49:03.171216 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:49:03.171216 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:49:03.171216 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:49:03.171216 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:49:03.171216 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:49:03.171216 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 97397e464bcd421f86ee7db03f1141fe Aug 31 15:49:03.171216 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-810688591 Aug 31 15:49:03.171216 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,admin,member Aug 31 15:49:03.171216 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,admin,member Aug 31 15:49:03.172567 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/97397e464bcd421f86ee7db03f1141fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/97397e464bcd421f86ee7db03f1141fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/97397e464bcd421f86ee7db03f1141fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_97397e464bcd421f86ee7db03f1141fe", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:49:03.172567 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-810688591 Aug 31 15:49:03.172567 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 97397e464bcd421f86ee7db03f1141fe Aug 31 15:49:03.172567 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-810688591 Aug 31 15:49:03.172567 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-810688591-project-admin Aug 31 15:49:03.172567 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:49:03.172567 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:49:03.172567 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: b0f42f6e434748549f8a516110287b2e Aug 31 15:49:03.172567 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-810688591-project-admin Aug 31 15:49:03.172567 n-d-833090-16 devstack@n-api.service[128863]: method: Aug 31 15:49:03.172567 n-d-833090-16 devstack@n-api.service[128863]: exception: No hypervisor matching '60331af6-6ad7-4753-a52c-a1fa82e99c82' could be found. Aug 31 15:49:03.172567 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '60331af6-6ad7-4753-a52c-a1fa82e99c82'} Aug 31 15:49:03.173619 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:49:03.173619 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:03.173619 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:03.173619 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:03.173619 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:49:03.173619 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:49:03.173619 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:49:03.173619 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:49:03.173619 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:49:03.173619 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:49:03.173619 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Aug 31 15:49:03.173619 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 31 15:49:03.173619 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 31 15:49:03.173619 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 31 15:49:03.173619 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '60331af6-6ad7-4753-a52c-a1fa82e99c82' could be found. Aug 31 15:49:03.173619 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:03.173619 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:03.173619 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:03.173619 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:03.174628 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:03.174628 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:03.174628 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:49:03.174628 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:49:03.174628 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '60331af6-6ad7-4753-a52c-a1fa82e99c82' could be found. Aug 31 15:49:03.174628 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:03.176043 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-62393328-d9b9-49a3-bdcb-e673a81635bd tempest-HypervisorAdminNegativeUnderV252Test-810688591 tempest-HypervisorAdminNegativeUnderV252Test-810688591-project-admin] Returning 404 to user: No hypervisor matching '60331af6-6ad7-4753-a52c-a1fa82e99c82' could be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:49:03.177452 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-62393328-d9b9-49a3-bdcb-e673a81635bd tempest-HypervisorAdminNegativeUnderV252Test-810688591 tempest-HypervisorAdminNegativeUnderV252Test-810688591-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/60331af6-6ad7-4753-a52c-a1fa82e99c82/servers" status: 404 len: 123 microversion: 2.1 time: 0.025891 Aug 31 15:49:03.178552 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 22/61] 10.222.0.50 () {58 vars in 1281 bytes} [Wed Aug 31 15:49:03 2022] GET /compute/v2.1/os-hypervisors/60331af6-6ad7-4753-a52c-a1fa82e99c82/servers => generated 123 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:49:03.584867 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c64a8076-672e-4152-a5c8-6dbc88052bc9 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca35cd4f679249c2b98305e4bc1cb13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454e809640fd4c1381463bd27e69c02b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:03.602857 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c64a8076-672e-4152-a5c8-6dbc88052bc9 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] 10.222.0.50 "GET /compute/v2.1/servers/e1429482-9aee-476b-a4db-585f0493cff7" status: 200 len: 1337 microversion: 2.1 time: 0.478585 Aug 31 15:49:03.619604 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 40/62] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:49:03 2022] GET /compute/v2.1/servers/e1429482-9aee-476b-a4db-585f0493cff7 => generated 1337 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:49:04.638662 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e2e84a41-9712-4032-9db3-88c0b4ff8634 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:04.640791 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e2e84a41-9712-4032-9db3-88c0b4ff8634 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] [instance: e1429482-9aee-476b-a4db-585f0493cff7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:04.682972 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2e84a41-9712-4032-9db3-88c0b4ff8634 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:04.684119 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2e84a41-9712-4032-9db3-88c0b4ff8634 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:04.685118 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2e84a41-9712-4032-9db3-88c0b4ff8634 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:04.687584 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2e84a41-9712-4032-9db3-88c0b4ff8634 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:04.689331 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2e84a41-9712-4032-9db3-88c0b4ff8634 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:04.691297 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2e84a41-9712-4032-9db3-88c0b4ff8634 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:04.785018 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=8 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:49:04.949727 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e2e84a41-9712-4032-9db3-88c0b4ff8634 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca35cd4f679249c2b98305e4bc1cb13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454e809640fd4c1381463bd27e69c02b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:04.959464 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e2e84a41-9712-4032-9db3-88c0b4ff8634 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] 10.222.0.50 "GET /compute/v2.1/servers/e1429482-9aee-476b-a4db-585f0493cff7" status: 200 len: 1337 microversion: 2.1 time: 0.333424 Aug 31 15:49:04.960230 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 23/63] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:49:04 2022] GET /compute/v2.1/servers/e1429482-9aee-476b-a4db-585f0493cff7 => generated 1337 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:05.982015 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0038799a-1ab5-4a48-836c-6d5a9a8fcbfa tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:05.983467 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0038799a-1ab5-4a48-836c-6d5a9a8fcbfa tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] [instance: e1429482-9aee-476b-a4db-585f0493cff7] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:05.992510 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0038799a-1ab5-4a48-836c-6d5a9a8fcbfa tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:06.001434 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0038799a-1ab5-4a48-836c-6d5a9a8fcbfa tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:06.008756 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0038799a-1ab5-4a48-836c-6d5a9a8fcbfa tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:06.009764 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0038799a-1ab5-4a48-836c-6d5a9a8fcbfa tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:06.013365 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0038799a-1ab5-4a48-836c-6d5a9a8fcbfa tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:06.013920 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0038799a-1ab5-4a48-836c-6d5a9a8fcbfa tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:06.328078 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0038799a-1ab5-4a48-836c-6d5a9a8fcbfa tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca35cd4f679249c2b98305e4bc1cb13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454e809640fd4c1381463bd27e69c02b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:06.347544 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0038799a-1ab5-4a48-836c-6d5a9a8fcbfa tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] 10.222.0.50 "GET /compute/v2.1/servers/e1429482-9aee-476b-a4db-585f0493cff7" status: 200 len: 1337 microversion: 2.1 time: 0.365742 Aug 31 15:49:06.357065 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 41/64] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:49:05 2022] GET /compute/v2.1/servers/e1429482-9aee-476b-a4db-585f0493cff7 => generated 1337 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:07.384267 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fda50ce5-2924-46ad-b5dc-b8ad786e75d0 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:07.384878 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fda50ce5-2924-46ad-b5dc-b8ad786e75d0 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] [instance: e1429482-9aee-476b-a4db-585f0493cff7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:07.391612 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fda50ce5-2924-46ad-b5dc-b8ad786e75d0 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:07.392541 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fda50ce5-2924-46ad-b5dc-b8ad786e75d0 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:07.393152 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fda50ce5-2924-46ad-b5dc-b8ad786e75d0 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:07.394056 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fda50ce5-2924-46ad-b5dc-b8ad786e75d0 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:07.394704 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fda50ce5-2924-46ad-b5dc-b8ad786e75d0 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:07.395294 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fda50ce5-2924-46ad-b5dc-b8ad786e75d0 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:07.563831 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fda50ce5-2924-46ad-b5dc-b8ad786e75d0 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca35cd4f679249c2b98305e4bc1cb13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454e809640fd4c1381463bd27e69c02b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:07.571886 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fda50ce5-2924-46ad-b5dc-b8ad786e75d0 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] 10.222.0.50 "GET /compute/v2.1/servers/e1429482-9aee-476b-a4db-585f0493cff7" status: 200 len: 1337 microversion: 2.1 time: 0.194734 Aug 31 15:49:07.572622 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 24/65] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:49:07 2022] GET /compute/v2.1/servers/e1429482-9aee-476b-a4db-585f0493cff7 => generated 1337 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:08.591962 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6cf7b7bc-0b7c-4ee1-8fa8-81c70eae76b6 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:08.592583 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6cf7b7bc-0b7c-4ee1-8fa8-81c70eae76b6 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] [instance: e1429482-9aee-476b-a4db-585f0493cff7] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:08.599619 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6cf7b7bc-0b7c-4ee1-8fa8-81c70eae76b6 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:08.600093 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6cf7b7bc-0b7c-4ee1-8fa8-81c70eae76b6 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:08.600520 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6cf7b7bc-0b7c-4ee1-8fa8-81c70eae76b6 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:08.601205 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6cf7b7bc-0b7c-4ee1-8fa8-81c70eae76b6 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:08.601635 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6cf7b7bc-0b7c-4ee1-8fa8-81c70eae76b6 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:08.602268 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6cf7b7bc-0b7c-4ee1-8fa8-81c70eae76b6 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:08.753109 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6cf7b7bc-0b7c-4ee1-8fa8-81c70eae76b6 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca35cd4f679249c2b98305e4bc1cb13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454e809640fd4c1381463bd27e69c02b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:08.762034 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6cf7b7bc-0b7c-4ee1-8fa8-81c70eae76b6 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] 10.222.0.50 "GET /compute/v2.1/servers/e1429482-9aee-476b-a4db-585f0493cff7" status: 200 len: 1337 microversion: 2.1 time: 0.173969 Aug 31 15:49:08.763168 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 42/66] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:49:08 2022] GET /compute/v2.1/servers/e1429482-9aee-476b-a4db-585f0493cff7 => generated 1337 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:09.785048 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a4f3ebba-11c1-4c8e-b996-05284da4f0e8 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:09.786462 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a4f3ebba-11c1-4c8e-b996-05284da4f0e8 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] [instance: e1429482-9aee-476b-a4db-585f0493cff7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:09.794744 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4f3ebba-11c1-4c8e-b996-05284da4f0e8 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:09.795653 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4f3ebba-11c1-4c8e-b996-05284da4f0e8 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:09.796414 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4f3ebba-11c1-4c8e-b996-05284da4f0e8 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:09.797692 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4f3ebba-11c1-4c8e-b996-05284da4f0e8 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:09.798373 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4f3ebba-11c1-4c8e-b996-05284da4f0e8 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:09.799201 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4f3ebba-11c1-4c8e-b996-05284da4f0e8 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:09.991398 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a4f3ebba-11c1-4c8e-b996-05284da4f0e8 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca35cd4f679249c2b98305e4bc1cb13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454e809640fd4c1381463bd27e69c02b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:10.003344 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a4f3ebba-11c1-4c8e-b996-05284da4f0e8 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] 10.222.0.50 "GET /compute/v2.1/servers/e1429482-9aee-476b-a4db-585f0493cff7" status: 200 len: 1337 microversion: 2.1 time: 0.223269 Aug 31 15:49:10.004444 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 25/67] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:49:09 2022] GET /compute/v2.1/servers/e1429482-9aee-476b-a4db-585f0493cff7 => generated 1337 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:10.786674 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-547d18bd-e7f2-4c5f-b3ee-696e826e61e4 tempest-HypervisorAdminV228Test-1747124015 tempest-HypervisorAdminV228Test-1747124015-project-admin] Calling method '.version_select at 0x7fbb47685790>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:10.788457 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-547d18bd-e7f2-4c5f-b3ee-696e826e61e4 tempest-HypervisorAdminV228Test-1747124015 tempest-HypervisorAdminV228Test-1747124015-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:10.788906 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-547d18bd-e7f2-4c5f-b3ee-696e826e61e4 tempest-HypervisorAdminV228Test-1747124015 tempest-HypervisorAdminV228Test-1747124015-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:10.789510 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-547d18bd-e7f2-4c5f-b3ee-696e826e61e4 tempest-HypervisorAdminV228Test-1747124015 tempest-HypervisorAdminV228Test-1747124015-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:10.827832 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-547d18bd-e7f2-4c5f-b3ee-696e826e61e4 tempest-HypervisorAdminV228Test-1747124015 tempest-HypervisorAdminV228Test-1747124015-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:10.829847 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-547d18bd-e7f2-4c5f-b3ee-696e826e61e4 tempest-HypervisorAdminV228Test-1747124015 tempest-HypervisorAdminV228Test-1747124015-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:10.830703 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-547d18bd-e7f2-4c5f-b3ee-696e826e61e4 tempest-HypervisorAdminV228Test-1747124015 tempest-HypervisorAdminV228Test-1747124015-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:10.843921 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-547d18bd-e7f2-4c5f-b3ee-696e826e61e4 tempest-HypervisorAdminV228Test-1747124015 tempest-HypervisorAdminV228Test-1747124015-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:10.844914 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-547d18bd-e7f2-4c5f-b3ee-696e826e61e4 tempest-HypervisorAdminV228Test-1747124015 tempest-HypervisorAdminV228Test-1747124015-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:10.845624 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-547d18bd-e7f2-4c5f-b3ee-696e826e61e4 tempest-HypervisorAdminV228Test-1747124015 tempest-HypervisorAdminV228Test-1747124015-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:10.852047 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-547d18bd-e7f2-4c5f-b3ee-696e826e61e4 tempest-HypervisorAdminV228Test-1747124015 tempest-HypervisorAdminV228Test-1747124015-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.28 time: 0.399680 Aug 31 15:49:10.852941 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 43/68] 10.222.0.50 () {60 vars in 1187 bytes} [Wed Aug 31 15:49:10 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 15:49:10.865652 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-193003bb-1cf1-4fa2-8ee9-4c637ee2f63b tempest-HypervisorAdminV228Test-1747124015 tempest-HypervisorAdminV228Test-1747124015-project-admin] Calling method '.version_select at 0x7fbb4772aaf0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:10.868743 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-193003bb-1cf1-4fa2-8ee9-4c637ee2f63b tempest-HypervisorAdminV228Test-1747124015 tempest-HypervisorAdminV228Test-1747124015-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:10.880452 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-193003bb-1cf1-4fa2-8ee9-4c637ee2f63b tempest-HypervisorAdminV228Test-1747124015 tempest-HypervisorAdminV228Test-1747124015-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:10.880452 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-193003bb-1cf1-4fa2-8ee9-4c637ee2f63b tempest-HypervisorAdminV228Test-1747124015 tempest-HypervisorAdminV228Test-1747124015-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:10.892689 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-193003bb-1cf1-4fa2-8ee9-4c637ee2f63b tempest-HypervisorAdminV228Test-1747124015 tempest-HypervisorAdminV228Test-1747124015-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:10.893534 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-193003bb-1cf1-4fa2-8ee9-4c637ee2f63b tempest-HypervisorAdminV228Test-1747124015 tempest-HypervisorAdminV228Test-1747124015-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:10.894333 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-193003bb-1cf1-4fa2-8ee9-4c637ee2f63b tempest-HypervisorAdminV228Test-1747124015 tempest-HypervisorAdminV228Test-1747124015-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:10.904478 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-193003bb-1cf1-4fa2-8ee9-4c637ee2f63b tempest-HypervisorAdminV228Test-1747124015 tempest-HypervisorAdminV228Test-1747124015-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 720 microversion: 2.28 time: 0.043362 Aug 31 15:49:10.911033 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 44/69] 10.222.0.50 () {60 vars in 1193 bytes} [Wed Aug 31 15:49:10 2022] GET /compute/v2.1/os-hypervisors/1 => generated 720 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:49:11.068436 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-02827cec-f547-4ed0-b696-d170fd1f55c5 tempest-QuotasAdminTestV236-1767085267 tempest-QuotasAdminTestV236-1767085267-project-admin] Action: 'update', calling method: .version_select at 0x7fbb47682670>, body: {"quota_set": {"ram": "5120"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:11.158513 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-22d35fad-8950-43bf-af2a-6470b4845d95 req-508cb287-73ba-4000-8f48-0ff619f6cb0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1429482-9aee-476b-a4db-585f0493cff7", "tag": "a82371a6-c79c-42a9-afc9-11da569e1bd2"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:11.176051 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-22d35fad-8950-43bf-af2a-6470b4845d95 req-508cb287-73ba-4000-8f48-0ff619f6cb0c service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:11.177213 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-22d35fad-8950-43bf-af2a-6470b4845d95 req-508cb287-73ba-4000-8f48-0ff619f6cb0c service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:11.178147 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-22d35fad-8950-43bf-af2a-6470b4845d95 req-508cb287-73ba-4000-8f48-0ff619f6cb0c service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:11.204518 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-22d35fad-8950-43bf-af2a-6470b4845d95 req-508cb287-73ba-4000-8f48-0ff619f6cb0c service nova] Creating event network-changed:a82371a6-c79c-42a9-afc9-11da569e1bd2 for instance e1429482-9aee-476b-a4db-585f0493cff7 on n-h1-833090-16 Aug 31 15:49:11.205734 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-22d35fad-8950-43bf-af2a-6470b4845d95 req-508cb287-73ba-4000-8f48-0ff619f6cb0c service nova] Acquiring lock "compute-rpcapi-router" {{(pid=128864) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 15:49:11.206545 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-22d35fad-8950-43bf-af2a-6470b4845d95 req-508cb287-73ba-4000-8f48-0ff619f6cb0c service nova] Acquired lock "compute-rpcapi-router" {{(pid=128864) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 15:49:11.208203 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b290573b-9062-4c02-aab0-a102af7842f7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:11.208873 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b290573b-9062-4c02-aab0-a102af7842f7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:11.209456 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b290573b-9062-4c02-aab0-a102af7842f7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:11.210287 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b290573b-9062-4c02-aab0-a102af7842f7 None None] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:11.210979 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b290573b-9062-4c02-aab0-a102af7842f7 None None] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:11.211679 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b290573b-9062-4c02-aab0-a102af7842f7 None None] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:11.224893 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.compute.rpcapi [None req-b290573b-9062-4c02-aab0-a102af7842f7 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 31 15:49:11.226438 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b290573b-9062-4c02-aab0-a102af7842f7 None None] Releasing lock "compute-rpcapi-router" {{(pid=128864) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 15:49:11.249406 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b290573b-9062-4c02-aab0-a102af7842f7 None None] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.246388 Aug 31 15:49:11.253380 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 45/70] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:49:11.257832 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02827cec-f547-4ed0-b696-d170fd1f55c5 tempest-QuotasAdminTestV236-1767085267 tempest-QuotasAdminTestV236-1767085267-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:11.258775 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-bcae5f08-bee6-4c18-b6b8-4d61cec705e9 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:11.261044 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-bcae5f08-bee6-4c18-b6b8-4d61cec705e9 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] [instance: e1429482-9aee-476b-a4db-585f0493cff7] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:11.264126 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02827cec-f547-4ed0-b696-d170fd1f55c5 tempest-QuotasAdminTestV236-1767085267 tempest-QuotasAdminTestV236-1767085267-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:11.264866 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02827cec-f547-4ed0-b696-d170fd1f55c5 tempest-QuotasAdminTestV236-1767085267 tempest-QuotasAdminTestV236-1767085267-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:11.267716 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02827cec-f547-4ed0-b696-d170fd1f55c5 tempest-QuotasAdminTestV236-1767085267 tempest-QuotasAdminTestV236-1767085267-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:11.269390 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bcae5f08-bee6-4c18-b6b8-4d61cec705e9 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:11.269892 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bcae5f08-bee6-4c18-b6b8-4d61cec705e9 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:11.270197 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02827cec-f547-4ed0-b696-d170fd1f55c5 tempest-QuotasAdminTestV236-1767085267 tempest-QuotasAdminTestV236-1767085267-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:11.270641 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02827cec-f547-4ed0-b696-d170fd1f55c5 tempest-QuotasAdminTestV236-1767085267 tempest-QuotasAdminTestV236-1767085267-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:11.270828 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bcae5f08-bee6-4c18-b6b8-4d61cec705e9 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:11.272145 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bcae5f08-bee6-4c18-b6b8-4d61cec705e9 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:11.272739 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bcae5f08-bee6-4c18-b6b8-4d61cec705e9 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:11.273350 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bcae5f08-bee6-4c18-b6b8-4d61cec705e9 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:11.278587 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=100 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:49:11.370777 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-02827cec-f547-4ed0-b696-d170fd1f55c5 tempest-QuotasAdminTestV236-1767085267 tempest-QuotasAdminTestV236-1767085267-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/63b6d163ddc34b14b54a8bb3f3cb2086" status: 200 len: 240 microversion: 2.36 time: 0.539328 Aug 31 15:49:11.371273 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 26/71] 10.222.0.50 () {62 vars in 1303 bytes} [Wed Aug 31 15:49:10 2022] PUT /compute/v2.1/os-quota-sets/63b6d163ddc34b14b54a8bb3f3cb2086 => generated 240 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:49:11.452326 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-bcae5f08-bee6-4c18-b6b8-4d61cec705e9 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca35cd4f679249c2b98305e4bc1cb13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454e809640fd4c1381463bd27e69c02b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:11.461569 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-bcae5f08-bee6-4c18-b6b8-4d61cec705e9 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] 10.222.0.50 "GET /compute/v2.1/servers/e1429482-9aee-476b-a4db-585f0493cff7" status: 200 len: 1337 microversion: 2.1 time: 0.206897 Aug 31 15:49:11.462165 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 46/72] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:49:11 2022] GET /compute/v2.1/servers/e1429482-9aee-476b-a4db-585f0493cff7 => generated 1337 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:11.466891 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4617d4d8-c6ef-434a-89ba-673018c42d29 tempest-QuotasAdminTestV236-1767085267 tempest-QuotasAdminTestV236-1767085267-project-admin] Calling method '.version_select at 0x7fbb476855e0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:11.706135 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1fe453f2-4627-496a-a39c-b3a35a0e0f06 tempest-FlavorsAccessNegativeTestJSON-155980058 tempest-FlavorsAccessNegativeTestJSON-155980058-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1657063210", "id": 2017999691, "os-flavor-access:is_public": "False"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:11.715436 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=10,nova_api:UPDATE=18 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:49:11.730325 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1fe453f2-4627-496a-a39c-b3a35a0e0f06 tempest-FlavorsAccessNegativeTestJSON-155980058 tempest-FlavorsAccessNegativeTestJSON-155980058-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.357771 Aug 31 15:49:11.731790 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 27/73] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:49:11 2022] POST /compute/v2.1/flavors => generated 439 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:11.744289 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a56bf804-8259-4578-8f59-85ac68307066 tempest-FlavorsAccessNegativeTestJSON-155980058 tempest-FlavorsAccessNegativeTestJSON-155980058-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "3804e175f2df4381a498e3bf7471815f"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:11.970081 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4617d4d8-c6ef-434a-89ba-673018c42d29 tempest-QuotasAdminTestV236-1767085267 tempest-QuotasAdminTestV236-1767085267-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:11.970840 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4617d4d8-c6ef-434a-89ba-673018c42d29 tempest-QuotasAdminTestV236-1767085267 tempest-QuotasAdminTestV236-1767085267-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:11.971208 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4617d4d8-c6ef-434a-89ba-673018c42d29 tempest-QuotasAdminTestV236-1767085267 tempest-QuotasAdminTestV236-1767085267-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:11.972090 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4617d4d8-c6ef-434a-89ba-673018c42d29 tempest-QuotasAdminTestV236-1767085267 tempest-QuotasAdminTestV236-1767085267-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:11.972898 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4617d4d8-c6ef-434a-89ba-673018c42d29 tempest-QuotasAdminTestV236-1767085267 tempest-QuotasAdminTestV236-1767085267-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:11.973524 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4617d4d8-c6ef-434a-89ba-673018c42d29 tempest-QuotasAdminTestV236-1767085267 tempest-QuotasAdminTestV236-1767085267-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:11.980268 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a56bf804-8259-4578-8f59-85ac68307066 tempest-FlavorsAccessNegativeTestJSON-155980058 tempest-FlavorsAccessNegativeTestJSON-155980058-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/2017999691/action" status: 200 len: 97 microversion: 2.1 time: 0.240321 Aug 31 15:49:11.987834 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 28/74] 10.222.0.50 () {60 vars in 1200 bytes} [Wed Aug 31 15:49:11 2022] POST /compute/v2.1/flavors/2017999691/action => generated 97 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 15:49:11.993030 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-970ab5e2-d375-45c3-969c-a663db60646e tempest-FlavorsAccessNegativeTestJSON-155980058 tempest-FlavorsAccessNegativeTestJSON-155980058-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "3804e175f2df4381a498e3bf7471815f"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:12.013478 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4617d4d8-c6ef-434a-89ba-673018c42d29 tempest-QuotasAdminTestV236-1767085267 tempest-QuotasAdminTestV236-1767085267-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/63b6d163ddc34b14b54a8bb3f3cb2086/detail" status: 200 len: 672 microversion: 2.36 time: 0.549870 Aug 31 15:49:12.022315 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 47/75] 10.222.0.50 () {60 vars in 1304 bytes} [Wed Aug 31 15:49:11 2022] GET /compute/v2.1/os-quota-sets/63b6d163ddc34b14b54a8bb3f3cb2086/detail => generated 672 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:49:12.077551 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-970ab5e2-d375-45c3-969c-a663db60646e tempest-FlavorsAccessNegativeTestJSON-155980058 tempest-FlavorsAccessNegativeTestJSON-155980058-project-admin] HTTP exception thrown: Flavor access already exists for flavor 19 and project 3804e175f2df4381a498e3bf7471815f combination. Aug 31 15:49:12.109911 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-970ab5e2-d375-45c3-969c-a663db60646e tempest-FlavorsAccessNegativeTestJSON-155980058 tempest-FlavorsAccessNegativeTestJSON-155980058-project-admin] Request method failure captured: Aug 31 15:49:12.109911 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/flavors/2017999691/action HTTP/1.1 Aug 31 15:49:12.109911 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:49:12.109911 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:49:12.109911 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:49:12.109911 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 67 Aug 31 15:49:12.109911 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:49:12.109911 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:49:12.109911 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:49:12.109911 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:49:12.109911 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4L18kcMoZPeFi0MRk8xxJsArCoAelZG8hzeDQeN3IeZTIHmNszu0Tt75RPW-fYU0rnfmmWkbWCEwPKiiyL8FSsDas0qioWIfi5v4JEAJYD6TtYEJKv-Nauzww2TlQ2mmQyV1lEmHPYItFaDj52OO36CGb9keaefX9bBfwoTH40HezI Aug 31 15:49:12.109911 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:49:12.109911 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:49:12.109911 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:49:12.109911 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:49:12.109911 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:49:12.109911 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:49:12.109911 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: e5e66ecc63c8416da667725e68e5801d Aug 31 15:49:12.109911 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-155980058 Aug 31 15:49:12.109911 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,admin,member Aug 31 15:49:12.109911 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,admin,member Aug 31 15:49:12.111576 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e5e66ecc63c8416da667725e68e5801d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e5e66ecc63c8416da667725e68e5801d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e5e66ecc63c8416da667725e68e5801d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e5e66ecc63c8416da667725e68e5801d", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:49:12.111576 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-155980058 Aug 31 15:49:12.111576 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: e5e66ecc63c8416da667725e68e5801d Aug 31 15:49:12.111576 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-155980058 Aug 31 15:49:12.111576 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-FlavorsAccessNegativeTestJSON-155980058-project-admin Aug 31 15:49:12.111576 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:49:12.111576 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:49:12.111576 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 1c73a31dd3a84eb4ade4d41188fbbcbf Aug 31 15:49:12.111576 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-155980058-project-admin Aug 31 15:49:12.111576 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 15:49:12.111576 n-d-833090-16 devstack@n-api.service[128863]: {"addTenantAccess": {"tenant": "3804e175f2df4381a498e3bf7471815f"}} Aug 31 15:49:12.111576 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 15:49:12.112366 n-d-833090-16 devstack@n-api.service[128863]: exception: Flavor access already exists for flavor 19 and project 3804e175f2df4381a498e3bf7471815f combination. Aug 31 15:49:12.112366 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '2017999691', 'body': {'addTenantAccess': {'tenant': '3804e175f2df4381a498e3bf7471815f'}}} Aug 31 15:49:12.112366 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:49:12.112366 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:12.112366 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 15:49:12.112366 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 31 15:49:12.112366 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 15:49:12.112366 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 31 15:49:12.112366 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 15:49:12.112366 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 31 15:49:12.112366 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 15:49:12.112366 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 31 15:49:12.112366 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 15:49:12.112366 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 15:49:12.112366 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 15:49:12.112366 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result.read() Aug 31 15:49:12.112366 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 15:49:12.112366 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 31 15:49:12.113472 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 15:49:12.113472 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 31 15:49:12.113472 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 15:49:12.113472 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 31 15:49:12.113472 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 15:49:12.113472 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 31 15:49:12.113472 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '19-3804e175f2df4381a498e3bf7471815f' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 31 15:49:12.113472 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:12.113472 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 31 15:49:12.113472 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:12.113472 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:12.113472 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Aug 31 15:49:12.113472 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi project.save(context.session) Aug 31 15:49:12.113472 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 31 15:49:12.113472 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi session.flush() Aug 31 15:49:12.113472 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 15:49:12.113472 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 31 15:49:12.113472 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 15:49:12.113472 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 31 15:49:12.114692 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 15:49:12.114692 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 31 15:49:12.114692 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 15:49:12.114692 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception Aug 31 15:49:12.114692 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 15:49:12.114692 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 31 15:49:12.114692 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 15:49:12.114692 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 31 15:49:12.114692 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 15:49:12.114692 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 31 15:49:12.114692 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 15:49:12.114692 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 31 15:49:12.114692 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 31 15:49:12.114692 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 31 15:49:12.114692 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 15:49:12.114692 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 15:49:12.114692 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 15:49:12.114692 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 31 15:49:12.115856 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 15:49:12.115856 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 31 15:49:12.115856 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 15:49:12.115856 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 31 15:49:12.115856 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 15:49:12.115856 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 15:49:12.115856 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 15:49:12.115856 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception Aug 31 15:49:12.115856 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 15:49:12.115856 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 31 15:49:12.115856 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 15:49:12.115856 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 31 15:49:12.115856 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 15:49:12.115856 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 31 15:49:12.115856 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 15:49:12.115856 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 31 15:49:12.115856 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 15:49:12.115856 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 15:49:12.117020 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 15:49:12.117020 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result.read() Aug 31 15:49:12.117020 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 15:49:12.117020 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 31 15:49:12.117020 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 15:49:12.117020 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 31 15:49:12.117020 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 15:49:12.117020 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 31 15:49:12.117020 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 15:49:12.117020 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 31 15:49:12.117020 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '19-3804e175f2df4381a498e3bf7471815f' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 31 15:49:12.117020 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Aug 31 15:49:12.117020 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 31, 15, 49, 12, 71310), 'updated_at': None, 'flavor_id': 19, 'project_id': '3804e175f2df4381a498e3bf7471815f'}] Aug 31 15:49:12.117020 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 15:49:12.117020 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:12.117020 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:12.117020 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:12.118033 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:12.118033 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Aug 31 15:49:12.118033 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Aug 31 15:49:12.118033 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 31 15:49:12.118033 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 31 15:49:12.118033 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Aug 31 15:49:12.118033 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Aug 31 15:49:12.118033 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Aug 31 15:49:12.118033 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Aug 31 15:49:12.118033 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Aug 31 15:49:12.118033 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Aug 31 15:49:12.118033 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 31 15:49:12.118033 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 31 15:49:12.118033 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Aug 31 15:49:12.118033 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Aug 31 15:49:12.118033 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 19 and project 3804e175f2df4381a498e3bf7471815f combination. Aug 31 15:49:12.118033 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:12.118033 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:12.118033 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:12.119226 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:12.119226 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:12.119226 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:12.119226 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:49:12.119226 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:49:12.119226 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:49:12.119226 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:49:12.119226 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:49:12.119226 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:49:12.119226 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Aug 31 15:49:12.119226 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Aug 31 15:49:12.119226 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 19 and project 3804e175f2df4381a498e3bf7471815f combination. Aug 31 15:49:12.119226 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:12.119226 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:12.119226 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:12.119226 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:12.119226 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:12.119226 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:12.119226 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:49:12.119226 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:49:12.120449 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 19 and project 3804e175f2df4381a498e3bf7471815f combination. Aug 31 15:49:12.120449 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:12.120449 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-970ab5e2-d375-45c3-969c-a663db60646e tempest-FlavorsAccessNegativeTestJSON-155980058 tempest-FlavorsAccessNegativeTestJSON-155980058-project-admin] Returning 409 to user: Flavor access already exists for flavor 19 and project 3804e175f2df4381a498e3bf7471815f combination. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:49:12.120449 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-970ab5e2-d375-45c3-969c-a663db60646e tempest-FlavorsAccessNegativeTestJSON-155980058 tempest-FlavorsAccessNegativeTestJSON-155980058-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/2017999691/action" status: 409 len: 152 microversion: 2.1 time: 0.122976 Aug 31 15:49:12.120449 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 29/76] 10.222.0.50 () {60 vars in 1200 bytes} [Wed Aug 31 15:49:11 2022] POST /compute/v2.1/flavors/2017999691/action => generated 152 bytes in 124 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 15:49:12.126452 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9e2ae33b-391e-4d56-a2f1-da1542940e94 tempest-FlavorsAccessNegativeTestJSON-155980058 tempest-FlavorsAccessNegativeTestJSON-155980058-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "3804e175f2df4381a498e3bf7471815f"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:12.347712 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-abdd98fe-95ee-4d30-b6f8-3d968a720bb5 tempest-QuotasAdminTestV236-1767085267 tempest-QuotasAdminTestV236-1767085267-project-admin] Action: 'update', calling method: .version_select at 0x7fbb47433d30>, body: {"quota_set": {"ram": "2048"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:12.492504 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=84,nova_api:SAVEPOINT=1,nova_api:RELEASE=1,nova_api:DELETE=13,nova_api:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:49:12.495370 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9e2ae33b-391e-4d56-a2f1-da1542940e94 tempest-FlavorsAccessNegativeTestJSON-155980058 tempest-FlavorsAccessNegativeTestJSON-155980058-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/2017999691/action" status: 200 len: 21 microversion: 2.1 time: 0.377405 Aug 31 15:49:12.496093 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 48/77] 10.222.0.50 () {60 vars in 1200 bytes} [Wed Aug 31 15:49:12 2022] POST /compute/v2.1/flavors/2017999691/action => generated 21 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 15:49:12.503571 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-eea8e2a1-72c8-418f-b383-f58de657f06f tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:12.504322 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-eea8e2a1-72c8-418f-b383-f58de657f06f tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] [instance: e1429482-9aee-476b-a4db-585f0493cff7] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:12.511321 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-eea8e2a1-72c8-418f-b383-f58de657f06f tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:12.515529 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-eea8e2a1-72c8-418f-b383-f58de657f06f tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:12.515529 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-eea8e2a1-72c8-418f-b383-f58de657f06f tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:12.515529 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-eea8e2a1-72c8-418f-b383-f58de657f06f tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:12.515529 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-eea8e2a1-72c8-418f-b383-f58de657f06f tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:12.515959 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-eea8e2a1-72c8-418f-b383-f58de657f06f tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:12.659640 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-abdd98fe-95ee-4d30-b6f8-3d968a720bb5 tempest-QuotasAdminTestV236-1767085267 tempest-QuotasAdminTestV236-1767085267-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:12.660828 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-abdd98fe-95ee-4d30-b6f8-3d968a720bb5 tempest-QuotasAdminTestV236-1767085267 tempest-QuotasAdminTestV236-1767085267-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:12.661579 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-abdd98fe-95ee-4d30-b6f8-3d968a720bb5 tempest-QuotasAdminTestV236-1767085267 tempest-QuotasAdminTestV236-1767085267-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:12.664676 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-abdd98fe-95ee-4d30-b6f8-3d968a720bb5 tempest-QuotasAdminTestV236-1767085267 tempest-QuotasAdminTestV236-1767085267-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:12.665225 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-abdd98fe-95ee-4d30-b6f8-3d968a720bb5 tempest-QuotasAdminTestV236-1767085267 tempest-QuotasAdminTestV236-1767085267-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:12.666371 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-abdd98fe-95ee-4d30-b6f8-3d968a720bb5 tempest-QuotasAdminTestV236-1767085267 tempest-QuotasAdminTestV236-1767085267-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:12.762002 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-abdd98fe-95ee-4d30-b6f8-3d968a720bb5 tempest-QuotasAdminTestV236-1767085267 tempest-QuotasAdminTestV236-1767085267-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:12.765615 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-abdd98fe-95ee-4d30-b6f8-3d968a720bb5 tempest-QuotasAdminTestV236-1767085267 tempest-QuotasAdminTestV236-1767085267-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:12.766312 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-abdd98fe-95ee-4d30-b6f8-3d968a720bb5 tempest-QuotasAdminTestV236-1767085267 tempest-QuotasAdminTestV236-1767085267-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:12.768195 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-abdd98fe-95ee-4d30-b6f8-3d968a720bb5 tempest-QuotasAdminTestV236-1767085267 tempest-QuotasAdminTestV236-1767085267-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:12.769288 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-abdd98fe-95ee-4d30-b6f8-3d968a720bb5 tempest-QuotasAdminTestV236-1767085267 tempest-QuotasAdminTestV236-1767085267-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:12.770459 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-abdd98fe-95ee-4d30-b6f8-3d968a720bb5 tempest-QuotasAdminTestV236-1767085267 tempest-QuotasAdminTestV236-1767085267-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:12.882318 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-eea8e2a1-72c8-418f-b383-f58de657f06f tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca35cd4f679249c2b98305e4bc1cb13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454e809640fd4c1381463bd27e69c02b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:12.897956 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-eea8e2a1-72c8-418f-b383-f58de657f06f tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] 10.222.0.50 "GET /compute/v2.1/servers/e1429482-9aee-476b-a4db-585f0493cff7" status: 200 len: 1337 microversion: 2.1 time: 0.395958 Aug 31 15:49:12.908482 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 49/78] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:49:12 2022] GET /compute/v2.1/servers/e1429482-9aee-476b-a4db-585f0493cff7 => generated 1337 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:12.914769 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-89e8d638-6dd0-4ecb-bd38-c70690d2f283 tempest-FlavorsAccessNegativeTestJSON-155980058 tempest-FlavorsAccessNegativeTestJSON-155980058-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:12.941316 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-89e8d638-6dd0-4ecb-bd38-c70690d2f283 tempest-FlavorsAccessNegativeTestJSON-155980058 tempest-FlavorsAccessNegativeTestJSON-155980058-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/2017999691" status: 202 len: 0 microversion: 2.1 time: 0.034149 Aug 31 15:49:12.942454 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 50/79] 10.222.0.50 () {58 vars in 1161 bytes} [Wed Aug 31 15:49:12 2022] DELETE /compute/v2.1/flavors/2017999691 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:49:12.954298 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-50650b31-8898-4404-a069-50601bf06ab6 tempest-FlavorsAccessNegativeTestJSON-155980058 tempest-FlavorsAccessNegativeTestJSON-155980058-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:12.980639 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-abdd98fe-95ee-4d30-b6f8-3d968a720bb5 tempest-QuotasAdminTestV236-1767085267 tempest-QuotasAdminTestV236-1767085267-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/63b6d163ddc34b14b54a8bb3f3cb2086?user_id=035b3cf44b824d5e99c43d3d0f39a496" status: 200 len: 240 microversion: 2.36 time: 0.637025 Aug 31 15:49:12.984578 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 30/80] 10.222.0.50 () {62 vars in 1384 bytes} [Wed Aug 31 15:49:12 2022] PUT /compute/v2.1/os-quota-sets/63b6d163ddc34b14b54a8bb3f3cb2086?user_id=035b3cf44b824d5e99c43d3d0f39a496 => generated 240 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:49:12.986875 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-50650b31-8898-4404-a069-50601bf06ab6 tempest-FlavorsAccessNegativeTestJSON-155980058 tempest-FlavorsAccessNegativeTestJSON-155980058-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038938 Aug 31 15:49:12.987735 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 51/81] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 31 15:49:12 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:12.996077 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-baf4f352-86ac-456c-97e4-e565caee151b tempest-QuotasAdminTestV236-1767085267 tempest-QuotasAdminTestV236-1767085267-project-admin] Calling method '.version_select at 0x7fbb47444040>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:13.007211 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-790110c1-b7e1-408b-88dd-5578547c2810 tempest-FlavorsAccessNegativeTestJSON-155980058 tempest-FlavorsAccessNegativeTestJSON-155980058-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-921290082", "id": 1187937249, "os-flavor-access:is_public": "True"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:13.051462 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-790110c1-b7e1-408b-88dd-5578547c2810 tempest-FlavorsAccessNegativeTestJSON-155980058 tempest-FlavorsAccessNegativeTestJSON-155980058-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.048983 Aug 31 15:49:13.054949 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 52/82] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:49:13 2022] POST /compute/v2.1/flavors => generated 437 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:49:13.069051 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-07ee3f8c-6050-4bcb-b853-580ddb761d8c tempest-FlavorsAccessNegativeTestJSON-155980058 tempest-FlavorsAccessNegativeTestJSON-155980058-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:13.081177 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-07ee3f8c-6050-4bcb-b853-580ddb761d8c tempest-FlavorsAccessNegativeTestJSON-155980058 tempest-FlavorsAccessNegativeTestJSON-155980058-project-admin] HTTP exception thrown: Access list not available for public flavors. Aug 31 15:49:13.084255 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-07ee3f8c-6050-4bcb-b853-580ddb761d8c tempest-FlavorsAccessNegativeTestJSON-155980058 tempest-FlavorsAccessNegativeTestJSON-155980058-project-admin] Request method failure captured: Aug 31 15:49:13.084255 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/flavors/1187937249/os-flavor-access HTTP/1.1 Aug 31 15:49:13.084255 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:49:13.084255 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:49:13.084255 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:49:13.084255 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:49:13.084255 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:49:13.084255 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:49:13.084255 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:49:13.084255 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:49:13.084255 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4L18kcMoZPeFi0MRk8xxJsArCoAelZG8hzeDQeN3IeZTIHmNszu0Tt75RPW-fYU0rnfmmWkbWCEwPKiiyL8FSsDas0qioWIfi5v4JEAJYD6TtYEJKv-Nauzww2TlQ2mmQyV1lEmHPYItFaDj52OO36CGb9keaefX9bBfwoTH40HezI Aug 31 15:49:13.084255 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:49:13.084255 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:49:13.084255 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:49:13.084255 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:49:13.084255 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:49:13.084255 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:49:13.084255 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: e5e66ecc63c8416da667725e68e5801d Aug 31 15:49:13.084255 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-155980058 Aug 31 15:49:13.084255 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,admin,member Aug 31 15:49:13.084255 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,admin,member Aug 31 15:49:13.085708 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e5e66ecc63c8416da667725e68e5801d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e5e66ecc63c8416da667725e68e5801d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e5e66ecc63c8416da667725e68e5801d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e5e66ecc63c8416da667725e68e5801d", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:49:13.085708 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-155980058 Aug 31 15:49:13.085708 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: e5e66ecc63c8416da667725e68e5801d Aug 31 15:49:13.085708 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-155980058 Aug 31 15:49:13.085708 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-FlavorsAccessNegativeTestJSON-155980058-project-admin Aug 31 15:49:13.085708 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:49:13.085708 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:49:13.085708 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 1c73a31dd3a84eb4ade4d41188fbbcbf Aug 31 15:49:13.085708 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-155980058-project-admin Aug 31 15:49:13.085708 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:49:13.085708 n-d-833090-16 devstack@n-api.service[128864]: exception: Access list not available for public flavors. Aug 31 15:49:13.085708 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'flavor_id': '1187937249'} Aug 31 15:49:13.086530 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:49:13.086530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:13.086530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:13.086530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:13.086530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:49:13.086530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:49:13.086530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:49:13.086530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:49:13.086530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Aug 31 15:49:13.086530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 31 15:49:13.086530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Aug 31 15:49:13.086530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:13.086530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:13.086530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:13.086530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:13.086530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:13.086530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:13.086530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:49:13.086530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:49:13.086530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Aug 31 15:49:13.086530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:13.089039 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-07ee3f8c-6050-4bcb-b853-580ddb761d8c tempest-FlavorsAccessNegativeTestJSON-155980058 tempest-FlavorsAccessNegativeTestJSON-155980058-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:49:13.090435 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-07ee3f8c-6050-4bcb-b853-580ddb761d8c tempest-FlavorsAccessNegativeTestJSON-155980058 tempest-FlavorsAccessNegativeTestJSON-155980058-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/1187937249/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.025316 Aug 31 15:49:13.095441 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 53/83] 10.222.0.50 () {58 vars in 1209 bytes} [Wed Aug 31 15:49:13 2022] GET /compute/v2.1/flavors/1187937249/os-flavor-access => generated 91 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 15:49:13.102551 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-45eddc06-38dc-4b31-a64e-e043369fef7a tempest-FlavorsAccessNegativeTestJSON-155980058 tempest-FlavorsAccessNegativeTestJSON-155980058-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:13.136947 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-45eddc06-38dc-4b31-a64e-e043369fef7a tempest-FlavorsAccessNegativeTestJSON-155980058 tempest-FlavorsAccessNegativeTestJSON-155980058-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1187937249" status: 202 len: 0 microversion: 2.1 time: 0.039400 Aug 31 15:49:13.142519 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 54/84] 10.222.0.50 () {58 vars in 1161 bytes} [Wed Aug 31 15:49:13 2022] DELETE /compute/v2.1/flavors/1187937249 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:49:13.148277 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-bc1f8e5b-07ec-415e-90cb-0b65b2077de6 tempest-FlavorsAccessNegativeTestJSON-155980058 tempest-FlavorsAccessNegativeTestJSON-155980058-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:13.168948 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-bc1f8e5b-07ec-415e-90cb-0b65b2077de6 tempest-FlavorsAccessNegativeTestJSON-155980058 tempest-FlavorsAccessNegativeTestJSON-155980058-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025105 Aug 31 15:49:13.169572 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 55/85] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 31 15:49:13 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:13.190645 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7048e2c2-4666-4d62-98e2-97034e5d0c15 tempest-FlavorsAccessNegativeTestJSON-155980058 tempest-FlavorsAccessNegativeTestJSON-155980058-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1535282221", "id": 2022835268, "os-flavor-access:is_public": "False"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:13.222952 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7048e2c2-4666-4d62-98e2-97034e5d0c15 tempest-FlavorsAccessNegativeTestJSON-155980058 tempest-FlavorsAccessNegativeTestJSON-155980058-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.036176 Aug 31 15:49:13.224832 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 56/86] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:49:13 2022] POST /compute/v2.1/flavors => generated 439 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:49:13.329257 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-baf4f352-86ac-456c-97e4-e565caee151b tempest-QuotasAdminTestV236-1767085267 tempest-QuotasAdminTestV236-1767085267-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/63b6d163ddc34b14b54a8bb3f3cb2086?user_id=035b3cf44b824d5e99c43d3d0f39a496" status: 200 len: 282 microversion: 2.36 time: 0.336612 Aug 31 15:49:13.331438 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 31/87] 10.222.0.50 () {60 vars in 1364 bytes} [Wed Aug 31 15:49:12 2022] GET /compute/v2.1/os-quota-sets/63b6d163ddc34b14b54a8bb3f3cb2086?user_id=035b3cf44b824d5e99c43d3d0f39a496 => generated 282 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:49:13.443595 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ea0bf3e5-1b18-40fa-bada-e8f2dd2157ab tempest-FlavorsAccessNegativeTestJSON-523328349 tempest-FlavorsAccessNegativeTestJSON-523328349-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "3804e175f2df4381a498e3bf7471815f"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:13.447365 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ea0bf3e5-1b18-40fa-bada-e8f2dd2157ab tempest-FlavorsAccessNegativeTestJSON-523328349 tempest-FlavorsAccessNegativeTestJSON-523328349-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '14cf85b13a8e46fe9c15f28326949616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3804e175f2df4381a498e3bf7471815f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:13.449829 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ea0bf3e5-1b18-40fa-bada-e8f2dd2157ab tempest-FlavorsAccessNegativeTestJSON-523328349 tempest-FlavorsAccessNegativeTestJSON-523328349-project] Request method failure captured: Aug 31 15:49:13.449829 n-d-833090-16 devstack@n-api.service[128864]: request: POST /compute/v2.1/flavors/2022835268/action HTTP/1.1 Aug 31 15:49:13.449829 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:49:13.449829 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:49:13.449829 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:49:13.449829 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 67 Aug 31 15:49:13.449829 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:49:13.449829 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:49:13.449829 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:49:13.449829 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:49:13.449829 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4L0iHmUGwqB1cdTJ7U9F5ZIVYw6w81eIQt1Cv05lXkxgYs7pVx6g6K-qc6Wmaxw7KROKw72hj-GdxzziWFIWlE4a2hTlZQK0NGHSMpCtO9zTlM6rlHys9CEufRedCpeD9mDQ1pp4Yb3XIKB0Mh7IsA7uDEfensuwXrZG5DlVlQvshE Aug 31 15:49:13.449829 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:49:13.449829 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:49:13.449829 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:49:13.449829 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:49:13.449829 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:49:13.449829 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:49:13.449829 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 3804e175f2df4381a498e3bf7471815f Aug 31 15:49:13.449829 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-523328349 Aug 31 15:49:13.449829 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:49:13.449829 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:49:13.451007 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3804e175f2df4381a498e3bf7471815f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3804e175f2df4381a498e3bf7471815f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3804e175f2df4381a498e3bf7471815f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3804e175f2df4381a498e3bf7471815f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:49:13.451007 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-523328349 Aug 31 15:49:13.451007 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 3804e175f2df4381a498e3bf7471815f Aug 31 15:49:13.451007 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-523328349 Aug 31 15:49:13.451007 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-FlavorsAccessNegativeTestJSON-523328349-project Aug 31 15:49:13.451007 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:49:13.451007 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:49:13.451007 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 14cf85b13a8e46fe9c15f28326949616 Aug 31 15:49:13.451007 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-523328349-project Aug 31 15:49:13.451007 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 15:49:13.451007 n-d-833090-16 devstack@n-api.service[128864]: {"addTenantAccess": {"tenant": "3804e175f2df4381a498e3bf7471815f"}} Aug 31 15:49:13.451007 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:49:13.451719 n-d-833090-16 devstack@n-api.service[128864]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 31 15:49:13.451719 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '2022835268', 'body': {'addTenantAccess': {'tenant': '3804e175f2df4381a498e3bf7471815f'}}} Aug 31 15:49:13.451719 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:49:13.451719 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:13.451719 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:13.451719 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:13.451719 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:49:13.451719 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:49:13.451719 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:49:13.451719 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:49:13.451719 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:49:13.451719 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:49:13.451719 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Aug 31 15:49:13.451719 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Aug 31 15:49:13.451719 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 15:49:13.451719 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 15:49:13.451719 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 15:49:13.451719 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 15:49:13.451719 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:49:13.452661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:49:13.452661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:49:13.452661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:49:13.452661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 15:49:13.452661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 15:49:13.452661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 15:49:13.452661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 15:49:13.452661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 15:49:13.452661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 15:49:13.452661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 31 15:49:13.452661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:13.452661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:13.452661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:13.452661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:13.452661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:13.452661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:13.452661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 15:49:13.452661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 15:49:13.452661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 31 15:49:13.452661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:13.455882 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ea0bf3e5-1b18-40fa-bada-e8f2dd2157ab tempest-FlavorsAccessNegativeTestJSON-523328349 tempest-FlavorsAccessNegativeTestJSON-523328349-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:49:13.456908 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ea0bf3e5-1b18-40fa-bada-e8f2dd2157ab tempest-FlavorsAccessNegativeTestJSON-523328349 tempest-FlavorsAccessNegativeTestJSON-523328349-project] 10.222.0.50 "POST /compute/v2.1/flavors/2022835268/action" status: 403 len: 130 microversion: 2.1 time: 0.223964 Aug 31 15:49:13.461464 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 57/88] 10.222.0.50 () {60 vars in 1200 bytes} [Wed Aug 31 15:49:13 2022] POST /compute/v2.1/flavors/2022835268/action => generated 130 bytes in 229 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:49:13.467253 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-748f3188-5bc3-4f47-a783-77b8dfa4db02 tempest-FlavorsAccessNegativeTestJSON-155980058 tempest-FlavorsAccessNegativeTestJSON-155980058-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:13.502303 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-748f3188-5bc3-4f47-a783-77b8dfa4db02 tempest-FlavorsAccessNegativeTestJSON-155980058 tempest-FlavorsAccessNegativeTestJSON-155980058-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/2022835268" status: 202 len: 0 microversion: 2.1 time: 0.039276 Aug 31 15:49:13.503198 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 32/89] 10.222.0.50 () {58 vars in 1161 bytes} [Wed Aug 31 15:49:13 2022] DELETE /compute/v2.1/flavors/2022835268 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 15:49:13.511190 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9956bb82-7018-420f-bc98-11e1723b7b2b tempest-FlavorsAccessNegativeTestJSON-155980058 tempest-FlavorsAccessNegativeTestJSON-155980058-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:13.532693 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9956bb82-7018-420f-bc98-11e1723b7b2b tempest-FlavorsAccessNegativeTestJSON-155980058 tempest-FlavorsAccessNegativeTestJSON-155980058-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025060 Aug 31 15:49:13.533287 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 58/90] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 31 15:49:13 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:13.551637 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-407072ab-7fb3-4ef3-8683-0a0178123cab tempest-FlavorsAccessNegativeTestJSON-155980058 tempest-FlavorsAccessNegativeTestJSON-155980058-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2121039200", "id": 1293678018, "os-flavor-access:is_public": "False"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:13.571427 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-407072ab-7fb3-4ef3-8683-0a0178123cab tempest-FlavorsAccessNegativeTestJSON-155980058 tempest-FlavorsAccessNegativeTestJSON-155980058-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.023567 Aug 31 15:49:13.572069 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 33/91] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:49:13 2022] POST /compute/v2.1/flavors => generated 439 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:49:13.584135 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f9f96422-4ae8-4929-8d2b-48001aa84817 tempest-FlavorsAccessNegativeTestJSON-155980058 tempest-FlavorsAccessNegativeTestJSON-155980058-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "3804e175f2df4381a498e3bf7471815f"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:13.923129 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-428a35f0-91eb-4aef-9be0-d8b237113f42 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:13.923803 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-428a35f0-91eb-4aef-9be0-d8b237113f42 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] [instance: e1429482-9aee-476b-a4db-585f0493cff7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:13.930438 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-428a35f0-91eb-4aef-9be0-d8b237113f42 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:13.930919 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-428a35f0-91eb-4aef-9be0-d8b237113f42 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:13.931337 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-428a35f0-91eb-4aef-9be0-d8b237113f42 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:13.932568 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-428a35f0-91eb-4aef-9be0-d8b237113f42 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:13.933881 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-428a35f0-91eb-4aef-9be0-d8b237113f42 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:13.934384 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-428a35f0-91eb-4aef-9be0-d8b237113f42 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:14.076958 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-428a35f0-91eb-4aef-9be0-d8b237113f42 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca35cd4f679249c2b98305e4bc1cb13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454e809640fd4c1381463bd27e69c02b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:14.084823 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-428a35f0-91eb-4aef-9be0-d8b237113f42 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] 10.222.0.50 "GET /compute/v2.1/servers/e1429482-9aee-476b-a4db-585f0493cff7" status: 200 len: 1337 microversion: 2.1 time: 0.166407 Aug 31 15:49:14.085399 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 34/92] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:49:13 2022] GET /compute/v2.1/servers/e1429482-9aee-476b-a4db-585f0493cff7 => generated 1337 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:14.163438 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f9f96422-4ae8-4929-8d2b-48001aa84817 tempest-FlavorsAccessNegativeTestJSON-155980058 tempest-FlavorsAccessNegativeTestJSON-155980058-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/1293678018/action" status: 200 len: 97 microversion: 2.1 time: 0.583242 Aug 31 15:49:14.169197 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 59/93] 10.222.0.50 () {60 vars in 1200 bytes} [Wed Aug 31 15:49:13 2022] POST /compute/v2.1/flavors/1293678018/action => generated 97 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 15:49:14.175184 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-41c30416-d9bf-4e5b-bc08-c4f4dc421e62 tempest-FlavorsAccessNegativeTestJSON-523328349 tempest-FlavorsAccessNegativeTestJSON-523328349-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "3804e175f2df4381a498e3bf7471815f"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:14.178638 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-41c30416-d9bf-4e5b-bc08-c4f4dc421e62 tempest-FlavorsAccessNegativeTestJSON-523328349 tempest-FlavorsAccessNegativeTestJSON-523328349-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '14cf85b13a8e46fe9c15f28326949616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3804e175f2df4381a498e3bf7471815f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:14.180338 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-41c30416-d9bf-4e5b-bc08-c4f4dc421e62 tempest-FlavorsAccessNegativeTestJSON-523328349 tempest-FlavorsAccessNegativeTestJSON-523328349-project] Request method failure captured: Aug 31 15:49:14.180338 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/flavors/1293678018/action HTTP/1.1 Aug 31 15:49:14.180338 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:49:14.180338 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:49:14.180338 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:49:14.180338 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 70 Aug 31 15:49:14.180338 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:49:14.180338 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:49:14.180338 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:49:14.180338 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:49:14.180338 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4L0iHmUGwqB1cdTJ7U9F5ZIVYw6w81eIQt1Cv05lXkxgYs7pVx6g6K-qc6Wmaxw7KROKw72hj-GdxzziWFIWlE4a2hTlZQK0NGHSMpCtO9zTlM6rlHys9CEufRedCpeD9mDQ1pp4Yb3XIKB0Mh7IsA7uDEfensuwXrZG5DlVlQvshE Aug 31 15:49:14.180338 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:49:14.180338 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:49:14.180338 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:49:14.180338 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:49:14.180338 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:49:14.180338 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:49:14.180338 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 3804e175f2df4381a498e3bf7471815f Aug 31 15:49:14.180338 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-523328349 Aug 31 15:49:14.180338 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:49:14.180338 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:49:14.181485 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3804e175f2df4381a498e3bf7471815f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3804e175f2df4381a498e3bf7471815f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3804e175f2df4381a498e3bf7471815f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3804e175f2df4381a498e3bf7471815f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:49:14.181485 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-523328349 Aug 31 15:49:14.181485 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 3804e175f2df4381a498e3bf7471815f Aug 31 15:49:14.181485 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-523328349 Aug 31 15:49:14.181485 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-FlavorsAccessNegativeTestJSON-523328349-project Aug 31 15:49:14.181485 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:49:14.181485 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:49:14.181485 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 14cf85b13a8e46fe9c15f28326949616 Aug 31 15:49:14.181485 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-523328349-project Aug 31 15:49:14.181485 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 15:49:14.181485 n-d-833090-16 devstack@n-api.service[128863]: {"removeTenantAccess": {"tenant": "3804e175f2df4381a498e3bf7471815f"}} Aug 31 15:49:14.181485 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 15:49:14.182236 n-d-833090-16 devstack@n-api.service[128863]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 31 15:49:14.182236 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '1293678018', 'body': {'removeTenantAccess': {'tenant': '3804e175f2df4381a498e3bf7471815f'}}} Aug 31 15:49:14.182236 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:49:14.182236 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:14.182236 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:14.182236 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:14.182236 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:49:14.182236 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:49:14.182236 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:49:14.182236 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:49:14.182236 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:49:14.182236 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:49:14.182236 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Aug 31 15:49:14.182236 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi context.can( Aug 31 15:49:14.182236 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 15:49:14.182236 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 15:49:14.182236 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 15:49:14.182236 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 15:49:14.182236 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:49:14.182236 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:49:14.183300 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:49:14.183300 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:49:14.183300 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 15:49:14.183300 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 15:49:14.183300 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 15:49:14.183300 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 15:49:14.183300 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 15:49:14.183300 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 15:49:14.183300 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 31 15:49:14.183300 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:14.183300 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:14.183300 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:14.183300 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:14.183300 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:14.183300 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:14.183300 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 15:49:14.183300 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 15:49:14.183300 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 31 15:49:14.183300 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:14.184314 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-41c30416-d9bf-4e5b-bc08-c4f4dc421e62 tempest-FlavorsAccessNegativeTestJSON-523328349 tempest-FlavorsAccessNegativeTestJSON-523328349-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:49:14.184314 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-41c30416-d9bf-4e5b-bc08-c4f4dc421e62 tempest-FlavorsAccessNegativeTestJSON-523328349 tempest-FlavorsAccessNegativeTestJSON-523328349-project] 10.222.0.50 "POST /compute/v2.1/flavors/1293678018/action" status: 403 len: 133 microversion: 2.1 time: 0.011042 Aug 31 15:49:14.185674 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 35/94] 10.222.0.50 () {60 vars in 1200 bytes} [Wed Aug 31 15:49:14 2022] POST /compute/v2.1/flavors/1293678018/action => generated 133 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:49:14.191696 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d70e68f6-f803-4434-99d8-9323e4995181 tempest-FlavorsAccessNegativeTestJSON-155980058 tempest-FlavorsAccessNegativeTestJSON-155980058-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "3804e175f2df4381a498e3bf7471815f"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:14.523151 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d70e68f6-f803-4434-99d8-9323e4995181 tempest-FlavorsAccessNegativeTestJSON-155980058 tempest-FlavorsAccessNegativeTestJSON-155980058-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/1293678018/action" status: 200 len: 21 microversion: 2.1 time: 0.335775 Aug 31 15:49:14.524641 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 60/95] 10.222.0.50 () {60 vars in 1200 bytes} [Wed Aug 31 15:49:14 2022] POST /compute/v2.1/flavors/1293678018/action => generated 21 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 15:49:14.539459 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3033d952-1269-4cfe-82b9-c82fbd3d6809 tempest-FlavorsAccessNegativeTestJSON-155980058 tempest-FlavorsAccessNegativeTestJSON-155980058-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:14.587073 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3033d952-1269-4cfe-82b9-c82fbd3d6809 tempest-FlavorsAccessNegativeTestJSON-155980058 tempest-FlavorsAccessNegativeTestJSON-155980058-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1293678018" status: 202 len: 0 microversion: 2.1 time: 0.053395 Aug 31 15:49:14.593833 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 36/96] 10.222.0.50 () {58 vars in 1161 bytes} [Wed Aug 31 15:49:14 2022] DELETE /compute/v2.1/flavors/1293678018 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:49:14.598661 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-822a4555-8331-45b0-9003-b8e65f2a2f4b tempest-FlavorsAccessNegativeTestJSON-155980058 tempest-FlavorsAccessNegativeTestJSON-155980058-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:14.647647 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-822a4555-8331-45b0-9003-b8e65f2a2f4b tempest-FlavorsAccessNegativeTestJSON-155980058 tempest-FlavorsAccessNegativeTestJSON-155980058-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.052571 Aug 31 15:49:14.648824 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 61/97] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 31 15:49:14 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:14.668067 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1aba5249-6a5c-4580-b3e7-72783e9e6414 tempest-FlavorsAccessNegativeTestJSON-155980058 tempest-FlavorsAccessNegativeTestJSON-155980058-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1255849886", "id": 1082449265, "os-flavor-access:is_public": "False"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:14.699530 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1aba5249-6a5c-4580-b3e7-72783e9e6414 tempest-FlavorsAccessNegativeTestJSON-155980058 tempest-FlavorsAccessNegativeTestJSON-155980058-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.034517 Aug 31 15:49:14.700144 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 37/98] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:49:14 2022] POST /compute/v2.1/flavors => generated 439 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:14.715810 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-730a538b-5694-4ce1-8304-68cc6b13ee0e tempest-FlavorsAccessNegativeTestJSON-155980058 tempest-FlavorsAccessNegativeTestJSON-155980058-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "ca1451a154184a2689f1e32ca026b08b"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:15.153173 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-730a538b-5694-4ce1-8304-68cc6b13ee0e tempest-FlavorsAccessNegativeTestJSON-155980058 tempest-FlavorsAccessNegativeTestJSON-155980058-project-admin] HTTP exception thrown: Flavor access not found for 23 / ca1451a154184a2689f1e32ca026b08b combination. Aug 31 15:49:15.156467 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-730a538b-5694-4ce1-8304-68cc6b13ee0e tempest-FlavorsAccessNegativeTestJSON-155980058 tempest-FlavorsAccessNegativeTestJSON-155980058-project-admin] Request method failure captured: Aug 31 15:49:15.156467 n-d-833090-16 devstack@n-api.service[128864]: request: POST /compute/v2.1/flavors/1082449265/action HTTP/1.1 Aug 31 15:49:15.156467 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:49:15.156467 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:49:15.156467 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:49:15.156467 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 70 Aug 31 15:49:15.156467 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:49:15.156467 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:49:15.156467 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:49:15.156467 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:49:15.156467 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4L18kcMoZPeFi0MRk8xxJsArCoAelZG8hzeDQeN3IeZTIHmNszu0Tt75RPW-fYU0rnfmmWkbWCEwPKiiyL8FSsDas0qioWIfi5v4JEAJYD6TtYEJKv-Nauzww2TlQ2mmQyV1lEmHPYItFaDj52OO36CGb9keaefX9bBfwoTH40HezI Aug 31 15:49:15.156467 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:49:15.156467 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:49:15.156467 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:49:15.156467 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:49:15.156467 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:49:15.156467 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:49:15.156467 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: e5e66ecc63c8416da667725e68e5801d Aug 31 15:49:15.156467 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-155980058 Aug 31 15:49:15.156467 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,admin,member Aug 31 15:49:15.156467 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,admin,member Aug 31 15:49:15.157984 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e5e66ecc63c8416da667725e68e5801d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e5e66ecc63c8416da667725e68e5801d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e5e66ecc63c8416da667725e68e5801d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e5e66ecc63c8416da667725e68e5801d", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:49:15.157984 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-155980058 Aug 31 15:49:15.157984 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: e5e66ecc63c8416da667725e68e5801d Aug 31 15:49:15.157984 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-155980058 Aug 31 15:49:15.157984 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-FlavorsAccessNegativeTestJSON-155980058-project-admin Aug 31 15:49:15.157984 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:49:15.157984 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:49:15.157984 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 1c73a31dd3a84eb4ade4d41188fbbcbf Aug 31 15:49:15.157984 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-155980058-project-admin Aug 31 15:49:15.157984 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 15:49:15.157984 n-d-833090-16 devstack@n-api.service[128864]: {"removeTenantAccess": {"tenant": "ca1451a154184a2689f1e32ca026b08b"}} Aug 31 15:49:15.157984 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:49:15.158733 n-d-833090-16 devstack@n-api.service[128864]: exception: Flavor access not found for 23 / ca1451a154184a2689f1e32ca026b08b combination. Aug 31 15:49:15.158733 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '1082449265', 'body': {'removeTenantAccess': {'tenant': 'ca1451a154184a2689f1e32ca026b08b'}}} Aug 31 15:49:15.158733 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:49:15.158733 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:15.158733 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Aug 31 15:49:15.158733 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Aug 31 15:49:15.158733 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 31 15:49:15.158733 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 31 15:49:15.158733 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Aug 31 15:49:15.158733 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Aug 31 15:49:15.158733 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Aug 31 15:49:15.158733 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Aug 31 15:49:15.158733 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Aug 31 15:49:15.158733 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Aug 31 15:49:15.158733 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 31 15:49:15.158733 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 31 15:49:15.158733 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Aug 31 15:49:15.158733 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Aug 31 15:49:15.159918 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 23 / ca1451a154184a2689f1e32ca026b08b combination. Aug 31 15:49:15.159918 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:15.159918 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:15.159918 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:15.159918 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:15.159918 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:15.159918 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:15.159918 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:49:15.159918 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:49:15.159918 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:49:15.159918 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:49:15.159918 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:49:15.159918 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:49:15.159918 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Aug 31 15:49:15.159918 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:49:15.159918 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 23 / ca1451a154184a2689f1e32ca026b08b combination. Aug 31 15:49:15.159918 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:15.159918 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:15.159918 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:15.159918 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:15.161136 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:15.161136 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:15.161136 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:49:15.161136 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:49:15.161136 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 23 / ca1451a154184a2689f1e32ca026b08b combination. Aug 31 15:49:15.161136 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:15.161136 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-730a538b-5694-4ce1-8304-68cc6b13ee0e tempest-FlavorsAccessNegativeTestJSON-155980058 tempest-FlavorsAccessNegativeTestJSON-155980058-project-admin] Returning 404 to user: Flavor access not found for 23 / ca1451a154184a2689f1e32ca026b08b combination. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:49:15.161136 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-730a538b-5694-4ce1-8304-68cc6b13ee0e tempest-FlavorsAccessNegativeTestJSON-155980058 tempest-FlavorsAccessNegativeTestJSON-155980058-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/1082449265/action" status: 404 len: 124 microversion: 2.1 time: 0.448912 Aug 31 15:49:15.162310 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 62/99] 10.222.0.50 () {60 vars in 1200 bytes} [Wed Aug 31 15:49:14 2022] POST /compute/v2.1/flavors/1082449265/action => generated 124 bytes in 454 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:49:15.167260 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e916f1ce-0bdd-4097-be7d-abfa8a7a1a16 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:15.168547 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e916f1ce-0bdd-4097-be7d-abfa8a7a1a16 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] [instance: e1429482-9aee-476b-a4db-585f0493cff7] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:15.175350 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e916f1ce-0bdd-4097-be7d-abfa8a7a1a16 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:15.176027 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e916f1ce-0bdd-4097-be7d-abfa8a7a1a16 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:15.176444 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e916f1ce-0bdd-4097-be7d-abfa8a7a1a16 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:15.177287 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e916f1ce-0bdd-4097-be7d-abfa8a7a1a16 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:15.177872 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e916f1ce-0bdd-4097-be7d-abfa8a7a1a16 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:15.179850 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e916f1ce-0bdd-4097-be7d-abfa8a7a1a16 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:15.185697 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b8a3abd6-9770-489d-9cf9-877b2baa7e81 tempest-QuotasAdminTestV257-1432428024 tempest-QuotasAdminTestV257-1432428024-project-admin] Action: 'update', calling method: .version_select at 0x7fbb4745ec10>, body: {"quota_set": {"ram": "5120"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:15.321400 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e916f1ce-0bdd-4097-be7d-abfa8a7a1a16 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca35cd4f679249c2b98305e4bc1cb13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454e809640fd4c1381463bd27e69c02b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:15.333310 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e916f1ce-0bdd-4097-be7d-abfa8a7a1a16 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] 10.222.0.50 "GET /compute/v2.1/servers/e1429482-9aee-476b-a4db-585f0493cff7" status: 200 len: 1337 microversion: 2.1 time: 0.169066 Aug 31 15:49:15.335212 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 63/100] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:49:15 2022] GET /compute/v2.1/servers/e1429482-9aee-476b-a4db-585f0493cff7 => generated 1337 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:15.342775 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fc16224b-ec9a-4e7f-b9ea-70309f5a3e48 tempest-FlavorsAccessNegativeTestJSON-155980058 tempest-FlavorsAccessNegativeTestJSON-155980058-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:15.362161 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fc16224b-ec9a-4e7f-b9ea-70309f5a3e48 tempest-FlavorsAccessNegativeTestJSON-155980058 tempest-FlavorsAccessNegativeTestJSON-155980058-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1082449265" status: 202 len: 0 microversion: 2.1 time: 0.024743 Aug 31 15:49:15.368142 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 64/101] 10.222.0.50 () {58 vars in 1161 bytes} [Wed Aug 31 15:49:15 2022] DELETE /compute/v2.1/flavors/1082449265 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:49:15.376280 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-bb965f0c-1e78-4d5d-a74f-8f06b05b8de4 tempest-FlavorsAccessNegativeTestJSON-155980058 tempest-FlavorsAccessNegativeTestJSON-155980058-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:15.403676 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-bb965f0c-1e78-4d5d-a74f-8f06b05b8de4 tempest-FlavorsAccessNegativeTestJSON-155980058 tempest-FlavorsAccessNegativeTestJSON-155980058-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033639 Aug 31 15:49:15.404955 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 65/102] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 31 15:49:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:15.805853 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8a3abd6-9770-489d-9cf9-877b2baa7e81 tempest-QuotasAdminTestV257-1432428024 tempest-QuotasAdminTestV257-1432428024-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:15.807851 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8a3abd6-9770-489d-9cf9-877b2baa7e81 tempest-QuotasAdminTestV257-1432428024 tempest-QuotasAdminTestV257-1432428024-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:15.808343 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8a3abd6-9770-489d-9cf9-877b2baa7e81 tempest-QuotasAdminTestV257-1432428024 tempest-QuotasAdminTestV257-1432428024-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:15.809267 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8a3abd6-9770-489d-9cf9-877b2baa7e81 tempest-QuotasAdminTestV257-1432428024 tempest-QuotasAdminTestV257-1432428024-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:15.813190 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8a3abd6-9770-489d-9cf9-877b2baa7e81 tempest-QuotasAdminTestV257-1432428024 tempest-QuotasAdminTestV257-1432428024-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:15.813774 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8a3abd6-9770-489d-9cf9-877b2baa7e81 tempest-QuotasAdminTestV257-1432428024 tempest-QuotasAdminTestV257-1432428024-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:15.870415 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b8a3abd6-9770-489d-9cf9-877b2baa7e81 tempest-QuotasAdminTestV257-1432428024 tempest-QuotasAdminTestV257-1432428024-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/d94d6284ea17436bb64e42bd73a71d03" status: 200 len: 148 microversion: 2.57 time: 0.972994 Aug 31 15:49:15.871305 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 38/103] 10.222.0.50 () {62 vars in 1303 bytes} [Wed Aug 31 15:49:14 2022] PUT /compute/v2.1/os-quota-sets/d94d6284ea17436bb64e42bd73a71d03 => generated 148 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:49:15.887381 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3594f296-4184-443d-a99d-00f265a81566 tempest-QuotasAdminTestV257-1432428024 tempest-QuotasAdminTestV257-1432428024-project-admin] Calling method '.version_select at 0x7fbb475c65e0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:16.178510 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b87117d5-6f02-45fc-9ac2-27033b4248d2 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1742928098", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:16.240232 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-b87117d5-6f02-45fc-9ac2-27033b4248d2 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] validate_networks() for None {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:49:16.355665 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3594f296-4184-443d-a99d-00f265a81566 tempest-QuotasAdminTestV257-1432428024 tempest-QuotasAdminTestV257-1432428024-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:16.356129 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3594f296-4184-443d-a99d-00f265a81566 tempest-QuotasAdminTestV257-1432428024 tempest-QuotasAdminTestV257-1432428024-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:16.356418 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3594f296-4184-443d-a99d-00f265a81566 tempest-QuotasAdminTestV257-1432428024 tempest-QuotasAdminTestV257-1432428024-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:16.357405 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3594f296-4184-443d-a99d-00f265a81566 tempest-QuotasAdminTestV257-1432428024 tempest-QuotasAdminTestV257-1432428024-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:16.357853 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3594f296-4184-443d-a99d-00f265a81566 tempest-QuotasAdminTestV257-1432428024 tempest-QuotasAdminTestV257-1432428024-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:16.358303 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3594f296-4184-443d-a99d-00f265a81566 tempest-QuotasAdminTestV257-1432428024 tempest-QuotasAdminTestV257-1432428024-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:16.379285 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3594f296-4184-443d-a99d-00f265a81566 tempest-QuotasAdminTestV257-1432428024 tempest-QuotasAdminTestV257-1432428024-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/d94d6284ea17436bb64e42bd73a71d03/detail" status: 200 len: 463 microversion: 2.57 time: 0.501213 Aug 31 15:49:16.379891 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 66/104] 10.222.0.50 () {60 vars in 1304 bytes} [Wed Aug 31 15:49:15 2022] GET /compute/v2.1/os-quota-sets/d94d6284ea17436bb64e42bd73a71d03/detail => generated 463 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 15:49:16.385295 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4150f50a-1efc-4b2b-959a-99c9c029c33a tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:16.385964 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4150f50a-1efc-4b2b-959a-99c9c029c33a tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] [instance: e1429482-9aee-476b-a4db-585f0493cff7] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:16.392925 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4150f50a-1efc-4b2b-959a-99c9c029c33a tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:16.393661 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4150f50a-1efc-4b2b-959a-99c9c029c33a tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:16.394545 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4150f50a-1efc-4b2b-959a-99c9c029c33a tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:16.395535 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4150f50a-1efc-4b2b-959a-99c9c029c33a tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:16.396134 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4150f50a-1efc-4b2b-959a-99c9c029c33a tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:16.396746 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4150f50a-1efc-4b2b-959a-99c9c029c33a tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:16.726927 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b87117d5-6f02-45fc-9ac2-27033b4248d2 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:49:16.727467 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b87117d5-6f02-45fc-9ac2-27033b4248d2 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:49:16.728002 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b87117d5-6f02-45fc-9ac2-27033b4248d2 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:49:16.728473 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b87117d5-6f02-45fc-9ac2-27033b4248d2 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:49:16.728880 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b87117d5-6f02-45fc-9ac2-27033b4248d2 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:49:16.745594 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b87117d5-6f02-45fc-9ac2-27033b4248d2 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:16.746553 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b87117d5-6f02-45fc-9ac2-27033b4248d2 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:16.747944 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b87117d5-6f02-45fc-9ac2-27033b4248d2 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:16.750636 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b87117d5-6f02-45fc-9ac2-27033b4248d2 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:16.751520 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b87117d5-6f02-45fc-9ac2-27033b4248d2 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:16.758458 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b87117d5-6f02-45fc-9ac2-27033b4248d2 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:16.787268 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-b87117d5-6f02-45fc-9ac2-27033b4248d2 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Getting quotas for project 7db749eb0a764fa0bb29ddc4abd6d245. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:49:16.794343 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4150f50a-1efc-4b2b-959a-99c9c029c33a tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca35cd4f679249c2b98305e4bc1cb13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454e809640fd4c1381463bd27e69c02b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:16.797964 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-b87117d5-6f02-45fc-9ac2-27033b4248d2 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Getting quotas for user fe647be03cef4e9c86b4fd6e703d0de1 and project 7db749eb0a764fa0bb29ddc4abd6d245. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:49:16.807877 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=88,nova_cell0:UPDATE=12 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:49:16.808437 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4150f50a-1efc-4b2b-959a-99c9c029c33a tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] 10.222.0.50 "GET /compute/v2.1/servers/e1429482-9aee-476b-a4db-585f0493cff7" status: 200 len: 1337 microversion: 2.1 time: 0.426165 Aug 31 15:49:16.817243 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b87117d5-6f02-45fc-9ac2-27033b4248d2 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:49:16.820843 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b87117d5-6f02-45fc-9ac2-27033b4248d2 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 848b21b2-98a0-4e70-a27c-08d390d73ae6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:49:16.826471 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 67/105] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:49:16 2022] GET /compute/v2.1/servers/e1429482-9aee-476b-a4db-585f0493cff7 => generated 1337 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:16.835302 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-393621cb-9891-4d0c-924d-cf13b10d0331 tempest-QuotasAdminTestV257-1432428024 tempest-QuotasAdminTestV257-1432428024-project-admin] Action: 'update', calling method: .version_select at 0x7fbb476855e0>, body: {"quota_set": {"ram": "2048"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:16.927870 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b87117d5-6f02-45fc-9ac2-27033b4248d2 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.041242 Aug 31 15:49:16.935819 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 39/106] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:49:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1050 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 15:49:16.951788 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3557a1de-9f5e-47d9-8d11-246f8f5f19db tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:16.952402 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3557a1de-9f5e-47d9-8d11-246f8f5f19db tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 848b21b2-98a0-4e70-a27c-08d390d73ae6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:17.126998 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3557a1de-9f5e-47d9-8d11-246f8f5f19db tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:17.165204 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3557a1de-9f5e-47d9-8d11-246f8f5f19db tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6" status: 200 len: 1217 microversion: 2.1 time: 0.222334 Aug 31 15:49:17.166129 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 40/107] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:49:16 2022] GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6 => generated 1217 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:17.325660 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-393621cb-9891-4d0c-924d-cf13b10d0331 tempest-QuotasAdminTestV257-1432428024 tempest-QuotasAdminTestV257-1432428024-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:17.326485 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-393621cb-9891-4d0c-924d-cf13b10d0331 tempest-QuotasAdminTestV257-1432428024 tempest-QuotasAdminTestV257-1432428024-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:17.328239 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-393621cb-9891-4d0c-924d-cf13b10d0331 tempest-QuotasAdminTestV257-1432428024 tempest-QuotasAdminTestV257-1432428024-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:17.331704 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-393621cb-9891-4d0c-924d-cf13b10d0331 tempest-QuotasAdminTestV257-1432428024 tempest-QuotasAdminTestV257-1432428024-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:17.332211 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-393621cb-9891-4d0c-924d-cf13b10d0331 tempest-QuotasAdminTestV257-1432428024 tempest-QuotasAdminTestV257-1432428024-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:17.334425 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-393621cb-9891-4d0c-924d-cf13b10d0331 tempest-QuotasAdminTestV257-1432428024 tempest-QuotasAdminTestV257-1432428024-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:17.413749 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-393621cb-9891-4d0c-924d-cf13b10d0331 tempest-QuotasAdminTestV257-1432428024 tempest-QuotasAdminTestV257-1432428024-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:17.414328 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-393621cb-9891-4d0c-924d-cf13b10d0331 tempest-QuotasAdminTestV257-1432428024 tempest-QuotasAdminTestV257-1432428024-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:17.414717 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-393621cb-9891-4d0c-924d-cf13b10d0331 tempest-QuotasAdminTestV257-1432428024 tempest-QuotasAdminTestV257-1432428024-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:17.416141 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-393621cb-9891-4d0c-924d-cf13b10d0331 tempest-QuotasAdminTestV257-1432428024 tempest-QuotasAdminTestV257-1432428024-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:17.417365 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-393621cb-9891-4d0c-924d-cf13b10d0331 tempest-QuotasAdminTestV257-1432428024 tempest-QuotasAdminTestV257-1432428024-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:17.417922 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-393621cb-9891-4d0c-924d-cf13b10d0331 tempest-QuotasAdminTestV257-1432428024 tempest-QuotasAdminTestV257-1432428024-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:17.519586 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-393621cb-9891-4d0c-924d-cf13b10d0331 tempest-QuotasAdminTestV257-1432428024 tempest-QuotasAdminTestV257-1432428024-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/d94d6284ea17436bb64e42bd73a71d03?user_id=77872e93471e447ba8e9b022cec289ec" status: 200 len: 148 microversion: 2.57 time: 0.691800 Aug 31 15:49:17.520249 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 68/108] 10.222.0.50 () {62 vars in 1384 bytes} [Wed Aug 31 15:49:16 2022] PUT /compute/v2.1/os-quota-sets/d94d6284ea17436bb64e42bd73a71d03?user_id=77872e93471e447ba8e9b022cec289ec => generated 148 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:49:17.533263 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bffe613c-0571-4f02-bc58-d3581646aad0 tempest-QuotasAdminTestV257-1432428024 tempest-QuotasAdminTestV257-1432428024-project-admin] Calling method '.version_select at 0x7fbb4740cb80>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:17.708969 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-51e433da-c3f4-4cfe-9514-86a62b1506f4 req-6dce9c15-2033-4626-92ec-2687215583a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1429482-9aee-476b-a4db-585f0493cff7", "name": "network-vif-plugged", "status": "completed", "tag": "a82371a6-c79c-42a9-afc9-11da569e1bd2"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:17.739346 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-51e433da-c3f4-4cfe-9514-86a62b1506f4 req-6dce9c15-2033-4626-92ec-2687215583a4 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:17.740527 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-51e433da-c3f4-4cfe-9514-86a62b1506f4 req-6dce9c15-2033-4626-92ec-2687215583a4 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:17.741154 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-51e433da-c3f4-4cfe-9514-86a62b1506f4 req-6dce9c15-2033-4626-92ec-2687215583a4 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:17.760384 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-51e433da-c3f4-4cfe-9514-86a62b1506f4 req-6dce9c15-2033-4626-92ec-2687215583a4 service nova] Creating event network-vif-plugged:a82371a6-c79c-42a9-afc9-11da569e1bd2 for instance e1429482-9aee-476b-a4db-585f0493cff7 on n-h1-833090-16 Aug 31 15:49:17.775834 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-51e433da-c3f4-4cfe-9514-86a62b1506f4 req-6dce9c15-2033-4626-92ec-2687215583a4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154345 Aug 31 15:49:17.779859 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 69/109] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:49:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:17.837037 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9cd2b5c7-a99a-4775-8ea9-14fdb97bd0cd tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:17.838182 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9cd2b5c7-a99a-4775-8ea9-14fdb97bd0cd tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] [instance: e1429482-9aee-476b-a4db-585f0493cff7] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:17.848090 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9cd2b5c7-a99a-4775-8ea9-14fdb97bd0cd tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:17.848851 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9cd2b5c7-a99a-4775-8ea9-14fdb97bd0cd tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:17.850244 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9cd2b5c7-a99a-4775-8ea9-14fdb97bd0cd tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:17.851161 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9cd2b5c7-a99a-4775-8ea9-14fdb97bd0cd tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:17.852403 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9cd2b5c7-a99a-4775-8ea9-14fdb97bd0cd tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:17.853028 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9cd2b5c7-a99a-4775-8ea9-14fdb97bd0cd tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:17.972979 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=9,nova_api:DELETE=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:49:17.999674 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bffe613c-0571-4f02-bc58-d3581646aad0 tempest-QuotasAdminTestV257-1432428024 tempest-QuotasAdminTestV257-1432428024-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/d94d6284ea17436bb64e42bd73a71d03?user_id=77872e93471e447ba8e9b022cec289ec" status: 200 len: 190 microversion: 2.57 time: 0.472253 Aug 31 15:49:18.000821 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 41/110] 10.222.0.50 () {60 vars in 1364 bytes} [Wed Aug 31 15:49:17 2022] GET /compute/v2.1/os-quota-sets/d94d6284ea17436bb64e42bd73a71d03?user_id=77872e93471e447ba8e9b022cec289ec => generated 190 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 15:49:18.159711 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9cd2b5c7-a99a-4775-8ea9-14fdb97bd0cd tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca35cd4f679249c2b98305e4bc1cb13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454e809640fd4c1381463bd27e69c02b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:18.175580 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9cd2b5c7-a99a-4775-8ea9-14fdb97bd0cd tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] 10.222.0.50 "GET /compute/v2.1/servers/e1429482-9aee-476b-a4db-585f0493cff7" status: 200 len: 1337 microversion: 2.1 time: 0.346141 Aug 31 15:49:18.178231 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 70/111] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:49:17 2022] GET /compute/v2.1/servers/e1429482-9aee-476b-a4db-585f0493cff7 => generated 1337 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:18.198777 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c4d6667e-2ad0-4d9c-af8d-51daec69ece9 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:18.199327 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c4d6667e-2ad0-4d9c-af8d-51daec69ece9 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 848b21b2-98a0-4e70-a27c-08d390d73ae6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:18.211824 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4d6667e-2ad0-4d9c-af8d-51daec69ece9 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:18.212658 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4d6667e-2ad0-4d9c-af8d-51daec69ece9 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:18.213644 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4d6667e-2ad0-4d9c-af8d-51daec69ece9 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:18.216240 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4d6667e-2ad0-4d9c-af8d-51daec69ece9 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:18.216984 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4d6667e-2ad0-4d9c-af8d-51daec69ece9 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:18.218525 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4d6667e-2ad0-4d9c-af8d-51daec69ece9 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:18.400227 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c4d6667e-2ad0-4d9c-af8d-51daec69ece9 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:18.418277 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c4d6667e-2ad0-4d9c-af8d-51daec69ece9 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6" status: 200 len: 1221 microversion: 2.1 time: 0.232871 Aug 31 15:49:18.420970 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 42/112] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:49:18 2022] GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6 => generated 1221 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:19.200101 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d3bfedb2-747d-4996-8212-ca571e828a9f tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:19.200753 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d3bfedb2-747d-4996-8212-ca571e828a9f tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] [instance: e1429482-9aee-476b-a4db-585f0493cff7] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:19.212797 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d3bfedb2-747d-4996-8212-ca571e828a9f tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:19.213675 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d3bfedb2-747d-4996-8212-ca571e828a9f tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:19.215427 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d3bfedb2-747d-4996-8212-ca571e828a9f tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:19.218518 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d3bfedb2-747d-4996-8212-ca571e828a9f tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:19.219746 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d3bfedb2-747d-4996-8212-ca571e828a9f tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:19.221181 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d3bfedb2-747d-4996-8212-ca571e828a9f tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:19.442074 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-58ad270a-81b1-498a-a9f2-26b1ec6c820b tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:19.442711 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-58ad270a-81b1-498a-a9f2-26b1ec6c820b tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 848b21b2-98a0-4e70-a27c-08d390d73ae6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:19.455852 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58ad270a-81b1-498a-a9f2-26b1ec6c820b tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:19.456663 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58ad270a-81b1-498a-a9f2-26b1ec6c820b tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:19.457236 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58ad270a-81b1-498a-a9f2-26b1ec6c820b tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:19.458083 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58ad270a-81b1-498a-a9f2-26b1ec6c820b tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:19.458696 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58ad270a-81b1-498a-a9f2-26b1ec6c820b tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:19.464647 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58ad270a-81b1-498a-a9f2-26b1ec6c820b tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:19.684093 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-58ad270a-81b1-498a-a9f2-26b1ec6c820b tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:19.696322 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-58ad270a-81b1-498a-a9f2-26b1ec6c820b tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6" status: 200 len: 1277 microversion: 2.1 time: 0.258885 Aug 31 15:49:19.704101 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 43/113] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:49:19 2022] GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6 => generated 1277 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:49:20.265371 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d3bfedb2-747d-4996-8212-ca571e828a9f tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca35cd4f679249c2b98305e4bc1cb13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454e809640fd4c1381463bd27e69c02b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:20.284931 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d3bfedb2-747d-4996-8212-ca571e828a9f tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] 10.222.0.50 "GET /compute/v2.1/servers/e1429482-9aee-476b-a4db-585f0493cff7" status: 200 len: 1337 microversion: 2.1 time: 1.088550 Aug 31 15:49:20.286182 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 71/114] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:49:19 2022] GET /compute/v2.1/servers/e1429482-9aee-476b-a4db-585f0493cff7 => generated 1337 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:20.725944 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a125d014-4037-4699-9625-7e7a0ce2e176 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:20.731413 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a125d014-4037-4699-9625-7e7a0ce2e176 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 848b21b2-98a0-4e70-a27c-08d390d73ae6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:20.746895 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a125d014-4037-4699-9625-7e7a0ce2e176 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:20.747638 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a125d014-4037-4699-9625-7e7a0ce2e176 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:20.753338 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a125d014-4037-4699-9625-7e7a0ce2e176 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:20.757518 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a125d014-4037-4699-9625-7e7a0ce2e176 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:20.758296 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a125d014-4037-4699-9625-7e7a0ce2e176 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:20.760509 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a125d014-4037-4699-9625-7e7a0ce2e176 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:20.920478 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a125d014-4037-4699-9625-7e7a0ce2e176 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:20.943641 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a125d014-4037-4699-9625-7e7a0ce2e176 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6" status: 200 len: 1275 microversion: 2.1 time: 0.219799 Aug 31 15:49:20.962282 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 44/115] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:49:20 2022] GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6 => generated 1275 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:21.309380 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-30f9484a-5a94-417e-89f1-ad4e446fcb6a tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:21.309987 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-30f9484a-5a94-417e-89f1-ad4e446fcb6a tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] [instance: e1429482-9aee-476b-a4db-585f0493cff7] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:21.313672 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=11,nova_api:INSERT=4 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:49:21.321564 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-30f9484a-5a94-417e-89f1-ad4e446fcb6a tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:21.322064 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-30f9484a-5a94-417e-89f1-ad4e446fcb6a tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:21.322512 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-30f9484a-5a94-417e-89f1-ad4e446fcb6a tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:21.323206 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-30f9484a-5a94-417e-89f1-ad4e446fcb6a tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:21.323652 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-30f9484a-5a94-417e-89f1-ad4e446fcb6a tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:21.324063 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-30f9484a-5a94-417e-89f1-ad4e446fcb6a tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:21.646766 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-30f9484a-5a94-417e-89f1-ad4e446fcb6a tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca35cd4f679249c2b98305e4bc1cb13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454e809640fd4c1381463bd27e69c02b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:21.696234 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-30f9484a-5a94-417e-89f1-ad4e446fcb6a tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] 10.222.0.50 "GET /compute/v2.1/servers/e1429482-9aee-476b-a4db-585f0493cff7" status: 200 len: 1487 microversion: 2.1 time: 0.389165 Aug 31 15:49:21.697275 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 72/116] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:49:21 2022] GET /compute/v2.1/servers/e1429482-9aee-476b-a4db-585f0493cff7 => generated 1487 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:21.720477 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ea70e180-63bc-4aeb-9314-a625fafcc110 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:21.721435 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ea70e180-63bc-4aeb-9314-a625fafcc110 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] [instance: e1429482-9aee-476b-a4db-585f0493cff7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:21.740168 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea70e180-63bc-4aeb-9314-a625fafcc110 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:21.742086 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea70e180-63bc-4aeb-9314-a625fafcc110 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:21.745669 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea70e180-63bc-4aeb-9314-a625fafcc110 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:21.746778 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea70e180-63bc-4aeb-9314-a625fafcc110 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:21.748570 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea70e180-63bc-4aeb-9314-a625fafcc110 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:21.750490 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea70e180-63bc-4aeb-9314-a625fafcc110 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:21.758622 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=84 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:49:21.966920 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9c2bc34a-d643-4e87-a8ce-079f544437bf tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:21.967829 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9c2bc34a-d643-4e87-a8ce-079f544437bf tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 848b21b2-98a0-4e70-a27c-08d390d73ae6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:21.979331 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9c2bc34a-d643-4e87-a8ce-079f544437bf tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:21.987035 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9c2bc34a-d643-4e87-a8ce-079f544437bf tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:21.987900 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9c2bc34a-d643-4e87-a8ce-079f544437bf tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:21.988817 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9c2bc34a-d643-4e87-a8ce-079f544437bf tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:21.989885 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9c2bc34a-d643-4e87-a8ce-079f544437bf tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:21.990676 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9c2bc34a-d643-4e87-a8ce-079f544437bf tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:22.202692 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9c2bc34a-d643-4e87-a8ce-079f544437bf tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:22.219755 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9c2bc34a-d643-4e87-a8ce-079f544437bf tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6" status: 200 len: 1275 microversion: 2.1 time: 0.252370 Aug 31 15:49:22.222677 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 73/117] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:49:21 2022] GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6 => generated 1275 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:22.970646 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ea70e180-63bc-4aeb-9314-a625fafcc110 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e1429482-9aee-476b-a4db-585f0493cff7" status: 200 len: 1640 microversion: 2.1 time: 1.254025 Aug 31 15:49:22.982681 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 45/118] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:49:21 2022] GET /compute/v2.1/servers/e1429482-9aee-476b-a4db-585f0493cff7 => generated 1640 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:23.008724 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-48bfb322-d925-419e-adc0-59c3859238b1 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:23.010067 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-48bfb322-d925-419e-adc0-59c3859238b1 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] [instance: e1429482-9aee-476b-a4db-585f0493cff7] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:23.017419 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-48bfb322-d925-419e-adc0-59c3859238b1 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:23.018051 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-48bfb322-d925-419e-adc0-59c3859238b1 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:23.021938 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-48bfb322-d925-419e-adc0-59c3859238b1 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:23.023196 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-48bfb322-d925-419e-adc0-59c3859238b1 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:23.023969 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-48bfb322-d925-419e-adc0-59c3859238b1 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:23.024546 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-48bfb322-d925-419e-adc0-59c3859238b1 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:23.063546 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-48bfb322-d925-419e-adc0-59c3859238b1 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] [instance: e1429482-9aee-476b-a4db-585f0493cff7] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:49:23.241871 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-42115791-9ce0-4e98-a844-1fd2561b9a12 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:23.243185 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-42115791-9ce0-4e98-a844-1fd2561b9a12 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 848b21b2-98a0-4e70-a27c-08d390d73ae6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:23.255161 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-42115791-9ce0-4e98-a844-1fd2561b9a12 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:23.256672 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-42115791-9ce0-4e98-a844-1fd2561b9a12 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:23.257122 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-42115791-9ce0-4e98-a844-1fd2561b9a12 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:23.259067 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-42115791-9ce0-4e98-a844-1fd2561b9a12 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:23.260685 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-42115791-9ce0-4e98-a844-1fd2561b9a12 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:23.261132 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-42115791-9ce0-4e98-a844-1fd2561b9a12 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:23.385160 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-48bfb322-d925-419e-adc0-59c3859238b1 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e1429482-9aee-476b-a4db-585f0493cff7" status: 204 len: 0 microversion: 2.1 time: 0.380157 Aug 31 15:49:23.385854 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 74/119] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:49:23 2022] DELETE /compute/v2.1/servers/e1429482-9aee-476b-a4db-585f0493cff7 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:49:23.395247 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7a7818fc-1538-4f18-b77f-ffcbbdf0084f tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:23.396101 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7a7818fc-1538-4f18-b77f-ffcbbdf0084f tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] [instance: e1429482-9aee-476b-a4db-585f0493cff7] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:23.421832 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7a7818fc-1538-4f18-b77f-ffcbbdf0084f tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:23.422350 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7a7818fc-1538-4f18-b77f-ffcbbdf0084f tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:23.422784 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7a7818fc-1538-4f18-b77f-ffcbbdf0084f tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:23.423547 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7a7818fc-1538-4f18-b77f-ffcbbdf0084f tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:23.423942 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7a7818fc-1538-4f18-b77f-ffcbbdf0084f tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:23.424333 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7a7818fc-1538-4f18-b77f-ffcbbdf0084f tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:23.443627 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-42115791-9ce0-4e98-a844-1fd2561b9a12 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:23.458538 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-42115791-9ce0-4e98-a844-1fd2561b9a12 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6" status: 200 len: 1275 microversion: 2.1 time: 0.220934 Aug 31 15:49:23.473247 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 46/120] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:49:23 2022] GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6 => generated 1275 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:23.813681 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7a7818fc-1538-4f18-b77f-ffcbbdf0084f tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca35cd4f679249c2b98305e4bc1cb13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454e809640fd4c1381463bd27e69c02b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:23.834315 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7a7818fc-1538-4f18-b77f-ffcbbdf0084f tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] 10.222.0.50 "GET /compute/v2.1/servers/e1429482-9aee-476b-a4db-585f0493cff7" status: 200 len: 1493 microversion: 2.1 time: 0.441932 Aug 31 15:49:23.846328 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 75/121] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:49:23 2022] GET /compute/v2.1/servers/e1429482-9aee-476b-a4db-585f0493cff7 => generated 1493 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:24.485556 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ba2c2ea5-fc1c-44b9-b3b9-9acdafb3892d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:24.487663 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ba2c2ea5-fc1c-44b9-b3b9-9acdafb3892d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 848b21b2-98a0-4e70-a27c-08d390d73ae6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:24.501467 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba2c2ea5-fc1c-44b9-b3b9-9acdafb3892d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:24.501868 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba2c2ea5-fc1c-44b9-b3b9-9acdafb3892d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:24.502342 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba2c2ea5-fc1c-44b9-b3b9-9acdafb3892d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:24.503051 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba2c2ea5-fc1c-44b9-b3b9-9acdafb3892d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:24.503509 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba2c2ea5-fc1c-44b9-b3b9-9acdafb3892d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:24.503936 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba2c2ea5-fc1c-44b9-b3b9-9acdafb3892d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:24.721871 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ba2c2ea5-fc1c-44b9-b3b9-9acdafb3892d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:24.744918 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ba2c2ea5-fc1c-44b9-b3b9-9acdafb3892d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6" status: 200 len: 1275 microversion: 2.1 time: 0.265188 Aug 31 15:49:24.746238 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 47/122] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:49:24 2022] GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6 => generated 1275 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:24.856600 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b03254bf-806e-4166-8564-de37cb1529fc tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:24.857262 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b03254bf-806e-4166-8564-de37cb1529fc tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] [instance: e1429482-9aee-476b-a4db-585f0493cff7] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:24.876503 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b03254bf-806e-4166-8564-de37cb1529fc tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:24.892069 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b03254bf-806e-4166-8564-de37cb1529fc tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:24.896589 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b03254bf-806e-4166-8564-de37cb1529fc tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:24.897851 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b03254bf-806e-4166-8564-de37cb1529fc tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:24.901813 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b03254bf-806e-4166-8564-de37cb1529fc tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:24.903789 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b03254bf-806e-4166-8564-de37cb1529fc tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:25.478703 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b03254bf-806e-4166-8564-de37cb1529fc tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca35cd4f679249c2b98305e4bc1cb13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454e809640fd4c1381463bd27e69c02b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:25.488172 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b03254bf-806e-4166-8564-de37cb1529fc tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] 10.222.0.50 "GET /compute/v2.1/servers/e1429482-9aee-476b-a4db-585f0493cff7" status: 200 len: 1493 microversion: 2.1 time: 0.635958 Aug 31 15:49:25.491785 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 76/123] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:49:24 2022] GET /compute/v2.1/servers/e1429482-9aee-476b-a4db-585f0493cff7 => generated 1493 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:25.546655 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e34947e3-7834-46e3-9dfa-721867db1e65 tempest-FlavorsV261TestJSON-1610172294 tempest-FlavorsV261TestJSON-1610172294-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-12054123", "id": 1058112794, "os-flavor-access:is_public": "True"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:25.606836 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e34947e3-7834-46e3-9dfa-721867db1e65 tempest-FlavorsV261TestJSON-1610172294 tempest-FlavorsV261TestJSON-1610172294-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 466 microversion: 2.61 time: 0.729324 Aug 31 15:49:25.621119 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 48/124] 10.222.0.50 () {62 vars in 1188 bytes} [Wed Aug 31 15:49:24 2022] POST /compute/v2.1/flavors => generated 466 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 15:49:25.768646 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9083ea82-5afd-48dd-bfc0-848254d1622d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:25.769672 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9083ea82-5afd-48dd-bfc0-848254d1622d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 848b21b2-98a0-4e70-a27c-08d390d73ae6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:25.785534 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9083ea82-5afd-48dd-bfc0-848254d1622d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:25.787664 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9083ea82-5afd-48dd-bfc0-848254d1622d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:25.789011 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9083ea82-5afd-48dd-bfc0-848254d1622d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:25.790778 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9083ea82-5afd-48dd-bfc0-848254d1622d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:25.791884 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9083ea82-5afd-48dd-bfc0-848254d1622d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:25.792517 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9083ea82-5afd-48dd-bfc0-848254d1622d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:25.946420 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6339a1f9-b3bd-4902-a37e-684c3ffdadc3 tempest-FlavorsV261TestJSON-920357831 tempest-FlavorsV261TestJSON-920357831-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:25.975771 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6339a1f9-b3bd-4902-a37e-684c3ffdadc3 tempest-FlavorsV261TestJSON-920357831 tempest-FlavorsV261TestJSON-920357831-project] 10.222.0.50 "GET /compute/v2.1/flavors/1058112794" status: 200 len: 466 microversion: 2.61 time: 0.357038 Aug 31 15:49:25.979144 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 77/125] 10.222.0.50 () {60 vars in 1199 bytes} [Wed Aug 31 15:49:25 2022] GET /compute/v2.1/flavors/1058112794 => generated 466 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:49:25.990785 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b53cd45a-2b32-4801-86eb-0eb9852f79f6 tempest-FlavorsV261TestJSON-1610172294 tempest-FlavorsV261TestJSON-1610172294-project-admin] Action: 'update', calling method: .version_select at 0x7fbb48719f70>, body: {"flavor": {"description": "new"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:25.996842 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9083ea82-5afd-48dd-bfc0-848254d1622d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:26.005553 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9083ea82-5afd-48dd-bfc0-848254d1622d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6" status: 200 len: 1275 microversion: 2.1 time: 0.242097 Aug 31 15:49:26.011102 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 49/126] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:49:25 2022] GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6 => generated 1275 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:49:26.081691 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b53cd45a-2b32-4801-86eb-0eb9852f79f6 tempest-FlavorsV261TestJSON-1610172294 tempest-FlavorsV261TestJSON-1610172294-project-admin] 10.222.0.50 "PUT /compute/v2.1/flavors/1058112794" status: 200 len: 467 microversion: 2.61 time: 0.094953 Aug 31 15:49:26.084636 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 78/127] 10.222.0.50 () {62 vars in 1219 bytes} [Wed Aug 31 15:49:25 2022] PUT /compute/v2.1/flavors/1058112794 => generated 467 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 15:49:26.097594 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2e21d07a-1644-4dfe-a828-430740ecb475 tempest-FlavorsV261TestJSON-920357831 tempest-FlavorsV261TestJSON-920357831-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:26.166839 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2e21d07a-1644-4dfe-a828-430740ecb475 tempest-FlavorsV261TestJSON-920357831 tempest-FlavorsV261TestJSON-920357831-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 6248 microversion: 2.61 time: 0.071291 Aug 31 15:49:26.169401 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 50/128] 10.222.0.50 () {60 vars in 1187 bytes} [Wed Aug 31 15:49:26 2022] GET /compute/v2.1/flavors/detail => generated 6248 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:49:26.189717 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-80f27e34-274c-4660-9d82-dee94e47656e tempest-FlavorsV261TestJSON-920357831 tempest-FlavorsV261TestJSON-920357831-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:26.505882 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-80f27e34-274c-4660-9d82-dee94e47656e tempest-FlavorsV261TestJSON-920357831 tempest-FlavorsV261TestJSON-920357831-project] 10.222.0.50 "GET /compute/v2.1/flavors" status: 200 len: 3155 microversion: 2.61 time: 0.319957 Aug 31 15:49:26.506854 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 79/129] 10.222.0.50 () {60 vars in 1166 bytes} [Wed Aug 31 15:49:26 2022] GET /compute/v2.1/flavors => generated 3155 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:49:26.522987 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f3bfd65c-be31-48f3-a27a-b58f46e9a1a4 tempest-FlavorsV261TestJSON-1610172294 tempest-FlavorsV261TestJSON-1610172294-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:26.538400 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6a6872f6-1b0b-42e3-a25d-aac4f916b209 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:26.541388 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6a6872f6-1b0b-42e3-a25d-aac4f916b209 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] [instance: e1429482-9aee-476b-a4db-585f0493cff7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:26.561212 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f3bfd65c-be31-48f3-a27a-b58f46e9a1a4 tempest-FlavorsV261TestJSON-1610172294 tempest-FlavorsV261TestJSON-1610172294-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1058112794" status: 202 len: 0 microversion: 2.61 time: 0.042013 Aug 31 15:49:26.562508 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 80/130] 10.222.0.50 () {60 vars in 1202 bytes} [Wed Aug 31 15:49:26 2022] DELETE /compute/v2.1/flavors/1058112794 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:49:26.571615 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9da7ab34-88df-426e-b259-9a3eaa8cd1bc tempest-FlavorsV261TestJSON-1610172294 tempest-FlavorsV261TestJSON-1610172294-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:26.575836 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a6872f6-1b0b-42e3-a25d-aac4f916b209 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:26.585633 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a6872f6-1b0b-42e3-a25d-aac4f916b209 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:26.586389 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a6872f6-1b0b-42e3-a25d-aac4f916b209 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:26.587742 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a6872f6-1b0b-42e3-a25d-aac4f916b209 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:26.591261 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a6872f6-1b0b-42e3-a25d-aac4f916b209 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:26.593499 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a6872f6-1b0b-42e3-a25d-aac4f916b209 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:26.633771 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9da7ab34-88df-426e-b259-9a3eaa8cd1bc tempest-FlavorsV261TestJSON-1610172294 tempest-FlavorsV261TestJSON-1610172294-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.066417 Aug 31 15:49:26.642801 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 81/131] 10.222.0.50 () {60 vars in 1187 bytes} [Wed Aug 31 15:49:26 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:49:26.770031 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=11 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:49:26.919991 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-86431021-68a9-4b4d-971a-6a1dc6246b18 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1213575771", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": "none"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:27.070789 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6a6872f6-1b0b-42e3-a25d-aac4f916b209 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca35cd4f679249c2b98305e4bc1cb13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454e809640fd4c1381463bd27e69c02b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:27.084838 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6a6872f6-1b0b-42e3-a25d-aac4f916b209 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] 10.222.0.50 "GET /compute/v2.1/servers/e1429482-9aee-476b-a4db-585f0493cff7" status: 200 len: 1493 microversion: 2.1 time: 0.565703 Aug 31 15:49:27.088503 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 51/132] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:49:26 2022] GET /compute/v2.1/servers/e1429482-9aee-476b-a4db-585f0493cff7 => generated 1493 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:27.089459 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-86431021-68a9-4b4d-971a-6a1dc6246b18 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:49:27.090490 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-86431021-68a9-4b4d-971a-6a1dc6246b18 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:49:27.091180 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-86431021-68a9-4b4d-971a-6a1dc6246b18 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:49:27.091887 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-86431021-68a9-4b4d-971a-6a1dc6246b18 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:49:27.092505 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-86431021-68a9-4b4d-971a-6a1dc6246b18 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:49:27.108274 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5eff7bd5-b5f8-44e0-a7da-0051ca71929f tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:27.109102 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5eff7bd5-b5f8-44e0-a7da-0051ca71929f tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 848b21b2-98a0-4e70-a27c-08d390d73ae6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:27.112886 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=27 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:49:27.117433 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5eff7bd5-b5f8-44e0-a7da-0051ca71929f tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:27.121175 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5eff7bd5-b5f8-44e0-a7da-0051ca71929f tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:27.121876 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5eff7bd5-b5f8-44e0-a7da-0051ca71929f tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:27.122777 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5eff7bd5-b5f8-44e0-a7da-0051ca71929f tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:27.123371 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5eff7bd5-b5f8-44e0-a7da-0051ca71929f tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:27.128541 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5eff7bd5-b5f8-44e0-a7da-0051ca71929f tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:27.134635 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-86431021-68a9-4b4d-971a-6a1dc6246b18 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:27.142019 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-86431021-68a9-4b4d-971a-6a1dc6246b18 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:27.142645 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-86431021-68a9-4b4d-971a-6a1dc6246b18 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:27.143696 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-86431021-68a9-4b4d-971a-6a1dc6246b18 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:27.144432 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-86431021-68a9-4b4d-971a-6a1dc6246b18 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:27.150915 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-86431021-68a9-4b4d-971a-6a1dc6246b18 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:27.205488 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-86431021-68a9-4b4d-971a-6a1dc6246b18 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Getting quotas for project d52ac8c8bc0e42f79e9db32a94b5f0e5. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:49:27.221946 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-86431021-68a9-4b4d-971a-6a1dc6246b18 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Getting quotas for user 62c3220431874b2395d0059d57660050 and project d52ac8c8bc0e42f79e9db32a94b5f0e5. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:49:27.259679 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5eff7bd5-b5f8-44e0-a7da-0051ca71929f tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:27.266255 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-86431021-68a9-4b4d-971a-6a1dc6246b18 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:49:27.271297 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5eff7bd5-b5f8-44e0-a7da-0051ca71929f tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6" status: 200 len: 1275 microversion: 2.1 time: 0.180905 Aug 31 15:49:27.274216 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-86431021-68a9-4b4d-971a-6a1dc6246b18 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:49:27.289325 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 52/133] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:49:27 2022] GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6 => generated 1275 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:27.419383 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-86431021-68a9-4b4d-971a-6a1dc6246b18 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.775109 Aug 31 15:49:27.420475 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 82/134] 10.222.0.50 () {62 vars in 1188 bytes} [Wed Aug 31 15:49:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 777 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 31 15:49:27.432107 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cd2c8d87-7d59-4194-a2dc-c037759e0409 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:27.434947 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cd2c8d87-7d59-4194-a2dc-c037759e0409 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:27.713538 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-dd65f5f3-894f-4c7c-82ae-24b9698fcbdf req-f117f9c8-23fe-45b5-8025-9649dde8ec38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1429482-9aee-476b-a4db-585f0493cff7", "name": "network-vif-deleted", "tag": "a82371a6-c79c-42a9-afc9-11da569e1bd2"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:27.747784 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-dd65f5f3-894f-4c7c-82ae-24b9698fcbdf req-f117f9c8-23fe-45b5-8025-9649dde8ec38 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:27.753381 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-dd65f5f3-894f-4c7c-82ae-24b9698fcbdf req-f117f9c8-23fe-45b5-8025-9649dde8ec38 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:27.754244 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-dd65f5f3-894f-4c7c-82ae-24b9698fcbdf req-f117f9c8-23fe-45b5-8025-9649dde8ec38 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:27.778515 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-dd65f5f3-894f-4c7c-82ae-24b9698fcbdf req-f117f9c8-23fe-45b5-8025-9649dde8ec38 service nova] Creating event network-vif-deleted:a82371a6-c79c-42a9-afc9-11da569e1bd2 for instance e1429482-9aee-476b-a4db-585f0493cff7 on n-h1-833090-16 Aug 31 15:49:27.790854 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-dd65f5f3-894f-4c7c-82ae-24b9698fcbdf req-f117f9c8-23fe-45b5-8025-9649dde8ec38 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081228 Aug 31 15:49:27.793449 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 83/135] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:49:27.992353 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:49:28.113697 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-43682da6-ff39-45b7-bec0-78d55be169df tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:28.114482 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-43682da6-ff39-45b7-bec0-78d55be169df tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] [instance: e1429482-9aee-476b-a4db-585f0493cff7] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:28.132156 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-43682da6-ff39-45b7-bec0-78d55be169df tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:28.137476 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cd2c8d87-7d59-4194-a2dc-c037759e0409 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:28.141896 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-43682da6-ff39-45b7-bec0-78d55be169df tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:28.146815 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cd2c8d87-7d59-4194-a2dc-c037759e0409 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:28.147712 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-43682da6-ff39-45b7-bec0-78d55be169df tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:28.150154 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-43682da6-ff39-45b7-bec0-78d55be169df tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:28.157949 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-43682da6-ff39-45b7-bec0-78d55be169df tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:28.158651 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-43682da6-ff39-45b7-bec0-78d55be169df tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:28.161245 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cd2c8d87-7d59-4194-a2dc-c037759e0409 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:28.193147 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cd2c8d87-7d59-4194-a2dc-c037759e0409 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] 10.222.0.50 "PUT /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f" status: 200 len: 1359 microversion: 2.75 time: 0.765429 Aug 31 15:49:28.193766 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 53/136] 10.222.0.50 () {62 vars in 1297 bytes} [Wed Aug 31 15:49:27 2022] PUT /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f => generated 1359 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:49:28.231228 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e6203463-92de-43f8-88c0-abd57696738a tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:28.231637 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e6203463-92de-43f8-88c0-abd57696738a tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:28.240470 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-43682da6-ff39-45b7-bec0-78d55be169df tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:28.241227 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-43682da6-ff39-45b7-bec0-78d55be169df tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:28.241832 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-43682da6-ff39-45b7-bec0-78d55be169df tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:28.242757 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-43682da6-ff39-45b7-bec0-78d55be169df tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lazy-loading 'fault' on Instance uuid e1429482-9aee-476b-a4db-585f0493cff7 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:49:28.399610 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e6203463-92de-43f8-88c0-abd57696738a tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:28.408371 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e6203463-92de-43f8-88c0-abd57696738a tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:28.410244 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e6203463-92de-43f8-88c0-abd57696738a tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:28.413538 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-43682da6-ff39-45b7-bec0-78d55be169df tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca35cd4f679249c2b98305e4bc1cb13e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454e809640fd4c1381463bd27e69c02b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:28.430154 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-43682da6-ff39-45b7-bec0-78d55be169df tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] 10.222.0.50 "GET /compute/v2.1/servers/e1429482-9aee-476b-a4db-585f0493cff7" status: 200 len: 1327 microversion: 2.1 time: 0.321827 Aug 31 15:49:28.441384 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 84/137] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:49:28 2022] GET /compute/v2.1/servers/e1429482-9aee-476b-a4db-585f0493cff7 => generated 1327 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:49:28.457527 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e6203463-92de-43f8-88c0-abd57696738a tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] 10.222.0.50 "GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f" status: 200 len: 1359 microversion: 2.75 time: 0.227682 Aug 31 15:49:28.457527 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 54/138] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:49:28 2022] GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f => generated 1359 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 15:49:28.457689 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-26c7ecbb-c81b-4c9b-bc76-2bb2779efc36 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:28.457689 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-26c7ecbb-c81b-4c9b-bc76-2bb2779efc36 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 848b21b2-98a0-4e70-a27c-08d390d73ae6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:28.476435 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26c7ecbb-c81b-4c9b-bc76-2bb2779efc36 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:28.476931 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26c7ecbb-c81b-4c9b-bc76-2bb2779efc36 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:28.477500 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26c7ecbb-c81b-4c9b-bc76-2bb2779efc36 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:28.478060 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26c7ecbb-c81b-4c9b-bc76-2bb2779efc36 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:28.478714 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26c7ecbb-c81b-4c9b-bc76-2bb2779efc36 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:28.488297 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26c7ecbb-c81b-4c9b-bc76-2bb2779efc36 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:28.538935 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:49:28.706161 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-26c7ecbb-c81b-4c9b-bc76-2bb2779efc36 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:28.723134 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-26c7ecbb-c81b-4c9b-bc76-2bb2779efc36 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6" status: 200 len: 1275 microversion: 2.1 time: 0.280361 Aug 31 15:49:28.724096 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 85/139] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:49:28 2022] GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6 => generated 1275 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:29.465235 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5301701e-fa05-4104-bf4c-064b4d98c12a tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:29.475230 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-73556e02-35fa-433a-a1ad-2b4891a47a70 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:29.476635 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5301701e-fa05-4104-bf4c-064b4d98c12a tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] [instance: e1429482-9aee-476b-a4db-585f0493cff7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:29.476745 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-73556e02-35fa-433a-a1ad-2b4891a47a70 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:29.493477 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5301701e-fa05-4104-bf4c-064b4d98c12a tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:29.495120 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5301701e-fa05-4104-bf4c-064b4d98c12a tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:29.495314 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-73556e02-35fa-433a-a1ad-2b4891a47a70 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:29.497410 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5301701e-fa05-4104-bf4c-064b4d98c12a tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:29.498396 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5301701e-fa05-4104-bf4c-064b4d98c12a tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:29.499917 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-73556e02-35fa-433a-a1ad-2b4891a47a70 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:29.500485 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-73556e02-35fa-433a-a1ad-2b4891a47a70 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:29.501579 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5301701e-fa05-4104-bf4c-064b4d98c12a tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:29.503825 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-73556e02-35fa-433a-a1ad-2b4891a47a70 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:29.504263 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5301701e-fa05-4104-bf4c-064b4d98c12a tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:29.507292 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-73556e02-35fa-433a-a1ad-2b4891a47a70 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:29.507964 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-73556e02-35fa-433a-a1ad-2b4891a47a70 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:29.545585 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-5301701e-fa05-4104-bf4c-064b4d98c12a tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] HTTP exception thrown: Instance e1429482-9aee-476b-a4db-585f0493cff7 could not be found. Aug 31 15:49:29.574316 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5301701e-fa05-4104-bf4c-064b4d98c12a tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Request method failure captured: Aug 31 15:49:29.574316 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/e1429482-9aee-476b-a4db-585f0493cff7 HTTP/1.1 Aug 31 15:49:29.574316 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:49:29.574316 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:49:29.574316 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:49:29.574316 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:49:29.574316 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:49:29.574316 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:49:29.574316 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:49:29.574316 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:49:29.574316 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4LfKhr6CNM_fKcU5K-N_6TOI3c-h4fjkycv1UBCzT7uAWc4Kn90P_gWLqhRyMWHbHsaKr8cNBvBVxfRXIeL-e22ExUCkUD82Z8h8KSzu4zSx2o8yioH02FuxPcneisbGJhDpVm3htFR-MGqMV8WZ_mKnOupE_fQtD4RkVRXyAOrh5A Aug 31 15:49:29.574316 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:49:29.574316 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:49:29.574316 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:49:29.574316 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:49:29.574316 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:49:29.574316 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:49:29.574316 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 454e809640fd4c1381463bd27e69c02b Aug 31 15:49:29.574316 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-AggregatesAdminTestJSON-2094361298 Aug 31 15:49:29.574316 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:49:29.574316 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:49:29.575635 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/454e809640fd4c1381463bd27e69c02b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/454e809640fd4c1381463bd27e69c02b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/454e809640fd4c1381463bd27e69c02b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_454e809640fd4c1381463bd27e69c02b", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:49:29.575635 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-AggregatesAdminTestJSON-2094361298 Aug 31 15:49:29.575635 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 454e809640fd4c1381463bd27e69c02b Aug 31 15:49:29.575635 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2094361298 Aug 31 15:49:29.575635 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-AggregatesAdminTestJSON-2094361298-project Aug 31 15:49:29.575635 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:49:29.575635 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:49:29.575635 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: ca35cd4f679249c2b98305e4bc1cb13e Aug 31 15:49:29.575635 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-AggregatesAdminTestJSON-2094361298-project Aug 31 15:49:29.575635 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 15:49:29.575635 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance e1429482-9aee-476b-a4db-585f0493cff7 could not be found. Aug 31 15:49:29.575635 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'e1429482-9aee-476b-a4db-585f0493cff7'} Aug 31 15:49:29.576259 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:49:29.576259 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:29.576259 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:49:29.576259 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:49:29.576259 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:49:29.576259 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:49:29.576259 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:49:29.576259 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:49:29.576259 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:49:29.576259 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:49:29.576259 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1429482-9aee-476b-a4db-585f0493cff7 could not be found. Aug 31 15:49:29.576259 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:29.576259 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:29.576259 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:29.576259 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:29.576259 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:29.576259 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:29.576259 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:49:29.576259 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:49:29.576259 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:49:29.577345 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:49:29.577345 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:49:29.577345 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:49:29.577345 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:49:29.577345 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:49:29.577345 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:49:29.577345 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:49:29.577345 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1429482-9aee-476b-a4db-585f0493cff7 could not be found. Aug 31 15:49:29.577345 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:29.577345 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:29.577345 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:29.577345 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:29.577345 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:29.577345 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:29.577345 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:49:29.577345 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:49:29.577345 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1429482-9aee-476b-a4db-585f0493cff7 could not be found. Aug 31 15:49:29.577345 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:29.581076 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5301701e-fa05-4104-bf4c-064b4d98c12a tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Returning 404 to user: Instance e1429482-9aee-476b-a4db-585f0493cff7 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:49:29.583227 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5301701e-fa05-4104-bf4c-064b4d98c12a tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] 10.222.0.50 "GET /compute/v2.1/servers/e1429482-9aee-476b-a4db-585f0493cff7" status: 404 len: 111 microversion: 2.1 time: 0.122132 Aug 31 15:49:29.584992 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 55/140] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:49:29 2022] GET /compute/v2.1/servers/e1429482-9aee-476b-a4db-585f0493cff7 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:49:29.604270 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-00b92927-4501-4eba-a5eb-64ddc4064189 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-833090-16"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:29.697374 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00b92927-4501-4eba-a5eb-64ddc4064189 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:29.699086 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00b92927-4501-4eba-a5eb-64ddc4064189 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:29.699598 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00b92927-4501-4eba-a5eb-64ddc4064189 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:29.738027 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-73556e02-35fa-433a-a1ad-2b4891a47a70 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:29.753028 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-73556e02-35fa-433a-a1ad-2b4891a47a70 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:29.754570 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-73556e02-35fa-433a-a1ad-2b4891a47a70 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:29.765472 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-73556e02-35fa-433a-a1ad-2b4891a47a70 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] 10.222.0.50 "GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f" status: 200 len: 1411 microversion: 2.75 time: 0.295625 Aug 31 15:49:29.778499 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 86/141] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:49:29 2022] GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f => generated 1411 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:49:29.788326 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-33de5c97-68a1-4c39-8df9-8027b5465f56 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:29.789221 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-33de5c97-68a1-4c39-8df9-8027b5465f56 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 848b21b2-98a0-4e70-a27c-08d390d73ae6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:29.795886 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33de5c97-68a1-4c39-8df9-8027b5465f56 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:29.797129 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33de5c97-68a1-4c39-8df9-8027b5465f56 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:29.797922 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33de5c97-68a1-4c39-8df9-8027b5465f56 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:29.798883 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33de5c97-68a1-4c39-8df9-8027b5465f56 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:29.799544 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33de5c97-68a1-4c39-8df9-8027b5465f56 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:29.800208 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33de5c97-68a1-4c39-8df9-8027b5465f56 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:29.878585 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-33de5c97-68a1-4c39-8df9-8027b5465f56 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:29.887044 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-33de5c97-68a1-4c39-8df9-8027b5465f56 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6" status: 200 len: 1275 microversion: 2.1 time: 0.107382 Aug 31 15:49:29.890377 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 87/142] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:49:29 2022] GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6 => generated 1275 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:30.754009 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-00b92927-4501-4eba-a5eb-64ddc4064189 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 298 microversion: 2.1 time: 1.163470 Aug 31 15:49:30.756571 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 56/143] 10.222.0.50 () {60 vars in 1191 bytes} [Wed Aug 31 15:49:29 2022] POST /compute/v2.1/os-aggregates/1/action => generated 298 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:30.767490 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fba1b223-74dd-4215-9799-0dae1c2f2f24 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:30.798171 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-166c6aba-5745-423c-acc3-60259683c158 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:30.798978 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-166c6aba-5745-423c-acc3-60259683c158 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:30.815886 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fba1b223-74dd-4215-9799-0dae1c2f2f24 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.052761 Aug 31 15:49:30.822012 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 88/144] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Aug 31 15:49:30 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 31 15:49:30.822331 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-166c6aba-5745-423c-acc3-60259683c158 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:30.822545 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-166c6aba-5745-423c-acc3-60259683c158 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:30.822981 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-166c6aba-5745-423c-acc3-60259683c158 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:30.823695 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-166c6aba-5745-423c-acc3-60259683c158 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:30.824132 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-166c6aba-5745-423c-acc3-60259683c158 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:30.824547 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-166c6aba-5745-423c-acc3-60259683c158 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:30.837628 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f7acf560-3e46-4b1f-a0c2-1a0726b2a36b tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-307521443"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:30.849711 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.aggregate [None req-f7acf560-3e46-4b1f-a0c2-1a0726b2a36b tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Generated uuid 4ba45e88-9a46-4d76-af6d-3dfddcf2e0b3 for aggregate {{(pid=128864) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 31 15:49:30.914840 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f7acf560-3e46-4b1f-a0c2-1a0726b2a36b tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.081295 Aug 31 15:49:30.915944 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 89/145] 10.222.0.50 () {60 vars in 1164 bytes} [Wed Aug 31 15:49:30 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:49:30.932025 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f4a94e0a-b366-49a6-bf77-6dd7eace4fbb tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:30.935680 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f4a94e0a-b366-49a6-bf77-6dd7eace4fbb tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 848b21b2-98a0-4e70-a27c-08d390d73ae6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:30.959890 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f4a94e0a-b366-49a6-bf77-6dd7eace4fbb tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:30.960655 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f4a94e0a-b366-49a6-bf77-6dd7eace4fbb tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:30.961417 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f4a94e0a-b366-49a6-bf77-6dd7eace4fbb tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:30.962885 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f4a94e0a-b366-49a6-bf77-6dd7eace4fbb tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:30.964285 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f4a94e0a-b366-49a6-bf77-6dd7eace4fbb tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:30.965431 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f4a94e0a-b366-49a6-bf77-6dd7eace4fbb tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:31.216995 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-166c6aba-5745-423c-acc3-60259683c158 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:31.234066 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-166c6aba-5745-423c-acc3-60259683c158 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:31.235927 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-166c6aba-5745-423c-acc3-60259683c158 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:31.250820 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-166c6aba-5745-423c-acc3-60259683c158 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] 10.222.0.50 "GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f" status: 200 len: 1417 microversion: 2.75 time: 0.460149 Aug 31 15:49:31.253229 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 57/146] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:49:30 2022] GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f => generated 1417 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:49:31.263941 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0a04ce5a-3166-4e76-afd4-0ca07379e109 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-833090-16"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:31.288400 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a04ce5a-3166-4e76-afd4-0ca07379e109 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:31.289082 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a04ce5a-3166-4e76-afd4-0ca07379e109 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:31.289983 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a04ce5a-3166-4e76-afd4-0ca07379e109 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:31.472062 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0a04ce5a-3166-4e76-afd4-0ca07379e109 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 242 microversion: 2.1 time: 0.211568 Aug 31 15:49:31.478494 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 58/147] 10.222.0.50 () {60 vars in 1191 bytes} [Wed Aug 31 15:49:31 2022] POST /compute/v2.1/os-aggregates/2/action => generated 242 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:31.484316 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1aebd21f-4dbc-413f-a5d9-2647d4572f9a tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:31.493152 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1aebd21f-4dbc-413f-a5d9-2647d4572f9a tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 242 microversion: 2.1 time: 0.012935 Aug 31 15:49:31.494246 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 59/148] 10.222.0.50 () {58 vars in 1149 bytes} [Wed Aug 31 15:49:31 2022] GET /compute/v2.1/os-aggregates/2 => generated 242 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:31.507378 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b166f721-2d33-4e4d-b566-28d7b54f3b79 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-833090-16"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:31.525698 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b166f721-2d33-4e4d-b566-28d7b54f3b79 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:31.526557 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b166f721-2d33-4e4d-b566-28d7b54f3b79 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:31.527296 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b166f721-2d33-4e4d-b566-28d7b54f3b79 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:31.622989 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f4a94e0a-b366-49a6-bf77-6dd7eace4fbb tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:31.635105 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f4a94e0a-b366-49a6-bf77-6dd7eace4fbb tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6" status: 200 len: 1317 microversion: 2.1 time: 0.717319 Aug 31 15:49:31.635469 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 90/149] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:49:30 2022] GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6 => generated 1317 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:31.724591 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b166f721-2d33-4e4d-b566-28d7b54f3b79 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 226 microversion: 2.1 time: 0.221222 Aug 31 15:49:31.725912 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 60/150] 10.222.0.50 () {60 vars in 1191 bytes} [Wed Aug 31 15:49:31 2022] POST /compute/v2.1/os-aggregates/2/action => generated 226 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:31.738582 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-dd134409-f5ed-4370-82da-298900841ca9 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:31.784148 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-dd134409-f5ed-4370-82da-298900841ca9 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.050642 Aug 31 15:49:31.785855 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 91/151] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Aug 31 15:49:31 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 31 15:49:31.801386 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6d339857-adfa-4cc9-8b66-fb0d50b57b7a tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-317267136"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:31.805545 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.aggregate [None req-6d339857-adfa-4cc9-8b66-fb0d50b57b7a tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Generated uuid e724d09c-2c0f-41d8-9354-edd5f5a819af for aggregate {{(pid=128863) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 31 15:49:31.851779 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6d339857-adfa-4cc9-8b66-fb0d50b57b7a tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.058332 Aug 31 15:49:31.853534 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 61/152] 10.222.0.50 () {60 vars in 1164 bytes} [Wed Aug 31 15:49:31 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:31.870349 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-038c14d5-5deb-4b4c-844a-1f0f04cde99b tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-833090-16"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:31.898118 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-038c14d5-5deb-4b4c-844a-1f0f04cde99b tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:31.900595 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-038c14d5-5deb-4b4c-844a-1f0f04cde99b tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:31.901197 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-038c14d5-5deb-4b4c-844a-1f0f04cde99b tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:32.154251 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-038c14d5-5deb-4b4c-844a-1f0f04cde99b tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 242 microversion: 2.1 time: 0.292145 Aug 31 15:49:32.156379 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 92/153] 10.222.0.50 () {60 vars in 1191 bytes} [Wed Aug 31 15:49:31 2022] POST /compute/v2.1/os-aggregates/3/action => generated 242 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:32.169135 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f2ce90a3-7c81-4547-be48-51e1fb50ec96 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:32.198012 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f2ce90a3-7c81-4547-be48-51e1fb50ec96 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.034130 Aug 31 15:49:32.207944 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 62/154] 10.222.0.50 () {58 vars in 1143 bytes} [Wed Aug 31 15:49:32 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:32.219976 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-99ac868e-c60e-4eaf-91d8-c5c8902edd24 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-833090-16"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:32.240053 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-99ac868e-c60e-4eaf-91d8-c5c8902edd24 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:32.243079 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-99ac868e-c60e-4eaf-91d8-c5c8902edd24 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:32.244766 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-99ac868e-c60e-4eaf-91d8-c5c8902edd24 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:32.285051 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3577d63c-ef2f-4cdd-b779-c8cac54bb9c1 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:32.285662 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3577d63c-ef2f-4cdd-b779-c8cac54bb9c1 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:32.313794 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3577d63c-ef2f-4cdd-b779-c8cac54bb9c1 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:32.318811 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3577d63c-ef2f-4cdd-b779-c8cac54bb9c1 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:32.319294 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3577d63c-ef2f-4cdd-b779-c8cac54bb9c1 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:32.322856 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3577d63c-ef2f-4cdd-b779-c8cac54bb9c1 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:32.323417 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3577d63c-ef2f-4cdd-b779-c8cac54bb9c1 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:32.323827 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3577d63c-ef2f-4cdd-b779-c8cac54bb9c1 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:32.465666 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-99ac868e-c60e-4eaf-91d8-c5c8902edd24 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 226 microversion: 2.1 time: 0.249803 Aug 31 15:49:32.466864 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 93/155] 10.222.0.50 () {60 vars in 1191 bytes} [Wed Aug 31 15:49:32 2022] POST /compute/v2.1/os-aggregates/3/action => generated 226 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:49:32.478505 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-53dda23a-f4b8-4839-bc65-d59cc5308ecd tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:32.495378 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3577d63c-ef2f-4cdd-b779-c8cac54bb9c1 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:32.504693 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3577d63c-ef2f-4cdd-b779-c8cac54bb9c1 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:32.506442 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3577d63c-ef2f-4cdd-b779-c8cac54bb9c1 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:32.507927 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=2,nova_api:DELETE=10,nova_api:INSERT=5 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:49:32.514810 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3577d63c-ef2f-4cdd-b779-c8cac54bb9c1 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] 10.222.0.50 "GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f" status: 200 len: 1417 microversion: 2.75 time: 0.240645 Aug 31 15:49:32.516924 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 63/156] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:49:32 2022] GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f => generated 1417 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:49:32.523987 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-53dda23a-f4b8-4839-bc65-d59cc5308ecd tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.049921 Aug 31 15:49:32.525228 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 94/157] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Aug 31 15:49:32 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 31 15:49:32.544052 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-de5eafa2-9ad3-41f8-bee7-88cd6e01b8a7 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-928138162"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:32.548752 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.aggregate [None req-de5eafa2-9ad3-41f8-bee7-88cd6e01b8a7 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Generated uuid f840964b-26f7-4a8e-b2fc-0bac183494fd for aggregate {{(pid=128863) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 31 15:49:32.597881 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-de5eafa2-9ad3-41f8-bee7-88cd6e01b8a7 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.063740 Aug 31 15:49:32.598522 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 64/158] 10.222.0.50 () {60 vars in 1164 bytes} [Wed Aug 31 15:49:32 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:32.627938 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f58033ad-63ed-486d-9a10-13db10590c08 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-833090-16"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:32.657122 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a1ed9b64-589d-4792-8e66-59ee57e727ad tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:32.657738 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a1ed9b64-589d-4792-8e66-59ee57e727ad tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 848b21b2-98a0-4e70-a27c-08d390d73ae6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:32.675766 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1ed9b64-589d-4792-8e66-59ee57e727ad tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:32.677755 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f58033ad-63ed-486d-9a10-13db10590c08 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:32.678291 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f58033ad-63ed-486d-9a10-13db10590c08 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:32.678729 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f58033ad-63ed-486d-9a10-13db10590c08 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:32.684592 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1ed9b64-589d-4792-8e66-59ee57e727ad tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:32.685139 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1ed9b64-589d-4792-8e66-59ee57e727ad tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:32.685888 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1ed9b64-589d-4792-8e66-59ee57e727ad tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:32.687911 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1ed9b64-589d-4792-8e66-59ee57e727ad tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:32.688355 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1ed9b64-589d-4792-8e66-59ee57e727ad tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:32.957943 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f58033ad-63ed-486d-9a10-13db10590c08 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 242 microversion: 2.1 time: 0.346300 Aug 31 15:49:32.958754 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 95/159] 10.222.0.50 () {60 vars in 1191 bytes} [Wed Aug 31 15:49:32 2022] POST /compute/v2.1/os-aggregates/4/action => generated 242 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:32.973341 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b6daf142-7949-416a-a989-1ed5a2c75611 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-833090-16"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:33.010387 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b6daf142-7949-416a-a989-1ed5a2c75611 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:33.011268 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b6daf142-7949-416a-a989-1ed5a2c75611 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:33.017540 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b6daf142-7949-416a-a989-1ed5a2c75611 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:33.123392 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a1ed9b64-589d-4792-8e66-59ee57e727ad tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:33.138018 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a1ed9b64-589d-4792-8e66-59ee57e727ad tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6" status: 200 len: 1317 microversion: 2.1 time: 0.485391 Aug 31 15:49:33.162602 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 65/160] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:49:32 2022] GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6 => generated 1317 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:33.310086 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b6daf142-7949-416a-a989-1ed5a2c75611 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 226 microversion: 2.1 time: 0.343754 Aug 31 15:49:33.313653 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 96/161] 10.222.0.50 () {60 vars in 1191 bytes} [Wed Aug 31 15:49:32 2022] POST /compute/v2.1/os-aggregates/4/action => generated 226 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:49:33.325763 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-62bb4728-7783-4763-ad35-4f8925353965 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:33.393647 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-62bb4728-7783-4763-ad35-4f8925353965 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.072362 Aug 31 15:49:33.394935 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 66/162] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Aug 31 15:49:33 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 31 15:49:33.404073 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c49fe550-0a76-40fb-b55e-59148a875397 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1692823015"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:33.412936 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.aggregate [None req-c49fe550-0a76-40fb-b55e-59148a875397 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Generated uuid e57f1be7-5179-425b-87cb-d5e9d1c6a955 for aggregate {{(pid=128864) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 31 15:49:33.458724 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c49fe550-0a76-40fb-b55e-59148a875397 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.057703 Aug 31 15:49:33.460093 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 97/163] 10.222.0.50 () {60 vars in 1164 bytes} [Wed Aug 31 15:49:33 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:33.477164 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e7f1b3da-1033-4db1-aad9-2de7d526956f tempest-AggregatesAdminTestV241-2010438165 tempest-AggregatesAdminTestV241-2010438165-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1092811371"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:33.487060 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.aggregate [None req-e7f1b3da-1033-4db1-aad9-2de7d526956f tempest-AggregatesAdminTestV241-2010438165 tempest-AggregatesAdminTestV241-2010438165-project-admin] Generated uuid defe125a-f9c4-458b-8a91-26d7f6500ee5 for aggregate {{(pid=128863) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 31 15:49:33.504291 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ac077f20-13c3-4082-8917-9477a81742f5 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:33.513066 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:DELETE=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:49:33.619939 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e7f1b3da-1033-4db1-aad9-2de7d526956f tempest-AggregatesAdminTestV241-2010438165 tempest-AggregatesAdminTestV241-2010438165-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.147689 Aug 31 15:49:33.622325 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 67/164] 10.222.0.50 () {62 vars in 1205 bytes} [Wed Aug 31 15:49:33 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 15:49:33.635184 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ac077f20-13c3-4082-8917-9477a81742f5 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.152049 Aug 31 15:49:33.638575 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 98/165] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Aug 31 15:49:33 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 31 15:49:33.652646 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c1999bd4-af0e-4de3-8f16-7722a52f645f tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:33.657865 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c1999bd4-af0e-4de3-8f16-7722a52f645f tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:33.672357 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c1999bd4-af0e-4de3-8f16-7722a52f645f tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:33.672919 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c1999bd4-af0e-4de3-8f16-7722a52f645f tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:33.674001 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c1999bd4-af0e-4de3-8f16-7722a52f645f tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:33.675451 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c1999bd4-af0e-4de3-8f16-7722a52f645f tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:33.676208 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c1999bd4-af0e-4de3-8f16-7722a52f645f tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:33.678163 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c1999bd4-af0e-4de3-8f16-7722a52f645f tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:33.930013 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9ef9a2c9-3e68-41af-9d77-e4b00f0e4e0e tempest-HostsAdminNegativeTestJSON-1782868351 tempest-HostsAdminNegativeTestJSON-1782868351-project-admin] Calling method '.version_select at 0x7fbb475f5d30>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:33.933809 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ef9a2c9-3e68-41af-9d77-e4b00f0e4e0e tempest-HostsAdminNegativeTestJSON-1782868351 tempest-HostsAdminNegativeTestJSON-1782868351-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:33.936795 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ef9a2c9-3e68-41af-9d77-e4b00f0e4e0e tempest-HostsAdminNegativeTestJSON-1782868351 tempest-HostsAdminNegativeTestJSON-1782868351-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:33.936795 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ef9a2c9-3e68-41af-9d77-e4b00f0e4e0e tempest-HostsAdminNegativeTestJSON-1782868351 tempest-HostsAdminNegativeTestJSON-1782868351-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:33.937706 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ef9a2c9-3e68-41af-9d77-e4b00f0e4e0e tempest-HostsAdminNegativeTestJSON-1782868351 tempest-HostsAdminNegativeTestJSON-1782868351-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:33.938548 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ef9a2c9-3e68-41af-9d77-e4b00f0e4e0e tempest-HostsAdminNegativeTestJSON-1782868351 tempest-HostsAdminNegativeTestJSON-1782868351-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:33.938979 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ef9a2c9-3e68-41af-9d77-e4b00f0e4e0e tempest-HostsAdminNegativeTestJSON-1782868351 tempest-HostsAdminNegativeTestJSON-1782868351-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:33.952500 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=14 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:49:34.001089 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c1999bd4-af0e-4de3-8f16-7722a52f645f tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:34.013304 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c1999bd4-af0e-4de3-8f16-7722a52f645f tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:34.016169 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c1999bd4-af0e-4de3-8f16-7722a52f645f tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:34.018963 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9ef9a2c9-3e68-41af-9d77-e4b00f0e4e0e tempest-HostsAdminNegativeTestJSON-1782868351 tempest-HostsAdminNegativeTestJSON-1782868351-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.377292 Aug 31 15:49:34.023852 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 99/166] 10.222.0.50 () {58 vars in 1128 bytes} [Wed Aug 31 15:49:33 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:34.034133 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c1999bd4-af0e-4de3-8f16-7722a52f645f tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] 10.222.0.50 "GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f" status: 200 len: 1417 microversion: 2.75 time: 0.410549 Aug 31 15:49:34.034397 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f2cf5073-f242-4185-97c2-e2bdd4be7564 tempest-AggregatesAdminTestV241-2010438165 tempest-AggregatesAdminTestV241-2010438165-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-573359833"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:34.035789 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 68/167] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:49:33 2022] GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f => generated 1417 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:49:34.041617 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fd28683a-31f5-4cf6-ab38-f3c87cff5665 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:34.053893 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-fd28683a-31f5-4cf6-ab38-f3c87cff5665 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Aug 31 15:49:34.060758 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fd28683a-31f5-4cf6-ab38-f3c87cff5665 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Request method failure captured: Aug 31 15:49:34.060758 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/os-aggregates/5 HTTP/1.1 Aug 31 15:49:34.060758 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:49:34.060758 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:49:34.060758 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:49:34.060758 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:49:34.060758 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:49:34.060758 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:49:34.060758 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:49:34.060758 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:49:34.060758 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4LiK2szWdJ805okZPNBhNZrKI1pL96--DtXAiwjrF-4c0UYPxumLcPEBw26Stsd0WaVxYSjKu0TSaH_Ut6VPXVcaW_WonIdnLJvJyG7pkqW_lz3VdV_9ziDW23Q0ijvf-IbFZJbwdTKWh4cbK99NClCaUa4b_Szbrk0SJ0cRdclV4c Aug 31 15:49:34.060758 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:49:34.060758 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:49:34.060758 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:49:34.060758 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:49:34.060758 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:49:34.060758 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:49:34.060758 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 9acca6b4bdf5480dadd87d9bf41cfa12 Aug 31 15:49:34.060758 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-AggregatesAdminTestJSON-1492060115 Aug 31 15:49:34.060758 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,admin,member Aug 31 15:49:34.060758 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,admin,member Aug 31 15:49:34.062481 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9acca6b4bdf5480dadd87d9bf41cfa12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9acca6b4bdf5480dadd87d9bf41cfa12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9acca6b4bdf5480dadd87d9bf41cfa12"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9acca6b4bdf5480dadd87d9bf41cfa12", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:49:34.062481 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-AggregatesAdminTestJSON-1492060115 Aug 31 15:49:34.062481 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 9acca6b4bdf5480dadd87d9bf41cfa12 Aug 31 15:49:34.062481 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1492060115 Aug 31 15:49:34.062481 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-AggregatesAdminTestJSON-1492060115-project-admin Aug 31 15:49:34.062481 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:49:34.062481 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:49:34.062481 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 3997602fdcb54000a817d588a7a0da6c Aug 31 15:49:34.062481 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-AggregatesAdminTestJSON-1492060115-project-admin Aug 31 15:49:34.062481 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 15:49:34.062481 n-d-833090-16 devstack@n-api.service[128863]: exception: Aggregate 5 could not be found. Aug 31 15:49:34.062481 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '5'} Aug 31 15:49:34.062481 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:49:34.063803 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:34.063803 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 31 15:49:34.063803 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 31 15:49:34.063803 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6462, in get_aggregate Aug 31 15:49:34.063803 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 31 15:49:34.063803 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 15:49:34.063803 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 15:49:34.063803 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 31 15:49:34.063803 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 31 15:49:34.063803 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 31 15:49:34.063803 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 31 15:49:34.063803 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 31 15:49:34.063803 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 31 15:49:34.063803 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Aug 31 15:49:34.063803 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:34.063803 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:34.063803 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:34.063803 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:34.063803 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:34.065517 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:34.065517 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:49:34.065517 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:49:34.065517 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:49:34.065517 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:49:34.065517 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 31 15:49:34.065517 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:49:34.065517 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Aug 31 15:49:34.065517 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:34.065517 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:34.065517 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:34.065517 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:34.065517 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:34.065517 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:34.065517 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:49:34.065517 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:49:34.065517 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Aug 31 15:49:34.065517 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:34.069123 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fd28683a-31f5-4cf6-ab38-f3c87cff5665 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:49:34.070846 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fd28683a-31f5-4cf6-ab38-f3c87cff5665 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.033790 Aug 31 15:49:34.071884 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 69/168] 10.222.0.50 () {58 vars in 1149 bytes} [Wed Aug 31 15:49:34 2022] GET /compute/v2.1/os-aggregates/5 => generated 77 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 15:49:34.293851 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f2cf5073-f242-4185-97c2-e2bdd4be7564 tempest-AggregatesAdminTestV241-2010438165 tempest-AggregatesAdminTestV241-2010438165-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-aggregates/6" status: 200 len: 298 microversion: 2.41 time: 0.267789 Aug 31 15:49:34.294948 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 100/169] 10.222.0.50 () {62 vars in 1210 bytes} [Wed Aug 31 15:49:34 2022] PUT /compute/v2.1/os-aggregates/6 => generated 298 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:49:34.335298 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7e768f5b-513c-42a1-8526-26885ec303c1 tempest-HostsAdminNegativeTestJSON-2031521559 tempest-HostsAdminNegativeTestJSON-2031521559-project] Calling method '.version_select at 0x7fbb4726cc10>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:34.342893 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7e768f5b-513c-42a1-8526-26885ec303c1 tempest-HostsAdminNegativeTestJSON-2031521559 tempest-HostsAdminNegativeTestJSON-2031521559-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'b9ee2ffc379746cebc52ed7b164d5aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae922e02a2940028224ff8d78235fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:34.348013 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-938d9ef3-bc69-46fd-8958-4f800d69cf0b tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:34.351364 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7e768f5b-513c-42a1-8526-26885ec303c1 tempest-HostsAdminNegativeTestJSON-2031521559 tempest-HostsAdminNegativeTestJSON-2031521559-project] Request method failure captured: Aug 31 15:49:34.351364 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Aug 31 15:49:34.351364 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:49:34.351364 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:49:34.351364 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:49:34.351364 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:49:34.351364 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:49:34.351364 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:49:34.351364 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:49:34.351364 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:49:34.351364 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4MME-OAXfj8hT9XIp7fQnJePfXsDgdKWsiDIVObuE5NAyRN2alT98baIVyFlspEpP4q_Et8xRVgPLphA9-a89RJ54iS98aPHfUW5IXrU3C_NCHetSt1HXjQHwfnXtt8VDRuW0r2vEC3mz_6bY0xazxgwpMP-u5Pa1B__GYvAeT1HQA Aug 31 15:49:34.351364 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:49:34.351364 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:49:34.351364 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:49:34.351364 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:49:34.351364 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:49:34.351364 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:49:34.351364 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 8ae922e02a2940028224ff8d78235fd4 Aug 31 15:49:34.351364 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2031521559 Aug 31 15:49:34.351364 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:49:34.351364 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:49:34.352732 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8ae922e02a2940028224ff8d78235fd4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8ae922e02a2940028224ff8d78235fd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8ae922e02a2940028224ff8d78235fd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8ae922e02a2940028224ff8d78235fd4", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:49:34.352732 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2031521559 Aug 31 15:49:34.352732 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 8ae922e02a2940028224ff8d78235fd4 Aug 31 15:49:34.352732 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2031521559 Aug 31 15:49:34.352732 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-HostsAdminNegativeTestJSON-2031521559-project Aug 31 15:49:34.352732 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:49:34.352732 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:49:34.352732 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: b9ee2ffc379746cebc52ed7b164d5aaf Aug 31 15:49:34.352732 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2031521559-project Aug 31 15:49:34.352732 n-d-833090-16 devstack@n-api.service[128863]: method: Aug 31 15:49:34.352732 n-d-833090-16 devstack@n-api.service[128863]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 31 15:49:34.352732 n-d-833090-16 devstack@n-api.service[128863]: action_args: {} Aug 31 15:49:34.352732 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:49:34.353611 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:34.353611 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:34.353611 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:34.353611 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:49:34.353611 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:49:34.353611 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:49:34.353611 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:49:34.353611 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 15:49:34.353611 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:49:34.353611 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:49:34.353611 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:49:34.353611 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Aug 31 15:49:34.353611 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Aug 31 15:49:34.353611 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 15:49:34.353611 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 15:49:34.353611 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 15:49:34.353611 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 15:49:34.353611 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:49:34.353611 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:49:34.354896 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:49:34.354896 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:49:34.354896 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 15:49:34.354896 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 15:49:34.354896 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 15:49:34.354896 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 15:49:34.354896 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 15:49:34.354896 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 15:49:34.354896 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 31 15:49:34.354896 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:34.354896 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:34.354896 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:34.354896 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:34.354896 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:34.354896 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:34.354896 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 15:49:34.354896 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 15:49:34.354896 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 31 15:49:34.354896 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:34.357866 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7e768f5b-513c-42a1-8526-26885ec303c1 tempest-HostsAdminNegativeTestJSON-2031521559 tempest-HostsAdminNegativeTestJSON-2031521559-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:49:34.363079 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7e768f5b-513c-42a1-8526-26885ec303c1 tempest-HostsAdminNegativeTestJSON-2031521559 tempest-HostsAdminNegativeTestJSON-2031521559-project] 10.222.0.50 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.284942 Aug 31 15:49:34.373527 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 70/170] 10.222.0.50 () {58 vars in 1128 bytes} [Wed Aug 31 15:49:34 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 301 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:49:34.400644 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-938d9ef3-bc69-46fd-8958-4f800d69cf0b tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Aug 31 15:49:34.401260 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8aeab14e-4057-4887-910e-3e87cb6c1289 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:34.401976 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8aeab14e-4057-4887-910e-3e87cb6c1289 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 848b21b2-98a0-4e70-a27c-08d390d73ae6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:34.411850 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-938d9ef3-bc69-46fd-8958-4f800d69cf0b tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Request method failure captured: Aug 31 15:49:34.411850 n-d-833090-16 devstack@n-api.service[128864]: request: DELETE /compute/v2.1/os-aggregates/5 HTTP/1.1 Aug 31 15:49:34.411850 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:49:34.411850 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:49:34.411850 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:49:34.411850 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:49:34.411850 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:49:34.411850 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:49:34.411850 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:49:34.411850 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:49:34.411850 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4LiK2szWdJ805okZPNBhNZrKI1pL96--DtXAiwjrF-4c0UYPxumLcPEBw26Stsd0WaVxYSjKu0TSaH_Ut6VPXVcaW_WonIdnLJvJyG7pkqW_lz3VdV_9ziDW23Q0ijvf-IbFZJbwdTKWh4cbK99NClCaUa4b_Szbrk0SJ0cRdclV4c Aug 31 15:49:34.411850 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:49:34.411850 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:49:34.411850 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:49:34.411850 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:49:34.411850 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:49:34.411850 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:49:34.411850 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 9acca6b4bdf5480dadd87d9bf41cfa12 Aug 31 15:49:34.411850 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-AggregatesAdminTestJSON-1492060115 Aug 31 15:49:34.411850 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,admin,member Aug 31 15:49:34.411850 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,admin,member Aug 31 15:49:34.413381 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9acca6b4bdf5480dadd87d9bf41cfa12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9acca6b4bdf5480dadd87d9bf41cfa12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9acca6b4bdf5480dadd87d9bf41cfa12"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9acca6b4bdf5480dadd87d9bf41cfa12", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:49:34.413381 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-AggregatesAdminTestJSON-1492060115 Aug 31 15:49:34.413381 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 9acca6b4bdf5480dadd87d9bf41cfa12 Aug 31 15:49:34.413381 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1492060115 Aug 31 15:49:34.413381 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-AggregatesAdminTestJSON-1492060115-project-admin Aug 31 15:49:34.413381 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:49:34.413381 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:49:34.413381 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 3997602fdcb54000a817d588a7a0da6c Aug 31 15:49:34.413381 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-AggregatesAdminTestJSON-1492060115-project-admin Aug 31 15:49:34.413381 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:49:34.413381 n-d-833090-16 devstack@n-api.service[128864]: exception: Aggregate 5 could not be found. Aug 31 15:49:34.413381 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '5'} Aug 31 15:49:34.413381 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:49:34.414206 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:34.414206 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 31 15:49:34.414206 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 31 15:49:34.414206 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 31 15:49:34.414206 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 31 15:49:34.414206 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:49:34.414206 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:49:34.414206 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:49:34.414206 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:49:34.414206 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 31 15:49:34.414206 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 31 15:49:34.414206 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6515, in delete_aggregate Aug 31 15:49:34.414206 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 31 15:49:34.414206 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 15:49:34.414206 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 15:49:34.414206 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 31 15:49:34.414206 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 31 15:49:34.414206 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 31 15:49:34.414206 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 31 15:49:34.415503 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 31 15:49:34.415503 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 31 15:49:34.415503 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Aug 31 15:49:34.415503 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:34.415503 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:34.415503 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:34.415503 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:34.415503 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:34.415503 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:34.415503 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:49:34.415503 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:49:34.415503 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:49:34.415503 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:49:34.415503 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 31 15:49:34.415503 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:49:34.415503 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Aug 31 15:49:34.415503 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:34.415503 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:34.415503 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:34.415503 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:34.415503 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:34.416820 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:34.416820 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:49:34.416820 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:49:34.416820 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Aug 31 15:49:34.416820 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:34.416820 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-938d9ef3-bc69-46fd-8958-4f800d69cf0b tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:49:34.416820 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-938d9ef3-bc69-46fd-8958-4f800d69cf0b tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.093677 Aug 31 15:49:34.417268 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8aeab14e-4057-4887-910e-3e87cb6c1289 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:34.419538 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 101/171] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Aug 31 15:49:34 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 77 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 15:49:34.420997 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8aeab14e-4057-4887-910e-3e87cb6c1289 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:34.422374 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8aeab14e-4057-4887-910e-3e87cb6c1289 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:34.423139 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8aeab14e-4057-4887-910e-3e87cb6c1289 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:34.423613 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8aeab14e-4057-4887-910e-3e87cb6c1289 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:34.428036 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8aeab14e-4057-4887-910e-3e87cb6c1289 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:34.433969 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e27ef692-b9ee-4c91-aad7-2653f0a6c6a6 tempest-AggregatesAdminTestV241-2010438165 tempest-AggregatesAdminTestV241-2010438165-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:34.454383 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e27ef692-b9ee-4c91-aad7-2653f0a6c6a6 tempest-AggregatesAdminTestV241-2010438165 tempest-AggregatesAdminTestV241-2010438165-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates/6" status: 200 len: 298 microversion: 2.41 time: 0.033612 Aug 31 15:49:34.456211 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 102/172] 10.222.0.50 () {60 vars in 1190 bytes} [Wed Aug 31 15:49:34 2022] GET /compute/v2.1/os-aggregates/6 => generated 298 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:49:34.478262 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-db40bd15-0c8a-470b-9fa9-a4e4a28160cc tempest-HostsAdminNegativeTestJSON-2031521559 tempest-HostsAdminNegativeTestJSON-2031521559-project] Calling method '.version_select at 0x7fbb47361c10>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:34.482658 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-db40bd15-0c8a-470b-9fa9-a4e4a28160cc tempest-HostsAdminNegativeTestJSON-2031521559 tempest-HostsAdminNegativeTestJSON-2031521559-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'b9ee2ffc379746cebc52ed7b164d5aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae922e02a2940028224ff8d78235fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:34.490056 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-db40bd15-0c8a-470b-9fa9-a4e4a28160cc tempest-HostsAdminNegativeTestJSON-2031521559 tempest-HostsAdminNegativeTestJSON-2031521559-project] Request method failure captured: Aug 31 15:49:34.490056 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/os-hosts/n-d-833090-16/reboot HTTP/1.1 Aug 31 15:49:34.490056 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:49:34.490056 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:49:34.490056 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:49:34.490056 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:49:34.490056 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:49:34.490056 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:49:34.490056 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:49:34.490056 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:49:34.490056 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4MME-OAXfj8hT9XIp7fQnJePfXsDgdKWsiDIVObuE5NAyRN2alT98baIVyFlspEpP4q_Et8xRVgPLphA9-a89RJ54iS98aPHfUW5IXrU3C_NCHetSt1HXjQHwfnXtt8VDRuW0r2vEC3mz_6bY0xazxgwpMP-u5Pa1B__GYvAeT1HQA Aug 31 15:49:34.490056 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:49:34.490056 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:49:34.490056 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:49:34.490056 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:49:34.490056 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:49:34.490056 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:49:34.490056 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 8ae922e02a2940028224ff8d78235fd4 Aug 31 15:49:34.490056 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2031521559 Aug 31 15:49:34.490056 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:49:34.490056 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:49:34.491567 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8ae922e02a2940028224ff8d78235fd4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8ae922e02a2940028224ff8d78235fd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8ae922e02a2940028224ff8d78235fd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8ae922e02a2940028224ff8d78235fd4", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:49:34.491567 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2031521559 Aug 31 15:49:34.491567 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 8ae922e02a2940028224ff8d78235fd4 Aug 31 15:49:34.491567 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2031521559 Aug 31 15:49:34.491567 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-HostsAdminNegativeTestJSON-2031521559-project Aug 31 15:49:34.491567 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:49:34.491567 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:49:34.491567 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: b9ee2ffc379746cebc52ed7b164d5aaf Aug 31 15:49:34.491567 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2031521559-project Aug 31 15:49:34.491567 n-d-833090-16 devstack@n-api.service[128864]: method: Aug 31 15:49:34.491567 n-d-833090-16 devstack@n-api.service[128864]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 31 15:49:34.491567 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'n-d-833090-16'} Aug 31 15:49:34.491567 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:49:34.492404 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:34.492404 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:34.492404 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:34.492404 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:49:34.492404 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:49:34.492404 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:49:34.492404 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:49:34.492404 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:49:34.492404 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:49:34.492404 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Aug 31 15:49:34.492404 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Aug 31 15:49:34.492404 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 15:49:34.492404 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 15:49:34.492404 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 15:49:34.492404 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 15:49:34.492404 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:49:34.492404 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:49:34.492404 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:49:34.492404 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:49:34.493581 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 15:49:34.493581 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 15:49:34.493581 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 15:49:34.493581 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 15:49:34.493581 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 15:49:34.493581 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 15:49:34.493581 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 31 15:49:34.493581 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:34.493581 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:34.493581 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:34.493581 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:34.493581 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:34.493581 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:34.493581 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 15:49:34.493581 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 15:49:34.493581 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 31 15:49:34.493581 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:34.494698 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-db40bd15-0c8a-470b-9fa9-a4e4a28160cc tempest-HostsAdminNegativeTestJSON-2031521559 tempest-HostsAdminNegativeTestJSON-2031521559-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:49:34.494698 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-db40bd15-0c8a-470b-9fa9-a4e4a28160cc tempest-HostsAdminNegativeTestJSON-2031521559 tempest-HostsAdminNegativeTestJSON-2031521559-project] 10.222.0.50 "GET /compute/v2.1/os-hosts/n-d-833090-16/reboot" status: 403 len: 111 microversion: 2.1 time: 0.025854 Aug 31 15:49:34.500499 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 103/173] 10.222.0.50 () {58 vars in 1191 bytes} [Wed Aug 31 15:49:34 2022] GET /compute/v2.1/os-hosts/n-d-833090-16/reboot => generated 111 bytes in 44 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:49:34.511161 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c2698e27-baf0-4398-a708-2c27128de451 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1142730302", "name": "tempest-test_aggregate-2053304330"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:34.520249 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.aggregate [None req-c2698e27-baf0-4398-a708-2c27128de451 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Generated uuid 535a0db2-27ff-44fe-94da-bb095549273e for aggregate {{(pid=128864) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 31 15:49:34.590039 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c2698e27-baf0-4398-a708-2c27128de451 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.087810 Aug 31 15:49:34.590748 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 104/174] 10.222.0.50 () {60 vars in 1165 bytes} [Wed Aug 31 15:49:34 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:34.602920 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4d3c4c7b-0e88-4c1b-b679-b05f70820dcf tempest-AggregatesAdminTestV241-2010438165 tempest-AggregatesAdminTestV241-2010438165-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-833090-16"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:34.614983 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4d3c4c7b-0e88-4c1b-b679-b05f70820dcf tempest-AggregatesAdminTestV241-2010438165 tempest-AggregatesAdminTestV241-2010438165-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:34.615481 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4d3c4c7b-0e88-4c1b-b679-b05f70820dcf tempest-AggregatesAdminTestV241-2010438165 tempest-AggregatesAdminTestV241-2010438165-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:34.615913 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4d3c4c7b-0e88-4c1b-b679-b05f70820dcf tempest-AggregatesAdminTestV241-2010438165 tempest-AggregatesAdminTestV241-2010438165-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:34.828493 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4d3c4c7b-0e88-4c1b-b679-b05f70820dcf tempest-AggregatesAdminTestV241-2010438165 tempest-AggregatesAdminTestV241-2010438165-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 314 microversion: 2.41 time: 0.229491 Aug 31 15:49:34.829278 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 105/175] 10.222.0.50 () {62 vars in 1232 bytes} [Wed Aug 31 15:49:34 2022] POST /compute/v2.1/os-aggregates/6/action => generated 314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:49:34.833880 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b5532d99-1ba0-4272-96c0-32ede9b7bf71 tempest-HostsAdminNegativeTestJSON-1782868351 tempest-HostsAdminNegativeTestJSON-1782868351-project-admin] Calling method '.version_select at 0x7fbb477114c0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:34.852912 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-b5532d99-1ba0-4272-96c0-32ede9b7bf71 tempest-HostsAdminNegativeTestJSON-1782868351 tempest-HostsAdminNegativeTestJSON-1782868351-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 31 15:49:34.855337 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b5532d99-1ba0-4272-96c0-32ede9b7bf71 tempest-HostsAdminNegativeTestJSON-1782868351 tempest-HostsAdminNegativeTestJSON-1782868351-project-admin] Request method failure captured: Aug 31 15:49:34.855337 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Aug 31 15:49:34.855337 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:49:34.855337 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:49:34.855337 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:49:34.855337 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:49:34.855337 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:49:34.855337 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:49:34.855337 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:49:34.855337 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:49:34.855337 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4MNJJRNsgEDtr-gJwpnPOtdSXYjZNbMKDAQRkkGXkmyrF-mbYJZgqHH0Ec7XQJU449rEceonbzv_7kQbnCmzfUgGy-VDRGjYhjorfV4V54fByD7oZ90cKIftJMb1Xim8WE0Y891xIdv6iBepOzgC1ZmUQ7ASujBfE4mQQY21MD7wAE Aug 31 15:49:34.855337 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:49:34.855337 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:49:34.855337 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:49:34.855337 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:49:34.855337 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:49:34.855337 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:49:34.855337 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 2b6469c21ad34bcab797fe3f53b282f2 Aug 31 15:49:34.855337 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1782868351 Aug 31 15:49:34.855337 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,admin,member Aug 31 15:49:34.855337 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,admin,member Aug 31 15:49:34.856718 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2b6469c21ad34bcab797fe3f53b282f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2b6469c21ad34bcab797fe3f53b282f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2b6469c21ad34bcab797fe3f53b282f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2b6469c21ad34bcab797fe3f53b282f2", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:49:34.856718 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1782868351 Aug 31 15:49:34.856718 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 2b6469c21ad34bcab797fe3f53b282f2 Aug 31 15:49:34.856718 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1782868351 Aug 31 15:49:34.856718 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-HostsAdminNegativeTestJSON-1782868351-project-admin Aug 31 15:49:34.856718 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:49:34.856718 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:49:34.856718 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: e14ebd4cbdb74d0b8562ab4ad4fe4147 Aug 31 15:49:34.856718 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1782868351-project-admin Aug 31 15:49:34.856718 n-d-833090-16 devstack@n-api.service[128864]: method: Aug 31 15:49:34.856718 n-d-833090-16 devstack@n-api.service[128864]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 31 15:49:34.856718 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'nonexistent_hostname'} Aug 31 15:49:34.856718 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:49:34.857610 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:34.857610 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 31 15:49:34.857610 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 31 15:49:34.857610 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 31 15:49:34.857610 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 31 15:49:34.857610 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:49:34.857610 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:49:34.857610 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:49:34.857610 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:49:34.857610 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 31 15:49:34.857610 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 31 15:49:34.857610 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 31 15:49:34.857610 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 31 15:49:34.857610 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 15:49:34.857610 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 15:49:34.857610 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 31 15:49:34.857610 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 31 15:49:34.857610 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 31 15:49:34.857610 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 31 15:49:34.858907 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 31 15:49:34.858907 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 31 15:49:34.858907 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 31 15:49:34.858907 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:34.858907 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:34.858907 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:34.858907 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:34.858907 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:34.858907 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:34.858907 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:49:34.858907 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:49:34.858907 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:49:34.858907 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:49:34.858907 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:49:34.858907 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:49:34.858907 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Aug 31 15:49:34.858907 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Aug 31 15:49:34.858907 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 31 15:49:34.858907 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:49:34.860545 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 31 15:49:34.860545 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:34.860545 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:34.860545 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:34.860545 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:34.860545 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:34.860545 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:34.860545 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:49:34.860545 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:49:34.860545 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 31 15:49:34.860545 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:34.860545 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b5532d99-1ba0-4272-96c0-32ede9b7bf71 tempest-HostsAdminNegativeTestJSON-1782868351 tempest-HostsAdminNegativeTestJSON-1782868351-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:49:34.860545 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b5532d99-1ba0-4272-96c0-32ede9b7bf71 tempest-HostsAdminNegativeTestJSON-1782868351 tempest-HostsAdminNegativeTestJSON-1782868351-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.027125 Aug 31 15:49:34.863327 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 106/176] 10.222.0.50 () {58 vars in 1212 bytes} [Wed Aug 31 15:49:34 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 15:49:34.870594 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8ab6e2c1-eedd-48e0-aeaf-218204acf082 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:34.913679 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8ab6e2c1-eedd-48e0-aeaf-218204acf082 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.049142 Aug 31 15:49:34.914288 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 107/177] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Aug 31 15:49:34 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 31 15:49:34.921538 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c1363a06-bc5a-44cf-a6c3-64694154a071 tempest-AggregatesAdminTestV241-2010438165 tempest-AggregatesAdminTestV241-2010438165-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-833090-16"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:34.935663 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c1363a06-bc5a-44cf-a6c3-64694154a071 tempest-AggregatesAdminTestV241-2010438165 tempest-AggregatesAdminTestV241-2010438165-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:34.936258 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c1363a06-bc5a-44cf-a6c3-64694154a071 tempest-AggregatesAdminTestV241-2010438165 tempest-AggregatesAdminTestV241-2010438165-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:34.937533 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c1363a06-bc5a-44cf-a6c3-64694154a071 tempest-AggregatesAdminTestV241-2010438165 tempest-AggregatesAdminTestV241-2010438165-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:35.129064 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c1363a06-bc5a-44cf-a6c3-64694154a071 tempest-AggregatesAdminTestV241-2010438165 tempest-AggregatesAdminTestV241-2010438165-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 298 microversion: 2.41 time: 0.208880 Aug 31 15:49:35.147086 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 108/178] 10.222.0.50 () {62 vars in 1232 bytes} [Wed Aug 31 15:49:34 2022] POST /compute/v2.1/os-aggregates/6/action => generated 298 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:49:35.147825 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8aeab14e-4057-4887-910e-3e87cb6c1289 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:35.172834 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8aeab14e-4057-4887-910e-3e87cb6c1289 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6" status: 200 len: 1317 microversion: 2.1 time: 0.787058 Aug 31 15:49:35.175321 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 71/179] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:49:34 2022] GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6 => generated 1317 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:35.178461 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1c85eb16-2e31-4674-baed-85c88d297483 tempest-HostsAdminNegativeTestJSON-2031521559 tempest-HostsAdminNegativeTestJSON-2031521559-project] Calling method '.version_select at 0x7fbb47361ee0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:35.183303 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1c85eb16-2e31-4674-baed-85c88d297483 tempest-HostsAdminNegativeTestJSON-2031521559 tempest-HostsAdminNegativeTestJSON-2031521559-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'b9ee2ffc379746cebc52ed7b164d5aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae922e02a2940028224ff8d78235fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:35.186054 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1c85eb16-2e31-4674-baed-85c88d297483 tempest-HostsAdminNegativeTestJSON-2031521559 tempest-HostsAdminNegativeTestJSON-2031521559-project] Request method failure captured: Aug 31 15:49:35.186054 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/os-hosts/n-d-833090-16 HTTP/1.1 Aug 31 15:49:35.186054 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:49:35.186054 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:49:35.186054 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:49:35.186054 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:49:35.186054 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:49:35.186054 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:49:35.186054 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:49:35.186054 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:49:35.186054 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4MME-OAXfj8hT9XIp7fQnJePfXsDgdKWsiDIVObuE5NAyRN2alT98baIVyFlspEpP4q_Et8xRVgPLphA9-a89RJ54iS98aPHfUW5IXrU3C_NCHetSt1HXjQHwfnXtt8VDRuW0r2vEC3mz_6bY0xazxgwpMP-u5Pa1B__GYvAeT1HQA Aug 31 15:49:35.186054 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:49:35.186054 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:49:35.186054 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:49:35.186054 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:49:35.186054 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:49:35.186054 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:49:35.186054 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 8ae922e02a2940028224ff8d78235fd4 Aug 31 15:49:35.186054 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2031521559 Aug 31 15:49:35.186054 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:49:35.186054 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:49:35.187455 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8ae922e02a2940028224ff8d78235fd4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8ae922e02a2940028224ff8d78235fd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8ae922e02a2940028224ff8d78235fd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8ae922e02a2940028224ff8d78235fd4", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:49:35.187455 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2031521559 Aug 31 15:49:35.187455 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 8ae922e02a2940028224ff8d78235fd4 Aug 31 15:49:35.187455 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2031521559 Aug 31 15:49:35.187455 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-HostsAdminNegativeTestJSON-2031521559-project Aug 31 15:49:35.187455 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:49:35.187455 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:49:35.187455 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: b9ee2ffc379746cebc52ed7b164d5aaf Aug 31 15:49:35.187455 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2031521559-project Aug 31 15:49:35.187455 n-d-833090-16 devstack@n-api.service[128864]: method: Aug 31 15:49:35.187455 n-d-833090-16 devstack@n-api.service[128864]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 31 15:49:35.187455 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'n-d-833090-16'} Aug 31 15:49:35.187455 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:49:35.188192 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:35.188192 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:35.188192 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:35.188192 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:49:35.188192 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:49:35.188192 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:49:35.188192 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:49:35.188192 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:49:35.188192 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:49:35.188192 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Aug 31 15:49:35.188192 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Aug 31 15:49:35.188192 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 15:49:35.188192 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 15:49:35.188192 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 15:49:35.188192 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 15:49:35.188192 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:49:35.188192 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:49:35.188192 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:49:35.188192 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:49:35.189190 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 15:49:35.189190 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 15:49:35.189190 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 15:49:35.189190 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 15:49:35.189190 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 15:49:35.189190 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 15:49:35.189190 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 31 15:49:35.189190 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:35.189190 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:35.189190 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:35.189190 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:35.189190 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:35.189190 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:35.189190 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 15:49:35.189190 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 15:49:35.189190 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 31 15:49:35.189190 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:35.190751 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-43f35e95-876c-4510-aeeb-8cf50fd8ba96 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:35.196108 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1c85eb16-2e31-4674-baed-85c88d297483 tempest-HostsAdminNegativeTestJSON-2031521559 tempest-HostsAdminNegativeTestJSON-2031521559-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:49:35.198652 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1c85eb16-2e31-4674-baed-85c88d297483 tempest-HostsAdminNegativeTestJSON-2031521559 tempest-HostsAdminNegativeTestJSON-2031521559-project] 10.222.0.50 "GET /compute/v2.1/os-hosts/n-d-833090-16" status: 403 len: 109 microversion: 2.1 time: 0.032508 Aug 31 15:49:35.208831 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 109/180] 10.222.0.50 () {58 vars in 1170 bytes} [Wed Aug 31 15:49:35 2022] GET /compute/v2.1/os-hosts/n-d-833090-16 => generated 109 bytes in 59 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:49:35.211882 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-43f35e95-876c-4510-aeeb-8cf50fd8ba96 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Aug 31 15:49:35.215737 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a85daf2b-e11d-4c13-8c1e-2f027dbf2d12 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:35.216649 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a85daf2b-e11d-4c13-8c1e-2f027dbf2d12 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:35.216965 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-43f35e95-876c-4510-aeeb-8cf50fd8ba96 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Request method failure captured: Aug 31 15:49:35.216965 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Aug 31 15:49:35.216965 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:49:35.216965 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:49:35.216965 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:49:35.216965 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:49:35.216965 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:49:35.216965 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:49:35.216965 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:49:35.216965 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:49:35.216965 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4LiK2szWdJ805okZPNBhNZrKI1pL96--DtXAiwjrF-4c0UYPxumLcPEBw26Stsd0WaVxYSjKu0TSaH_Ut6VPXVcaW_WonIdnLJvJyG7pkqW_lz3VdV_9ziDW23Q0ijvf-IbFZJbwdTKWh4cbK99NClCaUa4b_Szbrk0SJ0cRdclV4c Aug 31 15:49:35.216965 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:49:35.216965 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:49:35.216965 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:49:35.216965 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:49:35.216965 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:49:35.216965 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:49:35.216965 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 9acca6b4bdf5480dadd87d9bf41cfa12 Aug 31 15:49:35.216965 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-AggregatesAdminTestJSON-1492060115 Aug 31 15:49:35.216965 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,admin,member Aug 31 15:49:35.216965 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,admin,member Aug 31 15:49:35.218719 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9acca6b4bdf5480dadd87d9bf41cfa12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9acca6b4bdf5480dadd87d9bf41cfa12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9acca6b4bdf5480dadd87d9bf41cfa12"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9acca6b4bdf5480dadd87d9bf41cfa12", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:49:35.218719 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-AggregatesAdminTestJSON-1492060115 Aug 31 15:49:35.218719 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 9acca6b4bdf5480dadd87d9bf41cfa12 Aug 31 15:49:35.218719 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1492060115 Aug 31 15:49:35.218719 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-AggregatesAdminTestJSON-1492060115-project-admin Aug 31 15:49:35.218719 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:49:35.218719 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:49:35.218719 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 3997602fdcb54000a817d588a7a0da6c Aug 31 15:49:35.218719 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-AggregatesAdminTestJSON-1492060115-project-admin Aug 31 15:49:35.218719 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 15:49:35.218719 n-d-833090-16 devstack@n-api.service[128863]: exception: Aggregate 7 could not be found. Aug 31 15:49:35.218719 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '7'} Aug 31 15:49:35.218719 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:49:35.219566 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:35.219566 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 31 15:49:35.219566 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 31 15:49:35.219566 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6462, in get_aggregate Aug 31 15:49:35.219566 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 31 15:49:35.219566 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 15:49:35.219566 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 15:49:35.219566 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 31 15:49:35.219566 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 31 15:49:35.219566 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 31 15:49:35.219566 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 31 15:49:35.219566 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 31 15:49:35.219566 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 31 15:49:35.219566 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Aug 31 15:49:35.219566 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:35.219566 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:35.219566 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:35.219566 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:35.219566 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:35.222352 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:35.222352 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:49:35.222352 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:49:35.222352 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:49:35.222352 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:49:35.222352 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 31 15:49:35.222352 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:49:35.222352 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Aug 31 15:49:35.222352 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:35.222352 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:35.222352 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:35.222352 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:35.222352 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:35.222352 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:35.222352 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:49:35.222352 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:49:35.222352 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Aug 31 15:49:35.222352 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:35.224666 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-43f35e95-876c-4510-aeeb-8cf50fd8ba96 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:49:35.226507 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-43f35e95-876c-4510-aeeb-8cf50fd8ba96 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.049468 Aug 31 15:49:35.228898 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 72/181] 10.222.0.50 () {58 vars in 1149 bytes} [Wed Aug 31 15:49:35 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 15:49:35.234887 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a85daf2b-e11d-4c13-8c1e-2f027dbf2d12 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:35.236784 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a85daf2b-e11d-4c13-8c1e-2f027dbf2d12 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:35.237377 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a85daf2b-e11d-4c13-8c1e-2f027dbf2d12 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:35.239243 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a85daf2b-e11d-4c13-8c1e-2f027dbf2d12 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:35.240043 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a85daf2b-e11d-4c13-8c1e-2f027dbf2d12 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:35.241856 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a85daf2b-e11d-4c13-8c1e-2f027dbf2d12 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:35.243612 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-64fd6626-674d-4ce3-8e6b-4043466005a6 tempest-AggregatesAdminTestV241-2010438165 tempest-AggregatesAdminTestV241-2010438165-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:35.298702 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-64fd6626-674d-4ce3-8e6b-4043466005a6 tempest-AggregatesAdminTestV241-2010438165 tempest-AggregatesAdminTestV241-2010438165-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.41 time: 0.065018 Aug 31 15:49:35.304228 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 73/182] 10.222.0.50 () {60 vars in 1193 bytes} [Wed Aug 31 15:49:35 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:35.323437 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-22573201-caea-444b-82b7-e9c4eb2702f2 tempest-HostsAdminNegativeTestJSON-1782868351 tempest-HostsAdminNegativeTestJSON-1782868351-project-admin] Calling method '.version_select at 0x7fbb47357790>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:35.349347 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-22573201-caea-444b-82b7-e9c4eb2702f2 tempest-HostsAdminNegativeTestJSON-1782868351 tempest-HostsAdminNegativeTestJSON-1782868351-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 31 15:49:35.355872 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-22573201-caea-444b-82b7-e9c4eb2702f2 tempest-HostsAdminNegativeTestJSON-1782868351 tempest-HostsAdminNegativeTestJSON-1782868351-project-admin] Request method failure captured: Aug 31 15:49:35.355872 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 31 15:49:35.355872 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:49:35.355872 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:49:35.355872 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:49:35.355872 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:49:35.355872 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:49:35.355872 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:49:35.355872 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:49:35.355872 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:49:35.355872 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4MNJJRNsgEDtr-gJwpnPOtdSXYjZNbMKDAQRkkGXkmyrF-mbYJZgqHH0Ec7XQJU449rEceonbzv_7kQbnCmzfUgGy-VDRGjYhjorfV4V54fByD7oZ90cKIftJMb1Xim8WE0Y891xIdv6iBepOzgC1ZmUQ7ASujBfE4mQQY21MD7wAE Aug 31 15:49:35.355872 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:49:35.355872 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:49:35.355872 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:49:35.355872 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:49:35.355872 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:49:35.355872 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:49:35.355872 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 2b6469c21ad34bcab797fe3f53b282f2 Aug 31 15:49:35.355872 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1782868351 Aug 31 15:49:35.355872 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,admin,member Aug 31 15:49:35.355872 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,admin,member Aug 31 15:49:35.357333 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2b6469c21ad34bcab797fe3f53b282f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2b6469c21ad34bcab797fe3f53b282f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2b6469c21ad34bcab797fe3f53b282f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2b6469c21ad34bcab797fe3f53b282f2", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:49:35.357333 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1782868351 Aug 31 15:49:35.357333 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 2b6469c21ad34bcab797fe3f53b282f2 Aug 31 15:49:35.357333 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1782868351 Aug 31 15:49:35.357333 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-HostsAdminNegativeTestJSON-1782868351-project-admin Aug 31 15:49:35.357333 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:49:35.357333 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:49:35.357333 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: e14ebd4cbdb74d0b8562ab4ad4fe4147 Aug 31 15:49:35.357333 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1782868351-project-admin Aug 31 15:49:35.357333 n-d-833090-16 devstack@n-api.service[128863]: method: Aug 31 15:49:35.357333 n-d-833090-16 devstack@n-api.service[128863]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 31 15:49:35.357333 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'nonexistent_hostname'} Aug 31 15:49:35.357333 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:49:35.358217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:35.358217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Aug 31 15:49:35.358217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 31 15:49:35.358217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 15:49:35.358217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 15:49:35.358217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 31 15:49:35.358217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 31 15:49:35.358217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 31 15:49:35.358217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 31 15:49:35.358217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 31 15:49:35.358217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 31 15:49:35.358217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 31 15:49:35.358217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:35.358217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:35.358217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:35.358217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:35.358217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:35.358217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:35.358217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:49:35.359849 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:49:35.359849 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:49:35.359849 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:49:35.359849 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:49:35.359849 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:49:35.359849 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Aug 31 15:49:35.359849 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:49:35.359849 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 31 15:49:35.359849 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:35.359849 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:35.359849 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:35.359849 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:35.359849 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:35.359849 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:35.359849 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:49:35.359849 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:49:35.359849 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 31 15:49:35.359849 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:35.363497 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-22573201-caea-444b-82b7-e9c4eb2702f2 tempest-HostsAdminNegativeTestJSON-1782868351 tempest-HostsAdminNegativeTestJSON-1782868351-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:49:35.367347 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-22573201-caea-444b-82b7-e9c4eb2702f2 tempest-HostsAdminNegativeTestJSON-1782868351 tempest-HostsAdminNegativeTestJSON-1782868351-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.065762 Aug 31 15:49:35.373515 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 74/183] 10.222.0.50 () {58 vars in 1191 bytes} [Wed Aug 31 15:49:35 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 15:49:35.388362 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8c5c0892-692a-426f-a978-6b36955f74dd tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:35.421128 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-8c5c0892-692a-426f-a978-6b36955f74dd tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Aug 31 15:49:35.423260 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8c5c0892-692a-426f-a978-6b36955f74dd tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Request method failure captured: Aug 31 15:49:35.423260 n-d-833090-16 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Aug 31 15:49:35.423260 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:49:35.423260 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:49:35.423260 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:49:35.423260 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:49:35.423260 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:49:35.423260 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:49:35.423260 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:49:35.423260 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:49:35.423260 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4LiK2szWdJ805okZPNBhNZrKI1pL96--DtXAiwjrF-4c0UYPxumLcPEBw26Stsd0WaVxYSjKu0TSaH_Ut6VPXVcaW_WonIdnLJvJyG7pkqW_lz3VdV_9ziDW23Q0ijvf-IbFZJbwdTKWh4cbK99NClCaUa4b_Szbrk0SJ0cRdclV4c Aug 31 15:49:35.423260 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:49:35.423260 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:49:35.423260 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:49:35.423260 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:49:35.423260 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:49:35.423260 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:49:35.423260 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 9acca6b4bdf5480dadd87d9bf41cfa12 Aug 31 15:49:35.423260 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-AggregatesAdminTestJSON-1492060115 Aug 31 15:49:35.423260 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,admin,member Aug 31 15:49:35.423260 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,admin,member Aug 31 15:49:35.424795 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9acca6b4bdf5480dadd87d9bf41cfa12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9acca6b4bdf5480dadd87d9bf41cfa12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9acca6b4bdf5480dadd87d9bf41cfa12"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9acca6b4bdf5480dadd87d9bf41cfa12", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:49:35.424795 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-AggregatesAdminTestJSON-1492060115 Aug 31 15:49:35.424795 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 9acca6b4bdf5480dadd87d9bf41cfa12 Aug 31 15:49:35.424795 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1492060115 Aug 31 15:49:35.424795 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-AggregatesAdminTestJSON-1492060115-project-admin Aug 31 15:49:35.424795 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:49:35.424795 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:49:35.424795 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 3997602fdcb54000a817d588a7a0da6c Aug 31 15:49:35.424795 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-AggregatesAdminTestJSON-1492060115-project-admin Aug 31 15:49:35.424795 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 15:49:35.424795 n-d-833090-16 devstack@n-api.service[128863]: exception: Aggregate 7 could not be found. Aug 31 15:49:35.424795 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '7'} Aug 31 15:49:35.424795 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:49:35.425705 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:35.425705 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 31 15:49:35.425705 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 31 15:49:35.425705 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 31 15:49:35.425705 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 31 15:49:35.425705 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:49:35.425705 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:49:35.425705 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:49:35.425705 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:49:35.425705 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 31 15:49:35.425705 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 31 15:49:35.425705 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6515, in delete_aggregate Aug 31 15:49:35.425705 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 31 15:49:35.425705 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 15:49:35.425705 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 15:49:35.425705 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 31 15:49:35.425705 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 31 15:49:35.425705 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 31 15:49:35.425705 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 31 15:49:35.427246 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 31 15:49:35.427246 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 31 15:49:35.427246 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Aug 31 15:49:35.427246 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:35.427246 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:35.427246 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:35.427246 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:35.427246 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:35.427246 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:35.427246 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:49:35.427246 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:49:35.427246 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:49:35.427246 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:49:35.427246 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 31 15:49:35.427246 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:49:35.427246 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Aug 31 15:49:35.427246 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:35.427246 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:35.427246 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:35.427246 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:35.427246 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:35.429424 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:35.429424 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:49:35.429424 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:49:35.429424 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Aug 31 15:49:35.429424 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:35.429424 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8c5c0892-692a-426f-a978-6b36955f74dd tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:49:35.429424 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8c5c0892-692a-426f-a978-6b36955f74dd tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.053015 Aug 31 15:49:35.430734 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 75/184] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Aug 31 15:49:35 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 15:49:35.437986 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a85daf2b-e11d-4c13-8c1e-2f027dbf2d12 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:35.439938 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-db46cf53-5f37-4d53-9a08-3ca925ed2977 tempest-HostsAdminNegativeTestJSON-2031521559 tempest-HostsAdminNegativeTestJSON-2031521559-project] Calling method '.version_select at 0x7fbb471da940>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:35.441906 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-db46cf53-5f37-4d53-9a08-3ca925ed2977 tempest-HostsAdminNegativeTestJSON-2031521559 tempest-HostsAdminNegativeTestJSON-2031521559-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'b9ee2ffc379746cebc52ed7b164d5aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae922e02a2940028224ff8d78235fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:35.444533 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-db46cf53-5f37-4d53-9a08-3ca925ed2977 tempest-HostsAdminNegativeTestJSON-2031521559 tempest-HostsAdminNegativeTestJSON-2031521559-project] Request method failure captured: Aug 31 15:49:35.444533 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/os-hosts/n-d-833090-16/shutdown HTTP/1.1 Aug 31 15:49:35.444533 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:49:35.444533 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:49:35.444533 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:49:35.444533 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:49:35.444533 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:49:35.444533 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:49:35.444533 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:49:35.444533 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:49:35.444533 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4MME-OAXfj8hT9XIp7fQnJePfXsDgdKWsiDIVObuE5NAyRN2alT98baIVyFlspEpP4q_Et8xRVgPLphA9-a89RJ54iS98aPHfUW5IXrU3C_NCHetSt1HXjQHwfnXtt8VDRuW0r2vEC3mz_6bY0xazxgwpMP-u5Pa1B__GYvAeT1HQA Aug 31 15:49:35.444533 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:49:35.444533 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:49:35.444533 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:49:35.444533 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:49:35.444533 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:49:35.444533 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:49:35.444533 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 8ae922e02a2940028224ff8d78235fd4 Aug 31 15:49:35.444533 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2031521559 Aug 31 15:49:35.444533 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:49:35.444533 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:49:35.445774 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8ae922e02a2940028224ff8d78235fd4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8ae922e02a2940028224ff8d78235fd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8ae922e02a2940028224ff8d78235fd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8ae922e02a2940028224ff8d78235fd4", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:49:35.445774 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2031521559 Aug 31 15:49:35.445774 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 8ae922e02a2940028224ff8d78235fd4 Aug 31 15:49:35.445774 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2031521559 Aug 31 15:49:35.445774 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-HostsAdminNegativeTestJSON-2031521559-project Aug 31 15:49:35.445774 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:49:35.445774 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:49:35.445774 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: b9ee2ffc379746cebc52ed7b164d5aaf Aug 31 15:49:35.445774 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2031521559-project Aug 31 15:49:35.445774 n-d-833090-16 devstack@n-api.service[128863]: method: Aug 31 15:49:35.445774 n-d-833090-16 devstack@n-api.service[128863]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 31 15:49:35.445774 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'n-d-833090-16'} Aug 31 15:49:35.445774 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:49:35.446529 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:35.446529 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:35.446529 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:35.446529 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:49:35.446529 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:49:35.446529 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:49:35.446529 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:49:35.446529 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:49:35.446529 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:49:35.446529 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Aug 31 15:49:35.446529 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Aug 31 15:49:35.446529 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 15:49:35.446529 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 15:49:35.446529 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 15:49:35.446529 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 15:49:35.446529 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:49:35.446529 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:49:35.446529 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:49:35.446529 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:49:35.447497 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 15:49:35.447497 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 15:49:35.447497 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 15:49:35.447497 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 15:49:35.447497 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 15:49:35.447497 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 15:49:35.447497 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 31 15:49:35.447497 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:35.447497 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:35.447497 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:35.447497 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:35.447497 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:35.447497 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:35.447497 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 15:49:35.447497 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 15:49:35.447497 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 31 15:49:35.447497 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:35.451126 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a85daf2b-e11d-4c13-8c1e-2f027dbf2d12 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:35.452203 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-db46cf53-5f37-4d53-9a08-3ca925ed2977 tempest-HostsAdminNegativeTestJSON-2031521559 tempest-HostsAdminNegativeTestJSON-2031521559-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:49:35.455578 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a85daf2b-e11d-4c13-8c1e-2f027dbf2d12 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:35.456182 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-db46cf53-5f37-4d53-9a08-3ca925ed2977 tempest-HostsAdminNegativeTestJSON-2031521559 tempest-HostsAdminNegativeTestJSON-2031521559-project] 10.222.0.50 "GET /compute/v2.1/os-hosts/n-d-833090-16/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.024051 Aug 31 15:49:35.457057 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 76/185] 10.222.0.50 () {58 vars in 1197 bytes} [Wed Aug 31 15:49:35 2022] GET /compute/v2.1/os-hosts/n-d-833090-16/shutdown => generated 113 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:49:35.465366 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-67616491-ccf3-4378-bcf9-951e7a32eb35 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1525020868"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:35.472768 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.aggregate [None req-67616491-ccf3-4378-bcf9-951e7a32eb35 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Generated uuid e460f6c3-e17d-40aa-abc8-6108835af485 for aggregate {{(pid=128863) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 31 15:49:35.474775 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a85daf2b-e11d-4c13-8c1e-2f027dbf2d12 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] 10.222.0.50 "GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f" status: 200 len: 1417 microversion: 2.75 time: 0.261993 Aug 31 15:49:35.476095 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 110/186] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:49:35 2022] GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f => generated 1417 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:49:35.488528 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8437c5b9-45ad-47d3-8f89-465c3585d057 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2047217419"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:35.494539 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.aggregate [None req-8437c5b9-45ad-47d3-8f89-465c3585d057 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Generated uuid 84e42626-9dc5-49cd-8e6b-fb29f4bac735 for aggregate {{(pid=128864) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 31 15:49:35.538591 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-67616491-ccf3-4378-bcf9-951e7a32eb35 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.079579 Aug 31 15:49:35.541280 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8437c5b9-45ad-47d3-8f89-465c3585d057 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.061958 Aug 31 15:49:35.541965 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 111/187] 10.222.0.50 () {60 vars in 1164 bytes} [Wed Aug 31 15:49:35 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:35.546718 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-0b173063-742e-450e-8f78-f8fe5f2a3017 req-887047c3-bc49-4a26-9c61-82f40b6009f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "848b21b2-98a0-4e70-a27c-08d390d73ae6", "tag": "dd829db9-9a09-4434-b55f-8bb2e13964a3"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:35.549885 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 77/188] 10.222.0.50 () {60 vars in 1164 bytes} [Wed Aug 31 15:49:35 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:35.559439 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9881e1ce-1941-4b7b-b291-078bb6ff0310 tempest-HostsAdminNegativeTestJSON-1782868351 tempest-HostsAdminNegativeTestJSON-1782868351-project-admin] Calling method '.version_select at 0x7fbb471a3160>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:35.581251 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-0b173063-742e-450e-8f78-f8fe5f2a3017 req-887047c3-bc49-4a26-9c61-82f40b6009f8 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:35.584525 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-0b173063-742e-450e-8f78-f8fe5f2a3017 req-887047c3-bc49-4a26-9c61-82f40b6009f8 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:35.585315 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-0b173063-742e-450e-8f78-f8fe5f2a3017 req-887047c3-bc49-4a26-9c61-82f40b6009f8 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:35.599460 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-9881e1ce-1941-4b7b-b291-078bb6ff0310 tempest-HostsAdminNegativeTestJSON-1782868351 tempest-HostsAdminNegativeTestJSON-1782868351-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 31 15:49:35.601484 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9881e1ce-1941-4b7b-b291-078bb6ff0310 tempest-HostsAdminNegativeTestJSON-1782868351 tempest-HostsAdminNegativeTestJSON-1782868351-project-admin] Request method failure captured: Aug 31 15:49:35.601484 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Aug 31 15:49:35.601484 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:49:35.601484 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:49:35.601484 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:49:35.601484 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:49:35.601484 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:49:35.601484 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:49:35.601484 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:49:35.601484 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:49:35.601484 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4MNJJRNsgEDtr-gJwpnPOtdSXYjZNbMKDAQRkkGXkmyrF-mbYJZgqHH0Ec7XQJU449rEceonbzv_7kQbnCmzfUgGy-VDRGjYhjorfV4V54fByD7oZ90cKIftJMb1Xim8WE0Y891xIdv6iBepOzgC1ZmUQ7ASujBfE4mQQY21MD7wAE Aug 31 15:49:35.601484 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:49:35.601484 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:49:35.601484 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:49:35.601484 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:49:35.601484 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:49:35.601484 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:49:35.601484 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 2b6469c21ad34bcab797fe3f53b282f2 Aug 31 15:49:35.601484 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1782868351 Aug 31 15:49:35.601484 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,admin,member Aug 31 15:49:35.601484 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,admin,member Aug 31 15:49:35.602850 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2b6469c21ad34bcab797fe3f53b282f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2b6469c21ad34bcab797fe3f53b282f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2b6469c21ad34bcab797fe3f53b282f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2b6469c21ad34bcab797fe3f53b282f2", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:49:35.602850 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1782868351 Aug 31 15:49:35.602850 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 2b6469c21ad34bcab797fe3f53b282f2 Aug 31 15:49:35.602850 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1782868351 Aug 31 15:49:35.602850 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-HostsAdminNegativeTestJSON-1782868351-project-admin Aug 31 15:49:35.602850 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:49:35.602850 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:49:35.602850 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: e14ebd4cbdb74d0b8562ab4ad4fe4147 Aug 31 15:49:35.602850 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1782868351-project-admin Aug 31 15:49:35.602850 n-d-833090-16 devstack@n-api.service[128863]: method: Aug 31 15:49:35.602850 n-d-833090-16 devstack@n-api.service[128863]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 31 15:49:35.602850 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'nonexistent_hostname'} Aug 31 15:49:35.602850 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:49:35.603714 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:35.603714 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 31 15:49:35.603714 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 31 15:49:35.603714 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 31 15:49:35.603714 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 31 15:49:35.603714 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:49:35.603714 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:49:35.603714 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:49:35.603714 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:49:35.603714 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 31 15:49:35.603714 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 31 15:49:35.603714 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 31 15:49:35.603714 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 31 15:49:35.603714 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 15:49:35.603714 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 15:49:35.603714 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 31 15:49:35.603714 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 31 15:49:35.603714 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 31 15:49:35.603714 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 31 15:49:35.604804 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 31 15:49:35.604804 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 31 15:49:35.604804 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 31 15:49:35.604804 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:35.604804 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:35.604804 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:35.604804 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:35.604804 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:35.604804 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:35.604804 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:49:35.604804 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:49:35.604804 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:49:35.604804 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:49:35.604804 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:49:35.604804 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:49:35.604804 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Aug 31 15:49:35.604804 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Aug 31 15:49:35.604804 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 31 15:49:35.604804 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:49:35.605974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 31 15:49:35.605974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:35.605974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:35.605974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:35.605974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:35.605974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:35.605974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:35.605974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:49:35.605974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:49:35.605974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 31 15:49:35.605974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:35.612731 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-0b173063-742e-450e-8f78-f8fe5f2a3017 req-887047c3-bc49-4a26-9c61-82f40b6009f8 service nova] Creating event network-changed:dd829db9-9a09-4434-b55f-8bb2e13964a3 for instance 848b21b2-98a0-4e70-a27c-08d390d73ae6 on n-h2-833090-16 Aug 31 15:49:35.615921 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9881e1ce-1941-4b7b-b291-078bb6ff0310 tempest-HostsAdminNegativeTestJSON-1782868351 tempest-HostsAdminNegativeTestJSON-1782868351-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:49:35.616984 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9881e1ce-1941-4b7b-b291-078bb6ff0310 tempest-HostsAdminNegativeTestJSON-1782868351 tempest-HostsAdminNegativeTestJSON-1782868351-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.062748 Aug 31 15:49:35.617585 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 78/189] 10.222.0.50 () {58 vars in 1218 bytes} [Wed Aug 31 15:49:35 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 15:49:35.632419 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e6d5ae6f-83e6-48cf-8b8c-ab102a8055c9 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:35.634136 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-0b173063-742e-450e-8f78-f8fe5f2a3017 req-887047c3-bc49-4a26-9c61-82f40b6009f8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084317 Aug 31 15:49:35.638400 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 112/190] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:35.656249 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8fc8713b-1083-45c6-9c8c-21c572c8d7b6 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-833090-16"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:35.657682 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e6d5ae6f-83e6-48cf-8b8c-ab102a8055c9 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 227 microversion: 2.1 time: 0.038749 Aug 31 15:49:35.659872 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 79/191] 10.222.0.50 () {58 vars in 1149 bytes} [Wed Aug 31 15:49:35 2022] GET /compute/v2.1/os-aggregates/9 => generated 227 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:35.675255 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-484212ff-9016-4bfa-ab6b-aae1a0eec3fb tempest-HostsAdminNegativeTestJSON-2031521559 tempest-HostsAdminNegativeTestJSON-2031521559-project] Calling method '.version_select at 0x7fbb471a30d0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:35.677200 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-484212ff-9016-4bfa-ab6b-aae1a0eec3fb tempest-HostsAdminNegativeTestJSON-2031521559 tempest-HostsAdminNegativeTestJSON-2031521559-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'b9ee2ffc379746cebc52ed7b164d5aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae922e02a2940028224ff8d78235fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:35.685514 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8fc8713b-1083-45c6-9c8c-21c572c8d7b6 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:35.687729 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8fc8713b-1083-45c6-9c8c-21c572c8d7b6 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:35.688214 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-484212ff-9016-4bfa-ab6b-aae1a0eec3fb tempest-HostsAdminNegativeTestJSON-2031521559 tempest-HostsAdminNegativeTestJSON-2031521559-project] Request method failure captured: Aug 31 15:49:35.688214 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/os-hosts/n-d-833090-16/startup HTTP/1.1 Aug 31 15:49:35.688214 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:49:35.688214 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:49:35.688214 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:49:35.688214 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:49:35.688214 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:49:35.688214 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:49:35.688214 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:49:35.688214 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:49:35.688214 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4MME-OAXfj8hT9XIp7fQnJePfXsDgdKWsiDIVObuE5NAyRN2alT98baIVyFlspEpP4q_Et8xRVgPLphA9-a89RJ54iS98aPHfUW5IXrU3C_NCHetSt1HXjQHwfnXtt8VDRuW0r2vEC3mz_6bY0xazxgwpMP-u5Pa1B__GYvAeT1HQA Aug 31 15:49:35.688214 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:49:35.688214 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:49:35.688214 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:49:35.688214 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:49:35.688214 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:49:35.688214 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:49:35.688214 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 8ae922e02a2940028224ff8d78235fd4 Aug 31 15:49:35.688214 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2031521559 Aug 31 15:49:35.688214 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:49:35.688214 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:49:35.689612 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8ae922e02a2940028224ff8d78235fd4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8ae922e02a2940028224ff8d78235fd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8ae922e02a2940028224ff8d78235fd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8ae922e02a2940028224ff8d78235fd4", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:49:35.689612 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2031521559 Aug 31 15:49:35.689612 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 8ae922e02a2940028224ff8d78235fd4 Aug 31 15:49:35.689612 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2031521559 Aug 31 15:49:35.689612 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-HostsAdminNegativeTestJSON-2031521559-project Aug 31 15:49:35.689612 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:49:35.689612 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:49:35.689612 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: b9ee2ffc379746cebc52ed7b164d5aaf Aug 31 15:49:35.689612 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2031521559-project Aug 31 15:49:35.689612 n-d-833090-16 devstack@n-api.service[128863]: method: Aug 31 15:49:35.689612 n-d-833090-16 devstack@n-api.service[128863]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 31 15:49:35.689612 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'n-d-833090-16'} Aug 31 15:49:35.689612 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:49:35.690595 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:35.690595 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:35.690595 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:35.690595 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:49:35.690595 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:49:35.690595 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:49:35.690595 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:49:35.690595 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:49:35.690595 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:49:35.690595 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Aug 31 15:49:35.690595 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Aug 31 15:49:35.690595 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 15:49:35.690595 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 15:49:35.690595 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 15:49:35.690595 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 15:49:35.690595 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:49:35.690595 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:49:35.690595 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:49:35.690595 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:49:35.691703 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 15:49:35.691703 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 15:49:35.691703 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 15:49:35.691703 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 15:49:35.691703 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 15:49:35.691703 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 15:49:35.691703 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 31 15:49:35.691703 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:35.691703 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:35.691703 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:35.691703 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:35.691703 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:35.691703 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:35.691703 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 15:49:35.691703 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 15:49:35.691703 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 31 15:49:35.691703 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:35.692810 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8fc8713b-1083-45c6-9c8c-21c572c8d7b6 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:35.694239 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-484212ff-9016-4bfa-ab6b-aae1a0eec3fb tempest-HostsAdminNegativeTestJSON-2031521559 tempest-HostsAdminNegativeTestJSON-2031521559-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:49:35.695260 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-484212ff-9016-4bfa-ab6b-aae1a0eec3fb tempest-HostsAdminNegativeTestJSON-2031521559 tempest-HostsAdminNegativeTestJSON-2031521559-project] 10.222.0.50 "GET /compute/v2.1/os-hosts/n-d-833090-16/startup" status: 403 len: 110 microversion: 2.1 time: 0.032138 Aug 31 15:49:35.696804 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 80/192] 10.222.0.50 () {58 vars in 1194 bytes} [Wed Aug 31 15:49:35 2022] GET /compute/v2.1/os-hosts/n-d-833090-16/startup => generated 110 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:49:35.706436 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9fe46ebe-23c7-4fae-a194-a15ddb9b9867 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:35.787918 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9fe46ebe-23c7-4fae-a194-a15ddb9b9867 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 265 microversion: 2.1 time: 0.086179 Aug 31 15:49:35.793143 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 81/193] 10.222.0.50 () {60 vars in 1191 bytes} [Wed Aug 31 15:49:35 2022] POST /compute/v2.1/os-aggregates/9/action => generated 265 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:35.809668 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-77a1f977-e9c5-4308-8831-b1d9fcadd535 tempest-HostsAdminNegativeTestJSON-1782868351 tempest-HostsAdminNegativeTestJSON-1782868351-project-admin] Calling method '.version_select at 0x7fbb471da3a0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:35.828615 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-77a1f977-e9c5-4308-8831-b1d9fcadd535 tempest-HostsAdminNegativeTestJSON-1782868351 tempest-HostsAdminNegativeTestJSON-1782868351-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 31 15:49:35.830745 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-77a1f977-e9c5-4308-8831-b1d9fcadd535 tempest-HostsAdminNegativeTestJSON-1782868351 tempest-HostsAdminNegativeTestJSON-1782868351-project-admin] Request method failure captured: Aug 31 15:49:35.830745 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Aug 31 15:49:35.830745 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:49:35.830745 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:49:35.830745 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:49:35.830745 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:49:35.830745 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:49:35.830745 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:49:35.830745 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:49:35.830745 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:49:35.830745 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4MNJJRNsgEDtr-gJwpnPOtdSXYjZNbMKDAQRkkGXkmyrF-mbYJZgqHH0Ec7XQJU449rEceonbzv_7kQbnCmzfUgGy-VDRGjYhjorfV4V54fByD7oZ90cKIftJMb1Xim8WE0Y891xIdv6iBepOzgC1ZmUQ7ASujBfE4mQQY21MD7wAE Aug 31 15:49:35.830745 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:49:35.830745 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:49:35.830745 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:49:35.830745 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:49:35.830745 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:49:35.830745 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:49:35.830745 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 2b6469c21ad34bcab797fe3f53b282f2 Aug 31 15:49:35.830745 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1782868351 Aug 31 15:49:35.830745 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,admin,member Aug 31 15:49:35.830745 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,admin,member Aug 31 15:49:35.832257 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2b6469c21ad34bcab797fe3f53b282f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2b6469c21ad34bcab797fe3f53b282f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2b6469c21ad34bcab797fe3f53b282f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2b6469c21ad34bcab797fe3f53b282f2", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:49:35.832257 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1782868351 Aug 31 15:49:35.832257 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 2b6469c21ad34bcab797fe3f53b282f2 Aug 31 15:49:35.832257 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1782868351 Aug 31 15:49:35.832257 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-HostsAdminNegativeTestJSON-1782868351-project-admin Aug 31 15:49:35.832257 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:49:35.832257 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:49:35.832257 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: e14ebd4cbdb74d0b8562ab4ad4fe4147 Aug 31 15:49:35.832257 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1782868351-project-admin Aug 31 15:49:35.832257 n-d-833090-16 devstack@n-api.service[128863]: method: Aug 31 15:49:35.832257 n-d-833090-16 devstack@n-api.service[128863]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 31 15:49:35.832257 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'nonexistent_hostname'} Aug 31 15:49:35.832257 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:49:35.833163 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:35.833163 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 31 15:49:35.833163 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 31 15:49:35.833163 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 31 15:49:35.833163 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 31 15:49:35.833163 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:49:35.833163 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:49:35.833163 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:49:35.833163 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:49:35.833163 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 31 15:49:35.833163 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 31 15:49:35.833163 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 31 15:49:35.833163 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 31 15:49:35.833163 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 15:49:35.833163 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 15:49:35.833163 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 31 15:49:35.833163 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 31 15:49:35.833163 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 31 15:49:35.833163 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 31 15:49:35.834622 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 31 15:49:35.834622 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 31 15:49:35.834622 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 31 15:49:35.834622 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:35.834622 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:35.834622 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:35.834622 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:35.834622 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:35.834622 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:35.834622 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:49:35.834622 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:49:35.834622 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:49:35.834622 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:49:35.834622 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:49:35.834622 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:49:35.834622 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Aug 31 15:49:35.834622 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Aug 31 15:49:35.834622 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 31 15:49:35.834622 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:49:35.836051 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 31 15:49:35.836051 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:35.836051 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:35.836051 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:35.836051 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:35.836051 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:35.836051 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:35.836051 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:49:35.836051 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:49:35.836051 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 31 15:49:35.836051 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:35.837258 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-77a1f977-e9c5-4308-8831-b1d9fcadd535 tempest-HostsAdminNegativeTestJSON-1782868351 tempest-HostsAdminNegativeTestJSON-1782868351-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:49:35.838993 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-77a1f977-e9c5-4308-8831-b1d9fcadd535 tempest-HostsAdminNegativeTestJSON-1782868351 tempest-HostsAdminNegativeTestJSON-1782868351-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.043144 Aug 31 15:49:35.840541 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 82/194] 10.222.0.50 () {58 vars in 1215 bytes} [Wed Aug 31 15:49:35 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 15:49:35.853055 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d997381d-96ea-448f-9e87-d6846b3837da tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:35.874011 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d997381d-96ea-448f-9e87-d6846b3837da tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 241 microversion: 2.1 time: 0.031155 Aug 31 15:49:35.878455 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 83/195] 10.222.0.50 () {58 vars in 1149 bytes} [Wed Aug 31 15:49:35 2022] GET /compute/v2.1/os-aggregates/9 => generated 241 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:35.893867 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f41eda36-d13f-41fc-917e-d5fe7eeccd4b tempest-HostsAdminNegativeTestJSON-1782868351 tempest-HostsAdminNegativeTestJSON-1782868351-project-admin] Action: 'update', calling method: .version_select at 0x7fbb471da9d0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:35.914876 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f41eda36-d13f-41fc-917e-d5fe7eeccd4b tempest-HostsAdminNegativeTestJSON-1782868351 tempest-HostsAdminNegativeTestJSON-1782868351-project-admin] Request method failure captured: Aug 31 15:49:35.914876 n-d-833090-16 devstack@n-api.service[128863]: request: PUT /compute/v2.1/os-hosts/n-d-833090-16 HTTP/1.1 Aug 31 15:49:35.914876 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:49:35.914876 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:49:35.914876 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:49:35.914876 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 51 Aug 31 15:49:35.914876 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:49:35.914876 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:49:35.914876 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:49:35.914876 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:49:35.914876 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4MNJJRNsgEDtr-gJwpnPOtdSXYjZNbMKDAQRkkGXkmyrF-mbYJZgqHH0Ec7XQJU449rEceonbzv_7kQbnCmzfUgGy-VDRGjYhjorfV4V54fByD7oZ90cKIftJMb1Xim8WE0Y891xIdv6iBepOzgC1ZmUQ7ASujBfE4mQQY21MD7wAE Aug 31 15:49:35.914876 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:49:35.914876 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:49:35.914876 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:49:35.914876 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:49:35.914876 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:49:35.914876 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:49:35.914876 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 2b6469c21ad34bcab797fe3f53b282f2 Aug 31 15:49:35.914876 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1782868351 Aug 31 15:49:35.914876 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,admin,member Aug 31 15:49:35.914876 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,admin,member Aug 31 15:49:35.916482 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2b6469c21ad34bcab797fe3f53b282f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2b6469c21ad34bcab797fe3f53b282f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2b6469c21ad34bcab797fe3f53b282f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2b6469c21ad34bcab797fe3f53b282f2", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:49:35.916482 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1782868351 Aug 31 15:49:35.916482 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 2b6469c21ad34bcab797fe3f53b282f2 Aug 31 15:49:35.916482 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1782868351 Aug 31 15:49:35.916482 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-HostsAdminNegativeTestJSON-1782868351-project-admin Aug 31 15:49:35.916482 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:49:35.916482 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:49:35.916482 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: e14ebd4cbdb74d0b8562ab4ad4fe4147 Aug 31 15:49:35.916482 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1782868351-project-admin Aug 31 15:49:35.916482 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 15:49:35.916482 n-d-833090-16 devstack@n-api.service[128863]: {"status": "enable", "maintenance_mode": "invalid"} Aug 31 15:49:35.916482 n-d-833090-16 devstack@n-api.service[128863]: method: Aug 31 15:49:35.916482 n-d-833090-16 devstack@n-api.service[128863]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 31 15:49:35.917200 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'n-d-833090-16', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Aug 31 15:49:35.917200 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:49:35.917200 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:35.917200 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 15:49:35.917200 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 15:49:35.917200 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 15:49:35.917200 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise error Aug 31 15:49:35.917200 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 31 15:49:35.917200 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:35.917200 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Aug 31 15:49:35.917200 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 31 15:49:35.917200 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'disable', Aug 31 15:49:35.917200 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'Enable', Aug 31 15:49:35.917200 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'Disable', Aug 31 15:49:35.917200 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 31 15:49:35.917200 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 31 15:49:35.917200 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 31 15:49:35.917200 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:35.917200 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi On instance: Aug 31 15:49:35.917200 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'invalid' Aug 31 15:49:35.917200 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:35.917200 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:35.917200 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:35.917200 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:35.917200 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:35.921649 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:35.921649 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:49:35.921649 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:49:35.921649 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:49:35.921649 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:49:35.921649 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:49:35.921649 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:49:35.921649 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 15:49:35.921649 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 15:49:35.921649 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 15:49:35.921649 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 15:49:35.921649 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 15:49:35.921649 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 15:49:35.921649 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 31 15:49:35.921649 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:35.921649 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:35.921649 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:35.921649 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:35.921649 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:35.923129 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:35.923129 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 15:49:35.923129 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 15:49:35.923129 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 31 15:49:35.923129 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:35.923129 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f41eda36-d13f-41fc-917e-d5fe7eeccd4b tempest-HostsAdminNegativeTestJSON-1782868351 tempest-HostsAdminNegativeTestJSON-1782868351-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:49:35.923129 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f41eda36-d13f-41fc-917e-d5fe7eeccd4b tempest-HostsAdminNegativeTestJSON-1782868351 tempest-HostsAdminNegativeTestJSON-1782868351-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-hosts/n-d-833090-16" status: 400 len: 199 microversion: 2.1 time: 0.037347 Aug 31 15:49:35.925975 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 84/196] 10.222.0.50 () {60 vars in 1190 bytes} [Wed Aug 31 15:49:35 2022] PUT /compute/v2.1/os-hosts/n-d-833090-16 => generated 199 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 15:49:35.929974 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8fc8713b-1083-45c6-9c8c-21c572c8d7b6 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 243 microversion: 2.1 time: 0.288971 Aug 31 15:49:35.930963 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 113/197] 10.222.0.50 () {60 vars in 1191 bytes} [Wed Aug 31 15:49:35 2022] POST /compute/v2.1/os-aggregates/8/action => generated 243 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:35.940281 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9e1ad776-e0b3-48ae-ac3d-6264b2b10d58 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:35.944623 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-df17301c-574e-43a0-9ccb-14e856ca3d3a tempest-HostsAdminNegativeTestJSON-1782868351 tempest-HostsAdminNegativeTestJSON-1782868351-project-admin] Action: 'update', calling method: .version_select at 0x7fbb476075e0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:35.950990 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-df17301c-574e-43a0-9ccb-14e856ca3d3a tempest-HostsAdminNegativeTestJSON-1782868351 tempest-HostsAdminNegativeTestJSON-1782868351-project-admin] Request method failure captured: Aug 31 15:49:35.950990 n-d-833090-16 devstack@n-api.service[128864]: request: PUT /compute/v2.1/os-hosts/n-d-833090-16 HTTP/1.1 Aug 31 15:49:35.950990 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:49:35.950990 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:49:35.950990 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:49:35.950990 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 51 Aug 31 15:49:35.950990 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:49:35.950990 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:49:35.950990 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:49:35.950990 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:49:35.950990 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4MNJJRNsgEDtr-gJwpnPOtdSXYjZNbMKDAQRkkGXkmyrF-mbYJZgqHH0Ec7XQJU449rEceonbzv_7kQbnCmzfUgGy-VDRGjYhjorfV4V54fByD7oZ90cKIftJMb1Xim8WE0Y891xIdv6iBepOzgC1ZmUQ7ASujBfE4mQQY21MD7wAE Aug 31 15:49:35.950990 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:49:35.950990 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:49:35.950990 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:49:35.950990 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:49:35.950990 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:49:35.950990 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:49:35.950990 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 2b6469c21ad34bcab797fe3f53b282f2 Aug 31 15:49:35.950990 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1782868351 Aug 31 15:49:35.950990 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,admin,member Aug 31 15:49:35.950990 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,admin,member Aug 31 15:49:35.952704 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2b6469c21ad34bcab797fe3f53b282f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2b6469c21ad34bcab797fe3f53b282f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2b6469c21ad34bcab797fe3f53b282f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2b6469c21ad34bcab797fe3f53b282f2", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:49:35.952704 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1782868351 Aug 31 15:49:35.952704 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 2b6469c21ad34bcab797fe3f53b282f2 Aug 31 15:49:35.952704 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1782868351 Aug 31 15:49:35.952704 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-HostsAdminNegativeTestJSON-1782868351-project-admin Aug 31 15:49:35.952704 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:49:35.952704 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:49:35.952704 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: e14ebd4cbdb74d0b8562ab4ad4fe4147 Aug 31 15:49:35.952704 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1782868351-project-admin Aug 31 15:49:35.952704 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 15:49:35.952704 n-d-833090-16 devstack@n-api.service[128864]: {"status": "invalid", "maintenance_mode": "enable"} Aug 31 15:49:35.952704 n-d-833090-16 devstack@n-api.service[128864]: method: Aug 31 15:49:35.952704 n-d-833090-16 devstack@n-api.service[128864]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 31 15:49:35.953587 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'n-d-833090-16', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Aug 31 15:49:35.953587 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:49:35.953587 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:35.953587 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 15:49:35.953587 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 15:49:35.953587 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 15:49:35.953587 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise error Aug 31 15:49:35.953587 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 31 15:49:35.953587 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:35.953587 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Aug 31 15:49:35.953587 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 31 15:49:35.953587 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi 'disable', Aug 31 15:49:35.953587 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi 'Enable', Aug 31 15:49:35.953587 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi 'Disable', Aug 31 15:49:35.953587 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 31 15:49:35.953587 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 31 15:49:35.953587 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 31 15:49:35.953587 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:35.953587 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi On instance: Aug 31 15:49:35.953587 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi 'invalid' Aug 31 15:49:35.953587 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:35.953587 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:35.953587 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:35.953587 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:35.953587 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:35.956381 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:35.956381 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:49:35.956381 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:49:35.956381 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:49:35.956381 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:49:35.956381 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:49:35.956381 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:49:35.956381 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 15:49:35.956381 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 15:49:35.956381 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 15:49:35.956381 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 15:49:35.956381 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 15:49:35.956381 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 15:49:35.956381 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 31 15:49:35.956381 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:35.956381 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:35.956381 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:35.956381 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:35.956381 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:35.960964 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:35.960964 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 15:49:35.960964 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 15:49:35.960964 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 31 15:49:35.960964 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:35.963540 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-df17301c-574e-43a0-9ccb-14e856ca3d3a tempest-HostsAdminNegativeTestJSON-1782868351 tempest-HostsAdminNegativeTestJSON-1782868351-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:49:35.965312 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-df17301c-574e-43a0-9ccb-14e856ca3d3a tempest-HostsAdminNegativeTestJSON-1782868351 tempest-HostsAdminNegativeTestJSON-1782868351-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-hosts/n-d-833090-16" status: 400 len: 189 microversion: 2.1 time: 0.033125 Aug 31 15:49:35.966576 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 114/198] 10.222.0.50 () {60 vars in 1190 bytes} [Wed Aug 31 15:49:35 2022] PUT /compute/v2.1/os-hosts/n-d-833090-16 => generated 189 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 15:49:35.975751 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a39161f2-250c-45d1-b6aa-49765ea8d9b5 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-833090-16"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:35.995074 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a39161f2-250c-45d1-b6aa-49765ea8d9b5 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:35.995770 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a39161f2-250c-45d1-b6aa-49765ea8d9b5 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:35.996498 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a39161f2-250c-45d1-b6aa-49765ea8d9b5 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:36.016911 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9e1ad776-e0b3-48ae-ac3d-6264b2b10d58 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.084382 Aug 31 15:49:36.019257 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 85/199] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Aug 31 15:49:35 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 31 15:49:36.039502 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e0b158fc-3231-4464-86b4-89de87e0fda7 tempest-HostsAdminNegativeTestJSON-2031521559 tempest-HostsAdminNegativeTestJSON-2031521559-project] Action: 'update', calling method: .version_select at 0x7fbb471daaf0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:36.059327 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e0b158fc-3231-4464-86b4-89de87e0fda7 tempest-HostsAdminNegativeTestJSON-2031521559 tempest-HostsAdminNegativeTestJSON-2031521559-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'b9ee2ffc379746cebc52ed7b164d5aaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae922e02a2940028224ff8d78235fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:36.068046 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e0b158fc-3231-4464-86b4-89de87e0fda7 tempest-HostsAdminNegativeTestJSON-2031521559 tempest-HostsAdminNegativeTestJSON-2031521559-project] Request method failure captured: Aug 31 15:49:36.068046 n-d-833090-16 devstack@n-api.service[128863]: request: PUT /compute/v2.1/os-hosts/n-d-833090-16 HTTP/1.1 Aug 31 15:49:36.068046 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:49:36.068046 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:49:36.068046 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:49:36.068046 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 50 Aug 31 15:49:36.068046 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:49:36.068046 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:49:36.068046 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:49:36.068046 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:49:36.068046 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4MME-OAXfj8hT9XIp7fQnJePfXsDgdKWsiDIVObuE5NAyRN2alT98baIVyFlspEpP4q_Et8xRVgPLphA9-a89RJ54iS98aPHfUW5IXrU3C_NCHetSt1HXjQHwfnXtt8VDRuW0r2vEC3mz_6bY0xazxgwpMP-u5Pa1B__GYvAeT1HQA Aug 31 15:49:36.068046 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:49:36.068046 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:49:36.068046 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:49:36.068046 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:49:36.068046 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:49:36.068046 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:49:36.068046 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 8ae922e02a2940028224ff8d78235fd4 Aug 31 15:49:36.068046 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2031521559 Aug 31 15:49:36.068046 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:49:36.068046 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:49:36.069505 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8ae922e02a2940028224ff8d78235fd4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8ae922e02a2940028224ff8d78235fd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8ae922e02a2940028224ff8d78235fd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8ae922e02a2940028224ff8d78235fd4", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:49:36.069505 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2031521559 Aug 31 15:49:36.069505 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 8ae922e02a2940028224ff8d78235fd4 Aug 31 15:49:36.069505 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2031521559 Aug 31 15:49:36.069505 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-HostsAdminNegativeTestJSON-2031521559-project Aug 31 15:49:36.069505 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:49:36.069505 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:49:36.069505 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: b9ee2ffc379746cebc52ed7b164d5aaf Aug 31 15:49:36.069505 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2031521559-project Aug 31 15:49:36.069505 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 15:49:36.069505 n-d-833090-16 devstack@n-api.service[128863]: {"status": "enable", "maintenance_mode": "enable"} Aug 31 15:49:36.069505 n-d-833090-16 devstack@n-api.service[128863]: method: Aug 31 15:49:36.069505 n-d-833090-16 devstack@n-api.service[128863]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 31 15:49:36.069505 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'n-d-833090-16', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 31 15:49:36.070474 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:49:36.070474 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:36.070474 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:36.070474 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:36.070474 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:49:36.070474 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:49:36.070474 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:49:36.070474 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:49:36.070474 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:49:36.070474 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:49:36.070474 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:49:36.070474 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:49:36.070474 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Aug 31 15:49:36.070474 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Aug 31 15:49:36.070474 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 15:49:36.070474 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 15:49:36.070474 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 15:49:36.070474 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 15:49:36.070474 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:49:36.070474 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:49:36.071857 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:49:36.071857 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:49:36.071857 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 15:49:36.071857 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 15:49:36.071857 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 15:49:36.071857 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 15:49:36.071857 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 15:49:36.071857 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 15:49:36.071857 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 31 15:49:36.071857 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:36.071857 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:36.071857 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:36.071857 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:36.071857 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:36.071857 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:36.071857 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 15:49:36.071857 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 15:49:36.071857 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 31 15:49:36.071857 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:36.073108 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e0b158fc-3231-4464-86b4-89de87e0fda7 tempest-HostsAdminNegativeTestJSON-2031521559 tempest-HostsAdminNegativeTestJSON-2031521559-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:49:36.073108 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e0b158fc-3231-4464-86b4-89de87e0fda7 tempest-HostsAdminNegativeTestJSON-2031521559 tempest-HostsAdminNegativeTestJSON-2031521559-project] 10.222.0.50 "PUT /compute/v2.1/os-hosts/n-d-833090-16" status: 403 len: 111 microversion: 2.1 time: 0.049107 Aug 31 15:49:36.077990 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 86/200] 10.222.0.50 () {60 vars in 1190 bytes} [Wed Aug 31 15:49:36 2022] PUT /compute/v2.1/os-hosts/n-d-833090-16 => generated 111 bytes in 55 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:49:36.090234 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6b374a41-86ba-499c-92fe-1d383dd17f78 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1469348421", "availability_zone": "tempest-test_az-1345981665"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:36.095617 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-a39161f2-250c-45d1-b6aa-49765ea8d9b5 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] HTTP exception thrown: Aggregate 8 already has host n-h1-833090-16. Aug 31 15:49:36.134725 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a39161f2-250c-45d1-b6aa-49765ea8d9b5 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Request method failure captured: Aug 31 15:49:36.134725 n-d-833090-16 devstack@n-api.service[128864]: request: POST /compute/v2.1/os-aggregates/8/action HTTP/1.1 Aug 31 15:49:36.134725 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:49:36.134725 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:49:36.134725 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:49:36.134725 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 40 Aug 31 15:49:36.134725 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:49:36.134725 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:49:36.134725 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:49:36.134725 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:49:36.134725 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4Lk3esfAPKc65t_nvTRGKegL6t97spK7u6iOZvCDDIhprzOGX96flC0EzFbJkIF5_qJGP-pD_qmJ7xAVnxlGC3Qu6aPNObBZjPmfyNqhvAyrnsg7jKQ0SqOb7J2ZHIIFO8ooJKhnG-5SvdeYWYsyP2tB9v_K_ARPJuvIwrCjlecflY Aug 31 15:49:36.134725 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:49:36.134725 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:49:36.134725 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:49:36.134725 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:49:36.134725 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:49:36.134725 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:49:36.134725 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: cd14c575cc574d65adcfe4df7bb170c1 Aug 31 15:49:36.134725 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1561922880 Aug 31 15:49:36.134725 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,admin,member Aug 31 15:49:36.134725 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,admin,member Aug 31 15:49:36.136734 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cd14c575cc574d65adcfe4df7bb170c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cd14c575cc574d65adcfe4df7bb170c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cd14c575cc574d65adcfe4df7bb170c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cd14c575cc574d65adcfe4df7bb170c1", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:49:36.136734 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1561922880 Aug 31 15:49:36.136734 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: cd14c575cc574d65adcfe4df7bb170c1 Aug 31 15:49:36.136734 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1561922880 Aug 31 15:49:36.136734 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin Aug 31 15:49:36.136734 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:49:36.136734 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:49:36.136734 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 4c54901aa14a48e8a8c007a0d01804b2 Aug 31 15:49:36.136734 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin Aug 31 15:49:36.136734 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 15:49:36.136734 n-d-833090-16 devstack@n-api.service[128864]: {"add_host": {"host": "n-h1-833090-16"}} Aug 31 15:49:36.136734 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:49:36.136734 n-d-833090-16 devstack@n-api.service[128864]: exception: Aggregate 8 already has host n-h1-833090-16. Aug 31 15:49:36.137695 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '8', 'body': {'add_host': {'host': 'n-h1-833090-16'}}} Aug 31 15:49:36.137695 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:49:36.137695 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:36.137695 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 15:49:36.137695 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 31 15:49:36.137695 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 15:49:36.137695 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 31 15:49:36.137695 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 15:49:36.137695 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 31 15:49:36.137695 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 15:49:36.137695 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 31 15:49:36.137695 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 15:49:36.137695 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 15:49:36.137695 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 15:49:36.137695 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result.read() Aug 31 15:49:36.137695 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 15:49:36.137695 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 31 15:49:36.137695 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 15:49:36.137695 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 31 15:49:36.139954 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 15:49:36.139954 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 31 15:49:36.139954 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 15:49:36.139954 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 31 15:49:36.139954 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-833090-16-8' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 31 15:49:36.139954 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:36.139954 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 31 15:49:36.139954 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:36.139954 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:36.139954 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Aug 31 15:49:36.139954 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Aug 31 15:49:36.139954 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 31 15:49:36.139954 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi session.flush() Aug 31 15:49:36.139954 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 15:49:36.139954 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 31 15:49:36.139954 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 15:49:36.139954 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 31 15:49:36.139954 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 15:49:36.139954 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 31 15:49:36.142146 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 15:49:36.142146 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception Aug 31 15:49:36.142146 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 15:49:36.142146 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 31 15:49:36.142146 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 15:49:36.142146 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 31 15:49:36.142146 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 15:49:36.142146 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 31 15:49:36.142146 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 15:49:36.142146 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 31 15:49:36.142146 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 31 15:49:36.142146 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 31 15:49:36.142146 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 15:49:36.142146 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 15:49:36.142146 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 15:49:36.142146 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 31 15:49:36.142146 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 15:49:36.142146 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 31 15:49:36.143795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 15:49:36.143795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 31 15:49:36.143795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 15:49:36.143795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 15:49:36.143795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 15:49:36.143795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception Aug 31 15:49:36.143795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 15:49:36.143795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 31 15:49:36.143795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 15:49:36.143795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 31 15:49:36.143795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 15:49:36.143795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 31 15:49:36.143795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 15:49:36.143795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 31 15:49:36.143795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 15:49:36.143795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 15:49:36.143795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 15:49:36.143795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result.read() Aug 31 15:49:36.148149 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 15:49:36.148149 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 31 15:49:36.148149 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 15:49:36.148149 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 31 15:49:36.148149 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 15:49:36.148149 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 31 15:49:36.148149 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 15:49:36.148149 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 31 15:49:36.148149 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-833090-16-8' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 31 15:49:36.148149 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Aug 31 15:49:36.148149 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 31, 15, 49, 36, 74390), 'updated_at': None, 'host': 'n-h1-833090-16', 'aggregate_id': 8}] Aug 31 15:49:36.148149 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 15:49:36.148149 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:36.148149 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:36.148149 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:36.148149 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:36.148149 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 31 15:49:36.149980 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 31 15:49:36.149980 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 31 15:49:36.149980 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 31 15:49:36.149980 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:49:36.149980 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:49:36.149980 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:49:36.149980 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:49:36.149980 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 31 15:49:36.149980 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 31 15:49:36.149980 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6639, in add_host_to_aggregate Aug 31 15:49:36.149980 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Aug 31 15:49:36.149980 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 31 15:49:36.149980 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 31 15:49:36.149980 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Aug 31 15:49:36.149980 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Aug 31 15:49:36.149980 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Aug 31 15:49:36.149980 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Aug 31 15:49:36.149980 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 8 already has host n-h1-833090-16. Aug 31 15:49:36.149980 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:36.149980 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:36.152748 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:36.152748 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:36.152748 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:36.152748 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:36.152748 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:49:36.152748 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:49:36.152748 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:49:36.152748 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:49:36.152748 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:49:36.152748 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:49:36.152748 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Aug 31 15:49:36.152748 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 31 15:49:36.152748 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 8 already has host n-h1-833090-16. Aug 31 15:49:36.152748 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:36.152748 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:36.152748 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:36.152748 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:36.152748 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:36.152748 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:36.152748 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:49:36.152748 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:49:36.155147 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 8 already has host n-h1-833090-16. Aug 31 15:49:36.155147 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:36.155147 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a39161f2-250c-45d1-b6aa-49765ea8d9b5 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Returning 409 to user: Aggregate 8 already has host n-h1-833090-16. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:49:36.155147 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a39161f2-250c-45d1-b6aa-49765ea8d9b5 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/8/action" status: 409 len: 96 microversion: 2.1 time: 0.170537 Aug 31 15:49:36.155147 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 115/201] 10.222.0.50 () {60 vars in 1191 bytes} [Wed Aug 31 15:49:35 2022] POST /compute/v2.1/os-aggregates/8/action => generated 96 bytes in 174 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Aug 31 15:49:36.156426 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.aggregate [None req-6b374a41-86ba-499c-92fe-1d383dd17f78 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Generated uuid 11bf66e8-7b15-460a-9e17-80e0519c2d3b for aggregate {{(pid=128863) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 31 15:49:36.160424 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-92a708c0-7c14-49a4-88a9-e9b758764a0d tempest-HostsAdminNegativeTestJSON-1782868351 tempest-HostsAdminNegativeTestJSON-1782868351-project-admin] Action: 'update', calling method: .version_select at 0x7fbb47118040>, body: {"status": null, "maintenance_mode": null} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:36.173371 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-92a708c0-7c14-49a4-88a9-e9b758764a0d tempest-HostsAdminNegativeTestJSON-1782868351 tempest-HostsAdminNegativeTestJSON-1782868351-project-admin] Request method failure captured: Aug 31 15:49:36.173371 n-d-833090-16 devstack@n-api.service[128864]: request: PUT /compute/v2.1/os-hosts/n-d-833090-16 HTTP/1.1 Aug 31 15:49:36.173371 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:49:36.173371 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:49:36.173371 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:49:36.173371 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 42 Aug 31 15:49:36.173371 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:49:36.173371 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:49:36.173371 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:49:36.173371 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:49:36.173371 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4MNJJRNsgEDtr-gJwpnPOtdSXYjZNbMKDAQRkkGXkmyrF-mbYJZgqHH0Ec7XQJU449rEceonbzv_7kQbnCmzfUgGy-VDRGjYhjorfV4V54fByD7oZ90cKIftJMb1Xim8WE0Y891xIdv6iBepOzgC1ZmUQ7ASujBfE4mQQY21MD7wAE Aug 31 15:49:36.173371 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:49:36.173371 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:49:36.173371 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:49:36.173371 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:49:36.173371 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:49:36.173371 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:49:36.173371 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 2b6469c21ad34bcab797fe3f53b282f2 Aug 31 15:49:36.173371 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1782868351 Aug 31 15:49:36.173371 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,admin,member Aug 31 15:49:36.173371 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,admin,member Aug 31 15:49:36.174673 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2b6469c21ad34bcab797fe3f53b282f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2b6469c21ad34bcab797fe3f53b282f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2b6469c21ad34bcab797fe3f53b282f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2b6469c21ad34bcab797fe3f53b282f2", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:49:36.174673 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1782868351 Aug 31 15:49:36.174673 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 2b6469c21ad34bcab797fe3f53b282f2 Aug 31 15:49:36.174673 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1782868351 Aug 31 15:49:36.174673 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-HostsAdminNegativeTestJSON-1782868351-project-admin Aug 31 15:49:36.174673 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:49:36.174673 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:49:36.174673 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: e14ebd4cbdb74d0b8562ab4ad4fe4147 Aug 31 15:49:36.174673 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1782868351-project-admin Aug 31 15:49:36.174673 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 15:49:36.174673 n-d-833090-16 devstack@n-api.service[128864]: {"status": null, "maintenance_mode": null} Aug 31 15:49:36.174673 n-d-833090-16 devstack@n-api.service[128864]: method: Aug 31 15:49:36.174673 n-d-833090-16 devstack@n-api.service[128864]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 31 15:49:36.174673 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'n-d-833090-16', 'body': {'status': None, 'maintenance_mode': None}} Aug 31 15:49:36.175583 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:49:36.175583 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:36.175583 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 15:49:36.175583 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 15:49:36.175583 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 15:49:36.175583 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise error Aug 31 15:49:36.175583 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Aug 31 15:49:36.175583 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:36.175583 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Aug 31 15:49:36.175583 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 31 15:49:36.175583 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi 'disable', Aug 31 15:49:36.175583 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi 'Enable', Aug 31 15:49:36.175583 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi 'Disable', Aug 31 15:49:36.175583 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 31 15:49:36.175583 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 31 15:49:36.175583 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 31 15:49:36.175583 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:36.175583 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi On instance: Aug 31 15:49:36.175583 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi None Aug 31 15:49:36.175583 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:36.175583 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:36.175583 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:36.175583 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:36.175583 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:36.175583 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:36.176921 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:49:36.176921 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:49:36.176921 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:49:36.176921 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:49:36.176921 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:49:36.176921 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:49:36.176921 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 15:49:36.176921 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 15:49:36.176921 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 15:49:36.176921 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 15:49:36.176921 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 15:49:36.176921 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 15:49:36.176921 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 31 15:49:36.176921 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:36.176921 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:36.176921 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:36.176921 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:36.176921 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:36.176921 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:36.178023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 15:49:36.178023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 15:49:36.178023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 31 15:49:36.178023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:36.178023 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-92a708c0-7c14-49a4-88a9-e9b758764a0d tempest-HostsAdminNegativeTestJSON-1782868351 tempest-HostsAdminNegativeTestJSON-1782868351-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:49:36.178023 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-92a708c0-7c14-49a4-88a9-e9b758764a0d tempest-HostsAdminNegativeTestJSON-1782868351 tempest-HostsAdminNegativeTestJSON-1782868351-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-hosts/n-d-833090-16" status: 400 len: 127 microversion: 2.1 time: 0.031466 Aug 31 15:49:36.178023 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 116/202] 10.222.0.50 () {60 vars in 1190 bytes} [Wed Aug 31 15:49:36 2022] PUT /compute/v2.1/os-hosts/n-d-833090-16 => generated 127 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 15:49:36.193981 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9113363e-af3f-4c47-a687-ff6d73b43b3e tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-833090-16"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:36.220144 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9113363e-af3f-4c47-a687-ff6d73b43b3e tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:36.220646 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9113363e-af3f-4c47-a687-ff6d73b43b3e tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:36.222281 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9113363e-af3f-4c47-a687-ff6d73b43b3e tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:36.242640 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6b374a41-86ba-499c-92fe-1d383dd17f78 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.150864 Aug 31 15:49:36.242640 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 87/203] 10.222.0.50 () {60 vars in 1165 bytes} [Wed Aug 31 15:49:36 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:36.254483 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-33e51c18-2b03-46f3-abba-ea0c97b3598b tempest-HostsAdminNegativeTestJSON-1782868351 tempest-HostsAdminNegativeTestJSON-1782868351-project-admin] Action: 'update', calling method: .version_select at 0x7fbb47797160>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:36.267488 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.hosts [None req-33e51c18-2b03-46f3-abba-ea0c97b3598b tempest-HostsAdminNegativeTestJSON-1782868351 tempest-HostsAdminNegativeTestJSON-1782868351-project-admin] Enabling host nonexistent_hostname. Aug 31 15:49:36.287776 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-33e51c18-2b03-46f3-abba-ea0c97b3598b tempest-HostsAdminNegativeTestJSON-1782868351 tempest-HostsAdminNegativeTestJSON-1782868351-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 31 15:49:36.289817 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-33e51c18-2b03-46f3-abba-ea0c97b3598b tempest-HostsAdminNegativeTestJSON-1782868351 tempest-HostsAdminNegativeTestJSON-1782868351-project-admin] Request method failure captured: Aug 31 15:49:36.289817 n-d-833090-16 devstack@n-api.service[128863]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 31 15:49:36.289817 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:49:36.289817 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:49:36.289817 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:49:36.289817 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 50 Aug 31 15:49:36.289817 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:49:36.289817 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:49:36.289817 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:49:36.289817 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:49:36.289817 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4MNJJRNsgEDtr-gJwpnPOtdSXYjZNbMKDAQRkkGXkmyrF-mbYJZgqHH0Ec7XQJU449rEceonbzv_7kQbnCmzfUgGy-VDRGjYhjorfV4V54fByD7oZ90cKIftJMb1Xim8WE0Y891xIdv6iBepOzgC1ZmUQ7ASujBfE4mQQY21MD7wAE Aug 31 15:49:36.289817 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:49:36.289817 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:49:36.289817 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:49:36.289817 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:49:36.289817 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:49:36.289817 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:49:36.289817 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 2b6469c21ad34bcab797fe3f53b282f2 Aug 31 15:49:36.289817 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1782868351 Aug 31 15:49:36.289817 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,admin,member Aug 31 15:49:36.289817 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,admin,member Aug 31 15:49:36.291265 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2b6469c21ad34bcab797fe3f53b282f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2b6469c21ad34bcab797fe3f53b282f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2b6469c21ad34bcab797fe3f53b282f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2b6469c21ad34bcab797fe3f53b282f2", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:49:36.291265 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1782868351 Aug 31 15:49:36.291265 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 2b6469c21ad34bcab797fe3f53b282f2 Aug 31 15:49:36.291265 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1782868351 Aug 31 15:49:36.291265 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-HostsAdminNegativeTestJSON-1782868351-project-admin Aug 31 15:49:36.291265 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:49:36.291265 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:49:36.291265 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: e14ebd4cbdb74d0b8562ab4ad4fe4147 Aug 31 15:49:36.291265 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1782868351-project-admin Aug 31 15:49:36.291265 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 15:49:36.291265 n-d-833090-16 devstack@n-api.service[128863]: {"status": "enable", "maintenance_mode": "enable"} Aug 31 15:49:36.291265 n-d-833090-16 devstack@n-api.service[128863]: method: Aug 31 15:49:36.291265 n-d-833090-16 devstack@n-api.service[128863]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 31 15:49:36.291265 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 31 15:49:36.292024 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:49:36.292024 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:36.292024 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Aug 31 15:49:36.292024 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Aug 31 15:49:36.292024 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 31 15:49:36.292024 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 31 15:49:36.292024 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:49:36.292024 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:49:36.292024 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:49:36.292024 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:49:36.292024 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 31 15:49:36.292024 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 31 15:49:36.292024 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 31 15:49:36.292024 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 31 15:49:36.292024 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 15:49:36.292024 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 15:49:36.292024 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 31 15:49:36.292024 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 31 15:49:36.292960 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 31 15:49:36.292960 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 31 15:49:36.292960 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 31 15:49:36.292960 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 31 15:49:36.292960 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 31 15:49:36.292960 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:36.292960 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:36.292960 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:36.292960 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:36.292960 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:36.292960 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:36.292960 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:49:36.292960 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:49:36.292960 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:49:36.292960 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:49:36.292960 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:49:36.292960 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:49:36.292960 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:49:36.292960 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:49:36.292960 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Aug 31 15:49:36.294000 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Aug 31 15:49:36.294000 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Aug 31 15:49:36.294000 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:49:36.294000 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 31 15:49:36.294000 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:36.294000 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:36.294000 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:36.294000 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:36.294000 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:36.294000 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:36.294000 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:49:36.294000 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:49:36.294000 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 31 15:49:36.294000 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:36.297454 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-33e51c18-2b03-46f3-abba-ea0c97b3598b tempest-HostsAdminNegativeTestJSON-1782868351 tempest-HostsAdminNegativeTestJSON-1782868351-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:49:36.298649 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-33e51c18-2b03-46f3-abba-ea0c97b3598b tempest-HostsAdminNegativeTestJSON-1782868351 tempest-HostsAdminNegativeTestJSON-1782868351-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.056314 Aug 31 15:49:36.303754 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 88/204] 10.222.0.50 () {60 vars in 1211 bytes} [Wed Aug 31 15:49:36 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 15:49:36.311028 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d891d669-bdba-44cd-9068-85cecf883c5e tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:36.311962 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d891d669-bdba-44cd-9068-85cecf883c5e tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 848b21b2-98a0-4e70-a27c-08d390d73ae6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:36.319072 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d891d669-bdba-44cd-9068-85cecf883c5e tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:36.319819 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d891d669-bdba-44cd-9068-85cecf883c5e tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:36.320510 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d891d669-bdba-44cd-9068-85cecf883c5e tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:36.321419 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d891d669-bdba-44cd-9068-85cecf883c5e tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:36.322082 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d891d669-bdba-44cd-9068-85cecf883c5e tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:36.322722 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d891d669-bdba-44cd-9068-85cecf883c5e tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:36.456279 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9113363e-af3f-4c47-a687-ff6d73b43b3e tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 227 microversion: 2.1 time: 0.272103 Aug 31 15:49:36.459386 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 117/205] 10.222.0.50 () {60 vars in 1191 bytes} [Wed Aug 31 15:49:36 2022] POST /compute/v2.1/os-aggregates/8/action => generated 227 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:36.479700 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d54620c2-8224-4d21-a910-12b0be60da14 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1469348421_new", "availability_zone": "tempest-test_az-1345981665_new"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:36.508997 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=8,nova_api:DELETE=7,nova_api:UPDATE=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:49:36.586708 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d54620c2-8224-4d21-a910-12b0be60da14 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:36.596213 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d54620c2-8224-4d21-a910-12b0be60da14 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:36.596213 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d54620c2-8224-4d21-a910-12b0be60da14 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:36.706481 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d54620c2-8224-4d21-a910-12b0be60da14 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-aggregates/10" status: 200 len: 337 microversion: 2.1 time: 0.241655 Aug 31 15:49:36.707428 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 118/206] 10.222.0.50 () {60 vars in 1173 bytes} [Wed Aug 31 15:49:36 2022] PUT /compute/v2.1/os-aggregates/10 => generated 337 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:36.721355 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ac4b12a0-062a-408d-bd47-a55217b3e2c1 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:36.787866 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ac4b12a0-062a-408d-bd47-a55217b3e2c1 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.077417 Aug 31 15:49:36.787866 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 119/207] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Aug 31 15:49:36 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 31 15:49:36.823290 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1f2e348c-f778-4e5d-86a2-0ed2d02619e1 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:36.824056 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1f2e348c-f778-4e5d-86a2-0ed2d02619e1 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:36.836835 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d891d669-bdba-44cd-9068-85cecf883c5e tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:36.842045 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1f2e348c-f778-4e5d-86a2-0ed2d02619e1 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:36.843920 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1f2e348c-f778-4e5d-86a2-0ed2d02619e1 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:36.844427 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1f2e348c-f778-4e5d-86a2-0ed2d02619e1 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:36.845239 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1f2e348c-f778-4e5d-86a2-0ed2d02619e1 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:36.846840 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1f2e348c-f778-4e5d-86a2-0ed2d02619e1 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:36.847336 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1f2e348c-f778-4e5d-86a2-0ed2d02619e1 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:36.860201 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d891d669-bdba-44cd-9068-85cecf883c5e tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6" status: 200 len: 1317 microversion: 2.1 time: 0.553712 Aug 31 15:49:36.861488 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 89/208] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:49:36 2022] GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6 => generated 1317 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:36.866700 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3cacfff1-31e8-4930-a6da-064b27fb3843 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:36.889719 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3cacfff1-31e8-4930-a6da-064b27fb3843 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates" status: 200 len: 340 microversion: 2.1 time: 0.021102 Aug 31 15:49:36.894800 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 90/209] 10.222.0.50 () {58 vars in 1143 bytes} [Wed Aug 31 15:49:36 2022] GET /compute/v2.1/os-aggregates => generated 340 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:36.904785 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-af5d96d1-fc72-44fd-9724-abc864b32e33 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1064000127"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:36.914641 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.aggregate [None req-af5d96d1-fc72-44fd-9724-abc864b32e33 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Generated uuid 1eb1a33e-6d3d-415f-b794-65818d3ce363 for aggregate {{(pid=128863) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 31 15:49:36.983614 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-af5d96d1-fc72-44fd-9724-abc864b32e33 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.087259 Aug 31 15:49:36.994422 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 91/210] 10.222.0.50 () {60 vars in 1164 bytes} [Wed Aug 31 15:49:36 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:37.005023 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-392cd0b5-ca93-475c-ab14-a0808bfccee3 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:37.103875 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-392cd0b5-ca93-475c-ab14-a0808bfccee3 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.107958 Aug 31 15:49:37.104466 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 92/211] 10.222.0.50 () {58 vars in 1155 bytes} [Wed Aug 31 15:49:36 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 31 15:49:37.130336 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1f2e348c-f778-4e5d-86a2-0ed2d02619e1 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:37.142771 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1f2e348c-f778-4e5d-86a2-0ed2d02619e1 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:37.148481 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1f2e348c-f778-4e5d-86a2-0ed2d02619e1 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:37.159250 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1f2e348c-f778-4e5d-86a2-0ed2d02619e1 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] 10.222.0.50 "GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f" status: 200 len: 1438 microversion: 2.75 time: 0.371440 Aug 31 15:49:37.162086 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 120/212] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:49:36 2022] GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f => generated 1438 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:49:37.170003 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-46239043-ff2c-4001-9793-4f0f259107eb tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2019302780"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:37.174655 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.aggregate [None req-46239043-ff2c-4001-9793-4f0f259107eb tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Generated uuid f9bb939a-984b-4881-912d-a252c7c342cb for aggregate {{(pid=128864) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 31 15:49:37.230242 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-46239043-ff2c-4001-9793-4f0f259107eb tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.066722 Aug 31 15:49:37.238022 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 121/213] 10.222.0.50 () {60 vars in 1164 bytes} [Wed Aug 31 15:49:37 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:37.240975 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=5 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:49:37.257659 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f218c625-606d-44c7-aad2-14e35368bf16 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:37.263781 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f218c625-606d-44c7-aad2-14e35368bf16 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:37.282952 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f218c625-606d-44c7-aad2-14e35368bf16 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:37.283449 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f218c625-606d-44c7-aad2-14e35368bf16 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:37.283888 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f218c625-606d-44c7-aad2-14e35368bf16 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:37.284602 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f218c625-606d-44c7-aad2-14e35368bf16 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:37.285054 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f218c625-606d-44c7-aad2-14e35368bf16 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:37.285489 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f218c625-606d-44c7-aad2-14e35368bf16 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:37.436832 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-f218c625-606d-44c7-aad2-14e35368bf16 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:49:37.438000 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-f218c625-606d-44c7-aad2-14e35368bf16 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:49:37.438830 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-f218c625-606d-44c7-aad2-14e35368bf16 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:49:37.439380 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-f218c625-606d-44c7-aad2-14e35368bf16 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:49:37.439969 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-f218c625-606d-44c7-aad2-14e35368bf16 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:49:37.563623 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f218c625-606d-44c7-aad2-14e35368bf16 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:37.577795 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-481165b1-8c2e-4ab6-9f49-aa923f5a62eb tempest-AggregatesAdminNegativeTestJSON-1827558708 tempest-AggregatesAdminNegativeTestJSON-1827558708-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-833090-16"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:37.584641 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f218c625-606d-44c7-aad2-14e35368bf16 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:37.585145 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f218c625-606d-44c7-aad2-14e35368bf16 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:37.586166 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f218c625-606d-44c7-aad2-14e35368bf16 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:37.590568 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f218c625-606d-44c7-aad2-14e35368bf16 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:37.591079 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f218c625-606d-44c7-aad2-14e35368bf16 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:37.591524 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f218c625-606d-44c7-aad2-14e35368bf16 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:37.600315 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-481165b1-8c2e-4ab6-9f49-aa923f5a62eb tempest-AggregatesAdminNegativeTestJSON-1827558708 tempest-AggregatesAdminNegativeTestJSON-1827558708-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '3889494b29e246c7a976d8d82629a8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a09212572a4f1c94b30936c66011c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:37.612061 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-481165b1-8c2e-4ab6-9f49-aa923f5a62eb tempest-AggregatesAdminNegativeTestJSON-1827558708 tempest-AggregatesAdminNegativeTestJSON-1827558708-project] Request method failure captured: Aug 31 15:49:37.612061 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Aug 31 15:49:37.612061 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:49:37.612061 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:49:37.612061 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:49:37.612061 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 40 Aug 31 15:49:37.612061 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:49:37.612061 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:49:37.612061 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:49:37.612061 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:49:37.612061 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4Lhg4lpkOcKmkKnllk4OB1-ElK61p9Z4zRIFQdy9z9hqOTtnr9SlgRF3vipS8KArBcBvC3p08-LaJrj6HhH8A_R_NpL7xHnKJk_7H88slOo-e_Sf2DTW8UVRhbP892MY2spRrHrWGsSzYYTonJfdPXd2Yul-UGlCwRM-4TzqsMoxxo Aug 31 15:49:37.612061 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:49:37.612061 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:49:37.612061 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:49:37.612061 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:49:37.612061 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:49:37.612061 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:49:37.612061 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 61a09212572a4f1c94b30936c66011c7 Aug 31 15:49:37.612061 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1827558708 Aug 31 15:49:37.612061 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:49:37.612061 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:49:37.613453 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/61a09212572a4f1c94b30936c66011c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/61a09212572a4f1c94b30936c66011c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/61a09212572a4f1c94b30936c66011c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_61a09212572a4f1c94b30936c66011c7", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:49:37.613453 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1827558708 Aug 31 15:49:37.613453 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 61a09212572a4f1c94b30936c66011c7 Aug 31 15:49:37.613453 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1827558708 Aug 31 15:49:37.613453 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-AggregatesAdminNegativeTestJSON-1827558708-project Aug 31 15:49:37.613453 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:49:37.613453 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:49:37.613453 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 3889494b29e246c7a976d8d82629a8b5 Aug 31 15:49:37.613453 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1827558708-project Aug 31 15:49:37.613453 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 15:49:37.613453 n-d-833090-16 devstack@n-api.service[128863]: {"add_host": {"host": "n-h1-833090-16"}} Aug 31 15:49:37.613453 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 15:49:37.613453 n-d-833090-16 devstack@n-api.service[128863]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 31 15:49:37.614637 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '11', 'body': {'add_host': {'host': 'n-h1-833090-16'}}} Aug 31 15:49:37.614637 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:49:37.614637 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:37.614637 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:37.614637 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:37.614637 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:49:37.614637 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:49:37.614637 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:49:37.614637 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:49:37.614637 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:49:37.614637 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:49:37.614637 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Aug 31 15:49:37.614637 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Aug 31 15:49:37.614637 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 15:49:37.614637 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 15:49:37.614637 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 15:49:37.614637 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 15:49:37.614637 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:49:37.614637 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:49:37.615852 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:49:37.615852 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:49:37.615852 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 15:49:37.615852 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 15:49:37.615852 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 15:49:37.615852 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 15:49:37.615852 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 15:49:37.615852 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 15:49:37.615852 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 31 15:49:37.615852 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:37.615852 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:37.615852 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:37.615852 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:37.615852 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:37.615852 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:37.615852 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 15:49:37.615852 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 15:49:37.615852 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 31 15:49:37.615852 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:37.617372 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-481165b1-8c2e-4ab6-9f49-aa923f5a62eb tempest-AggregatesAdminNegativeTestJSON-1827558708 tempest-AggregatesAdminNegativeTestJSON-1827558708-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:49:37.617372 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-481165b1-8c2e-4ab6-9f49-aa923f5a62eb tempest-AggregatesAdminNegativeTestJSON-1827558708 tempest-AggregatesAdminNegativeTestJSON-1827558708-project] 10.222.0.50 "POST /compute/v2.1/os-aggregates/11/action" status: 403 len: 118 microversion: 2.1 time: 0.507007 Aug 31 15:49:37.619120 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 93/214] 10.222.0.50 () {60 vars in 1194 bytes} [Wed Aug 31 15:49:37 2022] POST /compute/v2.1/os-aggregates/11/action => generated 118 bytes in 510 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:49:37.633896 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-91c6c0c2-75e5-45bf-9c49-56d5ce353747 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:37.661582 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-91c6c0c2-75e5-45bf-9c49-56d5ce353747 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates" status: 200 len: 446 microversion: 2.1 time: 0.040581 Aug 31 15:49:37.662303 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 94/215] 10.222.0.50 () {58 vars in 1143 bytes} [Wed Aug 31 15:49:37 2022] GET /compute/v2.1/os-aggregates => generated 446 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:37.669067 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-05606738-9613-4932-b63f-3f52cf214a8e tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:37.751730 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-05606738-9613-4932-b63f-3f52cf214a8e tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.084953 Aug 31 15:49:37.752380 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 95/216] 10.222.0.50 () {58 vars in 1155 bytes} [Wed Aug 31 15:49:37 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 31 15:49:37.765097 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3c266a07-4b1b-4e63-9ccf-113f66b20cf4 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:37.838379 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3c266a07-4b1b-4e63-9ccf-113f66b20cf4 tempest-AggregatesAdminTestJSON-1492060115 tempest-AggregatesAdminTestJSON-1492060115-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.082706 Aug 31 15:49:37.840680 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 96/217] 10.222.0.50 () {58 vars in 1155 bytes} [Wed Aug 31 15:49:37 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 31 15:49:37.868517 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-818625dd-3ebf-4f02-b1c7-70602b7d7ef6 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1675980618"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:37.883769 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.aggregate [None req-818625dd-3ebf-4f02-b1c7-70602b7d7ef6 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Generated uuid c72616ee-4ad0-4cc8-b41f-a5838573bcdd for aggregate {{(pid=128863) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 31 15:49:37.925673 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-818625dd-3ebf-4f02-b1c7-70602b7d7ef6 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.083498 Aug 31 15:49:37.928676 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 97/218] 10.222.0.50 () {60 vars in 1164 bytes} [Wed Aug 31 15:49:37 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:37.934407 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4cf047fe-d872-48df-8fb0-7a6326c712d9 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:37.934878 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4cf047fe-d872-48df-8fb0-7a6326c712d9 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] [instance: e1429482-9aee-476b-a4db-585f0493cff7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:37.942959 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4cf047fe-d872-48df-8fb0-7a6326c712d9 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:37.943993 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4cf047fe-d872-48df-8fb0-7a6326c712d9 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:37.944444 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4cf047fe-d872-48df-8fb0-7a6326c712d9 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:37.945152 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4cf047fe-d872-48df-8fb0-7a6326c712d9 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:37.945608 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4cf047fe-d872-48df-8fb0-7a6326c712d9 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:37.946075 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4cf047fe-d872-48df-8fb0-7a6326c712d9 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:37.962605 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-4cf047fe-d872-48df-8fb0-7a6326c712d9 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] HTTP exception thrown: Instance e1429482-9aee-476b-a4db-585f0493cff7 could not be found. Aug 31 15:49:37.965804 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4cf047fe-d872-48df-8fb0-7a6326c712d9 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Request method failure captured: Aug 31 15:49:37.965804 n-d-833090-16 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/e1429482-9aee-476b-a4db-585f0493cff7 HTTP/1.1 Aug 31 15:49:37.965804 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:49:37.965804 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:49:37.965804 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:49:37.965804 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:49:37.965804 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:49:37.965804 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:49:37.965804 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:49:37.965804 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:49:37.965804 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4LfKhr6CNM_fKcU5K-N_6TOI3c-h4fjkycv1UBCzT7uAWc4Kn90P_gWLqhRyMWHbHsaKr8cNBvBVxfRXIeL-e22ExUCkUD82Z8h8KSzu4zSx2o8yioH02FuxPcneisbGJhDpVm3htFR-MGqMV8WZ_mKnOupE_fQtD4RkVRXyAOrh5A Aug 31 15:49:37.965804 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:49:37.965804 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:49:37.965804 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:49:37.965804 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:49:37.965804 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:49:37.965804 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:49:37.965804 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 454e809640fd4c1381463bd27e69c02b Aug 31 15:49:37.965804 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-AggregatesAdminTestJSON-2094361298 Aug 31 15:49:37.965804 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:49:37.965804 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:49:37.967351 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/454e809640fd4c1381463bd27e69c02b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/454e809640fd4c1381463bd27e69c02b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/454e809640fd4c1381463bd27e69c02b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_454e809640fd4c1381463bd27e69c02b", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:49:37.967351 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-AggregatesAdminTestJSON-2094361298 Aug 31 15:49:37.967351 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 454e809640fd4c1381463bd27e69c02b Aug 31 15:49:37.967351 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2094361298 Aug 31 15:49:37.967351 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-AggregatesAdminTestJSON-2094361298-project Aug 31 15:49:37.967351 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:49:37.967351 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:49:37.967351 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: ca35cd4f679249c2b98305e4bc1cb13e Aug 31 15:49:37.967351 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-AggregatesAdminTestJSON-2094361298-project Aug 31 15:49:37.967351 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 15:49:37.967351 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance e1429482-9aee-476b-a4db-585f0493cff7 could not be found. Aug 31 15:49:37.967351 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'e1429482-9aee-476b-a4db-585f0493cff7'} Aug 31 15:49:37.967997 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:49:37.967997 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:37.967997 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:49:37.967997 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:49:37.967997 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:49:37.967997 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:49:37.967997 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:49:37.967997 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:49:37.967997 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:49:37.967997 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:49:37.967997 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1429482-9aee-476b-a4db-585f0493cff7 could not be found. Aug 31 15:49:37.967997 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:37.967997 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:37.967997 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:37.967997 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:37.967997 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:37.967997 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:37.967997 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:49:37.967997 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:49:37.967997 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:49:37.969084 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:49:37.969084 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 15:49:37.969084 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 15:49:37.969084 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 15:49:37.969084 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 15:49:37.969084 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:49:37.969084 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:49:37.969084 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:49:37.969084 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:49:37.969084 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1429482-9aee-476b-a4db-585f0493cff7 could not be found. Aug 31 15:49:37.969084 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:37.969084 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:37.969084 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:37.969084 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:37.969084 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:37.969084 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:37.969084 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:49:37.969084 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:49:37.969084 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1429482-9aee-476b-a4db-585f0493cff7 could not be found. Aug 31 15:49:37.969084 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:37.970276 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4cf047fe-d872-48df-8fb0-7a6326c712d9 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Returning 404 to user: Instance e1429482-9aee-476b-a4db-585f0493cff7 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:49:37.970276 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4cf047fe-d872-48df-8fb0-7a6326c712d9 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e1429482-9aee-476b-a4db-585f0493cff7" status: 404 len: 111 microversion: 2.1 time: 0.037645 Aug 31 15:49:37.970276 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 98/219] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:49:37 2022] DELETE /compute/v2.1/servers/e1429482-9aee-476b-a4db-585f0493cff7 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:49:37.974839 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9461e7f7-a4ad-4712-a1c5-8d160a743296 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:37.976139 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9461e7f7-a4ad-4712-a1c5-8d160a743296 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 848b21b2-98a0-4e70-a27c-08d390d73ae6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:37.985401 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9461e7f7-a4ad-4712-a1c5-8d160a743296 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:37.986008 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9461e7f7-a4ad-4712-a1c5-8d160a743296 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:37.986434 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9461e7f7-a4ad-4712-a1c5-8d160a743296 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:37.987284 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9461e7f7-a4ad-4712-a1c5-8d160a743296 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:37.987730 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9461e7f7-a4ad-4712-a1c5-8d160a743296 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:37.988219 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9461e7f7-a4ad-4712-a1c5-8d160a743296 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:38.132988 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f218c625-606d-44c7-aad2-14e35368bf16 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:38.145338 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f218c625-606d-44c7-aad2-14e35368bf16 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:38.154245 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f218c625-606d-44c7-aad2-14e35368bf16 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:38.171083 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f218c625-606d-44c7-aad2-14e35368bf16 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] 10.222.0.50 "POST /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f/action" status: 202 len: 1495 microversion: 2.75 time: 0.938617 Aug 31 15:49:38.177527 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 122/220] 10.222.0.50 () {62 vars in 1319 bytes} [Wed Aug 31 15:49:37 2022] POST /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f/action => generated 1495 bytes in 945 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 31 15:49:38.195003 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-593a1b38-6451-4855-8306-e60a3889012f tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-840884274"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:38.218262 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-593a1b38-6451-4855-8306-e60a3889012f tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:38.218967 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-593a1b38-6451-4855-8306-e60a3889012f tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:38.222059 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-593a1b38-6451-4855-8306-e60a3889012f tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:38.248355 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-593a1b38-6451-4855-8306-e60a3889012f tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:38.249061 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-593a1b38-6451-4855-8306-e60a3889012f tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:38.251031 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-593a1b38-6451-4855-8306-e60a3889012f tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:38.275044 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-593a1b38-6451-4855-8306-e60a3889012f tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-840884274 could not be found. Aug 31 15:49:38.290485 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-593a1b38-6451-4855-8306-e60a3889012f tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Request method failure captured: Aug 31 15:49:38.290485 n-d-833090-16 devstack@n-api.service[128864]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Aug 31 15:49:38.290485 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:49:38.290485 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:49:38.290485 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:49:38.290485 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 57 Aug 31 15:49:38.290485 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:49:38.290485 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:49:38.290485 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:49:38.290485 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:49:38.290485 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4Lk3esfAPKc65t_nvTRGKegL6t97spK7u6iOZvCDDIhprzOGX96flC0EzFbJkIF5_qJGP-pD_qmJ7xAVnxlGC3Qu6aPNObBZjPmfyNqhvAyrnsg7jKQ0SqOb7J2ZHIIFO8ooJKhnG-5SvdeYWYsyP2tB9v_K_ARPJuvIwrCjlecflY Aug 31 15:49:38.290485 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:49:38.290485 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:49:38.290485 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:49:38.290485 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:49:38.290485 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:49:38.290485 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:49:38.290485 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: cd14c575cc574d65adcfe4df7bb170c1 Aug 31 15:49:38.290485 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1561922880 Aug 31 15:49:38.290485 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,admin,member Aug 31 15:49:38.290485 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,admin,member Aug 31 15:49:38.291933 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cd14c575cc574d65adcfe4df7bb170c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cd14c575cc574d65adcfe4df7bb170c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cd14c575cc574d65adcfe4df7bb170c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cd14c575cc574d65adcfe4df7bb170c1", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:49:38.291933 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1561922880 Aug 31 15:49:38.291933 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: cd14c575cc574d65adcfe4df7bb170c1 Aug 31 15:49:38.291933 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1561922880 Aug 31 15:49:38.291933 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin Aug 31 15:49:38.291933 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:49:38.291933 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:49:38.291933 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 4c54901aa14a48e8a8c007a0d01804b2 Aug 31 15:49:38.291933 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin Aug 31 15:49:38.291933 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 15:49:38.291933 n-d-833090-16 devstack@n-api.service[128864]: {"add_host": {"host": "tempest-nonexist_host-840884274"}} Aug 31 15:49:38.291933 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:49:38.292808 n-d-833090-16 devstack@n-api.service[128864]: exception: Compute host tempest-nonexist_host-840884274 could not be found. Aug 31 15:49:38.292808 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '13', 'body': {'add_host': {'host': 'tempest-nonexist_host-840884274'}}} Aug 31 15:49:38.292808 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:49:38.292808 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:38.292808 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5997, in _get_service_in_cell_by_host Aug 31 15:49:38.292808 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 31 15:49:38.292808 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 15:49:38.292808 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 15:49:38.292808 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 31 15:49:38.292808 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 31 15:49:38.292808 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 31 15:49:38.292808 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 31 15:49:38.292808 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 31 15:49:38.292808 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 31 15:49:38.292808 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-840884274' is not mapped to any cell Aug 31 15:49:38.292808 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:38.292808 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:38.292808 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:38.292808 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:38.292808 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6003, in _get_service_in_cell_by_host Aug 31 15:49:38.294224 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 31 15:49:38.294224 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 31 15:49:38.294224 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 31 15:49:38.294224 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 31 15:49:38.294224 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:38.294224 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:38.294224 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:38.294224 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:38.294224 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 31 15:49:38.294224 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 31 15:49:38.294224 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 31 15:49:38.294224 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 31 15:49:38.294224 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:49:38.294224 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:49:38.294224 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:49:38.294224 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:49:38.294224 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 31 15:49:38.294224 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 31 15:49:38.294224 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6619, in add_host_to_aggregate Aug 31 15:49:38.294224 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Aug 31 15:49:38.295564 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Aug 31 15:49:38.295564 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 31 15:49:38.295564 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-840884274 could not be found. Aug 31 15:49:38.295564 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:38.295564 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:38.295564 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:38.295564 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:38.295564 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:38.295564 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:38.295564 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:49:38.295564 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:49:38.295564 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:49:38.295564 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:49:38.295564 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:49:38.295564 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:49:38.295564 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Aug 31 15:49:38.295564 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:49:38.295564 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-840884274 could not be found. Aug 31 15:49:38.295564 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:38.295564 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:38.295564 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:38.297026 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:38.297026 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:38.297026 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:38.297026 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:49:38.297026 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:49:38.297026 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-840884274 could not be found. Aug 31 15:49:38.297026 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:38.298646 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-593a1b38-6451-4855-8306-e60a3889012f tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-840884274 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:49:38.302480 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-593a1b38-6451-4855-8306-e60a3889012f tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/13/action" status: 404 len: 110 microversion: 2.1 time: 0.121173 Aug 31 15:49:38.303374 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 123/221] 10.222.0.50 () {60 vars in 1194 bytes} [Wed Aug 31 15:49:38 2022] POST /compute/v2.1/os-aggregates/13/action => generated 110 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:49:38.324156 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d863ffb8-3a5e-4124-9da1-6b7ac5f36a90 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:38.325453 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d863ffb8-3a5e-4124-9da1-6b7ac5f36a90 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] [instance: e1429482-9aee-476b-a4db-585f0493cff7] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:38.342066 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d863ffb8-3a5e-4124-9da1-6b7ac5f36a90 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:38.344367 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d863ffb8-3a5e-4124-9da1-6b7ac5f36a90 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:38.345359 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d863ffb8-3a5e-4124-9da1-6b7ac5f36a90 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:38.357361 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d863ffb8-3a5e-4124-9da1-6b7ac5f36a90 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:38.358269 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d863ffb8-3a5e-4124-9da1-6b7ac5f36a90 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:38.360306 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d863ffb8-3a5e-4124-9da1-6b7ac5f36a90 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:38.397880 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-d863ffb8-3a5e-4124-9da1-6b7ac5f36a90 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] HTTP exception thrown: Instance e1429482-9aee-476b-a4db-585f0493cff7 could not be found. Aug 31 15:49:38.402848 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d863ffb8-3a5e-4124-9da1-6b7ac5f36a90 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Request method failure captured: Aug 31 15:49:38.402848 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/e1429482-9aee-476b-a4db-585f0493cff7 HTTP/1.1 Aug 31 15:49:38.402848 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:49:38.402848 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:49:38.402848 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:49:38.402848 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:49:38.402848 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:49:38.402848 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:49:38.402848 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:49:38.402848 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:49:38.402848 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4LfKhr6CNM_fKcU5K-N_6TOI3c-h4fjkycv1UBCzT7uAWc4Kn90P_gWLqhRyMWHbHsaKr8cNBvBVxfRXIeL-e22ExUCkUD82Z8h8KSzu4zSx2o8yioH02FuxPcneisbGJhDpVm3htFR-MGqMV8WZ_mKnOupE_fQtD4RkVRXyAOrh5A Aug 31 15:49:38.402848 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:49:38.402848 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:49:38.402848 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:49:38.402848 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:49:38.402848 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:49:38.402848 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:49:38.402848 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 454e809640fd4c1381463bd27e69c02b Aug 31 15:49:38.402848 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-AggregatesAdminTestJSON-2094361298 Aug 31 15:49:38.402848 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:49:38.402848 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:49:38.404396 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/454e809640fd4c1381463bd27e69c02b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/454e809640fd4c1381463bd27e69c02b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/454e809640fd4c1381463bd27e69c02b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_454e809640fd4c1381463bd27e69c02b", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:49:38.404396 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-AggregatesAdminTestJSON-2094361298 Aug 31 15:49:38.404396 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 454e809640fd4c1381463bd27e69c02b Aug 31 15:49:38.404396 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2094361298 Aug 31 15:49:38.404396 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-AggregatesAdminTestJSON-2094361298-project Aug 31 15:49:38.404396 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:49:38.404396 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:49:38.404396 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: ca35cd4f679249c2b98305e4bc1cb13e Aug 31 15:49:38.404396 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-AggregatesAdminTestJSON-2094361298-project Aug 31 15:49:38.404396 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:49:38.404396 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance e1429482-9aee-476b-a4db-585f0493cff7 could not be found. Aug 31 15:49:38.404396 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'e1429482-9aee-476b-a4db-585f0493cff7'} Aug 31 15:49:38.405313 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:49:38.405313 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:38.405313 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:49:38.405313 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:49:38.405313 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:49:38.405313 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:49:38.405313 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:49:38.405313 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:49:38.405313 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:49:38.405313 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:49:38.405313 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1429482-9aee-476b-a4db-585f0493cff7 could not be found. Aug 31 15:49:38.405313 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:38.405313 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:38.405313 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:38.405313 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:38.405313 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:38.405313 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:38.405313 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:49:38.405313 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:49:38.405313 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:49:38.406615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:49:38.406615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:49:38.406615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:49:38.406615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:49:38.406615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:49:38.406615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:49:38.406615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:49:38.406615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1429482-9aee-476b-a4db-585f0493cff7 could not be found. Aug 31 15:49:38.406615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:38.406615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:38.406615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:38.406615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:38.406615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:38.406615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:38.406615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:49:38.406615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:49:38.406615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1429482-9aee-476b-a4db-585f0493cff7 could not be found. Aug 31 15:49:38.406615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:38.407684 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:49:38.411261 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d863ffb8-3a5e-4124-9da1-6b7ac5f36a90 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] Returning 404 to user: Instance e1429482-9aee-476b-a4db-585f0493cff7 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:49:38.418779 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d863ffb8-3a5e-4124-9da1-6b7ac5f36a90 tempest-AggregatesAdminTestJSON-2094361298 tempest-AggregatesAdminTestJSON-2094361298-project] 10.222.0.50 "GET /compute/v2.1/servers/e1429482-9aee-476b-a4db-585f0493cff7" status: 404 len: 111 microversion: 2.1 time: 0.106664 Aug 31 15:49:38.424905 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 124/222] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:49:38 2022] GET /compute/v2.1/servers/e1429482-9aee-476b-a4db-585f0493cff7 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:49:38.437043 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6d96c568-45dd-401e-a93c-014a4dbf239c tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:38.439487 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6d96c568-45dd-401e-a93c-014a4dbf239c tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:38.450530 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d96c568-45dd-401e-a93c-014a4dbf239c tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:38.453246 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d96c568-45dd-401e-a93c-014a4dbf239c tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:38.456574 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d96c568-45dd-401e-a93c-014a4dbf239c tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:38.457630 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d96c568-45dd-401e-a93c-014a4dbf239c tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:38.458436 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d96c568-45dd-401e-a93c-014a4dbf239c tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:38.461511 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d96c568-45dd-401e-a93c-014a4dbf239c tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:38.500357 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:49:38.663674 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9461e7f7-a4ad-4712-a1c5-8d160a743296 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:38.677331 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9461e7f7-a4ad-4712-a1c5-8d160a743296 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6" status: 200 len: 1317 microversion: 2.1 time: 0.707455 Aug 31 15:49:38.678328 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 99/223] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:49:37 2022] GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6 => generated 1317 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:38.689692 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b69150cc-11fb-4b9f-9eba-714903293025 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:38.735098 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b69150cc-11fb-4b9f-9eba-714903293025 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.053242 Aug 31 15:49:38.736718 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 100/224] 10.222.0.50 () {58 vars in 1155 bytes} [Wed Aug 31 15:49:38 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 31 15:49:38.752269 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-800d91d9-1945-42d0-91cc-db5086f3ca53 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:38.758539 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6d96c568-45dd-401e-a93c-014a4dbf239c tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:38.761372 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-800d91d9-1945-42d0-91cc-db5086f3ca53 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Request method failure captured: Aug 31 15:49:38.761372 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 31 15:49:38.761372 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:49:38.761372 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:49:38.761372 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:49:38.761372 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 283 Aug 31 15:49:38.761372 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:49:38.761372 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:49:38.761372 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:49:38.761372 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:49:38.761372 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4Lk3esfAPKc65t_nvTRGKegL6t97spK7u6iOZvCDDIhprzOGX96flC0EzFbJkIF5_qJGP-pD_qmJ7xAVnxlGC3Qu6aPNObBZjPmfyNqhvAyrnsg7jKQ0SqOb7J2ZHIIFO8ooJKhnG-5SvdeYWYsyP2tB9v_K_ARPJuvIwrCjlecflY Aug 31 15:49:38.761372 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:49:38.761372 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:49:38.761372 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:49:38.761372 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:49:38.761372 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:49:38.761372 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:49:38.761372 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: cd14c575cc574d65adcfe4df7bb170c1 Aug 31 15:49:38.761372 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1561922880 Aug 31 15:49:38.761372 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,admin,member Aug 31 15:49:38.761372 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,admin,member Aug 31 15:49:38.762701 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cd14c575cc574d65adcfe4df7bb170c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cd14c575cc574d65adcfe4df7bb170c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cd14c575cc574d65adcfe4df7bb170c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cd14c575cc574d65adcfe4df7bb170c1", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:49:38.762701 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1561922880 Aug 31 15:49:38.762701 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: cd14c575cc574d65adcfe4df7bb170c1 Aug 31 15:49:38.762701 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1561922880 Aug 31 15:49:38.762701 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin Aug 31 15:49:38.762701 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:49:38.762701 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:49:38.762701 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 4c54901aa14a48e8a8c007a0d01804b2 Aug 31 15:49:38.762701 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin Aug 31 15:49:38.762701 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 15:49:38.763326 n-d-833090-16 devstack@n-api.service[128863]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 31 15:49:38.763326 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 15:49:38.763326 n-d-833090-16 devstack@n-api.service[128863]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 31 15:49:38.763326 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 31 15:49:38.763326 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:49:38.763326 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:38.763326 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 15:49:38.763326 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 15:49:38.763326 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 15:49:38.763326 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise error Aug 31 15:49:38.763883 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 31 15:49:38.763883 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:38.763883 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Aug 31 15:49:38.763883 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 31 15:49:38.763883 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:38.763883 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 31 15:49:38.763883 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 31 15:49:38.763883 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:38.763883 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:38.763883 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:38.763883 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:38.763883 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:38.763883 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:38.763883 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:49:38.763883 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:49:38.763883 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:49:38.763883 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:49:38.766808 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:49:38.766808 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:49:38.766808 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 15:49:38.766808 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 15:49:38.766808 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 15:49:38.766808 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 15:49:38.766808 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 15:49:38.766808 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 15:49:38.766808 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 31 15:49:38.766808 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:38.766808 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:38.766808 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:38.766808 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:38.766808 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:38.766808 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:38.767667 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 15:49:38.767667 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 15:49:38.767667 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 31 15:49:38.767667 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:38.767667 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-800d91d9-1945-42d0-91cc-db5086f3ca53 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:49:38.768010 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-800d91d9-1945-42d0-91cc-db5086f3ca53 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.018533 Aug 31 15:49:38.768010 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 101/225] 10.222.0.50 () {60 vars in 1165 bytes} [Wed Aug 31 15:49:38 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 15:49:38.771491 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6d96c568-45dd-401e-a93c-014a4dbf239c tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:38.772920 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6d96c568-45dd-401e-a93c-014a4dbf239c tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:38.779926 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c2022ac7-dd30-4243-941c-d951268e6c68 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:38.784863 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c2022ac7-dd30-4243-941c-d951268e6c68 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Request method failure captured: Aug 31 15:49:38.784863 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 31 15:49:38.784863 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:49:38.784863 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:49:38.784863 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:49:38.784863 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 27 Aug 31 15:49:38.784863 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:49:38.784863 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:49:38.784863 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:49:38.784863 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:49:38.784863 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4Lk3esfAPKc65t_nvTRGKegL6t97spK7u6iOZvCDDIhprzOGX96flC0EzFbJkIF5_qJGP-pD_qmJ7xAVnxlGC3Qu6aPNObBZjPmfyNqhvAyrnsg7jKQ0SqOb7J2ZHIIFO8ooJKhnG-5SvdeYWYsyP2tB9v_K_ARPJuvIwrCjlecflY Aug 31 15:49:38.784863 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:49:38.784863 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:49:38.784863 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:49:38.784863 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:49:38.784863 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:49:38.784863 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:49:38.784863 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: cd14c575cc574d65adcfe4df7bb170c1 Aug 31 15:49:38.784863 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1561922880 Aug 31 15:49:38.784863 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,admin,member Aug 31 15:49:38.784863 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,admin,member Aug 31 15:49:38.786631 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cd14c575cc574d65adcfe4df7bb170c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cd14c575cc574d65adcfe4df7bb170c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cd14c575cc574d65adcfe4df7bb170c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cd14c575cc574d65adcfe4df7bb170c1", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:49:38.786631 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1561922880 Aug 31 15:49:38.786631 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: cd14c575cc574d65adcfe4df7bb170c1 Aug 31 15:49:38.786631 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1561922880 Aug 31 15:49:38.786631 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin Aug 31 15:49:38.786631 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:49:38.786631 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:49:38.786631 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 4c54901aa14a48e8a8c007a0d01804b2 Aug 31 15:49:38.786631 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin Aug 31 15:49:38.786631 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 15:49:38.786631 n-d-833090-16 devstack@n-api.service[128863]: {"aggregate": {"name": ""}} Aug 31 15:49:38.786631 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 15:49:38.786631 n-d-833090-16 devstack@n-api.service[128863]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 31 15:49:38.787682 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'body': {'aggregate': {'name': ''}}} Aug 31 15:49:38.787682 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:49:38.787682 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:38.787682 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 15:49:38.787682 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 15:49:38.787682 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 15:49:38.787682 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise error Aug 31 15:49:38.787682 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 31 15:49:38.787682 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:38.787682 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Aug 31 15:49:38.787682 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 31 15:49:38.787682 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:38.787682 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 31 15:49:38.787682 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi '' Aug 31 15:49:38.787682 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:38.787682 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:38.787682 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:38.787682 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:38.787682 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:38.787682 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:38.787682 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:49:38.787682 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:49:38.787682 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:49:38.790228 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:49:38.790228 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:49:38.790228 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:49:38.790228 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 15:49:38.790228 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 15:49:38.790228 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 15:49:38.790228 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 15:49:38.790228 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 15:49:38.790228 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 15:49:38.790228 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 31 15:49:38.790228 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:38.790228 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:38.790228 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:38.790228 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:38.790228 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:38.790228 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:38.790228 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 15:49:38.790228 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 15:49:38.790228 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 31 15:49:38.790228 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:38.791669 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c2022ac7-dd30-4243-941c-d951268e6c68 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:49:38.791669 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c2022ac7-dd30-4243-941c-d951268e6c68 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.016618 Aug 31 15:49:38.799282 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6d96c568-45dd-401e-a93c-014a4dbf239c tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] 10.222.0.50 "GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f" status: 200 len: 1447 microversion: 2.75 time: 0.371835 Aug 31 15:49:38.799532 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 102/226] 10.222.0.50 () {60 vars in 1164 bytes} [Wed Aug 31 15:49:38 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 15:49:38.799859 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 125/227] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:49:38 2022] GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f => generated 1447 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:49:38.804968 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-871ed6c9-4095-4c9b-932a-7c2518a743d4 tempest-AggregatesAdminNegativeTestJSON-1827558708 tempest-AggregatesAdminNegativeTestJSON-1827558708-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1109431054"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:38.808566 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-871ed6c9-4095-4c9b-932a-7c2518a743d4 tempest-AggregatesAdminNegativeTestJSON-1827558708 tempest-AggregatesAdminNegativeTestJSON-1827558708-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '3889494b29e246c7a976d8d82629a8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a09212572a4f1c94b30936c66011c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:38.810894 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-871ed6c9-4095-4c9b-932a-7c2518a743d4 tempest-AggregatesAdminNegativeTestJSON-1827558708 tempest-AggregatesAdminNegativeTestJSON-1827558708-project] Request method failure captured: Aug 31 15:49:38.810894 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 31 15:49:38.810894 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:49:38.810894 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:49:38.810894 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:49:38.810894 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 60 Aug 31 15:49:38.810894 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:49:38.810894 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:49:38.810894 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:49:38.810894 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:49:38.810894 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4Lhg4lpkOcKmkKnllk4OB1-ElK61p9Z4zRIFQdy9z9hqOTtnr9SlgRF3vipS8KArBcBvC3p08-LaJrj6HhH8A_R_NpL7xHnKJk_7H88slOo-e_Sf2DTW8UVRhbP892MY2spRrHrWGsSzYYTonJfdPXd2Yul-UGlCwRM-4TzqsMoxxo Aug 31 15:49:38.810894 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:49:38.810894 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:49:38.810894 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:49:38.810894 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:49:38.810894 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:49:38.810894 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:49:38.810894 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 61a09212572a4f1c94b30936c66011c7 Aug 31 15:49:38.810894 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1827558708 Aug 31 15:49:38.810894 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:49:38.810894 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:49:38.812705 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/61a09212572a4f1c94b30936c66011c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/61a09212572a4f1c94b30936c66011c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/61a09212572a4f1c94b30936c66011c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_61a09212572a4f1c94b30936c66011c7", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:49:38.812705 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1827558708 Aug 31 15:49:38.812705 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 61a09212572a4f1c94b30936c66011c7 Aug 31 15:49:38.812705 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1827558708 Aug 31 15:49:38.812705 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-AggregatesAdminNegativeTestJSON-1827558708-project Aug 31 15:49:38.812705 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:49:38.812705 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:49:38.812705 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 3889494b29e246c7a976d8d82629a8b5 Aug 31 15:49:38.812705 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1827558708-project Aug 31 15:49:38.812705 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 15:49:38.812705 n-d-833090-16 devstack@n-api.service[128863]: {"aggregate": {"name": "tempest-test_aggregate-1109431054"}} Aug 31 15:49:38.812705 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 15:49:38.812705 n-d-833090-16 devstack@n-api.service[128863]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 31 15:49:38.813392 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1109431054'}}} Aug 31 15:49:38.813392 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:49:38.813392 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:38.813392 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:38.813392 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:38.813392 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:49:38.813392 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:49:38.813392 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:49:38.813392 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:49:38.813392 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:49:38.813392 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:49:38.813392 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:49:38.813392 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:49:38.813392 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Aug 31 15:49:38.813392 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Aug 31 15:49:38.813392 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 15:49:38.813392 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 15:49:38.813392 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 15:49:38.813392 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 15:49:38.815465 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:49:38.815465 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:49:38.815465 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:49:38.815465 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:49:38.815465 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 15:49:38.815465 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 15:49:38.815465 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 15:49:38.815465 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 15:49:38.815465 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 15:49:38.815465 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 15:49:38.815465 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 31 15:49:38.815465 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:38.815465 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:38.815465 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:38.815465 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:38.815465 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:38.815465 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:38.815465 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 15:49:38.815465 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 15:49:38.815465 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 31 15:49:38.818057 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:38.819264 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-871ed6c9-4095-4c9b-932a-7c2518a743d4 tempest-AggregatesAdminNegativeTestJSON-1827558708 tempest-AggregatesAdminNegativeTestJSON-1827558708-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:49:38.820675 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-871ed6c9-4095-4c9b-932a-7c2518a743d4 tempest-AggregatesAdminNegativeTestJSON-1827558708 tempest-AggregatesAdminNegativeTestJSON-1827558708-project] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.019971 Aug 31 15:49:38.827599 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 103/228] 10.222.0.50 () {60 vars in 1164 bytes} [Wed Aug 31 15:49:38 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:49:38.837394 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c1afb86d-95a8-4663-9b8e-70067577f49c tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1016724456"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:38.844897 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.aggregate [None req-c1afb86d-95a8-4663-9b8e-70067577f49c tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Generated uuid 4e34018e-9185-4ddc-bc8a-db13a927b8a8 for aggregate {{(pid=128864) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 31 15:49:38.878935 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c1afb86d-95a8-4663-9b8e-70067577f49c tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.048421 Aug 31 15:49:38.888827 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 126/229] 10.222.0.50 () {60 vars in 1164 bytes} [Wed Aug 31 15:49:38 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:38.893584 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-59291108-b7e1-4630-96ae-af8704c4cff0 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1016724456"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:38.899404 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.aggregate [None req-59291108-b7e1-4630-96ae-af8704c4cff0 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Generated uuid 28741c1b-3d6a-4593-be66-aaefbfdeebe8 for aggregate {{(pid=128863) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 31 15:49:38.919332 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-59291108-b7e1-4630-96ae-af8704c4cff0 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1016724456 already exists. Aug 31 15:49:38.925760 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-59291108-b7e1-4630-96ae-af8704c4cff0 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Request method failure captured: Aug 31 15:49:38.925760 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 31 15:49:38.925760 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:49:38.925760 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:49:38.925760 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:49:38.925760 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 60 Aug 31 15:49:38.925760 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:49:38.925760 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:49:38.925760 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:49:38.925760 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:49:38.925760 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4Lk3esfAPKc65t_nvTRGKegL6t97spK7u6iOZvCDDIhprzOGX96flC0EzFbJkIF5_qJGP-pD_qmJ7xAVnxlGC3Qu6aPNObBZjPmfyNqhvAyrnsg7jKQ0SqOb7J2ZHIIFO8ooJKhnG-5SvdeYWYsyP2tB9v_K_ARPJuvIwrCjlecflY Aug 31 15:49:38.925760 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:49:38.925760 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:49:38.925760 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:49:38.925760 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:49:38.925760 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:49:38.925760 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:49:38.925760 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: cd14c575cc574d65adcfe4df7bb170c1 Aug 31 15:49:38.925760 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1561922880 Aug 31 15:49:38.925760 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,admin,member Aug 31 15:49:38.925760 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,admin,member Aug 31 15:49:38.927401 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cd14c575cc574d65adcfe4df7bb170c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cd14c575cc574d65adcfe4df7bb170c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cd14c575cc574d65adcfe4df7bb170c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cd14c575cc574d65adcfe4df7bb170c1", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:49:38.927401 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1561922880 Aug 31 15:49:38.927401 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: cd14c575cc574d65adcfe4df7bb170c1 Aug 31 15:49:38.927401 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1561922880 Aug 31 15:49:38.927401 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin Aug 31 15:49:38.927401 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:49:38.927401 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:49:38.927401 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 4c54901aa14a48e8a8c007a0d01804b2 Aug 31 15:49:38.927401 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin Aug 31 15:49:38.927401 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 15:49:38.927401 n-d-833090-16 devstack@n-api.service[128863]: {"aggregate": {"name": "tempest-test_aggregate-1016724456"}} Aug 31 15:49:38.927401 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 15:49:38.927401 n-d-833090-16 devstack@n-api.service[128863]: exception: Aggregate tempest-test_aggregate-1016724456 already exists. Aug 31 15:49:38.928260 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1016724456'}}} Aug 31 15:49:38.928260 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:49:38.928260 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:38.928260 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Aug 31 15:49:38.928260 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Aug 31 15:49:38.928260 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 31 15:49:38.928260 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 31 15:49:38.928260 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:49:38.928260 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:49:38.928260 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:49:38.928260 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:49:38.928260 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 31 15:49:38.928260 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 31 15:49:38.928260 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6456, in create_aggregate Aug 31 15:49:38.928260 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi aggregate.create() Aug 31 15:49:38.928260 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 31 15:49:38.928260 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 31 15:49:38.928260 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Aug 31 15:49:38.928260 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Aug 31 15:49:38.929477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 31 15:49:38.929477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 31 15:49:38.929477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Aug 31 15:49:38.929477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Aug 31 15:49:38.929477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1016724456 already exists. Aug 31 15:49:38.929477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:38.929477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:38.929477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:38.929477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:38.929477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:38.929477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:38.929477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:49:38.929477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:49:38.929477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:49:38.929477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:49:38.929477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:49:38.929477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:49:38.929477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:49:38.929477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:49:38.929477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Aug 31 15:49:38.931422 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 31 15:49:38.931422 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1016724456 already exists. Aug 31 15:49:38.931422 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:38.931422 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:38.931422 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:38.931422 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:38.931422 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:38.931422 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:38.931422 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:49:38.931422 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:49:38.931422 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1016724456 already exists. Aug 31 15:49:38.931422 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:38.938655 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-59291108-b7e1-4630-96ae-af8704c4cff0 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1016724456 already exists. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:49:38.939385 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-59291108-b7e1-4630-96ae-af8704c4cff0 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.050937 Aug 31 15:49:38.940283 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 104/230] 10.222.0.50 () {60 vars in 1164 bytes} [Wed Aug 31 15:49:38 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 52 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 15:49:38.949380 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-aaf98394-2ef6-4747-95ea-bfa3d5e86af6 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:39.019802 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-aaf98394-2ef6-4747-95ea-bfa3d5e86af6 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.074028 Aug 31 15:49:39.032778 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e7a9ca01-e569-4ae8-b69b-7819a815ca24 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-231509797"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:39.037456 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.aggregate [None req-e7a9ca01-e569-4ae8-b69b-7819a815ca24 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Generated uuid 66610c37-f473-46bb-84c6-902654be19ef for aggregate {{(pid=128863) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 31 15:49:39.040125 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 127/231] 10.222.0.50 () {58 vars in 1155 bytes} [Wed Aug 31 15:49:38 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 31 15:49:39.060224 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=7,nova_api:DELETE=12 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:49:39.103111 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e7a9ca01-e569-4ae8-b69b-7819a815ca24 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.074398 Aug 31 15:49:39.120064 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d99cb085-4e44-4d6b-b5e3-5f5f6303111e tempest-AggregatesAdminNegativeTestJSON-1827558708 tempest-AggregatesAdminNegativeTestJSON-1827558708-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:39.121916 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d99cb085-4e44-4d6b-b5e3-5f5f6303111e tempest-AggregatesAdminNegativeTestJSON-1827558708 tempest-AggregatesAdminNegativeTestJSON-1827558708-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '3889494b29e246c7a976d8d82629a8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a09212572a4f1c94b30936c66011c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:39.124922 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d99cb085-4e44-4d6b-b5e3-5f5f6303111e tempest-AggregatesAdminNegativeTestJSON-1827558708 tempest-AggregatesAdminNegativeTestJSON-1827558708-project] Request method failure captured: Aug 31 15:49:39.124922 n-d-833090-16 devstack@n-api.service[128864]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Aug 31 15:49:39.124922 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:49:39.124922 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:49:39.124922 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:49:39.124922 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:49:39.124922 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:49:39.124922 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:49:39.124922 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:49:39.124922 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:49:39.124922 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4Lhg4lpkOcKmkKnllk4OB1-ElK61p9Z4zRIFQdy9z9hqOTtnr9SlgRF3vipS8KArBcBvC3p08-LaJrj6HhH8A_R_NpL7xHnKJk_7H88slOo-e_Sf2DTW8UVRhbP892MY2spRrHrWGsSzYYTonJfdPXd2Yul-UGlCwRM-4TzqsMoxxo Aug 31 15:49:39.124922 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:49:39.124922 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:49:39.124922 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:49:39.124922 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:49:39.124922 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:49:39.124922 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:49:39.124922 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 61a09212572a4f1c94b30936c66011c7 Aug 31 15:49:39.124922 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1827558708 Aug 31 15:49:39.124922 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:49:39.124922 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:49:39.126363 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/61a09212572a4f1c94b30936c66011c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/61a09212572a4f1c94b30936c66011c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/61a09212572a4f1c94b30936c66011c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_61a09212572a4f1c94b30936c66011c7", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:49:39.126363 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1827558708 Aug 31 15:49:39.126363 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 61a09212572a4f1c94b30936c66011c7 Aug 31 15:49:39.126363 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1827558708 Aug 31 15:49:39.126363 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-AggregatesAdminNegativeTestJSON-1827558708-project Aug 31 15:49:39.126363 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:49:39.126363 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:49:39.126363 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 3889494b29e246c7a976d8d82629a8b5 Aug 31 15:49:39.126363 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1827558708-project Aug 31 15:49:39.126363 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:49:39.126363 n-d-833090-16 devstack@n-api.service[128864]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 31 15:49:39.126363 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '15'} Aug 31 15:49:39.127160 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:49:39.127160 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:39.127160 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:39.127160 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:39.127160 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:49:39.127160 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:49:39.127160 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:49:39.127160 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:49:39.127160 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Aug 31 15:49:39.127160 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Aug 31 15:49:39.127160 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 15:49:39.127160 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 15:49:39.127160 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 15:49:39.127160 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 15:49:39.127160 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:49:39.127160 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:49:39.127160 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:49:39.127160 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:49:39.127160 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 15:49:39.128421 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 15:49:39.128421 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 15:49:39.128421 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 15:49:39.128421 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 15:49:39.128421 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 15:49:39.128421 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 31 15:49:39.128421 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:39.128421 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:39.128421 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:39.128421 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:39.128421 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:39.128421 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:39.128421 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 15:49:39.128421 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 15:49:39.128421 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 31 15:49:39.128421 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:39.130278 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d99cb085-4e44-4d6b-b5e3-5f5f6303111e tempest-AggregatesAdminNegativeTestJSON-1827558708 tempest-AggregatesAdminNegativeTestJSON-1827558708-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:49:39.132129 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 105/232] 10.222.0.50 () {60 vars in 1164 bytes} [Wed Aug 31 15:49:39 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:39.133225 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d99cb085-4e44-4d6b-b5e3-5f5f6303111e tempest-AggregatesAdminNegativeTestJSON-1827558708 tempest-AggregatesAdminNegativeTestJSON-1827558708-project] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.018597 Aug 31 15:49:39.140440 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 128/233] 10.222.0.50 () {58 vars in 1155 bytes} [Wed Aug 31 15:49:39 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:49:39.146421 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a0f503f6-9efd-4ead-97a5-6c25d1a2f299 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:39.201189 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a0f503f6-9efd-4ead-97a5-6c25d1a2f299 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.057006 Aug 31 15:49:39.203787 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 106/234] 10.222.0.50 () {58 vars in 1155 bytes} [Wed Aug 31 15:49:39 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 31 15:49:39.216251 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8d2c3557-4208-47de-9722-3b061941f246 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:39.233801 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-8d2c3557-4208-47de-9722-3b061941f246 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 31 15:49:39.236060 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8d2c3557-4208-47de-9722-3b061941f246 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Request method failure captured: Aug 31 15:49:39.236060 n-d-833090-16 devstack@n-api.service[128864]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 31 15:49:39.236060 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:49:39.236060 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:49:39.236060 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:49:39.236060 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:49:39.236060 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:49:39.236060 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:49:39.236060 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:49:39.236060 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:49:39.236060 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4Lk3esfAPKc65t_nvTRGKegL6t97spK7u6iOZvCDDIhprzOGX96flC0EzFbJkIF5_qJGP-pD_qmJ7xAVnxlGC3Qu6aPNObBZjPmfyNqhvAyrnsg7jKQ0SqOb7J2ZHIIFO8ooJKhnG-5SvdeYWYsyP2tB9v_K_ARPJuvIwrCjlecflY Aug 31 15:49:39.236060 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:49:39.236060 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:49:39.236060 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:49:39.236060 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:49:39.236060 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:49:39.236060 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:49:39.236060 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: cd14c575cc574d65adcfe4df7bb170c1 Aug 31 15:49:39.236060 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1561922880 Aug 31 15:49:39.236060 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,admin,member Aug 31 15:49:39.236060 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,admin,member Aug 31 15:49:39.237657 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cd14c575cc574d65adcfe4df7bb170c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cd14c575cc574d65adcfe4df7bb170c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cd14c575cc574d65adcfe4df7bb170c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cd14c575cc574d65adcfe4df7bb170c1", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:49:39.237657 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1561922880 Aug 31 15:49:39.237657 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: cd14c575cc574d65adcfe4df7bb170c1 Aug 31 15:49:39.237657 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1561922880 Aug 31 15:49:39.237657 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin Aug 31 15:49:39.237657 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:49:39.237657 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:49:39.237657 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 4c54901aa14a48e8a8c007a0d01804b2 Aug 31 15:49:39.237657 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin Aug 31 15:49:39.237657 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:49:39.237657 n-d-833090-16 devstack@n-api.service[128864]: exception: Aggregate -1 could not be found. Aug 31 15:49:39.237657 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '-1'} Aug 31 15:49:39.239083 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:49:39.239083 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:39.239083 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 31 15:49:39.239083 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 31 15:49:39.239083 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 31 15:49:39.239083 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 31 15:49:39.239083 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:49:39.239083 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:49:39.239083 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:49:39.239083 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:49:39.239083 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 31 15:49:39.239083 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 31 15:49:39.239083 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6515, in delete_aggregate Aug 31 15:49:39.239083 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 31 15:49:39.239083 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 15:49:39.239083 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 15:49:39.239083 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 31 15:49:39.239083 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 31 15:49:39.239083 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 31 15:49:39.240745 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 31 15:49:39.240745 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 31 15:49:39.240745 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 31 15:49:39.240745 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 31 15:49:39.240745 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:39.240745 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:39.240745 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:39.240745 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:39.240745 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:39.240745 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:39.240745 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:49:39.240745 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:49:39.240745 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:49:39.240745 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:49:39.240745 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 31 15:49:39.240745 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:49:39.240745 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 31 15:49:39.240745 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:39.240745 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:39.240745 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:39.240745 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:39.242437 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:39.242437 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:39.242437 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:49:39.242437 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:49:39.242437 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 31 15:49:39.242437 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:39.244187 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8d2c3557-4208-47de-9722-3b061941f246 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:49:39.245211 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8d2c3557-4208-47de-9722-3b061941f246 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.035024 Aug 31 15:49:39.259125 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7c70eb86-5116-4c30-ba50-f9d06100c0dc tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-136526257"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:39.262985 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.aggregate [None req-7c70eb86-5116-4c30-ba50-f9d06100c0dc tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Generated uuid 6fff5617-6723-4027-977d-16d9314d2e20 for aggregate {{(pid=128863) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 31 15:49:39.263911 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 129/235] 10.222.0.50 () {58 vars in 1155 bytes} [Wed Aug 31 15:49:39 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 15:49:39.301081 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7c70eb86-5116-4c30-ba50-f9d06100c0dc tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.046218 Aug 31 15:49:39.313850 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9a19fb2f-cc55-42f0-8131-d31fad3e9b3a tempest-AggregatesAdminNegativeTestJSON-1827558708 tempest-AggregatesAdminNegativeTestJSON-1827558708-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:39.315994 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9a19fb2f-cc55-42f0-8131-d31fad3e9b3a tempest-AggregatesAdminNegativeTestJSON-1827558708 tempest-AggregatesAdminNegativeTestJSON-1827558708-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '3889494b29e246c7a976d8d82629a8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a09212572a4f1c94b30936c66011c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:39.321664 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9a19fb2f-cc55-42f0-8131-d31fad3e9b3a tempest-AggregatesAdminNegativeTestJSON-1827558708 tempest-AggregatesAdminNegativeTestJSON-1827558708-project] Request method failure captured: Aug 31 15:49:39.321664 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Aug 31 15:49:39.321664 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:49:39.321664 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:49:39.321664 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:49:39.321664 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:49:39.321664 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:49:39.321664 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:49:39.321664 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:49:39.321664 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:49:39.321664 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4Lhg4lpkOcKmkKnllk4OB1-ElK61p9Z4zRIFQdy9z9hqOTtnr9SlgRF3vipS8KArBcBvC3p08-LaJrj6HhH8A_R_NpL7xHnKJk_7H88slOo-e_Sf2DTW8UVRhbP892MY2spRrHrWGsSzYYTonJfdPXd2Yul-UGlCwRM-4TzqsMoxxo Aug 31 15:49:39.321664 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:49:39.321664 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:49:39.321664 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:49:39.321664 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:49:39.321664 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:49:39.321664 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:49:39.321664 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 61a09212572a4f1c94b30936c66011c7 Aug 31 15:49:39.321664 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1827558708 Aug 31 15:49:39.321664 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:49:39.321664 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:49:39.323082 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/61a09212572a4f1c94b30936c66011c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/61a09212572a4f1c94b30936c66011c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/61a09212572a4f1c94b30936c66011c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_61a09212572a4f1c94b30936c66011c7", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:49:39.323082 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1827558708 Aug 31 15:49:39.323082 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 61a09212572a4f1c94b30936c66011c7 Aug 31 15:49:39.323082 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1827558708 Aug 31 15:49:39.323082 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-AggregatesAdminNegativeTestJSON-1827558708-project Aug 31 15:49:39.323082 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:49:39.323082 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:49:39.323082 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 3889494b29e246c7a976d8d82629a8b5 Aug 31 15:49:39.323082 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1827558708-project Aug 31 15:49:39.323082 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:49:39.323082 n-d-833090-16 devstack@n-api.service[128864]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 31 15:49:39.323082 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '16'} Aug 31 15:49:39.323816 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:49:39.323816 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:39.323816 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:39.323816 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:39.323816 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:49:39.323816 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:49:39.323816 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:49:39.323816 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:49:39.323816 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Aug 31 15:49:39.323816 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Aug 31 15:49:39.323816 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 15:49:39.323816 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 15:49:39.323816 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 15:49:39.323816 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 15:49:39.323816 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:49:39.323816 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:49:39.323816 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:49:39.323816 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:49:39.323816 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 15:49:39.324886 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 15:49:39.324886 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 15:49:39.324886 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 15:49:39.324886 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 15:49:39.324886 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 15:49:39.324886 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 31 15:49:39.324886 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:39.324886 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:39.324886 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:39.324886 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:39.324886 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:39.324886 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:39.324886 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 15:49:39.324886 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 15:49:39.324886 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 31 15:49:39.324886 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:39.326700 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9a19fb2f-cc55-42f0-8131-d31fad3e9b3a tempest-AggregatesAdminNegativeTestJSON-1827558708 tempest-AggregatesAdminNegativeTestJSON-1827558708-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:49:39.327260 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 107/236] 10.222.0.50 () {60 vars in 1164 bytes} [Wed Aug 31 15:49:39 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:39.328429 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9a19fb2f-cc55-42f0-8131-d31fad3e9b3a tempest-AggregatesAdminNegativeTestJSON-1827558708 tempest-AggregatesAdminNegativeTestJSON-1827558708-project] 10.222.0.50 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.018898 Aug 31 15:49:39.339254 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 130/237] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Aug 31 15:49:39 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:49:39.346607 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f1778a2b-3a82-4e7b-8197-d9580f39e9d6 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:39.416848 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f1778a2b-3a82-4e7b-8197-d9580f39e9d6 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.078011 Aug 31 15:49:39.425134 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 108/238] 10.222.0.50 () {58 vars in 1155 bytes} [Wed Aug 31 15:49:39 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 31 15:49:39.436423 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-18039411-6d48-4249-b64c-1ef99baf5700 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:39.452700 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-18039411-6d48-4249-b64c-1ef99baf5700 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 31 15:49:39.455281 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-18039411-6d48-4249-b64c-1ef99baf5700 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Request method failure captured: Aug 31 15:49:39.455281 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 31 15:49:39.455281 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:49:39.455281 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:49:39.455281 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:49:39.455281 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:49:39.455281 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:49:39.455281 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:49:39.455281 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:49:39.455281 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:49:39.455281 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4Lk3esfAPKc65t_nvTRGKegL6t97spK7u6iOZvCDDIhprzOGX96flC0EzFbJkIF5_qJGP-pD_qmJ7xAVnxlGC3Qu6aPNObBZjPmfyNqhvAyrnsg7jKQ0SqOb7J2ZHIIFO8ooJKhnG-5SvdeYWYsyP2tB9v_K_ARPJuvIwrCjlecflY Aug 31 15:49:39.455281 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:49:39.455281 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:49:39.455281 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:49:39.455281 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:49:39.455281 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:49:39.455281 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:49:39.455281 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: cd14c575cc574d65adcfe4df7bb170c1 Aug 31 15:49:39.455281 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1561922880 Aug 31 15:49:39.455281 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,admin,member Aug 31 15:49:39.455281 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,admin,member Aug 31 15:49:39.456620 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cd14c575cc574d65adcfe4df7bb170c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cd14c575cc574d65adcfe4df7bb170c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cd14c575cc574d65adcfe4df7bb170c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cd14c575cc574d65adcfe4df7bb170c1", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:49:39.456620 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1561922880 Aug 31 15:49:39.456620 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: cd14c575cc574d65adcfe4df7bb170c1 Aug 31 15:49:39.456620 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1561922880 Aug 31 15:49:39.456620 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin Aug 31 15:49:39.456620 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:49:39.456620 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:49:39.456620 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 4c54901aa14a48e8a8c007a0d01804b2 Aug 31 15:49:39.456620 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin Aug 31 15:49:39.456620 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:49:39.456620 n-d-833090-16 devstack@n-api.service[128864]: exception: Aggregate -1 could not be found. Aug 31 15:49:39.456620 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '-1'} Aug 31 15:49:39.457407 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:49:39.457407 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:39.457407 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 31 15:49:39.457407 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 31 15:49:39.457407 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6462, in get_aggregate Aug 31 15:49:39.457407 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 31 15:49:39.457407 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 15:49:39.457407 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 15:49:39.457407 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 31 15:49:39.457407 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 31 15:49:39.457407 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 31 15:49:39.457407 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 31 15:49:39.457407 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 31 15:49:39.457407 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 31 15:49:39.457407 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 31 15:49:39.457407 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:39.457407 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:39.457407 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:39.457407 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:39.457407 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:39.458878 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:39.458878 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:49:39.458878 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:49:39.458878 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:49:39.458878 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:49:39.458878 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 31 15:49:39.458878 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:49:39.458878 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 31 15:49:39.458878 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:39.458878 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:39.458878 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:39.458878 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:39.458878 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:39.458878 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:39.458878 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:49:39.458878 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:49:39.458878 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 31 15:49:39.458878 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:49:39.460547 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-18039411-6d48-4249-b64c-1ef99baf5700 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:49:39.460547 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-18039411-6d48-4249-b64c-1ef99baf5700 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.024456 Aug 31 15:49:39.468075 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 131/239] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Aug 31 15:49:39 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 15:49:39.471761 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9292bff9-c22c-4b63-ba23-f469a55ca120 tempest-AggregatesAdminNegativeTestJSON-1827558708 tempest-AggregatesAdminNegativeTestJSON-1827558708-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:39.473457 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9292bff9-c22c-4b63-ba23-f469a55ca120 tempest-AggregatesAdminNegativeTestJSON-1827558708 tempest-AggregatesAdminNegativeTestJSON-1827558708-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '3889494b29e246c7a976d8d82629a8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a09212572a4f1c94b30936c66011c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:39.475149 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9292bff9-c22c-4b63-ba23-f469a55ca120 tempest-AggregatesAdminNegativeTestJSON-1827558708 tempest-AggregatesAdminNegativeTestJSON-1827558708-project] Request method failure captured: Aug 31 15:49:39.475149 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Aug 31 15:49:39.475149 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:49:39.475149 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:49:39.475149 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:49:39.475149 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:49:39.475149 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:49:39.475149 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:49:39.475149 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:49:39.475149 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:49:39.475149 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4Lhg4lpkOcKmkKnllk4OB1-ElK61p9Z4zRIFQdy9z9hqOTtnr9SlgRF3vipS8KArBcBvC3p08-LaJrj6HhH8A_R_NpL7xHnKJk_7H88slOo-e_Sf2DTW8UVRhbP892MY2spRrHrWGsSzYYTonJfdPXd2Yul-UGlCwRM-4TzqsMoxxo Aug 31 15:49:39.475149 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:49:39.475149 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:49:39.475149 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:49:39.475149 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:49:39.475149 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:49:39.475149 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:49:39.475149 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 61a09212572a4f1c94b30936c66011c7 Aug 31 15:49:39.475149 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1827558708 Aug 31 15:49:39.475149 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:49:39.475149 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:49:39.476627 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/61a09212572a4f1c94b30936c66011c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/61a09212572a4f1c94b30936c66011c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/61a09212572a4f1c94b30936c66011c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_61a09212572a4f1c94b30936c66011c7", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:49:39.476627 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1827558708 Aug 31 15:49:39.476627 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 61a09212572a4f1c94b30936c66011c7 Aug 31 15:49:39.476627 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1827558708 Aug 31 15:49:39.476627 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-AggregatesAdminNegativeTestJSON-1827558708-project Aug 31 15:49:39.476627 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:49:39.476627 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:49:39.476627 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 3889494b29e246c7a976d8d82629a8b5 Aug 31 15:49:39.476627 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1827558708-project Aug 31 15:49:39.476627 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 15:49:39.476627 n-d-833090-16 devstack@n-api.service[128863]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 31 15:49:39.476627 n-d-833090-16 devstack@n-api.service[128863]: action_args: {} Aug 31 15:49:39.477489 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:49:39.477489 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:39.477489 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:39.477489 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:39.477489 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:49:39.477489 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:49:39.477489 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:49:39.477489 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:49:39.477489 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Aug 31 15:49:39.477489 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Aug 31 15:49:39.477489 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 15:49:39.477489 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 15:49:39.477489 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 15:49:39.477489 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 15:49:39.477489 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:49:39.477489 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:49:39.477489 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:49:39.477489 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:49:39.477489 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 15:49:39.478720 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 15:49:39.478720 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 15:49:39.478720 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 15:49:39.478720 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 15:49:39.478720 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 15:49:39.478720 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 31 15:49:39.478720 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:39.478720 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:39.478720 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:39.478720 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:39.478720 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:39.478720 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:39.478720 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 15:49:39.478720 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 15:49:39.478720 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 31 15:49:39.478720 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:39.480016 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9292bff9-c22c-4b63-ba23-f469a55ca120 tempest-AggregatesAdminNegativeTestJSON-1827558708 tempest-AggregatesAdminNegativeTestJSON-1827558708-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:49:39.487675 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9292bff9-c22c-4b63-ba23-f469a55ca120 tempest-AggregatesAdminNegativeTestJSON-1827558708 tempest-AggregatesAdminNegativeTestJSON-1827558708-project] 10.222.0.50 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.018765 Aug 31 15:49:39.494417 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 109/240] 10.222.0.50 () {58 vars in 1143 bytes} [Wed Aug 31 15:49:39 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:49:39.501737 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ef40593e-66b8-4c3f-85d5-65712488a7a4 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-465706441"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:39.505950 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.aggregate [None req-ef40593e-66b8-4c3f-85d5-65712488a7a4 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Generated uuid 7b461a9e-a350-4a6f-937f-49ce202ae25e for aggregate {{(pid=128864) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 31 15:49:39.546772 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ef40593e-66b8-4c3f-85d5-65712488a7a4 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.048985 Aug 31 15:49:39.557440 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 132/241] 10.222.0.50 () {60 vars in 1164 bytes} [Wed Aug 31 15:49:39 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:39.561014 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-23c19619-010c-47f4-9f50-39757187b71f tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-833090-16"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:39.576108 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23c19619-010c-47f4-9f50-39757187b71f tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:39.576930 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23c19619-010c-47f4-9f50-39757187b71f tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:39.578206 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23c19619-010c-47f4-9f50-39757187b71f tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:39.698929 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e21bbba9-f971-4692-b857-c6bd0fc4d497 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:39.699651 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e21bbba9-f971-4692-b857-c6bd0fc4d497 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 848b21b2-98a0-4e70-a27c-08d390d73ae6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:39.712107 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e21bbba9-f971-4692-b857-c6bd0fc4d497 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:39.712879 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e21bbba9-f971-4692-b857-c6bd0fc4d497 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:39.714880 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e21bbba9-f971-4692-b857-c6bd0fc4d497 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:39.719472 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e21bbba9-f971-4692-b857-c6bd0fc4d497 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:39.720236 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e21bbba9-f971-4692-b857-c6bd0fc4d497 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:39.721524 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e21bbba9-f971-4692-b857-c6bd0fc4d497 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:39.802398 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-23c19619-010c-47f4-9f50-39757187b71f tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 243 microversion: 2.1 time: 0.246749 Aug 31 15:49:39.802998 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 110/242] 10.222.0.50 () {60 vars in 1194 bytes} [Wed Aug 31 15:49:39 2022] POST /compute/v2.1/os-aggregates/17/action => generated 243 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:39.817215 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-881325ef-0d85-4220-9823-e9f3da503885 tempest-AggregatesAdminNegativeTestJSON-1827558708 tempest-AggregatesAdminNegativeTestJSON-1827558708-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-833090-16"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:39.825888 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-881325ef-0d85-4220-9823-e9f3da503885 tempest-AggregatesAdminNegativeTestJSON-1827558708 tempest-AggregatesAdminNegativeTestJSON-1827558708-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '3889494b29e246c7a976d8d82629a8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61a09212572a4f1c94b30936c66011c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:39.828473 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-881325ef-0d85-4220-9823-e9f3da503885 tempest-AggregatesAdminNegativeTestJSON-1827558708 tempest-AggregatesAdminNegativeTestJSON-1827558708-project] Request method failure captured: Aug 31 15:49:39.828473 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Aug 31 15:49:39.828473 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:49:39.828473 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:49:39.828473 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:49:39.828473 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 43 Aug 31 15:49:39.828473 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:49:39.828473 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:49:39.828473 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:49:39.828473 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:49:39.828473 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4Lhg4lpkOcKmkKnllk4OB1-ElK61p9Z4zRIFQdy9z9hqOTtnr9SlgRF3vipS8KArBcBvC3p08-LaJrj6HhH8A_R_NpL7xHnKJk_7H88slOo-e_Sf2DTW8UVRhbP892MY2spRrHrWGsSzYYTonJfdPXd2Yul-UGlCwRM-4TzqsMoxxo Aug 31 15:49:39.828473 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:49:39.828473 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:49:39.828473 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:49:39.828473 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:49:39.828473 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:49:39.828473 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:49:39.828473 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 61a09212572a4f1c94b30936c66011c7 Aug 31 15:49:39.828473 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1827558708 Aug 31 15:49:39.828473 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:49:39.828473 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:49:39.829884 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/61a09212572a4f1c94b30936c66011c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/61a09212572a4f1c94b30936c66011c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/61a09212572a4f1c94b30936c66011c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_61a09212572a4f1c94b30936c66011c7", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:49:39.829884 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1827558708 Aug 31 15:49:39.829884 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 61a09212572a4f1c94b30936c66011c7 Aug 31 15:49:39.829884 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1827558708 Aug 31 15:49:39.829884 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-AggregatesAdminNegativeTestJSON-1827558708-project Aug 31 15:49:39.829884 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:49:39.829884 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:49:39.829884 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 3889494b29e246c7a976d8d82629a8b5 Aug 31 15:49:39.829884 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1827558708-project Aug 31 15:49:39.829884 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 15:49:39.829884 n-d-833090-16 devstack@n-api.service[128863]: {"remove_host": {"host": "n-h1-833090-16"}} Aug 31 15:49:39.829884 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 15:49:39.829884 n-d-833090-16 devstack@n-api.service[128863]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 31 15:49:39.830920 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h1-833090-16'}}} Aug 31 15:49:39.830920 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:49:39.830920 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:39.830920 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:39.830920 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:39.830920 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:49:39.830920 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:49:39.830920 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:49:39.830920 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:49:39.830920 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:49:39.830920 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:49:39.830920 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Aug 31 15:49:39.830920 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Aug 31 15:49:39.830920 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 15:49:39.830920 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 15:49:39.830920 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 15:49:39.830920 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 15:49:39.830920 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:49:39.830920 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:49:39.832134 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:49:39.832134 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:49:39.832134 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 15:49:39.832134 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 15:49:39.832134 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 15:49:39.832134 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 15:49:39.832134 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 15:49:39.832134 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 15:49:39.832134 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 31 15:49:39.832134 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:39.832134 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:39.832134 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:39.832134 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:39.832134 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:39.832134 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:39.832134 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 15:49:39.832134 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 15:49:39.832134 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 31 15:49:39.832134 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:39.835657 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-881325ef-0d85-4220-9823-e9f3da503885 tempest-AggregatesAdminNegativeTestJSON-1827558708 tempest-AggregatesAdminNegativeTestJSON-1827558708-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:49:39.838691 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-881325ef-0d85-4220-9823-e9f3da503885 tempest-AggregatesAdminNegativeTestJSON-1827558708 tempest-AggregatesAdminNegativeTestJSON-1827558708-project] 10.222.0.50 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.025494 Aug 31 15:49:39.841203 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 111/243] 10.222.0.50 () {60 vars in 1194 bytes} [Wed Aug 31 15:49:39 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 31 15:49:39.850452 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d89c3e85-1d68-4d54-b72f-cf0d3a7091ad tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:39.857789 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d89c3e85-1d68-4d54-b72f-cf0d3a7091ad tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:39.878800 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d89c3e85-1d68-4d54-b72f-cf0d3a7091ad tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:39.880109 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d89c3e85-1d68-4d54-b72f-cf0d3a7091ad tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:39.880548 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d89c3e85-1d68-4d54-b72f-cf0d3a7091ad tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:39.881267 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d89c3e85-1d68-4d54-b72f-cf0d3a7091ad tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:39.881716 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d89c3e85-1d68-4d54-b72f-cf0d3a7091ad tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:39.882264 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d89c3e85-1d68-4d54-b72f-cf0d3a7091ad tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:39.930068 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:49:40.207256 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d89c3e85-1d68-4d54-b72f-cf0d3a7091ad tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:40.225980 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d89c3e85-1d68-4d54-b72f-cf0d3a7091ad tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:40.232970 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d89c3e85-1d68-4d54-b72f-cf0d3a7091ad tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:40.267004 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d89c3e85-1d68-4d54-b72f-cf0d3a7091ad tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] 10.222.0.50 "GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f" status: 200 len: 1447 microversion: 2.75 time: 0.423258 Aug 31 15:49:40.285919 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 112/244] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:49:39 2022] GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f => generated 1447 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:49:40.298419 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1fc644e9-ecc6-42d7-b017-e4510d63e120 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-833090-16"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:40.318343 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1fc644e9-ecc6-42d7-b017-e4510d63e120 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:40.318836 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1fc644e9-ecc6-42d7-b017-e4510d63e120 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:40.329710 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1fc644e9-ecc6-42d7-b017-e4510d63e120 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:40.684650 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1fc644e9-ecc6-42d7-b017-e4510d63e120 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 227 microversion: 2.1 time: 0.392175 Aug 31 15:49:40.697739 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 113/245] 10.222.0.50 () {60 vars in 1194 bytes} [Wed Aug 31 15:49:40 2022] POST /compute/v2.1/os-aggregates/17/action => generated 227 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:40.709694 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d65aac71-63fe-4c01-bb51-34efc781b1a3 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:40.751136 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e21bbba9-f971-4692-b857-c6bd0fc4d497 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:40.768517 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e21bbba9-f971-4692-b857-c6bd0fc4d497 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6" status: 200 len: 1317 microversion: 2.1 time: 1.072066 Aug 31 15:49:40.774816 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 133/246] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:49:39 2022] GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6 => generated 1317 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:49:40.786738 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d65aac71-63fe-4c01-bb51-34efc781b1a3 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.080576 Aug 31 15:49:40.787334 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 114/247] 10.222.0.50 () {58 vars in 1155 bytes} [Wed Aug 31 15:49:40 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 31 15:49:40.802259 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5407eef9-32ad-49c3-9290-348abd1e3c7f tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1085614293"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:40.806654 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.aggregate [None req-5407eef9-32ad-49c3-9290-348abd1e3c7f tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Generated uuid e04b10ad-a76c-46fb-9a0b-4f78704bef09 for aggregate {{(pid=128864) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 31 15:49:40.862425 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5407eef9-32ad-49c3-9290-348abd1e3c7f tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.062571 Aug 31 15:49:40.873579 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 134/248] 10.222.0.50 () {60 vars in 1164 bytes} [Wed Aug 31 15:49:40 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:40.874574 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4b2a80f8-164d-48a5-bc02-bc5406105b6a tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:40.897695 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b2a80f8-164d-48a5-bc02-bc5406105b6a tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:40.899305 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b2a80f8-164d-48a5-bc02-bc5406105b6a tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:40.900448 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b2a80f8-164d-48a5-bc02-bc5406105b6a tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:40.944768 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b2a80f8-164d-48a5-bc02-bc5406105b6a tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:40.952267 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b2a80f8-164d-48a5-bc02-bc5406105b6a tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:40.955805 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b2a80f8-164d-48a5-bc02-bc5406105b6a tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:40.979885 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.compute.aggregates [None req-4b2a80f8-164d-48a5-bc02-bc5406105b6a tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 31 15:49:40.981271 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-4b2a80f8-164d-48a5-bc02-bc5406105b6a tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Aug 31 15:49:40.987448 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4b2a80f8-164d-48a5-bc02-bc5406105b6a tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Request method failure captured: Aug 31 15:49:40.987448 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Aug 31 15:49:40.987448 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:49:40.987448 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:49:40.987448 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:49:40.987448 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 42 Aug 31 15:49:40.987448 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:49:40.987448 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:49:40.987448 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:49:40.987448 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:49:40.987448 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4Lk3esfAPKc65t_nvTRGKegL6t97spK7u6iOZvCDDIhprzOGX96flC0EzFbJkIF5_qJGP-pD_qmJ7xAVnxlGC3Qu6aPNObBZjPmfyNqhvAyrnsg7jKQ0SqOb7J2ZHIIFO8ooJKhnG-5SvdeYWYsyP2tB9v_K_ARPJuvIwrCjlecflY Aug 31 15:49:40.987448 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:49:40.987448 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:49:40.987448 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:49:40.987448 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:49:40.987448 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:49:40.987448 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:49:40.987448 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: cd14c575cc574d65adcfe4df7bb170c1 Aug 31 15:49:40.987448 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1561922880 Aug 31 15:49:40.987448 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,admin,member Aug 31 15:49:40.987448 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,admin,member Aug 31 15:49:40.988903 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cd14c575cc574d65adcfe4df7bb170c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cd14c575cc574d65adcfe4df7bb170c1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cd14c575cc574d65adcfe4df7bb170c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cd14c575cc574d65adcfe4df7bb170c1", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:49:40.988903 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1561922880 Aug 31 15:49:40.988903 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: cd14c575cc574d65adcfe4df7bb170c1 Aug 31 15:49:40.988903 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1561922880 Aug 31 15:49:40.988903 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin Aug 31 15:49:40.988903 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:49:40.988903 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:49:40.988903 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 4c54901aa14a48e8a8c007a0d01804b2 Aug 31 15:49:40.988903 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin Aug 31 15:49:40.988903 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 15:49:40.988903 n-d-833090-16 devstack@n-api.service[128863]: {"remove_host": {"host": "nonexist_host"}} Aug 31 15:49:40.988903 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 15:49:40.988903 n-d-833090-16 devstack@n-api.service[128863]: exception: Cannot remove host nonexist_host in aggregate 18 Aug 31 15:49:40.989803 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Aug 31 15:49:40.989803 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:49:40.989803 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:40.989803 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5997, in _get_service_in_cell_by_host Aug 31 15:49:40.989803 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 31 15:49:40.989803 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 15:49:40.989803 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 15:49:40.989803 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 31 15:49:40.989803 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 31 15:49:40.989803 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 31 15:49:40.989803 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 31 15:49:40.989803 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 31 15:49:40.989803 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 31 15:49:40.989803 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Aug 31 15:49:40.989803 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:40.989803 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:40.989803 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:40.989803 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:40.989803 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6003, in _get_service_in_cell_by_host Aug 31 15:49:40.989803 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 31 15:49:40.991302 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 31 15:49:40.991302 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 31 15:49:40.991302 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 31 15:49:40.991302 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:40.991302 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:40.991302 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:40.991302 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:40.991302 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Aug 31 15:49:40.991302 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Aug 31 15:49:40.991302 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 31 15:49:40.991302 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 31 15:49:40.991302 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:49:40.991302 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:49:40.991302 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:49:40.991302 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:49:40.991302 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 31 15:49:40.991302 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 31 15:49:40.991302 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6681, in remove_host_from_aggregate Aug 31 15:49:40.991302 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Aug 31 15:49:40.991302 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Aug 31 15:49:40.992698 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 31 15:49:40.992698 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 31 15:49:40.992698 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:40.992698 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:40.992698 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:40.992698 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:40.992698 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:40.992698 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:40.992698 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:49:40.992698 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:49:40.992698 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:49:40.992698 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:49:40.992698 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:49:40.992698 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:49:40.992698 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Aug 31 15:49:40.992698 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 31 15:49:40.992698 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Aug 31 15:49:40.992698 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:40.992698 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:40.992698 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:40.992698 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:40.994138 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:40.994138 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:40.994138 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:49:40.994138 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:49:40.994138 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Aug 31 15:49:40.994138 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:40.996209 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4b2a80f8-164d-48a5-bc02-bc5406105b6a tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:49:40.999042 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4b2a80f8-164d-48a5-bc02-bc5406105b6a tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.128447 Aug 31 15:49:41.004675 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 115/249] 10.222.0.50 () {60 vars in 1194 bytes} [Wed Aug 31 15:49:40 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 31 15:49:41.013480 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-163a5462-7047-44c2-9e99-3acf3bebcbf1 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:41.062046 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-163a5462-7047-44c2-9e99-3acf3bebcbf1 tempest-AggregatesAdminNegativeTestJSON-1561922880 tempest-AggregatesAdminNegativeTestJSON-1561922880-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.052404 Aug 31 15:49:41.070647 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 135/250] 10.222.0.50 () {58 vars in 1155 bytes} [Wed Aug 31 15:49:41 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 31 15:49:41.297555 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4fd2c536-d312-436a-8199-a3296f95ad31 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:41.298592 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4fd2c536-d312-436a-8199-a3296f95ad31 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:41.311535 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4fd2c536-d312-436a-8199-a3296f95ad31 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:41.318953 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4fd2c536-d312-436a-8199-a3296f95ad31 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:41.320381 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4fd2c536-d312-436a-8199-a3296f95ad31 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:41.321290 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4fd2c536-d312-436a-8199-a3296f95ad31 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:41.328552 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4fd2c536-d312-436a-8199-a3296f95ad31 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:41.329242 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4fd2c536-d312-436a-8199-a3296f95ad31 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:41.631374 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4fd2c536-d312-436a-8199-a3296f95ad31 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:41.646733 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4fd2c536-d312-436a-8199-a3296f95ad31 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:41.648174 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4fd2c536-d312-436a-8199-a3296f95ad31 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:41.667681 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4fd2c536-d312-436a-8199-a3296f95ad31 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] 10.222.0.50 "GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f" status: 200 len: 1447 microversion: 2.75 time: 0.374498 Aug 31 15:49:41.668757 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 116/251] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:49:41 2022] GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f => generated 1447 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:49:41.804448 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-83820673-3cc4-46fb-b300-b3528cb4baea tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:41.805636 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-83820673-3cc4-46fb-b300-b3528cb4baea tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 848b21b2-98a0-4e70-a27c-08d390d73ae6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:41.823986 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83820673-3cc4-46fb-b300-b3528cb4baea tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:41.825806 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83820673-3cc4-46fb-b300-b3528cb4baea tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:41.832604 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83820673-3cc4-46fb-b300-b3528cb4baea tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:41.834012 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83820673-3cc4-46fb-b300-b3528cb4baea tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:41.834782 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83820673-3cc4-46fb-b300-b3528cb4baea tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:41.846807 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83820673-3cc4-46fb-b300-b3528cb4baea tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:42.410465 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-83820673-3cc4-46fb-b300-b3528cb4baea tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:42.421419 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-83820673-3cc4-46fb-b300-b3528cb4baea tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6" status: 200 len: 1317 microversion: 2.1 time: 0.621452 Aug 31 15:49:42.423433 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 136/252] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:49:41 2022] GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6 => generated 1317 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:42.696729 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4fb5b742-962f-47e3-a84d-2d68a4b2d8fc tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:42.698167 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4fb5b742-962f-47e3-a84d-2d68a4b2d8fc tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:42.705102 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4fb5b742-962f-47e3-a84d-2d68a4b2d8fc tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:42.711475 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4fb5b742-962f-47e3-a84d-2d68a4b2d8fc tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:42.718532 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4fb5b742-962f-47e3-a84d-2d68a4b2d8fc tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:42.720111 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4fb5b742-962f-47e3-a84d-2d68a4b2d8fc tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:42.721767 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4fb5b742-962f-47e3-a84d-2d68a4b2d8fc tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:42.724138 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4fb5b742-962f-47e3-a84d-2d68a4b2d8fc tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:42.898637 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4fb5b742-962f-47e3-a84d-2d68a4b2d8fc tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:42.914442 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4fb5b742-962f-47e3-a84d-2d68a4b2d8fc tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:42.918875 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4fb5b742-962f-47e3-a84d-2d68a4b2d8fc tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:42.936462 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4fb5b742-962f-47e3-a84d-2d68a4b2d8fc tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] 10.222.0.50 "GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f" status: 200 len: 1447 microversion: 2.75 time: 0.242754 Aug 31 15:49:42.940178 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 117/253] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:49:42 2022] GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f => generated 1447 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:49:43.445504 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-24c373f3-4ba0-404b-aa02-2edcc03ed8b6 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:43.446872 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-24c373f3-4ba0-404b-aa02-2edcc03ed8b6 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 848b21b2-98a0-4e70-a27c-08d390d73ae6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:43.457879 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-24c373f3-4ba0-404b-aa02-2edcc03ed8b6 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:43.461999 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-24c373f3-4ba0-404b-aa02-2edcc03ed8b6 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:43.462688 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-24c373f3-4ba0-404b-aa02-2edcc03ed8b6 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:43.463577 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-24c373f3-4ba0-404b-aa02-2edcc03ed8b6 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:43.464177 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-24c373f3-4ba0-404b-aa02-2edcc03ed8b6 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:43.466680 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-24c373f3-4ba0-404b-aa02-2edcc03ed8b6 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:43.553206 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-135aabcb-674c-487f-87dd-e237edb0e054 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Action: 'create', calling method: .version_select at 0x7fbb473225e0>, body: {"keypair": {"name": "tempest-keypair-1280244927", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGM79ycBcC3gK7Ng9KT11sfI1a2QxeYHeooTuOirc+l0PbQbMrh34MRxtOHJh3NKhNBZx+tufr0F1ixlDcCz5FLN4Z2TdbOLzR7R9QCYw68DexNZ4Q9KFbBHgvJs1fM7Qw=="}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:43.626884 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-135aabcb-674c-487f-87dd-e237edb0e054 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Getting quotas for project 8a08078ba5a04c31b6cc63dee67be8c4. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:49:43.643446 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-135aabcb-674c-487f-87dd-e237edb0e054 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Getting quotas for user 704d7c428d3e4a1bbe5fb78485415214 and project 8a08078ba5a04c31b6cc63dee67be8c4. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:49:43.738384 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-135aabcb-674c-487f-87dd-e237edb0e054 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.613743 Aug 31 15:49:43.739578 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 137/254] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 31 15:49:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:43.968779 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f1081d99-2d21-4129-b256-de83b9984f73 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:43.970759 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f1081d99-2d21-4129-b256-de83b9984f73 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:43.979094 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f1081d99-2d21-4129-b256-de83b9984f73 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:43.979890 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f1081d99-2d21-4129-b256-de83b9984f73 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:43.981043 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f1081d99-2d21-4129-b256-de83b9984f73 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:43.982045 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f1081d99-2d21-4129-b256-de83b9984f73 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:43.983631 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f1081d99-2d21-4129-b256-de83b9984f73 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:43.984826 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f1081d99-2d21-4129-b256-de83b9984f73 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:44.372976 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-24c373f3-4ba0-404b-aa02-2edcc03ed8b6 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:44.382131 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-24c373f3-4ba0-404b-aa02-2edcc03ed8b6 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6" status: 200 len: 1317 microversion: 2.1 time: 0.941120 Aug 31 15:49:44.382737 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 118/255] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:49:43 2022] GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6 => generated 1317 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:49:44.402681 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f1081d99-2d21-4129-b256-de83b9984f73 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:44.420577 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f1081d99-2d21-4129-b256-de83b9984f73 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:44.424578 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f1081d99-2d21-4129-b256-de83b9984f73 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:44.455517 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f1081d99-2d21-4129-b256-de83b9984f73 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] 10.222.0.50 "GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f" status: 200 len: 1447 microversion: 2.75 time: 0.491573 Aug 31 15:49:44.460277 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 138/256] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:49:43 2022] GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f => generated 1447 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:49:45.407554 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bfb98aa8-ae0b-45a1-aca3-82a1d20f1648 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:45.409273 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bfb98aa8-ae0b-45a1-aca3-82a1d20f1648 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 848b21b2-98a0-4e70-a27c-08d390d73ae6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:45.424656 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfb98aa8-ae0b-45a1-aca3-82a1d20f1648 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:45.426457 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfb98aa8-ae0b-45a1-aca3-82a1d20f1648 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:45.427851 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfb98aa8-ae0b-45a1-aca3-82a1d20f1648 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:45.433980 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfb98aa8-ae0b-45a1-aca3-82a1d20f1648 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:45.436700 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfb98aa8-ae0b-45a1-aca3-82a1d20f1648 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:45.439046 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfb98aa8-ae0b-45a1-aca3-82a1d20f1648 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:45.486450 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a219e27b-f2fc-4017-8a4e-3d8c51a2f1eb tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:45.488410 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a219e27b-f2fc-4017-8a4e-3d8c51a2f1eb tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:45.524801 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a219e27b-f2fc-4017-8a4e-3d8c51a2f1eb tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:45.525322 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a219e27b-f2fc-4017-8a4e-3d8c51a2f1eb tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:45.525769 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a219e27b-f2fc-4017-8a4e-3d8c51a2f1eb tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:45.526529 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a219e27b-f2fc-4017-8a4e-3d8c51a2f1eb tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:45.526975 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a219e27b-f2fc-4017-8a4e-3d8c51a2f1eb tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:45.527391 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a219e27b-f2fc-4017-8a4e-3d8c51a2f1eb tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:45.829077 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a219e27b-f2fc-4017-8a4e-3d8c51a2f1eb tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:45.838772 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a219e27b-f2fc-4017-8a4e-3d8c51a2f1eb tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:45.849923 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a219e27b-f2fc-4017-8a4e-3d8c51a2f1eb tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:45.867030 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a219e27b-f2fc-4017-8a4e-3d8c51a2f1eb tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] 10.222.0.50 "GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f" status: 200 len: 1447 microversion: 2.75 time: 0.388128 Aug 31 15:49:45.890199 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 139/257] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:49:45 2022] GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f => generated 1447 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:49:46.000521 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bfb98aa8-ae0b-45a1-aca3-82a1d20f1648 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:46.013452 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bfb98aa8-ae0b-45a1-aca3-82a1d20f1648 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6" status: 200 len: 1317 microversion: 2.1 time: 0.609557 Aug 31 15:49:46.016479 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 119/258] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:49:45 2022] GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6 => generated 1317 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:46.900454 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-08920b90-6c51-4725-b2e6-b91dce217e5c tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:46.901670 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-08920b90-6c51-4725-b2e6-b91dce217e5c tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:46.913372 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-08920b90-6c51-4725-b2e6-b91dce217e5c tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:46.916092 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-08920b90-6c51-4725-b2e6-b91dce217e5c tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:46.916722 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-08920b90-6c51-4725-b2e6-b91dce217e5c tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:46.918909 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-08920b90-6c51-4725-b2e6-b91dce217e5c tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:46.924291 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-08920b90-6c51-4725-b2e6-b91dce217e5c tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:46.924920 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-08920b90-6c51-4725-b2e6-b91dce217e5c tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:47.039311 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1c61299b-c307-4ccc-a731-a0b7d8f968c7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:47.040635 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1c61299b-c307-4ccc-a731-a0b7d8f968c7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 848b21b2-98a0-4e70-a27c-08d390d73ae6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:47.052599 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c61299b-c307-4ccc-a731-a0b7d8f968c7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:47.053972 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c61299b-c307-4ccc-a731-a0b7d8f968c7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:47.056866 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c61299b-c307-4ccc-a731-a0b7d8f968c7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:47.057765 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c61299b-c307-4ccc-a731-a0b7d8f968c7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:47.059524 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c61299b-c307-4ccc-a731-a0b7d8f968c7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:47.075255 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-08920b90-6c51-4725-b2e6-b91dce217e5c tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:47.080006 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c61299b-c307-4ccc-a731-a0b7d8f968c7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:47.089874 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-08920b90-6c51-4725-b2e6-b91dce217e5c tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:47.099790 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-08920b90-6c51-4725-b2e6-b91dce217e5c tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:47.123148 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-08920b90-6c51-4725-b2e6-b91dce217e5c tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] 10.222.0.50 "GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f" status: 200 len: 1447 microversion: 2.75 time: 0.228716 Aug 31 15:49:47.148611 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 140/259] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:49:46 2022] GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f => generated 1447 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:49:47.617899 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1c61299b-c307-4ccc-a731-a0b7d8f968c7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:47.638274 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1c61299b-c307-4ccc-a731-a0b7d8f968c7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6" status: 200 len: 1317 microversion: 2.1 time: 0.605725 Aug 31 15:49:47.644413 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 120/260] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:49:47 2022] GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6 => generated 1317 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:49:48.144270 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1af792f5-9f0f-4345-8301-d08d97c9a144 tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-440508431", "id": 1690702921, "os-flavor-access:is_public": "True"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:48.175534 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5567f144-b984-40a8-b506-5ce8a8d1acd5 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Calling method '.version_select at 0x7fbb471c4820>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:48.178140 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=2,nova_api:DELETE=6,nova_api:INSERT=6 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:49:48.178447 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5567f144-b984-40a8-b506-5ce8a8d1acd5 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:48.179340 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5567f144-b984-40a8-b506-5ce8a8d1acd5 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:48.180216 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5567f144-b984-40a8-b506-5ce8a8d1acd5 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:48.196189 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1af792f5-9f0f-4345-8301-d08d97c9a144 tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.379050 Aug 31 15:49:48.204800 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 141/261] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:49:47 2022] POST /compute/v2.1/flavors => generated 429 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:48.214154 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-99415b41-7bb7-4fe9-bfe4-b783fd931a64 req-1ad3675a-c514-48ed-9d0d-c32b245b04f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "848b21b2-98a0-4e70-a27c-08d390d73ae6", "name": "network-vif-plugged", "status": "completed", "tag": "dd829db9-9a09-4434-b55f-8bb2e13964a3"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:48.237008 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5567f144-b984-40a8-b506-5ce8a8d1acd5 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:48.237506 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5567f144-b984-40a8-b506-5ce8a8d1acd5 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:48.238006 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5567f144-b984-40a8-b506-5ce8a8d1acd5 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:48.243913 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=3 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:49:48.250584 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-99415b41-7bb7-4fe9-bfe4-b783fd931a64 req-1ad3675a-c514-48ed-9d0d-c32b245b04f7 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:48.251506 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-99415b41-7bb7-4fe9-bfe4-b783fd931a64 req-1ad3675a-c514-48ed-9d0d-c32b245b04f7 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:48.252040 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-99415b41-7bb7-4fe9-bfe4-b783fd931a64 req-1ad3675a-c514-48ed-9d0d-c32b245b04f7 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:48.287988 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-99415b41-7bb7-4fe9-bfe4-b783fd931a64 req-1ad3675a-c514-48ed-9d0d-c32b245b04f7 service nova] Creating event network-vif-plugged:dd829db9-9a09-4434-b55f-8bb2e13964a3 for instance 848b21b2-98a0-4e70-a27c-08d390d73ae6 on n-h2-833090-16 Aug 31 15:49:48.288294 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5567f144-b984-40a8-b506-5ce8a8d1acd5 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:48.288835 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5567f144-b984-40a8-b506-5ce8a8d1acd5 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:48.293829 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5567f144-b984-40a8-b506-5ce8a8d1acd5 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:48.304810 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-99415b41-7bb7-4fe9-bfe4-b783fd931a64 req-1ad3675a-c514-48ed-9d0d-c32b245b04f7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098562 Aug 31 15:49:48.309477 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5567f144-b984-40a8-b506-5ce8a8d1acd5 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.414899 Aug 31 15:49:48.310188 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 142/262] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:49:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:48.325635 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-797e0c57-6369-4fb5-9886-f47b8c73670e tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:48.328231 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-797e0c57-6369-4fb5-9886-f47b8c73670e tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:48.330341 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 121/263] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 31 15:49:47 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:48.347360 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-66ff7bb1-c195-4ac6-bdb8-4d04850ceecb tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:48.349823 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-797e0c57-6369-4fb5-9886-f47b8c73670e tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:48.350551 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-797e0c57-6369-4fb5-9886-f47b8c73670e tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:48.358353 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-797e0c57-6369-4fb5-9886-f47b8c73670e tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:48.359639 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-797e0c57-6369-4fb5-9886-f47b8c73670e tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:48.360704 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-797e0c57-6369-4fb5-9886-f47b8c73670e tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:48.361139 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-797e0c57-6369-4fb5-9886-f47b8c73670e tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:48.381131 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-66ff7bb1-c195-4ac6-bdb8-4d04850ceecb tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1690702921" status: 202 len: 0 microversion: 2.1 time: 0.049041 Aug 31 15:49:48.383235 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 122/264] 10.222.0.50 () {58 vars in 1161 bytes} [Wed Aug 31 15:49:48 2022] DELETE /compute/v2.1/flavors/1690702921 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:49:48.390047 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-efcf65c9-c7fb-47cf-8f16-769f705918e4 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Calling method '.version_select at 0x7fbb471c4310>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:48.393338 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-efcf65c9-c7fb-47cf-8f16-769f705918e4 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:48.394122 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-efcf65c9-c7fb-47cf-8f16-769f705918e4 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:48.406637 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-efcf65c9-c7fb-47cf-8f16-769f705918e4 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:48.425197 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-efcf65c9-c7fb-47cf-8f16-769f705918e4 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:48.427140 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-efcf65c9-c7fb-47cf-8f16-769f705918e4 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:48.427814 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-efcf65c9-c7fb-47cf-8f16-769f705918e4 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:48.445822 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-efcf65c9-c7fb-47cf-8f16-769f705918e4 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:48.446841 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-efcf65c9-c7fb-47cf-8f16-769f705918e4 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:48.447524 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-efcf65c9-c7fb-47cf-8f16-769f705918e4 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:48.456975 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-efcf65c9-c7fb-47cf-8f16-769f705918e4 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1508 microversion: 2.1 time: 0.072210 Aug 31 15:49:48.477077 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 123/265] 10.222.0.50 () {58 vars in 1167 bytes} [Wed Aug 31 15:49:48 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1508 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:48.490113 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-65616431-65fa-4a4e-9bfe-4d94baa3df76 tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:48.566401 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-65616431-65fa-4a4e-9bfe-4d94baa3df76 tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.083893 Aug 31 15:49:48.567238 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 124/266] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 31 15:49:48 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:48.572833 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7c3e7c67-3f26-4ace-8013-a12e17c6f86a tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1831251589", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "b3fd157f-8b8c-402c-9ab7-9d2e22e7328a"}], "security_groups": [{"name": "tempest-securitygroup--1801088292"}], "key_name": "tempest-keypair-1280244927", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:48.650005 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-797e0c57-6369-4fb5-9886-f47b8c73670e tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:48.661309 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-797e0c57-6369-4fb5-9886-f47b8c73670e tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:48.668044 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-797e0c57-6369-4fb5-9886-f47b8c73670e tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:48.686791 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-797e0c57-6369-4fb5-9886-f47b8c73670e tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] 10.222.0.50 "GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f" status: 200 len: 1447 microversion: 2.75 time: 0.368414 Aug 31 15:49:48.691905 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 143/267] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:49:48 2022] GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f => generated 1447 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:49:48.699346 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c431a200-ef35-453c-8a98-e0472fbc1b5d tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Calling method '.version_select at 0x7fbb473220d0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:48.702856 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c431a200-ef35-453c-8a98-e0472fbc1b5d tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:48.703550 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c431a200-ef35-453c-8a98-e0472fbc1b5d tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:48.704351 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c431a200-ef35-453c-8a98-e0472fbc1b5d tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:48.737387 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c431a200-ef35-453c-8a98-e0472fbc1b5d tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:48.737884 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c431a200-ef35-453c-8a98-e0472fbc1b5d tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:48.738333 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c431a200-ef35-453c-8a98-e0472fbc1b5d tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:48.756811 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c431a200-ef35-453c-8a98-e0472fbc1b5d tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:48.757867 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c431a200-ef35-453c-8a98-e0472fbc1b5d tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:48.758959 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c431a200-ef35-453c-8a98-e0472fbc1b5d tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:48.768857 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c431a200-ef35-453c-8a98-e0472fbc1b5d tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.074019 Aug 31 15:49:48.769868 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 144/268] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 31 15:49:48 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:48.777559 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-191a4155-ea52-4a83-8886-2cf78c9a562a tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1613583096", "id": 1939227604, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:48.807159 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-191a4155-ea52-4a83-8886-2cf78c9a562a tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 417 microversion: 2.1 time: 0.035419 Aug 31 15:49:48.809193 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 145/269] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:49:48 2022] POST /compute/v2.1/flavors => generated 417 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:48.835824 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6f0acd4e-a947-42f4-a0a0-8b6262b42958 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:48.843318 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6f0acd4e-a947-42f4-a0a0-8b6262b42958 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 848b21b2-98a0-4e70-a27c-08d390d73ae6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:48.861866 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f0acd4e-a947-42f4-a0a0-8b6262b42958 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:48.862392 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f0acd4e-a947-42f4-a0a0-8b6262b42958 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:48.862822 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f0acd4e-a947-42f4-a0a0-8b6262b42958 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:48.863539 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f0acd4e-a947-42f4-a0a0-8b6262b42958 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:48.864011 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f0acd4e-a947-42f4-a0a0-8b6262b42958 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:48.864427 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f0acd4e-a947-42f4-a0a0-8b6262b42958 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:48.912686 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-7c3e7c67-3f26-4ace-8013-a12e17c6f86a tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] validate_networks() for [('b3fd157f-8b8c-402c-9ab7-9d2e22e7328a', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:49:49.595880 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6f0acd4e-a947-42f4-a0a0-8b6262b42958 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:49.609973 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6f0acd4e-a947-42f4-a0a0-8b6262b42958 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6" status: 200 len: 1317 microversion: 2.1 time: 0.792409 Aug 31 15:49:49.626515 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 146/270] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:49:48 2022] GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6 => generated 1317 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:49.633357 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e2babe2e-2d12-4215-af23-743c7075a8ee tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Calling method '.version_select at 0x7fbb47322160>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:49.640503 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e2babe2e-2d12-4215-af23-743c7075a8ee tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:49.643217 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e2babe2e-2d12-4215-af23-743c7075a8ee tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:49.643666 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e2babe2e-2d12-4215-af23-743c7075a8ee tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:49.680276 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e2babe2e-2d12-4215-af23-743c7075a8ee tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:49.680881 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e2babe2e-2d12-4215-af23-743c7075a8ee tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:49.684597 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e2babe2e-2d12-4215-af23-743c7075a8ee tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:49.718187 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e2babe2e-2d12-4215-af23-743c7075a8ee tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 759 microversion: 2.1 time: 0.096615 Aug 31 15:49:49.719953 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 147/271] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Aug 31 15:49:49 2022] GET /compute/v2.1/os-hypervisors/1 => generated 759 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:49.739363 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9ced2e02-3b88-4102-8638-57b63dcf06ed tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:49.816816 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9ced2e02-3b88-4102-8638-57b63dcf06ed tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5398 microversion: 2.1 time: 0.095151 Aug 31 15:49:49.822883 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 148/272] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 31 15:49:49 2022] GET /compute/v2.1/flavors/detail => generated 5398 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:49.835194 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-292f5801-5e7b-49fa-bdc0-c1a42173e332 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:49.836273 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-292f5801-5e7b-49fa-bdc0-c1a42173e332 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:49.844722 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-292f5801-5e7b-49fa-bdc0-c1a42173e332 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:49.845556 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-292f5801-5e7b-49fa-bdc0-c1a42173e332 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:49.846225 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-292f5801-5e7b-49fa-bdc0-c1a42173e332 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:49.847478 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-292f5801-5e7b-49fa-bdc0-c1a42173e332 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:49.848126 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-292f5801-5e7b-49fa-bdc0-c1a42173e332 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:49.848827 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-292f5801-5e7b-49fa-bdc0-c1a42173e332 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:50.020316 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-292f5801-5e7b-49fa-bdc0-c1a42173e332 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:50.032024 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-292f5801-5e7b-49fa-bdc0-c1a42173e332 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:50.043820 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-292f5801-5e7b-49fa-bdc0-c1a42173e332 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:50.079632 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-292f5801-5e7b-49fa-bdc0-c1a42173e332 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] 10.222.0.50 "GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f" status: 200 len: 1447 microversion: 2.75 time: 0.253603 Aug 31 15:49:50.081978 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 149/273] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:49:49 2022] GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f => generated 1447 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:49:50.094912 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1be13f91-d898-4b0f-b1d4-3751b814dc04 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Calling method '.version_select at 0x7fbb47045f70>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:50.097730 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1be13f91-d898-4b0f-b1d4-3751b814dc04 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:50.103158 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1be13f91-d898-4b0f-b1d4-3751b814dc04 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:50.114723 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1be13f91-d898-4b0f-b1d4-3751b814dc04 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:50.149184 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1be13f91-d898-4b0f-b1d4-3751b814dc04 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.063563 Aug 31 15:49:50.149904 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 150/274] 10.222.0.50 () {58 vars in 1179 bytes} [Wed Aug 31 15:49:50 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:50.156323 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-45d5df9a-c632-4a42-9d29-bf341fca293e tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:50.179451 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-45d5df9a-c632-4a42-9d29-bf341fca293e tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1939227604" status: 202 len: 0 microversion: 2.1 time: 0.028263 Aug 31 15:49:50.192895 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 151/275] 10.222.0.50 () {58 vars in 1161 bytes} [Wed Aug 31 15:49:50 2022] DELETE /compute/v2.1/flavors/1939227604 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:49:50.205990 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e7fc2e4b-5623-4022-a393-78a1489d6204 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Calling method '.version_select at 0x7fbb473220d0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:50.217955 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7fc2e4b-5623-4022-a393-78a1489d6204 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:50.225497 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7fc2e4b-5623-4022-a393-78a1489d6204 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:50.226511 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7fc2e4b-5623-4022-a393-78a1489d6204 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:50.280785 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7fc2e4b-5623-4022-a393-78a1489d6204 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:50.283426 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7fc2e4b-5623-4022-a393-78a1489d6204 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:50.284124 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7fc2e4b-5623-4022-a393-78a1489d6204 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:50.324941 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7fc2e4b-5623-4022-a393-78a1489d6204 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:50.326982 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7fc2e4b-5623-4022-a393-78a1489d6204 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:50.329499 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7fc2e4b-5623-4022-a393-78a1489d6204 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:50.341066 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e7fc2e4b-5623-4022-a393-78a1489d6204 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.143849 Aug 31 15:49:50.342332 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 152/276] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 31 15:49:50 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:50.347147 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4a54c3a2-8ced-40e4-9b2b-a12c9fda013c tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:50.391960 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4a54c3a2-8ced-40e4-9b2b-a12c9fda013c tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.048241 Aug 31 15:49:50.406039 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 153/277] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 31 15:49:50 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:50.406039 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5028969b-9df1-44b7-a6be-be4aca797ce7 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Calling method '.version_select at 0x7fbb470454c0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:50.412203 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5028969b-9df1-44b7-a6be-be4aca797ce7 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:50.412686 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5028969b-9df1-44b7-a6be-be4aca797ce7 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:50.413435 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5028969b-9df1-44b7-a6be-be4aca797ce7 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:50.445082 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5028969b-9df1-44b7-a6be-be4aca797ce7 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:50.445522 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5028969b-9df1-44b7-a6be-be4aca797ce7 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:50.445940 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5028969b-9df1-44b7-a6be-be4aca797ce7 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:50.464853 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5028969b-9df1-44b7-a6be-be4aca797ce7 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 759 microversion: 2.1 time: 0.066798 Aug 31 15:49:50.465234 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 154/278] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Aug 31 15:49:50 2022] GET /compute/v2.1/os-hypervisors/1 => generated 759 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:50.479922 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fec0b565-7fe7-4e38-a883-9f8c1af05d81 tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1115479011", "id": 651587748, "os-flavor-access:is_public": "True"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:50.527377 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fec0b565-7fe7-4e38-a883-9f8c1af05d81 tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.061128 Aug 31 15:49:50.532527 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 155/279] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:49:50 2022] POST /compute/v2.1/flavors => generated 426 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:50.542258 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-cd047389-3ed2-4313-8ef7-a1a645e95f61 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Calling method '.version_select at 0x7fbb47409d30>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:50.544531 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cd047389-3ed2-4313-8ef7-a1a645e95f61 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:50.544613 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cd047389-3ed2-4313-8ef7-a1a645e95f61 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:50.545065 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cd047389-3ed2-4313-8ef7-a1a645e95f61 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:50.585191 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cd047389-3ed2-4313-8ef7-a1a645e95f61 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:50.585684 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cd047389-3ed2-4313-8ef7-a1a645e95f61 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:50.592309 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cd047389-3ed2-4313-8ef7-a1a645e95f61 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:50.607962 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-cd047389-3ed2-4313-8ef7-a1a645e95f61 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 760 microversion: 2.1 time: 0.074273 Aug 31 15:49:50.611604 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 156/280] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Aug 31 15:49:50 2022] GET /compute/v2.1/os-hypervisors/2 => generated 760 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:50.620624 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-999cdf5c-2009-472d-8b68-afff03728e38 tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:50.671640 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-999cdf5c-2009-472d-8b68-afff03728e38 tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/651587748" status: 202 len: 0 microversion: 2.1 time: 0.058706 Aug 31 15:49:50.673010 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 157/281] 10.222.0.50 () {58 vars in 1158 bytes} [Wed Aug 31 15:49:50 2022] DELETE /compute/v2.1/flavors/651587748 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:49:50.682184 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f8470882-3eb7-4048-96c4-ecbe36ff22b0 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Calling method '.version_select at 0x7fbb472c2160>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:50.687962 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f8470882-3eb7-4048-96c4-ecbe36ff22b0 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:50.689724 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f8470882-3eb7-4048-96c4-ecbe36ff22b0 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:50.692984 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f8470882-3eb7-4048-96c4-ecbe36ff22b0 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:50.723808 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f8470882-3eb7-4048-96c4-ecbe36ff22b0 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:50.725884 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f8470882-3eb7-4048-96c4-ecbe36ff22b0 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:50.726564 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f8470882-3eb7-4048-96c4-ecbe36ff22b0 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:50.754417 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f8470882-3eb7-4048-96c4-ecbe36ff22b0 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:50.755287 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f8470882-3eb7-4048-96c4-ecbe36ff22b0 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:50.758187 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f8470882-3eb7-4048-96c4-ecbe36ff22b0 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:50.810197 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f8470882-3eb7-4048-96c4-ecbe36ff22b0 tempest-HypervisorAdminTestJSON-1064221537 tempest-HypervisorAdminTestJSON-1064221537-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 176 microversion: 2.1 time: 0.135430 Aug 31 15:49:50.820054 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 158/282] 10.222.0.50 () {58 vars in 1173 bytes} [Wed Aug 31 15:49:50 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 176 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:50.827994 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5c1d52c1-e168-4df0-9d29-40d386484db8 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:50.828782 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5c1d52c1-e168-4df0-9d29-40d386484db8 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 848b21b2-98a0-4e70-a27c-08d390d73ae6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:50.836455 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5c1d52c1-e168-4df0-9d29-40d386484db8 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:50.836964 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5c1d52c1-e168-4df0-9d29-40d386484db8 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:50.837445 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5c1d52c1-e168-4df0-9d29-40d386484db8 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:50.838282 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5c1d52c1-e168-4df0-9d29-40d386484db8 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:50.838813 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5c1d52c1-e168-4df0-9d29-40d386484db8 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:50.839231 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5c1d52c1-e168-4df0-9d29-40d386484db8 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:50.929804 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:49:50.974937 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-7c3e7c67-3f26-4ace-8013-a12e17c6f86a tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:49:50.975833 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-7c3e7c67-3f26-4ace-8013-a12e17c6f86a tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:49:50.976442 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-7c3e7c67-3f26-4ace-8013-a12e17c6f86a tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:49:50.977144 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-7c3e7c67-3f26-4ace-8013-a12e17c6f86a tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:49:50.977706 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-7c3e7c67-3f26-4ace-8013-a12e17c6f86a tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:49:51.001970 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c3e7c67-3f26-4ace-8013-a12e17c6f86a tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:51.003932 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c3e7c67-3f26-4ace-8013-a12e17c6f86a tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:51.004494 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c3e7c67-3f26-4ace-8013-a12e17c6f86a tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:51.006449 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c3e7c67-3f26-4ace-8013-a12e17c6f86a tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:51.008745 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c3e7c67-3f26-4ace-8013-a12e17c6f86a tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:51.011051 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c3e7c67-3f26-4ace-8013-a12e17c6f86a tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:51.056329 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-7c3e7c67-3f26-4ace-8013-a12e17c6f86a tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Getting quotas for project 8a08078ba5a04c31b6cc63dee67be8c4. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:49:51.066201 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-7c3e7c67-3f26-4ace-8013-a12e17c6f86a tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Getting quotas for user 704d7c428d3e4a1bbe5fb78485415214 and project 8a08078ba5a04c31b6cc63dee67be8c4. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:49:51.087064 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7c3e7c67-3f26-4ace-8013-a12e17c6f86a tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:49:51.090412 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7c3e7c67-3f26-4ace-8013-a12e17c6f86a tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] [instance: 1e8fdb86-13be-42a3-a7af-5d50024f7419] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:49:51.160092 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7c3e7c67-3f26-4ace-8013-a12e17c6f86a tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.591483 Aug 31 15:49:51.161610 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 125/283] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:49:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 2593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 15:49:51.167943 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-08ead630-6aad-4ce3-8721-a8fc74bc876e tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:51.216359 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-08ead630-6aad-4ce3-8721-a8fc74bc876e tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.052834 Aug 31 15:49:51.217906 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 126/284] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 31 15:49:51 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:51.223648 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5dcaf044-3115-4cf5-976a-f24d8709ccbb tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:51.225254 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5dcaf044-3115-4cf5-976a-f24d8709ccbb tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:51.232237 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5dcaf044-3115-4cf5-976a-f24d8709ccbb tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:51.234530 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5dcaf044-3115-4cf5-976a-f24d8709ccbb tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:51.235248 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5dcaf044-3115-4cf5-976a-f24d8709ccbb tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:51.237236 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5dcaf044-3115-4cf5-976a-f24d8709ccbb tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:51.237899 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5dcaf044-3115-4cf5-976a-f24d8709ccbb tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:51.238680 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5dcaf044-3115-4cf5-976a-f24d8709ccbb tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:51.470749 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5dcaf044-3115-4cf5-976a-f24d8709ccbb tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:51.489954 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5dcaf044-3115-4cf5-976a-f24d8709ccbb tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:51.495933 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5dcaf044-3115-4cf5-976a-f24d8709ccbb tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:51.513106 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5dcaf044-3115-4cf5-976a-f24d8709ccbb tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] 10.222.0.50 "GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f" status: 200 len: 1447 microversion: 2.75 time: 0.286883 Aug 31 15:49:51.525586 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 127/285] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:49:51 2022] GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f => generated 1447 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:49:51.553873 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8085fdef-a8fa-4b92-8fb6-88a99cf25ae1 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:51.556689 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8085fdef-a8fa-4b92-8fb6-88a99cf25ae1 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] [instance: 1e8fdb86-13be-42a3-a7af-5d50024f7419] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:51.571223 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5c1d52c1-e168-4df0-9d29-40d386484db8 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:51.577487 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=84,nova_api:DELETE=10 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:49:51.593797 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5c1d52c1-e168-4df0-9d29-40d386484db8 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6" status: 200 len: 1466 microversion: 2.1 time: 0.770982 Aug 31 15:49:51.597655 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 159/286] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:49:50 2022] GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6 => generated 1466 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:51.629764 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-15a432c0-c2d0-4625-bbd7-98a03aef9579 tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-87706654", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:51.704296 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-15a432c0-c2d0-4625-bbd7-98a03aef9579 tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 505 microversion: 2.1 time: 0.104048 Aug 31 15:49:51.710241 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 160/287] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:49:51 2022] POST /compute/v2.1/flavors => generated 505 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:51.935606 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8085fdef-a8fa-4b92-8fb6-88a99cf25ae1 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704d7c428d3e4a1bbe5fb78485415214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a08078ba5a04c31b6cc63dee67be8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:51.944825 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8085fdef-a8fa-4b92-8fb6-88a99cf25ae1 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] 10.222.0.50 "GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419" status: 200 len: 1242 microversion: 2.1 time: 0.417918 Aug 31 15:49:51.949469 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 128/288] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:49:51 2022] GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419 => generated 1242 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:51.967754 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-82861abd-3b41-40bb-9e28-2405b7a61487 tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:52.076371 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-82861abd-3b41-40bb-9e28-2405b7a61487 tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/b8d9bdf7-5ce2-444a-8e93-ed2885d20c29" status: 202 len: 0 microversion: 2.1 time: 0.123817 Aug 31 15:49:52.088874 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 129/289] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:49:51 2022] DELETE /compute/v2.1/flavors/b8d9bdf7-5ce2-444a-8e93-ed2885d20c29 => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:49:52.111875 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bfd205db-2040-4719-b66e-05d79790128f tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:52.208908 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bfd205db-2040-4719-b66e-05d79790128f tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.115224 Aug 31 15:49:52.214873 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 130/290] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 31 15:49:52 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:52.237545 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-94065d95-b617-4f67-925a-c73d5eaab270 tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1221687539", "id": "d27b5306-9602-4da6-8bed-a50ec09b20f5", "os-flavor-access:is_public": "True"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:52.308161 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-94065d95-b617-4f67-925a-c73d5eaab270 tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.073797 Aug 31 15:49:52.312549 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 131/291] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:49:52 2022] POST /compute/v2.1/flavors => generated 507 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:49:52.331601 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3bbc3b16-007f-4bfc-800a-d18d1a43aab4 tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:52.406937 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3bbc3b16-007f-4bfc-800a-d18d1a43aab4 tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/d27b5306-9602-4da6-8bed-a50ec09b20f5" status: 202 len: 0 microversion: 2.1 time: 0.087505 Aug 31 15:49:52.408034 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 132/292] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:49:52 2022] DELETE /compute/v2.1/flavors/d27b5306-9602-4da6-8bed-a50ec09b20f5 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:49:52.420760 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-627a6c13-4b11-4e33-9109-a79053a6eb14 tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:52.451207 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0ef15377-cddb-4770-af8d-70cbe830e9dd tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:52.451872 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0ef15377-cddb-4770-af8d-70cbe830e9dd tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] [instance: 848b21b2-98a0-4e70-a27c-08d390d73ae6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:52.459638 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-627a6c13-4b11-4e33-9109-a79053a6eb14 tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.045465 Aug 31 15:49:52.460944 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 133/293] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 31 15:49:52 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:49:52.469990 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0ef15377-cddb-4770-af8d-70cbe830e9dd tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:52.470523 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0ef15377-cddb-4770-af8d-70cbe830e9dd tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:52.470952 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0ef15377-cddb-4770-af8d-70cbe830e9dd tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:52.473439 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0ef15377-cddb-4770-af8d-70cbe830e9dd tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:52.473439 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0ef15377-cddb-4770-af8d-70cbe830e9dd tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:52.473439 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0ef15377-cddb-4770-af8d-70cbe830e9dd tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:52.480072 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-32d7741d-7d92-4b55-8dfc-3e5c468b9803 tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1510843219", "id": 1653871937, "os-flavor-access:is_public": "True"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:52.528433 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-32d7741d-7d92-4b55-8dfc-3e5c468b9803 tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.052975 Aug 31 15:49:52.531549 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 134/294] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:49:52 2022] POST /compute/v2.1/flavors => generated 414 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:52.543152 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2e42deec-1df7-4328-8fac-f986482e584e tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:52.558575 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2e42deec-1df7-4328-8fac-f986482e584e tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/1653871937" status: 200 len: 414 microversion: 2.1 time: 0.020031 Aug 31 15:49:52.560635 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 135/295] 10.222.0.50 () {58 vars in 1158 bytes} [Wed Aug 31 15:49:52 2022] GET /compute/v2.1/flavors/1653871937 => generated 414 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:49:52.585439 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3940c7e7-1240-4ed4-ae62-438a9f884457 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:52.586739 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3940c7e7-1240-4ed4-ae62-438a9f884457 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:52.621664 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3940c7e7-1240-4ed4-ae62-438a9f884457 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:52.625686 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3940c7e7-1240-4ed4-ae62-438a9f884457 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:52.627181 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3940c7e7-1240-4ed4-ae62-438a9f884457 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:52.632498 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3940c7e7-1240-4ed4-ae62-438a9f884457 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:52.636109 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3940c7e7-1240-4ed4-ae62-438a9f884457 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:52.637884 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3940c7e7-1240-4ed4-ae62-438a9f884457 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:53.473222 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3940c7e7-1240-4ed4-ae62-438a9f884457 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:53.489842 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3940c7e7-1240-4ed4-ae62-438a9f884457 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:53.495879 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3940c7e7-1240-4ed4-ae62-438a9f884457 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:53.516058 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3940c7e7-1240-4ed4-ae62-438a9f884457 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] 10.222.0.50 "GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f" status: 200 len: 1447 microversion: 2.75 time: 0.950046 Aug 31 15:49:53.519644 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 136/296] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:49:52 2022] GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f => generated 1447 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:49:53.682011 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=4 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:49:53.936341 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0ef15377-cddb-4770-af8d-70cbe830e9dd tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6" status: 200 len: 1619 microversion: 2.1 time: 2.224350 Aug 31 15:49:53.941193 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 161/297] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:49:51 2022] GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6 => generated 1619 bytes in 2230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:53.951196 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-075ffb84-3484-49c3-9717-a3f6503135a6 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:53.952388 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-075ffb84-3484-49c3-9717-a3f6503135a6 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] [instance: 1e8fdb86-13be-42a3-a7af-5d50024f7419] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:53.965165 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-075ffb84-3484-49c3-9717-a3f6503135a6 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:53.967797 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-075ffb84-3484-49c3-9717-a3f6503135a6 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:53.970189 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-07ef710d-93a7-45e3-a080-d6de89b54cab tempest-FlavorsAdminTestJSON-679419016 tempest-FlavorsAdminTestJSON-679419016-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:53.971661 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-075ffb84-3484-49c3-9717-a3f6503135a6 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:53.972600 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-075ffb84-3484-49c3-9717-a3f6503135a6 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:53.973245 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-075ffb84-3484-49c3-9717-a3f6503135a6 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:53.973837 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-075ffb84-3484-49c3-9717-a3f6503135a6 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:54.029477 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-07ef710d-93a7-45e3-a080-d6de89b54cab tempest-FlavorsAdminTestJSON-679419016 tempest-FlavorsAdminTestJSON-679419016-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.503530 Aug 31 15:49:54.031639 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=100 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:49:54.059833 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 137/298] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 31 15:49:53 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:54.072763 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-95addb9d-09e7-4426-912a-c038ea1037a9 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Action: 'create', calling method: .version_select at 0x7fbb471da3a0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-960755472", "policies": ["affinity"]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:54.125022 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-075ffb84-3484-49c3-9717-a3f6503135a6 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704d7c428d3e4a1bbe5fb78485415214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a08078ba5a04c31b6cc63dee67be8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:54.128669 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-95addb9d-09e7-4426-912a-c038ea1037a9 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Getting quotas for project 7db749eb0a764fa0bb29ddc4abd6d245. Resources: {'server_groups'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:49:54.145399 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-075ffb84-3484-49c3-9717-a3f6503135a6 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] 10.222.0.50 "GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419" status: 200 len: 1300 microversion: 2.1 time: 0.202020 Aug 31 15:49:54.145998 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 162/299] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:49:53 2022] GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419 => generated 1300 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:54.152121 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-95addb9d-09e7-4426-912a-c038ea1037a9 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Getting quotas for user fe647be03cef4e9c86b4fd6e703d0de1 and project 7db749eb0a764fa0bb29ddc4abd6d245. Resources: {'server_groups'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:49:54.170367 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-afccad6b-8f3b-4d90-b5e7-47dcaa0eaf65 tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:54.229473 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-afccad6b-8f3b-4d90-b5e7-47dcaa0eaf65 tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1653871937" status: 202 len: 0 microversion: 2.1 time: 0.082328 Aug 31 15:49:54.230466 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 163/300] 10.222.0.50 () {58 vars in 1161 bytes} [Wed Aug 31 15:49:54 2022] DELETE /compute/v2.1/flavors/1653871937 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:49:54.239185 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-10dce52e-dc98-4edb-83fd-8c6d8b5e89f6 tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:54.273095 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-95addb9d-09e7-4426-912a-c038ea1037a9 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Getting quotas for project 7db749eb0a764fa0bb29ddc4abd6d245. Resources: {'server_groups'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:49:54.273790 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-10dce52e-dc98-4edb-83fd-8c6d8b5e89f6 tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038206 Aug 31 15:49:54.274924 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 164/301] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 31 15:49:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:54.290209 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-95addb9d-09e7-4426-912a-c038ea1037a9 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Getting quotas for user fe647be03cef4e9c86b4fd6e703d0de1 and project 7db749eb0a764fa0bb29ddc4abd6d245. Resources: {'server_groups'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:49:54.297882 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-21a92d8f-7dcb-4204-9695-e511bf474245 tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-997914915", "id": 578785935, "os-flavor-access:is_public": "False"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:54.330610 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-95addb9d-09e7-4426-912a-c038ea1037a9 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.266172 Aug 31 15:49:54.331273 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 138/302] 10.222.0.50 () {60 vars in 1174 bytes} [Wed Aug 31 15:49:54 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:54.342547 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-21a92d8f-7dcb-4204-9695-e511bf474245 tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.043093 Aug 31 15:49:54.342547 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 165/303] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:49:54 2022] POST /compute/v2.1/flavors => generated 426 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:54.359491 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f7488c5b-e94b-4ce0-a66b-f1c444091df2 tempest-FlavorsAdminTestJSON-679419016 tempest-FlavorsAdminTestJSON-679419016-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "578785935"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:54.372542 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-f7488c5b-e94b-4ce0-a66b-f1c444091df2 tempest-FlavorsAdminTestJSON-679419016 tempest-FlavorsAdminTestJSON-679419016-project] HTTP exception thrown: Flavor 578785935 could not be found. Aug 31 15:49:54.376810 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f7488c5b-e94b-4ce0-a66b-f1c444091df2 tempest-FlavorsAdminTestJSON-679419016 tempest-FlavorsAdminTestJSON-679419016-project] Request method failure captured: Aug 31 15:49:54.376810 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 31 15:49:54.376810 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:49:54.376810 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:49:54.376810 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:49:54.376810 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 106 Aug 31 15:49:54.376810 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:49:54.376810 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:49:54.376810 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:49:54.376810 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:49:54.376810 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4MYjgHrVg3_6rHoHd-ysBvjgv7cRMGMKZlVrdieHln_KyuZafc_DOW2-NEvxZ9bPqDNTQbpNlbdtS9pfWLLjbqyaiRK-6qRnoDAABvVXFo96yrOwBs4EwZWmLhzzaJUKhPfBxfm8d9Dx3AVGc0NR3ukbOKI11uxsV4YzYE1wXVkWhE Aug 31 15:49:54.376810 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:49:54.376810 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:49:54.376810 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:49:54.376810 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:49:54.376810 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:49:54.376810 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:49:54.376810 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 6b8f69ce02584d968ae48bb3eab2a56c Aug 31 15:49:54.376810 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-FlavorsAdminTestJSON-679419016 Aug 31 15:49:54.376810 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:49:54.376810 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:49:54.378081 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6b8f69ce02584d968ae48bb3eab2a56c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6b8f69ce02584d968ae48bb3eab2a56c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6b8f69ce02584d968ae48bb3eab2a56c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6b8f69ce02584d968ae48bb3eab2a56c", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:49:54.378081 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-FlavorsAdminTestJSON-679419016 Aug 31 15:49:54.378081 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 6b8f69ce02584d968ae48bb3eab2a56c Aug 31 15:49:54.378081 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-679419016 Aug 31 15:49:54.378081 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-FlavorsAdminTestJSON-679419016-project Aug 31 15:49:54.378081 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:49:54.378081 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:49:54.378081 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 0ee1a912651d4b9b9203b0a3006b7581 Aug 31 15:49:54.378081 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-FlavorsAdminTestJSON-679419016-project Aug 31 15:49:54.378081 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 15:49:54.378081 n-d-833090-16 devstack@n-api.service[128863]: {"server": {"name": "test", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "578785935"}} Aug 31 15:49:54.378081 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 15:49:54.378081 n-d-833090-16 devstack@n-api.service[128863]: exception: Flavor 578785935 could not be found. Aug 31 15:49:54.378814 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'd715a41c-0e56-494a-a102-cac65831f6bd', 'flavorRef': '578785935'}}} Aug 31 15:49:54.378814 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:49:54.378814 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:54.378814 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 31 15:49:54.378814 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 31 15:49:54.378814 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 15:49:54.378814 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 15:49:54.378814 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 15:49:54.378814 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 15:49:54.378814 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 15:49:54.378814 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 15:49:54.378814 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 15:49:54.378814 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:49:54.378814 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 15:49:54.378814 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 15:49:54.378814 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 578785935 could not be found. Aug 31 15:49:54.378814 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:54.378814 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:54.378814 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:54.378814 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:54.379939 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:54.379939 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:54.379939 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:49:54.379939 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:49:54.379939 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:49:54.379939 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:49:54.379939 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:49:54.379939 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:49:54.379939 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:49:54.379939 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:49:54.379939 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:49:54.379939 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:49:54.379939 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 31 15:49:54.379939 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 31 15:49:54.379939 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 31 15:49:54.379939 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 578785935 could not be found. Aug 31 15:49:54.379939 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:54.379939 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:49:54.379939 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:54.379939 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:49:54.379939 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:49:54.381023 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:49:54.381023 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:49:54.381023 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:49:54.381023 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 578785935 could not be found. Aug 31 15:49:54.381023 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:49:54.383212 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f7488c5b-e94b-4ce0-a66b-f1c444091df2 tempest-FlavorsAdminTestJSON-679419016 tempest-FlavorsAdminTestJSON-679419016-project] Returning 400 to user: Flavor 578785935 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:49:54.384310 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f7488c5b-e94b-4ce0-a66b-f1c444091df2 tempest-FlavorsAdminTestJSON-679419016 tempest-FlavorsAdminTestJSON-679419016-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.031015 Aug 31 15:49:54.385463 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 139/304] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:49:54 2022] POST /compute/v2.1/servers => generated 80 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 31 15:49:54.394680 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7943a8d9-92de-4c3f-ae93-051ad2ab8a91 tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:54.425842 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7943a8d9-92de-4c3f-ae93-051ad2ab8a91 tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/578785935" status: 202 len: 0 microversion: 2.1 time: 0.035412 Aug 31 15:49:54.426830 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 166/305] 10.222.0.50 () {58 vars in 1158 bytes} [Wed Aug 31 15:49:54 2022] DELETE /compute/v2.1/flavors/578785935 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:49:54.435834 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a7d5d0ed-e42f-4df6-a789-cf016ca8e5de tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:54.456824 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a7d5d0ed-e42f-4df6-a789-cf016ca8e5de tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024852 Aug 31 15:49:54.458124 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 140/306] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 31 15:49:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:54.482783 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-af16fba7-b37d-4794-99f8-b7a7845633a3 tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-751608326", "id": 223044163, "os-flavor-access:is_public": "False"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:54.510391 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-af16fba7-b37d-4794-99f8-b7a7845633a3 tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.036088 Aug 31 15:49:54.511821 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 167/307] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:49:54 2022] POST /compute/v2.1/flavors => generated 411 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:49:54.523814 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-93a48245-fcda-4fc7-930c-0295b405cca9 tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-526867721", "id": 1080218169, "os-flavor-access:is_public": "True"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:54.548456 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-24def544-fc2f-463e-88f4-d4c4d6a444a4 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:54.549800 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-24def544-fc2f-463e-88f4-d4c4d6a444a4 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:54.560068 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-93a48245-fcda-4fc7-930c-0295b405cca9 tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.039976 Aug 31 15:49:54.563081 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 141/308] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:49:54 2022] POST /compute/v2.1/flavors => generated 413 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:54.571625 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-24def544-fc2f-463e-88f4-d4c4d6a444a4 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:54.572358 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-24def544-fc2f-463e-88f4-d4c4d6a444a4 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:54.573884 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-24def544-fc2f-463e-88f4-d4c4d6a444a4 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:54.575500 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-24def544-fc2f-463e-88f4-d4c4d6a444a4 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:54.578600 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-24def544-fc2f-463e-88f4-d4c4d6a444a4 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:54.579352 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-24def544-fc2f-463e-88f4-d4c4d6a444a4 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:54.582479 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a1fa671a-1079-4c93-9708-e1540a1ae7f7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-970421602", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "09b56213-6e6a-4309-8e25-d9f079e6536c"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:54.701493 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-a1fa671a-1079-4c93-9708-e1540a1ae7f7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] validate_networks() for None {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:49:54.727426 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-24def544-fc2f-463e-88f4-d4c4d6a444a4 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:54.749317 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-24def544-fc2f-463e-88f4-d4c4d6a444a4 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:54.750978 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-24def544-fc2f-463e-88f4-d4c4d6a444a4 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:54.761426 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-24def544-fc2f-463e-88f4-d4c4d6a444a4 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] 10.222.0.50 "GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f" status: 200 len: 1447 microversion: 2.75 time: 0.217650 Aug 31 15:49:54.763021 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 168/309] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:49:54 2022] GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f => generated 1447 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:49:54.769895 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f7543989-2432-4bf0-b716-52411f95999c tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:54.803661 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f7543989-2432-4bf0-b716-52411f95999c tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 414 microversion: 2.1 time: 0.036956 Aug 31 15:49:54.813829 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 169/310] 10.222.0.50 () {58 vars in 1169 bytes} [Wed Aug 31 15:49:54 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 414 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:55.291480 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d2b0d74e-6fe8-4590-8424-1aaf33507fd6 tempest-HypervisorAdminUnderV252Test-1267143065 tempest-HypervisorAdminUnderV252Test-1267143065-project-admin] Calling method '.version_select at 0x7fbb470669d0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:55.293897 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d2b0d74e-6fe8-4590-8424-1aaf33507fd6 tempest-HypervisorAdminUnderV252Test-1267143065 tempest-HypervisorAdminUnderV252Test-1267143065-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:55.295373 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d2b0d74e-6fe8-4590-8424-1aaf33507fd6 tempest-HypervisorAdminUnderV252Test-1267143065 tempest-HypervisorAdminUnderV252Test-1267143065-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:55.296219 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d2b0d74e-6fe8-4590-8424-1aaf33507fd6 tempest-HypervisorAdminUnderV252Test-1267143065 tempest-HypervisorAdminUnderV252Test-1267143065-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:55.297704 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-a1fa671a-1079-4c93-9708-e1540a1ae7f7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:49:55.298160 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-a1fa671a-1079-4c93-9708-e1540a1ae7f7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:49:55.298597 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-a1fa671a-1079-4c93-9708-e1540a1ae7f7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:49:55.299001 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-a1fa671a-1079-4c93-9708-e1540a1ae7f7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:49:55.299404 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-a1fa671a-1079-4c93-9708-e1540a1ae7f7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:49:55.319967 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d2b0d74e-6fe8-4590-8424-1aaf33507fd6 tempest-HypervisorAdminUnderV252Test-1267143065 tempest-HypervisorAdminUnderV252Test-1267143065-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:55.321013 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d2b0d74e-6fe8-4590-8424-1aaf33507fd6 tempest-HypervisorAdminUnderV252Test-1267143065 tempest-HypervisorAdminUnderV252Test-1267143065-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:55.321697 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d2b0d74e-6fe8-4590-8424-1aaf33507fd6 tempest-HypervisorAdminUnderV252Test-1267143065 tempest-HypervisorAdminUnderV252Test-1267143065-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:55.342879 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=5,nova_api:DELETE=12 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:49:55.345092 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d2b0d74e-6fe8-4590-8424-1aaf33507fd6 tempest-HypervisorAdminUnderV252Test-1267143065 tempest-HypervisorAdminUnderV252Test-1267143065-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:55.345831 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d2b0d74e-6fe8-4590-8424-1aaf33507fd6 tempest-HypervisorAdminUnderV252Test-1267143065 tempest-HypervisorAdminUnderV252Test-1267143065-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:55.346531 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d2b0d74e-6fe8-4590-8424-1aaf33507fd6 tempest-HypervisorAdminUnderV252Test-1267143065 tempest-HypervisorAdminUnderV252Test-1267143065-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:55.354197 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1fa671a-1079-4c93-9708-e1540a1ae7f7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:55.354686 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1fa671a-1079-4c93-9708-e1540a1ae7f7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:55.355111 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1fa671a-1079-4c93-9708-e1540a1ae7f7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:55.355846 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1fa671a-1079-4c93-9708-e1540a1ae7f7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:55.356289 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1fa671a-1079-4c93-9708-e1540a1ae7f7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:55.357306 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1fa671a-1079-4c93-9708-e1540a1ae7f7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:55.357962 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d2b0d74e-6fe8-4590-8424-1aaf33507fd6 tempest-HypervisorAdminUnderV252Test-1267143065 tempest-HypervisorAdminUnderV252Test-1267143065-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.541095 Aug 31 15:49:55.360453 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 170/311] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 31 15:49:54 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:55.372217 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-350eac5e-793f-44fb-b297-f9e288158ce3 tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:55.395805 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-350eac5e-793f-44fb-b297-f9e288158ce3 tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 414 microversion: 2.1 time: 0.032804 Aug 31 15:49:55.397194 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 171/312] 10.222.0.50 () {58 vars in 1177 bytes} [Wed Aug 31 15:49:55 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 414 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:55.410159 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-135422c5-a668-4853-a556-70d357eb9551 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:55.412150 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-135422c5-a668-4853-a556-70d357eb9551 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] [instance: 1e8fdb86-13be-42a3-a7af-5d50024f7419] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:55.424093 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-135422c5-a668-4853-a556-70d357eb9551 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:55.424358 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-a1fa671a-1079-4c93-9708-e1540a1ae7f7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Getting quotas for project 7db749eb0a764fa0bb29ddc4abd6d245. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:49:55.424577 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-135422c5-a668-4853-a556-70d357eb9551 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:55.425038 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-135422c5-a668-4853-a556-70d357eb9551 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:55.425744 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-135422c5-a668-4853-a556-70d357eb9551 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:55.426225 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-135422c5-a668-4853-a556-70d357eb9551 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:55.426635 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-135422c5-a668-4853-a556-70d357eb9551 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:55.429897 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-a1fa671a-1079-4c93-9708-e1540a1ae7f7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Getting quotas for user fe647be03cef4e9c86b4fd6e703d0de1 and project 7db749eb0a764fa0bb29ddc4abd6d245. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:49:55.455604 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a1fa671a-1079-4c93-9708-e1540a1ae7f7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Going to run 2 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:49:55.457824 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a1fa671a-1079-4c93-9708-e1540a1ae7f7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 269c2cc1-ce8d-41bc-bf54-90f0c37642a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:49:55.522808 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-a1fa671a-1079-4c93-9708-e1540a1ae7f7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=128863) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 31 15:49:55.550448 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-a1fa671a-1079-4c93-9708-e1540a1ae7f7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Getting quotas for project 7db749eb0a764fa0bb29ddc4abd6d245. Resources: {'server_group_members'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:49:55.557825 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-a1fa671a-1079-4c93-9708-e1540a1ae7f7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Getting quotas for user fe647be03cef4e9c86b4fd6e703d0de1 and project 7db749eb0a764fa0bb29ddc4abd6d245. Resources: {'server_group_members'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:49:55.563450 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=6,nova_api:INSERT=8 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:49:55.578803 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-135422c5-a668-4853-a556-70d357eb9551 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704d7c428d3e4a1bbe5fb78485415214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a08078ba5a04c31b6cc63dee67be8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:55.590972 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-135422c5-a668-4853-a556-70d357eb9551 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] 10.222.0.50 "GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419" status: 200 len: 1300 microversion: 2.1 time: 0.192412 Aug 31 15:49:55.595914 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 172/313] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:49:55 2022] GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419 => generated 1300 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:55.605470 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-bfb1f7e5-cc73-4ff9-b43e-0ab37d966121 tempest-HypervisorAdminUnderV252Test-1267143065 tempest-HypervisorAdminUnderV252Test-1267143065-project-admin] Calling method '.version_select at 0x7fbb472c2160>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:55.618523 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bfb1f7e5-cc73-4ff9-b43e-0ab37d966121 tempest-HypervisorAdminUnderV252Test-1267143065 tempest-HypervisorAdminUnderV252Test-1267143065-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:55.624606 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bfb1f7e5-cc73-4ff9-b43e-0ab37d966121 tempest-HypervisorAdminUnderV252Test-1267143065 tempest-HypervisorAdminUnderV252Test-1267143065-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:55.627560 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bfb1f7e5-cc73-4ff9-b43e-0ab37d966121 tempest-HypervisorAdminUnderV252Test-1267143065 tempest-HypervisorAdminUnderV252Test-1267143065-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:55.652849 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bfb1f7e5-cc73-4ff9-b43e-0ab37d966121 tempest-HypervisorAdminUnderV252Test-1267143065 tempest-HypervisorAdminUnderV252Test-1267143065-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:55.653660 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bfb1f7e5-cc73-4ff9-b43e-0ab37d966121 tempest-HypervisorAdminUnderV252Test-1267143065 tempest-HypervisorAdminUnderV252Test-1267143065-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:55.654579 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bfb1f7e5-cc73-4ff9-b43e-0ab37d966121 tempest-HypervisorAdminUnderV252Test-1267143065 tempest-HypervisorAdminUnderV252Test-1267143065-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:55.686411 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bfb1f7e5-cc73-4ff9-b43e-0ab37d966121 tempest-HypervisorAdminUnderV252Test-1267143065 tempest-HypervisorAdminUnderV252Test-1267143065-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:55.687566 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bfb1f7e5-cc73-4ff9-b43e-0ab37d966121 tempest-HypervisorAdminUnderV252Test-1267143065 tempest-HypervisorAdminUnderV252Test-1267143065-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:55.688214 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bfb1f7e5-cc73-4ff9-b43e-0ab37d966121 tempest-HypervisorAdminUnderV252Test-1267143065 tempest-HypervisorAdminUnderV252Test-1267143065-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:55.696930 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-bfb1f7e5-cc73-4ff9-b43e-0ab37d966121 tempest-HypervisorAdminUnderV252Test-1267143065 tempest-HypervisorAdminUnderV252Test-1267143065-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/n-h1-833090-16/servers" status: 200 len: 197 microversion: 2.1 time: 0.099540 Aug 31 15:49:55.698128 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 173/314] 10.222.0.50 () {58 vars in 1215 bytes} [Wed Aug 31 15:49:55 2022] GET /compute/v2.1/os-hypervisors/n-h1-833090-16/servers => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:55.701323 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-a1fa671a-1079-4c93-9708-e1540a1ae7f7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Getting quotas for project 7db749eb0a764fa0bb29ddc4abd6d245. Resources: {'server_group_members'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:49:55.703537 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c79d4bb4-db4d-45f6-a1ec-c9995d8d9699 tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:55.717640 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-a1fa671a-1079-4c93-9708-e1540a1ae7f7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Getting quotas for user fe647be03cef4e9c86b4fd6e703d0de1 and project 7db749eb0a764fa0bb29ddc4abd6d245. Resources: {'server_group_members'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:49:55.724674 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c79d4bb4-db4d-45f6-a1ec-c9995d8d9699 tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 414 microversion: 2.1 time: 0.024829 Aug 31 15:49:55.730236 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 174/315] 10.222.0.50 () {58 vars in 1171 bytes} [Wed Aug 31 15:49:55 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 414 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:55.749528 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-af4327d4-d304-4741-a8c8-dde8009b53f4 tempest-HypervisorAdminUnderV252Test-1267143065 tempest-HypervisorAdminUnderV252Test-1267143065-project-admin] Calling method '.version_select at 0x7fbb47048040>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:55.758006 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-af4327d4-d304-4741-a8c8-dde8009b53f4 tempest-HypervisorAdminUnderV252Test-1267143065 tempest-HypervisorAdminUnderV252Test-1267143065-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:55.759030 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-af4327d4-d304-4741-a8c8-dde8009b53f4 tempest-HypervisorAdminUnderV252Test-1267143065 tempest-HypervisorAdminUnderV252Test-1267143065-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:55.759817 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-af4327d4-d304-4741-a8c8-dde8009b53f4 tempest-HypervisorAdminUnderV252Test-1267143065 tempest-HypervisorAdminUnderV252Test-1267143065-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:55.765670 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a1fa671a-1079-4c93-9708-e1540a1ae7f7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: c3ca0ff6-8f52-4ac3-8706-f5efab49a099] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=269c2cc1-ce8d-41bc-bf54-90f0c37642a2,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:49:55.782367 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-af4327d4-d304-4741-a8c8-dde8009b53f4 tempest-HypervisorAdminUnderV252Test-1267143065 tempest-HypervisorAdminUnderV252Test-1267143065-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:55.783108 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-af4327d4-d304-4741-a8c8-dde8009b53f4 tempest-HypervisorAdminUnderV252Test-1267143065 tempest-HypervisorAdminUnderV252Test-1267143065-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:55.783698 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-af4327d4-d304-4741-a8c8-dde8009b53f4 tempest-HypervisorAdminUnderV252Test-1267143065 tempest-HypervisorAdminUnderV252Test-1267143065-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:55.797291 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-af4327d4-d304-4741-a8c8-dde8009b53f4 tempest-HypervisorAdminUnderV252Test-1267143065 tempest-HypervisorAdminUnderV252Test-1267143065-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:55.798294 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-af4327d4-d304-4741-a8c8-dde8009b53f4 tempest-HypervisorAdminUnderV252Test-1267143065 tempest-HypervisorAdminUnderV252Test-1267143065-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:55.799290 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-af4327d4-d304-4741-a8c8-dde8009b53f4 tempest-HypervisorAdminUnderV252Test-1267143065 tempest-HypervisorAdminUnderV252Test-1267143065-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:55.808075 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-af4327d4-d304-4741-a8c8-dde8009b53f4 tempest-HypervisorAdminUnderV252Test-1267143065 tempest-HypervisorAdminUnderV252Test-1267143065-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.075397 Aug 31 15:49:55.809697 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 175/316] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 31 15:49:55 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:55.815944 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-097d3ea5-883a-40b4-9acb-6444fe15c74a tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:55.828490 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-097d3ea5-883a-40b4-9acb-6444fe15c74a tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 414 microversion: 2.1 time: 0.016906 Aug 31 15:49:55.830486 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 176/317] 10.222.0.50 () {58 vars in 1169 bytes} [Wed Aug 31 15:49:55 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 414 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:55.843085 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-bd756a64-b81e-41f6-ae33-4b6de3f298d7 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:55.844870 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-bd756a64-b81e-41f6-ae33-4b6de3f298d7 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:55.857051 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-a1fa671a-1079-4c93-9708-e1540a1ae7f7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Getting quotas for project 7db749eb0a764fa0bb29ddc4abd6d245. Resources: {'server_group_members'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:49:55.861171 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bd756a64-b81e-41f6-ae33-4b6de3f298d7 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:55.863786 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-a1fa671a-1079-4c93-9708-e1540a1ae7f7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Getting quotas for user fe647be03cef4e9c86b4fd6e703d0de1 and project 7db749eb0a764fa0bb29ddc4abd6d245. Resources: {'server_group_members'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:49:55.865564 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bd756a64-b81e-41f6-ae33-4b6de3f298d7 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:55.865978 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bd756a64-b81e-41f6-ae33-4b6de3f298d7 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:55.867209 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bd756a64-b81e-41f6-ae33-4b6de3f298d7 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:55.867639 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bd756a64-b81e-41f6-ae33-4b6de3f298d7 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:55.867828 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bd756a64-b81e-41f6-ae33-4b6de3f298d7 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:55.921846 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-a1fa671a-1079-4c93-9708-e1540a1ae7f7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Getting quotas for project 7db749eb0a764fa0bb29ddc4abd6d245. Resources: {'server_group_members'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:49:55.927693 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-a1fa671a-1079-4c93-9708-e1540a1ae7f7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Getting quotas for user fe647be03cef4e9c86b4fd6e703d0de1 and project 7db749eb0a764fa0bb29ddc4abd6d245. Resources: {'server_group_members'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:49:55.967265 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a1fa671a-1079-4c93-9708-e1540a1ae7f7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.395838 Aug 31 15:49:55.968625 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 142/318] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:49:54 2022] POST /compute/v2.1/servers => generated 32 bytes in 1398 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 31 15:49:55.973725 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b98ec0cf-2f05-4624-81e6-9a8a349ce53a tempest-HypervisorAdminUnderV252Test-1267143065 tempest-HypervisorAdminUnderV252Test-1267143065-project-admin] Calling method '.version_select at 0x7fbb471a35e0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:55.976264 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b98ec0cf-2f05-4624-81e6-9a8a349ce53a tempest-HypervisorAdminUnderV252Test-1267143065 tempest-HypervisorAdminUnderV252Test-1267143065-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:55.977271 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b98ec0cf-2f05-4624-81e6-9a8a349ce53a tempest-HypervisorAdminUnderV252Test-1267143065 tempest-HypervisorAdminUnderV252Test-1267143065-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:55.979396 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b98ec0cf-2f05-4624-81e6-9a8a349ce53a tempest-HypervisorAdminUnderV252Test-1267143065 tempest-HypervisorAdminUnderV252Test-1267143065-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:55.996826 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b98ec0cf-2f05-4624-81e6-9a8a349ce53a tempest-HypervisorAdminUnderV252Test-1267143065 tempest-HypervisorAdminUnderV252Test-1267143065-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:55.997597 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b98ec0cf-2f05-4624-81e6-9a8a349ce53a tempest-HypervisorAdminUnderV252Test-1267143065 tempest-HypervisorAdminUnderV252Test-1267143065-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:55.998765 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b98ec0cf-2f05-4624-81e6-9a8a349ce53a tempest-HypervisorAdminUnderV252Test-1267143065 tempest-HypervisorAdminUnderV252Test-1267143065-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:56.006826 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b98ec0cf-2f05-4624-81e6-9a8a349ce53a tempest-HypervisorAdminUnderV252Test-1267143065 tempest-HypervisorAdminUnderV252Test-1267143065-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/n-h1-833090-16/search" status: 200 len: 105 microversion: 2.1 time: 0.036684 Aug 31 15:49:56.007771 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 143/319] 10.222.0.50 () {58 vars in 1212 bytes} [Wed Aug 31 15:49:55 2022] GET /compute/v2.1/os-hypervisors/n-h1-833090-16/search => generated 105 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:56.014051 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e3ca86f1-5f79-4999-8f70-410d0f96447d tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:56.042462 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e3ca86f1-5f79-4999-8f70-410d0f96447d tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5394 microversion: 2.1 time: 0.033397 Aug 31 15:49:56.044208 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 144/320] 10.222.0.50 () {58 vars in 1169 bytes} [Wed Aug 31 15:49:56 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5394 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:56.077212 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f65345e7-4899-4c7c-b797-d58f61399451 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:56.087577 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-bd756a64-b81e-41f6-ae33-4b6de3f298d7 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:56.099517 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-bd756a64-b81e-41f6-ae33-4b6de3f298d7 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:56.103212 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-bd756a64-b81e-41f6-ae33-4b6de3f298d7 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:56.111397 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f65345e7-4899-4c7c-b797-d58f61399451 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:56.117954 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f65345e7-4899-4c7c-b797-d58f61399451 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Searching by: {'deleted': False, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245'} {{(pid=128863) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 15:49:56.135401 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-bd756a64-b81e-41f6-ae33-4b6de3f298d7 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] 10.222.0.50 "GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f" status: 200 len: 1447 microversion: 2.75 time: 0.303003 Aug 31 15:49:56.150833 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 177/321] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:49:55 2022] GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f => generated 1447 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:49:56.150833 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f094f15f-fef9-426e-8fc5-be2319bf7dff tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:56.151119 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f65345e7-4899-4c7c-b797-d58f61399451 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:56.151119 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f65345e7-4899-4c7c-b797-d58f61399451 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:56.151119 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f65345e7-4899-4c7c-b797-d58f61399451 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:56.151119 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f65345e7-4899-4c7c-b797-d58f61399451 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:56.151454 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f65345e7-4899-4c7c-b797-d58f61399451 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:56.162633 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f65345e7-4899-4c7c-b797-d58f61399451 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:56.222361 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f094f15f-fef9-426e-8fc5-be2319bf7dff tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5394 microversion: 2.1 time: 0.075262 Aug 31 15:49:56.223495 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 178/322] 10.222.0.50 () {58 vars in 1175 bytes} [Wed Aug 31 15:49:56 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5394 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:56.246462 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-307b2889-db69-40d6-a61c-bb6bcf08c7f0 tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:56.294395 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-307b2889-db69-40d6-a61c-bb6bcf08c7f0 tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5394 microversion: 2.1 time: 0.052507 Aug 31 15:49:56.299236 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 179/323] 10.222.0.50 () {58 vars in 1173 bytes} [Wed Aug 31 15:49:56 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5394 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:56.316724 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c3d0d356-5ee9-4472-a9e0-29e582333956 tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:56.374705 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c3d0d356-5ee9-4472-a9e0-29e582333956 tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5394 microversion: 2.1 time: 0.061313 Aug 31 15:49:56.390470 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 180/324] 10.222.0.50 () {58 vars in 1169 bytes} [Wed Aug 31 15:49:56 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5394 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:49:56.410736 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3a329fd5-187a-419b-9dfd-f0f6ddd0a4bd tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:56.460390 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3a329fd5-187a-419b-9dfd-f0f6ddd0a4bd tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1080218169" status: 202 len: 0 microversion: 2.1 time: 0.060847 Aug 31 15:49:56.470793 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 181/325] 10.222.0.50 () {58 vars in 1161 bytes} [Wed Aug 31 15:49:56 2022] DELETE /compute/v2.1/flavors/1080218169 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:49:56.483996 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-bea95ccb-4171-4823-a1ba-40ae0cda99b4 tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:56.496038 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.multi_cell_list [None req-f65345e7-4899-4c7c-b797-d58f61399451 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=128863) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 15:49:56.549654 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-bea95ccb-4171-4823-a1ba-40ae0cda99b4 tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.073067 Aug 31 15:49:56.564285 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 182/326] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 31 15:49:56 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:56.577511 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8a64f307-7234-44e6-98d4-b2467afed25a tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:56.632327 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8a64f307-7234-44e6-98d4-b2467afed25a tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/223044163" status: 202 len: 0 microversion: 2.1 time: 0.064871 Aug 31 15:49:56.638146 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 183/327] 10.222.0.50 () {58 vars in 1158 bytes} [Wed Aug 31 15:49:56 2022] DELETE /compute/v2.1/flavors/223044163 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:49:56.660819 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-17be32dc-2ea4-42e5-bb65-eb4343e894a3 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:56.661653 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-17be32dc-2ea4-42e5-bb65-eb4343e894a3 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] [instance: 1e8fdb86-13be-42a3-a7af-5d50024f7419] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:56.683204 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-17be32dc-2ea4-42e5-bb65-eb4343e894a3 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:56.689494 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-17be32dc-2ea4-42e5-bb65-eb4343e894a3 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:56.692795 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-17be32dc-2ea4-42e5-bb65-eb4343e894a3 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:56.694833 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-17be32dc-2ea4-42e5-bb65-eb4343e894a3 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:56.703756 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-17be32dc-2ea4-42e5-bb65-eb4343e894a3 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:56.705569 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-17be32dc-2ea4-42e5-bb65-eb4343e894a3 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:56.822392 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f65345e7-4899-4c7c-b797-d58f61399451 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 1002 microversion: 2.1 time: 0.774642 Aug 31 15:49:56.837792 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 145/328] 10.222.0.50 () {58 vars in 1125 bytes} [Wed Aug 31 15:49:56 2022] GET /compute/v2.1/servers => generated 1002 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:56.840214 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f9de8cde-0663-4c3d-866b-f482281025be tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:56.891919 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f9de8cde-0663-4c3d-866b-f482281025be tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.059339 Aug 31 15:49:56.905612 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 146/329] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 31 15:49:56 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:56.910739 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-679d663e-f141-4104-b22f-2799cfbb910a tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:56.911331 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-679d663e-f141-4104-b22f-2799cfbb910a tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: c3ca0ff6-8f52-4ac3-8706-f5efab49a099] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:57.147583 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-679d663e-f141-4104-b22f-2799cfbb910a tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:57.155986 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-679d663e-f141-4104-b22f-2799cfbb910a tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/c3ca0ff6-8f52-4ac3-8706-f5efab49a099" status: 200 len: 1218 microversion: 2.1 time: 0.261300 Aug 31 15:49:57.158133 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 147/330] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:49:56 2022] GET /compute/v2.1/servers/c3ca0ff6-8f52-4ac3-8706-f5efab49a099 => generated 1218 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:57.170246 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-560161e3-cb7e-4e37-bf2a-56b98e966778 tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1543610366", "id": 1847597000, "os-flavor-access:is_public": "False"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:57.216073 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-560161e3-cb7e-4e37-bf2a-56b98e966778 tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.056692 Aug 31 15:49:57.219765 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 148/331] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:49:57 2022] POST /compute/v2.1/flavors => generated 415 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:57.237580 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-81e3162e-f061-44ff-84c9-ef097c1a8cb9 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:57.239959 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-81e3162e-f061-44ff-84c9-ef097c1a8cb9 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:57.257618 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-81e3162e-f061-44ff-84c9-ef097c1a8cb9 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:57.260301 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-81e3162e-f061-44ff-84c9-ef097c1a8cb9 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:57.261073 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-81e3162e-f061-44ff-84c9-ef097c1a8cb9 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:57.263108 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-81e3162e-f061-44ff-84c9-ef097c1a8cb9 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:57.266364 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-81e3162e-f061-44ff-84c9-ef097c1a8cb9 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:57.267300 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-81e3162e-f061-44ff-84c9-ef097c1a8cb9 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:57.375645 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-17be32dc-2ea4-42e5-bb65-eb4343e894a3 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704d7c428d3e4a1bbe5fb78485415214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a08078ba5a04c31b6cc63dee67be8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:57.387890 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-17be32dc-2ea4-42e5-bb65-eb4343e894a3 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] 10.222.0.50 "GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419" status: 200 len: 1368 microversion: 2.1 time: 0.748161 Aug 31 15:49:57.394859 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 184/332] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:49:56 2022] GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419 => generated 1368 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:57.407514 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e79f8e97-a50d-4cc5-989b-7b8d167a7c15 tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:57.485455 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-81e3162e-f061-44ff-84c9-ef097c1a8cb9 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:57.486669 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e79f8e97-a50d-4cc5-989b-7b8d167a7c15 tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.089654 Aug 31 15:49:57.498781 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-81e3162e-f061-44ff-84c9-ef097c1a8cb9 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:57.500332 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 185/333] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 31 15:49:57 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:57.507987 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b18d4398-b6b5-43ce-9264-592692f8a257 tempest-FlavorsAdminTestJSON-679419016 tempest-FlavorsAdminTestJSON-679419016-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:57.508167 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-81e3162e-f061-44ff-84c9-ef097c1a8cb9 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:57.526792 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-81e3162e-f061-44ff-84c9-ef097c1a8cb9 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] 10.222.0.50 "GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f" status: 200 len: 1447 microversion: 2.75 time: 0.303566 Aug 31 15:49:57.536715 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 149/334] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:49:57 2022] GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f => generated 1447 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:49:57.564872 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b18d4398-b6b5-43ce-9264-592692f8a257 tempest-FlavorsAdminTestJSON-679419016 tempest-FlavorsAdminTestJSON-679419016-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.061686 Aug 31 15:49:57.579285 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 186/335] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 31 15:49:57 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:49:57.588166 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-11e253df-102d-4c0a-b941-c6b04d4c4875 tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:57.632215 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-11e253df-102d-4c0a-b941-c6b04d4c4875 tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1847597000" status: 202 len: 0 microversion: 2.1 time: 0.048369 Aug 31 15:49:57.636089 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 150/336] 10.222.0.50 () {58 vars in 1161 bytes} [Wed Aug 31 15:49:57 2022] DELETE /compute/v2.1/flavors/1847597000 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:49:57.642191 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1550feb9-0a16-4241-bd20-eb6bc3eecd98 tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:57.678887 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1550feb9-0a16-4241-bd20-eb6bc3eecd98 tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038324 Aug 31 15:49:57.679889 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 187/337] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 31 15:49:57 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:57.717126 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ff996247-83df-4433-90a1-9a551d7f20d1 tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1760723886", "id": 233786888, "os-flavor-access:is_public": "True"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:57.773589 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ff996247-83df-4433-90a1-9a551d7f20d1 tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.074877 Aug 31 15:49:57.775912 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 151/338] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:49:57 2022] POST /compute/v2.1/flavors => generated 411 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:57.789942 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2aaeb156-a7bd-4e5f-a2be-357fa54f6a9d tempest-FlavorsAdminTestJSON-679419016 tempest-FlavorsAdminTestJSON-679419016-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:57.847954 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2aaeb156-a7bd-4e5f-a2be-357fa54f6a9d tempest-FlavorsAdminTestJSON-679419016 tempest-FlavorsAdminTestJSON-679419016-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.063968 Aug 31 15:49:57.851284 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 188/339] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 31 15:49:57 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:57.875049 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-11fcef87-f706-4526-bd96-3401c6853c4d tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:57.917204 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-11fcef87-f706-4526-bd96-3401c6853c4d tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/233786888" status: 202 len: 0 microversion: 2.1 time: 0.050370 Aug 31 15:49:57.918175 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 152/340] 10.222.0.50 () {58 vars in 1158 bytes} [Wed Aug 31 15:49:57 2022] DELETE /compute/v2.1/flavors/233786888 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:49:57.926773 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3783d772-8334-48f2-8970-9b5ab43306a1 tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:57.968133 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3783d772-8334-48f2-8970-9b5ab43306a1 tempest-FlavorsAdminTestJSON-744459874 tempest-FlavorsAdminTestJSON-744459874-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.045483 Aug 31 15:49:57.978458 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 189/341] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 31 15:49:57 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:58.180360 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f20daf90-6a89-4651-b3f0-46140b60bdbc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:58.180971 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f20daf90-6a89-4651-b3f0-46140b60bdbc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: c3ca0ff6-8f52-4ac3-8706-f5efab49a099] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:58.198574 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f20daf90-6a89-4651-b3f0-46140b60bdbc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:58.201055 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f20daf90-6a89-4651-b3f0-46140b60bdbc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:58.201260 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f20daf90-6a89-4651-b3f0-46140b60bdbc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:58.206456 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f20daf90-6a89-4651-b3f0-46140b60bdbc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:58.206761 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f20daf90-6a89-4651-b3f0-46140b60bdbc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:58.207189 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f20daf90-6a89-4651-b3f0-46140b60bdbc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:58.410882 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2db1fd62-18b3-4580-bf4a-157abda31955 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:58.412185 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2db1fd62-18b3-4580-bf4a-157abda31955 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] [instance: 1e8fdb86-13be-42a3-a7af-5d50024f7419] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:58.431535 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2db1fd62-18b3-4580-bf4a-157abda31955 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:58.431711 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2db1fd62-18b3-4580-bf4a-157abda31955 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:58.432146 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2db1fd62-18b3-4580-bf4a-157abda31955 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:58.438251 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2db1fd62-18b3-4580-bf4a-157abda31955 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:58.442916 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2db1fd62-18b3-4580-bf4a-157abda31955 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:58.443565 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2db1fd62-18b3-4580-bf4a-157abda31955 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:58.593358 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f20daf90-6a89-4651-b3f0-46140b60bdbc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:58.615268 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f20daf90-6a89-4651-b3f0-46140b60bdbc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/c3ca0ff6-8f52-4ac3-8706-f5efab49a099" status: 200 len: 1214 microversion: 2.1 time: 0.438704 Aug 31 15:49:58.615878 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 153/342] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:49:58 2022] GET /compute/v2.1/servers/c3ca0ff6-8f52-4ac3-8706-f5efab49a099 => generated 1214 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:58.709597 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-936b8e04-7555-4fea-b034-5f0493529535 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:58.712066 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-936b8e04-7555-4fea-b034-5f0493529535 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:58.741109 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-936b8e04-7555-4fea-b034-5f0493529535 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:58.744906 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-936b8e04-7555-4fea-b034-5f0493529535 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:58.745569 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-936b8e04-7555-4fea-b034-5f0493529535 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:58.747556 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-936b8e04-7555-4fea-b034-5f0493529535 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:58.749463 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-936b8e04-7555-4fea-b034-5f0493529535 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:58.749905 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-936b8e04-7555-4fea-b034-5f0493529535 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:58.904302 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-936b8e04-7555-4fea-b034-5f0493529535 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:58.920510 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-936b8e04-7555-4fea-b034-5f0493529535 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:58.926218 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-936b8e04-7555-4fea-b034-5f0493529535 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:58.945271 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-936b8e04-7555-4fea-b034-5f0493529535 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] 10.222.0.50 "GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f" status: 200 len: 1447 microversion: 2.75 time: 0.281552 Aug 31 15:49:58.945863 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 154/343] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:49:58 2022] GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f => generated 1447 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:49:59.162193 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2db1fd62-18b3-4580-bf4a-157abda31955 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704d7c428d3e4a1bbe5fb78485415214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a08078ba5a04c31b6cc63dee67be8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:59.181299 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2db1fd62-18b3-4580-bf4a-157abda31955 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] 10.222.0.50 "GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419" status: 200 len: 1368 microversion: 2.1 time: 0.774868 Aug 31 15:49:59.183466 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 190/344] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:49:58 2022] GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419 => generated 1368 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:49:59.327442 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-3ee83931-62b8-42ca-96c9-5a1b98ca6ff9 req-51b19e89-5dd8-4b70-b21f-1ce56ab69bec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e8fdb86-13be-42a3-a7af-5d50024f7419", "tag": "e33a5029-0218-44c8-9329-fb96edf985c5"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:49:59.363625 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3ee83931-62b8-42ca-96c9-5a1b98ca6ff9 req-51b19e89-5dd8-4b70-b21f-1ce56ab69bec service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:59.370576 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3ee83931-62b8-42ca-96c9-5a1b98ca6ff9 req-51b19e89-5dd8-4b70-b21f-1ce56ab69bec service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:59.371432 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3ee83931-62b8-42ca-96c9-5a1b98ca6ff9 req-51b19e89-5dd8-4b70-b21f-1ce56ab69bec service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:59.427287 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-3ee83931-62b8-42ca-96c9-5a1b98ca6ff9 req-51b19e89-5dd8-4b70-b21f-1ce56ab69bec service nova] Creating event network-changed:e33a5029-0218-44c8-9329-fb96edf985c5 for instance 1e8fdb86-13be-42a3-a7af-5d50024f7419 on n-h1-833090-16 Aug 31 15:49:59.429686 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3ee83931-62b8-42ca-96c9-5a1b98ca6ff9 req-51b19e89-5dd8-4b70-b21f-1ce56ab69bec service nova] Acquiring lock "compute-rpcapi-router" {{(pid=128863) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 15:49:59.430505 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3ee83931-62b8-42ca-96c9-5a1b98ca6ff9 req-51b19e89-5dd8-4b70-b21f-1ce56ab69bec service nova] Acquired lock "compute-rpcapi-router" {{(pid=128863) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 15:49:59.433926 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1bec01fc-cd9b-4900-a95e-0c038358e870 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:59.436202 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1bec01fc-cd9b-4900-a95e-0c038358e870 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:59.438425 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1bec01fc-cd9b-4900-a95e-0c038358e870 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:59.442409 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1bec01fc-cd9b-4900-a95e-0c038358e870 None None] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:59.443920 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1bec01fc-cd9b-4900-a95e-0c038358e870 None None] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:59.453430 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1bec01fc-cd9b-4900-a95e-0c038358e870 None None] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:59.482854 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:49:59.486826 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.compute.rpcapi [None req-1bec01fc-cd9b-4900-a95e-0c038358e870 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 31 15:49:59.500447 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1bec01fc-cd9b-4900-a95e-0c038358e870 None None] Releasing lock "compute-rpcapi-router" {{(pid=128863) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 15:49:59.540991 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1bec01fc-cd9b-4900-a95e-0c038358e870 None None] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.218598 Aug 31 15:49:59.543782 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 155/345] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:49:59.637147 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-838922dc-8cd3-4b01-9dc7-f8ee6e33e507 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:59.646674 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-838922dc-8cd3-4b01-9dc7-f8ee6e33e507 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: c3ca0ff6-8f52-4ac3-8706-f5efab49a099] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:59.673232 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-838922dc-8cd3-4b01-9dc7-f8ee6e33e507 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:59.678364 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-838922dc-8cd3-4b01-9dc7-f8ee6e33e507 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:59.679615 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-838922dc-8cd3-4b01-9dc7-f8ee6e33e507 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:59.689540 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-838922dc-8cd3-4b01-9dc7-f8ee6e33e507 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:59.690553 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-838922dc-8cd3-4b01-9dc7-f8ee6e33e507 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:59.691377 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-838922dc-8cd3-4b01-9dc7-f8ee6e33e507 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:59.956106 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-838922dc-8cd3-4b01-9dc7-f8ee6e33e507 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:49:59.971982 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-838922dc-8cd3-4b01-9dc7-f8ee6e33e507 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/c3ca0ff6-8f52-4ac3-8706-f5efab49a099" status: 200 len: 1288 microversion: 2.1 time: 0.338845 Aug 31 15:49:59.973019 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 191/346] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:49:59 2022] GET /compute/v2.1/servers/c3ca0ff6-8f52-4ac3-8706-f5efab49a099 => generated 1288 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:49:59.977952 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e0d9f806-4034-4bc2-8842-c79556bb0df3 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:49:59.978613 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e0d9f806-4034-4bc2-8842-c79556bb0df3 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:49:59.995578 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e0d9f806-4034-4bc2-8842-c79556bb0df3 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:59.996081 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e0d9f806-4034-4bc2-8842-c79556bb0df3 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:59.996516 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e0d9f806-4034-4bc2-8842-c79556bb0df3 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:49:59.997280 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e0d9f806-4034-4bc2-8842-c79556bb0df3 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:49:59.998749 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e0d9f806-4034-4bc2-8842-c79556bb0df3 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:49:59.999499 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e0d9f806-4034-4bc2-8842-c79556bb0df3 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:00.138085 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-392b049b-4f14-41ba-9841-f063c847337b tempest-InstanceUsageAuditLogNegativeTestJSON-1990738155 tempest-InstanceUsageAuditLogNegativeTestJSON-1990738155-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:00.142639 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-392b049b-4f14-41ba-9841-f063c847337b tempest-InstanceUsageAuditLogNegativeTestJSON-1990738155 tempest-InstanceUsageAuditLogNegativeTestJSON-1990738155-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Aug 31 15:50:00.152047 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-392b049b-4f14-41ba-9841-f063c847337b tempest-InstanceUsageAuditLogNegativeTestJSON-1990738155 tempest-InstanceUsageAuditLogNegativeTestJSON-1990738155-project-admin] Request method failure captured: Aug 31 15:50:00.152047 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Aug 31 15:50:00.152047 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:50:00.152047 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:50:00.152047 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:50:00.152047 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:50:00.152047 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:50:00.152047 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:50:00.152047 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:50:00.152047 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:50:00.152047 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4Mn02HlSN85rKFsBiuchYVyTDBwnEPdz125gTZbx80oTIVJaSF028d-9sHcJzKxIdit8vW4sAKBRrSBJmk1PXhUxc4emXh7262-f62yQxtbnINArSmqQWcMxdi-XEl1Tj-3ukD3vIKQUty7pMCudOlo2NKKnLRXEe4ao4AT-I69nVU Aug 31 15:50:00.152047 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:50:00.152047 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:50:00.152047 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:50:00.152047 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:50:00.152047 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:50:00.152047 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:50:00.152047 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 06fd6b0fdbba4b07943afd115e252b6b Aug 31 15:50:00.152047 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1990738155 Aug 31 15:50:00.152047 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,admin,member Aug 31 15:50:00.152047 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,admin,member Aug 31 15:50:00.153291 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/06fd6b0fdbba4b07943afd115e252b6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/06fd6b0fdbba4b07943afd115e252b6b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/06fd6b0fdbba4b07943afd115e252b6b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_06fd6b0fdbba4b07943afd115e252b6b", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:50:00.153291 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1990738155 Aug 31 15:50:00.153291 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 06fd6b0fdbba4b07943afd115e252b6b Aug 31 15:50:00.153291 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1990738155 Aug 31 15:50:00.153291 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1990738155-project-admin Aug 31 15:50:00.153291 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:50:00.153291 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:50:00.153291 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: d016cc8b32e54f76b642832d8c61a616 Aug 31 15:50:00.153291 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1990738155-project-admin Aug 31 15:50:00.153291 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 15:50:00.153291 n-d-833090-16 devstack@n-api.service[128863]: exception: Invalid timestamp for date invalid_time Aug 31 15:50:00.154044 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'invalid_time'} Aug 31 15:50:00.154044 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:50:00.154044 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:00.154044 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Aug 31 15:50:00.154044 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Aug 31 15:50:00.154044 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Aug 31 15:50:00.154044 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Aug 31 15:50:00.154044 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Aug 31 15:50:00.154044 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Aug 31 15:50:00.154044 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Aug 31 15:50:00.154044 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:50:00.154044 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:50:00.154044 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:50:00.154044 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:00.154044 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:50:00.154044 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:50:00.154044 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:50:00.154044 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:50:00.154044 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:50:00.154044 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:50:00.155126 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Aug 31 15:50:00.155126 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Aug 31 15:50:00.155126 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Aug 31 15:50:00.155126 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:50:00.155126 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:50:00.155126 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:50:00.155126 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:00.155126 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:50:00.155126 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:50:00.155126 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:50:00.155126 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:50:00.155126 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Aug 31 15:50:00.155126 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:50:00.155126 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-392b049b-4f14-41ba-9841-f063c847337b tempest-InstanceUsageAuditLogNegativeTestJSON-1990738155 tempest-InstanceUsageAuditLogNegativeTestJSON-1990738155-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:50:00.155873 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-392b049b-4f14-41ba-9841-f063c847337b tempest-InstanceUsageAuditLogNegativeTestJSON-1990738155 tempest-InstanceUsageAuditLogNegativeTestJSON-1990738155-project-admin] 10.222.0.50 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.269536 Aug 31 15:50:00.157925 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 156/347] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Aug 31 15:49:59 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 274 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 31 15:50:00.169155 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e0d9f806-4034-4bc2-8842-c79556bb0df3 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:00.183021 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e0d9f806-4034-4bc2-8842-c79556bb0df3 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:00.186536 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e0d9f806-4034-4bc2-8842-c79556bb0df3 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:00.205192 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e0d9f806-4034-4bc2-8842-c79556bb0df3 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] 10.222.0.50 "GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f" status: 200 len: 1447 microversion: 2.75 time: 0.230903 Aug 31 15:50:00.208297 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 192/348] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:49:59 2022] GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f => generated 1447 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:50:00.223403 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0f9ad14e-bbed-46bc-acd2-d9273c205618 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:00.224498 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0f9ad14e-bbed-46bc-acd2-d9273c205618 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] [instance: 1e8fdb86-13be-42a3-a7af-5d50024f7419] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:00.241129 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0f9ad14e-bbed-46bc-acd2-d9273c205618 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:00.241977 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0f9ad14e-bbed-46bc-acd2-d9273c205618 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:00.243024 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0f9ad14e-bbed-46bc-acd2-d9273c205618 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:00.245348 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0f9ad14e-bbed-46bc-acd2-d9273c205618 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:00.246474 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0f9ad14e-bbed-46bc-acd2-d9273c205618 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:00.247056 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0f9ad14e-bbed-46bc-acd2-d9273c205618 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:00.427405 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-04ee9242-5ed9-4faa-bb8f-b4f0aa25b00c tempest-InstanceUsageAuditLogNegativeTestJSON-2137750651 tempest-InstanceUsageAuditLogNegativeTestJSON-2137750651-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:00.429259 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-04ee9242-5ed9-4faa-bb8f-b4f0aa25b00c tempest-InstanceUsageAuditLogNegativeTestJSON-2137750651 tempest-InstanceUsageAuditLogNegativeTestJSON-2137750651-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '37ee620a11bc47a28b44c18816f79b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864cd8b673f949158aeb94acdd663ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:00.430986 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-04ee9242-5ed9-4faa-bb8f-b4f0aa25b00c tempest-InstanceUsageAuditLogNegativeTestJSON-2137750651 tempest-InstanceUsageAuditLogNegativeTestJSON-2137750651-project] Request method failure captured: Aug 31 15:50:00.430986 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Aug 31 15:50:00.430986 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:50:00.430986 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:50:00.430986 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:50:00.430986 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:50:00.430986 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:50:00.430986 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:50:00.430986 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:50:00.430986 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:50:00.430986 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4Mm00EcK97KQGXeaWbJva1UKRL9URdXTo2xDdWrA5nKnVyG1FsRFskx75o0BhfoVkZmg9TRyfwaOPWJ-m8DS8AI7aE55nh6AORKtJ9-64wlmjA3S2uK8zfbPvnPzYHHww0D9q248-ko4KVyHmw8z2lcUy9uJLpTE0qhxArwUaE9lSM Aug 31 15:50:00.430986 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:50:00.430986 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:50:00.430986 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:50:00.430986 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:50:00.430986 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:50:00.430986 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:50:00.430986 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 864cd8b673f949158aeb94acdd663ebf Aug 31 15:50:00.430986 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2137750651 Aug 31 15:50:00.430986 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:50:00.430986 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:50:00.432472 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/864cd8b673f949158aeb94acdd663ebf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/864cd8b673f949158aeb94acdd663ebf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/864cd8b673f949158aeb94acdd663ebf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_864cd8b673f949158aeb94acdd663ebf", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:50:00.432472 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-2137750651 Aug 31 15:50:00.432472 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 864cd8b673f949158aeb94acdd663ebf Aug 31 15:50:00.432472 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2137750651 Aug 31 15:50:00.432472 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-2137750651-project Aug 31 15:50:00.432472 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:50:00.432472 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:50:00.432472 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 37ee620a11bc47a28b44c18816f79b89 Aug 31 15:50:00.432472 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2137750651-project Aug 31 15:50:00.432472 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 15:50:00.433175 n-d-833090-16 devstack@n-api.service[128863]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 31 15:50:00.433175 n-d-833090-16 devstack@n-api.service[128863]: action_args: {} Aug 31 15:50:00.433175 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:50:00.433175 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:00.433175 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:50:00.433175 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:50:00.433175 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:50:00.433175 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:50:00.433175 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:50:00.433175 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:50:00.433175 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Aug 31 15:50:00.433175 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Aug 31 15:50:00.433175 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 15:50:00.433175 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 15:50:00.433175 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 15:50:00.433175 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 15:50:00.433175 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:50:00.433175 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:50:00.433175 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:50:00.433175 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:50:00.434503 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 15:50:00.434503 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 15:50:00.434503 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 15:50:00.434503 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 15:50:00.434503 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 15:50:00.434503 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 15:50:00.434503 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 31 15:50:00.434503 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:50:00.434503 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:50:00.434503 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:50:00.434503 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:00.434503 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:50:00.434503 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:50:00.434503 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 15:50:00.434503 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 15:50:00.434503 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 31 15:50:00.434503 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:50:00.439816 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-04ee9242-5ed9-4faa-bb8f-b4f0aa25b00c tempest-InstanceUsageAuditLogNegativeTestJSON-2137750651 tempest-InstanceUsageAuditLogNegativeTestJSON-2137750651-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:50:00.441472 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-04ee9242-5ed9-4faa-bb8f-b4f0aa25b00c tempest-InstanceUsageAuditLogNegativeTestJSON-2137750651 tempest-InstanceUsageAuditLogNegativeTestJSON-2137750651-project] 10.222.0.50 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.271675 Aug 31 15:50:00.442553 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 157/349] 10.222.0.50 () {58 vars in 1185 bytes} [Wed Aug 31 15:50:00 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 274 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:50:00.454173 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-85a7df98-a387-4886-8922-77e85f917e5e tempest-InstanceUsageAuditLogNegativeTestJSON-2137750651 tempest-InstanceUsageAuditLogNegativeTestJSON-2137750651-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:00.457302 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-85a7df98-a387-4886-8922-77e85f917e5e tempest-InstanceUsageAuditLogNegativeTestJSON-2137750651 tempest-InstanceUsageAuditLogNegativeTestJSON-2137750651-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '37ee620a11bc47a28b44c18816f79b89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '864cd8b673f949158aeb94acdd663ebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:00.475515 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-85a7df98-a387-4886-8922-77e85f917e5e tempest-InstanceUsageAuditLogNegativeTestJSON-2137750651 tempest-InstanceUsageAuditLogNegativeTestJSON-2137750651-project] Request method failure captured: Aug 31 15:50:00.475515 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-08-31%2015:50:00 HTTP/1.1 Aug 31 15:50:00.475515 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:50:00.475515 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:50:00.475515 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:50:00.475515 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:50:00.475515 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:50:00.475515 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:50:00.475515 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:50:00.475515 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:50:00.475515 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4Mm00EcK97KQGXeaWbJva1UKRL9URdXTo2xDdWrA5nKnVyG1FsRFskx75o0BhfoVkZmg9TRyfwaOPWJ-m8DS8AI7aE55nh6AORKtJ9-64wlmjA3S2uK8zfbPvnPzYHHww0D9q248-ko4KVyHmw8z2lcUy9uJLpTE0qhxArwUaE9lSM Aug 31 15:50:00.475515 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:50:00.475515 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:50:00.475515 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:50:00.475515 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:50:00.475515 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:50:00.475515 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:50:00.475515 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 864cd8b673f949158aeb94acdd663ebf Aug 31 15:50:00.475515 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2137750651 Aug 31 15:50:00.475515 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:50:00.475515 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:50:00.477093 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/864cd8b673f949158aeb94acdd663ebf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/864cd8b673f949158aeb94acdd663ebf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/864cd8b673f949158aeb94acdd663ebf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_864cd8b673f949158aeb94acdd663ebf", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:50:00.477093 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-2137750651 Aug 31 15:50:00.477093 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 864cd8b673f949158aeb94acdd663ebf Aug 31 15:50:00.477093 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2137750651 Aug 31 15:50:00.477093 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-2137750651-project Aug 31 15:50:00.477093 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:50:00.477093 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:50:00.477093 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 37ee620a11bc47a28b44c18816f79b89 Aug 31 15:50:00.477093 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2137750651-project Aug 31 15:50:00.477093 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 15:50:00.477773 n-d-833090-16 devstack@n-api.service[128863]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 31 15:50:00.477773 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '2022-08-31 15:50:00'} Aug 31 15:50:00.477773 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:50:00.477773 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:00.477773 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:50:00.477773 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:50:00.477773 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:50:00.477773 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:50:00.477773 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:50:00.477773 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:50:00.477773 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Aug 31 15:50:00.477773 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Aug 31 15:50:00.477773 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 15:50:00.477773 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 15:50:00.477773 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 15:50:00.477773 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 15:50:00.477773 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:50:00.477773 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:50:00.477773 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:50:00.477773 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:50:00.479118 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 15:50:00.479118 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 15:50:00.479118 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 15:50:00.479118 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 15:50:00.479118 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 15:50:00.479118 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 15:50:00.479118 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 31 15:50:00.479118 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:50:00.479118 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:50:00.479118 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:50:00.479118 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:00.479118 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:50:00.479118 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:50:00.479118 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 15:50:00.479118 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 15:50:00.479118 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 31 15:50:00.479118 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:50:00.480359 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-85a7df98-a387-4886-8922-77e85f917e5e tempest-InstanceUsageAuditLogNegativeTestJSON-2137750651 tempest-InstanceUsageAuditLogNegativeTestJSON-2137750651-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:50:00.480359 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-85a7df98-a387-4886-8922-77e85f917e5e tempest-InstanceUsageAuditLogNegativeTestJSON-2137750651 tempest-InstanceUsageAuditLogNegativeTestJSON-2137750651-project] 10.222.0.50 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-31 15:50:00" status: 403 len: 128 microversion: 2.1 time: 0.030721 Aug 31 15:50:00.484735 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 158/350] 10.222.0.50 () {58 vars in 1251 bytes} [Wed Aug 31 15:50:00 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-31%2015%3A50%3A00 => generated 128 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:50:00.995674 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2814405d-7bd3-4b0c-a956-5995cc82a525 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:00.996403 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2814405d-7bd3-4b0c-a956-5995cc82a525 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: c3ca0ff6-8f52-4ac3-8706-f5efab49a099] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:01.021886 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2814405d-7bd3-4b0c-a956-5995cc82a525 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:01.028254 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2814405d-7bd3-4b0c-a956-5995cc82a525 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:01.030782 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2814405d-7bd3-4b0c-a956-5995cc82a525 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:01.031563 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2814405d-7bd3-4b0c-a956-5995cc82a525 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:01.032036 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2814405d-7bd3-4b0c-a956-5995cc82a525 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:01.032462 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2814405d-7bd3-4b0c-a956-5995cc82a525 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:01.464183 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2814405d-7bd3-4b0c-a956-5995cc82a525 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:01.475106 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2814405d-7bd3-4b0c-a956-5995cc82a525 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/c3ca0ff6-8f52-4ac3-8706-f5efab49a099" status: 200 len: 1276 microversion: 2.1 time: 0.485197 Aug 31 15:50:01.476181 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 159/351] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:00 2022] GET /compute/v2.1/servers/c3ca0ff6-8f52-4ac3-8706-f5efab49a099 => generated 1276 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:01.501591 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-50ea553f-7ded-49e9-97f9-0eff8baed217 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:01.502336 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-50ea553f-7ded-49e9-97f9-0eff8baed217 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:01.519761 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50ea553f-7ded-49e9-97f9-0eff8baed217 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:01.520185 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50ea553f-7ded-49e9-97f9-0eff8baed217 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:01.520620 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50ea553f-7ded-49e9-97f9-0eff8baed217 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:01.521827 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50ea553f-7ded-49e9-97f9-0eff8baed217 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:01.522339 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50ea553f-7ded-49e9-97f9-0eff8baed217 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:01.522912 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50ea553f-7ded-49e9-97f9-0eff8baed217 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:01.659239 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0f9ad14e-bbed-46bc-acd2-d9273c205618 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704d7c428d3e4a1bbe5fb78485415214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a08078ba5a04c31b6cc63dee67be8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:01.668033 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0f9ad14e-bbed-46bc-acd2-d9273c205618 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] 10.222.0.50 "GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419" status: 200 len: 1368 microversion: 2.1 time: 1.456181 Aug 31 15:50:01.668586 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 193/352] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:00 2022] GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419 => generated 1368 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:01.797420 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-50ea553f-7ded-49e9-97f9-0eff8baed217 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:01.816640 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-50ea553f-7ded-49e9-97f9-0eff8baed217 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:01.819959 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-50ea553f-7ded-49e9-97f9-0eff8baed217 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:01.831199 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-50ea553f-7ded-49e9-97f9-0eff8baed217 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] 10.222.0.50 "GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f" status: 200 len: 1447 microversion: 2.75 time: 0.353752 Aug 31 15:50:01.832922 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 160/353] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:50:01 2022] GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f => generated 1447 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:50:02.424764 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-79e957cb-774f-40b6-8fe0-2660a3362ca0 req-f736d433-d056-4ec5-af4f-af82a6a4cf61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3ca0ff6-8f52-4ac3-8706-f5efab49a099", "tag": "68581347-ace3-404a-bd96-2f05626c4e9c"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:50:02.436565 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-79e957cb-774f-40b6-8fe0-2660a3362ca0 req-f736d433-d056-4ec5-af4f-af82a6a4cf61 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:02.437442 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-79e957cb-774f-40b6-8fe0-2660a3362ca0 req-f736d433-d056-4ec5-af4f-af82a6a4cf61 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:02.438010 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-79e957cb-774f-40b6-8fe0-2660a3362ca0 req-f736d433-d056-4ec5-af4f-af82a6a4cf61 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:02.451144 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-79e957cb-774f-40b6-8fe0-2660a3362ca0 req-f736d433-d056-4ec5-af4f-af82a6a4cf61 service nova] Creating event network-changed:68581347-ace3-404a-bd96-2f05626c4e9c for instance c3ca0ff6-8f52-4ac3-8706-f5efab49a099 on n-h1-833090-16 Aug 31 15:50:02.458473 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-79e957cb-774f-40b6-8fe0-2660a3362ca0 req-f736d433-d056-4ec5-af4f-af82a6a4cf61 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036915 Aug 31 15:50:02.460017 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 194/354] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:50:02.498260 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3f40286d-8e5c-43f6-9da2-75c146daf131 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:02.498837 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3f40286d-8e5c-43f6-9da2-75c146daf131 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: c3ca0ff6-8f52-4ac3-8706-f5efab49a099] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:02.505363 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f40286d-8e5c-43f6-9da2-75c146daf131 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:02.506187 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f40286d-8e5c-43f6-9da2-75c146daf131 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:02.506864 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f40286d-8e5c-43f6-9da2-75c146daf131 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:02.507810 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f40286d-8e5c-43f6-9da2-75c146daf131 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:02.508343 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f40286d-8e5c-43f6-9da2-75c146daf131 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:02.508927 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f40286d-8e5c-43f6-9da2-75c146daf131 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:02.693584 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-aca76693-99f4-4d17-bf5c-f703bd1875b5 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:02.694529 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-aca76693-99f4-4d17-bf5c-f703bd1875b5 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] [instance: 1e8fdb86-13be-42a3-a7af-5d50024f7419] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:02.716439 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aca76693-99f4-4d17-bf5c-f703bd1875b5 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:02.720399 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aca76693-99f4-4d17-bf5c-f703bd1875b5 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:02.722490 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aca76693-99f4-4d17-bf5c-f703bd1875b5 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:02.725947 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aca76693-99f4-4d17-bf5c-f703bd1875b5 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:02.726695 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aca76693-99f4-4d17-bf5c-f703bd1875b5 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:02.727252 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aca76693-99f4-4d17-bf5c-f703bd1875b5 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:03.454858 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3f40286d-8e5c-43f6-9da2-75c146daf131 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:03.465133 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3f40286d-8e5c-43f6-9da2-75c146daf131 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/c3ca0ff6-8f52-4ac3-8706-f5efab49a099" status: 200 len: 1318 microversion: 2.1 time: 0.971632 Aug 31 15:50:03.466870 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 161/355] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:02 2022] GET /compute/v2.1/servers/c3ca0ff6-8f52-4ac3-8706-f5efab49a099 => generated 1318 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:03.475606 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8acc14f3-fe39-4767-8c34-b420b14c02a9 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:03.477333 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8acc14f3-fe39-4767-8c34-b420b14c02a9 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:03.490040 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8acc14f3-fe39-4767-8c34-b420b14c02a9 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:03.491329 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8acc14f3-fe39-4767-8c34-b420b14c02a9 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:03.491878 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8acc14f3-fe39-4767-8c34-b420b14c02a9 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:03.492791 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8acc14f3-fe39-4767-8c34-b420b14c02a9 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:03.493405 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8acc14f3-fe39-4767-8c34-b420b14c02a9 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:03.494742 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8acc14f3-fe39-4767-8c34-b420b14c02a9 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:03.596952 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-aca76693-99f4-4d17-bf5c-f703bd1875b5 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704d7c428d3e4a1bbe5fb78485415214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a08078ba5a04c31b6cc63dee67be8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:03.614748 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-aca76693-99f4-4d17-bf5c-f703bd1875b5 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] 10.222.0.50 "GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419" status: 200 len: 1368 microversion: 2.1 time: 0.922139 Aug 31 15:50:03.620999 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 195/356] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:02 2022] GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419 => generated 1368 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:03.743935 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8acc14f3-fe39-4767-8c34-b420b14c02a9 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:03.759202 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8acc14f3-fe39-4767-8c34-b420b14c02a9 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:03.760879 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8acc14f3-fe39-4767-8c34-b420b14c02a9 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:03.764632 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=7,nova_api:DELETE=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:50:03.781400 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8acc14f3-fe39-4767-8c34-b420b14c02a9 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] 10.222.0.50 "GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f" status: 200 len: 1447 microversion: 2.75 time: 0.312830 Aug 31 15:50:03.782721 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 162/357] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:50:03 2022] GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f => generated 1447 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:50:04.490704 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-849b346a-8e33-4324-9d16-65ef80f1b421 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:04.493652 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-849b346a-8e33-4324-9d16-65ef80f1b421 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: c3ca0ff6-8f52-4ac3-8706-f5efab49a099] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:04.518380 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-849b346a-8e33-4324-9d16-65ef80f1b421 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:04.519287 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-849b346a-8e33-4324-9d16-65ef80f1b421 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:04.519872 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-849b346a-8e33-4324-9d16-65ef80f1b421 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:04.520788 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-849b346a-8e33-4324-9d16-65ef80f1b421 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:04.521415 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-849b346a-8e33-4324-9d16-65ef80f1b421 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:04.521998 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-849b346a-8e33-4324-9d16-65ef80f1b421 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:04.643230 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c9042376-ee3e-44c9-aa33-a23b58a3e912 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:04.643777 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c9042376-ee3e-44c9-aa33-a23b58a3e912 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] [instance: 1e8fdb86-13be-42a3-a7af-5d50024f7419] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:04.670353 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9042376-ee3e-44c9-aa33-a23b58a3e912 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:04.676745 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9042376-ee3e-44c9-aa33-a23b58a3e912 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:04.679746 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9042376-ee3e-44c9-aa33-a23b58a3e912 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:04.687054 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9042376-ee3e-44c9-aa33-a23b58a3e912 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:04.688008 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9042376-ee3e-44c9-aa33-a23b58a3e912 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:04.691500 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9042376-ee3e-44c9-aa33-a23b58a3e912 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:05.700562 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-849b346a-8e33-4324-9d16-65ef80f1b421 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:05.713440 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-849b346a-8e33-4324-9d16-65ef80f1b421 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/c3ca0ff6-8f52-4ac3-8706-f5efab49a099" status: 200 len: 1318 microversion: 2.1 time: 1.227928 Aug 31 15:50:05.729584 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 196/358] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:04 2022] GET /compute/v2.1/servers/c3ca0ff6-8f52-4ac3-8706-f5efab49a099 => generated 1318 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:05.735895 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1a272008-17ec-4948-a94d-032a3cb217e3 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:05.736733 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1a272008-17ec-4948-a94d-032a3cb217e3 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:05.743750 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a272008-17ec-4948-a94d-032a3cb217e3 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:05.744645 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a272008-17ec-4948-a94d-032a3cb217e3 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:05.745229 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a272008-17ec-4948-a94d-032a3cb217e3 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:05.746115 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a272008-17ec-4948-a94d-032a3cb217e3 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:05.746722 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a272008-17ec-4948-a94d-032a3cb217e3 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:05.747479 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a272008-17ec-4948-a94d-032a3cb217e3 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:06.084096 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c9042376-ee3e-44c9-aa33-a23b58a3e912 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704d7c428d3e4a1bbe5fb78485415214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a08078ba5a04c31b6cc63dee67be8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:06.101388 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c9042376-ee3e-44c9-aa33-a23b58a3e912 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] 10.222.0.50 "GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419" status: 200 len: 1368 microversion: 2.1 time: 1.462145 Aug 31 15:50:06.102181 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 163/359] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:04 2022] GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419 => generated 1368 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:50:06.428928 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1a272008-17ec-4948-a94d-032a3cb217e3 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:06.453365 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1a272008-17ec-4948-a94d-032a3cb217e3 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:06.458438 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1a272008-17ec-4948-a94d-032a3cb217e3 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:06.474353 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1a272008-17ec-4948-a94d-032a3cb217e3 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] 10.222.0.50 "GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f" status: 200 len: 1447 microversion: 2.75 time: 0.740965 Aug 31 15:50:06.476212 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 197/360] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:50:05 2022] GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f => generated 1447 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:50:06.738144 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1ceb495d-9deb-47eb-8c9e-edcd1b259147 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:06.738934 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1ceb495d-9deb-47eb-8c9e-edcd1b259147 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: c3ca0ff6-8f52-4ac3-8706-f5efab49a099] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:06.752716 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ceb495d-9deb-47eb-8c9e-edcd1b259147 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:06.755014 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ceb495d-9deb-47eb-8c9e-edcd1b259147 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:06.757240 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ceb495d-9deb-47eb-8c9e-edcd1b259147 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:06.759667 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ceb495d-9deb-47eb-8c9e-edcd1b259147 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:06.763322 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ceb495d-9deb-47eb-8c9e-edcd1b259147 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:06.764276 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ceb495d-9deb-47eb-8c9e-edcd1b259147 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:07.126586 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0774c0bd-bc37-4e8d-bd85-1005ff6fb41c tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:07.128094 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0774c0bd-bc37-4e8d-bd85-1005ff6fb41c tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] [instance: 1e8fdb86-13be-42a3-a7af-5d50024f7419] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:07.147940 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0774c0bd-bc37-4e8d-bd85-1005ff6fb41c tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:07.148948 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0774c0bd-bc37-4e8d-bd85-1005ff6fb41c tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:07.152137 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0774c0bd-bc37-4e8d-bd85-1005ff6fb41c tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:07.154057 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0774c0bd-bc37-4e8d-bd85-1005ff6fb41c tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:07.155207 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=40 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:50:07.160310 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0774c0bd-bc37-4e8d-bd85-1005ff6fb41c tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:07.160991 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0774c0bd-bc37-4e8d-bd85-1005ff6fb41c tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:07.382632 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1ceb495d-9deb-47eb-8c9e-edcd1b259147 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:07.394444 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1ceb495d-9deb-47eb-8c9e-edcd1b259147 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/c3ca0ff6-8f52-4ac3-8706-f5efab49a099" status: 200 len: 1318 microversion: 2.1 time: 0.660359 Aug 31 15:50:07.402221 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 164/361] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:06 2022] GET /compute/v2.1/servers/c3ca0ff6-8f52-4ac3-8706-f5efab49a099 => generated 1318 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:07.503580 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d210d161-4cf7-4ffb-b5da-274c8d6ce9e8 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:07.504740 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d210d161-4cf7-4ffb-b5da-274c8d6ce9e8 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:07.515947 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d210d161-4cf7-4ffb-b5da-274c8d6ce9e8 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:07.520678 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d210d161-4cf7-4ffb-b5da-274c8d6ce9e8 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:07.522951 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d210d161-4cf7-4ffb-b5da-274c8d6ce9e8 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:07.523921 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d210d161-4cf7-4ffb-b5da-274c8d6ce9e8 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:07.525487 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d210d161-4cf7-4ffb-b5da-274c8d6ce9e8 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:07.526246 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d210d161-4cf7-4ffb-b5da-274c8d6ce9e8 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:07.774203 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0774c0bd-bc37-4e8d-bd85-1005ff6fb41c tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704d7c428d3e4a1bbe5fb78485415214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a08078ba5a04c31b6cc63dee67be8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:07.785226 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d210d161-4cf7-4ffb-b5da-274c8d6ce9e8 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:07.806856 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d210d161-4cf7-4ffb-b5da-274c8d6ce9e8 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:07.807915 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0774c0bd-bc37-4e8d-bd85-1005ff6fb41c tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] 10.222.0.50 "GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419" status: 200 len: 1368 microversion: 2.1 time: 0.682749 Aug 31 15:50:07.810600 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 198/362] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:07 2022] GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419 => generated 1368 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:50:07.816717 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d210d161-4cf7-4ffb-b5da-274c8d6ce9e8 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:07.835163 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d210d161-4cf7-4ffb-b5da-274c8d6ce9e8 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] 10.222.0.50 "GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f" status: 200 len: 1453 microversion: 2.75 time: 0.335574 Aug 31 15:50:07.836036 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 165/363] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:50:07 2022] GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f => generated 1453 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 15:50:08.175040 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ead7b4e9-e614-47ce-858c-d06c8f47f777 tempest-HypervisorAdminNegativeTestJSON-1515959070 tempest-HypervisorAdminNegativeTestJSON-1515959070-project] Calling method '.version_select at 0x7fbb470481f0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:08.177615 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ead7b4e9-e614-47ce-858c-d06c8f47f777 tempest-HypervisorAdminNegativeTestJSON-1515959070 tempest-HypervisorAdminNegativeTestJSON-1515959070-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'c035285d282049ecbd229799398aaa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99eaabde7a544f47a1aa96dfcadff301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:08.182570 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ead7b4e9-e614-47ce-858c-d06c8f47f777 tempest-HypervisorAdminNegativeTestJSON-1515959070 tempest-HypervisorAdminNegativeTestJSON-1515959070-project] Request method failure captured: Aug 31 15:50:08.182570 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Aug 31 15:50:08.182570 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:50:08.182570 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:50:08.182570 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:50:08.182570 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:50:08.182570 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:50:08.182570 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:50:08.182570 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:50:08.182570 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:50:08.182570 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4MtfNrUSISrnPA6LvUUpvOAD2IL_Ea1pZMBHiFrsXMbkNLAgTXjxfuLaLAlNwvSufzAR33qXXShFYGrCYyyjulogAfgEAN-SR6H2lu8LzVyqLrqwIQXJP0iLuwlnjuN0lRroI8-DJH3m6cNPx2KsQANWowcOQ3aGVDFDLQDjik8dZA Aug 31 15:50:08.182570 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:50:08.182570 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:50:08.182570 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:50:08.182570 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:50:08.182570 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:50:08.182570 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:50:08.182570 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 99eaabde7a544f47a1aa96dfcadff301 Aug 31 15:50:08.182570 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1515959070 Aug 31 15:50:08.182570 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:50:08.182570 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:50:08.183943 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/99eaabde7a544f47a1aa96dfcadff301"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/99eaabde7a544f47a1aa96dfcadff301"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/99eaabde7a544f47a1aa96dfcadff301"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_99eaabde7a544f47a1aa96dfcadff301", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:50:08.183943 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1515959070 Aug 31 15:50:08.183943 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 99eaabde7a544f47a1aa96dfcadff301 Aug 31 15:50:08.183943 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1515959070 Aug 31 15:50:08.183943 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-HypervisorAdminNegativeTestJSON-1515959070-project Aug 31 15:50:08.183943 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:50:08.183943 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:50:08.183943 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: c035285d282049ecbd229799398aaa81 Aug 31 15:50:08.183943 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1515959070-project Aug 31 15:50:08.183943 n-d-833090-16 devstack@n-api.service[128864]: method: Aug 31 15:50:08.183943 n-d-833090-16 devstack@n-api.service[128864]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 31 15:50:08.183943 n-d-833090-16 devstack@n-api.service[128864]: action_args: {} Aug 31 15:50:08.183943 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:50:08.185344 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:08.185344 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:50:08.185344 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:50:08.185344 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:50:08.185344 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:50:08.185344 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:50:08.185344 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:50:08.185344 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:50:08.185344 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:50:08.185344 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Aug 31 15:50:08.185344 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._detail(req) Aug 31 15:50:08.185344 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Aug 31 15:50:08.185344 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Aug 31 15:50:08.185344 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 15:50:08.185344 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 15:50:08.185344 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 15:50:08.185344 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 15:50:08.185344 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:50:08.185344 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:50:08.187108 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:50:08.187108 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:50:08.187108 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 15:50:08.187108 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 15:50:08.187108 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 15:50:08.187108 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 15:50:08.187108 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 15:50:08.187108 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 15:50:08.187108 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 31 15:50:08.187108 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:08.187108 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:50:08.187108 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:08.187108 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:08.187108 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:50:08.187108 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:50:08.187108 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 15:50:08.187108 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 15:50:08.187108 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 31 15:50:08.187108 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:08.191238 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ead7b4e9-e614-47ce-858c-d06c8f47f777 tempest-HypervisorAdminNegativeTestJSON-1515959070 tempest-HypervisorAdminNegativeTestJSON-1515959070-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:50:08.194857 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ead7b4e9-e614-47ce-858c-d06c8f47f777 tempest-HypervisorAdminNegativeTestJSON-1515959070 tempest-HypervisorAdminNegativeTestJSON-1515959070-project] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.381406 Aug 31 15:50:08.195645 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-da440d13-2b21-4fe1-88c3-c6ec8713bb1e tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465 tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-77048473", "ram": 512, "vcpus": 1, "disk": 10, "id": 717171740, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:50:08.197446 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 199/364] 10.222.0.50 () {58 vars in 1167 bytes} [Wed Aug 31 15:50:07 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 386 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:50:08.209844 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6bc93f2b-7e22-47ab-804a-dea086c5bf8d tempest-HypervisorAdminNegativeTestJSON-1515959070 tempest-HypervisorAdminNegativeTestJSON-1515959070-project] Calling method '.version_select at 0x7fbb4731c160>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:08.212069 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6bc93f2b-7e22-47ab-804a-dea086c5bf8d tempest-HypervisorAdminNegativeTestJSON-1515959070 tempest-HypervisorAdminNegativeTestJSON-1515959070-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'c035285d282049ecbd229799398aaa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99eaabde7a544f47a1aa96dfcadff301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:08.214406 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6bc93f2b-7e22-47ab-804a-dea086c5bf8d tempest-HypervisorAdminNegativeTestJSON-1515959070 tempest-HypervisorAdminNegativeTestJSON-1515959070-project] Request method failure captured: Aug 31 15:50:08.214406 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Aug 31 15:50:08.214406 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:50:08.214406 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:50:08.214406 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:50:08.214406 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:50:08.214406 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:50:08.214406 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:50:08.214406 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:50:08.214406 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:50:08.214406 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4MtfNrUSISrnPA6LvUUpvOAD2IL_Ea1pZMBHiFrsXMbkNLAgTXjxfuLaLAlNwvSufzAR33qXXShFYGrCYyyjulogAfgEAN-SR6H2lu8LzVyqLrqwIQXJP0iLuwlnjuN0lRroI8-DJH3m6cNPx2KsQANWowcOQ3aGVDFDLQDjik8dZA Aug 31 15:50:08.214406 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:50:08.214406 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:50:08.214406 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:50:08.214406 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:50:08.214406 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:50:08.214406 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:50:08.214406 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 99eaabde7a544f47a1aa96dfcadff301 Aug 31 15:50:08.214406 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1515959070 Aug 31 15:50:08.214406 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:50:08.214406 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:50:08.215573 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/99eaabde7a544f47a1aa96dfcadff301"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/99eaabde7a544f47a1aa96dfcadff301"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/99eaabde7a544f47a1aa96dfcadff301"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_99eaabde7a544f47a1aa96dfcadff301", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:50:08.215573 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1515959070 Aug 31 15:50:08.215573 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 99eaabde7a544f47a1aa96dfcadff301 Aug 31 15:50:08.215573 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1515959070 Aug 31 15:50:08.215573 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-HypervisorAdminNegativeTestJSON-1515959070-project Aug 31 15:50:08.215573 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:50:08.215573 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:50:08.215573 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: c035285d282049ecbd229799398aaa81 Aug 31 15:50:08.215573 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1515959070-project Aug 31 15:50:08.215573 n-d-833090-16 devstack@n-api.service[128864]: method: Aug 31 15:50:08.215573 n-d-833090-16 devstack@n-api.service[128864]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 31 15:50:08.215573 n-d-833090-16 devstack@n-api.service[128864]: action_args: {} Aug 31 15:50:08.215573 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:50:08.216699 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:08.216699 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:50:08.216699 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:50:08.216699 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:50:08.216699 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:50:08.216699 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:50:08.216699 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:50:08.216699 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:50:08.216699 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:50:08.216699 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Aug 31 15:50:08.216699 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 31 15:50:08.216699 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Aug 31 15:50:08.216699 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Aug 31 15:50:08.216699 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 15:50:08.216699 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 15:50:08.216699 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 15:50:08.216699 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 15:50:08.216699 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:50:08.216699 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:50:08.217713 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:50:08.217713 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:50:08.217713 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 15:50:08.217713 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 15:50:08.217713 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 15:50:08.217713 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 15:50:08.217713 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 15:50:08.217713 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 15:50:08.217713 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 31 15:50:08.217713 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:08.217713 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:50:08.217713 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:08.217713 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:08.217713 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:50:08.217713 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:50:08.217713 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 15:50:08.217713 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 15:50:08.217713 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 31 15:50:08.217713 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:08.221851 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6bc93f2b-7e22-47ab-804a-dea086c5bf8d tempest-HypervisorAdminNegativeTestJSON-1515959070 tempest-HypervisorAdminNegativeTestJSON-1515959070-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:50:08.222679 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6bc93f2b-7e22-47ab-804a-dea086c5bf8d tempest-HypervisorAdminNegativeTestJSON-1515959070 tempest-HypervisorAdminNegativeTestJSON-1515959070-project] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.018201 Aug 31 15:50:08.223407 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 200/365] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 31 15:50:08 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:50:08.234509 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-da440d13-2b21-4fe1-88c3-c6ec8713bb1e tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465 tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.385885 Aug 31 15:50:08.242807 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 166/366] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:50:07 2022] POST /compute/v2.1/flavors => generated 411 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:50:08.243792 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7d4cb673-8b32-4f0f-b05b-015bb46b9eda tempest-HypervisorAdminNegativeTestJSON-1515959070 tempest-HypervisorAdminNegativeTestJSON-1515959070-project] Calling method '.version_select at 0x7fbb4731cd30>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:08.249034 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7d4cb673-8b32-4f0f-b05b-015bb46b9eda tempest-HypervisorAdminNegativeTestJSON-1515959070 tempest-HypervisorAdminNegativeTestJSON-1515959070-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'c035285d282049ecbd229799398aaa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99eaabde7a544f47a1aa96dfcadff301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:08.254559 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7d4cb673-8b32-4f0f-b05b-015bb46b9eda tempest-HypervisorAdminNegativeTestJSON-1515959070 tempest-HypervisorAdminNegativeTestJSON-1515959070-project] Request method failure captured: Aug 31 15:50:08.254559 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Aug 31 15:50:08.254559 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:50:08.254559 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:50:08.254559 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:50:08.254559 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:50:08.254559 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:50:08.254559 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:50:08.254559 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:50:08.254559 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:50:08.254559 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4MtfNrUSISrnPA6LvUUpvOAD2IL_Ea1pZMBHiFrsXMbkNLAgTXjxfuLaLAlNwvSufzAR33qXXShFYGrCYyyjulogAfgEAN-SR6H2lu8LzVyqLrqwIQXJP0iLuwlnjuN0lRroI8-DJH3m6cNPx2KsQANWowcOQ3aGVDFDLQDjik8dZA Aug 31 15:50:08.254559 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:50:08.254559 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:50:08.254559 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:50:08.254559 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:50:08.254559 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:50:08.254559 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:50:08.254559 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 99eaabde7a544f47a1aa96dfcadff301 Aug 31 15:50:08.254559 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1515959070 Aug 31 15:50:08.254559 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:50:08.254559 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:50:08.256060 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/99eaabde7a544f47a1aa96dfcadff301"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/99eaabde7a544f47a1aa96dfcadff301"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/99eaabde7a544f47a1aa96dfcadff301"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_99eaabde7a544f47a1aa96dfcadff301", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:50:08.256060 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1515959070 Aug 31 15:50:08.256060 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 99eaabde7a544f47a1aa96dfcadff301 Aug 31 15:50:08.256060 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1515959070 Aug 31 15:50:08.256060 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-HypervisorAdminNegativeTestJSON-1515959070-project Aug 31 15:50:08.256060 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:50:08.256060 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:50:08.256060 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: c035285d282049ecbd229799398aaa81 Aug 31 15:50:08.256060 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1515959070-project Aug 31 15:50:08.256060 n-d-833090-16 devstack@n-api.service[128864]: method: Aug 31 15:50:08.256060 n-d-833090-16 devstack@n-api.service[128864]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 31 15:50:08.256060 n-d-833090-16 devstack@n-api.service[128864]: action_args: {} Aug 31 15:50:08.256060 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:50:08.256871 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:08.256871 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:50:08.256871 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:50:08.256871 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:50:08.256871 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:50:08.256871 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:50:08.256871 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:50:08.256871 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:50:08.256871 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:50:08.256871 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Aug 31 15:50:08.256871 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Aug 31 15:50:08.256871 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 15:50:08.256871 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 15:50:08.256871 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 15:50:08.256871 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 15:50:08.256871 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:50:08.256871 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:50:08.256871 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:50:08.256871 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:50:08.258067 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 15:50:08.258067 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 15:50:08.258067 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 15:50:08.258067 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 15:50:08.258067 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 15:50:08.258067 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 15:50:08.258067 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 31 15:50:08.258067 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:08.258067 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:50:08.258067 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:08.258067 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:08.258067 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:50:08.258067 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:50:08.258067 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 15:50:08.258067 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 15:50:08.258067 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 31 15:50:08.258067 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:08.260156 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7d4cb673-8b32-4f0f-b05b-015bb46b9eda tempest-HypervisorAdminNegativeTestJSON-1515959070 tempest-HypervisorAdminNegativeTestJSON-1515959070-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:50:08.261561 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7d4cb673-8b32-4f0f-b05b-015bb46b9eda tempest-HypervisorAdminNegativeTestJSON-1515959070 tempest-HypervisorAdminNegativeTestJSON-1515959070-project] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.026934 Aug 31 15:50:08.262477 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 201/367] 10.222.0.50 () {58 vars in 1179 bytes} [Wed Aug 31 15:50:08 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:50:08.430394 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-afaf7bd4-0d62-42c9-b326-750fe4483867 tempest-FlavorsExtraSpecsNegativeTestJSON-157149317 tempest-FlavorsExtraSpecsNegativeTestJSON-157149317-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:08.455623 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-afaf7bd4-0d62-42c9-b326-750fe4483867 tempest-FlavorsExtraSpecsNegativeTestJSON-157149317 tempest-FlavorsExtraSpecsNegativeTestJSON-157149317-project] HTTP exception thrown: Flavor 717171740 has no extra specs with key hw:cpu_thread_policy. Aug 31 15:50:08.463429 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-afaf7bd4-0d62-42c9-b326-750fe4483867 tempest-FlavorsExtraSpecsNegativeTestJSON-157149317 tempest-FlavorsExtraSpecsNegativeTestJSON-157149317-project] Request method failure captured: Aug 31 15:50:08.463429 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/flavors/717171740/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 31 15:50:08.463429 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:50:08.463429 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:50:08.463429 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:50:08.463429 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:50:08.463429 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:50:08.463429 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:50:08.463429 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:50:08.463429 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:50:08.463429 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4MtEvh-PZhri8wQdGYHZ842GxDfai2P7bkm7fj0_9Soi-VxpCMaxRa8GEP0aOqnLvDct4wrbk7xQQP6iOWenwHBWW2r_WoJsHW2u1Vmwo0skCj9jfwgWdIM6yLUeh_zWQCtTITC-0fYkC9xe8FZLRBkZC3QnItsEpB81zAQmZdq_UA Aug 31 15:50:08.463429 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:50:08.463429 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:50:08.463429 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:50:08.463429 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:50:08.463429 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:50:08.463429 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:50:08.463429 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: d2b025b0f80a4e26b296e14a513129eb Aug 31 15:50:08.463429 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-157149317 Aug 31 15:50:08.463429 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:50:08.463429 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:50:08.464654 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d2b025b0f80a4e26b296e14a513129eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d2b025b0f80a4e26b296e14a513129eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d2b025b0f80a4e26b296e14a513129eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d2b025b0f80a4e26b296e14a513129eb", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:50:08.464654 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-157149317 Aug 31 15:50:08.464654 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: d2b025b0f80a4e26b296e14a513129eb Aug 31 15:50:08.464654 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-157149317 Aug 31 15:50:08.464654 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-157149317-project Aug 31 15:50:08.464654 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:50:08.464654 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:50:08.464654 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: a2001078dad740928590968405eeddc5 Aug 31 15:50:08.464654 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-157149317-project Aug 31 15:50:08.464654 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 15:50:08.464654 n-d-833090-16 devstack@n-api.service[128863]: exception: Flavor 717171740 has no extra specs with key hw:cpu_thread_policy. Aug 31 15:50:08.465362 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'flavor_id': '717171740', 'id': 'hw:cpu_thread_policy'} Aug 31 15:50:08.465362 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:50:08.465362 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:08.465362 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Aug 31 15:50:08.465362 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Aug 31 15:50:08.465362 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 31 15:50:08.465362 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:50:08.465362 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:50:08.465362 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:50:08.465362 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:08.465362 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:50:08.465362 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:50:08.465362 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:50:08.465362 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:50:08.465362 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:50:08.465362 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:50:08.465362 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Aug 31 15:50:08.465362 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 31 15:50:08.465362 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 717171740 has no extra specs with key hw:cpu_thread_policy. Aug 31 15:50:08.465362 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:50:08.465362 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:50:08.465362 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:50:08.466759 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:08.466759 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:50:08.466759 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:50:08.466759 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:50:08.466759 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:50:08.466759 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 717171740 has no extra specs with key hw:cpu_thread_policy. Aug 31 15:50:08.466759 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:50:08.474544 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-afaf7bd4-0d62-42c9-b326-750fe4483867 tempest-FlavorsExtraSpecsNegativeTestJSON-157149317 tempest-FlavorsExtraSpecsNegativeTestJSON-157149317-project] Returning 404 to user: Flavor 717171740 has no extra specs with key hw:cpu_thread_policy. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:50:08.478720 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-afaf7bd4-0d62-42c9-b326-750fe4483867 tempest-FlavorsExtraSpecsNegativeTestJSON-157149317 tempest-FlavorsExtraSpecsNegativeTestJSON-157149317-project] 10.222.0.50 "GET /compute/v2.1/flavors/717171740/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.234457 Aug 31 15:50:08.487325 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 167/368] 10.222.0.50 () {58 vars in 1263 bytes} [Wed Aug 31 15:50:08 2022] GET /compute/v2.1/flavors/717171740/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 243 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:50:08.503317 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f8c8be65-1405-408e-987c-b05641eb1830 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:08.511119 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f8c8be65-1405-408e-987c-b05641eb1830 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: c3ca0ff6-8f52-4ac3-8706-f5efab49a099] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:08.527285 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8c8be65-1405-408e-987c-b05641eb1830 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:08.528068 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8c8be65-1405-408e-987c-b05641eb1830 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:08.529897 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8c8be65-1405-408e-987c-b05641eb1830 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:08.530823 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8c8be65-1405-408e-987c-b05641eb1830 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:08.532205 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8c8be65-1405-408e-987c-b05641eb1830 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:08.532981 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8c8be65-1405-408e-987c-b05641eb1830 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:08.800303 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4daf665b-b7b3-4dbf-9716-e3b58c55e176 tempest-HypervisorAdminNegativeTestJSON-200723839 tempest-HypervisorAdminNegativeTestJSON-200723839-project-admin] Calling method '.version_select at 0x7fbb470010d0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:08.802059 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4daf665b-b7b3-4dbf-9716-e3b58c55e176 tempest-HypervisorAdminNegativeTestJSON-200723839 tempest-HypervisorAdminNegativeTestJSON-200723839-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:08.802560 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4daf665b-b7b3-4dbf-9716-e3b58c55e176 tempest-HypervisorAdminNegativeTestJSON-200723839 tempest-HypervisorAdminNegativeTestJSON-200723839-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:08.802985 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4daf665b-b7b3-4dbf-9716-e3b58c55e176 tempest-HypervisorAdminNegativeTestJSON-200723839 tempest-HypervisorAdminNegativeTestJSON-200723839-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:08.834508 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4daf665b-b7b3-4dbf-9716-e3b58c55e176 tempest-HypervisorAdminNegativeTestJSON-200723839 tempest-HypervisorAdminNegativeTestJSON-200723839-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:08.838050 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4daf665b-b7b3-4dbf-9716-e3b58c55e176 tempest-HypervisorAdminNegativeTestJSON-200723839 tempest-HypervisorAdminNegativeTestJSON-200723839-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:08.839765 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4daf665b-b7b3-4dbf-9716-e3b58c55e176 tempest-HypervisorAdminNegativeTestJSON-200723839 tempest-HypervisorAdminNegativeTestJSON-200723839-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:08.845183 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=100 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:50:08.871929 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4daf665b-b7b3-4dbf-9716-e3b58c55e176 tempest-HypervisorAdminNegativeTestJSON-200723839 tempest-HypervisorAdminNegativeTestJSON-200723839-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:08.872739 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4daf665b-b7b3-4dbf-9716-e3b58c55e176 tempest-HypervisorAdminNegativeTestJSON-200723839 tempest-HypervisorAdminNegativeTestJSON-200723839-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:08.873473 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4daf665b-b7b3-4dbf-9716-e3b58c55e176 tempest-HypervisorAdminNegativeTestJSON-200723839 tempest-HypervisorAdminNegativeTestJSON-200723839-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:08.885970 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4daf665b-b7b3-4dbf-9716-e3b58c55e176 tempest-HypervisorAdminNegativeTestJSON-200723839 tempest-HypervisorAdminNegativeTestJSON-200723839-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.618418 Aug 31 15:50:08.886605 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 202/369] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 31 15:50:08 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:50:08.896531 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9adbadf5-4b45-4587-b948-079cd890a7a7 tempest-FlavorsExtraSpecsNegativeTestJSON-157149317 tempest-FlavorsExtraSpecsNegativeTestJSON-157149317-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:50:08.904642 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9adbadf5-4b45-4587-b948-079cd890a7a7 tempest-FlavorsExtraSpecsNegativeTestJSON-157149317 tempest-FlavorsExtraSpecsNegativeTestJSON-157149317-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'a2001078dad740928590968405eeddc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b025b0f80a4e26b296e14a513129eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:08.906612 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9adbadf5-4b45-4587-b948-079cd890a7a7 tempest-FlavorsExtraSpecsNegativeTestJSON-157149317 tempest-FlavorsExtraSpecsNegativeTestJSON-157149317-project] Request method failure captured: Aug 31 15:50:08.906612 n-d-833090-16 devstack@n-api.service[128864]: request: POST /compute/v2.1/flavors/717171740/os-extra_specs HTTP/1.1 Aug 31 15:50:08.906612 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:50:08.906612 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:50:08.906612 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:50:08.906612 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 66 Aug 31 15:50:08.906612 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:50:08.906612 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:50:08.906612 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:50:08.906612 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:50:08.906612 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4MtEvh-PZhri8wQdGYHZ842GxDfai2P7bkm7fj0_9Soi-VxpCMaxRa8GEP0aOqnLvDct4wrbk7xQQP6iOWenwHBWW2r_WoJsHW2u1Vmwo0skCj9jfwgWdIM6yLUeh_zWQCtTITC-0fYkC9xe8FZLRBkZC3QnItsEpB81zAQmZdq_UA Aug 31 15:50:08.906612 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:50:08.906612 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:50:08.906612 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:50:08.906612 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:50:08.906612 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:50:08.906612 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:50:08.906612 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: d2b025b0f80a4e26b296e14a513129eb Aug 31 15:50:08.906612 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-157149317 Aug 31 15:50:08.906612 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:50:08.906612 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:50:08.907734 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d2b025b0f80a4e26b296e14a513129eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d2b025b0f80a4e26b296e14a513129eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d2b025b0f80a4e26b296e14a513129eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d2b025b0f80a4e26b296e14a513129eb", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:50:08.907734 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-157149317 Aug 31 15:50:08.907734 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: d2b025b0f80a4e26b296e14a513129eb Aug 31 15:50:08.907734 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-157149317 Aug 31 15:50:08.907734 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-157149317-project Aug 31 15:50:08.907734 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:50:08.907734 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:50:08.907734 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: a2001078dad740928590968405eeddc5 Aug 31 15:50:08.907734 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-157149317-project Aug 31 15:50:08.907734 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 15:50:08.907734 n-d-833090-16 devstack@n-api.service[128864]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Aug 31 15:50:08.907734 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:50:08.908961 n-d-833090-16 devstack@n-api.service[128864]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 31 15:50:08.908961 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'flavor_id': '717171740', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Aug 31 15:50:08.908961 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:50:08.908961 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:08.908961 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:50:08.908961 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:50:08.908961 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:50:08.908961 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:50:08.908961 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:50:08.908961 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:50:08.908961 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:50:08.908961 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:50:08.908961 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Aug 31 15:50:08.908961 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Aug 31 15:50:08.908961 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 15:50:08.908961 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 15:50:08.908961 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 15:50:08.908961 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 15:50:08.908961 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:50:08.910207 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:50:08.910207 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:50:08.910207 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:50:08.910207 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 15:50:08.910207 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 15:50:08.910207 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 15:50:08.910207 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 15:50:08.910207 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 15:50:08.910207 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 15:50:08.910207 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 31 15:50:08.910207 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:08.910207 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:50:08.910207 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:08.910207 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:08.910207 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:50:08.910207 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:50:08.910207 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 15:50:08.910207 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 15:50:08.910207 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 31 15:50:08.910207 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:08.911267 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9adbadf5-4b45-4587-b948-079cd890a7a7 tempest-FlavorsExtraSpecsNegativeTestJSON-157149317 tempest-FlavorsExtraSpecsNegativeTestJSON-157149317-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:50:08.911267 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9adbadf5-4b45-4587-b948-079cd890a7a7 tempest-FlavorsExtraSpecsNegativeTestJSON-157149317 tempest-FlavorsExtraSpecsNegativeTestJSON-157149317-project] 10.222.0.50 "POST /compute/v2.1/flavors/717171740/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.020351 Aug 31 15:50:08.919114 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 203/370] 10.222.0.50 () {60 vars in 1221 bytes} [Wed Aug 31 15:50:08 2022] POST /compute/v2.1/flavors/717171740/os-extra_specs => generated 124 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:50:09.004862 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-6cb8081b-13c8-4905-848a-08042d1c49dd req-ce1d978c-63a3-4203-806c-55c19139c912 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "269c2cc1-ce8d-41bc-bf54-90f0c37642a2", "tag": "f5ab5bc7-50cc-4ab5-a182-e23f14ab5ec6"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:50:09.019381 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-6cb8081b-13c8-4905-848a-08042d1c49dd req-ce1d978c-63a3-4203-806c-55c19139c912 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:09.021270 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-6cb8081b-13c8-4905-848a-08042d1c49dd req-ce1d978c-63a3-4203-806c-55c19139c912 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:09.021925 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-6cb8081b-13c8-4905-848a-08042d1c49dd req-ce1d978c-63a3-4203-806c-55c19139c912 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:09.036195 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-6cb8081b-13c8-4905-848a-08042d1c49dd req-ce1d978c-63a3-4203-806c-55c19139c912 service nova] Creating event network-changed:f5ab5bc7-50cc-4ab5-a182-e23f14ab5ec6 for instance 269c2cc1-ce8d-41bc-bf54-90f0c37642a2 on n-h1-833090-16 Aug 31 15:50:09.041780 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-6cb8081b-13c8-4905-848a-08042d1c49dd req-ce1d978c-63a3-4203-806c-55c19139c912 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121348 Aug 31 15:50:09.043060 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 204/371] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:50:09.051685 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-99ef7b1b-0357-4859-a33f-eb4d959115a1 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:09.052685 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-99ef7b1b-0357-4859-a33f-eb4d959115a1 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] [instance: 1e8fdb86-13be-42a3-a7af-5d50024f7419] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:09.062603 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-99ef7b1b-0357-4859-a33f-eb4d959115a1 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:09.063442 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-99ef7b1b-0357-4859-a33f-eb4d959115a1 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:09.064884 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-99ef7b1b-0357-4859-a33f-eb4d959115a1 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:09.067334 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-99ef7b1b-0357-4859-a33f-eb4d959115a1 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:09.068005 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-99ef7b1b-0357-4859-a33f-eb4d959115a1 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:09.068705 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-99ef7b1b-0357-4859-a33f-eb4d959115a1 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:09.404359 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f8c8be65-1405-408e-987c-b05641eb1830 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:09.416925 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f8c8be65-1405-408e-987c-b05641eb1830 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/c3ca0ff6-8f52-4ac3-8706-f5efab49a099" status: 200 len: 1318 microversion: 2.1 time: 0.929250 Aug 31 15:50:09.426835 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 168/372] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:08 2022] GET /compute/v2.1/servers/c3ca0ff6-8f52-4ac3-8706-f5efab49a099 => generated 1318 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:09.437462 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-080e5870-2550-4bd9-8c1f-554ffad2fd29 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:09.438337 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-080e5870-2550-4bd9-8c1f-554ffad2fd29 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:09.446832 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-080e5870-2550-4bd9-8c1f-554ffad2fd29 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:09.447528 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-080e5870-2550-4bd9-8c1f-554ffad2fd29 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:09.448131 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-080e5870-2550-4bd9-8c1f-554ffad2fd29 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:09.448996 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-080e5870-2550-4bd9-8c1f-554ffad2fd29 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:09.449599 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-080e5870-2550-4bd9-8c1f-554ffad2fd29 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:09.450264 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-080e5870-2550-4bd9-8c1f-554ffad2fd29 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:09.485294 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=8 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:50:09.608921 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-080e5870-2550-4bd9-8c1f-554ffad2fd29 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:09.617835 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-080e5870-2550-4bd9-8c1f-554ffad2fd29 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:09.628152 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-080e5870-2550-4bd9-8c1f-554ffad2fd29 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:09.634419 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-080e5870-2550-4bd9-8c1f-554ffad2fd29 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] 10.222.0.50 "GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f" status: 200 len: 1453 microversion: 2.75 time: 0.206204 Aug 31 15:50:09.635598 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 169/373] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:50:09 2022] GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f => generated 1453 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:50:09.648008 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-00b3efc2-9c65-474a-93e9-8f6b86223a21 tempest-HypervisorAdminNegativeTestJSON-1515959070 tempest-HypervisorAdminNegativeTestJSON-1515959070-project] Calling method '.version_select at 0x7fbb46fce3a0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:09.653031 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-00b3efc2-9c65-474a-93e9-8f6b86223a21 tempest-HypervisorAdminNegativeTestJSON-1515959070 tempest-HypervisorAdminNegativeTestJSON-1515959070-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'c035285d282049ecbd229799398aaa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99eaabde7a544f47a1aa96dfcadff301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:09.656866 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-00b3efc2-9c65-474a-93e9-8f6b86223a21 tempest-HypervisorAdminNegativeTestJSON-1515959070 tempest-HypervisorAdminNegativeTestJSON-1515959070-project] Request method failure captured: Aug 31 15:50:09.656866 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Aug 31 15:50:09.656866 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:50:09.656866 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:50:09.656866 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:50:09.656866 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:50:09.656866 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:50:09.656866 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:50:09.656866 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:50:09.656866 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:50:09.656866 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4MtfNrUSISrnPA6LvUUpvOAD2IL_Ea1pZMBHiFrsXMbkNLAgTXjxfuLaLAlNwvSufzAR33qXXShFYGrCYyyjulogAfgEAN-SR6H2lu8LzVyqLrqwIQXJP0iLuwlnjuN0lRroI8-DJH3m6cNPx2KsQANWowcOQ3aGVDFDLQDjik8dZA Aug 31 15:50:09.656866 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:50:09.656866 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:50:09.656866 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:50:09.656866 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:50:09.656866 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:50:09.656866 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:50:09.656866 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 99eaabde7a544f47a1aa96dfcadff301 Aug 31 15:50:09.656866 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1515959070 Aug 31 15:50:09.656866 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:50:09.656866 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:50:09.658429 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/99eaabde7a544f47a1aa96dfcadff301"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/99eaabde7a544f47a1aa96dfcadff301"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/99eaabde7a544f47a1aa96dfcadff301"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_99eaabde7a544f47a1aa96dfcadff301", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:50:09.658429 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1515959070 Aug 31 15:50:09.658429 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 99eaabde7a544f47a1aa96dfcadff301 Aug 31 15:50:09.658429 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1515959070 Aug 31 15:50:09.658429 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-HypervisorAdminNegativeTestJSON-1515959070-project Aug 31 15:50:09.658429 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:50:09.658429 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:50:09.658429 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: c035285d282049ecbd229799398aaa81 Aug 31 15:50:09.658429 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1515959070-project Aug 31 15:50:09.658429 n-d-833090-16 devstack@n-api.service[128863]: method: Aug 31 15:50:09.658429 n-d-833090-16 devstack@n-api.service[128863]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 31 15:50:09.658429 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '1'} Aug 31 15:50:09.658429 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:50:09.659467 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:09.659467 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:50:09.659467 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:50:09.659467 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:50:09.659467 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:50:09.659467 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:50:09.659467 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:50:09.659467 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:50:09.659467 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:50:09.659467 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Aug 31 15:50:09.659467 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Aug 31 15:50:09.659467 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 15:50:09.659467 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 15:50:09.659467 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 15:50:09.659467 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 15:50:09.659467 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:50:09.659467 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:50:09.659467 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:50:09.659467 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:50:09.660795 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 15:50:09.660795 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 15:50:09.660795 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 15:50:09.660795 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 15:50:09.660795 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 15:50:09.660795 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 15:50:09.660795 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 31 15:50:09.660795 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:50:09.660795 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:50:09.660795 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:50:09.660795 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:09.660795 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:50:09.660795 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:50:09.660795 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 15:50:09.660795 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 15:50:09.660795 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 31 15:50:09.660795 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:50:09.663135 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-00b3efc2-9c65-474a-93e9-8f6b86223a21 tempest-HypervisorAdminNegativeTestJSON-1515959070 tempest-HypervisorAdminNegativeTestJSON-1515959070-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:50:09.665969 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-00b3efc2-9c65-474a-93e9-8f6b86223a21 tempest-HypervisorAdminNegativeTestJSON-1515959070 tempest-HypervisorAdminNegativeTestJSON-1515959070-project] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.029078 Aug 31 15:50:09.669224 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 170/374] 10.222.0.50 () {58 vars in 1173 bytes} [Wed Aug 31 15:50:09 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:50:09.676498 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f71b2725-5bff-4b1e-88e6-d8838c30fc35 tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465 tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:50:09.754610 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f71b2725-5bff-4b1e-88e6-d8838c30fc35 tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465 tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/717171740/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.080778 Aug 31 15:50:09.760132 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 171/375] 10.222.0.50 () {60 vars in 1221 bytes} [Wed Aug 31 15:50:09 2022] POST /compute/v2.1/flavors/717171740/os-extra_specs => generated 66 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 15:50:09.761039 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-afbf9dbf-ae06-4b58-9352-2e86234980a4 tempest-HypervisorAdminNegativeTestJSON-200723839 tempest-HypervisorAdminNegativeTestJSON-200723839-project-admin] Calling method '.version_select at 0x7fbb46f35af0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:09.763781 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-afbf9dbf-ae06-4b58-9352-2e86234980a4 tempest-HypervisorAdminNegativeTestJSON-200723839 tempest-HypervisorAdminNegativeTestJSON-200723839-project-admin] HTTP exception thrown: Hypervisor with ID 'c2ec107f-c773-46d5-824f-f61e96224c40' could not be found. Aug 31 15:50:09.773178 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-afbf9dbf-ae06-4b58-9352-2e86234980a4 tempest-HypervisorAdminNegativeTestJSON-200723839 tempest-HypervisorAdminNegativeTestJSON-200723839-project-admin] Request method failure captured: Aug 31 15:50:09.773178 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/os-hypervisors/c2ec107f-c773-46d5-824f-f61e96224c40/uptime HTTP/1.1 Aug 31 15:50:09.773178 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:50:09.773178 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:50:09.773178 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:50:09.773178 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:50:09.773178 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:50:09.773178 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:50:09.773178 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:50:09.773178 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:50:09.773178 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4MvhKuDq4aKMm34SqwkJSUofREfISlPS-sUiPZmdfgE68xhacIyLW0XujkALUezw7DO7GeaqunmRntJilDstNhRYfUO7xvZ0qwgHY_-I5OR5I_zsU6D--zjzz0t01RBFiRa0uVBAe-Jzmox6i7vb5oNNK0HUAUnQnYrVdqegNZHiWk Aug 31 15:50:09.773178 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:50:09.773178 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:50:09.773178 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:50:09.773178 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:50:09.773178 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:50:09.773178 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:50:09.773178 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 9602ab29bbbf4d94a6438f26eb7dda19 Aug 31 15:50:09.773178 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-200723839 Aug 31 15:50:09.773178 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,admin,member Aug 31 15:50:09.773178 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,admin,member Aug 31 15:50:09.774560 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9602ab29bbbf4d94a6438f26eb7dda19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9602ab29bbbf4d94a6438f26eb7dda19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9602ab29bbbf4d94a6438f26eb7dda19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9602ab29bbbf4d94a6438f26eb7dda19", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:50:09.774560 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-200723839 Aug 31 15:50:09.774560 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 9602ab29bbbf4d94a6438f26eb7dda19 Aug 31 15:50:09.774560 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-200723839 Aug 31 15:50:09.774560 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-HypervisorAdminNegativeTestJSON-200723839-project-admin Aug 31 15:50:09.774560 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:50:09.774560 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:50:09.774560 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 6d88c86afac245fa99db26691baccc5b Aug 31 15:50:09.774560 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-200723839-project-admin Aug 31 15:50:09.774560 n-d-833090-16 devstack@n-api.service[128863]: method: Aug 31 15:50:09.774560 n-d-833090-16 devstack@n-api.service[128863]: exception: Hypervisor with ID 'c2ec107f-c773-46d5-824f-f61e96224c40' could not be found. Aug 31 15:50:09.774560 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'c2ec107f-c773-46d5-824f-f61e96224c40'} Aug 31 15:50:09.775264 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:50:09.775264 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:09.775264 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 31 15:50:09.775264 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 31 15:50:09.775264 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'c2ec107f-c773-46d5-824f-f61e96224c40' Aug 31 15:50:09.775264 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:50:09.775264 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:50:09.775264 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:50:09.775264 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:09.775264 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 31 15:50:09.775264 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 31 15:50:09.775264 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 31 15:50:09.775264 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 31 15:50:09.775264 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 31 15:50:09.775264 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:50:09.775264 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:50:09.775264 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:50:09.775264 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:09.775264 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 31 15:50:09.775264 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 31 15:50:09.775264 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 31 15:50:09.775264 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 31 15:50:09.777174 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 31 15:50:09.777174 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:50:09.777174 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:50:09.777174 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:50:09.777174 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:09.777174 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:50:09.777174 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:50:09.777174 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:50:09.777174 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:50:09.777174 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:50:09.777174 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:50:09.777174 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:50:09.777174 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:50:09.777174 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Aug 31 15:50:09.777174 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 31 15:50:09.777174 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 31 15:50:09.777174 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 31 15:50:09.777174 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'c2ec107f-c773-46d5-824f-f61e96224c40' could not be found. Aug 31 15:50:09.777174 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:50:09.777174 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:50:09.777174 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:50:09.778512 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:09.778512 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:50:09.778512 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:50:09.778512 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:50:09.778512 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:50:09.778512 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'c2ec107f-c773-46d5-824f-f61e96224c40' could not be found. Aug 31 15:50:09.778512 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:50:09.778512 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-afbf9dbf-ae06-4b58-9352-2e86234980a4 tempest-HypervisorAdminNegativeTestJSON-200723839 tempest-HypervisorAdminNegativeTestJSON-200723839-project-admin] Returning 404 to user: Hypervisor with ID 'c2ec107f-c773-46d5-824f-f61e96224c40' could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:50:09.778512 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-afbf9dbf-ae06-4b58-9352-2e86234980a4 tempest-HypervisorAdminNegativeTestJSON-200723839 tempest-HypervisorAdminNegativeTestJSON-200723839-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/c2ec107f-c773-46d5-824f-f61e96224c40/uptime" status: 404 len: 123 microversion: 2.1 time: 0.018142 Aug 31 15:50:09.778512 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 172/376] 10.222.0.50 () {58 vars in 1278 bytes} [Wed Aug 31 15:50:09 2022] GET /compute/v2.1/os-hypervisors/c2ec107f-c773-46d5-824f-f61e96224c40/uptime => generated 123 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:50:09.792989 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-99ef7b1b-0357-4859-a33f-eb4d959115a1 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704d7c428d3e4a1bbe5fb78485415214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a08078ba5a04c31b6cc63dee67be8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:09.802645 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-99ef7b1b-0357-4859-a33f-eb4d959115a1 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] 10.222.0.50 "GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419" status: 200 len: 1368 microversion: 2.1 time: 0.757353 Aug 31 15:50:09.812902 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 205/377] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:09 2022] GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419 => generated 1368 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:09.819762 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d3f3959f-afaf-41fd-adf4-9dbbfc26f6e8 tempest-FlavorsExtraSpecsNegativeTestJSON-157149317 tempest-FlavorsExtraSpecsNegativeTestJSON-157149317-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:09.824071 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d3f3959f-afaf-41fd-adf4-9dbbfc26f6e8 tempest-FlavorsExtraSpecsNegativeTestJSON-157149317 tempest-FlavorsExtraSpecsNegativeTestJSON-157149317-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'a2001078dad740928590968405eeddc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b025b0f80a4e26b296e14a513129eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:09.830060 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d3f3959f-afaf-41fd-adf4-9dbbfc26f6e8 tempest-FlavorsExtraSpecsNegativeTestJSON-157149317 tempest-FlavorsExtraSpecsNegativeTestJSON-157149317-project] Request method failure captured: Aug 31 15:50:09.830060 n-d-833090-16 devstack@n-api.service[128864]: request: DELETE /compute/v2.1/flavors/717171740/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 31 15:50:09.830060 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:50:09.830060 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:50:09.830060 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:50:09.830060 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:50:09.830060 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:50:09.830060 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:50:09.830060 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:50:09.830060 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:50:09.830060 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4MtEvh-PZhri8wQdGYHZ842GxDfai2P7bkm7fj0_9Soi-VxpCMaxRa8GEP0aOqnLvDct4wrbk7xQQP6iOWenwHBWW2r_WoJsHW2u1Vmwo0skCj9jfwgWdIM6yLUeh_zWQCtTITC-0fYkC9xe8FZLRBkZC3QnItsEpB81zAQmZdq_UA Aug 31 15:50:09.830060 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:50:09.830060 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:50:09.830060 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:50:09.830060 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:50:09.830060 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:50:09.830060 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:50:09.830060 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: d2b025b0f80a4e26b296e14a513129eb Aug 31 15:50:09.830060 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-157149317 Aug 31 15:50:09.830060 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:50:09.830060 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:50:09.831392 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d2b025b0f80a4e26b296e14a513129eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d2b025b0f80a4e26b296e14a513129eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d2b025b0f80a4e26b296e14a513129eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d2b025b0f80a4e26b296e14a513129eb", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:50:09.831392 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-157149317 Aug 31 15:50:09.831392 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: d2b025b0f80a4e26b296e14a513129eb Aug 31 15:50:09.831392 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-157149317 Aug 31 15:50:09.831392 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-157149317-project Aug 31 15:50:09.831392 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:50:09.831392 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:50:09.831392 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: a2001078dad740928590968405eeddc5 Aug 31 15:50:09.831392 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-157149317-project Aug 31 15:50:09.831392 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:50:09.831392 n-d-833090-16 devstack@n-api.service[128864]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 31 15:50:09.832023 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'flavor_id': '717171740', 'id': 'hw:numa_nodes'} Aug 31 15:50:09.832023 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:50:09.832023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:09.832023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:50:09.832023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:50:09.832023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:50:09.832023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:50:09.832023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:50:09.832023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:50:09.832023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Aug 31 15:50:09.832023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Aug 31 15:50:09.832023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 15:50:09.832023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 15:50:09.832023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 15:50:09.832023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 15:50:09.832023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:50:09.832023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:50:09.832023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:50:09.832023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:50:09.832023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 15:50:09.833165 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 15:50:09.833165 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 15:50:09.833165 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 15:50:09.833165 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 15:50:09.833165 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 15:50:09.833165 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 31 15:50:09.833165 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:09.833165 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:50:09.833165 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:09.833165 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:09.833165 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:50:09.833165 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:50:09.833165 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 15:50:09.833165 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 15:50:09.833165 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 31 15:50:09.833165 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:09.833165 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d3f3959f-afaf-41fd-adf4-9dbbfc26f6e8 tempest-FlavorsExtraSpecsNegativeTestJSON-157149317 tempest-FlavorsExtraSpecsNegativeTestJSON-157149317-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:50:09.839091 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d3f3959f-afaf-41fd-adf4-9dbbfc26f6e8 tempest-FlavorsExtraSpecsNegativeTestJSON-157149317 tempest-FlavorsExtraSpecsNegativeTestJSON-157149317-project] 10.222.0.50 "DELETE /compute/v2.1/flavors/717171740/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.026120 Aug 31 15:50:09.839091 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 206/378] 10.222.0.50 () {58 vars in 1245 bytes} [Wed Aug 31 15:50:09 2022] DELETE /compute/v2.1/flavors/717171740/os-extra_specs/hw:numa_nodes => generated 124 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:50:09.845208 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7139a16c-7d0f-4a1c-a0b0-683172bd460d tempest-HypervisorAdminNegativeTestJSON-200723839 tempest-HypervisorAdminNegativeTestJSON-200723839-project-admin] Calling method '.version_select at 0x7fbb46fe4280>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:09.849935 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7139a16c-7d0f-4a1c-a0b0-683172bd460d tempest-HypervisorAdminNegativeTestJSON-200723839 tempest-HypervisorAdminNegativeTestJSON-200723839-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:09.850493 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7139a16c-7d0f-4a1c-a0b0-683172bd460d tempest-HypervisorAdminNegativeTestJSON-200723839 tempest-HypervisorAdminNegativeTestJSON-200723839-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:09.854347 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7139a16c-7d0f-4a1c-a0b0-683172bd460d tempest-HypervisorAdminNegativeTestJSON-200723839 tempest-HypervisorAdminNegativeTestJSON-200723839-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:09.899806 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7139a16c-7d0f-4a1c-a0b0-683172bd460d tempest-HypervisorAdminNegativeTestJSON-200723839 tempest-HypervisorAdminNegativeTestJSON-200723839-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:09.900374 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7139a16c-7d0f-4a1c-a0b0-683172bd460d tempest-HypervisorAdminNegativeTestJSON-200723839 tempest-HypervisorAdminNegativeTestJSON-200723839-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:09.900769 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7139a16c-7d0f-4a1c-a0b0-683172bd460d tempest-HypervisorAdminNegativeTestJSON-200723839 tempest-HypervisorAdminNegativeTestJSON-200723839-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:09.925182 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7139a16c-7d0f-4a1c-a0b0-683172bd460d tempest-HypervisorAdminNegativeTestJSON-200723839 tempest-HypervisorAdminNegativeTestJSON-200723839-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:09.925676 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7139a16c-7d0f-4a1c-a0b0-683172bd460d tempest-HypervisorAdminNegativeTestJSON-200723839 tempest-HypervisorAdminNegativeTestJSON-200723839-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:09.926148 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7139a16c-7d0f-4a1c-a0b0-683172bd460d tempest-HypervisorAdminNegativeTestJSON-200723839 tempest-HypervisorAdminNegativeTestJSON-200723839-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:09.941304 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7139a16c-7d0f-4a1c-a0b0-683172bd460d tempest-HypervisorAdminNegativeTestJSON-200723839 tempest-HypervisorAdminNegativeTestJSON-200723839-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.106078 Aug 31 15:50:09.949344 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 207/379] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 31 15:50:09 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:50:09.961183 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c91c4804-25c1-4b69-bf39-cf4d784cac8e tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465 tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:50:10.016723 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c91c4804-25c1-4b69-bf39-cf4d784cac8e tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465 tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/717171740/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.065760 Aug 31 15:50:10.021058 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 208/380] 10.222.0.50 () {60 vars in 1221 bytes} [Wed Aug 31 15:50:09 2022] POST /compute/v2.1/flavors/717171740/os-extra_specs => generated 66 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 15:50:10.032851 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c5ec29e7-8001-478e-84ca-86b1eecbb36b tempest-HypervisorAdminNegativeTestJSON-1515959070 tempest-HypervisorAdminNegativeTestJSON-1515959070-project] Calling method '.version_select at 0x7fbb4731c160>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:10.040765 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c5ec29e7-8001-478e-84ca-86b1eecbb36b tempest-HypervisorAdminNegativeTestJSON-1515959070 tempest-HypervisorAdminNegativeTestJSON-1515959070-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'c035285d282049ecbd229799398aaa81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99eaabde7a544f47a1aa96dfcadff301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:10.042733 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c5ec29e7-8001-478e-84ca-86b1eecbb36b tempest-HypervisorAdminNegativeTestJSON-1515959070 tempest-HypervisorAdminNegativeTestJSON-1515959070-project] Request method failure captured: Aug 31 15:50:10.042733 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Aug 31 15:50:10.042733 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:50:10.042733 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:50:10.042733 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:50:10.042733 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:50:10.042733 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:50:10.042733 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:50:10.042733 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:50:10.042733 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:50:10.042733 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4MtfNrUSISrnPA6LvUUpvOAD2IL_Ea1pZMBHiFrsXMbkNLAgTXjxfuLaLAlNwvSufzAR33qXXShFYGrCYyyjulogAfgEAN-SR6H2lu8LzVyqLrqwIQXJP0iLuwlnjuN0lRroI8-DJH3m6cNPx2KsQANWowcOQ3aGVDFDLQDjik8dZA Aug 31 15:50:10.042733 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:50:10.042733 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:50:10.042733 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:50:10.042733 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:50:10.042733 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:50:10.042733 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:50:10.042733 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 99eaabde7a544f47a1aa96dfcadff301 Aug 31 15:50:10.042733 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1515959070 Aug 31 15:50:10.042733 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:50:10.042733 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:50:10.043981 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/99eaabde7a544f47a1aa96dfcadff301"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/99eaabde7a544f47a1aa96dfcadff301"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/99eaabde7a544f47a1aa96dfcadff301"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_99eaabde7a544f47a1aa96dfcadff301", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:50:10.043981 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1515959070 Aug 31 15:50:10.043981 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 99eaabde7a544f47a1aa96dfcadff301 Aug 31 15:50:10.043981 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1515959070 Aug 31 15:50:10.043981 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-HypervisorAdminNegativeTestJSON-1515959070-project Aug 31 15:50:10.043981 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:50:10.043981 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:50:10.043981 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: c035285d282049ecbd229799398aaa81 Aug 31 15:50:10.043981 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1515959070-project Aug 31 15:50:10.043981 n-d-833090-16 devstack@n-api.service[128864]: method: Aug 31 15:50:10.043981 n-d-833090-16 devstack@n-api.service[128864]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 31 15:50:10.043981 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '1'} Aug 31 15:50:10.043981 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:50:10.045420 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:10.045420 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:50:10.045420 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:50:10.045420 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:50:10.045420 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:50:10.045420 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:50:10.045420 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:50:10.045420 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:50:10.045420 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:50:10.045420 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 31 15:50:10.045420 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 31 15:50:10.045420 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Aug 31 15:50:10.045420 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Aug 31 15:50:10.045420 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 15:50:10.045420 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 15:50:10.045420 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 15:50:10.045420 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 15:50:10.045420 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:50:10.045420 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:50:10.046981 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:50:10.046981 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:50:10.046981 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 15:50:10.046981 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 15:50:10.046981 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 15:50:10.046981 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 15:50:10.046981 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 15:50:10.046981 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 15:50:10.046981 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 31 15:50:10.046981 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:10.046981 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:50:10.046981 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:10.046981 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:10.046981 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:50:10.046981 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:50:10.046981 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 15:50:10.046981 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 15:50:10.046981 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 31 15:50:10.046981 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:10.049818 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c5ec29e7-8001-478e-84ca-86b1eecbb36b tempest-HypervisorAdminNegativeTestJSON-1515959070 tempest-HypervisorAdminNegativeTestJSON-1515959070-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:50:10.051637 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c5ec29e7-8001-478e-84ca-86b1eecbb36b tempest-HypervisorAdminNegativeTestJSON-1515959070 tempest-HypervisorAdminNegativeTestJSON-1515959070-project] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.028921 Aug 31 15:50:10.052751 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 209/381] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Aug 31 15:50:10 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:50:10.064734 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f74bd4d5-84a1-4a17-b5f7-95885ca1e4dc tempest-FlavorsExtraSpecsNegativeTestJSON-157149317 tempest-FlavorsExtraSpecsNegativeTestJSON-157149317-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:50:10.069391 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f74bd4d5-84a1-4a17-b5f7-95885ca1e4dc tempest-FlavorsExtraSpecsNegativeTestJSON-157149317 tempest-FlavorsExtraSpecsNegativeTestJSON-157149317-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'a2001078dad740928590968405eeddc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b025b0f80a4e26b296e14a513129eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:10.080007 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f74bd4d5-84a1-4a17-b5f7-95885ca1e4dc tempest-FlavorsExtraSpecsNegativeTestJSON-157149317 tempest-FlavorsExtraSpecsNegativeTestJSON-157149317-project] Request method failure captured: Aug 31 15:50:10.080007 n-d-833090-16 devstack@n-api.service[128864]: request: PUT /compute/v2.1/flavors/717171740/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 31 15:50:10.080007 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:50:10.080007 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:50:10.080007 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:50:10.080007 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 22 Aug 31 15:50:10.080007 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:50:10.080007 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:50:10.080007 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:50:10.080007 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:50:10.080007 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4MtEvh-PZhri8wQdGYHZ842GxDfai2P7bkm7fj0_9Soi-VxpCMaxRa8GEP0aOqnLvDct4wrbk7xQQP6iOWenwHBWW2r_WoJsHW2u1Vmwo0skCj9jfwgWdIM6yLUeh_zWQCtTITC-0fYkC9xe8FZLRBkZC3QnItsEpB81zAQmZdq_UA Aug 31 15:50:10.080007 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:50:10.080007 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:50:10.080007 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:50:10.080007 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:50:10.080007 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:50:10.080007 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:50:10.080007 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: d2b025b0f80a4e26b296e14a513129eb Aug 31 15:50:10.080007 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-157149317 Aug 31 15:50:10.080007 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:50:10.080007 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:50:10.081330 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d2b025b0f80a4e26b296e14a513129eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d2b025b0f80a4e26b296e14a513129eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d2b025b0f80a4e26b296e14a513129eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d2b025b0f80a4e26b296e14a513129eb", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:50:10.081330 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-157149317 Aug 31 15:50:10.081330 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: d2b025b0f80a4e26b296e14a513129eb Aug 31 15:50:10.081330 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-157149317 Aug 31 15:50:10.081330 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-157149317-project Aug 31 15:50:10.081330 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:50:10.081330 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:50:10.081330 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: a2001078dad740928590968405eeddc5 Aug 31 15:50:10.081330 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-157149317-project Aug 31 15:50:10.081330 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 15:50:10.081330 n-d-833090-16 devstack@n-api.service[128864]: {"hw:numa_nodes": "1"} Aug 31 15:50:10.081330 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:50:10.081330 n-d-833090-16 devstack@n-api.service[128864]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 31 15:50:10.082050 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'flavor_id': '717171740', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Aug 31 15:50:10.082050 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:50:10.082050 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:10.082050 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:50:10.082050 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:50:10.082050 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:50:10.082050 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:50:10.082050 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:50:10.082050 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:50:10.082050 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:50:10.082050 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:50:10.082050 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Aug 31 15:50:10.082050 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Aug 31 15:50:10.082050 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 15:50:10.082050 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 15:50:10.082050 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 15:50:10.082050 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 15:50:10.082050 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:50:10.082050 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:50:10.083075 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:50:10.083075 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:50:10.083075 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 15:50:10.083075 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 15:50:10.083075 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 15:50:10.083075 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 15:50:10.083075 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 15:50:10.083075 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 15:50:10.083075 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 31 15:50:10.083075 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:10.083075 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:50:10.083075 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:10.083075 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:10.083075 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:50:10.083075 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:50:10.083075 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 15:50:10.083075 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 15:50:10.083075 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 31 15:50:10.083075 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:10.088076 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f74bd4d5-84a1-4a17-b5f7-95885ca1e4dc tempest-FlavorsExtraSpecsNegativeTestJSON-157149317 tempest-FlavorsExtraSpecsNegativeTestJSON-157149317-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:50:10.089187 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f74bd4d5-84a1-4a17-b5f7-95885ca1e4dc tempest-FlavorsExtraSpecsNegativeTestJSON-157149317 tempest-FlavorsExtraSpecsNegativeTestJSON-157149317-project] 10.222.0.50 "PUT /compute/v2.1/flavors/717171740/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.034968 Aug 31 15:50:10.090371 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 210/382] 10.222.0.50 () {60 vars in 1262 bytes} [Wed Aug 31 15:50:10 2022] PUT /compute/v2.1/flavors/717171740/os-extra_specs/hw:numa_nodes => generated 124 bytes in 37 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:50:10.098264 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6a67b4a8-2e16-487d-9797-07a838fb00ed tempest-HypervisorAdminNegativeTestJSON-200723839 tempest-HypervisorAdminNegativeTestJSON-200723839-project-admin] Calling method '.version_select at 0x7fbb470013a0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:10.100171 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-6a67b4a8-2e16-487d-9797-07a838fb00ed tempest-HypervisorAdminNegativeTestJSON-200723839 tempest-HypervisorAdminNegativeTestJSON-200723839-project-admin] HTTP exception thrown: Hypervisor with ID 'f3323dcd-f693-4c02-ba18-9f553c6c49cf' could not be found. Aug 31 15:50:10.102862 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6a67b4a8-2e16-487d-9797-07a838fb00ed tempest-HypervisorAdminNegativeTestJSON-200723839 tempest-HypervisorAdminNegativeTestJSON-200723839-project-admin] Request method failure captured: Aug 31 15:50:10.102862 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/os-hypervisors/f3323dcd-f693-4c02-ba18-9f553c6c49cf HTTP/1.1 Aug 31 15:50:10.102862 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:50:10.102862 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:50:10.102862 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:50:10.102862 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:50:10.102862 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:50:10.102862 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:50:10.102862 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:50:10.102862 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:50:10.102862 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4MvhKuDq4aKMm34SqwkJSUofREfISlPS-sUiPZmdfgE68xhacIyLW0XujkALUezw7DO7GeaqunmRntJilDstNhRYfUO7xvZ0qwgHY_-I5OR5I_zsU6D--zjzz0t01RBFiRa0uVBAe-Jzmox6i7vb5oNNK0HUAUnQnYrVdqegNZHiWk Aug 31 15:50:10.102862 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:50:10.102862 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:50:10.102862 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:50:10.102862 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:50:10.102862 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:50:10.102862 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:50:10.102862 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 9602ab29bbbf4d94a6438f26eb7dda19 Aug 31 15:50:10.102862 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-200723839 Aug 31 15:50:10.102862 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,admin,member Aug 31 15:50:10.102862 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,admin,member Aug 31 15:50:10.104058 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9602ab29bbbf4d94a6438f26eb7dda19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9602ab29bbbf4d94a6438f26eb7dda19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9602ab29bbbf4d94a6438f26eb7dda19"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9602ab29bbbf4d94a6438f26eb7dda19", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:50:10.104058 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-200723839 Aug 31 15:50:10.104058 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 9602ab29bbbf4d94a6438f26eb7dda19 Aug 31 15:50:10.104058 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-200723839 Aug 31 15:50:10.104058 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-HypervisorAdminNegativeTestJSON-200723839-project-admin Aug 31 15:50:10.104058 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:50:10.104058 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:50:10.104058 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 6d88c86afac245fa99db26691baccc5b Aug 31 15:50:10.104058 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-200723839-project-admin Aug 31 15:50:10.104058 n-d-833090-16 devstack@n-api.service[128864]: method: Aug 31 15:50:10.104058 n-d-833090-16 devstack@n-api.service[128864]: exception: Hypervisor with ID 'f3323dcd-f693-4c02-ba18-9f553c6c49cf' could not be found. Aug 31 15:50:10.104058 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'f3323dcd-f693-4c02-ba18-9f553c6c49cf'} Aug 31 15:50:10.104897 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:50:10.104897 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:10.104897 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 31 15:50:10.104897 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 31 15:50:10.104897 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'f3323dcd-f693-4c02-ba18-9f553c6c49cf' Aug 31 15:50:10.104897 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:10.104897 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:50:10.104897 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:10.104897 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:10.104897 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 31 15:50:10.104897 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 31 15:50:10.104897 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 31 15:50:10.104897 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 31 15:50:10.104897 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 31 15:50:10.104897 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:10.104897 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:50:10.104897 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:10.104897 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:10.104897 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 31 15:50:10.104897 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 31 15:50:10.104897 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 31 15:50:10.104897 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 31 15:50:10.106344 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 31 15:50:10.106344 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:10.106344 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:50:10.106344 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:10.106344 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:10.106344 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:50:10.106344 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:50:10.106344 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:50:10.106344 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:50:10.106344 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:50:10.106344 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:50:10.106344 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:50:10.106344 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:50:10.106344 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 31 15:50:10.106344 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 31 15:50:10.106344 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Aug 31 15:50:10.106344 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 31 15:50:10.106344 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 31 15:50:10.106344 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 31 15:50:10.106344 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'f3323dcd-f693-4c02-ba18-9f553c6c49cf' could not be found. Aug 31 15:50:10.108167 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:10.108167 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:50:10.108167 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:10.108167 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:10.108167 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:50:10.108167 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:50:10.108167 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:50:10.108167 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:50:10.108167 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'f3323dcd-f693-4c02-ba18-9f553c6c49cf' could not be found. Aug 31 15:50:10.108167 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:10.111327 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6a67b4a8-2e16-487d-9797-07a838fb00ed tempest-HypervisorAdminNegativeTestJSON-200723839 tempest-HypervisorAdminNegativeTestJSON-200723839-project-admin] Returning 404 to user: Hypervisor with ID 'f3323dcd-f693-4c02-ba18-9f553c6c49cf' could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:50:10.115443 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6a67b4a8-2e16-487d-9797-07a838fb00ed tempest-HypervisorAdminNegativeTestJSON-200723839 tempest-HypervisorAdminNegativeTestJSON-200723839-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/f3323dcd-f693-4c02-ba18-9f553c6c49cf" status: 404 len: 123 microversion: 2.1 time: 0.023047 Aug 31 15:50:10.118600 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 211/383] 10.222.0.50 () {58 vars in 1257 bytes} [Wed Aug 31 15:50:10 2022] GET /compute/v2.1/os-hypervisors/f3323dcd-f693-4c02-ba18-9f553c6c49cf => generated 123 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:50:10.128625 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-dd96c1c6-fed8-46c4-82a9-23eab62de78d tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465 tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:10.146618 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=6,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:50:10.149484 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-dd96c1c6-fed8-46c4-82a9-23eab62de78d tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465 tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465-project-admin] HTTP exception thrown: Flavor 717171740 has no extra specs with key hw:cpu_thread_policy. Aug 31 15:50:10.151365 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-dd96c1c6-fed8-46c4-82a9-23eab62de78d tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465 tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465-project-admin] Request method failure captured: Aug 31 15:50:10.151365 n-d-833090-16 devstack@n-api.service[128864]: request: DELETE /compute/v2.1/flavors/717171740/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 31 15:50:10.151365 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:50:10.151365 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:50:10.151365 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:50:10.151365 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:50:10.151365 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:50:10.151365 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:50:10.151365 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:50:10.151365 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:50:10.151365 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4MvHQ12rm83q8X8Nf9L1vAmjYa-GA8fzoVX3TkGV-ODJuDe7vgZjStQwakaFeESEv7_S4x2i2VaJCgFsaaeJUc0yTSBJWFKjZ_mXNFNlvgM5dXPaQxht8nAGvR-nnYSVHWmJR12e-islzCRNnxGocNH8flewwiFgOuruH85xWc0lDQ Aug 31 15:50:10.151365 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:50:10.151365 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:50:10.151365 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:50:10.151365 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:50:10.151365 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:50:10.151365 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:50:10.151365 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 6a69c70ded644229a186c2491fdfd8fe Aug 31 15:50:10.151365 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465 Aug 31 15:50:10.151365 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,admin,member Aug 31 15:50:10.151365 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,admin,member Aug 31 15:50:10.152917 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6a69c70ded644229a186c2491fdfd8fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6a69c70ded644229a186c2491fdfd8fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6a69c70ded644229a186c2491fdfd8fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6a69c70ded644229a186c2491fdfd8fe", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:50:10.152917 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465 Aug 31 15:50:10.152917 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 6a69c70ded644229a186c2491fdfd8fe Aug 31 15:50:10.152917 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465 Aug 31 15:50:10.152917 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465-project-admin Aug 31 15:50:10.152917 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:50:10.152917 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:50:10.152917 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 60ec280d2fbf444cbd8c8d061582e5cf Aug 31 15:50:10.152917 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465-project-admin Aug 31 15:50:10.152917 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:50:10.152917 n-d-833090-16 devstack@n-api.service[128864]: exception: Flavor 717171740 has no extra specs with key hw:cpu_thread_policy. Aug 31 15:50:10.154411 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'flavor_id': '717171740', 'id': 'hw:cpu_thread_policy'} Aug 31 15:50:10.154411 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:50:10.154411 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:10.154411 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Aug 31 15:50:10.154411 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Aug 31 15:50:10.154411 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 31 15:50:10.154411 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:10.154411 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:50:10.154411 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:10.154411 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:10.154411 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:50:10.154411 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:50:10.154411 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:50:10.154411 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:50:10.154411 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:50:10.154411 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:50:10.154411 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Aug 31 15:50:10.154411 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 31 15:50:10.154411 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 717171740 has no extra specs with key hw:cpu_thread_policy. Aug 31 15:50:10.154411 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:10.154411 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:50:10.154411 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:10.155622 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:10.155622 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:50:10.155622 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:50:10.155622 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:50:10.155622 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:50:10.155622 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 717171740 has no extra specs with key hw:cpu_thread_policy. Aug 31 15:50:10.155622 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:10.158025 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-dd96c1c6-fed8-46c4-82a9-23eab62de78d tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465 tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465-project-admin] Returning 404 to user: Flavor 717171740 has no extra specs with key hw:cpu_thread_policy. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:50:10.159141 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-dd96c1c6-fed8-46c4-82a9-23eab62de78d tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465 tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/717171740/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.039337 Aug 31 15:50:10.160236 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 212/384] 10.222.0.50 () {58 vars in 1266 bytes} [Wed Aug 31 15:50:10 2022] DELETE /compute/v2.1/flavors/717171740/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:50:10.175385 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-38a202b8-059c-4ece-82a7-81af78a1335a tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465 tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:50:10.184770 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-38a202b8-059c-4ece-82a7-81af78a1335a tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465 tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465-project-admin] HTTP exception thrown: Request body and URI mismatch Aug 31 15:50:10.188288 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-38a202b8-059c-4ece-82a7-81af78a1335a tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465 tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465-project-admin] Request method failure captured: Aug 31 15:50:10.188288 n-d-833090-16 devstack@n-api.service[128864]: request: PUT /compute/v2.1/flavors/717171740/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 31 15:50:10.188288 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:50:10.188288 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:50:10.188288 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:50:10.188288 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 27 Aug 31 15:50:10.188288 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:50:10.188288 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:50:10.188288 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:50:10.188288 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:50:10.188288 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4MvHQ12rm83q8X8Nf9L1vAmjYa-GA8fzoVX3TkGV-ODJuDe7vgZjStQwakaFeESEv7_S4x2i2VaJCgFsaaeJUc0yTSBJWFKjZ_mXNFNlvgM5dXPaQxht8nAGvR-nnYSVHWmJR12e-islzCRNnxGocNH8flewwiFgOuruH85xWc0lDQ Aug 31 15:50:10.188288 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:50:10.188288 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:50:10.188288 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:50:10.188288 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:50:10.188288 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:50:10.188288 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:50:10.188288 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 6a69c70ded644229a186c2491fdfd8fe Aug 31 15:50:10.188288 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465 Aug 31 15:50:10.188288 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,admin,member Aug 31 15:50:10.188288 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,admin,member Aug 31 15:50:10.189548 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6a69c70ded644229a186c2491fdfd8fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6a69c70ded644229a186c2491fdfd8fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6a69c70ded644229a186c2491fdfd8fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6a69c70ded644229a186c2491fdfd8fe", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:50:10.189548 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465 Aug 31 15:50:10.189548 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 6a69c70ded644229a186c2491fdfd8fe Aug 31 15:50:10.189548 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465 Aug 31 15:50:10.189548 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465-project-admin Aug 31 15:50:10.189548 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:50:10.189548 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:50:10.189548 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 60ec280d2fbf444cbd8c8d061582e5cf Aug 31 15:50:10.189548 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465-project-admin Aug 31 15:50:10.189548 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 15:50:10.189548 n-d-833090-16 devstack@n-api.service[128864]: {"hw:cpu_policy": "shared"} Aug 31 15:50:10.189548 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:50:10.189548 n-d-833090-16 devstack@n-api.service[128864]: exception: Request body and URI mismatch Aug 31 15:50:10.190313 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'flavor_id': '717171740', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Aug 31 15:50:10.190313 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:50:10.190313 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:10.190313 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:50:10.190313 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:50:10.190313 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:50:10.190313 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:50:10.190313 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:50:10.190313 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:50:10.190313 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:50:10.190313 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:50:10.190313 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Aug 31 15:50:10.190313 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Aug 31 15:50:10.190313 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Aug 31 15:50:10.190313 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:10.190313 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:50:10.190313 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:10.190313 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:10.190313 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:50:10.190313 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:50:10.191404 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:50:10.191404 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:50:10.191404 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Aug 31 15:50:10.191404 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:10.192999 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-38a202b8-059c-4ece-82a7-81af78a1335a tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465 tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:50:10.194069 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-38a202b8-059c-4ece-82a7-81af78a1335a tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465 tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465-project-admin] 10.222.0.50 "PUT /compute/v2.1/flavors/717171740/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.028849 Aug 31 15:50:10.194909 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 213/385] 10.222.0.50 () {60 vars in 1262 bytes} [Wed Aug 31 15:50:10 2022] PUT /compute/v2.1/flavors/717171740/os-extra_specs/hw:numa_nodes => generated 73 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Aug 31 15:50:10.218551 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-eeea256f-26eb-4ed8-842e-ed0fe6f4a72c tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465 tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:50:10.224692 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-eeea256f-26eb-4ed8-842e-ed0fe6f4a72c tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465 tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465-project-admin] Request method failure captured: Aug 31 15:50:10.224692 n-d-833090-16 devstack@n-api.service[128864]: request: PUT /compute/v2.1/flavors/717171740/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 31 15:50:10.224692 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:50:10.224692 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:50:10.224692 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:50:10.224692 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 49 Aug 31 15:50:10.224692 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:50:10.224692 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:50:10.224692 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:50:10.224692 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:50:10.224692 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4MvHQ12rm83q8X8Nf9L1vAmjYa-GA8fzoVX3TkGV-ODJuDe7vgZjStQwakaFeESEv7_S4x2i2VaJCgFsaaeJUc0yTSBJWFKjZ_mXNFNlvgM5dXPaQxht8nAGvR-nnYSVHWmJR12e-islzCRNnxGocNH8flewwiFgOuruH85xWc0lDQ Aug 31 15:50:10.224692 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:50:10.224692 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:50:10.224692 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:50:10.224692 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:50:10.224692 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:50:10.224692 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:50:10.224692 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 6a69c70ded644229a186c2491fdfd8fe Aug 31 15:50:10.224692 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465 Aug 31 15:50:10.224692 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,admin,member Aug 31 15:50:10.224692 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,admin,member Aug 31 15:50:10.226120 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6a69c70ded644229a186c2491fdfd8fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6a69c70ded644229a186c2491fdfd8fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6a69c70ded644229a186c2491fdfd8fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6a69c70ded644229a186c2491fdfd8fe", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:50:10.226120 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465 Aug 31 15:50:10.226120 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 6a69c70ded644229a186c2491fdfd8fe Aug 31 15:50:10.226120 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465 Aug 31 15:50:10.226120 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465-project-admin Aug 31 15:50:10.226120 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:50:10.226120 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:50:10.226120 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 60ec280d2fbf444cbd8c8d061582e5cf Aug 31 15:50:10.226120 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465-project-admin Aug 31 15:50:10.226120 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 15:50:10.226120 n-d-833090-16 devstack@n-api.service[128864]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Aug 31 15:50:10.226120 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:50:10.226788 n-d-833090-16 devstack@n-api.service[128864]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 31 15:50:10.226788 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'flavor_id': '717171740', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Aug 31 15:50:10.226788 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:50:10.226788 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:10.226788 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 15:50:10.226788 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 15:50:10.226788 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 15:50:10.226788 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise error Aug 31 15:50:10.226788 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 31 15:50:10.226788 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:10.226788 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Aug 31 15:50:10.226788 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 31 15:50:10.226788 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Aug 31 15:50:10.226788 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Aug 31 15:50:10.226788 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 31 15:50:10.226788 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi 'type': ['string', Aug 31 15:50:10.226788 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi 'number']}}, Aug 31 15:50:10.226788 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 31 15:50:10.226788 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:10.226788 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi On instance: Aug 31 15:50:10.226788 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Aug 31 15:50:10.226788 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:10.228036 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:50:10.228036 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:10.228036 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:10.228036 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:50:10.228036 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:50:10.228036 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:50:10.228036 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:50:10.228036 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:50:10.228036 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:50:10.228036 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 15:50:10.228036 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 15:50:10.228036 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 15:50:10.228036 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 15:50:10.228036 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 15:50:10.228036 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 15:50:10.228036 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 31 15:50:10.228036 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:10.228036 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:50:10.228036 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:10.228036 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:10.229105 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:50:10.229105 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:50:10.229105 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 15:50:10.229105 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 15:50:10.229105 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 31 15:50:10.229105 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:10.231943 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-eeea256f-26eb-4ed8-842e-ed0fe6f4a72c tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465 tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:50:10.234239 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-eeea256f-26eb-4ed8-842e-ed0fe6f4a72c tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465 tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465-project-admin] 10.222.0.50 "PUT /compute/v2.1/flavors/717171740/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.033799 Aug 31 15:50:10.235336 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 214/386] 10.222.0.50 () {60 vars in 1262 bytes} [Wed Aug 31 15:50:10 2022] PUT /compute/v2.1/flavors/717171740/os-extra_specs/hw:numa_nodes => generated 117 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 15:50:10.244873 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3c89a586-bf7e-4080-a230-3d91df80ee18 tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465 tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:10.273236 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3c89a586-bf7e-4080-a230-3d91df80ee18 tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465 tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/717171740" status: 202 len: 0 microversion: 2.1 time: 0.031775 Aug 31 15:50:10.274648 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 215/387] 10.222.0.50 () {58 vars in 1158 bytes} [Wed Aug 31 15:50:10 2022] DELETE /compute/v2.1/flavors/717171740 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:50:10.301566 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f2b4119d-f065-49a5-a3ed-597a3154dab3 tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465 tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:10.352725 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f2b4119d-f065-49a5-a3ed-597a3154dab3 tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465 tempest-FlavorsExtraSpecsNegativeTestJSON-1106782465-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.073942 Aug 31 15:50:10.354422 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 216/388] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 31 15:50:10 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:10.361483 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e95bac7b-a961-4bc1-9281-58bec7dee4e5 tempest-KeyPairsV210TestJSON-362955769 tempest-KeyPairsV210TestJSON-362955769-project-admin] Action: 'create', calling method: .version_select at 0x7fbb46fac310>, body: {"keypair": {"name": "tempest-keypair-803379813", "type": "ssh", "user_id": "dd317078dbb649008966343506fa8060", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOo0heWlebCujclEFMam2Dp0bjbXZiicioSd7Ei8gHNGknbwVSCM4GcQ4LnfgaP2VBJjngrBboPUYVajVVzsaSVFWxI2wzUtxJMjLCz8hfDltOpM1NJdIN5FgCKozswxQ=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:50:10.410868 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-e95bac7b-a961-4bc1-9281-58bec7dee4e5 tempest-KeyPairsV210TestJSON-362955769 tempest-KeyPairsV210TestJSON-362955769-project-admin] Getting quotas for project ac87505741d44d3a9f82ac65f0bb28fc. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:50:10.417625 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-e95bac7b-a961-4bc1-9281-58bec7dee4e5 tempest-KeyPairsV210TestJSON-362955769 tempest-KeyPairsV210TestJSON-362955769-project-admin] Getting quotas for user 15d5c5c8bcaa41aa98e70d7d1f291148 and project ac87505741d44d3a9f82ac65f0bb28fc. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:50:10.466776 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2b319bac-0ef1-45b4-917c-881334d38128 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:10.471788 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2b319bac-0ef1-45b4-917c-881334d38128 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: c3ca0ff6-8f52-4ac3-8706-f5efab49a099] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:10.489952 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b319bac-0ef1-45b4-917c-881334d38128 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:10.490481 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b319bac-0ef1-45b4-917c-881334d38128 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:10.497768 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b319bac-0ef1-45b4-917c-881334d38128 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:10.498750 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b319bac-0ef1-45b4-917c-881334d38128 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:10.499230 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b319bac-0ef1-45b4-917c-881334d38128 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:10.499694 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b319bac-0ef1-45b4-917c-881334d38128 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:10.506415 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e95bac7b-a961-4bc1-9281-58bec7dee4e5 tempest-KeyPairsV210TestJSON-362955769 tempest-KeyPairsV210TestJSON-362955769-project-admin] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.729020 Aug 31 15:50:10.507349 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 173/389] 10.222.0.50 () {62 vars in 1200 bytes} [Wed Aug 31 15:50:09 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 731 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 31 15:50:10.522374 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a3072bf5-7d03-4853-8848-08577292a24e tempest-KeyPairsV210TestJSON-362955769 tempest-KeyPairsV210TestJSON-362955769-project-admin] Action: 'create', calling method: .version_select at 0x7fbb46facca0>, body: {"keypair": {"name": "tempest-keypair-2122825027", "type": "ssh", "user_id": "dd317078dbb649008966343506fa8060", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOhjo5Lq8Hqcjx2i+fgMRzXRi7OY3rxX1nlCJx6/pJqm+/dQo6BE+EvsKGftCxwarygWVtcUJ4J5SvPH4V4b5+2zJZR9sSmrLasZuojSb301b+1WvaYoTyVH6qD7qLn0VQ=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:50:10.548036 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-a3072bf5-7d03-4853-8848-08577292a24e tempest-KeyPairsV210TestJSON-362955769 tempest-KeyPairsV210TestJSON-362955769-project-admin] Getting quotas for project ac87505741d44d3a9f82ac65f0bb28fc. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:50:10.561329 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-a3072bf5-7d03-4853-8848-08577292a24e tempest-KeyPairsV210TestJSON-362955769 tempest-KeyPairsV210TestJSON-362955769-project-admin] Getting quotas for user 15d5c5c8bcaa41aa98e70d7d1f291148 and project ac87505741d44d3a9f82ac65f0bb28fc. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:50:10.664570 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a3072bf5-7d03-4853-8848-08577292a24e tempest-KeyPairsV210TestJSON-362955769 tempest-KeyPairsV210TestJSON-362955769-project-admin] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.146756 Aug 31 15:50:10.671710 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 174/390] 10.222.0.50 () {62 vars in 1200 bytes} [Wed Aug 31 15:50:10 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 154 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 31 15:50:10.682753 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c43221ea-a2a7-4221-88cc-b11fcf8ce979 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:10.686068 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c43221ea-a2a7-4221-88cc-b11fcf8ce979 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:10.707119 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c43221ea-a2a7-4221-88cc-b11fcf8ce979 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:10.707934 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c43221ea-a2a7-4221-88cc-b11fcf8ce979 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:10.710271 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c43221ea-a2a7-4221-88cc-b11fcf8ce979 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:10.711245 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c43221ea-a2a7-4221-88cc-b11fcf8ce979 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:10.715132 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c43221ea-a2a7-4221-88cc-b11fcf8ce979 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:10.716831 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c43221ea-a2a7-4221-88cc-b11fcf8ce979 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:10.888835 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2b319bac-0ef1-45b4-917c-881334d38128 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:10.900123 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2b319bac-0ef1-45b4-917c-881334d38128 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/c3ca0ff6-8f52-4ac3-8706-f5efab49a099" status: 200 len: 1318 microversion: 2.1 time: 0.445407 Aug 31 15:50:10.902669 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 217/391] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:10 2022] GET /compute/v2.1/servers/c3ca0ff6-8f52-4ac3-8706-f5efab49a099 => generated 1318 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:10.918226 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ad69e0de-8349-4e4c-ab3e-486ff77d02bf tempest-KeyPairsV210TestJSON-362955769 tempest-KeyPairsV210TestJSON-362955769-project-admin] Calling method '.version_select at 0x7fbb470e1940>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:10.921657 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c43221ea-a2a7-4221-88cc-b11fcf8ce979 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:10.934556 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c43221ea-a2a7-4221-88cc-b11fcf8ce979 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:10.945499 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ad69e0de-8349-4e4c-ab3e-486ff77d02bf tempest-KeyPairsV210TestJSON-362955769 tempest-KeyPairsV210TestJSON-362955769-project-admin] 10.222.0.50 "GET /compute/v2.1/os-keypairs/tempest-keypair-803379813?user_id=dd317078dbb649008966343506fa8060" status: 200 len: 511 microversion: 2.10 time: 0.041557 Aug 31 15:50:10.946888 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c43221ea-a2a7-4221-88cc-b11fcf8ce979 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:10.949413 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 218/392] 10.222.0.50 () {60 vars in 1337 bytes} [Wed Aug 31 15:50:10 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-803379813?user_id=dd317078dbb649008966343506fa8060 => generated 511 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:50:10.963381 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c3e3217d-4a5c-4628-a13d-17caf11cb602 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:10.964524 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c3e3217d-4a5c-4628-a13d-17caf11cb602 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] [instance: 1e8fdb86-13be-42a3-a7af-5d50024f7419] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:10.975026 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c43221ea-a2a7-4221-88cc-b11fcf8ce979 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] 10.222.0.50 "GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f" status: 200 len: 1453 microversion: 2.75 time: 0.299571 Aug 31 15:50:10.991185 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3e3217d-4a5c-4628-a13d-17caf11cb602 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:10.992991 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3e3217d-4a5c-4628-a13d-17caf11cb602 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:10.994488 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 175/393] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:50:10 2022] GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f => generated 1453 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:50:10.998478 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3e3217d-4a5c-4628-a13d-17caf11cb602 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:10.999427 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3e3217d-4a5c-4628-a13d-17caf11cb602 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:11.000039 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3e3217d-4a5c-4628-a13d-17caf11cb602 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:11.000647 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3e3217d-4a5c-4628-a13d-17caf11cb602 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:11.022213 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-25a2a841-a912-41de-af0c-33fe9645abb2 tempest-KeyPairsV210TestJSON-362955769 tempest-KeyPairsV210TestJSON-362955769-project-admin] Action: 'create', calling method: .version_select at 0x7fbb46f57ca0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1198557154", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPSYVjXuqWwvacJKgvQsRcb4WddNU3lx+kcXaOZbm34rfsjwUgrD92SAUwD66NKzy9P5KyI+7fHVFhObhCMmU9fHWh+FvnUqigZR1TXpragZ8g4KjsBzYA488X8OyILLA=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:50:11.090839 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-25a2a841-a912-41de-af0c-33fe9645abb2 tempest-KeyPairsV210TestJSON-362955769 tempest-KeyPairsV210TestJSON-362955769-project-admin] Getting quotas for project ac87505741d44d3a9f82ac65f0bb28fc. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:50:11.109687 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-25a2a841-a912-41de-af0c-33fe9645abb2 tempest-KeyPairsV210TestJSON-362955769 tempest-KeyPairsV210TestJSON-362955769-project-admin] Getting quotas for user 15d5c5c8bcaa41aa98e70d7d1f291148 and project ac87505741d44d3a9f82ac65f0bb28fc. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:50:11.220449 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-25a2a841-a912-41de-af0c-33fe9645abb2 tempest-KeyPairsV210TestJSON-362955769 tempest-KeyPairsV210TestJSON-362955769-project-admin] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.213970 Aug 31 15:50:11.221073 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 176/394] 10.222.0.50 () {62 vars in 1200 bytes} [Wed Aug 31 15:50:10 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 226 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 31 15:50:11.237634 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f7cf9d6e-9b46-47f5-888e-8c2fcb33945c tempest-KeyPairsV210TestJSON-362955769 tempest-KeyPairsV210TestJSON-362955769-project-admin] Calling method '.version_select at 0x7fbb46facaf0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:11.256604 n-d-833090-16 devstack@n-api.service[128863]: WARNING oslo_db.sqlalchemy.utils [None req-f7cf9d6e-9b46-47f5-888e-8c2fcb33945c tempest-KeyPairsV210TestJSON-362955769 tempest-KeyPairsV210TestJSON-362955769-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Aug 31 15:50:11.285827 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f7cf9d6e-9b46-47f5-888e-8c2fcb33945c tempest-KeyPairsV210TestJSON-362955769 tempest-KeyPairsV210TestJSON-362955769-project-admin] 10.222.0.50 "GET /compute/v2.1/os-keypairs?user_id=dd317078dbb649008966343506fa8060" status: 200 len: 725 microversion: 2.10 time: 0.054608 Aug 31 15:50:11.286489 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 177/395] 10.222.0.50 () {60 vars in 1259 bytes} [Wed Aug 31 15:50:11 2022] GET /compute/v2.1/os-keypairs?user_id=dd317078dbb649008966343506fa8060 => generated 725 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:50:11.314430 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-52fa0433-10e0-43de-9d45-87751ab820b3 req-6d7760a3-8271-418a-a6d5-33c1e44a99ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3ca0ff6-8f52-4ac3-8706-f5efab49a099", "name": "network-vif-plugged", "status": "completed", "tag": "68581347-ace3-404a-bd96-2f05626c4e9c"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:50:11.339553 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-52fa0433-10e0-43de-9d45-87751ab820b3 req-6d7760a3-8271-418a-a6d5-33c1e44a99ff service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:11.340123 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-52fa0433-10e0-43de-9d45-87751ab820b3 req-6d7760a3-8271-418a-a6d5-33c1e44a99ff service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:11.340610 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-52fa0433-10e0-43de-9d45-87751ab820b3 req-6d7760a3-8271-418a-a6d5-33c1e44a99ff service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:11.368361 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-52fa0433-10e0-43de-9d45-87751ab820b3 req-6d7760a3-8271-418a-a6d5-33c1e44a99ff service nova] Creating event network-vif-plugged:68581347-ace3-404a-bd96-2f05626c4e9c for instance c3ca0ff6-8f52-4ac3-8706-f5efab49a099 on n-h1-833090-16 Aug 31 15:50:11.382066 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-52fa0433-10e0-43de-9d45-87751ab820b3 req-6d7760a3-8271-418a-a6d5-33c1e44a99ff service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078615 Aug 31 15:50:11.391850 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 178/396] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:50:11.401469 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a9e241d7-3083-4c45-91ab-2dbfd0a7d2c6 tempest-KeyPairsV210TestJSON-362955769 tempest-KeyPairsV210TestJSON-362955769-project-admin] Calling method '.version_select at 0x7fbb46edc3a0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:11.459186 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a9e241d7-3083-4c45-91ab-2dbfd0a7d2c6 tempest-KeyPairsV210TestJSON-362955769 tempest-KeyPairsV210TestJSON-362955769-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1198557154" status: 204 len: 0 microversion: 2.10 time: 0.063533 Aug 31 15:50:11.463965 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 179/397] 10.222.0.50 () {60 vars in 1325 bytes} [Wed Aug 31 15:50:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1198557154 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 15:50:11.478218 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dbccdc37-8525-4351-b6fc-35293d712751 tempest-KeyPairsV210TestJSON-362955769 tempest-KeyPairsV210TestJSON-362955769-project-admin] Calling method '.version_select at 0x7fbb47031160>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:11.522219 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dbccdc37-8525-4351-b6fc-35293d712751 tempest-KeyPairsV210TestJSON-362955769 tempest-KeyPairsV210TestJSON-362955769-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2122825027?user_id=dd317078dbb649008966343506fa8060" status: 204 len: 0 microversion: 2.10 time: 0.056770 Aug 31 15:50:11.526526 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 180/398] 10.222.0.50 () {60 vars in 1343 bytes} [Wed Aug 31 15:50:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2122825027?user_id=dd317078dbb649008966343506fa8060 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 15:50:11.540269 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-55e7ef22-3a4d-41c0-9308-93b426e9442d tempest-KeyPairsV210TestJSON-362955769 tempest-KeyPairsV210TestJSON-362955769-project-admin] Calling method '.version_select at 0x7fbb46f353a0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:11.587455 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-55e7ef22-3a4d-41c0-9308-93b426e9442d tempest-KeyPairsV210TestJSON-362955769 tempest-KeyPairsV210TestJSON-362955769-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-803379813?user_id=dd317078dbb649008966343506fa8060" status: 204 len: 0 microversion: 2.10 time: 0.059329 Aug 31 15:50:11.595507 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 181/399] 10.222.0.50 () {60 vars in 1340 bytes} [Wed Aug 31 15:50:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-803379813?user_id=dd317078dbb649008966343506fa8060 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 15:50:11.931358 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-04747444-115c-4525-a449-6c2880cc508d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:11.932606 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-04747444-115c-4525-a449-6c2880cc508d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: c3ca0ff6-8f52-4ac3-8706-f5efab49a099] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:11.952750 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04747444-115c-4525-a449-6c2880cc508d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:11.954594 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04747444-115c-4525-a449-6c2880cc508d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:11.957036 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04747444-115c-4525-a449-6c2880cc508d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:11.958955 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04747444-115c-4525-a449-6c2880cc508d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:11.966050 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04747444-115c-4525-a449-6c2880cc508d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:11.967010 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04747444-115c-4525-a449-6c2880cc508d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:11.991544 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c3e3217d-4a5c-4628-a13d-17caf11cb602 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704d7c428d3e4a1bbe5fb78485415214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a08078ba5a04c31b6cc63dee67be8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:12.000185 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c3e3217d-4a5c-4628-a13d-17caf11cb602 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] 10.222.0.50 "GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419" status: 200 len: 1368 microversion: 2.1 time: 1.048179 Aug 31 15:50:12.000796 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 219/400] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:10 2022] GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419 => generated 1368 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:12.016179 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-60119d47-fa69-4c9d-b743-6e2c9c2189d5 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:12.032946 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-60119d47-fa69-4c9d-b743-6e2c9c2189d5 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:12.054729 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-60119d47-fa69-4c9d-b743-6e2c9c2189d5 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:12.060381 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-60119d47-fa69-4c9d-b743-6e2c9c2189d5 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:12.061905 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-60119d47-fa69-4c9d-b743-6e2c9c2189d5 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:12.063069 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-60119d47-fa69-4c9d-b743-6e2c9c2189d5 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:12.068516 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-60119d47-fa69-4c9d-b743-6e2c9c2189d5 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:12.069318 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-60119d47-fa69-4c9d-b743-6e2c9c2189d5 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:12.421347 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-60119d47-fa69-4c9d-b743-6e2c9c2189d5 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:12.429991 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-60119d47-fa69-4c9d-b743-6e2c9c2189d5 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:12.438397 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-60119d47-fa69-4c9d-b743-6e2c9c2189d5 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:12.453398 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-60119d47-fa69-4c9d-b743-6e2c9c2189d5 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] 10.222.0.50 "GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f" status: 200 len: 1453 microversion: 2.75 time: 0.443388 Aug 31 15:50:12.476408 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 220/401] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:50:12 2022] GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f => generated 1453 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:50:12.837755 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-04747444-115c-4525-a449-6c2880cc508d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:12.852341 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-04747444-115c-4525-a449-6c2880cc508d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/c3ca0ff6-8f52-4ac3-8706-f5efab49a099" status: 200 len: 1318 microversion: 2.1 time: 0.929588 Aug 31 15:50:12.858975 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 182/402] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:11 2022] GET /compute/v2.1/servers/c3ca0ff6-8f52-4ac3-8706-f5efab49a099 => generated 1318 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:13.021969 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d9f4a5de-d309-4906-8502-1233897e9a1b tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:13.023265 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d9f4a5de-d309-4906-8502-1233897e9a1b tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] [instance: 1e8fdb86-13be-42a3-a7af-5d50024f7419] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:13.032846 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d9f4a5de-d309-4906-8502-1233897e9a1b tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:13.034566 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d9f4a5de-d309-4906-8502-1233897e9a1b tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:13.035217 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d9f4a5de-d309-4906-8502-1233897e9a1b tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:13.036911 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d9f4a5de-d309-4906-8502-1233897e9a1b tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:13.038370 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d9f4a5de-d309-4906-8502-1233897e9a1b tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:13.039118 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d9f4a5de-d309-4906-8502-1233897e9a1b tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:13.426779 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-c7290e4f-8110-45f2-aa6f-32662230aeff req-ff10b539-8ce5-486d-b9d3-e05ed8a7d978 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e8fdb86-13be-42a3-a7af-5d50024f7419", "name": "network-vif-plugged", "status": "completed", "tag": "e33a5029-0218-44c8-9329-fb96edf985c5"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:50:13.444665 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c7290e4f-8110-45f2-aa6f-32662230aeff req-ff10b539-8ce5-486d-b9d3-e05ed8a7d978 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:13.447782 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c7290e4f-8110-45f2-aa6f-32662230aeff req-ff10b539-8ce5-486d-b9d3-e05ed8a7d978 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:13.450330 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c7290e4f-8110-45f2-aa6f-32662230aeff req-ff10b539-8ce5-486d-b9d3-e05ed8a7d978 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:13.518578 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-c7290e4f-8110-45f2-aa6f-32662230aeff req-ff10b539-8ce5-486d-b9d3-e05ed8a7d978 service nova] Creating event network-vif-plugged:e33a5029-0218-44c8-9329-fb96edf985c5 for instance 1e8fdb86-13be-42a3-a7af-5d50024f7419 on n-h1-833090-16 Aug 31 15:50:13.546415 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-c7290e4f-8110-45f2-aa6f-32662230aeff req-ff10b539-8ce5-486d-b9d3-e05ed8a7d978 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120992 Aug 31 15:50:13.548906 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 183/403] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:50:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:50:13.574358 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-17a86c0d-dafb-48ca-aa3c-c1039ba53035 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:13.576568 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-17a86c0d-dafb-48ca-aa3c-c1039ba53035 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:13.605754 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-17a86c0d-dafb-48ca-aa3c-c1039ba53035 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:13.606332 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-17a86c0d-dafb-48ca-aa3c-c1039ba53035 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:13.606980 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-17a86c0d-dafb-48ca-aa3c-c1039ba53035 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:13.608195 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-17a86c0d-dafb-48ca-aa3c-c1039ba53035 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:13.615663 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-17a86c0d-dafb-48ca-aa3c-c1039ba53035 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:13.618412 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-17a86c0d-dafb-48ca-aa3c-c1039ba53035 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:13.661707 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d9f4a5de-d309-4906-8502-1233897e9a1b tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704d7c428d3e4a1bbe5fb78485415214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a08078ba5a04c31b6cc63dee67be8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:13.673736 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d9f4a5de-d309-4906-8502-1233897e9a1b tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] 10.222.0.50 "GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419" status: 200 len: 1368 microversion: 2.1 time: 0.655568 Aug 31 15:50:13.687603 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 221/404] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:13 2022] GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419 => generated 1368 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:13.875539 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f907248d-d0f3-47c5-af1f-4771cf78c5c6 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:13.876458 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f907248d-d0f3-47c5-af1f-4771cf78c5c6 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: c3ca0ff6-8f52-4ac3-8706-f5efab49a099] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:13.893220 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f907248d-d0f3-47c5-af1f-4771cf78c5c6 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:13.894295 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f907248d-d0f3-47c5-af1f-4771cf78c5c6 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:13.897193 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f907248d-d0f3-47c5-af1f-4771cf78c5c6 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:13.905426 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f907248d-d0f3-47c5-af1f-4771cf78c5c6 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:13.906529 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f907248d-d0f3-47c5-af1f-4771cf78c5c6 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:13.907413 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f907248d-d0f3-47c5-af1f-4771cf78c5c6 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:13.992196 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-17a86c0d-dafb-48ca-aa3c-c1039ba53035 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:14.013451 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-17a86c0d-dafb-48ca-aa3c-c1039ba53035 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:14.024204 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-17a86c0d-dafb-48ca-aa3c-c1039ba53035 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:14.040128 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-17a86c0d-dafb-48ca-aa3c-c1039ba53035 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] 10.222.0.50 "GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f" status: 200 len: 1438 microversion: 2.75 time: 0.489603 Aug 31 15:50:14.040763 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 184/405] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:50:13 2022] GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f => generated 1438 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:50:14.444052 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f907248d-d0f3-47c5-af1f-4771cf78c5c6 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:14.453498 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f907248d-d0f3-47c5-af1f-4771cf78c5c6 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/c3ca0ff6-8f52-4ac3-8706-f5efab49a099" status: 200 len: 1467 microversion: 2.1 time: 0.582546 Aug 31 15:50:14.457015 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 222/406] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:13 2022] GET /compute/v2.1/servers/c3ca0ff6-8f52-4ac3-8706-f5efab49a099 => generated 1467 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:14.483184 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-bc440fb0-92ef-4c9d-a234-40a4359be5f8 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:14.486465 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-bc440fb0-92ef-4c9d-a234-40a4359be5f8 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 269c2cc1-ce8d-41bc-bf54-90f0c37642a2] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:14.501064 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bc440fb0-92ef-4c9d-a234-40a4359be5f8 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:14.502802 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bc440fb0-92ef-4c9d-a234-40a4359be5f8 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:14.504138 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bc440fb0-92ef-4c9d-a234-40a4359be5f8 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:14.505651 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bc440fb0-92ef-4c9d-a234-40a4359be5f8 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:14.506687 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bc440fb0-92ef-4c9d-a234-40a4359be5f8 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:14.507463 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bc440fb0-92ef-4c9d-a234-40a4359be5f8 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:14.532267 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-643e4736-d448-4d8b-b0be-80ac64b54870 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:50:14.554277 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-643e4736-d448-4d8b-b0be-80ac64b54870 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:14.585295 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-643e4736-d448-4d8b-b0be-80ac64b54870 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:14.585796 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-643e4736-d448-4d8b-b0be-80ac64b54870 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:14.586260 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-643e4736-d448-4d8b-b0be-80ac64b54870 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:14.586971 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-643e4736-d448-4d8b-b0be-80ac64b54870 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:14.587424 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-643e4736-d448-4d8b-b0be-80ac64b54870 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:14.587853 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-643e4736-d448-4d8b-b0be-80ac64b54870 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:14.741719 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=6,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:50:14.755485 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-643e4736-d448-4d8b-b0be-80ac64b54870 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:50:14.756258 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-643e4736-d448-4d8b-b0be-80ac64b54870 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:50:14.758819 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-643e4736-d448-4d8b-b0be-80ac64b54870 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:50:14.759326 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-643e4736-d448-4d8b-b0be-80ac64b54870 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:50:14.759809 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-643e4736-d448-4d8b-b0be-80ac64b54870 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:50:14.818936 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-bc440fb0-92ef-4c9d-a234-40a4359be5f8 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:14.833206 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-bc440fb0-92ef-4c9d-a234-40a4359be5f8 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/269c2cc1-ce8d-41bc-bf54-90f0c37642a2" status: 200 len: 1318 microversion: 2.1 time: 0.354580 Aug 31 15:50:14.833417 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 223/407] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:14 2022] GET /compute/v2.1/servers/269c2cc1-ce8d-41bc-bf54-90f0c37642a2 => generated 1318 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:50:14.923114 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-643e4736-d448-4d8b-b0be-80ac64b54870 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:14.936843 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-643e4736-d448-4d8b-b0be-80ac64b54870 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:14.938160 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-643e4736-d448-4d8b-b0be-80ac64b54870 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:14.941579 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-643e4736-d448-4d8b-b0be-80ac64b54870 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:14.942361 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-643e4736-d448-4d8b-b0be-80ac64b54870 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:14.942947 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-643e4736-d448-4d8b-b0be-80ac64b54870 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:14.945270 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-643e4736-d448-4d8b-b0be-80ac64b54870 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:15.134546 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-643e4736-d448-4d8b-b0be-80ac64b54870 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lazy-loading 'services' on Instance uuid a71c696b-bfa3-40cd-ba75-af485432d34f {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:50:15.222174 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-643e4736-d448-4d8b-b0be-80ac64b54870 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f/action" status: 202 len: 1944 microversion: 2.75 time: 1.154680 Aug 31 15:50:15.223213 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 185/408] 10.222.0.50 () {62 vars in 1319 bytes} [Wed Aug 31 15:50:14 2022] POST /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f/action => generated 1944 bytes in 1156 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 31 15:50:15.228265 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-61970b22-011c-4840-a6f7-f3a861a6528f tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:15.228933 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-61970b22-011c-4840-a6f7-f3a861a6528f tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] [instance: 1e8fdb86-13be-42a3-a7af-5d50024f7419] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:15.236072 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61970b22-011c-4840-a6f7-f3a861a6528f tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:15.236777 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61970b22-011c-4840-a6f7-f3a861a6528f tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:15.237365 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61970b22-011c-4840-a6f7-f3a861a6528f tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:15.238247 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61970b22-011c-4840-a6f7-f3a861a6528f tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:15.238963 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61970b22-011c-4840-a6f7-f3a861a6528f tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:15.239590 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61970b22-011c-4840-a6f7-f3a861a6528f tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:15.245640 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:50:15.479567 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-61970b22-011c-4840-a6f7-f3a861a6528f tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704d7c428d3e4a1bbe5fb78485415214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a08078ba5a04c31b6cc63dee67be8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:15.494753 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-61970b22-011c-4840-a6f7-f3a861a6528f tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] 10.222.0.50 "GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419" status: 200 len: 1368 microversion: 2.1 time: 0.270398 Aug 31 15:50:15.514580 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-94f672a1-2407-416b-a2c4-a5180cef90a2 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:15.519729 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 186/409] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:15 2022] GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419 => generated 1368 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:15.528590 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-94f672a1-2407-416b-a2c4-a5180cef90a2 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.693904 Aug 31 15:50:15.529767 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7779f397-36ba-420d-88f7-35e6ad67585f tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:15.530452 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7779f397-36ba-420d-88f7-35e6ad67585f tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:15.531401 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 224/410] 10.222.0.50 () {58 vars in 1137 bytes} [Wed Aug 31 15:50:14 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:50:15.537630 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7779f397-36ba-420d-88f7-35e6ad67585f tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:15.538263 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7779f397-36ba-420d-88f7-35e6ad67585f tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:15.545036 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7779f397-36ba-420d-88f7-35e6ad67585f tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:15.545844 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7779f397-36ba-420d-88f7-35e6ad67585f tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:15.546348 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7779f397-36ba-420d-88f7-35e6ad67585f tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:15.546770 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7779f397-36ba-420d-88f7-35e6ad67585f tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:15.662849 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-7779f397-36ba-420d-88f7-35e6ad67585f tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lazy-loading 'services' on Instance uuid a71c696b-bfa3-40cd-ba75-af485432d34f {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:50:15.689075 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7779f397-36ba-420d-88f7-35e6ad67585f tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f" status: 200 len: 1931 microversion: 2.75 time: 0.167132 Aug 31 15:50:15.702117 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 187/411] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:50:15 2022] GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f => generated 1931 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:50:15.702117 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-38c44f38-b99c-4b33-bb84-36d07b68c993 req-230d5086-a25f-4d63-bcca-8e1f4285d4d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "269c2cc1-ce8d-41bc-bf54-90f0c37642a2", "name": "network-vif-plugged", "status": "completed", "tag": "f5ab5bc7-50cc-4ab5-a182-e23f14ab5ec6"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:50:15.721624 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-38c44f38-b99c-4b33-bb84-36d07b68c993 req-230d5086-a25f-4d63-bcca-8e1f4285d4d3 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:15.722442 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-38c44f38-b99c-4b33-bb84-36d07b68c993 req-230d5086-a25f-4d63-bcca-8e1f4285d4d3 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:15.723061 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-38c44f38-b99c-4b33-bb84-36d07b68c993 req-230d5086-a25f-4d63-bcca-8e1f4285d4d3 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:15.736591 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-38c44f38-b99c-4b33-bb84-36d07b68c993 req-230d5086-a25f-4d63-bcca-8e1f4285d4d3 service nova] Creating event network-vif-plugged:f5ab5bc7-50cc-4ab5-a182-e23f14ab5ec6 for instance 269c2cc1-ce8d-41bc-bf54-90f0c37642a2 on n-h1-833090-16 Aug 31 15:50:15.743744 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-38c44f38-b99c-4b33-bb84-36d07b68c993 req-230d5086-a25f-4d63-bcca-8e1f4285d4d3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052167 Aug 31 15:50:15.746473 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 188/412] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:50:15.857256 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2562b2c2-d005-4ecd-9e62-5d5c4b724d22 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:15.858364 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2562b2c2-d005-4ecd-9e62-5d5c4b724d22 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 269c2cc1-ce8d-41bc-bf54-90f0c37642a2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:15.871305 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2562b2c2-d005-4ecd-9e62-5d5c4b724d22 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:15.871805 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2562b2c2-d005-4ecd-9e62-5d5c4b724d22 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:15.872230 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2562b2c2-d005-4ecd-9e62-5d5c4b724d22 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:15.872934 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2562b2c2-d005-4ecd-9e62-5d5c4b724d22 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:15.874566 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2562b2c2-d005-4ecd-9e62-5d5c4b724d22 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:15.874989 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2562b2c2-d005-4ecd-9e62-5d5c4b724d22 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:16.018159 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7a4edb20-c7e0-4469-b742-8c5b0a227ea6 tempest-ServersWithSpecificFlavorTestJSON-1689394370 tempest-ServersWithSpecificFlavorTestJSON-1689394370-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-36074014", "id": 1065532236, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:50:16.071862 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7a4edb20-c7e0-4469-b742-8c5b0a227ea6 tempest-ServersWithSpecificFlavorTestJSON-1689394370 tempest-ServersWithSpecificFlavorTestJSON-1689394370-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 423 microversion: 2.1 time: 0.532442 Aug 31 15:50:16.072576 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 225/413] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:50:15 2022] POST /compute/v2.1/flavors => generated 423 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:50:16.085037 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7df5c210-30e9-4159-9532-adac1af9c7d8 tempest-ServersWithSpecificFlavorTestJSON-1689394370 tempest-ServersWithSpecificFlavorTestJSON-1689394370-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:16.106067 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7df5c210-30e9-4159-9532-adac1af9c7d8 tempest-ServersWithSpecificFlavorTestJSON-1689394370 tempest-ServersWithSpecificFlavorTestJSON-1689394370-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.025716 Aug 31 15:50:16.106829 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 226/414] 10.222.0.50 () {58 vars in 1182 bytes} [Wed Aug 31 15:50:16 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 15:50:16.118004 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-bddb1442-846d-410c-94c1-3d26c27d702c tempest-ServersWithSpecificFlavorTestJSON-1689394370 tempest-ServersWithSpecificFlavorTestJSON-1689394370-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1748302779", "id": 1698763133, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:50:16.132093 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2562b2c2-d005-4ecd-9e62-5d5c4b724d22 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:16.144827 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2562b2c2-d005-4ecd-9e62-5d5c4b724d22 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/269c2cc1-ce8d-41bc-bf54-90f0c37642a2" status: 200 len: 1318 microversion: 2.1 time: 0.291937 Aug 31 15:50:16.146507 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 189/415] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:15 2022] GET /compute/v2.1/servers/269c2cc1-ce8d-41bc-bf54-90f0c37642a2 => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:50:16.150375 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-bddb1442-846d-410c-94c1-3d26c27d702c tempest-ServersWithSpecificFlavorTestJSON-1689394370 tempest-ServersWithSpecificFlavorTestJSON-1689394370-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.036783 Aug 31 15:50:16.150962 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 227/416] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:50:16 2022] POST /compute/v2.1/flavors => generated 425 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:50:16.170823 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b3af7f8e-976f-441f-b2ae-566722857f93 tempest-ServersWithSpecificFlavorTestJSON-1689394370 tempest-ServersWithSpecificFlavorTestJSON-1689394370-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:16.193519 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b3af7f8e-976f-441f-b2ae-566722857f93 tempest-ServersWithSpecificFlavorTestJSON-1689394370 tempest-ServersWithSpecificFlavorTestJSON-1689394370-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.033382 Aug 31 15:50:16.204043 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 190/417] 10.222.0.50 () {58 vars in 1182 bytes} [Wed Aug 31 15:50:16 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 15:50:16.208958 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8316d30c-7c15-47a0-8cc0-ef7e37653c99 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Action: 'create', calling method: .version_select at 0x7fbb46f67280>, body: {"keypair": {"name": "tempest-keypair-1476463508", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHpInYq+eojDFua/ncnhUVB05wxHxIIMoqAeK6VaPd8e9Suo77yotG+oyXwD5vdiEYJSakVT40nKX4DGPlRErJiXmacGYcIZTDyE6K8vxUt3lyCQTzeSvQz0+zGl9aLRA=="}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:50:16.233634 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-8316d30c-7c15-47a0-8cc0-ef7e37653c99 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Getting quotas for project d33f8cd7d4424157b410b64c7823f480. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:50:16.240394 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-8316d30c-7c15-47a0-8cc0-ef7e37653c99 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Getting quotas for user 6349b0ee9e2142a8a440d4e6ae0703a7 and project d33f8cd7d4424157b410b64c7823f480. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:50:16.277152 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8316d30c-7c15-47a0-8cc0-ef7e37653c99 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.072110 Aug 31 15:50:16.278556 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 228/418] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 31 15:50:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:50:16.520444 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a2c035d3-7c4d-4e72-af33-0f174d6cd789 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:16.521042 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a2c035d3-7c4d-4e72-af33-0f174d6cd789 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] [instance: 1e8fdb86-13be-42a3-a7af-5d50024f7419] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:16.530946 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a2c035d3-7c4d-4e72-af33-0f174d6cd789 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:16.532863 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a2c035d3-7c4d-4e72-af33-0f174d6cd789 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:16.534391 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a2c035d3-7c4d-4e72-af33-0f174d6cd789 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:16.536057 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a2c035d3-7c4d-4e72-af33-0f174d6cd789 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:16.536851 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a2c035d3-7c4d-4e72-af33-0f174d6cd789 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:16.537783 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a2c035d3-7c4d-4e72-af33-0f174d6cd789 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:16.716565 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-69e622ef-cf0d-4ab3-9d76-e6b62180af07 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:16.718584 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-69e622ef-cf0d-4ab3-9d76-e6b62180af07 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:16.728080 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69e622ef-cf0d-4ab3-9d76-e6b62180af07 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:16.731249 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69e622ef-cf0d-4ab3-9d76-e6b62180af07 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:16.733587 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69e622ef-cf0d-4ab3-9d76-e6b62180af07 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:16.734364 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69e622ef-cf0d-4ab3-9d76-e6b62180af07 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:16.738818 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69e622ef-cf0d-4ab3-9d76-e6b62180af07 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:16.739463 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69e622ef-cf0d-4ab3-9d76-e6b62180af07 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:16.877952 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a2c035d3-7c4d-4e72-af33-0f174d6cd789 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704d7c428d3e4a1bbe5fb78485415214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a08078ba5a04c31b6cc63dee67be8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:16.886734 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a2c035d3-7c4d-4e72-af33-0f174d6cd789 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] 10.222.0.50 "GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419" status: 200 len: 1558 microversion: 2.1 time: 0.372174 Aug 31 15:50:16.890518 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 191/419] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:16 2022] GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419 => generated 1558 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:16.911601 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b9305755-cf52-4dce-8852-f53a0287311c tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:16.912876 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b9305755-cf52-4dce-8852-f53a0287311c tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] [instance: 1e8fdb86-13be-42a3-a7af-5d50024f7419] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:16.927627 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9305755-cf52-4dce-8852-f53a0287311c tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:16.929477 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9305755-cf52-4dce-8852-f53a0287311c tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:16.930479 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9305755-cf52-4dce-8852-f53a0287311c tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:16.935453 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9305755-cf52-4dce-8852-f53a0287311c tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:16.936983 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9305755-cf52-4dce-8852-f53a0287311c tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:16.937719 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9305755-cf52-4dce-8852-f53a0287311c tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:16.967705 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-69e622ef-cf0d-4ab3-9d76-e6b62180af07 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lazy-loading 'services' on Instance uuid a71c696b-bfa3-40cd-ba75-af485432d34f {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:50:17.098398 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-69e622ef-cf0d-4ab3-9d76-e6b62180af07 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f" status: 200 len: 1931 microversion: 2.75 time: 0.387463 Aug 31 15:50:17.099640 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 229/420] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:50:16 2022] GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f => generated 1931 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:50:17.170750 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-207f5c76-7a9d-4fc6-88e7-06ad9b1a7f98 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:17.171470 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-207f5c76-7a9d-4fc6-88e7-06ad9b1a7f98 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 269c2cc1-ce8d-41bc-bf54-90f0c37642a2] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:17.191805 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-207f5c76-7a9d-4fc6-88e7-06ad9b1a7f98 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:17.193251 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-207f5c76-7a9d-4fc6-88e7-06ad9b1a7f98 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:17.200677 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-207f5c76-7a9d-4fc6-88e7-06ad9b1a7f98 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:17.202461 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-207f5c76-7a9d-4fc6-88e7-06ad9b1a7f98 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:17.203107 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-207f5c76-7a9d-4fc6-88e7-06ad9b1a7f98 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:17.203695 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-207f5c76-7a9d-4fc6-88e7-06ad9b1a7f98 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:17.228664 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b9305755-cf52-4dce-8852-f53a0287311c tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] 10.222.0.50 "GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.322890 Aug 31 15:50:17.229563 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 192/421] 10.222.0.50 () {58 vars in 1275 bytes} [Wed Aug 31 15:50:16 2022] GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419/os-interface => generated 284 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:50:17.824855 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-207f5c76-7a9d-4fc6-88e7-06ad9b1a7f98 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:17.838620 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-207f5c76-7a9d-4fc6-88e7-06ad9b1a7f98 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/269c2cc1-ce8d-41bc-bf54-90f0c37642a2" status: 200 len: 1318 microversion: 2.1 time: 0.674957 Aug 31 15:50:17.853837 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 230/422] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:17 2022] GET /compute/v2.1/servers/269c2cc1-ce8d-41bc-bf54-90f0c37642a2 => generated 1318 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:50:18.126836 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e503a5cb-19ec-4301-a016-c7585f1996b1 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:18.127435 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e503a5cb-19ec-4301-a016-c7585f1996b1 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:18.137143 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e503a5cb-19ec-4301-a016-c7585f1996b1 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:18.138960 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e503a5cb-19ec-4301-a016-c7585f1996b1 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:18.140469 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e503a5cb-19ec-4301-a016-c7585f1996b1 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:18.143008 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e503a5cb-19ec-4301-a016-c7585f1996b1 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:18.144375 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e503a5cb-19ec-4301-a016-c7585f1996b1 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:18.147748 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e503a5cb-19ec-4301-a016-c7585f1996b1 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:18.394372 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-e503a5cb-19ec-4301-a016-c7585f1996b1 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lazy-loading 'services' on Instance uuid a71c696b-bfa3-40cd-ba75-af485432d34f {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:50:18.431461 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e503a5cb-19ec-4301-a016-c7585f1996b1 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f" status: 200 len: 1931 microversion: 2.75 time: 0.307188 Aug 31 15:50:18.432866 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 193/423] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:50:18 2022] GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f => generated 1931 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:50:18.803422 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-08fb0344-7f60-469e-8e3e-71ff98996f4b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-124978585", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:50:18.861664 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6da1fbf9-cc2b-4e45-9c1e-ddcd17824a9f tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:18.862476 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6da1fbf9-cc2b-4e45-9c1e-ddcd17824a9f tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 269c2cc1-ce8d-41bc-bf54-90f0c37642a2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:18.874302 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6da1fbf9-cc2b-4e45-9c1e-ddcd17824a9f tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:18.875041 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6da1fbf9-cc2b-4e45-9c1e-ddcd17824a9f tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:18.876529 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6da1fbf9-cc2b-4e45-9c1e-ddcd17824a9f tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:18.881296 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6da1fbf9-cc2b-4e45-9c1e-ddcd17824a9f tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:18.882033 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6da1fbf9-cc2b-4e45-9c1e-ddcd17824a9f tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:18.882657 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6da1fbf9-cc2b-4e45-9c1e-ddcd17824a9f tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:18.913425 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-08fb0344-7f60-469e-8e3e-71ff98996f4b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] validate_networks() for None {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:50:19.879567 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6da1fbf9-cc2b-4e45-9c1e-ddcd17824a9f tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:19.896395 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6da1fbf9-cc2b-4e45-9c1e-ddcd17824a9f tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/269c2cc1-ce8d-41bc-bf54-90f0c37642a2" status: 200 len: 1467 microversion: 2.1 time: 1.038818 Aug 31 15:50:19.897293 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 194/424] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:18 2022] GET /compute/v2.1/servers/269c2cc1-ce8d-41bc-bf54-90f0c37642a2 => generated 1467 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:50:19.906588 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-0acd2a35-f2df-43cd-8359-dc89151d1d0e req-3d76979a-b213-4cc8-aa27-7cda404ef63f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e8fdb86-13be-42a3-a7af-5d50024f7419", "tag": "e33a5029-0218-44c8-9329-fb96edf985c5"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:50:19.938266 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-0acd2a35-f2df-43cd-8359-dc89151d1d0e req-3d76979a-b213-4cc8-aa27-7cda404ef63f service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:19.938975 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-0acd2a35-f2df-43cd-8359-dc89151d1d0e req-3d76979a-b213-4cc8-aa27-7cda404ef63f service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:19.939569 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-0acd2a35-f2df-43cd-8359-dc89151d1d0e req-3d76979a-b213-4cc8-aa27-7cda404ef63f service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:19.961435 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-0acd2a35-f2df-43cd-8359-dc89151d1d0e req-3d76979a-b213-4cc8-aa27-7cda404ef63f service nova] Creating event network-changed:e33a5029-0218-44c8-9329-fb96edf985c5 for instance 1e8fdb86-13be-42a3-a7af-5d50024f7419 on n-h1-833090-16 Aug 31 15:50:19.968023 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-0acd2a35-f2df-43cd-8359-dc89151d1d0e req-3d76979a-b213-4cc8-aa27-7cda404ef63f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069155 Aug 31 15:50:19.970184 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 195/425] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:50:19.984560 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ba9b5625-b4ee-4611-81ed-458240f70467 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:19.986031 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ba9b5625-b4ee-4611-81ed-458240f70467 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:20.002795 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba9b5625-b4ee-4611-81ed-458240f70467 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:20.003265 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba9b5625-b4ee-4611-81ed-458240f70467 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:20.003890 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba9b5625-b4ee-4611-81ed-458240f70467 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:20.004854 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba9b5625-b4ee-4611-81ed-458240f70467 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:20.005450 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba9b5625-b4ee-4611-81ed-458240f70467 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:20.006018 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba9b5625-b4ee-4611-81ed-458240f70467 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:20.182244 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-ba9b5625-b4ee-4611-81ed-458240f70467 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lazy-loading 'services' on Instance uuid a71c696b-bfa3-40cd-ba75-af485432d34f {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:50:20.230311 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-08fb0344-7f60-469e-8e3e-71ff98996f4b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:50:20.230998 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ba9b5625-b4ee-4611-81ed-458240f70467 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f" status: 200 len: 1931 microversion: 2.75 time: 0.258047 Aug 31 15:50:20.231791 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-08fb0344-7f60-469e-8e3e-71ff98996f4b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:50:20.232718 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-08fb0344-7f60-469e-8e3e-71ff98996f4b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:50:20.233292 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-08fb0344-7f60-469e-8e3e-71ff98996f4b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:50:20.233745 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 196/426] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:50:19 2022] GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f => generated 1931 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:50:20.242696 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-08fb0344-7f60-469e-8e3e-71ff98996f4b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:50:20.253110 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-196c12df-9145-4531-89ee-0bc8c857db54 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:20.261026 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-196c12df-9145-4531-89ee-0bc8c857db54 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:20.263094 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-196c12df-9145-4531-89ee-0bc8c857db54 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Searching by: {'reservation_id': 'r-v010d60a', 'deleted': False, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245'} {{(pid=128863) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 15:50:20.275899 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-196c12df-9145-4531-89ee-0bc8c857db54 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:20.276194 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-08fb0344-7f60-469e-8e3e-71ff98996f4b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:20.276821 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-08fb0344-7f60-469e-8e3e-71ff98996f4b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:20.277403 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-08fb0344-7f60-469e-8e3e-71ff98996f4b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:20.278454 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-08fb0344-7f60-469e-8e3e-71ff98996f4b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:20.279053 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-08fb0344-7f60-469e-8e3e-71ff98996f4b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:20.279628 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-08fb0344-7f60-469e-8e3e-71ff98996f4b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:20.281362 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-196c12df-9145-4531-89ee-0bc8c857db54 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:20.284257 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-196c12df-9145-4531-89ee-0bc8c857db54 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:20.286641 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-196c12df-9145-4531-89ee-0bc8c857db54 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:20.288623 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-196c12df-9145-4531-89ee-0bc8c857db54 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:20.289979 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-196c12df-9145-4531-89ee-0bc8c857db54 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:20.316002 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-08fb0344-7f60-469e-8e3e-71ff98996f4b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Getting quotas for project 9b4c50ece07f441b8974d384f4ab29a4. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:50:20.340002 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-08fb0344-7f60-469e-8e3e-71ff98996f4b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Getting quotas for user 5f6f8b9d63234b8199c60f842a3c407f and project 9b4c50ece07f441b8974d384f4ab29a4. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:50:20.372208 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-08fb0344-7f60-469e-8e3e-71ff98996f4b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:50:20.378577 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-08fb0344-7f60-469e-8e3e-71ff98996f4b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: a5a21e54-e375-4370-9d9e-b41df3e5922e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:50:20.490053 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-08fb0344-7f60-469e-8e3e-71ff98996f4b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.175824 Aug 31 15:50:20.498453 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 231/427] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:50:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2184 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 15:50:20.595491 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.multi_cell_list [None req-196c12df-9145-4531-89ee-0bc8c857db54 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128863) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 15:50:20.793641 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-196c12df-9145-4531-89ee-0bc8c857db54 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:20.808936 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-196c12df-9145-4531-89ee-0bc8c857db54 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:20.809498 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-196c12df-9145-4531-89ee-0bc8c857db54 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:20.809874 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-196c12df-9145-4531-89ee-0bc8c857db54 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:21.035080 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-464f1d4a-5309-426a-8e32-c1784217fdda tempest-NetworksTest-51074156 tempest-NetworksTest-51074156-project-admin] Calling method '.version_select at 0x7fbb46f67160>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:21.316547 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-196c12df-9145-4531-89ee-0bc8c857db54 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/detail?reservation_id=r-v010d60a" status: 200 len: 2927 microversion: 2.1 time: 1.079568 Aug 31 15:50:21.317843 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 197/428] 10.222.0.50 () {58 vars in 1197 bytes} [Wed Aug 31 15:50:20 2022] GET /compute/v2.1/servers/detail?reservation_id=r-v010d60a => generated 2927 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:21.323288 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7f08a410-4af4-499d-83de-8a41e23f48a2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:21.324124 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7f08a410-4af4-499d-83de-8a41e23f48a2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: a5a21e54-e375-4370-9d9e-b41df3e5922e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:21.343944 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f08a410-4af4-499d-83de-8a41e23f48a2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:21.345292 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f08a410-4af4-499d-83de-8a41e23f48a2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:21.345974 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f08a410-4af4-499d-83de-8a41e23f48a2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:21.348092 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f08a410-4af4-499d-83de-8a41e23f48a2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:21.348739 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f08a410-4af4-499d-83de-8a41e23f48a2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:21.349335 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f08a410-4af4-499d-83de-8a41e23f48a2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:21.411239 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-464f1d4a-5309-426a-8e32-c1784217fdda tempest-NetworksTest-51074156 tempest-NetworksTest-51074156-project-admin] 10.222.0.50 "GET /compute/v2.1/os-networks" status: 200 len: 5390 microversion: 2.1 time: 0.911185 Aug 31 15:50:21.411906 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 232/429] 10.222.0.50 () {58 vars in 1137 bytes} [Wed Aug 31 15:50:20 2022] GET /compute/v2.1/os-networks => generated 5390 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:21.419491 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4b024f95-daaf-48ac-908f-3f6d3e474869 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1640433065", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "1698763133", "adminPass": "***", "networks": [{"uuid": "9e7e92fb-7d42-434e-8b6f-12584674780b"}], "security_groups": [{"name": "tempest-securitygroup--982524549"}], "key_name": "tempest-keypair-1476463508", "user_data": "}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:50:21.448708 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7f08a410-4af4-499d-83de-8a41e23f48a2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:21.462410 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7f08a410-4af4-499d-83de-8a41e23f48a2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e" status: 200 len: 1216 microversion: 2.1 time: 0.141965 Aug 31 15:50:21.465197 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 198/430] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:21 2022] GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e => generated 1216 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:21.599356 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f51e6904-df57-4142-b61e-daef2681f410 tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] Calling method '.version_select at 0x7fbb46fceca0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:21.601511 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-4b024f95-daaf-48ac-908f-3f6d3e474869 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] validate_networks() for [('9e7e92fb-7d42-434e-8b6f-12584674780b', None, None, None, None, None)] {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:50:21.607299 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f51e6904-df57-4142-b61e-daef2681f410 tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:21.608019 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f51e6904-df57-4142-b61e-daef2681f410 tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:21.608597 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f51e6904-df57-4142-b61e-daef2681f410 tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:21.610333 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f51e6904-df57-4142-b61e-daef2681f410 tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:21.611148 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f51e6904-df57-4142-b61e-daef2681f410 tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:21.611732 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f51e6904-df57-4142-b61e-daef2681f410 tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:21.699738 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f51e6904-df57-4142-b61e-daef2681f410 tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.229984 Aug 31 15:50:21.700517 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 199/431] 10.222.0.50 () {58 vars in 1128 bytes} [Wed Aug 31 15:50:21 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:50:21.720113 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-facd1a38-9bcb-4c3a-b5c5-63aae65455b8 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:21.720852 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-facd1a38-9bcb-4c3a-b5c5-63aae65455b8 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:21.727730 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-facd1a38-9bcb-4c3a-b5c5-63aae65455b8 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:21.728501 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-facd1a38-9bcb-4c3a-b5c5-63aae65455b8 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:21.729262 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-facd1a38-9bcb-4c3a-b5c5-63aae65455b8 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:21.730198 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-facd1a38-9bcb-4c3a-b5c5-63aae65455b8 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:21.730851 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-facd1a38-9bcb-4c3a-b5c5-63aae65455b8 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:21.731430 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-facd1a38-9bcb-4c3a-b5c5-63aae65455b8 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:21.870467 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-facd1a38-9bcb-4c3a-b5c5-63aae65455b8 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lazy-loading 'services' on Instance uuid a71c696b-bfa3-40cd-ba75-af485432d34f {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:50:21.898849 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-facd1a38-9bcb-4c3a-b5c5-63aae65455b8 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f" status: 200 len: 1931 microversion: 2.75 time: 0.187487 Aug 31 15:50:21.900121 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 200/432] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:50:21 2022] GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f => generated 1931 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:50:21.910425 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-35a6a7c9-42de-43f0-b607-4fdb8d0d2a91 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:21.927102 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.compute.server_groups [None req-35a6a7c9-42de-43f0-b607-4fdb8d0d2a91 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Querying cell ff6ab154-5f51-4e0d-922a-904eb5aa20da(cell1) for 2 instances {{(pid=128863) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 31 15:50:21.927918 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-35a6a7c9-42de-43f0-b607-4fdb8d0d2a91 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:21.928905 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-35a6a7c9-42de-43f0-b607-4fdb8d0d2a91 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:21.929429 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-35a6a7c9-42de-43f0-b607-4fdb8d0d2a91 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:21.972952 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-35a6a7c9-42de-43f0-b607-4fdb8d0d2a91 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/os-server-groups/09b56213-6e6a-4309-8e25-d9f079e6536c" status: 200 len: 265 microversion: 2.1 time: 0.070866 Aug 31 15:50:21.974039 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 201/433] 10.222.0.50 () {58 vars in 1263 bytes} [Wed Aug 31 15:50:21 2022] GET /compute/v2.1/os-server-groups/09b56213-6e6a-4309-8e25-d9f079e6536c => generated 265 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:50:21.979066 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-20f2656c-f3e8-4e74-840e-878668d8c6a9 tempest-NetworksTest-51074156 tempest-NetworksTest-51074156-project-admin] Calling method '.version_select at 0x7fbb46e1a5e0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:22.135126 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-20f2656c-f3e8-4e74-840e-878668d8c6a9 tempest-NetworksTest-51074156 tempest-NetworksTest-51074156-project-admin] 10.222.0.50 "GET /compute/v2.1/os-networks/01541c28-e61f-455d-a5a3-6c50a4460e17" status: 200 len: 652 microversion: 2.1 time: 0.159550 Aug 31 15:50:22.136004 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 202/434] 10.222.0.50 () {58 vars in 1248 bytes} [Wed Aug 31 15:50:21 2022] GET /compute/v2.1/os-networks/01541c28-e61f-455d-a5a3-6c50a4460e17 => generated 652 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:50:22.140723 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-64b4d8ff-837f-4d06-8e42-4010f1fa671c tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] Calling method '.version_select at 0x7fbb46f35940>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:22.144288 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64b4d8ff-837f-4d06-8e42-4010f1fa671c tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:22.144764 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64b4d8ff-837f-4d06-8e42-4010f1fa671c tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:22.151578 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64b4d8ff-837f-4d06-8e42-4010f1fa671c tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:22.152717 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64b4d8ff-837f-4d06-8e42-4010f1fa671c tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:22.153333 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64b4d8ff-837f-4d06-8e42-4010f1fa671c tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:22.153933 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64b4d8ff-837f-4d06-8e42-4010f1fa671c tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:22.195046 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-64b4d8ff-837f-4d06-8e42-4010f1fa671c tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 381 microversion: 2.1 time: 0.057646 Aug 31 15:50:22.202114 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 203/435] 10.222.0.50 () {58 vars in 1139 bytes} [Wed Aug 31 15:50:22 2022] GET /compute/v2.1/os-hosts?zone= => generated 381 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:50:22.206926 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dec13811-9f1b-4f72-b08d-a5eabeb48662 tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:22.207533 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dec13811-9f1b-4f72-b08d-a5eabeb48662 tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] [instance: 269c2cc1-ce8d-41bc-bf54-90f0c37642a2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:22.213874 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dec13811-9f1b-4f72-b08d-a5eabeb48662 tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:22.214489 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dec13811-9f1b-4f72-b08d-a5eabeb48662 tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:22.215664 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dec13811-9f1b-4f72-b08d-a5eabeb48662 tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:22.215664 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dec13811-9f1b-4f72-b08d-a5eabeb48662 tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:22.216084 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dec13811-9f1b-4f72-b08d-a5eabeb48662 tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:22.216496 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dec13811-9f1b-4f72-b08d-a5eabeb48662 tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:22.411097 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dec13811-9f1b-4f72-b08d-a5eabeb48662 tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/269c2cc1-ce8d-41bc-bf54-90f0c37642a2" status: 200 len: 1620 microversion: 2.1 time: 0.207705 Aug 31 15:50:22.423340 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 204/436] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:22 2022] GET /compute/v2.1/servers/269c2cc1-ce8d-41bc-bf54-90f0c37642a2 => generated 1620 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:22.431953 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9b0a2a22-073a-4a20-8a37-1ee0635035ad tempest-NetworksTest-51074156 tempest-NetworksTest-51074156-project-admin] Calling method '.version_select at 0x7fbb46fce3a0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:22.566993 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-4b024f95-daaf-48ac-908f-3f6d3e474869 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:50:22.567965 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-4b024f95-daaf-48ac-908f-3f6d3e474869 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:50:22.568684 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-4b024f95-daaf-48ac-908f-3f6d3e474869 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:50:22.568994 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-4b024f95-daaf-48ac-908f-3f6d3e474869 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:50:22.569402 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-4b024f95-daaf-48ac-908f-3f6d3e474869 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:50:22.584190 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4b024f95-daaf-48ac-908f-3f6d3e474869 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:22.584668 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4b024f95-daaf-48ac-908f-3f6d3e474869 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:22.586403 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4b024f95-daaf-48ac-908f-3f6d3e474869 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:22.589526 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4b024f95-daaf-48ac-908f-3f6d3e474869 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:22.591686 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4b024f95-daaf-48ac-908f-3f6d3e474869 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:22.592344 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4b024f95-daaf-48ac-908f-3f6d3e474869 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:22.622473 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-4b024f95-daaf-48ac-908f-3f6d3e474869 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Getting quotas for project d33f8cd7d4424157b410b64c7823f480. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:50:22.628342 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-4b024f95-daaf-48ac-908f-3f6d3e474869 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Getting quotas for user 6349b0ee9e2142a8a440d4e6ae0703a7 and project d33f8cd7d4424157b410b64c7823f480. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:50:22.642500 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4b024f95-daaf-48ac-908f-3f6d3e474869 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:50:22.645689 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4b024f95-daaf-48ac-908f-3f6d3e474869 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: 2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:50:22.657387 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9b0a2a22-073a-4a20-8a37-1ee0635035ad tempest-NetworksTest-51074156 tempest-NetworksTest-51074156-project-admin] 10.222.0.50 "GET /compute/v2.1/os-networks" status: 200 len: 5390 microversion: 2.1 time: 0.233939 Aug 31 15:50:22.658325 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 205/437] 10.222.0.50 () {58 vars in 1137 bytes} [Wed Aug 31 15:50:22 2022] GET /compute/v2.1/os-networks => generated 5390 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:22.662978 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-36cabca1-d202-4dd6-8c27-84744e117750 tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] Calling method '.version_select at 0x7fbb46c49ca0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:22.667128 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-36cabca1-d202-4dd6-8c27-84744e117750 tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:22.667957 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-36cabca1-d202-4dd6-8c27-84744e117750 tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:22.668721 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-36cabca1-d202-4dd6-8c27-84744e117750 tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:22.669925 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-36cabca1-d202-4dd6-8c27-84744e117750 tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:22.670673 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-36cabca1-d202-4dd6-8c27-84744e117750 tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:22.671357 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-36cabca1-d202-4dd6-8c27-84744e117750 tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:22.710677 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-36cabca1-d202-4dd6-8c27-84744e117750 tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.051055 Aug 31 15:50:22.711898 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 206/438] 10.222.0.50 () {58 vars in 1145 bytes} [Wed Aug 31 15:50:22 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 15:50:22.717185 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-37c450e6-4826-484d-99e9-79ec03b7650e tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:22.718015 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-37c450e6-4826-484d-99e9-79ec03b7650e tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] [instance: c3ca0ff6-8f52-4ac3-8706-f5efab49a099] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:22.724889 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37c450e6-4826-484d-99e9-79ec03b7650e tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:22.725646 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37c450e6-4826-484d-99e9-79ec03b7650e tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:22.726377 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37c450e6-4826-484d-99e9-79ec03b7650e tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:22.727221 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37c450e6-4826-484d-99e9-79ec03b7650e tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:22.727846 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37c450e6-4826-484d-99e9-79ec03b7650e tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:22.728444 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37c450e6-4826-484d-99e9-79ec03b7650e tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:22.748319 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4b024f95-daaf-48ac-908f-3f6d3e474869 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.335123 Aug 31 15:50:22.750816 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 233/439] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:50:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 1338 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 15:50:22.766328 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-66598ce1-d363-42d5-9b43-7840d798e641 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:22.770639 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-66598ce1-d363-42d5-9b43-7840d798e641 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: a5a21e54-e375-4370-9d9e-b41df3e5922e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:22.779022 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-66598ce1-d363-42d5-9b43-7840d798e641 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:22.781330 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-66598ce1-d363-42d5-9b43-7840d798e641 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:22.830060 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-66598ce1-d363-42d5-9b43-7840d798e641 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:22.831163 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-66598ce1-d363-42d5-9b43-7840d798e641 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:22.831910 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-66598ce1-d363-42d5-9b43-7840d798e641 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:22.832485 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-66598ce1-d363-42d5-9b43-7840d798e641 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:22.955673 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:50:22.967892 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-37c450e6-4826-484d-99e9-79ec03b7650e tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/c3ca0ff6-8f52-4ac3-8706-f5efab49a099" status: 200 len: 1620 microversion: 2.1 time: 0.254755 Aug 31 15:50:22.970984 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 207/440] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:22 2022] GET /compute/v2.1/servers/c3ca0ff6-8f52-4ac3-8706-f5efab49a099 => generated 1620 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:22.982396 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-55a5a5f7-b8bb-4e1a-a855-5e7f70a5b117 tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] Calling method '.version_select at 0x7fbb46edc1f0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:22.989738 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55a5a5f7-b8bb-4e1a-a855-5e7f70a5b117 tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:22.989738 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55a5a5f7-b8bb-4e1a-a855-5e7f70a5b117 tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:22.989738 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55a5a5f7-b8bb-4e1a-a855-5e7f70a5b117 tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:22.989738 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55a5a5f7-b8bb-4e1a-a855-5e7f70a5b117 tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:22.994677 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55a5a5f7-b8bb-4e1a-a855-5e7f70a5b117 tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:22.995162 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55a5a5f7-b8bb-4e1a-a855-5e7f70a5b117 tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:23.007641 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-66598ce1-d363-42d5-9b43-7840d798e641 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:23.027440 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-66598ce1-d363-42d5-9b43-7840d798e641 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e" status: 200 len: 1270 microversion: 2.1 time: 0.273644 Aug 31 15:50:23.030783 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 234/441] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:22 2022] GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e => generated 1270 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:23.045907 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-212c48c5-5f37-4d50-9216-657020c4fced tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:23.045907 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-212c48c5-5f37-4d50-9216-657020c4fced tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: 2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:23.050072 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-55a5a5f7-b8bb-4e1a-a855-5e7f70a5b117 tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.075168 Aug 31 15:50:23.061262 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 208/442] 10.222.0.50 () {58 vars in 1128 bytes} [Wed Aug 31 15:50:22 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:50:23.074398 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9b9695bf-d42c-48ef-b40b-1291ae0f15c4 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:23.075190 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9b9695bf-d42c-48ef-b40b-1291ae0f15c4 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:23.091147 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b9695bf-d42c-48ef-b40b-1291ae0f15c4 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:23.091887 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b9695bf-d42c-48ef-b40b-1291ae0f15c4 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:23.092474 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b9695bf-d42c-48ef-b40b-1291ae0f15c4 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:23.093329 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b9695bf-d42c-48ef-b40b-1291ae0f15c4 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:23.094446 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b9695bf-d42c-48ef-b40b-1291ae0f15c4 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:23.095023 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b9695bf-d42c-48ef-b40b-1291ae0f15c4 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:23.153963 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-212c48c5-5f37-4d50-9216-657020c4fced tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6349b0ee9e2142a8a440d4e6ae0703a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33f8cd7d4424157b410b64c7823f480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:23.166144 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-212c48c5-5f37-4d50-9216-657020c4fced tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "GET /compute/v2.1/servers/2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881" status: 200 len: 1265 microversion: 2.1 time: 0.130160 Aug 31 15:50:23.167291 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 235/443] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:23 2022] GET /compute/v2.1/servers/2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881 => generated 1265 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:23.176551 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d7d8ec32-e672-4eb0-8d0f-fe62716326d2 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Action: 'create', calling method: .version_select at 0x7fbb46f67310>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1220644342", "policies": ["anti-affinity"]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:50:23.194324 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=3,nova_api:INSERT=9 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:50:23.217958 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-d7d8ec32-e672-4eb0-8d0f-fe62716326d2 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Getting quotas for project 7db749eb0a764fa0bb29ddc4abd6d245. Resources: {'server_groups'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:50:23.228479 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-d7d8ec32-e672-4eb0-8d0f-fe62716326d2 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Getting quotas for user fe647be03cef4e9c86b4fd6e703d0de1 and project 7db749eb0a764fa0bb29ddc4abd6d245. Resources: {'server_groups'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:50:23.246017 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-9b9695bf-d42c-48ef-b40b-1291ae0f15c4 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lazy-loading 'services' on Instance uuid a71c696b-bfa3-40cd-ba75-af485432d34f {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:50:23.324277 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-d7d8ec32-e672-4eb0-8d0f-fe62716326d2 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Getting quotas for project 7db749eb0a764fa0bb29ddc4abd6d245. Resources: {'server_groups'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:50:23.331696 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-d7d8ec32-e672-4eb0-8d0f-fe62716326d2 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Getting quotas for user fe647be03cef4e9c86b4fd6e703d0de1 and project 7db749eb0a764fa0bb29ddc4abd6d245. Resources: {'server_groups'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:50:23.345169 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9b9695bf-d42c-48ef-b40b-1291ae0f15c4 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f" status: 200 len: 1931 microversion: 2.75 time: 0.279806 Aug 31 15:50:23.345931 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 209/444] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:50:23 2022] GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f => generated 1931 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:50:23.358937 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-469667c5-c051-41e5-8fe4-6a144715bb56 tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] Calling method '.version_select at 0x7fbb46f1daf0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:23.364771 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-469667c5-c051-41e5-8fe4-6a144715bb56 tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:23.365706 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-469667c5-c051-41e5-8fe4-6a144715bb56 tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:23.366399 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-469667c5-c051-41e5-8fe4-6a144715bb56 tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:23.366683 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d7d8ec32-e672-4eb0-8d0f-fe62716326d2 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.198054 Aug 31 15:50:23.379924 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-469667c5-c051-41e5-8fe4-6a144715bb56 tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:23.380931 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-469667c5-c051-41e5-8fe4-6a144715bb56 tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:23.381580 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-469667c5-c051-41e5-8fe4-6a144715bb56 tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:23.386558 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 236/445] 10.222.0.50 () {60 vars in 1174 bytes} [Wed Aug 31 15:50:23 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:50:23.414529 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-469667c5-c051-41e5-8fe4-6a144715bb56 tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.066677 Aug 31 15:50:23.416207 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 210/446] 10.222.0.50 () {58 vars in 1155 bytes} [Wed Aug 31 15:50:23 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:50:23.429639 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1005c30d-fb9f-42b1-b043-e915e859d5e9 tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] Calling method '.version_select at 0x7fbb46ffcc10>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:23.435093 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1005c30d-fb9f-42b1-b043-e915e859d5e9 tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:23.435586 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1005c30d-fb9f-42b1-b043-e915e859d5e9 tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:23.436013 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1005c30d-fb9f-42b1-b043-e915e859d5e9 tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:23.439508 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1005c30d-fb9f-42b1-b043-e915e859d5e9 tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:23.440165 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1005c30d-fb9f-42b1-b043-e915e859d5e9 tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:23.441305 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1005c30d-fb9f-42b1-b043-e915e859d5e9 tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:23.501009 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1005c30d-fb9f-42b1-b043-e915e859d5e9 tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.075883 Aug 31 15:50:23.519690 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 237/447] 10.222.0.50 () {58 vars in 1128 bytes} [Wed Aug 31 15:50:23 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:50:23.526803 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d16bfca8-7b59-48d8-b720-2b0334dfcdcb tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] Calling method '.version_select at 0x7fbb46f35af0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:23.537875 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d16bfca8-7b59-48d8-b720-2b0334dfcdcb tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:23.539505 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d16bfca8-7b59-48d8-b720-2b0334dfcdcb tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:23.540158 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d16bfca8-7b59-48d8-b720-2b0334dfcdcb tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:23.568946 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-29509083-76db-4c11-b69d-cb78ed7aaf8f tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-686219638", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "a8426721-d328-4b9e-a0a2-d354113b5300"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:50:23.602417 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d16bfca8-7b59-48d8-b720-2b0334dfcdcb tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:23.603222 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d16bfca8-7b59-48d8-b720-2b0334dfcdcb tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:23.605175 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d16bfca8-7b59-48d8-b720-2b0334dfcdcb tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:23.664111 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-29509083-76db-4c11-b69d-cb78ed7aaf8f tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] validate_networks() for None {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:50:23.707054 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d16bfca8-7b59-48d8-b720-2b0334dfcdcb tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts/n-h1-833090-16" status: 200 len: 603 microversion: 2.1 time: 0.185491 Aug 31 15:50:23.724105 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 211/448] 10.222.0.50 () {58 vars in 1173 bytes} [Wed Aug 31 15:50:23 2022] GET /compute/v2.1/os-hosts/n-h1-833090-16 => generated 603 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:50:23.747484 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ee5785c6-d846-4a4a-9dd8-69e46ac03365 tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] Calling method '.version_select at 0x7fbb46cfc160>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:23.763133 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee5785c6-d846-4a4a-9dd8-69e46ac03365 tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:23.763922 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee5785c6-d846-4a4a-9dd8-69e46ac03365 tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:23.764502 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee5785c6-d846-4a4a-9dd8-69e46ac03365 tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:23.789742 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee5785c6-d846-4a4a-9dd8-69e46ac03365 tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:23.790521 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee5785c6-d846-4a4a-9dd8-69e46ac03365 tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:23.791116 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee5785c6-d846-4a4a-9dd8-69e46ac03365 tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:23.817853 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ee5785c6-d846-4a4a-9dd8-69e46ac03365 tempest-HostsAdminTestJSON-420746150 tempest-HostsAdminTestJSON-420746150-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts/n-h2-833090-16" status: 200 len: 735 microversion: 2.1 time: 0.092333 Aug 31 15:50:23.825383 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 212/449] 10.222.0.50 () {58 vars in 1173 bytes} [Wed Aug 31 15:50:23 2022] GET /compute/v2.1/os-hosts/n-h2-833090-16 => generated 735 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:50:24.051098 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-104e6555-4340-42ee-9813-b4ee2117a53c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:24.052205 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-104e6555-4340-42ee-9813-b4ee2117a53c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: a5a21e54-e375-4370-9d9e-b41df3e5922e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:24.066120 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-104e6555-4340-42ee-9813-b4ee2117a53c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:24.067269 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-104e6555-4340-42ee-9813-b4ee2117a53c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:24.067861 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-104e6555-4340-42ee-9813-b4ee2117a53c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:24.079953 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-104e6555-4340-42ee-9813-b4ee2117a53c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:24.080707 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-104e6555-4340-42ee-9813-b4ee2117a53c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:24.082603 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-104e6555-4340-42ee-9813-b4ee2117a53c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:24.193926 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-29509083-76db-4c11-b69d-cb78ed7aaf8f tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:50:24.194602 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-29509083-76db-4c11-b69d-cb78ed7aaf8f tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:50:24.195247 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-29509083-76db-4c11-b69d-cb78ed7aaf8f tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:50:24.195785 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-29509083-76db-4c11-b69d-cb78ed7aaf8f tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:50:24.197112 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-29509083-76db-4c11-b69d-cb78ed7aaf8f tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:50:24.255018 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-104e6555-4340-42ee-9813-b4ee2117a53c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:24.268373 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-104e6555-4340-42ee-9813-b4ee2117a53c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e" status: 200 len: 1270 microversion: 2.1 time: 0.222309 Aug 31 15:50:24.270434 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-29509083-76db-4c11-b69d-cb78ed7aaf8f tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:24.271179 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 213/450] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:24 2022] GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e => generated 1270 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:24.272710 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-29509083-76db-4c11-b69d-cb78ed7aaf8f tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:24.273354 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-29509083-76db-4c11-b69d-cb78ed7aaf8f tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:24.274983 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-29509083-76db-4c11-b69d-cb78ed7aaf8f tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:24.277026 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-29509083-76db-4c11-b69d-cb78ed7aaf8f tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:24.278220 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-29509083-76db-4c11-b69d-cb78ed7aaf8f tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:24.283377 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1c0091c2-f7e9-4241-aa5b-2b84e1fa7d07 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:24.287969 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1c0091c2-f7e9-4241-aa5b-2b84e1fa7d07 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: 2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:24.299908 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c0091c2-f7e9-4241-aa5b-2b84e1fa7d07 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:24.300406 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c0091c2-f7e9-4241-aa5b-2b84e1fa7d07 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:24.300884 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c0091c2-f7e9-4241-aa5b-2b84e1fa7d07 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:24.301596 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c0091c2-f7e9-4241-aa5b-2b84e1fa7d07 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:24.302048 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c0091c2-f7e9-4241-aa5b-2b84e1fa7d07 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:24.302491 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c0091c2-f7e9-4241-aa5b-2b84e1fa7d07 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:24.327340 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-29509083-76db-4c11-b69d-cb78ed7aaf8f tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Getting quotas for project 7db749eb0a764fa0bb29ddc4abd6d245. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:50:24.343619 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-29509083-76db-4c11-b69d-cb78ed7aaf8f tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Getting quotas for user fe647be03cef4e9c86b4fd6e703d0de1 and project 7db749eb0a764fa0bb29ddc4abd6d245. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:50:24.363332 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-29509083-76db-4c11-b69d-cb78ed7aaf8f tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Going to run 2 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:50:24.366779 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-29509083-76db-4c11-b69d-cb78ed7aaf8f tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 19da7b68-c450-41e9-9a0b-135b8105b4d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:50:24.445365 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-29509083-76db-4c11-b69d-cb78ed7aaf8f tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=128864) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 31 15:50:24.480163 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-29509083-76db-4c11-b69d-cb78ed7aaf8f tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Getting quotas for project 7db749eb0a764fa0bb29ddc4abd6d245. Resources: {'server_group_members'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:50:24.482184 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1c0091c2-f7e9-4241-aa5b-2b84e1fa7d07 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6349b0ee9e2142a8a440d4e6ae0703a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33f8cd7d4424157b410b64c7823f480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:24.487119 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-29509083-76db-4c11-b69d-cb78ed7aaf8f tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Getting quotas for user fe647be03cef4e9c86b4fd6e703d0de1 and project 7db749eb0a764fa0bb29ddc4abd6d245. Resources: {'server_group_members'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:50:24.500718 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1c0091c2-f7e9-4241-aa5b-2b84e1fa7d07 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "GET /compute/v2.1/servers/2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881" status: 200 len: 1317 microversion: 2.1 time: 0.228396 Aug 31 15:50:24.501320 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 214/451] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:24 2022] GET /compute/v2.1/servers/2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881 => generated 1317 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:24.516825 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4ff584a0-1988-4b54-8379-c36fa416cee0 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:24.520276 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4ff584a0-1988-4b54-8379-c36fa416cee0 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:24.539459 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ff584a0-1988-4b54-8379-c36fa416cee0 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:24.539961 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ff584a0-1988-4b54-8379-c36fa416cee0 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:24.540395 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ff584a0-1988-4b54-8379-c36fa416cee0 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:24.541097 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ff584a0-1988-4b54-8379-c36fa416cee0 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:24.541546 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ff584a0-1988-4b54-8379-c36fa416cee0 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:24.541961 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ff584a0-1988-4b54-8379-c36fa416cee0 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:24.591921 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-29509083-76db-4c11-b69d-cb78ed7aaf8f tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Getting quotas for project 7db749eb0a764fa0bb29ddc4abd6d245. Resources: {'server_group_members'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:50:24.617333 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-29509083-76db-4c11-b69d-cb78ed7aaf8f tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Getting quotas for user fe647be03cef4e9c86b4fd6e703d0de1 and project 7db749eb0a764fa0bb29ddc4abd6d245. Resources: {'server_group_members'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:50:24.644649 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-29509083-76db-4c11-b69d-cb78ed7aaf8f tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: d15c3817-84b0-4e82-86b2-f2333ceeb3cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=19da7b68-c450-41e9-9a0b-135b8105b4d5,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:50:24.745953 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-4ff584a0-1988-4b54-8379-c36fa416cee0 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lazy-loading 'services' on Instance uuid a71c696b-bfa3-40cd-ba75-af485432d34f {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:50:24.800628 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-29509083-76db-4c11-b69d-cb78ed7aaf8f tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Getting quotas for project 7db749eb0a764fa0bb29ddc4abd6d245. Resources: {'server_group_members'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:50:24.813318 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-29509083-76db-4c11-b69d-cb78ed7aaf8f tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Getting quotas for user fe647be03cef4e9c86b4fd6e703d0de1 and project 7db749eb0a764fa0bb29ddc4abd6d245. Resources: {'server_group_members'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:50:24.816819 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4ff584a0-1988-4b54-8379-c36fa416cee0 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f" status: 200 len: 1931 microversion: 2.75 time: 0.314439 Aug 31 15:50:24.817728 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 215/452] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:50:24 2022] GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f => generated 1931 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:50:24.900637 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-29509083-76db-4c11-b69d-cb78ed7aaf8f tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Getting quotas for project 7db749eb0a764fa0bb29ddc4abd6d245. Resources: {'server_group_members'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:50:24.940812 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-29509083-76db-4c11-b69d-cb78ed7aaf8f tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Getting quotas for user fe647be03cef4e9c86b4fd6e703d0de1 and project 7db749eb0a764fa0bb29ddc4abd6d245. Resources: {'server_group_members'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:50:25.008530 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-29509083-76db-4c11-b69d-cb78ed7aaf8f tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.443498 Aug 31 15:50:25.020294 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d068243d-5620-4d77-935b-ce3aec9af9a0 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:25.026207 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 238/453] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:50:23 2022] POST /compute/v2.1/servers => generated 32 bytes in 1451 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 31 15:50:25.057849 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d068243d-5620-4d77-935b-ce3aec9af9a0 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:25.058743 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d068243d-5620-4d77-935b-ce3aec9af9a0 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Searching by: {'deleted': False, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245'} {{(pid=128863) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 15:50:25.145769 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d068243d-5620-4d77-935b-ce3aec9af9a0 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:25.149242 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d068243d-5620-4d77-935b-ce3aec9af9a0 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:25.149942 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d068243d-5620-4d77-935b-ce3aec9af9a0 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:25.154183 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d068243d-5620-4d77-935b-ce3aec9af9a0 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:25.155146 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d068243d-5620-4d77-935b-ce3aec9af9a0 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:25.155741 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d068243d-5620-4d77-935b-ce3aec9af9a0 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:25.224962 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.multi_cell_list [None req-d068243d-5620-4d77-935b-ce3aec9af9a0 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=128863) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 15:50:25.291425 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c78d1a05-2e2f-4668-adff-6b242930c5b1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:25.292301 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c78d1a05-2e2f-4668-adff-6b242930c5b1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: a5a21e54-e375-4370-9d9e-b41df3e5922e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:25.300136 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d068243d-5620-4d77-935b-ce3aec9af9a0 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 1662 microversion: 2.1 time: 0.284518 Aug 31 15:50:25.301484 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 216/454] 10.222.0.50 () {58 vars in 1125 bytes} [Wed Aug 31 15:50:25 2022] GET /compute/v2.1/servers => generated 1662 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:25.311412 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:50:25.313151 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-471eb43e-3d40-4c66-81de-f0a72e897aa9 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:25.313772 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-471eb43e-3d40-4c66-81de-f0a72e897aa9 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: d15c3817-84b0-4e82-86b2-f2333ceeb3cd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:25.315044 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c78d1a05-2e2f-4668-adff-6b242930c5b1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:25.316071 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c78d1a05-2e2f-4668-adff-6b242930c5b1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:25.316924 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c78d1a05-2e2f-4668-adff-6b242930c5b1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:25.317831 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c78d1a05-2e2f-4668-adff-6b242930c5b1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:25.318325 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c78d1a05-2e2f-4668-adff-6b242930c5b1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:25.318910 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c78d1a05-2e2f-4668-adff-6b242930c5b1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:25.524412 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-471eb43e-3d40-4c66-81de-f0a72e897aa9 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:25.542463 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-471eb43e-3d40-4c66-81de-f0a72e897aa9 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/d15c3817-84b0-4e82-86b2-f2333ceeb3cd" status: 200 len: 1218 microversion: 2.1 time: 0.229137 Aug 31 15:50:25.550789 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 217/455] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:25 2022] GET /compute/v2.1/servers/d15c3817-84b0-4e82-86b2-f2333ceeb3cd => generated 1218 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:50:25.563480 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a268d437-d224-4c13-b4f9-cc1366342fbe tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:25.564854 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a268d437-d224-4c13-b4f9-cc1366342fbe tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: 2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:25.591521 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a268d437-d224-4c13-b4f9-cc1366342fbe tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:25.596542 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a268d437-d224-4c13-b4f9-cc1366342fbe tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:25.597612 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a268d437-d224-4c13-b4f9-cc1366342fbe tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:25.601036 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a268d437-d224-4c13-b4f9-cc1366342fbe tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:25.603238 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a268d437-d224-4c13-b4f9-cc1366342fbe tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:25.603868 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a268d437-d224-4c13-b4f9-cc1366342fbe tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:25.792513 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a268d437-d224-4c13-b4f9-cc1366342fbe tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6349b0ee9e2142a8a440d4e6ae0703a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33f8cd7d4424157b410b64c7823f480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:25.808082 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a268d437-d224-4c13-b4f9-cc1366342fbe tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "GET /compute/v2.1/servers/2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881" status: 200 len: 1323 microversion: 2.1 time: 0.253791 Aug 31 15:50:25.809660 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 218/456] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:25 2022] GET /compute/v2.1/servers/2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881 => generated 1323 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:25.852957 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-98ae7132-bb37-4f03-a76f-99ac0469b748 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:25.854123 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-98ae7132-bb37-4f03-a76f-99ac0469b748 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:25.861716 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:50:25.872817 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c78d1a05-2e2f-4668-adff-6b242930c5b1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:25.878581 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98ae7132-bb37-4f03-a76f-99ac0469b748 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:25.879400 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98ae7132-bb37-4f03-a76f-99ac0469b748 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:25.881355 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c78d1a05-2e2f-4668-adff-6b242930c5b1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e" status: 200 len: 1312 microversion: 2.1 time: 0.594455 Aug 31 15:50:25.882151 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 239/457] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:25 2022] GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e => generated 1312 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:50:25.889141 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98ae7132-bb37-4f03-a76f-99ac0469b748 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:25.890084 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98ae7132-bb37-4f03-a76f-99ac0469b748 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:25.890676 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98ae7132-bb37-4f03-a76f-99ac0469b748 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:25.899029 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98ae7132-bb37-4f03-a76f-99ac0469b748 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:26.109174 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-98ae7132-bb37-4f03-a76f-99ac0469b748 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lazy-loading 'services' on Instance uuid a71c696b-bfa3-40cd-ba75-af485432d34f {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:50:26.157665 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-98ae7132-bb37-4f03-a76f-99ac0469b748 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f" status: 200 len: 1931 microversion: 2.75 time: 0.319939 Aug 31 15:50:26.161998 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 219/458] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:50:25 2022] GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f => generated 1931 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:50:26.572654 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-560cc7e8-f66e-465e-b912-1dd06d6bbdbc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:26.573925 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-560cc7e8-f66e-465e-b912-1dd06d6bbdbc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: d15c3817-84b0-4e82-86b2-f2333ceeb3cd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:26.587103 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-560cc7e8-f66e-465e-b912-1dd06d6bbdbc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:26.587596 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-560cc7e8-f66e-465e-b912-1dd06d6bbdbc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:26.588022 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-560cc7e8-f66e-465e-b912-1dd06d6bbdbc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:26.588708 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-560cc7e8-f66e-465e-b912-1dd06d6bbdbc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:26.589319 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-560cc7e8-f66e-465e-b912-1dd06d6bbdbc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:26.589928 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-560cc7e8-f66e-465e-b912-1dd06d6bbdbc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:26.752971 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-560cc7e8-f66e-465e-b912-1dd06d6bbdbc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:26.761746 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-560cc7e8-f66e-465e-b912-1dd06d6bbdbc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/d15c3817-84b0-4e82-86b2-f2333ceeb3cd" status: 200 len: 1222 microversion: 2.1 time: 0.192901 Aug 31 15:50:26.762976 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 240/459] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:26 2022] GET /compute/v2.1/servers/d15c3817-84b0-4e82-86b2-f2333ceeb3cd => generated 1222 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:26.830567 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b811fd91-3842-4e18-a739-6d8511a60424 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:26.831201 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b811fd91-3842-4e18-a739-6d8511a60424 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: 2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:26.844051 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b811fd91-3842-4e18-a739-6d8511a60424 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:26.848667 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b811fd91-3842-4e18-a739-6d8511a60424 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:26.850514 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b811fd91-3842-4e18-a739-6d8511a60424 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:26.851270 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b811fd91-3842-4e18-a739-6d8511a60424 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:26.851732 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b811fd91-3842-4e18-a739-6d8511a60424 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:26.852152 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b811fd91-3842-4e18-a739-6d8511a60424 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:26.910810 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5365c4c7-7dad-418f-81cf-fd4ecb2c0a2f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:26.911910 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5365c4c7-7dad-418f-81cf-fd4ecb2c0a2f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: a5a21e54-e375-4370-9d9e-b41df3e5922e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:26.939445 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5365c4c7-7dad-418f-81cf-fd4ecb2c0a2f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:26.941367 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5365c4c7-7dad-418f-81cf-fd4ecb2c0a2f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:26.941830 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5365c4c7-7dad-418f-81cf-fd4ecb2c0a2f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:26.942593 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5365c4c7-7dad-418f-81cf-fd4ecb2c0a2f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:26.945575 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5365c4c7-7dad-418f-81cf-fd4ecb2c0a2f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:26.946988 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5365c4c7-7dad-418f-81cf-fd4ecb2c0a2f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:26.998307 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b811fd91-3842-4e18-a739-6d8511a60424 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6349b0ee9e2142a8a440d4e6ae0703a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33f8cd7d4424157b410b64c7823f480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:27.013886 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b811fd91-3842-4e18-a739-6d8511a60424 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "GET /compute/v2.1/servers/2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881" status: 200 len: 1323 microversion: 2.1 time: 0.185420 Aug 31 15:50:27.014720 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 220/460] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:26 2022] GET /compute/v2.1/servers/2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881 => generated 1323 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:27.188756 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bdb9d764-88e1-42c4-8a7d-bb2bc4621b50 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:27.190298 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bdb9d764-88e1-42c4-8a7d-bb2bc4621b50 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:27.201827 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bdb9d764-88e1-42c4-8a7d-bb2bc4621b50 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:27.202254 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bdb9d764-88e1-42c4-8a7d-bb2bc4621b50 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:27.202720 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bdb9d764-88e1-42c4-8a7d-bb2bc4621b50 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:27.203405 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bdb9d764-88e1-42c4-8a7d-bb2bc4621b50 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:27.203919 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bdb9d764-88e1-42c4-8a7d-bb2bc4621b50 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:27.204347 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bdb9d764-88e1-42c4-8a7d-bb2bc4621b50 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:27.254857 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5365c4c7-7dad-418f-81cf-fd4ecb2c0a2f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:27.268250 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5365c4c7-7dad-418f-81cf-fd4ecb2c0a2f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e" status: 200 len: 1312 microversion: 2.1 time: 0.363942 Aug 31 15:50:27.268844 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 241/461] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:26 2022] GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e => generated 1312 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:50:27.351400 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-bdb9d764-88e1-42c4-8a7d-bb2bc4621b50 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lazy-loading 'services' on Instance uuid a71c696b-bfa3-40cd-ba75-af485432d34f {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:50:27.375715 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bdb9d764-88e1-42c4-8a7d-bb2bc4621b50 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f" status: 200 len: 1931 microversion: 2.75 time: 0.191665 Aug 31 15:50:27.377356 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 221/462] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:50:27 2022] GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f => generated 1931 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 15:50:27.797073 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-00687438-b4d8-4f3b-a5cf-33de20f41953 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:27.798314 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-00687438-b4d8-4f3b-a5cf-33de20f41953 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: d15c3817-84b0-4e82-86b2-f2333ceeb3cd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:27.820205 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-00687438-b4d8-4f3b-a5cf-33de20f41953 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:27.821116 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-00687438-b4d8-4f3b-a5cf-33de20f41953 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:27.822403 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-00687438-b4d8-4f3b-a5cf-33de20f41953 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:27.824246 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-00687438-b4d8-4f3b-a5cf-33de20f41953 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:27.825292 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-00687438-b4d8-4f3b-a5cf-33de20f41953 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:27.826197 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-00687438-b4d8-4f3b-a5cf-33de20f41953 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:27.846605 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=100 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:50:27.874220 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-c77e69d2-7f5b-4c57-bb92-0a19b5c652e8 req-58ed73b5-719a-4b7e-9722-0c9bf77c64fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5a21e54-e375-4370-9d9e-b41df3e5922e", "tag": "abeadf77-b435-4819-a412-27a7510ef57a"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:50:27.910712 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c77e69d2-7f5b-4c57-bb92-0a19b5c652e8 req-58ed73b5-719a-4b7e-9722-0c9bf77c64fc service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:27.911235 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c77e69d2-7f5b-4c57-bb92-0a19b5c652e8 req-58ed73b5-719a-4b7e-9722-0c9bf77c64fc service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:27.911716 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c77e69d2-7f5b-4c57-bb92-0a19b5c652e8 req-58ed73b5-719a-4b7e-9722-0c9bf77c64fc service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:27.973019 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-c77e69d2-7f5b-4c57-bb92-0a19b5c652e8 req-58ed73b5-719a-4b7e-9722-0c9bf77c64fc service nova] Creating event network-changed:abeadf77-b435-4819-a412-27a7510ef57a for instance a5a21e54-e375-4370-9d9e-b41df3e5922e on n-h2-833090-16 Aug 31 15:50:27.999397 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-c77e69d2-7f5b-4c57-bb92-0a19b5c652e8 req-58ed73b5-719a-4b7e-9722-0c9bf77c64fc service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130287 Aug 31 15:50:28.003322 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 222/463] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:50:28.040766 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7ecf9b18-6159-45cb-8177-4a2d6e6f7b39 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:28.041756 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7ecf9b18-6159-45cb-8177-4a2d6e6f7b39 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: 2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:28.062651 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ecf9b18-6159-45cb-8177-4a2d6e6f7b39 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:28.063879 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ecf9b18-6159-45cb-8177-4a2d6e6f7b39 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:28.067482 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ecf9b18-6159-45cb-8177-4a2d6e6f7b39 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:28.071795 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ecf9b18-6159-45cb-8177-4a2d6e6f7b39 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:28.072755 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ecf9b18-6159-45cb-8177-4a2d6e6f7b39 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:28.075212 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ecf9b18-6159-45cb-8177-4a2d6e6f7b39 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:28.341831 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-00687438-b4d8-4f3b-a5cf-33de20f41953 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:28.360956 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-00687438-b4d8-4f3b-a5cf-33de20f41953 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/d15c3817-84b0-4e82-86b2-f2333ceeb3cd" status: 200 len: 1278 microversion: 2.1 time: 0.578995 Aug 31 15:50:28.367612 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 242/464] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:27 2022] GET /compute/v2.1/servers/d15c3817-84b0-4e82-86b2-f2333ceeb3cd => generated 1278 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:28.376645 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-93f1e489-b30f-48f5-8dc2-d3e262e6543f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:28.379798 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-93f1e489-b30f-48f5-8dc2-d3e262e6543f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: a5a21e54-e375-4370-9d9e-b41df3e5922e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:28.395307 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-93f1e489-b30f-48f5-8dc2-d3e262e6543f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:28.401067 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-93f1e489-b30f-48f5-8dc2-d3e262e6543f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:28.401806 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-93f1e489-b30f-48f5-8dc2-d3e262e6543f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:28.405001 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-93f1e489-b30f-48f5-8dc2-d3e262e6543f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:28.405633 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-93f1e489-b30f-48f5-8dc2-d3e262e6543f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:28.407111 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-93f1e489-b30f-48f5-8dc2-d3e262e6543f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:28.410564 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7ecf9b18-6159-45cb-8177-4a2d6e6f7b39 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6349b0ee9e2142a8a440d4e6ae0703a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33f8cd7d4424157b410b64c7823f480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:28.420240 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7ecf9b18-6159-45cb-8177-4a2d6e6f7b39 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "GET /compute/v2.1/servers/2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881" status: 200 len: 1323 microversion: 2.1 time: 0.386549 Aug 31 15:50:28.427461 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 223/465] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:28 2022] GET /compute/v2.1/servers/2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881 => generated 1323 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:50:28.447434 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-115b3092-a2e4-4021-92ee-aace38229400 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:28.448228 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-115b3092-a2e4-4021-92ee-aace38229400 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:28.459066 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-115b3092-a2e4-4021-92ee-aace38229400 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:28.459715 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-115b3092-a2e4-4021-92ee-aace38229400 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:28.460474 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-115b3092-a2e4-4021-92ee-aace38229400 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:28.461348 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-115b3092-a2e4-4021-92ee-aace38229400 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:28.461941 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-115b3092-a2e4-4021-92ee-aace38229400 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:28.462530 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-115b3092-a2e4-4021-92ee-aace38229400 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:28.636175 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-115b3092-a2e4-4021-92ee-aace38229400 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lazy-loading 'services' on Instance uuid a71c696b-bfa3-40cd-ba75-af485432d34f {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:50:28.686839 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-115b3092-a2e4-4021-92ee-aace38229400 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f" status: 200 len: 1931 microversion: 2.75 time: 0.257894 Aug 31 15:50:28.691257 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 224/466] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:50:28 2022] GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f => generated 1931 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:50:28.896230 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-93f1e489-b30f-48f5-8dc2-d3e262e6543f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:28.910129 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-93f1e489-b30f-48f5-8dc2-d3e262e6543f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e" status: 200 len: 1312 microversion: 2.1 time: 0.540913 Aug 31 15:50:28.912104 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 243/467] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:28 2022] GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e => generated 1312 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:29.205903 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ee878cbd-6362-4388-a2c2-51c48fcda38e tempest-QuotaClassesAdmin257Test-1623573150 tempest-QuotaClassesAdmin257Test-1623573150-project-admin] Calling method '.version_select at 0x7fbb46f35160>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:29.231596 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ee878cbd-6362-4388-a2c2-51c48fcda38e tempest-QuotaClassesAdmin257Test-1623573150 tempest-QuotaClassesAdmin257Test-1623573150-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.227206 Aug 31 15:50:29.233076 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 225/468] 10.222.0.50 () {60 vars in 1226 bytes} [Wed Aug 31 15:50:29 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:50:29.243904 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4c792efc-b84f-4636-b0aa-346daeaa03f2 tempest-QuotaClassesAdmin257Test-1623573150 tempest-QuotaClassesAdmin257Test-1623573150-project-admin] Action: 'update', calling method: .version_select at 0x7fbb46f38e50>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:50:29.391629 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d0680ca9-d7e2-4634-b74c-5e9c98039288 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:29.392297 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d0680ca9-d7e2-4634-b74c-5e9c98039288 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: d15c3817-84b0-4e82-86b2-f2333ceeb3cd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:29.408806 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0680ca9-d7e2-4634-b74c-5e9c98039288 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:29.409299 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0680ca9-d7e2-4634-b74c-5e9c98039288 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:29.409725 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0680ca9-d7e2-4634-b74c-5e9c98039288 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:29.410520 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0680ca9-d7e2-4634-b74c-5e9c98039288 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:29.410913 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0680ca9-d7e2-4634-b74c-5e9c98039288 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:29.411328 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0680ca9-d7e2-4634-b74c-5e9c98039288 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:29.489296 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:50:29.491844 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4c792efc-b84f-4636-b0aa-346daeaa03f2 tempest-QuotaClassesAdmin257Test-1623573150 tempest-QuotaClassesAdmin257Test-1623573150-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.252087 Aug 31 15:50:29.496563 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 244/469] 10.222.0.50 () {62 vars in 1247 bytes} [Wed Aug 31 15:50:29 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:50:29.508636 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6cbdbeba-8236-42d0-91a4-9519d586f10e tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:29.513829 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6cbdbeba-8236-42d0-91a4-9519d586f10e tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: 2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:29.527830 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6cbdbeba-8236-42d0-91a4-9519d586f10e tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:29.528327 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6cbdbeba-8236-42d0-91a4-9519d586f10e tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:29.535408 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6cbdbeba-8236-42d0-91a4-9519d586f10e tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:29.536665 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6cbdbeba-8236-42d0-91a4-9519d586f10e tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:29.537155 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6cbdbeba-8236-42d0-91a4-9519d586f10e tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:29.537706 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6cbdbeba-8236-42d0-91a4-9519d586f10e tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:29.668668 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d0680ca9-d7e2-4634-b74c-5e9c98039288 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:29.681732 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d0680ca9-d7e2-4634-b74c-5e9c98039288 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/d15c3817-84b0-4e82-86b2-f2333ceeb3cd" status: 200 len: 1276 microversion: 2.1 time: 0.294392 Aug 31 15:50:29.694077 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 226/470] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:29 2022] GET /compute/v2.1/servers/d15c3817-84b0-4e82-86b2-f2333ceeb3cd => generated 1276 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:50:29.702036 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-78da6f64-db6f-4ee5-a431-480fe6314d83 tempest-QuotaClassesAdmin257Test-1623573150 tempest-QuotaClassesAdmin257Test-1623573150-project-admin] Calling method '.version_select at 0x7fbb46cfc160>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:29.737081 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-78da6f64-db6f-4ee5-a431-480fe6314d83 tempest-QuotaClassesAdmin257Test-1623573150 tempest-QuotaClassesAdmin257Test-1623573150-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.041401 Aug 31 15:50:29.739651 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 227/471] 10.222.0.50 () {60 vars in 1226 bytes} [Wed Aug 31 15:50:29 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:50:29.753872 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-071a50ad-5b8e-4b3a-8340-54b0a2617059 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:29.754743 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-071a50ad-5b8e-4b3a-8340-54b0a2617059 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:29.770640 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-071a50ad-5b8e-4b3a-8340-54b0a2617059 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:29.773511 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-071a50ad-5b8e-4b3a-8340-54b0a2617059 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:29.775005 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-071a50ad-5b8e-4b3a-8340-54b0a2617059 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:29.776830 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-071a50ad-5b8e-4b3a-8340-54b0a2617059 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:29.777399 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-071a50ad-5b8e-4b3a-8340-54b0a2617059 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:29.777822 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-071a50ad-5b8e-4b3a-8340-54b0a2617059 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:30.096024 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6cbdbeba-8236-42d0-91a4-9519d586f10e tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6349b0ee9e2142a8a440d4e6ae0703a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33f8cd7d4424157b410b64c7823f480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:30.104223 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6cbdbeba-8236-42d0-91a4-9519d586f10e tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "GET /compute/v2.1/servers/2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881" status: 200 len: 1390 microversion: 2.1 time: 0.604804 Aug 31 15:50:30.104804 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 245/472] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:29 2022] GET /compute/v2.1/servers/2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881 => generated 1390 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:30.113653 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-20824c4f-e6cb-4dce-a929-8e502867fca8 tempest-QuotaClassesAdmin257Test-1623573150 tempest-QuotaClassesAdmin257Test-1623573150-project-admin] Action: 'update', calling method: .version_select at 0x7fbb46f38f70>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:50:30.139587 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-071a50ad-5b8e-4b3a-8340-54b0a2617059 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lazy-loading 'services' on Instance uuid a71c696b-bfa3-40cd-ba75-af485432d34f {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:50:30.171911 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-071a50ad-5b8e-4b3a-8340-54b0a2617059 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f" status: 200 len: 1931 microversion: 2.75 time: 0.429962 Aug 31 15:50:30.173406 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 228/473] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:50:29 2022] GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f => generated 1931 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:50:30.181526 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-af4292aa-3c5e-4b08-8902-4ccc97be95ce tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:30.182444 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-af4292aa-3c5e-4b08-8902-4ccc97be95ce tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: a5a21e54-e375-4370-9d9e-b41df3e5922e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:30.206029 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af4292aa-3c5e-4b08-8902-4ccc97be95ce tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:30.209236 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af4292aa-3c5e-4b08-8902-4ccc97be95ce tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:30.211333 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af4292aa-3c5e-4b08-8902-4ccc97be95ce tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:30.215242 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af4292aa-3c5e-4b08-8902-4ccc97be95ce tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:30.216673 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af4292aa-3c5e-4b08-8902-4ccc97be95ce tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:30.217613 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af4292aa-3c5e-4b08-8902-4ccc97be95ce tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:30.244596 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-20824c4f-e6cb-4dce-a929-8e502867fca8 tempest-QuotaClassesAdmin257Test-1623573150 tempest-QuotaClassesAdmin257Test-1623573150-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.138649 Aug 31 15:50:30.245195 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 246/474] 10.222.0.50 () {62 vars in 1247 bytes} [Wed Aug 31 15:50:30 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:50:30.713354 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-af4292aa-3c5e-4b08-8902-4ccc97be95ce tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:30.734259 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-af4292aa-3c5e-4b08-8902-4ccc97be95ce tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e" status: 200 len: 1312 microversion: 2.1 time: 0.559341 Aug 31 15:50:30.735207 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 229/475] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:30 2022] GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e => generated 1312 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:30.747151 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-916e193d-be75-45c4-844e-2461e4a99e1d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:30.749545 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-916e193d-be75-45c4-844e-2461e4a99e1d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: d15c3817-84b0-4e82-86b2-f2333ceeb3cd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:30.772167 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-916e193d-be75-45c4-844e-2461e4a99e1d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:30.772656 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-916e193d-be75-45c4-844e-2461e4a99e1d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:30.773086 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-916e193d-be75-45c4-844e-2461e4a99e1d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:30.773785 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-916e193d-be75-45c4-844e-2461e4a99e1d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:30.774261 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-916e193d-be75-45c4-844e-2461e4a99e1d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:30.781599 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-916e193d-be75-45c4-844e-2461e4a99e1d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:30.819919 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-baed372e-b343-482c-9a07-266e6c987ce1 tempest-ServicesAdminTestJSON-933561525 tempest-ServicesAdminTestJSON-933561525-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:30.823895 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-baed372e-b343-482c-9a07-266e6c987ce1 tempest-ServicesAdminTestJSON-933561525 tempest-ServicesAdminTestJSON-933561525-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:30.824989 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-baed372e-b343-482c-9a07-266e6c987ce1 tempest-ServicesAdminTestJSON-933561525 tempest-ServicesAdminTestJSON-933561525-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:30.825518 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-baed372e-b343-482c-9a07-266e6c987ce1 tempest-ServicesAdminTestJSON-933561525 tempest-ServicesAdminTestJSON-933561525-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:30.826496 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-baed372e-b343-482c-9a07-266e6c987ce1 tempest-ServicesAdminTestJSON-933561525 tempest-ServicesAdminTestJSON-933561525-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:30.827173 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-baed372e-b343-482c-9a07-266e6c987ce1 tempest-ServicesAdminTestJSON-933561525 tempest-ServicesAdminTestJSON-933561525-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:30.827703 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-baed372e-b343-482c-9a07-266e6c987ce1 tempest-ServicesAdminTestJSON-933561525 tempest-ServicesAdminTestJSON-933561525-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:30.857826 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-baed372e-b343-482c-9a07-266e6c987ce1 tempest-ServicesAdminTestJSON-933561525 tempest-ServicesAdminTestJSON-933561525-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.407685 Aug 31 15:50:30.866191 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 247/476] 10.222.0.50 () {58 vars in 1137 bytes} [Wed Aug 31 15:50:30 2022] GET /compute/v2.1/os-services => generated 949 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:50:30.875151 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b54e87a1-2109-4e80-a19e-191d415c27e9 tempest-ServicesAdminTestJSON-933561525 tempest-ServicesAdminTestJSON-933561525-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:30.879621 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b54e87a1-2109-4e80-a19e-191d415c27e9 tempest-ServicesAdminTestJSON-933561525 tempest-ServicesAdminTestJSON-933561525-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:30.880729 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b54e87a1-2109-4e80-a19e-191d415c27e9 tempest-ServicesAdminTestJSON-933561525 tempest-ServicesAdminTestJSON-933561525-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:30.882397 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b54e87a1-2109-4e80-a19e-191d415c27e9 tempest-ServicesAdminTestJSON-933561525 tempest-ServicesAdminTestJSON-933561525-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:30.883394 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b54e87a1-2109-4e80-a19e-191d415c27e9 tempest-ServicesAdminTestJSON-933561525 tempest-ServicesAdminTestJSON-933561525-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:30.884072 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b54e87a1-2109-4e80-a19e-191d415c27e9 tempest-ServicesAdminTestJSON-933561525 tempest-ServicesAdminTestJSON-933561525-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:30.885209 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b54e87a1-2109-4e80-a19e-191d415c27e9 tempest-ServicesAdminTestJSON-933561525 tempest-ServicesAdminTestJSON-933561525-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:30.915165 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b54e87a1-2109-4e80-a19e-191d415c27e9 tempest-ServicesAdminTestJSON-933561525 tempest-ServicesAdminTestJSON-933561525-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?host=n-d-833090-16" status: 200 len: 581 microversion: 2.1 time: 0.047779 Aug 31 15:50:30.916371 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 248/477] 10.222.0.50 () {58 vars in 1174 bytes} [Wed Aug 31 15:50:30 2022] GET /compute/v2.1/os-services?host=n-d-833090-16 => generated 581 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:50:30.931086 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2b00ed03-f965-45ba-9940-3e01a120685a tempest-ServicesAdminTestJSON-933561525 tempest-ServicesAdminTestJSON-933561525-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:30.939411 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b00ed03-f965-45ba-9940-3e01a120685a tempest-ServicesAdminTestJSON-933561525 tempest-ServicesAdminTestJSON-933561525-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:30.940263 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b00ed03-f965-45ba-9940-3e01a120685a tempest-ServicesAdminTestJSON-933561525 tempest-ServicesAdminTestJSON-933561525-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:30.941304 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b00ed03-f965-45ba-9940-3e01a120685a tempest-ServicesAdminTestJSON-933561525 tempest-ServicesAdminTestJSON-933561525-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:30.942288 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b00ed03-f965-45ba-9940-3e01a120685a tempest-ServicesAdminTestJSON-933561525 tempest-ServicesAdminTestJSON-933561525-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:30.943310 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b00ed03-f965-45ba-9940-3e01a120685a tempest-ServicesAdminTestJSON-933561525 tempest-ServicesAdminTestJSON-933561525-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:30.943929 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b00ed03-f965-45ba-9940-3e01a120685a tempest-ServicesAdminTestJSON-933561525 tempest-ServicesAdminTestJSON-933561525-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:30.985689 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2b00ed03-f965-45ba-9940-3e01a120685a tempest-ServicesAdminTestJSON-933561525 tempest-ServicesAdminTestJSON-933561525-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.055927 Aug 31 15:50:30.986433 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 249/478] 10.222.0.50 () {58 vars in 1176 bytes} [Wed Aug 31 15:50:30 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:50:31.000358 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e1f2a1a3-74d6-4bbb-96fe-ecfd3588eed4 tempest-ServicesAdminTestJSON-933561525 tempest-ServicesAdminTestJSON-933561525-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:31.005040 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-916e193d-be75-45c4-844e-2461e4a99e1d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:31.016122 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-916e193d-be75-45c4-844e-2461e4a99e1d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/d15c3817-84b0-4e82-86b2-f2333ceeb3cd" status: 200 len: 1276 microversion: 2.1 time: 0.277701 Aug 31 15:50:31.017441 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e1f2a1a3-74d6-4bbb-96fe-ecfd3588eed4 tempest-ServicesAdminTestJSON-933561525 tempest-ServicesAdminTestJSON-933561525-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:31.018705 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 230/479] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:30 2022] GET /compute/v2.1/servers/d15c3817-84b0-4e82-86b2-f2333ceeb3cd => generated 1276 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:31.019300 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e1f2a1a3-74d6-4bbb-96fe-ecfd3588eed4 tempest-ServicesAdminTestJSON-933561525 tempest-ServicesAdminTestJSON-933561525-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:31.019937 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e1f2a1a3-74d6-4bbb-96fe-ecfd3588eed4 tempest-ServicesAdminTestJSON-933561525 tempest-ServicesAdminTestJSON-933561525-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:31.021594 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e1f2a1a3-74d6-4bbb-96fe-ecfd3588eed4 tempest-ServicesAdminTestJSON-933561525 tempest-ServicesAdminTestJSON-933561525-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:31.022267 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e1f2a1a3-74d6-4bbb-96fe-ecfd3588eed4 tempest-ServicesAdminTestJSON-933561525 tempest-ServicesAdminTestJSON-933561525-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:31.022906 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e1f2a1a3-74d6-4bbb-96fe-ecfd3588eed4 tempest-ServicesAdminTestJSON-933561525 tempest-ServicesAdminTestJSON-933561525-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:31.052988 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e1f2a1a3-74d6-4bbb-96fe-ecfd3588eed4 tempest-ServicesAdminTestJSON-933561525 tempest-ServicesAdminTestJSON-933561525-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.056581 Aug 31 15:50:31.064234 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 250/480] 10.222.0.50 () {58 vars in 1137 bytes} [Wed Aug 31 15:50:30 2022] GET /compute/v2.1/os-services => generated 949 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:50:31.087349 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-d3a217d1-c2d5-4ea3-8b7c-2083a0861427 req-065bc426-3f9d-4798-98e3-2a07a93954ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881", "tag": "12f537b0-fb53-4252-b4e9-7a06b83e70f8"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:50:31.099116 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d3a217d1-c2d5-4ea3-8b7c-2083a0861427 req-065bc426-3f9d-4798-98e3-2a07a93954ae service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:31.104152 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d3a217d1-c2d5-4ea3-8b7c-2083a0861427 req-065bc426-3f9d-4798-98e3-2a07a93954ae service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:31.106832 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d3a217d1-c2d5-4ea3-8b7c-2083a0861427 req-065bc426-3f9d-4798-98e3-2a07a93954ae service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:31.125285 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6ab21b52-849a-495e-999f-d645e33c4848 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:31.125987 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6ab21b52-849a-495e-999f-d645e33c4848 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: 2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:31.137952 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6ab21b52-849a-495e-999f-d645e33c4848 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:31.142965 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-d3a217d1-c2d5-4ea3-8b7c-2083a0861427 req-065bc426-3f9d-4798-98e3-2a07a93954ae service nova] Creating event network-changed:12f537b0-fb53-4252-b4e9-7a06b83e70f8 for instance 2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881 on n-h2-833090-16 Aug 31 15:50:31.143747 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6ab21b52-849a-495e-999f-d645e33c4848 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:31.144279 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6ab21b52-849a-495e-999f-d645e33c4848 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:31.145109 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6ab21b52-849a-495e-999f-d645e33c4848 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:31.145673 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6ab21b52-849a-495e-999f-d645e33c4848 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:31.153484 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6ab21b52-849a-495e-999f-d645e33c4848 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:31.177771 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-d3a217d1-c2d5-4ea3-8b7c-2083a0861427 req-065bc426-3f9d-4798-98e3-2a07a93954ae service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094337 Aug 31 15:50:31.179979 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 231/481] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:50:31.205295 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-39922e9e-75b6-4b62-85d8-1fdcee1e132d tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:31.206115 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-39922e9e-75b6-4b62-85d8-1fdcee1e132d tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:31.220844 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39922e9e-75b6-4b62-85d8-1fdcee1e132d tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:31.221513 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39922e9e-75b6-4b62-85d8-1fdcee1e132d tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:31.222992 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39922e9e-75b6-4b62-85d8-1fdcee1e132d tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:31.224792 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39922e9e-75b6-4b62-85d8-1fdcee1e132d tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:31.225269 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39922e9e-75b6-4b62-85d8-1fdcee1e132d tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:31.225698 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39922e9e-75b6-4b62-85d8-1fdcee1e132d tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:31.685088 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-39922e9e-75b6-4b62-85d8-1fdcee1e132d tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lazy-loading 'services' on Instance uuid a71c696b-bfa3-40cd-ba75-af485432d34f {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:50:31.722443 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-39922e9e-75b6-4b62-85d8-1fdcee1e132d tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f" status: 200 len: 1931 microversion: 2.75 time: 0.517808 Aug 31 15:50:31.723492 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 232/482] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:50:31 2022] GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f => generated 1931 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:50:31.757078 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-586dc28a-cc17-4fe0-8dd0-13814fae68df tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:31.758370 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-586dc28a-cc17-4fe0-8dd0-13814fae68df tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: a5a21e54-e375-4370-9d9e-b41df3e5922e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:31.766856 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-586dc28a-cc17-4fe0-8dd0-13814fae68df tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:31.767842 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-586dc28a-cc17-4fe0-8dd0-13814fae68df tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:31.768459 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-586dc28a-cc17-4fe0-8dd0-13814fae68df tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:31.769771 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-586dc28a-cc17-4fe0-8dd0-13814fae68df tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:31.770842 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-586dc28a-cc17-4fe0-8dd0-13814fae68df tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:31.771632 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-586dc28a-cc17-4fe0-8dd0-13814fae68df tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:32.067062 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6ab21b52-849a-495e-999f-d645e33c4848 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6349b0ee9e2142a8a440d4e6ae0703a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33f8cd7d4424157b410b64c7823f480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:32.080859 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6ab21b52-849a-495e-999f-d645e33c4848 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "GET /compute/v2.1/servers/2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881" status: 200 len: 1390 microversion: 2.1 time: 0.959714 Aug 31 15:50:32.081949 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 251/483] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:31 2022] GET /compute/v2.1/servers/2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881 => generated 1390 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:32.087300 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-bda37107-5225-4f2c-bf66-f37526b21c4d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:32.088533 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-bda37107-5225-4f2c-bf66-f37526b21c4d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: d15c3817-84b0-4e82-86b2-f2333ceeb3cd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:32.109440 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bda37107-5225-4f2c-bf66-f37526b21c4d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:32.111071 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bda37107-5225-4f2c-bf66-f37526b21c4d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:32.111719 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bda37107-5225-4f2c-bf66-f37526b21c4d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:32.112936 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bda37107-5225-4f2c-bf66-f37526b21c4d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:32.113502 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bda37107-5225-4f2c-bf66-f37526b21c4d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:32.114247 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bda37107-5225-4f2c-bf66-f37526b21c4d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:32.159355 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-586dc28a-cc17-4fe0-8dd0-13814fae68df tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:32.170538 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-586dc28a-cc17-4fe0-8dd0-13814fae68df tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e" status: 200 len: 1312 microversion: 2.1 time: 0.416926 Aug 31 15:50:32.187023 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 233/484] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:31 2022] GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e => generated 1312 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:32.373821 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-bda37107-5225-4f2c-bf66-f37526b21c4d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:32.385569 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-bda37107-5225-4f2c-bf66-f37526b21c4d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/d15c3817-84b0-4e82-86b2-f2333ceeb3cd" status: 200 len: 1318 microversion: 2.1 time: 0.302250 Aug 31 15:50:32.388805 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 252/485] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:32 2022] GET /compute/v2.1/servers/d15c3817-84b0-4e82-86b2-f2333ceeb3cd => generated 1318 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:32.683750 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-23c51aba-513d-44d3-a524-08d5277bfb29 req-e200d2a5-2fa1-4bda-9f08-3c9b75897044 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19da7b68-c450-41e9-9a0b-135b8105b4d5", "tag": "49cad27c-0371-48ed-b8ca-95367001546e"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:50:32.705797 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-23c51aba-513d-44d3-a524-08d5277bfb29 req-e200d2a5-2fa1-4bda-9f08-3c9b75897044 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:32.707337 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-23c51aba-513d-44d3-a524-08d5277bfb29 req-e200d2a5-2fa1-4bda-9f08-3c9b75897044 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:32.709030 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-23c51aba-513d-44d3-a524-08d5277bfb29 req-e200d2a5-2fa1-4bda-9f08-3c9b75897044 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:32.745056 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-23c51aba-513d-44d3-a524-08d5277bfb29 req-e200d2a5-2fa1-4bda-9f08-3c9b75897044 service nova] Creating event network-changed:49cad27c-0371-48ed-b8ca-95367001546e for instance 19da7b68-c450-41e9-9a0b-135b8105b4d5 on n-h1-833090-16 Aug 31 15:50:32.753050 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f8186842-8e5a-4dd3-bff6-91feb931058b tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:32.754415 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f8186842-8e5a-4dd3-bff6-91feb931058b tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:32.779757 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f8186842-8e5a-4dd3-bff6-91feb931058b tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:32.780615 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f8186842-8e5a-4dd3-bff6-91feb931058b tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:32.786789 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f8186842-8e5a-4dd3-bff6-91feb931058b tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:32.788508 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f8186842-8e5a-4dd3-bff6-91feb931058b tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:32.789191 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-23c51aba-513d-44d3-a524-08d5277bfb29 req-e200d2a5-2fa1-4bda-9f08-3c9b75897044 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108577 Aug 31 15:50:32.790908 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 234/486] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:50:32.791399 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f8186842-8e5a-4dd3-bff6-91feb931058b tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:32.795511 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f8186842-8e5a-4dd3-bff6-91feb931058b tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:33.006581 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-f8186842-8e5a-4dd3-bff6-91feb931058b tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lazy-loading 'services' on Instance uuid a71c696b-bfa3-40cd-ba75-af485432d34f {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:50:33.051722 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f8186842-8e5a-4dd3-bff6-91feb931058b tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f" status: 200 len: 1931 microversion: 2.75 time: 0.302910 Aug 31 15:50:33.055120 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 253/487] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:50:32 2022] GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f => generated 1931 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:50:33.106839 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b1b4e1b8-5df6-4bb4-a75a-f322af82aa4a tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:33.108993 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b1b4e1b8-5df6-4bb4-a75a-f322af82aa4a tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: 2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:33.128517 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1b4e1b8-5df6-4bb4-a75a-f322af82aa4a tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:33.131365 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1b4e1b8-5df6-4bb4-a75a-f322af82aa4a tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:33.132141 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1b4e1b8-5df6-4bb4-a75a-f322af82aa4a tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:33.134329 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1b4e1b8-5df6-4bb4-a75a-f322af82aa4a tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:33.135582 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1b4e1b8-5df6-4bb4-a75a-f322af82aa4a tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:33.138037 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1b4e1b8-5df6-4bb4-a75a-f322af82aa4a tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:33.193160 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7595f756-468b-4d73-8d6a-46a9b2013461 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:33.194336 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7595f756-468b-4d73-8d6a-46a9b2013461 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: a5a21e54-e375-4370-9d9e-b41df3e5922e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:33.202944 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7595f756-468b-4d73-8d6a-46a9b2013461 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:33.203632 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7595f756-468b-4d73-8d6a-46a9b2013461 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:33.205692 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7595f756-468b-4d73-8d6a-46a9b2013461 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:33.210396 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7595f756-468b-4d73-8d6a-46a9b2013461 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:33.218862 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7595f756-468b-4d73-8d6a-46a9b2013461 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:33.220647 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7595f756-468b-4d73-8d6a-46a9b2013461 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:34.101648 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7595f756-468b-4d73-8d6a-46a9b2013461 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:34.114730 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7595f756-468b-4d73-8d6a-46a9b2013461 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e" status: 200 len: 1312 microversion: 2.1 time: 0.925239 Aug 31 15:50:34.116538 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 254/488] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:33 2022] GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e => generated 1312 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:50:34.126026 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a26e6f63-83aa-48b3-aa4e-3ef4c93c25bc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:34.128671 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a26e6f63-83aa-48b3-aa4e-3ef4c93c25bc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: d15c3817-84b0-4e82-86b2-f2333ceeb3cd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:34.155651 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a26e6f63-83aa-48b3-aa4e-3ef4c93c25bc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:34.156458 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a26e6f63-83aa-48b3-aa4e-3ef4c93c25bc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:34.156601 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a26e6f63-83aa-48b3-aa4e-3ef4c93c25bc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:34.157305 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a26e6f63-83aa-48b3-aa4e-3ef4c93c25bc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:34.157703 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a26e6f63-83aa-48b3-aa4e-3ef4c93c25bc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:34.158132 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a26e6f63-83aa-48b3-aa4e-3ef4c93c25bc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:34.197715 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b1b4e1b8-5df6-4bb4-a75a-f322af82aa4a tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6349b0ee9e2142a8a440d4e6ae0703a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33f8cd7d4424157b410b64c7823f480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:34.218394 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b1b4e1b8-5df6-4bb4-a75a-f322af82aa4a tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "GET /compute/v2.1/servers/2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881" status: 200 len: 1390 microversion: 2.1 time: 1.118057 Aug 31 15:50:34.221522 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 235/489] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:33 2022] GET /compute/v2.1/servers/2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881 => generated 1390 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:34.243582 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f1833c4c-8057-4df3-80a4-e3b829e7204a tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:34.244768 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f1833c4c-8057-4df3-80a4-e3b829e7204a tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:34.257628 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f1833c4c-8057-4df3-80a4-e3b829e7204a tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:34.258398 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f1833c4c-8057-4df3-80a4-e3b829e7204a tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:34.259713 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f1833c4c-8057-4df3-80a4-e3b829e7204a tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:34.262421 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f1833c4c-8057-4df3-80a4-e3b829e7204a tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:34.263578 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f1833c4c-8057-4df3-80a4-e3b829e7204a tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:34.264307 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f1833c4c-8057-4df3-80a4-e3b829e7204a tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:34.646911 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-f1833c4c-8057-4df3-80a4-e3b829e7204a tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lazy-loading 'services' on Instance uuid a71c696b-bfa3-40cd-ba75-af485432d34f {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:50:34.667363 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f1833c4c-8057-4df3-80a4-e3b829e7204a tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f" status: 200 len: 1931 microversion: 2.75 time: 0.443822 Aug 31 15:50:34.668961 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 236/490] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:50:34 2022] GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f => generated 1931 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:50:34.832418 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a26e6f63-83aa-48b3-aa4e-3ef4c93c25bc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:34.860023 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a26e6f63-83aa-48b3-aa4e-3ef4c93c25bc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/d15c3817-84b0-4e82-86b2-f2333ceeb3cd" status: 200 len: 1318 microversion: 2.1 time: 0.739693 Aug 31 15:50:34.862738 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 255/491] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:34 2022] GET /compute/v2.1/servers/d15c3817-84b0-4e82-86b2-f2333ceeb3cd => generated 1318 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:35.137937 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-193fd026-c007-422c-8a5a-178f0d5255b3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:35.139082 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-193fd026-c007-422c-8a5a-178f0d5255b3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: a5a21e54-e375-4370-9d9e-b41df3e5922e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:35.150374 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-193fd026-c007-422c-8a5a-178f0d5255b3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:35.151092 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-193fd026-c007-422c-8a5a-178f0d5255b3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:35.151722 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-193fd026-c007-422c-8a5a-178f0d5255b3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:35.153655 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-193fd026-c007-422c-8a5a-178f0d5255b3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:35.157718 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-193fd026-c007-422c-8a5a-178f0d5255b3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:35.158557 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-193fd026-c007-422c-8a5a-178f0d5255b3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:35.216783 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=14 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:50:35.242790 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-db100d3d-1211-4d32-aaf5-8aef5c8b637d tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:35.243652 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-db100d3d-1211-4d32-aaf5-8aef5c8b637d tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: 2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:35.261714 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db100d3d-1211-4d32-aaf5-8aef5c8b637d tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:35.262545 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db100d3d-1211-4d32-aaf5-8aef5c8b637d tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:35.264040 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db100d3d-1211-4d32-aaf5-8aef5c8b637d tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:35.267452 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db100d3d-1211-4d32-aaf5-8aef5c8b637d tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:35.269070 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db100d3d-1211-4d32-aaf5-8aef5c8b637d tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:35.271391 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db100d3d-1211-4d32-aaf5-8aef5c8b637d tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:35.778003 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-193fd026-c007-422c-8a5a-178f0d5255b3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:35.803948 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-193fd026-c007-422c-8a5a-178f0d5255b3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e" status: 200 len: 1312 microversion: 2.1 time: 0.670670 Aug 31 15:50:35.817959 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-db100d3d-1211-4d32-aaf5-8aef5c8b637d tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6349b0ee9e2142a8a440d4e6ae0703a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33f8cd7d4424157b410b64c7823f480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:35.817959 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-db100d3d-1211-4d32-aaf5-8aef5c8b637d tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "GET /compute/v2.1/servers/2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881" status: 200 len: 1390 microversion: 2.1 time: 0.579153 Aug 31 15:50:35.820089 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 237/492] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:35 2022] GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e => generated 1312 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:35.829001 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 256/493] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:35 2022] GET /compute/v2.1/servers/2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881 => generated 1390 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:35.831308 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b1f951f6-79be-4837-be93-7d650e98fd64 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:35.833691 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b1f951f6-79be-4837-be93-7d650e98fd64 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:35.842586 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-05cd799f-b985-4e05-a29b-e291403b6bc4 req-fae2d7ad-eba5-4a41-88a8-58b74362877c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d15c3817-84b0-4e82-86b2-f2333ceeb3cd", "tag": "ee06d5e0-f1bc-4c73-8b29-4e8c0b5df323"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:50:35.846339 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1f951f6-79be-4837-be93-7d650e98fd64 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:35.849167 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1f951f6-79be-4837-be93-7d650e98fd64 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:35.852831 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1f951f6-79be-4837-be93-7d650e98fd64 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:35.853667 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1f951f6-79be-4837-be93-7d650e98fd64 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:35.854242 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1f951f6-79be-4837-be93-7d650e98fd64 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:35.854727 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1f951f6-79be-4837-be93-7d650e98fd64 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:35.868478 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-05cd799f-b985-4e05-a29b-e291403b6bc4 req-fae2d7ad-eba5-4a41-88a8-58b74362877c service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:35.868961 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-05cd799f-b985-4e05-a29b-e291403b6bc4 req-fae2d7ad-eba5-4a41-88a8-58b74362877c service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:35.869389 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-05cd799f-b985-4e05-a29b-e291403b6bc4 req-fae2d7ad-eba5-4a41-88a8-58b74362877c service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:35.891230 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-05cd799f-b985-4e05-a29b-e291403b6bc4 req-fae2d7ad-eba5-4a41-88a8-58b74362877c service nova] Creating event network-changed:ee06d5e0-f1bc-4c73-8b29-4e8c0b5df323 for instance d15c3817-84b0-4e82-86b2-f2333ceeb3cd on n-h2-833090-16 Aug 31 15:50:35.897145 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-05cd799f-b985-4e05-a29b-e291403b6bc4 req-fae2d7ad-eba5-4a41-88a8-58b74362877c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074989 Aug 31 15:50:35.897916 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 238/494] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:50:35.907261 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3ad2afbf-f5ee-420c-87f9-229c9f45c949 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:35.908250 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3ad2afbf-f5ee-420c-87f9-229c9f45c949 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: d15c3817-84b0-4e82-86b2-f2333ceeb3cd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:35.919183 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ad2afbf-f5ee-420c-87f9-229c9f45c949 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:35.919926 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ad2afbf-f5ee-420c-87f9-229c9f45c949 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:35.920539 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ad2afbf-f5ee-420c-87f9-229c9f45c949 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:35.921592 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ad2afbf-f5ee-420c-87f9-229c9f45c949 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:35.922481 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ad2afbf-f5ee-420c-87f9-229c9f45c949 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:35.923060 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ad2afbf-f5ee-420c-87f9-229c9f45c949 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:36.119749 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-b1f951f6-79be-4837-be93-7d650e98fd64 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lazy-loading 'services' on Instance uuid a71c696b-bfa3-40cd-ba75-af485432d34f {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:50:36.152049 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b1f951f6-79be-4837-be93-7d650e98fd64 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f" status: 200 len: 1931 microversion: 2.75 time: 0.328391 Aug 31 15:50:36.174277 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 257/495] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:50:35 2022] GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f => generated 1931 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:50:36.506118 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3ad2afbf-f5ee-420c-87f9-229c9f45c949 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:36.518005 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3ad2afbf-f5ee-420c-87f9-229c9f45c949 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/d15c3817-84b0-4e82-86b2-f2333ceeb3cd" status: 200 len: 1318 microversion: 2.1 time: 0.617867 Aug 31 15:50:36.518634 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 239/496] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:35 2022] GET /compute/v2.1/servers/d15c3817-84b0-4e82-86b2-f2333ceeb3cd => generated 1318 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:36.826459 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-79ecafe3-cff9-4721-8040-1137b9d497a1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:36.827089 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-79ecafe3-cff9-4721-8040-1137b9d497a1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: a5a21e54-e375-4370-9d9e-b41df3e5922e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:36.847995 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e8e506d5-2997-479c-8d0b-70411f2b02b9 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:36.849454 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e8e506d5-2997-479c-8d0b-70411f2b02b9 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: 2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:36.858488 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-79ecafe3-cff9-4721-8040-1137b9d497a1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:36.859080 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-79ecafe3-cff9-4721-8040-1137b9d497a1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:36.859382 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-79ecafe3-cff9-4721-8040-1137b9d497a1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:36.860260 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-79ecafe3-cff9-4721-8040-1137b9d497a1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:36.860843 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-79ecafe3-cff9-4721-8040-1137b9d497a1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:36.861406 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-79ecafe3-cff9-4721-8040-1137b9d497a1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:36.861899 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8e506d5-2997-479c-8d0b-70411f2b02b9 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:36.862964 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8e506d5-2997-479c-8d0b-70411f2b02b9 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:36.865137 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8e506d5-2997-479c-8d0b-70411f2b02b9 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:36.866235 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8e506d5-2997-479c-8d0b-70411f2b02b9 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:36.867388 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8e506d5-2997-479c-8d0b-70411f2b02b9 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:36.867984 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8e506d5-2997-479c-8d0b-70411f2b02b9 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:37.229797 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-79ecafe3-cff9-4721-8040-1137b9d497a1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:37.240230 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-79ecafe3-cff9-4721-8040-1137b9d497a1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e" status: 200 len: 1312 microversion: 2.1 time: 0.418455 Aug 31 15:50:37.240831 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 258/497] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:36 2022] GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e => generated 1312 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:37.282810 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e8e506d5-2997-479c-8d0b-70411f2b02b9 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6349b0ee9e2142a8a440d4e6ae0703a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33f8cd7d4424157b410b64c7823f480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:37.294565 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e8e506d5-2997-479c-8d0b-70411f2b02b9 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "GET /compute/v2.1/servers/2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881" status: 200 len: 1390 microversion: 2.1 time: 0.449987 Aug 31 15:50:37.298201 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 240/498] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:36 2022] GET /compute/v2.1/servers/2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881 => generated 1390 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:37.311399 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d5d81061-431e-4eb7-a8fc-3bcd41a3e43d tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:37.312415 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d5d81061-431e-4eb7-a8fc-3bcd41a3e43d tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:37.318980 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5d81061-431e-4eb7-a8fc-3bcd41a3e43d tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:37.319827 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5d81061-431e-4eb7-a8fc-3bcd41a3e43d tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:37.320469 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5d81061-431e-4eb7-a8fc-3bcd41a3e43d tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:37.321577 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5d81061-431e-4eb7-a8fc-3bcd41a3e43d tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:37.322271 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5d81061-431e-4eb7-a8fc-3bcd41a3e43d tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:37.322905 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5d81061-431e-4eb7-a8fc-3bcd41a3e43d tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:37.411246 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-d5d81061-431e-4eb7-a8fc-3bcd41a3e43d tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lazy-loading 'services' on Instance uuid a71c696b-bfa3-40cd-ba75-af485432d34f {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:50:37.442150 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d5d81061-431e-4eb7-a8fc-3bcd41a3e43d tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f" status: 200 len: 1931 microversion: 2.75 time: 0.141718 Aug 31 15:50:37.443045 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 241/499] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:50:37 2022] GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f => generated 1931 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:50:37.542461 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-df96f8c5-d369-4711-b729-444f83c1eb82 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:37.544033 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-df96f8c5-d369-4711-b729-444f83c1eb82 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: d15c3817-84b0-4e82-86b2-f2333ceeb3cd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:37.559243 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df96f8c5-d369-4711-b729-444f83c1eb82 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:37.559953 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7991f843-e7cf-47d2-be26-26bf244ef898 tempest-ServicesAdminNegativeTestJSON-1709106105 tempest-ServicesAdminNegativeTestJSON-1709106105-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:37.564005 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df96f8c5-d369-4711-b729-444f83c1eb82 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:37.564249 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7991f843-e7cf-47d2-be26-26bf244ef898 tempest-ServicesAdminNegativeTestJSON-1709106105 tempest-ServicesAdminNegativeTestJSON-1709106105-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:37.564761 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df96f8c5-d369-4711-b729-444f83c1eb82 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:37.565470 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7991f843-e7cf-47d2-be26-26bf244ef898 tempest-ServicesAdminNegativeTestJSON-1709106105 tempest-ServicesAdminNegativeTestJSON-1709106105-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:37.566056 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7991f843-e7cf-47d2-be26-26bf244ef898 tempest-ServicesAdminNegativeTestJSON-1709106105 tempest-ServicesAdminNegativeTestJSON-1709106105-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:37.567031 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7991f843-e7cf-47d2-be26-26bf244ef898 tempest-ServicesAdminNegativeTestJSON-1709106105 tempest-ServicesAdminNegativeTestJSON-1709106105-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:37.567788 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7991f843-e7cf-47d2-be26-26bf244ef898 tempest-ServicesAdminNegativeTestJSON-1709106105 tempest-ServicesAdminNegativeTestJSON-1709106105-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:37.568202 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7991f843-e7cf-47d2-be26-26bf244ef898 tempest-ServicesAdminNegativeTestJSON-1709106105 tempest-ServicesAdminNegativeTestJSON-1709106105-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:37.570722 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df96f8c5-d369-4711-b729-444f83c1eb82 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:37.573942 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df96f8c5-d369-4711-b729-444f83c1eb82 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:37.574536 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df96f8c5-d369-4711-b729-444f83c1eb82 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:37.603929 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7991f843-e7cf-47d2-be26-26bf244ef898 tempest-ServicesAdminNegativeTestJSON-1709106105 tempest-ServicesAdminNegativeTestJSON-1709106105-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.362060 Aug 31 15:50:37.615700 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 259/500] 10.222.0.50 () {58 vars in 1137 bytes} [Wed Aug 31 15:50:37 2022] GET /compute/v2.1/os-services => generated 949 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:50:37.636522 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a5724d96-be2a-4242-a293-78c5b9aecb57 tempest-ServicesAdminNegativeTestJSON-1709106105 tempest-ServicesAdminNegativeTestJSON-1709106105-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:37.645080 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5724d96-be2a-4242-a293-78c5b9aecb57 tempest-ServicesAdminNegativeTestJSON-1709106105 tempest-ServicesAdminNegativeTestJSON-1709106105-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:37.646668 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5724d96-be2a-4242-a293-78c5b9aecb57 tempest-ServicesAdminNegativeTestJSON-1709106105 tempest-ServicesAdminNegativeTestJSON-1709106105-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:37.648198 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5724d96-be2a-4242-a293-78c5b9aecb57 tempest-ServicesAdminNegativeTestJSON-1709106105 tempest-ServicesAdminNegativeTestJSON-1709106105-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:37.649494 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5724d96-be2a-4242-a293-78c5b9aecb57 tempest-ServicesAdminNegativeTestJSON-1709106105 tempest-ServicesAdminNegativeTestJSON-1709106105-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:37.650810 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5724d96-be2a-4242-a293-78c5b9aecb57 tempest-ServicesAdminNegativeTestJSON-1709106105 tempest-ServicesAdminNegativeTestJSON-1709106105-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:37.651446 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5724d96-be2a-4242-a293-78c5b9aecb57 tempest-ServicesAdminNegativeTestJSON-1709106105 tempest-ServicesAdminNegativeTestJSON-1709106105-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:37.687291 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a5724d96-be2a-4242-a293-78c5b9aecb57 tempest-ServicesAdminNegativeTestJSON-1709106105 tempest-ServicesAdminNegativeTestJSON-1709106105-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.062631 Aug 31 15:50:37.689341 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 260/501] 10.222.0.50 () {58 vars in 1170 bytes} [Wed Aug 31 15:50:37 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 949 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:50:37.709119 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-27970e89-e584-4b46-95f4-e6f30206f720 tempest-ServicesAdminNegativeTestJSON-1709106105 tempest-ServicesAdminNegativeTestJSON-1709106105-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:37.719746 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-27970e89-e584-4b46-95f4-e6f30206f720 tempest-ServicesAdminNegativeTestJSON-1709106105 tempest-ServicesAdminNegativeTestJSON-1709106105-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:37.720229 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-27970e89-e584-4b46-95f4-e6f30206f720 tempest-ServicesAdminNegativeTestJSON-1709106105 tempest-ServicesAdminNegativeTestJSON-1709106105-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:37.721799 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-27970e89-e584-4b46-95f4-e6f30206f720 tempest-ServicesAdminNegativeTestJSON-1709106105 tempest-ServicesAdminNegativeTestJSON-1709106105-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:37.725012 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-27970e89-e584-4b46-95f4-e6f30206f720 tempest-ServicesAdminNegativeTestJSON-1709106105 tempest-ServicesAdminNegativeTestJSON-1709106105-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:37.725485 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-27970e89-e584-4b46-95f4-e6f30206f720 tempest-ServicesAdminNegativeTestJSON-1709106105 tempest-ServicesAdminNegativeTestJSON-1709106105-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:37.725905 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-27970e89-e584-4b46-95f4-e6f30206f720 tempest-ServicesAdminNegativeTestJSON-1709106105 tempest-ServicesAdminNegativeTestJSON-1709106105-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:37.766321 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-27970e89-e584-4b46-95f4-e6f30206f720 tempest-ServicesAdminNegativeTestJSON-1709106105 tempest-ServicesAdminNegativeTestJSON-1709106105-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.067917 Aug 31 15:50:37.767039 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 261/502] 10.222.0.50 () {58 vars in 1137 bytes} [Wed Aug 31 15:50:37 2022] GET /compute/v2.1/os-services => generated 949 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:50:37.892274 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-df96f8c5-d369-4711-b729-444f83c1eb82 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:37.902470 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-df96f8c5-d369-4711-b729-444f83c1eb82 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/d15c3817-84b0-4e82-86b2-f2333ceeb3cd" status: 200 len: 1318 microversion: 2.1 time: 0.364876 Aug 31 15:50:37.903226 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 242/503] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:37 2022] GET /compute/v2.1/servers/d15c3817-84b0-4e82-86b2-f2333ceeb3cd => generated 1318 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:50:37.910802 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7935ac35-b2da-4721-8781-4f4356db8b8b tempest-ServicesAdminNegativeTestJSON-1709106105 tempest-ServicesAdminNegativeTestJSON-1709106105-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:37.924749 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7935ac35-b2da-4721-8781-4f4356db8b8b tempest-ServicesAdminNegativeTestJSON-1709106105 tempest-ServicesAdminNegativeTestJSON-1709106105-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:37.925473 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7935ac35-b2da-4721-8781-4f4356db8b8b tempest-ServicesAdminNegativeTestJSON-1709106105 tempest-ServicesAdminNegativeTestJSON-1709106105-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:37.926058 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7935ac35-b2da-4721-8781-4f4356db8b8b tempest-ServicesAdminNegativeTestJSON-1709106105 tempest-ServicesAdminNegativeTestJSON-1709106105-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:37.931328 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7935ac35-b2da-4721-8781-4f4356db8b8b tempest-ServicesAdminNegativeTestJSON-1709106105 tempest-ServicesAdminNegativeTestJSON-1709106105-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:37.932105 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7935ac35-b2da-4721-8781-4f4356db8b8b tempest-ServicesAdminNegativeTestJSON-1709106105 tempest-ServicesAdminNegativeTestJSON-1709106105-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:37.932700 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7935ac35-b2da-4721-8781-4f4356db8b8b tempest-ServicesAdminNegativeTestJSON-1709106105 tempest-ServicesAdminNegativeTestJSON-1709106105-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:37.968557 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7935ac35-b2da-4721-8781-4f4356db8b8b tempest-ServicesAdminNegativeTestJSON-1709106105 tempest-ServicesAdminNegativeTestJSON-1709106105-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?host=n-d-833090-16&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.061161 Aug 31 15:50:37.969184 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 243/504] 10.222.0.50 () {58 vars in 1196 bytes} [Wed Aug 31 15:50:37 2022] GET /compute/v2.1/os-services?host=n-d-833090-16&binary=xxx => generated 16 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 15:50:37.980689 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-95a094e6-fece-4d86-936a-ae63783a6a55 tempest-ServicesAdminNegativeTestJSON-1709106105 tempest-ServicesAdminNegativeTestJSON-1709106105-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:37.987649 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95a094e6-fece-4d86-936a-ae63783a6a55 tempest-ServicesAdminNegativeTestJSON-1709106105 tempest-ServicesAdminNegativeTestJSON-1709106105-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:37.988132 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95a094e6-fece-4d86-936a-ae63783a6a55 tempest-ServicesAdminNegativeTestJSON-1709106105 tempest-ServicesAdminNegativeTestJSON-1709106105-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:37.988561 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95a094e6-fece-4d86-936a-ae63783a6a55 tempest-ServicesAdminNegativeTestJSON-1709106105 tempest-ServicesAdminNegativeTestJSON-1709106105-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:37.989287 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95a094e6-fece-4d86-936a-ae63783a6a55 tempest-ServicesAdminNegativeTestJSON-1709106105 tempest-ServicesAdminNegativeTestJSON-1709106105-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:37.989740 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95a094e6-fece-4d86-936a-ae63783a6a55 tempest-ServicesAdminNegativeTestJSON-1709106105 tempest-ServicesAdminNegativeTestJSON-1709106105-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:37.990183 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95a094e6-fece-4d86-936a-ae63783a6a55 tempest-ServicesAdminNegativeTestJSON-1709106105 tempest-ServicesAdminNegativeTestJSON-1709106105-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:37.991561 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d90fe880-7551-4533-b338-9d3544768145 tempest-QuotasAdminNegativeTest-1045278505 tempest-QuotasAdminNegativeTest-1045278505-project-admin] Calling method '.version_select at 0x7fbb46e6b790>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:38.016846 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-95a094e6-fece-4d86-936a-ae63783a6a55 tempest-ServicesAdminNegativeTestJSON-1709106105 tempest-ServicesAdminNegativeTestJSON-1709106105-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.039808 Aug 31 15:50:38.018375 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 244/505] 10.222.0.50 () {58 vars in 1137 bytes} [Wed Aug 31 15:50:37 2022] GET /compute/v2.1/os-services => generated 949 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:50:38.031954 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-400a9840-6fae-4f0f-ad5a-f85ff4c30fa5 tempest-ServicesAdminNegativeTestJSON-1709106105 tempest-ServicesAdminNegativeTestJSON-1709106105-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:38.036028 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-400a9840-6fae-4f0f-ad5a-f85ff4c30fa5 tempest-ServicesAdminNegativeTestJSON-1709106105 tempest-ServicesAdminNegativeTestJSON-1709106105-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:38.036710 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-400a9840-6fae-4f0f-ad5a-f85ff4c30fa5 tempest-ServicesAdminNegativeTestJSON-1709106105 tempest-ServicesAdminNegativeTestJSON-1709106105-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:38.043169 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-400a9840-6fae-4f0f-ad5a-f85ff4c30fa5 tempest-ServicesAdminNegativeTestJSON-1709106105 tempest-ServicesAdminNegativeTestJSON-1709106105-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:38.044468 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-400a9840-6fae-4f0f-ad5a-f85ff4c30fa5 tempest-ServicesAdminNegativeTestJSON-1709106105 tempest-ServicesAdminNegativeTestJSON-1709106105-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:38.044939 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-400a9840-6fae-4f0f-ad5a-f85ff4c30fa5 tempest-ServicesAdminNegativeTestJSON-1709106105 tempest-ServicesAdminNegativeTestJSON-1709106105-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:38.045365 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-400a9840-6fae-4f0f-ad5a-f85ff4c30fa5 tempest-ServicesAdminNegativeTestJSON-1709106105 tempest-ServicesAdminNegativeTestJSON-1709106105-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:38.080845 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-400a9840-6fae-4f0f-ad5a-f85ff4c30fa5 tempest-ServicesAdminNegativeTestJSON-1709106105 tempest-ServicesAdminNegativeTestJSON-1709106105-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.054331 Aug 31 15:50:38.082228 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 245/506] 10.222.0.50 () {58 vars in 1198 bytes} [Wed Aug 31 15:50:38 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 15:50:38.123674 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=14,nova_api:INSERT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:50:38.129739 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d90fe880-7551-4533-b338-9d3544768145 tempest-QuotasAdminNegativeTest-1045278505 tempest-QuotasAdminNegativeTest-1045278505-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/ea31993d047a47cbb29989795af508ad" status: 200 len: 371 microversion: 2.1 time: 0.358366 Aug 31 15:50:38.140106 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 262/507] 10.222.0.50 () {58 vars in 1242 bytes} [Wed Aug 31 15:50:37 2022] GET /compute/v2.1/os-quota-sets/ea31993d047a47cbb29989795af508ad => generated 371 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:50:38.156489 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-76ea8d12-e1b3-49a2-a498-24b1870a7835 tempest-QuotasAdminNegativeTest-1045278505 tempest-QuotasAdminNegativeTest-1045278505-project-admin] Action: 'update', calling method: .version_select at 0x7fbb46e08f70>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:50:38.267198 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76ea8d12-e1b3-49a2-a498-24b1870a7835 tempest-QuotasAdminNegativeTest-1045278505 tempest-QuotasAdminNegativeTest-1045278505-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:38.267691 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76ea8d12-e1b3-49a2-a498-24b1870a7835 tempest-QuotasAdminNegativeTest-1045278505 tempest-QuotasAdminNegativeTest-1045278505-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:38.268116 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76ea8d12-e1b3-49a2-a498-24b1870a7835 tempest-QuotasAdminNegativeTest-1045278505 tempest-QuotasAdminNegativeTest-1045278505-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:38.268991 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76ea8d12-e1b3-49a2-a498-24b1870a7835 tempest-QuotasAdminNegativeTest-1045278505 tempest-QuotasAdminNegativeTest-1045278505-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:38.269270 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-82b3663c-8fae-4b10-a8a8-983d937c63f3 tempest-ServicesAdminNegativeTestJSON-984753155 tempest-ServicesAdminNegativeTestJSON-984753155-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:38.269444 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76ea8d12-e1b3-49a2-a498-24b1870a7835 tempest-QuotasAdminNegativeTest-1045278505 tempest-QuotasAdminNegativeTest-1045278505-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:38.270259 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76ea8d12-e1b3-49a2-a498-24b1870a7835 tempest-QuotasAdminNegativeTest-1045278505 tempest-QuotasAdminNegativeTest-1045278505-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:38.272829 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-82b3663c-8fae-4b10-a8a8-983d937c63f3 tempest-ServicesAdminNegativeTestJSON-984753155 tempest-ServicesAdminNegativeTestJSON-984753155-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '9206719bcb774cd888fcde257bc882a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4431537380ea4fa1a280794f7180d6b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:38.277526 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-82b3663c-8fae-4b10-a8a8-983d937c63f3 tempest-ServicesAdminNegativeTestJSON-984753155 tempest-ServicesAdminNegativeTestJSON-984753155-project] Request method failure captured: Aug 31 15:50:38.277526 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 31 15:50:38.277526 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:50:38.277526 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:50:38.277526 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:50:38.277526 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:50:38.277526 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:50:38.277526 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:50:38.277526 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:50:38.277526 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:50:38.277526 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4NLakxEPj8lFHkcohlLWlPlxC4vyNT9WOXoHXMPV0LeaAQKpKoK_6UEsLcm-UPdXy-i8IvYC3h4F4Lpv4wNCb6aDljk-ojf2SVHxnNXzZyybaxudCLyP5anA7LtDFE8pu2cWz7dI873PeU1v_QGhpKfCx85qJJYUBEs1k9NuJHGMSk Aug 31 15:50:38.277526 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:50:38.277526 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:50:38.277526 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:50:38.277526 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:50:38.277526 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:50:38.277526 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:50:38.277526 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 4431537380ea4fa1a280794f7180d6b7 Aug 31 15:50:38.277526 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-984753155 Aug 31 15:50:38.277526 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:50:38.277526 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:50:38.279244 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4431537380ea4fa1a280794f7180d6b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4431537380ea4fa1a280794f7180d6b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4431537380ea4fa1a280794f7180d6b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4431537380ea4fa1a280794f7180d6b7", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:50:38.279244 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-984753155 Aug 31 15:50:38.279244 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 4431537380ea4fa1a280794f7180d6b7 Aug 31 15:50:38.279244 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-984753155 Aug 31 15:50:38.279244 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServicesAdminNegativeTestJSON-984753155-project Aug 31 15:50:38.279244 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:50:38.279244 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:50:38.279244 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 9206719bcb774cd888fcde257bc882a4 Aug 31 15:50:38.279244 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-984753155-project Aug 31 15:50:38.279244 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 15:50:38.279244 n-d-833090-16 devstack@n-api.service[128863]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 31 15:50:38.279244 n-d-833090-16 devstack@n-api.service[128863]: action_args: {} Aug 31 15:50:38.280221 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:50:38.280221 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:38.280221 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:50:38.280221 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:50:38.280221 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:50:38.280221 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:50:38.280221 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 15:50:38.280221 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:50:38.280221 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 15:50:38.280221 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:50:38.280221 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:50:38.280221 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:50:38.280221 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Aug 31 15:50:38.280221 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 31 15:50:38.280221 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 15:50:38.280221 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 15:50:38.280221 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 15:50:38.280221 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 15:50:38.280221 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:50:38.281579 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:50:38.281579 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:50:38.281579 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:50:38.281579 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 15:50:38.281579 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 15:50:38.281579 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 15:50:38.281579 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 15:50:38.281579 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 15:50:38.281579 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 15:50:38.281579 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 31 15:50:38.281579 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:50:38.281579 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:50:38.281579 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:50:38.281579 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:38.281579 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:50:38.281579 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:50:38.281579 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 15:50:38.281579 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 15:50:38.281579 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 31 15:50:38.281579 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:50:38.286234 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-82b3663c-8fae-4b10-a8a8-983d937c63f3 tempest-ServicesAdminNegativeTestJSON-984753155 tempest-ServicesAdminNegativeTestJSON-984753155-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:50:38.287278 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-82b3663c-8fae-4b10-a8a8-983d937c63f3 tempest-ServicesAdminNegativeTestJSON-984753155 tempest-ServicesAdminNegativeTestJSON-984753155-project] 10.222.0.50 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.195563 Aug 31 15:50:38.289671 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 246/508] 10.222.0.50 () {58 vars in 1137 bytes} [Wed Aug 31 15:50:38 2022] GET /compute/v2.1/os-services => generated 112 bytes in 199 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:50:38.304482 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2a9fe343-490f-4324-9dde-f611cb5a6c21 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:38.305108 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2a9fe343-490f-4324-9dde-f611cb5a6c21 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: a5a21e54-e375-4370-9d9e-b41df3e5922e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:38.322491 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a9fe343-490f-4324-9dde-f611cb5a6c21 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:38.322996 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a9fe343-490f-4324-9dde-f611cb5a6c21 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:38.325104 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a9fe343-490f-4324-9dde-f611cb5a6c21 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:38.326555 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a9fe343-490f-4324-9dde-f611cb5a6c21 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:38.327195 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a9fe343-490f-4324-9dde-f611cb5a6c21 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:38.327873 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a9fe343-490f-4324-9dde-f611cb5a6c21 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:38.401906 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-76ea8d12-e1b3-49a2-a498-24b1870a7835 tempest-QuotasAdminNegativeTest-1045278505 tempest-QuotasAdminNegativeTest-1045278505-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/ea31993d047a47cbb29989795af508ad" status: 200 len: 328 microversion: 2.1 time: 0.258848 Aug 31 15:50:38.415840 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 263/509] 10.222.0.50 () {60 vars in 1262 bytes} [Wed Aug 31 15:50:38 2022] PUT /compute/v2.1/os-quota-sets/ea31993d047a47cbb29989795af508ad => generated 328 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:50:38.415840 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6ba986f6-edf2-434f-a467-0efa6b1cc85d tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:38.415840 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6ba986f6-edf2-434f-a467-0efa6b1cc85d tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: 2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:38.415840 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6ba986f6-edf2-434f-a467-0efa6b1cc85d tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:38.416324 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6ba986f6-edf2-434f-a467-0efa6b1cc85d tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:38.416668 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6ba986f6-edf2-434f-a467-0efa6b1cc85d tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:38.418392 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6ba986f6-edf2-434f-a467-0efa6b1cc85d tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:38.419020 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6ba986f6-edf2-434f-a467-0efa6b1cc85d tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:38.419589 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6ba986f6-edf2-434f-a467-0efa6b1cc85d tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:38.783899 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2a9fe343-490f-4324-9dde-f611cb5a6c21 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:38.786844 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:50:38.808370 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2a9fe343-490f-4324-9dde-f611cb5a6c21 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e" status: 200 len: 1312 microversion: 2.1 time: 0.512907 Aug 31 15:50:38.810516 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 247/510] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:38 2022] GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e => generated 1312 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:38.822671 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c7bfdfc2-8b56-4901-be20-9b0986f3479a tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:38.825504 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c7bfdfc2-8b56-4901-be20-9b0986f3479a tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:38.859199 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7bfdfc2-8b56-4901-be20-9b0986f3479a tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:38.859938 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7bfdfc2-8b56-4901-be20-9b0986f3479a tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:38.860667 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7bfdfc2-8b56-4901-be20-9b0986f3479a tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:38.861700 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7bfdfc2-8b56-4901-be20-9b0986f3479a tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:38.862353 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7bfdfc2-8b56-4901-be20-9b0986f3479a tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:38.862923 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7bfdfc2-8b56-4901-be20-9b0986f3479a tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:39.045837 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6ba986f6-edf2-434f-a467-0efa6b1cc85d tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6349b0ee9e2142a8a440d4e6ae0703a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33f8cd7d4424157b410b64c7823f480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:39.063392 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6ba986f6-edf2-434f-a467-0efa6b1cc85d tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "GET /compute/v2.1/servers/2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881" status: 200 len: 1390 microversion: 2.1 time: 0.656334 Aug 31 15:50:39.063957 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 264/511] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:38 2022] GET /compute/v2.1/servers/2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881 => generated 1390 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:39.368768 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-dd388737-7323-41bc-ba24-998721da8355 tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-302725688", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:50:39.439636 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-dd388737-7323-41bc-ba24-998721da8355 tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] validate_networks() for None {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:50:39.669966 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-c7bfdfc2-8b56-4901-be20-9b0986f3479a tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lazy-loading 'services' on Instance uuid a71c696b-bfa3-40cd-ba75-af485432d34f {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:50:39.719322 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c7bfdfc2-8b56-4901-be20-9b0986f3479a tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f" status: 200 len: 1931 microversion: 2.75 time: 0.906977 Aug 31 15:50:39.736775 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 248/512] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:50:38 2022] GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f => generated 1931 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:50:39.736775 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-76681078-fe08-429c-a1c2-c1415ba89f38 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:39.736775 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-76681078-fe08-429c-a1c2-c1415ba89f38 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: d15c3817-84b0-4e82-86b2-f2333ceeb3cd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:39.750018 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=20 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:50:39.755086 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76681078-fe08-429c-a1c2-c1415ba89f38 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:39.755901 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76681078-fe08-429c-a1c2-c1415ba89f38 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:39.766225 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76681078-fe08-429c-a1c2-c1415ba89f38 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:39.767493 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76681078-fe08-429c-a1c2-c1415ba89f38 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:39.768091 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76681078-fe08-429c-a1c2-c1415ba89f38 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:39.769107 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76681078-fe08-429c-a1c2-c1415ba89f38 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:40.332103 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-76681078-fe08-429c-a1c2-c1415ba89f38 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:40.349060 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-76681078-fe08-429c-a1c2-c1415ba89f38 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/d15c3817-84b0-4e82-86b2-f2333ceeb3cd" status: 200 len: 1318 microversion: 2.1 time: 0.623461 Aug 31 15:50:40.352784 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 249/513] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:39 2022] GET /compute/v2.1/servers/d15c3817-84b0-4e82-86b2-f2333ceeb3cd => generated 1318 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:40.374251 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1c0e0a97-8c97-4c1b-9823-e983b68e9eef tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:40.376132 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1c0e0a97-8c97-4c1b-9823-e983b68e9eef tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: a5a21e54-e375-4370-9d9e-b41df3e5922e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:40.393357 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c0e0a97-8c97-4c1b-9823-e983b68e9eef tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:40.394204 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c0e0a97-8c97-4c1b-9823-e983b68e9eef tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:40.394843 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c0e0a97-8c97-4c1b-9823-e983b68e9eef tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:40.396323 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c0e0a97-8c97-4c1b-9823-e983b68e9eef tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:40.397370 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c0e0a97-8c97-4c1b-9823-e983b68e9eef tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:40.398457 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c0e0a97-8c97-4c1b-9823-e983b68e9eef tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:40.445572 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-dd388737-7323-41bc-ba24-998721da8355 tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:50:40.447058 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-dd388737-7323-41bc-ba24-998721da8355 tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:50:40.447842 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-dd388737-7323-41bc-ba24-998721da8355 tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:50:40.450754 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-dd388737-7323-41bc-ba24-998721da8355 tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:50:40.451449 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-dd388737-7323-41bc-ba24-998721da8355 tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:50:40.467685 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dd388737-7323-41bc-ba24-998721da8355 tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:40.468915 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dd388737-7323-41bc-ba24-998721da8355 tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:40.470349 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dd388737-7323-41bc-ba24-998721da8355 tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:40.471321 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dd388737-7323-41bc-ba24-998721da8355 tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:40.471970 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dd388737-7323-41bc-ba24-998721da8355 tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:40.472605 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dd388737-7323-41bc-ba24-998721da8355 tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:40.507080 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-dd388737-7323-41bc-ba24-998721da8355 tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] Getting quotas for project ea31993d047a47cbb29989795af508ad. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:50:40.514799 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-dd388737-7323-41bc-ba24-998721da8355 tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] Getting quotas for user c918fa141b5a4f698999fd151c24437f and project ea31993d047a47cbb29989795af508ad. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:50:40.581418 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.utils [None req-dd388737-7323-41bc-ba24-998721da8355 tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] cores quota exceeded for ea31993d047a47cbb29989795af508ad, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128864) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 31 15:50:40.585686 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-dd388737-7323-41bc-ba24-998721da8355 tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 31 15:50:40.592840 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-dd388737-7323-41bc-ba24-998721da8355 tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] Request method failure captured: Aug 31 15:50:40.592840 n-d-833090-16 devstack@n-api.service[128864]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 31 15:50:40.592840 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:50:40.592840 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:50:40.592840 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:50:40.592840 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 144 Aug 31 15:50:40.592840 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:50:40.592840 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:50:40.592840 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:50:40.592840 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:50:40.592840 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4NM-Bx4D1rJxVmnfH4bVWVQKWSZRjSKNQTi7dXOWZMvl3H4ahwUP2I5wMfWTCGN1PCmUpNzGP_SSdKHruLqTlg4GNNr9uWDvpMkIa03rqncAZYH5Ntv1XLsDYI7jN-6OIz0ZSt5jchkllyTAe2RE-TMBmq-eKxpS_Fp7reydajQlz4 Aug 31 15:50:40.592840 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:50:40.592840 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:50:40.592840 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:50:40.592840 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:50:40.592840 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:50:40.592840 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:50:40.592840 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: ea31993d047a47cbb29989795af508ad Aug 31 15:50:40.592840 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-QuotasAdminNegativeTest-1582847698 Aug 31 15:50:40.592840 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:50:40.592840 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:50:40.594224 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ea31993d047a47cbb29989795af508ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ea31993d047a47cbb29989795af508ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ea31993d047a47cbb29989795af508ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ea31993d047a47cbb29989795af508ad", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:50:40.594224 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-QuotasAdminNegativeTest-1582847698 Aug 31 15:50:40.594224 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: ea31993d047a47cbb29989795af508ad Aug 31 15:50:40.594224 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1582847698 Aug 31 15:50:40.594224 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-QuotasAdminNegativeTest-1582847698-project Aug 31 15:50:40.594224 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:50:40.594224 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:50:40.594224 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: c918fa141b5a4f698999fd151c24437f Aug 31 15:50:40.594224 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-QuotasAdminNegativeTest-1582847698-project Aug 31 15:50:40.594224 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 15:50:40.594224 n-d-833090-16 devstack@n-api.service[128864]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-302725688", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452"}} Aug 31 15:50:40.594224 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:50:40.595585 n-d-833090-16 devstack@n-api.service[128864]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 31 15:50:40.595585 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-302725688', 'imageRef': 'd715a41c-0e56-494a-a102-cac65831f6bd', 'flavorRef': '452'}}} Aug 31 15:50:40.595585 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:50:40.595585 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:40.595585 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 31 15:50:40.595585 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 31 15:50:40.595585 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 15:50:40.595585 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 15:50:40.595585 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 31 15:50:40.595585 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc Aug 31 15:50:40.595585 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 31 15:50:40.595585 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 31 15:50:40.595585 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 15:50:40.595585 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 15:50:40.595585 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 31 15:50:40.595585 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 31 15:50:40.595585 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 31 15:50:40.595585 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 31 15:50:40.596667 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 31 15:50:40.596667 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 31 15:50:40.596667 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 31 15:50:40.596667 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:40.596667 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:50:40.596667 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:40.596667 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:40.596667 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 31 15:50:40.596667 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 31 15:50:40.596667 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 31 15:50:40.596667 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 31 15:50:40.596667 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Aug 31 15:50:40.596667 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 31 15:50:40.596667 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Aug 31 15:50:40.596667 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 31 15:50:40.596667 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 31 15:50:40.596667 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 31 15:50:40.596667 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 31 15:50:40.596667 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:40.596667 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:50:40.596667 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:40.599582 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:40.599582 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:50:40.599582 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:50:40.599582 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:50:40.599582 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:50:40.599582 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:50:40.599582 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:50:40.599582 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:50:40.599582 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:50:40.599582 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:50:40.599582 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:50:40.599582 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:50:40.599582 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:50:40.599582 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 31 15:50:40.599582 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 31 15:50:40.599582 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 31 15:50:40.599582 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 31 15:50:40.599582 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:40.599582 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:50:40.599582 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:40.599582 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:40.602433 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:50:40.602433 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:50:40.602433 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:50:40.602433 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:50:40.602433 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 31 15:50:40.602433 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:40.605935 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-dd388737-7323-41bc-ba24-998721da8355 tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:50:40.608214 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-dd388737-7323-41bc-ba24-998721da8355 tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.512479 Aug 31 15:50:40.609997 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 265/514] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:50:39 2022] POST /compute/v2.1/servers => generated 111 bytes in 1523 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:50:40.616232 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-cfcef3f9-a30d-41a3-abb6-22006963c025 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:40.617183 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-cfcef3f9-a30d-41a3-abb6-22006963c025 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: 2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:40.625725 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cfcef3f9-a30d-41a3-abb6-22006963c025 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:40.626611 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cfcef3f9-a30d-41a3-abb6-22006963c025 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:40.627264 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cfcef3f9-a30d-41a3-abb6-22006963c025 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:40.628218 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cfcef3f9-a30d-41a3-abb6-22006963c025 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:40.629598 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cfcef3f9-a30d-41a3-abb6-22006963c025 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:40.630404 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cfcef3f9-a30d-41a3-abb6-22006963c025 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:40.874493 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1c0e0a97-8c97-4c1b-9823-e983b68e9eef tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:40.890041 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1c0e0a97-8c97-4c1b-9823-e983b68e9eef tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e" status: 200 len: 1312 microversion: 2.1 time: 0.532550 Aug 31 15:50:40.891030 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 250/515] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:40 2022] GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e => generated 1312 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:40.900947 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-0693b6af-a036-494d-84ad-21b1aff44f29 req-3338490c-269d-4c5f-a8ed-f4ba88cdda60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5a21e54-e375-4370-9d9e-b41df3e5922e", "name": "network-vif-plugged", "status": "completed", "tag": "abeadf77-b435-4819-a412-27a7510ef57a"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:50:40.926298 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-0693b6af-a036-494d-84ad-21b1aff44f29 req-3338490c-269d-4c5f-a8ed-f4ba88cdda60 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:40.929268 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-0693b6af-a036-494d-84ad-21b1aff44f29 req-3338490c-269d-4c5f-a8ed-f4ba88cdda60 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:40.930908 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-0693b6af-a036-494d-84ad-21b1aff44f29 req-3338490c-269d-4c5f-a8ed-f4ba88cdda60 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:40.956120 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-0693b6af-a036-494d-84ad-21b1aff44f29 req-3338490c-269d-4c5f-a8ed-f4ba88cdda60 service nova] Creating event network-vif-plugged:abeadf77-b435-4819-a412-27a7510ef57a for instance a5a21e54-e375-4370-9d9e-b41df3e5922e on n-h2-833090-16 Aug 31 15:50:40.974791 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-0693b6af-a036-494d-84ad-21b1aff44f29 req-3338490c-269d-4c5f-a8ed-f4ba88cdda60 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076746 Aug 31 15:50:40.975861 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 251/516] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:50:40.984216 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1e04a242-5c43-4c25-9570-1dd7ebb8a738 tempest-QuotasAdminNegativeTest-1045278505 tempest-QuotasAdminNegativeTest-1045278505-project-admin] Action: 'update', calling method: .version_select at 0x7fbb46cfc160>, body: {"quota_set": {"cores": 20}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:50:41.026788 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-cfcef3f9-a30d-41a3-abb6-22006963c025 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6349b0ee9e2142a8a440d4e6ae0703a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33f8cd7d4424157b410b64c7823f480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:41.041227 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-cfcef3f9-a30d-41a3-abb6-22006963c025 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "GET /compute/v2.1/servers/2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881" status: 200 len: 1390 microversion: 2.1 time: 0.429348 Aug 31 15:50:41.049310 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 266/517] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:40 2022] GET /compute/v2.1/servers/2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881 => generated 1390 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:41.072049 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b9bc567b-0a10-4d64-911f-e48182c869c7 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:41.076259 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b9bc567b-0a10-4d64-911f-e48182c869c7 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:41.105202 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b9bc567b-0a10-4d64-911f-e48182c869c7 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:41.105741 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b9bc567b-0a10-4d64-911f-e48182c869c7 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:41.107486 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b9bc567b-0a10-4d64-911f-e48182c869c7 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:41.108602 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b9bc567b-0a10-4d64-911f-e48182c869c7 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:41.114951 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b9bc567b-0a10-4d64-911f-e48182c869c7 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:41.117707 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b9bc567b-0a10-4d64-911f-e48182c869c7 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:41.140125 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=100 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:50:41.451298 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-b9bc567b-0a10-4d64-911f-e48182c869c7 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lazy-loading 'services' on Instance uuid a71c696b-bfa3-40cd-ba75-af485432d34f {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:50:41.463925 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e04a242-5c43-4c25-9570-1dd7ebb8a738 tempest-QuotasAdminNegativeTest-1045278505 tempest-QuotasAdminNegativeTest-1045278505-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:41.465782 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e04a242-5c43-4c25-9570-1dd7ebb8a738 tempest-QuotasAdminNegativeTest-1045278505 tempest-QuotasAdminNegativeTest-1045278505-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:41.466551 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e04a242-5c43-4c25-9570-1dd7ebb8a738 tempest-QuotasAdminNegativeTest-1045278505 tempest-QuotasAdminNegativeTest-1045278505-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:41.469457 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e04a242-5c43-4c25-9570-1dd7ebb8a738 tempest-QuotasAdminNegativeTest-1045278505 tempest-QuotasAdminNegativeTest-1045278505-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:41.470909 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e04a242-5c43-4c25-9570-1dd7ebb8a738 tempest-QuotasAdminNegativeTest-1045278505 tempest-QuotasAdminNegativeTest-1045278505-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:41.471470 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e04a242-5c43-4c25-9570-1dd7ebb8a738 tempest-QuotasAdminNegativeTest-1045278505 tempest-QuotasAdminNegativeTest-1045278505-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:41.487471 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b9bc567b-0a10-4d64-911f-e48182c869c7 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f" status: 200 len: 1931 microversion: 2.75 time: 0.434151 Aug 31 15:50:41.488064 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 267/518] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:50:41 2022] GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f => generated 1931 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:50:41.499293 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4a139515-7a67-4a45-95b3-941abf58c3f1 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:41.505565 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4a139515-7a67-4a45-95b3-941abf58c3f1 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: d15c3817-84b0-4e82-86b2-f2333ceeb3cd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:41.520045 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4a139515-7a67-4a45-95b3-941abf58c3f1 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:41.522555 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4a139515-7a67-4a45-95b3-941abf58c3f1 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:41.523306 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4a139515-7a67-4a45-95b3-941abf58c3f1 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:41.524765 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4a139515-7a67-4a45-95b3-941abf58c3f1 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:41.528625 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4a139515-7a67-4a45-95b3-941abf58c3f1 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:41.529932 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4a139515-7a67-4a45-95b3-941abf58c3f1 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:41.600995 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:50:41.602854 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1e04a242-5c43-4c25-9570-1dd7ebb8a738 tempest-QuotasAdminNegativeTest-1045278505 tempest-QuotasAdminNegativeTest-1045278505-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/ea31993d047a47cbb29989795af508ad" status: 200 len: 329 microversion: 2.1 time: 0.625623 Aug 31 15:50:41.603664 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 252/519] 10.222.0.50 () {60 vars in 1262 bytes} [Wed Aug 31 15:50:40 2022] PUT /compute/v2.1/os-quota-sets/ea31993d047a47cbb29989795af508ad => generated 329 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:50:41.618303 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-509170bc-7006-4343-92f9-309d59131ad4 tempest-QuotasAdminNegativeTest-1045278505 tempest-QuotasAdminNegativeTest-1045278505-project-admin] Calling method '.version_select at 0x7fbb46e1a940>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:41.801839 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4a139515-7a67-4a45-95b3-941abf58c3f1 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:41.814203 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4a139515-7a67-4a45-95b3-941abf58c3f1 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/d15c3817-84b0-4e82-86b2-f2333ceeb3cd" status: 200 len: 1318 microversion: 2.1 time: 0.318048 Aug 31 15:50:41.814874 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 268/520] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:41 2022] GET /compute/v2.1/servers/d15c3817-84b0-4e82-86b2-f2333ceeb3cd => generated 1318 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:41.986753 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a3b00fe2-3f10-495a-89f8-52eb8ca411f4 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-159993136", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "efd466b3-b86f-4dea-a01f-277dbef774dc"}]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:50:41.996143 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-509170bc-7006-4343-92f9-309d59131ad4 tempest-QuotasAdminNegativeTest-1045278505 tempest-QuotasAdminNegativeTest-1045278505-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/ea31993d047a47cbb29989795af508ad" status: 200 len: 371 microversion: 2.1 time: 0.383011 Aug 31 15:50:41.997301 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 253/521] 10.222.0.50 () {58 vars in 1242 bytes} [Wed Aug 31 15:50:41 2022] GET /compute/v2.1/os-quota-sets/ea31993d047a47cbb29989795af508ad => generated 371 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:50:42.002600 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6107d31e-4a37-48e6-ba9d-8874bf79e9d1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:42.003692 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6107d31e-4a37-48e6-ba9d-8874bf79e9d1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: a5a21e54-e375-4370-9d9e-b41df3e5922e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:42.010201 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6107d31e-4a37-48e6-ba9d-8874bf79e9d1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:42.011068 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6107d31e-4a37-48e6-ba9d-8874bf79e9d1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:42.011619 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6107d31e-4a37-48e6-ba9d-8874bf79e9d1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:42.012417 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6107d31e-4a37-48e6-ba9d-8874bf79e9d1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:42.012938 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6107d31e-4a37-48e6-ba9d-8874bf79e9d1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:42.013427 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6107d31e-4a37-48e6-ba9d-8874bf79e9d1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:42.087947 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-a3b00fe2-3f10-495a-89f8-52eb8ca411f4 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] validate_networks() for [('efd466b3-b86f-4dea-a01f-277dbef774dc', None, None, None, None, None)] {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:50:42.300164 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6107d31e-4a37-48e6-ba9d-8874bf79e9d1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:42.309656 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6107d31e-4a37-48e6-ba9d-8874bf79e9d1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e" status: 200 len: 1312 microversion: 2.1 time: 0.311040 Aug 31 15:50:42.312228 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 254/522] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:41 2022] GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e => generated 1312 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:42.320992 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cd79fee0-aac1-4f4e-8d7d-c7010677de7c tempest-QuotasAdminNegativeTest-1045278505 tempest-QuotasAdminNegativeTest-1045278505-project-admin] Action: 'update', calling method: .version_select at 0x7fbb46c499d0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:50:42.399304 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd79fee0-aac1-4f4e-8d7d-c7010677de7c tempest-QuotasAdminNegativeTest-1045278505 tempest-QuotasAdminNegativeTest-1045278505-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:42.400043 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd79fee0-aac1-4f4e-8d7d-c7010677de7c tempest-QuotasAdminNegativeTest-1045278505 tempest-QuotasAdminNegativeTest-1045278505-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:42.400661 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd79fee0-aac1-4f4e-8d7d-c7010677de7c tempest-QuotasAdminNegativeTest-1045278505 tempest-QuotasAdminNegativeTest-1045278505-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:42.401691 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd79fee0-aac1-4f4e-8d7d-c7010677de7c tempest-QuotasAdminNegativeTest-1045278505 tempest-QuotasAdminNegativeTest-1045278505-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:42.402156 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd79fee0-aac1-4f4e-8d7d-c7010677de7c tempest-QuotasAdminNegativeTest-1045278505 tempest-QuotasAdminNegativeTest-1045278505-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:42.402571 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd79fee0-aac1-4f4e-8d7d-c7010677de7c tempest-QuotasAdminNegativeTest-1045278505 tempest-QuotasAdminNegativeTest-1045278505-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:42.467486 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cd79fee0-aac1-4f4e-8d7d-c7010677de7c tempest-QuotasAdminNegativeTest-1045278505 tempest-QuotasAdminNegativeTest-1045278505-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/ea31993d047a47cbb29989795af508ad" status: 200 len: 328 microversion: 2.1 time: 0.154124 Aug 31 15:50:42.479477 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 255/523] 10.222.0.50 () {60 vars in 1262 bytes} [Wed Aug 31 15:50:42 2022] PUT /compute/v2.1/os-quota-sets/ea31993d047a47cbb29989795af508ad => generated 328 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:50:42.479705 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bbb3c92f-1eaa-4d26-ab64-acfadd57415d tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:42.480456 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bbb3c92f-1eaa-4d26-ab64-acfadd57415d tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: 2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:42.494233 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bbb3c92f-1eaa-4d26-ab64-acfadd57415d tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:42.494992 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bbb3c92f-1eaa-4d26-ab64-acfadd57415d tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:42.495647 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bbb3c92f-1eaa-4d26-ab64-acfadd57415d tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:42.496703 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bbb3c92f-1eaa-4d26-ab64-acfadd57415d tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:42.497221 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bbb3c92f-1eaa-4d26-ab64-acfadd57415d tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:42.497706 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bbb3c92f-1eaa-4d26-ab64-acfadd57415d tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:42.683141 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-a3b00fe2-3f10-495a-89f8-52eb8ca411f4 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:50:42.683598 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-a3b00fe2-3f10-495a-89f8-52eb8ca411f4 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:50:42.684072 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-a3b00fe2-3f10-495a-89f8-52eb8ca411f4 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:50:42.684473 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-a3b00fe2-3f10-495a-89f8-52eb8ca411f4 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:50:42.685061 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-a3b00fe2-3f10-495a-89f8-52eb8ca411f4 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:50:42.694989 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a3b00fe2-3f10-495a-89f8-52eb8ca411f4 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:42.695471 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a3b00fe2-3f10-495a-89f8-52eb8ca411f4 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:42.695940 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a3b00fe2-3f10-495a-89f8-52eb8ca411f4 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:42.696844 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a3b00fe2-3f10-495a-89f8-52eb8ca411f4 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:42.697293 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a3b00fe2-3f10-495a-89f8-52eb8ca411f4 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:42.697769 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a3b00fe2-3f10-495a-89f8-52eb8ca411f4 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:42.713047 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bbb3c92f-1eaa-4d26-ab64-acfadd57415d tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6349b0ee9e2142a8a440d4e6ae0703a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33f8cd7d4424157b410b64c7823f480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:42.716894 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-a3b00fe2-3f10-495a-89f8-52eb8ca411f4 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Getting quotas for project 86aafc129b8640d381f9bae1767fbc6c. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:50:42.721309 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bbb3c92f-1eaa-4d26-ab64-acfadd57415d tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "GET /compute/v2.1/servers/2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881" status: 200 len: 1390 microversion: 2.1 time: 0.245793 Aug 31 15:50:42.722535 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-a3b00fe2-3f10-495a-89f8-52eb8ca411f4 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Getting quotas for user 072bc5784d754815a511f6c3f4437f7c and project 86aafc129b8640d381f9bae1767fbc6c. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:50:42.723145 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 256/524] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:42 2022] GET /compute/v2.1/servers/2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881 => generated 1390 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:42.732504 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-832a836a-004f-4c05-9eb0-ec0a5c8caaef tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:42.733612 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-832a836a-004f-4c05-9eb0-ec0a5c8caaef tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:42.741342 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a3b00fe2-3f10-495a-89f8-52eb8ca411f4 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:50:42.742564 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-832a836a-004f-4c05-9eb0-ec0a5c8caaef tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:42.743410 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-832a836a-004f-4c05-9eb0-ec0a5c8caaef tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:42.743910 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-832a836a-004f-4c05-9eb0-ec0a5c8caaef tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:42.744663 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-832a836a-004f-4c05-9eb0-ec0a5c8caaef tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:42.745135 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a3b00fe2-3f10-495a-89f8-52eb8ca411f4 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 61e7db75-00b5-41e8-8efb-bced641ddd7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:50:42.745647 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-832a836a-004f-4c05-9eb0-ec0a5c8caaef tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:42.746199 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-832a836a-004f-4c05-9eb0-ec0a5c8caaef tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:42.820546 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a3b00fe2-3f10-495a-89f8-52eb8ca411f4 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.920105 Aug 31 15:50:42.826910 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 269/525] 10.222.0.50 () {62 vars in 1188 bytes} [Wed Aug 31 15:50:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 922 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 31 15:50:42.827160 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8f290d80-8e38-4258-a1bb-d54a275c271d tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-587723324", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:50:42.857348 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-832a836a-004f-4c05-9eb0-ec0a5c8caaef tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lazy-loading 'services' on Instance uuid a71c696b-bfa3-40cd-ba75-af485432d34f {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:50:42.878356 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-832a836a-004f-4c05-9eb0-ec0a5c8caaef tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f" status: 200 len: 1931 microversion: 2.75 time: 0.153512 Aug 31 15:50:42.884697 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 257/526] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:50:42 2022] GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f => generated 1931 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:50:42.892398 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-893eb0e7-ca46-48d8-a5a5-eded0c0596f0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:42.893299 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-893eb0e7-ca46-48d8-a5a5-eded0c0596f0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 61e7db75-00b5-41e8-8efb-bced641ddd7a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:42.925702 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-8f290d80-8e38-4258-a1bb-d54a275c271d tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] validate_networks() for None {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:50:42.954293 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-893eb0e7-ca46-48d8-a5a5-eded0c0596f0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:42.962751 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-893eb0e7-ca46-48d8-a5a5-eded0c0596f0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:42.964769 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-893eb0e7-ca46-48d8-a5a5-eded0c0596f0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:42.966199 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-893eb0e7-ca46-48d8-a5a5-eded0c0596f0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/61e7db75-00b5-41e8-8efb-bced641ddd7a" status: 200 len: 1261 microversion: 2.25 time: 0.080245 Aug 31 15:50:42.981344 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 258/527] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:50:42 2022] GET /compute/v2.1/servers/61e7db75-00b5-41e8-8efb-bced641ddd7a => generated 1261 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:50:42.986352 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-31fd849f-8d1f-475f-8053-65d32f97a1c7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:42.986965 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-31fd849f-8d1f-475f-8053-65d32f97a1c7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: d15c3817-84b0-4e82-86b2-f2333ceeb3cd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:42.994176 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31fd849f-8d1f-475f-8053-65d32f97a1c7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:42.994670 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31fd849f-8d1f-475f-8053-65d32f97a1c7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:42.995096 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31fd849f-8d1f-475f-8053-65d32f97a1c7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:42.995930 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31fd849f-8d1f-475f-8053-65d32f97a1c7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:42.996363 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31fd849f-8d1f-475f-8053-65d32f97a1c7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:42.996784 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31fd849f-8d1f-475f-8053-65d32f97a1c7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:43.309605 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-31fd849f-8d1f-475f-8053-65d32f97a1c7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:43.323209 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-31fd849f-8d1f-475f-8053-65d32f97a1c7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/d15c3817-84b0-4e82-86b2-f2333ceeb3cd" status: 200 len: 1318 microversion: 2.1 time: 0.338421 Aug 31 15:50:43.326941 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 259/528] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:42 2022] GET /compute/v2.1/servers/d15c3817-84b0-4e82-86b2-f2333ceeb3cd => generated 1318 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:43.341473 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-ef44d25a-7984-4e4f-9884-01debf3dc07f req-4cd92355-e419-4c2b-baad-e7fdf3fc1ab7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19da7b68-c450-41e9-9a0b-135b8105b4d5", "name": "network-vif-plugged", "status": "completed", "tag": "49cad27c-0371-48ed-b8ca-95367001546e"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:50:43.356810 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ef44d25a-7984-4e4f-9884-01debf3dc07f req-4cd92355-e419-4c2b-baad-e7fdf3fc1ab7 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:43.357583 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ef44d25a-7984-4e4f-9884-01debf3dc07f req-4cd92355-e419-4c2b-baad-e7fdf3fc1ab7 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:43.358298 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ef44d25a-7984-4e4f-9884-01debf3dc07f req-4cd92355-e419-4c2b-baad-e7fdf3fc1ab7 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:43.369980 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-ef44d25a-7984-4e4f-9884-01debf3dc07f req-4cd92355-e419-4c2b-baad-e7fdf3fc1ab7 service nova] Creating event network-vif-plugged:49cad27c-0371-48ed-b8ca-95367001546e for instance 19da7b68-c450-41e9-9a0b-135b8105b4d5 on n-h1-833090-16 Aug 31 15:50:43.375391 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-ef44d25a-7984-4e4f-9884-01debf3dc07f req-4cd92355-e419-4c2b-baad-e7fdf3fc1ab7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043445 Aug 31 15:50:43.376662 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 260/529] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:50:43.381836 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7329639b-048c-448c-b001-0bef9b12f91d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:43.382836 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7329639b-048c-448c-b001-0bef9b12f91d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: a5a21e54-e375-4370-9d9e-b41df3e5922e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:43.391512 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-8f290d80-8e38-4258-a1bb-d54a275c271d tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:50:43.391940 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-8f290d80-8e38-4258-a1bb-d54a275c271d tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:50:43.392862 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-8f290d80-8e38-4258-a1bb-d54a275c271d tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:50:43.393214 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7329639b-048c-448c-b001-0bef9b12f91d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:43.393348 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-8f290d80-8e38-4258-a1bb-d54a275c271d tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:50:43.393669 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-8f290d80-8e38-4258-a1bb-d54a275c271d tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:50:43.393963 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7329639b-048c-448c-b001-0bef9b12f91d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:43.394493 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7329639b-048c-448c-b001-0bef9b12f91d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:43.395401 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7329639b-048c-448c-b001-0bef9b12f91d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:43.396064 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7329639b-048c-448c-b001-0bef9b12f91d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:43.397044 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7329639b-048c-448c-b001-0bef9b12f91d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:43.413125 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8f290d80-8e38-4258-a1bb-d54a275c271d tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:43.415139 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8f290d80-8e38-4258-a1bb-d54a275c271d tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:43.416428 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8f290d80-8e38-4258-a1bb-d54a275c271d tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:43.417457 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8f290d80-8e38-4258-a1bb-d54a275c271d tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:43.419775 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8f290d80-8e38-4258-a1bb-d54a275c271d tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:43.422597 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8f290d80-8e38-4258-a1bb-d54a275c271d tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:43.465379 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-8f290d80-8e38-4258-a1bb-d54a275c271d tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] Getting quotas for project ea31993d047a47cbb29989795af508ad. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:50:43.471769 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-8f290d80-8e38-4258-a1bb-d54a275c271d tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] Getting quotas for user c918fa141b5a4f698999fd151c24437f and project ea31993d047a47cbb29989795af508ad. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:50:43.488118 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.utils [None req-8f290d80-8e38-4258-a1bb-d54a275c271d tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] instances quota exceeded for ea31993d047a47cbb29989795af508ad, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128864) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 31 15:50:43.488623 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-8f290d80-8e38-4258-a1bb-d54a275c271d tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 31 15:50:43.490669 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8f290d80-8e38-4258-a1bb-d54a275c271d tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] Request method failure captured: Aug 31 15:50:43.490669 n-d-833090-16 devstack@n-api.service[128864]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 31 15:50:43.490669 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:50:43.490669 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:50:43.490669 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:50:43.490669 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 144 Aug 31 15:50:43.490669 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:50:43.490669 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:50:43.490669 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:50:43.490669 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:50:43.490669 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4NM-Bx4D1rJxVmnfH4bVWVQKWSZRjSKNQTi7dXOWZMvl3H4ahwUP2I5wMfWTCGN1PCmUpNzGP_SSdKHruLqTlg4GNNr9uWDvpMkIa03rqncAZYH5Ntv1XLsDYI7jN-6OIz0ZSt5jchkllyTAe2RE-TMBmq-eKxpS_Fp7reydajQlz4 Aug 31 15:50:43.490669 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:50:43.490669 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:50:43.490669 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:50:43.490669 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:50:43.490669 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:50:43.490669 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:50:43.490669 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: ea31993d047a47cbb29989795af508ad Aug 31 15:50:43.490669 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-QuotasAdminNegativeTest-1582847698 Aug 31 15:50:43.490669 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:50:43.490669 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:50:43.491899 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ea31993d047a47cbb29989795af508ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ea31993d047a47cbb29989795af508ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ea31993d047a47cbb29989795af508ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ea31993d047a47cbb29989795af508ad", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:50:43.491899 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-QuotasAdminNegativeTest-1582847698 Aug 31 15:50:43.491899 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: ea31993d047a47cbb29989795af508ad Aug 31 15:50:43.491899 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1582847698 Aug 31 15:50:43.491899 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-QuotasAdminNegativeTest-1582847698-project Aug 31 15:50:43.491899 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:50:43.491899 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:50:43.491899 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: c918fa141b5a4f698999fd151c24437f Aug 31 15:50:43.491899 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-QuotasAdminNegativeTest-1582847698-project Aug 31 15:50:43.491899 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 15:50:43.491899 n-d-833090-16 devstack@n-api.service[128864]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-587723324", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452"}} Aug 31 15:50:43.491899 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:50:43.492612 n-d-833090-16 devstack@n-api.service[128864]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 31 15:50:43.492612 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-587723324', 'imageRef': 'd715a41c-0e56-494a-a102-cac65831f6bd', 'flavorRef': '452'}}} Aug 31 15:50:43.492612 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:50:43.492612 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:43.492612 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 31 15:50:43.492612 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 31 15:50:43.492612 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 15:50:43.492612 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 15:50:43.492612 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 31 15:50:43.492612 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc Aug 31 15:50:43.492612 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 31 15:50:43.492612 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 31 15:50:43.492612 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 15:50:43.492612 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 15:50:43.492612 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 31 15:50:43.492612 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 31 15:50:43.492612 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 31 15:50:43.492612 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 31 15:50:43.493671 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 31 15:50:43.493671 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 31 15:50:43.493671 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Aug 31 15:50:43.493671 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:43.493671 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:50:43.493671 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:43.493671 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:43.493671 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 31 15:50:43.493671 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 31 15:50:43.493671 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 31 15:50:43.493671 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 31 15:50:43.493671 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Aug 31 15:50:43.493671 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 31 15:50:43.493671 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Aug 31 15:50:43.493671 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 31 15:50:43.493671 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 31 15:50:43.493671 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 31 15:50:43.493671 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 31 15:50:43.493671 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:43.493671 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:50:43.493671 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:43.494885 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:43.494885 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:50:43.494885 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:50:43.494885 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:50:43.494885 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:50:43.494885 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:50:43.494885 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:50:43.494885 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:50:43.494885 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:50:43.494885 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:50:43.494885 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:50:43.494885 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:50:43.494885 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:50:43.494885 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 31 15:50:43.494885 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 31 15:50:43.494885 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 31 15:50:43.494885 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 31 15:50:43.494885 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:43.494885 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:50:43.494885 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:43.494885 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:43.496120 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:50:43.496120 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:50:43.496120 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:50:43.496120 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:50:43.496120 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 31 15:50:43.496120 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:43.496120 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8f290d80-8e38-4258-a1bb-d54a275c271d tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:50:43.496120 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8f290d80-8e38-4258-a1bb-d54a275c271d tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.669626 Aug 31 15:50:43.496120 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 270/530] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:50:42 2022] POST /compute/v2.1/servers => generated 119 bytes in 671 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:50:43.673292 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d2ce077a-52d9-483f-9d07-4203bb1bb37d tempest-ListImageFiltersNegativeTestJSON-498027231 tempest-ListImageFiltersNegativeTestJSON-498027231-project] Calling method '.version_select at 0x7fbb46dc0670>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:43.698501 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-d2ce077a-52d9-483f-9d07-4203bb1bb37d tempest-ListImageFiltersNegativeTestJSON-498027231 tempest-ListImageFiltersNegativeTestJSON-498027231-project] HTTP exception thrown: Image not found. Aug 31 15:50:43.710420 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d2ce077a-52d9-483f-9d07-4203bb1bb37d tempest-ListImageFiltersNegativeTestJSON-498027231 tempest-ListImageFiltersNegativeTestJSON-498027231-project] Request method failure captured: Aug 31 15:50:43.710420 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/images/5c045ce4-a3a3-4306-af8d-34d6f6c58acf HTTP/1.1 Aug 31 15:50:43.710420 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:50:43.710420 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:50:43.710420 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:50:43.710420 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:50:43.710420 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:50:43.710420 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:50:43.710420 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:50:43.710420 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:50:43.710420 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4NT5aejg_RFV5ifYEato-PzHrx7ZgeIw1IBQ5ut1icGyLEd4J_8_7vXq99DyNrGiBH2M4YF1gtOjsEeVM41uwxayZGXGxZrTvnvE6nuTy8ai6w1gSyTbhrUaEYaeDQ4TsncaEDD7CpvKT2179Di7fnMmngb8mKQspbYVfM5EuCpaFQ Aug 31 15:50:43.710420 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:50:43.710420 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:50:43.710420 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:50:43.710420 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:50:43.710420 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:50:43.710420 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:50:43.710420 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 294c45f9e16d4661afba4829c0fce34f Aug 31 15:50:43.710420 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-498027231 Aug 31 15:50:43.710420 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:50:43.710420 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:50:43.711766 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/294c45f9e16d4661afba4829c0fce34f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/294c45f9e16d4661afba4829c0fce34f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/294c45f9e16d4661afba4829c0fce34f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_294c45f9e16d4661afba4829c0fce34f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:50:43.711766 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-498027231 Aug 31 15:50:43.711766 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 294c45f9e16d4661afba4829c0fce34f Aug 31 15:50:43.711766 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-498027231 Aug 31 15:50:43.711766 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ListImageFiltersNegativeTestJSON-498027231-project Aug 31 15:50:43.711766 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:50:43.711766 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:50:43.711766 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 6f7f141d09554bada249f77d70324111 Aug 31 15:50:43.711766 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-498027231-project Aug 31 15:50:43.711766 n-d-833090-16 devstack@n-api.service[128864]: method: Aug 31 15:50:43.711766 n-d-833090-16 devstack@n-api.service[128864]: exception: Image not found. Aug 31 15:50:43.711766 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '5c045ce4-a3a3-4306-af8d-34d6f6c58acf'} Aug 31 15:50:43.711766 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:50:43.712535 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:43.712535 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 31 15:50:43.712535 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 31 15:50:43.712535 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 15:50:43.712535 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 15:50:43.712535 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 31 15:50:43.712535 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 31 15:50:43.712535 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 15:50:43.712535 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 15:50:43.712535 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 31 15:50:43.712535 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 31 15:50:43.712535 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 31 15:50:43.712535 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 31 15:50:43.712535 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 15:50:43.712535 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 15:50:43.712535 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 15:50:43.712535 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 15:50:43.712535 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5c045ce4-a3a3-4306-af8d-34d6f6c58acf Aug 31 15:50:43.713594 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:43.713594 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:50:43.713594 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:43.713594 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:43.713594 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 31 15:50:43.713594 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 31 15:50:43.713594 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 31 15:50:43.713594 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 31 15:50:43.713594 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 31 15:50:43.713594 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 31 15:50:43.713594 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 31 15:50:43.713594 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 31 15:50:43.713594 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 31 15:50:43.713594 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 31 15:50:43.713594 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 15:50:43.713594 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 15:50:43.713594 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 31 15:50:43.713594 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 31 15:50:43.713594 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 15:50:43.713594 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 15:50:43.715099 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 31 15:50:43.715099 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 31 15:50:43.715099 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 31 15:50:43.715099 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 31 15:50:43.715099 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 15:50:43.715099 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 15:50:43.715099 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 15:50:43.715099 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 15:50:43.715099 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5c045ce4-a3a3-4306-af8d-34d6f6c58acf could not be found. Aug 31 15:50:43.715099 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:43.715099 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:50:43.715099 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:43.715099 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:43.715099 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:50:43.715099 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:50:43.715099 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:50:43.715099 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:50:43.715099 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:50:43.715099 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:50:43.716197 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:50:43.716197 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:50:43.716197 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 31 15:50:43.716197 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 31 15:50:43.716197 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 31 15:50:43.716197 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:43.716197 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:50:43.716197 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:43.716197 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:43.716197 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:50:43.716197 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:50:43.716197 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:50:43.716197 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:50:43.716197 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 31 15:50:43.716197 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:43.719350 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7329639b-048c-448c-b001-0bef9b12f91d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:43.721232 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d2ce077a-52d9-483f-9d07-4203bb1bb37d tempest-ListImageFiltersNegativeTestJSON-498027231 tempest-ListImageFiltersNegativeTestJSON-498027231-project] Returning 404 to user: Image not found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:50:43.722361 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d2ce077a-52d9-483f-9d07-4203bb1bb37d tempest-ListImageFiltersNegativeTestJSON-498027231 tempest-ListImageFiltersNegativeTestJSON-498027231-project] 10.222.0.50 "GET /compute/v2.1/images/5c045ce4-a3a3-4306-af8d-34d6f6c58acf" status: 404 len: 62 microversion: 2.1 time: 0.228617 Aug 31 15:50:43.723005 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 271/531] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:50:43 2022] GET /compute/v2.1/images/5c045ce4-a3a3-4306-af8d-34d6f6c58acf => generated 62 bytes in 230 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 15:50:43.724282 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7329639b-048c-448c-b001-0bef9b12f91d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e" status: 200 len: 1312 microversion: 2.1 time: 0.346303 Aug 31 15:50:43.733299 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 261/532] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:43 2022] GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e => generated 1312 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:43.743143 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6f80a85e-bd02-440a-87c4-591ef8c70824 tempest-QuotasAdminNegativeTest-1045278505 tempest-QuotasAdminNegativeTest-1045278505-project-admin] Action: 'update', calling method: .version_select at 0x7fbb46da6280>, body: {"quota_set": {"instances": 10}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:50:43.746223 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-09de431c-bcb3-4de6-8339-1a65d7e82178 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:43.747814 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-09de431c-bcb3-4de6-8339-1a65d7e82178 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: 2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:43.760598 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09de431c-bcb3-4de6-8339-1a65d7e82178 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:43.762330 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09de431c-bcb3-4de6-8339-1a65d7e82178 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:43.763329 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09de431c-bcb3-4de6-8339-1a65d7e82178 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:43.764403 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09de431c-bcb3-4de6-8339-1a65d7e82178 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:43.765099 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09de431c-bcb3-4de6-8339-1a65d7e82178 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:43.765736 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09de431c-bcb3-4de6-8339-1a65d7e82178 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:43.936975 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f80a85e-bd02-440a-87c4-591ef8c70824 tempest-QuotasAdminNegativeTest-1045278505 tempest-QuotasAdminNegativeTest-1045278505-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:43.937507 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f80a85e-bd02-440a-87c4-591ef8c70824 tempest-QuotasAdminNegativeTest-1045278505 tempest-QuotasAdminNegativeTest-1045278505-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:43.938198 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f80a85e-bd02-440a-87c4-591ef8c70824 tempest-QuotasAdminNegativeTest-1045278505 tempest-QuotasAdminNegativeTest-1045278505-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:43.939414 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f80a85e-bd02-440a-87c4-591ef8c70824 tempest-QuotasAdminNegativeTest-1045278505 tempest-QuotasAdminNegativeTest-1045278505-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:43.940431 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f80a85e-bd02-440a-87c4-591ef8c70824 tempest-QuotasAdminNegativeTest-1045278505 tempest-QuotasAdminNegativeTest-1045278505-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:43.941033 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f80a85e-bd02-440a-87c4-591ef8c70824 tempest-QuotasAdminNegativeTest-1045278505 tempest-QuotasAdminNegativeTest-1045278505-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:43.999170 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-09de431c-bcb3-4de6-8339-1a65d7e82178 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6349b0ee9e2142a8a440d4e6ae0703a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33f8cd7d4424157b410b64c7823f480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:44.009304 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-09de431c-bcb3-4de6-8339-1a65d7e82178 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "GET /compute/v2.1/servers/2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881" status: 200 len: 1390 microversion: 2.1 time: 0.268545 Aug 31 15:50:44.010261 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 262/533] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:43 2022] GET /compute/v2.1/servers/2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881 => generated 1390 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:44.015470 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-03458b24-ffbf-4021-b7bc-dfb48b7db63d tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:44.016280 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-03458b24-ffbf-4021-b7bc-dfb48b7db63d tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:44.025329 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03458b24-ffbf-4021-b7bc-dfb48b7db63d tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:44.026837 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03458b24-ffbf-4021-b7bc-dfb48b7db63d tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:44.027547 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03458b24-ffbf-4021-b7bc-dfb48b7db63d tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:44.028491 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03458b24-ffbf-4021-b7bc-dfb48b7db63d tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:44.029336 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03458b24-ffbf-4021-b7bc-dfb48b7db63d tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:44.030041 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03458b24-ffbf-4021-b7bc-dfb48b7db63d tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:44.059440 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6f80a85e-bd02-440a-87c4-591ef8c70824 tempest-QuotasAdminNegativeTest-1045278505 tempest-QuotasAdminNegativeTest-1045278505-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/ea31993d047a47cbb29989795af508ad" status: 200 len: 329 microversion: 2.1 time: 0.335124 Aug 31 15:50:44.060084 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 272/534] 10.222.0.50 () {60 vars in 1262 bytes} [Wed Aug 31 15:50:43 2022] PUT /compute/v2.1/os-quota-sets/ea31993d047a47cbb29989795af508ad => generated 329 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:50:44.072820 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-df0a71fc-f334-444c-a084-8ba4400ee8b0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:44.073573 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-df0a71fc-f334-444c-a084-8ba4400ee8b0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 61e7db75-00b5-41e8-8efb-bced641ddd7a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:44.080935 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-df0a71fc-f334-444c-a084-8ba4400ee8b0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:44.081849 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-df0a71fc-f334-444c-a084-8ba4400ee8b0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:44.082481 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-df0a71fc-f334-444c-a084-8ba4400ee8b0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:44.083392 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-df0a71fc-f334-444c-a084-8ba4400ee8b0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:44.084031 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-df0a71fc-f334-444c-a084-8ba4400ee8b0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:44.084821 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-df0a71fc-f334-444c-a084-8ba4400ee8b0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:44.193249 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-03458b24-ffbf-4021-b7bc-dfb48b7db63d tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lazy-loading 'services' on Instance uuid a71c696b-bfa3-40cd-ba75-af485432d34f {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:50:44.228402 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-03458b24-ffbf-4021-b7bc-dfb48b7db63d tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f" status: 200 len: 1931 microversion: 2.75 time: 0.216595 Aug 31 15:50:44.228620 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-df0a71fc-f334-444c-a084-8ba4400ee8b0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:44.229221 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 263/535] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:50:44 2022] GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f => generated 1931 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:50:44.235801 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c2620f75-4860-4569-a957-7fa000fb7a30 tempest-QuotasAdminNegativeTest-1045278505 tempest-QuotasAdminNegativeTest-1045278505-project-admin] Calling method '.version_select at 0x7fbb46edc670>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:44.241661 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-df0a71fc-f334-444c-a084-8ba4400ee8b0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:44.247143 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-df0a71fc-f334-444c-a084-8ba4400ee8b0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:44.248250 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-df0a71fc-f334-444c-a084-8ba4400ee8b0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/61e7db75-00b5-41e8-8efb-bced641ddd7a" status: 200 len: 1313 microversion: 2.25 time: 0.179463 Aug 31 15:50:44.248820 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 273/536] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:50:44 2022] GET /compute/v2.1/servers/61e7db75-00b5-41e8-8efb-bced641ddd7a => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:50:44.349171 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c0652060-3db1-42cb-8b6b-acbf79d9bbfe tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:44.349782 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c0652060-3db1-42cb-8b6b-acbf79d9bbfe tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: d15c3817-84b0-4e82-86b2-f2333ceeb3cd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:44.359679 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c0652060-3db1-42cb-8b6b-acbf79d9bbfe tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:44.360203 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c0652060-3db1-42cb-8b6b-acbf79d9bbfe tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:44.360668 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c0652060-3db1-42cb-8b6b-acbf79d9bbfe tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:44.361432 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c0652060-3db1-42cb-8b6b-acbf79d9bbfe tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:44.361913 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c0652060-3db1-42cb-8b6b-acbf79d9bbfe tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:44.362434 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c0652060-3db1-42cb-8b6b-acbf79d9bbfe tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:44.496834 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c2620f75-4860-4569-a957-7fa000fb7a30 tempest-QuotasAdminNegativeTest-1045278505 tempest-QuotasAdminNegativeTest-1045278505-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/ea31993d047a47cbb29989795af508ad" status: 200 len: 371 microversion: 2.1 time: 0.264834 Aug 31 15:50:44.505236 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 264/537] 10.222.0.50 () {58 vars in 1242 bytes} [Wed Aug 31 15:50:44 2022] GET /compute/v2.1/os-quota-sets/ea31993d047a47cbb29989795af508ad => generated 371 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:50:44.511589 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d547b6d8-9938-427e-9834-baabb3ae472b tempest-QuotasAdminNegativeTest-1045278505 tempest-QuotasAdminNegativeTest-1045278505-project-admin] Action: 'update', calling method: .version_select at 0x7fbb46e1a550>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:50:44.563410 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c0652060-3db1-42cb-8b6b-acbf79d9bbfe tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:44.574909 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c0652060-3db1-42cb-8b6b-acbf79d9bbfe tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/d15c3817-84b0-4e82-86b2-f2333ceeb3cd" status: 200 len: 1318 microversion: 2.1 time: 0.229631 Aug 31 15:50:44.575690 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 274/538] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:44 2022] GET /compute/v2.1/servers/d15c3817-84b0-4e82-86b2-f2333ceeb3cd => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:50:44.613055 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d547b6d8-9938-427e-9834-baabb3ae472b tempest-QuotasAdminNegativeTest-1045278505 tempest-QuotasAdminNegativeTest-1045278505-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:44.613745 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d547b6d8-9938-427e-9834-baabb3ae472b tempest-QuotasAdminNegativeTest-1045278505 tempest-QuotasAdminNegativeTest-1045278505-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:44.614005 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d547b6d8-9938-427e-9834-baabb3ae472b tempest-QuotasAdminNegativeTest-1045278505 tempest-QuotasAdminNegativeTest-1045278505-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:44.614686 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d547b6d8-9938-427e-9834-baabb3ae472b tempest-QuotasAdminNegativeTest-1045278505 tempest-QuotasAdminNegativeTest-1045278505-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:44.615126 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d547b6d8-9938-427e-9834-baabb3ae472b tempest-QuotasAdminNegativeTest-1045278505 tempest-QuotasAdminNegativeTest-1045278505-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:44.615533 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d547b6d8-9938-427e-9834-baabb3ae472b tempest-QuotasAdminNegativeTest-1045278505 tempest-QuotasAdminNegativeTest-1045278505-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:44.677665 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d547b6d8-9938-427e-9834-baabb3ae472b tempest-QuotasAdminNegativeTest-1045278505 tempest-QuotasAdminNegativeTest-1045278505-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/ea31993d047a47cbb29989795af508ad" status: 200 len: 325 microversion: 2.1 time: 0.170490 Aug 31 15:50:44.678628 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 265/539] 10.222.0.50 () {60 vars in 1262 bytes} [Wed Aug 31 15:50:44 2022] PUT /compute/v2.1/os-quota-sets/ea31993d047a47cbb29989795af508ad => generated 325 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:50:44.747046 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b99e59ce-5749-435a-a436-012033c4ea79 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:44.748609 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b99e59ce-5749-435a-a436-012033c4ea79 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: a5a21e54-e375-4370-9d9e-b41df3e5922e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:44.755647 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b99e59ce-5749-435a-a436-012033c4ea79 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:44.756526 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b99e59ce-5749-435a-a436-012033c4ea79 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:44.757271 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b99e59ce-5749-435a-a436-012033c4ea79 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:44.758485 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b99e59ce-5749-435a-a436-012033c4ea79 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:44.759141 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b99e59ce-5749-435a-a436-012033c4ea79 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:44.759877 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b99e59ce-5749-435a-a436-012033c4ea79 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:44.839753 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0744956c-ceae-40d0-a976-f6c5d2f36e81 tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-939462299", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:50:44.905068 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-0744956c-ceae-40d0-a976-f6c5d2f36e81 tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] validate_networks() for None {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:50:45.019772 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b99e59ce-5749-435a-a436-012033c4ea79 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:45.037187 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b99e59ce-5749-435a-a436-012033c4ea79 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e" status: 200 len: 1312 microversion: 2.1 time: 0.293431 Aug 31 15:50:45.039248 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 275/540] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:44 2022] GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e => generated 1312 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:45.046803 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7c507faf-6c3d-49fd-8fff-160ad71604fa tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:45.047728 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7c507faf-6c3d-49fd-8fff-160ad71604fa tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: 2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:45.062230 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7c507faf-6c3d-49fd-8fff-160ad71604fa tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:45.062932 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7c507faf-6c3d-49fd-8fff-160ad71604fa tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:45.063556 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7c507faf-6c3d-49fd-8fff-160ad71604fa tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:45.065273 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7c507faf-6c3d-49fd-8fff-160ad71604fa tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:45.066012 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7c507faf-6c3d-49fd-8fff-160ad71604fa tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:45.067844 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7c507faf-6c3d-49fd-8fff-160ad71604fa tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:45.195557 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-0744956c-ceae-40d0-a976-f6c5d2f36e81 tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:50:45.196284 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-0744956c-ceae-40d0-a976-f6c5d2f36e81 tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:50:45.196987 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-0744956c-ceae-40d0-a976-f6c5d2f36e81 tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:50:45.197446 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-0744956c-ceae-40d0-a976-f6c5d2f36e81 tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:50:45.197960 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-0744956c-ceae-40d0-a976-f6c5d2f36e81 tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:50:45.209762 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0744956c-ceae-40d0-a976-f6c5d2f36e81 tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:45.210347 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0744956c-ceae-40d0-a976-f6c5d2f36e81 tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:45.210783 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0744956c-ceae-40d0-a976-f6c5d2f36e81 tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:45.211514 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0744956c-ceae-40d0-a976-f6c5d2f36e81 tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:45.211969 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0744956c-ceae-40d0-a976-f6c5d2f36e81 tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:45.212656 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0744956c-ceae-40d0-a976-f6c5d2f36e81 tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:45.237170 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-0744956c-ceae-40d0-a976-f6c5d2f36e81 tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] Getting quotas for project ea31993d047a47cbb29989795af508ad. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:50:45.247847 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-0744956c-ceae-40d0-a976-f6c5d2f36e81 tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] Getting quotas for user c918fa141b5a4f698999fd151c24437f and project ea31993d047a47cbb29989795af508ad. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:50:45.286106 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.utils [None req-0744956c-ceae-40d0-a976-f6c5d2f36e81 tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] ram quota exceeded for ea31993d047a47cbb29989795af508ad, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128863) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 31 15:50:45.299285 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-0744956c-ceae-40d0-a976-f6c5d2f36e81 tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 31 15:50:45.321807 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0744956c-ceae-40d0-a976-f6c5d2f36e81 tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] Request method failure captured: Aug 31 15:50:45.321807 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 31 15:50:45.321807 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:50:45.321807 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:50:45.321807 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:50:45.321807 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 144 Aug 31 15:50:45.321807 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:50:45.321807 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:50:45.321807 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:50:45.321807 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:50:45.321807 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4NM-Bx4D1rJxVmnfH4bVWVQKWSZRjSKNQTi7dXOWZMvl3H4ahwUP2I5wMfWTCGN1PCmUpNzGP_SSdKHruLqTlg4GNNr9uWDvpMkIa03rqncAZYH5Ntv1XLsDYI7jN-6OIz0ZSt5jchkllyTAe2RE-TMBmq-eKxpS_Fp7reydajQlz4 Aug 31 15:50:45.321807 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:50:45.321807 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:50:45.321807 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:50:45.321807 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:50:45.321807 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:50:45.321807 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:50:45.321807 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: ea31993d047a47cbb29989795af508ad Aug 31 15:50:45.321807 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-QuotasAdminNegativeTest-1582847698 Aug 31 15:50:45.321807 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:50:45.321807 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:50:45.323546 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ea31993d047a47cbb29989795af508ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ea31993d047a47cbb29989795af508ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ea31993d047a47cbb29989795af508ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ea31993d047a47cbb29989795af508ad", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:50:45.323546 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-QuotasAdminNegativeTest-1582847698 Aug 31 15:50:45.323546 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: ea31993d047a47cbb29989795af508ad Aug 31 15:50:45.323546 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1582847698 Aug 31 15:50:45.323546 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-QuotasAdminNegativeTest-1582847698-project Aug 31 15:50:45.323546 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:50:45.323546 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:50:45.323546 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: c918fa141b5a4f698999fd151c24437f Aug 31 15:50:45.323546 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-QuotasAdminNegativeTest-1582847698-project Aug 31 15:50:45.323546 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 15:50:45.323546 n-d-833090-16 devstack@n-api.service[128863]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-939462299", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452"}} Aug 31 15:50:45.323546 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 15:50:45.325049 n-d-833090-16 devstack@n-api.service[128863]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 31 15:50:45.325049 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-939462299', 'imageRef': 'd715a41c-0e56-494a-a102-cac65831f6bd', 'flavorRef': '452'}}} Aug 31 15:50:45.325049 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:50:45.325049 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:45.325049 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 31 15:50:45.325049 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 31 15:50:45.325049 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 15:50:45.325049 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 15:50:45.325049 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 31 15:50:45.325049 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc Aug 31 15:50:45.325049 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 31 15:50:45.325049 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 31 15:50:45.325049 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 15:50:45.325049 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 15:50:45.325049 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 31 15:50:45.325049 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 31 15:50:45.325049 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 31 15:50:45.325049 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 31 15:50:45.326418 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 31 15:50:45.326418 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 31 15:50:45.326418 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 31 15:50:45.326418 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:50:45.326418 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:50:45.326418 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:50:45.326418 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:45.326418 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 31 15:50:45.326418 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 31 15:50:45.326418 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 31 15:50:45.326418 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 31 15:50:45.326418 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Aug 31 15:50:45.326418 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 31 15:50:45.326418 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Aug 31 15:50:45.326418 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 31 15:50:45.326418 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 31 15:50:45.326418 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 31 15:50:45.326418 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 31 15:50:45.326418 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:50:45.326418 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:50:45.326418 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:50:45.328378 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:45.328378 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:50:45.328378 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:50:45.328378 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:50:45.328378 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:50:45.328378 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:50:45.328378 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:50:45.328378 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:50:45.328378 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:50:45.328378 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:50:45.328378 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:50:45.328378 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:50:45.328378 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:50:45.328378 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 31 15:50:45.328378 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 31 15:50:45.328378 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 31 15:50:45.328378 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 31 15:50:45.328378 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:50:45.328378 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:50:45.328378 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:50:45.328378 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:45.330811 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:50:45.330811 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:50:45.330811 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:50:45.330811 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:50:45.330811 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 31 15:50:45.330811 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:50:45.330811 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0744956c-ceae-40d0-a976-f6c5d2f36e81 tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:50:45.330811 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0744956c-ceae-40d0-a976-f6c5d2f36e81 tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.489326 Aug 31 15:50:45.330811 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 266/541] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:50:44 2022] POST /compute/v2.1/servers => generated 110 bytes in 494 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:50:45.332369 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4385ce8e-66b9-4d18-a5c4-db6f4add76fb tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:45.334342 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4385ce8e-66b9-4d18-a5c4-db6f4add76fb tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:45.343627 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7c507faf-6c3d-49fd-8fff-160ad71604fa tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6349b0ee9e2142a8a440d4e6ae0703a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33f8cd7d4424157b410b64c7823f480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:45.358782 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7c507faf-6c3d-49fd-8fff-160ad71604fa tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "GET /compute/v2.1/servers/2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881" status: 200 len: 1390 microversion: 2.1 time: 0.314121 Aug 31 15:50:45.361797 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 276/542] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:45 2022] GET /compute/v2.1/servers/2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881 => generated 1390 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:45.368199 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4385ce8e-66b9-4d18-a5c4-db6f4add76fb tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:45.368948 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4385ce8e-66b9-4d18-a5c4-db6f4add76fb tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:45.371885 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4385ce8e-66b9-4d18-a5c4-db6f4add76fb tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:45.372791 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4385ce8e-66b9-4d18-a5c4-db6f4add76fb tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:45.374912 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4385ce8e-66b9-4d18-a5c4-db6f4add76fb tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:45.375638 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4385ce8e-66b9-4d18-a5c4-db6f4add76fb tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:45.380398 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e87bf8c2-3b4f-4107-9ceb-5cfd11c999bc tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:45.381528 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e87bf8c2-3b4f-4107-9ceb-5cfd11c999bc tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 61e7db75-00b5-41e8-8efb-bced641ddd7a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:45.399586 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e87bf8c2-3b4f-4107-9ceb-5cfd11c999bc tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:45.402397 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e87bf8c2-3b4f-4107-9ceb-5cfd11c999bc tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:45.403039 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e87bf8c2-3b4f-4107-9ceb-5cfd11c999bc tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:45.403829 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e87bf8c2-3b4f-4107-9ceb-5cfd11c999bc tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:45.404504 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e87bf8c2-3b4f-4107-9ceb-5cfd11c999bc tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:45.404987 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e87bf8c2-3b4f-4107-9ceb-5cfd11c999bc tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:45.629169 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e87bf8c2-3b4f-4107-9ceb-5cfd11c999bc tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:45.642180 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e87bf8c2-3b4f-4107-9ceb-5cfd11c999bc tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:45.643700 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e87bf8c2-3b4f-4107-9ceb-5cfd11c999bc tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:45.644910 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e87bf8c2-3b4f-4107-9ceb-5cfd11c999bc tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/61e7db75-00b5-41e8-8efb-bced641ddd7a" status: 200 len: 1313 microversion: 2.25 time: 0.277937 Aug 31 15:50:45.645528 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 277/543] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:50:45 2022] GET /compute/v2.1/servers/61e7db75-00b5-41e8-8efb-bced641ddd7a => generated 1313 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:50:45.651675 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-42ef2da2-67e6-4be4-a2cf-985f1769b678 tempest-QuotasAdminNegativeTest-1045278505 tempest-QuotasAdminNegativeTest-1045278505-project-admin] Action: 'update', calling method: .version_select at 0x7fbb46dc0940>, body: {"quota_set": {"ram": 51200}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:50:45.727286 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-4385ce8e-66b9-4d18-a5c4-db6f4add76fb tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lazy-loading 'services' on Instance uuid a71c696b-bfa3-40cd-ba75-af485432d34f {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:50:45.788033 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4385ce8e-66b9-4d18-a5c4-db6f4add76fb tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f" status: 200 len: 1937 microversion: 2.75 time: 0.458934 Aug 31 15:50:45.789065 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 267/544] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:50:45 2022] GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f => generated 1937 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:50:45.805120 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-fab60fe1-e811-42cc-a45d-79ba0e5e8758 req-ae3ec8e1-5b59-4f77-9b41-8790d86d8760 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881", "name": "network-vif-plugged", "status": "completed", "tag": "12f537b0-fb53-4252-b4e9-7a06b83e70f8"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:50:45.829150 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-fab60fe1-e811-42cc-a45d-79ba0e5e8758 req-ae3ec8e1-5b59-4f77-9b41-8790d86d8760 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:45.830593 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-fab60fe1-e811-42cc-a45d-79ba0e5e8758 req-ae3ec8e1-5b59-4f77-9b41-8790d86d8760 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:45.833432 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-fab60fe1-e811-42cc-a45d-79ba0e5e8758 req-ae3ec8e1-5b59-4f77-9b41-8790d86d8760 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:45.865499 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-fab60fe1-e811-42cc-a45d-79ba0e5e8758 req-ae3ec8e1-5b59-4f77-9b41-8790d86d8760 service nova] Creating event network-vif-plugged:12f537b0-fb53-4252-b4e9-7a06b83e70f8 for instance 2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881 on n-h2-833090-16 Aug 31 15:50:45.877351 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-fab60fe1-e811-42cc-a45d-79ba0e5e8758 req-ae3ec8e1-5b59-4f77-9b41-8790d86d8760 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086784 Aug 31 15:50:45.880880 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 268/545] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:50:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:50:45.906715 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-078f31a8-1704-4ada-93d0-bef47b6fb188 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:45.911724 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-078f31a8-1704-4ada-93d0-bef47b6fb188 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: d15c3817-84b0-4e82-86b2-f2333ceeb3cd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:45.928746 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-078f31a8-1704-4ada-93d0-bef47b6fb188 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:45.929612 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-078f31a8-1704-4ada-93d0-bef47b6fb188 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:45.932967 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-078f31a8-1704-4ada-93d0-bef47b6fb188 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:45.935000 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-078f31a8-1704-4ada-93d0-bef47b6fb188 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:45.935713 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-078f31a8-1704-4ada-93d0-bef47b6fb188 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:45.939078 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-078f31a8-1704-4ada-93d0-bef47b6fb188 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:46.179266 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=95,nova_cell0:UPDATE=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:50:46.183637 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-42ef2da2-67e6-4be4-a2cf-985f1769b678 tempest-QuotasAdminNegativeTest-1045278505 tempest-QuotasAdminNegativeTest-1045278505-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:46.186438 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-42ef2da2-67e6-4be4-a2cf-985f1769b678 tempest-QuotasAdminNegativeTest-1045278505 tempest-QuotasAdminNegativeTest-1045278505-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:46.186886 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-42ef2da2-67e6-4be4-a2cf-985f1769b678 tempest-QuotasAdminNegativeTest-1045278505 tempest-QuotasAdminNegativeTest-1045278505-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:46.187709 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-42ef2da2-67e6-4be4-a2cf-985f1769b678 tempest-QuotasAdminNegativeTest-1045278505 tempest-QuotasAdminNegativeTest-1045278505-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:46.188750 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-42ef2da2-67e6-4be4-a2cf-985f1769b678 tempest-QuotasAdminNegativeTest-1045278505 tempest-QuotasAdminNegativeTest-1045278505-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:46.189324 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-42ef2da2-67e6-4be4-a2cf-985f1769b678 tempest-QuotasAdminNegativeTest-1045278505 tempest-QuotasAdminNegativeTest-1045278505-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:46.252658 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:50:46.313871 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-42ef2da2-67e6-4be4-a2cf-985f1769b678 tempest-QuotasAdminNegativeTest-1045278505 tempest-QuotasAdminNegativeTest-1045278505-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/ea31993d047a47cbb29989795af508ad" status: 200 len: 329 microversion: 2.1 time: 0.667144 Aug 31 15:50:46.314944 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 278/546] 10.222.0.50 () {60 vars in 1262 bytes} [Wed Aug 31 15:50:45 2022] PUT /compute/v2.1/os-quota-sets/ea31993d047a47cbb29989795af508ad => generated 329 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:50:46.340633 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-44149cf0-3acb-4f36-a130-f7023c687662 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:46.343002 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-44149cf0-3acb-4f36-a130-f7023c687662 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: a5a21e54-e375-4370-9d9e-b41df3e5922e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:46.353147 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-44149cf0-3acb-4f36-a130-f7023c687662 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:46.353781 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-44149cf0-3acb-4f36-a130-f7023c687662 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:46.354327 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-44149cf0-3acb-4f36-a130-f7023c687662 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:46.355154 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-44149cf0-3acb-4f36-a130-f7023c687662 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:46.356759 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-44149cf0-3acb-4f36-a130-f7023c687662 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:46.357454 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-44149cf0-3acb-4f36-a130-f7023c687662 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:46.495178 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-078f31a8-1704-4ada-93d0-bef47b6fb188 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:46.506393 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-078f31a8-1704-4ada-93d0-bef47b6fb188 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/d15c3817-84b0-4e82-86b2-f2333ceeb3cd" status: 200 len: 1318 microversion: 2.1 time: 0.622984 Aug 31 15:50:46.507304 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 269/547] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:45 2022] GET /compute/v2.1/servers/d15c3817-84b0-4e82-86b2-f2333ceeb3cd => generated 1318 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:46.546537 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a9dedaee-a47d-4d74-9d51-5e388edf2f9c tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] Action: 'update', calling method: .version_select at 0x7fbb46b99430>, body: {"quota_set": {"ram": 0}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:50:46.560223 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a9dedaee-a47d-4d74-9d51-5e388edf2f9c tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'c918fa141b5a4f698999fd151c24437f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea31993d047a47cbb29989795af508ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:46.566058 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a9dedaee-a47d-4d74-9d51-5e388edf2f9c tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] Request method failure captured: Aug 31 15:50:46.566058 n-d-833090-16 devstack@n-api.service[128863]: request: PUT /compute/v2.1/os-quota-sets/ea31993d047a47cbb29989795af508ad HTTP/1.1 Aug 31 15:50:46.566058 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:50:46.566058 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:50:46.566058 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:50:46.566058 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 25 Aug 31 15:50:46.566058 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:50:46.566058 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:50:46.566058 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:50:46.566058 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:50:46.566058 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4NM-Bx4D1rJxVmnfH4bVWVQKWSZRjSKNQTi7dXOWZMvl3H4ahwUP2I5wMfWTCGN1PCmUpNzGP_SSdKHruLqTlg4GNNr9uWDvpMkIa03rqncAZYH5Ntv1XLsDYI7jN-6OIz0ZSt5jchkllyTAe2RE-TMBmq-eKxpS_Fp7reydajQlz4 Aug 31 15:50:46.566058 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:50:46.566058 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:50:46.566058 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:50:46.566058 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:50:46.566058 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:50:46.566058 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:50:46.566058 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: ea31993d047a47cbb29989795af508ad Aug 31 15:50:46.566058 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-QuotasAdminNegativeTest-1582847698 Aug 31 15:50:46.566058 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:50:46.566058 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:50:46.567483 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ea31993d047a47cbb29989795af508ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ea31993d047a47cbb29989795af508ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ea31993d047a47cbb29989795af508ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ea31993d047a47cbb29989795af508ad", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:50:46.567483 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-QuotasAdminNegativeTest-1582847698 Aug 31 15:50:46.567483 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: ea31993d047a47cbb29989795af508ad Aug 31 15:50:46.567483 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1582847698 Aug 31 15:50:46.567483 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-QuotasAdminNegativeTest-1582847698-project Aug 31 15:50:46.567483 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:50:46.567483 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:50:46.567483 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: c918fa141b5a4f698999fd151c24437f Aug 31 15:50:46.567483 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-QuotasAdminNegativeTest-1582847698-project Aug 31 15:50:46.567483 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 15:50:46.567483 n-d-833090-16 devstack@n-api.service[128863]: {"quota_set": {"ram": 0}} Aug 31 15:50:46.567483 n-d-833090-16 devstack@n-api.service[128863]: method: Aug 31 15:50:46.567483 n-d-833090-16 devstack@n-api.service[128863]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 31 15:50:46.567483 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'ea31993d047a47cbb29989795af508ad', 'body': {'quota_set': {'ram': 0}}} Aug 31 15:50:46.568996 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:50:46.568996 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:46.568996 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:50:46.568996 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:50:46.568996 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:50:46.568996 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:50:46.568996 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:50:46.568996 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:50:46.568996 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:50:46.568996 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:50:46.568996 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:50:46.568996 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:50:46.568996 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Aug 31 15:50:46.568996 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Aug 31 15:50:46.568996 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 15:50:46.568996 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:50:46.568996 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 15:50:46.568996 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:50:46.568996 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Aug 31 15:50:46.570224 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Aug 31 15:50:46.570224 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 15:50:46.570224 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 15:50:46.570224 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 15:50:46.570224 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 15:50:46.570224 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:50:46.570224 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:50:46.570224 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:50:46.570224 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:50:46.570224 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 15:50:46.570224 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 15:50:46.570224 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 15:50:46.570224 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 15:50:46.570224 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 15:50:46.570224 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 15:50:46.570224 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 31 15:50:46.570224 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:50:46.570224 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:50:46.570224 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:50:46.570224 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:46.571398 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:50:46.571398 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:50:46.571398 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 15:50:46.571398 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 15:50:46.571398 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 31 15:50:46.571398 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:50:46.571398 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a9dedaee-a47d-4d74-9d51-5e388edf2f9c tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:50:46.571398 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a9dedaee-a47d-4d74-9d51-5e388edf2f9c tempest-QuotasAdminNegativeTest-1582847698 tempest-QuotasAdminNegativeTest-1582847698-project] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/ea31993d047a47cbb29989795af508ad" status: 403 len: 116 microversion: 2.1 time: 0.047503 Aug 31 15:50:46.571398 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 270/548] 10.222.0.50 () {60 vars in 1262 bytes} [Wed Aug 31 15:50:46 2022] PUT /compute/v2.1/os-quota-sets/ea31993d047a47cbb29989795af508ad => generated 116 bytes in 60 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:50:46.583239 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ac11e8d4-e70c-470e-8729-3a342eeaae6e tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:46.583853 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ac11e8d4-e70c-470e-8729-3a342eeaae6e tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: 2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:46.600314 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-44149cf0-3acb-4f36-a130-f7023c687662 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:46.601139 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ac11e8d4-e70c-470e-8729-3a342eeaae6e tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:46.603013 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ac11e8d4-e70c-470e-8729-3a342eeaae6e tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:46.609670 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ac11e8d4-e70c-470e-8729-3a342eeaae6e tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:46.611352 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ac11e8d4-e70c-470e-8729-3a342eeaae6e tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:46.612016 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ac11e8d4-e70c-470e-8729-3a342eeaae6e tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:46.612635 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ac11e8d4-e70c-470e-8729-3a342eeaae6e tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:46.625228 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-44149cf0-3acb-4f36-a130-f7023c687662 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e" status: 200 len: 1462 microversion: 2.1 time: 0.304341 Aug 31 15:50:46.638575 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 279/549] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:46 2022] GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e => generated 1462 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:46.975478 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-42d54ed0-5471-4926-8376-bafb9328ab32 tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:46.976314 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-42d54ed0-5471-4926-8376-bafb9328ab32 tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] [instance: a5a21e54-e375-4370-9d9e-b41df3e5922e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:46.993905 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-42d54ed0-5471-4926-8376-bafb9328ab32 tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:46.995402 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-42d54ed0-5471-4926-8376-bafb9328ab32 tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:46.997567 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-42d54ed0-5471-4926-8376-bafb9328ab32 tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:47.000933 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-42d54ed0-5471-4926-8376-bafb9328ab32 tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:47.003132 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-42d54ed0-5471-4926-8376-bafb9328ab32 tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:47.005084 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-42d54ed0-5471-4926-8376-bafb9328ab32 tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:47.013220 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ac11e8d4-e70c-470e-8729-3a342eeaae6e tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6349b0ee9e2142a8a440d4e6ae0703a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33f8cd7d4424157b410b64c7823f480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:47.020458 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:50:47.029968 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ac11e8d4-e70c-470e-8729-3a342eeaae6e tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "GET /compute/v2.1/servers/2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881" status: 200 len: 1390 microversion: 2.1 time: 0.460885 Aug 31 15:50:47.031468 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 271/550] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:46 2022] GET /compute/v2.1/servers/2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881 => generated 1390 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:47.050412 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9591172f-69fc-4f1c-af58-16d36bdf2598 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:47.051024 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9591172f-69fc-4f1c-af58-16d36bdf2598 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 61e7db75-00b5-41e8-8efb-bced641ddd7a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:47.079654 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9591172f-69fc-4f1c-af58-16d36bdf2598 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:47.080276 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9591172f-69fc-4f1c-af58-16d36bdf2598 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:47.082115 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9591172f-69fc-4f1c-af58-16d36bdf2598 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:47.082853 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9591172f-69fc-4f1c-af58-16d36bdf2598 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:47.083305 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9591172f-69fc-4f1c-af58-16d36bdf2598 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:47.090314 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9591172f-69fc-4f1c-af58-16d36bdf2598 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:47.372058 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9591172f-69fc-4f1c-af58-16d36bdf2598 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:47.386976 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9591172f-69fc-4f1c-af58-16d36bdf2598 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:47.389673 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9591172f-69fc-4f1c-af58-16d36bdf2598 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:47.392548 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9591172f-69fc-4f1c-af58-16d36bdf2598 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/61e7db75-00b5-41e8-8efb-bced641ddd7a" status: 200 len: 1319 microversion: 2.25 time: 0.354453 Aug 31 15:50:47.396174 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 272/551] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:50:47 2022] GET /compute/v2.1/servers/61e7db75-00b5-41e8-8efb-bced641ddd7a => generated 1319 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:50:47.403645 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0649130f-f792-483b-bb32-57fd96baaad9 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:47.407712 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0649130f-f792-483b-bb32-57fd96baaad9 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:47.415030 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0649130f-f792-483b-bb32-57fd96baaad9 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:47.415838 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0649130f-f792-483b-bb32-57fd96baaad9 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:47.416401 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0649130f-f792-483b-bb32-57fd96baaad9 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:47.418025 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0649130f-f792-483b-bb32-57fd96baaad9 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:47.418807 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0649130f-f792-483b-bb32-57fd96baaad9 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:47.420119 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0649130f-f792-483b-bb32-57fd96baaad9 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:47.639969 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-0649130f-f792-483b-bb32-57fd96baaad9 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lazy-loading 'services' on Instance uuid a71c696b-bfa3-40cd-ba75-af485432d34f {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:50:47.685169 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0649130f-f792-483b-bb32-57fd96baaad9 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f" status: 200 len: 1937 microversion: 2.75 time: 0.286876 Aug 31 15:50:47.698963 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 273/552] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:50:47 2022] GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f => generated 1937 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:50:47.698963 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f8f61637-f69d-492b-bf12-4274df6a2eff tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:47.698963 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f8f61637-f69d-492b-bf12-4274df6a2eff tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: d15c3817-84b0-4e82-86b2-f2333ceeb3cd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:47.710164 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8f61637-f69d-492b-bf12-4274df6a2eff tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:47.710736 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8f61637-f69d-492b-bf12-4274df6a2eff tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:47.711739 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8f61637-f69d-492b-bf12-4274df6a2eff tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:47.712487 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8f61637-f69d-492b-bf12-4274df6a2eff tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:47.714248 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8f61637-f69d-492b-bf12-4274df6a2eff tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:47.715613 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8f61637-f69d-492b-bf12-4274df6a2eff tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:47.809187 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-42d54ed0-5471-4926-8376-bafb9328ab32 tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e" status: 200 len: 1615 microversion: 2.1 time: 1.163041 Aug 31 15:50:47.815345 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 280/553] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:46 2022] GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e => generated 1615 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:47.839324 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8186c8bc-d742-4af0-a416-695e370bf50e tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:50:47.840305 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8186c8bc-d742-4af0-a416-695e370bf50e tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] [instance: a5a21e54-e375-4370-9d9e-b41df3e5922e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:47.848180 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8186c8bc-d742-4af0-a416-695e370bf50e tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:47.850739 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8186c8bc-d742-4af0-a416-695e370bf50e tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:47.853306 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8186c8bc-d742-4af0-a416-695e370bf50e tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:47.856060 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8186c8bc-d742-4af0-a416-695e370bf50e tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:47.856652 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8186c8bc-d742-4af0-a416-695e370bf50e tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:47.858525 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8186c8bc-d742-4af0-a416-695e370bf50e tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:48.003560 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8186c8bc-d742-4af0-a416-695e370bf50e tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '77b1ec7373a54f958adddae78b2ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbcc4fab66cb488883527a9fdf315609', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:48.005812 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8186c8bc-d742-4af0-a416-695e370bf50e tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] [instance: a5a21e54-e375-4370-9d9e-b41df3e5922e] flavor_id is None. Assuming migration. {{(pid=128864) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 31 15:50:48.006387 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8186c8bc-d742-4af0-a416-695e370bf50e tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] [instance: a5a21e54-e375-4370-9d9e-b41df3e5922e] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128864) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 31 15:50:48.111166 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f8f61637-f69d-492b-bf12-4274df6a2eff tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:48.124146 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f8f61637-f69d-492b-bf12-4274df6a2eff tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/d15c3817-84b0-4e82-86b2-f2333ceeb3cd" status: 200 len: 1318 microversion: 2.1 time: 0.435066 Aug 31 15:50:48.126034 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 274/554] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:47 2022] GET /compute/v2.1/servers/d15c3817-84b0-4e82-86b2-f2333ceeb3cd => generated 1318 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:48.133719 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2db9a1b4-f6f1-4b37-be07-0e6564fd3988 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:48.137497 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2db9a1b4-f6f1-4b37-be07-0e6564fd3988 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: 2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:48.154581 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2db9a1b4-f6f1-4b37-be07-0e6564fd3988 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:48.156028 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2db9a1b4-f6f1-4b37-be07-0e6564fd3988 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:48.156477 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2db9a1b4-f6f1-4b37-be07-0e6564fd3988 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:48.160179 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2db9a1b4-f6f1-4b37-be07-0e6564fd3988 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:48.161758 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2db9a1b4-f6f1-4b37-be07-0e6564fd3988 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:48.162384 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2db9a1b4-f6f1-4b37-be07-0e6564fd3988 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:48.256772 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8186c8bc-d742-4af0-a416-695e370bf50e tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e/action" status: 202 len: 0 microversion: 2.1 time: 0.417837 Aug 31 15:50:48.258553 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 281/555] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 15:50:47 2022] POST /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e/action => generated 0 bytes in 424 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:50:48.270373 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-a997aac0-b169-4a29-b8e7-aee29222891b req-a5519b43-8c05-4d1c-b82b-bbd79124699f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d15c3817-84b0-4e82-86b2-f2333ceeb3cd", "name": "network-vif-plugged", "status": "completed", "tag": "ee06d5e0-f1bc-4c73-8b29-4e8c0b5df323"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:50:48.289876 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-a997aac0-b169-4a29-b8e7-aee29222891b req-a5519b43-8c05-4d1c-b82b-bbd79124699f service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:48.290766 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-a997aac0-b169-4a29-b8e7-aee29222891b req-a5519b43-8c05-4d1c-b82b-bbd79124699f service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:48.291365 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-a997aac0-b169-4a29-b8e7-aee29222891b req-a5519b43-8c05-4d1c-b82b-bbd79124699f service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:48.309174 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-a997aac0-b169-4a29-b8e7-aee29222891b req-a5519b43-8c05-4d1c-b82b-bbd79124699f service nova] Creating event network-vif-plugged:ee06d5e0-f1bc-4c73-8b29-4e8c0b5df323 for instance d15c3817-84b0-4e82-86b2-f2333ceeb3cd on n-h2-833090-16 Aug 31 15:50:48.322745 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-a997aac0-b169-4a29-b8e7-aee29222891b req-a5519b43-8c05-4d1c-b82b-bbd79124699f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057662 Aug 31 15:50:48.324276 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 282/556] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:50:48.337330 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1e31e76b-9879-48a1-92ba-3dccf4b0605d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:48.340376 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1e31e76b-9879-48a1-92ba-3dccf4b0605d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: a5a21e54-e375-4370-9d9e-b41df3e5922e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:48.353411 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e31e76b-9879-48a1-92ba-3dccf4b0605d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:48.359632 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e31e76b-9879-48a1-92ba-3dccf4b0605d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:48.362218 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e31e76b-9879-48a1-92ba-3dccf4b0605d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:48.363322 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e31e76b-9879-48a1-92ba-3dccf4b0605d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:48.364491 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e31e76b-9879-48a1-92ba-3dccf4b0605d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:48.366834 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e31e76b-9879-48a1-92ba-3dccf4b0605d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:48.784107 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2db9a1b4-f6f1-4b37-be07-0e6564fd3988 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6349b0ee9e2142a8a440d4e6ae0703a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33f8cd7d4424157b410b64c7823f480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:48.796425 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2db9a1b4-f6f1-4b37-be07-0e6564fd3988 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "GET /compute/v2.1/servers/2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881" status: 200 len: 1390 microversion: 2.1 time: 0.669057 Aug 31 15:50:48.797131 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 275/557] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:48 2022] GET /compute/v2.1/servers/2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881 => generated 1390 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:48.804411 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ddb6c517-58ad-4d20-a707-5c2e4b45219d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:48.810910 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ddb6c517-58ad-4d20-a707-5c2e4b45219d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 61e7db75-00b5-41e8-8efb-bced641ddd7a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:48.825868 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ddb6c517-58ad-4d20-a707-5c2e4b45219d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:48.826691 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ddb6c517-58ad-4d20-a707-5c2e4b45219d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:48.827487 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ddb6c517-58ad-4d20-a707-5c2e4b45219d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:48.828645 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ddb6c517-58ad-4d20-a707-5c2e4b45219d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:48.829241 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ddb6c517-58ad-4d20-a707-5c2e4b45219d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:48.829830 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ddb6c517-58ad-4d20-a707-5c2e4b45219d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:49.022929 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1e31e76b-9879-48a1-92ba-3dccf4b0605d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:49.036659 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1e31e76b-9879-48a1-92ba-3dccf4b0605d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e" status: 200 len: 1471 microversion: 2.1 time: 0.708889 Aug 31 15:50:49.037294 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 283/558] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:48 2022] GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e => generated 1471 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:49.054851 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c3ca5628-ecd0-466b-a47b-b6d620e9af14 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:49.058770 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c3ca5628-ecd0-466b-a47b-b6d620e9af14 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:49.085270 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3ca5628-ecd0-466b-a47b-b6d620e9af14 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:49.086560 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3ca5628-ecd0-466b-a47b-b6d620e9af14 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:49.088151 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3ca5628-ecd0-466b-a47b-b6d620e9af14 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:49.091889 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3ca5628-ecd0-466b-a47b-b6d620e9af14 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:49.093802 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3ca5628-ecd0-466b-a47b-b6d620e9af14 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:49.094708 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3ca5628-ecd0-466b-a47b-b6d620e9af14 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:49.301079 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-c3ca5628-ecd0-466b-a47b-b6d620e9af14 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lazy-loading 'services' on Instance uuid a71c696b-bfa3-40cd-ba75-af485432d34f {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:50:49.336441 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c3ca5628-ecd0-466b-a47b-b6d620e9af14 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f" status: 200 len: 1937 microversion: 2.75 time: 0.292022 Aug 31 15:50:49.342604 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 284/559] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:50:49 2022] GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f => generated 1937 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:50:49.348512 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4150dd05-b544-4763-8cd0-6aa49f75318c tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:49.351456 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4150dd05-b544-4763-8cd0-6aa49f75318c tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: d15c3817-84b0-4e82-86b2-f2333ceeb3cd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:49.366049 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4150dd05-b544-4763-8cd0-6aa49f75318c tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:49.368076 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4150dd05-b544-4763-8cd0-6aa49f75318c tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:49.368559 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4150dd05-b544-4763-8cd0-6aa49f75318c tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:49.369396 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4150dd05-b544-4763-8cd0-6aa49f75318c tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:49.369880 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4150dd05-b544-4763-8cd0-6aa49f75318c tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:49.370418 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4150dd05-b544-4763-8cd0-6aa49f75318c tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:49.537013 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ddb6c517-58ad-4d20-a707-5c2e4b45219d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:49.545834 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ddb6c517-58ad-4d20-a707-5c2e4b45219d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:49.547307 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ddb6c517-58ad-4d20-a707-5c2e4b45219d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:49.548433 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ddb6c517-58ad-4d20-a707-5c2e4b45219d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/61e7db75-00b5-41e8-8efb-bced641ddd7a" status: 200 len: 1361 microversion: 2.25 time: 0.750325 Aug 31 15:50:49.559167 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 276/560] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:50:48 2022] GET /compute/v2.1/servers/61e7db75-00b5-41e8-8efb-bced641ddd7a => generated 1361 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:50:49.819733 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b8a79ed4-07ab-417b-b76d-4b172bc0e1ab tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:49.820752 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b8a79ed4-07ab-417b-b76d-4b172bc0e1ab tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: 2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:49.834921 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8a79ed4-07ab-417b-b76d-4b172bc0e1ab tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:49.835407 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8a79ed4-07ab-417b-b76d-4b172bc0e1ab tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:49.836160 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8a79ed4-07ab-417b-b76d-4b172bc0e1ab tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:49.836520 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8a79ed4-07ab-417b-b76d-4b172bc0e1ab tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:49.836957 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8a79ed4-07ab-417b-b76d-4b172bc0e1ab tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:49.838773 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8a79ed4-07ab-417b-b76d-4b172bc0e1ab tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:49.848297 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4150dd05-b544-4763-8cd0-6aa49f75318c tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:49.856576 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:50:49.861934 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4150dd05-b544-4763-8cd0-6aa49f75318c tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/d15c3817-84b0-4e82-86b2-f2333ceeb3cd" status: 200 len: 1318 microversion: 2.1 time: 0.515707 Aug 31 15:50:49.874185 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 285/561] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:49 2022] GET /compute/v2.1/servers/d15c3817-84b0-4e82-86b2-f2333ceeb3cd => generated 1318 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:49.900516 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-bdeb6360-1c72-466e-b3cc-264bcc454382 req-ce6a2200-f202-4635-a33f-7202bbc1f0a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61e7db75-00b5-41e8-8efb-bced641ddd7a", "tag": "034d0508-b254-4514-999a-4b96164ff990"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:50:49.925273 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-bdeb6360-1c72-466e-b3cc-264bcc454382 req-ce6a2200-f202-4635-a33f-7202bbc1f0a9 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:49.926861 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-bdeb6360-1c72-466e-b3cc-264bcc454382 req-ce6a2200-f202-4635-a33f-7202bbc1f0a9 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:49.927305 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-bdeb6360-1c72-466e-b3cc-264bcc454382 req-ce6a2200-f202-4635-a33f-7202bbc1f0a9 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:49.946270 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-bdeb6360-1c72-466e-b3cc-264bcc454382 req-ce6a2200-f202-4635-a33f-7202bbc1f0a9 service nova] Creating event network-changed:034d0508-b254-4514-999a-4b96164ff990 for instance 61e7db75-00b5-41e8-8efb-bced641ddd7a on n-h1-833090-16 Aug 31 15:50:49.952524 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-bdeb6360-1c72-466e-b3cc-264bcc454382 req-ce6a2200-f202-4635-a33f-7202bbc1f0a9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057524 Aug 31 15:50:49.953105 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 286/562] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:50:50.061745 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-67a0a37b-f396-47c9-ba18-1b8dc403b0f7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:50.062497 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-67a0a37b-f396-47c9-ba18-1b8dc403b0f7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: a5a21e54-e375-4370-9d9e-b41df3e5922e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:50.087447 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-67a0a37b-f396-47c9-ba18-1b8dc403b0f7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:50.088023 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-67a0a37b-f396-47c9-ba18-1b8dc403b0f7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:50.088468 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-67a0a37b-f396-47c9-ba18-1b8dc403b0f7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:50.092982 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-67a0a37b-f396-47c9-ba18-1b8dc403b0f7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:50.093544 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-67a0a37b-f396-47c9-ba18-1b8dc403b0f7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:50.095171 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-67a0a37b-f396-47c9-ba18-1b8dc403b0f7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:50.407827 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b8a79ed4-07ab-417b-b76d-4b172bc0e1ab tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6349b0ee9e2142a8a440d4e6ae0703a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33f8cd7d4424157b410b64c7823f480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:50.423238 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b8a79ed4-07ab-417b-b76d-4b172bc0e1ab tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "GET /compute/v2.1/servers/2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881" status: 200 len: 1390 microversion: 2.1 time: 0.609436 Aug 31 15:50:50.424540 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 277/563] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:49 2022] GET /compute/v2.1/servers/2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881 => generated 1390 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:50:50.441519 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-47b7021d-f874-4de5-8f96-eafa418cc6a5 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:50.442269 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-47b7021d-f874-4de5-8f96-eafa418cc6a5 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:50.450864 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47b7021d-f874-4de5-8f96-eafa418cc6a5 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:50.451788 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47b7021d-f874-4de5-8f96-eafa418cc6a5 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:50.452581 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47b7021d-f874-4de5-8f96-eafa418cc6a5 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:50.453518 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47b7021d-f874-4de5-8f96-eafa418cc6a5 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:50.454311 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47b7021d-f874-4de5-8f96-eafa418cc6a5 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:50.455063 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47b7021d-f874-4de5-8f96-eafa418cc6a5 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:50.598656 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-47b7021d-f874-4de5-8f96-eafa418cc6a5 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lazy-loading 'services' on Instance uuid a71c696b-bfa3-40cd-ba75-af485432d34f {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:50:50.617809 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-67a0a37b-f396-47c9-ba18-1b8dc403b0f7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:50.633169 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:50:50.635107 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-47b7021d-f874-4de5-8f96-eafa418cc6a5 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f" status: 200 len: 1937 microversion: 2.75 time: 0.209319 Aug 31 15:50:50.636327 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 278/564] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:50:50 2022] GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f => generated 1937 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:50:50.641206 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-67a0a37b-f396-47c9-ba18-1b8dc403b0f7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e" status: 200 len: 1471 microversion: 2.1 time: 0.586559 Aug 31 15:50:50.642708 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 287/565] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:50 2022] GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e => generated 1471 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:50.647606 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-221e577d-2ba1-4c16-9a69-fc82de6eddcb tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:50.648433 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-221e577d-2ba1-4c16-9a69-fc82de6eddcb tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 61e7db75-00b5-41e8-8efb-bced641ddd7a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:50.658399 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-221e577d-2ba1-4c16-9a69-fc82de6eddcb tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:50.659594 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-221e577d-2ba1-4c16-9a69-fc82de6eddcb tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:50.660052 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-221e577d-2ba1-4c16-9a69-fc82de6eddcb tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:50.661136 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-221e577d-2ba1-4c16-9a69-fc82de6eddcb tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:50.661781 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-221e577d-2ba1-4c16-9a69-fc82de6eddcb tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:50.662236 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-221e577d-2ba1-4c16-9a69-fc82de6eddcb tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:50.890607 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6a241842-d51d-4820-bbe0-c185d45d1231 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:50.891261 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6a241842-d51d-4820-bbe0-c185d45d1231 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: d15c3817-84b0-4e82-86b2-f2333ceeb3cd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:50.902824 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6a241842-d51d-4820-bbe0-c185d45d1231 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:50.903350 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6a241842-d51d-4820-bbe0-c185d45d1231 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:50.903784 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6a241842-d51d-4820-bbe0-c185d45d1231 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:50.904498 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6a241842-d51d-4820-bbe0-c185d45d1231 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:50.904951 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6a241842-d51d-4820-bbe0-c185d45d1231 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:50.910899 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6a241842-d51d-4820-bbe0-c185d45d1231 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:51.189343 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-221e577d-2ba1-4c16-9a69-fc82de6eddcb tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:51.199967 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-221e577d-2ba1-4c16-9a69-fc82de6eddcb tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:51.218953 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-221e577d-2ba1-4c16-9a69-fc82de6eddcb tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:51.220453 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-221e577d-2ba1-4c16-9a69-fc82de6eddcb tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/61e7db75-00b5-41e8-8efb-bced641ddd7a" status: 200 len: 1361 microversion: 2.25 time: 0.582961 Aug 31 15:50:51.237601 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 279/566] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:50:50 2022] GET /compute/v2.1/servers/61e7db75-00b5-41e8-8efb-bced641ddd7a => generated 1361 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:50:51.292816 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6a241842-d51d-4820-bbe0-c185d45d1231 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:51.300695 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6a241842-d51d-4820-bbe0-c185d45d1231 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/d15c3817-84b0-4e82-86b2-f2333ceeb3cd" status: 200 len: 1318 microversion: 2.1 time: 0.415649 Aug 31 15:50:51.304048 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 288/567] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:50 2022] GET /compute/v2.1/servers/d15c3817-84b0-4e82-86b2-f2333ceeb3cd => generated 1318 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:51.445273 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-50f483e1-ea7f-4ca2-b409-721c62b837b3 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:51.446233 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-50f483e1-ea7f-4ca2-b409-721c62b837b3 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: 2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:51.454055 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50f483e1-ea7f-4ca2-b409-721c62b837b3 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:51.454946 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50f483e1-ea7f-4ca2-b409-721c62b837b3 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:51.455611 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50f483e1-ea7f-4ca2-b409-721c62b837b3 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:51.457519 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50f483e1-ea7f-4ca2-b409-721c62b837b3 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:51.458587 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50f483e1-ea7f-4ca2-b409-721c62b837b3 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:51.459217 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50f483e1-ea7f-4ca2-b409-721c62b837b3 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:51.647285 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-50f483e1-ea7f-4ca2-b409-721c62b837b3 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6349b0ee9e2142a8a440d4e6ae0703a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33f8cd7d4424157b410b64c7823f480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:51.662960 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ab0c03df-1edd-473e-bb1c-b8d07cb5c260 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:51.663567 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ab0c03df-1edd-473e-bb1c-b8d07cb5c260 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:51.669252 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-50f483e1-ea7f-4ca2-b409-721c62b837b3 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "GET /compute/v2.1/servers/2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881" status: 200 len: 1390 microversion: 2.1 time: 0.228958 Aug 31 15:50:51.681397 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ab0c03df-1edd-473e-bb1c-b8d07cb5c260 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:51.682186 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ab0c03df-1edd-473e-bb1c-b8d07cb5c260 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:51.683068 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ab0c03df-1edd-473e-bb1c-b8d07cb5c260 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:51.684104 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 280/568] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:51 2022] GET /compute/v2.1/servers/2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881 => generated 1390 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:51.684508 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ab0c03df-1edd-473e-bb1c-b8d07cb5c260 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:51.685153 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ab0c03df-1edd-473e-bb1c-b8d07cb5c260 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:51.685761 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ab0c03df-1edd-473e-bb1c-b8d07cb5c260 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:51.689800 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3fb2332b-2a7e-4761-a509-c4a06a8a9c12 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:51.690712 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3fb2332b-2a7e-4761-a509-c4a06a8a9c12 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: a5a21e54-e375-4370-9d9e-b41df3e5922e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:51.698138 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3fb2332b-2a7e-4761-a509-c4a06a8a9c12 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:51.698863 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3fb2332b-2a7e-4761-a509-c4a06a8a9c12 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:51.700212 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3fb2332b-2a7e-4761-a509-c4a06a8a9c12 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:51.701106 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3fb2332b-2a7e-4761-a509-c4a06a8a9c12 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:51.701766 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3fb2332b-2a7e-4761-a509-c4a06a8a9c12 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:51.702416 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3fb2332b-2a7e-4761-a509-c4a06a8a9c12 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:51.829190 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-ab0c03df-1edd-473e-bb1c-b8d07cb5c260 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lazy-loading 'services' on Instance uuid a71c696b-bfa3-40cd-ba75-af485432d34f {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:50:51.867816 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ab0c03df-1edd-473e-bb1c-b8d07cb5c260 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f" status: 200 len: 1937 microversion: 2.75 time: 0.209068 Aug 31 15:50:51.869240 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 289/569] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:50:51 2022] GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f => generated 1937 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:50:51.981718 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3fb2332b-2a7e-4761-a509-c4a06a8a9c12 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:52.004175 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3fb2332b-2a7e-4761-a509-c4a06a8a9c12 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e" status: 200 len: 1471 microversion: 2.1 time: 0.313850 Aug 31 15:50:52.005641 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 281/570] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:51 2022] GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e => generated 1471 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:52.249166 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e60fd174-8977-4a6b-b4e2-053e4c1991ea tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:52.250359 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e60fd174-8977-4a6b-b4e2-053e4c1991ea tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 61e7db75-00b5-41e8-8efb-bced641ddd7a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:52.271140 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e60fd174-8977-4a6b-b4e2-053e4c1991ea tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:52.272044 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e60fd174-8977-4a6b-b4e2-053e4c1991ea tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:52.273055 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e60fd174-8977-4a6b-b4e2-053e4c1991ea tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:52.274379 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e60fd174-8977-4a6b-b4e2-053e4c1991ea tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:52.275207 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e60fd174-8977-4a6b-b4e2-053e4c1991ea tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:52.276292 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e60fd174-8977-4a6b-b4e2-053e4c1991ea tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:52.323868 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-deee8840-fda6-4e43-b58c-0a9cb97a7860 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:52.324719 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-deee8840-fda6-4e43-b58c-0a9cb97a7860 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: d15c3817-84b0-4e82-86b2-f2333ceeb3cd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:52.344603 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-deee8840-fda6-4e43-b58c-0a9cb97a7860 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:52.346970 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-deee8840-fda6-4e43-b58c-0a9cb97a7860 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:52.347662 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-deee8840-fda6-4e43-b58c-0a9cb97a7860 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:52.349000 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-deee8840-fda6-4e43-b58c-0a9cb97a7860 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:52.349670 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-deee8840-fda6-4e43-b58c-0a9cb97a7860 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:52.358737 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-deee8840-fda6-4e43-b58c-0a9cb97a7860 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:52.584693 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e60fd174-8977-4a6b-b4e2-053e4c1991ea tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:52.648012 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e60fd174-8977-4a6b-b4e2-053e4c1991ea tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:52.669309 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e60fd174-8977-4a6b-b4e2-053e4c1991ea tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:52.671568 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e60fd174-8977-4a6b-b4e2-053e4c1991ea tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/61e7db75-00b5-41e8-8efb-bced641ddd7a" status: 200 len: 1361 microversion: 2.25 time: 0.429907 Aug 31 15:50:52.694028 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 290/571] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:50:52 2022] GET /compute/v2.1/servers/61e7db75-00b5-41e8-8efb-bced641ddd7a => generated 1361 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:50:52.706754 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e367b0f2-f1da-460f-97c8-b1765075f830 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:52.708031 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e367b0f2-f1da-460f-97c8-b1765075f830 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: 2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:52.726212 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e367b0f2-f1da-460f-97c8-b1765075f830 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:52.735948 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e367b0f2-f1da-460f-97c8-b1765075f830 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:52.737270 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e367b0f2-f1da-460f-97c8-b1765075f830 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:52.739196 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e367b0f2-f1da-460f-97c8-b1765075f830 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:52.740501 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e367b0f2-f1da-460f-97c8-b1765075f830 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:52.741704 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e367b0f2-f1da-460f-97c8-b1765075f830 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:53.342193 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-deee8840-fda6-4e43-b58c-0a9cb97a7860 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:53.352310 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-deee8840-fda6-4e43-b58c-0a9cb97a7860 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/d15c3817-84b0-4e82-86b2-f2333ceeb3cd" status: 200 len: 1468 microversion: 2.1 time: 1.034921 Aug 31 15:50:53.354143 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 282/572] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:52 2022] GET /compute/v2.1/servers/d15c3817-84b0-4e82-86b2-f2333ceeb3cd => generated 1468 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:53.359580 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f894c6f8-8778-48e8-91ac-67a7fc564484 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:53.360400 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f894c6f8-8778-48e8-91ac-67a7fc564484 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:53.368285 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f894c6f8-8778-48e8-91ac-67a7fc564484 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:53.369084 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f894c6f8-8778-48e8-91ac-67a7fc564484 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:53.369939 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f894c6f8-8778-48e8-91ac-67a7fc564484 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:53.370951 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f894c6f8-8778-48e8-91ac-67a7fc564484 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:53.371588 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f894c6f8-8778-48e8-91ac-67a7fc564484 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:53.372946 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f894c6f8-8778-48e8-91ac-67a7fc564484 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:53.509924 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-f894c6f8-8778-48e8-91ac-67a7fc564484 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] Lazy-loading 'services' on Instance uuid a71c696b-bfa3-40cd-ba75-af485432d34f {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:50:53.554329 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e367b0f2-f1da-460f-97c8-b1765075f830 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6349b0ee9e2142a8a440d4e6ae0703a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33f8cd7d4424157b410b64c7823f480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:53.554942 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f894c6f8-8778-48e8-91ac-67a7fc564484 tempest-ServersAdmin275Test-321328959 tempest-ServersAdmin275Test-321328959-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f" status: 200 len: 1922 microversion: 2.75 time: 0.199325 Aug 31 15:50:53.556522 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 283/573] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:50:53 2022] GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f => generated 1922 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:50:53.566190 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e367b0f2-f1da-460f-97c8-b1765075f830 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "GET /compute/v2.1/servers/2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881" status: 200 len: 1589 microversion: 2.1 time: 0.867003 Aug 31 15:50:53.574148 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 291/574] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:52 2022] GET /compute/v2.1/servers/2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881 => generated 1589 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:53.587367 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8d47bdda-5637-4ef8-b0b7-c3f2b6049320 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:53.588858 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8d47bdda-5637-4ef8-b0b7-c3f2b6049320 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: a5a21e54-e375-4370-9d9e-b41df3e5922e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:53.601667 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8d47bdda-5637-4ef8-b0b7-c3f2b6049320 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:53.602586 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8d47bdda-5637-4ef8-b0b7-c3f2b6049320 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:53.603227 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8d47bdda-5637-4ef8-b0b7-c3f2b6049320 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:53.614481 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8d47bdda-5637-4ef8-b0b7-c3f2b6049320 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:53.615319 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8d47bdda-5637-4ef8-b0b7-c3f2b6049320 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:53.615982 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8d47bdda-5637-4ef8-b0b7-c3f2b6049320 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:53.776106 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5ef56d09-3385-4b20-861c-bef7e001f030 tempest-SecurityGroupsNegativeTestJSON-410129084 tempest-SecurityGroupsNegativeTestJSON-410129084-project] Calling method '.version_select at 0x7fbb46b99c10>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:53.847175 n-d-833090-16 devstack@n-api.service[128863]: DEBUG neutronclient.v2_0.client [None req-5ef56d09-3385-4b20-861c-bef7e001f030 tempest-SecurityGroupsNegativeTestJSON-410129084 tempest-SecurityGroupsNegativeTestJSON-410129084-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3e641eda-7799-4ecc-aa2c-9c32fa728fda does not exist", "detail": ""}} {{(pid=128863) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 31 15:50:53.847815 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.security_group_api [None req-5ef56d09-3385-4b20-861c-bef7e001f030 tempest-SecurityGroupsNegativeTestJSON-410129084 tempest-SecurityGroupsNegativeTestJSON-410129084-project] Neutron security group 3e641eda-7799-4ecc-aa2c-9c32fa728fda not found {{(pid=128863) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 31 15:50:53.848355 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-5ef56d09-3385-4b20-861c-bef7e001f030 tempest-SecurityGroupsNegativeTestJSON-410129084 tempest-SecurityGroupsNegativeTestJSON-410129084-project] HTTP exception thrown: Security group 3e641eda-7799-4ecc-aa2c-9c32fa728fda does not exist Aug 31 15:50:53.848355 n-d-833090-16 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-1aca653a-7ab8-4263-89c1-196e0b436e91'] Aug 31 15:50:53.864923 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5ef56d09-3385-4b20-861c-bef7e001f030 tempest-SecurityGroupsNegativeTestJSON-410129084 tempest-SecurityGroupsNegativeTestJSON-410129084-project] Request method failure captured: Aug 31 15:50:53.864923 n-d-833090-16 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/os-security-groups/3e641eda-7799-4ecc-aa2c-9c32fa728fda HTTP/1.1 Aug 31 15:50:53.864923 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:50:53.864923 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:50:53.864923 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:50:53.864923 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:50:53.864923 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:50:53.864923 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:50:53.864923 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:50:53.864923 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:50:53.864923 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4NcTWhoRxKn-O2Fco9QK6vzNrRoWVw8H5gM6X2Ugllke2EZctQvD8UDcYZB72rgdg97Gn0F1Mm8riKJmASbTJ79ylZagJONU5ToxTkg6NI-5fQYP1ROYXhPYU6T3JMcpif8l_Et4gCDdgtGHpfwxcVyDTunFVOQm_fvrAZM03SEmA8 Aug 31 15:50:53.864923 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:50:53.864923 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:50:53.864923 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:50:53.864923 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:50:53.864923 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:50:53.864923 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:50:53.864923 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: fa04945541734eb8a00489cbe475c0ea Aug 31 15:50:53.864923 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-410129084 Aug 31 15:50:53.864923 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:50:53.864923 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:50:53.866580 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fa04945541734eb8a00489cbe475c0ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fa04945541734eb8a00489cbe475c0ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/fa04945541734eb8a00489cbe475c0ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_fa04945541734eb8a00489cbe475c0ea", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:50:53.866580 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-410129084 Aug 31 15:50:53.866580 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: fa04945541734eb8a00489cbe475c0ea Aug 31 15:50:53.866580 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-410129084 Aug 31 15:50:53.866580 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-SecurityGroupsNegativeTestJSON-410129084-project Aug 31 15:50:53.866580 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:50:53.866580 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:50:53.866580 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: ce801c3020764d2486387e3060ae48f2 Aug 31 15:50:53.866580 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-410129084-project Aug 31 15:50:53.866580 n-d-833090-16 devstack@n-api.service[128863]: method: Aug 31 15:50:53.866580 n-d-833090-16 devstack@n-api.service[128863]: exception: Security group 3e641eda-7799-4ecc-aa2c-9c32fa728fda does not exist Aug 31 15:50:53.866580 n-d-833090-16 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-1aca653a-7ab8-4263-89c1-196e0b436e91'] Aug 31 15:50:53.866580 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '3e641eda-7799-4ecc-aa2c-9c32fa728fda'} Aug 31 15:50:53.867383 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:50:53.867383 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:53.867383 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 31 15:50:53.867383 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 31 15:50:53.867383 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 15:50:53.867383 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 15:50:53.867383 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 31 15:50:53.867383 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 31 15:50:53.867383 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 15:50:53.867383 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 15:50:53.867383 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 31 15:50:53.867383 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 31 15:50:53.867383 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 15:50:53.867383 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 15:50:53.867383 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 31 15:50:53.867383 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 31 15:50:53.867383 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 15:50:53.867383 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 15:50:53.867383 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 31 15:50:53.868561 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 31 15:50:53.868561 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 15:50:53.868561 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 15:50:53.868561 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 31 15:50:53.868561 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 31 15:50:53.868561 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 31 15:50:53.868561 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 31 15:50:53.868561 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3e641eda-7799-4ecc-aa2c-9c32fa728fda does not exist Aug 31 15:50:53.868561 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1aca653a-7ab8-4263-89c1-196e0b436e91'] Aug 31 15:50:53.868561 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:50:53.868561 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:50:53.868561 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:50:53.868561 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:53.868561 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 31 15:50:53.868561 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 31 15:50:53.868561 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 31 15:50:53.868561 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 31 15:50:53.868561 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3e641eda-7799-4ecc-aa2c-9c32fa728fda does not exist Aug 31 15:50:53.870507 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1aca653a-7ab8-4263-89c1-196e0b436e91'] Aug 31 15:50:53.870507 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:50:53.870507 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:50:53.870507 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:50:53.870507 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:53.870507 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:50:53.870507 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:50:53.870507 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:50:53.870507 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:50:53.870507 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:50:53.870507 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:50:53.870507 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:50:53.870507 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:50:53.870507 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 31 15:50:53.870507 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 31 15:50:53.870507 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3e641eda-7799-4ecc-aa2c-9c32fa728fda does not exist Aug 31 15:50:53.870507 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1aca653a-7ab8-4263-89c1-196e0b436e91'] Aug 31 15:50:53.870507 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:50:53.870507 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:50:53.870507 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:50:53.870507 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:53.873024 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:50:53.873024 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:50:53.873024 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:50:53.873024 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:50:53.873024 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3e641eda-7799-4ecc-aa2c-9c32fa728fda does not exist Aug 31 15:50:53.873024 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1aca653a-7ab8-4263-89c1-196e0b436e91'] Aug 31 15:50:53.873024 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:50:53.873024 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5ef56d09-3385-4b20-861c-bef7e001f030 tempest-SecurityGroupsNegativeTestJSON-410129084 tempest-SecurityGroupsNegativeTestJSON-410129084-project] Returning 404 to user: Security group 3e641eda-7799-4ecc-aa2c-9c32fa728fda does not exist Aug 31 15:50:53.873024 n-d-833090-16 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-1aca653a-7ab8-4263-89c1-196e0b436e91'] {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:50:53.873024 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5ef56d09-3385-4b20-861c-bef7e001f030 tempest-SecurityGroupsNegativeTestJSON-410129084 tempest-SecurityGroupsNegativeTestJSON-410129084-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/3e641eda-7799-4ecc-aa2c-9c32fa728fda" status: 404 len: 194 microversion: 2.1 time: 0.308749 Aug 31 15:50:53.873024 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 284/575] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 31 15:50:53 2022] DELETE /compute/v2.1/os-security-groups/3e641eda-7799-4ecc-aa2c-9c32fa728fda => generated 194 bytes in 310 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:50:53.934079 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8d47bdda-5637-4ef8-b0b7-c3f2b6049320 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:53.942427 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8d47bdda-5637-4ef8-b0b7-c3f2b6049320 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e" status: 200 len: 1471 microversion: 2.1 time: 0.362951 Aug 31 15:50:53.943008 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 292/576] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:53 2022] GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e => generated 1471 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:53.954369 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0ce3cab7-9c8a-4469-a172-0ba7fca55cf9 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:53.954369 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0ce3cab7-9c8a-4469-a172-0ba7fca55cf9 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 19da7b68-c450-41e9-9a0b-135b8105b4d5] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:53.955751 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0ce3cab7-9c8a-4469-a172-0ba7fca55cf9 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:53.956244 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0ce3cab7-9c8a-4469-a172-0ba7fca55cf9 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:53.959489 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0ce3cab7-9c8a-4469-a172-0ba7fca55cf9 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:53.959489 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0ce3cab7-9c8a-4469-a172-0ba7fca55cf9 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:53.959489 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0ce3cab7-9c8a-4469-a172-0ba7fca55cf9 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:53.959489 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0ce3cab7-9c8a-4469-a172-0ba7fca55cf9 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:53.996037 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2ff4749b-b844-4fdf-9b7e-0a3f066e87c6 tempest-SecurityGroupsTestAdminJSON-1677170732 tempest-SecurityGroupsTestAdminJSON-1677170732-project] Action: 'create', calling method: .version_select at 0x7fbb46a39700>, body: {"security_group": {"name": "tempest-securitygroup-1478408679", "description": "tempest-description-1392482238"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:50:54.297353 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0ce3cab7-9c8a-4469-a172-0ba7fca55cf9 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:54.306282 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0ce3cab7-9c8a-4469-a172-0ba7fca55cf9 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/19da7b68-c450-41e9-9a0b-135b8105b4d5" status: 200 len: 1468 microversion: 2.1 time: 0.362131 Aug 31 15:50:54.306847 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 293/577] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:53 2022] GET /compute/v2.1/servers/19da7b68-c450-41e9-9a0b-135b8105b4d5 => generated 1468 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:54.312062 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5953f735-b083-4991-befb-de215fd79be2 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:54.312750 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5953f735-b083-4991-befb-de215fd79be2 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: 2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:54.318836 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5953f735-b083-4991-befb-de215fd79be2 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:54.319499 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5953f735-b083-4991-befb-de215fd79be2 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:54.320195 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5953f735-b083-4991-befb-de215fd79be2 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:54.321255 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5953f735-b083-4991-befb-de215fd79be2 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:54.321881 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5953f735-b083-4991-befb-de215fd79be2 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:54.322496 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5953f735-b083-4991-befb-de215fd79be2 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:54.458758 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5953f735-b083-4991-befb-de215fd79be2 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "GET /compute/v2.1/servers/2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.150634 Aug 31 15:50:54.459894 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 294/578] 10.222.0.50 () {58 vars in 1275 bytes} [Wed Aug 31 15:50:54 2022] GET /compute/v2.1/servers/2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881/os-interface => generated 284 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:50:54.465345 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fb16a246-7b62-4bfe-99ed-29d9bbe12b86 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:54.466030 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fb16a246-7b62-4bfe-99ed-29d9bbe12b86 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:54.477782 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb16a246-7b62-4bfe-99ed-29d9bbe12b86 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:54.483429 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb16a246-7b62-4bfe-99ed-29d9bbe12b86 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:54.484073 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb16a246-7b62-4bfe-99ed-29d9bbe12b86 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:54.485112 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb16a246-7b62-4bfe-99ed-29d9bbe12b86 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:54.485736 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb16a246-7b62-4bfe-99ed-29d9bbe12b86 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:54.486193 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb16a246-7b62-4bfe-99ed-29d9bbe12b86 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:54.532775 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fb16a246-7b62-4bfe-99ed-29d9bbe12b86 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:50:54.670629 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fb16a246-7b62-4bfe-99ed-29d9bbe12b86 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f" status: 204 len: 0 microversion: 2.75 time: 0.208971 Aug 31 15:50:54.672946 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 295/579] 10.222.0.50 () {60 vars in 1280 bytes} [Wed Aug 31 15:50:54 2022] DELETE /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 15:50:54.683689 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-759d0f4d-e78f-4cbe-a645-8472a4c93143 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:54.686013 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-759d0f4d-e78f-4cbe-a645-8472a4c93143 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 61e7db75-00b5-41e8-8efb-bced641ddd7a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:54.699510 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-759d0f4d-e78f-4cbe-a645-8472a4c93143 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:54.700005 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-759d0f4d-e78f-4cbe-a645-8472a4c93143 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:54.700682 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-759d0f4d-e78f-4cbe-a645-8472a4c93143 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:54.701176 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-759d0f4d-e78f-4cbe-a645-8472a4c93143 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:54.701632 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-759d0f4d-e78f-4cbe-a645-8472a4c93143 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:54.702489 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-759d0f4d-e78f-4cbe-a645-8472a4c93143 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:54.842566 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2ff4749b-b844-4fdf-9b7e-0a3f066e87c6 tempest-SecurityGroupsTestAdminJSON-1677170732 tempest-SecurityGroupsTestAdminJSON-1677170732-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.974375 Aug 31 15:50:54.843165 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 285/580] 10.222.0.50 () {60 vars in 1180 bytes} [Wed Aug 31 15:50:53 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:50:54.847783 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b5039504-8b75-49e7-bf54-3715dc145dbd tempest-SecurityGroupsNegativeTestJSON-410129084 tempest-SecurityGroupsNegativeTestJSON-410129084-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.003646 Aug 31 15:50:54.852336 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 286/581] 10.222.0.50 () {58 vars in 1164 bytes} [Wed Aug 31 15:50:54 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 31 15:50:54.858078 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a48434e7-44c0-4997-81d1-5376e320bd17 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:54.863208 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a48434e7-44c0-4997-81d1-5376e320bd17 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:54.864318 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a48434e7-44c0-4997-81d1-5376e320bd17 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Searching by: {'reservation_id': 'r-60xrl1c4', 'deleted': False, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245'} {{(pid=128863) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 15:50:54.870375 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a48434e7-44c0-4997-81d1-5376e320bd17 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:54.871133 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a48434e7-44c0-4997-81d1-5376e320bd17 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:54.871743 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a48434e7-44c0-4997-81d1-5376e320bd17 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:54.872624 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a48434e7-44c0-4997-81d1-5376e320bd17 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:54.873273 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a48434e7-44c0-4997-81d1-5376e320bd17 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:54.874139 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a48434e7-44c0-4997-81d1-5376e320bd17 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:54.966437 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-759d0f4d-e78f-4cbe-a645-8472a4c93143 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:54.983543 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-759d0f4d-e78f-4cbe-a645-8472a4c93143 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:54.985163 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-759d0f4d-e78f-4cbe-a645-8472a4c93143 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:54.990459 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-759d0f4d-e78f-4cbe-a645-8472a4c93143 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/61e7db75-00b5-41e8-8efb-bced641ddd7a" status: 200 len: 1361 microversion: 2.25 time: 0.311827 Aug 31 15:50:55.006163 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 296/582] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:50:54 2022] GET /compute/v2.1/servers/61e7db75-00b5-41e8-8efb-bced641ddd7a => generated 1361 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:50:55.009560 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.multi_cell_list [None req-a48434e7-44c0-4997-81d1-5376e320bd17 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128863) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 15:50:55.012852 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ce216dd3-734b-4372-a364-83395fc3e59a tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:55.013595 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ce216dd3-734b-4372-a364-83395fc3e59a tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:55.021718 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ce216dd3-734b-4372-a364-83395fc3e59a tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:55.022377 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ce216dd3-734b-4372-a364-83395fc3e59a tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:55.022906 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ce216dd3-734b-4372-a364-83395fc3e59a tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:55.023715 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ce216dd3-734b-4372-a364-83395fc3e59a tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:55.024384 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ce216dd3-734b-4372-a364-83395fc3e59a tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:55.024900 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ce216dd3-734b-4372-a364-83395fc3e59a tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:55.119177 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ce216dd3-734b-4372-a364-83395fc3e59a tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:55.125749 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a48434e7-44c0-4997-81d1-5376e320bd17 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:55.130278 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ce216dd3-734b-4372-a364-83395fc3e59a tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:55.132349 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ce216dd3-734b-4372-a364-83395fc3e59a tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:55.139790 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ce216dd3-734b-4372-a364-83395fc3e59a tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] 10.222.0.50 "GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f" status: 200 len: 1444 microversion: 2.75 time: 0.132151 Aug 31 15:50:55.140607 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 297/583] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:50:55 2022] GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f => generated 1444 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:50:55.147069 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-34bca834-ddfb-450a-ab0f-4cbd6164471c tempest-SecurityGroupsTestAdminJSON-1677170732 tempest-SecurityGroupsTestAdminJSON-1677170732-project] Action: 'create', calling method: .version_select at 0x7fbb46d198b0>, body: {"security_group": {"name": "tempest-securitygroup-1639797470", "description": "tempest-description-846332069"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:50:55.148484 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a48434e7-44c0-4997-81d1-5376e320bd17 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:55.149082 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a48434e7-44c0-4997-81d1-5376e320bd17 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:55.149636 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a48434e7-44c0-4997-81d1-5376e320bd17 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:55.400559 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a48434e7-44c0-4997-81d1-5376e320bd17 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/detail?reservation_id=r-60xrl1c4" status: 200 len: 2929 microversion: 2.1 time: 0.547107 Aug 31 15:50:55.401706 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 287/584] 10.222.0.50 () {58 vars in 1197 bytes} [Wed Aug 31 15:50:54 2022] GET /compute/v2.1/servers/detail?reservation_id=r-60xrl1c4 => generated 2929 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:55.418152 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9bd43f75-6c83-440e-bbf1-6cf215592a4d tempest-SecurityGroupsNegativeTestJSON-410129084 tempest-SecurityGroupsNegativeTestJSON-410129084-project] Calling method '.version_select at 0x7fbb46b99040>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:55.585866 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-34bca834-ddfb-450a-ab0f-4cbd6164471c tempest-SecurityGroupsTestAdminJSON-1677170732 tempest-SecurityGroupsTestAdminJSON-1677170732-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.444019 Aug 31 15:50:55.586879 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 298/585] 10.222.0.50 () {60 vars in 1180 bytes} [Wed Aug 31 15:50:55 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:50:55.591834 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-cb36115f-f537-4085-a64c-ed3373a81a15 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:55.592644 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-cb36115f-f537-4085-a64c-ed3373a81a15 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: a5a21e54-e375-4370-9d9e-b41df3e5922e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:55.604854 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb36115f-f537-4085-a64c-ed3373a81a15 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:55.613804 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb36115f-f537-4085-a64c-ed3373a81a15 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:55.614839 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb36115f-f537-4085-a64c-ed3373a81a15 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:55.615772 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb36115f-f537-4085-a64c-ed3373a81a15 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:55.616529 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb36115f-f537-4085-a64c-ed3373a81a15 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:55.617110 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb36115f-f537-4085-a64c-ed3373a81a15 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:55.723139 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9bd43f75-6c83-440e-bbf1-6cf215592a4d tempest-SecurityGroupsNegativeTestJSON-410129084 tempest-SecurityGroupsNegativeTestJSON-410129084-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.319969 Aug 31 15:50:55.723734 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 288/586] 10.222.0.50 () {58 vars in 1158 bytes} [Wed Aug 31 15:50:55 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:50:55.729669 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-20f10597-0b27-46ad-bcb3-99cf2ac3a7fd tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:55.765686 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.compute.server_groups [None req-20f10597-0b27-46ad-bcb3-99cf2ac3a7fd tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Querying cell ff6ab154-5f51-4e0d-922a-904eb5aa20da(cell1) for 2 instances {{(pid=128863) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 31 15:50:55.778713 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20f10597-0b27-46ad-bcb3-99cf2ac3a7fd tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:55.779286 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20f10597-0b27-46ad-bcb3-99cf2ac3a7fd tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:55.779769 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20f10597-0b27-46ad-bcb3-99cf2ac3a7fd tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:55.811464 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-20f10597-0b27-46ad-bcb3-99cf2ac3a7fd tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/os-server-groups/a8426721-d328-4b9e-a0a2-d354113b5300" status: 200 len: 271 microversion: 2.1 time: 0.086643 Aug 31 15:50:55.818001 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 289/587] 10.222.0.50 () {58 vars in 1263 bytes} [Wed Aug 31 15:50:55 2022] GET /compute/v2.1/os-server-groups/a8426721-d328-4b9e-a0a2-d354113b5300 => generated 271 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:50:55.893175 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-cb36115f-f537-4085-a64c-ed3373a81a15 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:55.905225 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-cb36115f-f537-4085-a64c-ed3373a81a15 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e" status: 200 len: 1476 microversion: 2.1 time: 0.317073 Aug 31 15:50:55.909455 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 299/588] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:55 2022] GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e => generated 1476 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:55.912914 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1a24b739-965d-4cc7-a928-7389b88b2a69 tempest-SecurityGroupsTestAdminJSON-2014297923 tempest-SecurityGroupsTestAdminJSON-2014297923-project-admin] Action: 'create', calling method: .version_select at 0x7fbb46b998b0>, body: {"security_group": {"name": "tempest-securitygroup-732601573", "description": "tempest-description-491173743"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:50:55.922006 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-feaafc86-1a3c-4127-8207-4c12f9f3c52a tempest-SecurityGroupsNegativeTestJSON-410129084 tempest-SecurityGroupsNegativeTestJSON-410129084-project] Calling method '.version_select at 0x7fbb46bb38b0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:56.211546 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=34 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:50:56.275641 n-d-833090-16 devstack@n-api.service[128864]: DEBUG neutronclient.v2_0.client [None req-feaafc86-1a3c-4127-8207-4c12f9f3c52a tempest-SecurityGroupsNegativeTestJSON-410129084 tempest-SecurityGroupsNegativeTestJSON-410129084-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=128864) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 31 15:50:56.276425 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-feaafc86-1a3c-4127-8207-4c12f9f3c52a tempest-SecurityGroupsNegativeTestJSON-410129084 tempest-SecurityGroupsNegativeTestJSON-410129084-project] HTTP exception thrown: Insufficient rights for removing default security group. Aug 31 15:50:56.276425 n-d-833090-16 devstack@n-api.service[128864]: Neutron server returns request_ids: ['req-64f8a769-9b7c-4568-8cc7-01b70c260bbd'] Aug 31 15:50:56.281243 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-feaafc86-1a3c-4127-8207-4c12f9f3c52a tempest-SecurityGroupsNegativeTestJSON-410129084 tempest-SecurityGroupsNegativeTestJSON-410129084-project] Request method failure captured: Aug 31 15:50:56.281243 n-d-833090-16 devstack@n-api.service[128864]: request: DELETE /compute/v2.1/os-security-groups/82ab5645-4fbb-4345-8231-24ba7037dbae HTTP/1.1 Aug 31 15:50:56.281243 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:50:56.281243 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:50:56.281243 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:50:56.281243 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:50:56.281243 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:50:56.281243 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:50:56.281243 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:50:56.281243 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:50:56.281243 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4NcTWhoRxKn-O2Fco9QK6vzNrRoWVw8H5gM6X2Ugllke2EZctQvD8UDcYZB72rgdg97Gn0F1Mm8riKJmASbTJ79ylZagJONU5ToxTkg6NI-5fQYP1ROYXhPYU6T3JMcpif8l_Et4gCDdgtGHpfwxcVyDTunFVOQm_fvrAZM03SEmA8 Aug 31 15:50:56.281243 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:50:56.281243 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:50:56.281243 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:50:56.281243 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:50:56.281243 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:50:56.281243 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:50:56.281243 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: fa04945541734eb8a00489cbe475c0ea Aug 31 15:50:56.281243 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-410129084 Aug 31 15:50:56.281243 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:50:56.281243 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:50:56.282871 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fa04945541734eb8a00489cbe475c0ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fa04945541734eb8a00489cbe475c0ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/fa04945541734eb8a00489cbe475c0ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_fa04945541734eb8a00489cbe475c0ea", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:50:56.282871 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-410129084 Aug 31 15:50:56.282871 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: fa04945541734eb8a00489cbe475c0ea Aug 31 15:50:56.282871 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-410129084 Aug 31 15:50:56.282871 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-SecurityGroupsNegativeTestJSON-410129084-project Aug 31 15:50:56.282871 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:50:56.282871 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:50:56.282871 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: ce801c3020764d2486387e3060ae48f2 Aug 31 15:50:56.282871 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-410129084-project Aug 31 15:50:56.282871 n-d-833090-16 devstack@n-api.service[128864]: method: Aug 31 15:50:56.282871 n-d-833090-16 devstack@n-api.service[128864]: exception: Insufficient rights for removing default security group. Aug 31 15:50:56.282871 n-d-833090-16 devstack@n-api.service[128864]: Neutron server returns request_ids: ['req-64f8a769-9b7c-4568-8cc7-01b70c260bbd'] Aug 31 15:50:56.282871 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '82ab5645-4fbb-4345-8231-24ba7037dbae'} Aug 31 15:50:56.283935 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:50:56.283935 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:56.283935 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 31 15:50:56.283935 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 31 15:50:56.283935 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 15:50:56.283935 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 15:50:56.283935 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 31 15:50:56.283935 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 31 15:50:56.283935 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 15:50:56.283935 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 15:50:56.283935 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 31 15:50:56.283935 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 31 15:50:56.283935 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 15:50:56.283935 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 15:50:56.283935 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 31 15:50:56.283935 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 31 15:50:56.283935 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 15:50:56.283935 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 15:50:56.283935 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 31 15:50:56.285283 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 31 15:50:56.285283 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 15:50:56.285283 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 15:50:56.285283 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 31 15:50:56.285283 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 31 15:50:56.285283 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 31 15:50:56.285283 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 31 15:50:56.285283 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Aug 31 15:50:56.285283 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-64f8a769-9b7c-4568-8cc7-01b70c260bbd'] Aug 31 15:50:56.285283 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:56.285283 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:50:56.285283 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:56.285283 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:56.285283 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 31 15:50:56.285283 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 31 15:50:56.285283 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 31 15:50:56.285283 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 31 15:50:56.285283 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Aug 31 15:50:56.285283 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-64f8a769-9b7c-4568-8cc7-01b70c260bbd'] Aug 31 15:50:56.286551 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:56.286551 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:50:56.286551 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:56.286551 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:56.286551 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:50:56.286551 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:50:56.286551 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:50:56.286551 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:50:56.286551 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:50:56.286551 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:50:56.286551 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:50:56.286551 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:50:56.286551 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 31 15:50:56.286551 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 31 15:50:56.286551 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Aug 31 15:50:56.286551 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-64f8a769-9b7c-4568-8cc7-01b70c260bbd'] Aug 31 15:50:56.286551 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:56.286551 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:50:56.286551 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:56.286551 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:56.286551 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:50:56.287985 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:50:56.287985 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:50:56.287985 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:50:56.287985 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Aug 31 15:50:56.287985 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-64f8a769-9b7c-4568-8cc7-01b70c260bbd'] Aug 31 15:50:56.287985 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:56.287985 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-feaafc86-1a3c-4127-8207-4c12f9f3c52a tempest-SecurityGroupsNegativeTestJSON-410129084 tempest-SecurityGroupsNegativeTestJSON-410129084-project] Returning 400 to user: Insufficient rights for removing default security group. Aug 31 15:50:56.287985 n-d-833090-16 devstack@n-api.service[128864]: Neutron server returns request_ids: ['req-64f8a769-9b7c-4568-8cc7-01b70c260bbd'] {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:50:56.287985 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-feaafc86-1a3c-4127-8207-4c12f9f3c52a tempest-SecurityGroupsNegativeTestJSON-410129084 tempest-SecurityGroupsNegativeTestJSON-410129084-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/82ab5645-4fbb-4345-8231-24ba7037dbae" status: 400 len: 182 microversion: 2.1 time: 0.371173 Aug 31 15:50:56.290418 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 300/589] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 31 15:50:55 2022] DELETE /compute/v2.1/os-security-groups/82ab5645-4fbb-4345-8231-24ba7037dbae => generated 182 bytes in 380 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 15:50:56.302899 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fe37c331-a009-4ba2-92a4-ded2c196c7e2 tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:56.303676 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fe37c331-a009-4ba2-92a4-ded2c196c7e2 tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] [instance: 19da7b68-c450-41e9-9a0b-135b8105b4d5] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:56.319931 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=7 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:50:56.323089 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fe37c331-a009-4ba2-92a4-ded2c196c7e2 tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:56.326716 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fe37c331-a009-4ba2-92a4-ded2c196c7e2 tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:56.327384 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fe37c331-a009-4ba2-92a4-ded2c196c7e2 tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:56.328296 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fe37c331-a009-4ba2-92a4-ded2c196c7e2 tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:56.328956 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fe37c331-a009-4ba2-92a4-ded2c196c7e2 tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:56.333364 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fe37c331-a009-4ba2-92a4-ded2c196c7e2 tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:56.409883 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1a24b739-965d-4cc7-a928-7389b88b2a69 tempest-SecurityGroupsTestAdminJSON-2014297923 tempest-SecurityGroupsTestAdminJSON-2014297923-project-admin] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.590399 Aug 31 15:50:56.410690 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 290/590] 10.222.0.50 () {60 vars in 1180 bytes} [Wed Aug 31 15:50:55 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:50:56.416164 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e50cb39e-c68b-4b12-82be-d2ec6c7b292e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:56.416907 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e50cb39e-c68b-4b12-82be-d2ec6c7b292e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 61e7db75-00b5-41e8-8efb-bced641ddd7a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:56.429958 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e50cb39e-c68b-4b12-82be-d2ec6c7b292e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:56.430483 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e50cb39e-c68b-4b12-82be-d2ec6c7b292e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:56.434805 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e50cb39e-c68b-4b12-82be-d2ec6c7b292e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:56.435726 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e50cb39e-c68b-4b12-82be-d2ec6c7b292e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:56.436775 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e50cb39e-c68b-4b12-82be-d2ec6c7b292e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:56.436775 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e50cb39e-c68b-4b12-82be-d2ec6c7b292e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:56.704817 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fe37c331-a009-4ba2-92a4-ded2c196c7e2 tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/19da7b68-c450-41e9-9a0b-135b8105b4d5" status: 200 len: 1621 microversion: 2.1 time: 0.413199 Aug 31 15:50:56.707875 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 301/591] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:56 2022] GET /compute/v2.1/servers/19da7b68-c450-41e9-9a0b-135b8105b4d5 => generated 1621 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:56.710213 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e50cb39e-c68b-4b12-82be-d2ec6c7b292e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:56.720910 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0a28c45c-d933-4623-925d-e696ba89cbae tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:56.721682 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e50cb39e-c68b-4b12-82be-d2ec6c7b292e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:56.723959 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0a28c45c-d933-4623-925d-e696ba89cbae tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:56.724807 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e50cb39e-c68b-4b12-82be-d2ec6c7b292e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:56.726839 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e50cb39e-c68b-4b12-82be-d2ec6c7b292e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/61e7db75-00b5-41e8-8efb-bced641ddd7a" status: 200 len: 1361 microversion: 2.25 time: 0.314905 Aug 31 15:50:56.764277 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0a28c45c-d933-4623-925d-e696ba89cbae tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:56.770077 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0a28c45c-d933-4623-925d-e696ba89cbae tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:56.770576 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0a28c45c-d933-4623-925d-e696ba89cbae tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:56.773664 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0a28c45c-d933-4623-925d-e696ba89cbae tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:56.774382 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0a28c45c-d933-4623-925d-e696ba89cbae tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:56.776264 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 291/592] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:50:56 2022] GET /compute/v2.1/servers/61e7db75-00b5-41e8-8efb-bced641ddd7a => generated 1361 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:50:56.776963 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0a28c45c-d933-4623-925d-e696ba89cbae tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:56.782242 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9828283a-ee53-4992-b666-f68858231f38 tempest-SecurityGroupsNegativeTestJSON-410129084 tempest-SecurityGroupsNegativeTestJSON-410129084-project] Calling method '.version_select at 0x7fbb469cd790>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:56.819634 n-d-833090-16 devstack@n-api.service[128863]: DEBUG neutronclient.v2_0.client [None req-9828283a-ee53-4992-b666-f68858231f38 tempest-SecurityGroupsNegativeTestJSON-410129084 tempest-SecurityGroupsNegativeTestJSON-410129084-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group cfd1783a-2a75-4289-9d80-323fdc1423ba does not exist", "detail": ""}} {{(pid=128863) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 31 15:50:56.820333 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.security_group_api [None req-9828283a-ee53-4992-b666-f68858231f38 tempest-SecurityGroupsNegativeTestJSON-410129084 tempest-SecurityGroupsNegativeTestJSON-410129084-project] Neutron security group cfd1783a-2a75-4289-9d80-323fdc1423ba not found {{(pid=128863) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 31 15:50:56.821051 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-9828283a-ee53-4992-b666-f68858231f38 tempest-SecurityGroupsNegativeTestJSON-410129084 tempest-SecurityGroupsNegativeTestJSON-410129084-project] HTTP exception thrown: Security group cfd1783a-2a75-4289-9d80-323fdc1423ba does not exist Aug 31 15:50:56.821051 n-d-833090-16 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-1c9ce17e-e7a3-4524-8406-fc4d455f2110'] Aug 31 15:50:56.823164 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9828283a-ee53-4992-b666-f68858231f38 tempest-SecurityGroupsNegativeTestJSON-410129084 tempest-SecurityGroupsNegativeTestJSON-410129084-project] Request method failure captured: Aug 31 15:50:56.823164 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/os-security-groups/cfd1783a-2a75-4289-9d80-323fdc1423ba HTTP/1.1 Aug 31 15:50:56.823164 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:50:56.823164 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:50:56.823164 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:50:56.823164 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:50:56.823164 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:50:56.823164 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:50:56.823164 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:50:56.823164 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:50:56.823164 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4NcTWhoRxKn-O2Fco9QK6vzNrRoWVw8H5gM6X2Ugllke2EZctQvD8UDcYZB72rgdg97Gn0F1Mm8riKJmASbTJ79ylZagJONU5ToxTkg6NI-5fQYP1ROYXhPYU6T3JMcpif8l_Et4gCDdgtGHpfwxcVyDTunFVOQm_fvrAZM03SEmA8 Aug 31 15:50:56.823164 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:50:56.823164 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:50:56.823164 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:50:56.823164 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:50:56.823164 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:50:56.823164 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:50:56.823164 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: fa04945541734eb8a00489cbe475c0ea Aug 31 15:50:56.823164 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-410129084 Aug 31 15:50:56.823164 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:50:56.823164 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:50:56.824666 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fa04945541734eb8a00489cbe475c0ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fa04945541734eb8a00489cbe475c0ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/fa04945541734eb8a00489cbe475c0ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_fa04945541734eb8a00489cbe475c0ea", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:50:56.824666 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-410129084 Aug 31 15:50:56.824666 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: fa04945541734eb8a00489cbe475c0ea Aug 31 15:50:56.824666 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-410129084 Aug 31 15:50:56.824666 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-SecurityGroupsNegativeTestJSON-410129084-project Aug 31 15:50:56.824666 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:50:56.824666 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:50:56.824666 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: ce801c3020764d2486387e3060ae48f2 Aug 31 15:50:56.824666 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-410129084-project Aug 31 15:50:56.824666 n-d-833090-16 devstack@n-api.service[128863]: method: Aug 31 15:50:56.824666 n-d-833090-16 devstack@n-api.service[128863]: exception: Security group cfd1783a-2a75-4289-9d80-323fdc1423ba does not exist Aug 31 15:50:56.824666 n-d-833090-16 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-1c9ce17e-e7a3-4524-8406-fc4d455f2110'] Aug 31 15:50:56.824666 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'cfd1783a-2a75-4289-9d80-323fdc1423ba'} Aug 31 15:50:56.825599 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:50:56.825599 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:56.825599 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 31 15:50:56.825599 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 31 15:50:56.825599 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 15:50:56.825599 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 15:50:56.825599 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 31 15:50:56.825599 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 31 15:50:56.825599 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 15:50:56.825599 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 15:50:56.825599 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 31 15:50:56.825599 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 31 15:50:56.825599 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 15:50:56.825599 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 15:50:56.825599 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 31 15:50:56.825599 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 31 15:50:56.825599 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 15:50:56.825599 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 15:50:56.825599 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 31 15:50:56.826928 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 31 15:50:56.826928 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 15:50:56.826928 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 15:50:56.826928 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 31 15:50:56.826928 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 31 15:50:56.826928 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 31 15:50:56.826928 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 31 15:50:56.826928 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group cfd1783a-2a75-4289-9d80-323fdc1423ba does not exist Aug 31 15:50:56.826928 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1c9ce17e-e7a3-4524-8406-fc4d455f2110'] Aug 31 15:50:56.826928 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:50:56.826928 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:50:56.826928 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:50:56.826928 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:56.826928 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 31 15:50:56.826928 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 31 15:50:56.826928 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 31 15:50:56.826928 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 31 15:50:56.826928 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group cfd1783a-2a75-4289-9d80-323fdc1423ba does not exist Aug 31 15:50:56.828208 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1c9ce17e-e7a3-4524-8406-fc4d455f2110'] Aug 31 15:50:56.828208 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:50:56.828208 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:50:56.828208 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:50:56.828208 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:56.828208 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:50:56.828208 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:50:56.828208 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:50:56.828208 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:50:56.828208 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:50:56.828208 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:50:56.828208 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:50:56.828208 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:50:56.828208 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 31 15:50:56.828208 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 31 15:50:56.828208 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group cfd1783a-2a75-4289-9d80-323fdc1423ba does not exist Aug 31 15:50:56.828208 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1c9ce17e-e7a3-4524-8406-fc4d455f2110'] Aug 31 15:50:56.828208 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:50:56.828208 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:50:56.828208 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:50:56.828208 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:56.829576 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:50:56.829576 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:50:56.829576 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:50:56.829576 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:50:56.829576 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group cfd1783a-2a75-4289-9d80-323fdc1423ba does not exist Aug 31 15:50:56.829576 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1c9ce17e-e7a3-4524-8406-fc4d455f2110'] Aug 31 15:50:56.829576 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:50:56.829576 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9828283a-ee53-4992-b666-f68858231f38 tempest-SecurityGroupsNegativeTestJSON-410129084 tempest-SecurityGroupsNegativeTestJSON-410129084-project] Returning 404 to user: Security group cfd1783a-2a75-4289-9d80-323fdc1423ba does not exist Aug 31 15:50:56.829576 n-d-833090-16 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-1c9ce17e-e7a3-4524-8406-fc4d455f2110'] {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:50:56.829576 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9828283a-ee53-4992-b666-f68858231f38 tempest-SecurityGroupsNegativeTestJSON-410129084 tempest-SecurityGroupsNegativeTestJSON-410129084-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups/cfd1783a-2a75-4289-9d80-323fdc1423ba" status: 404 len: 194 microversion: 2.1 time: 0.048553 Aug 31 15:50:56.829576 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 292/593] 10.222.0.50 () {58 vars in 1269 bytes} [Wed Aug 31 15:50:56 2022] GET /compute/v2.1/os-security-groups/cfd1783a-2a75-4289-9d80-323fdc1423ba => generated 194 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:50:56.841140 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e5141cbd-1f90-451e-8db6-a0f09f1cedbb tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:56.843016 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e5141cbd-1f90-451e-8db6-a0f09f1cedbb tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: 2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:56.858813 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e5141cbd-1f90-451e-8db6-a0f09f1cedbb tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:56.861201 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0a28c45c-d933-4623-925d-e696ba89cbae tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:56.861862 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e5141cbd-1f90-451e-8db6-a0f09f1cedbb tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:56.862446 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e5141cbd-1f90-451e-8db6-a0f09f1cedbb tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:56.870219 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e5141cbd-1f90-451e-8db6-a0f09f1cedbb tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:56.870991 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0a28c45c-d933-4623-925d-e696ba89cbae tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:56.871124 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e5141cbd-1f90-451e-8db6-a0f09f1cedbb tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:56.871522 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e5141cbd-1f90-451e-8db6-a0f09f1cedbb tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:56.872528 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0a28c45c-d933-4623-925d-e696ba89cbae tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62c3220431874b2395d0059d57660050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd52ac8c8bc0e42f79e9db32a94b5f0e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:56.879585 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0a28c45c-d933-4623-925d-e696ba89cbae tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] 10.222.0.50 "GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f" status: 200 len: 1444 microversion: 2.75 time: 0.169673 Aug 31 15:50:56.882665 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 302/594] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:50:56 2022] GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f => generated 1444 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:50:56.897130 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-e447798c-7e19-4666-ac23-03899c5a2676 req-9d03aec4-03f8-4d5d-8e8d-3d8d70c03fb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881", "tag": "12f537b0-fb53-4252-b4e9-7a06b83e70f8"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:50:56.911634 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-e447798c-7e19-4666-ac23-03899c5a2676 req-9d03aec4-03f8-4d5d-8e8d-3d8d70c03fb0 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:56.912442 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-e447798c-7e19-4666-ac23-03899c5a2676 req-9d03aec4-03f8-4d5d-8e8d-3d8d70c03fb0 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:56.913067 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-e447798c-7e19-4666-ac23-03899c5a2676 req-9d03aec4-03f8-4d5d-8e8d-3d8d70c03fb0 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:56.928442 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-e447798c-7e19-4666-ac23-03899c5a2676 req-9d03aec4-03f8-4d5d-8e8d-3d8d70c03fb0 service nova] Creating event network-changed:12f537b0-fb53-4252-b4e9-7a06b83e70f8 for instance 2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881 on n-h2-833090-16 Aug 31 15:50:56.937677 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:50:56.938633 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-e447798c-7e19-4666-ac23-03899c5a2676 req-9d03aec4-03f8-4d5d-8e8d-3d8d70c03fb0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053034 Aug 31 15:50:56.942582 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 303/595] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:50:56.954339 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7cca8ce4-fc3c-4f19-9d6a-df54849a9fdf tempest-SecurityGroupsTestAdminJSON-2014297923 tempest-SecurityGroupsTestAdminJSON-2014297923-project-admin] Action: 'create', calling method: .version_select at 0x7fbb46b6eee0>, body: {"security_group": {"name": "tempest-securitygroup-177826666", "description": "tempest-description-1572670107"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:50:57.332419 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e5141cbd-1f90-451e-8db6-a0f09f1cedbb tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6349b0ee9e2142a8a440d4e6ae0703a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33f8cd7d4424157b410b64c7823f480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:57.346154 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e5141cbd-1f90-451e-8db6-a0f09f1cedbb tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "GET /compute/v2.1/servers/2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881" status: 200 len: 1589 microversion: 2.1 time: 0.515869 Aug 31 15:50:57.349328 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 293/596] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:56 2022] GET /compute/v2.1/servers/2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881 => generated 1589 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:57.358632 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c6117416-6b0d-44fa-9403-0f22672a1fc2 tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:57.362694 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c6117416-6b0d-44fa-9403-0f22672a1fc2 tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] [instance: d15c3817-84b0-4e82-86b2-f2333ceeb3cd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:57.395256 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6117416-6b0d-44fa-9403-0f22672a1fc2 tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:57.400409 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6117416-6b0d-44fa-9403-0f22672a1fc2 tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:57.401125 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6117416-6b0d-44fa-9403-0f22672a1fc2 tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:57.402153 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6117416-6b0d-44fa-9403-0f22672a1fc2 tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:57.402630 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6117416-6b0d-44fa-9403-0f22672a1fc2 tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:57.403048 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6117416-6b0d-44fa-9403-0f22672a1fc2 tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:57.504653 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7cca8ce4-fc3c-4f19-9d6a-df54849a9fdf tempest-SecurityGroupsTestAdminJSON-2014297923 tempest-SecurityGroupsTestAdminJSON-2014297923-project-admin] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.560734 Aug 31 15:50:57.505408 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 304/597] 10.222.0.50 () {60 vars in 1180 bytes} [Wed Aug 31 15:50:56 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:50:57.513469 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e7630632-2da4-4abc-ae3b-3784a4126476 tempest-SecurityGroupsNegativeTestJSON-410129084 tempest-SecurityGroupsNegativeTestJSON-410129084-project] Action: 'update', calling method: .version_select at 0x7fbb46bb3040>, body: {"security_group": {"name": "tempest-sg-312852461", "description": "tempest-description-473099929"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:50:57.596453 n-d-833090-16 devstack@n-api.service[128864]: DEBUG neutronclient.v2_0.client [None req-e7630632-2da4-4abc-ae3b-3784a4126476 tempest-SecurityGroupsNegativeTestJSON-410129084 tempest-SecurityGroupsNegativeTestJSON-410129084-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c9a176c6-4328-457d-b56b-182a1302e0a0 does not exist", "detail": ""}} {{(pid=128864) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 31 15:50:57.597054 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.security_group_api [None req-e7630632-2da4-4abc-ae3b-3784a4126476 tempest-SecurityGroupsNegativeTestJSON-410129084 tempest-SecurityGroupsNegativeTestJSON-410129084-project] Neutron security group c9a176c6-4328-457d-b56b-182a1302e0a0 not found {{(pid=128864) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 31 15:50:57.597582 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-e7630632-2da4-4abc-ae3b-3784a4126476 tempest-SecurityGroupsNegativeTestJSON-410129084 tempest-SecurityGroupsNegativeTestJSON-410129084-project] HTTP exception thrown: Security group c9a176c6-4328-457d-b56b-182a1302e0a0 does not exist Aug 31 15:50:57.597582 n-d-833090-16 devstack@n-api.service[128864]: Neutron server returns request_ids: ['req-5f71d9b6-e170-46d1-87a7-df741191b688'] Aug 31 15:50:57.599606 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e7630632-2da4-4abc-ae3b-3784a4126476 tempest-SecurityGroupsNegativeTestJSON-410129084 tempest-SecurityGroupsNegativeTestJSON-410129084-project] Request method failure captured: Aug 31 15:50:57.599606 n-d-833090-16 devstack@n-api.service[128864]: request: PUT /compute/v2.1/os-security-groups/c9a176c6-4328-457d-b56b-182a1302e0a0 HTTP/1.1 Aug 31 15:50:57.599606 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:50:57.599606 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:50:57.599606 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:50:57.599606 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 100 Aug 31 15:50:57.599606 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:50:57.599606 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:50:57.599606 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:50:57.599606 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:50:57.599606 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4NcTWhoRxKn-O2Fco9QK6vzNrRoWVw8H5gM6X2Ugllke2EZctQvD8UDcYZB72rgdg97Gn0F1Mm8riKJmASbTJ79ylZagJONU5ToxTkg6NI-5fQYP1ROYXhPYU6T3JMcpif8l_Et4gCDdgtGHpfwxcVyDTunFVOQm_fvrAZM03SEmA8 Aug 31 15:50:57.599606 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:50:57.599606 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:50:57.599606 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:50:57.599606 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:50:57.599606 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:50:57.599606 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:50:57.599606 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: fa04945541734eb8a00489cbe475c0ea Aug 31 15:50:57.599606 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-410129084 Aug 31 15:50:57.599606 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:50:57.599606 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:50:57.600967 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fa04945541734eb8a00489cbe475c0ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fa04945541734eb8a00489cbe475c0ea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/fa04945541734eb8a00489cbe475c0ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_fa04945541734eb8a00489cbe475c0ea", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:50:57.600967 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-410129084 Aug 31 15:50:57.600967 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: fa04945541734eb8a00489cbe475c0ea Aug 31 15:50:57.600967 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-410129084 Aug 31 15:50:57.600967 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-SecurityGroupsNegativeTestJSON-410129084-project Aug 31 15:50:57.600967 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:50:57.600967 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:50:57.600967 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: ce801c3020764d2486387e3060ae48f2 Aug 31 15:50:57.600967 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-410129084-project Aug 31 15:50:57.600967 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 15:50:57.600967 n-d-833090-16 devstack@n-api.service[128864]: {"security_group": {"name": "tempest-sg-312852461", "description": "tempest-description-473099929"}} Aug 31 15:50:57.600967 n-d-833090-16 devstack@n-api.service[128864]: method: Aug 31 15:50:57.600967 n-d-833090-16 devstack@n-api.service[128864]: exception: Security group c9a176c6-4328-457d-b56b-182a1302e0a0 does not exist Aug 31 15:50:57.601729 n-d-833090-16 devstack@n-api.service[128864]: Neutron server returns request_ids: ['req-5f71d9b6-e170-46d1-87a7-df741191b688'] Aug 31 15:50:57.601729 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'c9a176c6-4328-457d-b56b-182a1302e0a0', 'body': {'security_group': {'name': 'tempest-sg-312852461', 'description': 'tempest-description-473099929'}}} Aug 31 15:50:57.601729 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:50:57.601729 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:57.601729 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 31 15:50:57.601729 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 31 15:50:57.601729 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 15:50:57.601729 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 15:50:57.601729 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 31 15:50:57.601729 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 31 15:50:57.601729 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 15:50:57.601729 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 15:50:57.601729 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 31 15:50:57.601729 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 31 15:50:57.601729 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 15:50:57.601729 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 15:50:57.601729 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 31 15:50:57.601729 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 31 15:50:57.602813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 15:50:57.602813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 15:50:57.602813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 31 15:50:57.602813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 31 15:50:57.602813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 15:50:57.602813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 15:50:57.602813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 31 15:50:57.602813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 31 15:50:57.602813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 31 15:50:57.602813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 31 15:50:57.602813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c9a176c6-4328-457d-b56b-182a1302e0a0 does not exist Aug 31 15:50:57.602813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5f71d9b6-e170-46d1-87a7-df741191b688'] Aug 31 15:50:57.602813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:57.602813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:50:57.602813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:57.602813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:57.602813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Aug 31 15:50:57.602813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 31 15:50:57.602813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 31 15:50:57.604055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 31 15:50:57.604055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c9a176c6-4328-457d-b56b-182a1302e0a0 does not exist Aug 31 15:50:57.604055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5f71d9b6-e170-46d1-87a7-df741191b688'] Aug 31 15:50:57.604055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:57.604055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:50:57.604055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:57.604055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:57.604055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:50:57.604055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:50:57.604055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:50:57.604055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:50:57.604055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:50:57.604055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:50:57.604055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:50:57.604055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:50:57.604055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Aug 31 15:50:57.604055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 31 15:50:57.604055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c9a176c6-4328-457d-b56b-182a1302e0a0 does not exist Aug 31 15:50:57.604055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5f71d9b6-e170-46d1-87a7-df741191b688'] Aug 31 15:50:57.604055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:57.606316 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:50:57.606316 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:57.606316 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:57.606316 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:50:57.606316 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:50:57.606316 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:50:57.606316 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:50:57.606316 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c9a176c6-4328-457d-b56b-182a1302e0a0 does not exist Aug 31 15:50:57.606316 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5f71d9b6-e170-46d1-87a7-df741191b688'] Aug 31 15:50:57.606316 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:57.606316 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e7630632-2da4-4abc-ae3b-3784a4126476 tempest-SecurityGroupsNegativeTestJSON-410129084 tempest-SecurityGroupsNegativeTestJSON-410129084-project] Returning 404 to user: Security group c9a176c6-4328-457d-b56b-182a1302e0a0 does not exist Aug 31 15:50:57.606316 n-d-833090-16 devstack@n-api.service[128864]: Neutron server returns request_ids: ['req-5f71d9b6-e170-46d1-87a7-df741191b688'] {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:50:57.629853 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e7630632-2da4-4abc-ae3b-3784a4126476 tempest-SecurityGroupsNegativeTestJSON-410129084 tempest-SecurityGroupsNegativeTestJSON-410129084-project] 10.222.0.50 "PUT /compute/v2.1/os-security-groups/c9a176c6-4328-457d-b56b-182a1302e0a0" status: 404 len: 194 microversion: 2.1 time: 0.123287 Aug 31 15:50:57.636690 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 305/598] 10.222.0.50 () {60 vars in 1290 bytes} [Wed Aug 31 15:50:57 2022] PUT /compute/v2.1/os-security-groups/c9a176c6-4328-457d-b56b-182a1302e0a0 => generated 194 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:50:57.657510 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fa119ebf-432f-4e02-9911-7175a77bc3cf tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:57.658992 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fa119ebf-432f-4e02-9911-7175a77bc3cf tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: a5a21e54-e375-4370-9d9e-b41df3e5922e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:57.673762 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fa119ebf-432f-4e02-9911-7175a77bc3cf tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:57.684364 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fa119ebf-432f-4e02-9911-7175a77bc3cf tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:57.685080 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fa119ebf-432f-4e02-9911-7175a77bc3cf tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:57.687351 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fa119ebf-432f-4e02-9911-7175a77bc3cf tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:57.688243 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fa119ebf-432f-4e02-9911-7175a77bc3cf tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:57.697320 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fa119ebf-432f-4e02-9911-7175a77bc3cf tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:57.710128 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:50:58.013292 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c6117416-6b0d-44fa-9403-0f22672a1fc2 tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/d15c3817-84b0-4e82-86b2-f2333ceeb3cd" status: 200 len: 1621 microversion: 2.1 time: 0.661811 Aug 31 15:50:58.015781 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 294/599] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:57 2022] GET /compute/v2.1/servers/d15c3817-84b0-4e82-86b2-f2333ceeb3cd => generated 1621 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:58.027620 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-00966fce-90b6-4d6d-b3ff-ebbcab53f59f tempest-SecurityGroupsTestAdminJSON-2014297923 tempest-SecurityGroupsTestAdminJSON-2014297923-project-admin] Calling method '.version_select at 0x7fbb46e1a5e0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:58.368362 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-fa119ebf-432f-4e02-9911-7175a77bc3cf tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:58.395079 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fa119ebf-432f-4e02-9911-7175a77bc3cf tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e" status: 200 len: 1476 microversion: 2.1 time: 0.756804 Aug 31 15:50:58.396009 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 306/600] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:50:57 2022] GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e => generated 1476 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:50:58.424090 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-93fc7ded-4342-4e62-81b8-3fd7a1e47fc4 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:58.424991 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-93fc7ded-4342-4e62-81b8-3fd7a1e47fc4 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 61e7db75-00b5-41e8-8efb-bced641ddd7a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:58.450229 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-93fc7ded-4342-4e62-81b8-3fd7a1e47fc4 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:58.450809 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-93fc7ded-4342-4e62-81b8-3fd7a1e47fc4 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:58.454623 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-93fc7ded-4342-4e62-81b8-3fd7a1e47fc4 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:58.457277 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-93fc7ded-4342-4e62-81b8-3fd7a1e47fc4 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:58.458023 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-93fc7ded-4342-4e62-81b8-3fd7a1e47fc4 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:58.460916 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-93fc7ded-4342-4e62-81b8-3fd7a1e47fc4 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:59.126294 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-93fc7ded-4342-4e62-81b8-3fd7a1e47fc4 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:59.134613 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-93fc7ded-4342-4e62-81b8-3fd7a1e47fc4 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:59.136145 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-93fc7ded-4342-4e62-81b8-3fd7a1e47fc4 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:50:59.137263 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-93fc7ded-4342-4e62-81b8-3fd7a1e47fc4 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/61e7db75-00b5-41e8-8efb-bced641ddd7a" status: 200 len: 1361 microversion: 2.25 time: 0.739939 Aug 31 15:50:59.137822 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 307/601] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:50:58 2022] GET /compute/v2.1/servers/61e7db75-00b5-41e8-8efb-bced641ddd7a => generated 1361 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:50:59.142342 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-afcc7afc-f48f-4225-a90d-b7cd2bca7805 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:50:59.142945 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-afcc7afc-f48f-4225-a90d-b7cd2bca7805 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] [instance: a71c696b-bfa3-40cd-ba75-af485432d34f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:50:59.148938 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-afcc7afc-f48f-4225-a90d-b7cd2bca7805 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:59.149423 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-afcc7afc-f48f-4225-a90d-b7cd2bca7805 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:59.149852 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-afcc7afc-f48f-4225-a90d-b7cd2bca7805 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:59.150586 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-afcc7afc-f48f-4225-a90d-b7cd2bca7805 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:59.151043 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-afcc7afc-f48f-4225-a90d-b7cd2bca7805 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:59.151472 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-afcc7afc-f48f-4225-a90d-b7cd2bca7805 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:59.166237 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-afcc7afc-f48f-4225-a90d-b7cd2bca7805 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] HTTP exception thrown: Instance a71c696b-bfa3-40cd-ba75-af485432d34f could not be found. Aug 31 15:50:59.167956 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-afcc7afc-f48f-4225-a90d-b7cd2bca7805 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Request method failure captured: Aug 31 15:50:59.167956 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f HTTP/1.1 Aug 31 15:50:59.167956 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:50:59.167956 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:50:59.167956 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:50:59.167956 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:50:59.167956 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:50:59.167956 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:50:59.167956 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:50:59.167956 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:50:59.167956 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4MFhvof9I_5k_C12i7FrU-dVzmbGeLZBsv2Bw_QqsTvothNiw4dUCGHSKTZUqlQuX7N1K902yj3vj442UkHaJ_BuHD-UzivqOT3a3OHe0JTXXipjSup32uslG--NyeejPQ37wx-fFp0o7pntBXqrgcmR_Q9BiifNlnCUAga_kYx51k Aug 31 15:50:59.167956 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:50:59.167956 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:50:59.167956 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:50:59.167956 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:50:59.167956 n-d-833090-16 devstack@n-api.service[128864]: X-Openstack-Nova-Api-Version: 2.75 Aug 31 15:50:59.167956 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:50:59.167956 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:50:59.167956 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: d52ac8c8bc0e42f79e9db32a94b5f0e5 Aug 31 15:50:59.167956 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServersAdmin275Test-1096158365 Aug 31 15:50:59.167956 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:50:59.167956 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:50:59.169583 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d52ac8c8bc0e42f79e9db32a94b5f0e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d52ac8c8bc0e42f79e9db32a94b5f0e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d52ac8c8bc0e42f79e9db32a94b5f0e5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d52ac8c8bc0e42f79e9db32a94b5f0e5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:50:59.169583 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServersAdmin275Test-1096158365 Aug 31 15:50:59.169583 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: d52ac8c8bc0e42f79e9db32a94b5f0e5 Aug 31 15:50:59.169583 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServersAdmin275Test-1096158365 Aug 31 15:50:59.169583 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServersAdmin275Test-1096158365-project Aug 31 15:50:59.169583 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:50:59.169583 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:50:59.169583 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 62c3220431874b2395d0059d57660050 Aug 31 15:50:59.169583 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServersAdmin275Test-1096158365-project Aug 31 15:50:59.169583 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:50:59.169583 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance a71c696b-bfa3-40cd-ba75-af485432d34f could not be found. Aug 31 15:50:59.169583 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'a71c696b-bfa3-40cd-ba75-af485432d34f'} Aug 31 15:50:59.170495 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:50:59.170495 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:59.170495 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:50:59.170495 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:50:59.170495 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:50:59.170495 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:50:59.170495 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:50:59.170495 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:50:59.170495 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:50:59.170495 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:50:59.170495 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a71c696b-bfa3-40cd-ba75-af485432d34f could not be found. Aug 31 15:50:59.170495 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:59.170495 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:50:59.170495 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:59.170495 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:59.170495 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:50:59.170495 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:50:59.170495 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:50:59.170495 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:50:59.170495 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:50:59.171852 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:50:59.171852 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:50:59.171852 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:50:59.171852 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:50:59.171852 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:50:59.171852 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:50:59.171852 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:50:59.171852 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a71c696b-bfa3-40cd-ba75-af485432d34f could not be found. Aug 31 15:50:59.171852 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:59.171852 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:50:59.171852 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:59.171852 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:50:59.171852 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:50:59.171852 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:50:59.171852 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:50:59.171852 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:50:59.171852 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a71c696b-bfa3-40cd-ba75-af485432d34f could not be found. Aug 31 15:50:59.171852 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:50:59.173008 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-afcc7afc-f48f-4225-a90d-b7cd2bca7805 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] Returning 404 to user: Instance a71c696b-bfa3-40cd-ba75-af485432d34f could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:50:59.173008 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-afcc7afc-f48f-4225-a90d-b7cd2bca7805 tempest-ServersAdmin275Test-1096158365 tempest-ServersAdmin275Test-1096158365-project] 10.222.0.50 "GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f" status: 404 len: 111 microversion: 2.75 time: 0.030538 Aug 31 15:50:59.173308 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 308/602] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:50:59 2022] GET /compute/v2.1/servers/a71c696b-bfa3-40cd-ba75-af485432d34f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 15:50:59.177962 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-56d9c0c2-d2d0-4bdf-8e8f-6a2a7195f277 req-463c68b4-d03e-42f4-be39-94dba81fef11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61e7db75-00b5-41e8-8efb-bced641ddd7a", "name": "network-vif-plugged", "status": "completed", "tag": "034d0508-b254-4514-999a-4b96164ff990"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:50:59.190788 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-56d9c0c2-d2d0-4bdf-8e8f-6a2a7195f277 req-463c68b4-d03e-42f4-be39-94dba81fef11 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:50:59.191268 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-56d9c0c2-d2d0-4bdf-8e8f-6a2a7195f277 req-463c68b4-d03e-42f4-be39-94dba81fef11 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:50:59.191706 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-56d9c0c2-d2d0-4bdf-8e8f-6a2a7195f277 req-463c68b4-d03e-42f4-be39-94dba81fef11 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:50:59.207072 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-56d9c0c2-d2d0-4bdf-8e8f-6a2a7195f277 req-463c68b4-d03e-42f4-be39-94dba81fef11 service nova] Creating event network-vif-plugged:034d0508-b254-4514-999a-4b96164ff990 for instance 61e7db75-00b5-41e8-8efb-bced641ddd7a on n-h1-833090-16 Aug 31 15:50:59.212636 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-56d9c0c2-d2d0-4bdf-8e8f-6a2a7195f277 req-463c68b4-d03e-42f4-be39-94dba81fef11 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038276 Aug 31 15:50:59.214274 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 309/603] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:50:59.220844 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-54489851-12b3-48aa-912b-7cb857e3b797 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1655296711", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "848b21b2-98a0-4e70-a27c-08d390d73ae6"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:50:59.297559 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-54489851-12b3-48aa-912b-7cb857e3b797 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] validate_networks() for None {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:50:59.968440 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-54489851-12b3-48aa-912b-7cb857e3b797 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:50:59.969024 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-54489851-12b3-48aa-912b-7cb857e3b797 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:50:59.972152 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-54489851-12b3-48aa-912b-7cb857e3b797 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:50:59.972972 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-54489851-12b3-48aa-912b-7cb857e3b797 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:50:59.973575 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-54489851-12b3-48aa-912b-7cb857e3b797 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:51:00.001846 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-54489851-12b3-48aa-912b-7cb857e3b797 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:00.004546 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-54489851-12b3-48aa-912b-7cb857e3b797 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:00.005127 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-54489851-12b3-48aa-912b-7cb857e3b797 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:00.006383 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-54489851-12b3-48aa-912b-7cb857e3b797 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:00.007050 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-54489851-12b3-48aa-912b-7cb857e3b797 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:00.007629 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-54489851-12b3-48aa-912b-7cb857e3b797 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:00.030758 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-54489851-12b3-48aa-912b-7cb857e3b797 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Getting quotas for project 7db749eb0a764fa0bb29ddc4abd6d245. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:51:00.037381 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-54489851-12b3-48aa-912b-7cb857e3b797 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Getting quotas for user fe647be03cef4e9c86b4fd6e703d0de1 and project 7db749eb0a764fa0bb29ddc4abd6d245. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:51:00.054069 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-54489851-12b3-48aa-912b-7cb857e3b797 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:51:00.059496 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-54489851-12b3-48aa-912b-7cb857e3b797 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: f0bc4527-6410-4415-b9db-7a76b91dfee3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:51:00.117238 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-54489851-12b3-48aa-912b-7cb857e3b797 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.901542 Aug 31 15:51:00.118188 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 310/604] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:50:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 903 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 15:51:00.124797 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-13173d3a-7e60-475f-a37c-bbc59ed90119 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:00.125607 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-13173d3a-7e60-475f-a37c-bbc59ed90119 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: a5a21e54-e375-4370-9d9e-b41df3e5922e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:00.132522 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-13173d3a-7e60-475f-a37c-bbc59ed90119 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:00.133617 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-13173d3a-7e60-475f-a37c-bbc59ed90119 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:00.138298 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-13173d3a-7e60-475f-a37c-bbc59ed90119 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:00.139401 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-13173d3a-7e60-475f-a37c-bbc59ed90119 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:00.141277 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-13173d3a-7e60-475f-a37c-bbc59ed90119 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:00.142151 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-13173d3a-7e60-475f-a37c-bbc59ed90119 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:00.384588 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-13173d3a-7e60-475f-a37c-bbc59ed90119 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:00.398215 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-13173d3a-7e60-475f-a37c-bbc59ed90119 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e" status: 200 len: 1476 microversion: 2.1 time: 0.278897 Aug 31 15:51:00.413227 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 311/605] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:00 2022] GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e => generated 1476 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:00.420527 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-85077816-fbb5-4672-b914-6cb2287f4e7c tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a94e3b6-d9aa-4cef-b60a-ab31ad8db770"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:51:00.425308 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-85077816-fbb5-4672-b914-6cb2287f4e7c tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] [instance: 1e8fdb86-13be-42a3-a7af-5d50024f7419] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:00.434040 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85077816-fbb5-4672-b914-6cb2287f4e7c tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:00.434866 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85077816-fbb5-4672-b914-6cb2287f4e7c tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:00.435500 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85077816-fbb5-4672-b914-6cb2287f4e7c tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:00.436600 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85077816-fbb5-4672-b914-6cb2287f4e7c tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:00.437253 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85077816-fbb5-4672-b914-6cb2287f4e7c tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:00.437873 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85077816-fbb5-4672-b914-6cb2287f4e7c tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:01.053169 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-85077816-fbb5-4672-b914-6cb2287f4e7c tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] 10.222.0.50 "POST /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.637172 Aug 31 15:51:01.059809 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 312/606] 10.222.0.50 () {60 vars in 1323 bytes} [Wed Aug 31 15:51:00 2022] POST /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419/os-volume_attachments => generated 194 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:51:01.066138 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0acdf53d-49d1-4c34-8223-b9bd65ba173a tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:01.067184 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0acdf53d-49d1-4c34-8223-b9bd65ba173a tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: f0bc4527-6410-4415-b9db-7a76b91dfee3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:01.076720 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0acdf53d-49d1-4c34-8223-b9bd65ba173a tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:01.077280 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0acdf53d-49d1-4c34-8223-b9bd65ba173a tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:01.077712 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0acdf53d-49d1-4c34-8223-b9bd65ba173a tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:01.078454 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0acdf53d-49d1-4c34-8223-b9bd65ba173a tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:01.079094 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0acdf53d-49d1-4c34-8223-b9bd65ba173a tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:01.079774 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0acdf53d-49d1-4c34-8223-b9bd65ba173a tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:01.164037 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0acdf53d-49d1-4c34-8223-b9bd65ba173a tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:01.184516 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0acdf53d-49d1-4c34-8223-b9bd65ba173a tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/f0bc4527-6410-4415-b9db-7a76b91dfee3" status: 200 len: 1213 microversion: 2.1 time: 0.122980 Aug 31 15:51:01.185211 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 313/607] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:01 2022] GET /compute/v2.1/servers/f0bc4527-6410-4415-b9db-7a76b91dfee3 => generated 1213 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:01.190393 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2d5beaaf-ad45-47d5-b11e-4d10ca6a9d53 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:01.191219 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2d5beaaf-ad45-47d5-b11e-4d10ca6a9d53 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 61e7db75-00b5-41e8-8efb-bced641ddd7a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:01.193486 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=94,nova_api:UPDATE=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:51:01.202806 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2d5beaaf-ad45-47d5-b11e-4d10ca6a9d53 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:01.203442 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2d5beaaf-ad45-47d5-b11e-4d10ca6a9d53 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:01.203971 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2d5beaaf-ad45-47d5-b11e-4d10ca6a9d53 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:01.204796 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2d5beaaf-ad45-47d5-b11e-4d10ca6a9d53 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:01.205775 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2d5beaaf-ad45-47d5-b11e-4d10ca6a9d53 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:01.206652 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2d5beaaf-ad45-47d5-b11e-4d10ca6a9d53 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:01.774871 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2d5beaaf-ad45-47d5-b11e-4d10ca6a9d53 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:01.783376 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2d5beaaf-ad45-47d5-b11e-4d10ca6a9d53 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:01.784797 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2d5beaaf-ad45-47d5-b11e-4d10ca6a9d53 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:01.795765 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2d5beaaf-ad45-47d5-b11e-4d10ca6a9d53 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/61e7db75-00b5-41e8-8efb-bced641ddd7a" status: 200 len: 1555 microversion: 2.25 time: 0.609211 Aug 31 15:51:01.806126 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 314/608] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:51:01 2022] GET /compute/v2.1/servers/61e7db75-00b5-41e8-8efb-bced641ddd7a => generated 1555 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:51:01.806126 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8e63699a-32cb-48f1-ba0e-ad891dbdba67 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:01.806126 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8e63699a-32cb-48f1-ba0e-ad891dbdba67 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: a5a21e54-e375-4370-9d9e-b41df3e5922e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:01.816786 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8e63699a-32cb-48f1-ba0e-ad891dbdba67 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:01.817956 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8e63699a-32cb-48f1-ba0e-ad891dbdba67 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:01.817956 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8e63699a-32cb-48f1-ba0e-ad891dbdba67 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:01.822668 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8e63699a-32cb-48f1-ba0e-ad891dbdba67 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:01.822668 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8e63699a-32cb-48f1-ba0e-ad891dbdba67 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:01.822668 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8e63699a-32cb-48f1-ba0e-ad891dbdba67 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:02.148505 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8e63699a-32cb-48f1-ba0e-ad891dbdba67 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:02.162452 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8e63699a-32cb-48f1-ba0e-ad891dbdba67 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e" status: 200 len: 1476 microversion: 2.1 time: 0.361702 Aug 31 15:51:02.165826 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 315/609] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:01 2022] GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e => generated 1476 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:02.730623 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b05c9709-63d5-4111-b44a-82f55c1214f3 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:02.731217 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b05c9709-63d5-4111-b44a-82f55c1214f3 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] [instance: 61e7db75-00b5-41e8-8efb-bced641ddd7a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:02.749590 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b05c9709-63d5-4111-b44a-82f55c1214f3 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:02.750326 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b05c9709-63d5-4111-b44a-82f55c1214f3 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:02.750761 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b05c9709-63d5-4111-b44a-82f55c1214f3 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:02.751479 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b05c9709-63d5-4111-b44a-82f55c1214f3 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:02.751924 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b05c9709-63d5-4111-b44a-82f55c1214f3 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:02.752337 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b05c9709-63d5-4111-b44a-82f55c1214f3 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:03.212209 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-b05c9709-63d5-4111-b44a-82f55c1214f3 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lazy-loading 'services' on Instance uuid 61e7db75-00b5-41e8-8efb-bced641ddd7a {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:51:03.241864 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b05c9709-63d5-4111-b44a-82f55c1214f3 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/61e7db75-00b5-41e8-8efb-bced641ddd7a" status: 200 len: 2049 microversion: 2.25 time: 1.074350 Aug 31 15:51:03.243150 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 316/610] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:51:02 2022] GET /compute/v2.1/servers/61e7db75-00b5-41e8-8efb-bced641ddd7a => generated 2049 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:51:03.260489 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-299b71bd-0899-4e11-b4c8-30ed05bcb0dc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:03.261355 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-299b71bd-0899-4e11-b4c8-30ed05bcb0dc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: f0bc4527-6410-4415-b9db-7a76b91dfee3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:03.276785 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-299b71bd-0899-4e11-b4c8-30ed05bcb0dc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:03.280035 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-299b71bd-0899-4e11-b4c8-30ed05bcb0dc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:03.280586 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-299b71bd-0899-4e11-b4c8-30ed05bcb0dc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:03.281381 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-299b71bd-0899-4e11-b4c8-30ed05bcb0dc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:03.281914 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-299b71bd-0899-4e11-b4c8-30ed05bcb0dc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:03.284249 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-299b71bd-0899-4e11-b4c8-30ed05bcb0dc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:03.412148 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-299b71bd-0899-4e11-b4c8-30ed05bcb0dc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:03.426332 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-299b71bd-0899-4e11-b4c8-30ed05bcb0dc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/f0bc4527-6410-4415-b9db-7a76b91dfee3" status: 200 len: 1275 microversion: 2.1 time: 0.181037 Aug 31 15:51:03.427834 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 317/611] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:03 2022] GET /compute/v2.1/servers/f0bc4527-6410-4415-b9db-7a76b91dfee3 => generated 1275 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:03.657769 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b9acfa97-d843-456e-ae71-dbd1a8f20926 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Action: 'update', calling method: .version_select at 0x7fbb46a97820>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:51:03.661055 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b9acfa97-d843-456e-ae71-dbd1a8f20926 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:03.661537 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b9acfa97-d843-456e-ae71-dbd1a8f20926 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:03.661966 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b9acfa97-d843-456e-ae71-dbd1a8f20926 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:03.683298 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b9acfa97-d843-456e-ae71-dbd1a8f20926 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:03.686991 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b9acfa97-d843-456e-ae71-dbd1a8f20926 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:03.687475 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b9acfa97-d843-456e-ae71-dbd1a8f20926 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:03.701913 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-b9acfa97-d843-456e-ae71-dbd1a8f20926 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] HTTP exception thrown: Service 4f05e233-e90c-462c-a74e-108136d44b5c could not be found. Aug 31 15:51:03.704007 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b9acfa97-d843-456e-ae71-dbd1a8f20926 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Request method failure captured: Aug 31 15:51:03.704007 n-d-833090-16 devstack@n-api.service[128864]: request: PUT /compute/v2.1/os-services/4f05e233-e90c-462c-a74e-108136d44b5c HTTP/1.1 Aug 31 15:51:03.704007 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:51:03.704007 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:51:03.704007 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:51:03.704007 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 56 Aug 31 15:51:03.704007 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:51:03.704007 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:51:03.704007 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:51:03.704007 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:51:03.704007 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4NmraLhQ0XU41MgjZTB0s8zAGyGM6Xfz8615sz73Z-hJvGIX5QDgMrqANUn_ePztH8hSnTfWL0TkcrzEO2pnvqadXxdScHwZ2pdcxWjLg4ifd1bsujc-8bVOKFGGDOYF8C6QDHubaYw5X5iTadtUzgOd8FPwMrvpcIuM-XidtfaytM Aug 31 15:51:03.704007 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:51:03.704007 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:51:03.704007 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:51:03.704007 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:51:03.704007 n-d-833090-16 devstack@n-api.service[128864]: X-Openstack-Nova-Api-Version: 2.53 Aug 31 15:51:03.704007 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:51:03.704007 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:51:03.704007 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: f56d733654394e948781e43d9cf088c0 Aug 31 15:51:03.704007 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1364816767 Aug 31 15:51:03.704007 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,admin,member Aug 31 15:51:03.704007 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,admin,member Aug 31 15:51:03.705672 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f56d733654394e948781e43d9cf088c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f56d733654394e948781e43d9cf088c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f56d733654394e948781e43d9cf088c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f56d733654394e948781e43d9cf088c0", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:51:03.705672 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1364816767 Aug 31 15:51:03.705672 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: f56d733654394e948781e43d9cf088c0 Aug 31 15:51:03.705672 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1364816767 Aug 31 15:51:03.705672 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin Aug 31 15:51:03.705672 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:51:03.705672 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:51:03.705672 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 10eb7054a86645a6af1785445a47c8f3 Aug 31 15:51:03.705672 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin Aug 31 15:51:03.705672 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 15:51:03.705672 n-d-833090-16 devstack@n-api.service[128864]: {"status": "disabled", "disabled_reason": "maintenance"} Aug 31 15:51:03.705672 n-d-833090-16 devstack@n-api.service[128864]: method: Aug 31 15:51:03.705672 n-d-833090-16 devstack@n-api.service[128864]: exception: Service 4f05e233-e90c-462c-a74e-108136d44b5c could not be found. Aug 31 15:51:03.706669 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '4f05e233-e90c-462c-a74e-108136d44b5c', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Aug 31 15:51:03.706669 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:51:03.706669 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:51:03.706669 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6205, in service_get_by_id Aug 31 15:51:03.706669 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 31 15:51:03.706669 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 31 15:51:03.706669 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 31 15:51:03.706669 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 31 15:51:03.706669 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:51:03.706669 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:51:03.706669 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:51:03.706669 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:51:03.706669 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 31 15:51:03.706669 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 31 15:51:03.706669 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Aug 31 15:51:03.706669 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 31 15:51:03.706669 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 4f05e233-e90c-462c-a74e-108136d44b5c could not be found. Aug 31 15:51:03.706669 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:51:03.706669 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:51:03.706669 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:51:03.706669 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:51:03.708202 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:51:03.708202 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:51:03.708202 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:51:03.708202 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:51:03.708202 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:51:03.708202 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:51:03.708202 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:51:03.708202 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:51:03.708202 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:51:03.708202 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:51:03.708202 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 31 15:51:03.708202 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:51:03.708202 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 4f05e233-e90c-462c-a74e-108136d44b5c could not be found. Aug 31 15:51:03.708202 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:51:03.708202 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:51:03.708202 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:51:03.708202 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:51:03.708202 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:51:03.708202 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:51:03.708202 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:51:03.709663 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:51:03.709663 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 4f05e233-e90c-462c-a74e-108136d44b5c could not be found. Aug 31 15:51:03.709663 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:51:03.709663 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b9acfa97-d843-456e-ae71-dbd1a8f20926 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Returning 404 to user: Service 4f05e233-e90c-462c-a74e-108136d44b5c could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:51:03.709663 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b9acfa97-d843-456e-ae71-dbd1a8f20926 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-services/4f05e233-e90c-462c-a74e-108136d44b5c" status: 404 len: 110 microversion: 2.53 time: 0.276362 Aug 31 15:51:03.709663 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 318/612] 10.222.0.50 () {62 vars in 1309 bytes} [Wed Aug 31 15:51:03 2022] PUT /compute/v2.1/os-services/4f05e233-e90c-462c-a74e-108136d44b5c => generated 110 bytes in 277 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 15:51:03.734548 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a15d7152-020f-4838-99bb-4972b9876fe2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:03.735167 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a15d7152-020f-4838-99bb-4972b9876fe2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: a5a21e54-e375-4370-9d9e-b41df3e5922e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:03.741551 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a15d7152-020f-4838-99bb-4972b9876fe2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:03.742035 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a15d7152-020f-4838-99bb-4972b9876fe2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:03.742508 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a15d7152-020f-4838-99bb-4972b9876fe2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:03.743197 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a15d7152-020f-4838-99bb-4972b9876fe2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:03.743646 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a15d7152-020f-4838-99bb-4972b9876fe2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:03.744309 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a15d7152-020f-4838-99bb-4972b9876fe2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:04.024421 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a15d7152-020f-4838-99bb-4972b9876fe2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:04.041912 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a15d7152-020f-4838-99bb-4972b9876fe2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e" status: 200 len: 1476 microversion: 2.1 time: 0.313995 Aug 31 15:51:04.055298 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 319/613] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:03 2022] GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e => generated 1476 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:04.070698 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2d603006-3077-48dc-a92a-e3272c39145f tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:04.073394 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2d603006-3077-48dc-a92a-e3272c39145f tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] [instance: 61e7db75-00b5-41e8-8efb-bced641ddd7a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:04.098250 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2d603006-3077-48dc-a92a-e3272c39145f tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:04.100351 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2d603006-3077-48dc-a92a-e3272c39145f tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:04.102743 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2d603006-3077-48dc-a92a-e3272c39145f tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:04.107500 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2d603006-3077-48dc-a92a-e3272c39145f tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:04.116033 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2d603006-3077-48dc-a92a-e3272c39145f tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:04.118925 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2d603006-3077-48dc-a92a-e3272c39145f tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:04.488458 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-00966fce-90b6-4d6d-b3ff-ebbcab53f59f tempest-SecurityGroupsTestAdminJSON-2014297923 tempest-SecurityGroupsTestAdminJSON-2014297923-project-admin] 10.222.0.50 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 13047 microversion: 2.1 time: 6.469379 Aug 31 15:51:04.489622 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 295/614] 10.222.0.50 () {58 vars in 1191 bytes} [Wed Aug 31 15:50:58 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 13047 bytes in 6473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:51:04.517265 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-88758877-3027-4cf5-adcc-d0f7da629ef9 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Action: 'update', calling method: .version_select at 0x7fbb469cdc10>, body: {"status": "disabled"} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:51:04.532025 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88758877-3027-4cf5-adcc-d0f7da629ef9 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:04.533996 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88758877-3027-4cf5-adcc-d0f7da629ef9 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:04.549107 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88758877-3027-4cf5-adcc-d0f7da629ef9 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:04.572987 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88758877-3027-4cf5-adcc-d0f7da629ef9 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:04.575521 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88758877-3027-4cf5-adcc-d0f7da629ef9 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:04.577111 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88758877-3027-4cf5-adcc-d0f7da629ef9 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:04.606332 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-2d603006-3077-48dc-a92a-e3272c39145f tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lazy-loading 'services' on Instance uuid 61e7db75-00b5-41e8-8efb-bced641ddd7a {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:51:04.619144 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-88758877-3027-4cf5-adcc-d0f7da629ef9 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] HTTP exception thrown: Service 4f05e233-e90c-462c-a74e-108136d44b5c could not be found. Aug 31 15:51:04.621342 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-88758877-3027-4cf5-adcc-d0f7da629ef9 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Request method failure captured: Aug 31 15:51:04.621342 n-d-833090-16 devstack@n-api.service[128863]: request: PUT /compute/v2.1/os-services/4f05e233-e90c-462c-a74e-108136d44b5c HTTP/1.1 Aug 31 15:51:04.621342 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:51:04.621342 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:51:04.621342 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:51:04.621342 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 22 Aug 31 15:51:04.621342 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:51:04.621342 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:51:04.621342 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:51:04.621342 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:51:04.621342 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4NmraLhQ0XU41MgjZTB0s8zAGyGM6Xfz8615sz73Z-hJvGIX5QDgMrqANUn_ePztH8hSnTfWL0TkcrzEO2pnvqadXxdScHwZ2pdcxWjLg4ifd1bsujc-8bVOKFGGDOYF8C6QDHubaYw5X5iTadtUzgOd8FPwMrvpcIuM-XidtfaytM Aug 31 15:51:04.621342 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:51:04.621342 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:51:04.621342 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:51:04.621342 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:51:04.621342 n-d-833090-16 devstack@n-api.service[128863]: X-Openstack-Nova-Api-Version: 2.53 Aug 31 15:51:04.621342 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:51:04.621342 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:51:04.621342 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: f56d733654394e948781e43d9cf088c0 Aug 31 15:51:04.621342 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1364816767 Aug 31 15:51:04.621342 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,admin,member Aug 31 15:51:04.621342 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,admin,member Aug 31 15:51:04.622745 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f56d733654394e948781e43d9cf088c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f56d733654394e948781e43d9cf088c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f56d733654394e948781e43d9cf088c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f56d733654394e948781e43d9cf088c0", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:51:04.622745 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1364816767 Aug 31 15:51:04.622745 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: f56d733654394e948781e43d9cf088c0 Aug 31 15:51:04.622745 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1364816767 Aug 31 15:51:04.622745 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin Aug 31 15:51:04.622745 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:51:04.622745 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:51:04.622745 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 10eb7054a86645a6af1785445a47c8f3 Aug 31 15:51:04.622745 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin Aug 31 15:51:04.622745 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 15:51:04.622745 n-d-833090-16 devstack@n-api.service[128863]: {"status": "disabled"} Aug 31 15:51:04.622745 n-d-833090-16 devstack@n-api.service[128863]: method: Aug 31 15:51:04.622745 n-d-833090-16 devstack@n-api.service[128863]: exception: Service 4f05e233-e90c-462c-a74e-108136d44b5c could not be found. Aug 31 15:51:04.622745 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '4f05e233-e90c-462c-a74e-108136d44b5c', 'body': {'status': 'disabled'}} Aug 31 15:51:04.623678 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:51:04.623678 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:51:04.623678 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6205, in service_get_by_id Aug 31 15:51:04.623678 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 31 15:51:04.623678 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 31 15:51:04.623678 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 31 15:51:04.623678 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 31 15:51:04.623678 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:51:04.623678 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:51:04.623678 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:51:04.623678 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:51:04.623678 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 31 15:51:04.623678 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 31 15:51:04.623678 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Aug 31 15:51:04.623678 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 31 15:51:04.623678 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 4f05e233-e90c-462c-a74e-108136d44b5c could not be found. Aug 31 15:51:04.623678 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:51:04.623678 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:51:04.623678 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:51:04.623678 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:51:04.623678 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:51:04.625545 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:51:04.625545 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:51:04.625545 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:51:04.625545 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:51:04.625545 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:51:04.625545 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:51:04.625545 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:51:04.625545 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:51:04.625545 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:51:04.625545 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 31 15:51:04.625545 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:51:04.625545 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 4f05e233-e90c-462c-a74e-108136d44b5c could not be found. Aug 31 15:51:04.625545 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:51:04.625545 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:51:04.625545 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:51:04.625545 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:51:04.625545 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:51:04.625545 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:51:04.625545 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:51:04.625545 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:51:04.627884 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 4f05e233-e90c-462c-a74e-108136d44b5c could not be found. Aug 31 15:51:04.627884 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:51:04.629051 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-88758877-3027-4cf5-adcc-d0f7da629ef9 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Returning 404 to user: Service 4f05e233-e90c-462c-a74e-108136d44b5c could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:51:04.631074 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-88758877-3027-4cf5-adcc-d0f7da629ef9 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-services/4f05e233-e90c-462c-a74e-108136d44b5c" status: 404 len: 110 microversion: 2.53 time: 0.120353 Aug 31 15:51:04.632121 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 296/615] 10.222.0.50 () {62 vars in 1309 bytes} [Wed Aug 31 15:51:04 2022] PUT /compute/v2.1/os-services/4f05e233-e90c-462c-a74e-108136d44b5c => generated 110 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 15:51:04.640534 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-838222c2-8cb7-4d6c-931d-b894bd0d1ac5 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:04.641638 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-838222c2-8cb7-4d6c-931d-b894bd0d1ac5 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: f0bc4527-6410-4415-b9db-7a76b91dfee3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:04.649831 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-838222c2-8cb7-4d6c-931d-b894bd0d1ac5 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:04.651137 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-838222c2-8cb7-4d6c-931d-b894bd0d1ac5 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:04.651981 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-838222c2-8cb7-4d6c-931d-b894bd0d1ac5 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:04.652904 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-838222c2-8cb7-4d6c-931d-b894bd0d1ac5 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:04.653589 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-838222c2-8cb7-4d6c-931d-b894bd0d1ac5 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:04.654250 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-838222c2-8cb7-4d6c-931d-b894bd0d1ac5 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:04.665822 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2d603006-3077-48dc-a92a-e3272c39145f tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/61e7db75-00b5-41e8-8efb-bced641ddd7a" status: 200 len: 2049 microversion: 2.25 time: 0.603737 Aug 31 15:51:04.673346 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 320/616] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:51:04 2022] GET /compute/v2.1/servers/61e7db75-00b5-41e8-8efb-bced641ddd7a => generated 2049 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:51:04.689562 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-46494398-a5b0-4007-b736-6fd85040f027 tempest-SecurityGroupsTestAdminJSON-1677170732 tempest-SecurityGroupsTestAdminJSON-1677170732-project] Calling method '.version_select at 0x7fbb46e2a670>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:05.085640 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-838222c2-8cb7-4d6c-931d-b894bd0d1ac5 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:05.101076 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-838222c2-8cb7-4d6c-931d-b894bd0d1ac5 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/f0bc4527-6410-4415-b9db-7a76b91dfee3" status: 200 len: 1317 microversion: 2.1 time: 0.467379 Aug 31 15:51:05.115183 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 297/617] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:04 2022] GET /compute/v2.1/servers/f0bc4527-6410-4415-b9db-7a76b91dfee3 => generated 1317 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:05.131621 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bc5500d0-abdb-4ac0-b080-f9f375e56d32 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Action: 'update', calling method: .version_select at 0x7fbb476d7d30>, body: {"status": "enabled"} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:51:05.137747 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc5500d0-abdb-4ac0-b080-f9f375e56d32 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:05.138295 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc5500d0-abdb-4ac0-b080-f9f375e56d32 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:05.138737 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc5500d0-abdb-4ac0-b080-f9f375e56d32 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:05.144631 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=38 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:51:05.146540 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc5500d0-abdb-4ac0-b080-f9f375e56d32 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:05.147667 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc5500d0-abdb-4ac0-b080-f9f375e56d32 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:05.148108 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc5500d0-abdb-4ac0-b080-f9f375e56d32 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:05.155078 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-bc5500d0-abdb-4ac0-b080-f9f375e56d32 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] HTTP exception thrown: Service 4f05e233-e90c-462c-a74e-108136d44b5c could not be found. Aug 31 15:51:05.157257 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bc5500d0-abdb-4ac0-b080-f9f375e56d32 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Request method failure captured: Aug 31 15:51:05.157257 n-d-833090-16 devstack@n-api.service[128863]: request: PUT /compute/v2.1/os-services/4f05e233-e90c-462c-a74e-108136d44b5c HTTP/1.1 Aug 31 15:51:05.157257 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:51:05.157257 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:51:05.157257 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:51:05.157257 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 21 Aug 31 15:51:05.157257 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:51:05.157257 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:51:05.157257 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:51:05.157257 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:51:05.157257 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4NmraLhQ0XU41MgjZTB0s8zAGyGM6Xfz8615sz73Z-hJvGIX5QDgMrqANUn_ePztH8hSnTfWL0TkcrzEO2pnvqadXxdScHwZ2pdcxWjLg4ifd1bsujc-8bVOKFGGDOYF8C6QDHubaYw5X5iTadtUzgOd8FPwMrvpcIuM-XidtfaytM Aug 31 15:51:05.157257 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:51:05.157257 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:51:05.157257 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:51:05.157257 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:51:05.157257 n-d-833090-16 devstack@n-api.service[128863]: X-Openstack-Nova-Api-Version: 2.53 Aug 31 15:51:05.157257 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:51:05.157257 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:51:05.157257 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: f56d733654394e948781e43d9cf088c0 Aug 31 15:51:05.157257 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1364816767 Aug 31 15:51:05.157257 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,admin,member Aug 31 15:51:05.157257 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,admin,member Aug 31 15:51:05.158858 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f56d733654394e948781e43d9cf088c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f56d733654394e948781e43d9cf088c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f56d733654394e948781e43d9cf088c0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f56d733654394e948781e43d9cf088c0", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:51:05.158858 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1364816767 Aug 31 15:51:05.158858 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: f56d733654394e948781e43d9cf088c0 Aug 31 15:51:05.158858 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1364816767 Aug 31 15:51:05.158858 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin Aug 31 15:51:05.158858 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:51:05.158858 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:51:05.158858 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 10eb7054a86645a6af1785445a47c8f3 Aug 31 15:51:05.158858 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin Aug 31 15:51:05.158858 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 15:51:05.158858 n-d-833090-16 devstack@n-api.service[128863]: {"status": "enabled"} Aug 31 15:51:05.158858 n-d-833090-16 devstack@n-api.service[128863]: method: Aug 31 15:51:05.158858 n-d-833090-16 devstack@n-api.service[128863]: exception: Service 4f05e233-e90c-462c-a74e-108136d44b5c could not be found. Aug 31 15:51:05.158858 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '4f05e233-e90c-462c-a74e-108136d44b5c', 'body': {'status': 'enabled'}} Aug 31 15:51:05.159886 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:51:05.159886 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:51:05.159886 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6205, in service_get_by_id Aug 31 15:51:05.159886 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 31 15:51:05.159886 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 31 15:51:05.159886 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 31 15:51:05.159886 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 31 15:51:05.159886 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:51:05.159886 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:51:05.159886 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:51:05.159886 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:51:05.159886 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 31 15:51:05.159886 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 31 15:51:05.159886 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Aug 31 15:51:05.159886 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 31 15:51:05.159886 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 4f05e233-e90c-462c-a74e-108136d44b5c could not be found. Aug 31 15:51:05.159886 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:51:05.159886 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:51:05.159886 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:51:05.159886 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:51:05.159886 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:51:05.161640 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:51:05.161640 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:51:05.161640 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:51:05.161640 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:51:05.161640 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:51:05.161640 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:51:05.161640 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:51:05.161640 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:51:05.161640 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:51:05.161640 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 31 15:51:05.161640 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:51:05.161640 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 4f05e233-e90c-462c-a74e-108136d44b5c could not be found. Aug 31 15:51:05.161640 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:51:05.161640 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:51:05.161640 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:51:05.161640 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:51:05.161640 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:51:05.161640 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:51:05.161640 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:51:05.161640 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:51:05.164848 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 4f05e233-e90c-462c-a74e-108136d44b5c could not be found. Aug 31 15:51:05.164848 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:51:05.181270 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bc5500d0-abdb-4ac0-b080-f9f375e56d32 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Returning 404 to user: Service 4f05e233-e90c-462c-a74e-108136d44b5c could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:51:05.182272 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bc5500d0-abdb-4ac0-b080-f9f375e56d32 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-services/4f05e233-e90c-462c-a74e-108136d44b5c" status: 404 len: 110 microversion: 2.53 time: 0.065709 Aug 31 15:51:05.186971 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 298/618] 10.222.0.50 () {62 vars in 1309 bytes} [Wed Aug 31 15:51:05 2022] PUT /compute/v2.1/os-services/4f05e233-e90c-462c-a74e-108136d44b5c => generated 110 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 15:51:05.189556 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dd5db836-14a6-4f1e-910c-7c8e999f02d7 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:05.193578 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd5db836-14a6-4f1e-910c-7c8e999f02d7 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:05.194074 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd5db836-14a6-4f1e-910c-7c8e999f02d7 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:05.194532 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd5db836-14a6-4f1e-910c-7c8e999f02d7 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:05.195262 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd5db836-14a6-4f1e-910c-7c8e999f02d7 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:05.195714 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd5db836-14a6-4f1e-910c-7c8e999f02d7 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:05.196130 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd5db836-14a6-4f1e-910c-7c8e999f02d7 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:05.232918 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dd5db836-14a6-4f1e-910c-7c8e999f02d7 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.048013 Aug 31 15:51:05.233987 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 299/619] 10.222.0.50 () {60 vars in 1217 bytes} [Wed Aug 31 15:51:05 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:51:05.238658 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9099f910-9aff-41b0-9d92-843d4b1e4e01 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:05.239505 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9099f910-9aff-41b0-9d92-843d4b1e4e01 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: a5a21e54-e375-4370-9d9e-b41df3e5922e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:05.249052 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9099f910-9aff-41b0-9d92-843d4b1e4e01 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:05.249784 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9099f910-9aff-41b0-9d92-843d4b1e4e01 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:05.250452 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9099f910-9aff-41b0-9d92-843d4b1e4e01 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:05.252551 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9099f910-9aff-41b0-9d92-843d4b1e4e01 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:05.253436 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9099f910-9aff-41b0-9d92-843d4b1e4e01 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:05.254070 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9099f910-9aff-41b0-9d92-843d4b1e4e01 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:05.346159 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-46494398-a5b0-4007-b736-6fd85040f027 tempest-SecurityGroupsTestAdminJSON-1677170732 tempest-SecurityGroupsTestAdminJSON-1677170732-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1112 microversion: 2.1 time: 0.671561 Aug 31 15:51:05.347059 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 321/620] 10.222.0.50 () {58 vars in 1191 bytes} [Wed Aug 31 15:51:04 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1112 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:05.351596 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5ce38889-3998-4b3a-891a-333aa865a685 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:05.358680 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5ce38889-3998-4b3a-891a-333aa865a685 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:05.359272 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5ce38889-3998-4b3a-891a-333aa865a685 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:05.359594 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5ce38889-3998-4b3a-891a-333aa865a685 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:05.360335 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5ce38889-3998-4b3a-891a-333aa865a685 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:05.360775 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5ce38889-3998-4b3a-891a-333aa865a685 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:05.361299 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5ce38889-3998-4b3a-891a-333aa865a685 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:05.396929 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5ce38889-3998-4b3a-891a-333aa865a685 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.047761 Aug 31 15:51:05.398556 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 322/621] 10.222.0.50 () {60 vars in 1178 bytes} [Wed Aug 31 15:51:05 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:51:05.404109 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b778ce97-b95e-4542-adc6-17fb0a8c86a5 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-833090-16", "block_migration": "auto"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:51:05.408549 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b778ce97-b95e-4542-adc6-17fb0a8c86a5 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] [instance: 61e7db75-00b5-41e8-8efb-bced641ddd7a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:05.417787 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b778ce97-b95e-4542-adc6-17fb0a8c86a5 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:05.419620 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b778ce97-b95e-4542-adc6-17fb0a8c86a5 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:05.420801 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b778ce97-b95e-4542-adc6-17fb0a8c86a5 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:05.421736 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b778ce97-b95e-4542-adc6-17fb0a8c86a5 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:05.422989 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b778ce97-b95e-4542-adc6-17fb0a8c86a5 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:05.424357 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b778ce97-b95e-4542-adc6-17fb0a8c86a5 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:05.516026 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-b778ce97-b95e-4542-adc6-17fb0a8c86a5 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lazy-loading 'flavor' on Instance uuid 61e7db75-00b5-41e8-8efb-bced641ddd7a {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:51:05.553971 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9099f910-9aff-41b0-9d92-843d4b1e4e01 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:05.571510 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9099f910-9aff-41b0-9d92-843d4b1e4e01 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e" status: 200 len: 1476 microversion: 2.1 time: 0.336261 Aug 31 15:51:05.572099 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 300/622] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:05 2022] GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e => generated 1476 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:05.580104 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a5a1a478-bfa1-47d0-a005-a0f23e4bbed0 tempest-SecurityGroupsTestAdminJSON-2014297923 tempest-SecurityGroupsTestAdminJSON-2014297923-project-admin] Calling method '.version_select at 0x7fbb469cd4c0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:05.616866 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b778ce97-b95e-4542-adc6-17fb0a8c86a5 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] [instance: 61e7db75-00b5-41e8-8efb-bced641ddd7a] Going to try to live migrate instance to n-h2-833090-16 {{(pid=128864) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 31 15:51:05.764734 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:51:06.108891 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a5a1a478-bfa1-47d0-a005-a0f23e4bbed0 tempest-SecurityGroupsTestAdminJSON-2014297923 tempest-SecurityGroupsTestAdminJSON-2014297923-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/2bb53ffe-4eb3-44e5-9c1b-57bcd2ea8881" status: 202 len: 0 microversion: 2.1 time: 0.535260 Aug 31 15:51:06.109494 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 301/623] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 31 15:51:05 2022] DELETE /compute/v2.1/os-security-groups/2bb53ffe-4eb3-44e5-9c1b-57bcd2ea8881 => generated 0 bytes in 537 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:51:06.113919 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-40466673-8f37-416f-a99f-db0879b38303 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:06.117580 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-40466673-8f37-416f-a99f-db0879b38303 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:06.121425 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-40466673-8f37-416f-a99f-db0879b38303 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:06.123502 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-40466673-8f37-416f-a99f-db0879b38303 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:06.126914 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-40466673-8f37-416f-a99f-db0879b38303 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:06.127638 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-40466673-8f37-416f-a99f-db0879b38303 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:06.128443 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-40466673-8f37-416f-a99f-db0879b38303 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:06.146012 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=23 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:51:06.173712 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-40466673-8f37-416f-a99f-db0879b38303 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.063063 Aug 31 15:51:06.174842 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 302/624] 10.222.0.50 () {60 vars in 1211 bytes} [Wed Aug 31 15:51:06 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1244 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:51:06.189655 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6454197c-0e84-465e-a2ed-ccf06c16f45b tempest-SecurityGroupsTestAdminJSON-2014297923 tempest-SecurityGroupsTestAdminJSON-2014297923-project-admin] Calling method '.version_select at 0x7fbb469d9ee0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:06.716894 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6454197c-0e84-465e-a2ed-ccf06c16f45b tempest-SecurityGroupsTestAdminJSON-2014297923 tempest-SecurityGroupsTestAdminJSON-2014297923-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/e0c5e672-068e-4686-a35d-02bc34a34be3" status: 202 len: 0 microversion: 2.1 time: 0.540719 Aug 31 15:51:06.717776 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 303/625] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 31 15:51:06 2022] DELETE /compute/v2.1/os-security-groups/e0c5e672-068e-4686-a35d-02bc34a34be3 => generated 0 bytes in 542 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:51:06.724200 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8ce15d9c-3038-4dc1-9ed9-33249c6dd1de tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:06.725001 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8ce15d9c-3038-4dc1-9ed9-33249c6dd1de tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: f0bc4527-6410-4415-b9db-7a76b91dfee3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:06.738776 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ce15d9c-3038-4dc1-9ed9-33249c6dd1de tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:06.739670 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ce15d9c-3038-4dc1-9ed9-33249c6dd1de tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:06.740254 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ce15d9c-3038-4dc1-9ed9-33249c6dd1de tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:06.742350 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ce15d9c-3038-4dc1-9ed9-33249c6dd1de tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:06.751688 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ce15d9c-3038-4dc1-9ed9-33249c6dd1de tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:06.752168 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ce15d9c-3038-4dc1-9ed9-33249c6dd1de tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:07.036518 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8ce15d9c-3038-4dc1-9ed9-33249c6dd1de tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:07.050366 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8ce15d9c-3038-4dc1-9ed9-33249c6dd1de tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/f0bc4527-6410-4415-b9db-7a76b91dfee3" status: 200 len: 1317 microversion: 2.1 time: 0.331269 Aug 31 15:51:07.064711 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 304/626] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:06 2022] GET /compute/v2.1/servers/f0bc4527-6410-4415-b9db-7a76b91dfee3 => generated 1317 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:07.069874 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-73e3668c-e701-4f81-84ee-89b7840922b7 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:07.074078 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-73e3668c-e701-4f81-84ee-89b7840922b7 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:07.075046 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-73e3668c-e701-4f81-84ee-89b7840922b7 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:07.075673 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-73e3668c-e701-4f81-84ee-89b7840922b7 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:07.076611 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-73e3668c-e701-4f81-84ee-89b7840922b7 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:07.077262 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-73e3668c-e701-4f81-84ee-89b7840922b7 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:07.077869 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-73e3668c-e701-4f81-84ee-89b7840922b7 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:07.105367 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-73e3668c-e701-4f81-84ee-89b7840922b7 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.038724 Aug 31 15:51:07.106677 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 305/627] 10.222.0.50 () {60 vars in 1178 bytes} [Wed Aug 31 15:51:07 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:51:07.111370 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-a1a34c2b-31fb-41fe-b75d-0946882c5d85 req-b1d1f6c1-39d2-42b4-9814-08db3358526b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0bc4527-6410-4415-b9db-7a76b91dfee3", "tag": "6d4ecb80-bbfe-4c36-ae0e-0e7f651c074f"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:51:07.122455 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a1a34c2b-31fb-41fe-b75d-0946882c5d85 req-b1d1f6c1-39d2-42b4-9814-08db3358526b service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:07.123159 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a1a34c2b-31fb-41fe-b75d-0946882c5d85 req-b1d1f6c1-39d2-42b4-9814-08db3358526b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:07.123773 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a1a34c2b-31fb-41fe-b75d-0946882c5d85 req-b1d1f6c1-39d2-42b4-9814-08db3358526b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:07.137703 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-a1a34c2b-31fb-41fe-b75d-0946882c5d85 req-b1d1f6c1-39d2-42b4-9814-08db3358526b service nova] Creating event network-changed:6d4ecb80-bbfe-4c36-ae0e-0e7f651c074f for instance f0bc4527-6410-4415-b9db-7a76b91dfee3 on n-h1-833090-16 Aug 31 15:51:07.143037 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-a1a34c2b-31fb-41fe-b75d-0946882c5d85 req-b1d1f6c1-39d2-42b4-9814-08db3358526b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034908 Aug 31 15:51:07.144167 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 306/628] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:51:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:51:07.149881 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5848be07-e179-4bbc-8db8-56b51cb176f8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:07.150814 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5848be07-e179-4bbc-8db8-56b51cb176f8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: a5a21e54-e375-4370-9d9e-b41df3e5922e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:07.157736 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5848be07-e179-4bbc-8db8-56b51cb176f8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:07.158458 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5848be07-e179-4bbc-8db8-56b51cb176f8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:07.159716 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5848be07-e179-4bbc-8db8-56b51cb176f8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:07.160633 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5848be07-e179-4bbc-8db8-56b51cb176f8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:07.161520 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5848be07-e179-4bbc-8db8-56b51cb176f8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:07.162498 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5848be07-e179-4bbc-8db8-56b51cb176f8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:07.436585 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5848be07-e179-4bbc-8db8-56b51cb176f8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:07.448709 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5848be07-e179-4bbc-8db8-56b51cb176f8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e" status: 200 len: 1476 microversion: 2.1 time: 0.301272 Aug 31 15:51:07.450235 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 307/629] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:07 2022] GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e => generated 1476 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:07.456157 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fdb5c0e8-2b93-4951-9b69-ae6eefbd2f84 tempest-SecurityGroupsTestAdminJSON-1677170732 tempest-SecurityGroupsTestAdminJSON-1677170732-project] Calling method '.version_select at 0x7fbb46cfcdc0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:07.684935 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b778ce97-b95e-4542-adc6-17fb0a8c86a5 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/61e7db75-00b5-41e8-8efb-bced641ddd7a/action" status: 202 len: 0 microversion: 2.25 time: 2.285231 Aug 31 15:51:07.686142 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 323/630] 10.222.0.50 () {62 vars in 1319 bytes} [Wed Aug 31 15:51:05 2022] POST /compute/v2.1/servers/61e7db75-00b5-41e8-8efb-bced641ddd7a/action => generated 0 bytes in 2287 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:51:07.692513 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-05f628bb-cf0d-400a-80af-1a94ebb0d714 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:07.703124 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-05f628bb-cf0d-400a-80af-1a94ebb0d714 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:07.706471 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-05f628bb-cf0d-400a-80af-1a94ebb0d714 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:07.708542 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-05f628bb-cf0d-400a-80af-1a94ebb0d714 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:07.710022 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-05f628bb-cf0d-400a-80af-1a94ebb0d714 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:07.711669 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-05f628bb-cf0d-400a-80af-1a94ebb0d714 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:07.713968 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-05f628bb-cf0d-400a-80af-1a94ebb0d714 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:07.768486 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-05f628bb-cf0d-400a-80af-1a94ebb0d714 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?host=n-d-833090-16&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.079520 Aug 31 15:51:07.769126 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 324/631] 10.222.0.50 () {60 vars in 1237 bytes} [Wed Aug 31 15:51:07 2022] GET /compute/v2.1/os-services?host=n-d-833090-16&binary=xxx => generated 16 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:07.776449 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-eb0f7fb9-af97-444f-89c0-a99da92f6d9f tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:07.781152 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-eb0f7fb9-af97-444f-89c0-a99da92f6d9f tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 61e7db75-00b5-41e8-8efb-bced641ddd7a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:07.794350 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-eb0f7fb9-af97-444f-89c0-a99da92f6d9f tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:07.795054 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-eb0f7fb9-af97-444f-89c0-a99da92f6d9f tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:07.795726 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-eb0f7fb9-af97-444f-89c0-a99da92f6d9f tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:07.796654 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-eb0f7fb9-af97-444f-89c0-a99da92f6d9f tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:07.797275 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-eb0f7fb9-af97-444f-89c0-a99da92f6d9f tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:07.797851 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-eb0f7fb9-af97-444f-89c0-a99da92f6d9f tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:07.862108 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fdb5c0e8-2b93-4951-9b69-ae6eefbd2f84 tempest-SecurityGroupsTestAdminJSON-1677170732 tempest-SecurityGroupsTestAdminJSON-1677170732-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/ee2bf3ee-dcbc-4abe-9b7b-b7b6a8a4f9ab" status: 202 len: 0 microversion: 2.1 time: 0.409522 Aug 31 15:51:07.863613 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 308/632] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 31 15:51:07 2022] DELETE /compute/v2.1/os-security-groups/ee2bf3ee-dcbc-4abe-9b7b-b7b6a8a4f9ab => generated 0 bytes in 413 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:51:07.869464 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-28c6b315-d050-41cf-8eb7-20e1bc78d379 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:07.878250 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28c6b315-d050-41cf-8eb7-20e1bc78d379 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:07.879015 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28c6b315-d050-41cf-8eb7-20e1bc78d379 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:07.880021 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28c6b315-d050-41cf-8eb7-20e1bc78d379 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:07.884159 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28c6b315-d050-41cf-8eb7-20e1bc78d379 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:07.885022 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28c6b315-d050-41cf-8eb7-20e1bc78d379 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:07.885609 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28c6b315-d050-41cf-8eb7-20e1bc78d379 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:07.958520 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-28c6b315-d050-41cf-8eb7-20e1bc78d379 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.093474 Aug 31 15:51:07.972366 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 309/633] 10.222.0.50 () {60 vars in 1178 bytes} [Wed Aug 31 15:51:07 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:51:07.977546 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d7710d4c-c255-4bfe-b95b-60c8cb3fabf5 tempest-SecurityGroupsTestAdminJSON-1677170732 tempest-SecurityGroupsTestAdminJSON-1677170732-project] Calling method '.version_select at 0x7fbb46a39f70>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:08.718256 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-eb0f7fb9-af97-444f-89c0-a99da92f6d9f tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:08.737640 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-eb0f7fb9-af97-444f-89c0-a99da92f6d9f tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:08.745242 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-eb0f7fb9-af97-444f-89c0-a99da92f6d9f tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:08.747504 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-eb0f7fb9-af97-444f-89c0-a99da92f6d9f tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/61e7db75-00b5-41e8-8efb-bced641ddd7a" status: 200 len: 1565 microversion: 2.25 time: 0.976417 Aug 31 15:51:08.748293 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 325/634] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:51:07 2022] GET /compute/v2.1/servers/61e7db75-00b5-41e8-8efb-bced641ddd7a => generated 1565 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:51:08.767429 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ae2eab4b-6f00-4bad-bf4d-fed586837b54 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:08.781967 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ae2eab4b-6f00-4bad-bf4d-fed586837b54 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:08.782856 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ae2eab4b-6f00-4bad-bf4d-fed586837b54 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:08.783481 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ae2eab4b-6f00-4bad-bf4d-fed586837b54 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:08.785367 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ae2eab4b-6f00-4bad-bf4d-fed586837b54 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:08.786009 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ae2eab4b-6f00-4bad-bf4d-fed586837b54 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:08.786621 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ae2eab4b-6f00-4bad-bf4d-fed586837b54 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:08.840186 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ae2eab4b-6f00-4bad-bf4d-fed586837b54 tempest-ServicesAdminNegativeV253TestJSON-1364816767 tempest-ServicesAdminNegativeV253TestJSON-1364816767-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.084198 Aug 31 15:51:08.841313 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 326/635] 10.222.0.50 () {60 vars in 1239 bytes} [Wed Aug 31 15:51:08 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:08.846187 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-57892fbf-6028-4a5d-a772-89b37f7d8e32 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:08.847025 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-57892fbf-6028-4a5d-a772-89b37f7d8e32 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: f0bc4527-6410-4415-b9db-7a76b91dfee3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:08.853875 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-57892fbf-6028-4a5d-a772-89b37f7d8e32 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:08.854974 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-57892fbf-6028-4a5d-a772-89b37f7d8e32 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:08.855564 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-57892fbf-6028-4a5d-a772-89b37f7d8e32 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:08.856480 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-57892fbf-6028-4a5d-a772-89b37f7d8e32 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:08.857080 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-57892fbf-6028-4a5d-a772-89b37f7d8e32 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:08.857646 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-57892fbf-6028-4a5d-a772-89b37f7d8e32 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:08.981897 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d7710d4c-c255-4bfe-b95b-60c8cb3fabf5 tempest-SecurityGroupsTestAdminJSON-1677170732 tempest-SecurityGroupsTestAdminJSON-1677170732-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/c61e4aed-1ab8-4c37-9a7c-59848482b9f5" status: 202 len: 0 microversion: 2.1 time: 1.012909 Aug 31 15:51:08.990447 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 310/636] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 31 15:51:07 2022] DELETE /compute/v2.1/os-security-groups/c61e4aed-1ab8-4c37-9a7c-59848482b9f5 => generated 0 bytes in 1024 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:51:08.997568 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e468c7cf-3563-4580-9304-34bf5bc10bd4 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:08.998742 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e468c7cf-3563-4580-9304-34bf5bc10bd4 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: a5a21e54-e375-4370-9d9e-b41df3e5922e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:09.007687 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e468c7cf-3563-4580-9304-34bf5bc10bd4 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:09.008351 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e468c7cf-3563-4580-9304-34bf5bc10bd4 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:09.009974 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e468c7cf-3563-4580-9304-34bf5bc10bd4 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:09.011923 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e468c7cf-3563-4580-9304-34bf5bc10bd4 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:09.012378 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e468c7cf-3563-4580-9304-34bf5bc10bd4 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:09.013019 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e468c7cf-3563-4580-9304-34bf5bc10bd4 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:09.278680 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-57892fbf-6028-4a5d-a772-89b37f7d8e32 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:09.314593 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-57892fbf-6028-4a5d-a772-89b37f7d8e32 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/f0bc4527-6410-4415-b9db-7a76b91dfee3" status: 200 len: 1317 microversion: 2.1 time: 0.471948 Aug 31 15:51:09.324208 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 327/637] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:08 2022] GET /compute/v2.1/servers/f0bc4527-6410-4415-b9db-7a76b91dfee3 => generated 1317 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:09.325120 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e468c7cf-3563-4580-9304-34bf5bc10bd4 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:09.338412 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e468c7cf-3563-4580-9304-34bf5bc10bd4 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e" status: 200 len: 1476 microversion: 2.1 time: 0.342414 Aug 31 15:51:09.345370 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 311/638] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:08 2022] GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e => generated 1476 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:09.661679 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7fa3d719-83fa-4939-a50c-093d11f97776 tempest-ServicesAdminNegativeV253TestJSON-1541497336 tempest-ServicesAdminNegativeV253TestJSON-1541497336-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:09.667322 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7fa3d719-83fa-4939-a50c-093d11f97776 tempest-ServicesAdminNegativeV253TestJSON-1541497336 tempest-ServicesAdminNegativeV253TestJSON-1541497336-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'a988b4a124fd436582ad8e8adc76ad85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b9e1ec3eb943c58b321996599f0ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:09.670257 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7fa3d719-83fa-4939-a50c-093d11f97776 tempest-ServicesAdminNegativeV253TestJSON-1541497336 tempest-ServicesAdminNegativeV253TestJSON-1541497336-project] Request method failure captured: Aug 31 15:51:09.670257 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 31 15:51:09.670257 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:51:09.670257 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:51:09.670257 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:51:09.670257 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:51:09.670257 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:51:09.670257 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:51:09.670257 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:51:09.670257 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:51:09.670257 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4NlCIg2XbwucDvcJAzchxLgv5qb-Cw0HOTdGvlLokts6MRiIOuN-llUyoQ7xYCxnaGQTnMvHUeRaKUWrOwA_8ZQDvKSpgYMxa2wd-SKT7DoDWelZfBKx6q8kmzmCawVN7eJB_-DvwGNdbbk7DH03yUo_-nA3tnwidRpBdT30-x0AwE Aug 31 15:51:09.670257 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:51:09.670257 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:51:09.670257 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:51:09.670257 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:51:09.670257 n-d-833090-16 devstack@n-api.service[128864]: X-Openstack-Nova-Api-Version: 2.53 Aug 31 15:51:09.670257 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:51:09.670257 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:51:09.670257 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 54b9e1ec3eb943c58b321996599f0ed8 Aug 31 15:51:09.670257 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1541497336 Aug 31 15:51:09.670257 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:51:09.670257 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:51:09.671708 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/54b9e1ec3eb943c58b321996599f0ed8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/54b9e1ec3eb943c58b321996599f0ed8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/54b9e1ec3eb943c58b321996599f0ed8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_54b9e1ec3eb943c58b321996599f0ed8", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:51:09.671708 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1541497336 Aug 31 15:51:09.671708 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 54b9e1ec3eb943c58b321996599f0ed8 Aug 31 15:51:09.671708 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1541497336 Aug 31 15:51:09.671708 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1541497336-project Aug 31 15:51:09.671708 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:51:09.671708 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:51:09.671708 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: a988b4a124fd436582ad8e8adc76ad85 Aug 31 15:51:09.671708 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1541497336-project Aug 31 15:51:09.671708 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:51:09.671708 n-d-833090-16 devstack@n-api.service[128864]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 31 15:51:09.671708 n-d-833090-16 devstack@n-api.service[128864]: action_args: {} Aug 31 15:51:09.672495 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:51:09.672495 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:51:09.672495 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:51:09.672495 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:51:09.672495 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:51:09.672495 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:51:09.672495 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 15:51:09.672495 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:51:09.672495 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 15:51:09.672495 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:51:09.672495 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:51:09.672495 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:51:09.672495 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Aug 31 15:51:09.672495 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 31 15:51:09.672495 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 15:51:09.672495 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 15:51:09.672495 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 15:51:09.672495 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 15:51:09.672495 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:51:09.673661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:51:09.673661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:51:09.673661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:51:09.673661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 15:51:09.673661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 15:51:09.673661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 15:51:09.673661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 15:51:09.673661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 15:51:09.673661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 15:51:09.673661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 31 15:51:09.673661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:51:09.673661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:51:09.673661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:51:09.673661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:51:09.673661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:51:09.673661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:51:09.673661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 15:51:09.673661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 15:51:09.673661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 31 15:51:09.673661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:51:09.677114 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7fa3d719-83fa-4939-a50c-093d11f97776 tempest-ServicesAdminNegativeV253TestJSON-1541497336 tempest-ServicesAdminNegativeV253TestJSON-1541497336-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:51:09.680299 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7fa3d719-83fa-4939-a50c-093d11f97776 tempest-ServicesAdminNegativeV253TestJSON-1541497336 tempest-ServicesAdminNegativeV253TestJSON-1541497336-project] 10.222.0.50 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.354467 Aug 31 15:51:09.681893 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 328/639] 10.222.0.50 () {60 vars in 1178 bytes} [Wed Aug 31 15:51:09 2022] GET /compute/v2.1/os-services => generated 112 bytes in 357 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Aug 31 15:51:09.776568 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dc5a7a2d-6b06-49d4-bf29-ff45c1ac4f82 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:09.777189 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dc5a7a2d-6b06-49d4-bf29-ff45c1ac4f82 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 61e7db75-00b5-41e8-8efb-bced641ddd7a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:09.792798 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc5a7a2d-6b06-49d4-bf29-ff45c1ac4f82 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:09.794707 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc5a7a2d-6b06-49d4-bf29-ff45c1ac4f82 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:09.795368 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc5a7a2d-6b06-49d4-bf29-ff45c1ac4f82 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:09.797548 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc5a7a2d-6b06-49d4-bf29-ff45c1ac4f82 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:09.798745 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc5a7a2d-6b06-49d4-bf29-ff45c1ac4f82 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:09.799327 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc5a7a2d-6b06-49d4-bf29-ff45c1ac4f82 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:10.039063 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dc5a7a2d-6b06-49d4-bf29-ff45c1ac4f82 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:10.057413 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dc5a7a2d-6b06-49d4-bf29-ff45c1ac4f82 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:10.062890 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dc5a7a2d-6b06-49d4-bf29-ff45c1ac4f82 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:10.066378 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dc5a7a2d-6b06-49d4-bf29-ff45c1ac4f82 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/61e7db75-00b5-41e8-8efb-bced641ddd7a" status: 200 len: 1565 microversion: 2.25 time: 0.293489 Aug 31 15:51:10.068029 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 312/640] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:51:09 2022] GET /compute/v2.1/servers/61e7db75-00b5-41e8-8efb-bced641ddd7a => generated 1565 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:51:10.337840 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ee85ee16-fc7f-4547-8d53-11c19703edab tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:10.340296 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ee85ee16-fc7f-4547-8d53-11c19703edab tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: f0bc4527-6410-4415-b9db-7a76b91dfee3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:10.348936 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=6 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:51:10.353473 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ee85ee16-fc7f-4547-8d53-11c19703edab tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:10.354297 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ee85ee16-fc7f-4547-8d53-11c19703edab tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:10.355202 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ee85ee16-fc7f-4547-8d53-11c19703edab tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:10.356520 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ee85ee16-fc7f-4547-8d53-11c19703edab tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:10.357271 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ee85ee16-fc7f-4547-8d53-11c19703edab tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:10.357889 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ee85ee16-fc7f-4547-8d53-11c19703edab tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:10.367913 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c139361a-894b-41c7-b08f-37af6af92e6c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:10.368614 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c139361a-894b-41c7-b08f-37af6af92e6c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: a5a21e54-e375-4370-9d9e-b41df3e5922e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:10.385895 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c139361a-894b-41c7-b08f-37af6af92e6c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:10.390282 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c139361a-894b-41c7-b08f-37af6af92e6c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:10.393285 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c139361a-894b-41c7-b08f-37af6af92e6c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:10.394156 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c139361a-894b-41c7-b08f-37af6af92e6c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:10.395043 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c139361a-894b-41c7-b08f-37af6af92e6c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:10.396686 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c139361a-894b-41c7-b08f-37af6af92e6c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:10.746210 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c139361a-894b-41c7-b08f-37af6af92e6c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:10.760709 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c139361a-894b-41c7-b08f-37af6af92e6c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e" status: 200 len: 1476 microversion: 2.1 time: 0.396329 Aug 31 15:51:10.762149 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 313/641] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:10 2022] GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e => generated 1476 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:51:10.765733 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ee85ee16-fc7f-4547-8d53-11c19703edab tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:10.771290 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-f838dc46-c8f4-4828-91f6-b78f800ef4cb req-72a2631f-99f3-45c1-b9f2-99f698f95cd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61e7db75-00b5-41e8-8efb-bced641ddd7a", "name": "network-vif-unplugged", "status": "completed", "tag": "034d0508-b254-4514-999a-4b96164ff990"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:51:10.777909 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ee85ee16-fc7f-4547-8d53-11c19703edab tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/f0bc4527-6410-4415-b9db-7a76b91dfee3" status: 200 len: 1317 microversion: 2.1 time: 0.445889 Aug 31 15:51:10.778526 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 329/642] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:10 2022] GET /compute/v2.1/servers/f0bc4527-6410-4415-b9db-7a76b91dfee3 => generated 1317 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:10.790162 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f838dc46-c8f4-4828-91f6-b78f800ef4cb req-72a2631f-99f3-45c1-b9f2-99f698f95cd5 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:10.792196 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f838dc46-c8f4-4828-91f6-b78f800ef4cb req-72a2631f-99f3-45c1-b9f2-99f698f95cd5 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:10.793064 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f838dc46-c8f4-4828-91f6-b78f800ef4cb req-72a2631f-99f3-45c1-b9f2-99f698f95cd5 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:10.814647 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-f838dc46-c8f4-4828-91f6-b78f800ef4cb req-72a2631f-99f3-45c1-b9f2-99f698f95cd5 service nova] Creating event network-vif-unplugged:034d0508-b254-4514-999a-4b96164ff990 for instance 61e7db75-00b5-41e8-8efb-bced641ddd7a on n-h1-833090-16 Aug 31 15:51:10.820077 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-f838dc46-c8f4-4828-91f6-b78f800ef4cb req-72a2631f-99f3-45c1-b9f2-99f698f95cd5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055653 Aug 31 15:51:10.820557 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 314/643] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:51:11.095083 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-06314a91-737f-45bd-8eed-aa60784138b6 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:11.096261 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-06314a91-737f-45bd-8eed-aa60784138b6 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 61e7db75-00b5-41e8-8efb-bced641ddd7a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:11.103366 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06314a91-737f-45bd-8eed-aa60784138b6 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:11.104805 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06314a91-737f-45bd-8eed-aa60784138b6 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:11.105718 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06314a91-737f-45bd-8eed-aa60784138b6 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:11.107037 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06314a91-737f-45bd-8eed-aa60784138b6 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:11.107742 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06314a91-737f-45bd-8eed-aa60784138b6 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:11.108370 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06314a91-737f-45bd-8eed-aa60784138b6 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:11.528973 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-06314a91-737f-45bd-8eed-aa60784138b6 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:11.546001 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-06314a91-737f-45bd-8eed-aa60784138b6 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:11.551989 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-06314a91-737f-45bd-8eed-aa60784138b6 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:11.557383 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-06314a91-737f-45bd-8eed-aa60784138b6 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/61e7db75-00b5-41e8-8efb-bced641ddd7a" status: 200 len: 1565 microversion: 2.25 time: 0.465557 Aug 31 15:51:11.557999 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 330/644] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:51:11 2022] GET /compute/v2.1/servers/61e7db75-00b5-41e8-8efb-bced641ddd7a => generated 1565 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:51:11.787496 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1be1dfe7-9b49-4c04-8204-a1e68f18804b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:11.788465 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1be1dfe7-9b49-4c04-8204-a1e68f18804b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: a5a21e54-e375-4370-9d9e-b41df3e5922e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:11.799995 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e90568be-4551-49f7-8617-b3634ab89a16 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:11.800616 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e90568be-4551-49f7-8617-b3634ab89a16 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: f0bc4527-6410-4415-b9db-7a76b91dfee3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:11.811110 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1be1dfe7-9b49-4c04-8204-a1e68f18804b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:11.813098 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1be1dfe7-9b49-4c04-8204-a1e68f18804b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:11.813733 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1be1dfe7-9b49-4c04-8204-a1e68f18804b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:11.814728 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1be1dfe7-9b49-4c04-8204-a1e68f18804b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:11.815444 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1be1dfe7-9b49-4c04-8204-a1e68f18804b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:11.816060 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1be1dfe7-9b49-4c04-8204-a1e68f18804b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:11.819334 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e90568be-4551-49f7-8617-b3634ab89a16 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:11.819927 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e90568be-4551-49f7-8617-b3634ab89a16 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:11.820432 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e90568be-4551-49f7-8617-b3634ab89a16 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:11.824045 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e90568be-4551-49f7-8617-b3634ab89a16 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:11.824533 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e90568be-4551-49f7-8617-b3634ab89a16 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:11.824967 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e90568be-4551-49f7-8617-b3634ab89a16 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:12.140305 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1be1dfe7-9b49-4c04-8204-a1e68f18804b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:12.153628 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1be1dfe7-9b49-4c04-8204-a1e68f18804b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e" status: 200 len: 1476 microversion: 2.1 time: 0.372393 Aug 31 15:51:12.154846 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 315/645] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:11 2022] GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e => generated 1476 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:12.182655 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e90568be-4551-49f7-8617-b3634ab89a16 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:12.200569 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e90568be-4551-49f7-8617-b3634ab89a16 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/f0bc4527-6410-4415-b9db-7a76b91dfee3" status: 200 len: 1317 microversion: 2.1 time: 0.404191 Aug 31 15:51:12.202501 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 331/646] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:11 2022] GET /compute/v2.1/servers/f0bc4527-6410-4415-b9db-7a76b91dfee3 => generated 1317 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:51:12.592905 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e7709ab0-f716-42a7-a854-a2b9b3f54a88 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:12.593525 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e7709ab0-f716-42a7-a854-a2b9b3f54a88 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 61e7db75-00b5-41e8-8efb-bced641ddd7a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:12.610186 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7709ab0-f716-42a7-a854-a2b9b3f54a88 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:12.610688 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7709ab0-f716-42a7-a854-a2b9b3f54a88 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:12.611117 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7709ab0-f716-42a7-a854-a2b9b3f54a88 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:12.612100 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7709ab0-f716-42a7-a854-a2b9b3f54a88 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:12.612804 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7709ab0-f716-42a7-a854-a2b9b3f54a88 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:12.613193 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7709ab0-f716-42a7-a854-a2b9b3f54a88 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:12.843741 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-496988c5-567b-4587-a913-788a8360d631 req-f890b21d-dbca-4844-9a9b-30e3d3d57310 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61e7db75-00b5-41e8-8efb-bced641ddd7a", "tag": "034d0508-b254-4514-999a-4b96164ff990"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:51:12.865297 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-496988c5-567b-4587-a913-788a8360d631 req-f890b21d-dbca-4844-9a9b-30e3d3d57310 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:12.878868 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-496988c5-567b-4587-a913-788a8360d631 req-f890b21d-dbca-4844-9a9b-30e3d3d57310 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:12.879345 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-496988c5-567b-4587-a913-788a8360d631 req-f890b21d-dbca-4844-9a9b-30e3d3d57310 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:12.894887 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-496988c5-567b-4587-a913-788a8360d631 req-f890b21d-dbca-4844-9a9b-30e3d3d57310 service nova] Creating event network-changed:034d0508-b254-4514-999a-4b96164ff990 for instance 61e7db75-00b5-41e8-8efb-bced641ddd7a on n-h1-833090-16 Aug 31 15:51:12.906596 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e7709ab0-f716-42a7-a854-a2b9b3f54a88 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:12.921916 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-496988c5-567b-4587-a913-788a8360d631 req-f890b21d-dbca-4844-9a9b-30e3d3d57310 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064744 Aug 31 15:51:12.924822 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 332/647] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:51:12.926610 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e7709ab0-f716-42a7-a854-a2b9b3f54a88 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:12.929078 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e7709ab0-f716-42a7-a854-a2b9b3f54a88 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:12.933282 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e7709ab0-f716-42a7-a854-a2b9b3f54a88 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/61e7db75-00b5-41e8-8efb-bced641ddd7a" status: 200 len: 1565 microversion: 2.25 time: 0.344676 Aug 31 15:51:12.951014 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 316/648] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:51:12 2022] GET /compute/v2.1/servers/61e7db75-00b5-41e8-8efb-bced641ddd7a => generated 1565 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:51:13.180153 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-65b3f66d-162d-4682-a9d2-6d546a4acba3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:13.182551 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-65b3f66d-162d-4682-a9d2-6d546a4acba3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: a5a21e54-e375-4370-9d9e-b41df3e5922e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:13.207180 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-65b3f66d-162d-4682-a9d2-6d546a4acba3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:13.208078 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-65b3f66d-162d-4682-a9d2-6d546a4acba3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:13.209909 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-65b3f66d-162d-4682-a9d2-6d546a4acba3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:13.212047 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-65b3f66d-162d-4682-a9d2-6d546a4acba3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:13.214635 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-65b3f66d-162d-4682-a9d2-6d546a4acba3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:13.215780 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-65b3f66d-162d-4682-a9d2-6d546a4acba3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:13.223985 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3546cdfa-ffbd-46e0-a3d9-26a8ed697b65 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:13.225217 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3546cdfa-ffbd-46e0-a3d9-26a8ed697b65 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: f0bc4527-6410-4415-b9db-7a76b91dfee3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:13.240648 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3546cdfa-ffbd-46e0-a3d9-26a8ed697b65 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:13.241213 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3546cdfa-ffbd-46e0-a3d9-26a8ed697b65 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:13.247190 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3546cdfa-ffbd-46e0-a3d9-26a8ed697b65 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:13.248378 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3546cdfa-ffbd-46e0-a3d9-26a8ed697b65 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:13.249004 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3546cdfa-ffbd-46e0-a3d9-26a8ed697b65 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:13.249585 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3546cdfa-ffbd-46e0-a3d9-26a8ed697b65 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:13.749850 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-65b3f66d-162d-4682-a9d2-6d546a4acba3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:13.757795 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-65b3f66d-162d-4682-a9d2-6d546a4acba3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e" status: 200 len: 1476 microversion: 2.1 time: 0.585811 Aug 31 15:51:13.766391 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 333/649] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:13 2022] GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e => generated 1476 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:13.857195 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3546cdfa-ffbd-46e0-a3d9-26a8ed697b65 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:13.888654 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3546cdfa-ffbd-46e0-a3d9-26a8ed697b65 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/f0bc4527-6410-4415-b9db-7a76b91dfee3" status: 200 len: 1317 microversion: 2.1 time: 0.669062 Aug 31 15:51:13.889258 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 317/650] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:13 2022] GET /compute/v2.1/servers/f0bc4527-6410-4415-b9db-7a76b91dfee3 => generated 1317 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:13.960327 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-250816f2-4967-40ea-9b8a-17e692adb6a9 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:13.962591 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-250816f2-4967-40ea-9b8a-17e692adb6a9 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 61e7db75-00b5-41e8-8efb-bced641ddd7a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:13.982459 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-250816f2-4967-40ea-9b8a-17e692adb6a9 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:13.982974 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-250816f2-4967-40ea-9b8a-17e692adb6a9 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:13.984062 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-250816f2-4967-40ea-9b8a-17e692adb6a9 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:13.987840 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-250816f2-4967-40ea-9b8a-17e692adb6a9 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:13.988332 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-250816f2-4967-40ea-9b8a-17e692adb6a9 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:13.988845 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-250816f2-4967-40ea-9b8a-17e692adb6a9 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:14.654341 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-aa7d415a-2bf8-492e-9083-efb45716f553 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1088895867", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:51:14.754172 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-250816f2-4967-40ea-9b8a-17e692adb6a9 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:14.764658 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-aa7d415a-2bf8-492e-9083-efb45716f553 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] validate_networks() for None {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:51:14.772444 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-250816f2-4967-40ea-9b8a-17e692adb6a9 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:14.774250 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-250816f2-4967-40ea-9b8a-17e692adb6a9 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:14.776137 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-250816f2-4967-40ea-9b8a-17e692adb6a9 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/61e7db75-00b5-41e8-8efb-bced641ddd7a" status: 200 len: 1565 microversion: 2.25 time: 0.821824 Aug 31 15:51:14.776891 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 334/651] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:51:13 2022] GET /compute/v2.1/servers/61e7db75-00b5-41e8-8efb-bced641ddd7a => generated 1565 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:51:14.781731 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-6e758fc5-b714-4f5b-962f-515037e837fb req-073de0a7-dd42-479a-95d5-5ba3bad02f96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0bc4527-6410-4415-b9db-7a76b91dfee3", "name": "network-vif-plugged", "status": "completed", "tag": "6d4ecb80-bbfe-4c36-ae0e-0e7f651c074f"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:51:14.792152 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-6e758fc5-b714-4f5b-962f-515037e837fb req-073de0a7-dd42-479a-95d5-5ba3bad02f96 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:14.800896 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-6e758fc5-b714-4f5b-962f-515037e837fb req-073de0a7-dd42-479a-95d5-5ba3bad02f96 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:14.801619 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-6e758fc5-b714-4f5b-962f-515037e837fb req-073de0a7-dd42-479a-95d5-5ba3bad02f96 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:14.823854 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-6e758fc5-b714-4f5b-962f-515037e837fb req-073de0a7-dd42-479a-95d5-5ba3bad02f96 service nova] Creating event network-vif-plugged:6d4ecb80-bbfe-4c36-ae0e-0e7f651c074f for instance f0bc4527-6410-4415-b9db-7a76b91dfee3 on n-h1-833090-16 Aug 31 15:51:14.829495 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-6e758fc5-b714-4f5b-962f-515037e837fb req-073de0a7-dd42-479a-95d5-5ba3bad02f96 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051153 Aug 31 15:51:14.830721 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 335/652] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:51:14.836274 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d2051e77-2c2c-492e-97b2-96d009aa7863 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:14.837293 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d2051e77-2c2c-492e-97b2-96d009aa7863 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: a5a21e54-e375-4370-9d9e-b41df3e5922e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:14.845091 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d2051e77-2c2c-492e-97b2-96d009aa7863 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:14.845925 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d2051e77-2c2c-492e-97b2-96d009aa7863 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:14.846577 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d2051e77-2c2c-492e-97b2-96d009aa7863 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:14.847566 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d2051e77-2c2c-492e-97b2-96d009aa7863 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:14.848206 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d2051e77-2c2c-492e-97b2-96d009aa7863 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:14.848810 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d2051e77-2c2c-492e-97b2-96d009aa7863 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:15.187369 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d2051e77-2c2c-492e-97b2-96d009aa7863 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:15.201673 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d2051e77-2c2c-492e-97b2-96d009aa7863 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e" status: 200 len: 1476 microversion: 2.1 time: 0.364850 Aug 31 15:51:15.201673 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 336/653] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:14 2022] GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e => generated 1476 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:15.222204 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-11bda81b-e3a5-409d-bbe2-d35a48366eea tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:15.222845 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-11bda81b-e3a5-409d-bbe2-d35a48366eea tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: f0bc4527-6410-4415-b9db-7a76b91dfee3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:15.252172 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11bda81b-e3a5-409d-bbe2-d35a48366eea tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:15.252706 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11bda81b-e3a5-409d-bbe2-d35a48366eea tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:15.253130 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11bda81b-e3a5-409d-bbe2-d35a48366eea tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:15.255747 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11bda81b-e3a5-409d-bbe2-d35a48366eea tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:15.256458 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11bda81b-e3a5-409d-bbe2-d35a48366eea tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:15.260307 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11bda81b-e3a5-409d-bbe2-d35a48366eea tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:15.297375 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-aa7d415a-2bf8-492e-9083-efb45716f553 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:51:15.298069 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-aa7d415a-2bf8-492e-9083-efb45716f553 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:51:15.298703 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-aa7d415a-2bf8-492e-9083-efb45716f553 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:51:15.299272 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-aa7d415a-2bf8-492e-9083-efb45716f553 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:51:15.299843 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-aa7d415a-2bf8-492e-9083-efb45716f553 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:51:15.316702 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa7d415a-2bf8-492e-9083-efb45716f553 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:15.317742 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa7d415a-2bf8-492e-9083-efb45716f553 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:15.318663 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa7d415a-2bf8-492e-9083-efb45716f553 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:15.331246 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa7d415a-2bf8-492e-9083-efb45716f553 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:15.333161 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa7d415a-2bf8-492e-9083-efb45716f553 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:15.335297 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa7d415a-2bf8-492e-9083-efb45716f553 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:15.391060 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-aa7d415a-2bf8-492e-9083-efb45716f553 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Getting quotas for project 7e94509e985441f7b2802e6c6b164cec. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:51:15.418946 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-aa7d415a-2bf8-492e-9083-efb45716f553 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Getting quotas for user 6849c97bdb0948bc824cf5efe0f709a5 and project 7e94509e985441f7b2802e6c6b164cec. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:51:15.458434 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-aa7d415a-2bf8-492e-9083-efb45716f553 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:51:15.471723 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-aa7d415a-2bf8-492e-9083-efb45716f553 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] [instance: 842a551a-278d-4bd3-82e5-91a4c271d69a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:51:15.529137 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-11bda81b-e3a5-409d-bbe2-d35a48366eea tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:15.544697 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-11bda81b-e3a5-409d-bbe2-d35a48366eea tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/f0bc4527-6410-4415-b9db-7a76b91dfee3" status: 200 len: 1317 microversion: 2.1 time: 0.343096 Aug 31 15:51:15.550432 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 337/654] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:15 2022] GET /compute/v2.1/servers/f0bc4527-6410-4415-b9db-7a76b91dfee3 => generated 1317 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:15.588485 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-aa7d415a-2bf8-492e-9083-efb45716f553 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.264254 Aug 31 15:51:15.589625 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 318/655] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:51:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1268 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 15:51:15.647072 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-80f40c0c-b94d-4775-8e4b-2e6a7d2ed4fc tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:15.648352 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-80f40c0c-b94d-4775-8e4b-2e6a7d2ed4fc tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] [instance: 842a551a-278d-4bd3-82e5-91a4c271d69a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:15.723438 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5b0d4cdd-0a03-4798-b15b-1f7c3e6053e8 tempest-ServerGroup264TestJSON-565385532 tempest-ServerGroup264TestJSON-565385532-project] Action: 'create', calling method: .version_select at 0x7fbb46add3a0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:51:15.767391 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-80f40c0c-b94d-4775-8e4b-2e6a7d2ed4fc tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6849c97bdb0948bc824cf5efe0f709a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e94509e985441f7b2802e6c6b164cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:15.771044 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-5b0d4cdd-0a03-4798-b15b-1f7c3e6053e8 tempest-ServerGroup264TestJSON-565385532 tempest-ServerGroup264TestJSON-565385532-project] Getting quotas for project 6120d6eb0e78412f9059a7ad611e2500. Resources: {'server_groups'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:51:15.780231 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-80f40c0c-b94d-4775-8e4b-2e6a7d2ed4fc tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] 10.222.0.50 "GET /compute/v2.1/servers/842a551a-278d-4bd3-82e5-91a4c271d69a" status: 200 len: 1222 microversion: 2.1 time: 0.183068 Aug 31 15:51:15.781119 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-5b0d4cdd-0a03-4798-b15b-1f7c3e6053e8 tempest-ServerGroup264TestJSON-565385532 tempest-ServerGroup264TestJSON-565385532-project] Getting quotas for user e490627f565b49c5a14c85b40ee9608d and project 6120d6eb0e78412f9059a7ad611e2500. Resources: {'server_groups'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:51:15.799784 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 319/656] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:15 2022] GET /compute/v2.1/servers/842a551a-278d-4bd3-82e5-91a4c271d69a => generated 1222 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:15.816164 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-51548842-8037-42c1-9bb5-e3d76ef8a65b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:15.816807 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-51548842-8037-42c1-9bb5-e3d76ef8a65b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 61e7db75-00b5-41e8-8efb-bced641ddd7a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:15.839853 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-51548842-8037-42c1-9bb5-e3d76ef8a65b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:15.841178 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-51548842-8037-42c1-9bb5-e3d76ef8a65b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:15.842863 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-51548842-8037-42c1-9bb5-e3d76ef8a65b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:15.844739 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-51548842-8037-42c1-9bb5-e3d76ef8a65b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:15.845208 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-51548842-8037-42c1-9bb5-e3d76ef8a65b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:15.845634 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-51548842-8037-42c1-9bb5-e3d76ef8a65b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:15.864519 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-5b0d4cdd-0a03-4798-b15b-1f7c3e6053e8 tempest-ServerGroup264TestJSON-565385532 tempest-ServerGroup264TestJSON-565385532-project] Getting quotas for project 6120d6eb0e78412f9059a7ad611e2500. Resources: {'server_groups'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:51:15.873201 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-5b0d4cdd-0a03-4798-b15b-1f7c3e6053e8 tempest-ServerGroup264TestJSON-565385532 tempest-ServerGroup264TestJSON-565385532-project] Getting quotas for user e490627f565b49c5a14c85b40ee9608d and project 6120d6eb0e78412f9059a7ad611e2500. Resources: {'server_groups'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:51:15.894378 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5b0d4cdd-0a03-4798-b15b-1f7c3e6053e8 tempest-ServerGroup264TestJSON-565385532 tempest-ServerGroup264TestJSON-565385532-project] 10.222.0.50 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.340484 Aug 31 15:51:15.895019 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 338/657] 10.222.0.50 () {62 vars in 1214 bytes} [Wed Aug 31 15:51:15 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:51:15.909531 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e5f04054-74c0-474c-a9e7-7753a9f6c863 tempest-ServerGroup264TestJSON-565385532 tempest-ServerGroup264TestJSON-565385532-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:15.955575 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e5f04054-74c0-474c-a9e7-7753a9f6c863 tempest-ServerGroup264TestJSON-565385532 tempest-ServerGroup264TestJSON-565385532-project] 10.222.0.50 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.053346 Aug 31 15:51:15.963584 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 339/658] 10.222.0.50 () {60 vars in 1193 bytes} [Wed Aug 31 15:51:15 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:51:15.973649 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e24b47c3-97f4-4793-aa38-ebc73c64f561 tempest-ServerGroup264TestJSON-565385532 tempest-ServerGroup264TestJSON-565385532-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:15.990732 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e24b47c3-97f4-4793-aa38-ebc73c64f561 tempest-ServerGroup264TestJSON-565385532 tempest-ServerGroup264TestJSON-565385532-project] 10.222.0.50 "GET /compute/v2.1/os-server-groups/23f00a5e-79a0-4f77-b1cb-78d070b4437a" status: 200 len: 235 microversion: 2.64 time: 0.025608 Aug 31 15:51:15.999839 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 340/659] 10.222.0.50 () {60 vars in 1304 bytes} [Wed Aug 31 15:51:15 2022] GET /compute/v2.1/os-server-groups/23f00a5e-79a0-4f77-b1cb-78d070b4437a => generated 235 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:51:16.005608 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0d14d571-87a5-45b1-91bb-08265b0f8636 tempest-ServerGroup264TestJSON-565385532 tempest-ServerGroup264TestJSON-565385532-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:16.059585 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0d14d571-87a5-45b1-91bb-08265b0f8636 tempest-ServerGroup264TestJSON-565385532 tempest-ServerGroup264TestJSON-565385532-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/23f00a5e-79a0-4f77-b1cb-78d070b4437a" status: 204 len: 0 microversion: 2.64 time: 0.056635 Aug 31 15:51:16.065484 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 341/660] 10.222.0.50 () {60 vars in 1307 bytes} [Wed Aug 31 15:51:15 2022] DELETE /compute/v2.1/os-server-groups/23f00a5e-79a0-4f77-b1cb-78d070b4437a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 15:51:16.085096 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9a5ba75b-7ceb-4830-a62f-a253bbbc1206 tempest-ServerGroup264TestJSON-565385532 tempest-ServerGroup264TestJSON-565385532-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:16.103628 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-9a5ba75b-7ceb-4830-a62f-a253bbbc1206 tempest-ServerGroup264TestJSON-565385532 tempest-ServerGroup264TestJSON-565385532-project] HTTP exception thrown: Instance group 23f00a5e-79a0-4f77-b1cb-78d070b4437a could not be found. Aug 31 15:51:16.107161 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9a5ba75b-7ceb-4830-a62f-a253bbbc1206 tempest-ServerGroup264TestJSON-565385532 tempest-ServerGroup264TestJSON-565385532-project] Request method failure captured: Aug 31 15:51:16.107161 n-d-833090-16 devstack@n-api.service[128864]: request: DELETE /compute/v2.1/os-server-groups/23f00a5e-79a0-4f77-b1cb-78d070b4437a HTTP/1.1 Aug 31 15:51:16.107161 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:51:16.107161 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:51:16.107161 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:51:16.107161 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:51:16.107161 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:51:16.107161 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:51:16.107161 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:51:16.107161 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:51:16.107161 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4NyzBw6N70ujppJ10UfgsC15evcQF3JRBfrLQwkZY2pBMzUh3vXZFr4eijyuziiZeTp_Uq29ayH488Ktnq88e9bI96CzgbP6CQf9nRzy_yvcJrYFZskV3yajZvJeihBGcE5V2q4TNVBKHUXk_qA3wOpdfESDt_11r059JqUuIjqVZQ Aug 31 15:51:16.107161 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:51:16.107161 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:51:16.107161 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:51:16.107161 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:51:16.107161 n-d-833090-16 devstack@n-api.service[128864]: X-Openstack-Nova-Api-Version: 2.64 Aug 31 15:51:16.107161 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:51:16.107161 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:51:16.107161 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 6120d6eb0e78412f9059a7ad611e2500 Aug 31 15:51:16.107161 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServerGroup264TestJSON-565385532 Aug 31 15:51:16.107161 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:51:16.107161 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:51:16.109306 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6120d6eb0e78412f9059a7ad611e2500"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6120d6eb0e78412f9059a7ad611e2500"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6120d6eb0e78412f9059a7ad611e2500"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6120d6eb0e78412f9059a7ad611e2500", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:51:16.109306 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServerGroup264TestJSON-565385532 Aug 31 15:51:16.109306 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 6120d6eb0e78412f9059a7ad611e2500 Aug 31 15:51:16.109306 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServerGroup264TestJSON-565385532 Aug 31 15:51:16.109306 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServerGroup264TestJSON-565385532-project Aug 31 15:51:16.109306 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:51:16.109306 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:51:16.109306 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: e490627f565b49c5a14c85b40ee9608d Aug 31 15:51:16.109306 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServerGroup264TestJSON-565385532-project Aug 31 15:51:16.109306 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:51:16.109306 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance group 23f00a5e-79a0-4f77-b1cb-78d070b4437a could not be found. Aug 31 15:51:16.109306 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '23f00a5e-79a0-4f77-b1cb-78d070b4437a'} Aug 31 15:51:16.110245 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:51:16.110245 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:51:16.110245 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 31 15:51:16.110245 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 31 15:51:16.110245 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 15:51:16.110245 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 15:51:16.110245 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 31 15:51:16.110245 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 31 15:51:16.110245 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 31 15:51:16.110245 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 31 15:51:16.110245 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 31 15:51:16.110245 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 31 15:51:16.110245 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 23f00a5e-79a0-4f77-b1cb-78d070b4437a could not be found. Aug 31 15:51:16.110245 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:51:16.110245 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:51:16.110245 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:51:16.110245 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:51:16.110245 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:51:16.110245 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:51:16.112145 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:51:16.112145 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:51:16.112145 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:51:16.112145 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:51:16.112145 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 31 15:51:16.112145 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:51:16.112145 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 23f00a5e-79a0-4f77-b1cb-78d070b4437a could not be found. Aug 31 15:51:16.112145 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:51:16.112145 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:51:16.112145 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:51:16.112145 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:51:16.112145 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:51:16.112145 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:51:16.112145 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:51:16.112145 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:51:16.112145 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 23f00a5e-79a0-4f77-b1cb-78d070b4437a could not be found. Aug 31 15:51:16.112145 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:51:16.118082 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9a5ba75b-7ceb-4830-a62f-a253bbbc1206 tempest-ServerGroup264TestJSON-565385532 tempest-ServerGroup264TestJSON-565385532-project] Returning 404 to user: Instance group 23f00a5e-79a0-4f77-b1cb-78d070b4437a could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:51:16.119915 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9a5ba75b-7ceb-4830-a62f-a253bbbc1206 tempest-ServerGroup264TestJSON-565385532 tempest-ServerGroup264TestJSON-565385532-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/23f00a5e-79a0-4f77-b1cb-78d070b4437a" status: 404 len: 117 microversion: 2.64 time: 0.050175 Aug 31 15:51:16.121172 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 342/661] 10.222.0.50 () {60 vars in 1307 bytes} [Wed Aug 31 15:51:16 2022] DELETE /compute/v2.1/os-server-groups/23f00a5e-79a0-4f77-b1cb-78d070b4437a => generated 117 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 15:51:16.190702 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-51548842-8037-42c1-9bb5-e3d76ef8a65b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:16.201353 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-51548842-8037-42c1-9bb5-e3d76ef8a65b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:16.202846 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-51548842-8037-42c1-9bb5-e3d76ef8a65b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:16.209253 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-51548842-8037-42c1-9bb5-e3d76ef8a65b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/61e7db75-00b5-41e8-8efb-bced641ddd7a" status: 200 len: 1565 microversion: 2.25 time: 0.401825 Aug 31 15:51:16.216889 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 320/662] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:51:15 2022] GET /compute/v2.1/servers/61e7db75-00b5-41e8-8efb-bced641ddd7a => generated 1565 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:51:16.231076 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-dd7f2e15-9697-4abe-ad86-a37e15be1ce1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:16.232764 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-dd7f2e15-9697-4abe-ad86-a37e15be1ce1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: a5a21e54-e375-4370-9d9e-b41df3e5922e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:16.246545 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dd7f2e15-9697-4abe-ad86-a37e15be1ce1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:16.248884 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dd7f2e15-9697-4abe-ad86-a37e15be1ce1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:16.249448 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dd7f2e15-9697-4abe-ad86-a37e15be1ce1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:16.251878 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dd7f2e15-9697-4abe-ad86-a37e15be1ce1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:16.252797 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dd7f2e15-9697-4abe-ad86-a37e15be1ce1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:16.259934 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dd7f2e15-9697-4abe-ad86-a37e15be1ce1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:16.575682 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d775af40-3f1a-4ed7-8a2f-f369c9c1b776 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:16.575936 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d775af40-3f1a-4ed7-8a2f-f369c9c1b776 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: f0bc4527-6410-4415-b9db-7a76b91dfee3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:16.591656 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d775af40-3f1a-4ed7-8a2f-f369c9c1b776 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:16.592770 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d775af40-3f1a-4ed7-8a2f-f369c9c1b776 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:16.594549 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d775af40-3f1a-4ed7-8a2f-f369c9c1b776 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:16.596507 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d775af40-3f1a-4ed7-8a2f-f369c9c1b776 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:16.597203 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d775af40-3f1a-4ed7-8a2f-f369c9c1b776 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:16.599533 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d775af40-3f1a-4ed7-8a2f-f369c9c1b776 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:16.625167 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-dd7f2e15-9697-4abe-ad86-a37e15be1ce1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:16.647343 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-dd7f2e15-9697-4abe-ad86-a37e15be1ce1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e" status: 200 len: 1476 microversion: 2.1 time: 0.421504 Aug 31 15:51:16.648283 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 343/663] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:16 2022] GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e => generated 1476 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:16.820718 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8b5e93bb-e580-4714-8730-c85fcf917515 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:16.821758 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8b5e93bb-e580-4714-8730-c85fcf917515 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] [instance: 842a551a-278d-4bd3-82e5-91a4c271d69a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:16.835426 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b5e93bb-e580-4714-8730-c85fcf917515 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:16.836290 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b5e93bb-e580-4714-8730-c85fcf917515 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:16.837367 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b5e93bb-e580-4714-8730-c85fcf917515 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:16.838860 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b5e93bb-e580-4714-8730-c85fcf917515 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:16.845758 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b5e93bb-e580-4714-8730-c85fcf917515 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:16.847400 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b5e93bb-e580-4714-8730-c85fcf917515 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:17.095676 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8b5e93bb-e580-4714-8730-c85fcf917515 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6849c97bdb0948bc824cf5efe0f709a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e94509e985441f7b2802e6c6b164cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:17.108591 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8b5e93bb-e580-4714-8730-c85fcf917515 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] 10.222.0.50 "GET /compute/v2.1/servers/842a551a-278d-4bd3-82e5-91a4c271d69a" status: 200 len: 1226 microversion: 2.1 time: 0.293440 Aug 31 15:51:17.109269 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 344/664] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:16 2022] GET /compute/v2.1/servers/842a551a-278d-4bd3-82e5-91a4c271d69a => generated 1226 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:51:17.205419 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d775af40-3f1a-4ed7-8a2f-f369c9c1b776 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:17.207780 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:51:17.218372 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d775af40-3f1a-4ed7-8a2f-f369c9c1b776 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/f0bc4527-6410-4415-b9db-7a76b91dfee3" status: 200 len: 1317 microversion: 2.1 time: 0.647242 Aug 31 15:51:17.223920 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 321/665] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:16 2022] GET /compute/v2.1/servers/f0bc4527-6410-4415-b9db-7a76b91dfee3 => generated 1317 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:51:17.238130 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-93aaf014-6f52-482c-b783-c446a95c56de tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:17.238995 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-93aaf014-6f52-482c-b783-c446a95c56de tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 61e7db75-00b5-41e8-8efb-bced641ddd7a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:17.253065 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-93aaf014-6f52-482c-b783-c446a95c56de tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:17.253788 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-93aaf014-6f52-482c-b783-c446a95c56de tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:17.254426 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-93aaf014-6f52-482c-b783-c446a95c56de tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:17.255344 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-93aaf014-6f52-482c-b783-c446a95c56de tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:17.255973 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-93aaf014-6f52-482c-b783-c446a95c56de tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:17.256569 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-93aaf014-6f52-482c-b783-c446a95c56de tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:17.380992 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-61eb84c9-f4bb-43a1-9f9a-0a22f11aab74 tempest-VolumesAdminNegativeTest-1121057591 tempest-VolumesAdminNegativeTest-1121057591-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "8b41c525-7f05-407c-a05f-260b7cc275f6"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:51:17.383819 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-61eb84c9-f4bb-43a1-9f9a-0a22f11aab74 tempest-VolumesAdminNegativeTest-1121057591 tempest-VolumesAdminNegativeTest-1121057591-project-admin] [instance: 1e8fdb86-13be-42a3-a7af-5d50024f7419] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:17.402835 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-61eb84c9-f4bb-43a1-9f9a-0a22f11aab74 tempest-VolumesAdminNegativeTest-1121057591 tempest-VolumesAdminNegativeTest-1121057591-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:17.403345 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-61eb84c9-f4bb-43a1-9f9a-0a22f11aab74 tempest-VolumesAdminNegativeTest-1121057591 tempest-VolumesAdminNegativeTest-1121057591-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:17.403931 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-61eb84c9-f4bb-43a1-9f9a-0a22f11aab74 tempest-VolumesAdminNegativeTest-1121057591 tempest-VolumesAdminNegativeTest-1121057591-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:17.404655 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-61eb84c9-f4bb-43a1-9f9a-0a22f11aab74 tempest-VolumesAdminNegativeTest-1121057591 tempest-VolumesAdminNegativeTest-1121057591-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:17.405113 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-61eb84c9-f4bb-43a1-9f9a-0a22f11aab74 tempest-VolumesAdminNegativeTest-1121057591 tempest-VolumesAdminNegativeTest-1121057591-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:17.405636 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-61eb84c9-f4bb-43a1-9f9a-0a22f11aab74 tempest-VolumesAdminNegativeTest-1121057591 tempest-VolumesAdminNegativeTest-1121057591-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:17.577922 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-93aaf014-6f52-482c-b783-c446a95c56de tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:17.594148 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-93aaf014-6f52-482c-b783-c446a95c56de tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:17.598569 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-93aaf014-6f52-482c-b783-c446a95c56de tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:17.600863 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-93aaf014-6f52-482c-b783-c446a95c56de tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/61e7db75-00b5-41e8-8efb-bced641ddd7a" status: 200 len: 1565 microversion: 2.25 time: 0.373810 Aug 31 15:51:17.608708 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 322/666] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:51:17 2022] GET /compute/v2.1/servers/61e7db75-00b5-41e8-8efb-bced641ddd7a => generated 1565 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:51:17.675886 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8aaebed7-f70a-4d90-82e8-412edd1a717b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:17.678726 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8aaebed7-f70a-4d90-82e8-412edd1a717b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: a5a21e54-e375-4370-9d9e-b41df3e5922e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:17.693340 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8aaebed7-f70a-4d90-82e8-412edd1a717b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:17.696437 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8aaebed7-f70a-4d90-82e8-412edd1a717b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:17.697269 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8aaebed7-f70a-4d90-82e8-412edd1a717b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:17.699545 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8aaebed7-f70a-4d90-82e8-412edd1a717b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:17.700242 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8aaebed7-f70a-4d90-82e8-412edd1a717b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:17.702431 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8aaebed7-f70a-4d90-82e8-412edd1a717b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:18.199898 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8aaebed7-f70a-4d90-82e8-412edd1a717b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:18.219848 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8aaebed7-f70a-4d90-82e8-412edd1a717b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e" status: 200 len: 1476 microversion: 2.1 time: 0.547956 Aug 31 15:51:18.232055 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 323/667] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:17 2022] GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e => generated 1476 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:51:18.248814 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0198af1d-045d-4920-98fa-767c1aa315e2 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:18.254932 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0198af1d-045d-4920-98fa-767c1aa315e2 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] [instance: 842a551a-278d-4bd3-82e5-91a4c271d69a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:18.284476 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0198af1d-045d-4920-98fa-767c1aa315e2 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:18.285283 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0198af1d-045d-4920-98fa-767c1aa315e2 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:18.285913 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0198af1d-045d-4920-98fa-767c1aa315e2 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:18.289866 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0198af1d-045d-4920-98fa-767c1aa315e2 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:18.290963 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0198af1d-045d-4920-98fa-767c1aa315e2 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:18.291878 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0198af1d-045d-4920-98fa-767c1aa315e2 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:18.373006 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-61eb84c9-f4bb-43a1-9f9a-0a22f11aab74 tempest-VolumesAdminNegativeTest-1121057591 tempest-VolumesAdminNegativeTest-1121057591-project-admin] HTTP exception thrown: Volume 8b41c525-7f05-407c-a05f-260b7cc275f6 could not be found. Aug 31 15:51:18.378607 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-61eb84c9-f4bb-43a1-9f9a-0a22f11aab74 tempest-VolumesAdminNegativeTest-1121057591 tempest-VolumesAdminNegativeTest-1121057591-project-admin] Request method failure captured: Aug 31 15:51:18.378607 n-d-833090-16 devstack@n-api.service[128864]: request: PUT /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419/os-volume_attachments/7a94e3b6-d9aa-4cef-b60a-ab31ad8db770 HTTP/1.1 Aug 31 15:51:18.378607 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:51:18.378607 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:51:18.378607 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:51:18.378607 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 74 Aug 31 15:51:18.378607 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:51:18.378607 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:51:18.378607 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:51:18.378607 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:51:18.378607 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4MWk_hExjJt-4p7zNvJSju3vxJcg4DGcLi036uZwUk7Q9QtVazPxAc5O6k3a5bZ824qYvU8wHkkUoeeos8uuKT0HawhD_bARcdb455NnjbUBt8BKvISxuJqE1ThXD0sHFQpqRPMzQMje16Ue58pMsRzLADQvUlh9oxfGDzfZz5g0bw Aug 31 15:51:18.378607 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:51:18.378607 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:51:18.378607 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:51:18.378607 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:51:18.378607 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:51:18.378607 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:51:18.378607 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 176a2e4690224bdba6c30a9d7c6c722c Aug 31 15:51:18.378607 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-VolumesAdminNegativeTest-1121057591 Aug 31 15:51:18.378607 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,admin,member Aug 31 15:51:18.378607 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,admin,member Aug 31 15:51:18.379909 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/176a2e4690224bdba6c30a9d7c6c722c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/176a2e4690224bdba6c30a9d7c6c722c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/176a2e4690224bdba6c30a9d7c6c722c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_176a2e4690224bdba6c30a9d7c6c722c", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:51:18.379909 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-VolumesAdminNegativeTest-1121057591 Aug 31 15:51:18.379909 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 176a2e4690224bdba6c30a9d7c6c722c Aug 31 15:51:18.379909 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1121057591 Aug 31 15:51:18.379909 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-VolumesAdminNegativeTest-1121057591-project-admin Aug 31 15:51:18.379909 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:51:18.379909 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:51:18.379909 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: df3a4aeff0ca49c2a1cda553d6239acc Aug 31 15:51:18.379909 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-VolumesAdminNegativeTest-1121057591-project-admin Aug 31 15:51:18.379909 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 15:51:18.379909 n-d-833090-16 devstack@n-api.service[128864]: {"volumeAttachment": {"volumeId": "8b41c525-7f05-407c-a05f-260b7cc275f6"}} Aug 31 15:51:18.379909 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:51:18.379909 n-d-833090-16 devstack@n-api.service[128864]: exception: Volume 8b41c525-7f05-407c-a05f-260b7cc275f6 could not be found. Aug 31 15:51:18.380712 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'server_id': '1e8fdb86-13be-42a3-a7af-5d50024f7419', 'id': '7a94e3b6-d9aa-4cef-b60a-ab31ad8db770', 'body': {'volumeAttachment': {'volumeId': '8b41c525-7f05-407c-a05f-260b7cc275f6'}}} Aug 31 15:51:18.380712 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:51:18.380712 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:51:18.380712 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 15:51:18.380712 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 15:51:18.380712 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 15:51:18.380712 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 15:51:18.380712 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 15:51:18.380712 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 15:51:18.380712 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 15:51:18.380712 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 15:51:18.380712 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 15:51:18.380712 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 15:51:18.380712 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 15:51:18.380712 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 15:51:18.380712 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 15:51:18.380712 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 15:51:18.382198 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8b41c525-7f05-407c-a05f-260b7cc275f6 could not be found. (HTTP 404) (Request-ID: req-b81d0750-bdd5-44fb-93cc-2ed53c343b8b) Aug 31 15:51:18.382198 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:51:18.382198 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:51:18.382198 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:51:18.382198 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:51:18.382198 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Aug 31 15:51:18.382198 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Aug 31 15:51:18.382198 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 15:51:18.382198 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 15:51:18.382198 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 15:51:18.382198 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 15:51:18.382198 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 15:51:18.382198 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 15:51:18.382198 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 15:51:18.382198 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 15:51:18.382198 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 15:51:18.382198 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 15:51:18.382198 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 15:51:18.382198 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 15:51:18.385355 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 15:51:18.385355 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 15:51:18.385355 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 15:51:18.385355 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 15:51:18.385355 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 15:51:18.385355 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 15:51:18.385355 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 15:51:18.385355 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 15:51:18.385355 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8b41c525-7f05-407c-a05f-260b7cc275f6 could not be found. Aug 31 15:51:18.385355 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:51:18.385355 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:51:18.385355 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:51:18.385355 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:51:18.385355 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:51:18.385355 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:51:18.385355 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:51:18.385355 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:51:18.385355 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:51:18.385355 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:51:18.387616 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:51:18.387616 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:51:18.387616 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:51:18.387616 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:51:18.387616 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 31 15:51:18.387616 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 31 15:51:18.387616 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Aug 31 15:51:18.387616 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 15:51:18.387616 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 8b41c525-7f05-407c-a05f-260b7cc275f6 could not be found. Aug 31 15:51:18.387616 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:51:18.387616 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:51:18.387616 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:51:18.387616 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:51:18.387616 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:51:18.387616 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:51:18.387616 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:51:18.387616 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:51:18.387616 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8b41c525-7f05-407c-a05f-260b7cc275f6 could not be found. Aug 31 15:51:18.387616 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:51:18.390058 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-61eb84c9-f4bb-43a1-9f9a-0a22f11aab74 tempest-VolumesAdminNegativeTest-1121057591 tempest-VolumesAdminNegativeTest-1121057591-project-admin] Returning 400 to user: Volume 8b41c525-7f05-407c-a05f-260b7cc275f6 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:51:18.390058 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-61eb84c9-f4bb-43a1-9f9a-0a22f11aab74 tempest-VolumesAdminNegativeTest-1121057591 tempest-VolumesAdminNegativeTest-1121057591-project-admin] 10.222.0.50 "PUT /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419/os-volume_attachments/7a94e3b6-d9aa-4cef-b60a-ab31ad8db770" status: 400 len: 107 microversion: 2.1 time: 1.270117 Aug 31 15:51:18.390058 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 345/668] 10.222.0.50 () {60 vars in 1433 bytes} [Wed Aug 31 15:51:17 2022] PUT /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419/os-volume_attachments/7a94e3b6-d9aa-4cef-b60a-ab31ad8db770 => generated 107 bytes in 1276 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 15:51:18.397621 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f32af686-937a-462c-91b0-01f5282be72f tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:18.398282 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f32af686-937a-462c-91b0-01f5282be72f tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: f0bc4527-6410-4415-b9db-7a76b91dfee3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:18.418275 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f32af686-937a-462c-91b0-01f5282be72f tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:18.420947 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f32af686-937a-462c-91b0-01f5282be72f tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:18.421441 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f32af686-937a-462c-91b0-01f5282be72f tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:18.422209 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f32af686-937a-462c-91b0-01f5282be72f tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:18.422679 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f32af686-937a-462c-91b0-01f5282be72f tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:18.426609 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f32af686-937a-462c-91b0-01f5282be72f tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:18.439886 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0198af1d-045d-4920-98fa-767c1aa315e2 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6849c97bdb0948bc824cf5efe0f709a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e94509e985441f7b2802e6c6b164cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:18.452290 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0198af1d-045d-4920-98fa-767c1aa315e2 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] 10.222.0.50 "GET /compute/v2.1/servers/842a551a-278d-4bd3-82e5-91a4c271d69a" status: 200 len: 1274 microversion: 2.1 time: 0.217955 Aug 31 15:51:18.453074 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 324/669] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:18 2022] GET /compute/v2.1/servers/842a551a-278d-4bd3-82e5-91a4c271d69a => generated 1274 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:18.583924 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bae7ab1a-21a3-409d-808d-2f3c1a9be02d tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:18.584777 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bae7ab1a-21a3-409d-808d-2f3c1a9be02d tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] [instance: 1e8fdb86-13be-42a3-a7af-5d50024f7419] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:18.612845 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bae7ab1a-21a3-409d-808d-2f3c1a9be02d tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:18.614352 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bae7ab1a-21a3-409d-808d-2f3c1a9be02d tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:18.615271 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bae7ab1a-21a3-409d-808d-2f3c1a9be02d tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:18.620540 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bae7ab1a-21a3-409d-808d-2f3c1a9be02d tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:18.624155 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bae7ab1a-21a3-409d-808d-2f3c1a9be02d tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:18.626070 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bae7ab1a-21a3-409d-808d-2f3c1a9be02d tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:18.803476 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=10 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:51:18.995471 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-bae7ab1a-21a3-409d-808d-2f3c1a9be02d tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lazy-loading 'services' on Instance uuid 1e8fdb86-13be-42a3-a7af-5d50024f7419 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:51:19.280394 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bae7ab1a-21a3-409d-808d-2f3c1a9be02d tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] 10.222.0.50 "DELETE /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419/os-volume_attachments/7a94e3b6-d9aa-4cef-b60a-ab31ad8db770" status: 202 len: 0 microversion: 2.1 time: 0.703546 Aug 31 15:51:19.282436 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 325/670] 10.222.0.50 () {58 vars in 1416 bytes} [Wed Aug 31 15:51:18 2022] DELETE /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419/os-volume_attachments/7a94e3b6-d9aa-4cef-b60a-ab31ad8db770 => generated 0 bytes in 707 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:51:19.288750 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f32af686-937a-462c-91b0-01f5282be72f tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:19.308861 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f32af686-937a-462c-91b0-01f5282be72f tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/f0bc4527-6410-4415-b9db-7a76b91dfee3" status: 200 len: 1317 microversion: 2.1 time: 0.921700 Aug 31 15:51:19.309699 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 346/671] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:18 2022] GET /compute/v2.1/servers/f0bc4527-6410-4415-b9db-7a76b91dfee3 => generated 1317 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:19.312515 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-393f12de-cbf9-45fb-b31a-de2658f6676d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:19.313770 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-393f12de-cbf9-45fb-b31a-de2658f6676d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 61e7db75-00b5-41e8-8efb-bced641ddd7a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:19.320556 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:51:19.343854 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-393f12de-cbf9-45fb-b31a-de2658f6676d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:19.346938 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-393f12de-cbf9-45fb-b31a-de2658f6676d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:19.347793 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-393f12de-cbf9-45fb-b31a-de2658f6676d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:19.348582 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-bec3e80f-551a-4c6f-825e-f3c09b3ec844 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:19.349267 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-bec3e80f-551a-4c6f-825e-f3c09b3ec844 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: a5a21e54-e375-4370-9d9e-b41df3e5922e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:19.349976 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-393f12de-cbf9-45fb-b31a-de2658f6676d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:19.352280 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-393f12de-cbf9-45fb-b31a-de2658f6676d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:19.352408 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=2,nova_api:DELETE=3 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:51:19.354002 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-393f12de-cbf9-45fb-b31a-de2658f6676d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:19.391559 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bec3e80f-551a-4c6f-825e-f3c09b3ec844 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:19.392119 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bec3e80f-551a-4c6f-825e-f3c09b3ec844 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:19.392562 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bec3e80f-551a-4c6f-825e-f3c09b3ec844 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:19.393201 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bec3e80f-551a-4c6f-825e-f3c09b3ec844 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:19.393666 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bec3e80f-551a-4c6f-825e-f3c09b3ec844 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:19.403950 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bec3e80f-551a-4c6f-825e-f3c09b3ec844 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:20.344654 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-bec3e80f-551a-4c6f-825e-f3c09b3ec844 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:20.355293 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-bec3e80f-551a-4c6f-825e-f3c09b3ec844 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e" status: 200 len: 1475 microversion: 2.1 time: 1.044734 Aug 31 15:51:20.356628 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 347/672] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:19 2022] GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e => generated 1475 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:20.361719 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-777e909f-d436-496c-880f-17c448964042 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:20.364879 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-777e909f-d436-496c-880f-17c448964042 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] [instance: 1e8fdb86-13be-42a3-a7af-5d50024f7419] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:20.377393 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-777e909f-d436-496c-880f-17c448964042 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:20.378119 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-777e909f-d436-496c-880f-17c448964042 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:20.378727 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-777e909f-d436-496c-880f-17c448964042 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:20.379601 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-777e909f-d436-496c-880f-17c448964042 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:20.398741 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-777e909f-d436-496c-880f-17c448964042 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:20.400651 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-777e909f-d436-496c-880f-17c448964042 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:20.468781 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:51:20.481923 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-777e909f-d436-496c-880f-17c448964042 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] 10.222.0.50 "GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124146 Aug 31 15:51:20.486772 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 348/673] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 15:51:20 2022] GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:51:20.499562 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-35c4f896-63b4-48ff-b9b1-18c5389d0fc4 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:20.500190 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-35c4f896-63b4-48ff-b9b1-18c5389d0fc4 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] [instance: 842a551a-278d-4bd3-82e5-91a4c271d69a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:20.522265 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-35c4f896-63b4-48ff-b9b1-18c5389d0fc4 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:20.522787 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-35c4f896-63b4-48ff-b9b1-18c5389d0fc4 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:20.523230 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-35c4f896-63b4-48ff-b9b1-18c5389d0fc4 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:20.527633 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-35c4f896-63b4-48ff-b9b1-18c5389d0fc4 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:20.528962 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-35c4f896-63b4-48ff-b9b1-18c5389d0fc4 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:20.529413 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-35c4f896-63b4-48ff-b9b1-18c5389d0fc4 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:20.856447 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-393f12de-cbf9-45fb-b31a-de2658f6676d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:20.872734 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-393f12de-cbf9-45fb-b31a-de2658f6676d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:20.874753 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-393f12de-cbf9-45fb-b31a-de2658f6676d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:20.876093 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-393f12de-cbf9-45fb-b31a-de2658f6676d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/61e7db75-00b5-41e8-8efb-bced641ddd7a" status: 200 len: 1565 microversion: 2.25 time: 1.591184 Aug 31 15:51:20.880056 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 326/674] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:51:19 2022] GET /compute/v2.1/servers/61e7db75-00b5-41e8-8efb-bced641ddd7a => generated 1565 bytes in 1597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:51:20.891799 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-27418707-488c-4c83-9679-bc325c367464 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:20.892829 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-27418707-488c-4c83-9679-bc325c367464 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: f0bc4527-6410-4415-b9db-7a76b91dfee3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:20.908584 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27418707-488c-4c83-9679-bc325c367464 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:20.909386 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27418707-488c-4c83-9679-bc325c367464 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:20.910488 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27418707-488c-4c83-9679-bc325c367464 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:20.911600 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27418707-488c-4c83-9679-bc325c367464 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:20.913435 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27418707-488c-4c83-9679-bc325c367464 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:20.914646 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27418707-488c-4c83-9679-bc325c367464 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:21.024395 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-35c4f896-63b4-48ff-b9b1-18c5389d0fc4 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6849c97bdb0948bc824cf5efe0f709a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e94509e985441f7b2802e6c6b164cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:21.041897 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-35c4f896-63b4-48ff-b9b1-18c5389d0fc4 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] 10.222.0.50 "GET /compute/v2.1/servers/842a551a-278d-4bd3-82e5-91a4c271d69a" status: 200 len: 1280 microversion: 2.1 time: 0.552565 Aug 31 15:51:21.058548 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 349/675] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:20 2022] GET /compute/v2.1/servers/842a551a-278d-4bd3-82e5-91a4c271d69a => generated 1280 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:21.382913 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-17be9a8e-60b3-4cfd-a51c-c3990719df25 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:21.383729 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-17be9a8e-60b3-4cfd-a51c-c3990719df25 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: a5a21e54-e375-4370-9d9e-b41df3e5922e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:21.400016 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-17be9a8e-60b3-4cfd-a51c-c3990719df25 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:21.400687 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-17be9a8e-60b3-4cfd-a51c-c3990719df25 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:21.405098 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-17be9a8e-60b3-4cfd-a51c-c3990719df25 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:21.406570 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-17be9a8e-60b3-4cfd-a51c-c3990719df25 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:21.407493 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-17be9a8e-60b3-4cfd-a51c-c3990719df25 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:21.409158 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-17be9a8e-60b3-4cfd-a51c-c3990719df25 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:21.536849 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-27418707-488c-4c83-9679-bc325c367464 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:21.565467 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-27418707-488c-4c83-9679-bc325c367464 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/f0bc4527-6410-4415-b9db-7a76b91dfee3" status: 200 len: 1466 microversion: 2.1 time: 0.684023 Aug 31 15:51:21.566551 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 327/676] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:20 2022] GET /compute/v2.1/servers/f0bc4527-6410-4415-b9db-7a76b91dfee3 => generated 1466 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:21.582289 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-02ecad36-b69f-4ae2-bf81-98714aa6da89 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:21.585122 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-02ecad36-b69f-4ae2-bf81-98714aa6da89 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] [instance: 1e8fdb86-13be-42a3-a7af-5d50024f7419] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:21.594226 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02ecad36-b69f-4ae2-bf81-98714aa6da89 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:21.594795 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02ecad36-b69f-4ae2-bf81-98714aa6da89 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:21.595483 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02ecad36-b69f-4ae2-bf81-98714aa6da89 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:21.596365 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02ecad36-b69f-4ae2-bf81-98714aa6da89 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:21.597233 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02ecad36-b69f-4ae2-bf81-98714aa6da89 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:21.597871 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02ecad36-b69f-4ae2-bf81-98714aa6da89 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:21.662440 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-02ecad36-b69f-4ae2-bf81-98714aa6da89 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] 10.222.0.50 "GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094528 Aug 31 15:51:21.667343 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 328/677] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 15:51:21 2022] GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:51:21.673882 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2044d695-33f6-4e21-b273-3a8c347ed111 tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:21.674829 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2044d695-33f6-4e21-b273-3a8c347ed111 tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] [instance: f0bc4527-6410-4415-b9db-7a76b91dfee3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:21.687945 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2044d695-33f6-4e21-b273-3a8c347ed111 tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:21.688735 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2044d695-33f6-4e21-b273-3a8c347ed111 tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:21.689382 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2044d695-33f6-4e21-b273-3a8c347ed111 tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:21.690514 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2044d695-33f6-4e21-b273-3a8c347ed111 tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:21.692197 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2044d695-33f6-4e21-b273-3a8c347ed111 tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:21.692818 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2044d695-33f6-4e21-b273-3a8c347ed111 tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:22.050754 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-17be9a8e-60b3-4cfd-a51c-c3990719df25 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:22.067256 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-17be9a8e-60b3-4cfd-a51c-c3990719df25 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e" status: 200 len: 1475 microversion: 2.1 time: 0.688977 Aug 31 15:51:22.068553 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 350/678] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:21 2022] GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e => generated 1475 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:22.091710 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-827445b2-02b6-406c-af4b-a7246d6c3741 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:22.094773 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-827445b2-02b6-406c-af4b-a7246d6c3741 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 61e7db75-00b5-41e8-8efb-bced641ddd7a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:22.109776 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-827445b2-02b6-406c-af4b-a7246d6c3741 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:22.116074 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-827445b2-02b6-406c-af4b-a7246d6c3741 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:22.116861 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-827445b2-02b6-406c-af4b-a7246d6c3741 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:22.141482 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-827445b2-02b6-406c-af4b-a7246d6c3741 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:22.142549 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-827445b2-02b6-406c-af4b-a7246d6c3741 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:22.143343 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-827445b2-02b6-406c-af4b-a7246d6c3741 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:22.330167 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2044d695-33f6-4e21-b273-3a8c347ed111 tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/f0bc4527-6410-4415-b9db-7a76b91dfee3" status: 200 len: 1619 microversion: 2.1 time: 0.661214 Aug 31 15:51:22.330828 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 329/679] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:21 2022] GET /compute/v2.1/servers/f0bc4527-6410-4415-b9db-7a76b91dfee3 => generated 1619 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:22.359539 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9e262ffb-816e-4342-af6d-54c80ec12f82 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:22.360610 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9e262ffb-816e-4342-af6d-54c80ec12f82 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] [instance: 842a551a-278d-4bd3-82e5-91a4c271d69a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:22.368566 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e262ffb-816e-4342-af6d-54c80ec12f82 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:22.369496 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e262ffb-816e-4342-af6d-54c80ec12f82 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:22.370172 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e262ffb-816e-4342-af6d-54c80ec12f82 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:22.371150 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e262ffb-816e-4342-af6d-54c80ec12f82 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:22.372131 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e262ffb-816e-4342-af6d-54c80ec12f82 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:22.372780 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e262ffb-816e-4342-af6d-54c80ec12f82 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:23.179077 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-827445b2-02b6-406c-af4b-a7246d6c3741 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:23.191605 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-827445b2-02b6-406c-af4b-a7246d6c3741 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:23.202334 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-827445b2-02b6-406c-af4b-a7246d6c3741 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:23.207400 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-827445b2-02b6-406c-af4b-a7246d6c3741 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/61e7db75-00b5-41e8-8efb-bced641ddd7a" status: 200 len: 1565 microversion: 2.25 time: 1.137568 Aug 31 15:51:23.211115 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 351/680] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:51:22 2022] GET /compute/v2.1/servers/61e7db75-00b5-41e8-8efb-bced641ddd7a => generated 1565 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:51:23.222674 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c193400e-db3c-4fea-a64a-454b03ff7c05 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1171955311", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["848b21b2-98a0-4e70-a27c-08d390d73ae6"]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:51:23.256251 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9e262ffb-816e-4342-af6d-54c80ec12f82 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6849c97bdb0948bc824cf5efe0f709a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e94509e985441f7b2802e6c6b164cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:23.271225 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9e262ffb-816e-4342-af6d-54c80ec12f82 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] 10.222.0.50 "GET /compute/v2.1/servers/842a551a-278d-4bd3-82e5-91a4c271d69a" status: 200 len: 1322 microversion: 2.1 time: 0.921580 Aug 31 15:51:23.271927 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 330/681] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:22 2022] GET /compute/v2.1/servers/842a551a-278d-4bd3-82e5-91a4c271d69a => generated 1322 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:23.277657 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-f6349474-afc2-49c6-b988-9c097f36f735 req-e9de0e73-b391-4ab1-9b64-ff999addeb18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5a21e54-e375-4370-9d9e-b41df3e5922e", "name": "network-vif-unplugged", "status": "completed", "tag": "abeadf77-b435-4819-a412-27a7510ef57a"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:51:23.305767 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f6349474-afc2-49c6-b988-9c097f36f735 req-e9de0e73-b391-4ab1-9b64-ff999addeb18 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:23.307319 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f6349474-afc2-49c6-b988-9c097f36f735 req-e9de0e73-b391-4ab1-9b64-ff999addeb18 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:23.307564 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f6349474-afc2-49c6-b988-9c097f36f735 req-e9de0e73-b391-4ab1-9b64-ff999addeb18 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:23.321103 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-c193400e-db3c-4fea-a64a-454b03ff7c05 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] validate_networks() for None {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:51:23.336038 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-f6349474-afc2-49c6-b988-9c097f36f735 req-e9de0e73-b391-4ab1-9b64-ff999addeb18 service nova] Creating event network-vif-unplugged:abeadf77-b435-4819-a412-27a7510ef57a for instance a5a21e54-e375-4370-9d9e-b41df3e5922e on n-h1-833090-16 Aug 31 15:51:23.392071 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [req-f6349474-afc2-49c6-b988-9c097f36f735 req-e9de0e73-b391-4ab1-9b64-ff999addeb18 service nova] Instance a5a21e54-e375-4370-9d9e-b41df3e5922e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-833090-16', 'n-h1-833090-16'} {{(pid=128863) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 15:51:23.413676 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-f6349474-afc2-49c6-b988-9c097f36f735 req-e9de0e73-b391-4ab1-9b64-ff999addeb18 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.140249 Aug 31 15:51:23.426497 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 331/682] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:51:23.454044 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8ae4261a-84ad-4828-aea9-e3781ba87465 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:23.470210 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8ae4261a-84ad-4828-aea9-e3781ba87465 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] [instance: 1e8fdb86-13be-42a3-a7af-5d50024f7419] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:23.486244 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ae4261a-84ad-4828-aea9-e3781ba87465 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:23.494934 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ae4261a-84ad-4828-aea9-e3781ba87465 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:23.495979 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ae4261a-84ad-4828-aea9-e3781ba87465 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:23.497053 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ae4261a-84ad-4828-aea9-e3781ba87465 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:23.499621 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ae4261a-84ad-4828-aea9-e3781ba87465 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:23.500156 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ae4261a-84ad-4828-aea9-e3781ba87465 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:23.620182 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8ae4261a-84ad-4828-aea9-e3781ba87465 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] 10.222.0.50 "GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.188533 Aug 31 15:51:23.624659 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 332/683] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 15:51:23 2022] GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419/os-volume_attachments => generated 197 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:51:23.637500 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8f5da52f-3589-4cf6-94f6-9ad741c03b9a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:23.644268 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8f5da52f-3589-4cf6-94f6-9ad741c03b9a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: a5a21e54-e375-4370-9d9e-b41df3e5922e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:23.669306 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f5da52f-3589-4cf6-94f6-9ad741c03b9a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:23.670217 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f5da52f-3589-4cf6-94f6-9ad741c03b9a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:23.671050 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f5da52f-3589-4cf6-94f6-9ad741c03b9a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:23.675184 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f5da52f-3589-4cf6-94f6-9ad741c03b9a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:23.675923 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f5da52f-3589-4cf6-94f6-9ad741c03b9a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:23.676536 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f5da52f-3589-4cf6-94f6-9ad741c03b9a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:24.005716 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-c193400e-db3c-4fea-a64a-454b03ff7c05 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:51:24.006164 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-c193400e-db3c-4fea-a64a-454b03ff7c05 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:51:24.006644 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-c193400e-db3c-4fea-a64a-454b03ff7c05 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:51:24.007064 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-c193400e-db3c-4fea-a64a-454b03ff7c05 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:51:24.007476 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-c193400e-db3c-4fea-a64a-454b03ff7c05 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:51:24.030770 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c193400e-db3c-4fea-a64a-454b03ff7c05 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:24.036692 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c193400e-db3c-4fea-a64a-454b03ff7c05 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:24.037141 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c193400e-db3c-4fea-a64a-454b03ff7c05 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:24.040020 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c193400e-db3c-4fea-a64a-454b03ff7c05 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:24.044527 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c193400e-db3c-4fea-a64a-454b03ff7c05 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:24.045183 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c193400e-db3c-4fea-a64a-454b03ff7c05 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:24.106434 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-c193400e-db3c-4fea-a64a-454b03ff7c05 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Getting quotas for project 7db749eb0a764fa0bb29ddc4abd6d245. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:51:24.115591 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-c193400e-db3c-4fea-a64a-454b03ff7c05 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Getting quotas for user fe647be03cef4e9c86b4fd6e703d0de1 and project 7db749eb0a764fa0bb29ddc4abd6d245. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:51:24.152329 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c193400e-db3c-4fea-a64a-454b03ff7c05 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:51:24.155443 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c193400e-db3c-4fea-a64a-454b03ff7c05 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 9cb430ca-c340-479a-b269-4672431bd393] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:51:24.258027 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8f5da52f-3589-4cf6-94f6-9ad741c03b9a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:24.275725 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8f5da52f-3589-4cf6-94f6-9ad741c03b9a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e" status: 200 len: 1475 microversion: 2.1 time: 0.646939 Aug 31 15:51:24.276326 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c193400e-db3c-4fea-a64a-454b03ff7c05 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.062356 Aug 31 15:51:24.276776 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 333/684] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:23 2022] GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e => generated 1475 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:24.292872 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 352/685] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:51:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1081 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 15:51:24.295911 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0ccdaabd-9f21-493b-96a4-3d9d05a8a10e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:24.296537 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0ccdaabd-9f21-493b-96a4-3d9d05a8a10e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 61e7db75-00b5-41e8-8efb-bced641ddd7a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:24.306135 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7139608f-727f-467c-9dd6-94875543203d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:24.318868 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7139608f-727f-467c-9dd6-94875543203d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 9cb430ca-c340-479a-b269-4672431bd393] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:24.359618 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ccdaabd-9f21-493b-96a4-3d9d05a8a10e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:24.360132 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ccdaabd-9f21-493b-96a4-3d9d05a8a10e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:24.360758 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ccdaabd-9f21-493b-96a4-3d9d05a8a10e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:24.363263 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ccdaabd-9f21-493b-96a4-3d9d05a8a10e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:24.364929 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ccdaabd-9f21-493b-96a4-3d9d05a8a10e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:24.369487 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ccdaabd-9f21-493b-96a4-3d9d05a8a10e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:25.221337 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7139608f-727f-467c-9dd6-94875543203d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:25.235191 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7139608f-727f-467c-9dd6-94875543203d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/9cb430ca-c340-479a-b269-4672431bd393" status: 200 len: 1217 microversion: 2.1 time: 0.931736 Aug 31 15:51:25.237358 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 353/686] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:24 2022] GET /compute/v2.1/servers/9cb430ca-c340-479a-b269-4672431bd393 => generated 1217 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:25.251452 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-01836991-f9a3-42cf-b6b6-b41f323fc79f tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:25.252369 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-01836991-f9a3-42cf-b6b6-b41f323fc79f tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] [instance: 842a551a-278d-4bd3-82e5-91a4c271d69a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:25.269801 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01836991-f9a3-42cf-b6b6-b41f323fc79f tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:25.270626 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01836991-f9a3-42cf-b6b6-b41f323fc79f tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:25.271364 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01836991-f9a3-42cf-b6b6-b41f323fc79f tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:25.275627 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01836991-f9a3-42cf-b6b6-b41f323fc79f tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:25.276525 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01836991-f9a3-42cf-b6b6-b41f323fc79f tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:25.277555 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01836991-f9a3-42cf-b6b6-b41f323fc79f tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:25.373175 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=7 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:51:25.614445 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0ccdaabd-9f21-493b-96a4-3d9d05a8a10e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:25.631568 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0ccdaabd-9f21-493b-96a4-3d9d05a8a10e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:25.633386 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0ccdaabd-9f21-493b-96a4-3d9d05a8a10e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:25.635078 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0ccdaabd-9f21-493b-96a4-3d9d05a8a10e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/61e7db75-00b5-41e8-8efb-bced641ddd7a" status: 200 len: 1565 microversion: 2.25 time: 1.357794 Aug 31 15:51:25.641346 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 334/687] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:51:24 2022] GET /compute/v2.1/servers/61e7db75-00b5-41e8-8efb-bced641ddd7a => generated 1565 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:51:25.648252 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b18db3c2-c066-4afc-9974-b25a6f00b906 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:25.651986 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b18db3c2-c066-4afc-9974-b25a6f00b906 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] [instance: 1e8fdb86-13be-42a3-a7af-5d50024f7419] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:25.669007 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b18db3c2-c066-4afc-9974-b25a6f00b906 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:25.673925 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b18db3c2-c066-4afc-9974-b25a6f00b906 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:25.674595 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b18db3c2-c066-4afc-9974-b25a6f00b906 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:25.675492 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b18db3c2-c066-4afc-9974-b25a6f00b906 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:25.677585 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b18db3c2-c066-4afc-9974-b25a6f00b906 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:25.678285 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b18db3c2-c066-4afc-9974-b25a6f00b906 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:25.762711 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b18db3c2-c066-4afc-9974-b25a6f00b906 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] 10.222.0.50 "GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119126 Aug 31 15:51:25.765988 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 335/688] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 15:51:25 2022] GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:51:25.780549 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-33a6ca92-67e0-45d0-815d-63556d746a2a req-f2ac8004-34eb-4291-91fe-fd61e1bb03dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "842a551a-278d-4bd3-82e5-91a4c271d69a", "tag": "b714daec-6546-4ca8-bc4b-8c3834cdea69"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:51:25.816510 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=8 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:51:25.824451 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-33a6ca92-67e0-45d0-815d-63556d746a2a req-f2ac8004-34eb-4291-91fe-fd61e1bb03dc service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:25.825319 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-33a6ca92-67e0-45d0-815d-63556d746a2a req-f2ac8004-34eb-4291-91fe-fd61e1bb03dc service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:25.826526 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-33a6ca92-67e0-45d0-815d-63556d746a2a req-f2ac8004-34eb-4291-91fe-fd61e1bb03dc service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:25.877745 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-33a6ca92-67e0-45d0-815d-63556d746a2a req-f2ac8004-34eb-4291-91fe-fd61e1bb03dc service nova] Creating event network-changed:b714daec-6546-4ca8-bc4b-8c3834cdea69 for instance 842a551a-278d-4bd3-82e5-91a4c271d69a on n-h2-833090-16 Aug 31 15:51:25.899920 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-33a6ca92-67e0-45d0-815d-63556d746a2a req-f2ac8004-34eb-4291-91fe-fd61e1bb03dc service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131359 Aug 31 15:51:25.901711 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 336/689] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:51:25.919248 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a69f9ec3-0a3d-48d8-87d4-59f6ad5bcbaa tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:25.920158 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a69f9ec3-0a3d-48d8-87d4-59f6ad5bcbaa tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: a5a21e54-e375-4370-9d9e-b41df3e5922e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:25.927599 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a69f9ec3-0a3d-48d8-87d4-59f6ad5bcbaa tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:25.928261 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a69f9ec3-0a3d-48d8-87d4-59f6ad5bcbaa tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:25.928794 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a69f9ec3-0a3d-48d8-87d4-59f6ad5bcbaa tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:25.929608 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a69f9ec3-0a3d-48d8-87d4-59f6ad5bcbaa tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:25.930179 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a69f9ec3-0a3d-48d8-87d4-59f6ad5bcbaa tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:25.930938 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a69f9ec3-0a3d-48d8-87d4-59f6ad5bcbaa tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:26.232766 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-01836991-f9a3-42cf-b6b6-b41f323fc79f tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6849c97bdb0948bc824cf5efe0f709a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e94509e985441f7b2802e6c6b164cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:26.247218 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-01836991-f9a3-42cf-b6b6-b41f323fc79f tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] 10.222.0.50 "GET /compute/v2.1/servers/842a551a-278d-4bd3-82e5-91a4c271d69a" status: 200 len: 1322 microversion: 2.1 time: 1.006831 Aug 31 15:51:26.248954 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 354/690] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:25 2022] GET /compute/v2.1/servers/842a551a-278d-4bd3-82e5-91a4c271d69a => generated 1322 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:26.263695 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-2a2f0040-1d4c-4506-978f-6edf1e487797 req-334c942b-f346-4ede-808b-399ca9639be4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5a21e54-e375-4370-9d9e-b41df3e5922e", "tag": "abeadf77-b435-4819-a412-27a7510ef57a"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:51:26.290519 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-2a2f0040-1d4c-4506-978f-6edf1e487797 req-334c942b-f346-4ede-808b-399ca9639be4 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:26.291325 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-2a2f0040-1d4c-4506-978f-6edf1e487797 req-334c942b-f346-4ede-808b-399ca9639be4 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:26.291543 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-2a2f0040-1d4c-4506-978f-6edf1e487797 req-334c942b-f346-4ede-808b-399ca9639be4 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:26.316419 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-2a2f0040-1d4c-4506-978f-6edf1e487797 req-334c942b-f346-4ede-808b-399ca9639be4 service nova] Creating event network-changed:abeadf77-b435-4819-a412-27a7510ef57a for instance a5a21e54-e375-4370-9d9e-b41df3e5922e on n-h1-833090-16 Aug 31 15:51:26.368301 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [req-2a2f0040-1d4c-4506-978f-6edf1e487797 req-334c942b-f346-4ede-808b-399ca9639be4 service nova] Instance a5a21e54-e375-4370-9d9e-b41df3e5922e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-833090-16', 'n-h1-833090-16'} {{(pid=128864) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 15:51:26.416454 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-2a2f0040-1d4c-4506-978f-6edf1e487797 req-334c942b-f346-4ede-808b-399ca9639be4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163634 Aug 31 15:51:26.420032 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 355/691] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:51:26.442013 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-22adb4ec-b3f8-4b36-b5bd-835c658f31da tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:26.444978 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-22adb4ec-b3f8-4b36-b5bd-835c658f31da tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 9cb430ca-c340-479a-b269-4672431bd393] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:26.479737 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-22adb4ec-b3f8-4b36-b5bd-835c658f31da tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:26.480350 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-22adb4ec-b3f8-4b36-b5bd-835c658f31da tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:26.483676 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-22adb4ec-b3f8-4b36-b5bd-835c658f31da tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:26.484383 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-22adb4ec-b3f8-4b36-b5bd-835c658f31da tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:26.484901 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-22adb4ec-b3f8-4b36-b5bd-835c658f31da tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:26.490969 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a69f9ec3-0a3d-48d8-87d4-59f6ad5bcbaa tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:26.502404 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a69f9ec3-0a3d-48d8-87d4-59f6ad5bcbaa tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e" status: 200 len: 1475 microversion: 2.1 time: 0.596691 Aug 31 15:51:26.503727 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 337/692] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:25 2022] GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e => generated 1475 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:26.508354 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-22adb4ec-b3f8-4b36-b5bd-835c658f31da tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:26.664553 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-905cc1a3-c152-4714-8298-fc59c7185501 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:26.665485 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-905cc1a3-c152-4714-8298-fc59c7185501 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 61e7db75-00b5-41e8-8efb-bced641ddd7a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:26.680892 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-905cc1a3-c152-4714-8298-fc59c7185501 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:26.681417 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-905cc1a3-c152-4714-8298-fc59c7185501 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:26.681860 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-905cc1a3-c152-4714-8298-fc59c7185501 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:26.682629 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-905cc1a3-c152-4714-8298-fc59c7185501 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:26.683076 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-905cc1a3-c152-4714-8298-fc59c7185501 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:26.688338 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-905cc1a3-c152-4714-8298-fc59c7185501 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:26.774254 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-22adb4ec-b3f8-4b36-b5bd-835c658f31da tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:26.785820 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-22adb4ec-b3f8-4b36-b5bd-835c658f31da tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/9cb430ca-c340-479a-b269-4672431bd393" status: 200 len: 1277 microversion: 2.1 time: 0.364199 Aug 31 15:51:26.788075 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 356/693] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:26 2022] GET /compute/v2.1/servers/9cb430ca-c340-479a-b269-4672431bd393 => generated 1277 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:26.806793 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-36948257-80c4-41df-913a-5f690ef3fdc6 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:26.809235 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-36948257-80c4-41df-913a-5f690ef3fdc6 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] [instance: 1e8fdb86-13be-42a3-a7af-5d50024f7419] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:26.815901 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-36948257-80c4-41df-913a-5f690ef3fdc6 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:26.822706 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-36948257-80c4-41df-913a-5f690ef3fdc6 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:26.823368 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-36948257-80c4-41df-913a-5f690ef3fdc6 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:26.825474 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-36948257-80c4-41df-913a-5f690ef3fdc6 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:26.825951 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-36948257-80c4-41df-913a-5f690ef3fdc6 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:26.826406 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-36948257-80c4-41df-913a-5f690ef3fdc6 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:26.901801 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-36948257-80c4-41df-913a-5f690ef3fdc6 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] 10.222.0.50 "GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112282 Aug 31 15:51:26.907437 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 357/694] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 15:51:26 2022] GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:51:27.047668 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-905cc1a3-c152-4714-8298-fc59c7185501 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:27.058048 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:51:27.062128 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-905cc1a3-c152-4714-8298-fc59c7185501 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:27.069613 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-905cc1a3-c152-4714-8298-fc59c7185501 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:27.075912 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-905cc1a3-c152-4714-8298-fc59c7185501 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/61e7db75-00b5-41e8-8efb-bced641ddd7a" status: 200 len: 1555 microversion: 2.25 time: 0.415289 Aug 31 15:51:27.076813 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 338/695] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:51:26 2022] GET /compute/v2.1/servers/61e7db75-00b5-41e8-8efb-bced641ddd7a => generated 1555 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:51:27.109616 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-08716775-3c7e-4427-b3da-3b2e89eb1399 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Calling method '.version_select at 0x7fbb469045e0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:27.113380 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-08716775-3c7e-4427-b3da-3b2e89eb1399 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:27.113873 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-08716775-3c7e-4427-b3da-3b2e89eb1399 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:27.114352 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-08716775-3c7e-4427-b3da-3b2e89eb1399 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:27.146961 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-08716775-3c7e-4427-b3da-3b2e89eb1399 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] 10.222.0.50 "GET /compute/v2.1/os-migrations" status: 200 len: 1117 microversion: 2.25 time: 0.041110 Aug 31 15:51:27.149539 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 358/696] 10.222.0.50 () {60 vars in 1184 bytes} [Wed Aug 31 15:51:27 2022] GET /compute/v2.1/os-migrations => generated 1117 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:51:27.171112 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-832b6586-d9f0-468c-bc21-93c2303cb5a3 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:27.171655 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-832b6586-d9f0-468c-bc21-93c2303cb5a3 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] [instance: 61e7db75-00b5-41e8-8efb-bced641ddd7a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:27.186120 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-832b6586-d9f0-468c-bc21-93c2303cb5a3 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:27.186645 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-832b6586-d9f0-468c-bc21-93c2303cb5a3 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:27.187089 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-832b6586-d9f0-468c-bc21-93c2303cb5a3 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:27.187811 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-832b6586-d9f0-468c-bc21-93c2303cb5a3 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:27.188267 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-832b6586-d9f0-468c-bc21-93c2303cb5a3 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:27.197663 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-832b6586-d9f0-468c-bc21-93c2303cb5a3 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:27.277009 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fbe76d37-f3cd-4019-98f9-837ec071a143 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:27.277644 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fbe76d37-f3cd-4019-98f9-837ec071a143 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] [instance: 842a551a-278d-4bd3-82e5-91a4c271d69a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:27.289761 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fbe76d37-f3cd-4019-98f9-837ec071a143 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:27.292778 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fbe76d37-f3cd-4019-98f9-837ec071a143 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:27.294122 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fbe76d37-f3cd-4019-98f9-837ec071a143 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:27.295050 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fbe76d37-f3cd-4019-98f9-837ec071a143 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:27.295646 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fbe76d37-f3cd-4019-98f9-837ec071a143 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:27.299422 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fbe76d37-f3cd-4019-98f9-837ec071a143 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:27.989420 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-fbe76d37-f3cd-4019-98f9-837ec071a143 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6849c97bdb0948bc824cf5efe0f709a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e94509e985441f7b2802e6c6b164cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:27.991336 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-832b6586-d9f0-468c-bc21-93c2303cb5a3 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lazy-loading 'services' on Instance uuid 61e7db75-00b5-41e8-8efb-bced641ddd7a {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:51:28.004126 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fbe76d37-f3cd-4019-98f9-837ec071a143 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] 10.222.0.50 "GET /compute/v2.1/servers/842a551a-278d-4bd3-82e5-91a4c271d69a" status: 200 len: 1322 microversion: 2.1 time: 0.735355 Aug 31 15:51:28.004906 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 359/697] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:27 2022] GET /compute/v2.1/servers/842a551a-278d-4bd3-82e5-91a4c271d69a => generated 1322 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:28.009865 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5dc7dd1e-b590-4cbe-b86f-74b0a5aac2de tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:28.019410 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5dc7dd1e-b590-4cbe-b86f-74b0a5aac2de tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: a5a21e54-e375-4370-9d9e-b41df3e5922e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:28.032338 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5dc7dd1e-b590-4cbe-b86f-74b0a5aac2de tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:28.032974 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5dc7dd1e-b590-4cbe-b86f-74b0a5aac2de tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:28.033509 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5dc7dd1e-b590-4cbe-b86f-74b0a5aac2de tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:28.036033 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-832b6586-d9f0-468c-bc21-93c2303cb5a3 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/61e7db75-00b5-41e8-8efb-bced641ddd7a" status: 200 len: 2049 microversion: 2.25 time: 0.871755 Aug 31 15:51:28.036273 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5dc7dd1e-b590-4cbe-b86f-74b0a5aac2de tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:28.036716 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5dc7dd1e-b590-4cbe-b86f-74b0a5aac2de tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:28.039277 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 339/698] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:51:27 2022] GET /compute/v2.1/servers/61e7db75-00b5-41e8-8efb-bced641ddd7a => generated 2049 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:51:28.039516 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5dc7dd1e-b590-4cbe-b86f-74b0a5aac2de tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:28.046059 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4b376dc0-4f21-4d50-9ed4-5664e096a6a0 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:28.046694 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4b376dc0-4f21-4d50-9ed4-5664e096a6a0 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 9cb430ca-c340-479a-b269-4672431bd393] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:28.072973 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b376dc0-4f21-4d50-9ed4-5664e096a6a0 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:28.073493 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b376dc0-4f21-4d50-9ed4-5664e096a6a0 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:28.079295 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b376dc0-4f21-4d50-9ed4-5664e096a6a0 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:28.082317 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b376dc0-4f21-4d50-9ed4-5664e096a6a0 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:28.084347 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b376dc0-4f21-4d50-9ed4-5664e096a6a0 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:28.084982 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b376dc0-4f21-4d50-9ed4-5664e096a6a0 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:28.247981 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4b376dc0-4f21-4d50-9ed4-5664e096a6a0 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:28.257140 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4b376dc0-4f21-4d50-9ed4-5664e096a6a0 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/9cb430ca-c340-479a-b269-4672431bd393" status: 200 len: 1275 microversion: 2.1 time: 0.216661 Aug 31 15:51:28.261113 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 340/699] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:28 2022] GET /compute/v2.1/servers/9cb430ca-c340-479a-b269-4672431bd393 => generated 1275 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:28.276974 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-60bb0e0b-ff72-43f9-9316-918e329b884b tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:28.280120 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-60bb0e0b-ff72-43f9-9316-918e329b884b tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] [instance: 1e8fdb86-13be-42a3-a7af-5d50024f7419] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:28.289998 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60bb0e0b-ff72-43f9-9316-918e329b884b tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:28.290831 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60bb0e0b-ff72-43f9-9316-918e329b884b tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:28.291525 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60bb0e0b-ff72-43f9-9316-918e329b884b tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:28.292797 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60bb0e0b-ff72-43f9-9316-918e329b884b tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:28.293310 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60bb0e0b-ff72-43f9-9316-918e329b884b tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:28.293859 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60bb0e0b-ff72-43f9-9316-918e329b884b tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:28.369449 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5dc7dd1e-b590-4cbe-b86f-74b0a5aac2de tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:28.371982 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-60bb0e0b-ff72-43f9-9316-918e329b884b tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] 10.222.0.50 "GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109691 Aug 31 15:51:28.372826 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 341/700] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 15:51:28 2022] GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:51:28.384654 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a33d46d3-286d-4074-9e46-bcb8cb3fec57 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1975164725", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "efd466b3-b86f-4dea-a01f-277dbef774dc"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:51:28.394963 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5dc7dd1e-b590-4cbe-b86f-74b0a5aac2de tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e" status: 200 len: 1473 microversion: 2.1 time: 0.388842 Aug 31 15:51:28.398564 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 360/701] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:28 2022] GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e => generated 1473 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:28.535977 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-a33d46d3-286d-4074-9e46-bcb8cb3fec57 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] validate_networks() for [('efd466b3-b86f-4dea-a01f-277dbef774dc', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:51:29.026042 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0ecc166e-18cc-46ba-80c7-8c050e974cfe tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:29.026802 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0ecc166e-18cc-46ba-80c7-8c050e974cfe tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] [instance: 842a551a-278d-4bd3-82e5-91a4c271d69a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:29.037305 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0ecc166e-18cc-46ba-80c7-8c050e974cfe tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:29.038419 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0ecc166e-18cc-46ba-80c7-8c050e974cfe tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:29.039204 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0ecc166e-18cc-46ba-80c7-8c050e974cfe tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:29.041070 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0ecc166e-18cc-46ba-80c7-8c050e974cfe tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:29.041877 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0ecc166e-18cc-46ba-80c7-8c050e974cfe tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:29.042770 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0ecc166e-18cc-46ba-80c7-8c050e974cfe tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:29.180051 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-a33d46d3-286d-4074-9e46-bcb8cb3fec57 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:51:29.180964 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-a33d46d3-286d-4074-9e46-bcb8cb3fec57 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:51:29.181624 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-a33d46d3-286d-4074-9e46-bcb8cb3fec57 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:51:29.182188 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-a33d46d3-286d-4074-9e46-bcb8cb3fec57 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:51:29.182958 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-a33d46d3-286d-4074-9e46-bcb8cb3fec57 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:51:29.205903 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a33d46d3-286d-4074-9e46-bcb8cb3fec57 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:29.208787 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a33d46d3-286d-4074-9e46-bcb8cb3fec57 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:29.214482 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a33d46d3-286d-4074-9e46-bcb8cb3fec57 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:29.215687 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a33d46d3-286d-4074-9e46-bcb8cb3fec57 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:29.216282 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a33d46d3-286d-4074-9e46-bcb8cb3fec57 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:29.217160 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a33d46d3-286d-4074-9e46-bcb8cb3fec57 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:29.266352 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-a33d46d3-286d-4074-9e46-bcb8cb3fec57 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Getting quotas for project 86aafc129b8640d381f9bae1767fbc6c. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:51:29.285143 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-a33d46d3-286d-4074-9e46-bcb8cb3fec57 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Getting quotas for user 072bc5784d754815a511f6c3f4437f7c and project 86aafc129b8640d381f9bae1767fbc6c. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:51:29.305967 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a33d46d3-286d-4074-9e46-bcb8cb3fec57 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:51:29.309923 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a33d46d3-286d-4074-9e46-bcb8cb3fec57 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:51:29.412656 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a33d46d3-286d-4074-9e46-bcb8cb3fec57 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.038942 Aug 31 15:51:29.419953 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 342/702] 10.222.0.50 () {62 vars in 1188 bytes} [Wed Aug 31 15:51:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1047 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 31 15:51:29.435661 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0a692c89-8290-4101-b90c-1f49f98015f1 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:29.435977 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0a692c89-8290-4101-b90c-1f49f98015f1 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 9cb430ca-c340-479a-b269-4672431bd393] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:29.456618 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a692c89-8290-4101-b90c-1f49f98015f1 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:29.457207 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a692c89-8290-4101-b90c-1f49f98015f1 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:29.457643 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a692c89-8290-4101-b90c-1f49f98015f1 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:29.458394 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a692c89-8290-4101-b90c-1f49f98015f1 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:29.458847 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a692c89-8290-4101-b90c-1f49f98015f1 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:29.459271 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a692c89-8290-4101-b90c-1f49f98015f1 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:30.496970 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0ecc166e-18cc-46ba-80c7-8c050e974cfe tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6849c97bdb0948bc824cf5efe0f709a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e94509e985441f7b2802e6c6b164cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:30.515368 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0ecc166e-18cc-46ba-80c7-8c050e974cfe tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] 10.222.0.50 "GET /compute/v2.1/servers/842a551a-278d-4bd3-82e5-91a4c271d69a" status: 200 len: 1322 microversion: 2.1 time: 1.494337 Aug 31 15:51:30.520733 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 361/703] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:29 2022] GET /compute/v2.1/servers/842a551a-278d-4bd3-82e5-91a4c271d69a => generated 1322 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:51:30.540928 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4b203cde-2fd6-48e6-a9b5-a474e9ec70b4 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:30.551587 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4b203cde-2fd6-48e6-a9b5-a474e9ec70b4 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] [instance: 1e8fdb86-13be-42a3-a7af-5d50024f7419] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:30.572380 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4b203cde-2fd6-48e6-a9b5-a474e9ec70b4 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:30.573167 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4b203cde-2fd6-48e6-a9b5-a474e9ec70b4 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:30.573812 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4b203cde-2fd6-48e6-a9b5-a474e9ec70b4 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:30.578350 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4b203cde-2fd6-48e6-a9b5-a474e9ec70b4 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:30.578350 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4b203cde-2fd6-48e6-a9b5-a474e9ec70b4 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:30.578878 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4b203cde-2fd6-48e6-a9b5-a474e9ec70b4 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:30.662851 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0a692c89-8290-4101-b90c-1f49f98015f1 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:30.667906 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4b203cde-2fd6-48e6-a9b5-a474e9ec70b4 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] 10.222.0.50 "GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.144886 Aug 31 15:51:30.675749 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 362/704] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 15:51:30 2022] GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419/os-volume_attachments => generated 25 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 15:51:30.686282 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-10b5d044-a3ee-4e37-ba12-57788d5c9dd5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:30.687227 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-10b5d044-a3ee-4e37-ba12-57788d5c9dd5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: a5a21e54-e375-4370-9d9e-b41df3e5922e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:30.688727 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0a692c89-8290-4101-b90c-1f49f98015f1 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/9cb430ca-c340-479a-b269-4672431bd393" status: 200 len: 1317 microversion: 2.1 time: 1.253774 Aug 31 15:51:30.689491 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 343/705] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:29 2022] GET /compute/v2.1/servers/9cb430ca-c340-479a-b269-4672431bd393 => generated 1317 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:30.694282 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e2e5c175-0767-4958-9072-93f34c347940 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:30.694882 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e2e5c175-0767-4958-9072-93f34c347940 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:30.696932 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-10b5d044-a3ee-4e37-ba12-57788d5c9dd5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:30.698205 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-10b5d044-a3ee-4e37-ba12-57788d5c9dd5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:30.699301 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-10b5d044-a3ee-4e37-ba12-57788d5c9dd5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:30.700467 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-10b5d044-a3ee-4e37-ba12-57788d5c9dd5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:30.702114 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-10b5d044-a3ee-4e37-ba12-57788d5c9dd5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:30.702960 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-10b5d044-a3ee-4e37-ba12-57788d5c9dd5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:30.717937 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2e5c175-0767-4958-9072-93f34c347940 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:30.726839 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2e5c175-0767-4958-9072-93f34c347940 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:30.727452 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2e5c175-0767-4958-9072-93f34c347940 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:30.728209 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2e5c175-0767-4958-9072-93f34c347940 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:30.728988 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2e5c175-0767-4958-9072-93f34c347940 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:30.729411 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2e5c175-0767-4958-9072-93f34c347940 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:31.121946 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e2e5c175-0767-4958-9072-93f34c347940 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:31.166891 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e2e5c175-0767-4958-9072-93f34c347940 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:31.168408 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e2e5c175-0767-4958-9072-93f34c347940 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:31.169555 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e2e5c175-0767-4958-9072-93f34c347940 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035" status: 200 len: 1258 microversion: 2.25 time: 0.479110 Aug 31 15:51:31.175122 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 344/706] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:51:30 2022] GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035 => generated 1258 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:51:31.202397 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c3120972-35b0-4671-bfa8-9b66917576d2 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1020512013", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "b3fd157f-8b8c-402c-9ab7-9d2e22e7328a"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:51:31.327200 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-c3120972-35b0-4671-bfa8-9b66917576d2 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] validate_networks() for [('b3fd157f-8b8c-402c-9ab7-9d2e22e7328a', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:51:31.492267 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-10b5d044-a3ee-4e37-ba12-57788d5c9dd5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:31.505000 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-10b5d044-a3ee-4e37-ba12-57788d5c9dd5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e" status: 200 len: 1470 microversion: 2.1 time: 0.826598 Aug 31 15:51:31.509118 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 363/707] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:30 2022] GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e => generated 1470 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:31.530601 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f9756282-0464-48c5-bde3-adf0f9d53839 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:51:31.531350 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f9756282-0464-48c5-bde3-adf0f9d53839 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: a5a21e54-e375-4370-9d9e-b41df3e5922e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:31.543673 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f9756282-0464-48c5-bde3-adf0f9d53839 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:31.550662 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f9756282-0464-48c5-bde3-adf0f9d53839 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:31.551290 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f9756282-0464-48c5-bde3-adf0f9d53839 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:31.552201 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f9756282-0464-48c5-bde3-adf0f9d53839 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:31.552926 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f9756282-0464-48c5-bde3-adf0f9d53839 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:31.553565 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f9756282-0464-48c5-bde3-adf0f9d53839 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:31.691426 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f9756282-0464-48c5-bde3-adf0f9d53839 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "POST /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e/action" status: 204 len: 0 microversion: 2.1 time: 0.166250 Aug 31 15:51:31.698075 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 364/708] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 15:51:31 2022] POST /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e/action => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 15:51:31.712995 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a61400bf-fcc0-4d7c-a216-11960f44e76b tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:31.713815 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a61400bf-fcc0-4d7c-a216-11960f44e76b tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] [instance: 842a551a-278d-4bd3-82e5-91a4c271d69a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:31.740063 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a61400bf-fcc0-4d7c-a216-11960f44e76b tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:31.740697 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a61400bf-fcc0-4d7c-a216-11960f44e76b tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:31.741134 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a61400bf-fcc0-4d7c-a216-11960f44e76b tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:31.742224 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a61400bf-fcc0-4d7c-a216-11960f44e76b tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:31.743751 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a61400bf-fcc0-4d7c-a216-11960f44e76b tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:31.744453 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a61400bf-fcc0-4d7c-a216-11960f44e76b tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:32.743743 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a61400bf-fcc0-4d7c-a216-11960f44e76b tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6849c97bdb0948bc824cf5efe0f709a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e94509e985441f7b2802e6c6b164cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:32.753538 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a61400bf-fcc0-4d7c-a216-11960f44e76b tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] 10.222.0.50 "GET /compute/v2.1/servers/842a551a-278d-4bd3-82e5-91a4c271d69a" status: 200 len: 1322 microversion: 2.1 time: 1.052177 Aug 31 15:51:32.754458 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 365/709] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:31 2022] GET /compute/v2.1/servers/842a551a-278d-4bd3-82e5-91a4c271d69a => generated 1322 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:32.771847 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2081d1e3-a0bf-4a8f-98c9-2c88b06b452e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:32.774286 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2081d1e3-a0bf-4a8f-98c9-2c88b06b452e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: a5a21e54-e375-4370-9d9e-b41df3e5922e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:32.802271 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2081d1e3-a0bf-4a8f-98c9-2c88b06b452e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:32.804492 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2081d1e3-a0bf-4a8f-98c9-2c88b06b452e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:32.806482 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2081d1e3-a0bf-4a8f-98c9-2c88b06b452e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:32.808222 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2081d1e3-a0bf-4a8f-98c9-2c88b06b452e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:32.814786 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2081d1e3-a0bf-4a8f-98c9-2c88b06b452e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:32.818199 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2081d1e3-a0bf-4a8f-98c9-2c88b06b452e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:33.388929 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2081d1e3-a0bf-4a8f-98c9-2c88b06b452e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:33.397454 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:51:33.403008 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2081d1e3-a0bf-4a8f-98c9-2c88b06b452e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e" status: 200 len: 1470 microversion: 2.1 time: 0.636081 Aug 31 15:51:33.420443 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 366/710] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:32 2022] GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e => generated 1470 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:33.428457 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a2a268e4-253b-43bb-974d-f91ac773c094 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:33.429620 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a2a268e4-253b-43bb-974d-f91ac773c094 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 9cb430ca-c340-479a-b269-4672431bd393] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:33.444982 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a2a268e4-253b-43bb-974d-f91ac773c094 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:33.448039 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a2a268e4-253b-43bb-974d-f91ac773c094 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:33.453430 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a2a268e4-253b-43bb-974d-f91ac773c094 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:33.454494 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a2a268e4-253b-43bb-974d-f91ac773c094 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:33.457426 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a2a268e4-253b-43bb-974d-f91ac773c094 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:33.458218 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a2a268e4-253b-43bb-974d-f91ac773c094 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:33.813649 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a2a268e4-253b-43bb-974d-f91ac773c094 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:33.818450 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-c3120972-35b0-4671-bfa8-9b66917576d2 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:51:33.819413 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-c3120972-35b0-4671-bfa8-9b66917576d2 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:51:33.820037 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-c3120972-35b0-4671-bfa8-9b66917576d2 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:51:33.820659 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-c3120972-35b0-4671-bfa8-9b66917576d2 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:51:33.821235 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-c3120972-35b0-4671-bfa8-9b66917576d2 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:51:33.828759 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a2a268e4-253b-43bb-974d-f91ac773c094 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/9cb430ca-c340-479a-b269-4672431bd393" status: 200 len: 1317 microversion: 2.1 time: 0.405114 Aug 31 15:51:33.847568 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3120972-35b0-4671-bfa8-9b66917576d2 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:33.849605 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3120972-35b0-4671-bfa8-9b66917576d2 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:33.851559 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3120972-35b0-4671-bfa8-9b66917576d2 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:33.851697 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 367/711] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:33 2022] GET /compute/v2.1/servers/9cb430ca-c340-479a-b269-4672431bd393 => generated 1317 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:33.854155 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3120972-35b0-4671-bfa8-9b66917576d2 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:33.854870 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3120972-35b0-4671-bfa8-9b66917576d2 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:33.856459 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3120972-35b0-4671-bfa8-9b66917576d2 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:33.871604 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c4cee86a-cc11-4629-a99a-c03addf82e8b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:33.872237 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c4cee86a-cc11-4629-a99a-c03addf82e8b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:33.895324 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c4cee86a-cc11-4629-a99a-c03addf82e8b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:33.897320 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c4cee86a-cc11-4629-a99a-c03addf82e8b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:33.897941 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c4cee86a-cc11-4629-a99a-c03addf82e8b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:33.903489 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c4cee86a-cc11-4629-a99a-c03addf82e8b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:33.906238 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c4cee86a-cc11-4629-a99a-c03addf82e8b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:33.911680 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c4cee86a-cc11-4629-a99a-c03addf82e8b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:33.938276 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-c3120972-35b0-4671-bfa8-9b66917576d2 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Getting quotas for project 8a08078ba5a04c31b6cc63dee67be8c4. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:51:33.956655 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-c3120972-35b0-4671-bfa8-9b66917576d2 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Getting quotas for user 704d7c428d3e4a1bbe5fb78485415214 and project 8a08078ba5a04c31b6cc63dee67be8c4. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:51:33.981533 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c3120972-35b0-4671-bfa8-9b66917576d2 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:51:33.984097 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c3120972-35b0-4671-bfa8-9b66917576d2 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] [instance: 3b33f103-9c08-4775-975c-3f815d99a70e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:51:34.051297 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c3120972-35b0-4671-bfa8-9b66917576d2 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.859342 Aug 31 15:51:34.059622 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 345/712] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:51:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2884 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 15:51:34.066431 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:51:34.072831 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-2c03ad0f-e6f6-45a8-b473-c62e8d891a21 req-2910b6ce-dc5d-4658-90f9-c38975714595 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cb430ca-c340-479a-b269-4672431bd393", "tag": "49e61df5-a85b-44f7-9ed7-4c18051cf4cb"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:51:34.096492 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2c03ad0f-e6f6-45a8-b473-c62e8d891a21 req-2910b6ce-dc5d-4658-90f9-c38975714595 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:34.097472 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2c03ad0f-e6f6-45a8-b473-c62e8d891a21 req-2910b6ce-dc5d-4658-90f9-c38975714595 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:34.098784 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2c03ad0f-e6f6-45a8-b473-c62e8d891a21 req-2910b6ce-dc5d-4658-90f9-c38975714595 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:34.116799 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-2c03ad0f-e6f6-45a8-b473-c62e8d891a21 req-2910b6ce-dc5d-4658-90f9-c38975714595 service nova] Creating event network-changed:49e61df5-a85b-44f7-9ed7-4c18051cf4cb for instance 9cb430ca-c340-479a-b269-4672431bd393 on n-h1-833090-16 Aug 31 15:51:34.124236 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-2c03ad0f-e6f6-45a8-b473-c62e8d891a21 req-2910b6ce-dc5d-4658-90f9-c38975714595 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062490 Aug 31 15:51:34.126254 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 346/713] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:51:34.135429 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-895de57a-fc24-4536-9cb2-41a7d8198f08 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:34.136032 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c4cee86a-cc11-4629-a99a-c03addf82e8b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:34.136810 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-895de57a-fc24-4536-9cb2-41a7d8198f08 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] [instance: 842a551a-278d-4bd3-82e5-91a4c271d69a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:34.145157 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c4cee86a-cc11-4629-a99a-c03addf82e8b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:34.146291 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-895de57a-fc24-4536-9cb2-41a7d8198f08 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:34.147145 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-895de57a-fc24-4536-9cb2-41a7d8198f08 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:34.147808 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-895de57a-fc24-4536-9cb2-41a7d8198f08 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:34.148760 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-895de57a-fc24-4536-9cb2-41a7d8198f08 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:34.149598 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-895de57a-fc24-4536-9cb2-41a7d8198f08 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:34.150389 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-895de57a-fc24-4536-9cb2-41a7d8198f08 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:34.151531 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c4cee86a-cc11-4629-a99a-c03addf82e8b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:34.152692 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c4cee86a-cc11-4629-a99a-c03addf82e8b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035" status: 200 len: 1320 microversion: 2.25 time: 0.297712 Aug 31 15:51:34.172005 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 368/714] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:51:33 2022] GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035 => generated 1320 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:51:34.184383 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7587c2d4-f0fa-43ce-ba44-1cbada83f2c7 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:34.185638 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7587c2d4-f0fa-43ce-ba44-1cbada83f2c7 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] [instance: 3b33f103-9c08-4775-975c-3f815d99a70e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:34.389253 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7587c2d4-f0fa-43ce-ba44-1cbada83f2c7 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704d7c428d3e4a1bbe5fb78485415214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a08078ba5a04c31b6cc63dee67be8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:34.416242 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7587c2d4-f0fa-43ce-ba44-1cbada83f2c7 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] 10.222.0.50 "GET /compute/v2.1/servers/3b33f103-9c08-4775-975c-3f815d99a70e" status: 200 len: 1218 microversion: 2.1 time: 0.242762 Aug 31 15:51:34.420556 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 369/715] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:34 2022] GET /compute/v2.1/servers/3b33f103-9c08-4775-975c-3f815d99a70e => generated 1218 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:34.442751 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9ee25495-a72c-4a3b-81c6-4185070d3b23 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:34.443370 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9ee25495-a72c-4a3b-81c6-4185070d3b23 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: a5a21e54-e375-4370-9d9e-b41df3e5922e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:34.458771 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ee25495-a72c-4a3b-81c6-4185070d3b23 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:34.459320 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ee25495-a72c-4a3b-81c6-4185070d3b23 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:34.459754 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ee25495-a72c-4a3b-81c6-4185070d3b23 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:34.461446 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ee25495-a72c-4a3b-81c6-4185070d3b23 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:34.461920 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ee25495-a72c-4a3b-81c6-4185070d3b23 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:34.462391 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ee25495-a72c-4a3b-81c6-4185070d3b23 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:34.671953 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-895de57a-fc24-4536-9cb2-41a7d8198f08 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6849c97bdb0948bc824cf5efe0f709a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e94509e985441f7b2802e6c6b164cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:34.685825 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-895de57a-fc24-4536-9cb2-41a7d8198f08 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] 10.222.0.50 "GET /compute/v2.1/servers/842a551a-278d-4bd3-82e5-91a4c271d69a" status: 200 len: 1322 microversion: 2.1 time: 0.557797 Aug 31 15:51:34.686470 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 347/716] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:34 2022] GET /compute/v2.1/servers/842a551a-278d-4bd3-82e5-91a4c271d69a => generated 1322 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:34.700706 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-899bde04-e22a-45dd-b71c-9f865cccba46 req-d4cf319c-50b5-4977-9f6a-d4ef63d5c9df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "842a551a-278d-4bd3-82e5-91a4c271d69a", "name": "network-vif-plugged", "status": "completed", "tag": "b714daec-6546-4ca8-bc4b-8c3834cdea69"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:51:34.724905 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-899bde04-e22a-45dd-b71c-9f865cccba46 req-d4cf319c-50b5-4977-9f6a-d4ef63d5c9df service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:34.725418 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-899bde04-e22a-45dd-b71c-9f865cccba46 req-d4cf319c-50b5-4977-9f6a-d4ef63d5c9df service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:34.727069 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-899bde04-e22a-45dd-b71c-9f865cccba46 req-d4cf319c-50b5-4977-9f6a-d4ef63d5c9df service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:34.753212 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-899bde04-e22a-45dd-b71c-9f865cccba46 req-d4cf319c-50b5-4977-9f6a-d4ef63d5c9df service nova] Creating event network-vif-plugged:b714daec-6546-4ca8-bc4b-8c3834cdea69 for instance 842a551a-278d-4bd3-82e5-91a4c271d69a on n-h2-833090-16 Aug 31 15:51:34.768684 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-899bde04-e22a-45dd-b71c-9f865cccba46 req-d4cf319c-50b5-4977-9f6a-d4ef63d5c9df service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078739 Aug 31 15:51:34.770692 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 348/717] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:51:34.861129 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6913a8e3-4bda-4a55-aadd-d50404d4a5c6 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:34.862074 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6913a8e3-4bda-4a55-aadd-d50404d4a5c6 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 9cb430ca-c340-479a-b269-4672431bd393] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:34.872370 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6913a8e3-4bda-4a55-aadd-d50404d4a5c6 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:34.876278 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6913a8e3-4bda-4a55-aadd-d50404d4a5c6 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:34.878769 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6913a8e3-4bda-4a55-aadd-d50404d4a5c6 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:34.880997 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6913a8e3-4bda-4a55-aadd-d50404d4a5c6 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:34.881554 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6913a8e3-4bda-4a55-aadd-d50404d4a5c6 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:34.882734 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6913a8e3-4bda-4a55-aadd-d50404d4a5c6 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:34.923886 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9ee25495-a72c-4a3b-81c6-4185070d3b23 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:34.933171 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9ee25495-a72c-4a3b-81c6-4185070d3b23 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e" status: 200 len: 1470 microversion: 2.1 time: 0.502218 Aug 31 15:51:34.936384 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 370/718] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:34 2022] GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e => generated 1470 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:35.179503 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ea75eeed-9a7b-4bd8-823d-b7a07315ddd0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:35.180179 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ea75eeed-9a7b-4bd8-823d-b7a07315ddd0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:35.192732 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ea75eeed-9a7b-4bd8-823d-b7a07315ddd0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:35.193280 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ea75eeed-9a7b-4bd8-823d-b7a07315ddd0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:35.193717 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ea75eeed-9a7b-4bd8-823d-b7a07315ddd0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:35.194467 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ea75eeed-9a7b-4bd8-823d-b7a07315ddd0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:35.194919 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ea75eeed-9a7b-4bd8-823d-b7a07315ddd0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:35.195339 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ea75eeed-9a7b-4bd8-823d-b7a07315ddd0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:35.285495 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6913a8e3-4bda-4a55-aadd-d50404d4a5c6 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:35.314891 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6913a8e3-4bda-4a55-aadd-d50404d4a5c6 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/9cb430ca-c340-479a-b269-4672431bd393" status: 200 len: 1317 microversion: 2.1 time: 0.457555 Aug 31 15:51:35.332957 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 349/719] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:34 2022] GET /compute/v2.1/servers/9cb430ca-c340-479a-b269-4672431bd393 => generated 1317 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:35.446675 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-95affe3e-2dad-49e8-9203-3a8b89ada9be tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:35.447439 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-95affe3e-2dad-49e8-9203-3a8b89ada9be tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] [instance: 3b33f103-9c08-4775-975c-3f815d99a70e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:35.460432 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95affe3e-2dad-49e8-9203-3a8b89ada9be tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:35.460932 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95affe3e-2dad-49e8-9203-3a8b89ada9be tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:35.464310 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95affe3e-2dad-49e8-9203-3a8b89ada9be tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:35.468346 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95affe3e-2dad-49e8-9203-3a8b89ada9be tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:35.468820 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95affe3e-2dad-49e8-9203-3a8b89ada9be tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:35.469252 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95affe3e-2dad-49e8-9203-3a8b89ada9be tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:35.587907 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ea75eeed-9a7b-4bd8-823d-b7a07315ddd0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:35.603851 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ea75eeed-9a7b-4bd8-823d-b7a07315ddd0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:35.606064 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ea75eeed-9a7b-4bd8-823d-b7a07315ddd0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:35.613536 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ea75eeed-9a7b-4bd8-823d-b7a07315ddd0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035" status: 200 len: 1362 microversion: 2.25 time: 0.435826 Aug 31 15:51:35.614438 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 371/720] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:51:35 2022] GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035 => generated 1362 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 15:51:35.641569 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-95affe3e-2dad-49e8-9203-3a8b89ada9be tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704d7c428d3e4a1bbe5fb78485415214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a08078ba5a04c31b6cc63dee67be8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:35.652362 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-95affe3e-2dad-49e8-9203-3a8b89ada9be tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] 10.222.0.50 "GET /compute/v2.1/servers/3b33f103-9c08-4775-975c-3f815d99a70e" status: 200 len: 1222 microversion: 2.1 time: 0.211420 Aug 31 15:51:35.654084 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 350/721] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:35 2022] GET /compute/v2.1/servers/3b33f103-9c08-4775-975c-3f815d99a70e => generated 1222 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:35.708777 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4ca1c2ab-a279-48f8-a111-79ecc5dc6e62 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:35.709433 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4ca1c2ab-a279-48f8-a111-79ecc5dc6e62 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] [instance: 842a551a-278d-4bd3-82e5-91a4c271d69a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:35.716426 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4ca1c2ab-a279-48f8-a111-79ecc5dc6e62 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:35.717204 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4ca1c2ab-a279-48f8-a111-79ecc5dc6e62 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:35.717836 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4ca1c2ab-a279-48f8-a111-79ecc5dc6e62 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:35.718754 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4ca1c2ab-a279-48f8-a111-79ecc5dc6e62 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:35.719392 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4ca1c2ab-a279-48f8-a111-79ecc5dc6e62 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:35.719998 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4ca1c2ab-a279-48f8-a111-79ecc5dc6e62 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:35.930290 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4ca1c2ab-a279-48f8-a111-79ecc5dc6e62 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6849c97bdb0948bc824cf5efe0f709a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e94509e985441f7b2802e6c6b164cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:35.940262 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4ca1c2ab-a279-48f8-a111-79ecc5dc6e62 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] 10.222.0.50 "GET /compute/v2.1/servers/842a551a-278d-4bd3-82e5-91a4c271d69a" status: 200 len: 1322 microversion: 2.1 time: 0.235817 Aug 31 15:51:35.940925 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 372/722] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:35 2022] GET /compute/v2.1/servers/842a551a-278d-4bd3-82e5-91a4c271d69a => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:35.956851 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fad46f18-f5f8-40b0-95a8-14dc79d28bcc tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:35.958000 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fad46f18-f5f8-40b0-95a8-14dc79d28bcc tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: a5a21e54-e375-4370-9d9e-b41df3e5922e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:35.965579 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fad46f18-f5f8-40b0-95a8-14dc79d28bcc tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:35.966072 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fad46f18-f5f8-40b0-95a8-14dc79d28bcc tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:35.966551 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fad46f18-f5f8-40b0-95a8-14dc79d28bcc tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:35.967320 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fad46f18-f5f8-40b0-95a8-14dc79d28bcc tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:35.968020 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fad46f18-f5f8-40b0-95a8-14dc79d28bcc tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:35.968771 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fad46f18-f5f8-40b0-95a8-14dc79d28bcc tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:36.122640 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fad46f18-f5f8-40b0-95a8-14dc79d28bcc tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:36.131009 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fad46f18-f5f8-40b0-95a8-14dc79d28bcc tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e" status: 200 len: 1470 microversion: 2.1 time: 0.177948 Aug 31 15:51:36.131830 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 351/723] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:35 2022] GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e => generated 1470 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:36.342507 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d12129cf-a292-4888-ab66-ed5d78574c3b tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:36.344297 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d12129cf-a292-4888-ab66-ed5d78574c3b tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 9cb430ca-c340-479a-b269-4672431bd393] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:36.352133 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d12129cf-a292-4888-ab66-ed5d78574c3b tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:36.353074 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d12129cf-a292-4888-ab66-ed5d78574c3b tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:36.354075 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d12129cf-a292-4888-ab66-ed5d78574c3b tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:36.355048 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d12129cf-a292-4888-ab66-ed5d78574c3b tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:36.355684 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d12129cf-a292-4888-ab66-ed5d78574c3b tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:36.357931 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d12129cf-a292-4888-ab66-ed5d78574c3b tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:36.639978 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-25461bdf-5bd5-4b86-9194-425d2eb43dd7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:36.641720 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-25461bdf-5bd5-4b86-9194-425d2eb43dd7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:36.663296 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25461bdf-5bd5-4b86-9194-425d2eb43dd7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:36.667263 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25461bdf-5bd5-4b86-9194-425d2eb43dd7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:36.671872 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25461bdf-5bd5-4b86-9194-425d2eb43dd7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:36.674592 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25461bdf-5bd5-4b86-9194-425d2eb43dd7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:36.675840 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25461bdf-5bd5-4b86-9194-425d2eb43dd7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:36.677844 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25461bdf-5bd5-4b86-9194-425d2eb43dd7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:37.307885 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-25461bdf-5bd5-4b86-9194-425d2eb43dd7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:37.338933 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-25461bdf-5bd5-4b86-9194-425d2eb43dd7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:37.344242 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-25461bdf-5bd5-4b86-9194-425d2eb43dd7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:37.348594 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-25461bdf-5bd5-4b86-9194-425d2eb43dd7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035" status: 200 len: 1362 microversion: 2.25 time: 0.714530 Aug 31 15:51:37.364730 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 352/724] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:51:36 2022] GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035 => generated 1362 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:51:37.377803 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-29281815-0076-411a-870c-db25f68c0d4c tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:37.379271 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-29281815-0076-411a-870c-db25f68c0d4c tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] [instance: 3b33f103-9c08-4775-975c-3f815d99a70e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:37.397115 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29281815-0076-411a-870c-db25f68c0d4c tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:37.403417 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29281815-0076-411a-870c-db25f68c0d4c tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:37.404209 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29281815-0076-411a-870c-db25f68c0d4c tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:37.405135 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29281815-0076-411a-870c-db25f68c0d4c tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:37.405767 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29281815-0076-411a-870c-db25f68c0d4c tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:37.406620 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29281815-0076-411a-870c-db25f68c0d4c tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:37.475939 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d12129cf-a292-4888-ab66-ed5d78574c3b tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:37.518205 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d12129cf-a292-4888-ab66-ed5d78574c3b tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/9cb430ca-c340-479a-b269-4672431bd393" status: 200 len: 1317 microversion: 2.1 time: 1.180681 Aug 31 15:51:37.520030 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 373/725] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:36 2022] GET /compute/v2.1/servers/9cb430ca-c340-479a-b269-4672431bd393 => generated 1317 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:37.527109 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-29281815-0076-411a-870c-db25f68c0d4c tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704d7c428d3e4a1bbe5fb78485415214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a08078ba5a04c31b6cc63dee67be8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:37.535256 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-29281815-0076-411a-870c-db25f68c0d4c tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] 10.222.0.50 "GET /compute/v2.1/servers/3b33f103-9c08-4775-975c-3f815d99a70e" status: 200 len: 1270 microversion: 2.1 time: 0.169230 Aug 31 15:51:37.538207 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 353/726] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:37 2022] GET /compute/v2.1/servers/3b33f103-9c08-4775-975c-3f815d99a70e => generated 1270 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:37.549361 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-90273679-e83f-47c2-a065-6ae8bd6edf82 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:37.550332 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-90273679-e83f-47c2-a065-6ae8bd6edf82 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: a5a21e54-e375-4370-9d9e-b41df3e5922e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:37.562014 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0922312f-12aa-4199-a1f2-d70c9cc57c5b tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:37.564234 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0922312f-12aa-4199-a1f2-d70c9cc57c5b tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] [instance: 842a551a-278d-4bd3-82e5-91a4c271d69a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:37.564684 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-90273679-e83f-47c2-a065-6ae8bd6edf82 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:37.565173 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-90273679-e83f-47c2-a065-6ae8bd6edf82 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:37.569307 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-90273679-e83f-47c2-a065-6ae8bd6edf82 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:37.570587 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-90273679-e83f-47c2-a065-6ae8bd6edf82 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:37.571300 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-90273679-e83f-47c2-a065-6ae8bd6edf82 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:37.572569 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-90273679-e83f-47c2-a065-6ae8bd6edf82 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:37.600068 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0922312f-12aa-4199-a1f2-d70c9cc57c5b tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:37.602570 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0922312f-12aa-4199-a1f2-d70c9cc57c5b tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:37.605773 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0922312f-12aa-4199-a1f2-d70c9cc57c5b tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:37.614761 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0922312f-12aa-4199-a1f2-d70c9cc57c5b tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:37.615713 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0922312f-12aa-4199-a1f2-d70c9cc57c5b tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:37.618819 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0922312f-12aa-4199-a1f2-d70c9cc57c5b tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:38.037796 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0922312f-12aa-4199-a1f2-d70c9cc57c5b tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6849c97bdb0948bc824cf5efe0f709a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e94509e985441f7b2802e6c6b164cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:38.046939 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0922312f-12aa-4199-a1f2-d70c9cc57c5b tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] 10.222.0.50 "GET /compute/v2.1/servers/842a551a-278d-4bd3-82e5-91a4c271d69a" status: 200 len: 1472 microversion: 2.1 time: 0.523314 Aug 31 15:51:38.047818 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-90273679-e83f-47c2-a065-6ae8bd6edf82 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:38.048835 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 374/727] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:37 2022] GET /compute/v2.1/servers/842a551a-278d-4bd3-82e5-91a4c271d69a => generated 1472 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:38.054195 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-7a6e01b1-39a7-4bbb-9c99-cd95678acd5c req-481b8648-fa65-4d75-9b90-fd50b28ccaec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5a21e54-e375-4370-9d9e-b41df3e5922e", "name": "network-vif-plugged", "status": "completed", "tag": "abeadf77-b435-4819-a412-27a7510ef57a"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:51:38.080303 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-90273679-e83f-47c2-a065-6ae8bd6edf82 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e" status: 200 len: 1470 microversion: 2.1 time: 0.538975 Aug 31 15:51:38.086176 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 354/728] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:37 2022] GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e => generated 1470 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:38.100661 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7a6e01b1-39a7-4bbb-9c99-cd95678acd5c req-481b8648-fa65-4d75-9b90-fd50b28ccaec service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:38.100661 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7a6e01b1-39a7-4bbb-9c99-cd95678acd5c req-481b8648-fa65-4d75-9b90-fd50b28ccaec service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:38.111809 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7a6e01b1-39a7-4bbb-9c99-cd95678acd5c req-481b8648-fa65-4d75-9b90-fd50b28ccaec service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:38.145053 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-7a6e01b1-39a7-4bbb-9c99-cd95678acd5c req-481b8648-fa65-4d75-9b90-fd50b28ccaec service nova] Creating event network-vif-plugged:abeadf77-b435-4819-a412-27a7510ef57a for instance a5a21e54-e375-4370-9d9e-b41df3e5922e on n-h1-833090-16 Aug 31 15:51:38.168500 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-7a6e01b1-39a7-4bbb-9c99-cd95678acd5c req-481b8648-fa65-4d75-9b90-fd50b28ccaec service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116862 Aug 31 15:51:38.173200 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 375/729] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:51:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:51:38.206067 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-16d3e47f-fc93-4588-b6d2-23e06393e1cc req-4d77c0a7-c3b1-45b2-85c9-5d24b23576e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ccef73e-5e82-42e7-a2cb-ef2e49f3a035", "tag": "dfe16a0a-a802-4494-ac84-4d7be18928d2"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:51:38.219657 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-16d3e47f-fc93-4588-b6d2-23e06393e1cc req-4d77c0a7-c3b1-45b2-85c9-5d24b23576e0 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:38.220340 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-16d3e47f-fc93-4588-b6d2-23e06393e1cc req-4d77c0a7-c3b1-45b2-85c9-5d24b23576e0 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:38.221298 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-16d3e47f-fc93-4588-b6d2-23e06393e1cc req-4d77c0a7-c3b1-45b2-85c9-5d24b23576e0 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:38.253343 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-16d3e47f-fc93-4588-b6d2-23e06393e1cc req-4d77c0a7-c3b1-45b2-85c9-5d24b23576e0 service nova] Creating event network-changed:dfe16a0a-a802-4494-ac84-4d7be18928d2 for instance 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035 on n-h2-833090-16 Aug 31 15:51:38.262470 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-16d3e47f-fc93-4588-b6d2-23e06393e1cc req-4d77c0a7-c3b1-45b2-85c9-5d24b23576e0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067109 Aug 31 15:51:38.263123 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 376/730] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:51:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:51:38.377210 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-05d4de86-a687-4ad5-abee-1db380f6f118 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:38.377910 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-05d4de86-a687-4ad5-abee-1db380f6f118 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:38.387198 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-05d4de86-a687-4ad5-abee-1db380f6f118 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:38.389477 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-05d4de86-a687-4ad5-abee-1db380f6f118 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:38.391099 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-05d4de86-a687-4ad5-abee-1db380f6f118 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:38.393333 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-05d4de86-a687-4ad5-abee-1db380f6f118 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:38.394174 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-05d4de86-a687-4ad5-abee-1db380f6f118 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:38.395281 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-05d4de86-a687-4ad5-abee-1db380f6f118 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:38.496512 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f5589bf7-852c-4d26-8291-1a1246e39e17 tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:51:38.497106 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f5589bf7-852c-4d26-8291-1a1246e39e17 tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] [instance: 99961b7d-798c-4f1f-b42c-42c7fbdac114] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:38.509725 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-f5589bf7-852c-4d26-8291-1a1246e39e17 tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] HTTP exception thrown: Instance 99961b7d-798c-4f1f-b42c-42c7fbdac114 could not be found. Aug 31 15:51:38.511771 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f5589bf7-852c-4d26-8291-1a1246e39e17 tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] Request method failure captured: Aug 31 15:51:38.511771 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers/99961b7d-798c-4f1f-b42c-42c7fbdac114/action HTTP/1.1 Aug 31 15:51:38.511771 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:51:38.511771 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:51:38.511771 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:51:38.511771 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 15 Aug 31 15:51:38.511771 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:51:38.511771 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:51:38.511771 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:51:38.511771 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:51:38.511771 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4NxEsjAP9kLGq6RzhMXix5dQRBooJoncvRdCA4wHvH8cQeUmDocKUaLt6mYXngMgURd6jqrjKjKoC1Z_mLqWI-B-I82_TJT9s7_PFk74be6UYa1zJHE9GmzCTgZWVT0sZPgASnHy0DiDIyzsPULe6VEYpx4cLkptTx16dh_b-__qSg Aug 31 15:51:38.511771 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:51:38.511771 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:51:38.511771 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:51:38.511771 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:51:38.511771 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:51:38.511771 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:51:38.511771 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 61de52d5f68c469d9201da6a357eaf3b Aug 31 15:51:38.511771 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1115837278 Aug 31 15:51:38.511771 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,admin,member Aug 31 15:51:38.511771 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,admin,member Aug 31 15:51:38.513457 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/61de52d5f68c469d9201da6a357eaf3b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/61de52d5f68c469d9201da6a357eaf3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/61de52d5f68c469d9201da6a357eaf3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_61de52d5f68c469d9201da6a357eaf3b", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:51:38.513457 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1115837278 Aug 31 15:51:38.513457 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 61de52d5f68c469d9201da6a357eaf3b Aug 31 15:51:38.513457 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1115837278 Aug 31 15:51:38.513457 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServersAdminNegativeTestJSON-1115837278-project-admin Aug 31 15:51:38.513457 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:51:38.513457 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:51:38.513457 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 581bfe2e15404e9e95d4b1b20e87de42 Aug 31 15:51:38.513457 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1115837278-project-admin Aug 31 15:51:38.513457 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 15:51:38.513457 n-d-833090-16 devstack@n-api.service[128863]: {"migrate": {}} Aug 31 15:51:38.513457 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 15:51:38.513457 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 99961b7d-798c-4f1f-b42c-42c7fbdac114 could not be found. Aug 31 15:51:38.514539 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '99961b7d-798c-4f1f-b42c-42c7fbdac114', 'body': {'migrate': {}}} Aug 31 15:51:38.514539 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:51:38.514539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:51:38.514539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:51:38.514539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:51:38.514539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:51:38.514539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:51:38.514539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 31 15:51:38.514539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 31 15:51:38.514539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99961b7d-798c-4f1f-b42c-42c7fbdac114 could not be found. Aug 31 15:51:38.514539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:51:38.514539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:51:38.514539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:51:38.514539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:51:38.514539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:51:38.514539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:51:38.514539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:51:38.514539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:51:38.514539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:51:38.514539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:51:38.516082 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:51:38.516082 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:51:38.516082 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Aug 31 15:51:38.516082 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Aug 31 15:51:38.516082 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:51:38.516082 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:51:38.516082 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99961b7d-798c-4f1f-b42c-42c7fbdac114 could not be found. Aug 31 15:51:38.516082 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:51:38.516082 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:51:38.516082 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:51:38.516082 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:51:38.516082 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:51:38.516082 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:51:38.516082 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:51:38.516082 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:51:38.516082 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99961b7d-798c-4f1f-b42c-42c7fbdac114 could not be found. Aug 31 15:51:38.516082 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:51:38.517460 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f5589bf7-852c-4d26-8291-1a1246e39e17 tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] Returning 404 to user: Instance 99961b7d-798c-4f1f-b42c-42c7fbdac114 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:51:38.519676 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f5589bf7-852c-4d26-8291-1a1246e39e17 tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/99961b7d-798c-4f1f-b42c-42c7fbdac114/action" status: 404 len: 111 microversion: 2.1 time: 0.432343 Aug 31 15:51:38.520834 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 355/731] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 15:51:38 2022] POST /compute/v2.1/servers/99961b7d-798c-4f1f-b42c-42c7fbdac114/action => generated 111 bytes in 434 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:51:38.542419 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0e921871-b119-4c02-8fd8-1ac1f31fa0d5 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:38.543311 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0e921871-b119-4c02-8fd8-1ac1f31fa0d5 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 9cb430ca-c340-479a-b269-4672431bd393] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:38.557288 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e921871-b119-4c02-8fd8-1ac1f31fa0d5 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:38.557799 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e921871-b119-4c02-8fd8-1ac1f31fa0d5 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:38.558269 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e921871-b119-4c02-8fd8-1ac1f31fa0d5 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:38.563655 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e921871-b119-4c02-8fd8-1ac1f31fa0d5 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:38.564153 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e921871-b119-4c02-8fd8-1ac1f31fa0d5 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:38.564592 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e921871-b119-4c02-8fd8-1ac1f31fa0d5 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:38.875733 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-05d4de86-a687-4ad5-abee-1db380f6f118 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:38.884567 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-05d4de86-a687-4ad5-abee-1db380f6f118 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:38.898975 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-05d4de86-a687-4ad5-abee-1db380f6f118 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:38.900174 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-05d4de86-a687-4ad5-abee-1db380f6f118 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035" status: 200 len: 1362 microversion: 2.25 time: 0.527879 Aug 31 15:51:38.900768 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 377/732] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:51:38 2022] GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035 => generated 1362 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 15:51:38.918728 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-171a3930-2527-4fd5-8078-85cd34db80a5 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:38.919338 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-171a3930-2527-4fd5-8078-85cd34db80a5 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] [instance: 3b33f103-9c08-4775-975c-3f815d99a70e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:38.926806 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-171a3930-2527-4fd5-8078-85cd34db80a5 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:38.928209 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-171a3930-2527-4fd5-8078-85cd34db80a5 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:38.928848 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-171a3930-2527-4fd5-8078-85cd34db80a5 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:38.929935 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-171a3930-2527-4fd5-8078-85cd34db80a5 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:38.930793 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-171a3930-2527-4fd5-8078-85cd34db80a5 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:38.931549 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-171a3930-2527-4fd5-8078-85cd34db80a5 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:39.074602 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0e921871-b119-4c02-8fd8-1ac1f31fa0d5 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:39.076225 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-171a3930-2527-4fd5-8078-85cd34db80a5 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704d7c428d3e4a1bbe5fb78485415214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a08078ba5a04c31b6cc63dee67be8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:39.086256 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-171a3930-2527-4fd5-8078-85cd34db80a5 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] 10.222.0.50 "GET /compute/v2.1/servers/3b33f103-9c08-4775-975c-3f815d99a70e" status: 200 len: 1276 microversion: 2.1 time: 0.183962 Aug 31 15:51:39.086910 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 378/733] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:38 2022] GET /compute/v2.1/servers/3b33f103-9c08-4775-975c-3f815d99a70e => generated 1276 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:39.089827 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0e921871-b119-4c02-8fd8-1ac1f31fa0d5 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/9cb430ca-c340-479a-b269-4672431bd393" status: 200 len: 1317 microversion: 2.1 time: 0.549738 Aug 31 15:51:39.092613 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 356/734] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:38 2022] GET /compute/v2.1/servers/9cb430ca-c340-479a-b269-4672431bd393 => generated 1317 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:39.113517 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-117d1de3-5670-4446-9f9b-c5d9fd83d64a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:39.115664 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-75c34480-27c5-434d-8cc4-b74cfa47ffc1 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-340578542", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:51:39.119198 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-117d1de3-5670-4446-9f9b-c5d9fd83d64a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: a5a21e54-e375-4370-9d9e-b41df3e5922e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:39.139280 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-117d1de3-5670-4446-9f9b-c5d9fd83d64a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:39.144297 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-117d1de3-5670-4446-9f9b-c5d9fd83d64a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:39.146815 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-117d1de3-5670-4446-9f9b-c5d9fd83d64a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:39.150039 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-117d1de3-5670-4446-9f9b-c5d9fd83d64a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:39.151478 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-117d1de3-5670-4446-9f9b-c5d9fd83d64a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:39.152778 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-117d1de3-5670-4446-9f9b-c5d9fd83d64a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:39.240668 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-75c34480-27c5-434d-8cc4-b74cfa47ffc1 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] validate_networks() for None {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:51:39.794430 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-117d1de3-5670-4446-9f9b-c5d9fd83d64a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:39.807900 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-117d1de3-5670-4446-9f9b-c5d9fd83d64a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e" status: 200 len: 1462 microversion: 2.1 time: 0.703031 Aug 31 15:51:39.808684 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 357/735] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:39 2022] GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e => generated 1462 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:39.829188 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9cec7526-b2bd-4e81-b701-c16e6f1ffd2a tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:39.830077 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9cec7526-b2bd-4e81-b701-c16e6f1ffd2a tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] [instance: a5a21e54-e375-4370-9d9e-b41df3e5922e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:39.838215 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9cec7526-b2bd-4e81-b701-c16e6f1ffd2a tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:39.838943 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9cec7526-b2bd-4e81-b701-c16e6f1ffd2a tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:39.839547 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9cec7526-b2bd-4e81-b701-c16e6f1ffd2a tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:39.840549 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9cec7526-b2bd-4e81-b701-c16e6f1ffd2a tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:39.841207 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9cec7526-b2bd-4e81-b701-c16e6f1ffd2a tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:39.841783 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9cec7526-b2bd-4e81-b701-c16e6f1ffd2a tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:40.099626 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-75c34480-27c5-434d-8cc4-b74cfa47ffc1 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:51:40.100652 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-75c34480-27c5-434d-8cc4-b74cfa47ffc1 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:51:40.101553 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-75c34480-27c5-434d-8cc4-b74cfa47ffc1 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:51:40.102371 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-75c34480-27c5-434d-8cc4-b74cfa47ffc1 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:51:40.103328 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-75c34480-27c5-434d-8cc4-b74cfa47ffc1 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:51:40.147349 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-75c34480-27c5-434d-8cc4-b74cfa47ffc1 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:40.150185 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-75c34480-27c5-434d-8cc4-b74cfa47ffc1 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:40.152255 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-75c34480-27c5-434d-8cc4-b74cfa47ffc1 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:40.161007 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-75c34480-27c5-434d-8cc4-b74cfa47ffc1 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:40.165058 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-75c34480-27c5-434d-8cc4-b74cfa47ffc1 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:40.170799 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-75c34480-27c5-434d-8cc4-b74cfa47ffc1 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:40.236005 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-75c34480-27c5-434d-8cc4-b74cfa47ffc1 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Getting quotas for project 7e94509e985441f7b2802e6c6b164cec. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:51:40.256123 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-75c34480-27c5-434d-8cc4-b74cfa47ffc1 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Getting quotas for user 6849c97bdb0948bc824cf5efe0f709a5 and project 7e94509e985441f7b2802e6c6b164cec. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:51:40.289302 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-75c34480-27c5-434d-8cc4-b74cfa47ffc1 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:51:40.298837 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-75c34480-27c5-434d-8cc4-b74cfa47ffc1 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] [instance: a21daf16-afa5-4cad-8f8c-6ca10636601d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:51:40.381317 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-75c34480-27c5-434d-8cc4-b74cfa47ffc1 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.293280 Aug 31 15:51:40.382818 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 379/736] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:51:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1295 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 15:51:40.393244 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ea47990a-e08c-4c64-845f-381125594546 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:40.399842 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ea47990a-e08c-4c64-845f-381125594546 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:40.416230 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ea47990a-e08c-4c64-845f-381125594546 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:40.417441 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ea47990a-e08c-4c64-845f-381125594546 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:40.423035 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ea47990a-e08c-4c64-845f-381125594546 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:40.424782 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ea47990a-e08c-4c64-845f-381125594546 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:40.427537 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ea47990a-e08c-4c64-845f-381125594546 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:40.428540 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ea47990a-e08c-4c64-845f-381125594546 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:40.759846 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:51:40.769286 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9cec7526-b2bd-4e81-b701-c16e6f1ffd2a tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e" status: 200 len: 1615 microversion: 2.1 time: 0.943917 Aug 31 15:51:40.786893 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 358/737] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:39 2022] GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e => generated 1615 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:40.798414 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b2020c09-2b6e-4e6d-bac4-d95cb79c4b5e tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:40.802849 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b2020c09-2b6e-4e6d-bac4-d95cb79c4b5e tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] [instance: 3b33f103-9c08-4775-975c-3f815d99a70e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:40.823369 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b2020c09-2b6e-4e6d-bac4-d95cb79c4b5e tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:40.827221 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b2020c09-2b6e-4e6d-bac4-d95cb79c4b5e tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:40.827964 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b2020c09-2b6e-4e6d-bac4-d95cb79c4b5e tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:40.828932 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b2020c09-2b6e-4e6d-bac4-d95cb79c4b5e tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:40.830166 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b2020c09-2b6e-4e6d-bac4-d95cb79c4b5e tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:40.831506 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b2020c09-2b6e-4e6d-bac4-d95cb79c4b5e tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:40.857791 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ea47990a-e08c-4c64-845f-381125594546 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:40.911800 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ea47990a-e08c-4c64-845f-381125594546 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:40.922953 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ea47990a-e08c-4c64-845f-381125594546 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:40.924157 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ea47990a-e08c-4c64-845f-381125594546 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035" status: 200 len: 1362 microversion: 2.25 time: 0.536602 Aug 31 15:51:40.942710 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 380/738] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:51:40 2022] GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035 => generated 1362 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:51:40.953177 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b7652761-3fae-4083-ae44-ec8a4c23eac7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:40.959315 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b7652761-3fae-4083-ae44-ec8a4c23eac7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 9cb430ca-c340-479a-b269-4672431bd393] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:40.977528 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b7652761-3fae-4083-ae44-ec8a4c23eac7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:40.978757 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b7652761-3fae-4083-ae44-ec8a4c23eac7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:40.979422 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b7652761-3fae-4083-ae44-ec8a4c23eac7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:40.980353 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b7652761-3fae-4083-ae44-ec8a4c23eac7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:40.981033 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b7652761-3fae-4083-ae44-ec8a4c23eac7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:40.981710 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b7652761-3fae-4083-ae44-ec8a4c23eac7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:41.392383 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b7652761-3fae-4083-ae44-ec8a4c23eac7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:41.403467 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b7652761-3fae-4083-ae44-ec8a4c23eac7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/9cb430ca-c340-479a-b269-4672431bd393" status: 200 len: 1317 microversion: 2.1 time: 0.459547 Aug 31 15:51:41.406399 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 381/739] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:40 2022] GET /compute/v2.1/servers/9cb430ca-c340-479a-b269-4672431bd393 => generated 1317 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:41.417998 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b2020c09-2b6e-4e6d-bac4-d95cb79c4b5e tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704d7c428d3e4a1bbe5fb78485415214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a08078ba5a04c31b6cc63dee67be8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:41.420582 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f40c35a4-2ee8-425c-a2bd-f46e006f465f tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:41.421323 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f40c35a4-2ee8-425c-a2bd-f46e006f465f tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] [instance: a21daf16-afa5-4cad-8f8c-6ca10636601d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:41.427758 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b2020c09-2b6e-4e6d-bac4-d95cb79c4b5e tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] 10.222.0.50 "GET /compute/v2.1/servers/3b33f103-9c08-4775-975c-3f815d99a70e" status: 200 len: 1318 microversion: 2.1 time: 0.636045 Aug 31 15:51:41.435509 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:51:41.440633 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 359/740] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:40 2022] GET /compute/v2.1/servers/3b33f103-9c08-4775-975c-3f815d99a70e => generated 1318 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:41.457914 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-975e1487-21aa-4c35-b41a-645e3c281f17 tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] Calling method '.version_select at 0x7fbb46cfcb80>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:41.476837 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-975e1487-21aa-4c35-b41a-645e3c281f17 tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:41.484352 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-975e1487-21aa-4c35-b41a-645e3c281f17 tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:41.490864 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-975e1487-21aa-4c35-b41a-645e3c281f17 tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:41.542598 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-975e1487-21aa-4c35-b41a-645e3c281f17 tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] 10.222.0.50 "GET /compute/v2.1/os-migrations" status: 200 len: 801 microversion: 2.1 time: 0.096797 Aug 31 15:51:41.550443 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 360/741] 10.222.0.50 () {58 vars in 1143 bytes} [Wed Aug 31 15:51:41 2022] GET /compute/v2.1/os-migrations => generated 801 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:51:41.592404 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f40c35a4-2ee8-425c-a2bd-f46e006f465f tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6849c97bdb0948bc824cf5efe0f709a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e94509e985441f7b2802e6c6b164cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:41.600259 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=25 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:51:41.609302 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f40c35a4-2ee8-425c-a2bd-f46e006f465f tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] 10.222.0.50 "GET /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d" status: 200 len: 1221 microversion: 2.1 time: 0.201065 Aug 31 15:51:41.612901 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 382/742] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:41 2022] GET /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d => generated 1221 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:41.776428 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5407d86d-cf01-4763-a25c-8d147d6cf033 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-414411820", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:51:41.905401 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-5407d86d-cf01-4763-a25c-8d147d6cf033 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] validate_networks() for None {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:51:41.955430 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-76a03a5b-6e94-487f-a34c-f257692216cf tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:41.956111 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-76a03a5b-6e94-487f-a34c-f257692216cf tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:41.975354 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76a03a5b-6e94-487f-a34c-f257692216cf tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:41.976266 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76a03a5b-6e94-487f-a34c-f257692216cf tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:41.977008 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76a03a5b-6e94-487f-a34c-f257692216cf tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:41.978347 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76a03a5b-6e94-487f-a34c-f257692216cf tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:41.979013 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76a03a5b-6e94-487f-a34c-f257692216cf tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:41.979674 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76a03a5b-6e94-487f-a34c-f257692216cf tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:42.970807 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-5407d86d-cf01-4763-a25c-8d147d6cf033 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:51:42.972479 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-5407d86d-cf01-4763-a25c-8d147d6cf033 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:51:42.980226 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-5407d86d-cf01-4763-a25c-8d147d6cf033 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:51:42.980745 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-5407d86d-cf01-4763-a25c-8d147d6cf033 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:51:42.981174 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-5407d86d-cf01-4763-a25c-8d147d6cf033 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:51:43.020525 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5407d86d-cf01-4763-a25c-8d147d6cf033 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:43.023581 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5407d86d-cf01-4763-a25c-8d147d6cf033 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:43.030705 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5407d86d-cf01-4763-a25c-8d147d6cf033 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:43.036647 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5407d86d-cf01-4763-a25c-8d147d6cf033 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:43.037333 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5407d86d-cf01-4763-a25c-8d147d6cf033 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:43.037775 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5407d86d-cf01-4763-a25c-8d147d6cf033 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:43.111038 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:51:43.131425 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-5407d86d-cf01-4763-a25c-8d147d6cf033 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Getting quotas for project 9b4c50ece07f441b8974d384f4ab29a4. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:51:43.149054 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-5407d86d-cf01-4763-a25c-8d147d6cf033 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Getting quotas for user 5f6f8b9d63234b8199c60f842a3c407f and project 9b4c50ece07f441b8974d384f4ab29a4. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:51:43.207837 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5407d86d-cf01-4763-a25c-8d147d6cf033 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:51:43.218623 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5407d86d-cf01-4763-a25c-8d147d6cf033 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 236954ea-2791-477d-a92b-88e590593c63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:51:43.330835 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5407d86d-cf01-4763-a25c-8d147d6cf033 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.582234 Aug 31 15:51:43.339790 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 361/743] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:51:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 15:51:43.351563 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-09460fba-fbc6-4ef7-b86a-f176fa7ee21d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:43.352180 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-09460fba-fbc6-4ef7-b86a-f176fa7ee21d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 9cb430ca-c340-479a-b269-4672431bd393] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:43.380722 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09460fba-fbc6-4ef7-b86a-f176fa7ee21d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:43.381215 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09460fba-fbc6-4ef7-b86a-f176fa7ee21d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:43.389400 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09460fba-fbc6-4ef7-b86a-f176fa7ee21d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:43.390233 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09460fba-fbc6-4ef7-b86a-f176fa7ee21d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:43.390720 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09460fba-fbc6-4ef7-b86a-f176fa7ee21d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:43.391159 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09460fba-fbc6-4ef7-b86a-f176fa7ee21d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:43.549247 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-76a03a5b-6e94-487f-a34c-f257692216cf tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:43.573825 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-76a03a5b-6e94-487f-a34c-f257692216cf tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:43.575688 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-76a03a5b-6e94-487f-a34c-f257692216cf tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:43.581282 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-76a03a5b-6e94-487f-a34c-f257692216cf tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035" status: 200 len: 1362 microversion: 2.25 time: 1.629960 Aug 31 15:51:43.603888 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 383/744] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:51:41 2022] GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035 => generated 1362 bytes in 1653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:51:43.633995 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-cdbe7c8b-df4b-494c-ab95-1470418dd0c6 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:43.636467 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-cdbe7c8b-df4b-494c-ab95-1470418dd0c6 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] [instance: 3b33f103-9c08-4775-975c-3f815d99a70e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:43.656913 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cdbe7c8b-df4b-494c-ab95-1470418dd0c6 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:43.663183 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cdbe7c8b-df4b-494c-ab95-1470418dd0c6 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:43.667077 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cdbe7c8b-df4b-494c-ab95-1470418dd0c6 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:43.669263 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cdbe7c8b-df4b-494c-ab95-1470418dd0c6 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:43.671442 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cdbe7c8b-df4b-494c-ab95-1470418dd0c6 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:43.673614 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cdbe7c8b-df4b-494c-ab95-1470418dd0c6 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:44.590565 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-09460fba-fbc6-4ef7-b86a-f176fa7ee21d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:44.630760 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-09460fba-fbc6-4ef7-b86a-f176fa7ee21d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/9cb430ca-c340-479a-b269-4672431bd393" status: 200 len: 1317 microversion: 2.1 time: 1.288314 Aug 31 15:51:44.647668 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 362/745] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:43 2022] GET /compute/v2.1/servers/9cb430ca-c340-479a-b269-4672431bd393 => generated 1317 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:44.670150 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-365f5e81-b272-4c7a-80bb-8adc6964c491 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:44.671808 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-365f5e81-b272-4c7a-80bb-8adc6964c491 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] [instance: a21daf16-afa5-4cad-8f8c-6ca10636601d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:44.705454 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-365f5e81-b272-4c7a-80bb-8adc6964c491 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:44.718669 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-365f5e81-b272-4c7a-80bb-8adc6964c491 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:44.724697 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-365f5e81-b272-4c7a-80bb-8adc6964c491 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:44.728184 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-365f5e81-b272-4c7a-80bb-8adc6964c491 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:44.730615 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-365f5e81-b272-4c7a-80bb-8adc6964c491 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:44.736668 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-365f5e81-b272-4c7a-80bb-8adc6964c491 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:44.887322 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-cdbe7c8b-df4b-494c-ab95-1470418dd0c6 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704d7c428d3e4a1bbe5fb78485415214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a08078ba5a04c31b6cc63dee67be8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:44.905399 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-cdbe7c8b-df4b-494c-ab95-1470418dd0c6 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] 10.222.0.50 "GET /compute/v2.1/servers/3b33f103-9c08-4775-975c-3f815d99a70e" status: 200 len: 1318 microversion: 2.1 time: 1.295701 Aug 31 15:51:44.906846 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 384/746] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:43 2022] GET /compute/v2.1/servers/3b33f103-9c08-4775-975c-3f815d99a70e => generated 1318 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:44.923263 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-41f78960-765a-4828-8bf1-7e1f0b76e935 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:44.923925 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-41f78960-765a-4828-8bf1-7e1f0b76e935 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 236954ea-2791-477d-a92b-88e590593c63] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:44.949172 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-41f78960-765a-4828-8bf1-7e1f0b76e935 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:44.955435 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-41f78960-765a-4828-8bf1-7e1f0b76e935 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:44.955938 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-41f78960-765a-4828-8bf1-7e1f0b76e935 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:44.958642 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-41f78960-765a-4828-8bf1-7e1f0b76e935 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:44.961398 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-41f78960-765a-4828-8bf1-7e1f0b76e935 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:44.966930 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-41f78960-765a-4828-8bf1-7e1f0b76e935 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:45.157074 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-365f5e81-b272-4c7a-80bb-8adc6964c491 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6849c97bdb0948bc824cf5efe0f709a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e94509e985441f7b2802e6c6b164cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:45.173665 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-365f5e81-b272-4c7a-80bb-8adc6964c491 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] 10.222.0.50 "GET /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d" status: 200 len: 1279 microversion: 2.1 time: 0.520975 Aug 31 15:51:45.175102 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 363/747] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:44 2022] GET /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d => generated 1279 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:45.198866 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-7451795f-7be1-4da5-97cd-04aaa6441bf2 req-9694fe8d-5623-4986-91e2-4e4d8b184bd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b33f103-9c08-4775-975c-3f815d99a70e", "tag": "6972e09f-ac79-4712-9a38-b8d3859e2423"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:51:45.258222 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7451795f-7be1-4da5-97cd-04aaa6441bf2 req-9694fe8d-5623-4986-91e2-4e4d8b184bd6 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:45.259190 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7451795f-7be1-4da5-97cd-04aaa6441bf2 req-9694fe8d-5623-4986-91e2-4e4d8b184bd6 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:45.259879 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7451795f-7be1-4da5-97cd-04aaa6441bf2 req-9694fe8d-5623-4986-91e2-4e4d8b184bd6 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:45.302204 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-7451795f-7be1-4da5-97cd-04aaa6441bf2 req-9694fe8d-5623-4986-91e2-4e4d8b184bd6 service nova] Creating event network-changed:6972e09f-ac79-4712-9a38-b8d3859e2423 for instance 3b33f103-9c08-4775-975c-3f815d99a70e on n-h1-833090-16 Aug 31 15:51:45.342967 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-7451795f-7be1-4da5-97cd-04aaa6441bf2 req-9694fe8d-5623-4986-91e2-4e4d8b184bd6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163056 Aug 31 15:51:45.344299 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 364/748] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:51:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:51:45.361173 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-62d5dce1-5d10-40ef-8e8c-86250ac8c797 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:45.362164 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-62d5dce1-5d10-40ef-8e8c-86250ac8c797 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:45.369250 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62d5dce1-5d10-40ef-8e8c-86250ac8c797 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:45.370151 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62d5dce1-5d10-40ef-8e8c-86250ac8c797 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:45.370842 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62d5dce1-5d10-40ef-8e8c-86250ac8c797 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:45.371794 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62d5dce1-5d10-40ef-8e8c-86250ac8c797 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:45.372735 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62d5dce1-5d10-40ef-8e8c-86250ac8c797 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:45.373379 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62d5dce1-5d10-40ef-8e8c-86250ac8c797 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:45.459880 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-41f78960-765a-4828-8bf1-7e1f0b76e935 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:45.470729 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-41f78960-765a-4828-8bf1-7e1f0b76e935 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63" status: 200 len: 1208 microversion: 2.1 time: 0.562676 Aug 31 15:51:45.485481 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 385/749] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:44 2022] GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63 => generated 1208 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:45.503002 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-05aef562-e6e6-46d3-bd91-c6c71cbc9ace req-c234a836-0453-4d33-a8b0-d8c385a8438c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cb430ca-c340-479a-b269-4672431bd393", "name": "network-vif-plugged", "status": "completed", "tag": "49e61df5-a85b-44f7-9ed7-4c18051cf4cb"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:51:45.533914 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-05aef562-e6e6-46d3-bd91-c6c71cbc9ace req-c234a836-0453-4d33-a8b0-d8c385a8438c service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:45.539786 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-05aef562-e6e6-46d3-bd91-c6c71cbc9ace req-c234a836-0453-4d33-a8b0-d8c385a8438c service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:45.541732 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-05aef562-e6e6-46d3-bd91-c6c71cbc9ace req-c234a836-0453-4d33-a8b0-d8c385a8438c service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:45.568891 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-05aef562-e6e6-46d3-bd91-c6c71cbc9ace req-c234a836-0453-4d33-a8b0-d8c385a8438c service nova] Creating event network-vif-plugged:49e61df5-a85b-44f7-9ed7-4c18051cf4cb for instance 9cb430ca-c340-479a-b269-4672431bd393 on n-h1-833090-16 Aug 31 15:51:45.575329 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-05aef562-e6e6-46d3-bd91-c6c71cbc9ace req-c234a836-0453-4d33-a8b0-d8c385a8438c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085580 Aug 31 15:51:45.582254 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 386/750] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:51:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:51:45.699187 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-797bac15-bb8b-491a-97ee-0f2f9534be21 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:45.701051 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-797bac15-bb8b-491a-97ee-0f2f9534be21 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 9cb430ca-c340-479a-b269-4672431bd393] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:45.713981 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-797bac15-bb8b-491a-97ee-0f2f9534be21 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:45.719420 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-797bac15-bb8b-491a-97ee-0f2f9534be21 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:45.721304 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-797bac15-bb8b-491a-97ee-0f2f9534be21 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:45.722400 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-797bac15-bb8b-491a-97ee-0f2f9534be21 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:45.723090 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-797bac15-bb8b-491a-97ee-0f2f9534be21 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:45.724022 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-797bac15-bb8b-491a-97ee-0f2f9534be21 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:46.246812 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-62d5dce1-5d10-40ef-8e8c-86250ac8c797 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:46.259533 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-62d5dce1-5d10-40ef-8e8c-86250ac8c797 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:46.261061 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-62d5dce1-5d10-40ef-8e8c-86250ac8c797 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:46.262241 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-62d5dce1-5d10-40ef-8e8c-86250ac8c797 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035" status: 200 len: 1362 microversion: 2.25 time: 0.916515 Aug 31 15:51:46.262800 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 365/751] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:51:45 2022] GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035 => generated 1362 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:51:46.283386 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b4597eb7-59fc-4404-9a25-048bf589aaa9 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:46.283998 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b4597eb7-59fc-4404-9a25-048bf589aaa9 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] [instance: 3b33f103-9c08-4775-975c-3f815d99a70e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:46.303477 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4597eb7-59fc-4404-9a25-048bf589aaa9 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:46.303972 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4597eb7-59fc-4404-9a25-048bf589aaa9 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:46.304465 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4597eb7-59fc-4404-9a25-048bf589aaa9 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:46.305471 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4597eb7-59fc-4404-9a25-048bf589aaa9 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:46.305934 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4597eb7-59fc-4404-9a25-048bf589aaa9 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:46.306391 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4597eb7-59fc-4404-9a25-048bf589aaa9 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:46.870909 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-797bac15-bb8b-491a-97ee-0f2f9534be21 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:46.888547 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b4597eb7-59fc-4404-9a25-048bf589aaa9 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704d7c428d3e4a1bbe5fb78485415214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a08078ba5a04c31b6cc63dee67be8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:46.894806 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-797bac15-bb8b-491a-97ee-0f2f9534be21 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/9cb430ca-c340-479a-b269-4672431bd393" status: 200 len: 1317 microversion: 2.1 time: 1.203598 Aug 31 15:51:46.896574 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 387/752] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:45 2022] GET /compute/v2.1/servers/9cb430ca-c340-479a-b269-4672431bd393 => generated 1317 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:46.909772 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5fecf150-92cd-4bb8-b972-950747e137cc tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:46.912733 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5fecf150-92cd-4bb8-b972-950747e137cc tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] [instance: a21daf16-afa5-4cad-8f8c-6ca10636601d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:46.913139 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b4597eb7-59fc-4404-9a25-048bf589aaa9 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] 10.222.0.50 "GET /compute/v2.1/servers/3b33f103-9c08-4775-975c-3f815d99a70e" status: 200 len: 1318 microversion: 2.1 time: 0.627076 Aug 31 15:51:46.915588 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 366/753] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:46 2022] GET /compute/v2.1/servers/3b33f103-9c08-4775-975c-3f815d99a70e => generated 1318 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:46.926175 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8c2a9959-3c76-4b2a-91ec-d859b19f7bf0 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:46.928397 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8c2a9959-3c76-4b2a-91ec-d859b19f7bf0 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 236954ea-2791-477d-a92b-88e590593c63] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:46.939460 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c2a9959-3c76-4b2a-91ec-d859b19f7bf0 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:46.940206 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c2a9959-3c76-4b2a-91ec-d859b19f7bf0 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:46.940793 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c2a9959-3c76-4b2a-91ec-d859b19f7bf0 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:46.941746 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c2a9959-3c76-4b2a-91ec-d859b19f7bf0 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:46.942416 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c2a9959-3c76-4b2a-91ec-d859b19f7bf0 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:46.942983 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c2a9959-3c76-4b2a-91ec-d859b19f7bf0 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:46.952786 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5fecf150-92cd-4bb8-b972-950747e137cc tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:46.953286 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5fecf150-92cd-4bb8-b972-950747e137cc tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:46.954816 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5fecf150-92cd-4bb8-b972-950747e137cc tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:46.955625 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5fecf150-92cd-4bb8-b972-950747e137cc tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:46.956743 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5fecf150-92cd-4bb8-b972-950747e137cc tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:46.957272 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5fecf150-92cd-4bb8-b972-950747e137cc tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:46.962707 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=100 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:51:47.073774 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5fecf150-92cd-4bb8-b972-950747e137cc tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6849c97bdb0948bc824cf5efe0f709a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e94509e985441f7b2802e6c6b164cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:47.089358 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8c2a9959-3c76-4b2a-91ec-d859b19f7bf0 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:47.102407 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8c2a9959-3c76-4b2a-91ec-d859b19f7bf0 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63" status: 200 len: 1270 microversion: 2.1 time: 0.184291 Aug 31 15:51:47.106164 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 367/754] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:46 2022] GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63 => generated 1270 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:47.106340 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5fecf150-92cd-4bb8-b972-950747e137cc tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] 10.222.0.50 "GET /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d" status: 200 len: 1279 microversion: 2.1 time: 0.207637 Aug 31 15:51:47.106597 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 388/755] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:46 2022] GET /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d => generated 1279 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:47.295497 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-40caec11-bc70-4423-9b12-d86dfe94be25 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:47.296691 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-40caec11-bc70-4423-9b12-d86dfe94be25 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:47.302721 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-40caec11-bc70-4423-9b12-d86dfe94be25 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:47.303200 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-40caec11-bc70-4423-9b12-d86dfe94be25 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:47.303620 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-40caec11-bc70-4423-9b12-d86dfe94be25 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:47.304946 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-40caec11-bc70-4423-9b12-d86dfe94be25 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:47.305822 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-40caec11-bc70-4423-9b12-d86dfe94be25 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:47.306460 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-40caec11-bc70-4423-9b12-d86dfe94be25 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:47.463917 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-40caec11-bc70-4423-9b12-d86dfe94be25 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:47.478200 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-40caec11-bc70-4423-9b12-d86dfe94be25 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:47.479648 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-40caec11-bc70-4423-9b12-d86dfe94be25 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:47.481887 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-40caec11-bc70-4423-9b12-d86dfe94be25 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035" status: 200 len: 1362 microversion: 2.25 time: 0.190211 Aug 31 15:51:47.482976 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 368/756] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:51:47 2022] GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035 => generated 1362 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:51:47.918836 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0f68a326-23d9-43e4-bc04-46b81e89017a tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:47.919758 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0f68a326-23d9-43e4-bc04-46b81e89017a tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 9cb430ca-c340-479a-b269-4672431bd393] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:47.928432 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0f68a326-23d9-43e4-bc04-46b81e89017a tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:47.929758 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0f68a326-23d9-43e4-bc04-46b81e89017a tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:47.930442 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0f68a326-23d9-43e4-bc04-46b81e89017a tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:47.931356 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0f68a326-23d9-43e4-bc04-46b81e89017a tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:47.935501 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0f68a326-23d9-43e4-bc04-46b81e89017a tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:47.936271 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0f68a326-23d9-43e4-bc04-46b81e89017a tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:47.952615 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a3924752-77f7-4a46-bee0-1aeb9ec3a02b tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:47.953408 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a3924752-77f7-4a46-bee0-1aeb9ec3a02b tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] [instance: 3b33f103-9c08-4775-975c-3f815d99a70e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:47.964857 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a3924752-77f7-4a46-bee0-1aeb9ec3a02b tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:47.965358 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a3924752-77f7-4a46-bee0-1aeb9ec3a02b tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:47.965796 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a3924752-77f7-4a46-bee0-1aeb9ec3a02b tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:47.973872 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a3924752-77f7-4a46-bee0-1aeb9ec3a02b tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:47.974441 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a3924752-77f7-4a46-bee0-1aeb9ec3a02b tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:47.976368 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a3924752-77f7-4a46-bee0-1aeb9ec3a02b tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:48.216851 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0f68a326-23d9-43e4-bc04-46b81e89017a tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:48.228379 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0f68a326-23d9-43e4-bc04-46b81e89017a tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/9cb430ca-c340-479a-b269-4672431bd393" status: 200 len: 1317 microversion: 2.1 time: 0.312935 Aug 31 15:51:48.234437 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 389/757] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:47 2022] GET /compute/v2.1/servers/9cb430ca-c340-479a-b269-4672431bd393 => generated 1317 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:48.240195 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1e80dd8e-1cda-4d78-b8e5-4e643a181a8d tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:48.244792 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1e80dd8e-1cda-4d78-b8e5-4e643a181a8d tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] [instance: a21daf16-afa5-4cad-8f8c-6ca10636601d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:48.259795 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e80dd8e-1cda-4d78-b8e5-4e643a181a8d tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:48.260632 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e80dd8e-1cda-4d78-b8e5-4e643a181a8d tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:48.261227 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e80dd8e-1cda-4d78-b8e5-4e643a181a8d tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:48.262212 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e80dd8e-1cda-4d78-b8e5-4e643a181a8d tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:48.267689 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e80dd8e-1cda-4d78-b8e5-4e643a181a8d tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:48.268412 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e80dd8e-1cda-4d78-b8e5-4e643a181a8d tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:48.331215 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a3924752-77f7-4a46-bee0-1aeb9ec3a02b tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704d7c428d3e4a1bbe5fb78485415214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a08078ba5a04c31b6cc63dee67be8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:48.341146 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a3924752-77f7-4a46-bee0-1aeb9ec3a02b tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] 10.222.0.50 "GET /compute/v2.1/servers/3b33f103-9c08-4775-975c-3f815d99a70e" status: 200 len: 1318 microversion: 2.1 time: 0.392948 Aug 31 15:51:48.359679 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 369/758] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:47 2022] GET /compute/v2.1/servers/3b33f103-9c08-4775-975c-3f815d99a70e => generated 1318 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:48.367931 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f31234e3-6841-4e23-94c8-b89a06b686f2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:48.371047 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f31234e3-6841-4e23-94c8-b89a06b686f2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 236954ea-2791-477d-a92b-88e590593c63] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:48.396001 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f31234e3-6841-4e23-94c8-b89a06b686f2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:48.396496 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f31234e3-6841-4e23-94c8-b89a06b686f2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:48.396940 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f31234e3-6841-4e23-94c8-b89a06b686f2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:48.397736 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f31234e3-6841-4e23-94c8-b89a06b686f2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:48.400680 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f31234e3-6841-4e23-94c8-b89a06b686f2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:48.401328 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f31234e3-6841-4e23-94c8-b89a06b686f2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:48.582456 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f31234e3-6841-4e23-94c8-b89a06b686f2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:48.594451 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f31234e3-6841-4e23-94c8-b89a06b686f2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63" status: 200 len: 1270 microversion: 2.1 time: 0.235410 Aug 31 15:51:48.595299 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 370/759] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:48 2022] GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63 => generated 1270 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:48.613520 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-94bfb2fe-dbb0-43d2-87f4-67cea7434f21 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:48.614562 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-94bfb2fe-dbb0-43d2-87f4-67cea7434f21 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:48.638152 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-94bfb2fe-dbb0-43d2-87f4-67cea7434f21 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:48.639578 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-94bfb2fe-dbb0-43d2-87f4-67cea7434f21 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:48.642224 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-94bfb2fe-dbb0-43d2-87f4-67cea7434f21 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:48.645364 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-94bfb2fe-dbb0-43d2-87f4-67cea7434f21 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:48.646628 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-94bfb2fe-dbb0-43d2-87f4-67cea7434f21 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:48.649578 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-94bfb2fe-dbb0-43d2-87f4-67cea7434f21 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:48.657545 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1e80dd8e-1cda-4d78-b8e5-4e643a181a8d tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6849c97bdb0948bc824cf5efe0f709a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e94509e985441f7b2802e6c6b164cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:48.666710 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1e80dd8e-1cda-4d78-b8e5-4e643a181a8d tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] 10.222.0.50 "GET /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d" status: 200 len: 1321 microversion: 2.1 time: 0.430926 Aug 31 15:51:48.667755 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 390/760] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:48 2022] GET /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d => generated 1321 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:48.772942 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b123b399-7d8b-4bd7-8ca8-5f6a14723700 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-2041571494", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "f2d8a591-b45a-45cf-9c03-1ea12e562c0c"}]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:51:48.858341 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-b123b399-7d8b-4bd7-8ca8-5f6a14723700 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] validate_networks() for [('f2d8a591-b45a-45cf-9c03-1ea12e562c0c', None, None, None, None, None)] {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:51:49.472748 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-94bfb2fe-dbb0-43d2-87f4-67cea7434f21 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:49.487196 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-94bfb2fe-dbb0-43d2-87f4-67cea7434f21 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:49.511318 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-94bfb2fe-dbb0-43d2-87f4-67cea7434f21 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:49.516788 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-94bfb2fe-dbb0-43d2-87f4-67cea7434f21 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035" status: 200 len: 1362 microversion: 2.25 time: 0.920192 Aug 31 15:51:49.519684 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 371/761] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:51:48 2022] GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035 => generated 1362 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:51:49.548091 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b708c21c-3fe3-4662-80f5-f69cea9ef30d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:49.549184 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b708c21c-3fe3-4662-80f5-f69cea9ef30d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 9cb430ca-c340-479a-b269-4672431bd393] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:49.568432 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b708c21c-3fe3-4662-80f5-f69cea9ef30d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:49.572288 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b708c21c-3fe3-4662-80f5-f69cea9ef30d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:49.573017 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b708c21c-3fe3-4662-80f5-f69cea9ef30d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:49.586639 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b708c21c-3fe3-4662-80f5-f69cea9ef30d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:49.588698 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b708c21c-3fe3-4662-80f5-f69cea9ef30d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:49.590130 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b708c21c-3fe3-4662-80f5-f69cea9ef30d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:49.878084 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b708c21c-3fe3-4662-80f5-f69cea9ef30d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:49.890907 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b708c21c-3fe3-4662-80f5-f69cea9ef30d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/9cb430ca-c340-479a-b269-4672431bd393" status: 200 len: 1467 microversion: 2.1 time: 0.368452 Aug 31 15:51:49.894948 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 372/762] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:49 2022] GET /compute/v2.1/servers/9cb430ca-c340-479a-b269-4672431bd393 => generated 1467 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:49.907546 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-1c2943da-14d0-4be3-9fab-1b24408f685e req-36ade058-804a-4410-b654-1124b07c8caf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ccef73e-5e82-42e7-a2cb-ef2e49f3a035", "name": "network-vif-plugged", "status": "completed", "tag": "dfe16a0a-a802-4494-ac84-4d7be18928d2"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:51:49.929983 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-1c2943da-14d0-4be3-9fab-1b24408f685e req-36ade058-804a-4410-b654-1124b07c8caf service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:49.930492 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-1c2943da-14d0-4be3-9fab-1b24408f685e req-36ade058-804a-4410-b654-1124b07c8caf service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:49.930915 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-1c2943da-14d0-4be3-9fab-1b24408f685e req-36ade058-804a-4410-b654-1124b07c8caf service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:49.959443 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-1c2943da-14d0-4be3-9fab-1b24408f685e req-36ade058-804a-4410-b654-1124b07c8caf service nova] Creating event network-vif-plugged:dfe16a0a-a802-4494-ac84-4d7be18928d2 for instance 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035 on n-h2-833090-16 Aug 31 15:51:49.968308 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-1c2943da-14d0-4be3-9fab-1b24408f685e req-36ade058-804a-4410-b654-1124b07c8caf service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071543 Aug 31 15:51:49.973348 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 373/763] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:51:49.979395 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-80c52231-22ee-44f7-bf95-113f57b4824a tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:49.980102 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-80c52231-22ee-44f7-bf95-113f57b4824a tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] [instance: 3b33f103-9c08-4775-975c-3f815d99a70e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:50.000941 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80c52231-22ee-44f7-bf95-113f57b4824a tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:50.001433 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80c52231-22ee-44f7-bf95-113f57b4824a tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:50.001860 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80c52231-22ee-44f7-bf95-113f57b4824a tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:50.002783 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80c52231-22ee-44f7-bf95-113f57b4824a tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:50.003232 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80c52231-22ee-44f7-bf95-113f57b4824a tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:50.003651 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80c52231-22ee-44f7-bf95-113f57b4824a tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:50.206968 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:51:50.425786 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-b123b399-7d8b-4bd7-8ca8-5f6a14723700 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:51:50.426605 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-b123b399-7d8b-4bd7-8ca8-5f6a14723700 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:51:50.426727 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-b123b399-7d8b-4bd7-8ca8-5f6a14723700 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:51:50.427099 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-b123b399-7d8b-4bd7-8ca8-5f6a14723700 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:51:50.427504 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-b123b399-7d8b-4bd7-8ca8-5f6a14723700 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:51:50.444015 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b123b399-7d8b-4bd7-8ca8-5f6a14723700 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:50.445523 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b123b399-7d8b-4bd7-8ca8-5f6a14723700 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:50.446606 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b123b399-7d8b-4bd7-8ca8-5f6a14723700 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:50.452297 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-80c52231-22ee-44f7-bf95-113f57b4824a tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704d7c428d3e4a1bbe5fb78485415214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a08078ba5a04c31b6cc63dee67be8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:50.470678 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b123b399-7d8b-4bd7-8ca8-5f6a14723700 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:50.471872 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b123b399-7d8b-4bd7-8ca8-5f6a14723700 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:50.474307 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b123b399-7d8b-4bd7-8ca8-5f6a14723700 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:50.480995 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-80c52231-22ee-44f7-bf95-113f57b4824a tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] 10.222.0.50 "GET /compute/v2.1/servers/3b33f103-9c08-4775-975c-3f815d99a70e" status: 200 len: 1318 microversion: 2.1 time: 0.501093 Aug 31 15:51:50.485370 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 374/764] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:49 2022] GET /compute/v2.1/servers/3b33f103-9c08-4775-975c-3f815d99a70e => generated 1318 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:50.498608 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7cafa400-c13e-4b0b-8a09-6a0c4bc00b36 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:50.499699 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7cafa400-c13e-4b0b-8a09-6a0c4bc00b36 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 236954ea-2791-477d-a92b-88e590593c63] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:50.514998 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cafa400-c13e-4b0b-8a09-6a0c4bc00b36 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:50.515919 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cafa400-c13e-4b0b-8a09-6a0c4bc00b36 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:50.518067 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cafa400-c13e-4b0b-8a09-6a0c4bc00b36 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:50.519064 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cafa400-c13e-4b0b-8a09-6a0c4bc00b36 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:50.520881 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cafa400-c13e-4b0b-8a09-6a0c4bc00b36 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:50.521806 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cafa400-c13e-4b0b-8a09-6a0c4bc00b36 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:50.533121 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-b123b399-7d8b-4bd7-8ca8-5f6a14723700 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Getting quotas for project 806480da4ae74a23aa20b86e3d6305f5. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:51:50.552332 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-b123b399-7d8b-4bd7-8ca8-5f6a14723700 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Getting quotas for user f1cd6d56b0de45179f1b46829536bbde and project 806480da4ae74a23aa20b86e3d6305f5. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:51:50.581651 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b123b399-7d8b-4bd7-8ca8-5f6a14723700 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:51:50.588327 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b123b399-7d8b-4bd7-8ca8-5f6a14723700 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] [instance: 14dbaad0-9a67-48c0-a58b-5d9997c078c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:51:50.718843 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b123b399-7d8b-4bd7-8ca8-5f6a14723700 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.048951 Aug 31 15:51:50.730140 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 391/765] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:51:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 2060 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 15:51:50.737217 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-465ab26b-bb13-493c-b8f7-39ac6229cbcd tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:50.743615 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-465ab26b-bb13-493c-b8f7-39ac6229cbcd tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] [instance: a21daf16-afa5-4cad-8f8c-6ca10636601d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:50.809137 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-465ab26b-bb13-493c-b8f7-39ac6229cbcd tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:50.809690 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-465ab26b-bb13-493c-b8f7-39ac6229cbcd tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:50.810170 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-465ab26b-bb13-493c-b8f7-39ac6229cbcd tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:50.810948 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-465ab26b-bb13-493c-b8f7-39ac6229cbcd tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:50.818520 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-465ab26b-bb13-493c-b8f7-39ac6229cbcd tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:50.819285 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-465ab26b-bb13-493c-b8f7-39ac6229cbcd tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:51.084764 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7cafa400-c13e-4b0b-8a09-6a0c4bc00b36 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:51.099181 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7cafa400-c13e-4b0b-8a09-6a0c4bc00b36 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63" status: 200 len: 1312 microversion: 2.1 time: 0.612210 Aug 31 15:51:51.100020 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 375/766] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:50 2022] GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63 => generated 1312 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:51.115989 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-ec20e8fb-66aa-49dd-a56d-a71833af77c5 req-c3ab9fa2-55a3-4c1d-a59f-06a7a347716f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a21daf16-afa5-4cad-8f8c-6ca10636601d", "tag": "9cf8063e-3763-4822-8435-e3dec32e2415"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:51:51.171287 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ec20e8fb-66aa-49dd-a56d-a71833af77c5 req-c3ab9fa2-55a3-4c1d-a59f-06a7a347716f service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:51.172125 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ec20e8fb-66aa-49dd-a56d-a71833af77c5 req-c3ab9fa2-55a3-4c1d-a59f-06a7a347716f service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:51.172728 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ec20e8fb-66aa-49dd-a56d-a71833af77c5 req-c3ab9fa2-55a3-4c1d-a59f-06a7a347716f service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:51.202035 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-ec20e8fb-66aa-49dd-a56d-a71833af77c5 req-c3ab9fa2-55a3-4c1d-a59f-06a7a347716f service nova] Creating event network-changed:9cf8063e-3763-4822-8435-e3dec32e2415 for instance a21daf16-afa5-4cad-8f8c-6ca10636601d on n-h2-833090-16 Aug 31 15:51:51.214575 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-ec20e8fb-66aa-49dd-a56d-a71833af77c5 req-c3ab9fa2-55a3-4c1d-a59f-06a7a347716f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109547 Aug 31 15:51:51.217588 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 376/767] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:51:51.233158 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-465ab26b-bb13-493c-b8f7-39ac6229cbcd tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6849c97bdb0948bc824cf5efe0f709a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e94509e985441f7b2802e6c6b164cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:51.243369 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a2e9ce44-8fa6-40a5-aeed-de4f6cefe823 tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:51.246289 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a2e9ce44-8fa6-40a5-aeed-de4f6cefe823 tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] [instance: 9cb430ca-c340-479a-b269-4672431bd393] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:51.260568 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-465ab26b-bb13-493c-b8f7-39ac6229cbcd tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] 10.222.0.50 "GET /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d" status: 200 len: 1321 microversion: 2.1 time: 0.531218 Aug 31 15:51:51.262285 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 392/768] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:50 2022] GET /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d => generated 1321 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:51.268848 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a2e9ce44-8fa6-40a5-aeed-de4f6cefe823 tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:51.269720 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a2e9ce44-8fa6-40a5-aeed-de4f6cefe823 tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:51.272036 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a2e9ce44-8fa6-40a5-aeed-de4f6cefe823 tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:51.273169 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a2e9ce44-8fa6-40a5-aeed-de4f6cefe823 tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:51.274665 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a2e9ce44-8fa6-40a5-aeed-de4f6cefe823 tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:51.275251 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a2e9ce44-8fa6-40a5-aeed-de4f6cefe823 tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:51.277333 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-25a06165-9296-485b-ab09-8b5d5c8ffd9b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:51.278704 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-25a06165-9296-485b-ab09-8b5d5c8ffd9b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:51.288196 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-25a06165-9296-485b-ab09-8b5d5c8ffd9b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:51.289152 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-25a06165-9296-485b-ab09-8b5d5c8ffd9b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:51.290032 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-25a06165-9296-485b-ab09-8b5d5c8ffd9b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:51.290994 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-25a06165-9296-485b-ab09-8b5d5c8ffd9b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:51.291710 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-25a06165-9296-485b-ab09-8b5d5c8ffd9b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:51.292981 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-25a06165-9296-485b-ab09-8b5d5c8ffd9b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:51.723016 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-25a06165-9296-485b-ab09-8b5d5c8ffd9b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:51.723503 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a2e9ce44-8fa6-40a5-aeed-de4f6cefe823 tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/9cb430ca-c340-479a-b269-4672431bd393" status: 200 len: 1620 microversion: 2.1 time: 0.501982 Aug 31 15:51:51.726014 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 377/769] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:51 2022] GET /compute/v2.1/servers/9cb430ca-c340-479a-b269-4672431bd393 => generated 1620 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:51.751378 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-25a06165-9296-485b-ab09-8b5d5c8ffd9b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:51.753861 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-25a06165-9296-485b-ab09-8b5d5c8ffd9b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:51.754759 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-246e1489-c709-4ee5-8e5f-80c9cd92a3fe tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:51.755689 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-246e1489-c709-4ee5-8e5f-80c9cd92a3fe tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] [instance: 14dbaad0-9a67-48c0-a58b-5d9997c078c5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:51.768947 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-25a06165-9296-485b-ab09-8b5d5c8ffd9b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035" status: 200 len: 1362 microversion: 2.25 time: 0.502614 Aug 31 15:51:51.780464 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 393/770] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:51:51 2022] GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035 => generated 1362 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:51:51.806320 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-640f0660-22db-4474-a871-10336611f44a tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:51.809499 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-640f0660-22db-4474-a871-10336611f44a tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] [instance: 3b33f103-9c08-4775-975c-3f815d99a70e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:51.833674 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-246e1489-c709-4ee5-8e5f-80c9cd92a3fe tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1cd6d56b0de45179f1b46829536bbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806480da4ae74a23aa20b86e3d6305f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:51.835618 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-640f0660-22db-4474-a871-10336611f44a tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:51.839477 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-640f0660-22db-4474-a871-10336611f44a tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:51.841404 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-640f0660-22db-4474-a871-10336611f44a tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:51.842925 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-246e1489-c709-4ee5-8e5f-80c9cd92a3fe tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] 10.222.0.50 "GET /compute/v2.1/servers/14dbaad0-9a67-48c0-a58b-5d9997c078c5" status: 200 len: 1216 microversion: 2.1 time: 0.104938 Aug 31 15:51:51.850142 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-640f0660-22db-4474-a871-10336611f44a tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:51.850958 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 378/771] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:51 2022] GET /compute/v2.1/servers/14dbaad0-9a67-48c0-a58b-5d9997c078c5 => generated 1216 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:51.851133 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-640f0660-22db-4474-a871-10336611f44a tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:51.851133 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-640f0660-22db-4474-a871-10336611f44a tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:51.958497 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-86b7dae5-d5d4-424d-a4f3-191e069dd890 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-753651958", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "848b21b2-98a0-4e70-a27c-08d390d73ae6"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:51:52.024893 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-86b7dae5-d5d4-424d-a4f3-191e069dd890 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] validate_networks() for None {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:51:52.105619 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-640f0660-22db-4474-a871-10336611f44a tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704d7c428d3e4a1bbe5fb78485415214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a08078ba5a04c31b6cc63dee67be8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:52.115637 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-640f0660-22db-4474-a871-10336611f44a tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] 10.222.0.50 "GET /compute/v2.1/servers/3b33f103-9c08-4775-975c-3f815d99a70e" status: 200 len: 1318 microversion: 2.1 time: 0.334060 Aug 31 15:51:52.119755 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 394/772] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:51 2022] GET /compute/v2.1/servers/3b33f103-9c08-4775-975c-3f815d99a70e => generated 1318 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:52.159500 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fce45aa3-0f36-475b-a2be-1208dcbb2428 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:52.160336 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fce45aa3-0f36-475b-a2be-1208dcbb2428 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 236954ea-2791-477d-a92b-88e590593c63] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:52.180044 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fce45aa3-0f36-475b-a2be-1208dcbb2428 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:52.180825 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fce45aa3-0f36-475b-a2be-1208dcbb2428 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:52.183565 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fce45aa3-0f36-475b-a2be-1208dcbb2428 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:52.184447 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fce45aa3-0f36-475b-a2be-1208dcbb2428 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:52.186576 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fce45aa3-0f36-475b-a2be-1208dcbb2428 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:52.188581 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fce45aa3-0f36-475b-a2be-1208dcbb2428 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:52.920326 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-fce45aa3-0f36-475b-a2be-1208dcbb2428 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:52.941737 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fce45aa3-0f36-475b-a2be-1208dcbb2428 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63" status: 200 len: 1312 microversion: 2.1 time: 0.795347 Aug 31 15:51:52.943091 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 395/773] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:52 2022] GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63 => generated 1312 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:52.948560 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e5a471ce-2ae1-414b-9ad9-b9b574076233 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:52.955588 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e5a471ce-2ae1-414b-9ad9-b9b574076233 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] [instance: a21daf16-afa5-4cad-8f8c-6ca10636601d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:52.968617 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e5a471ce-2ae1-414b-9ad9-b9b574076233 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:52.969164 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e5a471ce-2ae1-414b-9ad9-b9b574076233 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:52.969676 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e5a471ce-2ae1-414b-9ad9-b9b574076233 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:52.970727 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e5a471ce-2ae1-414b-9ad9-b9b574076233 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:52.971322 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e5a471ce-2ae1-414b-9ad9-b9b574076233 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:52.971754 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e5a471ce-2ae1-414b-9ad9-b9b574076233 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:53.084939 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:51:53.197126 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-86b7dae5-d5d4-424d-a4f3-191e069dd890 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:51:53.197623 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-86b7dae5-d5d4-424d-a4f3-191e069dd890 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:51:53.198559 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-86b7dae5-d5d4-424d-a4f3-191e069dd890 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:51:53.199344 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-86b7dae5-d5d4-424d-a4f3-191e069dd890 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:51:53.200288 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-86b7dae5-d5d4-424d-a4f3-191e069dd890 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:51:53.215821 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86b7dae5-d5d4-424d-a4f3-191e069dd890 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:53.216464 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86b7dae5-d5d4-424d-a4f3-191e069dd890 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:53.217161 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86b7dae5-d5d4-424d-a4f3-191e069dd890 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:53.218803 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86b7dae5-d5d4-424d-a4f3-191e069dd890 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:53.219339 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86b7dae5-d5d4-424d-a4f3-191e069dd890 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:53.219936 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86b7dae5-d5d4-424d-a4f3-191e069dd890 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:53.252368 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e5a471ce-2ae1-414b-9ad9-b9b574076233 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6849c97bdb0948bc824cf5efe0f709a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e94509e985441f7b2802e6c6b164cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:53.253701 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-86b7dae5-d5d4-424d-a4f3-191e069dd890 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Getting quotas for project 7db749eb0a764fa0bb29ddc4abd6d245. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:51:53.261273 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e5a471ce-2ae1-414b-9ad9-b9b574076233 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] 10.222.0.50 "GET /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d" status: 200 len: 1321 microversion: 2.1 time: 0.316777 Aug 31 15:51:53.262858 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 396/774] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:52 2022] GET /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d => generated 1321 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:53.265423 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-86b7dae5-d5d4-424d-a4f3-191e069dd890 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Getting quotas for user fe647be03cef4e9c86b4fd6e703d0de1 and project 7db749eb0a764fa0bb29ddc4abd6d245. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:51:53.269034 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2bb984d6-f167-4ded-92d8-d4dd3734e8b7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:53.269905 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2bb984d6-f167-4ded-92d8-d4dd3734e8b7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:53.277036 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2bb984d6-f167-4ded-92d8-d4dd3734e8b7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:53.278231 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2bb984d6-f167-4ded-92d8-d4dd3734e8b7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:53.278896 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2bb984d6-f167-4ded-92d8-d4dd3734e8b7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:53.279824 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2bb984d6-f167-4ded-92d8-d4dd3734e8b7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:53.280349 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-86b7dae5-d5d4-424d-a4f3-191e069dd890 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:51:53.280763 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2bb984d6-f167-4ded-92d8-d4dd3734e8b7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:53.282005 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2bb984d6-f167-4ded-92d8-d4dd3734e8b7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:53.285491 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-86b7dae5-d5d4-424d-a4f3-191e069dd890 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 4770c3f5-5b3d-40da-9507-85b77d673094] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:51:53.352135 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-86b7dae5-d5d4-424d-a4f3-191e069dd890 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.398127 Aug 31 15:51:53.358682 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 379/775] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:51:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1400 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 15:51:53.358682 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-76844130-dd6a-48ea-81a0-4ac26d0c2476 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:53.359177 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-76844130-dd6a-48ea-81a0-4ac26d0c2476 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] [instance: 14dbaad0-9a67-48c0-a58b-5d9997c078c5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:53.367668 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76844130-dd6a-48ea-81a0-4ac26d0c2476 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:53.368474 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76844130-dd6a-48ea-81a0-4ac26d0c2476 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:53.369493 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76844130-dd6a-48ea-81a0-4ac26d0c2476 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:53.373139 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76844130-dd6a-48ea-81a0-4ac26d0c2476 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:53.375100 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76844130-dd6a-48ea-81a0-4ac26d0c2476 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:53.376098 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76844130-dd6a-48ea-81a0-4ac26d0c2476 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:53.404804 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:51:53.509647 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-76844130-dd6a-48ea-81a0-4ac26d0c2476 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1cd6d56b0de45179f1b46829536bbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806480da4ae74a23aa20b86e3d6305f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:53.536686 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-76844130-dd6a-48ea-81a0-4ac26d0c2476 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] 10.222.0.50 "GET /compute/v2.1/servers/14dbaad0-9a67-48c0-a58b-5d9997c078c5" status: 200 len: 1220 microversion: 2.1 time: 0.182076 Aug 31 15:51:53.542722 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2bb984d6-f167-4ded-92d8-d4dd3734e8b7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:53.546587 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 380/776] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:53 2022] GET /compute/v2.1/servers/14dbaad0-9a67-48c0-a58b-5d9997c078c5 => generated 1220 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:53.552336 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2bb984d6-f167-4ded-92d8-d4dd3734e8b7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:53.560796 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2bb984d6-f167-4ded-92d8-d4dd3734e8b7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:53.562377 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2bb984d6-f167-4ded-92d8-d4dd3734e8b7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035" status: 200 len: 1362 microversion: 2.25 time: 0.297680 Aug 31 15:51:53.563994 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-51a1e8ad-f6d2-4c27-b66f-e9966afdcb44 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:53.563994 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-51a1e8ad-f6d2-4c27-b66f-e9966afdcb44 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] [instance: 3b33f103-9c08-4775-975c-3f815d99a70e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:53.566765 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 397/777] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:51:53 2022] GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035 => generated 1362 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:51:53.577162 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-36e3f296-4394-4d1c-bb01-89364db88197 req-d94054be-9cf1-47de-98e0-503aaf2caa32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "236954ea-2791-477d-a92b-88e590593c63", "tag": "741689b8-43aa-4b92-9c42-308fa64c312a"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:51:53.588947 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-51a1e8ad-f6d2-4c27-b66f-e9966afdcb44 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:53.589449 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-51a1e8ad-f6d2-4c27-b66f-e9966afdcb44 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:53.589878 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-51a1e8ad-f6d2-4c27-b66f-e9966afdcb44 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:53.590734 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-51a1e8ad-f6d2-4c27-b66f-e9966afdcb44 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:53.591577 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-51a1e8ad-f6d2-4c27-b66f-e9966afdcb44 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:53.591998 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-51a1e8ad-f6d2-4c27-b66f-e9966afdcb44 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:53.640236 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-36e3f296-4394-4d1c-bb01-89364db88197 req-d94054be-9cf1-47de-98e0-503aaf2caa32 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:53.641995 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-36e3f296-4394-4d1c-bb01-89364db88197 req-d94054be-9cf1-47de-98e0-503aaf2caa32 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:53.646245 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-36e3f296-4394-4d1c-bb01-89364db88197 req-d94054be-9cf1-47de-98e0-503aaf2caa32 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:53.664914 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-36e3f296-4394-4d1c-bb01-89364db88197 req-d94054be-9cf1-47de-98e0-503aaf2caa32 service nova] Creating event network-changed:741689b8-43aa-4b92-9c42-308fa64c312a for instance 236954ea-2791-477d-a92b-88e590593c63 on n-h1-833090-16 Aug 31 15:51:53.671815 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-36e3f296-4394-4d1c-bb01-89364db88197 req-d94054be-9cf1-47de-98e0-503aaf2caa32 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100217 Aug 31 15:51:53.673887 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 398/778] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:51:53.685894 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2a770f72-80c4-438a-8cb1-18e1e37578fc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:53.691131 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2a770f72-80c4-438a-8cb1-18e1e37578fc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 4770c3f5-5b3d-40da-9507-85b77d673094] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:53.844093 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2a770f72-80c4-438a-8cb1-18e1e37578fc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:53.854415 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2a770f72-80c4-438a-8cb1-18e1e37578fc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/4770c3f5-5b3d-40da-9507-85b77d673094" status: 200 len: 1216 microversion: 2.1 time: 0.176798 Aug 31 15:51:53.855258 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 399/779] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:53 2022] GET /compute/v2.1/servers/4770c3f5-5b3d-40da-9507-85b77d673094 => generated 1216 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:53.877624 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-51a1e8ad-f6d2-4c27-b66f-e9966afdcb44 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704d7c428d3e4a1bbe5fb78485415214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a08078ba5a04c31b6cc63dee67be8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:53.888279 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-51a1e8ad-f6d2-4c27-b66f-e9966afdcb44 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] 10.222.0.50 "GET /compute/v2.1/servers/3b33f103-9c08-4775-975c-3f815d99a70e" status: 200 len: 1318 microversion: 2.1 time: 0.340204 Aug 31 15:51:53.894150 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 381/780] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:53 2022] GET /compute/v2.1/servers/3b33f103-9c08-4775-975c-3f815d99a70e => generated 1318 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:53.975214 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4ba2a5d1-ef35-4e1c-88b6-acfcf54660d7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:53.976760 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4ba2a5d1-ef35-4e1c-88b6-acfcf54660d7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 236954ea-2791-477d-a92b-88e590593c63] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:54.008601 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4ba2a5d1-ef35-4e1c-88b6-acfcf54660d7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:54.010769 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4ba2a5d1-ef35-4e1c-88b6-acfcf54660d7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:54.012233 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4ba2a5d1-ef35-4e1c-88b6-acfcf54660d7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:54.012794 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4ba2a5d1-ef35-4e1c-88b6-acfcf54660d7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:54.013501 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4ba2a5d1-ef35-4e1c-88b6-acfcf54660d7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:54.014165 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4ba2a5d1-ef35-4e1c-88b6-acfcf54660d7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:54.205241 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4ba2a5d1-ef35-4e1c-88b6-acfcf54660d7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:54.214373 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4ba2a5d1-ef35-4e1c-88b6-acfcf54660d7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63" status: 200 len: 1312 microversion: 2.1 time: 0.243217 Aug 31 15:51:54.215006 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 400/781] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:53 2022] GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63 => generated 1312 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:54.292206 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-96f4a667-d133-4a8b-8adb-2e1fafab7f93 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:54.292825 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-96f4a667-d133-4a8b-8adb-2e1fafab7f93 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] [instance: a21daf16-afa5-4cad-8f8c-6ca10636601d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:54.299993 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-96f4a667-d133-4a8b-8adb-2e1fafab7f93 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:54.300696 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-96f4a667-d133-4a8b-8adb-2e1fafab7f93 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:54.301339 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-96f4a667-d133-4a8b-8adb-2e1fafab7f93 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:54.302124 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-96f4a667-d133-4a8b-8adb-2e1fafab7f93 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:54.302926 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-96f4a667-d133-4a8b-8adb-2e1fafab7f93 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:54.303558 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-96f4a667-d133-4a8b-8adb-2e1fafab7f93 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:54.447502 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-96f4a667-d133-4a8b-8adb-2e1fafab7f93 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6849c97bdb0948bc824cf5efe0f709a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e94509e985441f7b2802e6c6b164cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:54.456779 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-96f4a667-d133-4a8b-8adb-2e1fafab7f93 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] 10.222.0.50 "GET /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d" status: 200 len: 1321 microversion: 2.1 time: 0.168500 Aug 31 15:51:54.457365 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 382/782] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:54 2022] GET /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:54.571715 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c8c8682e-0997-4ae2-85a4-519cd7bb5df4 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:54.572531 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c8c8682e-0997-4ae2-85a4-519cd7bb5df4 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] [instance: 14dbaad0-9a67-48c0-a58b-5d9997c078c5] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:54.579868 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8c8682e-0997-4ae2-85a4-519cd7bb5df4 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:54.580395 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8c8682e-0997-4ae2-85a4-519cd7bb5df4 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:54.580802 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8c8682e-0997-4ae2-85a4-519cd7bb5df4 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:54.581504 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8c8682e-0997-4ae2-85a4-519cd7bb5df4 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:54.581953 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8c8682e-0997-4ae2-85a4-519cd7bb5df4 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:54.582386 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8c8682e-0997-4ae2-85a4-519cd7bb5df4 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:54.603882 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1853b172-817a-46b9-861a-9140e72f5455 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:54.609509 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1853b172-817a-46b9-861a-9140e72f5455 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:54.611545 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1853b172-817a-46b9-861a-9140e72f5455 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:54.612033 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1853b172-817a-46b9-861a-9140e72f5455 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:54.612465 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1853b172-817a-46b9-861a-9140e72f5455 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:54.614119 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1853b172-817a-46b9-861a-9140e72f5455 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:54.614119 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1853b172-817a-46b9-861a-9140e72f5455 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:54.614119 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1853b172-817a-46b9-861a-9140e72f5455 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:54.674657 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c8c8682e-0997-4ae2-85a4-519cd7bb5df4 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1cd6d56b0de45179f1b46829536bbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806480da4ae74a23aa20b86e3d6305f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:54.685166 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c8c8682e-0997-4ae2-85a4-519cd7bb5df4 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] 10.222.0.50 "GET /compute/v2.1/servers/14dbaad0-9a67-48c0-a58b-5d9997c078c5" status: 200 len: 1220 microversion: 2.1 time: 0.118956 Aug 31 15:51:54.685771 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 401/783] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:54 2022] GET /compute/v2.1/servers/14dbaad0-9a67-48c0-a58b-5d9997c078c5 => generated 1220 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:54.781586 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1853b172-817a-46b9-861a-9140e72f5455 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:54.790990 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1853b172-817a-46b9-861a-9140e72f5455 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:54.792437 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1853b172-817a-46b9-861a-9140e72f5455 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:54.793565 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1853b172-817a-46b9-861a-9140e72f5455 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035" status: 200 len: 1362 microversion: 2.25 time: 0.194420 Aug 31 15:51:54.794143 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 383/784] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:51:54 2022] GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035 => generated 1362 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:51:54.893090 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7792675b-66e4-4d1b-b5a2-a81ca1485014 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:54.893866 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7792675b-66e4-4d1b-b5a2-a81ca1485014 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 4770c3f5-5b3d-40da-9507-85b77d673094] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:54.901504 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7792675b-66e4-4d1b-b5a2-a81ca1485014 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:54.903429 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7792675b-66e4-4d1b-b5a2-a81ca1485014 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:54.910656 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-428ae815-3593-4e4c-9dcf-215ccd35d1a8 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:54.911318 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-428ae815-3593-4e4c-9dcf-215ccd35d1a8 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] [instance: 3b33f103-9c08-4775-975c-3f815d99a70e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:54.918404 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7792675b-66e4-4d1b-b5a2-a81ca1485014 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:54.919320 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7792675b-66e4-4d1b-b5a2-a81ca1485014 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:54.920617 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7792675b-66e4-4d1b-b5a2-a81ca1485014 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:54.922661 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7792675b-66e4-4d1b-b5a2-a81ca1485014 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:54.931673 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-428ae815-3593-4e4c-9dcf-215ccd35d1a8 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:54.932178 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-428ae815-3593-4e4c-9dcf-215ccd35d1a8 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:54.932636 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-428ae815-3593-4e4c-9dcf-215ccd35d1a8 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:54.933355 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-428ae815-3593-4e4c-9dcf-215ccd35d1a8 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:54.933812 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-428ae815-3593-4e4c-9dcf-215ccd35d1a8 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:54.934469 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-428ae815-3593-4e4c-9dcf-215ccd35d1a8 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:55.144148 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7792675b-66e4-4d1b-b5a2-a81ca1485014 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:55.169866 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7792675b-66e4-4d1b-b5a2-a81ca1485014 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/4770c3f5-5b3d-40da-9507-85b77d673094" status: 200 len: 1220 microversion: 2.1 time: 0.280060 Aug 31 15:51:55.190477 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 402/785] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:54 2022] GET /compute/v2.1/servers/4770c3f5-5b3d-40da-9507-85b77d673094 => generated 1220 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:55.233447 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-428ae815-3593-4e4c-9dcf-215ccd35d1a8 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704d7c428d3e4a1bbe5fb78485415214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a08078ba5a04c31b6cc63dee67be8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:55.239818 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b4bbd864-b06b-4470-be15-13a65e5baa1a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:55.240605 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b4bbd864-b06b-4470-be15-13a65e5baa1a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 236954ea-2791-477d-a92b-88e590593c63] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:55.248642 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-428ae815-3593-4e4c-9dcf-215ccd35d1a8 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] 10.222.0.50 "GET /compute/v2.1/servers/3b33f103-9c08-4775-975c-3f815d99a70e" status: 200 len: 1318 microversion: 2.1 time: 0.341993 Aug 31 15:51:55.249247 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 384/786] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:54 2022] GET /compute/v2.1/servers/3b33f103-9c08-4775-975c-3f815d99a70e => generated 1318 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:51:55.256499 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b4bbd864-b06b-4470-be15-13a65e5baa1a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:55.261314 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b4bbd864-b06b-4470-be15-13a65e5baa1a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:55.262384 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b4bbd864-b06b-4470-be15-13a65e5baa1a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:55.263338 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b4bbd864-b06b-4470-be15-13a65e5baa1a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:55.263985 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b4bbd864-b06b-4470-be15-13a65e5baa1a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:55.265721 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b4bbd864-b06b-4470-be15-13a65e5baa1a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:55.479304 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5a33e13d-58c0-42e3-98b5-dffa217952bd tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:55.480507 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5a33e13d-58c0-42e3-98b5-dffa217952bd tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] [instance: a21daf16-afa5-4cad-8f8c-6ca10636601d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:55.501752 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a33e13d-58c0-42e3-98b5-dffa217952bd tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:55.502469 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a33e13d-58c0-42e3-98b5-dffa217952bd tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:55.503093 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a33e13d-58c0-42e3-98b5-dffa217952bd tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:55.505515 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a33e13d-58c0-42e3-98b5-dffa217952bd tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:55.506343 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a33e13d-58c0-42e3-98b5-dffa217952bd tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:55.507795 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a33e13d-58c0-42e3-98b5-dffa217952bd tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:55.635466 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b4bbd864-b06b-4470-be15-13a65e5baa1a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:55.643801 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b4bbd864-b06b-4470-be15-13a65e5baa1a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63" status: 200 len: 1312 microversion: 2.1 time: 0.410836 Aug 31 15:51:55.647267 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 403/787] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:55 2022] GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63 => generated 1312 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:55.654305 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-744b62d9-c320-4f9c-9c1b-b11f59afec49 req-fc54b905-7f5e-48ca-9849-8b8fa8bd76b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b33f103-9c08-4775-975c-3f815d99a70e", "name": "network-vif-plugged", "status": "completed", "tag": "6972e09f-ac79-4712-9a38-b8d3859e2423"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:51:55.677820 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-744b62d9-c320-4f9c-9c1b-b11f59afec49 req-fc54b905-7f5e-48ca-9849-8b8fa8bd76b2 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:55.681146 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-744b62d9-c320-4f9c-9c1b-b11f59afec49 req-fc54b905-7f5e-48ca-9849-8b8fa8bd76b2 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:55.681647 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-744b62d9-c320-4f9c-9c1b-b11f59afec49 req-fc54b905-7f5e-48ca-9849-8b8fa8bd76b2 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:55.719865 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-744b62d9-c320-4f9c-9c1b-b11f59afec49 req-fc54b905-7f5e-48ca-9849-8b8fa8bd76b2 service nova] Creating event network-vif-plugged:6972e09f-ac79-4712-9a38-b8d3859e2423 for instance 3b33f103-9c08-4775-975c-3f815d99a70e on n-h1-833090-16 Aug 31 15:51:55.734521 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-744b62d9-c320-4f9c-9c1b-b11f59afec49 req-fc54b905-7f5e-48ca-9849-8b8fa8bd76b2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084959 Aug 31 15:51:55.735136 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 404/788] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:51:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:51:55.753315 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5a33e13d-58c0-42e3-98b5-dffa217952bd tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6849c97bdb0948bc824cf5efe0f709a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e94509e985441f7b2802e6c6b164cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:55.755195 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5f78fdba-894b-485a-8498-677f24bda238 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:55.755984 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5f78fdba-894b-485a-8498-677f24bda238 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] [instance: 14dbaad0-9a67-48c0-a58b-5d9997c078c5] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:55.767289 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5a33e13d-58c0-42e3-98b5-dffa217952bd tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] 10.222.0.50 "GET /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d" status: 200 len: 1321 microversion: 2.1 time: 0.292194 Aug 31 15:51:55.768475 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 385/789] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:55 2022] GET /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d => generated 1321 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:55.785196 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5f78fdba-894b-485a-8498-677f24bda238 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:55.786329 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5f78fdba-894b-485a-8498-677f24bda238 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:55.787526 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5f78fdba-894b-485a-8498-677f24bda238 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:55.788595 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5f78fdba-894b-485a-8498-677f24bda238 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:55.789250 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5f78fdba-894b-485a-8498-677f24bda238 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:55.789859 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5f78fdba-894b-485a-8498-677f24bda238 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:55.816705 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d4671472-76e2-447d-ab16-151ef7bf362f tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:55.818033 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d4671472-76e2-447d-ab16-151ef7bf362f tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:55.825520 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4671472-76e2-447d-ab16-151ef7bf362f tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:55.829918 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4671472-76e2-447d-ab16-151ef7bf362f tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:55.830585 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4671472-76e2-447d-ab16-151ef7bf362f tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:55.831986 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4671472-76e2-447d-ab16-151ef7bf362f tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:55.833340 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4671472-76e2-447d-ab16-151ef7bf362f tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:55.834261 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4671472-76e2-447d-ab16-151ef7bf362f tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:55.929005 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5f78fdba-894b-485a-8498-677f24bda238 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1cd6d56b0de45179f1b46829536bbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806480da4ae74a23aa20b86e3d6305f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:55.938544 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5f78fdba-894b-485a-8498-677f24bda238 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] 10.222.0.50 "GET /compute/v2.1/servers/14dbaad0-9a67-48c0-a58b-5d9997c078c5" status: 200 len: 1212 microversion: 2.1 time: 0.199275 Aug 31 15:51:55.939268 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 405/790] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:55 2022] GET /compute/v2.1/servers/14dbaad0-9a67-48c0-a58b-5d9997c078c5 => generated 1212 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:56.045025 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d4671472-76e2-447d-ab16-151ef7bf362f tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:56.055750 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d4671472-76e2-447d-ab16-151ef7bf362f tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:56.057528 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d4671472-76e2-447d-ab16-151ef7bf362f tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:56.059127 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d4671472-76e2-447d-ab16-151ef7bf362f tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035" status: 200 len: 1556 microversion: 2.25 time: 0.246998 Aug 31 15:51:56.060218 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 386/791] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:51:55 2022] GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035 => generated 1556 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:51:56.084930 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-cb7e2db1-452c-4be7-b9da-38c4c9053991 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:56.085562 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-cb7e2db1-452c-4be7-b9da-38c4c9053991 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] [instance: 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:56.095986 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb7e2db1-452c-4be7-b9da-38c4c9053991 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:56.096828 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb7e2db1-452c-4be7-b9da-38c4c9053991 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:56.097540 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb7e2db1-452c-4be7-b9da-38c4c9053991 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:56.098482 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb7e2db1-452c-4be7-b9da-38c4c9053991 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:56.099157 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb7e2db1-452c-4be7-b9da-38c4c9053991 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:56.099786 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb7e2db1-452c-4be7-b9da-38c4c9053991 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:56.194727 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4156edb3-3bc3-44bb-8ba7-b21c5258cd52 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:56.195700 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4156edb3-3bc3-44bb-8ba7-b21c5258cd52 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 4770c3f5-5b3d-40da-9507-85b77d673094] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:56.211311 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4156edb3-3bc3-44bb-8ba7-b21c5258cd52 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:56.215073 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4156edb3-3bc3-44bb-8ba7-b21c5258cd52 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:56.215719 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4156edb3-3bc3-44bb-8ba7-b21c5258cd52 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:56.217610 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4156edb3-3bc3-44bb-8ba7-b21c5258cd52 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:56.218755 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4156edb3-3bc3-44bb-8ba7-b21c5258cd52 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:56.219335 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4156edb3-3bc3-44bb-8ba7-b21c5258cd52 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:56.341816 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4156edb3-3bc3-44bb-8ba7-b21c5258cd52 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:56.349868 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4156edb3-3bc3-44bb-8ba7-b21c5258cd52 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/4770c3f5-5b3d-40da-9507-85b77d673094" status: 200 len: 1212 microversion: 2.1 time: 0.162209 Aug 31 15:51:56.366584 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 387/792] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:56 2022] GET /compute/v2.1/servers/4770c3f5-5b3d-40da-9507-85b77d673094 => generated 1212 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:56.367089 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9d93f3ae-31ba-42bf-87b1-f0d05455b2cf tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:56.367855 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9d93f3ae-31ba-42bf-87b1-f0d05455b2cf tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] [instance: 3b33f103-9c08-4775-975c-3f815d99a70e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:56.385612 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d93f3ae-31ba-42bf-87b1-f0d05455b2cf tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:56.386206 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d93f3ae-31ba-42bf-87b1-f0d05455b2cf tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:56.386588 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d93f3ae-31ba-42bf-87b1-f0d05455b2cf tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:56.387316 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d93f3ae-31ba-42bf-87b1-f0d05455b2cf tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:56.387763 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d93f3ae-31ba-42bf-87b1-f0d05455b2cf tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:56.388185 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d93f3ae-31ba-42bf-87b1-f0d05455b2cf tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:56.420780 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-cb7e2db1-452c-4be7-b9da-38c4c9053991 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lazy-loading 'services' on Instance uuid 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:51:56.437074 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-cb7e2db1-452c-4be7-b9da-38c4c9053991 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035" status: 200 len: 2051 microversion: 2.25 time: 0.358240 Aug 31 15:51:56.441480 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 406/793] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:51:56 2022] GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035 => generated 2051 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:51:56.461537 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-64ec0232-5e3f-46ce-b053-d105599a3531 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:56.462545 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-64ec0232-5e3f-46ce-b053-d105599a3531 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] [instance: 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:56.471065 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-64ec0232-5e3f-46ce-b053-d105599a3531 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:56.471849 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-64ec0232-5e3f-46ce-b053-d105599a3531 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:56.472381 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-64ec0232-5e3f-46ce-b053-d105599a3531 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:56.473681 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-64ec0232-5e3f-46ce-b053-d105599a3531 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:56.474282 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-64ec0232-5e3f-46ce-b053-d105599a3531 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:56.474897 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-64ec0232-5e3f-46ce-b053-d105599a3531 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:56.500537 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=100 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:51:56.747289 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-64ec0232-5e3f-46ce-b053-d105599a3531 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lazy-loading 'services' on Instance uuid 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:51:56.754494 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9d93f3ae-31ba-42bf-87b1-f0d05455b2cf tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704d7c428d3e4a1bbe5fb78485415214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a08078ba5a04c31b6cc63dee67be8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:56.766639 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9d93f3ae-31ba-42bf-87b1-f0d05455b2cf tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] 10.222.0.50 "GET /compute/v2.1/servers/3b33f103-9c08-4775-975c-3f815d99a70e" status: 200 len: 1318 microversion: 2.1 time: 0.411886 Aug 31 15:51:56.771693 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 388/794] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:56 2022] GET /compute/v2.1/servers/3b33f103-9c08-4775-975c-3f815d99a70e => generated 1318 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:56.785307 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c2d73072-2224-4220-b61a-51653b3c8754 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:56.786432 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c2d73072-2224-4220-b61a-51653b3c8754 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 236954ea-2791-477d-a92b-88e590593c63] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:56.792892 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-64ec0232-5e3f-46ce-b053-d105599a3531 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035" status: 200 len: 2051 microversion: 2.25 time: 0.335804 Aug 31 15:51:56.798489 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 407/795] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:51:56 2022] GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035 => generated 2051 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 15:51:56.800210 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2d73072-2224-4220-b61a-51653b3c8754 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:56.800740 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2d73072-2224-4220-b61a-51653b3c8754 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:56.801429 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2d73072-2224-4220-b61a-51653b3c8754 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:56.802242 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2d73072-2224-4220-b61a-51653b3c8754 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:56.802725 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2d73072-2224-4220-b61a-51653b3c8754 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:56.803151 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2d73072-2224-4220-b61a-51653b3c8754 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:56.805810 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5db8f7dc-eac6-4ead-948a-ccdc22364c67 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:56.806504 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5db8f7dc-eac6-4ead-948a-ccdc22364c67 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] [instance: a21daf16-afa5-4cad-8f8c-6ca10636601d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:56.813081 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5db8f7dc-eac6-4ead-948a-ccdc22364c67 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:56.813925 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5db8f7dc-eac6-4ead-948a-ccdc22364c67 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:56.814628 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5db8f7dc-eac6-4ead-948a-ccdc22364c67 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:56.815583 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5db8f7dc-eac6-4ead-948a-ccdc22364c67 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:56.816250 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5db8f7dc-eac6-4ead-948a-ccdc22364c67 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:56.817498 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5db8f7dc-eac6-4ead-948a-ccdc22364c67 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:57.067204 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5db8f7dc-eac6-4ead-948a-ccdc22364c67 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6849c97bdb0948bc824cf5efe0f709a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e94509e985441f7b2802e6c6b164cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:57.081895 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c2d73072-2224-4220-b61a-51653b3c8754 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:57.090178 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5db8f7dc-eac6-4ead-948a-ccdc22364c67 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] 10.222.0.50 "GET /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d" status: 200 len: 1321 microversion: 2.1 time: 0.290166 Aug 31 15:51:57.095361 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 408/796] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:56 2022] GET /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d => generated 1321 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:57.107325 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f9572133-6761-49a8-b7f2-6e334e2737d8 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:57.116424 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c2d73072-2224-4220-b61a-51653b3c8754 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63" status: 200 len: 1312 microversion: 2.1 time: 0.342901 Aug 31 15:51:57.117061 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 389/797] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:56 2022] GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63 => generated 1312 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:57.118182 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f9572133-6761-49a8-b7f2-6e334e2737d8 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:57.120077 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f9572133-6761-49a8-b7f2-6e334e2737d8 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:57.120854 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f9572133-6761-49a8-b7f2-6e334e2737d8 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:57.147748 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f9572133-6761-49a8-b7f2-6e334e2737d8 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:57.149662 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9060a400-e881-44a1-8da3-2018d3708d6f tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:57.150524 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9060a400-e881-44a1-8da3-2018d3708d6f tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] [instance: 14dbaad0-9a67-48c0-a58b-5d9997c078c5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:57.151384 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f9572133-6761-49a8-b7f2-6e334e2737d8 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:57.154670 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f9572133-6761-49a8-b7f2-6e334e2737d8 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:57.166823 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9060a400-e881-44a1-8da3-2018d3708d6f tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:57.167224 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9060a400-e881-44a1-8da3-2018d3708d6f tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:57.167650 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9060a400-e881-44a1-8da3-2018d3708d6f tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:57.170288 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9060a400-e881-44a1-8da3-2018d3708d6f tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:57.171123 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9060a400-e881-44a1-8da3-2018d3708d6f tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:57.171708 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9060a400-e881-44a1-8da3-2018d3708d6f tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:57.193501 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f9572133-6761-49a8-b7f2-6e334e2737d8 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.096756 Aug 31 15:51:57.194808 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 409/798] 10.222.0.50 () {60 vars in 1217 bytes} [Wed Aug 31 15:51:57 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:51:57.207844 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a8569f3f-8f43-4dab-bef6-f6e24c750c92 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:51:57.208854 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a8569f3f-8f43-4dab-bef6-f6e24c750c92 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] [instance: 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:57.216858 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a8569f3f-8f43-4dab-bef6-f6e24c750c92 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:57.217606 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a8569f3f-8f43-4dab-bef6-f6e24c750c92 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:57.218928 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a8569f3f-8f43-4dab-bef6-f6e24c750c92 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:57.220444 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a8569f3f-8f43-4dab-bef6-f6e24c750c92 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:57.221346 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a8569f3f-8f43-4dab-bef6-f6e24c750c92 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:57.221923 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a8569f3f-8f43-4dab-bef6-f6e24c750c92 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:57.257218 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9060a400-e881-44a1-8da3-2018d3708d6f tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1cd6d56b0de45179f1b46829536bbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806480da4ae74a23aa20b86e3d6305f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:57.268346 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9060a400-e881-44a1-8da3-2018d3708d6f tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] 10.222.0.50 "GET /compute/v2.1/servers/14dbaad0-9a67-48c0-a58b-5d9997c078c5" status: 200 len: 1212 microversion: 2.1 time: 0.150058 Aug 31 15:51:57.269631 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 390/799] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:57 2022] GET /compute/v2.1/servers/14dbaad0-9a67-48c0-a58b-5d9997c078c5 => generated 1212 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:57.339034 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a8569f3f-8f43-4dab-bef6-f6e24c750c92 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035/action" status: 202 len: 0 microversion: 2.25 time: 0.135924 Aug 31 15:51:57.340562 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 410/800] 10.222.0.50 () {62 vars in 1319 bytes} [Wed Aug 31 15:51:57 2022] POST /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:51:57.349103 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0bb5fd86-c37f-4028-a58f-ddfb7ff918fc tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:57.349990 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0bb5fd86-c37f-4028-a58f-ddfb7ff918fc tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] [instance: 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:57.368006 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0bb5fd86-c37f-4028-a58f-ddfb7ff918fc tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:57.368903 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0bb5fd86-c37f-4028-a58f-ddfb7ff918fc tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:57.369351 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0bb5fd86-c37f-4028-a58f-ddfb7ff918fc tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:57.370138 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0bb5fd86-c37f-4028-a58f-ddfb7ff918fc tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:57.370616 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0bb5fd86-c37f-4028-a58f-ddfb7ff918fc tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:57.371035 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0bb5fd86-c37f-4028-a58f-ddfb7ff918fc tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:57.382082 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-04d6bf7d-68c4-4e17-9357-22b54d3e70cb tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:57.382861 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-04d6bf7d-68c4-4e17-9357-22b54d3e70cb tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 4770c3f5-5b3d-40da-9507-85b77d673094] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:57.395761 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-04d6bf7d-68c4-4e17-9357-22b54d3e70cb tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:57.396763 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-04d6bf7d-68c4-4e17-9357-22b54d3e70cb tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:57.397274 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-04d6bf7d-68c4-4e17-9357-22b54d3e70cb tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:57.398384 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-04d6bf7d-68c4-4e17-9357-22b54d3e70cb tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:57.401157 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-04d6bf7d-68c4-4e17-9357-22b54d3e70cb tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:57.401157 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-04d6bf7d-68c4-4e17-9357-22b54d3e70cb tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:57.544251 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-04d6bf7d-68c4-4e17-9357-22b54d3e70cb tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:57.552414 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-04d6bf7d-68c4-4e17-9357-22b54d3e70cb tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/4770c3f5-5b3d-40da-9507-85b77d673094" status: 200 len: 1268 microversion: 2.1 time: 0.175163 Aug 31 15:51:57.556658 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 411/801] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:57 2022] GET /compute/v2.1/servers/4770c3f5-5b3d-40da-9507-85b77d673094 => generated 1268 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:57.635347 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-0bb5fd86-c37f-4028-a58f-ddfb7ff918fc tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lazy-loading 'services' on Instance uuid 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:51:57.652402 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0bb5fd86-c37f-4028-a58f-ddfb7ff918fc tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035" status: 200 len: 2056 microversion: 2.25 time: 0.308067 Aug 31 15:51:57.653631 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 391/802] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:51:57 2022] GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035 => generated 2056 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 15:51:57.795603 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0dea6d58-d213-4931-910a-0ec36162735d tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:57.796210 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0dea6d58-d213-4931-910a-0ec36162735d tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] [instance: 3b33f103-9c08-4775-975c-3f815d99a70e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:57.805898 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0dea6d58-d213-4931-910a-0ec36162735d tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:57.806407 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0dea6d58-d213-4931-910a-0ec36162735d tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:57.809715 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0dea6d58-d213-4931-910a-0ec36162735d tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:57.811092 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0dea6d58-d213-4931-910a-0ec36162735d tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:57.811507 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0dea6d58-d213-4931-910a-0ec36162735d tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:57.814405 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0dea6d58-d213-4931-910a-0ec36162735d tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:57.964829 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0dea6d58-d213-4931-910a-0ec36162735d tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704d7c428d3e4a1bbe5fb78485415214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a08078ba5a04c31b6cc63dee67be8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:57.973436 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0dea6d58-d213-4931-910a-0ec36162735d tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] 10.222.0.50 "GET /compute/v2.1/servers/3b33f103-9c08-4775-975c-3f815d99a70e" status: 200 len: 1509 microversion: 2.1 time: 0.182128 Aug 31 15:51:57.986825 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 412/803] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:57 2022] GET /compute/v2.1/servers/3b33f103-9c08-4775-975c-3f815d99a70e => generated 1509 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:51:58.121212 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b84cf553-4a20-44ee-b58e-d6d94d677465 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:58.122666 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b84cf553-4a20-44ee-b58e-d6d94d677465 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] [instance: a21daf16-afa5-4cad-8f8c-6ca10636601d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:58.137067 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5e6ed0cf-030e-4052-a0a8-06457efb86c6 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:58.137670 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5e6ed0cf-030e-4052-a0a8-06457efb86c6 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 236954ea-2791-477d-a92b-88e590593c63] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:58.141854 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b84cf553-4a20-44ee-b58e-d6d94d677465 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:58.142995 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b84cf553-4a20-44ee-b58e-d6d94d677465 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:58.144619 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b84cf553-4a20-44ee-b58e-d6d94d677465 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:58.147903 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b84cf553-4a20-44ee-b58e-d6d94d677465 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:58.149839 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b84cf553-4a20-44ee-b58e-d6d94d677465 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:58.150908 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b84cf553-4a20-44ee-b58e-d6d94d677465 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:58.157352 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e6ed0cf-030e-4052-a0a8-06457efb86c6 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:58.158398 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e6ed0cf-030e-4052-a0a8-06457efb86c6 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:58.158398 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e6ed0cf-030e-4052-a0a8-06457efb86c6 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:58.158979 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e6ed0cf-030e-4052-a0a8-06457efb86c6 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:58.160682 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e6ed0cf-030e-4052-a0a8-06457efb86c6 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:58.160682 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e6ed0cf-030e-4052-a0a8-06457efb86c6 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:58.514442 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5e6ed0cf-030e-4052-a0a8-06457efb86c6 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:58.530740 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5e6ed0cf-030e-4052-a0a8-06457efb86c6 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63" status: 200 len: 1312 microversion: 2.1 time: 0.392967 Aug 31 15:51:58.532096 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 413/804] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:58 2022] GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63 => generated 1312 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:58.548289 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d56151da-ebf2-4961-b40f-305ef13882cc tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:58.549835 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d56151da-ebf2-4961-b40f-305ef13882cc tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] [instance: 14dbaad0-9a67-48c0-a58b-5d9997c078c5] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:58.564108 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d56151da-ebf2-4961-b40f-305ef13882cc tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:58.567535 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d56151da-ebf2-4961-b40f-305ef13882cc tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:58.570539 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d56151da-ebf2-4961-b40f-305ef13882cc tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:58.573386 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d56151da-ebf2-4961-b40f-305ef13882cc tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:58.577639 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b84cf553-4a20-44ee-b58e-d6d94d677465 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6849c97bdb0948bc824cf5efe0f709a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e94509e985441f7b2802e6c6b164cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:58.583182 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d56151da-ebf2-4961-b40f-305ef13882cc tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:58.583182 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d56151da-ebf2-4961-b40f-305ef13882cc tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:58.591297 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b84cf553-4a20-44ee-b58e-d6d94d677465 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] 10.222.0.50 "GET /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d" status: 200 len: 1321 microversion: 2.1 time: 0.480064 Aug 31 15:51:58.593424 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 392/805] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:58 2022] GET /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d => generated 1321 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:58.601530 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3b712c5b-3e8e-4aed-acb3-ca3bfb997a57 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:58.602586 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3b712c5b-3e8e-4aed-acb3-ca3bfb997a57 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 4770c3f5-5b3d-40da-9507-85b77d673094] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:58.612697 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b712c5b-3e8e-4aed-acb3-ca3bfb997a57 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:58.613419 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b712c5b-3e8e-4aed-acb3-ca3bfb997a57 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:58.613860 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b712c5b-3e8e-4aed-acb3-ca3bfb997a57 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:58.614680 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b712c5b-3e8e-4aed-acb3-ca3bfb997a57 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:58.615391 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b712c5b-3e8e-4aed-acb3-ca3bfb997a57 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:58.616030 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b712c5b-3e8e-4aed-acb3-ca3bfb997a57 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:58.789275 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3b712c5b-3e8e-4aed-acb3-ca3bfb997a57 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:58.792145 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d56151da-ebf2-4961-b40f-305ef13882cc tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1cd6d56b0de45179f1b46829536bbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806480da4ae74a23aa20b86e3d6305f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:58.801098 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d56151da-ebf2-4961-b40f-305ef13882cc tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] 10.222.0.50 "GET /compute/v2.1/servers/14dbaad0-9a67-48c0-a58b-5d9997c078c5" status: 200 len: 1268 microversion: 2.1 time: 0.265822 Aug 31 15:51:58.802614 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 414/806] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:58 2022] GET /compute/v2.1/servers/14dbaad0-9a67-48c0-a58b-5d9997c078c5 => generated 1268 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:58.807100 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3b712c5b-3e8e-4aed-acb3-ca3bfb997a57 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/4770c3f5-5b3d-40da-9507-85b77d673094" status: 200 len: 1286 microversion: 2.1 time: 0.203665 Aug 31 15:51:58.815955 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 393/807] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:58 2022] GET /compute/v2.1/servers/4770c3f5-5b3d-40da-9507-85b77d673094 => generated 1286 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:51:58.815955 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bb79f6e5-8764-4f27-acbe-d3ae8579bf60 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:58.815955 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bb79f6e5-8764-4f27-acbe-d3ae8579bf60 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] [instance: 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:58.816806 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-09a50a6b-1f41-4a07-b580-02a9f6ee5f5f req-f385f8e5-aa89-48e3-bcea-e8ae9c729c37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a21daf16-afa5-4cad-8f8c-6ca10636601d", "name": "network-vif-plugged", "status": "completed", "tag": "9cf8063e-3763-4822-8435-e3dec32e2415"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:51:58.835875 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bb79f6e5-8764-4f27-acbe-d3ae8579bf60 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:58.840174 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bb79f6e5-8764-4f27-acbe-d3ae8579bf60 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:58.843420 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-09a50a6b-1f41-4a07-b580-02a9f6ee5f5f req-f385f8e5-aa89-48e3-bcea-e8ae9c729c37 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:58.843647 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bb79f6e5-8764-4f27-acbe-d3ae8579bf60 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:58.844952 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bb79f6e5-8764-4f27-acbe-d3ae8579bf60 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:58.845947 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bb79f6e5-8764-4f27-acbe-d3ae8579bf60 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:58.846691 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-09a50a6b-1f41-4a07-b580-02a9f6ee5f5f req-f385f8e5-aa89-48e3-bcea-e8ae9c729c37 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:58.847775 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bb79f6e5-8764-4f27-acbe-d3ae8579bf60 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:58.848335 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-09a50a6b-1f41-4a07-b580-02a9f6ee5f5f req-f385f8e5-aa89-48e3-bcea-e8ae9c729c37 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:58.875477 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-09a50a6b-1f41-4a07-b580-02a9f6ee5f5f req-f385f8e5-aa89-48e3-bcea-e8ae9c729c37 service nova] Creating event network-vif-plugged:9cf8063e-3763-4822-8435-e3dec32e2415 for instance a21daf16-afa5-4cad-8f8c-6ca10636601d on n-h2-833090-16 Aug 31 15:51:58.904218 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-09a50a6b-1f41-4a07-b580-02a9f6ee5f5f req-f385f8e5-aa89-48e3-bcea-e8ae9c729c37 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095955 Aug 31 15:51:58.907818 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 415/808] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:51:59.195724 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-bb79f6e5-8764-4f27-acbe-d3ae8579bf60 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lazy-loading 'services' on Instance uuid 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:51:59.259151 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bb79f6e5-8764-4f27-acbe-d3ae8579bf60 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035" status: 200 len: 2036 microversion: 2.25 time: 0.449563 Aug 31 15:51:59.266175 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 394/809] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:51:58 2022] GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035 => generated 2036 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:51:59.284201 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5f6072a3-1872-4d0c-86da-e2999342ee54 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-833090-16", "block_migration": "auto"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:51:59.287660 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5f6072a3-1872-4d0c-86da-e2999342ee54 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] [instance: 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:59.304275 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5f6072a3-1872-4d0c-86da-e2999342ee54 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:59.304761 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5f6072a3-1872-4d0c-86da-e2999342ee54 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:59.311650 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5f6072a3-1872-4d0c-86da-e2999342ee54 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:59.312538 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5f6072a3-1872-4d0c-86da-e2999342ee54 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:59.313020 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5f6072a3-1872-4d0c-86da-e2999342ee54 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:59.313592 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5f6072a3-1872-4d0c-86da-e2999342ee54 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:59.383676 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-5f6072a3-1872-4d0c-86da-e2999342ee54 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lazy-loading 'flavor' on Instance uuid 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:51:59.401387 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5f6072a3-1872-4d0c-86da-e2999342ee54 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] [instance: 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035] Going to try to live migrate instance to n-h1-833090-16 {{(pid=128864) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 31 15:51:59.553100 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cbc6f04f-36fa-49ff-9daa-e3109864c9fe tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:59.554238 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cbc6f04f-36fa-49ff-9daa-e3109864c9fe tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 236954ea-2791-477d-a92b-88e590593c63] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:59.571623 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbc6f04f-36fa-49ff-9daa-e3109864c9fe tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:59.572588 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbc6f04f-36fa-49ff-9daa-e3109864c9fe tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:59.573675 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbc6f04f-36fa-49ff-9daa-e3109864c9fe tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:59.573982 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbc6f04f-36fa-49ff-9daa-e3109864c9fe tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:59.574576 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbc6f04f-36fa-49ff-9daa-e3109864c9fe tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:59.575069 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbc6f04f-36fa-49ff-9daa-e3109864c9fe tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:59.914501 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cbc6f04f-36fa-49ff-9daa-e3109864c9fe tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:51:59.927599 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cbc6f04f-36fa-49ff-9daa-e3109864c9fe tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63" status: 200 len: 1312 microversion: 2.1 time: 0.379091 Aug 31 15:51:59.930920 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 395/810] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:59 2022] GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63 => generated 1312 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:51:59.941759 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-844ad66a-f5c3-447f-8d92-f15559945158 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:51:59.946956 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-844ad66a-f5c3-447f-8d92-f15559945158 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] [instance: a21daf16-afa5-4cad-8f8c-6ca10636601d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:51:59.958286 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-844ad66a-f5c3-447f-8d92-f15559945158 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:59.962742 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-844ad66a-f5c3-447f-8d92-f15559945158 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:59.963454 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-844ad66a-f5c3-447f-8d92-f15559945158 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:51:59.964489 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-844ad66a-f5c3-447f-8d92-f15559945158 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:51:59.965172 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-844ad66a-f5c3-447f-8d92-f15559945158 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:51:59.966016 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-844ad66a-f5c3-447f-8d92-f15559945158 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:00.033728 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:52:00.291335 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-844ad66a-f5c3-447f-8d92-f15559945158 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6849c97bdb0948bc824cf5efe0f709a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e94509e985441f7b2802e6c6b164cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:00.307463 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-844ad66a-f5c3-447f-8d92-f15559945158 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] 10.222.0.50 "GET /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d" status: 200 len: 1321 microversion: 2.1 time: 0.374333 Aug 31 15:52:00.309945 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 396/811] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:51:59 2022] GET /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d => generated 1321 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:00.317866 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-626952c3-7f18-410f-90b4-d2ef9c17b22e tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:00.318917 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-626952c3-7f18-410f-90b4-d2ef9c17b22e tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] [instance: 14dbaad0-9a67-48c0-a58b-5d9997c078c5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:00.351771 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-626952c3-7f18-410f-90b4-d2ef9c17b22e tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:00.353756 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-626952c3-7f18-410f-90b4-d2ef9c17b22e tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:00.354996 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-626952c3-7f18-410f-90b4-d2ef9c17b22e tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:00.356268 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-626952c3-7f18-410f-90b4-d2ef9c17b22e tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:00.356984 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-626952c3-7f18-410f-90b4-d2ef9c17b22e tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:00.357901 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-626952c3-7f18-410f-90b4-d2ef9c17b22e tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:00.468616 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-626952c3-7f18-410f-90b4-d2ef9c17b22e tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1cd6d56b0de45179f1b46829536bbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806480da4ae74a23aa20b86e3d6305f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:00.482615 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-626952c3-7f18-410f-90b4-d2ef9c17b22e tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] 10.222.0.50 "GET /compute/v2.1/servers/14dbaad0-9a67-48c0-a58b-5d9997c078c5" status: 200 len: 1268 microversion: 2.1 time: 0.171278 Aug 31 15:52:00.483814 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 397/812] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:00 2022] GET /compute/v2.1/servers/14dbaad0-9a67-48c0-a58b-5d9997c078c5 => generated 1268 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:00.490066 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ab619d55-ad96-41f6-870e-c6fe11314dba tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:00.492050 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ab619d55-ad96-41f6-870e-c6fe11314dba tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 4770c3f5-5b3d-40da-9507-85b77d673094] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:00.497806 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:52:00.499943 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab619d55-ad96-41f6-870e-c6fe11314dba tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:00.500739 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab619d55-ad96-41f6-870e-c6fe11314dba tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:00.501314 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab619d55-ad96-41f6-870e-c6fe11314dba tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:00.502396 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab619d55-ad96-41f6-870e-c6fe11314dba tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:00.502683 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab619d55-ad96-41f6-870e-c6fe11314dba tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:00.503170 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab619d55-ad96-41f6-870e-c6fe11314dba tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:00.721059 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ab619d55-ad96-41f6-870e-c6fe11314dba tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:00.733255 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ab619d55-ad96-41f6-870e-c6fe11314dba tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/4770c3f5-5b3d-40da-9507-85b77d673094" status: 200 len: 1316 microversion: 2.1 time: 0.247144 Aug 31 15:52:00.747168 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 398/813] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:00 2022] GET /compute/v2.1/servers/4770c3f5-5b3d-40da-9507-85b77d673094 => generated 1316 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:00.932580 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-281bb374-ee2b-48bd-b5d5-22297d224911 req-1430e130-7556-4b55-a483-3f2fc7cae97d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "236954ea-2791-477d-a92b-88e590593c63", "name": "network-vif-plugged", "status": "completed", "tag": "741689b8-43aa-4b92-9c42-308fa64c312a"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:52:00.976827 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-281bb374-ee2b-48bd-b5d5-22297d224911 req-1430e130-7556-4b55-a483-3f2fc7cae97d service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:00.980170 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-281bb374-ee2b-48bd-b5d5-22297d224911 req-1430e130-7556-4b55-a483-3f2fc7cae97d service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:00.983110 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-281bb374-ee2b-48bd-b5d5-22297d224911 req-1430e130-7556-4b55-a483-3f2fc7cae97d service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:01.045826 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-281bb374-ee2b-48bd-b5d5-22297d224911 req-1430e130-7556-4b55-a483-3f2fc7cae97d service nova] Creating event network-vif-plugged:741689b8-43aa-4b92-9c42-308fa64c312a for instance 236954ea-2791-477d-a92b-88e590593c63 on n-h1-833090-16 Aug 31 15:52:01.056798 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-281bb374-ee2b-48bd-b5d5-22297d224911 req-1430e130-7556-4b55-a483-3f2fc7cae97d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128951 Aug 31 15:52:01.061526 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 399/814] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:52:01.095444 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-58f1effb-ad25-4c44-b3c0-d82d8af4586d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:01.098412 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-58f1effb-ad25-4c44-b3c0-d82d8af4586d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 236954ea-2791-477d-a92b-88e590593c63] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:01.118298 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58f1effb-ad25-4c44-b3c0-d82d8af4586d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:01.121162 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58f1effb-ad25-4c44-b3c0-d82d8af4586d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:01.121901 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58f1effb-ad25-4c44-b3c0-d82d8af4586d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:01.124015 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58f1effb-ad25-4c44-b3c0-d82d8af4586d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:01.124522 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58f1effb-ad25-4c44-b3c0-d82d8af4586d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:01.124971 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58f1effb-ad25-4c44-b3c0-d82d8af4586d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:01.459157 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-58f1effb-ad25-4c44-b3c0-d82d8af4586d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:01.471671 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-58f1effb-ad25-4c44-b3c0-d82d8af4586d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63" status: 200 len: 1312 microversion: 2.1 time: 0.408646 Aug 31 15:52:01.492755 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 400/815] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:01 2022] GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63 => generated 1312 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:01.501113 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7bea1897-ebed-4361-9358-df1ceb4c3231 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:01.501113 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7bea1897-ebed-4361-9358-df1ceb4c3231 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] [instance: a21daf16-afa5-4cad-8f8c-6ca10636601d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:01.510668 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7bea1897-ebed-4361-9358-df1ceb4c3231 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:01.511548 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7bea1897-ebed-4361-9358-df1ceb4c3231 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:01.512541 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7bea1897-ebed-4361-9358-df1ceb4c3231 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:01.513419 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7bea1897-ebed-4361-9358-df1ceb4c3231 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:01.514273 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7bea1897-ebed-4361-9358-df1ceb4c3231 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:01.515104 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7bea1897-ebed-4361-9358-df1ceb4c3231 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:01.933369 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7bea1897-ebed-4361-9358-df1ceb4c3231 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6849c97bdb0948bc824cf5efe0f709a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e94509e985441f7b2802e6c6b164cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:01.952830 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7bea1897-ebed-4361-9358-df1ceb4c3231 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] 10.222.0.50 "GET /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d" status: 200 len: 1321 microversion: 2.1 time: 0.459040 Aug 31 15:52:01.953996 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 401/816] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:01 2022] GET /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d => generated 1321 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:01.959001 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dc1c85c7-e5f3-4510-9860-1bbc9e0ceeb8 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:01.960141 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dc1c85c7-e5f3-4510-9860-1bbc9e0ceeb8 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] [instance: 14dbaad0-9a67-48c0-a58b-5d9997c078c5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:01.975376 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc1c85c7-e5f3-4510-9860-1bbc9e0ceeb8 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:01.976158 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc1c85c7-e5f3-4510-9860-1bbc9e0ceeb8 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:01.977131 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc1c85c7-e5f3-4510-9860-1bbc9e0ceeb8 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:01.978044 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc1c85c7-e5f3-4510-9860-1bbc9e0ceeb8 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:01.978696 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc1c85c7-e5f3-4510-9860-1bbc9e0ceeb8 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:01.979296 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc1c85c7-e5f3-4510-9860-1bbc9e0ceeb8 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:02.118609 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dc1c85c7-e5f3-4510-9860-1bbc9e0ceeb8 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1cd6d56b0de45179f1b46829536bbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806480da4ae74a23aa20b86e3d6305f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:02.131782 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dc1c85c7-e5f3-4510-9860-1bbc9e0ceeb8 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] 10.222.0.50 "GET /compute/v2.1/servers/14dbaad0-9a67-48c0-a58b-5d9997c078c5" status: 200 len: 1274 microversion: 2.1 time: 0.176400 Aug 31 15:52:02.132975 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 402/817] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:01 2022] GET /compute/v2.1/servers/14dbaad0-9a67-48c0-a58b-5d9997c078c5 => generated 1274 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:02.149540 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-70c386a4-410a-424d-aa67-fbfdd6a3d2d1 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:02.150190 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-70c386a4-410a-424d-aa67-fbfdd6a3d2d1 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 4770c3f5-5b3d-40da-9507-85b77d673094] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:02.161708 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70c386a4-410a-424d-aa67-fbfdd6a3d2d1 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:02.162229 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70c386a4-410a-424d-aa67-fbfdd6a3d2d1 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:02.165560 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70c386a4-410a-424d-aa67-fbfdd6a3d2d1 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:02.166341 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70c386a4-410a-424d-aa67-fbfdd6a3d2d1 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:02.167158 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70c386a4-410a-424d-aa67-fbfdd6a3d2d1 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:02.167372 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70c386a4-410a-424d-aa67-fbfdd6a3d2d1 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:02.467569 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-70c386a4-410a-424d-aa67-fbfdd6a3d2d1 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:02.487933 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-70c386a4-410a-424d-aa67-fbfdd6a3d2d1 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/4770c3f5-5b3d-40da-9507-85b77d673094" status: 200 len: 1316 microversion: 2.1 time: 0.353271 Aug 31 15:52:02.489363 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 403/818] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:02 2022] GET /compute/v2.1/servers/4770c3f5-5b3d-40da-9507-85b77d673094 => generated 1316 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:02.496673 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c2f8996d-1c70-4035-8fa8-0cc4267e8d88 tempest-VolumesAdminNegativeTest-1121057591 tempest-VolumesAdminNegativeTest-1121057591-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "5b9e481e-13e1-4d05-8d5c-cd33650321ec"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:52:02.501187 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c2f8996d-1c70-4035-8fa8-0cc4267e8d88 tempest-VolumesAdminNegativeTest-1121057591 tempest-VolumesAdminNegativeTest-1121057591-project-admin] [instance: 3b33f103-9c08-4775-975c-3f815d99a70e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:02.515286 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2f8996d-1c70-4035-8fa8-0cc4267e8d88 tempest-VolumesAdminNegativeTest-1121057591 tempest-VolumesAdminNegativeTest-1121057591-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:02.516201 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2f8996d-1c70-4035-8fa8-0cc4267e8d88 tempest-VolumesAdminNegativeTest-1121057591 tempest-VolumesAdminNegativeTest-1121057591-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:02.516894 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2f8996d-1c70-4035-8fa8-0cc4267e8d88 tempest-VolumesAdminNegativeTest-1121057591 tempest-VolumesAdminNegativeTest-1121057591-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:02.517885 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2f8996d-1c70-4035-8fa8-0cc4267e8d88 tempest-VolumesAdminNegativeTest-1121057591 tempest-VolumesAdminNegativeTest-1121057591-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:02.519462 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2f8996d-1c70-4035-8fa8-0cc4267e8d88 tempest-VolumesAdminNegativeTest-1121057591 tempest-VolumesAdminNegativeTest-1121057591-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:02.520484 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2f8996d-1c70-4035-8fa8-0cc4267e8d88 tempest-VolumesAdminNegativeTest-1121057591 tempest-VolumesAdminNegativeTest-1121057591-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:02.617563 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-c2f8996d-1c70-4035-8fa8-0cc4267e8d88 tempest-VolumesAdminNegativeTest-1121057591 tempest-VolumesAdminNegativeTest-1121057591-project-admin] HTTP exception thrown: Volume 17a59a98-8c0e-4c5d-bc54-417be6a79adf could not be found. Aug 31 15:52:02.638317 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c2f8996d-1c70-4035-8fa8-0cc4267e8d88 tempest-VolumesAdminNegativeTest-1121057591 tempest-VolumesAdminNegativeTest-1121057591-project-admin] Request method failure captured: Aug 31 15:52:02.638317 n-d-833090-16 devstack@n-api.service[128863]: request: PUT /compute/v2.1/servers/3b33f103-9c08-4775-975c-3f815d99a70e/os-volume_attachments/17a59a98-8c0e-4c5d-bc54-417be6a79adf HTTP/1.1 Aug 31 15:52:02.638317 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:52:02.638317 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:52:02.638317 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:52:02.638317 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 74 Aug 31 15:52:02.638317 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:52:02.638317 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:52:02.638317 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:52:02.638317 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:52:02.638317 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4MWk_hExjJt-4p7zNvJSju3vxJcg4DGcLi036uZwUk7Q9QtVazPxAc5O6k3a5bZ824qYvU8wHkkUoeeos8uuKT0HawhD_bARcdb455NnjbUBt8BKvISxuJqE1ThXD0sHFQpqRPMzQMje16Ue58pMsRzLADQvUlh9oxfGDzfZz5g0bw Aug 31 15:52:02.638317 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:52:02.638317 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:52:02.638317 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:52:02.638317 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:52:02.638317 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:52:02.638317 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:52:02.638317 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 176a2e4690224bdba6c30a9d7c6c722c Aug 31 15:52:02.638317 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-VolumesAdminNegativeTest-1121057591 Aug 31 15:52:02.638317 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,admin,member Aug 31 15:52:02.638317 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,admin,member Aug 31 15:52:02.639812 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/176a2e4690224bdba6c30a9d7c6c722c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/176a2e4690224bdba6c30a9d7c6c722c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/176a2e4690224bdba6c30a9d7c6c722c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_176a2e4690224bdba6c30a9d7c6c722c", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:52:02.639812 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-VolumesAdminNegativeTest-1121057591 Aug 31 15:52:02.639812 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 176a2e4690224bdba6c30a9d7c6c722c Aug 31 15:52:02.639812 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1121057591 Aug 31 15:52:02.639812 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-VolumesAdminNegativeTest-1121057591-project-admin Aug 31 15:52:02.639812 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:52:02.639812 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:52:02.639812 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: df3a4aeff0ca49c2a1cda553d6239acc Aug 31 15:52:02.639812 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-VolumesAdminNegativeTest-1121057591-project-admin Aug 31 15:52:02.639812 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 15:52:02.639812 n-d-833090-16 devstack@n-api.service[128863]: {"volumeAttachment": {"volumeId": "5b9e481e-13e1-4d05-8d5c-cd33650321ec"}} Aug 31 15:52:02.639812 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 15:52:02.639812 n-d-833090-16 devstack@n-api.service[128863]: exception: Volume 17a59a98-8c0e-4c5d-bc54-417be6a79adf could not be found. Aug 31 15:52:02.640739 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'server_id': '3b33f103-9c08-4775-975c-3f815d99a70e', 'id': '17a59a98-8c0e-4c5d-bc54-417be6a79adf', 'body': {'volumeAttachment': {'volumeId': '5b9e481e-13e1-4d05-8d5c-cd33650321ec'}}} Aug 31 15:52:02.640739 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:52:02.640739 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:02.640739 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 15:52:02.640739 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 15:52:02.640739 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 15:52:02.640739 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 15:52:02.640739 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 15:52:02.640739 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 15:52:02.640739 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 15:52:02.640739 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 15:52:02.640739 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 15:52:02.640739 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 15:52:02.640739 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 15:52:02.640739 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 15:52:02.640739 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 15:52:02.640739 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 15:52:02.641862 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 17a59a98-8c0e-4c5d-bc54-417be6a79adf could not be found. (HTTP 404) (Request-ID: req-571d01d7-6b5a-4d26-80a7-8659faf7f1f7) Aug 31 15:52:02.641862 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:52:02.641862 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:52:02.641862 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:52:02.641862 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:02.641862 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Aug 31 15:52:02.641862 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Aug 31 15:52:02.641862 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 15:52:02.641862 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 15:52:02.641862 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 15:52:02.641862 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 15:52:02.641862 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 15:52:02.641862 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 15:52:02.641862 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 15:52:02.641862 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 15:52:02.641862 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 15:52:02.641862 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 15:52:02.641862 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 15:52:02.641862 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 15:52:02.644802 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 15:52:02.644802 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 15:52:02.644802 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 15:52:02.644802 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 15:52:02.644802 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 15:52:02.644802 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 15:52:02.644802 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 15:52:02.644802 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 15:52:02.644802 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 17a59a98-8c0e-4c5d-bc54-417be6a79adf could not be found. Aug 31 15:52:02.644802 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:52:02.644802 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:52:02.644802 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:52:02.644802 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:02.644802 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:52:02.644802 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:52:02.644802 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:52:02.644802 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:52:02.644802 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:52:02.644802 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:52:02.647609 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:52:02.647609 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:52:02.647609 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:52:02.647609 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:52:02.647609 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 31 15:52:02.647609 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 31 15:52:02.647609 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Aug 31 15:52:02.647609 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:52:02.647609 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 17a59a98-8c0e-4c5d-bc54-417be6a79adf could not be found. Aug 31 15:52:02.647609 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:52:02.647609 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:52:02.647609 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:52:02.647609 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:02.647609 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:52:02.647609 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:52:02.647609 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:52:02.647609 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:52:02.647609 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 17a59a98-8c0e-4c5d-bc54-417be6a79adf could not be found. Aug 31 15:52:02.647609 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:52:02.651065 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c2f8996d-1c70-4035-8fa8-0cc4267e8d88 tempest-VolumesAdminNegativeTest-1121057591 tempest-VolumesAdminNegativeTest-1121057591-project-admin] Returning 404 to user: Volume 17a59a98-8c0e-4c5d-bc54-417be6a79adf could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:52:02.651065 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c2f8996d-1c70-4035-8fa8-0cc4267e8d88 tempest-VolumesAdminNegativeTest-1121057591 tempest-VolumesAdminNegativeTest-1121057591-project-admin] 10.222.0.50 "PUT /compute/v2.1/servers/3b33f103-9c08-4775-975c-3f815d99a70e/os-volume_attachments/17a59a98-8c0e-4c5d-bc54-417be6a79adf" status: 404 len: 109 microversion: 2.1 time: 0.149287 Aug 31 15:52:02.651065 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 404/819] 10.222.0.50 () {60 vars in 1433 bytes} [Wed Aug 31 15:52:02 2022] PUT /compute/v2.1/servers/3b33f103-9c08-4775-975c-3f815d99a70e/os-volume_attachments/17a59a98-8c0e-4c5d-bc54-417be6a79adf => generated 109 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:52:02.653009 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-a8637429-e6c5-4937-bcc6-23f153b8d3ef req-ef7d2e3f-38c7-43f3-8dc2-9349579c209f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4770c3f5-5b3d-40da-9507-85b77d673094", "tag": "54fb4822-334f-41ba-aec2-444427824a7b"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:52:02.681645 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a8637429-e6c5-4937-bcc6-23f153b8d3ef req-ef7d2e3f-38c7-43f3-8dc2-9349579c209f service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:02.682153 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a8637429-e6c5-4937-bcc6-23f153b8d3ef req-ef7d2e3f-38c7-43f3-8dc2-9349579c209f service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:02.682592 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a8637429-e6c5-4937-bcc6-23f153b8d3ef req-ef7d2e3f-38c7-43f3-8dc2-9349579c209f service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:02.711405 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-a8637429-e6c5-4937-bcc6-23f153b8d3ef req-ef7d2e3f-38c7-43f3-8dc2-9349579c209f service nova] Creating event network-changed:54fb4822-334f-41ba-aec2-444427824a7b for instance 4770c3f5-5b3d-40da-9507-85b77d673094 on n-h2-833090-16 Aug 31 15:52:02.721670 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-a8637429-e6c5-4937-bcc6-23f153b8d3ef req-ef7d2e3f-38c7-43f3-8dc2-9349579c209f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072586 Aug 31 15:52:02.727401 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 405/820] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:52:02.742956 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-80edc7d5-df2b-4433-b244-2991ed3ef20e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:02.745624 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-80edc7d5-df2b-4433-b244-2991ed3ef20e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 236954ea-2791-477d-a92b-88e590593c63] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:02.753355 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5f6072a3-1872-4d0c-86da-e2999342ee54 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035/action" status: 202 len: 0 microversion: 2.25 time: 3.473308 Aug 31 15:52:02.754880 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 416/821] 10.222.0.50 () {62 vars in 1319 bytes} [Wed Aug 31 15:51:59 2022] POST /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035/action => generated 0 bytes in 3476 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:52:02.760386 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80edc7d5-df2b-4433-b244-2991ed3ef20e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:02.760948 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80edc7d5-df2b-4433-b244-2991ed3ef20e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:02.761374 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80edc7d5-df2b-4433-b244-2991ed3ef20e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:02.766894 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-80b9ff37-99de-4616-87de-1d7326bf4b91 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:02.767448 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80edc7d5-df2b-4433-b244-2991ed3ef20e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:02.767952 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80edc7d5-df2b-4433-b244-2991ed3ef20e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:02.768408 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80edc7d5-df2b-4433-b244-2991ed3ef20e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:02.770455 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-80b9ff37-99de-4616-87de-1d7326bf4b91 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:02.786482 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-80b9ff37-99de-4616-87de-1d7326bf4b91 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:02.788100 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-80b9ff37-99de-4616-87de-1d7326bf4b91 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:02.789211 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-80b9ff37-99de-4616-87de-1d7326bf4b91 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:02.793691 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-80b9ff37-99de-4616-87de-1d7326bf4b91 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:02.795407 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-80b9ff37-99de-4616-87de-1d7326bf4b91 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:02.796196 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-80b9ff37-99de-4616-87de-1d7326bf4b91 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:03.139732 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-80b9ff37-99de-4616-87de-1d7326bf4b91 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:03.155215 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-80b9ff37-99de-4616-87de-1d7326bf4b91 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:03.155449 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-80edc7d5-df2b-4433-b244-2991ed3ef20e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:03.157347 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-80b9ff37-99de-4616-87de-1d7326bf4b91 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:03.162046 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-80b9ff37-99de-4616-87de-1d7326bf4b91 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035" status: 200 len: 1566 microversion: 2.25 time: 0.401287 Aug 31 15:52:03.174125 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-80edc7d5-df2b-4433-b244-2991ed3ef20e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63" status: 200 len: 1312 microversion: 2.1 time: 0.440965 Aug 31 15:52:03.174125 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 406/822] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:02 2022] GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63 => generated 1312 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:03.174738 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 417/823] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:52:02 2022] GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035 => generated 1566 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:52:03.179801 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ca27d52f-07db-4cb3-846c-628d23860906 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:03.180439 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ca27d52f-07db-4cb3-846c-628d23860906 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] [instance: a21daf16-afa5-4cad-8f8c-6ca10636601d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:03.183703 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7b96dc39-c71f-4797-8a31-11e267bd2b9f tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:03.184515 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7b96dc39-c71f-4797-8a31-11e267bd2b9f tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] [instance: 14dbaad0-9a67-48c0-a58b-5d9997c078c5] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:03.192385 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7b96dc39-c71f-4797-8a31-11e267bd2b9f tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:03.193120 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7b96dc39-c71f-4797-8a31-11e267bd2b9f tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:03.193710 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7b96dc39-c71f-4797-8a31-11e267bd2b9f tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:03.194648 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7b96dc39-c71f-4797-8a31-11e267bd2b9f tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:03.195263 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7b96dc39-c71f-4797-8a31-11e267bd2b9f tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:03.195874 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7b96dc39-c71f-4797-8a31-11e267bd2b9f tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:03.205283 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca27d52f-07db-4cb3-846c-628d23860906 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:03.207318 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca27d52f-07db-4cb3-846c-628d23860906 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:03.207972 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca27d52f-07db-4cb3-846c-628d23860906 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:03.208497 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca27d52f-07db-4cb3-846c-628d23860906 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:03.208958 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca27d52f-07db-4cb3-846c-628d23860906 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:03.209404 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca27d52f-07db-4cb3-846c-628d23860906 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:03.281545 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:52:03.282640 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=26 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:52:03.755315 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ca27d52f-07db-4cb3-846c-628d23860906 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6849c97bdb0948bc824cf5efe0f709a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e94509e985441f7b2802e6c6b164cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:03.764459 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ca27d52f-07db-4cb3-846c-628d23860906 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] 10.222.0.50 "GET /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d" status: 200 len: 1471 microversion: 2.1 time: 0.592847 Aug 31 15:52:03.782120 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 407/824] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:03 2022] GET /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d => generated 1471 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:03.782120 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bea6aff0-5b99-43d8-8554-a8fa326b5e13 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:03.782120 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bea6aff0-5b99-43d8-8554-a8fa326b5e13 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 4770c3f5-5b3d-40da-9507-85b77d673094] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:03.797431 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7b96dc39-c71f-4797-8a31-11e267bd2b9f tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1cd6d56b0de45179f1b46829536bbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806480da4ae74a23aa20b86e3d6305f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:03.801840 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bea6aff0-5b99-43d8-8554-a8fa326b5e13 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:03.802413 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bea6aff0-5b99-43d8-8554-a8fa326b5e13 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:03.802950 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bea6aff0-5b99-43d8-8554-a8fa326b5e13 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:03.806386 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7b96dc39-c71f-4797-8a31-11e267bd2b9f tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] 10.222.0.50 "GET /compute/v2.1/servers/14dbaad0-9a67-48c0-a58b-5d9997c078c5" status: 200 len: 1316 microversion: 2.1 time: 0.630311 Aug 31 15:52:03.807308 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 418/825] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:03 2022] GET /compute/v2.1/servers/14dbaad0-9a67-48c0-a58b-5d9997c078c5 => generated 1316 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:03.812000 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8894c871-3f55-4162-b72c-acb5418c9954 tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:52:03.812529 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8894c871-3f55-4162-b72c-acb5418c9954 tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] [instance: a21daf16-afa5-4cad-8f8c-6ca10636601d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:03.820183 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8894c871-3f55-4162-b72c-acb5418c9954 tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:03.820370 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bea6aff0-5b99-43d8-8554-a8fa326b5e13 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:03.820677 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8894c871-3f55-4162-b72c-acb5418c9954 tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:03.821117 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8894c871-3f55-4162-b72c-acb5418c9954 tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:03.821821 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8894c871-3f55-4162-b72c-acb5418c9954 tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:03.822408 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8894c871-3f55-4162-b72c-acb5418c9954 tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:03.822631 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bea6aff0-5b99-43d8-8554-a8fa326b5e13 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:03.822833 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8894c871-3f55-4162-b72c-acb5418c9954 tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:03.823273 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bea6aff0-5b99-43d8-8554-a8fa326b5e13 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:03.850311 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=9 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:52:03.853873 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-8894c871-3f55-4162-b72c-acb5418c9954 tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] Lazy-loading 'flavor' on Instance uuid a21daf16-afa5-4cad-8f8c-6ca10636601d {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:52:04.055726 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8894c871-3f55-4162-b72c-acb5418c9954 tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d/action" status: 202 len: 0 microversion: 2.1 time: 0.247051 Aug 31 15:52:04.056819 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 419/826] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 15:52:03 2022] POST /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:52:04.079571 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-84ff7332-9e33-455a-9911-faf48ac5b450 tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:04.081482 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-84ff7332-9e33-455a-9911-faf48ac5b450 tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] [instance: a21daf16-afa5-4cad-8f8c-6ca10636601d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:04.098151 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-84ff7332-9e33-455a-9911-faf48ac5b450 tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:04.098825 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-84ff7332-9e33-455a-9911-faf48ac5b450 tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:04.099430 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-84ff7332-9e33-455a-9911-faf48ac5b450 tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:04.100385 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-84ff7332-9e33-455a-9911-faf48ac5b450 tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:04.101025 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-84ff7332-9e33-455a-9911-faf48ac5b450 tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:04.102163 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-84ff7332-9e33-455a-9911-faf48ac5b450 tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:04.144864 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:52:04.174457 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bea6aff0-5b99-43d8-8554-a8fa326b5e13 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:04.201052 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bea6aff0-5b99-43d8-8554-a8fa326b5e13 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/4770c3f5-5b3d-40da-9507-85b77d673094" status: 200 len: 1316 microversion: 2.1 time: 0.427515 Aug 31 15:52:04.226523 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 408/827] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:03 2022] GET /compute/v2.1/servers/4770c3f5-5b3d-40da-9507-85b77d673094 => generated 1316 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:04.231892 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-167a6342-4928-49bb-b1fb-6cd16ec12b75 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:04.232716 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-167a6342-4928-49bb-b1fb-6cd16ec12b75 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:04.249962 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-167a6342-4928-49bb-b1fb-6cd16ec12b75 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:04.250495 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-167a6342-4928-49bb-b1fb-6cd16ec12b75 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:04.250931 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-167a6342-4928-49bb-b1fb-6cd16ec12b75 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:04.251633 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-167a6342-4928-49bb-b1fb-6cd16ec12b75 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:04.252089 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-167a6342-4928-49bb-b1fb-6cd16ec12b75 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:04.252505 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-167a6342-4928-49bb-b1fb-6cd16ec12b75 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:04.498818 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-84ff7332-9e33-455a-9911-faf48ac5b450 tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d" status: 200 len: 1632 microversion: 2.1 time: 0.430483 Aug 31 15:52:04.500012 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 420/828] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:04 2022] GET /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d => generated 1632 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:04.513457 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-26b4a3d2-27a5-4e99-a51c-5b5519f9bd11 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:04.514548 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-26b4a3d2-27a5-4e99-a51c-5b5519f9bd11 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 236954ea-2791-477d-a92b-88e590593c63] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:04.528761 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:52:04.533761 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26b4a3d2-27a5-4e99-a51c-5b5519f9bd11 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:04.534871 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26b4a3d2-27a5-4e99-a51c-5b5519f9bd11 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:04.535651 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26b4a3d2-27a5-4e99-a51c-5b5519f9bd11 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:04.537312 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26b4a3d2-27a5-4e99-a51c-5b5519f9bd11 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:04.538743 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26b4a3d2-27a5-4e99-a51c-5b5519f9bd11 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:04.542449 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26b4a3d2-27a5-4e99-a51c-5b5519f9bd11 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:04.584187 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-167a6342-4928-49bb-b1fb-6cd16ec12b75 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:04.599538 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-167a6342-4928-49bb-b1fb-6cd16ec12b75 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:04.612584 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-167a6342-4928-49bb-b1fb-6cd16ec12b75 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:04.614257 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-167a6342-4928-49bb-b1fb-6cd16ec12b75 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035" status: 200 len: 1566 microversion: 2.25 time: 0.386113 Aug 31 15:52:04.619321 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 409/829] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:52:04 2022] GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035 => generated 1566 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:52:04.715868 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-26b4a3d2-27a5-4e99-a51c-5b5519f9bd11 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:04.724506 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-26b4a3d2-27a5-4e99-a51c-5b5519f9bd11 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63" status: 200 len: 1462 microversion: 2.1 time: 0.223229 Aug 31 15:52:04.725386 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 421/830] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:04 2022] GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63 => generated 1462 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:04.746773 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-27e3a57c-1093-4c7f-820a-555b604b15bc tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:52:04.749231 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-27e3a57c-1093-4c7f-820a-555b604b15bc tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 236954ea-2791-477d-a92b-88e590593c63] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:04.762664 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-449a7d96-a075-4bfc-ba90-841030959964 req-4920622e-ad96-4064-a40a-b5c33d1be584 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ccef73e-5e82-42e7-a2cb-ef2e49f3a035", "name": "network-vif-unplugged", "status": "completed", "tag": "dfe16a0a-a802-4494-ac84-4d7be18928d2"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:52:04.767982 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27e3a57c-1093-4c7f-820a-555b604b15bc tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:04.768476 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27e3a57c-1093-4c7f-820a-555b604b15bc tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:04.768926 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27e3a57c-1093-4c7f-820a-555b604b15bc tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:04.769644 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27e3a57c-1093-4c7f-820a-555b604b15bc tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:04.770126 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27e3a57c-1093-4c7f-820a-555b604b15bc tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:04.770555 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27e3a57c-1093-4c7f-820a-555b604b15bc tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:04.782552 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-449a7d96-a075-4bfc-ba90-841030959964 req-4920622e-ad96-4064-a40a-b5c33d1be584 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:04.783016 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-449a7d96-a075-4bfc-ba90-841030959964 req-4920622e-ad96-4064-a40a-b5c33d1be584 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:04.783450 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-449a7d96-a075-4bfc-ba90-841030959964 req-4920622e-ad96-4064-a40a-b5c33d1be584 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:04.817893 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-449a7d96-a075-4bfc-ba90-841030959964 req-4920622e-ad96-4064-a40a-b5c33d1be584 service nova] Creating event network-vif-unplugged:dfe16a0a-a802-4494-ac84-4d7be18928d2 for instance 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035 on n-h2-833090-16 Aug 31 15:52:04.826757 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-449a7d96-a075-4bfc-ba90-841030959964 req-4920622e-ad96-4064-a40a-b5c33d1be584 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072752 Aug 31 15:52:04.828008 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 422/831] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:52:04.833700 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5d2cab1a-a00a-4d29-bbd0-619673db6e94 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:04.840955 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5d2cab1a-a00a-4d29-bbd0-619673db6e94 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] [instance: 14dbaad0-9a67-48c0-a58b-5d9997c078c5] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:04.856008 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5d2cab1a-a00a-4d29-bbd0-619673db6e94 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:04.858799 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5d2cab1a-a00a-4d29-bbd0-619673db6e94 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:04.859568 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5d2cab1a-a00a-4d29-bbd0-619673db6e94 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:04.865405 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5d2cab1a-a00a-4d29-bbd0-619673db6e94 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:04.867020 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5d2cab1a-a00a-4d29-bbd0-619673db6e94 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:04.867714 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5d2cab1a-a00a-4d29-bbd0-619673db6e94 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:04.985678 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-27e3a57c-1093-4c7f-820a-555b604b15bc tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:04.997780 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-27e3a57c-1093-4c7f-820a-555b604b15bc tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 236954ea-2791-477d-a92b-88e590593c63] Old instance type m1.heat2, new instance type m1.heat {{(pid=128863) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 31 15:52:05.008719 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-27e3a57c-1093-4c7f-820a-555b604b15bc tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:52:05.009540 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-27e3a57c-1093-4c7f-820a-555b604b15bc tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:52:05.010235 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-27e3a57c-1093-4c7f-820a-555b604b15bc tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:52:05.011053 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-27e3a57c-1093-4c7f-820a-555b604b15bc tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:52:05.011632 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-27e3a57c-1093-4c7f-820a-555b604b15bc tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:52:05.032298 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5d2cab1a-a00a-4d29-bbd0-619673db6e94 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1cd6d56b0de45179f1b46829536bbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806480da4ae74a23aa20b86e3d6305f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:05.040425 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5d2cab1a-a00a-4d29-bbd0-619673db6e94 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] 10.222.0.50 "GET /compute/v2.1/servers/14dbaad0-9a67-48c0-a58b-5d9997c078c5" status: 200 len: 1316 microversion: 2.1 time: 0.210768 Aug 31 15:52:05.045273 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 423/832] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:04 2022] GET /compute/v2.1/servers/14dbaad0-9a67-48c0-a58b-5d9997c078c5 => generated 1316 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:05.206781 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-27e3a57c-1093-4c7f-820a-555b604b15bc tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "POST /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63/action" status: 202 len: 0 microversion: 2.1 time: 0.464165 Aug 31 15:52:05.208024 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 410/833] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 15:52:04 2022] POST /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63/action => generated 0 bytes in 466 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:52:05.215909 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f4c4ea7d-2993-4af6-bdd5-b60647e1566e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:05.217769 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f4c4ea7d-2993-4af6-bdd5-b60647e1566e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 236954ea-2791-477d-a92b-88e590593c63] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:05.232012 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f4c4ea7d-2993-4af6-bdd5-b60647e1566e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:05.232749 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f4c4ea7d-2993-4af6-bdd5-b60647e1566e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:05.233403 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f4c4ea7d-2993-4af6-bdd5-b60647e1566e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:05.234062 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4d90ac12-4ea4-4408-b3e3-18f2c9f741bc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:05.234815 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4d90ac12-4ea4-4408-b3e3-18f2c9f741bc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 4770c3f5-5b3d-40da-9507-85b77d673094] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:05.235345 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f4c4ea7d-2993-4af6-bdd5-b60647e1566e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:05.236020 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f4c4ea7d-2993-4af6-bdd5-b60647e1566e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:05.236698 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f4c4ea7d-2993-4af6-bdd5-b60647e1566e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:05.242435 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d90ac12-4ea4-4408-b3e3-18f2c9f741bc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:05.242759 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d90ac12-4ea4-4408-b3e3-18f2c9f741bc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:05.243173 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d90ac12-4ea4-4408-b3e3-18f2c9f741bc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:05.243881 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d90ac12-4ea4-4408-b3e3-18f2c9f741bc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:05.245758 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d90ac12-4ea4-4408-b3e3-18f2c9f741bc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:05.247067 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d90ac12-4ea4-4408-b3e3-18f2c9f741bc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:05.483752 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4d90ac12-4ea4-4408-b3e3-18f2c9f741bc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:05.492661 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4d90ac12-4ea4-4408-b3e3-18f2c9f741bc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/4770c3f5-5b3d-40da-9507-85b77d673094" status: 200 len: 1316 microversion: 2.1 time: 0.263274 Aug 31 15:52:05.497003 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 411/834] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:05 2022] GET /compute/v2.1/servers/4770c3f5-5b3d-40da-9507-85b77d673094 => generated 1316 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:52:05.515065 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f4c4ea7d-2993-4af6-bdd5-b60647e1566e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:05.524795 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f4c4ea7d-2993-4af6-bdd5-b60647e1566e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63" status: 200 len: 1471 microversion: 2.1 time: 0.312570 Aug 31 15:52:05.527373 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bf2931c0-6aec-4e84-b339-0d1082fc2e9e tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:05.538149 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bf2931c0-6aec-4e84-b339-0d1082fc2e9e tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] [instance: a21daf16-afa5-4cad-8f8c-6ca10636601d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:05.539660 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 424/835] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:05 2022] GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63 => generated 1471 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:05.542242 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf2931c0-6aec-4e84-b339-0d1082fc2e9e tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:05.542998 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf2931c0-6aec-4e84-b339-0d1082fc2e9e tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:05.544711 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf2931c0-6aec-4e84-b339-0d1082fc2e9e tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:05.546152 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf2931c0-6aec-4e84-b339-0d1082fc2e9e tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:05.553093 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf2931c0-6aec-4e84-b339-0d1082fc2e9e tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:05.553199 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf2931c0-6aec-4e84-b339-0d1082fc2e9e tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:05.649113 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0268ab11-a6f9-4622-9513-2b15f01ebdce tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:05.649736 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0268ab11-a6f9-4622-9513-2b15f01ebdce tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:05.663515 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0268ab11-a6f9-4622-9513-2b15f01ebdce tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:05.664011 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0268ab11-a6f9-4622-9513-2b15f01ebdce tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:05.664446 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0268ab11-a6f9-4622-9513-2b15f01ebdce tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:05.665165 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0268ab11-a6f9-4622-9513-2b15f01ebdce tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:05.665713 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0268ab11-a6f9-4622-9513-2b15f01ebdce tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:05.679474 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0268ab11-a6f9-4622-9513-2b15f01ebdce tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:06.252815 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bf2931c0-6aec-4e84-b339-0d1082fc2e9e tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d" status: 200 len: 1632 microversion: 2.1 time: 0.731290 Aug 31 15:52:06.254751 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 412/836] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:05 2022] GET /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d => generated 1632 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:52:06.262922 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-523e778e-717f-42a7-8c7b-19e4a1590758 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:06.267007 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-523e778e-717f-42a7-8c7b-19e4a1590758 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] [instance: 14dbaad0-9a67-48c0-a58b-5d9997c078c5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:06.285894 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-523e778e-717f-42a7-8c7b-19e4a1590758 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:06.286754 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-523e778e-717f-42a7-8c7b-19e4a1590758 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:06.287394 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-523e778e-717f-42a7-8c7b-19e4a1590758 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:06.288404 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-523e778e-717f-42a7-8c7b-19e4a1590758 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:06.289095 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-523e778e-717f-42a7-8c7b-19e4a1590758 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:06.289723 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-523e778e-717f-42a7-8c7b-19e4a1590758 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:06.314445 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:52:06.465092 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0268ab11-a6f9-4622-9513-2b15f01ebdce tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:06.513058 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0268ab11-a6f9-4622-9513-2b15f01ebdce tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:06.515509 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0268ab11-a6f9-4622-9513-2b15f01ebdce tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:06.516704 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0268ab11-a6f9-4622-9513-2b15f01ebdce tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035" status: 200 len: 1566 microversion: 2.25 time: 0.875611 Aug 31 15:52:06.550139 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 425/837] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:52:05 2022] GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035 => generated 1566 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 15:52:06.566117 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7644a1a2-e207-4ed6-bee3-e219940ea622 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:06.566604 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7644a1a2-e207-4ed6-bee3-e219940ea622 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] [instance: 3b33f103-9c08-4775-975c-3f815d99a70e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:06.607658 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7644a1a2-e207-4ed6-bee3-e219940ea622 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:06.608123 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7644a1a2-e207-4ed6-bee3-e219940ea622 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:06.612115 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7644a1a2-e207-4ed6-bee3-e219940ea622 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:06.613979 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7644a1a2-e207-4ed6-bee3-e219940ea622 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:06.616128 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7644a1a2-e207-4ed6-bee3-e219940ea622 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:06.617110 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7644a1a2-e207-4ed6-bee3-e219940ea622 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:06.693289 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7644a1a2-e207-4ed6-bee3-e219940ea622 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] [instance: 3b33f103-9c08-4775-975c-3f815d99a70e] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:52:06.804106 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-523e778e-717f-42a7-8c7b-19e4a1590758 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1cd6d56b0de45179f1b46829536bbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806480da4ae74a23aa20b86e3d6305f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:06.820108 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-523e778e-717f-42a7-8c7b-19e4a1590758 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] 10.222.0.50 "GET /compute/v2.1/servers/14dbaad0-9a67-48c0-a58b-5d9997c078c5" status: 200 len: 1316 microversion: 2.1 time: 0.560575 Aug 31 15:52:06.822712 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 413/838] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:06 2022] GET /compute/v2.1/servers/14dbaad0-9a67-48c0-a58b-5d9997c078c5 => generated 1316 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:06.832360 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-98b279f1-a587-440e-a556-418103b9c450 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:06.834755 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-98b279f1-a587-440e-a556-418103b9c450 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 4770c3f5-5b3d-40da-9507-85b77d673094] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:06.848558 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98b279f1-a587-440e-a556-418103b9c450 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:06.849861 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98b279f1-a587-440e-a556-418103b9c450 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:06.850928 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98b279f1-a587-440e-a556-418103b9c450 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:06.853732 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98b279f1-a587-440e-a556-418103b9c450 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:06.855451 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98b279f1-a587-440e-a556-418103b9c450 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:06.855961 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98b279f1-a587-440e-a556-418103b9c450 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:06.906331 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7644a1a2-e207-4ed6-bee3-e219940ea622 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3b33f103-9c08-4775-975c-3f815d99a70e" status: 204 len: 0 microversion: 2.1 time: 0.343577 Aug 31 15:52:06.910797 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 426/839] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:52:06 2022] DELETE /compute/v2.1/servers/3b33f103-9c08-4775-975c-3f815d99a70e => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:52:06.921245 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-cb497c35-99c8-4d53-b6d0-a9fd7295246b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:06.923408 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-cb497c35-99c8-4d53-b6d0-a9fd7295246b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 236954ea-2791-477d-a92b-88e590593c63] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:06.936152 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb497c35-99c8-4d53-b6d0-a9fd7295246b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:06.937623 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb497c35-99c8-4d53-b6d0-a9fd7295246b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:06.938377 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb497c35-99c8-4d53-b6d0-a9fd7295246b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:06.943240 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb497c35-99c8-4d53-b6d0-a9fd7295246b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:06.944186 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb497c35-99c8-4d53-b6d0-a9fd7295246b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:06.945205 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb497c35-99c8-4d53-b6d0-a9fd7295246b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:07.171755 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=4 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:52:07.261834 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-98b279f1-a587-440e-a556-418103b9c450 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:07.272985 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-98b279f1-a587-440e-a556-418103b9c450 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/4770c3f5-5b3d-40da-9507-85b77d673094" status: 200 len: 1316 microversion: 2.1 time: 0.444806 Aug 31 15:52:07.287159 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 414/840] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:06 2022] GET /compute/v2.1/servers/4770c3f5-5b3d-40da-9507-85b77d673094 => generated 1316 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:07.298631 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d1de735d-acf7-4657-998e-127fe2df91cb tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:07.302857 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d1de735d-acf7-4657-998e-127fe2df91cb tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] [instance: 3b33f103-9c08-4775-975c-3f815d99a70e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:07.316287 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d1de735d-acf7-4657-998e-127fe2df91cb tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:07.317589 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d1de735d-acf7-4657-998e-127fe2df91cb tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:07.318220 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d1de735d-acf7-4657-998e-127fe2df91cb tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:07.319158 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d1de735d-acf7-4657-998e-127fe2df91cb tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:07.320411 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d1de735d-acf7-4657-998e-127fe2df91cb tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:07.321835 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d1de735d-acf7-4657-998e-127fe2df91cb tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:07.342815 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-cb497c35-99c8-4d53-b6d0-a9fd7295246b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:07.360141 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-cb497c35-99c8-4d53-b6d0-a9fd7295246b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63" status: 200 len: 1471 microversion: 2.1 time: 0.446353 Aug 31 15:52:07.365078 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 427/841] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:06 2022] GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63 => generated 1471 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:07.375731 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-ae22f72b-bae6-4a6b-af3b-986710515d8a req-14ba491a-d064-4501-b880-06f74f1640fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ccef73e-5e82-42e7-a2cb-ef2e49f3a035", "tag": "dfe16a0a-a802-4494-ac84-4d7be18928d2"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:52:07.401754 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-ae22f72b-bae6-4a6b-af3b-986710515d8a req-14ba491a-d064-4501-b880-06f74f1640fb service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:07.402355 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-ae22f72b-bae6-4a6b-af3b-986710515d8a req-14ba491a-d064-4501-b880-06f74f1640fb service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:07.403628 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-ae22f72b-bae6-4a6b-af3b-986710515d8a req-14ba491a-d064-4501-b880-06f74f1640fb service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:07.419949 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-ae22f72b-bae6-4a6b-af3b-986710515d8a req-14ba491a-d064-4501-b880-06f74f1640fb service nova] Creating event network-changed:dfe16a0a-a802-4494-ac84-4d7be18928d2 for instance 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035 on n-h2-833090-16 Aug 31 15:52:07.429907 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-ae22f72b-bae6-4a6b-af3b-986710515d8a req-14ba491a-d064-4501-b880-06f74f1640fb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063040 Aug 31 15:52:07.435530 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 428/842] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:52:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:52:07.443192 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-979b0278-4615-4dad-a9c0-8ed7d9436efe tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:07.444026 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-979b0278-4615-4dad-a9c0-8ed7d9436efe tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] [instance: a21daf16-afa5-4cad-8f8c-6ca10636601d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:07.450878 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-979b0278-4615-4dad-a9c0-8ed7d9436efe tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:07.451447 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-979b0278-4615-4dad-a9c0-8ed7d9436efe tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:07.451942 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-979b0278-4615-4dad-a9c0-8ed7d9436efe tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:07.452707 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-979b0278-4615-4dad-a9c0-8ed7d9436efe tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:07.453222 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-979b0278-4615-4dad-a9c0-8ed7d9436efe tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:07.453707 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-979b0278-4615-4dad-a9c0-8ed7d9436efe tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:07.690588 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-979b0278-4615-4dad-a9c0-8ed7d9436efe tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d" status: 200 len: 1632 microversion: 2.1 time: 0.252552 Aug 31 15:52:07.702461 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 429/843] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:07 2022] GET /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d => generated 1632 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:07.707673 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-949fbcdd-d566-4645-9f8b-fbc41328a410 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:07.708284 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-949fbcdd-d566-4645-9f8b-fbc41328a410 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:07.722806 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-949fbcdd-d566-4645-9f8b-fbc41328a410 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:07.723288 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-949fbcdd-d566-4645-9f8b-fbc41328a410 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:07.723739 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-949fbcdd-d566-4645-9f8b-fbc41328a410 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:07.724412 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-949fbcdd-d566-4645-9f8b-fbc41328a410 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:07.724856 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-949fbcdd-d566-4645-9f8b-fbc41328a410 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:07.725560 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-949fbcdd-d566-4645-9f8b-fbc41328a410 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:07.753733 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d1de735d-acf7-4657-998e-127fe2df91cb tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704d7c428d3e4a1bbe5fb78485415214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a08078ba5a04c31b6cc63dee67be8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:07.762249 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d1de735d-acf7-4657-998e-127fe2df91cb tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] 10.222.0.50 "GET /compute/v2.1/servers/3b33f103-9c08-4775-975c-3f815d99a70e" status: 200 len: 1515 microversion: 2.1 time: 0.473640 Aug 31 15:52:07.762849 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 415/844] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:07 2022] GET /compute/v2.1/servers/3b33f103-9c08-4775-975c-3f815d99a70e => generated 1515 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:07.848883 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4dfc9c3e-1fc4-4a51-81ff-4ced8da4adac tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:07.850806 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4dfc9c3e-1fc4-4a51-81ff-4ced8da4adac tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] [instance: 14dbaad0-9a67-48c0-a58b-5d9997c078c5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:07.874427 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4dfc9c3e-1fc4-4a51-81ff-4ced8da4adac tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:07.879173 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4dfc9c3e-1fc4-4a51-81ff-4ced8da4adac tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:07.880366 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4dfc9c3e-1fc4-4a51-81ff-4ced8da4adac tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:07.881438 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4dfc9c3e-1fc4-4a51-81ff-4ced8da4adac tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:07.893987 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4dfc9c3e-1fc4-4a51-81ff-4ced8da4adac tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:07.896853 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4dfc9c3e-1fc4-4a51-81ff-4ced8da4adac tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:08.264472 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-949fbcdd-d566-4645-9f8b-fbc41328a410 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:08.302248 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-949fbcdd-d566-4645-9f8b-fbc41328a410 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:08.308341 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-949fbcdd-d566-4645-9f8b-fbc41328a410 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:08.310677 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-949fbcdd-d566-4645-9f8b-fbc41328a410 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035" status: 200 len: 1566 microversion: 2.25 time: 0.607119 Aug 31 15:52:08.322428 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 430/845] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:52:07 2022] GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035 => generated 1566 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:52:08.325321 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1f2fa74f-8ee5-4d93-8301-8ebe1c2299f5 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:08.325934 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1f2fa74f-8ee5-4d93-8301-8ebe1c2299f5 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 4770c3f5-5b3d-40da-9507-85b77d673094] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:08.338749 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1f2fa74f-8ee5-4d93-8301-8ebe1c2299f5 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:08.339243 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1f2fa74f-8ee5-4d93-8301-8ebe1c2299f5 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:08.339679 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1f2fa74f-8ee5-4d93-8301-8ebe1c2299f5 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:08.340375 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1f2fa74f-8ee5-4d93-8301-8ebe1c2299f5 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:08.353302 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1f2fa74f-8ee5-4d93-8301-8ebe1c2299f5 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:08.354070 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1f2fa74f-8ee5-4d93-8301-8ebe1c2299f5 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:08.366632 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4dfc9c3e-1fc4-4a51-81ff-4ced8da4adac tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1cd6d56b0de45179f1b46829536bbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806480da4ae74a23aa20b86e3d6305f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:08.374494 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4dfc9c3e-1fc4-4a51-81ff-4ced8da4adac tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] 10.222.0.50 "GET /compute/v2.1/servers/14dbaad0-9a67-48c0-a58b-5d9997c078c5" status: 200 len: 1316 microversion: 2.1 time: 0.532161 Aug 31 15:52:08.377374 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 416/846] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:07 2022] GET /compute/v2.1/servers/14dbaad0-9a67-48c0-a58b-5d9997c078c5 => generated 1316 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:08.393672 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c00eb805-7a5f-4c3c-a63a-6de88d1ac749 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:08.394641 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c00eb805-7a5f-4c3c-a63a-6de88d1ac749 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 236954ea-2791-477d-a92b-88e590593c63] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:08.404108 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c00eb805-7a5f-4c3c-a63a-6de88d1ac749 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:08.404961 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c00eb805-7a5f-4c3c-a63a-6de88d1ac749 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:08.405624 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c00eb805-7a5f-4c3c-a63a-6de88d1ac749 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:08.406569 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c00eb805-7a5f-4c3c-a63a-6de88d1ac749 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:08.407534 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c00eb805-7a5f-4c3c-a63a-6de88d1ac749 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:08.408359 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c00eb805-7a5f-4c3c-a63a-6de88d1ac749 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:08.773353 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1f2fa74f-8ee5-4d93-8301-8ebe1c2299f5 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:08.792207 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1f2fa74f-8ee5-4d93-8301-8ebe1c2299f5 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/4770c3f5-5b3d-40da-9507-85b77d673094" status: 200 len: 1316 microversion: 2.1 time: 0.461819 Aug 31 15:52:08.793669 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 431/847] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:08 2022] GET /compute/v2.1/servers/4770c3f5-5b3d-40da-9507-85b77d673094 => generated 1316 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:08.802421 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ac9191c3-9979-45d4-bf0d-95fdfd838f23 tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:08.815090 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ac9191c3-9979-45d4-bf0d-95fdfd838f23 tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] [instance: a21daf16-afa5-4cad-8f8c-6ca10636601d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:08.822441 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ac9191c3-9979-45d4-bf0d-95fdfd838f23 tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:08.823216 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ac9191c3-9979-45d4-bf0d-95fdfd838f23 tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:08.823651 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ac9191c3-9979-45d4-bf0d-95fdfd838f23 tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:08.824353 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ac9191c3-9979-45d4-bf0d-95fdfd838f23 tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:08.824834 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ac9191c3-9979-45d4-bf0d-95fdfd838f23 tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:08.825217 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ac9191c3-9979-45d4-bf0d-95fdfd838f23 tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:08.898188 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c00eb805-7a5f-4c3c-a63a-6de88d1ac749 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:08.908739 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c00eb805-7a5f-4c3c-a63a-6de88d1ac749 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63" status: 200 len: 1471 microversion: 2.1 time: 0.520104 Aug 31 15:52:08.909344 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 417/848] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:08 2022] GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63 => generated 1471 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:52:08.919473 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1115eae0-141e-40d4-a9af-855028f50d9d tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:08.920346 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1115eae0-141e-40d4-a9af-855028f50d9d tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] [instance: 3b33f103-9c08-4775-975c-3f815d99a70e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:08.936237 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1115eae0-141e-40d4-a9af-855028f50d9d tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:08.937020 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1115eae0-141e-40d4-a9af-855028f50d9d tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:08.937608 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1115eae0-141e-40d4-a9af-855028f50d9d tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:08.938555 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1115eae0-141e-40d4-a9af-855028f50d9d tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:08.939156 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1115eae0-141e-40d4-a9af-855028f50d9d tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:08.942752 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1115eae0-141e-40d4-a9af-855028f50d9d tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:09.296678 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ac9191c3-9979-45d4-bf0d-95fdfd838f23 tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d" status: 200 len: 1615 microversion: 2.1 time: 0.501600 Aug 31 15:52:09.297422 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 432/849] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:08 2022] GET /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d => generated 1615 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:09.304936 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-79c9b2ac-f7b3-41c0-95d8-adc776820163 req-f7a35ab8-62c2-4bf1-a1ca-8e2f100a233e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14dbaad0-9a67-48c0-a58b-5d9997c078c5", "tag": "5f62d425-884d-403a-93a6-ae540948466b"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:52:09.330427 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-79c9b2ac-f7b3-41c0-95d8-adc776820163 req-f7a35ab8-62c2-4bf1-a1ca-8e2f100a233e service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:09.331277 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-79c9b2ac-f7b3-41c0-95d8-adc776820163 req-f7a35ab8-62c2-4bf1-a1ca-8e2f100a233e service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:09.331876 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-79c9b2ac-f7b3-41c0-95d8-adc776820163 req-f7a35ab8-62c2-4bf1-a1ca-8e2f100a233e service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:09.365175 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1115eae0-141e-40d4-a9af-855028f50d9d tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704d7c428d3e4a1bbe5fb78485415214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a08078ba5a04c31b6cc63dee67be8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:09.369575 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-79c9b2ac-f7b3-41c0-95d8-adc776820163 req-f7a35ab8-62c2-4bf1-a1ca-8e2f100a233e service nova] Creating event network-changed:5f62d425-884d-403a-93a6-ae540948466b for instance 14dbaad0-9a67-48c0-a58b-5d9997c078c5 on n-h2-833090-16 Aug 31 15:52:09.378083 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-79c9b2ac-f7b3-41c0-95d8-adc776820163 req-f7a35ab8-62c2-4bf1-a1ca-8e2f100a233e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078524 Aug 31 15:52:09.379166 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1115eae0-141e-40d4-a9af-855028f50d9d tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] 10.222.0.50 "GET /compute/v2.1/servers/3b33f103-9c08-4775-975c-3f815d99a70e" status: 200 len: 1515 microversion: 2.1 time: 0.464956 Aug 31 15:52:09.379840 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 433/850] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:52:09.381374 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 418/851] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:08 2022] GET /compute/v2.1/servers/3b33f103-9c08-4775-975c-3f815d99a70e => generated 1515 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:09.386389 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-46637e4b-d9bb-4f2e-9054-53aeaed832de tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:52:09.389148 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-46637e4b-d9bb-4f2e-9054-53aeaed832de tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] [instance: a21daf16-afa5-4cad-8f8c-6ca10636601d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:09.390722 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a75f97ee-dc7d-480e-8418-6a7bfab8d699 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:09.391944 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a75f97ee-dc7d-480e-8418-6a7bfab8d699 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:09.399988 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-46637e4b-d9bb-4f2e-9054-53aeaed832de tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:09.401066 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-46637e4b-d9bb-4f2e-9054-53aeaed832de tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:09.402514 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-46637e4b-d9bb-4f2e-9054-53aeaed832de tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:09.402959 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a75f97ee-dc7d-480e-8418-6a7bfab8d699 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:09.403462 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a75f97ee-dc7d-480e-8418-6a7bfab8d699 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:09.404127 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-46637e4b-d9bb-4f2e-9054-53aeaed832de tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:09.404243 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a75f97ee-dc7d-480e-8418-6a7bfab8d699 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:09.405711 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-46637e4b-d9bb-4f2e-9054-53aeaed832de tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:09.406436 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-46637e4b-d9bb-4f2e-9054-53aeaed832de tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:09.421119 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a75f97ee-dc7d-480e-8418-6a7bfab8d699 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:09.423485 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a75f97ee-dc7d-480e-8418-6a7bfab8d699 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:09.427998 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a75f97ee-dc7d-480e-8418-6a7bfab8d699 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:09.464052 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-46637e4b-d9bb-4f2e-9054-53aeaed832de tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] HTTP exception thrown: Cannot 'migrate' instance a21daf16-afa5-4cad-8f8c-6ca10636601d while it is in vm_state suspended Aug 31 15:52:09.466646 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-46637e4b-d9bb-4f2e-9054-53aeaed832de tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] Request method failure captured: Aug 31 15:52:09.466646 n-d-833090-16 devstack@n-api.service[128864]: request: POST /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d/action HTTP/1.1 Aug 31 15:52:09.466646 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:52:09.466646 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:52:09.466646 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:52:09.466646 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 15 Aug 31 15:52:09.466646 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:52:09.466646 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:52:09.466646 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:52:09.466646 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:52:09.466646 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4NxEsjAP9kLGq6RzhMXix5dQRBooJoncvRdCA4wHvH8cQeUmDocKUaLt6mYXngMgURd6jqrjKjKoC1Z_mLqWI-B-I82_TJT9s7_PFk74be6UYa1zJHE9GmzCTgZWVT0sZPgASnHy0DiDIyzsPULe6VEYpx4cLkptTx16dh_b-__qSg Aug 31 15:52:09.466646 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:52:09.466646 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:52:09.466646 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:52:09.466646 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:52:09.466646 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:52:09.466646 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:52:09.466646 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 61de52d5f68c469d9201da6a357eaf3b Aug 31 15:52:09.466646 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1115837278 Aug 31 15:52:09.466646 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,admin,member Aug 31 15:52:09.466646 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,admin,member Aug 31 15:52:09.468225 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/61de52d5f68c469d9201da6a357eaf3b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/61de52d5f68c469d9201da6a357eaf3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/61de52d5f68c469d9201da6a357eaf3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_61de52d5f68c469d9201da6a357eaf3b", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:52:09.468225 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1115837278 Aug 31 15:52:09.468225 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 61de52d5f68c469d9201da6a357eaf3b Aug 31 15:52:09.468225 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1115837278 Aug 31 15:52:09.468225 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServersAdminNegativeTestJSON-1115837278-project-admin Aug 31 15:52:09.468225 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:52:09.468225 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:52:09.468225 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 581bfe2e15404e9e95d4b1b20e87de42 Aug 31 15:52:09.468225 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1115837278-project-admin Aug 31 15:52:09.468225 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 15:52:09.468225 n-d-833090-16 devstack@n-api.service[128864]: {"migrate": {}} Aug 31 15:52:09.468225 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:52:09.468225 n-d-833090-16 devstack@n-api.service[128864]: exception: Cannot 'migrate' instance a21daf16-afa5-4cad-8f8c-6ca10636601d while it is in vm_state suspended Aug 31 15:52:09.469069 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'a21daf16-afa5-4cad-8f8c-6ca10636601d', 'body': {'migrate': {}}} Aug 31 15:52:09.469069 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:52:09.469069 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:09.469069 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Aug 31 15:52:09.469069 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Aug 31 15:52:09.469069 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 31 15:52:09.469069 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 15:52:09.469069 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 31 15:52:09.469069 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 31 15:52:09.469069 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 31 15:52:09.469069 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 31 15:52:09.469069 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 15:52:09.469069 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 15:52:09.469069 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 15:52:09.469069 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 15:52:09.469069 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a21daf16-afa5-4cad-8f8c-6ca10636601d in vm_state suspended. Cannot resize while the instance is in this state. Aug 31 15:52:09.469069 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:09.469069 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:52:09.469069 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:09.469069 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:09.470317 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:52:09.470317 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:52:09.470317 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:52:09.470317 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:52:09.470317 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:52:09.470317 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:52:09.470317 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:52:09.470317 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:52:09.470317 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Aug 31 15:52:09.470317 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 15:52:09.470317 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 15:52:09.470317 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 15:52:09.470317 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance a21daf16-afa5-4cad-8f8c-6ca10636601d while it is in vm_state suspended Aug 31 15:52:09.470317 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:09.470317 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:52:09.470317 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:09.470317 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:09.470317 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:52:09.470317 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:52:09.477857 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:52:09.477857 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:52:09.477857 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance a21daf16-afa5-4cad-8f8c-6ca10636601d while it is in vm_state suspended Aug 31 15:52:09.477857 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:09.477857 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-46637e4b-d9bb-4f2e-9054-53aeaed832de tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] Returning 409 to user: Cannot 'migrate' instance a21daf16-afa5-4cad-8f8c-6ca10636601d while it is in vm_state suspended {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:52:09.477857 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-46637e4b-d9bb-4f2e-9054-53aeaed832de tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d/action" status: 409 len: 148 microversion: 2.1 time: 0.086812 Aug 31 15:52:09.477857 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 434/852] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 15:52:09 2022] POST /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d/action => generated 148 bytes in 88 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 15:52:09.477857 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e3b91e61-73a8-4bca-b2a3-7391949eb10c tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:09.479389 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e3b91e61-73a8-4bca-b2a3-7391949eb10c tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] [instance: 14dbaad0-9a67-48c0-a58b-5d9997c078c5] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:09.482021 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e3b91e61-73a8-4bca-b2a3-7391949eb10c tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:09.482550 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e3b91e61-73a8-4bca-b2a3-7391949eb10c tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:09.483229 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e3b91e61-73a8-4bca-b2a3-7391949eb10c tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:09.483970 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e3b91e61-73a8-4bca-b2a3-7391949eb10c tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:09.484667 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e3b91e61-73a8-4bca-b2a3-7391949eb10c tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:09.487285 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e3b91e61-73a8-4bca-b2a3-7391949eb10c tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:09.885797 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e3b91e61-73a8-4bca-b2a3-7391949eb10c tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1cd6d56b0de45179f1b46829536bbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806480da4ae74a23aa20b86e3d6305f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:09.898477 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e3b91e61-73a8-4bca-b2a3-7391949eb10c tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] 10.222.0.50 "GET /compute/v2.1/servers/14dbaad0-9a67-48c0-a58b-5d9997c078c5" status: 200 len: 1316 microversion: 2.1 time: 0.428384 Aug 31 15:52:09.903577 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 435/853] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:09 2022] GET /compute/v2.1/servers/14dbaad0-9a67-48c0-a58b-5d9997c078c5 => generated 1316 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:09.914289 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6ed14419-4650-4bc4-aeea-46317a141f33 tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:52:09.919699 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6ed14419-4650-4bc4-aeea-46317a141f33 tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] Request method failure captured: Aug 31 15:52:09.919699 n-d-833090-16 devstack@n-api.service[128864]: request: POST /compute/v2.1/servers/842a551a-278d-4bd3-82e5-91a4c271d69a/action HTTP/1.1 Aug 31 15:52:09.919699 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:52:09.919699 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:52:09.919699 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:52:09.919699 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 39 Aug 31 15:52:09.919699 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:52:09.919699 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:52:09.919699 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:52:09.919699 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:52:09.919699 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4NxEsjAP9kLGq6RzhMXix5dQRBooJoncvRdCA4wHvH8cQeUmDocKUaLt6mYXngMgURd6jqrjKjKoC1Z_mLqWI-B-I82_TJT9s7_PFk74be6UYa1zJHE9GmzCTgZWVT0sZPgASnHy0DiDIyzsPULe6VEYpx4cLkptTx16dh_b-__qSg Aug 31 15:52:09.919699 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:52:09.919699 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:52:09.919699 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:52:09.919699 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:52:09.919699 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:52:09.919699 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:52:09.919699 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 61de52d5f68c469d9201da6a357eaf3b Aug 31 15:52:09.919699 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1115837278 Aug 31 15:52:09.919699 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,admin,member Aug 31 15:52:09.919699 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,admin,member Aug 31 15:52:09.921037 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/61de52d5f68c469d9201da6a357eaf3b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/61de52d5f68c469d9201da6a357eaf3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/61de52d5f68c469d9201da6a357eaf3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_61de52d5f68c469d9201da6a357eaf3b", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:52:09.921037 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1115837278 Aug 31 15:52:09.921037 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 61de52d5f68c469d9201da6a357eaf3b Aug 31 15:52:09.921037 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1115837278 Aug 31 15:52:09.921037 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServersAdminNegativeTestJSON-1115837278-project-admin Aug 31 15:52:09.921037 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:52:09.921037 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:52:09.921037 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 581bfe2e15404e9e95d4b1b20e87de42 Aug 31 15:52:09.921037 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1115837278-project-admin Aug 31 15:52:09.921037 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 15:52:09.921037 n-d-833090-16 devstack@n-api.service[128864]: {"os-resetState": {"state": "invalid"}} Aug 31 15:52:09.921037 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:52:09.921763 n-d-833090-16 devstack@n-api.service[128864]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 31 15:52:09.921763 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '842a551a-278d-4bd3-82e5-91a4c271d69a', 'body': {'os-resetState': {'state': 'invalid'}}} Aug 31 15:52:09.921763 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:52:09.921763 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:09.921763 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 15:52:09.921763 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 15:52:09.921763 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 15:52:09.921763 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise error Aug 31 15:52:09.921763 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Aug 31 15:52:09.921763 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:09.921763 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Aug 31 15:52:09.921763 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 31 15:52:09.921763 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:09.921763 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 31 15:52:09.921763 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi 'invalid' Aug 31 15:52:09.921763 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:09.921763 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:52:09.921763 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:09.921763 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:09.921763 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:52:09.921763 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:52:09.921763 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:52:09.923126 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:52:09.923126 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:52:09.923126 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:52:09.923126 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 15:52:09.923126 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 15:52:09.923126 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 15:52:09.923126 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 15:52:09.923126 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 15:52:09.923126 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 15:52:09.923126 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 31 15:52:09.923126 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:09.923126 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:52:09.923126 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:09.923126 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:09.923126 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:52:09.923126 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:52:09.923126 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 15:52:09.923126 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 15:52:09.923126 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 31 15:52:09.924270 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:09.924270 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6ed14419-4650-4bc4-aeea-46317a141f33 tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:52:09.924270 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6ed14419-4650-4bc4-aeea-46317a141f33 tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/842a551a-278d-4bd3-82e5-91a4c271d69a/action" status: 400 len: 144 microversion: 2.1 time: 0.015320 Aug 31 15:52:09.926840 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 436/854] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 15:52:09 2022] POST /compute/v2.1/servers/842a551a-278d-4bd3-82e5-91a4c271d69a/action => generated 144 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 15:52:09.933664 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-63320312-b1f8-4d74-846d-f5f03308f68c tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:09.934515 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-63320312-b1f8-4d74-846d-f5f03308f68c tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 4770c3f5-5b3d-40da-9507-85b77d673094] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:09.945230 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-63320312-b1f8-4d74-846d-f5f03308f68c tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:09.945728 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-63320312-b1f8-4d74-846d-f5f03308f68c tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:09.946161 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-63320312-b1f8-4d74-846d-f5f03308f68c tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:09.947308 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-63320312-b1f8-4d74-846d-f5f03308f68c tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:09.947807 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-63320312-b1f8-4d74-846d-f5f03308f68c tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:09.948225 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-63320312-b1f8-4d74-846d-f5f03308f68c tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:09.987337 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a75f97ee-dc7d-480e-8418-6a7bfab8d699 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:10.001408 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a75f97ee-dc7d-480e-8418-6a7bfab8d699 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:10.002904 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a75f97ee-dc7d-480e-8418-6a7bfab8d699 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:10.004089 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a75f97ee-dc7d-480e-8418-6a7bfab8d699 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035" status: 200 len: 1566 microversion: 2.25 time: 0.621708 Aug 31 15:52:10.004657 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 419/855] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:52:09 2022] GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035 => generated 1566 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:52:10.036310 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-4091a12b-714b-4e25-a8a0-12c1437023ff req-1cb0bdf0-e7a2-4ef4-8f77-6b75f6a3f95a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b33f103-9c08-4775-975c-3f815d99a70e", "name": "network-vif-deleted", "tag": "6972e09f-ac79-4712-9a38-b8d3859e2423"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:52:10.056593 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4091a12b-714b-4e25-a8a0-12c1437023ff req-1cb0bdf0-e7a2-4ef4-8f77-6b75f6a3f95a service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:10.057440 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4091a12b-714b-4e25-a8a0-12c1437023ff req-1cb0bdf0-e7a2-4ef4-8f77-6b75f6a3f95a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:10.058120 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4091a12b-714b-4e25-a8a0-12c1437023ff req-1cb0bdf0-e7a2-4ef4-8f77-6b75f6a3f95a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:10.080675 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-4091a12b-714b-4e25-a8a0-12c1437023ff req-1cb0bdf0-e7a2-4ef4-8f77-6b75f6a3f95a service nova] Creating event network-vif-deleted:6972e09f-ac79-4712-9a38-b8d3859e2423 for instance 3b33f103-9c08-4775-975c-3f815d99a70e on n-h1-833090-16 Aug 31 15:52:10.089716 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-4091a12b-714b-4e25-a8a0-12c1437023ff req-1cb0bdf0-e7a2-4ef4-8f77-6b75f6a3f95a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057844 Aug 31 15:52:10.090954 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 420/856] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:52:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:52:10.097641 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b82a737b-9239-42eb-814f-de86fffd8616 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:10.098855 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b82a737b-9239-42eb-814f-de86fffd8616 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 236954ea-2791-477d-a92b-88e590593c63] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:10.116222 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b82a737b-9239-42eb-814f-de86fffd8616 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:10.117380 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b82a737b-9239-42eb-814f-de86fffd8616 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:10.118154 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b82a737b-9239-42eb-814f-de86fffd8616 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:10.119268 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b82a737b-9239-42eb-814f-de86fffd8616 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:10.120071 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b82a737b-9239-42eb-814f-de86fffd8616 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:10.120732 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b82a737b-9239-42eb-814f-de86fffd8616 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:10.467136 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-63320312-b1f8-4d74-846d-f5f03308f68c tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:10.479676 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-63320312-b1f8-4d74-846d-f5f03308f68c tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/4770c3f5-5b3d-40da-9507-85b77d673094" status: 200 len: 1316 microversion: 2.1 time: 0.551557 Aug 31 15:52:10.503882 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 437/857] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:09 2022] GET /compute/v2.1/servers/4770c3f5-5b3d-40da-9507-85b77d673094 => generated 1316 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:10.512509 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-42e475d2-4fa1-4dff-9df8-52ef780eedda tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:52:10.516324 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-42e475d2-4fa1-4dff-9df8-52ef780eedda tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] Request method failure captured: Aug 31 15:52:10.516324 n-d-833090-16 devstack@n-api.service[128864]: request: POST /compute/v2.1/servers/842a551a-278d-4bd3-82e5-91a4c271d69a/action HTTP/1.1 Aug 31 15:52:10.516324 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:52:10.516324 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:52:10.516324 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:52:10.516324 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 31 Aug 31 15:52:10.516324 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:52:10.516324 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:52:10.516324 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:52:10.516324 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:52:10.516324 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4NxEsjAP9kLGq6RzhMXix5dQRBooJoncvRdCA4wHvH8cQeUmDocKUaLt6mYXngMgURd6jqrjKjKoC1Z_mLqWI-B-I82_TJT9s7_PFk74be6UYa1zJHE9GmzCTgZWVT0sZPgASnHy0DiDIyzsPULe6VEYpx4cLkptTx16dh_b-__qSg Aug 31 15:52:10.516324 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:52:10.516324 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:52:10.516324 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:52:10.516324 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:52:10.516324 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:52:10.516324 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:52:10.516324 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 61de52d5f68c469d9201da6a357eaf3b Aug 31 15:52:10.516324 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1115837278 Aug 31 15:52:10.516324 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,admin,member Aug 31 15:52:10.516324 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,admin,member Aug 31 15:52:10.517615 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/61de52d5f68c469d9201da6a357eaf3b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/61de52d5f68c469d9201da6a357eaf3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/61de52d5f68c469d9201da6a357eaf3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_61de52d5f68c469d9201da6a357eaf3b", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:52:10.517615 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1115837278 Aug 31 15:52:10.517615 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 61de52d5f68c469d9201da6a357eaf3b Aug 31 15:52:10.517615 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1115837278 Aug 31 15:52:10.517615 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServersAdminNegativeTestJSON-1115837278-project-admin Aug 31 15:52:10.517615 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:52:10.517615 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:52:10.517615 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 581bfe2e15404e9e95d4b1b20e87de42 Aug 31 15:52:10.517615 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1115837278-project-admin Aug 31 15:52:10.517615 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 15:52:10.517615 n-d-833090-16 devstack@n-api.service[128864]: {"os-resetState": {"state": 1}} Aug 31 15:52:10.517615 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:52:10.517615 n-d-833090-16 devstack@n-api.service[128864]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 31 15:52:10.518534 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '842a551a-278d-4bd3-82e5-91a4c271d69a', 'body': {'os-resetState': {'state': 1}}} Aug 31 15:52:10.518534 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:52:10.518534 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:10.518534 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 15:52:10.518534 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 15:52:10.518534 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 15:52:10.518534 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise error Aug 31 15:52:10.518534 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Aug 31 15:52:10.518534 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:10.518534 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Aug 31 15:52:10.518534 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 31 15:52:10.518534 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:10.518534 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 31 15:52:10.518534 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi 1 Aug 31 15:52:10.518534 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:10.518534 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:52:10.518534 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:10.518534 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:10.518534 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:52:10.518534 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:52:10.518534 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:52:10.518534 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:52:10.519806 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:52:10.519806 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:52:10.519806 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 15:52:10.519806 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 15:52:10.519806 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 15:52:10.519806 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 15:52:10.519806 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 15:52:10.519806 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 15:52:10.519806 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 31 15:52:10.519806 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:10.519806 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:52:10.519806 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:10.519806 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:10.519806 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:52:10.519806 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:52:10.519806 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 15:52:10.519806 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 15:52:10.519806 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 31 15:52:10.519806 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:10.524122 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-42e475d2-4fa1-4dff-9df8-52ef780eedda tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:52:10.524122 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-42e475d2-4fa1-4dff-9df8-52ef780eedda tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/842a551a-278d-4bd3-82e5-91a4c271d69a/action" status: 400 len: 120 microversion: 2.1 time: 0.012751 Aug 31 15:52:10.525721 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b82a737b-9239-42eb-814f-de86fffd8616 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:10.535133 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b82a737b-9239-42eb-814f-de86fffd8616 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63" status: 200 len: 1471 microversion: 2.1 time: 0.442515 Aug 31 15:52:10.536803 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 438/858] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 15:52:10 2022] POST /compute/v2.1/servers/842a551a-278d-4bd3-82e5-91a4c271d69a/action => generated 120 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 15:52:10.542039 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8bd0a24c-4941-448e-aa1c-5ae88e6518b6 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:10.542664 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8bd0a24c-4941-448e-aa1c-5ae88e6518b6 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] [instance: 3b33f103-9c08-4775-975c-3f815d99a70e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:10.550310 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8bd0a24c-4941-448e-aa1c-5ae88e6518b6 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:10.551080 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8bd0a24c-4941-448e-aa1c-5ae88e6518b6 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:10.551668 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8bd0a24c-4941-448e-aa1c-5ae88e6518b6 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:10.552563 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8bd0a24c-4941-448e-aa1c-5ae88e6518b6 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:10.553289 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8bd0a24c-4941-448e-aa1c-5ae88e6518b6 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:10.554216 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8bd0a24c-4941-448e-aa1c-5ae88e6518b6 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:10.556213 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 421/859] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:10 2022] GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63 => generated 1471 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:10.561926 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3c3293a5-7002-47b7-b820-e98d1a6643a2 tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:52:10.564933 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3c3293a5-7002-47b7-b820-e98d1a6643a2 tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] Failed to fetch instance by id 999 {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 31 15:52:10.565646 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-3c3293a5-7002-47b7-b820-e98d1a6643a2 tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] HTTP exception thrown: Instance 999 could not be found. Aug 31 15:52:10.571837 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3c3293a5-7002-47b7-b820-e98d1a6643a2 tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] Request method failure captured: Aug 31 15:52:10.571837 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Aug 31 15:52:10.571837 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:52:10.571837 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:52:10.571837 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:52:10.571837 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 37 Aug 31 15:52:10.571837 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:52:10.571837 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:52:10.571837 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:52:10.571837 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:52:10.571837 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4NxEsjAP9kLGq6RzhMXix5dQRBooJoncvRdCA4wHvH8cQeUmDocKUaLt6mYXngMgURd6jqrjKjKoC1Z_mLqWI-B-I82_TJT9s7_PFk74be6UYa1zJHE9GmzCTgZWVT0sZPgASnHy0DiDIyzsPULe6VEYpx4cLkptTx16dh_b-__qSg Aug 31 15:52:10.571837 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:52:10.571837 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:52:10.571837 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:52:10.571837 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:52:10.571837 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:52:10.571837 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:52:10.571837 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 61de52d5f68c469d9201da6a357eaf3b Aug 31 15:52:10.571837 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1115837278 Aug 31 15:52:10.571837 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,admin,member Aug 31 15:52:10.571837 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,admin,member Aug 31 15:52:10.573359 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/61de52d5f68c469d9201da6a357eaf3b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/61de52d5f68c469d9201da6a357eaf3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/61de52d5f68c469d9201da6a357eaf3b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_61de52d5f68c469d9201da6a357eaf3b", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:52:10.573359 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1115837278 Aug 31 15:52:10.573359 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 61de52d5f68c469d9201da6a357eaf3b Aug 31 15:52:10.573359 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1115837278 Aug 31 15:52:10.573359 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServersAdminNegativeTestJSON-1115837278-project-admin Aug 31 15:52:10.573359 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:52:10.573359 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:52:10.573359 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 581bfe2e15404e9e95d4b1b20e87de42 Aug 31 15:52:10.573359 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1115837278-project-admin Aug 31 15:52:10.573359 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 15:52:10.573359 n-d-833090-16 devstack@n-api.service[128863]: {"os-resetState": {"state": "error"}} Aug 31 15:52:10.573359 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 15:52:10.573359 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 999 could not be found. Aug 31 15:52:10.574157 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Aug 31 15:52:10.574157 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:52:10.574157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:10.574157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:52:10.574157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:52:10.574157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 31 15:52:10.574157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 31 15:52:10.574157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 31 15:52:10.574157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:52:10.574157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:52:10.574157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:52:10.574157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:10.574157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:52:10.574157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:52:10.574157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:52:10.574157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:52:10.574157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:52:10.574157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:52:10.574157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:52:10.574157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:52:10.574157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Aug 31 15:52:10.575373 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 31 15:52:10.575373 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:52:10.575373 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:52:10.575373 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 31 15:52:10.575373 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:52:10.575373 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:52:10.575373 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:52:10.575373 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:10.575373 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:52:10.575373 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:52:10.575373 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:52:10.575373 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:52:10.575373 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 31 15:52:10.575373 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:52:10.579148 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3c3293a5-7002-47b7-b820-e98d1a6643a2 tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:52:10.581126 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3c3293a5-7002-47b7-b820-e98d1a6643a2 tempest-ServersAdminNegativeTestJSON-1115837278 tempest-ServersAdminNegativeTestJSON-1115837278-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.023463 Aug 31 15:52:10.581969 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 422/860] 10.222.0.50 () {60 vars in 1179 bytes} [Wed Aug 31 15:52:10 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 15:52:10.598059 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8bd0a24c-4941-448e-aa1c-5ae88e6518b6 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:10.598578 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8bd0a24c-4941-448e-aa1c-5ae88e6518b6 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:10.599263 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8bd0a24c-4941-448e-aa1c-5ae88e6518b6 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:10.600143 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-8bd0a24c-4941-448e-aa1c-5ae88e6518b6 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lazy-loading 'fault' on Instance uuid 3b33f103-9c08-4775-975c-3f815d99a70e {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:52:10.604396 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:52:10.606875 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c84d349e-2e1b-454c-aa12-0489dabd1976 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:10.607376 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c84d349e-2e1b-454c-aa12-0489dabd1976 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] [instance: a21daf16-afa5-4cad-8f8c-6ca10636601d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:10.618869 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c84d349e-2e1b-454c-aa12-0489dabd1976 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:10.619373 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c84d349e-2e1b-454c-aa12-0489dabd1976 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:10.620285 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c84d349e-2e1b-454c-aa12-0489dabd1976 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:10.621474 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c84d349e-2e1b-454c-aa12-0489dabd1976 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:10.622497 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c84d349e-2e1b-454c-aa12-0489dabd1976 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:10.623080 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c84d349e-2e1b-454c-aa12-0489dabd1976 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:10.656403 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c84d349e-2e1b-454c-aa12-0489dabd1976 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] [instance: a21daf16-afa5-4cad-8f8c-6ca10636601d] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:52:10.718363 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8bd0a24c-4941-448e-aa1c-5ae88e6518b6 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704d7c428d3e4a1bbe5fb78485415214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a08078ba5a04c31b6cc63dee67be8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:10.738175 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8bd0a24c-4941-448e-aa1c-5ae88e6518b6 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] 10.222.0.50 "GET /compute/v2.1/servers/3b33f103-9c08-4775-975c-3f815d99a70e" status: 200 len: 1308 microversion: 2.1 time: 0.197037 Aug 31 15:52:10.750155 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 439/861] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:10 2022] GET /compute/v2.1/servers/3b33f103-9c08-4775-975c-3f815d99a70e => generated 1308 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:10.777729 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c84d349e-2e1b-454c-aa12-0489dabd1976 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d" status: 204 len: 0 microversion: 2.1 time: 0.171151 Aug 31 15:52:10.778821 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 423/862] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:52:10 2022] DELETE /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:52:10.786964 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5739fefd-26bd-48e7-bd87-473b95018af3 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:10.787716 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5739fefd-26bd-48e7-bd87-473b95018af3 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] [instance: a21daf16-afa5-4cad-8f8c-6ca10636601d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:10.799703 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5739fefd-26bd-48e7-bd87-473b95018af3 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:10.800184 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5739fefd-26bd-48e7-bd87-473b95018af3 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:10.800763 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5739fefd-26bd-48e7-bd87-473b95018af3 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:10.801471 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5739fefd-26bd-48e7-bd87-473b95018af3 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:10.802143 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5739fefd-26bd-48e7-bd87-473b95018af3 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:10.806578 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5739fefd-26bd-48e7-bd87-473b95018af3 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:10.926433 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5775f472-696a-4361-9a4b-666206365558 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:10.926973 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5775f472-696a-4361-9a4b-666206365558 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] [instance: 14dbaad0-9a67-48c0-a58b-5d9997c078c5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:10.934359 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5775f472-696a-4361-9a4b-666206365558 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:10.934857 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5775f472-696a-4361-9a4b-666206365558 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:10.935262 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5775f472-696a-4361-9a4b-666206365558 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:10.935961 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5775f472-696a-4361-9a4b-666206365558 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:10.936468 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5775f472-696a-4361-9a4b-666206365558 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:10.936885 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5775f472-696a-4361-9a4b-666206365558 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:11.074231 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5739fefd-26bd-48e7-bd87-473b95018af3 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6849c97bdb0948bc824cf5efe0f709a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e94509e985441f7b2802e6c6b164cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:11.089688 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5739fefd-26bd-48e7-bd87-473b95018af3 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] 10.222.0.50 "GET /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d" status: 200 len: 1468 microversion: 2.1 time: 0.306393 Aug 31 15:52:11.098947 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 440/863] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:10 2022] GET /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d => generated 1468 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:11.114982 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-76954c2e-5a76-4ac4-a058-f7f861983499 req-49a66971-d088-4f20-b939-add8bf5f23ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4770c3f5-5b3d-40da-9507-85b77d673094", "name": "network-vif-plugged", "status": "completed", "tag": "54fb4822-334f-41ba-aec2-444427824a7b"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:52:11.127106 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-76954c2e-5a76-4ac4-a058-f7f861983499 req-49a66971-d088-4f20-b939-add8bf5f23ea service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:11.127592 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-76954c2e-5a76-4ac4-a058-f7f861983499 req-49a66971-d088-4f20-b939-add8bf5f23ea service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:11.128015 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-76954c2e-5a76-4ac4-a058-f7f861983499 req-49a66971-d088-4f20-b939-add8bf5f23ea service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:11.132901 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5775f472-696a-4361-9a4b-666206365558 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1cd6d56b0de45179f1b46829536bbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806480da4ae74a23aa20b86e3d6305f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:11.141096 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5775f472-696a-4361-9a4b-666206365558 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] 10.222.0.50 "GET /compute/v2.1/servers/14dbaad0-9a67-48c0-a58b-5d9997c078c5" status: 200 len: 1316 microversion: 2.1 time: 0.219278 Aug 31 15:52:11.151976 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 424/864] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:10 2022] GET /compute/v2.1/servers/14dbaad0-9a67-48c0-a58b-5d9997c078c5 => generated 1316 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:11.154180 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d7c9b4b1-03e3-4ab6-95ed-d30a1d100a60 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:11.157506 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d7c9b4b1-03e3-4ab6-95ed-d30a1d100a60 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:11.161154 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-76954c2e-5a76-4ac4-a058-f7f861983499 req-49a66971-d088-4f20-b939-add8bf5f23ea service nova] Creating event network-vif-plugged:54fb4822-334f-41ba-aec2-444427824a7b for instance 4770c3f5-5b3d-40da-9507-85b77d673094 on n-h2-833090-16 Aug 31 15:52:11.165688 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7c9b4b1-03e3-4ab6-95ed-d30a1d100a60 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:11.165688 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7c9b4b1-03e3-4ab6-95ed-d30a1d100a60 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:11.165688 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7c9b4b1-03e3-4ab6-95ed-d30a1d100a60 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:11.166059 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7c9b4b1-03e3-4ab6-95ed-d30a1d100a60 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:11.166827 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7c9b4b1-03e3-4ab6-95ed-d30a1d100a60 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:11.166950 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7c9b4b1-03e3-4ab6-95ed-d30a1d100a60 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:11.168774 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-76954c2e-5a76-4ac4-a058-f7f861983499 req-49a66971-d088-4f20-b939-add8bf5f23ea service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068573 Aug 31 15:52:11.172448 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 441/865] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:52:11.332667 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d7c9b4b1-03e3-4ab6-95ed-d30a1d100a60 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:11.346189 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d7c9b4b1-03e3-4ab6-95ed-d30a1d100a60 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:11.349748 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d7c9b4b1-03e3-4ab6-95ed-d30a1d100a60 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:11.351884 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d7c9b4b1-03e3-4ab6-95ed-d30a1d100a60 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035" status: 200 len: 1566 microversion: 2.25 time: 0.205477 Aug 31 15:52:11.352521 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 425/866] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:52:11 2022] GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035 => generated 1566 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:52:11.521303 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6842ab92-9d1c-4f65-ab3a-e0fdf9db1178 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:11.521303 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6842ab92-9d1c-4f65-ab3a-e0fdf9db1178 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 4770c3f5-5b3d-40da-9507-85b77d673094] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:11.521303 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6842ab92-9d1c-4f65-ab3a-e0fdf9db1178 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:11.521303 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6842ab92-9d1c-4f65-ab3a-e0fdf9db1178 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:11.521740 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6842ab92-9d1c-4f65-ab3a-e0fdf9db1178 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:11.522277 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6842ab92-9d1c-4f65-ab3a-e0fdf9db1178 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:11.522755 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6842ab92-9d1c-4f65-ab3a-e0fdf9db1178 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:11.523279 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6842ab92-9d1c-4f65-ab3a-e0fdf9db1178 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:11.557364 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-151431f4-6588-428a-8dfe-f5f329ab62ae tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:11.558031 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-151431f4-6588-428a-8dfe-f5f329ab62ae tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 236954ea-2791-477d-a92b-88e590593c63] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:11.565014 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-151431f4-6588-428a-8dfe-f5f329ab62ae tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:11.565475 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-151431f4-6588-428a-8dfe-f5f329ab62ae tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:11.565905 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-151431f4-6588-428a-8dfe-f5f329ab62ae tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:11.566636 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-151431f4-6588-428a-8dfe-f5f329ab62ae tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:11.567084 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-151431f4-6588-428a-8dfe-f5f329ab62ae tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:11.567507 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-151431f4-6588-428a-8dfe-f5f329ab62ae tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:11.712926 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6842ab92-9d1c-4f65-ab3a-e0fdf9db1178 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:11.721483 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6842ab92-9d1c-4f65-ab3a-e0fdf9db1178 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/4770c3f5-5b3d-40da-9507-85b77d673094" status: 200 len: 1316 microversion: 2.1 time: 0.213705 Aug 31 15:52:11.722164 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 442/867] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:11 2022] GET /compute/v2.1/servers/4770c3f5-5b3d-40da-9507-85b77d673094 => generated 1316 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:11.747581 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-151431f4-6588-428a-8dfe-f5f329ab62ae tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:11.757163 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-151431f4-6588-428a-8dfe-f5f329ab62ae tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63" status: 200 len: 1476 microversion: 2.1 time: 0.203394 Aug 31 15:52:11.757819 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 426/868] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:11 2022] GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63 => generated 1476 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:11.762840 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dbeef6c2-fa49-41b3-ba78-2b21654b93b5 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:11.763608 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dbeef6c2-fa49-41b3-ba78-2b21654b93b5 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] [instance: 3b33f103-9c08-4775-975c-3f815d99a70e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:11.769864 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dbeef6c2-fa49-41b3-ba78-2b21654b93b5 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:11.770397 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dbeef6c2-fa49-41b3-ba78-2b21654b93b5 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:11.770831 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dbeef6c2-fa49-41b3-ba78-2b21654b93b5 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:11.771523 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dbeef6c2-fa49-41b3-ba78-2b21654b93b5 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:11.772120 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dbeef6c2-fa49-41b3-ba78-2b21654b93b5 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:11.772806 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dbeef6c2-fa49-41b3-ba78-2b21654b93b5 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:11.786433 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-dbeef6c2-fa49-41b3-ba78-2b21654b93b5 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] HTTP exception thrown: Instance 3b33f103-9c08-4775-975c-3f815d99a70e could not be found. Aug 31 15:52:11.788599 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dbeef6c2-fa49-41b3-ba78-2b21654b93b5 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Request method failure captured: Aug 31 15:52:11.788599 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/3b33f103-9c08-4775-975c-3f815d99a70e HTTP/1.1 Aug 31 15:52:11.788599 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:52:11.788599 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:52:11.788599 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:52:11.788599 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:52:11.788599 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:52:11.788599 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:52:11.788599 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:52:11.788599 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:52:11.788599 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4MJFKI8xW2WhmmwQy65o69y6wv8e0WdoShEKQ-eIzJJBzg8HGYExJluBh_glZGMEUfN8MAU-hCQxc92WQSGuvYHAtszFxz-3PA9RJLSde3-Hobd92VY-eShMXig02SGkBxDH5JSplJjKEisOAo3b9XlltmEzzg3Mx9VFeKNbg9gUtY Aug 31 15:52:11.788599 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:52:11.788599 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:52:11.788599 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:52:11.788599 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:52:11.788599 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:52:11.788599 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:52:11.788599 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 8a08078ba5a04c31b6cc63dee67be8c4 Aug 31 15:52:11.788599 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-VolumesAdminNegativeTest-1443261666 Aug 31 15:52:11.788599 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:52:11.788599 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:52:11.790336 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a08078ba5a04c31b6cc63dee67be8c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a08078ba5a04c31b6cc63dee67be8c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8a08078ba5a04c31b6cc63dee67be8c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8a08078ba5a04c31b6cc63dee67be8c4", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:52:11.790336 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-VolumesAdminNegativeTest-1443261666 Aug 31 15:52:11.790336 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 8a08078ba5a04c31b6cc63dee67be8c4 Aug 31 15:52:11.790336 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1443261666 Aug 31 15:52:11.790336 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-VolumesAdminNegativeTest-1443261666-project Aug 31 15:52:11.790336 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:52:11.790336 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:52:11.790336 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 704d7c428d3e4a1bbe5fb78485415214 Aug 31 15:52:11.790336 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-VolumesAdminNegativeTest-1443261666-project Aug 31 15:52:11.790336 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 15:52:11.790336 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 3b33f103-9c08-4775-975c-3f815d99a70e could not be found. Aug 31 15:52:11.790336 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '3b33f103-9c08-4775-975c-3f815d99a70e'} Aug 31 15:52:11.791195 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:52:11.791195 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:11.791195 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:52:11.791195 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:52:11.791195 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:52:11.791195 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:52:11.791195 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:52:11.791195 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:52:11.791195 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:52:11.791195 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:52:11.791195 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b33f103-9c08-4775-975c-3f815d99a70e could not be found. Aug 31 15:52:11.791195 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:52:11.791195 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:52:11.791195 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:52:11.791195 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:11.791195 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:52:11.791195 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:52:11.791195 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:52:11.791195 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:52:11.791195 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:52:11.792590 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:52:11.792590 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:52:11.792590 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:52:11.792590 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:52:11.792590 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:52:11.792590 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:52:11.792590 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:52:11.792590 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b33f103-9c08-4775-975c-3f815d99a70e could not be found. Aug 31 15:52:11.792590 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:52:11.792590 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:52:11.792590 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:52:11.792590 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:11.792590 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:52:11.792590 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:52:11.792590 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:52:11.792590 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:52:11.792590 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b33f103-9c08-4775-975c-3f815d99a70e could not be found. Aug 31 15:52:11.792590 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:52:11.793814 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dbeef6c2-fa49-41b3-ba78-2b21654b93b5 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Returning 404 to user: Instance 3b33f103-9c08-4775-975c-3f815d99a70e could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:52:11.793814 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dbeef6c2-fa49-41b3-ba78-2b21654b93b5 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] 10.222.0.50 "GET /compute/v2.1/servers/3b33f103-9c08-4775-975c-3f815d99a70e" status: 404 len: 111 microversion: 2.1 time: 0.031212 Aug 31 15:52:11.793814 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 427/869] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:11 2022] GET /compute/v2.1/servers/3b33f103-9c08-4775-975c-3f815d99a70e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:52:11.853156 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7a0a42fe-d32a-414d-a7aa-8b283555e133 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Action: 'create', calling method: .version_select at 0x7fbb46f6cf70>, body: {"keypair": {"name": "tempest-keypair-1136658894", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMKMoL35qEhRDh6JdIjxXxDudng3XZ0K3qYVi0LwTHrFZcsTu7iwgqaPNhwo0kzKUCNAhzKiYJAm/r5VzcSMewZG7Pojs3LBuaXsHSTCryrjvP4S0YhmVuLW7zkYGB2YCg=="}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:52:11.871931 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-7a0a42fe-d32a-414d-a7aa-8b283555e133 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Getting quotas for project e1c897eb2e5b4101858807f875a8ac0e. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:52:11.879370 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-7a0a42fe-d32a-414d-a7aa-8b283555e133 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Getting quotas for user 39e40446741c470f92d6f60ec910d84e and project e1c897eb2e5b4101858807f875a8ac0e. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:52:11.907407 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7a0a42fe-d32a-414d-a7aa-8b283555e133 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.172016 Aug 31 15:52:11.908587 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 443/870] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 31 15:52:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:52:12.123009 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-60f03081-8e13-4be7-bace-166fe2462e20 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:12.123527 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-60f03081-8e13-4be7-bace-166fe2462e20 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] [instance: a21daf16-afa5-4cad-8f8c-6ca10636601d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:12.129647 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60f03081-8e13-4be7-bace-166fe2462e20 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:12.130125 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60f03081-8e13-4be7-bace-166fe2462e20 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:12.130567 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60f03081-8e13-4be7-bace-166fe2462e20 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:12.131708 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60f03081-8e13-4be7-bace-166fe2462e20 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:12.132499 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60f03081-8e13-4be7-bace-166fe2462e20 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:12.132909 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60f03081-8e13-4be7-bace-166fe2462e20 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:12.163225 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fb7b6d5b-0f66-4297-91c4-9af2ad79daf1 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:12.164917 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fb7b6d5b-0f66-4297-91c4-9af2ad79daf1 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] [instance: 14dbaad0-9a67-48c0-a58b-5d9997c078c5] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:12.173003 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb7b6d5b-0f66-4297-91c4-9af2ad79daf1 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:12.173801 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb7b6d5b-0f66-4297-91c4-9af2ad79daf1 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:12.174523 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb7b6d5b-0f66-4297-91c4-9af2ad79daf1 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:12.175294 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb7b6d5b-0f66-4297-91c4-9af2ad79daf1 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:12.175818 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb7b6d5b-0f66-4297-91c4-9af2ad79daf1 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:12.176307 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb7b6d5b-0f66-4297-91c4-9af2ad79daf1 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:12.387653 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-60f03081-8e13-4be7-bace-166fe2462e20 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6849c97bdb0948bc824cf5efe0f709a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e94509e985441f7b2802e6c6b164cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:12.404068 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-60f03081-8e13-4be7-bace-166fe2462e20 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] 10.222.0.50 "GET /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d" status: 200 len: 1468 microversion: 2.1 time: 0.283787 Aug 31 15:52:12.406828 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 428/871] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:12 2022] GET /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d => generated 1468 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:12.416286 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-44e2ade4-1385-46bd-bb8a-9061dac336cc tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:12.422258 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-fb7b6d5b-0f66-4297-91c4-9af2ad79daf1 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1cd6d56b0de45179f1b46829536bbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806480da4ae74a23aa20b86e3d6305f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:12.428349 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-44e2ade4-1385-46bd-bb8a-9061dac336cc tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:12.440656 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fb7b6d5b-0f66-4297-91c4-9af2ad79daf1 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] 10.222.0.50 "GET /compute/v2.1/servers/14dbaad0-9a67-48c0-a58b-5d9997c078c5" status: 200 len: 1316 microversion: 2.1 time: 0.281254 Aug 31 15:52:12.445249 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44e2ade4-1385-46bd-bb8a-9061dac336cc tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:12.446203 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 444/872] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:12 2022] GET /compute/v2.1/servers/14dbaad0-9a67-48c0-a58b-5d9997c078c5 => generated 1316 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:12.446664 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44e2ade4-1385-46bd-bb8a-9061dac336cc tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:12.447566 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44e2ade4-1385-46bd-bb8a-9061dac336cc tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:12.448935 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44e2ade4-1385-46bd-bb8a-9061dac336cc tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:12.449742 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44e2ade4-1385-46bd-bb8a-9061dac336cc tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:12.450687 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44e2ade4-1385-46bd-bb8a-9061dac336cc tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:12.750796 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c6f3eb12-0daf-408d-b7ea-dfc19252e283 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:12.751765 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c6f3eb12-0daf-408d-b7ea-dfc19252e283 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 4770c3f5-5b3d-40da-9507-85b77d673094] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:12.760606 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c6f3eb12-0daf-408d-b7ea-dfc19252e283 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:12.761338 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c6f3eb12-0daf-408d-b7ea-dfc19252e283 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:12.761490 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c6f3eb12-0daf-408d-b7ea-dfc19252e283 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:12.763002 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c6f3eb12-0daf-408d-b7ea-dfc19252e283 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:12.763455 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c6f3eb12-0daf-408d-b7ea-dfc19252e283 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:12.763864 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c6f3eb12-0daf-408d-b7ea-dfc19252e283 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:13.015191 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-44e2ade4-1385-46bd-bb8a-9061dac336cc tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:13.029307 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-44e2ade4-1385-46bd-bb8a-9061dac336cc tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:13.032419 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-44e2ade4-1385-46bd-bb8a-9061dac336cc tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:13.034213 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-44e2ade4-1385-46bd-bb8a-9061dac336cc tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035" status: 200 len: 1566 microversion: 2.25 time: 0.624920 Aug 31 15:52:13.036065 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 429/873] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:52:12 2022] GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035 => generated 1566 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:52:13.043638 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a773cd9c-453a-475f-bc6b-b6ff8e3521a8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:13.044514 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a773cd9c-453a-475f-bc6b-b6ff8e3521a8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 236954ea-2791-477d-a92b-88e590593c63] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:13.049351 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c6f3eb12-0daf-408d-b7ea-dfc19252e283 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:13.057853 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c6f3eb12-0daf-408d-b7ea-dfc19252e283 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/4770c3f5-5b3d-40da-9507-85b77d673094" status: 200 len: 1316 microversion: 2.1 time: 0.311490 Aug 31 15:52:13.058649 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a773cd9c-453a-475f-bc6b-b6ff8e3521a8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:13.058791 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 445/874] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:12 2022] GET /compute/v2.1/servers/4770c3f5-5b3d-40da-9507-85b77d673094 => generated 1316 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:13.059527 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a773cd9c-453a-475f-bc6b-b6ff8e3521a8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:13.060641 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a773cd9c-453a-475f-bc6b-b6ff8e3521a8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:13.061488 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a773cd9c-453a-475f-bc6b-b6ff8e3521a8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:13.062153 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a773cd9c-453a-475f-bc6b-b6ff8e3521a8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:13.062583 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a773cd9c-453a-475f-bc6b-b6ff8e3521a8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:13.281359 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a773cd9c-453a-475f-bc6b-b6ff8e3521a8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:13.286573 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:52:13.294855 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a773cd9c-453a-475f-bc6b-b6ff8e3521a8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63" status: 200 len: 1476 microversion: 2.1 time: 0.257223 Aug 31 15:52:13.306980 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 430/875] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:13 2022] GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63 => generated 1476 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:13.428082 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-97132bbb-485b-40fc-aa72-225c14531401 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:13.429611 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-97132bbb-485b-40fc-aa72-225c14531401 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] [instance: a21daf16-afa5-4cad-8f8c-6ca10636601d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:13.436092 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-97132bbb-485b-40fc-aa72-225c14531401 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:13.436867 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-97132bbb-485b-40fc-aa72-225c14531401 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:13.437300 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-97132bbb-485b-40fc-aa72-225c14531401 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:13.438002 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-97132bbb-485b-40fc-aa72-225c14531401 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:13.438487 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-97132bbb-485b-40fc-aa72-225c14531401 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:13.438913 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-97132bbb-485b-40fc-aa72-225c14531401 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:13.466739 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-40cd0df7-a22c-44b1-b316-6b2f91b2525e tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:13.467334 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-40cd0df7-a22c-44b1-b316-6b2f91b2525e tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] [instance: 14dbaad0-9a67-48c0-a58b-5d9997c078c5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:13.474143 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-40cd0df7-a22c-44b1-b316-6b2f91b2525e tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:13.474640 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-40cd0df7-a22c-44b1-b316-6b2f91b2525e tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:13.475648 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-40cd0df7-a22c-44b1-b316-6b2f91b2525e tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:13.482749 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-40cd0df7-a22c-44b1-b316-6b2f91b2525e tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:13.483230 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-40cd0df7-a22c-44b1-b316-6b2f91b2525e tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:13.483649 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-40cd0df7-a22c-44b1-b316-6b2f91b2525e tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:13.797306 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-97132bbb-485b-40fc-aa72-225c14531401 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6849c97bdb0948bc824cf5efe0f709a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e94509e985441f7b2802e6c6b164cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:13.808638 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-97132bbb-485b-40fc-aa72-225c14531401 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] 10.222.0.50 "GET /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d" status: 200 len: 1468 microversion: 2.1 time: 0.384496 Aug 31 15:52:13.810017 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 446/876] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:13 2022] GET /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d => generated 1468 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:13.849367 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-40cd0df7-a22c-44b1-b316-6b2f91b2525e tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1cd6d56b0de45179f1b46829536bbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806480da4ae74a23aa20b86e3d6305f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:13.858224 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-40cd0df7-a22c-44b1-b316-6b2f91b2525e tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] 10.222.0.50 "GET /compute/v2.1/servers/14dbaad0-9a67-48c0-a58b-5d9997c078c5" status: 200 len: 1316 microversion: 2.1 time: 0.395666 Aug 31 15:52:13.858850 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 431/877] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:13 2022] GET /compute/v2.1/servers/14dbaad0-9a67-48c0-a58b-5d9997c078c5 => generated 1316 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:52:14.059341 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8712b652-5574-41b5-9fcb-632423a8616d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:14.060023 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8712b652-5574-41b5-9fcb-632423a8616d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:14.066502 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8712b652-5574-41b5-9fcb-632423a8616d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:14.067081 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8712b652-5574-41b5-9fcb-632423a8616d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:14.067516 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8712b652-5574-41b5-9fcb-632423a8616d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:14.068210 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8712b652-5574-41b5-9fcb-632423a8616d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:14.068721 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8712b652-5574-41b5-9fcb-632423a8616d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:14.069437 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8712b652-5574-41b5-9fcb-632423a8616d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:14.077293 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-60c7cf9d-0a3e-4c91-b7a8-360083657c9d tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-893892011", "imageRef": "a580d0e9-c646-48a3-beb9-813eec439611", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "3e9a2004-e86c-4f5b-8bb8-e57cb9c16ce0"}], "security_groups": [{"name": "tempest-securitygroup--81070176"}], "key_name": "tempest-keypair-1136658894", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:52:14.221425 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-60c7cf9d-0a3e-4c91-b7a8-360083657c9d tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] validate_networks() for [('3e9a2004-e86c-4f5b-8bb8-e57cb9c16ce0', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:52:14.264719 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8712b652-5574-41b5-9fcb-632423a8616d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:14.273944 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8712b652-5574-41b5-9fcb-632423a8616d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:14.275419 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8712b652-5574-41b5-9fcb-632423a8616d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:14.276786 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8712b652-5574-41b5-9fcb-632423a8616d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035" status: 200 len: 1566 microversion: 2.25 time: 0.221795 Aug 31 15:52:14.290515 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 447/878] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:52:14 2022] GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035 => generated 1566 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:52:14.290515 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-61131e6b-4950-4895-ac68-9d508de2cf05 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:14.290515 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-61131e6b-4950-4895-ac68-9d508de2cf05 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 4770c3f5-5b3d-40da-9507-85b77d673094] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:14.292153 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-61131e6b-4950-4895-ac68-9d508de2cf05 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:14.292896 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-61131e6b-4950-4895-ac68-9d508de2cf05 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:14.294123 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-61131e6b-4950-4895-ac68-9d508de2cf05 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:14.295000 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-61131e6b-4950-4895-ac68-9d508de2cf05 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:14.295608 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-61131e6b-4950-4895-ac68-9d508de2cf05 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:14.296194 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-61131e6b-4950-4895-ac68-9d508de2cf05 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:14.486279 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-61131e6b-4950-4895-ac68-9d508de2cf05 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:14.494393 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-61131e6b-4950-4895-ac68-9d508de2cf05 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/4770c3f5-5b3d-40da-9507-85b77d673094" status: 200 len: 1316 microversion: 2.1 time: 0.215995 Aug 31 15:52:14.494990 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 448/879] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:14 2022] GET /compute/v2.1/servers/4770c3f5-5b3d-40da-9507-85b77d673094 => generated 1316 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:14.499404 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-183afdcf-6d93-49a9-83f0-f864d91a3e94 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:14.500134 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-183afdcf-6d93-49a9-83f0-f864d91a3e94 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 236954ea-2791-477d-a92b-88e590593c63] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:14.514460 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-183afdcf-6d93-49a9-83f0-f864d91a3e94 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:14.514916 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-183afdcf-6d93-49a9-83f0-f864d91a3e94 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:14.515619 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-183afdcf-6d93-49a9-83f0-f864d91a3e94 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:14.516397 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-183afdcf-6d93-49a9-83f0-f864d91a3e94 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:14.517977 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-183afdcf-6d93-49a9-83f0-f864d91a3e94 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:14.518816 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-183afdcf-6d93-49a9-83f0-f864d91a3e94 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:14.750710 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-183afdcf-6d93-49a9-83f0-f864d91a3e94 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:14.762832 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-183afdcf-6d93-49a9-83f0-f864d91a3e94 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63" status: 200 len: 1476 microversion: 2.1 time: 0.266201 Aug 31 15:52:14.763929 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 449/880] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:14 2022] GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63 => generated 1476 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:14.783182 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-60c7cf9d-0a3e-4c91-b7a8-360083657c9d tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:52:14.783730 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-60c7cf9d-0a3e-4c91-b7a8-360083657c9d tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:52:14.784196 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-60c7cf9d-0a3e-4c91-b7a8-360083657c9d tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:52:14.784646 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-60c7cf9d-0a3e-4c91-b7a8-360083657c9d tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:52:14.785047 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-60c7cf9d-0a3e-4c91-b7a8-360083657c9d tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:52:14.794515 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60c7cf9d-0a3e-4c91-b7a8-360083657c9d tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:14.794992 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60c7cf9d-0a3e-4c91-b7a8-360083657c9d tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:14.795447 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60c7cf9d-0a3e-4c91-b7a8-360083657c9d tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:14.796156 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60c7cf9d-0a3e-4c91-b7a8-360083657c9d tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:14.796600 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60c7cf9d-0a3e-4c91-b7a8-360083657c9d tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:14.797010 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60c7cf9d-0a3e-4c91-b7a8-360083657c9d tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:14.814309 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-60c7cf9d-0a3e-4c91-b7a8-360083657c9d tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Getting quotas for project e1c897eb2e5b4101858807f875a8ac0e. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:52:14.820583 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-60c7cf9d-0a3e-4c91-b7a8-360083657c9d tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Getting quotas for user 39e40446741c470f92d6f60ec910d84e and project e1c897eb2e5b4101858807f875a8ac0e. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:52:14.831094 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-68b0a2ce-b59a-418e-9100-fb7fb41b9b9f tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:14.831965 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-68b0a2ce-b59a-418e-9100-fb7fb41b9b9f tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] [instance: a21daf16-afa5-4cad-8f8c-6ca10636601d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:14.838976 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68b0a2ce-b59a-418e-9100-fb7fb41b9b9f tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:14.839743 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68b0a2ce-b59a-418e-9100-fb7fb41b9b9f tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:14.840347 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68b0a2ce-b59a-418e-9100-fb7fb41b9b9f tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:14.841212 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68b0a2ce-b59a-418e-9100-fb7fb41b9b9f tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:14.841858 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68b0a2ce-b59a-418e-9100-fb7fb41b9b9f tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:14.842459 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68b0a2ce-b59a-418e-9100-fb7fb41b9b9f tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:14.845709 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-60c7cf9d-0a3e-4c91-b7a8-360083657c9d tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:52:14.848637 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-60c7cf9d-0a3e-4c91-b7a8-360083657c9d tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] [instance: a90bb0c5-7d56-4e38-8d78-a5c92a9976c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a580d0e9-c646-48a3-beb9-813eec439611',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:52:14.929565 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-60c7cf9d-0a3e-4c91-b7a8-360083657c9d tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.856841 Aug 31 15:52:14.932992 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 432/881] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:52:14 2022] POST /compute/v2.1/servers => generated 404 bytes in 861 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 15:52:14.944321 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f689507f-b2e5-4813-a45c-4d08d3219fc1 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:14.945129 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f689507f-b2e5-4813-a45c-4d08d3219fc1 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] [instance: 14dbaad0-9a67-48c0-a58b-5d9997c078c5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:14.954929 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f689507f-b2e5-4813-a45c-4d08d3219fc1 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:14.956093 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f689507f-b2e5-4813-a45c-4d08d3219fc1 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:14.956699 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f689507f-b2e5-4813-a45c-4d08d3219fc1 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:14.957556 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f689507f-b2e5-4813-a45c-4d08d3219fc1 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:14.958311 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f689507f-b2e5-4813-a45c-4d08d3219fc1 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:14.959032 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f689507f-b2e5-4813-a45c-4d08d3219fc1 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:15.075871 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-68b0a2ce-b59a-418e-9100-fb7fb41b9b9f tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6849c97bdb0948bc824cf5efe0f709a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e94509e985441f7b2802e6c6b164cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:15.093225 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-68b0a2ce-b59a-418e-9100-fb7fb41b9b9f tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] 10.222.0.50 "GET /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d" status: 200 len: 1468 microversion: 2.1 time: 0.265559 Aug 31 15:52:15.121238 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 450/882] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:14 2022] GET /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d => generated 1468 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:15.127286 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5eb8fd14-58dd-4334-b960-7040bb30436a tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:15.128163 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5eb8fd14-58dd-4334-b960-7040bb30436a tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] [instance: a90bb0c5-7d56-4e38-8d78-a5c92a9976c3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:15.274782 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5eb8fd14-58dd-4334-b960-7040bb30436a tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e40446741c470f92d6f60ec910d84e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c897eb2e5b4101858807f875a8ac0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:15.285002 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5eb8fd14-58dd-4334-b960-7040bb30436a tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] 10.222.0.50 "GET /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3" status: 200 len: 1245 microversion: 2.1 time: 0.162018 Aug 31 15:52:15.285735 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 451/883] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:15 2022] GET /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3 => generated 1245 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:15.305037 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b51b6a79-320f-4c28-9481-123243a62b44 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:15.306195 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b51b6a79-320f-4c28-9481-123243a62b44 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] [instance: 1e8fdb86-13be-42a3-a7af-5d50024f7419] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:15.318536 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b51b6a79-320f-4c28-9481-123243a62b44 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:15.319821 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b51b6a79-320f-4c28-9481-123243a62b44 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:15.320423 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b51b6a79-320f-4c28-9481-123243a62b44 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:15.321266 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b51b6a79-320f-4c28-9481-123243a62b44 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:15.321849 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b51b6a79-320f-4c28-9481-123243a62b44 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:15.322441 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b51b6a79-320f-4c28-9481-123243a62b44 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:15.374629 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b51b6a79-320f-4c28-9481-123243a62b44 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] [instance: 1e8fdb86-13be-42a3-a7af-5d50024f7419] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:52:15.423237 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f689507f-b2e5-4813-a45c-4d08d3219fc1 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1cd6d56b0de45179f1b46829536bbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806480da4ae74a23aa20b86e3d6305f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:15.434437 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f689507f-b2e5-4813-a45c-4d08d3219fc1 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] 10.222.0.50 "GET /compute/v2.1/servers/14dbaad0-9a67-48c0-a58b-5d9997c078c5" status: 200 len: 1316 microversion: 2.1 time: 0.499432 Aug 31 15:52:15.436177 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 433/884] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:14 2022] GET /compute/v2.1/servers/14dbaad0-9a67-48c0-a58b-5d9997c078c5 => generated 1316 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:15.441286 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8aae8910-8814-4e73-84ef-88cbd0cebe67 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:15.441905 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8aae8910-8814-4e73-84ef-88cbd0cebe67 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:15.448749 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8aae8910-8814-4e73-84ef-88cbd0cebe67 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:15.449230 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8aae8910-8814-4e73-84ef-88cbd0cebe67 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:15.449651 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8aae8910-8814-4e73-84ef-88cbd0cebe67 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:15.450360 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8aae8910-8814-4e73-84ef-88cbd0cebe67 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:15.450960 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8aae8910-8814-4e73-84ef-88cbd0cebe67 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:15.451555 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8aae8910-8814-4e73-84ef-88cbd0cebe67 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:15.478324 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b51b6a79-320f-4c28-9481-123243a62b44 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] 10.222.0.50 "DELETE /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419" status: 204 len: 0 microversion: 2.1 time: 0.188234 Aug 31 15:52:15.479993 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 452/885] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:52:15 2022] DELETE /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:52:15.492420 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b1e8f3f5-f52c-4cde-a6f9-85b421a4ed23 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:15.496352 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b1e8f3f5-f52c-4cde-a6f9-85b421a4ed23 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] [instance: 1e8fdb86-13be-42a3-a7af-5d50024f7419] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:15.503829 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1e8f3f5-f52c-4cde-a6f9-85b421a4ed23 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:15.504751 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1e8f3f5-f52c-4cde-a6f9-85b421a4ed23 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:15.505385 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1e8f3f5-f52c-4cde-a6f9-85b421a4ed23 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:15.506220 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1e8f3f5-f52c-4cde-a6f9-85b421a4ed23 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:15.506739 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1e8f3f5-f52c-4cde-a6f9-85b421a4ed23 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:15.507167 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1e8f3f5-f52c-4cde-a6f9-85b421a4ed23 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:15.786319 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8aae8910-8814-4e73-84ef-88cbd0cebe67 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:15.797468 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8aae8910-8814-4e73-84ef-88cbd0cebe67 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:15.799346 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8aae8910-8814-4e73-84ef-88cbd0cebe67 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:15.801697 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8aae8910-8814-4e73-84ef-88cbd0cebe67 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035" status: 200 len: 1566 microversion: 2.25 time: 0.364018 Aug 31 15:52:15.818653 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 434/886] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:52:15 2022] GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035 => generated 1566 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:52:15.829829 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9fb74aa6-5b0e-4258-b04a-aee52be14907 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:15.830357 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9fb74aa6-5b0e-4258-b04a-aee52be14907 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 4770c3f5-5b3d-40da-9507-85b77d673094] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:15.837575 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9fb74aa6-5b0e-4258-b04a-aee52be14907 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:15.838058 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9fb74aa6-5b0e-4258-b04a-aee52be14907 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:15.838849 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9fb74aa6-5b0e-4258-b04a-aee52be14907 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:15.839551 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9fb74aa6-5b0e-4258-b04a-aee52be14907 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:15.839998 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9fb74aa6-5b0e-4258-b04a-aee52be14907 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:15.840396 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9fb74aa6-5b0e-4258-b04a-aee52be14907 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:15.852788 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b1e8f3f5-f52c-4cde-a6f9-85b421a4ed23 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704d7c428d3e4a1bbe5fb78485415214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a08078ba5a04c31b6cc63dee67be8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:15.863546 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b1e8f3f5-f52c-4cde-a6f9-85b421a4ed23 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] 10.222.0.50 "GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419" status: 200 len: 1681 microversion: 2.1 time: 0.378068 Aug 31 15:52:15.868668 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 453/887] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:15 2022] GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419 => generated 1681 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:15.873884 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0ae3b4b8-bdf3-4d5d-b212-9bedd25fd6c0 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:15.874637 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0ae3b4b8-bdf3-4d5d-b212-9bedd25fd6c0 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 236954ea-2791-477d-a92b-88e590593c63] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:15.885560 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0ae3b4b8-bdf3-4d5d-b212-9bedd25fd6c0 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:15.886802 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0ae3b4b8-bdf3-4d5d-b212-9bedd25fd6c0 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:15.887395 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0ae3b4b8-bdf3-4d5d-b212-9bedd25fd6c0 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:15.888281 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0ae3b4b8-bdf3-4d5d-b212-9bedd25fd6c0 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:15.889093 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0ae3b4b8-bdf3-4d5d-b212-9bedd25fd6c0 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:15.889757 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0ae3b4b8-bdf3-4d5d-b212-9bedd25fd6c0 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:16.171602 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9fb74aa6-5b0e-4258-b04a-aee52be14907 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:16.181546 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9fb74aa6-5b0e-4258-b04a-aee52be14907 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/4770c3f5-5b3d-40da-9507-85b77d673094" status: 200 len: 1316 microversion: 2.1 time: 0.361002 Aug 31 15:52:16.182146 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 435/888] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:15 2022] GET /compute/v2.1/servers/4770c3f5-5b3d-40da-9507-85b77d673094 => generated 1316 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:16.186972 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d9c3bf47-71af-4a7a-9d11-87c013178d32 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:16.187570 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d9c3bf47-71af-4a7a-9d11-87c013178d32 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] [instance: a21daf16-afa5-4cad-8f8c-6ca10636601d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:16.189482 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:52:16.195749 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9c3bf47-71af-4a7a-9d11-87c013178d32 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:16.196407 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9c3bf47-71af-4a7a-9d11-87c013178d32 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:16.196716 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0ae3b4b8-bdf3-4d5d-b212-9bedd25fd6c0 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:16.197036 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9c3bf47-71af-4a7a-9d11-87c013178d32 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:16.197727 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9c3bf47-71af-4a7a-9d11-87c013178d32 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:16.198216 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9c3bf47-71af-4a7a-9d11-87c013178d32 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:16.198809 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9c3bf47-71af-4a7a-9d11-87c013178d32 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:16.208320 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0ae3b4b8-bdf3-4d5d-b212-9bedd25fd6c0 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63" status: 200 len: 1476 microversion: 2.1 time: 0.338157 Aug 31 15:52:16.209374 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 454/889] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:15 2022] GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63 => generated 1476 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:16.305951 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ed328606-89ab-49aa-a359-ef40bb02e619 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:16.307897 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ed328606-89ab-49aa-a359-ef40bb02e619 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] [instance: a90bb0c5-7d56-4e38-8d78-a5c92a9976c3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:16.315667 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ed328606-89ab-49aa-a359-ef40bb02e619 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:16.316339 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ed328606-89ab-49aa-a359-ef40bb02e619 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:16.316779 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ed328606-89ab-49aa-a359-ef40bb02e619 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:16.318222 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ed328606-89ab-49aa-a359-ef40bb02e619 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:16.318222 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ed328606-89ab-49aa-a359-ef40bb02e619 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:16.318595 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ed328606-89ab-49aa-a359-ef40bb02e619 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:16.349005 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d9c3bf47-71af-4a7a-9d11-87c013178d32 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6849c97bdb0948bc824cf5efe0f709a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e94509e985441f7b2802e6c6b164cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:16.360228 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d9c3bf47-71af-4a7a-9d11-87c013178d32 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] 10.222.0.50 "GET /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d" status: 200 len: 1468 microversion: 2.1 time: 0.176797 Aug 31 15:52:16.360831 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 436/890] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:16 2022] GET /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d => generated 1468 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:16.399119 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ed328606-89ab-49aa-a359-ef40bb02e619 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e40446741c470f92d6f60ec910d84e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c897eb2e5b4101858807f875a8ac0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:16.410223 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ed328606-89ab-49aa-a359-ef40bb02e619 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] 10.222.0.50 "GET /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3" status: 200 len: 1249 microversion: 2.1 time: 0.108834 Aug 31 15:52:16.411029 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 455/891] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:16 2022] GET /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3 => generated 1249 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:16.466011 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0b63a33d-9144-44fa-9f9a-a85c605e010f tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:16.466875 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0b63a33d-9144-44fa-9f9a-a85c605e010f tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] [instance: 14dbaad0-9a67-48c0-a58b-5d9997c078c5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:16.477898 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0b63a33d-9144-44fa-9f9a-a85c605e010f tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:16.478828 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0b63a33d-9144-44fa-9f9a-a85c605e010f tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:16.479466 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0b63a33d-9144-44fa-9f9a-a85c605e010f tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:16.480710 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0b63a33d-9144-44fa-9f9a-a85c605e010f tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:16.481421 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0b63a33d-9144-44fa-9f9a-a85c605e010f tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:16.482064 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0b63a33d-9144-44fa-9f9a-a85c605e010f tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:16.652960 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0b63a33d-9144-44fa-9f9a-a85c605e010f tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1cd6d56b0de45179f1b46829536bbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806480da4ae74a23aa20b86e3d6305f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:16.665284 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0b63a33d-9144-44fa-9f9a-a85c605e010f tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] 10.222.0.50 "GET /compute/v2.1/servers/14dbaad0-9a67-48c0-a58b-5d9997c078c5" status: 200 len: 1316 microversion: 2.1 time: 0.207456 Aug 31 15:52:16.666227 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 437/892] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:16 2022] GET /compute/v2.1/servers/14dbaad0-9a67-48c0-a58b-5d9997c078c5 => generated 1316 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:16.833164 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0212d8bf-22dc-4dca-b205-58668252544c tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:16.834019 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0212d8bf-22dc-4dca-b205-58668252544c tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:16.842657 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0212d8bf-22dc-4dca-b205-58668252544c tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:16.843135 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0212d8bf-22dc-4dca-b205-58668252544c tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:16.843568 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0212d8bf-22dc-4dca-b205-58668252544c tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:16.844273 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0212d8bf-22dc-4dca-b205-58668252544c tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:16.844724 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0212d8bf-22dc-4dca-b205-58668252544c tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:16.845151 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0212d8bf-22dc-4dca-b205-58668252544c tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:16.894418 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e6394338-79cb-46a5-83fd-eea47f04d94d tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:16.895324 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e6394338-79cb-46a5-83fd-eea47f04d94d tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] [instance: 1e8fdb86-13be-42a3-a7af-5d50024f7419] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:16.902049 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6394338-79cb-46a5-83fd-eea47f04d94d tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:16.902648 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6394338-79cb-46a5-83fd-eea47f04d94d tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:16.903084 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6394338-79cb-46a5-83fd-eea47f04d94d tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:16.903777 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6394338-79cb-46a5-83fd-eea47f04d94d tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:16.904228 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6394338-79cb-46a5-83fd-eea47f04d94d tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:16.904639 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6394338-79cb-46a5-83fd-eea47f04d94d tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:17.292555 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0212d8bf-22dc-4dca-b205-58668252544c tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:17.307525 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0212d8bf-22dc-4dca-b205-58668252544c tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:17.309348 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0212d8bf-22dc-4dca-b205-58668252544c tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:17.313592 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0212d8bf-22dc-4dca-b205-58668252544c tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035" status: 200 len: 1566 microversion: 2.25 time: 0.484566 Aug 31 15:52:17.330266 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 456/893] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:52:16 2022] GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035 => generated 1566 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:52:17.330857 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e6394338-79cb-46a5-83fd-eea47f04d94d tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704d7c428d3e4a1bbe5fb78485415214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a08078ba5a04c31b6cc63dee67be8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:17.338547 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f8d9c758-a81b-445b-9634-8e73980c9681 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:17.339417 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f8d9c758-a81b-445b-9634-8e73980c9681 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 4770c3f5-5b3d-40da-9507-85b77d673094] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:17.347782 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f8d9c758-a81b-445b-9634-8e73980c9681 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:17.348460 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f8d9c758-a81b-445b-9634-8e73980c9681 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:17.352829 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f8d9c758-a81b-445b-9634-8e73980c9681 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:17.353899 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f8d9c758-a81b-445b-9634-8e73980c9681 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:17.354589 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f8d9c758-a81b-445b-9634-8e73980c9681 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:17.355341 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f8d9c758-a81b-445b-9634-8e73980c9681 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:17.359814 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e6394338-79cb-46a5-83fd-eea47f04d94d tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] 10.222.0.50 "GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419" status: 200 len: 1681 microversion: 2.1 time: 0.467567 Aug 31 15:52:17.361694 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:52:17.363512 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 438/894] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:16 2022] GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419 => generated 1681 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:52:17.381931 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-20a93141-313b-42e3-8c17-8c8f45b8cc83 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:17.390178 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-20a93141-313b-42e3-8c17-8c8f45b8cc83 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 236954ea-2791-477d-a92b-88e590593c63] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:17.419096 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20a93141-313b-42e3-8c17-8c8f45b8cc83 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:17.420048 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20a93141-313b-42e3-8c17-8c8f45b8cc83 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:17.422874 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20a93141-313b-42e3-8c17-8c8f45b8cc83 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:17.423645 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20a93141-313b-42e3-8c17-8c8f45b8cc83 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:17.425298 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20a93141-313b-42e3-8c17-8c8f45b8cc83 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:17.425731 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20a93141-313b-42e3-8c17-8c8f45b8cc83 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:18.093887 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-20a93141-313b-42e3-8c17-8c8f45b8cc83 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:18.111665 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-20a93141-313b-42e3-8c17-8c8f45b8cc83 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63" status: 200 len: 1476 microversion: 2.1 time: 0.744663 Aug 31 15:52:18.112910 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 439/895] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:17 2022] GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63 => generated 1476 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:18.134275 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d10393a3-6165-4b5e-8247-dac77f3e3683 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:18.135137 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d10393a3-6165-4b5e-8247-dac77f3e3683 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] [instance: a21daf16-afa5-4cad-8f8c-6ca10636601d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:18.157346 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d10393a3-6165-4b5e-8247-dac77f3e3683 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:18.157980 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d10393a3-6165-4b5e-8247-dac77f3e3683 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:18.158446 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d10393a3-6165-4b5e-8247-dac77f3e3683 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:18.159165 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d10393a3-6165-4b5e-8247-dac77f3e3683 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:18.159622 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d10393a3-6165-4b5e-8247-dac77f3e3683 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:18.160047 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d10393a3-6165-4b5e-8247-dac77f3e3683 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:18.171088 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f8d9c758-a81b-445b-9634-8e73980c9681 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:18.190360 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f8d9c758-a81b-445b-9634-8e73980c9681 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/4770c3f5-5b3d-40da-9507-85b77d673094" status: 200 len: 1466 microversion: 2.1 time: 0.857076 Aug 31 15:52:18.210804 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 457/896] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:17 2022] GET /compute/v2.1/servers/4770c3f5-5b3d-40da-9507-85b77d673094 => generated 1466 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:18.218053 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-95975c83-7a3b-4d4e-837f-3a362e9d41e1 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:18.218754 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-95975c83-7a3b-4d4e-837f-3a362e9d41e1 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] [instance: a90bb0c5-7d56-4e38-8d78-a5c92a9976c3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:18.228478 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95975c83-7a3b-4d4e-837f-3a362e9d41e1 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:18.228966 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95975c83-7a3b-4d4e-837f-3a362e9d41e1 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:18.230008 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95975c83-7a3b-4d4e-837f-3a362e9d41e1 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:18.231026 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95975c83-7a3b-4d4e-837f-3a362e9d41e1 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:18.231450 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95975c83-7a3b-4d4e-837f-3a362e9d41e1 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:18.231872 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95975c83-7a3b-4d4e-837f-3a362e9d41e1 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:18.503415 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-95975c83-7a3b-4d4e-837f-3a362e9d41e1 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e40446741c470f92d6f60ec910d84e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c897eb2e5b4101858807f875a8ac0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:18.514304 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-95975c83-7a3b-4d4e-837f-3a362e9d41e1 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] 10.222.0.50 "GET /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3" status: 200 len: 1305 microversion: 2.1 time: 0.302176 Aug 31 15:52:18.534622 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 458/897] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:18 2022] GET /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3 => generated 1305 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:18.565563 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-18f2d1da-c1aa-4d92-a189-ff34be677d80 req-4830bc9e-6af1-4338-ad29-3a6d402b9335 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14dbaad0-9a67-48c0-a58b-5d9997c078c5", "name": "network-vif-plugged", "status": "completed", "tag": "5f62d425-884d-403a-93a6-ae540948466b"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:52:18.592303 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d10393a3-6165-4b5e-8247-dac77f3e3683 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6849c97bdb0948bc824cf5efe0f709a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e94509e985441f7b2802e6c6b164cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:18.600757 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-18f2d1da-c1aa-4d92-a189-ff34be677d80 req-4830bc9e-6af1-4338-ad29-3a6d402b9335 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:18.604181 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d10393a3-6165-4b5e-8247-dac77f3e3683 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] 10.222.0.50 "GET /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d" status: 200 len: 1426 microversion: 2.1 time: 0.490051 Aug 31 15:52:18.604843 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-18f2d1da-c1aa-4d92-a189-ff34be677d80 req-4830bc9e-6af1-4338-ad29-3a6d402b9335 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:18.605613 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-18f2d1da-c1aa-4d92-a189-ff34be677d80 req-4830bc9e-6af1-4338-ad29-3a6d402b9335 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:18.622447 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 440/898] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:18 2022] GET /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d => generated 1426 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:18.629752 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-49f9daeb-fd47-40dd-bd9d-613c5b9d324d tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:18.631997 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-49f9daeb-fd47-40dd-bd9d-613c5b9d324d tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] [instance: 14dbaad0-9a67-48c0-a58b-5d9997c078c5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:18.642438 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-18f2d1da-c1aa-4d92-a189-ff34be677d80 req-4830bc9e-6af1-4338-ad29-3a6d402b9335 service nova] Creating event network-vif-plugged:5f62d425-884d-403a-93a6-ae540948466b for instance 14dbaad0-9a67-48c0-a58b-5d9997c078c5 on n-h2-833090-16 Aug 31 15:52:18.653532 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49f9daeb-fd47-40dd-bd9d-613c5b9d324d tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:18.657819 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49f9daeb-fd47-40dd-bd9d-613c5b9d324d tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:18.658975 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49f9daeb-fd47-40dd-bd9d-613c5b9d324d tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:18.661118 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49f9daeb-fd47-40dd-bd9d-613c5b9d324d tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:18.665198 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-18f2d1da-c1aa-4d92-a189-ff34be677d80 req-4830bc9e-6af1-4338-ad29-3a6d402b9335 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124973 Aug 31 15:52:18.666016 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49f9daeb-fd47-40dd-bd9d-613c5b9d324d tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:18.666585 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49f9daeb-fd47-40dd-bd9d-613c5b9d324d tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:18.668358 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 459/899] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:52:18.710069 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-34ee0192-0b45-417a-8ce8-eeaca723fe9f tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:18.725315 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-34ee0192-0b45-417a-8ce8-eeaca723fe9f tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] [instance: 4770c3f5-5b3d-40da-9507-85b77d673094] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:18.742200 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:52:18.770026 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-34ee0192-0b45-417a-8ce8-eeaca723fe9f tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:18.770555 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-34ee0192-0b45-417a-8ce8-eeaca723fe9f tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:18.771179 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-34ee0192-0b45-417a-8ce8-eeaca723fe9f tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:18.771748 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-34ee0192-0b45-417a-8ce8-eeaca723fe9f tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:18.781137 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-34ee0192-0b45-417a-8ce8-eeaca723fe9f tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:18.781780 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-34ee0192-0b45-417a-8ce8-eeaca723fe9f tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:19.617584 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-49f9daeb-fd47-40dd-bd9d-613c5b9d324d tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1cd6d56b0de45179f1b46829536bbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806480da4ae74a23aa20b86e3d6305f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:19.629981 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-49f9daeb-fd47-40dd-bd9d-613c5b9d324d tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] 10.222.0.50 "GET /compute/v2.1/servers/14dbaad0-9a67-48c0-a58b-5d9997c078c5" status: 200 len: 1316 microversion: 2.1 time: 1.005255 Aug 31 15:52:19.631119 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 441/900] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:18 2022] GET /compute/v2.1/servers/14dbaad0-9a67-48c0-a58b-5d9997c078c5 => generated 1316 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:19.649440 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-34ee0192-0b45-417a-8ce8-eeaca723fe9f tempest-ServersOnMultiNodesTest-2093555101 tempest-ServersOnMultiNodesTest-2093555101-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/4770c3f5-5b3d-40da-9507-85b77d673094" status: 200 len: 1619 microversion: 2.1 time: 0.965027 Aug 31 15:52:19.654948 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 460/901] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:18 2022] GET /compute/v2.1/servers/4770c3f5-5b3d-40da-9507-85b77d673094 => generated 1619 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:19.659905 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5ab8d8b2-9617-412d-a3d0-1861554fe5b4 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:19.660374 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b312dd0c-83f6-4fe9-83a1-b2e67a0833c3 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:19.661229 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b312dd0c-83f6-4fe9-83a1-b2e67a0833c3 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:19.676455 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5ab8d8b2-9617-412d-a3d0-1861554fe5b4 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] [instance: 1e8fdb86-13be-42a3-a7af-5d50024f7419] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:19.682056 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b312dd0c-83f6-4fe9-83a1-b2e67a0833c3 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:19.686010 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b312dd0c-83f6-4fe9-83a1-b2e67a0833c3 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:19.697390 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b312dd0c-83f6-4fe9-83a1-b2e67a0833c3 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:19.699150 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5ab8d8b2-9617-412d-a3d0-1861554fe5b4 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:19.700098 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b312dd0c-83f6-4fe9-83a1-b2e67a0833c3 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:19.700714 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b312dd0c-83f6-4fe9-83a1-b2e67a0833c3 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:19.701364 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5ab8d8b2-9617-412d-a3d0-1861554fe5b4 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:19.703636 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b312dd0c-83f6-4fe9-83a1-b2e67a0833c3 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:19.704318 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5ab8d8b2-9617-412d-a3d0-1861554fe5b4 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:19.709759 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5ab8d8b2-9617-412d-a3d0-1861554fe5b4 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:19.710669 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5ab8d8b2-9617-412d-a3d0-1861554fe5b4 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:19.713999 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5ab8d8b2-9617-412d-a3d0-1861554fe5b4 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:19.774671 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5ab8d8b2-9617-412d-a3d0-1861554fe5b4 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:19.775196 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5ab8d8b2-9617-412d-a3d0-1861554fe5b4 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:19.775660 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5ab8d8b2-9617-412d-a3d0-1861554fe5b4 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:19.776147 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-5ab8d8b2-9617-412d-a3d0-1861554fe5b4 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lazy-loading 'fault' on Instance uuid 1e8fdb86-13be-42a3-a7af-5d50024f7419 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:52:19.847569 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5ab8d8b2-9617-412d-a3d0-1861554fe5b4 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704d7c428d3e4a1bbe5fb78485415214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a08078ba5a04c31b6cc63dee67be8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:19.875389 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5ab8d8b2-9617-412d-a3d0-1861554fe5b4 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] 10.222.0.50 "GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419" status: 200 len: 1332 microversion: 2.1 time: 0.219115 Aug 31 15:52:19.884349 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 461/902] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:19 2022] GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419 => generated 1332 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:19.895965 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-9ad3772b-944f-400e-8865-60504ebc9161 req-b1450f24-5fed-43d5-acef-65b02118e1b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e8fdb86-13be-42a3-a7af-5d50024f7419", "name": "network-vif-deleted", "tag": "e33a5029-0218-44c8-9329-fb96edf985c5"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:52:19.932583 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-9ad3772b-944f-400e-8865-60504ebc9161 req-b1450f24-5fed-43d5-acef-65b02118e1b7 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:19.933400 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-9ad3772b-944f-400e-8865-60504ebc9161 req-b1450f24-5fed-43d5-acef-65b02118e1b7 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:19.933508 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-9ad3772b-944f-400e-8865-60504ebc9161 req-b1450f24-5fed-43d5-acef-65b02118e1b7 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:19.977667 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-9ad3772b-944f-400e-8865-60504ebc9161 req-b1450f24-5fed-43d5-acef-65b02118e1b7 service nova] Creating event network-vif-deleted:e33a5029-0218-44c8-9329-fb96edf985c5 for instance 1e8fdb86-13be-42a3-a7af-5d50024f7419 on n-h1-833090-16 Aug 31 15:52:19.991494 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-9ad3772b-944f-400e-8865-60504ebc9161 req-b1450f24-5fed-43d5-acef-65b02118e1b7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104570 Aug 31 15:52:19.992429 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 462/903] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:52:20.000139 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a0f920b1-b035-42f0-968d-3769b0cf4062 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:20.000942 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a0f920b1-b035-42f0-968d-3769b0cf4062 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 236954ea-2791-477d-a92b-88e590593c63] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:20.013420 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b312dd0c-83f6-4fe9-83a1-b2e67a0833c3 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:20.023142 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a0f920b1-b035-42f0-968d-3769b0cf4062 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:20.023631 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a0f920b1-b035-42f0-968d-3769b0cf4062 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:20.024058 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a0f920b1-b035-42f0-968d-3769b0cf4062 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:20.024820 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a0f920b1-b035-42f0-968d-3769b0cf4062 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:20.025262 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b312dd0c-83f6-4fe9-83a1-b2e67a0833c3 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:20.025436 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a0f920b1-b035-42f0-968d-3769b0cf4062 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:20.025709 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a0f920b1-b035-42f0-968d-3769b0cf4062 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:20.026704 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b312dd0c-83f6-4fe9-83a1-b2e67a0833c3 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:20.027883 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b312dd0c-83f6-4fe9-83a1-b2e67a0833c3 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035" status: 200 len: 1566 microversion: 2.25 time: 0.395663 Aug 31 15:52:20.028445 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 442/904] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:52:19 2022] GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035 => generated 1566 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:52:20.053138 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-edd6fec5-37db-4812-a436-bc7551b919db req-92e3369f-cea8-4283-a71b-725c07127d84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a21daf16-afa5-4cad-8f8c-6ca10636601d", "name": "network-vif-deleted", "tag": "9cf8063e-3763-4822-8435-e3dec32e2415"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:52:20.076558 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-edd6fec5-37db-4812-a436-bc7551b919db req-92e3369f-cea8-4283-a71b-725c07127d84 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:20.077049 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-edd6fec5-37db-4812-a436-bc7551b919db req-92e3369f-cea8-4283-a71b-725c07127d84 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:20.077536 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-edd6fec5-37db-4812-a436-bc7551b919db req-92e3369f-cea8-4283-a71b-725c07127d84 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:20.103113 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-edd6fec5-37db-4812-a436-bc7551b919db req-92e3369f-cea8-4283-a71b-725c07127d84 service nova] Creating event network-vif-deleted:9cf8063e-3763-4822-8435-e3dec32e2415 for instance a21daf16-afa5-4cad-8f8c-6ca10636601d on n-h2-833090-16 Aug 31 15:52:20.124473 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-edd6fec5-37db-4812-a436-bc7551b919db req-92e3369f-cea8-4283-a71b-725c07127d84 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076946 Aug 31 15:52:20.125652 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 443/905] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:52:20.131553 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3b81e445-9d3d-48e5-8559-29d65b8050c2 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:20.132488 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3b81e445-9d3d-48e5-8559-29d65b8050c2 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] [instance: a90bb0c5-7d56-4e38-8d78-a5c92a9976c3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:20.139211 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b81e445-9d3d-48e5-8559-29d65b8050c2 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:20.139951 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b81e445-9d3d-48e5-8559-29d65b8050c2 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:20.140551 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b81e445-9d3d-48e5-8559-29d65b8050c2 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:20.141410 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b81e445-9d3d-48e5-8559-29d65b8050c2 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:20.142015 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b81e445-9d3d-48e5-8559-29d65b8050c2 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:20.142640 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b81e445-9d3d-48e5-8559-29d65b8050c2 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:20.254824 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3b81e445-9d3d-48e5-8559-29d65b8050c2 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e40446741c470f92d6f60ec910d84e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c897eb2e5b4101858807f875a8ac0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:20.267581 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3b81e445-9d3d-48e5-8559-29d65b8050c2 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] 10.222.0.50 "GET /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3" status: 200 len: 1303 microversion: 2.1 time: 0.139835 Aug 31 15:52:20.273005 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 444/906] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:20 2022] GET /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3 => generated 1303 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:20.290059 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5a739ff1-4897-48c7-9c62-e785613ad7d2 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:20.290826 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5a739ff1-4897-48c7-9c62-e785613ad7d2 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] [instance: a21daf16-afa5-4cad-8f8c-6ca10636601d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:20.306789 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a739ff1-4897-48c7-9c62-e785613ad7d2 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:20.307838 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a739ff1-4897-48c7-9c62-e785613ad7d2 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:20.308281 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a739ff1-4897-48c7-9c62-e785613ad7d2 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:20.309033 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a739ff1-4897-48c7-9c62-e785613ad7d2 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:20.316781 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a739ff1-4897-48c7-9c62-e785613ad7d2 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:20.317110 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a739ff1-4897-48c7-9c62-e785613ad7d2 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:20.325571 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a0f920b1-b035-42f0-968d-3769b0cf4062 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:20.337545 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a0f920b1-b035-42f0-968d-3769b0cf4062 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63" status: 200 len: 1476 microversion: 2.1 time: 0.343857 Aug 31 15:52:20.338506 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 463/907] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:19 2022] GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63 => generated 1476 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:20.343706 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a255150b-6fce-45bd-bd3b-6f5621e5c8ca tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:20.344254 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a255150b-6fce-45bd-bd3b-6f5621e5c8ca tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 4770c3f5-5b3d-40da-9507-85b77d673094] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:20.364217 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a255150b-6fce-45bd-bd3b-6f5621e5c8ca tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:20.365519 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a255150b-6fce-45bd-bd3b-6f5621e5c8ca tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:20.365519 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a255150b-6fce-45bd-bd3b-6f5621e5c8ca tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:20.368449 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a255150b-6fce-45bd-bd3b-6f5621e5c8ca tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:20.368449 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a255150b-6fce-45bd-bd3b-6f5621e5c8ca tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:20.368449 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a255150b-6fce-45bd-bd3b-6f5621e5c8ca tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:20.410199 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a739ff1-4897-48c7-9c62-e785613ad7d2 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:20.411669 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a739ff1-4897-48c7-9c62-e785613ad7d2 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:20.412478 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a739ff1-4897-48c7-9c62-e785613ad7d2 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:20.413115 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-5a739ff1-4897-48c7-9c62-e785613ad7d2 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lazy-loading 'fault' on Instance uuid a21daf16-afa5-4cad-8f8c-6ca10636601d {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:52:20.439462 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a255150b-6fce-45bd-bd3b-6f5621e5c8ca tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 4770c3f5-5b3d-40da-9507-85b77d673094] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:52:20.511200 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5a739ff1-4897-48c7-9c62-e785613ad7d2 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6849c97bdb0948bc824cf5efe0f709a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e94509e985441f7b2802e6c6b164cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:20.521339 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5a739ff1-4897-48c7-9c62-e785613ad7d2 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] 10.222.0.50 "GET /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d" status: 200 len: 1311 microversion: 2.1 time: 0.246698 Aug 31 15:52:20.522577 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 445/908] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:20 2022] GET /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d => generated 1311 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:20.615484 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a255150b-6fce-45bd-bd3b-6f5621e5c8ca tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "DELETE /compute/v2.1/servers/4770c3f5-5b3d-40da-9507-85b77d673094" status: 204 len: 0 microversion: 2.1 time: 0.275457 Aug 31 15:52:20.627985 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c0191709-2c1c-4177-8a08-9e37fe56234e tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:20.628838 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c0191709-2c1c-4177-8a08-9e37fe56234e tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 4770c3f5-5b3d-40da-9507-85b77d673094] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:20.640242 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0191709-2c1c-4177-8a08-9e37fe56234e tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:20.640741 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0191709-2c1c-4177-8a08-9e37fe56234e tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:20.641165 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0191709-2c1c-4177-8a08-9e37fe56234e tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:20.641858 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0191709-2c1c-4177-8a08-9e37fe56234e tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:20.642331 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0191709-2c1c-4177-8a08-9e37fe56234e tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:20.651903 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0191709-2c1c-4177-8a08-9e37fe56234e tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:20.656682 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 464/909] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:52:20 2022] DELETE /compute/v2.1/servers/4770c3f5-5b3d-40da-9507-85b77d673094 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:52:20.682995 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1343e850-c48e-47e4-84c1-d35145fd065a tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:20.683831 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1343e850-c48e-47e4-84c1-d35145fd065a tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] [instance: 14dbaad0-9a67-48c0-a58b-5d9997c078c5] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:20.707518 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1343e850-c48e-47e4-84c1-d35145fd065a tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:20.708408 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1343e850-c48e-47e4-84c1-d35145fd065a tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:20.710626 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1343e850-c48e-47e4-84c1-d35145fd065a tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:20.712870 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1343e850-c48e-47e4-84c1-d35145fd065a tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:20.714233 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1343e850-c48e-47e4-84c1-d35145fd065a tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:20.716232 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1343e850-c48e-47e4-84c1-d35145fd065a tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:21.027334 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c0191709-2c1c-4177-8a08-9e37fe56234e tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:21.040766 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c0191709-2c1c-4177-8a08-9e37fe56234e tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/4770c3f5-5b3d-40da-9507-85b77d673094" status: 200 len: 1472 microversion: 2.1 time: 0.417288 Aug 31 15:52:21.051255 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 446/910] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:20 2022] GET /compute/v2.1/servers/4770c3f5-5b3d-40da-9507-85b77d673094 => generated 1472 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:52:21.051255 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dab09cba-66fb-43c0-9c55-3d9b2cf6ca89 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:21.051255 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dab09cba-66fb-43c0-9c55-3d9b2cf6ca89 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] [instance: 1e8fdb86-13be-42a3-a7af-5d50024f7419] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:21.065564 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dab09cba-66fb-43c0-9c55-3d9b2cf6ca89 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:21.066127 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dab09cba-66fb-43c0-9c55-3d9b2cf6ca89 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:21.066526 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dab09cba-66fb-43c0-9c55-3d9b2cf6ca89 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:21.067248 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dab09cba-66fb-43c0-9c55-3d9b2cf6ca89 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:21.067702 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dab09cba-66fb-43c0-9c55-3d9b2cf6ca89 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:21.068216 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dab09cba-66fb-43c0-9c55-3d9b2cf6ca89 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:21.096802 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1343e850-c48e-47e4-84c1-d35145fd065a tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1cd6d56b0de45179f1b46829536bbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806480da4ae74a23aa20b86e3d6305f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:21.114160 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1343e850-c48e-47e4-84c1-d35145fd065a tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] 10.222.0.50 "GET /compute/v2.1/servers/14dbaad0-9a67-48c0-a58b-5d9997c078c5" status: 200 len: 1316 microversion: 2.1 time: 0.450315 Aug 31 15:52:21.115327 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 465/911] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:20 2022] GET /compute/v2.1/servers/14dbaad0-9a67-48c0-a58b-5d9997c078c5 => generated 1316 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:21.124568 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8b7dd2a4-b3a1-4126-be43-960fe99dfc2a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:21.125347 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8b7dd2a4-b3a1-4126-be43-960fe99dfc2a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:21.142523 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b7dd2a4-b3a1-4126-be43-960fe99dfc2a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:21.143012 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b7dd2a4-b3a1-4126-be43-960fe99dfc2a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:21.143420 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b7dd2a4-b3a1-4126-be43-960fe99dfc2a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:21.144170 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b7dd2a4-b3a1-4126-be43-960fe99dfc2a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:21.144651 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b7dd2a4-b3a1-4126-be43-960fe99dfc2a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:21.145047 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b7dd2a4-b3a1-4126-be43-960fe99dfc2a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:21.155432 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dab09cba-66fb-43c0-9c55-3d9b2cf6ca89 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:21.155968 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dab09cba-66fb-43c0-9c55-3d9b2cf6ca89 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:21.157717 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dab09cba-66fb-43c0-9c55-3d9b2cf6ca89 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:21.163276 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-dab09cba-66fb-43c0-9c55-3d9b2cf6ca89 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lazy-loading 'fault' on Instance uuid 1e8fdb86-13be-42a3-a7af-5d50024f7419 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:52:21.230640 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dab09cba-66fb-43c0-9c55-3d9b2cf6ca89 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704d7c428d3e4a1bbe5fb78485415214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a08078ba5a04c31b6cc63dee67be8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:21.243461 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dab09cba-66fb-43c0-9c55-3d9b2cf6ca89 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] 10.222.0.50 "GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419" status: 200 len: 1332 microversion: 2.1 time: 0.200600 Aug 31 15:52:21.244350 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 447/912] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:21 2022] GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419 => generated 1332 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:21.294002 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e2e33e10-4d24-42dc-a0a6-7f6e582b7f24 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:21.295084 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e2e33e10-4d24-42dc-a0a6-7f6e582b7f24 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] [instance: a90bb0c5-7d56-4e38-8d78-a5c92a9976c3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:21.307580 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2e33e10-4d24-42dc-a0a6-7f6e582b7f24 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:21.309729 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2e33e10-4d24-42dc-a0a6-7f6e582b7f24 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:21.311205 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2e33e10-4d24-42dc-a0a6-7f6e582b7f24 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:21.313709 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2e33e10-4d24-42dc-a0a6-7f6e582b7f24 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:21.315223 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2e33e10-4d24-42dc-a0a6-7f6e582b7f24 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:21.315930 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2e33e10-4d24-42dc-a0a6-7f6e582b7f24 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:21.328719 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:52:21.445941 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e2e33e10-4d24-42dc-a0a6-7f6e582b7f24 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e40446741c470f92d6f60ec910d84e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c897eb2e5b4101858807f875a8ac0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:21.454741 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e2e33e10-4d24-42dc-a0a6-7f6e582b7f24 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] 10.222.0.50 "GET /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3" status: 200 len: 1303 microversion: 2.1 time: 0.165464 Aug 31 15:52:21.470120 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 448/913] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:21 2022] GET /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3 => generated 1303 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:52:21.474530 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-43c3a4ea-0e9c-4782-939b-5b01e14a4dcb tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:21.475138 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-43c3a4ea-0e9c-4782-939b-5b01e14a4dcb tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 236954ea-2791-477d-a92b-88e590593c63] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:21.494149 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43c3a4ea-0e9c-4782-939b-5b01e14a4dcb tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:21.495063 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43c3a4ea-0e9c-4782-939b-5b01e14a4dcb tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:21.495510 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43c3a4ea-0e9c-4782-939b-5b01e14a4dcb tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:21.496454 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43c3a4ea-0e9c-4782-939b-5b01e14a4dcb tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:21.496936 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43c3a4ea-0e9c-4782-939b-5b01e14a4dcb tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:21.497419 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43c3a4ea-0e9c-4782-939b-5b01e14a4dcb tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:21.566083 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8b7dd2a4-b3a1-4126-be43-960fe99dfc2a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:21.584259 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8b7dd2a4-b3a1-4126-be43-960fe99dfc2a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:21.598447 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8b7dd2a4-b3a1-4126-be43-960fe99dfc2a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:21.600164 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8b7dd2a4-b3a1-4126-be43-960fe99dfc2a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035" status: 200 len: 1566 microversion: 2.25 time: 0.483779 Aug 31 15:52:21.601413 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 466/914] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:52:21 2022] GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035 => generated 1566 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:52:21.614305 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-cd703720-4a34-41fa-b561-8a7848a01807 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:21.615298 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-cd703720-4a34-41fa-b561-8a7848a01807 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] [instance: a21daf16-afa5-4cad-8f8c-6ca10636601d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:21.621857 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cd703720-4a34-41fa-b561-8a7848a01807 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:21.622695 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cd703720-4a34-41fa-b561-8a7848a01807 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:21.623393 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cd703720-4a34-41fa-b561-8a7848a01807 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:21.624791 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cd703720-4a34-41fa-b561-8a7848a01807 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:21.625460 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cd703720-4a34-41fa-b561-8a7848a01807 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:21.626121 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cd703720-4a34-41fa-b561-8a7848a01807 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:21.699126 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cd703720-4a34-41fa-b561-8a7848a01807 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:21.702027 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cd703720-4a34-41fa-b561-8a7848a01807 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:21.702751 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cd703720-4a34-41fa-b561-8a7848a01807 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:21.709529 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-cd703720-4a34-41fa-b561-8a7848a01807 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lazy-loading 'fault' on Instance uuid a21daf16-afa5-4cad-8f8c-6ca10636601d {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:52:21.785691 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-43c3a4ea-0e9c-4782-939b-5b01e14a4dcb tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:21.795091 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-43c3a4ea-0e9c-4782-939b-5b01e14a4dcb tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63" status: 200 len: 1476 microversion: 2.1 time: 0.334790 Aug 31 15:52:21.795666 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 449/915] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:21 2022] GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63 => generated 1476 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:21.801652 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-cd703720-4a34-41fa-b561-8a7848a01807 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6849c97bdb0948bc824cf5efe0f709a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e94509e985441f7b2802e6c6b164cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:21.815518 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-cd703720-4a34-41fa-b561-8a7848a01807 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] 10.222.0.50 "GET /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d" status: 200 len: 1311 microversion: 2.1 time: 0.212783 Aug 31 15:52:21.817053 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 467/916] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:21 2022] GET /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d => generated 1311 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:22.092370 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3922ff73-5d9a-4361-8f0d-7f7edaea5933 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:22.100352 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3922ff73-5d9a-4361-8f0d-7f7edaea5933 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 4770c3f5-5b3d-40da-9507-85b77d673094] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:22.120325 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3922ff73-5d9a-4361-8f0d-7f7edaea5933 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:22.120820 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3922ff73-5d9a-4361-8f0d-7f7edaea5933 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:22.121251 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3922ff73-5d9a-4361-8f0d-7f7edaea5933 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:22.121957 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3922ff73-5d9a-4361-8f0d-7f7edaea5933 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:22.122523 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3922ff73-5d9a-4361-8f0d-7f7edaea5933 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:22.122864 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3922ff73-5d9a-4361-8f0d-7f7edaea5933 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:22.140756 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-bcd0c094-1a03-41ef-91d1-0a2f839b6ad7 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:22.141829 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-bcd0c094-1a03-41ef-91d1-0a2f839b6ad7 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] [instance: 14dbaad0-9a67-48c0-a58b-5d9997c078c5] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:22.150595 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bcd0c094-1a03-41ef-91d1-0a2f839b6ad7 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:22.151318 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bcd0c094-1a03-41ef-91d1-0a2f839b6ad7 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:22.152108 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bcd0c094-1a03-41ef-91d1-0a2f839b6ad7 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:22.153008 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bcd0c094-1a03-41ef-91d1-0a2f839b6ad7 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:22.153792 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bcd0c094-1a03-41ef-91d1-0a2f839b6ad7 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:22.154258 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bcd0c094-1a03-41ef-91d1-0a2f839b6ad7 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:22.399765 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-bcd0c094-1a03-41ef-91d1-0a2f839b6ad7 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1cd6d56b0de45179f1b46829536bbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806480da4ae74a23aa20b86e3d6305f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:22.414921 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-bcd0c094-1a03-41ef-91d1-0a2f839b6ad7 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] 10.222.0.50 "GET /compute/v2.1/servers/14dbaad0-9a67-48c0-a58b-5d9997c078c5" status: 200 len: 1504 microversion: 2.1 time: 0.278680 Aug 31 15:52:22.418186 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3922ff73-5d9a-4361-8f0d-7f7edaea5933 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:22.434126 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 468/917] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:22 2022] GET /compute/v2.1/servers/14dbaad0-9a67-48c0-a58b-5d9997c078c5 => generated 1504 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:22.434126 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b1bc5de8-9505-42ff-9270-d01dd16e09b4 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:22.434126 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b1bc5de8-9505-42ff-9270-d01dd16e09b4 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] [instance: 1e8fdb86-13be-42a3-a7af-5d50024f7419] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:22.442845 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3922ff73-5d9a-4361-8f0d-7f7edaea5933 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/4770c3f5-5b3d-40da-9507-85b77d673094" status: 200 len: 1472 microversion: 2.1 time: 0.364166 Aug 31 15:52:22.442845 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 450/918] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:22 2022] GET /compute/v2.1/servers/4770c3f5-5b3d-40da-9507-85b77d673094 => generated 1472 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:52:22.443212 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1bc5de8-9505-42ff-9270-d01dd16e09b4 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:22.443212 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1bc5de8-9505-42ff-9270-d01dd16e09b4 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:22.443620 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1bc5de8-9505-42ff-9270-d01dd16e09b4 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:22.444540 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1bc5de8-9505-42ff-9270-d01dd16e09b4 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:22.444997 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1bc5de8-9505-42ff-9270-d01dd16e09b4 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:22.445423 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1bc5de8-9505-42ff-9270-d01dd16e09b4 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:22.455586 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-09d3613f-24a5-4945-9c86-8e979e5b1840 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:22.456123 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-09d3613f-24a5-4945-9c86-8e979e5b1840 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] [instance: 14dbaad0-9a67-48c0-a58b-5d9997c078c5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:22.464096 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09d3613f-24a5-4945-9c86-8e979e5b1840 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:22.464629 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09d3613f-24a5-4945-9c86-8e979e5b1840 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:22.465067 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09d3613f-24a5-4945-9c86-8e979e5b1840 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:22.465986 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09d3613f-24a5-4945-9c86-8e979e5b1840 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:22.466456 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09d3613f-24a5-4945-9c86-8e979e5b1840 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:22.466876 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09d3613f-24a5-4945-9c86-8e979e5b1840 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:22.517988 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1bc5de8-9505-42ff-9270-d01dd16e09b4 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:22.519313 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1bc5de8-9505-42ff-9270-d01dd16e09b4 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:22.519758 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1bc5de8-9505-42ff-9270-d01dd16e09b4 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:22.520263 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-b1bc5de8-9505-42ff-9270-d01dd16e09b4 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lazy-loading 'fault' on Instance uuid 1e8fdb86-13be-42a3-a7af-5d50024f7419 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:52:22.552372 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-09d3613f-24a5-4945-9c86-8e979e5b1840 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] 10.222.0.50 "DELETE /compute/v2.1/servers/14dbaad0-9a67-48c0-a58b-5d9997c078c5/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.101363 Aug 31 15:52:22.553719 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 451/919] 10.222.0.50 () {58 vars in 1296 bytes} [Wed Aug 31 15:52:22 2022] DELETE /compute/v2.1/servers/14dbaad0-9a67-48c0-a58b-5d9997c078c5/os-server-password => generated 0 bytes in 103 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 15:52:22.562126 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6f10025c-e3b4-45c5-ab6f-2e7ffa9653fb tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:22.562126 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6f10025c-e3b4-45c5-ab6f-2e7ffa9653fb tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] [instance: a90bb0c5-7d56-4e38-8d78-a5c92a9976c3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:22.567640 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6f10025c-e3b4-45c5-ab6f-2e7ffa9653fb tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:22.568612 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6f10025c-e3b4-45c5-ab6f-2e7ffa9653fb tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:22.569176 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6f10025c-e3b4-45c5-ab6f-2e7ffa9653fb tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:22.569890 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6f10025c-e3b4-45c5-ab6f-2e7ffa9653fb tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:22.570382 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6f10025c-e3b4-45c5-ab6f-2e7ffa9653fb tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:22.570886 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6f10025c-e3b4-45c5-ab6f-2e7ffa9653fb tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:22.591019 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b1bc5de8-9505-42ff-9270-d01dd16e09b4 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704d7c428d3e4a1bbe5fb78485415214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a08078ba5a04c31b6cc63dee67be8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:22.626503 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b1bc5de8-9505-42ff-9270-d01dd16e09b4 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] 10.222.0.50 "GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419" status: 200 len: 1332 microversion: 2.1 time: 0.185028 Aug 31 15:52:22.627356 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 469/920] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:22 2022] GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419 => generated 1332 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:22.632798 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a46f1335-2205-47f4-b769-bd4407dd4b7f tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:22.633295 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a46f1335-2205-47f4-b769-bd4407dd4b7f tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] [instance: 14dbaad0-9a67-48c0-a58b-5d9997c078c5] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:22.658185 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a46f1335-2205-47f4-b769-bd4407dd4b7f tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:22.658769 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a46f1335-2205-47f4-b769-bd4407dd4b7f tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:22.659215 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a46f1335-2205-47f4-b769-bd4407dd4b7f tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:22.660009 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a46f1335-2205-47f4-b769-bd4407dd4b7f tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:22.660486 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a46f1335-2205-47f4-b769-bd4407dd4b7f tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:22.660988 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a46f1335-2205-47f4-b769-bd4407dd4b7f tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:22.702125 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a46f1335-2205-47f4-b769-bd4407dd4b7f tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] 10.222.0.50 "GET /compute/v2.1/servers/14dbaad0-9a67-48c0-a58b-5d9997c078c5/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.073531 Aug 31 15:52:22.703269 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 470/921] 10.222.0.50 () {58 vars in 1293 bytes} [Wed Aug 31 15:52:22 2022] GET /compute/v2.1/servers/14dbaad0-9a67-48c0-a58b-5d9997c078c5/os-server-password => generated 16 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 15:52:22.713753 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-69c67806-953c-40cc-98ef-d8154cfab665 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:22.714672 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-69c67806-953c-40cc-98ef-d8154cfab665 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:22.722998 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6f10025c-e3b4-45c5-ab6f-2e7ffa9653fb tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e40446741c470f92d6f60ec910d84e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c897eb2e5b4101858807f875a8ac0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:22.734430 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6f10025c-e3b4-45c5-ab6f-2e7ffa9653fb tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] 10.222.0.50 "GET /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3" status: 200 len: 1303 microversion: 2.1 time: 0.179620 Aug 31 15:52:22.735031 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 452/922] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:22 2022] GET /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3 => generated 1303 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:22.738876 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69c67806-953c-40cc-98ef-d8154cfab665 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:22.739648 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69c67806-953c-40cc-98ef-d8154cfab665 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:22.740679 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69c67806-953c-40cc-98ef-d8154cfab665 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:22.741777 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69c67806-953c-40cc-98ef-d8154cfab665 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:22.742504 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69c67806-953c-40cc-98ef-d8154cfab665 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:22.743121 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69c67806-953c-40cc-98ef-d8154cfab665 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:22.751687 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8d5e0d6a-84bc-4701-a3f9-fae51ba05836 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:22.752486 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8d5e0d6a-84bc-4701-a3f9-fae51ba05836 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] [instance: 14dbaad0-9a67-48c0-a58b-5d9997c078c5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:22.768410 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d5e0d6a-84bc-4701-a3f9-fae51ba05836 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:22.768818 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d5e0d6a-84bc-4701-a3f9-fae51ba05836 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:22.769254 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d5e0d6a-84bc-4701-a3f9-fae51ba05836 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:22.769960 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d5e0d6a-84bc-4701-a3f9-fae51ba05836 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:22.770438 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d5e0d6a-84bc-4701-a3f9-fae51ba05836 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:22.770901 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d5e0d6a-84bc-4701-a3f9-fae51ba05836 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:22.818066 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8d5e0d6a-84bc-4701-a3f9-fae51ba05836 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] [instance: 14dbaad0-9a67-48c0-a58b-5d9997c078c5] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:52:22.911036 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-69c67806-953c-40cc-98ef-d8154cfab665 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:22.917613 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8d5e0d6a-84bc-4701-a3f9-fae51ba05836 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] 10.222.0.50 "DELETE /compute/v2.1/servers/14dbaad0-9a67-48c0-a58b-5d9997c078c5" status: 204 len: 0 microversion: 2.1 time: 0.175829 Aug 31 15:52:22.918650 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 453/923] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:52:22 2022] DELETE /compute/v2.1/servers/14dbaad0-9a67-48c0-a58b-5d9997c078c5 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:52:22.920681 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-69c67806-953c-40cc-98ef-d8154cfab665 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:22.922218 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-69c67806-953c-40cc-98ef-d8154cfab665 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:22.923379 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-69c67806-953c-40cc-98ef-d8154cfab665 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035" status: 200 len: 1566 microversion: 2.25 time: 0.218970 Aug 31 15:52:22.923926 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 471/924] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:52:22 2022] GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035 => generated 1566 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:52:22.924448 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-91d9c09c-f07c-4fbd-8032-eaa1378d8844 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:22.925631 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-91d9c09c-f07c-4fbd-8032-eaa1378d8844 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 236954ea-2791-477d-a92b-88e590593c63] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:22.939622 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ace09b1c-fdc2-4a26-9db8-9b1168ee678f tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:22.945269 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ace09b1c-fdc2-4a26-9db8-9b1168ee678f tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] [instance: a21daf16-afa5-4cad-8f8c-6ca10636601d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:22.951979 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91d9c09c-f07c-4fbd-8032-eaa1378d8844 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:22.953517 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ace09b1c-fdc2-4a26-9db8-9b1168ee678f tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:22.954346 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91d9c09c-f07c-4fbd-8032-eaa1378d8844 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:22.954969 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91d9c09c-f07c-4fbd-8032-eaa1378d8844 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:22.955823 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91d9c09c-f07c-4fbd-8032-eaa1378d8844 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:22.956070 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ace09b1c-fdc2-4a26-9db8-9b1168ee678f tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:22.956357 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91d9c09c-f07c-4fbd-8032-eaa1378d8844 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:22.956625 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ace09b1c-fdc2-4a26-9db8-9b1168ee678f tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:22.956883 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91d9c09c-f07c-4fbd-8032-eaa1378d8844 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:22.957585 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ace09b1c-fdc2-4a26-9db8-9b1168ee678f tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:22.957984 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ace09b1c-fdc2-4a26-9db8-9b1168ee678f tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:22.958433 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ace09b1c-fdc2-4a26-9db8-9b1168ee678f tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:23.023833 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ace09b1c-fdc2-4a26-9db8-9b1168ee678f tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:23.024322 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ace09b1c-fdc2-4a26-9db8-9b1168ee678f tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:23.024752 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ace09b1c-fdc2-4a26-9db8-9b1168ee678f tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:23.025199 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-ace09b1c-fdc2-4a26-9db8-9b1168ee678f tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lazy-loading 'fault' on Instance uuid a21daf16-afa5-4cad-8f8c-6ca10636601d {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:52:23.028353 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:52:23.120858 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ace09b1c-fdc2-4a26-9db8-9b1168ee678f tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6849c97bdb0948bc824cf5efe0f709a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e94509e985441f7b2802e6c6b164cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:23.129373 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ace09b1c-fdc2-4a26-9db8-9b1168ee678f tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] 10.222.0.50 "GET /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d" status: 200 len: 1311 microversion: 2.1 time: 0.204477 Aug 31 15:52:23.129955 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 472/925] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:22 2022] GET /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d => generated 1311 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:23.134565 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9fb9fdca-d464-443f-bd6f-7ad3daf86947 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:23.135165 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9fb9fdca-d464-443f-bd6f-7ad3daf86947 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] [instance: 14dbaad0-9a67-48c0-a58b-5d9997c078c5] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:23.147047 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9fb9fdca-d464-443f-bd6f-7ad3daf86947 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:23.147548 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9fb9fdca-d464-443f-bd6f-7ad3daf86947 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:23.147985 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9fb9fdca-d464-443f-bd6f-7ad3daf86947 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:23.148726 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9fb9fdca-d464-443f-bd6f-7ad3daf86947 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:23.149137 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9fb9fdca-d464-443f-bd6f-7ad3daf86947 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:23.149549 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9fb9fdca-d464-443f-bd6f-7ad3daf86947 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:23.333599 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-91d9c09c-f07c-4fbd-8032-eaa1378d8844 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:23.342225 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-91d9c09c-f07c-4fbd-8032-eaa1378d8844 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63" status: 200 len: 1476 microversion: 2.1 time: 0.422297 Aug 31 15:52:23.342992 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 454/926] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:22 2022] GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63 => generated 1476 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:23.402835 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9fb9fdca-d464-443f-bd6f-7ad3daf86947 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1cd6d56b0de45179f1b46829536bbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806480da4ae74a23aa20b86e3d6305f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:23.410793 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9fb9fdca-d464-443f-bd6f-7ad3daf86947 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] 10.222.0.50 "GET /compute/v2.1/servers/14dbaad0-9a67-48c0-a58b-5d9997c078c5" status: 200 len: 1510 microversion: 2.1 time: 0.279786 Aug 31 15:52:23.411569 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 473/927] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:23 2022] GET /compute/v2.1/servers/14dbaad0-9a67-48c0-a58b-5d9997c078c5 => generated 1510 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:23.460998 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a0311ffb-f328-4d6e-92fa-ce53303b0236 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:23.461608 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a0311ffb-f328-4d6e-92fa-ce53303b0236 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 4770c3f5-5b3d-40da-9507-85b77d673094] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:23.467817 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a0311ffb-f328-4d6e-92fa-ce53303b0236 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:23.468435 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a0311ffb-f328-4d6e-92fa-ce53303b0236 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:23.468864 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a0311ffb-f328-4d6e-92fa-ce53303b0236 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:23.469548 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a0311ffb-f328-4d6e-92fa-ce53303b0236 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:23.470309 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a0311ffb-f328-4d6e-92fa-ce53303b0236 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:23.470611 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a0311ffb-f328-4d6e-92fa-ce53303b0236 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:23.648070 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-64c04810-a3a1-476a-80f2-fe78ce7e8b08 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:23.648690 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-64c04810-a3a1-476a-80f2-fe78ce7e8b08 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] [instance: 1e8fdb86-13be-42a3-a7af-5d50024f7419] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:23.670399 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-64c04810-a3a1-476a-80f2-fe78ce7e8b08 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:23.670910 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-64c04810-a3a1-476a-80f2-fe78ce7e8b08 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:23.671400 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-64c04810-a3a1-476a-80f2-fe78ce7e8b08 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:23.674333 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-64c04810-a3a1-476a-80f2-fe78ce7e8b08 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:23.674826 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-64c04810-a3a1-476a-80f2-fe78ce7e8b08 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:23.675246 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-64c04810-a3a1-476a-80f2-fe78ce7e8b08 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:23.722842 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a0311ffb-f328-4d6e-92fa-ce53303b0236 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:23.737600 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-64c04810-a3a1-476a-80f2-fe78ce7e8b08 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:23.738687 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-64c04810-a3a1-476a-80f2-fe78ce7e8b08 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:23.739332 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-64c04810-a3a1-476a-80f2-fe78ce7e8b08 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:23.740266 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-64c04810-a3a1-476a-80f2-fe78ce7e8b08 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lazy-loading 'fault' on Instance uuid 1e8fdb86-13be-42a3-a7af-5d50024f7419 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:52:23.752983 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a0311ffb-f328-4d6e-92fa-ce53303b0236 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/4770c3f5-5b3d-40da-9507-85b77d673094" status: 200 len: 1472 microversion: 2.1 time: 0.293087 Aug 31 15:52:23.764850 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 455/928] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:23 2022] GET /compute/v2.1/servers/4770c3f5-5b3d-40da-9507-85b77d673094 => generated 1472 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:23.769501 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-6562a532-5d43-4b54-8322-4418567d2835 req-aa7a39b2-881c-4c10-954b-35ee15bb6ede service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4770c3f5-5b3d-40da-9507-85b77d673094", "name": "network-vif-deleted", "tag": "54fb4822-334f-41ba-aec2-444427824a7b"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:52:23.779732 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-6562a532-5d43-4b54-8322-4418567d2835 req-aa7a39b2-881c-4c10-954b-35ee15bb6ede service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:23.780211 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-6562a532-5d43-4b54-8322-4418567d2835 req-aa7a39b2-881c-4c10-954b-35ee15bb6ede service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:23.780773 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-6562a532-5d43-4b54-8322-4418567d2835 req-aa7a39b2-881c-4c10-954b-35ee15bb6ede service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:23.795661 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-6562a532-5d43-4b54-8322-4418567d2835 req-aa7a39b2-881c-4c10-954b-35ee15bb6ede service nova] Creating event network-vif-deleted:54fb4822-334f-41ba-aec2-444427824a7b for instance 4770c3f5-5b3d-40da-9507-85b77d673094 on n-h2-833090-16 Aug 31 15:52:23.800734 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-6562a532-5d43-4b54-8322-4418567d2835 req-aa7a39b2-881c-4c10-954b-35ee15bb6ede service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034764 Aug 31 15:52:23.801722 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 456/929] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:52:23.808542 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-508b9505-cf92-4d83-b63e-dc5ae5aad46c tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:23.809306 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-508b9505-cf92-4d83-b63e-dc5ae5aad46c tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] [instance: a90bb0c5-7d56-4e38-8d78-a5c92a9976c3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:23.816057 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-508b9505-cf92-4d83-b63e-dc5ae5aad46c tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:23.816547 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-508b9505-cf92-4d83-b63e-dc5ae5aad46c tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:23.816972 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-508b9505-cf92-4d83-b63e-dc5ae5aad46c tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:23.817936 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-508b9505-cf92-4d83-b63e-dc5ae5aad46c tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:23.818608 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-508b9505-cf92-4d83-b63e-dc5ae5aad46c tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:23.819149 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-508b9505-cf92-4d83-b63e-dc5ae5aad46c tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:23.828331 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-64c04810-a3a1-476a-80f2-fe78ce7e8b08 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704d7c428d3e4a1bbe5fb78485415214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a08078ba5a04c31b6cc63dee67be8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:23.840719 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-64c04810-a3a1-476a-80f2-fe78ce7e8b08 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] 10.222.0.50 "GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419" status: 200 len: 1332 microversion: 2.1 time: 0.197188 Aug 31 15:52:23.858971 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 474/930] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:23 2022] GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419 => generated 1332 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:52:23.942620 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-508b9505-cf92-4d83-b63e-dc5ae5aad46c tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e40446741c470f92d6f60ec910d84e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c897eb2e5b4101858807f875a8ac0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:23.947151 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b72f759c-ac44-4afe-a1b8-361911307697 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:23.948256 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b72f759c-ac44-4afe-a1b8-361911307697 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:23.956290 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-508b9505-cf92-4d83-b63e-dc5ae5aad46c tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] 10.222.0.50 "GET /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3" status: 200 len: 1303 microversion: 2.1 time: 0.153221 Aug 31 15:52:23.970136 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 457/931] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:23 2022] GET /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3 => generated 1303 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:23.976358 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b72f759c-ac44-4afe-a1b8-361911307697 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:23.977168 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b72f759c-ac44-4afe-a1b8-361911307697 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:23.978497 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b72f759c-ac44-4afe-a1b8-361911307697 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:23.979250 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b72f759c-ac44-4afe-a1b8-361911307697 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:23.979718 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b72f759c-ac44-4afe-a1b8-361911307697 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:23.980167 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b72f759c-ac44-4afe-a1b8-361911307697 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:24.149498 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-27010716-bc97-48e7-bd8e-6f247e9a2d84 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:24.150436 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-27010716-bc97-48e7-bd8e-6f247e9a2d84 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] [instance: a21daf16-afa5-4cad-8f8c-6ca10636601d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:24.160188 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27010716-bc97-48e7-bd8e-6f247e9a2d84 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:24.160809 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27010716-bc97-48e7-bd8e-6f247e9a2d84 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:24.161306 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27010716-bc97-48e7-bd8e-6f247e9a2d84 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:24.163544 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27010716-bc97-48e7-bd8e-6f247e9a2d84 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:24.164057 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27010716-bc97-48e7-bd8e-6f247e9a2d84 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:24.167558 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27010716-bc97-48e7-bd8e-6f247e9a2d84 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:24.189482 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b72f759c-ac44-4afe-a1b8-361911307697 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:24.215246 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b72f759c-ac44-4afe-a1b8-361911307697 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:24.219389 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b72f759c-ac44-4afe-a1b8-361911307697 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:24.222006 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27010716-bc97-48e7-bd8e-6f247e9a2d84 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:24.222245 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27010716-bc97-48e7-bd8e-6f247e9a2d84 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:24.222532 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27010716-bc97-48e7-bd8e-6f247e9a2d84 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:24.222976 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-27010716-bc97-48e7-bd8e-6f247e9a2d84 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lazy-loading 'fault' on Instance uuid a21daf16-afa5-4cad-8f8c-6ca10636601d {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:52:24.227303 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b72f759c-ac44-4afe-a1b8-361911307697 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035" status: 200 len: 1566 microversion: 2.25 time: 0.284444 Aug 31 15:52:24.245331 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 475/932] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:52:23 2022] GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035 => generated 1566 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:52:24.313035 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-27010716-bc97-48e7-bd8e-6f247e9a2d84 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6849c97bdb0948bc824cf5efe0f709a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e94509e985441f7b2802e6c6b164cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:24.321366 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-27010716-bc97-48e7-bd8e-6f247e9a2d84 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] 10.222.0.50 "GET /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d" status: 200 len: 1311 microversion: 2.1 time: 0.175891 Aug 31 15:52:24.322375 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 458/933] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:24 2022] GET /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d => generated 1311 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:52:24.366007 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e8b16033-316f-4801-8390-c6b627d6b132 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:24.366679 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e8b16033-316f-4801-8390-c6b627d6b132 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 236954ea-2791-477d-a92b-88e590593c63] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:24.382189 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e8b16033-316f-4801-8390-c6b627d6b132 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:24.382189 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e8b16033-316f-4801-8390-c6b627d6b132 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:24.383776 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e8b16033-316f-4801-8390-c6b627d6b132 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:24.384697 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e8b16033-316f-4801-8390-c6b627d6b132 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:24.385169 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e8b16033-316f-4801-8390-c6b627d6b132 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:24.385647 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e8b16033-316f-4801-8390-c6b627d6b132 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:24.432608 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fe57fa50-14d6-4f7a-8de6-6dacd7916ab1 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:24.433478 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fe57fa50-14d6-4f7a-8de6-6dacd7916ab1 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] [instance: 14dbaad0-9a67-48c0-a58b-5d9997c078c5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:24.445931 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe57fa50-14d6-4f7a-8de6-6dacd7916ab1 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:24.446569 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe57fa50-14d6-4f7a-8de6-6dacd7916ab1 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:24.446896 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe57fa50-14d6-4f7a-8de6-6dacd7916ab1 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:24.447592 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe57fa50-14d6-4f7a-8de6-6dacd7916ab1 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:24.448044 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe57fa50-14d6-4f7a-8de6-6dacd7916ab1 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:24.448460 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe57fa50-14d6-4f7a-8de6-6dacd7916ab1 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:24.590647 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e8b16033-316f-4801-8390-c6b627d6b132 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:24.609353 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e8b16033-316f-4801-8390-c6b627d6b132 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63" status: 200 len: 1476 microversion: 2.1 time: 0.246038 Aug 31 15:52:24.610468 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 476/934] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:24 2022] GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63 => generated 1476 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:24.750262 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fe57fa50-14d6-4f7a-8de6-6dacd7916ab1 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1cd6d56b0de45179f1b46829536bbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806480da4ae74a23aa20b86e3d6305f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:24.760491 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fe57fa50-14d6-4f7a-8de6-6dacd7916ab1 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] 10.222.0.50 "GET /compute/v2.1/servers/14dbaad0-9a67-48c0-a58b-5d9997c078c5" status: 200 len: 1510 microversion: 2.1 time: 0.331161 Aug 31 15:52:24.772863 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-55ed5f50-da9f-4114-8560-c7674e203796 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:24.774226 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-55ed5f50-da9f-4114-8560-c7674e203796 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 4770c3f5-5b3d-40da-9507-85b77d673094] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:24.775368 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 459/935] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:24 2022] GET /compute/v2.1/servers/14dbaad0-9a67-48c0-a58b-5d9997c078c5 => generated 1510 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:52:24.782002 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-55ed5f50-da9f-4114-8560-c7674e203796 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:24.783044 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-55ed5f50-da9f-4114-8560-c7674e203796 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:24.783690 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-55ed5f50-da9f-4114-8560-c7674e203796 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:24.786045 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-55ed5f50-da9f-4114-8560-c7674e203796 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:24.786821 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-55ed5f50-da9f-4114-8560-c7674e203796 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:24.787466 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-55ed5f50-da9f-4114-8560-c7674e203796 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:24.827214 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-55ed5f50-da9f-4114-8560-c7674e203796 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:24.828131 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-55ed5f50-da9f-4114-8560-c7674e203796 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:24.828725 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-55ed5f50-da9f-4114-8560-c7674e203796 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:24.829370 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-55ed5f50-da9f-4114-8560-c7674e203796 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lazy-loading 'fault' on Instance uuid 4770c3f5-5b3d-40da-9507-85b77d673094 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:52:24.867438 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2d9558e5-349d-4bf5-8bc1-b82c5f694681 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:24.869065 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2d9558e5-349d-4bf5-8bc1-b82c5f694681 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] [instance: 1e8fdb86-13be-42a3-a7af-5d50024f7419] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:24.880304 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:52:24.882015 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:52:24.888768 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d9558e5-349d-4bf5-8bc1-b82c5f694681 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:24.889381 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d9558e5-349d-4bf5-8bc1-b82c5f694681 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:24.890188 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d9558e5-349d-4bf5-8bc1-b82c5f694681 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:24.891100 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d9558e5-349d-4bf5-8bc1-b82c5f694681 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:24.891702 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d9558e5-349d-4bf5-8bc1-b82c5f694681 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:24.900781 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d9558e5-349d-4bf5-8bc1-b82c5f694681 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:24.914225 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-55ed5f50-da9f-4114-8560-c7674e203796 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:24.929127 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-55ed5f50-da9f-4114-8560-c7674e203796 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/4770c3f5-5b3d-40da-9507-85b77d673094" status: 200 len: 1306 microversion: 2.1 time: 0.160518 Aug 31 15:52:24.930320 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 477/936] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:24 2022] GET /compute/v2.1/servers/4770c3f5-5b3d-40da-9507-85b77d673094 => generated 1306 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:24.954241 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d9558e5-349d-4bf5-8bc1-b82c5f694681 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:24.954724 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d9558e5-349d-4bf5-8bc1-b82c5f694681 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:24.955201 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d9558e5-349d-4bf5-8bc1-b82c5f694681 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:24.955597 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-2d9558e5-349d-4bf5-8bc1-b82c5f694681 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lazy-loading 'fault' on Instance uuid 1e8fdb86-13be-42a3-a7af-5d50024f7419 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:52:24.979680 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4bc5097f-86e4-46ef-aa0b-2c3be7b72db5 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:24.980337 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4bc5097f-86e4-46ef-aa0b-2c3be7b72db5 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] [instance: a90bb0c5-7d56-4e38-8d78-a5c92a9976c3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:24.989170 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4bc5097f-86e4-46ef-aa0b-2c3be7b72db5 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:24.989668 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4bc5097f-86e4-46ef-aa0b-2c3be7b72db5 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:24.991251 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4bc5097f-86e4-46ef-aa0b-2c3be7b72db5 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:24.992176 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4bc5097f-86e4-46ef-aa0b-2c3be7b72db5 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:24.992979 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4bc5097f-86e4-46ef-aa0b-2c3be7b72db5 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:24.993563 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4bc5097f-86e4-46ef-aa0b-2c3be7b72db5 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:25.057246 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2d9558e5-349d-4bf5-8bc1-b82c5f694681 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704d7c428d3e4a1bbe5fb78485415214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a08078ba5a04c31b6cc63dee67be8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:25.065526 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2d9558e5-349d-4bf5-8bc1-b82c5f694681 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] 10.222.0.50 "GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419" status: 200 len: 1332 microversion: 2.1 time: 0.202558 Aug 31 15:52:25.084288 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 460/937] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:24 2022] GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419 => generated 1332 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:25.087547 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4bc5097f-86e4-46ef-aa0b-2c3be7b72db5 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e40446741c470f92d6f60ec910d84e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c897eb2e5b4101858807f875a8ac0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:25.125193 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4bc5097f-86e4-46ef-aa0b-2c3be7b72db5 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] 10.222.0.50 "GET /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3" status: 200 len: 1303 microversion: 2.1 time: 0.151573 Aug 31 15:52:25.125808 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 478/938] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:24 2022] GET /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3 => generated 1303 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:52:25.262555 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ab66c6d5-3c9d-4f70-bf6a-9f3e2fd07a06 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:25.263502 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ab66c6d5-3c9d-4f70-bf6a-9f3e2fd07a06 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:25.274350 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab66c6d5-3c9d-4f70-bf6a-9f3e2fd07a06 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:25.275630 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab66c6d5-3c9d-4f70-bf6a-9f3e2fd07a06 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:25.275935 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab66c6d5-3c9d-4f70-bf6a-9f3e2fd07a06 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:25.276891 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab66c6d5-3c9d-4f70-bf6a-9f3e2fd07a06 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:25.277438 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab66c6d5-3c9d-4f70-bf6a-9f3e2fd07a06 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:25.278193 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab66c6d5-3c9d-4f70-bf6a-9f3e2fd07a06 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:25.345074 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-41f2802c-dee3-45a5-9324-9d4ba2f333aa tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:25.345818 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-41f2802c-dee3-45a5-9324-9d4ba2f333aa tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] [instance: a21daf16-afa5-4cad-8f8c-6ca10636601d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:25.348294 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=6 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:52:25.358658 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-41f2802c-dee3-45a5-9324-9d4ba2f333aa tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:25.359236 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-41f2802c-dee3-45a5-9324-9d4ba2f333aa tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:25.359771 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-41f2802c-dee3-45a5-9324-9d4ba2f333aa tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:25.360555 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-41f2802c-dee3-45a5-9324-9d4ba2f333aa tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:25.361105 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-41f2802c-dee3-45a5-9324-9d4ba2f333aa tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:25.361605 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-41f2802c-dee3-45a5-9324-9d4ba2f333aa tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:25.393331 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-41f2802c-dee3-45a5-9324-9d4ba2f333aa tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] HTTP exception thrown: Instance a21daf16-afa5-4cad-8f8c-6ca10636601d could not be found. Aug 31 15:52:25.395054 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-41f2802c-dee3-45a5-9324-9d4ba2f333aa tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Request method failure captured: Aug 31 15:52:25.395054 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d HTTP/1.1 Aug 31 15:52:25.395054 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:52:25.395054 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:52:25.395054 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:52:25.395054 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:52:25.395054 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:52:25.395054 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:52:25.395054 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:52:25.395054 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:52:25.395054 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4NwlChJuEmQnC81MpDm47mejLzUH_CopXZ48X929JdrZlmm322y1PIjD7M63EJWNjlsSW1LSCIWiudbdE4Z8E4P4jF-tMRySzMml-bO2JfRoGyL6hv67U5wd3ZjFgI4y2S0QV9OhHqoQPFyojZ8qcHdCMwFgq7mS34v-Xz42uBWr30 Aug 31 15:52:25.395054 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:52:25.395054 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:52:25.395054 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:52:25.395054 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:52:25.395054 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:52:25.395054 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:52:25.395054 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 7e94509e985441f7b2802e6c6b164cec Aug 31 15:52:25.395054 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1314834322 Aug 31 15:52:25.395054 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:52:25.395054 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:52:25.396664 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7e94509e985441f7b2802e6c6b164cec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7e94509e985441f7b2802e6c6b164cec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7e94509e985441f7b2802e6c6b164cec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7e94509e985441f7b2802e6c6b164cec", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:52:25.396664 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1314834322 Aug 31 15:52:25.396664 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 7e94509e985441f7b2802e6c6b164cec Aug 31 15:52:25.396664 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1314834322 Aug 31 15:52:25.396664 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServersAdminNegativeTestJSON-1314834322-project Aug 31 15:52:25.396664 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:52:25.396664 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:52:25.396664 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 6849c97bdb0948bc824cf5efe0f709a5 Aug 31 15:52:25.396664 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1314834322-project Aug 31 15:52:25.396664 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:52:25.396664 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance a21daf16-afa5-4cad-8f8c-6ca10636601d could not be found. Aug 31 15:52:25.396664 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'a21daf16-afa5-4cad-8f8c-6ca10636601d'} Aug 31 15:52:25.397498 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:52:25.397498 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:25.397498 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:52:25.397498 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:52:25.397498 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:52:25.397498 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:52:25.397498 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:52:25.397498 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:52:25.397498 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:52:25.397498 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:52:25.397498 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a21daf16-afa5-4cad-8f8c-6ca10636601d could not be found. Aug 31 15:52:25.397498 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:25.397498 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:52:25.397498 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:25.397498 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:25.397498 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:52:25.397498 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:52:25.397498 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:52:25.397498 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:52:25.397498 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:52:25.399032 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:52:25.399032 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:52:25.399032 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:52:25.399032 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:52:25.399032 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:52:25.399032 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:52:25.399032 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:52:25.399032 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a21daf16-afa5-4cad-8f8c-6ca10636601d could not be found. Aug 31 15:52:25.399032 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:25.399032 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:52:25.399032 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:25.399032 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:25.399032 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:52:25.399032 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:52:25.399032 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:52:25.399032 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:52:25.399032 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a21daf16-afa5-4cad-8f8c-6ca10636601d could not be found. Aug 31 15:52:25.399032 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:25.400560 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-41f2802c-dee3-45a5-9324-9d4ba2f333aa tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Returning 404 to user: Instance a21daf16-afa5-4cad-8f8c-6ca10636601d could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:52:25.400560 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-41f2802c-dee3-45a5-9324-9d4ba2f333aa tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] 10.222.0.50 "GET /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d" status: 404 len: 111 microversion: 2.1 time: 0.055439 Aug 31 15:52:25.400560 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 479/939] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:25 2022] GET /compute/v2.1/servers/a21daf16-afa5-4cad-8f8c-6ca10636601d => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 15:52:25.406678 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-18c0b624-521e-4dd0-86a0-b53d5ca0f46c tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:25.407303 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-18c0b624-521e-4dd0-86a0-b53d5ca0f46c tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] [instance: 842a551a-278d-4bd3-82e5-91a4c271d69a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:25.413945 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-18c0b624-521e-4dd0-86a0-b53d5ca0f46c tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:25.414539 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-18c0b624-521e-4dd0-86a0-b53d5ca0f46c tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:25.415111 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-18c0b624-521e-4dd0-86a0-b53d5ca0f46c tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:25.415871 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-18c0b624-521e-4dd0-86a0-b53d5ca0f46c tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:25.416396 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-18c0b624-521e-4dd0-86a0-b53d5ca0f46c tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:25.416827 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-18c0b624-521e-4dd0-86a0-b53d5ca0f46c tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:25.454692 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-18c0b624-521e-4dd0-86a0-b53d5ca0f46c tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] [instance: 842a551a-278d-4bd3-82e5-91a4c271d69a] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:52:25.549631 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ab66c6d5-3c9d-4f70-bf6a-9f3e2fd07a06 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:25.552154 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:52:25.565829 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ab66c6d5-3c9d-4f70-bf6a-9f3e2fd07a06 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:25.567268 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ab66c6d5-3c9d-4f70-bf6a-9f3e2fd07a06 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:25.569359 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ab66c6d5-3c9d-4f70-bf6a-9f3e2fd07a06 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035" status: 200 len: 1566 microversion: 2.25 time: 0.313627 Aug 31 15:52:25.587207 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 461/940] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:52:25 2022] GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035 => generated 1566 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:52:25.630885 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-150d7f6d-95d1-403e-a430-0a17bdbc33e2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:25.631302 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-150d7f6d-95d1-403e-a430-0a17bdbc33e2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 236954ea-2791-477d-a92b-88e590593c63] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:25.643220 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-150d7f6d-95d1-403e-a430-0a17bdbc33e2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:25.644052 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-150d7f6d-95d1-403e-a430-0a17bdbc33e2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:25.644642 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-150d7f6d-95d1-403e-a430-0a17bdbc33e2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:25.645492 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-150d7f6d-95d1-403e-a430-0a17bdbc33e2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:25.646371 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-150d7f6d-95d1-403e-a430-0a17bdbc33e2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:25.649372 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-150d7f6d-95d1-403e-a430-0a17bdbc33e2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:25.670303 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-18c0b624-521e-4dd0-86a0-b53d5ca0f46c tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] 10.222.0.50 "DELETE /compute/v2.1/servers/842a551a-278d-4bd3-82e5-91a4c271d69a" status: 204 len: 0 microversion: 2.1 time: 0.265329 Aug 31 15:52:25.674924 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 480/941] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:52:25 2022] DELETE /compute/v2.1/servers/842a551a-278d-4bd3-82e5-91a4c271d69a => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:52:25.693751 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f3b8fd0c-3933-407d-8854-9100be1943dd tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:25.694504 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f3b8fd0c-3933-407d-8854-9100be1943dd tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] [instance: 842a551a-278d-4bd3-82e5-91a4c271d69a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:25.727970 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f3b8fd0c-3933-407d-8854-9100be1943dd tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:25.728624 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f3b8fd0c-3933-407d-8854-9100be1943dd tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:25.729108 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f3b8fd0c-3933-407d-8854-9100be1943dd tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:25.729793 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f3b8fd0c-3933-407d-8854-9100be1943dd tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:25.730309 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f3b8fd0c-3933-407d-8854-9100be1943dd tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:25.730822 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f3b8fd0c-3933-407d-8854-9100be1943dd tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:26.013679 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-150d7f6d-95d1-403e-a430-0a17bdbc33e2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:26.023596 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-150d7f6d-95d1-403e-a430-0a17bdbc33e2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63" status: 200 len: 1476 microversion: 2.1 time: 0.398411 Aug 31 15:52:26.025151 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 462/942] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:25 2022] GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63 => generated 1476 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:26.042899 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c7d38ff3-1d66-4e6a-a3c7-7f708320b1d6 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:26.043955 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c7d38ff3-1d66-4e6a-a3c7-7f708320b1d6 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] [instance: 14dbaad0-9a67-48c0-a58b-5d9997c078c5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:26.063566 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7d38ff3-1d66-4e6a-a3c7-7f708320b1d6 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:26.064934 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7d38ff3-1d66-4e6a-a3c7-7f708320b1d6 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:26.066913 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7d38ff3-1d66-4e6a-a3c7-7f708320b1d6 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:26.068267 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7d38ff3-1d66-4e6a-a3c7-7f708320b1d6 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:26.071154 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7d38ff3-1d66-4e6a-a3c7-7f708320b1d6 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:26.079193 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7d38ff3-1d66-4e6a-a3c7-7f708320b1d6 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:26.082465 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f3b8fd0c-3933-407d-8854-9100be1943dd tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6849c97bdb0948bc824cf5efe0f709a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e94509e985441f7b2802e6c6b164cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:26.091869 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f3b8fd0c-3933-407d-8854-9100be1943dd tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] 10.222.0.50 "GET /compute/v2.1/servers/842a551a-278d-4bd3-82e5-91a4c271d69a" status: 200 len: 1478 microversion: 2.1 time: 0.413570 Aug 31 15:52:26.091869 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 481/943] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:25 2022] GET /compute/v2.1/servers/842a551a-278d-4bd3-82e5-91a4c271d69a => generated 1478 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:26.099239 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-971c1458-3c4d-45fc-af53-d26001c9d93e req-7eab288e-7f05-4511-a106-6a2fb739080f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14dbaad0-9a67-48c0-a58b-5d9997c078c5", "name": "network-vif-deleted", "tag": "5f62d425-884d-403a-93a6-ae540948466b"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:52:26.118525 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-971c1458-3c4d-45fc-af53-d26001c9d93e req-7eab288e-7f05-4511-a106-6a2fb739080f service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:26.119003 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-971c1458-3c4d-45fc-af53-d26001c9d93e req-7eab288e-7f05-4511-a106-6a2fb739080f service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:26.119427 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-971c1458-3c4d-45fc-af53-d26001c9d93e req-7eab288e-7f05-4511-a106-6a2fb739080f service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:26.138390 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-971c1458-3c4d-45fc-af53-d26001c9d93e req-7eab288e-7f05-4511-a106-6a2fb739080f service nova] Creating event network-vif-deleted:5f62d425-884d-403a-93a6-ae540948466b for instance 14dbaad0-9a67-48c0-a58b-5d9997c078c5 on n-h2-833090-16 Aug 31 15:52:26.153800 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-971c1458-3c4d-45fc-af53-d26001c9d93e req-7eab288e-7f05-4511-a106-6a2fb739080f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060539 Aug 31 15:52:26.158655 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 482/944] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:52:26.165992 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-feb6794c-cc9b-499b-86da-0d8214aace48 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:26.166742 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-feb6794c-cc9b-499b-86da-0d8214aace48 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 4770c3f5-5b3d-40da-9507-85b77d673094] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:26.173570 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-feb6794c-cc9b-499b-86da-0d8214aace48 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:26.174043 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-feb6794c-cc9b-499b-86da-0d8214aace48 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:26.174589 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-feb6794c-cc9b-499b-86da-0d8214aace48 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:26.175180 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-feb6794c-cc9b-499b-86da-0d8214aace48 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:26.175498 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c7d38ff3-1d66-4e6a-a3c7-7f708320b1d6 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1cd6d56b0de45179f1b46829536bbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806480da4ae74a23aa20b86e3d6305f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:26.175635 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-feb6794c-cc9b-499b-86da-0d8214aace48 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:26.176028 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-feb6794c-cc9b-499b-86da-0d8214aace48 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:26.184232 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c7d38ff3-1d66-4e6a-a3c7-7f708320b1d6 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] 10.222.0.50 "GET /compute/v2.1/servers/14dbaad0-9a67-48c0-a58b-5d9997c078c5" status: 200 len: 1468 microversion: 2.1 time: 0.149189 Aug 31 15:52:26.185374 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 463/945] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:26 2022] GET /compute/v2.1/servers/14dbaad0-9a67-48c0-a58b-5d9997c078c5 => generated 1468 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:26.190496 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7baa7e19-77c4-4bc7-9e0e-cbf056d18ecf tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:26.191490 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7baa7e19-77c4-4bc7-9e0e-cbf056d18ecf tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] [instance: 1e8fdb86-13be-42a3-a7af-5d50024f7419] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:26.198188 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7baa7e19-77c4-4bc7-9e0e-cbf056d18ecf tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:26.198732 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7baa7e19-77c4-4bc7-9e0e-cbf056d18ecf tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:26.199168 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7baa7e19-77c4-4bc7-9e0e-cbf056d18ecf tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:26.199876 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7baa7e19-77c4-4bc7-9e0e-cbf056d18ecf tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:26.200331 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7baa7e19-77c4-4bc7-9e0e-cbf056d18ecf tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:26.200824 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7baa7e19-77c4-4bc7-9e0e-cbf056d18ecf tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:26.203201 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-feb6794c-cc9b-499b-86da-0d8214aace48 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] HTTP exception thrown: Instance 4770c3f5-5b3d-40da-9507-85b77d673094 could not be found. Aug 31 15:52:26.205077 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-feb6794c-cc9b-499b-86da-0d8214aace48 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Request method failure captured: Aug 31 15:52:26.205077 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/4770c3f5-5b3d-40da-9507-85b77d673094 HTTP/1.1 Aug 31 15:52:26.205077 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:52:26.205077 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:52:26.205077 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:52:26.205077 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:52:26.205077 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:52:26.205077 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:52:26.205077 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:52:26.205077 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:52:26.205077 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4L5y07547XEfI_cY_8ZFyTZ2GODruSaAiNwL5T7pV746ldskVNIIQw6lIoEqrgxXvEXbIblt4yfV5d-cxgOpBf2oAyg-UpeVanVK5I-BR_CVasS0-Y9DUowTZd9jVO3T3hdjRzydMsILc76TUmWEyP017xiZ12asWHDSwtKrB6FkRQ Aug 31 15:52:26.205077 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:52:26.205077 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:52:26.205077 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:52:26.205077 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:52:26.205077 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:52:26.205077 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:52:26.205077 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 7db749eb0a764fa0bb29ddc4abd6d245 Aug 31 15:52:26.205077 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServersOnMultiNodesTest-1874033872 Aug 31 15:52:26.205077 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:52:26.205077 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:52:26.207060 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7db749eb0a764fa0bb29ddc4abd6d245"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7db749eb0a764fa0bb29ddc4abd6d245"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7db749eb0a764fa0bb29ddc4abd6d245"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7db749eb0a764fa0bb29ddc4abd6d245", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:52:26.207060 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServersOnMultiNodesTest-1874033872 Aug 31 15:52:26.207060 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 7db749eb0a764fa0bb29ddc4abd6d245 Aug 31 15:52:26.207060 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1874033872 Aug 31 15:52:26.207060 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServersOnMultiNodesTest-1874033872-project Aug 31 15:52:26.207060 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:52:26.207060 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:52:26.207060 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: fe647be03cef4e9c86b4fd6e703d0de1 Aug 31 15:52:26.207060 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServersOnMultiNodesTest-1874033872-project Aug 31 15:52:26.207060 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:52:26.207060 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 4770c3f5-5b3d-40da-9507-85b77d673094 could not be found. Aug 31 15:52:26.207060 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '4770c3f5-5b3d-40da-9507-85b77d673094'} Aug 31 15:52:26.208246 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:52:26.208246 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:26.208246 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:52:26.208246 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:52:26.208246 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:52:26.208246 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:52:26.208246 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:52:26.208246 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:52:26.208246 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:52:26.208246 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:52:26.208246 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4770c3f5-5b3d-40da-9507-85b77d673094 could not be found. Aug 31 15:52:26.208246 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:26.208246 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:52:26.208246 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:26.208246 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:26.208246 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:52:26.208246 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:52:26.208246 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:52:26.208246 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:52:26.208246 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:52:26.210298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:52:26.210298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:52:26.210298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:52:26.210298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:52:26.210298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:52:26.210298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:52:26.210298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:52:26.210298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4770c3f5-5b3d-40da-9507-85b77d673094 could not be found. Aug 31 15:52:26.210298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:26.210298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:52:26.210298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:26.210298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:26.210298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:52:26.210298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:52:26.210298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:52:26.210298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:52:26.210298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4770c3f5-5b3d-40da-9507-85b77d673094 could not be found. Aug 31 15:52:26.210298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:26.212869 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-feb6794c-cc9b-499b-86da-0d8214aace48 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Returning 404 to user: Instance 4770c3f5-5b3d-40da-9507-85b77d673094 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:52:26.212869 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-feb6794c-cc9b-499b-86da-0d8214aace48 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/4770c3f5-5b3d-40da-9507-85b77d673094" status: 404 len: 111 microversion: 2.1 time: 0.047122 Aug 31 15:52:26.212869 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 483/946] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:26 2022] GET /compute/v2.1/servers/4770c3f5-5b3d-40da-9507-85b77d673094 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:52:26.213356 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3fb1afcb-6744-4f37-a38b-825182c5ba08 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:26.214642 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3fb1afcb-6744-4f37-a38b-825182c5ba08 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] [instance: a90bb0c5-7d56-4e38-8d78-a5c92a9976c3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:26.223906 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3fb1afcb-6744-4f37-a38b-825182c5ba08 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:26.225258 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3fb1afcb-6744-4f37-a38b-825182c5ba08 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:26.226358 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3fb1afcb-6744-4f37-a38b-825182c5ba08 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:26.227430 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3fb1afcb-6744-4f37-a38b-825182c5ba08 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:26.228493 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3fb1afcb-6744-4f37-a38b-825182c5ba08 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:26.229215 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3fb1afcb-6744-4f37-a38b-825182c5ba08 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:26.238990 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7baa7e19-77c4-4bc7-9e0e-cbf056d18ecf tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:26.239463 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7baa7e19-77c4-4bc7-9e0e-cbf056d18ecf tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:26.240457 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7baa7e19-77c4-4bc7-9e0e-cbf056d18ecf tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:26.240906 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-7baa7e19-77c4-4bc7-9e0e-cbf056d18ecf tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lazy-loading 'fault' on Instance uuid 1e8fdb86-13be-42a3-a7af-5d50024f7419 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:52:26.330554 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7baa7e19-77c4-4bc7-9e0e-cbf056d18ecf tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704d7c428d3e4a1bbe5fb78485415214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a08078ba5a04c31b6cc63dee67be8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:26.333230 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3fb1afcb-6744-4f37-a38b-825182c5ba08 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e40446741c470f92d6f60ec910d84e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c897eb2e5b4101858807f875a8ac0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:26.344758 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7baa7e19-77c4-4bc7-9e0e-cbf056d18ecf tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] 10.222.0.50 "GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419" status: 200 len: 1332 microversion: 2.1 time: 0.158294 Aug 31 15:52:26.358137 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 464/947] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:26 2022] GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419 => generated 1332 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:26.358137 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5504b540-e26f-4f51-9908-6db981cc0550 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:26.358470 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5504b540-e26f-4f51-9908-6db981cc0550 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 9cb430ca-c340-479a-b269-4672431bd393] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:26.364953 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5504b540-e26f-4f51-9908-6db981cc0550 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:26.365789 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5504b540-e26f-4f51-9908-6db981cc0550 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:26.366020 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3fb1afcb-6744-4f37-a38b-825182c5ba08 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] 10.222.0.50 "GET /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3" status: 200 len: 1303 microversion: 2.1 time: 0.156285 Aug 31 15:52:26.366542 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5504b540-e26f-4f51-9908-6db981cc0550 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:26.367384 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5504b540-e26f-4f51-9908-6db981cc0550 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:26.368005 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5504b540-e26f-4f51-9908-6db981cc0550 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:26.368575 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5504b540-e26f-4f51-9908-6db981cc0550 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:26.380041 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 484/948] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:26 2022] GET /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3 => generated 1303 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:26.409480 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5504b540-e26f-4f51-9908-6db981cc0550 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 9cb430ca-c340-479a-b269-4672431bd393] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:52:26.502207 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5504b540-e26f-4f51-9908-6db981cc0550 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "DELETE /compute/v2.1/servers/9cb430ca-c340-479a-b269-4672431bd393" status: 204 len: 0 microversion: 2.1 time: 0.147866 Aug 31 15:52:26.502764 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 465/949] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:52:26 2022] DELETE /compute/v2.1/servers/9cb430ca-c340-479a-b269-4672431bd393 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:52:26.511325 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-aac43d37-2b81-4854-922c-b3954a51c212 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:26.512154 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-aac43d37-2b81-4854-922c-b3954a51c212 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 9cb430ca-c340-479a-b269-4672431bd393] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:26.518348 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aac43d37-2b81-4854-922c-b3954a51c212 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:26.518823 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aac43d37-2b81-4854-922c-b3954a51c212 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:26.519245 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aac43d37-2b81-4854-922c-b3954a51c212 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:26.519931 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aac43d37-2b81-4854-922c-b3954a51c212 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:26.520371 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aac43d37-2b81-4854-922c-b3954a51c212 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:26.520787 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aac43d37-2b81-4854-922c-b3954a51c212 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:26.600183 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4d4e81c1-d572-41b8-9a56-3360683b23df tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:26.601575 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4d4e81c1-d572-41b8-9a56-3360683b23df tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:26.608008 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d4e81c1-d572-41b8-9a56-3360683b23df tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:26.608563 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d4e81c1-d572-41b8-9a56-3360683b23df tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:26.609082 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d4e81c1-d572-41b8-9a56-3360683b23df tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:26.610027 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d4e81c1-d572-41b8-9a56-3360683b23df tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:26.610709 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d4e81c1-d572-41b8-9a56-3360683b23df tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:26.611193 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d4e81c1-d572-41b8-9a56-3360683b23df tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:26.717037 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-aac43d37-2b81-4854-922c-b3954a51c212 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:26.726243 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-aac43d37-2b81-4854-922c-b3954a51c212 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/9cb430ca-c340-479a-b269-4672431bd393" status: 200 len: 1473 microversion: 2.1 time: 0.218336 Aug 31 15:52:26.727021 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 485/950] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:26 2022] GET /compute/v2.1/servers/9cb430ca-c340-479a-b269-4672431bd393 => generated 1473 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:27.045458 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e4513d64-e57b-418c-bf26-44fef7e3b258 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:27.046290 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e4513d64-e57b-418c-bf26-44fef7e3b258 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 236954ea-2791-477d-a92b-88e590593c63] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:27.057098 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4513d64-e57b-418c-bf26-44fef7e3b258 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:27.057586 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4513d64-e57b-418c-bf26-44fef7e3b258 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:27.058015 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4513d64-e57b-418c-bf26-44fef7e3b258 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:27.060702 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4513d64-e57b-418c-bf26-44fef7e3b258 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:27.061774 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4513d64-e57b-418c-bf26-44fef7e3b258 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:27.061774 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4513d64-e57b-418c-bf26-44fef7e3b258 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:27.073178 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4d4e81c1-d572-41b8-9a56-3360683b23df tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:27.084249 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4d4e81c1-d572-41b8-9a56-3360683b23df tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:27.085715 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4d4e81c1-d572-41b8-9a56-3360683b23df tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:27.086902 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4d4e81c1-d572-41b8-9a56-3360683b23df tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035" status: 200 len: 1566 microversion: 2.25 time: 0.491452 Aug 31 15:52:27.087685 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 466/951] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:52:26 2022] GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035 => generated 1566 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 15:52:27.112630 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e4dd79e5-3779-40e4-87b5-d22390253b63 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:27.113572 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e4dd79e5-3779-40e4-87b5-d22390253b63 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] [instance: 842a551a-278d-4bd3-82e5-91a4c271d69a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:27.135930 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4dd79e5-3779-40e4-87b5-d22390253b63 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:27.136427 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4dd79e5-3779-40e4-87b5-d22390253b63 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:27.136860 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4dd79e5-3779-40e4-87b5-d22390253b63 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:27.137567 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4dd79e5-3779-40e4-87b5-d22390253b63 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:27.138015 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4dd79e5-3779-40e4-87b5-d22390253b63 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:27.138466 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4dd79e5-3779-40e4-87b5-d22390253b63 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:27.318836 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e4513d64-e57b-418c-bf26-44fef7e3b258 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:27.328751 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e4513d64-e57b-418c-bf26-44fef7e3b258 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63" status: 200 len: 1476 microversion: 2.1 time: 0.287413 Aug 31 15:52:27.329417 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 486/952] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:27 2022] GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63 => generated 1476 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:27.335895 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2b10bc09-98bf-4fd6-b70b-346192c2ca2e tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:27.335895 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2b10bc09-98bf-4fd6-b70b-346192c2ca2e tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] [instance: 14dbaad0-9a67-48c0-a58b-5d9997c078c5] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:27.342540 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b10bc09-98bf-4fd6-b70b-346192c2ca2e tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:27.343030 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b10bc09-98bf-4fd6-b70b-346192c2ca2e tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:27.343459 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b10bc09-98bf-4fd6-b70b-346192c2ca2e tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:27.344537 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b10bc09-98bf-4fd6-b70b-346192c2ca2e tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:27.345155 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b10bc09-98bf-4fd6-b70b-346192c2ca2e tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:27.345579 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b10bc09-98bf-4fd6-b70b-346192c2ca2e tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:27.371060 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e4dd79e5-3779-40e4-87b5-d22390253b63 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6849c97bdb0948bc824cf5efe0f709a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e94509e985441f7b2802e6c6b164cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:27.379494 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e4dd79e5-3779-40e4-87b5-d22390253b63 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] 10.222.0.50 "GET /compute/v2.1/servers/842a551a-278d-4bd3-82e5-91a4c271d69a" status: 200 len: 1478 microversion: 2.1 time: 0.271563 Aug 31 15:52:27.386154 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 467/953] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:27 2022] GET /compute/v2.1/servers/842a551a-278d-4bd3-82e5-91a4c271d69a => generated 1478 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:52:27.386597 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b10bc09-98bf-4fd6-b70b-346192c2ca2e tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:27.386597 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b10bc09-98bf-4fd6-b70b-346192c2ca2e tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:27.386597 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b10bc09-98bf-4fd6-b70b-346192c2ca2e tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:27.386895 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b195a695-61b2-437c-8cb9-081679154779 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:27.387124 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-2b10bc09-98bf-4fd6-b70b-346192c2ca2e tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lazy-loading 'fault' on Instance uuid 14dbaad0-9a67-48c0-a58b-5d9997c078c5 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:52:27.387219 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b195a695-61b2-437c-8cb9-081679154779 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] [instance: 1e8fdb86-13be-42a3-a7af-5d50024f7419] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:27.396473 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b195a695-61b2-437c-8cb9-081679154779 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:27.397061 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b195a695-61b2-437c-8cb9-081679154779 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:27.397553 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b195a695-61b2-437c-8cb9-081679154779 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:27.399135 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b195a695-61b2-437c-8cb9-081679154779 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:27.399637 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b195a695-61b2-437c-8cb9-081679154779 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:27.400062 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b195a695-61b2-437c-8cb9-081679154779 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:27.438321 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b195a695-61b2-437c-8cb9-081679154779 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:27.438872 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b195a695-61b2-437c-8cb9-081679154779 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:27.439362 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b195a695-61b2-437c-8cb9-081679154779 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:27.439876 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-b195a695-61b2-437c-8cb9-081679154779 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lazy-loading 'fault' on Instance uuid 1e8fdb86-13be-42a3-a7af-5d50024f7419 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:52:27.444086 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2b10bc09-98bf-4fd6-b70b-346192c2ca2e tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1cd6d56b0de45179f1b46829536bbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '806480da4ae74a23aa20b86e3d6305f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:27.452778 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2b10bc09-98bf-4fd6-b70b-346192c2ca2e tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] 10.222.0.50 "GET /compute/v2.1/servers/14dbaad0-9a67-48c0-a58b-5d9997c078c5" status: 200 len: 1306 microversion: 2.1 time: 0.122264 Aug 31 15:52:27.457392 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 487/954] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:27 2022] GET /compute/v2.1/servers/14dbaad0-9a67-48c0-a58b-5d9997c078c5 => generated 1306 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:27.465062 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-feb0ee63-17d7-43f8-851b-636db015dc23 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:27.465822 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-feb0ee63-17d7-43f8-851b-636db015dc23 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] [instance: a90bb0c5-7d56-4e38-8d78-a5c92a9976c3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:27.473125 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-feb0ee63-17d7-43f8-851b-636db015dc23 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:27.473616 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-feb0ee63-17d7-43f8-851b-636db015dc23 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:27.474248 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-feb0ee63-17d7-43f8-851b-636db015dc23 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:27.474991 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-feb0ee63-17d7-43f8-851b-636db015dc23 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:27.475466 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-feb0ee63-17d7-43f8-851b-636db015dc23 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:27.476273 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-feb0ee63-17d7-43f8-851b-636db015dc23 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:27.496504 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b195a695-61b2-437c-8cb9-081679154779 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704d7c428d3e4a1bbe5fb78485415214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a08078ba5a04c31b6cc63dee67be8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:27.496651 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:52:27.505510 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b195a695-61b2-437c-8cb9-081679154779 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] 10.222.0.50 "GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419" status: 200 len: 1332 microversion: 2.1 time: 0.123576 Aug 31 15:52:27.507437 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 468/955] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:27 2022] GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419 => generated 1332 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:27.569550 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-feb0ee63-17d7-43f8-851b-636db015dc23 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e40446741c470f92d6f60ec910d84e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c897eb2e5b4101858807f875a8ac0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:27.578796 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-feb0ee63-17d7-43f8-851b-636db015dc23 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] 10.222.0.50 "GET /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3" status: 200 len: 1303 microversion: 2.1 time: 0.120279 Aug 31 15:52:27.582127 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 488/956] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:27 2022] GET /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3 => generated 1303 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:27.748749 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ff6f239f-8f59-40b2-9fec-a69be3ad2761 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:27.749708 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ff6f239f-8f59-40b2-9fec-a69be3ad2761 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 9cb430ca-c340-479a-b269-4672431bd393] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:27.760729 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ff6f239f-8f59-40b2-9fec-a69be3ad2761 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:27.763850 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ff6f239f-8f59-40b2-9fec-a69be3ad2761 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:27.764570 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ff6f239f-8f59-40b2-9fec-a69be3ad2761 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:27.765405 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ff6f239f-8f59-40b2-9fec-a69be3ad2761 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:27.765963 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ff6f239f-8f59-40b2-9fec-a69be3ad2761 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:27.767755 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ff6f239f-8f59-40b2-9fec-a69be3ad2761 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:27.908277 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ff6f239f-8f59-40b2-9fec-a69be3ad2761 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:27.916716 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ff6f239f-8f59-40b2-9fec-a69be3ad2761 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/9cb430ca-c340-479a-b269-4672431bd393" status: 200 len: 1473 microversion: 2.1 time: 0.172311 Aug 31 15:52:27.917302 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 469/957] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:27 2022] GET /compute/v2.1/servers/9cb430ca-c340-479a-b269-4672431bd393 => generated 1473 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:28.111925 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0f4244b3-aaec-47bf-8131-a4377b21ebae tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:28.112582 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0f4244b3-aaec-47bf-8131-a4377b21ebae tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:28.120402 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0f4244b3-aaec-47bf-8131-a4377b21ebae tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:28.120969 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0f4244b3-aaec-47bf-8131-a4377b21ebae tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:28.121494 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0f4244b3-aaec-47bf-8131-a4377b21ebae tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:28.122228 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0f4244b3-aaec-47bf-8131-a4377b21ebae tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:28.122674 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0f4244b3-aaec-47bf-8131-a4377b21ebae tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:28.123124 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0f4244b3-aaec-47bf-8131-a4377b21ebae tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:28.350421 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-97c51170-df8e-4da2-bf20-dae26da3887f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:28.351909 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-97c51170-df8e-4da2-bf20-dae26da3887f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 236954ea-2791-477d-a92b-88e590593c63] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:28.352835 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0f4244b3-aaec-47bf-8131-a4377b21ebae tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:28.358486 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97c51170-df8e-4da2-bf20-dae26da3887f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:28.359742 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97c51170-df8e-4da2-bf20-dae26da3887f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:28.361763 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97c51170-df8e-4da2-bf20-dae26da3887f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:28.361763 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97c51170-df8e-4da2-bf20-dae26da3887f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:28.361763 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97c51170-df8e-4da2-bf20-dae26da3887f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:28.361763 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97c51170-df8e-4da2-bf20-dae26da3887f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:28.368608 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0f4244b3-aaec-47bf-8131-a4377b21ebae tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:28.368907 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0f4244b3-aaec-47bf-8131-a4377b21ebae tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:28.369891 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0f4244b3-aaec-47bf-8131-a4377b21ebae tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035" status: 200 len: 1566 microversion: 2.25 time: 0.262536 Aug 31 15:52:28.370675 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 489/958] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:52:28 2022] GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035 => generated 1566 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:52:28.400869 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e6d64a57-3422-4e0c-bb2e-95b70ecb60e5 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:28.401508 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e6d64a57-3422-4e0c-bb2e-95b70ecb60e5 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] [instance: 842a551a-278d-4bd3-82e5-91a4c271d69a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:28.408016 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6d64a57-3422-4e0c-bb2e-95b70ecb60e5 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:28.408527 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6d64a57-3422-4e0c-bb2e-95b70ecb60e5 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:28.408954 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6d64a57-3422-4e0c-bb2e-95b70ecb60e5 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:28.409637 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6d64a57-3422-4e0c-bb2e-95b70ecb60e5 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:28.410083 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6d64a57-3422-4e0c-bb2e-95b70ecb60e5 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:28.410517 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6d64a57-3422-4e0c-bb2e-95b70ecb60e5 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:28.697711 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-97c51170-df8e-4da2-bf20-dae26da3887f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:28.705608 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-97c51170-df8e-4da2-bf20-dae26da3887f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63" status: 200 len: 1476 microversion: 2.1 time: 0.360155 Aug 31 15:52:28.706239 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 470/959] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:28 2022] GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63 => generated 1476 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:52:28.711579 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-834afc0d-1aba-4bd4-b3d9-17b8b51ca512 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:28.712284 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-834afc0d-1aba-4bd4-b3d9-17b8b51ca512 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] [instance: 14dbaad0-9a67-48c0-a58b-5d9997c078c5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:28.719295 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-834afc0d-1aba-4bd4-b3d9-17b8b51ca512 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:28.720448 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-834afc0d-1aba-4bd4-b3d9-17b8b51ca512 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:28.720448 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-834afc0d-1aba-4bd4-b3d9-17b8b51ca512 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:28.721612 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-834afc0d-1aba-4bd4-b3d9-17b8b51ca512 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:28.722080 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-834afc0d-1aba-4bd4-b3d9-17b8b51ca512 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:28.722531 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-834afc0d-1aba-4bd4-b3d9-17b8b51ca512 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:28.734982 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e6d64a57-3422-4e0c-bb2e-95b70ecb60e5 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6849c97bdb0948bc824cf5efe0f709a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e94509e985441f7b2802e6c6b164cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:28.738479 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-834afc0d-1aba-4bd4-b3d9-17b8b51ca512 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] HTTP exception thrown: Instance 14dbaad0-9a67-48c0-a58b-5d9997c078c5 could not be found. Aug 31 15:52:28.740663 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-834afc0d-1aba-4bd4-b3d9-17b8b51ca512 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Request method failure captured: Aug 31 15:52:28.740663 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/14dbaad0-9a67-48c0-a58b-5d9997c078c5 HTTP/1.1 Aug 31 15:52:28.740663 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:52:28.740663 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:52:28.740663 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:52:28.740663 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:52:28.740663 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:52:28.740663 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:52:28.740663 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:52:28.740663 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:52:28.740663 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4OU4Mef1lfhqWSAYC1zqws4BiBayLmhtL47bbUhdJQyPyPvYP-axrVqKjnwl6Yo3SJyuJFyq-Z3Qs6Nm1UmB4CfgCguiVzsfbKFd2DKbZLQRT0wU6jH8-jIzDxi24AqnbsIyujy0XtMQVpPyDGrbJIhMlA639FarWB-hMtju5gnZdI Aug 31 15:52:28.740663 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:52:28.740663 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:52:28.740663 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:52:28.740663 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:52:28.740663 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:52:28.740663 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:52:28.740663 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 806480da4ae74a23aa20b86e3d6305f5 Aug 31 15:52:28.740663 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerPasswordTestJSON-1217174169 Aug 31 15:52:28.740663 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:52:28.740663 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:52:28.742073 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/806480da4ae74a23aa20b86e3d6305f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/806480da4ae74a23aa20b86e3d6305f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/806480da4ae74a23aa20b86e3d6305f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_806480da4ae74a23aa20b86e3d6305f5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:52:28.742073 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServerPasswordTestJSON-1217174169 Aug 31 15:52:28.742073 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 806480da4ae74a23aa20b86e3d6305f5 Aug 31 15:52:28.742073 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1217174169 Aug 31 15:52:28.742073 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServerPasswordTestJSON-1217174169-project Aug 31 15:52:28.742073 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:52:28.742073 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:52:28.742073 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: f1cd6d56b0de45179f1b46829536bbde Aug 31 15:52:28.742073 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServerPasswordTestJSON-1217174169-project Aug 31 15:52:28.742073 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 15:52:28.742073 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 14dbaad0-9a67-48c0-a58b-5d9997c078c5 could not be found. Aug 31 15:52:28.742073 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '14dbaad0-9a67-48c0-a58b-5d9997c078c5'} Aug 31 15:52:28.742930 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:52:28.742930 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:28.742930 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:52:28.742930 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:52:28.742930 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:52:28.742930 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:52:28.742930 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:52:28.742930 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:52:28.742930 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:52:28.742930 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:52:28.742930 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14dbaad0-9a67-48c0-a58b-5d9997c078c5 could not be found. Aug 31 15:52:28.742930 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:52:28.742930 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:52:28.742930 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:52:28.742930 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:28.742930 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:52:28.742930 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:52:28.742930 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:52:28.742930 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:52:28.742930 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:52:28.744224 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:52:28.744224 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:52:28.744224 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:52:28.744224 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:52:28.744224 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:52:28.744224 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:52:28.744224 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:52:28.744224 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14dbaad0-9a67-48c0-a58b-5d9997c078c5 could not be found. Aug 31 15:52:28.744224 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:52:28.744224 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:52:28.744224 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:52:28.744224 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:28.744224 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:52:28.744224 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:52:28.744224 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:52:28.744224 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:52:28.744224 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14dbaad0-9a67-48c0-a58b-5d9997c078c5 could not be found. Aug 31 15:52:28.744224 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:52:28.745372 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-834afc0d-1aba-4bd4-b3d9-17b8b51ca512 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] Returning 404 to user: Instance 14dbaad0-9a67-48c0-a58b-5d9997c078c5 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:52:28.745372 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-834afc0d-1aba-4bd4-b3d9-17b8b51ca512 tempest-ServerPasswordTestJSON-1217174169 tempest-ServerPasswordTestJSON-1217174169-project] 10.222.0.50 "GET /compute/v2.1/servers/14dbaad0-9a67-48c0-a58b-5d9997c078c5" status: 404 len: 111 microversion: 2.1 time: 0.035029 Aug 31 15:52:28.745372 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 471/960] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:28 2022] GET /compute/v2.1/servers/14dbaad0-9a67-48c0-a58b-5d9997c078c5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:52:28.747845 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7420fe86-d981-492c-a13f-65497716c94c tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:28.748639 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7420fe86-d981-492c-a13f-65497716c94c tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] [instance: 1e8fdb86-13be-42a3-a7af-5d50024f7419] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:28.750893 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e6d64a57-3422-4e0c-bb2e-95b70ecb60e5 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] 10.222.0.50 "GET /compute/v2.1/servers/842a551a-278d-4bd3-82e5-91a4c271d69a" status: 200 len: 1478 microversion: 2.1 time: 0.353633 Aug 31 15:52:28.752936 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 490/961] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:28 2022] GET /compute/v2.1/servers/842a551a-278d-4bd3-82e5-91a4c271d69a => generated 1478 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:28.758486 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-047c11b0-6e26-4961-b10d-e13a4cd99e76 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:28.759294 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-047c11b0-6e26-4961-b10d-e13a4cd99e76 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] [instance: a90bb0c5-7d56-4e38-8d78-a5c92a9976c3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:28.765891 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-047c11b0-6e26-4961-b10d-e13a4cd99e76 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:28.766801 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-047c11b0-6e26-4961-b10d-e13a4cd99e76 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:28.767243 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-047c11b0-6e26-4961-b10d-e13a4cd99e76 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:28.767988 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-047c11b0-6e26-4961-b10d-e13a4cd99e76 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:28.768442 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-047c11b0-6e26-4961-b10d-e13a4cd99e76 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:28.769102 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-047c11b0-6e26-4961-b10d-e13a4cd99e76 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:28.770540 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7420fe86-d981-492c-a13f-65497716c94c tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:28.771459 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7420fe86-d981-492c-a13f-65497716c94c tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:28.772144 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7420fe86-d981-492c-a13f-65497716c94c tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:28.773287 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7420fe86-d981-492c-a13f-65497716c94c tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:28.773776 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7420fe86-d981-492c-a13f-65497716c94c tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:28.774439 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7420fe86-d981-492c-a13f-65497716c94c tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:28.811734 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7420fe86-d981-492c-a13f-65497716c94c tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:28.812278 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7420fe86-d981-492c-a13f-65497716c94c tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:28.813044 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7420fe86-d981-492c-a13f-65497716c94c tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:28.813505 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-7420fe86-d981-492c-a13f-65497716c94c tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lazy-loading 'fault' on Instance uuid 1e8fdb86-13be-42a3-a7af-5d50024f7419 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:52:28.910909 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-047c11b0-6e26-4961-b10d-e13a4cd99e76 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e40446741c470f92d6f60ec910d84e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c897eb2e5b4101858807f875a8ac0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:28.920531 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-047c11b0-6e26-4961-b10d-e13a4cd99e76 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] 10.222.0.50 "GET /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3" status: 200 len: 1303 microversion: 2.1 time: 0.166308 Aug 31 15:52:28.921246 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 491/962] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:28 2022] GET /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3 => generated 1303 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:28.940631 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e5ae3372-6fea-4c8b-b0ec-fc3f4fc69afa tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:28.941240 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e5ae3372-6fea-4c8b-b0ec-fc3f4fc69afa tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 9cb430ca-c340-479a-b269-4672431bd393] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:28.946464 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7420fe86-d981-492c-a13f-65497716c94c tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '704d7c428d3e4a1bbe5fb78485415214', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a08078ba5a04c31b6cc63dee67be8c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:28.952914 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e5ae3372-6fea-4c8b-b0ec-fc3f4fc69afa tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:28.954391 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e5ae3372-6fea-4c8b-b0ec-fc3f4fc69afa tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:28.954391 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e5ae3372-6fea-4c8b-b0ec-fc3f4fc69afa tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:28.954723 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e5ae3372-6fea-4c8b-b0ec-fc3f4fc69afa tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:28.956509 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7420fe86-d981-492c-a13f-65497716c94c tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] 10.222.0.50 "GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419" status: 200 len: 1332 microversion: 2.1 time: 0.212684 Aug 31 15:52:28.957897 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 472/963] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:28 2022] GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419 => generated 1332 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:28.970255 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e5ae3372-6fea-4c8b-b0ec-fc3f4fc69afa tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:28.970987 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e5ae3372-6fea-4c8b-b0ec-fc3f4fc69afa tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:29.109196 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-57726b49-ae45-4de9-a312-3e40e27416d7 req-38af3de4-4779-43be-a56b-a209f43db197 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "842a551a-278d-4bd3-82e5-91a4c271d69a", "name": "network-vif-deleted", "tag": "b714daec-6546-4ca8-bc4b-8c3834cdea69"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:52:29.114424 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:52:29.121441 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-57726b49-ae45-4de9-a312-3e40e27416d7 req-38af3de4-4779-43be-a56b-a209f43db197 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:29.121916 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-57726b49-ae45-4de9-a312-3e40e27416d7 req-38af3de4-4779-43be-a56b-a209f43db197 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:29.123010 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-57726b49-ae45-4de9-a312-3e40e27416d7 req-38af3de4-4779-43be-a56b-a209f43db197 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:29.135115 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-57726b49-ae45-4de9-a312-3e40e27416d7 req-38af3de4-4779-43be-a56b-a209f43db197 service nova] Creating event network-vif-deleted:b714daec-6546-4ca8-bc4b-8c3834cdea69 for instance 842a551a-278d-4bd3-82e5-91a4c271d69a on n-h2-833090-16 Aug 31 15:52:29.139826 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-57726b49-ae45-4de9-a312-3e40e27416d7 req-38af3de4-4779-43be-a56b-a209f43db197 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034386 Aug 31 15:52:29.140324 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 473/964] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:52:29.353953 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e5ae3372-6fea-4c8b-b0ec-fc3f4fc69afa tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:29.373777 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e5ae3372-6fea-4c8b-b0ec-fc3f4fc69afa tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/9cb430ca-c340-479a-b269-4672431bd393" status: 200 len: 1473 microversion: 2.1 time: 0.435218 Aug 31 15:52:29.385433 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 492/965] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:28 2022] GET /compute/v2.1/servers/9cb430ca-c340-479a-b269-4672431bd393 => generated 1473 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:29.395593 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0ce8cd97-68ac-47c7-b056-ecb9b92499db tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:29.396748 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0ce8cd97-68ac-47c7-b056-ecb9b92499db tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:29.403146 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ce8cd97-68ac-47c7-b056-ecb9b92499db tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:29.403624 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ce8cd97-68ac-47c7-b056-ecb9b92499db tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:29.404073 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ce8cd97-68ac-47c7-b056-ecb9b92499db tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:29.404768 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ce8cd97-68ac-47c7-b056-ecb9b92499db tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:29.405303 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ce8cd97-68ac-47c7-b056-ecb9b92499db tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:29.405714 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ce8cd97-68ac-47c7-b056-ecb9b92499db tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:29.726060 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0ce8cd97-68ac-47c7-b056-ecb9b92499db tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:29.726979 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4c759b3c-f459-4d5a-9eb7-12a5eb1ccbeb tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:29.728372 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4c759b3c-f459-4d5a-9eb7-12a5eb1ccbeb tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 236954ea-2791-477d-a92b-88e590593c63] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:29.735561 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0ce8cd97-68ac-47c7-b056-ecb9b92499db tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:29.737097 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0ce8cd97-68ac-47c7-b056-ecb9b92499db tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:29.737417 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4c759b3c-f459-4d5a-9eb7-12a5eb1ccbeb tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:29.738081 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4c759b3c-f459-4d5a-9eb7-12a5eb1ccbeb tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:29.738690 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0ce8cd97-68ac-47c7-b056-ecb9b92499db tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035" status: 200 len: 1566 microversion: 2.25 time: 0.347219 Aug 31 15:52:29.739375 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 474/966] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:52:29 2022] GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035 => generated 1566 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:52:29.739594 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4c759b3c-f459-4d5a-9eb7-12a5eb1ccbeb tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:29.740348 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4c759b3c-f459-4d5a-9eb7-12a5eb1ccbeb tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:29.740805 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4c759b3c-f459-4d5a-9eb7-12a5eb1ccbeb tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:29.741428 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4c759b3c-f459-4d5a-9eb7-12a5eb1ccbeb tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:29.775711 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-99d0deaf-d605-4d81-9c5f-ba8bfca3447a tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:29.777381 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-99d0deaf-d605-4d81-9c5f-ba8bfca3447a tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] [instance: 842a551a-278d-4bd3-82e5-91a4c271d69a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:29.784090 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99d0deaf-d605-4d81-9c5f-ba8bfca3447a tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:29.784679 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99d0deaf-d605-4d81-9c5f-ba8bfca3447a tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:29.785242 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99d0deaf-d605-4d81-9c5f-ba8bfca3447a tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:29.786122 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99d0deaf-d605-4d81-9c5f-ba8bfca3447a tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:29.786775 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99d0deaf-d605-4d81-9c5f-ba8bfca3447a tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:29.787270 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99d0deaf-d605-4d81-9c5f-ba8bfca3447a tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:29.820334 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99d0deaf-d605-4d81-9c5f-ba8bfca3447a tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:29.820844 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99d0deaf-d605-4d81-9c5f-ba8bfca3447a tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:29.821286 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99d0deaf-d605-4d81-9c5f-ba8bfca3447a tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:29.821707 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-99d0deaf-d605-4d81-9c5f-ba8bfca3447a tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lazy-loading 'fault' on Instance uuid 842a551a-278d-4bd3-82e5-91a4c271d69a {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:52:29.918772 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-99d0deaf-d605-4d81-9c5f-ba8bfca3447a tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6849c97bdb0948bc824cf5efe0f709a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e94509e985441f7b2802e6c6b164cec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:29.929395 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-99d0deaf-d605-4d81-9c5f-ba8bfca3447a tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] 10.222.0.50 "GET /compute/v2.1/servers/842a551a-278d-4bd3-82e5-91a4c271d69a" status: 200 len: 1312 microversion: 2.1 time: 0.157746 Aug 31 15:52:29.930349 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 475/967] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:29 2022] GET /compute/v2.1/servers/842a551a-278d-4bd3-82e5-91a4c271d69a => generated 1312 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:29.948816 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b197a1cc-54a0-4d02-9e81-235c1543f7fd tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:29.949419 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b197a1cc-54a0-4d02-9e81-235c1543f7fd tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] [instance: a90bb0c5-7d56-4e38-8d78-a5c92a9976c3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:29.959691 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b197a1cc-54a0-4d02-9e81-235c1543f7fd tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:29.960463 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b197a1cc-54a0-4d02-9e81-235c1543f7fd tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:29.961123 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b197a1cc-54a0-4d02-9e81-235c1543f7fd tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:29.962165 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b197a1cc-54a0-4d02-9e81-235c1543f7fd tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:29.962663 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b197a1cc-54a0-4d02-9e81-235c1543f7fd tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:29.963077 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b197a1cc-54a0-4d02-9e81-235c1543f7fd tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:30.123202 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4c759b3c-f459-4d5a-9eb7-12a5eb1ccbeb tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:30.146759 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4c759b3c-f459-4d5a-9eb7-12a5eb1ccbeb tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63" status: 200 len: 1476 microversion: 2.1 time: 0.424063 Aug 31 15:52:30.164449 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 493/968] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:29 2022] GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63 => generated 1476 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:30.164449 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f640505d-665a-4de9-a4b0-cca45310da32 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:30.166369 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f640505d-665a-4de9-a4b0-cca45310da32 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] [instance: 1e8fdb86-13be-42a3-a7af-5d50024f7419] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:30.180925 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f640505d-665a-4de9-a4b0-cca45310da32 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:30.182586 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f640505d-665a-4de9-a4b0-cca45310da32 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:30.194865 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f640505d-665a-4de9-a4b0-cca45310da32 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:30.195613 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f640505d-665a-4de9-a4b0-cca45310da32 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:30.196289 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f640505d-665a-4de9-a4b0-cca45310da32 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:30.196784 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f640505d-665a-4de9-a4b0-cca45310da32 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:30.213458 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-f640505d-665a-4de9-a4b0-cca45310da32 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] HTTP exception thrown: Instance 1e8fdb86-13be-42a3-a7af-5d50024f7419 could not be found. Aug 31 15:52:30.215041 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f640505d-665a-4de9-a4b0-cca45310da32 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Request method failure captured: Aug 31 15:52:30.215041 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419 HTTP/1.1 Aug 31 15:52:30.215041 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:52:30.215041 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:52:30.215041 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:52:30.215041 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:52:30.215041 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:52:30.215041 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:52:30.215041 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:52:30.215041 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:52:30.215041 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4MJFKI8xW2WhmmwQy65o69y6wv8e0WdoShEKQ-eIzJJBzg8HGYExJluBh_glZGMEUfN8MAU-hCQxc92WQSGuvYHAtszFxz-3PA9RJLSde3-Hobd92VY-eShMXig02SGkBxDH5JSplJjKEisOAo3b9XlltmEzzg3Mx9VFeKNbg9gUtY Aug 31 15:52:30.215041 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:52:30.215041 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:52:30.215041 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:52:30.215041 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:52:30.215041 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:52:30.215041 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:52:30.215041 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 8a08078ba5a04c31b6cc63dee67be8c4 Aug 31 15:52:30.215041 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-VolumesAdminNegativeTest-1443261666 Aug 31 15:52:30.215041 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:52:30.215041 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:52:30.216739 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a08078ba5a04c31b6cc63dee67be8c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8a08078ba5a04c31b6cc63dee67be8c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8a08078ba5a04c31b6cc63dee67be8c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8a08078ba5a04c31b6cc63dee67be8c4", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:52:30.216739 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-VolumesAdminNegativeTest-1443261666 Aug 31 15:52:30.216739 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 8a08078ba5a04c31b6cc63dee67be8c4 Aug 31 15:52:30.216739 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1443261666 Aug 31 15:52:30.216739 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-VolumesAdminNegativeTest-1443261666-project Aug 31 15:52:30.216739 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:52:30.216739 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:52:30.216739 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 704d7c428d3e4a1bbe5fb78485415214 Aug 31 15:52:30.216739 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-VolumesAdminNegativeTest-1443261666-project Aug 31 15:52:30.216739 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:52:30.216739 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 1e8fdb86-13be-42a3-a7af-5d50024f7419 could not be found. Aug 31 15:52:30.216739 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '1e8fdb86-13be-42a3-a7af-5d50024f7419'} Aug 31 15:52:30.217705 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:52:30.217705 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:30.217705 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:52:30.217705 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:52:30.217705 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:52:30.217705 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:52:30.217705 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:52:30.217705 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:52:30.217705 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:52:30.217705 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:52:30.217705 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e8fdb86-13be-42a3-a7af-5d50024f7419 could not be found. Aug 31 15:52:30.217705 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:30.217705 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:52:30.217705 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:30.217705 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:30.217705 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:52:30.217705 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:52:30.217705 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:52:30.217705 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:52:30.217705 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:52:30.219239 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:52:30.219239 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:52:30.219239 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:52:30.219239 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:52:30.219239 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:52:30.219239 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:52:30.219239 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:52:30.219239 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e8fdb86-13be-42a3-a7af-5d50024f7419 could not be found. Aug 31 15:52:30.219239 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:30.219239 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:52:30.219239 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:30.219239 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:30.219239 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:52:30.219239 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:52:30.219239 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:52:30.219239 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:52:30.219239 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e8fdb86-13be-42a3-a7af-5d50024f7419 could not be found. Aug 31 15:52:30.219239 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:30.220663 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f640505d-665a-4de9-a4b0-cca45310da32 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Returning 404 to user: Instance 1e8fdb86-13be-42a3-a7af-5d50024f7419 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:52:30.220663 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f640505d-665a-4de9-a4b0-cca45310da32 tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] 10.222.0.50 "GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419" status: 404 len: 111 microversion: 2.1 time: 0.066096 Aug 31 15:52:30.222815 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 494/969] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:30 2022] GET /compute/v2.1/servers/1e8fdb86-13be-42a3-a7af-5d50024f7419 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:52:30.227970 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d47ba4b4-d46f-4d4c-a1be-f851b66dfbfd tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] Calling method '.version_select at 0x7fbb46800670>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:30.254635 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d47ba4b4-d46f-4d4c-a1be-f851b66dfbfd tempest-VolumesAdminNegativeTest-1443261666 tempest-VolumesAdminNegativeTest-1443261666-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1280244927" status: 202 len: 0 microversion: 2.1 time: 0.029560 Aug 31 15:52:30.255993 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 495/970] 10.222.0.50 () {58 vars in 1221 bytes} [Wed Aug 31 15:52:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1280244927 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:52:30.299069 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b197a1cc-54a0-4d02-9e81-235c1543f7fd tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e40446741c470f92d6f60ec910d84e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c897eb2e5b4101858807f875a8ac0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:30.304561 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:52:30.312983 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b197a1cc-54a0-4d02-9e81-235c1543f7fd tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] 10.222.0.50 "GET /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3" status: 200 len: 1369 microversion: 2.1 time: 0.367368 Aug 31 15:52:30.322612 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 476/971] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:29 2022] GET /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3 => generated 1369 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:52:30.397465 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-982b0a25-5127-4cba-a4fe-539175b528b7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:30.398255 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-982b0a25-5127-4cba-a4fe-539175b528b7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 9cb430ca-c340-479a-b269-4672431bd393] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:30.401519 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:52:30.406742 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-982b0a25-5127-4cba-a4fe-539175b528b7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:30.407220 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-982b0a25-5127-4cba-a4fe-539175b528b7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:30.407864 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-982b0a25-5127-4cba-a4fe-539175b528b7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:30.408591 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-982b0a25-5127-4cba-a4fe-539175b528b7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:30.409033 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-982b0a25-5127-4cba-a4fe-539175b528b7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:30.409535 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-982b0a25-5127-4cba-a4fe-539175b528b7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:30.763194 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d9e77b60-b773-4807-87c6-0130214734d0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:30.763826 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d9e77b60-b773-4807-87c6-0130214734d0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:30.771785 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9e77b60-b773-4807-87c6-0130214734d0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:30.772933 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9e77b60-b773-4807-87c6-0130214734d0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:30.773754 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9e77b60-b773-4807-87c6-0130214734d0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:30.774790 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9e77b60-b773-4807-87c6-0130214734d0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:30.775311 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9e77b60-b773-4807-87c6-0130214734d0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:30.776146 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9e77b60-b773-4807-87c6-0130214734d0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:30.962554 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-982b0a25-5127-4cba-a4fe-539175b528b7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:30.974259 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-982b0a25-5127-4cba-a4fe-539175b528b7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/9cb430ca-c340-479a-b269-4672431bd393" status: 200 len: 1473 microversion: 2.1 time: 0.581293 Aug 31 15:52:30.976428 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 496/972] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:30 2022] GET /compute/v2.1/servers/9cb430ca-c340-479a-b269-4672431bd393 => generated 1473 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:30.984098 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a7d79aa8-787c-4c34-bcf2-359b6ae2b838 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:30.985023 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a7d79aa8-787c-4c34-bcf2-359b6ae2b838 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] [instance: 842a551a-278d-4bd3-82e5-91a4c271d69a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:30.995761 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a7d79aa8-787c-4c34-bcf2-359b6ae2b838 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:30.996263 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a7d79aa8-787c-4c34-bcf2-359b6ae2b838 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:30.996701 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a7d79aa8-787c-4c34-bcf2-359b6ae2b838 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:30.997409 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a7d79aa8-787c-4c34-bcf2-359b6ae2b838 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:30.997858 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a7d79aa8-787c-4c34-bcf2-359b6ae2b838 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:30.998331 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a7d79aa8-787c-4c34-bcf2-359b6ae2b838 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:31.018938 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-a7d79aa8-787c-4c34-bcf2-359b6ae2b838 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] HTTP exception thrown: Instance 842a551a-278d-4bd3-82e5-91a4c271d69a could not be found. Aug 31 15:52:31.020599 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a7d79aa8-787c-4c34-bcf2-359b6ae2b838 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Request method failure captured: Aug 31 15:52:31.020599 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/842a551a-278d-4bd3-82e5-91a4c271d69a HTTP/1.1 Aug 31 15:52:31.020599 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:52:31.020599 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:52:31.020599 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:52:31.020599 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:52:31.020599 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:52:31.020599 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:52:31.020599 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:52:31.020599 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:52:31.020599 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4NwlChJuEmQnC81MpDm47mejLzUH_CopXZ48X929JdrZlmm322y1PIjD7M63EJWNjlsSW1LSCIWiudbdE4Z8E4P4jF-tMRySzMml-bO2JfRoGyL6hv67U5wd3ZjFgI4y2S0QV9OhHqoQPFyojZ8qcHdCMwFgq7mS34v-Xz42uBWr30 Aug 31 15:52:31.020599 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:52:31.020599 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:52:31.020599 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:52:31.020599 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:52:31.020599 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:52:31.020599 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:52:31.020599 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 7e94509e985441f7b2802e6c6b164cec Aug 31 15:52:31.020599 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1314834322 Aug 31 15:52:31.020599 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:52:31.020599 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:52:31.022973 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7e94509e985441f7b2802e6c6b164cec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7e94509e985441f7b2802e6c6b164cec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7e94509e985441f7b2802e6c6b164cec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7e94509e985441f7b2802e6c6b164cec", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:52:31.022973 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1314834322 Aug 31 15:52:31.022973 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 7e94509e985441f7b2802e6c6b164cec Aug 31 15:52:31.022973 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1314834322 Aug 31 15:52:31.022973 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServersAdminNegativeTestJSON-1314834322-project Aug 31 15:52:31.022973 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:52:31.022973 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:52:31.022973 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 6849c97bdb0948bc824cf5efe0f709a5 Aug 31 15:52:31.022973 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1314834322-project Aug 31 15:52:31.022973 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:52:31.022973 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 842a551a-278d-4bd3-82e5-91a4c271d69a could not be found. Aug 31 15:52:31.022973 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '842a551a-278d-4bd3-82e5-91a4c271d69a'} Aug 31 15:52:31.023721 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:52:31.023721 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:31.023721 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:52:31.023721 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:52:31.023721 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:52:31.023721 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:52:31.023721 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:52:31.023721 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:52:31.023721 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:52:31.023721 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:52:31.023721 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 842a551a-278d-4bd3-82e5-91a4c271d69a could not be found. Aug 31 15:52:31.023721 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:31.023721 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:52:31.023721 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:31.023721 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:31.023721 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:52:31.023721 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:52:31.023721 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:52:31.023721 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:52:31.023721 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:52:31.025028 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:52:31.025028 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:52:31.025028 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:52:31.025028 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:52:31.025028 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:52:31.025028 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:52:31.025028 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:52:31.025028 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 842a551a-278d-4bd3-82e5-91a4c271d69a could not be found. Aug 31 15:52:31.025028 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:31.025028 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:52:31.025028 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:31.025028 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:31.025028 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:52:31.025028 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:52:31.025028 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:52:31.025028 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:52:31.025028 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 842a551a-278d-4bd3-82e5-91a4c271d69a could not be found. Aug 31 15:52:31.025028 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:31.027846 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a7d79aa8-787c-4c34-bcf2-359b6ae2b838 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] Returning 404 to user: Instance 842a551a-278d-4bd3-82e5-91a4c271d69a could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:52:31.028925 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a7d79aa8-787c-4c34-bcf2-359b6ae2b838 tempest-ServersAdminNegativeTestJSON-1314834322 tempest-ServersAdminNegativeTestJSON-1314834322-project] 10.222.0.50 "GET /compute/v2.1/servers/842a551a-278d-4bd3-82e5-91a4c271d69a" status: 404 len: 111 microversion: 2.1 time: 0.051173 Aug 31 15:52:31.030013 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 497/973] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:30 2022] GET /compute/v2.1/servers/842a551a-278d-4bd3-82e5-91a4c271d69a => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:52:31.174994 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e52a7914-8ee5-4b5b-9407-6bd13125567c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:31.176163 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e52a7914-8ee5-4b5b-9407-6bd13125567c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 236954ea-2791-477d-a92b-88e590593c63] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:31.201565 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e52a7914-8ee5-4b5b-9407-6bd13125567c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:31.202213 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e52a7914-8ee5-4b5b-9407-6bd13125567c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:31.202774 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e52a7914-8ee5-4b5b-9407-6bd13125567c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:31.204602 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e52a7914-8ee5-4b5b-9407-6bd13125567c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:31.205328 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e52a7914-8ee5-4b5b-9407-6bd13125567c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:31.205984 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e52a7914-8ee5-4b5b-9407-6bd13125567c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:31.290081 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d9e77b60-b773-4807-87c6-0130214734d0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:31.303575 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d9e77b60-b773-4807-87c6-0130214734d0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:31.305035 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d9e77b60-b773-4807-87c6-0130214734d0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:31.306234 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d9e77b60-b773-4807-87c6-0130214734d0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035" status: 200 len: 1541 microversion: 2.25 time: 0.548013 Aug 31 15:52:31.312514 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 477/974] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:52:30 2022] GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035 => generated 1541 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:52:31.340862 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e33a557c-7289-4784-9e95-1dd6b8c25218 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:31.341573 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e33a557c-7289-4784-9e95-1dd6b8c25218 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] [instance: a90bb0c5-7d56-4e38-8d78-a5c92a9976c3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:31.349977 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e33a557c-7289-4784-9e95-1dd6b8c25218 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:31.351050 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e33a557c-7289-4784-9e95-1dd6b8c25218 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:31.351491 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e33a557c-7289-4784-9e95-1dd6b8c25218 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:31.352233 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e33a557c-7289-4784-9e95-1dd6b8c25218 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:31.352646 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e33a557c-7289-4784-9e95-1dd6b8c25218 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:31.353063 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e33a557c-7289-4784-9e95-1dd6b8c25218 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:31.782387 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e52a7914-8ee5-4b5b-9407-6bd13125567c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:31.793141 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e52a7914-8ee5-4b5b-9407-6bd13125567c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63" status: 200 len: 1476 microversion: 2.1 time: 0.625114 Aug 31 15:52:31.793622 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 498/975] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:31 2022] GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63 => generated 1476 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:31.799067 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c67ef7e9-ad56-43ed-93ba-d0d30b908fc9 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Calling method '.version_select at 0x7fbb467e0310>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:31.803490 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c67ef7e9-ad56-43ed-93ba-d0d30b908fc9 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:31.804138 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c67ef7e9-ad56-43ed-93ba-d0d30b908fc9 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:31.804788 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c67ef7e9-ad56-43ed-93ba-d0d30b908fc9 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:31.821916 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c67ef7e9-ad56-43ed-93ba-d0d30b908fc9 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] 10.222.0.50 "GET /compute/v2.1/os-migrations" status: 200 len: 1961 microversion: 2.25 time: 0.026992 Aug 31 15:52:31.832531 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 499/976] 10.222.0.50 () {60 vars in 1184 bytes} [Wed Aug 31 15:52:31 2022] GET /compute/v2.1/os-migrations => generated 1961 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:52:31.845249 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6ff8658d-1df9-47d2-962f-ee2b7df6c50f tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:31.846190 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6ff8658d-1df9-47d2-962f-ee2b7df6c50f tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] [instance: 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:31.852992 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6ff8658d-1df9-47d2-962f-ee2b7df6c50f tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:31.853725 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6ff8658d-1df9-47d2-962f-ee2b7df6c50f tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:31.854163 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6ff8658d-1df9-47d2-962f-ee2b7df6c50f tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:31.855056 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6ff8658d-1df9-47d2-962f-ee2b7df6c50f tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:31.855687 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6ff8658d-1df9-47d2-962f-ee2b7df6c50f tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:31.856107 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6ff8658d-1df9-47d2-962f-ee2b7df6c50f tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:31.894675 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e33a557c-7289-4784-9e95-1dd6b8c25218 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e40446741c470f92d6f60ec910d84e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c897eb2e5b4101858807f875a8ac0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:31.905419 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e33a557c-7289-4784-9e95-1dd6b8c25218 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] 10.222.0.50 "GET /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3" status: 200 len: 1369 microversion: 2.1 time: 0.574484 Aug 31 15:52:31.919988 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 478/977] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:31 2022] GET /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3 => generated 1369 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:32.002917 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-80c2fc7f-bebd-4bba-aefd-8aa2a35f6f9c tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:32.003563 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-80c2fc7f-bebd-4bba-aefd-8aa2a35f6f9c tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 9cb430ca-c340-479a-b269-4672431bd393] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:32.020116 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80c2fc7f-bebd-4bba-aefd-8aa2a35f6f9c tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:32.020804 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80c2fc7f-bebd-4bba-aefd-8aa2a35f6f9c tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:32.021226 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80c2fc7f-bebd-4bba-aefd-8aa2a35f6f9c tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:32.021946 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80c2fc7f-bebd-4bba-aefd-8aa2a35f6f9c tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:32.022422 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80c2fc7f-bebd-4bba-aefd-8aa2a35f6f9c tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:32.022842 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80c2fc7f-bebd-4bba-aefd-8aa2a35f6f9c tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:32.298232 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-80c2fc7f-bebd-4bba-aefd-8aa2a35f6f9c tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:32.315398 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-80c2fc7f-bebd-4bba-aefd-8aa2a35f6f9c tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/9cb430ca-c340-479a-b269-4672431bd393" status: 200 len: 1431 microversion: 2.1 time: 0.322304 Aug 31 15:52:32.316341 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 479/978] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:31 2022] GET /compute/v2.1/servers/9cb430ca-c340-479a-b269-4672431bd393 => generated 1431 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:32.482223 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-33afd29c-f7bc-4a34-a40e-5c1147810db3 req-4f11ad44-a583-459b-b4dd-a6a0c647508b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cb430ca-c340-479a-b269-4672431bd393", "name": "network-vif-deleted", "tag": "49e61df5-a85b-44f7-9ed7-4c18051cf4cb"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:52:32.549803 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-33afd29c-f7bc-4a34-a40e-5c1147810db3 req-4f11ad44-a583-459b-b4dd-a6a0c647508b service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:32.550691 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-33afd29c-f7bc-4a34-a40e-5c1147810db3 req-4f11ad44-a583-459b-b4dd-a6a0c647508b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:32.553421 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-33afd29c-f7bc-4a34-a40e-5c1147810db3 req-4f11ad44-a583-459b-b4dd-a6a0c647508b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:32.605710 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-33afd29c-f7bc-4a34-a40e-5c1147810db3 req-4f11ad44-a583-459b-b4dd-a6a0c647508b service nova] Creating event network-vif-deleted:49e61df5-a85b-44f7-9ed7-4c18051cf4cb for instance 9cb430ca-c340-479a-b269-4672431bd393 on n-h1-833090-16 Aug 31 15:52:32.614920 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-33afd29c-f7bc-4a34-a40e-5c1147810db3 req-4f11ad44-a583-459b-b4dd-a6a0c647508b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147227 Aug 31 15:52:32.618236 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 480/979] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:52:32.753055 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-6ff8658d-1df9-47d2-962f-ee2b7df6c50f tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lazy-loading 'services' on Instance uuid 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:52:32.803395 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6ff8658d-1df9-47d2-962f-ee2b7df6c50f tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035" status: 200 len: 2036 microversion: 2.25 time: 0.966511 Aug 31 15:52:32.826029 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 500/980] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:52:31 2022] GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035 => generated 2036 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:52:32.826446 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1a1403a9-583f-416d-a8ec-d3c103b061e3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:32.826446 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1a1403a9-583f-416d-a8ec-d3c103b061e3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 236954ea-2791-477d-a92b-88e590593c63] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:32.835821 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a1403a9-583f-416d-a8ec-d3c103b061e3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:32.836600 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a1403a9-583f-416d-a8ec-d3c103b061e3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:32.837324 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a1403a9-583f-416d-a8ec-d3c103b061e3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:32.838605 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a1403a9-583f-416d-a8ec-d3c103b061e3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:32.838605 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a1403a9-583f-416d-a8ec-d3c103b061e3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:32.843027 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a1403a9-583f-416d-a8ec-d3c103b061e3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:32.852037 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-79a9baab-0fbd-475e-85e3-7dd10b2681db tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Action: 'create', calling method: .version_select at 0x7fbb4682e4c0>, body: {"keypair": {"name": "tempest-keypair-2026544530", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnOibJsPlvDjOuofrxfCSOaQb3AUk/xVs6iqQBGq5HprY6kH/uhjP/ZBPJogcRgWcKCFN6g3ms6ERJSAtJaz5S3qRK3BCx2ZDqztRmqkLGvy6MhVRCfHj/mKCTn9vFnpw=="}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:52:32.877511 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-79a9baab-0fbd-475e-85e3-7dd10b2681db tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Getting quotas for project 86aafc129b8640d381f9bae1767fbc6c. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:52:32.883202 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-79a9baab-0fbd-475e-85e3-7dd10b2681db tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Getting quotas for user 072bc5784d754815a511f6c3f4437f7c and project 86aafc129b8640d381f9bae1767fbc6c. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:52:32.923656 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-79a9baab-0fbd-475e-85e3-7dd10b2681db tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.083067 Aug 31 15:52:32.933009 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 501/981] 10.222.0.50 () {62 vars in 1200 bytes} [Wed Aug 31 15:52:32 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 97 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 31 15:52:32.967357 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9b24f259-7622-498a-a4b5-fc4b52000d60 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:32.972704 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9b24f259-7622-498a-a4b5-fc4b52000d60 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] [instance: a90bb0c5-7d56-4e38-8d78-a5c92a9976c3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:32.989803 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9b24f259-7622-498a-a4b5-fc4b52000d60 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:32.994686 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9b24f259-7622-498a-a4b5-fc4b52000d60 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:32.995493 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9b24f259-7622-498a-a4b5-fc4b52000d60 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:32.997227 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9b24f259-7622-498a-a4b5-fc4b52000d60 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:33.000439 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9b24f259-7622-498a-a4b5-fc4b52000d60 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:33.001099 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9b24f259-7622-498a-a4b5-fc4b52000d60 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:33.636682 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9b24f259-7622-498a-a4b5-fc4b52000d60 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e40446741c470f92d6f60ec910d84e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c897eb2e5b4101858807f875a8ac0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:33.656283 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9b24f259-7622-498a-a4b5-fc4b52000d60 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] 10.222.0.50 "GET /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3" status: 200 len: 1369 microversion: 2.1 time: 0.703284 Aug 31 15:52:33.657020 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 502/982] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:32 2022] GET /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3 => generated 1369 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:33.662731 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3c9e2fc1-7282-420b-ac28-2e2dcba961d6 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:33.663589 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3c9e2fc1-7282-420b-ac28-2e2dcba961d6 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 9cb430ca-c340-479a-b269-4672431bd393] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:33.677364 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3c9e2fc1-7282-420b-ac28-2e2dcba961d6 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:33.678517 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3c9e2fc1-7282-420b-ac28-2e2dcba961d6 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:33.679719 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3c9e2fc1-7282-420b-ac28-2e2dcba961d6 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:33.680664 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3c9e2fc1-7282-420b-ac28-2e2dcba961d6 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:33.681370 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3c9e2fc1-7282-420b-ac28-2e2dcba961d6 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:33.682013 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3c9e2fc1-7282-420b-ac28-2e2dcba961d6 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:33.683158 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1a1403a9-583f-416d-a8ec-d3c103b061e3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:33.697023 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1a1403a9-583f-416d-a8ec-d3c103b061e3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63" status: 200 len: 1476 microversion: 2.1 time: 0.877647 Aug 31 15:52:33.697948 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 481/983] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:32 2022] GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63 => generated 1476 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:33.713876 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-3c9e2fc1-7282-420b-ac28-2e2dcba961d6 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] HTTP exception thrown: Instance 9cb430ca-c340-479a-b269-4672431bd393 could not be found. Aug 31 15:52:33.716089 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3c9e2fc1-7282-420b-ac28-2e2dcba961d6 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Request method failure captured: Aug 31 15:52:33.716089 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/9cb430ca-c340-479a-b269-4672431bd393 HTTP/1.1 Aug 31 15:52:33.716089 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:52:33.716089 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:52:33.716089 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:52:33.716089 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:52:33.716089 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:52:33.716089 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:52:33.716089 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:52:33.716089 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:52:33.716089 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4L5y07547XEfI_cY_8ZFyTZ2GODruSaAiNwL5T7pV746ldskVNIIQw6lIoEqrgxXvEXbIblt4yfV5d-cxgOpBf2oAyg-UpeVanVK5I-BR_CVasS0-Y9DUowTZd9jVO3T3hdjRzydMsILc76TUmWEyP017xiZ12asWHDSwtKrB6FkRQ Aug 31 15:52:33.716089 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:52:33.716089 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:52:33.716089 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:52:33.716089 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:52:33.716089 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:52:33.716089 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:52:33.716089 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 7db749eb0a764fa0bb29ddc4abd6d245 Aug 31 15:52:33.716089 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServersOnMultiNodesTest-1874033872 Aug 31 15:52:33.716089 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:52:33.716089 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:52:33.717498 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7db749eb0a764fa0bb29ddc4abd6d245"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7db749eb0a764fa0bb29ddc4abd6d245"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7db749eb0a764fa0bb29ddc4abd6d245"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7db749eb0a764fa0bb29ddc4abd6d245", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:52:33.717498 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServersOnMultiNodesTest-1874033872 Aug 31 15:52:33.717498 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 7db749eb0a764fa0bb29ddc4abd6d245 Aug 31 15:52:33.717498 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1874033872 Aug 31 15:52:33.717498 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServersOnMultiNodesTest-1874033872-project Aug 31 15:52:33.717498 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:52:33.717498 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:52:33.717498 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: fe647be03cef4e9c86b4fd6e703d0de1 Aug 31 15:52:33.717498 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServersOnMultiNodesTest-1874033872-project Aug 31 15:52:33.717498 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:52:33.717498 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 9cb430ca-c340-479a-b269-4672431bd393 could not be found. Aug 31 15:52:33.717498 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '9cb430ca-c340-479a-b269-4672431bd393'} Aug 31 15:52:33.718695 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:52:33.718695 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:33.718695 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:52:33.718695 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:52:33.718695 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:52:33.718695 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:52:33.718695 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:52:33.718695 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:52:33.718695 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:52:33.718695 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:52:33.718695 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cb430ca-c340-479a-b269-4672431bd393 could not be found. Aug 31 15:52:33.718695 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:33.718695 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:52:33.718695 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:33.718695 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:33.718695 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:52:33.718695 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:52:33.718695 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:52:33.718695 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:52:33.718695 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:52:33.719876 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:52:33.719876 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:52:33.719876 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:52:33.719876 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:52:33.719876 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:52:33.719876 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:52:33.719876 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:52:33.719876 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cb430ca-c340-479a-b269-4672431bd393 could not be found. Aug 31 15:52:33.719876 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:33.719876 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:52:33.719876 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:33.719876 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:33.719876 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:52:33.719876 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:52:33.719876 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:52:33.719876 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:52:33.719876 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cb430ca-c340-479a-b269-4672431bd393 could not be found. Aug 31 15:52:33.719876 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:33.723427 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3c9e2fc1-7282-420b-ac28-2e2dcba961d6 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Returning 404 to user: Instance 9cb430ca-c340-479a-b269-4672431bd393 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:52:33.725014 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3c9e2fc1-7282-420b-ac28-2e2dcba961d6 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/9cb430ca-c340-479a-b269-4672431bd393" status: 404 len: 111 microversion: 2.1 time: 0.066358 Aug 31 15:52:33.726521 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 503/984] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:33 2022] GET /compute/v2.1/servers/9cb430ca-c340-479a-b269-4672431bd393 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:52:33.734714 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b5035b87-9558-4924-9410-d0e57ed0e4a2 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:33.735499 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b5035b87-9558-4924-9410-d0e57ed0e4a2 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: f0bc4527-6410-4415-b9db-7a76b91dfee3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:33.742042 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5035b87-9558-4924-9410-d0e57ed0e4a2 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:33.742566 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5035b87-9558-4924-9410-d0e57ed0e4a2 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:33.743404 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5035b87-9558-4924-9410-d0e57ed0e4a2 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:33.744289 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5035b87-9558-4924-9410-d0e57ed0e4a2 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:33.745133 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5035b87-9558-4924-9410-d0e57ed0e4a2 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:33.745730 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5035b87-9558-4924-9410-d0e57ed0e4a2 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:33.792962 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b5035b87-9558-4924-9410-d0e57ed0e4a2 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: f0bc4527-6410-4415-b9db-7a76b91dfee3] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:52:33.947571 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b5035b87-9558-4924-9410-d0e57ed0e4a2 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "DELETE /compute/v2.1/servers/f0bc4527-6410-4415-b9db-7a76b91dfee3" status: 204 len: 0 microversion: 2.1 time: 0.214014 Aug 31 15:52:33.949116 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 482/985] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:52:33 2022] DELETE /compute/v2.1/servers/f0bc4527-6410-4415-b9db-7a76b91dfee3 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:52:33.958556 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c2498807-52b5-4fe2-bb7a-7323e2dcb849 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:33.959338 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c2498807-52b5-4fe2-bb7a-7323e2dcb849 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: f0bc4527-6410-4415-b9db-7a76b91dfee3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:33.969816 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c2498807-52b5-4fe2-bb7a-7323e2dcb849 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:33.971375 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c2498807-52b5-4fe2-bb7a-7323e2dcb849 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:33.971901 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c2498807-52b5-4fe2-bb7a-7323e2dcb849 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:33.972709 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c2498807-52b5-4fe2-bb7a-7323e2dcb849 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:33.973371 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c2498807-52b5-4fe2-bb7a-7323e2dcb849 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:33.974108 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c2498807-52b5-4fe2-bb7a-7323e2dcb849 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:34.352538 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c2498807-52b5-4fe2-bb7a-7323e2dcb849 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:34.362544 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c2498807-52b5-4fe2-bb7a-7323e2dcb849 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/f0bc4527-6410-4415-b9db-7a76b91dfee3" status: 200 len: 1472 microversion: 2.1 time: 0.408134 Aug 31 15:52:34.367715 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 504/986] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:33 2022] GET /compute/v2.1/servers/f0bc4527-6410-4415-b9db-7a76b91dfee3 => generated 1472 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:34.691420 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-57090952-3f83-413f-8485-cb475df64648 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:34.693041 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-57090952-3f83-413f-8485-cb475df64648 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] [instance: a90bb0c5-7d56-4e38-8d78-a5c92a9976c3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:34.695930 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-06f474df-e72b-49e4-8d10-42c44b795d5c req-6df8b915-cb42-4e71-9180-052eee105a40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a90bb0c5-7d56-4e38-8d78-a5c92a9976c3", "tag": "88614c31-a522-4542-ad79-12f8e6e4844c"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:52:34.701001 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57090952-3f83-413f-8485-cb475df64648 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:34.701497 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57090952-3f83-413f-8485-cb475df64648 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:34.701994 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57090952-3f83-413f-8485-cb475df64648 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:34.703285 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57090952-3f83-413f-8485-cb475df64648 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:34.703949 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57090952-3f83-413f-8485-cb475df64648 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:34.705582 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57090952-3f83-413f-8485-cb475df64648 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:34.709736 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-06f474df-e72b-49e4-8d10-42c44b795d5c req-6df8b915-cb42-4e71-9180-052eee105a40 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:34.711271 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-06f474df-e72b-49e4-8d10-42c44b795d5c req-6df8b915-cb42-4e71-9180-052eee105a40 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:34.712503 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-06f474df-e72b-49e4-8d10-42c44b795d5c req-6df8b915-cb42-4e71-9180-052eee105a40 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:34.727127 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-06f474df-e72b-49e4-8d10-42c44b795d5c req-6df8b915-cb42-4e71-9180-052eee105a40 service nova] Creating event network-changed:88614c31-a522-4542-ad79-12f8e6e4844c for instance a90bb0c5-7d56-4e38-8d78-a5c92a9976c3 on n-h1-833090-16 Aug 31 15:52:34.733910 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-06f474df-e72b-49e4-8d10-42c44b795d5c req-6df8b915-cb42-4e71-9180-052eee105a40 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042504 Aug 31 15:52:34.739745 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 505/987] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:52:34.748068 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1fa4e4bd-cecd-44ba-b571-10b02fcbc8bc tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:34.749417 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1fa4e4bd-cecd-44ba-b571-10b02fcbc8bc tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 236954ea-2791-477d-a92b-88e590593c63] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:34.764904 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1fa4e4bd-cecd-44ba-b571-10b02fcbc8bc tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:34.766341 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1fa4e4bd-cecd-44ba-b571-10b02fcbc8bc tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:34.767070 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1fa4e4bd-cecd-44ba-b571-10b02fcbc8bc tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:34.768757 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1fa4e4bd-cecd-44ba-b571-10b02fcbc8bc tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:34.770920 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1fa4e4bd-cecd-44ba-b571-10b02fcbc8bc tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:34.774502 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1fa4e4bd-cecd-44ba-b571-10b02fcbc8bc tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:35.009176 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-57090952-3f83-413f-8485-cb475df64648 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e40446741c470f92d6f60ec910d84e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c897eb2e5b4101858807f875a8ac0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:35.017204 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-57090952-3f83-413f-8485-cb475df64648 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] 10.222.0.50 "GET /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3" status: 200 len: 1369 microversion: 2.1 time: 0.336821 Aug 31 15:52:35.035681 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 483/988] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:34 2022] GET /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3 => generated 1369 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:35.040432 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1fa4e4bd-cecd-44ba-b571-10b02fcbc8bc tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:35.050775 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1fa4e4bd-cecd-44ba-b571-10b02fcbc8bc tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63" status: 200 len: 1476 microversion: 2.1 time: 0.308830 Aug 31 15:52:35.054861 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 506/989] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:34 2022] GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63 => generated 1476 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:35.387529 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e00490c6-5d39-4bba-b311-49bdacbe1edc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:35.388390 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e00490c6-5d39-4bba-b311-49bdacbe1edc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: f0bc4527-6410-4415-b9db-7a76b91dfee3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:35.398291 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e00490c6-5d39-4bba-b311-49bdacbe1edc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:35.398827 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e00490c6-5d39-4bba-b311-49bdacbe1edc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:35.399265 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e00490c6-5d39-4bba-b311-49bdacbe1edc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:35.400006 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e00490c6-5d39-4bba-b311-49bdacbe1edc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:35.412411 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e00490c6-5d39-4bba-b311-49bdacbe1edc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:35.414838 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e00490c6-5d39-4bba-b311-49bdacbe1edc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:35.899889 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e00490c6-5d39-4bba-b311-49bdacbe1edc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:35.913607 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e00490c6-5d39-4bba-b311-49bdacbe1edc tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/f0bc4527-6410-4415-b9db-7a76b91dfee3" status: 200 len: 1472 microversion: 2.1 time: 0.529879 Aug 31 15:52:35.926605 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 484/990] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:35 2022] GET /compute/v2.1/servers/f0bc4527-6410-4415-b9db-7a76b91dfee3 => generated 1472 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:36.044208 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9fc6a1e4-7a71-4a6e-b4da-da5422e51d4f tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:36.045540 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9fc6a1e4-7a71-4a6e-b4da-da5422e51d4f tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] [instance: a90bb0c5-7d56-4e38-8d78-a5c92a9976c3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:36.052886 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9fc6a1e4-7a71-4a6e-b4da-da5422e51d4f tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:36.054276 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9fc6a1e4-7a71-4a6e-b4da-da5422e51d4f tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:36.054778 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9fc6a1e4-7a71-4a6e-b4da-da5422e51d4f tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:36.055949 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9fc6a1e4-7a71-4a6e-b4da-da5422e51d4f tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:36.056624 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9fc6a1e4-7a71-4a6e-b4da-da5422e51d4f tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:36.057472 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9fc6a1e4-7a71-4a6e-b4da-da5422e51d4f tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:36.075389 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-31ebf7de-235b-42e9-b188-de23500bb1bf tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:36.076426 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-31ebf7de-235b-42e9-b188-de23500bb1bf tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 236954ea-2791-477d-a92b-88e590593c63] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:36.084524 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31ebf7de-235b-42e9-b188-de23500bb1bf tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:36.085335 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31ebf7de-235b-42e9-b188-de23500bb1bf tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:36.085983 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31ebf7de-235b-42e9-b188-de23500bb1bf tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:36.086931 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31ebf7de-235b-42e9-b188-de23500bb1bf tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:36.087610 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31ebf7de-235b-42e9-b188-de23500bb1bf tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:36.088235 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31ebf7de-235b-42e9-b188-de23500bb1bf tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:36.341788 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9fc6a1e4-7a71-4a6e-b4da-da5422e51d4f tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e40446741c470f92d6f60ec910d84e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c897eb2e5b4101858807f875a8ac0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:36.350787 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9fc6a1e4-7a71-4a6e-b4da-da5422e51d4f tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] 10.222.0.50 "GET /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3" status: 200 len: 1369 microversion: 2.1 time: 0.310571 Aug 31 15:52:36.351890 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 507/991] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:36 2022] GET /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3 => generated 1369 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:52:36.377909 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-31ebf7de-235b-42e9-b188-de23500bb1bf tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:36.387623 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-31ebf7de-235b-42e9-b188-de23500bb1bf tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63" status: 200 len: 1476 microversion: 2.1 time: 0.316304 Aug 31 15:52:36.388522 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 485/992] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:36 2022] GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63 => generated 1476 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:36.760094 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-3eed198e-0864-4fba-a57b-83c801d77f05 req-fc5a0617-d6a8-4270-8623-b74a0fd2418b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0bc4527-6410-4415-b9db-7a76b91dfee3", "name": "network-vif-deleted", "tag": "6d4ecb80-bbfe-4c36-ae0e-0e7f651c074f"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:52:36.776191 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-3eed198e-0864-4fba-a57b-83c801d77f05 req-fc5a0617-d6a8-4270-8623-b74a0fd2418b service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:36.782395 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-3eed198e-0864-4fba-a57b-83c801d77f05 req-fc5a0617-d6a8-4270-8623-b74a0fd2418b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:36.782660 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-3eed198e-0864-4fba-a57b-83c801d77f05 req-fc5a0617-d6a8-4270-8623-b74a0fd2418b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:36.803120 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-3eed198e-0864-4fba-a57b-83c801d77f05 req-fc5a0617-d6a8-4270-8623-b74a0fd2418b service nova] Creating event network-vif-deleted:6d4ecb80-bbfe-4c36-ae0e-0e7f651c074f for instance f0bc4527-6410-4415-b9db-7a76b91dfee3 on n-h1-833090-16 Aug 31 15:52:36.819369 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-3eed198e-0864-4fba-a57b-83c801d77f05 req-fc5a0617-d6a8-4270-8623-b74a0fd2418b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067735 Aug 31 15:52:36.823345 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 508/993] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:52:36.940231 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-49b15a93-9b30-4bf0-893e-aa38f5a9666e tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:36.942022 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-49b15a93-9b30-4bf0-893e-aa38f5a9666e tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: f0bc4527-6410-4415-b9db-7a76b91dfee3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:36.973105 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49b15a93-9b30-4bf0-893e-aa38f5a9666e tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:36.999101 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49b15a93-9b30-4bf0-893e-aa38f5a9666e tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:37.000865 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49b15a93-9b30-4bf0-893e-aa38f5a9666e tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:37.004679 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49b15a93-9b30-4bf0-893e-aa38f5a9666e tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:37.006350 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49b15a93-9b30-4bf0-893e-aa38f5a9666e tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:37.009813 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49b15a93-9b30-4bf0-893e-aa38f5a9666e tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:37.135090 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-49b15a93-9b30-4bf0-893e-aa38f5a9666e tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:37.164346 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-49b15a93-9b30-4bf0-893e-aa38f5a9666e tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/f0bc4527-6410-4415-b9db-7a76b91dfee3" status: 200 len: 1430 microversion: 2.1 time: 0.231513 Aug 31 15:52:37.165458 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 486/994] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:36 2022] GET /compute/v2.1/servers/f0bc4527-6410-4415-b9db-7a76b91dfee3 => generated 1430 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:37.375627 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-72d97d8e-6fe5-4fd2-be87-8b5ff8a2c64b tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:37.377104 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-72d97d8e-6fe5-4fd2-be87-8b5ff8a2c64b tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] [instance: a90bb0c5-7d56-4e38-8d78-a5c92a9976c3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:37.386880 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-72d97d8e-6fe5-4fd2-be87-8b5ff8a2c64b tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:37.387608 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-72d97d8e-6fe5-4fd2-be87-8b5ff8a2c64b tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:37.388463 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-72d97d8e-6fe5-4fd2-be87-8b5ff8a2c64b tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:37.389401 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-72d97d8e-6fe5-4fd2-be87-8b5ff8a2c64b tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:37.390068 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-72d97d8e-6fe5-4fd2-be87-8b5ff8a2c64b tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:37.390786 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-72d97d8e-6fe5-4fd2-be87-8b5ff8a2c64b tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:37.412589 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6c10586f-7adb-44c9-8660-407e58da2e85 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:37.413569 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6c10586f-7adb-44c9-8660-407e58da2e85 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 236954ea-2791-477d-a92b-88e590593c63] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:37.436275 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c10586f-7adb-44c9-8660-407e58da2e85 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:37.438664 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c10586f-7adb-44c9-8660-407e58da2e85 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:37.440929 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c10586f-7adb-44c9-8660-407e58da2e85 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:37.442042 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c10586f-7adb-44c9-8660-407e58da2e85 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:37.443729 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c10586f-7adb-44c9-8660-407e58da2e85 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:37.444835 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c10586f-7adb-44c9-8660-407e58da2e85 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:38.081565 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6c10586f-7adb-44c9-8660-407e58da2e85 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:38.090271 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6c10586f-7adb-44c9-8660-407e58da2e85 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63" status: 200 len: 1476 microversion: 2.1 time: 0.685220 Aug 31 15:52:38.091134 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 487/995] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:37 2022] GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63 => generated 1476 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:38.096150 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f7477ee1-4b44-46c9-abc5-28b7ad112d4a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-419942274", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "efd466b3-b86f-4dea-a01f-277dbef774dc"}], "security_groups": [{"name": "tempest-securitygroup--1226830705"}], "key_name": "tempest-keypair-2026544530", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:52:38.228049 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-72d97d8e-6fe5-4fd2-be87-8b5ff8a2c64b tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e40446741c470f92d6f60ec910d84e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c897eb2e5b4101858807f875a8ac0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:38.245910 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-72d97d8e-6fe5-4fd2-be87-8b5ff8a2c64b tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] 10.222.0.50 "GET /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3" status: 200 len: 1369 microversion: 2.1 time: 0.876337 Aug 31 15:52:38.246712 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 509/996] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:37 2022] GET /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3 => generated 1369 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:38.264564 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7ddb3015-0c64-4ea7-ba49-ea3f8b17b0ab tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:38.265557 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7ddb3015-0c64-4ea7-ba49-ea3f8b17b0ab tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: f0bc4527-6410-4415-b9db-7a76b91dfee3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:38.271786 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ddb3015-0c64-4ea7-ba49-ea3f8b17b0ab tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:38.272271 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ddb3015-0c64-4ea7-ba49-ea3f8b17b0ab tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:38.272699 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ddb3015-0c64-4ea7-ba49-ea3f8b17b0ab tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:38.273403 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ddb3015-0c64-4ea7-ba49-ea3f8b17b0ab tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:38.273837 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ddb3015-0c64-4ea7-ba49-ea3f8b17b0ab tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:38.274360 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ddb3015-0c64-4ea7-ba49-ea3f8b17b0ab tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:38.310323 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ddb3015-0c64-4ea7-ba49-ea3f8b17b0ab tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:38.310799 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ddb3015-0c64-4ea7-ba49-ea3f8b17b0ab tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:38.311473 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ddb3015-0c64-4ea7-ba49-ea3f8b17b0ab tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:38.312101 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-7ddb3015-0c64-4ea7-ba49-ea3f8b17b0ab tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lazy-loading 'fault' on Instance uuid f0bc4527-6410-4415-b9db-7a76b91dfee3 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:52:38.315574 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=100 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:52:38.339259 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-f7477ee1-4b44-46c9-abc5-28b7ad112d4a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] validate_networks() for [('efd466b3-b86f-4dea-a01f-277dbef774dc', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:52:38.668023 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7ddb3015-0c64-4ea7-ba49-ea3f8b17b0ab tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:38.680001 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7ddb3015-0c64-4ea7-ba49-ea3f8b17b0ab tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/f0bc4527-6410-4415-b9db-7a76b91dfee3" status: 200 len: 1307 microversion: 2.1 time: 0.420626 Aug 31 15:52:38.681183 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 510/997] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:38 2022] GET /compute/v2.1/servers/f0bc4527-6410-4415-b9db-7a76b91dfee3 => generated 1307 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:39.113202 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6fcd78af-e1a7-4c95-a0f7-78c6c7ae633c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:39.114234 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6fcd78af-e1a7-4c95-a0f7-78c6c7ae633c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 236954ea-2791-477d-a92b-88e590593c63] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:39.127797 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6fcd78af-e1a7-4c95-a0f7-78c6c7ae633c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:39.128321 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6fcd78af-e1a7-4c95-a0f7-78c6c7ae633c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:39.128958 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6fcd78af-e1a7-4c95-a0f7-78c6c7ae633c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:39.130074 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6fcd78af-e1a7-4c95-a0f7-78c6c7ae633c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:39.131049 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6fcd78af-e1a7-4c95-a0f7-78c6c7ae633c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:39.132350 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6fcd78af-e1a7-4c95-a0f7-78c6c7ae633c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:39.884264 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6fcd78af-e1a7-4c95-a0f7-78c6c7ae633c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:39.894394 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6fcd78af-e1a7-4c95-a0f7-78c6c7ae633c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63" status: 200 len: 1476 microversion: 2.1 time: 0.785714 Aug 31 15:52:39.900022 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 511/998] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:39 2022] GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63 => generated 1476 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:52:39.921430 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5999098b-79f9-47bb-a305-e4dcb5a7a0e1 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:39.923731 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5999098b-79f9-47bb-a305-e4dcb5a7a0e1 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] [instance: a90bb0c5-7d56-4e38-8d78-a5c92a9976c3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:39.946340 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5999098b-79f9-47bb-a305-e4dcb5a7a0e1 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:39.949019 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5999098b-79f9-47bb-a305-e4dcb5a7a0e1 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:39.949993 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5999098b-79f9-47bb-a305-e4dcb5a7a0e1 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:39.954684 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5999098b-79f9-47bb-a305-e4dcb5a7a0e1 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:39.955476 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5999098b-79f9-47bb-a305-e4dcb5a7a0e1 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:39.956252 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5999098b-79f9-47bb-a305-e4dcb5a7a0e1 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:40.377832 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-f7477ee1-4b44-46c9-abc5-28b7ad112d4a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:52:40.379501 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-f7477ee1-4b44-46c9-abc5-28b7ad112d4a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:52:40.380465 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-f7477ee1-4b44-46c9-abc5-28b7ad112d4a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:52:40.381176 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-f7477ee1-4b44-46c9-abc5-28b7ad112d4a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:52:40.381857 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-f7477ee1-4b44-46c9-abc5-28b7ad112d4a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:52:40.407063 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7477ee1-4b44-46c9-abc5-28b7ad112d4a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:40.410613 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7477ee1-4b44-46c9-abc5-28b7ad112d4a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:40.411469 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7477ee1-4b44-46c9-abc5-28b7ad112d4a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:40.412229 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7477ee1-4b44-46c9-abc5-28b7ad112d4a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:40.412683 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7477ee1-4b44-46c9-abc5-28b7ad112d4a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:40.413108 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7477ee1-4b44-46c9-abc5-28b7ad112d4a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:40.443166 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-f7477ee1-4b44-46c9-abc5-28b7ad112d4a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Getting quotas for project 86aafc129b8640d381f9bae1767fbc6c. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:52:40.449813 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-f7477ee1-4b44-46c9-abc5-28b7ad112d4a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Getting quotas for user 072bc5784d754815a511f6c3f4437f7c and project 86aafc129b8640d381f9bae1767fbc6c. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:52:40.467470 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f7477ee1-4b44-46c9-abc5-28b7ad112d4a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:52:40.470148 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f7477ee1-4b44-46c9-abc5-28b7ad112d4a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:52:40.544182 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f7477ee1-4b44-46c9-abc5-28b7ad112d4a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 2.451428 Aug 31 15:52:40.551790 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 488/999] 10.222.0.50 () {62 vars in 1188 bytes} [Wed Aug 31 15:52:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 2460 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 31 15:52:40.557633 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bc3fc3ac-21f3-4e2b-9f88-f9679bfac6d7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:40.558594 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bc3fc3ac-21f3-4e2b-9f88-f9679bfac6d7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: f0bc4527-6410-4415-b9db-7a76b91dfee3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:40.566085 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc3fc3ac-21f3-4e2b-9f88-f9679bfac6d7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:40.566915 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc3fc3ac-21f3-4e2b-9f88-f9679bfac6d7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:40.567662 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc3fc3ac-21f3-4e2b-9f88-f9679bfac6d7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:40.568811 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc3fc3ac-21f3-4e2b-9f88-f9679bfac6d7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:40.570463 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc3fc3ac-21f3-4e2b-9f88-f9679bfac6d7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:40.571383 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc3fc3ac-21f3-4e2b-9f88-f9679bfac6d7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:40.592348 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-bc3fc3ac-21f3-4e2b-9f88-f9679bfac6d7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] HTTP exception thrown: Instance f0bc4527-6410-4415-b9db-7a76b91dfee3 could not be found. Aug 31 15:52:40.594479 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bc3fc3ac-21f3-4e2b-9f88-f9679bfac6d7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Request method failure captured: Aug 31 15:52:40.594479 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/f0bc4527-6410-4415-b9db-7a76b91dfee3 HTTP/1.1 Aug 31 15:52:40.594479 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:52:40.594479 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:52:40.594479 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:52:40.594479 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:52:40.594479 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:52:40.594479 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:52:40.594479 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:52:40.594479 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:52:40.594479 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4L5y07547XEfI_cY_8ZFyTZ2GODruSaAiNwL5T7pV746ldskVNIIQw6lIoEqrgxXvEXbIblt4yfV5d-cxgOpBf2oAyg-UpeVanVK5I-BR_CVasS0-Y9DUowTZd9jVO3T3hdjRzydMsILc76TUmWEyP017xiZ12asWHDSwtKrB6FkRQ Aug 31 15:52:40.594479 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:52:40.594479 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:52:40.594479 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:52:40.594479 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:52:40.594479 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:52:40.594479 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:52:40.594479 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 7db749eb0a764fa0bb29ddc4abd6d245 Aug 31 15:52:40.594479 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersOnMultiNodesTest-1874033872 Aug 31 15:52:40.594479 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:52:40.594479 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:52:40.595788 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7db749eb0a764fa0bb29ddc4abd6d245"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7db749eb0a764fa0bb29ddc4abd6d245"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7db749eb0a764fa0bb29ddc4abd6d245"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7db749eb0a764fa0bb29ddc4abd6d245", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:52:40.595788 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServersOnMultiNodesTest-1874033872 Aug 31 15:52:40.595788 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 7db749eb0a764fa0bb29ddc4abd6d245 Aug 31 15:52:40.595788 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1874033872 Aug 31 15:52:40.595788 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServersOnMultiNodesTest-1874033872-project Aug 31 15:52:40.595788 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:52:40.595788 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:52:40.595788 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: fe647be03cef4e9c86b4fd6e703d0de1 Aug 31 15:52:40.595788 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServersOnMultiNodesTest-1874033872-project Aug 31 15:52:40.595788 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 15:52:40.595788 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance f0bc4527-6410-4415-b9db-7a76b91dfee3 could not be found. Aug 31 15:52:40.595788 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'f0bc4527-6410-4415-b9db-7a76b91dfee3'} Aug 31 15:52:40.596565 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:52:40.596565 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:40.596565 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:52:40.596565 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:52:40.596565 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:52:40.596565 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:52:40.596565 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:52:40.596565 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:52:40.596565 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:52:40.596565 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:52:40.596565 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0bc4527-6410-4415-b9db-7a76b91dfee3 could not be found. Aug 31 15:52:40.596565 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:52:40.596565 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:52:40.596565 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:52:40.596565 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:40.596565 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:52:40.596565 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:52:40.596565 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:52:40.596565 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:52:40.596565 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:52:40.597735 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:52:40.597735 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:52:40.597735 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:52:40.597735 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:52:40.597735 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:52:40.597735 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:52:40.597735 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:52:40.597735 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0bc4527-6410-4415-b9db-7a76b91dfee3 could not be found. Aug 31 15:52:40.597735 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:52:40.597735 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:52:40.597735 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:52:40.597735 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:40.597735 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:52:40.597735 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:52:40.597735 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:52:40.597735 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:52:40.597735 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0bc4527-6410-4415-b9db-7a76b91dfee3 could not be found. Aug 31 15:52:40.597735 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:52:40.602787 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bc3fc3ac-21f3-4e2b-9f88-f9679bfac6d7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Returning 404 to user: Instance f0bc4527-6410-4415-b9db-7a76b91dfee3 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:52:40.603926 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bc3fc3ac-21f3-4e2b-9f88-f9679bfac6d7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/f0bc4527-6410-4415-b9db-7a76b91dfee3" status: 404 len: 111 microversion: 2.1 time: 0.050660 Aug 31 15:52:40.604797 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 489/1000] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:40 2022] GET /compute/v2.1/servers/f0bc4527-6410-4415-b9db-7a76b91dfee3 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:52:40.616111 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-05ad3460-2c89-4cb3-ac66-3264ee8d47ec tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:40.617251 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-05ad3460-2c89-4cb3-ac66-3264ee8d47ec tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: 2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:40.642454 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05ad3460-2c89-4cb3-ac66-3264ee8d47ec tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:40.643282 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05ad3460-2c89-4cb3-ac66-3264ee8d47ec tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:40.643942 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05ad3460-2c89-4cb3-ac66-3264ee8d47ec tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:40.646551 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05ad3460-2c89-4cb3-ac66-3264ee8d47ec tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:40.649068 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05ad3460-2c89-4cb3-ac66-3264ee8d47ec tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:40.651601 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05ad3460-2c89-4cb3-ac66-3264ee8d47ec tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:40.726221 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-05ad3460-2c89-4cb3-ac66-3264ee8d47ec tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: 2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:52:40.879508 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-05ad3460-2c89-4cb3-ac66-3264ee8d47ec tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "DELETE /compute/v2.1/servers/2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881" status: 204 len: 0 microversion: 2.1 time: 0.266898 Aug 31 15:52:40.881933 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 490/1001] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:52:40 2022] DELETE /compute/v2.1/servers/2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:52:40.903161 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-088df13c-031a-40b0-9ccc-12d070624314 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:40.907095 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-088df13c-031a-40b0-9ccc-12d070624314 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:40.929851 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5999098b-79f9-47bb-a305-e4dcb5a7a0e1 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e40446741c470f92d6f60ec910d84e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c897eb2e5b4101858807f875a8ac0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:40.938403 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5999098b-79f9-47bb-a305-e4dcb5a7a0e1 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] 10.222.0.50 "GET /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3" status: 200 len: 1369 microversion: 2.1 time: 1.034505 Aug 31 15:52:40.942263 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 512/1002] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:39 2022] GET /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3 => generated 1369 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:40.966156 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6f050175-bde0-4a38-9fbd-f3288757bfe2 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:40.968680 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6f050175-bde0-4a38-9fbd-f3288757bfe2 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 19da7b68-c450-41e9-9a0b-135b8105b4d5] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:40.997396 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f050175-bde0-4a38-9fbd-f3288757bfe2 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:40.998046 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f050175-bde0-4a38-9fbd-f3288757bfe2 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:40.998526 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f050175-bde0-4a38-9fbd-f3288757bfe2 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:41.003952 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f050175-bde0-4a38-9fbd-f3288757bfe2 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:41.005065 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f050175-bde0-4a38-9fbd-f3288757bfe2 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:41.007269 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f050175-bde0-4a38-9fbd-f3288757bfe2 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:41.093159 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6f050175-bde0-4a38-9fbd-f3288757bfe2 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 19da7b68-c450-41e9-9a0b-135b8105b4d5] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:52:41.211796 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-088df13c-031a-40b0-9ccc-12d070624314 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:41.226572 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-088df13c-031a-40b0-9ccc-12d070624314 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:41.229723 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-088df13c-031a-40b0-9ccc-12d070624314 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:41.232596 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-088df13c-031a-40b0-9ccc-12d070624314 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a" status: 200 len: 1285 microversion: 2.25 time: 0.348929 Aug 31 15:52:41.233616 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6f050175-bde0-4a38-9fbd-f3288757bfe2 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "DELETE /compute/v2.1/servers/19da7b68-c450-41e9-9a0b-135b8105b4d5" status: 204 len: 0 microversion: 2.1 time: 0.288425 Aug 31 15:52:41.234768 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 513/1003] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:52:40 2022] DELETE /compute/v2.1/servers/19da7b68-c450-41e9-9a0b-135b8105b4d5 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:52:41.239901 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 491/1004] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:52:40 2022] GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a => generated 1285 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:52:41.243600 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-dcb40cb3-9186-4767-af85-e664853e6cd9 req-0da7176d-2c31-47c4-a1d3-c3da565aaa0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a90bb0c5-7d56-4e38-8d78-a5c92a9976c3", "name": "network-vif-plugged", "status": "completed", "tag": "88614c31-a522-4542-ad79-12f8e6e4844c"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:52:41.245468 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-55a35f0a-2a60-4e2f-8b3f-1d66f0b5d113 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:41.246075 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-55a35f0a-2a60-4e2f-8b3f-1d66f0b5d113 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 236954ea-2791-477d-a92b-88e590593c63] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:41.266131 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55a35f0a-2a60-4e2f-8b3f-1d66f0b5d113 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:41.268144 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-dcb40cb3-9186-4767-af85-e664853e6cd9 req-0da7176d-2c31-47c4-a1d3-c3da565aaa0a service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:41.268624 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55a35f0a-2a60-4e2f-8b3f-1d66f0b5d113 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:41.269552 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55a35f0a-2a60-4e2f-8b3f-1d66f0b5d113 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:41.270665 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55a35f0a-2a60-4e2f-8b3f-1d66f0b5d113 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:41.271565 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55a35f0a-2a60-4e2f-8b3f-1d66f0b5d113 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:41.271978 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-dcb40cb3-9186-4767-af85-e664853e6cd9 req-0da7176d-2c31-47c4-a1d3-c3da565aaa0a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:41.272585 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-dcb40cb3-9186-4767-af85-e664853e6cd9 req-0da7176d-2c31-47c4-a1d3-c3da565aaa0a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:41.274299 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55a35f0a-2a60-4e2f-8b3f-1d66f0b5d113 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:41.308608 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-dcb40cb3-9186-4767-af85-e664853e6cd9 req-0da7176d-2c31-47c4-a1d3-c3da565aaa0a service nova] Creating event network-vif-plugged:88614c31-a522-4542-ad79-12f8e6e4844c for instance a90bb0c5-7d56-4e38-8d78-a5c92a9976c3 on n-h1-833090-16 Aug 31 15:52:41.318066 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-dcb40cb3-9186-4767-af85-e664853e6cd9 req-0da7176d-2c31-47c4-a1d3-c3da565aaa0a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081709 Aug 31 15:52:41.319499 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 514/1005] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:52:41.327631 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1f0ff38d-5113-4448-99d9-8d81604fc304 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1946755769", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "1065532236", "adminPass": "***", "networks": [{"uuid": "9e7e92fb-7d42-434e-8b6f-12584674780b"}], "security_groups": [{"name": "tempest-securitygroup--982524549"}], "key_name": "tempest-keypair-1476463508", "user_data": "}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:52:42.160229 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-1f0ff38d-5113-4448-99d9-8d81604fc304 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] validate_networks() for [('9e7e92fb-7d42-434e-8b6f-12584674780b', None, None, None, None, None)] {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:52:42.529903 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-55a35f0a-2a60-4e2f-8b3f-1d66f0b5d113 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:42.545744 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-55a35f0a-2a60-4e2f-8b3f-1d66f0b5d113 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63" status: 200 len: 1475 microversion: 2.1 time: 1.304550 Aug 31 15:52:42.550383 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 492/1006] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:41 2022] GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63 => generated 1475 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:42.563653 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a105e8d1-c2de-4504-8a6d-c7903c11770d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:42.568337 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a105e8d1-c2de-4504-8a6d-c7903c11770d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: d15c3817-84b0-4e82-86b2-f2333ceeb3cd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:42.595262 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a105e8d1-c2de-4504-8a6d-c7903c11770d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:42.597048 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a105e8d1-c2de-4504-8a6d-c7903c11770d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:42.597620 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a105e8d1-c2de-4504-8a6d-c7903c11770d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:42.599423 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a105e8d1-c2de-4504-8a6d-c7903c11770d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:42.600569 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a105e8d1-c2de-4504-8a6d-c7903c11770d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:42.601947 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a105e8d1-c2de-4504-8a6d-c7903c11770d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:42.632454 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:52:42.715342 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a105e8d1-c2de-4504-8a6d-c7903c11770d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: d15c3817-84b0-4e82-86b2-f2333ceeb3cd] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:52:42.884222 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a105e8d1-c2de-4504-8a6d-c7903c11770d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d15c3817-84b0-4e82-86b2-f2333ceeb3cd" status: 204 len: 0 microversion: 2.1 time: 0.328135 Aug 31 15:52:42.885130 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 493/1007] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:52:42 2022] DELETE /compute/v2.1/servers/d15c3817-84b0-4e82-86b2-f2333ceeb3cd => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:52:42.894260 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=4 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:52:42.904673 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f0ee14d0-a9ed-40cc-b6b6-a7b9bde7f463 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:42.906294 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f0ee14d0-a9ed-40cc-b6b6-a7b9bde7f463 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] [instance: a90bb0c5-7d56-4e38-8d78-a5c92a9976c3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:42.922699 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f0ee14d0-a9ed-40cc-b6b6-a7b9bde7f463 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:42.924778 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f0ee14d0-a9ed-40cc-b6b6-a7b9bde7f463 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:42.925220 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f0ee14d0-a9ed-40cc-b6b6-a7b9bde7f463 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:42.931820 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f0ee14d0-a9ed-40cc-b6b6-a7b9bde7f463 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:42.933299 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f0ee14d0-a9ed-40cc-b6b6-a7b9bde7f463 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:42.933974 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f0ee14d0-a9ed-40cc-b6b6-a7b9bde7f463 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:43.563286 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f0ee14d0-a9ed-40cc-b6b6-a7b9bde7f463 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e40446741c470f92d6f60ec910d84e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c897eb2e5b4101858807f875a8ac0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:43.576630 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f0ee14d0-a9ed-40cc-b6b6-a7b9bde7f463 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] 10.222.0.50 "GET /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3" status: 200 len: 1369 microversion: 2.1 time: 0.688323 Aug 31 15:52:43.578489 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 494/1008] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:42 2022] GET /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3 => generated 1369 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:43.586852 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ce201384-c14e-457b-abcb-c8cd18cfd83d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:43.587824 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ce201384-c14e-457b-abcb-c8cd18cfd83d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:43.600577 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce201384-c14e-457b-abcb-c8cd18cfd83d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:43.601551 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce201384-c14e-457b-abcb-c8cd18cfd83d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:43.602290 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce201384-c14e-457b-abcb-c8cd18cfd83d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:43.603670 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce201384-c14e-457b-abcb-c8cd18cfd83d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:43.611886 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce201384-c14e-457b-abcb-c8cd18cfd83d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:43.613774 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce201384-c14e-457b-abcb-c8cd18cfd83d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:43.791965 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ce201384-c14e-457b-abcb-c8cd18cfd83d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:43.821398 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ce201384-c14e-457b-abcb-c8cd18cfd83d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:43.834848 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ce201384-c14e-457b-abcb-c8cd18cfd83d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:43.842018 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ce201384-c14e-457b-abcb-c8cd18cfd83d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a" status: 200 len: 1337 microversion: 2.25 time: 0.261433 Aug 31 15:52:43.842884 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 495/1009] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:52:43 2022] GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a => generated 1337 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:52:43.865658 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-480efe8a-1d80-4fa4-aa47-92f82bc5ba8d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:43.867745 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-480efe8a-1d80-4fa4-aa47-92f82bc5ba8d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 19da7b68-c450-41e9-9a0b-135b8105b4d5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:43.882976 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-480efe8a-1d80-4fa4-aa47-92f82bc5ba8d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:43.889098 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-480efe8a-1d80-4fa4-aa47-92f82bc5ba8d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:43.890034 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-480efe8a-1d80-4fa4-aa47-92f82bc5ba8d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:43.890954 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-480efe8a-1d80-4fa4-aa47-92f82bc5ba8d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:43.891526 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-480efe8a-1d80-4fa4-aa47-92f82bc5ba8d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:43.892071 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-480efe8a-1d80-4fa4-aa47-92f82bc5ba8d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:43.926739 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-1f0ff38d-5113-4448-99d9-8d81604fc304 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:52:43.927962 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-1f0ff38d-5113-4448-99d9-8d81604fc304 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:52:43.928661 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-1f0ff38d-5113-4448-99d9-8d81604fc304 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:52:43.929307 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-1f0ff38d-5113-4448-99d9-8d81604fc304 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:52:43.929984 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-1f0ff38d-5113-4448-99d9-8d81604fc304 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:52:43.950759 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1f0ff38d-5113-4448-99d9-8d81604fc304 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:43.951353 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1f0ff38d-5113-4448-99d9-8d81604fc304 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:43.951886 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1f0ff38d-5113-4448-99d9-8d81604fc304 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:43.952745 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1f0ff38d-5113-4448-99d9-8d81604fc304 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:43.953299 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1f0ff38d-5113-4448-99d9-8d81604fc304 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:43.953822 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1f0ff38d-5113-4448-99d9-8d81604fc304 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:44.010307 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-1f0ff38d-5113-4448-99d9-8d81604fc304 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Getting quotas for project d33f8cd7d4424157b410b64c7823f480. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:52:44.035051 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-1f0ff38d-5113-4448-99d9-8d81604fc304 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Getting quotas for user 6349b0ee9e2142a8a440d4e6ae0703a7 and project d33f8cd7d4424157b410b64c7823f480. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:52:44.075762 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1f0ff38d-5113-4448-99d9-8d81604fc304 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:52:44.078654 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1f0ff38d-5113-4448-99d9-8d81604fc304 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: c76166e9-e2cf-4253-99e2-3f8d919099ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:52:44.153216 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-480efe8a-1d80-4fa4-aa47-92f82bc5ba8d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:44.162626 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-480efe8a-1d80-4fa4-aa47-92f82bc5ba8d tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/19da7b68-c450-41e9-9a0b-135b8105b4d5" status: 200 len: 1432 microversion: 2.1 time: 0.313310 Aug 31 15:52:44.167367 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 496/1010] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:43 2022] GET /compute/v2.1/servers/19da7b68-c450-41e9-9a0b-135b8105b4d5 => generated 1432 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:44.250587 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1f0ff38d-5113-4448-99d9-8d81604fc304 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.929645 Aug 31 15:52:44.260300 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 515/1011] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:52:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 2936 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 15:52:44.272525 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-6cb89fb6-4294-4655-b4eb-0b2f22e4da35 req-38907112-8d0a-48e9-9c9b-6a76b623adb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "236954ea-2791-477d-a92b-88e590593c63", "name": "network-vif-unplugged", "status": "completed", "tag": "741689b8-43aa-4b92-9c42-308fa64c312a"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:52:44.337271 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-6cb89fb6-4294-4655-b4eb-0b2f22e4da35 req-38907112-8d0a-48e9-9c9b-6a76b623adb8 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:44.339197 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-6cb89fb6-4294-4655-b4eb-0b2f22e4da35 req-38907112-8d0a-48e9-9c9b-6a76b623adb8 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:44.339807 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-6cb89fb6-4294-4655-b4eb-0b2f22e4da35 req-38907112-8d0a-48e9-9c9b-6a76b623adb8 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:44.381191 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-6cb89fb6-4294-4655-b4eb-0b2f22e4da35 req-38907112-8d0a-48e9-9c9b-6a76b623adb8 service nova] Creating event network-vif-unplugged:741689b8-43aa-4b92-9c42-308fa64c312a for instance 236954ea-2791-477d-a92b-88e590593c63 on n-h2-833090-16 Aug 31 15:52:44.409821 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [req-6cb89fb6-4294-4655-b4eb-0b2f22e4da35 req-38907112-8d0a-48e9-9c9b-6a76b623adb8 service nova] Instance 236954ea-2791-477d-a92b-88e590593c63 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-833090-16', 'n-h1-833090-16'} {{(pid=128864) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 15:52:44.464141 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-6cb89fb6-4294-4655-b4eb-0b2f22e4da35 req-38907112-8d0a-48e9-9c9b-6a76b623adb8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.202463 Aug 31 15:52:44.473203 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 516/1012] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:52:44.492634 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8cffa3e7-dfc1-4e2a-88d2-73bfc7b19864 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:44.499297 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8cffa3e7-dfc1-4e2a-88d2-73bfc7b19864 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 236954ea-2791-477d-a92b-88e590593c63] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:44.521227 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8cffa3e7-dfc1-4e2a-88d2-73bfc7b19864 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:44.525659 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8cffa3e7-dfc1-4e2a-88d2-73bfc7b19864 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:44.527558 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8cffa3e7-dfc1-4e2a-88d2-73bfc7b19864 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:44.531368 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8cffa3e7-dfc1-4e2a-88d2-73bfc7b19864 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:44.537337 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8cffa3e7-dfc1-4e2a-88d2-73bfc7b19864 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:44.540720 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8cffa3e7-dfc1-4e2a-88d2-73bfc7b19864 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:44.634844 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6a975f1b-6ace-4324-92a3-dffc94e7b8a5 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-294530275", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": "none"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:52:44.800849 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-6a975f1b-6ace-4324-92a3-dffc94e7b8a5 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:52:44.801381 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-6a975f1b-6ace-4324-92a3-dffc94e7b8a5 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:52:44.801857 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-6a975f1b-6ace-4324-92a3-dffc94e7b8a5 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:52:44.814248 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-6a975f1b-6ace-4324-92a3-dffc94e7b8a5 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:52:44.814678 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-6a975f1b-6ace-4324-92a3-dffc94e7b8a5 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:52:44.848847 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a975f1b-6ace-4324-92a3-dffc94e7b8a5 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:44.849348 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a975f1b-6ace-4324-92a3-dffc94e7b8a5 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:44.868151 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a975f1b-6ace-4324-92a3-dffc94e7b8a5 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:44.869107 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a975f1b-6ace-4324-92a3-dffc94e7b8a5 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:44.869589 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a975f1b-6ace-4324-92a3-dffc94e7b8a5 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:44.870018 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a975f1b-6ace-4324-92a3-dffc94e7b8a5 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:44.916642 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-6a975f1b-6ace-4324-92a3-dffc94e7b8a5 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Getting quotas for project 7bdc9d048a4845f3983579cd9d88faca. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:52:44.936211 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-6a975f1b-6ace-4324-92a3-dffc94e7b8a5 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Getting quotas for user d6c2aa8a18954a9497c2c90890189fe3 and project 7bdc9d048a4845f3983579cd9d88faca. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:52:44.978383 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6a975f1b-6ace-4324-92a3-dffc94e7b8a5 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:52:44.980776 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6a975f1b-6ace-4324-92a3-dffc94e7b8a5 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] [instance: ec8bbe5f-2c2c-41b8-bfed-711906394506] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:52:45.035916 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=3,nova_api:INSERT=5 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:52:45.070549 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6a975f1b-6ace-4324-92a3-dffc94e7b8a5 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.900815 Aug 31 15:52:45.071525 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 497/1013] 10.222.0.50 () {62 vars in 1188 bytes} [Wed Aug 31 15:52:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 903 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 31 15:52:45.078423 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-47fccf9f-3edb-4f3d-b9b3-1b1455815a99 req-a3948d89-4c51-47d4-b246-c21c177b4095 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19da7b68-c450-41e9-9a0b-135b8105b4d5", "name": "network-vif-deleted", "tag": "49cad27c-0371-48ed-b8ca-95367001546e"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:52:45.102459 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-47fccf9f-3edb-4f3d-b9b3-1b1455815a99 req-a3948d89-4c51-47d4-b246-c21c177b4095 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:45.103580 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-47fccf9f-3edb-4f3d-b9b3-1b1455815a99 req-a3948d89-4c51-47d4-b246-c21c177b4095 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:45.104242 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-47fccf9f-3edb-4f3d-b9b3-1b1455815a99 req-a3948d89-4c51-47d4-b246-c21c177b4095 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:45.119528 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-47fccf9f-3edb-4f3d-b9b3-1b1455815a99 req-a3948d89-4c51-47d4-b246-c21c177b4095 service nova] Creating event network-vif-deleted:49cad27c-0371-48ed-b8ca-95367001546e for instance 19da7b68-c450-41e9-9a0b-135b8105b4d5 on n-h1-833090-16 Aug 31 15:52:45.129512 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-47fccf9f-3edb-4f3d-b9b3-1b1455815a99 req-a3948d89-4c51-47d4-b246-c21c177b4095 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055800 Aug 31 15:52:45.130773 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 498/1014] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:52:45.137362 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-32059894-f1d8-42fd-b6f4-a869f1d73f94 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:45.138768 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-32059894-f1d8-42fd-b6f4-a869f1d73f94 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: c76166e9-e2cf-4253-99e2-3f8d919099ba] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:45.601718 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-32059894-f1d8-42fd-b6f4-a869f1d73f94 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6349b0ee9e2142a8a440d4e6ae0703a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33f8cd7d4424157b410b64c7823f480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:45.620840 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-32059894-f1d8-42fd-b6f4-a869f1d73f94 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "GET /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba" status: 200 len: 1265 microversion: 2.1 time: 0.481125 Aug 31 15:52:45.630258 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 499/1015] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:45 2022] GET /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba => generated 1265 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:45.648388 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4ad38d4b-1840-4e91-8ba1-6cf3d94c0977 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:45.649241 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4ad38d4b-1840-4e91-8ba1-6cf3d94c0977 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] [instance: a90bb0c5-7d56-4e38-8d78-a5c92a9976c3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:45.660254 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ad38d4b-1840-4e91-8ba1-6cf3d94c0977 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:45.661013 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ad38d4b-1840-4e91-8ba1-6cf3d94c0977 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:45.661507 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ad38d4b-1840-4e91-8ba1-6cf3d94c0977 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:45.662650 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ad38d4b-1840-4e91-8ba1-6cf3d94c0977 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:45.663348 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ad38d4b-1840-4e91-8ba1-6cf3d94c0977 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:45.664286 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ad38d4b-1840-4e91-8ba1-6cf3d94c0977 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:45.890505 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8cffa3e7-dfc1-4e2a-88d2-73bfc7b19864 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:45.911629 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8cffa3e7-dfc1-4e2a-88d2-73bfc7b19864 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63" status: 200 len: 1475 microversion: 2.1 time: 1.436361 Aug 31 15:52:45.912937 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 517/1016] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:44 2022] GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63 => generated 1475 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:45.919758 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7615298a-1ac2-4289-8161-30fc380cfbd1 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:45.920939 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7615298a-1ac2-4289-8161-30fc380cfbd1 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:45.930869 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7615298a-1ac2-4289-8161-30fc380cfbd1 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:45.931881 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7615298a-1ac2-4289-8161-30fc380cfbd1 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:45.932582 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7615298a-1ac2-4289-8161-30fc380cfbd1 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:45.933626 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7615298a-1ac2-4289-8161-30fc380cfbd1 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:45.934461 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7615298a-1ac2-4289-8161-30fc380cfbd1 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:45.935074 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7615298a-1ac2-4289-8161-30fc380cfbd1 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:46.102570 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7615298a-1ac2-4289-8161-30fc380cfbd1 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:46.124003 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7615298a-1ac2-4289-8161-30fc380cfbd1 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:46.126366 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7615298a-1ac2-4289-8161-30fc380cfbd1 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:46.127761 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7615298a-1ac2-4289-8161-30fc380cfbd1 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a" status: 200 len: 1343 microversion: 2.25 time: 0.213583 Aug 31 15:52:46.143815 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 518/1017] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:52:45 2022] GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a => generated 1343 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:52:46.149816 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-25c40e09-bca2-428b-b276-604ad9ec753f tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:46.150666 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-25c40e09-bca2-428b-b276-604ad9ec753f tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] [instance: ec8bbe5f-2c2c-41b8-bfed-711906394506] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:46.164110 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-25c40e09-bca2-428b-b276-604ad9ec753f tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:46.164758 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-25c40e09-bca2-428b-b276-604ad9ec753f tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:46.165992 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-25c40e09-bca2-428b-b276-604ad9ec753f tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:46.167591 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-25c40e09-bca2-428b-b276-604ad9ec753f tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:46.168411 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-25c40e09-bca2-428b-b276-604ad9ec753f tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:46.169074 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-25c40e09-bca2-428b-b276-604ad9ec753f tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:46.312163 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4ad38d4b-1840-4e91-8ba1-6cf3d94c0977 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e40446741c470f92d6f60ec910d84e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c897eb2e5b4101858807f875a8ac0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:46.321271 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4ad38d4b-1840-4e91-8ba1-6cf3d94c0977 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] 10.222.0.50 "GET /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3" status: 200 len: 1554 microversion: 2.1 time: 0.689312 Aug 31 15:52:46.321856 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 500/1018] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:45 2022] GET /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3 => generated 1554 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:46.339100 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d83a3848-7593-4b91-a609-4c298241b6c1 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:46.339934 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d83a3848-7593-4b91-a609-4c298241b6c1 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 19da7b68-c450-41e9-9a0b-135b8105b4d5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:46.354870 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d83a3848-7593-4b91-a609-4c298241b6c1 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:46.360359 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d83a3848-7593-4b91-a609-4c298241b6c1 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:46.362363 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d83a3848-7593-4b91-a609-4c298241b6c1 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:46.369188 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d83a3848-7593-4b91-a609-4c298241b6c1 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:46.370399 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d83a3848-7593-4b91-a609-4c298241b6c1 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:46.371383 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d83a3848-7593-4b91-a609-4c298241b6c1 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:46.414843 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-d83a3848-7593-4b91-a609-4c298241b6c1 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] HTTP exception thrown: Instance 19da7b68-c450-41e9-9a0b-135b8105b4d5 could not be found. Aug 31 15:52:46.422604 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d83a3848-7593-4b91-a609-4c298241b6c1 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Request method failure captured: Aug 31 15:52:46.422604 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/19da7b68-c450-41e9-9a0b-135b8105b4d5 HTTP/1.1 Aug 31 15:52:46.422604 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:52:46.422604 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:52:46.422604 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:52:46.422604 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:52:46.422604 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:52:46.422604 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:52:46.422604 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:52:46.422604 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:52:46.422604 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4L5y07547XEfI_cY_8ZFyTZ2GODruSaAiNwL5T7pV746ldskVNIIQw6lIoEqrgxXvEXbIblt4yfV5d-cxgOpBf2oAyg-UpeVanVK5I-BR_CVasS0-Y9DUowTZd9jVO3T3hdjRzydMsILc76TUmWEyP017xiZ12asWHDSwtKrB6FkRQ Aug 31 15:52:46.422604 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:52:46.422604 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:52:46.422604 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:52:46.422604 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:52:46.422604 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:52:46.422604 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:52:46.422604 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 7db749eb0a764fa0bb29ddc4abd6d245 Aug 31 15:52:46.422604 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersOnMultiNodesTest-1874033872 Aug 31 15:52:46.422604 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:52:46.422604 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:52:46.424961 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7db749eb0a764fa0bb29ddc4abd6d245"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7db749eb0a764fa0bb29ddc4abd6d245"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7db749eb0a764fa0bb29ddc4abd6d245"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7db749eb0a764fa0bb29ddc4abd6d245", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:52:46.424961 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServersOnMultiNodesTest-1874033872 Aug 31 15:52:46.424961 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 7db749eb0a764fa0bb29ddc4abd6d245 Aug 31 15:52:46.424961 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1874033872 Aug 31 15:52:46.424961 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServersOnMultiNodesTest-1874033872-project Aug 31 15:52:46.424961 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:52:46.424961 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:52:46.424961 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: fe647be03cef4e9c86b4fd6e703d0de1 Aug 31 15:52:46.424961 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServersOnMultiNodesTest-1874033872-project Aug 31 15:52:46.424961 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 15:52:46.424961 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 19da7b68-c450-41e9-9a0b-135b8105b4d5 could not be found. Aug 31 15:52:46.424961 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '19da7b68-c450-41e9-9a0b-135b8105b4d5'} Aug 31 15:52:46.425879 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:52:46.425879 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:46.425879 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:52:46.425879 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:52:46.425879 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:52:46.425879 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:52:46.425879 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:52:46.425879 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:52:46.425879 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:52:46.425879 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:52:46.425879 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19da7b68-c450-41e9-9a0b-135b8105b4d5 could not be found. Aug 31 15:52:46.425879 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:52:46.425879 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:52:46.425879 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:52:46.425879 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:46.425879 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:52:46.425879 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:52:46.425879 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:52:46.425879 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:52:46.425879 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:52:46.427913 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:52:46.427913 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:52:46.427913 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:52:46.427913 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:52:46.427913 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:52:46.427913 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:52:46.427913 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:52:46.427913 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19da7b68-c450-41e9-9a0b-135b8105b4d5 could not be found. Aug 31 15:52:46.427913 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:52:46.427913 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:52:46.427913 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:52:46.427913 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:46.427913 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:52:46.427913 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:52:46.427913 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:52:46.427913 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:52:46.427913 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19da7b68-c450-41e9-9a0b-135b8105b4d5 could not be found. Aug 31 15:52:46.427913 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:52:46.432117 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d83a3848-7593-4b91-a609-4c298241b6c1 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Returning 404 to user: Instance 19da7b68-c450-41e9-9a0b-135b8105b4d5 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:52:46.435333 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d83a3848-7593-4b91-a609-4c298241b6c1 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/19da7b68-c450-41e9-9a0b-135b8105b4d5" status: 404 len: 111 microversion: 2.1 time: 0.102606 Aug 31 15:52:46.437394 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 501/1019] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:46 2022] GET /compute/v2.1/servers/19da7b68-c450-41e9-9a0b-135b8105b4d5 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:52:46.446915 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0e27884a-55ac-4c54-a1b9-dfdc455ef853 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:46.451162 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0e27884a-55ac-4c54-a1b9-dfdc455ef853 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] [instance: a90bb0c5-7d56-4e38-8d78-a5c92a9976c3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:46.467755 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e27884a-55ac-4c54-a1b9-dfdc455ef853 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:46.470496 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e27884a-55ac-4c54-a1b9-dfdc455ef853 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:46.471082 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e27884a-55ac-4c54-a1b9-dfdc455ef853 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:46.472032 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e27884a-55ac-4c54-a1b9-dfdc455ef853 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:46.474886 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e27884a-55ac-4c54-a1b9-dfdc455ef853 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:46.476262 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e27884a-55ac-4c54-a1b9-dfdc455ef853 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:46.580061 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-25c40e09-bca2-428b-b276-604ad9ec753f tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:46.601516 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-25c40e09-bca2-428b-b276-604ad9ec753f tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:46.604000 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-25c40e09-bca2-428b-b276-604ad9ec753f tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:46.606759 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-25c40e09-bca2-428b-b276-604ad9ec753f tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] 10.222.0.50 "GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506" status: 200 len: 1281 microversion: 2.54 time: 0.461422 Aug 31 15:52:46.619084 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 519/1020] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:52:46 2022] GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506 => generated 1281 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:52:46.629925 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9eee75e9-abb7-4c35-a2a9-1578560b4333 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:46.630939 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9eee75e9-abb7-4c35-a2a9-1578560b4333 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: d15c3817-84b0-4e82-86b2-f2333ceeb3cd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:46.639570 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9eee75e9-abb7-4c35-a2a9-1578560b4333 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:46.640632 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9eee75e9-abb7-4c35-a2a9-1578560b4333 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:46.641297 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9eee75e9-abb7-4c35-a2a9-1578560b4333 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:46.642341 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9eee75e9-abb7-4c35-a2a9-1578560b4333 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:46.643212 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9eee75e9-abb7-4c35-a2a9-1578560b4333 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:46.644106 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9eee75e9-abb7-4c35-a2a9-1578560b4333 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:46.765767 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0e27884a-55ac-4c54-a1b9-dfdc455ef853 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] 10.222.0.50 "GET /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.325781 Aug 31 15:52:46.773206 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 502/1021] 10.222.0.50 () {58 vars in 1275 bytes} [Wed Aug 31 15:52:46 2022] GET /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3/os-interface => generated 284 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:52:46.773611 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9eee75e9-abb7-4c35-a2a9-1578560b4333 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:46.779564 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-b20420b0-e493-4bcd-be6b-4b96d9b5d404 req-afaa99e7-c425-4bd9-9b20-c483a5409b88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "236954ea-2791-477d-a92b-88e590593c63", "tag": "741689b8-43aa-4b92-9c42-308fa64c312a"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:52:46.782232 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9eee75e9-abb7-4c35-a2a9-1578560b4333 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/d15c3817-84b0-4e82-86b2-f2333ceeb3cd" status: 200 len: 1432 microversion: 2.1 time: 0.161539 Aug 31 15:52:46.782835 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 520/1022] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:46 2022] GET /compute/v2.1/servers/d15c3817-84b0-4e82-86b2-f2333ceeb3cd => generated 1432 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:46.801016 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b20420b0-e493-4bcd-be6b-4b96d9b5d404 req-afaa99e7-c425-4bd9-9b20-c483a5409b88 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:46.807562 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b20420b0-e493-4bcd-be6b-4b96d9b5d404 req-afaa99e7-c425-4bd9-9b20-c483a5409b88 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:46.809084 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b20420b0-e493-4bcd-be6b-4b96d9b5d404 req-afaa99e7-c425-4bd9-9b20-c483a5409b88 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:46.810806 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-01be547a-c085-402c-953e-6004918f5de9 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:46.824623 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-01be547a-c085-402c-953e-6004918f5de9 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: c76166e9-e2cf-4253-99e2-3f8d919099ba] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:46.832918 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-b20420b0-e493-4bcd-be6b-4b96d9b5d404 req-afaa99e7-c425-4bd9-9b20-c483a5409b88 service nova] Creating event network-changed:741689b8-43aa-4b92-9c42-308fa64c312a for instance 236954ea-2791-477d-a92b-88e590593c63 on n-h2-833090-16 Aug 31 15:52:46.846538 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01be547a-c085-402c-953e-6004918f5de9 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:46.847435 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01be547a-c085-402c-953e-6004918f5de9 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:46.850602 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01be547a-c085-402c-953e-6004918f5de9 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:46.851249 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [req-b20420b0-e493-4bcd-be6b-4b96d9b5d404 req-afaa99e7-c425-4bd9-9b20-c483a5409b88 service nova] Instance 236954ea-2791-477d-a92b-88e590593c63 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-833090-16', 'n-h1-833090-16'} {{(pid=128863) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 15:52:46.859353 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01be547a-c085-402c-953e-6004918f5de9 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:46.861391 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01be547a-c085-402c-953e-6004918f5de9 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:46.862972 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01be547a-c085-402c-953e-6004918f5de9 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:46.887943 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-b20420b0-e493-4bcd-be6b-4b96d9b5d404 req-afaa99e7-c425-4bd9-9b20-c483a5409b88 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119175 Aug 31 15:52:46.889221 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 503/1023] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:52:46.933880 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d5030e84-962f-45e9-af15-7d1dd381c46b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:46.934689 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d5030e84-962f-45e9-af15-7d1dd381c46b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 236954ea-2791-477d-a92b-88e590593c63] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:46.953940 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5030e84-962f-45e9-af15-7d1dd381c46b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:46.954594 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5030e84-962f-45e9-af15-7d1dd381c46b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:46.955112 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5030e84-962f-45e9-af15-7d1dd381c46b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:46.956312 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5030e84-962f-45e9-af15-7d1dd381c46b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:46.956841 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5030e84-962f-45e9-af15-7d1dd381c46b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:46.957407 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5030e84-962f-45e9-af15-7d1dd381c46b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:47.101437 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-01be547a-c085-402c-953e-6004918f5de9 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6349b0ee9e2142a8a440d4e6ae0703a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33f8cd7d4424157b410b64c7823f480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:47.111417 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-01be547a-c085-402c-953e-6004918f5de9 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "GET /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba" status: 200 len: 1317 microversion: 2.1 time: 0.327370 Aug 31 15:52:47.116913 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 521/1024] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:46 2022] GET /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba => generated 1317 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:47.153381 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c504a69a-6dca-4b41-b794-f99e375ee072 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:47.154748 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c504a69a-6dca-4b41-b794-f99e375ee072 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:47.164770 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c504a69a-6dca-4b41-b794-f99e375ee072 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:47.166674 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c504a69a-6dca-4b41-b794-f99e375ee072 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:47.168662 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c504a69a-6dca-4b41-b794-f99e375ee072 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:47.169623 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c504a69a-6dca-4b41-b794-f99e375ee072 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:47.172630 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c504a69a-6dca-4b41-b794-f99e375ee072 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:47.175053 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c504a69a-6dca-4b41-b794-f99e375ee072 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:47.766462 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c504a69a-6dca-4b41-b794-f99e375ee072 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:47.779632 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c504a69a-6dca-4b41-b794-f99e375ee072 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:47.782469 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c504a69a-6dca-4b41-b794-f99e375ee072 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:47.789512 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c504a69a-6dca-4b41-b794-f99e375ee072 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a" status: 200 len: 1343 microversion: 2.25 time: 0.641979 Aug 31 15:52:47.802119 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 522/1025] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:52:47 2022] GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a => generated 1343 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 15:52:47.825252 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-c5187db4-0295-4651-88dc-e7263cc8d976 req-8cf9d0a8-17ae-4569-a69f-0bf58042fdc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881", "name": "network-vif-deleted", "tag": "12f537b0-fb53-4252-b4e9-7a06b83e70f8"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:52:47.847885 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-c5187db4-0295-4651-88dc-e7263cc8d976 req-8cf9d0a8-17ae-4569-a69f-0bf58042fdc9 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:47.848531 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-c5187db4-0295-4651-88dc-e7263cc8d976 req-8cf9d0a8-17ae-4569-a69f-0bf58042fdc9 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:47.849012 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-c5187db4-0295-4651-88dc-e7263cc8d976 req-8cf9d0a8-17ae-4569-a69f-0bf58042fdc9 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:47.902359 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-c5187db4-0295-4651-88dc-e7263cc8d976 req-8cf9d0a8-17ae-4569-a69f-0bf58042fdc9 service nova] Creating event network-vif-deleted:12f537b0-fb53-4252-b4e9-7a06b83e70f8 for instance 2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881 on n-h2-833090-16 Aug 31 15:52:47.911292 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-c5187db4-0295-4651-88dc-e7263cc8d976 req-8cf9d0a8-17ae-4569-a69f-0bf58042fdc9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113451 Aug 31 15:52:47.915453 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 523/1026] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:52:47.941872 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-25984670-36cb-4a67-b4a7-5d37292794c6 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:47.944579 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-25984670-36cb-4a67-b4a7-5d37292794c6 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] [instance: ec8bbe5f-2c2c-41b8-bfed-711906394506] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:47.958357 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-25984670-36cb-4a67-b4a7-5d37292794c6 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:47.959158 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-25984670-36cb-4a67-b4a7-5d37292794c6 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:47.959814 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-25984670-36cb-4a67-b4a7-5d37292794c6 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:47.961313 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-25984670-36cb-4a67-b4a7-5d37292794c6 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:47.962302 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-25984670-36cb-4a67-b4a7-5d37292794c6 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:47.963186 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-25984670-36cb-4a67-b4a7-5d37292794c6 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:47.993856 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d5030e84-962f-45e9-af15-7d1dd381c46b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:48.005642 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d5030e84-962f-45e9-af15-7d1dd381c46b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63" status: 200 len: 1475 microversion: 2.1 time: 1.076106 Aug 31 15:52:48.007107 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 504/1027] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:46 2022] GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63 => generated 1475 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:48.012493 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ae32976c-a41c-4201-9612-a7af7ce247e8 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:48.013262 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ae32976c-a41c-4201-9612-a7af7ce247e8 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: d15c3817-84b0-4e82-86b2-f2333ceeb3cd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:48.020222 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae32976c-a41c-4201-9612-a7af7ce247e8 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:48.021032 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae32976c-a41c-4201-9612-a7af7ce247e8 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:48.021737 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae32976c-a41c-4201-9612-a7af7ce247e8 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:48.022637 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae32976c-a41c-4201-9612-a7af7ce247e8 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:48.023270 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae32976c-a41c-4201-9612-a7af7ce247e8 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:48.023851 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae32976c-a41c-4201-9612-a7af7ce247e8 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:48.118435 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae32976c-a41c-4201-9612-a7af7ce247e8 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:48.121574 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae32976c-a41c-4201-9612-a7af7ce247e8 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:48.122249 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae32976c-a41c-4201-9612-a7af7ce247e8 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:48.122943 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-ae32976c-a41c-4201-9612-a7af7ce247e8 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lazy-loading 'fault' on Instance uuid d15c3817-84b0-4e82-86b2-f2333ceeb3cd {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:52:48.505097 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ae32976c-a41c-4201-9612-a7af7ce247e8 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:48.514366 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-25984670-36cb-4a67-b4a7-5d37292794c6 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:48.526038 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ae32976c-a41c-4201-9612-a7af7ce247e8 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/d15c3817-84b0-4e82-86b2-f2333ceeb3cd" status: 200 len: 1308 microversion: 2.1 time: 0.517513 Aug 31 15:52:48.526665 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 505/1028] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:48 2022] GET /compute/v2.1/servers/d15c3817-84b0-4e82-86b2-f2333ceeb3cd => generated 1308 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:48.546054 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fa540744-2ac9-41b2-96d5-b241037c65bf tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:48.546989 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fa540744-2ac9-41b2-96d5-b241037c65bf tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: c76166e9-e2cf-4253-99e2-3f8d919099ba] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:48.547737 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-25984670-36cb-4a67-b4a7-5d37292794c6 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:48.551854 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-25984670-36cb-4a67-b4a7-5d37292794c6 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:48.553884 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-25984670-36cb-4a67-b4a7-5d37292794c6 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] 10.222.0.50 "GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506" status: 200 len: 1335 microversion: 2.54 time: 0.636980 Aug 31 15:52:48.555293 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 524/1029] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:52:47 2022] GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506 => generated 1335 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:52:48.573324 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa540744-2ac9-41b2-96d5-b241037c65bf tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:48.574392 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa540744-2ac9-41b2-96d5-b241037c65bf tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:48.574929 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa540744-2ac9-41b2-96d5-b241037c65bf tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:48.575833 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa540744-2ac9-41b2-96d5-b241037c65bf tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:48.577045 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa540744-2ac9-41b2-96d5-b241037c65bf tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:48.577594 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa540744-2ac9-41b2-96d5-b241037c65bf tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:48.825159 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fa540744-2ac9-41b2-96d5-b241037c65bf tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6349b0ee9e2142a8a440d4e6ae0703a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33f8cd7d4424157b410b64c7823f480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:48.835066 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fa540744-2ac9-41b2-96d5-b241037c65bf tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "GET /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba" status: 200 len: 1323 microversion: 2.1 time: 0.303419 Aug 31 15:52:48.847073 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 506/1030] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:48 2022] GET /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba => generated 1323 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:48.856699 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8e6cc875-7709-4316-b8d7-b7e1b8060805 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:48.858996 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8e6cc875-7709-4316-b8d7-b7e1b8060805 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:48.867873 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e6cc875-7709-4316-b8d7-b7e1b8060805 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:48.868750 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e6cc875-7709-4316-b8d7-b7e1b8060805 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:48.869803 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e6cc875-7709-4316-b8d7-b7e1b8060805 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:48.870953 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e6cc875-7709-4316-b8d7-b7e1b8060805 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:48.871758 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e6cc875-7709-4316-b8d7-b7e1b8060805 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:48.872442 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e6cc875-7709-4316-b8d7-b7e1b8060805 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:48.888374 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5b4d3723-aa70-4e71-9bac-e3dd721f3387 tempest-ImagesDeleteNegativeTestJSON-300093117 tempest-ImagesDeleteNegativeTestJSON-300093117-project] 10.222.0.50 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.181306 Aug 31 15:52:48.889448 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 525/1031] 10.222.0.50 () {58 vars in 1128 bytes} [Wed Aug 31 15:52:48 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 31 15:52:48.902008 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-82ca8906-aa03-4692-bb7a-602c358ba706 tempest-ImagesDeleteNegativeTestJSON-300093117 tempest-ImagesDeleteNegativeTestJSON-300093117-project] Calling method '.version_select at 0x7fbb467b90d0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:48.978632 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-82ca8906-aa03-4692-bb7a-602c358ba706 tempest-ImagesDeleteNegativeTestJSON-300093117 tempest-ImagesDeleteNegativeTestJSON-300093117-project] HTTP exception thrown: Image not found. Aug 31 15:52:48.980673 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-82ca8906-aa03-4692-bb7a-602c358ba706 tempest-ImagesDeleteNegativeTestJSON-300093117 tempest-ImagesDeleteNegativeTestJSON-300093117-project] Request method failure captured: Aug 31 15:52:48.980673 n-d-833090-16 devstack@n-api.service[128864]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Aug 31 15:52:48.980673 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:52:48.980673 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:52:48.980673 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:52:48.980673 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:52:48.980673 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:52:48.980673 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:52:48.980673 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:52:48.980673 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:52:48.980673 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4PQRzDpwqG-CPWfTs7EO18pv7yLOEuUUHG8sVkP2S5fbuARjj1Gj8Mza1ndosNh3KlXXVRCCNba_l2sDTDIrY9HtRkQvC37pha_wHRo5tpjDaADCvF0-j3AtiXKy6e6z0r275Ftw2nr-ldm24wqhPuSSGALn2J9ddQxPdpxy3NrpD8 Aug 31 15:52:48.980673 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:52:48.980673 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:52:48.980673 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:52:48.980673 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:52:48.980673 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:52:48.980673 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:52:48.980673 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: f207eef5bb904deabc9de40803025011 Aug 31 15:52:48.980673 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-300093117 Aug 31 15:52:48.980673 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:52:48.980673 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:52:48.982154 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f207eef5bb904deabc9de40803025011"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f207eef5bb904deabc9de40803025011"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f207eef5bb904deabc9de40803025011"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f207eef5bb904deabc9de40803025011", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:52:48.982154 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-300093117 Aug 31 15:52:48.982154 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: f207eef5bb904deabc9de40803025011 Aug 31 15:52:48.982154 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-300093117 Aug 31 15:52:48.982154 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ImagesDeleteNegativeTestJSON-300093117-project Aug 31 15:52:48.982154 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:52:48.982154 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:52:48.982154 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: fccb09da90a844ac98a04ba0c00b0437 Aug 31 15:52:48.982154 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-300093117-project Aug 31 15:52:48.982154 n-d-833090-16 devstack@n-api.service[128864]: method: Aug 31 15:52:48.982154 n-d-833090-16 devstack@n-api.service[128864]: exception: Image not found. Aug 31 15:52:48.982154 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '-1'} Aug 31 15:52:48.982154 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:52:48.982154 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:48.983080 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 31 15:52:48.983080 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 31 15:52:48.983080 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 15:52:48.983080 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 15:52:48.983080 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 15:52:48.983080 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 15:52:48.983080 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 31 15:52:48.983080 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 31 15:52:48.983080 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 31 15:52:48.983080 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 31 15:52:48.983080 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 15:52:48.983080 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 15:52:48.983080 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 15:52:48.983080 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 15:52:48.983080 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Aug 31 15:52:48.983080 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:48.983080 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:52:48.983080 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:48.983080 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:48.984887 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 31 15:52:48.984887 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 31 15:52:48.984887 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 31 15:52:48.984887 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 31 15:52:48.984887 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 31 15:52:48.984887 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 31 15:52:48.984887 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Aug 31 15:52:48.984887 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:48.984887 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:52:48.984887 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:48.984887 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:48.984887 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:52:48.984887 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:52:48.984887 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:52:48.984887 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:52:48.984887 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:52:48.984887 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:52:48.984887 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:52:48.984887 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:52:48.984887 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 31 15:52:48.986390 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 31 15:52:48.986390 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 31 15:52:48.986390 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:48.986390 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:52:48.986390 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:48.986390 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:48.986390 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:52:48.986390 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:52:48.986390 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:52:48.986390 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:52:48.986390 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 31 15:52:48.986390 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:48.986390 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-82ca8906-aa03-4692-bb7a-602c358ba706 tempest-ImagesDeleteNegativeTestJSON-300093117 tempest-ImagesDeleteNegativeTestJSON-300093117-project] Returning 404 to user: Image not found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:52:48.986390 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-82ca8906-aa03-4692-bb7a-602c358ba706 tempest-ImagesDeleteNegativeTestJSON-300093117 tempest-ImagesDeleteNegativeTestJSON-300093117-project] 10.222.0.50 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.085202 Aug 31 15:52:48.986390 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 526/1032] 10.222.0.50 () {58 vars in 1134 bytes} [Wed Aug 31 15:52:48 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 31 15:52:48.993313 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9bf6dfd4-c7f1-48fa-b3da-2a6ceb6c3f65 tempest-ImagesDeleteNegativeTestJSON-300093117 tempest-ImagesDeleteNegativeTestJSON-300093117-project] Calling method '.version_select at 0x7fbb4678c820>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:49.026287 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-9bf6dfd4-c7f1-48fa-b3da-2a6ceb6c3f65 tempest-ImagesDeleteNegativeTestJSON-300093117 tempest-ImagesDeleteNegativeTestJSON-300093117-project] HTTP exception thrown: Image not found. Aug 31 15:52:49.028866 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9bf6dfd4-c7f1-48fa-b3da-2a6ceb6c3f65 tempest-ImagesDeleteNegativeTestJSON-300093117 tempest-ImagesDeleteNegativeTestJSON-300093117-project] Request method failure captured: Aug 31 15:52:49.028866 n-d-833090-16 devstack@n-api.service[128864]: request: DELETE /compute/v2.1/images/99488060-140e-414b-91db-4acbb1520cbj HTTP/1.1 Aug 31 15:52:49.028866 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:52:49.028866 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:52:49.028866 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:52:49.028866 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:52:49.028866 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:52:49.028866 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:52:49.028866 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:52:49.028866 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:52:49.028866 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4PQRzDpwqG-CPWfTs7EO18pv7yLOEuUUHG8sVkP2S5fbuARjj1Gj8Mza1ndosNh3KlXXVRCCNba_l2sDTDIrY9HtRkQvC37pha_wHRo5tpjDaADCvF0-j3AtiXKy6e6z0r275Ftw2nr-ldm24wqhPuSSGALn2J9ddQxPdpxy3NrpD8 Aug 31 15:52:49.028866 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:52:49.028866 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:52:49.028866 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:52:49.028866 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:52:49.028866 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:52:49.028866 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:52:49.028866 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: f207eef5bb904deabc9de40803025011 Aug 31 15:52:49.028866 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-300093117 Aug 31 15:52:49.028866 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:52:49.028866 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:52:49.030548 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f207eef5bb904deabc9de40803025011"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f207eef5bb904deabc9de40803025011"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f207eef5bb904deabc9de40803025011"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f207eef5bb904deabc9de40803025011", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:52:49.030548 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-300093117 Aug 31 15:52:49.030548 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: f207eef5bb904deabc9de40803025011 Aug 31 15:52:49.030548 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-300093117 Aug 31 15:52:49.030548 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ImagesDeleteNegativeTestJSON-300093117-project Aug 31 15:52:49.030548 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:52:49.030548 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:52:49.030548 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: fccb09da90a844ac98a04ba0c00b0437 Aug 31 15:52:49.030548 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-300093117-project Aug 31 15:52:49.030548 n-d-833090-16 devstack@n-api.service[128864]: method: Aug 31 15:52:49.030548 n-d-833090-16 devstack@n-api.service[128864]: exception: Image not found. Aug 31 15:52:49.030548 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '99488060-140e-414b-91db-4acbb1520cbj'} Aug 31 15:52:49.030548 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:52:49.031544 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:49.031544 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 31 15:52:49.031544 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 31 15:52:49.031544 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 15:52:49.031544 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 15:52:49.031544 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 15:52:49.031544 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 15:52:49.031544 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 31 15:52:49.031544 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 31 15:52:49.031544 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 31 15:52:49.031544 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 31 15:52:49.031544 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 15:52:49.031544 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 15:52:49.031544 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 15:52:49.031544 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 15:52:49.031544 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 99488060-140e-414b-91db-4acbb1520cbj to delete Aug 31 15:52:49.031544 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:49.031544 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:52:49.031544 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:49.032904 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:49.032904 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 31 15:52:49.032904 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 31 15:52:49.032904 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 31 15:52:49.032904 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 31 15:52:49.032904 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 31 15:52:49.032904 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 31 15:52:49.032904 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 99488060-140e-414b-91db-4acbb1520cbj could not be found. Aug 31 15:52:49.032904 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:49.032904 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:52:49.032904 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:49.032904 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:49.032904 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:52:49.032904 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:52:49.032904 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:52:49.032904 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:52:49.032904 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:52:49.032904 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:52:49.032904 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:52:49.032904 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:52:49.034840 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 31 15:52:49.034840 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 31 15:52:49.034840 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 31 15:52:49.034840 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:49.034840 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:52:49.034840 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:49.034840 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:49.034840 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:52:49.034840 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:52:49.034840 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:52:49.034840 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:52:49.034840 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 31 15:52:49.034840 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:49.037055 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9bf6dfd4-c7f1-48fa-b3da-2a6ceb6c3f65 tempest-ImagesDeleteNegativeTestJSON-300093117 tempest-ImagesDeleteNegativeTestJSON-300093117-project] Returning 404 to user: Image not found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:52:49.037944 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9bf6dfd4-c7f1-48fa-b3da-2a6ceb6c3f65 tempest-ImagesDeleteNegativeTestJSON-300093117 tempest-ImagesDeleteNegativeTestJSON-300093117-project] 10.222.0.50 "DELETE /compute/v2.1/images/99488060-140e-414b-91db-4acbb1520cbj" status: 404 len: 62 microversion: 2.1 time: 0.049038 Aug 31 15:52:49.038658 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 527/1033] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:48 2022] DELETE /compute/v2.1/images/99488060-140e-414b-91db-4acbb1520cbj => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 15:52:49.045747 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ec859702-1e7c-4858-acc3-969aae1dcc0f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:49.047016 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ec859702-1e7c-4858-acc3-969aae1dcc0f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 236954ea-2791-477d-a92b-88e590593c63] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:49.053242 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ec859702-1e7c-4858-acc3-969aae1dcc0f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:49.053733 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ec859702-1e7c-4858-acc3-969aae1dcc0f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:49.054248 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ec859702-1e7c-4858-acc3-969aae1dcc0f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:49.054964 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ec859702-1e7c-4858-acc3-969aae1dcc0f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:49.055417 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ec859702-1e7c-4858-acc3-969aae1dcc0f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:49.057592 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ec859702-1e7c-4858-acc3-969aae1dcc0f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:49.523717 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8e6cc875-7709-4316-b8d7-b7e1b8060805 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:49.532738 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8e6cc875-7709-4316-b8d7-b7e1b8060805 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:49.534402 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8e6cc875-7709-4316-b8d7-b7e1b8060805 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:49.535375 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8e6cc875-7709-4316-b8d7-b7e1b8060805 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a" status: 200 len: 1411 microversion: 2.25 time: 0.686989 Aug 31 15:52:49.536102 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 507/1034] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:52:48 2022] GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a => generated 1411 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:52:49.540889 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e413034b-8ea9-464d-b3c3-fbeac15f0cdb tempest-ImagesDeleteNegativeTestJSON-300093117 tempest-ImagesDeleteNegativeTestJSON-300093117-project] Calling method '.version_select at 0x7fbb4686a0d0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:49.558841 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-e413034b-8ea9-464d-b3c3-fbeac15f0cdb tempest-ImagesDeleteNegativeTestJSON-300093117 tempest-ImagesDeleteNegativeTestJSON-300093117-project] HTTP exception thrown: Image not found. Aug 31 15:52:49.569330 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e413034b-8ea9-464d-b3c3-fbeac15f0cdb tempest-ImagesDeleteNegativeTestJSON-300093117 tempest-ImagesDeleteNegativeTestJSON-300093117-project] Request method failure captured: Aug 31 15:52:49.569330 n-d-833090-16 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/images/eb6a01d0-2867-4412-a248-0f5f710497d71 HTTP/1.1 Aug 31 15:52:49.569330 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:52:49.569330 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:52:49.569330 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:52:49.569330 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:52:49.569330 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:52:49.569330 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:52:49.569330 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:52:49.569330 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:52:49.569330 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4PQRzDpwqG-CPWfTs7EO18pv7yLOEuUUHG8sVkP2S5fbuARjj1Gj8Mza1ndosNh3KlXXVRCCNba_l2sDTDIrY9HtRkQvC37pha_wHRo5tpjDaADCvF0-j3AtiXKy6e6z0r275Ftw2nr-ldm24wqhPuSSGALn2J9ddQxPdpxy3NrpD8 Aug 31 15:52:49.569330 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:52:49.569330 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:52:49.569330 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:52:49.569330 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:52:49.569330 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:52:49.569330 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:52:49.569330 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: f207eef5bb904deabc9de40803025011 Aug 31 15:52:49.569330 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-300093117 Aug 31 15:52:49.569330 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:52:49.569330 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:52:49.570919 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f207eef5bb904deabc9de40803025011"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f207eef5bb904deabc9de40803025011"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f207eef5bb904deabc9de40803025011"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f207eef5bb904deabc9de40803025011", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:52:49.570919 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-300093117 Aug 31 15:52:49.570919 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: f207eef5bb904deabc9de40803025011 Aug 31 15:52:49.570919 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-300093117 Aug 31 15:52:49.570919 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ImagesDeleteNegativeTestJSON-300093117-project Aug 31 15:52:49.570919 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:52:49.570919 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:52:49.570919 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: fccb09da90a844ac98a04ba0c00b0437 Aug 31 15:52:49.570919 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-300093117-project Aug 31 15:52:49.570919 n-d-833090-16 devstack@n-api.service[128863]: method: Aug 31 15:52:49.570919 n-d-833090-16 devstack@n-api.service[128863]: exception: Image not found. Aug 31 15:52:49.570919 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'eb6a01d0-2867-4412-a248-0f5f710497d71'} Aug 31 15:52:49.570919 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:52:49.571807 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:49.571807 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 31 15:52:49.571807 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 31 15:52:49.571807 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 15:52:49.571807 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 15:52:49.571807 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 15:52:49.571807 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 15:52:49.571807 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 31 15:52:49.571807 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 31 15:52:49.571807 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 31 15:52:49.571807 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 31 15:52:49.571807 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 15:52:49.571807 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 15:52:49.571807 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 15:52:49.571807 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 15:52:49.571807 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image eb6a01d0-2867-4412-a248-0f5f710497d71 to delete Aug 31 15:52:49.571807 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:52:49.571807 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:52:49.571807 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:52:49.576500 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:49.576500 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 31 15:52:49.576500 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 31 15:52:49.576500 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 31 15:52:49.576500 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 31 15:52:49.576500 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 31 15:52:49.576500 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 31 15:52:49.576500 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image eb6a01d0-2867-4412-a248-0f5f710497d71 could not be found. Aug 31 15:52:49.576500 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:52:49.576500 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:52:49.576500 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:52:49.576500 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:49.576500 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:52:49.576500 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:52:49.576500 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:52:49.576500 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:52:49.576500 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:52:49.576500 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:52:49.576500 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:52:49.576500 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:52:49.579671 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 31 15:52:49.579671 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 31 15:52:49.579671 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 31 15:52:49.579671 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:52:49.579671 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:52:49.579671 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:52:49.579671 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:49.579671 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:52:49.579671 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:52:49.579671 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:52:49.579671 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:52:49.579671 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 31 15:52:49.579671 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:52:49.579671 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e413034b-8ea9-464d-b3c3-fbeac15f0cdb tempest-ImagesDeleteNegativeTestJSON-300093117 tempest-ImagesDeleteNegativeTestJSON-300093117-project] Returning 404 to user: Image not found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:52:49.579671 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e413034b-8ea9-464d-b3c3-fbeac15f0cdb tempest-ImagesDeleteNegativeTestJSON-300093117 tempest-ImagesDeleteNegativeTestJSON-300093117-project] 10.222.0.50 "DELETE /compute/v2.1/images/eb6a01d0-2867-4412-a248-0f5f710497d71" status: 404 len: 62 microversion: 2.1 time: 0.033861 Aug 31 15:52:49.581424 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 508/1035] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:52:49 2022] DELETE /compute/v2.1/images/eb6a01d0-2867-4412-a248-0f5f710497d71 => generated 62 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 15:52:49.581424 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1008b062-9e40-47b5-ba74-4c5036a9d77c tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:49.581424 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1008b062-9e40-47b5-ba74-4c5036a9d77c tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: d15c3817-84b0-4e82-86b2-f2333ceeb3cd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:49.588097 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1008b062-9e40-47b5-ba74-4c5036a9d77c tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:49.588645 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1008b062-9e40-47b5-ba74-4c5036a9d77c tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:49.589164 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1008b062-9e40-47b5-ba74-4c5036a9d77c tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:49.589859 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1008b062-9e40-47b5-ba74-4c5036a9d77c tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:49.590349 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1008b062-9e40-47b5-ba74-4c5036a9d77c tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:49.590772 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1008b062-9e40-47b5-ba74-4c5036a9d77c tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:49.604643 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-1008b062-9e40-47b5-ba74-4c5036a9d77c tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] HTTP exception thrown: Instance d15c3817-84b0-4e82-86b2-f2333ceeb3cd could not be found. Aug 31 15:52:49.608389 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1008b062-9e40-47b5-ba74-4c5036a9d77c tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Request method failure captured: Aug 31 15:52:49.608389 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/d15c3817-84b0-4e82-86b2-f2333ceeb3cd HTTP/1.1 Aug 31 15:52:49.608389 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:52:49.608389 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:52:49.608389 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:52:49.608389 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:52:49.608389 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:52:49.608389 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:52:49.608389 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:52:49.608389 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:52:49.608389 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4L5y07547XEfI_cY_8ZFyTZ2GODruSaAiNwL5T7pV746ldskVNIIQw6lIoEqrgxXvEXbIblt4yfV5d-cxgOpBf2oAyg-UpeVanVK5I-BR_CVasS0-Y9DUowTZd9jVO3T3hdjRzydMsILc76TUmWEyP017xiZ12asWHDSwtKrB6FkRQ Aug 31 15:52:49.608389 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:52:49.608389 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:52:49.608389 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:52:49.608389 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:52:49.608389 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:52:49.608389 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:52:49.608389 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 7db749eb0a764fa0bb29ddc4abd6d245 Aug 31 15:52:49.608389 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersOnMultiNodesTest-1874033872 Aug 31 15:52:49.608389 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:52:49.608389 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:52:49.609911 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7db749eb0a764fa0bb29ddc4abd6d245"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7db749eb0a764fa0bb29ddc4abd6d245"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7db749eb0a764fa0bb29ddc4abd6d245"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7db749eb0a764fa0bb29ddc4abd6d245", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:52:49.609911 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServersOnMultiNodesTest-1874033872 Aug 31 15:52:49.609911 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 7db749eb0a764fa0bb29ddc4abd6d245 Aug 31 15:52:49.609911 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1874033872 Aug 31 15:52:49.609911 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServersOnMultiNodesTest-1874033872-project Aug 31 15:52:49.609911 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:52:49.609911 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:52:49.609911 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: fe647be03cef4e9c86b4fd6e703d0de1 Aug 31 15:52:49.609911 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServersOnMultiNodesTest-1874033872-project Aug 31 15:52:49.609911 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 15:52:49.609911 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance d15c3817-84b0-4e82-86b2-f2333ceeb3cd could not be found. Aug 31 15:52:49.609911 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'd15c3817-84b0-4e82-86b2-f2333ceeb3cd'} Aug 31 15:52:49.610756 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:52:49.610756 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:49.610756 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:52:49.610756 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:52:49.610756 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:52:49.610756 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:52:49.610756 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:52:49.610756 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:52:49.610756 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:52:49.610756 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:52:49.610756 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d15c3817-84b0-4e82-86b2-f2333ceeb3cd could not be found. Aug 31 15:52:49.610756 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:52:49.610756 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:52:49.610756 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:52:49.610756 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:49.610756 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:52:49.610756 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:52:49.610756 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:52:49.610756 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:52:49.610756 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:52:49.611979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:52:49.611979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:52:49.611979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:52:49.611979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:52:49.611979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:52:49.611979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:52:49.611979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:52:49.611979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d15c3817-84b0-4e82-86b2-f2333ceeb3cd could not be found. Aug 31 15:52:49.611979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:52:49.611979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:52:49.611979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:52:49.611979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:49.611979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:52:49.611979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:52:49.611979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:52:49.611979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:52:49.611979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d15c3817-84b0-4e82-86b2-f2333ceeb3cd could not be found. Aug 31 15:52:49.611979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:52:49.615803 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1008b062-9e40-47b5-ba74-4c5036a9d77c tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Returning 404 to user: Instance d15c3817-84b0-4e82-86b2-f2333ceeb3cd could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:52:49.616673 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1008b062-9e40-47b5-ba74-4c5036a9d77c tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/d15c3817-84b0-4e82-86b2-f2333ceeb3cd" status: 404 len: 111 microversion: 2.1 time: 0.044152 Aug 31 15:52:49.620437 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 509/1036] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:49 2022] GET /compute/v2.1/servers/d15c3817-84b0-4e82-86b2-f2333ceeb3cd => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:52:49.623962 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ec859702-1e7c-4858-acc3-969aae1dcc0f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:49.626245 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3f84d008-7400-47f9-8301-31b846a41be1 tempest-ImagesDeleteNegativeTestJSON-300093117 tempest-ImagesDeleteNegativeTestJSON-300093117-project] Calling method '.version_select at 0x7fbb46888310>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:49.636215 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ec859702-1e7c-4858-acc3-969aae1dcc0f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63" status: 200 len: 1475 microversion: 2.1 time: 0.596324 Aug 31 15:52:49.636824 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 528/1037] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:49 2022] GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63 => generated 1475 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:49.641852 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-355c3aa7-20ca-45b4-9b1f-4c7e03b20456 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:49.643358 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-355c3aa7-20ca-45b4-9b1f-4c7e03b20456 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] [instance: ec8bbe5f-2c2c-41b8-bfed-711906394506] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:49.652199 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-3f84d008-7400-47f9-8301-31b846a41be1 tempest-ImagesDeleteNegativeTestJSON-300093117 tempest-ImagesDeleteNegativeTestJSON-300093117-project] HTTP exception thrown: Image not found. Aug 31 15:52:49.652352 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-355c3aa7-20ca-45b4-9b1f-4c7e03b20456 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:49.652809 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-355c3aa7-20ca-45b4-9b1f-4c7e03b20456 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:49.653266 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-355c3aa7-20ca-45b4-9b1f-4c7e03b20456 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:49.654173 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-355c3aa7-20ca-45b4-9b1f-4c7e03b20456 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:49.654754 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-355c3aa7-20ca-45b4-9b1f-4c7e03b20456 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:49.655179 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-355c3aa7-20ca-45b4-9b1f-4c7e03b20456 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:49.656427 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3f84d008-7400-47f9-8301-31b846a41be1 tempest-ImagesDeleteNegativeTestJSON-300093117 tempest-ImagesDeleteNegativeTestJSON-300093117-project] Request method failure captured: Aug 31 15:52:49.656427 n-d-833090-16 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/images/tempest-invalid-1749853962 HTTP/1.1 Aug 31 15:52:49.656427 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:52:49.656427 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:52:49.656427 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:52:49.656427 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:52:49.656427 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:52:49.656427 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:52:49.656427 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:52:49.656427 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:52:49.656427 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4PQRzDpwqG-CPWfTs7EO18pv7yLOEuUUHG8sVkP2S5fbuARjj1Gj8Mza1ndosNh3KlXXVRCCNba_l2sDTDIrY9HtRkQvC37pha_wHRo5tpjDaADCvF0-j3AtiXKy6e6z0r275Ftw2nr-ldm24wqhPuSSGALn2J9ddQxPdpxy3NrpD8 Aug 31 15:52:49.656427 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:52:49.656427 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:52:49.656427 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:52:49.656427 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:52:49.656427 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:52:49.656427 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:52:49.656427 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: f207eef5bb904deabc9de40803025011 Aug 31 15:52:49.656427 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-300093117 Aug 31 15:52:49.656427 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:52:49.656427 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:52:49.657725 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f207eef5bb904deabc9de40803025011"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f207eef5bb904deabc9de40803025011"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f207eef5bb904deabc9de40803025011"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f207eef5bb904deabc9de40803025011", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:52:49.657725 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-300093117 Aug 31 15:52:49.657725 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: f207eef5bb904deabc9de40803025011 Aug 31 15:52:49.657725 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-300093117 Aug 31 15:52:49.657725 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ImagesDeleteNegativeTestJSON-300093117-project Aug 31 15:52:49.657725 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:52:49.657725 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:52:49.657725 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: fccb09da90a844ac98a04ba0c00b0437 Aug 31 15:52:49.657725 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-300093117-project Aug 31 15:52:49.657725 n-d-833090-16 devstack@n-api.service[128863]: method: Aug 31 15:52:49.657725 n-d-833090-16 devstack@n-api.service[128863]: exception: Image not found. Aug 31 15:52:49.657725 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'tempest-invalid-1749853962'} Aug 31 15:52:49.657725 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:52:49.658748 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:49.658748 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 31 15:52:49.658748 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 31 15:52:49.658748 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 15:52:49.658748 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 15:52:49.658748 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 15:52:49.658748 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 15:52:49.658748 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 31 15:52:49.658748 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 31 15:52:49.658748 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 31 15:52:49.658748 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 31 15:52:49.658748 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 15:52:49.658748 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 15:52:49.658748 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 15:52:49.658748 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 15:52:49.658748 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1749853962 to delete Aug 31 15:52:49.658748 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:52:49.658748 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:52:49.658748 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:52:49.661133 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:49.661133 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 31 15:52:49.661133 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 31 15:52:49.661133 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 31 15:52:49.661133 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 31 15:52:49.661133 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 31 15:52:49.661133 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 31 15:52:49.661133 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1749853962 could not be found. Aug 31 15:52:49.661133 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:52:49.661133 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:52:49.661133 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:52:49.661133 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:49.661133 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:52:49.661133 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:52:49.661133 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:52:49.661133 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:52:49.661133 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:52:49.661133 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:52:49.661133 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:52:49.661133 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:52:49.662501 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 31 15:52:49.662501 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 31 15:52:49.662501 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 31 15:52:49.662501 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:52:49.662501 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:52:49.662501 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:52:49.662501 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:49.662501 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:52:49.662501 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:52:49.662501 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:52:49.662501 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:52:49.662501 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 31 15:52:49.662501 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:52:49.662501 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3f84d008-7400-47f9-8301-31b846a41be1 tempest-ImagesDeleteNegativeTestJSON-300093117 tempest-ImagesDeleteNegativeTestJSON-300093117-project] Returning 404 to user: Image not found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:52:49.662501 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3f84d008-7400-47f9-8301-31b846a41be1 tempest-ImagesDeleteNegativeTestJSON-300093117 tempest-ImagesDeleteNegativeTestJSON-300093117-project] 10.222.0.50 "DELETE /compute/v2.1/images/tempest-invalid-1749853962" status: 404 len: 62 microversion: 2.1 time: 0.039230 Aug 31 15:52:49.663497 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 510/1038] 10.222.0.50 () {58 vars in 1206 bytes} [Wed Aug 31 15:52:49 2022] DELETE /compute/v2.1/images/tempest-invalid-1749853962 => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 15:52:49.665967 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7b6ad723-c7db-4850-8a1a-b02b735bdaea tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:49.709203 n-d-833090-16 devstack@n-api.service[128863]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7b6ad723-c7db-4850-8a1a-b02b735bdaea tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [20597d35-4b4e-4ea0-93ee-0a08dc793a48] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 15:52:49.800791 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-355c3aa7-20ca-45b4-9b1f-4c7e03b20456 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:49.810919 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-355c3aa7-20ca-45b4-9b1f-4c7e03b20456 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:49.813222 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-355c3aa7-20ca-45b4-9b1f-4c7e03b20456 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:49.814651 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-355c3aa7-20ca-45b4-9b1f-4c7e03b20456 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] 10.222.0.50 "GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506" status: 200 len: 1335 microversion: 2.54 time: 0.176702 Aug 31 15:52:49.815768 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 529/1039] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:52:49 2022] GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506 => generated 1335 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:52:49.830363 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3dfc208c-fcf2-4d0b-bb14-10667761db9b tempest-ImagesDeleteNegativeTestJSON-300093117 tempest-ImagesDeleteNegativeTestJSON-300093117-project] Calling method '.version_select at 0x7fbb46800670>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:49.857807 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-3dfc208c-fcf2-4d0b-bb14-10667761db9b tempest-ImagesDeleteNegativeTestJSON-300093117 tempest-ImagesDeleteNegativeTestJSON-300093117-project] HTTP exception thrown: Image not found. Aug 31 15:52:49.859862 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3dfc208c-fcf2-4d0b-bb14-10667761db9b tempest-ImagesDeleteNegativeTestJSON-300093117 tempest-ImagesDeleteNegativeTestJSON-300093117-project] Request method failure captured: Aug 31 15:52:49.859862 n-d-833090-16 devstack@n-api.service[128864]: request: DELETE /compute/v2.1/images/3594aa22-fa2c-44d9-b18b-768d960b4d34 HTTP/1.1 Aug 31 15:52:49.859862 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:52:49.859862 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:52:49.859862 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:52:49.859862 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:52:49.859862 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:52:49.859862 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:52:49.859862 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:52:49.859862 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:52:49.859862 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4PQRzDpwqG-CPWfTs7EO18pv7yLOEuUUHG8sVkP2S5fbuARjj1Gj8Mza1ndosNh3KlXXVRCCNba_l2sDTDIrY9HtRkQvC37pha_wHRo5tpjDaADCvF0-j3AtiXKy6e6z0r275Ftw2nr-ldm24wqhPuSSGALn2J9ddQxPdpxy3NrpD8 Aug 31 15:52:49.859862 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:52:49.859862 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:52:49.859862 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:52:49.859862 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:52:49.859862 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:52:49.859862 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:52:49.859862 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: f207eef5bb904deabc9de40803025011 Aug 31 15:52:49.859862 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-300093117 Aug 31 15:52:49.859862 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:52:49.859862 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:52:49.861201 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f207eef5bb904deabc9de40803025011"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f207eef5bb904deabc9de40803025011"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f207eef5bb904deabc9de40803025011"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f207eef5bb904deabc9de40803025011", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:52:49.861201 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-300093117 Aug 31 15:52:49.861201 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: f207eef5bb904deabc9de40803025011 Aug 31 15:52:49.861201 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-300093117 Aug 31 15:52:49.861201 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ImagesDeleteNegativeTestJSON-300093117-project Aug 31 15:52:49.861201 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:52:49.861201 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:52:49.861201 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: fccb09da90a844ac98a04ba0c00b0437 Aug 31 15:52:49.861201 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-300093117-project Aug 31 15:52:49.861201 n-d-833090-16 devstack@n-api.service[128864]: method: Aug 31 15:52:49.861201 n-d-833090-16 devstack@n-api.service[128864]: exception: Image not found. Aug 31 15:52:49.861201 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '3594aa22-fa2c-44d9-b18b-768d960b4d34'} Aug 31 15:52:49.861201 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:52:49.862008 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:49.862008 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 31 15:52:49.862008 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 31 15:52:49.862008 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 15:52:49.862008 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 15:52:49.862008 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 15:52:49.862008 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 15:52:49.862008 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 31 15:52:49.862008 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 31 15:52:49.862008 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 31 15:52:49.862008 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 31 15:52:49.862008 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 15:52:49.862008 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 15:52:49.862008 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 15:52:49.862008 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 15:52:49.862008 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 3594aa22-fa2c-44d9-b18b-768d960b4d34 to delete Aug 31 15:52:49.862008 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:49.862008 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:52:49.862008 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:49.863226 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:49.863226 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 31 15:52:49.863226 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 31 15:52:49.863226 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 31 15:52:49.863226 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 31 15:52:49.863226 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 31 15:52:49.863226 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 31 15:52:49.863226 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3594aa22-fa2c-44d9-b18b-768d960b4d34 could not be found. Aug 31 15:52:49.863226 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:49.863226 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:52:49.863226 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:49.863226 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:49.863226 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:52:49.863226 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:52:49.863226 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:52:49.863226 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:52:49.863226 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:52:49.863226 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:52:49.863226 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:52:49.863226 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:52:49.865898 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 31 15:52:49.865898 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 31 15:52:49.865898 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 31 15:52:49.865898 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:49.865898 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:52:49.865898 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:49.865898 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:49.865898 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:52:49.865898 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:52:49.865898 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:52:49.865898 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:52:49.865898 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 31 15:52:49.865898 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:49.869338 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3dfc208c-fcf2-4d0b-bb14-10667761db9b tempest-ImagesDeleteNegativeTestJSON-300093117 tempest-ImagesDeleteNegativeTestJSON-300093117-project] Returning 404 to user: Image not found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:52:49.870446 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3dfc208c-fcf2-4d0b-bb14-10667761db9b tempest-ImagesDeleteNegativeTestJSON-300093117 tempest-ImagesDeleteNegativeTestJSON-300093117-project] 10.222.0.50 "DELETE /compute/v2.1/images/3594aa22-fa2c-44d9-b18b-768d960b4d34" status: 404 len: 62 microversion: 2.1 time: 0.053308 Aug 31 15:52:49.871547 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 530/1040] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:49 2022] DELETE /compute/v2.1/images/3594aa22-fa2c-44d9-b18b-768d960b4d34 => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 15:52:49.876532 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b0f2f502-a4ca-4b3c-a106-73040a8e8493 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:49.878009 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b0f2f502-a4ca-4b3c-a106-73040a8e8493 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: c76166e9-e2cf-4253-99e2-3f8d919099ba] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:49.887124 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b0f2f502-a4ca-4b3c-a106-73040a8e8493 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:49.887983 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b0f2f502-a4ca-4b3c-a106-73040a8e8493 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:49.889112 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b0f2f502-a4ca-4b3c-a106-73040a8e8493 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:49.890047 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b0f2f502-a4ca-4b3c-a106-73040a8e8493 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:49.890752 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b0f2f502-a4ca-4b3c-a106-73040a8e8493 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:49.891385 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b0f2f502-a4ca-4b3c-a106-73040a8e8493 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:50.177040 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b0f2f502-a4ca-4b3c-a106-73040a8e8493 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6349b0ee9e2142a8a440d4e6ae0703a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33f8cd7d4424157b410b64c7823f480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:50.180785 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:52:50.187005 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b0f2f502-a4ca-4b3c-a106-73040a8e8493 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "GET /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba" status: 200 len: 1390 microversion: 2.1 time: 0.314093 Aug 31 15:52:50.191095 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 531/1041] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:49 2022] GET /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba => generated 1390 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:50.200355 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-fea6b1d3-79f6-4fec-88a7-275b4aaceadd req-0b076a96-0da6-4db2-9439-285e1d4e589e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d15c3817-84b0-4e82-86b2-f2333ceeb3cd", "name": "network-vif-deleted", "tag": "ee06d5e0-f1bc-4c73-8b29-4e8c0b5df323"}, {"name": "network-changed", "server_uuid": "8a25dea8-1dc1-480e-a431-13d2f2270d0a", "tag": "be9ab567-195e-4d60-b1e4-2ba6690fe483"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:52:50.225404 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-fea6b1d3-79f6-4fec-88a7-275b4aaceadd req-0b076a96-0da6-4db2-9439-285e1d4e589e service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:50.238974 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-fea6b1d3-79f6-4fec-88a7-275b4aaceadd req-0b076a96-0da6-4db2-9439-285e1d4e589e service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:50.239583 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-fea6b1d3-79f6-4fec-88a7-275b4aaceadd req-0b076a96-0da6-4db2-9439-285e1d4e589e service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:50.254118 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-fea6b1d3-79f6-4fec-88a7-275b4aaceadd req-0b076a96-0da6-4db2-9439-285e1d4e589e service nova] Creating event network-vif-deleted:ee06d5e0-f1bc-4c73-8b29-4e8c0b5df323 for instance d15c3817-84b0-4e82-86b2-f2333ceeb3cd on n-h2-833090-16 Aug 31 15:52:50.261187 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-fea6b1d3-79f6-4fec-88a7-275b4aaceadd req-0b076a96-0da6-4db2-9439-285e1d4e589e service nova] Creating event network-changed:be9ab567-195e-4d60-b1e4-2ba6690fe483 for instance 8a25dea8-1dc1-480e-a431-13d2f2270d0a on n-h2-833090-16 Aug 31 15:52:50.272382 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-fea6b1d3-79f6-4fec-88a7-275b4aaceadd req-0b076a96-0da6-4db2-9439-285e1d4e589e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.077976 Aug 31 15:52:50.277712 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 532/1042] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:52:50.398487 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-37e3b87e-2d25-4d85-97c7-94f77295fb9c req-730391bb-009f-4b9e-a0c3-452b9df9d6b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a90bb0c5-7d56-4e38-8d78-a5c92a9976c3", "tag": "88614c31-a522-4542-ad79-12f8e6e4844c"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:52:50.409574 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-37e3b87e-2d25-4d85-97c7-94f77295fb9c req-730391bb-009f-4b9e-a0c3-452b9df9d6b7 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:50.410056 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-37e3b87e-2d25-4d85-97c7-94f77295fb9c req-730391bb-009f-4b9e-a0c3-452b9df9d6b7 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:50.410547 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-37e3b87e-2d25-4d85-97c7-94f77295fb9c req-730391bb-009f-4b9e-a0c3-452b9df9d6b7 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:50.424049 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-37e3b87e-2d25-4d85-97c7-94f77295fb9c req-730391bb-009f-4b9e-a0c3-452b9df9d6b7 service nova] Creating event network-changed:88614c31-a522-4542-ad79-12f8e6e4844c for instance a90bb0c5-7d56-4e38-8d78-a5c92a9976c3 on n-h1-833090-16 Aug 31 15:52:50.430771 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-37e3b87e-2d25-4d85-97c7-94f77295fb9c req-730391bb-009f-4b9e-a0c3-452b9df9d6b7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036839 Aug 31 15:52:50.435471 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 533/1043] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:52:50.559721 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1527a1b5-d4c4-4977-a23c-a3671d1e3296 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:50.560448 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1527a1b5-d4c4-4977-a23c-a3671d1e3296 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:50.566559 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:52:50.568510 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1527a1b5-d4c4-4977-a23c-a3671d1e3296 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:50.569154 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1527a1b5-d4c4-4977-a23c-a3671d1e3296 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:50.569745 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1527a1b5-d4c4-4977-a23c-a3671d1e3296 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:50.570703 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1527a1b5-d4c4-4977-a23c-a3671d1e3296 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:50.571563 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1527a1b5-d4c4-4977-a23c-a3671d1e3296 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:50.572174 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1527a1b5-d4c4-4977-a23c-a3671d1e3296 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:50.716141 n-d-833090-16 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [None req-7b6ad723-c7db-4850-8a1a-b02b735bdaea tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [20597d35-4b4e-4ea0-93ee-0a08dc793a48] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 45718. Aug 31 15:52:50.721496 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7b6ad723-c7db-4850-8a1a-b02b735bdaea tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/a8426721-d328-4b9e-a0a2-d354113b5300" status: 204 len: 0 microversion: 2.1 time: 1.060552 Aug 31 15:52:50.722325 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 511/1044] 10.222.0.50 () {58 vars in 1266 bytes} [Wed Aug 31 15:52:49 2022] DELETE /compute/v2.1/os-server-groups/a8426721-d328-4b9e-a0a2-d354113b5300 => generated 0 bytes in 1062 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:52:50.731532 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-271decf9-1164-40b0-a2d8-0a905c1d0efe tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:50.733586 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-271decf9-1164-40b0-a2d8-0a905c1d0efe tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 236954ea-2791-477d-a92b-88e590593c63] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:50.752122 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-271decf9-1164-40b0-a2d8-0a905c1d0efe tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:50.763354 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-271decf9-1164-40b0-a2d8-0a905c1d0efe tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:50.764180 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-271decf9-1164-40b0-a2d8-0a905c1d0efe tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:50.765620 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-271decf9-1164-40b0-a2d8-0a905c1d0efe tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:50.766646 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-271decf9-1164-40b0-a2d8-0a905c1d0efe tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:50.767342 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-271decf9-1164-40b0-a2d8-0a905c1d0efe tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:51.356717 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1527a1b5-d4c4-4977-a23c-a3671d1e3296 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:51.399603 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1527a1b5-d4c4-4977-a23c-a3671d1e3296 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:51.415031 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1527a1b5-d4c4-4977-a23c-a3671d1e3296 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:51.417388 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1527a1b5-d4c4-4977-a23c-a3671d1e3296 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a" status: 200 len: 1411 microversion: 2.25 time: 0.861965 Aug 31 15:52:51.421994 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 534/1045] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:52:50 2022] GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a => generated 1411 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 15:52:51.433569 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5b1503f6-2101-44e6-b8aa-1f532a80a886 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:51.435051 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5b1503f6-2101-44e6-b8aa-1f532a80a886 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 269c2cc1-ce8d-41bc-bf54-90f0c37642a2] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:51.548338 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5b1503f6-2101-44e6-b8aa-1f532a80a886 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:51.551290 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5b1503f6-2101-44e6-b8aa-1f532a80a886 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:51.559243 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5b1503f6-2101-44e6-b8aa-1f532a80a886 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:51.561310 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5b1503f6-2101-44e6-b8aa-1f532a80a886 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:51.563574 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5b1503f6-2101-44e6-b8aa-1f532a80a886 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:51.570379 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5b1503f6-2101-44e6-b8aa-1f532a80a886 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:51.656418 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-271decf9-1164-40b0-a2d8-0a905c1d0efe tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:51.666731 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-271decf9-1164-40b0-a2d8-0a905c1d0efe tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63" status: 200 len: 1475 microversion: 2.1 time: 0.939456 Aug 31 15:52:51.671730 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5b1503f6-2101-44e6-b8aa-1f532a80a886 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 269c2cc1-ce8d-41bc-bf54-90f0c37642a2] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:52:51.674139 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 512/1046] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:50 2022] GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63 => generated 1475 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:51.688134 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-39c67f93-04ba-4b98-984d-57ac62342890 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:51.692558 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-39c67f93-04ba-4b98-984d-57ac62342890 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] [instance: ec8bbe5f-2c2c-41b8-bfed-711906394506] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:51.720125 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39c67f93-04ba-4b98-984d-57ac62342890 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:51.721806 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39c67f93-04ba-4b98-984d-57ac62342890 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:51.725954 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39c67f93-04ba-4b98-984d-57ac62342890 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:51.726748 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39c67f93-04ba-4b98-984d-57ac62342890 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:51.727221 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39c67f93-04ba-4b98-984d-57ac62342890 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:51.730555 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39c67f93-04ba-4b98-984d-57ac62342890 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:51.852554 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5b1503f6-2101-44e6-b8aa-1f532a80a886 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "DELETE /compute/v2.1/servers/269c2cc1-ce8d-41bc-bf54-90f0c37642a2" status: 204 len: 0 microversion: 2.1 time: 0.428100 Aug 31 15:52:51.853904 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 535/1047] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:52:51 2022] DELETE /compute/v2.1/servers/269c2cc1-ce8d-41bc-bf54-90f0c37642a2 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:52:51.864910 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-260f1c0b-57af-47a8-9af2-a495f1dd2043 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:51.869721 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-260f1c0b-57af-47a8-9af2-a495f1dd2043 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: c76166e9-e2cf-4253-99e2-3f8d919099ba] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:51.881839 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-260f1c0b-57af-47a8-9af2-a495f1dd2043 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:51.886779 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-260f1c0b-57af-47a8-9af2-a495f1dd2043 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:51.887397 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-260f1c0b-57af-47a8-9af2-a495f1dd2043 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:51.888245 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-260f1c0b-57af-47a8-9af2-a495f1dd2043 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:51.888838 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-260f1c0b-57af-47a8-9af2-a495f1dd2043 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:51.889364 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-260f1c0b-57af-47a8-9af2-a495f1dd2043 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:51.965158 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-39c67f93-04ba-4b98-984d-57ac62342890 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:51.978946 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-39c67f93-04ba-4b98-984d-57ac62342890 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:51.980938 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-39c67f93-04ba-4b98-984d-57ac62342890 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:51.983742 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-39c67f93-04ba-4b98-984d-57ac62342890 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] 10.222.0.50 "GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506" status: 200 len: 1335 microversion: 2.54 time: 0.308235 Aug 31 15:52:51.985161 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 513/1048] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:52:51 2022] GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506 => generated 1335 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:52:51.990068 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e2f1501e-6f6d-449f-a13e-42ad871fb237 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:51.992378 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e2f1501e-6f6d-449f-a13e-42ad871fb237 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: c3ca0ff6-8f52-4ac3-8706-f5efab49a099] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:52.001511 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2f1501e-6f6d-449f-a13e-42ad871fb237 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:52.003109 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2f1501e-6f6d-449f-a13e-42ad871fb237 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:52.006215 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2f1501e-6f6d-449f-a13e-42ad871fb237 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:52.007193 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2f1501e-6f6d-449f-a13e-42ad871fb237 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:52.007827 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2f1501e-6f6d-449f-a13e-42ad871fb237 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:52.008411 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2f1501e-6f6d-449f-a13e-42ad871fb237 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:52.055620 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e2f1501e-6f6d-449f-a13e-42ad871fb237 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: c3ca0ff6-8f52-4ac3-8706-f5efab49a099] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:52:52.141970 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:52:52.156547 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-260f1c0b-57af-47a8-9af2-a495f1dd2043 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6349b0ee9e2142a8a440d4e6ae0703a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33f8cd7d4424157b410b64c7823f480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:52.167509 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-260f1c0b-57af-47a8-9af2-a495f1dd2043 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "GET /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba" status: 200 len: 1390 microversion: 2.1 time: 0.311288 Aug 31 15:52:52.170209 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 536/1049] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:51 2022] GET /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba => generated 1390 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:52.233562 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e2f1501e-6f6d-449f-a13e-42ad871fb237 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "DELETE /compute/v2.1/servers/c3ca0ff6-8f52-4ac3-8706-f5efab49a099" status: 204 len: 0 microversion: 2.1 time: 0.246829 Aug 31 15:52:52.235990 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 514/1050] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:52:51 2022] DELETE /compute/v2.1/servers/c3ca0ff6-8f52-4ac3-8706-f5efab49a099 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:52:52.245231 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5434ca8a-4a58-4217-a0bd-33b5e0c3c1d1 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:52.246327 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5434ca8a-4a58-4217-a0bd-33b5e0c3c1d1 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 269c2cc1-ce8d-41bc-bf54-90f0c37642a2] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:52.261681 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5434ca8a-4a58-4217-a0bd-33b5e0c3c1d1 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:52.262546 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5434ca8a-4a58-4217-a0bd-33b5e0c3c1d1 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:52.264639 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5434ca8a-4a58-4217-a0bd-33b5e0c3c1d1 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:52.265566 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5434ca8a-4a58-4217-a0bd-33b5e0c3c1d1 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:52.266607 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5434ca8a-4a58-4217-a0bd-33b5e0c3c1d1 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:52.266958 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5434ca8a-4a58-4217-a0bd-33b5e0c3c1d1 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:52.443633 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f773dae3-7b0d-49b4-aef6-8b10258b969b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:52.444395 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f773dae3-7b0d-49b4-aef6-8b10258b969b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:52.453369 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f773dae3-7b0d-49b4-aef6-8b10258b969b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:52.453933 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f773dae3-7b0d-49b4-aef6-8b10258b969b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:52.454355 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f773dae3-7b0d-49b4-aef6-8b10258b969b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:52.455260 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f773dae3-7b0d-49b4-aef6-8b10258b969b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:52.455713 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f773dae3-7b0d-49b4-aef6-8b10258b969b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:52.456134 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f773dae3-7b0d-49b4-aef6-8b10258b969b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:52.495707 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5434ca8a-4a58-4217-a0bd-33b5e0c3c1d1 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:52.509443 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5434ca8a-4a58-4217-a0bd-33b5e0c3c1d1 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/269c2cc1-ce8d-41bc-bf54-90f0c37642a2" status: 200 len: 1473 microversion: 2.1 time: 0.269022 Aug 31 15:52:52.510048 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 537/1051] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:52 2022] GET /compute/v2.1/servers/269c2cc1-ce8d-41bc-bf54-90f0c37642a2 => generated 1473 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:52.694803 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f773dae3-7b0d-49b4-aef6-8b10258b969b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:52.701148 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6f46ab84-5e58-42bf-80f3-b83780a799a2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:52.701994 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6f46ab84-5e58-42bf-80f3-b83780a799a2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 236954ea-2791-477d-a92b-88e590593c63] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:52.709212 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f46ab84-5e58-42bf-80f3-b83780a799a2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:52.710518 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f46ab84-5e58-42bf-80f3-b83780a799a2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:52.711126 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f46ab84-5e58-42bf-80f3-b83780a799a2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:52.711995 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f46ab84-5e58-42bf-80f3-b83780a799a2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:52.712438 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f46ab84-5e58-42bf-80f3-b83780a799a2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:52.712655 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f773dae3-7b0d-49b4-aef6-8b10258b969b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:52.713202 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f46ab84-5e58-42bf-80f3-b83780a799a2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:52.714938 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f773dae3-7b0d-49b4-aef6-8b10258b969b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:52.725156 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f773dae3-7b0d-49b4-aef6-8b10258b969b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a" status: 200 len: 1411 microversion: 2.25 time: 0.280957 Aug 31 15:52:52.740627 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 515/1052] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:52:52 2022] GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a => generated 1411 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:52:52.889624 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6f46ab84-5e58-42bf-80f3-b83780a799a2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:52.908320 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6f46ab84-5e58-42bf-80f3-b83780a799a2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63" status: 200 len: 1473 microversion: 2.1 time: 0.216723 Aug 31 15:52:52.925429 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 538/1053] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:52 2022] GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63 => generated 1473 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:52:52.940474 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dd34e029-5dbc-4853-a179-47f75a2fac2d tempest-AbsoluteLimitsTestJSON-898355896 tempest-AbsoluteLimitsTestJSON-898355896-project] Calling method '.version_select at 0x7fbb46672c10>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:52.967608 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd34e029-5dbc-4853-a179-47f75a2fac2d tempest-AbsoluteLimitsTestJSON-898355896 tempest-AbsoluteLimitsTestJSON-898355896-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:52.968439 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd34e029-5dbc-4853-a179-47f75a2fac2d tempest-AbsoluteLimitsTestJSON-898355896 tempest-AbsoluteLimitsTestJSON-898355896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:52.968979 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd34e029-5dbc-4853-a179-47f75a2fac2d tempest-AbsoluteLimitsTestJSON-898355896 tempest-AbsoluteLimitsTestJSON-898355896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:52.970145 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd34e029-5dbc-4853-a179-47f75a2fac2d tempest-AbsoluteLimitsTestJSON-898355896 tempest-AbsoluteLimitsTestJSON-898355896-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:52.970797 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd34e029-5dbc-4853-a179-47f75a2fac2d tempest-AbsoluteLimitsTestJSON-898355896 tempest-AbsoluteLimitsTestJSON-898355896-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:52.971316 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd34e029-5dbc-4853-a179-47f75a2fac2d tempest-AbsoluteLimitsTestJSON-898355896 tempest-AbsoluteLimitsTestJSON-898355896-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:52.998808 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dd34e029-5dbc-4853-a179-47f75a2fac2d tempest-AbsoluteLimitsTestJSON-898355896 tempest-AbsoluteLimitsTestJSON-898355896-project] 10.222.0.50 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.216356 Aug 31 15:52:53.008677 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 516/1054] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 15:52:52 2022] GET /compute/v2.1/limits => generated 511 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:52:53.014529 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-303c2c05-1885-4300-830f-40bfbe8b7b46 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:53.015184 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-303c2c05-1885-4300-830f-40bfbe8b7b46 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] [instance: ec8bbe5f-2c2c-41b8-bfed-711906394506] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:53.023717 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-303c2c05-1885-4300-830f-40bfbe8b7b46 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:53.025772 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-303c2c05-1885-4300-830f-40bfbe8b7b46 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:53.026257 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-303c2c05-1885-4300-830f-40bfbe8b7b46 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:53.026987 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-303c2c05-1885-4300-830f-40bfbe8b7b46 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:53.028336 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-303c2c05-1885-4300-830f-40bfbe8b7b46 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:53.028775 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-303c2c05-1885-4300-830f-40bfbe8b7b46 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:53.111375 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-303c2c05-1885-4300-830f-40bfbe8b7b46 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:53.121914 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-303c2c05-1885-4300-830f-40bfbe8b7b46 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:53.123422 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-303c2c05-1885-4300-830f-40bfbe8b7b46 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:53.124604 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-303c2c05-1885-4300-830f-40bfbe8b7b46 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] 10.222.0.50 "GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506" status: 200 len: 1335 microversion: 2.54 time: 0.114059 Aug 31 15:52:53.138130 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 539/1055] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:52:53 2022] GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506 => generated 1335 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:52:53.190570 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-063e5e4e-bed1-4527-bfc8-bf543a6503e7 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:53.191195 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-063e5e4e-bed1-4527-bfc8-bf543a6503e7 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: c76166e9-e2cf-4253-99e2-3f8d919099ba] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:53.203921 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-063e5e4e-bed1-4527-bfc8-bf543a6503e7 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:53.204723 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-063e5e4e-bed1-4527-bfc8-bf543a6503e7 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:53.205164 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-063e5e4e-bed1-4527-bfc8-bf543a6503e7 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:53.205935 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-063e5e4e-bed1-4527-bfc8-bf543a6503e7 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:53.206445 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-063e5e4e-bed1-4527-bfc8-bf543a6503e7 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:53.218558 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-063e5e4e-bed1-4527-bfc8-bf543a6503e7 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:53.442655 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-063e5e4e-bed1-4527-bfc8-bf543a6503e7 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6349b0ee9e2142a8a440d4e6ae0703a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33f8cd7d4424157b410b64c7823f480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:53.462153 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-063e5e4e-bed1-4527-bfc8-bf543a6503e7 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "GET /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba" status: 200 len: 1390 microversion: 2.1 time: 0.275491 Aug 31 15:52:53.462770 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 517/1056] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:53 2022] GET /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba => generated 1390 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:53.533085 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-125c356d-1720-4611-bbd3-e3a7faa51432 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:53.533917 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-125c356d-1720-4611-bbd3-e3a7faa51432 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 269c2cc1-ce8d-41bc-bf54-90f0c37642a2] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:53.560344 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-125c356d-1720-4611-bbd3-e3a7faa51432 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:53.565402 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-125c356d-1720-4611-bbd3-e3a7faa51432 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:53.567830 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-125c356d-1720-4611-bbd3-e3a7faa51432 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:53.570078 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-125c356d-1720-4611-bbd3-e3a7faa51432 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:53.571212 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-125c356d-1720-4611-bbd3-e3a7faa51432 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:53.571651 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-125c356d-1720-4611-bbd3-e3a7faa51432 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:53.752256 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-34beb792-8b32-45b4-97e7-4d06cbf9a34b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:53.752908 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-34beb792-8b32-45b4-97e7-4d06cbf9a34b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:53.767651 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-34beb792-8b32-45b4-97e7-4d06cbf9a34b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:53.769648 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-34beb792-8b32-45b4-97e7-4d06cbf9a34b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:53.771002 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-34beb792-8b32-45b4-97e7-4d06cbf9a34b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:53.772585 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-34beb792-8b32-45b4-97e7-4d06cbf9a34b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:53.773237 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-34beb792-8b32-45b4-97e7-4d06cbf9a34b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:53.774431 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-34beb792-8b32-45b4-97e7-4d06cbf9a34b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:53.821675 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-125c356d-1720-4611-bbd3-e3a7faa51432 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:53.830979 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-125c356d-1720-4611-bbd3-e3a7faa51432 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/269c2cc1-ce8d-41bc-bf54-90f0c37642a2" status: 200 len: 1473 microversion: 2.1 time: 0.302222 Aug 31 15:52:53.831659 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 540/1057] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:53 2022] GET /compute/v2.1/servers/269c2cc1-ce8d-41bc-bf54-90f0c37642a2 => generated 1473 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:53.924873 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-cbcfed1b-c852-4c0f-b0f5-48b8a6edcb07 req-9e5d003b-3ea1-4f64-b459-a336fc77fc3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c76166e9-e2cf-4253-99e2-3f8d919099ba", "tag": "3e098f5c-9a2b-4fa2-8406-5975188f6f3a"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:52:53.949767 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-cbcfed1b-c852-4c0f-b0f5-48b8a6edcb07 req-9e5d003b-3ea1-4f64-b459-a336fc77fc3a service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:53.950293 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-cbcfed1b-c852-4c0f-b0f5-48b8a6edcb07 req-9e5d003b-3ea1-4f64-b459-a336fc77fc3a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:53.950728 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-cbcfed1b-c852-4c0f-b0f5-48b8a6edcb07 req-9e5d003b-3ea1-4f64-b459-a336fc77fc3a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:53.969066 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-cbcfed1b-c852-4c0f-b0f5-48b8a6edcb07 req-9e5d003b-3ea1-4f64-b459-a336fc77fc3a service nova] Creating event network-changed:3e098f5c-9a2b-4fa2-8406-5975188f6f3a for instance c76166e9-e2cf-4253-99e2-3f8d919099ba on n-h2-833090-16 Aug 31 15:52:53.976024 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-cbcfed1b-c852-4c0f-b0f5-48b8a6edcb07 req-9e5d003b-3ea1-4f64-b459-a336fc77fc3a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058368 Aug 31 15:52:53.977463 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 541/1058] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:52:53.986878 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c2ccdf7d-cf2b-4ee8-8bd6-9511d171d618 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:53.988009 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c2ccdf7d-cf2b-4ee8-8bd6-9511d171d618 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 236954ea-2791-477d-a92b-88e590593c63] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:53.994610 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:52:54.002312 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c2ccdf7d-cf2b-4ee8-8bd6-9511d171d618 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:54.003036 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c2ccdf7d-cf2b-4ee8-8bd6-9511d171d618 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:54.003655 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c2ccdf7d-cf2b-4ee8-8bd6-9511d171d618 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:54.004703 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c2ccdf7d-cf2b-4ee8-8bd6-9511d171d618 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:54.005121 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c2ccdf7d-cf2b-4ee8-8bd6-9511d171d618 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:54.005695 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c2ccdf7d-cf2b-4ee8-8bd6-9511d171d618 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:54.023015 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-34beb792-8b32-45b4-97e7-4d06cbf9a34b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:54.034723 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-34beb792-8b32-45b4-97e7-4d06cbf9a34b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:54.039440 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-34beb792-8b32-45b4-97e7-4d06cbf9a34b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:54.044311 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-34beb792-8b32-45b4-97e7-4d06cbf9a34b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a" status: 200 len: 1411 microversion: 2.25 time: 0.300182 Aug 31 15:52:54.046612 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 518/1059] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:52:53 2022] GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a => generated 1411 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 15:52:54.056329 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=6 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:52:54.265957 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c2ccdf7d-cf2b-4ee8-8bd6-9511d171d618 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:54.279980 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c2ccdf7d-cf2b-4ee8-8bd6-9511d171d618 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63" status: 200 len: 1473 microversion: 2.1 time: 0.300616 Aug 31 15:52:54.281880 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 542/1060] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:53 2022] GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63 => generated 1473 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:54.287834 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3066afc1-bb5b-48a4-b27e-ae3549b88ab4 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:54.288789 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3066afc1-bb5b-48a4-b27e-ae3549b88ab4 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] [instance: ec8bbe5f-2c2c-41b8-bfed-711906394506] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:54.303503 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3066afc1-bb5b-48a4-b27e-ae3549b88ab4 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:54.304004 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3066afc1-bb5b-48a4-b27e-ae3549b88ab4 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:54.307579 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a7809c2d-ad92-4821-81c7-586934677b55 tempest-FloatingIPsNegativeTestJSON-1739070588 tempest-FloatingIPsNegativeTestJSON-1739070588-project] Calling method '.version_select at 0x7fbb46671940>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:54.307851 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3066afc1-bb5b-48a4-b27e-ae3549b88ab4 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:54.308639 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3066afc1-bb5b-48a4-b27e-ae3549b88ab4 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:54.312587 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3066afc1-bb5b-48a4-b27e-ae3549b88ab4 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:54.313262 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3066afc1-bb5b-48a4-b27e-ae3549b88ab4 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:54.490802 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a7809c2d-ad92-4821-81c7-586934677b55 tempest-FloatingIPsNegativeTestJSON-1739070588 tempest-FloatingIPsNegativeTestJSON-1739070588-project] 10.222.0.50 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.370030 Aug 31 15:52:54.492883 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 519/1061] 10.222.0.50 () {58 vars in 1149 bytes} [Wed Aug 31 15:52:54 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 15:52:54.493471 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3066afc1-bb5b-48a4-b27e-ae3549b88ab4 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:54.498704 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f5356c3d-a6f4-433d-a790-754404a6ae1b tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:54.501623 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f5356c3d-a6f4-433d-a790-754404a6ae1b tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: c76166e9-e2cf-4253-99e2-3f8d919099ba] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:54.504915 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3066afc1-bb5b-48a4-b27e-ae3549b88ab4 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:54.506965 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3066afc1-bb5b-48a4-b27e-ae3549b88ab4 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:54.507562 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3066afc1-bb5b-48a4-b27e-ae3549b88ab4 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] 10.222.0.50 "GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506" status: 200 len: 1356 microversion: 2.54 time: 0.224107 Aug 31 15:52:54.508125 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 543/1062] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:52:54 2022] GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506 => generated 1356 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:52:54.512366 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5356c3d-a6f4-433d-a790-754404a6ae1b tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:54.513044 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5356c3d-a6f4-433d-a790-754404a6ae1b tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:54.514622 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5356c3d-a6f4-433d-a790-754404a6ae1b tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:54.515508 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5356c3d-a6f4-433d-a790-754404a6ae1b tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:54.516116 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5356c3d-a6f4-433d-a790-754404a6ae1b tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:54.516697 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5356c3d-a6f4-433d-a790-754404a6ae1b tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:54.532913 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2503ded8-f4d9-4670-827d-7cda6fc8ce67 tempest-FloatingIPsNegativeTestJSON-1739070588 tempest-FloatingIPsNegativeTestJSON-1739070588-project] Action: 'create', calling method: .version_select at 0x7fbb46788280>, body: {"pool": "non_exist_pool"} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:52:54.663652 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-2503ded8-f4d9-4670-827d-7cda6fc8ce67 tempest-FloatingIPsNegativeTestJSON-1739070588 tempest-FloatingIPsNegativeTestJSON-1739070588-project] HTTP exception thrown: Floating IP pool not found. Aug 31 15:52:54.673430 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2503ded8-f4d9-4670-827d-7cda6fc8ce67 tempest-FloatingIPsNegativeTestJSON-1739070588 tempest-FloatingIPsNegativeTestJSON-1739070588-project] Request method failure captured: Aug 31 15:52:54.673430 n-d-833090-16 devstack@n-api.service[128864]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Aug 31 15:52:54.673430 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:52:54.673430 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:52:54.673430 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:52:54.673430 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 26 Aug 31 15:52:54.673430 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:52:54.673430 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:52:54.673430 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:52:54.673430 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:52:54.673430 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4PVslLaAlCxdG8yx70_3BsqotYW81qzxG-8oz1f0q0WSfTsSU2XIx9tGE4miiTbaAooZpItdFXitePwROx-GEHhU5a_RCo0QnjTjnoslqlJGGef_OZ4CJcV0qUefMMWOB9IVcPHxel6fdBAfjaNXkpKJm70YpH_y7dK8Y8JAXa_5fM Aug 31 15:52:54.673430 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:52:54.673430 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:52:54.673430 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:52:54.673430 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:52:54.673430 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:52:54.673430 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:52:54.673430 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: e6c2e5337aae40619745a4bf2680454f Aug 31 15:52:54.673430 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1739070588 Aug 31 15:52:54.673430 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:52:54.673430 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:52:54.675310 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e6c2e5337aae40619745a4bf2680454f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e6c2e5337aae40619745a4bf2680454f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e6c2e5337aae40619745a4bf2680454f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e6c2e5337aae40619745a4bf2680454f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:52:54.675310 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1739070588 Aug 31 15:52:54.675310 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: e6c2e5337aae40619745a4bf2680454f Aug 31 15:52:54.675310 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1739070588 Aug 31 15:52:54.675310 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-FloatingIPsNegativeTestJSON-1739070588-project Aug 31 15:52:54.675310 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:52:54.675310 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:52:54.675310 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 74d446b87b6b48aba47357164cc02777 Aug 31 15:52:54.675310 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1739070588-project Aug 31 15:52:54.675310 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 15:52:54.675310 n-d-833090-16 devstack@n-api.service[128864]: {"pool": "non_exist_pool"} Aug 31 15:52:54.675310 n-d-833090-16 devstack@n-api.service[128864]: method: Aug 31 15:52:54.675310 n-d-833090-16 devstack@n-api.service[128864]: exception: Floating IP pool not found. Aug 31 15:52:54.675310 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'body': {'pool': 'non_exist_pool'}} Aug 31 15:52:54.675310 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:52:54.677219 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:54.677219 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Aug 31 15:52:54.677219 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Aug 31 15:52:54.677219 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Aug 31 15:52:54.677219 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Aug 31 15:52:54.677219 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Aug 31 15:52:54.677219 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Aug 31 15:52:54.677219 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Aug 31 15:52:54.677219 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:54.677219 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:52:54.677219 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:54.677219 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:54.677219 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:52:54.677219 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:52:54.677219 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:52:54.677219 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:52:54.677219 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:52:54.677219 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:52:54.677219 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:52:54.677219 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:52:54.680001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Aug 31 15:52:54.680001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:52:54.680001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Aug 31 15:52:54.680001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:54.680001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:52:54.680001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:54.680001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:54.680001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:52:54.680001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:52:54.680001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:52:54.680001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:52:54.680001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Aug 31 15:52:54.680001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:54.680001 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2503ded8-f4d9-4670-827d-7cda6fc8ce67 tempest-FloatingIPsNegativeTestJSON-1739070588 tempest-FloatingIPsNegativeTestJSON-1739070588-project] Returning 404 to user: Floating IP pool not found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:52:54.680001 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2503ded8-f4d9-4670-827d-7cda6fc8ce67 tempest-FloatingIPsNegativeTestJSON-1739070588 tempest-FloatingIPsNegativeTestJSON-1739070588-project] 10.222.0.50 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.151869 Aug 31 15:52:54.681194 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 544/1063] 10.222.0.50 () {60 vars in 1170 bytes} [Wed Aug 31 15:52:54 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 15:52:54.684340 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8dea13c8-6218-4c83-b2cc-0d4f683f652d tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Action: 'create', calling method: .version_select at 0x7fbb4678c700>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-529590680", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBUABtRSN4Tha8mxHEbojo/tv4F/oRC25S5xgUPLqxULncUq6rFB+Wjj/qLuGKb/hMUpdsD1ZDPdRbMqtPoQ6RpvnufXxQdJBQaWAyXSNe5g1RA2Yh4w0xewFwmIfrC9g=="}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:52:54.703254 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-8dea13c8-6218-4c83-b2cc-0d4f683f652d tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Getting quotas for project 7bdc9d048a4845f3983579cd9d88faca. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:52:54.709351 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-8dea13c8-6218-4c83-b2cc-0d4f683f652d tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Getting quotas for user d6c2aa8a18954a9497c2c90890189fe3 and project 7bdc9d048a4845f3983579cd9d88faca. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:52:54.735955 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8dea13c8-6218-4c83-b2cc-0d4f683f652d tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.058793 Aug 31 15:52:54.736596 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 545/1064] 10.222.0.50 () {62 vars in 1200 bytes} [Wed Aug 31 15:52:54 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 60 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 31 15:52:54.746662 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-aa495639-9874-4b07-a13a-f4d8d50c0729 tempest-FloatingIPsNegativeTestJSON-1739070588 tempest-FloatingIPsNegativeTestJSON-1739070588-project] Calling method '.version_select at 0x7fbb4672b160>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:54.861456 n-d-833090-16 devstack@n-api.service[128864]: DEBUG neutronclient.v2_0.client [None req-aa495639-9874-4b07-a13a-f4d8d50c0729 tempest-FloatingIPsNegativeTestJSON-1739070588 tempest-FloatingIPsNegativeTestJSON-1739070588-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 1d1449aa-b9ac-41a7-ae45-c5be52ba7922 could not be found", "detail": ""}} {{(pid=128864) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 31 15:52:54.862552 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-aa495639-9874-4b07-a13a-f4d8d50c0729 tempest-FloatingIPsNegativeTestJSON-1739070588 tempest-FloatingIPsNegativeTestJSON-1739070588-project] HTTP exception thrown: Floating IP not found for ID 1d1449aa-b9ac-41a7-ae45-c5be52ba7922 Aug 31 15:52:54.866634 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-aa495639-9874-4b07-a13a-f4d8d50c0729 tempest-FloatingIPsNegativeTestJSON-1739070588 tempest-FloatingIPsNegativeTestJSON-1739070588-project] Request method failure captured: Aug 31 15:52:54.866634 n-d-833090-16 devstack@n-api.service[128864]: request: DELETE /compute/v2.1/os-floating-ips/1d1449aa-b9ac-41a7-ae45-c5be52ba7922 HTTP/1.1 Aug 31 15:52:54.866634 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:52:54.866634 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:52:54.866634 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:52:54.866634 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:52:54.866634 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:52:54.866634 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:52:54.866634 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:52:54.866634 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:52:54.866634 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4PVslLaAlCxdG8yx70_3BsqotYW81qzxG-8oz1f0q0WSfTsSU2XIx9tGE4miiTbaAooZpItdFXitePwROx-GEHhU5a_RCo0QnjTjnoslqlJGGef_OZ4CJcV0qUefMMWOB9IVcPHxel6fdBAfjaNXkpKJm70YpH_y7dK8Y8JAXa_5fM Aug 31 15:52:54.866634 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:52:54.866634 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:52:54.866634 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:52:54.866634 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:52:54.866634 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:52:54.866634 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:52:54.866634 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: e6c2e5337aae40619745a4bf2680454f Aug 31 15:52:54.866634 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1739070588 Aug 31 15:52:54.866634 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:52:54.866634 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:52:54.868217 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e6c2e5337aae40619745a4bf2680454f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e6c2e5337aae40619745a4bf2680454f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e6c2e5337aae40619745a4bf2680454f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e6c2e5337aae40619745a4bf2680454f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:52:54.868217 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1739070588 Aug 31 15:52:54.868217 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: e6c2e5337aae40619745a4bf2680454f Aug 31 15:52:54.868217 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1739070588 Aug 31 15:52:54.868217 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-FloatingIPsNegativeTestJSON-1739070588-project Aug 31 15:52:54.868217 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:52:54.868217 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:52:54.868217 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 74d446b87b6b48aba47357164cc02777 Aug 31 15:52:54.868217 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1739070588-project Aug 31 15:52:54.868217 n-d-833090-16 devstack@n-api.service[128864]: method: Aug 31 15:52:54.868217 n-d-833090-16 devstack@n-api.service[128864]: exception: Floating IP not found for ID 1d1449aa-b9ac-41a7-ae45-c5be52ba7922 Aug 31 15:52:54.868217 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '1d1449aa-b9ac-41a7-ae45-c5be52ba7922'} Aug 31 15:52:54.868217 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:52:54.869170 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:54.869170 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 31 15:52:54.869170 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 31 15:52:54.869170 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 15:52:54.869170 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 15:52:54.869170 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 31 15:52:54.869170 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 31 15:52:54.869170 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 15:52:54.869170 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 15:52:54.869170 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 31 15:52:54.869170 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 31 15:52:54.869170 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 15:52:54.869170 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 15:52:54.869170 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 31 15:52:54.869170 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 31 15:52:54.869170 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 15:52:54.869170 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 15:52:54.869170 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 31 15:52:54.869170 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 31 15:52:54.871775 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 15:52:54.871775 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 15:52:54.871775 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 31 15:52:54.871775 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 31 15:52:54.871775 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 31 15:52:54.871775 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 31 15:52:54.871775 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 1d1449aa-b9ac-41a7-ae45-c5be52ba7922 could not be found Aug 31 15:52:54.871775 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b6b300b6-0253-47a9-beed-43c36aca3053'] Aug 31 15:52:54.871775 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:54.871775 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:52:54.871775 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:54.871775 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:54.871775 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 31 15:52:54.871775 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 31 15:52:54.871775 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 31 15:52:54.871775 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 31 15:52:54.871775 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 1d1449aa-b9ac-41a7-ae45-c5be52ba7922. Aug 31 15:52:54.871775 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:54.871775 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:52:54.871775 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:54.873451 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:54.873451 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:52:54.873451 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:52:54.873451 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:52:54.873451 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:52:54.873451 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:52:54.873451 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:52:54.873451 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:52:54.873451 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:52:54.873451 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 31 15:52:54.873451 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 31 15:52:54.873451 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 1d1449aa-b9ac-41a7-ae45-c5be52ba7922 Aug 31 15:52:54.873451 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:54.873451 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:52:54.873451 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:54.873451 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:54.873451 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:52:54.873451 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:52:54.873451 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:52:54.873451 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:52:54.875261 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 1d1449aa-b9ac-41a7-ae45-c5be52ba7922 Aug 31 15:52:54.875261 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:54.877146 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-aa495639-9874-4b07-a13a-f4d8d50c0729 tempest-FloatingIPsNegativeTestJSON-1739070588 tempest-FloatingIPsNegativeTestJSON-1739070588-project] Returning 404 to user: Floating IP not found for ID 1d1449aa-b9ac-41a7-ae45-c5be52ba7922 {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:52:54.878420 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-aa495639-9874-4b07-a13a-f4d8d50c0729 tempest-FloatingIPsNegativeTestJSON-1739070588 tempest-FloatingIPsNegativeTestJSON-1739070588-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/1d1449aa-b9ac-41a7-ae45-c5be52ba7922" status: 404 len: 111 microversion: 2.1 time: 0.140771 Aug 31 15:52:54.879614 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 546/1065] 10.222.0.50 () {58 vars in 1263 bytes} [Wed Aug 31 15:52:54 2022] DELETE /compute/v2.1/os-floating-ips/1d1449aa-b9ac-41a7-ae45-c5be52ba7922 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:52:54.888763 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-aaaa59a4-86c4-4c83-a551-cafa9e9b25ab tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-529590680", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:52:54.892371 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-aaaa59a4-86c4-4c83-a551-cafa9e9b25ab tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] [instance: ec8bbe5f-2c2c-41b8-bfed-711906394506] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:54.903075 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aaaa59a4-86c4-4c83-a551-cafa9e9b25ab tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:54.903738 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aaaa59a4-86c4-4c83-a551-cafa9e9b25ab tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:54.904316 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aaaa59a4-86c4-4c83-a551-cafa9e9b25ab tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:54.905186 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aaaa59a4-86c4-4c83-a551-cafa9e9b25ab tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:54.905784 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aaaa59a4-86c4-4c83-a551-cafa9e9b25ab tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:54.906406 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aaaa59a4-86c4-4c83-a551-cafa9e9b25ab tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:55.110632 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-aaaa59a4-86c4-4c83-a551-cafa9e9b25ab tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:52:55.112914 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-aaaa59a4-86c4-4c83-a551-cafa9e9b25ab tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:52:55.115128 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-aaaa59a4-86c4-4c83-a551-cafa9e9b25ab tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:52:55.115252 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f5356c3d-a6f4-433d-a790-754404a6ae1b tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6349b0ee9e2142a8a440d4e6ae0703a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33f8cd7d4424157b410b64c7823f480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:55.115716 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-aaaa59a4-86c4-4c83-a551-cafa9e9b25ab tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:52:55.119621 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-aaaa59a4-86c4-4c83-a551-cafa9e9b25ab tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:52:55.124392 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f5356c3d-a6f4-433d-a790-754404a6ae1b tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "GET /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba" status: 200 len: 1390 microversion: 2.1 time: 0.630058 Aug 31 15:52:55.129755 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 520/1066] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:54 2022] GET /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba => generated 1390 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:55.137348 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-88f1f1ab-f760-411f-ad41-e000b54aa2d4 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:55.143653 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-88f1f1ab-f760-411f-ad41-e000b54aa2d4 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 269c2cc1-ce8d-41bc-bf54-90f0c37642a2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:55.169425 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88f1f1ab-f760-411f-ad41-e000b54aa2d4 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:55.170739 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88f1f1ab-f760-411f-ad41-e000b54aa2d4 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:55.171986 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88f1f1ab-f760-411f-ad41-e000b54aa2d4 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:55.174084 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88f1f1ab-f760-411f-ad41-e000b54aa2d4 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:55.177217 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88f1f1ab-f760-411f-ad41-e000b54aa2d4 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:55.178244 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88f1f1ab-f760-411f-ad41-e000b54aa2d4 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:55.375367 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-aaaa59a4-86c4-4c83-a551-cafa9e9b25ab tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] [instance: ec8bbe5f-2c2c-41b8-bfed-711906394506] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:55.400857 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-88f1f1ab-f760-411f-ad41-e000b54aa2d4 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:55.401306 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aaaa59a4-86c4-4c83-a551-cafa9e9b25ab tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:55.402041 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aaaa59a4-86c4-4c83-a551-cafa9e9b25ab tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:55.402741 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aaaa59a4-86c4-4c83-a551-cafa9e9b25ab tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:55.408067 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aaaa59a4-86c4-4c83-a551-cafa9e9b25ab tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:55.409170 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aaaa59a4-86c4-4c83-a551-cafa9e9b25ab tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:55.410252 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aaaa59a4-86c4-4c83-a551-cafa9e9b25ab tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:55.411259 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-88f1f1ab-f760-411f-ad41-e000b54aa2d4 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/269c2cc1-ce8d-41bc-bf54-90f0c37642a2" status: 200 len: 1431 microversion: 2.1 time: 0.277651 Aug 31 15:52:55.411852 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 521/1067] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:55 2022] GET /compute/v2.1/servers/269c2cc1-ce8d-41bc-bf54-90f0c37642a2 => generated 1431 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:55.458464 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-840b721f-04f4-4f37-845a-644f67e7e324 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:55.462463 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-840b721f-04f4-4f37-845a-644f67e7e324 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:55.508664 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-840b721f-04f4-4f37-845a-644f67e7e324 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:55.515195 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-840b721f-04f4-4f37-845a-644f67e7e324 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:55.518395 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-840b721f-04f4-4f37-845a-644f67e7e324 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:55.519389 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-840b721f-04f4-4f37-845a-644f67e7e324 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:55.523470 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-840b721f-04f4-4f37-845a-644f67e7e324 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:55.525663 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-840b721f-04f4-4f37-845a-644f67e7e324 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:55.572078 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-aaaa59a4-86c4-4c83-a551-cafa9e9b25ab tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] 10.222.0.50 "POST /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506/action" status: 202 len: 1138 microversion: 2.54 time: 0.686321 Aug 31 15:52:55.586944 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 547/1068] 10.222.0.50 () {62 vars in 1320 bytes} [Wed Aug 31 15:52:54 2022] POST /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506/action => generated 1138 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 31 15:52:55.600862 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-85ddc698-bab1-4249-aad5-0f0d705ffd65 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:55.601482 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-85ddc698-bab1-4249-aad5-0f0d705ffd65 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 236954ea-2791-477d-a92b-88e590593c63] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:55.631771 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85ddc698-bab1-4249-aad5-0f0d705ffd65 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:55.635252 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85ddc698-bab1-4249-aad5-0f0d705ffd65 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:55.639072 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85ddc698-bab1-4249-aad5-0f0d705ffd65 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:55.640012 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85ddc698-bab1-4249-aad5-0f0d705ffd65 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:55.641136 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85ddc698-bab1-4249-aad5-0f0d705ffd65 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:55.643164 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85ddc698-bab1-4249-aad5-0f0d705ffd65 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:55.982338 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-85ddc698-bab1-4249-aad5-0f0d705ffd65 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:55.998682 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-85ddc698-bab1-4249-aad5-0f0d705ffd65 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63" status: 200 len: 1473 microversion: 2.1 time: 0.406390 Aug 31 15:52:56.002225 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 548/1069] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:55 2022] GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63 => generated 1473 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:56.004341 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-840b721f-04f4-4f37-845a-644f67e7e324 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:56.013030 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-59875030-fde4-44f4-8c4f-223b5cd7498b req-b51a1dae-9c68-4378-92d7-8326752a90a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "269c2cc1-ce8d-41bc-bf54-90f0c37642a2", "name": "network-vif-deleted", "tag": "f5ab5bc7-50cc-4ab5-a182-e23f14ab5ec6"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:52:56.019723 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-840b721f-04f4-4f37-845a-644f67e7e324 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:56.021539 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-840b721f-04f4-4f37-845a-644f67e7e324 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:56.023458 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-840b721f-04f4-4f37-845a-644f67e7e324 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a" status: 200 len: 1411 microversion: 2.25 time: 0.610679 Aug 31 15:52:56.026917 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 522/1070] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:52:55 2022] GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a => generated 1411 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:52:56.044599 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6df88acc-bada-4309-9a36-64ded0bb32f8 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:56.046252 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6df88acc-bada-4309-9a36-64ded0bb32f8 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] [instance: ec8bbe5f-2c2c-41b8-bfed-711906394506] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:56.061044 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-59875030-fde4-44f4-8c4f-223b5cd7498b req-b51a1dae-9c68-4378-92d7-8326752a90a4 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:56.062300 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-59875030-fde4-44f4-8c4f-223b5cd7498b req-b51a1dae-9c68-4378-92d7-8326752a90a4 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:56.063189 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-59875030-fde4-44f4-8c4f-223b5cd7498b req-b51a1dae-9c68-4378-92d7-8326752a90a4 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:56.072658 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6df88acc-bada-4309-9a36-64ded0bb32f8 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:56.073155 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6df88acc-bada-4309-9a36-64ded0bb32f8 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:56.074543 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6df88acc-bada-4309-9a36-64ded0bb32f8 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:56.075265 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6df88acc-bada-4309-9a36-64ded0bb32f8 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:56.075888 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6df88acc-bada-4309-9a36-64ded0bb32f8 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:56.076400 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6df88acc-bada-4309-9a36-64ded0bb32f8 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:56.084573 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-59875030-fde4-44f4-8c4f-223b5cd7498b req-b51a1dae-9c68-4378-92d7-8326752a90a4 service nova] Creating event network-vif-deleted:f5ab5bc7-50cc-4ab5-a182-e23f14ab5ec6 for instance 269c2cc1-ce8d-41bc-bf54-90f0c37642a2 on n-h1-833090-16 Aug 31 15:52:56.098707 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-59875030-fde4-44f4-8c4f-223b5cd7498b req-b51a1dae-9c68-4378-92d7-8326752a90a4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090466 Aug 31 15:52:56.100004 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 549/1071] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:52:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:52:56.115699 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-6006a24f-907e-4f6c-8fab-283e3747c982 req-20ac12d5-f4b9-4af4-bd2e-85a3b026bd36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3ca0ff6-8f52-4ac3-8706-f5efab49a099", "name": "network-vif-deleted", "tag": "68581347-ace3-404a-bd96-2f05626c4e9c"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:52:56.138049 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-6006a24f-907e-4f6c-8fab-283e3747c982 req-20ac12d5-f4b9-4af4-bd2e-85a3b026bd36 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:56.142527 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-6006a24f-907e-4f6c-8fab-283e3747c982 req-20ac12d5-f4b9-4af4-bd2e-85a3b026bd36 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:56.143823 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-6006a24f-907e-4f6c-8fab-283e3747c982 req-20ac12d5-f4b9-4af4-bd2e-85a3b026bd36 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:56.171428 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:52:56.176372 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-6006a24f-907e-4f6c-8fab-283e3747c982 req-20ac12d5-f4b9-4af4-bd2e-85a3b026bd36 service nova] Creating event network-vif-deleted:68581347-ace3-404a-bd96-2f05626c4e9c for instance c3ca0ff6-8f52-4ac3-8706-f5efab49a099 on n-h1-833090-16 Aug 31 15:52:56.184314 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-6006a24f-907e-4f6c-8fab-283e3747c982 req-20ac12d5-f4b9-4af4-bd2e-85a3b026bd36 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078717 Aug 31 15:52:56.185578 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 550/1072] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:52:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:52:56.205935 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d147160e-2f51-4e4b-a863-7402df0aa846 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:56.207073 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d147160e-2f51-4e4b-a863-7402df0aa846 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: c76166e9-e2cf-4253-99e2-3f8d919099ba] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:56.214078 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d147160e-2f51-4e4b-a863-7402df0aa846 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:56.214945 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d147160e-2f51-4e4b-a863-7402df0aa846 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:56.216225 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d147160e-2f51-4e4b-a863-7402df0aa846 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:56.217142 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d147160e-2f51-4e4b-a863-7402df0aa846 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:56.217786 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d147160e-2f51-4e4b-a863-7402df0aa846 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:56.218436 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d147160e-2f51-4e4b-a863-7402df0aa846 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:56.239918 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6df88acc-bada-4309-9a36-64ded0bb32f8 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:56.256087 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6df88acc-bada-4309-9a36-64ded0bb32f8 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:56.259527 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6df88acc-bada-4309-9a36-64ded0bb32f8 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:56.261875 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6df88acc-bada-4309-9a36-64ded0bb32f8 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] 10.222.0.50 "GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506" status: 200 len: 1407 microversion: 2.54 time: 0.233612 Aug 31 15:52:56.264797 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 523/1073] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:52:56 2022] GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506 => generated 1407 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:52:56.433646 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ae94817c-13cb-4abd-be41-3ed422d46329 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:56.434549 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ae94817c-13cb-4abd-be41-3ed422d46329 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 269c2cc1-ce8d-41bc-bf54-90f0c37642a2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:56.441310 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d147160e-2f51-4e4b-a863-7402df0aa846 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6349b0ee9e2142a8a440d4e6ae0703a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33f8cd7d4424157b410b64c7823f480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:56.441476 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae94817c-13cb-4abd-be41-3ed422d46329 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:56.442035 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae94817c-13cb-4abd-be41-3ed422d46329 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:56.442410 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae94817c-13cb-4abd-be41-3ed422d46329 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:56.443288 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae94817c-13cb-4abd-be41-3ed422d46329 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:56.443737 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae94817c-13cb-4abd-be41-3ed422d46329 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:56.444153 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae94817c-13cb-4abd-be41-3ed422d46329 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:56.451215 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d147160e-2f51-4e4b-a863-7402df0aa846 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "GET /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba" status: 200 len: 1390 microversion: 2.1 time: 0.264057 Aug 31 15:52:56.453923 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 551/1074] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:56 2022] GET /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba => generated 1390 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:56.509406 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae94817c-13cb-4abd-be41-3ed422d46329 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:56.510061 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae94817c-13cb-4abd-be41-3ed422d46329 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:56.510561 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae94817c-13cb-4abd-be41-3ed422d46329 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:56.510997 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-ae94817c-13cb-4abd-be41-3ed422d46329 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lazy-loading 'fault' on Instance uuid 269c2cc1-ce8d-41bc-bf54-90f0c37642a2 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:52:56.571803 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ae94817c-13cb-4abd-be41-3ed422d46329 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:56.590004 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ae94817c-13cb-4abd-be41-3ed422d46329 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/269c2cc1-ce8d-41bc-bf54-90f0c37642a2" status: 200 len: 1308 microversion: 2.1 time: 0.160480 Aug 31 15:52:56.605519 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 524/1075] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:56 2022] GET /compute/v2.1/servers/269c2cc1-ce8d-41bc-bf54-90f0c37642a2 => generated 1308 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:52:57.025359 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1ecfbe0e-923c-4195-9ddf-fb105b26f121 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:57.025980 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1ecfbe0e-923c-4195-9ddf-fb105b26f121 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 236954ea-2791-477d-a92b-88e590593c63] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:57.035540 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1ecfbe0e-923c-4195-9ddf-fb105b26f121 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:57.035778 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1ecfbe0e-923c-4195-9ddf-fb105b26f121 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:57.036213 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1ecfbe0e-923c-4195-9ddf-fb105b26f121 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:57.036924 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1ecfbe0e-923c-4195-9ddf-fb105b26f121 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:57.037373 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1ecfbe0e-923c-4195-9ddf-fb105b26f121 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:57.037797 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1ecfbe0e-923c-4195-9ddf-fb105b26f121 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:57.056198 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-70d4498a-e355-4a00-9cdf-e1211bc98b49 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:57.056810 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-70d4498a-e355-4a00-9cdf-e1211bc98b49 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:57.072894 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70d4498a-e355-4a00-9cdf-e1211bc98b49 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:57.074309 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70d4498a-e355-4a00-9cdf-e1211bc98b49 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:57.076506 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70d4498a-e355-4a00-9cdf-e1211bc98b49 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:57.081320 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70d4498a-e355-4a00-9cdf-e1211bc98b49 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:57.083801 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70d4498a-e355-4a00-9cdf-e1211bc98b49 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:57.085172 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70d4498a-e355-4a00-9cdf-e1211bc98b49 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:57.428503 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1ecfbe0e-923c-4195-9ddf-fb105b26f121 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:57.443128 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1ecfbe0e-923c-4195-9ddf-fb105b26f121 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63" status: 200 len: 1473 microversion: 2.1 time: 0.418926 Aug 31 15:52:57.444755 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 552/1076] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:57 2022] GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63 => generated 1473 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:57.462654 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2aa1daa2-e1c7-448d-a73a-e880e3249a53 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:57.466631 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2aa1daa2-e1c7-448d-a73a-e880e3249a53 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] [instance: ec8bbe5f-2c2c-41b8-bfed-711906394506] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:57.482508 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2aa1daa2-e1c7-448d-a73a-e880e3249a53 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:57.483721 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2aa1daa2-e1c7-448d-a73a-e880e3249a53 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:57.484274 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2aa1daa2-e1c7-448d-a73a-e880e3249a53 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:57.486800 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2aa1daa2-e1c7-448d-a73a-e880e3249a53 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:57.491735 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2aa1daa2-e1c7-448d-a73a-e880e3249a53 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:57.492663 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2aa1daa2-e1c7-448d-a73a-e880e3249a53 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:57.633704 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-70d4498a-e355-4a00-9cdf-e1211bc98b49 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:57.649176 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-70d4498a-e355-4a00-9cdf-e1211bc98b49 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:57.650764 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-70d4498a-e355-4a00-9cdf-e1211bc98b49 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:57.652085 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-70d4498a-e355-4a00-9cdf-e1211bc98b49 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a" status: 200 len: 1411 microversion: 2.25 time: 0.603083 Aug 31 15:52:57.652972 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 525/1077] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:52:57 2022] GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a => generated 1411 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 15:52:57.659240 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-615eab94-ad1f-4cc0-9033-77d961fa08dd tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:57.659882 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-615eab94-ad1f-4cc0-9033-77d961fa08dd tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: c76166e9-e2cf-4253-99e2-3f8d919099ba] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:57.677186 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-615eab94-ad1f-4cc0-9033-77d961fa08dd tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:57.682864 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-615eab94-ad1f-4cc0-9033-77d961fa08dd tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:57.683569 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-615eab94-ad1f-4cc0-9033-77d961fa08dd tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:57.684503 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-615eab94-ad1f-4cc0-9033-77d961fa08dd tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:57.685110 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-615eab94-ad1f-4cc0-9033-77d961fa08dd tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:57.685699 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-615eab94-ad1f-4cc0-9033-77d961fa08dd tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:57.720693 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2aa1daa2-e1c7-448d-a73a-e880e3249a53 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:57.740024 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2aa1daa2-e1c7-448d-a73a-e880e3249a53 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:57.742146 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2aa1daa2-e1c7-448d-a73a-e880e3249a53 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:57.747320 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2aa1daa2-e1c7-448d-a73a-e880e3249a53 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] 10.222.0.50 "GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506" status: 200 len: 1407 microversion: 2.54 time: 0.301454 Aug 31 15:52:57.748956 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 553/1078] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:52:57 2022] GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506 => generated 1407 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:52:57.758835 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-bf3b28fe-6aea-418a-9cc8-086ee0c8836c tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:57.767403 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-bf3b28fe-6aea-418a-9cc8-086ee0c8836c tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 269c2cc1-ce8d-41bc-bf54-90f0c37642a2] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:57.787956 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bf3b28fe-6aea-418a-9cc8-086ee0c8836c tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:57.788362 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bf3b28fe-6aea-418a-9cc8-086ee0c8836c tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:57.788793 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bf3b28fe-6aea-418a-9cc8-086ee0c8836c tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:57.789495 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bf3b28fe-6aea-418a-9cc8-086ee0c8836c tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:57.789942 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bf3b28fe-6aea-418a-9cc8-086ee0c8836c tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:57.790405 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bf3b28fe-6aea-418a-9cc8-086ee0c8836c tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:57.815757 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-bf3b28fe-6aea-418a-9cc8-086ee0c8836c tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] HTTP exception thrown: Instance 269c2cc1-ce8d-41bc-bf54-90f0c37642a2 could not be found. Aug 31 15:52:57.817963 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-bf3b28fe-6aea-418a-9cc8-086ee0c8836c tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Request method failure captured: Aug 31 15:52:57.817963 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/269c2cc1-ce8d-41bc-bf54-90f0c37642a2 HTTP/1.1 Aug 31 15:52:57.817963 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:52:57.817963 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:52:57.817963 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:52:57.817963 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:52:57.817963 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:52:57.817963 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:52:57.817963 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:52:57.817963 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:52:57.817963 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4L5y07547XEfI_cY_8ZFyTZ2GODruSaAiNwL5T7pV746ldskVNIIQw6lIoEqrgxXvEXbIblt4yfV5d-cxgOpBf2oAyg-UpeVanVK5I-BR_CVasS0-Y9DUowTZd9jVO3T3hdjRzydMsILc76TUmWEyP017xiZ12asWHDSwtKrB6FkRQ Aug 31 15:52:57.817963 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:52:57.817963 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:52:57.817963 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:52:57.817963 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:52:57.817963 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:52:57.817963 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:52:57.817963 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 7db749eb0a764fa0bb29ddc4abd6d245 Aug 31 15:52:57.817963 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServersOnMultiNodesTest-1874033872 Aug 31 15:52:57.817963 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:52:57.817963 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:52:57.819674 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7db749eb0a764fa0bb29ddc4abd6d245"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7db749eb0a764fa0bb29ddc4abd6d245"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7db749eb0a764fa0bb29ddc4abd6d245"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7db749eb0a764fa0bb29ddc4abd6d245", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:52:57.819674 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServersOnMultiNodesTest-1874033872 Aug 31 15:52:57.819674 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 7db749eb0a764fa0bb29ddc4abd6d245 Aug 31 15:52:57.819674 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1874033872 Aug 31 15:52:57.819674 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServersOnMultiNodesTest-1874033872-project Aug 31 15:52:57.819674 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:52:57.819674 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:52:57.819674 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: fe647be03cef4e9c86b4fd6e703d0de1 Aug 31 15:52:57.819674 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServersOnMultiNodesTest-1874033872-project Aug 31 15:52:57.819674 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:52:57.819674 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 269c2cc1-ce8d-41bc-bf54-90f0c37642a2 could not be found. Aug 31 15:52:57.819674 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '269c2cc1-ce8d-41bc-bf54-90f0c37642a2'} Aug 31 15:52:57.820553 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:52:57.820553 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:57.820553 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:52:57.820553 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:52:57.820553 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:52:57.820553 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:52:57.820553 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:52:57.820553 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:52:57.820553 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:52:57.820553 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:52:57.820553 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 269c2cc1-ce8d-41bc-bf54-90f0c37642a2 could not be found. Aug 31 15:52:57.820553 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:57.820553 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:52:57.820553 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:57.820553 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:57.820553 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:52:57.820553 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:52:57.820553 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:52:57.820553 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:52:57.820553 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:52:57.821978 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:52:57.821978 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:52:57.821978 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:52:57.821978 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:52:57.821978 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:52:57.821978 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:52:57.821978 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:52:57.821978 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 269c2cc1-ce8d-41bc-bf54-90f0c37642a2 could not be found. Aug 31 15:52:57.821978 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:57.821978 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:52:57.821978 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:57.821978 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:57.821978 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:52:57.821978 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:52:57.821978 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:52:57.821978 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:52:57.821978 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 269c2cc1-ce8d-41bc-bf54-90f0c37642a2 could not be found. Aug 31 15:52:57.821978 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:57.824032 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-bf3b28fe-6aea-418a-9cc8-086ee0c8836c tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Returning 404 to user: Instance 269c2cc1-ce8d-41bc-bf54-90f0c37642a2 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:52:57.825040 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-bf3b28fe-6aea-418a-9cc8-086ee0c8836c tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/269c2cc1-ce8d-41bc-bf54-90f0c37642a2" status: 404 len: 111 microversion: 2.1 time: 0.075119 Aug 31 15:52:57.826082 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 554/1079] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:57 2022] GET /compute/v2.1/servers/269c2cc1-ce8d-41bc-bf54-90f0c37642a2 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:52:57.841672 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-db7db738-0d45-48c3-8c59-0b4ed0c79e0a tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:57.843383 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-db7db738-0d45-48c3-8c59-0b4ed0c79e0a tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: c3ca0ff6-8f52-4ac3-8706-f5efab49a099] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:57.850394 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db7db738-0d45-48c3-8c59-0b4ed0c79e0a tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:57.851109 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db7db738-0d45-48c3-8c59-0b4ed0c79e0a tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:57.851765 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db7db738-0d45-48c3-8c59-0b4ed0c79e0a tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:57.852615 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db7db738-0d45-48c3-8c59-0b4ed0c79e0a tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:57.853256 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db7db738-0d45-48c3-8c59-0b4ed0c79e0a tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:57.853836 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db7db738-0d45-48c3-8c59-0b4ed0c79e0a tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:57.869027 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-db7db738-0d45-48c3-8c59-0b4ed0c79e0a tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] HTTP exception thrown: Instance c3ca0ff6-8f52-4ac3-8706-f5efab49a099 could not be found. Aug 31 15:52:57.870792 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-db7db738-0d45-48c3-8c59-0b4ed0c79e0a tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Request method failure captured: Aug 31 15:52:57.870792 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/c3ca0ff6-8f52-4ac3-8706-f5efab49a099 HTTP/1.1 Aug 31 15:52:57.870792 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:52:57.870792 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:52:57.870792 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:52:57.870792 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:52:57.870792 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:52:57.870792 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:52:57.870792 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:52:57.870792 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:52:57.870792 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4L5y07547XEfI_cY_8ZFyTZ2GODruSaAiNwL5T7pV746ldskVNIIQw6lIoEqrgxXvEXbIblt4yfV5d-cxgOpBf2oAyg-UpeVanVK5I-BR_CVasS0-Y9DUowTZd9jVO3T3hdjRzydMsILc76TUmWEyP017xiZ12asWHDSwtKrB6FkRQ Aug 31 15:52:57.870792 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:52:57.870792 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:52:57.870792 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:52:57.870792 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:52:57.870792 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:52:57.870792 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:52:57.870792 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 7db749eb0a764fa0bb29ddc4abd6d245 Aug 31 15:52:57.870792 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServersOnMultiNodesTest-1874033872 Aug 31 15:52:57.870792 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:52:57.870792 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:52:57.872379 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7db749eb0a764fa0bb29ddc4abd6d245"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7db749eb0a764fa0bb29ddc4abd6d245"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7db749eb0a764fa0bb29ddc4abd6d245"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7db749eb0a764fa0bb29ddc4abd6d245", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:52:57.872379 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServersOnMultiNodesTest-1874033872 Aug 31 15:52:57.872379 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 7db749eb0a764fa0bb29ddc4abd6d245 Aug 31 15:52:57.872379 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1874033872 Aug 31 15:52:57.872379 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServersOnMultiNodesTest-1874033872-project Aug 31 15:52:57.872379 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:52:57.872379 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:52:57.872379 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: fe647be03cef4e9c86b4fd6e703d0de1 Aug 31 15:52:57.872379 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServersOnMultiNodesTest-1874033872-project Aug 31 15:52:57.872379 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:52:57.872379 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance c3ca0ff6-8f52-4ac3-8706-f5efab49a099 could not be found. Aug 31 15:52:57.872379 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'c3ca0ff6-8f52-4ac3-8706-f5efab49a099'} Aug 31 15:52:57.873249 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:52:57.873249 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:57.873249 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:52:57.873249 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:52:57.873249 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:52:57.873249 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:52:57.873249 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:52:57.873249 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:52:57.873249 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:52:57.873249 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:52:57.873249 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3ca0ff6-8f52-4ac3-8706-f5efab49a099 could not be found. Aug 31 15:52:57.873249 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:57.873249 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:52:57.873249 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:57.873249 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:57.873249 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:52:57.873249 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:52:57.873249 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:52:57.873249 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:52:57.873249 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:52:57.874677 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:52:57.874677 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:52:57.874677 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:52:57.874677 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:52:57.874677 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:52:57.874677 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:52:57.874677 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:52:57.874677 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3ca0ff6-8f52-4ac3-8706-f5efab49a099 could not be found. Aug 31 15:52:57.874677 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:57.874677 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:52:57.874677 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:57.874677 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:52:57.874677 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:52:57.874677 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:52:57.874677 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:52:57.874677 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:52:57.874677 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3ca0ff6-8f52-4ac3-8706-f5efab49a099 could not be found. Aug 31 15:52:57.874677 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:52:57.876800 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-db7db738-0d45-48c3-8c59-0b4ed0c79e0a tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Returning 404 to user: Instance c3ca0ff6-8f52-4ac3-8706-f5efab49a099 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:52:57.877824 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-db7db738-0d45-48c3-8c59-0b4ed0c79e0a tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/c3ca0ff6-8f52-4ac3-8706-f5efab49a099" status: 404 len: 111 microversion: 2.1 time: 0.046705 Aug 31 15:52:57.878926 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 555/1080] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:57 2022] GET /compute/v2.1/servers/c3ca0ff6-8f52-4ac3-8706-f5efab49a099 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:52:57.887796 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-559c4258-879e-432c-9c26-c0b80ebf1392 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:57.920200 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-559c4258-879e-432c-9c26-c0b80ebf1392 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/09b56213-6e6a-4309-8e25-d9f079e6536c" status: 204 len: 0 microversion: 2.1 time: 0.036154 Aug 31 15:52:57.920902 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 556/1081] 10.222.0.50 () {58 vars in 1266 bytes} [Wed Aug 31 15:52:57 2022] DELETE /compute/v2.1/os-server-groups/09b56213-6e6a-4309-8e25-d9f079e6536c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:52:57.929215 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f91b3630-c710-44db-b482-296b1bc20fc7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:57.929911 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f91b3630-c710-44db-b482-296b1bc20fc7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 848b21b2-98a0-4e70-a27c-08d390d73ae6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:57.938799 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f91b3630-c710-44db-b482-296b1bc20fc7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:57.939589 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f91b3630-c710-44db-b482-296b1bc20fc7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:57.940040 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f91b3630-c710-44db-b482-296b1bc20fc7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:57.940944 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f91b3630-c710-44db-b482-296b1bc20fc7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:57.942751 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f91b3630-c710-44db-b482-296b1bc20fc7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:57.943189 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f91b3630-c710-44db-b482-296b1bc20fc7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:57.998485 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f91b3630-c710-44db-b482-296b1bc20fc7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 848b21b2-98a0-4e70-a27c-08d390d73ae6] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:52:58.008853 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-615eab94-ad1f-4cc0-9033-77d961fa08dd tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6349b0ee9e2142a8a440d4e6ae0703a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33f8cd7d4424157b410b64c7823f480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:58.019151 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-615eab94-ad1f-4cc0-9033-77d961fa08dd tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "GET /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba" status: 200 len: 1390 microversion: 2.1 time: 0.365097 Aug 31 15:52:58.021896 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 526/1082] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:57 2022] GET /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba => generated 1390 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:58.113605 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f91b3630-c710-44db-b482-296b1bc20fc7 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "DELETE /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6" status: 204 len: 0 microversion: 2.1 time: 0.186974 Aug 31 15:52:58.114748 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 557/1083] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:52:57 2022] DELETE /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:52:58.130707 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-20a424b4-1fbe-47cb-9e50-2fcabe2870b5 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:58.131685 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-20a424b4-1fbe-47cb-9e50-2fcabe2870b5 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 848b21b2-98a0-4e70-a27c-08d390d73ae6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:58.139998 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20a424b4-1fbe-47cb-9e50-2fcabe2870b5 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:58.140695 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20a424b4-1fbe-47cb-9e50-2fcabe2870b5 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:58.141295 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20a424b4-1fbe-47cb-9e50-2fcabe2870b5 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:58.143291 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20a424b4-1fbe-47cb-9e50-2fcabe2870b5 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:58.143717 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20a424b4-1fbe-47cb-9e50-2fcabe2870b5 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:58.144149 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20a424b4-1fbe-47cb-9e50-2fcabe2870b5 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:58.401639 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-20a424b4-1fbe-47cb-9e50-2fcabe2870b5 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:58.411097 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-20a424b4-1fbe-47cb-9e50-2fcabe2870b5 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6" status: 200 len: 1472 microversion: 2.1 time: 0.292315 Aug 31 15:52:58.412608 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 527/1084] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:58 2022] GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6 => generated 1472 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:58.472133 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-06f6efa2-3a8b-4216-a262-5ef70ea122b1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:58.476910 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-06f6efa2-3a8b-4216-a262-5ef70ea122b1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 236954ea-2791-477d-a92b-88e590593c63] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:58.489574 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06f6efa2-3a8b-4216-a262-5ef70ea122b1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:58.490172 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06f6efa2-3a8b-4216-a262-5ef70ea122b1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:58.490585 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06f6efa2-3a8b-4216-a262-5ef70ea122b1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:58.492422 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06f6efa2-3a8b-4216-a262-5ef70ea122b1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:58.492876 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06f6efa2-3a8b-4216-a262-5ef70ea122b1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:58.493330 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06f6efa2-3a8b-4216-a262-5ef70ea122b1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:58.682543 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-32f9b721-a900-4d35-8f8b-3adffb9b995d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:58.685357 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-32f9b721-a900-4d35-8f8b-3adffb9b995d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:58.692753 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-32f9b721-a900-4d35-8f8b-3adffb9b995d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:58.693699 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-32f9b721-a900-4d35-8f8b-3adffb9b995d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:58.694408 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-32f9b721-a900-4d35-8f8b-3adffb9b995d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:58.695357 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-32f9b721-a900-4d35-8f8b-3adffb9b995d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:58.696018 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-32f9b721-a900-4d35-8f8b-3adffb9b995d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:58.696648 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-32f9b721-a900-4d35-8f8b-3adffb9b995d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:58.871900 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-06f6efa2-3a8b-4216-a262-5ef70ea122b1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:58.881621 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-06f6efa2-3a8b-4216-a262-5ef70ea122b1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63" status: 200 len: 1470 microversion: 2.1 time: 0.416309 Aug 31 15:52:58.897998 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 558/1085] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:58 2022] GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63 => generated 1470 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:52:58.903546 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3bfafcda-f750-4ee9-91c9-851928396aa5 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:58.904482 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3bfafcda-f750-4ee9-91c9-851928396aa5 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] [instance: ec8bbe5f-2c2c-41b8-bfed-711906394506] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:58.911911 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3bfafcda-f750-4ee9-91c9-851928396aa5 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:58.912640 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3bfafcda-f750-4ee9-91c9-851928396aa5 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:58.913308 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3bfafcda-f750-4ee9-91c9-851928396aa5 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:58.914550 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3bfafcda-f750-4ee9-91c9-851928396aa5 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:58.915224 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3bfafcda-f750-4ee9-91c9-851928396aa5 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:58.915877 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3bfafcda-f750-4ee9-91c9-851928396aa5 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:59.017477 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3bfafcda-f750-4ee9-91c9-851928396aa5 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:59.024798 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-32f9b721-a900-4d35-8f8b-3adffb9b995d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:59.033502 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3bfafcda-f750-4ee9-91c9-851928396aa5 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:59.039296 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3bfafcda-f750-4ee9-91c9-851928396aa5 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:59.042442 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-32f9b721-a900-4d35-8f8b-3adffb9b995d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:59.043858 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3bfafcda-f750-4ee9-91c9-851928396aa5 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] 10.222.0.50 "GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506" status: 200 len: 1407 microversion: 2.54 time: 0.141347 Aug 31 15:52:59.045127 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-32f9b721-a900-4d35-8f8b-3adffb9b995d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:52:59.045783 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 559/1086] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:52:58 2022] GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506 => generated 1407 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:52:59.047373 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-32f9b721-a900-4d35-8f8b-3adffb9b995d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a" status: 200 len: 1411 microversion: 2.25 time: 0.369969 Aug 31 15:52:59.047872 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 528/1087] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:52:58 2022] GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a => generated 1411 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:52:59.056854 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3e1fb380-0a44-4416-b36d-563a74658575 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:52:59.058758 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3e1fb380-0a44-4416-b36d-563a74658575 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 236954ea-2791-477d-a92b-88e590593c63] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:59.068439 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1a39dd7d-bd17-4d07-81a4-5815d7b575f1 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:59.069984 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1a39dd7d-bd17-4d07-81a4-5815d7b575f1 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: c76166e9-e2cf-4253-99e2-3f8d919099ba] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:59.073731 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3e1fb380-0a44-4416-b36d-563a74658575 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:59.077723 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a39dd7d-bd17-4d07-81a4-5815d7b575f1 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:59.077995 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3e1fb380-0a44-4416-b36d-563a74658575 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:59.078664 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a39dd7d-bd17-4d07-81a4-5815d7b575f1 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:59.079361 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a39dd7d-bd17-4d07-81a4-5815d7b575f1 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:59.079687 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3e1fb380-0a44-4416-b36d-563a74658575 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:59.080433 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a39dd7d-bd17-4d07-81a4-5815d7b575f1 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:59.080556 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3e1fb380-0a44-4416-b36d-563a74658575 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:59.081283 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a39dd7d-bd17-4d07-81a4-5815d7b575f1 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:59.082220 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a39dd7d-bd17-4d07-81a4-5815d7b575f1 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:59.082912 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3e1fb380-0a44-4416-b36d-563a74658575 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:59.085920 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3e1fb380-0a44-4416-b36d-563a74658575 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:59.192380 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3e1fb380-0a44-4416-b36d-563a74658575 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "POST /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63/action" status: 204 len: 0 microversion: 2.1 time: 0.143520 Aug 31 15:52:59.197640 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 560/1088] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 15:52:59 2022] POST /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63/action => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:52:59.204343 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-83b9fd0b-a92f-4061-8320-fdf4bb35ca3e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:52:59.205423 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-83b9fd0b-a92f-4061-8320-fdf4bb35ca3e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 236954ea-2791-477d-a92b-88e590593c63] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:52:59.214932 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83b9fd0b-a92f-4061-8320-fdf4bb35ca3e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:59.215742 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83b9fd0b-a92f-4061-8320-fdf4bb35ca3e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:59.217375 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83b9fd0b-a92f-4061-8320-fdf4bb35ca3e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:52:59.218991 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83b9fd0b-a92f-4061-8320-fdf4bb35ca3e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:52:59.219629 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83b9fd0b-a92f-4061-8320-fdf4bb35ca3e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:52:59.220151 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83b9fd0b-a92f-4061-8320-fdf4bb35ca3e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:00.009536 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1a39dd7d-bd17-4d07-81a4-5815d7b575f1 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6349b0ee9e2142a8a440d4e6ae0703a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33f8cd7d4424157b410b64c7823f480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:00.048036 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1a39dd7d-bd17-4d07-81a4-5815d7b575f1 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "GET /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba" status: 200 len: 1390 microversion: 2.1 time: 0.993968 Aug 31 15:53:00.049506 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 529/1089] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:59 2022] GET /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba => generated 1390 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:00.057938 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3768a470-187b-4cf9-a956-cac2666968ee tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:00.064253 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3768a470-187b-4cf9-a956-cac2666968ee tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 848b21b2-98a0-4e70-a27c-08d390d73ae6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:00.079174 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3768a470-187b-4cf9-a956-cac2666968ee tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:00.080677 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3768a470-187b-4cf9-a956-cac2666968ee tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:00.087652 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3768a470-187b-4cf9-a956-cac2666968ee tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:00.090017 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3768a470-187b-4cf9-a956-cac2666968ee tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:00.090777 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3768a470-187b-4cf9-a956-cac2666968ee tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:00.091475 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3768a470-187b-4cf9-a956-cac2666968ee tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:00.278510 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-83b9fd0b-a92f-4061-8320-fdf4bb35ca3e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:00.293468 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-83b9fd0b-a92f-4061-8320-fdf4bb35ca3e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63" status: 200 len: 1470 microversion: 2.1 time: 1.093481 Aug 31 15:53:00.294069 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 561/1090] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:52:59 2022] GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63 => generated 1470 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:00.303839 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0a551b49-e362-47d2-a953-ce2dbdf15eb7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:00.304803 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0a551b49-e362-47d2-a953-ce2dbdf15eb7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:00.313737 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0a551b49-e362-47d2-a953-ce2dbdf15eb7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:00.314400 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0a551b49-e362-47d2-a953-ce2dbdf15eb7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:00.314838 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0a551b49-e362-47d2-a953-ce2dbdf15eb7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:00.315546 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0a551b49-e362-47d2-a953-ce2dbdf15eb7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:00.316296 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0a551b49-e362-47d2-a953-ce2dbdf15eb7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:00.317644 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0a551b49-e362-47d2-a953-ce2dbdf15eb7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:00.851124 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3768a470-187b-4cf9-a956-cac2666968ee tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:00.871406 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3768a470-187b-4cf9-a956-cac2666968ee tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6" status: 200 len: 1472 microversion: 2.1 time: 0.820206 Aug 31 15:53:00.872969 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 530/1091] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:00 2022] GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6 => generated 1472 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:00.879248 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-43a43121-9e0c-412e-9cc1-4ccea4141c95 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:00.880182 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-43a43121-9e0c-412e-9cc1-4ccea4141c95 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] [instance: ec8bbe5f-2c2c-41b8-bfed-711906394506] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:00.889411 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43a43121-9e0c-412e-9cc1-4ccea4141c95 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:00.890209 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43a43121-9e0c-412e-9cc1-4ccea4141c95 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:00.890805 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43a43121-9e0c-412e-9cc1-4ccea4141c95 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:00.891926 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43a43121-9e0c-412e-9cc1-4ccea4141c95 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:00.892813 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43a43121-9e0c-412e-9cc1-4ccea4141c95 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:00.893468 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43a43121-9e0c-412e-9cc1-4ccea4141c95 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:00.956401 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:53:01.104016 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-43a43121-9e0c-412e-9cc1-4ccea4141c95 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:01.113845 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-43a43121-9e0c-412e-9cc1-4ccea4141c95 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:01.116230 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-43a43121-9e0c-412e-9cc1-4ccea4141c95 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:01.117656 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-43a43121-9e0c-412e-9cc1-4ccea4141c95 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] 10.222.0.50 "GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506" status: 200 len: 1407 microversion: 2.54 time: 0.243164 Aug 31 15:53:01.119835 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 531/1092] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:53:00 2022] GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506 => generated 1407 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:53:01.125147 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4fabd8b8-de5e-4446-8b2f-2f83d784f61b tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:01.126000 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4fabd8b8-de5e-4446-8b2f-2f83d784f61b tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: c76166e9-e2cf-4253-99e2-3f8d919099ba] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:01.134438 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4fabd8b8-de5e-4446-8b2f-2f83d784f61b tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:01.135222 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4fabd8b8-de5e-4446-8b2f-2f83d784f61b tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:01.135820 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4fabd8b8-de5e-4446-8b2f-2f83d784f61b tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:01.136864 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4fabd8b8-de5e-4446-8b2f-2f83d784f61b tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:01.137539 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4fabd8b8-de5e-4446-8b2f-2f83d784f61b tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:01.143075 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0a551b49-e362-47d2-a953-ce2dbdf15eb7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:01.151813 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4fabd8b8-de5e-4446-8b2f-2f83d784f61b tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:01.163917 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0a551b49-e362-47d2-a953-ce2dbdf15eb7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:01.165419 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0a551b49-e362-47d2-a953-ce2dbdf15eb7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:01.167062 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0a551b49-e362-47d2-a953-ce2dbdf15eb7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a" status: 200 len: 1411 microversion: 2.25 time: 0.872038 Aug 31 15:53:01.167799 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 562/1093] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:53:00 2022] GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a => generated 1411 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:53:01.283932 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-2bfd7406-f7e7-4aef-8100-a6d6f556e96c req-f27ce5c4-6b44-4d3d-8333-1a51bf6d054e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "236954ea-2791-477d-a92b-88e590593c63", "name": "network-vif-plugged", "status": "completed", "tag": "741689b8-43aa-4b92-9c42-308fa64c312a"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:53:01.316591 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-2bfd7406-f7e7-4aef-8100-a6d6f556e96c req-f27ce5c4-6b44-4d3d-8333-1a51bf6d054e service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:01.318471 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-2bfd7406-f7e7-4aef-8100-a6d6f556e96c req-f27ce5c4-6b44-4d3d-8333-1a51bf6d054e service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:01.319281 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-2bfd7406-f7e7-4aef-8100-a6d6f556e96c req-f27ce5c4-6b44-4d3d-8333-1a51bf6d054e service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:01.365370 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-2bfd7406-f7e7-4aef-8100-a6d6f556e96c req-f27ce5c4-6b44-4d3d-8333-1a51bf6d054e service nova] Creating event network-vif-plugged:741689b8-43aa-4b92-9c42-308fa64c312a for instance 236954ea-2791-477d-a92b-88e590593c63 on n-h2-833090-16 Aug 31 15:53:01.374320 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [req-2bfd7406-f7e7-4aef-8100-a6d6f556e96c req-f27ce5c4-6b44-4d3d-8333-1a51bf6d054e service nova] Instance 236954ea-2791-477d-a92b-88e590593c63 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-833090-16', 'n-h1-833090-16'} {{(pid=128864) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 15:53:01.395379 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-2bfd7406-f7e7-4aef-8100-a6d6f556e96c req-f27ce5c4-6b44-4d3d-8333-1a51bf6d054e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115420 Aug 31 15:53:01.397349 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 563/1094] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:53:01.406410 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b96f8fad-a3f4-499f-8cbb-6b3da7d3b74f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:01.407533 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b96f8fad-a3f4-499f-8cbb-6b3da7d3b74f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 236954ea-2791-477d-a92b-88e590593c63] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:01.416349 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b96f8fad-a3f4-499f-8cbb-6b3da7d3b74f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:01.417089 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b96f8fad-a3f4-499f-8cbb-6b3da7d3b74f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:01.417989 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b96f8fad-a3f4-499f-8cbb-6b3da7d3b74f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:01.419165 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b96f8fad-a3f4-499f-8cbb-6b3da7d3b74f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:01.419798 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b96f8fad-a3f4-499f-8cbb-6b3da7d3b74f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:01.420409 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b96f8fad-a3f4-499f-8cbb-6b3da7d3b74f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:01.983080 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b96f8fad-a3f4-499f-8cbb-6b3da7d3b74f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:02.000160 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b96f8fad-a3f4-499f-8cbb-6b3da7d3b74f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63" status: 200 len: 1470 microversion: 2.1 time: 0.600254 Aug 31 15:53:02.013414 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 564/1095] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:01 2022] GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63 => generated 1470 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:02.014311 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4fabd8b8-de5e-4446-8b2f-2f83d784f61b tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6349b0ee9e2142a8a440d4e6ae0703a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33f8cd7d4424157b410b64c7823f480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:02.024660 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c760ccaf-828b-46f6-9a73-1c5a11a0c597 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:02.025276 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c760ccaf-828b-46f6-9a73-1c5a11a0c597 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 848b21b2-98a0-4e70-a27c-08d390d73ae6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:02.029779 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4fabd8b8-de5e-4446-8b2f-2f83d784f61b tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "GET /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba" status: 200 len: 1390 microversion: 2.1 time: 0.903907 Aug 31 15:53:02.032597 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 532/1096] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:01 2022] GET /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba => generated 1390 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:02.041514 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c760ccaf-828b-46f6-9a73-1c5a11a0c597 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:02.042657 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c760ccaf-828b-46f6-9a73-1c5a11a0c597 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:02.044929 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c760ccaf-828b-46f6-9a73-1c5a11a0c597 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:02.045897 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-ed7087d6-160b-4463-87db-0e78fb9e621d req-65ec8564-f9c0-44d3-a21f-e9db051581a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "848b21b2-98a0-4e70-a27c-08d390d73ae6", "name": "network-vif-deleted", "tag": "dd829db9-9a09-4434-b55f-8bb2e13964a3"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:53:02.047517 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c760ccaf-828b-46f6-9a73-1c5a11a0c597 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:02.048719 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c760ccaf-828b-46f6-9a73-1c5a11a0c597 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:02.049583 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c760ccaf-828b-46f6-9a73-1c5a11a0c597 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:02.083229 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ed7087d6-160b-4463-87db-0e78fb9e621d req-65ec8564-f9c0-44d3-a21f-e9db051581a1 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:02.083826 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ed7087d6-160b-4463-87db-0e78fb9e621d req-65ec8564-f9c0-44d3-a21f-e9db051581a1 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:02.084363 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ed7087d6-160b-4463-87db-0e78fb9e621d req-65ec8564-f9c0-44d3-a21f-e9db051581a1 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:02.098072 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-ed7087d6-160b-4463-87db-0e78fb9e621d req-65ec8564-f9c0-44d3-a21f-e9db051581a1 service nova] Creating event network-vif-deleted:dd829db9-9a09-4434-b55f-8bb2e13964a3 for instance 848b21b2-98a0-4e70-a27c-08d390d73ae6 on n-h2-833090-16 Aug 31 15:53:02.110756 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-ed7087d6-160b-4463-87db-0e78fb9e621d req-65ec8564-f9c0-44d3-a21f-e9db051581a1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076483 Aug 31 15:53:02.116796 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 533/1097] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:53:02.156780 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-78fd5d8c-87e8-4cf3-b484-0b8dde915109 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:02.159444 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-78fd5d8c-87e8-4cf3-b484-0b8dde915109 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] [instance: ec8bbe5f-2c2c-41b8-bfed-711906394506] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:02.175026 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78fd5d8c-87e8-4cf3-b484-0b8dde915109 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:02.177203 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78fd5d8c-87e8-4cf3-b484-0b8dde915109 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:02.177987 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78fd5d8c-87e8-4cf3-b484-0b8dde915109 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:02.179158 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78fd5d8c-87e8-4cf3-b484-0b8dde915109 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:02.180634 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78fd5d8c-87e8-4cf3-b484-0b8dde915109 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:02.181387 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78fd5d8c-87e8-4cf3-b484-0b8dde915109 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:02.238498 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c760ccaf-828b-46f6-9a73-1c5a11a0c597 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:02.251418 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c760ccaf-828b-46f6-9a73-1c5a11a0c597 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6" status: 200 len: 1430 microversion: 2.1 time: 0.236635 Aug 31 15:53:02.263523 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 565/1098] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:02 2022] GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6 => generated 1430 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:02.269443 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4954f704-aee5-4ec7-8b15-e26fca32fe26 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:02.270772 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4954f704-aee5-4ec7-8b15-e26fca32fe26 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:02.297982 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4954f704-aee5-4ec7-8b15-e26fca32fe26 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:02.298757 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4954f704-aee5-4ec7-8b15-e26fca32fe26 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:02.299043 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4954f704-aee5-4ec7-8b15-e26fca32fe26 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:02.306883 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4954f704-aee5-4ec7-8b15-e26fca32fe26 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:02.307634 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4954f704-aee5-4ec7-8b15-e26fca32fe26 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:02.308077 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4954f704-aee5-4ec7-8b15-e26fca32fe26 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:02.512852 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-78fd5d8c-87e8-4cf3-b484-0b8dde915109 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:02.525948 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-78fd5d8c-87e8-4cf3-b484-0b8dde915109 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:02.528049 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-78fd5d8c-87e8-4cf3-b484-0b8dde915109 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:02.529988 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-78fd5d8c-87e8-4cf3-b484-0b8dde915109 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] 10.222.0.50 "GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506" status: 200 len: 1407 microversion: 2.54 time: 0.388199 Aug 31 15:53:02.531073 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 534/1099] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:53:02 2022] GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506 => generated 1407 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:53:03.020199 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4954f704-aee5-4ec7-8b15-e26fca32fe26 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:03.027910 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4954f704-aee5-4ec7-8b15-e26fca32fe26 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:03.028616 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ea9ea2d1-36e3-4421-9085-39bef822d6fb tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:03.029331 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4954f704-aee5-4ec7-8b15-e26fca32fe26 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:03.029651 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ea9ea2d1-36e3-4421-9085-39bef822d6fb tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 236954ea-2791-477d-a92b-88e590593c63] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:03.030466 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4954f704-aee5-4ec7-8b15-e26fca32fe26 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a" status: 200 len: 1411 microversion: 2.25 time: 0.765420 Aug 31 15:53:03.031021 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 566/1100] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:53:02 2022] GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a => generated 1411 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:53:03.033723 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=18 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:53:03.036083 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:53:03.042024 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea9ea2d1-36e3-4421-9085-39bef822d6fb tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:03.044597 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea9ea2d1-36e3-4421-9085-39bef822d6fb tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:03.045948 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea9ea2d1-36e3-4421-9085-39bef822d6fb tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:03.046786 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea9ea2d1-36e3-4421-9085-39bef822d6fb tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:03.051582 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea9ea2d1-36e3-4421-9085-39bef822d6fb tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:03.058369 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4fefcac3-8b19-46c6-bf05-6cb528c4d9e5 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:03.059237 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4fefcac3-8b19-46c6-bf05-6cb528c4d9e5 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: c76166e9-e2cf-4253-99e2-3f8d919099ba] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:03.063128 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea9ea2d1-36e3-4421-9085-39bef822d6fb tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:03.065703 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4fefcac3-8b19-46c6-bf05-6cb528c4d9e5 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:03.066527 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4fefcac3-8b19-46c6-bf05-6cb528c4d9e5 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:03.067132 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4fefcac3-8b19-46c6-bf05-6cb528c4d9e5 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:03.067986 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4fefcac3-8b19-46c6-bf05-6cb528c4d9e5 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:03.068587 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4fefcac3-8b19-46c6-bf05-6cb528c4d9e5 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:03.069149 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4fefcac3-8b19-46c6-bf05-6cb528c4d9e5 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:03.098301 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:53:03.413967 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4fefcac3-8b19-46c6-bf05-6cb528c4d9e5 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6349b0ee9e2142a8a440d4e6ae0703a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33f8cd7d4424157b410b64c7823f480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:03.425204 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4fefcac3-8b19-46c6-bf05-6cb528c4d9e5 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "GET /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba" status: 200 len: 1390 microversion: 2.1 time: 0.371899 Aug 31 15:53:03.447911 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ea9ea2d1-36e3-4421-9085-39bef822d6fb tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:03.454271 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 567/1101] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:03 2022] GET /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba => generated 1390 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:03.460538 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ea9ea2d1-36e3-4421-9085-39bef822d6fb tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63" status: 200 len: 1470 microversion: 2.1 time: 0.436434 Aug 31 15:53:03.460679 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-57581044-79a9-46a8-b55d-a91311e633bb tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:03.461118 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 535/1102] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:03 2022] GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63 => generated 1470 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:53:03.461672 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-57581044-79a9-46a8-b55d-a91311e633bb tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 848b21b2-98a0-4e70-a27c-08d390d73ae6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:03.479923 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-57581044-79a9-46a8-b55d-a91311e633bb tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:03.480256 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-57581044-79a9-46a8-b55d-a91311e633bb tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:03.481036 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-57581044-79a9-46a8-b55d-a91311e633bb tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:03.481902 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-57581044-79a9-46a8-b55d-a91311e633bb tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:03.482776 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-57581044-79a9-46a8-b55d-a91311e633bb tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:03.483406 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-57581044-79a9-46a8-b55d-a91311e633bb tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:03.518499 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:53:03.523306 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-57581044-79a9-46a8-b55d-a91311e633bb tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:03.524026 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-57581044-79a9-46a8-b55d-a91311e633bb tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:03.524650 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-57581044-79a9-46a8-b55d-a91311e633bb tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:03.526493 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-57581044-79a9-46a8-b55d-a91311e633bb tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lazy-loading 'fault' on Instance uuid 848b21b2-98a0-4e70-a27c-08d390d73ae6 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:53:03.553440 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a5902244-cc3f-4a61-92e7-2b8994224cca tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:03.556627 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a5902244-cc3f-4a61-92e7-2b8994224cca tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] [instance: ec8bbe5f-2c2c-41b8-bfed-711906394506] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:03.569846 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5902244-cc3f-4a61-92e7-2b8994224cca tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:03.573249 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5902244-cc3f-4a61-92e7-2b8994224cca tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:03.573855 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5902244-cc3f-4a61-92e7-2b8994224cca tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:03.574751 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5902244-cc3f-4a61-92e7-2b8994224cca tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:03.580421 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5902244-cc3f-4a61-92e7-2b8994224cca tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:03.582492 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5902244-cc3f-4a61-92e7-2b8994224cca tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:03.597663 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-57581044-79a9-46a8-b55d-a91311e633bb tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:03.614205 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-57581044-79a9-46a8-b55d-a91311e633bb tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6" status: 200 len: 1307 microversion: 2.1 time: 0.158384 Aug 31 15:53:03.618627 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 568/1103] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:03 2022] GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6 => generated 1307 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:03.702023 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a5902244-cc3f-4a61-92e7-2b8994224cca tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:03.713666 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a5902244-cc3f-4a61-92e7-2b8994224cca tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:03.716541 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a5902244-cc3f-4a61-92e7-2b8994224cca tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:03.722715 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a5902244-cc3f-4a61-92e7-2b8994224cca tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] 10.222.0.50 "GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506" status: 200 len: 1407 microversion: 2.54 time: 0.171710 Aug 31 15:53:03.727171 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 536/1104] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:53:03 2022] GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506 => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:53:04.062589 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8fbebd8a-ff1b-49a4-b3d2-42eb20b906f6 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:04.063256 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8fbebd8a-ff1b-49a4-b3d2-42eb20b906f6 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:04.072075 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8fbebd8a-ff1b-49a4-b3d2-42eb20b906f6 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:04.072576 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8fbebd8a-ff1b-49a4-b3d2-42eb20b906f6 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:04.073055 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8fbebd8a-ff1b-49a4-b3d2-42eb20b906f6 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:04.073770 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8fbebd8a-ff1b-49a4-b3d2-42eb20b906f6 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:04.074245 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8fbebd8a-ff1b-49a4-b3d2-42eb20b906f6 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:04.086849 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8fbebd8a-ff1b-49a4-b3d2-42eb20b906f6 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:04.330290 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8fbebd8a-ff1b-49a4-b3d2-42eb20b906f6 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:04.347656 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8fbebd8a-ff1b-49a4-b3d2-42eb20b906f6 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:04.349498 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8fbebd8a-ff1b-49a4-b3d2-42eb20b906f6 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:04.351236 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8fbebd8a-ff1b-49a4-b3d2-42eb20b906f6 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a" status: 200 len: 1411 microversion: 2.25 time: 0.292542 Aug 31 15:53:04.351946 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 569/1105] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:53:04 2022] GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a => generated 1411 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:53:04.453404 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-95a43a43-8761-4752-8877-e967a20d4276 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:04.455148 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-95a43a43-8761-4752-8877-e967a20d4276 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: c76166e9-e2cf-4253-99e2-3f8d919099ba] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:04.464674 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95a43a43-8761-4752-8877-e967a20d4276 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:04.465161 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95a43a43-8761-4752-8877-e967a20d4276 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:04.465588 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95a43a43-8761-4752-8877-e967a20d4276 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:04.466311 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95a43a43-8761-4752-8877-e967a20d4276 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:04.466751 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95a43a43-8761-4752-8877-e967a20d4276 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:04.467173 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95a43a43-8761-4752-8877-e967a20d4276 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:04.481891 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-296ef8b2-36dd-42f7-b30b-dbb7733888de tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:04.482736 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-296ef8b2-36dd-42f7-b30b-dbb7733888de tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 236954ea-2791-477d-a92b-88e590593c63] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:04.491199 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-296ef8b2-36dd-42f7-b30b-dbb7733888de tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:04.493073 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-296ef8b2-36dd-42f7-b30b-dbb7733888de tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:04.499847 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-296ef8b2-36dd-42f7-b30b-dbb7733888de tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:04.500819 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-296ef8b2-36dd-42f7-b30b-dbb7733888de tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:04.501296 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-296ef8b2-36dd-42f7-b30b-dbb7733888de tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:04.501930 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-296ef8b2-36dd-42f7-b30b-dbb7733888de tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:04.718249 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=4 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:53:04.941698 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-95a43a43-8761-4752-8877-e967a20d4276 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6349b0ee9e2142a8a440d4e6ae0703a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33f8cd7d4424157b410b64c7823f480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:04.950230 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-95a43a43-8761-4752-8877-e967a20d4276 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "GET /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba" status: 200 len: 1390 microversion: 2.1 time: 0.503976 Aug 31 15:53:04.968018 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 537/1106] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:04 2022] GET /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba => generated 1390 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:04.975833 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bbb9e1b6-e6fe-41b8-9df7-17f09cab7cb0 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:04.978489 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bbb9e1b6-e6fe-41b8-9df7-17f09cab7cb0 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 848b21b2-98a0-4e70-a27c-08d390d73ae6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:04.985765 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bbb9e1b6-e6fe-41b8-9df7-17f09cab7cb0 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:04.986326 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bbb9e1b6-e6fe-41b8-9df7-17f09cab7cb0 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:04.986831 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bbb9e1b6-e6fe-41b8-9df7-17f09cab7cb0 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:04.987776 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bbb9e1b6-e6fe-41b8-9df7-17f09cab7cb0 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:04.988278 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bbb9e1b6-e6fe-41b8-9df7-17f09cab7cb0 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:04.989881 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bbb9e1b6-e6fe-41b8-9df7-17f09cab7cb0 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:05.062247 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=95,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:53:05.086037 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-296ef8b2-36dd-42f7-b30b-dbb7733888de tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:05.086889 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bbb9e1b6-e6fe-41b8-9df7-17f09cab7cb0 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:05.091377 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bbb9e1b6-e6fe-41b8-9df7-17f09cab7cb0 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:05.091908 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bbb9e1b6-e6fe-41b8-9df7-17f09cab7cb0 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:05.092440 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-bbb9e1b6-e6fe-41b8-9df7-17f09cab7cb0 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lazy-loading 'fault' on Instance uuid 848b21b2-98a0-4e70-a27c-08d390d73ae6 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:53:05.114784 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-296ef8b2-36dd-42f7-b30b-dbb7733888de tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63" status: 200 len: 1462 microversion: 2.1 time: 0.636648 Aug 31 15:53:05.120665 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 570/1107] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:04 2022] GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63 => generated 1462 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:53:05.131727 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1b368604-c1ed-4c2d-b4ac-e3dfb9b43a4d tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:05.134712 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1b368604-c1ed-4c2d-b4ac-e3dfb9b43a4d tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] [instance: ec8bbe5f-2c2c-41b8-bfed-711906394506] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:05.151135 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1b368604-c1ed-4c2d-b4ac-e3dfb9b43a4d tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:05.151628 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1b368604-c1ed-4c2d-b4ac-e3dfb9b43a4d tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:05.152061 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1b368604-c1ed-4c2d-b4ac-e3dfb9b43a4d tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:05.155440 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1b368604-c1ed-4c2d-b4ac-e3dfb9b43a4d tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:05.157950 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1b368604-c1ed-4c2d-b4ac-e3dfb9b43a4d tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:05.158653 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1b368604-c1ed-4c2d-b4ac-e3dfb9b43a4d tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:05.324456 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bbb9e1b6-e6fe-41b8-9df7-17f09cab7cb0 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:05.333784 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bbb9e1b6-e6fe-41b8-9df7-17f09cab7cb0 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6" status: 200 len: 1307 microversion: 2.1 time: 0.364206 Aug 31 15:53:05.351214 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1b368604-c1ed-4c2d-b4ac-e3dfb9b43a4d tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:05.355121 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 538/1108] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:04 2022] GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6 => generated 1307 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:05.362659 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fe84de77-74b9-4cbc-8a7d-aaafe28b4bd6 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:05.362659 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fe84de77-74b9-4cbc-8a7d-aaafe28b4bd6 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 236954ea-2791-477d-a92b-88e590593c63] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:05.364153 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1b368604-c1ed-4c2d-b4ac-e3dfb9b43a4d tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:05.371488 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1b368604-c1ed-4c2d-b4ac-e3dfb9b43a4d tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:05.372056 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe84de77-74b9-4cbc-8a7d-aaafe28b4bd6 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:05.372551 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe84de77-74b9-4cbc-8a7d-aaafe28b4bd6 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:05.372706 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1b368604-c1ed-4c2d-b4ac-e3dfb9b43a4d tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] 10.222.0.50 "GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506" status: 200 len: 1407 microversion: 2.54 time: 0.246847 Aug 31 15:53:05.373214 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe84de77-74b9-4cbc-8a7d-aaafe28b4bd6 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:05.374647 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe84de77-74b9-4cbc-8a7d-aaafe28b4bd6 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:05.375249 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe84de77-74b9-4cbc-8a7d-aaafe28b4bd6 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:05.375739 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 571/1109] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:53:05 2022] GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506 => generated 1407 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:53:05.375954 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe84de77-74b9-4cbc-8a7d-aaafe28b4bd6 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:05.386918 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6464dc77-88a5-43fb-a80c-8fe2902b3144 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:05.389536 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6464dc77-88a5-43fb-a80c-8fe2902b3144 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:05.397276 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6464dc77-88a5-43fb-a80c-8fe2902b3144 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:05.398075 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6464dc77-88a5-43fb-a80c-8fe2902b3144 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:05.398747 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6464dc77-88a5-43fb-a80c-8fe2902b3144 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:05.399626 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6464dc77-88a5-43fb-a80c-8fe2902b3144 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:05.400254 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6464dc77-88a5-43fb-a80c-8fe2902b3144 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:05.400987 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6464dc77-88a5-43fb-a80c-8fe2902b3144 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:05.741388 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6464dc77-88a5-43fb-a80c-8fe2902b3144 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:05.742278 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fe84de77-74b9-4cbc-8a7d-aaafe28b4bd6 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:05.756324 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fe84de77-74b9-4cbc-8a7d-aaafe28b4bd6 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63" status: 200 len: 1462 microversion: 2.1 time: 0.399652 Aug 31 15:53:05.756925 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 539/1110] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:05 2022] GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63 => generated 1462 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:05.763125 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6464dc77-88a5-43fb-a80c-8fe2902b3144 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:05.764695 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6464dc77-88a5-43fb-a80c-8fe2902b3144 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:05.765908 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6464dc77-88a5-43fb-a80c-8fe2902b3144 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a" status: 200 len: 1411 microversion: 2.25 time: 0.389207 Aug 31 15:53:05.770763 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 572/1111] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:53:05 2022] GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a => generated 1411 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:53:05.783456 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7e09bacc-9abb-490e-9507-788a8844cf3f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Action: 'create', calling method: .version_select at 0x7fbb4672bd30>, body: {"keypair": {"name": "tempest-keypair-27323870", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCg1IE7GURqw4MZd/ExWdyGdPWBepkYdfmx+9NW0uTtoAafIcw1nMFOCB+hTpFN2ypSC8jF5gTlMi3knmNiTAfDIQsLA7z3kIW/CddOMOOHwmg7NqfoPDLgP2/LvKwLd2Q=="}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:53:05.819423 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-7e09bacc-9abb-490e-9507-788a8844cf3f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Getting quotas for project 9b4c50ece07f441b8974d384f4ab29a4. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:53:05.830265 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-7e09bacc-9abb-490e-9507-788a8844cf3f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Getting quotas for user 5f6f8b9d63234b8199c60f842a3c407f and project 9b4c50ece07f441b8974d384f4ab29a4. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:53:05.892690 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7e09bacc-9abb-490e-9507-788a8844cf3f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.113396 Aug 31 15:53:05.894166 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 573/1112] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 31 15:53:05 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:53:05.976639 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e55a9447-111b-4266-bd70-268fa51e7805 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:05.977552 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e55a9447-111b-4266-bd70-268fa51e7805 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: c76166e9-e2cf-4253-99e2-3f8d919099ba] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:05.990591 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e55a9447-111b-4266-bd70-268fa51e7805 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:05.991160 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e55a9447-111b-4266-bd70-268fa51e7805 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:05.991610 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e55a9447-111b-4266-bd70-268fa51e7805 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:05.992378 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e55a9447-111b-4266-bd70-268fa51e7805 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:05.994635 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e55a9447-111b-4266-bd70-268fa51e7805 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:05.995110 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e55a9447-111b-4266-bd70-268fa51e7805 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:06.020949 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6e2d3d58-65ef-4687-980f-5dc6719b9ce5 tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] Action: 'create', calling method: .version_select at 0x7fbb468e2b80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1292486371", "description": "tempest-description-360619724"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:53:06.353132 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e55a9447-111b-4266-bd70-268fa51e7805 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6349b0ee9e2142a8a440d4e6ae0703a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33f8cd7d4424157b410b64c7823f480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:06.398122 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e55a9447-111b-4266-bd70-268fa51e7805 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "GET /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba" status: 200 len: 1390 microversion: 2.1 time: 0.419356 Aug 31 15:53:06.414281 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 574/1113] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:05 2022] GET /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba => generated 1390 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:53:06.414281 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-836b15e2-c69f-423b-8b02-c94d6f7ea45a tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:06.414281 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-836b15e2-c69f-423b-8b02-c94d6f7ea45a tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 848b21b2-98a0-4e70-a27c-08d390d73ae6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:06.440558 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-836b15e2-c69f-423b-8b02-c94d6f7ea45a tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:06.441158 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-836b15e2-c69f-423b-8b02-c94d6f7ea45a tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:06.441704 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-836b15e2-c69f-423b-8b02-c94d6f7ea45a tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:06.442554 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-836b15e2-c69f-423b-8b02-c94d6f7ea45a tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:06.442883 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-836b15e2-c69f-423b-8b02-c94d6f7ea45a tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:06.443982 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-836b15e2-c69f-423b-8b02-c94d6f7ea45a tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:06.496859 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-836b15e2-c69f-423b-8b02-c94d6f7ea45a tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:06.497703 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-836b15e2-c69f-423b-8b02-c94d6f7ea45a tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:06.498381 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-836b15e2-c69f-423b-8b02-c94d6f7ea45a tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:06.499026 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-836b15e2-c69f-423b-8b02-c94d6f7ea45a tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lazy-loading 'fault' on Instance uuid 848b21b2-98a0-4e70-a27c-08d390d73ae6 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:53:06.569207 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6e2d3d58-65ef-4687-980f-5dc6719b9ce5 tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.801776 Aug 31 15:53:06.570281 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 540/1114] 10.222.0.50 () {60 vars in 1180 bytes} [Wed Aug 31 15:53:05 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:53:06.577653 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e5172098-009c-4861-be02-cdb6e7ac8a98 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:06.578606 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e5172098-009c-4861-be02-cdb6e7ac8a98 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] [instance: ec8bbe5f-2c2c-41b8-bfed-711906394506] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:06.599058 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e5172098-009c-4861-be02-cdb6e7ac8a98 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:06.599881 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e5172098-009c-4861-be02-cdb6e7ac8a98 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:06.601419 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e5172098-009c-4861-be02-cdb6e7ac8a98 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:06.604306 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e5172098-009c-4861-be02-cdb6e7ac8a98 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:06.605934 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e5172098-009c-4861-be02-cdb6e7ac8a98 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:06.606790 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e5172098-009c-4861-be02-cdb6e7ac8a98 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:06.674556 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-836b15e2-c69f-423b-8b02-c94d6f7ea45a tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe647be03cef4e9c86b4fd6e703d0de1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db749eb0a764fa0bb29ddc4abd6d245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:06.692437 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-836b15e2-c69f-423b-8b02-c94d6f7ea45a tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6" status: 200 len: 1307 microversion: 2.1 time: 0.286909 Aug 31 15:53:06.695800 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 575/1115] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:06 2022] GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6 => generated 1307 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:06.708112 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ed2100ff-9ab5-46d8-8528-4c1a15afd8ae tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] Action: 'create', calling method: .version_select at 0x7fbb467880d0>, body: {"security_group_rule": {"parent_group_id": "897f071f-c702-4f18-b9c0-0c12779689f6", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:53:06.825115 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e5172098-009c-4861-be02-cdb6e7ac8a98 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:06.840973 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e5172098-009c-4861-be02-cdb6e7ac8a98 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:06.845692 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e5172098-009c-4861-be02-cdb6e7ac8a98 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:06.855132 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e5172098-009c-4861-be02-cdb6e7ac8a98 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] 10.222.0.50 "GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506" status: 200 len: 1407 microversion: 2.54 time: 0.277031 Aug 31 15:53:06.868238 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 541/1116] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:53:06 2022] GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506 => generated 1407 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:53:06.881228 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1c6a9340-1785-4d20-baaf-1757f0f7b287 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:06.882438 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1c6a9340-1785-4d20-baaf-1757f0f7b287 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:06.898722 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c6a9340-1785-4d20-baaf-1757f0f7b287 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:06.901033 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c6a9340-1785-4d20-baaf-1757f0f7b287 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:06.903508 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c6a9340-1785-4d20-baaf-1757f0f7b287 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:06.905749 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c6a9340-1785-4d20-baaf-1757f0f7b287 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:06.907255 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c6a9340-1785-4d20-baaf-1757f0f7b287 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:06.908876 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c6a9340-1785-4d20-baaf-1757f0f7b287 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:07.458076 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1c6a9340-1785-4d20-baaf-1757f0f7b287 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:07.467415 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1c6a9340-1785-4d20-baaf-1757f0f7b287 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:07.471757 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1c6a9340-1785-4d20-baaf-1757f0f7b287 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:07.483640 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1c6a9340-1785-4d20-baaf-1757f0f7b287 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a" status: 200 len: 1411 microversion: 2.25 time: 0.613760 Aug 31 15:53:07.484241 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 542/1117] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:53:06 2022] GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a => generated 1411 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:53:07.489136 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-78d062d7-bf2f-45d2-af76-05934a59cca5 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:07.489739 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-78d062d7-bf2f-45d2-af76-05934a59cca5 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: c76166e9-e2cf-4253-99e2-3f8d919099ba] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:07.511231 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78d062d7-bf2f-45d2-af76-05934a59cca5 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:07.511725 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78d062d7-bf2f-45d2-af76-05934a59cca5 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:07.512368 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78d062d7-bf2f-45d2-af76-05934a59cca5 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:07.513073 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78d062d7-bf2f-45d2-af76-05934a59cca5 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:07.515569 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78d062d7-bf2f-45d2-af76-05934a59cca5 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:07.516305 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78d062d7-bf2f-45d2-af76-05934a59cca5 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:07.792963 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ed2100ff-9ab5-46d8-8528-4c1a15afd8ae tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.093726 Aug 31 15:53:07.793582 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 576/1118] 10.222.0.50 () {60 vars in 1195 bytes} [Wed Aug 31 15:53:06 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:53:07.804854 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-ca00bc45-0407-4753-a281-b658827be98a req-acccdd29-5290-40ce-b2e0-258853d9e2f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a25dea8-1dc1-480e-a431-13d2f2270d0a", "name": "network-vif-plugged", "status": "completed", "tag": "be9ab567-195e-4d60-b1e4-2ba6690fe483"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:53:07.844056 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-ca00bc45-0407-4753-a281-b658827be98a req-acccdd29-5290-40ce-b2e0-258853d9e2f2 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:07.844559 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-ca00bc45-0407-4753-a281-b658827be98a req-acccdd29-5290-40ce-b2e0-258853d9e2f2 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:07.845278 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-ca00bc45-0407-4753-a281-b658827be98a req-acccdd29-5290-40ce-b2e0-258853d9e2f2 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:07.865754 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-ca00bc45-0407-4753-a281-b658827be98a req-acccdd29-5290-40ce-b2e0-258853d9e2f2 service nova] Creating event network-vif-plugged:be9ab567-195e-4d60-b1e4-2ba6690fe483 for instance 8a25dea8-1dc1-480e-a431-13d2f2270d0a on n-h2-833090-16 Aug 31 15:53:07.879104 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-ca00bc45-0407-4753-a281-b658827be98a req-acccdd29-5290-40ce-b2e0-258853d9e2f2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080068 Aug 31 15:53:07.886493 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 577/1119] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:53:07.887833 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-78d062d7-bf2f-45d2-af76-05934a59cca5 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6349b0ee9e2142a8a440d4e6ae0703a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33f8cd7d4424157b410b64c7823f480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:07.894029 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9ede754f-0f37-4c7c-91de-ce5f7d0b0922 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:07.894908 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9ede754f-0f37-4c7c-91de-ce5f7d0b0922 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] [instance: 848b21b2-98a0-4e70-a27c-08d390d73ae6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:07.903328 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ede754f-0f37-4c7c-91de-ce5f7d0b0922 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:07.903974 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-78d062d7-bf2f-45d2-af76-05934a59cca5 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "GET /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba" status: 200 len: 1390 microversion: 2.1 time: 0.418643 Aug 31 15:53:07.904490 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ede754f-0f37-4c7c-91de-ce5f7d0b0922 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:07.905081 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 543/1120] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:07 2022] GET /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba => generated 1390 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:07.905500 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ede754f-0f37-4c7c-91de-ce5f7d0b0922 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:07.906687 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ede754f-0f37-4c7c-91de-ce5f7d0b0922 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:07.907353 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ede754f-0f37-4c7c-91de-ce5f7d0b0922 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:07.907976 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ede754f-0f37-4c7c-91de-ce5f7d0b0922 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:07.916296 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e1c288c7-e7c7-4e1c-ab90-c1df8506360a tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] Action: 'create', calling method: .version_select at 0x7fbb46601ee0>, body: {"security_group_rule": {"parent_group_id": "897f071f-c702-4f18-b9c0-0c12779689f6", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:53:07.926472 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-9ede754f-0f37-4c7c-91de-ce5f7d0b0922 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] HTTP exception thrown: Instance 848b21b2-98a0-4e70-a27c-08d390d73ae6 could not be found. Aug 31 15:53:07.929395 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9ede754f-0f37-4c7c-91de-ce5f7d0b0922 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Request method failure captured: Aug 31 15:53:07.929395 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6 HTTP/1.1 Aug 31 15:53:07.929395 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:53:07.929395 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:53:07.929395 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:53:07.929395 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:53:07.929395 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:53:07.929395 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:53:07.929395 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:53:07.929395 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:53:07.929395 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4L5y07547XEfI_cY_8ZFyTZ2GODruSaAiNwL5T7pV746ldskVNIIQw6lIoEqrgxXvEXbIblt4yfV5d-cxgOpBf2oAyg-UpeVanVK5I-BR_CVasS0-Y9DUowTZd9jVO3T3hdjRzydMsILc76TUmWEyP017xiZ12asWHDSwtKrB6FkRQ Aug 31 15:53:07.929395 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:53:07.929395 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:53:07.929395 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:53:07.929395 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:53:07.929395 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:53:07.929395 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:53:07.929395 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 7db749eb0a764fa0bb29ddc4abd6d245 Aug 31 15:53:07.929395 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServersOnMultiNodesTest-1874033872 Aug 31 15:53:07.929395 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:53:07.929395 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:53:07.930831 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7db749eb0a764fa0bb29ddc4abd6d245"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7db749eb0a764fa0bb29ddc4abd6d245"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7db749eb0a764fa0bb29ddc4abd6d245"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7db749eb0a764fa0bb29ddc4abd6d245", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:53:07.930831 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServersOnMultiNodesTest-1874033872 Aug 31 15:53:07.930831 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 7db749eb0a764fa0bb29ddc4abd6d245 Aug 31 15:53:07.930831 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1874033872 Aug 31 15:53:07.930831 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServersOnMultiNodesTest-1874033872-project Aug 31 15:53:07.930831 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:53:07.930831 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:53:07.930831 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: fe647be03cef4e9c86b4fd6e703d0de1 Aug 31 15:53:07.930831 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServersOnMultiNodesTest-1874033872-project Aug 31 15:53:07.930831 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:53:07.930831 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 848b21b2-98a0-4e70-a27c-08d390d73ae6 could not be found. Aug 31 15:53:07.930831 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '848b21b2-98a0-4e70-a27c-08d390d73ae6'} Aug 31 15:53:07.931706 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:53:07.931706 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:07.931706 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:53:07.931706 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:53:07.931706 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:53:07.931706 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:53:07.931706 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:53:07.931706 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:53:07.931706 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:53:07.931706 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:53:07.931706 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 848b21b2-98a0-4e70-a27c-08d390d73ae6 could not be found. Aug 31 15:53:07.931706 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:53:07.931706 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:53:07.931706 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:53:07.931706 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:07.931706 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:53:07.931706 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:53:07.931706 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:53:07.931706 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:53:07.931706 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:53:07.933131 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:53:07.933131 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:53:07.933131 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:53:07.933131 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:53:07.933131 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:53:07.933131 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:53:07.933131 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:53:07.933131 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 848b21b2-98a0-4e70-a27c-08d390d73ae6 could not be found. Aug 31 15:53:07.933131 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:53:07.933131 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:53:07.933131 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:53:07.933131 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:07.933131 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:53:07.933131 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:53:07.933131 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:53:07.933131 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:53:07.933131 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 848b21b2-98a0-4e70-a27c-08d390d73ae6 could not be found. Aug 31 15:53:07.933131 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:53:07.936305 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9ede754f-0f37-4c7c-91de-ce5f7d0b0922 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] Returning 404 to user: Instance 848b21b2-98a0-4e70-a27c-08d390d73ae6 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:53:07.953015 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9ede754f-0f37-4c7c-91de-ce5f7d0b0922 tempest-ServersOnMultiNodesTest-1874033872 tempest-ServersOnMultiNodesTest-1874033872-project] 10.222.0.50 "GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6" status: 404 len: 111 microversion: 2.1 time: 0.065367 Aug 31 15:53:07.954912 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 578/1121] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:07 2022] GET /compute/v2.1/servers/848b21b2-98a0-4e70-a27c-08d390d73ae6 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:53:07.963060 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2ac17db0-b543-4dee-a082-b44f48fe3c96 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:07.974531 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2ac17db0-b543-4dee-a082-b44f48fe3c96 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] [instance: ec8bbe5f-2c2c-41b8-bfed-711906394506] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:07.984316 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2ac17db0-b543-4dee-a082-b44f48fe3c96 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:07.989710 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2ac17db0-b543-4dee-a082-b44f48fe3c96 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:07.990422 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2ac17db0-b543-4dee-a082-b44f48fe3c96 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:07.991365 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2ac17db0-b543-4dee-a082-b44f48fe3c96 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:07.992447 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2ac17db0-b543-4dee-a082-b44f48fe3c96 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:07.993124 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2ac17db0-b543-4dee-a082-b44f48fe3c96 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:08.508308 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2ac17db0-b543-4dee-a082-b44f48fe3c96 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:08.523548 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2ac17db0-b543-4dee-a082-b44f48fe3c96 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:08.524988 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2ac17db0-b543-4dee-a082-b44f48fe3c96 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:08.526184 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2ac17db0-b543-4dee-a082-b44f48fe3c96 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] 10.222.0.50 "GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506" status: 200 len: 1407 microversion: 2.54 time: 0.568730 Aug 31 15:53:08.526745 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 579/1122] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:53:07 2022] GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506 => generated 1407 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:53:08.542006 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f4a697d8-7903-46f2-9985-974d1257ab76 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:08.544566 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f4a697d8-7903-46f2-9985-974d1257ab76 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:08.571672 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f4a697d8-7903-46f2-9985-974d1257ab76 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:08.572382 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f4a697d8-7903-46f2-9985-974d1257ab76 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:08.572834 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f4a697d8-7903-46f2-9985-974d1257ab76 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:08.574004 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f4a697d8-7903-46f2-9985-974d1257ab76 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:08.574502 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f4a697d8-7903-46f2-9985-974d1257ab76 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:08.575220 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f4a697d8-7903-46f2-9985-974d1257ab76 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:08.662813 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-e1c288c7-e7c7-4e1c-ab90-c1df8506360a tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] HTTP exception thrown: This rule already exists in group 897f071f-c702-4f18-b9c0-0c12779689f6 Aug 31 15:53:08.664442 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e1c288c7-e7c7-4e1c-ab90-c1df8506360a tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] Request method failure captured: Aug 31 15:53:08.664442 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 31 15:53:08.664442 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:53:08.664442 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:53:08.664442 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:53:08.664442 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 138 Aug 31 15:53:08.664442 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:53:08.664442 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:53:08.664442 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:53:08.664442 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:53:08.664442 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4Ph3sZVLMF4oFbNL7OWvRkq8q0JfwD2ESOWQLyfL5jo5TX90MqPPPbny-W1BTSUC4PlzvrucSdfPC3OArelVcarxOjBmtjEGwYaB8z7AvNzsvUit2EmoYh3nNWrpAw6fatYxTcL2ixRiICliKZcG1ROKOkzeC-2BnKrScGh6mKI7u4 Aug 31 15:53:08.664442 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:53:08.664442 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:53:08.664442 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:53:08.664442 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:53:08.664442 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:53:08.664442 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:53:08.664442 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 3bc3b279cb094b5abfc17a9e0f14be75 Aug 31 15:53:08.664442 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-630679065 Aug 31 15:53:08.664442 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:53:08.664442 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:53:08.666045 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3bc3b279cb094b5abfc17a9e0f14be75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3bc3b279cb094b5abfc17a9e0f14be75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3bc3b279cb094b5abfc17a9e0f14be75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3bc3b279cb094b5abfc17a9e0f14be75", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:53:08.666045 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-630679065 Aug 31 15:53:08.666045 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 3bc3b279cb094b5abfc17a9e0f14be75 Aug 31 15:53:08.666045 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-630679065 Aug 31 15:53:08.666045 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-630679065-project Aug 31 15:53:08.666045 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:53:08.666045 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:53:08.666045 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: ebbfb1d55f7646cba9aa9c9995e5daaa Aug 31 15:53:08.666045 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-630679065-project Aug 31 15:53:08.666045 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 15:53:08.666045 n-d-833090-16 devstack@n-api.service[128863]: {"security_group_rule": {"parent_group_id": "897f071f-c702-4f18-b9c0-0c12779689f6", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 31 15:53:08.666045 n-d-833090-16 devstack@n-api.service[128863]: method: Aug 31 15:53:08.666867 n-d-833090-16 devstack@n-api.service[128863]: exception: This rule already exists in group 897f071f-c702-4f18-b9c0-0c12779689f6 Aug 31 15:53:08.666867 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'body': {'security_group_rule': {'parent_group_id': '897f071f-c702-4f18-b9c0-0c12779689f6', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 31 15:53:08.666867 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:53:08.666867 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:08.666867 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Aug 31 15:53:08.666867 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Aug 31 15:53:08.666867 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Aug 31 15:53:08.666867 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 31 15:53:08.666867 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 897f071f-c702-4f18-b9c0-0c12779689f6 Aug 31 15:53:08.666867 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:53:08.666867 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:53:08.666867 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:53:08.666867 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:08.666867 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:53:08.666867 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:53:08.666867 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:53:08.666867 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:53:08.666867 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:53:08.666867 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:53:08.666867 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:53:08.668951 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:53:08.668951 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Aug 31 15:53:08.668951 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 31 15:53:08.668951 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 897f071f-c702-4f18-b9c0-0c12779689f6 Aug 31 15:53:08.668951 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:53:08.668951 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:53:08.668951 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:53:08.668951 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:08.668951 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:53:08.668951 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:53:08.668951 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:53:08.668951 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:53:08.668951 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 897f071f-c702-4f18-b9c0-0c12779689f6 Aug 31 15:53:08.668951 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:53:08.668951 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e1c288c7-e7c7-4e1c-ab90-c1df8506360a tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] Returning 400 to user: This rule already exists in group 897f071f-c702-4f18-b9c0-0c12779689f6 {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:53:08.671351 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e1c288c7-e7c7-4e1c-ab90-c1df8506360a tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.759809 Aug 31 15:53:08.671351 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 544/1123] 10.222.0.50 () {60 vars in 1195 bytes} [Wed Aug 31 15:53:07 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 761 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 15:53:08.675391 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9b853511-cf76-4ae9-8c5a-ddb8f8648693 tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] Calling method '.version_select at 0x7fbb4686af70>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:09.050165 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f4a697d8-7903-46f2-9985-974d1257ab76 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:09.073597 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f4a697d8-7903-46f2-9985-974d1257ab76 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:09.082857 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f4a697d8-7903-46f2-9985-974d1257ab76 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:09.086906 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f4a697d8-7903-46f2-9985-974d1257ab76 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a" status: 200 len: 1411 microversion: 2.25 time: 0.556782 Aug 31 15:53:09.088664 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 580/1124] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:53:08 2022] GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a => generated 1411 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:53:09.109389 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-72ea7ea9-4b6e-40fa-b35d-1b5026333218 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:09.112230 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-72ea7ea9-4b6e-40fa-b35d-1b5026333218 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: c76166e9-e2cf-4253-99e2-3f8d919099ba] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:09.138963 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-72ea7ea9-4b6e-40fa-b35d-1b5026333218 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:09.139809 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-72ea7ea9-4b6e-40fa-b35d-1b5026333218 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:09.144806 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-72ea7ea9-4b6e-40fa-b35d-1b5026333218 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:09.146900 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-72ea7ea9-4b6e-40fa-b35d-1b5026333218 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:09.147604 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-72ea7ea9-4b6e-40fa-b35d-1b5026333218 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:09.149065 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-72ea7ea9-4b6e-40fa-b35d-1b5026333218 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:09.558937 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9b853511-cf76-4ae9-8c5a-ddb8f8648693 tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-group-rules/6be35abd-f0bc-45eb-9078-145e8d61260b" status: 202 len: 0 microversion: 2.1 time: 0.887364 Aug 31 15:53:09.563942 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 545/1125] 10.222.0.50 () {58 vars in 1287 bytes} [Wed Aug 31 15:53:08 2022] DELETE /compute/v2.1/os-security-group-rules/6be35abd-f0bc-45eb-9078-145e8d61260b => generated 0 bytes in 893 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 15:53:09.569808 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a1b8c335-a99d-4921-b72f-4082c5b58cc6 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:09.570616 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a1b8c335-a99d-4921-b72f-4082c5b58cc6 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] [instance: ec8bbe5f-2c2c-41b8-bfed-711906394506] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:09.591174 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1b8c335-a99d-4921-b72f-4082c5b58cc6 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:09.591761 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1b8c335-a99d-4921-b72f-4082c5b58cc6 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:09.592201 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1b8c335-a99d-4921-b72f-4082c5b58cc6 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:09.592921 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1b8c335-a99d-4921-b72f-4082c5b58cc6 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:09.593377 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1b8c335-a99d-4921-b72f-4082c5b58cc6 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:09.593806 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1b8c335-a99d-4921-b72f-4082c5b58cc6 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:09.756213 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a1b8c335-a99d-4921-b72f-4082c5b58cc6 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:09.767080 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a1b8c335-a99d-4921-b72f-4082c5b58cc6 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:09.771138 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a1b8c335-a99d-4921-b72f-4082c5b58cc6 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:09.772381 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a1b8c335-a99d-4921-b72f-4082c5b58cc6 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] 10.222.0.50 "GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506" status: 200 len: 1407 microversion: 2.54 time: 0.207399 Aug 31 15:53:09.772948 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 546/1126] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:53:09 2022] GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506 => generated 1407 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:53:09.792546 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-de4618b2-a176-4a24-8393-baac11ca553c tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] Action: 'create', calling method: .version_select at 0x7fbb46601940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-2024980178", "description": "tempest-description-992792407"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:53:09.802887 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-72ea7ea9-4b6e-40fa-b35d-1b5026333218 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6349b0ee9e2142a8a440d4e6ae0703a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33f8cd7d4424157b410b64c7823f480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:09.817626 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-72ea7ea9-4b6e-40fa-b35d-1b5026333218 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "GET /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba" status: 200 len: 1390 microversion: 2.1 time: 0.725230 Aug 31 15:53:09.824460 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 581/1127] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:09 2022] GET /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba => generated 1390 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:10.097441 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2c3d9043-1c3c-4341-b290-ae8f26794fa6 tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] Calling method '.version_select at 0x7fbb4ac615e0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:10.119440 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2c3d9043-1c3c-4341-b290-ae8f26794fa6 tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:10.123347 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2c3d9043-1c3c-4341-b290-ae8f26794fa6 tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:10.127366 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2c3d9043-1c3c-4341-b290-ae8f26794fa6 tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:10.153757 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2c3d9043-1c3c-4341-b290-ae8f26794fa6 tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] 10.222.0.50 "GET /compute/v2.1/os-migrations" status: 200 len: 1586 microversion: 2.1 time: 0.061976 Aug 31 15:53:10.155148 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 582/1128] 10.222.0.50 () {58 vars in 1143 bytes} [Wed Aug 31 15:53:10 2022] GET /compute/v2.1/os-migrations => generated 1586 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:53:10.161195 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-de135091-332c-42e2-9d04-08ce0207f7d0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:10.176103 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-de135091-332c-42e2-9d04-08ce0207f7d0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:10.200022 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-de135091-332c-42e2-9d04-08ce0207f7d0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:10.202262 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-de135091-332c-42e2-9d04-08ce0207f7d0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:10.203501 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-de135091-332c-42e2-9d04-08ce0207f7d0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:10.207004 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-de135091-332c-42e2-9d04-08ce0207f7d0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:10.207787 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-de135091-332c-42e2-9d04-08ce0207f7d0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:10.210302 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-de135091-332c-42e2-9d04-08ce0207f7d0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:10.249529 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-de4618b2-a176-4a24-8393-baac11ca553c tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.471780 Aug 31 15:53:10.259098 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 547/1129] 10.222.0.50 () {60 vars in 1180 bytes} [Wed Aug 31 15:53:09 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:53:10.267651 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3c12b026-6386-413c-b7c5-eb4a0c681af2 tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:10.277306 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3c12b026-6386-413c-b7c5-eb4a0c681af2 tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016849 Aug 31 15:53:10.278639 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 548/1130] 10.222.0.50 () {58 vars in 1137 bytes} [Wed Aug 31 15:53:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:53:10.288429 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a80f3f67-e5e4-4783-8419-db55d36ac367 tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] Action: 'create', calling method: .version_select at 0x7fbb46808d30>, body: {"security_group_rule": {"parent_group_id": "338babd0-5179-443d-9890-91ddacc60eb9", "ip_protocol": "tcp", "from_port": 92287595, "to_port": 22}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:53:10.447643 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-a80f3f67-e5e4-4783-8419-db55d36ac367 tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] HTTP exception thrown: Invalid port range 92287595:22. Former value cannot be greater than the later Aug 31 15:53:10.450139 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a80f3f67-e5e4-4783-8419-db55d36ac367 tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] Request method failure captured: Aug 31 15:53:10.450139 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 31 15:53:10.450139 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:53:10.450139 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:53:10.450139 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:53:10.450139 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 144 Aug 31 15:53:10.450139 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:53:10.450139 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:53:10.450139 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:53:10.450139 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:53:10.450139 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4Ph3sZVLMF4oFbNL7OWvRkq8q0JfwD2ESOWQLyfL5jo5TX90MqPPPbny-W1BTSUC4PlzvrucSdfPC3OArelVcarxOjBmtjEGwYaB8z7AvNzsvUit2EmoYh3nNWrpAw6fatYxTcL2ixRiICliKZcG1ROKOkzeC-2BnKrScGh6mKI7u4 Aug 31 15:53:10.450139 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:53:10.450139 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:53:10.450139 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:53:10.450139 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:53:10.450139 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:53:10.450139 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:53:10.450139 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 3bc3b279cb094b5abfc17a9e0f14be75 Aug 31 15:53:10.450139 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-630679065 Aug 31 15:53:10.450139 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:53:10.450139 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:53:10.451635 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3bc3b279cb094b5abfc17a9e0f14be75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3bc3b279cb094b5abfc17a9e0f14be75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3bc3b279cb094b5abfc17a9e0f14be75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3bc3b279cb094b5abfc17a9e0f14be75", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:53:10.451635 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-630679065 Aug 31 15:53:10.451635 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 3bc3b279cb094b5abfc17a9e0f14be75 Aug 31 15:53:10.451635 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-630679065 Aug 31 15:53:10.451635 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-630679065-project Aug 31 15:53:10.451635 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:53:10.451635 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:53:10.451635 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: ebbfb1d55f7646cba9aa9c9995e5daaa Aug 31 15:53:10.451635 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-630679065-project Aug 31 15:53:10.451635 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 15:53:10.451635 n-d-833090-16 devstack@n-api.service[128863]: {"security_group_rule": {"parent_group_id": "338babd0-5179-443d-9890-91ddacc60eb9", "ip_protocol": "tcp", "from_port": 92287595, "to_port": 22}} Aug 31 15:53:10.451635 n-d-833090-16 devstack@n-api.service[128863]: method: Aug 31 15:53:10.452537 n-d-833090-16 devstack@n-api.service[128863]: exception: Invalid port range 92287595:22. Former value cannot be greater than the later Aug 31 15:53:10.452537 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'body': {'security_group_rule': {'parent_group_id': '338babd0-5179-443d-9890-91ddacc60eb9', 'ip_protocol': 'tcp', 'from_port': 92287595, 'to_port': 22}}} Aug 31 15:53:10.452537 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:53:10.452537 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:10.452537 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 31 15:53:10.452537 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 31 15:53:10.452537 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 31 15:53:10.452537 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 31 15:53:10.452537 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 31 15:53:10.452537 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 31 15:53:10.452537 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 31 15:53:10.452537 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 31 15:53:10.452537 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 92287595:22. Former value cannot be greater than the later Aug 31 15:53:10.452537 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:53:10.452537 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:53:10.452537 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:53:10.452537 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:10.452537 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:53:10.452537 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:53:10.453983 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:53:10.453983 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:53:10.453983 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:53:10.453983 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:53:10.453983 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:53:10.453983 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:53:10.453983 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 31 15:53:10.453983 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 31 15:53:10.453983 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 92287595:22. Former value cannot be greater than the later Aug 31 15:53:10.453983 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:53:10.453983 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:53:10.453983 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:53:10.453983 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:10.453983 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:53:10.453983 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:53:10.453983 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:53:10.453983 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:53:10.453983 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 92287595:22. Former value cannot be greater than the later Aug 31 15:53:10.453983 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:53:10.455358 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a80f3f67-e5e4-4783-8419-db55d36ac367 tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] Returning 400 to user: Invalid port range 92287595:22. Former value cannot be greater than the later {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:53:10.455358 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a80f3f67-e5e4-4783-8419-db55d36ac367 tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 121 microversion: 2.1 time: 0.167517 Aug 31 15:53:10.455358 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 549/1131] 10.222.0.50 () {60 vars in 1195 bytes} [Wed Aug 31 15:53:10 2022] POST /compute/v2.1/os-security-group-rules => generated 121 bytes in 173 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 15:53:10.468146 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e947e16b-a334-4614-8004-de123b2b4a52 tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1627738804", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:53:10.503923 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e947e16b-a334-4614-8004-de123b2b4a52 tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.045426 Aug 31 15:53:10.504529 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 550/1132] 10.222.0.50 () {60 vars in 1146 bytes} [Wed Aug 31 15:53:10 2022] POST /compute/v2.1/flavors => generated 499 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:53:10.516149 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dcb5a421-6a7f-4c17-bc5b-69ed143d140b tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] Action: 'create', calling method: .version_select at 0x7fbb46601e50>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-491113292", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:53:10.527791 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-dcb5a421-6a7f-4c17-bc5b-69ed143d140b tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] HTTP exception thrown: Security group id should be uuid Aug 31 15:53:10.531742 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dcb5a421-6a7f-4c17-bc5b-69ed143d140b tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] Request method failure captured: Aug 31 15:53:10.531742 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 31 15:53:10.531742 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:53:10.531742 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:53:10.531742 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:53:10.531742 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 130 Aug 31 15:53:10.531742 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:53:10.531742 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:53:10.531742 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:53:10.531742 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:53:10.531742 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4Ph3sZVLMF4oFbNL7OWvRkq8q0JfwD2ESOWQLyfL5jo5TX90MqPPPbny-W1BTSUC4PlzvrucSdfPC3OArelVcarxOjBmtjEGwYaB8z7AvNzsvUit2EmoYh3nNWrpAw6fatYxTcL2ixRiICliKZcG1ROKOkzeC-2BnKrScGh6mKI7u4 Aug 31 15:53:10.531742 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:53:10.531742 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:53:10.531742 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:53:10.531742 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:53:10.531742 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:53:10.531742 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:53:10.531742 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 3bc3b279cb094b5abfc17a9e0f14be75 Aug 31 15:53:10.531742 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-630679065 Aug 31 15:53:10.531742 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:53:10.531742 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:53:10.533431 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3bc3b279cb094b5abfc17a9e0f14be75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3bc3b279cb094b5abfc17a9e0f14be75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3bc3b279cb094b5abfc17a9e0f14be75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3bc3b279cb094b5abfc17a9e0f14be75", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:53:10.533431 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-630679065 Aug 31 15:53:10.533431 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 3bc3b279cb094b5abfc17a9e0f14be75 Aug 31 15:53:10.533431 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-630679065 Aug 31 15:53:10.533431 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-630679065-project Aug 31 15:53:10.533431 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:53:10.533431 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:53:10.533431 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: ebbfb1d55f7646cba9aa9c9995e5daaa Aug 31 15:53:10.533431 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-630679065-project Aug 31 15:53:10.533431 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 15:53:10.533431 n-d-833090-16 devstack@n-api.service[128863]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-491113292", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 31 15:53:10.533431 n-d-833090-16 devstack@n-api.service[128863]: method: Aug 31 15:53:10.533431 n-d-833090-16 devstack@n-api.service[128863]: exception: Security group id should be uuid Aug 31 15:53:10.534392 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-491113292', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 31 15:53:10.534392 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:53:10.534392 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:10.534392 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Aug 31 15:53:10.534392 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Aug 31 15:53:10.534392 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Aug 31 15:53:10.534392 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 31 15:53:10.534392 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Aug 31 15:53:10.534392 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:53:10.534392 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:53:10.534392 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:53:10.534392 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:10.534392 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:53:10.534392 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:53:10.534392 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:53:10.534392 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:53:10.534392 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:53:10.534392 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:53:10.534392 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:53:10.534392 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:53:10.535633 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 31 15:53:10.535633 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 31 15:53:10.535633 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Aug 31 15:53:10.535633 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:53:10.535633 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:53:10.535633 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:53:10.535633 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:10.535633 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:53:10.535633 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:53:10.535633 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:53:10.535633 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:53:10.535633 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Aug 31 15:53:10.535633 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:53:10.537829 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dcb5a421-6a7f-4c17-bc5b-69ed143d140b tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] Returning 400 to user: Security group id should be uuid {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:53:10.541590 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dcb5a421-6a7f-4c17-bc5b-69ed143d140b tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.030296 Aug 31 15:53:10.542426 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 551/1133] 10.222.0.50 () {60 vars in 1195 bytes} [Wed Aug 31 15:53:10 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 31 15:53:10.559843 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-38fc9c67-bb94-4937-ab26-85e659da8fd6 tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:10.584681 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-38fc9c67-bb94-4937-ab26-85e659da8fd6 tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.028953 Aug 31 15:53:10.588534 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 552/1134] 10.222.0.50 () {58 vars in 1182 bytes} [Wed Aug 31 15:53:10 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 15:53:10.605866 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-de135091-332c-42e2-9d04-08ce0207f7d0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:10.621237 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-de135091-332c-42e2-9d04-08ce0207f7d0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:10.621577 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3985a5b9-49c8-4250-9579-0edb3241c19d tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] Action: 'create', calling method: .version_select at 0x7fbb467ad310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-37389596", "description": "tempest-description-1099388461"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:53:10.635909 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-de135091-332c-42e2-9d04-08ce0207f7d0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:10.650163 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-de135091-332c-42e2-9d04-08ce0207f7d0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a" status: 200 len: 1411 microversion: 2.25 time: 0.493280 Aug 31 15:53:10.653178 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 583/1135] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:53:10 2022] GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a => generated 1411 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:53:10.801123 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ae421a0f-77f6-4fb0-aa1f-b71675a8a837 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:10.802488 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ae421a0f-77f6-4fb0-aa1f-b71675a8a837 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] [instance: ec8bbe5f-2c2c-41b8-bfed-711906394506] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:10.811512 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ae421a0f-77f6-4fb0-aa1f-b71675a8a837 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:10.812108 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ae421a0f-77f6-4fb0-aa1f-b71675a8a837 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:10.812612 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ae421a0f-77f6-4fb0-aa1f-b71675a8a837 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:10.814537 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ae421a0f-77f6-4fb0-aa1f-b71675a8a837 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:10.815091 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ae421a0f-77f6-4fb0-aa1f-b71675a8a837 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:10.815619 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ae421a0f-77f6-4fb0-aa1f-b71675a8a837 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:11.085989 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ae421a0f-77f6-4fb0-aa1f-b71675a8a837 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:11.114911 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ae421a0f-77f6-4fb0-aa1f-b71675a8a837 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:11.127461 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ae421a0f-77f6-4fb0-aa1f-b71675a8a837 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:11.128901 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ae421a0f-77f6-4fb0-aa1f-b71675a8a837 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] 10.222.0.50 "GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506" status: 200 len: 1407 microversion: 2.54 time: 0.336077 Aug 31 15:53:11.136010 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 584/1136] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:53:10 2022] GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506 => generated 1407 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 15:53:11.155333 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4afb85ea-73cb-429a-86ca-5d7a8f24fda7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-725085351", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "6c36be30-5093-4c9c-be28-22b7f059d672"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:53:11.213856 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3985a5b9-49c8-4250-9579-0edb3241c19d tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.614559 Aug 31 15:53:11.217857 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 553/1137] 10.222.0.50 () {60 vars in 1180 bytes} [Wed Aug 31 15:53:10 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:53:11.223772 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0452d191-5ddd-4d11-978d-bb27547955aa tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:11.224674 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0452d191-5ddd-4d11-978d-bb27547955aa tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: c76166e9-e2cf-4253-99e2-3f8d919099ba] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:11.233466 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0452d191-5ddd-4d11-978d-bb27547955aa tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:11.234333 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0452d191-5ddd-4d11-978d-bb27547955aa tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:11.234953 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0452d191-5ddd-4d11-978d-bb27547955aa tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:11.235839 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0452d191-5ddd-4d11-978d-bb27547955aa tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:11.236466 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0452d191-5ddd-4d11-978d-bb27547955aa tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:11.237629 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0452d191-5ddd-4d11-978d-bb27547955aa tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:11.276466 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-4afb85ea-73cb-429a-86ca-5d7a8f24fda7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] validate_networks() for None {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:53:11.567908 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0452d191-5ddd-4d11-978d-bb27547955aa tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6349b0ee9e2142a8a440d4e6ae0703a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33f8cd7d4424157b410b64c7823f480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:11.590546 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0452d191-5ddd-4d11-978d-bb27547955aa tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "GET /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba" status: 200 len: 1390 microversion: 2.1 time: 0.370518 Aug 31 15:53:11.591491 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 554/1138] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:11 2022] GET /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba => generated 1390 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:11.628415 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2411b734-a6ae-4172-b08c-215853200295 tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] Action: 'create', calling method: .version_select at 0x7fbb466bb550>, body: {"security_group_rule": {"parent_group_id": "63808108-14e8-4791-a48f-182f69ff7be1", "ip_protocol": "tempest-999-58907127", "from_port": 22, "to_port": 22}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:53:12.186677 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-2411b734-a6ae-4172-b08c-215853200295 tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] HTTP exception thrown: Invalid IP protocol tempest-999-58907127. Aug 31 15:53:12.188786 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2411b734-a6ae-4172-b08c-215853200295 tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] Request method failure captured: Aug 31 15:53:12.188786 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 31 15:53:12.188786 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:53:12.188786 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:53:12.188786 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:53:12.188786 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 155 Aug 31 15:53:12.188786 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:53:12.188786 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:53:12.188786 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:53:12.188786 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:53:12.188786 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4Ph3sZVLMF4oFbNL7OWvRkq8q0JfwD2ESOWQLyfL5jo5TX90MqPPPbny-W1BTSUC4PlzvrucSdfPC3OArelVcarxOjBmtjEGwYaB8z7AvNzsvUit2EmoYh3nNWrpAw6fatYxTcL2ixRiICliKZcG1ROKOkzeC-2BnKrScGh6mKI7u4 Aug 31 15:53:12.188786 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:53:12.188786 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:53:12.188786 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:53:12.188786 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:53:12.188786 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:53:12.188786 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:53:12.188786 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 3bc3b279cb094b5abfc17a9e0f14be75 Aug 31 15:53:12.188786 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-630679065 Aug 31 15:53:12.188786 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:53:12.188786 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:53:12.190452 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3bc3b279cb094b5abfc17a9e0f14be75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3bc3b279cb094b5abfc17a9e0f14be75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3bc3b279cb094b5abfc17a9e0f14be75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3bc3b279cb094b5abfc17a9e0f14be75", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:53:12.190452 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-630679065 Aug 31 15:53:12.190452 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 3bc3b279cb094b5abfc17a9e0f14be75 Aug 31 15:53:12.190452 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-630679065 Aug 31 15:53:12.190452 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-630679065-project Aug 31 15:53:12.190452 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:53:12.190452 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:53:12.190452 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: ebbfb1d55f7646cba9aa9c9995e5daaa Aug 31 15:53:12.190452 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-630679065-project Aug 31 15:53:12.190452 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 15:53:12.190452 n-d-833090-16 devstack@n-api.service[128863]: {"security_group_rule": {"parent_group_id": "63808108-14e8-4791-a48f-182f69ff7be1", "ip_protocol": "tempest-999-58907127", "from_port": 22, "to_port": 22}} Aug 31 15:53:12.190452 n-d-833090-16 devstack@n-api.service[128863]: method: Aug 31 15:53:12.191257 n-d-833090-16 devstack@n-api.service[128863]: exception: Invalid IP protocol tempest-999-58907127. Aug 31 15:53:12.191257 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'body': {'security_group_rule': {'parent_group_id': '63808108-14e8-4791-a48f-182f69ff7be1', 'ip_protocol': 'tempest-999-58907127', 'from_port': 22, 'to_port': 22}}} Aug 31 15:53:12.191257 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:53:12.191257 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:12.191257 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 31 15:53:12.191257 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 31 15:53:12.191257 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 31 15:53:12.191257 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 31 15:53:12.191257 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 31 15:53:12.191257 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 31 15:53:12.191257 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Aug 31 15:53:12.191257 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Aug 31 15:53:12.191257 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-58907127. Aug 31 15:53:12.191257 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:53:12.191257 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:53:12.191257 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:53:12.191257 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:12.191257 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:53:12.191257 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:53:12.192424 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:53:12.192424 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:53:12.192424 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:53:12.192424 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:53:12.192424 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:53:12.192424 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:53:12.192424 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 31 15:53:12.192424 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 31 15:53:12.192424 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-58907127. Aug 31 15:53:12.192424 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:53:12.192424 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:53:12.192424 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:53:12.192424 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:12.192424 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:53:12.192424 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:53:12.192424 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:53:12.192424 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:53:12.192424 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-58907127. Aug 31 15:53:12.192424 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:53:12.195072 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2411b734-a6ae-4172-b08c-215853200295 tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] Returning 400 to user: Invalid IP protocol tempest-999-58907127. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:53:12.196170 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2411b734-a6ae-4172-b08c-215853200295 tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 85 microversion: 2.1 time: 0.586397 Aug 31 15:53:12.197127 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 555/1139] 10.222.0.50 () {60 vars in 1195 bytes} [Wed Aug 31 15:53:11 2022] POST /compute/v2.1/os-security-group-rules => generated 85 bytes in 588 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 31 15:53:12.218293 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-4afb85ea-73cb-429a-86ca-5d7a8f24fda7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:53:12.219986 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-4afb85ea-73cb-429a-86ca-5d7a8f24fda7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:53:12.220848 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-4afb85ea-73cb-429a-86ca-5d7a8f24fda7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:53:12.222351 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-4afb85ea-73cb-429a-86ca-5d7a8f24fda7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:53:12.223792 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-4afb85ea-73cb-429a-86ca-5d7a8f24fda7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:53:12.235734 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4afb85ea-73cb-429a-86ca-5d7a8f24fda7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:12.236220 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4afb85ea-73cb-429a-86ca-5d7a8f24fda7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:12.236650 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4afb85ea-73cb-429a-86ca-5d7a8f24fda7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:12.237437 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4afb85ea-73cb-429a-86ca-5d7a8f24fda7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:12.238189 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4afb85ea-73cb-429a-86ca-5d7a8f24fda7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:12.238615 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4afb85ea-73cb-429a-86ca-5d7a8f24fda7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:12.258305 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-4afb85ea-73cb-429a-86ca-5d7a8f24fda7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Getting quotas for project 9b4c50ece07f441b8974d384f4ab29a4. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:53:12.265215 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-4afb85ea-73cb-429a-86ca-5d7a8f24fda7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Getting quotas for user 5f6f8b9d63234b8199c60f842a3c407f and project 9b4c50ece07f441b8974d384f4ab29a4. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:53:12.278836 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4afb85ea-73cb-429a-86ca-5d7a8f24fda7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:53:12.284219 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4afb85ea-73cb-429a-86ca-5d7a8f24fda7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 04a4f94b-5820-4bbe-a9b0-7fa55a697e09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:53:12.351573 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4afb85ea-73cb-429a-86ca-5d7a8f24fda7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.214293 Aug 31 15:53:12.354494 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 585/1140] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:53:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1218 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 15:53:12.370049 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-67468887-4703-493b-b577-b2069c253db7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:12.371005 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-67468887-4703-493b-b577-b2069c253db7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:12.401805 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-67468887-4703-493b-b577-b2069c253db7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:12.403793 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-67468887-4703-493b-b577-b2069c253db7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:12.405813 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-67468887-4703-493b-b577-b2069c253db7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:12.408883 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-67468887-4703-493b-b577-b2069c253db7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:12.409729 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-67468887-4703-493b-b577-b2069c253db7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:12.410443 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-67468887-4703-493b-b577-b2069c253db7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:12.666037 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f5bb3dff-1b30-4a76-a0e2-30885ea92ed2 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-2016561975", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "9ddd3c53-8c58-42c7-9738-29f60f85ca75"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:53:12.704322 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-67468887-4703-493b-b577-b2069c253db7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:12.714437 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-67468887-4703-493b-b577-b2069c253db7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:12.717143 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-67468887-4703-493b-b577-b2069c253db7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:12.719476 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-67468887-4703-493b-b577-b2069c253db7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a" status: 200 len: 1606 microversion: 2.25 time: 0.363609 Aug 31 15:53:12.720600 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 586/1141] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:53:12 2022] GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a => generated 1606 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:53:12.727347 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-110b6469-c35c-4214-9241-813c27a1e72f req-5eda97ce-4f1b-4174-a72e-de0f45649f7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c76166e9-e2cf-4253-99e2-3f8d919099ba", "name": "network-vif-plugged", "status": "completed", "tag": "3e098f5c-9a2b-4fa2-8406-5975188f6f3a"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:53:12.754976 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-110b6469-c35c-4214-9241-813c27a1e72f req-5eda97ce-4f1b-4174-a72e-de0f45649f7a service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:12.759878 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-110b6469-c35c-4214-9241-813c27a1e72f req-5eda97ce-4f1b-4174-a72e-de0f45649f7a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:12.760541 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-110b6469-c35c-4214-9241-813c27a1e72f req-5eda97ce-4f1b-4174-a72e-de0f45649f7a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:12.773687 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-110b6469-c35c-4214-9241-813c27a1e72f req-5eda97ce-4f1b-4174-a72e-de0f45649f7a service nova] Creating event network-vif-plugged:3e098f5c-9a2b-4fa2-8406-5975188f6f3a for instance c76166e9-e2cf-4253-99e2-3f8d919099ba on n-h2-833090-16 Aug 31 15:53:12.779253 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-110b6469-c35c-4214-9241-813c27a1e72f req-5eda97ce-4f1b-4174-a72e-de0f45649f7a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057152 Aug 31 15:53:12.779849 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 587/1142] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:53:12.790305 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3dd96ccb-5f96-40c8-b8ae-0ed60fd85754 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:12.791009 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3dd96ccb-5f96-40c8-b8ae-0ed60fd85754 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] [instance: ec8bbe5f-2c2c-41b8-bfed-711906394506] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:12.797505 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3dd96ccb-5f96-40c8-b8ae-0ed60fd85754 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:12.797988 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3dd96ccb-5f96-40c8-b8ae-0ed60fd85754 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:12.798430 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-f5bb3dff-1b30-4a76-a0e2-30885ea92ed2 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] validate_networks() for [('9ddd3c53-8c58-42c7-9738-29f60f85ca75', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:53:12.798568 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3dd96ccb-5f96-40c8-b8ae-0ed60fd85754 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:12.799138 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3dd96ccb-5f96-40c8-b8ae-0ed60fd85754 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:12.799589 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3dd96ccb-5f96-40c8-b8ae-0ed60fd85754 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:12.800252 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3dd96ccb-5f96-40c8-b8ae-0ed60fd85754 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:12.942610 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3dd96ccb-5f96-40c8-b8ae-0ed60fd85754 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:12.949732 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=100 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:53:12.953071 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3dd96ccb-5f96-40c8-b8ae-0ed60fd85754 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:12.954632 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3dd96ccb-5f96-40c8-b8ae-0ed60fd85754 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:12.955861 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3dd96ccb-5f96-40c8-b8ae-0ed60fd85754 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] 10.222.0.50 "GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506" status: 200 len: 1407 microversion: 2.54 time: 0.171170 Aug 31 15:53:12.970874 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 588/1143] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:53:12 2022] GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506 => generated 1407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:53:12.978422 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7a8425a8-4ff0-49eb-933e-510ffb4daeea tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] Action: 'create', calling method: .version_select at 0x7fbb4ac61f70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-826146573", "description": "tempest-description-933314320"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:53:13.468415 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7a8425a8-4ff0-49eb-933e-510ffb4daeea tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.496189 Aug 31 15:53:13.470112 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 589/1144] 10.222.0.50 () {60 vars in 1180 bytes} [Wed Aug 31 15:53:12 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:53:13.484410 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-cdab45bc-3536-4bda-b8df-83372cff7417 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:13.485126 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-cdab45bc-3536-4bda-b8df-83372cff7417 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 04a4f94b-5820-4bbe-a9b0-7fa55a697e09] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:13.502316 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cdab45bc-3536-4bda-b8df-83372cff7417 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:13.503218 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cdab45bc-3536-4bda-b8df-83372cff7417 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:13.503672 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cdab45bc-3536-4bda-b8df-83372cff7417 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:13.504381 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cdab45bc-3536-4bda-b8df-83372cff7417 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:13.504837 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cdab45bc-3536-4bda-b8df-83372cff7417 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:13.505256 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cdab45bc-3536-4bda-b8df-83372cff7417 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:13.523527 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-f5bb3dff-1b30-4a76-a0e2-30885ea92ed2 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:53:13.524336 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-f5bb3dff-1b30-4a76-a0e2-30885ea92ed2 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:53:13.526248 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-f5bb3dff-1b30-4a76-a0e2-30885ea92ed2 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:53:13.526823 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-f5bb3dff-1b30-4a76-a0e2-30885ea92ed2 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:53:13.527429 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-f5bb3dff-1b30-4a76-a0e2-30885ea92ed2 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:53:13.537880 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5bb3dff-1b30-4a76-a0e2-30885ea92ed2 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:13.538820 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5bb3dff-1b30-4a76-a0e2-30885ea92ed2 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:13.539303 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5bb3dff-1b30-4a76-a0e2-30885ea92ed2 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:13.540147 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5bb3dff-1b30-4a76-a0e2-30885ea92ed2 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:13.540596 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5bb3dff-1b30-4a76-a0e2-30885ea92ed2 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:13.541013 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5bb3dff-1b30-4a76-a0e2-30885ea92ed2 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:13.564367 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-f5bb3dff-1b30-4a76-a0e2-30885ea92ed2 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Getting quotas for project 7d9759d18563406e954d97c6bcb0718c. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:53:13.572758 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-f5bb3dff-1b30-4a76-a0e2-30885ea92ed2 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Getting quotas for user 5b5489a5053e481683354d9b1541dee5 and project 7d9759d18563406e954d97c6bcb0718c. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:53:13.584657 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-cdab45bc-3536-4bda-b8df-83372cff7417 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:13.588007 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f5bb3dff-1b30-4a76-a0e2-30885ea92ed2 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:53:13.590677 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f5bb3dff-1b30-4a76-a0e2-30885ea92ed2 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] [instance: 6fd0e478-c48e-4bf0-b934-374fd737e10e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:53:13.595103 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-cdab45bc-3536-4bda-b8df-83372cff7417 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09" status: 200 len: 1330 microversion: 2.1 time: 0.114679 Aug 31 15:53:13.610186 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 590/1145] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:13 2022] GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09 => generated 1330 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:13.617896 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ec890414-d3db-436e-b9c4-2f355ce2201f tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:13.618940 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ec890414-d3db-436e-b9c4-2f355ce2201f tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: c76166e9-e2cf-4253-99e2-3f8d919099ba] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:13.625911 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ec890414-d3db-436e-b9c4-2f355ce2201f tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:13.626452 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ec890414-d3db-436e-b9c4-2f355ce2201f tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:13.626891 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ec890414-d3db-436e-b9c4-2f355ce2201f tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:13.627615 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ec890414-d3db-436e-b9c4-2f355ce2201f tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:13.628291 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ec890414-d3db-436e-b9c4-2f355ce2201f tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:13.629006 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ec890414-d3db-436e-b9c4-2f355ce2201f tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:13.643831 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f5bb3dff-1b30-4a76-a0e2-30885ea92ed2 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.445268 Aug 31 15:53:13.645121 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 556/1146] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:53:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1447 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 15:53:13.797911 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8afac83a-66ec-42db-9bb1-9776d837b341 tempest-FlavorsV2NegativeTest-1634663984 tempest-FlavorsV2NegativeTest-1634663984-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:13.814183 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8afac83a-66ec-42db-9bb1-9776d837b341 tempest-FlavorsV2NegativeTest-1634663984 tempest-FlavorsV2NegativeTest-1634663984-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.167520 Aug 31 15:53:13.815580 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ec890414-d3db-436e-b9c4-2f355ce2201f tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6349b0ee9e2142a8a440d4e6ae0703a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33f8cd7d4424157b410b64c7823f480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:13.825917 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ec890414-d3db-436e-b9c4-2f355ce2201f tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "GET /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba" status: 200 len: 1390 microversion: 2.1 time: 0.214167 Aug 31 15:53:13.827082 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 557/1147] 10.222.0.50 () {58 vars in 1137 bytes} [Wed Aug 31 15:53:13 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:53:13.827323 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 591/1148] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:13 2022] GET /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba => generated 1390 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:13.832743 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-067f0fa6-88a8-4b82-bc52-1cf28883385a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:13.833231 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-067f0fa6-88a8-4b82-bc52-1cf28883385a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:13.839417 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-067f0fa6-88a8-4b82-bc52-1cf28883385a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:13.839906 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-067f0fa6-88a8-4b82-bc52-1cf28883385a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:13.840340 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-067f0fa6-88a8-4b82-bc52-1cf28883385a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:13.841031 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-067f0fa6-88a8-4b82-bc52-1cf28883385a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:13.841481 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-067f0fa6-88a8-4b82-bc52-1cf28883385a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:13.841898 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-067f0fa6-88a8-4b82-bc52-1cf28883385a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:13.842695 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-54d86023-b1a1-47d0-9741-5c1a8e1f39f3 tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] Action: 'create', calling method: .version_select at 0x7fbb467524c0>, body: {"security_group_rule": {"parent_group_id": "62846c97-f865-42ae-a181-f71cb0bf1409", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:53:13.976353 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-54d86023-b1a1-47d0-9741-5c1a8e1f39f3 tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Aug 31 15:53:13.980755 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-54d86023-b1a1-47d0-9741-5c1a8e1f39f3 tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] Request method failure captured: Aug 31 15:53:13.980755 n-d-833090-16 devstack@n-api.service[128864]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 31 15:53:13.980755 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:53:13.980755 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:53:13.980755 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:53:13.980755 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 138 Aug 31 15:53:13.980755 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:53:13.980755 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:53:13.980755 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:53:13.980755 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:53:13.980755 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4Ph3sZVLMF4oFbNL7OWvRkq8q0JfwD2ESOWQLyfL5jo5TX90MqPPPbny-W1BTSUC4PlzvrucSdfPC3OArelVcarxOjBmtjEGwYaB8z7AvNzsvUit2EmoYh3nNWrpAw6fatYxTcL2ixRiICliKZcG1ROKOkzeC-2BnKrScGh6mKI7u4 Aug 31 15:53:13.980755 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:53:13.980755 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:53:13.980755 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:53:13.980755 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:53:13.980755 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:53:13.980755 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:53:13.980755 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 3bc3b279cb094b5abfc17a9e0f14be75 Aug 31 15:53:13.980755 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-630679065 Aug 31 15:53:13.980755 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:53:13.980755 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:53:13.982309 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3bc3b279cb094b5abfc17a9e0f14be75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3bc3b279cb094b5abfc17a9e0f14be75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3bc3b279cb094b5abfc17a9e0f14be75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3bc3b279cb094b5abfc17a9e0f14be75", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:53:13.982309 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-630679065 Aug 31 15:53:13.982309 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 3bc3b279cb094b5abfc17a9e0f14be75 Aug 31 15:53:13.982309 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-630679065 Aug 31 15:53:13.982309 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-630679065-project Aug 31 15:53:13.982309 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:53:13.982309 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:53:13.982309 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: ebbfb1d55f7646cba9aa9c9995e5daaa Aug 31 15:53:13.982309 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-630679065-project Aug 31 15:53:13.982309 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 15:53:13.982309 n-d-833090-16 devstack@n-api.service[128864]: {"security_group_rule": {"parent_group_id": "62846c97-f865-42ae-a181-f71cb0bf1409", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Aug 31 15:53:13.982309 n-d-833090-16 devstack@n-api.service[128864]: method: Aug 31 15:53:13.983164 n-d-833090-16 devstack@n-api.service[128864]: exception: Invalid port range 22:21. Former value cannot be greater than the later Aug 31 15:53:13.983164 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'body': {'security_group_rule': {'parent_group_id': '62846c97-f865-42ae-a181-f71cb0bf1409', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Aug 31 15:53:13.983164 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:53:13.983164 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:13.983164 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 31 15:53:13.983164 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 31 15:53:13.983164 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 31 15:53:13.983164 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 31 15:53:13.983164 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 31 15:53:13.983164 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 31 15:53:13.983164 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 31 15:53:13.983164 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 31 15:53:13.983164 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Aug 31 15:53:13.983164 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:53:13.983164 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:53:13.983164 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:53:13.983164 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:13.983164 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:53:13.983164 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:53:13.984520 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:53:13.984520 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:53:13.984520 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:53:13.984520 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:53:13.984520 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:53:13.984520 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:53:13.984520 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 31 15:53:13.984520 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 31 15:53:13.984520 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Aug 31 15:53:13.984520 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:53:13.984520 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:53:13.984520 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:53:13.984520 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:13.984520 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:53:13.984520 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:53:13.984520 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:53:13.984520 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:53:13.984520 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Aug 31 15:53:13.984520 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:53:13.986844 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-54d86023-b1a1-47d0-9741-5c1a8e1f39f3 tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:53:13.987983 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-54d86023-b1a1-47d0-9741-5c1a8e1f39f3 tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.159470 Aug 31 15:53:13.991362 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 592/1149] 10.222.0.50 () {60 vars in 1195 bytes} [Wed Aug 31 15:53:13 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 163 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 15:53:14.000235 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3312d5e1-6758-46e3-96d5-1603fa0dabfe tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:14.004945 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3312d5e1-6758-46e3-96d5-1603fa0dabfe tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] [instance: 6fd0e478-c48e-4bf0-b934-374fd737e10e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:14.042494 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-067f0fa6-88a8-4b82-bc52-1cf28883385a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.214097 Aug 31 15:53:14.043096 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 558/1150] 10.222.0.50 () {60 vars in 1316 bytes} [Wed Aug 31 15:53:13 2022] GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a/os-interface => generated 285 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:53:14.049885 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f49c7e08-04b6-46c6-a60a-0601efaf5978 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:14.051488 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f49c7e08-04b6-46c6-a60a-0601efaf5978 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] [instance: ec8bbe5f-2c2c-41b8-bfed-711906394506] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:14.066324 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f49c7e08-04b6-46c6-a60a-0601efaf5978 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:14.070250 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f49c7e08-04b6-46c6-a60a-0601efaf5978 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:14.071153 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f49c7e08-04b6-46c6-a60a-0601efaf5978 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:14.072190 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f49c7e08-04b6-46c6-a60a-0601efaf5978 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:14.072986 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f49c7e08-04b6-46c6-a60a-0601efaf5978 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:14.073570 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f49c7e08-04b6-46c6-a60a-0601efaf5978 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:14.110782 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3312d5e1-6758-46e3-96d5-1603fa0dabfe tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5489a5053e481683354d9b1541dee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9759d18563406e954d97c6bcb0718c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:14.119028 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3312d5e1-6758-46e3-96d5-1603fa0dabfe tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] 10.222.0.50 "GET /compute/v2.1/servers/6fd0e478-c48e-4bf0-b934-374fd737e10e" status: 200 len: 1216 microversion: 2.1 time: 0.126405 Aug 31 15:53:14.135602 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 593/1151] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:13 2022] GET /compute/v2.1/servers/6fd0e478-c48e-4bf0-b934-374fd737e10e => generated 1216 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:14.150261 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-945d5c9d-a3fc-4f84-b8ba-f63cffd4a0de tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] Action: 'create', calling method: .version_select at 0x7fbb46ac50d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1083374256", "description": "tempest-description-511900424"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:53:14.268830 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f49c7e08-04b6-46c6-a60a-0601efaf5978 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:14.292060 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f49c7e08-04b6-46c6-a60a-0601efaf5978 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:14.297116 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f49c7e08-04b6-46c6-a60a-0601efaf5978 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:14.301299 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f49c7e08-04b6-46c6-a60a-0601efaf5978 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] 10.222.0.50 "GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506" status: 200 len: 1407 microversion: 2.54 time: 0.256001 Aug 31 15:53:14.304334 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 559/1152] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:53:14 2022] GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506 => generated 1407 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:53:14.619112 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-90b22d4b-27f1-407f-afc6-e417b39b8367 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:14.619799 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-90b22d4b-27f1-407f-afc6-e417b39b8367 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 04a4f94b-5820-4bbe-a9b0-7fa55a697e09] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:14.655766 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-90b22d4b-27f1-407f-afc6-e417b39b8367 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:14.656286 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-90b22d4b-27f1-407f-afc6-e417b39b8367 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:14.657501 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-90b22d4b-27f1-407f-afc6-e417b39b8367 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:14.658409 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-90b22d4b-27f1-407f-afc6-e417b39b8367 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:14.659169 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-90b22d4b-27f1-407f-afc6-e417b39b8367 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:14.660140 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-90b22d4b-27f1-407f-afc6-e417b39b8367 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:14.696893 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-945d5c9d-a3fc-4f84-b8ba-f63cffd4a0de tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.560170 Aug 31 15:53:14.698043 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 594/1153] 10.222.0.50 () {60 vars in 1180 bytes} [Wed Aug 31 15:53:14 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:53:14.711338 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-88738943-01e1-4039-99a7-5c65303f24f8 tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] Action: 'create', calling method: .version_select at 0x7fbb4ac61f70>, body: {"security_group_rule": {"parent_group_id": "39a7a32f-a4ff-4cd0-a2eb-7f46f90d3859", "ip_protocol": "tcp", "from_port": 22, "to_port": 486792906}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:53:14.813561 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-90b22d4b-27f1-407f-afc6-e417b39b8367 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:14.824222 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-90b22d4b-27f1-407f-afc6-e417b39b8367 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09" status: 200 len: 1336 microversion: 2.1 time: 0.211088 Aug 31 15:53:14.824809 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 560/1154] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:14 2022] GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09 => generated 1336 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:53:14.826167 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-88738943-01e1-4039-99a7-5c65303f24f8 tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] HTTP exception thrown: Invalid port range 22:486792906. Valid TCP ports should be between 1-65535 Aug 31 15:53:14.828051 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-88738943-01e1-4039-99a7-5c65303f24f8 tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] Request method failure captured: Aug 31 15:53:14.828051 n-d-833090-16 devstack@n-api.service[128864]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 31 15:53:14.828051 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:53:14.828051 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:53:14.828051 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:53:14.828051 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 145 Aug 31 15:53:14.828051 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:53:14.828051 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:53:14.828051 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:53:14.828051 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:53:14.828051 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4Ph3sZVLMF4oFbNL7OWvRkq8q0JfwD2ESOWQLyfL5jo5TX90MqPPPbny-W1BTSUC4PlzvrucSdfPC3OArelVcarxOjBmtjEGwYaB8z7AvNzsvUit2EmoYh3nNWrpAw6fatYxTcL2ixRiICliKZcG1ROKOkzeC-2BnKrScGh6mKI7u4 Aug 31 15:53:14.828051 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:53:14.828051 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:53:14.828051 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:53:14.828051 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:53:14.828051 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:53:14.828051 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:53:14.828051 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 3bc3b279cb094b5abfc17a9e0f14be75 Aug 31 15:53:14.828051 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-630679065 Aug 31 15:53:14.828051 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:53:14.828051 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:53:14.829669 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3bc3b279cb094b5abfc17a9e0f14be75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3bc3b279cb094b5abfc17a9e0f14be75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3bc3b279cb094b5abfc17a9e0f14be75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3bc3b279cb094b5abfc17a9e0f14be75", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:53:14.829669 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-630679065 Aug 31 15:53:14.829669 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 3bc3b279cb094b5abfc17a9e0f14be75 Aug 31 15:53:14.829669 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-630679065 Aug 31 15:53:14.829669 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-630679065-project Aug 31 15:53:14.829669 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:53:14.829669 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:53:14.829669 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: ebbfb1d55f7646cba9aa9c9995e5daaa Aug 31 15:53:14.829669 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-630679065-project Aug 31 15:53:14.829669 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 15:53:14.829669 n-d-833090-16 devstack@n-api.service[128864]: {"security_group_rule": {"parent_group_id": "39a7a32f-a4ff-4cd0-a2eb-7f46f90d3859", "ip_protocol": "tcp", "from_port": 22, "to_port": 486792906}} Aug 31 15:53:14.829669 n-d-833090-16 devstack@n-api.service[128864]: method: Aug 31 15:53:14.830606 n-d-833090-16 devstack@n-api.service[128864]: exception: Invalid port range 22:486792906. Valid TCP ports should be between 1-65535 Aug 31 15:53:14.830606 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'body': {'security_group_rule': {'parent_group_id': '39a7a32f-a4ff-4cd0-a2eb-7f46f90d3859', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 486792906}}} Aug 31 15:53:14.830606 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:53:14.830606 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:14.830606 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 31 15:53:14.830606 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 31 15:53:14.830606 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 31 15:53:14.830606 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 31 15:53:14.830606 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 31 15:53:14.830606 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 31 15:53:14.830606 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Aug 31 15:53:14.830606 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 31 15:53:14.830606 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:486792906. Valid TCP ports should be between 1-65535 Aug 31 15:53:14.830606 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:53:14.830606 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:53:14.830606 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:53:14.830606 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:14.830606 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:53:14.830606 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:53:14.832224 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:53:14.832224 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:53:14.832224 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:53:14.832224 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:53:14.832224 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:53:14.832224 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:53:14.832224 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 31 15:53:14.832224 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 31 15:53:14.832224 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:486792906. Valid TCP ports should be between 1-65535 Aug 31 15:53:14.832224 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:53:14.832224 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:53:14.832224 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:53:14.832224 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:14.832224 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:53:14.832224 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:53:14.832224 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:53:14.832224 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:53:14.832224 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:486792906. Valid TCP ports should be between 1-65535 Aug 31 15:53:14.832224 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:53:14.834480 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-88738943-01e1-4039-99a7-5c65303f24f8 tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] Returning 400 to user: Invalid port range 22:486792906. Valid TCP ports should be between 1-65535 {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:53:14.835511 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-88738943-01e1-4039-99a7-5c65303f24f8 tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.128847 Aug 31 15:53:14.836448 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 595/1155] 10.222.0.50 () {60 vars in 1195 bytes} [Wed Aug 31 15:53:14 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 130 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 31 15:53:14.849658 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a232817e-dd2a-42cf-837b-bd9280ee5af9 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:14.850309 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a232817e-dd2a-42cf-837b-bd9280ee5af9 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: c76166e9-e2cf-4253-99e2-3f8d919099ba] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:14.850769 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-61684e99-fbe5-4ed8-90a4-6729d9a43bab tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] Action: 'create', calling method: .version_select at 0x7fbb4ac57820>, body: {"security_group_rule": {"parent_group_id": "6a48871b-465e-49a6-9bf5-d4024cccf74a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:53:14.863299 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a232817e-dd2a-42cf-837b-bd9280ee5af9 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:14.863799 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a232817e-dd2a-42cf-837b-bd9280ee5af9 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:14.864231 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a232817e-dd2a-42cf-837b-bd9280ee5af9 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:14.864937 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a232817e-dd2a-42cf-837b-bd9280ee5af9 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:14.865386 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a232817e-dd2a-42cf-837b-bd9280ee5af9 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:14.865801 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a232817e-dd2a-42cf-837b-bd9280ee5af9 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:14.897196 n-d-833090-16 devstack@n-api.service[128864]: DEBUG neutronclient.v2_0.client [None req-61684e99-fbe5-4ed8-90a4-6729d9a43bab tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6a48871b-465e-49a6-9bf5-d4024cccf74a does not exist", "detail": ""}} {{(pid=128864) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 31 15:53:14.898136 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.security_group_api [None req-61684e99-fbe5-4ed8-90a4-6729d9a43bab tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] Neutron security group 6a48871b-465e-49a6-9bf5-d4024cccf74a not found {{(pid=128864) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 31 15:53:14.898816 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-61684e99-fbe5-4ed8-90a4-6729d9a43bab tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] HTTP exception thrown: Security group 6a48871b-465e-49a6-9bf5-d4024cccf74a does not exist Aug 31 15:53:14.898816 n-d-833090-16 devstack@n-api.service[128864]: Neutron server returns request_ids: ['req-8ece7be7-d86c-4ad8-b004-57763cd2dd69'] Aug 31 15:53:14.901113 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-61684e99-fbe5-4ed8-90a4-6729d9a43bab tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] Request method failure captured: Aug 31 15:53:14.901113 n-d-833090-16 devstack@n-api.service[128864]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 31 15:53:14.901113 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:53:14.901113 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:53:14.901113 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:53:14.901113 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 138 Aug 31 15:53:14.901113 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:53:14.901113 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:53:14.901113 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:53:14.901113 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:53:14.901113 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4Ph3sZVLMF4oFbNL7OWvRkq8q0JfwD2ESOWQLyfL5jo5TX90MqPPPbny-W1BTSUC4PlzvrucSdfPC3OArelVcarxOjBmtjEGwYaB8z7AvNzsvUit2EmoYh3nNWrpAw6fatYxTcL2ixRiICliKZcG1ROKOkzeC-2BnKrScGh6mKI7u4 Aug 31 15:53:14.901113 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:53:14.901113 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:53:14.901113 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:53:14.901113 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:53:14.901113 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:53:14.901113 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:53:14.901113 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 3bc3b279cb094b5abfc17a9e0f14be75 Aug 31 15:53:14.901113 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-630679065 Aug 31 15:53:14.901113 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:53:14.901113 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:53:14.902942 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3bc3b279cb094b5abfc17a9e0f14be75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3bc3b279cb094b5abfc17a9e0f14be75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3bc3b279cb094b5abfc17a9e0f14be75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3bc3b279cb094b5abfc17a9e0f14be75", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:53:14.902942 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-630679065 Aug 31 15:53:14.902942 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 3bc3b279cb094b5abfc17a9e0f14be75 Aug 31 15:53:14.902942 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-630679065 Aug 31 15:53:14.902942 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-630679065-project Aug 31 15:53:14.902942 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:53:14.902942 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:53:14.902942 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: ebbfb1d55f7646cba9aa9c9995e5daaa Aug 31 15:53:14.902942 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-630679065-project Aug 31 15:53:14.902942 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 15:53:14.902942 n-d-833090-16 devstack@n-api.service[128864]: {"security_group_rule": {"parent_group_id": "6a48871b-465e-49a6-9bf5-d4024cccf74a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 31 15:53:14.902942 n-d-833090-16 devstack@n-api.service[128864]: method: Aug 31 15:53:14.910471 n-d-833090-16 devstack@n-api.service[128864]: exception: Security group 6a48871b-465e-49a6-9bf5-d4024cccf74a does not exist Aug 31 15:53:14.910471 n-d-833090-16 devstack@n-api.service[128864]: Neutron server returns request_ids: ['req-8ece7be7-d86c-4ad8-b004-57763cd2dd69'] Aug 31 15:53:14.910471 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'body': {'security_group_rule': {'parent_group_id': '6a48871b-465e-49a6-9bf5-d4024cccf74a', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 31 15:53:14.910471 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:53:14.910471 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:14.910471 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 31 15:53:14.910471 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 31 15:53:14.910471 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 15:53:14.910471 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 15:53:14.910471 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 31 15:53:14.910471 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 31 15:53:14.910471 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 15:53:14.910471 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 15:53:14.910471 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 31 15:53:14.910471 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 31 15:53:14.910471 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 15:53:14.910471 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 15:53:14.910471 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 31 15:53:14.910471 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 31 15:53:14.912753 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 15:53:14.912753 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 15:53:14.912753 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 31 15:53:14.912753 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 31 15:53:14.912753 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 15:53:14.912753 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 15:53:14.912753 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 31 15:53:14.912753 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 31 15:53:14.912753 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 31 15:53:14.912753 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 31 15:53:14.912753 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6a48871b-465e-49a6-9bf5-d4024cccf74a does not exist Aug 31 15:53:14.912753 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8ece7be7-d86c-4ad8-b004-57763cd2dd69'] Aug 31 15:53:14.912753 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:53:14.912753 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:53:14.912753 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:53:14.912753 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:14.912753 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Aug 31 15:53:14.912753 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Aug 31 15:53:14.912753 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 31 15:53:14.916213 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 31 15:53:14.916213 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6a48871b-465e-49a6-9bf5-d4024cccf74a does not exist Aug 31 15:53:14.916213 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8ece7be7-d86c-4ad8-b004-57763cd2dd69'] Aug 31 15:53:14.916213 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:53:14.916213 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:53:14.916213 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:53:14.916213 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:14.916213 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:53:14.916213 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:53:14.916213 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:53:14.916213 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:53:14.916213 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:53:14.916213 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:53:14.916213 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:53:14.916213 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:53:14.916213 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Aug 31 15:53:14.916213 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 31 15:53:14.916213 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6a48871b-465e-49a6-9bf5-d4024cccf74a does not exist Aug 31 15:53:14.916213 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8ece7be7-d86c-4ad8-b004-57763cd2dd69'] Aug 31 15:53:14.916213 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:53:14.920391 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:53:14.920391 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:53:14.920391 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:14.920391 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:53:14.920391 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:53:14.920391 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:53:14.920391 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:53:14.920391 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6a48871b-465e-49a6-9bf5-d4024cccf74a does not exist Aug 31 15:53:14.920391 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8ece7be7-d86c-4ad8-b004-57763cd2dd69'] Aug 31 15:53:14.920391 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:53:14.920391 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-61684e99-fbe5-4ed8-90a4-6729d9a43bab tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] Returning 404 to user: Security group 6a48871b-465e-49a6-9bf5-d4024cccf74a does not exist Aug 31 15:53:14.920391 n-d-833090-16 devstack@n-api.service[128864]: Neutron server returns request_ids: ['req-8ece7be7-d86c-4ad8-b004-57763cd2dd69'] {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:53:14.920391 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-61684e99-fbe5-4ed8-90a4-6729d9a43bab tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.057449 Aug 31 15:53:14.924831 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 596/1156] 10.222.0.50 () {60 vars in 1195 bytes} [Wed Aug 31 15:53:14 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 15:53:14.924991 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:53:14.925212 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1c2f41c8-cdb1-40e6-b6c2-f575e0fd44df tempest-FlavorsV2NegativeTest-1634663984 tempest-FlavorsV2NegativeTest-1634663984-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1016399981", "imageRef": "96bc7acb-a924-4dff-ac3f-a873f554c708", "flavorRef": "452"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:53:14.991228 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-1c2f41c8-cdb1-40e6-b6c2-f575e0fd44df tempest-FlavorsV2NegativeTest-1634663984 tempest-FlavorsV2NegativeTest-1634663984-project] validate_networks() for None {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:53:15.373277 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a232817e-dd2a-42cf-837b-bd9280ee5af9 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6349b0ee9e2142a8a440d4e6ae0703a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33f8cd7d4424157b410b64c7823f480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:15.383179 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a232817e-dd2a-42cf-837b-bd9280ee5af9 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "GET /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba" status: 200 len: 1390 microversion: 2.1 time: 0.538583 Aug 31 15:53:15.388958 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 561/1157] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:14 2022] GET /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba => generated 1390 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:15.395421 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a9552274-2a62-43d9-aa9e-f242957720f6 tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] Calling method '.version_select at 0x7fbb466bbb80>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:15.499789 n-d-833090-16 devstack@n-api.service[128863]: DEBUG neutronclient.v2_0.client [None req-a9552274-2a62-43d9-aa9e-f242957720f6 tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 6eb85891-16da-4b85-af68-52a0145edfc9 does not exist", "detail": ""}} {{(pid=128863) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 31 15:53:15.500631 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.security_group_api [None req-a9552274-2a62-43d9-aa9e-f242957720f6 tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] Neutron security group rule 6eb85891-16da-4b85-af68-52a0145edfc9 not found {{(pid=128863) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Aug 31 15:53:15.502082 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-a9552274-2a62-43d9-aa9e-f242957720f6 tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] HTTP exception thrown: Security group rule 6eb85891-16da-4b85-af68-52a0145edfc9 does not exist Aug 31 15:53:15.502082 n-d-833090-16 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-df398708-8be5-43f9-9c65-1651760978e3'] Aug 31 15:53:15.505390 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a9552274-2a62-43d9-aa9e-f242957720f6 tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] Request method failure captured: Aug 31 15:53:15.505390 n-d-833090-16 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/os-security-group-rules/6eb85891-16da-4b85-af68-52a0145edfc9 HTTP/1.1 Aug 31 15:53:15.505390 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:53:15.505390 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:53:15.505390 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:53:15.505390 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:53:15.505390 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:53:15.505390 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:53:15.505390 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:53:15.505390 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:53:15.505390 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4Ph3sZVLMF4oFbNL7OWvRkq8q0JfwD2ESOWQLyfL5jo5TX90MqPPPbny-W1BTSUC4PlzvrucSdfPC3OArelVcarxOjBmtjEGwYaB8z7AvNzsvUit2EmoYh3nNWrpAw6fatYxTcL2ixRiICliKZcG1ROKOkzeC-2BnKrScGh6mKI7u4 Aug 31 15:53:15.505390 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:53:15.505390 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:53:15.505390 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:53:15.505390 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:53:15.505390 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:53:15.505390 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:53:15.505390 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 3bc3b279cb094b5abfc17a9e0f14be75 Aug 31 15:53:15.505390 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-630679065 Aug 31 15:53:15.505390 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:53:15.505390 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:53:15.506858 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3bc3b279cb094b5abfc17a9e0f14be75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3bc3b279cb094b5abfc17a9e0f14be75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3bc3b279cb094b5abfc17a9e0f14be75"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3bc3b279cb094b5abfc17a9e0f14be75", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:53:15.506858 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-630679065 Aug 31 15:53:15.506858 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 3bc3b279cb094b5abfc17a9e0f14be75 Aug 31 15:53:15.506858 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-630679065 Aug 31 15:53:15.506858 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-630679065-project Aug 31 15:53:15.506858 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:53:15.506858 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:53:15.506858 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: ebbfb1d55f7646cba9aa9c9995e5daaa Aug 31 15:53:15.506858 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-630679065-project Aug 31 15:53:15.506858 n-d-833090-16 devstack@n-api.service[128863]: method: Aug 31 15:53:15.506858 n-d-833090-16 devstack@n-api.service[128863]: exception: Security group rule 6eb85891-16da-4b85-af68-52a0145edfc9 does not exist Aug 31 15:53:15.506858 n-d-833090-16 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-df398708-8be5-43f9-9c65-1651760978e3'] Aug 31 15:53:15.508698 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '6eb85891-16da-4b85-af68-52a0145edfc9'} Aug 31 15:53:15.508698 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:53:15.508698 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:15.508698 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Aug 31 15:53:15.508698 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Aug 31 15:53:15.508698 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 15:53:15.508698 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 15:53:15.508698 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Aug 31 15:53:15.508698 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Aug 31 15:53:15.508698 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 15:53:15.508698 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 15:53:15.508698 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 31 15:53:15.508698 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 31 15:53:15.508698 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 15:53:15.508698 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 15:53:15.508698 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 31 15:53:15.508698 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 31 15:53:15.508698 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 15:53:15.508698 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 15:53:15.510276 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 31 15:53:15.510276 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 31 15:53:15.510276 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 15:53:15.510276 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 15:53:15.510276 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 31 15:53:15.510276 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 31 15:53:15.510276 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 31 15:53:15.510276 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 31 15:53:15.510276 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 6eb85891-16da-4b85-af68-52a0145edfc9 does not exist Aug 31 15:53:15.510276 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-df398708-8be5-43f9-9c65-1651760978e3'] Aug 31 15:53:15.510276 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:53:15.510276 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:53:15.510276 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:53:15.510276 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:15.510276 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Aug 31 15:53:15.510276 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Aug 31 15:53:15.510276 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Aug 31 15:53:15.510276 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 31 15:53:15.513593 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 6eb85891-16da-4b85-af68-52a0145edfc9 does not exist Aug 31 15:53:15.513593 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-df398708-8be5-43f9-9c65-1651760978e3'] Aug 31 15:53:15.513593 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:53:15.513593 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:53:15.513593 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:53:15.513593 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:15.513593 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:53:15.513593 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:53:15.513593 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:53:15.513593 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:53:15.513593 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:53:15.513593 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:53:15.513593 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:53:15.513593 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:53:15.513593 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Aug 31 15:53:15.513593 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 31 15:53:15.513593 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 6eb85891-16da-4b85-af68-52a0145edfc9 does not exist Aug 31 15:53:15.513593 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-df398708-8be5-43f9-9c65-1651760978e3'] Aug 31 15:53:15.513593 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:53:15.513593 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:53:15.519545 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:53:15.519545 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:15.519545 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:53:15.519545 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:53:15.519545 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:53:15.519545 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:53:15.519545 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 6eb85891-16da-4b85-af68-52a0145edfc9 does not exist Aug 31 15:53:15.519545 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-df398708-8be5-43f9-9c65-1651760978e3'] Aug 31 15:53:15.519545 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:53:15.519545 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a9552274-2a62-43d9-aa9e-f242957720f6 tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] Returning 404 to user: Security group rule 6eb85891-16da-4b85-af68-52a0145edfc9 does not exist Aug 31 15:53:15.519545 n-d-833090-16 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-df398708-8be5-43f9-9c65-1651760978e3'] {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:53:15.519545 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a9552274-2a62-43d9-aa9e-f242957720f6 tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-group-rules/6eb85891-16da-4b85-af68-52a0145edfc9" status: 404 len: 199 microversion: 2.1 time: 0.127492 Aug 31 15:53:15.526766 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 562/1158] 10.222.0.50 () {58 vars in 1287 bytes} [Wed Aug 31 15:53:15 2022] DELETE /compute/v2.1/os-security-group-rules/6eb85891-16da-4b85-af68-52a0145edfc9 => generated 199 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:53:15.541700 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e746cb75-a547-482e-a438-0d6395a860dc tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:15.542741 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e746cb75-a547-482e-a438-0d6395a860dc tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] [instance: 6fd0e478-c48e-4bf0-b934-374fd737e10e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:15.553226 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-1c2f41c8-cdb1-40e6-b6c2-f575e0fd44df tempest-FlavorsV2NegativeTest-1634663984 tempest-FlavorsV2NegativeTest-1634663984-project] HTTP exception thrown: Flavor's memory is too small for requested image. Aug 31 15:53:15.554121 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e746cb75-a547-482e-a438-0d6395a860dc tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:15.554839 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e746cb75-a547-482e-a438-0d6395a860dc tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:15.554957 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1c2f41c8-cdb1-40e6-b6c2-f575e0fd44df tempest-FlavorsV2NegativeTest-1634663984 tempest-FlavorsV2NegativeTest-1634663984-project] Request method failure captured: Aug 31 15:53:15.554957 n-d-833090-16 devstack@n-api.service[128864]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 31 15:53:15.554957 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:53:15.554957 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:53:15.554957 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:53:15.554957 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 143 Aug 31 15:53:15.554957 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:53:15.554957 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:53:15.554957 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:53:15.554957 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:53:15.554957 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4PoauFnXJdOX3TjxsvCy-GtuEjQAwWeJhBHtDrz5Mj5nYl0ypmIl3Vwn2UYg4wUuHv1Jj8gSXYqtBRFlZleEhQeSbPoIBIoZwhneSXuQhqMlqYSnJndulGw1f8H_dlDl6y-3ylkVKJLVpCUtsAxT_i7hC7sH3d41VxEhuY8aROIzO8 Aug 31 15:53:15.554957 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:53:15.554957 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:53:15.554957 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:53:15.554957 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:53:15.554957 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:53:15.554957 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:53:15.554957 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 90fb195a14e647efae647fa7513ca7f6 Aug 31 15:53:15.554957 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-FlavorsV2NegativeTest-1634663984 Aug 31 15:53:15.554957 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:53:15.554957 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:53:15.556429 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/90fb195a14e647efae647fa7513ca7f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/90fb195a14e647efae647fa7513ca7f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/90fb195a14e647efae647fa7513ca7f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_90fb195a14e647efae647fa7513ca7f6", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:53:15.556429 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-FlavorsV2NegativeTest-1634663984 Aug 31 15:53:15.556429 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 90fb195a14e647efae647fa7513ca7f6 Aug 31 15:53:15.556429 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1634663984 Aug 31 15:53:15.556429 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-FlavorsV2NegativeTest-1634663984-project Aug 31 15:53:15.556429 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:53:15.556429 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:53:15.556429 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 840c8acfdb864811ada1cd1ea83dc0da Aug 31 15:53:15.556429 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-FlavorsV2NegativeTest-1634663984-project Aug 31 15:53:15.556429 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 15:53:15.556429 n-d-833090-16 devstack@n-api.service[128864]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1016399981", "imageRef": "96bc7acb-a924-4dff-ac3f-a873f554c708", "flavorRef": "452"}} Aug 31 15:53:15.556429 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:53:15.557190 n-d-833090-16 devstack@n-api.service[128864]: exception: Flavor's memory is too small for requested image. Aug 31 15:53:15.557190 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1016399981', 'imageRef': '96bc7acb-a924-4dff-ac3f-a873f554c708', 'flavorRef': '452'}}} Aug 31 15:53:15.557190 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:53:15.557190 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:15.557190 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 31 15:53:15.557190 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 31 15:53:15.557190 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 31 15:53:15.557190 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 31 15:53:15.557190 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Aug 31 15:53:15.557190 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 31 15:53:15.557190 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Aug 31 15:53:15.557190 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Aug 31 15:53:15.557190 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Aug 31 15:53:15.557190 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Aug 31 15:53:15.557190 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Aug 31 15:53:15.557190 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Aug 31 15:53:15.557190 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Aug 31 15:53:15.557190 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:53:15.557190 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:53:15.557190 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:53:15.558653 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:15.558653 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:53:15.558653 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:53:15.558653 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:53:15.558653 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:53:15.558653 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:53:15.558653 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:53:15.558653 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:53:15.558653 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:53:15.558653 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:53:15.558653 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:53:15.558653 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:53:15.558653 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:53:15.558653 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 31 15:53:15.558653 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Aug 31 15:53:15.558653 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 31 15:53:15.558653 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Aug 31 15:53:15.558653 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:53:15.558653 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:53:15.558653 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:53:15.558653 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:15.561737 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:53:15.561737 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:53:15.561737 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:53:15.561737 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:53:15.561737 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Aug 31 15:53:15.561737 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:53:15.561737 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1c2f41c8-cdb1-40e6-b6c2-f575e0fd44df tempest-FlavorsV2NegativeTest-1634663984 tempest-FlavorsV2NegativeTest-1634663984-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:53:15.561737 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1c2f41c8-cdb1-40e6-b6c2-f575e0fd44df tempest-FlavorsV2NegativeTest-1634663984 tempest-FlavorsV2NegativeTest-1634663984-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.652123 Aug 31 15:53:15.561737 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 597/1159] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:53:14 2022] POST /compute/v2.1/servers => generated 93 bytes in 653 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 31 15:53:15.568007 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e746cb75-a547-482e-a438-0d6395a860dc tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:15.569232 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-027ad678-7942-4b7f-b1a0-c5f89d750d2f tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:15.569584 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e746cb75-a547-482e-a438-0d6395a860dc tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:15.569856 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-027ad678-7942-4b7f-b1a0-c5f89d750d2f tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] [instance: ec8bbe5f-2c2c-41b8-bfed-711906394506] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:15.570568 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e746cb75-a547-482e-a438-0d6395a860dc tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:15.571259 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e746cb75-a547-482e-a438-0d6395a860dc tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:15.586228 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-027ad678-7942-4b7f-b1a0-c5f89d750d2f tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:15.586747 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-027ad678-7942-4b7f-b1a0-c5f89d750d2f tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:15.588017 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-027ad678-7942-4b7f-b1a0-c5f89d750d2f tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:15.588017 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-027ad678-7942-4b7f-b1a0-c5f89d750d2f tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:15.588322 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-027ad678-7942-4b7f-b1a0-c5f89d750d2f tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:15.588753 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-027ad678-7942-4b7f-b1a0-c5f89d750d2f tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:15.712896 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e746cb75-a547-482e-a438-0d6395a860dc tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5489a5053e481683354d9b1541dee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9759d18563406e954d97c6bcb0718c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:15.725579 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e746cb75-a547-482e-a438-0d6395a860dc tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] 10.222.0.50 "GET /compute/v2.1/servers/6fd0e478-c48e-4bf0-b934-374fd737e10e" status: 200 len: 1268 microversion: 2.1 time: 0.197221 Aug 31 15:53:15.729123 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 563/1160] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:15 2022] GET /compute/v2.1/servers/6fd0e478-c48e-4bf0-b934-374fd737e10e => generated 1268 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:15.737604 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-298f8810-3dd4-405c-b157-1be345cbf641 tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] Calling method '.version_select at 0x7fbb467ad820>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:15.776553 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-027ad678-7942-4b7f-b1a0-c5f89d750d2f tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:15.792166 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-027ad678-7942-4b7f-b1a0-c5f89d750d2f tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:15.794802 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-027ad678-7942-4b7f-b1a0-c5f89d750d2f tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:15.796630 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-027ad678-7942-4b7f-b1a0-c5f89d750d2f tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] 10.222.0.50 "GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506" status: 200 len: 1407 microversion: 2.54 time: 0.238626 Aug 31 15:53:15.805518 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 598/1161] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:53:15 2022] GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506 => generated 1407 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:53:15.845966 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d50bafa6-61fb-450d-8c2f-578cba8b24d3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:15.849830 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d50bafa6-61fb-450d-8c2f-578cba8b24d3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 04a4f94b-5820-4bbe-a9b0-7fa55a697e09] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:15.863304 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d50bafa6-61fb-450d-8c2f-578cba8b24d3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:15.863811 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d50bafa6-61fb-450d-8c2f-578cba8b24d3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:15.882454 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d50bafa6-61fb-450d-8c2f-578cba8b24d3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:15.885737 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d50bafa6-61fb-450d-8c2f-578cba8b24d3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:15.886221 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d50bafa6-61fb-450d-8c2f-578cba8b24d3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:15.886822 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d50bafa6-61fb-450d-8c2f-578cba8b24d3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:16.198406 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d50bafa6-61fb-450d-8c2f-578cba8b24d3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:16.209289 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d50bafa6-61fb-450d-8c2f-578cba8b24d3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09" status: 200 len: 1336 microversion: 2.1 time: 0.367836 Aug 31 15:53:16.210144 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 599/1162] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:15 2022] GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09 => generated 1336 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:16.215585 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-83897841-9c47-456a-a94c-304666fd3a51 req-d78de3cc-96bb-4cc9-bbcc-e4bc478fce1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a25dea8-1dc1-480e-a431-13d2f2270d0a", "tag": "be9ab567-195e-4d60-b1e4-2ba6690fe483"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:53:16.244559 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-83897841-9c47-456a-a94c-304666fd3a51 req-d78de3cc-96bb-4cc9-bbcc-e4bc478fce1b service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:16.245916 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-83897841-9c47-456a-a94c-304666fd3a51 req-d78de3cc-96bb-4cc9-bbcc-e4bc478fce1b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:16.247177 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-83897841-9c47-456a-a94c-304666fd3a51 req-d78de3cc-96bb-4cc9-bbcc-e4bc478fce1b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:16.278457 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-83897841-9c47-456a-a94c-304666fd3a51 req-d78de3cc-96bb-4cc9-bbcc-e4bc478fce1b service nova] Creating event network-changed:be9ab567-195e-4d60-b1e4-2ba6690fe483 for instance 8a25dea8-1dc1-480e-a431-13d2f2270d0a on n-h2-833090-16 Aug 31 15:53:16.288300 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-83897841-9c47-456a-a94c-304666fd3a51 req-d78de3cc-96bb-4cc9-bbcc-e4bc478fce1b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076100 Aug 31 15:53:16.289353 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 600/1163] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:53:16.405323 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-59eac6ef-b404-424b-8c3d-74c336a1affe tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:16.406668 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-59eac6ef-b404-424b-8c3d-74c336a1affe tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: c76166e9-e2cf-4253-99e2-3f8d919099ba] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:16.422368 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-59eac6ef-b404-424b-8c3d-74c336a1affe tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:16.423376 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-59eac6ef-b404-424b-8c3d-74c336a1affe tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:16.424147 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-59eac6ef-b404-424b-8c3d-74c336a1affe tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:16.425128 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-59eac6ef-b404-424b-8c3d-74c336a1affe tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:16.425774 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-59eac6ef-b404-424b-8c3d-74c336a1affe tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:16.426410 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-59eac6ef-b404-424b-8c3d-74c336a1affe tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:16.936169 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-298f8810-3dd4-405c-b157-1be345cbf641 tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/39a7a32f-a4ff-4cd0-a2eb-7f46f90d3859" status: 202 len: 0 microversion: 2.1 time: 1.206141 Aug 31 15:53:16.940928 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 564/1164] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 31 15:53:15 2022] DELETE /compute/v2.1/os-security-groups/39a7a32f-a4ff-4cd0-a2eb-7f46f90d3859 => generated 0 bytes in 1212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:53:16.946309 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3bfc3990-e376-4464-861f-ff705dbe744d tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:16.947113 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3bfc3990-e376-4464-861f-ff705dbe744d tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] [instance: 6fd0e478-c48e-4bf0-b934-374fd737e10e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:16.967115 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bfc3990-e376-4464-861f-ff705dbe744d tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:16.967808 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bfc3990-e376-4464-861f-ff705dbe744d tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:16.968458 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bfc3990-e376-4464-861f-ff705dbe744d tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:16.971852 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bfc3990-e376-4464-861f-ff705dbe744d tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:16.972336 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bfc3990-e376-4464-861f-ff705dbe744d tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:16.972763 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bfc3990-e376-4464-861f-ff705dbe744d tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:17.029551 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-59eac6ef-b404-424b-8c3d-74c336a1affe tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6349b0ee9e2142a8a440d4e6ae0703a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33f8cd7d4424157b410b64c7823f480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:17.047859 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-59eac6ef-b404-424b-8c3d-74c336a1affe tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "GET /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba" status: 200 len: 1590 microversion: 2.1 time: 0.646714 Aug 31 15:53:17.068828 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 601/1165] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:16 2022] GET /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba => generated 1590 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:17.076268 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e89fabeb-8c4f-4ace-b3fe-def0d722ab44 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:17.077008 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e89fabeb-8c4f-4ace-b3fe-def0d722ab44 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] [instance: ec8bbe5f-2c2c-41b8-bfed-711906394506] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:17.089091 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e89fabeb-8c4f-4ace-b3fe-def0d722ab44 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:17.089694 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e89fabeb-8c4f-4ace-b3fe-def0d722ab44 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:17.090250 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e89fabeb-8c4f-4ace-b3fe-def0d722ab44 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:17.090979 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e89fabeb-8c4f-4ace-b3fe-def0d722ab44 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:17.092276 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e89fabeb-8c4f-4ace-b3fe-def0d722ab44 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:17.092797 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e89fabeb-8c4f-4ace-b3fe-def0d722ab44 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:17.113958 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3bfc3990-e376-4464-861f-ff705dbe744d tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5489a5053e481683354d9b1541dee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9759d18563406e954d97c6bcb0718c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:17.129103 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3bfc3990-e376-4464-861f-ff705dbe744d tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] 10.222.0.50 "GET /compute/v2.1/servers/6fd0e478-c48e-4bf0-b934-374fd737e10e" status: 200 len: 1274 microversion: 2.1 time: 0.186675 Aug 31 15:53:17.145269 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 565/1166] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:16 2022] GET /compute/v2.1/servers/6fd0e478-c48e-4bf0-b934-374fd737e10e => generated 1274 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:17.149536 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e2ffde66-3e80-41a0-b355-5184bfb59353 tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] Calling method '.version_select at 0x7fbb46671430>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:17.310054 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e89fabeb-8c4f-4ace-b3fe-def0d722ab44 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:17.320376 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e89fabeb-8c4f-4ace-b3fe-def0d722ab44 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:17.321931 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e89fabeb-8c4f-4ace-b3fe-def0d722ab44 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:17.323170 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e89fabeb-8c4f-4ace-b3fe-def0d722ab44 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] 10.222.0.50 "GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506" status: 200 len: 1407 microversion: 2.54 time: 0.252502 Aug 31 15:53:17.335331 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 602/1167] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:53:17 2022] GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506 => generated 1407 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:53:17.340751 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-96cb8c53-0905-441c-8c4b-6221f1d23a6b tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:17.341186 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-96cb8c53-0905-441c-8c4b-6221f1d23a6b tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: c76166e9-e2cf-4253-99e2-3f8d919099ba] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:17.355123 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-96cb8c53-0905-441c-8c4b-6221f1d23a6b tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:17.355709 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-96cb8c53-0905-441c-8c4b-6221f1d23a6b tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:17.356144 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-96cb8c53-0905-441c-8c4b-6221f1d23a6b tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:17.356843 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-96cb8c53-0905-441c-8c4b-6221f1d23a6b tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:17.357544 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-96cb8c53-0905-441c-8c4b-6221f1d23a6b tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:17.357971 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-96cb8c53-0905-441c-8c4b-6221f1d23a6b tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:17.553740 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-96cb8c53-0905-441c-8c4b-6221f1d23a6b tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "GET /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.217158 Aug 31 15:53:17.561400 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 603/1168] 10.222.0.50 () {58 vars in 1275 bytes} [Wed Aug 31 15:53:17 2022] GET /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba/os-interface => generated 285 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:53:17.572062 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-992893b6-d973-4655-95bb-cbb190579487 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:17.575567 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-992893b6-d973-4655-95bb-cbb190579487 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 04a4f94b-5820-4bbe-a9b0-7fa55a697e09] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:17.594952 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-992893b6-d973-4655-95bb-cbb190579487 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:17.597568 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-992893b6-d973-4655-95bb-cbb190579487 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:17.599755 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-992893b6-d973-4655-95bb-cbb190579487 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:17.603049 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-992893b6-d973-4655-95bb-cbb190579487 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:17.604107 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-992893b6-d973-4655-95bb-cbb190579487 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:17.606022 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-992893b6-d973-4655-95bb-cbb190579487 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:17.806014 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e2ffde66-3e80-41a0-b355-5184bfb59353 tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/62846c97-f865-42ae-a181-f71cb0bf1409" status: 202 len: 0 microversion: 2.1 time: 0.672254 Aug 31 15:53:17.807040 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 566/1169] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 31 15:53:17 2022] DELETE /compute/v2.1/os-security-groups/62846c97-f865-42ae-a181-f71cb0bf1409 => generated 0 bytes in 674 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:53:17.818264 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4fe3f9b6-88b8-4530-ae3b-0d21ed8c7fce tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] Calling method '.version_select at 0x7fbb46671e50>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:18.385525 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-992893b6-d973-4655-95bb-cbb190579487 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:18.433957 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-992893b6-d973-4655-95bb-cbb190579487 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09" status: 200 len: 1378 microversion: 2.1 time: 0.875592 Aug 31 15:53:18.436790 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 604/1170] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:17 2022] GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09 => generated 1378 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:18.454370 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-305491fd-eefe-4294-a6ac-2720a2cd450b tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:18.455511 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-305491fd-eefe-4294-a6ac-2720a2cd450b tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] [instance: 6fd0e478-c48e-4bf0-b934-374fd737e10e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:18.476320 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-305491fd-eefe-4294-a6ac-2720a2cd450b tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:18.484893 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-305491fd-eefe-4294-a6ac-2720a2cd450b tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:18.487712 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-305491fd-eefe-4294-a6ac-2720a2cd450b tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:18.488817 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-305491fd-eefe-4294-a6ac-2720a2cd450b tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:18.490981 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-305491fd-eefe-4294-a6ac-2720a2cd450b tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:18.491681 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-305491fd-eefe-4294-a6ac-2720a2cd450b tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:18.717713 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-305491fd-eefe-4294-a6ac-2720a2cd450b tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5489a5053e481683354d9b1541dee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9759d18563406e954d97c6bcb0718c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:18.740627 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-305491fd-eefe-4294-a6ac-2720a2cd450b tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] 10.222.0.50 "GET /compute/v2.1/servers/6fd0e478-c48e-4bf0-b934-374fd737e10e" status: 200 len: 1274 microversion: 2.1 time: 0.299372 Aug 31 15:53:18.757695 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 605/1171] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:18 2022] GET /compute/v2.1/servers/6fd0e478-c48e-4bf0-b934-374fd737e10e => generated 1274 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:18.765124 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-38a08d3c-76a2-4342-8b35-19c0d38cad29 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:18.767033 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-38a08d3c-76a2-4342-8b35-19c0d38cad29 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] [instance: ec8bbe5f-2c2c-41b8-bfed-711906394506] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:18.774971 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-38a08d3c-76a2-4342-8b35-19c0d38cad29 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:18.775862 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-38a08d3c-76a2-4342-8b35-19c0d38cad29 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:18.777689 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-38a08d3c-76a2-4342-8b35-19c0d38cad29 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:18.778757 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-38a08d3c-76a2-4342-8b35-19c0d38cad29 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:18.779473 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-38a08d3c-76a2-4342-8b35-19c0d38cad29 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:18.780092 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-38a08d3c-76a2-4342-8b35-19c0d38cad29 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:18.948857 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-38a08d3c-76a2-4342-8b35-19c0d38cad29 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:18.971110 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-38a08d3c-76a2-4342-8b35-19c0d38cad29 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:18.972196 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4fe3f9b6-88b8-4530-ae3b-0d21ed8c7fce tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/63808108-14e8-4791-a48f-182f69ff7be1" status: 202 len: 0 microversion: 2.1 time: 1.160631 Aug 31 15:53:18.973225 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-38a08d3c-76a2-4342-8b35-19c0d38cad29 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:18.974590 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-38a08d3c-76a2-4342-8b35-19c0d38cad29 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] 10.222.0.50 "GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506" status: 200 len: 1407 microversion: 2.54 time: 0.215138 Aug 31 15:53:18.976148 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 567/1172] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 31 15:53:17 2022] DELETE /compute/v2.1/os-security-groups/63808108-14e8-4791-a48f-182f69ff7be1 => generated 0 bytes in 1165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:53:18.993832 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-88d9e278-14f5-4862-b7ad-ed795145eb79 tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] Calling method '.version_select at 0x7fbb46671940>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:18.995504 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 606/1173] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:53:18 2022] GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506 => generated 1407 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:53:19.465687 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-66210974-a16e-44d4-9e9b-beccd042b990 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:19.467610 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-66210974-a16e-44d4-9e9b-beccd042b990 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 04a4f94b-5820-4bbe-a9b0-7fa55a697e09] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:19.489879 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-66210974-a16e-44d4-9e9b-beccd042b990 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:19.491348 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-66210974-a16e-44d4-9e9b-beccd042b990 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:19.494836 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-66210974-a16e-44d4-9e9b-beccd042b990 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:19.497600 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-66210974-a16e-44d4-9e9b-beccd042b990 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:19.499965 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-66210974-a16e-44d4-9e9b-beccd042b990 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:19.500960 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-66210974-a16e-44d4-9e9b-beccd042b990 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:20.093175 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-66210974-a16e-44d4-9e9b-beccd042b990 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:20.113083 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-66210974-a16e-44d4-9e9b-beccd042b990 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09" status: 200 len: 1378 microversion: 2.1 time: 0.655909 Aug 31 15:53:20.113682 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 607/1174] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:19 2022] GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09 => generated 1378 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:20.131902 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b0d21a6c-e965-457c-8b57-28befbae8b59 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:20.132752 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b0d21a6c-e965-457c-8b57-28befbae8b59 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] [instance: 6fd0e478-c48e-4bf0-b934-374fd737e10e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:20.139880 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b0d21a6c-e965-457c-8b57-28befbae8b59 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:20.140365 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b0d21a6c-e965-457c-8b57-28befbae8b59 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:20.141087 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b0d21a6c-e965-457c-8b57-28befbae8b59 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:20.142074 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b0d21a6c-e965-457c-8b57-28befbae8b59 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:20.142692 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b0d21a6c-e965-457c-8b57-28befbae8b59 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:20.143498 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b0d21a6c-e965-457c-8b57-28befbae8b59 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:20.259973 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-88d9e278-14f5-4862-b7ad-ed795145eb79 tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/338babd0-5179-443d-9890-91ddacc60eb9" status: 202 len: 0 microversion: 2.1 time: 1.282319 Aug 31 15:53:20.261500 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 568/1175] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 31 15:53:18 2022] DELETE /compute/v2.1/os-security-groups/338babd0-5179-443d-9890-91ddacc60eb9 => generated 0 bytes in 1284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:53:20.266255 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8b36c97d-2256-40cc-95c0-b2dcdc6881a2 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:20.267018 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8b36c97d-2256-40cc-95c0-b2dcdc6881a2 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: c76166e9-e2cf-4253-99e2-3f8d919099ba] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:20.275613 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b36c97d-2256-40cc-95c0-b2dcdc6881a2 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:20.276340 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b36c97d-2256-40cc-95c0-b2dcdc6881a2 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:20.276761 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b36c97d-2256-40cc-95c0-b2dcdc6881a2 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:20.277753 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b36c97d-2256-40cc-95c0-b2dcdc6881a2 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:20.278395 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b36c97d-2256-40cc-95c0-b2dcdc6881a2 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:20.279255 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b36c97d-2256-40cc-95c0-b2dcdc6881a2 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:20.724500 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8b36c97d-2256-40cc-95c0-b2dcdc6881a2 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6349b0ee9e2142a8a440d4e6ae0703a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33f8cd7d4424157b410b64c7823f480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:20.743857 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8b36c97d-2256-40cc-95c0-b2dcdc6881a2 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "GET /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba" status: 200 len: 1590 microversion: 2.1 time: 0.478966 Aug 31 15:53:20.744945 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 569/1176] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:20 2022] GET /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba => generated 1590 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:20.761708 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b0d21a6c-e965-457c-8b57-28befbae8b59 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5489a5053e481683354d9b1541dee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9759d18563406e954d97c6bcb0718c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:20.766926 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-78be6ef3-9ded-440d-b154-baaa1ca9d90a req-6e56ede1-908d-48a2-b07a-bb65302f2e03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c76166e9-e2cf-4253-99e2-3f8d919099ba", "tag": "3e098f5c-9a2b-4fa2-8406-5975188f6f3a"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:53:20.769898 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b0d21a6c-e965-457c-8b57-28befbae8b59 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] 10.222.0.50 "GET /compute/v2.1/servers/6fd0e478-c48e-4bf0-b934-374fd737e10e" status: 200 len: 1316 microversion: 2.1 time: 0.642333 Aug 31 15:53:20.770517 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 608/1177] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:20 2022] GET /compute/v2.1/servers/6fd0e478-c48e-4bf0-b934-374fd737e10e => generated 1316 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:20.779441 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-78be6ef3-9ded-440d-b154-baaa1ca9d90a req-6e56ede1-908d-48a2-b07a-bb65302f2e03 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:20.780054 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-78be6ef3-9ded-440d-b154-baaa1ca9d90a req-6e56ede1-908d-48a2-b07a-bb65302f2e03 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:20.780683 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-78be6ef3-9ded-440d-b154-baaa1ca9d90a req-6e56ede1-908d-48a2-b07a-bb65302f2e03 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:20.784378 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ac931a9b-545c-4888-b4ce-be034f9aa2af tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:20.785000 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ac931a9b-545c-4888-b4ce-be034f9aa2af tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] [instance: ec8bbe5f-2c2c-41b8-bfed-711906394506] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:20.796520 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-78be6ef3-9ded-440d-b154-baaa1ca9d90a req-6e56ede1-908d-48a2-b07a-bb65302f2e03 service nova] Creating event network-changed:3e098f5c-9a2b-4fa2-8406-5975188f6f3a for instance c76166e9-e2cf-4253-99e2-3f8d919099ba on n-h2-833090-16 Aug 31 15:53:20.801966 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ac931a9b-545c-4888-b4ce-be034f9aa2af tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:20.802707 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ac931a9b-545c-4888-b4ce-be034f9aa2af tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:20.803320 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ac931a9b-545c-4888-b4ce-be034f9aa2af tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:20.804209 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-78be6ef3-9ded-440d-b154-baaa1ca9d90a req-6e56ede1-908d-48a2-b07a-bb65302f2e03 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047028 Aug 31 15:53:20.804342 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ac931a9b-545c-4888-b4ce-be034f9aa2af tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:20.804659 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ac931a9b-545c-4888-b4ce-be034f9aa2af tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:20.805238 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ac931a9b-545c-4888-b4ce-be034f9aa2af tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:20.806821 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 570/1178] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:53:20.813366 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-109a2342-3f94-4a11-b6e6-d809a6cc4ec9 req-35e686cc-f317-446b-9aae-42a6e2f6aed2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04a4f94b-5820-4bbe-a9b0-7fa55a697e09", "tag": "f57c1856-6065-432f-b1a1-14b1ca0672d2"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:53:20.829706 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-109a2342-3f94-4a11-b6e6-d809a6cc4ec9 req-35e686cc-f317-446b-9aae-42a6e2f6aed2 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:20.830561 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-109a2342-3f94-4a11-b6e6-d809a6cc4ec9 req-35e686cc-f317-446b-9aae-42a6e2f6aed2 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:20.831286 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-109a2342-3f94-4a11-b6e6-d809a6cc4ec9 req-35e686cc-f317-446b-9aae-42a6e2f6aed2 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:20.846239 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-109a2342-3f94-4a11-b6e6-d809a6cc4ec9 req-35e686cc-f317-446b-9aae-42a6e2f6aed2 service nova] Creating event network-changed:f57c1856-6065-432f-b1a1-14b1ca0672d2 for instance 04a4f94b-5820-4bbe-a9b0-7fa55a697e09 on n-h1-833090-16 Aug 31 15:53:20.854190 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-109a2342-3f94-4a11-b6e6-d809a6cc4ec9 req-35e686cc-f317-446b-9aae-42a6e2f6aed2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045039 Aug 31 15:53:20.855559 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 571/1179] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:53:20.862779 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7c1278ed-f63a-4d80-a9d1-3776ef05c558 tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] Calling method '.version_select at 0x7fbb46671a60>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:20.960190 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ac931a9b-545c-4888-b4ce-be034f9aa2af tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:20.976045 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ac931a9b-545c-4888-b4ce-be034f9aa2af tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:20.977305 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ac931a9b-545c-4888-b4ce-be034f9aa2af tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:20.978534 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ac931a9b-545c-4888-b4ce-be034f9aa2af tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] 10.222.0.50 "GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506" status: 200 len: 1407 microversion: 2.54 time: 0.207059 Aug 31 15:53:20.981359 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 609/1180] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:53:20 2022] GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506 => generated 1407 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:53:20.985815 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0702590f-8ce5-4e75-a94f-eb1a2884d7e8 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e1ebb6f4-7758-4867-acff-077bdade0fbb"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:53:20.993186 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0702590f-8ce5-4e75-a94f-eb1a2884d7e8 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] [instance: a90bb0c5-7d56-4e38-8d78-a5c92a9976c3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:21.008585 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0702590f-8ce5-4e75-a94f-eb1a2884d7e8 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:21.009890 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0702590f-8ce5-4e75-a94f-eb1a2884d7e8 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:21.011706 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0702590f-8ce5-4e75-a94f-eb1a2884d7e8 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:21.013072 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0702590f-8ce5-4e75-a94f-eb1a2884d7e8 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:21.013798 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0702590f-8ce5-4e75-a94f-eb1a2884d7e8 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:21.014483 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0702590f-8ce5-4e75-a94f-eb1a2884d7e8 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:21.366367 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0702590f-8ce5-4e75-a94f-eb1a2884d7e8 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] 10.222.0.50 "POST /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.384182 Aug 31 15:53:21.367404 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 610/1181] 10.222.0.50 () {60 vars in 1323 bytes} [Wed Aug 31 15:53:20 2022] POST /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3/os-volume_attachments => generated 194 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:53:21.383850 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e5f06877-cd84-49e7-94fb-515d03feceb8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:21.386890 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e5f06877-cd84-49e7-94fb-515d03feceb8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 04a4f94b-5820-4bbe-a9b0-7fa55a697e09] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:21.402700 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:53:21.407747 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e5f06877-cd84-49e7-94fb-515d03feceb8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:21.411741 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e5f06877-cd84-49e7-94fb-515d03feceb8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:21.412409 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e5f06877-cd84-49e7-94fb-515d03feceb8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:21.413183 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e5f06877-cd84-49e7-94fb-515d03feceb8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:21.415155 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e5f06877-cd84-49e7-94fb-515d03feceb8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:21.415847 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e5f06877-cd84-49e7-94fb-515d03feceb8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:21.584701 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7c1278ed-f63a-4d80-a9d1-3776ef05c558 tempest-SecurityGroupRulesNegativeTestJSON-630679065 tempest-SecurityGroupRulesNegativeTestJSON-630679065-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/897f071f-c702-4f18-b9c0-0c12779689f6" status: 202 len: 0 microversion: 2.1 time: 0.727012 Aug 31 15:53:21.585959 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 572/1182] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 31 15:53:20 2022] DELETE /compute/v2.1/os-security-groups/897f071f-c702-4f18-b9c0-0c12779689f6 => generated 0 bytes in 730 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:53:21.797220 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d1638935-e8cb-4bf0-b301-bec4c0d6d323 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:21.798695 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d1638935-e8cb-4bf0-b301-bec4c0d6d323 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] [instance: 6fd0e478-c48e-4bf0-b934-374fd737e10e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:21.812395 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d1638935-e8cb-4bf0-b301-bec4c0d6d323 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:21.818972 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d1638935-e8cb-4bf0-b301-bec4c0d6d323 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:21.819778 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d1638935-e8cb-4bf0-b301-bec4c0d6d323 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:21.820830 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d1638935-e8cb-4bf0-b301-bec4c0d6d323 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:21.821625 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d1638935-e8cb-4bf0-b301-bec4c0d6d323 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:21.822480 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d1638935-e8cb-4bf0-b301-bec4c0d6d323 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:21.994085 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e5f06877-cd84-49e7-94fb-515d03feceb8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:22.004442 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e5f06877-cd84-49e7-94fb-515d03feceb8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09" status: 200 len: 1378 microversion: 2.1 time: 0.635605 Aug 31 15:53:22.014584 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 611/1183] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:21 2022] GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09 => generated 1378 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:22.032928 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e5417cae-f05b-4050-b584-cd403ce01e72 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:22.033459 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e5417cae-f05b-4050-b584-cd403ce01e72 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] [instance: ec8bbe5f-2c2c-41b8-bfed-711906394506] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:22.061189 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e5417cae-f05b-4050-b584-cd403ce01e72 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:22.062017 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e5417cae-f05b-4050-b584-cd403ce01e72 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:22.062744 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e5417cae-f05b-4050-b584-cd403ce01e72 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:22.063617 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e5417cae-f05b-4050-b584-cd403ce01e72 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:22.064259 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e5417cae-f05b-4050-b584-cd403ce01e72 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:22.064869 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e5417cae-f05b-4050-b584-cd403ce01e72 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:22.068486 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:53:22.197988 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e5417cae-f05b-4050-b584-cd403ce01e72 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:22.216196 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e5417cae-f05b-4050-b584-cd403ce01e72 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:22.217634 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e5417cae-f05b-4050-b584-cd403ce01e72 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:22.218880 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e5417cae-f05b-4050-b584-cd403ce01e72 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] 10.222.0.50 "GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506" status: 200 len: 1407 microversion: 2.54 time: 0.190033 Aug 31 15:53:22.224816 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 612/1184] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:53:22 2022] GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506 => generated 1407 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:53:22.482946 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d1638935-e8cb-4bf0-b301-bec4c0d6d323 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5489a5053e481683354d9b1541dee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9759d18563406e954d97c6bcb0718c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:22.498723 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d1638935-e8cb-4bf0-b301-bec4c0d6d323 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] 10.222.0.50 "GET /compute/v2.1/servers/6fd0e478-c48e-4bf0-b934-374fd737e10e" status: 200 len: 1316 microversion: 2.1 time: 0.708212 Aug 31 15:53:22.499796 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 573/1185] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:21 2022] GET /compute/v2.1/servers/6fd0e478-c48e-4bf0-b934-374fd737e10e => generated 1316 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:22.910699 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-16e78077-f1c7-4276-9279-22d9b33a85f8 req-31272301-fc61-40a1-b44b-e52056c192b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fd0e478-c48e-4bf0-b934-374fd737e10e", "tag": "08858af6-f63a-4806-bf78-9b9701ace801"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:53:22.920872 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:53:22.924352 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-16e78077-f1c7-4276-9279-22d9b33a85f8 req-31272301-fc61-40a1-b44b-e52056c192b7 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:22.925185 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-16e78077-f1c7-4276-9279-22d9b33a85f8 req-31272301-fc61-40a1-b44b-e52056c192b7 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:22.925820 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-16e78077-f1c7-4276-9279-22d9b33a85f8 req-31272301-fc61-40a1-b44b-e52056c192b7 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:22.959070 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-16e78077-f1c7-4276-9279-22d9b33a85f8 req-31272301-fc61-40a1-b44b-e52056c192b7 service nova] Creating event network-changed:08858af6-f63a-4806-bf78-9b9701ace801 for instance 6fd0e478-c48e-4bf0-b934-374fd737e10e on n-h2-833090-16 Aug 31 15:53:22.974911 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-16e78077-f1c7-4276-9279-22d9b33a85f8 req-31272301-fc61-40a1-b44b-e52056c192b7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067998 Aug 31 15:53:22.975531 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 613/1186] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:53:23.035745 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4ea6db32-1705-4122-a05e-65f43a889b59 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:23.036302 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4ea6db32-1705-4122-a05e-65f43a889b59 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 04a4f94b-5820-4bbe-a9b0-7fa55a697e09] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:23.054574 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ea6db32-1705-4122-a05e-65f43a889b59 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:23.056969 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ea6db32-1705-4122-a05e-65f43a889b59 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:23.058008 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ea6db32-1705-4122-a05e-65f43a889b59 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:23.059138 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ea6db32-1705-4122-a05e-65f43a889b59 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:23.059804 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ea6db32-1705-4122-a05e-65f43a889b59 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:23.060426 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ea6db32-1705-4122-a05e-65f43a889b59 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:23.248811 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ddd531bd-b2fd-4141-a246-48f751e0f079 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:23.249655 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ddd531bd-b2fd-4141-a246-48f751e0f079 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] [instance: ec8bbe5f-2c2c-41b8-bfed-711906394506] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:23.266064 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ddd531bd-b2fd-4141-a246-48f751e0f079 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:23.266590 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ddd531bd-b2fd-4141-a246-48f751e0f079 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:23.267022 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ddd531bd-b2fd-4141-a246-48f751e0f079 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:23.267720 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ddd531bd-b2fd-4141-a246-48f751e0f079 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:23.268512 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ddd531bd-b2fd-4141-a246-48f751e0f079 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:23.269424 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ddd531bd-b2fd-4141-a246-48f751e0f079 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:23.552939 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:53:23.583360 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:53:23.832210 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ddd531bd-b2fd-4141-a246-48f751e0f079 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:23.847969 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ddd531bd-b2fd-4141-a246-48f751e0f079 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:23.849879 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ddd531bd-b2fd-4141-a246-48f751e0f079 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:23.854656 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ddd531bd-b2fd-4141-a246-48f751e0f079 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] 10.222.0.50 "GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506" status: 200 len: 1407 microversion: 2.54 time: 0.610323 Aug 31 15:53:23.866859 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 614/1187] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:53:23 2022] GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506 => generated 1407 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:53:23.877159 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-10f6025a-7c64-4a94-83fd-5e0e133564ab tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:23.878184 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-10f6025a-7c64-4a94-83fd-5e0e133564ab tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] [instance: 6fd0e478-c48e-4bf0-b934-374fd737e10e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:23.884442 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-10f6025a-7c64-4a94-83fd-5e0e133564ab tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:23.885190 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-10f6025a-7c64-4a94-83fd-5e0e133564ab tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:23.885831 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-10f6025a-7c64-4a94-83fd-5e0e133564ab tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:23.886897 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-10f6025a-7c64-4a94-83fd-5e0e133564ab tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:23.887541 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-10f6025a-7c64-4a94-83fd-5e0e133564ab tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:23.888162 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-10f6025a-7c64-4a94-83fd-5e0e133564ab tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:24.119390 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=12 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:53:24.665330 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4ea6db32-1705-4122-a05e-65f43a889b59 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:24.695401 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4ea6db32-1705-4122-a05e-65f43a889b59 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09" status: 200 len: 1378 microversion: 2.1 time: 1.663975 Aug 31 15:53:24.696607 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 574/1188] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:23 2022] GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09 => generated 1378 bytes in 1666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:24.705661 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-10f6025a-7c64-4a94-83fd-5e0e133564ab tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5489a5053e481683354d9b1541dee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9759d18563406e954d97c6bcb0718c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:24.714995 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-10f6025a-7c64-4a94-83fd-5e0e133564ab tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] 10.222.0.50 "GET /compute/v2.1/servers/6fd0e478-c48e-4bf0-b934-374fd737e10e" status: 200 len: 1316 microversion: 2.1 time: 0.846786 Aug 31 15:53:24.718403 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 615/1189] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:23 2022] GET /compute/v2.1/servers/6fd0e478-c48e-4bf0-b934-374fd737e10e => generated 1316 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:24.883918 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-47ea8708-bea4-4f84-a46d-0c0c2ab27971 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:24.884567 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-47ea8708-bea4-4f84-a46d-0c0c2ab27971 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] [instance: ec8bbe5f-2c2c-41b8-bfed-711906394506] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:24.899377 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47ea8708-bea4-4f84-a46d-0c0c2ab27971 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:24.899877 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47ea8708-bea4-4f84-a46d-0c0c2ab27971 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:24.900308 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47ea8708-bea4-4f84-a46d-0c0c2ab27971 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:24.901021 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47ea8708-bea4-4f84-a46d-0c0c2ab27971 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:24.901510 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47ea8708-bea4-4f84-a46d-0c0c2ab27971 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:24.908582 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47ea8708-bea4-4f84-a46d-0c0c2ab27971 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:25.059600 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-187f894e-9099-47c2-8f91-f3888b2f86ad req-91d2d984-39bb-4655-b040-e3d25eb219e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04a4f94b-5820-4bbe-a9b0-7fa55a697e09", "name": "network-vif-plugged", "status": "completed", "tag": "f57c1856-6065-432f-b1a1-14b1ca0672d2"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:53:25.079057 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-187f894e-9099-47c2-8f91-f3888b2f86ad req-91d2d984-39bb-4655-b040-e3d25eb219e6 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:25.079538 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-187f894e-9099-47c2-8f91-f3888b2f86ad req-91d2d984-39bb-4655-b040-e3d25eb219e6 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:25.082056 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-187f894e-9099-47c2-8f91-f3888b2f86ad req-91d2d984-39bb-4655-b040-e3d25eb219e6 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:25.113043 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-187f894e-9099-47c2-8f91-f3888b2f86ad req-91d2d984-39bb-4655-b040-e3d25eb219e6 service nova] Creating event network-vif-plugged:f57c1856-6065-432f-b1a1-14b1ca0672d2 for instance 04a4f94b-5820-4bbe-a9b0-7fa55a697e09 on n-h1-833090-16 Aug 31 15:53:25.123600 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-187f894e-9099-47c2-8f91-f3888b2f86ad req-91d2d984-39bb-4655-b040-e3d25eb219e6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067563 Aug 31 15:53:25.127432 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 616/1190] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:53:25.248233 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-47ea8708-bea4-4f84-a46d-0c0c2ab27971 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:25.263118 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-47ea8708-bea4-4f84-a46d-0c0c2ab27971 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:25.265021 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-47ea8708-bea4-4f84-a46d-0c0c2ab27971 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:25.266745 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-47ea8708-bea4-4f84-a46d-0c0c2ab27971 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] 10.222.0.50 "GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506" status: 200 len: 1407 microversion: 2.54 time: 0.387391 Aug 31 15:53:25.270421 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 575/1191] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:53:24 2022] GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506 => generated 1407 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:53:25.719557 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c9fdb24e-9e6b-4878-b4ad-afb56a0f7c90 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:25.720616 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c9fdb24e-9e6b-4878-b4ad-afb56a0f7c90 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 04a4f94b-5820-4bbe-a9b0-7fa55a697e09] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:25.733186 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c9fdb24e-9e6b-4878-b4ad-afb56a0f7c90 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:25.737896 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c9fdb24e-9e6b-4878-b4ad-afb56a0f7c90 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:25.738798 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c9fdb24e-9e6b-4878-b4ad-afb56a0f7c90 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:25.739746 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c9fdb24e-9e6b-4878-b4ad-afb56a0f7c90 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:25.740407 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c9fdb24e-9e6b-4878-b4ad-afb56a0f7c90 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:25.741758 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c9fdb24e-9e6b-4878-b4ad-afb56a0f7c90 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:25.742179 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-182475f3-95ab-4348-bdfd-09dcf02a8aa3 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:25.742797 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-182475f3-95ab-4348-bdfd-09dcf02a8aa3 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] [instance: 6fd0e478-c48e-4bf0-b934-374fd737e10e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:25.752675 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-182475f3-95ab-4348-bdfd-09dcf02a8aa3 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:25.753421 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-182475f3-95ab-4348-bdfd-09dcf02a8aa3 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:25.753995 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-182475f3-95ab-4348-bdfd-09dcf02a8aa3 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:25.759044 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-182475f3-95ab-4348-bdfd-09dcf02a8aa3 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:25.759731 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-182475f3-95ab-4348-bdfd-09dcf02a8aa3 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:25.760326 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-182475f3-95ab-4348-bdfd-09dcf02a8aa3 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:26.320137 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-182475f3-95ab-4348-bdfd-09dcf02a8aa3 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5489a5053e481683354d9b1541dee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9759d18563406e954d97c6bcb0718c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:26.336006 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-182475f3-95ab-4348-bdfd-09dcf02a8aa3 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] 10.222.0.50 "GET /compute/v2.1/servers/6fd0e478-c48e-4bf0-b934-374fd737e10e" status: 200 len: 1316 microversion: 2.1 time: 0.597569 Aug 31 15:53:26.339516 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 576/1192] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:25 2022] GET /compute/v2.1/servers/6fd0e478-c48e-4bf0-b934-374fd737e10e => generated 1316 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:53:26.355714 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c9fdb24e-9e6b-4878-b4ad-afb56a0f7c90 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:26.357172 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-01c6b4a1-27e7-4a06-b8fe-71f89be918f6 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:26.357960 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-01c6b4a1-27e7-4a06-b8fe-71f89be918f6 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] [instance: ec8bbe5f-2c2c-41b8-bfed-711906394506] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:26.369719 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c9fdb24e-9e6b-4878-b4ad-afb56a0f7c90 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09" status: 200 len: 1378 microversion: 2.1 time: 0.655770 Aug 31 15:53:26.385520 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 617/1193] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:25 2022] GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09 => generated 1378 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:26.388539 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01c6b4a1-27e7-4a06-b8fe-71f89be918f6 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:26.389286 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01c6b4a1-27e7-4a06-b8fe-71f89be918f6 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:26.389965 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01c6b4a1-27e7-4a06-b8fe-71f89be918f6 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:26.390867 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01c6b4a1-27e7-4a06-b8fe-71f89be918f6 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:26.391476 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01c6b4a1-27e7-4a06-b8fe-71f89be918f6 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:26.393408 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01c6b4a1-27e7-4a06-b8fe-71f89be918f6 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:26.699694 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-01c6b4a1-27e7-4a06-b8fe-71f89be918f6 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:26.716144 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-01c6b4a1-27e7-4a06-b8fe-71f89be918f6 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:26.718777 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-01c6b4a1-27e7-4a06-b8fe-71f89be918f6 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:26.720256 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-01c6b4a1-27e7-4a06-b8fe-71f89be918f6 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] 10.222.0.50 "GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506" status: 200 len: 1407 microversion: 2.54 time: 0.379543 Aug 31 15:53:26.721687 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 577/1194] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:53:26 2022] GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506 => generated 1407 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:53:27.360009 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-cd82eadd-0b4f-4d37-b8f6-f8be7fcf83c1 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:27.361134 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-cd82eadd-0b4f-4d37-b8f6-f8be7fcf83c1 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] [instance: 6fd0e478-c48e-4bf0-b934-374fd737e10e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:27.377500 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cd82eadd-0b4f-4d37-b8f6-f8be7fcf83c1 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:27.378164 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cd82eadd-0b4f-4d37-b8f6-f8be7fcf83c1 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:27.380884 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cd82eadd-0b4f-4d37-b8f6-f8be7fcf83c1 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:27.383272 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cd82eadd-0b4f-4d37-b8f6-f8be7fcf83c1 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:27.392432 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7a79234e-0d0f-4b73-8661-3bc85e84e67c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:27.393897 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7a79234e-0d0f-4b73-8661-3bc85e84e67c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 04a4f94b-5820-4bbe-a9b0-7fa55a697e09] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:27.402640 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cd82eadd-0b4f-4d37-b8f6-f8be7fcf83c1 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:27.403504 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cd82eadd-0b4f-4d37-b8f6-f8be7fcf83c1 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:27.411792 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a79234e-0d0f-4b73-8661-3bc85e84e67c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:27.417214 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a79234e-0d0f-4b73-8661-3bc85e84e67c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:27.418083 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a79234e-0d0f-4b73-8661-3bc85e84e67c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:27.427096 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a79234e-0d0f-4b73-8661-3bc85e84e67c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:27.427582 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a79234e-0d0f-4b73-8661-3bc85e84e67c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:27.428020 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a79234e-0d0f-4b73-8661-3bc85e84e67c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:28.066740 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-cd82eadd-0b4f-4d37-b8f6-f8be7fcf83c1 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5489a5053e481683354d9b1541dee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9759d18563406e954d97c6bcb0718c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:28.079820 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-cd82eadd-0b4f-4d37-b8f6-f8be7fcf83c1 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] 10.222.0.50 "GET /compute/v2.1/servers/6fd0e478-c48e-4bf0-b934-374fd737e10e" status: 200 len: 1316 microversion: 2.1 time: 0.723683 Aug 31 15:53:28.080464 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 618/1195] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:27 2022] GET /compute/v2.1/servers/6fd0e478-c48e-4bf0-b934-374fd737e10e => generated 1316 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:28.103648 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f744ad39-a47b-43e9-a436-46f6863d5151 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:28.104385 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f744ad39-a47b-43e9-a436-46f6863d5151 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] [instance: ec8bbe5f-2c2c-41b8-bfed-711906394506] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:28.123412 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f744ad39-a47b-43e9-a436-46f6863d5151 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:28.124282 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f744ad39-a47b-43e9-a436-46f6863d5151 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:28.125087 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f744ad39-a47b-43e9-a436-46f6863d5151 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:28.126011 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f744ad39-a47b-43e9-a436-46f6863d5151 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:28.126703 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f744ad39-a47b-43e9-a436-46f6863d5151 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:28.127396 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f744ad39-a47b-43e9-a436-46f6863d5151 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:28.161144 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7a79234e-0d0f-4b73-8661-3bc85e84e67c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:28.187317 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7a79234e-0d0f-4b73-8661-3bc85e84e67c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09" status: 200 len: 1528 microversion: 2.1 time: 0.796478 Aug 31 15:53:28.189791 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 578/1196] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:27 2022] GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09 => generated 1528 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:28.399803 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-06ac2322-1faa-415a-aa6d-756502550d44 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1883150750", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "6da6fef1-33a8-4f7a-a21c-08f85e78d1da"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:53:28.464665 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-06ac2322-1faa-415a-aa6d-756502550d44 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] validate_networks() for [('6da6fef1-33a8-4f7a-a21c-08f85e78d1da', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:53:28.712826 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f744ad39-a47b-43e9-a436-46f6863d5151 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:28.723110 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f744ad39-a47b-43e9-a436-46f6863d5151 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:28.724916 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f744ad39-a47b-43e9-a436-46f6863d5151 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:28.726767 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f744ad39-a47b-43e9-a436-46f6863d5151 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] 10.222.0.50 "GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506" status: 200 len: 1407 microversion: 2.54 time: 0.645096 Aug 31 15:53:28.731878 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 619/1197] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:53:28 2022] GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506 => generated 1407 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:53:28.738700 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f2a6478f-6faa-4464-95b0-4cb0c9587f28 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:28.740016 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f2a6478f-6faa-4464-95b0-4cb0c9587f28 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 04a4f94b-5820-4bbe-a9b0-7fa55a697e09] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:28.747193 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f2a6478f-6faa-4464-95b0-4cb0c9587f28 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:28.747677 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f2a6478f-6faa-4464-95b0-4cb0c9587f28 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:28.748246 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f2a6478f-6faa-4464-95b0-4cb0c9587f28 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:28.749122 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f2a6478f-6faa-4464-95b0-4cb0c9587f28 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:28.749745 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f2a6478f-6faa-4464-95b0-4cb0c9587f28 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:28.750361 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f2a6478f-6faa-4464-95b0-4cb0c9587f28 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:29.028897 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f2a6478f-6faa-4464-95b0-4cb0c9587f28 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:29.040103 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f2a6478f-6faa-4464-95b0-4cb0c9587f28 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09" status: 200 len: 1528 microversion: 2.1 time: 0.306453 Aug 31 15:53:29.057807 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 620/1198] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:28 2022] GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09 => generated 1528 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:29.069807 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-af7b725c-4960-4697-b8cc-51784aa15f3c tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:29.092683 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-af7b725c-4960-4697-b8cc-51784aa15f3c tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/6c36be30-5093-4c9c-be28-22b7f059d672" status: 202 len: 0 microversion: 2.1 time: 0.032054 Aug 31 15:53:29.097615 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 621/1199] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:53:29 2022] DELETE /compute/v2.1/flavors/6c36be30-5093-4c9c-be28-22b7f059d672 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:53:29.102607 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e6f0742c-5ce9-475c-b04e-eae6c2404a78 tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:29.148846 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e6f0742c-5ce9-475c-b04e-eae6c2404a78 tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.049776 Aug 31 15:53:29.162749 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 622/1200] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 31 15:53:29 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:29.171666 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6ff4b209-5c2f-42d8-aafc-ced617372624 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:29.172281 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6ff4b209-5c2f-42d8-aafc-ced617372624 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] [instance: 6fd0e478-c48e-4bf0-b934-374fd737e10e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:29.183615 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6ff4b209-5c2f-42d8-aafc-ced617372624 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:29.184196 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6ff4b209-5c2f-42d8-aafc-ced617372624 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:29.184637 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6ff4b209-5c2f-42d8-aafc-ced617372624 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:29.185363 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6ff4b209-5c2f-42d8-aafc-ced617372624 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:29.186562 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6ff4b209-5c2f-42d8-aafc-ced617372624 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:29.187178 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6ff4b209-5c2f-42d8-aafc-ced617372624 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:29.509783 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6ff4b209-5c2f-42d8-aafc-ced617372624 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5489a5053e481683354d9b1541dee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9759d18563406e954d97c6bcb0718c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:29.519655 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6ff4b209-5c2f-42d8-aafc-ced617372624 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] 10.222.0.50 "GET /compute/v2.1/servers/6fd0e478-c48e-4bf0-b934-374fd737e10e" status: 200 len: 1316 microversion: 2.1 time: 0.355668 Aug 31 15:53:29.520242 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 623/1201] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:29 2022] GET /compute/v2.1/servers/6fd0e478-c48e-4bf0-b934-374fd737e10e => generated 1316 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:29.535072 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d915d0a3-9829-4171-94e4-c6388e7980d5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:53:29.540007 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d915d0a3-9829-4171-94e4-c6388e7980d5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 04a4f94b-5820-4bbe-a9b0-7fa55a697e09] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:29.560638 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d915d0a3-9829-4171-94e4-c6388e7980d5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:29.564920 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-06ac2322-1faa-415a-aa6d-756502550d44 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:53:29.565898 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-06ac2322-1faa-415a-aa6d-756502550d44 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:53:29.566010 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-06ac2322-1faa-415a-aa6d-756502550d44 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:53:29.566802 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-06ac2322-1faa-415a-aa6d-756502550d44 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:53:29.568604 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-06ac2322-1faa-415a-aa6d-756502550d44 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:53:29.578708 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d915d0a3-9829-4171-94e4-c6388e7980d5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:29.579233 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d915d0a3-9829-4171-94e4-c6388e7980d5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:29.580284 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d915d0a3-9829-4171-94e4-c6388e7980d5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:29.580953 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d915d0a3-9829-4171-94e4-c6388e7980d5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:29.584617 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d915d0a3-9829-4171-94e4-c6388e7980d5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:29.590750 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06ac2322-1faa-415a-aa6d-756502550d44 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:29.592082 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06ac2322-1faa-415a-aa6d-756502550d44 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:29.592715 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06ac2322-1faa-415a-aa6d-756502550d44 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:29.593635 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06ac2322-1faa-415a-aa6d-756502550d44 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:29.594403 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06ac2322-1faa-415a-aa6d-756502550d44 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:29.595048 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06ac2322-1faa-415a-aa6d-756502550d44 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:29.665587 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-06ac2322-1faa-415a-aa6d-756502550d44 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Getting quotas for project 390f00bece0c42999585de9fc68e1ce0. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:53:29.676750 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-06ac2322-1faa-415a-aa6d-756502550d44 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Getting quotas for user 88494f6bd936497b88c3f50b4ffb2fd0 and project 390f00bece0c42999585de9fc68e1ce0. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:53:29.698165 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-06ac2322-1faa-415a-aa6d-756502550d44 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:53:29.701370 n-d-833090-16 devstack@n-api.service[128863]: WARNING nova.utils [None req-06ac2322-1faa-415a-aa6d-756502550d44 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1883150750 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-188315075 Aug 31 15:53:29.702536 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-06ac2322-1faa-415a-aa6d-756502550d44 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] [instance: 378220a7-113f-49e1-9bfa-3804d55260c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:53:29.784938 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-06ac2322-1faa-415a-aa6d-756502550d44 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.593341 Aug 31 15:53:29.793743 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 579/1202] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:53:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 15:53:29.804221 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1d3536bd-4edc-4b43-afa4-c7a56a38bed9 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:29.826536 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1d3536bd-4edc-4b43-afa4-c7a56a38bed9 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] [instance: ec8bbe5f-2c2c-41b8-bfed-711906394506] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:29.837891 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d3536bd-4edc-4b43-afa4-c7a56a38bed9 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:29.838411 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d3536bd-4edc-4b43-afa4-c7a56a38bed9 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:29.838842 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d3536bd-4edc-4b43-afa4-c7a56a38bed9 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:29.839596 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d3536bd-4edc-4b43-afa4-c7a56a38bed9 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:29.840042 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d3536bd-4edc-4b43-afa4-c7a56a38bed9 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:29.840458 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d3536bd-4edc-4b43-afa4-c7a56a38bed9 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:29.887933 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d915d0a3-9829-4171-94e4-c6388e7980d5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:29.895898 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d915d0a3-9829-4171-94e4-c6388e7980d5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 04a4f94b-5820-4bbe-a9b0-7fa55a697e09] Old instance type tempest-test_resize_flavor_-1627738804, new instance type m1.heat {{(pid=128864) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 31 15:53:29.913747 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-d915d0a3-9829-4171-94e4-c6388e7980d5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:53:29.914194 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-d915d0a3-9829-4171-94e4-c6388e7980d5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:53:29.914674 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-d915d0a3-9829-4171-94e4-c6388e7980d5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:53:29.915073 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-d915d0a3-9829-4171-94e4-c6388e7980d5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:53:29.921423 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-d915d0a3-9829-4171-94e4-c6388e7980d5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:53:30.005898 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1d3536bd-4edc-4b43-afa4-c7a56a38bed9 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:30.020226 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1d3536bd-4edc-4b43-afa4-c7a56a38bed9 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:30.023612 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1d3536bd-4edc-4b43-afa4-c7a56a38bed9 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:30.029606 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1d3536bd-4edc-4b43-afa4-c7a56a38bed9 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] 10.222.0.50 "GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506" status: 200 len: 1413 microversion: 2.54 time: 0.234365 Aug 31 15:53:30.030222 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 580/1203] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:53:29 2022] GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506 => generated 1413 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:53:30.060006 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f2c1f91b-969a-4869-beaa-9336f750dd45 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:30.060872 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f2c1f91b-969a-4869-beaa-9336f750dd45 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] [instance: 378220a7-113f-49e1-9bfa-3804d55260c6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:30.127918 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d915d0a3-9829-4171-94e4-c6388e7980d5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "POST /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09/action" status: 202 len: 0 microversion: 2.1 time: 0.600901 Aug 31 15:53:30.128827 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 624/1204] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 15:53:29 2022] POST /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09/action => generated 0 bytes in 607 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:53:30.151591 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-685771cc-7fe2-4d59-888f-985b6fe3c4a5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:30.158365 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-685771cc-7fe2-4d59-888f-985b6fe3c4a5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 04a4f94b-5820-4bbe-a9b0-7fa55a697e09] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:30.188548 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-685771cc-7fe2-4d59-888f-985b6fe3c4a5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:30.189531 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-685771cc-7fe2-4d59-888f-985b6fe3c4a5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:30.190921 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-685771cc-7fe2-4d59-888f-985b6fe3c4a5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:30.193382 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-685771cc-7fe2-4d59-888f-985b6fe3c4a5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:30.196718 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-685771cc-7fe2-4d59-888f-985b6fe3c4a5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:30.197968 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-685771cc-7fe2-4d59-888f-985b6fe3c4a5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:30.252571 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f2c1f91b-969a-4869-beaa-9336f750dd45 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88494f6bd936497b88c3f50b4ffb2fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390f00bece0c42999585de9fc68e1ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:30.265645 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f2c1f91b-969a-4869-beaa-9336f750dd45 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] 10.222.0.50 "GET /compute/v2.1/servers/378220a7-113f-49e1-9bfa-3804d55260c6" status: 200 len: 1232 microversion: 2.1 time: 0.214627 Aug 31 15:53:30.266267 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 581/1205] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:30 2022] GET /compute/v2.1/servers/378220a7-113f-49e1-9bfa-3804d55260c6 => generated 1232 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:30.544712 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1c0db2d9-3649-4074-bc50-9de1d6e510fd tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:30.545770 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1c0db2d9-3649-4074-bc50-9de1d6e510fd tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] [instance: 6fd0e478-c48e-4bf0-b934-374fd737e10e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:30.577052 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c0db2d9-3649-4074-bc50-9de1d6e510fd tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:30.577686 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c0db2d9-3649-4074-bc50-9de1d6e510fd tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:30.579098 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c0db2d9-3649-4074-bc50-9de1d6e510fd tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:30.580214 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c0db2d9-3649-4074-bc50-9de1d6e510fd tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:30.580824 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c0db2d9-3649-4074-bc50-9de1d6e510fd tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:30.581388 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c0db2d9-3649-4074-bc50-9de1d6e510fd tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:30.634653 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-685771cc-7fe2-4d59-888f-985b6fe3c4a5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:30.649846 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-685771cc-7fe2-4d59-888f-985b6fe3c4a5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09" status: 200 len: 1537 microversion: 2.1 time: 0.512564 Aug 31 15:53:30.651446 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 625/1206] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:30 2022] GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09 => generated 1537 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:30.830908 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1c0db2d9-3649-4074-bc50-9de1d6e510fd tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5489a5053e481683354d9b1541dee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9759d18563406e954d97c6bcb0718c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:30.840382 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1c0db2d9-3649-4074-bc50-9de1d6e510fd tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] 10.222.0.50 "GET /compute/v2.1/servers/6fd0e478-c48e-4bf0-b934-374fd737e10e" status: 200 len: 1316 microversion: 2.1 time: 0.300564 Aug 31 15:53:30.840972 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 582/1207] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:30 2022] GET /compute/v2.1/servers/6fd0e478-c48e-4bf0-b934-374fd737e10e => generated 1316 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:53:31.062995 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c10095a8-da4b-4718-9df7-b32ebf6ac449 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:31.065488 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c10095a8-da4b-4718-9df7-b32ebf6ac449 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] [instance: ec8bbe5f-2c2c-41b8-bfed-711906394506] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:31.089597 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c10095a8-da4b-4718-9df7-b32ebf6ac449 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:31.091270 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c10095a8-da4b-4718-9df7-b32ebf6ac449 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:31.091721 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c10095a8-da4b-4718-9df7-b32ebf6ac449 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:31.092464 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c10095a8-da4b-4718-9df7-b32ebf6ac449 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:31.092933 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c10095a8-da4b-4718-9df7-b32ebf6ac449 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:31.093349 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c10095a8-da4b-4718-9df7-b32ebf6ac449 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:31.224637 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c10095a8-da4b-4718-9df7-b32ebf6ac449 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:31.234501 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c10095a8-da4b-4718-9df7-b32ebf6ac449 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:31.236288 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c10095a8-da4b-4718-9df7-b32ebf6ac449 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:31.238155 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c10095a8-da4b-4718-9df7-b32ebf6ac449 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] 10.222.0.50 "GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506" status: 200 len: 1413 microversion: 2.54 time: 0.184318 Aug 31 15:53:31.239693 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 626/1208] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:53:31 2022] GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506 => generated 1413 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:53:31.286381 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2c2fc79a-a509-47bb-8c62-d8fe23816062 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:31.287333 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2c2fc79a-a509-47bb-8c62-d8fe23816062 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] [instance: 378220a7-113f-49e1-9bfa-3804d55260c6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:31.296808 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c2fc79a-a509-47bb-8c62-d8fe23816062 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:31.297639 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c2fc79a-a509-47bb-8c62-d8fe23816062 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:31.298337 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c2fc79a-a509-47bb-8c62-d8fe23816062 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:31.299257 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c2fc79a-a509-47bb-8c62-d8fe23816062 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:31.300140 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c2fc79a-a509-47bb-8c62-d8fe23816062 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:31.300860 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c2fc79a-a509-47bb-8c62-d8fe23816062 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:31.401052 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2c2fc79a-a509-47bb-8c62-d8fe23816062 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88494f6bd936497b88c3f50b4ffb2fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390f00bece0c42999585de9fc68e1ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:31.432859 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2c2fc79a-a509-47bb-8c62-d8fe23816062 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] 10.222.0.50 "GET /compute/v2.1/servers/378220a7-113f-49e1-9bfa-3804d55260c6" status: 200 len: 1284 microversion: 2.1 time: 0.150471 Aug 31 15:53:31.439663 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 583/1209] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:31 2022] GET /compute/v2.1/servers/378220a7-113f-49e1-9bfa-3804d55260c6 => generated 1284 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:31.672953 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6d944e61-f4a6-4e5a-b059-7cf8b6cc0e06 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:31.681116 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6d944e61-f4a6-4e5a-b059-7cf8b6cc0e06 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 04a4f94b-5820-4bbe-a9b0-7fa55a697e09] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:31.692031 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d944e61-f4a6-4e5a-b059-7cf8b6cc0e06 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:31.696449 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d944e61-f4a6-4e5a-b059-7cf8b6cc0e06 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:31.697519 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d944e61-f4a6-4e5a-b059-7cf8b6cc0e06 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:31.699070 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d944e61-f4a6-4e5a-b059-7cf8b6cc0e06 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:31.700778 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d944e61-f4a6-4e5a-b059-7cf8b6cc0e06 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:31.701290 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d944e61-f4a6-4e5a-b059-7cf8b6cc0e06 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:31.867640 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6ad0461f-da5d-4bc0-927c-424c2cd8d8e6 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:31.869707 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6ad0461f-da5d-4bc0-927c-424c2cd8d8e6 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] [instance: 6fd0e478-c48e-4bf0-b934-374fd737e10e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:31.884326 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ad0461f-da5d-4bc0-927c-424c2cd8d8e6 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:31.886523 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ad0461f-da5d-4bc0-927c-424c2cd8d8e6 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:31.887529 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ad0461f-da5d-4bc0-927c-424c2cd8d8e6 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:31.889773 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ad0461f-da5d-4bc0-927c-424c2cd8d8e6 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:31.891063 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ad0461f-da5d-4bc0-927c-424c2cd8d8e6 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:31.896811 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ad0461f-da5d-4bc0-927c-424c2cd8d8e6 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:32.057323 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6d944e61-f4a6-4e5a-b059-7cf8b6cc0e06 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:32.073547 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6d944e61-f4a6-4e5a-b059-7cf8b6cc0e06 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09" status: 200 len: 1537 microversion: 2.1 time: 0.404975 Aug 31 15:53:32.091621 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 627/1210] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:31 2022] GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09 => generated 1537 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:32.198140 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6ad0461f-da5d-4bc0-927c-424c2cd8d8e6 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5489a5053e481683354d9b1541dee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9759d18563406e954d97c6bcb0718c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:32.207805 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6ad0461f-da5d-4bc0-927c-424c2cd8d8e6 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] 10.222.0.50 "GET /compute/v2.1/servers/6fd0e478-c48e-4bf0-b934-374fd737e10e" status: 200 len: 1316 microversion: 2.1 time: 0.347609 Aug 31 15:53:32.209200 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 584/1211] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:31 2022] GET /compute/v2.1/servers/6fd0e478-c48e-4bf0-b934-374fd737e10e => generated 1316 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:32.264621 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3da384cf-5b2d-4ef6-b224-c6e8f2117a00 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:32.265215 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3da384cf-5b2d-4ef6-b224-c6e8f2117a00 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] [instance: ec8bbe5f-2c2c-41b8-bfed-711906394506] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:32.284222 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3da384cf-5b2d-4ef6-b224-c6e8f2117a00 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:32.284913 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3da384cf-5b2d-4ef6-b224-c6e8f2117a00 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:32.285957 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3da384cf-5b2d-4ef6-b224-c6e8f2117a00 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:32.286883 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3da384cf-5b2d-4ef6-b224-c6e8f2117a00 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:32.287504 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3da384cf-5b2d-4ef6-b224-c6e8f2117a00 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:32.287940 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3da384cf-5b2d-4ef6-b224-c6e8f2117a00 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:32.427946 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3da384cf-5b2d-4ef6-b224-c6e8f2117a00 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:32.443095 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3da384cf-5b2d-4ef6-b224-c6e8f2117a00 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:32.450160 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3da384cf-5b2d-4ef6-b224-c6e8f2117a00 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:32.460846 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3da384cf-5b2d-4ef6-b224-c6e8f2117a00 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] 10.222.0.50 "GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506" status: 200 len: 1413 microversion: 2.54 time: 0.200545 Aug 31 15:53:32.467642 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-32e4d7de-b74b-4491-b121-98fc8f597363 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:32.468284 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-32e4d7de-b74b-4491-b121-98fc8f597363 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] [instance: 378220a7-113f-49e1-9bfa-3804d55260c6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:32.477083 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 628/1212] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:53:32 2022] GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506 => generated 1413 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:53:32.485262 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-32e4d7de-b74b-4491-b121-98fc8f597363 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:32.485812 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-32e4d7de-b74b-4491-b121-98fc8f597363 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:32.486847 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-32e4d7de-b74b-4491-b121-98fc8f597363 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:32.488021 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-32e4d7de-b74b-4491-b121-98fc8f597363 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:32.490210 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-32e4d7de-b74b-4491-b121-98fc8f597363 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:32.490749 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-32e4d7de-b74b-4491-b121-98fc8f597363 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:32.521106 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-aea757b1-9c36-42e1-bc41-ae3bbdfadc5d req-cb2390ed-e081-400d-bf10-9e594ffc9367 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fd0e478-c48e-4bf0-b934-374fd737e10e", "name": "network-vif-plugged", "status": "completed", "tag": "08858af6-f63a-4806-bf78-9b9701ace801"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:53:32.556699 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-aea757b1-9c36-42e1-bc41-ae3bbdfadc5d req-cb2390ed-e081-400d-bf10-9e594ffc9367 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:32.562752 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-aea757b1-9c36-42e1-bc41-ae3bbdfadc5d req-cb2390ed-e081-400d-bf10-9e594ffc9367 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:32.566516 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-aea757b1-9c36-42e1-bc41-ae3bbdfadc5d req-cb2390ed-e081-400d-bf10-9e594ffc9367 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:32.598809 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-aea757b1-9c36-42e1-bc41-ae3bbdfadc5d req-cb2390ed-e081-400d-bf10-9e594ffc9367 service nova] Creating event network-vif-plugged:08858af6-f63a-4806-bf78-9b9701ace801 for instance 6fd0e478-c48e-4bf0-b934-374fd737e10e on n-h2-833090-16 Aug 31 15:53:32.617369 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-aea757b1-9c36-42e1-bc41-ae3bbdfadc5d req-cb2390ed-e081-400d-bf10-9e594ffc9367 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104719 Aug 31 15:53:32.628659 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 629/1213] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:53:32.638234 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-32e4d7de-b74b-4491-b121-98fc8f597363 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88494f6bd936497b88c3f50b4ffb2fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390f00bece0c42999585de9fc68e1ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:32.650841 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-32e4d7de-b74b-4491-b121-98fc8f597363 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] 10.222.0.50 "GET /compute/v2.1/servers/378220a7-113f-49e1-9bfa-3804d55260c6" status: 200 len: 1290 microversion: 2.1 time: 0.191324 Aug 31 15:53:32.651967 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 585/1214] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:32 2022] GET /compute/v2.1/servers/378220a7-113f-49e1-9bfa-3804d55260c6 => generated 1290 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:33.099406 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a6b29b63-e4ee-4f07-9fb2-f8c7222c004b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:33.100500 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a6b29b63-e4ee-4f07-9fb2-f8c7222c004b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 04a4f94b-5820-4bbe-a9b0-7fa55a697e09] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:33.122410 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a6b29b63-e4ee-4f07-9fb2-f8c7222c004b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:33.123156 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a6b29b63-e4ee-4f07-9fb2-f8c7222c004b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:33.123803 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a6b29b63-e4ee-4f07-9fb2-f8c7222c004b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:33.124908 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a6b29b63-e4ee-4f07-9fb2-f8c7222c004b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:33.125630 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a6b29b63-e4ee-4f07-9fb2-f8c7222c004b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:33.126282 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a6b29b63-e4ee-4f07-9fb2-f8c7222c004b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:33.230319 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-146ed3e8-e44b-4b34-b88d-bc3ece1d4fc8 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:33.230899 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-146ed3e8-e44b-4b34-b88d-bc3ece1d4fc8 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] [instance: 6fd0e478-c48e-4bf0-b934-374fd737e10e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:33.232909 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:53:33.245427 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-146ed3e8-e44b-4b34-b88d-bc3ece1d4fc8 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:33.247267 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-146ed3e8-e44b-4b34-b88d-bc3ece1d4fc8 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:33.249504 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-146ed3e8-e44b-4b34-b88d-bc3ece1d4fc8 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:33.250484 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-146ed3e8-e44b-4b34-b88d-bc3ece1d4fc8 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:33.250948 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-146ed3e8-e44b-4b34-b88d-bc3ece1d4fc8 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:33.251377 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-146ed3e8-e44b-4b34-b88d-bc3ece1d4fc8 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:33.522416 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a6b29b63-e4ee-4f07-9fb2-f8c7222c004b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:33.531799 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a6b29b63-e4ee-4f07-9fb2-f8c7222c004b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09" status: 200 len: 1537 microversion: 2.1 time: 0.440291 Aug 31 15:53:33.532271 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 630/1215] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:33 2022] GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09 => generated 1537 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:33.536956 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-146ed3e8-e44b-4b34-b88d-bc3ece1d4fc8 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5489a5053e481683354d9b1541dee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9759d18563406e954d97c6bcb0718c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:33.537258 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0f784e42-1760-4d25-bad6-796429de7657 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:33.538007 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0f784e42-1760-4d25-bad6-796429de7657 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] [instance: ec8bbe5f-2c2c-41b8-bfed-711906394506] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:33.545166 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0f784e42-1760-4d25-bad6-796429de7657 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:33.545892 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0f784e42-1760-4d25-bad6-796429de7657 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:33.546423 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0f784e42-1760-4d25-bad6-796429de7657 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:33.546874 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-146ed3e8-e44b-4b34-b88d-bc3ece1d4fc8 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] 10.222.0.50 "GET /compute/v2.1/servers/6fd0e478-c48e-4bf0-b934-374fd737e10e" status: 200 len: 1316 microversion: 2.1 time: 0.320953 Aug 31 15:53:33.547113 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0f784e42-1760-4d25-bad6-796429de7657 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:33.547549 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0f784e42-1760-4d25-bad6-796429de7657 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:33.547769 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 586/1216] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:33 2022] GET /compute/v2.1/servers/6fd0e478-c48e-4bf0-b934-374fd737e10e => generated 1316 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:33.548330 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0f784e42-1760-4d25-bad6-796429de7657 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:33.565226 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:53:33.623692 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0f784e42-1760-4d25-bad6-796429de7657 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:33.633365 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0f784e42-1760-4d25-bad6-796429de7657 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:33.634815 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0f784e42-1760-4d25-bad6-796429de7657 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:33.635979 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0f784e42-1760-4d25-bad6-796429de7657 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] 10.222.0.50 "GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506" status: 200 len: 1413 microversion: 2.54 time: 0.102523 Aug 31 15:53:33.636571 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 631/1217] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:53:33 2022] GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506 => generated 1413 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:53:33.676663 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-834df71c-903a-44a4-8c23-29ae1fb2e950 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:33.677253 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-834df71c-903a-44a4-8c23-29ae1fb2e950 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] [instance: 378220a7-113f-49e1-9bfa-3804d55260c6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:33.683517 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-834df71c-903a-44a4-8c23-29ae1fb2e950 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:33.684075 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-834df71c-903a-44a4-8c23-29ae1fb2e950 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:33.684557 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-834df71c-903a-44a4-8c23-29ae1fb2e950 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:33.685288 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-834df71c-903a-44a4-8c23-29ae1fb2e950 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:33.685754 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-834df71c-903a-44a4-8c23-29ae1fb2e950 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:33.686217 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-834df71c-903a-44a4-8c23-29ae1fb2e950 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:33.690880 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:53:33.820781 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-834df71c-903a-44a4-8c23-29ae1fb2e950 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88494f6bd936497b88c3f50b4ffb2fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390f00bece0c42999585de9fc68e1ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:33.830180 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-834df71c-903a-44a4-8c23-29ae1fb2e950 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] 10.222.0.50 "GET /compute/v2.1/servers/378220a7-113f-49e1-9bfa-3804d55260c6" status: 200 len: 1332 microversion: 2.1 time: 0.157947 Aug 31 15:53:33.842340 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 587/1218] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:33 2022] GET /compute/v2.1/servers/378220a7-113f-49e1-9bfa-3804d55260c6 => generated 1332 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:34.116290 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-2e58d06e-d90c-4076-859e-51284697ebe3 req-093c73fc-953e-4748-be22-e31dc6fa070e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "378220a7-113f-49e1-9bfa-3804d55260c6", "tag": "7f87d1ce-41ae-4d7a-8907-6f24a3691eed"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:53:34.126443 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-2e58d06e-d90c-4076-859e-51284697ebe3 req-093c73fc-953e-4748-be22-e31dc6fa070e service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:34.134901 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-2e58d06e-d90c-4076-859e-51284697ebe3 req-093c73fc-953e-4748-be22-e31dc6fa070e service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:34.135621 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-2e58d06e-d90c-4076-859e-51284697ebe3 req-093c73fc-953e-4748-be22-e31dc6fa070e service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:34.148866 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-2e58d06e-d90c-4076-859e-51284697ebe3 req-093c73fc-953e-4748-be22-e31dc6fa070e service nova] Creating event network-changed:7f87d1ce-41ae-4d7a-8907-6f24a3691eed for instance 378220a7-113f-49e1-9bfa-3804d55260c6 on n-h1-833090-16 Aug 31 15:53:34.156580 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-2e58d06e-d90c-4076-859e-51284697ebe3 req-093c73fc-953e-4748-be22-e31dc6fa070e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044327 Aug 31 15:53:34.157796 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 632/1219] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:53:34.556093 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1d344440-6d44-42df-851b-1d2c26df2336 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:34.557820 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1d344440-6d44-42df-851b-1d2c26df2336 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 04a4f94b-5820-4bbe-a9b0-7fa55a697e09] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:34.568199 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d344440-6d44-42df-851b-1d2c26df2336 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:34.569669 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d344440-6d44-42df-851b-1d2c26df2336 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:34.570584 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d344440-6d44-42df-851b-1d2c26df2336 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:34.571755 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d344440-6d44-42df-851b-1d2c26df2336 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:34.572708 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d344440-6d44-42df-851b-1d2c26df2336 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:34.573627 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d344440-6d44-42df-851b-1d2c26df2336 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:34.576462 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-12f726a8-a84b-42fb-a9a9-524174fee507 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:34.577623 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-12f726a8-a84b-42fb-a9a9-524174fee507 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] [instance: 6fd0e478-c48e-4bf0-b934-374fd737e10e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:34.588132 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-12f726a8-a84b-42fb-a9a9-524174fee507 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:34.589088 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-12f726a8-a84b-42fb-a9a9-524174fee507 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:34.589788 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-12f726a8-a84b-42fb-a9a9-524174fee507 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:34.590623 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-12f726a8-a84b-42fb-a9a9-524174fee507 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:34.591297 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-12f726a8-a84b-42fb-a9a9-524174fee507 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:34.591933 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-12f726a8-a84b-42fb-a9a9-524174fee507 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:34.901881 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-12f726a8-a84b-42fb-a9a9-524174fee507 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5489a5053e481683354d9b1541dee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9759d18563406e954d97c6bcb0718c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:34.915533 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-12f726a8-a84b-42fb-a9a9-524174fee507 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] 10.222.0.50 "GET /compute/v2.1/servers/6fd0e478-c48e-4bf0-b934-374fd737e10e" status: 200 len: 1316 microversion: 2.1 time: 0.350016 Aug 31 15:53:34.930416 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 633/1220] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:34 2022] GET /compute/v2.1/servers/6fd0e478-c48e-4bf0-b934-374fd737e10e => generated 1316 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:34.937762 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-02715bc7-9c3c-47ec-8566-12c2dff8f238 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:34.939173 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-02715bc7-9c3c-47ec-8566-12c2dff8f238 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] [instance: ec8bbe5f-2c2c-41b8-bfed-711906394506] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:34.962511 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-02715bc7-9c3c-47ec-8566-12c2dff8f238 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:34.971690 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-02715bc7-9c3c-47ec-8566-12c2dff8f238 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:34.972449 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-02715bc7-9c3c-47ec-8566-12c2dff8f238 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:34.978735 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-02715bc7-9c3c-47ec-8566-12c2dff8f238 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:34.997907 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-02715bc7-9c3c-47ec-8566-12c2dff8f238 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:34.999790 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-02715bc7-9c3c-47ec-8566-12c2dff8f238 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:35.020884 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1d344440-6d44-42df-851b-1d2c26df2336 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:35.034105 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1d344440-6d44-42df-851b-1d2c26df2336 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09" status: 200 len: 1537 microversion: 2.1 time: 0.484576 Aug 31 15:53:35.052769 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 588/1221] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:34 2022] GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09 => generated 1537 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:35.058939 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6c009967-ccc8-4780-96a0-6768230a2295 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:35.059511 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6c009967-ccc8-4780-96a0-6768230a2295 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] [instance: 378220a7-113f-49e1-9bfa-3804d55260c6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:35.066473 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c009967-ccc8-4780-96a0-6768230a2295 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:35.067254 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c009967-ccc8-4780-96a0-6768230a2295 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:35.067677 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c009967-ccc8-4780-96a0-6768230a2295 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:35.068368 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c009967-ccc8-4780-96a0-6768230a2295 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:35.068812 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c009967-ccc8-4780-96a0-6768230a2295 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:35.069222 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c009967-ccc8-4780-96a0-6768230a2295 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:35.179018 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-02715bc7-9c3c-47ec-8566-12c2dff8f238 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:35.187958 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-02715bc7-9c3c-47ec-8566-12c2dff8f238 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:35.189679 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-02715bc7-9c3c-47ec-8566-12c2dff8f238 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:35.191247 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-02715bc7-9c3c-47ec-8566-12c2dff8f238 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] 10.222.0.50 "GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506" status: 200 len: 1413 microversion: 2.54 time: 0.259150 Aug 31 15:53:35.192345 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 634/1222] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:53:34 2022] GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506 => generated 1413 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:53:35.367602 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6c009967-ccc8-4780-96a0-6768230a2295 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88494f6bd936497b88c3f50b4ffb2fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390f00bece0c42999585de9fc68e1ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:35.375222 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6c009967-ccc8-4780-96a0-6768230a2295 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] 10.222.0.50 "GET /compute/v2.1/servers/378220a7-113f-49e1-9bfa-3804d55260c6" status: 200 len: 1332 microversion: 2.1 time: 0.321196 Aug 31 15:53:35.375788 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 589/1223] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:35 2022] GET /compute/v2.1/servers/378220a7-113f-49e1-9bfa-3804d55260c6 => generated 1332 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:35.938018 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a0303bb2-096f-43a7-b985-5f3db72eeeb1 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:35.942901 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a0303bb2-096f-43a7-b985-5f3db72eeeb1 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] [instance: 6fd0e478-c48e-4bf0-b934-374fd737e10e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:35.957260 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a0303bb2-096f-43a7-b985-5f3db72eeeb1 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:35.958607 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a0303bb2-096f-43a7-b985-5f3db72eeeb1 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:35.960372 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a0303bb2-096f-43a7-b985-5f3db72eeeb1 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:35.962498 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a0303bb2-096f-43a7-b985-5f3db72eeeb1 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:35.964016 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a0303bb2-096f-43a7-b985-5f3db72eeeb1 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:35.965610 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a0303bb2-096f-43a7-b985-5f3db72eeeb1 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:36.056909 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ccc8c39e-2ca2-4c65-ae46-b51ae5ae5546 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:36.057922 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ccc8c39e-2ca2-4c65-ae46-b51ae5ae5546 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 04a4f94b-5820-4bbe-a9b0-7fa55a697e09] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:36.065119 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ccc8c39e-2ca2-4c65-ae46-b51ae5ae5546 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:36.065862 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ccc8c39e-2ca2-4c65-ae46-b51ae5ae5546 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:36.066471 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ccc8c39e-2ca2-4c65-ae46-b51ae5ae5546 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:36.067692 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ccc8c39e-2ca2-4c65-ae46-b51ae5ae5546 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:36.068553 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ccc8c39e-2ca2-4c65-ae46-b51ae5ae5546 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:36.069164 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ccc8c39e-2ca2-4c65-ae46-b51ae5ae5546 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:36.268877 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a0303bb2-096f-43a7-b985-5f3db72eeeb1 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5489a5053e481683354d9b1541dee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9759d18563406e954d97c6bcb0718c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:36.289113 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a0303bb2-096f-43a7-b985-5f3db72eeeb1 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] 10.222.0.50 "GET /compute/v2.1/servers/6fd0e478-c48e-4bf0-b934-374fd737e10e" status: 200 len: 1316 microversion: 2.1 time: 0.355485 Aug 31 15:53:36.318592 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 635/1224] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:35 2022] GET /compute/v2.1/servers/6fd0e478-c48e-4bf0-b934-374fd737e10e => generated 1316 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:36.336944 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b7e41114-6497-4f98-84f2-da89adf8f035 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:36.347684 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ccc8c39e-2ca2-4c65-ae46-b51ae5ae5546 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:36.349240 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b7e41114-6497-4f98-84f2-da89adf8f035 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] [instance: a90bb0c5-7d56-4e38-8d78-a5c92a9976c3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:36.362760 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b7e41114-6497-4f98-84f2-da89adf8f035 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:36.363256 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b7e41114-6497-4f98-84f2-da89adf8f035 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:36.363683 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b7e41114-6497-4f98-84f2-da89adf8f035 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:36.364383 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b7e41114-6497-4f98-84f2-da89adf8f035 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:36.364828 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b7e41114-6497-4f98-84f2-da89adf8f035 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:36.369670 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b7e41114-6497-4f98-84f2-da89adf8f035 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:36.372924 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ccc8c39e-2ca2-4c65-ae46-b51ae5ae5546 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09" status: 200 len: 1537 microversion: 2.1 time: 0.319823 Aug 31 15:53:36.391323 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 590/1225] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:36 2022] GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09 => generated 1537 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:53:36.410303 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2bccbece-d847-46f1-a5b1-9b671f83149b tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:36.411310 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2bccbece-d847-46f1-a5b1-9b671f83149b tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] [instance: ec8bbe5f-2c2c-41b8-bfed-711906394506] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:36.432971 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2bccbece-d847-46f1-a5b1-9b671f83149b tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:36.446460 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2bccbece-d847-46f1-a5b1-9b671f83149b tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:36.447385 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2bccbece-d847-46f1-a5b1-9b671f83149b tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:36.451277 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2bccbece-d847-46f1-a5b1-9b671f83149b tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:36.454599 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2bccbece-d847-46f1-a5b1-9b671f83149b tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:36.455441 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2bccbece-d847-46f1-a5b1-9b671f83149b tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:36.464951 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b7e41114-6497-4f98-84f2-da89adf8f035 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] 10.222.0.50 "GET /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.143195 Aug 31 15:53:36.465550 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 636/1226] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 15:53:36 2022] GET /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:53:36.476656 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7bfb07db-6da6-4943-8792-289709f6e781 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:36.477803 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7bfb07db-6da6-4943-8792-289709f6e781 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] [instance: 378220a7-113f-49e1-9bfa-3804d55260c6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:36.485540 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7bfb07db-6da6-4943-8792-289709f6e781 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:36.486335 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7bfb07db-6da6-4943-8792-289709f6e781 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:36.487315 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7bfb07db-6da6-4943-8792-289709f6e781 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:36.488917 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7bfb07db-6da6-4943-8792-289709f6e781 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:36.489967 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7bfb07db-6da6-4943-8792-289709f6e781 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:36.490847 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7bfb07db-6da6-4943-8792-289709f6e781 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:36.681936 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2bccbece-d847-46f1-a5b1-9b671f83149b tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:36.692538 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2bccbece-d847-46f1-a5b1-9b671f83149b tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:36.695348 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2bccbece-d847-46f1-a5b1-9b671f83149b tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:36.696640 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2bccbece-d847-46f1-a5b1-9b671f83149b tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] 10.222.0.50 "GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506" status: 200 len: 1398 microversion: 2.54 time: 0.304204 Aug 31 15:53:36.706144 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 591/1227] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:53:36 2022] GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506 => generated 1398 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:53:36.715859 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-10586ad1-2892-4283-8bd3-b33034fb4139 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:36.716974 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-10586ad1-2892-4283-8bd3-b33034fb4139 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] [instance: a90bb0c5-7d56-4e38-8d78-a5c92a9976c3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:36.726947 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10586ad1-2892-4283-8bd3-b33034fb4139 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:36.727603 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10586ad1-2892-4283-8bd3-b33034fb4139 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:36.728623 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10586ad1-2892-4283-8bd3-b33034fb4139 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:36.729350 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10586ad1-2892-4283-8bd3-b33034fb4139 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:36.730544 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10586ad1-2892-4283-8bd3-b33034fb4139 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:36.731619 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10586ad1-2892-4283-8bd3-b33034fb4139 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:36.800752 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7bfb07db-6da6-4943-8792-289709f6e781 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88494f6bd936497b88c3f50b4ffb2fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390f00bece0c42999585de9fc68e1ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:36.809721 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7bfb07db-6da6-4943-8792-289709f6e781 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] 10.222.0.50 "GET /compute/v2.1/servers/378220a7-113f-49e1-9bfa-3804d55260c6" status: 200 len: 1332 microversion: 2.1 time: 0.343126 Aug 31 15:53:36.826639 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 637/1228] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:36 2022] GET /compute/v2.1/servers/378220a7-113f-49e1-9bfa-3804d55260c6 => generated 1332 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:36.841798 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-454289af-22d4-42f0-9a89-4bbf9be480c5 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Calling method '.version_select at 0x7fbb46788550>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:36.876798 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-10586ad1-2892-4283-8bd3-b33034fb4139 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lazy-loading 'services' on Instance uuid a90bb0c5-7d56-4e38-8d78-a5c92a9976c3 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:53:36.877951 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-454289af-22d4-42f0-9a89-4bbf9be480c5 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-529590680" status: 204 len: 0 microversion: 2.54 time: 0.045679 Aug 31 15:53:36.889936 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 638/1229] 10.222.0.50 () {60 vars in 1316 bytes} [Wed Aug 31 15:53:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-529590680 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 15:53:36.896245 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e7b1452f-029f-48df-8bb2-41af1b781702 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:36.896838 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e7b1452f-029f-48df-8bb2-41af1b781702 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] [instance: ec8bbe5f-2c2c-41b8-bfed-711906394506] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:36.904648 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7b1452f-029f-48df-8bb2-41af1b781702 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:36.905691 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7b1452f-029f-48df-8bb2-41af1b781702 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:36.906626 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7b1452f-029f-48df-8bb2-41af1b781702 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:36.907406 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7b1452f-029f-48df-8bb2-41af1b781702 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:36.908531 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7b1452f-029f-48df-8bb2-41af1b781702 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:36.909032 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7b1452f-029f-48df-8bb2-41af1b781702 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:36.962960 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e7b1452f-029f-48df-8bb2-41af1b781702 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] [instance: ec8bbe5f-2c2c-41b8-bfed-711906394506] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:53:37.027384 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-10586ad1-2892-4283-8bd3-b33034fb4139 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3/os-volume_attachments/e1ebb6f4-7758-4867-acff-077bdade0fbb" status: 202 len: 0 microversion: 2.1 time: 0.328057 Aug 31 15:53:37.028246 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 592/1230] 10.222.0.50 () {58 vars in 1416 bytes} [Wed Aug 31 15:53:36 2022] DELETE /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3/os-volume_attachments/e1ebb6f4-7758-4867-acff-077bdade0fbb => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:53:37.162403 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e7b1452f-029f-48df-8bb2-41af1b781702 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506" status: 204 len: 0 microversion: 2.54 time: 0.272719 Aug 31 15:53:37.163557 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 639/1231] 10.222.0.50 () {60 vars in 1280 bytes} [Wed Aug 31 15:53:36 2022] DELETE /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 15:53:37.175579 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b4b2de9d-f8b3-47a3-b4c2-a9e4d52cecf7 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:37.177460 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b4b2de9d-f8b3-47a3-b4c2-a9e4d52cecf7 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] [instance: ec8bbe5f-2c2c-41b8-bfed-711906394506] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:37.186993 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4b2de9d-f8b3-47a3-b4c2-a9e4d52cecf7 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:37.188316 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4b2de9d-f8b3-47a3-b4c2-a9e4d52cecf7 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:37.189038 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4b2de9d-f8b3-47a3-b4c2-a9e4d52cecf7 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:37.191361 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4b2de9d-f8b3-47a3-b4c2-a9e4d52cecf7 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:37.192061 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4b2de9d-f8b3-47a3-b4c2-a9e4d52cecf7 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:37.193553 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4b2de9d-f8b3-47a3-b4c2-a9e4d52cecf7 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:37.282232 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b4b2de9d-f8b3-47a3-b4c2-a9e4d52cecf7 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:37.291666 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b4b2de9d-f8b3-47a3-b4c2-a9e4d52cecf7 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:37.294651 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b4b2de9d-f8b3-47a3-b4c2-a9e4d52cecf7 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:37.296169 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b4b2de9d-f8b3-47a3-b4c2-a9e4d52cecf7 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] 10.222.0.50 "GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506" status: 200 len: 1404 microversion: 2.54 time: 0.127337 Aug 31 15:53:37.319464 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a3485520-dcf9-49eb-b805-55c2186e778b tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:37.320937 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a3485520-dcf9-49eb-b805-55c2186e778b tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] [instance: 6fd0e478-c48e-4bf0-b934-374fd737e10e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:37.323360 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 593/1232] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:53:37 2022] GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506 => generated 1404 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:53:37.328431 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a3485520-dcf9-49eb-b805-55c2186e778b tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:37.329321 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a3485520-dcf9-49eb-b805-55c2186e778b tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:37.329793 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a3485520-dcf9-49eb-b805-55c2186e778b tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:37.330933 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a3485520-dcf9-49eb-b805-55c2186e778b tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:37.331778 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a3485520-dcf9-49eb-b805-55c2186e778b tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:37.332723 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a3485520-dcf9-49eb-b805-55c2186e778b tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:37.395909 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4f18013f-b846-4562-9765-2f44934d2b68 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:37.396740 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4f18013f-b846-4562-9765-2f44934d2b68 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 04a4f94b-5820-4bbe-a9b0-7fa55a697e09] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:37.412494 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f18013f-b846-4562-9765-2f44934d2b68 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:37.419120 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f18013f-b846-4562-9765-2f44934d2b68 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:37.421838 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f18013f-b846-4562-9765-2f44934d2b68 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:37.422733 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f18013f-b846-4562-9765-2f44934d2b68 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:37.424670 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f18013f-b846-4562-9765-2f44934d2b68 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:37.427245 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f18013f-b846-4562-9765-2f44934d2b68 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:37.585697 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a3485520-dcf9-49eb-b805-55c2186e778b tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5489a5053e481683354d9b1541dee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9759d18563406e954d97c6bcb0718c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:37.619328 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a3485520-dcf9-49eb-b805-55c2186e778b tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] 10.222.0.50 "GET /compute/v2.1/servers/6fd0e478-c48e-4bf0-b934-374fd737e10e" status: 200 len: 1504 microversion: 2.1 time: 0.307484 Aug 31 15:53:37.630007 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 640/1233] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:37 2022] GET /compute/v2.1/servers/6fd0e478-c48e-4bf0-b934-374fd737e10e => generated 1504 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:37.655415 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ec66ea2f-29e1-4c71-a71f-c16311c11b73 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:37.655911 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ec66ea2f-29e1-4c71-a71f-c16311c11b73 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] [instance: 6fd0e478-c48e-4bf0-b934-374fd737e10e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:37.663607 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ec66ea2f-29e1-4c71-a71f-c16311c11b73 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:37.664363 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ec66ea2f-29e1-4c71-a71f-c16311c11b73 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:37.665471 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ec66ea2f-29e1-4c71-a71f-c16311c11b73 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:37.666519 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ec66ea2f-29e1-4c71-a71f-c16311c11b73 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:37.667210 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ec66ea2f-29e1-4c71-a71f-c16311c11b73 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:37.667909 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ec66ea2f-29e1-4c71-a71f-c16311c11b73 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:37.703787 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ec66ea2f-29e1-4c71-a71f-c16311c11b73 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] [instance: 6fd0e478-c48e-4bf0-b934-374fd737e10e] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:53:37.901795 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ec66ea2f-29e1-4c71-a71f-c16311c11b73 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] 10.222.0.50 "DELETE /compute/v2.1/servers/6fd0e478-c48e-4bf0-b934-374fd737e10e" status: 204 len: 0 microversion: 2.1 time: 0.249963 Aug 31 15:53:37.902681 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 641/1234] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:53:37 2022] DELETE /compute/v2.1/servers/6fd0e478-c48e-4bf0-b934-374fd737e10e => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 15:53:37.912665 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ed3176e5-3d74-4b9e-9e0a-4ef5d20650f4 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:37.913743 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ed3176e5-3d74-4b9e-9e0a-4ef5d20650f4 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] [instance: 378220a7-113f-49e1-9bfa-3804d55260c6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:37.921862 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ed3176e5-3d74-4b9e-9e0a-4ef5d20650f4 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:37.922803 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ed3176e5-3d74-4b9e-9e0a-4ef5d20650f4 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:37.923946 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ed3176e5-3d74-4b9e-9e0a-4ef5d20650f4 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:37.925110 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ed3176e5-3d74-4b9e-9e0a-4ef5d20650f4 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:37.926807 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ed3176e5-3d74-4b9e-9e0a-4ef5d20650f4 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:37.927422 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ed3176e5-3d74-4b9e-9e0a-4ef5d20650f4 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:38.013135 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4f18013f-b846-4562-9765-2f44934d2b68 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:38.024124 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4f18013f-b846-4562-9765-2f44934d2b68 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09" status: 200 len: 1537 microversion: 2.1 time: 0.633216 Aug 31 15:53:38.025072 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 594/1235] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:37 2022] GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09 => generated 1537 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:53:38.030891 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2783203c-2f5a-48bc-8cc4-6ef42359dfcb tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:38.031513 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2783203c-2f5a-48bc-8cc4-6ef42359dfcb tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] [instance: 6fd0e478-c48e-4bf0-b934-374fd737e10e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:38.042843 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2783203c-2f5a-48bc-8cc4-6ef42359dfcb tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:38.043350 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2783203c-2f5a-48bc-8cc4-6ef42359dfcb tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:38.043797 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2783203c-2f5a-48bc-8cc4-6ef42359dfcb tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:38.044774 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2783203c-2f5a-48bc-8cc4-6ef42359dfcb tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:38.045234 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2783203c-2f5a-48bc-8cc4-6ef42359dfcb tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:38.045657 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2783203c-2f5a-48bc-8cc4-6ef42359dfcb tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:38.333100 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ed3176e5-3d74-4b9e-9e0a-4ef5d20650f4 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88494f6bd936497b88c3f50b4ffb2fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390f00bece0c42999585de9fc68e1ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:38.352426 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ed3176e5-3d74-4b9e-9e0a-4ef5d20650f4 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] 10.222.0.50 "GET /compute/v2.1/servers/378220a7-113f-49e1-9bfa-3804d55260c6" status: 200 len: 1332 microversion: 2.1 time: 0.445597 Aug 31 15:53:38.353068 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 642/1236] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:37 2022] GET /compute/v2.1/servers/378220a7-113f-49e1-9bfa-3804d55260c6 => generated 1332 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:38.361943 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ce113646-424f-4509-8e8c-50ff5c34e79a tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:38.362514 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ce113646-424f-4509-8e8c-50ff5c34e79a tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] [instance: ec8bbe5f-2c2c-41b8-bfed-711906394506] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:38.372224 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2783203c-2f5a-48bc-8cc4-6ef42359dfcb tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5489a5053e481683354d9b1541dee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9759d18563406e954d97c6bcb0718c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:38.382687 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2783203c-2f5a-48bc-8cc4-6ef42359dfcb tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] 10.222.0.50 "GET /compute/v2.1/servers/6fd0e478-c48e-4bf0-b934-374fd737e10e" status: 200 len: 1510 microversion: 2.1 time: 0.356419 Aug 31 15:53:38.384526 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 595/1237] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:38 2022] GET /compute/v2.1/servers/6fd0e478-c48e-4bf0-b934-374fd737e10e => generated 1510 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:38.387261 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ce113646-424f-4509-8e8c-50ff5c34e79a tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:38.387768 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ce113646-424f-4509-8e8c-50ff5c34e79a tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:38.388200 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ce113646-424f-4509-8e8c-50ff5c34e79a tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:38.389041 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ce113646-424f-4509-8e8c-50ff5c34e79a tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:38.389489 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ce113646-424f-4509-8e8c-50ff5c34e79a tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:38.390073 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ce113646-424f-4509-8e8c-50ff5c34e79a tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:38.468574 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ce113646-424f-4509-8e8c-50ff5c34e79a tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:38.479780 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ce113646-424f-4509-8e8c-50ff5c34e79a tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:38.481892 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ce113646-424f-4509-8e8c-50ff5c34e79a tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:38.483120 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ce113646-424f-4509-8e8c-50ff5c34e79a tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] 10.222.0.50 "GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506" status: 200 len: 1404 microversion: 2.54 time: 0.128911 Aug 31 15:53:38.484090 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 643/1238] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:53:38 2022] GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506 => generated 1404 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:53:39.045331 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-19f78857-8b68-4b0c-bf15-4df3445123b1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:39.047104 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-19f78857-8b68-4b0c-bf15-4df3445123b1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 04a4f94b-5820-4bbe-a9b0-7fa55a697e09] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:39.063974 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19f78857-8b68-4b0c-bf15-4df3445123b1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:39.066074 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19f78857-8b68-4b0c-bf15-4df3445123b1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:39.066810 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19f78857-8b68-4b0c-bf15-4df3445123b1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:39.067860 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19f78857-8b68-4b0c-bf15-4df3445123b1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:39.068343 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19f78857-8b68-4b0c-bf15-4df3445123b1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:39.068803 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19f78857-8b68-4b0c-bf15-4df3445123b1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:39.376701 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5cfa7d60-d2b9-4224-b817-12906c67d928 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:39.377228 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-19f78857-8b68-4b0c-bf15-4df3445123b1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:39.377593 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5cfa7d60-d2b9-4224-b817-12906c67d928 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] [instance: 378220a7-113f-49e1-9bfa-3804d55260c6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:39.387212 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-19f78857-8b68-4b0c-bf15-4df3445123b1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09" status: 200 len: 1542 microversion: 2.1 time: 0.346036 Aug 31 15:53:39.388816 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 596/1239] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:39 2022] GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09 => generated 1542 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:39.403841 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5cfa7d60-d2b9-4224-b817-12906c67d928 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:39.404353 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5cfa7d60-d2b9-4224-b817-12906c67d928 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:39.404780 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5cfa7d60-d2b9-4224-b817-12906c67d928 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:39.405512 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5cfa7d60-d2b9-4224-b817-12906c67d928 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:39.409792 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bc7b8fc0-96c0-4e74-8b90-9f87349f5ec8 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:39.410444 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bc7b8fc0-96c0-4e74-8b90-9f87349f5ec8 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] [instance: 6fd0e478-c48e-4bf0-b934-374fd737e10e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:39.412988 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5cfa7d60-d2b9-4224-b817-12906c67d928 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:39.413432 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5cfa7d60-d2b9-4224-b817-12906c67d928 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:39.438955 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc7b8fc0-96c0-4e74-8b90-9f87349f5ec8 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:39.441447 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc7b8fc0-96c0-4e74-8b90-9f87349f5ec8 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:39.441895 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc7b8fc0-96c0-4e74-8b90-9f87349f5ec8 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:39.444624 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc7b8fc0-96c0-4e74-8b90-9f87349f5ec8 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:39.445127 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc7b8fc0-96c0-4e74-8b90-9f87349f5ec8 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:39.446498 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc7b8fc0-96c0-4e74-8b90-9f87349f5ec8 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:39.641435 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:53:39.754533 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5cfa7d60-d2b9-4224-b817-12906c67d928 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88494f6bd936497b88c3f50b4ffb2fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390f00bece0c42999585de9fc68e1ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:39.765584 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5cfa7d60-d2b9-4224-b817-12906c67d928 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] 10.222.0.50 "GET /compute/v2.1/servers/378220a7-113f-49e1-9bfa-3804d55260c6" status: 200 len: 1332 microversion: 2.1 time: 0.392572 Aug 31 15:53:39.769817 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 644/1240] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:39 2022] GET /compute/v2.1/servers/378220a7-113f-49e1-9bfa-3804d55260c6 => generated 1332 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:53:39.781887 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-5c24e596-a496-478e-afc1-4b33faf7beb4 req-16b16b0c-3ae4-4cfe-8f28-0efe2e31b7a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "378220a7-113f-49e1-9bfa-3804d55260c6", "name": "network-vif-plugged", "status": "completed", "tag": "7f87d1ce-41ae-4d7a-8907-6f24a3691eed"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:53:39.804149 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bc7b8fc0-96c0-4e74-8b90-9f87349f5ec8 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5489a5053e481683354d9b1541dee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9759d18563406e954d97c6bcb0718c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:39.806081 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-5c24e596-a496-478e-afc1-4b33faf7beb4 req-16b16b0c-3ae4-4cfe-8f28-0efe2e31b7a2 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:39.806832 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-5c24e596-a496-478e-afc1-4b33faf7beb4 req-16b16b0c-3ae4-4cfe-8f28-0efe2e31b7a2 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:39.807461 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-5c24e596-a496-478e-afc1-4b33faf7beb4 req-16b16b0c-3ae4-4cfe-8f28-0efe2e31b7a2 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:39.813283 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bc7b8fc0-96c0-4e74-8b90-9f87349f5ec8 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] 10.222.0.50 "GET /compute/v2.1/servers/6fd0e478-c48e-4bf0-b934-374fd737e10e" status: 200 len: 1510 microversion: 2.1 time: 0.412195 Aug 31 15:53:39.826117 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 597/1241] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:39 2022] GET /compute/v2.1/servers/6fd0e478-c48e-4bf0-b934-374fd737e10e => generated 1510 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:39.826117 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c488df05-f9e6-4a70-85bf-4343639e34fe tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:39.826117 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c488df05-f9e6-4a70-85bf-4343639e34fe tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] [instance: ec8bbe5f-2c2c-41b8-bfed-711906394506] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:39.827403 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c488df05-f9e6-4a70-85bf-4343639e34fe tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:39.827887 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c488df05-f9e6-4a70-85bf-4343639e34fe tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:39.828311 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c488df05-f9e6-4a70-85bf-4343639e34fe tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:39.833627 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c488df05-f9e6-4a70-85bf-4343639e34fe tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:39.834031 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c488df05-f9e6-4a70-85bf-4343639e34fe tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:39.834719 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c488df05-f9e6-4a70-85bf-4343639e34fe tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:39.835690 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-5c24e596-a496-478e-afc1-4b33faf7beb4 req-16b16b0c-3ae4-4cfe-8f28-0efe2e31b7a2 service nova] Creating event network-vif-plugged:7f87d1ce-41ae-4d7a-8907-6f24a3691eed for instance 378220a7-113f-49e1-9bfa-3804d55260c6 on n-h1-833090-16 Aug 31 15:53:39.842590 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-5c24e596-a496-478e-afc1-4b33faf7beb4 req-16b16b0c-3ae4-4cfe-8f28-0efe2e31b7a2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069879 Aug 31 15:53:39.863010 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 645/1242] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:53:39.982571 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c488df05-f9e6-4a70-85bf-4343639e34fe tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:39.993113 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c488df05-f9e6-4a70-85bf-4343639e34fe tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:40.000046 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c488df05-f9e6-4a70-85bf-4343639e34fe tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:40.006175 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c488df05-f9e6-4a70-85bf-4343639e34fe tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] 10.222.0.50 "GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506" status: 200 len: 1404 microversion: 2.54 time: 0.189099 Aug 31 15:53:40.007026 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 598/1243] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:53:39 2022] GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506 => generated 1404 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:53:40.411154 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8b021c5c-6f85-44c6-add6-a086c4db93b7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:40.412248 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8b021c5c-6f85-44c6-add6-a086c4db93b7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 04a4f94b-5820-4bbe-a9b0-7fa55a697e09] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:40.429258 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b021c5c-6f85-44c6-add6-a086c4db93b7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:40.430655 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b021c5c-6f85-44c6-add6-a086c4db93b7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:40.432063 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b021c5c-6f85-44c6-add6-a086c4db93b7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:40.434435 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b021c5c-6f85-44c6-add6-a086c4db93b7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:40.435055 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b021c5c-6f85-44c6-add6-a086c4db93b7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:40.435637 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b021c5c-6f85-44c6-add6-a086c4db93b7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:40.700998 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8b021c5c-6f85-44c6-add6-a086c4db93b7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:40.717365 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8b021c5c-6f85-44c6-add6-a086c4db93b7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09" status: 200 len: 1542 microversion: 2.1 time: 0.311270 Aug 31 15:53:40.717937 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 646/1244] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:40 2022] GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09 => generated 1542 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:40.789594 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fcdfbd99-29ab-4dc5-a3a8-9716539a0c4d tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:40.790840 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fcdfbd99-29ab-4dc5-a3a8-9716539a0c4d tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] [instance: 378220a7-113f-49e1-9bfa-3804d55260c6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:40.799079 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=8 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:53:40.802003 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fcdfbd99-29ab-4dc5-a3a8-9716539a0c4d tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:40.802632 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fcdfbd99-29ab-4dc5-a3a8-9716539a0c4d tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:40.803257 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fcdfbd99-29ab-4dc5-a3a8-9716539a0c4d tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:40.804554 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fcdfbd99-29ab-4dc5-a3a8-9716539a0c4d tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:40.805172 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fcdfbd99-29ab-4dc5-a3a8-9716539a0c4d tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:40.805752 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fcdfbd99-29ab-4dc5-a3a8-9716539a0c4d tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:40.840190 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e9c9c70e-d07d-41ff-a46b-986f6dfe428e tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:40.840633 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e9c9c70e-d07d-41ff-a46b-986f6dfe428e tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] [instance: 6fd0e478-c48e-4bf0-b934-374fd737e10e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:40.862569 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e9c9c70e-d07d-41ff-a46b-986f6dfe428e tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:40.863107 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e9c9c70e-d07d-41ff-a46b-986f6dfe428e tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:40.863543 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e9c9c70e-d07d-41ff-a46b-986f6dfe428e tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:40.864257 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e9c9c70e-d07d-41ff-a46b-986f6dfe428e tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:40.866455 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e9c9c70e-d07d-41ff-a46b-986f6dfe428e tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:40.869240 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e9c9c70e-d07d-41ff-a46b-986f6dfe428e tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:40.884329 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:53:41.251195 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fcdfbd99-29ab-4dc5-a3a8-9716539a0c4d tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88494f6bd936497b88c3f50b4ffb2fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390f00bece0c42999585de9fc68e1ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:41.275559 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e9c9c70e-d07d-41ff-a46b-986f6dfe428e tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5489a5053e481683354d9b1541dee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9759d18563406e954d97c6bcb0718c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:41.284118 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fcdfbd99-29ab-4dc5-a3a8-9716539a0c4d tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] 10.222.0.50 "GET /compute/v2.1/servers/378220a7-113f-49e1-9bfa-3804d55260c6" status: 200 len: 1332 microversion: 2.1 time: 0.489117 Aug 31 15:53:41.285582 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 599/1245] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:40 2022] GET /compute/v2.1/servers/378220a7-113f-49e1-9bfa-3804d55260c6 => generated 1332 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:41.308529 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e9c9c70e-d07d-41ff-a46b-986f6dfe428e tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] 10.222.0.50 "GET /compute/v2.1/servers/6fd0e478-c48e-4bf0-b934-374fd737e10e" status: 200 len: 1510 microversion: 2.1 time: 0.472535 Aug 31 15:53:41.310668 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d21b4dfd-f127-4a6f-b703-58a2ea3e3671 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:41.313167 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 647/1246] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:40 2022] GET /compute/v2.1/servers/6fd0e478-c48e-4bf0-b934-374fd737e10e => generated 1510 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:41.314553 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d21b4dfd-f127-4a6f-b703-58a2ea3e3671 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] [instance: ec8bbe5f-2c2c-41b8-bfed-711906394506] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:41.334875 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d21b4dfd-f127-4a6f-b703-58a2ea3e3671 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:41.335841 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d21b4dfd-f127-4a6f-b703-58a2ea3e3671 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:41.337610 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d21b4dfd-f127-4a6f-b703-58a2ea3e3671 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:41.340109 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d21b4dfd-f127-4a6f-b703-58a2ea3e3671 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:41.342192 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d21b4dfd-f127-4a6f-b703-58a2ea3e3671 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:41.343179 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d21b4dfd-f127-4a6f-b703-58a2ea3e3671 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:41.382333 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-b420d778-deba-425a-b842-0003a6623ac1 req-888b65d0-df05-466f-91f4-8d97382b1474 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fd0e478-c48e-4bf0-b934-374fd737e10e", "name": "network-vif-deleted", "tag": "08858af6-f63a-4806-bf78-9b9701ace801"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:53:41.403721 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-b420d778-deba-425a-b842-0003a6623ac1 req-888b65d0-df05-466f-91f4-8d97382b1474 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:41.404474 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-b420d778-deba-425a-b842-0003a6623ac1 req-888b65d0-df05-466f-91f4-8d97382b1474 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:41.406404 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-b420d778-deba-425a-b842-0003a6623ac1 req-888b65d0-df05-466f-91f4-8d97382b1474 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:41.435766 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-b420d778-deba-425a-b842-0003a6623ac1 req-888b65d0-df05-466f-91f4-8d97382b1474 service nova] Creating event network-vif-deleted:08858af6-f63a-4806-bf78-9b9701ace801 for instance 6fd0e478-c48e-4bf0-b934-374fd737e10e on n-h2-833090-16 Aug 31 15:53:41.438647 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d21b4dfd-f127-4a6f-b703-58a2ea3e3671 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:41.439572 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d21b4dfd-f127-4a6f-b703-58a2ea3e3671 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:41.440307 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d21b4dfd-f127-4a6f-b703-58a2ea3e3671 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:41.441128 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-d21b4dfd-f127-4a6f-b703-58a2ea3e3671 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lazy-loading 'fault' on Instance uuid ec8bbe5f-2c2c-41b8-bfed-711906394506 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:53:41.453669 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-b420d778-deba-425a-b842-0003a6623ac1 req-888b65d0-df05-466f-91f4-8d97382b1474 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076071 Aug 31 15:53:41.459090 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 648/1247] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:53:41.533836 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d21b4dfd-f127-4a6f-b703-58a2ea3e3671 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:41.546428 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d21b4dfd-f127-4a6f-b703-58a2ea3e3671 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:41.550073 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d21b4dfd-f127-4a6f-b703-58a2ea3e3671 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd6c2aa8a18954a9497c2c90890189fe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdc9d048a4845f3983579cd9d88faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:41.552075 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d21b4dfd-f127-4a6f-b703-58a2ea3e3671 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] 10.222.0.50 "GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506" status: 200 len: 1409 microversion: 2.54 time: 0.262299 Aug 31 15:53:41.552877 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 600/1248] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:53:41 2022] GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506 => generated 1409 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:53:41.741309 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4901297f-ad0b-4ba8-97a0-b895258be76f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:41.742339 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4901297f-ad0b-4ba8-97a0-b895258be76f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 04a4f94b-5820-4bbe-a9b0-7fa55a697e09] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:41.756074 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4901297f-ad0b-4ba8-97a0-b895258be76f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:41.757273 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4901297f-ad0b-4ba8-97a0-b895258be76f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:41.758000 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4901297f-ad0b-4ba8-97a0-b895258be76f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:41.758951 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4901297f-ad0b-4ba8-97a0-b895258be76f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:41.760419 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4901297f-ad0b-4ba8-97a0-b895258be76f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:41.761017 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4901297f-ad0b-4ba8-97a0-b895258be76f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:42.304827 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4901297f-ad0b-4ba8-97a0-b895258be76f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:42.305791 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4a69ebff-fad3-476f-8c10-40deaaaf180d tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:42.306522 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4a69ebff-fad3-476f-8c10-40deaaaf180d tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] [instance: 378220a7-113f-49e1-9bfa-3804d55260c6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:42.319249 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a69ebff-fad3-476f-8c10-40deaaaf180d tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:42.320076 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a69ebff-fad3-476f-8c10-40deaaaf180d tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:42.320675 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a69ebff-fad3-476f-8c10-40deaaaf180d tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:42.321583 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a69ebff-fad3-476f-8c10-40deaaaf180d tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:42.322270 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a69ebff-fad3-476f-8c10-40deaaaf180d tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:42.322839 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a69ebff-fad3-476f-8c10-40deaaaf180d tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:42.333395 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4901297f-ad0b-4ba8-97a0-b895258be76f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09" status: 200 len: 1542 microversion: 2.1 time: 0.591534 Aug 31 15:53:42.345337 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 649/1249] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:41 2022] GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09 => generated 1542 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:42.345337 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4e6abf2e-d92d-4458-8ac5-992c99f8bc6c tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:42.345337 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4e6abf2e-d92d-4458-8ac5-992c99f8bc6c tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] [instance: 6fd0e478-c48e-4bf0-b934-374fd737e10e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:42.360170 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=4,nova_api:UPDATE=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:53:42.362543 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4e6abf2e-d92d-4458-8ac5-992c99f8bc6c tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:42.365751 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4e6abf2e-d92d-4458-8ac5-992c99f8bc6c tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:42.366293 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4e6abf2e-d92d-4458-8ac5-992c99f8bc6c tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:42.367042 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4e6abf2e-d92d-4458-8ac5-992c99f8bc6c tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:42.367502 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4e6abf2e-d92d-4458-8ac5-992c99f8bc6c tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:42.367927 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4e6abf2e-d92d-4458-8ac5-992c99f8bc6c tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:42.485895 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4e6abf2e-d92d-4458-8ac5-992c99f8bc6c tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:42.486603 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4e6abf2e-d92d-4458-8ac5-992c99f8bc6c tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:42.486857 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4e6abf2e-d92d-4458-8ac5-992c99f8bc6c tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:42.487323 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-4e6abf2e-d92d-4458-8ac5-992c99f8bc6c tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lazy-loading 'fault' on Instance uuid 6fd0e478-c48e-4bf0-b934-374fd737e10e {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:53:42.604572 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4e6abf2e-d92d-4458-8ac5-992c99f8bc6c tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5489a5053e481683354d9b1541dee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9759d18563406e954d97c6bcb0718c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:42.618914 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4e6abf2e-d92d-4458-8ac5-992c99f8bc6c tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] 10.222.0.50 "GET /compute/v2.1/servers/6fd0e478-c48e-4bf0-b934-374fd737e10e" status: 200 len: 1306 microversion: 2.1 time: 0.281059 Aug 31 15:53:42.637558 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 650/1250] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:42 2022] GET /compute/v2.1/servers/6fd0e478-c48e-4bf0-b934-374fd737e10e => generated 1306 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:42.654728 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-437278b2-184d-4c38-a119-10d844e209d3 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:42.656899 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-437278b2-184d-4c38-a119-10d844e209d3 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] [instance: ec8bbe5f-2c2c-41b8-bfed-711906394506] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:42.670480 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-437278b2-184d-4c38-a119-10d844e209d3 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:42.671273 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-437278b2-184d-4c38-a119-10d844e209d3 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:42.673139 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-437278b2-184d-4c38-a119-10d844e209d3 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:42.674172 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-437278b2-184d-4c38-a119-10d844e209d3 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:42.675425 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-437278b2-184d-4c38-a119-10d844e209d3 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:42.677164 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-437278b2-184d-4c38-a119-10d844e209d3 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:42.715647 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-437278b2-184d-4c38-a119-10d844e209d3 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] HTTP exception thrown: Instance ec8bbe5f-2c2c-41b8-bfed-711906394506 could not be found. Aug 31 15:53:42.719358 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-437278b2-184d-4c38-a119-10d844e209d3 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Request method failure captured: Aug 31 15:53:42.719358 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506 HTTP/1.1 Aug 31 15:53:42.719358 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:53:42.719358 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:53:42.719358 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:53:42.719358 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:53:42.719358 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:53:42.719358 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:53:42.719358 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:53:42.719358 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:53:42.719358 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4PK5nj6f1WR1Kw310f4QxG43HIwFqVkvrOkhMZYhPtk6uSMraGyUydeBKZeycKw9jeBDntVzhOySzTd6wZO43hLHyQ2Jh72mNLlO-aaNkqNrGbL9xSX_Ae76ITiPpo7i_X7TNImHThIQQvYcmTs7K7GLhUBF4UgOx9jed4Ol23mCMg Aug 31 15:53:42.719358 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:53:42.719358 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:53:42.719358 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:53:42.719358 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:53:42.719358 n-d-833090-16 devstack@n-api.service[128864]: X-Openstack-Nova-Api-Version: 2.54 Aug 31 15:53:42.719358 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:53:42.719358 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:53:42.719358 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 7bdc9d048a4845f3983579cd9d88faca Aug 31 15:53:42.719358 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServerShowV254Test-684980357 Aug 31 15:53:42.719358 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:53:42.719358 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:53:42.721834 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7bdc9d048a4845f3983579cd9d88faca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7bdc9d048a4845f3983579cd9d88faca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7bdc9d048a4845f3983579cd9d88faca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7bdc9d048a4845f3983579cd9d88faca", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:53:42.721834 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServerShowV254Test-684980357 Aug 31 15:53:42.721834 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 7bdc9d048a4845f3983579cd9d88faca Aug 31 15:53:42.721834 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServerShowV254Test-684980357 Aug 31 15:53:42.721834 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServerShowV254Test-684980357-project Aug 31 15:53:42.721834 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:53:42.721834 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:53:42.721834 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: d6c2aa8a18954a9497c2c90890189fe3 Aug 31 15:53:42.721834 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServerShowV254Test-684980357-project Aug 31 15:53:42.721834 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:53:42.721834 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance ec8bbe5f-2c2c-41b8-bfed-711906394506 could not be found. Aug 31 15:53:42.721834 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'ec8bbe5f-2c2c-41b8-bfed-711906394506'} Aug 31 15:53:42.722835 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:53:42.722835 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:42.722835 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:53:42.722835 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:53:42.722835 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:53:42.722835 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:53:42.722835 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:53:42.722835 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:53:42.722835 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:53:42.722835 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:53:42.722835 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec8bbe5f-2c2c-41b8-bfed-711906394506 could not be found. Aug 31 15:53:42.722835 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:53:42.722835 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:53:42.722835 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:53:42.722835 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:42.722835 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:53:42.722835 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:53:42.722835 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:53:42.722835 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:53:42.722835 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:53:42.724430 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:53:42.724430 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:53:42.724430 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:53:42.724430 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:53:42.724430 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:53:42.724430 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:53:42.724430 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:53:42.724430 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec8bbe5f-2c2c-41b8-bfed-711906394506 could not be found. Aug 31 15:53:42.724430 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:53:42.724430 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:53:42.724430 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:53:42.724430 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:42.724430 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:53:42.724430 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:53:42.724430 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:53:42.724430 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:53:42.724430 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec8bbe5f-2c2c-41b8-bfed-711906394506 could not be found. Aug 31 15:53:42.724430 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:53:42.727998 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-437278b2-184d-4c38-a119-10d844e209d3 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] Returning 404 to user: Instance ec8bbe5f-2c2c-41b8-bfed-711906394506 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:53:42.729436 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-437278b2-184d-4c38-a119-10d844e209d3 tempest-ServerShowV254Test-684980357 tempest-ServerShowV254Test-684980357-project] 10.222.0.50 "GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506" status: 404 len: 111 microversion: 2.54 time: 0.090643 Aug 31 15:53:42.735052 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 651/1251] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:53:42 2022] GET /compute/v2.1/servers/ec8bbe5f-2c2c-41b8-bfed-711906394506 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 15:53:42.751957 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4a69ebff-fad3-476f-8c10-40deaaaf180d tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88494f6bd936497b88c3f50b4ffb2fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390f00bece0c42999585de9fc68e1ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:42.767638 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4a69ebff-fad3-476f-8c10-40deaaaf180d tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] 10.222.0.50 "GET /compute/v2.1/servers/378220a7-113f-49e1-9bfa-3804d55260c6" status: 200 len: 1536 microversion: 2.1 time: 0.461727 Aug 31 15:53:42.768179 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 601/1252] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:42 2022] GET /compute/v2.1/servers/378220a7-113f-49e1-9bfa-3804d55260c6 => generated 1536 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:53:42.793274 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-736b8bbd-8df2-411c-94ec-990c6c0a938d tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Action: 'create', calling method: .version_select at 0x7fbb4ab7e280>, body: {"pool": "01541c28-e61f-455d-a5a3-6c50a4460e17"} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:53:43.359855 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6814f6c8-c6a4-46c2-868d-5bc19d9517c4 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:43.361238 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6814f6c8-c6a4-46c2-868d-5bc19d9517c4 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 04a4f94b-5820-4bbe-a9b0-7fa55a697e09] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:43.372409 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6814f6c8-c6a4-46c2-868d-5bc19d9517c4 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:43.373240 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6814f6c8-c6a4-46c2-868d-5bc19d9517c4 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:43.374120 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6814f6c8-c6a4-46c2-868d-5bc19d9517c4 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:43.375255 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6814f6c8-c6a4-46c2-868d-5bc19d9517c4 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:43.376118 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6814f6c8-c6a4-46c2-868d-5bc19d9517c4 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:43.377268 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6814f6c8-c6a4-46c2-868d-5bc19d9517c4 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:43.912695 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6814f6c8-c6a4-46c2-868d-5bc19d9517c4 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:43.944916 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:53:43.957594 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6814f6c8-c6a4-46c2-868d-5bc19d9517c4 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09" status: 200 len: 1542 microversion: 2.1 time: 0.604020 Aug 31 15:53:43.972178 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 602/1253] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:43 2022] GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09 => generated 1542 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:53:44.000737 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-117cf62e-5dec-42de-9e3c-224c851a6668 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:44.002973 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-117cf62e-5dec-42de-9e3c-224c851a6668 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] [instance: 6fd0e478-c48e-4bf0-b934-374fd737e10e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:44.019936 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-117cf62e-5dec-42de-9e3c-224c851a6668 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:44.020835 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-117cf62e-5dec-42de-9e3c-224c851a6668 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:44.023424 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-117cf62e-5dec-42de-9e3c-224c851a6668 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:44.024949 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-117cf62e-5dec-42de-9e3c-224c851a6668 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:44.029541 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-117cf62e-5dec-42de-9e3c-224c851a6668 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:44.030620 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-117cf62e-5dec-42de-9e3c-224c851a6668 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:44.053881 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-117cf62e-5dec-42de-9e3c-224c851a6668 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] HTTP exception thrown: Instance 6fd0e478-c48e-4bf0-b934-374fd737e10e could not be found. Aug 31 15:53:44.055922 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-117cf62e-5dec-42de-9e3c-224c851a6668 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Request method failure captured: Aug 31 15:53:44.055922 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/6fd0e478-c48e-4bf0-b934-374fd737e10e HTTP/1.1 Aug 31 15:53:44.055922 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:53:44.055922 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:53:44.055922 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:53:44.055922 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:53:44.055922 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:53:44.055922 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:53:44.055922 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:53:44.055922 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:53:44.055922 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4Pn0RoDVVim5pqVezhLvozN4I3cxh5ZT36NHV2hiFQcLjyJ110jka2NP7jUstq44gj0SNchySopZ91BYTMIEVBLMBx1FqzIgcpDG96IrZ9x0cpNMdhybPCxwau0B9MMkehhvwgMZF89UKNXZ5Nz0nr2gf_s5GWnoCWg5Ke4zSFf7Ho Aug 31 15:53:44.055922 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:53:44.055922 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:53:44.055922 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:53:44.055922 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:53:44.055922 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:53:44.055922 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:53:44.055922 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 7d9759d18563406e954d97c6bcb0718c Aug 31 15:53:44.055922 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ImagesNegativeTestJSON-930559103 Aug 31 15:53:44.055922 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:53:44.055922 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:53:44.057606 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7d9759d18563406e954d97c6bcb0718c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7d9759d18563406e954d97c6bcb0718c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7d9759d18563406e954d97c6bcb0718c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7d9759d18563406e954d97c6bcb0718c", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:53:44.057606 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ImagesNegativeTestJSON-930559103 Aug 31 15:53:44.057606 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 7d9759d18563406e954d97c6bcb0718c Aug 31 15:53:44.057606 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-930559103 Aug 31 15:53:44.057606 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ImagesNegativeTestJSON-930559103-project Aug 31 15:53:44.057606 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:53:44.057606 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:53:44.057606 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 5b5489a5053e481683354d9b1541dee5 Aug 31 15:53:44.057606 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ImagesNegativeTestJSON-930559103-project Aug 31 15:53:44.057606 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 15:53:44.057606 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 6fd0e478-c48e-4bf0-b934-374fd737e10e could not be found. Aug 31 15:53:44.057606 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '6fd0e478-c48e-4bf0-b934-374fd737e10e'} Aug 31 15:53:44.058863 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:53:44.058863 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:44.058863 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:53:44.058863 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:53:44.058863 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:53:44.058863 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:53:44.058863 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:53:44.058863 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:53:44.058863 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:53:44.058863 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:53:44.058863 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fd0e478-c48e-4bf0-b934-374fd737e10e could not be found. Aug 31 15:53:44.058863 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:53:44.058863 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:53:44.058863 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:53:44.058863 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:44.058863 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:53:44.058863 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:53:44.058863 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:53:44.058863 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:53:44.058863 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:53:44.060297 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:53:44.060297 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:53:44.060297 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:53:44.060297 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:53:44.060297 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:53:44.060297 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:53:44.060297 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:53:44.060297 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fd0e478-c48e-4bf0-b934-374fd737e10e could not be found. Aug 31 15:53:44.060297 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:53:44.060297 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:53:44.060297 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:53:44.060297 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:44.060297 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:53:44.060297 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:53:44.060297 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:53:44.060297 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:53:44.060297 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fd0e478-c48e-4bf0-b934-374fd737e10e could not be found. Aug 31 15:53:44.060297 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:53:44.061616 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-117cf62e-5dec-42de-9e3c-224c851a6668 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Returning 404 to user: Instance 6fd0e478-c48e-4bf0-b934-374fd737e10e could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:53:44.062624 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-117cf62e-5dec-42de-9e3c-224c851a6668 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] 10.222.0.50 "GET /compute/v2.1/servers/6fd0e478-c48e-4bf0-b934-374fd737e10e" status: 404 len: 111 microversion: 2.1 time: 0.087960 Aug 31 15:53:44.063377 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 603/1254] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:43 2022] GET /compute/v2.1/servers/6fd0e478-c48e-4bf0-b934-374fd737e10e => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:53:44.074242 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f20222d9-2be0-4f1c-abf7-73cc5ad7a6ac tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1771762592", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "358656d5-f98b-4dfa-bf11-2a4c37517ed2"}, {"uuid": "6ac5eba2-bef7-4431-9ea5-68c03f402645"}, {"uuid": "358656d5-f98b-4dfa-bf11-2a4c37517ed2"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:53:44.185712 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-f20222d9-2be0-4f1c-abf7-73cc5ad7a6ac tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] validate_networks() for [('358656d5-f98b-4dfa-bf11-2a4c37517ed2', None, None, None, None, None), ('6ac5eba2-bef7-4431-9ea5-68c03f402645', None, None, None, None, None), ('358656d5-f98b-4dfa-bf11-2a4c37517ed2', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:53:46.323489 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-736b8bbd-8df2-411c-94ec-990c6c0a938d tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] 10.222.0.50 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.537555 Aug 31 15:53:46.331363 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 652/1255] 10.222.0.50 () {60 vars in 1170 bytes} [Wed Aug 31 15:53:42 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:53:46.335882 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d3054112-a01c-4208-87e5-89353d5d1d77 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-754689662", "metadata": {"image_type": "test"}}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:53:46.338615 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d3054112-a01c-4208-87e5-89353d5d1d77 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] [instance: 6fd0e478-c48e-4bf0-b934-374fd737e10e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:46.347401 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d3054112-a01c-4208-87e5-89353d5d1d77 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:46.348768 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d3054112-a01c-4208-87e5-89353d5d1d77 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:46.349293 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d3054112-a01c-4208-87e5-89353d5d1d77 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:46.350739 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d3054112-a01c-4208-87e5-89353d5d1d77 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:46.351391 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d3054112-a01c-4208-87e5-89353d5d1d77 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:46.352502 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d3054112-a01c-4208-87e5-89353d5d1d77 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:46.368701 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-d3054112-a01c-4208-87e5-89353d5d1d77 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] HTTP exception thrown: Instance 6fd0e478-c48e-4bf0-b934-374fd737e10e could not be found. Aug 31 15:53:46.370717 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d3054112-a01c-4208-87e5-89353d5d1d77 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Request method failure captured: Aug 31 15:53:46.370717 n-d-833090-16 devstack@n-api.service[128864]: request: POST /compute/v2.1/servers/6fd0e478-c48e-4bf0-b934-374fd737e10e/action HTTP/1.1 Aug 31 15:53:46.370717 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:53:46.370717 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:53:46.370717 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:53:46.370717 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 111 Aug 31 15:53:46.370717 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:53:46.370717 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:53:46.370717 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:53:46.370717 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:53:46.370717 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4Pn0RoDVVim5pqVezhLvozN4I3cxh5ZT36NHV2hiFQcLjyJ110jka2NP7jUstq44gj0SNchySopZ91BYTMIEVBLMBx1FqzIgcpDG96IrZ9x0cpNMdhybPCxwau0B9MMkehhvwgMZF89UKNXZ5Nz0nr2gf_s5GWnoCWg5Ke4zSFf7Ho Aug 31 15:53:46.370717 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:53:46.370717 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:53:46.370717 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:53:46.370717 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:53:46.370717 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:53:46.370717 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:53:46.370717 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 7d9759d18563406e954d97c6bcb0718c Aug 31 15:53:46.370717 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ImagesNegativeTestJSON-930559103 Aug 31 15:53:46.370717 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:53:46.370717 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:53:46.372449 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7d9759d18563406e954d97c6bcb0718c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7d9759d18563406e954d97c6bcb0718c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7d9759d18563406e954d97c6bcb0718c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7d9759d18563406e954d97c6bcb0718c", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:53:46.372449 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ImagesNegativeTestJSON-930559103 Aug 31 15:53:46.372449 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 7d9759d18563406e954d97c6bcb0718c Aug 31 15:53:46.372449 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-930559103 Aug 31 15:53:46.372449 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ImagesNegativeTestJSON-930559103-project Aug 31 15:53:46.372449 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:53:46.372449 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:53:46.372449 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 5b5489a5053e481683354d9b1541dee5 Aug 31 15:53:46.372449 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ImagesNegativeTestJSON-930559103-project Aug 31 15:53:46.372449 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 15:53:46.372449 n-d-833090-16 devstack@n-api.service[128864]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-754689662", "metadata": {"image_type": "test"}}} Aug 31 15:53:46.372449 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:53:46.373329 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 6fd0e478-c48e-4bf0-b934-374fd737e10e could not be found. Aug 31 15:53:46.373329 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '6fd0e478-c48e-4bf0-b934-374fd737e10e', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-754689662', 'metadata': {'image_type': 'test'}}}} Aug 31 15:53:46.373329 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:53:46.373329 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:46.373329 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:53:46.373329 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:53:46.373329 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:53:46.373329 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:53:46.373329 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:53:46.373329 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:53:46.373329 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:53:46.373329 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:53:46.373329 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fd0e478-c48e-4bf0-b934-374fd737e10e could not be found. Aug 31 15:53:46.373329 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:53:46.373329 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:53:46.373329 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:53:46.373329 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:46.373329 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:53:46.373329 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:53:46.374870 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:53:46.374870 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:53:46.374870 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:53:46.374870 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:53:46.374870 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:53:46.374870 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:53:46.374870 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:53:46.374870 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:53:46.374870 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 31 15:53:46.374870 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 31 15:53:46.374870 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:53:46.374870 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:53:46.374870 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:53:46.374870 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:53:46.374870 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fd0e478-c48e-4bf0-b934-374fd737e10e could not be found. Aug 31 15:53:46.374870 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:53:46.374870 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:53:46.374870 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:53:46.374870 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:46.374870 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:53:46.376381 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:53:46.376381 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:53:46.376381 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:53:46.376381 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fd0e478-c48e-4bf0-b934-374fd737e10e could not be found. Aug 31 15:53:46.376381 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:53:46.378005 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d3054112-a01c-4208-87e5-89353d5d1d77 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Returning 404 to user: Instance 6fd0e478-c48e-4bf0-b934-374fd737e10e could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:53:46.378885 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d3054112-a01c-4208-87e5-89353d5d1d77 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] 10.222.0.50 "POST /compute/v2.1/servers/6fd0e478-c48e-4bf0-b934-374fd737e10e/action" status: 404 len: 111 microversion: 2.1 time: 0.053064 Aug 31 15:53:46.379475 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 653/1256] 10.222.0.50 () {60 vars in 1279 bytes} [Wed Aug 31 15:53:46 2022] POST /compute/v2.1/servers/6fd0e478-c48e-4bf0-b934-374fd737e10e/action => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:53:46.389878 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-06adca4c-3adc-462e-9fec-d21e583cd0ac tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:46.390579 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-06adca4c-3adc-462e-9fec-d21e583cd0ac tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 04a4f94b-5820-4bbe-a9b0-7fa55a697e09] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:46.396860 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06adca4c-3adc-462e-9fec-d21e583cd0ac tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:46.397348 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06adca4c-3adc-462e-9fec-d21e583cd0ac tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:46.398180 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06adca4c-3adc-462e-9fec-d21e583cd0ac tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:46.398743 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06adca4c-3adc-462e-9fec-d21e583cd0ac tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:46.399362 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06adca4c-3adc-462e-9fec-d21e583cd0ac tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:46.400116 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06adca4c-3adc-462e-9fec-d21e583cd0ac tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:46.576802 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-f20222d9-2be0-4f1c-abf7-73cc5ad7a6ac tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:53:46.577452 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-f20222d9-2be0-4f1c-abf7-73cc5ad7a6ac tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:53:46.578165 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-f20222d9-2be0-4f1c-abf7-73cc5ad7a6ac tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:53:46.578756 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-f20222d9-2be0-4f1c-abf7-73cc5ad7a6ac tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:53:46.579493 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-f20222d9-2be0-4f1c-abf7-73cc5ad7a6ac tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:53:46.589412 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f20222d9-2be0-4f1c-abf7-73cc5ad7a6ac tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:46.590294 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f20222d9-2be0-4f1c-abf7-73cc5ad7a6ac tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:46.591334 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f20222d9-2be0-4f1c-abf7-73cc5ad7a6ac tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:46.592475 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f20222d9-2be0-4f1c-abf7-73cc5ad7a6ac tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:46.593006 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f20222d9-2be0-4f1c-abf7-73cc5ad7a6ac tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:46.593597 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f20222d9-2be0-4f1c-abf7-73cc5ad7a6ac tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:46.601370 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-06adca4c-3adc-462e-9fec-d21e583cd0ac tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:46.609510 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-06adca4c-3adc-462e-9fec-d21e583cd0ac tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09" status: 200 len: 1542 microversion: 2.1 time: 0.228805 Aug 31 15:53:46.610251 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 654/1257] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:46 2022] GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09 => generated 1542 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:46.628452 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-f20222d9-2be0-4f1c-abf7-73cc5ad7a6ac tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Getting quotas for project 87fc33005b5440098daf798066a653f7. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:53:46.635496 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-f20222d9-2be0-4f1c-abf7-73cc5ad7a6ac tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Getting quotas for user 048bcefe0af04bc6a3a2995b22cbe43f and project 87fc33005b5440098daf798066a653f7. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:53:46.650976 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f20222d9-2be0-4f1c-abf7-73cc5ad7a6ac tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:53:46.653899 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f20222d9-2be0-4f1c-abf7-73cc5ad7a6ac tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] [instance: e4a38af3-ba7d-4074-a628-9c7825ae3358] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:53:46.705222 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f20222d9-2be0-4f1c-abf7-73cc5ad7a6ac tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.640459 Aug 31 15:53:46.712041 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 604/1258] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:53:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 15:53:46.717198 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7dda3bc6-02c5-480e-b4c3-58bb2ec7389b tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:46.720203 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7dda3bc6-02c5-480e-b4c3-58bb2ec7389b tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] [instance: a90bb0c5-7d56-4e38-8d78-a5c92a9976c3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:46.739598 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7dda3bc6-02c5-480e-b4c3-58bb2ec7389b tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:46.740121 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7dda3bc6-02c5-480e-b4c3-58bb2ec7389b tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:46.740554 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7dda3bc6-02c5-480e-b4c3-58bb2ec7389b tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:46.741248 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7dda3bc6-02c5-480e-b4c3-58bb2ec7389b tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:46.741696 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7dda3bc6-02c5-480e-b4c3-58bb2ec7389b tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:46.742122 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7dda3bc6-02c5-480e-b4c3-58bb2ec7389b tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:46.755129 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-26c7b73a-1ad5-4c97-bf06-b1e7af4774fc tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1100062651", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": "none"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:53:46.775397 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7dda3bc6-02c5-480e-b4c3-58bb2ec7389b tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] 10.222.0.50 "GET /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063535 Aug 31 15:53:46.775957 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 605/1259] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 15:53:46 2022] GET /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 15:53:46.795779 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4c31d31b-41d7-43ab-a360-8c1687a78b19 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Action: 'action', calling method: .version_select at 0x7fbb485a8940>, body: {"addFloatingIp": {"address": "172.25.9.31"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:53:46.798365 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4c31d31b-41d7-43ab-a360-8c1687a78b19 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] [instance: 378220a7-113f-49e1-9bfa-3804d55260c6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:46.813106 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c31d31b-41d7-43ab-a360-8c1687a78b19 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:46.813636 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c31d31b-41d7-43ab-a360-8c1687a78b19 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:46.814082 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c31d31b-41d7-43ab-a360-8c1687a78b19 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:46.814796 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c31d31b-41d7-43ab-a360-8c1687a78b19 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:46.821259 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c31d31b-41d7-43ab-a360-8c1687a78b19 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:46.821706 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c31d31b-41d7-43ab-a360-8c1687a78b19 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:46.824124 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-26c7b73a-1ad5-4c97-bf06-b1e7af4774fc tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:53:46.824740 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-26c7b73a-1ad5-4c97-bf06-b1e7af4774fc tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:53:46.825412 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-26c7b73a-1ad5-4c97-bf06-b1e7af4774fc tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:53:46.826414 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-26c7b73a-1ad5-4c97-bf06-b1e7af4774fc tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:53:46.827306 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-26c7b73a-1ad5-4c97-bf06-b1e7af4774fc tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:53:46.837845 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26c7b73a-1ad5-4c97-bf06-b1e7af4774fc tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:46.838686 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26c7b73a-1ad5-4c97-bf06-b1e7af4774fc tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:46.839125 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26c7b73a-1ad5-4c97-bf06-b1e7af4774fc tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:46.839849 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26c7b73a-1ad5-4c97-bf06-b1e7af4774fc tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:46.840298 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26c7b73a-1ad5-4c97-bf06-b1e7af4774fc tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:46.840719 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26c7b73a-1ad5-4c97-bf06-b1e7af4774fc tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:46.859573 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-26c7b73a-1ad5-4c97-bf06-b1e7af4774fc tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Getting quotas for project ddb2c26184cb4df6a6e9627953b0b45b. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:53:46.865509 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-26c7b73a-1ad5-4c97-bf06-b1e7af4774fc tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Getting quotas for user 73524e30e7874944a43f46781878f7a3 and project ddb2c26184cb4df6a6e9627953b0b45b. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:53:46.879391 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-26c7b73a-1ad5-4c97-bf06-b1e7af4774fc tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:53:46.881686 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-26c7b73a-1ad5-4c97-bf06-b1e7af4774fc tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] [instance: e803dd93-0c39-49a2-9bca-92bf0a789290] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:53:46.925496 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c31d31b-41d7-43ab-a360-8c1687a78b19 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Acquiring lock "refresh_cache-378220a7-113f-49e1-9bfa-3804d55260c6" {{(pid=128863) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 15:53:46.926334 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c31d31b-41d7-43ab-a360-8c1687a78b19 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Acquired lock "refresh_cache-378220a7-113f-49e1-9bfa-3804d55260c6" {{(pid=128863) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 15:53:46.946882 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-26c7b73a-1ad5-4c97-bf06-b1e7af4774fc tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.330910 Aug 31 15:53:46.954084 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 655/1260] 10.222.0.50 () {62 vars in 1188 bytes} [Wed Aug 31 15:53:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 334 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 31 15:53:46.974025 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fab620f1-5e29-46d0-a623-5b018e68d66f tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-730796775", "metadata": {"image_type": "test"}}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:53:46.977793 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fab620f1-5e29-46d0-a623-5b018e68d66f tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Failed to fetch instance by id tempest-invalid-542645817 {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 31 15:53:46.978458 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-fab620f1-5e29-46d0-a623-5b018e68d66f tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] HTTP exception thrown: Instance tempest-invalid-542645817 could not be found. Aug 31 15:53:46.980180 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fab620f1-5e29-46d0-a623-5b018e68d66f tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Request method failure captured: Aug 31 15:53:46.980180 n-d-833090-16 devstack@n-api.service[128864]: request: POST /compute/v2.1/servers/tempest-invalid-542645817/action HTTP/1.1 Aug 31 15:53:46.980180 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:53:46.980180 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:53:46.980180 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:53:46.980180 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 111 Aug 31 15:53:46.980180 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:53:46.980180 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:53:46.980180 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:53:46.980180 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:53:46.980180 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4Pn0RoDVVim5pqVezhLvozN4I3cxh5ZT36NHV2hiFQcLjyJ110jka2NP7jUstq44gj0SNchySopZ91BYTMIEVBLMBx1FqzIgcpDG96IrZ9x0cpNMdhybPCxwau0B9MMkehhvwgMZF89UKNXZ5Nz0nr2gf_s5GWnoCWg5Ke4zSFf7Ho Aug 31 15:53:46.980180 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:53:46.980180 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:53:46.980180 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:53:46.980180 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:53:46.980180 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:53:46.980180 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:53:46.980180 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 7d9759d18563406e954d97c6bcb0718c Aug 31 15:53:46.980180 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ImagesNegativeTestJSON-930559103 Aug 31 15:53:46.980180 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:53:46.980180 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:53:46.982003 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7d9759d18563406e954d97c6bcb0718c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7d9759d18563406e954d97c6bcb0718c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7d9759d18563406e954d97c6bcb0718c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7d9759d18563406e954d97c6bcb0718c", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:53:46.982003 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ImagesNegativeTestJSON-930559103 Aug 31 15:53:46.982003 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 7d9759d18563406e954d97c6bcb0718c Aug 31 15:53:46.982003 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-930559103 Aug 31 15:53:46.982003 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ImagesNegativeTestJSON-930559103-project Aug 31 15:53:46.982003 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:53:46.982003 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:53:46.982003 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 5b5489a5053e481683354d9b1541dee5 Aug 31 15:53:46.982003 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ImagesNegativeTestJSON-930559103-project Aug 31 15:53:46.982003 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 15:53:46.982003 n-d-833090-16 devstack@n-api.service[128864]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-730796775", "metadata": {"image_type": "test"}}} Aug 31 15:53:46.982003 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:53:46.982003 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance tempest-invalid-542645817 could not be found. Aug 31 15:53:46.982971 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'tempest-invalid-542645817', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-730796775', 'metadata': {'image_type': 'test'}}}} Aug 31 15:53:46.982971 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:53:46.982971 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:46.982971 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:53:46.982971 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:53:46.982971 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 31 15:53:46.982971 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 31 15:53:46.982971 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-542645817 could not be found. Aug 31 15:53:46.982971 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:53:46.982971 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:53:46.982971 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:53:46.982971 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:46.982971 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:53:46.982971 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:53:46.982971 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:53:46.982971 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:53:46.982971 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:53:46.982971 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:53:46.982971 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:53:46.982971 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:53:46.984502 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:53:46.984502 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:53:46.984502 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 31 15:53:46.984502 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 31 15:53:46.984502 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:53:46.984502 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:53:46.984502 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:53:46.984502 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:53:46.984502 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-542645817 could not be found. Aug 31 15:53:46.984502 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:53:46.984502 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:53:46.984502 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:53:46.984502 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:46.984502 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:53:46.984502 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:53:46.984502 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:53:46.984502 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:53:46.984502 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-542645817 could not be found. Aug 31 15:53:46.984502 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:53:46.987373 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fab620f1-5e29-46d0-a623-5b018e68d66f tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Returning 404 to user: Instance tempest-invalid-542645817 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:53:46.987373 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fab620f1-5e29-46d0-a623-5b018e68d66f tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] 10.222.0.50 "POST /compute/v2.1/servers/tempest-invalid-542645817/action" status: 404 len: 100 microversion: 2.1 time: 0.034097 Aug 31 15:53:46.987373 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 656/1261] 10.222.0.50 () {60 vars in 1246 bytes} [Wed Aug 31 15:53:46 2022] POST /compute/v2.1/servers/tempest-invalid-542645817/action => generated 100 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:53:46.991668 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1f37c2fd-cfec-4d47-a301-6110c52f4be3 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:46.993948 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1f37c2fd-cfec-4d47-a301-6110c52f4be3 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] [instance: e4a38af3-ba7d-4074-a628-9c7825ae3358] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:47.156494 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1f37c2fd-cfec-4d47-a301-6110c52f4be3 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048bcefe0af04bc6a3a2995b22cbe43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87fc33005b5440098daf798066a653f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:47.165379 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1f37c2fd-cfec-4d47-a301-6110c52f4be3 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] 10.222.0.50 "GET /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358" status: 200 len: 1213 microversion: 2.1 time: 0.179784 Aug 31 15:53:47.166484 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 657/1262] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:46 2022] GET /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358 => generated 1213 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:47.182501 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3ce7a7a5-1b4a-44e2-99b0-e1f1bdc236b0 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:47.185609 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3ce7a7a5-1b4a-44e2-99b0-e1f1bdc236b0 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] [instance: a90bb0c5-7d56-4e38-8d78-a5c92a9976c3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:47.201775 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3ce7a7a5-1b4a-44e2-99b0-e1f1bdc236b0 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:47.202303 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3ce7a7a5-1b4a-44e2-99b0-e1f1bdc236b0 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:47.203019 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3ce7a7a5-1b4a-44e2-99b0-e1f1bdc236b0 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:47.204969 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3ce7a7a5-1b4a-44e2-99b0-e1f1bdc236b0 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:47.206136 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3ce7a7a5-1b4a-44e2-99b0-e1f1bdc236b0 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:47.206874 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3ce7a7a5-1b4a-44e2-99b0-e1f1bdc236b0 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:47.291703 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3ce7a7a5-1b4a-44e2-99b0-e1f1bdc236b0 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] 10.222.0.50 "GET /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.123991 Aug 31 15:53:47.292305 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 658/1263] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 15:53:47 2022] GET /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3/os-volume_attachments => generated 25 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 15:53:47.297511 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2054a0fc-a160-4db8-b96f-fff8e78a08ec tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:47.303794 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2054a0fc-a160-4db8-b96f-fff8e78a08ec tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] [instance: e803dd93-0c39-49a2-9bca-92bf0a789290] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:47.407607 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2054a0fc-a160-4db8-b96f-fff8e78a08ec tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:47.416471 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2054a0fc-a160-4db8-b96f-fff8e78a08ec tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:47.417898 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2054a0fc-a160-4db8-b96f-fff8e78a08ec tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:47.419110 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2054a0fc-a160-4db8-b96f-fff8e78a08ec tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] 10.222.0.50 "GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290" status: 200 len: 1278 microversion: 2.57 time: 0.125895 Aug 31 15:53:47.419875 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 659/1264] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:53:47 2022] GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290 => generated 1278 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:53:47.444699 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1ddb1232-4204-415f-be96-d7f626ab9831 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-941987703"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:53:47.452213 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1ddb1232-4204-415f-be96-d7f626ab9831 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 31 15:53:47.455505 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-1ddb1232-4204-415f-be96-d7f626ab9831 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 31 15:53:47.459054 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1ddb1232-4204-415f-be96-d7f626ab9831 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Request method failure captured: Aug 31 15:53:47.459054 n-d-833090-16 devstack@n-api.service[128864]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 31 15:53:47.459054 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:53:47.459054 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:53:47.459054 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:53:47.459054 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 56 Aug 31 15:53:47.459054 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:53:47.459054 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:53:47.459054 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:53:47.459054 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:53:47.459054 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4Pn0RoDVVim5pqVezhLvozN4I3cxh5ZT36NHV2hiFQcLjyJ110jka2NP7jUstq44gj0SNchySopZ91BYTMIEVBLMBx1FqzIgcpDG96IrZ9x0cpNMdhybPCxwau0B9MMkehhvwgMZF89UKNXZ5Nz0nr2gf_s5GWnoCWg5Ke4zSFf7Ho Aug 31 15:53:47.459054 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:53:47.459054 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:53:47.459054 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:53:47.459054 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:53:47.459054 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:53:47.459054 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:53:47.459054 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 7d9759d18563406e954d97c6bcb0718c Aug 31 15:53:47.459054 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ImagesNegativeTestJSON-930559103 Aug 31 15:53:47.459054 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:53:47.459054 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:53:47.460469 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7d9759d18563406e954d97c6bcb0718c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7d9759d18563406e954d97c6bcb0718c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7d9759d18563406e954d97c6bcb0718c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7d9759d18563406e954d97c6bcb0718c", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:53:47.460469 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ImagesNegativeTestJSON-930559103 Aug 31 15:53:47.460469 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 7d9759d18563406e954d97c6bcb0718c Aug 31 15:53:47.460469 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-930559103 Aug 31 15:53:47.460469 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ImagesNegativeTestJSON-930559103-project Aug 31 15:53:47.460469 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:53:47.460469 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:53:47.460469 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 5b5489a5053e481683354d9b1541dee5 Aug 31 15:53:47.460469 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ImagesNegativeTestJSON-930559103-project Aug 31 15:53:47.460469 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 15:53:47.460469 n-d-833090-16 devstack@n-api.service[128864]: {"createImage": {"name": "tempest-test-snap-941987703"}} Aug 31 15:53:47.460469 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:53:47.460469 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 31 15:53:47.461415 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-941987703'}}} Aug 31 15:53:47.461415 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:53:47.461415 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:47.461415 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:53:47.461415 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:53:47.461415 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 31 15:53:47.461415 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 31 15:53:47.461415 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 31 15:53:47.461415 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:53:47.461415 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:53:47.461415 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:53:47.461415 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:47.461415 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:53:47.461415 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:53:47.461415 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:53:47.461415 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:53:47.461415 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:53:47.461415 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:53:47.461415 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:53:47.461415 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:53:47.462854 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:53:47.462854 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:53:47.462854 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 31 15:53:47.462854 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 31 15:53:47.462854 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:53:47.462854 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:53:47.462854 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:53:47.462854 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:53:47.462854 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 31 15:53:47.462854 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:53:47.462854 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:53:47.462854 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:53:47.462854 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:47.462854 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:53:47.462854 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:53:47.462854 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:53:47.462854 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:53:47.462854 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 31 15:53:47.462854 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:53:47.466038 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1ddb1232-4204-415f-be96-d7f626ab9831 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:53:47.467253 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1ddb1232-4204-415f-be96-d7f626ab9831 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] 10.222.0.50 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.046148 Aug 31 15:53:47.468771 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 660/1265] 10.222.0.50 () {60 vars in 1275 bytes} [Wed Aug 31 15:53:47 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:53:47.478745 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f58df5aa-ed29-4bc4-97fc-9b968da89b98 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:47.479549 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f58df5aa-ed29-4bc4-97fc-9b968da89b98 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] [instance: a90bb0c5-7d56-4e38-8d78-a5c92a9976c3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:47.487571 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f58df5aa-ed29-4bc4-97fc-9b968da89b98 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:47.488471 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f58df5aa-ed29-4bc4-97fc-9b968da89b98 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:47.489219 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f58df5aa-ed29-4bc4-97fc-9b968da89b98 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:47.490294 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f58df5aa-ed29-4bc4-97fc-9b968da89b98 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:47.490907 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f58df5aa-ed29-4bc4-97fc-9b968da89b98 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:47.491535 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f58df5aa-ed29-4bc4-97fc-9b968da89b98 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:47.533094 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f58df5aa-ed29-4bc4-97fc-9b968da89b98 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] [instance: a90bb0c5-7d56-4e38-8d78-a5c92a9976c3] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:53:47.656001 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f58df5aa-ed29-4bc4-97fc-9b968da89b98 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3" status: 204 len: 0 microversion: 2.1 time: 0.183283 Aug 31 15:53:47.656881 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 661/1266] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:53:47 2022] DELETE /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:53:47.671598 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9fa76d5e-3bd5-4a51-88d4-8acdbbc3a3ba tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2143475417"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:53:47.674857 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9fa76d5e-3bd5-4a51-88d4-8acdbbc3a3ba tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 31 15:53:47.675612 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-9fa76d5e-3bd5-4a51-88d4-8acdbbc3a3ba tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 31 15:53:47.677576 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9fa76d5e-3bd5-4a51-88d4-8acdbbc3a3ba tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Request method failure captured: Aug 31 15:53:47.677576 n-d-833090-16 devstack@n-api.service[128864]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 31 15:53:47.677576 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:53:47.677576 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:53:47.677576 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:53:47.677576 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 57 Aug 31 15:53:47.677576 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:53:47.677576 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:53:47.677576 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:53:47.677576 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:53:47.677576 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4Pn0RoDVVim5pqVezhLvozN4I3cxh5ZT36NHV2hiFQcLjyJ110jka2NP7jUstq44gj0SNchySopZ91BYTMIEVBLMBx1FqzIgcpDG96IrZ9x0cpNMdhybPCxwau0B9MMkehhvwgMZF89UKNXZ5Nz0nr2gf_s5GWnoCWg5Ke4zSFf7Ho Aug 31 15:53:47.677576 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:53:47.677576 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:53:47.677576 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:53:47.677576 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:53:47.677576 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:53:47.677576 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:53:47.677576 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 7d9759d18563406e954d97c6bcb0718c Aug 31 15:53:47.677576 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ImagesNegativeTestJSON-930559103 Aug 31 15:53:47.677576 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:53:47.677576 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:53:47.679199 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7d9759d18563406e954d97c6bcb0718c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7d9759d18563406e954d97c6bcb0718c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7d9759d18563406e954d97c6bcb0718c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7d9759d18563406e954d97c6bcb0718c", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:53:47.679199 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ImagesNegativeTestJSON-930559103 Aug 31 15:53:47.679199 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 7d9759d18563406e954d97c6bcb0718c Aug 31 15:53:47.679199 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-930559103 Aug 31 15:53:47.679199 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ImagesNegativeTestJSON-930559103-project Aug 31 15:53:47.679199 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:53:47.679199 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:53:47.679199 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 5b5489a5053e481683354d9b1541dee5 Aug 31 15:53:47.679199 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ImagesNegativeTestJSON-930559103-project Aug 31 15:53:47.679199 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 15:53:47.679199 n-d-833090-16 devstack@n-api.service[128864]: {"createImage": {"name": "tempest-test-snap-2143475417"}} Aug 31 15:53:47.679199 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:53:47.679199 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 31 15:53:47.680023 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-2143475417'}}} Aug 31 15:53:47.680023 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:53:47.680023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:47.680023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:53:47.680023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:53:47.680023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 31 15:53:47.680023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 31 15:53:47.680023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 31 15:53:47.680023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:53:47.680023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:53:47.680023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:53:47.680023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:47.680023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:53:47.680023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:53:47.680023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:53:47.680023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:53:47.680023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:53:47.680023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:53:47.680023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:53:47.680023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:53:47.681321 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:53:47.681321 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:53:47.681321 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 31 15:53:47.681321 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 31 15:53:47.681321 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:53:47.681321 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:53:47.681321 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:53:47.681321 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:53:47.681321 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 31 15:53:47.681321 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:53:47.681321 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:53:47.681321 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:53:47.681321 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:47.681321 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:53:47.681321 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:53:47.681321 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:53:47.681321 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:53:47.681321 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 31 15:53:47.681321 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:53:47.685621 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9fa76d5e-3bd5-4a51-88d4-8acdbbc3a3ba tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:53:47.686933 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9fa76d5e-3bd5-4a51-88d4-8acdbbc3a3ba tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] 10.222.0.50 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.028832 Aug 31 15:53:47.687720 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 662/1267] 10.222.0.50 () {60 vars in 1281 bytes} [Wed Aug 31 15:53:47 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:53:47.694722 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-90ac3b94-5560-4a5f-bfdc-b5f88eebddc4 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:47.695460 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-90ac3b94-5560-4a5f-bfdc-b5f88eebddc4 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 04a4f94b-5820-4bbe-a9b0-7fa55a697e09] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:47.703553 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-90ac3b94-5560-4a5f-bfdc-b5f88eebddc4 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:47.704471 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-90ac3b94-5560-4a5f-bfdc-b5f88eebddc4 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:47.705128 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-90ac3b94-5560-4a5f-bfdc-b5f88eebddc4 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:47.706086 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-90ac3b94-5560-4a5f-bfdc-b5f88eebddc4 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:47.706966 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-90ac3b94-5560-4a5f-bfdc-b5f88eebddc4 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:47.707583 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-90ac3b94-5560-4a5f-bfdc-b5f88eebddc4 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:47.940003 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-90ac3b94-5560-4a5f-bfdc-b5f88eebddc4 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:47.947922 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-90ac3b94-5560-4a5f-bfdc-b5f88eebddc4 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09" status: 200 len: 1542 microversion: 2.1 time: 0.258703 Aug 31 15:53:47.961553 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 663/1268] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:47 2022] GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09 => generated 1542 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:47.966797 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-427b03f9-3f79-4726-89d5-2ab4a490c534 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:47.967764 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-427b03f9-3f79-4726-89d5-2ab4a490c534 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] [instance: a90bb0c5-7d56-4e38-8d78-a5c92a9976c3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:47.977217 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-427b03f9-3f79-4726-89d5-2ab4a490c534 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:47.981034 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-427b03f9-3f79-4726-89d5-2ab4a490c534 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:47.981687 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-427b03f9-3f79-4726-89d5-2ab4a490c534 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:47.982610 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-427b03f9-3f79-4726-89d5-2ab4a490c534 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:47.983224 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-427b03f9-3f79-4726-89d5-2ab4a490c534 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:47.983805 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-427b03f9-3f79-4726-89d5-2ab4a490c534 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:48.231627 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-427b03f9-3f79-4726-89d5-2ab4a490c534 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e40446741c470f92d6f60ec910d84e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c897eb2e5b4101858807f875a8ac0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:48.241408 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-427b03f9-3f79-4726-89d5-2ab4a490c534 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] 10.222.0.50 "GET /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3" status: 200 len: 1678 microversion: 2.1 time: 0.278406 Aug 31 15:53:48.241985 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 664/1269] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:47 2022] GET /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3 => generated 1678 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:48.246753 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-68212d2f-c38e-4b98-8585-fa08ef72214d tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:48.247503 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-68212d2f-c38e-4b98-8585-fa08ef72214d tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] [instance: 6fd0e478-c48e-4bf0-b934-374fd737e10e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:48.255422 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68212d2f-c38e-4b98-8585-fa08ef72214d tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:48.256174 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68212d2f-c38e-4b98-8585-fa08ef72214d tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:48.256890 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68212d2f-c38e-4b98-8585-fa08ef72214d tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:48.257788 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68212d2f-c38e-4b98-8585-fa08ef72214d tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:48.258490 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68212d2f-c38e-4b98-8585-fa08ef72214d tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:48.259108 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68212d2f-c38e-4b98-8585-fa08ef72214d tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:48.275185 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-68212d2f-c38e-4b98-8585-fa08ef72214d tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] HTTP exception thrown: Instance 6fd0e478-c48e-4bf0-b934-374fd737e10e could not be found. Aug 31 15:53:48.277047 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-68212d2f-c38e-4b98-8585-fa08ef72214d tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Request method failure captured: Aug 31 15:53:48.277047 n-d-833090-16 devstack@n-api.service[128864]: request: DELETE /compute/v2.1/servers/6fd0e478-c48e-4bf0-b934-374fd737e10e HTTP/1.1 Aug 31 15:53:48.277047 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:53:48.277047 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:53:48.277047 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:53:48.277047 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:53:48.277047 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:53:48.277047 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:53:48.277047 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:53:48.277047 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:53:48.277047 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4Pn0RoDVVim5pqVezhLvozN4I3cxh5ZT36NHV2hiFQcLjyJ110jka2NP7jUstq44gj0SNchySopZ91BYTMIEVBLMBx1FqzIgcpDG96IrZ9x0cpNMdhybPCxwau0B9MMkehhvwgMZF89UKNXZ5Nz0nr2gf_s5GWnoCWg5Ke4zSFf7Ho Aug 31 15:53:48.277047 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:53:48.277047 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:53:48.277047 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:53:48.277047 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:53:48.277047 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:53:48.277047 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:53:48.277047 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 7d9759d18563406e954d97c6bcb0718c Aug 31 15:53:48.277047 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ImagesNegativeTestJSON-930559103 Aug 31 15:53:48.277047 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:53:48.277047 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:53:48.278549 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7d9759d18563406e954d97c6bcb0718c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7d9759d18563406e954d97c6bcb0718c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7d9759d18563406e954d97c6bcb0718c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7d9759d18563406e954d97c6bcb0718c", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:53:48.278549 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ImagesNegativeTestJSON-930559103 Aug 31 15:53:48.278549 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 7d9759d18563406e954d97c6bcb0718c Aug 31 15:53:48.278549 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-930559103 Aug 31 15:53:48.278549 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ImagesNegativeTestJSON-930559103-project Aug 31 15:53:48.278549 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:53:48.278549 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:53:48.278549 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 5b5489a5053e481683354d9b1541dee5 Aug 31 15:53:48.278549 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ImagesNegativeTestJSON-930559103-project Aug 31 15:53:48.278549 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:53:48.278549 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 6fd0e478-c48e-4bf0-b934-374fd737e10e could not be found. Aug 31 15:53:48.278549 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '6fd0e478-c48e-4bf0-b934-374fd737e10e'} Aug 31 15:53:48.279295 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:53:48.279295 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:48.279295 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:53:48.279295 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:53:48.279295 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:53:48.279295 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:53:48.279295 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:53:48.279295 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:53:48.279295 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:53:48.279295 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:53:48.279295 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fd0e478-c48e-4bf0-b934-374fd737e10e could not be found. Aug 31 15:53:48.279295 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:53:48.279295 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:53:48.279295 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:53:48.279295 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:48.279295 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:53:48.279295 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:53:48.279295 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:53:48.279295 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:53:48.279295 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:53:48.280776 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:53:48.280776 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 15:53:48.280776 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 15:53:48.280776 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 15:53:48.280776 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 15:53:48.280776 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:53:48.280776 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:53:48.280776 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:53:48.280776 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:53:48.280776 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fd0e478-c48e-4bf0-b934-374fd737e10e could not be found. Aug 31 15:53:48.280776 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:53:48.280776 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:53:48.280776 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:53:48.280776 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:48.280776 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:53:48.280776 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:53:48.280776 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:53:48.280776 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:53:48.280776 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fd0e478-c48e-4bf0-b934-374fd737e10e could not be found. Aug 31 15:53:48.280776 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:53:48.282003 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-68212d2f-c38e-4b98-8585-fa08ef72214d tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Returning 404 to user: Instance 6fd0e478-c48e-4bf0-b934-374fd737e10e could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:53:48.282418 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-68212d2f-c38e-4b98-8585-fa08ef72214d tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] 10.222.0.50 "DELETE /compute/v2.1/servers/6fd0e478-c48e-4bf0-b934-374fd737e10e" status: 404 len: 111 microversion: 2.1 time: 0.038490 Aug 31 15:53:48.286170 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 665/1270] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:53:48 2022] DELETE /compute/v2.1/servers/6fd0e478-c48e-4bf0-b934-374fd737e10e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:53:48.289813 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fee0ca5c-1237-440b-8dca-8c4a4cb7f395 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:48.290509 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fee0ca5c-1237-440b-8dca-8c4a4cb7f395 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] [instance: e4a38af3-ba7d-4074-a628-9c7825ae3358] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:48.299194 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fee0ca5c-1237-440b-8dca-8c4a4cb7f395 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:48.299771 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fee0ca5c-1237-440b-8dca-8c4a4cb7f395 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:48.300217 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fee0ca5c-1237-440b-8dca-8c4a4cb7f395 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:48.301066 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fee0ca5c-1237-440b-8dca-8c4a4cb7f395 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:48.301520 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fee0ca5c-1237-440b-8dca-8c4a4cb7f395 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:48.301992 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fee0ca5c-1237-440b-8dca-8c4a4cb7f395 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:48.376001 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-fee0ca5c-1237-440b-8dca-8c4a4cb7f395 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048bcefe0af04bc6a3a2995b22cbe43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87fc33005b5440098daf798066a653f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:48.385227 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fee0ca5c-1237-440b-8dca-8c4a4cb7f395 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] 10.222.0.50 "GET /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358" status: 200 len: 1265 microversion: 2.1 time: 0.101036 Aug 31 15:53:48.386184 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 666/1271] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:48 2022] GET /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358 => generated 1265 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:48.395401 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-78d9a03b-6d58-442c-b4d7-941f08aa1673 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:48.396067 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-78d9a03b-6d58-442c-b4d7-941f08aa1673 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] [instance: 6fd0e478-c48e-4bf0-b934-374fd737e10e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:48.403035 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-78d9a03b-6d58-442c-b4d7-941f08aa1673 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:48.403676 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-78d9a03b-6d58-442c-b4d7-941f08aa1673 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:48.404113 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-78d9a03b-6d58-442c-b4d7-941f08aa1673 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:48.404814 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-78d9a03b-6d58-442c-b4d7-941f08aa1673 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:48.405262 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-78d9a03b-6d58-442c-b4d7-941f08aa1673 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:48.405664 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-78d9a03b-6d58-442c-b4d7-941f08aa1673 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:48.422597 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-78d9a03b-6d58-442c-b4d7-941f08aa1673 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] HTTP exception thrown: Instance 6fd0e478-c48e-4bf0-b934-374fd737e10e could not be found. Aug 31 15:53:48.425812 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-78d9a03b-6d58-442c-b4d7-941f08aa1673 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Request method failure captured: Aug 31 15:53:48.425812 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/6fd0e478-c48e-4bf0-b934-374fd737e10e HTTP/1.1 Aug 31 15:53:48.425812 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:53:48.425812 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:53:48.425812 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:53:48.425812 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:53:48.425812 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:53:48.425812 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:53:48.425812 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:53:48.425812 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:53:48.425812 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4Pn0RoDVVim5pqVezhLvozN4I3cxh5ZT36NHV2hiFQcLjyJ110jka2NP7jUstq44gj0SNchySopZ91BYTMIEVBLMBx1FqzIgcpDG96IrZ9x0cpNMdhybPCxwau0B9MMkehhvwgMZF89UKNXZ5Nz0nr2gf_s5GWnoCWg5Ke4zSFf7Ho Aug 31 15:53:48.425812 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:53:48.425812 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:53:48.425812 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:53:48.425812 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:53:48.425812 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:53:48.425812 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:53:48.425812 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 7d9759d18563406e954d97c6bcb0718c Aug 31 15:53:48.425812 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ImagesNegativeTestJSON-930559103 Aug 31 15:53:48.425812 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:53:48.425812 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:53:48.427359 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7d9759d18563406e954d97c6bcb0718c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7d9759d18563406e954d97c6bcb0718c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7d9759d18563406e954d97c6bcb0718c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7d9759d18563406e954d97c6bcb0718c", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:53:48.427359 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ImagesNegativeTestJSON-930559103 Aug 31 15:53:48.427359 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 7d9759d18563406e954d97c6bcb0718c Aug 31 15:53:48.427359 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-930559103 Aug 31 15:53:48.427359 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ImagesNegativeTestJSON-930559103-project Aug 31 15:53:48.427359 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:53:48.427359 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:53:48.427359 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 5b5489a5053e481683354d9b1541dee5 Aug 31 15:53:48.427359 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ImagesNegativeTestJSON-930559103-project Aug 31 15:53:48.427359 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:53:48.427359 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 6fd0e478-c48e-4bf0-b934-374fd737e10e could not be found. Aug 31 15:53:48.427359 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '6fd0e478-c48e-4bf0-b934-374fd737e10e'} Aug 31 15:53:48.428147 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:53:48.428147 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:48.428147 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:53:48.428147 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:53:48.428147 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:53:48.428147 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:53:48.428147 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:53:48.428147 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:53:48.428147 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:53:48.428147 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:53:48.428147 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fd0e478-c48e-4bf0-b934-374fd737e10e could not be found. Aug 31 15:53:48.428147 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:53:48.428147 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:53:48.428147 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:53:48.428147 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:48.428147 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:53:48.428147 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:53:48.428147 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:53:48.428147 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:53:48.428147 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:53:48.429766 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:53:48.429766 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:53:48.429766 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:53:48.429766 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:53:48.429766 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:53:48.429766 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:53:48.429766 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:53:48.429766 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fd0e478-c48e-4bf0-b934-374fd737e10e could not be found. Aug 31 15:53:48.429766 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:53:48.429766 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:53:48.429766 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:53:48.429766 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:48.429766 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:53:48.429766 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:53:48.429766 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:53:48.429766 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:53:48.429766 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fd0e478-c48e-4bf0-b934-374fd737e10e could not be found. Aug 31 15:53:48.429766 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:53:48.431214 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-78d9a03b-6d58-442c-b4d7-941f08aa1673 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] Returning 404 to user: Instance 6fd0e478-c48e-4bf0-b934-374fd737e10e could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:53:48.431214 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-78d9a03b-6d58-442c-b4d7-941f08aa1673 tempest-ImagesNegativeTestJSON-930559103 tempest-ImagesNegativeTestJSON-930559103-project] 10.222.0.50 "GET /compute/v2.1/servers/6fd0e478-c48e-4bf0-b934-374fd737e10e" status: 404 len: 111 microversion: 2.1 time: 0.040097 Aug 31 15:53:48.431214 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 667/1272] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:48 2022] GET /compute/v2.1/servers/6fd0e478-c48e-4bf0-b934-374fd737e10e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:53:48.446257 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-250f8734-c318-45ad-81da-a36646a4f72c tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:48.446959 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-250f8734-c318-45ad-81da-a36646a4f72c tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] [instance: e803dd93-0c39-49a2-9bca-92bf0a789290] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:48.458875 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-250f8734-c318-45ad-81da-a36646a4f72c tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:48.459759 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-250f8734-c318-45ad-81da-a36646a4f72c tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:48.460434 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-250f8734-c318-45ad-81da-a36646a4f72c tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:48.461372 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-250f8734-c318-45ad-81da-a36646a4f72c tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:48.462368 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-250f8734-c318-45ad-81da-a36646a4f72c tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:48.463263 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-250f8734-c318-45ad-81da-a36646a4f72c tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:48.598077 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-250f8734-c318-45ad-81da-a36646a4f72c tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:48.627608 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-250f8734-c318-45ad-81da-a36646a4f72c tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:48.631410 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-250f8734-c318-45ad-81da-a36646a4f72c tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:48.632831 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-250f8734-c318-45ad-81da-a36646a4f72c tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] 10.222.0.50 "GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290" status: 200 len: 1330 microversion: 2.57 time: 0.194727 Aug 31 15:53:48.633898 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 668/1273] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:53:48 2022] GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290 => generated 1330 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:53:48.705508 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-4c31d31b-41d7-43ab-a360-8c1687a78b19 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] [instance: 378220a7-113f-49e1-9bfa-3804d55260c6] Building network info cache for instance {{(pid=128863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 31 15:53:48.715973 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-7372c05e-1363-4f7d-9298-223754a9fd90 req-4df9a6ab-240a-4379-8b52-dae416c17b1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "378220a7-113f-49e1-9bfa-3804d55260c6", "tag": "7f87d1ce-41ae-4d7a-8907-6f24a3691eed"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:53:48.732908 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7372c05e-1363-4f7d-9298-223754a9fd90 req-4df9a6ab-240a-4379-8b52-dae416c17b1e service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:48.734725 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7372c05e-1363-4f7d-9298-223754a9fd90 req-4df9a6ab-240a-4379-8b52-dae416c17b1e service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:48.735453 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7372c05e-1363-4f7d-9298-223754a9fd90 req-4df9a6ab-240a-4379-8b52-dae416c17b1e service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:48.752543 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-7372c05e-1363-4f7d-9298-223754a9fd90 req-4df9a6ab-240a-4379-8b52-dae416c17b1e service nova] Creating event network-changed:7f87d1ce-41ae-4d7a-8907-6f24a3691eed for instance 378220a7-113f-49e1-9bfa-3804d55260c6 on n-h1-833090-16 Aug 31 15:53:48.762724 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-7372c05e-1363-4f7d-9298-223754a9fd90 req-4df9a6ab-240a-4379-8b52-dae416c17b1e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050755 Aug 31 15:53:48.763707 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 669/1274] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:53:48.969916 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-af863b81-536f-4617-a518-07a8f8500536 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:48.970983 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-af863b81-536f-4617-a518-07a8f8500536 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 04a4f94b-5820-4bbe-a9b0-7fa55a697e09] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:48.978802 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-af863b81-536f-4617-a518-07a8f8500536 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:48.979848 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-af863b81-536f-4617-a518-07a8f8500536 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:48.980446 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-af863b81-536f-4617-a518-07a8f8500536 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:48.981321 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-af863b81-536f-4617-a518-07a8f8500536 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:48.981936 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-af863b81-536f-4617-a518-07a8f8500536 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:48.982683 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-af863b81-536f-4617-a518-07a8f8500536 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:49.311664 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-af863b81-536f-4617-a518-07a8f8500536 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:49.319894 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-af863b81-536f-4617-a518-07a8f8500536 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09" status: 200 len: 1542 microversion: 2.1 time: 0.354693 Aug 31 15:53:49.333909 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 670/1275] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:48 2022] GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09 => generated 1542 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:53:49.345606 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-92739de1-f56c-4146-888a-bb597a6391e8 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:49.346576 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-92739de1-f56c-4146-888a-bb597a6391e8 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] [instance: a90bb0c5-7d56-4e38-8d78-a5c92a9976c3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:49.352770 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-92739de1-f56c-4146-888a-bb597a6391e8 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:49.353629 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-92739de1-f56c-4146-888a-bb597a6391e8 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:49.354131 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-92739de1-f56c-4146-888a-bb597a6391e8 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:49.355048 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-92739de1-f56c-4146-888a-bb597a6391e8 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:49.355701 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-92739de1-f56c-4146-888a-bb597a6391e8 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:49.356331 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-92739de1-f56c-4146-888a-bb597a6391e8 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:49.666382 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-4c31d31b-41d7-43ab-a360-8c1687a78b19 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] [instance: 378220a7-113f-49e1-9bfa-3804d55260c6] Updating instance_info_cache with network_info: [{"id": "7f87d1ce-41ae-4d7a-8907-6f24a3691eed", "address": "fa:16:3e:0a:d3:cc", "network": {"id": "6da6fef1-33a8-4f7a-a21c-08f85e78d1da", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-413077722-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "390f00bece0c42999585de9fc68e1ce0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap7f87d1ce-41", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 31 15:53:49.680915 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-92739de1-f56c-4146-888a-bb597a6391e8 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e40446741c470f92d6f60ec910d84e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c897eb2e5b4101858807f875a8ac0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:49.685099 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c31d31b-41d7-43ab-a360-8c1687a78b19 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Releasing lock "refresh_cache-378220a7-113f-49e1-9bfa-3804d55260c6" {{(pid=128863) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 15:53:49.687113 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4c31d31b-41d7-43ab-a360-8c1687a78b19 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] 10.222.0.50 "POST /compute/v2.1/servers/378220a7-113f-49e1-9bfa-3804d55260c6/action" status: 202 len: 0 microversion: 2.1 time: 2.895150 Aug 31 15:53:49.688737 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 606/1276] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 15:53:46 2022] POST /compute/v2.1/servers/378220a7-113f-49e1-9bfa-3804d55260c6/action => generated 0 bytes in 2912 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 31 15:53:49.694913 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c0d498bb-32f7-4787-9d54-b045d5fa50fd tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:49.695582 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c0d498bb-32f7-4787-9d54-b045d5fa50fd tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] [instance: e4a38af3-ba7d-4074-a628-9c7825ae3358] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:49.698701 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-92739de1-f56c-4146-888a-bb597a6391e8 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] 10.222.0.50 "GET /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3" status: 200 len: 1678 microversion: 2.1 time: 0.370334 Aug 31 15:53:49.701920 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 671/1277] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:49 2022] GET /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3 => generated 1678 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:49.703296 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0d498bb-32f7-4787-9d54-b045d5fa50fd tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:49.704289 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0d498bb-32f7-4787-9d54-b045d5fa50fd tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:49.704497 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0d498bb-32f7-4787-9d54-b045d5fa50fd tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:49.705536 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0d498bb-32f7-4787-9d54-b045d5fa50fd tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:49.706129 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0d498bb-32f7-4787-9d54-b045d5fa50fd tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:49.706626 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0d498bb-32f7-4787-9d54-b045d5fa50fd tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:49.730693 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7293ade2-93b4-42cc-9f52-a4cd63c61ed1 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:49.731692 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7293ade2-93b4-42cc-9f52-a4cd63c61ed1 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] [instance: e803dd93-0c39-49a2-9bca-92bf0a789290] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:49.746397 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7293ade2-93b4-42cc-9f52-a4cd63c61ed1 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:49.747263 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7293ade2-93b4-42cc-9f52-a4cd63c61ed1 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:49.748124 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7293ade2-93b4-42cc-9f52-a4cd63c61ed1 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:49.749628 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7293ade2-93b4-42cc-9f52-a4cd63c61ed1 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:49.750441 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7293ade2-93b4-42cc-9f52-a4cd63c61ed1 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:49.751522 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7293ade2-93b4-42cc-9f52-a4cd63c61ed1 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:49.781696 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:53:50.155071 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c0d498bb-32f7-4787-9d54-b045d5fa50fd tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048bcefe0af04bc6a3a2995b22cbe43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87fc33005b5440098daf798066a653f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:50.161490 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7293ade2-93b4-42cc-9f52-a4cd63c61ed1 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:50.174753 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c0d498bb-32f7-4787-9d54-b045d5fa50fd tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] 10.222.0.50 "GET /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358" status: 200 len: 1271 microversion: 2.1 time: 0.484595 Aug 31 15:53:50.176753 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7293ade2-93b4-42cc-9f52-a4cd63c61ed1 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:50.193856 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 607/1278] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:49 2022] GET /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358 => generated 1271 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:50.196400 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7293ade2-93b4-42cc-9f52-a4cd63c61ed1 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:50.200639 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7293ade2-93b4-42cc-9f52-a4cd63c61ed1 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] 10.222.0.50 "GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290" status: 200 len: 1336 microversion: 2.57 time: 0.480842 Aug 31 15:53:50.201431 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 672/1279] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:53:49 2022] GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290 => generated 1336 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:53:50.203453 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-eb44bb1e-7e0f-4f2a-84e5-47e1c47623b8 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Action: 'create', calling method: .version_select at 0x7fbb465c3040>, body: {"pool": "01541c28-e61f-455d-a5a3-6c50a4460e17"} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:53:50.342504 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-40e01c04-4bd9-45f2-b91b-08548e1ddc51 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:50.343268 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-40e01c04-4bd9-45f2-b91b-08548e1ddc51 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 04a4f94b-5820-4bbe-a9b0-7fa55a697e09] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:50.351343 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-40e01c04-4bd9-45f2-b91b-08548e1ddc51 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:50.351894 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-40e01c04-4bd9-45f2-b91b-08548e1ddc51 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:50.352565 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-40e01c04-4bd9-45f2-b91b-08548e1ddc51 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:50.353443 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-40e01c04-4bd9-45f2-b91b-08548e1ddc51 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:50.354063 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-40e01c04-4bd9-45f2-b91b-08548e1ddc51 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:50.354484 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-40e01c04-4bd9-45f2-b91b-08548e1ddc51 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:50.691042 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-40e01c04-4bd9-45f2-b91b-08548e1ddc51 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:50.706625 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-40e01c04-4bd9-45f2-b91b-08548e1ddc51 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09" status: 200 len: 1542 microversion: 2.1 time: 0.367009 Aug 31 15:53:50.707363 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 673/1280] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:50 2022] GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09 => generated 1542 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:50.727239 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ee0c4cae-c733-4ed7-aaf5-ee99f8746eec tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:50.728217 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ee0c4cae-c733-4ed7-aaf5-ee99f8746eec tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] [instance: a90bb0c5-7d56-4e38-8d78-a5c92a9976c3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:50.740343 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ee0c4cae-c733-4ed7-aaf5-ee99f8746eec tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:50.741471 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ee0c4cae-c733-4ed7-aaf5-ee99f8746eec tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:50.742298 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ee0c4cae-c733-4ed7-aaf5-ee99f8746eec tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:50.743457 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ee0c4cae-c733-4ed7-aaf5-ee99f8746eec tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:50.744225 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ee0c4cae-c733-4ed7-aaf5-ee99f8746eec tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:50.745823 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ee0c4cae-c733-4ed7-aaf5-ee99f8746eec tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:51.059267 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ee0c4cae-c733-4ed7-aaf5-ee99f8746eec tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e40446741c470f92d6f60ec910d84e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c897eb2e5b4101858807f875a8ac0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:51.071766 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ee0c4cae-c733-4ed7-aaf5-ee99f8746eec tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] 10.222.0.50 "GET /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3" status: 200 len: 1678 microversion: 2.1 time: 0.348461 Aug 31 15:53:51.072527 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 674/1281] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:50 2022] GET /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3 => generated 1678 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:51.198973 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7741278f-6326-46bd-abbb-d03f0e6c18a2 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:51.199972 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7741278f-6326-46bd-abbb-d03f0e6c18a2 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] [instance: e4a38af3-ba7d-4074-a628-9c7825ae3358] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:51.206571 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7741278f-6326-46bd-abbb-d03f0e6c18a2 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:51.207173 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7741278f-6326-46bd-abbb-d03f0e6c18a2 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:51.207805 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7741278f-6326-46bd-abbb-d03f0e6c18a2 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:51.208500 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7741278f-6326-46bd-abbb-d03f0e6c18a2 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:51.208951 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7741278f-6326-46bd-abbb-d03f0e6c18a2 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:51.209367 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7741278f-6326-46bd-abbb-d03f0e6c18a2 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:51.493570 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7741278f-6326-46bd-abbb-d03f0e6c18a2 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048bcefe0af04bc6a3a2995b22cbe43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87fc33005b5440098daf798066a653f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:51.514987 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7741278f-6326-46bd-abbb-d03f0e6c18a2 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] 10.222.0.50 "GET /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358" status: 200 len: 1313 microversion: 2.1 time: 0.319849 Aug 31 15:53:51.516519 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 675/1282] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:51 2022] GET /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358 => generated 1313 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:51.521612 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-dc992a1f-2d24-4cde-82e3-e908c1e87378 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:51.522930 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-dc992a1f-2d24-4cde-82e3-e908c1e87378 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] [instance: e803dd93-0c39-49a2-9bca-92bf0a789290] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:51.538189 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dc992a1f-2d24-4cde-82e3-e908c1e87378 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:51.539295 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dc992a1f-2d24-4cde-82e3-e908c1e87378 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:51.540017 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dc992a1f-2d24-4cde-82e3-e908c1e87378 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:51.541121 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dc992a1f-2d24-4cde-82e3-e908c1e87378 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:51.543082 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dc992a1f-2d24-4cde-82e3-e908c1e87378 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:51.544025 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dc992a1f-2d24-4cde-82e3-e908c1e87378 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:51.760974 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-dc992a1f-2d24-4cde-82e3-e908c1e87378 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:51.773557 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-dc992a1f-2d24-4cde-82e3-e908c1e87378 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:51.782396 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-dc992a1f-2d24-4cde-82e3-e908c1e87378 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:51.783766 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-dc992a1f-2d24-4cde-82e3-e908c1e87378 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] 10.222.0.50 "GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290" status: 200 len: 1336 microversion: 2.57 time: 0.266071 Aug 31 15:53:51.784778 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 676/1283] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:53:51 2022] GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290 => generated 1336 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:53:51.789567 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-01be2f20-8739-4211-8933-aa5fd150596b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:51.799242 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-01be2f20-8739-4211-8933-aa5fd150596b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 04a4f94b-5820-4bbe-a9b0-7fa55a697e09] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:51.808375 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01be2f20-8739-4211-8933-aa5fd150596b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:51.809169 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01be2f20-8739-4211-8933-aa5fd150596b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:51.819233 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01be2f20-8739-4211-8933-aa5fd150596b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:51.820172 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01be2f20-8739-4211-8933-aa5fd150596b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:51.820804 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01be2f20-8739-4211-8933-aa5fd150596b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:51.821382 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01be2f20-8739-4211-8933-aa5fd150596b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:52.196293 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-01be2f20-8739-4211-8933-aa5fd150596b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:52.208181 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-01be2f20-8739-4211-8933-aa5fd150596b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09" status: 200 len: 1542 microversion: 2.1 time: 0.419789 Aug 31 15:53:52.209242 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 677/1284] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:51 2022] GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09 => generated 1542 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:52.217731 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-0bd76ce8-584b-4490-bdd3-ce1ae2fcd650 req-1de27133-4a39-4680-b18a-ae938a34b109 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a90bb0c5-7d56-4e38-8d78-a5c92a9976c3", "name": "network-vif-deleted", "tag": "88614c31-a522-4542-ad79-12f8e6e4844c"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:53:52.237018 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-0bd76ce8-584b-4490-bdd3-ce1ae2fcd650 req-1de27133-4a39-4680-b18a-ae938a34b109 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:52.243740 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-0bd76ce8-584b-4490-bdd3-ce1ae2fcd650 req-1de27133-4a39-4680-b18a-ae938a34b109 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:52.244525 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-0bd76ce8-584b-4490-bdd3-ce1ae2fcd650 req-1de27133-4a39-4680-b18a-ae938a34b109 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:52.260785 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-0bd76ce8-584b-4490-bdd3-ce1ae2fcd650 req-1de27133-4a39-4680-b18a-ae938a34b109 service nova] Creating event network-vif-deleted:88614c31-a522-4542-ad79-12f8e6e4844c for instance a90bb0c5-7d56-4e38-8d78-a5c92a9976c3 on n-h1-833090-16 Aug 31 15:53:52.267785 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-0bd76ce8-584b-4490-bdd3-ce1ae2fcd650 req-1de27133-4a39-4680-b18a-ae938a34b109 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053140 Aug 31 15:53:52.269081 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 678/1285] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:53:52.275649 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-944f6b19-d98a-4e7f-8dd0-8d11f25d980e tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:52.277666 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-944f6b19-d98a-4e7f-8dd0-8d11f25d980e tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] [instance: a90bb0c5-7d56-4e38-8d78-a5c92a9976c3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:52.298918 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-944f6b19-d98a-4e7f-8dd0-8d11f25d980e tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:52.299410 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-944f6b19-d98a-4e7f-8dd0-8d11f25d980e tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:52.299835 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-944f6b19-d98a-4e7f-8dd0-8d11f25d980e tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:52.300732 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-944f6b19-d98a-4e7f-8dd0-8d11f25d980e tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:52.301326 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-944f6b19-d98a-4e7f-8dd0-8d11f25d980e tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:52.301889 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-944f6b19-d98a-4e7f-8dd0-8d11f25d980e tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:52.336807 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-944f6b19-d98a-4e7f-8dd0-8d11f25d980e tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:52.337539 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-944f6b19-d98a-4e7f-8dd0-8d11f25d980e tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:52.338293 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-944f6b19-d98a-4e7f-8dd0-8d11f25d980e tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:52.339031 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-944f6b19-d98a-4e7f-8dd0-8d11f25d980e tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lazy-loading 'fault' on Instance uuid a90bb0c5-7d56-4e38-8d78-a5c92a9976c3 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:53:52.403994 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-944f6b19-d98a-4e7f-8dd0-8d11f25d980e tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e40446741c470f92d6f60ec910d84e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c897eb2e5b4101858807f875a8ac0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:52.412324 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-944f6b19-d98a-4e7f-8dd0-8d11f25d980e tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] 10.222.0.50 "GET /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3" status: 200 len: 1331 microversion: 2.1 time: 0.141766 Aug 31 15:53:52.413466 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 679/1286] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:52 2022] GET /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3 => generated 1331 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:52.537385 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-630fb5c4-6bf7-4fcb-9027-164830395bea tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:52.537941 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-630fb5c4-6bf7-4fcb-9027-164830395bea tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] [instance: e4a38af3-ba7d-4074-a628-9c7825ae3358] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:52.547170 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-630fb5c4-6bf7-4fcb-9027-164830395bea tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:52.550634 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-630fb5c4-6bf7-4fcb-9027-164830395bea tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:52.551371 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-630fb5c4-6bf7-4fcb-9027-164830395bea tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:52.552337 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-630fb5c4-6bf7-4fcb-9027-164830395bea tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:52.553090 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-630fb5c4-6bf7-4fcb-9027-164830395bea tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:52.554146 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-630fb5c4-6bf7-4fcb-9027-164830395bea tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:52.819754 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-630fb5c4-6bf7-4fcb-9027-164830395bea tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048bcefe0af04bc6a3a2995b22cbe43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87fc33005b5440098daf798066a653f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:52.848356 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-630fb5c4-6bf7-4fcb-9027-164830395bea tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] 10.222.0.50 "GET /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358" status: 200 len: 1313 microversion: 2.1 time: 0.307045 Aug 31 15:53:52.860006 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 680/1287] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:52 2022] GET /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358 => generated 1313 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:53:52.871977 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d585ce5d-dbe6-41d4-91ab-31b4bf5796d2 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:52.875003 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d585ce5d-dbe6-41d4-91ab-31b4bf5796d2 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] [instance: e803dd93-0c39-49a2-9bca-92bf0a789290] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:52.881920 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d585ce5d-dbe6-41d4-91ab-31b4bf5796d2 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:52.883214 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d585ce5d-dbe6-41d4-91ab-31b4bf5796d2 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:52.883736 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d585ce5d-dbe6-41d4-91ab-31b4bf5796d2 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:52.884661 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d585ce5d-dbe6-41d4-91ab-31b4bf5796d2 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:52.885239 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d585ce5d-dbe6-41d4-91ab-31b4bf5796d2 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:52.885750 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d585ce5d-dbe6-41d4-91ab-31b4bf5796d2 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:52.902946 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-eb44bb1e-7e0f-4f2a-84e5-47e1c47623b8 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] 10.222.0.50 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.707426 Aug 31 15:53:52.903741 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 608/1288] 10.222.0.50 () {60 vars in 1170 bytes} [Wed Aug 31 15:53:50 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2709 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:53:52.917132 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7183b87a-1c61-439f-812e-ae135fdfc98d tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.235"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:53:52.921332 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7183b87a-1c61-439f-812e-ae135fdfc98d tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] [instance: 378220a7-113f-49e1-9bfa-3804d55260c6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:52.928114 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7183b87a-1c61-439f-812e-ae135fdfc98d tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:52.928596 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7183b87a-1c61-439f-812e-ae135fdfc98d tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:52.929013 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7183b87a-1c61-439f-812e-ae135fdfc98d tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:52.929697 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7183b87a-1c61-439f-812e-ae135fdfc98d tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:52.930326 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7183b87a-1c61-439f-812e-ae135fdfc98d tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:52.930627 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7183b87a-1c61-439f-812e-ae135fdfc98d tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:52.988735 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d585ce5d-dbe6-41d4-91ab-31b4bf5796d2 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:53.000147 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d585ce5d-dbe6-41d4-91ab-31b4bf5796d2 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:53.002246 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d585ce5d-dbe6-41d4-91ab-31b4bf5796d2 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:53.003966 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d585ce5d-dbe6-41d4-91ab-31b4bf5796d2 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] 10.222.0.50 "GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290" status: 200 len: 1336 microversion: 2.57 time: 0.142645 Aug 31 15:53:53.004728 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 681/1289] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:53:52 2022] GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290 => generated 1336 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:53:53.006315 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7183b87a-1c61-439f-812e-ae135fdfc98d tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Acquiring lock "refresh_cache-378220a7-113f-49e1-9bfa-3804d55260c6" {{(pid=128863) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 15:53:53.006947 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7183b87a-1c61-439f-812e-ae135fdfc98d tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Acquired lock "refresh_cache-378220a7-113f-49e1-9bfa-3804d55260c6" {{(pid=128863) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 15:53:53.239460 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9298745f-7cbd-4259-bb2c-ff26ac2e4b75 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:53.240067 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9298745f-7cbd-4259-bb2c-ff26ac2e4b75 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 04a4f94b-5820-4bbe-a9b0-7fa55a697e09] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:53.259907 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9298745f-7cbd-4259-bb2c-ff26ac2e4b75 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:53.260540 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9298745f-7cbd-4259-bb2c-ff26ac2e4b75 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:53.262622 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9298745f-7cbd-4259-bb2c-ff26ac2e4b75 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:53.263572 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9298745f-7cbd-4259-bb2c-ff26ac2e4b75 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:53.264195 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9298745f-7cbd-4259-bb2c-ff26ac2e4b75 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:53.264769 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9298745f-7cbd-4259-bb2c-ff26ac2e4b75 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:53.553825 n-d-833090-16 devstack@n-api.service[128863]: DEBUG neutronclient.v2_0.client [None req-7183b87a-1c61-439f-812e-ae135fdfc98d tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.9.235 (036916b4-653a-40cd-acb1-0fb6dbc6c342) with port 7f87d1ce-41ae-4d7a-8907-6f24a3691eed using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 01541c28-e61f-455d-a5a3-6c50a4460e17.", "detail": ""}} {{(pid=128863) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 31 15:53:53.554761 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7183b87a-1c61-439f-812e-ae135fdfc98d tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Releasing lock "refresh_cache-378220a7-113f-49e1-9bfa-3804d55260c6" {{(pid=128863) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 15:53:53.555537 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-7183b87a-1c61-439f-812e-ae135fdfc98d tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] HTTP exception thrown: Cannot associate floating IP 172.25.9.235 (036916b4-653a-40cd-acb1-0fb6dbc6c342) with port 7f87d1ce-41ae-4d7a-8907-6f24a3691eed using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 01541c28-e61f-455d-a5a3-6c50a4460e17. Aug 31 15:53:53.555537 n-d-833090-16 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-59205ef8-057c-4bb0-8ada-22aa3358c5a8'] Aug 31 15:53:53.558045 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7183b87a-1c61-439f-812e-ae135fdfc98d tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Request method failure captured: Aug 31 15:53:53.558045 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers/378220a7-113f-49e1-9bfa-3804d55260c6/action HTTP/1.1 Aug 31 15:53:53.558045 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:53:53.558045 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:53:53.558045 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:53:53.558045 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 46 Aug 31 15:53:53.558045 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:53:53.558045 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:53:53.558045 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:53:53.558045 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:53:53.558045 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4P3e4vWl86HsSCKrwN7UgYj6fmoFiGiZaNcsOVajSsrupSvowweH3IxPnlgwZhAuMgXmGZ4AVG5C-ZHiKf0KSpTtQTOvxTEEoapPMs742UCkmNpn4sdsPiVvAVZZ_02EtsqSjbIRJKfx7yl0WXkbI0mjmOsmBQgOw6ZWHOzL9H9r7U Aug 31 15:53:53.558045 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:53:53.558045 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:53:53.558045 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:53:53.558045 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:53:53.558045 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:53:53.558045 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:53:53.558045 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 390f00bece0c42999585de9fc68e1ce0 Aug 31 15:53:53.558045 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-240143373 Aug 31 15:53:53.558045 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:53:53.558045 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:53:53.559779 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/390f00bece0c42999585de9fc68e1ce0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/390f00bece0c42999585de9fc68e1ce0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/390f00bece0c42999585de9fc68e1ce0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_390f00bece0c42999585de9fc68e1ce0", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:53:53.559779 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-240143373 Aug 31 15:53:53.559779 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 390f00bece0c42999585de9fc68e1ce0 Aug 31 15:53:53.559779 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-240143373 Aug 31 15:53:53.559779 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project Aug 31 15:53:53.559779 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:53:53.559779 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:53:53.559779 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 88494f6bd936497b88c3f50b4ffb2fd0 Aug 31 15:53:53.559779 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project Aug 31 15:53:53.559779 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 15:53:53.559779 n-d-833090-16 devstack@n-api.service[128863]: {"addFloatingIp": {"address": "172.25.9.235"}} Aug 31 15:53:53.559779 n-d-833090-16 devstack@n-api.service[128863]: method: Aug 31 15:53:53.560769 n-d-833090-16 devstack@n-api.service[128863]: exception: Cannot associate floating IP 172.25.9.235 (036916b4-653a-40cd-acb1-0fb6dbc6c342) with port 7f87d1ce-41ae-4d7a-8907-6f24a3691eed using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 01541c28-e61f-455d-a5a3-6c50a4460e17. Aug 31 15:53:53.560769 n-d-833090-16 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-59205ef8-057c-4bb0-8ada-22aa3358c5a8'] Aug 31 15:53:53.560769 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '378220a7-113f-49e1-9bfa-3804d55260c6', 'body': {'addFloatingIp': {'address': '172.25.9.235'}}} Aug 31 15:53:53.560769 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:53:53.560769 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:53.560769 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Aug 31 15:53:53.560769 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Aug 31 15:53:53.560769 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 15:53:53.560769 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 15:53:53.560769 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Aug 31 15:53:53.560769 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Aug 31 15:53:53.560769 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 15:53:53.560769 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 15:53:53.560769 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Aug 31 15:53:53.560769 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Aug 31 15:53:53.560769 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 15:53:53.560769 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 15:53:53.562085 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Aug 31 15:53:53.562085 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Aug 31 15:53:53.562085 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 15:53:53.562085 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 15:53:53.562085 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 31 15:53:53.562085 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 31 15:53:53.562085 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 15:53:53.562085 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 15:53:53.562085 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 31 15:53:53.562085 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 31 15:53:53.562085 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 15:53:53.562085 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 15:53:53.562085 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 31 15:53:53.562085 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 31 15:53:53.562085 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 31 15:53:53.562085 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 31 15:53:53.563458 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.9.235 (036916b4-653a-40cd-acb1-0fb6dbc6c342) with port 7f87d1ce-41ae-4d7a-8907-6f24a3691eed using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 01541c28-e61f-455d-a5a3-6c50a4460e17. Aug 31 15:53:53.563458 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59205ef8-057c-4bb0-8ada-22aa3358c5a8'] Aug 31 15:53:53.563458 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:53:53.563458 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:53:53.563458 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:53:53.563458 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:53.563458 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 31 15:53:53.563458 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 31 15:53:53.563458 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 31 15:53:53.563458 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 31 15:53:53.563458 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Aug 31 15:53:53.563458 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Aug 31 15:53:53.563458 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.9.235 (036916b4-653a-40cd-acb1-0fb6dbc6c342) with port 7f87d1ce-41ae-4d7a-8907-6f24a3691eed using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 01541c28-e61f-455d-a5a3-6c50a4460e17. Aug 31 15:53:53.563458 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59205ef8-057c-4bb0-8ada-22aa3358c5a8'] Aug 31 15:53:53.563458 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:53:53.563458 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:53:53.564979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:53:53.564979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:53.564979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:53:53.564979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:53:53.564979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:53:53.564979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:53:53.564979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:53:53.564979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:53:53.564979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:53:53.564979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:53:53.564979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:53:53.564979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:53:53.564979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Aug 31 15:53:53.564979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 15:53:53.564979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.9.235 (036916b4-653a-40cd-acb1-0fb6dbc6c342) with port 7f87d1ce-41ae-4d7a-8907-6f24a3691eed using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 01541c28-e61f-455d-a5a3-6c50a4460e17. Aug 31 15:53:53.564979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59205ef8-057c-4bb0-8ada-22aa3358c5a8'] Aug 31 15:53:53.564979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:53:53.564979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:53:53.566354 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:53:53.566354 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:53.566354 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:53:53.566354 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:53:53.566354 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:53:53.566354 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:53:53.566354 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.9.235 (036916b4-653a-40cd-acb1-0fb6dbc6c342) with port 7f87d1ce-41ae-4d7a-8907-6f24a3691eed using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 01541c28-e61f-455d-a5a3-6c50a4460e17. Aug 31 15:53:53.566354 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59205ef8-057c-4bb0-8ada-22aa3358c5a8'] Aug 31 15:53:53.566354 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:53:53.566354 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7183b87a-1c61-439f-812e-ae135fdfc98d tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Returning 400 to user: Cannot associate floating IP 172.25.9.235 (036916b4-653a-40cd-acb1-0fb6dbc6c342) with port 7f87d1ce-41ae-4d7a-8907-6f24a3691eed using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 01541c28-e61f-455d-a5a3-6c50a4460e17. Aug 31 15:53:53.566354 n-d-833090-16 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-59205ef8-057c-4bb0-8ada-22aa3358c5a8'] {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:53:53.567199 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7183b87a-1c61-439f-812e-ae135fdfc98d tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] 10.222.0.50 "POST /compute/v2.1/servers/378220a7-113f-49e1-9bfa-3804d55260c6/action" status: 400 len: 382 microversion: 2.1 time: 0.652769 Aug 31 15:53:53.570119 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 609/1290] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 15:53:52 2022] POST /compute/v2.1/servers/378220a7-113f-49e1-9bfa-3804d55260c6/action => generated 382 bytes in 657 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 15:53:53.577236 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6333fa52-fce4-4095-b526-0a4bf59641e1 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:53.584705 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6333fa52-fce4-4095-b526-0a4bf59641e1 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] [instance: a90bb0c5-7d56-4e38-8d78-a5c92a9976c3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:53.595098 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6333fa52-fce4-4095-b526-0a4bf59641e1 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:53.595751 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6333fa52-fce4-4095-b526-0a4bf59641e1 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:53.596601 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6333fa52-fce4-4095-b526-0a4bf59641e1 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:53.601365 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6333fa52-fce4-4095-b526-0a4bf59641e1 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:53.602188 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6333fa52-fce4-4095-b526-0a4bf59641e1 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:53.602724 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6333fa52-fce4-4095-b526-0a4bf59641e1 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:53.620669 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-6333fa52-fce4-4095-b526-0a4bf59641e1 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] HTTP exception thrown: Instance a90bb0c5-7d56-4e38-8d78-a5c92a9976c3 could not be found. Aug 31 15:53:53.624667 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6333fa52-fce4-4095-b526-0a4bf59641e1 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Request method failure captured: Aug 31 15:53:53.624667 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3 HTTP/1.1 Aug 31 15:53:53.624667 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:53:53.624667 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:53:53.624667 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:53:53.624667 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:53:53.624667 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:53:53.624667 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:53:53.624667 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:53:53.624667 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:53:53.624667 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4N7U-PVpbl0kLWMtLgV8didI6cP-hMyAbHGO9dDZc4kAtu4x746Z7BrKA5ZNBxzrwlnJK5YcC5JrpokHkB1n2J4xueHWMLa0meSeH0I57ndiZkx4Ld3bViDB3J5inrMyEh1WKJp1hRAVcRBmXMzbxXUISR-ROX_E_JRnKusJzJK_fY Aug 31 15:53:53.624667 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:53:53.624667 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:53:53.624667 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:53:53.624667 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:53:53.624667 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:53:53.624667 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:53:53.624667 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: e1c897eb2e5b4101858807f875a8ac0e Aug 31 15:53:53.624667 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1577078678 Aug 31 15:53:53.624667 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:53:53.624667 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:53:53.626140 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e1c897eb2e5b4101858807f875a8ac0e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e1c897eb2e5b4101858807f875a8ac0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e1c897eb2e5b4101858807f875a8ac0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e1c897eb2e5b4101858807f875a8ac0e", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:53:53.626140 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1577078678 Aug 31 15:53:53.626140 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: e1c897eb2e5b4101858807f875a8ac0e Aug 31 15:53:53.626140 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1577078678 Aug 31 15:53:53.626140 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-AttachSCSIVolumeTestJSON-1577078678-project Aug 31 15:53:53.626140 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:53:53.626140 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:53:53.626140 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 39e40446741c470f92d6f60ec910d84e Aug 31 15:53:53.626140 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1577078678-project Aug 31 15:53:53.626140 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 15:53:53.626140 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance a90bb0c5-7d56-4e38-8d78-a5c92a9976c3 could not be found. Aug 31 15:53:53.626140 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'a90bb0c5-7d56-4e38-8d78-a5c92a9976c3'} Aug 31 15:53:53.626949 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:53:53.626949 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:53.626949 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:53:53.626949 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:53:53.626949 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:53:53.626949 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:53:53.626949 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:53:53.626949 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:53:53.626949 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:53:53.626949 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:53:53.626949 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a90bb0c5-7d56-4e38-8d78-a5c92a9976c3 could not be found. Aug 31 15:53:53.626949 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:53:53.626949 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:53:53.626949 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:53:53.626949 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:53.626949 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:53:53.626949 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:53:53.626949 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:53:53.626949 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:53:53.626949 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:53:53.628157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:53:53.628157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:53:53.628157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:53:53.628157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:53:53.628157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:53:53.628157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:53:53.628157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:53:53.628157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a90bb0c5-7d56-4e38-8d78-a5c92a9976c3 could not be found. Aug 31 15:53:53.628157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:53:53.628157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:53:53.628157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:53:53.628157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:53:53.628157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:53:53.628157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:53:53.628157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:53:53.628157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:53:53.628157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a90bb0c5-7d56-4e38-8d78-a5c92a9976c3 could not be found. Aug 31 15:53:53.628157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:53:53.638345 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6333fa52-fce4-4095-b526-0a4bf59641e1 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Returning 404 to user: Instance a90bb0c5-7d56-4e38-8d78-a5c92a9976c3 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:53:53.639429 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6333fa52-fce4-4095-b526-0a4bf59641e1 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] 10.222.0.50 "GET /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3" status: 404 len: 111 microversion: 2.1 time: 0.070293 Aug 31 15:53:53.640217 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 610/1291] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:53 2022] GET /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:53:53.645239 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-305e256e-a319-42b4-a6b4-4e0acf9013d3 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Calling method '.version_select at 0x7fbb46d9a1f0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:54.272414 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9298745f-7cbd-4259-bb2c-ff26ac2e4b75 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:54.283725 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9298745f-7cbd-4259-bb2c-ff26ac2e4b75 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09" status: 200 len: 1542 microversion: 2.1 time: 1.054672 Aug 31 15:53:54.295861 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 682/1292] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:53 2022] GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09 => generated 1542 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:53:54.295861 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-64108c13-e1b9-4dd1-b00a-153ba7c9667e tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Calling method '.version_select at 0x7fbb4ab47ca0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:54.308539 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-64108c13-e1b9-4dd1-b00a-153ba7c9667e tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1136658894" status: 202 len: 0 microversion: 2.1 time: 0.022614 Aug 31 15:53:54.309120 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 683/1293] 10.222.0.50 () {58 vars in 1221 bytes} [Wed Aug 31 15:53:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1136658894 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:53:54.313689 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e6ba3cd9-0ece-4718-9ff5-ed0795f44b39 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:54.314300 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e6ba3cd9-0ece-4718-9ff5-ed0795f44b39 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] [instance: e4a38af3-ba7d-4074-a628-9c7825ae3358] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:54.320256 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6ba3cd9-0ece-4718-9ff5-ed0795f44b39 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:54.320715 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6ba3cd9-0ece-4718-9ff5-ed0795f44b39 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:54.321143 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6ba3cd9-0ece-4718-9ff5-ed0795f44b39 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:54.322032 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6ba3cd9-0ece-4718-9ff5-ed0795f44b39 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:54.322516 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6ba3cd9-0ece-4718-9ff5-ed0795f44b39 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:54.322948 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6ba3cd9-0ece-4718-9ff5-ed0795f44b39 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:54.732102 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e6ba3cd9-0ece-4718-9ff5-ed0795f44b39 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048bcefe0af04bc6a3a2995b22cbe43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87fc33005b5440098daf798066a653f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:54.744101 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e6ba3cd9-0ece-4718-9ff5-ed0795f44b39 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] 10.222.0.50 "GET /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358" status: 200 len: 1334 microversion: 2.1 time: 0.432667 Aug 31 15:53:54.744822 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 684/1294] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:54 2022] GET /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358 => generated 1334 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:54.762074 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2d754f54-e8b2-4319-b9a9-40a53d4981d2 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:54.762950 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2d754f54-e8b2-4319-b9a9-40a53d4981d2 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] [instance: e803dd93-0c39-49a2-9bca-92bf0a789290] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:54.769751 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2d754f54-e8b2-4319-b9a9-40a53d4981d2 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:54.770544 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2d754f54-e8b2-4319-b9a9-40a53d4981d2 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:54.771124 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2d754f54-e8b2-4319-b9a9-40a53d4981d2 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:54.771970 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2d754f54-e8b2-4319-b9a9-40a53d4981d2 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:54.772562 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2d754f54-e8b2-4319-b9a9-40a53d4981d2 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:54.773170 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2d754f54-e8b2-4319-b9a9-40a53d4981d2 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:54.926006 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2d754f54-e8b2-4319-b9a9-40a53d4981d2 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:54.942785 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2d754f54-e8b2-4319-b9a9-40a53d4981d2 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:54.945342 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2d754f54-e8b2-4319-b9a9-40a53d4981d2 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:54.951034 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2d754f54-e8b2-4319-b9a9-40a53d4981d2 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] 10.222.0.50 "GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290" status: 200 len: 1357 microversion: 2.57 time: 0.203698 Aug 31 15:53:54.955055 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 685/1295] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:53:54 2022] GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290 => generated 1357 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:53:54.979839 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ecbf1852-9b84-4eb4-a21c-4a1cfcce87fe tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:53:54.983562 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ecbf1852-9b84-4eb4-a21c-4a1cfcce87fe tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] [instance: e803dd93-0c39-49a2-9bca-92bf0a789290] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:54.991224 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ecbf1852-9b84-4eb4-a21c-4a1cfcce87fe tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:54.992027 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ecbf1852-9b84-4eb4-a21c-4a1cfcce87fe tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:54.992657 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ecbf1852-9b84-4eb4-a21c-4a1cfcce87fe tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:54.993534 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ecbf1852-9b84-4eb4-a21c-4a1cfcce87fe tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:54.994320 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ecbf1852-9b84-4eb4-a21c-4a1cfcce87fe tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:54.995024 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ecbf1852-9b84-4eb4-a21c-4a1cfcce87fe tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:55.084856 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-ecbf1852-9b84-4eb4-a21c-4a1cfcce87fe tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:53:55.085510 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-ecbf1852-9b84-4eb4-a21c-4a1cfcce87fe tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:53:55.086489 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-ecbf1852-9b84-4eb4-a21c-4a1cfcce87fe tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:53:55.087592 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-ecbf1852-9b84-4eb4-a21c-4a1cfcce87fe tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:53:55.088427 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-ecbf1852-9b84-4eb4-a21c-4a1cfcce87fe tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:53:55.211323 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ecbf1852-9b84-4eb4-a21c-4a1cfcce87fe tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] [instance: e803dd93-0c39-49a2-9bca-92bf0a789290] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:55.270301 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ecbf1852-9b84-4eb4-a21c-4a1cfcce87fe tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:55.272197 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ecbf1852-9b84-4eb4-a21c-4a1cfcce87fe tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:55.273421 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ecbf1852-9b84-4eb4-a21c-4a1cfcce87fe tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:55.275716 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ecbf1852-9b84-4eb4-a21c-4a1cfcce87fe tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:55.276429 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ecbf1852-9b84-4eb4-a21c-4a1cfcce87fe tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:55.277204 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ecbf1852-9b84-4eb4-a21c-4a1cfcce87fe tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:55.345383 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ecbf1852-9b84-4eb4-a21c-4a1cfcce87fe tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] 10.222.0.50 "POST /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290/action" status: 202 len: 1138 microversion: 2.57 time: 0.369950 Aug 31 15:53:55.347469 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 686/1296] 10.222.0.50 () {62 vars in 1320 bytes} [Wed Aug 31 15:53:54 2022] POST /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290/action => generated 1138 bytes in 373 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Aug 31 15:53:55.355178 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-cada2c62-bada-4ff4-ae10-6195fdb27dcc tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:55.356199 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-cada2c62-bada-4ff4-ae10-6195fdb27dcc tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 04a4f94b-5820-4bbe-a9b0-7fa55a697e09] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:55.365458 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:53:55.368211 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cada2c62-bada-4ff4-ae10-6195fdb27dcc tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:55.369238 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cada2c62-bada-4ff4-ae10-6195fdb27dcc tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:55.369909 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cada2c62-bada-4ff4-ae10-6195fdb27dcc tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:55.371479 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cada2c62-bada-4ff4-ae10-6195fdb27dcc tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:55.372108 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cada2c62-bada-4ff4-ae10-6195fdb27dcc tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:55.372769 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cada2c62-bada-4ff4-ae10-6195fdb27dcc tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:55.522545 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-305e256e-a319-42b4-a6b4-4e0acf9013d3 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/036916b4-653a-40cd-acb1-0fb6dbc6c342" status: 202 len: 0 microversion: 2.1 time: 1.881000 Aug 31 15:53:55.524051 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 611/1297] 10.222.0.50 () {58 vars in 1263 bytes} [Wed Aug 31 15:53:53 2022] DELETE /compute/v2.1/os-floating-ips/036916b4-653a-40cd-acb1-0fb6dbc6c342 => generated 0 bytes in 1883 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:53:55.536427 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f3a7a44d-7780-4708-837a-96ccecab7b9f tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:55.537546 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f3a7a44d-7780-4708-837a-96ccecab7b9f tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] [instance: e803dd93-0c39-49a2-9bca-92bf0a789290] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:55.546977 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f3a7a44d-7780-4708-837a-96ccecab7b9f tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:55.548056 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f3a7a44d-7780-4708-837a-96ccecab7b9f tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:55.548486 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f3a7a44d-7780-4708-837a-96ccecab7b9f tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:55.549414 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f3a7a44d-7780-4708-837a-96ccecab7b9f tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:55.550126 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f3a7a44d-7780-4708-837a-96ccecab7b9f tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:55.550780 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f3a7a44d-7780-4708-837a-96ccecab7b9f tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:55.625804 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f3a7a44d-7780-4708-837a-96ccecab7b9f tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:55.636703 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f3a7a44d-7780-4708-837a-96ccecab7b9f tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:55.639067 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f3a7a44d-7780-4708-837a-96ccecab7b9f tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:55.640525 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f3a7a44d-7780-4708-837a-96ccecab7b9f tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] 10.222.0.50 "GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290" status: 200 len: 1366 microversion: 2.57 time: 0.115538 Aug 31 15:53:55.641788 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 612/1298] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:53:55 2022] GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290 => generated 1366 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:53:55.647112 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6cff430e-edc2-497f-8263-978e47022b9f tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Action: 'action', calling method: .version_select at 0x7fbb485a89d0>, body: {"removeFloatingIp": {"address": "172.25.9.31"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:53:55.950774 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6cff430e-edc2-497f-8263-978e47022b9f tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] [instance: 378220a7-113f-49e1-9bfa-3804d55260c6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:55.958345 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6cff430e-edc2-497f-8263-978e47022b9f tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:55.958917 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6cff430e-edc2-497f-8263-978e47022b9f tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:55.959353 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6cff430e-edc2-497f-8263-978e47022b9f tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:55.960859 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6cff430e-edc2-497f-8263-978e47022b9f tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:55.961334 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6cff430e-edc2-497f-8263-978e47022b9f tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:55.962977 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6cff430e-edc2-497f-8263-978e47022b9f tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:55.985248 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-cada2c62-bada-4ff4-ae10-6195fdb27dcc tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:55.997500 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-cada2c62-bada-4ff4-ae10-6195fdb27dcc tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09" status: 200 len: 1542 microversion: 2.1 time: 0.648611 Aug 31 15:53:55.998889 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 687/1299] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:55 2022] GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09 => generated 1542 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:56.004920 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-75e3a5d0-83ef-409e-a508-6565a8589434 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:56.005759 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-75e3a5d0-83ef-409e-a508-6565a8589434 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] [instance: e4a38af3-ba7d-4074-a628-9c7825ae3358] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:56.012716 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-75e3a5d0-83ef-409e-a508-6565a8589434 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:56.014038 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-75e3a5d0-83ef-409e-a508-6565a8589434 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:56.014720 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-75e3a5d0-83ef-409e-a508-6565a8589434 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:56.015684 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-75e3a5d0-83ef-409e-a508-6565a8589434 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:56.016856 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-75e3a5d0-83ef-409e-a508-6565a8589434 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:56.017503 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-75e3a5d0-83ef-409e-a508-6565a8589434 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:56.036263 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:53:56.290121 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-75e3a5d0-83ef-409e-a508-6565a8589434 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048bcefe0af04bc6a3a2995b22cbe43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87fc33005b5440098daf798066a653f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:56.299977 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-75e3a5d0-83ef-409e-a508-6565a8589434 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] 10.222.0.50 "GET /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358" status: 200 len: 1355 microversion: 2.1 time: 0.299523 Aug 31 15:53:56.301188 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 688/1300] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:55 2022] GET /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358 => generated 1355 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:56.382489 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6cff430e-edc2-497f-8263-978e47022b9f tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Acquiring lock "refresh_cache-378220a7-113f-49e1-9bfa-3804d55260c6" {{(pid=128863) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 15:53:56.383125 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6cff430e-edc2-497f-8263-978e47022b9f tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Acquired lock "refresh_cache-378220a7-113f-49e1-9bfa-3804d55260c6" {{(pid=128863) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 15:53:56.604297 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:53:56.613466 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-798d1e30-e629-472d-bf82-5f9240ca3310 req-b76246e4-e706-4e50-8729-471d0be2671c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4a38af3-ba7d-4074-a628-9c7825ae3358", "tag": "d7e6779f-5f3b-407f-9773-9e0e92b5d2d6"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:53:56.644651 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:53:56.654569 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-798d1e30-e629-472d-bf82-5f9240ca3310 req-b76246e4-e706-4e50-8729-471d0be2671c service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:56.655075 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-798d1e30-e629-472d-bf82-5f9240ca3310 req-b76246e4-e706-4e50-8729-471d0be2671c service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:56.655648 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-798d1e30-e629-472d-bf82-5f9240ca3310 req-b76246e4-e706-4e50-8729-471d0be2671c service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:56.668723 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-798d1e30-e629-472d-bf82-5f9240ca3310 req-b76246e4-e706-4e50-8729-471d0be2671c service nova] Creating event network-changed:d7e6779f-5f3b-407f-9773-9e0e92b5d2d6 for instance e4a38af3-ba7d-4074-a628-9c7825ae3358 on n-h2-833090-16 Aug 31 15:53:56.674366 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-798d1e30-e629-472d-bf82-5f9240ca3310 req-b76246e4-e706-4e50-8729-471d0be2671c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074676 Aug 31 15:53:56.675628 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 689/1301] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:53:56.681289 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-150bd5b7-8644-444e-900f-c4fe690019df tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:56.682272 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-150bd5b7-8644-444e-900f-c4fe690019df tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] [instance: e803dd93-0c39-49a2-9bca-92bf0a789290] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:56.689222 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-150bd5b7-8644-444e-900f-c4fe690019df tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:56.689928 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-150bd5b7-8644-444e-900f-c4fe690019df tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:56.690601 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-150bd5b7-8644-444e-900f-c4fe690019df tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:56.691718 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-150bd5b7-8644-444e-900f-c4fe690019df tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:56.692435 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-150bd5b7-8644-444e-900f-c4fe690019df tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:56.693018 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-150bd5b7-8644-444e-900f-c4fe690019df tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:56.849608 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:53:56.883375 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-150bd5b7-8644-444e-900f-c4fe690019df tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:56.915965 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-150bd5b7-8644-444e-900f-c4fe690019df tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:56.918618 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-150bd5b7-8644-444e-900f-c4fe690019df tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:56.923798 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-150bd5b7-8644-444e-900f-c4fe690019df tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] 10.222.0.50 "GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290" status: 200 len: 1366 microversion: 2.57 time: 0.246591 Aug 31 15:53:56.927458 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 690/1302] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:53:56 2022] GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290 => generated 1366 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:53:57.026898 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-89eaabf2-d7bf-46df-baf9-319e124a4fb9 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:57.027891 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-89eaabf2-d7bf-46df-baf9-319e124a4fb9 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 04a4f94b-5820-4bbe-a9b0-7fa55a697e09] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:57.036161 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-89eaabf2-d7bf-46df-baf9-319e124a4fb9 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:57.041059 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-89eaabf2-d7bf-46df-baf9-319e124a4fb9 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:57.043533 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-89eaabf2-d7bf-46df-baf9-319e124a4fb9 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:57.045349 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-89eaabf2-d7bf-46df-baf9-319e124a4fb9 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:57.049094 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-89eaabf2-d7bf-46df-baf9-319e124a4fb9 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:57.049789 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-89eaabf2-d7bf-46df-baf9-319e124a4fb9 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:57.413338 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=10 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:53:57.501522 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-89eaabf2-d7bf-46df-baf9-319e124a4fb9 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:57.509211 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-89eaabf2-d7bf-46df-baf9-319e124a4fb9 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09" status: 200 len: 1542 microversion: 2.1 time: 0.488135 Aug 31 15:53:57.522530 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 691/1303] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:57 2022] GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09 => generated 1542 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:53:57.699540 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-27817321-f7c0-40c3-936c-1ee927605d5d tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1831881367", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:53:57.773878 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-27817321-f7c0-40c3-936c-1ee927605d5d tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] validate_networks() for None {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:53:57.801004 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-6cff430e-edc2-497f-8263-978e47022b9f tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] [instance: 378220a7-113f-49e1-9bfa-3804d55260c6] Building network info cache for instance {{(pid=128863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 31 15:53:58.492297 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-27817321-f7c0-40c3-936c-1ee927605d5d tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:53:58.492896 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-27817321-f7c0-40c3-936c-1ee927605d5d tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:53:58.493167 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-27817321-f7c0-40c3-936c-1ee927605d5d tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:53:58.493570 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-27817321-f7c0-40c3-936c-1ee927605d5d tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:53:58.493977 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-27817321-f7c0-40c3-936c-1ee927605d5d tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:53:58.509576 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-27817321-f7c0-40c3-936c-1ee927605d5d tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:58.510068 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-27817321-f7c0-40c3-936c-1ee927605d5d tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:58.510535 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-27817321-f7c0-40c3-936c-1ee927605d5d tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:58.516468 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-27817321-f7c0-40c3-936c-1ee927605d5d tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:58.516950 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-27817321-f7c0-40c3-936c-1ee927605d5d tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:58.517385 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-27817321-f7c0-40c3-936c-1ee927605d5d tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:58.540517 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-27817321-f7c0-40c3-936c-1ee927605d5d tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Getting quotas for project a45d2345cb0e4847964e67928ab3069b. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:53:58.546966 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-27817321-f7c0-40c3-936c-1ee927605d5d tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Getting quotas for user 0578b42db80943249238958e5fce15f1 and project a45d2345cb0e4847964e67928ab3069b. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:53:58.561022 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-27817321-f7c0-40c3-936c-1ee927605d5d tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:53:58.564047 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-27817321-f7c0-40c3-936c-1ee927605d5d tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] [instance: 0442e1d9-fa54-4957-8313-335c0f39c763] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:53:58.614583 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-27817321-f7c0-40c3-936c-1ee927605d5d tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.090381 Aug 31 15:53:58.621787 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 692/1304] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:53:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1098 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 15:53:58.627346 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d9232add-af80-4dbe-950e-96d520c9b44a tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:58.628543 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d9232add-af80-4dbe-950e-96d520c9b44a tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] [instance: e4a38af3-ba7d-4074-a628-9c7825ae3358] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:58.636354 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d9232add-af80-4dbe-950e-96d520c9b44a tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:58.637267 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d9232add-af80-4dbe-950e-96d520c9b44a tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:58.637918 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d9232add-af80-4dbe-950e-96d520c9b44a tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:58.638887 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d9232add-af80-4dbe-950e-96d520c9b44a tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:58.639594 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d9232add-af80-4dbe-950e-96d520c9b44a tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:58.640238 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d9232add-af80-4dbe-950e-96d520c9b44a tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:59.016135 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d9232add-af80-4dbe-950e-96d520c9b44a tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048bcefe0af04bc6a3a2995b22cbe43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87fc33005b5440098daf798066a653f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:59.035414 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d9232add-af80-4dbe-950e-96d520c9b44a tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] 10.222.0.50 "GET /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358" status: 200 len: 1355 microversion: 2.1 time: 0.412159 Aug 31 15:53:59.050495 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 693/1305] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:58 2022] GET /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358 => generated 1355 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:59.059502 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-40b9af38-38be-408a-b186-584f589e51be req-d2146673-8c73-47eb-b73e-a28d59d23b8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "378220a7-113f-49e1-9bfa-3804d55260c6", "tag": "7f87d1ce-41ae-4d7a-8907-6f24a3691eed"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:53:59.105318 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-40b9af38-38be-408a-b186-584f589e51be req-d2146673-8c73-47eb-b73e-a28d59d23b8c service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:59.105837 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-40b9af38-38be-408a-b186-584f589e51be req-d2146673-8c73-47eb-b73e-a28d59d23b8c service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:59.106304 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-40b9af38-38be-408a-b186-584f589e51be req-d2146673-8c73-47eb-b73e-a28d59d23b8c service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:59.133074 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-40b9af38-38be-408a-b186-584f589e51be req-d2146673-8c73-47eb-b73e-a28d59d23b8c service nova] Creating event network-changed:7f87d1ce-41ae-4d7a-8907-6f24a3691eed for instance 378220a7-113f-49e1-9bfa-3804d55260c6 on n-h1-833090-16 Aug 31 15:53:59.147494 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-40b9af38-38be-408a-b186-584f589e51be req-d2146673-8c73-47eb-b73e-a28d59d23b8c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094210 Aug 31 15:53:59.148126 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 694/1306] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:53:59.161015 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-600baf49-1269-4ada-ada3-add280d2c0e4 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:59.161736 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-600baf49-1269-4ada-ada3-add280d2c0e4 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] [instance: e803dd93-0c39-49a2-9bca-92bf0a789290] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:59.173604 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-600baf49-1269-4ada-ada3-add280d2c0e4 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:59.173997 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-600baf49-1269-4ada-ada3-add280d2c0e4 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:59.180318 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-600baf49-1269-4ada-ada3-add280d2c0e4 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:59.181164 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-600baf49-1269-4ada-ada3-add280d2c0e4 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:59.181658 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-600baf49-1269-4ada-ada3-add280d2c0e4 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:59.182112 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-600baf49-1269-4ada-ada3-add280d2c0e4 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:59.407026 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-600baf49-1269-4ada-ada3-add280d2c0e4 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:59.421495 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-600baf49-1269-4ada-ada3-add280d2c0e4 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:59.423603 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-600baf49-1269-4ada-ada3-add280d2c0e4 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:59.425042 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-600baf49-1269-4ada-ada3-add280d2c0e4 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] 10.222.0.50 "GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290" status: 200 len: 1366 microversion: 2.57 time: 0.275828 Aug 31 15:53:59.428148 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 695/1307] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:53:59 2022] GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290 => generated 1366 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:53:59.435824 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b0fc1f4d-ae9b-4467-b79e-ad1f86fa7f16 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:59.437047 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b0fc1f4d-ae9b-4467-b79e-ad1f86fa7f16 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 04a4f94b-5820-4bbe-a9b0-7fa55a697e09] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:59.440171 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-6cff430e-edc2-497f-8263-978e47022b9f tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] [instance: 378220a7-113f-49e1-9bfa-3804d55260c6] Updating instance_info_cache with network_info: [{"id": "7f87d1ce-41ae-4d7a-8907-6f24a3691eed", "address": "fa:16:3e:0a:d3:cc", "network": {"id": "6da6fef1-33a8-4f7a-a21c-08f85e78d1da", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-413077722-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "390f00bece0c42999585de9fc68e1ce0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap7f87d1ce-41", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 31 15:53:59.452698 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b0fc1f4d-ae9b-4467-b79e-ad1f86fa7f16 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:59.454252 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b0fc1f4d-ae9b-4467-b79e-ad1f86fa7f16 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:59.455134 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b0fc1f4d-ae9b-4467-b79e-ad1f86fa7f16 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:59.462379 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b0fc1f4d-ae9b-4467-b79e-ad1f86fa7f16 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:59.463085 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6cff430e-edc2-497f-8263-978e47022b9f tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Releasing lock "refresh_cache-378220a7-113f-49e1-9bfa-3804d55260c6" {{(pid=128863) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 15:53:59.463303 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b0fc1f4d-ae9b-4467-b79e-ad1f86fa7f16 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:59.463591 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b0fc1f4d-ae9b-4467-b79e-ad1f86fa7f16 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:59.465659 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6cff430e-edc2-497f-8263-978e47022b9f tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] 10.222.0.50 "POST /compute/v2.1/servers/378220a7-113f-49e1-9bfa-3804d55260c6/action" status: 202 len: 0 microversion: 2.1 time: 3.821675 Aug 31 15:53:59.469802 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 613/1308] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 15:53:55 2022] POST /compute/v2.1/servers/378220a7-113f-49e1-9bfa-3804d55260c6/action => generated 0 bytes in 3826 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 31 15:53:59.487580 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c3c000ab-98cb-4cfe-aff7-3b217496dade tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:59.488902 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c3c000ab-98cb-4cfe-aff7-3b217496dade tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] [instance: 0442e1d9-fa54-4957-8313-335c0f39c763] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:53:59.605410 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c3c000ab-98cb-4cfe-aff7-3b217496dade tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0578b42db80943249238958e5fce15f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45d2345cb0e4847964e67928ab3069b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:59.615229 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c3c000ab-98cb-4cfe-aff7-3b217496dade tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "GET /compute/v2.1/servers/0442e1d9-fa54-4957-8313-335c0f39c763" status: 200 len: 1217 microversion: 2.1 time: 0.143173 Aug 31 15:53:59.616009 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 614/1309] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:59 2022] GET /compute/v2.1/servers/0442e1d9-fa54-4957-8313-335c0f39c763 => generated 1217 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:53:59.632759 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-60b72c47-10c2-4839-852a-af943581edc3 req-e63f7a3c-88e4-4bc5-9116-f91ebe16229d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4a38af3-ba7d-4074-a628-9c7825ae3358", "tag": "ebf441e7-25e3-470e-97ba-860218cd32be"}, {"name": "network-changed", "server_uuid": "e4a38af3-ba7d-4074-a628-9c7825ae3358", "tag": "2f65903b-694a-4587-998c-6e75f99fcccf"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:53:59.653838 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-60b72c47-10c2-4839-852a-af943581edc3 req-e63f7a3c-88e4-4bc5-9116-f91ebe16229d service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:53:59.654955 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-60b72c47-10c2-4839-852a-af943581edc3 req-e63f7a3c-88e4-4bc5-9116-f91ebe16229d service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:53:59.655548 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-60b72c47-10c2-4839-852a-af943581edc3 req-e63f7a3c-88e4-4bc5-9116-f91ebe16229d service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:53:59.676668 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-60b72c47-10c2-4839-852a-af943581edc3 req-e63f7a3c-88e4-4bc5-9116-f91ebe16229d service nova] Creating event network-changed:ebf441e7-25e3-470e-97ba-860218cd32be for instance e4a38af3-ba7d-4074-a628-9c7825ae3358 on n-h2-833090-16 Aug 31 15:53:59.677719 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-60b72c47-10c2-4839-852a-af943581edc3 req-e63f7a3c-88e4-4bc5-9116-f91ebe16229d service nova] Creating event network-changed:2f65903b-694a-4587-998c-6e75f99fcccf for instance e4a38af3-ba7d-4074-a628-9c7825ae3358 on n-h2-833090-16 Aug 31 15:53:59.683533 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-60b72c47-10c2-4839-852a-af943581edc3 req-e63f7a3c-88e4-4bc5-9116-f91ebe16229d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.065836 Aug 31 15:53:59.684752 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 615/1310] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:53:59.691271 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-54849504-6d40-4de3-b1ec-3613415ccf4d tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Calling method '.version_select at 0x7fbb4686aca0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:53:59.810457 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b0fc1f4d-ae9b-4467-b79e-ad1f86fa7f16 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:53:59.818643 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b0fc1f4d-ae9b-4467-b79e-ad1f86fa7f16 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09" status: 200 len: 1542 microversion: 2.1 time: 0.386592 Aug 31 15:53:59.822858 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 696/1311] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:53:59 2022] GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09 => generated 1542 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:00.062506 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4a25d8b7-545b-4adc-aeba-1c2349602d4a tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:00.063585 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4a25d8b7-545b-4adc-aeba-1c2349602d4a tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] [instance: e4a38af3-ba7d-4074-a628-9c7825ae3358] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:00.069954 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4a25d8b7-545b-4adc-aeba-1c2349602d4a tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:00.070819 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4a25d8b7-545b-4adc-aeba-1c2349602d4a tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:00.071491 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4a25d8b7-545b-4adc-aeba-1c2349602d4a tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:00.072665 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4a25d8b7-545b-4adc-aeba-1c2349602d4a tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:00.073322 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4a25d8b7-545b-4adc-aeba-1c2349602d4a tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:00.074156 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4a25d8b7-545b-4adc-aeba-1c2349602d4a tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:00.352281 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4a25d8b7-545b-4adc-aeba-1c2349602d4a tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048bcefe0af04bc6a3a2995b22cbe43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87fc33005b5440098daf798066a653f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:00.364311 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4a25d8b7-545b-4adc-aeba-1c2349602d4a tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] 10.222.0.50 "GET /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358" status: 200 len: 1355 microversion: 2.1 time: 0.305617 Aug 31 15:54:00.378342 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 697/1312] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:00 2022] GET /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358 => generated 1355 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:00.454873 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e2266aa4-9a22-416e-a9d0-7713f49c4da6 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:00.455610 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e2266aa4-9a22-416e-a9d0-7713f49c4da6 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] [instance: e803dd93-0c39-49a2-9bca-92bf0a789290] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:00.461782 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e2266aa4-9a22-416e-a9d0-7713f49c4da6 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:00.462367 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e2266aa4-9a22-416e-a9d0-7713f49c4da6 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:00.462855 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e2266aa4-9a22-416e-a9d0-7713f49c4da6 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:00.464037 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e2266aa4-9a22-416e-a9d0-7713f49c4da6 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:00.464812 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e2266aa4-9a22-416e-a9d0-7713f49c4da6 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:00.465296 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e2266aa4-9a22-416e-a9d0-7713f49c4da6 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:00.561804 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e2266aa4-9a22-416e-a9d0-7713f49c4da6 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:00.571747 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e2266aa4-9a22-416e-a9d0-7713f49c4da6 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:00.573797 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e2266aa4-9a22-416e-a9d0-7713f49c4da6 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:00.575037 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e2266aa4-9a22-416e-a9d0-7713f49c4da6 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] 10.222.0.50 "GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290" status: 200 len: 1366 microversion: 2.57 time: 0.124515 Aug 31 15:54:00.575734 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 698/1313] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:54:00 2022] GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290 => generated 1366 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 15:54:00.636149 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7a67398c-430f-42df-8124-5ef236645051 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:00.636772 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7a67398c-430f-42df-8124-5ef236645051 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] [instance: 0442e1d9-fa54-4957-8313-335c0f39c763] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:00.647673 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7a67398c-430f-42df-8124-5ef236645051 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:00.649373 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7a67398c-430f-42df-8124-5ef236645051 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:00.649807 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7a67398c-430f-42df-8124-5ef236645051 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:00.650625 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7a67398c-430f-42df-8124-5ef236645051 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:00.651259 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7a67398c-430f-42df-8124-5ef236645051 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:00.651832 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7a67398c-430f-42df-8124-5ef236645051 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:00.779156 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7a67398c-430f-42df-8124-5ef236645051 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0578b42db80943249238958e5fce15f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45d2345cb0e4847964e67928ab3069b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:00.795410 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7a67398c-430f-42df-8124-5ef236645051 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "GET /compute/v2.1/servers/0442e1d9-fa54-4957-8313-335c0f39c763" status: 200 len: 1221 microversion: 2.1 time: 0.163445 Aug 31 15:54:00.796967 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 699/1314] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:00 2022] GET /compute/v2.1/servers/0442e1d9-fa54-4957-8313-335c0f39c763 => generated 1221 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:54:00.808875 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-54849504-6d40-4de3-b1ec-3613415ccf4d tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/2656dcb3-5ab9-4d38-b7eb-06ed6c526e2a" status: 202 len: 0 microversion: 2.1 time: 1.122487 Aug 31 15:54:00.810148 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 616/1315] 10.222.0.50 () {58 vars in 1263 bytes} [Wed Aug 31 15:53:59 2022] DELETE /compute/v2.1/os-floating-ips/2656dcb3-5ab9-4d38-b7eb-06ed6c526e2a => generated 0 bytes in 1124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:54:00.832180 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a4e9162b-f528-48ff-a106-dde40d2405f5 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Action: 'action', calling method: .version_select at 0x7fbb485aa8b0>, body: {"addFloatingIp": {"address": ""}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:54:00.842943 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-529b74a8-221a-4137-88e6-663bb333888f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:00.843709 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-529b74a8-221a-4137-88e6-663bb333888f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 04a4f94b-5820-4bbe-a9b0-7fa55a697e09] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:00.845501 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a4e9162b-f528-48ff-a106-dde40d2405f5 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Request method failure captured: Aug 31 15:54:00.845501 n-d-833090-16 devstack@n-api.service[128864]: request: POST /compute/v2.1/servers/378220a7-113f-49e1-9bfa-3804d55260c6/action HTTP/1.1 Aug 31 15:54:00.845501 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:54:00.845501 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:54:00.845501 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:54:00.845501 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 34 Aug 31 15:54:00.845501 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:54:00.845501 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:54:00.845501 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:54:00.845501 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:54:00.845501 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4P3e4vWl86HsSCKrwN7UgYj6fmoFiGiZaNcsOVajSsrupSvowweH3IxPnlgwZhAuMgXmGZ4AVG5C-ZHiKf0KSpTtQTOvxTEEoapPMs742UCkmNpn4sdsPiVvAVZZ_02EtsqSjbIRJKfx7yl0WXkbI0mjmOsmBQgOw6ZWHOzL9H9r7U Aug 31 15:54:00.845501 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:54:00.845501 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:54:00.845501 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:54:00.845501 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:54:00.845501 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:54:00.845501 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:54:00.845501 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 390f00bece0c42999585de9fc68e1ce0 Aug 31 15:54:00.845501 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-240143373 Aug 31 15:54:00.845501 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:54:00.845501 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:54:00.847899 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/390f00bece0c42999585de9fc68e1ce0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/390f00bece0c42999585de9fc68e1ce0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/390f00bece0c42999585de9fc68e1ce0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_390f00bece0c42999585de9fc68e1ce0", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:54:00.847899 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-240143373 Aug 31 15:54:00.847899 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 390f00bece0c42999585de9fc68e1ce0 Aug 31 15:54:00.847899 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-240143373 Aug 31 15:54:00.847899 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project Aug 31 15:54:00.847899 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:54:00.847899 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:54:00.847899 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 88494f6bd936497b88c3f50b4ffb2fd0 Aug 31 15:54:00.847899 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project Aug 31 15:54:00.847899 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 15:54:00.847899 n-d-833090-16 devstack@n-api.service[128864]: {"addFloatingIp": {"address": ""}} Aug 31 15:54:00.847899 n-d-833090-16 devstack@n-api.service[128864]: method: Aug 31 15:54:00.847899 n-d-833090-16 devstack@n-api.service[128864]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 31 15:54:00.849126 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '378220a7-113f-49e1-9bfa-3804d55260c6', 'body': {'addFloatingIp': {'address': ''}}} Aug 31 15:54:00.849126 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:54:00.849126 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:54:00.849126 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 15:54:00.849126 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 15:54:00.849126 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 15:54:00.849126 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise error Aug 31 15:54:00.849126 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Aug 31 15:54:00.849126 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:54:00.849126 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Aug 31 15:54:00.849126 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Aug 31 15:54:00.849126 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:54:00.849126 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Aug 31 15:54:00.849126 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi '' Aug 31 15:54:00.849126 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:54:00.849126 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:54:00.849126 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:54:00.849126 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:54:00.849126 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:54:00.849126 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:54:00.849126 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:54:00.849126 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:54:00.851148 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:54:00.851148 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:54:00.851148 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:54:00.851148 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:54:00.851148 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 15:54:00.851148 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 15:54:00.851148 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 15:54:00.851148 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 15:54:00.851148 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 15:54:00.851148 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 15:54:00.851148 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 31 15:54:00.851148 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:54:00.851148 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:54:00.851148 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:54:00.851148 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:54:00.851148 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:54:00.851148 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:54:00.851148 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 15:54:00.851148 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 15:54:00.852718 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 31 15:54:00.852718 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:54:00.852894 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-529b74a8-221a-4137-88e6-663bb333888f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:00.852894 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-529b74a8-221a-4137-88e6-663bb333888f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:00.853094 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-529b74a8-221a-4137-88e6-663bb333888f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:00.856074 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-529b74a8-221a-4137-88e6-663bb333888f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:00.856176 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a4e9162b-f528-48ff-a106-dde40d2405f5 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:54:00.856268 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-529b74a8-221a-4137-88e6-663bb333888f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:00.856356 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a4e9162b-f528-48ff-a106-dde40d2405f5 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] 10.222.0.50 "POST /compute/v2.1/servers/378220a7-113f-49e1-9bfa-3804d55260c6/action" status: 400 len: 142 microversion: 2.1 time: 0.027564 Aug 31 15:54:00.856356 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 700/1316] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 15:54:00 2022] POST /compute/v2.1/servers/378220a7-113f-49e1-9bfa-3804d55260c6/action => generated 142 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 15:54:00.860389 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-529b74a8-221a-4137-88e6-663bb333888f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:00.865497 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-feba032d-6e21-4f97-b82b-ea958944788c tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:54:00.881534 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-feba032d-6e21-4f97-b82b-ea958944788c tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] [instance: 378220a7-113f-49e1-9bfa-3804d55260c6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:00.889790 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-feba032d-6e21-4f97-b82b-ea958944788c tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:00.890822 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-feba032d-6e21-4f97-b82b-ea958944788c tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:00.891562 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-feba032d-6e21-4f97-b82b-ea958944788c tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:00.892601 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-feba032d-6e21-4f97-b82b-ea958944788c tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:00.893162 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-feba032d-6e21-4f97-b82b-ea958944788c tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:00.894689 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-feba032d-6e21-4f97-b82b-ea958944788c tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:00.997992 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-feba032d-6e21-4f97-b82b-ea958944788c tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Acquiring lock "refresh_cache-378220a7-113f-49e1-9bfa-3804d55260c6" {{(pid=128864) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 15:54:00.999056 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-feba032d-6e21-4f97-b82b-ea958944788c tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Acquired lock "refresh_cache-378220a7-113f-49e1-9bfa-3804d55260c6" {{(pid=128864) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 15:54:01.190772 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-feba032d-6e21-4f97-b82b-ea958944788c tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Releasing lock "refresh_cache-378220a7-113f-49e1-9bfa-3804d55260c6" {{(pid=128864) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 15:54:01.191834 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-feba032d-6e21-4f97-b82b-ea958944788c tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] HTTP exception thrown: floating IP not found Aug 31 15:54:01.194741 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-feba032d-6e21-4f97-b82b-ea958944788c tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Request method failure captured: Aug 31 15:54:01.194741 n-d-833090-16 devstack@n-api.service[128864]: request: POST /compute/v2.1/servers/378220a7-113f-49e1-9bfa-3804d55260c6/action HTTP/1.1 Aug 31 15:54:01.194741 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:54:01.194741 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:54:01.194741 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:54:01.194741 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 41 Aug 31 15:54:01.194741 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:54:01.194741 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:54:01.194741 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:54:01.194741 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:54:01.194741 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4P3e4vWl86HsSCKrwN7UgYj6fmoFiGiZaNcsOVajSsrupSvowweH3IxPnlgwZhAuMgXmGZ4AVG5C-ZHiKf0KSpTtQTOvxTEEoapPMs742UCkmNpn4sdsPiVvAVZZ_02EtsqSjbIRJKfx7yl0WXkbI0mjmOsmBQgOw6ZWHOzL9H9r7U Aug 31 15:54:01.194741 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:54:01.194741 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:54:01.194741 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:54:01.194741 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:54:01.194741 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:54:01.194741 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:54:01.194741 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 390f00bece0c42999585de9fc68e1ce0 Aug 31 15:54:01.194741 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-240143373 Aug 31 15:54:01.194741 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:54:01.194741 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:54:01.196158 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/390f00bece0c42999585de9fc68e1ce0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/390f00bece0c42999585de9fc68e1ce0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/390f00bece0c42999585de9fc68e1ce0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_390f00bece0c42999585de9fc68e1ce0", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:54:01.196158 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-240143373 Aug 31 15:54:01.196158 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 390f00bece0c42999585de9fc68e1ce0 Aug 31 15:54:01.196158 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-240143373 Aug 31 15:54:01.196158 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project Aug 31 15:54:01.196158 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:54:01.196158 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:54:01.196158 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 88494f6bd936497b88c3f50b4ffb2fd0 Aug 31 15:54:01.196158 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project Aug 31 15:54:01.196158 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 15:54:01.196158 n-d-833090-16 devstack@n-api.service[128864]: {"addFloatingIp": {"address": "0.0.0.0"}} Aug 31 15:54:01.196158 n-d-833090-16 devstack@n-api.service[128864]: method: Aug 31 15:54:01.196158 n-d-833090-16 devstack@n-api.service[128864]: exception: floating IP not found Aug 31 15:54:01.197001 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '378220a7-113f-49e1-9bfa-3804d55260c6', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Aug 31 15:54:01.197001 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:54:01.197001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:54:01.197001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 31 15:54:01.197001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 31 15:54:01.197001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 31 15:54:01.197001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 31 15:54:01.197001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Aug 31 15:54:01.197001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Aug 31 15:54:01.197001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 31 15:54:01.197001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 31 15:54:01.197001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 31 15:54:01.197001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:54:01.197001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:54:01.197001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:54:01.197001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:54:01.197001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:54:01.197001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:54:01.197001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:54:01.199615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:54:01.199615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:54:01.199615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:54:01.199615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:54:01.199615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:54:01.199615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:54:01.199615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:54:01.199615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Aug 31 15:54:01.199615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 31 15:54:01.199615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Aug 31 15:54:01.199615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:54:01.199615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:54:01.199615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:54:01.199615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:54:01.199615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:54:01.199615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:54:01.199615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:54:01.199615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:54:01.199615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Aug 31 15:54:01.199615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:54:01.203724 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-feba032d-6e21-4f97-b82b-ea958944788c tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Returning 404 to user: floating IP not found {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:54:01.204713 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-529b74a8-221a-4137-88e6-663bb333888f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:01.206169 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-feba032d-6e21-4f97-b82b-ea958944788c tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] 10.222.0.50 "POST /compute/v2.1/servers/378220a7-113f-49e1-9bfa-3804d55260c6/action" status: 404 len: 67 microversion: 2.1 time: 0.344396 Aug 31 15:54:01.211127 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 701/1317] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 15:54:00 2022] POST /compute/v2.1/servers/378220a7-113f-49e1-9bfa-3804d55260c6/action => generated 67 bytes in 346 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 15:54:01.219266 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9531241c-a1bb-45d4-bd81-8d3e084e19d0 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Action: 'action', calling method: .version_select at 0x7fbb485aa940>, body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:54:01.221551 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-529b74a8-221a-4137-88e6-663bb333888f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09" status: 200 len: 1542 microversion: 2.1 time: 0.380036 Aug 31 15:54:01.224261 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 617/1318] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:00 2022] GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09 => generated 1542 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:01.259181 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d42cf053-a80f-4985-93c4-521c67c6593e tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:01.259671 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d42cf053-a80f-4985-93c4-521c67c6593e tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] [instance: a90bb0c5-7d56-4e38-8d78-a5c92a9976c3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:01.265948 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d42cf053-a80f-4985-93c4-521c67c6593e tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:01.266687 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d42cf053-a80f-4985-93c4-521c67c6593e tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:01.267117 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d42cf053-a80f-4985-93c4-521c67c6593e tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:01.267810 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d42cf053-a80f-4985-93c4-521c67c6593e tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:01.268267 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d42cf053-a80f-4985-93c4-521c67c6593e tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:01.268674 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d42cf053-a80f-4985-93c4-521c67c6593e tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:01.283066 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-d42cf053-a80f-4985-93c4-521c67c6593e tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] HTTP exception thrown: Instance a90bb0c5-7d56-4e38-8d78-a5c92a9976c3 could not be found. Aug 31 15:54:01.284788 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d42cf053-a80f-4985-93c4-521c67c6593e tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Request method failure captured: Aug 31 15:54:01.284788 n-d-833090-16 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3 HTTP/1.1 Aug 31 15:54:01.284788 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:54:01.284788 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:54:01.284788 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:54:01.284788 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:54:01.284788 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:54:01.284788 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:54:01.284788 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:54:01.284788 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:54:01.284788 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4N7U-PVpbl0kLWMtLgV8didI6cP-hMyAbHGO9dDZc4kAtu4x746Z7BrKA5ZNBxzrwlnJK5YcC5JrpokHkB1n2J4xueHWMLa0meSeH0I57ndiZkx4Ld3bViDB3J5inrMyEh1WKJp1hRAVcRBmXMzbxXUISR-ROX_E_JRnKusJzJK_fY Aug 31 15:54:01.284788 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:54:01.284788 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:54:01.284788 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:54:01.284788 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:54:01.284788 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:54:01.284788 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:54:01.284788 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: e1c897eb2e5b4101858807f875a8ac0e Aug 31 15:54:01.284788 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1577078678 Aug 31 15:54:01.284788 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:54:01.284788 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:54:01.286578 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e1c897eb2e5b4101858807f875a8ac0e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e1c897eb2e5b4101858807f875a8ac0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e1c897eb2e5b4101858807f875a8ac0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e1c897eb2e5b4101858807f875a8ac0e", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:54:01.286578 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1577078678 Aug 31 15:54:01.286578 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: e1c897eb2e5b4101858807f875a8ac0e Aug 31 15:54:01.286578 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1577078678 Aug 31 15:54:01.286578 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-AttachSCSIVolumeTestJSON-1577078678-project Aug 31 15:54:01.286578 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:54:01.286578 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:54:01.286578 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 39e40446741c470f92d6f60ec910d84e Aug 31 15:54:01.286578 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1577078678-project Aug 31 15:54:01.286578 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 15:54:01.286578 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance a90bb0c5-7d56-4e38-8d78-a5c92a9976c3 could not be found. Aug 31 15:54:01.286578 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'a90bb0c5-7d56-4e38-8d78-a5c92a9976c3'} Aug 31 15:54:01.287539 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:54:01.287539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:54:01.287539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:54:01.287539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:54:01.287539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:54:01.287539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:54:01.287539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:54:01.287539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:54:01.287539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:54:01.287539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:54:01.287539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a90bb0c5-7d56-4e38-8d78-a5c92a9976c3 could not be found. Aug 31 15:54:01.287539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:54:01.287539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:54:01.287539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:54:01.287539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:54:01.287539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:54:01.287539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:54:01.287539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:54:01.287539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:54:01.287539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:54:01.290250 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:54:01.290250 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 15:54:01.290250 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 15:54:01.290250 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 15:54:01.290250 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 15:54:01.290250 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:54:01.290250 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:54:01.290250 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:54:01.290250 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:54:01.290250 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a90bb0c5-7d56-4e38-8d78-a5c92a9976c3 could not be found. Aug 31 15:54:01.290250 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:54:01.290250 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:54:01.290250 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:54:01.290250 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:54:01.290250 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:54:01.290250 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:54:01.290250 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:54:01.290250 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:54:01.290250 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a90bb0c5-7d56-4e38-8d78-a5c92a9976c3 could not be found. Aug 31 15:54:01.290250 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:54:01.291904 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-9531241c-a1bb-45d4-bd81-8d3e084e19d0 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Aug 31 15:54:01.291904 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9531241c-a1bb-45d4-bd81-8d3e084e19d0 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Request method failure captured: Aug 31 15:54:01.291904 n-d-833090-16 devstack@n-api.service[128864]: request: POST /compute/v2.1/servers/378220a7-113f-49e1-9bfa-3804d55260c6/action HTTP/1.1 Aug 31 15:54:01.291904 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:54:01.291904 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:54:01.291904 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:54:01.291904 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 44 Aug 31 15:54:01.291904 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:54:01.291904 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:54:01.291904 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:54:01.291904 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:54:01.291904 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4P3e4vWl86HsSCKrwN7UgYj6fmoFiGiZaNcsOVajSsrupSvowweH3IxPnlgwZhAuMgXmGZ4AVG5C-ZHiKf0KSpTtQTOvxTEEoapPMs742UCkmNpn4sdsPiVvAVZZ_02EtsqSjbIRJKfx7yl0WXkbI0mjmOsmBQgOw6ZWHOzL9H9r7U Aug 31 15:54:01.291904 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:54:01.291904 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:54:01.291904 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:54:01.291904 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:54:01.291904 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:54:01.291904 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:54:01.291904 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 390f00bece0c42999585de9fc68e1ce0 Aug 31 15:54:01.291904 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-240143373 Aug 31 15:54:01.291904 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:54:01.291904 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:54:01.293530 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/390f00bece0c42999585de9fc68e1ce0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/390f00bece0c42999585de9fc68e1ce0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/390f00bece0c42999585de9fc68e1ce0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_390f00bece0c42999585de9fc68e1ce0", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:54:01.293530 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-240143373 Aug 31 15:54:01.293530 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 390f00bece0c42999585de9fc68e1ce0 Aug 31 15:54:01.293530 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-240143373 Aug 31 15:54:01.293530 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project Aug 31 15:54:01.293530 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:54:01.293530 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:54:01.293530 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 88494f6bd936497b88c3f50b4ffb2fd0 Aug 31 15:54:01.293530 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project Aug 31 15:54:01.293530 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 15:54:01.293530 n-d-833090-16 devstack@n-api.service[128864]: {"removeFloatingIp": {"address": "0.0.0.0"}} Aug 31 15:54:01.293530 n-d-833090-16 devstack@n-api.service[128864]: method: Aug 31 15:54:01.293530 n-d-833090-16 devstack@n-api.service[128864]: exception: Floating IP not found for address 0.0.0.0. Aug 31 15:54:01.294574 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '378220a7-113f-49e1-9bfa-3804d55260c6', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Aug 31 15:54:01.294574 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:54:01.294574 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:54:01.294574 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Aug 31 15:54:01.294574 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Aug 31 15:54:01.294574 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Aug 31 15:54:01.294574 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Aug 31 15:54:01.294574 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 31 15:54:01.294574 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 31 15:54:01.294574 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 31 15:54:01.294574 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:54:01.294574 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:54:01.294574 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:54:01.294574 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:54:01.294574 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:54:01.294574 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:54:01.294574 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:54:01.294574 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:54:01.294574 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:54:01.298578 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:54:01.298578 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:54:01.298578 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:54:01.298578 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:54:01.298578 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:54:01.298578 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Aug 31 15:54:01.298578 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Aug 31 15:54:01.298578 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Aug 31 15:54:01.298578 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Aug 31 15:54:01.298578 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Aug 31 15:54:01.298578 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:54:01.298578 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:54:01.298578 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:54:01.298578 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:54:01.298578 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:54:01.298578 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:54:01.298578 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:54:01.298578 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:54:01.298578 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Aug 31 15:54:01.298578 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:54:01.300178 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9531241c-a1bb-45d4-bd81-8d3e084e19d0 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:54:01.300178 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9531241c-a1bb-45d4-bd81-8d3e084e19d0 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] 10.222.0.50 "POST /compute/v2.1/servers/378220a7-113f-49e1-9bfa-3804d55260c6/action" status: 404 len: 88 microversion: 2.1 time: 0.079690 Aug 31 15:54:01.300178 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 702/1319] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 15:54:01 2022] POST /compute/v2.1/servers/378220a7-113f-49e1-9bfa-3804d55260c6/action => generated 88 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 15:54:01.302779 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d42cf053-a80f-4985-93c4-521c67c6593e tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Returning 404 to user: Instance a90bb0c5-7d56-4e38-8d78-a5c92a9976c3 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:54:01.302779 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d42cf053-a80f-4985-93c4-521c67c6593e tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3" status: 404 len: 111 microversion: 2.1 time: 0.039070 Aug 31 15:54:01.302779 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 618/1320] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:54:01 2022] DELETE /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 15:54:01.304106 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5a514019-22d0-4f3d-b359-0ccf2e7c0907 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:01.304721 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5a514019-22d0-4f3d-b359-0ccf2e7c0907 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] [instance: a90bb0c5-7d56-4e38-8d78-a5c92a9976c3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:01.306823 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d78e53c7-7c3d-44a7-9f54-d61b442962ba tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:01.307528 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d78e53c7-7c3d-44a7-9f54-d61b442962ba tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] [instance: 378220a7-113f-49e1-9bfa-3804d55260c6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:01.312111 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a514019-22d0-4f3d-b359-0ccf2e7c0907 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:01.312634 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a514019-22d0-4f3d-b359-0ccf2e7c0907 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:01.313100 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a514019-22d0-4f3d-b359-0ccf2e7c0907 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:01.314544 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a514019-22d0-4f3d-b359-0ccf2e7c0907 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:01.315029 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a514019-22d0-4f3d-b359-0ccf2e7c0907 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:01.315422 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a514019-22d0-4f3d-b359-0ccf2e7c0907 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:01.317155 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d78e53c7-7c3d-44a7-9f54-d61b442962ba tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:01.318003 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d78e53c7-7c3d-44a7-9f54-d61b442962ba tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:01.318678 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d78e53c7-7c3d-44a7-9f54-d61b442962ba tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:01.320773 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d78e53c7-7c3d-44a7-9f54-d61b442962ba tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:01.321428 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d78e53c7-7c3d-44a7-9f54-d61b442962ba tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:01.322043 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d78e53c7-7c3d-44a7-9f54-d61b442962ba tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:01.330712 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-5a514019-22d0-4f3d-b359-0ccf2e7c0907 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] HTTP exception thrown: Instance a90bb0c5-7d56-4e38-8d78-a5c92a9976c3 could not be found. Aug 31 15:54:01.332289 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5a514019-22d0-4f3d-b359-0ccf2e7c0907 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Request method failure captured: Aug 31 15:54:01.332289 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3 HTTP/1.1 Aug 31 15:54:01.332289 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:54:01.332289 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:54:01.332289 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:54:01.332289 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:54:01.332289 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:54:01.332289 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:54:01.332289 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:54:01.332289 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:54:01.332289 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4N7U-PVpbl0kLWMtLgV8didI6cP-hMyAbHGO9dDZc4kAtu4x746Z7BrKA5ZNBxzrwlnJK5YcC5JrpokHkB1n2J4xueHWMLa0meSeH0I57ndiZkx4Ld3bViDB3J5inrMyEh1WKJp1hRAVcRBmXMzbxXUISR-ROX_E_JRnKusJzJK_fY Aug 31 15:54:01.332289 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:54:01.332289 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:54:01.332289 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:54:01.332289 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:54:01.332289 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:54:01.332289 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:54:01.332289 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: e1c897eb2e5b4101858807f875a8ac0e Aug 31 15:54:01.332289 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1577078678 Aug 31 15:54:01.332289 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:54:01.332289 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:54:01.333644 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e1c897eb2e5b4101858807f875a8ac0e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e1c897eb2e5b4101858807f875a8ac0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e1c897eb2e5b4101858807f875a8ac0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e1c897eb2e5b4101858807f875a8ac0e", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:54:01.333644 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1577078678 Aug 31 15:54:01.333644 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: e1c897eb2e5b4101858807f875a8ac0e Aug 31 15:54:01.333644 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1577078678 Aug 31 15:54:01.333644 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-AttachSCSIVolumeTestJSON-1577078678-project Aug 31 15:54:01.333644 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:54:01.333644 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:54:01.333644 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 39e40446741c470f92d6f60ec910d84e Aug 31 15:54:01.333644 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1577078678-project Aug 31 15:54:01.333644 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 15:54:01.333644 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance a90bb0c5-7d56-4e38-8d78-a5c92a9976c3 could not be found. Aug 31 15:54:01.333644 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'a90bb0c5-7d56-4e38-8d78-a5c92a9976c3'} Aug 31 15:54:01.334453 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:54:01.334453 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:54:01.334453 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:54:01.334453 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:54:01.334453 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:54:01.334453 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:54:01.334453 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:54:01.334453 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:54:01.334453 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:54:01.334453 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:54:01.334453 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a90bb0c5-7d56-4e38-8d78-a5c92a9976c3 could not be found. Aug 31 15:54:01.334453 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:54:01.334453 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:54:01.334453 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:54:01.334453 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:54:01.334453 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:54:01.334453 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:54:01.334453 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:54:01.334453 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:54:01.334453 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:54:01.335665 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:54:01.335665 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:54:01.335665 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:54:01.335665 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:54:01.335665 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:54:01.335665 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:54:01.335665 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:54:01.335665 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a90bb0c5-7d56-4e38-8d78-a5c92a9976c3 could not be found. Aug 31 15:54:01.335665 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:54:01.335665 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:54:01.335665 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:54:01.335665 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:54:01.335665 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:54:01.335665 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:54:01.335665 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:54:01.335665 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:54:01.335665 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a90bb0c5-7d56-4e38-8d78-a5c92a9976c3 could not be found. Aug 31 15:54:01.335665 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:54:01.336847 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5a514019-22d0-4f3d-b359-0ccf2e7c0907 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] Returning 404 to user: Instance a90bb0c5-7d56-4e38-8d78-a5c92a9976c3 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:54:01.336847 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5a514019-22d0-4f3d-b359-0ccf2e7c0907 tempest-AttachSCSIVolumeTestJSON-1577078678 tempest-AttachSCSIVolumeTestJSON-1577078678-project] 10.222.0.50 "GET /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3" status: 404 len: 111 microversion: 2.1 time: 0.033504 Aug 31 15:54:01.337898 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 619/1321] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:01 2022] GET /compute/v2.1/servers/a90bb0c5-7d56-4e38-8d78-a5c92a9976c3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:54:01.351761 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d78e53c7-7c3d-44a7-9f54-d61b442962ba tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] [instance: 378220a7-113f-49e1-9bfa-3804d55260c6] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:54:01.386742 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c3d4c5ea-8ce1-4c85-a7f6-d31f5ef9a0bb tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:01.387630 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c3d4c5ea-8ce1-4c85-a7f6-d31f5ef9a0bb tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] [instance: e4a38af3-ba7d-4074-a628-9c7825ae3358] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:01.394334 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3d4c5ea-8ce1-4c85-a7f6-d31f5ef9a0bb tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:01.394857 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3d4c5ea-8ce1-4c85-a7f6-d31f5ef9a0bb tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:01.395279 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3d4c5ea-8ce1-4c85-a7f6-d31f5ef9a0bb tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:01.396107 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3d4c5ea-8ce1-4c85-a7f6-d31f5ef9a0bb tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:01.396531 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3d4c5ea-8ce1-4c85-a7f6-d31f5ef9a0bb tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:01.396991 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3d4c5ea-8ce1-4c85-a7f6-d31f5ef9a0bb tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:01.458219 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d78e53c7-7c3d-44a7-9f54-d61b442962ba tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] 10.222.0.50 "DELETE /compute/v2.1/servers/378220a7-113f-49e1-9bfa-3804d55260c6" status: 204 len: 0 microversion: 2.1 time: 0.159553 Aug 31 15:54:01.460390 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 703/1322] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:54:01 2022] DELETE /compute/v2.1/servers/378220a7-113f-49e1-9bfa-3804d55260c6 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:54:01.474641 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-402859e9-fa5b-4d7d-93ca-52416455e844 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:01.475830 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-402859e9-fa5b-4d7d-93ca-52416455e844 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] [instance: 378220a7-113f-49e1-9bfa-3804d55260c6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:01.484195 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-402859e9-fa5b-4d7d-93ca-52416455e844 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:01.485094 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-402859e9-fa5b-4d7d-93ca-52416455e844 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:01.485785 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-402859e9-fa5b-4d7d-93ca-52416455e844 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:01.486716 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-402859e9-fa5b-4d7d-93ca-52416455e844 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:01.487628 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-402859e9-fa5b-4d7d-93ca-52416455e844 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:01.489915 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-402859e9-fa5b-4d7d-93ca-52416455e844 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:01.644414 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c3d4c5ea-8ce1-4c85-a7f6-d31f5ef9a0bb tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048bcefe0af04bc6a3a2995b22cbe43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87fc33005b5440098daf798066a653f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:01.653717 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c3d4c5ea-8ce1-4c85-a7f6-d31f5ef9a0bb tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] 10.222.0.50 "GET /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358" status: 200 len: 1355 microversion: 2.1 time: 0.270768 Aug 31 15:54:01.654498 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 620/1323] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:01 2022] GET /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358 => generated 1355 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:54:01.659632 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b5861bcb-5c74-4454-8edc-4b46c4c2aeee tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:01.660444 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b5861bcb-5c74-4454-8edc-4b46c4c2aeee tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] [instance: e803dd93-0c39-49a2-9bca-92bf0a789290] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:01.667773 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5861bcb-5c74-4454-8edc-4b46c4c2aeee tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:01.668280 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5861bcb-5c74-4454-8edc-4b46c4c2aeee tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:01.668861 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5861bcb-5c74-4454-8edc-4b46c4c2aeee tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:01.669613 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5861bcb-5c74-4454-8edc-4b46c4c2aeee tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:01.670792 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5861bcb-5c74-4454-8edc-4b46c4c2aeee tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:01.671280 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5861bcb-5c74-4454-8edc-4b46c4c2aeee tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:01.693983 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-402859e9-fa5b-4d7d-93ca-52416455e844 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88494f6bd936497b88c3f50b4ffb2fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390f00bece0c42999585de9fc68e1ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:01.701978 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-402859e9-fa5b-4d7d-93ca-52416455e844 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] 10.222.0.50 "GET /compute/v2.1/servers/378220a7-113f-49e1-9bfa-3804d55260c6" status: 200 len: 1542 microversion: 2.1 time: 0.236649 Aug 31 15:54:01.702784 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 704/1324] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:01 2022] GET /compute/v2.1/servers/378220a7-113f-49e1-9bfa-3804d55260c6 => generated 1542 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:01.739252 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b5861bcb-5c74-4454-8edc-4b46c4c2aeee tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:01.748372 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b5861bcb-5c74-4454-8edc-4b46c4c2aeee tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:01.750603 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b5861bcb-5c74-4454-8edc-4b46c4c2aeee tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:01.752188 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b5861bcb-5c74-4454-8edc-4b46c4c2aeee tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] 10.222.0.50 "GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290" status: 200 len: 1366 microversion: 2.57 time: 0.096474 Aug 31 15:54:01.752836 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 621/1325] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:54:01 2022] GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290 => generated 1366 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:54:01.816838 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c5685952-34e5-45e0-bb86-44b68bd74c0f tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:01.817462 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c5685952-34e5-45e0-bb86-44b68bd74c0f tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] [instance: 0442e1d9-fa54-4957-8313-335c0f39c763] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:01.824542 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c5685952-34e5-45e0-bb86-44b68bd74c0f tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:01.825278 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c5685952-34e5-45e0-bb86-44b68bd74c0f tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:01.825774 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c5685952-34e5-45e0-bb86-44b68bd74c0f tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:01.826767 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c5685952-34e5-45e0-bb86-44b68bd74c0f tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:01.827297 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c5685952-34e5-45e0-bb86-44b68bd74c0f tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:01.828039 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c5685952-34e5-45e0-bb86-44b68bd74c0f tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:01.893331 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c5685952-34e5-45e0-bb86-44b68bd74c0f tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0578b42db80943249238958e5fce15f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45d2345cb0e4847964e67928ab3069b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:01.901238 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c5685952-34e5-45e0-bb86-44b68bd74c0f tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "GET /compute/v2.1/servers/0442e1d9-fa54-4957-8313-335c0f39c763" status: 200 len: 1277 microversion: 2.1 time: 0.088297 Aug 31 15:54:01.902149 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 705/1326] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:01 2022] GET /compute/v2.1/servers/0442e1d9-fa54-4957-8313-335c0f39c763 => generated 1277 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:02.249128 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9493af1e-3fa8-4adc-867c-51755f7b826b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:02.249718 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9493af1e-3fa8-4adc-867c-51755f7b826b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 04a4f94b-5820-4bbe-a9b0-7fa55a697e09] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:02.256849 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9493af1e-3fa8-4adc-867c-51755f7b826b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:02.257692 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9493af1e-3fa8-4adc-867c-51755f7b826b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:02.258662 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9493af1e-3fa8-4adc-867c-51755f7b826b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:02.259378 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9493af1e-3fa8-4adc-867c-51755f7b826b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:02.259830 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9493af1e-3fa8-4adc-867c-51755f7b826b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:02.260480 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9493af1e-3fa8-4adc-867c-51755f7b826b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:02.409920 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9493af1e-3fa8-4adc-867c-51755f7b826b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:02.418435 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9493af1e-3fa8-4adc-867c-51755f7b826b tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09" status: 200 len: 1541 microversion: 2.1 time: 0.173173 Aug 31 15:54:02.419118 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 622/1327] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:02 2022] GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09 => generated 1541 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:02.675865 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-31acf404-5405-4128-b871-649fc0114abe tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:02.676596 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-31acf404-5405-4128-b871-649fc0114abe tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] [instance: e4a38af3-ba7d-4074-a628-9c7825ae3358] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:02.684809 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-31acf404-5405-4128-b871-649fc0114abe tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:02.685300 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-31acf404-5405-4128-b871-649fc0114abe tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:02.686258 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-31acf404-5405-4128-b871-649fc0114abe tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:02.687180 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-31acf404-5405-4128-b871-649fc0114abe tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:02.687796 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-31acf404-5405-4128-b871-649fc0114abe tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:02.688890 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-31acf404-5405-4128-b871-649fc0114abe tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:02.723980 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-27f571da-2a58-4107-826e-058f29ed7916 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:02.725087 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-27f571da-2a58-4107-826e-058f29ed7916 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] [instance: 378220a7-113f-49e1-9bfa-3804d55260c6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:02.731688 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27f571da-2a58-4107-826e-058f29ed7916 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:02.732161 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27f571da-2a58-4107-826e-058f29ed7916 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:02.732781 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27f571da-2a58-4107-826e-058f29ed7916 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:02.733481 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27f571da-2a58-4107-826e-058f29ed7916 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:02.733930 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27f571da-2a58-4107-826e-058f29ed7916 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:02.734410 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27f571da-2a58-4107-826e-058f29ed7916 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:03.023103 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-31acf404-5405-4128-b871-649fc0114abe tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048bcefe0af04bc6a3a2995b22cbe43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87fc33005b5440098daf798066a653f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:03.043223 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-27f571da-2a58-4107-826e-058f29ed7916 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88494f6bd936497b88c3f50b4ffb2fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390f00bece0c42999585de9fc68e1ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:03.047955 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-31acf404-5405-4128-b871-649fc0114abe tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] 10.222.0.50 "GET /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358" status: 200 len: 1355 microversion: 2.1 time: 0.365695 Aug 31 15:54:03.052784 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 706/1328] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:02 2022] GET /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358 => generated 1355 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:03.060637 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-27f571da-2a58-4107-826e-058f29ed7916 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] 10.222.0.50 "GET /compute/v2.1/servers/378220a7-113f-49e1-9bfa-3804d55260c6" status: 200 len: 1542 microversion: 2.1 time: 0.340650 Aug 31 15:54:03.061476 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 623/1329] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:02 2022] GET /compute/v2.1/servers/378220a7-113f-49e1-9bfa-3804d55260c6 => generated 1542 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:54:03.073543 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-55e7de4e-5c38-4e81-900a-36fe87725909 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:03.073949 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8340f5ff-62d8-4571-bb11-d16473c89d11 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:03.074679 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8340f5ff-62d8-4571-bb11-d16473c89d11 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] [instance: e803dd93-0c39-49a2-9bca-92bf0a789290] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:03.074966 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-55e7de4e-5c38-4e81-900a-36fe87725909 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] [instance: 0442e1d9-fa54-4957-8313-335c0f39c763] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:03.085733 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-55e7de4e-5c38-4e81-900a-36fe87725909 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:03.089192 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-55e7de4e-5c38-4e81-900a-36fe87725909 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:03.089635 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8340f5ff-62d8-4571-bb11-d16473c89d11 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:03.090121 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-55e7de4e-5c38-4e81-900a-36fe87725909 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:03.090953 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8340f5ff-62d8-4571-bb11-d16473c89d11 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:03.091554 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8340f5ff-62d8-4571-bb11-d16473c89d11 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:03.093198 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8340f5ff-62d8-4571-bb11-d16473c89d11 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:03.093823 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-55e7de4e-5c38-4e81-900a-36fe87725909 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:03.094430 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-55e7de4e-5c38-4e81-900a-36fe87725909 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:03.094913 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8340f5ff-62d8-4571-bb11-d16473c89d11 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:03.095724 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-55e7de4e-5c38-4e81-900a-36fe87725909 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:03.096030 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8340f5ff-62d8-4571-bb11-d16473c89d11 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:03.225197 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-55e7de4e-5c38-4e81-900a-36fe87725909 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0578b42db80943249238958e5fce15f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45d2345cb0e4847964e67928ab3069b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:03.228595 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8340f5ff-62d8-4571-bb11-d16473c89d11 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:03.243033 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:54:03.245827 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-55e7de4e-5c38-4e81-900a-36fe87725909 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "GET /compute/v2.1/servers/0442e1d9-fa54-4957-8313-335c0f39c763" status: 200 len: 1275 microversion: 2.1 time: 0.177558 Aug 31 15:54:03.247268 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8340f5ff-62d8-4571-bb11-d16473c89d11 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:03.248906 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8340f5ff-62d8-4571-bb11-d16473c89d11 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:03.250126 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 707/1330] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:03 2022] GET /compute/v2.1/servers/0442e1d9-fa54-4957-8313-335c0f39c763 => generated 1275 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:03.251674 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8340f5ff-62d8-4571-bb11-d16473c89d11 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] 10.222.0.50 "GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290" status: 200 len: 1366 microversion: 2.57 time: 0.187846 Aug 31 15:54:03.267037 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 624/1331] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:54:03 2022] GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290 => generated 1366 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:54:03.441677 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c675101c-6815-4598-9dda-8cd76a73e750 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:03.442673 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c675101c-6815-4598-9dda-8cd76a73e750 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 04a4f94b-5820-4bbe-a9b0-7fa55a697e09] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:03.450159 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c675101c-6815-4598-9dda-8cd76a73e750 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:03.450823 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c675101c-6815-4598-9dda-8cd76a73e750 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:03.451941 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c675101c-6815-4598-9dda-8cd76a73e750 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:03.451941 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c675101c-6815-4598-9dda-8cd76a73e750 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:03.452401 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c675101c-6815-4598-9dda-8cd76a73e750 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:03.453498 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c675101c-6815-4598-9dda-8cd76a73e750 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:03.730938 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c675101c-6815-4598-9dda-8cd76a73e750 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:03.740005 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c675101c-6815-4598-9dda-8cd76a73e750 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09" status: 200 len: 1541 microversion: 2.1 time: 0.303303 Aug 31 15:54:03.741205 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 708/1332] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:03 2022] GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09 => generated 1541 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:03.765147 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-22854ad0-3fa2-41cb-968e-833ec35afcc4 req-97a38b02-9ce7-4981-b312-137109c54ca9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "378220a7-113f-49e1-9bfa-3804d55260c6", "name": "network-vif-deleted", "tag": "7f87d1ce-41ae-4d7a-8907-6f24a3691eed"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:54:03.789489 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:54:03.792099 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-22854ad0-3fa2-41cb-968e-833ec35afcc4 req-97a38b02-9ce7-4981-b312-137109c54ca9 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:03.792829 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-22854ad0-3fa2-41cb-968e-833ec35afcc4 req-97a38b02-9ce7-4981-b312-137109c54ca9 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:03.793413 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-22854ad0-3fa2-41cb-968e-833ec35afcc4 req-97a38b02-9ce7-4981-b312-137109c54ca9 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:03.811569 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-22854ad0-3fa2-41cb-968e-833ec35afcc4 req-97a38b02-9ce7-4981-b312-137109c54ca9 service nova] Creating event network-vif-deleted:7f87d1ce-41ae-4d7a-8907-6f24a3691eed for instance 378220a7-113f-49e1-9bfa-3804d55260c6 on n-h1-833090-16 Aug 31 15:54:03.836039 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-22854ad0-3fa2-41cb-968e-833ec35afcc4 req-97a38b02-9ce7-4981-b312-137109c54ca9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074367 Aug 31 15:54:03.838760 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 625/1333] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:54:04.074918 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-87c39c41-720f-4dcf-8617-85dc60edc1f7 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:04.076345 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-87c39c41-720f-4dcf-8617-85dc60edc1f7 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] [instance: e4a38af3-ba7d-4074-a628-9c7825ae3358] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:04.088250 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fe8def7e-3da0-48be-89ce-0836b5a50de8 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:04.089452 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fe8def7e-3da0-48be-89ce-0836b5a50de8 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] [instance: 378220a7-113f-49e1-9bfa-3804d55260c6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:04.093526 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-87c39c41-720f-4dcf-8617-85dc60edc1f7 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:04.098841 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-87c39c41-720f-4dcf-8617-85dc60edc1f7 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:04.100803 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-87c39c41-720f-4dcf-8617-85dc60edc1f7 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:04.105676 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-87c39c41-720f-4dcf-8617-85dc60edc1f7 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:04.106715 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-87c39c41-720f-4dcf-8617-85dc60edc1f7 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:04.107480 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-87c39c41-720f-4dcf-8617-85dc60edc1f7 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:04.128187 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe8def7e-3da0-48be-89ce-0836b5a50de8 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:04.131202 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe8def7e-3da0-48be-89ce-0836b5a50de8 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:04.136015 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe8def7e-3da0-48be-89ce-0836b5a50de8 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:04.143870 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe8def7e-3da0-48be-89ce-0836b5a50de8 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:04.146378 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe8def7e-3da0-48be-89ce-0836b5a50de8 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:04.150879 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe8def7e-3da0-48be-89ce-0836b5a50de8 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:04.244637 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe8def7e-3da0-48be-89ce-0836b5a50de8 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:04.245115 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe8def7e-3da0-48be-89ce-0836b5a50de8 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:04.245737 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe8def7e-3da0-48be-89ce-0836b5a50de8 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:04.246462 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-fe8def7e-3da0-48be-89ce-0836b5a50de8 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lazy-loading 'fault' on Instance uuid 378220a7-113f-49e1-9bfa-3804d55260c6 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:54:04.250313 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:54:04.544435 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fe8def7e-3da0-48be-89ce-0836b5a50de8 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88494f6bd936497b88c3f50b4ffb2fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '390f00bece0c42999585de9fc68e1ce0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:04.560467 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fe8def7e-3da0-48be-89ce-0836b5a50de8 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] 10.222.0.50 "GET /compute/v2.1/servers/378220a7-113f-49e1-9bfa-3804d55260c6" status: 200 len: 1322 microversion: 2.1 time: 0.475375 Aug 31 15:54:04.561492 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 626/1334] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:04 2022] GET /compute/v2.1/servers/378220a7-113f-49e1-9bfa-3804d55260c6 => generated 1322 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:04.574073 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a5545675-18c4-4558-80c0-b61902fe6aef tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:04.575103 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a5545675-18c4-4558-80c0-b61902fe6aef tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] [instance: 0442e1d9-fa54-4957-8313-335c0f39c763] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:04.589159 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5545675-18c4-4558-80c0-b61902fe6aef tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:04.592552 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5545675-18c4-4558-80c0-b61902fe6aef tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:04.593911 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5545675-18c4-4558-80c0-b61902fe6aef tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:04.596469 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5545675-18c4-4558-80c0-b61902fe6aef tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:04.597462 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5545675-18c4-4558-80c0-b61902fe6aef tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:04.599608 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5545675-18c4-4558-80c0-b61902fe6aef tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:04.700521 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-87c39c41-720f-4dcf-8617-85dc60edc1f7 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048bcefe0af04bc6a3a2995b22cbe43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87fc33005b5440098daf798066a653f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:04.712424 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-87c39c41-720f-4dcf-8617-85dc60edc1f7 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] 10.222.0.50 "GET /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358" status: 200 len: 1355 microversion: 2.1 time: 0.641758 Aug 31 15:54:04.726131 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 709/1335] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:04 2022] GET /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358 => generated 1355 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:04.726131 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-404dadd8-9229-441a-8f4e-0a61158e4809 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:04.727257 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-404dadd8-9229-441a-8f4e-0a61158e4809 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] [instance: e803dd93-0c39-49a2-9bca-92bf0a789290] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:04.735824 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-404dadd8-9229-441a-8f4e-0a61158e4809 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:04.736597 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-404dadd8-9229-441a-8f4e-0a61158e4809 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:04.737336 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-404dadd8-9229-441a-8f4e-0a61158e4809 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:04.738303 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-404dadd8-9229-441a-8f4e-0a61158e4809 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:04.739249 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-404dadd8-9229-441a-8f4e-0a61158e4809 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:04.740018 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-404dadd8-9229-441a-8f4e-0a61158e4809 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:04.917033 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-404dadd8-9229-441a-8f4e-0a61158e4809 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:04.926557 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-404dadd8-9229-441a-8f4e-0a61158e4809 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:04.928324 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-404dadd8-9229-441a-8f4e-0a61158e4809 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:04.930290 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-404dadd8-9229-441a-8f4e-0a61158e4809 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] 10.222.0.50 "GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290" status: 200 len: 1366 microversion: 2.57 time: 0.213976 Aug 31 15:54:04.931380 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 710/1336] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:54:04 2022] GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290 => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:54:04.936500 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2c12cd31-1793-46d8-8d1c-25d7dbf713e8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:04.937092 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2c12cd31-1793-46d8-8d1c-25d7dbf713e8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 04a4f94b-5820-4bbe-a9b0-7fa55a697e09] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:04.949652 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2c12cd31-1793-46d8-8d1c-25d7dbf713e8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:04.950563 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2c12cd31-1793-46d8-8d1c-25d7dbf713e8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:04.953134 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2c12cd31-1793-46d8-8d1c-25d7dbf713e8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:04.954532 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2c12cd31-1793-46d8-8d1c-25d7dbf713e8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:04.955449 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2c12cd31-1793-46d8-8d1c-25d7dbf713e8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:04.956258 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2c12cd31-1793-46d8-8d1c-25d7dbf713e8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:05.460613 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a5545675-18c4-4558-80c0-b61902fe6aef tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0578b42db80943249238958e5fce15f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45d2345cb0e4847964e67928ab3069b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:05.498212 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a5545675-18c4-4558-80c0-b61902fe6aef tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "GET /compute/v2.1/servers/0442e1d9-fa54-4957-8313-335c0f39c763" status: 200 len: 1317 microversion: 2.1 time: 0.934556 Aug 31 15:54:05.499061 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 627/1337] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:04 2022] GET /compute/v2.1/servers/0442e1d9-fa54-4957-8313-335c0f39c763 => generated 1317 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:05.584210 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-afa82894-53b7-417a-a5e2-8428ada91b50 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:05.586065 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-afa82894-53b7-417a-a5e2-8428ada91b50 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] [instance: 378220a7-113f-49e1-9bfa-3804d55260c6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:05.593267 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-afa82894-53b7-417a-a5e2-8428ada91b50 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:05.593986 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-afa82894-53b7-417a-a5e2-8428ada91b50 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:05.594618 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-afa82894-53b7-417a-a5e2-8428ada91b50 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:05.595814 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-afa82894-53b7-417a-a5e2-8428ada91b50 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:05.596425 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-afa82894-53b7-417a-a5e2-8428ada91b50 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:05.598111 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-afa82894-53b7-417a-a5e2-8428ada91b50 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:05.609158 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2c12cd31-1793-46d8-8d1c-25d7dbf713e8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:05.615369 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-afa82894-53b7-417a-a5e2-8428ada91b50 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] HTTP exception thrown: Instance 378220a7-113f-49e1-9bfa-3804d55260c6 could not be found. Aug 31 15:54:05.617405 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-afa82894-53b7-417a-a5e2-8428ada91b50 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Request method failure captured: Aug 31 15:54:05.617405 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/378220a7-113f-49e1-9bfa-3804d55260c6 HTTP/1.1 Aug 31 15:54:05.617405 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:54:05.617405 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:54:05.617405 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:54:05.617405 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:54:05.617405 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:54:05.617405 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:54:05.617405 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:54:05.617405 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:54:05.617405 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4P3e4vWl86HsSCKrwN7UgYj6fmoFiGiZaNcsOVajSsrupSvowweH3IxPnlgwZhAuMgXmGZ4AVG5C-ZHiKf0KSpTtQTOvxTEEoapPMs742UCkmNpn4sdsPiVvAVZZ_02EtsqSjbIRJKfx7yl0WXkbI0mjmOsmBQgOw6ZWHOzL9H9r7U Aug 31 15:54:05.617405 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:54:05.617405 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:54:05.617405 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:54:05.617405 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:54:05.617405 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:54:05.617405 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:54:05.617405 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 390f00bece0c42999585de9fc68e1ce0 Aug 31 15:54:05.617405 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-240143373 Aug 31 15:54:05.617405 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:54:05.617405 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:54:05.619144 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/390f00bece0c42999585de9fc68e1ce0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/390f00bece0c42999585de9fc68e1ce0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/390f00bece0c42999585de9fc68e1ce0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_390f00bece0c42999585de9fc68e1ce0", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:54:05.619144 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-240143373 Aug 31 15:54:05.619144 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 390f00bece0c42999585de9fc68e1ce0 Aug 31 15:54:05.619144 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-240143373 Aug 31 15:54:05.619144 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project Aug 31 15:54:05.619144 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:54:05.619144 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:54:05.619144 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 88494f6bd936497b88c3f50b4ffb2fd0 Aug 31 15:54:05.619144 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project Aug 31 15:54:05.619144 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 15:54:05.619144 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 378220a7-113f-49e1-9bfa-3804d55260c6 could not be found. Aug 31 15:54:05.620003 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '378220a7-113f-49e1-9bfa-3804d55260c6'} Aug 31 15:54:05.620003 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:54:05.620003 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:54:05.620003 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:54:05.620003 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:54:05.620003 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:54:05.620003 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:54:05.620003 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:54:05.620003 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:54:05.620003 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:54:05.620003 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:54:05.620003 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 378220a7-113f-49e1-9bfa-3804d55260c6 could not be found. Aug 31 15:54:05.620003 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:54:05.620003 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:54:05.620003 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:54:05.620003 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:54:05.620003 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:54:05.620003 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:54:05.620003 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:54:05.620003 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:54:05.621542 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:54:05.621542 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:54:05.621542 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:54:05.621542 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:54:05.621542 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:54:05.621542 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:54:05.621542 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:54:05.621542 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:54:05.621542 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 378220a7-113f-49e1-9bfa-3804d55260c6 could not be found. Aug 31 15:54:05.621542 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:54:05.621542 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:54:05.621542 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:54:05.621542 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:54:05.621542 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:54:05.621542 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:54:05.621542 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:54:05.621542 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:54:05.621542 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 378220a7-113f-49e1-9bfa-3804d55260c6 could not be found. Aug 31 15:54:05.621542 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:54:05.623982 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2c12cd31-1793-46d8-8d1c-25d7dbf713e8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09" status: 200 len: 1541 microversion: 2.1 time: 0.691280 Aug 31 15:54:05.624250 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-afa82894-53b7-417a-a5e2-8428ada91b50 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] Returning 404 to user: Instance 378220a7-113f-49e1-9bfa-3804d55260c6 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:54:05.625314 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-afa82894-53b7-417a-a5e2-8428ada91b50 tempest-FloatingIPsAssociationNegativeTestJSON-240143373 tempest-FloatingIPsAssociationNegativeTestJSON-240143373-project] 10.222.0.50 "GET /compute/v2.1/servers/378220a7-113f-49e1-9bfa-3804d55260c6" status: 404 len: 111 microversion: 2.1 time: 0.045270 Aug 31 15:54:05.626414 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 628/1338] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:05 2022] GET /compute/v2.1/servers/378220a7-113f-49e1-9bfa-3804d55260c6 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:54:05.629590 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 711/1339] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:04 2022] GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09 => generated 1541 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:05.733823 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f9fdb5dc-5a25-41fe-8bf2-64f6ea6f3be5 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:05.735220 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f9fdb5dc-5a25-41fe-8bf2-64f6ea6f3be5 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] [instance: e4a38af3-ba7d-4074-a628-9c7825ae3358] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:05.743199 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9fdb5dc-5a25-41fe-8bf2-64f6ea6f3be5 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:05.744269 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9fdb5dc-5a25-41fe-8bf2-64f6ea6f3be5 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:05.744892 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9fdb5dc-5a25-41fe-8bf2-64f6ea6f3be5 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:05.745760 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9fdb5dc-5a25-41fe-8bf2-64f6ea6f3be5 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:05.746391 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9fdb5dc-5a25-41fe-8bf2-64f6ea6f3be5 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:05.746966 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9fdb5dc-5a25-41fe-8bf2-64f6ea6f3be5 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:05.961112 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-abd275e5-0adf-4254-897c-e0c64ac423dc tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:05.967004 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-abd275e5-0adf-4254-897c-e0c64ac423dc tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] [instance: e803dd93-0c39-49a2-9bca-92bf0a789290] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:05.977070 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-abd275e5-0adf-4254-897c-e0c64ac423dc tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:05.977782 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-abd275e5-0adf-4254-897c-e0c64ac423dc tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:05.978407 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-abd275e5-0adf-4254-897c-e0c64ac423dc tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:05.979504 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-abd275e5-0adf-4254-897c-e0c64ac423dc tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:05.980138 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-abd275e5-0adf-4254-897c-e0c64ac423dc tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:05.980737 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-abd275e5-0adf-4254-897c-e0c64ac423dc tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:06.094917 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-abd275e5-0adf-4254-897c-e0c64ac423dc tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:06.106476 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-abd275e5-0adf-4254-897c-e0c64ac423dc tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:06.108650 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-abd275e5-0adf-4254-897c-e0c64ac423dc tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:06.110594 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-abd275e5-0adf-4254-897c-e0c64ac423dc tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] 10.222.0.50 "GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290" status: 200 len: 1366 microversion: 2.57 time: 0.158295 Aug 31 15:54:06.118375 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 712/1340] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:54:05 2022] GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:54:06.122061 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f9fdb5dc-5a25-41fe-8bf2-64f6ea6f3be5 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048bcefe0af04bc6a3a2995b22cbe43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87fc33005b5440098daf798066a653f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:06.130311 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f9fdb5dc-5a25-41fe-8bf2-64f6ea6f3be5 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] 10.222.0.50 "GET /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358" status: 200 len: 1355 microversion: 2.1 time: 0.400260 Aug 31 15:54:06.130862 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 629/1341] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:05 2022] GET /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358 => generated 1355 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:06.190631 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-ab5e831f-95c4-40ce-ad37-d16cbdcfd32d req-7dc48de3-d05a-40c1-a6af-6e72075e19db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04a4f94b-5820-4bbe-a9b0-7fa55a697e09", "name": "network-vif-unplugged", "status": "completed", "tag": "f57c1856-6065-432f-b1a1-14b1ca0672d2"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:54:06.201885 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-ab5e831f-95c4-40ce-ad37-d16cbdcfd32d req-7dc48de3-d05a-40c1-a6af-6e72075e19db service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:06.202644 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-ab5e831f-95c4-40ce-ad37-d16cbdcfd32d req-7dc48de3-d05a-40c1-a6af-6e72075e19db service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:06.203304 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-ab5e831f-95c4-40ce-ad37-d16cbdcfd32d req-7dc48de3-d05a-40c1-a6af-6e72075e19db service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:06.216784 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-ab5e831f-95c4-40ce-ad37-d16cbdcfd32d req-7dc48de3-d05a-40c1-a6af-6e72075e19db service nova] Creating event network-vif-unplugged:f57c1856-6065-432f-b1a1-14b1ca0672d2 for instance 04a4f94b-5820-4bbe-a9b0-7fa55a697e09 on n-h2-833090-16 Aug 31 15:54:06.224342 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [req-ab5e831f-95c4-40ce-ad37-d16cbdcfd32d req-7dc48de3-d05a-40c1-a6af-6e72075e19db service nova] Instance 04a4f94b-5820-4bbe-a9b0-7fa55a697e09 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-833090-16', 'n-h1-833090-16'} {{(pid=128864) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 15:54:06.238168 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-ab5e831f-95c4-40ce-ad37-d16cbdcfd32d req-7dc48de3-d05a-40c1-a6af-6e72075e19db service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051984 Aug 31 15:54:06.239181 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 713/1342] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:54:06.519918 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bcaa68e7-1aac-43e0-9314-0b7e5854bd2e tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:06.521102 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bcaa68e7-1aac-43e0-9314-0b7e5854bd2e tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] [instance: 0442e1d9-fa54-4957-8313-335c0f39c763] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:06.528037 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bcaa68e7-1aac-43e0-9314-0b7e5854bd2e tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:06.528621 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bcaa68e7-1aac-43e0-9314-0b7e5854bd2e tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:06.529129 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bcaa68e7-1aac-43e0-9314-0b7e5854bd2e tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:06.529887 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bcaa68e7-1aac-43e0-9314-0b7e5854bd2e tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:06.530610 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bcaa68e7-1aac-43e0-9314-0b7e5854bd2e tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:06.531189 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bcaa68e7-1aac-43e0-9314-0b7e5854bd2e tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:06.653788 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-95c5125a-c34f-4175-a27e-e6e77b7768f8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:06.654600 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-95c5125a-c34f-4175-a27e-e6e77b7768f8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 04a4f94b-5820-4bbe-a9b0-7fa55a697e09] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:06.663788 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95c5125a-c34f-4175-a27e-e6e77b7768f8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:06.664153 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95c5125a-c34f-4175-a27e-e6e77b7768f8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:06.664845 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95c5125a-c34f-4175-a27e-e6e77b7768f8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:06.665879 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95c5125a-c34f-4175-a27e-e6e77b7768f8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:06.666428 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95c5125a-c34f-4175-a27e-e6e77b7768f8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:06.667051 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95c5125a-c34f-4175-a27e-e6e77b7768f8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:06.930645 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bcaa68e7-1aac-43e0-9314-0b7e5854bd2e tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0578b42db80943249238958e5fce15f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45d2345cb0e4847964e67928ab3069b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:06.947110 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bcaa68e7-1aac-43e0-9314-0b7e5854bd2e tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "GET /compute/v2.1/servers/0442e1d9-fa54-4957-8313-335c0f39c763" status: 200 len: 1317 microversion: 2.1 time: 0.430749 Aug 31 15:54:06.949598 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 630/1343] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:06 2022] GET /compute/v2.1/servers/0442e1d9-fa54-4957-8313-335c0f39c763 => generated 1317 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:07.070980 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-95c5125a-c34f-4175-a27e-e6e77b7768f8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:07.115999 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-95c5125a-c34f-4175-a27e-e6e77b7768f8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09" status: 200 len: 1541 microversion: 2.1 time: 0.462559 Aug 31 15:54:07.116826 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 714/1344] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:06 2022] GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09 => generated 1541 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:54:07.144445 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-45d8d181-64ba-44f9-80ea-6d2b0d4ed25e tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:07.145780 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-45d8d181-64ba-44f9-80ea-6d2b0d4ed25e tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] [instance: e803dd93-0c39-49a2-9bca-92bf0a789290] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:07.151743 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c23afec7-cb27-4595-b927-44bc886214be tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:07.152743 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c23afec7-cb27-4595-b927-44bc886214be tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] [instance: e4a38af3-ba7d-4074-a628-9c7825ae3358] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:07.156461 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45d8d181-64ba-44f9-80ea-6d2b0d4ed25e tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:07.157172 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45d8d181-64ba-44f9-80ea-6d2b0d4ed25e tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:07.158508 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45d8d181-64ba-44f9-80ea-6d2b0d4ed25e tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:07.161075 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45d8d181-64ba-44f9-80ea-6d2b0d4ed25e tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:07.162312 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c23afec7-cb27-4595-b927-44bc886214be tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:07.162704 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45d8d181-64ba-44f9-80ea-6d2b0d4ed25e tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:07.163679 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45d8d181-64ba-44f9-80ea-6d2b0d4ed25e tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:07.164348 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c23afec7-cb27-4595-b927-44bc886214be tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:07.167145 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c23afec7-cb27-4595-b927-44bc886214be tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:07.168127 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c23afec7-cb27-4595-b927-44bc886214be tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:07.168805 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c23afec7-cb27-4595-b927-44bc886214be tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:07.169488 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c23afec7-cb27-4595-b927-44bc886214be tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:07.316364 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-45d8d181-64ba-44f9-80ea-6d2b0d4ed25e tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:07.325587 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-45d8d181-64ba-44f9-80ea-6d2b0d4ed25e tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:07.327331 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-45d8d181-64ba-44f9-80ea-6d2b0d4ed25e tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:07.328750 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-45d8d181-64ba-44f9-80ea-6d2b0d4ed25e tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] 10.222.0.50 "GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290" status: 200 len: 1366 microversion: 2.57 time: 0.193115 Aug 31 15:54:07.347626 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 631/1345] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:54:07 2022] GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290 => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:54:07.353879 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-df4d3d4e-8002-417d-b432-346195fbf8c1 req-d590ef4c-4903-41af-83f8-1dcfae0c8722 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4a38af3-ba7d-4074-a628-9c7825ae3358", "name": "network-vif-plugged", "status": "completed", "tag": "d7e6779f-5f3b-407f-9773-9e0e92b5d2d6"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:54:07.367106 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-df4d3d4e-8002-417d-b432-346195fbf8c1 req-d590ef4c-4903-41af-83f8-1dcfae0c8722 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:07.368070 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-df4d3d4e-8002-417d-b432-346195fbf8c1 req-d590ef4c-4903-41af-83f8-1dcfae0c8722 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:07.368714 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-df4d3d4e-8002-417d-b432-346195fbf8c1 req-d590ef4c-4903-41af-83f8-1dcfae0c8722 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:07.389806 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-df4d3d4e-8002-417d-b432-346195fbf8c1 req-d590ef4c-4903-41af-83f8-1dcfae0c8722 service nova] Creating event network-vif-plugged:d7e6779f-5f3b-407f-9773-9e0e92b5d2d6 for instance e4a38af3-ba7d-4074-a628-9c7825ae3358 on n-h2-833090-16 Aug 31 15:54:07.397573 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-df4d3d4e-8002-417d-b432-346195fbf8c1 req-d590ef4c-4903-41af-83f8-1dcfae0c8722 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047566 Aug 31 15:54:07.399433 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 632/1346] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:54:07.447017 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c23afec7-cb27-4595-b927-44bc886214be tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048bcefe0af04bc6a3a2995b22cbe43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87fc33005b5440098daf798066a653f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:07.469601 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c23afec7-cb27-4595-b927-44bc886214be tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] 10.222.0.50 "GET /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358" status: 200 len: 1355 microversion: 2.1 time: 0.320806 Aug 31 15:54:07.472254 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 715/1347] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:07 2022] GET /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358 => generated 1355 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:07.972026 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8709a511-3f91-40b9-9e5b-fa706e576e94 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:07.972728 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8709a511-3f91-40b9-9e5b-fa706e576e94 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] [instance: 0442e1d9-fa54-4957-8313-335c0f39c763] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:07.979474 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8709a511-3f91-40b9-9e5b-fa706e576e94 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:07.979960 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8709a511-3f91-40b9-9e5b-fa706e576e94 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:07.980388 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8709a511-3f91-40b9-9e5b-fa706e576e94 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:07.981119 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8709a511-3f91-40b9-9e5b-fa706e576e94 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:07.981574 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8709a511-3f91-40b9-9e5b-fa706e576e94 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:07.981992 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8709a511-3f91-40b9-9e5b-fa706e576e94 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:08.117541 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8709a511-3f91-40b9-9e5b-fa706e576e94 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0578b42db80943249238958e5fce15f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45d2345cb0e4847964e67928ab3069b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:08.127316 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8709a511-3f91-40b9-9e5b-fa706e576e94 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "GET /compute/v2.1/servers/0442e1d9-fa54-4957-8313-335c0f39c763" status: 200 len: 1317 microversion: 2.1 time: 0.160290 Aug 31 15:54:08.127899 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 633/1348] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:07 2022] GET /compute/v2.1/servers/0442e1d9-fa54-4957-8313-335c0f39c763 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:08.144810 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8595a78c-7a03-4881-889c-f111f7b97be3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:08.147120 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8595a78c-7a03-4881-889c-f111f7b97be3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 04a4f94b-5820-4bbe-a9b0-7fa55a697e09] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:08.154979 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8595a78c-7a03-4881-889c-f111f7b97be3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:08.155890 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8595a78c-7a03-4881-889c-f111f7b97be3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:08.157020 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8595a78c-7a03-4881-889c-f111f7b97be3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:08.167040 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8595a78c-7a03-4881-889c-f111f7b97be3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:08.167582 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8595a78c-7a03-4881-889c-f111f7b97be3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:08.168023 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8595a78c-7a03-4881-889c-f111f7b97be3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:08.259771 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-491a294f-3f18-4fd5-b97e-17c7ab4fa7f1 req-0c45cd36-97af-4a5e-a0a4-c11063e165ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0442e1d9-fa54-4957-8313-335c0f39c763", "tag": "a977db7b-bcd4-47fa-9827-fa736d70e905"}, {"name": "network-changed", "server_uuid": "04a4f94b-5820-4bbe-a9b0-7fa55a697e09", "tag": "f57c1856-6065-432f-b1a1-14b1ca0672d2"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:54:08.272882 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-491a294f-3f18-4fd5-b97e-17c7ab4fa7f1 req-0c45cd36-97af-4a5e-a0a4-c11063e165ec service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:08.273632 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-491a294f-3f18-4fd5-b97e-17c7ab4fa7f1 req-0c45cd36-97af-4a5e-a0a4-c11063e165ec service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:08.274276 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-491a294f-3f18-4fd5-b97e-17c7ab4fa7f1 req-0c45cd36-97af-4a5e-a0a4-c11063e165ec service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:08.304313 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-491a294f-3f18-4fd5-b97e-17c7ab4fa7f1 req-0c45cd36-97af-4a5e-a0a4-c11063e165ec service nova] Creating event network-changed:a977db7b-bcd4-47fa-9827-fa736d70e905 for instance 0442e1d9-fa54-4957-8313-335c0f39c763 on n-h1-833090-16 Aug 31 15:54:08.305775 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-491a294f-3f18-4fd5-b97e-17c7ab4fa7f1 req-0c45cd36-97af-4a5e-a0a4-c11063e165ec service nova] Creating event network-changed:f57c1856-6065-432f-b1a1-14b1ca0672d2 for instance 04a4f94b-5820-4bbe-a9b0-7fa55a697e09 on n-h2-833090-16 Aug 31 15:54:08.322509 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [req-491a294f-3f18-4fd5-b97e-17c7ab4fa7f1 req-0c45cd36-97af-4a5e-a0a4-c11063e165ec service nova] Instance 04a4f94b-5820-4bbe-a9b0-7fa55a697e09 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-833090-16', 'n-h1-833090-16'} {{(pid=128863) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 15:54:08.337301 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-491a294f-3f18-4fd5-b97e-17c7ab4fa7f1 req-0c45cd36-97af-4a5e-a0a4-c11063e165ec service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.085013 Aug 31 15:54:08.338603 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 634/1349] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:54:08 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:54:08.342295 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8595a78c-7a03-4881-889c-f111f7b97be3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:08.355446 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8595a78c-7a03-4881-889c-f111f7b97be3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09" status: 200 len: 1473 microversion: 2.1 time: 0.216059 Aug 31 15:54:08.355599 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c03236d9-c1db-4181-8b1e-c84caebc1ccb tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:08.356253 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c03236d9-c1db-4181-8b1e-c84caebc1ccb tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] [instance: e803dd93-0c39-49a2-9bca-92bf0a789290] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:08.357119 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 716/1350] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:08 2022] GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09 => generated 1473 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:08.376959 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c03236d9-c1db-4181-8b1e-c84caebc1ccb tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:08.377291 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c03236d9-c1db-4181-8b1e-c84caebc1ccb tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:08.377987 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c03236d9-c1db-4181-8b1e-c84caebc1ccb tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:08.378732 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c03236d9-c1db-4181-8b1e-c84caebc1ccb tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:08.379341 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c03236d9-c1db-4181-8b1e-c84caebc1ccb tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:08.379929 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c03236d9-c1db-4181-8b1e-c84caebc1ccb tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:08.492303 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-29183420-dd94-4db8-af4a-4b7c4864f1ef tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:08.493480 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-29183420-dd94-4db8-af4a-4b7c4864f1ef tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] [instance: e4a38af3-ba7d-4074-a628-9c7825ae3358] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:08.500572 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-29183420-dd94-4db8-af4a-4b7c4864f1ef tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:08.501128 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-29183420-dd94-4db8-af4a-4b7c4864f1ef tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:08.501532 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-29183420-dd94-4db8-af4a-4b7c4864f1ef tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:08.502452 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-29183420-dd94-4db8-af4a-4b7c4864f1ef tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:08.503204 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-29183420-dd94-4db8-af4a-4b7c4864f1ef tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:08.503787 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-29183420-dd94-4db8-af4a-4b7c4864f1ef tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:08.506303 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c03236d9-c1db-4181-8b1e-c84caebc1ccb tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:08.520765 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c03236d9-c1db-4181-8b1e-c84caebc1ccb tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:08.523630 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c03236d9-c1db-4181-8b1e-c84caebc1ccb tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:08.525169 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c03236d9-c1db-4181-8b1e-c84caebc1ccb tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] 10.222.0.50 "GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290" status: 200 len: 1366 microversion: 2.57 time: 0.175758 Aug 31 15:54:08.540489 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 635/1351] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:54:08 2022] GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 15:54:08.545083 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:54:08.556077 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=6 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:54:08.783291 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-29183420-dd94-4db8-af4a-4b7c4864f1ef tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048bcefe0af04bc6a3a2995b22cbe43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87fc33005b5440098daf798066a653f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:08.795652 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-29183420-dd94-4db8-af4a-4b7c4864f1ef tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] 10.222.0.50 "GET /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358" status: 200 len: 1355 microversion: 2.1 time: 0.307208 Aug 31 15:54:08.812360 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 717/1352] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:08 2022] GET /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358 => generated 1355 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:09.147946 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e11a2875-c69b-4df2-a8c4-02f16211d25d tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:09.149388 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e11a2875-c69b-4df2-a8c4-02f16211d25d tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] [instance: 0442e1d9-fa54-4957-8313-335c0f39c763] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:09.158022 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e11a2875-c69b-4df2-a8c4-02f16211d25d tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:09.159087 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e11a2875-c69b-4df2-a8c4-02f16211d25d tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:09.159780 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e11a2875-c69b-4df2-a8c4-02f16211d25d tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:09.160875 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e11a2875-c69b-4df2-a8c4-02f16211d25d tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:09.161566 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e11a2875-c69b-4df2-a8c4-02f16211d25d tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:09.162222 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e11a2875-c69b-4df2-a8c4-02f16211d25d tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:09.381681 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3facf007-e6e4-4b6c-9512-15602f6ad2a2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:09.387796 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3facf007-e6e4-4b6c-9512-15602f6ad2a2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 04a4f94b-5820-4bbe-a9b0-7fa55a697e09] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:09.401662 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3facf007-e6e4-4b6c-9512-15602f6ad2a2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:09.403465 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3facf007-e6e4-4b6c-9512-15602f6ad2a2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:09.406853 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3facf007-e6e4-4b6c-9512-15602f6ad2a2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:09.408127 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3facf007-e6e4-4b6c-9512-15602f6ad2a2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:09.409431 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3facf007-e6e4-4b6c-9512-15602f6ad2a2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:09.410107 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3facf007-e6e4-4b6c-9512-15602f6ad2a2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:09.501980 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e11a2875-c69b-4df2-a8c4-02f16211d25d tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0578b42db80943249238958e5fce15f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45d2345cb0e4847964e67928ab3069b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:09.534448 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e11a2875-c69b-4df2-a8c4-02f16211d25d tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "GET /compute/v2.1/servers/0442e1d9-fa54-4957-8313-335c0f39c763" status: 200 len: 1317 microversion: 2.1 time: 0.388540 Aug 31 15:54:09.549757 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 636/1353] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:09 2022] GET /compute/v2.1/servers/0442e1d9-fa54-4957-8313-335c0f39c763 => generated 1317 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:09.553113 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b034a487-5832-4d48-9fd4-a1699f152e1b tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:09.554029 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b034a487-5832-4d48-9fd4-a1699f152e1b tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] [instance: e803dd93-0c39-49a2-9bca-92bf0a789290] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:09.566205 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b034a487-5832-4d48-9fd4-a1699f152e1b tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:09.567107 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b034a487-5832-4d48-9fd4-a1699f152e1b tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:09.571673 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b034a487-5832-4d48-9fd4-a1699f152e1b tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:09.573140 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b034a487-5832-4d48-9fd4-a1699f152e1b tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:09.574003 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b034a487-5832-4d48-9fd4-a1699f152e1b tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:09.577046 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b034a487-5832-4d48-9fd4-a1699f152e1b tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:09.630952 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:54:09.794673 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b034a487-5832-4d48-9fd4-a1699f152e1b tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:09.808907 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b034a487-5832-4d48-9fd4-a1699f152e1b tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:09.813168 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b034a487-5832-4d48-9fd4-a1699f152e1b tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:09.813878 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3facf007-e6e4-4b6c-9512-15602f6ad2a2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:09.814894 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b034a487-5832-4d48-9fd4-a1699f152e1b tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] 10.222.0.50 "GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290" status: 200 len: 1366 microversion: 2.57 time: 0.267416 Aug 31 15:54:09.827486 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 637/1354] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:54:09 2022] GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290 => generated 1366 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:54:09.831066 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3facf007-e6e4-4b6c-9512-15602f6ad2a2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09" status: 200 len: 1473 microversion: 2.1 time: 0.454375 Aug 31 15:54:09.831742 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 718/1355] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:09 2022] GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09 => generated 1473 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:09.838693 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-86941d18-f14c-4562-999e-3d1bf9adef46 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:09.839227 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-86941d18-f14c-4562-999e-3d1bf9adef46 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] [instance: e4a38af3-ba7d-4074-a628-9c7825ae3358] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:09.846766 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86941d18-f14c-4562-999e-3d1bf9adef46 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:09.848133 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86941d18-f14c-4562-999e-3d1bf9adef46 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:09.848570 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86941d18-f14c-4562-999e-3d1bf9adef46 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:09.849278 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86941d18-f14c-4562-999e-3d1bf9adef46 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:09.849725 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86941d18-f14c-4562-999e-3d1bf9adef46 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:09.850249 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86941d18-f14c-4562-999e-3d1bf9adef46 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:10.556838 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-31b210b8-5abd-4ad8-a0a9-840e7d6ab37c tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:10.557549 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-31b210b8-5abd-4ad8-a0a9-840e7d6ab37c tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] [instance: 0442e1d9-fa54-4957-8313-335c0f39c763] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:10.565755 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-31b210b8-5abd-4ad8-a0a9-840e7d6ab37c tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:10.566553 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-31b210b8-5abd-4ad8-a0a9-840e7d6ab37c tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:10.567201 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-31b210b8-5abd-4ad8-a0a9-840e7d6ab37c tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:10.568211 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-31b210b8-5abd-4ad8-a0a9-840e7d6ab37c tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:10.568857 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-31b210b8-5abd-4ad8-a0a9-840e7d6ab37c tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:10.569490 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-31b210b8-5abd-4ad8-a0a9-840e7d6ab37c tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:10.720762 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-86941d18-f14c-4562-999e-3d1bf9adef46 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048bcefe0af04bc6a3a2995b22cbe43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87fc33005b5440098daf798066a653f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:10.728791 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-86941d18-f14c-4562-999e-3d1bf9adef46 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] 10.222.0.50 "GET /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358" status: 200 len: 1355 microversion: 2.1 time: 0.900093 Aug 31 15:54:10.729481 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 638/1356] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:09 2022] GET /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358 => generated 1355 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:10.848518 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-545d9967-274b-474c-9ff5-62c79b71a548 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:10.849126 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-545d9967-274b-474c-9ff5-62c79b71a548 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] [instance: e803dd93-0c39-49a2-9bca-92bf0a789290] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:10.855914 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-545d9967-274b-474c-9ff5-62c79b71a548 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:10.856401 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-545d9967-274b-474c-9ff5-62c79b71a548 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:10.856828 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-545d9967-274b-474c-9ff5-62c79b71a548 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:10.857561 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-545d9967-274b-474c-9ff5-62c79b71a548 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:10.858176 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-545d9967-274b-474c-9ff5-62c79b71a548 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:10.858808 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-545d9967-274b-474c-9ff5-62c79b71a548 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:11.011581 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-545d9967-274b-474c-9ff5-62c79b71a548 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:11.019979 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-545d9967-274b-474c-9ff5-62c79b71a548 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:11.021411 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-545d9967-274b-474c-9ff5-62c79b71a548 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:11.022610 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-545d9967-274b-474c-9ff5-62c79b71a548 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] 10.222.0.50 "GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290" status: 200 len: 1366 microversion: 2.57 time: 0.185654 Aug 31 15:54:11.034822 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 639/1357] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:54:10 2022] GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290 => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 15:54:11.034822 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-936713bd-886c-49a4-82f7-165a175b6163 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:11.034822 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-936713bd-886c-49a4-82f7-165a175b6163 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 04a4f94b-5820-4bbe-a9b0-7fa55a697e09] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:11.034822 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-936713bd-886c-49a4-82f7-165a175b6163 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:11.035335 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-936713bd-886c-49a4-82f7-165a175b6163 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:11.035428 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-936713bd-886c-49a4-82f7-165a175b6163 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:11.036076 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-936713bd-886c-49a4-82f7-165a175b6163 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:11.036553 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-936713bd-886c-49a4-82f7-165a175b6163 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:11.036966 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-936713bd-886c-49a4-82f7-165a175b6163 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:11.041247 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-31b210b8-5abd-4ad8-a0a9-840e7d6ab37c tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0578b42db80943249238958e5fce15f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45d2345cb0e4847964e67928ab3069b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:11.049423 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-31b210b8-5abd-4ad8-a0a9-840e7d6ab37c tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "GET /compute/v2.1/servers/0442e1d9-fa54-4957-8313-335c0f39c763" status: 200 len: 1317 microversion: 2.1 time: 0.496469 Aug 31 15:54:11.050029 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 719/1358] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:10 2022] GET /compute/v2.1/servers/0442e1d9-fa54-4957-8313-335c0f39c763 => generated 1317 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:54:11.319479 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-993b155b-b6ab-4441-91b6-21f89f396fd5 req-a669297b-f486-4607-bced-5344c5d18fd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0442e1d9-fa54-4957-8313-335c0f39c763", "name": "network-vif-plugged", "status": "completed", "tag": "a977db7b-bcd4-47fa-9827-fa736d70e905"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:54:11.328731 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-993b155b-b6ab-4441-91b6-21f89f396fd5 req-a669297b-f486-4607-bced-5344c5d18fd6 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:11.329362 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-993b155b-b6ab-4441-91b6-21f89f396fd5 req-a669297b-f486-4607-bced-5344c5d18fd6 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:11.329952 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-993b155b-b6ab-4441-91b6-21f89f396fd5 req-a669297b-f486-4607-bced-5344c5d18fd6 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:11.343773 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-993b155b-b6ab-4441-91b6-21f89f396fd5 req-a669297b-f486-4607-bced-5344c5d18fd6 service nova] Creating event network-vif-plugged:a977db7b-bcd4-47fa-9827-fa736d70e905 for instance 0442e1d9-fa54-4957-8313-335c0f39c763 on n-h1-833090-16 Aug 31 15:54:11.349865 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-993b155b-b6ab-4441-91b6-21f89f396fd5 req-a669297b-f486-4607-bced-5344c5d18fd6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039632 Aug 31 15:54:11.350866 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 720/1359] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:54:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:54:11.401307 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-936713bd-886c-49a4-82f7-165a175b6163 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:11.412239 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-936713bd-886c-49a4-82f7-165a175b6163 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09" status: 200 len: 1473 microversion: 2.1 time: 0.388066 Aug 31 15:54:11.412925 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 640/1360] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:11 2022] GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09 => generated 1473 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:11.753315 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e86a9622-9be1-4f52-aad7-a0457c2bb7df tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:11.754033 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e86a9622-9be1-4f52-aad7-a0457c2bb7df tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] [instance: e4a38af3-ba7d-4074-a628-9c7825ae3358] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:11.766919 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e86a9622-9be1-4f52-aad7-a0457c2bb7df tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:11.767844 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e86a9622-9be1-4f52-aad7-a0457c2bb7df tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:11.768801 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e86a9622-9be1-4f52-aad7-a0457c2bb7df tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:11.769923 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e86a9622-9be1-4f52-aad7-a0457c2bb7df tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:11.770672 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e86a9622-9be1-4f52-aad7-a0457c2bb7df tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:11.771168 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e86a9622-9be1-4f52-aad7-a0457c2bb7df tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:12.047771 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7d32a71a-24f3-4734-a818-ec99f3a06380 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:12.048382 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7d32a71a-24f3-4734-a818-ec99f3a06380 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] [instance: e803dd93-0c39-49a2-9bca-92bf0a789290] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:12.057258 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d32a71a-24f3-4734-a818-ec99f3a06380 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:12.058653 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d32a71a-24f3-4734-a818-ec99f3a06380 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:12.062813 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d32a71a-24f3-4734-a818-ec99f3a06380 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:12.066071 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d32a71a-24f3-4734-a818-ec99f3a06380 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:12.066962 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d32a71a-24f3-4734-a818-ec99f3a06380 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:12.067553 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d32a71a-24f3-4734-a818-ec99f3a06380 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:12.207017 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e86a9622-9be1-4f52-aad7-a0457c2bb7df tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048bcefe0af04bc6a3a2995b22cbe43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87fc33005b5440098daf798066a653f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:12.215478 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e86a9622-9be1-4f52-aad7-a0457c2bb7df tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] 10.222.0.50 "GET /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358" status: 200 len: 1355 microversion: 2.1 time: 0.468287 Aug 31 15:54:12.235005 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7d32a71a-24f3-4734-a818-ec99f3a06380 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:12.239759 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 721/1361] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:11 2022] GET /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358 => generated 1355 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:12.253310 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7d32a71a-24f3-4734-a818-ec99f3a06380 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:12.258414 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7d32a71a-24f3-4734-a818-ec99f3a06380 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:12.258683 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1838836e-ee4f-4b29-86c3-4d1db9bd89f4 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:12.260019 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7d32a71a-24f3-4734-a818-ec99f3a06380 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] 10.222.0.50 "GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290" status: 200 len: 1366 microversion: 2.57 time: 0.216341 Aug 31 15:54:12.260834 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1838836e-ee4f-4b29-86c3-4d1db9bd89f4 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] [instance: 0442e1d9-fa54-4957-8313-335c0f39c763] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:12.264425 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 641/1362] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:54:12 2022] GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290 => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 15:54:12.277347 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1838836e-ee4f-4b29-86c3-4d1db9bd89f4 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:12.279049 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1838836e-ee4f-4b29-86c3-4d1db9bd89f4 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:12.279748 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1838836e-ee4f-4b29-86c3-4d1db9bd89f4 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:12.280684 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1838836e-ee4f-4b29-86c3-4d1db9bd89f4 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:12.281815 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1838836e-ee4f-4b29-86c3-4d1db9bd89f4 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:12.282628 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1838836e-ee4f-4b29-86c3-4d1db9bd89f4 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:12.433382 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9390b4f5-741c-4f8e-8c00-7874d2cecf78 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:12.434221 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9390b4f5-741c-4f8e-8c00-7874d2cecf78 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 04a4f94b-5820-4bbe-a9b0-7fa55a697e09] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:12.446639 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9390b4f5-741c-4f8e-8c00-7874d2cecf78 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:12.448291 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9390b4f5-741c-4f8e-8c00-7874d2cecf78 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:12.448968 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9390b4f5-741c-4f8e-8c00-7874d2cecf78 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:12.450299 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9390b4f5-741c-4f8e-8c00-7874d2cecf78 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:12.450927 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9390b4f5-741c-4f8e-8c00-7874d2cecf78 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:12.451535 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9390b4f5-741c-4f8e-8c00-7874d2cecf78 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:12.742062 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1838836e-ee4f-4b29-86c3-4d1db9bd89f4 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0578b42db80943249238958e5fce15f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45d2345cb0e4847964e67928ab3069b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:12.750413 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1838836e-ee4f-4b29-86c3-4d1db9bd89f4 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "GET /compute/v2.1/servers/0442e1d9-fa54-4957-8313-335c0f39c763" status: 200 len: 1317 microversion: 2.1 time: 0.502280 Aug 31 15:54:12.765999 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 722/1363] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:12 2022] GET /compute/v2.1/servers/0442e1d9-fa54-4957-8313-335c0f39c763 => generated 1317 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:12.913068 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9390b4f5-741c-4f8e-8c00-7874d2cecf78 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:12.923359 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9390b4f5-741c-4f8e-8c00-7874d2cecf78 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09" status: 200 len: 1470 microversion: 2.1 time: 0.493788 Aug 31 15:54:12.923961 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 642/1364] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:12 2022] GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09 => generated 1470 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:12.945596 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5f613c57-d4e6-4dec-8cc3-e53ee68adeed tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:54:12.946248 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5f613c57-d4e6-4dec-8cc3-e53ee68adeed tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 04a4f94b-5820-4bbe-a9b0-7fa55a697e09] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:12.954615 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5f613c57-d4e6-4dec-8cc3-e53ee68adeed tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:12.955431 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5f613c57-d4e6-4dec-8cc3-e53ee68adeed tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:12.956083 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5f613c57-d4e6-4dec-8cc3-e53ee68adeed tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:12.956829 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5f613c57-d4e6-4dec-8cc3-e53ee68adeed tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:12.957710 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5f613c57-d4e6-4dec-8cc3-e53ee68adeed tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:12.961807 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5f613c57-d4e6-4dec-8cc3-e53ee68adeed tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:13.012325 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5f613c57-d4e6-4dec-8cc3-e53ee68adeed tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:13.013138 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5f613c57-d4e6-4dec-8cc3-e53ee68adeed tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:13.013803 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5f613c57-d4e6-4dec-8cc3-e53ee68adeed tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:13.014819 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5f613c57-d4e6-4dec-8cc3-e53ee68adeed tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:13.015655 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5f613c57-d4e6-4dec-8cc3-e53ee68adeed tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:13.016245 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5f613c57-d4e6-4dec-8cc3-e53ee68adeed tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:13.042481 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-5f613c57-d4e6-4dec-8cc3-e53ee68adeed tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Getting quotas for project 9b4c50ece07f441b8974d384f4ab29a4. Resources: {'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:54:13.049307 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-5f613c57-d4e6-4dec-8cc3-e53ee68adeed tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Getting quotas for user 5f6f8b9d63234b8199c60f842a3c407f and project 9b4c50ece07f441b8974d384f4ab29a4. Resources: {'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:54:13.067986 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:54:13.106463 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=100 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:54:13.201993 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5f613c57-d4e6-4dec-8cc3-e53ee68adeed tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "POST /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09/action" status: 202 len: 0 microversion: 2.1 time: 0.260016 Aug 31 15:54:13.204088 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 723/1365] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 15:54:12 2022] POST /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:54:13.212867 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-aaf50b36-53ff-4f83-8d34-3d9e3dad04b7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:13.214139 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-aaf50b36-53ff-4f83-8d34-3d9e3dad04b7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 04a4f94b-5820-4bbe-a9b0-7fa55a697e09] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:13.221783 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aaf50b36-53ff-4f83-8d34-3d9e3dad04b7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:13.222568 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aaf50b36-53ff-4f83-8d34-3d9e3dad04b7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:13.223220 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aaf50b36-53ff-4f83-8d34-3d9e3dad04b7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:13.224152 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aaf50b36-53ff-4f83-8d34-3d9e3dad04b7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:13.224605 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aaf50b36-53ff-4f83-8d34-3d9e3dad04b7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:13.225020 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aaf50b36-53ff-4f83-8d34-3d9e3dad04b7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:13.247417 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9284ac9d-1489-4353-9446-c50c43577b38 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:13.252306 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9284ac9d-1489-4353-9446-c50c43577b38 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] [instance: e4a38af3-ba7d-4074-a628-9c7825ae3358] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:13.281264 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9284ac9d-1489-4353-9446-c50c43577b38 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:13.281819 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9284ac9d-1489-4353-9446-c50c43577b38 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:13.282738 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9284ac9d-1489-4353-9446-c50c43577b38 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:13.283125 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9284ac9d-1489-4353-9446-c50c43577b38 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:13.285667 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9284ac9d-1489-4353-9446-c50c43577b38 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:13.285667 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9284ac9d-1489-4353-9446-c50c43577b38 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:13.638116 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9284ac9d-1489-4353-9446-c50c43577b38 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048bcefe0af04bc6a3a2995b22cbe43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87fc33005b5440098daf798066a653f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:13.651127 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9284ac9d-1489-4353-9446-c50c43577b38 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] 10.222.0.50 "GET /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358" status: 200 len: 1355 microversion: 2.1 time: 0.409440 Aug 31 15:54:13.651773 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 724/1366] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:13 2022] GET /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358 => generated 1355 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:13.656657 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6cfb4623-4b8b-499c-8535-61de9b241dd1 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:13.657252 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6cfb4623-4b8b-499c-8535-61de9b241dd1 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] [instance: e803dd93-0c39-49a2-9bca-92bf0a789290] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:13.663407 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-aaf50b36-53ff-4f83-8d34-3d9e3dad04b7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:13.670767 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6cfb4623-4b8b-499c-8535-61de9b241dd1 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:13.671261 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6cfb4623-4b8b-499c-8535-61de9b241dd1 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:13.676264 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-aaf50b36-53ff-4f83-8d34-3d9e3dad04b7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09" status: 200 len: 1469 microversion: 2.1 time: 0.468630 Aug 31 15:54:13.676850 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 643/1367] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:13 2022] GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09 => generated 1469 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:13.681170 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6cfb4623-4b8b-499c-8535-61de9b241dd1 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:13.681469 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-6d9ce5d8-fafc-4ff5-9e52-b8ee0b716d0d req-28ba4c85-64b9-4ff4-8d26-04be67ab53b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4a38af3-ba7d-4074-a628-9c7825ae3358", "name": "network-vif-plugged", "status": "completed", "tag": "2f65903b-694a-4587-998c-6e75f99fcccf"}, {"server_uuid": "e4a38af3-ba7d-4074-a628-9c7825ae3358", "name": "network-vif-plugged", "status": "completed", "tag": "ebf441e7-25e3-470e-97ba-860218cd32be"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:54:13.682173 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6cfb4623-4b8b-499c-8535-61de9b241dd1 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:13.682787 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6cfb4623-4b8b-499c-8535-61de9b241dd1 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:13.683915 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6cfb4623-4b8b-499c-8535-61de9b241dd1 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:13.691170 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-6d9ce5d8-fafc-4ff5-9e52-b8ee0b716d0d req-28ba4c85-64b9-4ff4-8d26-04be67ab53b1 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:13.691892 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-6d9ce5d8-fafc-4ff5-9e52-b8ee0b716d0d req-28ba4c85-64b9-4ff4-8d26-04be67ab53b1 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:13.692474 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-6d9ce5d8-fafc-4ff5-9e52-b8ee0b716d0d req-28ba4c85-64b9-4ff4-8d26-04be67ab53b1 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:13.706600 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-6d9ce5d8-fafc-4ff5-9e52-b8ee0b716d0d req-28ba4c85-64b9-4ff4-8d26-04be67ab53b1 service nova] Creating event network-vif-plugged:2f65903b-694a-4587-998c-6e75f99fcccf for instance e4a38af3-ba7d-4074-a628-9c7825ae3358 on n-h2-833090-16 Aug 31 15:54:13.707356 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-6d9ce5d8-fafc-4ff5-9e52-b8ee0b716d0d req-28ba4c85-64b9-4ff4-8d26-04be67ab53b1 service nova] Creating event network-vif-plugged:ebf441e7-25e3-470e-97ba-860218cd32be for instance e4a38af3-ba7d-4074-a628-9c7825ae3358 on n-h2-833090-16 Aug 31 15:54:13.713371 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-6d9ce5d8-fafc-4ff5-9e52-b8ee0b716d0d req-28ba4c85-64b9-4ff4-8d26-04be67ab53b1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035194 Aug 31 15:54:13.714834 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 644/1368] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:54:13.770033 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6cfb4623-4b8b-499c-8535-61de9b241dd1 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:13.776654 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e7f481d5-ff52-4d5d-8f83-1b60ca79741c tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:13.777479 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e7f481d5-ff52-4d5d-8f83-1b60ca79741c tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] [instance: 0442e1d9-fa54-4957-8313-335c0f39c763] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:13.780226 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6cfb4623-4b8b-499c-8535-61de9b241dd1 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:13.782203 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6cfb4623-4b8b-499c-8535-61de9b241dd1 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:13.783874 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6cfb4623-4b8b-499c-8535-61de9b241dd1 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] 10.222.0.50 "GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290" status: 200 len: 1366 microversion: 2.57 time: 0.130983 Aug 31 15:54:13.784949 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 725/1369] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:54:13 2022] GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290 => generated 1366 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:54:13.787626 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7f481d5-ff52-4d5d-8f83-1b60ca79741c tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:13.788210 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7f481d5-ff52-4d5d-8f83-1b60ca79741c tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:13.788869 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7f481d5-ff52-4d5d-8f83-1b60ca79741c tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:13.789672 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7f481d5-ff52-4d5d-8f83-1b60ca79741c tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:13.790242 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7f481d5-ff52-4d5d-8f83-1b60ca79741c tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:13.791221 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7f481d5-ff52-4d5d-8f83-1b60ca79741c tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:13.835838 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:54:14.546043 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e7f481d5-ff52-4d5d-8f83-1b60ca79741c tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0578b42db80943249238958e5fce15f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45d2345cb0e4847964e67928ab3069b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:14.557934 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e7f481d5-ff52-4d5d-8f83-1b60ca79741c tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "GET /compute/v2.1/servers/0442e1d9-fa54-4957-8313-335c0f39c763" status: 200 len: 1466 microversion: 2.1 time: 0.787172 Aug 31 15:54:14.558955 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 645/1370] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:13 2022] GET /compute/v2.1/servers/0442e1d9-fa54-4957-8313-335c0f39c763 => generated 1466 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:54:14.582896 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d5bdc2ba-4860-4d9e-9cb0-a9cfa959ac3e tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-102452639", "metadata": {"image_type": "test"}}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:54:14.587471 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d5bdc2ba-4860-4d9e-9cb0-a9cfa959ac3e tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] [instance: 0442e1d9-fa54-4957-8313-335c0f39c763] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:14.598082 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d5bdc2ba-4860-4d9e-9cb0-a9cfa959ac3e tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:14.599591 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d5bdc2ba-4860-4d9e-9cb0-a9cfa959ac3e tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:14.600256 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d5bdc2ba-4860-4d9e-9cb0-a9cfa959ac3e tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:14.605265 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d5bdc2ba-4860-4d9e-9cb0-a9cfa959ac3e tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:14.606425 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d5bdc2ba-4860-4d9e-9cb0-a9cfa959ac3e tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:14.607135 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d5bdc2ba-4860-4d9e-9cb0-a9cfa959ac3e tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:14.652160 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-d5bdc2ba-4860-4d9e-9cb0-a9cfa959ac3e tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Getting quotas for project a45d2345cb0e4847964e67928ab3069b. Resources: dict_keys(['metadata_items']) {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:54:14.658414 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-d5bdc2ba-4860-4d9e-9cb0-a9cfa959ac3e tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Getting quotas for user 0578b42db80943249238958e5fce15f1 and project a45d2345cb0e4847964e67928ab3069b. Resources: dict_keys(['metadata_items']) {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:54:14.675526 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d5c0f26e-3f21-4003-bf9a-6d12e4d2b2ab tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:14.676412 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d5c0f26e-3f21-4003-bf9a-6d12e4d2b2ab tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] [instance: e4a38af3-ba7d-4074-a628-9c7825ae3358] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:14.688941 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5c0f26e-3f21-4003-bf9a-6d12e4d2b2ab tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:14.691748 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5c0f26e-3f21-4003-bf9a-6d12e4d2b2ab tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:14.692422 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5c0f26e-3f21-4003-bf9a-6d12e4d2b2ab tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:14.693306 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5c0f26e-3f21-4003-bf9a-6d12e4d2b2ab tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:14.695466 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5c0f26e-3f21-4003-bf9a-6d12e4d2b2ab tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:14.696092 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5c0f26e-3f21-4003-bf9a-6d12e4d2b2ab tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:14.976268 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d5bdc2ba-4860-4d9e-9cb0-a9cfa959ac3e tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "POST /compute/v2.1/servers/0442e1d9-fa54-4957-8313-335c0f39c763/action" status: 202 len: 0 microversion: 2.1 time: 0.398739 Aug 31 15:54:14.984954 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 726/1371] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 15:54:14 2022] POST /compute/v2.1/servers/0442e1d9-fa54-4957-8313-335c0f39c763/action => generated 0 bytes in 401 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 31 15:54:14.985342 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d5c0f26e-3f21-4003-bf9a-6d12e4d2b2ab tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048bcefe0af04bc6a3a2995b22cbe43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87fc33005b5440098daf798066a653f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:14.991181 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d5c0f26e-3f21-4003-bf9a-6d12e4d2b2ab tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] 10.222.0.50 "GET /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358" status: 200 len: 1355 microversion: 2.1 time: 0.320905 Aug 31 15:54:14.999244 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-200bd547-4e0a-4c9a-ac74-592c85250e6d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:15.000205 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-200bd547-4e0a-4c9a-ac74-592c85250e6d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 04a4f94b-5820-4bbe-a9b0-7fa55a697e09] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:15.004401 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 646/1372] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:14 2022] GET /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358 => generated 1355 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:15.013141 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-200bd547-4e0a-4c9a-ac74-592c85250e6d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:15.014047 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-200bd547-4e0a-4c9a-ac74-592c85250e6d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:15.014209 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-da64e2c9-0a13-40cf-9d29-a8617876cc2e tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:15.014795 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-200bd547-4e0a-4c9a-ac74-592c85250e6d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:15.014920 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-da64e2c9-0a13-40cf-9d29-a8617876cc2e tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] [instance: e803dd93-0c39-49a2-9bca-92bf0a789290] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:15.016129 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-200bd547-4e0a-4c9a-ac74-592c85250e6d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:15.016771 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-200bd547-4e0a-4c9a-ac74-592c85250e6d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:15.017335 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-200bd547-4e0a-4c9a-ac74-592c85250e6d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:15.022119 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da64e2c9-0a13-40cf-9d29-a8617876cc2e tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:15.024404 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da64e2c9-0a13-40cf-9d29-a8617876cc2e tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:15.024948 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da64e2c9-0a13-40cf-9d29-a8617876cc2e tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:15.025935 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da64e2c9-0a13-40cf-9d29-a8617876cc2e tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:15.026636 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da64e2c9-0a13-40cf-9d29-a8617876cc2e tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:15.027334 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da64e2c9-0a13-40cf-9d29-a8617876cc2e tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:15.154397 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-da64e2c9-0a13-40cf-9d29-a8617876cc2e tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:15.166226 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-da64e2c9-0a13-40cf-9d29-a8617876cc2e tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:15.167721 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-da64e2c9-0a13-40cf-9d29-a8617876cc2e tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:15.168950 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-da64e2c9-0a13-40cf-9d29-a8617876cc2e tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] 10.222.0.50 "GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290" status: 200 len: 1366 microversion: 2.57 time: 0.162088 Aug 31 15:54:15.169518 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 647/1373] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:54:15 2022] GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:54:15.192365 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-86c9f5f6-73d4-45b6-9ad9-6cfc142763d2 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '.version_select at 0x7fbb466bb790>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:15.251779 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-86c9f5f6-73d4-45b6-9ad9-6cfc142763d2 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "GET /compute/v2.1/images/cafb6e84-9246-4fe7-a97d-05f8a0e3b640" status: 200 len: 1423 microversion: 2.1 time: 0.067674 Aug 31 15:54:15.253286 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 648/1374] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:54:15 2022] GET /compute/v2.1/images/cafb6e84-9246-4fe7-a97d-05f8a0e3b640 => generated 1423 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:15.297308 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-200bd547-4e0a-4c9a-ac74-592c85250e6d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:15.306761 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-200bd547-4e0a-4c9a-ac74-592c85250e6d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09" status: 200 len: 1469 microversion: 2.1 time: 0.315802 Aug 31 15:54:15.307819 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 727/1375] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:14 2022] GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09 => generated 1469 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:15.732839 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-746342cb-d937-4e11-b519-49fd9e6cca32 tempest-ImagesMetadataTestJSON-1430443104 tempest-ImagesMetadataTestJSON-1430443104-project] Calling method '.version_select at 0x7fbb46543d30>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:15.776327 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-746342cb-d937-4e11-b519-49fd9e6cca32 tempest-ImagesMetadataTestJSON-1430443104 tempest-ImagesMetadataTestJSON-1430443104-project] 10.222.0.50 "GET /compute/v2.1/images/31071273-5a29-46aa-9c04-aaa46917044d" status: 200 len: 636 microversion: 2.1 time: 0.047246 Aug 31 15:54:15.776939 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 649/1376] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:54:15 2022] GET /compute/v2.1/images/31071273-5a29-46aa-9c04-aaa46917044d => generated 636 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:54:15.792849 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-00f310f5-8238-404b-a2ac-34fbed9c5a79 tempest-ImagesMetadataTestJSON-1430443104 tempest-ImagesMetadataTestJSON-1430443104-project] Action: 'update_all', calling method: .version_select at 0x7fbb4ac3c280>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:54:15.850184 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-00f310f5-8238-404b-a2ac-34fbed9c5a79 tempest-ImagesMetadataTestJSON-1430443104 tempest-ImagesMetadataTestJSON-1430443104-project] Getting quotas for project c873ab5c4d974e60b4c87f40fdb2dd3d. Resources: dict_keys(['metadata_items']) {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:54:15.855727 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-00f310f5-8238-404b-a2ac-34fbed9c5a79 tempest-ImagesMetadataTestJSON-1430443104 tempest-ImagesMetadataTestJSON-1430443104-project] Getting quotas for user 05a31c13b9fb413b8706e5a7456082f9 and project c873ab5c4d974e60b4c87f40fdb2dd3d. Resources: dict_keys(['metadata_items']) {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:54:16.013332 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e2e18563-a6af-45d7-aed9-60d596c0715a tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:16.014271 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e2e18563-a6af-45d7-aed9-60d596c0715a tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] [instance: e4a38af3-ba7d-4074-a628-9c7825ae3358] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:16.027038 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2e18563-a6af-45d7-aed9-60d596c0715a tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:16.027544 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2e18563-a6af-45d7-aed9-60d596c0715a tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:16.027953 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2e18563-a6af-45d7-aed9-60d596c0715a tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:16.028674 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2e18563-a6af-45d7-aed9-60d596c0715a tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:16.029102 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2e18563-a6af-45d7-aed9-60d596c0715a tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:16.029540 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2e18563-a6af-45d7-aed9-60d596c0715a tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:16.146785 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-00f310f5-8238-404b-a2ac-34fbed9c5a79 tempest-ImagesMetadataTestJSON-1430443104 tempest-ImagesMetadataTestJSON-1430443104-project] 10.222.0.50 "PUT /compute/v2.1/images/31071273-5a29-46aa-9c04-aaa46917044d/metadata" status: 200 len: 61 microversion: 2.1 time: 0.358006 Aug 31 15:54:16.147418 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 728/1377] 10.222.0.50 () {60 vars in 1280 bytes} [Wed Aug 31 15:54:15 2022] PUT /compute/v2.1/images/31071273-5a29-46aa-9c04-aaa46917044d/metadata => generated 61 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 15:54:16.201387 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e2e18563-a6af-45d7-aed9-60d596c0715a tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048bcefe0af04bc6a3a2995b22cbe43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87fc33005b5440098daf798066a653f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:16.209493 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e2e18563-a6af-45d7-aed9-60d596c0715a tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] 10.222.0.50 "GET /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358" status: 200 len: 1355 microversion: 2.1 time: 0.200297 Aug 31 15:54:16.210071 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 650/1378] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:16 2022] GET /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358 => generated 1355 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:54:16.214714 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6e860636-92b4-4fe7-b816-3d2c5fc025b6 tempest-ImagesMetadataTestJSON-1430443104 tempest-ImagesMetadataTestJSON-1430443104-project] Calling method '.version_select at 0x7fbb464f6e50>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:16.268505 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-99620a31-a090-4601-acbf-4b4f19737f8e tempest-FlavorsV2TestJSON-148204543 tempest-FlavorsV2TestJSON-148204543-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:16.277059 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-99620a31-a090-4601-acbf-4b4f19737f8e tempest-FlavorsV2TestJSON-148204543 tempest-FlavorsV2TestJSON-148204543-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.128616 Aug 31 15:54:16.277774 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 729/1379] 10.222.0.50 () {58 vars in 1137 bytes} [Wed Aug 31 15:54:16 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:54:16.282961 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4635ba8c-9a31-4f1a-9662-1a2f24fbb90d tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:16.283592 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4635ba8c-9a31-4f1a-9662-1a2f24fbb90d tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] [instance: e803dd93-0c39-49a2-9bca-92bf0a789290] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:16.291617 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4635ba8c-9a31-4f1a-9662-1a2f24fbb90d tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:16.292281 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4635ba8c-9a31-4f1a-9662-1a2f24fbb90d tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:16.292703 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4635ba8c-9a31-4f1a-9662-1a2f24fbb90d tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:16.293386 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4635ba8c-9a31-4f1a-9662-1a2f24fbb90d tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:16.293828 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4635ba8c-9a31-4f1a-9662-1a2f24fbb90d tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:16.294286 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4635ba8c-9a31-4f1a-9662-1a2f24fbb90d tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:16.364178 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4635ba8c-9a31-4f1a-9662-1a2f24fbb90d tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:16.373678 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4635ba8c-9a31-4f1a-9662-1a2f24fbb90d tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:16.375331 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4635ba8c-9a31-4f1a-9662-1a2f24fbb90d tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:16.376518 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4635ba8c-9a31-4f1a-9662-1a2f24fbb90d tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] 10.222.0.50 "GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290" status: 200 len: 1366 microversion: 2.57 time: 0.097764 Aug 31 15:54:16.377271 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 730/1380] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:54:16 2022] GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290 => generated 1366 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:54:16.381926 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d514fac5-3b79-48fb-8086-869e7e364ef0 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '.version_select at 0x7fbb467a61f0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:16.440225 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d514fac5-3b79-48fb-8086-869e7e364ef0 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "GET /compute/v2.1/images/cafb6e84-9246-4fe7-a97d-05f8a0e3b640" status: 200 len: 1423 microversion: 2.1 time: 0.061462 Aug 31 15:54:16.441235 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 731/1381] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:54:16 2022] GET /compute/v2.1/images/cafb6e84-9246-4fe7-a97d-05f8a0e3b640 => generated 1423 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:16.451277 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-904fdc54-ae4c-424a-8394-95ee6d52bac6 tempest-FlavorsV2TestJSON-148204543 tempest-FlavorsV2TestJSON-148204543-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:16.475862 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-904fdc54-ae4c-424a-8394-95ee6d52bac6 tempest-FlavorsV2TestJSON-148204543 tempest-FlavorsV2TestJSON-148204543-project] 10.222.0.50 "GET /compute/v2.1/flavors" status: 200 len: 3080 microversion: 2.1 time: 0.033464 Aug 31 15:54:16.476858 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 732/1382] 10.222.0.50 () {58 vars in 1125 bytes} [Wed Aug 31 15:54:16 2022] GET /compute/v2.1/flavors => generated 3080 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:16.482214 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6f308311-d030-4732-8fc8-df95f4e4ab7c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:16.482991 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6f308311-d030-4732-8fc8-df95f4e4ab7c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 04a4f94b-5820-4bbe-a9b0-7fa55a697e09] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:16.490173 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f308311-d030-4732-8fc8-df95f4e4ab7c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:16.490663 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f308311-d030-4732-8fc8-df95f4e4ab7c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:16.491309 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f308311-d030-4732-8fc8-df95f4e4ab7c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:16.492139 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f308311-d030-4732-8fc8-df95f4e4ab7c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:16.492599 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f308311-d030-4732-8fc8-df95f4e4ab7c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:16.493022 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f308311-d030-4732-8fc8-df95f4e4ab7c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:16.498804 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6e860636-92b4-4fe7-b816-3d2c5fc025b6 tempest-ImagesMetadataTestJSON-1430443104 tempest-ImagesMetadataTestJSON-1430443104-project] 10.222.0.50 "DELETE /compute/v2.1/images/31071273-5a29-46aa-9c04-aaa46917044d/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.287635 Aug 31 15:54:16.499762 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 651/1383] 10.222.0.50 () {58 vars in 1296 bytes} [Wed Aug 31 15:54:16 2022] DELETE /compute/v2.1/images/31071273-5a29-46aa-9c04-aaa46917044d/metadata/os_version => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:54:16.506613 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d7350cf5-e635-4832-b242-26cf266c0fa5 tempest-FlavorsV2TestJSON-148204543 tempest-FlavorsV2TestJSON-148204543-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:16.515372 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d7350cf5-e635-4832-b242-26cf266c0fa5 tempest-FlavorsV2TestJSON-148204543 tempest-FlavorsV2TestJSON-148204543-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013853 Aug 31 15:54:16.516453 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 652/1384] 10.222.0.50 () {58 vars in 1137 bytes} [Wed Aug 31 15:54:16 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:54:16.521785 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-534b5240-f817-4d06-a5e0-bfd9667dc6f4 tempest-ImagesMetadataTestJSON-1430443104 tempest-ImagesMetadataTestJSON-1430443104-project] Calling method '.version_select at 0x7fbb464f6ee0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:16.575283 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-534b5240-f817-4d06-a5e0-bfd9667dc6f4 tempest-ImagesMetadataTestJSON-1430443104 tempest-ImagesMetadataTestJSON-1430443104-project] 10.222.0.50 "GET /compute/v2.1/images/31071273-5a29-46aa-9c04-aaa46917044d/metadata" status: 200 len: 37 microversion: 2.1 time: 0.057490 Aug 31 15:54:16.575965 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 653/1385] 10.222.0.50 () {58 vars in 1260 bytes} [Wed Aug 31 15:54:16 2022] GET /compute/v2.1/images/31071273-5a29-46aa-9c04-aaa46917044d/metadata => generated 37 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 15:54:16.583625 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-8cff8e1d-c315-4b7a-ae73-5f378a9e7d21 req-d8d240c0-c030-4d9b-950f-7df9144f3156 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04a4f94b-5820-4bbe-a9b0-7fa55a697e09", "name": "network-vif-plugged", "status": "completed", "tag": "f57c1856-6065-432f-b1a1-14b1ca0672d2"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:54:16.595144 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8cff8e1d-c315-4b7a-ae73-5f378a9e7d21 req-d8d240c0-c030-4d9b-950f-7df9144f3156 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:16.595836 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8cff8e1d-c315-4b7a-ae73-5f378a9e7d21 req-d8d240c0-c030-4d9b-950f-7df9144f3156 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:16.596474 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8cff8e1d-c315-4b7a-ae73-5f378a9e7d21 req-d8d240c0-c030-4d9b-950f-7df9144f3156 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:16.609620 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-8cff8e1d-c315-4b7a-ae73-5f378a9e7d21 req-d8d240c0-c030-4d9b-950f-7df9144f3156 service nova] Creating event network-vif-plugged:f57c1856-6065-432f-b1a1-14b1ca0672d2 for instance 04a4f94b-5820-4bbe-a9b0-7fa55a697e09 on n-h2-833090-16 Aug 31 15:54:16.615665 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [req-8cff8e1d-c315-4b7a-ae73-5f378a9e7d21 req-d8d240c0-c030-4d9b-950f-7df9144f3156 service nova] Instance 04a4f94b-5820-4bbe-a9b0-7fa55a697e09 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-833090-16', 'n-h1-833090-16'} {{(pid=128863) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 15:54:16.627077 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-8cff8e1d-c315-4b7a-ae73-5f378a9e7d21 req-d8d240c0-c030-4d9b-950f-7df9144f3156 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049708 Aug 31 15:54:16.627807 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 654/1386] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:54:16.633018 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d61b829b-05e5-4670-a23b-5af3663e45b4 tempest-FlavorsV2TestJSON-148204543 tempest-FlavorsV2TestJSON-148204543-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:16.641384 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d61b829b-05e5-4670-a23b-5af3663e45b4 tempest-FlavorsV2TestJSON-148204543 tempest-FlavorsV2TestJSON-148204543-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012189 Aug 31 15:54:16.641951 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 655/1387] 10.222.0.50 () {58 vars in 1137 bytes} [Wed Aug 31 15:54:16 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:54:16.649168 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6f308311-d030-4732-8fc8-df95f4e4ab7c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:16.654661 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-eb93005e-0396-4295-b113-d304abec9829 tempest-ImagesMetadataTestJSON-1430443104 tempest-ImagesMetadataTestJSON-1430443104-project] Action: 'update_all', calling method: .version_select at 0x7fbb464f6c10>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:54:16.656626 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6f308311-d030-4732-8fc8-df95f4e4ab7c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09" status: 200 len: 1469 microversion: 2.1 time: 0.178125 Aug 31 15:54:16.657225 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 733/1388] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:16 2022] GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09 => generated 1469 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:16.662060 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-59e4f6b2-4b61-4725-b15b-50f0d31a56a9 tempest-FlavorsV2TestJSON-148204543 tempest-FlavorsV2TestJSON-148204543-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:16.690948 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-59e4f6b2-4b61-4725-b15b-50f0d31a56a9 tempest-FlavorsV2TestJSON-148204543 tempest-FlavorsV2TestJSON-148204543-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.032626 Aug 31 15:54:16.691542 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 734/1389] 10.222.0.50 () {58 vars in 1165 bytes} [Wed Aug 31 15:54:16 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:16.706524 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-eb93005e-0396-4295-b113-d304abec9829 tempest-ImagesMetadataTestJSON-1430443104 tempest-ImagesMetadataTestJSON-1430443104-project] Getting quotas for project c873ab5c4d974e60b4c87f40fdb2dd3d. Resources: dict_keys(['metadata_items']) {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:54:16.709036 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f7a91436-de94-4cf1-9f02-887d3e8c52bc tempest-FlavorsV2TestJSON-148204543 tempest-FlavorsV2TestJSON-148204543-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:16.711910 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-eb93005e-0396-4295-b113-d304abec9829 tempest-ImagesMetadataTestJSON-1430443104 tempest-ImagesMetadataTestJSON-1430443104-project] Getting quotas for user 05a31c13b9fb413b8706e5a7456082f9 and project c873ab5c4d974e60b4c87f40fdb2dd3d. Resources: dict_keys(['metadata_items']) {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:54:16.718536 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f7a91436-de94-4cf1-9f02-887d3e8c52bc tempest-FlavorsV2TestJSON-148204543 tempest-FlavorsV2TestJSON-148204543-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013948 Aug 31 15:54:16.719098 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 735/1390] 10.222.0.50 () {58 vars in 1137 bytes} [Wed Aug 31 15:54:16 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:54:16.732036 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-325599ff-fc30-49d5-8b17-55255c50b3db tempest-FlavorsV2TestJSON-148204543 tempest-FlavorsV2TestJSON-148204543-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:16.757127 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-325599ff-fc30-49d5-8b17-55255c50b3db tempest-FlavorsV2TestJSON-148204543 tempest-FlavorsV2TestJSON-148204543-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.029737 Aug 31 15:54:16.757705 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 736/1391] 10.222.0.50 () {58 vars in 1169 bytes} [Wed Aug 31 15:54:16 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:54:16.774272 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-be20b311-e40b-45bb-86a6-2c16a2f33b31 tempest-FlavorsV2TestJSON-148204543 tempest-FlavorsV2TestJSON-148204543-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:16.787447 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-be20b311-e40b-45bb-86a6-2c16a2f33b31 tempest-FlavorsV2TestJSON-148204543 tempest-FlavorsV2TestJSON-148204543-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.017226 Aug 31 15:54:16.788050 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 737/1392] 10.222.0.50 () {58 vars in 1161 bytes} [Wed Aug 31 15:54:16 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:54:16.801588 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6b0f17bb-4394-4559-b7da-797d60c02652 tempest-FlavorsV2TestJSON-148204543 tempest-FlavorsV2TestJSON-148204543-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:16.811776 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6b0f17bb-4394-4559-b7da-797d60c02652 tempest-FlavorsV2TestJSON-148204543 tempest-FlavorsV2TestJSON-148204543-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013888 Aug 31 15:54:16.817515 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 738/1393] 10.222.0.50 () {58 vars in 1137 bytes} [Wed Aug 31 15:54:16 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:54:16.824586 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5615ca87-e2c1-4e1c-91cc-83edcb8297d8 tempest-FlavorsV2TestJSON-148204543 tempest-FlavorsV2TestJSON-148204543-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:16.864693 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5615ca87-e2c1-4e1c-91cc-83edcb8297d8 tempest-FlavorsV2TestJSON-148204543 tempest-FlavorsV2TestJSON-148204543-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.044180 Aug 31 15:54:16.865254 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 739/1394] 10.222.0.50 () {58 vars in 1167 bytes} [Wed Aug 31 15:54:16 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:16.880753 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a50142dd-4347-429d-854b-f5bab79bea3b tempest-FlavorsV2TestJSON-148204543 tempest-FlavorsV2TestJSON-148204543-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:16.888907 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a50142dd-4347-429d-854b-f5bab79bea3b tempest-FlavorsV2TestJSON-148204543 tempest-FlavorsV2TestJSON-148204543-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012003 Aug 31 15:54:16.889491 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 740/1395] 10.222.0.50 () {58 vars in 1137 bytes} [Wed Aug 31 15:54:16 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:54:16.900774 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-648b6d86-b75d-4f8c-8103-ee45b2a88d87 tempest-FlavorsV2TestJSON-148204543 tempest-FlavorsV2TestJSON-148204543-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:16.920795 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-648b6d86-b75d-4f8c-8103-ee45b2a88d87 tempest-FlavorsV2TestJSON-148204543 tempest-FlavorsV2TestJSON-148204543-project] 10.222.0.50 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.023373 Aug 31 15:54:16.930688 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 741/1396] 10.222.0.50 () {58 vars in 1144 bytes} [Wed Aug 31 15:54:16 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:54:16.936054 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c6bb2225-cc9f-454d-990b-af873f939a48 tempest-FlavorsV2TestJSON-148204543 tempest-FlavorsV2TestJSON-148204543-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:16.946003 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c6bb2225-cc9f-454d-990b-af873f939a48 tempest-FlavorsV2TestJSON-148204543 tempest-FlavorsV2TestJSON-148204543-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013915 Aug 31 15:54:16.946660 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 742/1397] 10.222.0.50 () {58 vars in 1137 bytes} [Wed Aug 31 15:54:16 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:54:16.957816 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-628039d0-a140-4e10-a3cd-5adfa5d048f7 tempest-FlavorsV2TestJSON-148204543 tempest-FlavorsV2TestJSON-148204543-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:16.974006 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-628039d0-a140-4e10-a3cd-5adfa5d048f7 tempest-FlavorsV2TestJSON-148204543 tempest-FlavorsV2TestJSON-148204543-project] 10.222.0.50 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.019743 Aug 31 15:54:16.974612 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 743/1398] 10.222.0.50 () {58 vars in 1148 bytes} [Wed Aug 31 15:54:16 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:54:16.977130 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-eb93005e-0396-4295-b113-d304abec9829 tempest-ImagesMetadataTestJSON-1430443104 tempest-ImagesMetadataTestJSON-1430443104-project] 10.222.0.50 "PUT /compute/v2.1/images/31071273-5a29-46aa-9c04-aaa46917044d/metadata" status: 200 len: 61 microversion: 2.1 time: 0.326561 Aug 31 15:54:16.977736 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 656/1399] 10.222.0.50 () {60 vars in 1280 bytes} [Wed Aug 31 15:54:16 2022] PUT /compute/v2.1/images/31071273-5a29-46aa-9c04-aaa46917044d/metadata => generated 61 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 15:54:16.987635 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-31596e77-d0fe-4102-b2df-4ae05842e6ad tempest-FlavorsV2TestJSON-148204543 tempest-FlavorsV2TestJSON-148204543-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:16.989668 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fce0abe6-fc0f-45d7-8401-8beaab3237df tempest-ImagesMetadataTestJSON-1430443104 tempest-ImagesMetadataTestJSON-1430443104-project] Calling method '.version_select at 0x7fbb4ac20280>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:17.000933 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-31596e77-d0fe-4102-b2df-4ae05842e6ad tempest-FlavorsV2TestJSON-148204543 tempest-FlavorsV2TestJSON-148204543-project] 10.222.0.50 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.017193 Aug 31 15:54:17.001500 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 657/1400] 10.222.0.50 () {58 vars in 1140 bytes} [Wed Aug 31 15:54:16 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:54:17.013145 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-20768cd1-a114-4861-bbc5-8a69b9ed1871 tempest-FlavorsV2TestJSON-148204543 tempest-FlavorsV2TestJSON-148204543-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:17.024936 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-20768cd1-a114-4861-bbc5-8a69b9ed1871 tempest-FlavorsV2TestJSON-148204543 tempest-FlavorsV2TestJSON-148204543-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015424 Aug 31 15:54:17.025537 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 658/1401] 10.222.0.50 () {58 vars in 1137 bytes} [Wed Aug 31 15:54:17 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:54:17.034484 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fce0abe6-fc0f-45d7-8401-8beaab3237df tempest-ImagesMetadataTestJSON-1430443104 tempest-ImagesMetadataTestJSON-1430443104-project] 10.222.0.50 "GET /compute/v2.1/images/31071273-5a29-46aa-9c04-aaa46917044d/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.050823 Aug 31 15:54:17.035053 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 744/1402] 10.222.0.50 () {58 vars in 1290 bytes} [Wed Aug 31 15:54:16 2022] GET /compute/v2.1/images/31071273-5a29-46aa-9c04-aaa46917044d/metadata/os_distro => generated 33 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 15:54:17.038141 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-960fec5a-04c2-48df-829c-bde95f5e8267 tempest-FlavorsV2TestJSON-148204543 tempest-FlavorsV2TestJSON-148204543-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:17.045382 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5dd14be0-2be3-409d-9ce9-9e73effd89c9 tempest-ImagesMetadataTestJSON-1430443104 tempest-ImagesMetadataTestJSON-1430443104-project] Action: 'update_all', calling method: .version_select at 0x7fbb46752d30>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:54:17.075317 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-960fec5a-04c2-48df-829c-bde95f5e8267 tempest-FlavorsV2TestJSON-148204543 tempest-FlavorsV2TestJSON-148204543-project] 10.222.0.50 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.040814 Aug 31 15:54:17.075925 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 659/1403] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 31 15:54:17 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:17.092783 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6390f5ac-f753-4e4a-aa73-e0ec0f582af7 tempest-FlavorsV2TestJSON-148204543 tempest-FlavorsV2TestJSON-148204543-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:17.096092 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-5dd14be0-2be3-409d-9ce9-9e73effd89c9 tempest-ImagesMetadataTestJSON-1430443104 tempest-ImagesMetadataTestJSON-1430443104-project] Getting quotas for project c873ab5c4d974e60b4c87f40fdb2dd3d. Resources: dict_keys(['metadata_items']) {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:54:17.101713 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-5dd14be0-2be3-409d-9ce9-9e73effd89c9 tempest-ImagesMetadataTestJSON-1430443104 tempest-ImagesMetadataTestJSON-1430443104-project] Getting quotas for user 05a31c13b9fb413b8706e5a7456082f9 and project c873ab5c4d974e60b4c87f40fdb2dd3d. Resources: dict_keys(['metadata_items']) {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:54:17.116818 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6390f5ac-f753-4e4a-aa73-e0ec0f582af7 tempest-FlavorsV2TestJSON-148204543 tempest-FlavorsV2TestJSON-148204543-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.028987 Aug 31 15:54:17.117614 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 660/1404] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 31 15:54:17 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:17.134677 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-094570e0-7d63-4e11-ae4b-c121fa81f16e tempest-FlavorsV2TestJSON-148204543 tempest-FlavorsV2TestJSON-148204543-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:17.145137 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-094570e0-7d63-4e11-ae4b-c121fa81f16e tempest-FlavorsV2TestJSON-148204543 tempest-FlavorsV2TestJSON-148204543-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014181 Aug 31 15:54:17.149501 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 661/1405] 10.222.0.50 () {58 vars in 1137 bytes} [Wed Aug 31 15:54:17 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:54:17.236058 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7818efe4-3b93-4aa6-ab73-45324f9f6297 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:17.238240 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7818efe4-3b93-4aa6-ab73-45324f9f6297 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] [instance: e4a38af3-ba7d-4074-a628-9c7825ae3358] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:17.249982 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7818efe4-3b93-4aa6-ab73-45324f9f6297 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:17.250925 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7818efe4-3b93-4aa6-ab73-45324f9f6297 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:17.251672 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7818efe4-3b93-4aa6-ab73-45324f9f6297 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:17.252652 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7818efe4-3b93-4aa6-ab73-45324f9f6297 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:17.254203 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7818efe4-3b93-4aa6-ab73-45324f9f6297 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:17.255565 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7818efe4-3b93-4aa6-ab73-45324f9f6297 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:17.282198 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5dd14be0-2be3-409d-9ce9-9e73effd89c9 tempest-ImagesMetadataTestJSON-1430443104 tempest-ImagesMetadataTestJSON-1430443104-project] 10.222.0.50 "PUT /compute/v2.1/images/31071273-5a29-46aa-9c04-aaa46917044d/metadata" status: 200 len: 61 microversion: 2.1 time: 0.240604 Aug 31 15:54:17.283537 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 745/1406] 10.222.0.50 () {60 vars in 1280 bytes} [Wed Aug 31 15:54:17 2022] PUT /compute/v2.1/images/31071273-5a29-46aa-9c04-aaa46917044d/metadata => generated 61 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 15:54:17.294659 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-48384f88-e7a8-4b35-9d1f-f9c71340beb8 tempest-ImagesMetadataTestJSON-1430443104 tempest-ImagesMetadataTestJSON-1430443104-project] Calling method '.version_select at 0x7fbb4ac20280>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:17.348717 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-48384f88-e7a8-4b35-9d1f-f9c71340beb8 tempest-ImagesMetadataTestJSON-1430443104 tempest-ImagesMetadataTestJSON-1430443104-project] 10.222.0.50 "GET /compute/v2.1/images/31071273-5a29-46aa-9c04-aaa46917044d/metadata" status: 200 len: 61 microversion: 2.1 time: 0.059416 Aug 31 15:54:17.349418 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 746/1407] 10.222.0.50 () {58 vars in 1260 bytes} [Wed Aug 31 15:54:17 2022] GET /compute/v2.1/images/31071273-5a29-46aa-9c04-aaa46917044d/metadata => generated 61 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 15:54:17.361289 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8b89edbb-7dd7-44ca-a71d-af65ade12d8a tempest-ImagesMetadataTestJSON-1430443104 tempest-ImagesMetadataTestJSON-1430443104-project] Action: 'update_all', calling method: .version_select at 0x7fbb467a65e0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:54:17.429992 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-8b89edbb-7dd7-44ca-a71d-af65ade12d8a tempest-ImagesMetadataTestJSON-1430443104 tempest-ImagesMetadataTestJSON-1430443104-project] Getting quotas for project c873ab5c4d974e60b4c87f40fdb2dd3d. Resources: dict_keys(['metadata_items']) {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:54:17.436323 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-8b89edbb-7dd7-44ca-a71d-af65ade12d8a tempest-ImagesMetadataTestJSON-1430443104 tempest-ImagesMetadataTestJSON-1430443104-project] Getting quotas for user 05a31c13b9fb413b8706e5a7456082f9 and project c873ab5c4d974e60b4c87f40fdb2dd3d. Resources: dict_keys(['metadata_items']) {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:54:17.450576 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7818efe4-3b93-4aa6-ab73-45324f9f6297 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048bcefe0af04bc6a3a2995b22cbe43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87fc33005b5440098daf798066a653f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:17.459705 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7818efe4-3b93-4aa6-ab73-45324f9f6297 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] 10.222.0.50 "GET /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358" status: 200 len: 1806 microversion: 2.1 time: 0.230214 Aug 31 15:54:17.460502 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 662/1408] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:17 2022] GET /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358 => generated 1806 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:54:17.465469 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2d7e0243-1950-478f-8471-ce4ab0987af5 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:17.466187 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2d7e0243-1950-478f-8471-ce4ab0987af5 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] [instance: e803dd93-0c39-49a2-9bca-92bf0a789290] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:17.473631 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d7e0243-1950-478f-8471-ce4ab0987af5 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:17.474328 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d7e0243-1950-478f-8471-ce4ab0987af5 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:17.474885 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d7e0243-1950-478f-8471-ce4ab0987af5 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:17.475852 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d7e0243-1950-478f-8471-ce4ab0987af5 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:17.476291 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d7e0243-1950-478f-8471-ce4ab0987af5 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:17.476868 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d7e0243-1950-478f-8471-ce4ab0987af5 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:17.589318 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2d7e0243-1950-478f-8471-ce4ab0987af5 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:17.600810 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2d7e0243-1950-478f-8471-ce4ab0987af5 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:17.602699 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2d7e0243-1950-478f-8471-ce4ab0987af5 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:17.604047 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2d7e0243-1950-478f-8471-ce4ab0987af5 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] 10.222.0.50 "GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290" status: 200 len: 1366 microversion: 2.57 time: 0.142744 Aug 31 15:54:17.604888 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 663/1409] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:54:17 2022] GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290 => generated 1366 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:54:17.613330 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a22a9b34-2055-45b1-b3f8-4d20047b0de3 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '.version_select at 0x7fbb464f6f70>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:17.712903 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8b89edbb-7dd7-44ca-a71d-af65ade12d8a tempest-ImagesMetadataTestJSON-1430443104 tempest-ImagesMetadataTestJSON-1430443104-project] 10.222.0.50 "PUT /compute/v2.1/images/31071273-5a29-46aa-9c04-aaa46917044d/metadata" status: 200 len: 61 microversion: 2.1 time: 0.355487 Aug 31 15:54:17.719939 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 747/1410] 10.222.0.50 () {60 vars in 1280 bytes} [Wed Aug 31 15:54:17 2022] PUT /compute/v2.1/images/31071273-5a29-46aa-9c04-aaa46917044d/metadata => generated 61 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 15:54:17.724420 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a22a9b34-2055-45b1-b3f8-4d20047b0de3 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "GET /compute/v2.1/images/cafb6e84-9246-4fe7-a97d-05f8a0e3b640" status: 200 len: 1423 microversion: 2.1 time: 0.114630 Aug 31 15:54:17.725093 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 664/1411] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:54:17 2022] GET /compute/v2.1/images/cafb6e84-9246-4fe7-a97d-05f8a0e3b640 => generated 1423 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:17.735798 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ca317280-22d5-4a64-a24d-9c122ced8343 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:17.736574 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ca317280-22d5-4a64-a24d-9c122ced8343 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] [instance: e4a38af3-ba7d-4074-a628-9c7825ae3358] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:17.738832 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e468cbd0-e952-441c-9594-ccbf26fc36d0 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:17.739493 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e468cbd0-e952-441c-9594-ccbf26fc36d0 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 04a4f94b-5820-4bbe-a9b0-7fa55a697e09] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:17.754125 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ca317280-22d5-4a64-a24d-9c122ced8343 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:17.755106 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ca317280-22d5-4a64-a24d-9c122ced8343 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:17.755542 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ca317280-22d5-4a64-a24d-9c122ced8343 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:17.759241 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ca317280-22d5-4a64-a24d-9c122ced8343 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:17.759672 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ca317280-22d5-4a64-a24d-9c122ced8343 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:17.760198 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ca317280-22d5-4a64-a24d-9c122ced8343 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:17.762958 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e468cbd0-e952-441c-9594-ccbf26fc36d0 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:17.764055 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e468cbd0-e952-441c-9594-ccbf26fc36d0 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:17.764543 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e468cbd0-e952-441c-9594-ccbf26fc36d0 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:17.766275 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e468cbd0-e952-441c-9594-ccbf26fc36d0 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:17.766660 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e468cbd0-e952-441c-9594-ccbf26fc36d0 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:17.776830 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e468cbd0-e952-441c-9594-ccbf26fc36d0 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:17.892196 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ca317280-22d5-4a64-a24d-9c122ced8343 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] 10.222.0.50 "GET /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358/ips" status: 200 len: 219 microversion: 2.1 time: 0.170522 Aug 31 15:54:17.924430 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 748/1412] 10.222.0.50 () {58 vars in 1248 bytes} [Wed Aug 31 15:54:17 2022] GET /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358/ips => generated 219 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:54:17.942278 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-154af9ba-c3dc-4c37-a36d-a473fccafe3c tempest-ImagesMetadataTestJSON-1430443104 tempest-ImagesMetadataTestJSON-1430443104-project] Action: 'update_all', calling method: .version_select at 0x7fbb4678fb80>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:54:18.028516 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e468cbd0-e952-441c-9594-ccbf26fc36d0 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:18.045293 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-154af9ba-c3dc-4c37-a36d-a473fccafe3c tempest-ImagesMetadataTestJSON-1430443104 tempest-ImagesMetadataTestJSON-1430443104-project] Getting quotas for project c873ab5c4d974e60b4c87f40fdb2dd3d. Resources: dict_keys(['metadata_items']) {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:54:18.050515 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e468cbd0-e952-441c-9594-ccbf26fc36d0 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09" status: 200 len: 1469 microversion: 2.1 time: 0.321725 Aug 31 15:54:18.054106 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 665/1413] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:17 2022] GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09 => generated 1469 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:18.054445 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-154af9ba-c3dc-4c37-a36d-a473fccafe3c tempest-ImagesMetadataTestJSON-1430443104 tempest-ImagesMetadataTestJSON-1430443104-project] Getting quotas for user 05a31c13b9fb413b8706e5a7456082f9 and project c873ab5c4d974e60b4c87f40fdb2dd3d. Resources: dict_keys(['metadata_items']) {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:54:18.060604 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c34022ac-8730-4089-9ce5-b1e5d8956fd7 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:18.061321 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c34022ac-8730-4089-9ce5-b1e5d8956fd7 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] [instance: e4a38af3-ba7d-4074-a628-9c7825ae3358] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:18.069794 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c34022ac-8730-4089-9ce5-b1e5d8956fd7 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:18.070749 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c34022ac-8730-4089-9ce5-b1e5d8956fd7 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:18.071518 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c34022ac-8730-4089-9ce5-b1e5d8956fd7 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:18.072503 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c34022ac-8730-4089-9ce5-b1e5d8956fd7 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:18.073449 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c34022ac-8730-4089-9ce5-b1e5d8956fd7 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:18.074247 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c34022ac-8730-4089-9ce5-b1e5d8956fd7 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:18.124639 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c34022ac-8730-4089-9ce5-b1e5d8956fd7 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] [instance: e4a38af3-ba7d-4074-a628-9c7825ae3358] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:54:18.345804 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c34022ac-8730-4089-9ce5-b1e5d8956fd7 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358" status: 204 len: 0 microversion: 2.1 time: 0.287180 Aug 31 15:54:18.350785 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 666/1414] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:54:18 2022] DELETE /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:54:18.360128 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b0cf9223-46a7-4663-8d3c-f2a4cb1afc6c tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:18.360965 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b0cf9223-46a7-4663-8d3c-f2a4cb1afc6c tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] [instance: e4a38af3-ba7d-4074-a628-9c7825ae3358] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:18.369579 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0cf9223-46a7-4663-8d3c-f2a4cb1afc6c tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:18.370609 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0cf9223-46a7-4663-8d3c-f2a4cb1afc6c tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:18.371416 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0cf9223-46a7-4663-8d3c-f2a4cb1afc6c tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:18.372354 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0cf9223-46a7-4663-8d3c-f2a4cb1afc6c tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:18.372989 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0cf9223-46a7-4663-8d3c-f2a4cb1afc6c tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:18.374339 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0cf9223-46a7-4663-8d3c-f2a4cb1afc6c tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:18.612097 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-154af9ba-c3dc-4c37-a36d-a473fccafe3c tempest-ImagesMetadataTestJSON-1430443104 tempest-ImagesMetadataTestJSON-1430443104-project] 10.222.0.50 "PUT /compute/v2.1/images/31071273-5a29-46aa-9c04-aaa46917044d/metadata" status: 200 len: 64 microversion: 2.1 time: 0.678421 Aug 31 15:54:18.612883 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 749/1415] 10.222.0.50 () {60 vars in 1280 bytes} [Wed Aug 31 15:54:17 2022] PUT /compute/v2.1/images/31071273-5a29-46aa-9c04-aaa46917044d/metadata => generated 64 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 15:54:18.641299 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-21231979-2aae-4a78-bfd9-b2068c57f42a tempest-ImagesMetadataTestJSON-1430443104 tempest-ImagesMetadataTestJSON-1430443104-project] Calling method '.version_select at 0x7fbb4754de50>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:18.669484 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b0cf9223-46a7-4663-8d3c-f2a4cb1afc6c tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048bcefe0af04bc6a3a2995b22cbe43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87fc33005b5440098daf798066a653f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:18.682213 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b0cf9223-46a7-4663-8d3c-f2a4cb1afc6c tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] 10.222.0.50 "GET /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358" status: 200 len: 1812 microversion: 2.1 time: 0.329391 Aug 31 15:54:18.683160 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 667/1416] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:18 2022] GET /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358 => generated 1812 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:18.690287 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b9ac9009-04ce-479b-a701-6b4b78ba3d66 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:18.690982 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b9ac9009-04ce-479b-a701-6b4b78ba3d66 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] [instance: e803dd93-0c39-49a2-9bca-92bf0a789290] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:18.694831 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-21231979-2aae-4a78-bfd9-b2068c57f42a tempest-ImagesMetadataTestJSON-1430443104 tempest-ImagesMetadataTestJSON-1430443104-project] 10.222.0.50 "GET /compute/v2.1/images/31071273-5a29-46aa-9c04-aaa46917044d/metadata" status: 200 len: 64 microversion: 2.1 time: 0.075076 Aug 31 15:54:18.698154 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9ac9009-04ce-479b-a701-6b4b78ba3d66 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:18.699607 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9ac9009-04ce-479b-a701-6b4b78ba3d66 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:18.699607 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9ac9009-04ce-479b-a701-6b4b78ba3d66 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:18.700349 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9ac9009-04ce-479b-a701-6b4b78ba3d66 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:18.700808 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9ac9009-04ce-479b-a701-6b4b78ba3d66 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:18.701526 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9ac9009-04ce-479b-a701-6b4b78ba3d66 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:18.702824 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 750/1417] 10.222.0.50 () {58 vars in 1260 bytes} [Wed Aug 31 15:54:18 2022] GET /compute/v2.1/images/31071273-5a29-46aa-9c04-aaa46917044d/metadata => generated 64 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 15:54:18.708237 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c49785e8-f695-4dff-b796-7c900a180ff4 tempest-ImagesMetadataTestJSON-1430443104 tempest-ImagesMetadataTestJSON-1430443104-project] Action: 'update_all', calling method: .version_select at 0x7fbb46775a60>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:54:18.778346 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-c49785e8-f695-4dff-b796-7c900a180ff4 tempest-ImagesMetadataTestJSON-1430443104 tempest-ImagesMetadataTestJSON-1430443104-project] Getting quotas for project c873ab5c4d974e60b4c87f40fdb2dd3d. Resources: dict_keys(['metadata_items']) {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:54:18.781898 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b9ac9009-04ce-479b-a701-6b4b78ba3d66 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:18.785673 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-c49785e8-f695-4dff-b796-7c900a180ff4 tempest-ImagesMetadataTestJSON-1430443104 tempest-ImagesMetadataTestJSON-1430443104-project] Getting quotas for user 05a31c13b9fb413b8706e5a7456082f9 and project c873ab5c4d974e60b4c87f40fdb2dd3d. Resources: dict_keys(['metadata_items']) {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:54:18.792834 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b9ac9009-04ce-479b-a701-6b4b78ba3d66 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:18.795411 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b9ac9009-04ce-479b-a701-6b4b78ba3d66 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:18.797528 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b9ac9009-04ce-479b-a701-6b4b78ba3d66 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] 10.222.0.50 "GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290" status: 200 len: 1366 microversion: 2.57 time: 0.113104 Aug 31 15:54:18.812261 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 668/1418] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:54:18 2022] GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290 => generated 1366 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:54:18.825836 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-05acc8d4-7656-46bf-8eed-0dc2e09e988b tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '.version_select at 0x7fbb4656a040>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:18.933732 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-05acc8d4-7656-46bf-8eed-0dc2e09e988b tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "GET /compute/v2.1/images/cafb6e84-9246-4fe7-a97d-05f8a0e3b640" status: 200 len: 1423 microversion: 2.1 time: 0.120621 Aug 31 15:54:18.946586 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 669/1419] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:54:18 2022] GET /compute/v2.1/images/cafb6e84-9246-4fe7-a97d-05f8a0e3b640 => generated 1423 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:19.091271 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9b9c699f-430d-4021-9eb4-fd31d682668e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:19.092579 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9b9c699f-430d-4021-9eb4-fd31d682668e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 04a4f94b-5820-4bbe-a9b0-7fa55a697e09] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:19.131227 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b9c699f-430d-4021-9eb4-fd31d682668e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:19.132511 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b9c699f-430d-4021-9eb4-fd31d682668e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:19.133114 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b9c699f-430d-4021-9eb4-fd31d682668e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:19.133899 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b9c699f-430d-4021-9eb4-fd31d682668e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:19.134441 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b9c699f-430d-4021-9eb4-fd31d682668e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:19.135040 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b9c699f-430d-4021-9eb4-fd31d682668e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:19.337724 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c49785e8-f695-4dff-b796-7c900a180ff4 tempest-ImagesMetadataTestJSON-1430443104 tempest-ImagesMetadataTestJSON-1430443104-project] 10.222.0.50 "PUT /compute/v2.1/images/31071273-5a29-46aa-9c04-aaa46917044d/metadata" status: 200 len: 61 microversion: 2.1 time: 0.633715 Aug 31 15:54:19.338731 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 751/1420] 10.222.0.50 () {60 vars in 1280 bytes} [Wed Aug 31 15:54:18 2022] PUT /compute/v2.1/images/31071273-5a29-46aa-9c04-aaa46917044d/metadata => generated 61 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 15:54:19.350711 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1eb9f2be-f65e-4c25-8651-a11fdc054707 tempest-ImagesMetadataTestJSON-1430443104 tempest-ImagesMetadataTestJSON-1430443104-project] Action: 'update', calling method: .version_select at 0x7fbb4ac20160>, body: {"meta": {"os_version": "alt"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:54:19.408527 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9b9c699f-430d-4021-9eb4-fd31d682668e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:19.419561 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9b9c699f-430d-4021-9eb4-fd31d682668e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09" status: 200 len: 1469 microversion: 2.1 time: 0.340127 Aug 31 15:54:19.421293 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 670/1421] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:19 2022] GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09 => generated 1469 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:54:19.474520 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-1eb9f2be-f65e-4c25-8651-a11fdc054707 tempest-ImagesMetadataTestJSON-1430443104 tempest-ImagesMetadataTestJSON-1430443104-project] Getting quotas for project c873ab5c4d974e60b4c87f40fdb2dd3d. Resources: dict_keys(['metadata_items']) {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:54:19.490072 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-1eb9f2be-f65e-4c25-8651-a11fdc054707 tempest-ImagesMetadataTestJSON-1430443104 tempest-ImagesMetadataTestJSON-1430443104-project] Getting quotas for user 05a31c13b9fb413b8706e5a7456082f9 and project c873ab5c4d974e60b4c87f40fdb2dd3d. Resources: dict_keys(['metadata_items']) {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:54:19.734004 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-e266a67b-e503-4ee2-b259-6baa4ce76f7b req-c604eaad-c59b-4152-ba82-70adc19dd4dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0442e1d9-fa54-4957-8313-335c0f39c763", "name": "network-vif-plugged", "status": "completed", "tag": "a977db7b-bcd4-47fa-9827-fa736d70e905"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:54:19.749139 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e266a67b-e503-4ee2-b259-6baa4ce76f7b req-c604eaad-c59b-4152-ba82-70adc19dd4dc service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:19.753408 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e266a67b-e503-4ee2-b259-6baa4ce76f7b req-c604eaad-c59b-4152-ba82-70adc19dd4dc service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:19.759513 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e266a67b-e503-4ee2-b259-6baa4ce76f7b req-c604eaad-c59b-4152-ba82-70adc19dd4dc service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:19.787319 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-e266a67b-e503-4ee2-b259-6baa4ce76f7b req-c604eaad-c59b-4152-ba82-70adc19dd4dc service nova] Creating event network-vif-plugged:a977db7b-bcd4-47fa-9827-fa736d70e905 for instance 0442e1d9-fa54-4957-8313-335c0f39c763 on n-h1-833090-16 Aug 31 15:54:19.795975 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-e266a67b-e503-4ee2-b259-6baa4ce76f7b req-c604eaad-c59b-4152-ba82-70adc19dd4dc service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.341741 Aug 31 15:54:19.799035 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 671/1422] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:54:19.806168 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-58c3234b-8e8f-46c0-a2ac-d65678b3516f tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:19.807453 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-58c3234b-8e8f-46c0-a2ac-d65678b3516f tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] [instance: e4a38af3-ba7d-4074-a628-9c7825ae3358] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:19.818490 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58c3234b-8e8f-46c0-a2ac-d65678b3516f tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:19.819266 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58c3234b-8e8f-46c0-a2ac-d65678b3516f tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:19.819866 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58c3234b-8e8f-46c0-a2ac-d65678b3516f tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:19.821301 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58c3234b-8e8f-46c0-a2ac-d65678b3516f tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:19.822004 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58c3234b-8e8f-46c0-a2ac-d65678b3516f tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:19.822603 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58c3234b-8e8f-46c0-a2ac-d65678b3516f tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:19.900461 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1eb9f2be-f65e-4c25-8651-a11fdc054707 tempest-ImagesMetadataTestJSON-1430443104 tempest-ImagesMetadataTestJSON-1430443104-project] 10.222.0.50 "PUT /compute/v2.1/images/31071273-5a29-46aa-9c04-aaa46917044d/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.556311 Aug 31 15:54:19.902677 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 752/1423] 10.222.0.50 () {60 vars in 1313 bytes} [Wed Aug 31 15:54:19 2022] PUT /compute/v2.1/images/31071273-5a29-46aa-9c04-aaa46917044d/metadata/os_version => generated 31 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 15:54:19.915951 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-cc0a4fa6-2abf-40a8-8f0a-944df573b981 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:19.916871 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-cc0a4fa6-2abf-40a8-8f0a-944df573b981 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] [instance: e803dd93-0c39-49a2-9bca-92bf0a789290] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:19.924007 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:54:19.926025 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cc0a4fa6-2abf-40a8-8f0a-944df573b981 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:19.926908 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cc0a4fa6-2abf-40a8-8f0a-944df573b981 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:19.927576 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cc0a4fa6-2abf-40a8-8f0a-944df573b981 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:19.928746 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cc0a4fa6-2abf-40a8-8f0a-944df573b981 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:19.929355 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cc0a4fa6-2abf-40a8-8f0a-944df573b981 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:19.929996 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cc0a4fa6-2abf-40a8-8f0a-944df573b981 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:20.023227 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-cc0a4fa6-2abf-40a8-8f0a-944df573b981 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:20.036705 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-cc0a4fa6-2abf-40a8-8f0a-944df573b981 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:20.041096 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-cc0a4fa6-2abf-40a8-8f0a-944df573b981 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:20.042407 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-cc0a4fa6-2abf-40a8-8f0a-944df573b981 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] 10.222.0.50 "GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290" status: 200 len: 1366 microversion: 2.57 time: 0.131650 Aug 31 15:54:20.047552 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 753/1424] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:54:19 2022] GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290 => generated 1366 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:54:20.064298 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-373fab55-3339-4c96-b6c2-97ee2dacf68f tempest-ImagesMetadataTestJSON-1430443104 tempest-ImagesMetadataTestJSON-1430443104-project] Calling method '.version_select at 0x7fbb4672b940>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:20.077808 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-58c3234b-8e8f-46c0-a2ac-d65678b3516f tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048bcefe0af04bc6a3a2995b22cbe43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87fc33005b5440098daf798066a653f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:20.090658 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-58c3234b-8e8f-46c0-a2ac-d65678b3516f tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] 10.222.0.50 "GET /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358" status: 200 len: 1812 microversion: 2.1 time: 0.288767 Aug 31 15:54:20.093727 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 672/1425] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:19 2022] GET /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358 => generated 1812 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:20.104920 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0508d3b0-cfb4-4fec-a45f-5e6379bf0b18 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '.version_select at 0x7fbb468088b0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:20.134138 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-373fab55-3339-4c96-b6c2-97ee2dacf68f tempest-ImagesMetadataTestJSON-1430443104 tempest-ImagesMetadataTestJSON-1430443104-project] 10.222.0.50 "GET /compute/v2.1/images/31071273-5a29-46aa-9c04-aaa46917044d/metadata" status: 200 len: 58 microversion: 2.1 time: 0.084873 Aug 31 15:54:20.135540 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 754/1426] 10.222.0.50 () {58 vars in 1260 bytes} [Wed Aug 31 15:54:20 2022] GET /compute/v2.1/images/31071273-5a29-46aa-9c04-aaa46917044d/metadata => generated 58 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 15:54:20.147718 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1310b8f5-886d-4501-8fc9-23a54a1365c8 tempest-ImagesMetadataTestJSON-1430443104 tempest-ImagesMetadataTestJSON-1430443104-project] Action: 'update_all', calling method: .version_select at 0x7fbb468234c0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:54:20.196844 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0508d3b0-cfb4-4fec-a45f-5e6379bf0b18 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "GET /compute/v2.1/images/cafb6e84-9246-4fe7-a97d-05f8a0e3b640" status: 200 len: 1423 microversion: 2.1 time: 0.100097 Aug 31 15:54:20.199896 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 673/1427] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:54:20 2022] GET /compute/v2.1/images/cafb6e84-9246-4fe7-a97d-05f8a0e3b640 => generated 1423 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:20.264383 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-1310b8f5-886d-4501-8fc9-23a54a1365c8 tempest-ImagesMetadataTestJSON-1430443104 tempest-ImagesMetadataTestJSON-1430443104-project] Getting quotas for project c873ab5c4d974e60b4c87f40fdb2dd3d. Resources: dict_keys(['metadata_items']) {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:54:20.273916 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-1310b8f5-886d-4501-8fc9-23a54a1365c8 tempest-ImagesMetadataTestJSON-1430443104 tempest-ImagesMetadataTestJSON-1430443104-project] Getting quotas for user 05a31c13b9fb413b8706e5a7456082f9 and project c873ab5c4d974e60b4c87f40fdb2dd3d. Resources: dict_keys(['metadata_items']) {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:54:20.446990 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dd3b03a1-d88c-482c-bbf4-99deccf0e34a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:20.447963 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dd3b03a1-d88c-482c-bbf4-99deccf0e34a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 04a4f94b-5820-4bbe-a9b0-7fa55a697e09] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:20.452371 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:54:20.464779 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd3b03a1-d88c-482c-bbf4-99deccf0e34a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:20.467320 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd3b03a1-d88c-482c-bbf4-99deccf0e34a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:20.468226 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd3b03a1-d88c-482c-bbf4-99deccf0e34a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:20.469126 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd3b03a1-d88c-482c-bbf4-99deccf0e34a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:20.470213 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd3b03a1-d88c-482c-bbf4-99deccf0e34a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:20.470798 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd3b03a1-d88c-482c-bbf4-99deccf0e34a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:20.736642 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1310b8f5-886d-4501-8fc9-23a54a1365c8 tempest-ImagesMetadataTestJSON-1430443104 tempest-ImagesMetadataTestJSON-1430443104-project] 10.222.0.50 "PUT /compute/v2.1/images/31071273-5a29-46aa-9c04-aaa46917044d/metadata" status: 200 len: 61 microversion: 2.1 time: 0.594225 Aug 31 15:54:20.737569 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 755/1428] 10.222.0.50 () {60 vars in 1280 bytes} [Wed Aug 31 15:54:20 2022] PUT /compute/v2.1/images/31071273-5a29-46aa-9c04-aaa46917044d/metadata => generated 61 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 15:54:20.755820 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-dec7fe2a-40f1-41ce-8c5d-cfddd21c09a1 tempest-ImagesMetadataTestJSON-1430443104 tempest-ImagesMetadataTestJSON-1430443104-project] Action: 'create', calling method: .version_select at 0x7fbb46823ca0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:54:20.835632 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-dec7fe2a-40f1-41ce-8c5d-cfddd21c09a1 tempest-ImagesMetadataTestJSON-1430443104 tempest-ImagesMetadataTestJSON-1430443104-project] Getting quotas for project c873ab5c4d974e60b4c87f40fdb2dd3d. Resources: dict_keys(['metadata_items']) {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:54:20.851281 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-dec7fe2a-40f1-41ce-8c5d-cfddd21c09a1 tempest-ImagesMetadataTestJSON-1430443104 tempest-ImagesMetadataTestJSON-1430443104-project] Getting quotas for user 05a31c13b9fb413b8706e5a7456082f9 and project c873ab5c4d974e60b4c87f40fdb2dd3d. Resources: dict_keys(['metadata_items']) {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:54:20.949735 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dd3b03a1-d88c-482c-bbf4-99deccf0e34a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:20.977552 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dd3b03a1-d88c-482c-bbf4-99deccf0e34a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09" status: 200 len: 1469 microversion: 2.1 time: 0.532752 Aug 31 15:54:20.978280 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 674/1429] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:20 2022] GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09 => generated 1469 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:21.071290 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5ff86888-eb12-40f9-abb5-76d45aa2c6da tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:21.072181 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5ff86888-eb12-40f9-abb5-76d45aa2c6da tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] [instance: e803dd93-0c39-49a2-9bca-92bf0a789290] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:21.082164 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ff86888-eb12-40f9-abb5-76d45aa2c6da tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:21.083105 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ff86888-eb12-40f9-abb5-76d45aa2c6da tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:21.085952 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ff86888-eb12-40f9-abb5-76d45aa2c6da tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:21.086886 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ff86888-eb12-40f9-abb5-76d45aa2c6da tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:21.090164 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ff86888-eb12-40f9-abb5-76d45aa2c6da tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:21.091021 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ff86888-eb12-40f9-abb5-76d45aa2c6da tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:21.226618 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-dec7fe2a-40f1-41ce-8c5d-cfddd21c09a1 tempest-ImagesMetadataTestJSON-1430443104 tempest-ImagesMetadataTestJSON-1430443104-project] 10.222.0.50 "POST /compute/v2.1/images/31071273-5a29-46aa-9c04-aaa46917044d/metadata" status: 200 len: 85 microversion: 2.1 time: 0.475442 Aug 31 15:54:21.227222 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 756/1430] 10.222.0.50 () {60 vars in 1281 bytes} [Wed Aug 31 15:54:20 2022] POST /compute/v2.1/images/31071273-5a29-46aa-9c04-aaa46917044d/metadata => generated 85 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 15:54:21.232250 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fd861e17-c22b-4092-b236-8adf02fb039d tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:21.236207 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fd861e17-c22b-4092-b236-8adf02fb039d tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] [instance: e4a38af3-ba7d-4074-a628-9c7825ae3358] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:21.246673 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fd861e17-c22b-4092-b236-8adf02fb039d tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:21.247477 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fd861e17-c22b-4092-b236-8adf02fb039d tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:21.248142 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fd861e17-c22b-4092-b236-8adf02fb039d tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:21.249372 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fd861e17-c22b-4092-b236-8adf02fb039d tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:21.250395 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fd861e17-c22b-4092-b236-8adf02fb039d tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:21.251011 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fd861e17-c22b-4092-b236-8adf02fb039d tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:21.328244 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5ff86888-eb12-40f9-abb5-76d45aa2c6da tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:21.353609 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5ff86888-eb12-40f9-abb5-76d45aa2c6da tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:21.357628 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5ff86888-eb12-40f9-abb5-76d45aa2c6da tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:21.361696 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5ff86888-eb12-40f9-abb5-76d45aa2c6da tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] 10.222.0.50 "GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290" status: 200 len: 1366 microversion: 2.57 time: 0.294251 Aug 31 15:54:21.366369 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 675/1431] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:54:21 2022] GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290 => generated 1366 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:54:21.377534 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-827318af-cae6-487d-91d4-2e5922d9ceec tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '.version_select at 0x7fbb464c2e50>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:21.466553 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-827318af-cae6-487d-91d4-2e5922d9ceec tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "GET /compute/v2.1/images/cafb6e84-9246-4fe7-a97d-05f8a0e3b640" status: 200 len: 1423 microversion: 2.1 time: 0.097467 Aug 31 15:54:21.466890 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 676/1432] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:54:21 2022] GET /compute/v2.1/images/cafb6e84-9246-4fe7-a97d-05f8a0e3b640 => generated 1423 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:21.481534 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-265328ab-5bb4-47c0-870d-b8589d17469b tempest-ImagesMetadataTestJSON-1430443104 tempest-ImagesMetadataTestJSON-1430443104-project] Calling method '.version_select at 0x7fbb46671700>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:21.547020 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-265328ab-5bb4-47c0-870d-b8589d17469b tempest-ImagesMetadataTestJSON-1430443104 tempest-ImagesMetadataTestJSON-1430443104-project] 10.222.0.50 "GET /compute/v2.1/images/31071273-5a29-46aa-9c04-aaa46917044d/metadata" status: 200 len: 85 microversion: 2.1 time: 0.078961 Aug 31 15:54:21.548107 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 677/1433] 10.222.0.50 () {58 vars in 1260 bytes} [Wed Aug 31 15:54:21 2022] GET /compute/v2.1/images/31071273-5a29-46aa-9c04-aaa46917044d/metadata => generated 85 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 15:54:21.820723 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-fd861e17-c22b-4092-b236-8adf02fb039d tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048bcefe0af04bc6a3a2995b22cbe43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87fc33005b5440098daf798066a653f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:21.835269 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fd861e17-c22b-4092-b236-8adf02fb039d tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] 10.222.0.50 "GET /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358" status: 200 len: 1812 microversion: 2.1 time: 0.606299 Aug 31 15:54:21.850520 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 757/1434] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:21 2022] GET /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358 => generated 1812 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:22.001436 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e3eb1fc2-2c2b-4b67-90a3-1bddb589c180 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:22.002482 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e3eb1fc2-2c2b-4b67-90a3-1bddb589c180 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 04a4f94b-5820-4bbe-a9b0-7fa55a697e09] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:22.015156 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3eb1fc2-2c2b-4b67-90a3-1bddb589c180 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:22.019483 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3eb1fc2-2c2b-4b67-90a3-1bddb589c180 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:22.028265 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3eb1fc2-2c2b-4b67-90a3-1bddb589c180 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:22.029455 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3eb1fc2-2c2b-4b67-90a3-1bddb589c180 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:22.030210 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3eb1fc2-2c2b-4b67-90a3-1bddb589c180 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:22.031741 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3eb1fc2-2c2b-4b67-90a3-1bddb589c180 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:22.095105 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:54:22.391697 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-408261f1-ce05-42d1-ae75-e801bb732e45 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:22.393394 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-408261f1-ce05-42d1-ae75-e801bb732e45 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] [instance: e803dd93-0c39-49a2-9bca-92bf0a789290] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:22.409482 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-408261f1-ce05-42d1-ae75-e801bb732e45 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:22.420231 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-408261f1-ce05-42d1-ae75-e801bb732e45 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:22.423986 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-408261f1-ce05-42d1-ae75-e801bb732e45 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:22.427218 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-408261f1-ce05-42d1-ae75-e801bb732e45 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:22.431891 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-408261f1-ce05-42d1-ae75-e801bb732e45 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:22.435133 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-408261f1-ce05-42d1-ae75-e801bb732e45 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:22.712753 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-408261f1-ce05-42d1-ae75-e801bb732e45 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:22.723203 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-408261f1-ce05-42d1-ae75-e801bb732e45 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:22.724621 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-408261f1-ce05-42d1-ae75-e801bb732e45 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:22.725844 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-408261f1-ce05-42d1-ae75-e801bb732e45 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] 10.222.0.50 "GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290" status: 200 len: 1366 microversion: 2.57 time: 0.340130 Aug 31 15:54:22.736798 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 758/1435] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:54:22 2022] GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290 => generated 1366 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:54:22.743733 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-933349fa-ad78-4530-b207-d2d73f78c120 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '.version_select at 0x7fbb4ac575e0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:22.766084 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e3eb1fc2-2c2b-4b67-90a3-1bddb589c180 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:22.807204 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e3eb1fc2-2c2b-4b67-90a3-1bddb589c180 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09" status: 200 len: 1535 microversion: 2.1 time: 0.798959 Aug 31 15:54:22.808232 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 678/1436] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:21 2022] GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09 => generated 1535 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:22.824643 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-fc0048c8-d749-4e75-9af4-ee3918775313 req-2a9dd80d-d56b-4937-adf4-f082519f2d5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4a38af3-ba7d-4074-a628-9c7825ae3358", "name": "network-vif-deleted", "tag": "2f65903b-694a-4587-998c-6e75f99fcccf"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:54:22.874442 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-fc0048c8-d749-4e75-9af4-ee3918775313 req-2a9dd80d-d56b-4937-adf4-f082519f2d5a service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:22.882963 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-fc0048c8-d749-4e75-9af4-ee3918775313 req-2a9dd80d-d56b-4937-adf4-f082519f2d5a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:22.884146 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-fc0048c8-d749-4e75-9af4-ee3918775313 req-2a9dd80d-d56b-4937-adf4-f082519f2d5a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:22.914391 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-933349fa-ad78-4530-b207-d2d73f78c120 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "GET /compute/v2.1/images/cafb6e84-9246-4fe7-a97d-05f8a0e3b640" status: 200 len: 1423 microversion: 2.1 time: 0.176334 Aug 31 15:54:22.914986 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 759/1437] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:54:22 2022] GET /compute/v2.1/images/cafb6e84-9246-4fe7-a97d-05f8a0e3b640 => generated 1423 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:22.929314 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-040d920d-fee4-4172-bf31-1fcac2e389f1 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:22.929966 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-040d920d-fee4-4172-bf31-1fcac2e389f1 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] [instance: e4a38af3-ba7d-4074-a628-9c7825ae3358] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:22.935843 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-fc0048c8-d749-4e75-9af4-ee3918775313 req-2a9dd80d-d56b-4937-adf4-f082519f2d5a service nova] Creating event network-vif-deleted:2f65903b-694a-4587-998c-6e75f99fcccf for instance e4a38af3-ba7d-4074-a628-9c7825ae3358 on n-h2-833090-16 Aug 31 15:54:22.944662 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-040d920d-fee4-4172-bf31-1fcac2e389f1 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:22.948083 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-040d920d-fee4-4172-bf31-1fcac2e389f1 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:22.950186 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-fc0048c8-d749-4e75-9af4-ee3918775313 req-2a9dd80d-d56b-4937-adf4-f082519f2d5a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138157 Aug 31 15:54:22.950811 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 679/1438] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:54:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:54:22.953078 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-040d920d-fee4-4172-bf31-1fcac2e389f1 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:22.954302 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-040d920d-fee4-4172-bf31-1fcac2e389f1 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:22.955275 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-040d920d-fee4-4172-bf31-1fcac2e389f1 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:22.957834 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-040d920d-fee4-4172-bf31-1fcac2e389f1 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:23.054105 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=3 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:54:23.501815 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-040d920d-fee4-4172-bf31-1fcac2e389f1 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048bcefe0af04bc6a3a2995b22cbe43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87fc33005b5440098daf798066a653f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:23.524524 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-040d920d-fee4-4172-bf31-1fcac2e389f1 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] 10.222.0.50 "GET /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358" status: 200 len: 1770 microversion: 2.1 time: 0.605227 Aug 31 15:54:23.526723 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 760/1439] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:22 2022] GET /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358 => generated 1770 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:23.751886 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a7e6cea0-debb-4496-9e7b-809dcf748bf6 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:23.752841 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a7e6cea0-debb-4496-9e7b-809dcf748bf6 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] [instance: e803dd93-0c39-49a2-9bca-92bf0a789290] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:23.766448 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a7e6cea0-debb-4496-9e7b-809dcf748bf6 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:23.770145 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a7e6cea0-debb-4496-9e7b-809dcf748bf6 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:23.771310 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a7e6cea0-debb-4496-9e7b-809dcf748bf6 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:23.772265 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a7e6cea0-debb-4496-9e7b-809dcf748bf6 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:23.774080 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a7e6cea0-debb-4496-9e7b-809dcf748bf6 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:23.774707 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a7e6cea0-debb-4496-9e7b-809dcf748bf6 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:23.835001 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c56d5819-f060-41c2-95e2-debf4d91ddcc tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:23.835959 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c56d5819-f060-41c2-95e2-debf4d91ddcc tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 04a4f94b-5820-4bbe-a9b0-7fa55a697e09] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:23.849454 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c56d5819-f060-41c2-95e2-debf4d91ddcc tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:23.850227 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c56d5819-f060-41c2-95e2-debf4d91ddcc tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:23.851026 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c56d5819-f060-41c2-95e2-debf4d91ddcc tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:23.853079 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c56d5819-f060-41c2-95e2-debf4d91ddcc tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:23.854637 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c56d5819-f060-41c2-95e2-debf4d91ddcc tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:23.856806 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c56d5819-f060-41c2-95e2-debf4d91ddcc tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:24.152334 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a7e6cea0-debb-4496-9e7b-809dcf748bf6 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:24.173986 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a7e6cea0-debb-4496-9e7b-809dcf748bf6 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:24.178246 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a7e6cea0-debb-4496-9e7b-809dcf748bf6 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:24.183081 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a7e6cea0-debb-4496-9e7b-809dcf748bf6 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] 10.222.0.50 "GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290" status: 200 len: 1366 microversion: 2.57 time: 0.435974 Aug 31 15:54:24.184124 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 680/1440] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:54:23 2022] GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290 => generated 1366 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:54:24.202018 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0656c631-8c50-49f2-91a8-2de7a8dd7d8f tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '.version_select at 0x7fbb464c2af0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:24.287081 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0656c631-8c50-49f2-91a8-2de7a8dd7d8f tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "GET /compute/v2.1/images/cafb6e84-9246-4fe7-a97d-05f8a0e3b640" status: 200 len: 1423 microversion: 2.1 time: 0.098838 Aug 31 15:54:24.288248 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 681/1441] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:54:24 2022] GET /compute/v2.1/images/cafb6e84-9246-4fe7-a97d-05f8a0e3b640 => generated 1423 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:24.482441 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c56d5819-f060-41c2-95e2-debf4d91ddcc tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:24.500635 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c56d5819-f060-41c2-95e2-debf4d91ddcc tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09" status: 200 len: 1535 microversion: 2.1 time: 0.670829 Aug 31 15:54:24.501241 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 761/1442] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:23 2022] GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09 => generated 1535 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:54:24.533298 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-8150031a-df6d-43e7-97fe-e4d8b34d9b1b req-cd987de3-86c6-4733-b0bc-3930a78974e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4a38af3-ba7d-4074-a628-9c7825ae3358", "name": "network-vif-unplugged", "status": "completed", "tag": "d7e6779f-5f3b-407f-9773-9e0e92b5d2d6"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:54:24.553072 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a36442c9-51aa-48d0-88bf-317615b14f45 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:24.556259 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8150031a-df6d-43e7-97fe-e4d8b34d9b1b req-cd987de3-86c6-4733-b0bc-3930a78974e8 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:24.560468 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a36442c9-51aa-48d0-88bf-317615b14f45 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] [instance: e4a38af3-ba7d-4074-a628-9c7825ae3358] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:24.560974 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8150031a-df6d-43e7-97fe-e4d8b34d9b1b req-cd987de3-86c6-4733-b0bc-3930a78974e8 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:24.561760 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8150031a-df6d-43e7-97fe-e4d8b34d9b1b req-cd987de3-86c6-4733-b0bc-3930a78974e8 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:24.578362 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a36442c9-51aa-48d0-88bf-317615b14f45 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:24.579172 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a36442c9-51aa-48d0-88bf-317615b14f45 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:24.579765 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a36442c9-51aa-48d0-88bf-317615b14f45 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:24.580851 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a36442c9-51aa-48d0-88bf-317615b14f45 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:24.581461 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a36442c9-51aa-48d0-88bf-317615b14f45 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:24.582198 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a36442c9-51aa-48d0-88bf-317615b14f45 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:24.588156 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-8150031a-df6d-43e7-97fe-e4d8b34d9b1b req-cd987de3-86c6-4733-b0bc-3930a78974e8 service nova] Creating event network-vif-unplugged:d7e6779f-5f3b-407f-9773-9e0e92b5d2d6 for instance e4a38af3-ba7d-4074-a628-9c7825ae3358 on n-h2-833090-16 Aug 31 15:54:24.596197 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-8150031a-df6d-43e7-97fe-e4d8b34d9b1b req-cd987de3-86c6-4733-b0bc-3930a78974e8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069520 Aug 31 15:54:24.601776 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 682/1443] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:54:25.032782 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a36442c9-51aa-48d0-88bf-317615b14f45 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048bcefe0af04bc6a3a2995b22cbe43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87fc33005b5440098daf798066a653f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:25.070256 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a36442c9-51aa-48d0-88bf-317615b14f45 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] 10.222.0.50 "GET /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358" status: 200 len: 1655 microversion: 2.1 time: 0.515057 Aug 31 15:54:25.072318 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 762/1444] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:24 2022] GET /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358 => generated 1655 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:54:25.210521 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-79bc5a60-7d44-4774-8446-87e8ce542828 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:25.211600 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-79bc5a60-7d44-4774-8446-87e8ce542828 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] [instance: e803dd93-0c39-49a2-9bca-92bf0a789290] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:25.233060 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79bc5a60-7d44-4774-8446-87e8ce542828 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:25.241331 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79bc5a60-7d44-4774-8446-87e8ce542828 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:25.242297 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79bc5a60-7d44-4774-8446-87e8ce542828 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:25.244544 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79bc5a60-7d44-4774-8446-87e8ce542828 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:25.251410 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79bc5a60-7d44-4774-8446-87e8ce542828 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:25.254517 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79bc5a60-7d44-4774-8446-87e8ce542828 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:25.297183 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-128f44c7-0136-4d8e-8a88-4021639acaf8 req-0f7695b0-65dc-4080-89f3-e460545a829b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04a4f94b-5820-4bbe-a9b0-7fa55a697e09", "name": "network-vif-unplugged", "status": "completed", "tag": "f57c1856-6065-432f-b1a1-14b1ca0672d2"}, {"server_uuid": "e4a38af3-ba7d-4074-a628-9c7825ae3358", "name": "network-vif-deleted", "tag": "ebf441e7-25e3-470e-97ba-860218cd32be"}, {"name": "network-changed", "server_uuid": "04a4f94b-5820-4bbe-a9b0-7fa55a697e09", "tag": "f57c1856-6065-432f-b1a1-14b1ca0672d2"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:54:25.310414 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-128f44c7-0136-4d8e-8a88-4021639acaf8 req-0f7695b0-65dc-4080-89f3-e460545a829b service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:25.311232 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-128f44c7-0136-4d8e-8a88-4021639acaf8 req-0f7695b0-65dc-4080-89f3-e460545a829b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:25.311901 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-128f44c7-0136-4d8e-8a88-4021639acaf8 req-0f7695b0-65dc-4080-89f3-e460545a829b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:25.356524 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-128f44c7-0136-4d8e-8a88-4021639acaf8 req-0f7695b0-65dc-4080-89f3-e460545a829b service nova] Creating event network-vif-unplugged:f57c1856-6065-432f-b1a1-14b1ca0672d2 for instance 04a4f94b-5820-4bbe-a9b0-7fa55a697e09 on n-h1-833090-16 Aug 31 15:54:25.357258 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-128f44c7-0136-4d8e-8a88-4021639acaf8 req-0f7695b0-65dc-4080-89f3-e460545a829b service nova] Creating event network-vif-deleted:ebf441e7-25e3-470e-97ba-860218cd32be for instance e4a38af3-ba7d-4074-a628-9c7825ae3358 on n-h2-833090-16 Aug 31 15:54:25.357797 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-128f44c7-0136-4d8e-8a88-4021639acaf8 req-0f7695b0-65dc-4080-89f3-e460545a829b service nova] Creating event network-changed:f57c1856-6065-432f-b1a1-14b1ca0672d2 for instance 04a4f94b-5820-4bbe-a9b0-7fa55a697e09 on n-h1-833090-16 Aug 31 15:54:25.361484 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:54:25.366714 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [req-128f44c7-0136-4d8e-8a88-4021639acaf8 req-0f7695b0-65dc-4080-89f3-e460545a829b service nova] Instance 04a4f94b-5820-4bbe-a9b0-7fa55a697e09 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-833090-16', 'n-h1-833090-16'} {{(pid=128864) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 15:54:25.380462 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-128f44c7-0136-4d8e-8a88-4021639acaf8 req-0f7695b0-65dc-4080-89f3-e460545a829b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 523 microversion: 2.1 time: 0.100519 Aug 31 15:54:25.381835 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 763/1445] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 523 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:54:25.388877 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-acfe0a5e-e1d0-4664-9350-75ea3317b1ab tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '.version_select at 0x7fbb4ac20700>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:25.463287 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-acfe0a5e-e1d0-4664-9350-75ea3317b1ab tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "GET /compute/v2.1/images/cafb6e84-9246-4fe7-a97d-05f8a0e3b640" status: 200 len: 1423 microversion: 2.1 time: 0.078770 Aug 31 15:54:25.463910 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 764/1446] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:54:25 2022] GET /compute/v2.1/images/cafb6e84-9246-4fe7-a97d-05f8a0e3b640 => generated 1423 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:25.521936 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8f49144b-040b-4400-96a8-f803b219b91d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:25.523222 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8f49144b-040b-4400-96a8-f803b219b91d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 04a4f94b-5820-4bbe-a9b0-7fa55a697e09] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:25.550014 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8f49144b-040b-4400-96a8-f803b219b91d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:25.550821 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8f49144b-040b-4400-96a8-f803b219b91d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:25.552108 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8f49144b-040b-4400-96a8-f803b219b91d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:25.554960 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8f49144b-040b-4400-96a8-f803b219b91d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:25.556325 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8f49144b-040b-4400-96a8-f803b219b91d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:25.558473 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8f49144b-040b-4400-96a8-f803b219b91d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:25.559380 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-79bc5a60-7d44-4774-8446-87e8ce542828 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:25.569334 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-79bc5a60-7d44-4774-8446-87e8ce542828 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:25.570803 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-79bc5a60-7d44-4774-8446-87e8ce542828 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:25.583552 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-79bc5a60-7d44-4774-8446-87e8ce542828 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] 10.222.0.50 "GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290" status: 200 len: 1366 microversion: 2.57 time: 0.366247 Aug 31 15:54:25.585058 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 683/1447] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:54:25 2022] GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290 => generated 1366 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:54:26.090373 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8f49144b-040b-4400-96a8-f803b219b91d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:26.103969 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8f49144b-040b-4400-96a8-f803b219b91d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09" status: 200 len: 1535 microversion: 2.1 time: 0.586363 Aug 31 15:54:26.104569 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 765/1448] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:25 2022] GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09 => generated 1535 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:54:26.105875 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7cd1750a-b7fb-4525-9187-5574a7c5f7e8 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:26.106581 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7cd1750a-b7fb-4525-9187-5574a7c5f7e8 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] [instance: e4a38af3-ba7d-4074-a628-9c7825ae3358] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:26.117158 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cd1750a-b7fb-4525-9187-5574a7c5f7e8 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:26.119478 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cd1750a-b7fb-4525-9187-5574a7c5f7e8 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:26.120120 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cd1750a-b7fb-4525-9187-5574a7c5f7e8 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:26.122365 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cd1750a-b7fb-4525-9187-5574a7c5f7e8 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:26.123078 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cd1750a-b7fb-4525-9187-5574a7c5f7e8 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:26.127260 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cd1750a-b7fb-4525-9187-5574a7c5f7e8 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:26.214201 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cd1750a-b7fb-4525-9187-5574a7c5f7e8 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:26.220352 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cd1750a-b7fb-4525-9187-5574a7c5f7e8 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:26.221132 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cd1750a-b7fb-4525-9187-5574a7c5f7e8 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:26.221842 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-7cd1750a-b7fb-4525-9187-5574a7c5f7e8 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lazy-loading 'fault' on Instance uuid e4a38af3-ba7d-4074-a628-9c7825ae3358 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:54:26.344486 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7cd1750a-b7fb-4525-9187-5574a7c5f7e8 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048bcefe0af04bc6a3a2995b22cbe43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87fc33005b5440098daf798066a653f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:26.359869 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7cd1750a-b7fb-4525-9187-5574a7c5f7e8 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] 10.222.0.50 "GET /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358" status: 200 len: 1303 microversion: 2.1 time: 0.259154 Aug 31 15:54:26.363387 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 684/1449] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:26 2022] GET /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358 => generated 1303 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:54:26.479686 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5de6a648-b96e-4173-8c71-96adc94c422d tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '.version_select at 0x7fbb4ac20160>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:26.557236 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5de6a648-b96e-4173-8c71-96adc94c422d tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "GET /compute/v2.1/images/cafb6e84-9246-4fe7-a97d-05f8a0e3b640" status: 200 len: 1423 microversion: 2.1 time: 0.081215 Aug 31 15:54:26.557997 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 766/1450] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:54:26 2022] GET /compute/v2.1/images/cafb6e84-9246-4fe7-a97d-05f8a0e3b640 => generated 1423 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:54:26.619326 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3f816ffb-8f0a-4d4f-98c9-a9f273b6c149 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:26.621814 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3f816ffb-8f0a-4d4f-98c9-a9f273b6c149 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] [instance: e803dd93-0c39-49a2-9bca-92bf0a789290] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:26.646777 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f816ffb-8f0a-4d4f-98c9-a9f273b6c149 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:26.647539 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f816ffb-8f0a-4d4f-98c9-a9f273b6c149 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:26.649597 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f816ffb-8f0a-4d4f-98c9-a9f273b6c149 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:26.652236 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f816ffb-8f0a-4d4f-98c9-a9f273b6c149 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:26.653432 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f816ffb-8f0a-4d4f-98c9-a9f273b6c149 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:26.656216 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f816ffb-8f0a-4d4f-98c9-a9f273b6c149 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:26.732021 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:54:26.841659 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3f816ffb-8f0a-4d4f-98c9-a9f273b6c149 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:26.865815 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3f816ffb-8f0a-4d4f-98c9-a9f273b6c149 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:26.869604 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3f816ffb-8f0a-4d4f-98c9-a9f273b6c149 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:26.874577 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3f816ffb-8f0a-4d4f-98c9-a9f273b6c149 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] 10.222.0.50 "GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290" status: 200 len: 1366 microversion: 2.57 time: 0.259218 Aug 31 15:54:26.876997 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 685/1451] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:54:26 2022] GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290 => generated 1366 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:54:27.131229 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0c0eca7c-236d-47cf-8dd7-46222be146db tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:27.131843 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0c0eca7c-236d-47cf-8dd7-46222be146db tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 04a4f94b-5820-4bbe-a9b0-7fa55a697e09] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:27.140370 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0c0eca7c-236d-47cf-8dd7-46222be146db tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:27.152226 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0c0eca7c-236d-47cf-8dd7-46222be146db tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:27.156167 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0c0eca7c-236d-47cf-8dd7-46222be146db tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:27.156923 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0c0eca7c-236d-47cf-8dd7-46222be146db tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:27.162639 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0c0eca7c-236d-47cf-8dd7-46222be146db tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:27.163470 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0c0eca7c-236d-47cf-8dd7-46222be146db tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:27.393015 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-45f8e5ac-b71e-4517-8f5b-cd168a781a8b tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:27.394326 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-45f8e5ac-b71e-4517-8f5b-cd168a781a8b tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] [instance: e4a38af3-ba7d-4074-a628-9c7825ae3358] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:27.426073 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45f8e5ac-b71e-4517-8f5b-cd168a781a8b tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:27.427804 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45f8e5ac-b71e-4517-8f5b-cd168a781a8b tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:27.431882 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45f8e5ac-b71e-4517-8f5b-cd168a781a8b tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:27.433607 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45f8e5ac-b71e-4517-8f5b-cd168a781a8b tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:27.438876 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45f8e5ac-b71e-4517-8f5b-cd168a781a8b tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:27.441459 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45f8e5ac-b71e-4517-8f5b-cd168a781a8b tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:27.463113 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-45f8e5ac-b71e-4517-8f5b-cd168a781a8b tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] HTTP exception thrown: Instance e4a38af3-ba7d-4074-a628-9c7825ae3358 could not be found. Aug 31 15:54:27.470206 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-45f8e5ac-b71e-4517-8f5b-cd168a781a8b tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Request method failure captured: Aug 31 15:54:27.470206 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358 HTTP/1.1 Aug 31 15:54:27.470206 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:54:27.470206 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:54:27.470206 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:54:27.470206 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:54:27.470206 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:54:27.470206 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:54:27.470206 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:54:27.470206 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:54:27.470206 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4QEzV7UYeFoZ6CXANWsE8AGcFXL7cKP8nn17x2vQuX1Be2UEwxoivijeVSTB7REhWn5GNrXHbLfygoTIsWTTtV_gTbNFmFzo6sm4bNJW93IwqkNro8HG2ZfwaHK2pcULOylDToL-r9NAoJeJYTdwr1tAS7UUZ0kiT7pUbjwBzq1vJU Aug 31 15:54:27.470206 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:54:27.470206 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:54:27.470206 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:54:27.470206 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:54:27.470206 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:54:27.470206 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:54:27.470206 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 87fc33005b5440098daf798066a653f7 Aug 31 15:54:27.470206 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersTestMultiNic-144128256 Aug 31 15:54:27.470206 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:54:27.470206 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:54:27.472086 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/87fc33005b5440098daf798066a653f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/87fc33005b5440098daf798066a653f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/87fc33005b5440098daf798066a653f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_87fc33005b5440098daf798066a653f7", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:54:27.472086 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServersTestMultiNic-144128256 Aug 31 15:54:27.472086 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 87fc33005b5440098daf798066a653f7 Aug 31 15:54:27.472086 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersTestMultiNic-144128256 Aug 31 15:54:27.472086 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServersTestMultiNic-144128256-project Aug 31 15:54:27.472086 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:54:27.472086 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:54:27.472086 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 048bcefe0af04bc6a3a2995b22cbe43f Aug 31 15:54:27.472086 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServersTestMultiNic-144128256-project Aug 31 15:54:27.472086 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 15:54:27.472086 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance e4a38af3-ba7d-4074-a628-9c7825ae3358 could not be found. Aug 31 15:54:27.472086 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'e4a38af3-ba7d-4074-a628-9c7825ae3358'} Aug 31 15:54:27.472913 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:54:27.472913 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:54:27.472913 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:54:27.472913 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:54:27.472913 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:54:27.472913 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:54:27.472913 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:54:27.472913 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:54:27.472913 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:54:27.472913 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:54:27.472913 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4a38af3-ba7d-4074-a628-9c7825ae3358 could not be found. Aug 31 15:54:27.472913 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:54:27.472913 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:54:27.472913 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:54:27.472913 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:54:27.472913 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:54:27.472913 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:54:27.472913 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:54:27.472913 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:54:27.472913 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:54:27.474190 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:54:27.474190 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:54:27.474190 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:54:27.474190 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:54:27.474190 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:54:27.474190 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:54:27.474190 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:54:27.474190 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4a38af3-ba7d-4074-a628-9c7825ae3358 could not be found. Aug 31 15:54:27.474190 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:54:27.474190 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:54:27.474190 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:54:27.474190 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:54:27.474190 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:54:27.474190 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:54:27.474190 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:54:27.474190 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:54:27.474190 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4a38af3-ba7d-4074-a628-9c7825ae3358 could not be found. Aug 31 15:54:27.474190 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:54:27.477353 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-45f8e5ac-b71e-4517-8f5b-cd168a781a8b tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Returning 404 to user: Instance e4a38af3-ba7d-4074-a628-9c7825ae3358 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:54:27.478632 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-45f8e5ac-b71e-4517-8f5b-cd168a781a8b tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] 10.222.0.50 "GET /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358" status: 404 len: 111 microversion: 2.1 time: 0.095369 Aug 31 15:54:27.479792 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 686/1452] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:27 2022] GET /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 15:54:27.569712 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-02d6bded-301f-47ac-9711-5d32266087c4 req-89534f75-9c46-46cb-90b1-2083c365d0d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4a38af3-ba7d-4074-a628-9c7825ae3358", "name": "network-vif-deleted", "tag": "d7e6779f-5f3b-407f-9773-9e0e92b5d2d6"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:54:27.614146 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-02d6bded-301f-47ac-9711-5d32266087c4 req-89534f75-9c46-46cb-90b1-2083c365d0d3 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:27.615104 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-02d6bded-301f-47ac-9711-5d32266087c4 req-89534f75-9c46-46cb-90b1-2083c365d0d3 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:27.616989 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-02d6bded-301f-47ac-9711-5d32266087c4 req-89534f75-9c46-46cb-90b1-2083c365d0d3 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:27.655113 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-02d6bded-301f-47ac-9711-5d32266087c4 req-89534f75-9c46-46cb-90b1-2083c365d0d3 service nova] Creating event network-vif-deleted:d7e6779f-5f3b-407f-9773-9e0e92b5d2d6 for instance e4a38af3-ba7d-4074-a628-9c7825ae3358 on n-h2-833090-16 Aug 31 15:54:27.668985 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-02d6bded-301f-47ac-9711-5d32266087c4 req-89534f75-9c46-46cb-90b1-2083c365d0d3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104902 Aug 31 15:54:27.671195 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 687/1453] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:54:27.677464 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-14330df3-818e-4e8b-a586-500f7142bcb0 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '.version_select at 0x7fbb464a15e0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:27.795603 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-14330df3-818e-4e8b-a586-500f7142bcb0 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "GET /compute/v2.1/images/cafb6e84-9246-4fe7-a97d-05f8a0e3b640" status: 200 len: 1423 microversion: 2.1 time: 0.122599 Aug 31 15:54:27.796741 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 688/1454] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:54:27 2022] GET /compute/v2.1/images/cafb6e84-9246-4fe7-a97d-05f8a0e3b640 => generated 1423 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:27.902638 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-aa608579-036e-4f17-9e5a-d791991dde31 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:27.903832 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-aa608579-036e-4f17-9e5a-d791991dde31 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] [instance: e803dd93-0c39-49a2-9bca-92bf0a789290] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:27.926319 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa608579-036e-4f17-9e5a-d791991dde31 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:27.934564 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa608579-036e-4f17-9e5a-d791991dde31 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:27.937857 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa608579-036e-4f17-9e5a-d791991dde31 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:27.944597 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa608579-036e-4f17-9e5a-d791991dde31 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:27.945322 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa608579-036e-4f17-9e5a-d791991dde31 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:27.947204 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa608579-036e-4f17-9e5a-d791991dde31 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:28.084956 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0c0eca7c-236d-47cf-8dd7-46222be146db tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:28.119073 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0c0eca7c-236d-47cf-8dd7-46222be146db tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09" status: 200 len: 1535 microversion: 2.1 time: 0.983030 Aug 31 15:54:28.121730 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 767/1455] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:27 2022] GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09 => generated 1535 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:28.243885 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-aa608579-036e-4f17-9e5a-d791991dde31 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:28.267544 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-aa608579-036e-4f17-9e5a-d791991dde31 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:28.271560 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-aa608579-036e-4f17-9e5a-d791991dde31 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:28.275214 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-aa608579-036e-4f17-9e5a-d791991dde31 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] 10.222.0.50 "GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290" status: 200 len: 1366 microversion: 2.57 time: 0.377778 Aug 31 15:54:28.278074 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 689/1456] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:54:27 2022] GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290 => generated 1366 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 15:54:28.812242 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0f13e428-bf03-4e08-b0ec-f622987f34c7 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '.version_select at 0x7fbb4672bee0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:28.893916 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0f13e428-bf03-4e08-b0ec-f622987f34c7 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "GET /compute/v2.1/images/cafb6e84-9246-4fe7-a97d-05f8a0e3b640" status: 200 len: 1423 microversion: 2.1 time: 0.086406 Aug 31 15:54:28.894563 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 768/1457] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:54:28 2022] GET /compute/v2.1/images/cafb6e84-9246-4fe7-a97d-05f8a0e3b640 => generated 1423 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:29.148939 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4eb0eee0-8b89-4374-877b-0cf24812e0cf tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:29.149544 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4eb0eee0-8b89-4374-877b-0cf24812e0cf tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 04a4f94b-5820-4bbe-a9b0-7fa55a697e09] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:29.167997 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4eb0eee0-8b89-4374-877b-0cf24812e0cf tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:29.176762 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4eb0eee0-8b89-4374-877b-0cf24812e0cf tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:29.177218 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4eb0eee0-8b89-4374-877b-0cf24812e0cf tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:29.178023 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4eb0eee0-8b89-4374-877b-0cf24812e0cf tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:29.178514 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4eb0eee0-8b89-4374-877b-0cf24812e0cf tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:29.178940 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4eb0eee0-8b89-4374-877b-0cf24812e0cf tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:29.305951 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-40509e8a-4ee1-46a8-994d-c7ead2194068 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:29.307370 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-40509e8a-4ee1-46a8-994d-c7ead2194068 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] [instance: e803dd93-0c39-49a2-9bca-92bf0a789290] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:29.324489 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-40509e8a-4ee1-46a8-994d-c7ead2194068 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:29.325282 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-40509e8a-4ee1-46a8-994d-c7ead2194068 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:29.325945 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-40509e8a-4ee1-46a8-994d-c7ead2194068 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:29.327405 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-40509e8a-4ee1-46a8-994d-c7ead2194068 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:29.329505 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-40509e8a-4ee1-46a8-994d-c7ead2194068 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:29.330198 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-40509e8a-4ee1-46a8-994d-c7ead2194068 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:29.516370 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-40509e8a-4ee1-46a8-994d-c7ead2194068 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:29.546075 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-40509e8a-4ee1-46a8-994d-c7ead2194068 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:29.556942 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-40509e8a-4ee1-46a8-994d-c7ead2194068 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:29.559051 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-40509e8a-4ee1-46a8-994d-c7ead2194068 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] 10.222.0.50 "GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290" status: 200 len: 1372 microversion: 2.57 time: 0.261888 Aug 31 15:54:29.560339 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 769/1458] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:54:29 2022] GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290 => generated 1372 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:54:29.748449 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4eb0eee0-8b89-4374-877b-0cf24812e0cf tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:29.767054 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4eb0eee0-8b89-4374-877b-0cf24812e0cf tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09" status: 200 len: 1528 microversion: 2.1 time: 0.614580 Aug 31 15:54:29.768049 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 690/1459] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:29 2022] GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09 => generated 1528 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:29.788552 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-502d82f7-51e6-44bd-961e-df0a6937d396 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:29.789381 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-502d82f7-51e6-44bd-961e-df0a6937d396 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 04a4f94b-5820-4bbe-a9b0-7fa55a697e09] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:29.796320 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-502d82f7-51e6-44bd-961e-df0a6937d396 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:29.797083 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-502d82f7-51e6-44bd-961e-df0a6937d396 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:29.797812 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-502d82f7-51e6-44bd-961e-df0a6937d396 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:29.798778 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-502d82f7-51e6-44bd-961e-df0a6937d396 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:29.799567 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-502d82f7-51e6-44bd-961e-df0a6937d396 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:29.800208 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-502d82f7-51e6-44bd-961e-df0a6937d396 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:29.909944 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-12fc44ec-0600-4478-92fd-bd008488ad75 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '.version_select at 0x7fbb46808160>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:29.982934 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-12fc44ec-0600-4478-92fd-bd008488ad75 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "GET /compute/v2.1/images/cafb6e84-9246-4fe7-a97d-05f8a0e3b640" status: 200 len: 1423 microversion: 2.1 time: 0.077465 Aug 31 15:54:29.983996 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 691/1460] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:54:29 2022] GET /compute/v2.1/images/cafb6e84-9246-4fe7-a97d-05f8a0e3b640 => generated 1423 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:54:30.175794 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-502d82f7-51e6-44bd-961e-df0a6937d396 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:30.190303 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-502d82f7-51e6-44bd-961e-df0a6937d396 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09" status: 200 len: 1528 microversion: 2.1 time: 0.403974 Aug 31 15:54:30.207107 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 770/1461] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:29 2022] GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09 => generated 1528 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:30.218610 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0d6e14cf-6fc2-4f9c-a681-d35049df78c5 tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:30.231662 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-0d6e14cf-6fc2-4f9c-a681-d35049df78c5 tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] HTTP exception thrown: Flavor 6c36be30-5093-4c9c-be28-22b7f059d672 could not be found. Aug 31 15:54:30.242473 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0d6e14cf-6fc2-4f9c-a681-d35049df78c5 tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] Request method failure captured: Aug 31 15:54:30.242473 n-d-833090-16 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/flavors/6c36be30-5093-4c9c-be28-22b7f059d672 HTTP/1.1 Aug 31 15:54:30.242473 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:54:30.242473 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:54:30.242473 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:54:30.242473 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:54:30.242473 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:54:30.242473 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:54:30.242473 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:54:30.242473 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:54:30.242473 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4M55HG_wdY_10XRLxEEJfsSbRiZ3Wexya8VNjKwOp9ti2FnX-KXMHhEtrdi6XooPYjuZ2XzmZ1zuitkpel1vuM3v2BqgXAqeJpuXAFGO65-EXEGoiSH2Ux4qrNrGOPkPbCwSOl-2J62bWttWFXY43-auwSiB9dSVbHvRmNHeQ2HrdQ Aug 31 15:54:30.242473 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:54:30.242473 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:54:30.242473 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:54:30.242473 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:54:30.242473 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:54:30.242473 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:54:30.242473 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: cbcc4fab66cb488883527a9fdf315609 Aug 31 15:54:30.242473 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-MigrationsAdminTest-303256700 Aug 31 15:54:30.242473 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,admin,member Aug 31 15:54:30.242473 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,admin,member Aug 31 15:54:30.244847 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cbcc4fab66cb488883527a9fdf315609"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cbcc4fab66cb488883527a9fdf315609"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cbcc4fab66cb488883527a9fdf315609"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cbcc4fab66cb488883527a9fdf315609", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:54:30.244847 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-MigrationsAdminTest-303256700 Aug 31 15:54:30.244847 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: cbcc4fab66cb488883527a9fdf315609 Aug 31 15:54:30.244847 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-MigrationsAdminTest-303256700 Aug 31 15:54:30.244847 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-MigrationsAdminTest-303256700-project-admin Aug 31 15:54:30.244847 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:54:30.244847 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:54:30.244847 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 77b1ec7373a54f958adddae78b2ed709 Aug 31 15:54:30.244847 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-MigrationsAdminTest-303256700-project-admin Aug 31 15:54:30.244847 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 15:54:30.244847 n-d-833090-16 devstack@n-api.service[128863]: exception: Flavor 6c36be30-5093-4c9c-be28-22b7f059d672 could not be found. Aug 31 15:54:30.244847 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '6c36be30-5093-4c9c-be28-22b7f059d672'} Aug 31 15:54:30.246354 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:54:30.246354 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:54:30.246354 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Aug 31 15:54:30.246354 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi flavor.destroy() Aug 31 15:54:30.246354 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 31 15:54:30.246354 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 31 15:54:30.246354 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Aug 31 15:54:30.246354 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Aug 31 15:54:30.246354 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Aug 31 15:54:30.246354 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Aug 31 15:54:30.246354 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 31 15:54:30.246354 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 31 15:54:30.246354 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Aug 31 15:54:30.246354 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Aug 31 15:54:30.246354 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 6c36be30-5093-4c9c-be28-22b7f059d672 could not be found. Aug 31 15:54:30.246354 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:54:30.246354 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:54:30.246354 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:54:30.246354 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:54:30.246354 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:54:30.251203 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:54:30.251203 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:54:30.251203 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:54:30.251203 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:54:30.251203 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:54:30.251203 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Aug 31 15:54:30.251203 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:54:30.251203 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 6c36be30-5093-4c9c-be28-22b7f059d672 could not be found. Aug 31 15:54:30.251203 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:54:30.251203 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:54:30.251203 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:54:30.251203 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:54:30.251203 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:54:30.251203 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:54:30.251203 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:54:30.251203 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:54:30.251203 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 6c36be30-5093-4c9c-be28-22b7f059d672 could not be found. Aug 31 15:54:30.251203 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:54:30.262370 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0d6e14cf-6fc2-4f9c-a681-d35049df78c5 tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] Returning 404 to user: Flavor 6c36be30-5093-4c9c-be28-22b7f059d672 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:54:30.262370 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0d6e14cf-6fc2-4f9c-a681-d35049df78c5 tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/6c36be30-5093-4c9c-be28-22b7f059d672" status: 404 len: 109 microversion: 2.1 time: 0.041707 Aug 31 15:54:30.262370 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 692/1462] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:54:30 2022] DELETE /compute/v2.1/flavors/6c36be30-5093-4c9c-be28-22b7f059d672 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:54:30.537675 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ceef0621-59db-4f16-87a8-ed608522490a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-319087152", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:54:30.583776 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f9bcfe91-49bb-41a1-b7ec-f8577a148a24 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:30.584400 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f9bcfe91-49bb-41a1-b7ec-f8577a148a24 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] [instance: e803dd93-0c39-49a2-9bca-92bf0a789290] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:30.609095 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9bcfe91-49bb-41a1-b7ec-f8577a148a24 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:30.610599 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9bcfe91-49bb-41a1-b7ec-f8577a148a24 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:30.611778 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9bcfe91-49bb-41a1-b7ec-f8577a148a24 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:30.615691 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9bcfe91-49bb-41a1-b7ec-f8577a148a24 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:30.620875 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9bcfe91-49bb-41a1-b7ec-f8577a148a24 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:30.624408 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9bcfe91-49bb-41a1-b7ec-f8577a148a24 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:30.716069 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-ceef0621-59db-4f16-87a8-ed608522490a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] validate_networks() for None {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:54:30.842693 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f9bcfe91-49bb-41a1-b7ec-f8577a148a24 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:30.853824 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f9bcfe91-49bb-41a1-b7ec-f8577a148a24 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:30.863044 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f9bcfe91-49bb-41a1-b7ec-f8577a148a24 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:30.866198 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=32 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:54:30.874572 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f9bcfe91-49bb-41a1-b7ec-f8577a148a24 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] 10.222.0.50 "GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290" status: 200 len: 1372 microversion: 2.57 time: 0.286471 Aug 31 15:54:30.875408 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 693/1463] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:54:30 2022] GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290 => generated 1372 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:54:30.999220 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-76ca6692-6186-478b-a2ab-2ca97daa4d02 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '.version_select at 0x7fbb465439d0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:31.067686 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-76ca6692-6186-478b-a2ab-2ca97daa4d02 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "GET /compute/v2.1/images/cafb6e84-9246-4fe7-a97d-05f8a0e3b640" status: 200 len: 1423 microversion: 2.1 time: 0.072768 Aug 31 15:54:31.068271 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 694/1464] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:54:30 2022] GET /compute/v2.1/images/cafb6e84-9246-4fe7-a97d-05f8a0e3b640 => generated 1423 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:54:31.510238 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8ce30a41-aa59-4715-b600-7af83c5ba928 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-40106597", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "e71afd64-faa4-4680-b8e0-76fe805d5df1"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:54:31.634790 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-8ce30a41-aa59-4715-b600-7af83c5ba928 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] validate_networks() for [('e71afd64-faa4-4680-b8e0-76fe805d5df1', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:54:32.177899 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-ceef0621-59db-4f16-87a8-ed608522490a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:54:32.178527 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-ceef0621-59db-4f16-87a8-ed608522490a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:54:32.178813 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-ceef0621-59db-4f16-87a8-ed608522490a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:54:32.179219 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-ceef0621-59db-4f16-87a8-ed608522490a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:54:32.180063 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-ceef0621-59db-4f16-87a8-ed608522490a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:54:32.194370 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ceef0621-59db-4f16-87a8-ed608522490a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:32.197140 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ceef0621-59db-4f16-87a8-ed608522490a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:32.198604 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ceef0621-59db-4f16-87a8-ed608522490a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:32.199598 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ceef0621-59db-4f16-87a8-ed608522490a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:32.205247 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ceef0621-59db-4f16-87a8-ed608522490a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:32.206405 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ceef0621-59db-4f16-87a8-ed608522490a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:32.257497 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-ceef0621-59db-4f16-87a8-ed608522490a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Getting quotas for project 9b4c50ece07f441b8974d384f4ab29a4. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:54:32.275068 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-ceef0621-59db-4f16-87a8-ed608522490a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Getting quotas for user 5f6f8b9d63234b8199c60f842a3c407f and project 9b4c50ece07f441b8974d384f4ab29a4. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:54:32.327197 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ceef0621-59db-4f16-87a8-ed608522490a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:54:32.341052 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ceef0621-59db-4f16-87a8-ed608522490a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:54:32.480422 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ceef0621-59db-4f16-87a8-ed608522490a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.946937 Aug 31 15:54:32.481416 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 771/1465] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:54:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1949 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 15:54:32.487343 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e9f0221b-98df-45bc-b06b-d1a2ba89c82c tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:32.492958 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e9f0221b-98df-45bc-b06b-d1a2ba89c82c tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] [instance: e803dd93-0c39-49a2-9bca-92bf0a789290] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:32.519634 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e9f0221b-98df-45bc-b06b-d1a2ba89c82c tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:32.520171 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e9f0221b-98df-45bc-b06b-d1a2ba89c82c tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:32.522016 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e9f0221b-98df-45bc-b06b-d1a2ba89c82c tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:32.525716 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e9f0221b-98df-45bc-b06b-d1a2ba89c82c tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:32.526497 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e9f0221b-98df-45bc-b06b-d1a2ba89c82c tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:32.526946 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e9f0221b-98df-45bc-b06b-d1a2ba89c82c tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:32.739626 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e9f0221b-98df-45bc-b06b-d1a2ba89c82c tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:32.761143 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e9f0221b-98df-45bc-b06b-d1a2ba89c82c tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:32.767368 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e9f0221b-98df-45bc-b06b-d1a2ba89c82c tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:32.771256 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e9f0221b-98df-45bc-b06b-d1a2ba89c82c tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] 10.222.0.50 "GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290" status: 200 len: 1372 microversion: 2.57 time: 0.288498 Aug 31 15:54:32.774800 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 772/1466] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:54:32 2022] GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290 => generated 1372 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:54:32.793493 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8530abe0-69ff-477a-a116-f705d4e42b38 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '.version_select at 0x7fbb46823820>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:32.921621 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8530abe0-69ff-477a-a116-f705d4e42b38 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "GET /compute/v2.1/images/cafb6e84-9246-4fe7-a97d-05f8a0e3b640" status: 200 len: 1423 microversion: 2.1 time: 0.143833 Aug 31 15:54:32.935803 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 773/1467] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:54:32 2022] GET /compute/v2.1/images/cafb6e84-9246-4fe7-a97d-05f8a0e3b640 => generated 1423 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:32.953408 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-7173b4ad-6216-4a91-b2f7-5164522c12b5 req-5dbaf2d3-5f21-4921-88d9-bbb2200cb52f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04a4f94b-5820-4bbe-a9b0-7fa55a697e09", "name": "network-vif-plugged", "status": "completed", "tag": "f57c1856-6065-432f-b1a1-14b1ca0672d2"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:54:32.990866 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7173b4ad-6216-4a91-b2f7-5164522c12b5 req-5dbaf2d3-5f21-4921-88d9-bbb2200cb52f service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:32.995063 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7173b4ad-6216-4a91-b2f7-5164522c12b5 req-5dbaf2d3-5f21-4921-88d9-bbb2200cb52f service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:32.996324 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7173b4ad-6216-4a91-b2f7-5164522c12b5 req-5dbaf2d3-5f21-4921-88d9-bbb2200cb52f service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:33.068641 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-7173b4ad-6216-4a91-b2f7-5164522c12b5 req-5dbaf2d3-5f21-4921-88d9-bbb2200cb52f service nova] Creating event network-vif-plugged:f57c1856-6065-432f-b1a1-14b1ca0672d2 for instance 04a4f94b-5820-4bbe-a9b0-7fa55a697e09 on n-h1-833090-16 Aug 31 15:54:33.082591 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-7173b4ad-6216-4a91-b2f7-5164522c12b5 req-5dbaf2d3-5f21-4921-88d9-bbb2200cb52f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141586 Aug 31 15:54:33.085383 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 774/1468] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:54:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:54:33.094206 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-df2b9c0e-73df-4b59-ac36-b30a3c793bb8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:33.097762 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-df2b9c0e-73df-4b59-ac36-b30a3c793bb8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:33.290374 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-df2b9c0e-73df-4b59-ac36-b30a3c793bb8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:33.302939 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-df2b9c0e-73df-4b59-ac36-b30a3c793bb8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65" status: 200 len: 1212 microversion: 2.1 time: 0.215924 Aug 31 15:54:33.304132 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 775/1469] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:33 2022] GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65 => generated 1212 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:33.799255 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fe11ad01-794c-46f6-898d-c66976329814 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:33.800033 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fe11ad01-794c-46f6-898d-c66976329814 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] [instance: e803dd93-0c39-49a2-9bca-92bf0a789290] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:33.812703 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fe11ad01-794c-46f6-898d-c66976329814 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:33.813003 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-8ce30a41-aa59-4715-b600-7af83c5ba928 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:54:33.813474 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fe11ad01-794c-46f6-898d-c66976329814 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:33.813613 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fe11ad01-794c-46f6-898d-c66976329814 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:33.815785 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-8ce30a41-aa59-4715-b600-7af83c5ba928 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:54:33.816512 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-8ce30a41-aa59-4715-b600-7af83c5ba928 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:54:33.817130 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-8ce30a41-aa59-4715-b600-7af83c5ba928 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:54:33.818495 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-8ce30a41-aa59-4715-b600-7af83c5ba928 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:54:33.823051 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fe11ad01-794c-46f6-898d-c66976329814 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:33.823650 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fe11ad01-794c-46f6-898d-c66976329814 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:33.824106 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fe11ad01-794c-46f6-898d-c66976329814 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:33.830815 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ce30a41-aa59-4715-b600-7af83c5ba928 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:33.831699 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ce30a41-aa59-4715-b600-7af83c5ba928 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:33.832368 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ce30a41-aa59-4715-b600-7af83c5ba928 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:33.833521 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ce30a41-aa59-4715-b600-7af83c5ba928 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:33.834339 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ce30a41-aa59-4715-b600-7af83c5ba928 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:33.835403 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ce30a41-aa59-4715-b600-7af83c5ba928 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:33.864112 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-8ce30a41-aa59-4715-b600-7af83c5ba928 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Getting quotas for project dde27d282fc24e56a62eaeacff1431d5. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:54:33.871699 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-8ce30a41-aa59-4715-b600-7af83c5ba928 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Getting quotas for user 4d4f2146c3bc4a64b5d7f72cd136b6db and project dde27d282fc24e56a62eaeacff1431d5. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:54:33.890410 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8ce30a41-aa59-4715-b600-7af83c5ba928 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:54:33.896572 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8ce30a41-aa59-4715-b600-7af83c5ba928 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: a8003433-1952-4dca-9b3d-43c41d2b70f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:54:34.084459 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-fe11ad01-794c-46f6-898d-c66976329814 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:34.097763 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8ce30a41-aa59-4715-b600-7af83c5ba928 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.860571 Aug 31 15:54:34.110334 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 695/1470] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:54:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2875 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 15:54:34.118546 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-fe11ad01-794c-46f6-898d-c66976329814 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:34.120016 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-fe11ad01-794c-46f6-898d-c66976329814 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:34.121179 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ca8a1b7c-df14-473b-8200-b8e870a8d69c tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '.version_select at 0x7fbb46543a60>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:34.121313 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fe11ad01-794c-46f6-898d-c66976329814 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] 10.222.0.50 "GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290" status: 200 len: 1372 microversion: 2.57 time: 0.326438 Aug 31 15:54:34.167166 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 776/1471] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:54:33 2022] GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290 => generated 1372 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:54:34.190494 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e3422350-a0db-4d4c-8b18-b2fd50a96c65 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:34.191125 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e3422350-a0db-4d4c-8b18-b2fd50a96c65 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: a8003433-1952-4dca-9b3d-43c41d2b70f5] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:34.262179 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ca8a1b7c-df14-473b-8200-b8e870a8d69c tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "GET /compute/v2.1/images/cafb6e84-9246-4fe7-a97d-05f8a0e3b640" status: 200 len: 1423 microversion: 2.1 time: 0.148286 Aug 31 15:54:34.263280 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 696/1472] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:54:34 2022] GET /compute/v2.1/images/cafb6e84-9246-4fe7-a97d-05f8a0e3b640 => generated 1423 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:34.325683 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3a796d37-7775-4d94-8005-6a7f2c14b626 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:34.327104 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3a796d37-7775-4d94-8005-6a7f2c14b626 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:34.349700 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a796d37-7775-4d94-8005-6a7f2c14b626 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:34.360008 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a796d37-7775-4d94-8005-6a7f2c14b626 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:34.374900 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a796d37-7775-4d94-8005-6a7f2c14b626 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:34.376120 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a796d37-7775-4d94-8005-6a7f2c14b626 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:34.376120 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a796d37-7775-4d94-8005-6a7f2c14b626 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:34.376581 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a796d37-7775-4d94-8005-6a7f2c14b626 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:34.399737 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e3422350-a0db-4d4c-8b18-b2fd50a96c65 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:34.409223 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e3422350-a0db-4d4c-8b18-b2fd50a96c65 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/a8003433-1952-4dca-9b3d-43c41d2b70f5" status: 200 len: 1213 microversion: 2.1 time: 0.240844 Aug 31 15:54:34.425199 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 777/1473] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:34 2022] GET /compute/v2.1/servers/a8003433-1952-4dca-9b3d-43c41d2b70f5 => generated 1213 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:34.649584 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3a796d37-7775-4d94-8005-6a7f2c14b626 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:34.662693 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3a796d37-7775-4d94-8005-6a7f2c14b626 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65" status: 200 len: 1208 microversion: 2.1 time: 0.341241 Aug 31 15:54:34.663289 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 697/1474] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:34 2022] GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65 => generated 1208 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:54:35.146551 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c84b5807-b61c-45c5-b226-678f5e133617 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:35.147888 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c84b5807-b61c-45c5-b226-678f5e133617 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] [instance: e803dd93-0c39-49a2-9bca-92bf0a789290] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:35.167371 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c84b5807-b61c-45c5-b226-678f5e133617 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:35.169915 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c84b5807-b61c-45c5-b226-678f5e133617 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:35.172425 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c84b5807-b61c-45c5-b226-678f5e133617 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:35.174559 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c84b5807-b61c-45c5-b226-678f5e133617 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:35.175231 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c84b5807-b61c-45c5-b226-678f5e133617 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:35.178168 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c84b5807-b61c-45c5-b226-678f5e133617 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:35.278692 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d7446b5b-d180-4a92-bfe3-78b05e69aab2 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '.version_select at 0x7fbb465435e0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:35.368827 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d7446b5b-d180-4a92-bfe3-78b05e69aab2 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "GET /compute/v2.1/images/cafb6e84-9246-4fe7-a97d-05f8a0e3b640" status: 200 len: 1423 microversion: 2.1 time: 0.088376 Aug 31 15:54:35.372631 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 698/1475] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:54:35 2022] GET /compute/v2.1/images/cafb6e84-9246-4fe7-a97d-05f8a0e3b640 => generated 1423 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:54:35.440345 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c84b5807-b61c-45c5-b226-678f5e133617 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:35.443898 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fe24adec-5e03-40b2-8f01-dabd6e42f202 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:35.444644 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fe24adec-5e03-40b2-8f01-dabd6e42f202 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: a8003433-1952-4dca-9b3d-43c41d2b70f5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:35.455609 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c84b5807-b61c-45c5-b226-678f5e133617 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:35.459810 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c84b5807-b61c-45c5-b226-678f5e133617 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:35.460657 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe24adec-5e03-40b2-8f01-dabd6e42f202 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:35.462690 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe24adec-5e03-40b2-8f01-dabd6e42f202 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:35.464225 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c84b5807-b61c-45c5-b226-678f5e133617 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] 10.222.0.50 "GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290" status: 200 len: 1357 microversion: 2.57 time: 0.323627 Aug 31 15:54:35.465254 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe24adec-5e03-40b2-8f01-dabd6e42f202 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:35.472364 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe24adec-5e03-40b2-8f01-dabd6e42f202 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:35.473214 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe24adec-5e03-40b2-8f01-dabd6e42f202 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:35.474050 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe24adec-5e03-40b2-8f01-dabd6e42f202 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:35.484463 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 778/1476] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:54:35 2022] GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290 => generated 1357 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:54:35.497912 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f60a9b9f-b0e8-4210-a574-71d86c70e6ff tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:35.498465 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f60a9b9f-b0e8-4210-a574-71d86c70e6ff tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] [instance: e803dd93-0c39-49a2-9bca-92bf0a789290] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:35.515248 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f60a9b9f-b0e8-4210-a574-71d86c70e6ff tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:35.517832 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f60a9b9f-b0e8-4210-a574-71d86c70e6ff tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:35.518546 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f60a9b9f-b0e8-4210-a574-71d86c70e6ff tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:35.523039 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f60a9b9f-b0e8-4210-a574-71d86c70e6ff tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:35.524027 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f60a9b9f-b0e8-4210-a574-71d86c70e6ff tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:35.524637 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f60a9b9f-b0e8-4210-a574-71d86c70e6ff tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:35.595043 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f60a9b9f-b0e8-4210-a574-71d86c70e6ff tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] [instance: e803dd93-0c39-49a2-9bca-92bf0a789290] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:54:35.664007 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fe24adec-5e03-40b2-8f01-dabd6e42f202 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:35.691471 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fe24adec-5e03-40b2-8f01-dabd6e42f202 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/a8003433-1952-4dca-9b3d-43c41d2b70f5" status: 200 len: 1217 microversion: 2.1 time: 0.251094 Aug 31 15:54:35.696188 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 699/1477] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:35 2022] GET /compute/v2.1/servers/a8003433-1952-4dca-9b3d-43c41d2b70f5 => generated 1217 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:35.716071 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9adff1bf-1c52-4f8c-82d4-aa1ad79fe415 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:35.719500 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9adff1bf-1c52-4f8c-82d4-aa1ad79fe415 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:35.736960 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9adff1bf-1c52-4f8c-82d4-aa1ad79fe415 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:35.738967 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9adff1bf-1c52-4f8c-82d4-aa1ad79fe415 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:35.741040 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9adff1bf-1c52-4f8c-82d4-aa1ad79fe415 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:35.743498 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9adff1bf-1c52-4f8c-82d4-aa1ad79fe415 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:35.745302 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9adff1bf-1c52-4f8c-82d4-aa1ad79fe415 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:35.746001 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9adff1bf-1c52-4f8c-82d4-aa1ad79fe415 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:35.796204 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f60a9b9f-b0e8-4210-a574-71d86c70e6ff tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290" status: 204 len: 0 microversion: 2.57 time: 0.301894 Aug 31 15:54:35.804776 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 779/1478] 10.222.0.50 () {60 vars in 1280 bytes} [Wed Aug 31 15:54:35 2022] DELETE /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 31 15:54:35.815091 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b2fc77cd-c5c2-4fb9-8600-053fb01a0032 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:35.816073 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b2fc77cd-c5c2-4fb9-8600-053fb01a0032 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] [instance: e803dd93-0c39-49a2-9bca-92bf0a789290] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:35.847037 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b2fc77cd-c5c2-4fb9-8600-053fb01a0032 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:35.848095 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b2fc77cd-c5c2-4fb9-8600-053fb01a0032 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:35.848756 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b2fc77cd-c5c2-4fb9-8600-053fb01a0032 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:35.849625 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b2fc77cd-c5c2-4fb9-8600-053fb01a0032 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:35.853663 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b2fc77cd-c5c2-4fb9-8600-053fb01a0032 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:35.854404 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b2fc77cd-c5c2-4fb9-8600-053fb01a0032 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:36.048675 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9adff1bf-1c52-4f8c-82d4-aa1ad79fe415 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:36.062685 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9adff1bf-1c52-4f8c-82d4-aa1ad79fe415 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65" status: 200 len: 1282 microversion: 2.1 time: 0.360972 Aug 31 15:54:36.085305 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 700/1479] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:35 2022] GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65 => generated 1282 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:36.097858 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b2fc77cd-c5c2-4fb9-8600-053fb01a0032 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:36.111408 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b2fc77cd-c5c2-4fb9-8600-053fb01a0032 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:36.114623 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b2fc77cd-c5c2-4fb9-8600-053fb01a0032 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:36.124967 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b2fc77cd-c5c2-4fb9-8600-053fb01a0032 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] 10.222.0.50 "GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290" status: 200 len: 1363 microversion: 2.57 time: 0.318421 Aug 31 15:54:36.125567 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 780/1480] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:54:35 2022] GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290 => generated 1363 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:54:36.386565 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-27e16776-faa4-4476-a85c-e6214420eee2 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '.version_select at 0x7fbb4656a4c0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:36.477553 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-27e16776-faa4-4476-a85c-e6214420eee2 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "GET /compute/v2.1/images/cafb6e84-9246-4fe7-a97d-05f8a0e3b640" status: 200 len: 1423 microversion: 2.1 time: 0.095149 Aug 31 15:54:36.485130 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 701/1481] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:54:36 2022] GET /compute/v2.1/images/cafb6e84-9246-4fe7-a97d-05f8a0e3b640 => generated 1423 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:36.715804 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d46adfa0-cf0c-47c3-afe7-6235bc100136 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:36.717293 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d46adfa0-cf0c-47c3-afe7-6235bc100136 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: a8003433-1952-4dca-9b3d-43c41d2b70f5] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:36.747331 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d46adfa0-cf0c-47c3-afe7-6235bc100136 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:36.755291 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d46adfa0-cf0c-47c3-afe7-6235bc100136 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:36.756045 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d46adfa0-cf0c-47c3-afe7-6235bc100136 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:36.759295 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d46adfa0-cf0c-47c3-afe7-6235bc100136 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:36.763183 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d46adfa0-cf0c-47c3-afe7-6235bc100136 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:36.766461 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d46adfa0-cf0c-47c3-afe7-6235bc100136 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:36.953361 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d46adfa0-cf0c-47c3-afe7-6235bc100136 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:36.965779 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d46adfa0-cf0c-47c3-afe7-6235bc100136 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/a8003433-1952-4dca-9b3d-43c41d2b70f5" status: 200 len: 1265 microversion: 2.1 time: 0.253660 Aug 31 15:54:36.983295 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 781/1482] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:36 2022] GET /compute/v2.1/servers/a8003433-1952-4dca-9b3d-43c41d2b70f5 => generated 1265 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:37.084625 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-959a70aa-cd24-41e3-b82e-0316d6af32f3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:37.085239 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-959a70aa-cd24-41e3-b82e-0316d6af32f3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:37.099770 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-959a70aa-cd24-41e3-b82e-0316d6af32f3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:37.105287 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-959a70aa-cd24-41e3-b82e-0316d6af32f3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:37.109658 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-959a70aa-cd24-41e3-b82e-0316d6af32f3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:37.113018 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-959a70aa-cd24-41e3-b82e-0316d6af32f3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:37.119721 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-959a70aa-cd24-41e3-b82e-0316d6af32f3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:37.120502 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-959a70aa-cd24-41e3-b82e-0316d6af32f3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:37.156072 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-951d11a3-57a7-4ce8-aeca-8da5b5a0e61b tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:37.156922 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-951d11a3-57a7-4ce8-aeca-8da5b5a0e61b tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] [instance: e803dd93-0c39-49a2-9bca-92bf0a789290] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:37.172781 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-951d11a3-57a7-4ce8-aeca-8da5b5a0e61b tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:37.174545 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-951d11a3-57a7-4ce8-aeca-8da5b5a0e61b tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:37.177971 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-951d11a3-57a7-4ce8-aeca-8da5b5a0e61b tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:37.183352 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-951d11a3-57a7-4ce8-aeca-8da5b5a0e61b tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:37.184184 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-951d11a3-57a7-4ce8-aeca-8da5b5a0e61b tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:37.187174 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-951d11a3-57a7-4ce8-aeca-8da5b5a0e61b tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:37.406579 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-959a70aa-cd24-41e3-b82e-0316d6af32f3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:37.440304 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-959a70aa-cd24-41e3-b82e-0316d6af32f3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65" status: 200 len: 1270 microversion: 2.1 time: 0.356400 Aug 31 15:54:37.442438 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 702/1483] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:37 2022] GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65 => generated 1270 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:37.491126 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-951d11a3-57a7-4ce8-aeca-8da5b5a0e61b tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:37.492913 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-909c83a4-5b99-4fff-860a-6e0c89f9893b tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '.version_select at 0x7fbb4656aa60>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:37.509325 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-951d11a3-57a7-4ce8-aeca-8da5b5a0e61b tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:37.511323 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-951d11a3-57a7-4ce8-aeca-8da5b5a0e61b tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:37.515119 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-951d11a3-57a7-4ce8-aeca-8da5b5a0e61b tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] 10.222.0.50 "GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290" status: 200 len: 1363 microversion: 2.57 time: 0.364031 Aug 31 15:54:37.523284 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 782/1484] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:54:37 2022] GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290 => generated 1363 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:54:37.591245 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-909c83a4-5b99-4fff-860a-6e0c89f9893b tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "GET /compute/v2.1/images/cafb6e84-9246-4fe7-a97d-05f8a0e3b640" status: 200 len: 1423 microversion: 2.1 time: 0.102178 Aug 31 15:54:37.592171 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 703/1485] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:54:37 2022] GET /compute/v2.1/images/cafb6e84-9246-4fe7-a97d-05f8a0e3b640 => generated 1423 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:54:37.994930 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c060311c-1a0d-43b4-bb99-6d6a4e785180 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:37.996172 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c060311c-1a0d-43b4-bb99-6d6a4e785180 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: a8003433-1952-4dca-9b3d-43c41d2b70f5] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:38.004563 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c060311c-1a0d-43b4-bb99-6d6a4e785180 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:38.008437 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c060311c-1a0d-43b4-bb99-6d6a4e785180 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:38.011437 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c060311c-1a0d-43b4-bb99-6d6a4e785180 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:38.014557 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c060311c-1a0d-43b4-bb99-6d6a4e785180 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:38.015327 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c060311c-1a0d-43b4-bb99-6d6a4e785180 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:38.015922 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c060311c-1a0d-43b4-bb99-6d6a4e785180 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:38.126695 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c060311c-1a0d-43b4-bb99-6d6a4e785180 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:38.137994 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c060311c-1a0d-43b4-bb99-6d6a4e785180 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/a8003433-1952-4dca-9b3d-43c41d2b70f5" status: 200 len: 1283 microversion: 2.1 time: 0.145178 Aug 31 15:54:38.139303 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 783/1486] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:37 2022] GET /compute/v2.1/servers/a8003433-1952-4dca-9b3d-43c41d2b70f5 => generated 1283 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:38.464562 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-96f1d009-84f9-400a-b967-d7216a1c73b3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:38.465841 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-96f1d009-84f9-400a-b967-d7216a1c73b3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:38.485343 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-96f1d009-84f9-400a-b967-d7216a1c73b3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:38.485839 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-96f1d009-84f9-400a-b967-d7216a1c73b3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:38.488914 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-96f1d009-84f9-400a-b967-d7216a1c73b3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:38.489649 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-96f1d009-84f9-400a-b967-d7216a1c73b3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:38.490850 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-96f1d009-84f9-400a-b967-d7216a1c73b3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:38.492067 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-96f1d009-84f9-400a-b967-d7216a1c73b3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:38.543171 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9806a51a-74f0-46ec-aa72-27ba26a96c49 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:38.543699 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9806a51a-74f0-46ec-aa72-27ba26a96c49 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] [instance: e803dd93-0c39-49a2-9bca-92bf0a789290] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:38.559181 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9806a51a-74f0-46ec-aa72-27ba26a96c49 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:38.559673 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9806a51a-74f0-46ec-aa72-27ba26a96c49 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:38.560106 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9806a51a-74f0-46ec-aa72-27ba26a96c49 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:38.560872 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9806a51a-74f0-46ec-aa72-27ba26a96c49 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:38.561389 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9806a51a-74f0-46ec-aa72-27ba26a96c49 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:38.561817 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9806a51a-74f0-46ec-aa72-27ba26a96c49 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:38.830671 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9806a51a-74f0-46ec-aa72-27ba26a96c49 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:38.856034 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9806a51a-74f0-46ec-aa72-27ba26a96c49 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:38.858331 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9806a51a-74f0-46ec-aa72-27ba26a96c49 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:38.859938 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9806a51a-74f0-46ec-aa72-27ba26a96c49 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] 10.222.0.50 "GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290" status: 200 len: 1363 microversion: 2.57 time: 0.320914 Aug 31 15:54:38.876786 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 784/1487] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:54:38 2022] GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290 => generated 1363 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:54:38.886498 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-48c44ef3-60e2-48e1-9af9-ca8838d458b1 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '.version_select at 0x7fbb46788af0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:38.971224 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-48c44ef3-60e2-48e1-9af9-ca8838d458b1 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "GET /compute/v2.1/images/cafb6e84-9246-4fe7-a97d-05f8a0e3b640" status: 200 len: 1423 microversion: 2.1 time: 0.093259 Aug 31 15:54:38.971825 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 785/1488] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:54:38 2022] GET /compute/v2.1/images/cafb6e84-9246-4fe7-a97d-05f8a0e3b640 => generated 1423 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:38.986241 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6bead1b0-6970-44b9-8b81-637c4b863f0e tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-205355354", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "6d984612-f961-4325-a5b1-7673a94c5c18"}, {"uuid": "07a7cd7c-ed0f-4d83-b586-0408dcc98d68"}]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:54:39.097715 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-6bead1b0-6970-44b9-8b81-637c4b863f0e tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] validate_networks() for [('6d984612-f961-4325-a5b1-7673a94c5c18', None, None, None, None, None), ('07a7cd7c-ed0f-4d83-b586-0408dcc98d68', None, None, None, None, None)] {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:54:39.278206 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-96f1d009-84f9-400a-b967-d7216a1c73b3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:39.291829 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-96f1d009-84f9-400a-b967-d7216a1c73b3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65" status: 200 len: 1312 microversion: 2.1 time: 0.829410 Aug 31 15:54:39.292846 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 704/1489] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:38 2022] GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65 => generated 1312 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:39.325901 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1976a839-dc4b-44ce-9e3b-28da7876ac81 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:39.338571 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1976a839-dc4b-44ce-9e3b-28da7876ac81 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: a8003433-1952-4dca-9b3d-43c41d2b70f5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:39.393270 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1976a839-dc4b-44ce-9e3b-28da7876ac81 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:39.395416 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1976a839-dc4b-44ce-9e3b-28da7876ac81 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:39.397713 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1976a839-dc4b-44ce-9e3b-28da7876ac81 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:39.401621 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1976a839-dc4b-44ce-9e3b-28da7876ac81 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:39.402359 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1976a839-dc4b-44ce-9e3b-28da7876ac81 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:39.406774 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1976a839-dc4b-44ce-9e3b-28da7876ac81 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:39.727093 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1976a839-dc4b-44ce-9e3b-28da7876ac81 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:39.746160 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1976a839-dc4b-44ce-9e3b-28da7876ac81 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/a8003433-1952-4dca-9b3d-43c41d2b70f5" status: 200 len: 1271 microversion: 2.1 time: 0.434968 Aug 31 15:54:39.746781 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 705/1490] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:39 2022] GET /compute/v2.1/servers/a8003433-1952-4dca-9b3d-43c41d2b70f5 => generated 1271 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:39.884806 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e0fd4006-dde5-4333-8f8f-a82483a4a253 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:39.885140 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e0fd4006-dde5-4333-8f8f-a82483a4a253 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] [instance: e803dd93-0c39-49a2-9bca-92bf0a789290] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:39.900080 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0fd4006-dde5-4333-8f8f-a82483a4a253 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:39.900572 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0fd4006-dde5-4333-8f8f-a82483a4a253 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:39.901008 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0fd4006-dde5-4333-8f8f-a82483a4a253 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:39.901809 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0fd4006-dde5-4333-8f8f-a82483a4a253 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:39.902195 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0fd4006-dde5-4333-8f8f-a82483a4a253 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:39.902617 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0fd4006-dde5-4333-8f8f-a82483a4a253 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:40.014080 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0fd4006-dde5-4333-8f8f-a82483a4a253 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:40.014611 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0fd4006-dde5-4333-8f8f-a82483a4a253 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:40.015042 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0fd4006-dde5-4333-8f8f-a82483a4a253 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:40.015965 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-e0fd4006-dde5-4333-8f8f-a82483a4a253 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lazy-loading 'fault' on Instance uuid e803dd93-0c39-49a2-9bca-92bf0a789290 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:54:40.320212 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e0fd4006-dde5-4333-8f8f-a82483a4a253 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:40.323861 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:54:40.337586 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e0fd4006-dde5-4333-8f8f-a82483a4a253 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:40.340553 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e0fd4006-dde5-4333-8f8f-a82483a4a253 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73524e30e7874944a43f46781878f7a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c26184cb4df6a6e9627953b0b45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:40.342957 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e0fd4006-dde5-4333-8f8f-a82483a4a253 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] 10.222.0.50 "GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290" status: 200 len: 1368 microversion: 2.57 time: 0.462442 Aug 31 15:54:40.345988 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 706/1491] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:54:39 2022] GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290 => generated 1368 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 15:54:40.355644 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6bc5e9dd-1ff3-48ca-a535-5b1a55151511 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '.version_select at 0x7fbb464a14c0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:40.415531 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6bc5e9dd-1ff3-48ca-a535-5b1a55151511 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "GET /compute/v2.1/images/cafb6e84-9246-4fe7-a97d-05f8a0e3b640" status: 200 len: 1423 microversion: 2.1 time: 0.066520 Aug 31 15:54:40.416560 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 707/1492] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:54:40 2022] GET /compute/v2.1/images/cafb6e84-9246-4fe7-a97d-05f8a0e3b640 => generated 1423 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:40.422076 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9696dc02-a680-452d-8440-4911260c2b1e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:40.422970 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9696dc02-a680-452d-8440-4911260c2b1e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:40.444135 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9696dc02-a680-452d-8440-4911260c2b1e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:40.446171 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9696dc02-a680-452d-8440-4911260c2b1e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:40.446903 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9696dc02-a680-452d-8440-4911260c2b1e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:40.447929 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9696dc02-a680-452d-8440-4911260c2b1e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:40.449229 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9696dc02-a680-452d-8440-4911260c2b1e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:40.449917 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9696dc02-a680-452d-8440-4911260c2b1e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:41.803956 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9696dc02-a680-452d-8440-4911260c2b1e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:41.824771 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9696dc02-a680-452d-8440-4911260c2b1e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65" status: 200 len: 1312 microversion: 2.1 time: 1.406811 Aug 31 15:54:41.828333 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 708/1493] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:40 2022] GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65 => generated 1312 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:42.001756 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-c328287b-0ea6-4109-94bb-74f6c4f07105 req-b815c3c8-802b-4c4b-a879-c8489fe382bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d065e0ee-199e-4e8b-99ca-5801d627ce65", "tag": "b13f13ce-7cbb-472a-bc2c-bb5104160fb0"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:54:42.024285 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c328287b-0ea6-4109-94bb-74f6c4f07105 req-b815c3c8-802b-4c4b-a879-c8489fe382bb service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:42.028043 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c328287b-0ea6-4109-94bb-74f6c4f07105 req-b815c3c8-802b-4c4b-a879-c8489fe382bb service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:42.028296 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c328287b-0ea6-4109-94bb-74f6c4f07105 req-b815c3c8-802b-4c4b-a879-c8489fe382bb service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:42.060461 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-c328287b-0ea6-4109-94bb-74f6c4f07105 req-b815c3c8-802b-4c4b-a879-c8489fe382bb service nova] Creating event network-changed:b13f13ce-7cbb-472a-bc2c-bb5104160fb0 for instance d065e0ee-199e-4e8b-99ca-5801d627ce65 on n-h2-833090-16 Aug 31 15:54:42.073028 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-c328287b-0ea6-4109-94bb-74f6c4f07105 req-b815c3c8-802b-4c4b-a879-c8489fe382bb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.239480 Aug 31 15:54:42.075562 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 709/1494] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:54:42.094770 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3a8279cc-7edf-459d-b718-5d6396af33dc tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:42.102266 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3a8279cc-7edf-459d-b718-5d6396af33dc tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: a8003433-1952-4dca-9b3d-43c41d2b70f5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:42.126041 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a8279cc-7edf-459d-b718-5d6396af33dc tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:42.126626 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a8279cc-7edf-459d-b718-5d6396af33dc tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:42.127069 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a8279cc-7edf-459d-b718-5d6396af33dc tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:42.127804 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a8279cc-7edf-459d-b718-5d6396af33dc tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:42.128254 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a8279cc-7edf-459d-b718-5d6396af33dc tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:42.128693 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a8279cc-7edf-459d-b718-5d6396af33dc tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:42.234564 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:54:42.553603 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-6bead1b0-6970-44b9-8b81-637c4b863f0e tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:54:42.554329 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-6bead1b0-6970-44b9-8b81-637c4b863f0e tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:54:42.554958 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-6bead1b0-6970-44b9-8b81-637c4b863f0e tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:54:42.555510 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-6bead1b0-6970-44b9-8b81-637c4b863f0e tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:54:42.556081 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-6bead1b0-6970-44b9-8b81-637c4b863f0e tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:54:42.581258 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6bead1b0-6970-44b9-8b81-637c4b863f0e tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:42.581753 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6bead1b0-6970-44b9-8b81-637c4b863f0e tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:42.582209 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6bead1b0-6970-44b9-8b81-637c4b863f0e tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:42.590533 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6bead1b0-6970-44b9-8b81-637c4b863f0e tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:42.594412 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6bead1b0-6970-44b9-8b81-637c4b863f0e tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:42.596948 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6bead1b0-6970-44b9-8b81-637c4b863f0e tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:42.641398 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3a8279cc-7edf-459d-b718-5d6396af33dc tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:42.652818 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3a8279cc-7edf-459d-b718-5d6396af33dc tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/a8003433-1952-4dca-9b3d-43c41d2b70f5" status: 200 len: 1313 microversion: 2.1 time: 0.575855 Aug 31 15:54:42.653792 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 710/1495] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:42 2022] GET /compute/v2.1/servers/a8003433-1952-4dca-9b3d-43c41d2b70f5 => generated 1313 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:42.663306 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-21001ce3-615a-47a6-b183-577d6ec34757 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:42.663905 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-21001ce3-615a-47a6-b183-577d6ec34757 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] [instance: e803dd93-0c39-49a2-9bca-92bf0a789290] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:42.669861 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-6bead1b0-6970-44b9-8b81-637c4b863f0e tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Getting quotas for project 87fc33005b5440098daf798066a653f7. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:54:42.682695 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-6bead1b0-6970-44b9-8b81-637c4b863f0e tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Getting quotas for user 048bcefe0af04bc6a3a2995b22cbe43f and project 87fc33005b5440098daf798066a653f7. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:54:42.684287 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-21001ce3-615a-47a6-b183-577d6ec34757 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:42.684950 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-21001ce3-615a-47a6-b183-577d6ec34757 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:42.685664 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-21001ce3-615a-47a6-b183-577d6ec34757 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:42.686789 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-21001ce3-615a-47a6-b183-577d6ec34757 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:42.687415 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-21001ce3-615a-47a6-b183-577d6ec34757 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:42.687992 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-21001ce3-615a-47a6-b183-577d6ec34757 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:42.702303 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6bead1b0-6970-44b9-8b81-637c4b863f0e tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:54:42.710684 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6bead1b0-6970-44b9-8b81-637c4b863f0e tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] [instance: d90a0347-3975-4633-be62-0e57756f93df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:54:42.726503 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-21001ce3-615a-47a6-b183-577d6ec34757 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] HTTP exception thrown: Instance e803dd93-0c39-49a2-9bca-92bf0a789290 could not be found. Aug 31 15:54:42.734484 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-21001ce3-615a-47a6-b183-577d6ec34757 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Request method failure captured: Aug 31 15:54:42.734484 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290 HTTP/1.1 Aug 31 15:54:42.734484 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:54:42.734484 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:54:42.734484 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:54:42.734484 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:54:42.734484 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:54:42.734484 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:54:42.734484 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:54:42.734484 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:54:42.734484 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4QJpwISAAi8Mm7MPKTRa6vp65FvOhZNSflINqz-_gDHXuWTHIz8TFKCoHVjAbQ-7Abemo2UsRqsDy78EOro_e34sm12X6xWBL2AFEU0ee_Zca2lPrhJRvwEj5GVYOhAV9sNV74VpE37x40XFsZEhJpbF4vjFP17c7mTmzigb4YwoLE Aug 31 15:54:42.734484 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:54:42.734484 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:54:42.734484 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:54:42.734484 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:54:42.734484 n-d-833090-16 devstack@n-api.service[128863]: X-Openstack-Nova-Api-Version: 2.57 Aug 31 15:54:42.734484 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:54:42.734484 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:54:42.734484 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: ddb2c26184cb4df6a6e9627953b0b45b Aug 31 15:54:42.734484 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerShowV257Test-160395147 Aug 31 15:54:42.734484 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:54:42.734484 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:54:42.736386 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ddb2c26184cb4df6a6e9627953b0b45b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ddb2c26184cb4df6a6e9627953b0b45b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ddb2c26184cb4df6a6e9627953b0b45b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ddb2c26184cb4df6a6e9627953b0b45b", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:54:42.736386 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServerShowV257Test-160395147 Aug 31 15:54:42.736386 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: ddb2c26184cb4df6a6e9627953b0b45b Aug 31 15:54:42.736386 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerShowV257Test-160395147 Aug 31 15:54:42.736386 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServerShowV257Test-160395147-project Aug 31 15:54:42.736386 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:54:42.736386 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:54:42.736386 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 73524e30e7874944a43f46781878f7a3 Aug 31 15:54:42.736386 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServerShowV257Test-160395147-project Aug 31 15:54:42.736386 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 15:54:42.736386 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance e803dd93-0c39-49a2-9bca-92bf0a789290 could not be found. Aug 31 15:54:42.736386 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'e803dd93-0c39-49a2-9bca-92bf0a789290'} Aug 31 15:54:42.737413 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:54:42.737413 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:54:42.737413 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:54:42.737413 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:54:42.737413 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:54:42.737413 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:54:42.737413 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:54:42.737413 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:54:42.737413 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:54:42.737413 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:54:42.737413 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e803dd93-0c39-49a2-9bca-92bf0a789290 could not be found. Aug 31 15:54:42.737413 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:54:42.737413 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:54:42.737413 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:54:42.737413 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:54:42.737413 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:54:42.737413 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:54:42.737413 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:54:42.737413 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:54:42.737413 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:54:42.739305 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:54:42.739305 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:54:42.739305 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:54:42.739305 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:54:42.739305 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:54:42.739305 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:54:42.739305 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:54:42.739305 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e803dd93-0c39-49a2-9bca-92bf0a789290 could not be found. Aug 31 15:54:42.739305 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:54:42.739305 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:54:42.739305 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:54:42.739305 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:54:42.739305 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:54:42.739305 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:54:42.739305 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:54:42.739305 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:54:42.739305 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e803dd93-0c39-49a2-9bca-92bf0a789290 could not be found. Aug 31 15:54:42.739305 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:54:42.740858 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-21001ce3-615a-47a6-b183-577d6ec34757 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] Returning 404 to user: Instance e803dd93-0c39-49a2-9bca-92bf0a789290 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:54:42.740858 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-21001ce3-615a-47a6-b183-577d6ec34757 tempest-ServerShowV257Test-160395147 tempest-ServerShowV257Test-160395147-project] 10.222.0.50 "GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290" status: 404 len: 111 microversion: 2.57 time: 0.078713 Aug 31 15:54:42.753633 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 711/1496] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:54:42 2022] GET /compute/v2.1/servers/e803dd93-0c39-49a2-9bca-92bf0a789290 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 15:54:42.765340 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:54:42.769289 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b3dd543c-236a-42ba-afd9-1c2bbdae404a tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '.version_select at 0x7fbb464a1d30>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:42.865574 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6bead1b0-6970-44b9-8b81-637c4b863f0e tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.892654 Aug 31 15:54:42.869029 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 786/1497] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:54:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 3897 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 15:54:42.873050 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b3dd543c-236a-42ba-afd9-1c2bbdae404a tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "GET /compute/v2.1/images/cafb6e84-9246-4fe7-a97d-05f8a0e3b640" status: 200 len: 1432 microversion: 2.1 time: 0.117311 Aug 31 15:54:42.880443 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 712/1498] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:54:42 2022] GET /compute/v2.1/images/cafb6e84-9246-4fe7-a97d-05f8a0e3b640 => generated 1432 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:42.907866 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-45b7eee1-0f67-4d5b-865d-5c1fd96ba632 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:42.908477 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-45b7eee1-0f67-4d5b-865d-5c1fd96ba632 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:42.911164 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-eb61ec58-616d-4465-acb9-3b2716b23d6f tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:42.912555 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-eb61ec58-616d-4465-acb9-3b2716b23d6f tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:42.928263 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-eb61ec58-616d-4465-acb9-3b2716b23d6f tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:42.928767 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-eb61ec58-616d-4465-acb9-3b2716b23d6f tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:42.929203 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-eb61ec58-616d-4465-acb9-3b2716b23d6f tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:42.929917 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-eb61ec58-616d-4465-acb9-3b2716b23d6f tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:42.930396 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-eb61ec58-616d-4465-acb9-3b2716b23d6f tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:42.930816 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-eb61ec58-616d-4465-acb9-3b2716b23d6f tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:42.933124 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45b7eee1-0f67-4d5b-865d-5c1fd96ba632 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:42.934662 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45b7eee1-0f67-4d5b-865d-5c1fd96ba632 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:42.935098 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45b7eee1-0f67-4d5b-865d-5c1fd96ba632 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:42.936019 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45b7eee1-0f67-4d5b-865d-5c1fd96ba632 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:42.936479 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45b7eee1-0f67-4d5b-865d-5c1fd96ba632 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:42.936895 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45b7eee1-0f67-4d5b-865d-5c1fd96ba632 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:43.639376 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:54:43.646331 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-eb61ec58-616d-4465-acb9-3b2716b23d6f tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lazy-loading 'services' on Instance uuid 8a25dea8-1dc1-480e-a431-13d2f2270d0a {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:54:43.681974 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-eb61ec58-616d-4465-acb9-3b2716b23d6f tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a" status: 200 len: 2345 microversion: 2.25 time: 0.809836 Aug 31 15:54:43.695516 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 787/1499] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:54:42 2022] GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a => generated 2345 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:54:43.700895 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-45b7eee1-0f67-4d5b-865d-5c1fd96ba632 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:43.706982 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a25392c9-25f6-43ae-a18c-538270c112cd tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:43.708094 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a25392c9-25f6-43ae-a18c-538270c112cd tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] [instance: d90a0347-3975-4633-be62-0e57756f93df] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:43.715088 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a25392c9-25f6-43ae-a18c-538270c112cd tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:43.715856 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a25392c9-25f6-43ae-a18c-538270c112cd tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:43.716473 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a25392c9-25f6-43ae-a18c-538270c112cd tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:43.717037 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-45b7eee1-0f67-4d5b-865d-5c1fd96ba632 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65" status: 200 len: 1312 microversion: 2.1 time: 0.834768 Aug 31 15:54:43.717778 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a25392c9-25f6-43ae-a18c-538270c112cd tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:43.718916 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a25392c9-25f6-43ae-a18c-538270c112cd tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:43.719517 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a25392c9-25f6-43ae-a18c-538270c112cd tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:43.720194 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 713/1500] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:42 2022] GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65 => generated 1312 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:43.746825 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4f8d583c-808e-4cdf-974e-de71be08400d tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '.version_select at 0x7fbb464a1310>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:43.821745 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4f8d583c-808e-4cdf-974e-de71be08400d tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "GET /compute/v2.1/images/cafb6e84-9246-4fe7-a97d-05f8a0e3b640" status: 200 len: 1432 microversion: 2.1 time: 0.083641 Aug 31 15:54:43.823887 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 714/1501] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:54:43 2022] GET /compute/v2.1/images/cafb6e84-9246-4fe7-a97d-05f8a0e3b640 => generated 1432 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:43.834759 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a25392c9-25f6-43ae-a18c-538270c112cd tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048bcefe0af04bc6a3a2995b22cbe43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87fc33005b5440098daf798066a653f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:43.851825 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:54:43.870439 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a25392c9-25f6-43ae-a18c-538270c112cd tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] 10.222.0.50 "GET /compute/v2.1/servers/d90a0347-3975-4633-be62-0e57756f93df" status: 200 len: 1216 microversion: 2.1 time: 0.169929 Aug 31 15:54:43.872561 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 788/1502] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:43 2022] GET /compute/v2.1/servers/d90a0347-3975-4633-be62-0e57756f93df => generated 1216 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:43.886510 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:54:43.889283 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-61997c7f-1ab4-4bf4-8198-76bc10929878 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:43.892527 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-61997c7f-1ab4-4bf4-8198-76bc10929878 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: a8003433-1952-4dca-9b3d-43c41d2b70f5] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:43.915335 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-61997c7f-1ab4-4bf4-8198-76bc10929878 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:43.917450 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-61997c7f-1ab4-4bf4-8198-76bc10929878 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:43.919255 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-61997c7f-1ab4-4bf4-8198-76bc10929878 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:43.926223 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-61997c7f-1ab4-4bf4-8198-76bc10929878 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:43.929868 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-61997c7f-1ab4-4bf4-8198-76bc10929878 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:43.930635 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-61997c7f-1ab4-4bf4-8198-76bc10929878 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:44.072397 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0db7e7dc-e9bf-48b6-98cc-97dfb3f79ed6 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-738553427", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "cbd57e67-cabe-44b0-9027-5fa4dc677f22"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:54:44.154770 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-0db7e7dc-e9bf-48b6-98cc-97dfb3f79ed6 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] validate_networks() for [('cbd57e67-cabe-44b0-9027-5fa4dc677f22', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:54:45.031368 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-61997c7f-1ab4-4bf4-8198-76bc10929878 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:45.046060 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-61997c7f-1ab4-4bf4-8198-76bc10929878 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/a8003433-1952-4dca-9b3d-43c41d2b70f5" status: 200 len: 1313 microversion: 2.1 time: 1.166159 Aug 31 15:54:45.047136 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 789/1503] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:43 2022] GET /compute/v2.1/servers/a8003433-1952-4dca-9b3d-43c41d2b70f5 => generated 1313 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:45.054035 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1e7a1aff-ffa7-4554-9df1-2a1e3fc1384a tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:45.058311 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e7a1aff-ffa7-4554-9df1-2a1e3fc1384a tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:45.058903 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e7a1aff-ffa7-4554-9df1-2a1e3fc1384a tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:45.060941 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e7a1aff-ffa7-4554-9df1-2a1e3fc1384a tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:45.062659 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e7a1aff-ffa7-4554-9df1-2a1e3fc1384a tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:45.063474 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e7a1aff-ffa7-4554-9df1-2a1e3fc1384a tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:45.065582 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e7a1aff-ffa7-4554-9df1-2a1e3fc1384a tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:45.124787 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1e7a1aff-ffa7-4554-9df1-2a1e3fc1384a tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.060814 Aug 31 15:54:45.125894 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 790/1504] 10.222.0.50 () {60 vars in 1217 bytes} [Wed Aug 31 15:54:45 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:54:45.153772 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1a4b717e-0728-42c4-9ad6-c63e595db975 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:45.172075 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1a4b717e-0728-42c4-9ad6-c63e595db975 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] [instance: 0442e1d9-fa54-4957-8313-335c0f39c763] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:45.193979 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a4b717e-0728-42c4-9ad6-c63e595db975 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:45.201041 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a4b717e-0728-42c4-9ad6-c63e595db975 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:45.201744 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a4b717e-0728-42c4-9ad6-c63e595db975 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:45.204130 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a4b717e-0728-42c4-9ad6-c63e595db975 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:45.204877 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a4b717e-0728-42c4-9ad6-c63e595db975 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:45.214839 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a4b717e-0728-42c4-9ad6-c63e595db975 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:46.296903 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1a4b717e-0728-42c4-9ad6-c63e595db975 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0578b42db80943249238958e5fce15f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45d2345cb0e4847964e67928ab3069b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:46.311290 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1a4b717e-0728-42c4-9ad6-c63e595db975 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "GET /compute/v2.1/servers/0442e1d9-fa54-4957-8313-335c0f39c763" status: 200 len: 1466 microversion: 2.1 time: 1.160487 Aug 31 15:54:46.312184 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 791/1505] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:45 2022] GET /compute/v2.1/servers/0442e1d9-fa54-4957-8313-335c0f39c763 => generated 1466 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:46.346282 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-852640dd-5747-4f81-ad07-86b2e22a56c4 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:46.347770 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-852640dd-5747-4f81-ad07-86b2e22a56c4 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:46.366534 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-852640dd-5747-4f81-ad07-86b2e22a56c4 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:46.367041 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-852640dd-5747-4f81-ad07-86b2e22a56c4 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:46.367483 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-852640dd-5747-4f81-ad07-86b2e22a56c4 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:46.371467 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-852640dd-5747-4f81-ad07-86b2e22a56c4 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:46.371982 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-852640dd-5747-4f81-ad07-86b2e22a56c4 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:46.375547 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-852640dd-5747-4f81-ad07-86b2e22a56c4 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:47.101628 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-852640dd-5747-4f81-ad07-86b2e22a56c4 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:47.110532 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-852640dd-5747-4f81-ad07-86b2e22a56c4 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65" status: 200 len: 1312 microversion: 2.1 time: 0.778988 Aug 31 15:54:47.120054 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 792/1506] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:46 2022] GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65 => generated 1312 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:47.134877 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-18cba813-fd59-4a41-942d-01c866498707 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:47.136250 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-18cba813-fd59-4a41-942d-01c866498707 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] [instance: d90a0347-3975-4633-be62-0e57756f93df] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:47.159552 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-18cba813-fd59-4a41-942d-01c866498707 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:47.163198 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-18cba813-fd59-4a41-942d-01c866498707 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:47.163935 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-18cba813-fd59-4a41-942d-01c866498707 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:47.176242 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-18cba813-fd59-4a41-942d-01c866498707 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:47.176739 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-18cba813-fd59-4a41-942d-01c866498707 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:47.177923 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-18cba813-fd59-4a41-942d-01c866498707 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:47.353438 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-0db7e7dc-e9bf-48b6-98cc-97dfb3f79ed6 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:54:47.354285 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-0db7e7dc-e9bf-48b6-98cc-97dfb3f79ed6 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:54:47.354761 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-0db7e7dc-e9bf-48b6-98cc-97dfb3f79ed6 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:54:47.355204 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-0db7e7dc-e9bf-48b6-98cc-97dfb3f79ed6 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:54:47.355612 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-0db7e7dc-e9bf-48b6-98cc-97dfb3f79ed6 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:54:47.372624 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0db7e7dc-e9bf-48b6-98cc-97dfb3f79ed6 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:47.374121 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0db7e7dc-e9bf-48b6-98cc-97dfb3f79ed6 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:47.378338 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0db7e7dc-e9bf-48b6-98cc-97dfb3f79ed6 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:47.379399 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0db7e7dc-e9bf-48b6-98cc-97dfb3f79ed6 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:47.385079 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0db7e7dc-e9bf-48b6-98cc-97dfb3f79ed6 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:47.386013 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0db7e7dc-e9bf-48b6-98cc-97dfb3f79ed6 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:47.424141 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-0db7e7dc-e9bf-48b6-98cc-97dfb3f79ed6 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Getting quotas for project c508a07ab50746468f855f7c5893ffdc. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:54:47.442658 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-0db7e7dc-e9bf-48b6-98cc-97dfb3f79ed6 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Getting quotas for user 7d84a1872d9442b2886a8060d2e59580 and project c508a07ab50746468f855f7c5893ffdc. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:54:47.491007 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0db7e7dc-e9bf-48b6-98cc-97dfb3f79ed6 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:54:47.501294 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0db7e7dc-e9bf-48b6-98cc-97dfb3f79ed6 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: 3054bf54-101d-4e7d-b62d-bcd53d30a4bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:54:47.635241 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0db7e7dc-e9bf-48b6-98cc-97dfb3f79ed6 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.809956 Aug 31 15:54:47.641543 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 715/1507] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:54:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 3813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 15:54:47.648598 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8dafe480-a1ae-48b1-bb92-c649ed694786 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:47.654392 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8dafe480-a1ae-48b1-bb92-c649ed694786 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: a8003433-1952-4dca-9b3d-43c41d2b70f5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:47.672472 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8dafe480-a1ae-48b1-bb92-c649ed694786 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:47.677823 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8dafe480-a1ae-48b1-bb92-c649ed694786 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:47.678504 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8dafe480-a1ae-48b1-bb92-c649ed694786 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:47.679985 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8dafe480-a1ae-48b1-bb92-c649ed694786 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:47.682777 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8dafe480-a1ae-48b1-bb92-c649ed694786 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:47.683356 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8dafe480-a1ae-48b1-bb92-c649ed694786 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:47.792907 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-18cba813-fd59-4a41-942d-01c866498707 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048bcefe0af04bc6a3a2995b22cbe43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87fc33005b5440098daf798066a653f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:47.803732 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-18cba813-fd59-4a41-942d-01c866498707 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] 10.222.0.50 "GET /compute/v2.1/servers/d90a0347-3975-4633-be62-0e57756f93df" status: 200 len: 1312 microversion: 2.1 time: 0.682036 Aug 31 15:54:47.826993 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 793/1508] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:47 2022] GET /compute/v2.1/servers/d90a0347-3975-4633-be62-0e57756f93df => generated 1312 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:47.833761 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8d191a15-617f-4c83-abcf-0726a329ba41 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '.version_select at 0x7fbb467e05e0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:47.950141 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8d191a15-617f-4c83-abcf-0726a329ba41 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "GET /compute/v2.1/images/d715a41c-0e56-494a-a102-cac65831f6bd" status: 200 len: 784 microversion: 2.1 time: 0.121680 Aug 31 15:54:47.972391 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 794/1509] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:54:47 2022] GET /compute/v2.1/images/d715a41c-0e56-494a-a102-cac65831f6bd => generated 784 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:54:47.986395 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8b6ff922-9b70-4e72-87c4-8424feb9e1b2 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:47.987398 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8b6ff922-9b70-4e72-87c4-8424feb9e1b2 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: c76166e9-e2cf-4253-99e2-3f8d919099ba] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:48.015472 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b6ff922-9b70-4e72-87c4-8424feb9e1b2 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:48.015982 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b6ff922-9b70-4e72-87c4-8424feb9e1b2 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:48.042795 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b6ff922-9b70-4e72-87c4-8424feb9e1b2 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:48.043729 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b6ff922-9b70-4e72-87c4-8424feb9e1b2 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:48.044275 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b6ff922-9b70-4e72-87c4-8424feb9e1b2 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:48.047636 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b6ff922-9b70-4e72-87c4-8424feb9e1b2 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:48.072088 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8dafe480-a1ae-48b1-bb92-c649ed694786 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:48.110379 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8dafe480-a1ae-48b1-bb92-c649ed694786 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/a8003433-1952-4dca-9b3d-43c41d2b70f5" status: 200 len: 1313 microversion: 2.1 time: 0.466167 Aug 31 15:54:48.120712 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 716/1510] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:47 2022] GET /compute/v2.1/servers/a8003433-1952-4dca-9b3d-43c41d2b70f5 => generated 1313 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:48.136441 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-626125c8-19b6-44ef-b8b6-b1a847b0301e req-a98cdbaf-328c-4658-993a-9b6b9fece234 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8003433-1952-4dca-9b3d-43c41d2b70f5", "tag": "0578bc2f-1096-4994-b834-7c0ae501f931"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:54:48.147042 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8b6ff922-9b70-4e72-87c4-8424feb9e1b2 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: c76166e9-e2cf-4253-99e2-3f8d919099ba] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:54:48.167776 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-626125c8-19b6-44ef-b8b6-b1a847b0301e req-a98cdbaf-328c-4658-993a-9b6b9fece234 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:48.174902 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-626125c8-19b6-44ef-b8b6-b1a847b0301e req-a98cdbaf-328c-4658-993a-9b6b9fece234 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:48.175825 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-626125c8-19b6-44ef-b8b6-b1a847b0301e req-a98cdbaf-328c-4658-993a-9b6b9fece234 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:48.234161 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-626125c8-19b6-44ef-b8b6-b1a847b0301e req-a98cdbaf-328c-4658-993a-9b6b9fece234 service nova] Creating event network-changed:0578bc2f-1096-4994-b834-7c0ae501f931 for instance a8003433-1952-4dca-9b3d-43c41d2b70f5 on n-h2-833090-16 Aug 31 15:54:48.247358 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-626125c8-19b6-44ef-b8b6-b1a847b0301e req-a98cdbaf-328c-4658-993a-9b6b9fece234 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125273 Aug 31 15:54:48.261719 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 717/1511] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:54:48.270794 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ce87c475-31f9-4fe1-ab67-e579dfaeeea3 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:48.282809 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ce87c475-31f9-4fe1-ab67-e579dfaeeea3 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: 3054bf54-101d-4e7d-b62d-bcd53d30a4bb] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:48.389576 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8b6ff922-9b70-4e72-87c4-8424feb9e1b2 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "DELETE /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba" status: 204 len: 0 microversion: 2.1 time: 0.414284 Aug 31 15:54:48.391216 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 795/1512] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:54:47 2022] DELETE /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:54:48.400169 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-115cb7d4-31d1-4ebb-8614-b4e532e4d0ea tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:48.415731 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-115cb7d4-31d1-4ebb-8614-b4e532e4d0ea tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022099 Aug 31 15:54:48.417836 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 796/1513] 10.222.0.50 () {58 vars in 1137 bytes} [Wed Aug 31 15:54:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:54:48.426661 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3bf6099f-fcdf-407d-9c4c-5cf855c314b1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:48.427930 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3bf6099f-fcdf-407d-9c4c-5cf855c314b1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:48.436772 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3bf6099f-fcdf-407d-9c4c-5cf855c314b1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:48.437435 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3bf6099f-fcdf-407d-9c4c-5cf855c314b1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:48.437993 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3bf6099f-fcdf-407d-9c4c-5cf855c314b1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:48.438802 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3bf6099f-fcdf-407d-9c4c-5cf855c314b1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:48.439399 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3bf6099f-fcdf-407d-9c4c-5cf855c314b1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:48.439831 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3bf6099f-fcdf-407d-9c4c-5cf855c314b1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:49.326943 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ce87c475-31f9-4fe1-ab67-e579dfaeeea3 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:49.357001 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ce87c475-31f9-4fe1-ab67-e579dfaeeea3 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/3054bf54-101d-4e7d-b62d-bcd53d30a4bb" status: 200 len: 1207 microversion: 2.1 time: 1.079840 Aug 31 15:54:49.379432 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 718/1514] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:48 2022] GET /compute/v2.1/servers/3054bf54-101d-4e7d-b62d-bcd53d30a4bb => generated 1207 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:49.387038 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1255c869-28c3-4d7d-bc03-b3f1f5040d6e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f307e02b-a97c-4901-b77a-1d9c635136ce", "device": "/dev/xvdb"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:54:49.390040 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1255c869-28c3-4d7d-bc03-b3f1f5040d6e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:49.398451 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1255c869-28c3-4d7d-bc03-b3f1f5040d6e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:49.399127 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1255c869-28c3-4d7d-bc03-b3f1f5040d6e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:49.400092 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1255c869-28c3-4d7d-bc03-b3f1f5040d6e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:49.400962 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1255c869-28c3-4d7d-bc03-b3f1f5040d6e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:49.401714 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1255c869-28c3-4d7d-bc03-b3f1f5040d6e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:49.402320 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1255c869-28c3-4d7d-bc03-b3f1f5040d6e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:49.539316 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3bf6099f-fcdf-407d-9c4c-5cf855c314b1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:49.559722 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3bf6099f-fcdf-407d-9c4c-5cf855c314b1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65" status: 200 len: 1312 microversion: 2.1 time: 1.132733 Aug 31 15:54:49.561946 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 797/1515] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:48 2022] GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65 => generated 1312 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:49.566980 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-218da277-6141-4819-b6d8-9ebc27e97893 req-f3c457d4-77c3-4dc7-ba7e-394dd9de72ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0442e1d9-fa54-4957-8313-335c0f39c763", "name": "network-vif-unplugged", "status": "completed", "tag": "a977db7b-bcd4-47fa-9827-fa736d70e905"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:54:49.581918 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-218da277-6141-4819-b6d8-9ebc27e97893 req-f3c457d4-77c3-4dc7-ba7e-394dd9de72ac service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:49.583113 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-218da277-6141-4819-b6d8-9ebc27e97893 req-f3c457d4-77c3-4dc7-ba7e-394dd9de72ac service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:49.584405 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-218da277-6141-4819-b6d8-9ebc27e97893 req-f3c457d4-77c3-4dc7-ba7e-394dd9de72ac service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:49.618082 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-218da277-6141-4819-b6d8-9ebc27e97893 req-f3c457d4-77c3-4dc7-ba7e-394dd9de72ac service nova] Creating event network-vif-unplugged:a977db7b-bcd4-47fa-9827-fa736d70e905 for instance 0442e1d9-fa54-4957-8313-335c0f39c763 on n-h1-833090-16 Aug 31 15:54:49.642201 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-218da277-6141-4819-b6d8-9ebc27e97893 req-f3c457d4-77c3-4dc7-ba7e-394dd9de72ac service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078063 Aug 31 15:54:49.643744 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 798/1516] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:54:49.660831 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ea9cee04-10fd-4242-aa6b-7385cc48c04e tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:49.661644 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ea9cee04-10fd-4242-aa6b-7385cc48c04e tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: c76166e9-e2cf-4253-99e2-3f8d919099ba] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:49.672836 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ea9cee04-10fd-4242-aa6b-7385cc48c04e tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:49.673483 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ea9cee04-10fd-4242-aa6b-7385cc48c04e tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:49.674679 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ea9cee04-10fd-4242-aa6b-7385cc48c04e tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:49.675485 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ea9cee04-10fd-4242-aa6b-7385cc48c04e tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:49.676796 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ea9cee04-10fd-4242-aa6b-7385cc48c04e tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:49.677335 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ea9cee04-10fd-4242-aa6b-7385cc48c04e tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:50.016040 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1255c869-28c3-4d7d-bc03-b3f1f5040d6e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "POST /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.631838 Aug 31 15:54:50.022211 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 719/1517] 10.222.0.50 () {62 vars in 1364 bytes} [Wed Aug 31 15:54:49 2022] POST /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a/os-volume_attachments => generated 194 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:54:50.056228 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ab51e55a-66ee-4af2-aca9-db22d6c5716f tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '.version_select at 0x7fbb4645d940>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:50.225165 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ea9cee04-10fd-4242-aa6b-7385cc48c04e tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6349b0ee9e2142a8a440d4e6ae0703a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33f8cd7d4424157b410b64c7823f480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:50.239038 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ea9cee04-10fd-4242-aa6b-7385cc48c04e tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "GET /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba" status: 200 len: 1715 microversion: 2.1 time: 0.593589 Aug 31 15:54:50.252555 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 799/1518] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:49 2022] GET /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba => generated 1715 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:50.252555 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-67e93ba4-ed67-4ff4-93c6-cacf62e4a38c tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:50.253129 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-67e93ba4-ed67-4ff4-93c6-cacf62e4a38c tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] [instance: d90a0347-3975-4633-be62-0e57756f93df] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:50.280723 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-67e93ba4-ed67-4ff4-93c6-cacf62e4a38c tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:50.285412 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-67e93ba4-ed67-4ff4-93c6-cacf62e4a38c tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:50.286256 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-67e93ba4-ed67-4ff4-93c6-cacf62e4a38c tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:50.289214 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-67e93ba4-ed67-4ff4-93c6-cacf62e4a38c tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:50.289719 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-67e93ba4-ed67-4ff4-93c6-cacf62e4a38c tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:50.291828 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-67e93ba4-ed67-4ff4-93c6-cacf62e4a38c tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:50.642207 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-67e93ba4-ed67-4ff4-93c6-cacf62e4a38c tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048bcefe0af04bc6a3a2995b22cbe43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87fc33005b5440098daf798066a653f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:50.653949 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-67e93ba4-ed67-4ff4-93c6-cacf62e4a38c tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] 10.222.0.50 "GET /compute/v2.1/servers/d90a0347-3975-4633-be62-0e57756f93df" status: 200 len: 1333 microversion: 2.1 time: 0.409293 Aug 31 15:54:50.670251 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 800/1519] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:50 2022] GET /compute/v2.1/servers/d90a0347-3975-4633-be62-0e57756f93df => generated 1333 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:50.679005 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b6b4ab2e-20d9-42af-9d30-cfc41f93c760 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:50.680454 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b6b4ab2e-20d9-42af-9d30-cfc41f93c760 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: a8003433-1952-4dca-9b3d-43c41d2b70f5] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:50.693213 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b6b4ab2e-20d9-42af-9d30-cfc41f93c760 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:50.694552 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b6b4ab2e-20d9-42af-9d30-cfc41f93c760 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:50.695374 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b6b4ab2e-20d9-42af-9d30-cfc41f93c760 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:50.696680 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b6b4ab2e-20d9-42af-9d30-cfc41f93c760 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:50.697577 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b6b4ab2e-20d9-42af-9d30-cfc41f93c760 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:50.698001 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b6b4ab2e-20d9-42af-9d30-cfc41f93c760 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:51.091611 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b6b4ab2e-20d9-42af-9d30-cfc41f93c760 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:51.105596 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b6b4ab2e-20d9-42af-9d30-cfc41f93c760 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/a8003433-1952-4dca-9b3d-43c41d2b70f5" status: 200 len: 1313 microversion: 2.1 time: 0.432439 Aug 31 15:54:51.108493 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 801/1520] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:50 2022] GET /compute/v2.1/servers/a8003433-1952-4dca-9b3d-43c41d2b70f5 => generated 1313 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:51.125146 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-fc7a65e0-6a04-4ad0-a832-6fa806f6ce25 req-ed8d540c-f762-4a6b-b0ed-7f30f6efa521 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d90a0347-3975-4633-be62-0e57756f93df", "tag": "a72bbdc1-c8b4-407a-b1c4-431d6f63424f"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:54:51.142970 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-fc7a65e0-6a04-4ad0-a832-6fa806f6ce25 req-ed8d540c-f762-4a6b-b0ed-7f30f6efa521 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:51.143474 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-fc7a65e0-6a04-4ad0-a832-6fa806f6ce25 req-ed8d540c-f762-4a6b-b0ed-7f30f6efa521 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:51.144182 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-fc7a65e0-6a04-4ad0-a832-6fa806f6ce25 req-ed8d540c-f762-4a6b-b0ed-7f30f6efa521 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:51.175045 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-fc7a65e0-6a04-4ad0-a832-6fa806f6ce25 req-ed8d540c-f762-4a6b-b0ed-7f30f6efa521 service nova] Creating event network-changed:a72bbdc1-c8b4-407a-b1c4-431d6f63424f for instance d90a0347-3975-4633-be62-0e57756f93df on n-h1-833090-16 Aug 31 15:54:51.187933 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-fc7a65e0-6a04-4ad0-a832-6fa806f6ce25 req-ed8d540c-f762-4a6b-b0ed-7f30f6efa521 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078149 Aug 31 15:54:51.189222 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 802/1521] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:54:51.209534 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-99ec8da0-85d8-4f51-ab79-14dc279d9a96 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:51.210303 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-99ec8da0-85d8-4f51-ab79-14dc279d9a96 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: 3054bf54-101d-4e7d-b62d-bcd53d30a4bb] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:51.241003 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-99ec8da0-85d8-4f51-ab79-14dc279d9a96 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:51.241689 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-99ec8da0-85d8-4f51-ab79-14dc279d9a96 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:51.242495 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-99ec8da0-85d8-4f51-ab79-14dc279d9a96 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:51.244174 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-99ec8da0-85d8-4f51-ab79-14dc279d9a96 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:51.246851 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-99ec8da0-85d8-4f51-ab79-14dc279d9a96 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:51.247700 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-99ec8da0-85d8-4f51-ab79-14dc279d9a96 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:51.359683 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ab51e55a-66ee-4af2-aca9-db22d6c5716f tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "DELETE /compute/v2.1/images/cafb6e84-9246-4fe7-a97d-05f8a0e3b640" status: 204 len: 0 microversion: 2.1 time: 1.338137 Aug 31 15:54:51.360151 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 720/1522] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:50 2022] DELETE /compute/v2.1/images/cafb6e84-9246-4fe7-a97d-05f8a0e3b640 => generated 0 bytes in 1341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:54:51.364884 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-39717cc9-9b4d-4669-a51b-f36ce1cf3be6 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:51.365744 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-39717cc9-9b4d-4669-a51b-f36ce1cf3be6 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:51.390776 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:54:51.396452 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39717cc9-9b4d-4669-a51b-f36ce1cf3be6 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:51.397799 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39717cc9-9b4d-4669-a51b-f36ce1cf3be6 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:51.398807 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39717cc9-9b4d-4669-a51b-f36ce1cf3be6 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:51.400273 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39717cc9-9b4d-4669-a51b-f36ce1cf3be6 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:51.401434 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39717cc9-9b4d-4669-a51b-f36ce1cf3be6 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:51.401861 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39717cc9-9b4d-4669-a51b-f36ce1cf3be6 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:51.668765 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-99ec8da0-85d8-4f51-ab79-14dc279d9a96 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:51.678608 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-99ec8da0-85d8-4f51-ab79-14dc279d9a96 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/3054bf54-101d-4e7d-b62d-bcd53d30a4bb" status: 200 len: 1307 microversion: 2.1 time: 0.486940 Aug 31 15:54:51.682429 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 803/1523] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:51 2022] GET /compute/v2.1/servers/3054bf54-101d-4e7d-b62d-bcd53d30a4bb => generated 1307 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:51.689658 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-17d1a512-7ada-4f1f-a765-c90897aeb5d1 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:51.690649 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-17d1a512-7ada-4f1f-a765-c90897aeb5d1 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: c76166e9-e2cf-4253-99e2-3f8d919099ba] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:51.700508 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-17d1a512-7ada-4f1f-a765-c90897aeb5d1 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:51.701003 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-17d1a512-7ada-4f1f-a765-c90897aeb5d1 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:51.701440 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-17d1a512-7ada-4f1f-a765-c90897aeb5d1 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:51.702171 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-17d1a512-7ada-4f1f-a765-c90897aeb5d1 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:51.702847 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-17d1a512-7ada-4f1f-a765-c90897aeb5d1 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:51.703269 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-17d1a512-7ada-4f1f-a765-c90897aeb5d1 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:51.777862 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-39717cc9-9b4d-4669-a51b-f36ce1cf3be6 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:51.791548 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-39717cc9-9b4d-4669-a51b-f36ce1cf3be6 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65" status: 200 len: 1312 microversion: 2.1 time: 0.430399 Aug 31 15:54:51.796442 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 721/1524] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:51 2022] GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65 => generated 1312 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:51.806989 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-35c5878d-041d-47fb-abb2-a8b4d5a53de2 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '.version_select at 0x7fbb4645da60>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:51.835354 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-35c5878d-041d-47fb-abb2-a8b4d5a53de2 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] HTTP exception thrown: Image not found. Aug 31 15:54:51.838249 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-35c5878d-041d-47fb-abb2-a8b4d5a53de2 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Request method failure captured: Aug 31 15:54:51.838249 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/images/cafb6e84-9246-4fe7-a97d-05f8a0e3b640 HTTP/1.1 Aug 31 15:54:51.838249 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:54:51.838249 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:54:51.838249 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:54:51.838249 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:54:51.838249 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:54:51.838249 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:54:51.838249 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:54:51.838249 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:54:51.838249 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4QVQYNk5_sHDuHLSUKMwE3UeAFTW43NrI5LZQyq17QjM7Tm_NNDHOYwyDkqduzPdovqCgxFK2mabNmxzK5helNFaxArTkN6djKzZKb0J3uLMX_RPzOQxBGt-NklOg-saYpjwR3tvbqrZBqYIXS5wJcla3v6T1J9CnCi_PTvOv1_D6U Aug 31 15:54:51.838249 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:54:51.838249 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:54:51.838249 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:54:51.838249 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:54:51.838249 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:54:51.838249 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:54:51.838249 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: a45d2345cb0e4847964e67928ab3069b Aug 31 15:54:51.838249 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ImagesOneServerTestJSON-2096053179 Aug 31 15:54:51.838249 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:54:51.838249 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:54:51.840124 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a45d2345cb0e4847964e67928ab3069b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a45d2345cb0e4847964e67928ab3069b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a45d2345cb0e4847964e67928ab3069b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a45d2345cb0e4847964e67928ab3069b", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:54:51.840124 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ImagesOneServerTestJSON-2096053179 Aug 31 15:54:51.840124 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: a45d2345cb0e4847964e67928ab3069b Aug 31 15:54:51.840124 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-2096053179 Aug 31 15:54:51.840124 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ImagesOneServerTestJSON-2096053179-project Aug 31 15:54:51.840124 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:54:51.840124 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:54:51.840124 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 0578b42db80943249238958e5fce15f1 Aug 31 15:54:51.840124 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ImagesOneServerTestJSON-2096053179-project Aug 31 15:54:51.840124 n-d-833090-16 devstack@n-api.service[128863]: method: Aug 31 15:54:51.840124 n-d-833090-16 devstack@n-api.service[128863]: exception: Image not found. Aug 31 15:54:51.840124 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'cafb6e84-9246-4fe7-a97d-05f8a0e3b640'} Aug 31 15:54:51.840124 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:54:51.841183 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:54:51.841183 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 31 15:54:51.841183 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 31 15:54:51.841183 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 15:54:51.841183 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 15:54:51.841183 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 31 15:54:51.841183 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 31 15:54:51.841183 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 15:54:51.841183 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 15:54:51.841183 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 31 15:54:51.841183 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 31 15:54:51.841183 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 31 15:54:51.841183 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 31 15:54:51.841183 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 15:54:51.841183 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 15:54:51.841183 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 15:54:51.841183 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 15:54:51.841183 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID cafb6e84-9246-4fe7-a97d-05f8a0e3b640 Aug 31 15:54:51.842653 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:54:51.842653 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:54:51.842653 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:54:51.842653 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:54:51.842653 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 31 15:54:51.842653 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 31 15:54:51.842653 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 31 15:54:51.842653 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 31 15:54:51.842653 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 31 15:54:51.842653 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 31 15:54:51.842653 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 31 15:54:51.842653 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 31 15:54:51.842653 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 31 15:54:51.842653 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 31 15:54:51.842653 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 15:54:51.842653 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 15:54:51.842653 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 31 15:54:51.842653 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 31 15:54:51.842653 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 15:54:51.842653 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 15:54:51.845416 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 31 15:54:51.845416 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 31 15:54:51.845416 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 31 15:54:51.845416 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 31 15:54:51.845416 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 15:54:51.845416 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 15:54:51.845416 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 15:54:51.845416 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 15:54:51.845416 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cafb6e84-9246-4fe7-a97d-05f8a0e3b640 could not be found. Aug 31 15:54:51.845416 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:54:51.845416 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:54:51.845416 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:54:51.845416 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:54:51.845416 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:54:51.845416 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:54:51.845416 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:54:51.845416 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:54:51.845416 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:54:51.845416 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:54:51.851571 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:54:51.851571 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:54:51.851571 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 31 15:54:51.851571 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 31 15:54:51.851571 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 31 15:54:51.851571 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:54:51.851571 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:54:51.851571 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:54:51.851571 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:54:51.851571 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:54:51.851571 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:54:51.851571 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:54:51.851571 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:54:51.851571 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 31 15:54:51.851571 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:54:51.851571 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-35c5878d-041d-47fb-abb2-a8b4d5a53de2 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Returning 404 to user: Image not found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:54:51.851571 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-35c5878d-041d-47fb-abb2-a8b4d5a53de2 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "GET /compute/v2.1/images/cafb6e84-9246-4fe7-a97d-05f8a0e3b640" status: 404 len: 62 microversion: 2.1 time: 0.042033 Aug 31 15:54:51.853650 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 722/1525] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:54:51 2022] GET /compute/v2.1/images/cafb6e84-9246-4fe7-a97d-05f8a0e3b640 => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 15:54:51.855266 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-b6596478-e669-451b-9a25-7bca23f8a31d req-bd638698-3c08-4c69-a1c1-e6f4d3bad253 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d065e0ee-199e-4e8b-99ca-5801d627ce65", "name": "network-vif-plugged", "status": "completed", "tag": "b13f13ce-7cbb-472a-bc2c-bb5104160fb0"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:54:51.900363 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b6596478-e669-451b-9a25-7bca23f8a31d req-bd638698-3c08-4c69-a1c1-e6f4d3bad253 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:51.902001 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b6596478-e669-451b-9a25-7bca23f8a31d req-bd638698-3c08-4c69-a1c1-e6f4d3bad253 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:51.903853 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b6596478-e669-451b-9a25-7bca23f8a31d req-bd638698-3c08-4c69-a1c1-e6f4d3bad253 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:51.933994 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-b6596478-e669-451b-9a25-7bca23f8a31d req-bd638698-3c08-4c69-a1c1-e6f4d3bad253 service nova] Creating event network-vif-plugged:b13f13ce-7cbb-472a-bc2c-bb5104160fb0 for instance d065e0ee-199e-4e8b-99ca-5801d627ce65 on n-h2-833090-16 Aug 31 15:54:51.948256 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-b6596478-e669-451b-9a25-7bca23f8a31d req-bd638698-3c08-4c69-a1c1-e6f4d3bad253 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105737 Aug 31 15:54:51.948874 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 723/1526] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:54:51.960279 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b6c06a0c-be5f-42b2-8659-3e1cb4cf8b58 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:51.963294 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b6c06a0c-be5f-42b2-8659-3e1cb4cf8b58 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] [instance: d90a0347-3975-4633-be62-0e57756f93df] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:51.980828 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6c06a0c-be5f-42b2-8659-3e1cb4cf8b58 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:51.983668 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6c06a0c-be5f-42b2-8659-3e1cb4cf8b58 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:51.985517 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6c06a0c-be5f-42b2-8659-3e1cb4cf8b58 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:51.986494 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6c06a0c-be5f-42b2-8659-3e1cb4cf8b58 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:51.988874 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6c06a0c-be5f-42b2-8659-3e1cb4cf8b58 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:51.989648 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6c06a0c-be5f-42b2-8659-3e1cb4cf8b58 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:52.377267 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-17d1a512-7ada-4f1f-a765-c90897aeb5d1 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6349b0ee9e2142a8a440d4e6ae0703a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33f8cd7d4424157b410b64c7823f480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:52.392587 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-17d1a512-7ada-4f1f-a765-c90897aeb5d1 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "GET /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba" status: 200 len: 1715 microversion: 2.1 time: 0.701981 Aug 31 15:54:52.409078 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 804/1527] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:51 2022] GET /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba => generated 1715 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:52.415439 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1509f23f-2236-4b85-8202-601686fffced tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1233747505"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:54:52.426266 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1509f23f-2236-4b85-8202-601686fffced tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] [instance: 0442e1d9-fa54-4957-8313-335c0f39c763] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:52.433376 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1509f23f-2236-4b85-8202-601686fffced tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:52.434469 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1509f23f-2236-4b85-8202-601686fffced tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:52.436283 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1509f23f-2236-4b85-8202-601686fffced tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:52.437786 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1509f23f-2236-4b85-8202-601686fffced tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:52.438459 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1509f23f-2236-4b85-8202-601686fffced tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:52.439046 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1509f23f-2236-4b85-8202-601686fffced tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:52.519051 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b6c06a0c-be5f-42b2-8659-3e1cb4cf8b58 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048bcefe0af04bc6a3a2995b22cbe43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87fc33005b5440098daf798066a653f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:52.531654 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b6c06a0c-be5f-42b2-8659-3e1cb4cf8b58 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] 10.222.0.50 "GET /compute/v2.1/servers/d90a0347-3975-4633-be62-0e57756f93df" status: 200 len: 1333 microversion: 2.1 time: 0.581362 Aug 31 15:54:52.539175 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 724/1528] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:51 2022] GET /compute/v2.1/servers/d90a0347-3975-4633-be62-0e57756f93df => generated 1333 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:52.549476 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e68a4922-0b68-49bf-b085-6819fa8cd6a7 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:52.550494 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e68a4922-0b68-49bf-b085-6819fa8cd6a7 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: a8003433-1952-4dca-9b3d-43c41d2b70f5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:52.572147 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e68a4922-0b68-49bf-b085-6819fa8cd6a7 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:52.574112 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e68a4922-0b68-49bf-b085-6819fa8cd6a7 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:52.576900 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e68a4922-0b68-49bf-b085-6819fa8cd6a7 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:52.577748 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e68a4922-0b68-49bf-b085-6819fa8cd6a7 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:52.578594 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e68a4922-0b68-49bf-b085-6819fa8cd6a7 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:52.579467 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e68a4922-0b68-49bf-b085-6819fa8cd6a7 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:52.705024 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:54:52.706345 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=16 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:54:52.742205 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1509f23f-2236-4b85-8202-601686fffced tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "POST /compute/v2.1/servers/0442e1d9-fa54-4957-8313-335c0f39c763/action" status: 202 len: 0 microversion: 2.1 time: 0.330049 Aug 31 15:54:52.748767 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 805/1529] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 15:54:52 2022] POST /compute/v2.1/servers/0442e1d9-fa54-4957-8313-335c0f39c763/action => generated 0 bytes in 338 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 31 15:54:52.754404 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d424d237-809f-480c-959e-f88d62142dd8 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:52.755334 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d424d237-809f-480c-959e-f88d62142dd8 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: 3054bf54-101d-4e7d-b62d-bcd53d30a4bb] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:52.764008 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d424d237-809f-480c-959e-f88d62142dd8 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:52.765057 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d424d237-809f-480c-959e-f88d62142dd8 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:52.765956 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d424d237-809f-480c-959e-f88d62142dd8 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:52.766871 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d424d237-809f-480c-959e-f88d62142dd8 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:52.767510 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d424d237-809f-480c-959e-f88d62142dd8 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:52.768294 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d424d237-809f-480c-959e-f88d62142dd8 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:52.946869 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e68a4922-0b68-49bf-b085-6819fa8cd6a7 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:52.956058 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e68a4922-0b68-49bf-b085-6819fa8cd6a7 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/a8003433-1952-4dca-9b3d-43c41d2b70f5" status: 200 len: 1313 microversion: 2.1 time: 0.415542 Aug 31 15:54:52.957318 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 725/1530] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:52 2022] GET /compute/v2.1/servers/a8003433-1952-4dca-9b3d-43c41d2b70f5 => generated 1313 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:52.962231 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-05f0cce7-eb66-4c67-8204-abfcd1137257 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '.version_select at 0x7fbb4656ac10>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:53.007958 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d424d237-809f-480c-959e-f88d62142dd8 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:53.016682 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d424d237-809f-480c-959e-f88d62142dd8 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/3054bf54-101d-4e7d-b62d-bcd53d30a4bb" status: 200 len: 1307 microversion: 2.1 time: 0.266646 Aug 31 15:54:53.017510 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 806/1531] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:52 2022] GET /compute/v2.1/servers/3054bf54-101d-4e7d-b62d-bcd53d30a4bb => generated 1307 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:53.022648 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-05f0cce7-eb66-4c67-8204-abfcd1137257 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "GET /compute/v2.1/images/9f2c07f2-5e5e-48d3-9305-7e17c297beb6" status: 200 len: 1429 microversion: 2.1 time: 0.063845 Aug 31 15:54:53.023387 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 726/1532] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:54:52 2022] GET /compute/v2.1/images/9f2c07f2-5e5e-48d3-9305-7e17c297beb6 => generated 1429 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:53.028911 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-e05c7179-2010-4761-9d10-d5f1b52b6549 req-1318f392-e5b1-41a2-ada6-961db052e3aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3054bf54-101d-4e7d-b62d-bcd53d30a4bb", "tag": "032c6df0-61bb-4081-aa47-4e046311cc7a"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:54:53.034037 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-306b99af-092a-486b-82a5-ec7c3abaa401 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:53.034691 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-306b99af-092a-486b-82a5-ec7c3abaa401 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:53.040114 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e05c7179-2010-4761-9d10-d5f1b52b6549 req-1318f392-e5b1-41a2-ada6-961db052e3aa service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:53.040586 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e05c7179-2010-4761-9d10-d5f1b52b6549 req-1318f392-e5b1-41a2-ada6-961db052e3aa service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:53.041047 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e05c7179-2010-4761-9d10-d5f1b52b6549 req-1318f392-e5b1-41a2-ada6-961db052e3aa service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:53.041165 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-306b99af-092a-486b-82a5-ec7c3abaa401 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:53.041579 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-306b99af-092a-486b-82a5-ec7c3abaa401 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:53.042035 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-306b99af-092a-486b-82a5-ec7c3abaa401 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:53.042741 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-306b99af-092a-486b-82a5-ec7c3abaa401 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:53.043368 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-306b99af-092a-486b-82a5-ec7c3abaa401 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:53.043960 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-306b99af-092a-486b-82a5-ec7c3abaa401 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:53.053317 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-e05c7179-2010-4761-9d10-d5f1b52b6549 req-1318f392-e5b1-41a2-ada6-961db052e3aa service nova] Creating event network-changed:032c6df0-61bb-4081-aa47-4e046311cc7a for instance 3054bf54-101d-4e7d-b62d-bcd53d30a4bb on n-h1-833090-16 Aug 31 15:54:53.059193 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-e05c7179-2010-4761-9d10-d5f1b52b6549 req-1318f392-e5b1-41a2-ada6-961db052e3aa service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033666 Aug 31 15:54:53.059995 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 727/1533] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:54:53.186693 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-306b99af-092a-486b-82a5-ec7c3abaa401 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:53.194497 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-306b99af-092a-486b-82a5-ec7c3abaa401 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65" status: 200 len: 1312 microversion: 2.1 time: 0.173794 Aug 31 15:54:53.194997 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 807/1534] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:53 2022] GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65 => generated 1312 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:53.240974 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-63ce5c2d-9e74-4ea8-ba41-65b422d9fff3 req-d3c95833-11aa-4482-9d21-6c5d5c5ecdde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d90a0347-3975-4633-be62-0e57756f93df", "tag": "357e2a5c-9788-4346-b9a8-19f88f270678"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:54:53.250538 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-63ce5c2d-9e74-4ea8-ba41-65b422d9fff3 req-d3c95833-11aa-4482-9d21-6c5d5c5ecdde service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:53.251006 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-63ce5c2d-9e74-4ea8-ba41-65b422d9fff3 req-d3c95833-11aa-4482-9d21-6c5d5c5ecdde service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:53.251422 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-63ce5c2d-9e74-4ea8-ba41-65b422d9fff3 req-d3c95833-11aa-4482-9d21-6c5d5c5ecdde service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:53.262574 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-63ce5c2d-9e74-4ea8-ba41-65b422d9fff3 req-d3c95833-11aa-4482-9d21-6c5d5c5ecdde service nova] Creating event network-changed:357e2a5c-9788-4346-b9a8-19f88f270678 for instance d90a0347-3975-4633-be62-0e57756f93df on n-h1-833090-16 Aug 31 15:54:53.267700 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-63ce5c2d-9e74-4ea8-ba41-65b422d9fff3 req-d3c95833-11aa-4482-9d21-6c5d5c5ecdde service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030714 Aug 31 15:54:53.268284 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 728/1535] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:54:53.416440 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7f19942a-3719-47f5-a325-bb4d69ec9aa5 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:53.417215 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7f19942a-3719-47f5-a325-bb4d69ec9aa5 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: c76166e9-e2cf-4253-99e2-3f8d919099ba] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:53.424740 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f19942a-3719-47f5-a325-bb4d69ec9aa5 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:53.425382 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f19942a-3719-47f5-a325-bb4d69ec9aa5 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:53.425944 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f19942a-3719-47f5-a325-bb4d69ec9aa5 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:53.426853 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f19942a-3719-47f5-a325-bb4d69ec9aa5 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:53.427371 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f19942a-3719-47f5-a325-bb4d69ec9aa5 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:53.427860 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f19942a-3719-47f5-a325-bb4d69ec9aa5 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:53.553506 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-05ce960c-c465-4205-ba01-782537aebd68 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:53.555070 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-05ce960c-c465-4205-ba01-782537aebd68 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] [instance: d90a0347-3975-4633-be62-0e57756f93df] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:53.580224 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05ce960c-c465-4205-ba01-782537aebd68 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:53.581502 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05ce960c-c465-4205-ba01-782537aebd68 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:53.585356 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05ce960c-c465-4205-ba01-782537aebd68 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:53.586356 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05ce960c-c465-4205-ba01-782537aebd68 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:53.587311 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05ce960c-c465-4205-ba01-782537aebd68 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:53.588269 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05ce960c-c465-4205-ba01-782537aebd68 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:53.650948 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7f19942a-3719-47f5-a325-bb4d69ec9aa5 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6349b0ee9e2142a8a440d4e6ae0703a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33f8cd7d4424157b410b64c7823f480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:53.666330 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7f19942a-3719-47f5-a325-bb4d69ec9aa5 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "GET /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba" status: 200 len: 1715 microversion: 2.1 time: 0.253605 Aug 31 15:54:53.682878 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 808/1536] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:53 2022] GET /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba => generated 1715 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:53.977760 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2d679c83-d9f3-4bf2-8840-4a6ab11526ae tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:53.978508 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2d679c83-d9f3-4bf2-8840-4a6ab11526ae tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: a8003433-1952-4dca-9b3d-43c41d2b70f5] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:53.995765 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2d679c83-d9f3-4bf2-8840-4a6ab11526ae tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:53.998755 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2d679c83-d9f3-4bf2-8840-4a6ab11526ae tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:54.003243 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2d679c83-d9f3-4bf2-8840-4a6ab11526ae tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:54.004481 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2d679c83-d9f3-4bf2-8840-4a6ab11526ae tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:54.005626 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2d679c83-d9f3-4bf2-8840-4a6ab11526ae tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:54.006985 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2d679c83-d9f3-4bf2-8840-4a6ab11526ae tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:54.356073 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-05ce960c-c465-4205-ba01-782537aebd68 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048bcefe0af04bc6a3a2995b22cbe43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87fc33005b5440098daf798066a653f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:54.373678 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-05ce960c-c465-4205-ba01-782537aebd68 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] 10.222.0.50 "GET /compute/v2.1/servers/d90a0347-3975-4633-be62-0e57756f93df" status: 200 len: 1333 microversion: 2.1 time: 0.824088 Aug 31 15:54:54.375039 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 729/1537] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:53 2022] GET /compute/v2.1/servers/d90a0347-3975-4633-be62-0e57756f93df => generated 1333 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:54:54.381715 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-68e431d1-2207-447b-afc7-b6fb537ca125 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '.version_select at 0x7fbb46808160>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:54.446581 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-68e431d1-2207-447b-afc7-b6fb537ca125 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "GET /compute/v2.1/images/9f2c07f2-5e5e-48d3-9305-7e17c297beb6" status: 200 len: 1429 microversion: 2.1 time: 0.069741 Aug 31 15:54:54.447797 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 730/1538] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:54:54 2022] GET /compute/v2.1/images/9f2c07f2-5e5e-48d3-9305-7e17c297beb6 => generated 1429 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:54.454478 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f94ece5a-7e6b-4caf-89a8-7ff0ae20c77d tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:54.455952 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f94ece5a-7e6b-4caf-89a8-7ff0ae20c77d tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: 3054bf54-101d-4e7d-b62d-bcd53d30a4bb] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:54.463519 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f94ece5a-7e6b-4caf-89a8-7ff0ae20c77d tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:54.464047 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f94ece5a-7e6b-4caf-89a8-7ff0ae20c77d tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:54.464809 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f94ece5a-7e6b-4caf-89a8-7ff0ae20c77d tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:54.466475 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f94ece5a-7e6b-4caf-89a8-7ff0ae20c77d tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:54.467326 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f94ece5a-7e6b-4caf-89a8-7ff0ae20c77d tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:54.468274 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f94ece5a-7e6b-4caf-89a8-7ff0ae20c77d tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:54.720785 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2d679c83-d9f3-4bf2-8840-4a6ab11526ae tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:54.735047 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2d679c83-d9f3-4bf2-8840-4a6ab11526ae tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/a8003433-1952-4dca-9b3d-43c41d2b70f5" status: 200 len: 1313 microversion: 2.1 time: 0.761116 Aug 31 15:54:54.735721 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 809/1539] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:53 2022] GET /compute/v2.1/servers/a8003433-1952-4dca-9b3d-43c41d2b70f5 => generated 1313 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:54.749072 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-363ebc30-d116-43cf-83f8-06abd1b4dd7f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:54.749997 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-363ebc30-d116-43cf-83f8-06abd1b4dd7f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:54.767532 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-363ebc30-d116-43cf-83f8-06abd1b4dd7f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:54.768283 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-363ebc30-d116-43cf-83f8-06abd1b4dd7f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:54.769606 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-363ebc30-d116-43cf-83f8-06abd1b4dd7f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:54.771572 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-363ebc30-d116-43cf-83f8-06abd1b4dd7f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:54.772202 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-363ebc30-d116-43cf-83f8-06abd1b4dd7f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:54.774687 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-363ebc30-d116-43cf-83f8-06abd1b4dd7f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:54.814337 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f94ece5a-7e6b-4caf-89a8-7ff0ae20c77d tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:54.828939 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f94ece5a-7e6b-4caf-89a8-7ff0ae20c77d tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/3054bf54-101d-4e7d-b62d-bcd53d30a4bb" status: 200 len: 1307 microversion: 2.1 time: 0.379783 Aug 31 15:54:54.834987 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 731/1540] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:54 2022] GET /compute/v2.1/servers/3054bf54-101d-4e7d-b62d-bcd53d30a4bb => generated 1307 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:54.847327 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8b0b6009-6982-4fd8-894f-ce0c17f2a005 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:54.850334 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8b0b6009-6982-4fd8-894f-ce0c17f2a005 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: c76166e9-e2cf-4253-99e2-3f8d919099ba] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:54.860596 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b0b6009-6982-4fd8-894f-ce0c17f2a005 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:54.861363 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b0b6009-6982-4fd8-894f-ce0c17f2a005 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:54.861967 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b0b6009-6982-4fd8-894f-ce0c17f2a005 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:54.862882 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b0b6009-6982-4fd8-894f-ce0c17f2a005 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:54.863496 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b0b6009-6982-4fd8-894f-ce0c17f2a005 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:54.864124 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b0b6009-6982-4fd8-894f-ce0c17f2a005 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:55.034559 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8b0b6009-6982-4fd8-894f-ce0c17f2a005 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6349b0ee9e2142a8a440d4e6ae0703a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33f8cd7d4424157b410b64c7823f480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:55.045823 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8b0b6009-6982-4fd8-894f-ce0c17f2a005 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "GET /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba" status: 200 len: 1648 microversion: 2.1 time: 0.209269 Aug 31 15:54:55.046820 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 732/1541] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:54 2022] GET /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba => generated 1648 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:55.083399 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=4 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:54:55.371017 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-363ebc30-d116-43cf-83f8-06abd1b4dd7f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:55.379972 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-363ebc30-d116-43cf-83f8-06abd1b4dd7f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65" status: 200 len: 1312 microversion: 2.1 time: 0.640254 Aug 31 15:54:55.380851 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 810/1542] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:54 2022] GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65 => generated 1312 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:55.399609 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2e4051ff-5a65-4f19-bf96-1ad47eb8d2bb tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:55.400518 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2e4051ff-5a65-4f19-bf96-1ad47eb8d2bb tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] [instance: d90a0347-3975-4633-be62-0e57756f93df] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:55.412956 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e4051ff-5a65-4f19-bf96-1ad47eb8d2bb tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:55.413687 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e4051ff-5a65-4f19-bf96-1ad47eb8d2bb tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:55.414335 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e4051ff-5a65-4f19-bf96-1ad47eb8d2bb tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:55.415236 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e4051ff-5a65-4f19-bf96-1ad47eb8d2bb tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:55.415848 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e4051ff-5a65-4f19-bf96-1ad47eb8d2bb tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:55.416648 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e4051ff-5a65-4f19-bf96-1ad47eb8d2bb tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:55.462769 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e0e33615-6ce4-40fa-bee5-bccdb3179e20 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '.version_select at 0x7fbb46864f70>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:55.535406 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e0e33615-6ce4-40fa-bee5-bccdb3179e20 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "GET /compute/v2.1/images/9f2c07f2-5e5e-48d3-9305-7e17c297beb6" status: 200 len: 1429 microversion: 2.1 time: 0.077279 Aug 31 15:54:55.536612 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 811/1543] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:54:55 2022] GET /compute/v2.1/images/9f2c07f2-5e5e-48d3-9305-7e17c297beb6 => generated 1429 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:55.760739 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-59bd92ca-d8e7-48d5-b9f5-33ae699e24b7 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:55.761248 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-59bd92ca-d8e7-48d5-b9f5-33ae699e24b7 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: a8003433-1952-4dca-9b3d-43c41d2b70f5] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:55.781762 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-59bd92ca-d8e7-48d5-b9f5-33ae699e24b7 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:55.782362 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-59bd92ca-d8e7-48d5-b9f5-33ae699e24b7 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:55.782799 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-59bd92ca-d8e7-48d5-b9f5-33ae699e24b7 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:55.783721 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-59bd92ca-d8e7-48d5-b9f5-33ae699e24b7 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:55.784348 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-59bd92ca-d8e7-48d5-b9f5-33ae699e24b7 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:55.784946 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-59bd92ca-d8e7-48d5-b9f5-33ae699e24b7 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:56.083512 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2e4051ff-5a65-4f19-bf96-1ad47eb8d2bb tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048bcefe0af04bc6a3a2995b22cbe43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87fc33005b5440098daf798066a653f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:56.140504 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2e4051ff-5a65-4f19-bf96-1ad47eb8d2bb tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] 10.222.0.50 "GET /compute/v2.1/servers/d90a0347-3975-4633-be62-0e57756f93df" status: 200 len: 1333 microversion: 2.1 time: 0.737709 Aug 31 15:54:56.144494 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 733/1544] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:55 2022] GET /compute/v2.1/servers/d90a0347-3975-4633-be62-0e57756f93df => generated 1333 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:56.171819 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8afb5863-6f7c-4341-9758-4bbcacb4b070 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:56.173613 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8afb5863-6f7c-4341-9758-4bbcacb4b070 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: 3054bf54-101d-4e7d-b62d-bcd53d30a4bb] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:56.206296 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8afb5863-6f7c-4341-9758-4bbcacb4b070 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:56.207723 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8afb5863-6f7c-4341-9758-4bbcacb4b070 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:56.212847 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8afb5863-6f7c-4341-9758-4bbcacb4b070 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:56.214885 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8afb5863-6f7c-4341-9758-4bbcacb4b070 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:56.216723 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8afb5863-6f7c-4341-9758-4bbcacb4b070 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:56.218914 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8afb5863-6f7c-4341-9758-4bbcacb4b070 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:56.256867 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-59bd92ca-d8e7-48d5-b9f5-33ae699e24b7 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:56.266220 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-59bd92ca-d8e7-48d5-b9f5-33ae699e24b7 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/a8003433-1952-4dca-9b3d-43c41d2b70f5" status: 200 len: 1313 microversion: 2.1 time: 0.510907 Aug 31 15:54:56.273857 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 812/1545] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:55 2022] GET /compute/v2.1/servers/a8003433-1952-4dca-9b3d-43c41d2b70f5 => generated 1313 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:56.297658 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-1ffb7e17-2380-490c-a4c3-ec4b025b956e req-9a44af43-4207-4171-a6f5-4c8e7fd96f10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c76166e9-e2cf-4253-99e2-3f8d919099ba", "name": "network-vif-deleted", "tag": "3e098f5c-9a2b-4fa2-8406-5975188f6f3a"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:54:56.315361 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-1ffb7e17-2380-490c-a4c3-ec4b025b956e req-9a44af43-4207-4171-a6f5-4c8e7fd96f10 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:56.316629 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-1ffb7e17-2380-490c-a4c3-ec4b025b956e req-9a44af43-4207-4171-a6f5-4c8e7fd96f10 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:56.317219 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-1ffb7e17-2380-490c-a4c3-ec4b025b956e req-9a44af43-4207-4171-a6f5-4c8e7fd96f10 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:56.330530 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-1ffb7e17-2380-490c-a4c3-ec4b025b956e req-9a44af43-4207-4171-a6f5-4c8e7fd96f10 service nova] Creating event network-vif-deleted:3e098f5c-9a2b-4fa2-8406-5975188f6f3a for instance c76166e9-e2cf-4253-99e2-3f8d919099ba on n-h2-833090-16 Aug 31 15:54:56.336706 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-1ffb7e17-2380-490c-a4c3-ec4b025b956e req-9a44af43-4207-4171-a6f5-4c8e7fd96f10 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060588 Aug 31 15:54:56.338035 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 813/1546] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:54:56.346681 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-72af28ed-8cf9-484e-baf1-c3c310599770 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:56.348063 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-72af28ed-8cf9-484e-baf1-c3c310599770 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: c76166e9-e2cf-4253-99e2-3f8d919099ba] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:56.368200 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-72af28ed-8cf9-484e-baf1-c3c310599770 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:56.370909 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-72af28ed-8cf9-484e-baf1-c3c310599770 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:56.371610 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-72af28ed-8cf9-484e-baf1-c3c310599770 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:56.375001 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-72af28ed-8cf9-484e-baf1-c3c310599770 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:56.375724 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-72af28ed-8cf9-484e-baf1-c3c310599770 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:56.377734 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-72af28ed-8cf9-484e-baf1-c3c310599770 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:56.508816 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-72af28ed-8cf9-484e-baf1-c3c310599770 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6349b0ee9e2142a8a440d4e6ae0703a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33f8cd7d4424157b410b64c7823f480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:56.521642 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-72af28ed-8cf9-484e-baf1-c3c310599770 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "GET /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba" status: 200 len: 1350 microversion: 2.1 time: 0.182207 Aug 31 15:54:56.522509 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 814/1547] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:56 2022] GET /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba => generated 1350 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:56.549870 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-51903bdf-a0e5-4bca-9195-612b089b58e3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:56.552868 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-51903bdf-a0e5-4bca-9195-612b089b58e3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:56.575792 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51903bdf-a0e5-4bca-9195-612b089b58e3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:56.577248 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51903bdf-a0e5-4bca-9195-612b089b58e3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:56.577877 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51903bdf-a0e5-4bca-9195-612b089b58e3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:56.578871 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51903bdf-a0e5-4bca-9195-612b089b58e3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:56.579548 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51903bdf-a0e5-4bca-9195-612b089b58e3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:56.580131 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51903bdf-a0e5-4bca-9195-612b089b58e3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:56.626114 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8afb5863-6f7c-4341-9758-4bbcacb4b070 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:56.630057 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:54:56.642198 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8afb5863-6f7c-4341-9758-4bbcacb4b070 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/3054bf54-101d-4e7d-b62d-bcd53d30a4bb" status: 200 len: 1307 microversion: 2.1 time: 0.488492 Aug 31 15:54:56.643108 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 734/1548] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:56 2022] GET /compute/v2.1/servers/3054bf54-101d-4e7d-b62d-bcd53d30a4bb => generated 1307 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:56.664362 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ed6ba151-0e35-407b-a1da-27d4fdbfefa9 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '.version_select at 0x7fbb468e2b80>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:56.755647 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ed6ba151-0e35-407b-a1da-27d4fdbfefa9 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "GET /compute/v2.1/images/9f2c07f2-5e5e-48d3-9305-7e17c297beb6" status: 200 len: 1429 microversion: 2.1 time: 0.101926 Aug 31 15:54:56.756236 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 735/1549] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:54:56 2022] GET /compute/v2.1/images/9f2c07f2-5e5e-48d3-9305-7e17c297beb6 => generated 1429 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:56.879775 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-51903bdf-a0e5-4bca-9195-612b089b58e3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:56.892259 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-51903bdf-a0e5-4bca-9195-612b089b58e3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65" status: 200 len: 1462 microversion: 2.1 time: 0.366825 Aug 31 15:54:56.894215 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 815/1550] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:56 2022] GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65 => generated 1462 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:56.916877 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e2626977-c758-4366-a4df-629cddda5329 tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:56.917556 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e2626977-c758-4366-a4df-629cddda5329 tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:56.935302 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2626977-c758-4366-a4df-629cddda5329 tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:56.935878 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2626977-c758-4366-a4df-629cddda5329 tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:56.936324 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2626977-c758-4366-a4df-629cddda5329 tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:56.937103 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2626977-c758-4366-a4df-629cddda5329 tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:56.937622 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2626977-c758-4366-a4df-629cddda5329 tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:56.938070 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2626977-c758-4366-a4df-629cddda5329 tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:57.107518 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e2626977-c758-4366-a4df-629cddda5329 tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65" status: 200 len: 1615 microversion: 2.1 time: 0.194836 Aug 31 15:54:57.123128 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 736/1551] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:56 2022] GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65 => generated 1615 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:57.129222 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-922f4679-5132-4c83-9648-1089205e1ea7 tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:54:57.130146 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-922f4679-5132-4c83-9648-1089205e1ea7 tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:57.137377 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-922f4679-5132-4c83-9648-1089205e1ea7 tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:57.138458 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-922f4679-5132-4c83-9648-1089205e1ea7 tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:57.139340 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-922f4679-5132-4c83-9648-1089205e1ea7 tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:57.140215 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-922f4679-5132-4c83-9648-1089205e1ea7 tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:57.140819 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-922f4679-5132-4c83-9648-1089205e1ea7 tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:57.141399 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-922f4679-5132-4c83-9648-1089205e1ea7 tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:57.168675 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f6e5289a-b867-46a4-b8d0-e13db65f2d31 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:57.169518 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f6e5289a-b867-46a4-b8d0-e13db65f2d31 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] [instance: d90a0347-3975-4633-be62-0e57756f93df] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:57.180281 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6e5289a-b867-46a4-b8d0-e13db65f2d31 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:57.180910 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-922f4679-5132-4c83-9648-1089205e1ea7 tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '77b1ec7373a54f958adddae78b2ed709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbcc4fab66cb488883527a9fdf315609', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:57.182260 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6e5289a-b867-46a4-b8d0-e13db65f2d31 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:57.182654 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-922f4679-5132-4c83-9648-1089205e1ea7 tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] flavor_id is None. Assuming migration. {{(pid=128864) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 31 15:54:57.182989 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6e5289a-b867-46a4-b8d0-e13db65f2d31 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:57.183717 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-922f4679-5132-4c83-9648-1089205e1ea7 tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128864) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 31 15:54:57.187210 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6e5289a-b867-46a4-b8d0-e13db65f2d31 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:57.188467 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6e5289a-b867-46a4-b8d0-e13db65f2d31 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:57.189381 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6e5289a-b867-46a4-b8d0-e13db65f2d31 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:57.403718 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:54:57.643508 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f6e5289a-b867-46a4-b8d0-e13db65f2d31 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048bcefe0af04bc6a3a2995b22cbe43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87fc33005b5440098daf798066a653f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:57.654581 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f6e5289a-b867-46a4-b8d0-e13db65f2d31 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] 10.222.0.50 "GET /compute/v2.1/servers/d90a0347-3975-4633-be62-0e57756f93df" status: 200 len: 1333 microversion: 2.1 time: 0.489696 Aug 31 15:54:57.671375 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 737/1552] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:57 2022] GET /compute/v2.1/servers/d90a0347-3975-4633-be62-0e57756f93df => generated 1333 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:54:57.693008 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2132bc73-0fa6-4160-a32d-6559424fc123 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:57.696675 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2132bc73-0fa6-4160-a32d-6559424fc123 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: a8003433-1952-4dca-9b3d-43c41d2b70f5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:57.714191 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2132bc73-0fa6-4160-a32d-6559424fc123 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:57.714663 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2132bc73-0fa6-4160-a32d-6559424fc123 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:57.716661 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2132bc73-0fa6-4160-a32d-6559424fc123 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:57.717384 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2132bc73-0fa6-4160-a32d-6559424fc123 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:57.718166 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2132bc73-0fa6-4160-a32d-6559424fc123 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:57.718589 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2132bc73-0fa6-4160-a32d-6559424fc123 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:57.838939 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-922f4679-5132-4c83-9648-1089205e1ea7 tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65/action" status: 202 len: 0 microversion: 2.1 time: 0.713817 Aug 31 15:54:57.840340 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 816/1553] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 15:54:57 2022] POST /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65/action => generated 0 bytes in 717 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 15:54:57.848866 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-03a8ef5e-49fb-4a84-a7b3-8ea619a2f5f1 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:57.855611 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-03a8ef5e-49fb-4a84-a7b3-8ea619a2f5f1 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: c76166e9-e2cf-4253-99e2-3f8d919099ba] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:57.865613 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-03a8ef5e-49fb-4a84-a7b3-8ea619a2f5f1 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:57.874387 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-03a8ef5e-49fb-4a84-a7b3-8ea619a2f5f1 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:57.878348 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-03a8ef5e-49fb-4a84-a7b3-8ea619a2f5f1 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:57.879450 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-03a8ef5e-49fb-4a84-a7b3-8ea619a2f5f1 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:57.880181 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-03a8ef5e-49fb-4a84-a7b3-8ea619a2f5f1 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:57.880791 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-03a8ef5e-49fb-4a84-a7b3-8ea619a2f5f1 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:57.964427 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-03a8ef5e-49fb-4a84-a7b3-8ea619a2f5f1 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:57.965376 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-03a8ef5e-49fb-4a84-a7b3-8ea619a2f5f1 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:57.968040 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-03a8ef5e-49fb-4a84-a7b3-8ea619a2f5f1 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:57.968944 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-03a8ef5e-49fb-4a84-a7b3-8ea619a2f5f1 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lazy-loading 'fault' on Instance uuid c76166e9-e2cf-4253-99e2-3f8d919099ba {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:54:58.380189 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-03a8ef5e-49fb-4a84-a7b3-8ea619a2f5f1 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6349b0ee9e2142a8a440d4e6ae0703a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33f8cd7d4424157b410b64c7823f480', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:58.392766 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-03a8ef5e-49fb-4a84-a7b3-8ea619a2f5f1 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "GET /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba" status: 200 len: 1355 microversion: 2.1 time: 0.550255 Aug 31 15:54:58.393634 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 817/1554] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:57 2022] GET /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba => generated 1355 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:58.410189 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ac6eefd0-4339-4b00-a831-05341df1448a tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:58.411083 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ac6eefd0-4339-4b00-a831-05341df1448a tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: 3054bf54-101d-4e7d-b62d-bcd53d30a4bb] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:58.428210 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ac6eefd0-4339-4b00-a831-05341df1448a tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:58.429191 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ac6eefd0-4339-4b00-a831-05341df1448a tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:58.429791 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ac6eefd0-4339-4b00-a831-05341df1448a tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:58.430711 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ac6eefd0-4339-4b00-a831-05341df1448a tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:58.431321 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ac6eefd0-4339-4b00-a831-05341df1448a tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:58.431992 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ac6eefd0-4339-4b00-a831-05341df1448a tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:58.832655 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2132bc73-0fa6-4160-a32d-6559424fc123 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:58.855345 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2132bc73-0fa6-4160-a32d-6559424fc123 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/a8003433-1952-4dca-9b3d-43c41d2b70f5" status: 200 len: 1313 microversion: 2.1 time: 1.179458 Aug 31 15:54:58.860184 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 738/1555] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:57 2022] GET /compute/v2.1/servers/a8003433-1952-4dca-9b3d-43c41d2b70f5 => generated 1313 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:58.874762 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6f24c89f-c312-4fda-be6c-3ed28c20b784 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '.version_select at 0x7fbb4645daf0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:58.965070 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6f24c89f-c312-4fda-be6c-3ed28c20b784 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "GET /compute/v2.1/images/9f2c07f2-5e5e-48d3-9305-7e17c297beb6" status: 200 len: 1429 microversion: 2.1 time: 0.103654 Aug 31 15:54:58.972806 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 739/1556] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:54:58 2022] GET /compute/v2.1/images/9f2c07f2-5e5e-48d3-9305-7e17c297beb6 => generated 1429 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:58.989538 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-edf45fe5-f727-42ef-b100-978c0fd7552e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:58.991577 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-edf45fe5-f727-42ef-b100-978c0fd7552e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:59.003688 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-edf45fe5-f727-42ef-b100-978c0fd7552e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:59.004321 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-edf45fe5-f727-42ef-b100-978c0fd7552e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:59.004979 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-edf45fe5-f727-42ef-b100-978c0fd7552e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:59.006133 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-edf45fe5-f727-42ef-b100-978c0fd7552e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:59.006779 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-edf45fe5-f727-42ef-b100-978c0fd7552e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:59.007554 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-edf45fe5-f727-42ef-b100-978c0fd7552e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:59.025613 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ac6eefd0-4339-4b00-a831-05341df1448a tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:59.051049 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ac6eefd0-4339-4b00-a831-05341df1448a tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/3054bf54-101d-4e7d-b62d-bcd53d30a4bb" status: 200 len: 1307 microversion: 2.1 time: 0.656141 Aug 31 15:54:59.052044 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 818/1557] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:58 2022] GET /compute/v2.1/servers/3054bf54-101d-4e7d-b62d-bcd53d30a4bb => generated 1307 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:59.064558 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-444f6689-f61c-45f6-9b80-255adc1e5215 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:59.065770 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-444f6689-f61c-45f6-9b80-255adc1e5215 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] [instance: d90a0347-3975-4633-be62-0e57756f93df] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:59.085993 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-444f6689-f61c-45f6-9b80-255adc1e5215 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:59.091436 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-444f6689-f61c-45f6-9b80-255adc1e5215 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:59.092296 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-444f6689-f61c-45f6-9b80-255adc1e5215 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:59.093549 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-444f6689-f61c-45f6-9b80-255adc1e5215 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:59.094263 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-444f6689-f61c-45f6-9b80-255adc1e5215 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:59.094869 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-444f6689-f61c-45f6-9b80-255adc1e5215 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:59.334485 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=8 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:54:59.552096 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-edf45fe5-f727-42ef-b100-978c0fd7552e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:59.564325 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-edf45fe5-f727-42ef-b100-978c0fd7552e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65" status: 200 len: 1471 microversion: 2.1 time: 0.596401 Aug 31 15:54:59.566070 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 740/1558] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:58 2022] GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65 => generated 1471 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:59.581119 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-01fc9bc6-1d43-4452-bd46-f40935f331b1 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:59.583507 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-01fc9bc6-1d43-4452-bd46-f40935f331b1 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: c76166e9-e2cf-4253-99e2-3f8d919099ba] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:59.602016 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01fc9bc6-1d43-4452-bd46-f40935f331b1 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:59.603026 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01fc9bc6-1d43-4452-bd46-f40935f331b1 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:59.604240 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01fc9bc6-1d43-4452-bd46-f40935f331b1 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:59.605399 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01fc9bc6-1d43-4452-bd46-f40935f331b1 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:59.606148 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01fc9bc6-1d43-4452-bd46-f40935f331b1 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:59.607051 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01fc9bc6-1d43-4452-bd46-f40935f331b1 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:59.632775 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-01fc9bc6-1d43-4452-bd46-f40935f331b1 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] HTTP exception thrown: Instance c76166e9-e2cf-4253-99e2-3f8d919099ba could not be found. Aug 31 15:54:59.635010 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-01fc9bc6-1d43-4452-bd46-f40935f331b1 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Request method failure captured: Aug 31 15:54:59.635010 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba HTTP/1.1 Aug 31 15:54:59.635010 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:54:59.635010 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:54:59.635010 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:54:59.635010 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:54:59.635010 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:54:59.635010 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:54:59.635010 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:54:59.635010 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:54:59.635010 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4MqJUA1-rNBuAO4Qoiu6hpL6nZ0jQzbI1SdHfnSwpf943ZFDLeAnoMARViAVmW7HRQ5Z1f6ZQ4YyIOwuz00WNHysiuO8m8Xm-1ZGF_EyiwOpqArO84YUwLSyxbcyu7rbfFPQEkK05CbD96iBQyiYbImeQFs7vZKgJTX9pmTDPCMbVo Aug 31 15:54:59.635010 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:54:59.635010 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:54:59.635010 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:54:59.635010 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:54:59.635010 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:54:59.635010 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:54:59.635010 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: d33f8cd7d4424157b410b64c7823f480 Aug 31 15:54:59.635010 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-33929139 Aug 31 15:54:59.635010 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:54:59.635010 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:54:59.636578 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d33f8cd7d4424157b410b64c7823f480"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d33f8cd7d4424157b410b64c7823f480"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d33f8cd7d4424157b410b64c7823f480"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d33f8cd7d4424157b410b64c7823f480", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:54:59.636578 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-33929139 Aug 31 15:54:59.636578 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: d33f8cd7d4424157b410b64c7823f480 Aug 31 15:54:59.636578 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-33929139 Aug 31 15:54:59.636578 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServersWithSpecificFlavorTestJSON-33929139-project Aug 31 15:54:59.636578 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:54:59.636578 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:54:59.636578 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 6349b0ee9e2142a8a440d4e6ae0703a7 Aug 31 15:54:59.636578 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-33929139-project Aug 31 15:54:59.636578 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 15:54:59.636578 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance c76166e9-e2cf-4253-99e2-3f8d919099ba could not be found. Aug 31 15:54:59.636578 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'c76166e9-e2cf-4253-99e2-3f8d919099ba'} Aug 31 15:54:59.637464 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:54:59.637464 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:54:59.637464 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:54:59.637464 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:54:59.637464 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:54:59.637464 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:54:59.637464 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:54:59.637464 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:54:59.637464 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:54:59.637464 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:54:59.637464 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c76166e9-e2cf-4253-99e2-3f8d919099ba could not be found. Aug 31 15:54:59.637464 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:54:59.637464 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:54:59.637464 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:54:59.637464 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:54:59.637464 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:54:59.637464 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:54:59.637464 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:54:59.637464 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:54:59.637464 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:54:59.640118 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:54:59.640118 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:54:59.640118 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:54:59.640118 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:54:59.640118 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:54:59.640118 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:54:59.640118 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:54:59.640118 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c76166e9-e2cf-4253-99e2-3f8d919099ba could not be found. Aug 31 15:54:59.640118 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:54:59.640118 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:54:59.640118 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:54:59.640118 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:54:59.640118 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:54:59.640118 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:54:59.640118 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:54:59.640118 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:54:59.640118 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c76166e9-e2cf-4253-99e2-3f8d919099ba could not be found. Aug 31 15:54:59.640118 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:54:59.643615 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-01fc9bc6-1d43-4452-bd46-f40935f331b1 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Returning 404 to user: Instance c76166e9-e2cf-4253-99e2-3f8d919099ba could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:54:59.645007 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-01fc9bc6-1d43-4452-bd46-f40935f331b1 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "GET /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba" status: 404 len: 111 microversion: 2.1 time: 0.076648 Aug 31 15:54:59.646389 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 741/1559] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:59 2022] GET /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:54:59.668248 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-084fe855-b8c6-45c0-a447-04192ddaedb1 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:59.671418 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-084fe855-b8c6-45c0-a447-04192ddaedb1 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: 2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:59.689921 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-084fe855-b8c6-45c0-a447-04192ddaedb1 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:59.692023 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-084fe855-b8c6-45c0-a447-04192ddaedb1 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:59.694590 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-084fe855-b8c6-45c0-a447-04192ddaedb1 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:59.697772 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-084fe855-b8c6-45c0-a447-04192ddaedb1 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:59.698679 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-084fe855-b8c6-45c0-a447-04192ddaedb1 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:59.700316 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-084fe855-b8c6-45c0-a447-04192ddaedb1 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:59.744531 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-084fe855-b8c6-45c0-a447-04192ddaedb1 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] HTTP exception thrown: Instance 2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881 could not be found. Aug 31 15:54:59.750734 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-084fe855-b8c6-45c0-a447-04192ddaedb1 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Request method failure captured: Aug 31 15:54:59.750734 n-d-833090-16 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881 HTTP/1.1 Aug 31 15:54:59.750734 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:54:59.750734 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:54:59.750734 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:54:59.750734 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:54:59.750734 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:54:59.750734 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:54:59.750734 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:54:59.750734 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:54:59.750734 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4MqJUA1-rNBuAO4Qoiu6hpL6nZ0jQzbI1SdHfnSwpf943ZFDLeAnoMARViAVmW7HRQ5Z1f6ZQ4YyIOwuz00WNHysiuO8m8Xm-1ZGF_EyiwOpqArO84YUwLSyxbcyu7rbfFPQEkK05CbD96iBQyiYbImeQFs7vZKgJTX9pmTDPCMbVo Aug 31 15:54:59.750734 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:54:59.750734 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:54:59.750734 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:54:59.750734 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:54:59.750734 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:54:59.750734 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:54:59.750734 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: d33f8cd7d4424157b410b64c7823f480 Aug 31 15:54:59.750734 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-33929139 Aug 31 15:54:59.750734 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:54:59.750734 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:54:59.752299 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d33f8cd7d4424157b410b64c7823f480"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d33f8cd7d4424157b410b64c7823f480"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d33f8cd7d4424157b410b64c7823f480"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d33f8cd7d4424157b410b64c7823f480", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:54:59.752299 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-33929139 Aug 31 15:54:59.752299 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: d33f8cd7d4424157b410b64c7823f480 Aug 31 15:54:59.752299 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-33929139 Aug 31 15:54:59.752299 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServersWithSpecificFlavorTestJSON-33929139-project Aug 31 15:54:59.752299 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:54:59.752299 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:54:59.752299 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 6349b0ee9e2142a8a440d4e6ae0703a7 Aug 31 15:54:59.752299 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-33929139-project Aug 31 15:54:59.752299 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 15:54:59.752299 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881 could not be found. Aug 31 15:54:59.752299 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881'} Aug 31 15:54:59.753158 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:54:59.753158 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:54:59.753158 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:54:59.753158 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:54:59.753158 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:54:59.753158 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:54:59.753158 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:54:59.753158 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:54:59.753158 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:54:59.753158 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:54:59.753158 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881 could not be found. Aug 31 15:54:59.753158 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:54:59.753158 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:54:59.753158 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:54:59.753158 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:54:59.753158 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:54:59.753158 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:54:59.753158 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:54:59.753158 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:54:59.753158 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:54:59.754518 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:54:59.754518 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 15:54:59.754518 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 15:54:59.754518 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 15:54:59.754518 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 15:54:59.754518 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:54:59.754518 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:54:59.754518 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:54:59.754518 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:54:59.754518 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881 could not be found. Aug 31 15:54:59.754518 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:54:59.754518 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:54:59.754518 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:54:59.754518 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:54:59.754518 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:54:59.754518 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:54:59.754518 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:54:59.754518 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:54:59.754518 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881 could not be found. Aug 31 15:54:59.754518 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:54:59.759892 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-084fe855-b8c6-45c0-a447-04192ddaedb1 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Returning 404 to user: Instance 2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:54:59.762381 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-084fe855-b8c6-45c0-a447-04192ddaedb1 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "DELETE /compute/v2.1/servers/2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881" status: 404 len: 111 microversion: 2.1 time: 0.108153 Aug 31 15:54:59.765250 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 742/1560] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:54:59 2022] DELETE /compute/v2.1/servers/2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:54:59.786335 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-607437f0-1ef3-4cc6-ac09-722174756720 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:59.791720 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-607437f0-1ef3-4cc6-ac09-722174756720 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: 2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:59.805419 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-607437f0-1ef3-4cc6-ac09-722174756720 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:59.806551 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-607437f0-1ef3-4cc6-ac09-722174756720 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:59.809584 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-607437f0-1ef3-4cc6-ac09-722174756720 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:59.812777 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-607437f0-1ef3-4cc6-ac09-722174756720 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:59.813506 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-607437f0-1ef3-4cc6-ac09-722174756720 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:59.814163 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-607437f0-1ef3-4cc6-ac09-722174756720 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:59.817560 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-444f6689-f61c-45f6-9b80-255adc1e5215 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048bcefe0af04bc6a3a2995b22cbe43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87fc33005b5440098daf798066a653f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:54:59.849622 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-444f6689-f61c-45f6-9b80-255adc1e5215 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] 10.222.0.50 "GET /compute/v2.1/servers/d90a0347-3975-4633-be62-0e57756f93df" status: 200 len: 1333 microversion: 2.1 time: 0.796266 Aug 31 15:54:59.850299 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 819/1561] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:59 2022] GET /compute/v2.1/servers/d90a0347-3975-4633-be62-0e57756f93df => generated 1333 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:54:59.857060 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-607437f0-1ef3-4cc6-ac09-722174756720 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] HTTP exception thrown: Instance 2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881 could not be found. Aug 31 15:54:59.860923 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-607437f0-1ef3-4cc6-ac09-722174756720 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Request method failure captured: Aug 31 15:54:59.860923 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881 HTTP/1.1 Aug 31 15:54:59.860923 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:54:59.860923 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:54:59.860923 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:54:59.860923 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:54:59.860923 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:54:59.860923 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:54:59.860923 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:54:59.860923 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:54:59.860923 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4MqJUA1-rNBuAO4Qoiu6hpL6nZ0jQzbI1SdHfnSwpf943ZFDLeAnoMARViAVmW7HRQ5Z1f6ZQ4YyIOwuz00WNHysiuO8m8Xm-1ZGF_EyiwOpqArO84YUwLSyxbcyu7rbfFPQEkK05CbD96iBQyiYbImeQFs7vZKgJTX9pmTDPCMbVo Aug 31 15:54:59.860923 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:54:59.860923 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:54:59.860923 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:54:59.860923 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:54:59.860923 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:54:59.860923 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:54:59.860923 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: d33f8cd7d4424157b410b64c7823f480 Aug 31 15:54:59.860923 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-33929139 Aug 31 15:54:59.860923 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:54:59.860923 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:54:59.862483 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d33f8cd7d4424157b410b64c7823f480"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d33f8cd7d4424157b410b64c7823f480"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d33f8cd7d4424157b410b64c7823f480"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d33f8cd7d4424157b410b64c7823f480", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:54:59.862483 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-33929139 Aug 31 15:54:59.862483 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: d33f8cd7d4424157b410b64c7823f480 Aug 31 15:54:59.862483 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-33929139 Aug 31 15:54:59.862483 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServersWithSpecificFlavorTestJSON-33929139-project Aug 31 15:54:59.862483 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:54:59.862483 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:54:59.862483 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 6349b0ee9e2142a8a440d4e6ae0703a7 Aug 31 15:54:59.862483 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-33929139-project Aug 31 15:54:59.862483 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 15:54:59.862483 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881 could not be found. Aug 31 15:54:59.862483 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881'} Aug 31 15:54:59.863323 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:54:59.863323 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:54:59.863323 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:54:59.863323 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:54:59.863323 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:54:59.863323 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:54:59.863323 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:54:59.863323 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:54:59.863323 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:54:59.863323 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:54:59.863323 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881 could not be found. Aug 31 15:54:59.863323 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:54:59.863323 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:54:59.863323 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:54:59.863323 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:54:59.863323 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:54:59.863323 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:54:59.863323 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:54:59.863323 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:54:59.863323 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:54:59.865270 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:54:59.865270 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:54:59.865270 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:54:59.865270 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:54:59.865270 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:54:59.865270 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:54:59.865270 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:54:59.865270 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881 could not be found. Aug 31 15:54:59.865270 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:54:59.865270 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:54:59.865270 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:54:59.865270 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:54:59.865270 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:54:59.865270 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:54:59.865270 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:54:59.865270 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:54:59.865270 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881 could not be found. Aug 31 15:54:59.865270 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:54:59.867221 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-607437f0-1ef3-4cc6-ac09-722174756720 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Returning 404 to user: Instance 2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:54:59.867221 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-607437f0-1ef3-4cc6-ac09-722174756720 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "GET /compute/v2.1/servers/2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881" status: 404 len: 111 microversion: 2.1 time: 0.093758 Aug 31 15:54:59.872946 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 743/1562] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:59 2022] GET /compute/v2.1/servers/2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:54:59.877686 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-68b72521-7d25-49fc-aae8-602982bb8ebd tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Calling method '.version_select at 0x7fbb468784c0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:59.883188 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-680b2140-e013-4c30-bd50-c6fe6224eebf tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:54:59.883742 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-680b2140-e013-4c30-bd50-c6fe6224eebf tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: a8003433-1952-4dca-9b3d-43c41d2b70f5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:54:59.903441 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-680b2140-e013-4c30-bd50-c6fe6224eebf tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:59.908287 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-680b2140-e013-4c30-bd50-c6fe6224eebf tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:59.909006 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-680b2140-e013-4c30-bd50-c6fe6224eebf tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:59.909757 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-680b2140-e013-4c30-bd50-c6fe6224eebf tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:54:59.915769 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-680b2140-e013-4c30-bd50-c6fe6224eebf tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:54:59.916211 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-680b2140-e013-4c30-bd50-c6fe6224eebf tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:54:59.940461 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-68b72521-7d25-49fc-aae8-602982bb8ebd tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1476463508" status: 202 len: 0 microversion: 2.1 time: 0.071496 Aug 31 15:54:59.941882 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 820/1563] 10.222.0.50 () {58 vars in 1221 bytes} [Wed Aug 31 15:54:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1476463508 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:54:59.981696 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-878d55c0-8d18-4a13-b4ef-4014c4fc80a6 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '.version_select at 0x7fbb4690d1f0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:00.104740 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-878d55c0-8d18-4a13-b4ef-4014c4fc80a6 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "GET /compute/v2.1/images/9f2c07f2-5e5e-48d3-9305-7e17c297beb6" status: 200 len: 1429 microversion: 2.1 time: 0.126450 Aug 31 15:55:00.107856 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 821/1564] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:54:59 2022] GET /compute/v2.1/images/9f2c07f2-5e5e-48d3-9305-7e17c297beb6 => generated 1429 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:00.124391 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-478af01b-582d-44aa-9324-ebd3a3564db3 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:00.125011 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-478af01b-582d-44aa-9324-ebd3a3564db3 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: 3054bf54-101d-4e7d-b62d-bcd53d30a4bb] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:00.136906 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-478af01b-582d-44aa-9324-ebd3a3564db3 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:00.138266 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-478af01b-582d-44aa-9324-ebd3a3564db3 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:00.139638 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-478af01b-582d-44aa-9324-ebd3a3564db3 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:00.141529 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-478af01b-582d-44aa-9324-ebd3a3564db3 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:00.142193 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-478af01b-582d-44aa-9324-ebd3a3564db3 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:00.143273 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-478af01b-582d-44aa-9324-ebd3a3564db3 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:00.775343 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-680b2140-e013-4c30-bd50-c6fe6224eebf tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:00.791678 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-680b2140-e013-4c30-bd50-c6fe6224eebf tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/a8003433-1952-4dca-9b3d-43c41d2b70f5" status: 200 len: 1313 microversion: 2.1 time: 0.917554 Aug 31 15:55:00.792267 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 744/1565] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:54:59 2022] GET /compute/v2.1/servers/a8003433-1952-4dca-9b3d-43c41d2b70f5 => generated 1313 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:00.798004 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b36cb52c-d505-460d-9afc-8882f0d3cc01 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:00.802169 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b36cb52c-d505-460d-9afc-8882f0d3cc01 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:00.807127 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-478af01b-582d-44aa-9324-ebd3a3564db3 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:00.820300 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-478af01b-582d-44aa-9324-ebd3a3564db3 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/3054bf54-101d-4e7d-b62d-bcd53d30a4bb" status: 200 len: 1307 microversion: 2.1 time: 0.702509 Aug 31 15:55:00.821503 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b36cb52c-d505-460d-9afc-8882f0d3cc01 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:00.823811 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b36cb52c-d505-460d-9afc-8882f0d3cc01 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:00.825871 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 822/1566] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:00 2022] GET /compute/v2.1/servers/3054bf54-101d-4e7d-b62d-bcd53d30a4bb => generated 1307 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:00.826029 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b36cb52c-d505-460d-9afc-8882f0d3cc01 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:00.826796 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b36cb52c-d505-460d-9afc-8882f0d3cc01 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:00.827326 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b36cb52c-d505-460d-9afc-8882f0d3cc01 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:00.828845 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b36cb52c-d505-460d-9afc-8882f0d3cc01 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:00.843620 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-854a9229-ea1e-49c9-ba82-23afdc77884b req-02bb7ee5-2b60-4f57-895c-421471811578 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8003433-1952-4dca-9b3d-43c41d2b70f5", "name": "network-vif-plugged", "status": "completed", "tag": "0578bc2f-1096-4994-b834-7c0ae501f931"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:00.858429 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-854a9229-ea1e-49c9-ba82-23afdc77884b req-02bb7ee5-2b60-4f57-895c-421471811578 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:00.859367 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-854a9229-ea1e-49c9-ba82-23afdc77884b req-02bb7ee5-2b60-4f57-895c-421471811578 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:00.860126 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-854a9229-ea1e-49c9-ba82-23afdc77884b req-02bb7ee5-2b60-4f57-895c-421471811578 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:00.879246 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-854a9229-ea1e-49c9-ba82-23afdc77884b req-02bb7ee5-2b60-4f57-895c-421471811578 service nova] Creating event network-vif-plugged:0578bc2f-1096-4994-b834-7c0ae501f931 for instance a8003433-1952-4dca-9b3d-43c41d2b70f5 on n-h2-833090-16 Aug 31 15:55:00.895270 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-854a9229-ea1e-49c9-ba82-23afdc77884b req-02bb7ee5-2b60-4f57-895c-421471811578 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065924 Aug 31 15:55:00.896506 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 823/1567] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:55:00.913204 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-87964782-9969-4827-b85d-e6a85a74c4a4 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:00.919707 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-87964782-9969-4827-b85d-e6a85a74c4a4 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] [instance: d90a0347-3975-4633-be62-0e57756f93df] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:00.936601 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-87964782-9969-4827-b85d-e6a85a74c4a4 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:00.955847 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-87964782-9969-4827-b85d-e6a85a74c4a4 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:00.959544 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-87964782-9969-4827-b85d-e6a85a74c4a4 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:00.968459 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-87964782-9969-4827-b85d-e6a85a74c4a4 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:00.970732 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-87964782-9969-4827-b85d-e6a85a74c4a4 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:00.973562 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-87964782-9969-4827-b85d-e6a85a74c4a4 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:00.993804 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:55:01.213751 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b36cb52c-d505-460d-9afc-8882f0d3cc01 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:01.224366 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b36cb52c-d505-460d-9afc-8882f0d3cc01 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65" status: 200 len: 1471 microversion: 2.1 time: 0.430389 Aug 31 15:55:01.242459 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 745/1568] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:00 2022] GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65 => generated 1471 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:01.247897 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6b29ab2a-5a65-40fa-8bb4-7319c121c923 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '.version_select at 0x7fbb4686a670>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:01.337034 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6b29ab2a-5a65-40fa-8bb4-7319c121c923 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "GET /compute/v2.1/images/9f2c07f2-5e5e-48d3-9305-7e17c297beb6" status: 200 len: 1429 microversion: 2.1 time: 0.107212 Aug 31 15:55:01.337624 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 746/1569] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:55:01 2022] GET /compute/v2.1/images/9f2c07f2-5e5e-48d3-9305-7e17c297beb6 => generated 1429 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:01.395432 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-87964782-9969-4827-b85d-e6a85a74c4a4 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048bcefe0af04bc6a3a2995b22cbe43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87fc33005b5440098daf798066a653f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:01.404295 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-87964782-9969-4827-b85d-e6a85a74c4a4 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] 10.222.0.50 "GET /compute/v2.1/servers/d90a0347-3975-4633-be62-0e57756f93df" status: 200 len: 1333 microversion: 2.1 time: 0.504825 Aug 31 15:55:01.405138 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 824/1570] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:00 2022] GET /compute/v2.1/servers/d90a0347-3975-4633-be62-0e57756f93df => generated 1333 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:01.689660 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9a072566-4602-497e-8cba-459cac2c32e9 tempest-ServersWithSpecificFlavorTestJSON-1689394370 tempest-ServersWithSpecificFlavorTestJSON-1689394370-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:01.736971 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9a072566-4602-497e-8cba-459cac2c32e9 tempest-ServersWithSpecificFlavorTestJSON-1689394370 tempest-ServersWithSpecificFlavorTestJSON-1689394370-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1698763133" status: 202 len: 0 microversion: 2.1 time: 0.051042 Aug 31 15:55:01.737613 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 747/1571] 10.222.0.50 () {58 vars in 1161 bytes} [Wed Aug 31 15:55:01 2022] DELETE /compute/v2.1/flavors/1698763133 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:55:01.746388 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6188a498-ceaa-41fe-b170-7f3df165f2a8 tempest-ServersWithSpecificFlavorTestJSON-1689394370 tempest-ServersWithSpecificFlavorTestJSON-1689394370-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:01.796749 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6188a498-ceaa-41fe-b170-7f3df165f2a8 tempest-ServersWithSpecificFlavorTestJSON-1689394370 tempest-ServersWithSpecificFlavorTestJSON-1689394370-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5404 microversion: 2.1 time: 0.054451 Aug 31 15:55:01.811403 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 825/1572] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 31 15:55:01 2022] GET /compute/v2.1/flavors/detail => generated 5404 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:55:01.820489 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6bdc565c-17bd-4f79-8f12-35600d9646ec tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:01.821113 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6bdc565c-17bd-4f79-8f12-35600d9646ec tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: a8003433-1952-4dca-9b3d-43c41d2b70f5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:01.828749 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ea9e1f50-10b4-497c-ad35-9c8b462e72d4 tempest-ServersWithSpecificFlavorTestJSON-1689394370 tempest-ServersWithSpecificFlavorTestJSON-1689394370-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:01.833482 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6bdc565c-17bd-4f79-8f12-35600d9646ec tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:01.833973 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6bdc565c-17bd-4f79-8f12-35600d9646ec tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:01.834433 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6bdc565c-17bd-4f79-8f12-35600d9646ec tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:01.842889 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6bdc565c-17bd-4f79-8f12-35600d9646ec tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:01.843391 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6bdc565c-17bd-4f79-8f12-35600d9646ec tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:01.843830 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6bdc565c-17bd-4f79-8f12-35600d9646ec tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:01.918936 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ea9e1f50-10b4-497c-ad35-9c8b462e72d4 tempest-ServersWithSpecificFlavorTestJSON-1689394370 tempest-ServersWithSpecificFlavorTestJSON-1689394370-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1065532236" status: 202 len: 0 microversion: 2.1 time: 0.093724 Aug 31 15:55:01.920281 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 826/1573] 10.222.0.50 () {58 vars in 1161 bytes} [Wed Aug 31 15:55:01 2022] DELETE /compute/v2.1/flavors/1065532236 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:55:01.926286 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6504a0b4-22d1-4637-beda-e2bf8be836c5 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:01.927172 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6504a0b4-22d1-4637-beda-e2bf8be836c5 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: 3054bf54-101d-4e7d-b62d-bcd53d30a4bb] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:01.938193 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6504a0b4-22d1-4637-beda-e2bf8be836c5 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:01.938693 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6504a0b4-22d1-4637-beda-e2bf8be836c5 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:01.939129 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6504a0b4-22d1-4637-beda-e2bf8be836c5 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:01.939831 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6504a0b4-22d1-4637-beda-e2bf8be836c5 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:01.951054 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6504a0b4-22d1-4637-beda-e2bf8be836c5 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:01.951791 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6504a0b4-22d1-4637-beda-e2bf8be836c5 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:02.235338 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6bdc565c-17bd-4f79-8f12-35600d9646ec tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:02.245042 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6bdc565c-17bd-4f79-8f12-35600d9646ec tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/a8003433-1952-4dca-9b3d-43c41d2b70f5" status: 200 len: 1313 microversion: 2.1 time: 0.431663 Aug 31 15:55:02.250364 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 748/1574] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:01 2022] GET /compute/v2.1/servers/a8003433-1952-4dca-9b3d-43c41d2b70f5 => generated 1313 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:02.254825 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6504a0b4-22d1-4637-beda-e2bf8be836c5 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:02.267305 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d93ec8b4-088b-418d-9fe6-9726762def29 tempest-ServersWithSpecificFlavorTestJSON-1689394370 tempest-ServersWithSpecificFlavorTestJSON-1689394370-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:02.272999 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6504a0b4-22d1-4637-beda-e2bf8be836c5 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/3054bf54-101d-4e7d-b62d-bcd53d30a4bb" status: 200 len: 1307 microversion: 2.1 time: 0.351275 Aug 31 15:55:02.295103 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 827/1575] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:01 2022] GET /compute/v2.1/servers/3054bf54-101d-4e7d-b62d-bcd53d30a4bb => generated 1307 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:02.305638 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-96b7429a-6710-4e22-90a9-2a00ea6ce5d3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:02.307224 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-96b7429a-6710-4e22-90a9-2a00ea6ce5d3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:02.312859 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d93ec8b4-088b-418d-9fe6-9726762def29 tempest-ServersWithSpecificFlavorTestJSON-1689394370 tempest-ServersWithSpecificFlavorTestJSON-1689394370-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.063606 Aug 31 15:55:02.313342 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 749/1576] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 31 15:55:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:02.329358 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=4 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:55:02.341896 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-96b7429a-6710-4e22-90a9-2a00ea6ce5d3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:02.343545 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-96b7429a-6710-4e22-90a9-2a00ea6ce5d3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:02.362138 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-88f205c5-953b-473d-91b7-459d75627e48 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '.version_select at 0x7fbb468e2b80>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:02.364556 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-96b7429a-6710-4e22-90a9-2a00ea6ce5d3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:02.366736 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-96b7429a-6710-4e22-90a9-2a00ea6ce5d3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:02.370675 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-96b7429a-6710-4e22-90a9-2a00ea6ce5d3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:02.371186 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-96b7429a-6710-4e22-90a9-2a00ea6ce5d3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:02.453505 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-88f205c5-953b-473d-91b7-459d75627e48 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "GET /compute/v2.1/images/9f2c07f2-5e5e-48d3-9305-7e17c297beb6" status: 200 len: 1429 microversion: 2.1 time: 0.102921 Aug 31 15:55:02.454530 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 750/1577] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:55:02 2022] GET /compute/v2.1/images/9f2c07f2-5e5e-48d3-9305-7e17c297beb6 => generated 1429 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:02.466880 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7cfa4a0f-028a-482a-bfc7-c9b7cbaf2581 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:02.474313 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7cfa4a0f-028a-482a-bfc7-c9b7cbaf2581 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: c76166e9-e2cf-4253-99e2-3f8d919099ba] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:02.485865 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cfa4a0f-028a-482a-bfc7-c9b7cbaf2581 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:02.486920 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cfa4a0f-028a-482a-bfc7-c9b7cbaf2581 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:02.487544 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cfa4a0f-028a-482a-bfc7-c9b7cbaf2581 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:02.488440 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cfa4a0f-028a-482a-bfc7-c9b7cbaf2581 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:02.489072 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cfa4a0f-028a-482a-bfc7-c9b7cbaf2581 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:02.489658 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cfa4a0f-028a-482a-bfc7-c9b7cbaf2581 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:02.527900 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-7cfa4a0f-028a-482a-bfc7-c9b7cbaf2581 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] HTTP exception thrown: Instance c76166e9-e2cf-4253-99e2-3f8d919099ba could not be found. Aug 31 15:55:02.533105 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7cfa4a0f-028a-482a-bfc7-c9b7cbaf2581 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Request method failure captured: Aug 31 15:55:02.533105 n-d-833090-16 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba HTTP/1.1 Aug 31 15:55:02.533105 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:55:02.533105 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:55:02.533105 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:55:02.533105 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:55:02.533105 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:55:02.533105 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:55:02.533105 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:55:02.533105 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:55:02.533105 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4MqJUA1-rNBuAO4Qoiu6hpL6nZ0jQzbI1SdHfnSwpf943ZFDLeAnoMARViAVmW7HRQ5Z1f6ZQ4YyIOwuz00WNHysiuO8m8Xm-1ZGF_EyiwOpqArO84YUwLSyxbcyu7rbfFPQEkK05CbD96iBQyiYbImeQFs7vZKgJTX9pmTDPCMbVo Aug 31 15:55:02.533105 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:55:02.533105 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:55:02.533105 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:55:02.533105 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:55:02.533105 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:55:02.533105 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:55:02.533105 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: d33f8cd7d4424157b410b64c7823f480 Aug 31 15:55:02.533105 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-33929139 Aug 31 15:55:02.533105 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:55:02.533105 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:55:02.535109 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d33f8cd7d4424157b410b64c7823f480"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d33f8cd7d4424157b410b64c7823f480"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d33f8cd7d4424157b410b64c7823f480"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d33f8cd7d4424157b410b64c7823f480", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:55:02.535109 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-33929139 Aug 31 15:55:02.535109 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: d33f8cd7d4424157b410b64c7823f480 Aug 31 15:55:02.535109 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-33929139 Aug 31 15:55:02.535109 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServersWithSpecificFlavorTestJSON-33929139-project Aug 31 15:55:02.535109 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:55:02.535109 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:55:02.535109 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 6349b0ee9e2142a8a440d4e6ae0703a7 Aug 31 15:55:02.535109 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-33929139-project Aug 31 15:55:02.535109 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 15:55:02.535109 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance c76166e9-e2cf-4253-99e2-3f8d919099ba could not be found. Aug 31 15:55:02.535109 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'c76166e9-e2cf-4253-99e2-3f8d919099ba'} Aug 31 15:55:02.536158 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:55:02.536158 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:02.536158 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:55:02.536158 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:55:02.536158 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:55:02.536158 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:55:02.536158 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:55:02.536158 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:55:02.536158 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:55:02.536158 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:55:02.536158 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c76166e9-e2cf-4253-99e2-3f8d919099ba could not be found. Aug 31 15:55:02.536158 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:55:02.536158 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:55:02.536158 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:55:02.536158 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:02.536158 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:55:02.536158 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:55:02.536158 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:55:02.536158 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:55:02.536158 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:55:02.537941 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:55:02.537941 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 15:55:02.537941 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 15:55:02.537941 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 15:55:02.537941 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 15:55:02.537941 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:55:02.537941 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:55:02.537941 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:55:02.537941 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:55:02.537941 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c76166e9-e2cf-4253-99e2-3f8d919099ba could not be found. Aug 31 15:55:02.537941 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:55:02.537941 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:55:02.537941 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:55:02.537941 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:02.537941 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:55:02.537941 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:55:02.537941 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:55:02.537941 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:55:02.537941 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c76166e9-e2cf-4253-99e2-3f8d919099ba could not be found. Aug 31 15:55:02.537941 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:55:02.541869 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7cfa4a0f-028a-482a-bfc7-c9b7cbaf2581 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Returning 404 to user: Instance c76166e9-e2cf-4253-99e2-3f8d919099ba could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:55:02.544337 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7cfa4a0f-028a-482a-bfc7-c9b7cbaf2581 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "DELETE /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba" status: 404 len: 111 microversion: 2.1 time: 0.087497 Aug 31 15:55:02.545757 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 751/1578] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:55:02 2022] DELETE /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:55:02.564716 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c7632b2c-7151-45fb-aafd-3a0e0a6f1cf6 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:02.565757 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c7632b2c-7151-45fb-aafd-3a0e0a6f1cf6 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] [instance: d90a0347-3975-4633-be62-0e57756f93df] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:02.584048 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7632b2c-7151-45fb-aafd-3a0e0a6f1cf6 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:02.584657 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7632b2c-7151-45fb-aafd-3a0e0a6f1cf6 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:02.585186 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7632b2c-7151-45fb-aafd-3a0e0a6f1cf6 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:02.587251 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7632b2c-7151-45fb-aafd-3a0e0a6f1cf6 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:02.588242 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7632b2c-7151-45fb-aafd-3a0e0a6f1cf6 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:02.589050 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7632b2c-7151-45fb-aafd-3a0e0a6f1cf6 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:02.595448 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-96b7429a-6710-4e22-90a9-2a00ea6ce5d3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:02.612903 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-96b7429a-6710-4e22-90a9-2a00ea6ce5d3 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65" status: 200 len: 1471 microversion: 2.1 time: 0.313338 Aug 31 15:55:02.619161 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 828/1579] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:02 2022] GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65 => generated 1471 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:02.645037 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e4b0d6ed-de03-450a-a60d-3ae362f96a22 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:02.646598 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e4b0d6ed-de03-450a-a60d-3ae362f96a22 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: c76166e9-e2cf-4253-99e2-3f8d919099ba] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:02.653439 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4b0d6ed-de03-450a-a60d-3ae362f96a22 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:02.654637 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4b0d6ed-de03-450a-a60d-3ae362f96a22 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:02.655434 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4b0d6ed-de03-450a-a60d-3ae362f96a22 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:02.657443 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4b0d6ed-de03-450a-a60d-3ae362f96a22 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:02.658201 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4b0d6ed-de03-450a-a60d-3ae362f96a22 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:02.658833 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4b0d6ed-de03-450a-a60d-3ae362f96a22 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:02.695778 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-e4b0d6ed-de03-450a-a60d-3ae362f96a22 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] HTTP exception thrown: Instance c76166e9-e2cf-4253-99e2-3f8d919099ba could not be found. Aug 31 15:55:02.697633 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e4b0d6ed-de03-450a-a60d-3ae362f96a22 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Request method failure captured: Aug 31 15:55:02.697633 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba HTTP/1.1 Aug 31 15:55:02.697633 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:55:02.697633 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:55:02.697633 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:55:02.697633 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:55:02.697633 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:55:02.697633 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:55:02.697633 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:55:02.697633 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:55:02.697633 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4MqJUA1-rNBuAO4Qoiu6hpL6nZ0jQzbI1SdHfnSwpf943ZFDLeAnoMARViAVmW7HRQ5Z1f6ZQ4YyIOwuz00WNHysiuO8m8Xm-1ZGF_EyiwOpqArO84YUwLSyxbcyu7rbfFPQEkK05CbD96iBQyiYbImeQFs7vZKgJTX9pmTDPCMbVo Aug 31 15:55:02.697633 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:55:02.697633 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:55:02.697633 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:55:02.697633 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:55:02.697633 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:55:02.697633 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:55:02.697633 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: d33f8cd7d4424157b410b64c7823f480 Aug 31 15:55:02.697633 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-33929139 Aug 31 15:55:02.697633 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:55:02.697633 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:55:02.699194 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d33f8cd7d4424157b410b64c7823f480"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d33f8cd7d4424157b410b64c7823f480"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d33f8cd7d4424157b410b64c7823f480"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d33f8cd7d4424157b410b64c7823f480", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:55:02.699194 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-33929139 Aug 31 15:55:02.699194 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: d33f8cd7d4424157b410b64c7823f480 Aug 31 15:55:02.699194 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-33929139 Aug 31 15:55:02.699194 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServersWithSpecificFlavorTestJSON-33929139-project Aug 31 15:55:02.699194 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:55:02.699194 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:55:02.699194 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 6349b0ee9e2142a8a440d4e6ae0703a7 Aug 31 15:55:02.699194 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-33929139-project Aug 31 15:55:02.699194 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:55:02.699194 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance c76166e9-e2cf-4253-99e2-3f8d919099ba could not be found. Aug 31 15:55:02.699194 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'c76166e9-e2cf-4253-99e2-3f8d919099ba'} Aug 31 15:55:02.700090 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:55:02.700090 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:02.700090 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:55:02.700090 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:55:02.700090 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:55:02.700090 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:55:02.700090 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:55:02.700090 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:55:02.700090 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:55:02.700090 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:55:02.700090 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c76166e9-e2cf-4253-99e2-3f8d919099ba could not be found. Aug 31 15:55:02.700090 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:55:02.700090 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:55:02.700090 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:55:02.700090 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:02.700090 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:55:02.700090 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:55:02.700090 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:55:02.700090 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:55:02.700090 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:55:02.701528 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:55:02.701528 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:55:02.701528 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:55:02.701528 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:55:02.701528 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:55:02.701528 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:55:02.701528 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:55:02.701528 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c76166e9-e2cf-4253-99e2-3f8d919099ba could not be found. Aug 31 15:55:02.701528 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:55:02.701528 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:55:02.701528 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:55:02.701528 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:02.701528 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:55:02.701528 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:55:02.701528 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:55:02.701528 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:55:02.701528 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c76166e9-e2cf-4253-99e2-3f8d919099ba could not be found. Aug 31 15:55:02.701528 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:55:02.702778 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e4b0d6ed-de03-450a-a60d-3ae362f96a22 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Returning 404 to user: Instance c76166e9-e2cf-4253-99e2-3f8d919099ba could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:55:02.702778 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e4b0d6ed-de03-450a-a60d-3ae362f96a22 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "GET /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba" status: 404 len: 111 microversion: 2.1 time: 0.078179 Aug 31 15:55:02.716588 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 829/1580] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:02 2022] GET /compute/v2.1/servers/c76166e9-e2cf-4253-99e2-3f8d919099ba => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:55:02.736123 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-92280143-288f-4f44-9e08-311650e59e8e tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:02.738854 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-92280143-288f-4f44-9e08-311650e59e8e tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: 2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:02.757619 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-92280143-288f-4f44-9e08-311650e59e8e tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:02.759113 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-92280143-288f-4f44-9e08-311650e59e8e tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:02.761386 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-92280143-288f-4f44-9e08-311650e59e8e tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:02.762872 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-92280143-288f-4f44-9e08-311650e59e8e tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:02.764212 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-92280143-288f-4f44-9e08-311650e59e8e tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:02.765645 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-92280143-288f-4f44-9e08-311650e59e8e tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:02.792664 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-92280143-288f-4f44-9e08-311650e59e8e tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] HTTP exception thrown: Instance 2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881 could not be found. Aug 31 15:55:02.801167 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-92280143-288f-4f44-9e08-311650e59e8e tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Request method failure captured: Aug 31 15:55:02.801167 n-d-833090-16 devstack@n-api.service[128864]: request: DELETE /compute/v2.1/servers/2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881 HTTP/1.1 Aug 31 15:55:02.801167 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:55:02.801167 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:55:02.801167 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:55:02.801167 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:55:02.801167 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:55:02.801167 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:55:02.801167 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:55:02.801167 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:55:02.801167 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4MqJUA1-rNBuAO4Qoiu6hpL6nZ0jQzbI1SdHfnSwpf943ZFDLeAnoMARViAVmW7HRQ5Z1f6ZQ4YyIOwuz00WNHysiuO8m8Xm-1ZGF_EyiwOpqArO84YUwLSyxbcyu7rbfFPQEkK05CbD96iBQyiYbImeQFs7vZKgJTX9pmTDPCMbVo Aug 31 15:55:02.801167 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:55:02.801167 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:55:02.801167 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:55:02.801167 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:55:02.801167 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:55:02.801167 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:55:02.801167 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: d33f8cd7d4424157b410b64c7823f480 Aug 31 15:55:02.801167 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-33929139 Aug 31 15:55:02.801167 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:55:02.801167 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:55:02.802897 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d33f8cd7d4424157b410b64c7823f480"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d33f8cd7d4424157b410b64c7823f480"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d33f8cd7d4424157b410b64c7823f480"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d33f8cd7d4424157b410b64c7823f480", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:55:02.802897 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-33929139 Aug 31 15:55:02.802897 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: d33f8cd7d4424157b410b64c7823f480 Aug 31 15:55:02.802897 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-33929139 Aug 31 15:55:02.802897 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServersWithSpecificFlavorTestJSON-33929139-project Aug 31 15:55:02.802897 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:55:02.802897 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:55:02.802897 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 6349b0ee9e2142a8a440d4e6ae0703a7 Aug 31 15:55:02.802897 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-33929139-project Aug 31 15:55:02.802897 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:55:02.802897 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881 could not be found. Aug 31 15:55:02.802897 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881'} Aug 31 15:55:02.803859 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:55:02.803859 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:02.803859 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:55:02.803859 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:55:02.803859 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:55:02.803859 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:55:02.803859 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:55:02.803859 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:55:02.803859 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:55:02.803859 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:55:02.803859 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881 could not be found. Aug 31 15:55:02.803859 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:55:02.803859 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:55:02.803859 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:55:02.803859 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:02.803859 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:55:02.803859 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:55:02.803859 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:55:02.803859 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:55:02.803859 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:55:02.805412 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:55:02.805412 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 15:55:02.805412 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 15:55:02.805412 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 15:55:02.805412 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 15:55:02.805412 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:55:02.805412 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:55:02.805412 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:55:02.805412 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:55:02.805412 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881 could not be found. Aug 31 15:55:02.805412 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:55:02.805412 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:55:02.805412 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:55:02.805412 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:02.805412 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:55:02.805412 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:55:02.805412 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:55:02.805412 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:55:02.805412 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881 could not be found. Aug 31 15:55:02.805412 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:55:02.809196 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-92280143-288f-4f44-9e08-311650e59e8e tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Returning 404 to user: Instance 2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:55:02.813246 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-92280143-288f-4f44-9e08-311650e59e8e tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "DELETE /compute/v2.1/servers/2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881" status: 404 len: 111 microversion: 2.1 time: 0.092137 Aug 31 15:55:02.815892 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 830/1581] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:55:02 2022] DELETE /compute/v2.1/servers/2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:55:02.835480 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f082fac9-093a-489f-b8d0-9005c8657372 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:02.840869 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f082fac9-093a-489f-b8d0-9005c8657372 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] [instance: 2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:02.863458 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f082fac9-093a-489f-b8d0-9005c8657372 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:02.864157 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f082fac9-093a-489f-b8d0-9005c8657372 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:02.864684 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f082fac9-093a-489f-b8d0-9005c8657372 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:02.866702 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f082fac9-093a-489f-b8d0-9005c8657372 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:02.867377 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f082fac9-093a-489f-b8d0-9005c8657372 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:02.869036 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f082fac9-093a-489f-b8d0-9005c8657372 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:02.919667 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-f082fac9-093a-489f-b8d0-9005c8657372 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] HTTP exception thrown: Instance 2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881 could not be found. Aug 31 15:55:02.931447 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f082fac9-093a-489f-b8d0-9005c8657372 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Request method failure captured: Aug 31 15:55:02.931447 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881 HTTP/1.1 Aug 31 15:55:02.931447 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:55:02.931447 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:55:02.931447 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:55:02.931447 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:55:02.931447 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:55:02.931447 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:55:02.931447 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:55:02.931447 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:55:02.931447 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4MqJUA1-rNBuAO4Qoiu6hpL6nZ0jQzbI1SdHfnSwpf943ZFDLeAnoMARViAVmW7HRQ5Z1f6ZQ4YyIOwuz00WNHysiuO8m8Xm-1ZGF_EyiwOpqArO84YUwLSyxbcyu7rbfFPQEkK05CbD96iBQyiYbImeQFs7vZKgJTX9pmTDPCMbVo Aug 31 15:55:02.931447 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:55:02.931447 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:55:02.931447 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:55:02.931447 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:55:02.931447 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:55:02.931447 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:55:02.931447 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: d33f8cd7d4424157b410b64c7823f480 Aug 31 15:55:02.931447 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-33929139 Aug 31 15:55:02.931447 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:55:02.931447 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:55:02.933349 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d33f8cd7d4424157b410b64c7823f480"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d33f8cd7d4424157b410b64c7823f480"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d33f8cd7d4424157b410b64c7823f480"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d33f8cd7d4424157b410b64c7823f480", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:55:02.933349 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-33929139 Aug 31 15:55:02.933349 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: d33f8cd7d4424157b410b64c7823f480 Aug 31 15:55:02.933349 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-33929139 Aug 31 15:55:02.933349 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServersWithSpecificFlavorTestJSON-33929139-project Aug 31 15:55:02.933349 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:55:02.933349 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:55:02.933349 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 6349b0ee9e2142a8a440d4e6ae0703a7 Aug 31 15:55:02.933349 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-33929139-project Aug 31 15:55:02.933349 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:55:02.933349 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881 could not be found. Aug 31 15:55:02.933349 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881'} Aug 31 15:55:02.934639 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:55:02.934639 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:02.934639 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:55:02.934639 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:55:02.934639 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:55:02.934639 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:55:02.934639 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:55:02.934639 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:55:02.934639 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:55:02.934639 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:55:02.934639 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881 could not be found. Aug 31 15:55:02.934639 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:55:02.934639 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:55:02.934639 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:55:02.934639 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:02.934639 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:55:02.934639 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:55:02.934639 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:55:02.934639 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:55:02.934639 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:55:02.936559 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:55:02.936559 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:55:02.936559 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:55:02.936559 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:55:02.936559 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:55:02.936559 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:55:02.936559 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:55:02.936559 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881 could not be found. Aug 31 15:55:02.936559 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:55:02.936559 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:55:02.936559 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:55:02.936559 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:02.936559 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:55:02.936559 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:55:02.936559 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:55:02.936559 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:55:02.936559 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881 could not be found. Aug 31 15:55:02.936559 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:55:02.939386 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f082fac9-093a-489f-b8d0-9005c8657372 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] Returning 404 to user: Instance 2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:55:02.940513 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f082fac9-093a-489f-b8d0-9005c8657372 tempest-ServersWithSpecificFlavorTestJSON-33929139 tempest-ServersWithSpecificFlavorTestJSON-33929139-project] 10.222.0.50 "GET /compute/v2.1/servers/2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881" status: 404 len: 111 microversion: 2.1 time: 0.119962 Aug 31 15:55:02.947064 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c7632b2c-7151-45fb-aafd-3a0e0a6f1cf6 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048bcefe0af04bc6a3a2995b22cbe43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87fc33005b5440098daf798066a653f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:02.947298 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 831/1582] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:02 2022] GET /compute/v2.1/servers/2d8bbf9f-d90b-4d51-9cdd-2a6f9144d881 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:55:02.956958 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c7632b2c-7151-45fb-aafd-3a0e0a6f1cf6 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] 10.222.0.50 "GET /compute/v2.1/servers/d90a0347-3975-4633-be62-0e57756f93df" status: 200 len: 1333 microversion: 2.1 time: 0.409744 Aug 31 15:55:02.960771 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 752/1583] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:02 2022] GET /compute/v2.1/servers/d90a0347-3975-4633-be62-0e57756f93df => generated 1333 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:03.160818 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-cf24e564-23ba-43f2-80a7-44c0f3c58292 req-04a192d2-e35c-4502-a9d5-269cf4b97c9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0442e1d9-fa54-4957-8313-335c0f39c763", "name": "network-vif-plugged", "status": "completed", "tag": "a977db7b-bcd4-47fa-9827-fa736d70e905"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:03.203699 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-cf24e564-23ba-43f2-80a7-44c0f3c58292 req-04a192d2-e35c-4502-a9d5-269cf4b97c9b service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:03.204520 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-cf24e564-23ba-43f2-80a7-44c0f3c58292 req-04a192d2-e35c-4502-a9d5-269cf4b97c9b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:03.205164 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-cf24e564-23ba-43f2-80a7-44c0f3c58292 req-04a192d2-e35c-4502-a9d5-269cf4b97c9b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:03.240013 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-cf24e564-23ba-43f2-80a7-44c0f3c58292 req-04a192d2-e35c-4502-a9d5-269cf4b97c9b service nova] Creating event network-vif-plugged:a977db7b-bcd4-47fa-9827-fa736d70e905 for instance 0442e1d9-fa54-4957-8313-335c0f39c763 on n-h1-833090-16 Aug 31 15:55:03.260530 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-cf24e564-23ba-43f2-80a7-44c0f3c58292 req-04a192d2-e35c-4502-a9d5-269cf4b97c9b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092430 Aug 31 15:55:03.267927 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8b85b1aa-74bb-4b54-9c14-23425dd40f6d tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:03.269421 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8b85b1aa-74bb-4b54-9c14-23425dd40f6d tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: a8003433-1952-4dca-9b3d-43c41d2b70f5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:03.280555 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 832/1584] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:55:03.291839 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b85b1aa-74bb-4b54-9c14-23425dd40f6d tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:03.294924 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b85b1aa-74bb-4b54-9c14-23425dd40f6d tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:03.302960 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b85b1aa-74bb-4b54-9c14-23425dd40f6d tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:03.308258 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b85b1aa-74bb-4b54-9c14-23425dd40f6d tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:03.308914 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b85b1aa-74bb-4b54-9c14-23425dd40f6d tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:03.309618 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ee827417-7aa3-4d5e-b498-6fd3568d9fab tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:03.314351 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b85b1aa-74bb-4b54-9c14-23425dd40f6d tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:03.314962 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ee827417-7aa3-4d5e-b498-6fd3568d9fab tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: 3054bf54-101d-4e7d-b62d-bcd53d30a4bb] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:03.339411 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ee827417-7aa3-4d5e-b498-6fd3568d9fab tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:03.343393 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ee827417-7aa3-4d5e-b498-6fd3568d9fab tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:03.345850 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ee827417-7aa3-4d5e-b498-6fd3568d9fab tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:03.349896 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ee827417-7aa3-4d5e-b498-6fd3568d9fab tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:03.351774 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ee827417-7aa3-4d5e-b498-6fd3568d9fab tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:03.352577 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ee827417-7aa3-4d5e-b498-6fd3568d9fab tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:03.950930 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8b85b1aa-74bb-4b54-9c14-23425dd40f6d tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:03.995733 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8b85b1aa-74bb-4b54-9c14-23425dd40f6d tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/a8003433-1952-4dca-9b3d-43c41d2b70f5" status: 200 len: 1500 microversion: 2.1 time: 0.729402 Aug 31 15:55:03.999017 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 753/1585] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:03 2022] GET /compute/v2.1/servers/a8003433-1952-4dca-9b3d-43c41d2b70f5 => generated 1500 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:55:04.008049 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0c3a1be0-ba65-417e-92d2-79f8a122a49d tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '.version_select at 0x7fbb4656a790>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:04.009104 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ee827417-7aa3-4d5e-b498-6fd3568d9fab tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:04.025924 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ee827417-7aa3-4d5e-b498-6fd3568d9fab tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/3054bf54-101d-4e7d-b62d-bcd53d30a4bb" status: 200 len: 1307 microversion: 2.1 time: 0.728429 Aug 31 15:55:04.034342 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 833/1586] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:03 2022] GET /compute/v2.1/servers/3054bf54-101d-4e7d-b62d-bcd53d30a4bb => generated 1307 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:55:04.054025 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-315dc2bb-163e-420a-b360-479290698805 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:04.057220 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-315dc2bb-163e-420a-b360-479290698805 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:04.085705 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-315dc2bb-163e-420a-b360-479290698805 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:04.086418 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-315dc2bb-163e-420a-b360-479290698805 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:04.087797 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-315dc2bb-163e-420a-b360-479290698805 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:04.091659 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-315dc2bb-163e-420a-b360-479290698805 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:04.093385 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-315dc2bb-163e-420a-b360-479290698805 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:04.094209 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-315dc2bb-163e-420a-b360-479290698805 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:04.112627 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0c3a1be0-ba65-417e-92d2-79f8a122a49d tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "GET /compute/v2.1/images/9f2c07f2-5e5e-48d3-9305-7e17c297beb6" status: 200 len: 1429 microversion: 2.1 time: 0.108073 Aug 31 15:55:04.115117 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 754/1587] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:55:03 2022] GET /compute/v2.1/images/9f2c07f2-5e5e-48d3-9305-7e17c297beb6 => generated 1429 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:04.130014 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cb903a98-376a-4e7a-b7a8-591cd806d474 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:04.138251 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cb903a98-376a-4e7a-b7a8-591cd806d474 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] [instance: d90a0347-3975-4633-be62-0e57756f93df] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:04.163603 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb903a98-376a-4e7a-b7a8-591cd806d474 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:04.166073 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb903a98-376a-4e7a-b7a8-591cd806d474 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:04.168523 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb903a98-376a-4e7a-b7a8-591cd806d474 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:04.170134 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb903a98-376a-4e7a-b7a8-591cd806d474 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:04.175087 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb903a98-376a-4e7a-b7a8-591cd806d474 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:04.176778 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb903a98-376a-4e7a-b7a8-591cd806d474 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:04.660900 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-315dc2bb-163e-420a-b360-479290698805 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:04.673766 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-315dc2bb-163e-420a-b360-479290698805 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65" status: 200 len: 1476 microversion: 2.1 time: 0.636930 Aug 31 15:55:04.687040 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 834/1588] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:04 2022] GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65 => generated 1476 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:04.696486 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-535e94d7-b203-48ae-8c53-0fcf6b41912a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:04.697105 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-535e94d7-b203-48ae-8c53-0fcf6b41912a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: a8003433-1952-4dca-9b3d-43c41d2b70f5] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:04.705008 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-535e94d7-b203-48ae-8c53-0fcf6b41912a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:04.705634 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-535e94d7-b203-48ae-8c53-0fcf6b41912a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:04.706293 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-535e94d7-b203-48ae-8c53-0fcf6b41912a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:04.707389 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-535e94d7-b203-48ae-8c53-0fcf6b41912a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:04.708048 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-535e94d7-b203-48ae-8c53-0fcf6b41912a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:04.708681 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-535e94d7-b203-48ae-8c53-0fcf6b41912a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:04.747802 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-535e94d7-b203-48ae-8c53-0fcf6b41912a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: a8003433-1952-4dca-9b3d-43c41d2b70f5] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:55:04.862531 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cb903a98-376a-4e7a-b7a8-591cd806d474 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048bcefe0af04bc6a3a2995b22cbe43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87fc33005b5440098daf798066a653f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:04.878873 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cb903a98-376a-4e7a-b7a8-591cd806d474 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] 10.222.0.50 "GET /compute/v2.1/servers/d90a0347-3975-4633-be62-0e57756f93df" status: 200 len: 1333 microversion: 2.1 time: 0.760326 Aug 31 15:55:04.879888 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 755/1589] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:04 2022] GET /compute/v2.1/servers/d90a0347-3975-4633-be62-0e57756f93df => generated 1333 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:04.933606 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-535e94d7-b203-48ae-8c53-0fcf6b41912a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a8003433-1952-4dca-9b3d-43c41d2b70f5" status: 204 len: 0 microversion: 2.1 time: 0.244632 Aug 31 15:55:04.937328 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 835/1590] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:55:04 2022] DELETE /compute/v2.1/servers/a8003433-1952-4dca-9b3d-43c41d2b70f5 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:55:04.943244 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c36eec97-0c3c-4b0e-bc3b-820fedae0d10 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:04.944001 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c36eec97-0c3c-4b0e-bc3b-820fedae0d10 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: a8003433-1952-4dca-9b3d-43c41d2b70f5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:04.953692 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c36eec97-0c3c-4b0e-bc3b-820fedae0d10 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:04.954617 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c36eec97-0c3c-4b0e-bc3b-820fedae0d10 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:04.955891 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c36eec97-0c3c-4b0e-bc3b-820fedae0d10 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:04.956325 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c36eec97-0c3c-4b0e-bc3b-820fedae0d10 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:04.956922 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c36eec97-0c3c-4b0e-bc3b-820fedae0d10 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:04.957501 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c36eec97-0c3c-4b0e-bc3b-820fedae0d10 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:05.052731 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-69aa6620-4693-405f-8c48-8184286ab212 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:05.053196 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-69aa6620-4693-405f-8c48-8184286ab212 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: 3054bf54-101d-4e7d-b62d-bcd53d30a4bb] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:05.065351 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69aa6620-4693-405f-8c48-8184286ab212 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:05.065582 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69aa6620-4693-405f-8c48-8184286ab212 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:05.066011 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69aa6620-4693-405f-8c48-8184286ab212 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:05.067652 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69aa6620-4693-405f-8c48-8184286ab212 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:05.068113 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69aa6620-4693-405f-8c48-8184286ab212 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:05.068539 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69aa6620-4693-405f-8c48-8184286ab212 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:05.279141 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c36eec97-0c3c-4b0e-bc3b-820fedae0d10 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:05.293617 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c36eec97-0c3c-4b0e-bc3b-820fedae0d10 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/a8003433-1952-4dca-9b3d-43c41d2b70f5" status: 200 len: 1506 microversion: 2.1 time: 0.354734 Aug 31 15:55:05.294643 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 756/1591] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:04 2022] GET /compute/v2.1/servers/a8003433-1952-4dca-9b3d-43c41d2b70f5 => generated 1506 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:05.308584 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4795132b-69fc-4c69-b4c9-10bf5c9dbddc tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '.version_select at 0x7fbb46408f70>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:05.366221 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4795132b-69fc-4c69-b4c9-10bf5c9dbddc tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "GET /compute/v2.1/images/9f2c07f2-5e5e-48d3-9305-7e17c297beb6" status: 200 len: 1429 microversion: 2.1 time: 0.069822 Aug 31 15:55:05.374926 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 757/1592] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:55:05 2022] GET /compute/v2.1/images/9f2c07f2-5e5e-48d3-9305-7e17c297beb6 => generated 1429 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:05.379940 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-df2cd4f5-c3e8-498e-ab82-cb3ad688cef0 req-61e361bb-c80f-4af6-a210-d664bd662a13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d90a0347-3975-4633-be62-0e57756f93df", "name": "network-vif-plugged", "status": "completed", "tag": "357e2a5c-9788-4346-b9a8-19f88f270678"}, {"server_uuid": "d90a0347-3975-4633-be62-0e57756f93df", "name": "network-vif-plugged", "status": "completed", "tag": "a72bbdc1-c8b4-407a-b1c4-431d6f63424f"}, {"server_uuid": "3054bf54-101d-4e7d-b62d-bcd53d30a4bb", "name": "network-vif-plugged", "status": "completed", "tag": "032c6df0-61bb-4081-aa47-4e046311cc7a"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:05.393028 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-df2cd4f5-c3e8-498e-ab82-cb3ad688cef0 req-61e361bb-c80f-4af6-a210-d664bd662a13 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:05.393951 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-df2cd4f5-c3e8-498e-ab82-cb3ad688cef0 req-61e361bb-c80f-4af6-a210-d664bd662a13 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:05.395066 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-df2cd4f5-c3e8-498e-ab82-cb3ad688cef0 req-61e361bb-c80f-4af6-a210-d664bd662a13 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:05.409693 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-df2cd4f5-c3e8-498e-ab82-cb3ad688cef0 req-61e361bb-c80f-4af6-a210-d664bd662a13 service nova] Creating event network-vif-plugged:357e2a5c-9788-4346-b9a8-19f88f270678 for instance d90a0347-3975-4633-be62-0e57756f93df on n-h1-833090-16 Aug 31 15:55:05.410619 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-df2cd4f5-c3e8-498e-ab82-cb3ad688cef0 req-61e361bb-c80f-4af6-a210-d664bd662a13 service nova] Creating event network-vif-plugged:a72bbdc1-c8b4-407a-b1c4-431d6f63424f for instance d90a0347-3975-4633-be62-0e57756f93df on n-h1-833090-16 Aug 31 15:55:05.411394 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-df2cd4f5-c3e8-498e-ab82-cb3ad688cef0 req-61e361bb-c80f-4af6-a210-d664bd662a13 service nova] Creating event network-vif-plugged:032c6df0-61bb-4081-aa47-4e046311cc7a for instance 3054bf54-101d-4e7d-b62d-bcd53d30a4bb on n-h1-833090-16 Aug 31 15:55:05.420575 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-df2cd4f5-c3e8-498e-ab82-cb3ad688cef0 req-61e361bb-c80f-4af6-a210-d664bd662a13 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.044079 Aug 31 15:55:05.421776 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 758/1593] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:55:05.491378 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-69aa6620-4693-405f-8c48-8184286ab212 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:05.518028 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-69aa6620-4693-405f-8c48-8184286ab212 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/3054bf54-101d-4e7d-b62d-bcd53d30a4bb" status: 200 len: 1307 microversion: 2.1 time: 0.469449 Aug 31 15:55:05.533718 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 836/1594] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:05 2022] GET /compute/v2.1/servers/3054bf54-101d-4e7d-b62d-bcd53d30a4bb => generated 1307 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:05.704325 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f6bf5f28-1275-4238-9bfd-beed5edc7532 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:05.705240 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f6bf5f28-1275-4238-9bfd-beed5edc7532 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:05.717720 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6bf5f28-1275-4238-9bfd-beed5edc7532 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:05.720575 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6bf5f28-1275-4238-9bfd-beed5edc7532 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:05.721873 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6bf5f28-1275-4238-9bfd-beed5edc7532 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:05.722936 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6bf5f28-1275-4238-9bfd-beed5edc7532 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:05.724242 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6bf5f28-1275-4238-9bfd-beed5edc7532 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:05.724940 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6bf5f28-1275-4238-9bfd-beed5edc7532 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:05.907541 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f074f8c6-1ff4-4f62-9a7b-d8ac8515790b tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:05.910716 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f074f8c6-1ff4-4f62-9a7b-d8ac8515790b tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] [instance: d90a0347-3975-4633-be62-0e57756f93df] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:05.920430 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f074f8c6-1ff4-4f62-9a7b-d8ac8515790b tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:05.921284 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f074f8c6-1ff4-4f62-9a7b-d8ac8515790b tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:05.922137 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f074f8c6-1ff4-4f62-9a7b-d8ac8515790b tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:05.924101 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f074f8c6-1ff4-4f62-9a7b-d8ac8515790b tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:05.924748 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f074f8c6-1ff4-4f62-9a7b-d8ac8515790b tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:05.925804 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f074f8c6-1ff4-4f62-9a7b-d8ac8515790b tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:06.012964 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f6bf5f28-1275-4238-9bfd-beed5edc7532 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:06.052326 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f6bf5f28-1275-4238-9bfd-beed5edc7532 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65" status: 200 len: 1476 microversion: 2.1 time: 0.353344 Aug 31 15:55:06.052921 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 759/1595] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:05 2022] GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65 => generated 1476 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:06.284878 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f074f8c6-1ff4-4f62-9a7b-d8ac8515790b tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048bcefe0af04bc6a3a2995b22cbe43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87fc33005b5440098daf798066a653f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:06.296824 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f074f8c6-1ff4-4f62-9a7b-d8ac8515790b tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] 10.222.0.50 "GET /compute/v2.1/servers/d90a0347-3975-4633-be62-0e57756f93df" status: 200 len: 1333 microversion: 2.1 time: 0.394319 Aug 31 15:55:06.298310 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 837/1596] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:05 2022] GET /compute/v2.1/servers/d90a0347-3975-4633-be62-0e57756f93df => generated 1333 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:06.321269 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c884ab72-44b0-4aed-8d96-45c9aee2985a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:06.323243 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c884ab72-44b0-4aed-8d96-45c9aee2985a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: a8003433-1952-4dca-9b3d-43c41d2b70f5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:06.346616 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c884ab72-44b0-4aed-8d96-45c9aee2985a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:06.347341 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c884ab72-44b0-4aed-8d96-45c9aee2985a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:06.347990 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c884ab72-44b0-4aed-8d96-45c9aee2985a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:06.349101 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c884ab72-44b0-4aed-8d96-45c9aee2985a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:06.350272 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c884ab72-44b0-4aed-8d96-45c9aee2985a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:06.350936 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c884ab72-44b0-4aed-8d96-45c9aee2985a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:06.382010 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e8526cd4-0a89-4af1-bf3a-9e65aef21b5b tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '.version_select at 0x7fbb4ac57d30>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:06.464297 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e8526cd4-0a89-4af1-bf3a-9e65aef21b5b tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "GET /compute/v2.1/images/9f2c07f2-5e5e-48d3-9305-7e17c297beb6" status: 200 len: 1429 microversion: 2.1 time: 0.087245 Aug 31 15:55:06.467945 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 838/1597] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:55:06 2022] GET /compute/v2.1/images/9f2c07f2-5e5e-48d3-9305-7e17c297beb6 => generated 1429 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:06.543019 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3762d224-993a-4fc4-b184-c7a123a7745b tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:06.543918 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3762d224-993a-4fc4-b184-c7a123a7745b tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: 3054bf54-101d-4e7d-b62d-bcd53d30a4bb] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:06.552067 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3762d224-993a-4fc4-b184-c7a123a7745b tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:06.553471 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3762d224-993a-4fc4-b184-c7a123a7745b tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:06.554159 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3762d224-993a-4fc4-b184-c7a123a7745b tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:06.555300 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3762d224-993a-4fc4-b184-c7a123a7745b tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:06.555921 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3762d224-993a-4fc4-b184-c7a123a7745b tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:06.557905 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3762d224-993a-4fc4-b184-c7a123a7745b tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:07.200596 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c884ab72-44b0-4aed-8d96-45c9aee2985a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:07.209832 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c884ab72-44b0-4aed-8d96-45c9aee2985a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/a8003433-1952-4dca-9b3d-43c41d2b70f5" status: 200 len: 1506 microversion: 2.1 time: 0.895117 Aug 31 15:55:07.215217 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 760/1598] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:06 2022] GET /compute/v2.1/servers/a8003433-1952-4dca-9b3d-43c41d2b70f5 => generated 1506 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:07.221473 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7e414cff-b26f-42e0-a870-cbc85afdfab8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:07.227029 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7e414cff-b26f-42e0-a870-cbc85afdfab8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:07.244422 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e414cff-b26f-42e0-a870-cbc85afdfab8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:07.245229 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e414cff-b26f-42e0-a870-cbc85afdfab8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:07.245877 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e414cff-b26f-42e0-a870-cbc85afdfab8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:07.246944 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e414cff-b26f-42e0-a870-cbc85afdfab8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:07.247658 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e414cff-b26f-42e0-a870-cbc85afdfab8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:07.248294 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e414cff-b26f-42e0-a870-cbc85afdfab8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:07.256803 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3762d224-993a-4fc4-b184-c7a123a7745b tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:07.266033 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3762d224-993a-4fc4-b184-c7a123a7745b tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/3054bf54-101d-4e7d-b62d-bcd53d30a4bb" status: 200 len: 1307 microversion: 2.1 time: 0.727765 Aug 31 15:55:07.270144 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 839/1599] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:06 2022] GET /compute/v2.1/servers/3054bf54-101d-4e7d-b62d-bcd53d30a4bb => generated 1307 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:07.318553 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-48c918f6-017e-4efc-8490-6006ae94805a tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:07.319993 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-48c918f6-017e-4efc-8490-6006ae94805a tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] [instance: d90a0347-3975-4633-be62-0e57756f93df] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:07.329777 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-48c918f6-017e-4efc-8490-6006ae94805a tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:07.330808 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-48c918f6-017e-4efc-8490-6006ae94805a tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:07.331666 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-48c918f6-017e-4efc-8490-6006ae94805a tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:07.333986 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-48c918f6-017e-4efc-8490-6006ae94805a tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:07.335658 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-48c918f6-017e-4efc-8490-6006ae94805a tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:07.337556 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-48c918f6-017e-4efc-8490-6006ae94805a tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:07.902780 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-48c918f6-017e-4efc-8490-6006ae94805a tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048bcefe0af04bc6a3a2995b22cbe43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87fc33005b5440098daf798066a653f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:07.912012 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-48c918f6-017e-4efc-8490-6006ae94805a tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] 10.222.0.50 "GET /compute/v2.1/servers/d90a0347-3975-4633-be62-0e57756f93df" status: 200 len: 1333 microversion: 2.1 time: 0.597846 Aug 31 15:55:07.912601 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 840/1600] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:07 2022] GET /compute/v2.1/servers/d90a0347-3975-4633-be62-0e57756f93df => generated 1333 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:55:07.923142 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7e414cff-b26f-42e0-a870-cbc85afdfab8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:07.935383 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7e414cff-b26f-42e0-a870-cbc85afdfab8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65" status: 200 len: 1476 microversion: 2.1 time: 0.718514 Aug 31 15:55:07.954765 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-48b07c20-000b-4025-9649-5c2964b30263 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '.version_select at 0x7fbb46857820>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:07.962769 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 761/1601] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:07 2022] GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65 => generated 1476 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:07.996188 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-b3a99d96-d220-4786-bd39-599275b45d90 req-3524b866-d186-4280-8c98-b8565a7af6cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8003433-1952-4dca-9b3d-43c41d2b70f5", "name": "network-vif-deleted", "tag": "0578bc2f-1096-4994-b834-7c0ae501f931"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:08.033383 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b3a99d96-d220-4786-bd39-599275b45d90 req-3524b866-d186-4280-8c98-b8565a7af6cf service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:08.034177 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b3a99d96-d220-4786-bd39-599275b45d90 req-3524b866-d186-4280-8c98-b8565a7af6cf service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:08.034805 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b3a99d96-d220-4786-bd39-599275b45d90 req-3524b866-d186-4280-8c98-b8565a7af6cf service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:08.069832 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-48b07c20-000b-4025-9649-5c2964b30263 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "GET /compute/v2.1/images/9f2c07f2-5e5e-48d3-9305-7e17c297beb6" status: 200 len: 1429 microversion: 2.1 time: 0.148452 Aug 31 15:55:08.070538 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 841/1602] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:55:07 2022] GET /compute/v2.1/images/9f2c07f2-5e5e-48d3-9305-7e17c297beb6 => generated 1429 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:08.081126 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-b3a99d96-d220-4786-bd39-599275b45d90 req-3524b866-d186-4280-8c98-b8565a7af6cf service nova] Creating event network-vif-deleted:0578bc2f-1096-4994-b834-7c0ae501f931 for instance a8003433-1952-4dca-9b3d-43c41d2b70f5 on n-h2-833090-16 Aug 31 15:55:08.089015 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-b3a99d96-d220-4786-bd39-599275b45d90 req-3524b866-d186-4280-8c98-b8565a7af6cf service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122776 Aug 31 15:55:08.090107 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 762/1603] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:55:08.240678 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2273e0a8-b9d2-4d34-9cab-b68d7d7d2ae0 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:08.241676 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2273e0a8-b9d2-4d34-9cab-b68d7d7d2ae0 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: a8003433-1952-4dca-9b3d-43c41d2b70f5] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:08.256950 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2273e0a8-b9d2-4d34-9cab-b68d7d7d2ae0 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:08.257877 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2273e0a8-b9d2-4d34-9cab-b68d7d7d2ae0 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:08.258512 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2273e0a8-b9d2-4d34-9cab-b68d7d7d2ae0 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:08.260184 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2273e0a8-b9d2-4d34-9cab-b68d7d7d2ae0 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:08.261336 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2273e0a8-b9d2-4d34-9cab-b68d7d7d2ae0 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:08.263725 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2273e0a8-b9d2-4d34-9cab-b68d7d7d2ae0 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:08.291948 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ce378b70-35fc-4189-8021-d7ddc9f47891 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:08.293394 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ce378b70-35fc-4189-8021-d7ddc9f47891 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: 3054bf54-101d-4e7d-b62d-bcd53d30a4bb] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:08.304698 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce378b70-35fc-4189-8021-d7ddc9f47891 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:08.306573 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce378b70-35fc-4189-8021-d7ddc9f47891 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:08.307198 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce378b70-35fc-4189-8021-d7ddc9f47891 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:08.316892 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce378b70-35fc-4189-8021-d7ddc9f47891 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:08.317780 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce378b70-35fc-4189-8021-d7ddc9f47891 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:08.318830 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce378b70-35fc-4189-8021-d7ddc9f47891 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:08.354475 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:55:08.449989 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2273e0a8-b9d2-4d34-9cab-b68d7d7d2ae0 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:08.474036 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2273e0a8-b9d2-4d34-9cab-b68d7d7d2ae0 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/a8003433-1952-4dca-9b3d-43c41d2b70f5" status: 200 len: 1464 microversion: 2.1 time: 0.237891 Aug 31 15:55:08.475055 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 842/1604] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:08 2022] GET /compute/v2.1/servers/a8003433-1952-4dca-9b3d-43c41d2b70f5 => generated 1464 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:08.847245 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ce378b70-35fc-4189-8021-d7ddc9f47891 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:08.858047 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ce378b70-35fc-4189-8021-d7ddc9f47891 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/3054bf54-101d-4e7d-b62d-bcd53d30a4bb" status: 200 len: 1486 microversion: 2.1 time: 0.570592 Aug 31 15:55:08.863124 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 763/1605] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:08 2022] GET /compute/v2.1/servers/3054bf54-101d-4e7d-b62d-bcd53d30a4bb => generated 1486 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:08.894881 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2f63442c-d735-4792-b12c-f43bf1bffdef tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:08.895422 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2f63442c-d735-4792-b12c-f43bf1bffdef tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: 3054bf54-101d-4e7d-b62d-bcd53d30a4bb] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:08.906008 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2f63442c-d735-4792-b12c-f43bf1bffdef tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:08.912677 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2f63442c-d735-4792-b12c-f43bf1bffdef tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:08.915412 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2f63442c-d735-4792-b12c-f43bf1bffdef tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:08.917468 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2f63442c-d735-4792-b12c-f43bf1bffdef tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:08.918119 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2f63442c-d735-4792-b12c-f43bf1bffdef tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:08.918961 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2f63442c-d735-4792-b12c-f43bf1bffdef tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:08.933716 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1eacec37-bc13-4bca-a03e-c1a47803000e tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:08.934658 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1eacec37-bc13-4bca-a03e-c1a47803000e tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] [instance: d90a0347-3975-4633-be62-0e57756f93df] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:08.948017 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1eacec37-bc13-4bca-a03e-c1a47803000e tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:08.948017 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1eacec37-bc13-4bca-a03e-c1a47803000e tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:08.949418 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1eacec37-bc13-4bca-a03e-c1a47803000e tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:08.950343 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1eacec37-bc13-4bca-a03e-c1a47803000e tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:08.950928 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1eacec37-bc13-4bca-a03e-c1a47803000e tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:08.951414 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1eacec37-bc13-4bca-a03e-c1a47803000e tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:09.068136 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2f63442c-d735-4792-b12c-f43bf1bffdef tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "POST /compute/v2.1/servers/3054bf54-101d-4e7d-b62d-bcd53d30a4bb/action" status: 202 len: 0 microversion: 2.1 time: 0.179796 Aug 31 15:55:09.069067 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 843/1606] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 15:55:08 2022] POST /compute/v2.1/servers/3054bf54-101d-4e7d-b62d-bcd53d30a4bb/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:55:09.082696 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6d2dfb8c-42f8-402a-a3da-0cd0e8111c65 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:09.089071 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6d2dfb8c-42f8-402a-a3da-0cd0e8111c65 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:09.105155 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d2dfb8c-42f8-402a-a3da-0cd0e8111c65 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:09.105652 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d2dfb8c-42f8-402a-a3da-0cd0e8111c65 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:09.106321 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d2dfb8c-42f8-402a-a3da-0cd0e8111c65 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:09.107036 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d2dfb8c-42f8-402a-a3da-0cd0e8111c65 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:09.107484 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d2dfb8c-42f8-402a-a3da-0cd0e8111c65 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:09.108984 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d2dfb8c-42f8-402a-a3da-0cd0e8111c65 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:09.361282 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1eacec37-bc13-4bca-a03e-c1a47803000e tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048bcefe0af04bc6a3a2995b22cbe43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87fc33005b5440098daf798066a653f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:09.374945 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1eacec37-bc13-4bca-a03e-c1a47803000e tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] 10.222.0.50 "GET /compute/v2.1/servers/d90a0347-3975-4633-be62-0e57756f93df" status: 200 len: 1668 microversion: 2.1 time: 0.445434 Aug 31 15:55:09.375529 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 764/1607] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:08 2022] GET /compute/v2.1/servers/d90a0347-3975-4633-be62-0e57756f93df => generated 1668 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:55:09.386024 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b0622a33-a5b4-49ce-afce-ed29920cbafa tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:09.387070 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b0622a33-a5b4-49ce-afce-ed29920cbafa tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: 3054bf54-101d-4e7d-b62d-bcd53d30a4bb] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:09.400009 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0622a33-a5b4-49ce-afce-ed29920cbafa tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:09.406744 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0622a33-a5b4-49ce-afce-ed29920cbafa tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:09.407329 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0622a33-a5b4-49ce-afce-ed29920cbafa tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:09.408568 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0622a33-a5b4-49ce-afce-ed29920cbafa tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:09.409219 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0622a33-a5b4-49ce-afce-ed29920cbafa tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:09.409648 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0622a33-a5b4-49ce-afce-ed29920cbafa tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:09.650433 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6d2dfb8c-42f8-402a-a3da-0cd0e8111c65 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:09.652953 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:55:09.670409 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6d2dfb8c-42f8-402a-a3da-0cd0e8111c65 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65" status: 200 len: 1476 microversion: 2.1 time: 0.595788 Aug 31 15:55:09.672027 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 844/1608] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:09 2022] GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65 => generated 1476 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:09.690508 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6c264750-b20a-4dbc-b698-9d2990db3c50 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '.version_select at 0x7fbb470458b0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:09.774242 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b0622a33-a5b4-49ce-afce-ed29920cbafa tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:09.799188 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b0622a33-a5b4-49ce-afce-ed29920cbafa tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/3054bf54-101d-4e7d-b62d-bcd53d30a4bb" status: 200 len: 1471 microversion: 2.1 time: 0.418236 Aug 31 15:55:09.799188 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 765/1609] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:09 2022] GET /compute/v2.1/servers/3054bf54-101d-4e7d-b62d-bcd53d30a4bb => generated 1471 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:09.829006 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a88a0e81-64a0-4af0-af8f-23addfc2bfa8 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:09.833054 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a88a0e81-64a0-4af0-af8f-23addfc2bfa8 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] [instance: d90a0347-3975-4633-be62-0e57756f93df] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:09.861463 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a88a0e81-64a0-4af0-af8f-23addfc2bfa8 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:09.863262 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a88a0e81-64a0-4af0-af8f-23addfc2bfa8 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:09.865920 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a88a0e81-64a0-4af0-af8f-23addfc2bfa8 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:09.868205 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a88a0e81-64a0-4af0-af8f-23addfc2bfa8 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:09.870802 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a88a0e81-64a0-4af0-af8f-23addfc2bfa8 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:09.872182 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a88a0e81-64a0-4af0-af8f-23addfc2bfa8 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:09.931131 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6c264750-b20a-4dbc-b698-9d2990db3c50 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "GET /compute/v2.1/images/9f2c07f2-5e5e-48d3-9305-7e17c297beb6" status: 200 len: 1429 microversion: 2.1 time: 0.251460 Aug 31 15:55:09.939213 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 845/1610] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:55:09 2022] GET /compute/v2.1/images/9f2c07f2-5e5e-48d3-9305-7e17c297beb6 => generated 1429 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:09.955987 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1c3c33e8-ead1-49a9-a64a-da02f07e774b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:09.966561 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1c3c33e8-ead1-49a9-a64a-da02f07e774b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: a8003433-1952-4dca-9b3d-43c41d2b70f5] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:09.981454 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a88a0e81-64a0-4af0-af8f-23addfc2bfa8 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] 10.222.0.50 "GET /compute/v2.1/servers/d90a0347-3975-4633-be62-0e57756f93df/ips" status: 200 len: 179 microversion: 2.1 time: 0.176525 Aug 31 15:55:09.982105 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 766/1611] 10.222.0.50 () {58 vars in 1248 bytes} [Wed Aug 31 15:55:09 2022] GET /compute/v2.1/servers/d90a0347-3975-4633-be62-0e57756f93df/ips => generated 179 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:55:09.986934 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c3ccd253-23d3-4f0c-9c2e-8884d87fa3ce tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-131083160"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:09.990646 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c3ccd253-23d3-4f0c-9c2e-8884d87fa3ce tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: 3054bf54-101d-4e7d-b62d-bcd53d30a4bb] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:09.996757 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1c3c33e8-ead1-49a9-a64a-da02f07e774b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:09.997932 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1c3c33e8-ead1-49a9-a64a-da02f07e774b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:09.998077 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3ccd253-23d3-4f0c-9c2e-8884d87fa3ce tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:09.998464 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3ccd253-23d3-4f0c-9c2e-8884d87fa3ce tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:09.998952 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3ccd253-23d3-4f0c-9c2e-8884d87fa3ce tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:09.999097 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1c3c33e8-ead1-49a9-a64a-da02f07e774b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:10.000099 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1c3c33e8-ead1-49a9-a64a-da02f07e774b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:10.000676 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3ccd253-23d3-4f0c-9c2e-8884d87fa3ce tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:10.001666 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1c3c33e8-ead1-49a9-a64a-da02f07e774b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:10.002250 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3ccd253-23d3-4f0c-9c2e-8884d87fa3ce tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:10.002831 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3ccd253-23d3-4f0c-9c2e-8884d87fa3ce tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:10.003551 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1c3c33e8-ead1-49a9-a64a-da02f07e774b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:10.154718 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1c3c33e8-ead1-49a9-a64a-da02f07e774b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:10.155143 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1c3c33e8-ead1-49a9-a64a-da02f07e774b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:10.155585 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1c3c33e8-ead1-49a9-a64a-da02f07e774b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:10.156145 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-1c3c33e8-ead1-49a9-a64a-da02f07e774b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lazy-loading 'fault' on Instance uuid a8003433-1952-4dca-9b3d-43c41d2b70f5 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:55:10.293643 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1c3c33e8-ead1-49a9-a64a-da02f07e774b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:10.312860 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1c3c33e8-ead1-49a9-a64a-da02f07e774b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/a8003433-1952-4dca-9b3d-43c41d2b70f5" status: 200 len: 1303 microversion: 2.1 time: 0.371540 Aug 31 15:55:10.328952 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 846/1612] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:09 2022] GET /compute/v2.1/servers/a8003433-1952-4dca-9b3d-43c41d2b70f5 => generated 1303 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:10.339107 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-67564f81-58bc-49e3-a056-7363b3b5efd6 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:10.344106 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-67564f81-58bc-49e3-a056-7363b3b5efd6 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] [instance: d90a0347-3975-4633-be62-0e57756f93df] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:10.360026 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-67564f81-58bc-49e3-a056-7363b3b5efd6 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:10.365021 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-67564f81-58bc-49e3-a056-7363b3b5efd6 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:10.365451 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-67564f81-58bc-49e3-a056-7363b3b5efd6 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:10.369364 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-67564f81-58bc-49e3-a056-7363b3b5efd6 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:10.369888 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-67564f81-58bc-49e3-a056-7363b3b5efd6 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:10.370355 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-67564f81-58bc-49e3-a056-7363b3b5efd6 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:10.441808 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-67564f81-58bc-49e3-a056-7363b3b5efd6 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] [instance: d90a0347-3975-4633-be62-0e57756f93df] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:55:10.468828 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c3ccd253-23d3-4f0c-9c2e-8884d87fa3ce tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "POST /compute/v2.1/servers/3054bf54-101d-4e7d-b62d-bcd53d30a4bb/action" status: 202 len: 0 microversion: 2.1 time: 0.480057 Aug 31 15:55:10.470169 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 767/1613] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 15:55:09 2022] POST /compute/v2.1/servers/3054bf54-101d-4e7d-b62d-bcd53d30a4bb/action => generated 0 bytes in 487 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 31 15:55:10.488657 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3567d2ca-39c8-4f4d-97bd-d348feb72057 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb46d9a1f0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:10.595410 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3567d2ca-39c8-4f4d-97bd-d348feb72057 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/images/e202e141-5d73-4379-b82b-e5ecc6ddf63e" status: 200 len: 1411 microversion: 2.1 time: 0.116881 Aug 31 15:55:10.596275 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 768/1614] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:55:10 2022] GET /compute/v2.1/images/e202e141-5d73-4379-b82b-e5ecc6ddf63e => generated 1411 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:10.700454 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6ca92056-dbfb-48a9-8094-8f13b457b03a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:10.701612 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6ca92056-dbfb-48a9-8094-8f13b457b03a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:10.710354 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-67564f81-58bc-49e3-a056-7363b3b5efd6 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d90a0347-3975-4633-be62-0e57756f93df" status: 204 len: 0 microversion: 2.1 time: 0.376630 Aug 31 15:55:10.710891 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ca92056-dbfb-48a9-8094-8f13b457b03a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:10.711314 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 847/1615] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:55:10 2022] DELETE /compute/v2.1/servers/d90a0347-3975-4633-be62-0e57756f93df => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:55:10.721703 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ca92056-dbfb-48a9-8094-8f13b457b03a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:10.723504 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ca92056-dbfb-48a9-8094-8f13b457b03a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:10.725979 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ca92056-dbfb-48a9-8094-8f13b457b03a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:10.729230 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5413bfaf-4610-49e9-bf3a-6c6ee2049e83 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:10.731229 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ca92056-dbfb-48a9-8094-8f13b457b03a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:10.731673 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ca92056-dbfb-48a9-8094-8f13b457b03a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:10.732524 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5413bfaf-4610-49e9-bf3a-6c6ee2049e83 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:10.743329 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5413bfaf-4610-49e9-bf3a-6c6ee2049e83 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:10.745085 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5413bfaf-4610-49e9-bf3a-6c6ee2049e83 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:10.745777 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5413bfaf-4610-49e9-bf3a-6c6ee2049e83 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:10.747730 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5413bfaf-4610-49e9-bf3a-6c6ee2049e83 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:10.748460 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5413bfaf-4610-49e9-bf3a-6c6ee2049e83 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:10.749152 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5413bfaf-4610-49e9-bf3a-6c6ee2049e83 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:11.028867 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-5413bfaf-4610-49e9-bf3a-6c6ee2049e83 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lazy-loading 'services' on Instance uuid 8a25dea8-1dc1-480e-a431-13d2f2270d0a {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:55:11.062525 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5413bfaf-4610-49e9-bf3a-6c6ee2049e83 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a" status: 200 len: 2423 microversion: 2.25 time: 0.349702 Aug 31 15:55:11.063430 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 848/1616] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:55:10 2022] GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a => generated 2423 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:55:11.076127 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-970b2637-c16e-4b38-8785-f20cb1bbd240 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:11.087900 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-970b2637-c16e-4b38-8785-f20cb1bbd240 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] [instance: d90a0347-3975-4633-be62-0e57756f93df] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:11.104945 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6ca92056-dbfb-48a9-8094-8f13b457b03a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:11.115707 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-970b2637-c16e-4b38-8785-f20cb1bbd240 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:11.116206 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-970b2637-c16e-4b38-8785-f20cb1bbd240 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:11.116755 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-970b2637-c16e-4b38-8785-f20cb1bbd240 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:11.117351 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-970b2637-c16e-4b38-8785-f20cb1bbd240 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:11.117806 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-970b2637-c16e-4b38-8785-f20cb1bbd240 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:11.118265 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-970b2637-c16e-4b38-8785-f20cb1bbd240 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:11.120058 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6ca92056-dbfb-48a9-8094-8f13b457b03a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65" status: 200 len: 1476 microversion: 2.1 time: 0.422282 Aug 31 15:55:11.122615 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 769/1617] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:10 2022] GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65 => generated 1476 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:55:11.141403 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4aebd223-455c-494d-9c47-188d428b7eb0 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '.version_select at 0x7fbb4641d5e0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:11.254829 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4aebd223-455c-494d-9c47-188d428b7eb0 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "GET /compute/v2.1/images/9f2c07f2-5e5e-48d3-9305-7e17c297beb6" status: 200 len: 1429 microversion: 2.1 time: 0.130963 Aug 31 15:55:11.268407 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 770/1618] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:55:11 2022] GET /compute/v2.1/images/9f2c07f2-5e5e-48d3-9305-7e17c297beb6 => generated 1429 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:11.277192 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-47e040eb-35d9-4867-a83a-8a32d3f8744e tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-833090-16", "block_migration": "auto"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:11.280649 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-47e040eb-35d9-4867-a83a-8a32d3f8744e tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:11.298962 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47e040eb-35d9-4867-a83a-8a32d3f8744e tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:11.299478 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47e040eb-35d9-4867-a83a-8a32d3f8744e tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:11.300014 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47e040eb-35d9-4867-a83a-8a32d3f8744e tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:11.300666 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47e040eb-35d9-4867-a83a-8a32d3f8744e tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:11.301111 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47e040eb-35d9-4867-a83a-8a32d3f8744e tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:11.301527 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47e040eb-35d9-4867-a83a-8a32d3f8744e tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:11.404554 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-970b2637-c16e-4b38-8785-f20cb1bbd240 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048bcefe0af04bc6a3a2995b22cbe43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87fc33005b5440098daf798066a653f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:11.415927 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-970b2637-c16e-4b38-8785-f20cb1bbd240 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] 10.222.0.50 "GET /compute/v2.1/servers/d90a0347-3975-4633-be62-0e57756f93df" status: 200 len: 1674 microversion: 2.1 time: 0.343393 Aug 31 15:55:11.416749 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 849/1619] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:11 2022] GET /compute/v2.1/servers/d90a0347-3975-4633-be62-0e57756f93df => generated 1674 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:11.437670 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-69dc101b-65f8-47ca-8161-a87dfa5ac1e4 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:11.438784 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-69dc101b-65f8-47ca-8161-a87dfa5ac1e4 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: a8003433-1952-4dca-9b3d-43c41d2b70f5] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:11.447133 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69dc101b-65f8-47ca-8161-a87dfa5ac1e4 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:11.448147 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69dc101b-65f8-47ca-8161-a87dfa5ac1e4 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:11.449262 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69dc101b-65f8-47ca-8161-a87dfa5ac1e4 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:11.450855 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69dc101b-65f8-47ca-8161-a87dfa5ac1e4 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:11.451911 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69dc101b-65f8-47ca-8161-a87dfa5ac1e4 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:11.452566 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69dc101b-65f8-47ca-8161-a87dfa5ac1e4 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:11.497833 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-69dc101b-65f8-47ca-8161-a87dfa5ac1e4 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] HTTP exception thrown: Instance a8003433-1952-4dca-9b3d-43c41d2b70f5 could not be found. Aug 31 15:55:11.503570 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-69dc101b-65f8-47ca-8161-a87dfa5ac1e4 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Request method failure captured: Aug 31 15:55:11.503570 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/a8003433-1952-4dca-9b3d-43c41d2b70f5 HTTP/1.1 Aug 31 15:55:11.503570 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:55:11.503570 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:55:11.503570 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:55:11.503570 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:55:11.503570 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:55:11.503570 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:55:11.503570 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:55:11.503570 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:55:11.503570 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4Q2UxjmzRUIcRyBJZeRXZe8f-kxARGQrfLNadx-PtSKRAHFDd-cfjpN41Lm2TAtWQQVK9trDHJa1Iu7P1XlF1-EYrtrhJnDHGb-ivhI0erITWpZsYkLGmnwPDtbMbW99ld2jucgWFbVY0vVDf-y4OAM7Az1owqOg13oLERSA9bN0MQ Aug 31 15:55:11.503570 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:55:11.503570 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:55:11.503570 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:55:11.503570 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:55:11.503570 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:55:11.503570 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:55:11.503570 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: dde27d282fc24e56a62eaeacff1431d5 Aug 31 15:55:11.503570 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-DeleteServersTestJSON-1135653165 Aug 31 15:55:11.503570 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:55:11.503570 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:55:11.505496 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_dde27d282fc24e56a62eaeacff1431d5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:55:11.505496 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-DeleteServersTestJSON-1135653165 Aug 31 15:55:11.505496 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: dde27d282fc24e56a62eaeacff1431d5 Aug 31 15:55:11.505496 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-DeleteServersTestJSON-1135653165 Aug 31 15:55:11.505496 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-DeleteServersTestJSON-1135653165-project Aug 31 15:55:11.505496 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:55:11.505496 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:55:11.505496 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 4d4f2146c3bc4a64b5d7f72cd136b6db Aug 31 15:55:11.505496 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-DeleteServersTestJSON-1135653165-project Aug 31 15:55:11.505496 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:55:11.505496 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance a8003433-1952-4dca-9b3d-43c41d2b70f5 could not be found. Aug 31 15:55:11.505496 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'a8003433-1952-4dca-9b3d-43c41d2b70f5'} Aug 31 15:55:11.506808 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:55:11.506808 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:11.506808 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:55:11.506808 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:55:11.506808 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:55:11.506808 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:55:11.506808 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:55:11.506808 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:55:11.506808 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:55:11.506808 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:55:11.506808 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8003433-1952-4dca-9b3d-43c41d2b70f5 could not be found. Aug 31 15:55:11.506808 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:55:11.506808 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:55:11.506808 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:55:11.506808 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:11.506808 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:55:11.506808 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:55:11.506808 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:55:11.506808 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:55:11.506808 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:55:11.508301 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:55:11.508301 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:55:11.508301 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:55:11.508301 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:55:11.508301 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:55:11.508301 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:55:11.508301 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:55:11.508301 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8003433-1952-4dca-9b3d-43c41d2b70f5 could not be found. Aug 31 15:55:11.508301 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:55:11.508301 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:55:11.508301 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:55:11.508301 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:11.508301 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:55:11.508301 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:55:11.508301 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:55:11.508301 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:55:11.508301 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8003433-1952-4dca-9b3d-43c41d2b70f5 could not be found. Aug 31 15:55:11.508301 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:55:11.509627 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-69dc101b-65f8-47ca-8161-a87dfa5ac1e4 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Returning 404 to user: Instance a8003433-1952-4dca-9b3d-43c41d2b70f5 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:55:11.509627 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-69dc101b-65f8-47ca-8161-a87dfa5ac1e4 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/a8003433-1952-4dca-9b3d-43c41d2b70f5" status: 404 len: 111 microversion: 2.1 time: 0.073477 Aug 31 15:55:11.509627 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 850/1620] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:11 2022] GET /compute/v2.1/servers/a8003433-1952-4dca-9b3d-43c41d2b70f5 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:55:11.628973 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-578bf57f-df21-453c-af6b-c8666cbcd668 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb4682e5e0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:11.663965 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-47e040eb-35d9-4867-a83a-8a32d3f8744e tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lazy-loading 'flavor' on Instance uuid 8a25dea8-1dc1-480e-a431-13d2f2270d0a {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:55:11.693052 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-578bf57f-df21-453c-af6b-c8666cbcd668 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/images/e202e141-5d73-4379-b82b-e5ecc6ddf63e" status: 200 len: 1411 microversion: 2.1 time: 0.078796 Aug 31 15:55:11.697207 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 851/1621] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:55:11 2022] GET /compute/v2.1/images/e202e141-5d73-4379-b82b-e5ecc6ddf63e => generated 1411 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:11.781685 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-47e040eb-35d9-4867-a83a-8a32d3f8744e tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Going to try to live migrate instance to n-h1-833090-16 {{(pid=128863) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 31 15:55:11.856366 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-eedda11d-f813-4c1a-8413-01ee2e190629 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1236429093", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "e71afd64-faa4-4680-b8e0-76fe805d5df1"}]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:11.927563 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-eedda11d-f813-4c1a-8413-01ee2e190629 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] validate_networks() for [('e71afd64-faa4-4680-b8e0-76fe805d5df1', None, None, None, None, None)] {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:55:13.743039 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-eedda11d-f813-4c1a-8413-01ee2e190629 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:55:13.743749 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-eedda11d-f813-4c1a-8413-01ee2e190629 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:55:13.743928 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-eedda11d-f813-4c1a-8413-01ee2e190629 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:55:13.744565 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-eedda11d-f813-4c1a-8413-01ee2e190629 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:55:13.745181 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-eedda11d-f813-4c1a-8413-01ee2e190629 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:55:13.759657 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-eedda11d-f813-4c1a-8413-01ee2e190629 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:13.760138 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-eedda11d-f813-4c1a-8413-01ee2e190629 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:13.760571 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-eedda11d-f813-4c1a-8413-01ee2e190629 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:13.761292 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-eedda11d-f813-4c1a-8413-01ee2e190629 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:13.761844 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-eedda11d-f813-4c1a-8413-01ee2e190629 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:13.762263 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-eedda11d-f813-4c1a-8413-01ee2e190629 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:13.805107 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-eedda11d-f813-4c1a-8413-01ee2e190629 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Getting quotas for project dde27d282fc24e56a62eaeacff1431d5. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:55:13.824546 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-eedda11d-f813-4c1a-8413-01ee2e190629 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Getting quotas for user 4d4f2146c3bc4a64b5d7f72cd136b6db and project dde27d282fc24e56a62eaeacff1431d5. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:55:13.854763 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-eedda11d-f813-4c1a-8413-01ee2e190629 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:55:13.862168 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-eedda11d-f813-4c1a-8413-01ee2e190629 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 11bf6774-dc05-481c-a9f9-29c2ebd4531f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:55:13.984879 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-eedda11d-f813-4c1a-8413-01ee2e190629 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.133829 Aug 31 15:55:13.987160 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 852/1622] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:55:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2139 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 15:55:14.004566 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e5e70d12-9868-4b1a-8429-7f01ee9ed0f5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:14.010281 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e5e70d12-9868-4b1a-8429-7f01ee9ed0f5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:14.049667 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e5e70d12-9868-4b1a-8429-7f01ee9ed0f5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:14.052427 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e5e70d12-9868-4b1a-8429-7f01ee9ed0f5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:14.056204 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e5e70d12-9868-4b1a-8429-7f01ee9ed0f5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:14.059410 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e5e70d12-9868-4b1a-8429-7f01ee9ed0f5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:14.060255 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e5e70d12-9868-4b1a-8429-7f01ee9ed0f5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:14.060956 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e5e70d12-9868-4b1a-8429-7f01ee9ed0f5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:14.731420 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-47e040eb-35d9-4867-a83a-8a32d3f8744e tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a/action" status: 202 len: 0 microversion: 2.25 time: 3.468006 Aug 31 15:55:14.732295 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 771/1623] 10.222.0.50 () {62 vars in 1319 bytes} [Wed Aug 31 15:55:11 2022] POST /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a/action => generated 0 bytes in 3470 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:55:14.737319 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2ff801e8-ed18-43f9-959d-f70b5255418f tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '.version_select at 0x7fbb4641d700>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:14.852170 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2ff801e8-ed18-43f9-959d-f70b5255418f tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "GET /compute/v2.1/images/9f2c07f2-5e5e-48d3-9305-7e17c297beb6" status: 200 len: 1429 microversion: 2.1 time: 0.118725 Aug 31 15:55:14.852821 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 772/1624] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:55:14 2022] GET /compute/v2.1/images/9f2c07f2-5e5e-48d3-9305-7e17c297beb6 => generated 1429 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:14.884429 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-98b5e0ff-0a1a-4384-a766-2158e0b74d37 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:14.885131 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-98b5e0ff-0a1a-4384-a766-2158e0b74d37 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] [instance: d90a0347-3975-4633-be62-0e57756f93df] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:14.907921 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98b5e0ff-0a1a-4384-a766-2158e0b74d37 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:14.908419 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98b5e0ff-0a1a-4384-a766-2158e0b74d37 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:14.909211 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98b5e0ff-0a1a-4384-a766-2158e0b74d37 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:14.910128 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98b5e0ff-0a1a-4384-a766-2158e0b74d37 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:14.910749 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98b5e0ff-0a1a-4384-a766-2158e0b74d37 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:14.911468 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98b5e0ff-0a1a-4384-a766-2158e0b74d37 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:14.931142 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e5e70d12-9868-4b1a-8429-7f01ee9ed0f5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:14.948017 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e5e70d12-9868-4b1a-8429-7f01ee9ed0f5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65" status: 200 len: 1476 microversion: 2.1 time: 0.957134 Aug 31 15:55:14.950237 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 853/1625] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:13 2022] GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65 => generated 1476 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:14.966375 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f377c5a0-6e24-40fa-ab9c-33f17be97b1b tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb46800430>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:15.086557 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f377c5a0-6e24-40fa-ab9c-33f17be97b1b tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/images/e202e141-5d73-4379-b82b-e5ecc6ddf63e" status: 200 len: 1411 microversion: 2.1 time: 0.133580 Aug 31 15:55:15.096949 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 854/1626] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:55:14 2022] GET /compute/v2.1/images/e202e141-5d73-4379-b82b-e5ecc6ddf63e => generated 1411 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:15.117511 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5f6c9048-78da-4401-b379-d9aae571abd5 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:15.118372 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5f6c9048-78da-4401-b379-d9aae571abd5 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 11bf6774-dc05-481c-a9f9-29c2ebd4531f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:15.149679 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5f6c9048-78da-4401-b379-d9aae571abd5 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:15.154615 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5f6c9048-78da-4401-b379-d9aae571abd5 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:15.157311 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5f6c9048-78da-4401-b379-d9aae571abd5 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:15.158977 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5f6c9048-78da-4401-b379-d9aae571abd5 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:15.159466 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5f6c9048-78da-4401-b379-d9aae571abd5 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:15.160872 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5f6c9048-78da-4401-b379-d9aae571abd5 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:15.587757 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5f6c9048-78da-4401-b379-d9aae571abd5 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:15.621940 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5f6c9048-78da-4401-b379-d9aae571abd5 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/11bf6774-dc05-481c-a9f9-29c2ebd4531f" status: 200 len: 1219 microversion: 2.1 time: 0.522760 Aug 31 15:55:15.671605 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 855/1627] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:15 2022] GET /compute/v2.1/servers/11bf6774-dc05-481c-a9f9-29c2ebd4531f => generated 1219 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:16.043468 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-dcf366d0-6c4b-4483-97d6-eb3e3a561064 req-4a1d06cc-7fb0-4802-beb1-a6dc90886b97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d90a0347-3975-4633-be62-0e57756f93df", "name": "network-vif-deleted", "tag": "357e2a5c-9788-4346-b9a8-19f88f270678"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:16.114991 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-dcf366d0-6c4b-4483-97d6-eb3e3a561064 req-4a1d06cc-7fb0-4802-beb1-a6dc90886b97 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:16.129312 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-dcf366d0-6c4b-4483-97d6-eb3e3a561064 req-4a1d06cc-7fb0-4802-beb1-a6dc90886b97 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:16.131327 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-dcf366d0-6c4b-4483-97d6-eb3e3a561064 req-4a1d06cc-7fb0-4802-beb1-a6dc90886b97 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:16.159932 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-dcf366d0-6c4b-4483-97d6-eb3e3a561064 req-4a1d06cc-7fb0-4802-beb1-a6dc90886b97 service nova] Creating event network-vif-deleted:357e2a5c-9788-4346-b9a8-19f88f270678 for instance d90a0347-3975-4633-be62-0e57756f93df on n-h1-833090-16 Aug 31 15:55:16.166864 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-dcf366d0-6c4b-4483-97d6-eb3e3a561064 req-4a1d06cc-7fb0-4802-beb1-a6dc90886b97 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.512974 Aug 31 15:55:16.172252 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 856/1628] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:55:16.195652 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-90e4a2bf-1c39-4317-836c-cd44658e94f3 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:16.196799 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-90e4a2bf-1c39-4317-836c-cd44658e94f3 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:16.214938 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-90e4a2bf-1c39-4317-836c-cd44658e94f3 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:16.215949 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-90e4a2bf-1c39-4317-836c-cd44658e94f3 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:16.217656 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-90e4a2bf-1c39-4317-836c-cd44658e94f3 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:16.218776 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-90e4a2bf-1c39-4317-836c-cd44658e94f3 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:16.219414 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-90e4a2bf-1c39-4317-836c-cd44658e94f3 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:16.221360 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-90e4a2bf-1c39-4317-836c-cd44658e94f3 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:16.585574 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-98b5e0ff-0a1a-4384-a766-2158e0b74d37 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048bcefe0af04bc6a3a2995b22cbe43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87fc33005b5440098daf798066a653f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:16.595669 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-98b5e0ff-0a1a-4384-a766-2158e0b74d37 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] 10.222.0.50 "GET /compute/v2.1/servers/d90a0347-3975-4633-be62-0e57756f93df" status: 200 len: 1653 microversion: 2.1 time: 1.728376 Aug 31 15:55:16.599565 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 773/1629] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:14 2022] GET /compute/v2.1/servers/d90a0347-3975-4633-be62-0e57756f93df => generated 1653 bytes in 1746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:16.623471 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3e1863a3-e8b8-4b07-b556-60451690702e tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '.version_select at 0x7fbb465c3700>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:16.833284 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-90e4a2bf-1c39-4317-836c-cd44658e94f3 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:16.846617 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-90e4a2bf-1c39-4317-836c-cd44658e94f3 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:16.848083 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-90e4a2bf-1c39-4317-836c-cd44658e94f3 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:16.849281 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-90e4a2bf-1c39-4317-836c-cd44658e94f3 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a" status: 200 len: 1813 microversion: 2.25 time: 0.675609 Aug 31 15:55:16.849857 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 857/1630] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:55:16 2022] GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a => generated 1813 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:55:16.891442 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c8cd6173-17e2-4e87-a6ac-78a432a678f6 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:16.892201 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c8cd6173-17e2-4e87-a6ac-78a432a678f6 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:16.900979 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8cd6173-17e2-4e87-a6ac-78a432a678f6 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:16.901473 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8cd6173-17e2-4e87-a6ac-78a432a678f6 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:16.901912 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8cd6173-17e2-4e87-a6ac-78a432a678f6 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:16.902682 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8cd6173-17e2-4e87-a6ac-78a432a678f6 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:16.903322 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8cd6173-17e2-4e87-a6ac-78a432a678f6 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:16.903745 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8cd6173-17e2-4e87-a6ac-78a432a678f6 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:17.834351 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c8cd6173-17e2-4e87-a6ac-78a432a678f6 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:17.834351 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c8cd6173-17e2-4e87-a6ac-78a432a678f6 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65" status: 200 len: 1476 microversion: 2.1 time: 0.919039 Aug 31 15:55:17.834351 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 858/1631] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:16 2022] GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65 => generated 1476 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:17.834351 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6e42b49d-5b94-4ba0-bb18-16b587b9fb9f tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb46f6c3a0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:20.396829 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3e1863a3-e8b8-4b07-b556-60451690702e tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "GET /compute/v2.1/images/9f2c07f2-5e5e-48d3-9305-7e17c297beb6" status: 200 len: 1438 microversion: 2.1 time: 3.793908 Aug 31 15:55:20.406241 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 774/1632] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:55:16 2022] GET /compute/v2.1/images/9f2c07f2-5e5e-48d3-9305-7e17c297beb6 => generated 1438 bytes in 3805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:20.419869 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-04c4a257-e438-47df-920b-ac343fb7af60 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:20.420485 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-04c4a257-e438-47df-920b-ac343fb7af60 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 11bf6774-dc05-481c-a9f9-29c2ebd4531f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:20.449231 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6e42b49d-5b94-4ba0-bb18-16b587b9fb9f tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/images/e202e141-5d73-4379-b82b-e5ecc6ddf63e" status: 200 len: 1411 microversion: 2.1 time: 2.653911 Aug 31 15:55:20.450700 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 859/1633] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:55:17 2022] GET /compute/v2.1/images/e202e141-5d73-4379-b82b-e5ecc6ddf63e => generated 1411 bytes in 2656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:20.456850 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04c4a257-e438-47df-920b-ac343fb7af60 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:20.457598 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04c4a257-e438-47df-920b-ac343fb7af60 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:20.458230 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04c4a257-e438-47df-920b-ac343fb7af60 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:20.459097 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04c4a257-e438-47df-920b-ac343fb7af60 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:20.462023 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04c4a257-e438-47df-920b-ac343fb7af60 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:20.468049 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04c4a257-e438-47df-920b-ac343fb7af60 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:20.471684 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-830f9fbd-9d1c-42b0-96d7-7973389d2686 req-940ed899-18dd-4ade-91f1-fd564eaa25e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3054bf54-101d-4e7d-b62d-bcd53d30a4bb", "name": "network-vif-plugged", "status": "completed", "tag": "032c6df0-61bb-4081-aa47-4e046311cc7a"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:20.509077 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-830f9fbd-9d1c-42b0-96d7-7973389d2686 req-940ed899-18dd-4ade-91f1-fd564eaa25e1 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:20.509741 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-830f9fbd-9d1c-42b0-96d7-7973389d2686 req-940ed899-18dd-4ade-91f1-fd564eaa25e1 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:20.510350 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-830f9fbd-9d1c-42b0-96d7-7973389d2686 req-940ed899-18dd-4ade-91f1-fd564eaa25e1 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:20.539738 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-830f9fbd-9d1c-42b0-96d7-7973389d2686 req-940ed899-18dd-4ade-91f1-fd564eaa25e1 service nova] Creating event network-vif-plugged:032c6df0-61bb-4081-aa47-4e046311cc7a for instance 3054bf54-101d-4e7d-b62d-bcd53d30a4bb on n-h1-833090-16 Aug 31 15:55:20.560564 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-830f9fbd-9d1c-42b0-96d7-7973389d2686 req-940ed899-18dd-4ade-91f1-fd564eaa25e1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108352 Aug 31 15:55:20.565084 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 860/1634] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:55:20.591204 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7ab881dd-68aa-4a25-ae52-2b89274a3a2e tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:20.592457 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7ab881dd-68aa-4a25-ae52-2b89274a3a2e tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] [instance: d90a0347-3975-4633-be62-0e57756f93df] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:20.604373 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ab881dd-68aa-4a25-ae52-2b89274a3a2e tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:20.608765 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ab881dd-68aa-4a25-ae52-2b89274a3a2e tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:20.609586 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ab881dd-68aa-4a25-ae52-2b89274a3a2e tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:20.611036 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ab881dd-68aa-4a25-ae52-2b89274a3a2e tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:20.611743 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ab881dd-68aa-4a25-ae52-2b89274a3a2e tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:20.615037 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ab881dd-68aa-4a25-ae52-2b89274a3a2e tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:20.647845 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-7ab881dd-68aa-4a25-ae52-2b89274a3a2e tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] HTTP exception thrown: Instance d90a0347-3975-4633-be62-0e57756f93df could not be found. Aug 31 15:55:20.649879 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7ab881dd-68aa-4a25-ae52-2b89274a3a2e tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Request method failure captured: Aug 31 15:55:20.649879 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/d90a0347-3975-4633-be62-0e57756f93df HTTP/1.1 Aug 31 15:55:20.649879 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:55:20.649879 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:55:20.649879 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:55:20.649879 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:55:20.649879 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:55:20.649879 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:55:20.649879 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:55:20.649879 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:55:20.649879 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4QEzV7UYeFoZ6CXANWsE8AGcFXL7cKP8nn17x2vQuX1Be2UEwxoivijeVSTB7REhWn5GNrXHbLfygoTIsWTTtV_gTbNFmFzo6sm4bNJW93IwqkNro8HG2ZfwaHK2pcULOylDToL-r9NAoJeJYTdwr1tAS7UUZ0kiT7pUbjwBzq1vJU Aug 31 15:55:20.649879 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:55:20.649879 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:55:20.649879 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:55:20.649879 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:55:20.649879 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:55:20.649879 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:55:20.649879 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 87fc33005b5440098daf798066a653f7 Aug 31 15:55:20.649879 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServersTestMultiNic-144128256 Aug 31 15:55:20.649879 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:55:20.649879 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:55:20.651595 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/87fc33005b5440098daf798066a653f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/87fc33005b5440098daf798066a653f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/87fc33005b5440098daf798066a653f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_87fc33005b5440098daf798066a653f7", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:55:20.651595 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServersTestMultiNic-144128256 Aug 31 15:55:20.651595 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 87fc33005b5440098daf798066a653f7 Aug 31 15:55:20.651595 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServersTestMultiNic-144128256 Aug 31 15:55:20.651595 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServersTestMultiNic-144128256-project Aug 31 15:55:20.651595 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:55:20.651595 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:55:20.651595 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 048bcefe0af04bc6a3a2995b22cbe43f Aug 31 15:55:20.651595 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServersTestMultiNic-144128256-project Aug 31 15:55:20.651595 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:55:20.651595 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance d90a0347-3975-4633-be62-0e57756f93df could not be found. Aug 31 15:55:20.651595 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'd90a0347-3975-4633-be62-0e57756f93df'} Aug 31 15:55:20.652576 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:55:20.652576 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:20.652576 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:55:20.652576 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:55:20.652576 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:55:20.652576 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:55:20.652576 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:55:20.652576 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:55:20.652576 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:55:20.652576 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:55:20.652576 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d90a0347-3975-4633-be62-0e57756f93df could not be found. Aug 31 15:55:20.652576 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:55:20.652576 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:55:20.652576 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:55:20.652576 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:20.652576 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:55:20.652576 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:55:20.652576 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:55:20.652576 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:55:20.652576 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:55:20.654107 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:55:20.654107 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:55:20.654107 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:55:20.654107 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:55:20.654107 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:55:20.654107 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:55:20.654107 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:55:20.654107 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d90a0347-3975-4633-be62-0e57756f93df could not be found. Aug 31 15:55:20.654107 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:55:20.654107 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:55:20.654107 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:55:20.654107 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:20.654107 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:55:20.654107 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:55:20.654107 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:55:20.654107 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:55:20.654107 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d90a0347-3975-4633-be62-0e57756f93df could not be found. Aug 31 15:55:20.654107 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:55:20.661890 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7ab881dd-68aa-4a25-ae52-2b89274a3a2e tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Returning 404 to user: Instance d90a0347-3975-4633-be62-0e57756f93df could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:55:20.663041 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7ab881dd-68aa-4a25-ae52-2b89274a3a2e tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] 10.222.0.50 "GET /compute/v2.1/servers/d90a0347-3975-4633-be62-0e57756f93df" status: 404 len: 111 microversion: 2.1 time: 0.095805 Aug 31 15:55:20.665871 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 861/1635] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:20 2022] GET /compute/v2.1/servers/d90a0347-3975-4633-be62-0e57756f93df => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:55:20.671530 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0cf0f4c5-56fb-444c-81d7-48e69db5c209 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:20.679721 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0cf0f4c5-56fb-444c-81d7-48e69db5c209 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:20.693742 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0cf0f4c5-56fb-444c-81d7-48e69db5c209 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:20.694687 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0cf0f4c5-56fb-444c-81d7-48e69db5c209 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:20.695379 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0cf0f4c5-56fb-444c-81d7-48e69db5c209 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:20.700190 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0cf0f4c5-56fb-444c-81d7-48e69db5c209 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:20.700967 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0cf0f4c5-56fb-444c-81d7-48e69db5c209 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:20.701629 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0cf0f4c5-56fb-444c-81d7-48e69db5c209 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:20.950434 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-04c4a257-e438-47df-920b-ac343fb7af60 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:20.961574 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-04c4a257-e438-47df-920b-ac343fb7af60 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/11bf6774-dc05-481c-a9f9-29c2ebd4531f" status: 200 len: 1315 microversion: 2.1 time: 0.554139 Aug 31 15:55:20.965753 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 775/1636] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:20 2022] GET /compute/v2.1/servers/11bf6774-dc05-481c-a9f9-29c2ebd4531f => generated 1315 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:20.977476 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-c16244c1-f3de-4599-a70c-2a181d3ab5cc req-aa9d0145-d947-44af-82b8-9b26c65fc1fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d90a0347-3975-4633-be62-0e57756f93df", "name": "network-vif-deleted", "tag": "a72bbdc1-c8b4-407a-b1c4-431d6f63424f"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:21.003100 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c16244c1-f3de-4599-a70c-2a181d3ab5cc req-aa9d0145-d947-44af-82b8-9b26c65fc1fc service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:21.004467 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c16244c1-f3de-4599-a70c-2a181d3ab5cc req-aa9d0145-d947-44af-82b8-9b26c65fc1fc service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:21.005660 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c16244c1-f3de-4599-a70c-2a181d3ab5cc req-aa9d0145-d947-44af-82b8-9b26c65fc1fc service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:21.038006 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-c16244c1-f3de-4599-a70c-2a181d3ab5cc req-aa9d0145-d947-44af-82b8-9b26c65fc1fc service nova] Creating event network-vif-deleted:a72bbdc1-c8b4-407a-b1c4-431d6f63424f for instance d90a0347-3975-4633-be62-0e57756f93df on n-h1-833090-16 Aug 31 15:55:21.052423 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-c16244c1-f3de-4599-a70c-2a181d3ab5cc req-aa9d0145-d947-44af-82b8-9b26c65fc1fc service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081147 Aug 31 15:55:21.054767 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 776/1637] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:55:21.237411 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0cf0f4c5-56fb-444c-81d7-48e69db5c209 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:21.253792 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0cf0f4c5-56fb-444c-81d7-48e69db5c209 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:21.263754 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0cf0f4c5-56fb-444c-81d7-48e69db5c209 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:21.273317 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0cf0f4c5-56fb-444c-81d7-48e69db5c209 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a" status: 200 len: 1813 microversion: 2.25 time: 0.606061 Aug 31 15:55:21.279252 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 862/1638] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:55:20 2022] GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a => generated 1813 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:55:21.299139 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-84eb599e-9e1c-4093-a052-e1c685890992 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '.version_select at 0x7fbb46f6c3a0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:21.417742 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-84eb599e-9e1c-4093-a052-e1c685890992 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "GET /compute/v2.1/images/9f2c07f2-5e5e-48d3-9305-7e17c297beb6" status: 200 len: 1438 microversion: 2.1 time: 0.137310 Aug 31 15:55:21.418587 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 863/1639] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:55:21 2022] GET /compute/v2.1/images/9f2c07f2-5e5e-48d3-9305-7e17c297beb6 => generated 1438 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:21.435640 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-971bd17d-8d6a-4e0b-88ac-892218cbed00 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:21.436395 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-971bd17d-8d6a-4e0b-88ac-892218cbed00 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:21.437597 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4edb1ab4-4453-4b27-82f7-40b0b6607ad9 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:21.438610 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4edb1ab4-4453-4b27-82f7-40b0b6607ad9 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] [instance: 0442e1d9-fa54-4957-8313-335c0f39c763] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:21.451150 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4edb1ab4-4453-4b27-82f7-40b0b6607ad9 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:21.452579 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4edb1ab4-4453-4b27-82f7-40b0b6607ad9 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:21.455179 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-971bd17d-8d6a-4e0b-88ac-892218cbed00 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:21.455344 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4edb1ab4-4453-4b27-82f7-40b0b6607ad9 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:21.455680 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-971bd17d-8d6a-4e0b-88ac-892218cbed00 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:21.456116 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-971bd17d-8d6a-4e0b-88ac-892218cbed00 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:21.456693 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4edb1ab4-4453-4b27-82f7-40b0b6607ad9 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:21.456819 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-971bd17d-8d6a-4e0b-88ac-892218cbed00 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:21.457261 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-971bd17d-8d6a-4e0b-88ac-892218cbed00 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:21.457521 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4edb1ab4-4453-4b27-82f7-40b0b6607ad9 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:21.457674 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-971bd17d-8d6a-4e0b-88ac-892218cbed00 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:21.457953 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4edb1ab4-4453-4b27-82f7-40b0b6607ad9 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:21.898138 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4edb1ab4-4453-4b27-82f7-40b0b6607ad9 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0578b42db80943249238958e5fce15f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45d2345cb0e4847964e67928ab3069b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:21.910021 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4edb1ab4-4453-4b27-82f7-40b0b6607ad9 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "GET /compute/v2.1/servers/0442e1d9-fa54-4957-8313-335c0f39c763" status: 200 len: 1466 microversion: 2.1 time: 0.475703 Aug 31 15:55:21.910684 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 864/1640] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:21 2022] GET /compute/v2.1/servers/0442e1d9-fa54-4957-8313-335c0f39c763 => generated 1466 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:21.943179 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a1b2c1e2-5254-42fb-9db9-57da43d7a83a tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb46f679d0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:22.037960 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a1b2c1e2-5254-42fb-9db9-57da43d7a83a tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/images/e202e141-5d73-4379-b82b-e5ecc6ddf63e" status: 200 len: 1411 microversion: 2.1 time: 0.106985 Aug 31 15:55:22.038603 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 865/1641] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:55:21 2022] GET /compute/v2.1/images/e202e141-5d73-4379-b82b-e5ecc6ddf63e => generated 1411 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:22.054169 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-7bae75af-3091-432e-a8b3-8107f8229afc req-d4fc7789-ee7f-4dd9-9d05-46a27134d010 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11bf6774-dc05-481c-a9f9-29c2ebd4531f", "tag": "057a9369-1375-4306-ae2a-141459b97c92"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:22.080746 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-971bd17d-8d6a-4e0b-88ac-892218cbed00 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:22.091976 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-971bd17d-8d6a-4e0b-88ac-892218cbed00 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65" status: 200 len: 1476 microversion: 2.1 time: 1.031738 Aug 31 15:55:22.092667 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 777/1642] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:21 2022] GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65 => generated 1476 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:22.101125 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7bae75af-3091-432e-a8b3-8107f8229afc req-d4fc7789-ee7f-4dd9-9d05-46a27134d010 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:22.109225 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-438a2d5d-0e7e-480e-b32a-fc74cf3a40e8 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '.version_select at 0x7fbb46543e50>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:22.111945 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7bae75af-3091-432e-a8b3-8107f8229afc req-d4fc7789-ee7f-4dd9-9d05-46a27134d010 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:22.115791 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7bae75af-3091-432e-a8b3-8107f8229afc req-d4fc7789-ee7f-4dd9-9d05-46a27134d010 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:22.159618 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-7bae75af-3091-432e-a8b3-8107f8229afc req-d4fc7789-ee7f-4dd9-9d05-46a27134d010 service nova] Creating event network-changed:057a9369-1375-4306-ae2a-141459b97c92 for instance 11bf6774-dc05-481c-a9f9-29c2ebd4531f on n-h2-833090-16 Aug 31 15:55:22.171884 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-7bae75af-3091-432e-a8b3-8107f8229afc req-d4fc7789-ee7f-4dd9-9d05-46a27134d010 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132021 Aug 31 15:55:22.177595 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 866/1643] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:55:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:55:22.185554 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3b408a9a-d1e4-4ca4-94d3-d59cac879415 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:22.207345 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3b408a9a-d1e4-4ca4-94d3-d59cac879415 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 11bf6774-dc05-481c-a9f9-29c2ebd4531f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:22.217730 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3b408a9a-d1e4-4ca4-94d3-d59cac879415 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:22.230561 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3b408a9a-d1e4-4ca4-94d3-d59cac879415 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:22.232798 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3b408a9a-d1e4-4ca4-94d3-d59cac879415 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:22.233931 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3b408a9a-d1e4-4ca4-94d3-d59cac879415 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:22.243014 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3b408a9a-d1e4-4ca4-94d3-d59cac879415 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:22.243707 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3b408a9a-d1e4-4ca4-94d3-d59cac879415 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:23.215781 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3b408a9a-d1e4-4ca4-94d3-d59cac879415 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:23.229546 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3b408a9a-d1e4-4ca4-94d3-d59cac879415 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/11bf6774-dc05-481c-a9f9-29c2ebd4531f" status: 200 len: 1315 microversion: 2.1 time: 1.048334 Aug 31 15:55:23.234181 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 867/1644] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:22 2022] GET /compute/v2.1/servers/11bf6774-dc05-481c-a9f9-29c2ebd4531f => generated 1315 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:23.250294 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-57f3e772-42b0-4222-ad14-25d0d0d5a08d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:23.251890 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-57f3e772-42b0-4222-ad14-25d0d0d5a08d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:23.268913 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-57f3e772-42b0-4222-ad14-25d0d0d5a08d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:23.270602 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-57f3e772-42b0-4222-ad14-25d0d0d5a08d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:23.272116 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-57f3e772-42b0-4222-ad14-25d0d0d5a08d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:23.274135 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-57f3e772-42b0-4222-ad14-25d0d0d5a08d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:23.276483 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-57f3e772-42b0-4222-ad14-25d0d0d5a08d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:23.278641 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-57f3e772-42b0-4222-ad14-25d0d0d5a08d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:23.616622 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-438a2d5d-0e7e-480e-b32a-fc74cf3a40e8 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "DELETE /compute/v2.1/images/9f2c07f2-5e5e-48d3-9305-7e17c297beb6" status: 204 len: 0 microversion: 2.1 time: 1.513994 Aug 31 15:55:23.629028 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 778/1645] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:22 2022] DELETE /compute/v2.1/images/9f2c07f2-5e5e-48d3-9305-7e17c297beb6 => generated 0 bytes in 1515 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:55:23.633928 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8c00856c-a8ee-45a6-97bc-b9a1c10d8a81 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb464f6820>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:23.723683 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8c00856c-a8ee-45a6-97bc-b9a1c10d8a81 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/images/e202e141-5d73-4379-b82b-e5ecc6ddf63e" status: 200 len: 1411 microversion: 2.1 time: 0.093546 Aug 31 15:55:23.732065 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 779/1646] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:55:23 2022] GET /compute/v2.1/images/e202e141-5d73-4379-b82b-e5ecc6ddf63e => generated 1411 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:23.732065 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-66c6c7c4-2f7e-43f5-afd2-3113e24433a9 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:23.732065 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-66c6c7c4-2f7e-43f5-afd2-3113e24433a9 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:23.736085 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:55:23.739978 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-57f3e772-42b0-4222-ad14-25d0d0d5a08d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:23.753936 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66c6c7c4-2f7e-43f5-afd2-3113e24433a9 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:23.754482 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66c6c7c4-2f7e-43f5-afd2-3113e24433a9 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:23.754928 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66c6c7c4-2f7e-43f5-afd2-3113e24433a9 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:23.755731 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66c6c7c4-2f7e-43f5-afd2-3113e24433a9 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:23.756204 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66c6c7c4-2f7e-43f5-afd2-3113e24433a9 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:23.759574 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-57f3e772-42b0-4222-ad14-25d0d0d5a08d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:23.762600 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66c6c7c4-2f7e-43f5-afd2-3113e24433a9 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:23.765532 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-57f3e772-42b0-4222-ad14-25d0d0d5a08d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:23.767143 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-57f3e772-42b0-4222-ad14-25d0d0d5a08d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a" status: 200 len: 1813 microversion: 2.25 time: 0.531641 Aug 31 15:55:23.770027 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 868/1647] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:55:23 2022] GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a => generated 1813 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:55:23.781001 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a10dc27c-33ef-439f-b17b-42518e5c23ef tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '.version_select at 0x7fbb4690df70>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:23.813105 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:55:23.840464 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=6 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:55:23.866309 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-a10dc27c-33ef-439f-b17b-42518e5c23ef tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] HTTP exception thrown: Image not found. Aug 31 15:55:23.868393 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a10dc27c-33ef-439f-b17b-42518e5c23ef tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Request method failure captured: Aug 31 15:55:23.868393 n-d-833090-16 devstack@n-api.service[128864]: request: DELETE /compute/v2.1/images/cafb6e84-9246-4fe7-a97d-05f8a0e3b640 HTTP/1.1 Aug 31 15:55:23.868393 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:55:23.868393 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:55:23.868393 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:55:23.868393 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:55:23.868393 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:55:23.868393 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:55:23.868393 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:55:23.868393 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:55:23.868393 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4QVQYNk5_sHDuHLSUKMwE3UeAFTW43NrI5LZQyq17QjM7Tm_NNDHOYwyDkqduzPdovqCgxFK2mabNmxzK5helNFaxArTkN6djKzZKb0J3uLMX_RPzOQxBGt-NklOg-saYpjwR3tvbqrZBqYIXS5wJcla3v6T1J9CnCi_PTvOv1_D6U Aug 31 15:55:23.868393 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:55:23.868393 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:55:23.868393 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:55:23.868393 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:55:23.868393 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:55:23.868393 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:55:23.868393 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: a45d2345cb0e4847964e67928ab3069b Aug 31 15:55:23.868393 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ImagesOneServerTestJSON-2096053179 Aug 31 15:55:23.868393 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:55:23.868393 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:55:23.870215 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a45d2345cb0e4847964e67928ab3069b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a45d2345cb0e4847964e67928ab3069b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a45d2345cb0e4847964e67928ab3069b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a45d2345cb0e4847964e67928ab3069b", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:55:23.870215 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ImagesOneServerTestJSON-2096053179 Aug 31 15:55:23.870215 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: a45d2345cb0e4847964e67928ab3069b Aug 31 15:55:23.870215 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-2096053179 Aug 31 15:55:23.870215 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ImagesOneServerTestJSON-2096053179-project Aug 31 15:55:23.870215 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:55:23.870215 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:55:23.870215 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 0578b42db80943249238958e5fce15f1 Aug 31 15:55:23.870215 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ImagesOneServerTestJSON-2096053179-project Aug 31 15:55:23.870215 n-d-833090-16 devstack@n-api.service[128864]: method: Aug 31 15:55:23.870215 n-d-833090-16 devstack@n-api.service[128864]: exception: Image not found. Aug 31 15:55:23.870215 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'cafb6e84-9246-4fe7-a97d-05f8a0e3b640'} Aug 31 15:55:23.870215 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:55:23.872103 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:23.872103 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 31 15:55:23.872103 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 31 15:55:23.872103 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 15:55:23.872103 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 15:55:23.872103 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 15:55:23.872103 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 15:55:23.872103 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 31 15:55:23.872103 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 31 15:55:23.872103 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 31 15:55:23.872103 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 31 15:55:23.872103 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 15:55:23.872103 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 15:55:23.872103 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 15:55:23.872103 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 15:55:23.872103 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image cafb6e84-9246-4fe7-a97d-05f8a0e3b640 to delete Aug 31 15:55:23.872103 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:55:23.872103 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:55:23.872103 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:55:23.873736 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:23.873736 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 31 15:55:23.873736 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 31 15:55:23.873736 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 31 15:55:23.873736 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 31 15:55:23.873736 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 31 15:55:23.873736 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 31 15:55:23.873736 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image cafb6e84-9246-4fe7-a97d-05f8a0e3b640 could not be found. Aug 31 15:55:23.873736 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:55:23.873736 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:55:23.873736 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:55:23.873736 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:23.873736 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:55:23.873736 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:55:23.873736 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:55:23.873736 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:55:23.873736 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:55:23.873736 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:55:23.873736 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:55:23.873736 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:55:23.875411 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 31 15:55:23.875411 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 31 15:55:23.875411 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 31 15:55:23.875411 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:55:23.875411 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:55:23.875411 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:55:23.875411 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:23.875411 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:55:23.875411 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:55:23.875411 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:55:23.875411 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:55:23.875411 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 31 15:55:23.875411 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:55:23.875411 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a10dc27c-33ef-439f-b17b-42518e5c23ef tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Returning 404 to user: Image not found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:55:23.875411 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a10dc27c-33ef-439f-b17b-42518e5c23ef tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "DELETE /compute/v2.1/images/cafb6e84-9246-4fe7-a97d-05f8a0e3b640" status: 404 len: 62 microversion: 2.1 time: 0.098370 Aug 31 15:55:23.876714 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 869/1648] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:23 2022] DELETE /compute/v2.1/images/cafb6e84-9246-4fe7-a97d-05f8a0e3b640 => generated 62 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 15:55:23.884498 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-cc8cfafd-46a4-4735-a021-fb58e0158458 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:23.885005 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-cc8cfafd-46a4-4735-a021-fb58e0158458 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] [instance: 0442e1d9-fa54-4957-8313-335c0f39c763] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:23.931033 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cc8cfafd-46a4-4735-a021-fb58e0158458 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:23.932120 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cc8cfafd-46a4-4735-a021-fb58e0158458 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:23.933045 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cc8cfafd-46a4-4735-a021-fb58e0158458 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:23.937281 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cc8cfafd-46a4-4735-a021-fb58e0158458 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:23.938419 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cc8cfafd-46a4-4735-a021-fb58e0158458 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:23.939920 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cc8cfafd-46a4-4735-a021-fb58e0158458 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:23.992807 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:55:24.005608 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-cc8cfafd-46a4-4735-a021-fb58e0158458 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] [instance: 0442e1d9-fa54-4957-8313-335c0f39c763] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:55:24.153714 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:55:24.163593 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-cc8cfafd-46a4-4735-a021-fb58e0158458 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0442e1d9-fa54-4957-8313-335c0f39c763" status: 204 len: 0 microversion: 2.1 time: 0.287535 Aug 31 15:55:24.167474 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 870/1649] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:55:23 2022] DELETE /compute/v2.1/servers/0442e1d9-fa54-4957-8313-335c0f39c763 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:55:24.200830 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4867d834-d1c0-4db2-8146-327cbb680a88 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:24.201755 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4867d834-d1c0-4db2-8146-327cbb680a88 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] [instance: 0442e1d9-fa54-4957-8313-335c0f39c763] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:24.236344 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4867d834-d1c0-4db2-8146-327cbb680a88 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:24.236981 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4867d834-d1c0-4db2-8146-327cbb680a88 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:24.237270 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4867d834-d1c0-4db2-8146-327cbb680a88 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:24.244129 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4867d834-d1c0-4db2-8146-327cbb680a88 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:24.247798 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4867d834-d1c0-4db2-8146-327cbb680a88 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:24.252438 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4867d834-d1c0-4db2-8146-327cbb680a88 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:25.318194 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-66c6c7c4-2f7e-43f5-afd2-3113e24433a9 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:25.332421 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-66c6c7c4-2f7e-43f5-afd2-3113e24433a9 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65" status: 200 len: 1476 microversion: 2.1 time: 1.601716 Aug 31 15:55:25.333403 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 780/1650] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:23 2022] GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65 => generated 1476 bytes in 1608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:25.350273 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-11029ddd-94f9-4e76-8f99-a8b48b5d3c43 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:25.351437 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-11029ddd-94f9-4e76-8f99-a8b48b5d3c43 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 11bf6774-dc05-481c-a9f9-29c2ebd4531f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:25.359797 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11029ddd-94f9-4e76-8f99-a8b48b5d3c43 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:25.363458 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11029ddd-94f9-4e76-8f99-a8b48b5d3c43 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:25.364098 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11029ddd-94f9-4e76-8f99-a8b48b5d3c43 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:25.364994 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11029ddd-94f9-4e76-8f99-a8b48b5d3c43 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:25.376666 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11029ddd-94f9-4e76-8f99-a8b48b5d3c43 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:25.377405 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11029ddd-94f9-4e76-8f99-a8b48b5d3c43 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:25.542035 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4867d834-d1c0-4db2-8146-327cbb680a88 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0578b42db80943249238958e5fce15f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45d2345cb0e4847964e67928ab3069b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:25.556700 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4867d834-d1c0-4db2-8146-327cbb680a88 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "GET /compute/v2.1/servers/0442e1d9-fa54-4957-8313-335c0f39c763" status: 200 len: 1472 microversion: 2.1 time: 1.386643 Aug 31 15:55:25.557703 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 871/1651] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:24 2022] GET /compute/v2.1/servers/0442e1d9-fa54-4957-8313-335c0f39c763 => generated 1472 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:25.565018 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0fe7a43f-aa08-42a4-9f6d-2fe4fae18ed1 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb46faee50>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:25.647138 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0fe7a43f-aa08-42a4-9f6d-2fe4fae18ed1 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/images/e202e141-5d73-4379-b82b-e5ecc6ddf63e" status: 200 len: 1411 microversion: 2.1 time: 0.088222 Aug 31 15:55:25.655218 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 872/1652] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:55:25 2022] GET /compute/v2.1/images/e202e141-5d73-4379-b82b-e5ecc6ddf63e => generated 1411 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:25.661013 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3b964313-a1f0-4829-af3b-20fe46ba5184 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:25.666621 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3b964313-a1f0-4829-af3b-20fe46ba5184 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:25.680532 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3b964313-a1f0-4829-af3b-20fe46ba5184 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:25.686236 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3b964313-a1f0-4829-af3b-20fe46ba5184 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:25.687071 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3b964313-a1f0-4829-af3b-20fe46ba5184 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:25.688074 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3b964313-a1f0-4829-af3b-20fe46ba5184 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:25.688983 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3b964313-a1f0-4829-af3b-20fe46ba5184 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:25.689632 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3b964313-a1f0-4829-af3b-20fe46ba5184 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:26.450043 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-11029ddd-94f9-4e76-8f99-a8b48b5d3c43 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:26.463107 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-11029ddd-94f9-4e76-8f99-a8b48b5d3c43 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/11bf6774-dc05-481c-a9f9-29c2ebd4531f" status: 200 len: 1315 microversion: 2.1 time: 1.127213 Aug 31 15:55:26.464485 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 781/1653] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:25 2022] GET /compute/v2.1/servers/11bf6774-dc05-481c-a9f9-29c2ebd4531f => generated 1315 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:26.485450 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-4219022e-cfe8-4730-b788-44033d85919d req-c3b06c24-5a49-43f4-8dc1-a4d0adfd6e26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0442e1d9-fa54-4957-8313-335c0f39c763", "name": "network-vif-unplugged", "status": "completed", "tag": "a977db7b-bcd4-47fa-9827-fa736d70e905"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:26.567966 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4219022e-cfe8-4730-b788-44033d85919d req-c3b06c24-5a49-43f4-8dc1-a4d0adfd6e26 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:26.572858 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4219022e-cfe8-4730-b788-44033d85919d req-c3b06c24-5a49-43f4-8dc1-a4d0adfd6e26 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:26.576428 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4219022e-cfe8-4730-b788-44033d85919d req-c3b06c24-5a49-43f4-8dc1-a4d0adfd6e26 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:26.617810 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-4219022e-cfe8-4730-b788-44033d85919d req-c3b06c24-5a49-43f4-8dc1-a4d0adfd6e26 service nova] Creating event network-vif-unplugged:a977db7b-bcd4-47fa-9827-fa736d70e905 for instance 0442e1d9-fa54-4957-8313-335c0f39c763 on n-h1-833090-16 Aug 31 15:55:26.630428 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-4219022e-cfe8-4730-b788-44033d85919d req-c3b06c24-5a49-43f4-8dc1-a4d0adfd6e26 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.159881 Aug 31 15:55:26.630968 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3b964313-a1f0-4829-af3b-20fe46ba5184 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:26.644876 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3b964313-a1f0-4829-af3b-20fe46ba5184 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:26.650244 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 782/1654] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:55:26.654143 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3b964313-a1f0-4829-af3b-20fe46ba5184 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:26.655945 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3b964313-a1f0-4829-af3b-20fe46ba5184 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a" status: 200 len: 1813 microversion: 2.25 time: 0.999103 Aug 31 15:55:26.657811 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 873/1655] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:55:25 2022] GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a => generated 1813 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:55:26.665243 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1a3fab4b-9f38-4972-8fc2-2ce836eb9185 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:26.668345 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1a3fab4b-9f38-4972-8fc2-2ce836eb9185 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] [instance: 0442e1d9-fa54-4957-8313-335c0f39c763] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:26.681045 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b7955824-a9f6-4784-96d4-25f7d98e5794 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:26.682013 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b7955824-a9f6-4784-96d4-25f7d98e5794 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:26.707131 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a3fab4b-9f38-4972-8fc2-2ce836eb9185 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:26.712230 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7955824-a9f6-4784-96d4-25f7d98e5794 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:26.712741 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7955824-a9f6-4784-96d4-25f7d98e5794 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:26.713144 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a3fab4b-9f38-4972-8fc2-2ce836eb9185 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:26.715497 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a3fab4b-9f38-4972-8fc2-2ce836eb9185 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:26.718370 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7955824-a9f6-4784-96d4-25f7d98e5794 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:26.719106 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a3fab4b-9f38-4972-8fc2-2ce836eb9185 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:26.719236 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7955824-a9f6-4784-96d4-25f7d98e5794 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:26.719703 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7955824-a9f6-4784-96d4-25f7d98e5794 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:26.720141 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7955824-a9f6-4784-96d4-25f7d98e5794 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:26.722744 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a3fab4b-9f38-4972-8fc2-2ce836eb9185 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:26.723501 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a3fab4b-9f38-4972-8fc2-2ce836eb9185 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:27.497804 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1a3fab4b-9f38-4972-8fc2-2ce836eb9185 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0578b42db80943249238958e5fce15f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45d2345cb0e4847964e67928ab3069b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:27.512453 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1a3fab4b-9f38-4972-8fc2-2ce836eb9185 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "GET /compute/v2.1/servers/0442e1d9-fa54-4957-8313-335c0f39c763" status: 200 len: 1472 microversion: 2.1 time: 0.849098 Aug 31 15:55:27.514107 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 874/1656] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:26 2022] GET /compute/v2.1/servers/0442e1d9-fa54-4957-8313-335c0f39c763 => generated 1472 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:27.527365 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4d9e8593-e4ea-4626-b5a0-be6575522497 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb4672b940>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:28.178708 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4d9e8593-e4ea-4626-b5a0-be6575522497 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/images/e202e141-5d73-4379-b82b-e5ecc6ddf63e" status: 200 len: 1411 microversion: 2.1 time: 0.657796 Aug 31 15:55:28.189866 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 875/1657] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:55:27 2022] GET /compute/v2.1/images/e202e141-5d73-4379-b82b-e5ecc6ddf63e => generated 1411 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:28.208770 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9a87bb1d-95d5-4ede-9f42-0a41095f7d62 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:28.209393 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9a87bb1d-95d5-4ede-9f42-0a41095f7d62 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 11bf6774-dc05-481c-a9f9-29c2ebd4531f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:28.210685 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b7955824-a9f6-4784-96d4-25f7d98e5794 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:28.224794 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b7955824-a9f6-4784-96d4-25f7d98e5794 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65" status: 200 len: 1476 microversion: 2.1 time: 1.572608 Aug 31 15:55:28.225401 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 783/1658] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:26 2022] GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65 => generated 1476 bytes in 1575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:28.243274 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9a87bb1d-95d5-4ede-9f42-0a41095f7d62 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:28.249199 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9a87bb1d-95d5-4ede-9f42-0a41095f7d62 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:28.249780 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9a87bb1d-95d5-4ede-9f42-0a41095f7d62 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:28.253275 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9a87bb1d-95d5-4ede-9f42-0a41095f7d62 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:28.253771 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9a87bb1d-95d5-4ede-9f42-0a41095f7d62 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:28.254231 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9a87bb1d-95d5-4ede-9f42-0a41095f7d62 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:28.265140 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1bd86dfa-a442-44eb-a48c-0fd734cbc48e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:28.265909 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1bd86dfa-a442-44eb-a48c-0fd734cbc48e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:28.287466 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1bd86dfa-a442-44eb-a48c-0fd734cbc48e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:28.287990 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1bd86dfa-a442-44eb-a48c-0fd734cbc48e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:28.288847 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1bd86dfa-a442-44eb-a48c-0fd734cbc48e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:28.291548 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1bd86dfa-a442-44eb-a48c-0fd734cbc48e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:28.292022 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1bd86dfa-a442-44eb-a48c-0fd734cbc48e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:28.292962 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1bd86dfa-a442-44eb-a48c-0fd734cbc48e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:28.396411 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:55:28.962014 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1bd86dfa-a442-44eb-a48c-0fd734cbc48e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:28.982059 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1bd86dfa-a442-44eb-a48c-0fd734cbc48e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:28.985725 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1bd86dfa-a442-44eb-a48c-0fd734cbc48e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:28.990579 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1bd86dfa-a442-44eb-a48c-0fd734cbc48e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a" status: 200 len: 1813 microversion: 2.25 time: 0.745141 Aug 31 15:55:28.994405 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 784/1659] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:55:28 2022] GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a => generated 1813 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:55:29.010924 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c7ef6a91-d750-4f09-ba13-ab436135a1f9 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:29.013804 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9a87bb1d-95d5-4ede-9f42-0a41095f7d62 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:29.015469 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c7ef6a91-d750-4f09-ba13-ab436135a1f9 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] [instance: 0442e1d9-fa54-4957-8313-335c0f39c763] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:29.024164 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9a87bb1d-95d5-4ede-9f42-0a41095f7d62 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/11bf6774-dc05-481c-a9f9-29c2ebd4531f" status: 200 len: 1315 microversion: 2.1 time: 0.832211 Aug 31 15:55:29.041527 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 876/1660] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:28 2022] GET /compute/v2.1/servers/11bf6774-dc05-481c-a9f9-29c2ebd4531f => generated 1315 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:29.043638 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7ef6a91-d750-4f09-ba13-ab436135a1f9 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:29.044889 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7ef6a91-d750-4f09-ba13-ab436135a1f9 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:29.045429 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7ef6a91-d750-4f09-ba13-ab436135a1f9 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:29.046597 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7ef6a91-d750-4f09-ba13-ab436135a1f9 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:29.048798 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7ef6a91-d750-4f09-ba13-ab436135a1f9 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:29.049470 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7ef6a91-d750-4f09-ba13-ab436135a1f9 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:29.152090 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-dede2c28-afde-4a56-a66a-21688e6522e7 req-71abf84b-dade-43b8-a1ba-8375ebf90bcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0442e1d9-fa54-4957-8313-335c0f39c763", "name": "network-vif-deleted", "tag": "a977db7b-bcd4-47fa-9827-fa736d70e905"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:29.172801 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-dede2c28-afde-4a56-a66a-21688e6522e7 req-71abf84b-dade-43b8-a1ba-8375ebf90bcd service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:29.173588 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-dede2c28-afde-4a56-a66a-21688e6522e7 req-71abf84b-dade-43b8-a1ba-8375ebf90bcd service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:29.174267 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-dede2c28-afde-4a56-a66a-21688e6522e7 req-71abf84b-dade-43b8-a1ba-8375ebf90bcd service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:29.197871 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-dede2c28-afde-4a56-a66a-21688e6522e7 req-71abf84b-dade-43b8-a1ba-8375ebf90bcd service nova] Creating event network-vif-deleted:a977db7b-bcd4-47fa-9827-fa736d70e905 for instance 0442e1d9-fa54-4957-8313-335c0f39c763 on n-h1-833090-16 Aug 31 15:55:29.207956 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-dede2c28-afde-4a56-a66a-21688e6522e7 req-71abf84b-dade-43b8-a1ba-8375ebf90bcd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060679 Aug 31 15:55:29.210333 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 877/1661] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:55:29.217781 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-68833fff-bf00-40d9-b8f5-d82ff6991eb8 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb46f65c10>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:29.278954 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c7ef6a91-d750-4f09-ba13-ab436135a1f9 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0578b42db80943249238958e5fce15f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a45d2345cb0e4847964e67928ab3069b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:29.291875 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c7ef6a91-d750-4f09-ba13-ab436135a1f9 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "GET /compute/v2.1/servers/0442e1d9-fa54-4957-8313-335c0f39c763" status: 200 len: 1430 microversion: 2.1 time: 0.296027 Aug 31 15:55:29.293091 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 785/1662] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:28 2022] GET /compute/v2.1/servers/0442e1d9-fa54-4957-8313-335c0f39c763 => generated 1430 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:29.300437 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d14fcc84-7a67-47ab-870d-f40d03546e33 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:29.301264 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d14fcc84-7a67-47ab-870d-f40d03546e33 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:29.303639 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-68833fff-bf00-40d9-b8f5-d82ff6991eb8 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/images/e202e141-5d73-4379-b82b-e5ecc6ddf63e" status: 200 len: 1411 microversion: 2.1 time: 0.081346 Aug 31 15:55:29.307844 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 878/1663] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:55:29 2022] GET /compute/v2.1/images/e202e141-5d73-4379-b82b-e5ecc6ddf63e => generated 1411 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:29.314489 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d14fcc84-7a67-47ab-870d-f40d03546e33 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:29.315236 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d14fcc84-7a67-47ab-870d-f40d03546e33 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:29.316188 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d14fcc84-7a67-47ab-870d-f40d03546e33 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:29.318739 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d14fcc84-7a67-47ab-870d-f40d03546e33 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:29.320094 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d14fcc84-7a67-47ab-870d-f40d03546e33 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:29.321037 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d14fcc84-7a67-47ab-870d-f40d03546e33 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:29.335637 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-def0217c-53d6-4969-9e19-d36d775adc94 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:29.336685 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-def0217c-53d6-4969-9e19-d36d775adc94 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] [instance: d90a0347-3975-4633-be62-0e57756f93df] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:29.354732 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-def0217c-53d6-4969-9e19-d36d775adc94 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:29.355439 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-def0217c-53d6-4969-9e19-d36d775adc94 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:29.356049 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-def0217c-53d6-4969-9e19-d36d775adc94 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:29.357128 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-def0217c-53d6-4969-9e19-d36d775adc94 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:29.357781 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-def0217c-53d6-4969-9e19-d36d775adc94 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:29.358657 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-def0217c-53d6-4969-9e19-d36d775adc94 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:29.397536 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-def0217c-53d6-4969-9e19-d36d775adc94 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] HTTP exception thrown: Instance d90a0347-3975-4633-be62-0e57756f93df could not be found. Aug 31 15:55:29.400034 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-def0217c-53d6-4969-9e19-d36d775adc94 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Request method failure captured: Aug 31 15:55:29.400034 n-d-833090-16 devstack@n-api.service[128864]: request: DELETE /compute/v2.1/servers/d90a0347-3975-4633-be62-0e57756f93df HTTP/1.1 Aug 31 15:55:29.400034 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:55:29.400034 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:55:29.400034 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:55:29.400034 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:55:29.400034 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:55:29.400034 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:55:29.400034 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:55:29.400034 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:55:29.400034 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4QEzV7UYeFoZ6CXANWsE8AGcFXL7cKP8nn17x2vQuX1Be2UEwxoivijeVSTB7REhWn5GNrXHbLfygoTIsWTTtV_gTbNFmFzo6sm4bNJW93IwqkNro8HG2ZfwaHK2pcULOylDToL-r9NAoJeJYTdwr1tAS7UUZ0kiT7pUbjwBzq1vJU Aug 31 15:55:29.400034 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:55:29.400034 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:55:29.400034 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:55:29.400034 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:55:29.400034 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:55:29.400034 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:55:29.400034 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 87fc33005b5440098daf798066a653f7 Aug 31 15:55:29.400034 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServersTestMultiNic-144128256 Aug 31 15:55:29.400034 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:55:29.400034 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:55:29.401888 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/87fc33005b5440098daf798066a653f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/87fc33005b5440098daf798066a653f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/87fc33005b5440098daf798066a653f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_87fc33005b5440098daf798066a653f7", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:55:29.401888 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServersTestMultiNic-144128256 Aug 31 15:55:29.401888 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 87fc33005b5440098daf798066a653f7 Aug 31 15:55:29.401888 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServersTestMultiNic-144128256 Aug 31 15:55:29.401888 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServersTestMultiNic-144128256-project Aug 31 15:55:29.401888 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:55:29.401888 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:55:29.401888 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 048bcefe0af04bc6a3a2995b22cbe43f Aug 31 15:55:29.401888 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServersTestMultiNic-144128256-project Aug 31 15:55:29.401888 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:55:29.401888 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance d90a0347-3975-4633-be62-0e57756f93df could not be found. Aug 31 15:55:29.401888 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'd90a0347-3975-4633-be62-0e57756f93df'} Aug 31 15:55:29.403016 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:55:29.403016 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:29.403016 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:55:29.403016 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:55:29.403016 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:55:29.403016 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:55:29.403016 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:55:29.403016 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:55:29.403016 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:55:29.403016 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:55:29.403016 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d90a0347-3975-4633-be62-0e57756f93df could not be found. Aug 31 15:55:29.403016 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:55:29.403016 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:55:29.403016 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:55:29.403016 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:29.403016 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:55:29.403016 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:55:29.403016 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:55:29.403016 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:55:29.403016 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:55:29.404722 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:55:29.404722 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 15:55:29.404722 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 15:55:29.404722 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 15:55:29.404722 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 15:55:29.404722 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:55:29.404722 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:55:29.404722 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:55:29.404722 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:55:29.404722 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d90a0347-3975-4633-be62-0e57756f93df could not be found. Aug 31 15:55:29.404722 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:55:29.404722 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:55:29.404722 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:55:29.404722 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:29.404722 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:55:29.404722 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:55:29.404722 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:55:29.404722 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:55:29.404722 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d90a0347-3975-4633-be62-0e57756f93df could not be found. Aug 31 15:55:29.404722 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:55:29.409423 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-def0217c-53d6-4969-9e19-d36d775adc94 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Returning 404 to user: Instance d90a0347-3975-4633-be62-0e57756f93df could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:55:29.410344 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-def0217c-53d6-4969-9e19-d36d775adc94 tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d90a0347-3975-4633-be62-0e57756f93df" status: 404 len: 111 microversion: 2.1 time: 0.080024 Aug 31 15:55:29.410927 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 879/1664] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:55:29 2022] DELETE /compute/v2.1/servers/d90a0347-3975-4633-be62-0e57756f93df => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:55:29.421851 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-bd227f0c-84c2-4a2b-96f4-43691bdfabce tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:29.433344 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-bd227f0c-84c2-4a2b-96f4-43691bdfabce tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] [instance: d90a0347-3975-4633-be62-0e57756f93df] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:29.451519 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bd227f0c-84c2-4a2b-96f4-43691bdfabce tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:29.452358 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bd227f0c-84c2-4a2b-96f4-43691bdfabce tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:29.452978 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bd227f0c-84c2-4a2b-96f4-43691bdfabce tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:29.453869 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bd227f0c-84c2-4a2b-96f4-43691bdfabce tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:29.457127 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bd227f0c-84c2-4a2b-96f4-43691bdfabce tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:29.457777 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bd227f0c-84c2-4a2b-96f4-43691bdfabce tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:29.516271 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-bd227f0c-84c2-4a2b-96f4-43691bdfabce tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] HTTP exception thrown: Instance d90a0347-3975-4633-be62-0e57756f93df could not be found. Aug 31 15:55:29.523992 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-bd227f0c-84c2-4a2b-96f4-43691bdfabce tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Request method failure captured: Aug 31 15:55:29.523992 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/d90a0347-3975-4633-be62-0e57756f93df HTTP/1.1 Aug 31 15:55:29.523992 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:55:29.523992 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:55:29.523992 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:55:29.523992 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:55:29.523992 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:55:29.523992 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:55:29.523992 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:55:29.523992 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:55:29.523992 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4QEzV7UYeFoZ6CXANWsE8AGcFXL7cKP8nn17x2vQuX1Be2UEwxoivijeVSTB7REhWn5GNrXHbLfygoTIsWTTtV_gTbNFmFzo6sm4bNJW93IwqkNro8HG2ZfwaHK2pcULOylDToL-r9NAoJeJYTdwr1tAS7UUZ0kiT7pUbjwBzq1vJU Aug 31 15:55:29.523992 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:55:29.523992 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:55:29.523992 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:55:29.523992 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:55:29.523992 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:55:29.523992 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:55:29.523992 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 87fc33005b5440098daf798066a653f7 Aug 31 15:55:29.523992 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServersTestMultiNic-144128256 Aug 31 15:55:29.523992 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:55:29.523992 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:55:29.525849 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/87fc33005b5440098daf798066a653f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/87fc33005b5440098daf798066a653f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/87fc33005b5440098daf798066a653f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_87fc33005b5440098daf798066a653f7", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:55:29.525849 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServersTestMultiNic-144128256 Aug 31 15:55:29.525849 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 87fc33005b5440098daf798066a653f7 Aug 31 15:55:29.525849 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServersTestMultiNic-144128256 Aug 31 15:55:29.525849 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServersTestMultiNic-144128256-project Aug 31 15:55:29.525849 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:55:29.525849 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:55:29.525849 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 048bcefe0af04bc6a3a2995b22cbe43f Aug 31 15:55:29.525849 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServersTestMultiNic-144128256-project Aug 31 15:55:29.525849 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:55:29.525849 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance d90a0347-3975-4633-be62-0e57756f93df could not be found. Aug 31 15:55:29.525849 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'd90a0347-3975-4633-be62-0e57756f93df'} Aug 31 15:55:29.526982 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:55:29.526982 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:29.526982 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:55:29.526982 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:55:29.526982 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:55:29.526982 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:55:29.526982 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:55:29.526982 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:55:29.526982 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:55:29.526982 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:55:29.526982 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d90a0347-3975-4633-be62-0e57756f93df could not be found. Aug 31 15:55:29.526982 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:55:29.526982 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:55:29.526982 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:55:29.526982 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:29.526982 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:55:29.526982 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:55:29.526982 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:55:29.526982 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:55:29.526982 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:55:29.528690 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:55:29.528690 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:55:29.528690 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:55:29.528690 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:55:29.528690 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:55:29.528690 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:55:29.528690 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:55:29.528690 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d90a0347-3975-4633-be62-0e57756f93df could not be found. Aug 31 15:55:29.528690 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:55:29.528690 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:55:29.528690 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:55:29.528690 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:29.528690 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:55:29.528690 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:55:29.528690 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:55:29.528690 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:55:29.528690 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d90a0347-3975-4633-be62-0e57756f93df could not be found. Aug 31 15:55:29.528690 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:55:29.531012 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-bd227f0c-84c2-4a2b-96f4-43691bdfabce tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Returning 404 to user: Instance d90a0347-3975-4633-be62-0e57756f93df could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:55:29.536615 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-bd227f0c-84c2-4a2b-96f4-43691bdfabce tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] 10.222.0.50 "GET /compute/v2.1/servers/d90a0347-3975-4633-be62-0e57756f93df" status: 404 len: 111 microversion: 2.1 time: 0.120136 Aug 31 15:55:29.550454 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 880/1665] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:29 2022] GET /compute/v2.1/servers/d90a0347-3975-4633-be62-0e57756f93df => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:55:29.583067 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-17bfc43a-ebd9-437f-95d3-6d5e74a248fe tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:29.587927 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-17bfc43a-ebd9-437f-95d3-6d5e74a248fe tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] [instance: e4a38af3-ba7d-4074-a628-9c7825ae3358] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:29.626551 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-17bfc43a-ebd9-437f-95d3-6d5e74a248fe tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:29.630282 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-17bfc43a-ebd9-437f-95d3-6d5e74a248fe tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:29.639293 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-17bfc43a-ebd9-437f-95d3-6d5e74a248fe tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:29.641447 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-17bfc43a-ebd9-437f-95d3-6d5e74a248fe tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:29.643625 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-17bfc43a-ebd9-437f-95d3-6d5e74a248fe tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:29.646171 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-17bfc43a-ebd9-437f-95d3-6d5e74a248fe tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:29.648165 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d14fcc84-7a67-47ab-870d-f40d03546e33 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:29.665602 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d14fcc84-7a67-47ab-870d-f40d03546e33 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65" status: 200 len: 1476 microversion: 2.1 time: 0.369117 Aug 31 15:55:29.668506 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 786/1666] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:29 2022] GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65 => generated 1476 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:29.709492 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-17bfc43a-ebd9-437f-95d3-6d5e74a248fe tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] HTTP exception thrown: Instance e4a38af3-ba7d-4074-a628-9c7825ae3358 could not be found. Aug 31 15:55:29.711181 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-17bfc43a-ebd9-437f-95d3-6d5e74a248fe tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Request method failure captured: Aug 31 15:55:29.711181 n-d-833090-16 devstack@n-api.service[128864]: request: DELETE /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358 HTTP/1.1 Aug 31 15:55:29.711181 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:55:29.711181 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:55:29.711181 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:55:29.711181 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:55:29.711181 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:55:29.711181 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:55:29.711181 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:55:29.711181 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:55:29.711181 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4QEzV7UYeFoZ6CXANWsE8AGcFXL7cKP8nn17x2vQuX1Be2UEwxoivijeVSTB7REhWn5GNrXHbLfygoTIsWTTtV_gTbNFmFzo6sm4bNJW93IwqkNro8HG2ZfwaHK2pcULOylDToL-r9NAoJeJYTdwr1tAS7UUZ0kiT7pUbjwBzq1vJU Aug 31 15:55:29.711181 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:55:29.711181 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:55:29.711181 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:55:29.711181 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:55:29.711181 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:55:29.711181 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:55:29.711181 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 87fc33005b5440098daf798066a653f7 Aug 31 15:55:29.711181 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServersTestMultiNic-144128256 Aug 31 15:55:29.711181 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:55:29.711181 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:55:29.712929 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/87fc33005b5440098daf798066a653f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/87fc33005b5440098daf798066a653f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/87fc33005b5440098daf798066a653f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_87fc33005b5440098daf798066a653f7", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:55:29.712929 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServersTestMultiNic-144128256 Aug 31 15:55:29.712929 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 87fc33005b5440098daf798066a653f7 Aug 31 15:55:29.712929 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServersTestMultiNic-144128256 Aug 31 15:55:29.712929 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServersTestMultiNic-144128256-project Aug 31 15:55:29.712929 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:55:29.712929 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:55:29.712929 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 048bcefe0af04bc6a3a2995b22cbe43f Aug 31 15:55:29.712929 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServersTestMultiNic-144128256-project Aug 31 15:55:29.712929 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:55:29.712929 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance e4a38af3-ba7d-4074-a628-9c7825ae3358 could not be found. Aug 31 15:55:29.712929 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'e4a38af3-ba7d-4074-a628-9c7825ae3358'} Aug 31 15:55:29.713906 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:55:29.713906 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:29.713906 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:55:29.713906 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:55:29.713906 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:55:29.713906 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:55:29.713906 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:55:29.713906 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:55:29.713906 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:55:29.713906 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:55:29.713906 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4a38af3-ba7d-4074-a628-9c7825ae3358 could not be found. Aug 31 15:55:29.713906 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:55:29.713906 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:55:29.713906 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:55:29.713906 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:29.713906 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:55:29.713906 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:55:29.713906 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:55:29.713906 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:55:29.713906 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:55:29.715599 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:55:29.715599 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 15:55:29.715599 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 15:55:29.715599 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 15:55:29.715599 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 15:55:29.715599 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:55:29.715599 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:55:29.715599 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:55:29.715599 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:55:29.715599 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4a38af3-ba7d-4074-a628-9c7825ae3358 could not be found. Aug 31 15:55:29.715599 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:55:29.715599 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:55:29.715599 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:55:29.715599 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:29.715599 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:55:29.715599 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:55:29.715599 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:55:29.715599 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:55:29.715599 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4a38af3-ba7d-4074-a628-9c7825ae3358 could not be found. Aug 31 15:55:29.715599 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:55:29.737390 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-17bfc43a-ebd9-437f-95d3-6d5e74a248fe tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Returning 404 to user: Instance e4a38af3-ba7d-4074-a628-9c7825ae3358 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:55:29.738504 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-17bfc43a-ebd9-437f-95d3-6d5e74a248fe tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358" status: 404 len: 111 microversion: 2.1 time: 0.186870 Aug 31 15:55:29.754471 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 881/1667] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:55:29 2022] DELETE /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358 => generated 111 bytes in 202 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:55:29.762062 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-83dc5e8f-8119-4d03-a47c-e150fc74624a tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:29.764016 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-83dc5e8f-8119-4d03-a47c-e150fc74624a tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] [instance: e4a38af3-ba7d-4074-a628-9c7825ae3358] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:29.772470 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83dc5e8f-8119-4d03-a47c-e150fc74624a tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:29.776013 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83dc5e8f-8119-4d03-a47c-e150fc74624a tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:29.776781 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83dc5e8f-8119-4d03-a47c-e150fc74624a tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:29.777280 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83dc5e8f-8119-4d03-a47c-e150fc74624a tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:29.779271 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83dc5e8f-8119-4d03-a47c-e150fc74624a tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:29.781750 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83dc5e8f-8119-4d03-a47c-e150fc74624a tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:29.815046 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-83dc5e8f-8119-4d03-a47c-e150fc74624a tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] HTTP exception thrown: Instance e4a38af3-ba7d-4074-a628-9c7825ae3358 could not be found. Aug 31 15:55:29.816817 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-83dc5e8f-8119-4d03-a47c-e150fc74624a tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Request method failure captured: Aug 31 15:55:29.816817 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358 HTTP/1.1 Aug 31 15:55:29.816817 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:55:29.816817 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:55:29.816817 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:55:29.816817 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:55:29.816817 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:55:29.816817 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:55:29.816817 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:55:29.816817 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:55:29.816817 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4QEzV7UYeFoZ6CXANWsE8AGcFXL7cKP8nn17x2vQuX1Be2UEwxoivijeVSTB7REhWn5GNrXHbLfygoTIsWTTtV_gTbNFmFzo6sm4bNJW93IwqkNro8HG2ZfwaHK2pcULOylDToL-r9NAoJeJYTdwr1tAS7UUZ0kiT7pUbjwBzq1vJU Aug 31 15:55:29.816817 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:55:29.816817 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:55:29.816817 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:55:29.816817 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:55:29.816817 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:55:29.816817 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:55:29.816817 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 87fc33005b5440098daf798066a653f7 Aug 31 15:55:29.816817 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersTestMultiNic-144128256 Aug 31 15:55:29.816817 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:55:29.816817 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:55:29.818615 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/87fc33005b5440098daf798066a653f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/87fc33005b5440098daf798066a653f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/87fc33005b5440098daf798066a653f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_87fc33005b5440098daf798066a653f7", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:55:29.818615 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServersTestMultiNic-144128256 Aug 31 15:55:29.818615 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 87fc33005b5440098daf798066a653f7 Aug 31 15:55:29.818615 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersTestMultiNic-144128256 Aug 31 15:55:29.818615 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServersTestMultiNic-144128256-project Aug 31 15:55:29.818615 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:55:29.818615 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:55:29.818615 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 048bcefe0af04bc6a3a2995b22cbe43f Aug 31 15:55:29.818615 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServersTestMultiNic-144128256-project Aug 31 15:55:29.818615 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 15:55:29.818615 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance e4a38af3-ba7d-4074-a628-9c7825ae3358 could not be found. Aug 31 15:55:29.818615 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'e4a38af3-ba7d-4074-a628-9c7825ae3358'} Aug 31 15:55:29.819606 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:55:29.819606 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:29.819606 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:55:29.819606 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:55:29.819606 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:55:29.819606 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:55:29.819606 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:55:29.819606 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:55:29.819606 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:55:29.819606 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:55:29.819606 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4a38af3-ba7d-4074-a628-9c7825ae3358 could not be found. Aug 31 15:55:29.819606 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:55:29.819606 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:55:29.819606 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:55:29.819606 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:29.819606 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:55:29.819606 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:55:29.819606 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:55:29.819606 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:55:29.819606 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:55:29.821302 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:55:29.821302 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:55:29.821302 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:55:29.821302 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:55:29.821302 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:55:29.821302 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:55:29.821302 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:55:29.821302 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4a38af3-ba7d-4074-a628-9c7825ae3358 could not be found. Aug 31 15:55:29.821302 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:55:29.821302 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:55:29.821302 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:55:29.821302 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:29.821302 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:55:29.821302 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:55:29.821302 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:55:29.821302 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:55:29.821302 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4a38af3-ba7d-4074-a628-9c7825ae3358 could not be found. Aug 31 15:55:29.821302 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:55:29.823553 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-83dc5e8f-8119-4d03-a47c-e150fc74624a tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] Returning 404 to user: Instance e4a38af3-ba7d-4074-a628-9c7825ae3358 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:55:29.825600 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-83dc5e8f-8119-4d03-a47c-e150fc74624a tempest-ServersTestMultiNic-144128256 tempest-ServersTestMultiNic-144128256-project] 10.222.0.50 "GET /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358" status: 404 len: 111 microversion: 2.1 time: 0.068383 Aug 31 15:55:29.826258 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 787/1668] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:29 2022] GET /compute/v2.1/servers/e4a38af3-ba7d-4074-a628-9c7825ae3358 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:55:29.836632 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-da095fc4-7274-40e3-9b7e-358548abd2bf req-3ccf65f2-23ed-45a7-b2da-a31ff26df0da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11bf6774-dc05-481c-a9f9-29c2ebd4531f", "name": "network-vif-plugged", "status": "completed", "tag": "057a9369-1375-4306-ae2a-141459b97c92"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:29.860035 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-da095fc4-7274-40e3-9b7e-358548abd2bf req-3ccf65f2-23ed-45a7-b2da-a31ff26df0da service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:29.860440 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-da095fc4-7274-40e3-9b7e-358548abd2bf req-3ccf65f2-23ed-45a7-b2da-a31ff26df0da service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:29.861445 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-da095fc4-7274-40e3-9b7e-358548abd2bf req-3ccf65f2-23ed-45a7-b2da-a31ff26df0da service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:29.896885 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-da095fc4-7274-40e3-9b7e-358548abd2bf req-3ccf65f2-23ed-45a7-b2da-a31ff26df0da service nova] Creating event network-vif-plugged:057a9369-1375-4306-ae2a-141459b97c92 for instance 11bf6774-dc05-481c-a9f9-29c2ebd4531f on n-h2-833090-16 Aug 31 15:55:29.908704 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-da095fc4-7274-40e3-9b7e-358548abd2bf req-3ccf65f2-23ed-45a7-b2da-a31ff26df0da service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075895 Aug 31 15:55:29.917534 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 882/1669] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:55:30.021868 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e715bc6e-c39d-468a-8593-e3069107153f tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:30.022836 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e715bc6e-c39d-468a-8593-e3069107153f tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:30.036160 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e715bc6e-c39d-468a-8593-e3069107153f tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:30.038278 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e715bc6e-c39d-468a-8593-e3069107153f tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:30.039201 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e715bc6e-c39d-468a-8593-e3069107153f tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:30.040373 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e715bc6e-c39d-468a-8593-e3069107153f tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:30.041180 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e715bc6e-c39d-468a-8593-e3069107153f tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:30.041798 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e715bc6e-c39d-468a-8593-e3069107153f tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:30.048979 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a3ca38e7-dc17-405c-b280-e8eac89fb831 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:30.049970 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a3ca38e7-dc17-405c-b280-e8eac89fb831 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 11bf6774-dc05-481c-a9f9-29c2ebd4531f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:30.059095 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a3ca38e7-dc17-405c-b280-e8eac89fb831 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:30.060401 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a3ca38e7-dc17-405c-b280-e8eac89fb831 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:30.061475 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a3ca38e7-dc17-405c-b280-e8eac89fb831 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:30.062618 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a3ca38e7-dc17-405c-b280-e8eac89fb831 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:30.063727 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a3ca38e7-dc17-405c-b280-e8eac89fb831 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:30.066777 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a3ca38e7-dc17-405c-b280-e8eac89fb831 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:30.500089 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a3ca38e7-dc17-405c-b280-e8eac89fb831 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:30.521713 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a3ca38e7-dc17-405c-b280-e8eac89fb831 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/11bf6774-dc05-481c-a9f9-29c2ebd4531f" status: 200 len: 1315 microversion: 2.1 time: 0.471524 Aug 31 15:55:30.522689 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 883/1670] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:30 2022] GET /compute/v2.1/servers/11bf6774-dc05-481c-a9f9-29c2ebd4531f => generated 1315 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:30.528193 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9ac50eb1-f811-4c39-8e3f-5d7f0da451f0 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:30.539088 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9ac50eb1-f811-4c39-8e3f-5d7f0da451f0 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] [instance: 0442e1d9-fa54-4957-8313-335c0f39c763] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:30.546253 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ac50eb1-f811-4c39-8e3f-5d7f0da451f0 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:30.546991 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ac50eb1-f811-4c39-8e3f-5d7f0da451f0 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:30.548075 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ac50eb1-f811-4c39-8e3f-5d7f0da451f0 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:30.554257 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ac50eb1-f811-4c39-8e3f-5d7f0da451f0 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:30.554928 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ac50eb1-f811-4c39-8e3f-5d7f0da451f0 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:30.555568 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ac50eb1-f811-4c39-8e3f-5d7f0da451f0 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:30.561550 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e715bc6e-c39d-468a-8593-e3069107153f tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:30.574480 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e715bc6e-c39d-468a-8593-e3069107153f tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:30.579397 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e715bc6e-c39d-468a-8593-e3069107153f tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:30.581991 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e715bc6e-c39d-468a-8593-e3069107153f tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a" status: 200 len: 1813 microversion: 2.25 time: 0.564975 Aug 31 15:55:30.583752 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 788/1671] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:55:30 2022] GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a => generated 1813 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:55:30.589524 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-9ac50eb1-f811-4c39-8e3f-5d7f0da451f0 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] HTTP exception thrown: Instance 0442e1d9-fa54-4957-8313-335c0f39c763 could not be found. Aug 31 15:55:30.589919 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-75f818cd-5990-43aa-a3f2-325bd2fc1223 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb465c3940>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:30.598766 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9ac50eb1-f811-4c39-8e3f-5d7f0da451f0 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Request method failure captured: Aug 31 15:55:30.598766 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/0442e1d9-fa54-4957-8313-335c0f39c763 HTTP/1.1 Aug 31 15:55:30.598766 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:55:30.598766 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:55:30.598766 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:55:30.598766 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:55:30.598766 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:55:30.598766 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:55:30.598766 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:55:30.598766 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:55:30.598766 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4QVQYNk5_sHDuHLSUKMwE3UeAFTW43NrI5LZQyq17QjM7Tm_NNDHOYwyDkqduzPdovqCgxFK2mabNmxzK5helNFaxArTkN6djKzZKb0J3uLMX_RPzOQxBGt-NklOg-saYpjwR3tvbqrZBqYIXS5wJcla3v6T1J9CnCi_PTvOv1_D6U Aug 31 15:55:30.598766 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:55:30.598766 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:55:30.598766 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:55:30.598766 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:55:30.598766 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:55:30.598766 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:55:30.598766 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: a45d2345cb0e4847964e67928ab3069b Aug 31 15:55:30.598766 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ImagesOneServerTestJSON-2096053179 Aug 31 15:55:30.598766 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:55:30.598766 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:55:30.600234 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a45d2345cb0e4847964e67928ab3069b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a45d2345cb0e4847964e67928ab3069b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a45d2345cb0e4847964e67928ab3069b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a45d2345cb0e4847964e67928ab3069b", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:55:30.600234 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ImagesOneServerTestJSON-2096053179 Aug 31 15:55:30.600234 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: a45d2345cb0e4847964e67928ab3069b Aug 31 15:55:30.600234 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-2096053179 Aug 31 15:55:30.600234 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ImagesOneServerTestJSON-2096053179-project Aug 31 15:55:30.600234 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:55:30.600234 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:55:30.600234 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 0578b42db80943249238958e5fce15f1 Aug 31 15:55:30.600234 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ImagesOneServerTestJSON-2096053179-project Aug 31 15:55:30.600234 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:55:30.600234 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 0442e1d9-fa54-4957-8313-335c0f39c763 could not be found. Aug 31 15:55:30.600234 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '0442e1d9-fa54-4957-8313-335c0f39c763'} Aug 31 15:55:30.601260 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:55:30.601260 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:30.601260 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:55:30.601260 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:55:30.601260 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:55:30.601260 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:55:30.601260 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:55:30.601260 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:55:30.601260 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:55:30.601260 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:55:30.601260 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0442e1d9-fa54-4957-8313-335c0f39c763 could not be found. Aug 31 15:55:30.601260 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:55:30.601260 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:55:30.601260 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:55:30.601260 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:30.601260 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:55:30.601260 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:55:30.601260 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:55:30.601260 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:55:30.601260 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:55:30.602671 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:55:30.602671 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:55:30.602671 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:55:30.602671 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:55:30.602671 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:55:30.602671 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:55:30.602671 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:55:30.602671 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0442e1d9-fa54-4957-8313-335c0f39c763 could not be found. Aug 31 15:55:30.602671 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:55:30.602671 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:55:30.602671 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:55:30.602671 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:30.602671 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:55:30.602671 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:55:30.602671 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:55:30.602671 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:55:30.602671 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0442e1d9-fa54-4957-8313-335c0f39c763 could not be found. Aug 31 15:55:30.602671 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:55:30.603881 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9ac50eb1-f811-4c39-8e3f-5d7f0da451f0 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] Returning 404 to user: Instance 0442e1d9-fa54-4957-8313-335c0f39c763 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:55:30.603881 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9ac50eb1-f811-4c39-8e3f-5d7f0da451f0 tempest-ImagesOneServerTestJSON-2096053179 tempest-ImagesOneServerTestJSON-2096053179-project] 10.222.0.50 "GET /compute/v2.1/servers/0442e1d9-fa54-4957-8313-335c0f39c763" status: 404 len: 111 microversion: 2.1 time: 0.076054 Aug 31 15:55:30.603881 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 884/1672] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:30 2022] GET /compute/v2.1/servers/0442e1d9-fa54-4957-8313-335c0f39c763 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:55:30.686935 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-75f818cd-5990-43aa-a3f2-325bd2fc1223 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/images/e202e141-5d73-4379-b82b-e5ecc6ddf63e" status: 200 len: 1411 microversion: 2.1 time: 0.101679 Aug 31 15:55:30.687784 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 789/1673] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:55:30 2022] GET /compute/v2.1/images/e202e141-5d73-4379-b82b-e5ecc6ddf63e => generated 1411 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:30.696842 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2ce581bb-6612-4b75-92d4-e1d8b3da3c82 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:30.697703 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2ce581bb-6612-4b75-92d4-e1d8b3da3c82 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:30.704324 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2ce581bb-6612-4b75-92d4-e1d8b3da3c82 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:30.705063 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2ce581bb-6612-4b75-92d4-e1d8b3da3c82 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:30.706469 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2ce581bb-6612-4b75-92d4-e1d8b3da3c82 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:30.707373 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2ce581bb-6612-4b75-92d4-e1d8b3da3c82 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:30.708033 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2ce581bb-6612-4b75-92d4-e1d8b3da3c82 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:30.708746 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2ce581bb-6612-4b75-92d4-e1d8b3da3c82 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:30.955279 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2ce581bb-6612-4b75-92d4-e1d8b3da3c82 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:30.968747 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2ce581bb-6612-4b75-92d4-e1d8b3da3c82 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65" status: 200 len: 1476 microversion: 2.1 time: 0.283721 Aug 31 15:55:30.971577 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 885/1674] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:30 2022] GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65 => generated 1476 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:55:31.313814 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8f7db726-7bf0-42ca-8b3e-2902ac5d1f1c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-885400265", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:31.397393 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-8f7db726-7bf0-42ca-8b3e-2902ac5d1f1c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] validate_networks() for None {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:55:31.544125 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-16280130-ce36-4ebe-844a-adfbab38dc4f tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:31.550394 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-16280130-ce36-4ebe-844a-adfbab38dc4f tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 11bf6774-dc05-481c-a9f9-29c2ebd4531f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:31.559010 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-16280130-ce36-4ebe-844a-adfbab38dc4f tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:31.561649 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-16280130-ce36-4ebe-844a-adfbab38dc4f tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:31.562815 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-16280130-ce36-4ebe-844a-adfbab38dc4f tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:31.564103 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-16280130-ce36-4ebe-844a-adfbab38dc4f tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:31.564782 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-16280130-ce36-4ebe-844a-adfbab38dc4f tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:31.565780 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-16280130-ce36-4ebe-844a-adfbab38dc4f tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:31.780937 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-8f7db726-7bf0-42ca-8b3e-2902ac5d1f1c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:55:31.782069 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-8f7db726-7bf0-42ca-8b3e-2902ac5d1f1c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:55:31.782795 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-8f7db726-7bf0-42ca-8b3e-2902ac5d1f1c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:55:31.783633 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-8f7db726-7bf0-42ca-8b3e-2902ac5d1f1c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:55:31.784325 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-8f7db726-7bf0-42ca-8b3e-2902ac5d1f1c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:55:31.805795 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f7db726-7bf0-42ca-8b3e-2902ac5d1f1c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:31.807954 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f7db726-7bf0-42ca-8b3e-2902ac5d1f1c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:31.810190 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f7db726-7bf0-42ca-8b3e-2902ac5d1f1c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:31.811298 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f7db726-7bf0-42ca-8b3e-2902ac5d1f1c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:31.813801 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f7db726-7bf0-42ca-8b3e-2902ac5d1f1c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:31.814610 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f7db726-7bf0-42ca-8b3e-2902ac5d1f1c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:31.882019 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-8f7db726-7bf0-42ca-8b3e-2902ac5d1f1c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Getting quotas for project 6b53c5033fb543adaeaae8980537d4e2. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:55:31.893799 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-8f7db726-7bf0-42ca-8b3e-2902ac5d1f1c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Getting quotas for user 2a19bb40252746379cf71a4f4b773b0a and project 6b53c5033fb543adaeaae8980537d4e2. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:55:31.929637 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8f7db726-7bf0-42ca-8b3e-2902ac5d1f1c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:55:31.937928 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8f7db726-7bf0-42ca-8b3e-2902ac5d1f1c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] [instance: bbf8b630-eb17-4c08-9347-531e5b63c829] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:55:32.100417 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8f7db726-7bf0-42ca-8b3e-2902ac5d1f1c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.299630 Aug 31 15:55:32.103462 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 790/1675] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:55:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1303 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 15:55:32.113381 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ee11b131-3f8a-4376-9779-c5d2fd2a25f9 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:32.118040 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ee11b131-3f8a-4376-9779-c5d2fd2a25f9 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:32.134706 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee11b131-3f8a-4376-9779-c5d2fd2a25f9 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:32.135644 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee11b131-3f8a-4376-9779-c5d2fd2a25f9 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:32.138223 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee11b131-3f8a-4376-9779-c5d2fd2a25f9 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:32.139429 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee11b131-3f8a-4376-9779-c5d2fd2a25f9 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:32.141091 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee11b131-3f8a-4376-9779-c5d2fd2a25f9 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:32.142318 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee11b131-3f8a-4376-9779-c5d2fd2a25f9 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:32.225788 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-16280130-ce36-4ebe-844a-adfbab38dc4f tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:32.235260 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-16280130-ce36-4ebe-844a-adfbab38dc4f tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/11bf6774-dc05-481c-a9f9-29c2ebd4531f" status: 200 len: 1315 microversion: 2.1 time: 0.696401 Aug 31 15:55:32.240475 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 886/1676] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:31 2022] GET /compute/v2.1/servers/11bf6774-dc05-481c-a9f9-29c2ebd4531f => generated 1315 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:32.252669 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0380f7ee-3cc3-4539-b47d-046f6592db1c tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb46ffc280>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:32.338490 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0380f7ee-3cc3-4539-b47d-046f6592db1c tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/images/e202e141-5d73-4379-b82b-e5ecc6ddf63e" status: 200 len: 1411 microversion: 2.1 time: 0.094268 Aug 31 15:55:32.341291 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 887/1677] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:55:32 2022] GET /compute/v2.1/images/e202e141-5d73-4379-b82b-e5ecc6ddf63e => generated 1411 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:32.355607 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9c67c9a3-caeb-473d-a213-394c52f307bf tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:32.356470 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9c67c9a3-caeb-473d-a213-394c52f307bf tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:32.373325 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9c67c9a3-caeb-473d-a213-394c52f307bf tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:32.376297 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9c67c9a3-caeb-473d-a213-394c52f307bf tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:32.377130 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9c67c9a3-caeb-473d-a213-394c52f307bf tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:32.380528 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9c67c9a3-caeb-473d-a213-394c52f307bf tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:32.382006 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9c67c9a3-caeb-473d-a213-394c52f307bf tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:32.384644 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9c67c9a3-caeb-473d-a213-394c52f307bf tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:32.622072 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ee11b131-3f8a-4376-9779-c5d2fd2a25f9 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:32.640392 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ee11b131-3f8a-4376-9779-c5d2fd2a25f9 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:32.646612 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ee11b131-3f8a-4376-9779-c5d2fd2a25f9 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:32.649036 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ee11b131-3f8a-4376-9779-c5d2fd2a25f9 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a" status: 200 len: 1813 microversion: 2.25 time: 0.544300 Aug 31 15:55:32.666297 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 791/1678] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:55:32 2022] GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a => generated 1813 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:55:32.678350 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bef5ffca-9e51-4f38-be84-b419423a1471 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:32.685928 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bef5ffca-9e51-4f38-be84-b419423a1471 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] [instance: bbf8b630-eb17-4c08-9347-531e5b63c829] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:32.860925 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bef5ffca-9e51-4f38-be84-b419423a1471 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a19bb40252746379cf71a4f4b773b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b53c5033fb543adaeaae8980537d4e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:32.876790 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bef5ffca-9e51-4f38-be84-b419423a1471 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] 10.222.0.50 "GET /compute/v2.1/servers/bbf8b630-eb17-4c08-9347-531e5b63c829" status: 200 len: 1219 microversion: 2.1 time: 0.210480 Aug 31 15:55:32.891224 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 792/1679] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:32 2022] GET /compute/v2.1/servers/bbf8b630-eb17-4c08-9347-531e5b63c829 => generated 1219 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:32.912005 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9c67c9a3-caeb-473d-a213-394c52f307bf tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:32.926333 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9c67c9a3-caeb-473d-a213-394c52f307bf tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65" status: 200 len: 1476 microversion: 2.1 time: 0.579092 Aug 31 15:55:32.927002 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 888/1680] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:32 2022] GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65 => generated 1476 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:33.261405 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-12dfee4f-56a7-43c2-8b4e-229e5c87559b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:33.262464 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-12dfee4f-56a7-43c2-8b4e-229e5c87559b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 11bf6774-dc05-481c-a9f9-29c2ebd4531f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:33.279069 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12dfee4f-56a7-43c2-8b4e-229e5c87559b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:33.279567 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12dfee4f-56a7-43c2-8b4e-229e5c87559b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:33.279992 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12dfee4f-56a7-43c2-8b4e-229e5c87559b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:33.280700 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12dfee4f-56a7-43c2-8b4e-229e5c87559b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:33.281151 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12dfee4f-56a7-43c2-8b4e-229e5c87559b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:33.283245 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12dfee4f-56a7-43c2-8b4e-229e5c87559b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:33.356393 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f6afb82a-f920-46b5-9fc2-592a1a12b933 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb46faeb80>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:33.427421 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f6afb82a-f920-46b5-9fc2-592a1a12b933 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/images/e202e141-5d73-4379-b82b-e5ecc6ddf63e" status: 200 len: 1411 microversion: 2.1 time: 0.075353 Aug 31 15:55:33.440247 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 889/1681] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:55:33 2022] GET /compute/v2.1/images/e202e141-5d73-4379-b82b-e5ecc6ddf63e => generated 1411 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:55:33.680005 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8df1539b-cad1-4145-a110-97b6ed894f03 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:33.681186 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8df1539b-cad1-4145-a110-97b6ed894f03 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:33.691673 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8df1539b-cad1-4145-a110-97b6ed894f03 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:33.692627 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8df1539b-cad1-4145-a110-97b6ed894f03 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:33.693599 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8df1539b-cad1-4145-a110-97b6ed894f03 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:33.695293 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8df1539b-cad1-4145-a110-97b6ed894f03 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:33.696272 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8df1539b-cad1-4145-a110-97b6ed894f03 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:33.697083 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8df1539b-cad1-4145-a110-97b6ed894f03 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:34.060380 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-12dfee4f-56a7-43c2-8b4e-229e5c87559b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:34.072909 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-12dfee4f-56a7-43c2-8b4e-229e5c87559b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/11bf6774-dc05-481c-a9f9-29c2ebd4531f" status: 200 len: 1503 microversion: 2.1 time: 0.815719 Aug 31 15:55:34.075070 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 793/1682] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:33 2022] GET /compute/v2.1/servers/11bf6774-dc05-481c-a9f9-29c2ebd4531f => generated 1503 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:34.119967 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8df1539b-cad1-4145-a110-97b6ed894f03 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:34.134491 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8df1539b-cad1-4145-a110-97b6ed894f03 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:34.139538 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8df1539b-cad1-4145-a110-97b6ed894f03 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:34.142939 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8df1539b-cad1-4145-a110-97b6ed894f03 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a" status: 200 len: 1813 microversion: 2.25 time: 0.468122 Aug 31 15:55:34.144811 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 890/1683] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:55:33 2022] GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a => generated 1813 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:55:34.150313 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e67f5388-77fb-422d-8964-0921dcb7a558 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:34.151194 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e67f5388-77fb-422d-8964-0921dcb7a558 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] [instance: bbf8b630-eb17-4c08-9347-531e5b63c829] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:34.162411 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e67f5388-77fb-422d-8964-0921dcb7a558 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:34.165436 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e67f5388-77fb-422d-8964-0921dcb7a558 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:34.166133 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e67f5388-77fb-422d-8964-0921dcb7a558 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:34.176167 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e67f5388-77fb-422d-8964-0921dcb7a558 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:34.177771 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e67f5388-77fb-422d-8964-0921dcb7a558 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:34.179158 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e67f5388-77fb-422d-8964-0921dcb7a558 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:34.313325 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e67f5388-77fb-422d-8964-0921dcb7a558 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a19bb40252746379cf71a4f4b773b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b53c5033fb543adaeaae8980537d4e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:34.321906 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e67f5388-77fb-422d-8964-0921dcb7a558 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] 10.222.0.50 "GET /compute/v2.1/servers/bbf8b630-eb17-4c08-9347-531e5b63c829" status: 200 len: 1271 microversion: 2.1 time: 0.175821 Aug 31 15:55:34.328513 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 891/1684] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:34 2022] GET /compute/v2.1/servers/bbf8b630-eb17-4c08-9347-531e5b63c829 => generated 1271 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:34.341018 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c1d9b6da-8a6d-45fd-873a-87c37e9cd125 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:34.341941 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c1d9b6da-8a6d-45fd-873a-87c37e9cd125 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:34.352347 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c1d9b6da-8a6d-45fd-873a-87c37e9cd125 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:34.353120 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c1d9b6da-8a6d-45fd-873a-87c37e9cd125 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:34.353716 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c1d9b6da-8a6d-45fd-873a-87c37e9cd125 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:34.354725 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c1d9b6da-8a6d-45fd-873a-87c37e9cd125 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:34.355339 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c1d9b6da-8a6d-45fd-873a-87c37e9cd125 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:34.356002 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c1d9b6da-8a6d-45fd-873a-87c37e9cd125 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:34.432653 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d4866611-6a2a-4fb5-8be7-26203db9673b tempest-AbsoluteLimitsNegativeTestJSON-105639451 tempest-AbsoluteLimitsNegativeTestJSON-105639451-project] Calling method '.version_select at 0x7fbb46408820>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:34.491516 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4866611-6a2a-4fb5-8be7-26203db9673b tempest-AbsoluteLimitsNegativeTestJSON-105639451 tempest-AbsoluteLimitsNegativeTestJSON-105639451-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:34.493298 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4866611-6a2a-4fb5-8be7-26203db9673b tempest-AbsoluteLimitsNegativeTestJSON-105639451 tempest-AbsoluteLimitsNegativeTestJSON-105639451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:34.494988 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4866611-6a2a-4fb5-8be7-26203db9673b tempest-AbsoluteLimitsNegativeTestJSON-105639451 tempest-AbsoluteLimitsNegativeTestJSON-105639451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:34.499382 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4866611-6a2a-4fb5-8be7-26203db9673b tempest-AbsoluteLimitsNegativeTestJSON-105639451 tempest-AbsoluteLimitsNegativeTestJSON-105639451-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:34.500246 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4866611-6a2a-4fb5-8be7-26203db9673b tempest-AbsoluteLimitsNegativeTestJSON-105639451 tempest-AbsoluteLimitsNegativeTestJSON-105639451-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:34.500701 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4866611-6a2a-4fb5-8be7-26203db9673b tempest-AbsoluteLimitsNegativeTestJSON-105639451 tempest-AbsoluteLimitsNegativeTestJSON-105639451-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:34.595405 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d4866611-6a2a-4fb5-8be7-26203db9673b tempest-AbsoluteLimitsNegativeTestJSON-105639451 tempest-AbsoluteLimitsNegativeTestJSON-105639451-project] 10.222.0.50 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.517169 Aug 31 15:55:34.597668 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 794/1685] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 15:55:34 2022] GET /compute/v2.1/limits => generated 511 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:55:34.609299 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2cacca5b-0a67-425a-8b4b-7f20decf6d7f tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb464a14c0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:34.692989 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2cacca5b-0a67-425a-8b4b-7f20decf6d7f tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/images/e202e141-5d73-4379-b82b-e5ecc6ddf63e" status: 200 len: 1411 microversion: 2.1 time: 0.093364 Aug 31 15:55:34.694677 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 795/1686] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:55:34 2022] GET /compute/v2.1/images/e202e141-5d73-4379-b82b-e5ecc6ddf63e => generated 1411 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:34.786366 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-84342de3-530d-457f-99d4-a869d1a98aba tempest-AbsoluteLimitsNegativeTestJSON-105639451 tempest-AbsoluteLimitsNegativeTestJSON-105639451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-559992614", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:34.923005 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-84342de3-530d-457f-99d4-a869d1a98aba tempest-AbsoluteLimitsNegativeTestJSON-105639451 tempest-AbsoluteLimitsNegativeTestJSON-105639451-project] validate_networks() for None {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:55:35.006372 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c1d9b6da-8a6d-45fd-873a-87c37e9cd125 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:35.019639 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c1d9b6da-8a6d-45fd-873a-87c37e9cd125 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65" status: 200 len: 1476 microversion: 2.1 time: 0.688019 Aug 31 15:55:35.024997 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 892/1687] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:34 2022] GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65 => generated 1476 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:35.174449 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5836e250-e49b-4d06-af29-540437ee9c32 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:35.176363 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5836e250-e49b-4d06-af29-540437ee9c32 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:35.188834 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5836e250-e49b-4d06-af29-540437ee9c32 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:35.189616 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5836e250-e49b-4d06-af29-540437ee9c32 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:35.190320 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5836e250-e49b-4d06-af29-540437ee9c32 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:35.191544 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5836e250-e49b-4d06-af29-540437ee9c32 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:35.192153 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5836e250-e49b-4d06-af29-540437ee9c32 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:35.192905 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5836e250-e49b-4d06-af29-540437ee9c32 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:35.500659 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5836e250-e49b-4d06-af29-540437ee9c32 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:35.523612 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5836e250-e49b-4d06-af29-540437ee9c32 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:35.527015 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5836e250-e49b-4d06-af29-540437ee9c32 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:35.528886 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5836e250-e49b-4d06-af29-540437ee9c32 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a" status: 200 len: 1813 microversion: 2.25 time: 0.358489 Aug 31 15:55:35.548530 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 893/1688] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:55:35 2022] GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a => generated 1813 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 15:55:35.561391 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a134cf24-15c8-4933-9b50-e6beca0ec722 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:35.563760 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a134cf24-15c8-4933-9b50-e6beca0ec722 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] [instance: bbf8b630-eb17-4c08-9347-531e5b63c829] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:35.576642 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a134cf24-15c8-4933-9b50-e6beca0ec722 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:35.579599 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a134cf24-15c8-4933-9b50-e6beca0ec722 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:35.581678 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a134cf24-15c8-4933-9b50-e6beca0ec722 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:35.583223 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a134cf24-15c8-4933-9b50-e6beca0ec722 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:35.584776 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a134cf24-15c8-4933-9b50-e6beca0ec722 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:35.587146 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a134cf24-15c8-4933-9b50-e6beca0ec722 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:35.598123 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:55:35.895511 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a134cf24-15c8-4933-9b50-e6beca0ec722 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a19bb40252746379cf71a4f4b773b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b53c5033fb543adaeaae8980537d4e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:35.917937 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a134cf24-15c8-4933-9b50-e6beca0ec722 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] 10.222.0.50 "GET /compute/v2.1/servers/bbf8b630-eb17-4c08-9347-531e5b63c829" status: 200 len: 1277 microversion: 2.1 time: 0.355958 Aug 31 15:55:35.936345 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 894/1689] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:35 2022] GET /compute/v2.1/servers/bbf8b630-eb17-4c08-9347-531e5b63c829 => generated 1277 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:35.944073 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-10c70330-5780-44db-b0fa-da627b16798e tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb46f65a60>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:36.012093 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-10c70330-5780-44db-b0fa-da627b16798e tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/images/e202e141-5d73-4379-b82b-e5ecc6ddf63e" status: 200 len: 1411 microversion: 2.1 time: 0.087101 Aug 31 15:55:36.017767 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 895/1690] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:55:35 2022] GET /compute/v2.1/images/e202e141-5d73-4379-b82b-e5ecc6ddf63e => generated 1411 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:36.035025 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-84342de3-530d-457f-99d4-a869d1a98aba tempest-AbsoluteLimitsNegativeTestJSON-105639451 tempest-AbsoluteLimitsNegativeTestJSON-105639451-project] Getting quotas for project c7dcbac5803e498f98325f6571122104. Resources: dict_keys(['metadata_items']) {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:55:36.046614 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-137a91b9-292f-4c91-a7dd-d2b94ae33da9 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:36.047821 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-137a91b9-292f-4c91-a7dd-d2b94ae33da9 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:36.049388 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-84342de3-530d-457f-99d4-a869d1a98aba tempest-AbsoluteLimitsNegativeTestJSON-105639451 tempest-AbsoluteLimitsNegativeTestJSON-105639451-project] Getting quotas for user 56864f3a574b4acbb84471c2bc25333e and project c7dcbac5803e498f98325f6571122104. Resources: dict_keys(['metadata_items']) {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:55:36.065886 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-137a91b9-292f-4c91-a7dd-d2b94ae33da9 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:36.066696 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-137a91b9-292f-4c91-a7dd-d2b94ae33da9 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:36.067307 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-137a91b9-292f-4c91-a7dd-d2b94ae33da9 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:36.068655 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-137a91b9-292f-4c91-a7dd-d2b94ae33da9 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:36.070713 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-137a91b9-292f-4c91-a7dd-d2b94ae33da9 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:36.072030 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-137a91b9-292f-4c91-a7dd-d2b94ae33da9 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:36.086472 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-84342de3-530d-457f-99d4-a869d1a98aba tempest-AbsoluteLimitsNegativeTestJSON-105639451 tempest-AbsoluteLimitsNegativeTestJSON-105639451-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Aug 31 15:55:36.093045 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-84342de3-530d-457f-99d4-a869d1a98aba tempest-AbsoluteLimitsNegativeTestJSON-105639451 tempest-AbsoluteLimitsNegativeTestJSON-105639451-project] Request method failure captured: Aug 31 15:55:36.093045 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 31 15:55:36.093045 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:55:36.093045 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:55:36.093045 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:55:36.093045 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 1751 Aug 31 15:55:36.093045 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:55:36.093045 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:55:36.093045 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:55:36.093045 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:55:36.093045 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4R1C48kj-mHxZ2besG-I9jVeXkVqojIsFh99Qt369Ked1ma4OpOlcGTHbAz8ene66rak_szwUQ1Ktc1Nop3OW7ZtiX7_8qzJ7y500sGLLBkVY7BFl11TLKZrFEWHedXD18rgYKkoGQLVDuNghHAWwnA3WnoBTKn1mdc-20JlmnefwE Aug 31 15:55:36.093045 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:55:36.093045 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:55:36.093045 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:55:36.093045 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:55:36.093045 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:55:36.093045 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:55:36.093045 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: c7dcbac5803e498f98325f6571122104 Aug 31 15:55:36.093045 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-105639451 Aug 31 15:55:36.093045 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:55:36.093045 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:55:36.093045 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c7dcbac5803e498f98325f6571122104"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c7dcbac5803e498f98325f6571122104"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c7dcbac5803e498f98325f6571122104"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c7dcbac5803e498f98325f6571122104", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:55:36.093045 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-105639451 Aug 31 15:55:36.093045 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: c7dcbac5803e498f98325f6571122104 Aug 31 15:55:36.093045 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-105639451 Aug 31 15:55:36.093045 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-105639451-project Aug 31 15:55:36.093045 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:55:36.093045 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:55:36.093045 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 56864f3a574b4acbb84471c2bc25333e Aug 31 15:55:36.093045 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-105639451-project Aug 31 15:55:36.093045 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 15:55:36.093045 n-d-833090-16 devstack@n-api.service[128863]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-559992614", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Aug 31 15:55:36.093045 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 15:55:36.093045 n-d-833090-16 devstack@n-api.service[128863]: exception: Maximum number of metadata items exceeds 128 Aug 31 15:55:36.096146 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-559992614', 'imageRef': 'd715a41c-0e56-494a-a102-cac65831f6bd', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Aug 31 15:55:36.096146 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:55:36.096146 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:36.096146 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Aug 31 15:55:36.096146 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Aug 31 15:55:36.096146 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 15:55:36.096146 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 15:55:36.096146 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Aug 31 15:55:36.096146 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Aug 31 15:55:36.096146 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Aug 31 15:55:36.096146 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Aug 31 15:55:36.096146 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Aug 31 15:55:36.096146 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Aug 31 15:55:36.096146 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Aug 31 15:55:36.096146 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:55:36.096146 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:55:36.096146 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:55:36.096146 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:36.096146 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 31 15:55:36.096146 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 31 15:55:36.096146 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 31 15:55:36.096146 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 31 15:55:36.096146 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Aug 31 15:55:36.096146 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 31 15:55:36.096146 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Aug 31 15:55:36.096146 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Aug 31 15:55:36.096146 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Aug 31 15:55:36.096146 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Aug 31 15:55:36.096146 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Aug 31 15:55:36.096146 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:55:36.096146 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:55:36.096146 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:55:36.096146 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:36.096146 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:55:36.096146 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:55:36.096146 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:55:36.096146 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:55:36.096146 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:55:36.096146 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:55:36.096146 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:55:36.096146 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:55:36.096146 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:55:36.096146 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:55:36.096146 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:55:36.100008 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:55:36.100008 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 31 15:55:36.100008 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 31 15:55:36.100008 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 31 15:55:36.100008 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Aug 31 15:55:36.100008 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:55:36.100008 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:55:36.100008 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:55:36.100008 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:55:36.100008 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:55:36.100008 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:55:36.100008 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:55:36.100008 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:55:36.100008 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Aug 31 15:55:36.100008 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:55:36.103056 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-84342de3-530d-457f-99d4-a869d1a98aba tempest-AbsoluteLimitsNegativeTestJSON-105639451 tempest-AbsoluteLimitsNegativeTestJSON-105639451-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:55:36.108062 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-84342de3-530d-457f-99d4-a869d1a98aba tempest-AbsoluteLimitsNegativeTestJSON-105639451 tempest-AbsoluteLimitsNegativeTestJSON-105639451-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 1.323678 Aug 31 15:55:36.113311 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 796/1691] 10.222.0.50 () {60 vars in 1148 bytes} [Wed Aug 31 15:55:34 2022] POST /compute/v2.1/servers => generated 87 bytes in 1328 msecs (HTTP/1.1 403) 9 headers in 378 bytes (2 switches on core 0) Aug 31 15:55:36.560658 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-801f08b1-115c-44c3-9326-25f888f9d754 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:36.561271 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-801f08b1-115c-44c3-9326-25f888f9d754 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:36.589081 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-801f08b1-115c-44c3-9326-25f888f9d754 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:36.594499 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-801f08b1-115c-44c3-9326-25f888f9d754 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:36.594984 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-801f08b1-115c-44c3-9326-25f888f9d754 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:36.598501 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-801f08b1-115c-44c3-9326-25f888f9d754 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:36.620224 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-801f08b1-115c-44c3-9326-25f888f9d754 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:36.620916 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-801f08b1-115c-44c3-9326-25f888f9d754 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:36.646240 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-137a91b9-292f-4c91-a7dd-d2b94ae33da9 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:36.677214 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-137a91b9-292f-4c91-a7dd-d2b94ae33da9 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65" status: 200 len: 1476 microversion: 2.1 time: 0.635745 Aug 31 15:55:36.694216 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 896/1692] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:36 2022] GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65 => generated 1476 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:55:36.699527 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-a90fe5e2-b5b1-4b84-823e-aed7cae0a674 req-7c2aa5a4-c0e8-4271-af77-8762430381f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a25dea8-1dc1-480e-a431-13d2f2270d0a", "name": "network-vif-unplugged", "status": "completed", "tag": "be9ab567-195e-4d60-b1e4-2ba6690fe483"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:36.727179 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-a90fe5e2-b5b1-4b84-823e-aed7cae0a674 req-7c2aa5a4-c0e8-4271-af77-8762430381f4 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:36.729197 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-a90fe5e2-b5b1-4b84-823e-aed7cae0a674 req-7c2aa5a4-c0e8-4271-af77-8762430381f4 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:36.730174 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-a90fe5e2-b5b1-4b84-823e-aed7cae0a674 req-7c2aa5a4-c0e8-4271-af77-8762430381f4 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:36.763129 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-a90fe5e2-b5b1-4b84-823e-aed7cae0a674 req-7c2aa5a4-c0e8-4271-af77-8762430381f4 service nova] Creating event network-vif-unplugged:be9ab567-195e-4d60-b1e4-2ba6690fe483 for instance 8a25dea8-1dc1-480e-a431-13d2f2270d0a on n-h2-833090-16 Aug 31 15:55:36.774438 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-a90fe5e2-b5b1-4b84-823e-aed7cae0a674 req-7c2aa5a4-c0e8-4271-af77-8762430381f4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077073 Aug 31 15:55:36.778075 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 897/1693] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:55:36.943815 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4dacbe3a-3697-4f43-8e98-72a516c54f83 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:36.945274 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4dacbe3a-3697-4f43-8e98-72a516c54f83 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] [instance: bbf8b630-eb17-4c08-9347-531e5b63c829] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:36.966012 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4dacbe3a-3697-4f43-8e98-72a516c54f83 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:36.994273 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4dacbe3a-3697-4f43-8e98-72a516c54f83 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:36.995855 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4dacbe3a-3697-4f43-8e98-72a516c54f83 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:37.004639 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4dacbe3a-3697-4f43-8e98-72a516c54f83 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:37.009343 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4dacbe3a-3697-4f43-8e98-72a516c54f83 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:37.010805 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4dacbe3a-3697-4f43-8e98-72a516c54f83 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:37.515639 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4dacbe3a-3697-4f43-8e98-72a516c54f83 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a19bb40252746379cf71a4f4b773b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b53c5033fb543adaeaae8980537d4e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:37.545257 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4dacbe3a-3697-4f43-8e98-72a516c54f83 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] 10.222.0.50 "GET /compute/v2.1/servers/bbf8b630-eb17-4c08-9347-531e5b63c829" status: 200 len: 1277 microversion: 2.1 time: 0.605612 Aug 31 15:55:37.549745 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 898/1694] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:36 2022] GET /compute/v2.1/servers/bbf8b630-eb17-4c08-9347-531e5b63c829 => generated 1277 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:37.574132 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4fa4bde3-3af3-417d-ae2c-499e127a9657 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb46addc10>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:37.693775 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4fa4bde3-3af3-417d-ae2c-499e127a9657 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/images/e202e141-5d73-4379-b82b-e5ecc6ddf63e" status: 200 len: 1411 microversion: 2.1 time: 0.139436 Aug 31 15:55:37.702890 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 899/1695] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:55:37 2022] GET /compute/v2.1/images/e202e141-5d73-4379-b82b-e5ecc6ddf63e => generated 1411 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:37.708421 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-13245a4f-503a-425d-9623-6d7963e6e6f5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:37.710007 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-13245a4f-503a-425d-9623-6d7963e6e6f5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:37.719859 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-13245a4f-503a-425d-9623-6d7963e6e6f5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:37.720517 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-13245a4f-503a-425d-9623-6d7963e6e6f5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:37.721665 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-13245a4f-503a-425d-9623-6d7963e6e6f5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:37.723807 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-13245a4f-503a-425d-9623-6d7963e6e6f5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:37.724424 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-13245a4f-503a-425d-9623-6d7963e6e6f5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:37.725077 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-13245a4f-503a-425d-9623-6d7963e6e6f5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:38.155254 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-801f08b1-115c-44c3-9326-25f888f9d754 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:38.181530 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-801f08b1-115c-44c3-9326-25f888f9d754 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:38.185026 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-801f08b1-115c-44c3-9326-25f888f9d754 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:38.187001 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-801f08b1-115c-44c3-9326-25f888f9d754 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a" status: 200 len: 1813 microversion: 2.25 time: 1.630477 Aug 31 15:55:38.188387 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 797/1696] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:55:36 2022] GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a => generated 1813 bytes in 1633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 15:55:38.195051 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3b7dc734-6f4b-4a44-96c3-b09db5b00048 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d8dca5d3-e181-4f72-b8a6-9e240fd3f347"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:38.199885 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3b7dc734-6f4b-4a44-96c3-b09db5b00048 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 11bf6774-dc05-481c-a9f9-29c2ebd4531f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:38.207203 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b7dc734-6f4b-4a44-96c3-b09db5b00048 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:38.210390 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b7dc734-6f4b-4a44-96c3-b09db5b00048 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:38.211048 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b7dc734-6f4b-4a44-96c3-b09db5b00048 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:38.213578 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b7dc734-6f4b-4a44-96c3-b09db5b00048 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:38.214411 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b7dc734-6f4b-4a44-96c3-b09db5b00048 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:38.215012 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b7dc734-6f4b-4a44-96c3-b09db5b00048 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:38.743471 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3b7dc734-6f4b-4a44-96c3-b09db5b00048 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "POST /compute/v2.1/servers/11bf6774-dc05-481c-a9f9-29c2ebd4531f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.551787 Aug 31 15:55:38.745988 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 798/1697] 10.222.0.50 () {60 vars in 1323 bytes} [Wed Aug 31 15:55:38 2022] POST /compute/v2.1/servers/11bf6774-dc05-481c-a9f9-29c2ebd4531f/os-volume_attachments => generated 194 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:55:38.760571 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-54362d2c-7141-43ef-a92c-74e065f8734c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:38.761362 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-54362d2c-7141-43ef-a92c-74e065f8734c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] [instance: bbf8b630-eb17-4c08-9347-531e5b63c829] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:38.782934 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-54362d2c-7141-43ef-a92c-74e065f8734c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:38.783549 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-54362d2c-7141-43ef-a92c-74e065f8734c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:38.784052 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-54362d2c-7141-43ef-a92c-74e065f8734c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:38.785555 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-54362d2c-7141-43ef-a92c-74e065f8734c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:38.786226 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-54362d2c-7141-43ef-a92c-74e065f8734c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:38.786813 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-54362d2c-7141-43ef-a92c-74e065f8734c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:39.131397 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-13245a4f-503a-425d-9623-6d7963e6e6f5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:39.148552 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-13245a4f-503a-425d-9623-6d7963e6e6f5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65" status: 200 len: 1476 microversion: 2.1 time: 1.443173 Aug 31 15:55:39.150939 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 900/1698] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:37 2022] GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65 => generated 1476 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:39.169583 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-24eb44ed-a8df-489a-bd81-29a9c7f008ed tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb46aaac10>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:39.276336 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-24eb44ed-a8df-489a-bd81-29a9c7f008ed tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/images/e202e141-5d73-4379-b82b-e5ecc6ddf63e" status: 200 len: 1420 microversion: 2.1 time: 0.122737 Aug 31 15:55:39.276921 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 901/1699] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:55:39 2022] GET /compute/v2.1/images/e202e141-5d73-4379-b82b-e5ecc6ddf63e => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:39.283102 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-ca2961cd-ff98-4bf0-8b7b-50b8c19bebcb req-2896e863-c4c0-499a-acf5-ef16c1094793 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a25dea8-1dc1-480e-a431-13d2f2270d0a", "tag": "be9ab567-195e-4d60-b1e4-2ba6690fe483"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:39.310060 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-ca2961cd-ff98-4bf0-8b7b-50b8c19bebcb req-2896e863-c4c0-499a-acf5-ef16c1094793 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:39.310556 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-ca2961cd-ff98-4bf0-8b7b-50b8c19bebcb req-2896e863-c4c0-499a-acf5-ef16c1094793 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:39.310975 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-ca2961cd-ff98-4bf0-8b7b-50b8c19bebcb req-2896e863-c4c0-499a-acf5-ef16c1094793 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:39.327166 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-ca2961cd-ff98-4bf0-8b7b-50b8c19bebcb req-2896e863-c4c0-499a-acf5-ef16c1094793 service nova] Creating event network-changed:be9ab567-195e-4d60-b1e4-2ba6690fe483 for instance 8a25dea8-1dc1-480e-a431-13d2f2270d0a on n-h2-833090-16 Aug 31 15:55:39.334367 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-ca2961cd-ff98-4bf0-8b7b-50b8c19bebcb req-2896e863-c4c0-499a-acf5-ef16c1094793 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055812 Aug 31 15:55:39.335906 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 902/1700] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:55:39.353603 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b7b89690-c8da-4ac9-ba99-ce21ff8e9593 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:39.354767 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b7b89690-c8da-4ac9-ba99-ce21ff8e9593 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:39.392500 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b7b89690-c8da-4ac9-ba99-ce21ff8e9593 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:39.394458 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b7b89690-c8da-4ac9-ba99-ce21ff8e9593 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:39.395593 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b7b89690-c8da-4ac9-ba99-ce21ff8e9593 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:39.397987 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b7b89690-c8da-4ac9-ba99-ce21ff8e9593 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:39.405018 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b7b89690-c8da-4ac9-ba99-ce21ff8e9593 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:39.406668 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b7b89690-c8da-4ac9-ba99-ce21ff8e9593 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:39.989380 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-54362d2c-7141-43ef-a92c-74e065f8734c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a19bb40252746379cf71a4f4b773b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b53c5033fb543adaeaae8980537d4e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:40.002982 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-54362d2c-7141-43ef-a92c-74e065f8734c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] 10.222.0.50 "GET /compute/v2.1/servers/bbf8b630-eb17-4c08-9347-531e5b63c829" status: 200 len: 1319 microversion: 2.1 time: 1.250920 Aug 31 15:55:40.003849 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 799/1701] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:38 2022] GET /compute/v2.1/servers/bbf8b630-eb17-4c08-9347-531e5b63c829 => generated 1319 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:40.008750 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-54b7bc2b-9b9c-429c-9f78-e51e65019209 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb46672dc0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:40.142123 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-54b7bc2b-9b9c-429c-9f78-e51e65019209 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/images/e202e141-5d73-4379-b82b-e5ecc6ddf63e" status: 200 len: 1420 microversion: 2.1 time: 0.135586 Aug 31 15:55:40.144124 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 800/1702] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:55:40 2022] GET /compute/v2.1/images/e202e141-5d73-4379-b82b-e5ecc6ddf63e => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:40.158836 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c4f3af1c-5fbf-4d35-8297-0b6738288a9a tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb465434c0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:40.300304 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b7b89690-c8da-4ac9-ba99-ce21ff8e9593 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:40.332657 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b7b89690-c8da-4ac9-ba99-ce21ff8e9593 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:40.345417 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b7b89690-c8da-4ac9-ba99-ce21ff8e9593 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:40.348931 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b7b89690-c8da-4ac9-ba99-ce21ff8e9593 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a" status: 200 len: 1813 microversion: 2.25 time: 1.011046 Aug 31 15:55:40.350429 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 903/1703] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:55:39 2022] GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a => generated 1813 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:55:40.369987 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-702d9581-48bd-46fe-a8c4-fb28eaabe194 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:40.372008 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-702d9581-48bd-46fe-a8c4-fb28eaabe194 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:40.401199 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-702d9581-48bd-46fe-a8c4-fb28eaabe194 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:40.403585 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-702d9581-48bd-46fe-a8c4-fb28eaabe194 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:40.404317 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-702d9581-48bd-46fe-a8c4-fb28eaabe194 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:40.405818 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-702d9581-48bd-46fe-a8c4-fb28eaabe194 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:40.406476 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-702d9581-48bd-46fe-a8c4-fb28eaabe194 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:40.407067 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-702d9581-48bd-46fe-a8c4-fb28eaabe194 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:40.876181 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-702d9581-48bd-46fe-a8c4-fb28eaabe194 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:40.891632 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-702d9581-48bd-46fe-a8c4-fb28eaabe194 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65" status: 200 len: 1475 microversion: 2.1 time: 0.537460 Aug 31 15:55:40.894405 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 904/1704] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:40 2022] GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65 => generated 1475 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:41.024431 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-056f1d40-e8dc-437a-8333-cf6f584e5446 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:41.025032 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-056f1d40-e8dc-437a-8333-cf6f584e5446 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] [instance: bbf8b630-eb17-4c08-9347-531e5b63c829] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:41.058555 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-056f1d40-e8dc-437a-8333-cf6f584e5446 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:41.059427 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-056f1d40-e8dc-437a-8333-cf6f584e5446 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:41.060324 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-056f1d40-e8dc-437a-8333-cf6f584e5446 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:41.061264 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-056f1d40-e8dc-437a-8333-cf6f584e5446 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:41.061919 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-056f1d40-e8dc-437a-8333-cf6f584e5446 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:41.062528 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-056f1d40-e8dc-437a-8333-cf6f584e5446 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:41.209577 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c4f3af1c-5fbf-4d35-8297-0b6738288a9a tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "DELETE /compute/v2.1/images/e202e141-5d73-4379-b82b-e5ecc6ddf63e" status: 204 len: 0 microversion: 2.1 time: 1.055555 Aug 31 15:55:41.210815 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 801/1705] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:40 2022] DELETE /compute/v2.1/images/e202e141-5d73-4379-b82b-e5ecc6ddf63e => generated 0 bytes in 1058 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:55:41.251328 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-0883f0b5-ba0d-489d-b1ce-f3691ce84341 req-d6037245-2218-4065-b8a4-36c2a10f8013 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbf8b630-eb17-4c08-9347-531e5b63c829", "tag": "baa64b98-0f72-4ddb-9970-82c581c73b80"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:41.316540 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-0883f0b5-ba0d-489d-b1ce-f3691ce84341 req-d6037245-2218-4065-b8a4-36c2a10f8013 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:41.324876 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-0883f0b5-ba0d-489d-b1ce-f3691ce84341 req-d6037245-2218-4065-b8a4-36c2a10f8013 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:41.325402 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-0883f0b5-ba0d-489d-b1ce-f3691ce84341 req-d6037245-2218-4065-b8a4-36c2a10f8013 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:41.362367 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-0883f0b5-ba0d-489d-b1ce-f3691ce84341 req-d6037245-2218-4065-b8a4-36c2a10f8013 service nova] Creating event network-changed:baa64b98-0f72-4ddb-9970-82c581c73b80 for instance bbf8b630-eb17-4c08-9347-531e5b63c829 on n-h2-833090-16 Aug 31 15:55:41.382145 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-0883f0b5-ba0d-489d-b1ce-f3691ce84341 req-d6037245-2218-4065-b8a4-36c2a10f8013 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165677 Aug 31 15:55:41.384469 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 802/1706] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:55:41.399206 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-28b0d828-2f98-483e-8bfd-ea404a69aafe tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:41.405607 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-28b0d828-2f98-483e-8bfd-ea404a69aafe tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: 3054bf54-101d-4e7d-b62d-bcd53d30a4bb] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:41.425201 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28b0d828-2f98-483e-8bfd-ea404a69aafe tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:41.425998 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28b0d828-2f98-483e-8bfd-ea404a69aafe tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:41.427140 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28b0d828-2f98-483e-8bfd-ea404a69aafe tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:41.429662 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28b0d828-2f98-483e-8bfd-ea404a69aafe tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:41.431763 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28b0d828-2f98-483e-8bfd-ea404a69aafe tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:41.433217 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28b0d828-2f98-483e-8bfd-ea404a69aafe tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:41.482166 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-28b0d828-2f98-483e-8bfd-ea404a69aafe tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: 3054bf54-101d-4e7d-b62d-bcd53d30a4bb] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:55:41.645724 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-28b0d828-2f98-483e-8bfd-ea404a69aafe tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3054bf54-101d-4e7d-b62d-bcd53d30a4bb" status: 204 len: 0 microversion: 2.1 time: 0.259058 Aug 31 15:55:41.647765 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 803/1707] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:55:41 2022] DELETE /compute/v2.1/servers/3054bf54-101d-4e7d-b62d-bcd53d30a4bb => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:55:41.730516 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-056f1d40-e8dc-437a-8333-cf6f584e5446 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a19bb40252746379cf71a4f4b773b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b53c5033fb543adaeaae8980537d4e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:41.744736 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-056f1d40-e8dc-437a-8333-cf6f584e5446 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] 10.222.0.50 "GET /compute/v2.1/servers/bbf8b630-eb17-4c08-9347-531e5b63c829" status: 200 len: 1319 microversion: 2.1 time: 0.721040 Aug 31 15:55:41.762271 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 905/1708] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:41 2022] GET /compute/v2.1/servers/bbf8b630-eb17-4c08-9347-531e5b63c829 => generated 1319 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:41.774142 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-54f8d042-78f2-4933-b1f6-82b5426062a2 req-11510b0b-dfa5-4fdf-81a7-246657324ed2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d065e0ee-199e-4e8b-99ca-5801d627ce65", "name": "network-vif-unplugged", "status": "completed", "tag": "b13f13ce-7cbb-472a-bc2c-bb5104160fb0"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:41.790227 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-54f8d042-78f2-4933-b1f6-82b5426062a2 req-11510b0b-dfa5-4fdf-81a7-246657324ed2 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:41.791000 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-54f8d042-78f2-4933-b1f6-82b5426062a2 req-11510b0b-dfa5-4fdf-81a7-246657324ed2 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:41.791986 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-54f8d042-78f2-4933-b1f6-82b5426062a2 req-11510b0b-dfa5-4fdf-81a7-246657324ed2 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:41.816059 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-54f8d042-78f2-4933-b1f6-82b5426062a2 req-11510b0b-dfa5-4fdf-81a7-246657324ed2 service nova] Creating event network-vif-unplugged:b13f13ce-7cbb-472a-bc2c-bb5104160fb0 for instance d065e0ee-199e-4e8b-99ca-5801d627ce65 on n-h1-833090-16 Aug 31 15:55:41.827203 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [req-54f8d042-78f2-4933-b1f6-82b5426062a2 req-11510b0b-dfa5-4fdf-81a7-246657324ed2 service nova] Instance d065e0ee-199e-4e8b-99ca-5801d627ce65 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-833090-16', 'n-h1-833090-16'} {{(pid=128864) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 15:55:41.857832 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-54f8d042-78f2-4933-b1f6-82b5426062a2 req-11510b0b-dfa5-4fdf-81a7-246657324ed2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092895 Aug 31 15:55:41.860447 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 906/1709] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:55:41.876902 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4d377692-bf51-478c-9835-54a8ff952994 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-721776270", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "cbd57e67-cabe-44b0-9027-5fa4dc677f22"}]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:41.982152 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-4d377692-bf51-478c-9835-54a8ff952994 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] validate_networks() for [('cbd57e67-cabe-44b0-9027-5fa4dc677f22', None, None, None, None, None)] {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:55:42.101449 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7989abf4-754a-440a-9506-473ee943afcc tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:42.102187 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7989abf4-754a-440a-9506-473ee943afcc tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:42.119540 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7989abf4-754a-440a-9506-473ee943afcc tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:42.120284 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7989abf4-754a-440a-9506-473ee943afcc tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:42.121061 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7989abf4-754a-440a-9506-473ee943afcc tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:42.121880 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7989abf4-754a-440a-9506-473ee943afcc tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:42.122455 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7989abf4-754a-440a-9506-473ee943afcc tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:42.122957 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7989abf4-754a-440a-9506-473ee943afcc tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:43.027005 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7989abf4-754a-440a-9506-473ee943afcc tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:43.041879 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7989abf4-754a-440a-9506-473ee943afcc tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:43.047157 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7989abf4-754a-440a-9506-473ee943afcc tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:43.054939 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7989abf4-754a-440a-9506-473ee943afcc tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a" status: 200 len: 1813 microversion: 2.25 time: 1.404141 Aug 31 15:55:43.056461 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 804/1710] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:55:41 2022] GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a => generated 1813 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:55:43.064361 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-49385858-86af-4519-b757-31f9617b95d1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:43.065216 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-49385858-86af-4519-b757-31f9617b95d1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:43.074542 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49385858-86af-4519-b757-31f9617b95d1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:43.076051 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49385858-86af-4519-b757-31f9617b95d1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:43.076723 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49385858-86af-4519-b757-31f9617b95d1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:43.077685 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49385858-86af-4519-b757-31f9617b95d1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:43.078643 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49385858-86af-4519-b757-31f9617b95d1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:43.079309 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49385858-86af-4519-b757-31f9617b95d1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:43.773488 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-49385858-86af-4519-b757-31f9617b95d1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:43.784148 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-49385858-86af-4519-b757-31f9617b95d1 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65" status: 200 len: 1475 microversion: 2.1 time: 0.724501 Aug 31 15:55:43.787743 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 805/1711] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:43 2022] GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65 => generated 1475 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:43.798031 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9d563a24-416a-40ca-b360-d3270e5dd76a tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:43.798944 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9d563a24-416a-40ca-b360-d3270e5dd76a tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] [instance: bbf8b630-eb17-4c08-9347-531e5b63c829] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:43.816721 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d563a24-416a-40ca-b360-d3270e5dd76a tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:43.817592 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d563a24-416a-40ca-b360-d3270e5dd76a tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:43.818218 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d563a24-416a-40ca-b360-d3270e5dd76a tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:43.819201 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d563a24-416a-40ca-b360-d3270e5dd76a tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:43.819820 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d563a24-416a-40ca-b360-d3270e5dd76a tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:43.820404 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d563a24-416a-40ca-b360-d3270e5dd76a tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:43.902250 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-4d377692-bf51-478c-9835-54a8ff952994 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:55:43.902741 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-4d377692-bf51-478c-9835-54a8ff952994 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:55:43.909018 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-4d377692-bf51-478c-9835-54a8ff952994 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:55:43.909558 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-4d377692-bf51-478c-9835-54a8ff952994 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:55:43.909982 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-4d377692-bf51-478c-9835-54a8ff952994 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:55:43.969638 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4d377692-bf51-478c-9835-54a8ff952994 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:43.971074 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4d377692-bf51-478c-9835-54a8ff952994 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:43.972705 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4d377692-bf51-478c-9835-54a8ff952994 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:43.975462 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4d377692-bf51-478c-9835-54a8ff952994 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:43.979408 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4d377692-bf51-478c-9835-54a8ff952994 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:43.980888 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4d377692-bf51-478c-9835-54a8ff952994 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:44.027218 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-4d377692-bf51-478c-9835-54a8ff952994 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Getting quotas for project c508a07ab50746468f855f7c5893ffdc. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:55:44.039526 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-4d377692-bf51-478c-9835-54a8ff952994 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Getting quotas for user 7d84a1872d9442b2886a8060d2e59580 and project c508a07ab50746468f855f7c5893ffdc. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:55:44.071395 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4d377692-bf51-478c-9835-54a8ff952994 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:55:44.074499 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4d377692-bf51-478c-9835-54a8ff952994 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: f550488c-401c-4f00-805b-fe62d75da9d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:55:44.134530 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4d377692-bf51-478c-9835-54a8ff952994 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.261892 Aug 31 15:55:44.137677 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 907/1712] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:55:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2265 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 15:55:44.146703 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-4c20470e-c8f5-4ae9-b7f0-40b29216af09 req-1b9e4371-7626-441f-9cae-43f4e102d1ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3054bf54-101d-4e7d-b62d-bcd53d30a4bb", "name": "network-vif-unplugged", "status": "completed", "tag": "032c6df0-61bb-4081-aa47-4e046311cc7a"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:44.161144 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-4c20470e-c8f5-4ae9-b7f0-40b29216af09 req-1b9e4371-7626-441f-9cae-43f4e102d1ee service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:44.161921 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-4c20470e-c8f5-4ae9-b7f0-40b29216af09 req-1b9e4371-7626-441f-9cae-43f4e102d1ee service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:44.162527 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-4c20470e-c8f5-4ae9-b7f0-40b29216af09 req-1b9e4371-7626-441f-9cae-43f4e102d1ee service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:44.198672 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-4c20470e-c8f5-4ae9-b7f0-40b29216af09 req-1b9e4371-7626-441f-9cae-43f4e102d1ee service nova] Creating event network-vif-unplugged:032c6df0-61bb-4081-aa47-4e046311cc7a for instance 3054bf54-101d-4e7d-b62d-bcd53d30a4bb on n-h1-833090-16 Aug 31 15:55:44.205207 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-4c20470e-c8f5-4ae9-b7f0-40b29216af09 req-1b9e4371-7626-441f-9cae-43f4e102d1ee service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065953 Aug 31 15:55:44.206436 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 908/1713] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:55:44.212890 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-d83acd25-9ae6-4ede-853f-3cf7e2332841 req-a3756585-2ede-4c18-935d-dc3a568e8c6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d065e0ee-199e-4e8b-99ca-5801d627ce65", "tag": "b13f13ce-7cbb-472a-bc2c-bb5104160fb0"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:44.223558 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-d83acd25-9ae6-4ede-853f-3cf7e2332841 req-a3756585-2ede-4c18-935d-dc3a568e8c6d service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:44.224400 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-d83acd25-9ae6-4ede-853f-3cf7e2332841 req-a3756585-2ede-4c18-935d-dc3a568e8c6d service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:44.225106 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-d83acd25-9ae6-4ede-853f-3cf7e2332841 req-a3756585-2ede-4c18-935d-dc3a568e8c6d service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:44.242955 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-d83acd25-9ae6-4ede-853f-3cf7e2332841 req-a3756585-2ede-4c18-935d-dc3a568e8c6d service nova] Creating event network-changed:b13f13ce-7cbb-472a-bc2c-bb5104160fb0 for instance d065e0ee-199e-4e8b-99ca-5801d627ce65 on n-h1-833090-16 Aug 31 15:55:44.256899 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [req-d83acd25-9ae6-4ede-853f-3cf7e2332841 req-a3756585-2ede-4c18-935d-dc3a568e8c6d service nova] Instance d065e0ee-199e-4e8b-99ca-5801d627ce65 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-833090-16', 'n-h1-833090-16'} {{(pid=128864) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 15:55:44.277179 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-d83acd25-9ae6-4ede-853f-3cf7e2332841 req-a3756585-2ede-4c18-935d-dc3a568e8c6d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069134 Aug 31 15:55:44.278075 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 909/1714] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:55:44.287420 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c076d796-daad-4b78-b914-5db68e12cf89 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:44.288140 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c076d796-daad-4b78-b914-5db68e12cf89 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:44.296990 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c076d796-daad-4b78-b914-5db68e12cf89 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:44.297479 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c076d796-daad-4b78-b914-5db68e12cf89 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:44.297907 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c076d796-daad-4b78-b914-5db68e12cf89 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:44.298634 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c076d796-daad-4b78-b914-5db68e12cf89 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:44.299084 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c076d796-daad-4b78-b914-5db68e12cf89 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:44.299501 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c076d796-daad-4b78-b914-5db68e12cf89 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:44.541305 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:55:44.902882 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9d563a24-416a-40ca-b360-d3270e5dd76a tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a19bb40252746379cf71a4f4b773b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b53c5033fb543adaeaae8980537d4e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:44.911105 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:55:44.922937 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9d563a24-416a-40ca-b360-d3270e5dd76a tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] 10.222.0.50 "GET /compute/v2.1/servers/bbf8b630-eb17-4c08-9347-531e5b63c829" status: 200 len: 1319 microversion: 2.1 time: 1.130017 Aug 31 15:55:44.926448 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 806/1715] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:43 2022] GET /compute/v2.1/servers/bbf8b630-eb17-4c08-9347-531e5b63c829 => generated 1319 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:44.950591 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-79d027d9-a5e8-4df2-b1a8-f469388c997a tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:44.952517 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-79d027d9-a5e8-4df2-b1a8-f469388c997a tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: f550488c-401c-4f00-805b-fe62d75da9d4] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:44.974570 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c076d796-daad-4b78-b914-5db68e12cf89 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:44.978436 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79d027d9-a5e8-4df2-b1a8-f469388c997a tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:44.981297 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79d027d9-a5e8-4df2-b1a8-f469388c997a tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:44.982287 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79d027d9-a5e8-4df2-b1a8-f469388c997a tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:44.984765 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79d027d9-a5e8-4df2-b1a8-f469388c997a tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:44.984919 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c076d796-daad-4b78-b914-5db68e12cf89 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:44.986530 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79d027d9-a5e8-4df2-b1a8-f469388c997a tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:44.987428 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79d027d9-a5e8-4df2-b1a8-f469388c997a tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:44.989840 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c076d796-daad-4b78-b914-5db68e12cf89 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:44.994120 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c076d796-daad-4b78-b914-5db68e12cf89 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a" status: 200 len: 1813 microversion: 2.25 time: 0.714762 Aug 31 15:55:44.996651 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 910/1716] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:55:44 2022] GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a => generated 1813 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:55:45.009790 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-c756098d-94d1-41e2-8cce-aefb39a518d1 req-84110608-f541-41f9-8f63-bf6a9c393645 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3054bf54-101d-4e7d-b62d-bcd53d30a4bb", "name": "network-vif-deleted", "tag": "032c6df0-61bb-4081-aa47-4e046311cc7a"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:45.029602 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-c756098d-94d1-41e2-8cce-aefb39a518d1 req-84110608-f541-41f9-8f63-bf6a9c393645 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:45.030119 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-c756098d-94d1-41e2-8cce-aefb39a518d1 req-84110608-f541-41f9-8f63-bf6a9c393645 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:45.030592 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-c756098d-94d1-41e2-8cce-aefb39a518d1 req-84110608-f541-41f9-8f63-bf6a9c393645 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:45.046715 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-c756098d-94d1-41e2-8cce-aefb39a518d1 req-84110608-f541-41f9-8f63-bf6a9c393645 service nova] Creating event network-vif-deleted:032c6df0-61bb-4081-aa47-4e046311cc7a for instance 3054bf54-101d-4e7d-b62d-bcd53d30a4bb on n-h1-833090-16 Aug 31 15:55:45.053963 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-c756098d-94d1-41e2-8cce-aefb39a518d1 req-84110608-f541-41f9-8f63-bf6a9c393645 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055021 Aug 31 15:55:45.055364 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 911/1717] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:55:45.064542 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8db84e13-4adc-4877-943e-e9127c3de674 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:45.065605 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8db84e13-4adc-4877-943e-e9127c3de674 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:45.074730 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8db84e13-4adc-4877-943e-e9127c3de674 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:45.075210 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8db84e13-4adc-4877-943e-e9127c3de674 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:45.075963 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8db84e13-4adc-4877-943e-e9127c3de674 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:45.076681 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8db84e13-4adc-4877-943e-e9127c3de674 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:45.077191 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8db84e13-4adc-4877-943e-e9127c3de674 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:45.077616 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8db84e13-4adc-4877-943e-e9127c3de674 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:45.685642 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-79d027d9-a5e8-4df2-b1a8-f469388c997a tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:45.706743 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-79d027d9-a5e8-4df2-b1a8-f469388c997a tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4" status: 200 len: 1211 microversion: 2.1 time: 0.778901 Aug 31 15:55:45.707686 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 807/1718] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:44 2022] GET /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4 => generated 1211 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:45.932220 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8db84e13-4adc-4877-943e-e9127c3de674 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:45.945016 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ee112881-e4c6-48c9-b0e6-c88b08bd37cb tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:45.946145 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ee112881-e4c6-48c9-b0e6-c88b08bd37cb tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] [instance: bbf8b630-eb17-4c08-9347-531e5b63c829] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:45.952617 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8db84e13-4adc-4877-943e-e9127c3de674 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65" status: 200 len: 1475 microversion: 2.1 time: 0.894130 Aug 31 15:55:45.966135 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 912/1719] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:45 2022] GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65 => generated 1475 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:45.975135 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee112881-e4c6-48c9-b0e6-c88b08bd37cb tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:46.009926 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee112881-e4c6-48c9-b0e6-c88b08bd37cb tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.035s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:46.010798 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee112881-e4c6-48c9-b0e6-c88b08bd37cb tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:46.012585 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee112881-e4c6-48c9-b0e6-c88b08bd37cb tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:46.022753 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e6fe4abf-3af2-4307-b09d-741afffeb494 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:46.024034 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee112881-e4c6-48c9-b0e6-c88b08bd37cb tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:46.024631 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e6fe4abf-3af2-4307-b09d-741afffeb494 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:46.025311 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee112881-e4c6-48c9-b0e6-c88b08bd37cb tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:46.037056 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6fe4abf-3af2-4307-b09d-741afffeb494 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:46.038276 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6fe4abf-3af2-4307-b09d-741afffeb494 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:46.040671 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6fe4abf-3af2-4307-b09d-741afffeb494 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:46.046689 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6fe4abf-3af2-4307-b09d-741afffeb494 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:46.049411 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6fe4abf-3af2-4307-b09d-741afffeb494 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:46.051861 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6fe4abf-3af2-4307-b09d-741afffeb494 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:46.081082 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=14 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:55:47.057767 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ee112881-e4c6-48c9-b0e6-c88b08bd37cb tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a19bb40252746379cf71a4f4b773b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b53c5033fb543adaeaae8980537d4e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:47.071586 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ee112881-e4c6-48c9-b0e6-c88b08bd37cb tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] 10.222.0.50 "GET /compute/v2.1/servers/bbf8b630-eb17-4c08-9347-531e5b63c829" status: 200 len: 1319 microversion: 2.1 time: 1.128707 Aug 31 15:55:47.084929 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 808/1720] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:45 2022] GET /compute/v2.1/servers/bbf8b630-eb17-4c08-9347-531e5b63c829 => generated 1319 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:55:47.091000 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fb248a03-84cc-40d6-8544-992a2d393b47 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:47.091892 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fb248a03-84cc-40d6-8544-992a2d393b47 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: f550488c-401c-4f00-805b-fe62d75da9d4] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:47.109930 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb248a03-84cc-40d6-8544-992a2d393b47 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:47.110229 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb248a03-84cc-40d6-8544-992a2d393b47 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:47.110804 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb248a03-84cc-40d6-8544-992a2d393b47 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:47.114760 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb248a03-84cc-40d6-8544-992a2d393b47 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:47.115797 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb248a03-84cc-40d6-8544-992a2d393b47 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:47.116227 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb248a03-84cc-40d6-8544-992a2d393b47 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:47.186920 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e6fe4abf-3af2-4307-b09d-741afffeb494 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:47.211864 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e6fe4abf-3af2-4307-b09d-741afffeb494 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:47.217492 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e6fe4abf-3af2-4307-b09d-741afffeb494 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:47.219983 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e6fe4abf-3af2-4307-b09d-741afffeb494 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a" status: 200 len: 1813 microversion: 2.25 time: 1.201709 Aug 31 15:55:47.222408 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 913/1721] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:55:46 2022] GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a => generated 1813 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 15:55:47.233901 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-55007106-db88-4be5-93ea-d58ef7112125 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:47.234833 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-55007106-db88-4be5-93ea-d58ef7112125 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:47.241372 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-55007106-db88-4be5-93ea-d58ef7112125 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:47.242754 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-55007106-db88-4be5-93ea-d58ef7112125 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:47.243510 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-55007106-db88-4be5-93ea-d58ef7112125 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:47.244413 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-55007106-db88-4be5-93ea-d58ef7112125 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:47.245142 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-55007106-db88-4be5-93ea-d58ef7112125 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:47.246345 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-55007106-db88-4be5-93ea-d58ef7112125 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:47.310905 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fb248a03-84cc-40d6-8544-992a2d393b47 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:47.328630 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fb248a03-84cc-40d6-8544-992a2d393b47 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4" status: 200 len: 1265 microversion: 2.1 time: 0.252214 Aug 31 15:55:47.330907 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 809/1722] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:47 2022] GET /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4 => generated 1265 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:47.746289 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-55007106-db88-4be5-93ea-d58ef7112125 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:47.756383 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-55007106-db88-4be5-93ea-d58ef7112125 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65" status: 200 len: 1473 microversion: 2.1 time: 0.528884 Aug 31 15:55:47.757372 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 914/1723] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:47 2022] GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65 => generated 1473 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:48.094133 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fc628416-f67e-47eb-8e11-c92dde8b07fe tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:48.096173 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fc628416-f67e-47eb-8e11-c92dde8b07fe tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] [instance: bbf8b630-eb17-4c08-9347-531e5b63c829] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:48.115256 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc628416-f67e-47eb-8e11-c92dde8b07fe tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:48.115740 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc628416-f67e-47eb-8e11-c92dde8b07fe tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:48.122077 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc628416-f67e-47eb-8e11-c92dde8b07fe tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:48.122865 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc628416-f67e-47eb-8e11-c92dde8b07fe tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:48.123335 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc628416-f67e-47eb-8e11-c92dde8b07fe tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:48.123756 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc628416-f67e-47eb-8e11-c92dde8b07fe tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:48.248662 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6fa12422-6b8c-4c4a-abb4-5047a4711797 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:48.249284 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6fa12422-6b8c-4c4a-abb4-5047a4711797 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:48.266847 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6fa12422-6b8c-4c4a-abb4-5047a4711797 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:48.267329 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6fa12422-6b8c-4c4a-abb4-5047a4711797 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:48.267828 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6fa12422-6b8c-4c4a-abb4-5047a4711797 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:48.268546 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6fa12422-6b8c-4c4a-abb4-5047a4711797 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:48.268996 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6fa12422-6b8c-4c4a-abb4-5047a4711797 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:48.269411 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6fa12422-6b8c-4c4a-abb4-5047a4711797 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:48.929869 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fc628416-f67e-47eb-8e11-c92dde8b07fe tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a19bb40252746379cf71a4f4b773b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b53c5033fb543adaeaae8980537d4e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:48.940373 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fc628416-f67e-47eb-8e11-c92dde8b07fe tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] 10.222.0.50 "GET /compute/v2.1/servers/bbf8b630-eb17-4c08-9347-531e5b63c829" status: 200 len: 1319 microversion: 2.1 time: 0.852296 Aug 31 15:55:48.948756 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 810/1724] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:48 2022] GET /compute/v2.1/servers/bbf8b630-eb17-4c08-9347-531e5b63c829 => generated 1319 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:48.975214 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-355970c4-a0e8-45ca-aa0d-80353f1a553b tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:48.976463 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-355970c4-a0e8-45ca-aa0d-80353f1a553b tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: f550488c-401c-4f00-805b-fe62d75da9d4] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:48.984430 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-355970c4-a0e8-45ca-aa0d-80353f1a553b tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:48.985162 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-355970c4-a0e8-45ca-aa0d-80353f1a553b tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:48.985786 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-355970c4-a0e8-45ca-aa0d-80353f1a553b tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:48.986878 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-355970c4-a0e8-45ca-aa0d-80353f1a553b tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:48.987506 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-355970c4-a0e8-45ca-aa0d-80353f1a553b tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:48.988099 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-355970c4-a0e8-45ca-aa0d-80353f1a553b tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:49.167059 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-355970c4-a0e8-45ca-aa0d-80353f1a553b tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:49.180395 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-355970c4-a0e8-45ca-aa0d-80353f1a553b tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4" status: 200 len: 1265 microversion: 2.1 time: 0.230242 Aug 31 15:55:49.185205 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 811/1725] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:48 2022] GET /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4 => generated 1265 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:49.191642 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6fa12422-6b8c-4c4a-abb4-5047a4711797 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:49.195889 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a1e9f8bd-8f35-47f0-b8f8-995d36afaf7d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:49.199953 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a1e9f8bd-8f35-47f0-b8f8-995d36afaf7d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:49.211727 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6fa12422-6b8c-4c4a-abb4-5047a4711797 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:49.213746 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1e9f8bd-8f35-47f0-b8f8-995d36afaf7d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:49.216504 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6fa12422-6b8c-4c4a-abb4-5047a4711797 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:49.216705 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1e9f8bd-8f35-47f0-b8f8-995d36afaf7d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:49.217156 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1e9f8bd-8f35-47f0-b8f8-995d36afaf7d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:49.217912 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1e9f8bd-8f35-47f0-b8f8-995d36afaf7d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:49.218493 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1e9f8bd-8f35-47f0-b8f8-995d36afaf7d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:49.218916 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1e9f8bd-8f35-47f0-b8f8-995d36afaf7d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:49.219743 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6fa12422-6b8c-4c4a-abb4-5047a4711797 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a" status: 200 len: 1813 microversion: 2.25 time: 0.976531 Aug 31 15:55:49.242867 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 915/1726] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:55:48 2022] GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a => generated 1813 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 15:55:49.481669 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a1e9f8bd-8f35-47f0-b8f8-995d36afaf7d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:49.494721 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a1e9f8bd-8f35-47f0-b8f8-995d36afaf7d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65" status: 200 len: 1470 microversion: 2.1 time: 0.308296 Aug 31 15:55:49.511245 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 812/1727] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:49 2022] GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65 => generated 1470 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:49.517456 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2ef4eef3-5f9e-4ea8-a068-af594ceccc6a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:49.518596 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2ef4eef3-5f9e-4ea8-a068-af594ceccc6a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:49.527882 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2ef4eef3-5f9e-4ea8-a068-af594ceccc6a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:49.528637 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2ef4eef3-5f9e-4ea8-a068-af594ceccc6a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:49.529257 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2ef4eef3-5f9e-4ea8-a068-af594ceccc6a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:49.530154 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2ef4eef3-5f9e-4ea8-a068-af594ceccc6a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:49.530922 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2ef4eef3-5f9e-4ea8-a068-af594ceccc6a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:49.531752 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2ef4eef3-5f9e-4ea8-a068-af594ceccc6a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:49.642699 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:55:49.728767 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2ef4eef3-5f9e-4ea8-a068-af594ceccc6a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "POST /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65/action" status: 202 len: 0 microversion: 2.1 time: 0.214918 Aug 31 15:55:49.729955 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 916/1728] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 15:55:49 2022] POST /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 15:55:49.740140 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c397cf68-dd3a-4a18-aa9c-96fab0e7fd64 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:49.741000 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c397cf68-dd3a-4a18-aa9c-96fab0e7fd64 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:49.755048 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c397cf68-dd3a-4a18-aa9c-96fab0e7fd64 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:49.756079 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c397cf68-dd3a-4a18-aa9c-96fab0e7fd64 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:49.757925 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c397cf68-dd3a-4a18-aa9c-96fab0e7fd64 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:49.760363 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c397cf68-dd3a-4a18-aa9c-96fab0e7fd64 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:49.763308 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c397cf68-dd3a-4a18-aa9c-96fab0e7fd64 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:49.764519 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c397cf68-dd3a-4a18-aa9c-96fab0e7fd64 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:49.972355 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-24d0b2b3-df98-4c14-b1c7-c650c76bbefe tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:49.972986 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-24d0b2b3-df98-4c14-b1c7-c650c76bbefe tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] [instance: bbf8b630-eb17-4c08-9347-531e5b63c829] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:49.993313 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-24d0b2b3-df98-4c14-b1c7-c650c76bbefe tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:49.993812 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-24d0b2b3-df98-4c14-b1c7-c650c76bbefe tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:50.000680 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-24d0b2b3-df98-4c14-b1c7-c650c76bbefe tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:50.001817 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-24d0b2b3-df98-4c14-b1c7-c650c76bbefe tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:50.002780 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-24d0b2b3-df98-4c14-b1c7-c650c76bbefe tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:50.004212 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-24d0b2b3-df98-4c14-b1c7-c650c76bbefe tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:50.348043 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c397cf68-dd3a-4a18-aa9c-96fab0e7fd64 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:50.368881 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c397cf68-dd3a-4a18-aa9c-96fab0e7fd64 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65" status: 200 len: 1469 microversion: 2.1 time: 0.634423 Aug 31 15:55:50.370973 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 813/1729] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:49 2022] GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65 => generated 1469 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:50.376381 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8ad7b43e-3643-4dbf-b636-350c547d9004 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:50.377128 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8ad7b43e-3643-4dbf-b636-350c547d9004 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: f550488c-401c-4f00-805b-fe62d75da9d4] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:50.397450 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ad7b43e-3643-4dbf-b636-350c547d9004 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:50.397947 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ad7b43e-3643-4dbf-b636-350c547d9004 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:50.398500 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ad7b43e-3643-4dbf-b636-350c547d9004 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:50.403969 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ad7b43e-3643-4dbf-b636-350c547d9004 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:50.404817 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ad7b43e-3643-4dbf-b636-350c547d9004 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:50.405455 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ad7b43e-3643-4dbf-b636-350c547d9004 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:50.717694 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-24d0b2b3-df98-4c14-b1c7-c650c76bbefe tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a19bb40252746379cf71a4f4b773b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b53c5033fb543adaeaae8980537d4e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:50.726523 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-24d0b2b3-df98-4c14-b1c7-c650c76bbefe tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] 10.222.0.50 "GET /compute/v2.1/servers/bbf8b630-eb17-4c08-9347-531e5b63c829" status: 200 len: 1319 microversion: 2.1 time: 0.759750 Aug 31 15:55:50.728103 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 917/1730] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:49 2022] GET /compute/v2.1/servers/bbf8b630-eb17-4c08-9347-531e5b63c829 => generated 1319 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:50.746023 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-bcc9d818-b9a1-44a8-b22c-198b72e508d8 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:50.746898 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-bcc9d818-b9a1-44a8-b22c-198b72e508d8 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:50.764222 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bcc9d818-b9a1-44a8-b22c-198b72e508d8 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:50.765017 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bcc9d818-b9a1-44a8-b22c-198b72e508d8 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:50.765939 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bcc9d818-b9a1-44a8-b22c-198b72e508d8 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:50.780443 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bcc9d818-b9a1-44a8-b22c-198b72e508d8 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:50.781206 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bcc9d818-b9a1-44a8-b22c-198b72e508d8 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:50.781815 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bcc9d818-b9a1-44a8-b22c-198b72e508d8 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:50.983711 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8ad7b43e-3643-4dbf-b636-350c547d9004 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:51.000622 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8ad7b43e-3643-4dbf-b636-350c547d9004 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4" status: 200 len: 1307 microversion: 2.1 time: 0.628430 Aug 31 15:55:51.001462 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 814/1731] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:50 2022] GET /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4 => generated 1307 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:51.167135 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-a5e33390-57be-40e9-979d-7ce1c29a74d2 req-16f19ff9-acf3-43fa-9712-7b01b17a1095 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbf8b630-eb17-4c08-9347-531e5b63c829", "name": "network-vif-plugged", "status": "completed", "tag": "baa64b98-0f72-4ddb-9970-82c581c73b80"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:51.177543 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a5e33390-57be-40e9-979d-7ce1c29a74d2 req-16f19ff9-acf3-43fa-9712-7b01b17a1095 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:51.178318 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a5e33390-57be-40e9-979d-7ce1c29a74d2 req-16f19ff9-acf3-43fa-9712-7b01b17a1095 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:51.178927 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a5e33390-57be-40e9-979d-7ce1c29a74d2 req-16f19ff9-acf3-43fa-9712-7b01b17a1095 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:51.206646 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-a5e33390-57be-40e9-979d-7ce1c29a74d2 req-16f19ff9-acf3-43fa-9712-7b01b17a1095 service nova] Creating event network-vif-plugged:baa64b98-0f72-4ddb-9970-82c581c73b80 for instance bbf8b630-eb17-4c08-9347-531e5b63c829 on n-h2-833090-16 Aug 31 15:55:51.232818 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-a5e33390-57be-40e9-979d-7ce1c29a74d2 req-16f19ff9-acf3-43fa-9712-7b01b17a1095 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069617 Aug 31 15:55:51.234146 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 815/1732] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:55:51.319236 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-bcc9d818-b9a1-44a8-b22c-198b72e508d8 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:51.329127 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-bcc9d818-b9a1-44a8-b22c-198b72e508d8 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:51.330586 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-bcc9d818-b9a1-44a8-b22c-198b72e508d8 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:51.331761 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-bcc9d818-b9a1-44a8-b22c-198b72e508d8 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a" status: 200 len: 1813 microversion: 2.25 time: 0.602483 Aug 31 15:55:51.332466 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 918/1733] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:55:50 2022] GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a => generated 1813 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:55:51.393450 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3cf4c09c-d32e-4f5f-aac8-f25d0deca703 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:51.395463 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3cf4c09c-d32e-4f5f-aac8-f25d0deca703 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:51.402567 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3cf4c09c-d32e-4f5f-aac8-f25d0deca703 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:51.403726 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3cf4c09c-d32e-4f5f-aac8-f25d0deca703 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:51.404323 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3cf4c09c-d32e-4f5f-aac8-f25d0deca703 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:51.405224 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3cf4c09c-d32e-4f5f-aac8-f25d0deca703 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:51.406203 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3cf4c09c-d32e-4f5f-aac8-f25d0deca703 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:51.406789 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3cf4c09c-d32e-4f5f-aac8-f25d0deca703 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:51.751003 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8a8df693-61bf-4b6a-b4e5-245faee72b3f tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:51.753214 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8a8df693-61bf-4b6a-b4e5-245faee72b3f tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] [instance: bbf8b630-eb17-4c08-9347-531e5b63c829] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:51.757657 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:55:51.763133 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8a8df693-61bf-4b6a-b4e5-245faee72b3f tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:51.763954 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8a8df693-61bf-4b6a-b4e5-245faee72b3f tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:51.764609 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8a8df693-61bf-4b6a-b4e5-245faee72b3f tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:51.766001 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8a8df693-61bf-4b6a-b4e5-245faee72b3f tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:51.766689 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8a8df693-61bf-4b6a-b4e5-245faee72b3f tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:51.767375 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8a8df693-61bf-4b6a-b4e5-245faee72b3f tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:52.330717 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3cf4c09c-d32e-4f5f-aac8-f25d0deca703 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:52.379958 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8a8df693-61bf-4b6a-b4e5-245faee72b3f tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a19bb40252746379cf71a4f4b773b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b53c5033fb543adaeaae8980537d4e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:52.391460 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3cf4c09c-d32e-4f5f-aac8-f25d0deca703 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65" status: 200 len: 1469 microversion: 2.1 time: 1.002290 Aug 31 15:55:52.397693 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8a8df693-61bf-4b6a-b4e5-245faee72b3f tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] 10.222.0.50 "GET /compute/v2.1/servers/bbf8b630-eb17-4c08-9347-531e5b63c829" status: 200 len: 1319 microversion: 2.1 time: 0.652701 Aug 31 15:55:52.400621 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 919/1734] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:51 2022] GET /compute/v2.1/servers/bbf8b630-eb17-4c08-9347-531e5b63c829 => generated 1319 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:52.410586 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 816/1735] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:51 2022] GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65 => generated 1469 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:52.413233 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ed6a9e29-ab86-4d90-aa0e-8fdee9b84cfb tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:52.414082 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ed6a9e29-ab86-4d90-aa0e-8fdee9b84cfb tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: f550488c-401c-4f00-805b-fe62d75da9d4] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:52.422517 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ed6a9e29-ab86-4d90-aa0e-8fdee9b84cfb tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:52.423435 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ed6a9e29-ab86-4d90-aa0e-8fdee9b84cfb tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:52.423934 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b67c600b-06be-45f3-82cc-a5a34450ca8c tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:52.424405 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ed6a9e29-ab86-4d90-aa0e-8fdee9b84cfb tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:52.424636 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b67c600b-06be-45f3-82cc-a5a34450ca8c tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:52.425623 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ed6a9e29-ab86-4d90-aa0e-8fdee9b84cfb tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:52.426497 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ed6a9e29-ab86-4d90-aa0e-8fdee9b84cfb tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:52.427856 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ed6a9e29-ab86-4d90-aa0e-8fdee9b84cfb tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:52.430542 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:55:52.432600 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b67c600b-06be-45f3-82cc-a5a34450ca8c tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:52.433469 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b67c600b-06be-45f3-82cc-a5a34450ca8c tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:52.434148 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b67c600b-06be-45f3-82cc-a5a34450ca8c tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:52.435091 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b67c600b-06be-45f3-82cc-a5a34450ca8c tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:52.435836 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b67c600b-06be-45f3-82cc-a5a34450ca8c tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:52.436607 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b67c600b-06be-45f3-82cc-a5a34450ca8c tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:53.127918 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ed6a9e29-ab86-4d90-aa0e-8fdee9b84cfb tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:53.139150 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ed6a9e29-ab86-4d90-aa0e-8fdee9b84cfb tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4" status: 200 len: 1307 microversion: 2.1 time: 0.737077 Aug 31 15:55:53.150159 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 920/1736] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:52 2022] GET /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4 => generated 1307 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:53.150159 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-d172800a-59c6-4411-845b-4ba90c12d5f4 req-82261c58-8ddd-44c1-83b9-06b224c0dff0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f550488c-401c-4f00-805b-fe62d75da9d4", "tag": "0245a049-7e50-451b-9002-cd4e13a97fa5"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:53.160103 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-d172800a-59c6-4411-845b-4ba90c12d5f4 req-82261c58-8ddd-44c1-83b9-06b224c0dff0 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:53.160581 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-d172800a-59c6-4411-845b-4ba90c12d5f4 req-82261c58-8ddd-44c1-83b9-06b224c0dff0 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:53.161629 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-d172800a-59c6-4411-845b-4ba90c12d5f4 req-82261c58-8ddd-44c1-83b9-06b224c0dff0 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:53.165442 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b67c600b-06be-45f3-82cc-a5a34450ca8c tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:53.180450 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b67c600b-06be-45f3-82cc-a5a34450ca8c tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:53.193153 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b67c600b-06be-45f3-82cc-a5a34450ca8c tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:53.199857 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b67c600b-06be-45f3-82cc-a5a34450ca8c tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a" status: 200 len: 1813 microversion: 2.25 time: 0.788047 Aug 31 15:55:53.200472 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 817/1737] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:55:52 2022] GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a => generated 1813 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:55:53.222751 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-d172800a-59c6-4411-845b-4ba90c12d5f4 req-82261c58-8ddd-44c1-83b9-06b224c0dff0 service nova] Creating event network-changed:0245a049-7e50-451b-9002-cd4e13a97fa5 for instance f550488c-401c-4f00-805b-fe62d75da9d4 on n-h1-833090-16 Aug 31 15:55:53.228756 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-d172800a-59c6-4411-845b-4ba90c12d5f4 req-82261c58-8ddd-44c1-83b9-06b224c0dff0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086795 Aug 31 15:55:53.230397 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 921/1738] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:55:53.263539 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-1bda2f0a-9b69-4643-8a42-5f939092b451 req-15a02ab4-5670-4725-9ab8-84a1e0dd9c1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d065e0ee-199e-4e8b-99ca-5801d627ce65", "name": "network-vif-plugged", "status": "completed", "tag": "b13f13ce-7cbb-472a-bc2c-bb5104160fb0"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:53.279002 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-1bda2f0a-9b69-4643-8a42-5f939092b451 req-15a02ab4-5670-4725-9ab8-84a1e0dd9c1a service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:53.280101 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-1bda2f0a-9b69-4643-8a42-5f939092b451 req-15a02ab4-5670-4725-9ab8-84a1e0dd9c1a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:53.280743 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-1bda2f0a-9b69-4643-8a42-5f939092b451 req-15a02ab4-5670-4725-9ab8-84a1e0dd9c1a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:53.328328 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-1bda2f0a-9b69-4643-8a42-5f939092b451 req-15a02ab4-5670-4725-9ab8-84a1e0dd9c1a service nova] Creating event network-vif-plugged:b13f13ce-7cbb-472a-bc2c-bb5104160fb0 for instance d065e0ee-199e-4e8b-99ca-5801d627ce65 on n-h1-833090-16 Aug 31 15:55:53.346577 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [req-1bda2f0a-9b69-4643-8a42-5f939092b451 req-15a02ab4-5670-4725-9ab8-84a1e0dd9c1a service nova] Instance d065e0ee-199e-4e8b-99ca-5801d627ce65 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-833090-16', 'n-h1-833090-16'} {{(pid=128863) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 15:55:53.375362 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-1bda2f0a-9b69-4643-8a42-5f939092b451 req-15a02ab4-5670-4725-9ab8-84a1e0dd9c1a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117459 Aug 31 15:55:53.377742 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 818/1739] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:55:53.415794 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fde6f52b-7d50-4d3f-a979-ed84fcf3394a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:53.418231 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fde6f52b-7d50-4d3f-a979-ed84fcf3394a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:53.426302 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6c189462-7a80-47cc-9f5b-01e6cfc19211 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:53.427288 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6c189462-7a80-47cc-9f5b-01e6cfc19211 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] [instance: bbf8b630-eb17-4c08-9347-531e5b63c829] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:53.448980 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c189462-7a80-47cc-9f5b-01e6cfc19211 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:53.453865 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c189462-7a80-47cc-9f5b-01e6cfc19211 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:53.454317 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fde6f52b-7d50-4d3f-a979-ed84fcf3394a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:53.455736 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c189462-7a80-47cc-9f5b-01e6cfc19211 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:53.456337 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fde6f52b-7d50-4d3f-a979-ed84fcf3394a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:53.456971 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fde6f52b-7d50-4d3f-a979-ed84fcf3394a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:53.457911 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c189462-7a80-47cc-9f5b-01e6cfc19211 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:53.458847 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fde6f52b-7d50-4d3f-a979-ed84fcf3394a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:53.459510 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c189462-7a80-47cc-9f5b-01e6cfc19211 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:53.460200 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fde6f52b-7d50-4d3f-a979-ed84fcf3394a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:53.460934 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c189462-7a80-47cc-9f5b-01e6cfc19211 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:53.461540 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fde6f52b-7d50-4d3f-a979-ed84fcf3394a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:53.997806 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:55:54.064201 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=6 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:55:54.066206 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6c189462-7a80-47cc-9f5b-01e6cfc19211 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a19bb40252746379cf71a4f4b773b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b53c5033fb543adaeaae8980537d4e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:54.081018 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6c189462-7a80-47cc-9f5b-01e6cfc19211 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] 10.222.0.50 "GET /compute/v2.1/servers/bbf8b630-eb17-4c08-9347-531e5b63c829" status: 200 len: 1319 microversion: 2.1 time: 0.660955 Aug 31 15:55:54.098487 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 819/1740] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:53 2022] GET /compute/v2.1/servers/bbf8b630-eb17-4c08-9347-531e5b63c829 => generated 1319 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:55:54.128004 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-fde6f52b-7d50-4d3f-a979-ed84fcf3394a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:54.138273 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fde6f52b-7d50-4d3f-a979-ed84fcf3394a tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65" status: 200 len: 1469 microversion: 2.1 time: 0.728379 Aug 31 15:55:54.138864 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 922/1741] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:53 2022] GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65 => generated 1469 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:54.161148 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bcbf03ca-75cd-4ffa-b591-e72b6fb4835e tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:54.161761 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bcbf03ca-75cd-4ffa-b591-e72b6fb4835e tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: f550488c-401c-4f00-805b-fe62d75da9d4] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:54.168628 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bcbf03ca-75cd-4ffa-b591-e72b6fb4835e tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:54.173340 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bcbf03ca-75cd-4ffa-b591-e72b6fb4835e tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:54.179820 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bcbf03ca-75cd-4ffa-b591-e72b6fb4835e tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:54.180907 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bcbf03ca-75cd-4ffa-b591-e72b6fb4835e tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:54.181749 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bcbf03ca-75cd-4ffa-b591-e72b6fb4835e tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:54.182629 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bcbf03ca-75cd-4ffa-b591-e72b6fb4835e tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:54.227161 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-39d235bf-ad02-4ba3-9e41-9e7a84f3a1ce tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:54.231082 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-39d235bf-ad02-4ba3-9e41-9e7a84f3a1ce tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:54.250417 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-39d235bf-ad02-4ba3-9e41-9e7a84f3a1ce tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:54.257768 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-39d235bf-ad02-4ba3-9e41-9e7a84f3a1ce tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:54.262477 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-39d235bf-ad02-4ba3-9e41-9e7a84f3a1ce tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:54.263342 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-39d235bf-ad02-4ba3-9e41-9e7a84f3a1ce tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:54.263828 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-39d235bf-ad02-4ba3-9e41-9e7a84f3a1ce tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:54.264263 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-39d235bf-ad02-4ba3-9e41-9e7a84f3a1ce tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:55.051308 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bcbf03ca-75cd-4ffa-b591-e72b6fb4835e tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:55.057570 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-39d235bf-ad02-4ba3-9e41-9e7a84f3a1ce tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:55.094487 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bcbf03ca-75cd-4ffa-b591-e72b6fb4835e tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4" status: 200 len: 1307 microversion: 2.1 time: 0.936842 Aug 31 15:55:55.096231 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 820/1742] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:54 2022] GET /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4 => generated 1307 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:55.102155 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dc49ce70-5d8b-480e-a41c-03271b6ffb27 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:55.102824 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-39d235bf-ad02-4ba3-9e41-9e7a84f3a1ce tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:55.103447 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dc49ce70-5d8b-480e-a41c-03271b6ffb27 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 11bf6774-dc05-481c-a9f9-29c2ebd4531f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:55.105331 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-39d235bf-ad02-4ba3-9e41-9e7a84f3a1ce tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:55.110901 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc49ce70-5d8b-480e-a41c-03271b6ffb27 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:55.114666 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-39d235bf-ad02-4ba3-9e41-9e7a84f3a1ce tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a" status: 200 len: 1813 microversion: 2.25 time: 0.887654 Aug 31 15:55:55.126119 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 923/1743] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:55:54 2022] GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a => generated 1813 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 15:55:55.141632 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc49ce70-5d8b-480e-a41c-03271b6ffb27 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:55.142227 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc49ce70-5d8b-480e-a41c-03271b6ffb27 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:55.143082 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc49ce70-5d8b-480e-a41c-03271b6ffb27 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:55.144699 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc49ce70-5d8b-480e-a41c-03271b6ffb27 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:55.145418 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc49ce70-5d8b-480e-a41c-03271b6ffb27 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:55.145770 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0f0a91dc-ec6b-4bd6-b6e2-89f8d8591276 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:55.160246 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0f0a91dc-ec6b-4bd6-b6e2-89f8d8591276 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] [instance: bbf8b630-eb17-4c08-9347-531e5b63c829] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:55.196425 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0f0a91dc-ec6b-4bd6-b6e2-89f8d8591276 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:55.197057 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0f0a91dc-ec6b-4bd6-b6e2-89f8d8591276 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:55.197752 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0f0a91dc-ec6b-4bd6-b6e2-89f8d8591276 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:55.198681 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0f0a91dc-ec6b-4bd6-b6e2-89f8d8591276 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:55.199299 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0f0a91dc-ec6b-4bd6-b6e2-89f8d8591276 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:55.199927 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0f0a91dc-ec6b-4bd6-b6e2-89f8d8591276 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:55.239840 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dc49ce70-5d8b-480e-a41c-03271b6ffb27 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 11bf6774-dc05-481c-a9f9-29c2ebd4531f] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:55:55.469884 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dc49ce70-5d8b-480e-a41c-03271b6ffb27 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "DELETE /compute/v2.1/servers/11bf6774-dc05-481c-a9f9-29c2ebd4531f" status: 204 len: 0 microversion: 2.1 time: 0.370689 Aug 31 15:55:55.470642 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 821/1744] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:55:55 2022] DELETE /compute/v2.1/servers/11bf6774-dc05-481c-a9f9-29c2ebd4531f => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:55:55.500440 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-82b5b804-b75d-4ed9-aebe-f1836155786c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:55.501457 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-82b5b804-b75d-4ed9-aebe-f1836155786c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:55.513146 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-82b5b804-b75d-4ed9-aebe-f1836155786c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:55.517149 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-82b5b804-b75d-4ed9-aebe-f1836155786c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:55.519011 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-82b5b804-b75d-4ed9-aebe-f1836155786c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:55.519970 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-82b5b804-b75d-4ed9-aebe-f1836155786c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:55.520771 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-82b5b804-b75d-4ed9-aebe-f1836155786c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:55.521365 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-82b5b804-b75d-4ed9-aebe-f1836155786c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:55.857736 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0f0a91dc-ec6b-4bd6-b6e2-89f8d8591276 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a19bb40252746379cf71a4f4b773b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b53c5033fb543adaeaae8980537d4e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:55.868925 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0f0a91dc-ec6b-4bd6-b6e2-89f8d8591276 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] 10.222.0.50 "GET /compute/v2.1/servers/bbf8b630-eb17-4c08-9347-531e5b63c829" status: 200 len: 1469 microversion: 2.1 time: 0.751582 Aug 31 15:55:55.871269 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 924/1745] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:55 2022] GET /compute/v2.1/servers/bbf8b630-eb17-4c08-9347-531e5b63c829 => generated 1469 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:55.876240 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9f6c1ae0-bbbe-42f9-a8af-ddd722b945a1 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:55.884606 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9f6c1ae0-bbbe-42f9-a8af-ddd722b945a1 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 11bf6774-dc05-481c-a9f9-29c2ebd4531f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:55.897365 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9f6c1ae0-bbbe-42f9-a8af-ddd722b945a1 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:55.897855 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9f6c1ae0-bbbe-42f9-a8af-ddd722b945a1 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:55.902399 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9f6c1ae0-bbbe-42f9-a8af-ddd722b945a1 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:55.903427 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9f6c1ae0-bbbe-42f9-a8af-ddd722b945a1 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:55.903891 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9f6c1ae0-bbbe-42f9-a8af-ddd722b945a1 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:55.904314 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9f6c1ae0-bbbe-42f9-a8af-ddd722b945a1 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:55.940667 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-82b5b804-b75d-4ed9-aebe-f1836155786c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:55.944121 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:55:55.957871 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-82b5b804-b75d-4ed9-aebe-f1836155786c tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65" status: 200 len: 1469 microversion: 2.1 time: 0.483244 Aug 31 15:55:55.960472 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 822/1746] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:55 2022] GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65 => generated 1469 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:56.488081 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a578a1ba-68df-40cf-81b7-c3831300b748 tempest-DeleteServersAdminTestJSON-1745327615 tempest-DeleteServersAdminTestJSON-1745327615-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:56.488746 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a578a1ba-68df-40cf-81b7-c3831300b748 tempest-DeleteServersAdminTestJSON-1745327615 tempest-DeleteServersAdminTestJSON-1745327615-project-admin] [instance: bbf8b630-eb17-4c08-9347-531e5b63c829] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:56.497989 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a578a1ba-68df-40cf-81b7-c3831300b748 tempest-DeleteServersAdminTestJSON-1745327615 tempest-DeleteServersAdminTestJSON-1745327615-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:56.502830 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a578a1ba-68df-40cf-81b7-c3831300b748 tempest-DeleteServersAdminTestJSON-1745327615 tempest-DeleteServersAdminTestJSON-1745327615-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:56.503626 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a578a1ba-68df-40cf-81b7-c3831300b748 tempest-DeleteServersAdminTestJSON-1745327615 tempest-DeleteServersAdminTestJSON-1745327615-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:56.505386 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a578a1ba-68df-40cf-81b7-c3831300b748 tempest-DeleteServersAdminTestJSON-1745327615 tempest-DeleteServersAdminTestJSON-1745327615-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:56.507015 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a578a1ba-68df-40cf-81b7-c3831300b748 tempest-DeleteServersAdminTestJSON-1745327615 tempest-DeleteServersAdminTestJSON-1745327615-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:56.509013 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a578a1ba-68df-40cf-81b7-c3831300b748 tempest-DeleteServersAdminTestJSON-1745327615 tempest-DeleteServersAdminTestJSON-1745327615-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:56.575526 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a578a1ba-68df-40cf-81b7-c3831300b748 tempest-DeleteServersAdminTestJSON-1745327615 tempest-DeleteServersAdminTestJSON-1745327615-project-admin] [instance: bbf8b630-eb17-4c08-9347-531e5b63c829] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:55:56.758163 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a578a1ba-68df-40cf-81b7-c3831300b748 tempest-DeleteServersAdminTestJSON-1745327615 tempest-DeleteServersAdminTestJSON-1745327615-project-admin] 10.222.0.50 "DELETE /compute/v2.1/servers/bbf8b630-eb17-4c08-9347-531e5b63c829" status: 204 len: 0 microversion: 2.1 time: 0.796158 Aug 31 15:55:56.758806 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 823/1747] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:55:55 2022] DELETE /compute/v2.1/servers/bbf8b630-eb17-4c08-9347-531e5b63c829 => generated 0 bytes in 798 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:55:56.765209 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-59deb7a5-953c-4159-abef-c353770dfd24 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:56.774787 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-59deb7a5-953c-4159-abef-c353770dfd24 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: f550488c-401c-4f00-805b-fe62d75da9d4] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:56.781338 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-59deb7a5-953c-4159-abef-c353770dfd24 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:56.781818 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-59deb7a5-953c-4159-abef-c353770dfd24 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:56.782285 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-59deb7a5-953c-4159-abef-c353770dfd24 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:56.783003 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-59deb7a5-953c-4159-abef-c353770dfd24 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:56.783445 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-59deb7a5-953c-4159-abef-c353770dfd24 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:56.783860 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-59deb7a5-953c-4159-abef-c353770dfd24 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:57.054492 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9f6c1ae0-bbbe-42f9-a8af-ddd722b945a1 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:57.066165 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9f6c1ae0-bbbe-42f9-a8af-ddd722b945a1 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/11bf6774-dc05-481c-a9f9-29c2ebd4531f" status: 200 len: 1555 microversion: 2.1 time: 1.193597 Aug 31 15:55:57.070934 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 925/1748] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:55 2022] GET /compute/v2.1/servers/11bf6774-dc05-481c-a9f9-29c2ebd4531f => generated 1555 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:57.088153 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-319a4907-9a37-485e-8a44-07e60bb11cde tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:57.088819 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-319a4907-9a37-485e-8a44-07e60bb11cde tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:57.097152 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-319a4907-9a37-485e-8a44-07e60bb11cde tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:57.097647 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-319a4907-9a37-485e-8a44-07e60bb11cde tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:57.098134 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-319a4907-9a37-485e-8a44-07e60bb11cde tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:57.099442 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-319a4907-9a37-485e-8a44-07e60bb11cde tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:57.099442 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-319a4907-9a37-485e-8a44-07e60bb11cde tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:57.099678 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-319a4907-9a37-485e-8a44-07e60bb11cde tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:57.338554 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-59deb7a5-953c-4159-abef-c353770dfd24 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:57.356961 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-59deb7a5-953c-4159-abef-c353770dfd24 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4" status: 200 len: 1307 microversion: 2.1 time: 0.596484 Aug 31 15:55:57.358359 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 824/1749] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:56 2022] GET /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4 => generated 1307 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:57.364081 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-98b82e5e-15ff-42e0-9bb9-02f9a3490001 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:57.365171 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-98b82e5e-15ff-42e0-9bb9-02f9a3490001 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] [instance: bbf8b630-eb17-4c08-9347-531e5b63c829] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:57.388193 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98b82e5e-15ff-42e0-9bb9-02f9a3490001 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:57.390935 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98b82e5e-15ff-42e0-9bb9-02f9a3490001 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:57.391603 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98b82e5e-15ff-42e0-9bb9-02f9a3490001 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:57.394584 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98b82e5e-15ff-42e0-9bb9-02f9a3490001 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:57.396309 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98b82e5e-15ff-42e0-9bb9-02f9a3490001 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:57.397853 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98b82e5e-15ff-42e0-9bb9-02f9a3490001 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:57.827030 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-319a4907-9a37-485e-8a44-07e60bb11cde tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:57.840898 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-319a4907-9a37-485e-8a44-07e60bb11cde tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:57.842691 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-319a4907-9a37-485e-8a44-07e60bb11cde tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:57.844146 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-319a4907-9a37-485e-8a44-07e60bb11cde tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a" status: 200 len: 1813 microversion: 2.25 time: 0.772120 Aug 31 15:55:57.844931 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 926/1750] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:55:57 2022] GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a => generated 1813 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:55:57.866935 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-39dd6adc-7ffe-4748-ad9d-89eabf7848e7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:57.867785 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-39dd6adc-7ffe-4748-ad9d-89eabf7848e7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:57.875112 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-39dd6adc-7ffe-4748-ad9d-89eabf7848e7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:57.876007 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-39dd6adc-7ffe-4748-ad9d-89eabf7848e7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:57.876655 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-39dd6adc-7ffe-4748-ad9d-89eabf7848e7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:57.877579 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-39dd6adc-7ffe-4748-ad9d-89eabf7848e7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:57.878387 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-39dd6adc-7ffe-4748-ad9d-89eabf7848e7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:57.879319 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-39dd6adc-7ffe-4748-ad9d-89eabf7848e7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:57.955304 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-98b82e5e-15ff-42e0-9bb9-02f9a3490001 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a19bb40252746379cf71a4f4b773b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b53c5033fb543adaeaae8980537d4e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:57.987247 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-98b82e5e-15ff-42e0-9bb9-02f9a3490001 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] 10.222.0.50 "GET /compute/v2.1/servers/bbf8b630-eb17-4c08-9347-531e5b63c829" status: 200 len: 1475 microversion: 2.1 time: 0.627471 Aug 31 15:55:57.995125 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 825/1751] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:57 2022] GET /compute/v2.1/servers/bbf8b630-eb17-4c08-9347-531e5b63c829 => generated 1475 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:58.358569 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-39dd6adc-7ffe-4748-ad9d-89eabf7848e7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:58.382391 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-39dd6adc-7ffe-4748-ad9d-89eabf7848e7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65" status: 200 len: 1469 microversion: 2.1 time: 0.518677 Aug 31 15:55:58.385462 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 927/1752] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:57 2022] GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65 => generated 1469 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:58.401457 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-479cb77e-f4f1-47d1-8c10-a09d69557a64 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:58.406437 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-479cb77e-f4f1-47d1-8c10-a09d69557a64 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 11bf6774-dc05-481c-a9f9-29c2ebd4531f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:58.424670 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-479cb77e-f4f1-47d1-8c10-a09d69557a64 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:58.429369 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-479cb77e-f4f1-47d1-8c10-a09d69557a64 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:58.433369 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-479cb77e-f4f1-47d1-8c10-a09d69557a64 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:58.437234 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-479cb77e-f4f1-47d1-8c10-a09d69557a64 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:58.437908 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-479cb77e-f4f1-47d1-8c10-a09d69557a64 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:58.443744 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-479cb77e-f4f1-47d1-8c10-a09d69557a64 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:58.504838 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-217dbbe4-37a8-40db-b966-91f9020dbb35 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Action: 'create', calling method: .version_select at 0x7fbb46672430>, body: {"keypair": {"name": "tempest-keypair-1358575584", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH3FckqjdHp9vsXZ/2Mq/vBSE5Pf955B8T/iEz7QAmdoYBqHnbuEuw1bvFABIbjsL9OE+ASNqIAQOpWKslBeWIkHT/pbKLJcTNlNI3rzsvoxML8zLBdkC4YadxeyEgXmtw=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:55:58.558398 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-217dbbe4-37a8-40db-b966-91f9020dbb35 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Getting quotas for project e773dad0890c4048a0f0152e05fe8d77. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:55:58.566248 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-217dbbe4-37a8-40db-b966-91f9020dbb35 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Getting quotas for user e8f2bc800ceb41349e8c182d526d4d8e and project e773dad0890c4048a0f0152e05fe8d77. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:55:58.616638 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-217dbbe4-37a8-40db-b966-91f9020dbb35 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.620028 Aug 31 15:55:58.617868 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 826/1753] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 31 15:55:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:55:58.623644 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b0ee9494-b98d-4e36-94a7-4f96ef4b4d4d tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:58.625174 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b0ee9494-b98d-4e36-94a7-4f96ef4b4d4d tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: f550488c-401c-4f00-805b-fe62d75da9d4] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:58.633993 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0ee9494-b98d-4e36-94a7-4f96ef4b4d4d tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:58.635423 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0ee9494-b98d-4e36-94a7-4f96ef4b4d4d tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:58.636089 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0ee9494-b98d-4e36-94a7-4f96ef4b4d4d tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:58.637336 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0ee9494-b98d-4e36-94a7-4f96ef4b4d4d tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:58.638019 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0ee9494-b98d-4e36-94a7-4f96ef4b4d4d tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:58.638859 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0ee9494-b98d-4e36-94a7-4f96ef4b4d4d tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:59.044154 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-479cb77e-f4f1-47d1-8c10-a09d69557a64 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:59.059627 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-479cb77e-f4f1-47d1-8c10-a09d69557a64 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/11bf6774-dc05-481c-a9f9-29c2ebd4531f" status: 200 len: 1555 microversion: 2.1 time: 0.671754 Aug 31 15:55:59.060230 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 928/1754] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:58 2022] GET /compute/v2.1/servers/11bf6774-dc05-481c-a9f9-29c2ebd4531f => generated 1555 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:59.081764 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4773f584-b5b5-449b-9501-5a7ec44f50a8 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:59.082421 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4773f584-b5b5-449b-9501-5a7ec44f50a8 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:59.120944 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4773f584-b5b5-449b-9501-5a7ec44f50a8 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:59.121644 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4773f584-b5b5-449b-9501-5a7ec44f50a8 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:59.122122 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4773f584-b5b5-449b-9501-5a7ec44f50a8 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:59.122932 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4773f584-b5b5-449b-9501-5a7ec44f50a8 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:59.123391 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4773f584-b5b5-449b-9501-5a7ec44f50a8 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:59.125950 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4773f584-b5b5-449b-9501-5a7ec44f50a8 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:59.149242 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b0ee9494-b98d-4e36-94a7-4f96ef4b4d4d tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:55:59.157945 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b0ee9494-b98d-4e36-94a7-4f96ef4b4d4d tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4" status: 200 len: 1307 microversion: 2.1 time: 0.537994 Aug 31 15:55:59.170627 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 827/1755] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:58 2022] GET /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4 => generated 1307 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:55:59.186735 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-74f76e1d-916c-49f7-a440-8390bbb93bfe tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:55:59.187846 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-74f76e1d-916c-49f7-a440-8390bbb93bfe tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] [instance: bbf8b630-eb17-4c08-9347-531e5b63c829] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:55:59.197806 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-74f76e1d-916c-49f7-a440-8390bbb93bfe tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:59.198602 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-74f76e1d-916c-49f7-a440-8390bbb93bfe tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:59.199221 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-74f76e1d-916c-49f7-a440-8390bbb93bfe tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:55:59.200144 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-74f76e1d-916c-49f7-a440-8390bbb93bfe tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:55:59.200890 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-74f76e1d-916c-49f7-a440-8390bbb93bfe tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:55:59.201475 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-74f76e1d-916c-49f7-a440-8390bbb93bfe tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:00.219860 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4773f584-b5b5-449b-9501-5a7ec44f50a8 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:00.241773 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4773f584-b5b5-449b-9501-5a7ec44f50a8 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:00.247169 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4773f584-b5b5-449b-9501-5a7ec44f50a8 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:00.248968 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4773f584-b5b5-449b-9501-5a7ec44f50a8 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a" status: 200 len: 1803 microversion: 2.25 time: 1.177326 Aug 31 15:56:00.249819 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 929/1756] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:55:59 2022] GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a => generated 1803 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:56:00.260727 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-753bbefe-3487-42e2-8a74-8b69bdc46f05 req-d4de04e4-3065-4b53-9f15-c8cd9e36c98a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d065e0ee-199e-4e8b-99ca-5801d627ce65", "name": "network-vif-unplugged", "status": "completed", "tag": "b13f13ce-7cbb-472a-bc2c-bb5104160fb0"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:00.284587 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-753bbefe-3487-42e2-8a74-8b69bdc46f05 req-d4de04e4-3065-4b53-9f15-c8cd9e36c98a service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:00.285910 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-753bbefe-3487-42e2-8a74-8b69bdc46f05 req-d4de04e4-3065-4b53-9f15-c8cd9e36c98a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:00.286749 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-753bbefe-3487-42e2-8a74-8b69bdc46f05 req-d4de04e4-3065-4b53-9f15-c8cd9e36c98a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:00.313850 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-753bbefe-3487-42e2-8a74-8b69bdc46f05 req-d4de04e4-3065-4b53-9f15-c8cd9e36c98a service nova] Creating event network-vif-unplugged:b13f13ce-7cbb-472a-bc2c-bb5104160fb0 for instance d065e0ee-199e-4e8b-99ca-5801d627ce65 on n-h2-833090-16 Aug 31 15:56:00.329206 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [req-753bbefe-3487-42e2-8a74-8b69bdc46f05 req-d4de04e4-3065-4b53-9f15-c8cd9e36c98a service nova] Instance d065e0ee-199e-4e8b-99ca-5801d627ce65 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-833090-16', 'n-h1-833090-16'} {{(pid=128864) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 15:56:00.350813 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-753bbefe-3487-42e2-8a74-8b69bdc46f05 req-d4de04e4-3065-4b53-9f15-c8cd9e36c98a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096669 Aug 31 15:56:00.353002 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 930/1757] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:56:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:00.375494 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-bd267acd-a664-4d32-8375-88834a34e355 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:00.376517 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-bd267acd-a664-4d32-8375-88834a34e355 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:00.387093 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bd267acd-a664-4d32-8375-88834a34e355 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:00.388071 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bd267acd-a664-4d32-8375-88834a34e355 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:00.388957 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bd267acd-a664-4d32-8375-88834a34e355 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:00.390288 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bd267acd-a664-4d32-8375-88834a34e355 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:00.391053 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bd267acd-a664-4d32-8375-88834a34e355 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:00.393088 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bd267acd-a664-4d32-8375-88834a34e355 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:00.404199 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-74f76e1d-916c-49f7-a440-8390bbb93bfe tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a19bb40252746379cf71a4f4b773b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b53c5033fb543adaeaae8980537d4e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:00.417225 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-74f76e1d-916c-49f7-a440-8390bbb93bfe tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] 10.222.0.50 "GET /compute/v2.1/servers/bbf8b630-eb17-4c08-9347-531e5b63c829" status: 200 len: 1475 microversion: 2.1 time: 1.244374 Aug 31 15:56:00.418837 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 828/1758] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:55:59 2022] GET /compute/v2.1/servers/bbf8b630-eb17-4c08-9347-531e5b63c829 => generated 1475 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:00.439913 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-da29d8cf-3e03-48da-b1d1-33120d263909 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:00.440555 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-da29d8cf-3e03-48da-b1d1-33120d263909 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 11bf6774-dc05-481c-a9f9-29c2ebd4531f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:00.464973 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da29d8cf-3e03-48da-b1d1-33120d263909 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:00.465470 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da29d8cf-3e03-48da-b1d1-33120d263909 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:00.465910 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da29d8cf-3e03-48da-b1d1-33120d263909 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:00.470934 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da29d8cf-3e03-48da-b1d1-33120d263909 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:00.474611 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da29d8cf-3e03-48da-b1d1-33120d263909 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:00.475303 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da29d8cf-3e03-48da-b1d1-33120d263909 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:01.182955 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-bd267acd-a664-4d32-8375-88834a34e355 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:01.193660 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-bd267acd-a664-4d32-8375-88834a34e355 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65" status: 200 len: 1469 microversion: 2.1 time: 0.839077 Aug 31 15:56:01.198473 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 931/1759] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:00 2022] GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65 => generated 1469 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:01.206845 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d79ef52f-d7b7-41cd-90ff-7d61ac8b3a68 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:01.209775 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d79ef52f-d7b7-41cd-90ff-7d61ac8b3a68 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: f550488c-401c-4f00-805b-fe62d75da9d4] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:01.214563 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-da29d8cf-3e03-48da-b1d1-33120d263909 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:01.234758 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d79ef52f-d7b7-41cd-90ff-7d61ac8b3a68 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:01.235412 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d79ef52f-d7b7-41cd-90ff-7d61ac8b3a68 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:01.235853 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-da29d8cf-3e03-48da-b1d1-33120d263909 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/11bf6774-dc05-481c-a9f9-29c2ebd4531f" status: 200 len: 1555 microversion: 2.1 time: 0.815922 Aug 31 15:56:01.236031 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d79ef52f-d7b7-41cd-90ff-7d61ac8b3a68 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:01.238225 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 829/1760] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:00 2022] GET /compute/v2.1/servers/11bf6774-dc05-481c-a9f9-29c2ebd4531f => generated 1555 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:01.253471 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d79ef52f-d7b7-41cd-90ff-7d61ac8b3a68 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:01.254495 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d79ef52f-d7b7-41cd-90ff-7d61ac8b3a68 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:01.255208 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d79ef52f-d7b7-41cd-90ff-7d61ac8b3a68 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:01.266588 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e9118077-40fa-4e21-b038-1014af58abb2 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Calling method '.version_select at 0x7fbb46446ee0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:01.276778 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9118077-40fa-4e21-b038-1014af58abb2 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:01.277549 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9118077-40fa-4e21-b038-1014af58abb2 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:01.278205 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9118077-40fa-4e21-b038-1014af58abb2 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:01.302806 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e9118077-40fa-4e21-b038-1014af58abb2 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] 10.222.0.50 "GET /compute/v2.1/os-migrations" status: 200 len: 2992 microversion: 2.25 time: 0.062540 Aug 31 15:56:01.308381 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 830/1761] 10.222.0.50 () {60 vars in 1184 bytes} [Wed Aug 31 15:56:01 2022] GET /compute/v2.1/os-migrations => generated 2992 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:56:01.326417 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e4268435-335f-43d0-8229-3e4d6f6fb042 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:01.327106 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e4268435-335f-43d0-8229-3e4d6f6fb042 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:01.350052 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4268435-335f-43d0-8229-3e4d6f6fb042 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:01.350579 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4268435-335f-43d0-8229-3e4d6f6fb042 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:01.351015 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4268435-335f-43d0-8229-3e4d6f6fb042 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:01.351732 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4268435-335f-43d0-8229-3e4d6f6fb042 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:01.352181 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4268435-335f-43d0-8229-3e4d6f6fb042 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:01.352601 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4268435-335f-43d0-8229-3e4d6f6fb042 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:02.326721 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d79ef52f-d7b7-41cd-90ff-7d61ac8b3a68 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:02.343660 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d79ef52f-d7b7-41cd-90ff-7d61ac8b3a68 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4" status: 200 len: 1307 microversion: 2.1 time: 1.143668 Aug 31 15:56:02.352201 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 932/1762] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:01 2022] GET /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4 => generated 1307 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:02.367454 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a954d4b7-d370-4c08-babd-5a09d9e8bce6 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:02.369348 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a954d4b7-d370-4c08-babd-5a09d9e8bce6 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] [instance: bbf8b630-eb17-4c08-9347-531e5b63c829] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:02.389851 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a954d4b7-d370-4c08-babd-5a09d9e8bce6 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:02.391390 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a954d4b7-d370-4c08-babd-5a09d9e8bce6 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:02.391927 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a954d4b7-d370-4c08-babd-5a09d9e8bce6 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:02.393868 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a954d4b7-d370-4c08-babd-5a09d9e8bce6 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:02.398398 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a954d4b7-d370-4c08-babd-5a09d9e8bce6 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:02.401138 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a954d4b7-d370-4c08-babd-5a09d9e8bce6 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:02.457453 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:56:02.641909 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a954d4b7-d370-4c08-babd-5a09d9e8bce6 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a19bb40252746379cf71a4f4b773b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b53c5033fb543adaeaae8980537d4e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:02.655272 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a954d4b7-d370-4c08-babd-5a09d9e8bce6 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] 10.222.0.50 "GET /compute/v2.1/servers/bbf8b630-eb17-4c08-9347-531e5b63c829" status: 200 len: 1433 microversion: 2.1 time: 0.300000 Aug 31 15:56:02.668617 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 933/1763] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:02 2022] GET /compute/v2.1/servers/bbf8b630-eb17-4c08-9347-531e5b63c829 => generated 1433 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:02.668617 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8d81e009-4cd2-42a2-89a8-62c7a3244df9 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:02.668617 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8d81e009-4cd2-42a2-89a8-62c7a3244df9 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:02.670984 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8d81e009-4cd2-42a2-89a8-62c7a3244df9 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:02.671573 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8d81e009-4cd2-42a2-89a8-62c7a3244df9 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:02.672006 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8d81e009-4cd2-42a2-89a8-62c7a3244df9 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:02.672767 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8d81e009-4cd2-42a2-89a8-62c7a3244df9 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:02.673223 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8d81e009-4cd2-42a2-89a8-62c7a3244df9 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:02.673786 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8d81e009-4cd2-42a2-89a8-62c7a3244df9 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:02.826875 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-e4268435-335f-43d0-8229-3e4d6f6fb042 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lazy-loading 'services' on Instance uuid 8a25dea8-1dc1-480e-a431-13d2f2270d0a {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:56:02.857276 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e4268435-335f-43d0-8229-3e4d6f6fb042 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a" status: 200 len: 2423 microversion: 2.25 time: 1.537158 Aug 31 15:56:02.877036 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 831/1764] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:56:01 2022] GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a => generated 2423 bytes in 1558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 15:56:02.886890 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cfe325c0-6243-42fa-bc99-06e3d6b8b8d0 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:02.887788 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cfe325c0-6243-42fa-bc99-06e3d6b8b8d0 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 11bf6774-dc05-481c-a9f9-29c2ebd4531f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:02.909114 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cfe325c0-6243-42fa-bc99-06e3d6b8b8d0 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:02.909882 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cfe325c0-6243-42fa-bc99-06e3d6b8b8d0 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:02.910606 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cfe325c0-6243-42fa-bc99-06e3d6b8b8d0 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:02.911851 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cfe325c0-6243-42fa-bc99-06e3d6b8b8d0 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:02.912523 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cfe325c0-6243-42fa-bc99-06e3d6b8b8d0 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:02.913167 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cfe325c0-6243-42fa-bc99-06e3d6b8b8d0 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:03.051877 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cfe325c0-6243-42fa-bc99-06e3d6b8b8d0 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:03.074618 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cfe325c0-6243-42fa-bc99-06e3d6b8b8d0 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/11bf6774-dc05-481c-a9f9-29c2ebd4531f" status: 200 len: 1346 microversion: 2.1 time: 0.196081 Aug 31 15:56:03.076385 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 832/1765] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:02 2022] GET /compute/v2.1/servers/11bf6774-dc05-481c-a9f9-29c2ebd4531f => generated 1346 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:03.086458 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-f31c7619-cccc-4884-9b85-bd20e30f9ac1 req-4726fd13-d8a3-4641-a14a-6ce6b0d4e5b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f550488c-401c-4f00-805b-fe62d75da9d4", "name": "network-vif-plugged", "status": "completed", "tag": "0245a049-7e50-451b-9002-cd4e13a97fa5"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:03.101179 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f31c7619-cccc-4884-9b85-bd20e30f9ac1 req-4726fd13-d8a3-4641-a14a-6ce6b0d4e5b0 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:03.101775 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f31c7619-cccc-4884-9b85-bd20e30f9ac1 req-4726fd13-d8a3-4641-a14a-6ce6b0d4e5b0 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:03.102587 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f31c7619-cccc-4884-9b85-bd20e30f9ac1 req-4726fd13-d8a3-4641-a14a-6ce6b0d4e5b0 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:03.125313 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-f31c7619-cccc-4884-9b85-bd20e30f9ac1 req-4726fd13-d8a3-4641-a14a-6ce6b0d4e5b0 service nova] Creating event network-vif-plugged:0245a049-7e50-451b-9002-cd4e13a97fa5 for instance f550488c-401c-4f00-805b-fe62d75da9d4 on n-h1-833090-16 Aug 31 15:56:03.136170 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-f31c7619-cccc-4884-9b85-bd20e30f9ac1 req-4726fd13-d8a3-4641-a14a-6ce6b0d4e5b0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054504 Aug 31 15:56:03.137051 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 833/1766] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:03.147356 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-dfa33c83-00fd-4623-b3be-c976efdad9c4 req-28d2ecf6-b34d-4cd6-9839-fbe6ebc47b46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11bf6774-dc05-481c-a9f9-29c2ebd4531f", "name": "network-vif-deleted", "tag": "057a9369-1375-4306-ae2a-141459b97c92"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:03.168425 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-dfa33c83-00fd-4623-b3be-c976efdad9c4 req-28d2ecf6-b34d-4cd6-9839-fbe6ebc47b46 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:03.170001 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-dfa33c83-00fd-4623-b3be-c976efdad9c4 req-28d2ecf6-b34d-4cd6-9839-fbe6ebc47b46 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:03.170876 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-dfa33c83-00fd-4623-b3be-c976efdad9c4 req-28d2ecf6-b34d-4cd6-9839-fbe6ebc47b46 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:03.193020 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-dfa33c83-00fd-4623-b3be-c976efdad9c4 req-28d2ecf6-b34d-4cd6-9839-fbe6ebc47b46 service nova] Creating event network-vif-deleted:057a9369-1375-4306-ae2a-141459b97c92 for instance 11bf6774-dc05-481c-a9f9-29c2ebd4531f on n-h2-833090-16 Aug 31 15:56:03.200165 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-dfa33c83-00fd-4623-b3be-c976efdad9c4 req-28d2ecf6-b34d-4cd6-9839-fbe6ebc47b46 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061525 Aug 31 15:56:03.201632 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 834/1767] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:03.209130 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-c43c280f-7aa7-45b9-b03f-55ade27d0540 req-2ad4fbd3-b6b7-4800-bf2d-02c79b0fca04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbf8b630-eb17-4c08-9347-531e5b63c829", "name": "network-vif-deleted", "tag": "baa64b98-0f72-4ddb-9970-82c581c73b80"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:03.225423 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c43c280f-7aa7-45b9-b03f-55ade27d0540 req-2ad4fbd3-b6b7-4800-bf2d-02c79b0fca04 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:03.226616 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c43c280f-7aa7-45b9-b03f-55ade27d0540 req-2ad4fbd3-b6b7-4800-bf2d-02c79b0fca04 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:03.227536 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c43c280f-7aa7-45b9-b03f-55ade27d0540 req-2ad4fbd3-b6b7-4800-bf2d-02c79b0fca04 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:03.245704 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-c43c280f-7aa7-45b9-b03f-55ade27d0540 req-2ad4fbd3-b6b7-4800-bf2d-02c79b0fca04 service nova] Creating event network-vif-deleted:baa64b98-0f72-4ddb-9970-82c581c73b80 for instance bbf8b630-eb17-4c08-9347-531e5b63c829 on n-h2-833090-16 Aug 31 15:56:03.252698 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-c43c280f-7aa7-45b9-b03f-55ade27d0540 req-2ad4fbd3-b6b7-4800-bf2d-02c79b0fca04 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048762 Aug 31 15:56:03.255828 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 835/1768] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:03.264707 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7fdee1de-5151-493c-933d-8efc18d77666 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:03.266084 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7fdee1de-5151-493c-933d-8efc18d77666 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:03.276146 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fdee1de-5151-493c-933d-8efc18d77666 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:03.277727 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fdee1de-5151-493c-933d-8efc18d77666 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:03.278946 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fdee1de-5151-493c-933d-8efc18d77666 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:03.279926 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fdee1de-5151-493c-933d-8efc18d77666 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:03.282248 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fdee1de-5151-493c-933d-8efc18d77666 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:03.283005 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fdee1de-5151-493c-933d-8efc18d77666 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:03.388919 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8d81e009-4cd2-42a2-89a8-62c7a3244df9 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:03.401896 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8d81e009-4cd2-42a2-89a8-62c7a3244df9 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65" status: 200 len: 1469 microversion: 2.1 time: 0.744669 Aug 31 15:56:03.402939 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 934/1769] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:02 2022] GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65 => generated 1469 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:03.413756 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e3029a8d-7604-4167-8fe4-35485d894440 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:03.414722 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e3029a8d-7604-4167-8fe4-35485d894440 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: f550488c-401c-4f00-805b-fe62d75da9d4] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:03.427288 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e3029a8d-7604-4167-8fe4-35485d894440 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:03.428190 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e3029a8d-7604-4167-8fe4-35485d894440 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:03.428861 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e3029a8d-7604-4167-8fe4-35485d894440 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:03.434192 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e3029a8d-7604-4167-8fe4-35485d894440 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:03.438008 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e3029a8d-7604-4167-8fe4-35485d894440 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:03.439004 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e3029a8d-7604-4167-8fe4-35485d894440 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:03.812594 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-7fdee1de-5151-493c-933d-8efc18d77666 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lazy-loading 'services' on Instance uuid 8a25dea8-1dc1-480e-a431-13d2f2270d0a {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:56:03.860851 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7fdee1de-5151-493c-933d-8efc18d77666 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a" status: 200 len: 2423 microversion: 2.25 time: 0.602532 Aug 31 15:56:03.865504 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 836/1770] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:56:03 2022] GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a => generated 2423 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:56:03.890827 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3905fce1-52bb-4302-88eb-f7f358fdcabb tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:03.891526 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3905fce1-52bb-4302-88eb-f7f358fdcabb tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] [instance: bbf8b630-eb17-4c08-9347-531e5b63c829] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:03.910270 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3905fce1-52bb-4302-88eb-f7f358fdcabb tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:03.910818 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3905fce1-52bb-4302-88eb-f7f358fdcabb tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:03.911262 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3905fce1-52bb-4302-88eb-f7f358fdcabb tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:03.913919 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3905fce1-52bb-4302-88eb-f7f358fdcabb tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:03.914420 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3905fce1-52bb-4302-88eb-f7f358fdcabb tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:03.916189 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3905fce1-52bb-4302-88eb-f7f358fdcabb tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:03.961215 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-3905fce1-52bb-4302-88eb-f7f358fdcabb tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] HTTP exception thrown: Instance bbf8b630-eb17-4c08-9347-531e5b63c829 could not be found. Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3905fce1-52bb-4302-88eb-f7f358fdcabb tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Request method failure captured: Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/bbf8b630-eb17-4c08-9347-531e5b63c829 HTTP/1.1 Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4Rwv3U6QdMXPqLE7SZBSWJNO4D93QIjUdh6ESa2S1oEQIVR3j294TGM6TaeeRnoj0rThFrJ8TrQsR_Ricc0u7pIDtBX6RsXI1UCBUbiVlOJlb6FISX_ps9UgvncHO8wDKum1Z3wm-zP5x2eIkt-Qnd9gmHXzGdHJfsKZMd7oAUZ5Sk Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 6b53c5033fb543adaeaae8980537d4e2 Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-DeleteServersAdminTestJSON-256335396 Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6b53c5033fb543adaeaae8980537d4e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6b53c5033fb543adaeaae8980537d4e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6b53c5033fb543adaeaae8980537d4e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6b53c5033fb543adaeaae8980537d4e2", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-DeleteServersAdminTestJSON-256335396 Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 6b53c5033fb543adaeaae8980537d4e2 Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-256335396 Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-DeleteServersAdminTestJSON-256335396-project Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 2a19bb40252746379cf71a4f4b773b0a Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-DeleteServersAdminTestJSON-256335396-project Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance bbf8b630-eb17-4c08-9347-531e5b63c829 could not be found. Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'bbf8b630-eb17-4c08-9347-531e5b63c829'} Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbf8b630-eb17-4c08-9347-531e5b63c829 could not be found. Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbf8b630-eb17-4c08-9347-531e5b63c829 could not be found. Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:03.963040 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:56:03.968461 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:03.968461 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:03.968461 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:03.968461 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:56:03.968461 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:56:03.968461 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbf8b630-eb17-4c08-9347-531e5b63c829 could not be found. Aug 31 15:56:03.968461 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:56:03.968461 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3905fce1-52bb-4302-88eb-f7f358fdcabb tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Returning 404 to user: Instance bbf8b630-eb17-4c08-9347-531e5b63c829 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:56:03.970631 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3905fce1-52bb-4302-88eb-f7f358fdcabb tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] 10.222.0.50 "GET /compute/v2.1/servers/bbf8b630-eb17-4c08-9347-531e5b63c829" status: 404 len: 111 microversion: 2.1 time: 0.092036 Aug 31 15:56:03.971916 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 837/1771] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:03 2022] GET /compute/v2.1/servers/bbf8b630-eb17-4c08-9347-531e5b63c829 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:56:04.057747 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0b391a15-c613-4bf6-bee5-ab6a450da92b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:04.058307 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0b391a15-c613-4bf6-bee5-ab6a450da92b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:04.068457 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0b391a15-c613-4bf6-bee5-ab6a450da92b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:04.068956 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0b391a15-c613-4bf6-bee5-ab6a450da92b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:04.069394 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0b391a15-c613-4bf6-bee5-ab6a450da92b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:04.070350 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0b391a15-c613-4bf6-bee5-ab6a450da92b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:04.070815 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0b391a15-c613-4bf6-bee5-ab6a450da92b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:04.071217 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0b391a15-c613-4bf6-bee5-ab6a450da92b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:04.214372 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e3029a8d-7604-4167-8fe4-35485d894440 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:04.224829 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e3029a8d-7604-4167-8fe4-35485d894440 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4" status: 200 len: 1307 microversion: 2.1 time: 0.820606 Aug 31 15:56:04.227750 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 935/1772] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:03 2022] GET /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4 => generated 1307 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:04.255221 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5cd0d169-2075-47f6-905e-029afb5e9e63 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:04.258296 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5cd0d169-2075-47f6-905e-029afb5e9e63 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 11bf6774-dc05-481c-a9f9-29c2ebd4531f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:04.272285 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5cd0d169-2075-47f6-905e-029afb5e9e63 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:04.274705 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5cd0d169-2075-47f6-905e-029afb5e9e63 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:04.276972 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5cd0d169-2075-47f6-905e-029afb5e9e63 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:04.277879 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5cd0d169-2075-47f6-905e-029afb5e9e63 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:04.283139 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5cd0d169-2075-47f6-905e-029afb5e9e63 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:04.283874 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5cd0d169-2075-47f6-905e-029afb5e9e63 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:04.452012 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5cd0d169-2075-47f6-905e-029afb5e9e63 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:04.461852 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5cd0d169-2075-47f6-905e-029afb5e9e63 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/11bf6774-dc05-481c-a9f9-29c2ebd4531f" status: 200 len: 1346 microversion: 2.1 time: 0.218533 Aug 31 15:56:04.462876 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 936/1773] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:04 2022] GET /compute/v2.1/servers/11bf6774-dc05-481c-a9f9-29c2ebd4531f => generated 1346 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:04.468715 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-50f7c1d2-83d2-4d98-9671-e220f0bf36be tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1593754332", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:04.533779 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-50f7c1d2-83d2-4d98-9671-e220f0bf36be tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] validate_networks() for None {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:56:04.827132 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-0b391a15-c613-4bf6-bee5-ab6a450da92b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lazy-loading 'services' on Instance uuid 8a25dea8-1dc1-480e-a431-13d2f2270d0a {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:56:05.025888 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-50f7c1d2-83d2-4d98-9671-e220f0bf36be tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:56:05.026338 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-50f7c1d2-83d2-4d98-9671-e220f0bf36be tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:56:05.026810 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-50f7c1d2-83d2-4d98-9671-e220f0bf36be tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:56:05.027215 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-50f7c1d2-83d2-4d98-9671-e220f0bf36be tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:56:05.027710 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-50f7c1d2-83d2-4d98-9671-e220f0bf36be tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:56:05.047225 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-50f7c1d2-83d2-4d98-9671-e220f0bf36be tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:05.048001 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-50f7c1d2-83d2-4d98-9671-e220f0bf36be tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:05.048626 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-50f7c1d2-83d2-4d98-9671-e220f0bf36be tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:05.049536 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-50f7c1d2-83d2-4d98-9671-e220f0bf36be tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:05.050196 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-50f7c1d2-83d2-4d98-9671-e220f0bf36be tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:05.050797 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-50f7c1d2-83d2-4d98-9671-e220f0bf36be tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:05.091592 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0b391a15-c613-4bf6-bee5-ab6a450da92b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "DELETE /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a/os-volume_attachments/f307e02b-a97c-4901-b77a-1d9c635136ce" status: 202 len: 0 microversion: 2.25 time: 1.039170 Aug 31 15:56:05.093108 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 838/1774] 10.222.0.50 () {60 vars in 1457 bytes} [Wed Aug 31 15:56:04 2022] DELETE /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a/os-volume_attachments/f307e02b-a97c-4901-b77a-1d9c635136ce => generated 0 bytes in 1042 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:56:05.096713 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-50f7c1d2-83d2-4d98-9671-e220f0bf36be tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Getting quotas for project 6b53c5033fb543adaeaae8980537d4e2. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:56:05.105039 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-50f7c1d2-83d2-4d98-9671-e220f0bf36be tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Getting quotas for user 2a19bb40252746379cf71a4f4b773b0a and project 6b53c5033fb543adaeaae8980537d4e2. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:56:05.124087 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-50f7c1d2-83d2-4d98-9671-e220f0bf36be tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:56:05.126780 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-50f7c1d2-83d2-4d98-9671-e220f0bf36be tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] [instance: f6574815-a484-4d2d-82b4-9cc761af2c9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:56:05.130928 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cd001d06-8f9b-4c7b-ad56-6558209dac1f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:05.131668 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cd001d06-8f9b-4c7b-ad56-6558209dac1f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:05.148781 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd001d06-8f9b-4c7b-ad56-6558209dac1f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:05.149053 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd001d06-8f9b-4c7b-ad56-6558209dac1f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:05.149281 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd001d06-8f9b-4c7b-ad56-6558209dac1f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:05.150032 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd001d06-8f9b-4c7b-ad56-6558209dac1f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:05.165954 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd001d06-8f9b-4c7b-ad56-6558209dac1f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:05.166597 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd001d06-8f9b-4c7b-ad56-6558209dac1f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:05.199787 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-50f7c1d2-83d2-4d98-9671-e220f0bf36be tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.735574 Aug 31 15:56:05.201150 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 937/1775] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:56:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 15:56:05.325545 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-36740f36-968c-4493-a9ad-e82ca0bcf3a1 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1396539959", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "4cb66402-8964-4dd9-bc34-02ba923c9f39"}]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:05.413211 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-36740f36-968c-4493-a9ad-e82ca0bcf3a1 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] validate_networks() for [('4cb66402-8964-4dd9-bc34-02ba923c9f39', None, None, None, None, None)] {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:56:05.586370 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cd001d06-8f9b-4c7b-ad56-6558209dac1f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:05.598122 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cd001d06-8f9b-4c7b-ad56-6558209dac1f tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65" status: 200 len: 1469 microversion: 2.1 time: 0.503471 Aug 31 15:56:05.598782 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 839/1776] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:05 2022] GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65 => generated 1469 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:05.630672 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e38ccca1-78e3-4778-9280-dccd53e34e3d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:05.633011 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e38ccca1-78e3-4778-9280-dccd53e34e3d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:05.648861 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e38ccca1-78e3-4778-9280-dccd53e34e3d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:05.649352 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e38ccca1-78e3-4778-9280-dccd53e34e3d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:05.649845 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e38ccca1-78e3-4778-9280-dccd53e34e3d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:05.650703 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e38ccca1-78e3-4778-9280-dccd53e34e3d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:05.651177 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e38ccca1-78e3-4778-9280-dccd53e34e3d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:05.651596 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e38ccca1-78e3-4778-9280-dccd53e34e3d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:05.716584 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:56:05.756353 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e38ccca1-78e3-4778-9280-dccd53e34e3d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.140061 Aug 31 15:56:05.758060 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 840/1777] 10.222.0.50 () {60 vars in 1343 bytes} [Wed Aug 31 15:56:05 2022] GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:56:05.772185 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5f89be6a-6d56-43d8-ae16-2c854b71bd9b tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:05.773147 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5f89be6a-6d56-43d8-ae16-2c854b71bd9b tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] [instance: f6574815-a484-4d2d-82b4-9cc761af2c9a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:05.865345 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5f89be6a-6d56-43d8-ae16-2c854b71bd9b tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a19bb40252746379cf71a4f4b773b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b53c5033fb543adaeaae8980537d4e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:05.875150 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5f89be6a-6d56-43d8-ae16-2c854b71bd9b tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] 10.222.0.50 "GET /compute/v2.1/servers/f6574815-a484-4d2d-82b4-9cc761af2c9a" status: 200 len: 1220 microversion: 2.1 time: 0.115810 Aug 31 15:56:05.879227 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 841/1778] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:05 2022] GET /compute/v2.1/servers/f6574815-a484-4d2d-82b4-9cc761af2c9a => generated 1220 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:05.900202 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0400a46c-98fe-4653-a5c6-3b77db745b33 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:05.900897 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0400a46c-98fe-4653-a5c6-3b77db745b33 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: f550488c-401c-4f00-805b-fe62d75da9d4] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:05.908697 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0400a46c-98fe-4653-a5c6-3b77db745b33 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:05.911268 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0400a46c-98fe-4653-a5c6-3b77db745b33 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:05.912566 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0400a46c-98fe-4653-a5c6-3b77db745b33 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:05.920659 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0400a46c-98fe-4653-a5c6-3b77db745b33 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:05.921465 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0400a46c-98fe-4653-a5c6-3b77db745b33 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:05.922148 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0400a46c-98fe-4653-a5c6-3b77db745b33 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:06.143646 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0400a46c-98fe-4653-a5c6-3b77db745b33 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:06.157314 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0400a46c-98fe-4653-a5c6-3b77db745b33 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4" status: 200 len: 1486 microversion: 2.1 time: 0.276657 Aug 31 15:56:06.158541 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 842/1779] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:05 2022] GET /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4 => generated 1486 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:06.165131 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-ce2b4204-5938-4a2b-ba51-cfcbc8822c55 req-73d7f8ea-a3ae-4005-a035-06b163449f54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d065e0ee-199e-4e8b-99ca-5801d627ce65", "tag": "b13f13ce-7cbb-472a-bc2c-bb5104160fb0"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:06.186700 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ce2b4204-5938-4a2b-ba51-cfcbc8822c55 req-73d7f8ea-a3ae-4005-a035-06b163449f54 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:06.187603 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ce2b4204-5938-4a2b-ba51-cfcbc8822c55 req-73d7f8ea-a3ae-4005-a035-06b163449f54 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:06.188319 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ce2b4204-5938-4a2b-ba51-cfcbc8822c55 req-73d7f8ea-a3ae-4005-a035-06b163449f54 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:06.225684 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-ce2b4204-5938-4a2b-ba51-cfcbc8822c55 req-73d7f8ea-a3ae-4005-a035-06b163449f54 service nova] Creating event network-changed:b13f13ce-7cbb-472a-bc2c-bb5104160fb0 for instance d065e0ee-199e-4e8b-99ca-5801d627ce65 on n-h2-833090-16 Aug 31 15:56:06.233561 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [req-ce2b4204-5938-4a2b-ba51-cfcbc8822c55 req-73d7f8ea-a3ae-4005-a035-06b163449f54 service nova] Instance d065e0ee-199e-4e8b-99ca-5801d627ce65 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-833090-16', 'n-h1-833090-16'} {{(pid=128863) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 15:56:06.249341 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-ce2b4204-5938-4a2b-ba51-cfcbc8822c55 req-73d7f8ea-a3ae-4005-a035-06b163449f54 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087706 Aug 31 15:56:06.253063 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 843/1780] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:06.279665 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-694922c2-fde2-4205-a91f-12114e232a85 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:06.284368 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-694922c2-fde2-4205-a91f-12114e232a85 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 11bf6774-dc05-481c-a9f9-29c2ebd4531f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:06.320892 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-694922c2-fde2-4205-a91f-12114e232a85 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:06.326137 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-694922c2-fde2-4205-a91f-12114e232a85 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:06.327345 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-694922c2-fde2-4205-a91f-12114e232a85 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:06.330892 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-694922c2-fde2-4205-a91f-12114e232a85 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:06.333574 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-694922c2-fde2-4205-a91f-12114e232a85 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:06.336242 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-694922c2-fde2-4205-a91f-12114e232a85 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:06.447622 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-36740f36-968c-4493-a9ad-e82ca0bcf3a1 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:56:06.448634 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-36740f36-968c-4493-a9ad-e82ca0bcf3a1 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:56:06.449274 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-36740f36-968c-4493-a9ad-e82ca0bcf3a1 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:56:06.449924 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-36740f36-968c-4493-a9ad-e82ca0bcf3a1 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:56:06.450592 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-36740f36-968c-4493-a9ad-e82ca0bcf3a1 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:56:06.468260 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-36740f36-968c-4493-a9ad-e82ca0bcf3a1 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:06.472784 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-36740f36-968c-4493-a9ad-e82ca0bcf3a1 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:06.473660 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-36740f36-968c-4493-a9ad-e82ca0bcf3a1 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:06.475881 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-36740f36-968c-4493-a9ad-e82ca0bcf3a1 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:06.478845 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-36740f36-968c-4493-a9ad-e82ca0bcf3a1 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:06.479619 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-36740f36-968c-4493-a9ad-e82ca0bcf3a1 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:06.536565 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-36740f36-968c-4493-a9ad-e82ca0bcf3a1 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Getting quotas for project 7a740310041645c8b9c32992012d01aa. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:56:06.546493 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-36740f36-968c-4493-a9ad-e82ca0bcf3a1 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Getting quotas for user 2a66be47dc1d49f68f66ef363ccaccbd and project 7a740310041645c8b9c32992012d01aa. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:56:06.550454 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-694922c2-fde2-4205-a91f-12114e232a85 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:06.563335 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-694922c2-fde2-4205-a91f-12114e232a85 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/11bf6774-dc05-481c-a9f9-29c2ebd4531f" status: 200 len: 1346 microversion: 2.1 time: 0.307944 Aug 31 15:56:06.567716 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 844/1781] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:06 2022] GET /compute/v2.1/servers/11bf6774-dc05-481c-a9f9-29c2ebd4531f => generated 1346 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:06.576674 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cb40f401-24ca-43c4-be1d-c0af24da226d tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:06.581311 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-36740f36-968c-4493-a9ad-e82ca0bcf3a1 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:56:06.584527 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-36740f36-968c-4493-a9ad-e82ca0bcf3a1 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] [instance: 56489785-4b4c-4614-acfc-af86763249f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:56:06.588348 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb40f401-24ca-43c4-be1d-c0af24da226d tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:06.594786 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb40f401-24ca-43c4-be1d-c0af24da226d tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:06.595829 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb40f401-24ca-43c4-be1d-c0af24da226d tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:06.686695 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-36740f36-968c-4493-a9ad-e82ca0bcf3a1 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.484154 Aug 31 15:56:06.687250 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 938/1782] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:56:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1485 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 15:56:06.710240 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ac9c4151-5cb8-4b80-aca6-45deb2d54647 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:06.716947 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ac9c4151-5cb8-4b80-aca6-45deb2d54647 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:06.740238 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ac9c4151-5cb8-4b80-aca6-45deb2d54647 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:06.741641 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ac9c4151-5cb8-4b80-aca6-45deb2d54647 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:06.743526 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ac9c4151-5cb8-4b80-aca6-45deb2d54647 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:06.746870 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ac9c4151-5cb8-4b80-aca6-45deb2d54647 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:06.747632 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ac9c4151-5cb8-4b80-aca6-45deb2d54647 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:06.751461 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ac9c4151-5cb8-4b80-aca6-45deb2d54647 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:06.853737 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cb40f401-24ca-43c4-be1d-c0af24da226d tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: f550488c-401c-4f00-805b-fe62d75da9d4] Going to try to stop instance {{(pid=128863) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 15:56:06.944989 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cb40f401-24ca-43c4-be1d-c0af24da226d tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "POST /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4/action" status: 202 len: 0 microversion: 2.1 time: 0.374394 Aug 31 15:56:06.949612 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 845/1783] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 15:56:06 2022] POST /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4/action => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:56:06.960645 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4a8b296e-f6e5-426f-96df-a1cb0546f69d tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:06.964595 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4a8b296e-f6e5-426f-96df-a1cb0546f69d tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] [instance: 56489785-4b4c-4614-acfc-af86763249f9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:07.157083 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4a8b296e-f6e5-426f-96df-a1cb0546f69d tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a66be47dc1d49f68f66ef363ccaccbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a740310041645c8b9c32992012d01aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:07.169108 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4a8b296e-f6e5-426f-96df-a1cb0546f69d tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] 10.222.0.50 "GET /compute/v2.1/servers/56489785-4b4c-4614-acfc-af86763249f9" status: 200 len: 1217 microversion: 2.1 time: 0.219733 Aug 31 15:56:07.170020 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 846/1784] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:06 2022] GET /compute/v2.1/servers/56489785-4b4c-4614-acfc-af86763249f9 => generated 1217 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:07.175564 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-245be489-72ff-4041-a89d-048d3971f4ce tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:07.178774 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-245be489-72ff-4041-a89d-048d3971f4ce tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:07.206011 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-245be489-72ff-4041-a89d-048d3971f4ce tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:07.207991 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-245be489-72ff-4041-a89d-048d3971f4ce tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:07.209125 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-245be489-72ff-4041-a89d-048d3971f4ce tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:07.210754 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-245be489-72ff-4041-a89d-048d3971f4ce tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:07.212516 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-245be489-72ff-4041-a89d-048d3971f4ce tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:07.215665 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-245be489-72ff-4041-a89d-048d3971f4ce tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:07.298254 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ac9c4151-5cb8-4b80-aca6-45deb2d54647 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:07.308168 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ac9c4151-5cb8-4b80-aca6-45deb2d54647 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65" status: 200 len: 1469 microversion: 2.1 time: 0.617700 Aug 31 15:56:07.308766 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 939/1785] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:06 2022] GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65 => generated 1469 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:07.312435 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-245be489-72ff-4041-a89d-048d3971f4ce tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.140711 Aug 31 15:56:07.317005 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 847/1786] 10.222.0.50 () {60 vars in 1343 bytes} [Wed Aug 31 15:56:07 2022] GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:56:07.337610 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1c3e4617-52fe-45b0-ab50-81a5bc7f3ee7 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:07.338308 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6fc860a3-2975-46af-ac07-f8f024531de6 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:07.341286 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6fc860a3-2975-46af-ac07-f8f024531de6 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] [instance: f6574815-a484-4d2d-82b4-9cc761af2c9a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:07.342127 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1c3e4617-52fe-45b0-ab50-81a5bc7f3ee7 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: f550488c-401c-4f00-805b-fe62d75da9d4] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:07.360841 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1c3e4617-52fe-45b0-ab50-81a5bc7f3ee7 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:07.361349 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1c3e4617-52fe-45b0-ab50-81a5bc7f3ee7 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:07.361801 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1c3e4617-52fe-45b0-ab50-81a5bc7f3ee7 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:07.369101 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6fc860a3-2975-46af-ac07-f8f024531de6 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:07.369632 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1c3e4617-52fe-45b0-ab50-81a5bc7f3ee7 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:07.373582 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1c3e4617-52fe-45b0-ab50-81a5bc7f3ee7 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:07.373767 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6fc860a3-2975-46af-ac07-f8f024531de6 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:07.375251 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1c3e4617-52fe-45b0-ab50-81a5bc7f3ee7 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:07.375871 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6fc860a3-2975-46af-ac07-f8f024531de6 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:07.380064 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6fc860a3-2975-46af-ac07-f8f024531de6 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:07.384670 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6fc860a3-2975-46af-ac07-f8f024531de6 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:07.386425 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6fc860a3-2975-46af-ac07-f8f024531de6 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:07.671059 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6fc860a3-2975-46af-ac07-f8f024531de6 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a19bb40252746379cf71a4f4b773b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b53c5033fb543adaeaae8980537d4e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:07.688582 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6fc860a3-2975-46af-ac07-f8f024531de6 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] 10.222.0.50 "GET /compute/v2.1/servers/f6574815-a484-4d2d-82b4-9cc761af2c9a" status: 200 len: 1224 microversion: 2.1 time: 0.373984 Aug 31 15:56:07.691561 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 848/1787] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:07 2022] GET /compute/v2.1/servers/f6574815-a484-4d2d-82b4-9cc761af2c9a => generated 1224 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:07.709422 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-13796f11-7d47-4174-80b0-7b7ab253ee37 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:07.710034 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-13796f11-7d47-4174-80b0-7b7ab253ee37 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 11bf6774-dc05-481c-a9f9-29c2ebd4531f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:07.729183 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13796f11-7d47-4174-80b0-7b7ab253ee37 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:07.730922 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13796f11-7d47-4174-80b0-7b7ab253ee37 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:07.732121 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13796f11-7d47-4174-80b0-7b7ab253ee37 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:07.734982 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13796f11-7d47-4174-80b0-7b7ab253ee37 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:07.736600 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13796f11-7d47-4174-80b0-7b7ab253ee37 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:07.737550 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13796f11-7d47-4174-80b0-7b7ab253ee37 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:07.889848 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-13796f11-7d47-4174-80b0-7b7ab253ee37 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:07.898702 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1c3e4617-52fe-45b0-ab50-81a5bc7f3ee7 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:07.906677 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-13796f11-7d47-4174-80b0-7b7ab253ee37 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/11bf6774-dc05-481c-a9f9-29c2ebd4531f" status: 200 len: 1346 microversion: 2.1 time: 0.213969 Aug 31 15:56:07.918152 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 849/1788] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:07 2022] GET /compute/v2.1/servers/11bf6774-dc05-481c-a9f9-29c2ebd4531f => generated 1346 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:07.931785 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1c3e4617-52fe-45b0-ab50-81a5bc7f3ee7 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4" status: 200 len: 1496 microversion: 2.1 time: 0.606158 Aug 31 15:56:07.931785 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 940/1789] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:07 2022] GET /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4 => generated 1496 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:08.196909 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e5d689fa-d5a9-4e18-9653-857f3777b6c4 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:08.198257 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e5d689fa-d5a9-4e18-9653-857f3777b6c4 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] [instance: 56489785-4b4c-4614-acfc-af86763249f9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:08.209134 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e5d689fa-d5a9-4e18-9653-857f3777b6c4 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:08.215237 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e5d689fa-d5a9-4e18-9653-857f3777b6c4 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:08.216081 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e5d689fa-d5a9-4e18-9653-857f3777b6c4 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:08.217182 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e5d689fa-d5a9-4e18-9653-857f3777b6c4 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:08.219569 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e5d689fa-d5a9-4e18-9653-857f3777b6c4 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:08.220465 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e5d689fa-d5a9-4e18-9653-857f3777b6c4 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:08.327148 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5397790a-61d0-4021-8433-18874dcf374c tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:08.330109 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5397790a-61d0-4021-8433-18874dcf374c tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:08.381621 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5397790a-61d0-4021-8433-18874dcf374c tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:08.382166 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5397790a-61d0-4021-8433-18874dcf374c tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:08.382669 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5397790a-61d0-4021-8433-18874dcf374c tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:08.383409 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5397790a-61d0-4021-8433-18874dcf374c tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:08.384290 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5397790a-61d0-4021-8433-18874dcf374c tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:08.384742 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5397790a-61d0-4021-8433-18874dcf374c tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:08.385164 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e5d689fa-d5a9-4e18-9653-857f3777b6c4 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a66be47dc1d49f68f66ef363ccaccbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a740310041645c8b9c32992012d01aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:08.408392 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e5d689fa-d5a9-4e18-9653-857f3777b6c4 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] 10.222.0.50 "GET /compute/v2.1/servers/56489785-4b4c-4614-acfc-af86763249f9" status: 200 len: 1213 microversion: 2.1 time: 0.214057 Aug 31 15:56:08.412818 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 850/1790] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:08 2022] GET /compute/v2.1/servers/56489785-4b4c-4614-acfc-af86763249f9 => generated 1213 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:08.432621 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a74018d1-5cd1-4c97-bcf9-5369cc263039 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:08.433355 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a74018d1-5cd1-4c97-bcf9-5369cc263039 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:08.460720 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a74018d1-5cd1-4c97-bcf9-5369cc263039 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:08.466328 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a74018d1-5cd1-4c97-bcf9-5369cc263039 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:08.466979 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a74018d1-5cd1-4c97-bcf9-5369cc263039 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:08.467825 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a74018d1-5cd1-4c97-bcf9-5369cc263039 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:08.468302 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a74018d1-5cd1-4c97-bcf9-5369cc263039 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:08.468725 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a74018d1-5cd1-4c97-bcf9-5369cc263039 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:08.474080 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5397790a-61d0-4021-8433-18874dcf374c tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.136077 Aug 31 15:56:08.482992 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 941/1791] 10.222.0.50 () {60 vars in 1343 bytes} [Wed Aug 31 15:56:08 2022] GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:56:08.720784 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2d16b526-8412-41f1-b336-24625fc36c35 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:08.721906 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2d16b526-8412-41f1-b336-24625fc36c35 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] [instance: f6574815-a484-4d2d-82b4-9cc761af2c9a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:08.745797 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2d16b526-8412-41f1-b336-24625fc36c35 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:08.747877 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2d16b526-8412-41f1-b336-24625fc36c35 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:08.749646 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2d16b526-8412-41f1-b336-24625fc36c35 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:08.753348 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2d16b526-8412-41f1-b336-24625fc36c35 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:08.754372 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2d16b526-8412-41f1-b336-24625fc36c35 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:08.755334 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2d16b526-8412-41f1-b336-24625fc36c35 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:08.872915 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a74018d1-5cd1-4c97-bcf9-5369cc263039 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:08.882527 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a74018d1-5cd1-4c97-bcf9-5369cc263039 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65" status: 200 len: 1469 microversion: 2.1 time: 0.468585 Aug 31 15:56:08.889335 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 851/1792] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:08 2022] GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65 => generated 1469 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:08.937034 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5ac389c7-59e5-4c9e-8b7e-5ac2cd526718 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:08.937739 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5ac389c7-59e5-4c9e-8b7e-5ac2cd526718 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 11bf6774-dc05-481c-a9f9-29c2ebd4531f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:08.951792 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ac389c7-59e5-4c9e-8b7e-5ac2cd526718 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:08.960665 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ac389c7-59e5-4c9e-8b7e-5ac2cd526718 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:08.961432 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ac389c7-59e5-4c9e-8b7e-5ac2cd526718 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:08.962644 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ac389c7-59e5-4c9e-8b7e-5ac2cd526718 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:08.963387 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ac389c7-59e5-4c9e-8b7e-5ac2cd526718 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:08.964321 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ac389c7-59e5-4c9e-8b7e-5ac2cd526718 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:08.998334 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2d16b526-8412-41f1-b336-24625fc36c35 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a19bb40252746379cf71a4f4b773b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b53c5033fb543adaeaae8980537d4e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:09.013616 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2d16b526-8412-41f1-b336-24625fc36c35 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] 10.222.0.50 "GET /compute/v2.1/servers/f6574815-a484-4d2d-82b4-9cc761af2c9a" status: 200 len: 1272 microversion: 2.1 time: 0.302604 Aug 31 15:56:09.015244 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 942/1793] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:08 2022] GET /compute/v2.1/servers/f6574815-a484-4d2d-82b4-9cc761af2c9a => generated 1272 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:09.020870 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-02c44d0c-5e7b-411a-a205-d1f5627aca82 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:09.022470 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-02c44d0c-5e7b-411a-a205-d1f5627aca82 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: f550488c-401c-4f00-805b-fe62d75da9d4] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:09.029485 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-02c44d0c-5e7b-411a-a205-d1f5627aca82 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:09.030531 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-02c44d0c-5e7b-411a-a205-d1f5627aca82 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:09.031271 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-02c44d0c-5e7b-411a-a205-d1f5627aca82 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:09.032262 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-02c44d0c-5e7b-411a-a205-d1f5627aca82 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:09.032936 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-02c44d0c-5e7b-411a-a205-d1f5627aca82 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:09.033581 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-02c44d0c-5e7b-411a-a205-d1f5627aca82 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:09.147116 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5ac389c7-59e5-4c9e-8b7e-5ac2cd526718 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:09.159216 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5ac389c7-59e5-4c9e-8b7e-5ac2cd526718 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/11bf6774-dc05-481c-a9f9-29c2ebd4531f" status: 200 len: 1346 microversion: 2.1 time: 0.229308 Aug 31 15:56:09.159865 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 852/1794] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:08 2022] GET /compute/v2.1/servers/11bf6774-dc05-481c-a9f9-29c2ebd4531f => generated 1346 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:09.435652 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0dac1810-a331-4773-9365-d721b4c91b59 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:09.436312 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0dac1810-a331-4773-9365-d721b4c91b59 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] [instance: 56489785-4b4c-4614-acfc-af86763249f9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:09.452114 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0dac1810-a331-4773-9365-d721b4c91b59 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:09.456516 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0dac1810-a331-4773-9365-d721b4c91b59 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:09.458337 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0dac1810-a331-4773-9365-d721b4c91b59 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:09.462918 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0dac1810-a331-4773-9365-d721b4c91b59 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:09.463421 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0dac1810-a331-4773-9365-d721b4c91b59 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:09.465834 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0dac1810-a331-4773-9365-d721b4c91b59 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:09.482666 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-02c44d0c-5e7b-411a-a205-d1f5627aca82 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:09.491603 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-02c44d0c-5e7b-411a-a205-d1f5627aca82 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4" status: 200 len: 1496 microversion: 2.1 time: 0.474973 Aug 31 15:56:09.498964 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 943/1795] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:09 2022] GET /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4 => generated 1496 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:09.504501 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-38520448-e28f-412a-9a3d-fe12b86984f6 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:09.511048 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-38520448-e28f-412a-9a3d-fe12b86984f6 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:09.522711 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-38520448-e28f-412a-9a3d-fe12b86984f6 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:09.527260 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-38520448-e28f-412a-9a3d-fe12b86984f6 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:09.527710 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-38520448-e28f-412a-9a3d-fe12b86984f6 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:09.528457 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-38520448-e28f-412a-9a3d-fe12b86984f6 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:09.528911 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-38520448-e28f-412a-9a3d-fe12b86984f6 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:09.529325 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-38520448-e28f-412a-9a3d-fe12b86984f6 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:09.593428 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-38520448-e28f-412a-9a3d-fe12b86984f6 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.092919 Aug 31 15:56:09.594334 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 944/1796] 10.222.0.50 () {60 vars in 1343 bytes} [Wed Aug 31 15:56:09 2022] GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:56:09.634084 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0dac1810-a331-4773-9365-d721b4c91b59 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a66be47dc1d49f68f66ef363ccaccbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a740310041645c8b9c32992012d01aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:09.647298 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0dac1810-a331-4773-9365-d721b4c91b59 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] 10.222.0.50 "GET /compute/v2.1/servers/56489785-4b4c-4614-acfc-af86763249f9" status: 200 len: 1277 microversion: 2.1 time: 0.215839 Aug 31 15:56:09.648980 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 853/1797] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:09 2022] GET /compute/v2.1/servers/56489785-4b4c-4614-acfc-af86763249f9 => generated 1277 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:56:09.910608 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ba19af10-2d68-4d20-aa2e-f963532696ea tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:09.911668 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ba19af10-2d68-4d20-aa2e-f963532696ea tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:09.919044 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ba19af10-2d68-4d20-aa2e-f963532696ea tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:09.939109 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ba19af10-2d68-4d20-aa2e-f963532696ea tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:09.941112 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ba19af10-2d68-4d20-aa2e-f963532696ea tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:09.942129 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ba19af10-2d68-4d20-aa2e-f963532696ea tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:09.950832 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ba19af10-2d68-4d20-aa2e-f963532696ea tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:09.951274 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ba19af10-2d68-4d20-aa2e-f963532696ea tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:10.041359 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f4360745-fc8d-42c3-9c01-89e851f8e9b8 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:10.042285 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f4360745-fc8d-42c3-9c01-89e851f8e9b8 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] [instance: f6574815-a484-4d2d-82b4-9cc761af2c9a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:10.073298 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4360745-fc8d-42c3-9c01-89e851f8e9b8 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:10.073794 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4360745-fc8d-42c3-9c01-89e851f8e9b8 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:10.074275 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4360745-fc8d-42c3-9c01-89e851f8e9b8 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:10.075007 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4360745-fc8d-42c3-9c01-89e851f8e9b8 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:10.075469 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4360745-fc8d-42c3-9c01-89e851f8e9b8 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:10.075913 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4360745-fc8d-42c3-9c01-89e851f8e9b8 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:10.362422 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f4360745-fc8d-42c3-9c01-89e851f8e9b8 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a19bb40252746379cf71a4f4b773b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b53c5033fb543adaeaae8980537d4e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:10.372611 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f4360745-fc8d-42c3-9c01-89e851f8e9b8 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] 10.222.0.50 "GET /compute/v2.1/servers/f6574815-a484-4d2d-82b4-9cc761af2c9a" status: 200 len: 1290 microversion: 2.1 time: 0.335417 Aug 31 15:56:10.381938 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 854/1798] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:10 2022] GET /compute/v2.1/servers/f6574815-a484-4d2d-82b4-9cc761af2c9a => generated 1290 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:10.399795 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4a3f6677-91d0-4ee5-ab98-9d29f9eecacd tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:10.403000 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4a3f6677-91d0-4ee5-ab98-9d29f9eecacd tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 11bf6774-dc05-481c-a9f9-29c2ebd4531f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:10.413091 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:56:10.430056 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a3f6677-91d0-4ee5-ab98-9d29f9eecacd tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:10.435032 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a3f6677-91d0-4ee5-ab98-9d29f9eecacd tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:10.435748 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a3f6677-91d0-4ee5-ab98-9d29f9eecacd tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:10.437805 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a3f6677-91d0-4ee5-ab98-9d29f9eecacd tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:10.438889 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a3f6677-91d0-4ee5-ab98-9d29f9eecacd tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:10.440274 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a3f6677-91d0-4ee5-ab98-9d29f9eecacd tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:10.579776 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ba19af10-2d68-4d20-aa2e-f963532696ea tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:10.602023 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ba19af10-2d68-4d20-aa2e-f963532696ea tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65" status: 200 len: 1462 microversion: 2.1 time: 0.686426 Aug 31 15:56:10.603668 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 945/1799] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:09 2022] GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65 => generated 1462 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:10.635712 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-80b1ce21-e10b-4acc-bf0f-c250ccfa2dc9 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:10.639858 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-80b1ce21-e10b-4acc-bf0f-c250ccfa2dc9 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: f550488c-401c-4f00-805b-fe62d75da9d4] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:10.665329 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-80b1ce21-e10b-4acc-bf0f-c250ccfa2dc9 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:10.673410 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-80b1ce21-e10b-4acc-bf0f-c250ccfa2dc9 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:10.674057 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-80b1ce21-e10b-4acc-bf0f-c250ccfa2dc9 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:10.674842 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-80b1ce21-e10b-4acc-bf0f-c250ccfa2dc9 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:10.675610 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-80b1ce21-e10b-4acc-bf0f-c250ccfa2dc9 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:10.678906 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-80b1ce21-e10b-4acc-bf0f-c250ccfa2dc9 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:10.772696 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4a3f6677-91d0-4ee5-ab98-9d29f9eecacd tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:10.795997 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4a3f6677-91d0-4ee5-ab98-9d29f9eecacd tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/11bf6774-dc05-481c-a9f9-29c2ebd4531f" status: 200 len: 1346 microversion: 2.1 time: 0.408537 Aug 31 15:56:10.797042 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 855/1800] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:10 2022] GET /compute/v2.1/servers/11bf6774-dc05-481c-a9f9-29c2ebd4531f => generated 1346 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:10.805645 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-acce8a66-b511-4905-af3c-7a03a2827690 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:10.815287 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-acce8a66-b511-4905-af3c-7a03a2827690 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:10.837347 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-acce8a66-b511-4905-af3c-7a03a2827690 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:10.837884 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-acce8a66-b511-4905-af3c-7a03a2827690 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:10.838373 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-acce8a66-b511-4905-af3c-7a03a2827690 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:10.839863 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-acce8a66-b511-4905-af3c-7a03a2827690 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:10.840517 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-acce8a66-b511-4905-af3c-7a03a2827690 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:10.841159 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-acce8a66-b511-4905-af3c-7a03a2827690 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:10.926510 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-acce8a66-b511-4905-af3c-7a03a2827690 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.127684 Aug 31 15:56:10.927877 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 856/1801] 10.222.0.50 () {60 vars in 1343 bytes} [Wed Aug 31 15:56:10 2022] GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:56:11.024019 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-80b1ce21-e10b-4acc-bf0f-c250ccfa2dc9 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:11.039235 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-80b1ce21-e10b-4acc-bf0f-c250ccfa2dc9 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4" status: 200 len: 1496 microversion: 2.1 time: 0.426018 Aug 31 15:56:11.043248 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 946/1802] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:10 2022] GET /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4 => generated 1496 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:11.050198 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b69736fd-f562-4bbf-bb99-d0be6fcd287a tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:11.051289 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b69736fd-f562-4bbf-bb99-d0be6fcd287a tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] [instance: 56489785-4b4c-4614-acfc-af86763249f9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:11.085908 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b69736fd-f562-4bbf-bb99-d0be6fcd287a tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:11.089649 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b69736fd-f562-4bbf-bb99-d0be6fcd287a tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:11.092439 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b69736fd-f562-4bbf-bb99-d0be6fcd287a tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:11.094337 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b69736fd-f562-4bbf-bb99-d0be6fcd287a tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:11.096682 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b69736fd-f562-4bbf-bb99-d0be6fcd287a tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:11.099976 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b69736fd-f562-4bbf-bb99-d0be6fcd287a tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:11.373375 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b69736fd-f562-4bbf-bb99-d0be6fcd287a tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a66be47dc1d49f68f66ef363ccaccbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a740310041645c8b9c32992012d01aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:11.388375 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b69736fd-f562-4bbf-bb99-d0be6fcd287a tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] 10.222.0.50 "GET /compute/v2.1/servers/56489785-4b4c-4614-acfc-af86763249f9" status: 200 len: 1275 microversion: 2.1 time: 0.343615 Aug 31 15:56:11.389557 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 947/1803] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:11 2022] GET /compute/v2.1/servers/56489785-4b4c-4614-acfc-af86763249f9 => generated 1275 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:11.415922 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-efde489f-fe1f-4212-9d4c-4d4ddf552136 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:11.424360 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-efde489f-fe1f-4212-9d4c-4d4ddf552136 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] [instance: f6574815-a484-4d2d-82b4-9cc761af2c9a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:11.440694 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-efde489f-fe1f-4212-9d4c-4d4ddf552136 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:11.444320 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-efde489f-fe1f-4212-9d4c-4d4ddf552136 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:11.444992 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-efde489f-fe1f-4212-9d4c-4d4ddf552136 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:11.445937 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-efde489f-fe1f-4212-9d4c-4d4ddf552136 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:11.446912 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-efde489f-fe1f-4212-9d4c-4d4ddf552136 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:11.447604 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-efde489f-fe1f-4212-9d4c-4d4ddf552136 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:11.631305 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-efde489f-fe1f-4212-9d4c-4d4ddf552136 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a19bb40252746379cf71a4f4b773b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b53c5033fb543adaeaae8980537d4e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:11.655434 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-efde489f-fe1f-4212-9d4c-4d4ddf552136 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] 10.222.0.50 "GET /compute/v2.1/servers/f6574815-a484-4d2d-82b4-9cc761af2c9a" status: 200 len: 1278 microversion: 2.1 time: 0.255354 Aug 31 15:56:11.661172 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 948/1804] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:11 2022] GET /compute/v2.1/servers/f6574815-a484-4d2d-82b4-9cc761af2c9a => generated 1278 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:11.706408 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4d0e577d-4bb8-4d40-9a92-1bc2931f66a3 tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:11.707243 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4d0e577d-4bb8-4d40-9a92-1bc2931f66a3 tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:11.723428 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d0e577d-4bb8-4d40-9a92-1bc2931f66a3 tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:11.723928 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d0e577d-4bb8-4d40-9a92-1bc2931f66a3 tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:11.730931 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d0e577d-4bb8-4d40-9a92-1bc2931f66a3 tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:11.731700 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d0e577d-4bb8-4d40-9a92-1bc2931f66a3 tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:11.732179 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d0e577d-4bb8-4d40-9a92-1bc2931f66a3 tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:11.738235 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d0e577d-4bb8-4d40-9a92-1bc2931f66a3 tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:11.821802 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9ab5d2a7-9a19-4b03-b385-05776146a912 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:11.824896 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9ab5d2a7-9a19-4b03-b385-05776146a912 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 11bf6774-dc05-481c-a9f9-29c2ebd4531f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:11.847954 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ab5d2a7-9a19-4b03-b385-05776146a912 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:11.850566 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ab5d2a7-9a19-4b03-b385-05776146a912 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:11.854301 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ab5d2a7-9a19-4b03-b385-05776146a912 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:11.855278 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ab5d2a7-9a19-4b03-b385-05776146a912 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:11.855910 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ab5d2a7-9a19-4b03-b385-05776146a912 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:11.856739 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ab5d2a7-9a19-4b03-b385-05776146a912 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:11.951648 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ab5d2a7-9a19-4b03-b385-05776146a912 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:11.952051 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ab5d2a7-9a19-4b03-b385-05776146a912 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:11.952486 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ab5d2a7-9a19-4b03-b385-05776146a912 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:11.952937 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-9ab5d2a7-9a19-4b03-b385-05776146a912 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lazy-loading 'fault' on Instance uuid 11bf6774-dc05-481c-a9f9-29c2ebd4531f {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:56:12.782729 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9ab5d2a7-9a19-4b03-b385-05776146a912 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:12.798478 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9ab5d2a7-9a19-4b03-b385-05776146a912 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/11bf6774-dc05-481c-a9f9-29c2ebd4531f" status: 200 len: 1305 microversion: 2.1 time: 0.983382 Aug 31 15:56:12.800449 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 949/1805] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:11 2022] GET /compute/v2.1/servers/11bf6774-dc05-481c-a9f9-29c2ebd4531f => generated 1305 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:12.816461 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2d453689-e28c-43f5-b368-1041ea117dbd tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:12.820814 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2d453689-e28c-43f5-b368-1041ea117dbd tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:12.835886 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2d453689-e28c-43f5-b368-1041ea117dbd tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:12.838234 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2d453689-e28c-43f5-b368-1041ea117dbd tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:12.845661 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2d453689-e28c-43f5-b368-1041ea117dbd tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:12.846841 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2d453689-e28c-43f5-b368-1041ea117dbd tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:12.847569 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2d453689-e28c-43f5-b368-1041ea117dbd tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:12.848260 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2d453689-e28c-43f5-b368-1041ea117dbd tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:12.924063 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2d453689-e28c-43f5-b368-1041ea117dbd tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.119852 Aug 31 15:56:12.926977 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 950/1806] 10.222.0.50 () {60 vars in 1343 bytes} [Wed Aug 31 15:56:12 2022] GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:56:12.939791 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8b5d8cde-6423-4b29-903a-eeface914968 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:12.944126 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8b5d8cde-6423-4b29-903a-eeface914968 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: f550488c-401c-4f00-805b-fe62d75da9d4] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:12.953017 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4d0e577d-4bb8-4d40-9a92-1bc2931f66a3 tempest-MigrationsAdminTest-303256700 tempest-MigrationsAdminTest-303256700-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65" status: 200 len: 1615 microversion: 2.1 time: 2.024053 Aug 31 15:56:12.957411 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b5d8cde-6423-4b29-903a-eeface914968 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:12.958239 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b5d8cde-6423-4b29-903a-eeface914968 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:12.958909 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b5d8cde-6423-4b29-903a-eeface914968 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:12.959930 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b5d8cde-6423-4b29-903a-eeface914968 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:12.960672 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b5d8cde-6423-4b29-903a-eeface914968 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:12.961350 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b5d8cde-6423-4b29-903a-eeface914968 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:12.967128 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=100 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:56:12.967737 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 857/1807] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:10 2022] GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65 => generated 1615 bytes in 2039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:12.982987 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-64397a7b-0e58-4895-80ec-ab191f5ee579 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:12.983613 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-64397a7b-0e58-4895-80ec-ab191f5ee579 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] [instance: 56489785-4b4c-4614-acfc-af86763249f9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:12.997757 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64397a7b-0e58-4895-80ec-ab191f5ee579 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:12.998641 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64397a7b-0e58-4895-80ec-ab191f5ee579 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:12.999999 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64397a7b-0e58-4895-80ec-ab191f5ee579 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:13.000950 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64397a7b-0e58-4895-80ec-ab191f5ee579 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:13.001607 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64397a7b-0e58-4895-80ec-ab191f5ee579 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:13.002304 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64397a7b-0e58-4895-80ec-ab191f5ee579 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:13.402918 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-64397a7b-0e58-4895-80ec-ab191f5ee579 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a66be47dc1d49f68f66ef363ccaccbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a740310041645c8b9c32992012d01aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:13.411228 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:56:13.419099 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-64397a7b-0e58-4895-80ec-ab191f5ee579 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] 10.222.0.50 "GET /compute/v2.1/servers/56489785-4b4c-4614-acfc-af86763249f9" status: 200 len: 1317 microversion: 2.1 time: 0.448541 Aug 31 15:56:13.429685 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 858/1808] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:12 2022] GET /compute/v2.1/servers/56489785-4b4c-4614-acfc-af86763249f9 => generated 1317 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:13.439448 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ebb88484-4043-4d9d-b761-6bdd1da11005 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:13.442498 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ebb88484-4043-4d9d-b761-6bdd1da11005 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] [instance: f6574815-a484-4d2d-82b4-9cc761af2c9a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:13.467835 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebb88484-4043-4d9d-b761-6bdd1da11005 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:13.471489 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebb88484-4043-4d9d-b761-6bdd1da11005 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:13.472130 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebb88484-4043-4d9d-b761-6bdd1da11005 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:13.474939 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebb88484-4043-4d9d-b761-6bdd1da11005 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:13.475643 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebb88484-4043-4d9d-b761-6bdd1da11005 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:13.475993 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8b5d8cde-6423-4b29-903a-eeface914968 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:13.476463 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebb88484-4043-4d9d-b761-6bdd1da11005 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:13.488395 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8b5d8cde-6423-4b29-903a-eeface914968 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4" status: 200 len: 1496 microversion: 2.1 time: 0.560022 Aug 31 15:56:13.506521 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 951/1809] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:12 2022] GET /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4 => generated 1496 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:13.512653 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-5481ad10-a59b-4f0c-a8aa-f436d4110e35 req-2de9d574-8df6-4484-9022-d2970eda18c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56489785-4b4c-4614-acfc-af86763249f9", "tag": "3a01f967-b20a-4b06-80e1-770ba7e45135"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:13.526215 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-5481ad10-a59b-4f0c-a8aa-f436d4110e35 req-2de9d574-8df6-4484-9022-d2970eda18c8 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:13.527093 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-5481ad10-a59b-4f0c-a8aa-f436d4110e35 req-2de9d574-8df6-4484-9022-d2970eda18c8 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:13.527805 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-5481ad10-a59b-4f0c-a8aa-f436d4110e35 req-2de9d574-8df6-4484-9022-d2970eda18c8 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:13.548243 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-5481ad10-a59b-4f0c-a8aa-f436d4110e35 req-2de9d574-8df6-4484-9022-d2970eda18c8 service nova] Creating event network-changed:3a01f967-b20a-4b06-80e1-770ba7e45135 for instance 56489785-4b4c-4614-acfc-af86763249f9 on n-h2-833090-16 Aug 31 15:56:13.557660 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-5481ad10-a59b-4f0c-a8aa-f436d4110e35 req-2de9d574-8df6-4484-9022-d2970eda18c8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049503 Aug 31 15:56:13.560543 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 952/1810] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:13.571245 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c8d2f5a5-c21b-42b7-a10d-0a83b79babc8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:13.580987 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c8d2f5a5-c21b-42b7-a10d-0a83b79babc8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:13.594558 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8d2f5a5-c21b-42b7-a10d-0a83b79babc8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:13.595369 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8d2f5a5-c21b-42b7-a10d-0a83b79babc8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:13.596210 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8d2f5a5-c21b-42b7-a10d-0a83b79babc8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:13.598080 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8d2f5a5-c21b-42b7-a10d-0a83b79babc8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:13.598861 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8d2f5a5-c21b-42b7-a10d-0a83b79babc8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:13.599519 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8d2f5a5-c21b-42b7-a10d-0a83b79babc8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:13.658890 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c8d2f5a5-c21b-42b7-a10d-0a83b79babc8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:56:13.791869 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:56:13.819146 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c8d2f5a5-c21b-42b7-a10d-0a83b79babc8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65" status: 204 len: 0 microversion: 2.1 time: 0.253541 Aug 31 15:56:13.824761 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 953/1811] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:56:13 2022] DELETE /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:56:13.832001 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-3368599d-e5cd-49ee-93bc-a6499571c167 req-c9fee09c-e28e-411e-b158-ebf19363168f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d065e0ee-199e-4e8b-99ca-5801d627ce65", "name": "network-vif-plugged", "status": "completed", "tag": "b13f13ce-7cbb-472a-bc2c-bb5104160fb0"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:13.846178 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-3368599d-e5cd-49ee-93bc-a6499571c167 req-c9fee09c-e28e-411e-b158-ebf19363168f service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:13.847042 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-3368599d-e5cd-49ee-93bc-a6499571c167 req-c9fee09c-e28e-411e-b158-ebf19363168f service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:13.847575 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-3368599d-e5cd-49ee-93bc-a6499571c167 req-c9fee09c-e28e-411e-b158-ebf19363168f service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:13.863968 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-3368599d-e5cd-49ee-93bc-a6499571c167 req-c9fee09c-e28e-411e-b158-ebf19363168f service nova] Creating event network-vif-plugged:b13f13ce-7cbb-472a-bc2c-bb5104160fb0 for instance d065e0ee-199e-4e8b-99ca-5801d627ce65 on n-h2-833090-16 Aug 31 15:56:13.870979 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ebb88484-4043-4d9d-b761-6bdd1da11005 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a19bb40252746379cf71a4f4b773b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b53c5033fb543adaeaae8980537d4e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:13.871232 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-3368599d-e5cd-49ee-93bc-a6499571c167 req-c9fee09c-e28e-411e-b158-ebf19363168f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044543 Aug 31 15:56:13.872652 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 954/1812] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:13.880261 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-66a9015c-97ed-4649-9c14-0df05dad9267 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:13.881075 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-66a9015c-97ed-4649-9c14-0df05dad9267 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 11bf6774-dc05-481c-a9f9-29c2ebd4531f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:13.885049 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ebb88484-4043-4d9d-b761-6bdd1da11005 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] 10.222.0.50 "GET /compute/v2.1/servers/f6574815-a484-4d2d-82b4-9cc761af2c9a" status: 200 len: 1320 microversion: 2.1 time: 0.453762 Aug 31 15:56:13.885664 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 859/1813] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:13 2022] GET /compute/v2.1/servers/f6574815-a484-4d2d-82b4-9cc761af2c9a => generated 1320 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:13.897404 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-827fceb5-726a-4b2a-8232-ba976cea2fc7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:13.898028 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-827fceb5-726a-4b2a-8232-ba976cea2fc7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:13.900594 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-66a9015c-97ed-4649-9c14-0df05dad9267 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:13.901086 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-66a9015c-97ed-4649-9c14-0df05dad9267 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:13.901511 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-66a9015c-97ed-4649-9c14-0df05dad9267 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:13.903152 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-66a9015c-97ed-4649-9c14-0df05dad9267 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:13.903550 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-66a9015c-97ed-4649-9c14-0df05dad9267 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:13.905840 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-66a9015c-97ed-4649-9c14-0df05dad9267 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:13.925441 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-827fceb5-726a-4b2a-8232-ba976cea2fc7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:13.925952 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-827fceb5-726a-4b2a-8232-ba976cea2fc7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:13.926431 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-827fceb5-726a-4b2a-8232-ba976cea2fc7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:13.927156 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-827fceb5-726a-4b2a-8232-ba976cea2fc7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:13.927621 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-827fceb5-726a-4b2a-8232-ba976cea2fc7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:13.928044 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-827fceb5-726a-4b2a-8232-ba976cea2fc7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:13.942356 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-66a9015c-97ed-4649-9c14-0df05dad9267 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] HTTP exception thrown: Instance 11bf6774-dc05-481c-a9f9-29c2ebd4531f could not be found. Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-66a9015c-97ed-4649-9c14-0df05dad9267 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Request method failure captured: Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/11bf6774-dc05-481c-a9f9-29c2ebd4531f HTTP/1.1 Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4Q2UxjmzRUIcRyBJZeRXZe8f-kxARGQrfLNadx-PtSKRAHFDd-cfjpN41Lm2TAtWQQVK9trDHJa1Iu7P1XlF1-EYrtrhJnDHGb-ivhI0erITWpZsYkLGmnwPDtbMbW99ld2jucgWFbVY0vVDf-y4OAM7Az1owqOg13oLERSA9bN0MQ Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: dde27d282fc24e56a62eaeacff1431d5 Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-DeleteServersTestJSON-1135653165 Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_dde27d282fc24e56a62eaeacff1431d5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-DeleteServersTestJSON-1135653165 Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: dde27d282fc24e56a62eaeacff1431d5 Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-DeleteServersTestJSON-1135653165 Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-DeleteServersTestJSON-1135653165-project Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 4d4f2146c3bc4a64b5d7f72cd136b6db Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-DeleteServersTestJSON-1135653165-project Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 11bf6774-dc05-481c-a9f9-29c2ebd4531f could not be found. Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '11bf6774-dc05-481c-a9f9-29c2ebd4531f'} Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11bf6774-dc05-481c-a9f9-29c2ebd4531f could not be found. Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11bf6774-dc05-481c-a9f9-29c2ebd4531f could not be found. Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:13.946262 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:56:13.955088 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:13.955088 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:13.955088 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:13.955088 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:56:13.955088 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:56:13.955088 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11bf6774-dc05-481c-a9f9-29c2ebd4531f could not be found. Aug 31 15:56:13.955088 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:56:13.955088 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-66a9015c-97ed-4649-9c14-0df05dad9267 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Returning 404 to user: Instance 11bf6774-dc05-481c-a9f9-29c2ebd4531f could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:56:13.955088 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-66a9015c-97ed-4649-9c14-0df05dad9267 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/11bf6774-dc05-481c-a9f9-29c2ebd4531f" status: 404 len: 111 microversion: 2.1 time: 0.071671 Aug 31 15:56:13.955088 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 955/1814] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:13 2022] GET /compute/v2.1/servers/11bf6774-dc05-481c-a9f9-29c2ebd4531f => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:56:13.955088 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-54e7537b-fb9d-45c4-8435-26da1847f722 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:13.957412 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-54e7537b-fb9d-45c4-8435-26da1847f722 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:13.964728 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-54e7537b-fb9d-45c4-8435-26da1847f722 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:13.965214 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-54e7537b-fb9d-45c4-8435-26da1847f722 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:13.965681 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-54e7537b-fb9d-45c4-8435-26da1847f722 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:13.966398 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-54e7537b-fb9d-45c4-8435-26da1847f722 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:13.966847 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-54e7537b-fb9d-45c4-8435-26da1847f722 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:13.967266 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-54e7537b-fb9d-45c4-8435-26da1847f722 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:14.022265 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-54e7537b-fb9d-45c4-8435-26da1847f722 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.071590 Aug 31 15:56:14.028448 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 956/1815] 10.222.0.50 () {60 vars in 1343 bytes} [Wed Aug 31 15:56:13 2022] GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:56:14.159614 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3f22b05c-c9dc-466a-a234-82d191908178 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:14.161940 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3f22b05c-c9dc-466a-a234-82d191908178 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 11bf6774-dc05-481c-a9f9-29c2ebd4531f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:14.170305 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3f22b05c-c9dc-466a-a234-82d191908178 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:14.170940 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3f22b05c-c9dc-466a-a234-82d191908178 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:14.171470 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3f22b05c-c9dc-466a-a234-82d191908178 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:14.172276 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3f22b05c-c9dc-466a-a234-82d191908178 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:14.172832 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3f22b05c-c9dc-466a-a234-82d191908178 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:14.173390 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3f22b05c-c9dc-466a-a234-82d191908178 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:14.184492 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-827fceb5-726a-4b2a-8232-ba976cea2fc7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:14.189424 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-3f22b05c-c9dc-466a-a234-82d191908178 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] HTTP exception thrown: Instance 11bf6774-dc05-481c-a9f9-29c2ebd4531f could not be found. Aug 31 15:56:14.191494 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3f22b05c-c9dc-466a-a234-82d191908178 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Request method failure captured: Aug 31 15:56:14.191494 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/11bf6774-dc05-481c-a9f9-29c2ebd4531f/os-volume_attachments HTTP/1.1 Aug 31 15:56:14.191494 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:56:14.191494 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:56:14.191494 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:56:14.191494 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:56:14.191494 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:56:14.191494 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:56:14.191494 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:56:14.191494 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:56:14.191494 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4Q2UxjmzRUIcRyBJZeRXZe8f-kxARGQrfLNadx-PtSKRAHFDd-cfjpN41Lm2TAtWQQVK9trDHJa1Iu7P1XlF1-EYrtrhJnDHGb-ivhI0erITWpZsYkLGmnwPDtbMbW99ld2jucgWFbVY0vVDf-y4OAM7Az1owqOg13oLERSA9bN0MQ Aug 31 15:56:14.191494 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:56:14.191494 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:56:14.191494 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:56:14.191494 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:56:14.191494 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:56:14.191494 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:56:14.191494 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: dde27d282fc24e56a62eaeacff1431d5 Aug 31 15:56:14.191494 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-DeleteServersTestJSON-1135653165 Aug 31 15:56:14.191494 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:56:14.191494 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:56:14.191494 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_dde27d282fc24e56a62eaeacff1431d5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:56:14.191494 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-DeleteServersTestJSON-1135653165 Aug 31 15:56:14.191494 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: dde27d282fc24e56a62eaeacff1431d5 Aug 31 15:56:14.191494 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-DeleteServersTestJSON-1135653165 Aug 31 15:56:14.191494 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-DeleteServersTestJSON-1135653165-project Aug 31 15:56:14.191494 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:56:14.191494 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:56:14.191494 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 4d4f2146c3bc4a64b5d7f72cd136b6db Aug 31 15:56:14.191494 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-DeleteServersTestJSON-1135653165-project Aug 31 15:56:14.191494 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:56:14.191494 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 11bf6774-dc05-481c-a9f9-29c2ebd4531f could not be found. Aug 31 15:56:14.191494 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'server_id': '11bf6774-dc05-481c-a9f9-29c2ebd4531f'} Aug 31 15:56:14.191494 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:56:14.191494 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:14.191494 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:56:14.191494 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:56:14.191494 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:56:14.191494 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:56:14.191494 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:56:14.191494 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:56:14.191494 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:56:14.191494 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:56:14.191494 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11bf6774-dc05-481c-a9f9-29c2ebd4531f could not be found. Aug 31 15:56:14.191494 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:56:14.191494 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:14.191494 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:56:14.191494 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:14.191494 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:14.191494 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:14.191494 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:56:14.191494 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:56:14.191494 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:56:14.191494 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:56:14.191494 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 15:56:14.191494 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:56:14.191494 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 15:56:14.191494 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:56:14.191494 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 31 15:56:14.191494 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 31 15:56:14.191494 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:56:14.191494 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:56:14.197535 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11bf6774-dc05-481c-a9f9-29c2ebd4531f could not be found. Aug 31 15:56:14.197535 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:56:14.197535 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:14.197535 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:56:14.197535 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:14.197535 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:14.197535 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:14.197535 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:56:14.197535 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:56:14.197535 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11bf6774-dc05-481c-a9f9-29c2ebd4531f could not be found. Aug 31 15:56:14.197535 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:56:14.198533 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-827fceb5-726a-4b2a-8232-ba976cea2fc7 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65" status: 200 len: 1468 microversion: 2.1 time: 0.299202 Aug 31 15:56:14.198651 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3f22b05c-c9dc-466a-a234-82d191908178 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Returning 404 to user: Instance 11bf6774-dc05-481c-a9f9-29c2ebd4531f could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:56:14.200442 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3f22b05c-c9dc-466a-a234-82d191908178 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/11bf6774-dc05-481c-a9f9-29c2ebd4531f/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.042392 Aug 31 15:56:14.203583 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 957/1816] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 15:56:14 2022] GET /compute/v2.1/servers/11bf6774-dc05-481c-a9f9-29c2ebd4531f/os-volume_attachments => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 15:56:14.211416 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 860/1817] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:13 2022] GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65 => generated 1468 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:14.441883 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6104572e-354c-4e6c-b107-00a7c1bf0c98 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:14.442895 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6104572e-354c-4e6c-b107-00a7c1bf0c98 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] [instance: 56489785-4b4c-4614-acfc-af86763249f9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:14.454457 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6104572e-354c-4e6c-b107-00a7c1bf0c98 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:14.455052 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6104572e-354c-4e6c-b107-00a7c1bf0c98 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:14.462218 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6104572e-354c-4e6c-b107-00a7c1bf0c98 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:14.465436 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6104572e-354c-4e6c-b107-00a7c1bf0c98 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:14.467895 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6104572e-354c-4e6c-b107-00a7c1bf0c98 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:14.468683 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6104572e-354c-4e6c-b107-00a7c1bf0c98 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:14.490986 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4e9e9dd2-a96e-4fc6-813f-fe46d9f0cc66 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-964117507", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "e71afd64-faa4-4680-b8e0-76fe805d5df1"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:14.588697 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-4e9e9dd2-a96e-4fc6-813f-fe46d9f0cc66 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] validate_networks() for [('e71afd64-faa4-4680-b8e0-76fe805d5df1', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:56:14.871983 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6104572e-354c-4e6c-b107-00a7c1bf0c98 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a66be47dc1d49f68f66ef363ccaccbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a740310041645c8b9c32992012d01aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:14.883417 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6104572e-354c-4e6c-b107-00a7c1bf0c98 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] 10.222.0.50 "GET /compute/v2.1/servers/56489785-4b4c-4614-acfc-af86763249f9" status: 200 len: 1317 microversion: 2.1 time: 0.446223 Aug 31 15:56:14.884649 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 958/1818] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:14 2022] GET /compute/v2.1/servers/56489785-4b4c-4614-acfc-af86763249f9 => generated 1317 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:14.902129 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c2fdd541-4535-4ab9-b501-ddb7d7e2e79f tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:14.902756 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c2fdd541-4535-4ab9-b501-ddb7d7e2e79f tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: f550488c-401c-4f00-805b-fe62d75da9d4] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:14.908929 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c2fdd541-4535-4ab9-b501-ddb7d7e2e79f tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:14.909408 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c2fdd541-4535-4ab9-b501-ddb7d7e2e79f tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:14.909841 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c2fdd541-4535-4ab9-b501-ddb7d7e2e79f tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:14.910567 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c2fdd541-4535-4ab9-b501-ddb7d7e2e79f tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:14.911019 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c2fdd541-4535-4ab9-b501-ddb7d7e2e79f tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:14.911440 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c2fdd541-4535-4ab9-b501-ddb7d7e2e79f tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:15.375542 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c2fdd541-4535-4ab9-b501-ddb7d7e2e79f tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:15.390847 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c2fdd541-4535-4ab9-b501-ddb7d7e2e79f tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4" status: 200 len: 1496 microversion: 2.1 time: 0.505133 Aug 31 15:56:15.391447 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 959/1819] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:14 2022] GET /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4 => generated 1496 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:15.395928 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-cd5f0d9d-abf4-4c67-b05d-fd08fc311c0d tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:15.396534 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-cd5f0d9d-abf4-4c67-b05d-fd08fc311c0d tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] [instance: f6574815-a484-4d2d-82b4-9cc761af2c9a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:15.418640 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cd5f0d9d-abf4-4c67-b05d-fd08fc311c0d tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:15.419135 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cd5f0d9d-abf4-4c67-b05d-fd08fc311c0d tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:15.419563 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cd5f0d9d-abf4-4c67-b05d-fd08fc311c0d tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:15.420271 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cd5f0d9d-abf4-4c67-b05d-fd08fc311c0d tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:15.420719 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cd5f0d9d-abf4-4c67-b05d-fd08fc311c0d tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:15.421131 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cd5f0d9d-abf4-4c67-b05d-fd08fc311c0d tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:15.475775 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-4e9e9dd2-a96e-4fc6-813f-fe46d9f0cc66 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:56:15.476509 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-4e9e9dd2-a96e-4fc6-813f-fe46d9f0cc66 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:56:15.476987 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-4e9e9dd2-a96e-4fc6-813f-fe46d9f0cc66 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:56:15.477433 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-4e9e9dd2-a96e-4fc6-813f-fe46d9f0cc66 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:56:15.477837 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-4e9e9dd2-a96e-4fc6-813f-fe46d9f0cc66 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:56:15.494232 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e9e9dd2-a96e-4fc6-813f-fe46d9f0cc66 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:15.496160 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e9e9dd2-a96e-4fc6-813f-fe46d9f0cc66 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:15.498636 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e9e9dd2-a96e-4fc6-813f-fe46d9f0cc66 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:15.499610 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e9e9dd2-a96e-4fc6-813f-fe46d9f0cc66 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:15.501071 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e9e9dd2-a96e-4fc6-813f-fe46d9f0cc66 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:15.504198 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e9e9dd2-a96e-4fc6-813f-fe46d9f0cc66 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:15.548015 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-4e9e9dd2-a96e-4fc6-813f-fe46d9f0cc66 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Getting quotas for project dde27d282fc24e56a62eaeacff1431d5. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:56:15.567181 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-4e9e9dd2-a96e-4fc6-813f-fe46d9f0cc66 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Getting quotas for user 4d4f2146c3bc4a64b5d7f72cd136b6db and project dde27d282fc24e56a62eaeacff1431d5. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:56:15.606316 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4e9e9dd2-a96e-4fc6-813f-fe46d9f0cc66 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:56:15.623963 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4e9e9dd2-a96e-4fc6-813f-fe46d9f0cc66 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: d47f69b3-01f9-4cd1-a48f-53af8e3a2b8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:56:15.698750 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-cd5f0d9d-abf4-4c67-b05d-fd08fc311c0d tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a19bb40252746379cf71a4f4b773b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b53c5033fb543adaeaae8980537d4e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:15.715562 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-cd5f0d9d-abf4-4c67-b05d-fd08fc311c0d tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] 10.222.0.50 "GET /compute/v2.1/servers/f6574815-a484-4d2d-82b4-9cc761af2c9a" status: 200 len: 1320 microversion: 2.1 time: 0.322995 Aug 31 15:56:15.716457 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 960/1820] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:15 2022] GET /compute/v2.1/servers/f6574815-a484-4d2d-82b4-9cc761af2c9a => generated 1320 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:15.721002 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e52b7774-356f-489a-9a6a-d796437da5ba tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:15.761112 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e52b7774-356f-489a-9a6a-d796437da5ba tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:15.762333 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4e9e9dd2-a96e-4fc6-813f-fe46d9f0cc66 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.275482 Aug 31 15:56:15.764111 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 861/1821] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:56:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1278 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 15:56:15.780622 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5384c943-db0e-414f-b48c-5553a849c8f2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:15.782432 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e52b7774-356f-489a-9a6a-d796437da5ba tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:15.783181 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e52b7774-356f-489a-9a6a-d796437da5ba tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:15.784206 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5384c943-db0e-414f-b48c-5553a849c8f2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:15.785036 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e52b7774-356f-489a-9a6a-d796437da5ba tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:15.786037 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e52b7774-356f-489a-9a6a-d796437da5ba tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:15.787999 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e52b7774-356f-489a-9a6a-d796437da5ba tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:15.803063 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e52b7774-356f-489a-9a6a-d796437da5ba tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:15.803737 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5384c943-db0e-414f-b48c-5553a849c8f2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:15.804241 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5384c943-db0e-414f-b48c-5553a849c8f2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:15.805857 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5384c943-db0e-414f-b48c-5553a849c8f2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:15.807428 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5384c943-db0e-414f-b48c-5553a849c8f2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:15.810042 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5384c943-db0e-414f-b48c-5553a849c8f2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:15.811834 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5384c943-db0e-414f-b48c-5553a849c8f2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:15.854201 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e52b7774-356f-489a-9a6a-d796437da5ba tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.136767 Aug 31 15:56:15.856047 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 961/1822] 10.222.0.50 () {60 vars in 1343 bytes} [Wed Aug 31 15:56:15 2022] GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:56:15.863407 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-5417ebca-7143-4345-a082-1d27bcbc6b71 req-2c64c406-2abc-4503-9cda-412d4167c824 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6574815-a484-4d2d-82b4-9cc761af2c9a", "tag": "e900c20a-83c0-42c1-84b7-37696eebbb29"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:15.874797 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-5417ebca-7143-4345-a082-1d27bcbc6b71 req-2c64c406-2abc-4503-9cda-412d4167c824 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:15.876380 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-5417ebca-7143-4345-a082-1d27bcbc6b71 req-2c64c406-2abc-4503-9cda-412d4167c824 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:15.877033 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-5417ebca-7143-4345-a082-1d27bcbc6b71 req-2c64c406-2abc-4503-9cda-412d4167c824 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:15.894180 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-5417ebca-7143-4345-a082-1d27bcbc6b71 req-2c64c406-2abc-4503-9cda-412d4167c824 service nova] Creating event network-changed:e900c20a-83c0-42c1-84b7-37696eebbb29 for instance f6574815-a484-4d2d-82b4-9cc761af2c9a on n-h2-833090-16 Aug 31 15:56:15.902423 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-5417ebca-7143-4345-a082-1d27bcbc6b71 req-2c64c406-2abc-4503-9cda-412d4167c824 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044539 Aug 31 15:56:15.914924 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 962/1823] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:15.922595 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-bceca553-4ab7-474a-9357-67b76726d422 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:15.923308 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-bceca553-4ab7-474a-9357-67b76726d422 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: d47f69b3-01f9-4cd1-a48f-53af8e3a2b8a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:16.081277 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-bceca553-4ab7-474a-9357-67b76726d422 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:16.091521 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-bceca553-4ab7-474a-9357-67b76726d422 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/d47f69b3-01f9-4cd1-a48f-53af8e3a2b8a" status: 200 len: 1214 microversion: 2.1 time: 0.172490 Aug 31 15:56:16.095544 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 963/1824] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:15 2022] GET /compute/v2.1/servers/d47f69b3-01f9-4cd1-a48f-53af8e3a2b8a => generated 1214 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:16.111015 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ce3accbc-5d09-449f-8531-7adf54b24bbe tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:16.112595 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ce3accbc-5d09-449f-8531-7adf54b24bbe tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] [instance: 56489785-4b4c-4614-acfc-af86763249f9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:16.124931 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ce3accbc-5d09-449f-8531-7adf54b24bbe tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:16.130877 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ce3accbc-5d09-449f-8531-7adf54b24bbe tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:16.131331 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ce3accbc-5d09-449f-8531-7adf54b24bbe tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:16.133794 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ce3accbc-5d09-449f-8531-7adf54b24bbe tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:16.136122 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ce3accbc-5d09-449f-8531-7adf54b24bbe tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:16.136577 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ce3accbc-5d09-449f-8531-7adf54b24bbe tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:16.156286 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5384c943-db0e-414f-b48c-5553a849c8f2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:16.172557 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5384c943-db0e-414f-b48c-5553a849c8f2 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65" status: 200 len: 1468 microversion: 2.1 time: 0.406398 Aug 31 15:56:16.176400 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 862/1825] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:15 2022] GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65 => generated 1468 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:16.184561 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6b7f04f8-dee3-4c0d-a619-552ffe179d6c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:16.185977 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6b7f04f8-dee3-4c0d-a619-552ffe179d6c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: d47f69b3-01f9-4cd1-a48f-53af8e3a2b8a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:16.236466 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6b7f04f8-dee3-4c0d-a619-552ffe179d6c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: d47f69b3-01f9-4cd1-a48f-53af8e3a2b8a] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:56:16.378737 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ce3accbc-5d09-449f-8531-7adf54b24bbe tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a66be47dc1d49f68f66ef363ccaccbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a740310041645c8b9c32992012d01aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:16.396736 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ce3accbc-5d09-449f-8531-7adf54b24bbe tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] 10.222.0.50 "GET /compute/v2.1/servers/56489785-4b4c-4614-acfc-af86763249f9" status: 200 len: 1317 microversion: 2.1 time: 0.299618 Aug 31 15:56:16.397981 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 964/1826] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:16 2022] GET /compute/v2.1/servers/56489785-4b4c-4614-acfc-af86763249f9 => generated 1317 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:16.417779 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e561eb9d-43a9-4e79-8b85-f0b5785ba3ad tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:16.418791 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e561eb9d-43a9-4e79-8b85-f0b5785ba3ad tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: f550488c-401c-4f00-805b-fe62d75da9d4] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:16.426148 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e561eb9d-43a9-4e79-8b85-f0b5785ba3ad tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:16.427180 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e561eb9d-43a9-4e79-8b85-f0b5785ba3ad tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:16.427858 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e561eb9d-43a9-4e79-8b85-f0b5785ba3ad tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:16.428756 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e561eb9d-43a9-4e79-8b85-f0b5785ba3ad tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:16.429410 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e561eb9d-43a9-4e79-8b85-f0b5785ba3ad tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:16.430048 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e561eb9d-43a9-4e79-8b85-f0b5785ba3ad tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:16.511374 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=4 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:56:16.635196 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.scheduler.client.report [None req-6b7f04f8-dee3-4c0d-a619-552ffe179d6c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Deleted allocations for instance d47f69b3-01f9-4cd1-a48f-53af8e3a2b8a Aug 31 15:56:16.668668 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e561eb9d-43a9-4e79-8b85-f0b5785ba3ad tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:16.677548 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6b7f04f8-dee3-4c0d-a619-552ffe179d6c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d47f69b3-01f9-4cd1-a48f-53af8e3a2b8a" status: 204 len: 0 microversion: 2.1 time: 0.497085 Aug 31 15:56:16.678175 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 863/1827] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:56:16 2022] DELETE /compute/v2.1/servers/d47f69b3-01f9-4cd1-a48f-53af8e3a2b8a => generated 0 bytes in 500 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:56:16.681837 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e561eb9d-43a9-4e79-8b85-f0b5785ba3ad tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4" status: 200 len: 1496 microversion: 2.1 time: 0.268188 Aug 31 15:56:16.696292 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 965/1828] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:16 2022] GET /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4 => generated 1496 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:16.696539 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-411b7da7-d3cd-4ed6-b3b7-4f3f3fa1095e tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:16.696539 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-411b7da7-d3cd-4ed6-b3b7-4f3f3fa1095e tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: d47f69b3-01f9-4cd1-a48f-53af8e3a2b8a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:16.702558 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-411b7da7-d3cd-4ed6-b3b7-4f3f3fa1095e tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:16.703117 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-411b7da7-d3cd-4ed6-b3b7-4f3f3fa1095e tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:16.703659 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-411b7da7-d3cd-4ed6-b3b7-4f3f3fa1095e tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:16.704426 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-411b7da7-d3cd-4ed6-b3b7-4f3f3fa1095e tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:16.704939 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-411b7da7-d3cd-4ed6-b3b7-4f3f3fa1095e tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:16.705577 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-411b7da7-d3cd-4ed6-b3b7-4f3f3fa1095e tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:16.736458 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c2629245-ba8e-4f76-a579-5d2f4656fa14 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:16.737130 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c2629245-ba8e-4f76-a579-5d2f4656fa14 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] [instance: f6574815-a484-4d2d-82b4-9cc761af2c9a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:16.745496 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c2629245-ba8e-4f76-a579-5d2f4656fa14 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:16.745996 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c2629245-ba8e-4f76-a579-5d2f4656fa14 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:16.746469 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c2629245-ba8e-4f76-a579-5d2f4656fa14 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:16.747173 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c2629245-ba8e-4f76-a579-5d2f4656fa14 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:16.747603 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c2629245-ba8e-4f76-a579-5d2f4656fa14 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:16.748021 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c2629245-ba8e-4f76-a579-5d2f4656fa14 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:16.834543 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-411b7da7-d3cd-4ed6-b3b7-4f3f3fa1095e tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:16.850619 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-411b7da7-d3cd-4ed6-b3b7-4f3f3fa1095e tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/d47f69b3-01f9-4cd1-a48f-53af8e3a2b8a" status: 200 len: 1218 microversion: 2.1 time: 0.161375 Aug 31 15:56:16.851464 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 864/1829] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:16 2022] GET /compute/v2.1/servers/d47f69b3-01f9-4cd1-a48f-53af8e3a2b8a => generated 1218 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:56:16.872907 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e9fb6d8a-5381-4367-989e-1bf474d1be93 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:16.880796 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e9fb6d8a-5381-4367-989e-1bf474d1be93 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:16.892899 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9fb6d8a-5381-4367-989e-1bf474d1be93 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:16.893883 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9fb6d8a-5381-4367-989e-1bf474d1be93 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:16.894515 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9fb6d8a-5381-4367-989e-1bf474d1be93 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:16.896935 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9fb6d8a-5381-4367-989e-1bf474d1be93 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:16.897584 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9fb6d8a-5381-4367-989e-1bf474d1be93 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:16.898394 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9fb6d8a-5381-4367-989e-1bf474d1be93 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:16.944548 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e9fb6d8a-5381-4367-989e-1bf474d1be93 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.081196 Aug 31 15:56:16.946258 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 865/1830] 10.222.0.50 () {60 vars in 1343 bytes} [Wed Aug 31 15:56:16 2022] GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 15:56:17.028785 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c2629245-ba8e-4f76-a579-5d2f4656fa14 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a19bb40252746379cf71a4f4b773b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b53c5033fb543adaeaae8980537d4e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:17.040889 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c2629245-ba8e-4f76-a579-5d2f4656fa14 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] 10.222.0.50 "GET /compute/v2.1/servers/f6574815-a484-4d2d-82b4-9cc761af2c9a" status: 200 len: 1320 microversion: 2.1 time: 0.308445 Aug 31 15:56:17.042232 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 966/1831] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:16 2022] GET /compute/v2.1/servers/f6574815-a484-4d2d-82b4-9cc761af2c9a => generated 1320 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:17.200263 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ef810ac1-2523-4938-b781-638102462f8d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:17.200866 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ef810ac1-2523-4938-b781-638102462f8d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:17.207869 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef810ac1-2523-4938-b781-638102462f8d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:17.208363 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef810ac1-2523-4938-b781-638102462f8d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:17.208830 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef810ac1-2523-4938-b781-638102462f8d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:17.209558 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef810ac1-2523-4938-b781-638102462f8d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:17.210059 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef810ac1-2523-4938-b781-638102462f8d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:17.210546 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef810ac1-2523-4938-b781-638102462f8d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:17.386671 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ef810ac1-2523-4938-b781-638102462f8d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:17.395468 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ef810ac1-2523-4938-b781-638102462f8d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65" status: 200 len: 1468 microversion: 2.1 time: 0.198976 Aug 31 15:56:17.396667 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 866/1832] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:17 2022] GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65 => generated 1468 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:17.419471 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-890168a8-40d5-4613-ad74-9d582117b6ac tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:17.421118 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-890168a8-40d5-4613-ad74-9d582117b6ac tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] [instance: 56489785-4b4c-4614-acfc-af86763249f9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:17.428206 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-890168a8-40d5-4613-ad74-9d582117b6ac tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:17.432233 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-890168a8-40d5-4613-ad74-9d582117b6ac tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:17.433042 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-890168a8-40d5-4613-ad74-9d582117b6ac tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:17.434209 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-890168a8-40d5-4613-ad74-9d582117b6ac tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:17.434773 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-890168a8-40d5-4613-ad74-9d582117b6ac tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:17.435689 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-890168a8-40d5-4613-ad74-9d582117b6ac tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:17.608963 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-890168a8-40d5-4613-ad74-9d582117b6ac tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a66be47dc1d49f68f66ef363ccaccbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a740310041645c8b9c32992012d01aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:17.642881 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-890168a8-40d5-4613-ad74-9d582117b6ac tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] 10.222.0.50 "GET /compute/v2.1/servers/56489785-4b4c-4614-acfc-af86763249f9" status: 200 len: 1317 microversion: 2.1 time: 0.227719 Aug 31 15:56:17.652036 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 967/1833] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:17 2022] GET /compute/v2.1/servers/56489785-4b4c-4614-acfc-af86763249f9 => generated 1317 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:17.705943 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ae0132f5-87a9-4e74-bc91-29a021351788 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:17.706986 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ae0132f5-87a9-4e74-bc91-29a021351788 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: f550488c-401c-4f00-805b-fe62d75da9d4] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:17.719497 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae0132f5-87a9-4e74-bc91-29a021351788 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:17.720044 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae0132f5-87a9-4e74-bc91-29a021351788 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:17.720465 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae0132f5-87a9-4e74-bc91-29a021351788 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:17.721183 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae0132f5-87a9-4e74-bc91-29a021351788 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:17.725489 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae0132f5-87a9-4e74-bc91-29a021351788 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:17.725967 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae0132f5-87a9-4e74-bc91-29a021351788 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:17.873138 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-afd1628d-0c55-47ff-ac45-e7f0bae71295 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:17.873841 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-afd1628d-0c55-47ff-ac45-e7f0bae71295 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: d47f69b3-01f9-4cd1-a48f-53af8e3a2b8a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:17.881140 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-afd1628d-0c55-47ff-ac45-e7f0bae71295 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:17.889209 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-afd1628d-0c55-47ff-ac45-e7f0bae71295 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:17.889959 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-afd1628d-0c55-47ff-ac45-e7f0bae71295 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:17.890943 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-afd1628d-0c55-47ff-ac45-e7f0bae71295 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:17.891615 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-afd1628d-0c55-47ff-ac45-e7f0bae71295 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:17.892716 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-afd1628d-0c55-47ff-ac45-e7f0bae71295 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:17.927535 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-afd1628d-0c55-47ff-ac45-e7f0bae71295 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] HTTP exception thrown: Instance d47f69b3-01f9-4cd1-a48f-53af8e3a2b8a could not be found. Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-afd1628d-0c55-47ff-ac45-e7f0bae71295 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Request method failure captured: Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/d47f69b3-01f9-4cd1-a48f-53af8e3a2b8a HTTP/1.1 Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4Q2UxjmzRUIcRyBJZeRXZe8f-kxARGQrfLNadx-PtSKRAHFDd-cfjpN41Lm2TAtWQQVK9trDHJa1Iu7P1XlF1-EYrtrhJnDHGb-ivhI0erITWpZsYkLGmnwPDtbMbW99ld2jucgWFbVY0vVDf-y4OAM7Az1owqOg13oLERSA9bN0MQ Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: dde27d282fc24e56a62eaeacff1431d5 Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-DeleteServersTestJSON-1135653165 Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_dde27d282fc24e56a62eaeacff1431d5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-DeleteServersTestJSON-1135653165 Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: dde27d282fc24e56a62eaeacff1431d5 Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-DeleteServersTestJSON-1135653165 Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-DeleteServersTestJSON-1135653165-project Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 4d4f2146c3bc4a64b5d7f72cd136b6db Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-DeleteServersTestJSON-1135653165-project Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance d47f69b3-01f9-4cd1-a48f-53af8e3a2b8a could not be found. Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'd47f69b3-01f9-4cd1-a48f-53af8e3a2b8a'} Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d47f69b3-01f9-4cd1-a48f-53af8e3a2b8a could not be found. Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d47f69b3-01f9-4cd1-a48f-53af8e3a2b8a could not be found. Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:17.930710 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:56:17.935491 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:17.935491 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:17.935491 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:17.935491 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:56:17.935491 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:56:17.935491 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d47f69b3-01f9-4cd1-a48f-53af8e3a2b8a could not be found. Aug 31 15:56:17.935491 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:56:17.935491 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-afd1628d-0c55-47ff-ac45-e7f0bae71295 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Returning 404 to user: Instance d47f69b3-01f9-4cd1-a48f-53af8e3a2b8a could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:56:17.935491 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-afd1628d-0c55-47ff-ac45-e7f0bae71295 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/d47f69b3-01f9-4cd1-a48f-53af8e3a2b8a" status: 404 len: 111 microversion: 2.1 time: 0.065590 Aug 31 15:56:17.948227 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 968/1834] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:17 2022] GET /compute/v2.1/servers/d47f69b3-01f9-4cd1-a48f-53af8e3a2b8a => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 15:56:17.970450 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-83467156-fe97-4303-b7d6-9415720f6e88 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:17.989147 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-83467156-fe97-4303-b7d6-9415720f6e88 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:18.010245 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83467156-fe97-4303-b7d6-9415720f6e88 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:18.011072 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83467156-fe97-4303-b7d6-9415720f6e88 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:18.017557 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83467156-fe97-4303-b7d6-9415720f6e88 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:18.019207 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83467156-fe97-4303-b7d6-9415720f6e88 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:18.020113 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83467156-fe97-4303-b7d6-9415720f6e88 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:18.020726 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83467156-fe97-4303-b7d6-9415720f6e88 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:18.060305 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-83467156-fe97-4303-b7d6-9415720f6e88 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.107259 Aug 31 15:56:18.064309 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 969/1835] 10.222.0.50 () {60 vars in 1343 bytes} [Wed Aug 31 15:56:17 2022] GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a/os-volume_attachments => generated 25 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:56:18.071999 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-67edf1b8-99e8-4343-a890-627a9bb2fb2b tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:18.074813 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-67edf1b8-99e8-4343-a890-627a9bb2fb2b tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] [instance: f6574815-a484-4d2d-82b4-9cc761af2c9a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:18.091488 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-67edf1b8-99e8-4343-a890-627a9bb2fb2b tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:18.094158 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-67edf1b8-99e8-4343-a890-627a9bb2fb2b tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:18.094700 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-67edf1b8-99e8-4343-a890-627a9bb2fb2b tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:18.095512 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-67edf1b8-99e8-4343-a890-627a9bb2fb2b tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:18.098331 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-67edf1b8-99e8-4343-a890-627a9bb2fb2b tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:18.100723 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-67edf1b8-99e8-4343-a890-627a9bb2fb2b tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:18.165469 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ae0132f5-87a9-4e74-bc91-29a021351788 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:18.173704 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ae0132f5-87a9-4e74-bc91-29a021351788 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4" status: 200 len: 1496 microversion: 2.1 time: 0.472522 Aug 31 15:56:18.174839 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 867/1836] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:17 2022] GET /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4 => generated 1496 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:18.195985 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e4488ceb-14dd-405b-8d93-d7bd653b3788 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2006110338", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "e71afd64-faa4-4680-b8e0-76fe805d5df1"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:18.345825 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-e4488ceb-14dd-405b-8d93-d7bd653b3788 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] validate_networks() for [('e71afd64-faa4-4680-b8e0-76fe805d5df1', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:56:18.441664 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-67edf1b8-99e8-4343-a890-627a9bb2fb2b tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a19bb40252746379cf71a4f4b773b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b53c5033fb543adaeaae8980537d4e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:18.454729 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-67edf1b8-99e8-4343-a890-627a9bb2fb2b tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] 10.222.0.50 "GET /compute/v2.1/servers/f6574815-a484-4d2d-82b4-9cc761af2c9a" status: 200 len: 1320 microversion: 2.1 time: 0.388836 Aug 31 15:56:18.473282 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 970/1837] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:18 2022] GET /compute/v2.1/servers/f6574815-a484-4d2d-82b4-9cc761af2c9a => generated 1320 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:18.486036 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-cc7e2ee0-e96d-4ff8-8f1f-16e6961ba7ba tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:18.486702 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-cc7e2ee0-e96d-4ff8-8f1f-16e6961ba7ba tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:18.497334 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cc7e2ee0-e96d-4ff8-8f1f-16e6961ba7ba tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:18.497826 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cc7e2ee0-e96d-4ff8-8f1f-16e6961ba7ba tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:18.505267 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cc7e2ee0-e96d-4ff8-8f1f-16e6961ba7ba tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:18.506361 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cc7e2ee0-e96d-4ff8-8f1f-16e6961ba7ba tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:18.506861 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cc7e2ee0-e96d-4ff8-8f1f-16e6961ba7ba tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:18.507311 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cc7e2ee0-e96d-4ff8-8f1f-16e6961ba7ba tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:18.513479 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:56:19.308580 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-cc7e2ee0-e96d-4ff8-8f1f-16e6961ba7ba tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:19.323215 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-cc7e2ee0-e96d-4ff8-8f1f-16e6961ba7ba tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65" status: 200 len: 1468 microversion: 2.1 time: 0.848685 Aug 31 15:56:19.327605 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 971/1838] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:18 2022] GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65 => generated 1468 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:19.334261 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-29c76737-a709-4c38-b8f5-88b40542205f tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:19.345258 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-29c76737-a709-4c38-b8f5-88b40542205f tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] [instance: 56489785-4b4c-4614-acfc-af86763249f9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:19.357623 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-29c76737-a709-4c38-b8f5-88b40542205f tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:19.360517 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-29c76737-a709-4c38-b8f5-88b40542205f tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:19.361145 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-29c76737-a709-4c38-b8f5-88b40542205f tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:19.363023 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-29c76737-a709-4c38-b8f5-88b40542205f tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:19.364928 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-29c76737-a709-4c38-b8f5-88b40542205f tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:19.365542 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-29c76737-a709-4c38-b8f5-88b40542205f tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:19.799337 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-29c76737-a709-4c38-b8f5-88b40542205f tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a66be47dc1d49f68f66ef363ccaccbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a740310041645c8b9c32992012d01aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:19.819252 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-29c76737-a709-4c38-b8f5-88b40542205f tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] 10.222.0.50 "GET /compute/v2.1/servers/56489785-4b4c-4614-acfc-af86763249f9" status: 200 len: 1317 microversion: 2.1 time: 0.487910 Aug 31 15:56:19.822401 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 972/1839] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:19 2022] GET /compute/v2.1/servers/56489785-4b4c-4614-acfc-af86763249f9 => generated 1317 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:19.841520 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-6c80f10a-535c-4963-b7f3-753a30682108 req-2f346aec-6c10-47b4-b667-e382f72348db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d065e0ee-199e-4e8b-99ca-5801d627ce65", "name": "network-vif-unplugged", "status": "completed", "tag": "b13f13ce-7cbb-472a-bc2c-bb5104160fb0"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:19.853963 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-6c80f10a-535c-4963-b7f3-753a30682108 req-2f346aec-6c10-47b4-b667-e382f72348db service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:19.855195 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-6c80f10a-535c-4963-b7f3-753a30682108 req-2f346aec-6c10-47b4-b667-e382f72348db service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:19.855822 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-6c80f10a-535c-4963-b7f3-753a30682108 req-2f346aec-6c10-47b4-b667-e382f72348db service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:19.871261 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-6c80f10a-535c-4963-b7f3-753a30682108 req-2f346aec-6c10-47b4-b667-e382f72348db service nova] Creating event network-vif-unplugged:b13f13ce-7cbb-472a-bc2c-bb5104160fb0 for instance d065e0ee-199e-4e8b-99ca-5801d627ce65 on n-h2-833090-16 Aug 31 15:56:19.889159 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-6c80f10a-535c-4963-b7f3-753a30682108 req-2f346aec-6c10-47b4-b667-e382f72348db service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049194 Aug 31 15:56:19.889939 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 973/1840] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:19.902300 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-63d42fd6-db4f-4900-be8d-dd9816b71279 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:19.905007 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-63d42fd6-db4f-4900-be8d-dd9816b71279 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: f550488c-401c-4f00-805b-fe62d75da9d4] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:19.927716 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-63d42fd6-db4f-4900-be8d-dd9816b71279 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:19.928455 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-63d42fd6-db4f-4900-be8d-dd9816b71279 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:19.929260 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-63d42fd6-db4f-4900-be8d-dd9816b71279 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:19.931466 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-63d42fd6-db4f-4900-be8d-dd9816b71279 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:19.932574 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-63d42fd6-db4f-4900-be8d-dd9816b71279 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:19.933641 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-63d42fd6-db4f-4900-be8d-dd9816b71279 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:20.119767 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-e4488ceb-14dd-405b-8d93-d7bd653b3788 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:56:20.120485 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-e4488ceb-14dd-405b-8d93-d7bd653b3788 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:56:20.121288 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-e4488ceb-14dd-405b-8d93-d7bd653b3788 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:56:20.121706 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-e4488ceb-14dd-405b-8d93-d7bd653b3788 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:56:20.122139 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-e4488ceb-14dd-405b-8d93-d7bd653b3788 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:56:20.139965 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4488ceb-14dd-405b-8d93-d7bd653b3788 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:20.140758 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4488ceb-14dd-405b-8d93-d7bd653b3788 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:20.141671 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4488ceb-14dd-405b-8d93-d7bd653b3788 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:20.142643 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4488ceb-14dd-405b-8d93-d7bd653b3788 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:20.145891 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4488ceb-14dd-405b-8d93-d7bd653b3788 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:20.146608 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4488ceb-14dd-405b-8d93-d7bd653b3788 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:20.167245 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-e4488ceb-14dd-405b-8d93-d7bd653b3788 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Getting quotas for project dde27d282fc24e56a62eaeacff1431d5. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:56:20.172877 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-e4488ceb-14dd-405b-8d93-d7bd653b3788 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Getting quotas for user 4d4f2146c3bc4a64b5d7f72cd136b6db and project dde27d282fc24e56a62eaeacff1431d5. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:56:20.196438 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e4488ceb-14dd-405b-8d93-d7bd653b3788 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:56:20.198688 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e4488ceb-14dd-405b-8d93-d7bd653b3788 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: b90018d3-33b8-4bbc-9b09-d4f8a62a5a79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:56:20.340363 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e4488ceb-14dd-405b-8d93-d7bd653b3788 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.163739 Aug 31 15:56:20.353391 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 868/1841] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:56:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2178 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 15:56:20.365778 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b50b768f-adf0-47a8-b29c-8019e56c4a7d tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:20.366519 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b50b768f-adf0-47a8-b29c-8019e56c4a7d tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] [instance: f6574815-a484-4d2d-82b4-9cc761af2c9a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:20.377586 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-63d42fd6-db4f-4900-be8d-dd9816b71279 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:20.392513 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-63d42fd6-db4f-4900-be8d-dd9816b71279 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4" status: 200 len: 1496 microversion: 2.1 time: 0.500514 Aug 31 15:56:20.393596 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 974/1842] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:19 2022] GET /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4 => generated 1496 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:20.399452 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-e2cc6307-d01f-4b69-80b2-72d513244077 req-ea6f6fa6-3b57-423d-a241-60045de94bb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d065e0ee-199e-4e8b-99ca-5801d627ce65", "name": "network-vif-deleted", "tag": "b13f13ce-7cbb-472a-bc2c-bb5104160fb0"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:20.412143 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b50b768f-adf0-47a8-b29c-8019e56c4a7d tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:20.412639 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b50b768f-adf0-47a8-b29c-8019e56c4a7d tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:20.413076 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b50b768f-adf0-47a8-b29c-8019e56c4a7d tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:20.413795 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b50b768f-adf0-47a8-b29c-8019e56c4a7d tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:20.414716 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b50b768f-adf0-47a8-b29c-8019e56c4a7d tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:20.415764 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-e2cc6307-d01f-4b69-80b2-72d513244077 req-ea6f6fa6-3b57-423d-a241-60045de94bb4 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:20.415957 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b50b768f-adf0-47a8-b29c-8019e56c4a7d tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:20.416236 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-e2cc6307-d01f-4b69-80b2-72d513244077 req-ea6f6fa6-3b57-423d-a241-60045de94bb4 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:20.416967 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-e2cc6307-d01f-4b69-80b2-72d513244077 req-ea6f6fa6-3b57-423d-a241-60045de94bb4 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:20.437278 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-e2cc6307-d01f-4b69-80b2-72d513244077 req-ea6f6fa6-3b57-423d-a241-60045de94bb4 service nova] Creating event network-vif-deleted:b13f13ce-7cbb-472a-bc2c-bb5104160fb0 for instance d065e0ee-199e-4e8b-99ca-5801d627ce65 on n-h2-833090-16 Aug 31 15:56:20.460950 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-e2cc6307-d01f-4b69-80b2-72d513244077 req-ea6f6fa6-3b57-423d-a241-60045de94bb4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059227 Aug 31 15:56:20.462554 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 975/1843] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:20.491908 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-66c25a62-f2ec-4f48-945e-63acd46886ba tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:20.494855 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-66c25a62-f2ec-4f48-945e-63acd46886ba tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:20.509490 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-66c25a62-f2ec-4f48-945e-63acd46886ba tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:20.511172 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-66c25a62-f2ec-4f48-945e-63acd46886ba tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:20.511937 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-66c25a62-f2ec-4f48-945e-63acd46886ba tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:20.512915 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-66c25a62-f2ec-4f48-945e-63acd46886ba tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:20.514299 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-66c25a62-f2ec-4f48-945e-63acd46886ba tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:20.515103 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-66c25a62-f2ec-4f48-945e-63acd46886ba tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:20.654736 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-66c25a62-f2ec-4f48-945e-63acd46886ba tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:20.673190 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-66c25a62-f2ec-4f48-945e-63acd46886ba tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65" status: 200 len: 1426 microversion: 2.1 time: 0.206515 Aug 31 15:56:20.677414 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 976/1844] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:20 2022] GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65 => generated 1426 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:20.685587 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d806ea11-f457-4900-b840-3ce8c2281846 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:20.686217 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d806ea11-f457-4900-b840-3ce8c2281846 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: b90018d3-33b8-4bbc-9b09-d4f8a62a5a79] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:20.797242 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d806ea11-f457-4900-b840-3ce8c2281846 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:20.813872 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d806ea11-f457-4900-b840-3ce8c2281846 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/b90018d3-33b8-4bbc-9b09-d4f8a62a5a79" status: 200 len: 1215 microversion: 2.1 time: 0.133386 Aug 31 15:56:20.826120 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 977/1845] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:20 2022] GET /compute/v2.1/servers/b90018d3-33b8-4bbc-9b09-d4f8a62a5a79 => generated 1215 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:20.833821 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b50b768f-adf0-47a8-b29c-8019e56c4a7d tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a19bb40252746379cf71a4f4b773b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b53c5033fb543adaeaae8980537d4e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:20.844553 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-bf103739-6b40-44da-9aa7-8dc1272f6f80 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:20.845634 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b50b768f-adf0-47a8-b29c-8019e56c4a7d tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] 10.222.0.50 "GET /compute/v2.1/servers/f6574815-a484-4d2d-82b4-9cc761af2c9a" status: 200 len: 1320 microversion: 2.1 time: 0.490506 Aug 31 15:56:20.845905 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-bf103739-6b40-44da-9aa7-8dc1272f6f80 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] [instance: 56489785-4b4c-4614-acfc-af86763249f9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:20.846341 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 869/1846] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:20 2022] GET /compute/v2.1/servers/f6574815-a484-4d2d-82b4-9cc761af2c9a => generated 1320 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:20.853537 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bf103739-6b40-44da-9aa7-8dc1272f6f80 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:20.854147 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bf103739-6b40-44da-9aa7-8dc1272f6f80 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:20.854805 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bf103739-6b40-44da-9aa7-8dc1272f6f80 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:20.855727 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bf103739-6b40-44da-9aa7-8dc1272f6f80 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:20.856264 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bf103739-6b40-44da-9aa7-8dc1272f6f80 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:20.856584 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bf103739-6b40-44da-9aa7-8dc1272f6f80 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:21.075205 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-bf103739-6b40-44da-9aa7-8dc1272f6f80 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a66be47dc1d49f68f66ef363ccaccbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a740310041645c8b9c32992012d01aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:21.087871 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-bf103739-6b40-44da-9aa7-8dc1272f6f80 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] 10.222.0.50 "GET /compute/v2.1/servers/56489785-4b4c-4614-acfc-af86763249f9" status: 200 len: 1317 microversion: 2.1 time: 0.249275 Aug 31 15:56:21.089392 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 978/1847] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:20 2022] GET /compute/v2.1/servers/56489785-4b4c-4614-acfc-af86763249f9 => generated 1317 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:21.435906 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-12259cb9-9f0c-486b-971c-830c8c310742 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:21.436531 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-12259cb9-9f0c-486b-971c-830c8c310742 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: f550488c-401c-4f00-805b-fe62d75da9d4] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:21.449025 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12259cb9-9f0c-486b-971c-830c8c310742 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:21.451090 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12259cb9-9f0c-486b-971c-830c8c310742 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:21.451543 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12259cb9-9f0c-486b-971c-830c8c310742 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:21.452299 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12259cb9-9f0c-486b-971c-830c8c310742 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:21.458408 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12259cb9-9f0c-486b-971c-830c8c310742 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:21.459031 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12259cb9-9f0c-486b-971c-830c8c310742 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:21.669773 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-12259cb9-9f0c-486b-971c-830c8c310742 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:21.687328 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-12259cb9-9f0c-486b-971c-830c8c310742 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4" status: 200 len: 1496 microversion: 2.1 time: 0.267135 Aug 31 15:56:21.690653 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 870/1848] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:21 2022] GET /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4 => generated 1496 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:21.709234 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7a838c2f-3613-472a-a576-640450b63185 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:21.710460 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7a838c2f-3613-472a-a576-640450b63185 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:21.719447 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7a838c2f-3613-472a-a576-640450b63185 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:21.720169 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7a838c2f-3613-472a-a576-640450b63185 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:21.722737 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7a838c2f-3613-472a-a576-640450b63185 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:21.723999 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7a838c2f-3613-472a-a576-640450b63185 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:21.724649 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7a838c2f-3613-472a-a576-640450b63185 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:21.725081 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7a838c2f-3613-472a-a576-640450b63185 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:21.802552 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7a838c2f-3613-472a-a576-640450b63185 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:21.813874 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7a838c2f-3613-472a-a576-640450b63185 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65" status: 200 len: 1426 microversion: 2.1 time: 0.109814 Aug 31 15:56:21.815126 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 979/1849] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:21 2022] GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65 => generated 1426 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:56:21.840970 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b07b1596-e649-441e-9902-0e6b751668b3 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:21.841587 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b07b1596-e649-441e-9902-0e6b751668b3 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: b90018d3-33b8-4bbc-9b09-d4f8a62a5a79] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:21.851036 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b07b1596-e649-441e-9902-0e6b751668b3 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:21.852241 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b07b1596-e649-441e-9902-0e6b751668b3 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:21.852919 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b07b1596-e649-441e-9902-0e6b751668b3 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:21.853863 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b07b1596-e649-441e-9902-0e6b751668b3 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:21.854517 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b07b1596-e649-441e-9902-0e6b751668b3 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:21.855127 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b07b1596-e649-441e-9902-0e6b751668b3 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:21.876761 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-89c25d27-dcc5-4eab-ba20-6fb09659a0de tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:21.877947 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-89c25d27-dcc5-4eab-ba20-6fb09659a0de tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] [instance: f6574815-a484-4d2d-82b4-9cc761af2c9a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:21.889050 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-89c25d27-dcc5-4eab-ba20-6fb09659a0de tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:21.894807 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-89c25d27-dcc5-4eab-ba20-6fb09659a0de tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:21.895290 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-89c25d27-dcc5-4eab-ba20-6fb09659a0de tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:21.898291 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-89c25d27-dcc5-4eab-ba20-6fb09659a0de tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:21.898816 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-89c25d27-dcc5-4eab-ba20-6fb09659a0de tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:21.899248 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-89c25d27-dcc5-4eab-ba20-6fb09659a0de tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:21.971801 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b07b1596-e649-441e-9902-0e6b751668b3 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:21.990032 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b07b1596-e649-441e-9902-0e6b751668b3 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/b90018d3-33b8-4bbc-9b09-d4f8a62a5a79" status: 200 len: 1267 microversion: 2.1 time: 0.153461 Aug 31 15:56:21.992851 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 871/1850] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:21 2022] GET /compute/v2.1/servers/b90018d3-33b8-4bbc-9b09-d4f8a62a5a79 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:22.095032 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-02f0ac1a-8eea-43f8-a047-d7e2c6932120 req-83c28735-e267-4c48-bb35-d65c1f548db0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56489785-4b4c-4614-acfc-af86763249f9", "name": "network-vif-plugged", "status": "completed", "tag": "3a01f967-b20a-4b06-80e1-770ba7e45135"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:22.136453 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-02f0ac1a-8eea-43f8-a047-d7e2c6932120 req-83c28735-e267-4c48-bb35-d65c1f548db0 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:22.136961 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-02f0ac1a-8eea-43f8-a047-d7e2c6932120 req-83c28735-e267-4c48-bb35-d65c1f548db0 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:22.161158 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-02f0ac1a-8eea-43f8-a047-d7e2c6932120 req-83c28735-e267-4c48-bb35-d65c1f548db0 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:22.195891 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-02f0ac1a-8eea-43f8-a047-d7e2c6932120 req-83c28735-e267-4c48-bb35-d65c1f548db0 service nova] Creating event network-vif-plugged:3a01f967-b20a-4b06-80e1-770ba7e45135 for instance 56489785-4b4c-4614-acfc-af86763249f9 on n-h2-833090-16 Aug 31 15:56:22.216979 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-02f0ac1a-8eea-43f8-a047-d7e2c6932120 req-83c28735-e267-4c48-bb35-d65c1f548db0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124424 Aug 31 15:56:22.217644 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 872/1851] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:56:22.223630 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c135b9e4-eb23-4023-8381-c1a4bf17cfdc tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:22.224472 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c135b9e4-eb23-4023-8381-c1a4bf17cfdc tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] [instance: 56489785-4b4c-4614-acfc-af86763249f9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:22.241472 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c135b9e4-eb23-4023-8381-c1a4bf17cfdc tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:22.242427 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c135b9e4-eb23-4023-8381-c1a4bf17cfdc tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:22.242865 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c135b9e4-eb23-4023-8381-c1a4bf17cfdc tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:22.243692 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c135b9e4-eb23-4023-8381-c1a4bf17cfdc tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:22.244136 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c135b9e4-eb23-4023-8381-c1a4bf17cfdc tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:22.244662 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c135b9e4-eb23-4023-8381-c1a4bf17cfdc tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:22.364963 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-89c25d27-dcc5-4eab-ba20-6fb09659a0de tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a19bb40252746379cf71a4f4b773b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b53c5033fb543adaeaae8980537d4e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:22.377835 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-89c25d27-dcc5-4eab-ba20-6fb09659a0de tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] 10.222.0.50 "GET /compute/v2.1/servers/f6574815-a484-4d2d-82b4-9cc761af2c9a" status: 200 len: 1320 microversion: 2.1 time: 0.506217 Aug 31 15:56:22.378514 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 980/1852] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:21 2022] GET /compute/v2.1/servers/f6574815-a484-4d2d-82b4-9cc761af2c9a => generated 1320 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:56:22.611117 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c135b9e4-eb23-4023-8381-c1a4bf17cfdc tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a66be47dc1d49f68f66ef363ccaccbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a740310041645c8b9c32992012d01aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:22.622116 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c135b9e4-eb23-4023-8381-c1a4bf17cfdc tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] 10.222.0.50 "GET /compute/v2.1/servers/56489785-4b4c-4614-acfc-af86763249f9" status: 200 len: 1317 microversion: 2.1 time: 0.403120 Aug 31 15:56:22.622742 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 873/1853] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:22 2022] GET /compute/v2.1/servers/56489785-4b4c-4614-acfc-af86763249f9 => generated 1317 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:22.710638 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-00509c67-59ad-458e-8f4a-30e364acb281 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:22.712017 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-00509c67-59ad-458e-8f4a-30e364acb281 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: f550488c-401c-4f00-805b-fe62d75da9d4] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:22.723356 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-00509c67-59ad-458e-8f4a-30e364acb281 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:22.724109 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-00509c67-59ad-458e-8f4a-30e364acb281 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:22.724752 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-00509c67-59ad-458e-8f4a-30e364acb281 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:22.725706 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-00509c67-59ad-458e-8f4a-30e364acb281 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:22.726352 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-00509c67-59ad-458e-8f4a-30e364acb281 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:22.728028 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-00509c67-59ad-458e-8f4a-30e364acb281 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:22.838940 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d259ea10-addf-469b-b62c-daa7eccb35bb tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:22.840001 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d259ea10-addf-469b-b62c-daa7eccb35bb tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:22.854646 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d259ea10-addf-469b-b62c-daa7eccb35bb tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:22.855668 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d259ea10-addf-469b-b62c-daa7eccb35bb tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:22.857510 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d259ea10-addf-469b-b62c-daa7eccb35bb tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:22.858920 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d259ea10-addf-469b-b62c-daa7eccb35bb tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:22.860373 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d259ea10-addf-469b-b62c-daa7eccb35bb tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:22.860840 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d259ea10-addf-469b-b62c-daa7eccb35bb tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:23.011241 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d259ea10-addf-469b-b62c-daa7eccb35bb tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:23.018473 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-00509c67-59ad-458e-8f4a-30e364acb281 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:23.028384 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d259ea10-addf-469b-b62c-daa7eccb35bb tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65" status: 200 len: 1426 microversion: 2.1 time: 0.188852 Aug 31 15:56:23.029429 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 874/1854] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:22 2022] GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65 => generated 1426 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:56:23.038118 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6eab93b6-e9bb-4d06-8861-ccd9f394f95f tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:23.045457 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-00509c67-59ad-458e-8f4a-30e364acb281 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4" status: 200 len: 1496 microversion: 2.1 time: 0.338835 Aug 31 15:56:23.048059 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6eab93b6-e9bb-4d06-8861-ccd9f394f95f tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: b90018d3-33b8-4bbc-9b09-d4f8a62a5a79] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:23.051215 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 981/1855] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:22 2022] GET /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4 => generated 1496 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:23.059699 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6eab93b6-e9bb-4d06-8861-ccd9f394f95f tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:23.065916 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6eab93b6-e9bb-4d06-8861-ccd9f394f95f tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:23.066795 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6eab93b6-e9bb-4d06-8861-ccd9f394f95f tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:23.067760 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6eab93b6-e9bb-4d06-8861-ccd9f394f95f tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:23.068219 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6eab93b6-e9bb-4d06-8861-ccd9f394f95f tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:23.068651 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6eab93b6-e9bb-4d06-8861-ccd9f394f95f tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:23.411850 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-cf9181a1-b821-4255-b278-ec0424d7c53e tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:23.412627 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-cf9181a1-b821-4255-b278-ec0424d7c53e tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] [instance: f6574815-a484-4d2d-82b4-9cc761af2c9a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:23.420755 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cf9181a1-b821-4255-b278-ec0424d7c53e tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:23.422739 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cf9181a1-b821-4255-b278-ec0424d7c53e tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:23.423420 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cf9181a1-b821-4255-b278-ec0424d7c53e tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:23.425118 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cf9181a1-b821-4255-b278-ec0424d7c53e tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:23.425832 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cf9181a1-b821-4255-b278-ec0424d7c53e tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:23.426628 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cf9181a1-b821-4255-b278-ec0424d7c53e tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:23.686138 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6eab93b6-e9bb-4d06-8861-ccd9f394f95f tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:23.707078 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6eab93b6-e9bb-4d06-8861-ccd9f394f95f tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/b90018d3-33b8-4bbc-9b09-d4f8a62a5a79" status: 200 len: 1273 microversion: 2.1 time: 0.676146 Aug 31 15:56:23.722684 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 875/1856] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:23 2022] GET /compute/v2.1/servers/b90018d3-33b8-4bbc-9b09-d4f8a62a5a79 => generated 1273 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:23.737604 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fc7e4908-db96-4e7b-92ca-fed973096d7f tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:23.738727 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fc7e4908-db96-4e7b-92ca-fed973096d7f tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] [instance: 56489785-4b4c-4614-acfc-af86763249f9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:23.747555 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc7e4908-db96-4e7b-92ca-fed973096d7f tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:23.748825 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc7e4908-db96-4e7b-92ca-fed973096d7f tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:23.749573 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc7e4908-db96-4e7b-92ca-fed973096d7f tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:23.751172 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc7e4908-db96-4e7b-92ca-fed973096d7f tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:23.752417 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc7e4908-db96-4e7b-92ca-fed973096d7f tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:23.752417 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc7e4908-db96-4e7b-92ca-fed973096d7f tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:24.051882 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-cf9181a1-b821-4255-b278-ec0424d7c53e tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a19bb40252746379cf71a4f4b773b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b53c5033fb543adaeaae8980537d4e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:24.077839 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-cf9181a1-b821-4255-b278-ec0424d7c53e tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] 10.222.0.50 "GET /compute/v2.1/servers/f6574815-a484-4d2d-82b4-9cc761af2c9a" status: 200 len: 1320 microversion: 2.1 time: 0.679634 Aug 31 15:56:24.078796 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 982/1857] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:23 2022] GET /compute/v2.1/servers/f6574815-a484-4d2d-82b4-9cc761af2c9a => generated 1320 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:56:24.084346 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-63f1601d-24bc-43eb-9997-6bba5fa345b8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:24.085212 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-63f1601d-24bc-43eb-9997-6bba5fa345b8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: d065e0ee-199e-4e8b-99ca-5801d627ce65] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:24.092477 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-63f1601d-24bc-43eb-9997-6bba5fa345b8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:24.093217 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-63f1601d-24bc-43eb-9997-6bba5fa345b8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:24.093839 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-63f1601d-24bc-43eb-9997-6bba5fa345b8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:24.094744 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-63f1601d-24bc-43eb-9997-6bba5fa345b8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:24.095574 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-63f1601d-24bc-43eb-9997-6bba5fa345b8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:24.096267 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-63f1601d-24bc-43eb-9997-6bba5fa345b8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:24.116270 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-63f1601d-24bc-43eb-9997-6bba5fa345b8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] HTTP exception thrown: Instance d065e0ee-199e-4e8b-99ca-5801d627ce65 could not be found. Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-63f1601d-24bc-43eb-9997-6bba5fa345b8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Request method failure captured: Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65 HTTP/1.1 Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4M4NFC83ApiGEvumoFdoFLVBqseZv6iK4iD9K5RIGEFCd3H1sg_fW0mpc-3vNOBJJqf_S0BPjt81eWEYwAEhJOuhqtm1ZsU9nClam-0UBj5S7abSSA1G67q5tlH93w3RwFJjEFLB01lUWsMMowJ9h2ujkEuH1I7pHqjSGdyOWlXgHY Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 9b4c50ece07f441b8974d384f4ab29a4 Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-MigrationsAdminTest-860368600 Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9b4c50ece07f441b8974d384f4ab29a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9b4c50ece07f441b8974d384f4ab29a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9b4c50ece07f441b8974d384f4ab29a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9b4c50ece07f441b8974d384f4ab29a4", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-MigrationsAdminTest-860368600 Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 9b4c50ece07f441b8974d384f4ab29a4 Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-MigrationsAdminTest-860368600 Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-MigrationsAdminTest-860368600-project Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 5f6f8b9d63234b8199c60f842a3c407f Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-MigrationsAdminTest-860368600-project Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance d065e0ee-199e-4e8b-99ca-5801d627ce65 could not be found. Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'd065e0ee-199e-4e8b-99ca-5801d627ce65'} Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d065e0ee-199e-4e8b-99ca-5801d627ce65 could not be found. Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d065e0ee-199e-4e8b-99ca-5801d627ce65 could not be found. Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:24.118787 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:56:24.124569 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:24.124569 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:24.124569 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:24.124569 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:56:24.124569 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:56:24.124569 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d065e0ee-199e-4e8b-99ca-5801d627ce65 could not be found. Aug 31 15:56:24.124569 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:56:24.128522 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-63f1601d-24bc-43eb-9997-6bba5fa345b8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Returning 404 to user: Instance d065e0ee-199e-4e8b-99ca-5801d627ce65 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:56:24.129581 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-63f1601d-24bc-43eb-9997-6bba5fa345b8 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65" status: 404 len: 111 microversion: 2.1 time: 0.048989 Aug 31 15:56:24.130605 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 983/1858] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:24 2022] GET /compute/v2.1/servers/d065e0ee-199e-4e8b-99ca-5801d627ce65 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:56:24.138045 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4d28efe1-01a9-49a6-9fa4-fb4cd4c46e21 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:24.138973 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4d28efe1-01a9-49a6-9fa4-fb4cd4c46e21 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: f550488c-401c-4f00-805b-fe62d75da9d4] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:24.147369 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4d28efe1-01a9-49a6-9fa4-fb4cd4c46e21 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:24.148136 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4d28efe1-01a9-49a6-9fa4-fb4cd4c46e21 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:24.149374 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4d28efe1-01a9-49a6-9fa4-fb4cd4c46e21 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:24.150360 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4d28efe1-01a9-49a6-9fa4-fb4cd4c46e21 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:24.150988 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4d28efe1-01a9-49a6-9fa4-fb4cd4c46e21 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:24.152010 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4d28efe1-01a9-49a6-9fa4-fb4cd4c46e21 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:24.293994 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fc7e4908-db96-4e7b-92ca-fed973096d7f tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a66be47dc1d49f68f66ef363ccaccbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a740310041645c8b9c32992012d01aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:24.303657 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fc7e4908-db96-4e7b-92ca-fed973096d7f tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] 10.222.0.50 "GET /compute/v2.1/servers/56489785-4b4c-4614-acfc-af86763249f9" status: 200 len: 1317 microversion: 2.1 time: 0.579400 Aug 31 15:56:24.307246 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 876/1859] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:23 2022] GET /compute/v2.1/servers/56489785-4b4c-4614-acfc-af86763249f9 => generated 1317 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:24.328526 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-61799b75-2d7a-41a4-84f6-b757a14e485e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:24.330908 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-61799b75-2d7a-41a4-84f6-b757a14e485e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 04a4f94b-5820-4bbe-a9b0-7fa55a697e09] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:24.339765 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61799b75-2d7a-41a4-84f6-b757a14e485e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:24.356708 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61799b75-2d7a-41a4-84f6-b757a14e485e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:24.357465 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61799b75-2d7a-41a4-84f6-b757a14e485e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:24.359706 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61799b75-2d7a-41a4-84f6-b757a14e485e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:24.360347 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61799b75-2d7a-41a4-84f6-b757a14e485e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:24.361152 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61799b75-2d7a-41a4-84f6-b757a14e485e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:24.421807 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-61799b75-2d7a-41a4-84f6-b757a14e485e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 04a4f94b-5820-4bbe-a9b0-7fa55a697e09] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:56:24.470114 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:56:24.591762 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4d28efe1-01a9-49a6-9fa4-fb4cd4c46e21 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:24.611149 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4d28efe1-01a9-49a6-9fa4-fb4cd4c46e21 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4" status: 200 len: 1496 microversion: 2.1 time: 0.478748 Aug 31 15:56:24.615460 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 984/1860] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:24 2022] GET /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4 => generated 1496 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:24.640110 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-61799b75-2d7a-41a4-84f6-b757a14e485e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "DELETE /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09" status: 204 len: 0 microversion: 2.1 time: 0.329741 Aug 31 15:56:24.644689 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 877/1861] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:56:24 2022] DELETE /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:56:24.655539 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-96bb37a4-931e-4950-b157-3cc34b798f31 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:24.656154 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-96bb37a4-931e-4950-b157-3cc34b798f31 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 04a4f94b-5820-4bbe-a9b0-7fa55a697e09] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:24.668440 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-96bb37a4-931e-4950-b157-3cc34b798f31 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:24.669440 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-96bb37a4-931e-4950-b157-3cc34b798f31 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:24.669977 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-96bb37a4-931e-4950-b157-3cc34b798f31 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:24.671872 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-96bb37a4-931e-4950-b157-3cc34b798f31 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:24.672717 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-96bb37a4-931e-4950-b157-3cc34b798f31 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:24.673319 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-96bb37a4-931e-4950-b157-3cc34b798f31 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:24.743998 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2394f113-5736-4749-829d-1f4b56fadad2 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:24.745634 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2394f113-5736-4749-829d-1f4b56fadad2 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: b90018d3-33b8-4bbc-9b09-d4f8a62a5a79] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:24.757646 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2394f113-5736-4749-829d-1f4b56fadad2 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:24.758335 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2394f113-5736-4749-829d-1f4b56fadad2 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:24.759074 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2394f113-5736-4749-829d-1f4b56fadad2 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:24.760518 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2394f113-5736-4749-829d-1f4b56fadad2 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:24.762832 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2394f113-5736-4749-829d-1f4b56fadad2 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:24.763400 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2394f113-5736-4749-829d-1f4b56fadad2 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:24.967425 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-96bb37a4-931e-4950-b157-3cc34b798f31 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:24.979306 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-96bb37a4-931e-4950-b157-3cc34b798f31 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09" status: 200 len: 1534 microversion: 2.1 time: 0.329042 Aug 31 15:56:24.981896 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 985/1862] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:24 2022] GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09 => generated 1534 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:25.067683 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2394f113-5736-4749-829d-1f4b56fadad2 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:25.077149 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2394f113-5736-4749-829d-1f4b56fadad2 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/b90018d3-33b8-4bbc-9b09-d4f8a62a5a79" status: 200 len: 1315 microversion: 2.1 time: 0.338369 Aug 31 15:56:25.090814 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 878/1863] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:24 2022] GET /compute/v2.1/servers/b90018d3-33b8-4bbc-9b09-d4f8a62a5a79 => generated 1315 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:56:25.103672 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-75b6c037-6a40-48c1-b1c5-e1ba0e371953 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:25.105082 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-75b6c037-6a40-48c1-b1c5-e1ba0e371953 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] [instance: f6574815-a484-4d2d-82b4-9cc761af2c9a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:25.112687 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-75b6c037-6a40-48c1-b1c5-e1ba0e371953 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:25.113089 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-75b6c037-6a40-48c1-b1c5-e1ba0e371953 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:25.113778 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-75b6c037-6a40-48c1-b1c5-e1ba0e371953 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:25.114488 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-75b6c037-6a40-48c1-b1c5-e1ba0e371953 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:25.114928 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-75b6c037-6a40-48c1-b1c5-e1ba0e371953 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:25.115544 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-75b6c037-6a40-48c1-b1c5-e1ba0e371953 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:25.282468 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-75b6c037-6a40-48c1-b1c5-e1ba0e371953 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a19bb40252746379cf71a4f4b773b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b53c5033fb543adaeaae8980537d4e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:25.291832 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-75b6c037-6a40-48c1-b1c5-e1ba0e371953 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] 10.222.0.50 "GET /compute/v2.1/servers/f6574815-a484-4d2d-82b4-9cc761af2c9a" status: 200 len: 1320 microversion: 2.1 time: 0.192751 Aug 31 15:56:25.293249 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 986/1864] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:25 2022] GET /compute/v2.1/servers/f6574815-a484-4d2d-82b4-9cc761af2c9a => generated 1320 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:25.329069 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fccba4ab-1d48-4039-aa9f-b1495c6fa030 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:25.329753 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fccba4ab-1d48-4039-aa9f-b1495c6fa030 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] [instance: 56489785-4b4c-4614-acfc-af86763249f9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:25.338762 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fccba4ab-1d48-4039-aa9f-b1495c6fa030 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:25.339744 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fccba4ab-1d48-4039-aa9f-b1495c6fa030 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:25.340237 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fccba4ab-1d48-4039-aa9f-b1495c6fa030 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:25.341198 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fccba4ab-1d48-4039-aa9f-b1495c6fa030 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:25.341978 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fccba4ab-1d48-4039-aa9f-b1495c6fa030 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:25.342630 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fccba4ab-1d48-4039-aa9f-b1495c6fa030 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:25.535278 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fccba4ab-1d48-4039-aa9f-b1495c6fa030 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a66be47dc1d49f68f66ef363ccaccbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a740310041645c8b9c32992012d01aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:25.545585 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fccba4ab-1d48-4039-aa9f-b1495c6fa030 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] 10.222.0.50 "GET /compute/v2.1/servers/56489785-4b4c-4614-acfc-af86763249f9" status: 200 len: 1317 microversion: 2.1 time: 0.221617 Aug 31 15:56:25.547285 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 879/1865] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:25 2022] GET /compute/v2.1/servers/56489785-4b4c-4614-acfc-af86763249f9 => generated 1317 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:25.635358 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e343f475-4217-4c18-bfa3-4874d636aec8 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:25.636478 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e343f475-4217-4c18-bfa3-4874d636aec8 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: f550488c-401c-4f00-805b-fe62d75da9d4] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:25.648865 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e343f475-4217-4c18-bfa3-4874d636aec8 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:25.649637 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e343f475-4217-4c18-bfa3-4874d636aec8 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:25.650085 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e343f475-4217-4c18-bfa3-4874d636aec8 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:25.655575 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e343f475-4217-4c18-bfa3-4874d636aec8 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:25.656462 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e343f475-4217-4c18-bfa3-4874d636aec8 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:25.657058 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e343f475-4217-4c18-bfa3-4874d636aec8 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:25.973923 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e343f475-4217-4c18-bfa3-4874d636aec8 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:25.983485 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e343f475-4217-4c18-bfa3-4874d636aec8 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4" status: 200 len: 1496 microversion: 2.1 time: 0.354275 Aug 31 15:56:25.999187 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 987/1866] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:25 2022] GET /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4 => generated 1496 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:26.002160 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0267e82c-4931-48cd-a4d7-07badcc13e51 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:26.002921 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0267e82c-4931-48cd-a4d7-07badcc13e51 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 04a4f94b-5820-4bbe-a9b0-7fa55a697e09] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:26.013680 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0267e82c-4931-48cd-a4d7-07badcc13e51 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:26.014151 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0267e82c-4931-48cd-a4d7-07badcc13e51 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:26.014992 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0267e82c-4931-48cd-a4d7-07badcc13e51 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:26.016180 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0267e82c-4931-48cd-a4d7-07badcc13e51 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:26.016799 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0267e82c-4931-48cd-a4d7-07badcc13e51 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:26.017548 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0267e82c-4931-48cd-a4d7-07badcc13e51 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:26.099551 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a1fe2a80-cc9c-461a-ae10-7d71f6b9d39c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:26.100472 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a1fe2a80-cc9c-461a-ae10-7d71f6b9d39c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: b90018d3-33b8-4bbc-9b09-d4f8a62a5a79] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:26.112911 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a1fe2a80-cc9c-461a-ae10-7d71f6b9d39c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:26.113585 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a1fe2a80-cc9c-461a-ae10-7d71f6b9d39c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:26.116819 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a1fe2a80-cc9c-461a-ae10-7d71f6b9d39c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:26.118298 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a1fe2a80-cc9c-461a-ae10-7d71f6b9d39c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:26.118777 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a1fe2a80-cc9c-461a-ae10-7d71f6b9d39c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:26.119238 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a1fe2a80-cc9c-461a-ae10-7d71f6b9d39c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:26.511194 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0267e82c-4931-48cd-a4d7-07badcc13e51 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:26.521118 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0267e82c-4931-48cd-a4d7-07badcc13e51 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09" status: 200 len: 1534 microversion: 2.1 time: 0.523272 Aug 31 15:56:26.534350 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 880/1867] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:25 2022] GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09 => generated 1534 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:56:26.539914 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-43684596-0127-47f9-9992-c63476595078 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:26.547343 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-43684596-0127-47f9-9992-c63476595078 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] [instance: f6574815-a484-4d2d-82b4-9cc761af2c9a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:26.549928 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:56:26.568530 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43684596-0127-47f9-9992-c63476595078 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:26.578572 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43684596-0127-47f9-9992-c63476595078 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:26.580317 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43684596-0127-47f9-9992-c63476595078 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:26.587584 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43684596-0127-47f9-9992-c63476595078 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:26.588406 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43684596-0127-47f9-9992-c63476595078 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:26.588705 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a1fe2a80-cc9c-461a-ae10-7d71f6b9d39c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:26.588888 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43684596-0127-47f9-9992-c63476595078 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:26.606130 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a1fe2a80-cc9c-461a-ae10-7d71f6b9d39c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/b90018d3-33b8-4bbc-9b09-d4f8a62a5a79" status: 200 len: 1315 microversion: 2.1 time: 0.510484 Aug 31 15:56:26.624252 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 988/1868] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:26 2022] GET /compute/v2.1/servers/b90018d3-33b8-4bbc-9b09-d4f8a62a5a79 => generated 1315 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:26.646640 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-70158ce5-999a-43c3-aac9-8ece4417d37a tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:26.647259 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-70158ce5-999a-43c3-aac9-8ece4417d37a tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] [instance: 56489785-4b4c-4614-acfc-af86763249f9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:26.667984 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-70158ce5-999a-43c3-aac9-8ece4417d37a tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:26.670864 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-70158ce5-999a-43c3-aac9-8ece4417d37a tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:26.672930 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-70158ce5-999a-43c3-aac9-8ece4417d37a tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:26.675563 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-70158ce5-999a-43c3-aac9-8ece4417d37a tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:26.683713 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-70158ce5-999a-43c3-aac9-8ece4417d37a tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:26.685156 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-70158ce5-999a-43c3-aac9-8ece4417d37a tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:27.031192 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-70158ce5-999a-43c3-aac9-8ece4417d37a tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a66be47dc1d49f68f66ef363ccaccbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a740310041645c8b9c32992012d01aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:27.046401 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-70158ce5-999a-43c3-aac9-8ece4417d37a tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] 10.222.0.50 "GET /compute/v2.1/servers/56489785-4b4c-4614-acfc-af86763249f9" status: 200 len: 1505 microversion: 2.1 time: 0.420594 Aug 31 15:56:27.048264 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 989/1869] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:26 2022] GET /compute/v2.1/servers/56489785-4b4c-4614-acfc-af86763249f9 => generated 1505 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:27.062478 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-0976f2ba-fd39-46d5-946f-8d7b6e03c825 req-3d821929-060e-4212-ade0-0b03054fe170 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6574815-a484-4d2d-82b4-9cc761af2c9a", "name": "network-vif-plugged", "status": "completed", "tag": "e900c20a-83c0-42c1-84b7-37696eebbb29"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:27.088576 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-0976f2ba-fd39-46d5-946f-8d7b6e03c825 req-3d821929-060e-4212-ade0-0b03054fe170 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:27.089054 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-0976f2ba-fd39-46d5-946f-8d7b6e03c825 req-3d821929-060e-4212-ade0-0b03054fe170 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:27.089483 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-0976f2ba-fd39-46d5-946f-8d7b6e03c825 req-3d821929-060e-4212-ade0-0b03054fe170 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:27.126610 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-0976f2ba-fd39-46d5-946f-8d7b6e03c825 req-3d821929-060e-4212-ade0-0b03054fe170 service nova] Creating event network-vif-plugged:e900c20a-83c0-42c1-84b7-37696eebbb29 for instance f6574815-a484-4d2d-82b4-9cc761af2c9a on n-h2-833090-16 Aug 31 15:56:27.140068 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-0976f2ba-fd39-46d5-946f-8d7b6e03c825 req-3d821929-060e-4212-ade0-0b03054fe170 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088373 Aug 31 15:56:27.142682 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 990/1870] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:27.153447 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5e6a950d-f149-4473-a805-6493ac99fe14 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:27.154236 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5e6a950d-f149-4473-a805-6493ac99fe14 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: f550488c-401c-4f00-805b-fe62d75da9d4] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:27.174154 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e6a950d-f149-4473-a805-6493ac99fe14 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:27.174653 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e6a950d-f149-4473-a805-6493ac99fe14 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:27.175085 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e6a950d-f149-4473-a805-6493ac99fe14 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:27.175787 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e6a950d-f149-4473-a805-6493ac99fe14 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:27.176427 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e6a950d-f149-4473-a805-6493ac99fe14 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:27.177016 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e6a950d-f149-4473-a805-6493ac99fe14 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:27.234409 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-43684596-0127-47f9-9992-c63476595078 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a19bb40252746379cf71a4f4b773b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b53c5033fb543adaeaae8980537d4e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:27.243883 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=100 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:56:27.268002 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-43684596-0127-47f9-9992-c63476595078 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] 10.222.0.50 "GET /compute/v2.1/servers/f6574815-a484-4d2d-82b4-9cc761af2c9a" status: 200 len: 1320 microversion: 2.1 time: 0.730750 Aug 31 15:56:27.268708 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 881/1871] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:26 2022] GET /compute/v2.1/servers/f6574815-a484-4d2d-82b4-9cc761af2c9a => generated 1320 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:27.287871 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-68a32383-f8b7-41a5-b537-76c2c127b8c1 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:27.288727 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-68a32383-f8b7-41a5-b537-76c2c127b8c1 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] [instance: 56489785-4b4c-4614-acfc-af86763249f9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:27.296927 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68a32383-f8b7-41a5-b537-76c2c127b8c1 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:27.297438 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68a32383-f8b7-41a5-b537-76c2c127b8c1 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:27.297886 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68a32383-f8b7-41a5-b537-76c2c127b8c1 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:27.299324 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68a32383-f8b7-41a5-b537-76c2c127b8c1 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:27.300209 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68a32383-f8b7-41a5-b537-76c2c127b8c1 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:27.300825 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68a32383-f8b7-41a5-b537-76c2c127b8c1 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:27.341077 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-68a32383-f8b7-41a5-b537-76c2c127b8c1 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '2a66be47dc1d49f68f66ef363ccaccbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a740310041645c8b9c32992012d01aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:27.342525 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-68a32383-f8b7-41a5-b537-76c2c127b8c1 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] 10.222.0.50 "GET /compute/v2.1/servers/56489785-4b4c-4614-acfc-af86763249f9/os-instance-actions/req-36740f36-968c-4493-a9ad-e82ca0bcf3a1" status: 200 len: 313 microversion: 2.1 time: 0.067740 Aug 31 15:56:27.352205 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 882/1872] 10.222.0.50 () {58 vars in 1419 bytes} [Wed Aug 31 15:56:27 2022] GET /compute/v2.1/servers/56489785-4b4c-4614-acfc-af86763249f9/os-instance-actions/req-36740f36-968c-4493-a9ad-e82ca0bcf3a1 => generated 313 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:27.357843 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-26475d4e-be7f-41ac-8925-94ed7256820b tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:27.360746 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-26475d4e-be7f-41ac-8925-94ed7256820b tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] [instance: 56489785-4b4c-4614-acfc-af86763249f9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:27.369354 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26475d4e-be7f-41ac-8925-94ed7256820b tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:27.370050 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26475d4e-be7f-41ac-8925-94ed7256820b tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:27.370694 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26475d4e-be7f-41ac-8925-94ed7256820b tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:27.371586 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26475d4e-be7f-41ac-8925-94ed7256820b tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:27.372381 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26475d4e-be7f-41ac-8925-94ed7256820b tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:27.373115 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26475d4e-be7f-41ac-8925-94ed7256820b tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:27.469506 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-26475d4e-be7f-41ac-8925-94ed7256820b tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] 10.222.0.50 "POST /compute/v2.1/servers/56489785-4b4c-4614-acfc-af86763249f9/action" status: 202 len: 0 microversion: 2.1 time: 0.114319 Aug 31 15:56:27.478475 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 883/1873] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 15:56:27 2022] POST /compute/v2.1/servers/56489785-4b4c-4614-acfc-af86763249f9/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:56:27.486843 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-85e83719-3ecc-4c8d-8b6c-2397b1e79b97 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:27.487824 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-85e83719-3ecc-4c8d-8b6c-2397b1e79b97 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] [instance: 56489785-4b4c-4614-acfc-af86763249f9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:27.496918 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-85e83719-3ecc-4c8d-8b6c-2397b1e79b97 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:27.498275 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-85e83719-3ecc-4c8d-8b6c-2397b1e79b97 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:27.499018 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-85e83719-3ecc-4c8d-8b6c-2397b1e79b97 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:27.502530 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-85e83719-3ecc-4c8d-8b6c-2397b1e79b97 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:27.502530 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-85e83719-3ecc-4c8d-8b6c-2397b1e79b97 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:27.502530 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-85e83719-3ecc-4c8d-8b6c-2397b1e79b97 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:28.432269 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-85e83719-3ecc-4c8d-8b6c-2397b1e79b97 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a66be47dc1d49f68f66ef363ccaccbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a740310041645c8b9c32992012d01aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:28.453522 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-85e83719-3ecc-4c8d-8b6c-2397b1e79b97 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] 10.222.0.50 "GET /compute/v2.1/servers/56489785-4b4c-4614-acfc-af86763249f9" status: 200 len: 1507 microversion: 2.1 time: 0.971865 Aug 31 15:56:28.469446 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 884/1874] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:27 2022] GET /compute/v2.1/servers/56489785-4b4c-4614-acfc-af86763249f9 => generated 1507 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:28.474759 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8f95bf58-c2e1-4f4b-9feb-addb63b1fb4e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:28.479371 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8f95bf58-c2e1-4f4b-9feb-addb63b1fb4e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 04a4f94b-5820-4bbe-a9b0-7fa55a697e09] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:28.496305 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f95bf58-c2e1-4f4b-9feb-addb63b1fb4e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:28.508433 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f95bf58-c2e1-4f4b-9feb-addb63b1fb4e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:28.509107 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f95bf58-c2e1-4f4b-9feb-addb63b1fb4e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:28.510312 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f95bf58-c2e1-4f4b-9feb-addb63b1fb4e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:28.510963 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f95bf58-c2e1-4f4b-9feb-addb63b1fb4e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:28.512243 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f95bf58-c2e1-4f4b-9feb-addb63b1fb4e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:28.572297 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f95bf58-c2e1-4f4b-9feb-addb63b1fb4e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:28.572800 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f95bf58-c2e1-4f4b-9feb-addb63b1fb4e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:28.573241 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f95bf58-c2e1-4f4b-9feb-addb63b1fb4e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:28.573701 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-8f95bf58-c2e1-4f4b-9feb-addb63b1fb4e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lazy-loading 'fault' on Instance uuid 04a4f94b-5820-4bbe-a9b0-7fa55a697e09 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:56:28.595391 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5e6a950d-f149-4473-a805-6493ac99fe14 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:28.606882 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5e6a950d-f149-4473-a805-6493ac99fe14 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4" status: 200 len: 1496 microversion: 2.1 time: 1.462892 Aug 31 15:56:28.607471 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 991/1875] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:27 2022] GET /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4 => generated 1496 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:28.628717 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9d9e3d63-ba06-46de-9af6-6b22916374ce tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:28.630001 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9d9e3d63-ba06-46de-9af6-6b22916374ce tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: b90018d3-33b8-4bbc-9b09-d4f8a62a5a79] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:28.637620 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9d9e3d63-ba06-46de-9af6-6b22916374ce tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:28.638141 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9d9e3d63-ba06-46de-9af6-6b22916374ce tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:28.638578 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9d9e3d63-ba06-46de-9af6-6b22916374ce tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:28.639533 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9d9e3d63-ba06-46de-9af6-6b22916374ce tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:28.640165 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9d9e3d63-ba06-46de-9af6-6b22916374ce tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:28.640984 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9d9e3d63-ba06-46de-9af6-6b22916374ce tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:28.675020 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8f95bf58-c2e1-4f4b-9feb-addb63b1fb4e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:28.689643 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8f95bf58-c2e1-4f4b-9feb-addb63b1fb4e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09" status: 200 len: 1368 microversion: 2.1 time: 0.217575 Aug 31 15:56:28.693601 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 885/1876] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:28 2022] GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09 => generated 1368 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:28.710720 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-2857f946-adec-4227-b385-ffcb6de21b4b req-d8091d0d-7b7a-4c71-b2b9-ac51010ee9c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04a4f94b-5820-4bbe-a9b0-7fa55a697e09", "name": "network-vif-deleted", "tag": "f57c1856-6065-432f-b1a1-14b1ca0672d2"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:28.725034 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2857f946-adec-4227-b385-ffcb6de21b4b req-d8091d0d-7b7a-4c71-b2b9-ac51010ee9c6 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:28.725883 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2857f946-adec-4227-b385-ffcb6de21b4b req-d8091d0d-7b7a-4c71-b2b9-ac51010ee9c6 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:28.726821 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2857f946-adec-4227-b385-ffcb6de21b4b req-d8091d0d-7b7a-4c71-b2b9-ac51010ee9c6 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:28.757384 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-2857f946-adec-4227-b385-ffcb6de21b4b req-d8091d0d-7b7a-4c71-b2b9-ac51010ee9c6 service nova] Creating event network-vif-deleted:f57c1856-6065-432f-b1a1-14b1ca0672d2 for instance 04a4f94b-5820-4bbe-a9b0-7fa55a697e09 on n-h1-833090-16 Aug 31 15:56:28.763622 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-2857f946-adec-4227-b385-ffcb6de21b4b req-d8091d0d-7b7a-4c71-b2b9-ac51010ee9c6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068400 Aug 31 15:56:28.764435 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 886/1877] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:28.769666 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f5ab930a-4a7c-4683-a5d3-ebd81a4f3d6c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:28.770337 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f5ab930a-4a7c-4683-a5d3-ebd81a4f3d6c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] [instance: f6574815-a484-4d2d-82b4-9cc761af2c9a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:28.778531 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5ab930a-4a7c-4683-a5d3-ebd81a4f3d6c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:28.779023 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5ab930a-4a7c-4683-a5d3-ebd81a4f3d6c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:28.780008 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5ab930a-4a7c-4683-a5d3-ebd81a4f3d6c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:28.780185 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5ab930a-4a7c-4683-a5d3-ebd81a4f3d6c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:28.780624 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5ab930a-4a7c-4683-a5d3-ebd81a4f3d6c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:28.781050 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5ab930a-4a7c-4683-a5d3-ebd81a4f3d6c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:29.168876 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9d9e3d63-ba06-46de-9af6-6b22916374ce tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:29.182847 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9d9e3d63-ba06-46de-9af6-6b22916374ce tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/b90018d3-33b8-4bbc-9b09-d4f8a62a5a79" status: 200 len: 1315 microversion: 2.1 time: 0.560087 Aug 31 15:56:29.184390 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 992/1878] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:28 2022] GET /compute/v2.1/servers/b90018d3-33b8-4bbc-9b09-d4f8a62a5a79 => generated 1315 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:29.192104 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-73d41b7a-bfb7-4134-a784-7cc8854df9e4 req-e5b02a4a-3c2f-49ac-9052-53912ec1f346 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b90018d3-33b8-4bbc-9b09-d4f8a62a5a79", "tag": "9150bc93-a762-4941-b5ec-4f7b090a188b"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:29.200414 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f5ab930a-4a7c-4683-a5d3-ebd81a4f3d6c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a19bb40252746379cf71a4f4b773b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b53c5033fb543adaeaae8980537d4e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:29.206921 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-73d41b7a-bfb7-4134-a784-7cc8854df9e4 req-e5b02a4a-3c2f-49ac-9052-53912ec1f346 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:29.207836 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-73d41b7a-bfb7-4134-a784-7cc8854df9e4 req-e5b02a4a-3c2f-49ac-9052-53912ec1f346 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:29.208488 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-73d41b7a-bfb7-4134-a784-7cc8854df9e4 req-e5b02a4a-3c2f-49ac-9052-53912ec1f346 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:29.217715 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f5ab930a-4a7c-4683-a5d3-ebd81a4f3d6c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] 10.222.0.50 "GET /compute/v2.1/servers/f6574815-a484-4d2d-82b4-9cc761af2c9a" status: 200 len: 1320 microversion: 2.1 time: 0.452232 Aug 31 15:56:29.218658 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 887/1879] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:28 2022] GET /compute/v2.1/servers/f6574815-a484-4d2d-82b4-9cc761af2c9a => generated 1320 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:29.225215 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-73d41b7a-bfb7-4134-a784-7cc8854df9e4 req-e5b02a4a-3c2f-49ac-9052-53912ec1f346 service nova] Creating event network-changed:9150bc93-a762-4941-b5ec-4f7b090a188b for instance b90018d3-33b8-4bbc-9b09-d4f8a62a5a79 on n-h1-833090-16 Aug 31 15:56:29.231745 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-73d41b7a-bfb7-4134-a784-7cc8854df9e4 req-e5b02a4a-3c2f-49ac-9052-53912ec1f346 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045027 Aug 31 15:56:29.233202 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 993/1880] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:29.477501 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-23266f3c-5145-4220-86b2-3d988c5bedeb tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:29.478228 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-23266f3c-5145-4220-86b2-3d988c5bedeb tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] [instance: 56489785-4b4c-4614-acfc-af86763249f9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:29.488800 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23266f3c-5145-4220-86b2-3d988c5bedeb tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:29.489291 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23266f3c-5145-4220-86b2-3d988c5bedeb tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:29.489754 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23266f3c-5145-4220-86b2-3d988c5bedeb tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:29.501034 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23266f3c-5145-4220-86b2-3d988c5bedeb tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:29.501552 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23266f3c-5145-4220-86b2-3d988c5bedeb tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:29.502004 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23266f3c-5145-4220-86b2-3d988c5bedeb tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:29.628685 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4aa92f53-68ea-4c53-b660-3b21475dfbe0 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:29.629903 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4aa92f53-68ea-4c53-b660-3b21475dfbe0 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: f550488c-401c-4f00-805b-fe62d75da9d4] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:29.646628 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4aa92f53-68ea-4c53-b660-3b21475dfbe0 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:29.647189 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4aa92f53-68ea-4c53-b660-3b21475dfbe0 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:29.647649 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4aa92f53-68ea-4c53-b660-3b21475dfbe0 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:29.648568 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4aa92f53-68ea-4c53-b660-3b21475dfbe0 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:29.648901 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4aa92f53-68ea-4c53-b660-3b21475dfbe0 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:29.649318 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4aa92f53-68ea-4c53-b660-3b21475dfbe0 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:30.089516 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-23266f3c-5145-4220-86b2-3d988c5bedeb tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a66be47dc1d49f68f66ef363ccaccbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a740310041645c8b9c32992012d01aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:30.100334 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-23266f3c-5145-4220-86b2-3d988c5bedeb tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] 10.222.0.50 "GET /compute/v2.1/servers/56489785-4b4c-4614-acfc-af86763249f9" status: 200 len: 1507 microversion: 2.1 time: 0.627540 Aug 31 15:56:30.102118 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 888/1881] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:29 2022] GET /compute/v2.1/servers/56489785-4b4c-4614-acfc-af86763249f9 => generated 1507 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:30.107002 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4aa92f53-68ea-4c53-b660-3b21475dfbe0 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:30.121789 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4aa92f53-68ea-4c53-b660-3b21475dfbe0 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4" status: 200 len: 1496 microversion: 2.1 time: 0.497359 Aug 31 15:56:30.134627 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 994/1882] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:29 2022] GET /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4 => generated 1496 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:30.134859 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b066c1c3-f49d-4746-9bd7-1eee406281b0 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:30.135719 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b066c1c3-f49d-4746-9bd7-1eee406281b0 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 04a4f94b-5820-4bbe-a9b0-7fa55a697e09] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:30.143615 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b066c1c3-f49d-4746-9bd7-1eee406281b0 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:30.144353 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b066c1c3-f49d-4746-9bd7-1eee406281b0 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:30.144975 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b066c1c3-f49d-4746-9bd7-1eee406281b0 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:30.145868 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b066c1c3-f49d-4746-9bd7-1eee406281b0 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:30.146561 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b066c1c3-f49d-4746-9bd7-1eee406281b0 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:30.147151 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b066c1c3-f49d-4746-9bd7-1eee406281b0 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:30.160756 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:56:30.162923 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-b066c1c3-f49d-4746-9bd7-1eee406281b0 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] HTTP exception thrown: Instance 04a4f94b-5820-4bbe-a9b0-7fa55a697e09 could not be found. Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b066c1c3-f49d-4746-9bd7-1eee406281b0 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Request method failure captured: Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09 HTTP/1.1 Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4M4NFC83ApiGEvumoFdoFLVBqseZv6iK4iD9K5RIGEFCd3H1sg_fW0mpc-3vNOBJJqf_S0BPjt81eWEYwAEhJOuhqtm1ZsU9nClam-0UBj5S7abSSA1G67q5tlH93w3RwFJjEFLB01lUWsMMowJ9h2ujkEuH1I7pHqjSGdyOWlXgHY Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 9b4c50ece07f441b8974d384f4ab29a4 Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-MigrationsAdminTest-860368600 Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9b4c50ece07f441b8974d384f4ab29a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9b4c50ece07f441b8974d384f4ab29a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9b4c50ece07f441b8974d384f4ab29a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9b4c50ece07f441b8974d384f4ab29a4", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-MigrationsAdminTest-860368600 Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 9b4c50ece07f441b8974d384f4ab29a4 Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-MigrationsAdminTest-860368600 Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-MigrationsAdminTest-860368600-project Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 5f6f8b9d63234b8199c60f842a3c407f Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-MigrationsAdminTest-860368600-project Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 04a4f94b-5820-4bbe-a9b0-7fa55a697e09 could not be found. Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '04a4f94b-5820-4bbe-a9b0-7fa55a697e09'} Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04a4f94b-5820-4bbe-a9b0-7fa55a697e09 could not be found. Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04a4f94b-5820-4bbe-a9b0-7fa55a697e09 could not be found. Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:30.164964 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:56:30.170045 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:30.170045 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:30.170045 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:30.170045 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:56:30.170045 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:56:30.170045 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04a4f94b-5820-4bbe-a9b0-7fa55a697e09 could not be found. Aug 31 15:56:30.170045 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:56:30.171903 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b066c1c3-f49d-4746-9bd7-1eee406281b0 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Returning 404 to user: Instance 04a4f94b-5820-4bbe-a9b0-7fa55a697e09 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:56:30.172982 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b066c1c3-f49d-4746-9bd7-1eee406281b0 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09" status: 404 len: 111 microversion: 2.1 time: 0.069843 Aug 31 15:56:30.174398 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 889/1883] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:30 2022] GET /compute/v2.1/servers/04a4f94b-5820-4bbe-a9b0-7fa55a697e09 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:56:30.184827 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b35782ca-c688-482b-a16f-1821bc8866ae tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '.version_select at 0x7fbb4aa5c430>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:30.205384 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6bc55f66-3c90-4c4b-b22a-98eec8118154 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:30.206399 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6bc55f66-3c90-4c4b-b22a-98eec8118154 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: b90018d3-33b8-4bbc-9b09-d4f8a62a5a79] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:30.209746 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=22 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:56:30.220718 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6bc55f66-3c90-4c4b-b22a-98eec8118154 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:30.221218 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6bc55f66-3c90-4c4b-b22a-98eec8118154 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:30.221656 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6bc55f66-3c90-4c4b-b22a-98eec8118154 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:30.222388 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6bc55f66-3c90-4c4b-b22a-98eec8118154 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:30.222834 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6bc55f66-3c90-4c4b-b22a-98eec8118154 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:30.223250 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6bc55f66-3c90-4c4b-b22a-98eec8118154 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:30.230578 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b35782ca-c688-482b-a16f-1821bc8866ae tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-27323870" status: 202 len: 0 microversion: 2.1 time: 0.051295 Aug 31 15:56:30.234155 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 995/1884] 10.222.0.50 () {58 vars in 1215 bytes} [Wed Aug 31 15:56:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-27323870 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 15:56:30.242587 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2db1440b-53be-42f4-bc73-a19e83f11179 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:30.248554 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2db1440b-53be-42f4-bc73-a19e83f11179 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] [instance: f6574815-a484-4d2d-82b4-9cc761af2c9a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:30.270840 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2db1440b-53be-42f4-bc73-a19e83f11179 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:30.273502 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2db1440b-53be-42f4-bc73-a19e83f11179 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:30.274348 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2db1440b-53be-42f4-bc73-a19e83f11179 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:30.277688 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2db1440b-53be-42f4-bc73-a19e83f11179 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:30.278385 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2db1440b-53be-42f4-bc73-a19e83f11179 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:30.278976 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2db1440b-53be-42f4-bc73-a19e83f11179 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:30.612601 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2db1440b-53be-42f4-bc73-a19e83f11179 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a19bb40252746379cf71a4f4b773b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b53c5033fb543adaeaae8980537d4e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:30.629426 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2db1440b-53be-42f4-bc73-a19e83f11179 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] 10.222.0.50 "GET /compute/v2.1/servers/f6574815-a484-4d2d-82b4-9cc761af2c9a" status: 200 len: 1470 microversion: 2.1 time: 0.394520 Aug 31 15:56:30.630655 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 996/1885] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:30 2022] GET /compute/v2.1/servers/f6574815-a484-4d2d-82b4-9cc761af2c9a => generated 1470 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:30.632858 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6bc55f66-3c90-4c4b-b22a-98eec8118154 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:30.642176 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6bc55f66-3c90-4c4b-b22a-98eec8118154 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/b90018d3-33b8-4bbc-9b09-d4f8a62a5a79" status: 200 len: 1315 microversion: 2.1 time: 0.442326 Aug 31 15:56:30.654615 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f5c220dc-bf86-4916-8ef6-c8509c5570af tempest-DeleteServersAdminTestJSON-1745327615 tempest-DeleteServersAdminTestJSON-1745327615-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:30.658761 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 890/1886] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:30 2022] GET /compute/v2.1/servers/b90018d3-33b8-4bbc-9b09-d4f8a62a5a79 => generated 1315 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:56:30.660955 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f5c220dc-bf86-4916-8ef6-c8509c5570af tempest-DeleteServersAdminTestJSON-1745327615 tempest-DeleteServersAdminTestJSON-1745327615-project-admin] [instance: f6574815-a484-4d2d-82b4-9cc761af2c9a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:30.671208 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f5c220dc-bf86-4916-8ef6-c8509c5570af tempest-DeleteServersAdminTestJSON-1745327615 tempest-DeleteServersAdminTestJSON-1745327615-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:30.671692 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f5c220dc-bf86-4916-8ef6-c8509c5570af tempest-DeleteServersAdminTestJSON-1745327615 tempest-DeleteServersAdminTestJSON-1745327615-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:30.672269 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f5c220dc-bf86-4916-8ef6-c8509c5570af tempest-DeleteServersAdminTestJSON-1745327615 tempest-DeleteServersAdminTestJSON-1745327615-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:30.672978 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f5c220dc-bf86-4916-8ef6-c8509c5570af tempest-DeleteServersAdminTestJSON-1745327615 tempest-DeleteServersAdminTestJSON-1745327615-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:30.673422 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f5c220dc-bf86-4916-8ef6-c8509c5570af tempest-DeleteServersAdminTestJSON-1745327615 tempest-DeleteServersAdminTestJSON-1745327615-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:30.674030 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f5c220dc-bf86-4916-8ef6-c8509c5570af tempest-DeleteServersAdminTestJSON-1745327615 tempest-DeleteServersAdminTestJSON-1745327615-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:30.804575 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=16 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:56:30.888691 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f5c220dc-bf86-4916-8ef6-c8509c5570af tempest-DeleteServersAdminTestJSON-1745327615 tempest-DeleteServersAdminTestJSON-1745327615-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/f6574815-a484-4d2d-82b4-9cc761af2c9a/action" status: 202 len: 0 microversion: 2.1 time: 0.240233 Aug 31 15:56:30.893956 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 997/1887] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 15:56:30 2022] POST /compute/v2.1/servers/f6574815-a484-4d2d-82b4-9cc761af2c9a/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:56:30.897989 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a8d38b7b-c232-42bc-8a45-2be84c33c82c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:30.898787 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a8d38b7b-c232-42bc-8a45-2be84c33c82c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] [instance: f6574815-a484-4d2d-82b4-9cc761af2c9a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:30.909558 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a8d38b7b-c232-42bc-8a45-2be84c33c82c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:30.913169 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a8d38b7b-c232-42bc-8a45-2be84c33c82c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:30.916927 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a8d38b7b-c232-42bc-8a45-2be84c33c82c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:30.918790 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a8d38b7b-c232-42bc-8a45-2be84c33c82c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:30.923878 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a8d38b7b-c232-42bc-8a45-2be84c33c82c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:30.926280 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a8d38b7b-c232-42bc-8a45-2be84c33c82c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:30.985336 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a8d38b7b-c232-42bc-8a45-2be84c33c82c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:30.985834 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a8d38b7b-c232-42bc-8a45-2be84c33c82c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:30.986352 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a8d38b7b-c232-42bc-8a45-2be84c33c82c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:30.986815 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-a8d38b7b-c232-42bc-8a45-2be84c33c82c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lazy-loading 'fault' on Instance uuid f6574815-a484-4d2d-82b4-9cc761af2c9a {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:56:31.125741 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-83bac932-ef84-4807-8f86-931a263ef5ba tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:31.125904 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-83bac932-ef84-4807-8f86-931a263ef5ba tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] [instance: 56489785-4b4c-4614-acfc-af86763249f9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:31.137285 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:56:31.146956 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83bac932-ef84-4807-8f86-931a263ef5ba tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:31.151457 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83bac932-ef84-4807-8f86-931a263ef5ba tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:31.152213 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83bac932-ef84-4807-8f86-931a263ef5ba tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:31.157216 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83bac932-ef84-4807-8f86-931a263ef5ba tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:31.161101 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83bac932-ef84-4807-8f86-931a263ef5ba tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:31.165144 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83bac932-ef84-4807-8f86-931a263ef5ba tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:31.563385 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a8d38b7b-c232-42bc-8a45-2be84c33c82c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a19bb40252746379cf71a4f4b773b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b53c5033fb543adaeaae8980537d4e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:31.572698 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a8d38b7b-c232-42bc-8a45-2be84c33c82c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] 10.222.0.50 "GET /compute/v2.1/servers/f6574815-a484-4d2d-82b4-9cc761af2c9a" status: 200 len: 1453 microversion: 2.1 time: 0.679020 Aug 31 15:56:31.581460 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 891/1888] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:30 2022] GET /compute/v2.1/servers/f6574815-a484-4d2d-82b4-9cc761af2c9a => generated 1453 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:31.586965 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a434205f-5320-4a07-af4d-1eac7217efab tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:31.588178 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a434205f-5320-4a07-af4d-1eac7217efab tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: f550488c-401c-4f00-805b-fe62d75da9d4] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:31.594549 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a434205f-5320-4a07-af4d-1eac7217efab tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:31.595304 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a434205f-5320-4a07-af4d-1eac7217efab tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:31.596505 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a434205f-5320-4a07-af4d-1eac7217efab tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:31.597377 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a434205f-5320-4a07-af4d-1eac7217efab tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:31.597988 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a434205f-5320-4a07-af4d-1eac7217efab tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:31.598684 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a434205f-5320-4a07-af4d-1eac7217efab tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:31.741283 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-83bac932-ef84-4807-8f86-931a263ef5ba tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a66be47dc1d49f68f66ef363ccaccbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a740310041645c8b9c32992012d01aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:31.762553 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-83bac932-ef84-4807-8f86-931a263ef5ba tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] 10.222.0.50 "GET /compute/v2.1/servers/56489785-4b4c-4614-acfc-af86763249f9" status: 200 len: 1505 microversion: 2.1 time: 0.643080 Aug 31 15:56:31.763439 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 998/1889] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:31 2022] GET /compute/v2.1/servers/56489785-4b4c-4614-acfc-af86763249f9 => generated 1505 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:56:31.768857 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-955778ea-d6d5-475f-b8f3-f2a62123683f tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:31.769500 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-955778ea-d6d5-475f-b8f3-f2a62123683f tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] [instance: f6574815-a484-4d2d-82b4-9cc761af2c9a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:31.785305 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-955778ea-d6d5-475f-b8f3-f2a62123683f tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:31.785801 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-955778ea-d6d5-475f-b8f3-f2a62123683f tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:31.786258 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-955778ea-d6d5-475f-b8f3-f2a62123683f tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:31.787198 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-955778ea-d6d5-475f-b8f3-f2a62123683f tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:31.787653 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-955778ea-d6d5-475f-b8f3-f2a62123683f tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:31.788072 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-955778ea-d6d5-475f-b8f3-f2a62123683f tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:31.852271 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-955778ea-d6d5-475f-b8f3-f2a62123683f tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] [instance: f6574815-a484-4d2d-82b4-9cc761af2c9a] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:56:32.025481 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-955778ea-d6d5-475f-b8f3-f2a62123683f tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] 10.222.0.50 "DELETE /compute/v2.1/servers/f6574815-a484-4d2d-82b4-9cc761af2c9a" status: 204 len: 0 microversion: 2.1 time: 0.260261 Aug 31 15:56:32.027063 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 999/1890] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:56:31 2022] DELETE /compute/v2.1/servers/f6574815-a484-4d2d-82b4-9cc761af2c9a => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:56:32.033290 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a49e5d88-beac-4d06-a9d7-96c33d0077ef tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:32.036460 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a49e5d88-beac-4d06-a9d7-96c33d0077ef tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: b90018d3-33b8-4bbc-9b09-d4f8a62a5a79] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:32.049565 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a49e5d88-beac-4d06-a9d7-96c33d0077ef tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:32.060334 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a49e5d88-beac-4d06-a9d7-96c33d0077ef tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:32.060792 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a49e5d88-beac-4d06-a9d7-96c33d0077ef tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:32.063106 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a49e5d88-beac-4d06-a9d7-96c33d0077ef tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:32.064401 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a49e5d88-beac-4d06-a9d7-96c33d0077ef tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:32.064854 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a49e5d88-beac-4d06-a9d7-96c33d0077ef tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:32.888373 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a434205f-5320-4a07-af4d-1eac7217efab tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:32.906511 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a434205f-5320-4a07-af4d-1eac7217efab tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4" status: 200 len: 1496 microversion: 2.1 time: 1.323588 Aug 31 15:56:32.916123 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 892/1891] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:31 2022] GET /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4 => generated 1496 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:32.922884 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b2d8203b-6266-45e3-9302-1cc6e2264947 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Calling method '.version_select at 0x7fbb4ac57d30>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:32.923655 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b2d8203b-6266-45e3-9302-1cc6e2264947 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] [instance: 56489785-4b4c-4614-acfc-af86763249f9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:32.958018 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b2d8203b-6266-45e3-9302-1cc6e2264947 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:32.965212 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b2d8203b-6266-45e3-9302-1cc6e2264947 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:32.966084 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b2d8203b-6266-45e3-9302-1cc6e2264947 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:32.968067 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b2d8203b-6266-45e3-9302-1cc6e2264947 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:32.971151 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b2d8203b-6266-45e3-9302-1cc6e2264947 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:32.972763 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b2d8203b-6266-45e3-9302-1cc6e2264947 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:32.982873 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:56:33.007833 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a49e5d88-beac-4d06-a9d7-96c33d0077ef tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:33.017164 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a49e5d88-beac-4d06-a9d7-96c33d0077ef tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/b90018d3-33b8-4bbc-9b09-d4f8a62a5a79" status: 200 len: 1315 microversion: 2.1 time: 0.988481 Aug 31 15:56:33.020382 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1000/1892] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:32 2022] GET /compute/v2.1/servers/b90018d3-33b8-4bbc-9b09-d4f8a62a5a79 => generated 1315 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:33.038200 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fb6843f9-6b55-4410-81c6-384b4a5a7539 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:33.043018 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fb6843f9-6b55-4410-81c6-384b4a5a7539 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] [instance: f6574815-a484-4d2d-82b4-9cc761af2c9a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:33.060218 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb6843f9-6b55-4410-81c6-384b4a5a7539 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:33.064250 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb6843f9-6b55-4410-81c6-384b4a5a7539 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:33.065232 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb6843f9-6b55-4410-81c6-384b4a5a7539 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:33.066162 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb6843f9-6b55-4410-81c6-384b4a5a7539 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:33.068010 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb6843f9-6b55-4410-81c6-384b4a5a7539 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:33.075107 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb6843f9-6b55-4410-81c6-384b4a5a7539 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:33.100166 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b2d8203b-6266-45e3-9302-1cc6e2264947 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] 10.222.0.50 "GET /compute/v2.1/servers/56489785-4b4c-4614-acfc-af86763249f9/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.182331 Aug 31 15:56:33.110506 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 893/1893] 10.222.0.50 () {58 vars in 1296 bytes} [Wed Aug 31 15:56:32 2022] GET /compute/v2.1/servers/56489785-4b4c-4614-acfc-af86763249f9/os-instance-actions => generated 611 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:33.122016 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fc81b3be-c9c9-4cf9-9d89-b978cd07da64 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:33.122561 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fc81b3be-c9c9-4cf9-9d89-b978cd07da64 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 236954ea-2791-477d-a92b-88e590593c63] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:33.144087 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc81b3be-c9c9-4cf9-9d89-b978cd07da64 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:33.146653 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc81b3be-c9c9-4cf9-9d89-b978cd07da64 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:33.147286 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc81b3be-c9c9-4cf9-9d89-b978cd07da64 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:33.149272 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc81b3be-c9c9-4cf9-9d89-b978cd07da64 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:33.152088 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc81b3be-c9c9-4cf9-9d89-b978cd07da64 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:33.154439 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc81b3be-c9c9-4cf9-9d89-b978cd07da64 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:33.161002 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb6843f9-6b55-4410-81c6-384b4a5a7539 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:33.162704 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb6843f9-6b55-4410-81c6-384b4a5a7539 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:33.164336 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb6843f9-6b55-4410-81c6-384b4a5a7539 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:33.166004 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-fb6843f9-6b55-4410-81c6-384b4a5a7539 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lazy-loading 'fault' on Instance uuid f6574815-a484-4d2d-82b4-9cc761af2c9a {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:56:33.205797 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fc81b3be-c9c9-4cf9-9d89-b978cd07da64 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 236954ea-2791-477d-a92b-88e590593c63] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:56:33.348453 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fc81b3be-c9c9-4cf9-9d89-b978cd07da64 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "DELETE /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63" status: 204 len: 0 microversion: 2.1 time: 0.236116 Aug 31 15:56:33.349603 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 894/1894] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:56:33 2022] DELETE /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:56:33.358975 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f96fad34-7bbf-4407-acec-0c6f7010fc17 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:33.359935 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f96fad34-7bbf-4407-acec-0c6f7010fc17 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] [instance: 56489785-4b4c-4614-acfc-af86763249f9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:33.378661 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f96fad34-7bbf-4407-acec-0c6f7010fc17 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:33.384477 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f96fad34-7bbf-4407-acec-0c6f7010fc17 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:33.385552 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f96fad34-7bbf-4407-acec-0c6f7010fc17 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:33.387589 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f96fad34-7bbf-4407-acec-0c6f7010fc17 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:33.391674 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f96fad34-7bbf-4407-acec-0c6f7010fc17 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:33.393536 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f96fad34-7bbf-4407-acec-0c6f7010fc17 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:33.473636 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f96fad34-7bbf-4407-acec-0c6f7010fc17 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] [instance: 56489785-4b4c-4614-acfc-af86763249f9] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:56:33.679839 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-fb6843f9-6b55-4410-81c6-384b4a5a7539 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a19bb40252746379cf71a4f4b773b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b53c5033fb543adaeaae8980537d4e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:33.685080 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f96fad34-7bbf-4407-acec-0c6f7010fc17 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] 10.222.0.50 "DELETE /compute/v2.1/servers/56489785-4b4c-4614-acfc-af86763249f9" status: 204 len: 0 microversion: 2.1 time: 0.333864 Aug 31 15:56:33.685807 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 895/1895] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:56:33 2022] DELETE /compute/v2.1/servers/56489785-4b4c-4614-acfc-af86763249f9 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:56:33.691148 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5eaba3b5-aea1-49b7-9163-c9ac0e8187ed tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:33.692096 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5eaba3b5-aea1-49b7-9163-c9ac0e8187ed tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 236954ea-2791-477d-a92b-88e590593c63] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:33.694488 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fb6843f9-6b55-4410-81c6-384b4a5a7539 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] 10.222.0.50 "GET /compute/v2.1/servers/f6574815-a484-4d2d-82b4-9cc761af2c9a" status: 200 len: 1459 microversion: 2.1 time: 0.672531 Aug 31 15:56:33.705927 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5eaba3b5-aea1-49b7-9163-c9ac0e8187ed tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:33.714783 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5eaba3b5-aea1-49b7-9163-c9ac0e8187ed tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:33.715210 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5eaba3b5-aea1-49b7-9163-c9ac0e8187ed tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:33.715353 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1001/1896] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:33 2022] GET /compute/v2.1/servers/f6574815-a484-4d2d-82b4-9cc761af2c9a => generated 1459 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:33.715977 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5eaba3b5-aea1-49b7-9163-c9ac0e8187ed tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:33.716450 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5eaba3b5-aea1-49b7-9163-c9ac0e8187ed tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:33.716874 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5eaba3b5-aea1-49b7-9163-c9ac0e8187ed tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:33.725689 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-271bd07f-a7a9-48dd-97c7-59c0544f5691 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:33.726857 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-271bd07f-a7a9-48dd-97c7-59c0544f5691 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] [instance: 56489785-4b4c-4614-acfc-af86763249f9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:33.739419 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-271bd07f-a7a9-48dd-97c7-59c0544f5691 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:33.740265 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-271bd07f-a7a9-48dd-97c7-59c0544f5691 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:33.740945 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-271bd07f-a7a9-48dd-97c7-59c0544f5691 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:33.741952 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-271bd07f-a7a9-48dd-97c7-59c0544f5691 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:33.742651 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-271bd07f-a7a9-48dd-97c7-59c0544f5691 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:33.743374 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-271bd07f-a7a9-48dd-97c7-59c0544f5691 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:34.180446 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-271bd07f-a7a9-48dd-97c7-59c0544f5691 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a66be47dc1d49f68f66ef363ccaccbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a740310041645c8b9c32992012d01aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:34.190336 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-271bd07f-a7a9-48dd-97c7-59c0544f5691 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] 10.222.0.50 "GET /compute/v2.1/servers/56489785-4b4c-4614-acfc-af86763249f9" status: 200 len: 1511 microversion: 2.1 time: 0.473563 Aug 31 15:56:34.206183 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1002/1897] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:33 2022] GET /compute/v2.1/servers/56489785-4b4c-4614-acfc-af86763249f9 => generated 1511 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:34.206410 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5eaba3b5-aea1-49b7-9163-c9ac0e8187ed tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:34.214637 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5eaba3b5-aea1-49b7-9163-c9ac0e8187ed tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63" status: 200 len: 1468 microversion: 2.1 time: 0.527390 Aug 31 15:56:34.219084 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 896/1898] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:33 2022] GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63 => generated 1468 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:34.220678 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-955fce4a-93a5-4143-91ac-eb114b5d5405 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:34.221843 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-955fce4a-93a5-4143-91ac-eb114b5d5405 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: f550488c-401c-4f00-805b-fe62d75da9d4] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:34.225532 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-440ff8e9-852b-4c8c-a030-091cb28acbc5 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:34.232720 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-440ff8e9-852b-4c8c-a030-091cb28acbc5 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: b90018d3-33b8-4bbc-9b09-d4f8a62a5a79] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:34.235171 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-955fce4a-93a5-4143-91ac-eb114b5d5405 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:34.240654 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-955fce4a-93a5-4143-91ac-eb114b5d5405 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:34.241302 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-955fce4a-93a5-4143-91ac-eb114b5d5405 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:34.242924 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-955fce4a-93a5-4143-91ac-eb114b5d5405 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:34.244729 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-955fce4a-93a5-4143-91ac-eb114b5d5405 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:34.245260 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-955fce4a-93a5-4143-91ac-eb114b5d5405 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:34.251060 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-440ff8e9-852b-4c8c-a030-091cb28acbc5 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:34.251838 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-440ff8e9-852b-4c8c-a030-091cb28acbc5 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:34.253539 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-440ff8e9-852b-4c8c-a030-091cb28acbc5 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:34.257702 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-440ff8e9-852b-4c8c-a030-091cb28acbc5 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:34.258532 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-440ff8e9-852b-4c8c-a030-091cb28acbc5 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:34.259372 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-440ff8e9-852b-4c8c-a030-091cb28acbc5 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:34.671104 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-955fce4a-93a5-4143-91ac-eb114b5d5405 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:34.683869 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-955fce4a-93a5-4143-91ac-eb114b5d5405 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4" status: 200 len: 1473 microversion: 2.1 time: 0.487885 Aug 31 15:56:34.690248 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1003/1899] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:34 2022] GET /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4 => generated 1473 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:34.700209 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-440ff8e9-852b-4c8c-a030-091cb28acbc5 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:34.713171 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-440ff8e9-852b-4c8c-a030-091cb28acbc5 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/b90018d3-33b8-4bbc-9b09-d4f8a62a5a79" status: 200 len: 1315 microversion: 2.1 time: 0.489186 Aug 31 15:56:34.721378 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e59cf510-6f12-46cf-84fa-0c2fca48b04c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:34.722321 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e59cf510-6f12-46cf-84fa-0c2fca48b04c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] [instance: f6574815-a484-4d2d-82b4-9cc761af2c9a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:34.726684 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 897/1900] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:34 2022] GET /compute/v2.1/servers/b90018d3-33b8-4bbc-9b09-d4f8a62a5a79 => generated 1315 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:34.741977 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e59cf510-6f12-46cf-84fa-0c2fca48b04c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:34.743525 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e59cf510-6f12-46cf-84fa-0c2fca48b04c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:34.744271 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e59cf510-6f12-46cf-84fa-0c2fca48b04c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:34.745103 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e59cf510-6f12-46cf-84fa-0c2fca48b04c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:34.745644 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e59cf510-6f12-46cf-84fa-0c2fca48b04c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:34.746176 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e59cf510-6f12-46cf-84fa-0c2fca48b04c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:34.754383 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3eb03b78-337c-4690-b96d-bfb6b0bbca56 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1504585944"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:34.761384 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3eb03b78-337c-4690-b96d-bfb6b0bbca56 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: f550488c-401c-4f00-805b-fe62d75da9d4] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:34.788260 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3eb03b78-337c-4690-b96d-bfb6b0bbca56 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:34.788950 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3eb03b78-337c-4690-b96d-bfb6b0bbca56 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:34.789569 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3eb03b78-337c-4690-b96d-bfb6b0bbca56 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:34.790922 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3eb03b78-337c-4690-b96d-bfb6b0bbca56 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:34.791611 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3eb03b78-337c-4690-b96d-bfb6b0bbca56 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:34.792381 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3eb03b78-337c-4690-b96d-bfb6b0bbca56 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:34.810952 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e59cf510-6f12-46cf-84fa-0c2fca48b04c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:34.818285 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e59cf510-6f12-46cf-84fa-0c2fca48b04c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:34.820271 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e59cf510-6f12-46cf-84fa-0c2fca48b04c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:34.821375 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-e59cf510-6f12-46cf-84fa-0c2fca48b04c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lazy-loading 'fault' on Instance uuid f6574815-a484-4d2d-82b4-9cc761af2c9a {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:56:35.022413 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e59cf510-6f12-46cf-84fa-0c2fca48b04c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a19bb40252746379cf71a4f4b773b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b53c5033fb543adaeaae8980537d4e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:35.039849 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e59cf510-6f12-46cf-84fa-0c2fca48b04c tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] 10.222.0.50 "GET /compute/v2.1/servers/f6574815-a484-4d2d-82b4-9cc761af2c9a" status: 200 len: 1459 microversion: 2.1 time: 0.321995 Aug 31 15:56:35.058536 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1004/1901] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:34 2022] GET /compute/v2.1/servers/f6574815-a484-4d2d-82b4-9cc761af2c9a => generated 1459 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:35.181633 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3eb03b78-337c-4690-b96d-bfb6b0bbca56 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "POST /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4/action" status: 202 len: 0 microversion: 2.1 time: 0.452974 Aug 31 15:56:35.183316 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 898/1902] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 15:56:34 2022] POST /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4/action => generated 0 bytes in 456 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 31 15:56:35.198474 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f066e8d8-0f19-45e4-a123-28520ba12b76 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb4aa55940>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:35.230773 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fa7a34ad-35b6-4553-b3e9-3f832c0877e3 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:35.235563 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fa7a34ad-35b6-4553-b3e9-3f832c0877e3 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] [instance: 56489785-4b4c-4614-acfc-af86763249f9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:35.256409 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa7a34ad-35b6-4553-b3e9-3f832c0877e3 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:35.258227 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa7a34ad-35b6-4553-b3e9-3f832c0877e3 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:35.259287 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa7a34ad-35b6-4553-b3e9-3f832c0877e3 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:35.265999 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa7a34ad-35b6-4553-b3e9-3f832c0877e3 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:35.267627 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa7a34ad-35b6-4553-b3e9-3f832c0877e3 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:35.268716 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa7a34ad-35b6-4553-b3e9-3f832c0877e3 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:35.311251 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f066e8d8-0f19-45e4-a123-28520ba12b76 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/images/3eaecaef-7864-4e9d-a83b-14203707c01e" status: 200 len: 1412 microversion: 2.1 time: 0.121010 Aug 31 15:56:35.316720 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1005/1903] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:56:35 2022] GET /compute/v2.1/images/3eaecaef-7864-4e9d-a83b-14203707c01e => generated 1412 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:35.325553 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-02084d5b-34f0-4adf-aadc-c64797edcd0e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:35.330430 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-02084d5b-34f0-4adf-aadc-c64797edcd0e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 236954ea-2791-477d-a92b-88e590593c63] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:35.348265 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-02084d5b-34f0-4adf-aadc-c64797edcd0e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:35.350810 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-02084d5b-34f0-4adf-aadc-c64797edcd0e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:35.351568 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-02084d5b-34f0-4adf-aadc-c64797edcd0e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:35.353983 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-02084d5b-34f0-4adf-aadc-c64797edcd0e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:35.354578 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-02084d5b-34f0-4adf-aadc-c64797edcd0e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:35.355368 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-02084d5b-34f0-4adf-aadc-c64797edcd0e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:35.833065 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fa7a34ad-35b6-4553-b3e9-3f832c0877e3 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a66be47dc1d49f68f66ef363ccaccbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a740310041645c8b9c32992012d01aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:35.845395 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fa7a34ad-35b6-4553-b3e9-3f832c0877e3 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] 10.222.0.50 "GET /compute/v2.1/servers/56489785-4b4c-4614-acfc-af86763249f9" status: 200 len: 1511 microversion: 2.1 time: 0.629384 Aug 31 15:56:35.855781 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 899/1904] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:35 2022] GET /compute/v2.1/servers/56489785-4b4c-4614-acfc-af86763249f9 => generated 1511 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:56:35.877702 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ebdd7219-ad9f-40a3-b02c-00f9406c8c86 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:35.878784 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ebdd7219-ad9f-40a3-b02c-00f9406c8c86 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: b90018d3-33b8-4bbc-9b09-d4f8a62a5a79] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:35.894195 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebdd7219-ad9f-40a3-b02c-00f9406c8c86 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:35.895038 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebdd7219-ad9f-40a3-b02c-00f9406c8c86 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:35.895794 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebdd7219-ad9f-40a3-b02c-00f9406c8c86 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:35.896690 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebdd7219-ad9f-40a3-b02c-00f9406c8c86 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:35.910991 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebdd7219-ad9f-40a3-b02c-00f9406c8c86 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:35.911756 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebdd7219-ad9f-40a3-b02c-00f9406c8c86 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:35.969427 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-02084d5b-34f0-4adf-aadc-c64797edcd0e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:35.981353 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-02084d5b-34f0-4adf-aadc-c64797edcd0e tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63" status: 200 len: 1468 microversion: 2.1 time: 0.663568 Aug 31 15:56:35.982734 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1006/1905] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:35 2022] GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63 => generated 1468 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:35.990559 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-fca67d9a-5aba-4117-8811-b5c80eb94411 req-090b8bfc-4392-41a7-b309-70efbbe12915 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b90018d3-33b8-4bbc-9b09-d4f8a62a5a79", "name": "network-vif-plugged", "status": "completed", "tag": "9150bc93-a762-4941-b5ec-4f7b090a188b"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:36.002943 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-fca67d9a-5aba-4117-8811-b5c80eb94411 req-090b8bfc-4392-41a7-b309-70efbbe12915 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:36.003801 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-fca67d9a-5aba-4117-8811-b5c80eb94411 req-090b8bfc-4392-41a7-b309-70efbbe12915 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:36.004414 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-fca67d9a-5aba-4117-8811-b5c80eb94411 req-090b8bfc-4392-41a7-b309-70efbbe12915 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:36.012581 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:56:36.024077 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-fca67d9a-5aba-4117-8811-b5c80eb94411 req-090b8bfc-4392-41a7-b309-70efbbe12915 service nova] Creating event network-vif-plugged:9150bc93-a762-4941-b5ec-4f7b090a188b for instance b90018d3-33b8-4bbc-9b09-d4f8a62a5a79 on n-h1-833090-16 Aug 31 15:56:36.031357 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-fca67d9a-5aba-4117-8811-b5c80eb94411 req-090b8bfc-4392-41a7-b309-70efbbe12915 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046938 Aug 31 15:56:36.032527 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1007/1906] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:36.072151 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-76aea020-f099-4fbd-b93a-fb535bd2571d tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:36.076504 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-76aea020-f099-4fbd-b93a-fb535bd2571d tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] [instance: f6574815-a484-4d2d-82b4-9cc761af2c9a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:36.091430 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76aea020-f099-4fbd-b93a-fb535bd2571d tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:36.095994 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76aea020-f099-4fbd-b93a-fb535bd2571d tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:36.096648 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76aea020-f099-4fbd-b93a-fb535bd2571d tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:36.097579 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76aea020-f099-4fbd-b93a-fb535bd2571d tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:36.098231 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76aea020-f099-4fbd-b93a-fb535bd2571d tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:36.098836 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76aea020-f099-4fbd-b93a-fb535bd2571d tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:36.168118 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76aea020-f099-4fbd-b93a-fb535bd2571d tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:36.169122 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76aea020-f099-4fbd-b93a-fb535bd2571d tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:36.169723 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76aea020-f099-4fbd-b93a-fb535bd2571d tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:36.177964 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-76aea020-f099-4fbd-b93a-fb535bd2571d tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lazy-loading 'fault' on Instance uuid f6574815-a484-4d2d-82b4-9cc761af2c9a {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:56:36.472523 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ebdd7219-ad9f-40a3-b02c-00f9406c8c86 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:36.482462 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ebdd7219-ad9f-40a3-b02c-00f9406c8c86 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/b90018d3-33b8-4bbc-9b09-d4f8a62a5a79" status: 200 len: 1315 microversion: 2.1 time: 0.620756 Aug 31 15:56:36.484780 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 900/1907] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:35 2022] GET /compute/v2.1/servers/b90018d3-33b8-4bbc-9b09-d4f8a62a5a79 => generated 1315 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:36.493646 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2da7010b-add6-45ea-9fbf-846126208e81 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb46341550>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:36.536746 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-76aea020-f099-4fbd-b93a-fb535bd2571d tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a19bb40252746379cf71a4f4b773b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b53c5033fb543adaeaae8980537d4e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:36.545803 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-76aea020-f099-4fbd-b93a-fb535bd2571d tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] 10.222.0.50 "GET /compute/v2.1/servers/f6574815-a484-4d2d-82b4-9cc761af2c9a" status: 200 len: 1459 microversion: 2.1 time: 0.481072 Aug 31 15:56:36.572073 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1008/1908] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:36 2022] GET /compute/v2.1/servers/f6574815-a484-4d2d-82b4-9cc761af2c9a => generated 1459 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:36.598004 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2da7010b-add6-45ea-9fbf-846126208e81 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/images/3eaecaef-7864-4e9d-a83b-14203707c01e" status: 200 len: 1412 microversion: 2.1 time: 0.107855 Aug 31 15:56:36.599477 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 901/1909] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:56:36 2022] GET /compute/v2.1/images/3eaecaef-7864-4e9d-a83b-14203707c01e => generated 1412 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:36.877710 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-12d1d077-40e3-447a-89d3-bafbcd1d2afc tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:36.878521 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-12d1d077-40e3-447a-89d3-bafbcd1d2afc tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] [instance: 56489785-4b4c-4614-acfc-af86763249f9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:36.906525 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-12d1d077-40e3-447a-89d3-bafbcd1d2afc tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:36.907534 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-12d1d077-40e3-447a-89d3-bafbcd1d2afc tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:36.908403 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-12d1d077-40e3-447a-89d3-bafbcd1d2afc tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:36.909499 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-12d1d077-40e3-447a-89d3-bafbcd1d2afc tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:36.910274 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-12d1d077-40e3-447a-89d3-bafbcd1d2afc tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:36.911055 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-12d1d077-40e3-447a-89d3-bafbcd1d2afc tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:37.006931 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fef2edc7-ab5e-4a40-ab82-7ca4e82b5204 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:37.008122 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fef2edc7-ab5e-4a40-ab82-7ca4e82b5204 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 236954ea-2791-477d-a92b-88e590593c63] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:37.024031 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fef2edc7-ab5e-4a40-ab82-7ca4e82b5204 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:37.026026 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fef2edc7-ab5e-4a40-ab82-7ca4e82b5204 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:37.027738 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fef2edc7-ab5e-4a40-ab82-7ca4e82b5204 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:37.029612 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fef2edc7-ab5e-4a40-ab82-7ca4e82b5204 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:37.030263 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fef2edc7-ab5e-4a40-ab82-7ca4e82b5204 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:37.030847 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fef2edc7-ab5e-4a40-ab82-7ca4e82b5204 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:37.452178 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-12d1d077-40e3-447a-89d3-bafbcd1d2afc tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a66be47dc1d49f68f66ef363ccaccbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a740310041645c8b9c32992012d01aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:37.484660 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-12d1d077-40e3-447a-89d3-bafbcd1d2afc tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] 10.222.0.50 "GET /compute/v2.1/servers/56489785-4b4c-4614-acfc-af86763249f9" status: 200 len: 1511 microversion: 2.1 time: 0.610647 Aug 31 15:56:37.488624 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1009/1910] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:36 2022] GET /compute/v2.1/servers/56489785-4b4c-4614-acfc-af86763249f9 => generated 1511 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:37.507541 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-784880aa-4654-4a80-abed-ed695bbd113e req-5112eb3f-2023-42a9-9b51-0d10f443e390 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6574815-a484-4d2d-82b4-9cc761af2c9a", "name": "network-vif-deleted", "tag": "e900c20a-83c0-42c1-84b7-37696eebbb29"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:37.538538 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-784880aa-4654-4a80-abed-ed695bbd113e req-5112eb3f-2023-42a9-9b51-0d10f443e390 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:37.540288 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-784880aa-4654-4a80-abed-ed695bbd113e req-5112eb3f-2023-42a9-9b51-0d10f443e390 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:37.540929 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-784880aa-4654-4a80-abed-ed695bbd113e req-5112eb3f-2023-42a9-9b51-0d10f443e390 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:37.579379 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-784880aa-4654-4a80-abed-ed695bbd113e req-5112eb3f-2023-42a9-9b51-0d10f443e390 service nova] Creating event network-vif-deleted:e900c20a-83c0-42c1-84b7-37696eebbb29 for instance f6574815-a484-4d2d-82b4-9cc761af2c9a on n-h2-833090-16 Aug 31 15:56:37.596819 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-784880aa-4654-4a80-abed-ed695bbd113e req-5112eb3f-2023-42a9-9b51-0d10f443e390 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104680 Aug 31 15:56:37.600262 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1010/1911] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:37.617102 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fef2edc7-ab5e-4a40-ab82-7ca4e82b5204 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:37.630825 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fef2edc7-ab5e-4a40-ab82-7ca4e82b5204 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63" status: 200 len: 1468 microversion: 2.1 time: 0.628597 Aug 31 15:56:37.632059 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 902/1912] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:37 2022] GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63 => generated 1468 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:37.632696 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0295a04f-fa16-4895-b26d-238e118b606a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:37.635821 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0295a04f-fa16-4895-b26d-238e118b606a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: b90018d3-33b8-4bbc-9b09-d4f8a62a5a79] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:37.638911 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-205e5b5d-9128-48fd-88ef-28b858b1a9ae tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:37.639778 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-205e5b5d-9128-48fd-88ef-28b858b1a9ae tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] [instance: f6574815-a484-4d2d-82b4-9cc761af2c9a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:37.648130 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0295a04f-fa16-4895-b26d-238e118b606a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:37.652218 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0295a04f-fa16-4895-b26d-238e118b606a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:37.653306 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0295a04f-fa16-4895-b26d-238e118b606a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:37.656053 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0295a04f-fa16-4895-b26d-238e118b606a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:37.656745 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0295a04f-fa16-4895-b26d-238e118b606a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:37.657460 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0295a04f-fa16-4895-b26d-238e118b606a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:37.659592 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-205e5b5d-9128-48fd-88ef-28b858b1a9ae tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:37.660315 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-205e5b5d-9128-48fd-88ef-28b858b1a9ae tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:37.660789 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-205e5b5d-9128-48fd-88ef-28b858b1a9ae tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:37.669838 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-205e5b5d-9128-48fd-88ef-28b858b1a9ae tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:37.675126 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-205e5b5d-9128-48fd-88ef-28b858b1a9ae tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:37.675911 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-205e5b5d-9128-48fd-88ef-28b858b1a9ae tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:37.740611 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-205e5b5d-9128-48fd-88ef-28b858b1a9ae tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:37.741404 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-205e5b5d-9128-48fd-88ef-28b858b1a9ae tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:37.742289 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-205e5b5d-9128-48fd-88ef-28b858b1a9ae tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:37.745921 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-205e5b5d-9128-48fd-88ef-28b858b1a9ae tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lazy-loading 'fault' on Instance uuid f6574815-a484-4d2d-82b4-9cc761af2c9a {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:56:37.923192 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-205e5b5d-9128-48fd-88ef-28b858b1a9ae tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a19bb40252746379cf71a4f4b773b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b53c5033fb543adaeaae8980537d4e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:37.938015 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-205e5b5d-9128-48fd-88ef-28b858b1a9ae tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] 10.222.0.50 "GET /compute/v2.1/servers/f6574815-a484-4d2d-82b4-9cc761af2c9a" status: 200 len: 1310 microversion: 2.1 time: 0.304029 Aug 31 15:56:37.939443 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 903/1913] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:37 2022] GET /compute/v2.1/servers/f6574815-a484-4d2d-82b4-9cc761af2c9a => generated 1310 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:37.955634 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2ea6432e-c73b-4cbe-a781-9bc58c203a6d tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb4ac7fb80>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:38.063480 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2ea6432e-c73b-4cbe-a781-9bc58c203a6d tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/images/3eaecaef-7864-4e9d-a83b-14203707c01e" status: 200 len: 1412 microversion: 2.1 time: 0.121995 Aug 31 15:56:38.067915 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 904/1914] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:56:37 2022] GET /compute/v2.1/images/3eaecaef-7864-4e9d-a83b-14203707c01e => generated 1412 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:38.103326 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-39e03eaf-7949-475b-a39a-b2c941e6fc30 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-358660655", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "8de77340-24af-4d78-ada8-1b857d11fb2e"}], "security_groups": [{"name": "tempest-securitygroup--948350690"}], "key_name": "tempest-keypair-1358575584", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "11a450ed-efdd-4f7d-aa6c-b48ed74ea900", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:38.109058 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0295a04f-fa16-4895-b26d-238e118b606a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:38.121390 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0295a04f-fa16-4895-b26d-238e118b606a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/b90018d3-33b8-4bbc-9b09-d4f8a62a5a79" status: 200 len: 1315 microversion: 2.1 time: 0.517933 Aug 31 15:56:38.122507 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1011/1915] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:37 2022] GET /compute/v2.1/servers/b90018d3-33b8-4bbc-9b09-d4f8a62a5a79 => generated 1315 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:38.310677 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-963a721a-2679-4d18-a26a-7f8619446179 req-bb975bcf-65b6-4fb8-a131-2b9ecbccea98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "236954ea-2791-477d-a92b-88e590593c63", "name": "network-vif-deleted", "tag": "741689b8-43aa-4b92-9c42-308fa64c312a"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:38.395556 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-963a721a-2679-4d18-a26a-7f8619446179 req-bb975bcf-65b6-4fb8-a131-2b9ecbccea98 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:38.396087 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-963a721a-2679-4d18-a26a-7f8619446179 req-bb975bcf-65b6-4fb8-a131-2b9ecbccea98 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:38.396520 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-963a721a-2679-4d18-a26a-7f8619446179 req-bb975bcf-65b6-4fb8-a131-2b9ecbccea98 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:38.440097 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-963a721a-2679-4d18-a26a-7f8619446179 req-bb975bcf-65b6-4fb8-a131-2b9ecbccea98 service nova] Creating event network-vif-deleted:741689b8-43aa-4b92-9c42-308fa64c312a for instance 236954ea-2791-477d-a92b-88e590593c63 on n-h2-833090-16 Aug 31 15:56:38.447194 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-963a721a-2679-4d18-a26a-7f8619446179 req-bb975bcf-65b6-4fb8-a131-2b9ecbccea98 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144458 Aug 31 15:56:38.448351 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1012/1916] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:38.513452 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7f291a61-822c-4019-8793-d63462ecec86 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:38.514186 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7f291a61-822c-4019-8793-d63462ecec86 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] [instance: 56489785-4b4c-4614-acfc-af86763249f9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:38.528791 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f291a61-822c-4019-8793-d63462ecec86 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:38.533185 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f291a61-822c-4019-8793-d63462ecec86 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:38.533643 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f291a61-822c-4019-8793-d63462ecec86 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:38.534390 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f291a61-822c-4019-8793-d63462ecec86 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:38.534842 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f291a61-822c-4019-8793-d63462ecec86 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:38.535256 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f291a61-822c-4019-8793-d63462ecec86 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:38.598701 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-39e03eaf-7949-475b-a39a-b2c941e6fc30 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] validate_networks() for [('8de77340-24af-4d78-ada8-1b857d11fb2e', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:56:38.612762 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f291a61-822c-4019-8793-d63462ecec86 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:38.614347 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f291a61-822c-4019-8793-d63462ecec86 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:38.622864 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f291a61-822c-4019-8793-d63462ecec86 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:38.624498 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-7f291a61-822c-4019-8793-d63462ecec86 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lazy-loading 'fault' on Instance uuid 56489785-4b4c-4614-acfc-af86763249f9 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:56:38.716320 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7f291a61-822c-4019-8793-d63462ecec86 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a66be47dc1d49f68f66ef363ccaccbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a740310041645c8b9c32992012d01aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:38.730598 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7f291a61-822c-4019-8793-d63462ecec86 tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] 10.222.0.50 "GET /compute/v2.1/servers/56489785-4b4c-4614-acfc-af86763249f9" status: 200 len: 1307 microversion: 2.1 time: 0.222999 Aug 31 15:56:38.731399 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1013/1917] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:38 2022] GET /compute/v2.1/servers/56489785-4b4c-4614-acfc-af86763249f9 => generated 1307 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:38.745185 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-08429414-76d0-497e-b527-daaf82a9159d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:38.746466 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-08429414-76d0-497e-b527-daaf82a9159d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 236954ea-2791-477d-a92b-88e590593c63] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:38.761224 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-08429414-76d0-497e-b527-daaf82a9159d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:38.763740 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-08429414-76d0-497e-b527-daaf82a9159d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:38.765777 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-08429414-76d0-497e-b527-daaf82a9159d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:38.767160 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-08429414-76d0-497e-b527-daaf82a9159d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:38.770852 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-08429414-76d0-497e-b527-daaf82a9159d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:38.772169 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-08429414-76d0-497e-b527-daaf82a9159d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:38.851280 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-08429414-76d0-497e-b527-daaf82a9159d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:38.852092 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-08429414-76d0-497e-b527-daaf82a9159d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:38.852697 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-08429414-76d0-497e-b527-daaf82a9159d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:38.853314 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-08429414-76d0-497e-b527-daaf82a9159d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lazy-loading 'fault' on Instance uuid 236954ea-2791-477d-a92b-88e590593c63 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:56:39.118724 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-08429414-76d0-497e-b527-daaf82a9159d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:39.130086 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-08429414-76d0-497e-b527-daaf82a9159d tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63" status: 200 len: 1302 microversion: 2.1 time: 0.396724 Aug 31 15:56:39.145254 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1014/1918] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:38 2022] GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63 => generated 1302 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:39.153663 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-131f298c-8744-45e3-a654-de0cf8abc755 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:39.157389 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-131f298c-8744-45e3-a654-de0cf8abc755 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] [instance: f6574815-a484-4d2d-82b4-9cc761af2c9a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:39.171749 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-131f298c-8744-45e3-a654-de0cf8abc755 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:39.172233 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-131f298c-8744-45e3-a654-de0cf8abc755 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:39.172660 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-131f298c-8744-45e3-a654-de0cf8abc755 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:39.177018 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-131f298c-8744-45e3-a654-de0cf8abc755 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:39.178381 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-131f298c-8744-45e3-a654-de0cf8abc755 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:39.179091 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-131f298c-8744-45e3-a654-de0cf8abc755 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:39.216892 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-131f298c-8744-45e3-a654-de0cf8abc755 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] HTTP exception thrown: Instance f6574815-a484-4d2d-82b4-9cc761af2c9a could not be found. Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-131f298c-8744-45e3-a654-de0cf8abc755 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Request method failure captured: Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/f6574815-a484-4d2d-82b4-9cc761af2c9a HTTP/1.1 Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4Rwv3U6QdMXPqLE7SZBSWJNO4D93QIjUdh6ESa2S1oEQIVR3j294TGM6TaeeRnoj0rThFrJ8TrQsR_Ricc0u7pIDtBX6RsXI1UCBUbiVlOJlb6FISX_ps9UgvncHO8wDKum1Z3wm-zP5x2eIkt-Qnd9gmHXzGdHJfsKZMd7oAUZ5Sk Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 6b53c5033fb543adaeaae8980537d4e2 Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-DeleteServersAdminTestJSON-256335396 Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6b53c5033fb543adaeaae8980537d4e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6b53c5033fb543adaeaae8980537d4e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6b53c5033fb543adaeaae8980537d4e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6b53c5033fb543adaeaae8980537d4e2", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-DeleteServersAdminTestJSON-256335396 Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 6b53c5033fb543adaeaae8980537d4e2 Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-256335396 Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-DeleteServersAdminTestJSON-256335396-project Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 2a19bb40252746379cf71a4f4b773b0a Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-DeleteServersAdminTestJSON-256335396-project Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance f6574815-a484-4d2d-82b4-9cc761af2c9a could not be found. Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'f6574815-a484-4d2d-82b4-9cc761af2c9a'} Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6574815-a484-4d2d-82b4-9cc761af2c9a could not be found. Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6574815-a484-4d2d-82b4-9cc761af2c9a could not be found. Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:39.219306 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:56:39.224897 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:39.224897 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:39.224897 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:39.224897 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:56:39.224897 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:56:39.224897 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6574815-a484-4d2d-82b4-9cc761af2c9a could not be found. Aug 31 15:56:39.224897 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:56:39.224897 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-131f298c-8744-45e3-a654-de0cf8abc755 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Returning 404 to user: Instance f6574815-a484-4d2d-82b4-9cc761af2c9a could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:56:39.224897 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-131f298c-8744-45e3-a654-de0cf8abc755 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] 10.222.0.50 "GET /compute/v2.1/servers/f6574815-a484-4d2d-82b4-9cc761af2c9a" status: 404 len: 111 microversion: 2.1 time: 0.079263 Aug 31 15:56:39.226440 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1015/1919] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:39 2022] GET /compute/v2.1/servers/f6574815-a484-4d2d-82b4-9cc761af2c9a => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:56:39.243617 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3e583d4a-1e89-4482-b9f4-6517f5d8b299 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb4690dca0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:39.870084 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-39e03eaf-7949-475b-a39a-b2c941e6fc30 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Getting quotas for project e773dad0890c4048a0f0152e05fe8d77. Resources: dict_keys(['metadata_items']) {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:56:39.889760 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-39e03eaf-7949-475b-a39a-b2c941e6fc30 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Getting quotas for user e8f2bc800ceb41349e8c182d526d4d8e and project e773dad0890c4048a0f0152e05fe8d77. Resources: dict_keys(['metadata_items']) {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:56:39.942980 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-39e03eaf-7949-475b-a39a-b2c941e6fc30 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:56:39.943746 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-39e03eaf-7949-475b-a39a-b2c941e6fc30 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:56:39.945810 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-39e03eaf-7949-475b-a39a-b2c941e6fc30 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:56:39.946802 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-39e03eaf-7949-475b-a39a-b2c941e6fc30 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:56:39.949910 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-39e03eaf-7949-475b-a39a-b2c941e6fc30 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:56:39.977614 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39e03eaf-7949-475b-a39a-b2c941e6fc30 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:39.982945 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39e03eaf-7949-475b-a39a-b2c941e6fc30 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:39.983873 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39e03eaf-7949-475b-a39a-b2c941e6fc30 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:39.984907 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39e03eaf-7949-475b-a39a-b2c941e6fc30 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:39.988245 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39e03eaf-7949-475b-a39a-b2c941e6fc30 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:39.989025 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39e03eaf-7949-475b-a39a-b2c941e6fc30 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:40.064159 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-39e03eaf-7949-475b-a39a-b2c941e6fc30 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Getting quotas for project e773dad0890c4048a0f0152e05fe8d77. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:56:40.085381 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-39e03eaf-7949-475b-a39a-b2c941e6fc30 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Getting quotas for user e8f2bc800ceb41349e8c182d526d4d8e and project e773dad0890c4048a0f0152e05fe8d77. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:56:40.288487 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-39e03eaf-7949-475b-a39a-b2c941e6fc30 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:56:40.292550 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-39e03eaf-7949-475b-a39a-b2c941e6fc30 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] [instance: 0e79fda0-f46b-48bf-9e45-a183e5470fc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='11a450ed-efdd-4f7d-aa6c-b48ed74ea900',volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:56:40.589153 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-39e03eaf-7949-475b-a39a-b2c941e6fc30 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.519852 Aug 31 15:56:40.599041 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 905/1920] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:56:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 2530 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 15:56:40.604472 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7dfd8288-eda8-453b-af19-0db6e4887d71 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:40.605366 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7dfd8288-eda8-453b-af19-0db6e4887d71 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: b90018d3-33b8-4bbc-9b09-d4f8a62a5a79] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:40.617705 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7dfd8288-eda8-453b-af19-0db6e4887d71 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:40.618549 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7dfd8288-eda8-453b-af19-0db6e4887d71 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:40.619663 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7dfd8288-eda8-453b-af19-0db6e4887d71 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:40.620660 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7dfd8288-eda8-453b-af19-0db6e4887d71 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:40.621297 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7dfd8288-eda8-453b-af19-0db6e4887d71 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:40.621921 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7dfd8288-eda8-453b-af19-0db6e4887d71 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:41.090474 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7dfd8288-eda8-453b-af19-0db6e4887d71 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:41.103362 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7dfd8288-eda8-453b-af19-0db6e4887d71 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/b90018d3-33b8-4bbc-9b09-d4f8a62a5a79" status: 200 len: 1502 microversion: 2.1 time: 0.502801 Aug 31 15:56:41.104673 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 906/1921] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:40 2022] GET /compute/v2.1/servers/b90018d3-33b8-4bbc-9b09-d4f8a62a5a79 => generated 1502 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:41.109798 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f88a2cae-53eb-4335-a5b3-454b04976a80 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:41.110368 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f88a2cae-53eb-4335-a5b3-454b04976a80 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] [instance: f6574815-a484-4d2d-82b4-9cc761af2c9a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:41.117843 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f88a2cae-53eb-4335-a5b3-454b04976a80 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:41.118781 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f88a2cae-53eb-4335-a5b3-454b04976a80 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:41.119660 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f88a2cae-53eb-4335-a5b3-454b04976a80 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:41.124335 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f88a2cae-53eb-4335-a5b3-454b04976a80 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:41.125413 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f88a2cae-53eb-4335-a5b3-454b04976a80 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:41.126293 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f88a2cae-53eb-4335-a5b3-454b04976a80 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:41.151639 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-f88a2cae-53eb-4335-a5b3-454b04976a80 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] HTTP exception thrown: Instance f6574815-a484-4d2d-82b4-9cc761af2c9a could not be found. Aug 31 15:56:41.154636 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f88a2cae-53eb-4335-a5b3-454b04976a80 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Request method failure captured: Aug 31 15:56:41.154636 n-d-833090-16 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/f6574815-a484-4d2d-82b4-9cc761af2c9a HTTP/1.1 Aug 31 15:56:41.154636 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:56:41.154636 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:56:41.154636 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:56:41.154636 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:56:41.154636 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:56:41.154636 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:56:41.154636 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:56:41.154636 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:56:41.154636 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4Rwv3U6QdMXPqLE7SZBSWJNO4D93QIjUdh6ESa2S1oEQIVR3j294TGM6TaeeRnoj0rThFrJ8TrQsR_Ricc0u7pIDtBX6RsXI1UCBUbiVlOJlb6FISX_ps9UgvncHO8wDKum1Z3wm-zP5x2eIkt-Qnd9gmHXzGdHJfsKZMd7oAUZ5Sk Aug 31 15:56:41.154636 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:56:41.154636 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:56:41.154636 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:56:41.154636 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:56:41.154636 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:56:41.154636 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:56:41.154636 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 6b53c5033fb543adaeaae8980537d4e2 Aug 31 15:56:41.154636 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-DeleteServersAdminTestJSON-256335396 Aug 31 15:56:41.154636 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:56:41.154636 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:56:41.154636 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6b53c5033fb543adaeaae8980537d4e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6b53c5033fb543adaeaae8980537d4e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6b53c5033fb543adaeaae8980537d4e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6b53c5033fb543adaeaae8980537d4e2", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:56:41.154636 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-DeleteServersAdminTestJSON-256335396 Aug 31 15:56:41.154636 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 6b53c5033fb543adaeaae8980537d4e2 Aug 31 15:56:41.154636 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-256335396 Aug 31 15:56:41.154636 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-DeleteServersAdminTestJSON-256335396-project Aug 31 15:56:41.154636 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:56:41.154636 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:56:41.154636 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 2a19bb40252746379cf71a4f4b773b0a Aug 31 15:56:41.154636 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-DeleteServersAdminTestJSON-256335396-project Aug 31 15:56:41.154636 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 15:56:41.154636 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance f6574815-a484-4d2d-82b4-9cc761af2c9a could not be found. Aug 31 15:56:41.154636 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'f6574815-a484-4d2d-82b4-9cc761af2c9a'} Aug 31 15:56:41.154636 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:56:41.154636 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:41.154636 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:56:41.154636 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:56:41.154636 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:56:41.154636 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:56:41.154636 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:56:41.154636 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:56:41.154636 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:56:41.154636 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:56:41.154636 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6574815-a484-4d2d-82b4-9cc761af2c9a could not be found. Aug 31 15:56:41.154636 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:56:41.154636 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:41.154636 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:56:41.154636 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:41.154636 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:41.154636 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:41.154636 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:56:41.154636 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:56:41.154636 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:56:41.154636 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:56:41.154636 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 15:56:41.154636 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 15:56:41.154636 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 15:56:41.154636 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 15:56:41.154636 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:56:41.154636 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:56:41.154636 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:56:41.154636 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:56:41.159992 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6574815-a484-4d2d-82b4-9cc761af2c9a could not be found. Aug 31 15:56:41.159992 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:56:41.159992 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:41.159992 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:56:41.159992 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:41.159992 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:41.159992 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:41.159992 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:56:41.159992 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:56:41.159992 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6574815-a484-4d2d-82b4-9cc761af2c9a could not be found. Aug 31 15:56:41.159992 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:56:41.162080 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f88a2cae-53eb-4335-a5b3-454b04976a80 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Returning 404 to user: Instance f6574815-a484-4d2d-82b4-9cc761af2c9a could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:56:41.163455 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f88a2cae-53eb-4335-a5b3-454b04976a80 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] 10.222.0.50 "DELETE /compute/v2.1/servers/f6574815-a484-4d2d-82b4-9cc761af2c9a" status: 404 len: 111 microversion: 2.1 time: 0.057568 Aug 31 15:56:41.170790 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 907/1922] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:56:41 2022] DELETE /compute/v2.1/servers/f6574815-a484-4d2d-82b4-9cc761af2c9a => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:56:41.176348 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-18a4a66f-b41b-4cc4-900c-08925ae29389 req-cce0ee8c-6243-4e2b-a6b5-f9b6c71bda5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56489785-4b4c-4614-acfc-af86763249f9", "name": "network-vif-deleted", "tag": "3a01f967-b20a-4b06-80e1-770ba7e45135"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:41.187232 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-18a4a66f-b41b-4cc4-900c-08925ae29389 req-cce0ee8c-6243-4e2b-a6b5-f9b6c71bda5b service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:41.188047 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-18a4a66f-b41b-4cc4-900c-08925ae29389 req-cce0ee8c-6243-4e2b-a6b5-f9b6c71bda5b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:41.188411 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-18a4a66f-b41b-4cc4-900c-08925ae29389 req-cce0ee8c-6243-4e2b-a6b5-f9b6c71bda5b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:41.191682 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:56:41.211396 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-18a4a66f-b41b-4cc4-900c-08925ae29389 req-cce0ee8c-6243-4e2b-a6b5-f9b6c71bda5b service nova] Creating event network-vif-deleted:3a01f967-b20a-4b06-80e1-770ba7e45135 for instance 56489785-4b4c-4614-acfc-af86763249f9 on n-h2-833090-16 Aug 31 15:56:41.220910 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-18a4a66f-b41b-4cc4-900c-08925ae29389 req-cce0ee8c-6243-4e2b-a6b5-f9b6c71bda5b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048117 Aug 31 15:56:41.222221 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 908/1923] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:41.229126 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-45c91095-1231-4810-a2c9-2a88c89185de tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:41.230214 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-45c91095-1231-4810-a2c9-2a88c89185de tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] [instance: 56489785-4b4c-4614-acfc-af86763249f9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:41.242958 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45c91095-1231-4810-a2c9-2a88c89185de tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:41.243933 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45c91095-1231-4810-a2c9-2a88c89185de tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:41.244556 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45c91095-1231-4810-a2c9-2a88c89185de tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:41.245917 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45c91095-1231-4810-a2c9-2a88c89185de tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:41.246782 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45c91095-1231-4810-a2c9-2a88c89185de tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:41.247475 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45c91095-1231-4810-a2c9-2a88c89185de tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:41.286492 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-45c91095-1231-4810-a2c9-2a88c89185de tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] HTTP exception thrown: Instance 56489785-4b4c-4614-acfc-af86763249f9 could not be found. Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-45c91095-1231-4810-a2c9-2a88c89185de tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Request method failure captured: Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/56489785-4b4c-4614-acfc-af86763249f9 HTTP/1.1 Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4SUZZm4rKndObHgf75XxWt6Hc4k0Gy5b4n3FNdBS4pm9rKCvfQ5eRa0SL935OG0UCCNlJWTabvpjuaGW8BqSlNLigexF5v4tKPvh-F07B-X4P7d_21gbNRBvYJjbQr9glJD77kYXIRY9dxFXJ3nbZ-C29cGIlmtZoRMIB64KIZYtvQ Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 7a740310041645c8b9c32992012d01aa Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-InstanceActionsTestJSON-1806889346 Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7a740310041645c8b9c32992012d01aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7a740310041645c8b9c32992012d01aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7a740310041645c8b9c32992012d01aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7a740310041645c8b9c32992012d01aa", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-InstanceActionsTestJSON-1806889346 Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 7a740310041645c8b9c32992012d01aa Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1806889346 Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-InstanceActionsTestJSON-1806889346-project Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 2a66be47dc1d49f68f66ef363ccaccbd Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-InstanceActionsTestJSON-1806889346-project Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 56489785-4b4c-4614-acfc-af86763249f9 could not be found. Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '56489785-4b4c-4614-acfc-af86763249f9'} Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56489785-4b4c-4614-acfc-af86763249f9 could not be found. Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56489785-4b4c-4614-acfc-af86763249f9 could not be found. Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:41.292553 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:56:41.298194 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:41.298194 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:41.298194 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:41.298194 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:56:41.298194 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:56:41.298194 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56489785-4b4c-4614-acfc-af86763249f9 could not be found. Aug 31 15:56:41.298194 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:56:41.301828 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-45c91095-1231-4810-a2c9-2a88c89185de tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] Returning 404 to user: Instance 56489785-4b4c-4614-acfc-af86763249f9 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:56:41.302970 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-45c91095-1231-4810-a2c9-2a88c89185de tempest-InstanceActionsTestJSON-1806889346 tempest-InstanceActionsTestJSON-1806889346-project] 10.222.0.50 "GET /compute/v2.1/servers/56489785-4b4c-4614-acfc-af86763249f9" status: 404 len: 111 microversion: 2.1 time: 0.079166 Aug 31 15:56:41.310216 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 909/1924] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:41 2022] GET /compute/v2.1/servers/56489785-4b4c-4614-acfc-af86763249f9 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:56:41.332470 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8ea08154-98c1-4ae8-bf14-929bef9d7771 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:41.333122 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8ea08154-98c1-4ae8-bf14-929bef9d7771 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: 236954ea-2791-477d-a92b-88e590593c63] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:41.353701 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ea08154-98c1-4ae8-bf14-929bef9d7771 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:41.354225 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ea08154-98c1-4ae8-bf14-929bef9d7771 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:41.354657 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ea08154-98c1-4ae8-bf14-929bef9d7771 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:41.355368 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ea08154-98c1-4ae8-bf14-929bef9d7771 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:41.355818 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ea08154-98c1-4ae8-bf14-929bef9d7771 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:41.356261 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ea08154-98c1-4ae8-bf14-929bef9d7771 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:41.420214 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-8ea08154-98c1-4ae8-bf14-929bef9d7771 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] HTTP exception thrown: Instance 236954ea-2791-477d-a92b-88e590593c63 could not be found. Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8ea08154-98c1-4ae8-bf14-929bef9d7771 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Request method failure captured: Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63 HTTP/1.1 Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4M4NFC83ApiGEvumoFdoFLVBqseZv6iK4iD9K5RIGEFCd3H1sg_fW0mpc-3vNOBJJqf_S0BPjt81eWEYwAEhJOuhqtm1ZsU9nClam-0UBj5S7abSSA1G67q5tlH93w3RwFJjEFLB01lUWsMMowJ9h2ujkEuH1I7pHqjSGdyOWlXgHY Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 9b4c50ece07f441b8974d384f4ab29a4 Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-MigrationsAdminTest-860368600 Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9b4c50ece07f441b8974d384f4ab29a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9b4c50ece07f441b8974d384f4ab29a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9b4c50ece07f441b8974d384f4ab29a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9b4c50ece07f441b8974d384f4ab29a4", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-MigrationsAdminTest-860368600 Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 9b4c50ece07f441b8974d384f4ab29a4 Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-MigrationsAdminTest-860368600 Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-MigrationsAdminTest-860368600-project Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 5f6f8b9d63234b8199c60f842a3c407f Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-MigrationsAdminTest-860368600-project Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 236954ea-2791-477d-a92b-88e590593c63 could not be found. Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '236954ea-2791-477d-a92b-88e590593c63'} Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 236954ea-2791-477d-a92b-88e590593c63 could not be found. Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 236954ea-2791-477d-a92b-88e590593c63 could not be found. Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:41.427015 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:56:41.435645 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:41.435645 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:41.435645 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:41.435645 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:56:41.435645 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:56:41.435645 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 236954ea-2791-477d-a92b-88e590593c63 could not be found. Aug 31 15:56:41.435645 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:56:41.435645 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8ea08154-98c1-4ae8-bf14-929bef9d7771 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Returning 404 to user: Instance 236954ea-2791-477d-a92b-88e590593c63 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:56:41.435645 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8ea08154-98c1-4ae8-bf14-929bef9d7771 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63" status: 404 len: 111 microversion: 2.1 time: 0.117063 Aug 31 15:56:41.435645 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 910/1925] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:41 2022] GET /compute/v2.1/servers/236954ea-2791-477d-a92b-88e590593c63 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:56:41.454730 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-acdb59c0-0694-44bd-b4e8-e2a6a761c4e7 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:41.455642 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-acdb59c0-0694-44bd-b4e8-e2a6a761c4e7 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] [instance: 0e79fda0-f46b-48bf-9e45-a183e5470fc7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:41.482861 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:56:41.566226 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3e583d4a-1e89-4482-b9f4-6517f5d8b299 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/images/3eaecaef-7864-4e9d-a83b-14203707c01e" status: 200 len: 1412 microversion: 2.1 time: 2.337225 Aug 31 15:56:41.571896 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1016/1926] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:56:39 2022] GET /compute/v2.1/images/3eaecaef-7864-4e9d-a83b-14203707c01e => generated 1412 bytes in 2345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:41.586572 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-60f81f14-d95f-4085-aa68-e236ccf9c5f9 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:41.589281 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-60f81f14-d95f-4085-aa68-e236ccf9c5f9 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: b90018d3-33b8-4bbc-9b09-d4f8a62a5a79] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:41.608218 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-60f81f14-d95f-4085-aa68-e236ccf9c5f9 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:41.619221 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-60f81f14-d95f-4085-aa68-e236ccf9c5f9 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:41.620994 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-60f81f14-d95f-4085-aa68-e236ccf9c5f9 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:41.623222 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-60f81f14-d95f-4085-aa68-e236ccf9c5f9 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:41.631799 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-60f81f14-d95f-4085-aa68-e236ccf9c5f9 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:41.633768 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-60f81f14-d95f-4085-aa68-e236ccf9c5f9 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:41.820751 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-60f81f14-d95f-4085-aa68-e236ccf9c5f9 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "POST /compute/v2.1/servers/b90018d3-33b8-4bbc-9b09-d4f8a62a5a79/action" status: 202 len: 0 microversion: 2.1 time: 0.244876 Aug 31 15:56:41.822081 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1017/1927] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 15:56:41 2022] POST /compute/v2.1/servers/b90018d3-33b8-4bbc-9b09-d4f8a62a5a79/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:56:41.828242 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5e31f192-dab5-4133-b48e-c4020bd0bbea tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:41.829332 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5e31f192-dab5-4133-b48e-c4020bd0bbea tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] [instance: f6574815-a484-4d2d-82b4-9cc761af2c9a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:41.837198 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e31f192-dab5-4133-b48e-c4020bd0bbea tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:41.838682 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e31f192-dab5-4133-b48e-c4020bd0bbea tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:41.839502 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e31f192-dab5-4133-b48e-c4020bd0bbea tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:41.840816 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e31f192-dab5-4133-b48e-c4020bd0bbea tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:41.841632 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e31f192-dab5-4133-b48e-c4020bd0bbea tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:41.842397 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e31f192-dab5-4133-b48e-c4020bd0bbea tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:41.863699 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-5e31f192-dab5-4133-b48e-c4020bd0bbea tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] HTTP exception thrown: Instance f6574815-a484-4d2d-82b4-9cc761af2c9a could not be found. Aug 31 15:56:41.864651 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-acdb59c0-0694-44bd-b4e8-e2a6a761c4e7 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f2bc800ceb41349e8c182d526d4d8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773dad0890c4048a0f0152e05fe8d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5e31f192-dab5-4133-b48e-c4020bd0bbea tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Request method failure captured: Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/f6574815-a484-4d2d-82b4-9cc761af2c9a HTTP/1.1 Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4Rwv3U6QdMXPqLE7SZBSWJNO4D93QIjUdh6ESa2S1oEQIVR3j294TGM6TaeeRnoj0rThFrJ8TrQsR_Ricc0u7pIDtBX6RsXI1UCBUbiVlOJlb6FISX_ps9UgvncHO8wDKum1Z3wm-zP5x2eIkt-Qnd9gmHXzGdHJfsKZMd7oAUZ5Sk Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 6b53c5033fb543adaeaae8980537d4e2 Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-DeleteServersAdminTestJSON-256335396 Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6b53c5033fb543adaeaae8980537d4e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6b53c5033fb543adaeaae8980537d4e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6b53c5033fb543adaeaae8980537d4e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6b53c5033fb543adaeaae8980537d4e2", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-DeleteServersAdminTestJSON-256335396 Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 6b53c5033fb543adaeaae8980537d4e2 Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-256335396 Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-DeleteServersAdminTestJSON-256335396-project Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 2a19bb40252746379cf71a4f4b773b0a Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-DeleteServersAdminTestJSON-256335396-project Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance f6574815-a484-4d2d-82b4-9cc761af2c9a could not be found. Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'f6574815-a484-4d2d-82b4-9cc761af2c9a'} Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6574815-a484-4d2d-82b4-9cc761af2c9a could not be found. Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6574815-a484-4d2d-82b4-9cc761af2c9a could not be found. Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:41.866784 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:56:41.873587 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:41.873587 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:41.873587 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:41.873587 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:56:41.873587 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:56:41.873587 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6574815-a484-4d2d-82b4-9cc761af2c9a could not be found. Aug 31 15:56:41.873587 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:56:41.874443 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-acdb59c0-0694-44bd-b4e8-e2a6a761c4e7 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] 10.222.0.50 "GET /compute/v2.1/servers/0e79fda0-f46b-48bf-9e45-a183e5470fc7" status: 200 len: 1121 microversion: 2.1 time: 0.436724 Aug 31 15:56:41.876168 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5e31f192-dab5-4133-b48e-c4020bd0bbea tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Returning 404 to user: Instance f6574815-a484-4d2d-82b4-9cc761af2c9a could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:56:41.876476 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 911/1928] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:41 2022] GET /compute/v2.1/servers/0e79fda0-f46b-48bf-9e45-a183e5470fc7 => generated 1121 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:41.877667 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5e31f192-dab5-4133-b48e-c4020bd0bbea tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] 10.222.0.50 "GET /compute/v2.1/servers/f6574815-a484-4d2d-82b4-9cc761af2c9a" status: 404 len: 111 microversion: 2.1 time: 0.054072 Aug 31 15:56:41.878976 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1018/1929] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:41 2022] GET /compute/v2.1/servers/f6574815-a484-4d2d-82b4-9cc761af2c9a => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:56:41.884162 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-d16d7fe9-f128-4384-9d51-e71766e57035 req-81ea5f14-250a-4471-9ee4-8181841e8cbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f550488c-401c-4f00-805b-fe62d75da9d4", "name": "network-vif-plugged", "status": "completed", "tag": "0245a049-7e50-451b-9002-cd4e13a97fa5"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:41.893359 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-37926011-b570-418a-99b2-53d22678f9a5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:41.893862 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-37926011-b570-418a-99b2-53d22678f9a5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: a5a21e54-e375-4370-9d9e-b41df3e5922e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:41.906342 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-d16d7fe9-f128-4384-9d51-e71766e57035 req-81ea5f14-250a-4471-9ee4-8181841e8cbd service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:41.907186 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-d16d7fe9-f128-4384-9d51-e71766e57035 req-81ea5f14-250a-4471-9ee4-8181841e8cbd service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:41.908826 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-d16d7fe9-f128-4384-9d51-e71766e57035 req-81ea5f14-250a-4471-9ee4-8181841e8cbd service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:41.911709 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37926011-b570-418a-99b2-53d22678f9a5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:41.912197 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37926011-b570-418a-99b2-53d22678f9a5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:41.912628 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37926011-b570-418a-99b2-53d22678f9a5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:41.913521 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37926011-b570-418a-99b2-53d22678f9a5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:41.928251 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37926011-b570-418a-99b2-53d22678f9a5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:41.929008 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37926011-b570-418a-99b2-53d22678f9a5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:41.939807 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-d16d7fe9-f128-4384-9d51-e71766e57035 req-81ea5f14-250a-4471-9ee4-8181841e8cbd service nova] Creating event network-vif-plugged:0245a049-7e50-451b-9002-cd4e13a97fa5 for instance f550488c-401c-4f00-805b-fe62d75da9d4 on n-h1-833090-16 Aug 31 15:56:41.946788 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-d16d7fe9-f128-4384-9d51-e71766e57035 req-81ea5f14-250a-4471-9ee4-8181841e8cbd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065846 Aug 31 15:56:41.947805 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1019/1930] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:41.955143 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-39807db6-ed3b-485e-9c11-6d84d1e2afd2 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:41.956339 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-39807db6-ed3b-485e-9c11-6d84d1e2afd2 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: b90018d3-33b8-4bbc-9b09-d4f8a62a5a79] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:41.964384 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-39807db6-ed3b-485e-9c11-6d84d1e2afd2 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:41.965202 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-39807db6-ed3b-485e-9c11-6d84d1e2afd2 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:41.965887 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-39807db6-ed3b-485e-9c11-6d84d1e2afd2 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:41.967891 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-39807db6-ed3b-485e-9c11-6d84d1e2afd2 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:41.968710 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-39807db6-ed3b-485e-9c11-6d84d1e2afd2 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:41.969411 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-39807db6-ed3b-485e-9c11-6d84d1e2afd2 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:42.036187 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-37926011-b570-418a-99b2-53d22678f9a5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: a5a21e54-e375-4370-9d9e-b41df3e5922e] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:56:42.379817 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-37926011-b570-418a-99b2-53d22678f9a5 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e" status: 204 len: 0 microversion: 2.1 time: 0.501949 Aug 31 15:56:42.382053 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 912/1931] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:56:41 2022] DELETE /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e => generated 0 bytes in 505 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:56:42.395386 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-19efc84d-ec77-41f3-9927-6d797cb0d055 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:42.399510 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-19efc84d-ec77-41f3-9927-6d797cb0d055 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] [instance: bbf8b630-eb17-4c08-9347-531e5b63c829] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:42.453075 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19efc84d-ec77-41f3-9927-6d797cb0d055 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:42.457265 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19efc84d-ec77-41f3-9927-6d797cb0d055 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:42.461083 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19efc84d-ec77-41f3-9927-6d797cb0d055 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:42.464511 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19efc84d-ec77-41f3-9927-6d797cb0d055 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:42.467831 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19efc84d-ec77-41f3-9927-6d797cb0d055 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:42.471083 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19efc84d-ec77-41f3-9927-6d797cb0d055 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:42.544340 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-19efc84d-ec77-41f3-9927-6d797cb0d055 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] HTTP exception thrown: Instance bbf8b630-eb17-4c08-9347-531e5b63c829 could not be found. Aug 31 15:56:42.550834 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-19efc84d-ec77-41f3-9927-6d797cb0d055 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Request method failure captured: Aug 31 15:56:42.550834 n-d-833090-16 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/bbf8b630-eb17-4c08-9347-531e5b63c829 HTTP/1.1 Aug 31 15:56:42.550834 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:56:42.550834 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:56:42.550834 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:56:42.550834 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:56:42.550834 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:56:42.550834 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:56:42.550834 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:56:42.550834 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:56:42.550834 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4Rwv3U6QdMXPqLE7SZBSWJNO4D93QIjUdh6ESa2S1oEQIVR3j294TGM6TaeeRnoj0rThFrJ8TrQsR_Ricc0u7pIDtBX6RsXI1UCBUbiVlOJlb6FISX_ps9UgvncHO8wDKum1Z3wm-zP5x2eIkt-Qnd9gmHXzGdHJfsKZMd7oAUZ5Sk Aug 31 15:56:42.550834 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:56:42.550834 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:56:42.550834 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:56:42.550834 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:56:42.550834 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:56:42.550834 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:56:42.550834 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 6b53c5033fb543adaeaae8980537d4e2 Aug 31 15:56:42.550834 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-DeleteServersAdminTestJSON-256335396 Aug 31 15:56:42.550834 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:56:42.550834 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:56:42.550834 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6b53c5033fb543adaeaae8980537d4e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6b53c5033fb543adaeaae8980537d4e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6b53c5033fb543adaeaae8980537d4e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6b53c5033fb543adaeaae8980537d4e2", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:56:42.550834 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-DeleteServersAdminTestJSON-256335396 Aug 31 15:56:42.550834 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 6b53c5033fb543adaeaae8980537d4e2 Aug 31 15:56:42.550834 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-256335396 Aug 31 15:56:42.550834 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-DeleteServersAdminTestJSON-256335396-project Aug 31 15:56:42.550834 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:56:42.550834 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:56:42.550834 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 2a19bb40252746379cf71a4f4b773b0a Aug 31 15:56:42.550834 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-DeleteServersAdminTestJSON-256335396-project Aug 31 15:56:42.550834 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 15:56:42.550834 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance bbf8b630-eb17-4c08-9347-531e5b63c829 could not be found. Aug 31 15:56:42.550834 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'bbf8b630-eb17-4c08-9347-531e5b63c829'} Aug 31 15:56:42.550834 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:56:42.550834 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:42.550834 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:56:42.550834 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:56:42.550834 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:56:42.550834 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:56:42.550834 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:56:42.550834 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:56:42.550834 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:56:42.550834 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:56:42.550834 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbf8b630-eb17-4c08-9347-531e5b63c829 could not be found. Aug 31 15:56:42.550834 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:56:42.550834 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:42.550834 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:56:42.550834 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:42.550834 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:42.550834 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:42.550834 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:56:42.550834 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:56:42.550834 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:56:42.550834 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:56:42.550834 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 15:56:42.550834 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 15:56:42.550834 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 15:56:42.550834 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 15:56:42.550834 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:56:42.550834 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:56:42.550834 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:56:42.550834 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:56:42.558173 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbf8b630-eb17-4c08-9347-531e5b63c829 could not be found. Aug 31 15:56:42.558173 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:56:42.558173 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:42.558173 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:56:42.558173 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:42.558173 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:42.558173 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:42.558173 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:56:42.558173 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:56:42.558173 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbf8b630-eb17-4c08-9347-531e5b63c829 could not be found. Aug 31 15:56:42.558173 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:56:42.561178 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-19efc84d-ec77-41f3-9927-6d797cb0d055 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Returning 404 to user: Instance bbf8b630-eb17-4c08-9347-531e5b63c829 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:56:42.562339 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-19efc84d-ec77-41f3-9927-6d797cb0d055 tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] 10.222.0.50 "DELETE /compute/v2.1/servers/bbf8b630-eb17-4c08-9347-531e5b63c829" status: 404 len: 111 microversion: 2.1 time: 0.178707 Aug 31 15:56:42.563249 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 913/1932] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:56:42 2022] DELETE /compute/v2.1/servers/bbf8b630-eb17-4c08-9347-531e5b63c829 => generated 111 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:56:42.607763 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-53937630-ec2d-4d86-92b9-d3ae03bfa567 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:42.621382 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-53937630-ec2d-4d86-92b9-d3ae03bfa567 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: a5a21e54-e375-4370-9d9e-b41df3e5922e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:42.658660 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-53937630-ec2d-4d86-92b9-d3ae03bfa567 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:42.675832 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-53937630-ec2d-4d86-92b9-d3ae03bfa567 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:42.676450 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-53937630-ec2d-4d86-92b9-d3ae03bfa567 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:42.677338 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-53937630-ec2d-4d86-92b9-d3ae03bfa567 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:42.678734 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-53937630-ec2d-4d86-92b9-d3ae03bfa567 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:42.682905 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-53937630-ec2d-4d86-92b9-d3ae03bfa567 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:43.851535 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-39807db6-ed3b-485e-9c11-6d84d1e2afd2 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:43.865063 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-39807db6-ed3b-485e-9c11-6d84d1e2afd2 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/b90018d3-33b8-4bbc-9b09-d4f8a62a5a79" status: 200 len: 1507 microversion: 2.1 time: 1.915784 Aug 31 15:56:43.865980 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1020/1933] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:41 2022] GET /compute/v2.1/servers/b90018d3-33b8-4bbc-9b09-d4f8a62a5a79 => generated 1507 bytes in 1917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:43.890302 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b5218a41-0fd3-4ed6-bc13-cbc4cefcc62d tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:43.892606 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b5218a41-0fd3-4ed6-bc13-cbc4cefcc62d tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] [instance: bbf8b630-eb17-4c08-9347-531e5b63c829] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:43.908605 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b5218a41-0fd3-4ed6-bc13-cbc4cefcc62d tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:43.909517 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b5218a41-0fd3-4ed6-bc13-cbc4cefcc62d tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:43.910596 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b5218a41-0fd3-4ed6-bc13-cbc4cefcc62d tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:43.915687 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b5218a41-0fd3-4ed6-bc13-cbc4cefcc62d tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:43.916387 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b5218a41-0fd3-4ed6-bc13-cbc4cefcc62d tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:43.916985 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b5218a41-0fd3-4ed6-bc13-cbc4cefcc62d tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:43.951517 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-b5218a41-0fd3-4ed6-bc13-cbc4cefcc62d tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] HTTP exception thrown: Instance bbf8b630-eb17-4c08-9347-531e5b63c829 could not be found. Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b5218a41-0fd3-4ed6-bc13-cbc4cefcc62d tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Request method failure captured: Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/bbf8b630-eb17-4c08-9347-531e5b63c829 HTTP/1.1 Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4Rwv3U6QdMXPqLE7SZBSWJNO4D93QIjUdh6ESa2S1oEQIVR3j294TGM6TaeeRnoj0rThFrJ8TrQsR_Ricc0u7pIDtBX6RsXI1UCBUbiVlOJlb6FISX_ps9UgvncHO8wDKum1Z3wm-zP5x2eIkt-Qnd9gmHXzGdHJfsKZMd7oAUZ5Sk Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 6b53c5033fb543adaeaae8980537d4e2 Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-DeleteServersAdminTestJSON-256335396 Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6b53c5033fb543adaeaae8980537d4e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6b53c5033fb543adaeaae8980537d4e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6b53c5033fb543adaeaae8980537d4e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6b53c5033fb543adaeaae8980537d4e2", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-DeleteServersAdminTestJSON-256335396 Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 6b53c5033fb543adaeaae8980537d4e2 Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-256335396 Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-DeleteServersAdminTestJSON-256335396-project Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 2a19bb40252746379cf71a4f4b773b0a Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-DeleteServersAdminTestJSON-256335396-project Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance bbf8b630-eb17-4c08-9347-531e5b63c829 could not be found. Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'bbf8b630-eb17-4c08-9347-531e5b63c829'} Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbf8b630-eb17-4c08-9347-531e5b63c829 could not be found. Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbf8b630-eb17-4c08-9347-531e5b63c829 could not be found. Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:43.953198 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:56:43.959987 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:43.959987 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:43.959987 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:43.959987 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:56:43.959987 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:56:43.959987 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbf8b630-eb17-4c08-9347-531e5b63c829 could not be found. Aug 31 15:56:43.959987 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:56:43.959987 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b5218a41-0fd3-4ed6-bc13-cbc4cefcc62d tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] Returning 404 to user: Instance bbf8b630-eb17-4c08-9347-531e5b63c829 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:56:43.959987 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b5218a41-0fd3-4ed6-bc13-cbc4cefcc62d tempest-DeleteServersAdminTestJSON-256335396 tempest-DeleteServersAdminTestJSON-256335396-project] 10.222.0.50 "GET /compute/v2.1/servers/bbf8b630-eb17-4c08-9347-531e5b63c829" status: 404 len: 111 microversion: 2.1 time: 0.075087 Aug 31 15:56:43.961310 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1021/1934] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:43 2022] GET /compute/v2.1/servers/bbf8b630-eb17-4c08-9347-531e5b63c829 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:56:43.966084 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8efd6531-8aba-4084-82be-59c45f0d77ab tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb461b2430>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:44.100926 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8efd6531-8aba-4084-82be-59c45f0d77ab tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/images/3eaecaef-7864-4e9d-a83b-14203707c01e" status: 200 len: 1412 microversion: 2.1 time: 0.139207 Aug 31 15:56:44.101521 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1022/1935] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:56:43 2022] GET /compute/v2.1/images/3eaecaef-7864-4e9d-a83b-14203707c01e => generated 1412 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:44.129993 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8fa05f5f-7798-4489-a849-d38b4331c90f tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:44.139340 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8fa05f5f-7798-4489-a849-d38b4331c90f tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] [instance: 0e79fda0-f46b-48bf-9e45-a183e5470fc7] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:44.146781 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8fa05f5f-7798-4489-a849-d38b4331c90f tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:44.147241 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8fa05f5f-7798-4489-a849-d38b4331c90f tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:44.147787 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8fa05f5f-7798-4489-a849-d38b4331c90f tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:44.148413 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8fa05f5f-7798-4489-a849-d38b4331c90f tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:44.159219 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8fa05f5f-7798-4489-a849-d38b4331c90f tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:44.160045 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8fa05f5f-7798-4489-a849-d38b4331c90f tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:44.311072 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-53937630-ec2d-4d86-92b9-d3ae03bfa567 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:44.322500 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-53937630-ec2d-4d86-92b9-d3ae03bfa567 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e" status: 200 len: 1468 microversion: 2.1 time: 1.754815 Aug 31 15:56:44.332073 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 914/1936] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:42 2022] GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e => generated 1468 bytes in 1766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:44.492940 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8fa05f5f-7798-4489-a849-d38b4331c90f tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f2bc800ceb41349e8c182d526d4d8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773dad0890c4048a0f0152e05fe8d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:44.508700 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8fa05f5f-7798-4489-a849-d38b4331c90f tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] 10.222.0.50 "GET /compute/v2.1/servers/0e79fda0-f46b-48bf-9e45-a183e5470fc7" status: 200 len: 1237 microversion: 2.1 time: 0.393176 Aug 31 15:56:44.509804 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1023/1937] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:44 2022] GET /compute/v2.1/servers/0e79fda0-f46b-48bf-9e45-a183e5470fc7 => generated 1237 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:44.890420 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d570ba37-0673-4980-a5be-1db30a3c7bb8 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:44.891395 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d570ba37-0673-4980-a5be-1db30a3c7bb8 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: b90018d3-33b8-4bbc-9b09-d4f8a62a5a79] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:44.900419 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d570ba37-0673-4980-a5be-1db30a3c7bb8 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:44.907801 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d570ba37-0673-4980-a5be-1db30a3c7bb8 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:44.908498 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d570ba37-0673-4980-a5be-1db30a3c7bb8 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:44.909414 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d570ba37-0673-4980-a5be-1db30a3c7bb8 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:44.910039 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d570ba37-0673-4980-a5be-1db30a3c7bb8 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:44.910665 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d570ba37-0673-4980-a5be-1db30a3c7bb8 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:45.116952 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-98752217-31d7-4df7-a152-ce136a0ac609 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb461b4ca0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:45.217700 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-98752217-31d7-4df7-a152-ce136a0ac609 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/images/3eaecaef-7864-4e9d-a83b-14203707c01e" status: 200 len: 1412 microversion: 2.1 time: 0.106199 Aug 31 15:56:45.225618 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1024/1938] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:56:45 2022] GET /compute/v2.1/images/3eaecaef-7864-4e9d-a83b-14203707c01e => generated 1412 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:56:45.353138 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-be6e498b-d58f-4340-96a7-91bad65f4259 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:45.354050 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-be6e498b-d58f-4340-96a7-91bad65f4259 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: a5a21e54-e375-4370-9d9e-b41df3e5922e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:45.368226 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-be6e498b-d58f-4340-96a7-91bad65f4259 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:45.369030 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-be6e498b-d58f-4340-96a7-91bad65f4259 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:45.369635 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-be6e498b-d58f-4340-96a7-91bad65f4259 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:45.370634 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-be6e498b-d58f-4340-96a7-91bad65f4259 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:45.371270 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-be6e498b-d58f-4340-96a7-91bad65f4259 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:45.373821 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-be6e498b-d58f-4340-96a7-91bad65f4259 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:46.799528 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d570ba37-0673-4980-a5be-1db30a3c7bb8 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:46.821771 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d570ba37-0673-4980-a5be-1db30a3c7bb8 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/b90018d3-33b8-4bbc-9b09-d4f8a62a5a79" status: 200 len: 1487 microversion: 2.1 time: 1.935334 Aug 31 15:56:46.822401 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 915/1939] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:44 2022] GET /compute/v2.1/servers/b90018d3-33b8-4bbc-9b09-d4f8a62a5a79 => generated 1487 bytes in 1937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:46.838979 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-aa03ffa5-ccdb-47b2-bafc-73162c89b47a tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:46.851045 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-aa03ffa5-ccdb-47b2-bafc-73162c89b47a tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] [instance: 0e79fda0-f46b-48bf-9e45-a183e5470fc7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:46.867534 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa03ffa5-ccdb-47b2-bafc-73162c89b47a tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:46.868069 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa03ffa5-ccdb-47b2-bafc-73162c89b47a tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:46.868503 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa03ffa5-ccdb-47b2-bafc-73162c89b47a tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:46.869212 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa03ffa5-ccdb-47b2-bafc-73162c89b47a tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:46.869686 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa03ffa5-ccdb-47b2-bafc-73162c89b47a tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:46.870119 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa03ffa5-ccdb-47b2-bafc-73162c89b47a tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:47.221782 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-aa03ffa5-ccdb-47b2-bafc-73162c89b47a tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f2bc800ceb41349e8c182d526d4d8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773dad0890c4048a0f0152e05fe8d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:47.255725 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-aa03ffa5-ccdb-47b2-bafc-73162c89b47a tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] 10.222.0.50 "GET /compute/v2.1/servers/0e79fda0-f46b-48bf-9e45-a183e5470fc7" status: 200 len: 1237 microversion: 2.1 time: 0.432003 Aug 31 15:56:47.269035 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 916/1940] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:46 2022] GET /compute/v2.1/servers/0e79fda0-f46b-48bf-9e45-a183e5470fc7 => generated 1237 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:47.278620 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d604a1eb-37e1-48a4-9670-d92e568c5aee tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb4ac14550>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:47.395052 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d604a1eb-37e1-48a4-9670-d92e568c5aee tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/images/3eaecaef-7864-4e9d-a83b-14203707c01e" status: 200 len: 1412 microversion: 2.1 time: 0.135474 Aug 31 15:56:47.395796 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 917/1941] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:56:47 2022] GET /compute/v2.1/images/3eaecaef-7864-4e9d-a83b-14203707c01e => generated 1412 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:47.401552 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f7ddfc44-4a58-4300-9d68-baf48b321b70 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:47.419625 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f7ddfc44-4a58-4300-9d68-baf48b321b70 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: b90018d3-33b8-4bbc-9b09-d4f8a62a5a79] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:47.437187 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7ddfc44-4a58-4300-9d68-baf48b321b70 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:47.438571 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7ddfc44-4a58-4300-9d68-baf48b321b70 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:47.439424 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7ddfc44-4a58-4300-9d68-baf48b321b70 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:47.441138 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7ddfc44-4a58-4300-9d68-baf48b321b70 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:47.442009 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7ddfc44-4a58-4300-9d68-baf48b321b70 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:47.442697 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7ddfc44-4a58-4300-9d68-baf48b321b70 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:47.443606 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-be6e498b-d58f-4340-96a7-91bad65f4259 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:47.465541 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-be6e498b-d58f-4340-96a7-91bad65f4259 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e" status: 200 len: 1468 microversion: 2.1 time: 2.114151 Aug 31 15:56:47.483790 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1025/1942] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:45 2022] GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e => generated 1468 bytes in 2135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:56:47.515217 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f7ddfc44-4a58-4300-9d68-baf48b321b70 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: b90018d3-33b8-4bbc-9b09-d4f8a62a5a79] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:56:47.754597 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f7ddfc44-4a58-4300-9d68-baf48b321b70 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b90018d3-33b8-4bbc-9b09-d4f8a62a5a79" status: 204 len: 0 microversion: 2.1 time: 0.351693 Aug 31 15:56:47.759154 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 918/1943] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:56:47 2022] DELETE /compute/v2.1/servers/b90018d3-33b8-4bbc-9b09-d4f8a62a5a79 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:56:47.767288 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e59b37d5-1fb9-4080-bc9d-98b123e0b661 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:47.768183 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e59b37d5-1fb9-4080-bc9d-98b123e0b661 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: b90018d3-33b8-4bbc-9b09-d4f8a62a5a79] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:47.783105 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e59b37d5-1fb9-4080-bc9d-98b123e0b661 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:47.783610 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e59b37d5-1fb9-4080-bc9d-98b123e0b661 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:47.784047 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e59b37d5-1fb9-4080-bc9d-98b123e0b661 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:47.791912 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e59b37d5-1fb9-4080-bc9d-98b123e0b661 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:47.795405 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e59b37d5-1fb9-4080-bc9d-98b123e0b661 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:47.796300 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e59b37d5-1fb9-4080-bc9d-98b123e0b661 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:47.854509 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-ed09d671-5cb1-4ed7-8a8b-88083b757316 req-034b1b4f-863e-444f-a537-c681b7f629d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5a21e54-e375-4370-9d9e-b41df3e5922e", "name": "network-vif-deleted", "tag": "abeadf77-b435-4819-a412-27a7510ef57a"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:47.886112 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ed09d671-5cb1-4ed7-8a8b-88083b757316 req-034b1b4f-863e-444f-a537-c681b7f629d6 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:47.886616 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ed09d671-5cb1-4ed7-8a8b-88083b757316 req-034b1b4f-863e-444f-a537-c681b7f629d6 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:47.887062 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ed09d671-5cb1-4ed7-8a8b-88083b757316 req-034b1b4f-863e-444f-a537-c681b7f629d6 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:47.948289 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-ed09d671-5cb1-4ed7-8a8b-88083b757316 req-034b1b4f-863e-444f-a537-c681b7f629d6 service nova] Creating event network-vif-deleted:abeadf77-b435-4819-a412-27a7510ef57a for instance a5a21e54-e375-4370-9d9e-b41df3e5922e on n-h1-833090-16 Aug 31 15:56:47.960317 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-ed09d671-5cb1-4ed7-8a8b-88083b757316 req-034b1b4f-863e-444f-a537-c681b7f629d6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109834 Aug 31 15:56:47.962972 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 919/1944] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:56:48.279607 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a9dec88c-c82e-4f8c-b726-63473eb4ff7c tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:48.280224 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a9dec88c-c82e-4f8c-b726-63473eb4ff7c tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] [instance: 0e79fda0-f46b-48bf-9e45-a183e5470fc7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:48.300444 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9dec88c-c82e-4f8c-b726-63473eb4ff7c tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:48.300977 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9dec88c-c82e-4f8c-b726-63473eb4ff7c tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:48.301433 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9dec88c-c82e-4f8c-b726-63473eb4ff7c tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:48.302222 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9dec88c-c82e-4f8c-b726-63473eb4ff7c tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:48.302686 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9dec88c-c82e-4f8c-b726-63473eb4ff7c tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:48.303113 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9dec88c-c82e-4f8c-b726-63473eb4ff7c tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:49.299901 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e59b37d5-1fb9-4080-bc9d-98b123e0b661 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:49.312195 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e59b37d5-1fb9-4080-bc9d-98b123e0b661 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/b90018d3-33b8-4bbc-9b09-d4f8a62a5a79" status: 200 len: 1493 microversion: 2.1 time: 1.548696 Aug 31 15:56:49.325721 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1026/1945] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:47 2022] GET /compute/v2.1/servers/b90018d3-33b8-4bbc-9b09-d4f8a62a5a79 => generated 1493 bytes in 1563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:49.341271 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2f2365a9-381e-4094-80df-06af53d6bde2 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb461dc040>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:49.512685 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2f2365a9-381e-4094-80df-06af53d6bde2 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/images/3eaecaef-7864-4e9d-a83b-14203707c01e" status: 200 len: 1412 microversion: 2.1 time: 0.185367 Aug 31 15:56:49.515321 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1027/1946] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:56:49 2022] GET /compute/v2.1/images/3eaecaef-7864-4e9d-a83b-14203707c01e => generated 1412 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:49.527244 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9244693a-ed5c-4956-9f34-1d08071b2793 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:49.532509 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9244693a-ed5c-4956-9f34-1d08071b2793 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: a5a21e54-e375-4370-9d9e-b41df3e5922e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:49.543926 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9244693a-ed5c-4956-9f34-1d08071b2793 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:49.546696 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9244693a-ed5c-4956-9f34-1d08071b2793 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:49.547497 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9244693a-ed5c-4956-9f34-1d08071b2793 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:49.550500 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9244693a-ed5c-4956-9f34-1d08071b2793 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:49.551476 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9244693a-ed5c-4956-9f34-1d08071b2793 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:49.554745 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9244693a-ed5c-4956-9f34-1d08071b2793 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:49.739672 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9244693a-ed5c-4956-9f34-1d08071b2793 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:49.740701 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9244693a-ed5c-4956-9f34-1d08071b2793 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:49.741918 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9244693a-ed5c-4956-9f34-1d08071b2793 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:49.744195 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-9244693a-ed5c-4956-9f34-1d08071b2793 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lazy-loading 'fault' on Instance uuid a5a21e54-e375-4370-9d9e-b41df3e5922e {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:56:49.754655 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a9dec88c-c82e-4f8c-b726-63473eb4ff7c tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f2bc800ceb41349e8c182d526d4d8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773dad0890c4048a0f0152e05fe8d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:49.774236 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a9dec88c-c82e-4f8c-b726-63473eb4ff7c tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] 10.222.0.50 "GET /compute/v2.1/servers/0e79fda0-f46b-48bf-9e45-a183e5470fc7" status: 200 len: 1304 microversion: 2.1 time: 1.492145 Aug 31 15:56:49.797011 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 920/1947] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:48 2022] GET /compute/v2.1/servers/0e79fda0-f46b-48bf-9e45-a183e5470fc7 => generated 1304 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:56:49.884957 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9244693a-ed5c-4956-9f34-1d08071b2793 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f6f8b9d63234b8199c60f842a3c407f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b4c50ece07f441b8974d384f4ab29a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:49.896875 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9244693a-ed5c-4956-9f34-1d08071b2793 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e" status: 200 len: 1302 microversion: 2.1 time: 0.378493 Aug 31 15:56:49.912124 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1028/1948] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:49 2022] GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e => generated 1302 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:50.361746 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b7ff0349-d928-43df-82aa-39667575121c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:50.364734 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b7ff0349-d928-43df-82aa-39667575121c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: b90018d3-33b8-4bbc-9b09-d4f8a62a5a79] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:50.370145 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:56:50.391252 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7ff0349-d928-43df-82aa-39667575121c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:50.395603 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7ff0349-d928-43df-82aa-39667575121c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:50.396676 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7ff0349-d928-43df-82aa-39667575121c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:50.399197 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7ff0349-d928-43df-82aa-39667575121c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:50.401260 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7ff0349-d928-43df-82aa-39667575121c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:50.403266 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7ff0349-d928-43df-82aa-39667575121c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:50.530030 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d0430422-34ef-4253-a79e-ce278cc65515 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb461761f0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:50.636667 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d0430422-34ef-4253-a79e-ce278cc65515 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/images/3eaecaef-7864-4e9d-a83b-14203707c01e" status: 200 len: 1412 microversion: 2.1 time: 0.103459 Aug 31 15:56:50.638951 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1029/1949] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:56:50 2022] GET /compute/v2.1/images/3eaecaef-7864-4e9d-a83b-14203707c01e => generated 1412 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:50.804850 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-43174adc-846f-40d3-bd39-b441ea7ac28a tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:50.808685 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-43174adc-846f-40d3-bd39-b441ea7ac28a tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] [instance: 0e79fda0-f46b-48bf-9e45-a183e5470fc7] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:50.847224 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-43174adc-846f-40d3-bd39-b441ea7ac28a tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:50.849352 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-43174adc-846f-40d3-bd39-b441ea7ac28a tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:50.852208 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-43174adc-846f-40d3-bd39-b441ea7ac28a tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:50.855802 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-43174adc-846f-40d3-bd39-b441ea7ac28a tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:50.858430 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-43174adc-846f-40d3-bd39-b441ea7ac28a tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:50.859489 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-43174adc-846f-40d3-bd39-b441ea7ac28a tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:50.932931 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b7ff0349-d928-43df-82aa-39667575121c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:50.941546 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b7ff0349-d928-43df-82aa-39667575121c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/b90018d3-33b8-4bbc-9b09-d4f8a62a5a79" status: 200 len: 1493 microversion: 2.1 time: 0.587583 Aug 31 15:56:50.962125 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 921/1950] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:50 2022] GET /compute/v2.1/servers/b90018d3-33b8-4bbc-9b09-d4f8a62a5a79 => generated 1493 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:56:50.962125 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8b4c61a6-13b5-4879-b48b-8eaa8a3540e0 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:50.962125 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8b4c61a6-13b5-4879-b48b-8eaa8a3540e0 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] [instance: a5a21e54-e375-4370-9d9e-b41df3e5922e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:51.006006 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b4c61a6-13b5-4879-b48b-8eaa8a3540e0 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:51.008299 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b4c61a6-13b5-4879-b48b-8eaa8a3540e0 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:51.008997 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b4c61a6-13b5-4879-b48b-8eaa8a3540e0 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:51.009973 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b4c61a6-13b5-4879-b48b-8eaa8a3540e0 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:51.011076 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b4c61a6-13b5-4879-b48b-8eaa8a3540e0 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:51.015771 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b4c61a6-13b5-4879-b48b-8eaa8a3540e0 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:51.052014 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-8b4c61a6-13b5-4879-b48b-8eaa8a3540e0 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] HTTP exception thrown: Instance a5a21e54-e375-4370-9d9e-b41df3e5922e could not be found. Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8b4c61a6-13b5-4879-b48b-8eaa8a3540e0 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Request method failure captured: Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e HTTP/1.1 Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4M4NFC83ApiGEvumoFdoFLVBqseZv6iK4iD9K5RIGEFCd3H1sg_fW0mpc-3vNOBJJqf_S0BPjt81eWEYwAEhJOuhqtm1ZsU9nClam-0UBj5S7abSSA1G67q5tlH93w3RwFJjEFLB01lUWsMMowJ9h2ujkEuH1I7pHqjSGdyOWlXgHY Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 9b4c50ece07f441b8974d384f4ab29a4 Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-MigrationsAdminTest-860368600 Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9b4c50ece07f441b8974d384f4ab29a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9b4c50ece07f441b8974d384f4ab29a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9b4c50ece07f441b8974d384f4ab29a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9b4c50ece07f441b8974d384f4ab29a4", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-MigrationsAdminTest-860368600 Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 9b4c50ece07f441b8974d384f4ab29a4 Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-MigrationsAdminTest-860368600 Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-MigrationsAdminTest-860368600-project Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 5f6f8b9d63234b8199c60f842a3c407f Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-MigrationsAdminTest-860368600-project Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance a5a21e54-e375-4370-9d9e-b41df3e5922e could not be found. Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'a5a21e54-e375-4370-9d9e-b41df3e5922e'} Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5a21e54-e375-4370-9d9e-b41df3e5922e could not be found. Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5a21e54-e375-4370-9d9e-b41df3e5922e could not be found. Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:51.054499 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:56:51.061883 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:51.061883 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:51.061883 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:51.061883 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:56:51.061883 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:56:51.061883 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5a21e54-e375-4370-9d9e-b41df3e5922e could not be found. Aug 31 15:56:51.061883 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:56:51.064005 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8b4c61a6-13b5-4879-b48b-8eaa8a3540e0 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] Returning 404 to user: Instance a5a21e54-e375-4370-9d9e-b41df3e5922e could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:56:51.065142 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8b4c61a6-13b5-4879-b48b-8eaa8a3540e0 tempest-MigrationsAdminTest-860368600 tempest-MigrationsAdminTest-860368600-project] 10.222.0.50 "GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e" status: 404 len: 111 microversion: 2.1 time: 0.115603 Aug 31 15:56:51.065938 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 922/1951] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:50 2022] GET /compute/v2.1/servers/a5a21e54-e375-4370-9d9e-b41df3e5922e => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:56:51.653045 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-60b8b465-9554-40ae-8130-bfc8cfb28fd0 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb4ac25af0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:51.790480 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-60b8b465-9554-40ae-8130-bfc8cfb28fd0 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/images/3eaecaef-7864-4e9d-a83b-14203707c01e" status: 200 len: 1412 microversion: 2.1 time: 0.134757 Aug 31 15:56:51.794181 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 923/1952] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:56:51 2022] GET /compute/v2.1/images/3eaecaef-7864-4e9d-a83b-14203707c01e => generated 1412 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:51.978950 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-793f5f01-09d3-47e7-90df-a0a8f0c2f239 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:51.980508 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-793f5f01-09d3-47e7-90df-a0a8f0c2f239 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: b90018d3-33b8-4bbc-9b09-d4f8a62a5a79] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:51.983002 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=12 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:56:51.989821 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-793f5f01-09d3-47e7-90df-a0a8f0c2f239 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:51.991004 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-793f5f01-09d3-47e7-90df-a0a8f0c2f239 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:51.991844 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-793f5f01-09d3-47e7-90df-a0a8f0c2f239 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:51.992810 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-793f5f01-09d3-47e7-90df-a0a8f0c2f239 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:51.993639 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-793f5f01-09d3-47e7-90df-a0a8f0c2f239 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:51.994338 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-793f5f01-09d3-47e7-90df-a0a8f0c2f239 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:52.557700 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-43174adc-846f-40d3-bd39-b441ea7ac28a tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f2bc800ceb41349e8c182d526d4d8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773dad0890c4048a0f0152e05fe8d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:52.583997 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-43174adc-846f-40d3-bd39-b441ea7ac28a tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] 10.222.0.50 "GET /compute/v2.1/servers/0e79fda0-f46b-48bf-9e45-a183e5470fc7" status: 200 len: 1304 microversion: 2.1 time: 1.792502 Aug 31 15:56:52.594135 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1030/1953] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:50 2022] GET /compute/v2.1/servers/0e79fda0-f46b-48bf-9e45-a183e5470fc7 => generated 1304 bytes in 1799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:56:52.688173 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-793f5f01-09d3-47e7-90df-a0a8f0c2f239 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:52.710847 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-793f5f01-09d3-47e7-90df-a0a8f0c2f239 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/b90018d3-33b8-4bbc-9b09-d4f8a62a5a79" status: 200 len: 1493 microversion: 2.1 time: 0.726235 Aug 31 15:56:52.713429 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 924/1954] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:51 2022] GET /compute/v2.1/servers/b90018d3-33b8-4bbc-9b09-d4f8a62a5a79 => generated 1493 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:52.810585 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ff583453-9ccc-415c-bc4d-b40093b3b984 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb461b4940>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:52.921951 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ff583453-9ccc-415c-bc4d-b40093b3b984 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/images/3eaecaef-7864-4e9d-a83b-14203707c01e" status: 200 len: 1412 microversion: 2.1 time: 0.118271 Aug 31 15:56:52.930525 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1031/1955] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:56:52 2022] GET /compute/v2.1/images/3eaecaef-7864-4e9d-a83b-14203707c01e => generated 1412 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:53.614208 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a97e0853-7a5a-4671-a058-e36aa142ae95 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:53.614819 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a97e0853-7a5a-4671-a058-e36aa142ae95 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] [instance: 0e79fda0-f46b-48bf-9e45-a183e5470fc7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:53.637775 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a97e0853-7a5a-4671-a058-e36aa142ae95 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:53.642440 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a97e0853-7a5a-4671-a058-e36aa142ae95 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:53.643102 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a97e0853-7a5a-4671-a058-e36aa142ae95 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:53.645499 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a97e0853-7a5a-4671-a058-e36aa142ae95 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:53.659857 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a97e0853-7a5a-4671-a058-e36aa142ae95 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:53.660680 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a97e0853-7a5a-4671-a058-e36aa142ae95 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:53.739118 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c4314795-097d-402b-94e4-7363646f8175 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:53.739957 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c4314795-097d-402b-94e4-7363646f8175 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: b90018d3-33b8-4bbc-9b09-d4f8a62a5a79] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:53.764458 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c4314795-097d-402b-94e4-7363646f8175 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:53.766006 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c4314795-097d-402b-94e4-7363646f8175 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:53.768868 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c4314795-097d-402b-94e4-7363646f8175 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:53.772627 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c4314795-097d-402b-94e4-7363646f8175 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:53.773543 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c4314795-097d-402b-94e4-7363646f8175 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:53.776040 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c4314795-097d-402b-94e4-7363646f8175 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:53.806050 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:56:54.805170 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a97e0853-7a5a-4671-a058-e36aa142ae95 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f2bc800ceb41349e8c182d526d4d8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773dad0890c4048a0f0152e05fe8d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:54.831072 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a97e0853-7a5a-4671-a058-e36aa142ae95 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] 10.222.0.50 "GET /compute/v2.1/servers/0e79fda0-f46b-48bf-9e45-a183e5470fc7" status: 200 len: 1304 microversion: 2.1 time: 1.226369 Aug 31 15:56:54.854584 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 925/1956] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:53 2022] GET /compute/v2.1/servers/0e79fda0-f46b-48bf-9e45-a183e5470fc7 => generated 1304 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:54.884126 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c62b8240-cd2f-4365-8b13-f80a4ff584ec tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb4636f280>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:55.082066 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c62b8240-cd2f-4365-8b13-f80a4ff584ec tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/images/3eaecaef-7864-4e9d-a83b-14203707c01e" status: 200 len: 1412 microversion: 2.1 time: 0.225948 Aug 31 15:56:55.082685 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 926/1957] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:56:54 2022] GET /compute/v2.1/images/3eaecaef-7864-4e9d-a83b-14203707c01e => generated 1412 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:55.095798 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-22b7994f-1bb1-4ff2-b85c-020125d3d7ec req-2c75d613-b224-49bb-9afb-cf9262c54916 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b90018d3-33b8-4bbc-9b09-d4f8a62a5a79", "name": "network-vif-unplugged", "status": "completed", "tag": "9150bc93-a762-4941-b5ec-4f7b090a188b"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:55.154447 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-22b7994f-1bb1-4ff2-b85c-020125d3d7ec req-2c75d613-b224-49bb-9afb-cf9262c54916 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:55.154951 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-22b7994f-1bb1-4ff2-b85c-020125d3d7ec req-2c75d613-b224-49bb-9afb-cf9262c54916 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:55.155379 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-22b7994f-1bb1-4ff2-b85c-020125d3d7ec req-2c75d613-b224-49bb-9afb-cf9262c54916 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:55.201860 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-22b7994f-1bb1-4ff2-b85c-020125d3d7ec req-2c75d613-b224-49bb-9afb-cf9262c54916 service nova] Creating event network-vif-unplugged:9150bc93-a762-4941-b5ec-4f7b090a188b for instance b90018d3-33b8-4bbc-9b09-d4f8a62a5a79 on n-h1-833090-16 Aug 31 15:56:55.228871 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-22b7994f-1bb1-4ff2-b85c-020125d3d7ec req-2c75d613-b224-49bb-9afb-cf9262c54916 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.137031 Aug 31 15:56:55.234981 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 927/1958] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:55.684836 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c4314795-097d-402b-94e4-7363646f8175 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:55.695295 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c4314795-097d-402b-94e4-7363646f8175 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/b90018d3-33b8-4bbc-9b09-d4f8a62a5a79" status: 200 len: 1493 microversion: 2.1 time: 1.961723 Aug 31 15:56:55.696479 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1032/1959] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:53 2022] GET /compute/v2.1/servers/b90018d3-33b8-4bbc-9b09-d4f8a62a5a79 => generated 1493 bytes in 1964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:56:55.859396 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-65ba7bb9-363c-4ea6-b26f-7a26750721a7 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:55.860186 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-65ba7bb9-363c-4ea6-b26f-7a26750721a7 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] [instance: 0e79fda0-f46b-48bf-9e45-a183e5470fc7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:55.884099 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65ba7bb9-363c-4ea6-b26f-7a26750721a7 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:55.884601 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65ba7bb9-363c-4ea6-b26f-7a26750721a7 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:55.885035 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65ba7bb9-363c-4ea6-b26f-7a26750721a7 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:55.905450 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65ba7bb9-363c-4ea6-b26f-7a26750721a7 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:55.906056 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65ba7bb9-363c-4ea6-b26f-7a26750721a7 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:55.906548 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65ba7bb9-363c-4ea6-b26f-7a26750721a7 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:55.984683 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-6072bc0e-48bc-46f1-ba60-474aa639440e req-5f0823e2-cb05-4430-96a1-c37a7d41a5be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b90018d3-33b8-4bbc-9b09-d4f8a62a5a79", "name": "network-vif-deleted", "tag": "9150bc93-a762-4941-b5ec-4f7b090a188b"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:56.006681 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-6072bc0e-48bc-46f1-ba60-474aa639440e req-5f0823e2-cb05-4430-96a1-c37a7d41a5be service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:56.016533 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-6072bc0e-48bc-46f1-ba60-474aa639440e req-5f0823e2-cb05-4430-96a1-c37a7d41a5be service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:56.022017 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-6072bc0e-48bc-46f1-ba60-474aa639440e req-5f0823e2-cb05-4430-96a1-c37a7d41a5be service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:56.097747 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-6072bc0e-48bc-46f1-ba60-474aa639440e req-5f0823e2-cb05-4430-96a1-c37a7d41a5be service nova] Creating event network-vif-deleted:9150bc93-a762-4941-b5ec-4f7b090a188b for instance b90018d3-33b8-4bbc-9b09-d4f8a62a5a79 on n-h1-833090-16 Aug 31 15:56:56.126871 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-6072bc0e-48bc-46f1-ba60-474aa639440e req-5f0823e2-cb05-4430-96a1-c37a7d41a5be service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146528 Aug 31 15:56:56.130667 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1033/1960] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:56:56.170170 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-98223509-f7bb-4f0e-aff6-6eeea24fac0a tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb461dc9d0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:56.347121 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-98223509-f7bb-4f0e-aff6-6eeea24fac0a tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/images/3eaecaef-7864-4e9d-a83b-14203707c01e" status: 200 len: 1412 microversion: 2.1 time: 0.212467 Aug 31 15:56:56.354881 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1034/1961] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:56:56 2022] GET /compute/v2.1/images/3eaecaef-7864-4e9d-a83b-14203707c01e => generated 1412 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:56.876810 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-65ba7bb9-363c-4ea6-b26f-7a26750721a7 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f2bc800ceb41349e8c182d526d4d8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773dad0890c4048a0f0152e05fe8d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:56.899972 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-65ba7bb9-363c-4ea6-b26f-7a26750721a7 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] 10.222.0.50 "GET /compute/v2.1/servers/0e79fda0-f46b-48bf-9e45-a183e5470fc7" status: 200 len: 1304 microversion: 2.1 time: 1.039175 Aug 31 15:56:56.906959 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 928/1962] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:55 2022] GET /compute/v2.1/servers/0e79fda0-f46b-48bf-9e45-a183e5470fc7 => generated 1304 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:56.942581 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-75a5b465-2f69-4fad-803e-670f49da6f48 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:56.943681 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-75a5b465-2f69-4fad-803e-670f49da6f48 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: b90018d3-33b8-4bbc-9b09-d4f8a62a5a79] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:56.976841 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75a5b465-2f69-4fad-803e-670f49da6f48 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:56.977343 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75a5b465-2f69-4fad-803e-670f49da6f48 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:56.977780 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75a5b465-2f69-4fad-803e-670f49da6f48 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:56.978526 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75a5b465-2f69-4fad-803e-670f49da6f48 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:56.978975 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75a5b465-2f69-4fad-803e-670f49da6f48 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:56.979395 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75a5b465-2f69-4fad-803e-670f49da6f48 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:57.059611 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-46d14a9b-96bf-4b8e-8845-654a6c2081a2 tempest-FlavorsV255TestJSON-1952123092 tempest-FlavorsV255TestJSON-1952123092-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1429014774", "id": 272499188, "os-flavor-access:is_public": "True"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:57.158880 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-46d14a9b-96bf-4b8e-8845-654a6c2081a2 tempest-FlavorsV255TestJSON-1952123092 tempest-FlavorsV255TestJSON-1952123092-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 446 microversion: 2.55 time: 0.727549 Aug 31 15:56:57.159079 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75a5b465-2f69-4fad-803e-670f49da6f48 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:57.161273 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1035/1963] 10.222.0.50 () {62 vars in 1188 bytes} [Wed Aug 31 15:56:56 2022] POST /compute/v2.1/flavors => generated 446 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:56:57.169004 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75a5b465-2f69-4fad-803e-670f49da6f48 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:57.169004 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75a5b465-2f69-4fad-803e-670f49da6f48 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:57.169004 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-75a5b465-2f69-4fad-803e-670f49da6f48 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lazy-loading 'fault' on Instance uuid b90018d3-33b8-4bbc-9b09-d4f8a62a5a79 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:56:57.302197 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-75a5b465-2f69-4fad-803e-670f49da6f48 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:57.309166 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:56:57.321339 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-75a5b465-2f69-4fad-803e-670f49da6f48 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/b90018d3-33b8-4bbc-9b09-d4f8a62a5a79" status: 200 len: 1305 microversion: 2.1 time: 0.408990 Aug 31 15:56:57.325150 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 929/1964] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:56 2022] GET /compute/v2.1/servers/b90018d3-33b8-4bbc-9b09-d4f8a62a5a79 => generated 1305 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:57.363265 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3233c58a-fe29-4d25-88e5-2ff3a82ba485 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb4ac439d0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:57.513090 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3233c58a-fe29-4d25-88e5-2ff3a82ba485 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/images/3eaecaef-7864-4e9d-a83b-14203707c01e" status: 200 len: 1412 microversion: 2.1 time: 0.154082 Aug 31 15:56:57.513728 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 930/1965] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:56:57 2022] GET /compute/v2.1/images/3eaecaef-7864-4e9d-a83b-14203707c01e => generated 1412 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:56:57.723782 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-087035b0-b946-463a-88d0-798e3fd5b7e2 tempest-FlavorsV255TestJSON-1352569318 tempest-FlavorsV255TestJSON-1352569318-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:57.740562 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-087035b0-b946-463a-88d0-798e3fd5b7e2 tempest-FlavorsV255TestJSON-1352569318 tempest-FlavorsV255TestJSON-1352569318-project] 10.222.0.50 "GET /compute/v2.1/flavors/272499188" status: 200 len: 446 microversion: 2.55 time: 0.569859 Aug 31 15:56:57.757365 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1036/1966] 10.222.0.50 () {60 vars in 1196 bytes} [Wed Aug 31 15:56:57 2022] GET /compute/v2.1/flavors/272499188 => generated 446 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:56:57.765621 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f4171e33-6e66-43ec-bbfd-3369687b2922 tempest-FlavorsV255TestJSON-1952123092 tempest-FlavorsV255TestJSON-1952123092-project-admin] Action: 'update', calling method: .version_select at 0x7fbb48718f70>, body: {"flavor": {"description": "new"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:57.916194 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f4171e33-6e66-43ec-bbfd-3369687b2922 tempest-FlavorsV255TestJSON-1952123092 tempest-FlavorsV255TestJSON-1952123092-project-admin] 10.222.0.50 "PUT /compute/v2.1/flavors/272499188" status: 200 len: 447 microversion: 2.55 time: 0.162752 Aug 31 15:56:57.919450 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 931/1967] 10.222.0.50 () {62 vars in 1216 bytes} [Wed Aug 31 15:56:57 2022] PUT /compute/v2.1/flavors/272499188 => generated 447 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 15:56:57.928834 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4b8fd542-1cb6-4a20-ab1a-ba5387fc2ed9 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:57.929936 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4b8fd542-1cb6-4a20-ab1a-ba5387fc2ed9 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] [instance: 0e79fda0-f46b-48bf-9e45-a183e5470fc7] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:57.941830 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b2c65c48-138e-4f0c-b10d-a920761576e8 tempest-FlavorsV255TestJSON-1352569318 tempest-FlavorsV255TestJSON-1352569318-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:57.945662 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4b8fd542-1cb6-4a20-ab1a-ba5387fc2ed9 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:57.953196 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4b8fd542-1cb6-4a20-ab1a-ba5387fc2ed9 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:57.953806 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4b8fd542-1cb6-4a20-ab1a-ba5387fc2ed9 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:57.957928 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4b8fd542-1cb6-4a20-ab1a-ba5387fc2ed9 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:57.961967 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4b8fd542-1cb6-4a20-ab1a-ba5387fc2ed9 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:57.978977 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4b8fd542-1cb6-4a20-ab1a-ba5387fc2ed9 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:58.008856 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b2c65c48-138e-4f0c-b10d-a920761576e8 tempest-FlavorsV255TestJSON-1352569318 tempest-FlavorsV255TestJSON-1352569318-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5722 microversion: 2.55 time: 0.077885 Aug 31 15:56:58.012050 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 932/1968] 10.222.0.50 () {60 vars in 1187 bytes} [Wed Aug 31 15:56:57 2022] GET /compute/v2.1/flavors/detail => generated 5722 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:56:58.059288 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ba99588b-8a0a-4f9a-93eb-3c45266b666a tempest-FlavorsV255TestJSON-1352569318 tempest-FlavorsV255TestJSON-1352569318-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:58.127884 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ba99588b-8a0a-4f9a-93eb-3c45266b666a tempest-FlavorsV255TestJSON-1352569318 tempest-FlavorsV255TestJSON-1352569318-project] 10.222.0.50 "GET /compute/v2.1/flavors" status: 200 len: 3154 microversion: 2.55 time: 0.081668 Aug 31 15:56:58.132692 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 933/1969] 10.222.0.50 () {60 vars in 1166 bytes} [Wed Aug 31 15:56:58 2022] GET /compute/v2.1/flavors => generated 3154 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:56:58.156434 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e6babe8b-e106-48a9-9c90-ab06cb12a870 tempest-FlavorsV255TestJSON-1952123092 tempest-FlavorsV255TestJSON-1952123092-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:58.196806 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e6babe8b-e106-48a9-9c90-ab06cb12a870 tempest-FlavorsV255TestJSON-1952123092 tempest-FlavorsV255TestJSON-1952123092-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/272499188" status: 202 len: 0 microversion: 2.55 time: 0.047775 Aug 31 15:56:58.198489 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 934/1970] 10.222.0.50 () {60 vars in 1199 bytes} [Wed Aug 31 15:56:58 2022] DELETE /compute/v2.1/flavors/272499188 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:56:58.218898 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2772fbd5-5766-418d-b9aa-981964123dd3 tempest-FlavorsV255TestJSON-1952123092 tempest-FlavorsV255TestJSON-1952123092-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:58.335673 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2772fbd5-5766-418d-b9aa-981964123dd3 tempest-FlavorsV255TestJSON-1952123092 tempest-FlavorsV255TestJSON-1952123092-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.130025 Aug 31 15:56:58.339811 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 935/1971] 10.222.0.50 () {60 vars in 1187 bytes} [Wed Aug 31 15:56:58 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 15:56:58.351404 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-8cd81bee-86f4-445b-968e-53eb8084be79 req-71d7d3ae-5f5f-435a-8e2f-2adbd35fb0cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e79fda0-f46b-48bf-9e45-a183e5470fc7", "tag": "44bbd514-44c8-4952-80d8-40889c33f358"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:58.380350 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8cd81bee-86f4-445b-968e-53eb8084be79 req-71d7d3ae-5f5f-435a-8e2f-2adbd35fb0cb service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:58.384039 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8cd81bee-86f4-445b-968e-53eb8084be79 req-71d7d3ae-5f5f-435a-8e2f-2adbd35fb0cb service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:58.400621 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8cd81bee-86f4-445b-968e-53eb8084be79 req-71d7d3ae-5f5f-435a-8e2f-2adbd35fb0cb service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:58.500646 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-8cd81bee-86f4-445b-968e-53eb8084be79 req-71d7d3ae-5f5f-435a-8e2f-2adbd35fb0cb service nova] Creating event network-changed:44bbd514-44c8-4952-80d8-40889c33f358 for instance 0e79fda0-f46b-48bf-9e45-a183e5470fc7 on n-h2-833090-16 Aug 31 15:56:58.520954 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-8cd81bee-86f4-445b-968e-53eb8084be79 req-71d7d3ae-5f5f-435a-8e2f-2adbd35fb0cb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.175977 Aug 31 15:56:58.531294 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 936/1972] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:56:58.554516 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6714cc9a-f03c-47f3-82aa-d2360040f090 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:58.556194 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6714cc9a-f03c-47f3-82aa-d2360040f090 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: b90018d3-33b8-4bbc-9b09-d4f8a62a5a79] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:58.601678 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6714cc9a-f03c-47f3-82aa-d2360040f090 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:58.602204 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6714cc9a-f03c-47f3-82aa-d2360040f090 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:58.602650 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6714cc9a-f03c-47f3-82aa-d2360040f090 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:58.603384 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6714cc9a-f03c-47f3-82aa-d2360040f090 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:58.603838 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6714cc9a-f03c-47f3-82aa-d2360040f090 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:58.604265 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6714cc9a-f03c-47f3-82aa-d2360040f090 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:58.676575 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-6714cc9a-f03c-47f3-82aa-d2360040f090 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] HTTP exception thrown: Instance b90018d3-33b8-4bbc-9b09-d4f8a62a5a79 could not be found. Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6714cc9a-f03c-47f3-82aa-d2360040f090 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Request method failure captured: Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/b90018d3-33b8-4bbc-9b09-d4f8a62a5a79 HTTP/1.1 Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4Q2UxjmzRUIcRyBJZeRXZe8f-kxARGQrfLNadx-PtSKRAHFDd-cfjpN41Lm2TAtWQQVK9trDHJa1Iu7P1XlF1-EYrtrhJnDHGb-ivhI0erITWpZsYkLGmnwPDtbMbW99ld2jucgWFbVY0vVDf-y4OAM7Az1owqOg13oLERSA9bN0MQ Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: dde27d282fc24e56a62eaeacff1431d5 Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-DeleteServersTestJSON-1135653165 Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_dde27d282fc24e56a62eaeacff1431d5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-DeleteServersTestJSON-1135653165 Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: dde27d282fc24e56a62eaeacff1431d5 Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-DeleteServersTestJSON-1135653165 Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-DeleteServersTestJSON-1135653165-project Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 4d4f2146c3bc4a64b5d7f72cd136b6db Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-DeleteServersTestJSON-1135653165-project Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance b90018d3-33b8-4bbc-9b09-d4f8a62a5a79 could not be found. Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'b90018d3-33b8-4bbc-9b09-d4f8a62a5a79'} Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b90018d3-33b8-4bbc-9b09-d4f8a62a5a79 could not be found. Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b90018d3-33b8-4bbc-9b09-d4f8a62a5a79 could not be found. Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:56:58.678796 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:56:58.681858 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:56:58.681858 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:56:58.681858 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:56:58.681858 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:56:58.681858 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:56:58.681858 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b90018d3-33b8-4bbc-9b09-d4f8a62a5a79 could not be found. Aug 31 15:56:58.681858 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:56:58.688290 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4b8fd542-1cb6-4a20-ab1a-ba5387fc2ed9 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f2bc800ceb41349e8c182d526d4d8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773dad0890c4048a0f0152e05fe8d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:56:58.696599 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6714cc9a-f03c-47f3-82aa-d2360040f090 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Returning 404 to user: Instance b90018d3-33b8-4bbc-9b09-d4f8a62a5a79 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:56:58.699262 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6714cc9a-f03c-47f3-82aa-d2360040f090 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/b90018d3-33b8-4bbc-9b09-d4f8a62a5a79" status: 404 len: 111 microversion: 2.1 time: 0.166406 Aug 31 15:56:58.703121 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 937/1973] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:58 2022] GET /compute/v2.1/servers/b90018d3-33b8-4bbc-9b09-d4f8a62a5a79 => generated 111 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:56:58.739844 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4b8fd542-1cb6-4a20-ab1a-ba5387fc2ed9 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] 10.222.0.50 "GET /compute/v2.1/servers/0e79fda0-f46b-48bf-9e45-a183e5470fc7" status: 200 len: 1292 microversion: 2.1 time: 0.815687 Aug 31 15:56:58.759640 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1037/1974] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:57 2022] GET /compute/v2.1/servers/0e79fda0-f46b-48bf-9e45-a183e5470fc7 => generated 1292 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:58.777195 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-820743a8-af22-44f6-ae4e-ce1dcc513dba tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb4ac7f820>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:58.906961 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-820743a8-af22-44f6-ae4e-ce1dcc513dba tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/images/3eaecaef-7864-4e9d-a83b-14203707c01e" status: 200 len: 1412 microversion: 2.1 time: 0.202214 Aug 31 15:56:58.908572 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 938/1975] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:56:58 2022] GET /compute/v2.1/images/3eaecaef-7864-4e9d-a83b-14203707c01e => generated 1412 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:56:59.038641 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ae635d98-ddb5-4cdd-88d4-094a7dac677a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-23504248", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "e71afd64-faa4-4680-b8e0-76fe805d5df1"}]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:56:59.195480 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-ae635d98-ddb5-4cdd-88d4-094a7dac677a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] validate_networks() for [('e71afd64-faa4-4680-b8e0-76fe805d5df1', None, None, None, None, None)] {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:56:59.800205 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-39564dcf-f7be-4810-806a-b7c6daeae378 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:56:59.823135 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-39564dcf-f7be-4810-806a-b7c6daeae378 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] [instance: 0e79fda0-f46b-48bf-9e45-a183e5470fc7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:56:59.879100 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39564dcf-f7be-4810-806a-b7c6daeae378 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:59.886559 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39564dcf-f7be-4810-806a-b7c6daeae378 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:59.887016 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39564dcf-f7be-4810-806a-b7c6daeae378 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:56:59.887769 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39564dcf-f7be-4810-806a-b7c6daeae378 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:56:59.888224 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39564dcf-f7be-4810-806a-b7c6daeae378 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:56:59.893912 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39564dcf-f7be-4810-806a-b7c6daeae378 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:00.482746 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-39564dcf-f7be-4810-806a-b7c6daeae378 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f2bc800ceb41349e8c182d526d4d8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773dad0890c4048a0f0152e05fe8d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:00.491401 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-39564dcf-f7be-4810-806a-b7c6daeae378 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] 10.222.0.50 "GET /compute/v2.1/servers/0e79fda0-f46b-48bf-9e45-a183e5470fc7" status: 200 len: 1292 microversion: 2.1 time: 0.721530 Aug 31 15:57:00.502354 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 939/1976] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:56:59 2022] GET /compute/v2.1/servers/0e79fda0-f46b-48bf-9e45-a183e5470fc7 => generated 1292 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:00.503386 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-ae635d98-ddb5-4cdd-88d4-094a7dac677a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:57:00.503851 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-ae635d98-ddb5-4cdd-88d4-094a7dac677a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:57:00.504240 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-ae635d98-ddb5-4cdd-88d4-094a7dac677a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:57:00.506879 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-ae635d98-ddb5-4cdd-88d4-094a7dac677a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:57:00.507460 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-ae635d98-ddb5-4cdd-88d4-094a7dac677a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:57:00.528244 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-212504ae-0e6d-448a-9135-b6fd5e100016 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb4ac43040>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:00.535107 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ae635d98-ddb5-4cdd-88d4-094a7dac677a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:00.535658 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ae635d98-ddb5-4cdd-88d4-094a7dac677a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:00.536100 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ae635d98-ddb5-4cdd-88d4-094a7dac677a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:00.539694 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ae635d98-ddb5-4cdd-88d4-094a7dac677a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:00.540166 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ae635d98-ddb5-4cdd-88d4-094a7dac677a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:00.543987 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ae635d98-ddb5-4cdd-88d4-094a7dac677a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:00.601391 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-212504ae-0e6d-448a-9135-b6fd5e100016 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/images/3eaecaef-7864-4e9d-a83b-14203707c01e" status: 200 len: 1412 microversion: 2.1 time: 0.081790 Aug 31 15:57:00.603537 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 940/1977] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:57:00 2022] GET /compute/v2.1/images/3eaecaef-7864-4e9d-a83b-14203707c01e => generated 1412 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:00.615838 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bf312ff3-07e9-4319-8f48-f19bbb5416c5 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1809398168", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "efd466b3-b86f-4dea-a01f-277dbef774dc"}], "block_device_mapping_v2": [{"uuid": "6cf2c6af-20f4-487b-94c1-312aeeeb8828", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:00.624788 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-ae635d98-ddb5-4cdd-88d4-094a7dac677a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Getting quotas for project dde27d282fc24e56a62eaeacff1431d5. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:57:00.647610 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-ae635d98-ddb5-4cdd-88d4-094a7dac677a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Getting quotas for user 4d4f2146c3bc4a64b5d7f72cd136b6db and project dde27d282fc24e56a62eaeacff1431d5. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:57:00.711454 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ae635d98-ddb5-4cdd-88d4-094a7dac677a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:57:00.718314 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ae635d98-ddb5-4cdd-88d4-094a7dac677a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: f044dca7-71de-4182-b5ec-825299496c10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:57:00.789925 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-bf312ff3-07e9-4319-8f48-f19bbb5416c5 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] validate_networks() for [('efd466b3-b86f-4dea-a01f-277dbef774dc', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:57:00.912669 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ae635d98-ddb5-4cdd-88d4-094a7dac677a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.875924 Aug 31 15:57:00.929319 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1038/1978] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:56:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1897 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 15:57:00.952140 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6a8a2463-0d55-46c3-b335-44704ec62036 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:00.955159 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6a8a2463-0d55-46c3-b335-44704ec62036 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: f044dca7-71de-4182-b5ec-825299496c10] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:00.958506 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:57:01.320999 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6a8a2463-0d55-46c3-b335-44704ec62036 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:01.335065 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6a8a2463-0d55-46c3-b335-44704ec62036 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10" status: 200 len: 1213 microversion: 2.1 time: 0.400540 Aug 31 15:57:01.338355 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1039/1979] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:00 2022] GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10 => generated 1213 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:01.753577 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e3f96df8-c8b4-4222-bec1-4bed28fe5af9 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1817173521", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:01.857726 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-e3f96df8-c8b4-4222-bec1-4bed28fe5af9 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] validate_networks() for None {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:57:02.426750 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-e3f96df8-c8b4-4222-bec1-4bed28fe5af9 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:57:02.427768 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-e3f96df8-c8b4-4222-bec1-4bed28fe5af9 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:57:02.428866 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-e3f96df8-c8b4-4222-bec1-4bed28fe5af9 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:57:02.429421 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-e3f96df8-c8b4-4222-bec1-4bed28fe5af9 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:57:02.430153 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-e3f96df8-c8b4-4222-bec1-4bed28fe5af9 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:57:02.452795 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e3f96df8-c8b4-4222-bec1-4bed28fe5af9 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:02.453569 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e3f96df8-c8b4-4222-bec1-4bed28fe5af9 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:02.454190 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e3f96df8-c8b4-4222-bec1-4bed28fe5af9 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:02.455289 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e3f96df8-c8b4-4222-bec1-4bed28fe5af9 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:02.456522 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e3f96df8-c8b4-4222-bec1-4bed28fe5af9 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:02.457111 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e3f96df8-c8b4-4222-bec1-4bed28fe5af9 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:02.507093 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-e3f96df8-c8b4-4222-bec1-4bed28fe5af9 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Getting quotas for project 2f324e55d67b4764b183f7e85e206cb3. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:57:02.525978 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-e3f96df8-c8b4-4222-bec1-4bed28fe5af9 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Getting quotas for user 0d1221b21792476baf26260db2bdbe93 and project 2f324e55d67b4764b183f7e85e206cb3. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:57:02.563747 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e3f96df8-c8b4-4222-bec1-4bed28fe5af9 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:57:02.569950 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e3f96df8-c8b4-4222-bec1-4bed28fe5af9 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] [instance: c5de4f8b-332b-4e34-8290-cc0d445c50fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:57:02.674805 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-bf312ff3-07e9-4319-8f48-f19bbb5416c5 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:57:02.675872 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-bf312ff3-07e9-4319-8f48-f19bbb5416c5 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:57:02.676498 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-bf312ff3-07e9-4319-8f48-f19bbb5416c5 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:57:02.676886 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-bf312ff3-07e9-4319-8f48-f19bbb5416c5 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:57:02.677310 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-bf312ff3-07e9-4319-8f48-f19bbb5416c5 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:57:02.701246 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf312ff3-07e9-4319-8f48-f19bbb5416c5 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:02.702604 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf312ff3-07e9-4319-8f48-f19bbb5416c5 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:02.703319 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf312ff3-07e9-4319-8f48-f19bbb5416c5 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:02.704832 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf312ff3-07e9-4319-8f48-f19bbb5416c5 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:02.705491 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf312ff3-07e9-4319-8f48-f19bbb5416c5 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:02.711385 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf312ff3-07e9-4319-8f48-f19bbb5416c5 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:02.743928 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-bf312ff3-07e9-4319-8f48-f19bbb5416c5 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Getting quotas for project 86aafc129b8640d381f9bae1767fbc6c. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:57:02.756062 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-bf312ff3-07e9-4319-8f48-f19bbb5416c5 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Getting quotas for user 072bc5784d754815a511f6c3f4437f7c and project 86aafc129b8640d381f9bae1767fbc6c. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:57:02.811908 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e3f96df8-c8b4-4222-bec1-4bed28fe5af9 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.348926 Aug 31 15:57:02.812599 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1040/1980] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:57:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1350 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 15:57:02.835486 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-65b24bb6-0104-438b-9993-b6aa8a4f7a38 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:02.837935 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-65b24bb6-0104-438b-9993-b6aa8a4f7a38 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] [instance: 0e79fda0-f46b-48bf-9e45-a183e5470fc7] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:02.851578 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-65b24bb6-0104-438b-9993-b6aa8a4f7a38 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:02.852121 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-65b24bb6-0104-438b-9993-b6aa8a4f7a38 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:02.879271 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bf312ff3-07e9-4319-8f48-f19bbb5416c5 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:57:02.881491 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bf312ff3-07e9-4319-8f48-f19bbb5416c5 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 548e0225-fa26-46ba-9c12-7b52feee1784] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6cf2c6af-20f4-487b-94c1-312aeeeb8828',volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:57:02.882039 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-65b24bb6-0104-438b-9993-b6aa8a4f7a38 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:02.884085 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-65b24bb6-0104-438b-9993-b6aa8a4f7a38 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:02.884711 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-65b24bb6-0104-438b-9993-b6aa8a4f7a38 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:02.886713 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-65b24bb6-0104-438b-9993-b6aa8a4f7a38 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:03.153601 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bf312ff3-07e9-4319-8f48-f19bbb5416c5 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.548630 Aug 31 15:57:03.172729 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 941/1981] 10.222.0.50 () {62 vars in 1188 bytes} [Wed Aug 31 15:57:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2568 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 31 15:57:03.179905 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c155d59a-b2d5-4e82-a1b0-8f782445839b tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb4ac6b550>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:03.296987 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c155d59a-b2d5-4e82-a1b0-8f782445839b tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/images/3eaecaef-7864-4e9d-a83b-14203707c01e" status: 200 len: 1412 microversion: 2.1 time: 0.123075 Aug 31 15:57:03.305159 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 942/1982] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:57:03 2022] GET /compute/v2.1/images/3eaecaef-7864-4e9d-a83b-14203707c01e => generated 1412 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:03.312932 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-39956aad-98e4-44a1-b5bd-4a6ff6f273ac tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:03.313552 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-39956aad-98e4-44a1-b5bd-4a6ff6f273ac tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: f044dca7-71de-4182-b5ec-825299496c10] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:03.358917 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39956aad-98e4-44a1-b5bd-4a6ff6f273ac tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:03.359421 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39956aad-98e4-44a1-b5bd-4a6ff6f273ac tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:03.359851 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39956aad-98e4-44a1-b5bd-4a6ff6f273ac tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:03.360557 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39956aad-98e4-44a1-b5bd-4a6ff6f273ac tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:03.374485 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39956aad-98e4-44a1-b5bd-4a6ff6f273ac tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:03.378407 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39956aad-98e4-44a1-b5bd-4a6ff6f273ac tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:04.554336 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-65b24bb6-0104-438b-9993-b6aa8a4f7a38 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f2bc800ceb41349e8c182d526d4d8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773dad0890c4048a0f0152e05fe8d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:04.571875 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-65b24bb6-0104-438b-9993-b6aa8a4f7a38 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] 10.222.0.50 "GET /compute/v2.1/servers/0e79fda0-f46b-48bf-9e45-a183e5470fc7" status: 200 len: 1292 microversion: 2.1 time: 1.753849 Aug 31 15:57:04.575508 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1041/1983] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:02 2022] GET /compute/v2.1/servers/0e79fda0-f46b-48bf-9e45-a183e5470fc7 => generated 1292 bytes in 1762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:04.588006 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4b22ba47-f7f2-443e-a109-8dff14c28c18 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:04.589922 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4b22ba47-f7f2-443e-a109-8dff14c28c18 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] [instance: c5de4f8b-332b-4e34-8290-cc0d445c50fd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:04.618269 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4b22ba47-f7f2-443e-a109-8dff14c28c18 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:04.624384 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4b22ba47-f7f2-443e-a109-8dff14c28c18 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:04.625282 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4b22ba47-f7f2-443e-a109-8dff14c28c18 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:04.627098 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4b22ba47-f7f2-443e-a109-8dff14c28c18 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:04.632231 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4b22ba47-f7f2-443e-a109-8dff14c28c18 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:04.635084 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4b22ba47-f7f2-443e-a109-8dff14c28c18 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:04.748240 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-39956aad-98e4-44a1-b5bd-4a6ff6f273ac tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:04.769127 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-39956aad-98e4-44a1-b5bd-4a6ff6f273ac tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10" status: 200 len: 1265 microversion: 2.1 time: 1.467258 Aug 31 15:57:04.773360 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 943/1984] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:03 2022] GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10 => generated 1265 bytes in 1475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:04.799088 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6ec6464e-b186-431c-ae18-2ee227512cfa tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:04.814811 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6ec6464e-b186-431c-ae18-2ee227512cfa tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 548e0225-fa26-46ba-9c12-7b52feee1784] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:04.841784 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ec6464e-b186-431c-ae18-2ee227512cfa tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:04.859790 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ec6464e-b186-431c-ae18-2ee227512cfa tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:04.860389 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ec6464e-b186-431c-ae18-2ee227512cfa tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:04.861149 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ec6464e-b186-431c-ae18-2ee227512cfa tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:04.861619 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ec6464e-b186-431c-ae18-2ee227512cfa tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:04.862115 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ec6464e-b186-431c-ae18-2ee227512cfa tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:04.876803 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4b22ba47-f7f2-443e-a109-8dff14c28c18 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1221b21792476baf26260db2bdbe93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f324e55d67b4764b183f7e85e206cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:04.886441 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4b22ba47-f7f2-443e-a109-8dff14c28c18 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] 10.222.0.50 "GET /compute/v2.1/servers/c5de4f8b-332b-4e34-8290-cc0d445c50fd" status: 200 len: 1219 microversion: 2.1 time: 0.309171 Aug 31 15:57:04.887033 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1042/1985] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:04 2022] GET /compute/v2.1/servers/c5de4f8b-332b-4e34-8290-cc0d445c50fd => generated 1219 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:04.919691 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9b96cc40-f332-4ae4-84f9-ba20d23fa1b8 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb461a3040>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:05.018606 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9b96cc40-f332-4ae4-84f9-ba20d23fa1b8 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/images/3eaecaef-7864-4e9d-a83b-14203707c01e" status: 200 len: 1412 microversion: 2.1 time: 0.114034 Aug 31 15:57:05.031630 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1043/1986] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:57:04 2022] GET /compute/v2.1/images/3eaecaef-7864-4e9d-a83b-14203707c01e => generated 1412 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:05.049322 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6ec6464e-b186-431c-ae18-2ee227512cfa tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:05.062496 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6ec6464e-b186-431c-ae18-2ee227512cfa tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:05.064418 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6ec6464e-b186-431c-ae18-2ee227512cfa tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:05.066422 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6ec6464e-b186-431c-ae18-2ee227512cfa tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784" status: 200 len: 1177 microversion: 2.25 time: 0.290864 Aug 31 15:57:05.067773 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 944/1987] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:04 2022] GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784 => generated 1177 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:05.593887 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-629f49a3-3724-4bf6-a032-6d46a00ed1dc tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:05.595626 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-629f49a3-3724-4bf6-a032-6d46a00ed1dc tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] [instance: 0e79fda0-f46b-48bf-9e45-a183e5470fc7] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:05.633509 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-629f49a3-3724-4bf6-a032-6d46a00ed1dc tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:05.635963 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-629f49a3-3724-4bf6-a032-6d46a00ed1dc tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:05.636724 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-629f49a3-3724-4bf6-a032-6d46a00ed1dc tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:05.638950 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-629f49a3-3724-4bf6-a032-6d46a00ed1dc tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:05.639457 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-629f49a3-3724-4bf6-a032-6d46a00ed1dc tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:05.639892 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-629f49a3-3724-4bf6-a032-6d46a00ed1dc tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:05.791696 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cea57796-c08c-472e-977b-f7e0a2bd5275 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:05.792310 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cea57796-c08c-472e-977b-f7e0a2bd5275 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: f044dca7-71de-4182-b5ec-825299496c10] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:05.813109 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cea57796-c08c-472e-977b-f7e0a2bd5275 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:05.813404 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cea57796-c08c-472e-977b-f7e0a2bd5275 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:05.813837 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cea57796-c08c-472e-977b-f7e0a2bd5275 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:05.816804 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cea57796-c08c-472e-977b-f7e0a2bd5275 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:05.817283 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cea57796-c08c-472e-977b-f7e0a2bd5275 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:05.817709 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cea57796-c08c-472e-977b-f7e0a2bd5275 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:06.137628 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cea57796-c08c-472e-977b-f7e0a2bd5275 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:06.146854 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cea57796-c08c-472e-977b-f7e0a2bd5275 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10" status: 200 len: 1271 microversion: 2.1 time: 0.359972 Aug 31 15:57:06.171552 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 945/1988] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:05 2022] GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10 => generated 1271 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:57:06.193678 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e7d4cbe0-b45e-4f06-9a13-38941efd81f7 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:06.197863 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e7d4cbe0-b45e-4f06-9a13-38941efd81f7 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] [instance: c5de4f8b-332b-4e34-8290-cc0d445c50fd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:06.212489 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7d4cbe0-b45e-4f06-9a13-38941efd81f7 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:06.214732 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7d4cbe0-b45e-4f06-9a13-38941efd81f7 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:06.216411 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7d4cbe0-b45e-4f06-9a13-38941efd81f7 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:06.219436 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7d4cbe0-b45e-4f06-9a13-38941efd81f7 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:06.220305 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7d4cbe0-b45e-4f06-9a13-38941efd81f7 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:06.220964 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7d4cbe0-b45e-4f06-9a13-38941efd81f7 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:06.292518 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-629f49a3-3724-4bf6-a032-6d46a00ed1dc tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f2bc800ceb41349e8c182d526d4d8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773dad0890c4048a0f0152e05fe8d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:06.305377 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-629f49a3-3724-4bf6-a032-6d46a00ed1dc tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] 10.222.0.50 "GET /compute/v2.1/servers/0e79fda0-f46b-48bf-9e45-a183e5470fc7" status: 200 len: 1292 microversion: 2.1 time: 0.716082 Aug 31 15:57:06.318887 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1044/1989] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:05 2022] GET /compute/v2.1/servers/0e79fda0-f46b-48bf-9e45-a183e5470fc7 => generated 1292 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:06.324585 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-53937df5-9ebd-4bac-833c-e1fe7612cffb tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb461a30d0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:06.356326 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e7d4cbe0-b45e-4f06-9a13-38941efd81f7 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1221b21792476baf26260db2bdbe93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f324e55d67b4764b183f7e85e206cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:06.367450 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e7d4cbe0-b45e-4f06-9a13-38941efd81f7 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] 10.222.0.50 "GET /compute/v2.1/servers/c5de4f8b-332b-4e34-8290-cc0d445c50fd" status: 200 len: 1275 microversion: 2.1 time: 0.192287 Aug 31 15:57:06.368950 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 946/1990] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:06 2022] GET /compute/v2.1/servers/c5de4f8b-332b-4e34-8290-cc0d445c50fd => generated 1275 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:06.377515 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-45027bfa-e920-4341-ab8d-bdeec567aea5 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:06.378711 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-45027bfa-e920-4341-ab8d-bdeec567aea5 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 548e0225-fa26-46ba-9c12-7b52feee1784] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:06.393175 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45027bfa-e920-4341-ab8d-bdeec567aea5 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:06.395754 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45027bfa-e920-4341-ab8d-bdeec567aea5 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:06.396573 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45027bfa-e920-4341-ab8d-bdeec567aea5 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:06.397978 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45027bfa-e920-4341-ab8d-bdeec567aea5 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:06.398901 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45027bfa-e920-4341-ab8d-bdeec567aea5 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:06.401332 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45027bfa-e920-4341-ab8d-bdeec567aea5 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:06.413003 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-53937df5-9ebd-4bac-833c-e1fe7612cffb tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/images/3eaecaef-7864-4e9d-a83b-14203707c01e" status: 200 len: 1412 microversion: 2.1 time: 0.092766 Aug 31 15:57:06.413583 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1045/1991] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:57:06 2022] GET /compute/v2.1/images/3eaecaef-7864-4e9d-a83b-14203707c01e => generated 1412 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:06.915731 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-45027bfa-e920-4341-ab8d-bdeec567aea5 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:06.943597 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-45027bfa-e920-4341-ab8d-bdeec567aea5 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:06.953506 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-45027bfa-e920-4341-ab8d-bdeec567aea5 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:06.958502 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-45027bfa-e920-4341-ab8d-bdeec567aea5 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784" status: 200 len: 1233 microversion: 2.25 time: 0.585222 Aug 31 15:57:06.983228 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 947/1992] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:06 2022] GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784 => generated 1233 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:07.175362 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9e14970c-86a3-413a-be71-517b0306fcfd tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:07.175944 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9e14970c-86a3-413a-be71-517b0306fcfd tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: f044dca7-71de-4182-b5ec-825299496c10] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:07.191345 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9e14970c-86a3-413a-be71-517b0306fcfd tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:07.192005 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9e14970c-86a3-413a-be71-517b0306fcfd tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:07.192588 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9e14970c-86a3-413a-be71-517b0306fcfd tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:07.193902 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9e14970c-86a3-413a-be71-517b0306fcfd tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:07.195149 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9e14970c-86a3-413a-be71-517b0306fcfd tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:07.195858 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9e14970c-86a3-413a-be71-517b0306fcfd tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:07.331588 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c3b28ca1-ea1f-4955-94f5-aff5d37b84d9 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:07.334918 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c3b28ca1-ea1f-4955-94f5-aff5d37b84d9 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] [instance: 0e79fda0-f46b-48bf-9e45-a183e5470fc7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:07.355063 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3b28ca1-ea1f-4955-94f5-aff5d37b84d9 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:07.355562 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3b28ca1-ea1f-4955-94f5-aff5d37b84d9 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:07.358620 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3b28ca1-ea1f-4955-94f5-aff5d37b84d9 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:07.359701 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3b28ca1-ea1f-4955-94f5-aff5d37b84d9 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:07.360483 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3b28ca1-ea1f-4955-94f5-aff5d37b84d9 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:07.361722 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3b28ca1-ea1f-4955-94f5-aff5d37b84d9 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:07.504026 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9e14970c-86a3-413a-be71-517b0306fcfd tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:07.514339 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9e14970c-86a3-413a-be71-517b0306fcfd tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10" status: 200 len: 1271 microversion: 2.1 time: 0.342920 Aug 31 15:57:07.528351 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1046/1993] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:07 2022] GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10 => generated 1271 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:07.539121 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4a5c4fa6-44dd-4af0-a783-9024c22b0244 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:07.548413 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4a5c4fa6-44dd-4af0-a783-9024c22b0244 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] [instance: c5de4f8b-332b-4e34-8290-cc0d445c50fd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:07.570842 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4a5c4fa6-44dd-4af0-a783-9024c22b0244 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:07.571340 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4a5c4fa6-44dd-4af0-a783-9024c22b0244 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:07.571784 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4a5c4fa6-44dd-4af0-a783-9024c22b0244 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:07.572526 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4a5c4fa6-44dd-4af0-a783-9024c22b0244 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:07.572937 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4a5c4fa6-44dd-4af0-a783-9024c22b0244 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:07.573358 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4a5c4fa6-44dd-4af0-a783-9024c22b0244 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:08.306323 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4a5c4fa6-44dd-4af0-a783-9024c22b0244 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1221b21792476baf26260db2bdbe93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f324e55d67b4764b183f7e85e206cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:08.319040 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4a5c4fa6-44dd-4af0-a783-9024c22b0244 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] 10.222.0.50 "GET /compute/v2.1/servers/c5de4f8b-332b-4e34-8290-cc0d445c50fd" status: 200 len: 1281 microversion: 2.1 time: 0.794695 Aug 31 15:57:08.319931 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1047/1994] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:07 2022] GET /compute/v2.1/servers/c5de4f8b-332b-4e34-8290-cc0d445c50fd => generated 1281 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:08.348568 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2279b33b-6527-499c-a1d0-b6256fc91dc2 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb4690dca0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:08.445480 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2279b33b-6527-499c-a1d0-b6256fc91dc2 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/images/3eaecaef-7864-4e9d-a83b-14203707c01e" status: 200 len: 1421 microversion: 2.1 time: 0.124477 Aug 31 15:57:08.453886 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1048/1995] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:57:08 2022] GET /compute/v2.1/images/3eaecaef-7864-4e9d-a83b-14203707c01e => generated 1421 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:08.479178 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4f3384ec-a848-4dc8-9c8f-2d225953c686 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:08.479998 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4f3384ec-a848-4dc8-9c8f-2d225953c686 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 548e0225-fa26-46ba-9c12-7b52feee1784] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:08.503456 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4f3384ec-a848-4dc8-9c8f-2d225953c686 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:08.503967 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4f3384ec-a848-4dc8-9c8f-2d225953c686 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:08.504942 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4f3384ec-a848-4dc8-9c8f-2d225953c686 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:08.508072 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4f3384ec-a848-4dc8-9c8f-2d225953c686 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:08.508818 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4f3384ec-a848-4dc8-9c8f-2d225953c686 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:08.511558 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4f3384ec-a848-4dc8-9c8f-2d225953c686 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:08.930380 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4f3384ec-a848-4dc8-9c8f-2d225953c686 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:08.946015 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4f3384ec-a848-4dc8-9c8f-2d225953c686 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:08.948906 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4f3384ec-a848-4dc8-9c8f-2d225953c686 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:08.951910 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c3b28ca1-ea1f-4955-94f5-aff5d37b84d9 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f2bc800ceb41349e8c182d526d4d8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773dad0890c4048a0f0152e05fe8d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:08.954510 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4f3384ec-a848-4dc8-9c8f-2d225953c686 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784" status: 200 len: 1251 microversion: 2.25 time: 0.495458 Aug 31 15:57:08.960103 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c3b28ca1-ea1f-4955-94f5-aff5d37b84d9 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] 10.222.0.50 "GET /compute/v2.1/servers/0e79fda0-f46b-48bf-9e45-a183e5470fc7" status: 200 len: 1292 microversion: 2.1 time: 1.635014 Aug 31 15:57:08.972138 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1049/1996] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:08 2022] GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784 => generated 1251 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:08.982369 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 948/1997] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:07 2022] GET /compute/v2.1/servers/0e79fda0-f46b-48bf-9e45-a183e5470fc7 => generated 1292 bytes in 1658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:08.987250 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7d0e6f7c-9a0a-44bf-835d-0e62b511d1db tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb46136310>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:09.077343 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7d0e6f7c-9a0a-44bf-835d-0e62b511d1db tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/images/3eaecaef-7864-4e9d-a83b-14203707c01e" status: 200 len: 1421 microversion: 2.1 time: 0.103670 Aug 31 15:57:09.079129 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1050/1998] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:57:08 2022] GET /compute/v2.1/images/3eaecaef-7864-4e9d-a83b-14203707c01e => generated 1421 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:09.092526 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ba72c018-6997-411c-b1f9-6bee17aa8794 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:09.094782 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ba72c018-6997-411c-b1f9-6bee17aa8794 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: f044dca7-71de-4182-b5ec-825299496c10] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:09.107824 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ba72c018-6997-411c-b1f9-6bee17aa8794 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:09.108729 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ba72c018-6997-411c-b1f9-6bee17aa8794 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:09.109427 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ba72c018-6997-411c-b1f9-6bee17aa8794 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:09.110517 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ba72c018-6997-411c-b1f9-6bee17aa8794 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:09.111345 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ba72c018-6997-411c-b1f9-6bee17aa8794 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:09.113582 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ba72c018-6997-411c-b1f9-6bee17aa8794 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:09.237196 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-aa3bce93-b277-4685-999c-accee14e1e6a tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-237843117", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:09.260780 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=3,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:57:09.326119 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-aa3bce93-b277-4685-999c-accee14e1e6a tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] validate_networks() for None {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:57:09.738823 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ba72c018-6997-411c-b1f9-6bee17aa8794 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:09.753295 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ba72c018-6997-411c-b1f9-6bee17aa8794 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10" status: 200 len: 1313 microversion: 2.1 time: 0.672601 Aug 31 15:57:09.763872 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1051/1999] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:09 2022] GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10 => generated 1313 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:09.772575 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-deec8818-9795-4238-a0ee-64e341cd681c tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb46fae280>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:09.889166 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-aa3bce93-b277-4685-999c-accee14e1e6a tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:57:09.889703 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-aa3bce93-b277-4685-999c-accee14e1e6a tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:57:09.890276 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-aa3bce93-b277-4685-999c-accee14e1e6a tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:57:09.890940 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-aa3bce93-b277-4685-999c-accee14e1e6a tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:57:09.891584 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-aa3bce93-b277-4685-999c-accee14e1e6a tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:57:09.911865 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa3bce93-b277-4685-999c-accee14e1e6a tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:09.912753 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa3bce93-b277-4685-999c-accee14e1e6a tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:09.914539 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa3bce93-b277-4685-999c-accee14e1e6a tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:09.916461 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa3bce93-b277-4685-999c-accee14e1e6a tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:09.917186 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa3bce93-b277-4685-999c-accee14e1e6a tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:09.917859 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa3bce93-b277-4685-999c-accee14e1e6a tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:09.960079 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-aa3bce93-b277-4685-999c-accee14e1e6a tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Getting quotas for project 055586a03b0a4c1989b3ac658ac6347c. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:57:09.971659 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-aa3bce93-b277-4685-999c-accee14e1e6a tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Getting quotas for user b0ba08a4705f4f0a9bc6a01d16a5f607 and project 055586a03b0a4c1989b3ac658ac6347c. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:57:10.005527 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-aa3bce93-b277-4685-999c-accee14e1e6a tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:57:10.007748 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-aa3bce93-b277-4685-999c-accee14e1e6a tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] [instance: 862e1521-739f-47c0-a7e0-2bd017e5f738] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:57:10.080819 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-aa3bce93-b277-4685-999c-accee14e1e6a tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.096958 Aug 31 15:57:10.089485 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 949/2000] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:57:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1101 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 15:57:10.096412 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-045ac2a0-504b-4a97-8141-4b2d41beb5ac tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:10.100378 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-045ac2a0-504b-4a97-8141-4b2d41beb5ac tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] [instance: c5de4f8b-332b-4e34-8290-cc0d445c50fd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:10.135207 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-045ac2a0-504b-4a97-8141-4b2d41beb5ac tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:10.137933 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-045ac2a0-504b-4a97-8141-4b2d41beb5ac tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:10.141496 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-045ac2a0-504b-4a97-8141-4b2d41beb5ac tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:10.143116 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-045ac2a0-504b-4a97-8141-4b2d41beb5ac tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:10.147840 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-045ac2a0-504b-4a97-8141-4b2d41beb5ac tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:10.148551 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-045ac2a0-504b-4a97-8141-4b2d41beb5ac tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:10.850019 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-deec8818-9795-4238-a0ee-64e341cd681c tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "DELETE /compute/v2.1/images/3eaecaef-7864-4e9d-a83b-14203707c01e" status: 204 len: 0 microversion: 2.1 time: 1.083411 Aug 31 15:57:10.851663 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1052/2001] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:09 2022] DELETE /compute/v2.1/images/3eaecaef-7864-4e9d-a83b-14203707c01e => generated 0 bytes in 1087 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:57:10.864943 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-55f0e269-a33e-4371-b5dd-51af964082bf tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:10.865987 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-55f0e269-a33e-4371-b5dd-51af964082bf tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 548e0225-fa26-46ba-9c12-7b52feee1784] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:10.902209 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-55f0e269-a33e-4371-b5dd-51af964082bf tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:10.912199 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-55f0e269-a33e-4371-b5dd-51af964082bf tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:10.928660 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-55f0e269-a33e-4371-b5dd-51af964082bf tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:10.929571 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-55f0e269-a33e-4371-b5dd-51af964082bf tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:10.930081 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-55f0e269-a33e-4371-b5dd-51af964082bf tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:10.930547 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-55f0e269-a33e-4371-b5dd-51af964082bf tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:11.331013 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-045ac2a0-504b-4a97-8141-4b2d41beb5ac tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1221b21792476baf26260db2bdbe93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f324e55d67b4764b183f7e85e206cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:11.342453 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-045ac2a0-504b-4a97-8141-4b2d41beb5ac tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] 10.222.0.50 "GET /compute/v2.1/servers/c5de4f8b-332b-4e34-8290-cc0d445c50fd" status: 200 len: 1281 microversion: 2.1 time: 1.254948 Aug 31 15:57:11.348837 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 950/2002] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:10 2022] GET /compute/v2.1/servers/c5de4f8b-332b-4e34-8290-cc0d445c50fd => generated 1281 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:11.354635 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2d2b5c1b-677b-43a8-bc9c-f97a6e0f9173 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:11.367005 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2d2b5c1b-677b-43a8-bc9c-f97a6e0f9173 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] [instance: 0e79fda0-f46b-48bf-9e45-a183e5470fc7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:11.388065 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d2b5c1b-677b-43a8-bc9c-f97a6e0f9173 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:11.390439 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d2b5c1b-677b-43a8-bc9c-f97a6e0f9173 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:11.391431 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d2b5c1b-677b-43a8-bc9c-f97a6e0f9173 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:11.394180 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d2b5c1b-677b-43a8-bc9c-f97a6e0f9173 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:11.397439 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d2b5c1b-677b-43a8-bc9c-f97a6e0f9173 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:11.398130 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d2b5c1b-677b-43a8-bc9c-f97a6e0f9173 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:11.561638 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-55f0e269-a33e-4371-b5dd-51af964082bf tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:11.576296 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-55f0e269-a33e-4371-b5dd-51af964082bf tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:11.582434 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-55f0e269-a33e-4371-b5dd-51af964082bf tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:11.585985 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-55f0e269-a33e-4371-b5dd-51af964082bf tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784" status: 200 len: 1293 microversion: 2.25 time: 0.727424 Aug 31 15:57:11.594839 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1053/2003] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:10 2022] GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784 => generated 1293 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:11.600683 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-dfe1082d-d775-403d-ab79-d0457c047e6a tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:11.613894 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-dfe1082d-d775-403d-ab79-d0457c047e6a tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] [instance: 862e1521-739f-47c0-a7e0-2bd017e5f738] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:11.632538 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dfe1082d-d775-403d-ab79-d0457c047e6a tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:11.642271 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dfe1082d-d775-403d-ab79-d0457c047e6a tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:11.642802 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dfe1082d-d775-403d-ab79-d0457c047e6a tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:11.643848 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dfe1082d-d775-403d-ab79-d0457c047e6a tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:11.644588 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dfe1082d-d775-403d-ab79-d0457c047e6a tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:11.645326 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dfe1082d-d775-403d-ab79-d0457c047e6a tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:11.920157 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-dfe1082d-d775-403d-ab79-d0457c047e6a tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba08a4705f4f0a9bc6a01d16a5f607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055586a03b0a4c1989b3ac658ac6347c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:11.933315 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-dfe1082d-d775-403d-ab79-d0457c047e6a tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] 10.222.0.50 "GET /compute/v2.1/servers/862e1521-739f-47c0-a7e0-2bd017e5f738" status: 200 len: 1214 microversion: 2.1 time: 0.336974 Aug 31 15:57:11.946567 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1054/2004] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:11 2022] GET /compute/v2.1/servers/862e1521-739f-47c0-a7e0-2bd017e5f738 => generated 1214 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:11.953827 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8e8300da-14e0-49f3-920c-37dafd4541b2 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:11.954825 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8e8300da-14e0-49f3-920c-37dafd4541b2 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: f044dca7-71de-4182-b5ec-825299496c10] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:11.966640 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8e8300da-14e0-49f3-920c-37dafd4541b2 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:11.967437 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8e8300da-14e0-49f3-920c-37dafd4541b2 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:11.968065 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8e8300da-14e0-49f3-920c-37dafd4541b2 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:11.969043 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8e8300da-14e0-49f3-920c-37dafd4541b2 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:11.969902 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8e8300da-14e0-49f3-920c-37dafd4541b2 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:11.970804 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8e8300da-14e0-49f3-920c-37dafd4541b2 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:12.030680 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2d2b5c1b-677b-43a8-bc9c-f97a6e0f9173 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f2bc800ceb41349e8c182d526d4d8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773dad0890c4048a0f0152e05fe8d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:12.049046 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2d2b5c1b-677b-43a8-bc9c-f97a6e0f9173 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] 10.222.0.50 "GET /compute/v2.1/servers/0e79fda0-f46b-48bf-9e45-a183e5470fc7" status: 200 len: 1292 microversion: 2.1 time: 0.689877 Aug 31 15:57:12.049703 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 951/2005] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:11 2022] GET /compute/v2.1/servers/0e79fda0-f46b-48bf-9e45-a183e5470fc7 => generated 1292 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:12.062499 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a7a0d30e-2890-46b5-8620-bbf0e286293e tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:12.063218 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a7a0d30e-2890-46b5-8620-bbf0e286293e tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: f550488c-401c-4f00-805b-fe62d75da9d4] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:12.077286 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a7a0d30e-2890-46b5-8620-bbf0e286293e tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:12.078130 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a7a0d30e-2890-46b5-8620-bbf0e286293e tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:12.078733 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a7a0d30e-2890-46b5-8620-bbf0e286293e tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:12.080087 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a7a0d30e-2890-46b5-8620-bbf0e286293e tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:12.080736 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a7a0d30e-2890-46b5-8620-bbf0e286293e tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:12.081341 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a7a0d30e-2890-46b5-8620-bbf0e286293e tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:12.140092 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a7a0d30e-2890-46b5-8620-bbf0e286293e tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: f550488c-401c-4f00-805b-fe62d75da9d4] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:57:12.353696 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a7a0d30e-2890-46b5-8620-bbf0e286293e tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "DELETE /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4" status: 204 len: 0 microversion: 2.1 time: 0.302335 Aug 31 15:57:12.354601 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 952/2006] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:57:12 2022] DELETE /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:57:12.380727 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-24925c06-8ec1-4e51-a6d0-394fef5d0044 req-2bb1b387-eb27-4f23-b901-1a23a955f7a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e79fda0-f46b-48bf-9e45-a183e5470fc7", "name": "network-vif-plugged", "status": "completed", "tag": "44bbd514-44c8-4952-80d8-40889c33f358"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:12.420008 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-24925c06-8ec1-4e51-a6d0-394fef5d0044 req-2bb1b387-eb27-4f23-b901-1a23a955f7a7 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:12.420483 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-24925c06-8ec1-4e51-a6d0-394fef5d0044 req-2bb1b387-eb27-4f23-b901-1a23a955f7a7 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:12.425724 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-24925c06-8ec1-4e51-a6d0-394fef5d0044 req-2bb1b387-eb27-4f23-b901-1a23a955f7a7 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:12.456859 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-24925c06-8ec1-4e51-a6d0-394fef5d0044 req-2bb1b387-eb27-4f23-b901-1a23a955f7a7 service nova] Creating event network-vif-plugged:44bbd514-44c8-4952-80d8-40889c33f358 for instance 0e79fda0-f46b-48bf-9e45-a183e5470fc7 on n-h2-833090-16 Aug 31 15:57:12.471064 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-24925c06-8ec1-4e51-a6d0-394fef5d0044 req-2bb1b387-eb27-4f23-b901-1a23a955f7a7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108528 Aug 31 15:57:12.472279 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 953/2007] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:12.478367 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=4 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:57:12.487663 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d1923e1a-20e0-476e-a2d8-2de46dd40057 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:12.489279 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d1923e1a-20e0-476e-a2d8-2de46dd40057 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] [instance: c5de4f8b-332b-4e34-8290-cc0d445c50fd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:12.522740 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d1923e1a-20e0-476e-a2d8-2de46dd40057 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:12.525806 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d1923e1a-20e0-476e-a2d8-2de46dd40057 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:12.527967 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d1923e1a-20e0-476e-a2d8-2de46dd40057 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:12.534729 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d1923e1a-20e0-476e-a2d8-2de46dd40057 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:12.535639 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d1923e1a-20e0-476e-a2d8-2de46dd40057 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:12.536241 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d1923e1a-20e0-476e-a2d8-2de46dd40057 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:12.550691 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=14 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:57:12.785395 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d1923e1a-20e0-476e-a2d8-2de46dd40057 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1221b21792476baf26260db2bdbe93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f324e55d67b4764b183f7e85e206cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:12.799137 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d1923e1a-20e0-476e-a2d8-2de46dd40057 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] 10.222.0.50 "GET /compute/v2.1/servers/c5de4f8b-332b-4e34-8290-cc0d445c50fd" status: 200 len: 1281 microversion: 2.1 time: 0.324194 Aug 31 15:57:12.799748 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 954/2008] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:12 2022] GET /compute/v2.1/servers/c5de4f8b-332b-4e34-8290-cc0d445c50fd => generated 1281 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:12.826445 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-65be122b-049a-4e93-ae79-cedd33efd9d9 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:12.827243 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-65be122b-049a-4e93-ae79-cedd33efd9d9 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 548e0225-fa26-46ba-9c12-7b52feee1784] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:12.848926 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65be122b-049a-4e93-ae79-cedd33efd9d9 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:12.850051 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65be122b-049a-4e93-ae79-cedd33efd9d9 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:12.850921 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65be122b-049a-4e93-ae79-cedd33efd9d9 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:12.851866 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65be122b-049a-4e93-ae79-cedd33efd9d9 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:12.852361 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65be122b-049a-4e93-ae79-cedd33efd9d9 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:12.853496 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65be122b-049a-4e93-ae79-cedd33efd9d9 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:13.183945 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8e8300da-14e0-49f3-920c-37dafd4541b2 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:13.196311 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8e8300da-14e0-49f3-920c-37dafd4541b2 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10" status: 200 len: 1313 microversion: 2.1 time: 1.248420 Aug 31 15:57:13.196922 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1055/2009] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:11 2022] GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10 => generated 1313 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:13.209822 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d7101015-9d43-4da3-9010-c3cbef9a908b tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-165684550", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "cbd57e67-cabe-44b0-9027-5fa4dc677f22"}]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:13.299088 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-d7101015-9d43-4da3-9010-c3cbef9a908b tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] validate_networks() for [('cbd57e67-cabe-44b0-9027-5fa4dc677f22', None, None, None, None, None)] {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:57:13.476979 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-65be122b-049a-4e93-ae79-cedd33efd9d9 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:13.485527 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-65be122b-049a-4e93-ae79-cedd33efd9d9 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:13.487012 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-65be122b-049a-4e93-ae79-cedd33efd9d9 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:13.488143 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-65be122b-049a-4e93-ae79-cedd33efd9d9 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784" status: 200 len: 1293 microversion: 2.25 time: 0.666549 Aug 31 15:57:13.488713 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 955/2010] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:12 2022] GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784 => generated 1293 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:13.519276 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-4e954f4f-6721-4165-8803-d77e702f4ce1 req-3cc39e29-4920-440f-ba0f-5650f2d61a81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f044dca7-71de-4182-b5ec-825299496c10", "tag": "f2758b61-4cf5-4435-9306-d8d8ffd9e363"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:13.540071 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4e954f4f-6721-4165-8803-d77e702f4ce1 req-3cc39e29-4920-440f-ba0f-5650f2d61a81 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:13.551108 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4e954f4f-6721-4165-8803-d77e702f4ce1 req-3cc39e29-4920-440f-ba0f-5650f2d61a81 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:13.551801 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4e954f4f-6721-4165-8803-d77e702f4ce1 req-3cc39e29-4920-440f-ba0f-5650f2d61a81 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:13.575893 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-4e954f4f-6721-4165-8803-d77e702f4ce1 req-3cc39e29-4920-440f-ba0f-5650f2d61a81 service nova] Creating event network-changed:f2758b61-4cf5-4435-9306-d8d8ffd9e363 for instance f044dca7-71de-4182-b5ec-825299496c10 on n-h1-833090-16 Aug 31 15:57:13.591342 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-4e954f4f-6721-4165-8803-d77e702f4ce1 req-3cc39e29-4920-440f-ba0f-5650f2d61a81 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075763 Aug 31 15:57:13.592465 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 956/2011] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:13.603372 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5eee9e7b-8aa4-46d1-9fad-63294f8a372d tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:13.612771 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5eee9e7b-8aa4-46d1-9fad-63294f8a372d tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] [instance: 862e1521-739f-47c0-a7e0-2bd017e5f738] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:13.620287 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5eee9e7b-8aa4-46d1-9fad-63294f8a372d tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:13.621788 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5eee9e7b-8aa4-46d1-9fad-63294f8a372d tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:13.622900 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5eee9e7b-8aa4-46d1-9fad-63294f8a372d tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:13.624796 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5eee9e7b-8aa4-46d1-9fad-63294f8a372d tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:13.626826 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5eee9e7b-8aa4-46d1-9fad-63294f8a372d tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:13.627426 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5eee9e7b-8aa4-46d1-9fad-63294f8a372d tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:13.994322 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5eee9e7b-8aa4-46d1-9fad-63294f8a372d tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba08a4705f4f0a9bc6a01d16a5f607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055586a03b0a4c1989b3ac658ac6347c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:14.011938 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:57:14.023690 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5eee9e7b-8aa4-46d1-9fad-63294f8a372d tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] 10.222.0.50 "GET /compute/v2.1/servers/862e1521-739f-47c0-a7e0-2bd017e5f738" status: 200 len: 1278 microversion: 2.1 time: 0.429079 Aug 31 15:57:14.024830 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 957/2012] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:13 2022] GET /compute/v2.1/servers/862e1521-739f-47c0-a7e0-2bd017e5f738 => generated 1278 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:14.042571 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-04784fc7-19f5-4b71-819c-4a1602819a36 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:14.043456 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-04784fc7-19f5-4b71-819c-4a1602819a36 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] [instance: 0e79fda0-f46b-48bf-9e45-a183e5470fc7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:14.073600 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04784fc7-19f5-4b71-819c-4a1602819a36 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:14.074152 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04784fc7-19f5-4b71-819c-4a1602819a36 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:14.074634 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04784fc7-19f5-4b71-819c-4a1602819a36 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:14.080082 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04784fc7-19f5-4b71-819c-4a1602819a36 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:14.081740 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04784fc7-19f5-4b71-819c-4a1602819a36 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:14.083223 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04784fc7-19f5-4b71-819c-4a1602819a36 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:15.433018 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-04784fc7-19f5-4b71-819c-4a1602819a36 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f2bc800ceb41349e8c182d526d4d8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773dad0890c4048a0f0152e05fe8d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:15.446289 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-04784fc7-19f5-4b71-819c-4a1602819a36 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] 10.222.0.50 "GET /compute/v2.1/servers/0e79fda0-f46b-48bf-9e45-a183e5470fc7" status: 200 len: 1292 microversion: 2.1 time: 1.416086 Aug 31 15:57:15.447266 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 958/2013] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:14 2022] GET /compute/v2.1/servers/0e79fda0-f46b-48bf-9e45-a183e5470fc7 => generated 1292 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:15.458363 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-465d9fd3-d364-4384-8df1-3dff121f6b84 req-eb1d187d-3fe3-4bea-920a-7605c0a69da9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "548e0225-fa26-46ba-9c12-7b52feee1784", "tag": "da0ce8b3-d23a-4835-87ba-6b9636776b31"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:15.481773 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-465d9fd3-d364-4384-8df1-3dff121f6b84 req-eb1d187d-3fe3-4bea-920a-7605c0a69da9 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:15.488293 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-465d9fd3-d364-4384-8df1-3dff121f6b84 req-eb1d187d-3fe3-4bea-920a-7605c0a69da9 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:15.488828 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-465d9fd3-d364-4384-8df1-3dff121f6b84 req-eb1d187d-3fe3-4bea-920a-7605c0a69da9 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:15.508005 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-465d9fd3-d364-4384-8df1-3dff121f6b84 req-eb1d187d-3fe3-4bea-920a-7605c0a69da9 service nova] Creating event network-changed:da0ce8b3-d23a-4835-87ba-6b9636776b31 for instance 548e0225-fa26-46ba-9c12-7b52feee1784 on n-h2-833090-16 Aug 31 15:57:15.515094 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-465d9fd3-d364-4384-8df1-3dff121f6b84 req-eb1d187d-3fe3-4bea-920a-7605c0a69da9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066205 Aug 31 15:57:15.516915 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 959/2014] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:15.523450 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-70e8988b-4530-4d2b-96a2-311ddd8a0628 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:15.524880 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-70e8988b-4530-4d2b-96a2-311ddd8a0628 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] [instance: c5de4f8b-332b-4e34-8290-cc0d445c50fd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:15.545141 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70e8988b-4530-4d2b-96a2-311ddd8a0628 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:15.545962 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70e8988b-4530-4d2b-96a2-311ddd8a0628 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:15.546668 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70e8988b-4530-4d2b-96a2-311ddd8a0628 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:15.547588 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70e8988b-4530-4d2b-96a2-311ddd8a0628 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:15.548311 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70e8988b-4530-4d2b-96a2-311ddd8a0628 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:15.548939 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70e8988b-4530-4d2b-96a2-311ddd8a0628 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:16.738597 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-70e8988b-4530-4d2b-96a2-311ddd8a0628 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1221b21792476baf26260db2bdbe93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f324e55d67b4764b183f7e85e206cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:16.750472 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-70e8988b-4530-4d2b-96a2-311ddd8a0628 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] 10.222.0.50 "GET /compute/v2.1/servers/c5de4f8b-332b-4e34-8290-cc0d445c50fd" status: 200 len: 1323 microversion: 2.1 time: 1.232045 Aug 31 15:57:16.751429 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 960/2015] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:15 2022] GET /compute/v2.1/servers/c5de4f8b-332b-4e34-8290-cc0d445c50fd => generated 1323 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:16.766899 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fd5ebed4-08af-437e-a9fa-d8b216469098 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:16.767888 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fd5ebed4-08af-437e-a9fa-d8b216469098 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: f044dca7-71de-4182-b5ec-825299496c10] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:16.775703 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd5ebed4-08af-437e-a9fa-d8b216469098 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:16.776502 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd5ebed4-08af-437e-a9fa-d8b216469098 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:16.777126 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd5ebed4-08af-437e-a9fa-d8b216469098 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:16.778005 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd5ebed4-08af-437e-a9fa-d8b216469098 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:16.778694 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd5ebed4-08af-437e-a9fa-d8b216469098 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:16.779282 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd5ebed4-08af-437e-a9fa-d8b216469098 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:16.989115 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-d7101015-9d43-4da3-9010-c3cbef9a908b tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:57:16.989652 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-d7101015-9d43-4da3-9010-c3cbef9a908b tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:57:16.990124 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-d7101015-9d43-4da3-9010-c3cbef9a908b tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:57:16.991176 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-d7101015-9d43-4da3-9010-c3cbef9a908b tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:57:16.991607 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-d7101015-9d43-4da3-9010-c3cbef9a908b tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:57:17.012726 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d7101015-9d43-4da3-9010-c3cbef9a908b tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:17.013486 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d7101015-9d43-4da3-9010-c3cbef9a908b tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:17.014067 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d7101015-9d43-4da3-9010-c3cbef9a908b tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:17.014985 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d7101015-9d43-4da3-9010-c3cbef9a908b tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:17.015587 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d7101015-9d43-4da3-9010-c3cbef9a908b tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:17.016335 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d7101015-9d43-4da3-9010-c3cbef9a908b tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:17.061540 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-d7101015-9d43-4da3-9010-c3cbef9a908b tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Getting quotas for project c508a07ab50746468f855f7c5893ffdc. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:57:17.075306 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-d7101015-9d43-4da3-9010-c3cbef9a908b tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Getting quotas for user 7d84a1872d9442b2886a8060d2e59580 and project c508a07ab50746468f855f7c5893ffdc. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:57:17.091855 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d7101015-9d43-4da3-9010-c3cbef9a908b tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:57:17.094564 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d7101015-9d43-4da3-9010-c3cbef9a908b tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: 434ee39d-6510-411f-93e1-0500c19fb312] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:57:17.165175 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d7101015-9d43-4da3-9010-c3cbef9a908b tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.966973 Aug 31 15:57:17.168332 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1056/2016] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:57:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 3970 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 15:57:17.180293 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8c081323-4627-4e01-9972-926512159dc7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:17.181503 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8c081323-4627-4e01-9972-926512159dc7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 548e0225-fa26-46ba-9c12-7b52feee1784] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:17.191714 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8c081323-4627-4e01-9972-926512159dc7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:17.193943 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8c081323-4627-4e01-9972-926512159dc7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:17.195034 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8c081323-4627-4e01-9972-926512159dc7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:17.196620 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8c081323-4627-4e01-9972-926512159dc7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:17.198702 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8c081323-4627-4e01-9972-926512159dc7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:17.199332 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8c081323-4627-4e01-9972-926512159dc7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:17.646229 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fd5ebed4-08af-437e-a9fa-d8b216469098 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:17.659728 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fd5ebed4-08af-437e-a9fa-d8b216469098 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10" status: 200 len: 1313 microversion: 2.1 time: 0.903070 Aug 31 15:57:17.663493 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 961/2017] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:16 2022] GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10 => generated 1313 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:17.698073 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-42141f25-eca9-44a0-a9b3-1585a0448631 req-1ce8c46a-edb4-4c9c-9c15-1608767ef4b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f550488c-401c-4f00-805b-fe62d75da9d4", "name": "network-vif-unplugged", "status": "completed", "tag": "0245a049-7e50-451b-9002-cd4e13a97fa5"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:17.730655 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-42141f25-eca9-44a0-a9b3-1585a0448631 req-1ce8c46a-edb4-4c9c-9c15-1608767ef4b2 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:17.732373 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-42141f25-eca9-44a0-a9b3-1585a0448631 req-1ce8c46a-edb4-4c9c-9c15-1608767ef4b2 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:17.734402 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-42141f25-eca9-44a0-a9b3-1585a0448631 req-1ce8c46a-edb4-4c9c-9c15-1608767ef4b2 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:17.778121 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-42141f25-eca9-44a0-a9b3-1585a0448631 req-1ce8c46a-edb4-4c9c-9c15-1608767ef4b2 service nova] Creating event network-vif-unplugged:0245a049-7e50-451b-9002-cd4e13a97fa5 for instance f550488c-401c-4f00-805b-fe62d75da9d4 on n-h1-833090-16 Aug 31 15:57:17.792274 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-42141f25-eca9-44a0-a9b3-1585a0448631 req-1ce8c46a-edb4-4c9c-9c15-1608767ef4b2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.124923 Aug 31 15:57:17.794970 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 962/2018] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:17.807382 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1beeed36-5852-4973-ab4c-9aef98fadb8c tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:17.810329 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1beeed36-5852-4973-ab4c-9aef98fadb8c tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] [instance: 862e1521-739f-47c0-a7e0-2bd017e5f738] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:17.826114 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1beeed36-5852-4973-ab4c-9aef98fadb8c tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:17.829659 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1beeed36-5852-4973-ab4c-9aef98fadb8c tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:17.830253 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1beeed36-5852-4973-ab4c-9aef98fadb8c tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:17.831730 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1beeed36-5852-4973-ab4c-9aef98fadb8c tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:17.835215 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1beeed36-5852-4973-ab4c-9aef98fadb8c tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:17.837963 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1beeed36-5852-4973-ab4c-9aef98fadb8c tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:18.188777 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1beeed36-5852-4973-ab4c-9aef98fadb8c tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba08a4705f4f0a9bc6a01d16a5f607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055586a03b0a4c1989b3ac658ac6347c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:18.198733 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1beeed36-5852-4973-ab4c-9aef98fadb8c tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] 10.222.0.50 "GET /compute/v2.1/servers/862e1521-739f-47c0-a7e0-2bd017e5f738" status: 200 len: 1276 microversion: 2.1 time: 0.400635 Aug 31 15:57:18.199322 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 963/2019] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:17 2022] GET /compute/v2.1/servers/862e1521-739f-47c0-a7e0-2bd017e5f738 => generated 1276 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:18.229426 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ecc770d4-c908-4e0b-a4a8-d24753214fbb tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:18.230061 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ecc770d4-c908-4e0b-a4a8-d24753214fbb tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] [instance: 0e79fda0-f46b-48bf-9e45-a183e5470fc7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:18.253282 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ecc770d4-c908-4e0b-a4a8-d24753214fbb tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:18.253786 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ecc770d4-c908-4e0b-a4a8-d24753214fbb tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:18.254249 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ecc770d4-c908-4e0b-a4a8-d24753214fbb tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:18.255031 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ecc770d4-c908-4e0b-a4a8-d24753214fbb tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:18.255493 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ecc770d4-c908-4e0b-a4a8-d24753214fbb tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:18.255911 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ecc770d4-c908-4e0b-a4a8-d24753214fbb tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:18.337747 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8c081323-4627-4e01-9972-926512159dc7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:18.355810 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8c081323-4627-4e01-9972-926512159dc7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:18.357503 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8c081323-4627-4e01-9972-926512159dc7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:18.358932 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8c081323-4627-4e01-9972-926512159dc7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784" status: 200 len: 1281 microversion: 2.25 time: 1.189016 Aug 31 15:57:18.363347 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1057/2020] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:17 2022] GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784 => generated 1281 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:18.376381 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-debac7a3-5225-45db-8aea-b35d68de94cb tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:18.377286 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-debac7a3-5225-45db-8aea-b35d68de94cb tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: 434ee39d-6510-411f-93e1-0500c19fb312] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:18.397165 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-debac7a3-5225-45db-8aea-b35d68de94cb tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:18.397655 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-debac7a3-5225-45db-8aea-b35d68de94cb tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:18.398340 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-debac7a3-5225-45db-8aea-b35d68de94cb tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:18.399260 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-debac7a3-5225-45db-8aea-b35d68de94cb tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:18.400167 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-debac7a3-5225-45db-8aea-b35d68de94cb tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:18.400788 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-debac7a3-5225-45db-8aea-b35d68de94cb tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:18.869258 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-debac7a3-5225-45db-8aea-b35d68de94cb tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:18.878164 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-debac7a3-5225-45db-8aea-b35d68de94cb tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/434ee39d-6510-411f-93e1-0500c19fb312" status: 200 len: 1259 microversion: 2.1 time: 0.511864 Aug 31 15:57:18.882297 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1058/2021] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:18 2022] GET /compute/v2.1/servers/434ee39d-6510-411f-93e1-0500c19fb312 => generated 1259 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:18.894995 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a7610e1c-f5f1-4e12-a491-1ce22c16f0d8 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:18.895884 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a7610e1c-f5f1-4e12-a491-1ce22c16f0d8 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] [instance: c5de4f8b-332b-4e34-8290-cc0d445c50fd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:18.914556 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a7610e1c-f5f1-4e12-a491-1ce22c16f0d8 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:18.915225 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a7610e1c-f5f1-4e12-a491-1ce22c16f0d8 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:18.915777 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a7610e1c-f5f1-4e12-a491-1ce22c16f0d8 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:18.916603 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a7610e1c-f5f1-4e12-a491-1ce22c16f0d8 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:18.917180 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a7610e1c-f5f1-4e12-a491-1ce22c16f0d8 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:18.917719 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a7610e1c-f5f1-4e12-a491-1ce22c16f0d8 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:19.474169 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ecc770d4-c908-4e0b-a4a8-d24753214fbb tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f2bc800ceb41349e8c182d526d4d8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773dad0890c4048a0f0152e05fe8d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:19.509509 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ecc770d4-c908-4e0b-a4a8-d24753214fbb tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] 10.222.0.50 "GET /compute/v2.1/servers/0e79fda0-f46b-48bf-9e45-a183e5470fc7" status: 200 len: 1482 microversion: 2.1 time: 1.297552 Aug 31 15:57:19.513131 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 964/2022] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:18 2022] GET /compute/v2.1/servers/0e79fda0-f46b-48bf-9e45-a183e5470fc7 => generated 1482 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:19.519547 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dab51d62-c2d3-4c22-955f-69520f21fff1 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:19.520712 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dab51d62-c2d3-4c22-955f-69520f21fff1 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: f044dca7-71de-4182-b5ec-825299496c10] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:19.541654 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dab51d62-c2d3-4c22-955f-69520f21fff1 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:19.542403 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dab51d62-c2d3-4c22-955f-69520f21fff1 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:19.543216 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dab51d62-c2d3-4c22-955f-69520f21fff1 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:19.544138 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dab51d62-c2d3-4c22-955f-69520f21fff1 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:19.545452 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dab51d62-c2d3-4c22-955f-69520f21fff1 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:19.547430 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dab51d62-c2d3-4c22-955f-69520f21fff1 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:19.719828 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a7610e1c-f5f1-4e12-a491-1ce22c16f0d8 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1221b21792476baf26260db2bdbe93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f324e55d67b4764b183f7e85e206cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:19.733217 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a7610e1c-f5f1-4e12-a491-1ce22c16f0d8 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] 10.222.0.50 "GET /compute/v2.1/servers/c5de4f8b-332b-4e34-8290-cc0d445c50fd" status: 200 len: 1323 microversion: 2.1 time: 0.842255 Aug 31 15:57:19.751909 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1059/2023] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:18 2022] GET /compute/v2.1/servers/c5de4f8b-332b-4e34-8290-cc0d445c50fd => generated 1323 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:19.758158 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-040673e3-b479-4b14-bb6f-cf1317e0540c req-6e0c44e9-6610-4f4a-92bf-493455bf2a54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f550488c-401c-4f00-805b-fe62d75da9d4", "name": "network-vif-deleted", "tag": "0245a049-7e50-451b-9002-cd4e13a97fa5"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:19.775604 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-040673e3-b479-4b14-bb6f-cf1317e0540c req-6e0c44e9-6610-4f4a-92bf-493455bf2a54 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:19.776278 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-040673e3-b479-4b14-bb6f-cf1317e0540c req-6e0c44e9-6610-4f4a-92bf-493455bf2a54 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:19.776893 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-040673e3-b479-4b14-bb6f-cf1317e0540c req-6e0c44e9-6610-4f4a-92bf-493455bf2a54 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:19.797223 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-040673e3-b479-4b14-bb6f-cf1317e0540c req-6e0c44e9-6610-4f4a-92bf-493455bf2a54 service nova] Creating event network-vif-deleted:0245a049-7e50-451b-9002-cd4e13a97fa5 for instance f550488c-401c-4f00-805b-fe62d75da9d4 on n-h1-833090-16 Aug 31 15:57:19.803602 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-040673e3-b479-4b14-bb6f-cf1317e0540c req-6e0c44e9-6610-4f4a-92bf-493455bf2a54 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049980 Aug 31 15:57:19.805269 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1060/2024] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:19.812565 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f5abe1c3-3c3d-4c64-a1cf-cba9d2956dcf tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:19.816523 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f5abe1c3-3c3d-4c64-a1cf-cba9d2956dcf tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] [instance: 862e1521-739f-47c0-a7e0-2bd017e5f738] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:19.828628 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f5abe1c3-3c3d-4c64-a1cf-cba9d2956dcf tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:19.829920 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f5abe1c3-3c3d-4c64-a1cf-cba9d2956dcf tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:19.830978 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f5abe1c3-3c3d-4c64-a1cf-cba9d2956dcf tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:19.832575 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f5abe1c3-3c3d-4c64-a1cf-cba9d2956dcf tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:19.833350 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f5abe1c3-3c3d-4c64-a1cf-cba9d2956dcf tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:19.834583 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f5abe1c3-3c3d-4c64-a1cf-cba9d2956dcf tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:19.840641 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=100 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:57:19.930522 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:57:19.991001 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=12 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:57:20.042404 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f5abe1c3-3c3d-4c64-a1cf-cba9d2956dcf tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba08a4705f4f0a9bc6a01d16a5f607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055586a03b0a4c1989b3ac658ac6347c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:20.051138 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f5abe1c3-3c3d-4c64-a1cf-cba9d2956dcf tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] 10.222.0.50 "GET /compute/v2.1/servers/862e1521-739f-47c0-a7e0-2bd017e5f738" status: 200 len: 1276 microversion: 2.1 time: 0.244292 Aug 31 15:57:20.051789 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1061/2025] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:19 2022] GET /compute/v2.1/servers/862e1521-739f-47c0-a7e0-2bd017e5f738 => generated 1276 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:20.056675 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9127aef9-3aea-46ae-bba4-e57491cf3ece tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:20.057431 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9127aef9-3aea-46ae-bba4-e57491cf3ece tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 548e0225-fa26-46ba-9c12-7b52feee1784] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:20.063709 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9127aef9-3aea-46ae-bba4-e57491cf3ece tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:20.064357 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9127aef9-3aea-46ae-bba4-e57491cf3ece tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:20.065026 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9127aef9-3aea-46ae-bba4-e57491cf3ece tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:20.065876 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9127aef9-3aea-46ae-bba4-e57491cf3ece tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:20.066511 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9127aef9-3aea-46ae-bba4-e57491cf3ece tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:20.067078 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9127aef9-3aea-46ae-bba4-e57491cf3ece tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:20.124398 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dab51d62-c2d3-4c22-955f-69520f21fff1 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:20.132536 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dab51d62-c2d3-4c22-955f-69520f21fff1 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10" status: 200 len: 1313 microversion: 2.1 time: 0.618011 Aug 31 15:57:20.133123 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 965/2026] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:19 2022] GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10 => generated 1313 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:20.138164 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9d586823-1499-43cc-b43a-92e42c3bb22f tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:20.139297 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9d586823-1499-43cc-b43a-92e42c3bb22f tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] [instance: 0e79fda0-f46b-48bf-9e45-a183e5470fc7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:20.145335 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d586823-1499-43cc-b43a-92e42c3bb22f tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:20.146032 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d586823-1499-43cc-b43a-92e42c3bb22f tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:20.147076 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d586823-1499-43cc-b43a-92e42c3bb22f tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:20.148086 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d586823-1499-43cc-b43a-92e42c3bb22f tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:20.148433 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d586823-1499-43cc-b43a-92e42c3bb22f tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:20.149097 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d586823-1499-43cc-b43a-92e42c3bb22f tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:20.389601 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9d586823-1499-43cc-b43a-92e42c3bb22f tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] 10.222.0.50 "GET /compute/v2.1/servers/0e79fda0-f46b-48bf-9e45-a183e5470fc7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.255063 Aug 31 15:57:20.390436 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 966/2027] 10.222.0.50 () {58 vars in 1275 bytes} [Wed Aug 31 15:57:20 2022] GET /compute/v2.1/servers/0e79fda0-f46b-48bf-9e45-a183e5470fc7/os-interface => generated 284 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:20.395490 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e31ed563-8b11-4e60-9078-d0432818ee08 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:20.396338 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e31ed563-8b11-4e60-9078-d0432818ee08 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: 434ee39d-6510-411f-93e1-0500c19fb312] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:20.403770 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e31ed563-8b11-4e60-9078-d0432818ee08 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:20.404528 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e31ed563-8b11-4e60-9078-d0432818ee08 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:20.405493 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e31ed563-8b11-4e60-9078-d0432818ee08 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:20.406417 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e31ed563-8b11-4e60-9078-d0432818ee08 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:20.407130 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e31ed563-8b11-4e60-9078-d0432818ee08 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:20.408378 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e31ed563-8b11-4e60-9078-d0432818ee08 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:20.569214 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e31ed563-8b11-4e60-9078-d0432818ee08 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:20.586139 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e31ed563-8b11-4e60-9078-d0432818ee08 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/434ee39d-6510-411f-93e1-0500c19fb312" status: 200 len: 1265 microversion: 2.1 time: 0.194394 Aug 31 15:57:20.594310 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 967/2028] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:20 2022] GET /compute/v2.1/servers/434ee39d-6510-411f-93e1-0500c19fb312 => generated 1265 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:20.730060 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9127aef9-3aea-46ae-bba4-e57491cf3ece tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:20.739715 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9127aef9-3aea-46ae-bba4-e57491cf3ece tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:20.742819 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9127aef9-3aea-46ae-bba4-e57491cf3ece tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:20.744878 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9127aef9-3aea-46ae-bba4-e57491cf3ece tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784" status: 200 len: 1281 microversion: 2.25 time: 0.691148 Aug 31 15:57:20.745542 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1062/2029] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:20 2022] GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784 => generated 1281 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:20.755727 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3a7cc2a2-1015-4127-81bd-59f95f83d2db tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:20.756404 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3a7cc2a2-1015-4127-81bd-59f95f83d2db tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] [instance: c5de4f8b-332b-4e34-8290-cc0d445c50fd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:20.775198 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a7cc2a2-1015-4127-81bd-59f95f83d2db tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:20.775849 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a7cc2a2-1015-4127-81bd-59f95f83d2db tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:20.776250 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a7cc2a2-1015-4127-81bd-59f95f83d2db tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:20.777137 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a7cc2a2-1015-4127-81bd-59f95f83d2db tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:20.777742 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a7cc2a2-1015-4127-81bd-59f95f83d2db tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:20.778251 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a7cc2a2-1015-4127-81bd-59f95f83d2db tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:21.073212 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-85d97a87-72c7-40d2-b01e-027e7e08a2bf tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:21.082786 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-85d97a87-72c7-40d2-b01e-027e7e08a2bf tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] [instance: 862e1521-739f-47c0-a7e0-2bd017e5f738] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:21.096406 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85d97a87-72c7-40d2-b01e-027e7e08a2bf tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:21.098463 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85d97a87-72c7-40d2-b01e-027e7e08a2bf tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:21.099486 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85d97a87-72c7-40d2-b01e-027e7e08a2bf tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:21.100080 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85d97a87-72c7-40d2-b01e-027e7e08a2bf tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:21.100764 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85d97a87-72c7-40d2-b01e-027e7e08a2bf tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:21.101392 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85d97a87-72c7-40d2-b01e-027e7e08a2bf tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:21.615736 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3a7cc2a2-1015-4127-81bd-59f95f83d2db tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1221b21792476baf26260db2bdbe93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f324e55d67b4764b183f7e85e206cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:21.640170 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3a7cc2a2-1015-4127-81bd-59f95f83d2db tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] 10.222.0.50 "GET /compute/v2.1/servers/c5de4f8b-332b-4e34-8290-cc0d445c50fd" status: 200 len: 1323 microversion: 2.1 time: 0.888394 Aug 31 15:57:21.640994 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 968/2030] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:20 2022] GET /compute/v2.1/servers/c5de4f8b-332b-4e34-8290-cc0d445c50fd => generated 1323 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:21.655127 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-20fea44c-6eb4-4e4a-b9d4-3eca1100b67a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:21.656163 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-20fea44c-6eb4-4e4a-b9d4-3eca1100b67a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: f044dca7-71de-4182-b5ec-825299496c10] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:21.673269 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20fea44c-6eb4-4e4a-b9d4-3eca1100b67a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:21.674039 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20fea44c-6eb4-4e4a-b9d4-3eca1100b67a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:21.674687 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20fea44c-6eb4-4e4a-b9d4-3eca1100b67a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:21.675558 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20fea44c-6eb4-4e4a-b9d4-3eca1100b67a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:21.676155 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20fea44c-6eb4-4e4a-b9d4-3eca1100b67a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:21.676753 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20fea44c-6eb4-4e4a-b9d4-3eca1100b67a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:22.164359 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-85d97a87-72c7-40d2-b01e-027e7e08a2bf tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba08a4705f4f0a9bc6a01d16a5f607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055586a03b0a4c1989b3ac658ac6347c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:22.180369 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-85d97a87-72c7-40d2-b01e-027e7e08a2bf tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] 10.222.0.50 "GET /compute/v2.1/servers/862e1521-739f-47c0-a7e0-2bd017e5f738" status: 200 len: 1318 microversion: 2.1 time: 1.111940 Aug 31 15:57:22.183853 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1063/2031] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:21 2022] GET /compute/v2.1/servers/862e1521-739f-47c0-a7e0-2bd017e5f738 => generated 1318 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:57:22.202239 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-542dad74-dad3-4663-9f63-93f3da6592cd tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:22.203326 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-542dad74-dad3-4663-9f63-93f3da6592cd tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: 434ee39d-6510-411f-93e1-0500c19fb312] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:22.214864 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-542dad74-dad3-4663-9f63-93f3da6592cd tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:22.215582 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-542dad74-dad3-4663-9f63-93f3da6592cd tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:22.220704 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-542dad74-dad3-4663-9f63-93f3da6592cd tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:22.221648 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-542dad74-dad3-4663-9f63-93f3da6592cd tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:22.222294 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-542dad74-dad3-4663-9f63-93f3da6592cd tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:22.222861 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-542dad74-dad3-4663-9f63-93f3da6592cd tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:22.453802 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-542dad74-dad3-4663-9f63-93f3da6592cd tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:22.464601 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-542dad74-dad3-4663-9f63-93f3da6592cd tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/434ee39d-6510-411f-93e1-0500c19fb312" status: 200 len: 1265 microversion: 2.1 time: 0.279421 Aug 31 15:57:22.468123 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-20fea44c-6eb4-4e4a-b9d4-3eca1100b67a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:22.469049 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1064/2032] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:22 2022] GET /compute/v2.1/servers/434ee39d-6510-411f-93e1-0500c19fb312 => generated 1265 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:22.484855 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-20fea44c-6eb4-4e4a-b9d4-3eca1100b67a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10" status: 200 len: 1313 microversion: 2.1 time: 0.841904 Aug 31 15:57:22.498126 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 969/2033] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:21 2022] GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10 => generated 1313 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:22.498126 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-696a14eb-7154-4bb3-8e50-35524dfaf9fb req-3598fc29-ed16-476d-a5a1-f77f40549f97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f044dca7-71de-4182-b5ec-825299496c10", "name": "network-vif-plugged", "status": "completed", "tag": "f2758b61-4cf5-4435-9306-d8d8ffd9e363"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:22.502880 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2ef4dd66-f090-44af-8d0f-da1fbcdf706c tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:22.503512 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2ef4dd66-f090-44af-8d0f-da1fbcdf706c tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 548e0225-fa26-46ba-9c12-7b52feee1784] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:22.516231 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2ef4dd66-f090-44af-8d0f-da1fbcdf706c tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:22.516654 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2ef4dd66-f090-44af-8d0f-da1fbcdf706c tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:22.517091 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2ef4dd66-f090-44af-8d0f-da1fbcdf706c tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:22.522205 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-696a14eb-7154-4bb3-8e50-35524dfaf9fb req-3598fc29-ed16-476d-a5a1-f77f40549f97 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:22.523059 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-696a14eb-7154-4bb3-8e50-35524dfaf9fb req-3598fc29-ed16-476d-a5a1-f77f40549f97 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:22.525238 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2ef4dd66-f090-44af-8d0f-da1fbcdf706c tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:22.525855 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-696a14eb-7154-4bb3-8e50-35524dfaf9fb req-3598fc29-ed16-476d-a5a1-f77f40549f97 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:22.526325 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2ef4dd66-f090-44af-8d0f-da1fbcdf706c tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:22.526924 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2ef4dd66-f090-44af-8d0f-da1fbcdf706c tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:22.562646 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-696a14eb-7154-4bb3-8e50-35524dfaf9fb req-3598fc29-ed16-476d-a5a1-f77f40549f97 service nova] Creating event network-vif-plugged:f2758b61-4cf5-4435-9306-d8d8ffd9e363 for instance f044dca7-71de-4182-b5ec-825299496c10 on n-h1-833090-16 Aug 31 15:57:22.569876 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-696a14eb-7154-4bb3-8e50-35524dfaf9fb req-3598fc29-ed16-476d-a5a1-f77f40549f97 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082695 Aug 31 15:57:22.571138 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 970/2034] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:22.578450 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-982bce2b-f7e6-402d-95ab-ddc86f164d45 req-8a7d68c9-1a88-4f7b-84b8-98a937f5f696 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5de4f8b-332b-4e34-8290-cc0d445c50fd", "tag": "2c9bf410-c8d1-4264-92a1-8db9e76a7565"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:22.590817 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-982bce2b-f7e6-402d-95ab-ddc86f164d45 req-8a7d68c9-1a88-4f7b-84b8-98a937f5f696 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:22.591579 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-982bce2b-f7e6-402d-95ab-ddc86f164d45 req-8a7d68c9-1a88-4f7b-84b8-98a937f5f696 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:22.592007 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-982bce2b-f7e6-402d-95ab-ddc86f164d45 req-8a7d68c9-1a88-4f7b-84b8-98a937f5f696 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:22.609653 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-982bce2b-f7e6-402d-95ab-ddc86f164d45 req-8a7d68c9-1a88-4f7b-84b8-98a937f5f696 service nova] Creating event network-changed:2c9bf410-c8d1-4264-92a1-8db9e76a7565 for instance c5de4f8b-332b-4e34-8290-cc0d445c50fd on n-h2-833090-16 Aug 31 15:57:22.632547 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-982bce2b-f7e6-402d-95ab-ddc86f164d45 req-8a7d68c9-1a88-4f7b-84b8-98a937f5f696 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059584 Aug 31 15:57:22.634423 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 971/2035] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:22.670399 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-85e6532e-3617-445c-b1dd-feacf5bdf0e1 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:22.671219 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-85e6532e-3617-445c-b1dd-feacf5bdf0e1 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] [instance: c5de4f8b-332b-4e34-8290-cc0d445c50fd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:22.691370 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-85e6532e-3617-445c-b1dd-feacf5bdf0e1 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:22.691884 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-85e6532e-3617-445c-b1dd-feacf5bdf0e1 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:22.692329 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-85e6532e-3617-445c-b1dd-feacf5bdf0e1 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:22.693145 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-85e6532e-3617-445c-b1dd-feacf5bdf0e1 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:22.693600 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-85e6532e-3617-445c-b1dd-feacf5bdf0e1 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:22.694024 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-85e6532e-3617-445c-b1dd-feacf5bdf0e1 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:23.042060 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2ef4dd66-f090-44af-8d0f-da1fbcdf706c tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:23.086161 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2ef4dd66-f090-44af-8d0f-da1fbcdf706c tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:23.087695 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2ef4dd66-f090-44af-8d0f-da1fbcdf706c tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:23.095679 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2ef4dd66-f090-44af-8d0f-da1fbcdf706c tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784" status: 200 len: 1281 microversion: 2.25 time: 0.604883 Aug 31 15:57:23.109165 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1065/2036] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:22 2022] GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784 => generated 1281 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:23.242125 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-85e6532e-3617-445c-b1dd-feacf5bdf0e1 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1221b21792476baf26260db2bdbe93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f324e55d67b4764b183f7e85e206cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:23.248562 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-86b82f9e-39e9-462a-b325-8e9e295e02e3 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1615914636", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:23.252323 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-85e6532e-3617-445c-b1dd-feacf5bdf0e1 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] 10.222.0.50 "GET /compute/v2.1/servers/c5de4f8b-332b-4e34-8290-cc0d445c50fd" status: 200 len: 1323 microversion: 2.1 time: 0.593684 Aug 31 15:57:23.267093 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 972/2037] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:22 2022] GET /compute/v2.1/servers/c5de4f8b-332b-4e34-8290-cc0d445c50fd => generated 1323 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:23.275859 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fa14183a-9771-42af-80e8-3a0a5378035d tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:23.282741 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fa14183a-9771-42af-80e8-3a0a5378035d tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] [instance: 0e79fda0-f46b-48bf-9e45-a183e5470fc7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:23.304440 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa14183a-9771-42af-80e8-3a0a5378035d tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:23.305043 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa14183a-9771-42af-80e8-3a0a5378035d tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:23.305489 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa14183a-9771-42af-80e8-3a0a5378035d tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:23.306228 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa14183a-9771-42af-80e8-3a0a5378035d tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:23.306686 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa14183a-9771-42af-80e8-3a0a5378035d tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:23.307110 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa14183a-9771-42af-80e8-3a0a5378035d tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:23.341680 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-86b82f9e-39e9-462a-b325-8e9e295e02e3 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] validate_networks() for [('95b34cb5-ccab-4e4a-8df6-349b72ccc459', None, None, None, None, None)] {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:57:24.156420 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fa14183a-9771-42af-80e8-3a0a5378035d tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f2bc800ceb41349e8c182d526d4d8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773dad0890c4048a0f0152e05fe8d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:24.170690 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fa14183a-9771-42af-80e8-3a0a5378035d tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] 10.222.0.50 "GET /compute/v2.1/servers/0e79fda0-f46b-48bf-9e45-a183e5470fc7" status: 200 len: 1482 microversion: 2.1 time: 0.898974 Aug 31 15:57:24.171683 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 973/2038] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:23 2022] GET /compute/v2.1/servers/0e79fda0-f46b-48bf-9e45-a183e5470fc7 => generated 1482 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:24.185557 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-ed1b6f8e-9ea3-4550-9790-c5f5658c2123 req-5337f902-b250-4966-8ca4-1ac157be19bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e79fda0-f46b-48bf-9e45-a183e5470fc7", "tag": "44bbd514-44c8-4952-80d8-40889c33f358"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:24.208799 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ed1b6f8e-9ea3-4550-9790-c5f5658c2123 req-5337f902-b250-4966-8ca4-1ac157be19bb service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:24.212443 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ed1b6f8e-9ea3-4550-9790-c5f5658c2123 req-5337f902-b250-4966-8ca4-1ac157be19bb service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:24.214259 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ed1b6f8e-9ea3-4550-9790-c5f5658c2123 req-5337f902-b250-4966-8ca4-1ac157be19bb service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:24.237168 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-ed1b6f8e-9ea3-4550-9790-c5f5658c2123 req-5337f902-b250-4966-8ca4-1ac157be19bb service nova] Creating event network-changed:44bbd514-44c8-4952-80d8-40889c33f358 for instance 0e79fda0-f46b-48bf-9e45-a183e5470fc7 on n-h2-833090-16 Aug 31 15:57:24.246104 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-ed1b6f8e-9ea3-4550-9790-c5f5658c2123 req-5337f902-b250-4966-8ca4-1ac157be19bb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071142 Aug 31 15:57:24.247325 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 974/2039] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:24.276021 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-11698438-a8d3-4bb1-9922-d6d7918f184a tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:24.277677 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-11698438-a8d3-4bb1-9922-d6d7918f184a tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] [instance: 862e1521-739f-47c0-a7e0-2bd017e5f738] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:24.287362 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11698438-a8d3-4bb1-9922-d6d7918f184a tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:24.288205 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11698438-a8d3-4bb1-9922-d6d7918f184a tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:24.288949 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11698438-a8d3-4bb1-9922-d6d7918f184a tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:24.289878 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11698438-a8d3-4bb1-9922-d6d7918f184a tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:24.290569 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11698438-a8d3-4bb1-9922-d6d7918f184a tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:24.291459 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11698438-a8d3-4bb1-9922-d6d7918f184a tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:25.214226 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-11698438-a8d3-4bb1-9922-d6d7918f184a tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba08a4705f4f0a9bc6a01d16a5f607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055586a03b0a4c1989b3ac658ac6347c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:25.223198 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-11698438-a8d3-4bb1-9922-d6d7918f184a tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] 10.222.0.50 "GET /compute/v2.1/servers/862e1521-739f-47c0-a7e0-2bd017e5f738" status: 200 len: 1318 microversion: 2.1 time: 0.974498 Aug 31 15:57:25.223786 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 975/2040] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:24 2022] GET /compute/v2.1/servers/862e1521-739f-47c0-a7e0-2bd017e5f738 => generated 1318 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:25.238365 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ce6aab9c-12c2-4022-82b0-1cdbe98da3ad tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:25.239262 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ce6aab9c-12c2-4022-82b0-1cdbe98da3ad tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: 434ee39d-6510-411f-93e1-0500c19fb312] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:25.258299 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce6aab9c-12c2-4022-82b0-1cdbe98da3ad tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:25.259027 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce6aab9c-12c2-4022-82b0-1cdbe98da3ad tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:25.260223 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce6aab9c-12c2-4022-82b0-1cdbe98da3ad tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:25.261096 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce6aab9c-12c2-4022-82b0-1cdbe98da3ad tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:25.261709 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce6aab9c-12c2-4022-82b0-1cdbe98da3ad tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:25.262343 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce6aab9c-12c2-4022-82b0-1cdbe98da3ad tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:25.370431 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-86b82f9e-39e9-462a-b325-8e9e295e02e3 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:57:25.370947 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-86b82f9e-39e9-462a-b325-8e9e295e02e3 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:57:25.371313 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-86b82f9e-39e9-462a-b325-8e9e295e02e3 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:57:25.371889 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-86b82f9e-39e9-462a-b325-8e9e295e02e3 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:57:25.372317 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-86b82f9e-39e9-462a-b325-8e9e295e02e3 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:57:25.383228 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-86b82f9e-39e9-462a-b325-8e9e295e02e3 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:25.384099 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-86b82f9e-39e9-462a-b325-8e9e295e02e3 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:25.384767 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-86b82f9e-39e9-462a-b325-8e9e295e02e3 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:25.385762 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-86b82f9e-39e9-462a-b325-8e9e295e02e3 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:25.386470 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-86b82f9e-39e9-462a-b325-8e9e295e02e3 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:25.387112 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-86b82f9e-39e9-462a-b325-8e9e295e02e3 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:25.408939 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-86b82f9e-39e9-462a-b325-8e9e295e02e3 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Getting quotas for project f1371996a8304dc58ee579daa535bcd7. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:57:25.416733 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-86b82f9e-39e9-462a-b325-8e9e295e02e3 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Getting quotas for user f922a671cad44ea595e46290a5d52380 and project f1371996a8304dc58ee579daa535bcd7. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:57:25.434497 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-86b82f9e-39e9-462a-b325-8e9e295e02e3 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:57:25.437207 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-86b82f9e-39e9-462a-b325-8e9e295e02e3 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: a9448c8e-c801-4d08-b1c1-b34f279269e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:57:25.503005 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-86b82f9e-39e9-462a-b325-8e9e295e02e3 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.405207 Aug 31 15:57:25.504443 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1066/2041] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:57:23 2022] POST /compute/v2.1/servers => generated 383 bytes in 2407 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 15:57:25.510478 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9452304a-7f32-435a-927b-21379941c645 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:25.511407 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9452304a-7f32-435a-927b-21379941c645 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: f044dca7-71de-4182-b5ec-825299496c10] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:25.518363 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9452304a-7f32-435a-927b-21379941c645 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:25.520713 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9452304a-7f32-435a-927b-21379941c645 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:25.521560 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9452304a-7f32-435a-927b-21379941c645 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:25.524000 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9452304a-7f32-435a-927b-21379941c645 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:25.525774 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9452304a-7f32-435a-927b-21379941c645 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:25.526500 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9452304a-7f32-435a-927b-21379941c645 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:25.733428 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ce6aab9c-12c2-4022-82b0-1cdbe98da3ad tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:25.743739 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ce6aab9c-12c2-4022-82b0-1cdbe98da3ad tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/434ee39d-6510-411f-93e1-0500c19fb312" status: 200 len: 1307 microversion: 2.1 time: 0.512638 Aug 31 15:57:25.744345 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 976/2042] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:25 2022] GET /compute/v2.1/servers/434ee39d-6510-411f-93e1-0500c19fb312 => generated 1307 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:25.752936 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-56e55818-30db-43ea-b5d9-5b59dcd7d003 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:25.753715 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-56e55818-30db-43ea-b5d9-5b59dcd7d003 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 548e0225-fa26-46ba-9c12-7b52feee1784] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:25.771194 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56e55818-30db-43ea-b5d9-5b59dcd7d003 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:25.774564 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56e55818-30db-43ea-b5d9-5b59dcd7d003 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:25.775051 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56e55818-30db-43ea-b5d9-5b59dcd7d003 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:25.775777 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56e55818-30db-43ea-b5d9-5b59dcd7d003 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:25.776237 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56e55818-30db-43ea-b5d9-5b59dcd7d003 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:25.776929 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56e55818-30db-43ea-b5d9-5b59dcd7d003 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:26.203171 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9452304a-7f32-435a-927b-21379941c645 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:26.221475 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9452304a-7f32-435a-927b-21379941c645 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10" status: 200 len: 1500 microversion: 2.1 time: 0.715458 Aug 31 15:57:26.249198 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1067/2043] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:25 2022] GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10 => generated 1500 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:26.262459 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e5291403-3fd1-4f37-baa5-6b0ce68e1b67 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:26.263084 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e5291403-3fd1-4f37-baa5-6b0ce68e1b67 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] [instance: c5de4f8b-332b-4e34-8290-cc0d445c50fd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:26.283055 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e5291403-3fd1-4f37-baa5-6b0ce68e1b67 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:26.283669 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e5291403-3fd1-4f37-baa5-6b0ce68e1b67 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:26.284251 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e5291403-3fd1-4f37-baa5-6b0ce68e1b67 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:26.285110 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e5291403-3fd1-4f37-baa5-6b0ce68e1b67 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:26.289799 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e5291403-3fd1-4f37-baa5-6b0ce68e1b67 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:26.290571 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e5291403-3fd1-4f37-baa5-6b0ce68e1b67 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:26.583422 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-56e55818-30db-43ea-b5d9-5b59dcd7d003 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:26.617889 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-56e55818-30db-43ea-b5d9-5b59dcd7d003 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:26.621224 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-56e55818-30db-43ea-b5d9-5b59dcd7d003 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:26.627341 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-56e55818-30db-43ea-b5d9-5b59dcd7d003 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784" status: 200 len: 1281 microversion: 2.25 time: 0.877770 Aug 31 15:57:26.631529 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 977/2044] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:25 2022] GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784 => generated 1281 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:26.643428 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-f8fb5b4d-4f1d-4146-8993-2d6535f1d8dd req-a757ffc7-cb32-46cf-892b-99a50568c5f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "862e1521-739f-47c0-a7e0-2bd017e5f738", "tag": "02873cd3-826b-444d-b633-baeaea646877"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:26.690018 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f8fb5b4d-4f1d-4146-8993-2d6535f1d8dd req-a757ffc7-cb32-46cf-892b-99a50568c5f6 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:26.691258 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f8fb5b4d-4f1d-4146-8993-2d6535f1d8dd req-a757ffc7-cb32-46cf-892b-99a50568c5f6 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:26.694881 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f8fb5b4d-4f1d-4146-8993-2d6535f1d8dd req-a757ffc7-cb32-46cf-892b-99a50568c5f6 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:26.707441 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:57:26.741099 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-f8fb5b4d-4f1d-4146-8993-2d6535f1d8dd req-a757ffc7-cb32-46cf-892b-99a50568c5f6 service nova] Creating event network-changed:02873cd3-826b-444d-b633-baeaea646877 for instance 862e1521-739f-47c0-a7e0-2bd017e5f738 on n-h1-833090-16 Aug 31 15:57:26.750587 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-f8fb5b4d-4f1d-4146-8993-2d6535f1d8dd req-a757ffc7-cb32-46cf-892b-99a50568c5f6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117447 Aug 31 15:57:26.756892 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 978/2045] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:57:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:26.774982 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-97c8966d-b7a2-4ada-87ea-6011d5851f64 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:26.776440 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-97c8966d-b7a2-4ada-87ea-6011d5851f64 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: a9448c8e-c801-4d08-b1c1-b34f279269e6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:26.793314 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97c8966d-b7a2-4ada-87ea-6011d5851f64 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:26.793960 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97c8966d-b7a2-4ada-87ea-6011d5851f64 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:26.794463 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97c8966d-b7a2-4ada-87ea-6011d5851f64 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:26.795307 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97c8966d-b7a2-4ada-87ea-6011d5851f64 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:26.795931 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97c8966d-b7a2-4ada-87ea-6011d5851f64 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:26.796509 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97c8966d-b7a2-4ada-87ea-6011d5851f64 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:26.850158 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e5291403-3fd1-4f37-baa5-6b0ce68e1b67 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1221b21792476baf26260db2bdbe93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f324e55d67b4764b183f7e85e206cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:26.866909 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e5291403-3fd1-4f37-baa5-6b0ce68e1b67 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] 10.222.0.50 "GET /compute/v2.1/servers/c5de4f8b-332b-4e34-8290-cc0d445c50fd" status: 200 len: 1323 microversion: 2.1 time: 0.616057 Aug 31 15:57:26.867858 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1068/2046] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:26 2022] GET /compute/v2.1/servers/c5de4f8b-332b-4e34-8290-cc0d445c50fd => generated 1323 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:26.873384 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4e1b935b-ab54-4d79-997f-4c1708522149 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:26.878722 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4e1b935b-ab54-4d79-997f-4c1708522149 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] [instance: 862e1521-739f-47c0-a7e0-2bd017e5f738] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:26.897782 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4e1b935b-ab54-4d79-997f-4c1708522149 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:26.898651 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4e1b935b-ab54-4d79-997f-4c1708522149 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:26.900569 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4e1b935b-ab54-4d79-997f-4c1708522149 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:26.901603 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4e1b935b-ab54-4d79-997f-4c1708522149 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:26.902636 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4e1b935b-ab54-4d79-997f-4c1708522149 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:26.903235 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4e1b935b-ab54-4d79-997f-4c1708522149 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:26.974020 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-97c8966d-b7a2-4ada-87ea-6011d5851f64 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922a671cad44ea595e46290a5d52380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1371996a8304dc58ee579daa535bcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:26.989301 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-97c8966d-b7a2-4ada-87ea-6011d5851f64 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/a9448c8e-c801-4d08-b1c1-b34f279269e6" status: 200 len: 1218 microversion: 2.1 time: 0.229476 Aug 31 15:57:27.009994 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 979/2047] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:26 2022] GET /compute/v2.1/servers/a9448c8e-c801-4d08-b1c1-b34f279269e6 => generated 1218 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:27.015442 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-14baca98-93b2-4e17-86d8-e366119f1f39 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:27.016409 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-14baca98-93b2-4e17-86d8-e366119f1f39 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: f044dca7-71de-4182-b5ec-825299496c10] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:27.024023 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14baca98-93b2-4e17-86d8-e366119f1f39 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:27.024769 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14baca98-93b2-4e17-86d8-e366119f1f39 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:27.025435 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14baca98-93b2-4e17-86d8-e366119f1f39 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:27.026331 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14baca98-93b2-4e17-86d8-e366119f1f39 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:27.027038 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14baca98-93b2-4e17-86d8-e366119f1f39 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:27.027817 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14baca98-93b2-4e17-86d8-e366119f1f39 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:27.152557 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-14baca98-93b2-4e17-86d8-e366119f1f39 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lazy-loading 'flavor' on Instance uuid f044dca7-71de-4182-b5ec-825299496c10 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:57:27.764361 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4e1b935b-ab54-4d79-997f-4c1708522149 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba08a4705f4f0a9bc6a01d16a5f607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055586a03b0a4c1989b3ac658ac6347c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:27.780257 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4e1b935b-ab54-4d79-997f-4c1708522149 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] 10.222.0.50 "GET /compute/v2.1/servers/862e1521-739f-47c0-a7e0-2bd017e5f738" status: 200 len: 1318 microversion: 2.1 time: 0.910605 Aug 31 15:57:27.780860 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1069/2048] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:26 2022] GET /compute/v2.1/servers/862e1521-739f-47c0-a7e0-2bd017e5f738 => generated 1318 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:27.809099 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4eeb26f3-eb70-41db-b871-e43eb7fa87c7 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:27.809724 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4eeb26f3-eb70-41db-b871-e43eb7fa87c7 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: 434ee39d-6510-411f-93e1-0500c19fb312] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:27.810056 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-14baca98-93b2-4e17-86d8-e366119f1f39 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "POST /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10/action" status: 202 len: 0 microversion: 2.1 time: 0.797963 Aug 31 15:57:27.812539 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 980/2049] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 15:57:27 2022] POST /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10/action => generated 0 bytes in 802 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:57:27.822476 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4eeb26f3-eb70-41db-b871-e43eb7fa87c7 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:27.822975 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4eeb26f3-eb70-41db-b871-e43eb7fa87c7 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:27.823409 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4eeb26f3-eb70-41db-b871-e43eb7fa87c7 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:27.824115 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4eeb26f3-eb70-41db-b871-e43eb7fa87c7 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:27.824583 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4eeb26f3-eb70-41db-b871-e43eb7fa87c7 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:27.824990 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4eeb26f3-eb70-41db-b871-e43eb7fa87c7 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:27.827029 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-302ba0e3-12c5-440a-8e5e-f4c187eb7f20 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:27.828923 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-302ba0e3-12c5-440a-8e5e-f4c187eb7f20 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 548e0225-fa26-46ba-9c12-7b52feee1784] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:27.876192 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-302ba0e3-12c5-440a-8e5e-f4c187eb7f20 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:27.879566 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-302ba0e3-12c5-440a-8e5e-f4c187eb7f20 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:27.881655 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-302ba0e3-12c5-440a-8e5e-f4c187eb7f20 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:27.895240 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-302ba0e3-12c5-440a-8e5e-f4c187eb7f20 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:27.896227 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-302ba0e3-12c5-440a-8e5e-f4c187eb7f20 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:27.896908 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-302ba0e3-12c5-440a-8e5e-f4c187eb7f20 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:28.323799 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4eeb26f3-eb70-41db-b871-e43eb7fa87c7 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:28.348356 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4eeb26f3-eb70-41db-b871-e43eb7fa87c7 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/434ee39d-6510-411f-93e1-0500c19fb312" status: 200 len: 1307 microversion: 2.1 time: 0.551775 Aug 31 15:57:28.350326 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1070/2050] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:27 2022] GET /compute/v2.1/servers/434ee39d-6510-411f-93e1-0500c19fb312 => generated 1307 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:28.355429 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ebccaccc-6bec-4731-934b-0be88528e93e tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:28.356278 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ebccaccc-6bec-4731-934b-0be88528e93e tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: f044dca7-71de-4182-b5ec-825299496c10] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:28.364644 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ebccaccc-6bec-4731-934b-0be88528e93e tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:28.365211 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ebccaccc-6bec-4731-934b-0be88528e93e tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:28.365739 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ebccaccc-6bec-4731-934b-0be88528e93e tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:28.366487 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ebccaccc-6bec-4731-934b-0be88528e93e tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:28.367085 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ebccaccc-6bec-4731-934b-0be88528e93e tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:28.367710 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ebccaccc-6bec-4731-934b-0be88528e93e tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:28.764842 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-302ba0e3-12c5-440a-8e5e-f4c187eb7f20 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:28.781172 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-302ba0e3-12c5-440a-8e5e-f4c187eb7f20 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:28.783848 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-302ba0e3-12c5-440a-8e5e-f4c187eb7f20 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:28.785209 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-302ba0e3-12c5-440a-8e5e-f4c187eb7f20 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784" status: 200 len: 1281 microversion: 2.25 time: 0.964926 Aug 31 15:57:28.786795 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 981/2051] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:27 2022] GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784 => generated 1281 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:28.793246 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3e8b9acf-ed9a-411c-9aea-61e749bada2c tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:28.796163 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3e8b9acf-ed9a-411c-9aea-61e749bada2c tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] [instance: c5de4f8b-332b-4e34-8290-cc0d445c50fd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:28.803426 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e8b9acf-ed9a-411c-9aea-61e749bada2c tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:28.804397 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e8b9acf-ed9a-411c-9aea-61e749bada2c tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:28.805088 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e8b9acf-ed9a-411c-9aea-61e749bada2c tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:28.806558 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e8b9acf-ed9a-411c-9aea-61e749bada2c tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:28.807420 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e8b9acf-ed9a-411c-9aea-61e749bada2c tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:28.808305 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e8b9acf-ed9a-411c-9aea-61e749bada2c tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:29.343753 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ebccaccc-6bec-4731-934b-0be88528e93e tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:29.361080 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ebccaccc-6bec-4731-934b-0be88528e93e tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10" status: 200 len: 1506 microversion: 2.1 time: 1.003280 Aug 31 15:57:29.363208 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1071/2052] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:28 2022] GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10 => generated 1506 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:29.374795 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4daba9f7-4edc-4a57-aea5-f56f204ae533 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:29.387995 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4daba9f7-4edc-4a57-aea5-f56f204ae533 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: a9448c8e-c801-4d08-b1c1-b34f279269e6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:29.406668 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:57:29.413903 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4daba9f7-4edc-4a57-aea5-f56f204ae533 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:29.415525 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4daba9f7-4edc-4a57-aea5-f56f204ae533 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:29.416754 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4daba9f7-4edc-4a57-aea5-f56f204ae533 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:29.417730 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4daba9f7-4edc-4a57-aea5-f56f204ae533 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:29.418409 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4daba9f7-4edc-4a57-aea5-f56f204ae533 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:29.419092 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4daba9f7-4edc-4a57-aea5-f56f204ae533 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:29.597962 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4daba9f7-4edc-4a57-aea5-f56f204ae533 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922a671cad44ea595e46290a5d52380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1371996a8304dc58ee579daa535bcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:29.603374 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3e8b9acf-ed9a-411c-9aea-61e749bada2c tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1221b21792476baf26260db2bdbe93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f324e55d67b4764b183f7e85e206cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:29.631665 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4daba9f7-4edc-4a57-aea5-f56f204ae533 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/a9448c8e-c801-4d08-b1c1-b34f279269e6" status: 200 len: 1272 microversion: 2.1 time: 0.261521 Aug 31 15:57:29.632733 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1072/2053] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:29 2022] GET /compute/v2.1/servers/a9448c8e-c801-4d08-b1c1-b34f279269e6 => generated 1272 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:29.633304 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3e8b9acf-ed9a-411c-9aea-61e749bada2c tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] 10.222.0.50 "GET /compute/v2.1/servers/c5de4f8b-332b-4e34-8290-cc0d445c50fd" status: 200 len: 1323 microversion: 2.1 time: 0.844663 Aug 31 15:57:29.634492 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 982/2054] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:28 2022] GET /compute/v2.1/servers/c5de4f8b-332b-4e34-8290-cc0d445c50fd => generated 1323 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:29.647911 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6b947b5e-1429-4487-be3a-ef80c313f492 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:29.651877 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-9a2b241d-d66d-4335-ae07-c68830546a71 req-a843fa02-c65b-4f62-9db2-c6f4039dee76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "434ee39d-6510-411f-93e1-0500c19fb312", "tag": "5109e7a2-31db-42fd-b192-796f0b872104"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:29.655161 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6b947b5e-1429-4487-be3a-ef80c313f492 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] [instance: 862e1521-739f-47c0-a7e0-2bd017e5f738] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:29.663714 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6b947b5e-1429-4487-be3a-ef80c313f492 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:29.664205 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6b947b5e-1429-4487-be3a-ef80c313f492 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:29.666860 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6b947b5e-1429-4487-be3a-ef80c313f492 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:29.667798 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6b947b5e-1429-4487-be3a-ef80c313f492 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:29.669020 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6b947b5e-1429-4487-be3a-ef80c313f492 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:29.670309 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9a2b241d-d66d-4335-ae07-c68830546a71 req-a843fa02-c65b-4f62-9db2-c6f4039dee76 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:29.670945 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9a2b241d-d66d-4335-ae07-c68830546a71 req-a843fa02-c65b-4f62-9db2-c6f4039dee76 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:29.671250 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6b947b5e-1429-4487-be3a-ef80c313f492 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:29.672010 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9a2b241d-d66d-4335-ae07-c68830546a71 req-a843fa02-c65b-4f62-9db2-c6f4039dee76 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:29.708154 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-9a2b241d-d66d-4335-ae07-c68830546a71 req-a843fa02-c65b-4f62-9db2-c6f4039dee76 service nova] Creating event network-changed:5109e7a2-31db-42fd-b192-796f0b872104 for instance 434ee39d-6510-411f-93e1-0500c19fb312 on n-h1-833090-16 Aug 31 15:57:29.721453 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-9a2b241d-d66d-4335-ae07-c68830546a71 req-a843fa02-c65b-4f62-9db2-c6f4039dee76 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082726 Aug 31 15:57:29.724251 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 983/2055] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:29.736050 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5cae7a4b-4b52-46ef-96e5-d5aa65a2d293 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:29.737453 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5cae7a4b-4b52-46ef-96e5-d5aa65a2d293 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: 434ee39d-6510-411f-93e1-0500c19fb312] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:29.746977 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5cae7a4b-4b52-46ef-96e5-d5aa65a2d293 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:29.748192 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5cae7a4b-4b52-46ef-96e5-d5aa65a2d293 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:29.748787 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5cae7a4b-4b52-46ef-96e5-d5aa65a2d293 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:29.749877 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5cae7a4b-4b52-46ef-96e5-d5aa65a2d293 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:29.751122 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5cae7a4b-4b52-46ef-96e5-d5aa65a2d293 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:29.751954 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5cae7a4b-4b52-46ef-96e5-d5aa65a2d293 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:30.038152 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6b947b5e-1429-4487-be3a-ef80c313f492 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba08a4705f4f0a9bc6a01d16a5f607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055586a03b0a4c1989b3ac658ac6347c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:30.047015 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6b947b5e-1429-4487-be3a-ef80c313f492 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] 10.222.0.50 "GET /compute/v2.1/servers/862e1521-739f-47c0-a7e0-2bd017e5f738" status: 200 len: 1318 microversion: 2.1 time: 0.412996 Aug 31 15:57:30.053672 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1073/2056] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:29 2022] GET /compute/v2.1/servers/862e1521-739f-47c0-a7e0-2bd017e5f738 => generated 1318 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:30.059335 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-ada550fa-63bd-4970-a7fe-05048b8334cb req-a482d23c-557c-461a-85d0-58c8f748dde0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "548e0225-fa26-46ba-9c12-7b52feee1784", "name": "network-vif-plugged", "status": "completed", "tag": "da0ce8b3-d23a-4835-87ba-6b9636776b31"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:30.077905 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-ada550fa-63bd-4970-a7fe-05048b8334cb req-a482d23c-557c-461a-85d0-58c8f748dde0 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:30.078435 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-ada550fa-63bd-4970-a7fe-05048b8334cb req-a482d23c-557c-461a-85d0-58c8f748dde0 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:30.078855 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-ada550fa-63bd-4970-a7fe-05048b8334cb req-a482d23c-557c-461a-85d0-58c8f748dde0 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:30.097595 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5cae7a4b-4b52-46ef-96e5-d5aa65a2d293 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:30.099348 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-ada550fa-63bd-4970-a7fe-05048b8334cb req-a482d23c-557c-461a-85d0-58c8f748dde0 service nova] Creating event network-vif-plugged:da0ce8b3-d23a-4835-87ba-6b9636776b31 for instance 548e0225-fa26-46ba-9c12-7b52feee1784 on n-h2-833090-16 Aug 31 15:57:30.106358 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5cae7a4b-4b52-46ef-96e5-d5aa65a2d293 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/434ee39d-6510-411f-93e1-0500c19fb312" status: 200 len: 1307 microversion: 2.1 time: 0.378611 Aug 31 15:57:30.107076 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-ada550fa-63bd-4970-a7fe-05048b8334cb req-a482d23c-557c-461a-85d0-58c8f748dde0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051466 Aug 31 15:57:30.108125 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1074/2057] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:30.113943 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ec4b965f-b6c6-4224-b9c0-1b20dd130a79 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:30.114924 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ec4b965f-b6c6-4224-b9c0-1b20dd130a79 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 548e0225-fa26-46ba-9c12-7b52feee1784] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:30.121572 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 984/2058] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:29 2022] GET /compute/v2.1/servers/434ee39d-6510-411f-93e1-0500c19fb312 => generated 1307 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:30.124042 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ec4b965f-b6c6-4224-b9c0-1b20dd130a79 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:30.124524 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ec4b965f-b6c6-4224-b9c0-1b20dd130a79 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:30.124956 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ec4b965f-b6c6-4224-b9c0-1b20dd130a79 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:30.125650 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ec4b965f-b6c6-4224-b9c0-1b20dd130a79 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:30.126280 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ec4b965f-b6c6-4224-b9c0-1b20dd130a79 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:30.126737 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ec4b965f-b6c6-4224-b9c0-1b20dd130a79 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:30.352394 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ec4b965f-b6c6-4224-b9c0-1b20dd130a79 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:30.368099 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ec4b965f-b6c6-4224-b9c0-1b20dd130a79 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:30.370082 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ec4b965f-b6c6-4224-b9c0-1b20dd130a79 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:30.371524 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ec4b965f-b6c6-4224-b9c0-1b20dd130a79 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784" status: 200 len: 1281 microversion: 2.25 time: 0.262315 Aug 31 15:57:30.374166 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1075/2059] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:30 2022] GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784 => generated 1281 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:30.391463 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-37f9fe32-c099-4e75-aa35-213ba92dfac9 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:30.392065 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-37f9fe32-c099-4e75-aa35-213ba92dfac9 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: f044dca7-71de-4182-b5ec-825299496c10] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:30.398139 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37f9fe32-c099-4e75-aa35-213ba92dfac9 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:30.398643 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37f9fe32-c099-4e75-aa35-213ba92dfac9 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:30.399045 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37f9fe32-c099-4e75-aa35-213ba92dfac9 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:30.399918 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37f9fe32-c099-4e75-aa35-213ba92dfac9 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:30.400366 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37f9fe32-c099-4e75-aa35-213ba92dfac9 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:30.400844 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37f9fe32-c099-4e75-aa35-213ba92dfac9 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:30.576647 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-37f9fe32-c099-4e75-aa35-213ba92dfac9 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:30.587273 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-37f9fe32-c099-4e75-aa35-213ba92dfac9 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10" status: 200 len: 1506 microversion: 2.1 time: 0.199238 Aug 31 15:57:30.588012 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 985/2060] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:30 2022] GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10 => generated 1506 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:30.655812 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-144a2047-69f0-4528-bc06-75adc9bf77cf tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:30.656469 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-144a2047-69f0-4528-bc06-75adc9bf77cf tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] [instance: c5de4f8b-332b-4e34-8290-cc0d445c50fd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:30.661131 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-434dc4b9-d8d2-4e1e-a0fb-df22681ddd3f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:30.661741 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-434dc4b9-d8d2-4e1e-a0fb-df22681ddd3f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: a9448c8e-c801-4d08-b1c1-b34f279269e6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:30.664172 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-144a2047-69f0-4528-bc06-75adc9bf77cf tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:30.664672 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-144a2047-69f0-4528-bc06-75adc9bf77cf tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:30.665107 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-144a2047-69f0-4528-bc06-75adc9bf77cf tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:30.665811 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-144a2047-69f0-4528-bc06-75adc9bf77cf tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:30.666484 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-144a2047-69f0-4528-bc06-75adc9bf77cf tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:30.666975 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-144a2047-69f0-4528-bc06-75adc9bf77cf tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:30.670106 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-434dc4b9-d8d2-4e1e-a0fb-df22681ddd3f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:30.671088 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-434dc4b9-d8d2-4e1e-a0fb-df22681ddd3f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:30.671730 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-434dc4b9-d8d2-4e1e-a0fb-df22681ddd3f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:30.672631 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-434dc4b9-d8d2-4e1e-a0fb-df22681ddd3f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:30.673142 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-434dc4b9-d8d2-4e1e-a0fb-df22681ddd3f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:30.673765 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-434dc4b9-d8d2-4e1e-a0fb-df22681ddd3f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:30.926419 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-434dc4b9-d8d2-4e1e-a0fb-df22681ddd3f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922a671cad44ea595e46290a5d52380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1371996a8304dc58ee579daa535bcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:30.928238 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-144a2047-69f0-4528-bc06-75adc9bf77cf tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1221b21792476baf26260db2bdbe93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f324e55d67b4764b183f7e85e206cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:30.937770 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-144a2047-69f0-4528-bc06-75adc9bf77cf tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] 10.222.0.50 "GET /compute/v2.1/servers/c5de4f8b-332b-4e34-8290-cc0d445c50fd" status: 200 len: 1323 microversion: 2.1 time: 0.286674 Aug 31 15:57:30.938616 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1076/2061] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:30 2022] GET /compute/v2.1/servers/c5de4f8b-332b-4e34-8290-cc0d445c50fd => generated 1323 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:30.958279 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-434dc4b9-d8d2-4e1e-a0fb-df22681ddd3f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/a9448c8e-c801-4d08-b1c1-b34f279269e6" status: 200 len: 1314 microversion: 2.1 time: 0.304099 Aug 31 15:57:30.958814 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 986/2062] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:30 2022] GET /compute/v2.1/servers/a9448c8e-c801-4d08-b1c1-b34f279269e6 => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:31.079001 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d30bc08b-2546-4a35-81c1-feed5484b01a tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:31.079001 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d30bc08b-2546-4a35-81c1-feed5484b01a tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] [instance: 862e1521-739f-47c0-a7e0-2bd017e5f738] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:31.088424 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d30bc08b-2546-4a35-81c1-feed5484b01a tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:31.089301 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d30bc08b-2546-4a35-81c1-feed5484b01a tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:31.089948 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d30bc08b-2546-4a35-81c1-feed5484b01a tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:31.091913 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d30bc08b-2546-4a35-81c1-feed5484b01a tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:31.092602 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d30bc08b-2546-4a35-81c1-feed5484b01a tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:31.093230 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d30bc08b-2546-4a35-81c1-feed5484b01a tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:31.133774 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9495b882-d12b-42e8-aafe-503212b2332e tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:31.134675 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9495b882-d12b-42e8-aafe-503212b2332e tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: 434ee39d-6510-411f-93e1-0500c19fb312] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:31.157408 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9495b882-d12b-42e8-aafe-503212b2332e tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:31.158842 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9495b882-d12b-42e8-aafe-503212b2332e tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:31.159481 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9495b882-d12b-42e8-aafe-503212b2332e tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:31.160572 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9495b882-d12b-42e8-aafe-503212b2332e tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:31.161901 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9495b882-d12b-42e8-aafe-503212b2332e tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:31.163251 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9495b882-d12b-42e8-aafe-503212b2332e tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:31.505340 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d30bc08b-2546-4a35-81c1-feed5484b01a tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba08a4705f4f0a9bc6a01d16a5f607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055586a03b0a4c1989b3ac658ac6347c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:31.514400 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9495b882-d12b-42e8-aafe-503212b2332e tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:31.518583 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d30bc08b-2546-4a35-81c1-feed5484b01a tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] 10.222.0.50 "GET /compute/v2.1/servers/862e1521-739f-47c0-a7e0-2bd017e5f738" status: 200 len: 1318 microversion: 2.1 time: 0.445437 Aug 31 15:57:31.520332 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1077/2063] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:31 2022] GET /compute/v2.1/servers/862e1521-739f-47c0-a7e0-2bd017e5f738 => generated 1318 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:31.525770 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-67c7b04d-9664-4d84-9d61-fbecfb616e50 req-c0aec129-f459-4286-b0cd-14233ae219a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9448c8e-c801-4d08-b1c1-b34f279269e6", "tag": "2099a852-2512-4fb9-8fa5-c0420a4477eb"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:31.534184 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9495b882-d12b-42e8-aafe-503212b2332e tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/434ee39d-6510-411f-93e1-0500c19fb312" status: 200 len: 1307 microversion: 2.1 time: 0.408202 Aug 31 15:57:31.535341 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 987/2064] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:31 2022] GET /compute/v2.1/servers/434ee39d-6510-411f-93e1-0500c19fb312 => generated 1307 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:57:31.536454 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-67c7b04d-9664-4d84-9d61-fbecfb616e50 req-c0aec129-f459-4286-b0cd-14233ae219a7 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:31.537274 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-67c7b04d-9664-4d84-9d61-fbecfb616e50 req-c0aec129-f459-4286-b0cd-14233ae219a7 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:31.538225 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-67c7b04d-9664-4d84-9d61-fbecfb616e50 req-c0aec129-f459-4286-b0cd-14233ae219a7 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:31.540332 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e84d13df-cdc2-47ef-b661-f44fb63ce0f4 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:31.541213 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e84d13df-cdc2-47ef-b661-f44fb63ce0f4 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 548e0225-fa26-46ba-9c12-7b52feee1784] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:31.559692 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e84d13df-cdc2-47ef-b661-f44fb63ce0f4 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:31.560166 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e84d13df-cdc2-47ef-b661-f44fb63ce0f4 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:31.560621 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e84d13df-cdc2-47ef-b661-f44fb63ce0f4 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:31.561327 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e84d13df-cdc2-47ef-b661-f44fb63ce0f4 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:31.561746 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e84d13df-cdc2-47ef-b661-f44fb63ce0f4 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:31.562042 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-67c7b04d-9664-4d84-9d61-fbecfb616e50 req-c0aec129-f459-4286-b0cd-14233ae219a7 service nova] Creating event network-changed:2099a852-2512-4fb9-8fa5-c0420a4477eb for instance a9448c8e-c801-4d08-b1c1-b34f279269e6 on n-h2-833090-16 Aug 31 15:57:31.563192 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e84d13df-cdc2-47ef-b661-f44fb63ce0f4 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:31.572108 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-67c7b04d-9664-4d84-9d61-fbecfb616e50 req-c0aec129-f459-4286-b0cd-14233ae219a7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050302 Aug 31 15:57:31.573342 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1078/2065] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:31.609437 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-37626fbf-b453-4cea-a447-2ee0bbb1856f tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:31.610432 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-37626fbf-b453-4cea-a447-2ee0bbb1856f tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: f044dca7-71de-4182-b5ec-825299496c10] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:31.635238 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-37626fbf-b453-4cea-a447-2ee0bbb1856f tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:31.635752 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-37626fbf-b453-4cea-a447-2ee0bbb1856f tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:31.636191 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-37626fbf-b453-4cea-a447-2ee0bbb1856f tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:31.636909 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-37626fbf-b453-4cea-a447-2ee0bbb1856f tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:31.637522 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-37626fbf-b453-4cea-a447-2ee0bbb1856f tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:31.642290 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-37626fbf-b453-4cea-a447-2ee0bbb1856f tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:32.046628 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e84d13df-cdc2-47ef-b661-f44fb63ce0f4 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:32.061643 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e84d13df-cdc2-47ef-b661-f44fb63ce0f4 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:32.066248 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e84d13df-cdc2-47ef-b661-f44fb63ce0f4 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:32.073143 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e84d13df-cdc2-47ef-b661-f44fb63ce0f4 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784" status: 200 len: 1281 microversion: 2.25 time: 0.536521 Aug 31 15:57:32.074411 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 988/2066] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:31 2022] GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784 => generated 1281 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:32.085898 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0cb516ab-31ae-471a-9c40-176b693b0579 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:32.086849 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0cb516ab-31ae-471a-9c40-176b693b0579 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] [instance: c5de4f8b-332b-4e34-8290-cc0d445c50fd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:32.104817 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:57:32.120023 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-37626fbf-b453-4cea-a447-2ee0bbb1856f tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:32.123633 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=100 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:57:32.124512 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0cb516ab-31ae-471a-9c40-176b693b0579 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:32.129793 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0cb516ab-31ae-471a-9c40-176b693b0579 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:32.132472 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0cb516ab-31ae-471a-9c40-176b693b0579 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:32.136727 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0cb516ab-31ae-471a-9c40-176b693b0579 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:32.137556 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0cb516ab-31ae-471a-9c40-176b693b0579 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:32.141893 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-37626fbf-b453-4cea-a447-2ee0bbb1856f tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10" status: 200 len: 1506 microversion: 2.1 time: 0.537100 Aug 31 15:57:32.143952 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0cb516ab-31ae-471a-9c40-176b693b0579 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:32.158462 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1079/2067] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:31 2022] GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10 => generated 1506 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:57:32.191061 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-062d53a8-0785-47e1-aaa8-498253f20342 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:32.191832 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-062d53a8-0785-47e1-aaa8-498253f20342 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: a9448c8e-c801-4d08-b1c1-b34f279269e6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:32.208651 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-062d53a8-0785-47e1-aaa8-498253f20342 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:32.209338 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-062d53a8-0785-47e1-aaa8-498253f20342 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:32.210004 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-062d53a8-0785-47e1-aaa8-498253f20342 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:32.211091 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-062d53a8-0785-47e1-aaa8-498253f20342 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:32.211724 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-062d53a8-0785-47e1-aaa8-498253f20342 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:32.212627 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-062d53a8-0785-47e1-aaa8-498253f20342 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:32.517801 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-062d53a8-0785-47e1-aaa8-498253f20342 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922a671cad44ea595e46290a5d52380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1371996a8304dc58ee579daa535bcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:32.525923 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0cb516ab-31ae-471a-9c40-176b693b0579 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1221b21792476baf26260db2bdbe93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f324e55d67b4764b183f7e85e206cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:32.527746 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-062d53a8-0785-47e1-aaa8-498253f20342 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/a9448c8e-c801-4d08-b1c1-b34f279269e6" status: 200 len: 1314 microversion: 2.1 time: 0.362635 Aug 31 15:57:32.531520 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1080/2068] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:32 2022] GET /compute/v2.1/servers/a9448c8e-c801-4d08-b1c1-b34f279269e6 => generated 1314 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:32.538149 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0cb516ab-31ae-471a-9c40-176b693b0579 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] 10.222.0.50 "GET /compute/v2.1/servers/c5de4f8b-332b-4e34-8290-cc0d445c50fd" status: 200 len: 1323 microversion: 2.1 time: 0.462172 Aug 31 15:57:32.539445 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 989/2069] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:32 2022] GET /compute/v2.1/servers/c5de4f8b-332b-4e34-8290-cc0d445c50fd => generated 1323 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:32.541225 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-9c81872e-72d2-4099-95bf-b3db7242491e req-ef0798f4-6f3c-4dbb-b5c9-4be742a24b62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "862e1521-739f-47c0-a7e0-2bd017e5f738", "name": "network-vif-plugged", "status": "completed", "tag": "02873cd3-826b-444d-b633-baeaea646877"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:32.546054 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cc9cd536-ec54-472c-a50f-432ec4c17158 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:32.546720 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cc9cd536-ec54-472c-a50f-432ec4c17158 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] [instance: 862e1521-739f-47c0-a7e0-2bd017e5f738] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:32.558427 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cc9cd536-ec54-472c-a50f-432ec4c17158 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:32.559274 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cc9cd536-ec54-472c-a50f-432ec4c17158 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:32.560674 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cc9cd536-ec54-472c-a50f-432ec4c17158 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:32.561869 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cc9cd536-ec54-472c-a50f-432ec4c17158 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:32.562870 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cc9cd536-ec54-472c-a50f-432ec4c17158 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:32.563565 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cc9cd536-ec54-472c-a50f-432ec4c17158 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:32.565875 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-9c81872e-72d2-4099-95bf-b3db7242491e req-ef0798f4-6f3c-4dbb-b5c9-4be742a24b62 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:32.566379 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-9c81872e-72d2-4099-95bf-b3db7242491e req-ef0798f4-6f3c-4dbb-b5c9-4be742a24b62 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:32.566808 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-9c81872e-72d2-4099-95bf-b3db7242491e req-ef0798f4-6f3c-4dbb-b5c9-4be742a24b62 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:32.595271 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-9c81872e-72d2-4099-95bf-b3db7242491e req-ef0798f4-6f3c-4dbb-b5c9-4be742a24b62 service nova] Creating event network-vif-plugged:02873cd3-826b-444d-b633-baeaea646877 for instance 862e1521-739f-47c0-a7e0-2bd017e5f738 on n-h1-833090-16 Aug 31 15:57:32.618490 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-9c81872e-72d2-4099-95bf-b3db7242491e req-ef0798f4-6f3c-4dbb-b5c9-4be742a24b62 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085224 Aug 31 15:57:32.625956 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1081/2070] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:32.635832 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1da0dd62-2209-448b-9bf3-3d15a92c3dc9 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:32.636546 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1da0dd62-2209-448b-9bf3-3d15a92c3dc9 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: 434ee39d-6510-411f-93e1-0500c19fb312] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:32.649126 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1da0dd62-2209-448b-9bf3-3d15a92c3dc9 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:32.649879 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1da0dd62-2209-448b-9bf3-3d15a92c3dc9 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:32.650500 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1da0dd62-2209-448b-9bf3-3d15a92c3dc9 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:32.651355 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1da0dd62-2209-448b-9bf3-3d15a92c3dc9 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:32.652062 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1da0dd62-2209-448b-9bf3-3d15a92c3dc9 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:32.652634 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1da0dd62-2209-448b-9bf3-3d15a92c3dc9 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:32.940186 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cc9cd536-ec54-472c-a50f-432ec4c17158 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba08a4705f4f0a9bc6a01d16a5f607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055586a03b0a4c1989b3ac658ac6347c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:32.952761 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cc9cd536-ec54-472c-a50f-432ec4c17158 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] 10.222.0.50 "GET /compute/v2.1/servers/862e1521-739f-47c0-a7e0-2bd017e5f738" status: 200 len: 1318 microversion: 2.1 time: 0.411794 Aug 31 15:57:32.953430 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 990/2071] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:32 2022] GET /compute/v2.1/servers/862e1521-739f-47c0-a7e0-2bd017e5f738 => generated 1318 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:33.006523 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1da0dd62-2209-448b-9bf3-3d15a92c3dc9 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:33.016516 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1da0dd62-2209-448b-9bf3-3d15a92c3dc9 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/434ee39d-6510-411f-93e1-0500c19fb312" status: 200 len: 1307 microversion: 2.1 time: 0.388968 Aug 31 15:57:33.017056 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1082/2072] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:32 2022] GET /compute/v2.1/servers/434ee39d-6510-411f-93e1-0500c19fb312 => generated 1307 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:33.098564 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-188de316-7d80-40a2-b2a0-c96da1eaee11 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:33.099288 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-188de316-7d80-40a2-b2a0-c96da1eaee11 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 548e0225-fa26-46ba-9c12-7b52feee1784] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:33.105786 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-188de316-7d80-40a2-b2a0-c96da1eaee11 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:33.106317 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-188de316-7d80-40a2-b2a0-c96da1eaee11 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:33.106744 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-188de316-7d80-40a2-b2a0-c96da1eaee11 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:33.107435 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-188de316-7d80-40a2-b2a0-c96da1eaee11 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:33.108081 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-188de316-7d80-40a2-b2a0-c96da1eaee11 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:33.108490 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-188de316-7d80-40a2-b2a0-c96da1eaee11 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:33.171117 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-56b4eb75-b3fe-4083-8528-656c7a5ce894 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:33.172410 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-56b4eb75-b3fe-4083-8528-656c7a5ce894 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: f044dca7-71de-4182-b5ec-825299496c10] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:33.180082 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-56b4eb75-b3fe-4083-8528-656c7a5ce894 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:33.180897 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-56b4eb75-b3fe-4083-8528-656c7a5ce894 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:33.181504 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-56b4eb75-b3fe-4083-8528-656c7a5ce894 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:33.182806 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-56b4eb75-b3fe-4083-8528-656c7a5ce894 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:33.183800 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-56b4eb75-b3fe-4083-8528-656c7a5ce894 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:33.184515 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-56b4eb75-b3fe-4083-8528-656c7a5ce894 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:33.311154 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-188de316-7d80-40a2-b2a0-c96da1eaee11 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:33.321445 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-188de316-7d80-40a2-b2a0-c96da1eaee11 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:33.324701 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-188de316-7d80-40a2-b2a0-c96da1eaee11 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:33.327601 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-188de316-7d80-40a2-b2a0-c96da1eaee11 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784" status: 200 len: 1476 microversion: 2.25 time: 0.232316 Aug 31 15:57:33.328971 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 991/2073] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:33 2022] GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784 => generated 1476 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:33.351406 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-636be10b-802b-493a-bfd1-bfc76c3e25b0 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:33.352414 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-636be10b-802b-493a-bfd1-bfc76c3e25b0 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] [instance: 548e0225-fa26-46ba-9c12-7b52feee1784] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:33.360395 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-636be10b-802b-493a-bfd1-bfc76c3e25b0 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:33.361274 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-636be10b-802b-493a-bfd1-bfc76c3e25b0 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:33.361923 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-636be10b-802b-493a-bfd1-bfc76c3e25b0 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:33.362968 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-636be10b-802b-493a-bfd1-bfc76c3e25b0 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:33.363780 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-636be10b-802b-493a-bfd1-bfc76c3e25b0 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:33.364401 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-636be10b-802b-493a-bfd1-bfc76c3e25b0 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:33.599100 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-636be10b-802b-493a-bfd1-bfc76c3e25b0 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lazy-loading 'services' on Instance uuid 548e0225-fa26-46ba-9c12-7b52feee1784 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:57:33.618674 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-636be10b-802b-493a-bfd1-bfc76c3e25b0 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784" status: 200 len: 1971 microversion: 2.25 time: 0.271035 Aug 31 15:57:33.619926 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 992/2074] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:33 2022] GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784 => generated 1971 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:33.625549 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f89eeda0-3601-4443-abd1-3ebfa09bdfb1 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:33.626474 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f89eeda0-3601-4443-abd1-3ebfa09bdfb1 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: a9448c8e-c801-4d08-b1c1-b34f279269e6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:33.633441 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-56b4eb75-b3fe-4083-8528-656c7a5ce894 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:33.635170 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f89eeda0-3601-4443-abd1-3ebfa09bdfb1 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:33.636125 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f89eeda0-3601-4443-abd1-3ebfa09bdfb1 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:33.636769 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f89eeda0-3601-4443-abd1-3ebfa09bdfb1 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:33.638465 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f89eeda0-3601-4443-abd1-3ebfa09bdfb1 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:33.639131 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f89eeda0-3601-4443-abd1-3ebfa09bdfb1 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:33.639753 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f89eeda0-3601-4443-abd1-3ebfa09bdfb1 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:33.643795 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-56b4eb75-b3fe-4083-8528-656c7a5ce894 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10" status: 200 len: 1506 microversion: 2.1 time: 0.476372 Aug 31 15:57:33.645118 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1083/2075] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:33 2022] GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10 => generated 1506 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:57:33.650211 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5cf2bbae-85ea-4ce2-9e68-8fd23165cb5e tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:33.651379 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5cf2bbae-85ea-4ce2-9e68-8fd23165cb5e tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] [instance: c5de4f8b-332b-4e34-8290-cc0d445c50fd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:33.658561 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5cf2bbae-85ea-4ce2-9e68-8fd23165cb5e tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:33.659140 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5cf2bbae-85ea-4ce2-9e68-8fd23165cb5e tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:33.659574 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5cf2bbae-85ea-4ce2-9e68-8fd23165cb5e tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:33.660334 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5cf2bbae-85ea-4ce2-9e68-8fd23165cb5e tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:33.660926 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5cf2bbae-85ea-4ce2-9e68-8fd23165cb5e tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:33.661816 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5cf2bbae-85ea-4ce2-9e68-8fd23165cb5e tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:33.883580 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5cf2bbae-85ea-4ce2-9e68-8fd23165cb5e tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1221b21792476baf26260db2bdbe93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f324e55d67b4764b183f7e85e206cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:33.888478 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f89eeda0-3601-4443-abd1-3ebfa09bdfb1 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922a671cad44ea595e46290a5d52380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1371996a8304dc58ee579daa535bcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:33.892193 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5cf2bbae-85ea-4ce2-9e68-8fd23165cb5e tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] 10.222.0.50 "GET /compute/v2.1/servers/c5de4f8b-332b-4e34-8290-cc0d445c50fd" status: 200 len: 1323 microversion: 2.1 time: 0.245882 Aug 31 15:57:33.892676 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:57:33.902492 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f89eeda0-3601-4443-abd1-3ebfa09bdfb1 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/a9448c8e-c801-4d08-b1c1-b34f279269e6" status: 200 len: 1314 microversion: 2.1 time: 0.281120 Aug 31 15:57:33.917407 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1084/2076] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:33 2022] GET /compute/v2.1/servers/c5de4f8b-332b-4e34-8290-cc0d445c50fd => generated 1323 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:33.918231 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 993/2077] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:33 2022] GET /compute/v2.1/servers/a9448c8e-c801-4d08-b1c1-b34f279269e6 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:33.922568 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6a7d26a5-7828-45a6-9c71-0462e2f533d6 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:33.923272 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6a7d26a5-7828-45a6-9c71-0462e2f533d6 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] [instance: 548e0225-fa26-46ba-9c12-7b52feee1784] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:33.929818 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6a7d26a5-7828-45a6-9c71-0462e2f533d6 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:33.930424 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6a7d26a5-7828-45a6-9c71-0462e2f533d6 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:33.930925 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6a7d26a5-7828-45a6-9c71-0462e2f533d6 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:33.931688 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6a7d26a5-7828-45a6-9c71-0462e2f533d6 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:33.932205 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6a7d26a5-7828-45a6-9c71-0462e2f533d6 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:33.932718 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6a7d26a5-7828-45a6-9c71-0462e2f533d6 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:33.987904 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-650b0528-ec72-494b-ba0d-1c6e480ef7c5 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:33.989213 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-650b0528-ec72-494b-ba0d-1c6e480ef7c5 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] [instance: 862e1521-739f-47c0-a7e0-2bd017e5f738] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:33.998493 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-650b0528-ec72-494b-ba0d-1c6e480ef7c5 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:33.999448 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-650b0528-ec72-494b-ba0d-1c6e480ef7c5 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:34.001055 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-650b0528-ec72-494b-ba0d-1c6e480ef7c5 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:34.002064 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-650b0528-ec72-494b-ba0d-1c6e480ef7c5 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:34.002793 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-650b0528-ec72-494b-ba0d-1c6e480ef7c5 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:34.004025 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-650b0528-ec72-494b-ba0d-1c6e480ef7c5 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:34.173625 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-6a7d26a5-7828-45a6-9c71-0462e2f533d6 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lazy-loading 'services' on Instance uuid 548e0225-fa26-46ba-9c12-7b52feee1784 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:57:34.215017 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6a7d26a5-7828-45a6-9c71-0462e2f533d6 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784" status: 200 len: 1971 microversion: 2.25 time: 0.298820 Aug 31 15:57:34.216381 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1085/2078] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:33 2022] GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784 => generated 1971 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:34.228862 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5e7eb85c-5edf-40f8-b5cb-e8b291599073 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:34.229496 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5e7eb85c-5edf-40f8-b5cb-e8b291599073 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: 434ee39d-6510-411f-93e1-0500c19fb312] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:34.241978 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-650b0528-ec72-494b-ba0d-1c6e480ef7c5 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba08a4705f4f0a9bc6a01d16a5f607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055586a03b0a4c1989b3ac658ac6347c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:34.261671 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e7eb85c-5edf-40f8-b5cb-e8b291599073 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:34.262625 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e7eb85c-5edf-40f8-b5cb-e8b291599073 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:34.266731 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e7eb85c-5edf-40f8-b5cb-e8b291599073 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:34.268368 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e7eb85c-5edf-40f8-b5cb-e8b291599073 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:34.269047 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e7eb85c-5edf-40f8-b5cb-e8b291599073 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:34.269698 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e7eb85c-5edf-40f8-b5cb-e8b291599073 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:34.275075 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-650b0528-ec72-494b-ba0d-1c6e480ef7c5 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] 10.222.0.50 "GET /compute/v2.1/servers/862e1521-739f-47c0-a7e0-2bd017e5f738" status: 200 len: 1318 microversion: 2.1 time: 0.301193 Aug 31 15:57:34.298545 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 994/2079] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:33 2022] GET /compute/v2.1/servers/862e1521-739f-47c0-a7e0-2bd017e5f738 => generated 1318 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:34.308997 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3e71f625-62b1-42e9-8f87-9fc570fc33b9 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:34.317864 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e71f625-62b1-42e9-8f87-9fc570fc33b9 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:34.318613 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e71f625-62b1-42e9-8f87-9fc570fc33b9 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:34.319883 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e71f625-62b1-42e9-8f87-9fc570fc33b9 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:34.321169 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e71f625-62b1-42e9-8f87-9fc570fc33b9 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:34.321804 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e71f625-62b1-42e9-8f87-9fc570fc33b9 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:34.322423 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e71f625-62b1-42e9-8f87-9fc570fc33b9 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:34.367180 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3e71f625-62b1-42e9-8f87-9fc570fc33b9 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.066599 Aug 31 15:57:34.368598 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 995/2080] 10.222.0.50 () {60 vars in 1217 bytes} [Wed Aug 31 15:57:34 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:57:34.383429 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a6d8dfce-043e-459d-bc8b-d1fe530bb0f9 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-833090-16", "block_migration": "auto"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:34.391353 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a6d8dfce-043e-459d-bc8b-d1fe530bb0f9 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] [instance: 548e0225-fa26-46ba-9c12-7b52feee1784] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:34.411777 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a6d8dfce-043e-459d-bc8b-d1fe530bb0f9 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:34.412494 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a6d8dfce-043e-459d-bc8b-d1fe530bb0f9 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:34.412988 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a6d8dfce-043e-459d-bc8b-d1fe530bb0f9 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:34.415928 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a6d8dfce-043e-459d-bc8b-d1fe530bb0f9 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:34.418960 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a6d8dfce-043e-459d-bc8b-d1fe530bb0f9 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:34.419715 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a6d8dfce-043e-459d-bc8b-d1fe530bb0f9 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:34.461956 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-a6d8dfce-043e-459d-bc8b-d1fe530bb0f9 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lazy-loading 'flavor' on Instance uuid 548e0225-fa26-46ba-9c12-7b52feee1784 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:57:34.477435 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a6d8dfce-043e-459d-bc8b-d1fe530bb0f9 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] [instance: 548e0225-fa26-46ba-9c12-7b52feee1784] Going to try to live migrate instance to n-h1-833090-16 {{(pid=128863) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 31 15:57:34.504365 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5e7eb85c-5edf-40f8-b5cb-e8b291599073 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:34.514791 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5e7eb85c-5edf-40f8-b5cb-e8b291599073 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/434ee39d-6510-411f-93e1-0500c19fb312" status: 200 len: 1307 microversion: 2.1 time: 0.297219 Aug 31 15:57:34.532105 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1086/2081] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:34 2022] GET /compute/v2.1/servers/434ee39d-6510-411f-93e1-0500c19fb312 => generated 1307 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:34.666218 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ebe910c4-749a-4876-8ddd-30d3cd44fcf4 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:34.666957 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ebe910c4-749a-4876-8ddd-30d3cd44fcf4 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: f044dca7-71de-4182-b5ec-825299496c10] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:34.676072 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ebe910c4-749a-4876-8ddd-30d3cd44fcf4 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:34.676693 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ebe910c4-749a-4876-8ddd-30d3cd44fcf4 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:34.678281 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ebe910c4-749a-4876-8ddd-30d3cd44fcf4 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:34.679826 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ebe910c4-749a-4876-8ddd-30d3cd44fcf4 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:34.680460 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ebe910c4-749a-4876-8ddd-30d3cd44fcf4 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:34.681125 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ebe910c4-749a-4876-8ddd-30d3cd44fcf4 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:34.847606 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ebe910c4-749a-4876-8ddd-30d3cd44fcf4 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:34.856704 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ebe910c4-749a-4876-8ddd-30d3cd44fcf4 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10" status: 200 len: 1506 microversion: 2.1 time: 0.195350 Aug 31 15:57:34.857274 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1087/2082] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:34 2022] GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10 => generated 1506 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:57:34.865149 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-feaded6a-e32b-4ec1-90c2-203ff428da7f req-47a35507-168c-4044-90dc-34fc24234d45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5de4f8b-332b-4e34-8290-cc0d445c50fd", "name": "network-vif-plugged", "status": "completed", "tag": "2c9bf410-c8d1-4264-92a1-8db9e76a7565"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:34.884981 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-feaded6a-e32b-4ec1-90c2-203ff428da7f req-47a35507-168c-4044-90dc-34fc24234d45 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:34.885545 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-feaded6a-e32b-4ec1-90c2-203ff428da7f req-47a35507-168c-4044-90dc-34fc24234d45 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:34.886235 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-feaded6a-e32b-4ec1-90c2-203ff428da7f req-47a35507-168c-4044-90dc-34fc24234d45 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:34.900910 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-feaded6a-e32b-4ec1-90c2-203ff428da7f req-47a35507-168c-4044-90dc-34fc24234d45 service nova] Creating event network-vif-plugged:2c9bf410-c8d1-4264-92a1-8db9e76a7565 for instance c5de4f8b-332b-4e34-8290-cc0d445c50fd on n-h2-833090-16 Aug 31 15:57:34.904732 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-feaded6a-e32b-4ec1-90c2-203ff428da7f req-47a35507-168c-4044-90dc-34fc24234d45 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043929 Aug 31 15:57:34.905894 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1088/2083] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:34.919283 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c602c6c0-5564-4e7f-a22b-c113ddfdef7c tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:34.920469 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c602c6c0-5564-4e7f-a22b-c113ddfdef7c tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] [instance: c5de4f8b-332b-4e34-8290-cc0d445c50fd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:34.931186 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c602c6c0-5564-4e7f-a22b-c113ddfdef7c tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:34.932063 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c602c6c0-5564-4e7f-a22b-c113ddfdef7c tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:34.932511 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c602c6c0-5564-4e7f-a22b-c113ddfdef7c tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:34.933227 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c602c6c0-5564-4e7f-a22b-c113ddfdef7c tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:34.934176 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c602c6c0-5564-4e7f-a22b-c113ddfdef7c tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:34.934176 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c602c6c0-5564-4e7f-a22b-c113ddfdef7c tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:35.120501 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c602c6c0-5564-4e7f-a22b-c113ddfdef7c tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1221b21792476baf26260db2bdbe93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f324e55d67b4764b183f7e85e206cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:35.129554 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c602c6c0-5564-4e7f-a22b-c113ddfdef7c tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] 10.222.0.50 "GET /compute/v2.1/servers/c5de4f8b-332b-4e34-8290-cc0d445c50fd" status: 200 len: 1323 microversion: 2.1 time: 0.217431 Aug 31 15:57:35.131872 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1089/2084] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:34 2022] GET /compute/v2.1/servers/c5de4f8b-332b-4e34-8290-cc0d445c50fd => generated 1323 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:35.136829 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-aca02448-357c-48dd-84f9-bc11d61b8dfd tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:35.138488 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-aca02448-357c-48dd-84f9-bc11d61b8dfd tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: a9448c8e-c801-4d08-b1c1-b34f279269e6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:35.163412 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aca02448-357c-48dd-84f9-bc11d61b8dfd tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:35.166610 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aca02448-357c-48dd-84f9-bc11d61b8dfd tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:35.167257 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aca02448-357c-48dd-84f9-bc11d61b8dfd tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:35.170930 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aca02448-357c-48dd-84f9-bc11d61b8dfd tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:35.171610 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aca02448-357c-48dd-84f9-bc11d61b8dfd tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:35.172250 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aca02448-357c-48dd-84f9-bc11d61b8dfd tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:35.400602 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=4 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:57:35.427699 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=12 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:57:36.108281 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-aca02448-357c-48dd-84f9-bc11d61b8dfd tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922a671cad44ea595e46290a5d52380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1371996a8304dc58ee579daa535bcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:36.118293 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-aca02448-357c-48dd-84f9-bc11d61b8dfd tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/a9448c8e-c801-4d08-b1c1-b34f279269e6" status: 200 len: 1314 microversion: 2.1 time: 0.984751 Aug 31 15:57:36.130336 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1090/2085] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:35 2022] GET /compute/v2.1/servers/a9448c8e-c801-4d08-b1c1-b34f279269e6 => generated 1314 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:36.145952 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-40f3cb5a-63b3-4ea5-a2af-a5533f5bd574 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:36.147243 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-40f3cb5a-63b3-4ea5-a2af-a5533f5bd574 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] [instance: 862e1521-739f-47c0-a7e0-2bd017e5f738] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:36.164231 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-40f3cb5a-63b3-4ea5-a2af-a5533f5bd574 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:36.165155 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-40f3cb5a-63b3-4ea5-a2af-a5533f5bd574 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:36.166361 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-40f3cb5a-63b3-4ea5-a2af-a5533f5bd574 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:36.168601 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-40f3cb5a-63b3-4ea5-a2af-a5533f5bd574 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:36.169150 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-40f3cb5a-63b3-4ea5-a2af-a5533f5bd574 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:36.169646 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-40f3cb5a-63b3-4ea5-a2af-a5533f5bd574 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:36.474232 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-40f3cb5a-63b3-4ea5-a2af-a5533f5bd574 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba08a4705f4f0a9bc6a01d16a5f607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055586a03b0a4c1989b3ac658ac6347c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:36.483502 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-40f3cb5a-63b3-4ea5-a2af-a5533f5bd574 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] 10.222.0.50 "GET /compute/v2.1/servers/862e1521-739f-47c0-a7e0-2bd017e5f738" status: 200 len: 1468 microversion: 2.1 time: 0.353167 Aug 31 15:57:36.484414 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1091/2086] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:36 2022] GET /compute/v2.1/servers/862e1521-739f-47c0-a7e0-2bd017e5f738 => generated 1468 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:36.489452 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-68f9cdf7-4730-4337-9e64-aca2273b82a1 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:36.489987 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-68f9cdf7-4730-4337-9e64-aca2273b82a1 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: 434ee39d-6510-411f-93e1-0500c19fb312] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:36.496932 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68f9cdf7-4730-4337-9e64-aca2273b82a1 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:36.497446 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68f9cdf7-4730-4337-9e64-aca2273b82a1 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:36.497861 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68f9cdf7-4730-4337-9e64-aca2273b82a1 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:36.498584 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68f9cdf7-4730-4337-9e64-aca2273b82a1 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:36.499189 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68f9cdf7-4730-4337-9e64-aca2273b82a1 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:36.499752 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68f9cdf7-4730-4337-9e64-aca2273b82a1 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:36.739090 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-68f9cdf7-4730-4337-9e64-aca2273b82a1 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:36.749114 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-68f9cdf7-4730-4337-9e64-aca2273b82a1 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/434ee39d-6510-411f-93e1-0500c19fb312" status: 200 len: 1307 microversion: 2.1 time: 0.263242 Aug 31 15:57:36.750797 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1092/2087] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:36 2022] GET /compute/v2.1/servers/434ee39d-6510-411f-93e1-0500c19fb312 => generated 1307 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:36.757534 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-168dfd7f-bdfb-44e6-8b86-358da7ae9efb tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:36.758515 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-168dfd7f-bdfb-44e6-8b86-358da7ae9efb tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: f044dca7-71de-4182-b5ec-825299496c10] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:36.765292 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-168dfd7f-bdfb-44e6-8b86-358da7ae9efb tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:36.766212 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-168dfd7f-bdfb-44e6-8b86-358da7ae9efb tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:36.767039 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-168dfd7f-bdfb-44e6-8b86-358da7ae9efb tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:36.767814 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-168dfd7f-bdfb-44e6-8b86-358da7ae9efb tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:36.768365 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-168dfd7f-bdfb-44e6-8b86-358da7ae9efb tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:36.769424 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-168dfd7f-bdfb-44e6-8b86-358da7ae9efb tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:36.803222 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a6d8dfce-043e-459d-bc8b-d1fe530bb0f9 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784/action" status: 202 len: 0 microversion: 2.25 time: 2.425298 Aug 31 15:57:36.803830 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 996/2088] 10.222.0.50 () {62 vars in 1319 bytes} [Wed Aug 31 15:57:34 2022] POST /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784/action => generated 0 bytes in 2428 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 31 15:57:36.809637 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a6ebbe6c-0cc0-48fb-8a57-4bc316433946 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:36.810294 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a6ebbe6c-0cc0-48fb-8a57-4bc316433946 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] [instance: c5de4f8b-332b-4e34-8290-cc0d445c50fd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:36.817300 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a6ebbe6c-0cc0-48fb-8a57-4bc316433946 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:36.817781 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a6ebbe6c-0cc0-48fb-8a57-4bc316433946 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:36.818249 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a6ebbe6c-0cc0-48fb-8a57-4bc316433946 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:36.819157 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a6ebbe6c-0cc0-48fb-8a57-4bc316433946 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:36.819610 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a6ebbe6c-0cc0-48fb-8a57-4bc316433946 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:36.820062 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a6ebbe6c-0cc0-48fb-8a57-4bc316433946 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:36.972775 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-168dfd7f-bdfb-44e6-8b86-358da7ae9efb tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:36.984736 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-168dfd7f-bdfb-44e6-8b86-358da7ae9efb tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10" status: 200 len: 1506 microversion: 2.1 time: 0.232121 Aug 31 15:57:36.986121 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1093/2089] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:36 2022] GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10 => generated 1506 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:37.021364 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a6ebbe6c-0cc0-48fb-8a57-4bc316433946 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1221b21792476baf26260db2bdbe93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f324e55d67b4764b183f7e85e206cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:37.031401 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a6ebbe6c-0cc0-48fb-8a57-4bc316433946 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] 10.222.0.50 "GET /compute/v2.1/servers/c5de4f8b-332b-4e34-8290-cc0d445c50fd" status: 200 len: 1323 microversion: 2.1 time: 0.226108 Aug 31 15:57:37.033353 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 997/2090] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:36 2022] GET /compute/v2.1/servers/c5de4f8b-332b-4e34-8290-cc0d445c50fd => generated 1323 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:37.040492 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dccbed05-f00d-48e0-93ea-b5ab9232673d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:37.040934 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dccbed05-f00d-48e0-93ea-b5ab9232673d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 548e0225-fa26-46ba-9c12-7b52feee1784] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:37.048515 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dccbed05-f00d-48e0-93ea-b5ab9232673d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:37.049003 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dccbed05-f00d-48e0-93ea-b5ab9232673d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:37.049436 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dccbed05-f00d-48e0-93ea-b5ab9232673d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:37.050444 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dccbed05-f00d-48e0-93ea-b5ab9232673d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:37.050672 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dccbed05-f00d-48e0-93ea-b5ab9232673d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:37.051295 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dccbed05-f00d-48e0-93ea-b5ab9232673d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:37.062164 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b3526a47-50cf-408c-a76a-bac93d0320b1 tempest-LiveMigrationNegativeTest-1770440985 tempest-LiveMigrationNegativeTest-1770440985-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-909651874", "block_migration": true, "disk_over_commit": false}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:37.066519 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b3526a47-50cf-408c-a76a-bac93d0320b1 tempest-LiveMigrationNegativeTest-1770440985 tempest-LiveMigrationNegativeTest-1770440985-project-admin] [instance: 862e1521-739f-47c0-a7e0-2bd017e5f738] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:37.074592 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b3526a47-50cf-408c-a76a-bac93d0320b1 tempest-LiveMigrationNegativeTest-1770440985 tempest-LiveMigrationNegativeTest-1770440985-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:37.075414 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b3526a47-50cf-408c-a76a-bac93d0320b1 tempest-LiveMigrationNegativeTest-1770440985 tempest-LiveMigrationNegativeTest-1770440985-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:37.076300 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b3526a47-50cf-408c-a76a-bac93d0320b1 tempest-LiveMigrationNegativeTest-1770440985 tempest-LiveMigrationNegativeTest-1770440985-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:37.077213 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b3526a47-50cf-408c-a76a-bac93d0320b1 tempest-LiveMigrationNegativeTest-1770440985 tempest-LiveMigrationNegativeTest-1770440985-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:37.077849 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b3526a47-50cf-408c-a76a-bac93d0320b1 tempest-LiveMigrationNegativeTest-1770440985 tempest-LiveMigrationNegativeTest-1770440985-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:37.079138 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b3526a47-50cf-408c-a76a-bac93d0320b1 tempest-LiveMigrationNegativeTest-1770440985 tempest-LiveMigrationNegativeTest-1770440985-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:37.119306 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-b3526a47-50cf-408c-a76a-bac93d0320b1 tempest-LiveMigrationNegativeTest-1770440985 tempest-LiveMigrationNegativeTest-1770440985-project-admin] Lazy-loading 'flavor' on Instance uuid 862e1521-739f-47c0-a7e0-2bd017e5f738 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:57:37.147581 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b3526a47-50cf-408c-a76a-bac93d0320b1 tempest-LiveMigrationNegativeTest-1770440985 tempest-LiveMigrationNegativeTest-1770440985-project-admin] [instance: 862e1521-739f-47c0-a7e0-2bd017e5f738] Going to try to live migrate instance to tempest-host-909651874 {{(pid=128864) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 31 15:57:37.160185 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-b3526a47-50cf-408c-a76a-bac93d0320b1 tempest-LiveMigrationNegativeTest-1770440985 tempest-LiveMigrationNegativeTest-1770440985-project-admin] HTTP exception thrown: Compute host tempest-host-909651874 could not be found. Aug 31 15:57:37.185597 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b3526a47-50cf-408c-a76a-bac93d0320b1 tempest-LiveMigrationNegativeTest-1770440985 tempest-LiveMigrationNegativeTest-1770440985-project-admin] Request method failure captured: Aug 31 15:57:37.185597 n-d-833090-16 devstack@n-api.service[128864]: request: POST /compute/v2.1/servers/862e1521-739f-47c0-a7e0-2bd017e5f738/action HTTP/1.1 Aug 31 15:57:37.185597 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:57:37.185597 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:57:37.185597 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:57:37.185597 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 106 Aug 31 15:57:37.185597 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:57:37.185597 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:57:37.185597 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:57:37.185597 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:57:37.185597 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4TURDGU77-MYZ1mxFHvkQy6GIihMdlRLivL2wmoW6uQ93qBLMOJG2Ynhcwmw7DQccyssw0R-HuzP59NM58CN1GHIlhBnOqR_3m_p26fAwhf2oJ-9qTV3rYYqXqfZhA4Y9jZRkVicnJ7GBKXK0jClHdVKC-YNF4eXKSk2Kjc3JjRZ34 Aug 31 15:57:37.185597 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:57:37.185597 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:57:37.185597 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:57:37.185597 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:57:37.185597 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:57:37.185597 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:57:37.185597 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 7bd8a2e3863c445da8eb1206ab071abc Aug 31 15:57:37.185597 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-LiveMigrationNegativeTest-1770440985 Aug 31 15:57:37.185597 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,admin,member Aug 31 15:57:37.185597 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,admin,member Aug 31 15:57:37.185597 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7bd8a2e3863c445da8eb1206ab071abc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7bd8a2e3863c445da8eb1206ab071abc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7bd8a2e3863c445da8eb1206ab071abc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7bd8a2e3863c445da8eb1206ab071abc", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:57:37.185597 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-LiveMigrationNegativeTest-1770440985 Aug 31 15:57:37.185597 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 7bd8a2e3863c445da8eb1206ab071abc Aug 31 15:57:37.185597 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1770440985 Aug 31 15:57:37.185597 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-LiveMigrationNegativeTest-1770440985-project-admin Aug 31 15:57:37.185597 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:57:37.185597 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:57:37.185597 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 7561d7ef42ee4b9695e5cbfd4ccf8b31 Aug 31 15:57:37.185597 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-LiveMigrationNegativeTest-1770440985-project-admin Aug 31 15:57:37.185597 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 15:57:37.185597 n-d-833090-16 devstack@n-api.service[128864]: {"os-migrateLive": {"host": "tempest-host-909651874", "block_migration": true, "disk_over_commit": false}} Aug 31 15:57:37.185597 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:57:37.185597 n-d-833090-16 devstack@n-api.service[128864]: exception: Compute host tempest-host-909651874 could not be found. Aug 31 15:57:37.185597 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '862e1521-739f-47c0-a7e0-2bd017e5f738', 'body': {'os-migrateLive': {'host': 'tempest-host-909651874', 'block_migration': True, 'disk_over_commit': False}}} Aug 31 15:57:37.185597 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:57:37.185597 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:37.185597 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 31 15:57:37.185597 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 31 15:57:37.185597 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 31 15:57:37.185597 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 15:57:37.185597 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 31 15:57:37.185597 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 31 15:57:37.185597 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 31 15:57:37.185597 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 15:57:37.185597 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 31 15:57:37.185597 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 31 15:57:37.185597 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 31 15:57:37.185597 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 15:57:37.185597 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Aug 31 15:57:37.185597 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 15:57:37.185597 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 15:57:37.185597 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 15:57:37.185597 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 15:57:37.185597 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 15:57:37.185597 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5486, in live_migrate Aug 31 15:57:37.185597 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Aug 31 15:57:37.185597 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 15:57:37.185597 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 15:57:37.185597 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Aug 31 15:57:37.185597 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Aug 31 15:57:37.190863 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Aug 31 15:57:37.190863 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:57:37.190863 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Aug 31 15:57:37.190863 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Aug 31 15:57:37.190863 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Aug 31 15:57:37.190863 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Aug 31 15:57:37.190863 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Aug 31 15:57:37.190863 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Aug 31 15:57:37.190863 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-909651874 could not be found. Aug 31 15:57:37.190863 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:57:37.190863 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:57:37.190863 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:57:37.190863 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:37.190863 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:57:37.190863 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:57:37.190863 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:57:37.190863 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:57:37.190863 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:57:37.190863 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:57:37.190863 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:57:37.190863 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:57:37.190863 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:57:37.190863 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:57:37.190863 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:57:37.190863 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:57:37.190863 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 31 15:57:37.190863 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Aug 31 15:57:37.190863 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 15:57:37.190863 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-909651874 could not be found. Aug 31 15:57:37.190863 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:57:37.190863 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:57:37.190863 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:57:37.190863 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:37.190863 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:57:37.190863 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:57:37.190863 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:57:37.190863 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:57:37.190863 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-909651874 could not be found. Aug 31 15:57:37.190863 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:57:37.197950 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b3526a47-50cf-408c-a76a-bac93d0320b1 tempest-LiveMigrationNegativeTest-1770440985 tempest-LiveMigrationNegativeTest-1770440985-project-admin] Returning 400 to user: Compute host tempest-host-909651874 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:57:37.199831 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b3526a47-50cf-408c-a76a-bac93d0320b1 tempest-LiveMigrationNegativeTest-1770440985 tempest-LiveMigrationNegativeTest-1770440985-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/862e1521-739f-47c0-a7e0-2bd017e5f738/action" status: 400 len: 99 microversion: 2.1 time: 0.211758 Aug 31 15:57:37.201659 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1094/2091] 10.222.0.50 () {60 vars in 1279 bytes} [Wed Aug 31 15:57:36 2022] POST /compute/v2.1/servers/862e1521-739f-47c0-a7e0-2bd017e5f738/action => generated 99 bytes in 215 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 31 15:57:37.208150 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-0ebf8b69-22ab-4c7e-a858-1935c06a0e86 req-431799b1-f049-4477-a063-4131fc8ec429 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "434ee39d-6510-411f-93e1-0500c19fb312", "name": "network-vif-plugged", "status": "completed", "tag": "5109e7a2-31db-42fd-b192-796f0b872104"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:37.244993 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-0ebf8b69-22ab-4c7e-a858-1935c06a0e86 req-431799b1-f049-4477-a063-4131fc8ec429 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:37.246839 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-0ebf8b69-22ab-4c7e-a858-1935c06a0e86 req-431799b1-f049-4477-a063-4131fc8ec429 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:37.250204 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-0ebf8b69-22ab-4c7e-a858-1935c06a0e86 req-431799b1-f049-4477-a063-4131fc8ec429 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:37.275296 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dccbed05-f00d-48e0-93ea-b5ab9232673d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:37.284260 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-0ebf8b69-22ab-4c7e-a858-1935c06a0e86 req-431799b1-f049-4477-a063-4131fc8ec429 service nova] Creating event network-vif-plugged:5109e7a2-31db-42fd-b192-796f0b872104 for instance 434ee39d-6510-411f-93e1-0500c19fb312 on n-h1-833090-16 Aug 31 15:57:37.285584 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dccbed05-f00d-48e0-93ea-b5ab9232673d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:37.287378 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dccbed05-f00d-48e0-93ea-b5ab9232673d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:37.288939 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dccbed05-f00d-48e0-93ea-b5ab9232673d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784" status: 200 len: 1486 microversion: 2.25 time: 0.254511 Aug 31 15:57:37.296135 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-0ebf8b69-22ab-4c7e-a858-1935c06a0e86 req-431799b1-f049-4477-a063-4131fc8ec429 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092787 Aug 31 15:57:37.297839 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1095/2092] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:37.304768 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-129620b5-95d5-4c70-9ae0-5334323e52e4 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:37.305357 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 998/2093] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:37 2022] GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784 => generated 1486 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:37.306357 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-129620b5-95d5-4c70-9ae0-5334323e52e4 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: a9448c8e-c801-4d08-b1c1-b34f279269e6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:37.312300 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7af4c9a2-f7b9-457f-80b1-bd90c273ca27 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:37.313242 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7af4c9a2-f7b9-457f-80b1-bd90c273ca27 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] [instance: 862e1521-739f-47c0-a7e0-2bd017e5f738] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:37.317071 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-129620b5-95d5-4c70-9ae0-5334323e52e4 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:37.318127 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-129620b5-95d5-4c70-9ae0-5334323e52e4 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:37.318745 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-129620b5-95d5-4c70-9ae0-5334323e52e4 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:37.320111 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-129620b5-95d5-4c70-9ae0-5334323e52e4 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:37.321170 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7af4c9a2-f7b9-457f-80b1-bd90c273ca27 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:37.321353 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-129620b5-95d5-4c70-9ae0-5334323e52e4 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:37.322041 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-129620b5-95d5-4c70-9ae0-5334323e52e4 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:37.322171 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7af4c9a2-f7b9-457f-80b1-bd90c273ca27 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:37.322740 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7af4c9a2-f7b9-457f-80b1-bd90c273ca27 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:37.323573 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7af4c9a2-f7b9-457f-80b1-bd90c273ca27 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:37.324113 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7af4c9a2-f7b9-457f-80b1-bd90c273ca27 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:37.324622 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7af4c9a2-f7b9-457f-80b1-bd90c273ca27 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:37.762001 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7af4c9a2-f7b9-457f-80b1-bd90c273ca27 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba08a4705f4f0a9bc6a01d16a5f607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055586a03b0a4c1989b3ac658ac6347c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:37.777087 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7af4c9a2-f7b9-457f-80b1-bd90c273ca27 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] 10.222.0.50 "GET /compute/v2.1/servers/862e1521-739f-47c0-a7e0-2bd017e5f738" status: 200 len: 1468 microversion: 2.1 time: 0.468862 Aug 31 15:57:37.777917 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 999/2094] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:37 2022] GET /compute/v2.1/servers/862e1521-739f-47c0-a7e0-2bd017e5f738 => generated 1468 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:37.783295 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f752f2cb-58f7-414c-b7c3-771629096ce5 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:37.784565 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f752f2cb-58f7-414c-b7c3-771629096ce5 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: 434ee39d-6510-411f-93e1-0500c19fb312] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:37.793243 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f752f2cb-58f7-414c-b7c3-771629096ce5 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:37.794353 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f752f2cb-58f7-414c-b7c3-771629096ce5 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:37.795010 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f752f2cb-58f7-414c-b7c3-771629096ce5 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:37.796851 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f752f2cb-58f7-414c-b7c3-771629096ce5 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:37.797691 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f752f2cb-58f7-414c-b7c3-771629096ce5 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:37.802479 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-129620b5-95d5-4c70-9ae0-5334323e52e4 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922a671cad44ea595e46290a5d52380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1371996a8304dc58ee579daa535bcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:37.812753 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f752f2cb-58f7-414c-b7c3-771629096ce5 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:37.825275 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-129620b5-95d5-4c70-9ae0-5334323e52e4 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/a9448c8e-c801-4d08-b1c1-b34f279269e6" status: 200 len: 1314 microversion: 2.1 time: 0.525451 Aug 31 15:57:37.838344 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1096/2095] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:37 2022] GET /compute/v2.1/servers/a9448c8e-c801-4d08-b1c1-b34f279269e6 => generated 1314 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:37.890681 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fd831d3d-de80-4b15-99e8-b403990878d3 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-2038376470", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:37.963966 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-fd831d3d-de80-4b15-99e8-b403990878d3 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] validate_networks() for None {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:57:38.082651 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f752f2cb-58f7-414c-b7c3-771629096ce5 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:38.097306 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f752f2cb-58f7-414c-b7c3-771629096ce5 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/434ee39d-6510-411f-93e1-0500c19fb312" status: 200 len: 1307 microversion: 2.1 time: 0.317796 Aug 31 15:57:38.110158 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1000/2096] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:37 2022] GET /compute/v2.1/servers/434ee39d-6510-411f-93e1-0500c19fb312 => generated 1307 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:38.110158 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9c734a8a-bdac-4845-8b05-02fc0901c60a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:38.110158 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9c734a8a-bdac-4845-8b05-02fc0901c60a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: f044dca7-71de-4182-b5ec-825299496c10] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:38.128421 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c734a8a-bdac-4845-8b05-02fc0901c60a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:38.128919 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c734a8a-bdac-4845-8b05-02fc0901c60a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:38.129342 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c734a8a-bdac-4845-8b05-02fc0901c60a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:38.130266 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c734a8a-bdac-4845-8b05-02fc0901c60a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:38.130853 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c734a8a-bdac-4845-8b05-02fc0901c60a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:38.131540 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c734a8a-bdac-4845-8b05-02fc0901c60a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:38.420357 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9c734a8a-bdac-4845-8b05-02fc0901c60a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:38.435549 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9c734a8a-bdac-4845-8b05-02fc0901c60a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10" status: 200 len: 1506 microversion: 2.1 time: 0.331171 Aug 31 15:57:38.436184 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1001/2097] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:38 2022] GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10 => generated 1506 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:38.441880 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a97c9889-79ec-4e31-bea7-9930ed5a9536 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:38.442562 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a97c9889-79ec-4e31-bea7-9930ed5a9536 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] [instance: c5de4f8b-332b-4e34-8290-cc0d445c50fd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:38.451843 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a97c9889-79ec-4e31-bea7-9930ed5a9536 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:38.452327 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a97c9889-79ec-4e31-bea7-9930ed5a9536 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:38.456075 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a97c9889-79ec-4e31-bea7-9930ed5a9536 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:38.456815 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a97c9889-79ec-4e31-bea7-9930ed5a9536 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:38.457464 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a97c9889-79ec-4e31-bea7-9930ed5a9536 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:38.457879 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a97c9889-79ec-4e31-bea7-9930ed5a9536 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:38.535310 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-fd831d3d-de80-4b15-99e8-b403990878d3 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:57:38.536321 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-fd831d3d-de80-4b15-99e8-b403990878d3 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:57:38.536938 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-fd831d3d-de80-4b15-99e8-b403990878d3 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:57:38.537378 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-fd831d3d-de80-4b15-99e8-b403990878d3 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:57:38.537783 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-fd831d3d-de80-4b15-99e8-b403990878d3 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:57:38.546978 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fd831d3d-de80-4b15-99e8-b403990878d3 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:38.547424 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fd831d3d-de80-4b15-99e8-b403990878d3 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:38.547800 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fd831d3d-de80-4b15-99e8-b403990878d3 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:38.548693 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fd831d3d-de80-4b15-99e8-b403990878d3 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:38.549144 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fd831d3d-de80-4b15-99e8-b403990878d3 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:38.549545 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fd831d3d-de80-4b15-99e8-b403990878d3 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:38.596480 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-fd831d3d-de80-4b15-99e8-b403990878d3 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Getting quotas for project 055586a03b0a4c1989b3ac658ac6347c. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:57:38.604049 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-fd831d3d-de80-4b15-99e8-b403990878d3 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Getting quotas for user b0ba08a4705f4f0a9bc6a01d16a5f607 and project 055586a03b0a4c1989b3ac658ac6347c. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:57:38.653304 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fd831d3d-de80-4b15-99e8-b403990878d3 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:57:38.656295 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fd831d3d-de80-4b15-99e8-b403990878d3 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] [instance: d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:57:38.717879 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fd831d3d-de80-4b15-99e8-b403990878d3 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.831467 Aug 31 15:57:38.724479 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1097/2098] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:57:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 15:57:38.724479 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f2dc8723-1ed9-4dcf-bfbf-ca8ebfaa1f66 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:38.724856 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f2dc8723-1ed9-4dcf-bfbf-ca8ebfaa1f66 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 548e0225-fa26-46ba-9c12-7b52feee1784] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:38.732489 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f2dc8723-1ed9-4dcf-bfbf-ca8ebfaa1f66 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:38.733231 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f2dc8723-1ed9-4dcf-bfbf-ca8ebfaa1f66 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:38.733835 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f2dc8723-1ed9-4dcf-bfbf-ca8ebfaa1f66 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:38.734806 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f2dc8723-1ed9-4dcf-bfbf-ca8ebfaa1f66 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:38.735395 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f2dc8723-1ed9-4dcf-bfbf-ca8ebfaa1f66 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:38.736092 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f2dc8723-1ed9-4dcf-bfbf-ca8ebfaa1f66 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:38.754977 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a97c9889-79ec-4e31-bea7-9930ed5a9536 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1221b21792476baf26260db2bdbe93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f324e55d67b4764b183f7e85e206cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:38.756426 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=100 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:57:38.780223 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a97c9889-79ec-4e31-bea7-9930ed5a9536 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] 10.222.0.50 "GET /compute/v2.1/servers/c5de4f8b-332b-4e34-8290-cc0d445c50fd" status: 200 len: 1472 microversion: 2.1 time: 0.342977 Aug 31 15:57:38.801604 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1002/2099] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:38 2022] GET /compute/v2.1/servers/c5de4f8b-332b-4e34-8290-cc0d445c50fd => generated 1472 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:38.809479 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-042b9c46-3303-497d-9ffa-bdc52c0fd305 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:38.810123 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-042b9c46-3303-497d-9ffa-bdc52c0fd305 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] [instance: d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:38.926926 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-042b9c46-3303-497d-9ffa-bdc52c0fd305 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba08a4705f4f0a9bc6a01d16a5f607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055586a03b0a4c1989b3ac658ac6347c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:38.938463 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-042b9c46-3303-497d-9ffa-bdc52c0fd305 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] 10.222.0.50 "GET /compute/v2.1/servers/d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe" status: 200 len: 1219 microversion: 2.1 time: 0.131877 Aug 31 15:57:38.939061 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1003/2100] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:38 2022] GET /compute/v2.1/servers/d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe => generated 1219 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:38.949050 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-178aeebc-395f-4029-b22d-7fdceb61b876 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:38.949541 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-178aeebc-395f-4029-b22d-7fdceb61b876 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] [instance: c5de4f8b-332b-4e34-8290-cc0d445c50fd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:38.959424 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-178aeebc-395f-4029-b22d-7fdceb61b876 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:38.959916 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-178aeebc-395f-4029-b22d-7fdceb61b876 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:38.960342 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-178aeebc-395f-4029-b22d-7fdceb61b876 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:38.961307 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-178aeebc-395f-4029-b22d-7fdceb61b876 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:38.962815 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-178aeebc-395f-4029-b22d-7fdceb61b876 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:38.964054 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-178aeebc-395f-4029-b22d-7fdceb61b876 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:39.022881 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-178aeebc-395f-4029-b22d-7fdceb61b876 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '0d1221b21792476baf26260db2bdbe93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f324e55d67b4764b183f7e85e206cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:39.025777 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f2dc8723-1ed9-4dcf-bfbf-ca8ebfaa1f66 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:39.032314 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-178aeebc-395f-4029-b22d-7fdceb61b876 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Request method failure captured: Aug 31 15:57:39.032314 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/c5de4f8b-332b-4e34-8290-cc0d445c50fd/diagnostics HTTP/1.1 Aug 31 15:57:39.032314 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:57:39.032314 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:57:39.032314 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:57:39.032314 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:57:39.032314 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:57:39.032314 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:57:39.032314 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:57:39.032314 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:57:39.032314 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4TLtVkUMT2ZtolOJmloox0aJbsA-y-1I_y1s5IsXKk9676VYiBW7FzCT99RbbdH26BTrsSAAD8FSUnmXk8rfDBoAc30opWEEdXUZL_NbD3iKp1ON8x5GV4GA_HSxUt1Bp2FDe0VXLqJPT_7UscHzqNWBPLevlkhR1vFNPL8ASdj6W4 Aug 31 15:57:39.032314 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:57:39.032314 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:57:39.032314 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:57:39.032314 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:57:39.032314 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:57:39.032314 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:57:39.032314 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 2f324e55d67b4764b183f7e85e206cb3 Aug 31 15:57:39.032314 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-272452252 Aug 31 15:57:39.032314 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:57:39.032314 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:57:39.032314 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2f324e55d67b4764b183f7e85e206cb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2f324e55d67b4764b183f7e85e206cb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2f324e55d67b4764b183f7e85e206cb3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2f324e55d67b4764b183f7e85e206cb3", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:57:39.032314 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-272452252 Aug 31 15:57:39.032314 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 2f324e55d67b4764b183f7e85e206cb3 Aug 31 15:57:39.032314 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-272452252 Aug 31 15:57:39.032314 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServerDiagnosticsNegativeTest-272452252-project Aug 31 15:57:39.032314 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:57:39.032314 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:57:39.032314 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 0d1221b21792476baf26260db2bdbe93 Aug 31 15:57:39.032314 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-272452252-project Aug 31 15:57:39.032314 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 15:57:39.032314 n-d-833090-16 devstack@n-api.service[128863]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 31 15:57:39.032314 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'server_id': 'c5de4f8b-332b-4e34-8290-cc0d445c50fd'} Aug 31 15:57:39.032314 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:57:39.032314 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:39.032314 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:57:39.032314 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:57:39.032314 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:57:39.032314 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:57:39.032314 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:57:39.032314 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:57:39.032314 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Aug 31 15:57:39.032314 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Aug 31 15:57:39.032314 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 15:57:39.032314 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 15:57:39.032314 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 15:57:39.032314 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 15:57:39.032314 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:57:39.032314 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:57:39.032314 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:57:39.032314 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:57:39.032314 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 15:57:39.032314 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 15:57:39.032314 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 15:57:39.032314 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 15:57:39.032314 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 15:57:39.032314 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 15:57:39.032314 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 31 15:57:39.032314 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:57:39.032314 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:57:39.032314 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:57:39.032314 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:39.036327 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:57:39.036327 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:57:39.036327 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 15:57:39.036327 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 15:57:39.036327 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 31 15:57:39.036327 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:57:39.036641 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f2dc8723-1ed9-4dcf-bfbf-ca8ebfaa1f66 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:39.036641 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f2dc8723-1ed9-4dcf-bfbf-ca8ebfaa1f66 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:39.037894 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f2dc8723-1ed9-4dcf-bfbf-ca8ebfaa1f66 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784" status: 200 len: 1486 microversion: 2.25 time: 0.317621 Aug 31 15:57:39.040172 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-178aeebc-395f-4029-b22d-7fdceb61b876 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:57:39.041280 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-178aeebc-395f-4029-b22d-7fdceb61b876 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] 10.222.0.50 "GET /compute/v2.1/servers/c5de4f8b-332b-4e34-8290-cc0d445c50fd/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.100943 Aug 31 15:57:39.042902 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1004/2101] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 31 15:57:38 2022] GET /compute/v2.1/servers/c5de4f8b-332b-4e34-8290-cc0d445c50fd/diagnostics => generated 117 bytes in 103 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:57:39.048440 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a41ff6e5-ecee-4b8e-992f-c8ca020c056a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:39.050503 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a41ff6e5-ecee-4b8e-992f-c8ca020c056a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: a9448c8e-c801-4d08-b1c1-b34f279269e6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:39.059719 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1098/2102] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:38 2022] GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784 => generated 1486 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:39.068840 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0b65585e-ff9e-4fa6-bd9c-f51aa666fb66 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:39.071592 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0b65585e-ff9e-4fa6-bd9c-f51aa666fb66 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] [instance: c5de4f8b-332b-4e34-8290-cc0d445c50fd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:39.071906 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a41ff6e5-ecee-4b8e-992f-c8ca020c056a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:39.072405 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a41ff6e5-ecee-4b8e-992f-c8ca020c056a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:39.072847 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a41ff6e5-ecee-4b8e-992f-c8ca020c056a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:39.073533 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a41ff6e5-ecee-4b8e-992f-c8ca020c056a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:39.073978 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a41ff6e5-ecee-4b8e-992f-c8ca020c056a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:39.079020 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a41ff6e5-ecee-4b8e-992f-c8ca020c056a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:39.084595 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0b65585e-ff9e-4fa6-bd9c-f51aa666fb66 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:39.090965 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0b65585e-ff9e-4fa6-bd9c-f51aa666fb66 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:39.096227 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0b65585e-ff9e-4fa6-bd9c-f51aa666fb66 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:39.097182 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0b65585e-ff9e-4fa6-bd9c-f51aa666fb66 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:39.097779 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0b65585e-ff9e-4fa6-bd9c-f51aa666fb66 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:39.098336 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0b65585e-ff9e-4fa6-bd9c-f51aa666fb66 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:39.158568 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0b65585e-ff9e-4fa6-bd9c-f51aa666fb66 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] [instance: c5de4f8b-332b-4e34-8290-cc0d445c50fd] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:57:39.305962 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0b65585e-ff9e-4fa6-bd9c-f51aa666fb66 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] 10.222.0.50 "DELETE /compute/v2.1/servers/c5de4f8b-332b-4e34-8290-cc0d445c50fd" status: 204 len: 0 microversion: 2.1 time: 0.244555 Aug 31 15:57:39.318865 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1099/2103] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:57:39 2022] DELETE /compute/v2.1/servers/c5de4f8b-332b-4e34-8290-cc0d445c50fd => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:57:39.328947 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a41ff6e5-ecee-4b8e-992f-c8ca020c056a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922a671cad44ea595e46290a5d52380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1371996a8304dc58ee579daa535bcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:39.346917 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a41ff6e5-ecee-4b8e-992f-c8ca020c056a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/a9448c8e-c801-4d08-b1c1-b34f279269e6" status: 200 len: 1314 microversion: 2.1 time: 0.302426 Aug 31 15:57:39.348066 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5fd7641c-eb4a-4fdc-a218-c0694645ed12 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:39.348871 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5fd7641c-eb4a-4fdc-a218-c0694645ed12 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: 434ee39d-6510-411f-93e1-0500c19fb312] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:39.350870 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1005/2104] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:39 2022] GET /compute/v2.1/servers/a9448c8e-c801-4d08-b1c1-b34f279269e6 => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:39.362658 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-69c4bbe1-e1d5-445a-916f-1fe430b44157 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:39.364400 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-69c4bbe1-e1d5-445a-916f-1fe430b44157 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] [instance: c5de4f8b-332b-4e34-8290-cc0d445c50fd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:39.365066 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5fd7641c-eb4a-4fdc-a218-c0694645ed12 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:39.367474 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5fd7641c-eb4a-4fdc-a218-c0694645ed12 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:39.368557 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5fd7641c-eb4a-4fdc-a218-c0694645ed12 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:39.370360 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5fd7641c-eb4a-4fdc-a218-c0694645ed12 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:39.373026 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5fd7641c-eb4a-4fdc-a218-c0694645ed12 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:39.374363 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5fd7641c-eb4a-4fdc-a218-c0694645ed12 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:39.381843 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69c4bbe1-e1d5-445a-916f-1fe430b44157 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:39.383359 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69c4bbe1-e1d5-445a-916f-1fe430b44157 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:39.387570 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69c4bbe1-e1d5-445a-916f-1fe430b44157 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:39.388767 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69c4bbe1-e1d5-445a-916f-1fe430b44157 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:39.390882 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69c4bbe1-e1d5-445a-916f-1fe430b44157 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:39.391533 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69c4bbe1-e1d5-445a-916f-1fe430b44157 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:39.764132 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-69c4bbe1-e1d5-445a-916f-1fe430b44157 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1221b21792476baf26260db2bdbe93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f324e55d67b4764b183f7e85e206cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:39.773955 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-69c4bbe1-e1d5-445a-916f-1fe430b44157 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] 10.222.0.50 "GET /compute/v2.1/servers/c5de4f8b-332b-4e34-8290-cc0d445c50fd" status: 200 len: 1478 microversion: 2.1 time: 0.421638 Aug 31 15:57:39.792575 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1006/2105] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:39 2022] GET /compute/v2.1/servers/c5de4f8b-332b-4e34-8290-cc0d445c50fd => generated 1478 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:39.799595 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5fd7641c-eb4a-4fdc-a218-c0694645ed12 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:39.801338 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-176a8733-b88f-43b8-9115-5d2e176183fb req-ecbd7378-f136-4fc8-8e4e-114f36fa1e01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9448c8e-c801-4d08-b1c1-b34f279269e6", "name": "network-vif-plugged", "status": "completed", "tag": "2099a852-2512-4fb9-8fa5-c0420a4477eb"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:39.809430 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5fd7641c-eb4a-4fdc-a218-c0694645ed12 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/434ee39d-6510-411f-93e1-0500c19fb312" status: 200 len: 1487 microversion: 2.1 time: 0.489087 Aug 31 15:57:39.811221 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1100/2106] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:39 2022] GET /compute/v2.1/servers/434ee39d-6510-411f-93e1-0500c19fb312 => generated 1487 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:39.817296 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-31dd8208-d930-4446-8b97-5e0811ead1ae tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:39.818198 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-31dd8208-d930-4446-8b97-5e0811ead1ae tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: f044dca7-71de-4182-b5ec-825299496c10] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:39.826253 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-31dd8208-d930-4446-8b97-5e0811ead1ae tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:39.826958 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-31dd8208-d930-4446-8b97-5e0811ead1ae tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:39.828338 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-31dd8208-d930-4446-8b97-5e0811ead1ae tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:39.829465 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-31dd8208-d930-4446-8b97-5e0811ead1ae tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:39.830142 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-31dd8208-d930-4446-8b97-5e0811ead1ae tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:39.830606 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-176a8733-b88f-43b8-9115-5d2e176183fb req-ecbd7378-f136-4fc8-8e4e-114f36fa1e01 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:39.831094 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-31dd8208-d930-4446-8b97-5e0811ead1ae tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:39.831200 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-176a8733-b88f-43b8-9115-5d2e176183fb req-ecbd7378-f136-4fc8-8e4e-114f36fa1e01 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:39.831677 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-176a8733-b88f-43b8-9115-5d2e176183fb req-ecbd7378-f136-4fc8-8e4e-114f36fa1e01 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:39.845172 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-176a8733-b88f-43b8-9115-5d2e176183fb req-ecbd7378-f136-4fc8-8e4e-114f36fa1e01 service nova] Creating event network-vif-plugged:2099a852-2512-4fb9-8fa5-c0420a4477eb for instance a9448c8e-c801-4d08-b1c1-b34f279269e6 on n-h2-833090-16 Aug 31 15:57:39.850528 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-176a8733-b88f-43b8-9115-5d2e176183fb req-ecbd7378-f136-4fc8-8e4e-114f36fa1e01 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055378 Aug 31 15:57:39.851614 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1007/2107] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:57:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:39.860558 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-db92ed97-b380-4be7-912d-e84b15eed114 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:39.861887 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-db92ed97-b380-4be7-912d-e84b15eed114 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: 434ee39d-6510-411f-93e1-0500c19fb312] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:39.870178 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db92ed97-b380-4be7-912d-e84b15eed114 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:39.870974 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db92ed97-b380-4be7-912d-e84b15eed114 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:39.871740 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db92ed97-b380-4be7-912d-e84b15eed114 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:39.872743 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db92ed97-b380-4be7-912d-e84b15eed114 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:39.873411 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db92ed97-b380-4be7-912d-e84b15eed114 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:39.874026 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db92ed97-b380-4be7-912d-e84b15eed114 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:39.919876 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-db92ed97-b380-4be7-912d-e84b15eed114 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lazy-loading 'flavor' on Instance uuid 434ee39d-6510-411f-93e1-0500c19fb312 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:57:40.007822 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-31dd8208-d930-4446-8b97-5e0811ead1ae tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:40.018013 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-31dd8208-d930-4446-8b97-5e0811ead1ae tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10" status: 200 len: 1506 microversion: 2.1 time: 0.205506 Aug 31 15:57:40.019331 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1101/2108] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:39 2022] GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10 => generated 1506 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:40.024816 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-212970d8-ed1d-4204-b2eb-d41a98404c40 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:40.025530 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-212970d8-ed1d-4204-b2eb-d41a98404c40 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] [instance: d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:40.033211 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-212970d8-ed1d-4204-b2eb-d41a98404c40 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:40.033787 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-212970d8-ed1d-4204-b2eb-d41a98404c40 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:40.034582 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-212970d8-ed1d-4204-b2eb-d41a98404c40 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:40.035460 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-212970d8-ed1d-4204-b2eb-d41a98404c40 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:40.036802 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-212970d8-ed1d-4204-b2eb-d41a98404c40 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:40.037388 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-212970d8-ed1d-4204-b2eb-d41a98404c40 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:40.052203 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-db92ed97-b380-4be7-912d-e84b15eed114 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "POST /compute/v2.1/servers/434ee39d-6510-411f-93e1-0500c19fb312/action" status: 202 len: 0 microversion: 2.1 time: 0.196928 Aug 31 15:57:40.067818 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1008/2109] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 15:57:39 2022] POST /compute/v2.1/servers/434ee39d-6510-411f-93e1-0500c19fb312/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:57:40.091292 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-19773c1c-45d3-4fa8-b8e5-fae34c8cd6b3 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:40.096938 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-19773c1c-45d3-4fa8-b8e5-fae34c8cd6b3 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: 434ee39d-6510-411f-93e1-0500c19fb312] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:40.115899 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19773c1c-45d3-4fa8-b8e5-fae34c8cd6b3 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:40.119772 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19773c1c-45d3-4fa8-b8e5-fae34c8cd6b3 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:40.120303 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19773c1c-45d3-4fa8-b8e5-fae34c8cd6b3 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:40.121053 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19773c1c-45d3-4fa8-b8e5-fae34c8cd6b3 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:40.121509 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19773c1c-45d3-4fa8-b8e5-fae34c8cd6b3 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:40.121926 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19773c1c-45d3-4fa8-b8e5-fae34c8cd6b3 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:40.142821 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-212970d8-ed1d-4204-b2eb-d41a98404c40 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba08a4705f4f0a9bc6a01d16a5f607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055586a03b0a4c1989b3ac658ac6347c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:40.157484 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-212970d8-ed1d-4204-b2eb-d41a98404c40 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] 10.222.0.50 "GET /compute/v2.1/servers/d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe" status: 200 len: 1215 microversion: 2.1 time: 0.136920 Aug 31 15:57:40.161610 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1102/2110] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:40 2022] GET /compute/v2.1/servers/d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe => generated 1215 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:40.169950 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-bdd42549-7d36-4b0c-a1d8-f60a5ba96e7a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:40.177513 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-bdd42549-7d36-4b0c-a1d8-f60a5ba96e7a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 548e0225-fa26-46ba-9c12-7b52feee1784] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:40.180063 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:57:40.203451 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bdd42549-7d36-4b0c-a1d8-f60a5ba96e7a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:40.205189 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bdd42549-7d36-4b0c-a1d8-f60a5ba96e7a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:40.214532 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bdd42549-7d36-4b0c-a1d8-f60a5ba96e7a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:40.218221 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bdd42549-7d36-4b0c-a1d8-f60a5ba96e7a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:40.219107 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bdd42549-7d36-4b0c-a1d8-f60a5ba96e7a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:40.221083 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bdd42549-7d36-4b0c-a1d8-f60a5ba96e7a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:40.531930 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-bdd42549-7d36-4b0c-a1d8-f60a5ba96e7a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:40.547848 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-bdd42549-7d36-4b0c-a1d8-f60a5ba96e7a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:40.549259 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-19773c1c-45d3-4fa8-b8e5-fae34c8cd6b3 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:40.556490 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-bdd42549-7d36-4b0c-a1d8-f60a5ba96e7a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:40.558077 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-bdd42549-7d36-4b0c-a1d8-f60a5ba96e7a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784" status: 200 len: 1486 microversion: 2.25 time: 0.394268 Aug 31 15:57:40.570753 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-19773c1c-45d3-4fa8-b8e5-fae34c8cd6b3 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/434ee39d-6510-411f-93e1-0500c19fb312" status: 200 len: 1495 microversion: 2.1 time: 0.496817 Aug 31 15:57:40.570753 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1009/2111] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:40 2022] GET /compute/v2.1/servers/434ee39d-6510-411f-93e1-0500c19fb312 => generated 1495 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:40.578293 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1103/2112] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:40 2022] GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784 => generated 1486 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:40.586393 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7a077a39-8110-40c2-b795-3bd728ef296f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:40.587541 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7a077a39-8110-40c2-b795-3bd728ef296f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: a9448c8e-c801-4d08-b1c1-b34f279269e6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:40.596743 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a077a39-8110-40c2-b795-3bd728ef296f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:40.598532 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a077a39-8110-40c2-b795-3bd728ef296f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:40.599456 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a077a39-8110-40c2-b795-3bd728ef296f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:40.600360 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a077a39-8110-40c2-b795-3bd728ef296f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:40.601033 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a077a39-8110-40c2-b795-3bd728ef296f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:40.602547 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a077a39-8110-40c2-b795-3bd728ef296f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:40.808298 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c17256d5-afe6-4c0f-a666-d2dd61e90f3b tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:40.809293 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c17256d5-afe6-4c0f-a666-d2dd61e90f3b tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] [instance: c5de4f8b-332b-4e34-8290-cc0d445c50fd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:40.820892 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c17256d5-afe6-4c0f-a666-d2dd61e90f3b tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:40.824479 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c17256d5-afe6-4c0f-a666-d2dd61e90f3b tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:40.825223 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c17256d5-afe6-4c0f-a666-d2dd61e90f3b tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:40.828516 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c17256d5-afe6-4c0f-a666-d2dd61e90f3b tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:40.829896 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c17256d5-afe6-4c0f-a666-d2dd61e90f3b tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:40.830772 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c17256d5-afe6-4c0f-a666-d2dd61e90f3b tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:40.976686 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7a077a39-8110-40c2-b795-3bd728ef296f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922a671cad44ea595e46290a5d52380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1371996a8304dc58ee579daa535bcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:40.993086 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7a077a39-8110-40c2-b795-3bd728ef296f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/a9448c8e-c801-4d08-b1c1-b34f279269e6" status: 200 len: 1314 microversion: 2.1 time: 0.420936 Aug 31 15:57:40.994321 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1010/2113] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:40 2022] GET /compute/v2.1/servers/a9448c8e-c801-4d08-b1c1-b34f279269e6 => generated 1314 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:41.041942 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b8426726-a222-447b-b16e-b3c73ad652b3 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:41.042918 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b8426726-a222-447b-b16e-b3c73ad652b3 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: f044dca7-71de-4182-b5ec-825299496c10] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:41.057067 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8426726-a222-447b-b16e-b3c73ad652b3 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:41.057067 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8426726-a222-447b-b16e-b3c73ad652b3 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:41.057067 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8426726-a222-447b-b16e-b3c73ad652b3 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:41.057814 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8426726-a222-447b-b16e-b3c73ad652b3 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:41.057814 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8426726-a222-447b-b16e-b3c73ad652b3 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:41.058034 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8426726-a222-447b-b16e-b3c73ad652b3 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:41.084066 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c17256d5-afe6-4c0f-a666-d2dd61e90f3b tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1221b21792476baf26260db2bdbe93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f324e55d67b4764b183f7e85e206cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:41.094800 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c17256d5-afe6-4c0f-a666-d2dd61e90f3b tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] 10.222.0.50 "GET /compute/v2.1/servers/c5de4f8b-332b-4e34-8290-cc0d445c50fd" status: 200 len: 1478 microversion: 2.1 time: 0.297061 Aug 31 15:57:41.105368 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1104/2114] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:40 2022] GET /compute/v2.1/servers/c5de4f8b-332b-4e34-8290-cc0d445c50fd => generated 1478 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:41.181553 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-776672d1-46e9-48df-bb47-0e861fbfc025 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:41.182572 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-776672d1-46e9-48df-bb47-0e861fbfc025 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] [instance: d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:41.190144 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-776672d1-46e9-48df-bb47-0e861fbfc025 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:41.190908 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-776672d1-46e9-48df-bb47-0e861fbfc025 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:41.191547 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-776672d1-46e9-48df-bb47-0e861fbfc025 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:41.192465 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-776672d1-46e9-48df-bb47-0e861fbfc025 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:41.196110 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-776672d1-46e9-48df-bb47-0e861fbfc025 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:41.197213 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-776672d1-46e9-48df-bb47-0e861fbfc025 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:41.318684 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-776672d1-46e9-48df-bb47-0e861fbfc025 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba08a4705f4f0a9bc6a01d16a5f607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055586a03b0a4c1989b3ac658ac6347c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:41.327278 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-776672d1-46e9-48df-bb47-0e861fbfc025 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] 10.222.0.50 "GET /compute/v2.1/servers/d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe" status: 200 len: 1271 microversion: 2.1 time: 0.150098 Aug 31 15:57:41.345237 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1105/2115] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:41 2022] GET /compute/v2.1/servers/d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe => generated 1271 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:57:41.372652 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b8426726-a222-447b-b16e-b3c73ad652b3 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:41.381646 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b8426726-a222-447b-b16e-b3c73ad652b3 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10" status: 200 len: 1506 microversion: 2.1 time: 0.343027 Aug 31 15:57:41.382754 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1011/2116] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:41 2022] GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10 => generated 1506 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:41.596342 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-237f8147-f898-4a5f-bd10-60d26ffc1db7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:41.601283 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-49b0f290-91a8-4ed2-a9f9-066b76eaf234 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:41.602417 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-49b0f290-91a8-4ed2-a9f9-066b76eaf234 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: 434ee39d-6510-411f-93e1-0500c19fb312] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:41.602602 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-237f8147-f898-4a5f-bd10-60d26ffc1db7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 548e0225-fa26-46ba-9c12-7b52feee1784] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:41.669129 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-237f8147-f898-4a5f-bd10-60d26ffc1db7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:41.669633 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49b0f290-91a8-4ed2-a9f9-066b76eaf234 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:41.671247 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49b0f290-91a8-4ed2-a9f9-066b76eaf234 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:41.672002 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-237f8147-f898-4a5f-bd10-60d26ffc1db7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:41.676164 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49b0f290-91a8-4ed2-a9f9-066b76eaf234 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:41.678179 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-237f8147-f898-4a5f-bd10-60d26ffc1db7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:41.679557 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49b0f290-91a8-4ed2-a9f9-066b76eaf234 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:41.682299 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-237f8147-f898-4a5f-bd10-60d26ffc1db7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:41.683022 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-237f8147-f898-4a5f-bd10-60d26ffc1db7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:41.683403 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49b0f290-91a8-4ed2-a9f9-066b76eaf234 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:41.684029 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49b0f290-91a8-4ed2-a9f9-066b76eaf234 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:41.684607 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-237f8147-f898-4a5f-bd10-60d26ffc1db7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:42.147627 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-49b0f290-91a8-4ed2-a9f9-066b76eaf234 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:42.158336 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-49b0f290-91a8-4ed2-a9f9-066b76eaf234 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/434ee39d-6510-411f-93e1-0500c19fb312" status: 200 len: 1478 microversion: 2.1 time: 0.570472 Aug 31 15:57:42.172004 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-237f8147-f898-4a5f-bd10-60d26ffc1db7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:42.179099 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1012/2117] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:41 2022] GET /compute/v2.1/servers/434ee39d-6510-411f-93e1-0500c19fb312 => generated 1478 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:57:42.182045 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-237f8147-f898-4a5f-bd10-60d26ffc1db7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:42.183676 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-237f8147-f898-4a5f-bd10-60d26ffc1db7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:42.187430 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-237f8147-f898-4a5f-bd10-60d26ffc1db7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784" status: 200 len: 1486 microversion: 2.25 time: 0.605004 Aug 31 15:57:42.202471 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cb508bab-dd92-4f7c-8b3a-7895948a296e tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:42.202596 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1106/2118] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:41 2022] GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784 => generated 1486 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:42.202596 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a907a37d-5cd5-4378-a48a-0ffc52e5bb05 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:42.202596 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a907a37d-5cd5-4378-a48a-0ffc52e5bb05 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] [instance: c5de4f8b-332b-4e34-8290-cc0d445c50fd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:42.203665 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cb508bab-dd92-4f7c-8b3a-7895948a296e tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: a9448c8e-c801-4d08-b1c1-b34f279269e6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:42.217935 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a907a37d-5cd5-4378-a48a-0ffc52e5bb05 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:42.218440 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a907a37d-5cd5-4378-a48a-0ffc52e5bb05 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:42.218945 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a907a37d-5cd5-4378-a48a-0ffc52e5bb05 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:42.223943 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a907a37d-5cd5-4378-a48a-0ffc52e5bb05 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:42.224211 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a907a37d-5cd5-4378-a48a-0ffc52e5bb05 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:42.224593 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a907a37d-5cd5-4378-a48a-0ffc52e5bb05 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:42.224982 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb508bab-dd92-4f7c-8b3a-7895948a296e tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:42.225542 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb508bab-dd92-4f7c-8b3a-7895948a296e tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:42.226003 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb508bab-dd92-4f7c-8b3a-7895948a296e tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:42.231803 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb508bab-dd92-4f7c-8b3a-7895948a296e tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:42.233122 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb508bab-dd92-4f7c-8b3a-7895948a296e tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:42.235837 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb508bab-dd92-4f7c-8b3a-7895948a296e tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:42.805965 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cb508bab-dd92-4f7c-8b3a-7895948a296e tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922a671cad44ea595e46290a5d52380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1371996a8304dc58ee579daa535bcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:42.821281 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cb508bab-dd92-4f7c-8b3a-7895948a296e tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/a9448c8e-c801-4d08-b1c1-b34f279269e6" status: 200 len: 1314 microversion: 2.1 time: 0.639324 Aug 31 15:57:42.824103 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1013/2119] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:42 2022] GET /compute/v2.1/servers/a9448c8e-c801-4d08-b1c1-b34f279269e6 => generated 1314 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:42.841441 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1f5baac7-d04d-4e92-80a3-35ce1d709e90 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1766196096"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:42.843943 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1f5baac7-d04d-4e92-80a3-35ce1d709e90 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: 434ee39d-6510-411f-93e1-0500c19fb312] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:42.868196 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f5baac7-d04d-4e92-80a3-35ce1d709e90 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:42.868546 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f5baac7-d04d-4e92-80a3-35ce1d709e90 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:42.869010 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f5baac7-d04d-4e92-80a3-35ce1d709e90 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:42.869789 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f5baac7-d04d-4e92-80a3-35ce1d709e90 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:42.870291 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f5baac7-d04d-4e92-80a3-35ce1d709e90 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:42.878025 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f5baac7-d04d-4e92-80a3-35ce1d709e90 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:42.879133 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a907a37d-5cd5-4378-a48a-0ffc52e5bb05 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1221b21792476baf26260db2bdbe93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f324e55d67b4764b183f7e85e206cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:42.894806 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a907a37d-5cd5-4378-a48a-0ffc52e5bb05 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] 10.222.0.50 "GET /compute/v2.1/servers/c5de4f8b-332b-4e34-8290-cc0d445c50fd" status: 200 len: 1478 microversion: 2.1 time: 0.696160 Aug 31 15:57:42.896891 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1107/2120] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:42 2022] GET /compute/v2.1/servers/c5de4f8b-332b-4e34-8290-cc0d445c50fd => generated 1478 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:42.912177 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a62b4dae-e2a8-47e8-843f-edd01fe3c1a4 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:42.915767 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a62b4dae-e2a8-47e8-843f-edd01fe3c1a4 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] [instance: d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:42.940993 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a62b4dae-e2a8-47e8-843f-edd01fe3c1a4 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:42.941618 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a62b4dae-e2a8-47e8-843f-edd01fe3c1a4 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:42.944046 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a62b4dae-e2a8-47e8-843f-edd01fe3c1a4 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:42.944975 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a62b4dae-e2a8-47e8-843f-edd01fe3c1a4 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:42.946539 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a62b4dae-e2a8-47e8-843f-edd01fe3c1a4 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:42.947732 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a62b4dae-e2a8-47e8-843f-edd01fe3c1a4 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:43.087041 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a62b4dae-e2a8-47e8-843f-edd01fe3c1a4 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba08a4705f4f0a9bc6a01d16a5f607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055586a03b0a4c1989b3ac658ac6347c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:43.100202 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a62b4dae-e2a8-47e8-843f-edd01fe3c1a4 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] 10.222.0.50 "GET /compute/v2.1/servers/d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe" status: 200 len: 1277 microversion: 2.1 time: 0.196340 Aug 31 15:57:43.118810 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1108/2121] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:42 2022] GET /compute/v2.1/servers/d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe => generated 1277 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:43.124782 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5e25873f-b539-45cb-ac18-f7d23561348a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:43.125608 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5e25873f-b539-45cb-ac18-f7d23561348a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: f044dca7-71de-4182-b5ec-825299496c10] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:43.132410 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e25873f-b539-45cb-ac18-f7d23561348a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:43.133109 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e25873f-b539-45cb-ac18-f7d23561348a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:43.133753 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e25873f-b539-45cb-ac18-f7d23561348a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:43.135086 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e25873f-b539-45cb-ac18-f7d23561348a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:43.135800 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e25873f-b539-45cb-ac18-f7d23561348a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:43.136374 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e25873f-b539-45cb-ac18-f7d23561348a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:43.265831 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1f5baac7-d04d-4e92-80a3-35ce1d709e90 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "POST /compute/v2.1/servers/434ee39d-6510-411f-93e1-0500c19fb312/action" status: 202 len: 0 microversion: 2.1 time: 0.437633 Aug 31 15:57:43.267680 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1014/2122] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 15:57:42 2022] POST /compute/v2.1/servers/434ee39d-6510-411f-93e1-0500c19fb312/action => generated 0 bytes in 443 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 31 15:57:43.283037 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-7595ea24-4e81-42d2-b141-bd6e0a59d2a6 req-9f6ad9c8-2fc2-40df-bdf7-b8cc467e04e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5de4f8b-332b-4e34-8290-cc0d445c50fd", "name": "network-vif-deleted", "tag": "2c9bf410-c8d1-4264-92a1-8db9e76a7565"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:43.309415 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7595ea24-4e81-42d2-b141-bd6e0a59d2a6 req-9f6ad9c8-2fc2-40df-bdf7-b8cc467e04e2 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:43.310818 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7595ea24-4e81-42d2-b141-bd6e0a59d2a6 req-9f6ad9c8-2fc2-40df-bdf7-b8cc467e04e2 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:43.311810 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7595ea24-4e81-42d2-b141-bd6e0a59d2a6 req-9f6ad9c8-2fc2-40df-bdf7-b8cc467e04e2 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:43.345359 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-7595ea24-4e81-42d2-b141-bd6e0a59d2a6 req-9f6ad9c8-2fc2-40df-bdf7-b8cc467e04e2 service nova] Creating event network-vif-deleted:2c9bf410-c8d1-4264-92a1-8db9e76a7565 for instance c5de4f8b-332b-4e34-8290-cc0d445c50fd on n-h2-833090-16 Aug 31 15:57:43.351610 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-7595ea24-4e81-42d2-b141-bd6e0a59d2a6 req-9f6ad9c8-2fc2-40df-bdf7-b8cc467e04e2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082263 Aug 31 15:57:43.354405 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1015/2123] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:57:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:43.363921 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9643ab39-7be6-43b2-a55a-63eccecc1308 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:43.369528 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9643ab39-7be6-43b2-a55a-63eccecc1308 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 548e0225-fa26-46ba-9c12-7b52feee1784] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:43.380644 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9643ab39-7be6-43b2-a55a-63eccecc1308 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:43.385455 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9643ab39-7be6-43b2-a55a-63eccecc1308 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:43.386304 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9643ab39-7be6-43b2-a55a-63eccecc1308 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:43.387378 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9643ab39-7be6-43b2-a55a-63eccecc1308 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:43.387985 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9643ab39-7be6-43b2-a55a-63eccecc1308 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:43.391826 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9643ab39-7be6-43b2-a55a-63eccecc1308 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:44.071066 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5e25873f-b539-45cb-ac18-f7d23561348a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:44.090518 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9643ab39-7be6-43b2-a55a-63eccecc1308 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:44.099097 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9643ab39-7be6-43b2-a55a-63eccecc1308 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:44.100520 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9643ab39-7be6-43b2-a55a-63eccecc1308 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:44.101021 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5e25873f-b539-45cb-ac18-f7d23561348a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10" status: 200 len: 1506 microversion: 2.1 time: 0.963099 Aug 31 15:57:44.101706 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9643ab39-7be6-43b2-a55a-63eccecc1308 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784" status: 200 len: 1486 microversion: 2.25 time: 0.745922 Aug 31 15:57:44.102309 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1016/2124] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:43 2022] GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784 => generated 1486 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:44.103965 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1109/2125] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:43 2022] GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10 => generated 1506 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:44.120217 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c1b40d22-d1ea-428e-8f1b-d978479c6033 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:44.132366 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b183ff21-1e68-4f94-81bc-18ba3cba770b tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb4aa0dee0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:44.135947 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c1b40d22-d1ea-428e-8f1b-d978479c6033 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: a9448c8e-c801-4d08-b1c1-b34f279269e6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:44.150589 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c1b40d22-d1ea-428e-8f1b-d978479c6033 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:44.151446 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c1b40d22-d1ea-428e-8f1b-d978479c6033 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:44.152880 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c1b40d22-d1ea-428e-8f1b-d978479c6033 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:44.153783 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c1b40d22-d1ea-428e-8f1b-d978479c6033 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:44.154586 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c1b40d22-d1ea-428e-8f1b-d978479c6033 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:44.155251 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c1b40d22-d1ea-428e-8f1b-d978479c6033 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:44.236494 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b183ff21-1e68-4f94-81bc-18ba3cba770b tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/images/a44aac17-897f-4534-9995-797398bda710" status: 200 len: 1438 microversion: 2.1 time: 0.131011 Aug 31 15:57:44.237677 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1110/2126] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:57:44 2022] GET /compute/v2.1/images/a44aac17-897f-4534-9995-797398bda710 => generated 1438 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:44.246243 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d886ed58-3aad-4ac9-b5ea-9ee9e2cab1c7 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:44.247267 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d886ed58-3aad-4ac9-b5ea-9ee9e2cab1c7 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] [instance: c5de4f8b-332b-4e34-8290-cc0d445c50fd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:44.255176 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d886ed58-3aad-4ac9-b5ea-9ee9e2cab1c7 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:44.258488 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d886ed58-3aad-4ac9-b5ea-9ee9e2cab1c7 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:44.259375 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d886ed58-3aad-4ac9-b5ea-9ee9e2cab1c7 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:44.260337 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d886ed58-3aad-4ac9-b5ea-9ee9e2cab1c7 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:44.260996 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d886ed58-3aad-4ac9-b5ea-9ee9e2cab1c7 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:44.261631 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d886ed58-3aad-4ac9-b5ea-9ee9e2cab1c7 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:44.282136 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-d886ed58-3aad-4ac9-b5ea-9ee9e2cab1c7 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] HTTP exception thrown: Instance c5de4f8b-332b-4e34-8290-cc0d445c50fd could not be found. Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d886ed58-3aad-4ac9-b5ea-9ee9e2cab1c7 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Request method failure captured: Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/c5de4f8b-332b-4e34-8290-cc0d445c50fd HTTP/1.1 Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4TLtVkUMT2ZtolOJmloox0aJbsA-y-1I_y1s5IsXKk9676VYiBW7FzCT99RbbdH26BTrsSAAD8FSUnmXk8rfDBoAc30opWEEdXUZL_NbD3iKp1ON8x5GV4GA_HSxUt1Bp2FDe0VXLqJPT_7UscHzqNWBPLevlkhR1vFNPL8ASdj6W4 Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 2f324e55d67b4764b183f7e85e206cb3 Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-272452252 Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2f324e55d67b4764b183f7e85e206cb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2f324e55d67b4764b183f7e85e206cb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2f324e55d67b4764b183f7e85e206cb3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2f324e55d67b4764b183f7e85e206cb3", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-272452252 Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 2f324e55d67b4764b183f7e85e206cb3 Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-272452252 Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServerDiagnosticsNegativeTest-272452252-project Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 0d1221b21792476baf26260db2bdbe93 Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-272452252-project Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance c5de4f8b-332b-4e34-8290-cc0d445c50fd could not be found. Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'c5de4f8b-332b-4e34-8290-cc0d445c50fd'} Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5de4f8b-332b-4e34-8290-cc0d445c50fd could not be found. Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5de4f8b-332b-4e34-8290-cc0d445c50fd could not be found. Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:57:44.284918 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:57:44.289645 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:57:44.289645 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:57:44.289645 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:57:44.289645 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:57:44.289645 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:57:44.289645 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:57:44.289645 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5de4f8b-332b-4e34-8290-cc0d445c50fd could not be found. Aug 31 15:57:44.289645 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:57:44.294733 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d886ed58-3aad-4ac9-b5ea-9ee9e2cab1c7 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] Returning 404 to user: Instance c5de4f8b-332b-4e34-8290-cc0d445c50fd could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:57:44.296023 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d886ed58-3aad-4ac9-b5ea-9ee9e2cab1c7 tempest-ServerDiagnosticsNegativeTest-272452252 tempest-ServerDiagnosticsNegativeTest-272452252-project] 10.222.0.50 "GET /compute/v2.1/servers/c5de4f8b-332b-4e34-8290-cc0d445c50fd" status: 404 len: 111 microversion: 2.1 time: 0.057052 Aug 31 15:57:44.297277 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1111/2127] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:44 2022] GET /compute/v2.1/servers/c5de4f8b-332b-4e34-8290-cc0d445c50fd => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:57:44.320006 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-146d412e-713a-4e70-a3d6-9ee58629a695 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:44.325347 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-146d412e-713a-4e70-a3d6-9ee58629a695 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] [instance: d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:44.332356 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:57:44.337332 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-146d412e-713a-4e70-a3d6-9ee58629a695 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:44.343425 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-146d412e-713a-4e70-a3d6-9ee58629a695 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:44.343811 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-146d412e-713a-4e70-a3d6-9ee58629a695 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:44.344612 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-146d412e-713a-4e70-a3d6-9ee58629a695 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:44.345132 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-146d412e-713a-4e70-a3d6-9ee58629a695 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:44.345618 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-146d412e-713a-4e70-a3d6-9ee58629a695 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:44.648613 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c1b40d22-d1ea-428e-8f1b-d978479c6033 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922a671cad44ea595e46290a5d52380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1371996a8304dc58ee579daa535bcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:44.662504 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c1b40d22-d1ea-428e-8f1b-d978479c6033 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/a9448c8e-c801-4d08-b1c1-b34f279269e6" status: 200 len: 1499 microversion: 2.1 time: 0.554476 Aug 31 15:57:44.664787 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1017/2128] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:44 2022] GET /compute/v2.1/servers/a9448c8e-c801-4d08-b1c1-b34f279269e6 => generated 1499 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:44.691304 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d80c2fb4-9877-464a-ac63-7045a94605ea tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:44.694880 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d80c2fb4-9877-464a-ac63-7045a94605ea tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: a9448c8e-c801-4d08-b1c1-b34f279269e6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:44.705148 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d80c2fb4-9877-464a-ac63-7045a94605ea tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:44.705970 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d80c2fb4-9877-464a-ac63-7045a94605ea tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:44.706653 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d80c2fb4-9877-464a-ac63-7045a94605ea tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:44.707637 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d80c2fb4-9877-464a-ac63-7045a94605ea tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:44.708666 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d80c2fb4-9877-464a-ac63-7045a94605ea tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:44.709271 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d80c2fb4-9877-464a-ac63-7045a94605ea tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:44.743142 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-d80c2fb4-9877-464a-ac63-7045a94605ea tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lazy-loading 'flavor' on Instance uuid a9448c8e-c801-4d08-b1c1-b34f279269e6 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:57:44.912676 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d80c2fb4-9877-464a-ac63-7045a94605ea tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "POST /compute/v2.1/servers/a9448c8e-c801-4d08-b1c1-b34f279269e6/action" status: 200 len: 32 microversion: 2.1 time: 0.197128 Aug 31 15:57:44.918142 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1018/2129] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 15:57:44 2022] POST /compute/v2.1/servers/a9448c8e-c801-4d08-b1c1-b34f279269e6/action => generated 32 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 15:57:44.933909 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5eb5a390-1bac-4b20-8f4d-83c8a447da26 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:44.939228 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5eb5a390-1bac-4b20-8f4d-83c8a447da26 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: a9448c8e-c801-4d08-b1c1-b34f279269e6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:44.975895 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5eb5a390-1bac-4b20-8f4d-83c8a447da26 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:44.978329 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-146d412e-713a-4e70-a3d6-9ee58629a695 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba08a4705f4f0a9bc6a01d16a5f607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055586a03b0a4c1989b3ac658ac6347c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:44.979453 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5eb5a390-1bac-4b20-8f4d-83c8a447da26 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:44.983137 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5eb5a390-1bac-4b20-8f4d-83c8a447da26 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:44.985377 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5eb5a390-1bac-4b20-8f4d-83c8a447da26 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:44.986226 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5eb5a390-1bac-4b20-8f4d-83c8a447da26 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:44.986930 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5eb5a390-1bac-4b20-8f4d-83c8a447da26 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:45.002421 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-146d412e-713a-4e70-a3d6-9ee58629a695 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] 10.222.0.50 "GET /compute/v2.1/servers/d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe" status: 200 len: 1319 microversion: 2.1 time: 0.701648 Aug 31 15:57:45.003507 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1112/2130] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:44 2022] GET /compute/v2.1/servers/d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe => generated 1319 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:45.126563 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2ea95377-afb9-483d-ab8b-e0a15582e685 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:45.128956 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2ea95377-afb9-483d-ab8b-e0a15582e685 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: f044dca7-71de-4182-b5ec-825299496c10] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:45.161228 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:57:45.165397 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2ea95377-afb9-483d-ab8b-e0a15582e685 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:45.166936 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2ea95377-afb9-483d-ab8b-e0a15582e685 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:45.167661 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2ea95377-afb9-483d-ab8b-e0a15582e685 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:45.185668 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2ea95377-afb9-483d-ab8b-e0a15582e685 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:45.186723 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2ea95377-afb9-483d-ab8b-e0a15582e685 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:45.188360 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2ea95377-afb9-483d-ab8b-e0a15582e685 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:45.462564 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5eb5a390-1bac-4b20-8f4d-83c8a447da26 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922a671cad44ea595e46290a5d52380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1371996a8304dc58ee579daa535bcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:45.478652 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5eb5a390-1bac-4b20-8f4d-83c8a447da26 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/a9448c8e-c801-4d08-b1c1-b34f279269e6" status: 200 len: 1505 microversion: 2.1 time: 0.552909 Aug 31 15:57:45.479335 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1019/2131] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:44 2022] GET /compute/v2.1/servers/a9448c8e-c801-4d08-b1c1-b34f279269e6 => generated 1505 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:45.484919 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8abed0cf-3021-45d0-b971-3cf3fc928546 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:45.485523 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8abed0cf-3021-45d0-b971-3cf3fc928546 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 548e0225-fa26-46ba-9c12-7b52feee1784] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:45.504267 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8abed0cf-3021-45d0-b971-3cf3fc928546 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:45.504764 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8abed0cf-3021-45d0-b971-3cf3fc928546 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:45.505214 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8abed0cf-3021-45d0-b971-3cf3fc928546 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:45.505928 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8abed0cf-3021-45d0-b971-3cf3fc928546 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:45.506417 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8abed0cf-3021-45d0-b971-3cf3fc928546 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:45.506849 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8abed0cf-3021-45d0-b971-3cf3fc928546 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:45.784866 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2ea95377-afb9-483d-ab8b-e0a15582e685 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:45.797014 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2ea95377-afb9-483d-ab8b-e0a15582e685 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10" status: 200 len: 1506 microversion: 2.1 time: 0.677186 Aug 31 15:57:45.797596 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1113/2132] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:45 2022] GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10 => generated 1506 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:45.808623 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a12795dd-dd8f-45b1-93ef-29ea1c41f876 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb461a3310>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:45.923199 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a12795dd-dd8f-45b1-93ef-29ea1c41f876 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/images/a44aac17-897f-4534-9995-797398bda710" status: 200 len: 1438 microversion: 2.1 time: 0.124242 Aug 31 15:57:45.924573 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1114/2133] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:57:45 2022] GET /compute/v2.1/images/a44aac17-897f-4534-9995-797398bda710 => generated 1438 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:45.945133 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8abed0cf-3021-45d0-b971-3cf3fc928546 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:45.957748 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8abed0cf-3021-45d0-b971-3cf3fc928546 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:45.959902 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8abed0cf-3021-45d0-b971-3cf3fc928546 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:45.961408 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8abed0cf-3021-45d0-b971-3cf3fc928546 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784" status: 200 len: 1486 microversion: 2.25 time: 0.481079 Aug 31 15:57:45.962953 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1020/2134] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:45 2022] GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784 => generated 1486 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:46.028917 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2a00d9cd-ee30-40ff-94ea-f009681dfabf tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:46.029592 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2a00d9cd-ee30-40ff-94ea-f009681dfabf tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] [instance: d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:46.050960 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2a00d9cd-ee30-40ff-94ea-f009681dfabf tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:46.051467 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2a00d9cd-ee30-40ff-94ea-f009681dfabf tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:46.052149 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2a00d9cd-ee30-40ff-94ea-f009681dfabf tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:46.064574 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2a00d9cd-ee30-40ff-94ea-f009681dfabf tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:46.065217 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2a00d9cd-ee30-40ff-94ea-f009681dfabf tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:46.065796 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2a00d9cd-ee30-40ff-94ea-f009681dfabf tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:46.385685 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2a00d9cd-ee30-40ff-94ea-f009681dfabf tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba08a4705f4f0a9bc6a01d16a5f607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055586a03b0a4c1989b3ac658ac6347c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:46.399496 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2a00d9cd-ee30-40ff-94ea-f009681dfabf tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] 10.222.0.50 "GET /compute/v2.1/servers/d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe" status: 200 len: 1319 microversion: 2.1 time: 0.375458 Aug 31 15:57:46.400448 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1115/2135] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:46 2022] GET /compute/v2.1/servers/d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe => generated 1319 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:46.511309 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-203cd770-9a41-417e-9af2-a7f3d4af4cf7 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:46.511948 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-203cd770-9a41-417e-9af2-a7f3d4af4cf7 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: a9448c8e-c801-4d08-b1c1-b34f279269e6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:46.531750 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-203cd770-9a41-417e-9af2-a7f3d4af4cf7 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:46.534316 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-203cd770-9a41-417e-9af2-a7f3d4af4cf7 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:46.534996 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-203cd770-9a41-417e-9af2-a7f3d4af4cf7 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:46.539821 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-203cd770-9a41-417e-9af2-a7f3d4af4cf7 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:46.547498 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-203cd770-9a41-417e-9af2-a7f3d4af4cf7 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:46.548972 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-203cd770-9a41-417e-9af2-a7f3d4af4cf7 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:46.820202 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-08575254-01ef-4727-8e87-19b4f6f816cf tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:46.821528 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-08575254-01ef-4727-8e87-19b4f6f816cf tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: f044dca7-71de-4182-b5ec-825299496c10] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:46.838940 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-08575254-01ef-4727-8e87-19b4f6f816cf tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:46.839768 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-08575254-01ef-4727-8e87-19b4f6f816cf tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:46.840209 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-08575254-01ef-4727-8e87-19b4f6f816cf tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:46.840927 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-08575254-01ef-4727-8e87-19b4f6f816cf tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:46.855471 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-08575254-01ef-4727-8e87-19b4f6f816cf tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:46.856305 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-08575254-01ef-4727-8e87-19b4f6f816cf tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:46.868447 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:57:46.902925 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-203cd770-9a41-417e-9af2-a7f3d4af4cf7 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922a671cad44ea595e46290a5d52380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1371996a8304dc58ee579daa535bcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:46.920141 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-203cd770-9a41-417e-9af2-a7f3d4af4cf7 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/a9448c8e-c801-4d08-b1c1-b34f279269e6" status: 200 len: 1505 microversion: 2.1 time: 0.415587 Aug 31 15:57:46.920920 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1021/2136] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:46 2022] GET /compute/v2.1/servers/a9448c8e-c801-4d08-b1c1-b34f279269e6 => generated 1505 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:46.944468 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6e046337-01d1-4c03-be8f-3ce9ce5b5a03 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb4abc3670>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:47.009052 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6e046337-01d1-4c03-be8f-3ce9ce5b5a03 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/images/a44aac17-897f-4534-9995-797398bda710" status: 200 len: 1438 microversion: 2.1 time: 0.069130 Aug 31 15:57:47.011084 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1022/2137] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:57:46 2022] GET /compute/v2.1/images/a44aac17-897f-4534-9995-797398bda710 => generated 1438 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:57:47.018120 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c171c979-9794-4766-8c68-7645d9e6a406 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:47.023444 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c171c979-9794-4766-8c68-7645d9e6a406 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 548e0225-fa26-46ba-9c12-7b52feee1784] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:47.033799 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c171c979-9794-4766-8c68-7645d9e6a406 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:47.034787 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c171c979-9794-4766-8c68-7645d9e6a406 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:47.035639 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c171c979-9794-4766-8c68-7645d9e6a406 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:47.036522 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c171c979-9794-4766-8c68-7645d9e6a406 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:47.037133 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c171c979-9794-4766-8c68-7645d9e6a406 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:47.037738 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c171c979-9794-4766-8c68-7645d9e6a406 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:47.688797 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c171c979-9794-4766-8c68-7645d9e6a406 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:47.703824 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c171c979-9794-4766-8c68-7645d9e6a406 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:47.707782 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c171c979-9794-4766-8c68-7645d9e6a406 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:47.712498 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c171c979-9794-4766-8c68-7645d9e6a406 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784" status: 200 len: 1486 microversion: 2.25 time: 0.697788 Aug 31 15:57:47.722630 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1023/2138] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:47 2022] GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784 => generated 1486 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:47.728230 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ea05752f-91e6-46bd-94a2-e288fb0724d4 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:47.733205 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ea05752f-91e6-46bd-94a2-e288fb0724d4 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] [instance: d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:47.746356 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea05752f-91e6-46bd-94a2-e288fb0724d4 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:47.746845 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea05752f-91e6-46bd-94a2-e288fb0724d4 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:47.747315 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea05752f-91e6-46bd-94a2-e288fb0724d4 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:47.750082 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea05752f-91e6-46bd-94a2-e288fb0724d4 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:47.750690 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea05752f-91e6-46bd-94a2-e288fb0724d4 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:47.751222 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea05752f-91e6-46bd-94a2-e288fb0724d4 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:47.811052 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:57:47.855186 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-08575254-01ef-4727-8e87-19b4f6f816cf tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:47.875307 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-08575254-01ef-4727-8e87-19b4f6f816cf tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10" status: 200 len: 1506 microversion: 2.1 time: 1.060103 Aug 31 15:57:47.890628 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1116/2139] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:46 2022] GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10 => generated 1506 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:47.910943 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-a96b1ad0-dff4-4d81-b6ee-c0cb58591420 req-83dbc040-8c40-40ea-917a-102c2a963264 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe", "tag": "355c9967-e584-4ea1-9ceb-8c16fab4e749"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:47.989039 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-a96b1ad0-dff4-4d81-b6ee-c0cb58591420 req-83dbc040-8c40-40ea-917a-102c2a963264 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:47.992671 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-a96b1ad0-dff4-4d81-b6ee-c0cb58591420 req-83dbc040-8c40-40ea-917a-102c2a963264 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:47.993468 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-a96b1ad0-dff4-4d81-b6ee-c0cb58591420 req-83dbc040-8c40-40ea-917a-102c2a963264 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:48.046662 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-a96b1ad0-dff4-4d81-b6ee-c0cb58591420 req-83dbc040-8c40-40ea-917a-102c2a963264 service nova] Creating event network-changed:355c9967-e584-4ea1-9ceb-8c16fab4e749 for instance d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe on n-h1-833090-16 Aug 31 15:57:48.103426 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-a96b1ad0-dff4-4d81-b6ee-c0cb58591420 req-83dbc040-8c40-40ea-917a-102c2a963264 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176302 Aug 31 15:57:48.106037 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1117/2140] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:48.136075 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3776ac75-702a-40fe-b209-714cbb6484ca tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:48.138462 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3776ac75-702a-40fe-b209-714cbb6484ca tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: a9448c8e-c801-4d08-b1c1-b34f279269e6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:48.160166 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3776ac75-702a-40fe-b209-714cbb6484ca tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:48.163873 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3776ac75-702a-40fe-b209-714cbb6484ca tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:48.167639 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3776ac75-702a-40fe-b209-714cbb6484ca tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:48.170289 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3776ac75-702a-40fe-b209-714cbb6484ca tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:48.171614 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3776ac75-702a-40fe-b209-714cbb6484ca tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:48.174123 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3776ac75-702a-40fe-b209-714cbb6484ca tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:48.346873 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ea05752f-91e6-46bd-94a2-e288fb0724d4 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba08a4705f4f0a9bc6a01d16a5f607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055586a03b0a4c1989b3ac658ac6347c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:48.356748 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ea05752f-91e6-46bd-94a2-e288fb0724d4 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] 10.222.0.50 "GET /compute/v2.1/servers/d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe" status: 200 len: 1319 microversion: 2.1 time: 0.632654 Aug 31 15:57:48.381117 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1024/2141] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:47 2022] GET /compute/v2.1/servers/d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe => generated 1319 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:48.392651 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-78d0b3b5-23de-4a61-a458-c679e3897b02 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb4ab6a0d0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:48.491086 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-78d0b3b5-23de-4a61-a458-c679e3897b02 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/images/a44aac17-897f-4534-9995-797398bda710" status: 200 len: 1438 microversion: 2.1 time: 0.108495 Aug 31 15:57:48.492133 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1025/2142] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:57:48 2022] GET /compute/v2.1/images/a44aac17-897f-4534-9995-797398bda710 => generated 1438 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:48.560843 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:57:48.631292 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=6 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:57:48.740297 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-936fbfa1-2f72-417b-a5c7-d6a3e59a122b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:48.741114 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-936fbfa1-2f72-417b-a5c7-d6a3e59a122b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 548e0225-fa26-46ba-9c12-7b52feee1784] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:48.759381 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-936fbfa1-2f72-417b-a5c7-d6a3e59a122b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:48.760019 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-936fbfa1-2f72-417b-a5c7-d6a3e59a122b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:48.765019 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-936fbfa1-2f72-417b-a5c7-d6a3e59a122b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:48.766001 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-936fbfa1-2f72-417b-a5c7-d6a3e59a122b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:48.766682 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-936fbfa1-2f72-417b-a5c7-d6a3e59a122b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:48.767711 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-936fbfa1-2f72-417b-a5c7-d6a3e59a122b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:48.937743 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:57:49.554190 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-936fbfa1-2f72-417b-a5c7-d6a3e59a122b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:49.565882 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3776ac75-702a-40fe-b209-714cbb6484ca tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922a671cad44ea595e46290a5d52380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1371996a8304dc58ee579daa535bcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:49.575159 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-936fbfa1-2f72-417b-a5c7-d6a3e59a122b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:49.579158 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3776ac75-702a-40fe-b209-714cbb6484ca tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/a9448c8e-c801-4d08-b1c1-b34f279269e6" status: 200 len: 1505 microversion: 2.1 time: 1.469631 Aug 31 15:57:49.580337 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-936fbfa1-2f72-417b-a5c7-d6a3e59a122b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:49.582765 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1118/2143] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:48 2022] GET /compute/v2.1/servers/a9448c8e-c801-4d08-b1c1-b34f279269e6 => generated 1505 bytes in 1474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:49.584477 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-936fbfa1-2f72-417b-a5c7-d6a3e59a122b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784" status: 200 len: 1486 microversion: 2.25 time: 0.849008 Aug 31 15:57:49.593990 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fa9dde7b-9aad-4296-911a-dda400746fbf tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:49.598782 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fa9dde7b-9aad-4296-911a-dda400746fbf tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: f044dca7-71de-4182-b5ec-825299496c10] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:49.609579 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1026/2144] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:48 2022] GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784 => generated 1486 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 15:57:49.630646 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-e623f4ce-affd-4516-8116-163613a4314c req-b6cd73b4-5ee1-479a-9ff0-2db9bec3a2fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "434ee39d-6510-411f-93e1-0500c19fb312", "name": "network-vif-plugged", "status": "completed", "tag": "5109e7a2-31db-42fd-b192-796f0b872104"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:49.642025 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fa9dde7b-9aad-4296-911a-dda400746fbf tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:49.643398 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fa9dde7b-9aad-4296-911a-dda400746fbf tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:49.644054 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fa9dde7b-9aad-4296-911a-dda400746fbf tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:49.645311 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fa9dde7b-9aad-4296-911a-dda400746fbf tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:49.648264 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fa9dde7b-9aad-4296-911a-dda400746fbf tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:49.650197 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fa9dde7b-9aad-4296-911a-dda400746fbf tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:49.670395 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e623f4ce-affd-4516-8116-163613a4314c req-b6cd73b4-5ee1-479a-9ff0-2db9bec3a2fc service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:49.676806 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e623f4ce-affd-4516-8116-163613a4314c req-b6cd73b4-5ee1-479a-9ff0-2db9bec3a2fc service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:49.679413 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e623f4ce-affd-4516-8116-163613a4314c req-b6cd73b4-5ee1-479a-9ff0-2db9bec3a2fc service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:49.733047 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-e623f4ce-affd-4516-8116-163613a4314c req-b6cd73b4-5ee1-479a-9ff0-2db9bec3a2fc service nova] Creating event network-vif-plugged:5109e7a2-31db-42fd-b192-796f0b872104 for instance 434ee39d-6510-411f-93e1-0500c19fb312 on n-h1-833090-16 Aug 31 15:57:49.764387 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-e623f4ce-affd-4516-8116-163613a4314c req-b6cd73b4-5ee1-479a-9ff0-2db9bec3a2fc service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148424 Aug 31 15:57:49.766386 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1027/2145] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:49.774251 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a26d5cb5-d3af-4539-bbd6-b1a2fe626724 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:49.776441 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a26d5cb5-d3af-4539-bbd6-b1a2fe626724 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] [instance: d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:49.789904 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a26d5cb5-d3af-4539-bbd6-b1a2fe626724 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:49.791380 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a26d5cb5-d3af-4539-bbd6-b1a2fe626724 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:49.792338 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a26d5cb5-d3af-4539-bbd6-b1a2fe626724 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:49.793544 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a26d5cb5-d3af-4539-bbd6-b1a2fe626724 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:49.794987 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a26d5cb5-d3af-4539-bbd6-b1a2fe626724 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:49.799200 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a26d5cb5-d3af-4539-bbd6-b1a2fe626724 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:50.314071 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a26d5cb5-d3af-4539-bbd6-b1a2fe626724 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba08a4705f4f0a9bc6a01d16a5f607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055586a03b0a4c1989b3ac658ac6347c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:50.327383 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-fa9dde7b-9aad-4296-911a-dda400746fbf tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:50.327553 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a26d5cb5-d3af-4539-bbd6-b1a2fe626724 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] 10.222.0.50 "GET /compute/v2.1/servers/d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe" status: 200 len: 1319 microversion: 2.1 time: 0.559525 Aug 31 15:57:50.328072 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1028/2146] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:49 2022] GET /compute/v2.1/servers/d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe => generated 1319 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:50.335483 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-88a34d28-b896-4e4e-81df-6192fc087154 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb4ab6c0d0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:50.373097 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fa9dde7b-9aad-4296-911a-dda400746fbf tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10" status: 200 len: 1506 microversion: 2.1 time: 0.789105 Aug 31 15:57:50.393448 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1119/2147] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:49 2022] GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10 => generated 1506 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:50.424008 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-88a34d28-b896-4e4e-81df-6192fc087154 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/images/a44aac17-897f-4534-9995-797398bda710" status: 200 len: 1438 microversion: 2.1 time: 0.094881 Aug 31 15:57:50.426751 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1029/2148] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:57:50 2022] GET /compute/v2.1/images/a44aac17-897f-4534-9995-797398bda710 => generated 1438 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:50.604426 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-16359982-c77c-442c-9a05-5b2d910a8d6a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:50.605967 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-16359982-c77c-442c-9a05-5b2d910a8d6a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: a9448c8e-c801-4d08-b1c1-b34f279269e6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:50.621332 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16359982-c77c-442c-9a05-5b2d910a8d6a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:50.622210 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16359982-c77c-442c-9a05-5b2d910a8d6a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:50.622872 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16359982-c77c-442c-9a05-5b2d910a8d6a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:50.625797 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16359982-c77c-442c-9a05-5b2d910a8d6a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:50.626647 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16359982-c77c-442c-9a05-5b2d910a8d6a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:50.627338 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16359982-c77c-442c-9a05-5b2d910a8d6a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:50.685577 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a683fc79-3575-41b1-a3bc-03313ad8fde2 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-456484274", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": "none"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:50.792469 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-a683fc79-3575-41b1-a3bc-03313ad8fde2 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:57:50.793019 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-a683fc79-3575-41b1-a3bc-03313ad8fde2 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:57:50.793552 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-a683fc79-3575-41b1-a3bc-03313ad8fde2 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:57:50.793971 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-a683fc79-3575-41b1-a3bc-03313ad8fde2 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:57:50.794491 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-a683fc79-3575-41b1-a3bc-03313ad8fde2 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:57:50.808466 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a683fc79-3575-41b1-a3bc-03313ad8fde2 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:50.808888 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a683fc79-3575-41b1-a3bc-03313ad8fde2 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:50.809329 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a683fc79-3575-41b1-a3bc-03313ad8fde2 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:50.810070 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a683fc79-3575-41b1-a3bc-03313ad8fde2 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:50.810564 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a683fc79-3575-41b1-a3bc-03313ad8fde2 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:50.810994 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a683fc79-3575-41b1-a3bc-03313ad8fde2 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:50.857661 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-a683fc79-3575-41b1-a3bc-03313ad8fde2 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Getting quotas for project 273e7f33aad24bd89d3880179c838d8f. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:57:50.867162 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-a683fc79-3575-41b1-a3bc-03313ad8fde2 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Getting quotas for user acbc85a6cc2347dfb0834848e9fa5fcd and project 273e7f33aad24bd89d3880179c838d8f. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:57:50.894465 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a683fc79-3575-41b1-a3bc-03313ad8fde2 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:57:50.898025 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a683fc79-3575-41b1-a3bc-03313ad8fde2 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:57:50.970699 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a683fc79-3575-41b1-a3bc-03313ad8fde2 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.561996 Aug 31 15:57:50.980382 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1120/2149] 10.222.0.50 () {62 vars in 1188 bytes} [Wed Aug 31 15:57:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 31 15:57:50.992307 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e64bee4b-e914-4e90-b642-7562b7b86d15 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:50.992934 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e64bee4b-e914-4e90-b642-7562b7b86d15 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 548e0225-fa26-46ba-9c12-7b52feee1784] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:51.000361 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e64bee4b-e914-4e90-b642-7562b7b86d15 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:51.000823 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e64bee4b-e914-4e90-b642-7562b7b86d15 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:51.001264 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e64bee4b-e914-4e90-b642-7562b7b86d15 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:51.001970 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e64bee4b-e914-4e90-b642-7562b7b86d15 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:51.002459 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e64bee4b-e914-4e90-b642-7562b7b86d15 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:51.002884 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e64bee4b-e914-4e90-b642-7562b7b86d15 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:51.060546 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-16359982-c77c-442c-9a05-5b2d910a8d6a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922a671cad44ea595e46290a5d52380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1371996a8304dc58ee579daa535bcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:51.072998 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-16359982-c77c-442c-9a05-5b2d910a8d6a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/a9448c8e-c801-4d08-b1c1-b34f279269e6" status: 200 len: 1505 microversion: 2.1 time: 0.473182 Aug 31 15:57:51.091197 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1030/2150] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:50 2022] GET /compute/v2.1/servers/a9448c8e-c801-4d08-b1c1-b34f279269e6 => generated 1505 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:57:51.105221 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8a0f5188-7ddc-40b6-a5ca-b4f0ffa58f72 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:51.106069 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8a0f5188-7ddc-40b6-a5ca-b4f0ffa58f72 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:51.470451 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8a0f5188-7ddc-40b6-a5ca-b4f0ffa58f72 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:51.496126 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8a0f5188-7ddc-40b6-a5ca-b4f0ffa58f72 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:51.498021 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8a0f5188-7ddc-40b6-a5ca-b4f0ffa58f72 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:51.524278 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8a0f5188-7ddc-40b6-a5ca-b4f0ffa58f72 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1452 microversion: 2.91 time: 0.427981 Aug 31 15:57:51.526149 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1031/2151] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:51 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1452 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:51.541296 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f48b309a-0719-493d-8acf-d7e4d1d4935d tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:51.542478 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f48b309a-0719-493d-8acf-d7e4d1d4935d tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] [instance: d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:51.561211 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f48b309a-0719-493d-8acf-d7e4d1d4935d tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:51.562704 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f48b309a-0719-493d-8acf-d7e4d1d4935d tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:51.563727 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f48b309a-0719-493d-8acf-d7e4d1d4935d tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:51.571679 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f48b309a-0719-493d-8acf-d7e4d1d4935d tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:51.573652 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f48b309a-0719-493d-8acf-d7e4d1d4935d tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:51.574911 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f48b309a-0719-493d-8acf-d7e4d1d4935d tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:51.665782 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e64bee4b-e914-4e90-b642-7562b7b86d15 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:51.680630 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e64bee4b-e914-4e90-b642-7562b7b86d15 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:51.683316 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e64bee4b-e914-4e90-b642-7562b7b86d15 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:51.685697 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e64bee4b-e914-4e90-b642-7562b7b86d15 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784" status: 200 len: 1486 microversion: 2.25 time: 0.712601 Aug 31 15:57:51.687286 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1121/2152] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:50 2022] GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784 => generated 1486 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:51.697029 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a036ee2d-a0ec-4ca5-98ed-cd7d3b211167 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:51.698220 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a036ee2d-a0ec-4ca5-98ed-cd7d3b211167 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: f044dca7-71de-4182-b5ec-825299496c10] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:51.708505 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a036ee2d-a0ec-4ca5-98ed-cd7d3b211167 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:51.711664 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a036ee2d-a0ec-4ca5-98ed-cd7d3b211167 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:51.714345 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a036ee2d-a0ec-4ca5-98ed-cd7d3b211167 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:51.728727 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a036ee2d-a0ec-4ca5-98ed-cd7d3b211167 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:51.739469 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a036ee2d-a0ec-4ca5-98ed-cd7d3b211167 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:51.740362 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a036ee2d-a0ec-4ca5-98ed-cd7d3b211167 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:52.071007 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f48b309a-0719-493d-8acf-d7e4d1d4935d tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba08a4705f4f0a9bc6a01d16a5f607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055586a03b0a4c1989b3ac658ac6347c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:52.084433 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f48b309a-0719-493d-8acf-d7e4d1d4935d tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] 10.222.0.50 "GET /compute/v2.1/servers/d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe" status: 200 len: 1319 microversion: 2.1 time: 0.556828 Aug 31 15:57:52.090856 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1032/2153] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:51 2022] GET /compute/v2.1/servers/d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe => generated 1319 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:52.114769 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7f17e572-4e25-47b7-90e8-ad291e3809b4 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb464c23a0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:52.224512 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7f17e572-4e25-47b7-90e8-ad291e3809b4 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/images/a44aac17-897f-4534-9995-797398bda710" status: 200 len: 1438 microversion: 2.1 time: 0.128781 Aug 31 15:57:52.228164 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1033/2154] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:57:52 2022] GET /compute/v2.1/images/a44aac17-897f-4534-9995-797398bda710 => generated 1438 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:52.251830 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e50be483-95b4-4907-a4f2-4355a8edabcc tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:52.253916 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e50be483-95b4-4907-a4f2-4355a8edabcc tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: a9448c8e-c801-4d08-b1c1-b34f279269e6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:52.279036 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e50be483-95b4-4907-a4f2-4355a8edabcc tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:52.282027 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e50be483-95b4-4907-a4f2-4355a8edabcc tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:52.295619 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e50be483-95b4-4907-a4f2-4355a8edabcc tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:52.304938 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e50be483-95b4-4907-a4f2-4355a8edabcc tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:52.305668 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e50be483-95b4-4907-a4f2-4355a8edabcc tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:52.307803 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e50be483-95b4-4907-a4f2-4355a8edabcc tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:52.757629 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a036ee2d-a0ec-4ca5-98ed-cd7d3b211167 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:52.766992 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a036ee2d-a0ec-4ca5-98ed-cd7d3b211167 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10" status: 200 len: 1506 microversion: 2.1 time: 1.078329 Aug 31 15:57:52.784471 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1122/2155] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:51 2022] GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10 => generated 1506 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:52.790691 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-40841f12-c2ab-44bb-8b5e-e0609d87c07c tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:52.791783 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-40841f12-c2ab-44bb-8b5e-e0609d87c07c tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:52.799380 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-40841f12-c2ab-44bb-8b5e-e0609d87c07c tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:52.799991 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-40841f12-c2ab-44bb-8b5e-e0609d87c07c tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:52.800632 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-40841f12-c2ab-44bb-8b5e-e0609d87c07c tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:52.801557 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-40841f12-c2ab-44bb-8b5e-e0609d87c07c tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:52.802240 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-40841f12-c2ab-44bb-8b5e-e0609d87c07c tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:52.802850 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-40841f12-c2ab-44bb-8b5e-e0609d87c07c tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:52.999766 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-40841f12-c2ab-44bb-8b5e-e0609d87c07c tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:53.014827 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-40841f12-c2ab-44bb-8b5e-e0609d87c07c tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:53.015351 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e50be483-95b4-4907-a4f2-4355a8edabcc tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922a671cad44ea595e46290a5d52380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1371996a8304dc58ee579daa535bcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:53.016924 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-40841f12-c2ab-44bb-8b5e-e0609d87c07c tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:53.023796 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e50be483-95b4-4907-a4f2-4355a8edabcc tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/a9448c8e-c801-4d08-b1c1-b34f279269e6" status: 200 len: 1505 microversion: 2.1 time: 0.791269 Aug 31 15:57:53.024307 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-40841f12-c2ab-44bb-8b5e-e0609d87c07c tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1504 microversion: 2.91 time: 0.237844 Aug 31 15:57:53.039843 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1034/2156] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:52 2022] GET /compute/v2.1/servers/a9448c8e-c801-4d08-b1c1-b34f279269e6 => generated 1505 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:53.041578 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1123/2157] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:52 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1504 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:53.043738 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8d46ff33-dca0-49f4-a699-448febe8dba0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:53.046975 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8d46ff33-dca0-49f4-a699-448febe8dba0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 548e0225-fa26-46ba-9c12-7b52feee1784] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:53.056745 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d46ff33-dca0-49f4-a699-448febe8dba0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:53.057569 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d46ff33-dca0-49f4-a699-448febe8dba0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:53.058774 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d46ff33-dca0-49f4-a699-448febe8dba0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:53.059703 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d46ff33-dca0-49f4-a699-448febe8dba0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:53.060303 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d46ff33-dca0-49f4-a699-448febe8dba0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:53.060873 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d46ff33-dca0-49f4-a699-448febe8dba0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:53.126554 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b72b661b-63e0-4ea4-826d-102b606ecf02 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:53.128272 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b72b661b-63e0-4ea4-826d-102b606ecf02 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] [instance: d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:53.159880 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b72b661b-63e0-4ea4-826d-102b606ecf02 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:53.160881 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b72b661b-63e0-4ea4-826d-102b606ecf02 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:53.161842 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b72b661b-63e0-4ea4-826d-102b606ecf02 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:53.164524 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b72b661b-63e0-4ea4-826d-102b606ecf02 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:53.165708 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b72b661b-63e0-4ea4-826d-102b606ecf02 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:53.169173 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b72b661b-63e0-4ea4-826d-102b606ecf02 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:53.598440 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8d46ff33-dca0-49f4-a699-448febe8dba0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:53.617739 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8d46ff33-dca0-49f4-a699-448febe8dba0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:53.620706 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8d46ff33-dca0-49f4-a699-448febe8dba0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:53.622531 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8d46ff33-dca0-49f4-a699-448febe8dba0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784" status: 200 len: 1486 microversion: 2.25 time: 0.582740 Aug 31 15:57:53.646520 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1035/2158] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:53 2022] GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784 => generated 1486 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:53.661597 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a6672c1a-87a9-4a11-acd7-d0eb29a2d167 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb4ab4e670>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:53.770011 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b72b661b-63e0-4ea4-826d-102b606ecf02 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba08a4705f4f0a9bc6a01d16a5f607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055586a03b0a4c1989b3ac658ac6347c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:53.777400 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a6672c1a-87a9-4a11-acd7-d0eb29a2d167 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/images/a44aac17-897f-4534-9995-797398bda710" status: 200 len: 1438 microversion: 2.1 time: 0.132862 Aug 31 15:57:53.778474 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b72b661b-63e0-4ea4-826d-102b606ecf02 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] 10.222.0.50 "GET /compute/v2.1/servers/d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe" status: 200 len: 1319 microversion: 2.1 time: 0.665918 Aug 31 15:57:53.779065 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1124/2159] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:53 2022] GET /compute/v2.1/servers/d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe => generated 1319 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:53.795884 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1036/2160] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:57:53 2022] GET /compute/v2.1/images/a44aac17-897f-4534-9995-797398bda710 => generated 1438 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:53.796099 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-10586305-b5c3-40b0-a2e2-ecc420d8c6f5 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:53.796558 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-10586305-b5c3-40b0-a2e2-ecc420d8c6f5 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: f044dca7-71de-4182-b5ec-825299496c10] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:53.805074 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-10586305-b5c3-40b0-a2e2-ecc420d8c6f5 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:53.808973 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-10586305-b5c3-40b0-a2e2-ecc420d8c6f5 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:53.810388 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-10586305-b5c3-40b0-a2e2-ecc420d8c6f5 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:53.811827 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-10586305-b5c3-40b0-a2e2-ecc420d8c6f5 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:53.812511 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-10586305-b5c3-40b0-a2e2-ecc420d8c6f5 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:53.813661 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-10586305-b5c3-40b0-a2e2-ecc420d8c6f5 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:54.015817 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-10586305-b5c3-40b0-a2e2-ecc420d8c6f5 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:54.036786 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-10586305-b5c3-40b0-a2e2-ecc420d8c6f5 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10" status: 200 len: 1506 microversion: 2.1 time: 0.244887 Aug 31 15:57:54.038302 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1125/2161] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:53 2022] GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10 => generated 1506 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:57:54.046027 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fbe0d831-48aa-4333-8d49-f3a523992658 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:54.047085 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fbe0d831-48aa-4333-8d49-f3a523992658 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: a9448c8e-c801-4d08-b1c1-b34f279269e6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:54.063881 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbe0d831-48aa-4333-8d49-f3a523992658 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:54.065630 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbe0d831-48aa-4333-8d49-f3a523992658 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:54.066947 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7590b054-25f4-4854-a0dd-8b1c2e46b291 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:54.067616 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbe0d831-48aa-4333-8d49-f3a523992658 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:54.068574 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbe0d831-48aa-4333-8d49-f3a523992658 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:54.069399 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7590b054-25f4-4854-a0dd-8b1c2e46b291 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:54.070850 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbe0d831-48aa-4333-8d49-f3a523992658 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:54.071490 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbe0d831-48aa-4333-8d49-f3a523992658 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:54.083617 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7590b054-25f4-4854-a0dd-8b1c2e46b291 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:54.084519 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7590b054-25f4-4854-a0dd-8b1c2e46b291 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:54.087889 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7590b054-25f4-4854-a0dd-8b1c2e46b291 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:54.089241 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7590b054-25f4-4854-a0dd-8b1c2e46b291 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:54.089934 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7590b054-25f4-4854-a0dd-8b1c2e46b291 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:54.091488 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7590b054-25f4-4854-a0dd-8b1c2e46b291 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:54.237018 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7590b054-25f4-4854-a0dd-8b1c2e46b291 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:54.250173 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7590b054-25f4-4854-a0dd-8b1c2e46b291 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:54.251791 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7590b054-25f4-4854-a0dd-8b1c2e46b291 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:54.268116 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7590b054-25f4-4854-a0dd-8b1c2e46b291 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1510 microversion: 2.91 time: 0.213451 Aug 31 15:57:54.269107 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1126/2162] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:54 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1510 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:54.390363 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-b4b8005d-0fc5-46e7-a8fa-f207cfba71ba req-3dffe02f-e284-4ddf-b0cb-be481ee099a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe", "name": "network-vif-plugged", "status": "completed", "tag": "355c9967-e584-4ea1-9ceb-8c16fab4e749"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:54.411368 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fbe0d831-48aa-4333-8d49-f3a523992658 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922a671cad44ea595e46290a5d52380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1371996a8304dc58ee579daa535bcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:54.414712 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-b4b8005d-0fc5-46e7-a8fa-f207cfba71ba req-3dffe02f-e284-4ddf-b0cb-be481ee099a0 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:54.415566 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-b4b8005d-0fc5-46e7-a8fa-f207cfba71ba req-3dffe02f-e284-4ddf-b0cb-be481ee099a0 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:54.416355 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-b4b8005d-0fc5-46e7-a8fa-f207cfba71ba req-3dffe02f-e284-4ddf-b0cb-be481ee099a0 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:54.419938 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fbe0d831-48aa-4333-8d49-f3a523992658 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/a9448c8e-c801-4d08-b1c1-b34f279269e6" status: 200 len: 1505 microversion: 2.1 time: 0.378606 Aug 31 15:57:54.420940 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1037/2163] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:54 2022] GET /compute/v2.1/servers/a9448c8e-c801-4d08-b1c1-b34f279269e6 => generated 1505 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:54.434298 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-b4b8005d-0fc5-46e7-a8fa-f207cfba71ba req-3dffe02f-e284-4ddf-b0cb-be481ee099a0 service nova] Creating event network-vif-plugged:355c9967-e584-4ea1-9ceb-8c16fab4e749 for instance d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe on n-h1-833090-16 Aug 31 15:57:54.454083 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-b4b8005d-0fc5-46e7-a8fa-f207cfba71ba req-3dffe02f-e284-4ddf-b0cb-be481ee099a0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068485 Aug 31 15:57:54.455006 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1127/2164] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:54.658210 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c8fab243-7bd1-4cfb-9c0b-35a463abec79 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:54.659523 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c8fab243-7bd1-4cfb-9c0b-35a463abec79 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 548e0225-fa26-46ba-9c12-7b52feee1784] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:54.667656 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8fab243-7bd1-4cfb-9c0b-35a463abec79 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:54.668456 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8fab243-7bd1-4cfb-9c0b-35a463abec79 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:54.669078 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8fab243-7bd1-4cfb-9c0b-35a463abec79 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:54.669975 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8fab243-7bd1-4cfb-9c0b-35a463abec79 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:54.670625 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8fab243-7bd1-4cfb-9c0b-35a463abec79 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:54.671227 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8fab243-7bd1-4cfb-9c0b-35a463abec79 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:54.794871 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c72ba605-4fb0-4292-843c-f6ccdbf7eef8 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb4618e8b0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:54.873353 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c72ba605-4fb0-4292-843c-f6ccdbf7eef8 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/images/a44aac17-897f-4534-9995-797398bda710" status: 200 len: 1438 microversion: 2.1 time: 0.084177 Aug 31 15:57:54.881844 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1128/2165] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:57:54 2022] GET /compute/v2.1/images/a44aac17-897f-4534-9995-797398bda710 => generated 1438 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:57:54.890315 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-11c173ba-f147-4fdd-8158-5c03c9f65774 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:54.891490 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-11c173ba-f147-4fdd-8158-5c03c9f65774 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] [instance: d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:54.907437 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11c173ba-f147-4fdd-8158-5c03c9f65774 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:54.908243 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11c173ba-f147-4fdd-8158-5c03c9f65774 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:54.908812 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11c173ba-f147-4fdd-8158-5c03c9f65774 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:54.909339 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c8fab243-7bd1-4cfb-9c0b-35a463abec79 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:54.909750 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11c173ba-f147-4fdd-8158-5c03c9f65774 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:54.910568 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11c173ba-f147-4fdd-8158-5c03c9f65774 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:54.911201 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11c173ba-f147-4fdd-8158-5c03c9f65774 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:54.919061 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c8fab243-7bd1-4cfb-9c0b-35a463abec79 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:54.920917 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c8fab243-7bd1-4cfb-9c0b-35a463abec79 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:54.922446 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c8fab243-7bd1-4cfb-9c0b-35a463abec79 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784" status: 200 len: 1486 microversion: 2.25 time: 0.268792 Aug 31 15:57:54.923588 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1038/2166] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:54 2022] GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784 => generated 1486 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:55.061948 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0e5506d3-c491-4651-a0fd-844a7cc2f393 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:55.062842 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0e5506d3-c491-4651-a0fd-844a7cc2f393 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: f044dca7-71de-4182-b5ec-825299496c10] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:55.065907 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:57:55.085501 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e5506d3-c491-4651-a0fd-844a7cc2f393 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:55.086161 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e5506d3-c491-4651-a0fd-844a7cc2f393 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:55.087721 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e5506d3-c491-4651-a0fd-844a7cc2f393 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:55.089763 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e5506d3-c491-4651-a0fd-844a7cc2f393 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:55.090492 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e5506d3-c491-4651-a0fd-844a7cc2f393 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:55.091852 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e5506d3-c491-4651-a0fd-844a7cc2f393 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:55.130327 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-11c173ba-f147-4fdd-8158-5c03c9f65774 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba08a4705f4f0a9bc6a01d16a5f607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055586a03b0a4c1989b3ac658ac6347c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:55.147710 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-11c173ba-f147-4fdd-8158-5c03c9f65774 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] 10.222.0.50 "GET /compute/v2.1/servers/d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe" status: 200 len: 1319 microversion: 2.1 time: 0.266888 Aug 31 15:57:55.148386 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1129/2167] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:54 2022] GET /compute/v2.1/servers/d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe => generated 1319 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:55.297979 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c8a56e56-1008-41e1-ac31-c22ef7f6790c tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:55.299096 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c8a56e56-1008-41e1-ac31-c22ef7f6790c tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:55.314018 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8a56e56-1008-41e1-ac31-c22ef7f6790c tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:55.314883 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8a56e56-1008-41e1-ac31-c22ef7f6790c tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:55.315625 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8a56e56-1008-41e1-ac31-c22ef7f6790c tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:55.316854 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8a56e56-1008-41e1-ac31-c22ef7f6790c tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:55.317647 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8a56e56-1008-41e1-ac31-c22ef7f6790c tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:55.340900 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8a56e56-1008-41e1-ac31-c22ef7f6790c tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:55.484385 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0e5506d3-c491-4651-a0fd-844a7cc2f393 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:55.485471 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c8a56e56-1008-41e1-ac31-c22ef7f6790c tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:55.501090 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0e5506d3-c491-4651-a0fd-844a7cc2f393 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10" status: 200 len: 1506 microversion: 2.1 time: 0.443249 Aug 31 15:57:55.502016 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1039/2168] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:55 2022] GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10 => generated 1506 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:57:55.520564 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-10ca3fe8-ca63-4eb9-bb90-9cc2260d6b26 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:55.523050 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-10ca3fe8-ca63-4eb9-bb90-9cc2260d6b26 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: a9448c8e-c801-4d08-b1c1-b34f279269e6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:55.534326 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c8a56e56-1008-41e1-ac31-c22ef7f6790c tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:55.536411 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10ca3fe8-ca63-4eb9-bb90-9cc2260d6b26 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:55.538420 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c8a56e56-1008-41e1-ac31-c22ef7f6790c tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:55.540402 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10ca3fe8-ca63-4eb9-bb90-9cc2260d6b26 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:55.541909 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10ca3fe8-ca63-4eb9-bb90-9cc2260d6b26 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:55.545966 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10ca3fe8-ca63-4eb9-bb90-9cc2260d6b26 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:55.546692 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10ca3fe8-ca63-4eb9-bb90-9cc2260d6b26 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:55.547319 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10ca3fe8-ca63-4eb9-bb90-9cc2260d6b26 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:55.548137 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c8a56e56-1008-41e1-ac31-c22ef7f6790c tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1510 microversion: 2.91 time: 0.256451 Aug 31 15:57:55.556632 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1130/2169] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:55 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1510 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:55.889555 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-deb6f769-ec01-4780-92ab-826b97ad84ab tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb4aa65790>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:55.970936 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-deb6f769-ec01-4780-92ab-826b97ad84ab tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/images/a44aac17-897f-4534-9995-797398bda710" status: 200 len: 1438 microversion: 2.1 time: 0.085428 Aug 31 15:57:55.973068 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-10ca3fe8-ca63-4eb9-bb90-9cc2260d6b26 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922a671cad44ea595e46290a5d52380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1371996a8304dc58ee579daa535bcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:55.986797 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1131/2170] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:57:55 2022] GET /compute/v2.1/images/a44aac17-897f-4534-9995-797398bda710 => generated 1438 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:55.988742 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-10ca3fe8-ca63-4eb9-bb90-9cc2260d6b26 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/a9448c8e-c801-4d08-b1c1-b34f279269e6" status: 200 len: 1505 microversion: 2.1 time: 0.482559 Aug 31 15:57:55.995268 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d14625a7-40e9-4665-9e01-c1a6aae3c767 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:56.006831 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d14625a7-40e9-4665-9e01-c1a6aae3c767 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 548e0225-fa26-46ba-9c12-7b52feee1784] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:56.023250 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d14625a7-40e9-4665-9e01-c1a6aae3c767 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:56.023710 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1040/2171] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:55 2022] GET /compute/v2.1/servers/a9448c8e-c801-4d08-b1c1-b34f279269e6 => generated 1505 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:56.024626 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d14625a7-40e9-4665-9e01-c1a6aae3c767 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:56.025270 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d14625a7-40e9-4665-9e01-c1a6aae3c767 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:56.026308 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d14625a7-40e9-4665-9e01-c1a6aae3c767 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:56.027039 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d14625a7-40e9-4665-9e01-c1a6aae3c767 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:56.027712 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d14625a7-40e9-4665-9e01-c1a6aae3c767 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:56.176796 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7a45d104-f7b1-4f2a-a131-1664c18288d2 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:56.177774 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7a45d104-f7b1-4f2a-a131-1664c18288d2 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] [instance: d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:56.194029 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a45d104-f7b1-4f2a-a131-1664c18288d2 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:56.197128 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a45d104-f7b1-4f2a-a131-1664c18288d2 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:56.197677 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a45d104-f7b1-4f2a-a131-1664c18288d2 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:56.199764 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a45d104-f7b1-4f2a-a131-1664c18288d2 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:56.200352 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a45d104-f7b1-4f2a-a131-1664c18288d2 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:56.201872 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a45d104-f7b1-4f2a-a131-1664c18288d2 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:56.398140 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d14625a7-40e9-4665-9e01-c1a6aae3c767 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:56.429029 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d14625a7-40e9-4665-9e01-c1a6aae3c767 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:56.435541 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d14625a7-40e9-4665-9e01-c1a6aae3c767 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:56.454606 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d14625a7-40e9-4665-9e01-c1a6aae3c767 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784" status: 200 len: 1486 microversion: 2.25 time: 0.460460 Aug 31 15:57:56.470122 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1132/2172] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:55 2022] GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784 => generated 1486 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:56.524958 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ce0dd2ef-40aa-4727-beb6-0a619342f233 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:56.525795 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ce0dd2ef-40aa-4727-beb6-0a619342f233 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: f044dca7-71de-4182-b5ec-825299496c10] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:56.540830 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ce0dd2ef-40aa-4727-beb6-0a619342f233 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:56.541609 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ce0dd2ef-40aa-4727-beb6-0a619342f233 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:56.542474 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ce0dd2ef-40aa-4727-beb6-0a619342f233 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:56.544212 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ce0dd2ef-40aa-4727-beb6-0a619342f233 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:56.546715 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ce0dd2ef-40aa-4727-beb6-0a619342f233 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:56.547310 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ce0dd2ef-40aa-4727-beb6-0a619342f233 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:57.177952 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7a45d104-f7b1-4f2a-a131-1664c18288d2 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba08a4705f4f0a9bc6a01d16a5f607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055586a03b0a4c1989b3ac658ac6347c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:57.191599 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7a45d104-f7b1-4f2a-a131-1664c18288d2 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] 10.222.0.50 "GET /compute/v2.1/servers/d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe" status: 200 len: 1319 microversion: 2.1 time: 1.019184 Aug 31 15:57:57.202598 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1041/2173] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:56 2022] GET /compute/v2.1/servers/d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe => generated 1319 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:57:57.211278 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d237a443-9105-41ad-a01d-a1e407480663 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:57.212111 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d237a443-9105-41ad-a01d-a1e407480663 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:57.224206 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d237a443-9105-41ad-a01d-a1e407480663 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:57.224981 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d237a443-9105-41ad-a01d-a1e407480663 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:57.225722 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d237a443-9105-41ad-a01d-a1e407480663 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:57.226624 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d237a443-9105-41ad-a01d-a1e407480663 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:57.227224 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d237a443-9105-41ad-a01d-a1e407480663 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:57.227790 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d237a443-9105-41ad-a01d-a1e407480663 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:57.313920 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ce0dd2ef-40aa-4727-beb6-0a619342f233 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:57.332178 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ce0dd2ef-40aa-4727-beb6-0a619342f233 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10" status: 200 len: 1506 microversion: 2.1 time: 0.812307 Aug 31 15:57:57.333270 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1133/2174] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:56 2022] GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10 => generated 1506 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:57.339658 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-bfa01ede-39cf-4b28-9a66-7ddac491e5d4 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb4618e310>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:57.421135 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d237a443-9105-41ad-a01d-a1e407480663 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:57.434862 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d237a443-9105-41ad-a01d-a1e407480663 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:57.436480 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d237a443-9105-41ad-a01d-a1e407480663 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:57.448996 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-bfa01ede-39cf-4b28-9a66-7ddac491e5d4 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/images/a44aac17-897f-4534-9995-797398bda710" status: 200 len: 1438 microversion: 2.1 time: 0.114421 Aug 31 15:57:57.457514 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1134/2175] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:57:57 2022] GET /compute/v2.1/images/a44aac17-897f-4534-9995-797398bda710 => generated 1438 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:57.459906 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d237a443-9105-41ad-a01d-a1e407480663 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1510 microversion: 2.91 time: 0.255400 Aug 31 15:57:57.460509 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1042/2176] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:57 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1510 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:57.485264 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-03489249-5e70-43ec-830e-db52c207137a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:57.486203 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-03489249-5e70-43ec-830e-db52c207137a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: a9448c8e-c801-4d08-b1c1-b34f279269e6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:57.493545 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-03489249-5e70-43ec-830e-db52c207137a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:57.494254 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6357ab5f-fc43-48cb-97a9-1e45beebd132 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:57.494857 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-03489249-5e70-43ec-830e-db52c207137a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:57.494978 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6357ab5f-fc43-48cb-97a9-1e45beebd132 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 548e0225-fa26-46ba-9c12-7b52feee1784] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:57.495785 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-03489249-5e70-43ec-830e-db52c207137a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:57.497037 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-03489249-5e70-43ec-830e-db52c207137a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:57.497793 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-03489249-5e70-43ec-830e-db52c207137a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:57.498758 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-03489249-5e70-43ec-830e-db52c207137a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:57.519825 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6357ab5f-fc43-48cb-97a9-1e45beebd132 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:57.520623 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6357ab5f-fc43-48cb-97a9-1e45beebd132 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:57.521478 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6357ab5f-fc43-48cb-97a9-1e45beebd132 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:57.522969 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6357ab5f-fc43-48cb-97a9-1e45beebd132 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:57.527023 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6357ab5f-fc43-48cb-97a9-1e45beebd132 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:57.527987 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6357ab5f-fc43-48cb-97a9-1e45beebd132 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:58.265765 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-03489249-5e70-43ec-830e-db52c207137a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922a671cad44ea595e46290a5d52380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1371996a8304dc58ee579daa535bcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:58.280774 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-03489249-5e70-43ec-830e-db52c207137a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/a9448c8e-c801-4d08-b1c1-b34f279269e6" status: 200 len: 1505 microversion: 2.1 time: 0.821490 Aug 31 15:57:58.297509 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1135/2177] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:57 2022] GET /compute/v2.1/servers/a9448c8e-c801-4d08-b1c1-b34f279269e6 => generated 1505 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:58.311127 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-0626ef2f-c407-4ef6-90dc-d8262f9bc246 req-00cf6880-34eb-455f-8079-2e565ee144a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "548e0225-fa26-46ba-9c12-7b52feee1784", "name": "network-vif-unplugged", "status": "completed", "tag": "da0ce8b3-d23a-4835-87ba-6b9636776b31"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:58.344439 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-0626ef2f-c407-4ef6-90dc-d8262f9bc246 req-00cf6880-34eb-455f-8079-2e565ee144a7 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:58.346068 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-0626ef2f-c407-4ef6-90dc-d8262f9bc246 req-00cf6880-34eb-455f-8079-2e565ee144a7 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:58.347522 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-0626ef2f-c407-4ef6-90dc-d8262f9bc246 req-00cf6880-34eb-455f-8079-2e565ee144a7 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:58.382139 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-0626ef2f-c407-4ef6-90dc-d8262f9bc246 req-00cf6880-34eb-455f-8079-2e565ee144a7 service nova] Creating event network-vif-unplugged:da0ce8b3-d23a-4835-87ba-6b9636776b31 for instance 548e0225-fa26-46ba-9c12-7b52feee1784 on n-h2-833090-16 Aug 31 15:57:58.404545 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-0626ef2f-c407-4ef6-90dc-d8262f9bc246 req-00cf6880-34eb-455f-8079-2e565ee144a7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103311 Aug 31 15:57:58.409486 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1136/2178] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:58.427423 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0a280258-a3c6-4198-962f-391ba2466861 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:58.428200 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0a280258-a3c6-4198-962f-391ba2466861 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] [instance: d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:58.444820 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0a280258-a3c6-4198-962f-391ba2466861 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:58.445317 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0a280258-a3c6-4198-962f-391ba2466861 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:58.445756 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0a280258-a3c6-4198-962f-391ba2466861 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:58.448763 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0a280258-a3c6-4198-962f-391ba2466861 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:58.449314 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0a280258-a3c6-4198-962f-391ba2466861 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:58.453469 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0a280258-a3c6-4198-962f-391ba2466861 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:58.544209 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6357ab5f-fc43-48cb-97a9-1e45beebd132 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:58.556352 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6357ab5f-fc43-48cb-97a9-1e45beebd132 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:58.561731 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6357ab5f-fc43-48cb-97a9-1e45beebd132 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:58.568716 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6357ab5f-fc43-48cb-97a9-1e45beebd132 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784" status: 200 len: 1486 microversion: 2.25 time: 1.086507 Aug 31 15:57:58.569771 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1043/2179] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:57 2022] GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784 => generated 1486 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:58.577205 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4db065ae-134b-4bcd-83c8-42acfa899b82 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:58.585355 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4db065ae-134b-4bcd-83c8-42acfa899b82 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: f044dca7-71de-4182-b5ec-825299496c10] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:58.613270 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4db065ae-134b-4bcd-83c8-42acfa899b82 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:58.614395 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4db065ae-134b-4bcd-83c8-42acfa899b82 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:58.615338 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4db065ae-134b-4bcd-83c8-42acfa899b82 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:58.630545 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4db065ae-134b-4bcd-83c8-42acfa899b82 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:58.631283 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4db065ae-134b-4bcd-83c8-42acfa899b82 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:58.631996 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4db065ae-134b-4bcd-83c8-42acfa899b82 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:59.202578 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4db065ae-134b-4bcd-83c8-42acfa899b82 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:59.219024 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4db065ae-134b-4bcd-83c8-42acfa899b82 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10" status: 200 len: 1527 microversion: 2.1 time: 0.646332 Aug 31 15:57:59.220706 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1044/2180] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:58 2022] GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10 => generated 1527 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:59.233702 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-366d355e-bc22-40a3-bcc6-f5e47d2b96c3 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb4ab75040>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:59.296891 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0a280258-a3c6-4198-962f-391ba2466861 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba08a4705f4f0a9bc6a01d16a5f607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055586a03b0a4c1989b3ac658ac6347c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:59.313936 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0a280258-a3c6-4198-962f-391ba2466861 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] 10.222.0.50 "GET /compute/v2.1/servers/d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe" status: 200 len: 1469 microversion: 2.1 time: 0.899486 Aug 31 15:57:59.314562 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1137/2181] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:58 2022] GET /compute/v2.1/servers/d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe => generated 1469 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:59.345385 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-85b3b906-c33a-4393-b06f-5dd833801634 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:59.346337 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-85b3b906-c33a-4393-b06f-5dd833801634 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:59.350422 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-366d355e-bc22-40a3-bcc6-f5e47d2b96c3 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/images/a44aac17-897f-4534-9995-797398bda710" status: 200 len: 1438 microversion: 2.1 time: 0.128263 Aug 31 15:57:59.358699 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1045/2182] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:57:59 2022] GET /compute/v2.1/images/a44aac17-897f-4534-9995-797398bda710 => generated 1438 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:59.358699 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6b11728b-f353-4e82-83c9-31e312dafce8 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:59.362816 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6b11728b-f353-4e82-83c9-31e312dafce8 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e8f2bc800ceb41349e8c182d526d4d8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773dad0890c4048a0f0152e05fe8d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:59.363899 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6b11728b-f353-4e82-83c9-31e312dafce8 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Searching by: {'deleted': False, 'project_id': 'e773dad0890c4048a0f0152e05fe8d77'} {{(pid=128863) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 15:57:59.368730 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85b3b906-c33a-4393-b06f-5dd833801634 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:59.369276 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85b3b906-c33a-4393-b06f-5dd833801634 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:59.369676 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85b3b906-c33a-4393-b06f-5dd833801634 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:59.370442 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85b3b906-c33a-4393-b06f-5dd833801634 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:59.370901 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85b3b906-c33a-4393-b06f-5dd833801634 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:59.371313 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85b3b906-c33a-4393-b06f-5dd833801634 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:59.373249 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b11728b-f353-4e82-83c9-31e312dafce8 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:59.374119 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b11728b-f353-4e82-83c9-31e312dafce8 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:59.374741 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b11728b-f353-4e82-83c9-31e312dafce8 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:59.375752 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b11728b-f353-4e82-83c9-31e312dafce8 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:59.376351 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b11728b-f353-4e82-83c9-31e312dafce8 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:59.376918 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b11728b-f353-4e82-83c9-31e312dafce8 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:59.420265 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.multi_cell_list [None req-6b11728b-f353-4e82-83c9-31e312dafce8 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128863) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 15:57:59.478696 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=100 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:57:59.515830 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6b11728b-f353-4e82-83c9-31e312dafce8 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.161103 Aug 31 15:57:59.516849 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1046/2183] 10.222.0.50 () {58 vars in 1125 bytes} [Wed Aug 31 15:57:59 2022] GET /compute/v2.1/servers => generated 343 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:57:59.527310 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-671607e3-5b53-4f01-a93d-573dad7f3e4b tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:59.528940 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-671607e3-5b53-4f01-a93d-573dad7f3e4b tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: a9448c8e-c801-4d08-b1c1-b34f279269e6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:59.539585 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-671607e3-5b53-4f01-a93d-573dad7f3e4b tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:59.540294 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-671607e3-5b53-4f01-a93d-573dad7f3e4b tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:59.543602 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-671607e3-5b53-4f01-a93d-573dad7f3e4b tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:59.544641 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-671607e3-5b53-4f01-a93d-573dad7f3e4b tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:59.546330 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-671607e3-5b53-4f01-a93d-573dad7f3e4b tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:59.548488 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-671607e3-5b53-4f01-a93d-573dad7f3e4b tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:59.581757 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:57:59.645448 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-85b3b906-c33a-4393-b06f-5dd833801634 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:59.687076 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-85b3b906-c33a-4393-b06f-5dd833801634 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:59.701482 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-85b3b906-c33a-4393-b06f-5dd833801634 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:59.716755 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-85b3b906-c33a-4393-b06f-5dd833801634 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1531 microversion: 2.91 time: 0.400371 Aug 31 15:57:59.719083 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1138/2184] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:59 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1531 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:57:59.730514 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-10cf0463-582e-4125-a98b-bca288278a22 tempest-LiveMigrationNegativeTest-1770440985 tempest-LiveMigrationNegativeTest-1770440985-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:57:59.731917 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-10cf0463-582e-4125-a98b-bca288278a22 tempest-LiveMigrationNegativeTest-1770440985 tempest-LiveMigrationNegativeTest-1770440985-project-admin] [instance: d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:59.741617 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-10cf0463-582e-4125-a98b-bca288278a22 tempest-LiveMigrationNegativeTest-1770440985 tempest-LiveMigrationNegativeTest-1770440985-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:59.742934 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-10cf0463-582e-4125-a98b-bca288278a22 tempest-LiveMigrationNegativeTest-1770440985 tempest-LiveMigrationNegativeTest-1770440985-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:59.743831 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-10cf0463-582e-4125-a98b-bca288278a22 tempest-LiveMigrationNegativeTest-1770440985 tempest-LiveMigrationNegativeTest-1770440985-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:59.747057 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-10cf0463-582e-4125-a98b-bca288278a22 tempest-LiveMigrationNegativeTest-1770440985 tempest-LiveMigrationNegativeTest-1770440985-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:59.748149 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-10cf0463-582e-4125-a98b-bca288278a22 tempest-LiveMigrationNegativeTest-1770440985 tempest-LiveMigrationNegativeTest-1770440985-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:57:59.749017 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-10cf0463-582e-4125-a98b-bca288278a22 tempest-LiveMigrationNegativeTest-1770440985 tempest-LiveMigrationNegativeTest-1770440985-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:57:59.795389 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-10cf0463-582e-4125-a98b-bca288278a22 tempest-LiveMigrationNegativeTest-1770440985 tempest-LiveMigrationNegativeTest-1770440985-project-admin] Lazy-loading 'flavor' on Instance uuid d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:57:59.925498 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-671607e3-5b53-4f01-a93d-573dad7f3e4b tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922a671cad44ea595e46290a5d52380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1371996a8304dc58ee579daa535bcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:59.937128 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-671607e3-5b53-4f01-a93d-573dad7f3e4b tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/a9448c8e-c801-4d08-b1c1-b34f279269e6" status: 200 len: 1505 microversion: 2.1 time: 0.419016 Aug 31 15:57:59.938421 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1047/2185] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:57:59 2022] GET /compute/v2.1/servers/a9448c8e-c801-4d08-b1c1-b34f279269e6 => generated 1505 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:57:59.953740 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a75d627b-fd27-4d5e-bf7e-5221b39c15a8 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:59.959804 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-10cf0463-582e-4125-a98b-bca288278a22 tempest-LiveMigrationNegativeTest-1770440985 tempest-LiveMigrationNegativeTest-1770440985-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe/action" status: 202 len: 0 microversion: 2.1 time: 0.238853 Aug 31 15:57:59.964158 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1139/2186] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 15:57:59 2022] POST /compute/v2.1/servers/d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:57:59.979147 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-008b0ed6-2876-4cd4-b5d9-62ac5b1996a7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:57:59.979407 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a75d627b-fd27-4d5e-bf7e-5221b39c15a8 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e8f2bc800ceb41349e8c182d526d4d8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773dad0890c4048a0f0152e05fe8d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:57:59.981726 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-008b0ed6-2876-4cd4-b5d9-62ac5b1996a7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 548e0225-fa26-46ba-9c12-7b52feee1784] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:57:59.983590 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a75d627b-fd27-4d5e-bf7e-5221b39c15a8 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Searching by: {'deleted': False, 'project_id': 'e773dad0890c4048a0f0152e05fe8d77'} {{(pid=128863) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 15:57:59.999460 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-008b0ed6-2876-4cd4-b5d9-62ac5b1996a7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:57:59.999998 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-008b0ed6-2876-4cd4-b5d9-62ac5b1996a7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:00.000508 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-008b0ed6-2876-4cd4-b5d9-62ac5b1996a7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:00.002243 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a75d627b-fd27-4d5e-bf7e-5221b39c15a8 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:00.005169 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-008b0ed6-2876-4cd4-b5d9-62ac5b1996a7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:00.005510 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a75d627b-fd27-4d5e-bf7e-5221b39c15a8 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:00.006256 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a75d627b-fd27-4d5e-bf7e-5221b39c15a8 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:00.006653 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-008b0ed6-2876-4cd4-b5d9-62ac5b1996a7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:00.007518 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a75d627b-fd27-4d5e-bf7e-5221b39c15a8 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:00.008699 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-008b0ed6-2876-4cd4-b5d9-62ac5b1996a7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:00.009481 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a75d627b-fd27-4d5e-bf7e-5221b39c15a8 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:00.011064 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a75d627b-fd27-4d5e-bf7e-5221b39c15a8 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:00.204925 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.multi_cell_list [None req-a75d627b-fd27-4d5e-bf7e-5221b39c15a8 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128863) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 15:58:00.321108 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-008b0ed6-2876-4cd4-b5d9-62ac5b1996a7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:00.352467 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-008b0ed6-2876-4cd4-b5d9-62ac5b1996a7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:00.356902 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-008b0ed6-2876-4cd4-b5d9-62ac5b1996a7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:00.358791 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-008b0ed6-2876-4cd4-b5d9-62ac5b1996a7 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784" status: 200 len: 1486 microversion: 2.25 time: 0.393315 Aug 31 15:58:00.359977 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1140/2187] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:57:59 2022] GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784 => generated 1486 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:00.383178 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a75d627b-fd27-4d5e-bf7e-5221b39c15a8 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f2bc800ceb41349e8c182d526d4d8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773dad0890c4048a0f0152e05fe8d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:00.392179 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a75d627b-fd27-4d5e-bf7e-5221b39c15a8 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:00.393095 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a75d627b-fd27-4d5e-bf7e-5221b39c15a8 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:00.393881 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a75d627b-fd27-4d5e-bf7e-5221b39c15a8 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:00.551896 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-be917588-3025-4f48-a500-7b6b4f0d5662 tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:00.553032 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-be917588-3025-4f48-a500-7b6b4f0d5662 tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:00.567780 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-be917588-3025-4f48-a500-7b6b4f0d5662 tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:00.571522 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-be917588-3025-4f48-a500-7b6b4f0d5662 tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:00.574347 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-be917588-3025-4f48-a500-7b6b4f0d5662 tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:00.576494 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-be917588-3025-4f48-a500-7b6b4f0d5662 tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:00.579604 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-be917588-3025-4f48-a500-7b6b4f0d5662 tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:00.581090 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-be917588-3025-4f48-a500-7b6b4f0d5662 tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:00.740145 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a75d627b-fd27-4d5e-bf7e-5221b39c15a8 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] 10.222.0.50 "GET /compute/v2.1/servers/detail" status: 200 len: 1603 microversion: 2.1 time: 0.798611 Aug 31 15:58:00.741942 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1048/2188] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 31 15:57:59 2022] GET /compute/v2.1/servers/detail => generated 1603 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:00.763975 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ced8a800-5960-44fd-a0b7-6eea21e0b4fa tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:00.766413 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ced8a800-5960-44fd-a0b7-6eea21e0b4fa tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] [instance: d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:00.803668 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-be917588-3025-4f48-a500-7b6b4f0d5662 tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] Lazy-loading 'services' on Instance uuid 05236fda-96c7-419a-95f9-9d90d6e4ce78 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:58:00.806063 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ced8a800-5960-44fd-a0b7-6eea21e0b4fa tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:00.806814 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ced8a800-5960-44fd-a0b7-6eea21e0b4fa tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:00.808025 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ced8a800-5960-44fd-a0b7-6eea21e0b4fa tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:00.810878 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ced8a800-5960-44fd-a0b7-6eea21e0b4fa tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:00.811520 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ced8a800-5960-44fd-a0b7-6eea21e0b4fa tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:00.812159 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ced8a800-5960-44fd-a0b7-6eea21e0b4fa tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:00.848999 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:58:00.861108 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-be917588-3025-4f48-a500-7b6b4f0d5662 tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1938 microversion: 2.91 time: 0.499568 Aug 31 15:58:00.874725 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1141/2189] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:00 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1938 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:00.892990 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e01fe4f4-68cb-42af-a061-c56275be6fde tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:00.894220 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e01fe4f4-68cb-42af-a061-c56275be6fde tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: f044dca7-71de-4182-b5ec-825299496c10] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:00.897471 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=6 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:58:00.919663 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e01fe4f4-68cb-42af-a061-c56275be6fde tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:00.923531 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e01fe4f4-68cb-42af-a061-c56275be6fde tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:00.924283 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e01fe4f4-68cb-42af-a061-c56275be6fde tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:00.925363 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e01fe4f4-68cb-42af-a061-c56275be6fde tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:00.926110 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e01fe4f4-68cb-42af-a061-c56275be6fde tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:00.928419 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e01fe4f4-68cb-42af-a061-c56275be6fde tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:01.167867 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ced8a800-5960-44fd-a0b7-6eea21e0b4fa tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba08a4705f4f0a9bc6a01d16a5f607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055586a03b0a4c1989b3ac658ac6347c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:01.180622 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ced8a800-5960-44fd-a0b7-6eea21e0b4fa tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] 10.222.0.50 "GET /compute/v2.1/servers/d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe" status: 200 len: 1460 microversion: 2.1 time: 0.436401 Aug 31 15:58:01.181586 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1049/2190] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:00 2022] GET /compute/v2.1/servers/d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe => generated 1460 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:01.193262 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-35359f72-967c-4d70-aeb5-5d8c8c37e12e tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb4ab758b0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:01.273050 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e01fe4f4-68cb-42af-a061-c56275be6fde tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:01.287148 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e01fe4f4-68cb-42af-a061-c56275be6fde tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10" status: 200 len: 1527 microversion: 2.1 time: 0.410840 Aug 31 15:58:01.287758 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1142/2191] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:00 2022] GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10 => generated 1527 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:01.311207 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-35359f72-967c-4d70-aeb5-5d8c8c37e12e tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/images/a44aac17-897f-4534-9995-797398bda710" status: 200 len: 1438 microversion: 2.1 time: 0.128412 Aug 31 15:58:01.319865 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1050/2192] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:58:01 2022] GET /compute/v2.1/images/a44aac17-897f-4534-9995-797398bda710 => generated 1438 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:01.328482 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bb713927-c590-4723-860a-b1ee5aa8096e tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:01.328768 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-67fc4e67-cd76-49bd-b5b4-1153812db936 req-98573c74-1009-498c-a795-ad9679eecc3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "548e0225-fa26-46ba-9c12-7b52feee1784", "tag": "da0ce8b3-d23a-4835-87ba-6b9636776b31"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:01.369466 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-67fc4e67-cd76-49bd-b5b4-1153812db936 req-98573c74-1009-498c-a795-ad9679eecc3d service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:01.372859 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-67fc4e67-cd76-49bd-b5b4-1153812db936 req-98573c74-1009-498c-a795-ad9679eecc3d service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:01.373512 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-67fc4e67-cd76-49bd-b5b4-1153812db936 req-98573c74-1009-498c-a795-ad9679eecc3d service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:01.380830 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bb713927-c590-4723-860a-b1ee5aa8096e tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.054823 Aug 31 15:58:01.383259 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1051/2193] 10.222.0.50 () {58 vars in 1137 bytes} [Wed Aug 31 15:58:01 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:01.390256 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1b50356d-13e5-4986-b449-1cb78958746e tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:01.391340 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1b50356d-13e5-4986-b449-1cb78958746e tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:01.400338 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b50356d-13e5-4986-b449-1cb78958746e tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:01.404306 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b50356d-13e5-4986-b449-1cb78958746e tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:01.411383 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b50356d-13e5-4986-b449-1cb78958746e tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:01.412592 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b50356d-13e5-4986-b449-1cb78958746e tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:01.413495 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b50356d-13e5-4986-b449-1cb78958746e tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:01.414321 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b50356d-13e5-4986-b449-1cb78958746e tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:01.416842 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-67fc4e67-cd76-49bd-b5b4-1153812db936 req-98573c74-1009-498c-a795-ad9679eecc3d service nova] Creating event network-changed:da0ce8b3-d23a-4835-87ba-6b9636776b31 for instance 548e0225-fa26-46ba-9c12-7b52feee1784 on n-h2-833090-16 Aug 31 15:58:01.442669 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-67fc4e67-cd76-49bd-b5b4-1153812db936 req-98573c74-1009-498c-a795-ad9679eecc3d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124726 Aug 31 15:58:01.443634 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1143/2194] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:01.449616 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-61890504-5335-4e47-b308-c420d0799b17 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:01.450192 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-61890504-5335-4e47-b308-c420d0799b17 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: a9448c8e-c801-4d08-b1c1-b34f279269e6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:01.469824 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-61890504-5335-4e47-b308-c420d0799b17 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:01.472000 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-61890504-5335-4e47-b308-c420d0799b17 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:01.472731 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-61890504-5335-4e47-b308-c420d0799b17 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:01.474009 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-61890504-5335-4e47-b308-c420d0799b17 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:01.477776 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-61890504-5335-4e47-b308-c420d0799b17 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:01.479431 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-61890504-5335-4e47-b308-c420d0799b17 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:01.639974 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-1b50356d-13e5-4986-b449-1cb78958746e tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] Lazy-loading 'services' on Instance uuid 05236fda-96c7-419a-95f9-9d90d6e4ce78 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:58:01.679720 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1b50356d-13e5-4986-b449-1cb78958746e tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1938 microversion: 2.91 time: 0.294422 Aug 31 15:58:01.696739 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1052/2195] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:01 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1938 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:01.711133 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c381002d-5b21-49b8-9946-1832ea32ac98 tempest-LiveMigrationNegativeTest-1770440985 tempest-LiveMigrationNegativeTest-1770440985-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:01.712066 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c381002d-5b21-49b8-9946-1832ea32ac98 tempest-LiveMigrationNegativeTest-1770440985 tempest-LiveMigrationNegativeTest-1770440985-project-admin] [instance: d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:01.731628 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c381002d-5b21-49b8-9946-1832ea32ac98 tempest-LiveMigrationNegativeTest-1770440985 tempest-LiveMigrationNegativeTest-1770440985-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:01.736287 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c381002d-5b21-49b8-9946-1832ea32ac98 tempest-LiveMigrationNegativeTest-1770440985 tempest-LiveMigrationNegativeTest-1770440985-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:01.737019 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c381002d-5b21-49b8-9946-1832ea32ac98 tempest-LiveMigrationNegativeTest-1770440985 tempest-LiveMigrationNegativeTest-1770440985-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:01.743162 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c381002d-5b21-49b8-9946-1832ea32ac98 tempest-LiveMigrationNegativeTest-1770440985 tempest-LiveMigrationNegativeTest-1770440985-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:01.746332 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c381002d-5b21-49b8-9946-1832ea32ac98 tempest-LiveMigrationNegativeTest-1770440985 tempest-LiveMigrationNegativeTest-1770440985-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:01.748908 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c381002d-5b21-49b8-9946-1832ea32ac98 tempest-LiveMigrationNegativeTest-1770440985 tempest-LiveMigrationNegativeTest-1770440985-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:02.223121 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-61890504-5335-4e47-b308-c420d0799b17 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922a671cad44ea595e46290a5d52380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1371996a8304dc58ee579daa535bcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:02.235979 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-61890504-5335-4e47-b308-c420d0799b17 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/a9448c8e-c801-4d08-b1c1-b34f279269e6" status: 200 len: 1505 microversion: 2.1 time: 0.791036 Aug 31 15:58:02.236773 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1144/2196] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:01 2022] GET /compute/v2.1/servers/a9448c8e-c801-4d08-b1c1-b34f279269e6 => generated 1505 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:02.246678 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c0515abd-382d-45cc-a018-74d86474ccaf tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:02.247292 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c0515abd-382d-45cc-a018-74d86474ccaf tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 548e0225-fa26-46ba-9c12-7b52feee1784] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:02.261994 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c0515abd-382d-45cc-a018-74d86474ccaf tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:02.265720 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c0515abd-382d-45cc-a018-74d86474ccaf tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:02.266210 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c0515abd-382d-45cc-a018-74d86474ccaf tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:02.266968 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c0515abd-382d-45cc-a018-74d86474ccaf tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:02.267435 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c0515abd-382d-45cc-a018-74d86474ccaf tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:02.267863 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c0515abd-382d-45cc-a018-74d86474ccaf tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:02.853870 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c0515abd-382d-45cc-a018-74d86474ccaf tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:02.869943 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c0515abd-382d-45cc-a018-74d86474ccaf tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:02.876081 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c0515abd-382d-45cc-a018-74d86474ccaf tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:02.877579 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c0515abd-382d-45cc-a018-74d86474ccaf tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784" status: 200 len: 1486 microversion: 2.25 time: 0.639999 Aug 31 15:58:02.882437 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1145/2197] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:02 2022] GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784 => generated 1486 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:02.895299 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7ae93707-87cc-4c99-8b74-5e7bf70033ec tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:02.920582 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ae93707-87cc-4c99-8b74-5e7bf70033ec tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:02.922912 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ae93707-87cc-4c99-8b74-5e7bf70033ec tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:02.923344 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ae93707-87cc-4c99-8b74-5e7bf70033ec tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:02.924122 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ae93707-87cc-4c99-8b74-5e7bf70033ec tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:02.924588 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ae93707-87cc-4c99-8b74-5e7bf70033ec tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:02.925038 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ae93707-87cc-4c99-8b74-5e7bf70033ec tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:02.999634 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7ae93707-87cc-4c99-8b74-5e7bf70033ec tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 500 microversion: 2.91 time: 0.113689 Aug 31 15:58:03.003474 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1146/2198] 10.222.0.50 () {60 vars in 1217 bytes} [Wed Aug 31 15:58:02 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 500 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 15:58:03.023941 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-dfef3363-bcf5-4f46-9bf9-0953fe96033f tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:03.024829 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-dfef3363-bcf5-4f46-9bf9-0953fe96033f tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] [instance: 0e79fda0-f46b-48bf-9e45-a183e5470fc7] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:03.037993 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dfef3363-bcf5-4f46-9bf9-0953fe96033f tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:03.038909 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dfef3363-bcf5-4f46-9bf9-0953fe96033f tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:03.039575 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dfef3363-bcf5-4f46-9bf9-0953fe96033f tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:03.040512 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dfef3363-bcf5-4f46-9bf9-0953fe96033f tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:03.041176 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dfef3363-bcf5-4f46-9bf9-0953fe96033f tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:03.041804 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dfef3363-bcf5-4f46-9bf9-0953fe96033f tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:03.119191 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-dfef3363-bcf5-4f46-9bf9-0953fe96033f tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] [instance: 0e79fda0-f46b-48bf-9e45-a183e5470fc7] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:58:03.297586 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c381002d-5b21-49b8-9946-1832ea32ac98 tempest-LiveMigrationNegativeTest-1770440985 tempest-LiveMigrationNegativeTest-1770440985-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe" status: 200 len: 1613 microversion: 2.1 time: 1.599426 Aug 31 15:58:03.317639 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1053/2199] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:01 2022] GET /compute/v2.1/servers/d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe => generated 1613 bytes in 1620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:03.370015 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-10d3adc1-58c4-4d88-be67-74e428f54f92 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:03.372885 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-10d3adc1-58c4-4d88-be67-74e428f54f92 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: f044dca7-71de-4182-b5ec-825299496c10] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:03.409328 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10d3adc1-58c4-4d88-be67-74e428f54f92 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:03.410527 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10d3adc1-58c4-4d88-be67-74e428f54f92 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:03.411477 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10d3adc1-58c4-4d88-be67-74e428f54f92 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:03.412686 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10d3adc1-58c4-4d88-be67-74e428f54f92 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:03.413455 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10d3adc1-58c4-4d88-be67-74e428f54f92 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:03.417501 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-dfef3363-bcf5-4f46-9bf9-0953fe96033f tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0e79fda0-f46b-48bf-9e45-a183e5470fc7" status: 204 len: 0 microversion: 2.1 time: 0.412197 Aug 31 15:58:03.419201 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1147/2200] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:58:03 2022] DELETE /compute/v2.1/servers/0e79fda0-f46b-48bf-9e45-a183e5470fc7 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:58:03.421703 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10d3adc1-58c4-4d88-be67-74e428f54f92 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:03.431671 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-65468aaf-1f53-4c37-8e30-74f514916b6b tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb4aa65c10>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:03.790510 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-10d3adc1-58c4-4d88-be67-74e428f54f92 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:03.799756 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-10d3adc1-58c4-4d88-be67-74e428f54f92 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10" status: 200 len: 1522 microversion: 2.1 time: 0.474368 Aug 31 15:58:03.809195 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1054/2201] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:03 2022] GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10 => generated 1522 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:03.824902 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6c6edd1f-c444-4119-b5e1-2895e7ff392b tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:03.825917 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6c6edd1f-c444-4119-b5e1-2895e7ff392b tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:03.851013 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c6edd1f-c444-4119-b5e1-2895e7ff392b tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:03.851922 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c6edd1f-c444-4119-b5e1-2895e7ff392b tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:03.852609 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c6edd1f-c444-4119-b5e1-2895e7ff392b tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:03.853677 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c6edd1f-c444-4119-b5e1-2895e7ff392b tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:03.854396 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c6edd1f-c444-4119-b5e1-2895e7ff392b tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:03.855059 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c6edd1f-c444-4119-b5e1-2895e7ff392b tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:03.920673 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-6c6edd1f-c444-4119-b5e1-2895e7ff392b tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lazy-loading 'flavor' on Instance uuid 05236fda-96c7-419a-95f9-9d90d6e4ce78 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:58:09.037681 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-65468aaf-1f53-4c37-8e30-74f514916b6b tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/images/a44aac17-897f-4534-9995-797398bda710" status: 200 len: 1447 microversion: 2.1 time: 5.616014 Aug 31 15:58:09.053360 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1148/2202] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:58:03 2022] GET /compute/v2.1/images/a44aac17-897f-4534-9995-797398bda710 => generated 1447 bytes in 5633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:09.063574 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5e8b3453-dc41-460f-bd6e-f493fbb4d720 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:09.067962 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5e8b3453-dc41-460f-bd6e-f493fbb4d720 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: a9448c8e-c801-4d08-b1c1-b34f279269e6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:09.101214 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e8b3453-dc41-460f-bd6e-f493fbb4d720 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:09.103781 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e8b3453-dc41-460f-bd6e-f493fbb4d720 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:09.106287 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e8b3453-dc41-460f-bd6e-f493fbb4d720 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:09.109906 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e8b3453-dc41-460f-bd6e-f493fbb4d720 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:09.111594 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e8b3453-dc41-460f-bd6e-f493fbb4d720 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:09.115250 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e8b3453-dc41-460f-bd6e-f493fbb4d720 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:09.236116 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6c6edd1f-c444-4119-b5e1-2895e7ff392b tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "POST /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78/action" status: 202 len: 0 microversion: 2.91 time: 5.424787 Aug 31 15:58:09.240075 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1055/2203] 10.222.0.50 () {62 vars in 1319 bytes} [Wed Aug 31 15:58:03 2022] POST /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78/action => generated 0 bytes in 5426 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:58:09.249590 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-44af39a7-e021-433e-b6e0-9f2a9013283a tempest-LiveMigrationNegativeTest-1770440985 tempest-LiveMigrationNegativeTest-1770440985-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:09.296484 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44af39a7-e021-433e-b6e0-9f2a9013283a tempest-LiveMigrationNegativeTest-1770440985 tempest-LiveMigrationNegativeTest-1770440985-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:09.297363 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44af39a7-e021-433e-b6e0-9f2a9013283a tempest-LiveMigrationNegativeTest-1770440985 tempest-LiveMigrationNegativeTest-1770440985-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:09.300041 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44af39a7-e021-433e-b6e0-9f2a9013283a tempest-LiveMigrationNegativeTest-1770440985 tempest-LiveMigrationNegativeTest-1770440985-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:09.301043 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44af39a7-e021-433e-b6e0-9f2a9013283a tempest-LiveMigrationNegativeTest-1770440985 tempest-LiveMigrationNegativeTest-1770440985-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:09.302612 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44af39a7-e021-433e-b6e0-9f2a9013283a tempest-LiveMigrationNegativeTest-1770440985 tempest-LiveMigrationNegativeTest-1770440985-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:09.306261 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44af39a7-e021-433e-b6e0-9f2a9013283a tempest-LiveMigrationNegativeTest-1770440985 tempest-LiveMigrationNegativeTest-1770440985-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:09.391286 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-44af39a7-e021-433e-b6e0-9f2a9013283a tempest-LiveMigrationNegativeTest-1770440985 tempest-LiveMigrationNegativeTest-1770440985-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.148856 Aug 31 15:58:09.403514 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1056/2204] 10.222.0.50 () {58 vars in 1176 bytes} [Wed Aug 31 15:58:09 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:09.418504 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7377c0b8-33a3-4812-9489-e02c0d6ac244 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:09.420027 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7377c0b8-33a3-4812-9489-e02c0d6ac244 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] [instance: 0e79fda0-f46b-48bf-9e45-a183e5470fc7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:09.429544 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7377c0b8-33a3-4812-9489-e02c0d6ac244 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:09.431448 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7377c0b8-33a3-4812-9489-e02c0d6ac244 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:09.433196 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7377c0b8-33a3-4812-9489-e02c0d6ac244 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:09.434745 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7377c0b8-33a3-4812-9489-e02c0d6ac244 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:09.436016 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7377c0b8-33a3-4812-9489-e02c0d6ac244 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:09.436662 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7377c0b8-33a3-4812-9489-e02c0d6ac244 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:09.488918 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5e8b3453-dc41-460f-bd6e-f493fbb4d720 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922a671cad44ea595e46290a5d52380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1371996a8304dc58ee579daa535bcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:09.502898 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5e8b3453-dc41-460f-bd6e-f493fbb4d720 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/a9448c8e-c801-4d08-b1c1-b34f279269e6" status: 200 len: 1505 microversion: 2.1 time: 0.445003 Aug 31 15:58:09.521337 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1149/2205] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:09 2022] GET /compute/v2.1/servers/a9448c8e-c801-4d08-b1c1-b34f279269e6 => generated 1505 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:09.531576 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ec4816d0-4df4-4f4b-ac80-7fd43c33b9a6 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:09.532807 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ec4816d0-4df4-4f4b-ac80-7fd43c33b9a6 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 548e0225-fa26-46ba-9c12-7b52feee1784] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:09.533543 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7377c0b8-33a3-4812-9489-e02c0d6ac244 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f2bc800ceb41349e8c182d526d4d8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773dad0890c4048a0f0152e05fe8d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:09.543658 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7377c0b8-33a3-4812-9489-e02c0d6ac244 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] 10.222.0.50 "GET /compute/v2.1/servers/0e79fda0-f46b-48bf-9e45-a183e5470fc7" status: 200 len: 1252 microversion: 2.1 time: 0.138133 Aug 31 15:58:09.553431 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ec4816d0-4df4-4f4b-ac80-7fd43c33b9a6 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:09.553629 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1057/2206] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:09 2022] GET /compute/v2.1/servers/0e79fda0-f46b-48bf-9e45-a183e5470fc7 => generated 1252 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:09.569935 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ec4816d0-4df4-4f4b-ac80-7fd43c33b9a6 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:09.571124 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9a4b5943-3883-49a1-ac34-feecedef6235 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:09.571768 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ec4816d0-4df4-4f4b-ac80-7fd43c33b9a6 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:09.572204 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9a4b5943-3883-49a1-ac34-feecedef6235 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: f044dca7-71de-4182-b5ec-825299496c10] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:09.574276 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ec4816d0-4df4-4f4b-ac80-7fd43c33b9a6 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:09.576643 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ec4816d0-4df4-4f4b-ac80-7fd43c33b9a6 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:09.577983 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ec4816d0-4df4-4f4b-ac80-7fd43c33b9a6 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:09.582344 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a4b5943-3883-49a1-ac34-feecedef6235 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:09.583291 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a4b5943-3883-49a1-ac34-feecedef6235 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:09.584298 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a4b5943-3883-49a1-ac34-feecedef6235 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:09.585678 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a4b5943-3883-49a1-ac34-feecedef6235 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:09.586649 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a4b5943-3883-49a1-ac34-feecedef6235 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:09.587348 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a4b5943-3883-49a1-ac34-feecedef6235 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:10.108992 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ec4816d0-4df4-4f4b-ac80-7fd43c33b9a6 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:10.123772 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ec4816d0-4df4-4f4b-ac80-7fd43c33b9a6 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:10.132734 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ec4816d0-4df4-4f4b-ac80-7fd43c33b9a6 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:10.135249 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ec4816d0-4df4-4f4b-ac80-7fd43c33b9a6 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784" status: 200 len: 1486 microversion: 2.25 time: 0.611608 Aug 31 15:58:10.139157 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1150/2207] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:09 2022] GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784 => generated 1486 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:10.152802 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-1a0625ac-69c3-4275-a184-fd60919bd38e req-48c01ec8-160f-4626-a54f-5686fa5e631a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f044dca7-71de-4182-b5ec-825299496c10", "name": "network-vif-plugged", "status": "completed", "tag": "f2758b61-4cf5-4435-9306-d8d8ffd9e363"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:10.178117 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-1a0625ac-69c3-4275-a184-fd60919bd38e req-48c01ec8-160f-4626-a54f-5686fa5e631a service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:10.180900 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-1a0625ac-69c3-4275-a184-fd60919bd38e req-48c01ec8-160f-4626-a54f-5686fa5e631a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:10.181351 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-1a0625ac-69c3-4275-a184-fd60919bd38e req-48c01ec8-160f-4626-a54f-5686fa5e631a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:10.216868 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9a4b5943-3883-49a1-ac34-feecedef6235 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:10.218216 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-1a0625ac-69c3-4275-a184-fd60919bd38e req-48c01ec8-160f-4626-a54f-5686fa5e631a service nova] Creating event network-vif-plugged:f2758b61-4cf5-4435-9306-d8d8ffd9e363 for instance f044dca7-71de-4182-b5ec-825299496c10 on n-h1-833090-16 Aug 31 15:58:10.234007 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-1a0625ac-69c3-4275-a184-fd60919bd38e req-48c01ec8-160f-4626-a54f-5686fa5e631a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092961 Aug 31 15:58:10.235010 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1151/2208] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:10.251579 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-73a7ab99-662a-4615-80b1-a00c04878d44 req-80da3d01-0635-4e6b-ae50-060aaea7f3e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e79fda0-f46b-48bf-9e45-a183e5470fc7", "name": "network-vif-deleted", "tag": "44bbd514-44c8-4952-80d8-40889c33f358"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:10.251803 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9a4b5943-3883-49a1-ac34-feecedef6235 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10" status: 200 len: 1522 microversion: 2.1 time: 0.690438 Aug 31 15:58:10.253394 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1058/2209] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:09 2022] GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10 => generated 1522 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:10.259961 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e0bff118-7678-47e7-9600-e35c82fa9f25 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb4aaa18b0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:10.294791 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:58:10.315882 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-73a7ab99-662a-4615-80b1-a00c04878d44 req-80da3d01-0635-4e6b-ae50-060aaea7f3e4 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:10.316360 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-73a7ab99-662a-4615-80b1-a00c04878d44 req-80da3d01-0635-4e6b-ae50-060aaea7f3e4 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:10.334492 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-73a7ab99-662a-4615-80b1-a00c04878d44 req-80da3d01-0635-4e6b-ae50-060aaea7f3e4 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:10.365593 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e0bff118-7678-47e7-9600-e35c82fa9f25 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/images/a44aac17-897f-4534-9995-797398bda710" status: 200 len: 1447 microversion: 2.1 time: 0.109898 Aug 31 15:58:10.367645 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1059/2210] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:58:10 2022] GET /compute/v2.1/images/a44aac17-897f-4534-9995-797398bda710 => generated 1447 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:10.380650 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3ffc80bc-c8af-479c-9613-a318a743767f tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:10.385201 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3ffc80bc-c8af-479c-9613-a318a743767f tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:10.391985 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:58:10.392300 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-73a7ab99-662a-4615-80b1-a00c04878d44 req-80da3d01-0635-4e6b-ae50-060aaea7f3e4 service nova] Creating event network-vif-deleted:44bbd514-44c8-4952-80d8-40889c33f358 for instance 0e79fda0-f46b-48bf-9e45-a183e5470fc7 on n-h2-833090-16 Aug 31 15:58:10.416167 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-73a7ab99-662a-4615-80b1-a00c04878d44 req-80da3d01-0635-4e6b-ae50-060aaea7f3e4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175805 Aug 31 15:58:10.417886 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1152/2211] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:10.421332 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ffc80bc-c8af-479c-9613-a318a743767f tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:10.423186 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ffc80bc-c8af-479c-9613-a318a743767f tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:10.423713 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ffc80bc-c8af-479c-9613-a318a743767f tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:10.424455 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ffc80bc-c8af-479c-9613-a318a743767f tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:10.428888 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ffc80bc-c8af-479c-9613-a318a743767f tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:10.429409 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ffc80bc-c8af-479c-9613-a318a743767f tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:10.448126 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7a39c25e-543a-4af3-80ba-10a91b793f9f tempest-LiveMigrationNegativeTest-1770440985 tempest-LiveMigrationNegativeTest-1770440985-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-833090-16", "block_migration": true, "disk_over_commit": false}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:10.454420 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7a39c25e-543a-4af3-80ba-10a91b793f9f tempest-LiveMigrationNegativeTest-1770440985 tempest-LiveMigrationNegativeTest-1770440985-project-admin] [instance: d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:10.501798 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7a39c25e-543a-4af3-80ba-10a91b793f9f tempest-LiveMigrationNegativeTest-1770440985 tempest-LiveMigrationNegativeTest-1770440985-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:10.502653 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7a39c25e-543a-4af3-80ba-10a91b793f9f tempest-LiveMigrationNegativeTest-1770440985 tempest-LiveMigrationNegativeTest-1770440985-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:10.503844 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7a39c25e-543a-4af3-80ba-10a91b793f9f tempest-LiveMigrationNegativeTest-1770440985 tempest-LiveMigrationNegativeTest-1770440985-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:10.507451 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7a39c25e-543a-4af3-80ba-10a91b793f9f tempest-LiveMigrationNegativeTest-1770440985 tempest-LiveMigrationNegativeTest-1770440985-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:10.510710 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7a39c25e-543a-4af3-80ba-10a91b793f9f tempest-LiveMigrationNegativeTest-1770440985 tempest-LiveMigrationNegativeTest-1770440985-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:10.513997 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7a39c25e-543a-4af3-80ba-10a91b793f9f tempest-LiveMigrationNegativeTest-1770440985 tempest-LiveMigrationNegativeTest-1770440985-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:10.571496 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3ffc80bc-c8af-479c-9613-a318a743767f tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:10.572175 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-7a39c25e-543a-4af3-80ba-10a91b793f9f tempest-LiveMigrationNegativeTest-1770440985 tempest-LiveMigrationNegativeTest-1770440985-project-admin] Lazy-loading 'flavor' on Instance uuid d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:58:10.584598 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3ffc80bc-c8af-479c-9613-a318a743767f tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:10.588578 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-7a39c25e-543a-4af3-80ba-10a91b793f9f tempest-LiveMigrationNegativeTest-1770440985 tempest-LiveMigrationNegativeTest-1770440985-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe while it is in vm_state suspended Aug 31 15:58:10.591044 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7a39c25e-543a-4af3-80ba-10a91b793f9f tempest-LiveMigrationNegativeTest-1770440985 tempest-LiveMigrationNegativeTest-1770440985-project-admin] Request method failure captured: Aug 31 15:58:10.591044 n-d-833090-16 devstack@n-api.service[128864]: request: POST /compute/v2.1/servers/d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe/action HTTP/1.1 Aug 31 15:58:10.591044 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:58:10.591044 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:58:10.591044 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:58:10.591044 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 98 Aug 31 15:58:10.591044 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:58:10.591044 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:58:10.591044 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:58:10.591044 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:58:10.591044 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4TURDGU77-MYZ1mxFHvkQy6GIihMdlRLivL2wmoW6uQ93qBLMOJG2Ynhcwmw7DQccyssw0R-HuzP59NM58CN1GHIlhBnOqR_3m_p26fAwhf2oJ-9qTV3rYYqXqfZhA4Y9jZRkVicnJ7GBKXK0jClHdVKC-YNF4eXKSk2Kjc3JjRZ34 Aug 31 15:58:10.591044 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:58:10.591044 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:58:10.591044 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:58:10.591044 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:58:10.591044 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:58:10.591044 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:58:10.591044 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 7bd8a2e3863c445da8eb1206ab071abc Aug 31 15:58:10.591044 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-LiveMigrationNegativeTest-1770440985 Aug 31 15:58:10.591044 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,admin,member Aug 31 15:58:10.591044 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,admin,member Aug 31 15:58:10.591044 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7bd8a2e3863c445da8eb1206ab071abc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7bd8a2e3863c445da8eb1206ab071abc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7bd8a2e3863c445da8eb1206ab071abc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7bd8a2e3863c445da8eb1206ab071abc", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:58:10.591044 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-LiveMigrationNegativeTest-1770440985 Aug 31 15:58:10.591044 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 7bd8a2e3863c445da8eb1206ab071abc Aug 31 15:58:10.591044 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1770440985 Aug 31 15:58:10.591044 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-LiveMigrationNegativeTest-1770440985-project-admin Aug 31 15:58:10.591044 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:58:10.591044 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:58:10.591044 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 7561d7ef42ee4b9695e5cbfd4ccf8b31 Aug 31 15:58:10.591044 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-LiveMigrationNegativeTest-1770440985-project-admin Aug 31 15:58:10.591044 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 15:58:10.591044 n-d-833090-16 devstack@n-api.service[128864]: {"os-migrateLive": {"host": "n-h2-833090-16", "block_migration": true, "disk_over_commit": false}} Aug 31 15:58:10.591044 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:58:10.591044 n-d-833090-16 devstack@n-api.service[128864]: exception: Cannot 'os-migrateLive' instance d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe while it is in vm_state suspended Aug 31 15:58:10.591044 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'd1cf04d7-c720-4fb5-9e0e-fc9b058f94fe', 'body': {'os-migrateLive': {'host': 'n-h2-833090-16', 'block_migration': True, 'disk_over_commit': False}}} Aug 31 15:58:10.591044 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:58:10.591044 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:58:10.591044 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 31 15:58:10.591044 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 31 15:58:10.591044 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 31 15:58:10.591044 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 15:58:10.591044 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 31 15:58:10.591044 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 31 15:58:10.591044 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 31 15:58:10.591044 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 15:58:10.591044 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 31 15:58:10.591044 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 31 15:58:10.591044 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 31 15:58:10.591044 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 15:58:10.591044 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Aug 31 15:58:10.591044 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 15:58:10.591044 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 15:58:10.591044 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 15:58:10.591044 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 15:58:10.591044 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 15:58:10.591044 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe in vm_state suspended. Cannot live_migrate while the instance is in this state. Aug 31 15:58:10.591044 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:58:10.591044 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:58:10.591044 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:58:10.591044 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:58:10.591044 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:58:10.595485 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:58:10.595485 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:58:10.595485 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:58:10.595485 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:58:10.595485 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:58:10.595485 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:58:10.595485 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:58:10.595485 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:58:10.595485 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:58:10.595485 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 15:58:10.595485 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:58:10.595485 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 31 15:58:10.595485 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Aug 31 15:58:10.595485 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 15:58:10.595485 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 15:58:10.595485 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 15:58:10.595485 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe while it is in vm_state suspended Aug 31 15:58:10.595485 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:58:10.595485 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:58:10.595485 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:58:10.595485 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:58:10.595485 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:58:10.595485 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:58:10.595485 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:58:10.595485 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:58:10.595485 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe while it is in vm_state suspended Aug 31 15:58:10.595485 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:58:10.597688 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3ffc80bc-c8af-479c-9613-a318a743767f tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:10.598818 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7a39c25e-543a-4af3-80ba-10a91b793f9f tempest-LiveMigrationNegativeTest-1770440985 tempest-LiveMigrationNegativeTest-1770440985-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe while it is in vm_state suspended {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:58:10.600052 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7a39c25e-543a-4af3-80ba-10a91b793f9f tempest-LiveMigrationNegativeTest-1770440985 tempest-LiveMigrationNegativeTest-1770440985-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe/action" status: 409 len: 155 microversion: 2.1 time: 0.174602 Aug 31 15:58:10.605973 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1153/2212] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 15:58:10 2022] POST /compute/v2.1/servers/d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe/action => generated 155 bytes in 185 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 15:58:10.607460 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3ffc80bc-c8af-479c-9613-a318a743767f tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1537 microversion: 2.91 time: 0.238519 Aug 31 15:58:10.611879 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a3a2fdd4-04f0-495c-be89-563207512afd tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb46f65790>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:10.635149 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1060/2213] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:10 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1537 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:10.652661 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1421fe27-f79e-4a44-a025-f5a4297cfecf tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:10.654008 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1421fe27-f79e-4a44-a025-f5a4297cfecf tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: a9448c8e-c801-4d08-b1c1-b34f279269e6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:10.664659 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1421fe27-f79e-4a44-a025-f5a4297cfecf tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:10.665229 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1421fe27-f79e-4a44-a025-f5a4297cfecf tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:10.665759 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1421fe27-f79e-4a44-a025-f5a4297cfecf tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:10.666728 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1421fe27-f79e-4a44-a025-f5a4297cfecf tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:10.667899 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1421fe27-f79e-4a44-a025-f5a4297cfecf tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:10.668345 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1421fe27-f79e-4a44-a025-f5a4297cfecf tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:11.842073 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a3a2fdd4-04f0-495c-be89-563207512afd tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "DELETE /compute/v2.1/images/a44aac17-897f-4534-9995-797398bda710" status: 204 len: 0 microversion: 2.1 time: 1.234382 Aug 31 15:58:11.843253 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1154/2214] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:10 2022] DELETE /compute/v2.1/images/a44aac17-897f-4534-9995-797398bda710 => generated 0 bytes in 1236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:58:11.849376 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e7183c76-c605-48a2-9287-31701700095b tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:11.850082 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e7183c76-c605-48a2-9287-31701700095b tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] [instance: 0e79fda0-f46b-48bf-9e45-a183e5470fc7] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:11.871660 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7183c76-c605-48a2-9287-31701700095b tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:11.873236 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7183c76-c605-48a2-9287-31701700095b tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:11.873886 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7183c76-c605-48a2-9287-31701700095b tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:11.875445 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7183c76-c605-48a2-9287-31701700095b tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:11.876093 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7183c76-c605-48a2-9287-31701700095b tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:11.876698 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7183c76-c605-48a2-9287-31701700095b tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:12.069395 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e7183c76-c605-48a2-9287-31701700095b tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f2bc800ceb41349e8c182d526d4d8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773dad0890c4048a0f0152e05fe8d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:12.092208 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e7183c76-c605-48a2-9287-31701700095b tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] 10.222.0.50 "GET /compute/v2.1/servers/0e79fda0-f46b-48bf-9e45-a183e5470fc7" status: 200 len: 1252 microversion: 2.1 time: 0.247220 Aug 31 15:58:12.101808 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1155/2215] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:11 2022] GET /compute/v2.1/servers/0e79fda0-f46b-48bf-9e45-a183e5470fc7 => generated 1252 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:12.110811 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6bde864f-f9e5-4a09-b982-edcbc91622c8 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:12.112120 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6bde864f-f9e5-4a09-b982-edcbc91622c8 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] [instance: d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:12.116378 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1421fe27-f79e-4a44-a025-f5a4297cfecf tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922a671cad44ea595e46290a5d52380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1371996a8304dc58ee579daa535bcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:12.124665 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6bde864f-f9e5-4a09-b982-edcbc91622c8 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:12.126401 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6bde864f-f9e5-4a09-b982-edcbc91622c8 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:12.127502 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6bde864f-f9e5-4a09-b982-edcbc91622c8 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:12.129023 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6bde864f-f9e5-4a09-b982-edcbc91622c8 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:12.129500 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1421fe27-f79e-4a44-a025-f5a4297cfecf tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/a9448c8e-c801-4d08-b1c1-b34f279269e6" status: 200 len: 1505 microversion: 2.1 time: 1.490801 Aug 31 15:58:12.142129 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1061/2216] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:10 2022] GET /compute/v2.1/servers/a9448c8e-c801-4d08-b1c1-b34f279269e6 => generated 1505 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:12.142129 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4e46f5cc-d372-4978-aff8-7f426fd281a8 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:12.142129 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4e46f5cc-d372-4978-aff8-7f426fd281a8 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 548e0225-fa26-46ba-9c12-7b52feee1784] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:12.143480 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6bde864f-f9e5-4a09-b982-edcbc91622c8 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:12.144865 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6bde864f-f9e5-4a09-b982-edcbc91622c8 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:12.157778 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e46f5cc-d372-4978-aff8-7f426fd281a8 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:12.158308 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e46f5cc-d372-4978-aff8-7f426fd281a8 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:12.161393 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e46f5cc-d372-4978-aff8-7f426fd281a8 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:12.164152 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e46f5cc-d372-4978-aff8-7f426fd281a8 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:12.164837 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e46f5cc-d372-4978-aff8-7f426fd281a8 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:12.166677 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e46f5cc-d372-4978-aff8-7f426fd281a8 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:12.226639 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:58:12.247008 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6bde864f-f9e5-4a09-b982-edcbc91622c8 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] [instance: d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:58:12.431846 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4e46f5cc-d372-4978-aff8-7f426fd281a8 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:12.443519 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4e46f5cc-d372-4978-aff8-7f426fd281a8 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:12.449352 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4e46f5cc-d372-4978-aff8-7f426fd281a8 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:12.449541 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6bde864f-f9e5-4a09-b982-edcbc91622c8 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe" status: 204 len: 0 microversion: 2.1 time: 0.345621 Aug 31 15:58:12.452310 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4e46f5cc-d372-4978-aff8-7f426fd281a8 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784" status: 200 len: 1486 microversion: 2.25 time: 0.320745 Aug 31 15:58:12.454400 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1156/2217] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:58:12 2022] DELETE /compute/v2.1/servers/d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:58:12.460174 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-dc98a36f-f34b-48a6-a5b8-795822dd9a66 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:12.461240 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-dc98a36f-f34b-48a6-a5b8-795822dd9a66 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: f044dca7-71de-4182-b5ec-825299496c10] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:12.468454 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dc98a36f-f34b-48a6-a5b8-795822dd9a66 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:12.469289 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dc98a36f-f34b-48a6-a5b8-795822dd9a66 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:12.469945 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dc98a36f-f34b-48a6-a5b8-795822dd9a66 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:12.470949 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dc98a36f-f34b-48a6-a5b8-795822dd9a66 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:12.471822 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dc98a36f-f34b-48a6-a5b8-795822dd9a66 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:12.472436 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dc98a36f-f34b-48a6-a5b8-795822dd9a66 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:12.480574 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1062/2218] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:12 2022] GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784 => generated 1486 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:12.486796 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d6da1d30-4852-469d-af0d-acd346c695e1 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:12.487718 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d6da1d30-4852-469d-af0d-acd346c695e1 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:12.494283 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6da1d30-4852-469d-af0d-acd346c695e1 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:12.494768 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6da1d30-4852-469d-af0d-acd346c695e1 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:12.496719 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6da1d30-4852-469d-af0d-acd346c695e1 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:12.497765 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6da1d30-4852-469d-af0d-acd346c695e1 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:12.498546 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6da1d30-4852-469d-af0d-acd346c695e1 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:12.499131 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6da1d30-4852-469d-af0d-acd346c695e1 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:12.640238 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d6da1d30-4852-469d-af0d-acd346c695e1 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:12.663985 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d6da1d30-4852-469d-af0d-acd346c695e1 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:12.682647 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d6da1d30-4852-469d-af0d-acd346c695e1 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:12.695862 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d6da1d30-4852-469d-af0d-acd346c695e1 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1537 microversion: 2.91 time: 0.213953 Aug 31 15:58:12.704031 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1063/2219] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:12 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1537 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:12.716566 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-161ffa27-2ad6-4144-8f81-4f6cc2fbeab6 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:12.724633 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-161ffa27-2ad6-4144-8f81-4f6cc2fbeab6 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: 434ee39d-6510-411f-93e1-0500c19fb312] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:12.738692 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-161ffa27-2ad6-4144-8f81-4f6cc2fbeab6 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:12.739521 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-161ffa27-2ad6-4144-8f81-4f6cc2fbeab6 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:12.741840 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-161ffa27-2ad6-4144-8f81-4f6cc2fbeab6 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:12.743619 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-161ffa27-2ad6-4144-8f81-4f6cc2fbeab6 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:12.747636 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-161ffa27-2ad6-4144-8f81-4f6cc2fbeab6 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:12.748403 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-161ffa27-2ad6-4144-8f81-4f6cc2fbeab6 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:12.778519 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-161ffa27-2ad6-4144-8f81-4f6cc2fbeab6 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: 434ee39d-6510-411f-93e1-0500c19fb312] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:58:12.785338 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:58:12.956150 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:58:12.961670 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-161ffa27-2ad6-4144-8f81-4f6cc2fbeab6 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "DELETE /compute/v2.1/servers/434ee39d-6510-411f-93e1-0500c19fb312" status: 204 len: 0 microversion: 2.1 time: 0.254599 Aug 31 15:58:12.963364 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-dc98a36f-f34b-48a6-a5b8-795822dd9a66 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:12.980313 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-dc98a36f-f34b-48a6-a5b8-795822dd9a66 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10" status: 200 len: 1522 microversion: 2.1 time: 0.524264 Aug 31 15:58:12.981055 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1157/2221] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:12 2022] GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10 => generated 1522 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:12.988638 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1064/2221] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:58:12 2022] DELETE /compute/v2.1/servers/434ee39d-6510-411f-93e1-0500c19fb312 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:58:12.999688 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6d7f3da6-b6e7-4d5b-b119-45ada31d3c34 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:13.002433 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-93a4099f-12e8-4b8f-9bbb-2daf8ef4f5aa req-08021920-f4c6-4875-9e31-46fe9620cd04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e79fda0-f46b-48bf-9e45-a183e5470fc7", "name": "network-vif-unplugged", "status": "completed", "tag": "44bbd514-44c8-4952-80d8-40889c33f358"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:13.003508 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6d7f3da6-b6e7-4d5b-b119-45ada31d3c34 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] [instance: d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:13.023961 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d7f3da6-b6e7-4d5b-b119-45ada31d3c34 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:13.024660 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d7f3da6-b6e7-4d5b-b119-45ada31d3c34 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:13.025209 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d7f3da6-b6e7-4d5b-b119-45ada31d3c34 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:13.028582 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-93a4099f-12e8-4b8f-9bbb-2daf8ef4f5aa req-08021920-f4c6-4875-9e31-46fe9620cd04 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:13.030375 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d7f3da6-b6e7-4d5b-b119-45ada31d3c34 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:13.030696 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-93a4099f-12e8-4b8f-9bbb-2daf8ef4f5aa req-08021920-f4c6-4875-9e31-46fe9620cd04 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:13.030897 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d7f3da6-b6e7-4d5b-b119-45ada31d3c34 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:13.031693 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-93a4099f-12e8-4b8f-9bbb-2daf8ef4f5aa req-08021920-f4c6-4875-9e31-46fe9620cd04 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:13.032014 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d7f3da6-b6e7-4d5b-b119-45ada31d3c34 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:13.062111 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-93a4099f-12e8-4b8f-9bbb-2daf8ef4f5aa req-08021920-f4c6-4875-9e31-46fe9620cd04 service nova] Creating event network-vif-unplugged:44bbd514-44c8-4952-80d8-40889c33f358 for instance 0e79fda0-f46b-48bf-9e45-a183e5470fc7 on n-h2-833090-16 Aug 31 15:58:13.077686 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-93a4099f-12e8-4b8f-9bbb-2daf8ef4f5aa req-08021920-f4c6-4875-9e31-46fe9620cd04 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087090 Aug 31 15:58:13.082940 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1065/2222] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:13.128377 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a047d4dc-7341-4d92-9c14-e25609e4b06b tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:13.129261 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a047d4dc-7341-4d92-9c14-e25609e4b06b tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] [instance: 0e79fda0-f46b-48bf-9e45-a183e5470fc7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:13.142856 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a047d4dc-7341-4d92-9c14-e25609e4b06b tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:13.147747 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a047d4dc-7341-4d92-9c14-e25609e4b06b tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:13.148350 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a047d4dc-7341-4d92-9c14-e25609e4b06b tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:13.149228 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a047d4dc-7341-4d92-9c14-e25609e4b06b tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:13.150588 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a047d4dc-7341-4d92-9c14-e25609e4b06b tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:13.151087 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a047d4dc-7341-4d92-9c14-e25609e4b06b tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:13.309376 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a047d4dc-7341-4d92-9c14-e25609e4b06b tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f2bc800ceb41349e8c182d526d4d8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773dad0890c4048a0f0152e05fe8d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:13.318584 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a047d4dc-7341-4d92-9c14-e25609e4b06b tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] 10.222.0.50 "GET /compute/v2.1/servers/0e79fda0-f46b-48bf-9e45-a183e5470fc7" status: 200 len: 1252 microversion: 2.1 time: 0.194953 Aug 31 15:58:13.338249 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1066/2223] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:13 2022] GET /compute/v2.1/servers/0e79fda0-f46b-48bf-9e45-a183e5470fc7 => generated 1252 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:58:13.345861 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bed9296b-8330-453c-b2b8-c7e29b6f4f15 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:13.348744 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bed9296b-8330-453c-b2b8-c7e29b6f4f15 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: a9448c8e-c801-4d08-b1c1-b34f279269e6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:13.363173 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bed9296b-8330-453c-b2b8-c7e29b6f4f15 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:13.364557 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bed9296b-8330-453c-b2b8-c7e29b6f4f15 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:13.366988 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bed9296b-8330-453c-b2b8-c7e29b6f4f15 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:13.367832 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bed9296b-8330-453c-b2b8-c7e29b6f4f15 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:13.370314 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bed9296b-8330-453c-b2b8-c7e29b6f4f15 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:13.371379 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bed9296b-8330-453c-b2b8-c7e29b6f4f15 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:13.380886 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6d7f3da6-b6e7-4d5b-b119-45ada31d3c34 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba08a4705f4f0a9bc6a01d16a5f607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055586a03b0a4c1989b3ac658ac6347c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:13.398960 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6d7f3da6-b6e7-4d5b-b119-45ada31d3c34 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] 10.222.0.50 "GET /compute/v2.1/servers/d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe" status: 200 len: 1466 microversion: 2.1 time: 0.416383 Aug 31 15:58:13.400762 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1158/2224] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:12 2022] GET /compute/v2.1/servers/d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe => generated 1466 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:13.415180 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c255bee1-0996-4303-ab0e-691eb09b98de tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1062312629", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "cbd57e67-cabe-44b0-9027-5fa4dc677f22"}]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:13.496014 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-c255bee1-0996-4303-ab0e-691eb09b98de tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] validate_networks() for [('cbd57e67-cabe-44b0-9027-5fa4dc677f22', None, None, None, None, None)] {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:58:14.474678 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bed9296b-8330-453c-b2b8-c7e29b6f4f15 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922a671cad44ea595e46290a5d52380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1371996a8304dc58ee579daa535bcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:14.496133 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bed9296b-8330-453c-b2b8-c7e29b6f4f15 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/a9448c8e-c801-4d08-b1c1-b34f279269e6" status: 200 len: 1505 microversion: 2.1 time: 1.156392 Aug 31 15:58:14.502613 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1067/2225] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:13 2022] GET /compute/v2.1/servers/a9448c8e-c801-4d08-b1c1-b34f279269e6 => generated 1505 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:14.507670 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e8c1f79d-9f7e-42bc-b7bf-dc52cee71d96 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:14.508288 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e8c1f79d-9f7e-42bc-b7bf-dc52cee71d96 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 548e0225-fa26-46ba-9c12-7b52feee1784] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:14.534563 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8c1f79d-9f7e-42bc-b7bf-dc52cee71d96 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:14.535052 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8c1f79d-9f7e-42bc-b7bf-dc52cee71d96 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:14.535482 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8c1f79d-9f7e-42bc-b7bf-dc52cee71d96 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:14.536187 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8c1f79d-9f7e-42bc-b7bf-dc52cee71d96 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:14.536629 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8c1f79d-9f7e-42bc-b7bf-dc52cee71d96 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:14.537069 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8c1f79d-9f7e-42bc-b7bf-dc52cee71d96 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:14.986190 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e8c1f79d-9f7e-42bc-b7bf-dc52cee71d96 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:14.996011 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e8c1f79d-9f7e-42bc-b7bf-dc52cee71d96 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:15.003220 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e8c1f79d-9f7e-42bc-b7bf-dc52cee71d96 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:15.004607 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e8c1f79d-9f7e-42bc-b7bf-dc52cee71d96 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784" status: 200 len: 1476 microversion: 2.25 time: 0.500918 Aug 31 15:58:15.013502 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1068/2226] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:14 2022] GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784 => generated 1476 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:15.031534 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2ff091f4-dfc8-4bef-9af8-2825cb4a2dfa tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:15.032289 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2ff091f4-dfc8-4bef-9af8-2825cb4a2dfa tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:15.048410 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ff091f4-dfc8-4bef-9af8-2825cb4a2dfa tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:15.049045 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ff091f4-dfc8-4bef-9af8-2825cb4a2dfa tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:15.049584 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ff091f4-dfc8-4bef-9af8-2825cb4a2dfa tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:15.050465 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ff091f4-dfc8-4bef-9af8-2825cb4a2dfa tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:15.051075 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ff091f4-dfc8-4bef-9af8-2825cb4a2dfa tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:15.051601 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ff091f4-dfc8-4bef-9af8-2825cb4a2dfa tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:15.289488 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2ff091f4-dfc8-4bef-9af8-2825cb4a2dfa tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:15.304526 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2ff091f4-dfc8-4bef-9af8-2825cb4a2dfa tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:15.306239 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2ff091f4-dfc8-4bef-9af8-2825cb4a2dfa tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:15.306835 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-c255bee1-0996-4303-ab0e-691eb09b98de tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:58:15.307291 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-c255bee1-0996-4303-ab0e-691eb09b98de tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:58:15.307718 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-c255bee1-0996-4303-ab0e-691eb09b98de tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:58:15.308123 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-c255bee1-0996-4303-ab0e-691eb09b98de tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:58:15.308535 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-c255bee1-0996-4303-ab0e-691eb09b98de tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:58:15.320744 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2ff091f4-dfc8-4bef-9af8-2825cb4a2dfa tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1537 microversion: 2.91 time: 0.305421 Aug 31 15:58:15.338120 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1069/2227] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:15 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1537 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:15.338120 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-315442cb-4d7c-4714-8ba1-ec3809687f4b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:15.338637 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-315442cb-4d7c-4714-8ba1-ec3809687f4b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: f044dca7-71de-4182-b5ec-825299496c10] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:15.338844 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c255bee1-0996-4303-ab0e-691eb09b98de tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:15.339280 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c255bee1-0996-4303-ab0e-691eb09b98de tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:15.339714 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c255bee1-0996-4303-ab0e-691eb09b98de tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:15.345869 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c255bee1-0996-4303-ab0e-691eb09b98de tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:15.345869 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c255bee1-0996-4303-ab0e-691eb09b98de tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:15.345869 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c255bee1-0996-4303-ab0e-691eb09b98de tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:15.357035 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-315442cb-4d7c-4714-8ba1-ec3809687f4b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:15.357855 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-315442cb-4d7c-4714-8ba1-ec3809687f4b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:15.359186 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-315442cb-4d7c-4714-8ba1-ec3809687f4b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:15.359925 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-315442cb-4d7c-4714-8ba1-ec3809687f4b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:15.360387 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-315442cb-4d7c-4714-8ba1-ec3809687f4b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:15.360815 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-315442cb-4d7c-4714-8ba1-ec3809687f4b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:15.413583 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-c255bee1-0996-4303-ab0e-691eb09b98de tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Getting quotas for project c508a07ab50746468f855f7c5893ffdc. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:58:15.420129 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-c255bee1-0996-4303-ab0e-691eb09b98de tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Getting quotas for user 7d84a1872d9442b2886a8060d2e59580 and project c508a07ab50746468f855f7c5893ffdc. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:58:15.435867 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c255bee1-0996-4303-ab0e-691eb09b98de tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:58:15.445874 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c255bee1-0996-4303-ab0e-691eb09b98de tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: a4977edb-9ae0-48ee-887d-d19a5db58a43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:58:15.533803 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c255bee1-0996-4303-ab0e-691eb09b98de tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.131660 Aug 31 15:58:15.550486 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1159/2228] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:58:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2149 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 15:58:15.555693 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4d25c8b5-82f4-4b3d-a9f8-a6ca2321ce80 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:15.556313 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4d25c8b5-82f4-4b3d-a9f8-a6ca2321ce80 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] [instance: 0e79fda0-f46b-48bf-9e45-a183e5470fc7] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:15.572362 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4d25c8b5-82f4-4b3d-a9f8-a6ca2321ce80 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:15.573117 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4d25c8b5-82f4-4b3d-a9f8-a6ca2321ce80 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:15.573707 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4d25c8b5-82f4-4b3d-a9f8-a6ca2321ce80 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:15.579192 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4d25c8b5-82f4-4b3d-a9f8-a6ca2321ce80 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:15.580721 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4d25c8b5-82f4-4b3d-a9f8-a6ca2321ce80 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:15.581488 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4d25c8b5-82f4-4b3d-a9f8-a6ca2321ce80 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:15.734491 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4d25c8b5-82f4-4b3d-a9f8-a6ca2321ce80 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f2bc800ceb41349e8c182d526d4d8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773dad0890c4048a0f0152e05fe8d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:15.765894 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4d25c8b5-82f4-4b3d-a9f8-a6ca2321ce80 tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] 10.222.0.50 "GET /compute/v2.1/servers/0e79fda0-f46b-48bf-9e45-a183e5470fc7" status: 200 len: 1252 microversion: 2.1 time: 0.213990 Aug 31 15:58:15.769332 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1160/2229] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:15 2022] GET /compute/v2.1/servers/0e79fda0-f46b-48bf-9e45-a183e5470fc7 => generated 1252 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:15.787975 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-69a7b957-a2cc-4dd8-870f-3e3584fb68e8 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:15.789577 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-69a7b957-a2cc-4dd8-870f-3e3584fb68e8 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] [instance: d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:15.796706 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-315442cb-4d7c-4714-8ba1-ec3809687f4b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:15.813330 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69a7b957-a2cc-4dd8-870f-3e3584fb68e8 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:15.816218 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69a7b957-a2cc-4dd8-870f-3e3584fb68e8 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:15.820335 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69a7b957-a2cc-4dd8-870f-3e3584fb68e8 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:15.821563 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69a7b957-a2cc-4dd8-870f-3e3584fb68e8 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:15.822784 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-315442cb-4d7c-4714-8ba1-ec3809687f4b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10" status: 200 len: 1522 microversion: 2.1 time: 0.495586 Aug 31 15:58:15.830046 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69a7b957-a2cc-4dd8-870f-3e3584fb68e8 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:15.831740 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69a7b957-a2cc-4dd8-870f-3e3584fb68e8 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:15.841623 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1070/2230] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:15 2022] GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10 => generated 1522 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:15.849077 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4accf99f-60f9-4387-879f-604a9b35b375 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Calling method '.version_select at 0x7fbb4ab7a790>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:15.864035 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4accf99f-60f9-4387-879f-604a9b35b375 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:15.864829 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4accf99f-60f9-4387-879f-604a9b35b375 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:15.865456 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4accf99f-60f9-4387-879f-604a9b35b375 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:15.889247 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4accf99f-60f9-4387-879f-604a9b35b375 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] 10.222.0.50 "GET /compute/v2.1/os-migrations" status: 200 len: 1956 microversion: 2.25 time: 0.045757 Aug 31 15:58:15.893818 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1071/2231] 10.222.0.50 () {60 vars in 1184 bytes} [Wed Aug 31 15:58:15 2022] GET /compute/v2.1/os-migrations => generated 1956 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:15.932497 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-45d12839-bd00-4078-adb6-b8a9a3aaa012 req-288251e1-b551-4cdc-ae4d-0a0d5e8b44a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "434ee39d-6510-411f-93e1-0500c19fb312", "name": "network-vif-unplugged", "status": "completed", "tag": "5109e7a2-31db-42fd-b192-796f0b872104"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:15.959177 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-45d12839-bd00-4078-adb6-b8a9a3aaa012 req-288251e1-b551-4cdc-ae4d-0a0d5e8b44a2 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:15.961523 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-45d12839-bd00-4078-adb6-b8a9a3aaa012 req-288251e1-b551-4cdc-ae4d-0a0d5e8b44a2 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:15.962056 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-45d12839-bd00-4078-adb6-b8a9a3aaa012 req-288251e1-b551-4cdc-ae4d-0a0d5e8b44a2 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:15.989925 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-45d12839-bd00-4078-adb6-b8a9a3aaa012 req-288251e1-b551-4cdc-ae4d-0a0d5e8b44a2 service nova] Creating event network-vif-unplugged:5109e7a2-31db-42fd-b192-796f0b872104 for instance 434ee39d-6510-411f-93e1-0500c19fb312 on n-h1-833090-16 Aug 31 15:58:16.002653 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-45d12839-bd00-4078-adb6-b8a9a3aaa012 req-288251e1-b551-4cdc-ae4d-0a0d5e8b44a2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079380 Aug 31 15:58:16.008878 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1072/2232] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:16.017776 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-eb046467-a953-40e3-92f7-e6a7482eb37d tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:16.023222 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-eb046467-a953-40e3-92f7-e6a7482eb37d tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: a9448c8e-c801-4d08-b1c1-b34f279269e6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:16.044065 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb046467-a953-40e3-92f7-e6a7482eb37d tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:16.045412 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb046467-a953-40e3-92f7-e6a7482eb37d tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:16.049813 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb046467-a953-40e3-92f7-e6a7482eb37d tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:16.051088 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb046467-a953-40e3-92f7-e6a7482eb37d tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:16.053163 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb046467-a953-40e3-92f7-e6a7482eb37d tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:16.053992 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb046467-a953-40e3-92f7-e6a7482eb37d tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:17.073823 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-eb046467-a953-40e3-92f7-e6a7482eb37d tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922a671cad44ea595e46290a5d52380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1371996a8304dc58ee579daa535bcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:17.105740 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-69a7b957-a2cc-4dd8-870f-3e3584fb68e8 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba08a4705f4f0a9bc6a01d16a5f607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055586a03b0a4c1989b3ac658ac6347c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:17.125982 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-eb046467-a953-40e3-92f7-e6a7482eb37d tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/a9448c8e-c801-4d08-b1c1-b34f279269e6" status: 200 len: 1485 microversion: 2.1 time: 1.111512 Aug 31 15:58:17.126671 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1073/2233] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:16 2022] GET /compute/v2.1/servers/a9448c8e-c801-4d08-b1c1-b34f279269e6 => generated 1485 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:17.142840 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-69a7b957-a2cc-4dd8-870f-3e3584fb68e8 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] 10.222.0.50 "GET /compute/v2.1/servers/d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe" status: 200 len: 1466 microversion: 2.1 time: 1.371175 Aug 31 15:58:17.145022 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1161/2234] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:15 2022] GET /compute/v2.1/servers/d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe => generated 1466 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:17.150681 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9be567eb-ec8d-4fab-a51b-d52077e099c8 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:17.158645 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9be567eb-ec8d-4fab-a51b-d52077e099c8 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: a4977edb-9ae0-48ee-887d-d19a5db58a43] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:17.188486 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-925c4ed5-8e2a-47e3-b887-0501c7b76159 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:17.193722 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-925c4ed5-8e2a-47e3-b887-0501c7b76159 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] [instance: 548e0225-fa26-46ba-9c12-7b52feee1784] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:17.204629 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9be567eb-ec8d-4fab-a51b-d52077e099c8 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:17.205564 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9be567eb-ec8d-4fab-a51b-d52077e099c8 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:17.207757 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9be567eb-ec8d-4fab-a51b-d52077e099c8 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:17.208665 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9be567eb-ec8d-4fab-a51b-d52077e099c8 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:17.211063 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-925c4ed5-8e2a-47e3-b887-0501c7b76159 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:17.212625 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9be567eb-ec8d-4fab-a51b-d52077e099c8 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:17.220776 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-925c4ed5-8e2a-47e3-b887-0501c7b76159 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:17.221044 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9be567eb-ec8d-4fab-a51b-d52077e099c8 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:17.223992 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-925c4ed5-8e2a-47e3-b887-0501c7b76159 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:17.224739 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-925c4ed5-8e2a-47e3-b887-0501c7b76159 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:17.225207 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-925c4ed5-8e2a-47e3-b887-0501c7b76159 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:17.225639 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-925c4ed5-8e2a-47e3-b887-0501c7b76159 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:17.777156 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9be567eb-ec8d-4fab-a51b-d52077e099c8 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:17.792044 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9be567eb-ec8d-4fab-a51b-d52077e099c8 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/a4977edb-9ae0-48ee-887d-d19a5db58a43" status: 200 len: 1204 microversion: 2.1 time: 0.659964 Aug 31 15:58:17.795246 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1074/2235] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:17 2022] GET /compute/v2.1/servers/a4977edb-9ae0-48ee-887d-d19a5db58a43 => generated 1204 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:17.830068 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2c14d4ee-5348-433f-a070-28787713b281 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:17.830823 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2c14d4ee-5348-433f-a070-28787713b281 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:17.875096 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c14d4ee-5348-433f-a070-28787713b281 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:17.875739 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c14d4ee-5348-433f-a070-28787713b281 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:17.876850 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c14d4ee-5348-433f-a070-28787713b281 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:17.879783 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c14d4ee-5348-433f-a070-28787713b281 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:17.881405 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c14d4ee-5348-433f-a070-28787713b281 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:17.883573 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c14d4ee-5348-433f-a070-28787713b281 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:18.172213 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2c14d4ee-5348-433f-a070-28787713b281 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:18.222797 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2c14d4ee-5348-433f-a070-28787713b281 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:18.224792 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-925c4ed5-8e2a-47e3-b887-0501c7b76159 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] Lazy-loading 'services' on Instance uuid 548e0225-fa26-46ba-9c12-7b52feee1784 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:58:18.229569 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2c14d4ee-5348-433f-a070-28787713b281 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:18.256803 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2c14d4ee-5348-433f-a070-28787713b281 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1537 microversion: 2.91 time: 0.456959 Aug 31 15:58:18.259690 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1075/2236] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:17 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1537 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:18.273561 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4a58fbbb-723e-4b94-9a33-e8b417af830f tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:18.278720 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4a58fbbb-723e-4b94-9a33-e8b417af830f tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] [instance: 0e79fda0-f46b-48bf-9e45-a183e5470fc7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:18.297654 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-925c4ed5-8e2a-47e3-b887-0501c7b76159 tempest-LiveAutoBlockMigrationV225Test-1662970618 tempest-LiveAutoBlockMigrationV225Test-1662970618-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784" status: 200 len: 1971 microversion: 2.25 time: 1.151315 Aug 31 15:58:18.300783 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a58fbbb-723e-4b94-9a33-e8b417af830f tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:18.303237 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a58fbbb-723e-4b94-9a33-e8b417af830f tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:18.306529 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a58fbbb-723e-4b94-9a33-e8b417af830f tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:18.307299 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a58fbbb-723e-4b94-9a33-e8b417af830f tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:18.310507 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a58fbbb-723e-4b94-9a33-e8b417af830f tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:18.312345 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a58fbbb-723e-4b94-9a33-e8b417af830f tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:18.315267 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1162/2237] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:17 2022] GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784 => generated 1971 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:18.346150 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4dd4e531-b1dc-428c-a28b-9a432ba9e3dc tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:18.356964 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4dd4e531-b1dc-428c-a28b-9a432ba9e3dc tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: f044dca7-71de-4182-b5ec-825299496c10] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:18.388940 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4dd4e531-b1dc-428c-a28b-9a432ba9e3dc tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:18.401319 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a58fbbb-723e-4b94-9a33-e8b417af830f tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:18.401867 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a58fbbb-723e-4b94-9a33-e8b417af830f tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:18.402359 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a58fbbb-723e-4b94-9a33-e8b417af830f tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:18.402816 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-4a58fbbb-723e-4b94-9a33-e8b417af830f tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lazy-loading 'fault' on Instance uuid 0e79fda0-f46b-48bf-9e45-a183e5470fc7 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:58:18.407455 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4dd4e531-b1dc-428c-a28b-9a432ba9e3dc tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:18.411177 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4dd4e531-b1dc-428c-a28b-9a432ba9e3dc tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:18.412228 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4dd4e531-b1dc-428c-a28b-9a432ba9e3dc tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:18.418494 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4dd4e531-b1dc-428c-a28b-9a432ba9e3dc tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:18.423940 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4dd4e531-b1dc-428c-a28b-9a432ba9e3dc tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:18.556244 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4a58fbbb-723e-4b94-9a33-e8b417af830f tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f2bc800ceb41349e8c182d526d4d8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773dad0890c4048a0f0152e05fe8d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:18.566192 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4a58fbbb-723e-4b94-9a33-e8b417af830f tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] 10.222.0.50 "GET /compute/v2.1/servers/0e79fda0-f46b-48bf-9e45-a183e5470fc7" status: 200 len: 1211 microversion: 2.1 time: 0.305259 Aug 31 15:58:18.567456 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1076/2238] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:18 2022] GET /compute/v2.1/servers/0e79fda0-f46b-48bf-9e45-a183e5470fc7 => generated 1211 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:18.581512 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-03411997-383e-4ae1-aca3-c3f9f3dae79c tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-2123366971", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:18.759953 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-03411997-383e-4ae1-aca3-c3f9f3dae79c tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] validate_networks() for [('95b34cb5-ccab-4e4a-8df6-349b72ccc459', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:58:19.337016 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:58:19.470713 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4dd4e531-b1dc-428c-a28b-9a432ba9e3dc tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:19.528354 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4dd4e531-b1dc-428c-a28b-9a432ba9e3dc tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10" status: 200 len: 1522 microversion: 2.1 time: 1.207061 Aug 31 15:58:19.552181 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1163/2239] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:18 2022] GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10 => generated 1522 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:19.596705 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-06d53e82-0010-43ba-9aa0-8ed38830818e tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:19.598141 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-06d53e82-0010-43ba-9aa0-8ed38830818e tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] [instance: d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:19.639892 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06d53e82-0010-43ba-9aa0-8ed38830818e tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:19.642870 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06d53e82-0010-43ba-9aa0-8ed38830818e tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:19.647087 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06d53e82-0010-43ba-9aa0-8ed38830818e tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:19.649695 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06d53e82-0010-43ba-9aa0-8ed38830818e tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:19.653959 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06d53e82-0010-43ba-9aa0-8ed38830818e tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:19.654681 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06d53e82-0010-43ba-9aa0-8ed38830818e tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:19.761835 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06d53e82-0010-43ba-9aa0-8ed38830818e tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:19.763718 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06d53e82-0010-43ba-9aa0-8ed38830818e tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:19.765285 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06d53e82-0010-43ba-9aa0-8ed38830818e tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:19.767217 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-06d53e82-0010-43ba-9aa0-8ed38830818e tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lazy-loading 'fault' on Instance uuid d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:58:20.254192 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-06d53e82-0010-43ba-9aa0-8ed38830818e tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba08a4705f4f0a9bc6a01d16a5f607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055586a03b0a4c1989b3ac658ac6347c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:20.270470 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-06d53e82-0010-43ba-9aa0-8ed38830818e tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] 10.222.0.50 "GET /compute/v2.1/servers/d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe" status: 200 len: 1309 microversion: 2.1 time: 0.705198 Aug 31 15:58:20.272533 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1164/2240] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:19 2022] GET /compute/v2.1/servers/d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe => generated 1309 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:20.297155 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-e32f2e05-f564-4d0f-87df-5e416fd26755 req-8c6606f3-d457-4947-a681-b29f07f77887 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe", "name": "network-vif-deleted", "tag": "355c9967-e584-4ea1-9ceb-8c16fab4e749"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:20.319641 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-e32f2e05-f564-4d0f-87df-5e416fd26755 req-8c6606f3-d457-4947-a681-b29f07f77887 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:20.324283 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-e32f2e05-f564-4d0f-87df-5e416fd26755 req-8c6606f3-d457-4947-a681-b29f07f77887 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:20.325080 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-e32f2e05-f564-4d0f-87df-5e416fd26755 req-8c6606f3-d457-4947-a681-b29f07f77887 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:20.353577 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-e32f2e05-f564-4d0f-87df-5e416fd26755 req-8c6606f3-d457-4947-a681-b29f07f77887 service nova] Creating event network-vif-deleted:355c9967-e584-4ea1-9ceb-8c16fab4e749 for instance d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe on n-h1-833090-16 Aug 31 15:58:20.387634 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-e32f2e05-f564-4d0f-87df-5e416fd26755 req-8c6606f3-d457-4947-a681-b29f07f77887 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113538 Aug 31 15:58:20.390244 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1165/2241] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:20.409990 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a9ba5752-0b19-4316-b9b8-4d299e8b8c84 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:20.423471 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a9ba5752-0b19-4316-b9b8-4d299e8b8c84 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 548e0225-fa26-46ba-9c12-7b52feee1784] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:20.439604 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a9ba5752-0b19-4316-b9b8-4d299e8b8c84 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:20.451051 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a9ba5752-0b19-4316-b9b8-4d299e8b8c84 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:20.451610 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a9ba5752-0b19-4316-b9b8-4d299e8b8c84 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:20.452358 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a9ba5752-0b19-4316-b9b8-4d299e8b8c84 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:20.454942 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a9ba5752-0b19-4316-b9b8-4d299e8b8c84 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:20.462856 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a9ba5752-0b19-4316-b9b8-4d299e8b8c84 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:20.556367 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a9ba5752-0b19-4316-b9b8-4d299e8b8c84 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 548e0225-fa26-46ba-9c12-7b52feee1784] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:58:20.836713 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a9ba5752-0b19-4316-b9b8-4d299e8b8c84 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "DELETE /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784" status: 204 len: 0 microversion: 2.25 time: 0.444619 Aug 31 15:58:20.837648 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1166/2242] 10.222.0.50 () {60 vars in 1280 bytes} [Wed Aug 31 15:58:20 2022] DELETE /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 15:58:20.843774 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5fa42c73-ce68-4b90-bf39-0b123eca4cf1 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:20.844790 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5fa42c73-ce68-4b90-bf39-0b123eca4cf1 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: a4977edb-9ae0-48ee-887d-d19a5db58a43] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:20.863698 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5fa42c73-ce68-4b90-bf39-0b123eca4cf1 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:20.864263 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5fa42c73-ce68-4b90-bf39-0b123eca4cf1 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:20.864696 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5fa42c73-ce68-4b90-bf39-0b123eca4cf1 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:20.865395 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5fa42c73-ce68-4b90-bf39-0b123eca4cf1 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:20.865841 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5fa42c73-ce68-4b90-bf39-0b123eca4cf1 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:20.866290 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5fa42c73-ce68-4b90-bf39-0b123eca4cf1 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:21.154500 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-03411997-383e-4ae1-aca3-c3f9f3dae79c tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:58:21.155161 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-03411997-383e-4ae1-aca3-c3f9f3dae79c tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:58:21.155504 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-03411997-383e-4ae1-aca3-c3f9f3dae79c tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:58:21.155986 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-03411997-383e-4ae1-aca3-c3f9f3dae79c tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:58:21.156475 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-03411997-383e-4ae1-aca3-c3f9f3dae79c tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:58:21.174627 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03411997-383e-4ae1-aca3-c3f9f3dae79c tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:21.175116 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03411997-383e-4ae1-aca3-c3f9f3dae79c tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:21.175539 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03411997-383e-4ae1-aca3-c3f9f3dae79c tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:21.176260 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03411997-383e-4ae1-aca3-c3f9f3dae79c tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:21.176703 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03411997-383e-4ae1-aca3-c3f9f3dae79c tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:21.177119 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03411997-383e-4ae1-aca3-c3f9f3dae79c tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:21.236563 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5fa42c73-ce68-4b90-bf39-0b123eca4cf1 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:21.244682 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5fa42c73-ce68-4b90-bf39-0b123eca4cf1 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/a4977edb-9ae0-48ee-887d-d19a5db58a43" status: 200 len: 1266 microversion: 2.1 time: 0.405597 Aug 31 15:58:21.245259 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1167/2243] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:20 2022] GET /compute/v2.1/servers/a4977edb-9ae0-48ee-887d-d19a5db58a43 => generated 1266 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:21.247993 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-03411997-383e-4ae1-aca3-c3f9f3dae79c tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Getting quotas for project f1371996a8304dc58ee579daa535bcd7. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:58:21.255942 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-128af3e0-e79a-4c95-8b5d-2f9f4c294b57 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:21.260792 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-03411997-383e-4ae1-aca3-c3f9f3dae79c tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Getting quotas for user f922a671cad44ea595e46290a5d52380 and project f1371996a8304dc58ee579daa535bcd7. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:58:21.266745 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-128af3e0-e79a-4c95-8b5d-2f9f4c294b57 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:21.289149 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:58:21.291102 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-128af3e0-e79a-4c95-8b5d-2f9f4c294b57 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:21.296431 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-128af3e0-e79a-4c95-8b5d-2f9f4c294b57 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:21.297196 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-128af3e0-e79a-4c95-8b5d-2f9f4c294b57 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:21.298157 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-128af3e0-e79a-4c95-8b5d-2f9f4c294b57 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:21.300578 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-128af3e0-e79a-4c95-8b5d-2f9f4c294b57 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:21.301277 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-128af3e0-e79a-4c95-8b5d-2f9f4c294b57 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:21.313656 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-03411997-383e-4ae1-aca3-c3f9f3dae79c tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:58:21.347903 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-03411997-383e-4ae1-aca3-c3f9f3dae79c tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: 13cdbabc-03ef-4025-b984-4bba559857ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:58:21.432416 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-128af3e0-e79a-4c95-8b5d-2f9f4c294b57 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:21.443896 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-128af3e0-e79a-4c95-8b5d-2f9f4c294b57 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:21.453619 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-128af3e0-e79a-4c95-8b5d-2f9f4c294b57 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:21.463729 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-128af3e0-e79a-4c95-8b5d-2f9f4c294b57 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1537 microversion: 2.91 time: 0.214082 Aug 31 15:58:21.481812 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-03411997-383e-4ae1-aca3-c3f9f3dae79c tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.912247 Aug 31 15:58:21.482126 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1168/2244] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:21 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1537 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:21.489050 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a7b18af3-1fe9-42d7-a116-069ec4a7c50a tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:21.490331 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a7b18af3-1fe9-42d7-a116-069ec4a7c50a tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] [instance: 0e79fda0-f46b-48bf-9e45-a183e5470fc7] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:21.491440 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1077/2245] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:58:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 2922 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 15:58:21.498930 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-986ceea4-2e11-415e-bc96-13e31b4268eb req-b046e38d-2035-4d85-ad0d-410392fd7ec3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "434ee39d-6510-411f-93e1-0500c19fb312", "name": "network-vif-deleted", "tag": "5109e7a2-31db-42fd-b192-796f0b872104"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:21.506688 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a7b18af3-1fe9-42d7-a116-069ec4a7c50a tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:21.508546 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a7b18af3-1fe9-42d7-a116-069ec4a7c50a tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:21.511594 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-986ceea4-2e11-415e-bc96-13e31b4268eb req-b046e38d-2035-4d85-ad0d-410392fd7ec3 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:21.512486 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-986ceea4-2e11-415e-bc96-13e31b4268eb req-b046e38d-2035-4d85-ad0d-410392fd7ec3 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:21.513364 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-986ceea4-2e11-415e-bc96-13e31b4268eb req-b046e38d-2035-4d85-ad0d-410392fd7ec3 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:21.523920 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a7b18af3-1fe9-42d7-a116-069ec4a7c50a tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:21.525649 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a7b18af3-1fe9-42d7-a116-069ec4a7c50a tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:21.527812 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a7b18af3-1fe9-42d7-a116-069ec4a7c50a tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:21.528324 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a7b18af3-1fe9-42d7-a116-069ec4a7c50a tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:21.530672 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-986ceea4-2e11-415e-bc96-13e31b4268eb req-b046e38d-2035-4d85-ad0d-410392fd7ec3 service nova] Creating event network-vif-deleted:5109e7a2-31db-42fd-b192-796f0b872104 for instance 434ee39d-6510-411f-93e1-0500c19fb312 on n-h1-833090-16 Aug 31 15:58:21.536937 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-986ceea4-2e11-415e-bc96-13e31b4268eb req-b046e38d-2035-4d85-ad0d-410392fd7ec3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043132 Aug 31 15:58:21.538266 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1078/2246] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:21.544639 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cfd1dc15-3fb8-4684-a265-e82a1b0c6c39 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:21.545644 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cfd1dc15-3fb8-4684-a265-e82a1b0c6c39 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: f044dca7-71de-4182-b5ec-825299496c10] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:21.553198 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cfd1dc15-3fb8-4684-a265-e82a1b0c6c39 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:21.554190 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cfd1dc15-3fb8-4684-a265-e82a1b0c6c39 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:21.554848 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cfd1dc15-3fb8-4684-a265-e82a1b0c6c39 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:21.555750 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cfd1dc15-3fb8-4684-a265-e82a1b0c6c39 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:21.557043 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cfd1dc15-3fb8-4684-a265-e82a1b0c6c39 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:21.557708 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cfd1dc15-3fb8-4684-a265-e82a1b0c6c39 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:21.567057 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-a7b18af3-1fe9-42d7-a116-069ec4a7c50a tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] HTTP exception thrown: Instance 0e79fda0-f46b-48bf-9e45-a183e5470fc7 could not be found. Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a7b18af3-1fe9-42d7-a116-069ec4a7c50a tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Request method failure captured: Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/0e79fda0-f46b-48bf-9e45-a183e5470fc7 HTTP/1.1 Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4SMbAe_q3j74JfaZvatylDTuOH69G3WirAQ_ZchbKJQwRoxDWM70pb4LKHp7iS0e-63352N6KgA0u3DfbEA0BgsToFnNqoxhYQsDiB72Hq3qGWgLkh20IOtl1Ai66SER1l_0ydmnThgEC4dOwU6llPHBjmcKMLyxkLNjaW3jNaky0c Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: e773dad0890c4048a0f0152e05fe8d77 Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServersTestBootFromVolume-2024513306 Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e773dad0890c4048a0f0152e05fe8d77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e773dad0890c4048a0f0152e05fe8d77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e773dad0890c4048a0f0152e05fe8d77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e773dad0890c4048a0f0152e05fe8d77", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServersTestBootFromVolume-2024513306 Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: e773dad0890c4048a0f0152e05fe8d77 Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServersTestBootFromVolume-2024513306 Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServersTestBootFromVolume-2024513306-project Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: e8f2bc800ceb41349e8c182d526d4d8e Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServersTestBootFromVolume-2024513306-project Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 0e79fda0-f46b-48bf-9e45-a183e5470fc7 could not be found. Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '0e79fda0-f46b-48bf-9e45-a183e5470fc7'} Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e79fda0-f46b-48bf-9e45-a183e5470fc7 could not be found. Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e79fda0-f46b-48bf-9e45-a183e5470fc7 could not be found. Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:58:21.572444 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:58:21.577336 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:58:21.577336 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:58:21.577336 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:58:21.577336 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:58:21.577336 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:58:21.577336 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e79fda0-f46b-48bf-9e45-a183e5470fc7 could not be found. Aug 31 15:58:21.577336 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:58:21.577336 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a7b18af3-1fe9-42d7-a116-069ec4a7c50a tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Returning 404 to user: Instance 0e79fda0-f46b-48bf-9e45-a183e5470fc7 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:58:21.577336 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a7b18af3-1fe9-42d7-a116-069ec4a7c50a tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] 10.222.0.50 "GET /compute/v2.1/servers/0e79fda0-f46b-48bf-9e45-a183e5470fc7" status: 404 len: 111 microversion: 2.1 time: 0.091043 Aug 31 15:58:21.586510 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1169/2247] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:21 2022] GET /compute/v2.1/servers/0e79fda0-f46b-48bf-9e45-a183e5470fc7 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:58:21.591826 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-923ccc02-3a92-44fe-91e4-441cd05a21f5 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:21.595240 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-923ccc02-3a92-44fe-91e4-441cd05a21f5 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 548e0225-fa26-46ba-9c12-7b52feee1784] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:21.615724 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-923ccc02-3a92-44fe-91e4-441cd05a21f5 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:21.628124 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-923ccc02-3a92-44fe-91e4-441cd05a21f5 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:21.629014 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-923ccc02-3a92-44fe-91e4-441cd05a21f5 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:21.631069 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-923ccc02-3a92-44fe-91e4-441cd05a21f5 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:21.632750 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-923ccc02-3a92-44fe-91e4-441cd05a21f5 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:21.638383 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-923ccc02-3a92-44fe-91e4-441cd05a21f5 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:22.501152 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cfd1dc15-3fb8-4684-a265-e82a1b0c6c39 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:22.516266 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cfd1dc15-3fb8-4684-a265-e82a1b0c6c39 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10" status: 200 len: 1522 microversion: 2.1 time: 0.974726 Aug 31 15:58:22.520186 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1079/2248] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:21 2022] GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10 => generated 1522 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:22.534935 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cf1315a9-5334-49e3-ac18-dfcceb3cc6c7 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:22.535595 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cf1315a9-5334-49e3-ac18-dfcceb3cc6c7 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] [instance: d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:22.553239 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf1315a9-5334-49e3-ac18-dfcceb3cc6c7 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:22.554889 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf1315a9-5334-49e3-ac18-dfcceb3cc6c7 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:22.557412 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf1315a9-5334-49e3-ac18-dfcceb3cc6c7 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:22.561296 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf1315a9-5334-49e3-ac18-dfcceb3cc6c7 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:22.565158 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf1315a9-5334-49e3-ac18-dfcceb3cc6c7 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:22.566980 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf1315a9-5334-49e3-ac18-dfcceb3cc6c7 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:22.617506 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-cf1315a9-5334-49e3-ac18-dfcceb3cc6c7 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] HTTP exception thrown: Instance d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe could not be found. Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cf1315a9-5334-49e3-ac18-dfcceb3cc6c7 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Request method failure captured: Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe HTTP/1.1 Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4TSjRmyxkxB3EbpU91At_wUFAoSWk5gWWhvVXVgTOKDHQ6eOoT0_cfEJZBCRceiGO3lHiWnKlZb4uECbOS-R4cOk_V-lOr6ePYTTG-Q5uvtcgt6fkLFMGi0-yYWauJflwZLvBy6ldbwn-J4MuJQ3b4e9cH-X2zj-glWZuZzTtsBfZ4 Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 055586a03b0a4c1989b3ac658ac6347c Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-LiveMigrationNegativeTest-335890209 Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/055586a03b0a4c1989b3ac658ac6347c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/055586a03b0a4c1989b3ac658ac6347c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/055586a03b0a4c1989b3ac658ac6347c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_055586a03b0a4c1989b3ac658ac6347c", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-LiveMigrationNegativeTest-335890209 Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 055586a03b0a4c1989b3ac658ac6347c Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-335890209 Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-LiveMigrationNegativeTest-335890209-project Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: b0ba08a4705f4f0a9bc6a01d16a5f607 Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-LiveMigrationNegativeTest-335890209-project Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe could not be found. Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'd1cf04d7-c720-4fb5-9e0e-fc9b058f94fe'} Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe could not be found. Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe could not be found. Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:58:22.622900 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:58:22.630473 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:58:22.630473 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:58:22.630473 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:58:22.630473 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:58:22.630473 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:58:22.630473 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe could not be found. Aug 31 15:58:22.630473 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:58:22.630473 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cf1315a9-5334-49e3-ac18-dfcceb3cc6c7 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Returning 404 to user: Instance d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:58:22.635512 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cf1315a9-5334-49e3-ac18-dfcceb3cc6c7 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] 10.222.0.50 "GET /compute/v2.1/servers/d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe" status: 404 len: 111 microversion: 2.1 time: 0.113867 Aug 31 15:58:22.636444 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1080/2249] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:22 2022] GET /compute/v2.1/servers/d1cf04d7-c720-4fb5-9e0e-fc9b058f94fe => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:58:22.652692 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-944bd6f0-9bb9-4a24-ba2e-b6f182eae30d tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:22.654137 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-944bd6f0-9bb9-4a24-ba2e-b6f182eae30d tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: 13cdbabc-03ef-4025-b984-4bba559857ae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:22.674644 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-944bd6f0-9bb9-4a24-ba2e-b6f182eae30d tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:22.675517 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-944bd6f0-9bb9-4a24-ba2e-b6f182eae30d tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:22.676473 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-944bd6f0-9bb9-4a24-ba2e-b6f182eae30d tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:22.681322 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-944bd6f0-9bb9-4a24-ba2e-b6f182eae30d tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:22.685820 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-944bd6f0-9bb9-4a24-ba2e-b6f182eae30d tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:22.689103 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-944bd6f0-9bb9-4a24-ba2e-b6f182eae30d tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:23.144056 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-944bd6f0-9bb9-4a24-ba2e-b6f182eae30d tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922a671cad44ea595e46290a5d52380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1371996a8304dc58ee579daa535bcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:23.174959 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-944bd6f0-9bb9-4a24-ba2e-b6f182eae30d tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae" status: 200 len: 1218 microversion: 2.1 time: 0.515939 Aug 31 15:58:23.177721 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1081/2250] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:22 2022] GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae => generated 1218 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:23.188227 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fba60705-0215-483b-b944-df438ac6188b tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] Calling method '.version_select at 0x7fbb4aaaf040>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:23.213835 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-923ccc02-3a92-44fe-91e4-441cd05a21f5 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:23.221927 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:58:23.233361 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fba60705-0215-483b-b944-df438ac6188b tempest-ServersTestBootFromVolume-2024513306 tempest-ServersTestBootFromVolume-2024513306-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1358575584" status: 202 len: 0 microversion: 2.1 time: 0.054250 Aug 31 15:58:23.234505 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1082/2251] 10.222.0.50 () {58 vars in 1221 bytes} [Wed Aug 31 15:58:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1358575584 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:58:23.239530 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ac848609-0bb8-45a5-a32a-57f7a275b9c3 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:23.244046 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ac848609-0bb8-45a5-a32a-57f7a275b9c3 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: a4977edb-9ae0-48ee-887d-d19a5db58a43] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:23.253617 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-923ccc02-3a92-44fe-91e4-441cd05a21f5 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:23.255997 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-923ccc02-3a92-44fe-91e4-441cd05a21f5 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:23.258382 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-923ccc02-3a92-44fe-91e4-441cd05a21f5 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784" status: 200 len: 1482 microversion: 2.25 time: 1.670895 Aug 31 15:58:23.260417 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1170/2252] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:21 2022] GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784 => generated 1482 bytes in 1673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:23.275512 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e7ca741b-e7c5-430e-ba59-61a407d01be4 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:23.276388 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e7ca741b-e7c5-430e-ba59-61a407d01be4 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:23.284075 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ac848609-0bb8-45a5-a32a-57f7a275b9c3 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:23.284563 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ac848609-0bb8-45a5-a32a-57f7a275b9c3 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:23.288601 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7ca741b-e7c5-430e-ba59-61a407d01be4 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:23.289325 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7ca741b-e7c5-430e-ba59-61a407d01be4 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:23.289952 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7ca741b-e7c5-430e-ba59-61a407d01be4 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:23.291182 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7ca741b-e7c5-430e-ba59-61a407d01be4 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:23.292095 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7ca741b-e7c5-430e-ba59-61a407d01be4 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:23.292865 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7ca741b-e7c5-430e-ba59-61a407d01be4 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:23.297810 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ac848609-0bb8-45a5-a32a-57f7a275b9c3 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:23.298630 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ac848609-0bb8-45a5-a32a-57f7a275b9c3 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:23.299099 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ac848609-0bb8-45a5-a32a-57f7a275b9c3 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:23.299517 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ac848609-0bb8-45a5-a32a-57f7a275b9c3 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:23.615002 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e7ca741b-e7c5-430e-ba59-61a407d01be4 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:23.626867 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e7ca741b-e7c5-430e-ba59-61a407d01be4 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:23.628807 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e7ca741b-e7c5-430e-ba59-61a407d01be4 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:23.647918 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e7ca741b-e7c5-430e-ba59-61a407d01be4 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1537 microversion: 2.91 time: 0.382237 Aug 31 15:58:23.653877 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1171/2253] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:23 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1537 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:23.667200 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fdeb9ad8-97b5-4554-8cc1-ca608bdb1e32 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:23.667700 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fdeb9ad8-97b5-4554-8cc1-ca608bdb1e32 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] [instance: 862e1521-739f-47c0-a7e0-2bd017e5f738] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:23.696689 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fdeb9ad8-97b5-4554-8cc1-ca608bdb1e32 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:23.697183 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fdeb9ad8-97b5-4554-8cc1-ca608bdb1e32 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:23.697612 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fdeb9ad8-97b5-4554-8cc1-ca608bdb1e32 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:23.698562 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fdeb9ad8-97b5-4554-8cc1-ca608bdb1e32 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:23.698790 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fdeb9ad8-97b5-4554-8cc1-ca608bdb1e32 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:23.699209 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fdeb9ad8-97b5-4554-8cc1-ca608bdb1e32 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:23.816056 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fdeb9ad8-97b5-4554-8cc1-ca608bdb1e32 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] [instance: 862e1521-739f-47c0-a7e0-2bd017e5f738] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:58:24.015498 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fdeb9ad8-97b5-4554-8cc1-ca608bdb1e32 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] 10.222.0.50 "DELETE /compute/v2.1/servers/862e1521-739f-47c0-a7e0-2bd017e5f738" status: 204 len: 0 microversion: 2.1 time: 0.359811 Aug 31 15:58:24.016878 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1172/2254] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:58:23 2022] DELETE /compute/v2.1/servers/862e1521-739f-47c0-a7e0-2bd017e5f738 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:58:24.027155 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-43d7a750-80ec-42c4-90aa-d5acade883ef tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:24.028349 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-43d7a750-80ec-42c4-90aa-d5acade883ef tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: f044dca7-71de-4182-b5ec-825299496c10] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:24.036875 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-43d7a750-80ec-42c4-90aa-d5acade883ef tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:24.038359 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-43d7a750-80ec-42c4-90aa-d5acade883ef tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:24.039025 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-43d7a750-80ec-42c4-90aa-d5acade883ef tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:24.040812 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-43d7a750-80ec-42c4-90aa-d5acade883ef tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:24.041515 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-43d7a750-80ec-42c4-90aa-d5acade883ef tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:24.042237 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-43d7a750-80ec-42c4-90aa-d5acade883ef tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:24.398021 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ac848609-0bb8-45a5-a32a-57f7a275b9c3 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:24.418515 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ac848609-0bb8-45a5-a32a-57f7a275b9c3 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/a4977edb-9ae0-48ee-887d-d19a5db58a43" status: 200 len: 1308 microversion: 2.1 time: 1.180635 Aug 31 15:58:24.420214 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1083/2255] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:23 2022] GET /compute/v2.1/servers/a4977edb-9ae0-48ee-887d-d19a5db58a43 => generated 1308 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:24.446311 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-50436bf3-5ce0-47fe-bb09-dc99a26ac042 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:24.447163 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-50436bf3-5ce0-47fe-bb09-dc99a26ac042 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] [instance: 862e1521-739f-47c0-a7e0-2bd017e5f738] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:24.475751 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50436bf3-5ce0-47fe-bb09-dc99a26ac042 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:24.478968 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50436bf3-5ce0-47fe-bb09-dc99a26ac042 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:24.480203 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50436bf3-5ce0-47fe-bb09-dc99a26ac042 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:24.486129 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50436bf3-5ce0-47fe-bb09-dc99a26ac042 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:24.487437 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50436bf3-5ce0-47fe-bb09-dc99a26ac042 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:24.491532 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50436bf3-5ce0-47fe-bb09-dc99a26ac042 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:24.599139 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:58:25.066397 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-43d7a750-80ec-42c4-90aa-d5acade883ef tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:25.085412 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-43d7a750-80ec-42c4-90aa-d5acade883ef tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10" status: 200 len: 1522 microversion: 2.1 time: 1.066684 Aug 31 15:58:25.086531 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1173/2256] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:24 2022] GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10 => generated 1522 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:25.093018 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-65c85e2c-b795-4c11-8164-7ad9a6a4cf41 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:25.094034 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-65c85e2c-b795-4c11-8164-7ad9a6a4cf41 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: 13cdbabc-03ef-4025-b984-4bba559857ae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:25.102744 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-65c85e2c-b795-4c11-8164-7ad9a6a4cf41 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:25.103718 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-65c85e2c-b795-4c11-8164-7ad9a6a4cf41 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:25.104367 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-65c85e2c-b795-4c11-8164-7ad9a6a4cf41 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:25.106068 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-65c85e2c-b795-4c11-8164-7ad9a6a4cf41 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:25.106919 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-65c85e2c-b795-4c11-8164-7ad9a6a4cf41 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:25.107754 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-65c85e2c-b795-4c11-8164-7ad9a6a4cf41 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:25.369132 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:58:25.429860 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=6 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:58:25.499721 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-65c85e2c-b795-4c11-8164-7ad9a6a4cf41 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922a671cad44ea595e46290a5d52380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1371996a8304dc58ee579daa535bcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:25.510239 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-65c85e2c-b795-4c11-8164-7ad9a6a4cf41 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae" status: 200 len: 1272 microversion: 2.1 time: 0.422237 Aug 31 15:58:25.526964 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1174/2257] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:25 2022] GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae => generated 1272 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:25.547472 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fef894a2-de20-44ff-8cd2-cbe1ab476d84 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:25.547927 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fef894a2-de20-44ff-8cd2-cbe1ab476d84 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 548e0225-fa26-46ba-9c12-7b52feee1784] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:25.592135 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fef894a2-de20-44ff-8cd2-cbe1ab476d84 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:25.592967 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fef894a2-de20-44ff-8cd2-cbe1ab476d84 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:25.593679 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fef894a2-de20-44ff-8cd2-cbe1ab476d84 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:25.594615 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fef894a2-de20-44ff-8cd2-cbe1ab476d84 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:25.596969 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fef894a2-de20-44ff-8cd2-cbe1ab476d84 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:25.597569 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fef894a2-de20-44ff-8cd2-cbe1ab476d84 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:25.677340 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-50436bf3-5ce0-47fe-bb09-dc99a26ac042 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba08a4705f4f0a9bc6a01d16a5f607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055586a03b0a4c1989b3ac658ac6347c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:25.708344 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-50436bf3-5ce0-47fe-bb09-dc99a26ac042 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] 10.222.0.50 "GET /compute/v2.1/servers/862e1521-739f-47c0-a7e0-2bd017e5f738" status: 200 len: 1474 microversion: 2.1 time: 1.282959 Aug 31 15:58:25.722460 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1084/2258] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:24 2022] GET /compute/v2.1/servers/862e1521-739f-47c0-a7e0-2bd017e5f738 => generated 1474 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:25.722460 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-534e2ef8-2b9e-4783-8860-56a0c6ea9641 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:25.722460 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-534e2ef8-2b9e-4783-8860-56a0c6ea9641 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:25.754959 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-534e2ef8-2b9e-4783-8860-56a0c6ea9641 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:25.755721 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-534e2ef8-2b9e-4783-8860-56a0c6ea9641 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:25.756198 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-534e2ef8-2b9e-4783-8860-56a0c6ea9641 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:25.757031 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-534e2ef8-2b9e-4783-8860-56a0c6ea9641 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:25.757573 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-534e2ef8-2b9e-4783-8860-56a0c6ea9641 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:25.758030 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-534e2ef8-2b9e-4783-8860-56a0c6ea9641 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:25.834706 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-fef894a2-de20-44ff-8cd2-cbe1ab476d84 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:25.868463 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-fef894a2-de20-44ff-8cd2-cbe1ab476d84 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:25.876660 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-fef894a2-de20-44ff-8cd2-cbe1ab476d84 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:25.885715 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fef894a2-de20-44ff-8cd2-cbe1ab476d84 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784" status: 200 len: 1266 microversion: 2.25 time: 0.349964 Aug 31 15:58:25.890481 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1175/2259] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:25 2022] GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784 => generated 1266 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:25.912659 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-dabe49d1-4b99-4eb5-a4fa-31154dfaf3bb req-baafb10e-8ccb-44a3-9a65-c892718cae87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "548e0225-fa26-46ba-9c12-7b52feee1784", "name": "network-vif-deleted", "tag": "da0ce8b3-d23a-4835-87ba-6b9636776b31"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:25.950933 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-dabe49d1-4b99-4eb5-a4fa-31154dfaf3bb req-baafb10e-8ccb-44a3-9a65-c892718cae87 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:25.953753 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-dabe49d1-4b99-4eb5-a4fa-31154dfaf3bb req-baafb10e-8ccb-44a3-9a65-c892718cae87 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:25.955664 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-dabe49d1-4b99-4eb5-a4fa-31154dfaf3bb req-baafb10e-8ccb-44a3-9a65-c892718cae87 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:26.016264 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-dabe49d1-4b99-4eb5-a4fa-31154dfaf3bb req-baafb10e-8ccb-44a3-9a65-c892718cae87 service nova] Creating event network-vif-deleted:da0ce8b3-d23a-4835-87ba-6b9636776b31 for instance 548e0225-fa26-46ba-9c12-7b52feee1784 on n-h1-833090-16 Aug 31 15:58:26.033167 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-dabe49d1-4b99-4eb5-a4fa-31154dfaf3bb req-baafb10e-8ccb-44a3-9a65-c892718cae87 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137015 Aug 31 15:58:26.034504 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1176/2260] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:26.051321 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-21427832-c33a-48ed-8d24-5c047060c2e9 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:26.052191 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-21427832-c33a-48ed-8d24-5c047060c2e9 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: a4977edb-9ae0-48ee-887d-d19a5db58a43] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:26.082221 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-21427832-c33a-48ed-8d24-5c047060c2e9 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:26.084733 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-21427832-c33a-48ed-8d24-5c047060c2e9 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:26.087034 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-21427832-c33a-48ed-8d24-5c047060c2e9 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:26.087882 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-21427832-c33a-48ed-8d24-5c047060c2e9 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:26.088365 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-21427832-c33a-48ed-8d24-5c047060c2e9 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:26.091852 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-21427832-c33a-48ed-8d24-5c047060c2e9 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:26.341183 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-534e2ef8-2b9e-4783-8860-56a0c6ea9641 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:26.352277 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-534e2ef8-2b9e-4783-8860-56a0c6ea9641 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:26.364518 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-534e2ef8-2b9e-4783-8860-56a0c6ea9641 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:26.387722 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-534e2ef8-2b9e-4783-8860-56a0c6ea9641 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1537 microversion: 2.91 time: 0.676379 Aug 31 15:58:26.388316 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1085/2261] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:25 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1537 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:26.400160 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4d1483ba-d068-47a4-882d-552f4f490511 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:26.417107 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4d1483ba-d068-47a4-882d-552f4f490511 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: f044dca7-71de-4182-b5ec-825299496c10] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:26.440798 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d1483ba-d068-47a4-882d-552f4f490511 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:26.450943 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d1483ba-d068-47a4-882d-552f4f490511 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:26.453889 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d1483ba-d068-47a4-882d-552f4f490511 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:26.457470 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d1483ba-d068-47a4-882d-552f4f490511 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:26.460559 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d1483ba-d068-47a4-882d-552f4f490511 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:26.464322 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d1483ba-d068-47a4-882d-552f4f490511 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:27.406862 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-21427832-c33a-48ed-8d24-5c047060c2e9 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:27.415595 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-21427832-c33a-48ed-8d24-5c047060c2e9 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/a4977edb-9ae0-48ee-887d-d19a5db58a43" status: 200 len: 1308 microversion: 2.1 time: 1.376649 Aug 31 15:58:27.421307 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1177/2262] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:26 2022] GET /compute/v2.1/servers/a4977edb-9ae0-48ee-887d-d19a5db58a43 => generated 1308 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:27.426265 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-593c1cc2-77cb-47a9-bb81-46c09d6beea8 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:27.431729 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-593c1cc2-77cb-47a9-bb81-46c09d6beea8 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: 13cdbabc-03ef-4025-b984-4bba559857ae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:27.443504 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-593c1cc2-77cb-47a9-bb81-46c09d6beea8 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:27.447391 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-593c1cc2-77cb-47a9-bb81-46c09d6beea8 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:27.448389 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-593c1cc2-77cb-47a9-bb81-46c09d6beea8 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:27.449137 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-593c1cc2-77cb-47a9-bb81-46c09d6beea8 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:27.450815 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-593c1cc2-77cb-47a9-bb81-46c09d6beea8 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:27.453597 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-593c1cc2-77cb-47a9-bb81-46c09d6beea8 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:27.491753 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4d1483ba-d068-47a4-882d-552f4f490511 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:27.499923 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4d1483ba-d068-47a4-882d-552f4f490511 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10" status: 200 len: 1522 microversion: 2.1 time: 1.103534 Aug 31 15:58:27.516354 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1086/2263] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:26 2022] GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10 => generated 1522 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:27.521495 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-af0d70d7-f9a5-4703-9047-9ff4d7e007e4 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:27.522364 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-af0d70d7-f9a5-4703-9047-9ff4d7e007e4 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] [instance: 862e1521-739f-47c0-a7e0-2bd017e5f738] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:27.529380 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af0d70d7-f9a5-4703-9047-9ff4d7e007e4 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:27.531636 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af0d70d7-f9a5-4703-9047-9ff4d7e007e4 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:27.533727 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af0d70d7-f9a5-4703-9047-9ff4d7e007e4 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:27.535242 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af0d70d7-f9a5-4703-9047-9ff4d7e007e4 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:27.537254 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af0d70d7-f9a5-4703-9047-9ff4d7e007e4 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:27.538871 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af0d70d7-f9a5-4703-9047-9ff4d7e007e4 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:27.654075 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-593c1cc2-77cb-47a9-bb81-46c09d6beea8 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922a671cad44ea595e46290a5d52380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1371996a8304dc58ee579daa535bcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:27.672017 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-593c1cc2-77cb-47a9-bb81-46c09d6beea8 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae" status: 200 len: 1272 microversion: 2.1 time: 0.249017 Aug 31 15:58:27.672916 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1178/2264] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:27 2022] GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae => generated 1272 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:27.677725 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5c4fb27e-07ff-41e1-b3ff-7348950cd197 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:27.683176 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5c4fb27e-07ff-41e1-b3ff-7348950cd197 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 548e0225-fa26-46ba-9c12-7b52feee1784] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:27.699917 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5c4fb27e-07ff-41e1-b3ff-7348950cd197 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:27.703331 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5c4fb27e-07ff-41e1-b3ff-7348950cd197 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:27.704012 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5c4fb27e-07ff-41e1-b3ff-7348950cd197 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:27.705135 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5c4fb27e-07ff-41e1-b3ff-7348950cd197 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:27.705730 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5c4fb27e-07ff-41e1-b3ff-7348950cd197 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:27.707203 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5c4fb27e-07ff-41e1-b3ff-7348950cd197 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:28.043691 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5c4fb27e-07ff-41e1-b3ff-7348950cd197 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:28.052927 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5c4fb27e-07ff-41e1-b3ff-7348950cd197 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:28.054396 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5c4fb27e-07ff-41e1-b3ff-7348950cd197 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:28.055554 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5c4fb27e-07ff-41e1-b3ff-7348950cd197 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784" status: 200 len: 1266 microversion: 2.25 time: 0.381486 Aug 31 15:58:28.056118 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1179/2265] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:27 2022] GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784 => generated 1266 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:28.089714 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-60ccf8c8-a557-4fc2-8d45-b8e430f2fed3 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:28.090441 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-60ccf8c8-a557-4fc2-8d45-b8e430f2fed3 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:28.104767 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-60ccf8c8-a557-4fc2-8d45-b8e430f2fed3 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:28.105261 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-60ccf8c8-a557-4fc2-8d45-b8e430f2fed3 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:28.108046 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-60ccf8c8-a557-4fc2-8d45-b8e430f2fed3 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:28.108850 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-60ccf8c8-a557-4fc2-8d45-b8e430f2fed3 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:28.109318 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-60ccf8c8-a557-4fc2-8d45-b8e430f2fed3 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:28.111145 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-60ccf8c8-a557-4fc2-8d45-b8e430f2fed3 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:28.314277 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-af0d70d7-f9a5-4703-9047-9ff4d7e007e4 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba08a4705f4f0a9bc6a01d16a5f607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055586a03b0a4c1989b3ac658ac6347c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:28.322660 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-af0d70d7-f9a5-4703-9047-9ff4d7e007e4 tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] 10.222.0.50 "GET /compute/v2.1/servers/862e1521-739f-47c0-a7e0-2bd017e5f738" status: 200 len: 1474 microversion: 2.1 time: 0.804936 Aug 31 15:58:28.328981 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1087/2266] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:27 2022] GET /compute/v2.1/servers/862e1521-739f-47c0-a7e0-2bd017e5f738 => generated 1474 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:28.334327 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-37930db9-5ad1-4c92-9d57-b0c747414aa3 req-60123199-fa74-40d6-a70d-9420a7d4d884 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4977edb-9ae0-48ee-887d-d19a5db58a43", "tag": "98738177-422e-4e04-85eb-a363f7670a8e"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:28.338612 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-60ccf8c8-a557-4fc2-8d45-b8e430f2fed3 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:28.361312 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-60ccf8c8-a557-4fc2-8d45-b8e430f2fed3 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:28.362941 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-37930db9-5ad1-4c92-9d57-b0c747414aa3 req-60123199-fa74-40d6-a70d-9420a7d4d884 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:28.363557 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-37930db9-5ad1-4c92-9d57-b0c747414aa3 req-60123199-fa74-40d6-a70d-9420a7d4d884 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:28.364147 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-37930db9-5ad1-4c92-9d57-b0c747414aa3 req-60123199-fa74-40d6-a70d-9420a7d4d884 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:28.364876 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-60ccf8c8-a557-4fc2-8d45-b8e430f2fed3 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:28.381524 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-60ccf8c8-a557-4fc2-8d45-b8e430f2fed3 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1537 microversion: 2.91 time: 0.299125 Aug 31 15:58:28.382823 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1180/2267] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:28 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1537 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:28.394019 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-37930db9-5ad1-4c92-9d57-b0c747414aa3 req-60123199-fa74-40d6-a70d-9420a7d4d884 service nova] Creating event network-changed:98738177-422e-4e04-85eb-a363f7670a8e for instance a4977edb-9ae0-48ee-887d-d19a5db58a43 on n-h2-833090-16 Aug 31 15:58:28.403894 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-37930db9-5ad1-4c92-9d57-b0c747414aa3 req-60123199-fa74-40d6-a70d-9420a7d4d884 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073465 Aug 31 15:58:28.409181 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1088/2268] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:58:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:28.438052 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b2430c66-9a41-4809-a32a-38ee924e1d0e tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:28.438762 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b2430c66-9a41-4809-a32a-38ee924e1d0e tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: a4977edb-9ae0-48ee-887d-d19a5db58a43] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:28.458554 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b2430c66-9a41-4809-a32a-38ee924e1d0e tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:28.459260 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b2430c66-9a41-4809-a32a-38ee924e1d0e tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:28.459919 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b2430c66-9a41-4809-a32a-38ee924e1d0e tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:28.460721 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b2430c66-9a41-4809-a32a-38ee924e1d0e tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:28.461225 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b2430c66-9a41-4809-a32a-38ee924e1d0e tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:28.461656 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b2430c66-9a41-4809-a32a-38ee924e1d0e tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:28.524211 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c3543960-24cf-42c9-92a1-46c659074634 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:28.524896 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c3543960-24cf-42c9-92a1-46c659074634 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: f044dca7-71de-4182-b5ec-825299496c10] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:28.536568 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3543960-24cf-42c9-92a1-46c659074634 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:28.537054 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3543960-24cf-42c9-92a1-46c659074634 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:28.537659 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3543960-24cf-42c9-92a1-46c659074634 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:28.538413 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3543960-24cf-42c9-92a1-46c659074634 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:28.538860 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3543960-24cf-42c9-92a1-46c659074634 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:28.539274 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3543960-24cf-42c9-92a1-46c659074634 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:28.941098 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b2430c66-9a41-4809-a32a-38ee924e1d0e tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:28.951062 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c3543960-24cf-42c9-92a1-46c659074634 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:28.957673 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b2430c66-9a41-4809-a32a-38ee924e1d0e tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/a4977edb-9ae0-48ee-887d-d19a5db58a43" status: 200 len: 1308 microversion: 2.1 time: 0.525065 Aug 31 15:58:28.958298 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1181/2269] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:28 2022] GET /compute/v2.1/servers/a4977edb-9ae0-48ee-887d-d19a5db58a43 => generated 1308 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:28.973975 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c3543960-24cf-42c9-92a1-46c659074634 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10" status: 200 len: 1522 microversion: 2.1 time: 0.453990 Aug 31 15:58:28.976346 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1089/2270] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:28 2022] GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10 => generated 1522 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:28.977509 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9afa18db-49e7-4bad-a464-993f6d1fbf3e tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:28.978355 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9afa18db-49e7-4bad-a464-993f6d1fbf3e tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: 13cdbabc-03ef-4025-b984-4bba559857ae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:28.986825 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9afa18db-49e7-4bad-a464-993f6d1fbf3e tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:28.989460 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9afa18db-49e7-4bad-a464-993f6d1fbf3e tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:28.990136 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9afa18db-49e7-4bad-a464-993f6d1fbf3e tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:28.991186 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9afa18db-49e7-4bad-a464-993f6d1fbf3e tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:28.994465 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9afa18db-49e7-4bad-a464-993f6d1fbf3e tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:28.995090 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9afa18db-49e7-4bad-a464-993f6d1fbf3e tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:29.083620 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e3b9954a-77b0-4643-95af-2f8465b7a751 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:29.084536 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e3b9954a-77b0-4643-95af-2f8465b7a751 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 548e0225-fa26-46ba-9c12-7b52feee1784] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:29.108029 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3b9954a-77b0-4643-95af-2f8465b7a751 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:29.114888 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3b9954a-77b0-4643-95af-2f8465b7a751 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:29.115608 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3b9954a-77b0-4643-95af-2f8465b7a751 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:29.116545 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3b9954a-77b0-4643-95af-2f8465b7a751 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:29.117135 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3b9954a-77b0-4643-95af-2f8465b7a751 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:29.117903 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3b9954a-77b0-4643-95af-2f8465b7a751 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:29.328991 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e3b9954a-77b0-4643-95af-2f8465b7a751 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:29.347676 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e3b9954a-77b0-4643-95af-2f8465b7a751 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:29.353340 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e3b9954a-77b0-4643-95af-2f8465b7a751 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:29.354821 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e3b9954a-77b0-4643-95af-2f8465b7a751 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784" status: 200 len: 1266 microversion: 2.25 time: 0.278841 Aug 31 15:58:29.380647 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1090/2271] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:29 2022] GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784 => generated 1266 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:29.392037 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fbf0d390-35c1-4b31-918a-8279b901ac8a tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:29.394868 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fbf0d390-35c1-4b31-918a-8279b901ac8a tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] [instance: 862e1521-739f-47c0-a7e0-2bd017e5f738] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:29.421426 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbf0d390-35c1-4b31-918a-8279b901ac8a tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:29.422140 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbf0d390-35c1-4b31-918a-8279b901ac8a tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:29.426718 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbf0d390-35c1-4b31-918a-8279b901ac8a tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:29.428924 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbf0d390-35c1-4b31-918a-8279b901ac8a tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:29.429558 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbf0d390-35c1-4b31-918a-8279b901ac8a tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:29.430242 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbf0d390-35c1-4b31-918a-8279b901ac8a tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:29.545772 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbf0d390-35c1-4b31-918a-8279b901ac8a tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:29.553197 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbf0d390-35c1-4b31-918a-8279b901ac8a tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:29.559667 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbf0d390-35c1-4b31-918a-8279b901ac8a tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:29.560752 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-fbf0d390-35c1-4b31-918a-8279b901ac8a tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lazy-loading 'fault' on Instance uuid 862e1521-739f-47c0-a7e0-2bd017e5f738 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:58:29.572282 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9afa18db-49e7-4bad-a464-993f6d1fbf3e tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922a671cad44ea595e46290a5d52380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1371996a8304dc58ee579daa535bcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:29.593573 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9afa18db-49e7-4bad-a464-993f6d1fbf3e tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae" status: 200 len: 1314 microversion: 2.1 time: 0.621058 Aug 31 15:58:29.596020 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1182/2272] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:28 2022] GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae => generated 1314 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:29.606511 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-47692336-acee-4e6d-9f8a-71a5dcbdd581 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:29.607902 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-47692336-acee-4e6d-9f8a-71a5dcbdd581 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:29.613221 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:58:29.641014 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-47692336-acee-4e6d-9f8a-71a5dcbdd581 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:29.641964 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-47692336-acee-4e6d-9f8a-71a5dcbdd581 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:29.642800 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-47692336-acee-4e6d-9f8a-71a5dcbdd581 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:29.644093 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-47692336-acee-4e6d-9f8a-71a5dcbdd581 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:29.644888 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-47692336-acee-4e6d-9f8a-71a5dcbdd581 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:29.645571 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-47692336-acee-4e6d-9f8a-71a5dcbdd581 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:29.713848 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fbf0d390-35c1-4b31-918a-8279b901ac8a tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0ba08a4705f4f0a9bc6a01d16a5f607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '055586a03b0a4c1989b3ac658ac6347c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:29.738922 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fbf0d390-35c1-4b31-918a-8279b901ac8a tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] 10.222.0.50 "GET /compute/v2.1/servers/862e1521-739f-47c0-a7e0-2bd017e5f738" status: 200 len: 1308 microversion: 2.1 time: 0.356236 Aug 31 15:58:29.745263 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1091/2273] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:29 2022] GET /compute/v2.1/servers/862e1521-739f-47c0-a7e0-2bd017e5f738 => generated 1308 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:29.980796 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-81f06935-c6d6-4396-a0b5-80c26393d5f5 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:29.981689 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-81f06935-c6d6-4396-a0b5-80c26393d5f5 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: a4977edb-9ae0-48ee-887d-d19a5db58a43] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:29.982935 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-47692336-acee-4e6d-9f8a-71a5dcbdd581 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:29.996883 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-81f06935-c6d6-4396-a0b5-80c26393d5f5 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:29.997689 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-81f06935-c6d6-4396-a0b5-80c26393d5f5 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:29.998327 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-81f06935-c6d6-4396-a0b5-80c26393d5f5 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:29.999750 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-81f06935-c6d6-4396-a0b5-80c26393d5f5 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:30.000061 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-47692336-acee-4e6d-9f8a-71a5dcbdd581 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:30.000497 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-81f06935-c6d6-4396-a0b5-80c26393d5f5 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:30.000929 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-81f06935-c6d6-4396-a0b5-80c26393d5f5 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:30.005055 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-47692336-acee-4e6d-9f8a-71a5dcbdd581 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:30.018341 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-47692336-acee-4e6d-9f8a-71a5dcbdd581 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1537 microversion: 2.91 time: 0.417996 Aug 31 15:58:30.023431 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1183/2274] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:29 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1537 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:30.039560 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e4ba9885-8153-4d5f-9d51-dc69c90eaf45 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:30.040887 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e4ba9885-8153-4d5f-9d51-dc69c90eaf45 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: f044dca7-71de-4182-b5ec-825299496c10] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:30.068914 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4ba9885-8153-4d5f-9d51-dc69c90eaf45 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:30.069752 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4ba9885-8153-4d5f-9d51-dc69c90eaf45 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:30.070658 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4ba9885-8153-4d5f-9d51-dc69c90eaf45 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:30.071670 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4ba9885-8153-4d5f-9d51-dc69c90eaf45 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:30.072975 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4ba9885-8153-4d5f-9d51-dc69c90eaf45 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:30.075697 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4ba9885-8153-4d5f-9d51-dc69c90eaf45 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:30.762012 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e4ba9885-8153-4d5f-9d51-dc69c90eaf45 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:30.780561 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e4ba9885-8153-4d5f-9d51-dc69c90eaf45 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10" status: 200 len: 1504 microversion: 2.1 time: 0.754453 Aug 31 15:58:30.784029 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1184/2275] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:30 2022] GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10 => generated 1504 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:30.798649 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-033a8d6f-9aac-4646-a8d7-9f0cbadbdadb tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:30.800018 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-033a8d6f-9aac-4646-a8d7-9f0cbadbdadb tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 548e0225-fa26-46ba-9c12-7b52feee1784] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:30.812095 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-81f06935-c6d6-4396-a0b5-80c26393d5f5 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:30.819849 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-033a8d6f-9aac-4646-a8d7-9f0cbadbdadb tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:30.825335 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-033a8d6f-9aac-4646-a8d7-9f0cbadbdadb tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:30.826596 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-033a8d6f-9aac-4646-a8d7-9f0cbadbdadb tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:30.827538 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-81f06935-c6d6-4396-a0b5-80c26393d5f5 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/a4977edb-9ae0-48ee-887d-d19a5db58a43" status: 200 len: 1308 microversion: 2.1 time: 0.851098 Aug 31 15:58:30.829958 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-033a8d6f-9aac-4646-a8d7-9f0cbadbdadb tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:30.829958 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-033a8d6f-9aac-4646-a8d7-9f0cbadbdadb tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:30.830469 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-033a8d6f-9aac-4646-a8d7-9f0cbadbdadb tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:30.834489 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1092/2276] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:29 2022] GET /compute/v2.1/servers/a4977edb-9ae0-48ee-887d-d19a5db58a43 => generated 1308 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:30.841229 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-e4d239c4-c7c0-43bf-bbeb-6381b6b917fb req-0689d654-0f42-417a-b7e8-61a4ba479f04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "862e1521-739f-47c0-a7e0-2bd017e5f738", "name": "network-vif-deleted", "tag": "02873cd3-826b-444d-b633-baeaea646877"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:30.860024 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e4d239c4-c7c0-43bf-bbeb-6381b6b917fb req-0689d654-0f42-417a-b7e8-61a4ba479f04 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:30.860499 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e4d239c4-c7c0-43bf-bbeb-6381b6b917fb req-0689d654-0f42-417a-b7e8-61a4ba479f04 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:30.860925 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e4d239c4-c7c0-43bf-bbeb-6381b6b917fb req-0689d654-0f42-417a-b7e8-61a4ba479f04 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:30.915727 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-e4d239c4-c7c0-43bf-bbeb-6381b6b917fb req-0689d654-0f42-417a-b7e8-61a4ba479f04 service nova] Creating event network-vif-deleted:02873cd3-826b-444d-b633-baeaea646877 for instance 862e1521-739f-47c0-a7e0-2bd017e5f738 on n-h1-833090-16 Aug 31 15:58:30.929828 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-e4d239c4-c7c0-43bf-bbeb-6381b6b917fb req-0689d654-0f42-417a-b7e8-61a4ba479f04 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093997 Aug 31 15:58:30.930637 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1093/2277] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:30.947935 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-510e0328-4cff-4985-a85e-37ded142caca tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:30.953651 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-510e0328-4cff-4985-a85e-37ded142caca tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: 13cdbabc-03ef-4025-b984-4bba559857ae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:30.965834 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-510e0328-4cff-4985-a85e-37ded142caca tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:30.974156 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-510e0328-4cff-4985-a85e-37ded142caca tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:30.983323 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-510e0328-4cff-4985-a85e-37ded142caca tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:30.993786 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-510e0328-4cff-4985-a85e-37ded142caca tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:30.994317 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-510e0328-4cff-4985-a85e-37ded142caca tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:30.994762 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-510e0328-4cff-4985-a85e-37ded142caca tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:31.008381 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-033a8d6f-9aac-4646-a8d7-9f0cbadbdadb tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:31.019569 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-033a8d6f-9aac-4646-a8d7-9f0cbadbdadb tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:31.025230 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-033a8d6f-9aac-4646-a8d7-9f0cbadbdadb tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:31.030251 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-033a8d6f-9aac-4646-a8d7-9f0cbadbdadb tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784" status: 200 len: 1266 microversion: 2.25 time: 0.244703 Aug 31 15:58:31.030932 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1185/2278] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:30 2022] GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784 => generated 1266 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:31.045145 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1bf63c36-5b95-44e7-8c97-fe8603d391ca tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:31.045145 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1bf63c36-5b95-44e7-8c97-fe8603d391ca tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] [instance: 862e1521-739f-47c0-a7e0-2bd017e5f738] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:31.066000 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1bf63c36-5b95-44e7-8c97-fe8603d391ca tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:31.066334 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1bf63c36-5b95-44e7-8c97-fe8603d391ca tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:31.066769 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1bf63c36-5b95-44e7-8c97-fe8603d391ca tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:31.067673 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1bf63c36-5b95-44e7-8c97-fe8603d391ca tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:31.068126 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1bf63c36-5b95-44e7-8c97-fe8603d391ca tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:31.068541 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1bf63c36-5b95-44e7-8c97-fe8603d391ca tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:31.097224 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-1bf63c36-5b95-44e7-8c97-fe8603d391ca tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] HTTP exception thrown: Instance 862e1521-739f-47c0-a7e0-2bd017e5f738 could not be found. Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1bf63c36-5b95-44e7-8c97-fe8603d391ca tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Request method failure captured: Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/862e1521-739f-47c0-a7e0-2bd017e5f738 HTTP/1.1 Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4TSjRmyxkxB3EbpU91At_wUFAoSWk5gWWhvVXVgTOKDHQ6eOoT0_cfEJZBCRceiGO3lHiWnKlZb4uECbOS-R4cOk_V-lOr6ePYTTG-Q5uvtcgt6fkLFMGi0-yYWauJflwZLvBy6ldbwn-J4MuJQ3b4e9cH-X2zj-glWZuZzTtsBfZ4 Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 055586a03b0a4c1989b3ac658ac6347c Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-LiveMigrationNegativeTest-335890209 Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/055586a03b0a4c1989b3ac658ac6347c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/055586a03b0a4c1989b3ac658ac6347c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/055586a03b0a4c1989b3ac658ac6347c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_055586a03b0a4c1989b3ac658ac6347c", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-LiveMigrationNegativeTest-335890209 Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 055586a03b0a4c1989b3ac658ac6347c Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-335890209 Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-LiveMigrationNegativeTest-335890209-project Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: b0ba08a4705f4f0a9bc6a01d16a5f607 Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-LiveMigrationNegativeTest-335890209-project Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 862e1521-739f-47c0-a7e0-2bd017e5f738 could not be found. Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '862e1521-739f-47c0-a7e0-2bd017e5f738'} Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 862e1521-739f-47c0-a7e0-2bd017e5f738 could not be found. Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 862e1521-739f-47c0-a7e0-2bd017e5f738 could not be found. Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:58:31.099217 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:58:31.103882 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:58:31.103882 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:58:31.103882 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:58:31.103882 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:58:31.103882 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:58:31.103882 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 862e1521-739f-47c0-a7e0-2bd017e5f738 could not be found. Aug 31 15:58:31.103882 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:58:31.105788 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1bf63c36-5b95-44e7-8c97-fe8603d391ca tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] Returning 404 to user: Instance 862e1521-739f-47c0-a7e0-2bd017e5f738 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:58:31.107164 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1bf63c36-5b95-44e7-8c97-fe8603d391ca tempest-LiveMigrationNegativeTest-335890209 tempest-LiveMigrationNegativeTest-335890209-project] 10.222.0.50 "GET /compute/v2.1/servers/862e1521-739f-47c0-a7e0-2bd017e5f738" status: 404 len: 111 microversion: 2.1 time: 0.074992 Aug 31 15:58:31.111427 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1186/2279] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:31 2022] GET /compute/v2.1/servers/862e1521-739f-47c0-a7e0-2bd017e5f738 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:58:31.119226 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-69dcdce5-39c2-4ad2-86aa-a755d3c0d222 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:31.120249 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-69dcdce5-39c2-4ad2-86aa-a755d3c0d222 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:31.133295 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69dcdce5-39c2-4ad2-86aa-a755d3c0d222 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:31.133786 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69dcdce5-39c2-4ad2-86aa-a755d3c0d222 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:31.134476 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69dcdce5-39c2-4ad2-86aa-a755d3c0d222 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:31.134968 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69dcdce5-39c2-4ad2-86aa-a755d3c0d222 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:31.135415 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69dcdce5-39c2-4ad2-86aa-a755d3c0d222 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:31.135834 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69dcdce5-39c2-4ad2-86aa-a755d3c0d222 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:31.146021 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:58:31.204543 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:58:31.253030 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-69dcdce5-39c2-4ad2-86aa-a755d3c0d222 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:31.258192 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-510e0328-4cff-4985-a85e-37ded142caca tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922a671cad44ea595e46290a5d52380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1371996a8304dc58ee579daa535bcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:31.264235 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-69dcdce5-39c2-4ad2-86aa-a755d3c0d222 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:31.266031 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-69dcdce5-39c2-4ad2-86aa-a755d3c0d222 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:31.267471 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-510e0328-4cff-4985-a85e-37ded142caca tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae" status: 200 len: 1314 microversion: 2.1 time: 0.327072 Aug 31 15:58:31.268064 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1094/2280] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:30 2022] GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:31.287053 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-69dcdce5-39c2-4ad2-86aa-a755d3c0d222 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1558 microversion: 2.91 time: 0.173680 Aug 31 15:58:31.288311 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1187/2281] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:31 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1558 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:31.332702 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-2be7f2fd-974a-4f9f-ad38-732dbe3db557 req-722d7585-2964-49ef-b254-18679b2af055 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13cdbabc-03ef-4025-b984-4bba559857ae", "tag": "d1aa64dc-dced-4b64-b066-475595f92abb"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:31.338659 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:58:31.346949 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2be7f2fd-974a-4f9f-ad38-732dbe3db557 req-722d7585-2964-49ef-b254-18679b2af055 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:31.347704 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2be7f2fd-974a-4f9f-ad38-732dbe3db557 req-722d7585-2964-49ef-b254-18679b2af055 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:31.348325 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2be7f2fd-974a-4f9f-ad38-732dbe3db557 req-722d7585-2964-49ef-b254-18679b2af055 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:31.380545 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-2be7f2fd-974a-4f9f-ad38-732dbe3db557 req-722d7585-2964-49ef-b254-18679b2af055 service nova] Creating event network-changed:d1aa64dc-dced-4b64-b066-475595f92abb for instance 13cdbabc-03ef-4025-b984-4bba559857ae on n-h2-833090-16 Aug 31 15:58:31.389111 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-2be7f2fd-974a-4f9f-ad38-732dbe3db557 req-722d7585-2964-49ef-b254-18679b2af055 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060135 Aug 31 15:58:31.390363 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1095/2282] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:58:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:31.809500 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-71ce7ef3-f434-4852-97df-aabaa2c4b778 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:31.810751 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-71ce7ef3-f434-4852-97df-aabaa2c4b778 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: f044dca7-71de-4182-b5ec-825299496c10] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:31.826771 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-71ce7ef3-f434-4852-97df-aabaa2c4b778 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:31.827702 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-71ce7ef3-f434-4852-97df-aabaa2c4b778 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:31.828377 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-71ce7ef3-f434-4852-97df-aabaa2c4b778 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:31.829301 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-71ce7ef3-f434-4852-97df-aabaa2c4b778 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:31.829913 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-71ce7ef3-f434-4852-97df-aabaa2c4b778 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:31.830597 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-71ce7ef3-f434-4852-97df-aabaa2c4b778 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:31.850146 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4ef27750-ed2d-48cf-ac84-4609fe00ef7f tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:31.851436 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4ef27750-ed2d-48cf-ac84-4609fe00ef7f tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: a4977edb-9ae0-48ee-887d-d19a5db58a43] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:31.865382 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ef27750-ed2d-48cf-ac84-4609fe00ef7f tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:31.875153 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ef27750-ed2d-48cf-ac84-4609fe00ef7f tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:31.877437 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ef27750-ed2d-48cf-ac84-4609fe00ef7f tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:31.878930 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ef27750-ed2d-48cf-ac84-4609fe00ef7f tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:31.879573 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ef27750-ed2d-48cf-ac84-4609fe00ef7f tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:31.880179 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ef27750-ed2d-48cf-ac84-4609fe00ef7f tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:32.302330 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4ef27750-ed2d-48cf-ac84-4609fe00ef7f tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:32.318538 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4ef27750-ed2d-48cf-ac84-4609fe00ef7f tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/a4977edb-9ae0-48ee-887d-d19a5db58a43" status: 200 len: 1308 microversion: 2.1 time: 0.473353 Aug 31 15:58:32.319218 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1096/2283] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:31 2022] GET /compute/v2.1/servers/a4977edb-9ae0-48ee-887d-d19a5db58a43 => generated 1308 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:32.326394 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-71ce7ef3-f434-4852-97df-aabaa2c4b778 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:32.333658 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-e136c0fb-5979-4a9f-94c3-73ebe86c8148 req-39b9e748-2273-40fc-92c6-dbe779c627c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f044dca7-71de-4182-b5ec-825299496c10", "name": "network-vif-unplugged", "status": "completed", "tag": "f2758b61-4cf5-4435-9306-d8d8ffd9e363"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:32.341091 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-71ce7ef3-f434-4852-97df-aabaa2c4b778 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10" status: 200 len: 1504 microversion: 2.1 time: 0.535472 Aug 31 15:58:32.341702 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1188/2284] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:31 2022] GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10 => generated 1504 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:32.355781 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f1dfcd0f-fea9-4d8a-b043-5b6459316f21 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:32.356923 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f1dfcd0f-fea9-4d8a-b043-5b6459316f21 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 548e0225-fa26-46ba-9c12-7b52feee1784] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:32.362629 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e136c0fb-5979-4a9f-94c3-73ebe86c8148 req-39b9e748-2273-40fc-92c6-dbe779c627c4 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:32.363734 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e136c0fb-5979-4a9f-94c3-73ebe86c8148 req-39b9e748-2273-40fc-92c6-dbe779c627c4 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:32.366277 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e136c0fb-5979-4a9f-94c3-73ebe86c8148 req-39b9e748-2273-40fc-92c6-dbe779c627c4 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:32.368027 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f1dfcd0f-fea9-4d8a-b043-5b6459316f21 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:32.371773 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f1dfcd0f-fea9-4d8a-b043-5b6459316f21 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:32.372434 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f1dfcd0f-fea9-4d8a-b043-5b6459316f21 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:32.373384 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f1dfcd0f-fea9-4d8a-b043-5b6459316f21 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:32.377028 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f1dfcd0f-fea9-4d8a-b043-5b6459316f21 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:32.378013 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f1dfcd0f-fea9-4d8a-b043-5b6459316f21 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:32.412152 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-e136c0fb-5979-4a9f-94c3-73ebe86c8148 req-39b9e748-2273-40fc-92c6-dbe779c627c4 service nova] Creating event network-vif-unplugged:f2758b61-4cf5-4435-9306-d8d8ffd9e363 for instance f044dca7-71de-4182-b5ec-825299496c10 on n-h1-833090-16 Aug 31 15:58:32.432043 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-e136c0fb-5979-4a9f-94c3-73ebe86c8148 req-39b9e748-2273-40fc-92c6-dbe779c627c4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.111297 Aug 31 15:58:32.433059 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1097/2285] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:32.468585 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-83142405-b513-4b6c-9914-fce0cecbcd2f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:32.476138 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-83142405-b513-4b6c-9914-fce0cecbcd2f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: 13cdbabc-03ef-4025-b984-4bba559857ae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:32.502075 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83142405-b513-4b6c-9914-fce0cecbcd2f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:32.506294 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83142405-b513-4b6c-9914-fce0cecbcd2f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:32.506966 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83142405-b513-4b6c-9914-fce0cecbcd2f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:32.508022 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83142405-b513-4b6c-9914-fce0cecbcd2f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:32.511968 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83142405-b513-4b6c-9914-fce0cecbcd2f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:32.513067 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83142405-b513-4b6c-9914-fce0cecbcd2f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:32.684941 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f1dfcd0f-fea9-4d8a-b043-5b6459316f21 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:32.721025 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f1dfcd0f-fea9-4d8a-b043-5b6459316f21 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:32.753468 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f1dfcd0f-fea9-4d8a-b043-5b6459316f21 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:32.759023 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f1dfcd0f-fea9-4d8a-b043-5b6459316f21 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784" status: 200 len: 1266 microversion: 2.25 time: 0.415972 Aug 31 15:58:32.766552 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1189/2286] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:32 2022] GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784 => generated 1266 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:32.785620 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b5eeac6f-1bee-4784-b972-58083d6717ac tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:32.797815 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b5eeac6f-1bee-4784-b972-58083d6717ac tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:32.833030 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b5eeac6f-1bee-4784-b972-58083d6717ac tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:32.834188 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b5eeac6f-1bee-4784-b972-58083d6717ac tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:32.834188 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b5eeac6f-1bee-4784-b972-58083d6717ac tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:32.838997 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b5eeac6f-1bee-4784-b972-58083d6717ac tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:32.843797 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b5eeac6f-1bee-4784-b972-58083d6717ac tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:32.844517 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b5eeac6f-1bee-4784-b972-58083d6717ac tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:33.037193 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-83142405-b513-4b6c-9914-fce0cecbcd2f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922a671cad44ea595e46290a5d52380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1371996a8304dc58ee579daa535bcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:33.055922 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-83142405-b513-4b6c-9914-fce0cecbcd2f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae" status: 200 len: 1314 microversion: 2.1 time: 0.620508 Aug 31 15:58:33.078318 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1098/2287] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:32 2022] GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae => generated 1314 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:33.131890 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b5eeac6f-1bee-4784-b972-58083d6717ac tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:33.151838 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b5eeac6f-1bee-4784-b972-58083d6717ac tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:33.157164 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b5eeac6f-1bee-4784-b972-58083d6717ac tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:33.175280 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b5eeac6f-1bee-4784-b972-58083d6717ac tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1553 microversion: 2.91 time: 0.402310 Aug 31 15:58:33.177358 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1190/2288] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:32 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1553 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:33.341628 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f8883a3b-f624-4dbd-9c9a-0421edaef6b8 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:33.342360 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f8883a3b-f624-4dbd-9c9a-0421edaef6b8 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: a4977edb-9ae0-48ee-887d-d19a5db58a43] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:33.362531 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8883a3b-f624-4dbd-9c9a-0421edaef6b8 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:33.363027 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8883a3b-f624-4dbd-9c9a-0421edaef6b8 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:33.363502 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8883a3b-f624-4dbd-9c9a-0421edaef6b8 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:33.364285 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8883a3b-f624-4dbd-9c9a-0421edaef6b8 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:33.364778 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8883a3b-f624-4dbd-9c9a-0421edaef6b8 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:33.365295 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8883a3b-f624-4dbd-9c9a-0421edaef6b8 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:33.367888 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fdbc67d2-7263-4415-a400-e0d3ee37c1ce tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:33.368512 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fdbc67d2-7263-4415-a400-e0d3ee37c1ce tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: f044dca7-71de-4182-b5ec-825299496c10] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:33.391079 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fdbc67d2-7263-4415-a400-e0d3ee37c1ce tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:33.391669 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fdbc67d2-7263-4415-a400-e0d3ee37c1ce tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:33.394023 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fdbc67d2-7263-4415-a400-e0d3ee37c1ce tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:33.395449 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fdbc67d2-7263-4415-a400-e0d3ee37c1ce tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:33.401992 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fdbc67d2-7263-4415-a400-e0d3ee37c1ce tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:33.405241 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fdbc67d2-7263-4415-a400-e0d3ee37c1ce tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:33.885254 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f8883a3b-f624-4dbd-9c9a-0421edaef6b8 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:33.901817 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f8883a3b-f624-4dbd-9c9a-0421edaef6b8 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/a4977edb-9ae0-48ee-887d-d19a5db58a43" status: 200 len: 1308 microversion: 2.1 time: 0.564086 Aug 31 15:58:33.917445 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1099/2289] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:33 2022] GET /compute/v2.1/servers/a4977edb-9ae0-48ee-887d-d19a5db58a43 => generated 1308 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:33.923323 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0a546c1f-1c08-497d-bda2-40cdb4eef5d0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:33.923975 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0a546c1f-1c08-497d-bda2-40cdb4eef5d0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 548e0225-fa26-46ba-9c12-7b52feee1784] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:33.932210 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a546c1f-1c08-497d-bda2-40cdb4eef5d0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:33.932700 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a546c1f-1c08-497d-bda2-40cdb4eef5d0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:33.937834 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a546c1f-1c08-497d-bda2-40cdb4eef5d0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:33.938683 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a546c1f-1c08-497d-bda2-40cdb4eef5d0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:33.939170 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a546c1f-1c08-497d-bda2-40cdb4eef5d0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:33.939605 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a546c1f-1c08-497d-bda2-40cdb4eef5d0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:33.957312 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-fdbc67d2-7263-4415-a400-e0d3ee37c1ce tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:33.971947 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fdbc67d2-7263-4415-a400-e0d3ee37c1ce tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10" status: 200 len: 1507 microversion: 2.1 time: 0.610068 Aug 31 15:58:33.982176 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1191/2290] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:33 2022] GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10 => generated 1507 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:58:33.982366 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-0a546c1f-1c08-497d-bda2-40cdb4eef5d0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] HTTP exception thrown: Instance 548e0225-fa26-46ba-9c12-7b52feee1784 could not be found. Aug 31 15:58:33.982366 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0a546c1f-1c08-497d-bda2-40cdb4eef5d0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Request method failure captured: Aug 31 15:58:33.982366 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784 HTTP/1.1 Aug 31 15:58:33.982366 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:58:33.982366 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:58:33.982366 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:58:33.982366 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:58:33.982366 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:58:33.982366 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:58:33.982366 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:58:33.982366 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:58:33.982366 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4NHqkgwYGUym-Rz8_ahU9_nePHkL-bhC3R98SNlnSzexlfj7kN8EdCPwINUFbsF5Jo9rHxGnnKW4mmnCLqko9cX9nysCtsANAulE1Ljdk3EUSlUSaH_x03Hi5zjOnc1qB5IhtdxpQiIoa_bQFbmxCt0BdSE44Ku0YpN9lafIO9AgqU Aug 31 15:58:33.982366 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:58:33.982366 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:58:33.982366 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:58:33.982366 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:58:33.982366 n-d-833090-16 devstack@n-api.service[128863]: X-Openstack-Nova-Api-Version: 2.25 Aug 31 15:58:33.982366 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:58:33.982366 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:58:33.982366 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 86aafc129b8640d381f9bae1767fbc6c Aug 31 15:58:33.982366 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-181009754 Aug 31 15:58:33.982366 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:58:33.982366 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:58:33.982366 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/86aafc129b8640d381f9bae1767fbc6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/86aafc129b8640d381f9bae1767fbc6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/86aafc129b8640d381f9bae1767fbc6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_86aafc129b8640d381f9bae1767fbc6c", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:58:33.982366 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-181009754 Aug 31 15:58:33.982366 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 86aafc129b8640d381f9bae1767fbc6c Aug 31 15:58:33.982366 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-181009754 Aug 31 15:58:33.982366 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-LiveAutoBlockMigrationV225Test-181009754-project Aug 31 15:58:33.982366 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:58:33.982366 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:58:33.982366 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 072bc5784d754815a511f6c3f4437f7c Aug 31 15:58:33.982366 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-181009754-project Aug 31 15:58:33.982366 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 15:58:33.982366 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 548e0225-fa26-46ba-9c12-7b52feee1784 could not be found. Aug 31 15:58:33.982366 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '548e0225-fa26-46ba-9c12-7b52feee1784'} Aug 31 15:58:33.982366 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:58:33.982366 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:58:33.982366 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:58:33.982366 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:58:33.982366 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:58:33.982366 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:58:33.982366 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:58:33.982366 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:58:33.982366 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:58:33.982366 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:58:33.982366 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 548e0225-fa26-46ba-9c12-7b52feee1784 could not be found. Aug 31 15:58:33.982366 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:58:33.982366 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:58:33.982366 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:58:33.982366 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:58:33.982366 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:58:33.982366 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:58:33.982366 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:58:33.982366 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:58:33.982366 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:58:33.982366 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:58:33.982366 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:58:33.982366 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:58:33.982366 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:58:33.982366 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:58:33.982366 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:58:33.986855 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:58:33.986855 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 548e0225-fa26-46ba-9c12-7b52feee1784 could not be found. Aug 31 15:58:33.986855 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:58:33.986855 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:58:33.986855 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:58:33.986855 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:58:33.986855 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:58:33.986855 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:58:33.986855 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:58:33.986855 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:58:33.986855 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 548e0225-fa26-46ba-9c12-7b52feee1784 could not be found. Aug 31 15:58:33.986855 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:58:33.986855 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0a546c1f-1c08-497d-bda2-40cdb4eef5d0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Returning 404 to user: Instance 548e0225-fa26-46ba-9c12-7b52feee1784 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:58:33.986855 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0a546c1f-1c08-497d-bda2-40cdb4eef5d0 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784" status: 404 len: 111 microversion: 2.25 time: 0.069840 Aug 31 15:58:33.986855 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1100/2291] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:33 2022] GET /compute/v2.1/servers/548e0225-fa26-46ba-9c12-7b52feee1784 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 15:58:33.994223 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b6aa31e0-43e1-4d76-b943-079449334930 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:33.994732 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b6aa31e0-43e1-4d76-b943-079449334930 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: f044dca7-71de-4182-b5ec-825299496c10] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:34.004472 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b6aa31e0-43e1-4d76-b943-079449334930 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:34.004963 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b6aa31e0-43e1-4d76-b943-079449334930 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:34.005389 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b6aa31e0-43e1-4d76-b943-079449334930 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:34.006119 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b6aa31e0-43e1-4d76-b943-079449334930 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:34.006601 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b6aa31e0-43e1-4d76-b943-079449334930 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:34.007057 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b6aa31e0-43e1-4d76-b943-079449334930 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:34.051363 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b6aa31e0-43e1-4d76-b943-079449334930 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: f044dca7-71de-4182-b5ec-825299496c10] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:58:34.070777 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.compute.api [None req-b6aa31e0-43e1-4d76-b943-079449334930 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: f044dca7-71de-4182-b5ec-825299496c10] Working on deleting snapshot fa4033c9-4274-4b3e-b1b9-5794b4937612 from shelved instance... Aug 31 15:58:34.085101 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0167dee1-3da4-4089-a262-a1af39a49763 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:34.086121 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0167dee1-3da4-4089-a262-a1af39a49763 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: 13cdbabc-03ef-4025-b984-4bba559857ae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:34.121986 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0167dee1-3da4-4089-a262-a1af39a49763 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:34.122538 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0167dee1-3da4-4089-a262-a1af39a49763 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:34.122977 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0167dee1-3da4-4089-a262-a1af39a49763 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:34.123702 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0167dee1-3da4-4089-a262-a1af39a49763 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:34.124164 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0167dee1-3da4-4089-a262-a1af39a49763 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:34.124573 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0167dee1-3da4-4089-a262-a1af39a49763 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:34.427322 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0167dee1-3da4-4089-a262-a1af39a49763 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922a671cad44ea595e46290a5d52380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1371996a8304dc58ee579daa535bcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:34.444542 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0167dee1-3da4-4089-a262-a1af39a49763 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae" status: 200 len: 1314 microversion: 2.1 time: 0.369301 Aug 31 15:58:34.461676 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1101/2292] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:34 2022] GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae => generated 1314 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:34.472448 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1c762ddf-ec38-4202-9d50-5f68eef5e3a5 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:34.474826 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1c762ddf-ec38-4202-9d50-5f68eef5e3a5 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:34.488551 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c762ddf-ec38-4202-9d50-5f68eef5e3a5 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:34.494900 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c762ddf-ec38-4202-9d50-5f68eef5e3a5 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:34.495616 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c762ddf-ec38-4202-9d50-5f68eef5e3a5 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:34.507377 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c762ddf-ec38-4202-9d50-5f68eef5e3a5 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:34.507868 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c762ddf-ec38-4202-9d50-5f68eef5e3a5 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:34.508692 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c762ddf-ec38-4202-9d50-5f68eef5e3a5 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:34.776336 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1c762ddf-ec38-4202-9d50-5f68eef5e3a5 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:34.791878 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1c762ddf-ec38-4202-9d50-5f68eef5e3a5 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:34.798437 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1c762ddf-ec38-4202-9d50-5f68eef5e3a5 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:34.814486 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1c762ddf-ec38-4202-9d50-5f68eef5e3a5 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1553 microversion: 2.91 time: 0.351413 Aug 31 15:58:34.820611 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1102/2293] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:34 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1553 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:34.926744 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-796327bf-bc3a-4178-9a08-38370d42ad28 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:34.927283 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-796327bf-bc3a-4178-9a08-38370d42ad28 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: a4977edb-9ae0-48ee-887d-d19a5db58a43] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:34.943813 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-796327bf-bc3a-4178-9a08-38370d42ad28 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:34.945823 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-796327bf-bc3a-4178-9a08-38370d42ad28 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:34.946325 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-796327bf-bc3a-4178-9a08-38370d42ad28 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:34.948375 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-796327bf-bc3a-4178-9a08-38370d42ad28 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:34.949101 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-796327bf-bc3a-4178-9a08-38370d42ad28 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:34.951212 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-796327bf-bc3a-4178-9a08-38370d42ad28 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:35.145445 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b6aa31e0-43e1-4d76-b943-079449334930 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: f044dca7-71de-4182-b5ec-825299496c10] Doing local delete in cell ff6ab154-5f51-4e0d-922a-904eb5aa20da(cell1) {{(pid=128864) _delete /opt/stack/nova/nova/compute/api.py:2546}} Aug 31 15:58:35.149244 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b6aa31e0-43e1-4d76-b943-079449334930 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:35.152074 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b6aa31e0-43e1-4d76-b943-079449334930 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:35.155338 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b6aa31e0-43e1-4d76-b943-079449334930 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:35.157768 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.compute.api [None req-b6aa31e0-43e1-4d76-b943-079449334930 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: f044dca7-71de-4182-b5ec-825299496c10] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 31 15:58:35.174592 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-b6aa31e0-43e1-4d76-b943-079449334930 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: f044dca7-71de-4182-b5ec-825299496c10] deallocate_for_instance() {{(pid=128864) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 31 15:58:35.823090 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-796327bf-bc3a-4178-9a08-38370d42ad28 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:35.833401 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-796327bf-bc3a-4178-9a08-38370d42ad28 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/a4977edb-9ae0-48ee-887d-d19a5db58a43" status: 200 len: 1308 microversion: 2.1 time: 0.911963 Aug 31 15:58:35.838247 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1103/2294] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:34 2022] GET /compute/v2.1/servers/a4977edb-9ae0-48ee-887d-d19a5db58a43 => generated 1308 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:58:35.852983 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c5d2f93f-748e-45c9-b826-07e23a1f61e8 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:35.867914 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c5d2f93f-748e-45c9-b826-07e23a1f61e8 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: 13cdbabc-03ef-4025-b984-4bba559857ae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:35.895637 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c5d2f93f-748e-45c9-b826-07e23a1f61e8 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:35.896137 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c5d2f93f-748e-45c9-b826-07e23a1f61e8 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:35.896582 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c5d2f93f-748e-45c9-b826-07e23a1f61e8 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:35.897301 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c5d2f93f-748e-45c9-b826-07e23a1f61e8 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:35.910925 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c5d2f93f-748e-45c9-b826-07e23a1f61e8 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:35.911498 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c5d2f93f-748e-45c9-b826-07e23a1f61e8 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:35.965540 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:58:37.854704 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c5d2f93f-748e-45c9-b826-07e23a1f61e8 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922a671cad44ea595e46290a5d52380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1371996a8304dc58ee579daa535bcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:37.883297 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c5d2f93f-748e-45c9-b826-07e23a1f61e8 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae" status: 200 len: 1314 microversion: 2.1 time: 2.041854 Aug 31 15:58:37.884110 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1104/2295] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:35 2022] GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae => generated 1314 bytes in 2044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:37.912416 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9df08ee2-db6a-417b-b66f-1bfbace1e092 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:37.913519 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9df08ee2-db6a-417b-b66f-1bfbace1e092 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:37.933300 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9df08ee2-db6a-417b-b66f-1bfbace1e092 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:37.934605 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9df08ee2-db6a-417b-b66f-1bfbace1e092 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:37.939004 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9df08ee2-db6a-417b-b66f-1bfbace1e092 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:37.942964 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9df08ee2-db6a-417b-b66f-1bfbace1e092 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:37.943862 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9df08ee2-db6a-417b-b66f-1bfbace1e092 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:37.946940 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9df08ee2-db6a-417b-b66f-1bfbace1e092 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:38.384045 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9df08ee2-db6a-417b-b66f-1bfbace1e092 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:38.399018 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9df08ee2-db6a-417b-b66f-1bfbace1e092 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:38.405491 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9df08ee2-db6a-417b-b66f-1bfbace1e092 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:38.420266 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9df08ee2-db6a-417b-b66f-1bfbace1e092 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1553 microversion: 2.91 time: 0.531809 Aug 31 15:58:38.427965 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1105/2296] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:37 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1553 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:38.458514 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-d690bdc0-13d9-4b0f-bcc7-2d9c99738a1c req-8067dbed-cd14-44b2-9542-eb03d1223a48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4977edb-9ae0-48ee-887d-d19a5db58a43", "name": "network-vif-plugged", "status": "completed", "tag": "98738177-422e-4e04-85eb-a363f7670a8e"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:38.471182 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d690bdc0-13d9-4b0f-bcc7-2d9c99738a1c req-8067dbed-cd14-44b2-9542-eb03d1223a48 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:38.472281 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d690bdc0-13d9-4b0f-bcc7-2d9c99738a1c req-8067dbed-cd14-44b2-9542-eb03d1223a48 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:38.472993 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d690bdc0-13d9-4b0f-bcc7-2d9c99738a1c req-8067dbed-cd14-44b2-9542-eb03d1223a48 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:38.505607 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-d690bdc0-13d9-4b0f-bcc7-2d9c99738a1c req-8067dbed-cd14-44b2-9542-eb03d1223a48 service nova] Creating event network-vif-plugged:98738177-422e-4e04-85eb-a363f7670a8e for instance a4977edb-9ae0-48ee-887d-d19a5db58a43 on n-h2-833090-16 Aug 31 15:58:38.521736 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-d690bdc0-13d9-4b0f-bcc7-2d9c99738a1c req-8067dbed-cd14-44b2-9542-eb03d1223a48 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089005 Aug 31 15:58:38.525477 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1106/2297] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:38.533875 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6a7aefb2-8976-4e61-92b9-fe796ca78e36 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:38.535135 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6a7aefb2-8976-4e61-92b9-fe796ca78e36 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: a4977edb-9ae0-48ee-887d-d19a5db58a43] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:38.548674 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a7aefb2-8976-4e61-92b9-fe796ca78e36 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:38.552419 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a7aefb2-8976-4e61-92b9-fe796ca78e36 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:38.555470 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a7aefb2-8976-4e61-92b9-fe796ca78e36 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:38.556586 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a7aefb2-8976-4e61-92b9-fe796ca78e36 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:38.557358 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a7aefb2-8976-4e61-92b9-fe796ca78e36 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:38.572312 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a7aefb2-8976-4e61-92b9-fe796ca78e36 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:39.375283 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-b6aa31e0-43e1-4d76-b943-079449334930 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: f044dca7-71de-4182-b5ec-825299496c10] Updating instance_info_cache with network_info: [] {{(pid=128864) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 31 15:58:39.915750 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6a7aefb2-8976-4e61-92b9-fe796ca78e36 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:39.993043 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6a7aefb2-8976-4e61-92b9-fe796ca78e36 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/a4977edb-9ae0-48ee-887d-d19a5db58a43" status: 200 len: 1308 microversion: 2.1 time: 1.461548 Aug 31 15:58:39.995926 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1107/2298] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:38 2022] GET /compute/v2.1/servers/a4977edb-9ae0-48ee-887d-d19a5db58a43 => generated 1308 bytes in 1469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:40.011532 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fbeee818-af32-4c41-9c19-398468382cca tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:40.014753 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fbeee818-af32-4c41-9c19-398468382cca tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: 13cdbabc-03ef-4025-b984-4bba559857ae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:40.028933 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbeee818-af32-4c41-9c19-398468382cca tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:40.030745 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbeee818-af32-4c41-9c19-398468382cca tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:40.031568 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbeee818-af32-4c41-9c19-398468382cca tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:40.035381 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbeee818-af32-4c41-9c19-398468382cca tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:40.036113 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbeee818-af32-4c41-9c19-398468382cca tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:40.036763 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbeee818-af32-4c41-9c19-398468382cca tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:40.042462 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b6aa31e0-43e1-4d76-b943-079449334930 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "DELETE /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10" status: 204 len: 0 microversion: 2.1 time: 6.046406 Aug 31 15:58:40.043479 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1192/2299] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:58:33 2022] DELETE /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10 => generated 0 bytes in 6055 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:58:40.910820 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fbeee818-af32-4c41-9c19-398468382cca tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922a671cad44ea595e46290a5d52380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1371996a8304dc58ee579daa535bcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:40.925061 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fbeee818-af32-4c41-9c19-398468382cca tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae" status: 200 len: 1314 microversion: 2.1 time: 0.926696 Aug 31 15:58:40.931336 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1108/2300] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:39 2022] GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae => generated 1314 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:40.937343 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-938ae4dc-9c87-4f0c-8a2e-42d3b3f47585 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:40.938834 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-938ae4dc-9c87-4f0c-8a2e-42d3b3f47585 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:40.948254 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-938ae4dc-9c87-4f0c-8a2e-42d3b3f47585 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:40.961305 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-938ae4dc-9c87-4f0c-8a2e-42d3b3f47585 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:40.963862 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-938ae4dc-9c87-4f0c-8a2e-42d3b3f47585 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:40.968358 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-938ae4dc-9c87-4f0c-8a2e-42d3b3f47585 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:40.969423 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-938ae4dc-9c87-4f0c-8a2e-42d3b3f47585 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:40.972137 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-938ae4dc-9c87-4f0c-8a2e-42d3b3f47585 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:41.292335 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-938ae4dc-9c87-4f0c-8a2e-42d3b3f47585 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:41.306420 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-938ae4dc-9c87-4f0c-8a2e-42d3b3f47585 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:41.308223 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-938ae4dc-9c87-4f0c-8a2e-42d3b3f47585 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:41.317948 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-938ae4dc-9c87-4f0c-8a2e-42d3b3f47585 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1553 microversion: 2.91 time: 0.384845 Aug 31 15:58:41.346255 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1109/2301] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:40 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1553 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:41.367827 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-4cbd6d63-1ac3-4472-954f-a1e2b3280031 req-34546bfb-f67f-4be1-a65d-f19d7add8ded service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f044dca7-71de-4182-b5ec-825299496c10", "name": "network-vif-deleted", "tag": "f2758b61-4cf5-4435-9306-d8d8ffd9e363"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:41.388851 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-226b1d08-95df-4859-b61b-c4493e84b41d tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] Calling method '.version_select at 0x7fbb47066940>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:41.393019 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4cbd6d63-1ac3-4472-954f-a1e2b3280031 req-34546bfb-f67f-4be1-a65d-f19d7add8ded service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:41.394437 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4cbd6d63-1ac3-4472-954f-a1e2b3280031 req-34546bfb-f67f-4be1-a65d-f19d7add8ded service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:41.395451 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4cbd6d63-1ac3-4472-954f-a1e2b3280031 req-34546bfb-f67f-4be1-a65d-f19d7add8ded service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:41.421400 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.compute.server_external_events [req-4cbd6d63-1ac3-4472-954f-a1e2b3280031 req-34546bfb-f67f-4be1-a65d-f19d7add8ded service nova] Unable to find a host for instance f044dca7-71de-4182-b5ec-825299496c10. Dropping event network-vif-deleted {{(pid=128863) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 31 15:58:41.424807 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-4cbd6d63-1ac3-4472-954f-a1e2b3280031 req-34546bfb-f67f-4be1-a65d-f19d7add8ded service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.067133 Aug 31 15:58:41.426675 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1110/2302] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 79 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 31 15:58:41.434509 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7a6f22c1-b2e9-40d8-ba86-d05a60784d92 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:41.436914 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7a6f22c1-b2e9-40d8-ba86-d05a60784d92 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: f044dca7-71de-4182-b5ec-825299496c10] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:41.453809 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a6f22c1-b2e9-40d8-ba86-d05a60784d92 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:41.456408 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a6f22c1-b2e9-40d8-ba86-d05a60784d92 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:41.457441 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a6f22c1-b2e9-40d8-ba86-d05a60784d92 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:41.458574 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a6f22c1-b2e9-40d8-ba86-d05a60784d92 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:41.459220 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a6f22c1-b2e9-40d8-ba86-d05a60784d92 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:41.459842 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a6f22c1-b2e9-40d8-ba86-d05a60784d92 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:41.505259 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-7a6f22c1-b2e9-40d8-ba86-d05a60784d92 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] HTTP exception thrown: Instance f044dca7-71de-4182-b5ec-825299496c10 could not be found. Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7a6f22c1-b2e9-40d8-ba86-d05a60784d92 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Request method failure captured: Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10 HTTP/1.1 Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4Q2UxjmzRUIcRyBJZeRXZe8f-kxARGQrfLNadx-PtSKRAHFDd-cfjpN41Lm2TAtWQQVK9trDHJa1Iu7P1XlF1-EYrtrhJnDHGb-ivhI0erITWpZsYkLGmnwPDtbMbW99ld2jucgWFbVY0vVDf-y4OAM7Az1owqOg13oLERSA9bN0MQ Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: dde27d282fc24e56a62eaeacff1431d5 Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-DeleteServersTestJSON-1135653165 Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_dde27d282fc24e56a62eaeacff1431d5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-DeleteServersTestJSON-1135653165 Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: dde27d282fc24e56a62eaeacff1431d5 Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-DeleteServersTestJSON-1135653165 Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-DeleteServersTestJSON-1135653165-project Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 4d4f2146c3bc4a64b5d7f72cd136b6db Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-DeleteServersTestJSON-1135653165-project Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance f044dca7-71de-4182-b5ec-825299496c10 could not be found. Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'f044dca7-71de-4182-b5ec-825299496c10'} Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f044dca7-71de-4182-b5ec-825299496c10 could not be found. Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f044dca7-71de-4182-b5ec-825299496c10 could not be found. Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:58:41.509253 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:58:41.514856 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:58:41.514856 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:58:41.514856 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:58:41.514856 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:58:41.514856 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:58:41.514856 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f044dca7-71de-4182-b5ec-825299496c10 could not be found. Aug 31 15:58:41.514856 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:58:41.519507 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7a6f22c1-b2e9-40d8-ba86-d05a60784d92 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Returning 404 to user: Instance f044dca7-71de-4182-b5ec-825299496c10 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:58:41.522935 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7a6f22c1-b2e9-40d8-ba86-d05a60784d92 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10" status: 404 len: 111 microversion: 2.1 time: 0.094378 Aug 31 15:58:41.527684 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1111/2303] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:41 2022] GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:58:41.544812 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-17235c79-67b6-4a4a-92de-f865ba953bb1 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:41.546911 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-17235c79-67b6-4a4a-92de-f865ba953bb1 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: a4977edb-9ae0-48ee-887d-d19a5db58a43] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:41.581047 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-17235c79-67b6-4a4a-92de-f865ba953bb1 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:41.585070 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-17235c79-67b6-4a4a-92de-f865ba953bb1 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:41.587142 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-17235c79-67b6-4a4a-92de-f865ba953bb1 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:41.591764 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-17235c79-67b6-4a4a-92de-f865ba953bb1 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:41.593605 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-17235c79-67b6-4a4a-92de-f865ba953bb1 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:41.595816 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-17235c79-67b6-4a4a-92de-f865ba953bb1 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:41.674722 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-226b1d08-95df-4859-b61b-c4493e84b41d tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/9a2c5925c16e49bcbf85fe2812ff1d3e" status: 200 len: 371 microversion: 2.1 time: 1.627278 Aug 31 15:58:41.686964 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1193/2304] 10.222.0.50 () {58 vars in 1242 bytes} [Wed Aug 31 15:58:40 2022] GET /compute/v2.1/os-quota-sets/9a2c5925c16e49bcbf85fe2812ff1d3e => generated 371 bytes in 1640 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:41.709946 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-484c456a-9f14-41e0-afb4-309ca862e7fc tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] Action: 'update', calling method: .version_select at 0x7fbb46878670>, body: {"quota_set": {"ram": "5120"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:42.264453 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-17235c79-67b6-4a4a-92de-f865ba953bb1 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:42.300626 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-17235c79-67b6-4a4a-92de-f865ba953bb1 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/a4977edb-9ae0-48ee-887d-d19a5db58a43" status: 200 len: 1487 microversion: 2.1 time: 0.760417 Aug 31 15:58:42.302283 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1112/2305] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:41 2022] GET /compute/v2.1/servers/a4977edb-9ae0-48ee-887d-d19a5db58a43 => generated 1487 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:42.305482 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-484c456a-9f14-41e0-afb4-309ca862e7fc tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:42.306280 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-484c456a-9f14-41e0-afb4-309ca862e7fc tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:42.309385 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-484c456a-9f14-41e0-afb4-309ca862e7fc tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:42.310595 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-484c456a-9f14-41e0-afb4-309ca862e7fc tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:42.311307 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-484c456a-9f14-41e0-afb4-309ca862e7fc tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:42.314112 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-484c456a-9f14-41e0-afb4-309ca862e7fc tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:42.341077 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7cf87f70-e78f-4991-af40-1b84408240cc tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2000649239", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "e71afd64-faa4-4680-b8e0-76fe805d5df1"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:42.487080 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-484c456a-9f14-41e0-afb4-309ca862e7fc tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/9a2c5925c16e49bcbf85fe2812ff1d3e" status: 200 len: 328 microversion: 2.1 time: 0.798331 Aug 31 15:58:42.498525 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1194/2306] 10.222.0.50 () {60 vars in 1262 bytes} [Wed Aug 31 15:58:41 2022] PUT /compute/v2.1/os-quota-sets/9a2c5925c16e49bcbf85fe2812ff1d3e => generated 328 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:42.524277 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b89d6878-5218-4b62-a5db-0bc825251ca2 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:42.525554 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b89d6878-5218-4b62-a5db-0bc825251ca2 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: 13cdbabc-03ef-4025-b984-4bba559857ae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:42.535738 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-7cf87f70-e78f-4991-af40-1b84408240cc tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] validate_networks() for [('e71afd64-faa4-4680-b8e0-76fe805d5df1', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:58:42.547812 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b89d6878-5218-4b62-a5db-0bc825251ca2 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:42.551221 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b89d6878-5218-4b62-a5db-0bc825251ca2 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:42.561298 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b89d6878-5218-4b62-a5db-0bc825251ca2 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:42.562049 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b89d6878-5218-4b62-a5db-0bc825251ca2 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:42.562559 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b89d6878-5218-4b62-a5db-0bc825251ca2 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:42.563031 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b89d6878-5218-4b62-a5db-0bc825251ca2 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:43.136212 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b89d6878-5218-4b62-a5db-0bc825251ca2 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922a671cad44ea595e46290a5d52380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1371996a8304dc58ee579daa535bcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:43.147643 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b89d6878-5218-4b62-a5db-0bc825251ca2 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae" status: 200 len: 1314 microversion: 2.1 time: 0.647050 Aug 31 15:58:43.148244 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1195/2307] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:42 2022] GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae => generated 1314 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:43.156631 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1e286958-045f-4096-b577-f3c11bb14238 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-276057448"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:43.161457 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1e286958-045f-4096-b577-f3c11bb14238 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: a4977edb-9ae0-48ee-887d-d19a5db58a43] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:43.197388 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e286958-045f-4096-b577-f3c11bb14238 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:43.198975 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e286958-045f-4096-b577-f3c11bb14238 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:43.199675 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e286958-045f-4096-b577-f3c11bb14238 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:43.200576 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e286958-045f-4096-b577-f3c11bb14238 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:43.201412 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e286958-045f-4096-b577-f3c11bb14238 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:43.202502 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e286958-045f-4096-b577-f3c11bb14238 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:43.835227 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-7cf87f70-e78f-4991-af40-1b84408240cc tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:58:43.835782 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-7cf87f70-e78f-4991-af40-1b84408240cc tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:58:43.836095 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-7cf87f70-e78f-4991-af40-1b84408240cc tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:58:43.837193 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-7cf87f70-e78f-4991-af40-1b84408240cc tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:58:43.837757 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-7cf87f70-e78f-4991-af40-1b84408240cc tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:58:43.863397 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cf87f70-e78f-4991-af40-1b84408240cc tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:43.867315 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cf87f70-e78f-4991-af40-1b84408240cc tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:43.869658 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cf87f70-e78f-4991-af40-1b84408240cc tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:43.873265 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cf87f70-e78f-4991-af40-1b84408240cc tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:43.877035 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cf87f70-e78f-4991-af40-1b84408240cc tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:43.880640 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cf87f70-e78f-4991-af40-1b84408240cc tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:43.925920 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1e286958-045f-4096-b577-f3c11bb14238 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "POST /compute/v2.1/servers/a4977edb-9ae0-48ee-887d-d19a5db58a43/action" status: 202 len: 0 microversion: 2.1 time: 0.771652 Aug 31 15:58:43.931395 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1196/2308] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 15:58:43 2022] POST /compute/v2.1/servers/a4977edb-9ae0-48ee-887d-d19a5db58a43/action => generated 0 bytes in 778 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 31 15:58:43.944015 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9a363369-30f0-4013-8981-0cdec92a5b73 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:43.948603 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9a363369-30f0-4013-8981-0cdec92a5b73 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:43.965442 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-7cf87f70-e78f-4991-af40-1b84408240cc tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Getting quotas for project dde27d282fc24e56a62eaeacff1431d5. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:58:43.990198 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9a363369-30f0-4013-8981-0cdec92a5b73 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:43.992579 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9a363369-30f0-4013-8981-0cdec92a5b73 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:43.994505 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9a363369-30f0-4013-8981-0cdec92a5b73 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:43.996805 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9a363369-30f0-4013-8981-0cdec92a5b73 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:43.998576 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9a363369-30f0-4013-8981-0cdec92a5b73 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:43.999199 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9a363369-30f0-4013-8981-0cdec92a5b73 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:43.999310 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-7cf87f70-e78f-4991-af40-1b84408240cc tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Getting quotas for user 4d4f2146c3bc4a64b5d7f72cd136b6db and project dde27d282fc24e56a62eaeacff1431d5. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:58:44.076110 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:58:44.084019 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7cf87f70-e78f-4991-af40-1b84408240cc tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:58:44.093329 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7cf87f70-e78f-4991-af40-1b84408240cc tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 320bf21c-eec1-43ea-a496-059fccc2642f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:58:44.270410 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7cf87f70-e78f-4991-af40-1b84408240cc tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.944147 Aug 31 15:58:44.270410 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1113/2309] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:58:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1948 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 15:58:44.272143 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0fb5a650-dd6e-41ee-9bce-aea53778c5aa tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:44.322925 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0fb5a650-dd6e-41ee-9bce-aea53778c5aa tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-quota-sets/9a2c5925c16e49bcbf85fe2812ff1d3e" status: 202 len: 0 microversion: 2.1 time: 0.055156 Aug 31 15:58:44.323978 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1114/2310] 10.222.0.50 () {58 vars in 1245 bytes} [Wed Aug 31 15:58:44 2022] DELETE /compute/v2.1/os-quota-sets/9a2c5925c16e49bcbf85fe2812ff1d3e => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:58:44.334704 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-83875ceb-c9fc-40d2-8ebd-847c649134d9 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb4ab02e50>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:44.410653 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9a363369-30f0-4013-8981-0cdec92a5b73 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:44.413197 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:58:44.421797 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9a363369-30f0-4013-8981-0cdec92a5b73 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:44.423335 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9a363369-30f0-4013-8981-0cdec92a5b73 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:44.446288 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9a363369-30f0-4013-8981-0cdec92a5b73 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1553 microversion: 2.91 time: 0.511973 Aug 31 15:58:44.446858 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1197/2311] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:43 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1553 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:44.461630 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fdbe91a6-03bd-4b34-bae8-2d1e19e1c194 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:44.462281 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fdbe91a6-03bd-4b34-bae8-2d1e19e1c194 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: 13cdbabc-03ef-4025-b984-4bba559857ae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:44.479869 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-83875ceb-c9fc-40d2-8ebd-847c649134d9 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/images/d66293d2-cbc4-4ccf-ac36-12e31a418564" status: 200 len: 1411 microversion: 2.1 time: 0.154258 Aug 31 15:58:44.489848 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1115/2312] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:58:44 2022] GET /compute/v2.1/images/d66293d2-cbc4-4ccf-ac36-12e31a418564 => generated 1411 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:44.490615 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fdbe91a6-03bd-4b34-bae8-2d1e19e1c194 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:44.491407 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fdbe91a6-03bd-4b34-bae8-2d1e19e1c194 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:44.492107 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fdbe91a6-03bd-4b34-bae8-2d1e19e1c194 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:44.494197 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6f6f3de2-558d-4b0a-9202-d7de27d8f404 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:44.494895 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6f6f3de2-558d-4b0a-9202-d7de27d8f404 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 320bf21c-eec1-43ea-a496-059fccc2642f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:44.495099 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fdbe91a6-03bd-4b34-bae8-2d1e19e1c194 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:44.495684 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fdbe91a6-03bd-4b34-bae8-2d1e19e1c194 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:44.496137 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fdbe91a6-03bd-4b34-bae8-2d1e19e1c194 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:44.776560 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6f6f3de2-558d-4b0a-9202-d7de27d8f404 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:44.790925 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6f6f3de2-558d-4b0a-9202-d7de27d8f404 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f" status: 200 len: 1215 microversion: 2.1 time: 0.306944 Aug 31 15:58:44.794246 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1116/2313] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:44 2022] GET /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f => generated 1215 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:44.803887 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cc75bf82-aeab-4433-820a-8c1cb43dbfcd tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] Calling method '.version_select at 0x7fbb4aa5c3a0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:45.330416 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-fdbe91a6-03bd-4b34-bae8-2d1e19e1c194 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922a671cad44ea595e46290a5d52380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1371996a8304dc58ee579daa535bcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:45.379006 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fdbe91a6-03bd-4b34-bae8-2d1e19e1c194 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae" status: 200 len: 1314 microversion: 2.1 time: 0.919793 Aug 31 15:58:45.382639 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1198/2314] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:44 2022] GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae => generated 1314 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:45.403914 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c1f56d63-212b-4299-a1fb-44b04ce056f2 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:45.405705 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c1f56d63-212b-4299-a1fb-44b04ce056f2 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:45.417511 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c1f56d63-212b-4299-a1fb-44b04ce056f2 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:45.417914 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c1f56d63-212b-4299-a1fb-44b04ce056f2 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:45.418391 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c1f56d63-212b-4299-a1fb-44b04ce056f2 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:45.419129 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c1f56d63-212b-4299-a1fb-44b04ce056f2 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:45.419579 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c1f56d63-212b-4299-a1fb-44b04ce056f2 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:45.420179 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c1f56d63-212b-4299-a1fb-44b04ce056f2 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:45.479263 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c1f56d63-212b-4299-a1fb-44b04ce056f2 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:58:45.615103 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cc75bf82-aeab-4433-820a-8c1cb43dbfcd tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/9a2c5925c16e49bcbf85fe2812ff1d3e" status: 200 len: 371 microversion: 2.1 time: 0.806811 Aug 31 15:58:45.627027 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1117/2315] 10.222.0.50 () {58 vars in 1242 bytes} [Wed Aug 31 15:58:44 2022] GET /compute/v2.1/os-quota-sets/9a2c5925c16e49bcbf85fe2812ff1d3e => generated 371 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:45.642753 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-78e37df8-7bad-4323-84b1-c57386952788 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb4aa8ae50>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:45.826697 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c1f56d63-212b-4299-a1fb-44b04ce056f2 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "DELETE /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a" status: 204 len: 0 microversion: 2.25 time: 0.438938 Aug 31 15:58:45.835889 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1199/2316] 10.222.0.50 () {60 vars in 1280 bytes} [Wed Aug 31 15:58:45 2022] DELETE /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 15:58:45.861198 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-78e37df8-7bad-4323-84b1-c57386952788 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/images/d66293d2-cbc4-4ccf-ac36-12e31a418564" status: 200 len: 1411 microversion: 2.1 time: 0.225737 Aug 31 15:58:45.862514 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1118/2317] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:58:45 2022] GET /compute/v2.1/images/d66293d2-cbc4-4ccf-ac36-12e31a418564 => generated 1411 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:45.864801 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-0893c10e-0293-4e08-b4e3-dd897b6b137d req-66738e4c-3b3d-4414-a183-f8ab4f8fd9fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13cdbabc-03ef-4025-b984-4bba559857ae", "name": "network-vif-plugged", "status": "completed", "tag": "d1aa64dc-dced-4b64-b066-475595f92abb"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:45.883080 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-29477c56-e8e5-43af-b043-135ca20e1732 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:45.883823 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-29477c56-e8e5-43af-b043-135ca20e1732 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:45.909103 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-0893c10e-0293-4e08-b4e3-dd897b6b137d req-66738e4c-3b3d-4414-a183-f8ab4f8fd9fe service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:45.911349 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29477c56-e8e5-43af-b043-135ca20e1732 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:45.913130 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-0893c10e-0293-4e08-b4e3-dd897b6b137d req-66738e4c-3b3d-4414-a183-f8ab4f8fd9fe service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:45.914547 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-0893c10e-0293-4e08-b4e3-dd897b6b137d req-66738e4c-3b3d-4414-a183-f8ab4f8fd9fe service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:45.915025 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29477c56-e8e5-43af-b043-135ca20e1732 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:45.918200 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29477c56-e8e5-43af-b043-135ca20e1732 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:45.922840 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29477c56-e8e5-43af-b043-135ca20e1732 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:45.925602 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29477c56-e8e5-43af-b043-135ca20e1732 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:45.930010 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29477c56-e8e5-43af-b043-135ca20e1732 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:45.973734 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-0893c10e-0293-4e08-b4e3-dd897b6b137d req-66738e4c-3b3d-4414-a183-f8ab4f8fd9fe service nova] Creating event network-vif-plugged:d1aa64dc-dced-4b64-b066-475595f92abb for instance 13cdbabc-03ef-4025-b984-4bba559857ae on n-h2-833090-16 Aug 31 15:58:45.992671 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-0893c10e-0293-4e08-b4e3-dd897b6b137d req-66738e4c-3b3d-4414-a183-f8ab4f8fd9fe service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144836 Aug 31 15:58:45.993443 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1200/2318] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:46.012170 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c7f38016-115d-410b-8674-e8d9673c0eb9 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:46.016847 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c7f38016-115d-410b-8674-e8d9673c0eb9 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 320bf21c-eec1-43ea-a496-059fccc2642f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:46.055900 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c7f38016-115d-410b-8674-e8d9673c0eb9 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:46.059126 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c7f38016-115d-410b-8674-e8d9673c0eb9 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:46.059814 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c7f38016-115d-410b-8674-e8d9673c0eb9 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:46.065709 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c7f38016-115d-410b-8674-e8d9673c0eb9 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:46.082872 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c7f38016-115d-410b-8674-e8d9673c0eb9 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:46.083549 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c7f38016-115d-410b-8674-e8d9673c0eb9 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:46.234949 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-29477c56-e8e5-43af-b043-135ca20e1732 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:46.259214 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-29477c56-e8e5-43af-b043-135ca20e1732 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:46.264427 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-29477c56-e8e5-43af-b043-135ca20e1732 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:46.286138 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-29477c56-e8e5-43af-b043-135ca20e1732 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1553 microversion: 2.91 time: 0.418063 Aug 31 15:58:46.287063 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1119/2319] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:45 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1553 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:46.292132 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-25bf6519-0a42-4943-ae27-cf992f197f45 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:46.296929 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-25bf6519-0a42-4943-ae27-cf992f197f45 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:46.311068 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25bf6519-0a42-4943-ae27-cf992f197f45 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:46.315146 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25bf6519-0a42-4943-ae27-cf992f197f45 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:46.316547 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25bf6519-0a42-4943-ae27-cf992f197f45 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:46.318908 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25bf6519-0a42-4943-ae27-cf992f197f45 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:46.320103 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25bf6519-0a42-4943-ae27-cf992f197f45 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:46.320981 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25bf6519-0a42-4943-ae27-cf992f197f45 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:46.380974 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c7f38016-115d-410b-8674-e8d9673c0eb9 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:46.394505 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c7f38016-115d-410b-8674-e8d9673c0eb9 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f" status: 200 len: 1211 microversion: 2.1 time: 0.396454 Aug 31 15:58:46.399814 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1201/2320] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:45 2022] GET /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f => generated 1211 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:46.411716 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-82fd3b9c-8749-4546-8954-593b5f2a7e6e tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb467b9310>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:46.728648 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-82fd3b9c-8749-4546-8954-593b5f2a7e6e tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "DELETE /compute/v2.1/images/d66293d2-cbc4-4ccf-ac36-12e31a418564" status: 204 len: 0 microversion: 2.1 time: 0.326741 Aug 31 15:58:46.729238 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1202/2321] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:46 2022] DELETE /compute/v2.1/images/d66293d2-cbc4-4ccf-ac36-12e31a418564 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:58:46.735238 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a98879d7-53af-4df9-ac90-d67878553041 tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] Calling method '.version_select at 0x7fbb468578b0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:47.457593 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a98879d7-53af-4df9-ac90-d67878553041 tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/3eacc49906b84211b85bbe6baed447dd/defaults" status: 200 len: 371 microversion: 2.1 time: 0.726454 Aug 31 15:58:47.461291 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1203/2322] 10.222.0.50 () {58 vars in 1269 bytes} [Wed Aug 31 15:58:46 2022] GET /compute/v2.1/os-quota-sets/3eacc49906b84211b85bbe6baed447dd/defaults => generated 371 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:47.476583 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-58644204-2ffb-4c68-b411-6f0ce09e809f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:47.483298 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-58644204-2ffb-4c68-b411-6f0ce09e809f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: 13cdbabc-03ef-4025-b984-4bba559857ae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:47.524069 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-58644204-2ffb-4c68-b411-6f0ce09e809f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:47.525073 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-58644204-2ffb-4c68-b411-6f0ce09e809f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:47.527888 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-58644204-2ffb-4c68-b411-6f0ce09e809f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:47.529056 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-58644204-2ffb-4c68-b411-6f0ce09e809f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:47.529627 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-58644204-2ffb-4c68-b411-6f0ce09e809f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:47.530176 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-58644204-2ffb-4c68-b411-6f0ce09e809f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:47.674652 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-25bf6519-0a42-4943-ae27-cf992f197f45 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:47.687737 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-25bf6519-0a42-4943-ae27-cf992f197f45 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:47.689933 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-25bf6519-0a42-4943-ae27-cf992f197f45 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:47.697229 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-25bf6519-0a42-4943-ae27-cf992f197f45 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a" status: 200 len: 1731 microversion: 2.25 time: 1.408909 Aug 31 15:58:47.698152 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1120/2323] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:46 2022] GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a => generated 1731 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:47.711914 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bea22441-a246-48b2-948a-1d6503ed7bdf tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb4aac6430>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:47.772274 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-bea22441-a246-48b2-948a-1d6503ed7bdf tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] HTTP exception thrown: Image not found. Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bea22441-a246-48b2-948a-1d6503ed7bdf tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Request method failure captured: Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/images/d66293d2-cbc4-4ccf-ac36-12e31a418564 HTTP/1.1 Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4RCKsQiaZtbjrQJmd2Omjl_oKAmhft4D7jlzDIoeb03U1ZQC3H31yVwWa3WjVw5pgChsVO4acIHjtkGbbISXlxQMrYifNC9zQ3UBQ638xuVfQg3UB8C-mMDDctLeTsW0UlxlkPW1bUS7dAwoxIzX4-zocS5PRKR97axAhcoV_2u0I8 Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: c508a07ab50746468f855f7c5893ffdc Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ImagesTestJSON-145941755 Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c508a07ab50746468f855f7c5893ffdc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c508a07ab50746468f855f7c5893ffdc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c508a07ab50746468f855f7c5893ffdc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c508a07ab50746468f855f7c5893ffdc", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ImagesTestJSON-145941755 Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: c508a07ab50746468f855f7c5893ffdc Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ImagesTestJSON-145941755 Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ImagesTestJSON-145941755-project Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 7d84a1872d9442b2886a8060d2e59580 Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ImagesTestJSON-145941755-project Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: method: Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: exception: Image not found. Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'd66293d2-cbc4-4ccf-ac36-12e31a418564'} Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d66293d2-cbc4-4ccf-ac36-12e31a418564 Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 31 15:58:47.774429 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 31 15:58:47.778929 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 31 15:58:47.778929 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 31 15:58:47.778929 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 15:58:47.778929 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 15:58:47.778929 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 31 15:58:47.778929 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 31 15:58:47.778929 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 15:58:47.778929 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 15:58:47.778929 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 31 15:58:47.778929 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 31 15:58:47.778929 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 31 15:58:47.778929 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 31 15:58:47.778929 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 15:58:47.778929 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 15:58:47.778929 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 15:58:47.778929 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 15:58:47.778929 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d66293d2-cbc4-4ccf-ac36-12e31a418564 could not be found. Aug 31 15:58:47.778929 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:58:47.778929 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:58:47.778929 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:58:47.778929 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:58:47.778929 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:58:47.778929 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:58:47.778929 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:58:47.778929 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:58:47.778929 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:58:47.778929 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:58:47.778929 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:58:47.778929 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:58:47.778929 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 31 15:58:47.778929 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 31 15:58:47.778929 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 31 15:58:47.778929 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:58:47.778929 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:58:47.778929 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:58:47.778929 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:58:47.778929 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:58:47.778929 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:58:47.778929 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:58:47.778929 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:58:47.778929 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 31 15:58:47.778929 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:58:47.782413 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bea22441-a246-48b2-948a-1d6503ed7bdf tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Returning 404 to user: Image not found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:58:47.782849 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bea22441-a246-48b2-948a-1d6503ed7bdf tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/images/d66293d2-cbc4-4ccf-ac36-12e31a418564" status: 404 len: 62 microversion: 2.1 time: 0.080311 Aug 31 15:58:47.783502 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1121/2324] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 15:58:47 2022] GET /compute/v2.1/images/d66293d2-cbc4-4ccf-ac36-12e31a418564 => generated 62 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 15:58:47.800654 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2ff960a5-700b-4910-9511-6293b3d333f2 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:47.802072 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2ff960a5-700b-4910-9511-6293b3d333f2 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:47.821774 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ff960a5-700b-4910-9511-6293b3d333f2 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:47.825663 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ff960a5-700b-4910-9511-6293b3d333f2 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:47.828034 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ff960a5-700b-4910-9511-6293b3d333f2 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:47.832502 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ff960a5-700b-4910-9511-6293b3d333f2 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:47.834353 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ff960a5-700b-4910-9511-6293b3d333f2 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:47.834974 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ff960a5-700b-4910-9511-6293b3d333f2 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:48.069352 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2ff960a5-700b-4910-9511-6293b3d333f2 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:48.081836 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2ff960a5-700b-4910-9511-6293b3d333f2 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:48.084619 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2ff960a5-700b-4910-9511-6293b3d333f2 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:48.092552 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2ff960a5-700b-4910-9511-6293b3d333f2 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1553 microversion: 2.91 time: 0.307610 Aug 31 15:58:48.112637 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1122/2325] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:47 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1553 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:48.119768 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ae609248-ea74-43de-a970-54879cb1cdbf tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:48.120773 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ae609248-ea74-43de-a970-54879cb1cdbf tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 320bf21c-eec1-43ea-a496-059fccc2642f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:48.127868 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae609248-ea74-43de-a970-54879cb1cdbf tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:48.128692 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae609248-ea74-43de-a970-54879cb1cdbf tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:48.129333 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae609248-ea74-43de-a970-54879cb1cdbf tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:48.130310 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae609248-ea74-43de-a970-54879cb1cdbf tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:48.130989 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae609248-ea74-43de-a970-54879cb1cdbf tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:48.131607 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae609248-ea74-43de-a970-54879cb1cdbf tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:48.444273 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ae609248-ea74-43de-a970-54879cb1cdbf tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:48.468058 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ae609248-ea74-43de-a970-54879cb1cdbf tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f" status: 200 len: 1273 microversion: 2.1 time: 0.353920 Aug 31 15:58:48.469311 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1123/2326] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:48 2022] GET /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f => generated 1273 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:48.474855 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-58644204-2ffb-4c68-b411-6f0ce09e809f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922a671cad44ea595e46290a5d52380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1371996a8304dc58ee579daa535bcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:48.477616 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4760bcc3-eb7e-41b1-ae03-cfa270a194d1 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:48.478766 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4760bcc3-eb7e-41b1-ae03-cfa270a194d1 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: a4977edb-9ae0-48ee-887d-d19a5db58a43] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:48.486987 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-58644204-2ffb-4c68-b411-6f0ce09e809f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae" status: 200 len: 1314 microversion: 2.1 time: 1.023867 Aug 31 15:58:48.489711 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1204/2327] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:47 2022] GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae => generated 1314 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:48.490763 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4760bcc3-eb7e-41b1-ae03-cfa270a194d1 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:48.491406 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4760bcc3-eb7e-41b1-ae03-cfa270a194d1 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:48.491986 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4760bcc3-eb7e-41b1-ae03-cfa270a194d1 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:48.493096 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4760bcc3-eb7e-41b1-ae03-cfa270a194d1 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:48.493746 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4760bcc3-eb7e-41b1-ae03-cfa270a194d1 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:48.495145 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4760bcc3-eb7e-41b1-ae03-cfa270a194d1 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:48.498838 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-844e35f8-0db2-41d5-8521-708c4af1922e tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] Action: 'update', calling method: .version_select at 0x7fbb467b9040>, body: {"quota_set": {"ram": "5120"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:48.905577 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-844e35f8-0db2-41d5-8521-708c4af1922e tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:48.910062 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-844e35f8-0db2-41d5-8521-708c4af1922e tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:48.912061 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-844e35f8-0db2-41d5-8521-708c4af1922e tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:48.917132 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-844e35f8-0db2-41d5-8521-708c4af1922e tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:48.917892 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-844e35f8-0db2-41d5-8521-708c4af1922e tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:48.918532 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-844e35f8-0db2-41d5-8521-708c4af1922e tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:49.009060 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-844e35f8-0db2-41d5-8521-708c4af1922e tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/1f0fc1aa8d95470abf26fa575686fb98" status: 200 len: 328 microversion: 2.1 time: 0.517222 Aug 31 15:58:49.010951 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1205/2328] 10.222.0.50 () {60 vars in 1262 bytes} [Wed Aug 31 15:58:48 2022] PUT /compute/v2.1/os-quota-sets/1f0fc1aa8d95470abf26fa575686fb98 => generated 328 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:49.025322 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d8b9bd7e-22cf-4f35-bd23-9bd8f4fb9c7d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:49.031764 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d8b9bd7e-22cf-4f35-bd23-9bd8f4fb9c7d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:49.041956 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d8b9bd7e-22cf-4f35-bd23-9bd8f4fb9c7d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:49.042992 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d8b9bd7e-22cf-4f35-bd23-9bd8f4fb9c7d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:49.043652 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d8b9bd7e-22cf-4f35-bd23-9bd8f4fb9c7d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:49.044796 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d8b9bd7e-22cf-4f35-bd23-9bd8f4fb9c7d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:49.045683 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d8b9bd7e-22cf-4f35-bd23-9bd8f4fb9c7d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:49.046372 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d8b9bd7e-22cf-4f35-bd23-9bd8f4fb9c7d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:49.287608 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4760bcc3-eb7e-41b1-ae03-cfa270a194d1 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:49.327943 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4760bcc3-eb7e-41b1-ae03-cfa270a194d1 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/a4977edb-9ae0-48ee-887d-d19a5db58a43" status: 200 len: 1505 microversion: 2.1 time: 0.853050 Aug 31 15:58:49.328809 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1124/2329] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:48 2022] GET /compute/v2.1/servers/a4977edb-9ae0-48ee-887d-d19a5db58a43 => generated 1505 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:49.353002 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6b6988f0-d48e-456e-b582-c4deadf8059c tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] Calling method '.version_select at 0x7fbb464c23a0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:49.455576 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d8b9bd7e-22cf-4f35-bd23-9bd8f4fb9c7d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:49.468652 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d8b9bd7e-22cf-4f35-bd23-9bd8f4fb9c7d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:49.470305 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d8b9bd7e-22cf-4f35-bd23-9bd8f4fb9c7d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:49.471599 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d8b9bd7e-22cf-4f35-bd23-9bd8f4fb9c7d tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a" status: 200 len: 1731 microversion: 2.25 time: 0.459400 Aug 31 15:58:49.472373 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1206/2330] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:49 2022] GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a => generated 1731 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:49.489995 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7e4efb77-35ba-48f7-8772-0c86341b34f5 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:49.498666 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7e4efb77-35ba-48f7-8772-0c86341b34f5 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:49.513101 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7e4efb77-35ba-48f7-8772-0c86341b34f5 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:49.515084 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7e4efb77-35ba-48f7-8772-0c86341b34f5 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:49.516984 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7e4efb77-35ba-48f7-8772-0c86341b34f5 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:49.519712 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7e4efb77-35ba-48f7-8772-0c86341b34f5 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:49.523104 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7e4efb77-35ba-48f7-8772-0c86341b34f5 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:49.526269 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7e4efb77-35ba-48f7-8772-0c86341b34f5 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:49.535353 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b6988f0-d48e-456e-b582-c4deadf8059c tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:49.536611 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b6988f0-d48e-456e-b582-c4deadf8059c tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:49.537599 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b6988f0-d48e-456e-b582-c4deadf8059c tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:49.539268 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b6988f0-d48e-456e-b582-c4deadf8059c tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:49.540261 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b6988f0-d48e-456e-b582-c4deadf8059c tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:49.541108 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b6988f0-d48e-456e-b582-c4deadf8059c tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:49.579977 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6b6988f0-d48e-456e-b582-c4deadf8059c tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/1f0fc1aa8d95470abf26fa575686fb98/detail" status: 200 len: 916 microversion: 2.1 time: 0.237767 Aug 31 15:58:49.593824 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1125/2331] 10.222.0.50 () {58 vars in 1263 bytes} [Wed Aug 31 15:58:49 2022] GET /compute/v2.1/os-quota-sets/1f0fc1aa8d95470abf26fa575686fb98/detail => generated 916 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:49.601503 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6f8ed46b-33d7-4570-9166-9feb7716a5c0 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:49.602589 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6f8ed46b-33d7-4570-9166-9feb7716a5c0 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 320bf21c-eec1-43ea-a496-059fccc2642f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:49.609664 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6f8ed46b-33d7-4570-9166-9feb7716a5c0 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:49.610459 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6f8ed46b-33d7-4570-9166-9feb7716a5c0 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:49.611049 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6f8ed46b-33d7-4570-9166-9feb7716a5c0 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:49.612553 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6f8ed46b-33d7-4570-9166-9feb7716a5c0 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:49.613242 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6f8ed46b-33d7-4570-9166-9feb7716a5c0 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:49.614259 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6f8ed46b-33d7-4570-9166-9feb7716a5c0 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:49.810427 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7e4efb77-35ba-48f7-8772-0c86341b34f5 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:49.821342 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7e4efb77-35ba-48f7-8772-0c86341b34f5 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:49.828475 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6f8ed46b-33d7-4570-9166-9feb7716a5c0 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:49.844391 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7e4efb77-35ba-48f7-8772-0c86341b34f5 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:49.862225 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6f8ed46b-33d7-4570-9166-9feb7716a5c0 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f" status: 200 len: 1273 microversion: 2.1 time: 0.263890 Aug 31 15:58:49.867005 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1126/2332] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:49 2022] GET /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f => generated 1273 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:49.872368 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7e4efb77-35ba-48f7-8772-0c86341b34f5 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1553 microversion: 2.91 time: 0.396284 Aug 31 15:58:49.877949 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1207/2333] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:49 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1553 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:49.884211 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4a4b07c8-2c7f-48eb-bcc5-a85eb350e7f8 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:49.887801 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ff243fc6-ad8e-464c-a813-4ab9a9b84aa2 tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] Action: 'update', calling method: .version_select at 0x7fbb46acdca0>, body: {"quota_set": {"ram": "2048"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:49.891362 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4a4b07c8-2c7f-48eb-bcc5-a85eb350e7f8 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: 13cdbabc-03ef-4025-b984-4bba559857ae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:49.903328 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a4b07c8-2c7f-48eb-bcc5-a85eb350e7f8 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:49.916525 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a4b07c8-2c7f-48eb-bcc5-a85eb350e7f8 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:49.918645 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a4b07c8-2c7f-48eb-bcc5-a85eb350e7f8 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:49.922799 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a4b07c8-2c7f-48eb-bcc5-a85eb350e7f8 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:49.923529 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a4b07c8-2c7f-48eb-bcc5-a85eb350e7f8 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:49.926656 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a4b07c8-2c7f-48eb-bcc5-a85eb350e7f8 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:50.055212 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ff243fc6-ad8e-464c-a813-4ab9a9b84aa2 tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:50.057514 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ff243fc6-ad8e-464c-a813-4ab9a9b84aa2 tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:50.058471 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ff243fc6-ad8e-464c-a813-4ab9a9b84aa2 tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:50.059376 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ff243fc6-ad8e-464c-a813-4ab9a9b84aa2 tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:50.060158 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ff243fc6-ad8e-464c-a813-4ab9a9b84aa2 tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:50.063414 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ff243fc6-ad8e-464c-a813-4ab9a9b84aa2 tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:50.112112 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:58:50.179865 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ff243fc6-ad8e-464c-a813-4ab9a9b84aa2 tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:50.184658 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ff243fc6-ad8e-464c-a813-4ab9a9b84aa2 tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:50.185363 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ff243fc6-ad8e-464c-a813-4ab9a9b84aa2 tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:50.188265 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ff243fc6-ad8e-464c-a813-4ab9a9b84aa2 tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:50.188975 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ff243fc6-ad8e-464c-a813-4ab9a9b84aa2 tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:50.189752 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ff243fc6-ad8e-464c-a813-4ab9a9b84aa2 tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:50.293085 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4a4b07c8-2c7f-48eb-bcc5-a85eb350e7f8 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922a671cad44ea595e46290a5d52380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1371996a8304dc58ee579daa535bcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:50.306849 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4a4b07c8-2c7f-48eb-bcc5-a85eb350e7f8 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae" status: 200 len: 1499 microversion: 2.1 time: 0.437928 Aug 31 15:58:50.332252 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1127/2334] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:49 2022] GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae => generated 1499 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:50.341802 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d9a85d3a-ff26-4a3c-a0b7-98eb98df1fd1 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:50.343019 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ff243fc6-ad8e-464c-a813-4ab9a9b84aa2 tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/1f0fc1aa8d95470abf26fa575686fb98?user_id=b008bed59fd441efa593cc02e2156e01" status: 200 len: 328 microversion: 2.1 time: 0.461606 Aug 31 15:58:50.344173 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1208/2335] 10.222.0.50 () {60 vars in 1343 bytes} [Wed Aug 31 15:58:49 2022] PUT /compute/v2.1/os-quota-sets/1f0fc1aa8d95470abf26fa575686fb98?user_id=b008bed59fd441efa593cc02e2156e01 => generated 328 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:50.358426 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d9a85d3a-ff26-4a3c-a0b7-98eb98df1fd1 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: 13cdbabc-03ef-4025-b984-4bba559857ae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:50.359525 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-87669ec5-00f2-40db-87da-0098f3cd603f tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:50.360405 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-87669ec5-00f2-40db-87da-0098f3cd603f tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: a4977edb-9ae0-48ee-887d-d19a5db58a43] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:50.368134 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-87669ec5-00f2-40db-87da-0098f3cd603f tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:50.369149 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-87669ec5-00f2-40db-87da-0098f3cd603f tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:50.369870 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-87669ec5-00f2-40db-87da-0098f3cd603f tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:50.370826 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-87669ec5-00f2-40db-87da-0098f3cd603f tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:50.371675 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-87669ec5-00f2-40db-87da-0098f3cd603f tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:50.371851 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9a85d3a-ff26-4a3c-a0b7-98eb98df1fd1 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:50.372432 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-87669ec5-00f2-40db-87da-0098f3cd603f tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:50.372868 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9a85d3a-ff26-4a3c-a0b7-98eb98df1fd1 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:50.376549 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9a85d3a-ff26-4a3c-a0b7-98eb98df1fd1 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:50.377799 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9a85d3a-ff26-4a3c-a0b7-98eb98df1fd1 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:50.378445 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9a85d3a-ff26-4a3c-a0b7-98eb98df1fd1 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:50.378983 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9a85d3a-ff26-4a3c-a0b7-98eb98df1fd1 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:50.453632 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-d9a85d3a-ff26-4a3c-a0b7-98eb98df1fd1 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lazy-loading 'flavor' on Instance uuid 13cdbabc-03ef-4025-b984-4bba559857ae {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:58:50.601363 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:58:50.687323 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d9a85d3a-ff26-4a3c-a0b7-98eb98df1fd1 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "POST /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae/action" status: 200 len: 32 microversion: 2.1 time: 0.353215 Aug 31 15:58:50.696692 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1128/2336] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 15:58:50 2022] POST /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae/action => generated 32 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 15:58:50.705364 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0025abf5-b329-4db2-a0f7-013694ec1e04 tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] Calling method '.version_select at 0x7fbb4ab75ee0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:50.947227 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0025abf5-b329-4db2-a0f7-013694ec1e04 tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/1f0fc1aa8d95470abf26fa575686fb98?user_id=b008bed59fd441efa593cc02e2156e01" status: 200 len: 370 microversion: 2.1 time: 0.248574 Aug 31 15:58:50.950309 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1129/2337] 10.222.0.50 () {58 vars in 1323 bytes} [Wed Aug 31 15:58:50 2022] GET /compute/v2.1/os-quota-sets/1f0fc1aa8d95470abf26fa575686fb98?user_id=b008bed59fd441efa593cc02e2156e01 => generated 370 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:50.966533 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a154bdd3-b970-4f73-9825-937146bfc7c1 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:50.967923 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a154bdd3-b970-4f73-9825-937146bfc7c1 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:50.976995 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a154bdd3-b970-4f73-9825-937146bfc7c1 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:50.977933 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a154bdd3-b970-4f73-9825-937146bfc7c1 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:50.978922 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a154bdd3-b970-4f73-9825-937146bfc7c1 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:50.980149 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a154bdd3-b970-4f73-9825-937146bfc7c1 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:50.981037 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a154bdd3-b970-4f73-9825-937146bfc7c1 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:50.981817 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a154bdd3-b970-4f73-9825-937146bfc7c1 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:51.093933 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-87669ec5-00f2-40db-87da-0098f3cd603f tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:51.125794 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-87669ec5-00f2-40db-87da-0098f3cd603f tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/a4977edb-9ae0-48ee-887d-d19a5db58a43" status: 200 len: 1505 microversion: 2.1 time: 0.768320 Aug 31 15:58:51.126600 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1209/2338] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:50 2022] GET /compute/v2.1/servers/a4977edb-9ae0-48ee-887d-d19a5db58a43 => generated 1505 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:51.140855 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-529f7f3b-5452-4bce-9187-b86c011f95d5 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:51.141491 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-529f7f3b-5452-4bce-9187-b86c011f95d5 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: 13cdbabc-03ef-4025-b984-4bba559857ae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:51.170757 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-529f7f3b-5452-4bce-9187-b86c011f95d5 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:51.191145 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-529f7f3b-5452-4bce-9187-b86c011f95d5 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:51.191440 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-529f7f3b-5452-4bce-9187-b86c011f95d5 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:51.192209 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-529f7f3b-5452-4bce-9187-b86c011f95d5 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:51.192681 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-529f7f3b-5452-4bce-9187-b86c011f95d5 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:51.193102 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-529f7f3b-5452-4bce-9187-b86c011f95d5 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:51.259075 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a154bdd3-b970-4f73-9825-937146bfc7c1 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:51.273694 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a154bdd3-b970-4f73-9825-937146bfc7c1 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:51.276667 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a154bdd3-b970-4f73-9825-937146bfc7c1 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:51.279690 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a154bdd3-b970-4f73-9825-937146bfc7c1 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a" status: 200 len: 1663 microversion: 2.25 time: 0.327835 Aug 31 15:58:51.300059 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1130/2339] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:50 2022] GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a => generated 1663 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:51.312160 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cdebf86c-fc1c-40ad-963e-f861e522d78c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:51.314050 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cdebf86c-fc1c-40ad-963e-f861e522d78c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 320bf21c-eec1-43ea-a496-059fccc2642f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:51.322698 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cdebf86c-fc1c-40ad-963e-f861e522d78c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:51.323462 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cdebf86c-fc1c-40ad-963e-f861e522d78c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:51.324065 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cdebf86c-fc1c-40ad-963e-f861e522d78c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:51.325467 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cdebf86c-fc1c-40ad-963e-f861e522d78c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:51.333453 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cdebf86c-fc1c-40ad-963e-f861e522d78c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:51.335205 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cdebf86c-fc1c-40ad-963e-f861e522d78c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:51.527349 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cdebf86c-fc1c-40ad-963e-f861e522d78c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:51.550105 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cdebf86c-fc1c-40ad-963e-f861e522d78c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f" status: 200 len: 1273 microversion: 2.1 time: 0.245669 Aug 31 15:58:51.553054 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1131/2340] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:51 2022] GET /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f => generated 1273 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:51.573956 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c4211707-9aa4-464f-b043-6f736670720a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:51.577792 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c4211707-9aa4-464f-b043-6f736670720a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:51.609316 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4211707-9aa4-464f-b043-6f736670720a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:51.610063 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4211707-9aa4-464f-b043-6f736670720a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:51.612904 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4211707-9aa4-464f-b043-6f736670720a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:51.616230 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4211707-9aa4-464f-b043-6f736670720a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:51.621473 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4211707-9aa4-464f-b043-6f736670720a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:51.622086 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4211707-9aa4-464f-b043-6f736670720a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:51.742528 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-529f7f3b-5452-4bce-9187-b86c011f95d5 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922a671cad44ea595e46290a5d52380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1371996a8304dc58ee579daa535bcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:51.752441 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-529f7f3b-5452-4bce-9187-b86c011f95d5 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae" status: 200 len: 1505 microversion: 2.1 time: 0.624494 Aug 31 15:58:51.756191 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1210/2341] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:51 2022] GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae => generated 1505 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:51.767239 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-50ecad18-9f3e-4999-94e8-869e8d93e35f req-4e92f10d-3bf9-486e-af85-356e0bde9b51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a25dea8-1dc1-480e-a431-13d2f2270d0a", "name": "network-vif-deleted", "tag": "be9ab567-195e-4d60-b1e4-2ba6690fe483"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:51.818845 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-50ecad18-9f3e-4999-94e8-869e8d93e35f req-4e92f10d-3bf9-486e-af85-356e0bde9b51 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:51.819830 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-50ecad18-9f3e-4999-94e8-869e8d93e35f req-4e92f10d-3bf9-486e-af85-356e0bde9b51 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:51.820495 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-50ecad18-9f3e-4999-94e8-869e8d93e35f req-4e92f10d-3bf9-486e-af85-356e0bde9b51 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:51.845408 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c4211707-9aa4-464f-b043-6f736670720a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:51.846065 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-50ecad18-9f3e-4999-94e8-869e8d93e35f req-4e92f10d-3bf9-486e-af85-356e0bde9b51 service nova] Creating event network-vif-deleted:be9ab567-195e-4d60-b1e4-2ba6690fe483 for instance 8a25dea8-1dc1-480e-a431-13d2f2270d0a on n-h1-833090-16 Aug 31 15:58:51.864401 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c4211707-9aa4-464f-b043-6f736670720a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:51.865851 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c4211707-9aa4-464f-b043-6f736670720a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:51.866494 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-50ecad18-9f3e-4999-94e8-869e8d93e35f req-4e92f10d-3bf9-486e-af85-356e0bde9b51 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108749 Aug 31 15:58:51.871021 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1211/2342] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:58:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:51.876928 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0b848c65-c10a-4856-b6ac-20905a90ff23 tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] Calling method '.version_select at 0x7fbb468785e0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:51.891779 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c4211707-9aa4-464f-b043-6f736670720a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1553 microversion: 2.91 time: 0.333447 Aug 31 15:58:51.894766 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1132/2343] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:51 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1553 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:52.148011 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e60bdd31-8f9a-4aa0-83dd-e64adb071ab0 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:52.148636 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e60bdd31-8f9a-4aa0-83dd-e64adb071ab0 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: a4977edb-9ae0-48ee-887d-d19a5db58a43] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:52.171703 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e60bdd31-8f9a-4aa0-83dd-e64adb071ab0 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:52.173947 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e60bdd31-8f9a-4aa0-83dd-e64adb071ab0 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:52.174542 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e60bdd31-8f9a-4aa0-83dd-e64adb071ab0 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:52.180068 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e60bdd31-8f9a-4aa0-83dd-e64adb071ab0 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:52.182326 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e60bdd31-8f9a-4aa0-83dd-e64adb071ab0 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:52.184344 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e60bdd31-8f9a-4aa0-83dd-e64adb071ab0 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:52.465949 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0b848c65-c10a-4856-b6ac-20905a90ff23 tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/3eacc49906b84211b85bbe6baed447dd/defaults" status: 200 len: 371 microversion: 2.1 time: 0.592388 Aug 31 15:58:52.489327 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1212/2344] 10.222.0.50 () {58 vars in 1269 bytes} [Wed Aug 31 15:58:51 2022] GET /compute/v2.1/os-quota-sets/3eacc49906b84211b85bbe6baed447dd/defaults => generated 371 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:52.495239 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-277e537c-285b-4a05-9d7b-b290171b1e2a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:52.495239 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-277e537c-285b-4a05-9d7b-b290171b1e2a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 8a25dea8-1dc1-480e-a431-13d2f2270d0a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:52.520880 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-277e537c-285b-4a05-9d7b-b290171b1e2a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:52.531993 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-277e537c-285b-4a05-9d7b-b290171b1e2a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:52.532276 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-277e537c-285b-4a05-9d7b-b290171b1e2a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:52.534112 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-277e537c-285b-4a05-9d7b-b290171b1e2a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:52.534768 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-277e537c-285b-4a05-9d7b-b290171b1e2a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:52.535387 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-277e537c-285b-4a05-9d7b-b290171b1e2a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:52.555972 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-277e537c-285b-4a05-9d7b-b290171b1e2a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] HTTP exception thrown: Instance 8a25dea8-1dc1-480e-a431-13d2f2270d0a could not be found. Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-277e537c-285b-4a05-9d7b-b290171b1e2a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Request method failure captured: Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a HTTP/1.1 Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4NHqkgwYGUym-Rz8_ahU9_nePHkL-bhC3R98SNlnSzexlfj7kN8EdCPwINUFbsF5Jo9rHxGnnKW4mmnCLqko9cX9nysCtsANAulE1Ljdk3EUSlUSaH_x03Hi5zjOnc1qB5IhtdxpQiIoa_bQFbmxCt0BdSE44Ku0YpN9lafIO9AgqU Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: X-Openstack-Nova-Api-Version: 2.25 Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 86aafc129b8640d381f9bae1767fbc6c Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-181009754 Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/86aafc129b8640d381f9bae1767fbc6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/86aafc129b8640d381f9bae1767fbc6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/86aafc129b8640d381f9bae1767fbc6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_86aafc129b8640d381f9bae1767fbc6c", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-181009754 Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 86aafc129b8640d381f9bae1767fbc6c Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-181009754 Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-LiveAutoBlockMigrationV225Test-181009754-project Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 072bc5784d754815a511f6c3f4437f7c Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-181009754-project Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 8a25dea8-1dc1-480e-a431-13d2f2270d0a could not be found. Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '8a25dea8-1dc1-480e-a431-13d2f2270d0a'} Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a25dea8-1dc1-480e-a431-13d2f2270d0a could not be found. Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a25dea8-1dc1-480e-a431-13d2f2270d0a could not be found. Aug 31 15:58:52.564296 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:58:52.570396 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:58:52.570396 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:58:52.570396 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:58:52.570396 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:58:52.570396 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:58:52.570396 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:58:52.570396 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:58:52.570396 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a25dea8-1dc1-480e-a431-13d2f2270d0a could not be found. Aug 31 15:58:52.570396 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:58:52.570396 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-277e537c-285b-4a05-9d7b-b290171b1e2a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Returning 404 to user: Instance 8a25dea8-1dc1-480e-a431-13d2f2270d0a could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:58:52.571683 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-277e537c-285b-4a05-9d7b-b290171b1e2a tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a" status: 404 len: 111 microversion: 2.25 time: 0.084736 Aug 31 15:58:52.573635 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1213/2345] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:52 2022] GET /compute/v2.1/servers/8a25dea8-1dc1-480e-a431-13d2f2270d0a => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 15:58:52.586122 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-635d676b-fe6a-44dc-8f6b-ce14eb4a69de tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] Action: 'update', calling method: .version_select at 0x7fbb46864670>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:52.587009 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e60bdd31-8f9a-4aa0-83dd-e64adb071ab0 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:52.608581 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e60bdd31-8f9a-4aa0-83dd-e64adb071ab0 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/a4977edb-9ae0-48ee-887d-d19a5db58a43" status: 200 len: 1505 microversion: 2.1 time: 0.465222 Aug 31 15:58:52.609576 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1133/2346] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:52 2022] GET /compute/v2.1/servers/a4977edb-9ae0-48ee-887d-d19a5db58a43 => generated 1505 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:58:52.619444 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1ea7b796-2151-4df4-baac-86724bba8abe tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:52.620689 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1ea7b796-2151-4df4-baac-86724bba8abe tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 320bf21c-eec1-43ea-a496-059fccc2642f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:52.632798 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ea7b796-2151-4df4-baac-86724bba8abe tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:52.634928 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ea7b796-2151-4df4-baac-86724bba8abe tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:52.636936 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ea7b796-2151-4df4-baac-86724bba8abe tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:52.638479 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ea7b796-2151-4df4-baac-86724bba8abe tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:52.639279 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ea7b796-2151-4df4-baac-86724bba8abe tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:52.640362 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ea7b796-2151-4df4-baac-86724bba8abe tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:52.759390 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-635d676b-fe6a-44dc-8f6b-ce14eb4a69de tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:52.760182 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-635d676b-fe6a-44dc-8f6b-ce14eb4a69de tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:52.760733 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-635d676b-fe6a-44dc-8f6b-ce14eb4a69de tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:52.761846 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-635d676b-fe6a-44dc-8f6b-ce14eb4a69de tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:52.762653 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-635d676b-fe6a-44dc-8f6b-ce14eb4a69de tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:52.763149 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-635d676b-fe6a-44dc-8f6b-ce14eb4a69de tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:53.046332 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1ea7b796-2151-4df4-baac-86724bba8abe tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:53.089477 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1ea7b796-2151-4df4-baac-86724bba8abe tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f" status: 200 len: 1315 microversion: 2.1 time: 0.475421 Aug 31 15:58:53.091732 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1134/2347] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:52 2022] GET /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f => generated 1315 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:53.126652 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f3fbed54-a44c-4e93-80f9-5c1a3d8192d2 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '.version_select at 0x7fbb4aa5c9d0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:53.258490 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f3fbed54-a44c-4e93-80f9-5c1a3d8192d2 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2026544530" status: 204 len: 0 microversion: 2.25 time: 0.161499 Aug 31 15:58:53.264025 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1135/2348] 10.222.0.50 () {60 vars in 1262 bytes} [Wed Aug 31 15:58:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2026544530 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 15:58:53.284693 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3af49cc1-722b-45c6-ab03-6c2a9088900e tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:53.286531 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3af49cc1-722b-45c6-ab03-6c2a9088900e tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: 13cdbabc-03ef-4025-b984-4bba559857ae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:53.312771 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3af49cc1-722b-45c6-ab03-6c2a9088900e tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:53.317882 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3af49cc1-722b-45c6-ab03-6c2a9088900e tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:53.320089 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3af49cc1-722b-45c6-ab03-6c2a9088900e tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:53.323322 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3af49cc1-722b-45c6-ab03-6c2a9088900e tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:53.324873 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3af49cc1-722b-45c6-ab03-6c2a9088900e tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:53.325503 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3af49cc1-722b-45c6-ab03-6c2a9088900e tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:53.466522 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-635d676b-fe6a-44dc-8f6b-ce14eb4a69de tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/3eacc49906b84211b85bbe6baed447dd" status: 200 len: 329 microversion: 2.1 time: 0.890168 Aug 31 15:58:53.467627 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1214/2349] 10.222.0.50 () {60 vars in 1263 bytes} [Wed Aug 31 15:58:52 2022] PUT /compute/v2.1/os-quota-sets/3eacc49906b84211b85bbe6baed447dd => generated 329 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:53.500492 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f382ff75-e226-4137-88d9-6243b5cd7ad8 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:53.501480 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f382ff75-e226-4137-88d9-6243b5cd7ad8 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:53.509775 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f382ff75-e226-4137-88d9-6243b5cd7ad8 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:53.521861 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f382ff75-e226-4137-88d9-6243b5cd7ad8 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:53.522598 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f382ff75-e226-4137-88d9-6243b5cd7ad8 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:53.523611 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f382ff75-e226-4137-88d9-6243b5cd7ad8 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:53.524220 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f382ff75-e226-4137-88d9-6243b5cd7ad8 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:53.524810 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f382ff75-e226-4137-88d9-6243b5cd7ad8 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:53.807344 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f382ff75-e226-4137-88d9-6243b5cd7ad8 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:53.828157 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f382ff75-e226-4137-88d9-6243b5cd7ad8 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:53.841210 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f382ff75-e226-4137-88d9-6243b5cd7ad8 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:53.857452 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f382ff75-e226-4137-88d9-6243b5cd7ad8 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1553 microversion: 2.91 time: 0.380306 Aug 31 15:58:53.858814 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1215/2350] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:53 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1553 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:53.886841 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-7a56ac61-f7ff-43ff-8f00-69317e43b0f1 req-2013d274-a8b0-4ad6-a0fe-8cd0580fde2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4977edb-9ae0-48ee-887d-d19a5db58a43", "name": "network-vif-plugged", "status": "completed", "tag": "98738177-422e-4e04-85eb-a363f7670a8e"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:53.904694 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7a56ac61-f7ff-43ff-8f00-69317e43b0f1 req-2013d274-a8b0-4ad6-a0fe-8cd0580fde2b service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:53.914884 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7a56ac61-f7ff-43ff-8f00-69317e43b0f1 req-2013d274-a8b0-4ad6-a0fe-8cd0580fde2b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:53.915561 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7a56ac61-f7ff-43ff-8f00-69317e43b0f1 req-2013d274-a8b0-4ad6-a0fe-8cd0580fde2b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:53.944302 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-7a56ac61-f7ff-43ff-8f00-69317e43b0f1 req-2013d274-a8b0-4ad6-a0fe-8cd0580fde2b service nova] Creating event network-vif-plugged:98738177-422e-4e04-85eb-a363f7670a8e for instance a4977edb-9ae0-48ee-887d-d19a5db58a43 on n-h2-833090-16 Aug 31 15:58:53.957551 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-7a56ac61-f7ff-43ff-8f00-69317e43b0f1 req-2013d274-a8b0-4ad6-a0fe-8cd0580fde2b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083099 Aug 31 15:58:53.959065 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1216/2351] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:53.974995 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6adf7898-e74d-48db-baa2-5812c495be22 tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] Action: 'update', calling method: .version_select at 0x7fbb46864430>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:54.245685 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6adf7898-e74d-48db-baa2-5812c495be22 tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:54.247517 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6adf7898-e74d-48db-baa2-5812c495be22 tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:54.248294 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6adf7898-e74d-48db-baa2-5812c495be22 tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:54.249024 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6adf7898-e74d-48db-baa2-5812c495be22 tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:54.252455 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6adf7898-e74d-48db-baa2-5812c495be22 tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:54.255731 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6adf7898-e74d-48db-baa2-5812c495be22 tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:54.328975 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3af49cc1-722b-45c6-ab03-6c2a9088900e tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922a671cad44ea595e46290a5d52380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1371996a8304dc58ee579daa535bcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:54.344619 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3af49cc1-722b-45c6-ab03-6c2a9088900e tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae" status: 200 len: 1505 microversion: 2.1 time: 1.076273 Aug 31 15:58:54.345604 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1136/2352] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:53 2022] GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae => generated 1505 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:54.351617 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b7c72d09-6ce7-48d0-91ef-95f6520c41a5 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:54.365326 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b7c72d09-6ce7-48d0-91ef-95f6520c41a5 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: a4977edb-9ae0-48ee-887d-d19a5db58a43] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:54.381498 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7c72d09-6ce7-48d0-91ef-95f6520c41a5 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:54.382233 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7c72d09-6ce7-48d0-91ef-95f6520c41a5 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:54.382877 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7c72d09-6ce7-48d0-91ef-95f6520c41a5 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:54.385761 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7c72d09-6ce7-48d0-91ef-95f6520c41a5 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:54.387048 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7c72d09-6ce7-48d0-91ef-95f6520c41a5 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:54.388200 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7c72d09-6ce7-48d0-91ef-95f6520c41a5 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:54.619252 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=19,nova_api:UPDATE=4 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:58:55.160199 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6adf7898-e74d-48db-baa2-5812c495be22 tempest-QuotasAdminTestJSON-1211650293 tempest-QuotasAdminTestJSON-1211650293-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/3eacc49906b84211b85bbe6baed447dd" status: 200 len: 329 microversion: 2.1 time: 1.199178 Aug 31 15:58:55.160814 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1217/2353] 10.222.0.50 () {60 vars in 1263 bytes} [Wed Aug 31 15:58:53 2022] PUT /compute/v2.1/os-quota-sets/3eacc49906b84211b85bbe6baed447dd => generated 329 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:55.188032 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fec1e873-8bf3-4d24-80ee-1837bdf0b2a3 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:55.191195 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fec1e873-8bf3-4d24-80ee-1837bdf0b2a3 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 320bf21c-eec1-43ea-a496-059fccc2642f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:55.206458 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fec1e873-8bf3-4d24-80ee-1837bdf0b2a3 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:55.211219 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fec1e873-8bf3-4d24-80ee-1837bdf0b2a3 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:55.211717 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fec1e873-8bf3-4d24-80ee-1837bdf0b2a3 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:55.212468 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fec1e873-8bf3-4d24-80ee-1837bdf0b2a3 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:55.214353 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fec1e873-8bf3-4d24-80ee-1837bdf0b2a3 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:55.214789 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fec1e873-8bf3-4d24-80ee-1837bdf0b2a3 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:56.724340 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b7c72d09-6ce7-48d0-91ef-95f6520c41a5 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:56.742397 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b7c72d09-6ce7-48d0-91ef-95f6520c41a5 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/a4977edb-9ae0-48ee-887d-d19a5db58a43" status: 200 len: 1500 microversion: 2.1 time: 2.392422 Aug 31 15:58:56.743057 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1137/2354] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:54 2022] GET /compute/v2.1/servers/a4977edb-9ae0-48ee-887d-d19a5db58a43 => generated 1500 bytes in 2396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:56.777659 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d2c6272b-66fc-421f-bcaa-b653d795ca88 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:56.778455 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d2c6272b-66fc-421f-bcaa-b653d795ca88 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:56.794035 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2c6272b-66fc-421f-bcaa-b653d795ca88 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:56.796068 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2c6272b-66fc-421f-bcaa-b653d795ca88 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:56.796520 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2c6272b-66fc-421f-bcaa-b653d795ca88 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:56.797257 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2c6272b-66fc-421f-bcaa-b653d795ca88 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:56.797718 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2c6272b-66fc-421f-bcaa-b653d795ca88 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:56.798164 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2c6272b-66fc-421f-bcaa-b653d795ca88 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:57.114737 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d2c6272b-66fc-421f-bcaa-b653d795ca88 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:57.129820 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d2c6272b-66fc-421f-bcaa-b653d795ca88 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:57.131809 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d2c6272b-66fc-421f-bcaa-b653d795ca88 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:57.143653 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d2c6272b-66fc-421f-bcaa-b653d795ca88 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1553 microversion: 2.91 time: 0.397115 Aug 31 15:58:57.162628 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1138/2355] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:56 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1553 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:57.181494 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6ae6e2bf-df27-495e-ac39-0e7e5b18d225 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:57.182150 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6ae6e2bf-df27-495e-ac39-0e7e5b18d225 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: 13cdbabc-03ef-4025-b984-4bba559857ae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:57.198403 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ae6e2bf-df27-495e-ac39-0e7e5b18d225 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:57.199247 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ae6e2bf-df27-495e-ac39-0e7e5b18d225 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:57.199687 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ae6e2bf-df27-495e-ac39-0e7e5b18d225 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:57.201919 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ae6e2bf-df27-495e-ac39-0e7e5b18d225 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:57.203384 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ae6e2bf-df27-495e-ac39-0e7e5b18d225 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:57.204418 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ae6e2bf-df27-495e-ac39-0e7e5b18d225 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:57.373846 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-fec1e873-8bf3-4d24-80ee-1837bdf0b2a3 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:57.383749 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fec1e873-8bf3-4d24-80ee-1837bdf0b2a3 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f" status: 200 len: 1315 microversion: 2.1 time: 2.218445 Aug 31 15:58:57.386858 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1218/2356] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:55 2022] GET /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f => generated 1315 bytes in 2223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:57.625465 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-17fa8ecc-e2ad-431c-93cd-9ec165d2e976 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:57.626934 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-17fa8ecc-e2ad-431c-93cd-9ec165d2e976 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:57.653290 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-17fa8ecc-e2ad-431c-93cd-9ec165d2e976 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:57.653794 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-17fa8ecc-e2ad-431c-93cd-9ec165d2e976 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:57.657914 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-17fa8ecc-e2ad-431c-93cd-9ec165d2e976 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:57.658716 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-17fa8ecc-e2ad-431c-93cd-9ec165d2e976 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:57.662398 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-17fa8ecc-e2ad-431c-93cd-9ec165d2e976 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:57.663075 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-17fa8ecc-e2ad-431c-93cd-9ec165d2e976 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:57.739791 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-17fa8ecc-e2ad-431c-93cd-9ec165d2e976 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:58:57.844057 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:58:58.035272 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-17fa8ecc-e2ad-431c-93cd-9ec165d2e976 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "DELETE /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035" status: 204 len: 0 microversion: 2.25 time: 0.416909 Aug 31 15:58:58.050589 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1219/2357] 10.222.0.50 () {60 vars in 1280 bytes} [Wed Aug 31 15:58:57 2022] DELETE /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 31 15:58:58.056172 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-bf38ecaa-b3b8-4df4-ae1d-d84be854a0ee tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:58.056944 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-bf38ecaa-b3b8-4df4-ae1d-d84be854a0ee tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: a4977edb-9ae0-48ee-887d-d19a5db58a43] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:58.084547 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bf38ecaa-b3b8-4df4-ae1d-d84be854a0ee tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:58.087756 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bf38ecaa-b3b8-4df4-ae1d-d84be854a0ee tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:58.088375 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bf38ecaa-b3b8-4df4-ae1d-d84be854a0ee tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:58.090629 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bf38ecaa-b3b8-4df4-ae1d-d84be854a0ee tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:58.101527 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bf38ecaa-b3b8-4df4-ae1d-d84be854a0ee tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:58.104045 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bf38ecaa-b3b8-4df4-ae1d-d84be854a0ee tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:58.611400 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6ae6e2bf-df27-495e-ac39-0e7e5b18d225 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922a671cad44ea595e46290a5d52380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1371996a8304dc58ee579daa535bcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:58.625902 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6ae6e2bf-df27-495e-ac39-0e7e5b18d225 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae" status: 200 len: 1505 microversion: 2.1 time: 1.457282 Aug 31 15:58:58.628427 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1139/2358] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:57 2022] GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae => generated 1505 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:58.644705 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-045c4cfe-1836-47ca-b525-b0ddd3c22af1 req-57deb980-b1e7-4403-aa11-4af159f81f86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "320bf21c-eec1-43ea-a496-059fccc2642f", "tag": "af138e0c-ab28-4a83-bf6a-2359074606bb"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:58.686991 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-045c4cfe-1836-47ca-b525-b0ddd3c22af1 req-57deb980-b1e7-4403-aa11-4af159f81f86 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:58.688642 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-045c4cfe-1836-47ca-b525-b0ddd3c22af1 req-57deb980-b1e7-4403-aa11-4af159f81f86 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:58.689305 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-045c4cfe-1836-47ca-b525-b0ddd3c22af1 req-57deb980-b1e7-4403-aa11-4af159f81f86 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:58.746844 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-045c4cfe-1836-47ca-b525-b0ddd3c22af1 req-57deb980-b1e7-4403-aa11-4af159f81f86 service nova] Creating event network-changed:af138e0c-ab28-4a83-bf6a-2359074606bb for instance 320bf21c-eec1-43ea-a496-059fccc2642f on n-h1-833090-16 Aug 31 15:58:58.762700 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-045c4cfe-1836-47ca-b525-b0ddd3c22af1 req-57deb980-b1e7-4403-aa11-4af159f81f86 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132402 Aug 31 15:58:58.763980 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1140/2359] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:58.780795 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a100d122-5ed0-4f14-9ec5-acd3c899ce41 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:58.782002 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a100d122-5ed0-4f14-9ec5-acd3c899ce41 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:58.806032 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a100d122-5ed0-4f14-9ec5-acd3c899ce41 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:58.806741 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a100d122-5ed0-4f14-9ec5-acd3c899ce41 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:58.809773 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a100d122-5ed0-4f14-9ec5-acd3c899ce41 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:58.814507 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a100d122-5ed0-4f14-9ec5-acd3c899ce41 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:58.815823 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a100d122-5ed0-4f14-9ec5-acd3c899ce41 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:58.818346 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a100d122-5ed0-4f14-9ec5-acd3c899ce41 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:59.180210 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a100d122-5ed0-4f14-9ec5-acd3c899ce41 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:59.190499 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a100d122-5ed0-4f14-9ec5-acd3c899ce41 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:59.193678 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a100d122-5ed0-4f14-9ec5-acd3c899ce41 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:59.195177 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a100d122-5ed0-4f14-9ec5-acd3c899ce41 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035" status: 200 len: 1547 microversion: 2.25 time: 0.429928 Aug 31 15:58:59.203906 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1141/2360] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:58 2022] GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035 => generated 1547 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:59.221307 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a4facca8-0a37-4ebd-9519-053c07e40058 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:59.223553 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a4facca8-0a37-4ebd-9519-053c07e40058 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:59.237892 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4facca8-0a37-4ebd-9519-053c07e40058 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:59.239142 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4facca8-0a37-4ebd-9519-053c07e40058 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:59.239974 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4facca8-0a37-4ebd-9519-053c07e40058 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:59.241210 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4facca8-0a37-4ebd-9519-053c07e40058 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:59.243870 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4facca8-0a37-4ebd-9519-053c07e40058 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:59.244699 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4facca8-0a37-4ebd-9519-053c07e40058 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:59.563451 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:58:59.697145 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a4facca8-0a37-4ebd-9519-053c07e40058 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:59.714690 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a4facca8-0a37-4ebd-9519-053c07e40058 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:59.719802 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a4facca8-0a37-4ebd-9519-053c07e40058 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:59.736917 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a4facca8-0a37-4ebd-9519-053c07e40058 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1553 microversion: 2.91 time: 0.531464 Aug 31 15:58:59.742796 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1142/2361] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:58:59 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1553 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:58:59.761079 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3b7ed6ae-f1a8-48e0-ad5a-bb4dde5735e7 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:59.763600 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3b7ed6ae-f1a8-48e0-ad5a-bb4dde5735e7 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 320bf21c-eec1-43ea-a496-059fccc2642f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:58:59.800215 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b7ed6ae-f1a8-48e0-ad5a-bb4dde5735e7 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:59.801354 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b7ed6ae-f1a8-48e0-ad5a-bb4dde5735e7 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:59.803996 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b7ed6ae-f1a8-48e0-ad5a-bb4dde5735e7 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:59.805124 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b7ed6ae-f1a8-48e0-ad5a-bb4dde5735e7 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:59.819544 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-bf38ecaa-b3b8-4df4-ae1d-d84be854a0ee tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:58:59.830239 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b7ed6ae-f1a8-48e0-ad5a-bb4dde5735e7 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:59.832651 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b7ed6ae-f1a8-48e0-ad5a-bb4dde5735e7 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:59.845575 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-bf38ecaa-b3b8-4df4-ae1d-d84be854a0ee tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/a4977edb-9ae0-48ee-887d-d19a5db58a43" status: 200 len: 1487 microversion: 2.1 time: 1.791842 Aug 31 15:58:59.846961 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1220/2362] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:58 2022] GET /compute/v2.1/servers/a4977edb-9ae0-48ee-887d-d19a5db58a43 => generated 1487 bytes in 1796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:58:59.871044 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-6c8227fd-23d2-4c69-82f7-dc230e01f934 req-38f775f3-cbf7-4dc4-aac0-8e6416e29bf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4977edb-9ae0-48ee-887d-d19a5db58a43", "name": "network-vif-unplugged", "status": "completed", "tag": "98738177-422e-4e04-85eb-a363f7670a8e"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:58:59.902280 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-6c8227fd-23d2-4c69-82f7-dc230e01f934 req-38f775f3-cbf7-4dc4-aac0-8e6416e29bf7 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:58:59.908755 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-6c8227fd-23d2-4c69-82f7-dc230e01f934 req-38f775f3-cbf7-4dc4-aac0-8e6416e29bf7 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:58:59.911835 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-6c8227fd-23d2-4c69-82f7-dc230e01f934 req-38f775f3-cbf7-4dc4-aac0-8e6416e29bf7 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:58:59.947480 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-6c8227fd-23d2-4c69-82f7-dc230e01f934 req-38f775f3-cbf7-4dc4-aac0-8e6416e29bf7 service nova] Creating event network-vif-unplugged:98738177-422e-4e04-85eb-a363f7670a8e for instance a4977edb-9ae0-48ee-887d-d19a5db58a43 on n-h2-833090-16 Aug 31 15:58:59.962189 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-6c8227fd-23d2-4c69-82f7-dc230e01f934 req-38f775f3-cbf7-4dc4-aac0-8e6416e29bf7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106830 Aug 31 15:58:59.963532 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1221/2363] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:58:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:58:59.984416 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-26126239-9da7-4d52-a654-9f1550fb32d0 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:58:59.987880 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-26126239-9da7-4d52-a654-9f1550fb32d0 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: 13cdbabc-03ef-4025-b984-4bba559857ae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:00.007273 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26126239-9da7-4d52-a654-9f1550fb32d0 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:00.008195 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26126239-9da7-4d52-a654-9f1550fb32d0 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:00.008966 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26126239-9da7-4d52-a654-9f1550fb32d0 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:00.011471 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26126239-9da7-4d52-a654-9f1550fb32d0 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:00.012551 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26126239-9da7-4d52-a654-9f1550fb32d0 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:00.014457 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26126239-9da7-4d52-a654-9f1550fb32d0 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:00.319898 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3b7ed6ae-f1a8-48e0-ad5a-bb4dde5735e7 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:00.339468 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3b7ed6ae-f1a8-48e0-ad5a-bb4dde5735e7 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f" status: 200 len: 1315 microversion: 2.1 time: 0.592314 Aug 31 15:59:00.341870 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1143/2364] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:59 2022] GET /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f => generated 1315 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:00.369239 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cf68408f-0fd0-46be-9225-3d7f7c2ade24 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:00.371747 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cf68408f-0fd0-46be-9225-3d7f7c2ade24 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: a4977edb-9ae0-48ee-887d-d19a5db58a43] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:00.391509 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf68408f-0fd0-46be-9225-3d7f7c2ade24 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:00.392312 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf68408f-0fd0-46be-9225-3d7f7c2ade24 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:00.392984 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf68408f-0fd0-46be-9225-3d7f7c2ade24 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:00.395255 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf68408f-0fd0-46be-9225-3d7f7c2ade24 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:00.395998 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf68408f-0fd0-46be-9225-3d7f7c2ade24 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:00.396672 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf68408f-0fd0-46be-9225-3d7f7c2ade24 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:00.433239 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cf68408f-0fd0-46be-9225-3d7f7c2ade24 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: a4977edb-9ae0-48ee-887d-d19a5db58a43] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:59:00.569643 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cf68408f-0fd0-46be-9225-3d7f7c2ade24 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a4977edb-9ae0-48ee-887d-d19a5db58a43" status: 204 len: 0 microversion: 2.1 time: 0.224288 Aug 31 15:59:00.572063 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1144/2365] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:59:00 2022] DELETE /compute/v2.1/servers/a4977edb-9ae0-48ee-887d-d19a5db58a43 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:59:00.592247 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d63e3b31-5a00-4aaa-aa79-7fdf7a60433b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:00.594788 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d63e3b31-5a00-4aaa-aa79-7fdf7a60433b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:00.612759 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d63e3b31-5a00-4aaa-aa79-7fdf7a60433b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:00.615326 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d63e3b31-5a00-4aaa-aa79-7fdf7a60433b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:00.617272 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d63e3b31-5a00-4aaa-aa79-7fdf7a60433b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:00.618589 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d63e3b31-5a00-4aaa-aa79-7fdf7a60433b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:00.620228 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d63e3b31-5a00-4aaa-aa79-7fdf7a60433b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:00.624030 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d63e3b31-5a00-4aaa-aa79-7fdf7a60433b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:00.879822 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-26126239-9da7-4d52-a654-9f1550fb32d0 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922a671cad44ea595e46290a5d52380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1371996a8304dc58ee579daa535bcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:00.894830 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=16 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:59:00.902941 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-26126239-9da7-4d52-a654-9f1550fb32d0 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae" status: 200 len: 1505 microversion: 2.1 time: 0.929872 Aug 31 15:59:00.913814 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1222/2366] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:58:59 2022] GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae => generated 1505 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:00.919415 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-115e3ea3-b891-44dd-a61a-0a27d2e1f673 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb467a6670>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:00.971433 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-115e3ea3-b891-44dd-a61a-0a27d2e1f673 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] HTTP exception thrown: Image not found. Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-115e3ea3-b891-44dd-a61a-0a27d2e1f673 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Request method failure captured: Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: request: DELETE /compute/v2.1/images/d66293d2-cbc4-4ccf-ac36-12e31a418564 HTTP/1.1 Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4RCKsQiaZtbjrQJmd2Omjl_oKAmhft4D7jlzDIoeb03U1ZQC3H31yVwWa3WjVw5pgChsVO4acIHjtkGbbISXlxQMrYifNC9zQ3UBQ638xuVfQg3UB8C-mMDDctLeTsW0UlxlkPW1bUS7dAwoxIzX4-zocS5PRKR97axAhcoV_2u0I8 Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: c508a07ab50746468f855f7c5893ffdc Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ImagesTestJSON-145941755 Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c508a07ab50746468f855f7c5893ffdc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c508a07ab50746468f855f7c5893ffdc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c508a07ab50746468f855f7c5893ffdc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c508a07ab50746468f855f7c5893ffdc", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ImagesTestJSON-145941755 Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: c508a07ab50746468f855f7c5893ffdc Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ImagesTestJSON-145941755 Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ImagesTestJSON-145941755-project Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 7d84a1872d9442b2886a8060d2e59580 Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ImagesTestJSON-145941755-project Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: method: Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: exception: Image not found. Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'd66293d2-cbc4-4ccf-ac36-12e31a418564'} Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image d66293d2-cbc4-4ccf-ac36-12e31a418564 to delete Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d66293d2-cbc4-4ccf-ac36-12e31a418564 could not be found. Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:00.973989 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:00.978183 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:00.978183 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:00.978183 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:59:00.978183 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:59:00.978183 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:59:00.978183 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:59:00.978183 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:59:00.978183 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:59:00.978183 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 31 15:59:00.978183 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 31 15:59:00.978183 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 31 15:59:00.978183 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:00.978183 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:00.978183 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:00.978183 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:00.978183 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:00.978183 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:00.978183 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:59:00.978183 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:59:00.978183 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 31 15:59:00.978183 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:00.978183 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-115e3ea3-b891-44dd-a61a-0a27d2e1f673 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Returning 404 to user: Image not found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:59:00.978183 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-115e3ea3-b891-44dd-a61a-0a27d2e1f673 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "DELETE /compute/v2.1/images/d66293d2-cbc4-4ccf-ac36-12e31a418564" status: 404 len: 62 microversion: 2.1 time: 0.060519 Aug 31 15:59:00.978183 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1223/2367] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:00 2022] DELETE /compute/v2.1/images/d66293d2-cbc4-4ccf-ac36-12e31a418564 => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 15:59:00.987025 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a61ebaae-7aa5-43d0-ae86-064e0f792520 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:00.990320 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a61ebaae-7aa5-43d0-ae86-064e0f792520 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:01.010194 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a61ebaae-7aa5-43d0-ae86-064e0f792520 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:01.010751 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a61ebaae-7aa5-43d0-ae86-064e0f792520 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:01.011195 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a61ebaae-7aa5-43d0-ae86-064e0f792520 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:01.011919 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a61ebaae-7aa5-43d0-ae86-064e0f792520 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:01.012375 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a61ebaae-7aa5-43d0-ae86-064e0f792520 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:01.012883 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a61ebaae-7aa5-43d0-ae86-064e0f792520 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:01.152638 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a61ebaae-7aa5-43d0-ae86-064e0f792520 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:01.163671 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a61ebaae-7aa5-43d0-ae86-064e0f792520 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:01.164907 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a61ebaae-7aa5-43d0-ae86-064e0f792520 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:01.186641 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a61ebaae-7aa5-43d0-ae86-064e0f792520 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1553 microversion: 2.91 time: 0.208321 Aug 31 15:59:01.188146 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1224/2368] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:00 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1553 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:01.195011 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7c9b5031-51bb-40c9-a699-44435205d4d9 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:01.195518 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7c9b5031-51bb-40c9-a699-44435205d4d9 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: a4977edb-9ae0-48ee-887d-d19a5db58a43] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:01.215802 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7c9b5031-51bb-40c9-a699-44435205d4d9 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:01.216298 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7c9b5031-51bb-40c9-a699-44435205d4d9 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:01.216731 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7c9b5031-51bb-40c9-a699-44435205d4d9 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:01.217557 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7c9b5031-51bb-40c9-a699-44435205d4d9 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:01.217876 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7c9b5031-51bb-40c9-a699-44435205d4d9 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:01.218324 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7c9b5031-51bb-40c9-a699-44435205d4d9 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:01.252261 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d63e3b31-5a00-4aaa-aa79-7fdf7a60433b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:01.259084 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:59:01.264895 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d63e3b31-5a00-4aaa-aa79-7fdf7a60433b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:01.275666 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d63e3b31-5a00-4aaa-aa79-7fdf7a60433b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:01.283063 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d63e3b31-5a00-4aaa-aa79-7fdf7a60433b tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035" status: 200 len: 1547 microversion: 2.25 time: 0.698457 Aug 31 15:59:01.302431 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1145/2369] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:00 2022] GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035 => generated 1547 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:01.337066 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7c9b5031-51bb-40c9-a699-44435205d4d9 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: a4977edb-9ae0-48ee-887d-d19a5db58a43] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:59:01.361676 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-272e80f7-da06-4928-8752-5f8be40d615c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:01.362652 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-272e80f7-da06-4928-8752-5f8be40d615c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 320bf21c-eec1-43ea-a496-059fccc2642f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:01.394822 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-272e80f7-da06-4928-8752-5f8be40d615c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:01.399152 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-272e80f7-da06-4928-8752-5f8be40d615c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:01.399333 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-272e80f7-da06-4928-8752-5f8be40d615c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:01.400237 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-272e80f7-da06-4928-8752-5f8be40d615c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:01.400822 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-272e80f7-da06-4928-8752-5f8be40d615c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:01.402870 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-272e80f7-da06-4928-8752-5f8be40d615c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:01.520590 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.compute.api [None req-7c9b5031-51bb-40c9-a699-44435205d4d9 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: a4977edb-9ae0-48ee-887d-d19a5db58a43] Instance is already in deleting state, ignoring this request Aug 31 15:59:01.521996 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7c9b5031-51bb-40c9-a699-44435205d4d9 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a4977edb-9ae0-48ee-887d-d19a5db58a43" status: 204 len: 0 microversion: 2.1 time: 0.332887 Aug 31 15:59:01.523055 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1225/2370] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:59:01 2022] DELETE /compute/v2.1/servers/a4977edb-9ae0-48ee-887d-d19a5db58a43 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:59:01.533364 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e2f18957-49bd-45b9-bafc-a8f5963cfe70 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:01.538722 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e2f18957-49bd-45b9-bafc-a8f5963cfe70 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: a4977edb-9ae0-48ee-887d-d19a5db58a43] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:01.552996 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e2f18957-49bd-45b9-bafc-a8f5963cfe70 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:01.554382 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e2f18957-49bd-45b9-bafc-a8f5963cfe70 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:01.555022 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e2f18957-49bd-45b9-bafc-a8f5963cfe70 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:01.557117 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e2f18957-49bd-45b9-bafc-a8f5963cfe70 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:01.557981 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e2f18957-49bd-45b9-bafc-a8f5963cfe70 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:01.559261 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e2f18957-49bd-45b9-bafc-a8f5963cfe70 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:02.312168 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-272e80f7-da06-4928-8752-5f8be40d615c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:02.325404 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-272e80f7-da06-4928-8752-5f8be40d615c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f" status: 200 len: 1315 microversion: 2.1 time: 0.968387 Aug 31 15:59:02.332691 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1146/2371] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:01 2022] GET /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f => generated 1315 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:59:02.357262 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2acbd429-fb80-449a-91a4-f3f812939507 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:02.367153 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2acbd429-fb80-449a-91a4-f3f812939507 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: 13cdbabc-03ef-4025-b984-4bba559857ae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:02.385913 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2acbd429-fb80-449a-91a4-f3f812939507 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:02.386414 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2acbd429-fb80-449a-91a4-f3f812939507 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:02.391977 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2acbd429-fb80-449a-91a4-f3f812939507 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:02.393126 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2acbd429-fb80-449a-91a4-f3f812939507 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:02.393925 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2acbd429-fb80-449a-91a4-f3f812939507 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:02.398637 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2acbd429-fb80-449a-91a4-f3f812939507 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:02.480144 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e2f18957-49bd-45b9-bafc-a8f5963cfe70 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:02.493265 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e2f18957-49bd-45b9-bafc-a8f5963cfe70 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/a4977edb-9ae0-48ee-887d-d19a5db58a43" status: 200 len: 1493 microversion: 2.1 time: 0.964998 Aug 31 15:59:02.494964 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1226/2372] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:01 2022] GET /compute/v2.1/servers/a4977edb-9ae0-48ee-887d-d19a5db58a43 => generated 1493 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:02.503570 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b8ed2fce-e5ca-4f42-a32e-8e3506d05fc7 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:02.504444 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b8ed2fce-e5ca-4f42-a32e-8e3506d05fc7 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:02.513260 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b8ed2fce-e5ca-4f42-a32e-8e3506d05fc7 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:02.514133 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b8ed2fce-e5ca-4f42-a32e-8e3506d05fc7 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:02.514746 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b8ed2fce-e5ca-4f42-a32e-8e3506d05fc7 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:02.515798 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b8ed2fce-e5ca-4f42-a32e-8e3506d05fc7 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:02.516417 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b8ed2fce-e5ca-4f42-a32e-8e3506d05fc7 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:02.516999 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b8ed2fce-e5ca-4f42-a32e-8e3506d05fc7 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:03.380562 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b8ed2fce-e5ca-4f42-a32e-8e3506d05fc7 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:03.389432 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b8ed2fce-e5ca-4f42-a32e-8e3506d05fc7 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:03.396200 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b8ed2fce-e5ca-4f42-a32e-8e3506d05fc7 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:03.414919 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b8ed2fce-e5ca-4f42-a32e-8e3506d05fc7 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1553 microversion: 2.91 time: 0.913965 Aug 31 15:59:03.415790 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1227/2373] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:02 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1553 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:03.428988 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1c1d0494-383a-43ae-bfda-9fbcc605479e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:03.429888 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1c1d0494-383a-43ae-bfda-9fbcc605479e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:03.444242 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1c1d0494-383a-43ae-bfda-9fbcc605479e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:03.445166 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1c1d0494-383a-43ae-bfda-9fbcc605479e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:03.445820 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1c1d0494-383a-43ae-bfda-9fbcc605479e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:03.446775 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1c1d0494-383a-43ae-bfda-9fbcc605479e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:03.450167 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1c1d0494-383a-43ae-bfda-9fbcc605479e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:03.450858 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1c1d0494-383a-43ae-bfda-9fbcc605479e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:03.490467 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-1c1d0494-383a-43ae-bfda-9fbcc605479e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] HTTP exception thrown: Instance 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035 could not be found. Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1c1d0494-383a-43ae-bfda-9fbcc605479e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Request method failure captured: Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035 HTTP/1.1 Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4NHqkgwYGUym-Rz8_ahU9_nePHkL-bhC3R98SNlnSzexlfj7kN8EdCPwINUFbsF5Jo9rHxGnnKW4mmnCLqko9cX9nysCtsANAulE1Ljdk3EUSlUSaH_x03Hi5zjOnc1qB5IhtdxpQiIoa_bQFbmxCt0BdSE44Ku0YpN9lafIO9AgqU Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: X-Openstack-Nova-Api-Version: 2.25 Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 86aafc129b8640d381f9bae1767fbc6c Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-181009754 Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/86aafc129b8640d381f9bae1767fbc6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/86aafc129b8640d381f9bae1767fbc6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/86aafc129b8640d381f9bae1767fbc6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_86aafc129b8640d381f9bae1767fbc6c", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-181009754 Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 86aafc129b8640d381f9bae1767fbc6c Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-181009754 Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-LiveAutoBlockMigrationV225Test-181009754-project Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 072bc5784d754815a511f6c3f4437f7c Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-181009754-project Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035 could not be found. Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '6ccef73e-5e82-42e7-a2cb-ef2e49f3a035'} Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035 could not be found. Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035 could not be found. Aug 31 15:59:03.504673 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:03.512644 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:03.512644 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:03.512644 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:03.512644 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:03.512644 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:03.512644 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:59:03.512644 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:59:03.512644 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035 could not be found. Aug 31 15:59:03.512644 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:03.515644 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1c1d0494-383a-43ae-bfda-9fbcc605479e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Returning 404 to user: Instance 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:59:03.517519 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1c1d0494-383a-43ae-bfda-9fbcc605479e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035" status: 404 len: 111 microversion: 2.25 time: 0.099995 Aug 31 15:59:03.536350 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1228/2374] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:03 2022] GET /compute/v2.1/servers/6ccef73e-5e82-42e7-a2cb-ef2e49f3a035 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 15:59:03.552437 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-e1671493-8498-4503-9cc6-59f7f639b62d req-a5235f2c-2b1d-4e40-959a-19ada27c53a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ccef73e-5e82-42e7-a2cb-ef2e49f3a035", "name": "network-vif-deleted", "tag": "dfe16a0a-a802-4494-ac84-4d7be18928d2"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:59:03.600391 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-e1671493-8498-4503-9cc6-59f7f639b62d req-a5235f2c-2b1d-4e40-959a-19ada27c53a2 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:03.607245 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-e1671493-8498-4503-9cc6-59f7f639b62d req-a5235f2c-2b1d-4e40-959a-19ada27c53a2 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:03.608315 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-e1671493-8498-4503-9cc6-59f7f639b62d req-a5235f2c-2b1d-4e40-959a-19ada27c53a2 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:03.648953 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-e1671493-8498-4503-9cc6-59f7f639b62d req-a5235f2c-2b1d-4e40-959a-19ada27c53a2 service nova] Creating event network-vif-deleted:dfe16a0a-a802-4494-ac84-4d7be18928d2 for instance 6ccef73e-5e82-42e7-a2cb-ef2e49f3a035 on n-h1-833090-16 Aug 31 15:59:03.689389 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-e1671493-8498-4503-9cc6-59f7f639b62d req-a5235f2c-2b1d-4e40-959a-19ada27c53a2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150866 Aug 31 15:59:03.690664 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1229/2375] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:59:03.877736 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a92f2742-8ea7-4abb-bec3-9c9360d711f1 tempest-TenantUsagesNegativeTestJSON-352056504 tempest-TenantUsagesNegativeTestJSON-352056504-project-admin] 10.222.0.50 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-30T15%3A59%3A03.308415&end=2022-09-01T15%3A59%3A03.308415" status: 404 len: 112 microversion: - time: 0.185436 Aug 31 15:59:03.878763 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1230/2376] 10.222.0.50 () {58 vars in 1316 bytes} [Wed Aug 31 15:59:03 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-30T15%3A59%3A03.308415&end=2022-09-01T15%3A59%3A03.308415 => generated 112 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 31 15:59:03.884648 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7e92a40b-06f5-44f9-a44d-cda5b800e3c7 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:03.885415 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7e92a40b-06f5-44f9-a44d-cda5b800e3c7 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 320bf21c-eec1-43ea-a496-059fccc2642f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:03.893720 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7e92a40b-06f5-44f9-a44d-cda5b800e3c7 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:03.896244 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7e92a40b-06f5-44f9-a44d-cda5b800e3c7 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:03.896904 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7e92a40b-06f5-44f9-a44d-cda5b800e3c7 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:03.897842 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7e92a40b-06f5-44f9-a44d-cda5b800e3c7 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:03.898485 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7e92a40b-06f5-44f9-a44d-cda5b800e3c7 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:03.899139 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7e92a40b-06f5-44f9-a44d-cda5b800e3c7 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:04.154485 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2acbd429-fb80-449a-91a4-f3f812939507 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922a671cad44ea595e46290a5d52380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1371996a8304dc58ee579daa535bcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:04.170291 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2acbd429-fb80-449a-91a4-f3f812939507 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae" status: 200 len: 1505 microversion: 2.1 time: 1.834640 Aug 31 15:59:04.172213 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1147/2377] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:02 2022] GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae => generated 1505 bytes in 1838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:04.179992 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4416fc73-a30f-4b02-9a89-7779c778422f tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:04.185993 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4416fc73-a30f-4b02-9a89-7779c778422f tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 61e7db75-00b5-41e8-8efb-bced641ddd7a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:04.208694 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:59:04.213509 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4416fc73-a30f-4b02-9a89-7779c778422f tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:04.214177 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4416fc73-a30f-4b02-9a89-7779c778422f tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:04.214869 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4416fc73-a30f-4b02-9a89-7779c778422f tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:04.215850 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4416fc73-a30f-4b02-9a89-7779c778422f tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:04.216550 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4416fc73-a30f-4b02-9a89-7779c778422f tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:04.217194 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4416fc73-a30f-4b02-9a89-7779c778422f tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:04.263211 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4416fc73-a30f-4b02-9a89-7779c778422f tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 61e7db75-00b5-41e8-8efb-bced641ddd7a] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:59:04.288790 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=13 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:59:04.443396 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4416fc73-a30f-4b02-9a89-7779c778422f tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "DELETE /compute/v2.1/servers/61e7db75-00b5-41e8-8efb-bced641ddd7a" status: 204 len: 0 microversion: 2.25 time: 0.261708 Aug 31 15:59:04.444868 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1148/2378] 10.222.0.50 () {60 vars in 1280 bytes} [Wed Aug 31 15:59:04 2022] DELETE /compute/v2.1/servers/61e7db75-00b5-41e8-8efb-bced641ddd7a => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 15:59:04.451497 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-00c0d19a-9126-47cc-8262-b08c201958d6 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:04.452463 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-00c0d19a-9126-47cc-8262-b08c201958d6 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: a4977edb-9ae0-48ee-887d-d19a5db58a43] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:04.459571 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00c0d19a-9126-47cc-8262-b08c201958d6 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:04.460309 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00c0d19a-9126-47cc-8262-b08c201958d6 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:04.460909 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00c0d19a-9126-47cc-8262-b08c201958d6 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:04.461601 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00c0d19a-9126-47cc-8262-b08c201958d6 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:04.462043 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00c0d19a-9126-47cc-8262-b08c201958d6 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:04.462492 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00c0d19a-9126-47cc-8262-b08c201958d6 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:04.736790 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7e92a40b-06f5-44f9-a44d-cda5b800e3c7 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:04.754343 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7e92a40b-06f5-44f9-a44d-cda5b800e3c7 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f" status: 200 len: 1315 microversion: 2.1 time: 0.873227 Aug 31 15:59:04.766669 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1231/2379] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:03 2022] GET /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f => generated 1315 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:04.775997 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-737af48e-91e3-4f91-ad00-ebf3c8867ac3 tempest-TenantUsagesNegativeTestJSON-352056504 tempest-TenantUsagesNegativeTestJSON-352056504-project-admin] Calling method '.version_select at 0x7fbb461dc5e0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:04.786887 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-737af48e-91e3-4f91-ad00-ebf3c8867ac3 tempest-TenantUsagesNegativeTestJSON-352056504 tempest-TenantUsagesNegativeTestJSON-352056504-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Aug 31 15:59:04.794542 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-737af48e-91e3-4f91-ad00-ebf3c8867ac3 tempest-TenantUsagesNegativeTestJSON-352056504 tempest-TenantUsagesNegativeTestJSON-352056504-project-admin] Request method failure captured: Aug 31 15:59:04.794542 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/os-simple-tenant-usage/b536d361b9c24a73bd474b22e98052a2?start=2022-09-01T15%3A59%3A03.308415&end=2022-08-30T15%3A59%3A03.308415 HTTP/1.1 Aug 31 15:59:04.794542 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:59:04.794542 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:59:04.794542 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:59:04.794542 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:59:04.794542 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:59:04.794542 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:59:04.794542 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:59:04.794542 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:59:04.794542 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4VHkXVSh23iSvayAqIm6TliaoRRYjSCp5XWBnT-HivJn_gjj4pNhiTinVfQU9qwalNTJaSa0fIG4oLKYFod2-IZh_2sXPcfHsqt09MKfSe43YXnAvD4PNrwn9_MvmCUupm32wGRv6SnXeNdshznxMidetxiTqORIoaJi9bR2XM-Qwg Aug 31 15:59:04.794542 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:59:04.794542 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:59:04.794542 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:59:04.794542 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:59:04.794542 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:59:04.794542 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:59:04.794542 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 4abf139a2cab4bbcbe0c0993318abe77 Aug 31 15:59:04.794542 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-352056504 Aug 31 15:59:04.794542 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,admin,member Aug 31 15:59:04.794542 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,admin,member Aug 31 15:59:04.794542 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4abf139a2cab4bbcbe0c0993318abe77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4abf139a2cab4bbcbe0c0993318abe77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4abf139a2cab4bbcbe0c0993318abe77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4abf139a2cab4bbcbe0c0993318abe77", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:59:04.794542 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-352056504 Aug 31 15:59:04.794542 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 4abf139a2cab4bbcbe0c0993318abe77 Aug 31 15:59:04.794542 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-352056504 Aug 31 15:59:04.794542 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-TenantUsagesNegativeTestJSON-352056504-project-admin Aug 31 15:59:04.794542 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:59:04.794542 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:59:04.794542 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: f3bd94dc817748518ddb39c2b5d18acf Aug 31 15:59:04.794542 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-352056504-project-admin Aug 31 15:59:04.794542 n-d-833090-16 devstack@n-api.service[128864]: method: Aug 31 15:59:04.794542 n-d-833090-16 devstack@n-api.service[128864]: exception: Invalid start time. The start time cannot occur after the end time. Aug 31 15:59:04.794542 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'b536d361b9c24a73bd474b22e98052a2'} Aug 31 15:59:04.794542 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:59:04.794542 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:04.794542 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:04.794542 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:04.794542 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:59:04.794542 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:59:04.794542 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:59:04.794542 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:59:04.794542 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 15:59:04.794542 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:59:04.794542 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:59:04.794542 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:59:04.794542 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Aug 31 15:59:04.794542 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 31 15:59:04.794542 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Aug 31 15:59:04.794542 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Aug 31 15:59:04.794542 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Aug 31 15:59:04.794542 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 31 15:59:04.794542 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Aug 31 15:59:04.794542 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:04.794542 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:04.794542 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:04.794542 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:04.794542 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:04.794542 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:04.794542 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:59:04.794542 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:59:04.794542 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Aug 31 15:59:04.794542 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:04.802346 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-737af48e-91e3-4f91-ad00-ebf3c8867ac3 tempest-TenantUsagesNegativeTestJSON-352056504 tempest-TenantUsagesNegativeTestJSON-352056504-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:59:04.802346 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-737af48e-91e3-4f91-ad00-ebf3c8867ac3 tempest-TenantUsagesNegativeTestJSON-352056504 tempest-TenantUsagesNegativeTestJSON-352056504-project-admin] 10.222.0.50 "GET /compute/v2.1/os-simple-tenant-usage/b536d361b9c24a73bd474b22e98052a2?start=2022-09-01T15%3A59%3A03.308415&end=2022-08-30T15%3A59%3A03.308415" status: 400 len: 111 microversion: 2.1 time: 0.027776 Aug 31 15:59:04.802784 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1232/2380] 10.222.0.50 () {58 vars in 1412 bytes} [Wed Aug 31 15:59:04 2022] GET /compute/v2.1/os-simple-tenant-usage/b536d361b9c24a73bd474b22e98052a2?start=2022-09-01T15%3A59%3A03.308415&end=2022-08-30T15%3A59%3A03.308415 => generated 111 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 15:59:04.807878 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6dea80bc-ff39-457b-b640-265f60b3d537 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:04.808530 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6dea80bc-ff39-457b-b640-265f60b3d537 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:04.816007 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6dea80bc-ff39-457b-b640-265f60b3d537 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:04.816867 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6dea80bc-ff39-457b-b640-265f60b3d537 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:04.817381 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6dea80bc-ff39-457b-b640-265f60b3d537 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:04.818239 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6dea80bc-ff39-457b-b640-265f60b3d537 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:04.818696 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6dea80bc-ff39-457b-b640-265f60b3d537 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:04.819120 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6dea80bc-ff39-457b-b640-265f60b3d537 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:04.956072 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6dea80bc-ff39-457b-b640-265f60b3d537 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:04.972581 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6dea80bc-ff39-457b-b640-265f60b3d537 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:04.974050 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6dea80bc-ff39-457b-b640-265f60b3d537 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:04.979791 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6dea80bc-ff39-457b-b640-265f60b3d537 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1553 microversion: 2.91 time: 0.175940 Aug 31 15:59:04.980371 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1233/2381] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:04 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1553 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:04.985110 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-51edac99-8a20-4b9b-838a-3a1086ceceb3 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:04.991662 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-51edac99-8a20-4b9b-838a-3a1086ceceb3 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 61e7db75-00b5-41e8-8efb-bced641ddd7a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:04.998352 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51edac99-8a20-4b9b-838a-3a1086ceceb3 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:04.999027 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51edac99-8a20-4b9b-838a-3a1086ceceb3 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:04.999854 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51edac99-8a20-4b9b-838a-3a1086ceceb3 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:05.000855 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51edac99-8a20-4b9b-838a-3a1086ceceb3 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:05.001473 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51edac99-8a20-4b9b-838a-3a1086ceceb3 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:05.002077 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51edac99-8a20-4b9b-838a-3a1086ceceb3 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:05.023838 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-00c0d19a-9126-47cc-8262-b08c201958d6 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:05.033057 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-00c0d19a-9126-47cc-8262-b08c201958d6 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/a4977edb-9ae0-48ee-887d-d19a5db58a43" status: 200 len: 1493 microversion: 2.1 time: 0.586433 Aug 31 15:59:05.034275 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1149/2382] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:04 2022] GET /compute/v2.1/servers/a4977edb-9ae0-48ee-887d-d19a5db58a43 => generated 1493 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:05.137216 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=98 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:59:05.235762 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-10655f32-69bb-4144-bd40-8bf2c153a4c2 tempest-TenantUsagesNegativeTestJSON-891923029 tempest-TenantUsagesNegativeTestJSON-891923029-project] Calling method '.version_select at 0x7fbb4aa8aee0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:05.263311 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-10655f32-69bb-4144-bd40-8bf2c153a4c2 tempest-TenantUsagesNegativeTestJSON-891923029 tempest-TenantUsagesNegativeTestJSON-891923029-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '33eb3b85f6564487ba5468691e3cb403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b536d361b9c24a73bd474b22e98052a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-10655f32-69bb-4144-bd40-8bf2c153a4c2 tempest-TenantUsagesNegativeTestJSON-891923029 tempest-TenantUsagesNegativeTestJSON-891923029-project] Request method failure captured: Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-30T15%3A59%3A03.308415&end=2022-09-01T15%3A59%3A03.308415&detailed=1 HTTP/1.1 Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4VFcB7DQA0dlwTj9GvHPqvo2TP6ovW6wvMedl8-XyHc6vtlWdaTJm5JkKrqhHr4FwLB6baHQkpSg1gkEM4kGJIuk7briTxTR1KGlQ7_alo37mqo2dMBXZQnpW0PXGeo1c4Cc3n3y8UEVGNTAju0ZicdoEQNi0tTzMT-HDNnEufArF8 Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: b536d361b9c24a73bd474b22e98052a2 Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-891923029 Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b536d361b9c24a73bd474b22e98052a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b536d361b9c24a73bd474b22e98052a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b536d361b9c24a73bd474b22e98052a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b536d361b9c24a73bd474b22e98052a2", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-891923029 Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: b536d361b9c24a73bd474b22e98052a2 Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-891923029 Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-TenantUsagesNegativeTestJSON-891923029-project Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 33eb3b85f6564487ba5468691e3cb403 Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-891923029-project Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: method: Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: action_args: {} Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 31 15:59:05.273621 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 31 15:59:05.277360 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 31 15:59:05.277360 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:59:05.277360 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:05.277360 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:59:05.277360 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:05.277360 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:05.277360 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:05.277360 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 31 15:59:05.277360 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 31 15:59:05.277360 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 31 15:59:05.277360 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:59:05.284038 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-10655f32-69bb-4144-bd40-8bf2c153a4c2 tempest-TenantUsagesNegativeTestJSON-891923029 tempest-TenantUsagesNegativeTestJSON-891923029-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:59:05.292519 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-10655f32-69bb-4144-bd40-8bf2c153a4c2 tempest-TenantUsagesNegativeTestJSON-891923029 tempest-TenantUsagesNegativeTestJSON-891923029-project] 10.222.0.50 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-30T15%3A59%3A03.308415&end=2022-09-01T15%3A59%3A03.308415&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.253640 Aug 31 15:59:05.298423 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1150/2383] 10.222.0.50 () {58 vars in 1335 bytes} [Wed Aug 31 15:59:05 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-30T15%3A59%3A03.308415&end=2022-09-01T15%3A59%3A03.308415&detailed=1 => generated 123 bytes in 263 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:59:05.308120 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-91f62424-bf5c-4016-8456-a2138eec206b tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:05.312855 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-91f62424-bf5c-4016-8456-a2138eec206b tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: 13cdbabc-03ef-4025-b984-4bba559857ae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:05.331038 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91f62424-bf5c-4016-8456-a2138eec206b tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:05.334773 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91f62424-bf5c-4016-8456-a2138eec206b tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:05.336562 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91f62424-bf5c-4016-8456-a2138eec206b tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:05.339916 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91f62424-bf5c-4016-8456-a2138eec206b tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:05.340939 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91f62424-bf5c-4016-8456-a2138eec206b tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:05.341588 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91f62424-bf5c-4016-8456-a2138eec206b tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:05.649036 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-51edac99-8a20-4b9b-838a-3a1086ceceb3 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:05.657944 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-51edac99-8a20-4b9b-838a-3a1086ceceb3 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:05.659420 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-51edac99-8a20-4b9b-838a-3a1086ceceb3 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:05.660836 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-51edac99-8a20-4b9b-838a-3a1086ceceb3 tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/61e7db75-00b5-41e8-8efb-bced641ddd7a" status: 200 len: 1561 microversion: 2.25 time: 0.679207 Aug 31 15:59:05.673815 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1234/2384] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:04 2022] GET /compute/v2.1/servers/61e7db75-00b5-41e8-8efb-bced641ddd7a => generated 1561 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:05.787002 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9df968a9-eb1c-4b90-a300-8feaf89703ca tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:05.787648 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9df968a9-eb1c-4b90-a300-8feaf89703ca tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 320bf21c-eec1-43ea-a496-059fccc2642f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:05.813305 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9df968a9-eb1c-4b90-a300-8feaf89703ca tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:05.813814 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9df968a9-eb1c-4b90-a300-8feaf89703ca tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:05.815691 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9df968a9-eb1c-4b90-a300-8feaf89703ca tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:05.816683 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9df968a9-eb1c-4b90-a300-8feaf89703ca tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:05.817294 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9df968a9-eb1c-4b90-a300-8feaf89703ca tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:05.817472 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9df968a9-eb1c-4b90-a300-8feaf89703ca tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:06.167079 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-91f62424-bf5c-4016-8456-a2138eec206b tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922a671cad44ea595e46290a5d52380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1371996a8304dc58ee579daa535bcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:06.186128 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-91f62424-bf5c-4016-8456-a2138eec206b tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae" status: 200 len: 1505 microversion: 2.1 time: 0.885771 Aug 31 15:59:06.190327 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1151/2385] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:05 2022] GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae => generated 1505 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:06.203386 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-15361579-5d8b-4ce3-b54c-f2c9b99f4d9f tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:06.204229 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-15361579-5d8b-4ce3-b54c-f2c9b99f4d9f tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:06.218048 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-15361579-5d8b-4ce3-b54c-f2c9b99f4d9f tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:06.221185 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-15361579-5d8b-4ce3-b54c-f2c9b99f4d9f tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:06.222672 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-15361579-5d8b-4ce3-b54c-f2c9b99f4d9f tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:06.223615 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-15361579-5d8b-4ce3-b54c-f2c9b99f4d9f tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:06.226388 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-15361579-5d8b-4ce3-b54c-f2c9b99f4d9f tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:06.226825 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-15361579-5d8b-4ce3-b54c-f2c9b99f4d9f tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:06.459192 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9df968a9-eb1c-4b90-a300-8feaf89703ca tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:06.476887 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9df968a9-eb1c-4b90-a300-8feaf89703ca tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f" status: 200 len: 1315 microversion: 2.1 time: 0.693970 Aug 31 15:59:06.479180 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1235/2386] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:05 2022] GET /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f => generated 1315 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:59:06.485315 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-de0bf938-4b23-440d-bbee-6d9a83809f90 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:06.486303 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-de0bf938-4b23-440d-bbee-6d9a83809f90 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: a4977edb-9ae0-48ee-887d-d19a5db58a43] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:06.504351 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-de0bf938-4b23-440d-bbee-6d9a83809f90 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:06.509897 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-15361579-5d8b-4ce3-b54c-f2c9b99f4d9f tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:06.510638 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-de0bf938-4b23-440d-bbee-6d9a83809f90 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:06.510779 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-de0bf938-4b23-440d-bbee-6d9a83809f90 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:06.527397 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-15361579-5d8b-4ce3-b54c-f2c9b99f4d9f tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:06.528986 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-15361579-5d8b-4ce3-b54c-f2c9b99f4d9f tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:06.532107 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-de0bf938-4b23-440d-bbee-6d9a83809f90 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:06.536755 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-de0bf938-4b23-440d-bbee-6d9a83809f90 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:06.537422 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-de0bf938-4b23-440d-bbee-6d9a83809f90 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:06.556364 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-15361579-5d8b-4ce3-b54c-f2c9b99f4d9f tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1535 microversion: 2.91 time: 0.364501 Aug 31 15:59:06.560009 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1152/2387] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:06 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1535 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:06.572585 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-7351e271-72a5-407b-82bf-2effcf7a81f6 req-e841e62d-b277-4224-8081-c21d7409519b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4977edb-9ae0-48ee-887d-d19a5db58a43", "name": "network-vif-deleted", "tag": "98738177-422e-4e04-85eb-a363f7670a8e"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:59:06.585552 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-de0bf938-4b23-440d-bbee-6d9a83809f90 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:06.586143 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-de0bf938-4b23-440d-bbee-6d9a83809f90 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:06.586636 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-de0bf938-4b23-440d-bbee-6d9a83809f90 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:06.587285 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-de0bf938-4b23-440d-bbee-6d9a83809f90 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lazy-loading 'fault' on Instance uuid a4977edb-9ae0-48ee-887d-d19a5db58a43 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:59:06.621177 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7351e271-72a5-407b-82bf-2effcf7a81f6 req-e841e62d-b277-4224-8081-c21d7409519b service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:06.622108 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7351e271-72a5-407b-82bf-2effcf7a81f6 req-e841e62d-b277-4224-8081-c21d7409519b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:06.632567 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7351e271-72a5-407b-82bf-2effcf7a81f6 req-e841e62d-b277-4224-8081-c21d7409519b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:06.657305 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-de0bf938-4b23-440d-bbee-6d9a83809f90 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d84a1872d9442b2886a8060d2e59580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c508a07ab50746468f855f7c5893ffdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:06.672408 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-de0bf938-4b23-440d-bbee-6d9a83809f90 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/a4977edb-9ae0-48ee-887d-d19a5db58a43" status: 200 len: 1298 microversion: 2.1 time: 0.191576 Aug 31 15:59:06.687705 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-7351e271-72a5-407b-82bf-2effcf7a81f6 req-e841e62d-b277-4224-8081-c21d7409519b service nova] Creating event network-vif-deleted:98738177-422e-4e04-85eb-a363f7670a8e for instance a4977edb-9ae0-48ee-887d-d19a5db58a43 on n-h2-833090-16 Aug 31 15:59:06.696788 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1236/2388] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:06 2022] GET /compute/v2.1/servers/a4977edb-9ae0-48ee-887d-d19a5db58a43 => generated 1298 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:06.704180 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-7351e271-72a5-407b-82bf-2effcf7a81f6 req-e841e62d-b277-4224-8081-c21d7409519b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141839 Aug 31 15:59:06.707422 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1153/2389] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:59:06.710601 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-a04c917f-1d95-4501-a4e4-65c00b37f4f3 req-5d41c689-0af8-4f19-bd98-5930a1fbcf3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61e7db75-00b5-41e8-8efb-bced641ddd7a", "name": "network-vif-deleted", "tag": "034d0508-b254-4514-999a-4b96164ff990"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:59:06.724424 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-376e03b8-079f-48b9-bea1-b51b17544c04 req-fe144757-6f1f-482d-9e6d-6ccaba50c4f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "320bf21c-eec1-43ea-a496-059fccc2642f", "name": "network-vif-plugged", "status": "completed", "tag": "af138e0c-ab28-4a83-bf6a-2359074606bb"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:59:06.734149 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-a04c917f-1d95-4501-a4e4-65c00b37f4f3 req-5d41c689-0af8-4f19-bd98-5930a1fbcf3e service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:06.736065 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-a04c917f-1d95-4501-a4e4-65c00b37f4f3 req-5d41c689-0af8-4f19-bd98-5930a1fbcf3e service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:06.736496 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-a04c917f-1d95-4501-a4e4-65c00b37f4f3 req-5d41c689-0af8-4f19-bd98-5930a1fbcf3e service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:06.753479 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-376e03b8-079f-48b9-bea1-b51b17544c04 req-fe144757-6f1f-482d-9e6d-6ccaba50c4f7 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:06.754062 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-376e03b8-079f-48b9-bea1-b51b17544c04 req-fe144757-6f1f-482d-9e6d-6ccaba50c4f7 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:06.754516 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-376e03b8-079f-48b9-bea1-b51b17544c04 req-fe144757-6f1f-482d-9e6d-6ccaba50c4f7 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:06.767879 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-a04c917f-1d95-4501-a4e4-65c00b37f4f3 req-5d41c689-0af8-4f19-bd98-5930a1fbcf3e service nova] Creating event network-vif-deleted:034d0508-b254-4514-999a-4b96164ff990 for instance 61e7db75-00b5-41e8-8efb-bced641ddd7a on n-h2-833090-16 Aug 31 15:59:06.804027 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-376e03b8-079f-48b9-bea1-b51b17544c04 req-fe144757-6f1f-482d-9e6d-6ccaba50c4f7 service nova] Creating event network-vif-plugged:af138e0c-ab28-4a83-bf6a-2359074606bb for instance 320bf21c-eec1-43ea-a496-059fccc2642f on n-h1-833090-16 Aug 31 15:59:06.808024 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-a04c917f-1d95-4501-a4e4-65c00b37f4f3 req-5d41c689-0af8-4f19-bd98-5930a1fbcf3e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109680 Aug 31 15:59:06.809180 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1237/2390] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:59:06.817693 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d3cf6504-8415-48e1-acc4-125e236447ea tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:06.818760 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d3cf6504-8415-48e1-acc4-125e236447ea tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 61e7db75-00b5-41e8-8efb-bced641ddd7a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:06.819242 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-376e03b8-079f-48b9-bea1-b51b17544c04 req-fe144757-6f1f-482d-9e6d-6ccaba50c4f7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108309 Aug 31 15:59:06.820233 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1154/2391] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:59:06.834643 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d3cf6504-8415-48e1-acc4-125e236447ea tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:06.835475 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d3cf6504-8415-48e1-acc4-125e236447ea tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:06.836123 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d3cf6504-8415-48e1-acc4-125e236447ea tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:06.838084 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d3cf6504-8415-48e1-acc4-125e236447ea tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:06.838995 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d3cf6504-8415-48e1-acc4-125e236447ea tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:06.839833 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d3cf6504-8415-48e1-acc4-125e236447ea tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:06.980887 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d3cf6504-8415-48e1-acc4-125e236447ea tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:07.037519 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d3cf6504-8415-48e1-acc4-125e236447ea tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:07.039057 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d3cf6504-8415-48e1-acc4-125e236447ea tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '072bc5784d754815a511f6c3f4437f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86aafc129b8640d381f9bae1767fbc6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:07.040228 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d3cf6504-8415-48e1-acc4-125e236447ea tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/61e7db75-00b5-41e8-8efb-bced641ddd7a" status: 200 len: 1346 microversion: 2.25 time: 0.229506 Aug 31 15:59:07.057045 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ada9507a-ec90-4f56-bb3c-a229a00367d8 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Action: 'create', calling method: .version_select at 0x7fbb4aa25790>, body: {"keypair": {"name": "tempest-keypair-1324800784", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHY3wEUtdKRiJUY2GWAbWcZJHBovng8VvokTmMCPe4UFuYuYvjlbyqwnPbxTuPs2SCiB7J01tmmavP35Tz1TukPMf3IlBNpyG1kv2X74184FcT027G8g2+EeiDOgZIdkHA=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:59:07.068739 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1238/2392] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:06 2022] GET /compute/v2.1/servers/61e7db75-00b5-41e8-8efb-bced641ddd7a => generated 1346 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:07.098302 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-ada9507a-ec90-4f56-bb3c-a229a00367d8 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Getting quotas for project 11ef5102f83142d1a52befe52c3595d4. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:59:07.106730 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-ada9507a-ec90-4f56-bb3c-a229a00367d8 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Getting quotas for user aeeaf32202f747c8a2b98836f503aa7e and project 11ef5102f83142d1a52befe52c3595d4. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:59:07.159511 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ada9507a-ec90-4f56-bb3c-a229a00367d8 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.337993 Aug 31 15:59:07.161453 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1155/2393] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 31 15:59:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:59:07.214226 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9f282967-d6a8-40dd-8f34-479f7b77b31f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:07.214926 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9f282967-d6a8-40dd-8f34-479f7b77b31f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: 13cdbabc-03ef-4025-b984-4bba559857ae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:07.232846 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9f282967-d6a8-40dd-8f34-479f7b77b31f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:07.233614 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9f282967-d6a8-40dd-8f34-479f7b77b31f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:07.236463 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9f282967-d6a8-40dd-8f34-479f7b77b31f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:07.239088 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9f282967-d6a8-40dd-8f34-479f7b77b31f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:07.243893 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9f282967-d6a8-40dd-8f34-479f7b77b31f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:07.246151 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9f282967-d6a8-40dd-8f34-479f7b77b31f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:07.315595 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:59:07.501274 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8aa03d37-1963-45eb-aad2-2ec9b2b31c60 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:07.502281 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8aa03d37-1963-45eb-aad2-2ec9b2b31c60 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 320bf21c-eec1-43ea-a496-059fccc2642f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:07.522683 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8aa03d37-1963-45eb-aad2-2ec9b2b31c60 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:07.523209 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8aa03d37-1963-45eb-aad2-2ec9b2b31c60 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:07.523476 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8aa03d37-1963-45eb-aad2-2ec9b2b31c60 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:07.524258 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8aa03d37-1963-45eb-aad2-2ec9b2b31c60 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:07.524610 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8aa03d37-1963-45eb-aad2-2ec9b2b31c60 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:07.525029 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8aa03d37-1963-45eb-aad2-2ec9b2b31c60 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:07.601916 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9f282967-d6a8-40dd-8f34-479f7b77b31f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922a671cad44ea595e46290a5d52380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1371996a8304dc58ee579daa535bcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:07.614535 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9f282967-d6a8-40dd-8f34-479f7b77b31f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae" status: 200 len: 1505 microversion: 2.1 time: 0.405384 Aug 31 15:59:07.615398 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1239/2394] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:07 2022] GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae => generated 1505 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:07.623195 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-07c04729-dac1-44b4-bb91-d884b30e1578 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:07.623820 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-07c04729-dac1-44b4-bb91-d884b30e1578 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:07.636258 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-07c04729-dac1-44b4-bb91-d884b30e1578 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:07.637043 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-07c04729-dac1-44b4-bb91-d884b30e1578 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:07.637828 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-07c04729-dac1-44b4-bb91-d884b30e1578 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:07.638690 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-07c04729-dac1-44b4-bb91-d884b30e1578 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:07.639448 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-07c04729-dac1-44b4-bb91-d884b30e1578 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:07.639971 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-07c04729-dac1-44b4-bb91-d884b30e1578 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:07.768509 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-07c04729-dac1-44b4-bb91-d884b30e1578 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:07.778588 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-07c04729-dac1-44b4-bb91-d884b30e1578 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:07.780472 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-07c04729-dac1-44b4-bb91-d884b30e1578 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:07.787265 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-07c04729-dac1-44b4-bb91-d884b30e1578 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1538 microversion: 2.91 time: 0.169325 Aug 31 15:59:07.802209 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1240/2395] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:07 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1538 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:07.802209 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9284e0d3-b6e1-4d83-8003-30b6fade3b83 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:07.802209 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9284e0d3-b6e1-4d83-8003-30b6fade3b83 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: a4977edb-9ae0-48ee-887d-d19a5db58a43] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:07.802209 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:INSERT=10,nova_api:SELECT=79,nova_api:UPDATE=11 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:59:07.802209 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9284e0d3-b6e1-4d83-8003-30b6fade3b83 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:07.802742 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9284e0d3-b6e1-4d83-8003-30b6fade3b83 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:07.803546 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9284e0d3-b6e1-4d83-8003-30b6fade3b83 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:07.804132 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9284e0d3-b6e1-4d83-8003-30b6fade3b83 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:07.808755 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9284e0d3-b6e1-4d83-8003-30b6fade3b83 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:07.808755 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9284e0d3-b6e1-4d83-8003-30b6fade3b83 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:07.829182 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-9284e0d3-b6e1-4d83-8003-30b6fade3b83 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] HTTP exception thrown: Instance a4977edb-9ae0-48ee-887d-d19a5db58a43 could not be found. Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9284e0d3-b6e1-4d83-8003-30b6fade3b83 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Request method failure captured: Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/a4977edb-9ae0-48ee-887d-d19a5db58a43 HTTP/1.1 Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4RCKsQiaZtbjrQJmd2Omjl_oKAmhft4D7jlzDIoeb03U1ZQC3H31yVwWa3WjVw5pgChsVO4acIHjtkGbbISXlxQMrYifNC9zQ3UBQ638xuVfQg3UB8C-mMDDctLeTsW0UlxlkPW1bUS7dAwoxIzX4-zocS5PRKR97axAhcoV_2u0I8 Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: c508a07ab50746468f855f7c5893ffdc Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ImagesTestJSON-145941755 Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c508a07ab50746468f855f7c5893ffdc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c508a07ab50746468f855f7c5893ffdc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c508a07ab50746468f855f7c5893ffdc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c508a07ab50746468f855f7c5893ffdc", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ImagesTestJSON-145941755 Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: c508a07ab50746468f855f7c5893ffdc Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ImagesTestJSON-145941755 Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ImagesTestJSON-145941755-project Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 7d84a1872d9442b2886a8060d2e59580 Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ImagesTestJSON-145941755-project Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance a4977edb-9ae0-48ee-887d-d19a5db58a43 could not be found. Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'a4977edb-9ae0-48ee-887d-d19a5db58a43'} Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4977edb-9ae0-48ee-887d-d19a5db58a43 could not be found. Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4977edb-9ae0-48ee-887d-d19a5db58a43 could not be found. Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:07.833309 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:07.838717 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:07.838717 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:07.838717 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:59:07.838717 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:59:07.838717 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4977edb-9ae0-48ee-887d-d19a5db58a43 could not be found. Aug 31 15:59:07.838717 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:07.840357 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9284e0d3-b6e1-4d83-8003-30b6fade3b83 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Returning 404 to user: Instance a4977edb-9ae0-48ee-887d-d19a5db58a43 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:59:07.842552 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9284e0d3-b6e1-4d83-8003-30b6fade3b83 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/a4977edb-9ae0-48ee-887d-d19a5db58a43" status: 404 len: 111 microversion: 2.1 time: 0.053031 Aug 31 15:59:07.843797 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1241/2396] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:07 2022] GET /compute/v2.1/servers/a4977edb-9ae0-48ee-887d-d19a5db58a43 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:59:07.851937 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d96cfeec-5b2d-4857-ac9e-f3e722c1ba60 tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-833090-16"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:59:07.855844 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d96cfeec-5b2d-4857-ac9e-f3e722c1ba60 tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:07.870842 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d96cfeec-5b2d-4857-ac9e-f3e722c1ba60 tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:07.871699 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d96cfeec-5b2d-4857-ac9e-f3e722c1ba60 tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:07.872350 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d96cfeec-5b2d-4857-ac9e-f3e722c1ba60 tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:07.873302 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d96cfeec-5b2d-4857-ac9e-f3e722c1ba60 tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:07.873942 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d96cfeec-5b2d-4857-ac9e-f3e722c1ba60 tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:07.874855 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d96cfeec-5b2d-4857-ac9e-f3e722c1ba60 tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:07.948476 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d96cfeec-5b2d-4857-ac9e-f3e722c1ba60 tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-833090-16". {{(pid=128864) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 15:59:08.072334 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8aa03d37-1963-45eb-aad2-2ec9b2b31c60 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:08.081623 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d96cfeec-5b2d-4857-ac9e-f3e722c1ba60 tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78/action" status: 202 len: 0 microversion: 2.91 time: 0.234151 Aug 31 15:59:08.083022 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1242/2397] 10.222.0.50 () {62 vars in 1319 bytes} [Wed Aug 31 15:59:07 2022] POST /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:59:08.092612 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8aa03d37-1963-45eb-aad2-2ec9b2b31c60 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f" status: 200 len: 1315 microversion: 2.1 time: 0.595545 Aug 31 15:59:08.093493 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1156/2398] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:07 2022] GET /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f => generated 1315 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:59:08.095142 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e857b7df-9a3a-46c8-9667-94da84af7df1 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb46864550>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:08.111499 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-117f2787-9723-4da2-8593-4a03a126474e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:08.116529 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-117f2787-9723-4da2-8593-4a03a126474e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] [instance: 61e7db75-00b5-41e8-8efb-bced641ddd7a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:08.152180 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-117f2787-9723-4da2-8593-4a03a126474e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:08.152951 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-117f2787-9723-4da2-8593-4a03a126474e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:08.154243 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-e857b7df-9a3a-46c8-9667-94da84af7df1 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] HTTP exception thrown: Image not found. Aug 31 15:59:08.154573 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-117f2787-9723-4da2-8593-4a03a126474e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:08.155492 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-117f2787-9723-4da2-8593-4a03a126474e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e857b7df-9a3a-46c8-9667-94da84af7df1 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Request method failure captured: Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: request: DELETE /compute/v2.1/images/a44aac17-897f-4534-9995-797398bda710 HTTP/1.1 Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4RCKsQiaZtbjrQJmd2Omjl_oKAmhft4D7jlzDIoeb03U1ZQC3H31yVwWa3WjVw5pgChsVO4acIHjtkGbbISXlxQMrYifNC9zQ3UBQ638xuVfQg3UB8C-mMDDctLeTsW0UlxlkPW1bUS7dAwoxIzX4-zocS5PRKR97axAhcoV_2u0I8 Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: c508a07ab50746468f855f7c5893ffdc Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ImagesTestJSON-145941755 Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c508a07ab50746468f855f7c5893ffdc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c508a07ab50746468f855f7c5893ffdc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c508a07ab50746468f855f7c5893ffdc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c508a07ab50746468f855f7c5893ffdc", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ImagesTestJSON-145941755 Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: c508a07ab50746468f855f7c5893ffdc Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ImagesTestJSON-145941755 Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ImagesTestJSON-145941755-project Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 7d84a1872d9442b2886a8060d2e59580 Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ImagesTestJSON-145941755-project Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: method: Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: exception: Image not found. Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'a44aac17-897f-4534-9995-797398bda710'} Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a44aac17-897f-4534-9995-797398bda710 to delete Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a44aac17-897f-4534-9995-797398bda710 could not be found. Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:08.156076 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:08.159878 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:08.159878 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:08.159878 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:59:08.159878 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:59:08.159878 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:59:08.159878 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:59:08.159878 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:59:08.159878 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:59:08.159878 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 31 15:59:08.159878 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 31 15:59:08.159878 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 31 15:59:08.159878 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:08.159878 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:08.159878 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:08.159878 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:08.159878 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:08.159878 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:08.159878 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:59:08.159878 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:59:08.159878 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 31 15:59:08.159878 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:08.159878 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e857b7df-9a3a-46c8-9667-94da84af7df1 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Returning 404 to user: Image not found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:59:08.159878 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e857b7df-9a3a-46c8-9667-94da84af7df1 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "DELETE /compute/v2.1/images/a44aac17-897f-4534-9995-797398bda710" status: 404 len: 62 microversion: 2.1 time: 0.071741 Aug 31 15:59:08.159878 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1243/2399] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:08 2022] DELETE /compute/v2.1/images/a44aac17-897f-4534-9995-797398bda710 => generated 62 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 15:59:08.164192 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8f0db1cd-e92d-4a71-8b90-ba4423382a5a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:08.164809 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8f0db1cd-e92d-4a71-8b90-ba4423382a5a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:08.165391 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-117f2787-9723-4da2-8593-4a03a126474e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:08.165998 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-117f2787-9723-4da2-8593-4a03a126474e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:08.184033 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8f0db1cd-e92d-4a71-8b90-ba4423382a5a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:08.184728 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8f0db1cd-e92d-4a71-8b90-ba4423382a5a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:08.185181 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8f0db1cd-e92d-4a71-8b90-ba4423382a5a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:08.188153 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8f0db1cd-e92d-4a71-8b90-ba4423382a5a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:08.188634 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8f0db1cd-e92d-4a71-8b90-ba4423382a5a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:08.189074 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8f0db1cd-e92d-4a71-8b90-ba4423382a5a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:08.207423 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-117f2787-9723-4da2-8593-4a03a126474e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] HTTP exception thrown: Instance 61e7db75-00b5-41e8-8efb-bced641ddd7a could not be found. Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-117f2787-9723-4da2-8593-4a03a126474e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Request method failure captured: Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/61e7db75-00b5-41e8-8efb-bced641ddd7a HTTP/1.1 Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4NHqkgwYGUym-Rz8_ahU9_nePHkL-bhC3R98SNlnSzexlfj7kN8EdCPwINUFbsF5Jo9rHxGnnKW4mmnCLqko9cX9nysCtsANAulE1Ljdk3EUSlUSaH_x03Hi5zjOnc1qB5IhtdxpQiIoa_bQFbmxCt0BdSE44Ku0YpN9lafIO9AgqU Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: X-Openstack-Nova-Api-Version: 2.25 Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 86aafc129b8640d381f9bae1767fbc6c Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-181009754 Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/86aafc129b8640d381f9bae1767fbc6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/86aafc129b8640d381f9bae1767fbc6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/86aafc129b8640d381f9bae1767fbc6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_86aafc129b8640d381f9bae1767fbc6c", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-181009754 Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 86aafc129b8640d381f9bae1767fbc6c Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-181009754 Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-LiveAutoBlockMigrationV225Test-181009754-project Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 072bc5784d754815a511f6c3f4437f7c Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-181009754-project Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 61e7db75-00b5-41e8-8efb-bced641ddd7a could not be found. Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '61e7db75-00b5-41e8-8efb-bced641ddd7a'} Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61e7db75-00b5-41e8-8efb-bced641ddd7a could not be found. Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61e7db75-00b5-41e8-8efb-bced641ddd7a could not be found. Aug 31 15:59:08.214390 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:59:08.218369 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:08.218369 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:59:08.218369 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:08.218369 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:08.218369 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:08.218369 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:59:08.218369 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:59:08.218369 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61e7db75-00b5-41e8-8efb-bced641ddd7a could not be found. Aug 31 15:59:08.218369 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:59:08.220553 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-117f2787-9723-4da2-8593-4a03a126474e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] Returning 404 to user: Instance 61e7db75-00b5-41e8-8efb-bced641ddd7a could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:59:08.222622 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-117f2787-9723-4da2-8593-4a03a126474e tempest-LiveAutoBlockMigrationV225Test-181009754 tempest-LiveAutoBlockMigrationV225Test-181009754-project] 10.222.0.50 "GET /compute/v2.1/servers/61e7db75-00b5-41e8-8efb-bced641ddd7a" status: 404 len: 111 microversion: 2.25 time: 0.124141 Aug 31 15:59:08.224759 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1157/2400] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:08 2022] GET /compute/v2.1/servers/61e7db75-00b5-41e8-8efb-bced641ddd7a => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 15:59:08.237658 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-de1a7e95-e2c2-4786-aaf5-e88f21b97c4c tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:08.238528 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-de1a7e95-e2c2-4786-aaf5-e88f21b97c4c tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: 434ee39d-6510-411f-93e1-0500c19fb312] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:08.254570 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-de1a7e95-e2c2-4786-aaf5-e88f21b97c4c tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:08.256637 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-de1a7e95-e2c2-4786-aaf5-e88f21b97c4c tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:08.257492 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-de1a7e95-e2c2-4786-aaf5-e88f21b97c4c tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:08.258743 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-de1a7e95-e2c2-4786-aaf5-e88f21b97c4c tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:08.259485 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-de1a7e95-e2c2-4786-aaf5-e88f21b97c4c tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:08.260873 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-de1a7e95-e2c2-4786-aaf5-e88f21b97c4c tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:08.317392 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-de1a7e95-e2c2-4786-aaf5-e88f21b97c4c tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] HTTP exception thrown: Instance 434ee39d-6510-411f-93e1-0500c19fb312 could not be found. Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-de1a7e95-e2c2-4786-aaf5-e88f21b97c4c tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Request method failure captured: Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/434ee39d-6510-411f-93e1-0500c19fb312 HTTP/1.1 Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4RCKsQiaZtbjrQJmd2Omjl_oKAmhft4D7jlzDIoeb03U1ZQC3H31yVwWa3WjVw5pgChsVO4acIHjtkGbbISXlxQMrYifNC9zQ3UBQ638xuVfQg3UB8C-mMDDctLeTsW0UlxlkPW1bUS7dAwoxIzX4-zocS5PRKR97axAhcoV_2u0I8 Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: c508a07ab50746468f855f7c5893ffdc Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ImagesTestJSON-145941755 Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c508a07ab50746468f855f7c5893ffdc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c508a07ab50746468f855f7c5893ffdc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c508a07ab50746468f855f7c5893ffdc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c508a07ab50746468f855f7c5893ffdc", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ImagesTestJSON-145941755 Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: c508a07ab50746468f855f7c5893ffdc Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ImagesTestJSON-145941755 Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ImagesTestJSON-145941755-project Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 7d84a1872d9442b2886a8060d2e59580 Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ImagesTestJSON-145941755-project Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 434ee39d-6510-411f-93e1-0500c19fb312 could not be found. Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '434ee39d-6510-411f-93e1-0500c19fb312'} Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 434ee39d-6510-411f-93e1-0500c19fb312 could not be found. Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:59:08.325730 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 434ee39d-6510-411f-93e1-0500c19fb312 could not be found. Aug 31 15:59:08.329526 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:59:08.329526 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:08.329526 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:59:08.329526 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:08.329526 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:08.329526 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:08.329526 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:59:08.329526 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:59:08.329526 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 434ee39d-6510-411f-93e1-0500c19fb312 could not be found. Aug 31 15:59:08.329526 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:59:08.329526 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-de1a7e95-e2c2-4786-aaf5-e88f21b97c4c tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Returning 404 to user: Instance 434ee39d-6510-411f-93e1-0500c19fb312 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:59:08.333073 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-de1a7e95-e2c2-4786-aaf5-e88f21b97c4c tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "DELETE /compute/v2.1/servers/434ee39d-6510-411f-93e1-0500c19fb312" status: 404 len: 111 microversion: 2.1 time: 0.105269 Aug 31 15:59:08.341320 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1158/2401] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:59:08 2022] DELETE /compute/v2.1/servers/434ee39d-6510-411f-93e1-0500c19fb312 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:59:08.362755 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-818b891f-5c69-4c6d-9ce4-f08dc6df3689 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:08.365984 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-818b891f-5c69-4c6d-9ce4-f08dc6df3689 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: 434ee39d-6510-411f-93e1-0500c19fb312] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:08.374108 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-818b891f-5c69-4c6d-9ce4-f08dc6df3689 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:08.375707 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-818b891f-5c69-4c6d-9ce4-f08dc6df3689 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:08.376482 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-818b891f-5c69-4c6d-9ce4-f08dc6df3689 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:08.379118 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-818b891f-5c69-4c6d-9ce4-f08dc6df3689 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:08.380897 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-818b891f-5c69-4c6d-9ce4-f08dc6df3689 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:08.382355 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-818b891f-5c69-4c6d-9ce4-f08dc6df3689 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:08.417373 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-818b891f-5c69-4c6d-9ce4-f08dc6df3689 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] HTTP exception thrown: Instance 434ee39d-6510-411f-93e1-0500c19fb312 could not be found. Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-818b891f-5c69-4c6d-9ce4-f08dc6df3689 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Request method failure captured: Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/434ee39d-6510-411f-93e1-0500c19fb312 HTTP/1.1 Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4RCKsQiaZtbjrQJmd2Omjl_oKAmhft4D7jlzDIoeb03U1ZQC3H31yVwWa3WjVw5pgChsVO4acIHjtkGbbISXlxQMrYifNC9zQ3UBQ638xuVfQg3UB8C-mMDDctLeTsW0UlxlkPW1bUS7dAwoxIzX4-zocS5PRKR97axAhcoV_2u0I8 Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: c508a07ab50746468f855f7c5893ffdc Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ImagesTestJSON-145941755 Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c508a07ab50746468f855f7c5893ffdc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c508a07ab50746468f855f7c5893ffdc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c508a07ab50746468f855f7c5893ffdc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c508a07ab50746468f855f7c5893ffdc", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ImagesTestJSON-145941755 Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: c508a07ab50746468f855f7c5893ffdc Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ImagesTestJSON-145941755 Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ImagesTestJSON-145941755-project Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 7d84a1872d9442b2886a8060d2e59580 Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ImagesTestJSON-145941755-project Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 434ee39d-6510-411f-93e1-0500c19fb312 could not be found. Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '434ee39d-6510-411f-93e1-0500c19fb312'} Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 434ee39d-6510-411f-93e1-0500c19fb312 could not be found. Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 434ee39d-6510-411f-93e1-0500c19fb312 could not be found. Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:59:08.419648 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:08.423930 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:08.423930 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:08.423930 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:59:08.423930 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:59:08.423930 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 434ee39d-6510-411f-93e1-0500c19fb312 could not be found. Aug 31 15:59:08.423930 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:59:08.430666 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-818b891f-5c69-4c6d-9ce4-f08dc6df3689 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Returning 404 to user: Instance 434ee39d-6510-411f-93e1-0500c19fb312 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:59:08.435559 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-818b891f-5c69-4c6d-9ce4-f08dc6df3689 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/434ee39d-6510-411f-93e1-0500c19fb312" status: 404 len: 111 microversion: 2.1 time: 0.089367 Aug 31 15:59:08.443028 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1159/2402] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:08 2022] GET /compute/v2.1/servers/434ee39d-6510-411f-93e1-0500c19fb312 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:59:08.457806 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ff0641c3-9a7f-4358-bd20-844e93752622 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb4ab6cee0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:08.494897 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8f0db1cd-e92d-4a71-8b90-ba4423382a5a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:08.495927 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-ff0641c3-9a7f-4358-bd20-844e93752622 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] HTTP exception thrown: Image not found. Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ff0641c3-9a7f-4358-bd20-844e93752622 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Request method failure captured: Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/images/3eaecaef-7864-4e9d-a83b-14203707c01e HTTP/1.1 Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4RCKsQiaZtbjrQJmd2Omjl_oKAmhft4D7jlzDIoeb03U1ZQC3H31yVwWa3WjVw5pgChsVO4acIHjtkGbbISXlxQMrYifNC9zQ3UBQ638xuVfQg3UB8C-mMDDctLeTsW0UlxlkPW1bUS7dAwoxIzX4-zocS5PRKR97axAhcoV_2u0I8 Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: c508a07ab50746468f855f7c5893ffdc Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ImagesTestJSON-145941755 Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c508a07ab50746468f855f7c5893ffdc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c508a07ab50746468f855f7c5893ffdc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c508a07ab50746468f855f7c5893ffdc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c508a07ab50746468f855f7c5893ffdc", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ImagesTestJSON-145941755 Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: c508a07ab50746468f855f7c5893ffdc Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ImagesTestJSON-145941755 Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ImagesTestJSON-145941755-project Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 7d84a1872d9442b2886a8060d2e59580 Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ImagesTestJSON-145941755-project Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: method: Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: exception: Image not found. Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '3eaecaef-7864-4e9d-a83b-14203707c01e'} Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 3eaecaef-7864-4e9d-a83b-14203707c01e to delete Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3eaecaef-7864-4e9d-a83b-14203707c01e could not be found. Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:59:08.497368 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:08.501282 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:08.501282 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:08.501282 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:59:08.501282 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:59:08.501282 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:59:08.501282 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:59:08.501282 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:59:08.501282 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:59:08.501282 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 31 15:59:08.501282 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 31 15:59:08.501282 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 31 15:59:08.501282 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:59:08.501282 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:08.501282 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:59:08.501282 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:08.501282 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:08.501282 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:08.501282 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:59:08.501282 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:59:08.501282 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 31 15:59:08.501282 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:59:08.501282 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ff0641c3-9a7f-4358-bd20-844e93752622 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Returning 404 to user: Image not found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:59:08.501282 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ff0641c3-9a7f-4358-bd20-844e93752622 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "DELETE /compute/v2.1/images/3eaecaef-7864-4e9d-a83b-14203707c01e" status: 404 len: 62 microversion: 2.1 time: 0.053411 Aug 31 15:59:08.501282 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1160/2403] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:08 2022] DELETE /compute/v2.1/images/3eaecaef-7864-4e9d-a83b-14203707c01e => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 15:59:08.511595 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-226065cb-a21a-4371-8140-c642cd92a810 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:08.512776 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-226065cb-a21a-4371-8140-c642cd92a810 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: f550488c-401c-4f00-805b-fe62d75da9d4] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:08.513765 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8f0db1cd-e92d-4a71-8b90-ba4423382a5a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:08.518938 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8f0db1cd-e92d-4a71-8b90-ba4423382a5a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:08.534202 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-226065cb-a21a-4371-8140-c642cd92a810 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:08.534881 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-226065cb-a21a-4371-8140-c642cd92a810 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:08.535570 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-226065cb-a21a-4371-8140-c642cd92a810 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:08.538386 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-226065cb-a21a-4371-8140-c642cd92a810 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:08.539069 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-226065cb-a21a-4371-8140-c642cd92a810 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:08.542777 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-226065cb-a21a-4371-8140-c642cd92a810 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:08.550732 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8f0db1cd-e92d-4a71-8b90-ba4423382a5a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1546 microversion: 2.91 time: 0.391244 Aug 31 15:59:08.557108 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1244/2404] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:08 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1546 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:08.583587 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-226065cb-a21a-4371-8140-c642cd92a810 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] HTTP exception thrown: Instance f550488c-401c-4f00-805b-fe62d75da9d4 could not be found. Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-226065cb-a21a-4371-8140-c642cd92a810 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Request method failure captured: Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4 HTTP/1.1 Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4RCKsQiaZtbjrQJmd2Omjl_oKAmhft4D7jlzDIoeb03U1ZQC3H31yVwWa3WjVw5pgChsVO4acIHjtkGbbISXlxQMrYifNC9zQ3UBQ638xuVfQg3UB8C-mMDDctLeTsW0UlxlkPW1bUS7dAwoxIzX4-zocS5PRKR97axAhcoV_2u0I8 Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: c508a07ab50746468f855f7c5893ffdc Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ImagesTestJSON-145941755 Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c508a07ab50746468f855f7c5893ffdc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c508a07ab50746468f855f7c5893ffdc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c508a07ab50746468f855f7c5893ffdc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c508a07ab50746468f855f7c5893ffdc", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ImagesTestJSON-145941755 Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: c508a07ab50746468f855f7c5893ffdc Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ImagesTestJSON-145941755 Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ImagesTestJSON-145941755-project Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 7d84a1872d9442b2886a8060d2e59580 Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ImagesTestJSON-145941755-project Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance f550488c-401c-4f00-805b-fe62d75da9d4 could not be found. Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'f550488c-401c-4f00-805b-fe62d75da9d4'} Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f550488c-401c-4f00-805b-fe62d75da9d4 could not be found. Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:59:08.585421 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f550488c-401c-4f00-805b-fe62d75da9d4 could not be found. Aug 31 15:59:08.590471 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:59:08.590471 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:08.590471 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:59:08.590471 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:08.590471 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:08.590471 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:08.590471 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:59:08.590471 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:59:08.590471 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f550488c-401c-4f00-805b-fe62d75da9d4 could not be found. Aug 31 15:59:08.590471 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:59:08.590471 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-226065cb-a21a-4371-8140-c642cd92a810 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Returning 404 to user: Instance f550488c-401c-4f00-805b-fe62d75da9d4 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:59:08.590471 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-226065cb-a21a-4371-8140-c642cd92a810 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "DELETE /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4" status: 404 len: 111 microversion: 2.1 time: 0.081680 Aug 31 15:59:08.594060 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1161/2405] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:59:08 2022] DELETE /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:59:08.600638 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a46292f9-d5b6-4566-a384-781149d27981 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:08.601254 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a46292f9-d5b6-4566-a384-781149d27981 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: f550488c-401c-4f00-805b-fe62d75da9d4] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:08.637052 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d5ffc0ba-3d0d-4ed7-904a-6f87c9ca1a4f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:08.637878 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d5ffc0ba-3d0d-4ed7-904a-6f87c9ca1a4f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: 13cdbabc-03ef-4025-b984-4bba559857ae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:08.638391 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a46292f9-d5b6-4566-a384-781149d27981 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:08.638894 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a46292f9-d5b6-4566-a384-781149d27981 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:08.639331 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a46292f9-d5b6-4566-a384-781149d27981 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:08.644578 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a46292f9-d5b6-4566-a384-781149d27981 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:08.645247 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a46292f9-d5b6-4566-a384-781149d27981 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:08.645630 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a46292f9-d5b6-4566-a384-781149d27981 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:08.648737 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5ffc0ba-3d0d-4ed7-904a-6f87c9ca1a4f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:08.650322 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5ffc0ba-3d0d-4ed7-904a-6f87c9ca1a4f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:08.651230 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5ffc0ba-3d0d-4ed7-904a-6f87c9ca1a4f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:08.653061 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5ffc0ba-3d0d-4ed7-904a-6f87c9ca1a4f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:08.654352 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5ffc0ba-3d0d-4ed7-904a-6f87c9ca1a4f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:08.655651 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5ffc0ba-3d0d-4ed7-904a-6f87c9ca1a4f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:08.724733 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-a46292f9-d5b6-4566-a384-781149d27981 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] HTTP exception thrown: Instance f550488c-401c-4f00-805b-fe62d75da9d4 could not be found. Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a46292f9-d5b6-4566-a384-781149d27981 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Request method failure captured: Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4 HTTP/1.1 Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4RCKsQiaZtbjrQJmd2Omjl_oKAmhft4D7jlzDIoeb03U1ZQC3H31yVwWa3WjVw5pgChsVO4acIHjtkGbbISXlxQMrYifNC9zQ3UBQ638xuVfQg3UB8C-mMDDctLeTsW0UlxlkPW1bUS7dAwoxIzX4-zocS5PRKR97axAhcoV_2u0I8 Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: c508a07ab50746468f855f7c5893ffdc Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ImagesTestJSON-145941755 Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c508a07ab50746468f855f7c5893ffdc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c508a07ab50746468f855f7c5893ffdc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c508a07ab50746468f855f7c5893ffdc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c508a07ab50746468f855f7c5893ffdc", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ImagesTestJSON-145941755 Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: c508a07ab50746468f855f7c5893ffdc Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ImagesTestJSON-145941755 Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ImagesTestJSON-145941755-project Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 7d84a1872d9442b2886a8060d2e59580 Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ImagesTestJSON-145941755-project Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance f550488c-401c-4f00-805b-fe62d75da9d4 could not be found. Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'f550488c-401c-4f00-805b-fe62d75da9d4'} Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f550488c-401c-4f00-805b-fe62d75da9d4 could not be found. Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f550488c-401c-4f00-805b-fe62d75da9d4 could not be found. Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:08.729385 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:08.733989 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:08.733989 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:08.733989 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:59:08.733989 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:59:08.733989 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f550488c-401c-4f00-805b-fe62d75da9d4 could not be found. Aug 31 15:59:08.733989 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:08.733989 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a46292f9-d5b6-4566-a384-781149d27981 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Returning 404 to user: Instance f550488c-401c-4f00-805b-fe62d75da9d4 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:59:08.734750 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a46292f9-d5b6-4566-a384-781149d27981 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4" status: 404 len: 111 microversion: 2.1 time: 0.139717 Aug 31 15:59:08.739096 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1245/2406] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:08 2022] GET /compute/v2.1/servers/f550488c-401c-4f00-805b-fe62d75da9d4 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 15:59:08.746496 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-43469a50-f110-4789-8ad5-5d26d6aa73de tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '.version_select at 0x7fbb46775d30>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:08.822702 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-43469a50-f110-4789-8ad5-5d26d6aa73de tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] HTTP exception thrown: Image not found. Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-43469a50-f110-4789-8ad5-5d26d6aa73de tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Request method failure captured: Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: request: DELETE /compute/v2.1/images/e202e141-5d73-4379-b82b-e5ecc6ddf63e HTTP/1.1 Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4RCKsQiaZtbjrQJmd2Omjl_oKAmhft4D7jlzDIoeb03U1ZQC3H31yVwWa3WjVw5pgChsVO4acIHjtkGbbISXlxQMrYifNC9zQ3UBQ638xuVfQg3UB8C-mMDDctLeTsW0UlxlkPW1bUS7dAwoxIzX4-zocS5PRKR97axAhcoV_2u0I8 Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: c508a07ab50746468f855f7c5893ffdc Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ImagesTestJSON-145941755 Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c508a07ab50746468f855f7c5893ffdc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c508a07ab50746468f855f7c5893ffdc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c508a07ab50746468f855f7c5893ffdc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c508a07ab50746468f855f7c5893ffdc", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ImagesTestJSON-145941755 Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: c508a07ab50746468f855f7c5893ffdc Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ImagesTestJSON-145941755 Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ImagesTestJSON-145941755-project Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 7d84a1872d9442b2886a8060d2e59580 Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ImagesTestJSON-145941755-project Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: method: Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: exception: Image not found. Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'e202e141-5d73-4379-b82b-e5ecc6ddf63e'} Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e202e141-5d73-4379-b82b-e5ecc6ddf63e to delete Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e202e141-5d73-4379-b82b-e5ecc6ddf63e could not be found. Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:08.827084 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:08.833863 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:08.833863 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:08.833863 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:59:08.833863 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:59:08.833863 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:59:08.833863 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:59:08.833863 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:59:08.833863 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:59:08.833863 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 31 15:59:08.833863 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 31 15:59:08.833863 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 31 15:59:08.833863 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:08.833863 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:08.833863 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:08.833863 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:08.833863 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:08.833863 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:08.833863 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:59:08.833863 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:59:08.833863 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 31 15:59:08.833863 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:08.835882 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-43469a50-f110-4789-8ad5-5d26d6aa73de tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Returning 404 to user: Image not found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:59:08.837179 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-43469a50-f110-4789-8ad5-5d26d6aa73de tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "DELETE /compute/v2.1/images/e202e141-5d73-4379-b82b-e5ecc6ddf63e" status: 404 len: 62 microversion: 2.1 time: 0.096829 Aug 31 15:59:08.838304 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1246/2407] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:08 2022] DELETE /compute/v2.1/images/e202e141-5d73-4379-b82b-e5ecc6ddf63e => generated 62 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 15:59:08.847739 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-81de1d1d-28db-4b75-a631-35adc716f8bf tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:08.848577 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-81de1d1d-28db-4b75-a631-35adc716f8bf tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: 3054bf54-101d-4e7d-b62d-bcd53d30a4bb] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:08.865207 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-81de1d1d-28db-4b75-a631-35adc716f8bf tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:08.865375 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-81de1d1d-28db-4b75-a631-35adc716f8bf tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:08.871692 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-81de1d1d-28db-4b75-a631-35adc716f8bf tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:08.874530 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-81de1d1d-28db-4b75-a631-35adc716f8bf tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:08.875235 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-81de1d1d-28db-4b75-a631-35adc716f8bf tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:08.876157 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-81de1d1d-28db-4b75-a631-35adc716f8bf tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:08.925559 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-81de1d1d-28db-4b75-a631-35adc716f8bf tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] HTTP exception thrown: Instance 3054bf54-101d-4e7d-b62d-bcd53d30a4bb could not be found. Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-81de1d1d-28db-4b75-a631-35adc716f8bf tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Request method failure captured: Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: request: DELETE /compute/v2.1/servers/3054bf54-101d-4e7d-b62d-bcd53d30a4bb HTTP/1.1 Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4RCKsQiaZtbjrQJmd2Omjl_oKAmhft4D7jlzDIoeb03U1ZQC3H31yVwWa3WjVw5pgChsVO4acIHjtkGbbISXlxQMrYifNC9zQ3UBQ638xuVfQg3UB8C-mMDDctLeTsW0UlxlkPW1bUS7dAwoxIzX4-zocS5PRKR97axAhcoV_2u0I8 Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: c508a07ab50746468f855f7c5893ffdc Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ImagesTestJSON-145941755 Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c508a07ab50746468f855f7c5893ffdc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c508a07ab50746468f855f7c5893ffdc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c508a07ab50746468f855f7c5893ffdc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c508a07ab50746468f855f7c5893ffdc", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ImagesTestJSON-145941755 Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: c508a07ab50746468f855f7c5893ffdc Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ImagesTestJSON-145941755 Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ImagesTestJSON-145941755-project Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 7d84a1872d9442b2886a8060d2e59580 Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ImagesTestJSON-145941755-project Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 3054bf54-101d-4e7d-b62d-bcd53d30a4bb could not be found. Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '3054bf54-101d-4e7d-b62d-bcd53d30a4bb'} Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3054bf54-101d-4e7d-b62d-bcd53d30a4bb could not be found. Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:59:08.927883 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3054bf54-101d-4e7d-b62d-bcd53d30a4bb could not be found. Aug 31 15:59:08.932238 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:08.932238 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:08.932238 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:08.932238 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:08.932238 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:08.932238 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:08.932238 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:59:08.932238 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:59:08.932238 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3054bf54-101d-4e7d-b62d-bcd53d30a4bb could not be found. Aug 31 15:59:08.932238 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:08.934014 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-81de1d1d-28db-4b75-a631-35adc716f8bf tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Returning 404 to user: Instance 3054bf54-101d-4e7d-b62d-bcd53d30a4bb could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:59:08.935212 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-81de1d1d-28db-4b75-a631-35adc716f8bf tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3054bf54-101d-4e7d-b62d-bcd53d30a4bb" status: 404 len: 111 microversion: 2.1 time: 0.092885 Aug 31 15:59:08.935959 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1247/2408] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:59:08 2022] DELETE /compute/v2.1/servers/3054bf54-101d-4e7d-b62d-bcd53d30a4bb => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 15:59:08.948088 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-382d8502-7a78-4025-9a5e-33afbf365b30 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:08.948752 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-382d8502-7a78-4025-9a5e-33afbf365b30 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] [instance: 3054bf54-101d-4e7d-b62d-bcd53d30a4bb] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:08.999023 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-382d8502-7a78-4025-9a5e-33afbf365b30 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:08.999681 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-382d8502-7a78-4025-9a5e-33afbf365b30 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:09.000437 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-382d8502-7a78-4025-9a5e-33afbf365b30 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:09.003694 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-382d8502-7a78-4025-9a5e-33afbf365b30 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:09.005397 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-382d8502-7a78-4025-9a5e-33afbf365b30 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:09.006687 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-382d8502-7a78-4025-9a5e-33afbf365b30 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:09.090891 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-382d8502-7a78-4025-9a5e-33afbf365b30 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] HTTP exception thrown: Instance 3054bf54-101d-4e7d-b62d-bcd53d30a4bb could not be found. Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-382d8502-7a78-4025-9a5e-33afbf365b30 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Request method failure captured: Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/3054bf54-101d-4e7d-b62d-bcd53d30a4bb HTTP/1.1 Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4RCKsQiaZtbjrQJmd2Omjl_oKAmhft4D7jlzDIoeb03U1ZQC3H31yVwWa3WjVw5pgChsVO4acIHjtkGbbISXlxQMrYifNC9zQ3UBQ638xuVfQg3UB8C-mMDDctLeTsW0UlxlkPW1bUS7dAwoxIzX4-zocS5PRKR97axAhcoV_2u0I8 Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: c508a07ab50746468f855f7c5893ffdc Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ImagesTestJSON-145941755 Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c508a07ab50746468f855f7c5893ffdc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c508a07ab50746468f855f7c5893ffdc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c508a07ab50746468f855f7c5893ffdc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c508a07ab50746468f855f7c5893ffdc", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ImagesTestJSON-145941755 Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: c508a07ab50746468f855f7c5893ffdc Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ImagesTestJSON-145941755 Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ImagesTestJSON-145941755-project Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 7d84a1872d9442b2886a8060d2e59580 Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ImagesTestJSON-145941755-project Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 3054bf54-101d-4e7d-b62d-bcd53d30a4bb could not be found. Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '3054bf54-101d-4e7d-b62d-bcd53d30a4bb'} Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3054bf54-101d-4e7d-b62d-bcd53d30a4bb could not be found. Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3054bf54-101d-4e7d-b62d-bcd53d30a4bb could not be found. Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:09.092567 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:09.096296 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:09.096296 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:09.096296 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:59:09.096296 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:59:09.096296 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3054bf54-101d-4e7d-b62d-bcd53d30a4bb could not be found. Aug 31 15:59:09.096296 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:09.096296 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-382d8502-7a78-4025-9a5e-33afbf365b30 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] Returning 404 to user: Instance 3054bf54-101d-4e7d-b62d-bcd53d30a4bb could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:59:09.096296 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-382d8502-7a78-4025-9a5e-33afbf365b30 tempest-ImagesTestJSON-145941755 tempest-ImagesTestJSON-145941755-project] 10.222.0.50 "GET /compute/v2.1/servers/3054bf54-101d-4e7d-b62d-bcd53d30a4bb" status: 404 len: 111 microversion: 2.1 time: 0.153519 Aug 31 15:59:09.106902 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1248/2409] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:08 2022] GET /compute/v2.1/servers/3054bf54-101d-4e7d-b62d-bcd53d30a4bb => generated 111 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:59:09.119972 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0caaea29-98c3-484d-98d3-0912a9412171 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:09.120300 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0caaea29-98c3-484d-98d3-0912a9412171 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 320bf21c-eec1-43ea-a496-059fccc2642f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:09.152940 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0caaea29-98c3-484d-98d3-0912a9412171 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:09.153473 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0caaea29-98c3-484d-98d3-0912a9412171 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:09.153913 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0caaea29-98c3-484d-98d3-0912a9412171 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:09.154655 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0caaea29-98c3-484d-98d3-0912a9412171 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:09.155128 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0caaea29-98c3-484d-98d3-0912a9412171 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:09.155536 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0caaea29-98c3-484d-98d3-0912a9412171 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:09.765922 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d5ffc0ba-3d0d-4ed7-904a-6f87c9ca1a4f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922a671cad44ea595e46290a5d52380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1371996a8304dc58ee579daa535bcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:09.777549 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d5ffc0ba-3d0d-4ed7-904a-6f87c9ca1a4f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae" status: 200 len: 1505 microversion: 2.1 time: 1.144748 Aug 31 15:59:09.781762 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1162/2410] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:08 2022] GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae => generated 1505 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:59:09.798525 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1661d1be-06b7-40e6-be96-55c19905faab tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:09.799198 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1661d1be-06b7-40e6-be96-55c19905faab tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:09.841425 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1661d1be-06b7-40e6-be96-55c19905faab tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:09.845260 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1661d1be-06b7-40e6-be96-55c19905faab tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:09.847469 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1661d1be-06b7-40e6-be96-55c19905faab tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:09.849790 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1661d1be-06b7-40e6-be96-55c19905faab tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:09.852731 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1661d1be-06b7-40e6-be96-55c19905faab tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:09.855804 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1661d1be-06b7-40e6-be96-55c19905faab tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:10.099886 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0caaea29-98c3-484d-98d3-0912a9412171 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:10.119536 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1661d1be-06b7-40e6-be96-55c19905faab tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:10.120408 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0caaea29-98c3-484d-98d3-0912a9412171 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f" status: 200 len: 1503 microversion: 2.1 time: 1.004113 Aug 31 15:59:10.121006 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1249/2411] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:09 2022] GET /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f => generated 1503 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:10.135458 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1661d1be-06b7-40e6-be96-55c19905faab tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:10.141667 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1661d1be-06b7-40e6-be96-55c19905faab tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:10.142535 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-499ee70b-67e4-4cd5-a7c5-7e74b3c06e66 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:59:10.151593 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-499ee70b-67e4-4cd5-a7c5-7e74b3c06e66 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:10.153474 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-499ee70b-67e4-4cd5-a7c5-7e74b3c06e66 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:10.157597 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-499ee70b-67e4-4cd5-a7c5-7e74b3c06e66 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:10.165106 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1661d1be-06b7-40e6-be96-55c19905faab tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1486 microversion: 2.91 time: 0.381615 Aug 31 15:59:10.166872 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1163/2412] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:09 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1486 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:10.297850 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-499ee70b-67e4-4cd5-a7c5-7e74b3c06e66 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 320bf21c-eec1-43ea-a496-059fccc2642f] Going to try to stop instance {{(pid=128864) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 15:59:10.390848 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-499ee70b-67e4-4cd5-a7c5-7e74b3c06e66 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "POST /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f/action" status: 202 len: 0 microversion: 2.1 time: 0.252049 Aug 31 15:59:10.391877 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1250/2413] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 15:59:10 2022] POST /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 15:59:10.400432 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-873b63bc-cd18-41ae-9c92-d550ee6b1cfa tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:10.401443 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-873b63bc-cd18-41ae-9c92-d550ee6b1cfa tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 320bf21c-eec1-43ea-a496-059fccc2642f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:10.409003 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-873b63bc-cd18-41ae-9c92-d550ee6b1cfa tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:10.409656 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-873b63bc-cd18-41ae-9c92-d550ee6b1cfa tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:10.410333 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-873b63bc-cd18-41ae-9c92-d550ee6b1cfa tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:10.411222 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-873b63bc-cd18-41ae-9c92-d550ee6b1cfa tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:10.411983 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-873b63bc-cd18-41ae-9c92-d550ee6b1cfa tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:10.412628 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-873b63bc-cd18-41ae-9c92-d550ee6b1cfa tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:10.821312 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-223351f9-21e4-4981-89b7-40f606133c00 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:10.822059 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-223351f9-21e4-4981-89b7-40f606133c00 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: 13cdbabc-03ef-4025-b984-4bba559857ae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:10.838962 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-223351f9-21e4-4981-89b7-40f606133c00 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:10.839459 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-223351f9-21e4-4981-89b7-40f606133c00 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:10.839887 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-223351f9-21e4-4981-89b7-40f606133c00 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:10.840602 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-223351f9-21e4-4981-89b7-40f606133c00 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:10.841046 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-223351f9-21e4-4981-89b7-40f606133c00 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:10.841458 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-223351f9-21e4-4981-89b7-40f606133c00 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:10.961558 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-873b63bc-cd18-41ae-9c92-d550ee6b1cfa tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:10.978021 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-873b63bc-cd18-41ae-9c92-d550ee6b1cfa tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f" status: 200 len: 1513 microversion: 2.1 time: 0.581252 Aug 31 15:59:10.979337 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1164/2414] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:10 2022] GET /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f => generated 1513 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:11.206106 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3ccea202-5b39-4b51-9e39-fa804f8ac71a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:11.206960 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3ccea202-5b39-4b51-9e39-fa804f8ac71a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:11.217320 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ccea202-5b39-4b51-9e39-fa804f8ac71a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:11.217832 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ccea202-5b39-4b51-9e39-fa804f8ac71a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:11.218307 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ccea202-5b39-4b51-9e39-fa804f8ac71a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:11.219025 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ccea202-5b39-4b51-9e39-fa804f8ac71a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:11.219481 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ccea202-5b39-4b51-9e39-fa804f8ac71a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:11.228655 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ccea202-5b39-4b51-9e39-fa804f8ac71a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:11.438569 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3ccea202-5b39-4b51-9e39-fa804f8ac71a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:11.451905 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3ccea202-5b39-4b51-9e39-fa804f8ac71a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:11.454588 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3ccea202-5b39-4b51-9e39-fa804f8ac71a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:11.463842 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3ccea202-5b39-4b51-9e39-fa804f8ac71a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1544 microversion: 2.91 time: 0.262182 Aug 31 15:59:11.465159 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1165/2415] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:11 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1544 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 15:59:11.493500 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-223351f9-21e4-4981-89b7-40f606133c00 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922a671cad44ea595e46290a5d52380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1371996a8304dc58ee579daa535bcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:11.505086 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-223351f9-21e4-4981-89b7-40f606133c00 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae" status: 200 len: 1505 microversion: 2.1 time: 0.690195 Aug 31 15:59:11.512786 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1251/2416] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:10 2022] GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae => generated 1505 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:11.999449 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7cdd59ba-76cc-4410-bbc2-618363721f29 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:12.000144 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7cdd59ba-76cc-4410-bbc2-618363721f29 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 320bf21c-eec1-43ea-a496-059fccc2642f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:12.013020 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cdd59ba-76cc-4410-bbc2-618363721f29 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:12.013537 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cdd59ba-76cc-4410-bbc2-618363721f29 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:12.013972 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cdd59ba-76cc-4410-bbc2-618363721f29 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:12.014750 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cdd59ba-76cc-4410-bbc2-618363721f29 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:12.015659 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cdd59ba-76cc-4410-bbc2-618363721f29 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:12.016233 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cdd59ba-76cc-4410-bbc2-618363721f29 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:12.501727 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-af22e609-2293-4200-8dd4-53bce35153ea tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:12.502731 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-af22e609-2293-4200-8dd4-53bce35153ea tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:12.528835 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-af22e609-2293-4200-8dd4-53bce35153ea tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:12.532127 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-af22e609-2293-4200-8dd4-53bce35153ea tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:12.535226 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-af22e609-2293-4200-8dd4-53bce35153ea tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:12.540379 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-af22e609-2293-4200-8dd4-53bce35153ea tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:12.541425 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-af22e609-2293-4200-8dd4-53bce35153ea tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:12.542136 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-af22e609-2293-4200-8dd4-53bce35153ea tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:12.952018 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-af22e609-2293-4200-8dd4-53bce35153ea tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:12.968326 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-af22e609-2293-4200-8dd4-53bce35153ea tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:12.976853 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-af22e609-2293-4200-8dd4-53bce35153ea tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:12.988267 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-af22e609-2293-4200-8dd4-53bce35153ea tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1544 microversion: 2.91 time: 0.502460 Aug 31 15:59:12.989650 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1252/2417] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:12 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1544 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:12.998248 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1e019c7a-49b2-42c7-b687-54eb292927be tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:13.002997 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1e019c7a-49b2-42c7-b687-54eb292927be tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: 13cdbabc-03ef-4025-b984-4bba559857ae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:13.017785 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e019c7a-49b2-42c7-b687-54eb292927be tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:13.018665 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e019c7a-49b2-42c7-b687-54eb292927be tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:13.019258 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e019c7a-49b2-42c7-b687-54eb292927be tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:13.020437 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e019c7a-49b2-42c7-b687-54eb292927be tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:13.021941 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e019c7a-49b2-42c7-b687-54eb292927be tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:13.022965 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e019c7a-49b2-42c7-b687-54eb292927be tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:13.532717 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7cdd59ba-76cc-4410-bbc2-618363721f29 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:13.543525 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7cdd59ba-76cc-4410-bbc2-618363721f29 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f" status: 200 len: 1513 microversion: 2.1 time: 1.548463 Aug 31 15:59:13.565045 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1166/2418] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:11 2022] GET /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f => generated 1513 bytes in 1571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:14.020432 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6b12b73c-353b-44c1-b2d5-c545461f1ee5 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:14.022840 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6b12b73c-353b-44c1-b2d5-c545461f1ee5 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:14.041622 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b12b73c-353b-44c1-b2d5-c545461f1ee5 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:14.042438 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b12b73c-353b-44c1-b2d5-c545461f1ee5 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:14.043205 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b12b73c-353b-44c1-b2d5-c545461f1ee5 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:14.044134 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b12b73c-353b-44c1-b2d5-c545461f1ee5 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:14.044751 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b12b73c-353b-44c1-b2d5-c545461f1ee5 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:14.045336 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b12b73c-353b-44c1-b2d5-c545461f1ee5 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:14.480188 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6b12b73c-353b-44c1-b2d5-c545461f1ee5 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:14.491229 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:59:14.519990 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6b12b73c-353b-44c1-b2d5-c545461f1ee5 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:14.523789 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6b12b73c-353b-44c1-b2d5-c545461f1ee5 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:14.549849 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6b12b73c-353b-44c1-b2d5-c545461f1ee5 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1544 microversion: 2.91 time: 0.536498 Aug 31 15:59:14.556472 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1167/2419] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:14 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1544 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:14.578360 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1e019c7a-49b2-42c7-b687-54eb292927be tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922a671cad44ea595e46290a5d52380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1371996a8304dc58ee579daa535bcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:14.590586 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-af60ea1e-4ba7-4bfc-a523-14484110bd51 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:14.591362 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-af60ea1e-4ba7-4bfc-a523-14484110bd51 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 320bf21c-eec1-43ea-a496-059fccc2642f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:14.600885 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1e019c7a-49b2-42c7-b687-54eb292927be tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae" status: 200 len: 1505 microversion: 2.1 time: 1.609607 Aug 31 15:59:14.608892 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1253/2420] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:12 2022] GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae => generated 1505 bytes in 1619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:14.609958 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af60ea1e-4ba7-4bfc-a523-14484110bd51 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:14.610612 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af60ea1e-4ba7-4bfc-a523-14484110bd51 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:14.612141 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af60ea1e-4ba7-4bfc-a523-14484110bd51 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:14.616357 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af60ea1e-4ba7-4bfc-a523-14484110bd51 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:14.616968 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af60ea1e-4ba7-4bfc-a523-14484110bd51 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:14.617510 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af60ea1e-4ba7-4bfc-a523-14484110bd51 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:15.105031 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-575295e3-5d12-49c3-81bd-6d9ae0429c9d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1252339611", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4df1d88e-baa2-45b2-bf09-1af39b3d8e2f"}], "security_groups": [{"name": "tempest-securitygroup--1627254020"}], "key_name": "tempest-keypair-1324800784", "user_data": "}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:59:15.179265 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-af60ea1e-4ba7-4bfc-a523-14484110bd51 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:15.192836 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-af60ea1e-4ba7-4bfc-a523-14484110bd51 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f" status: 200 len: 1513 microversion: 2.1 time: 0.606280 Aug 31 15:59:15.193761 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1168/2421] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:14 2022] GET /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f => generated 1513 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:59:15.526947 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-575295e3-5d12-49c3-81bd-6d9ae0429c9d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] validate_networks() for [('4df1d88e-baa2-45b2-bf09-1af39b3d8e2f', None, None, None, None, None)] {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:59:15.578440 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-58c53763-0b12-4d9a-b87b-b3f38da5deae tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:15.579098 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-58c53763-0b12-4d9a-b87b-b3f38da5deae tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:15.596071 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58c53763-0b12-4d9a-b87b-b3f38da5deae tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:15.596575 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58c53763-0b12-4d9a-b87b-b3f38da5deae tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:15.597014 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58c53763-0b12-4d9a-b87b-b3f38da5deae tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:15.597731 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58c53763-0b12-4d9a-b87b-b3f38da5deae tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:15.598205 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58c53763-0b12-4d9a-b87b-b3f38da5deae tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:15.598689 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58c53763-0b12-4d9a-b87b-b3f38da5deae tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:15.849047 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-58c53763-0b12-4d9a-b87b-b3f38da5deae tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:15.866368 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-58c53763-0b12-4d9a-b87b-b3f38da5deae tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:15.868020 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-58c53763-0b12-4d9a-b87b-b3f38da5deae tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:15.894355 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-58c53763-0b12-4d9a-b87b-b3f38da5deae tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1544 microversion: 2.91 time: 0.319939 Aug 31 15:59:15.907627 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1169/2422] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:15 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1544 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 15:59:15.931677 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ab25d469-fa04-4e31-a87e-117fdaa4d2bf tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:15.938663 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ab25d469-fa04-4e31-a87e-117fdaa4d2bf tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: 13cdbabc-03ef-4025-b984-4bba559857ae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:15.952168 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab25d469-fa04-4e31-a87e-117fdaa4d2bf tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:15.952914 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab25d469-fa04-4e31-a87e-117fdaa4d2bf tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:15.953502 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab25d469-fa04-4e31-a87e-117fdaa4d2bf tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:15.954470 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab25d469-fa04-4e31-a87e-117fdaa4d2bf tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:15.955078 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab25d469-fa04-4e31-a87e-117fdaa4d2bf tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:15.955651 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab25d469-fa04-4e31-a87e-117fdaa4d2bf tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:16.741732 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ab25d469-fa04-4e31-a87e-117fdaa4d2bf tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922a671cad44ea595e46290a5d52380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1371996a8304dc58ee579daa535bcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:16.756810 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ab25d469-fa04-4e31-a87e-117fdaa4d2bf tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae" status: 200 len: 1505 microversion: 2.1 time: 0.846274 Aug 31 15:59:16.763315 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1170/2423] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:15 2022] GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae => generated 1505 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:16.768503 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-11c74f07-7d3a-4371-a28b-80b735179b87 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:16.771775 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-11c74f07-7d3a-4371-a28b-80b735179b87 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 320bf21c-eec1-43ea-a496-059fccc2642f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:16.795316 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11c74f07-7d3a-4371-a28b-80b735179b87 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:16.796368 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11c74f07-7d3a-4371-a28b-80b735179b87 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:16.809548 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11c74f07-7d3a-4371-a28b-80b735179b87 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:16.810693 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11c74f07-7d3a-4371-a28b-80b735179b87 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:16.811416 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11c74f07-7d3a-4371-a28b-80b735179b87 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:16.812000 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11c74f07-7d3a-4371-a28b-80b735179b87 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:17.125249 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:59:18.015416 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-575295e3-5d12-49c3-81bd-6d9ae0429c9d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:59:18.016353 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-575295e3-5d12-49c3-81bd-6d9ae0429c9d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:59:18.016980 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-575295e3-5d12-49c3-81bd-6d9ae0429c9d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:59:18.017534 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-575295e3-5d12-49c3-81bd-6d9ae0429c9d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:59:18.018140 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-575295e3-5d12-49c3-81bd-6d9ae0429c9d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:59:18.059448 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-575295e3-5d12-49c3-81bd-6d9ae0429c9d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:18.059946 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-575295e3-5d12-49c3-81bd-6d9ae0429c9d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:18.060456 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-575295e3-5d12-49c3-81bd-6d9ae0429c9d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:18.061202 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-575295e3-5d12-49c3-81bd-6d9ae0429c9d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:18.061714 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-575295e3-5d12-49c3-81bd-6d9ae0429c9d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:18.062222 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-575295e3-5d12-49c3-81bd-6d9ae0429c9d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:18.135159 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-575295e3-5d12-49c3-81bd-6d9ae0429c9d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Getting quotas for project 11ef5102f83142d1a52befe52c3595d4. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:59:18.169367 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-11c74f07-7d3a-4371-a28b-80b735179b87 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:18.179605 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-11c74f07-7d3a-4371-a28b-80b735179b87 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f" status: 200 len: 1513 microversion: 2.1 time: 1.414891 Aug 31 15:59:18.188568 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1171/2424] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:16 2022] GET /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f => generated 1513 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:18.198226 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-575295e3-5d12-49c3-81bd-6d9ae0429c9d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Getting quotas for user aeeaf32202f747c8a2b98836f503aa7e and project 11ef5102f83142d1a52befe52c3595d4. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:59:18.233187 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-575295e3-5d12-49c3-81bd-6d9ae0429c9d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:59:18.234741 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a73442fc-ed43-4bd6-ad5b-bda3e3ebe9c4 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:18.235568 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a73442fc-ed43-4bd6-ad5b-bda3e3ebe9c4 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:18.237612 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-575295e3-5d12-49c3-81bd-6d9ae0429c9d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:59:18.283513 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a73442fc-ed43-4bd6-ad5b-bda3e3ebe9c4 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:18.284069 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a73442fc-ed43-4bd6-ad5b-bda3e3ebe9c4 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:18.287215 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a73442fc-ed43-4bd6-ad5b-bda3e3ebe9c4 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:18.291110 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a73442fc-ed43-4bd6-ad5b-bda3e3ebe9c4 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:18.291970 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a73442fc-ed43-4bd6-ad5b-bda3e3ebe9c4 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:18.292499 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a73442fc-ed43-4bd6-ad5b-bda3e3ebe9c4 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:18.404451 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-575295e3-5d12-49c3-81bd-6d9ae0429c9d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 3.308759 Aug 31 15:59:18.407958 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1254/2425] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:59:15 2022] POST /compute/v2.1/servers => generated 409 bytes in 3313 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 15:59:18.420039 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ea90dd20-1365-4f30-a150-a30cdd9a9258 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:18.427044 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ea90dd20-1365-4f30-a150-a30cdd9a9258 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: 13cdbabc-03ef-4025-b984-4bba559857ae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:18.444656 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ea90dd20-1365-4f30-a150-a30cdd9a9258 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:18.445554 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ea90dd20-1365-4f30-a150-a30cdd9a9258 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:18.446235 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ea90dd20-1365-4f30-a150-a30cdd9a9258 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:18.450214 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ea90dd20-1365-4f30-a150-a30cdd9a9258 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:18.451397 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ea90dd20-1365-4f30-a150-a30cdd9a9258 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:18.452062 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ea90dd20-1365-4f30-a150-a30cdd9a9258 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:18.568457 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a73442fc-ed43-4bd6-ad5b-bda3e3ebe9c4 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:18.593293 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a73442fc-ed43-4bd6-ad5b-bda3e3ebe9c4 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:18.595194 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a73442fc-ed43-4bd6-ad5b-bda3e3ebe9c4 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:18.618163 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a73442fc-ed43-4bd6-ad5b-bda3e3ebe9c4 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1544 microversion: 2.91 time: 0.427969 Aug 31 15:59:18.629526 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1172/2426] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:18 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1544 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:18.647903 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1458d348-ccd6-4dd1-a02c-fd619229509e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:18.650885 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1458d348-ccd6-4dd1-a02c-fd619229509e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:19.758201 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1458d348-ccd6-4dd1-a02c-fd619229509e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:19.768469 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1458d348-ccd6-4dd1-a02c-fd619229509e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1239 microversion: 2.1 time: 1.137363 Aug 31 15:59:19.775157 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1173/2427] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:18 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1239 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:19.792060 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-243d311f-925f-4bb5-a9ce-aa527f3add27 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:19.794030 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-243d311f-925f-4bb5-a9ce-aa527f3add27 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 320bf21c-eec1-43ea-a496-059fccc2642f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:19.817836 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-243d311f-925f-4bb5-a9ce-aa527f3add27 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:19.823050 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-243d311f-925f-4bb5-a9ce-aa527f3add27 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:19.825390 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-243d311f-925f-4bb5-a9ce-aa527f3add27 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:19.826318 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-243d311f-925f-4bb5-a9ce-aa527f3add27 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:19.827397 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-243d311f-925f-4bb5-a9ce-aa527f3add27 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:19.828950 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-243d311f-925f-4bb5-a9ce-aa527f3add27 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:20.680593 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ea90dd20-1365-4f30-a150-a30cdd9a9258 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922a671cad44ea595e46290a5d52380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1371996a8304dc58ee579daa535bcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:20.702242 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ea90dd20-1365-4f30-a150-a30cdd9a9258 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae" status: 200 len: 1505 microversion: 2.1 time: 2.289790 Aug 31 15:59:20.707271 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1255/2428] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:18 2022] GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae => generated 1505 bytes in 2298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:20.772852 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-27355795-cde8-4f15-961c-0cf9cb4f8893 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:20.776932 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-27355795-cde8-4f15-961c-0cf9cb4f8893 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:20.804867 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-27355795-cde8-4f15-961c-0cf9cb4f8893 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:20.805369 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-27355795-cde8-4f15-961c-0cf9cb4f8893 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:20.805884 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-27355795-cde8-4f15-961c-0cf9cb4f8893 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:20.818569 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-27355795-cde8-4f15-961c-0cf9cb4f8893 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:20.819170 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-27355795-cde8-4f15-961c-0cf9cb4f8893 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:20.819555 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-27355795-cde8-4f15-961c-0cf9cb4f8893 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:20.832606 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-243d311f-925f-4bb5-a9ce-aa527f3add27 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:20.842889 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-243d311f-925f-4bb5-a9ce-aa527f3add27 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f" status: 200 len: 1513 microversion: 2.1 time: 1.066062 Aug 31 15:59:20.847079 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1174/2429] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:19 2022] GET /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f => generated 1513 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:20.872156 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-095ee8de-7fac-4ba2-968f-36b38c9dda2e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:20.880610 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-095ee8de-7fac-4ba2-968f-36b38c9dda2e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:20.915443 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-095ee8de-7fac-4ba2-968f-36b38c9dda2e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:20.916896 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-095ee8de-7fac-4ba2-968f-36b38c9dda2e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:20.918207 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-095ee8de-7fac-4ba2-968f-36b38c9dda2e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:20.919790 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-095ee8de-7fac-4ba2-968f-36b38c9dda2e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:20.921878 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-095ee8de-7fac-4ba2-968f-36b38c9dda2e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:20.923163 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-095ee8de-7fac-4ba2-968f-36b38c9dda2e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:21.185634 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-095ee8de-7fac-4ba2-968f-36b38c9dda2e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:21.204635 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-27355795-cde8-4f15-961c-0cf9cb4f8893 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:21.205333 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-095ee8de-7fac-4ba2-968f-36b38c9dda2e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1291 microversion: 2.1 time: 0.326258 Aug 31 15:59:21.206280 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1175/2430] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:20 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1291 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:21.229104 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-27355795-cde8-4f15-961c-0cf9cb4f8893 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:21.233718 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-27355795-cde8-4f15-961c-0cf9cb4f8893 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:21.256670 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-27355795-cde8-4f15-961c-0cf9cb4f8893 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1544 microversion: 2.91 time: 0.547015 Aug 31 15:59:21.257305 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1256/2431] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:20 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1544 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:21.728930 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7fd70cfd-06a9-4b8e-9956-f4d8361ba0d2 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:21.729960 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7fd70cfd-06a9-4b8e-9956-f4d8361ba0d2 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: 13cdbabc-03ef-4025-b984-4bba559857ae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:21.747706 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fd70cfd-06a9-4b8e-9956-f4d8361ba0d2 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:21.750642 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fd70cfd-06a9-4b8e-9956-f4d8361ba0d2 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:21.751416 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fd70cfd-06a9-4b8e-9956-f4d8361ba0d2 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:21.753491 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fd70cfd-06a9-4b8e-9956-f4d8361ba0d2 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:21.757074 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fd70cfd-06a9-4b8e-9956-f4d8361ba0d2 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:21.763563 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fd70cfd-06a9-4b8e-9956-f4d8361ba0d2 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:21.868094 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-364dc024-4a8f-490f-80ab-13741fb9396b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:21.869321 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-364dc024-4a8f-490f-80ab-13741fb9396b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 320bf21c-eec1-43ea-a496-059fccc2642f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:21.885215 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-364dc024-4a8f-490f-80ab-13741fb9396b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:21.888503 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-364dc024-4a8f-490f-80ab-13741fb9396b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:21.889154 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-364dc024-4a8f-490f-80ab-13741fb9396b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:21.890058 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-364dc024-4a8f-490f-80ab-13741fb9396b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:21.892538 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-364dc024-4a8f-490f-80ab-13741fb9396b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:21.893188 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-364dc024-4a8f-490f-80ab-13741fb9396b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:23.140102 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-364dc024-4a8f-490f-80ab-13741fb9396b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:23.152876 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7fd70cfd-06a9-4b8e-9956-f4d8361ba0d2 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922a671cad44ea595e46290a5d52380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1371996a8304dc58ee579daa535bcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:23.163854 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7fd70cfd-06a9-4b8e-9956-f4d8361ba0d2 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae" status: 200 len: 1505 microversion: 2.1 time: 1.440092 Aug 31 15:59:23.167634 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-364dc024-4a8f-490f-80ab-13741fb9396b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f" status: 200 len: 1513 microversion: 2.1 time: 1.300358 Aug 31 15:59:23.169267 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1176/2432] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:21 2022] GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae => generated 1505 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:23.182992 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1257/2433] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:21 2022] GET /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f => generated 1513 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:23.191532 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-55cad519-cedf-45cc-bd78-0ea922728865 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:23.196301 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-55cad519-cedf-45cc-bd78-0ea922728865 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:23.207204 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f6d50bfa-7645-4e73-8a6f-f42561a42df5 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:23.207825 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f6d50bfa-7645-4e73-8a6f-f42561a42df5 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:23.211959 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-55cad519-cedf-45cc-bd78-0ea922728865 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:23.213068 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-55cad519-cedf-45cc-bd78-0ea922728865 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:23.213849 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-55cad519-cedf-45cc-bd78-0ea922728865 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:23.215016 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-55cad519-cedf-45cc-bd78-0ea922728865 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:23.215914 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-55cad519-cedf-45cc-bd78-0ea922728865 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:23.216664 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-55cad519-cedf-45cc-bd78-0ea922728865 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:23.241021 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6d50bfa-7645-4e73-8a6f-f42561a42df5 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:23.241766 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6d50bfa-7645-4e73-8a6f-f42561a42df5 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:23.242450 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6d50bfa-7645-4e73-8a6f-f42561a42df5 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:23.246917 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6d50bfa-7645-4e73-8a6f-f42561a42df5 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:23.247457 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6d50bfa-7645-4e73-8a6f-f42561a42df5 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:23.247875 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6d50bfa-7645-4e73-8a6f-f42561a42df5 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:23.436885 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f6d50bfa-7645-4e73-8a6f-f42561a42df5 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:23.462221 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f6d50bfa-7645-4e73-8a6f-f42561a42df5 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:23.470570 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f6d50bfa-7645-4e73-8a6f-f42561a42df5 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:23.488299 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f6d50bfa-7645-4e73-8a6f-f42561a42df5 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1544 microversion: 2.91 time: 0.303607 Aug 31 15:59:23.498226 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1177/2434] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:23 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1544 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:23.582456 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-55cad519-cedf-45cc-bd78-0ea922728865 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:23.628047 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-55cad519-cedf-45cc-bd78-0ea922728865 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1297 microversion: 2.1 time: 0.453645 Aug 31 15:59:23.654276 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1258/2435] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:23 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1297 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:24.198584 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-09a7a25b-43e7-4061-9cce-9de6e6af7657 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:24.200015 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-09a7a25b-43e7-4061-9cce-9de6e6af7657 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: 13cdbabc-03ef-4025-b984-4bba559857ae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:24.213467 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e9650d65-1b4d-4faa-ba7d-405ede3291e3 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:24.214802 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e9650d65-1b4d-4faa-ba7d-405ede3291e3 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 320bf21c-eec1-43ea-a496-059fccc2642f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:24.223008 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09a7a25b-43e7-4061-9cce-9de6e6af7657 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:24.228212 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09a7a25b-43e7-4061-9cce-9de6e6af7657 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:24.251428 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09a7a25b-43e7-4061-9cce-9de6e6af7657 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:24.252459 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09a7a25b-43e7-4061-9cce-9de6e6af7657 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:24.276025 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09a7a25b-43e7-4061-9cce-9de6e6af7657 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:24.276551 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09a7a25b-43e7-4061-9cce-9de6e6af7657 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:24.285939 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e9650d65-1b4d-4faa-ba7d-405ede3291e3 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:24.287092 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e9650d65-1b4d-4faa-ba7d-405ede3291e3 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:24.289001 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e9650d65-1b4d-4faa-ba7d-405ede3291e3 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:24.310772 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e9650d65-1b4d-4faa-ba7d-405ede3291e3 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:24.311469 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e9650d65-1b4d-4faa-ba7d-405ede3291e3 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:24.311921 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e9650d65-1b4d-4faa-ba7d-405ede3291e3 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:24.406715 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:59:25.472102 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e9650d65-1b4d-4faa-ba7d-405ede3291e3 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:25.481788 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e9650d65-1b4d-4faa-ba7d-405ede3291e3 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f" status: 200 len: 1513 microversion: 2.1 time: 1.272947 Aug 31 15:59:25.485758 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1259/2436] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:24 2022] GET /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f => generated 1513 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:59:25.500559 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e0cd0f45-eff0-40e3-b080-4abfb3cbc645 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:25.501199 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e0cd0f45-eff0-40e3-b080-4abfb3cbc645 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:25.518751 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e0cd0f45-eff0-40e3-b080-4abfb3cbc645 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:25.519420 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e0cd0f45-eff0-40e3-b080-4abfb3cbc645 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:25.520030 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e0cd0f45-eff0-40e3-b080-4abfb3cbc645 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:25.520999 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e0cd0f45-eff0-40e3-b080-4abfb3cbc645 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:25.521824 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e0cd0f45-eff0-40e3-b080-4abfb3cbc645 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:25.522432 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e0cd0f45-eff0-40e3-b080-4abfb3cbc645 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:25.549927 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-09a7a25b-43e7-4061-9cce-9de6e6af7657 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922a671cad44ea595e46290a5d52380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1371996a8304dc58ee579daa535bcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:25.578949 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-09a7a25b-43e7-4061-9cce-9de6e6af7657 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae" status: 200 len: 1485 microversion: 2.1 time: 1.381708 Aug 31 15:59:25.581772 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1178/2437] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:24 2022] GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae => generated 1485 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:25.603873 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-02324c35-94d0-499b-92ea-7b3b574d8099 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:25.635809 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-02324c35-94d0-499b-92ea-7b3b574d8099 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:25.661159 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02324c35-94d0-499b-92ea-7b3b574d8099 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:25.662635 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02324c35-94d0-499b-92ea-7b3b574d8099 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:25.665002 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02324c35-94d0-499b-92ea-7b3b574d8099 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:25.665955 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02324c35-94d0-499b-92ea-7b3b574d8099 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:25.668148 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02324c35-94d0-499b-92ea-7b3b574d8099 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:25.669155 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02324c35-94d0-499b-92ea-7b3b574d8099 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:25.722410 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e0cd0f45-eff0-40e3-b080-4abfb3cbc645 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:25.747980 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e0cd0f45-eff0-40e3-b080-4abfb3cbc645 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:25.749562 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e0cd0f45-eff0-40e3-b080-4abfb3cbc645 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:25.779440 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e0cd0f45-eff0-40e3-b080-4abfb3cbc645 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1544 microversion: 2.91 time: 0.290584 Aug 31 15:59:25.780043 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1260/2438] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:25 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1544 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:25.790419 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9a63bd3c-2c33-4c9c-96a1-faf8ebc4b088 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:59:25.790828 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9a63bd3c-2c33-4c9c-96a1-faf8ebc4b088 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: 13cdbabc-03ef-4025-b984-4bba559857ae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:25.805574 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9a63bd3c-2c33-4c9c-96a1-faf8ebc4b088 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:25.806062 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9a63bd3c-2c33-4c9c-96a1-faf8ebc4b088 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:25.806704 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9a63bd3c-2c33-4c9c-96a1-faf8ebc4b088 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:25.807597 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9a63bd3c-2c33-4c9c-96a1-faf8ebc4b088 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:25.808590 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9a63bd3c-2c33-4c9c-96a1-faf8ebc4b088 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:25.809601 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9a63bd3c-2c33-4c9c-96a1-faf8ebc4b088 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:25.951194 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9a63bd3c-2c33-4c9c-96a1-faf8ebc4b088 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "POST /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae/action" status: 202 len: 0 microversion: 2.1 time: 0.169846 Aug 31 15:59:25.967453 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1261/2439] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 15:59:25 2022] POST /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:59:25.989073 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-72885731-d5ed-4019-89a9-503bfbf9031a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:26.006536 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-72885731-d5ed-4019-89a9-503bfbf9031a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: 13cdbabc-03ef-4025-b984-4bba559857ae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:26.019431 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-72885731-d5ed-4019-89a9-503bfbf9031a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:26.023933 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-72885731-d5ed-4019-89a9-503bfbf9031a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:26.024650 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-72885731-d5ed-4019-89a9-503bfbf9031a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:26.025586 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-72885731-d5ed-4019-89a9-503bfbf9031a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:26.029134 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-72885731-d5ed-4019-89a9-503bfbf9031a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:26.029863 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-72885731-d5ed-4019-89a9-503bfbf9031a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:26.677391 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-02324c35-94d0-499b-92ea-7b3b574d8099 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:26.743390 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-02324c35-94d0-499b-92ea-7b3b574d8099 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1365 microversion: 2.1 time: 1.158288 Aug 31 15:59:26.750450 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1179/2440] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:25 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1365 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:26.792414 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-72885731-d5ed-4019-89a9-503bfbf9031a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922a671cad44ea595e46290a5d52380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1371996a8304dc58ee579daa535bcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:26.804983 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-781d1a0f-d2c1-4cba-aac3-3aabafd7ede2 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:26.805778 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-781d1a0f-d2c1-4cba-aac3-3aabafd7ede2 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 320bf21c-eec1-43ea-a496-059fccc2642f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:26.811430 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-72885731-d5ed-4019-89a9-503bfbf9031a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae" status: 200 len: 1493 microversion: 2.1 time: 0.836271 Aug 31 15:59:26.831888 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1262/2441] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:25 2022] GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae => generated 1493 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:26.843510 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-781d1a0f-d2c1-4cba-aac3-3aabafd7ede2 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:26.844841 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-889c3ef6-b8bb-4d51-ae8c-18b66ab95113 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:26.845668 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-781d1a0f-d2c1-4cba-aac3-3aabafd7ede2 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:26.848875 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-889c3ef6-b8bb-4d51-ae8c-18b66ab95113 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:26.850395 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-781d1a0f-d2c1-4cba-aac3-3aabafd7ede2 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:26.857382 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-781d1a0f-d2c1-4cba-aac3-3aabafd7ede2 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:26.858478 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-781d1a0f-d2c1-4cba-aac3-3aabafd7ede2 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:26.858814 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-781d1a0f-d2c1-4cba-aac3-3aabafd7ede2 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:26.873150 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-889c3ef6-b8bb-4d51-ae8c-18b66ab95113 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:26.873653 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-889c3ef6-b8bb-4d51-ae8c-18b66ab95113 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:26.874111 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-889c3ef6-b8bb-4d51-ae8c-18b66ab95113 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:26.883197 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-889c3ef6-b8bb-4d51-ae8c-18b66ab95113 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:26.883691 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-889c3ef6-b8bb-4d51-ae8c-18b66ab95113 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:26.884132 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-889c3ef6-b8bb-4d51-ae8c-18b66ab95113 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:27.113577 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-889c3ef6-b8bb-4d51-ae8c-18b66ab95113 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:27.126812 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-889c3ef6-b8bb-4d51-ae8c-18b66ab95113 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:27.128288 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-889c3ef6-b8bb-4d51-ae8c-18b66ab95113 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:27.144087 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-889c3ef6-b8bb-4d51-ae8c-18b66ab95113 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1544 microversion: 2.91 time: 0.310982 Aug 31 15:59:27.160002 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1263/2442] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:26 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1544 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:27.458663 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-781d1a0f-d2c1-4cba-aac3-3aabafd7ede2 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:27.469743 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-781d1a0f-d2c1-4cba-aac3-3aabafd7ede2 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f" status: 200 len: 1513 microversion: 2.1 time: 0.714724 Aug 31 15:59:27.470386 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1180/2443] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:26 2022] GET /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f => generated 1513 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:27.786357 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2b75b51c-dc05-48d1-ae21-8519cb3250c0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:27.787096 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2b75b51c-dc05-48d1-ae21-8519cb3250c0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:27.805716 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b75b51c-dc05-48d1-ae21-8519cb3250c0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:27.806420 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b75b51c-dc05-48d1-ae21-8519cb3250c0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:27.810131 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b75b51c-dc05-48d1-ae21-8519cb3250c0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:27.820391 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b75b51c-dc05-48d1-ae21-8519cb3250c0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:27.821693 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b75b51c-dc05-48d1-ae21-8519cb3250c0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:27.824022 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b75b51c-dc05-48d1-ae21-8519cb3250c0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:27.836972 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-325691b2-a0af-4988-96aa-9c8404357e50 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:27.837677 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-325691b2-a0af-4988-96aa-9c8404357e50 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: 13cdbabc-03ef-4025-b984-4bba559857ae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:27.845387 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-325691b2-a0af-4988-96aa-9c8404357e50 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:27.853071 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-325691b2-a0af-4988-96aa-9c8404357e50 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:27.853673 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-325691b2-a0af-4988-96aa-9c8404357e50 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:27.854600 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-325691b2-a0af-4988-96aa-9c8404357e50 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:27.857261 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-325691b2-a0af-4988-96aa-9c8404357e50 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:27.857861 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-325691b2-a0af-4988-96aa-9c8404357e50 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:28.107045 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:59:28.215943 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=6 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:59:28.523058 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2b75b51c-dc05-48d1-ae21-8519cb3250c0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:28.537227 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2b75b51c-dc05-48d1-ae21-8519cb3250c0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1365 microversion: 2.1 time: 0.765561 Aug 31 15:59:28.538200 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1264/2444] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:27 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1365 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:28.546119 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f9b14494-9afe-43cf-a4b4-4c4d1fadda0a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:28.565403 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f9b14494-9afe-43cf-a4b4-4c4d1fadda0a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:28.583855 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f9b14494-9afe-43cf-a4b4-4c4d1fadda0a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:28.587748 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f9b14494-9afe-43cf-a4b4-4c4d1fadda0a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:28.588595 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f9b14494-9afe-43cf-a4b4-4c4d1fadda0a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:28.591357 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f9b14494-9afe-43cf-a4b4-4c4d1fadda0a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:28.592507 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f9b14494-9afe-43cf-a4b4-4c4d1fadda0a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:28.594552 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f9b14494-9afe-43cf-a4b4-4c4d1fadda0a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:28.650310 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-325691b2-a0af-4988-96aa-9c8404357e50 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922a671cad44ea595e46290a5d52380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1371996a8304dc58ee579daa535bcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:28.662392 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-325691b2-a0af-4988-96aa-9c8404357e50 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae" status: 200 len: 1493 microversion: 2.1 time: 0.828510 Aug 31 15:59:28.677993 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1181/2445] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:27 2022] GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae => generated 1493 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:28.683794 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-19625dec-b114-464c-9888-952ec0a04ae7 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:28.688816 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-19625dec-b114-464c-9888-952ec0a04ae7 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 320bf21c-eec1-43ea-a496-059fccc2642f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:28.699218 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19625dec-b114-464c-9888-952ec0a04ae7 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:28.700093 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19625dec-b114-464c-9888-952ec0a04ae7 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:28.700731 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19625dec-b114-464c-9888-952ec0a04ae7 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:28.701802 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19625dec-b114-464c-9888-952ec0a04ae7 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:28.702474 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19625dec-b114-464c-9888-952ec0a04ae7 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:28.703322 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19625dec-b114-464c-9888-952ec0a04ae7 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:28.903375 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f9b14494-9afe-43cf-a4b4-4c4d1fadda0a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:28.915670 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f9b14494-9afe-43cf-a4b4-4c4d1fadda0a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:28.917136 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f9b14494-9afe-43cf-a4b4-4c4d1fadda0a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:28.930113 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f9b14494-9afe-43cf-a4b4-4c4d1fadda0a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1544 microversion: 2.91 time: 0.390360 Aug 31 15:59:28.930738 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1265/2446] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:28 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1544 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:28.945103 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-097e28ac-9a51-4b3a-951a-978508b52240 req-1da318ad-44e1-4413-9822-a9ba5cc3f8b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b", "tag": "4e98deab-3424-49ec-b930-3019d71c32c7"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:59:28.967495 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-097e28ac-9a51-4b3a-951a-978508b52240 req-1da318ad-44e1-4413-9822-a9ba5cc3f8b9 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:28.971398 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-097e28ac-9a51-4b3a-951a-978508b52240 req-1da318ad-44e1-4413-9822-a9ba5cc3f8b9 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:28.976771 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-097e28ac-9a51-4b3a-951a-978508b52240 req-1da318ad-44e1-4413-9822-a9ba5cc3f8b9 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:29.011074 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-097e28ac-9a51-4b3a-951a-978508b52240 req-1da318ad-44e1-4413-9822-a9ba5cc3f8b9 service nova] Creating event network-changed:4e98deab-3424-49ec-b930-3019d71c32c7 for instance 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b on n-h1-833090-16 Aug 31 15:59:29.028547 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-097e28ac-9a51-4b3a-951a-978508b52240 req-1da318ad-44e1-4413-9822-a9ba5cc3f8b9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087752 Aug 31 15:59:29.029376 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1266/2447] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:59:29.559865 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2aa4c6e3-339e-4c64-81c3-4390b367d870 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:29.560760 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2aa4c6e3-339e-4c64-81c3-4390b367d870 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:29.569819 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2aa4c6e3-339e-4c64-81c3-4390b367d870 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:29.581092 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2aa4c6e3-339e-4c64-81c3-4390b367d870 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:29.587839 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2aa4c6e3-339e-4c64-81c3-4390b367d870 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:29.588856 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2aa4c6e3-339e-4c64-81c3-4390b367d870 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:29.589573 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2aa4c6e3-339e-4c64-81c3-4390b367d870 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:29.590225 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2aa4c6e3-339e-4c64-81c3-4390b367d870 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:29.762906 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:59:29.904122 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-19625dec-b114-464c-9888-952ec0a04ae7 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:29.914390 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-19625dec-b114-464c-9888-952ec0a04ae7 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f" status: 200 len: 1513 microversion: 2.1 time: 1.234745 Aug 31 15:59:29.915779 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1182/2448] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:28 2022] GET /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f => generated 1513 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:29.921238 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7a4f643e-17a1-4901-a9fc-d2f799080d5f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:29.922261 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7a4f643e-17a1-4901-a9fc-d2f799080d5f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: 13cdbabc-03ef-4025-b984-4bba559857ae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:29.935146 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a4f643e-17a1-4901-a9fc-d2f799080d5f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:29.936280 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a4f643e-17a1-4901-a9fc-d2f799080d5f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:29.937052 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a4f643e-17a1-4901-a9fc-d2f799080d5f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:29.938593 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a4f643e-17a1-4901-a9fc-d2f799080d5f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:29.939288 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a4f643e-17a1-4901-a9fc-d2f799080d5f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:29.940164 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a4f643e-17a1-4901-a9fc-d2f799080d5f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:30.403082 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2aa4c6e3-339e-4c64-81c3-4390b367d870 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:30.411071 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2aa4c6e3-339e-4c64-81c3-4390b367d870 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1365 microversion: 2.1 time: 0.855624 Aug 31 15:59:30.423215 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1267/2449] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:29 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1365 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:30.431229 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-69371a66-37a6-4a9c-92a9-52a8604c35ed tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:30.432355 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-69371a66-37a6-4a9c-92a9-52a8604c35ed tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:30.439768 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69371a66-37a6-4a9c-92a9-52a8604c35ed tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:30.442815 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69371a66-37a6-4a9c-92a9-52a8604c35ed tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:30.443686 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69371a66-37a6-4a9c-92a9-52a8604c35ed tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:30.444681 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69371a66-37a6-4a9c-92a9-52a8604c35ed tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:30.446400 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69371a66-37a6-4a9c-92a9-52a8604c35ed tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:30.447287 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69371a66-37a6-4a9c-92a9-52a8604c35ed tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:30.659909 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-69371a66-37a6-4a9c-92a9-52a8604c35ed tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:30.672014 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-69371a66-37a6-4a9c-92a9-52a8604c35ed tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:30.674333 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-69371a66-37a6-4a9c-92a9-52a8604c35ed tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:30.681286 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-69371a66-37a6-4a9c-92a9-52a8604c35ed tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1531 microversion: 2.91 time: 0.256649 Aug 31 15:59:30.683007 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1268/2450] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:30 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1531 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:30.685438 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7a4f643e-17a1-4901-a9fc-d2f799080d5f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922a671cad44ea595e46290a5d52380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1371996a8304dc58ee579daa535bcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:30.695929 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7a4f643e-17a1-4901-a9fc-d2f799080d5f tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae" status: 200 len: 1493 microversion: 2.1 time: 0.778690 Aug 31 15:59:30.699752 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1183/2451] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:29 2022] GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae => generated 1493 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:30.717732 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5d7d6b6c-e68f-44a1-ba08-8c2c3a57159c tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:30.718394 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5d7d6b6c-e68f-44a1-ba08-8c2c3a57159c tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:30.733615 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5d7d6b6c-e68f-44a1-ba08-8c2c3a57159c tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:30.734796 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5d7d6b6c-e68f-44a1-ba08-8c2c3a57159c tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:30.735735 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5d7d6b6c-e68f-44a1-ba08-8c2c3a57159c tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:30.736903 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5d7d6b6c-e68f-44a1-ba08-8c2c3a57159c tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:30.738924 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5d7d6b6c-e68f-44a1-ba08-8c2c3a57159c tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:30.739813 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5d7d6b6c-e68f-44a1-ba08-8c2c3a57159c tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:30.940765 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ebb22414-74f3-437f-b8a4-29b5b4f2f831 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:30.942319 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ebb22414-74f3-437f-b8a4-29b5b4f2f831 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 320bf21c-eec1-43ea-a496-059fccc2642f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:30.952623 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:59:30.954492 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebb22414-74f3-437f-b8a4-29b5b4f2f831 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:30.959207 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebb22414-74f3-437f-b8a4-29b5b4f2f831 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:30.961075 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebb22414-74f3-437f-b8a4-29b5b4f2f831 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:30.963225 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebb22414-74f3-437f-b8a4-29b5b4f2f831 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:30.964875 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebb22414-74f3-437f-b8a4-29b5b4f2f831 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:30.966676 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebb22414-74f3-437f-b8a4-29b5b4f2f831 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:30.977562 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-5d7d6b6c-e68f-44a1-ba08-8c2c3a57159c tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] Lazy-loading 'services' on Instance uuid 05236fda-96c7-419a-95f9-9d90d6e4ce78 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:59:31.029637 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5d7d6b6c-e68f-44a1-ba08-8c2c3a57159c tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1938 microversion: 2.91 time: 0.320860 Aug 31 15:59:31.031919 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1269/2452] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:30 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1938 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:31.064921 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-efeadd3b-c747-4e81-a09e-a808b3f519d8 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:59:31.065464 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-efeadd3b-c747-4e81-a09e-a808b3f519d8 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:31.073019 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-efeadd3b-c747-4e81-a09e-a808b3f519d8 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:31.073522 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-efeadd3b-c747-4e81-a09e-a808b3f519d8 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:31.074071 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-efeadd3b-c747-4e81-a09e-a808b3f519d8 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:31.074833 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-efeadd3b-c747-4e81-a09e-a808b3f519d8 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:31.075458 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-efeadd3b-c747-4e81-a09e-a808b3f519d8 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:31.076543 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-efeadd3b-c747-4e81-a09e-a808b3f519d8 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:31.120463 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-efeadd3b-c747-4e81-a09e-a808b3f519d8 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lazy-loading 'flavor' on Instance uuid 05236fda-96c7-419a-95f9-9d90d6e4ce78 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:59:31.555431 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-efeadd3b-c747-4e81-a09e-a808b3f519d8 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "POST /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78/action" status: 202 len: 0 microversion: 2.91 time: 0.497089 Aug 31 15:59:31.559510 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1270/2453] 10.222.0.50 () {62 vars in 1319 bytes} [Wed Aug 31 15:59:31 2022] POST /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78/action => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:59:31.572565 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f8d64cc0-049a-449d-899e-ccd8b39a2b2a tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:31.573631 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f8d64cc0-049a-449d-899e-ccd8b39a2b2a tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:31.596622 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f8d64cc0-049a-449d-899e-ccd8b39a2b2a tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:31.597126 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f8d64cc0-049a-449d-899e-ccd8b39a2b2a tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:31.597556 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f8d64cc0-049a-449d-899e-ccd8b39a2b2a tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:31.606588 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f8d64cc0-049a-449d-899e-ccd8b39a2b2a tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:31.607482 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f8d64cc0-049a-449d-899e-ccd8b39a2b2a tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:31.608117 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f8d64cc0-049a-449d-899e-ccd8b39a2b2a tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:31.891830 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ebb22414-74f3-437f-b8a4-29b5b4f2f831 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:31.903534 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ebb22414-74f3-437f-b8a4-29b5b4f2f831 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f" status: 200 len: 1513 microversion: 2.1 time: 0.970374 Aug 31 15:59:31.905027 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1184/2454] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:30 2022] GET /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f => generated 1513 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:59:31.923356 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d2d70e7e-f566-4e04-bbc5-259fbcb2d37a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:31.925175 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d2d70e7e-f566-4e04-bbc5-259fbcb2d37a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:31.944213 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2d70e7e-f566-4e04-bbc5-259fbcb2d37a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:31.944923 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2d70e7e-f566-4e04-bbc5-259fbcb2d37a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:31.945381 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2d70e7e-f566-4e04-bbc5-259fbcb2d37a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:31.946216 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2d70e7e-f566-4e04-bbc5-259fbcb2d37a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:31.948539 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2d70e7e-f566-4e04-bbc5-259fbcb2d37a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:31.949375 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2d70e7e-f566-4e04-bbc5-259fbcb2d37a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:32.002724 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:59:32.095675 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f8d64cc0-049a-449d-899e-ccd8b39a2b2a tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:32.109070 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f8d64cc0-049a-449d-899e-ccd8b39a2b2a tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1365 microversion: 2.1 time: 0.548167 Aug 31 15:59:32.110471 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1271/2455] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:31 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1365 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:32.122963 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b8994778-2265-4334-b7cf-0d750e89eb6a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:32.123935 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b8994778-2265-4334-b7cf-0d750e89eb6a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: 13cdbabc-03ef-4025-b984-4bba559857ae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:32.142213 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b8994778-2265-4334-b7cf-0d750e89eb6a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:32.142947 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b8994778-2265-4334-b7cf-0d750e89eb6a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:32.144580 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b8994778-2265-4334-b7cf-0d750e89eb6a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:32.147895 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b8994778-2265-4334-b7cf-0d750e89eb6a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:32.148607 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b8994778-2265-4334-b7cf-0d750e89eb6a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:32.150986 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b8994778-2265-4334-b7cf-0d750e89eb6a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:32.241501 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d2d70e7e-f566-4e04-bbc5-259fbcb2d37a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:32.264280 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d2d70e7e-f566-4e04-bbc5-259fbcb2d37a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:32.265773 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d2d70e7e-f566-4e04-bbc5-259fbcb2d37a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:32.278529 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d2d70e7e-f566-4e04-bbc5-259fbcb2d37a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1537 microversion: 2.91 time: 0.369453 Aug 31 15:59:32.286498 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1185/2456] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:31 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1537 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:32.715872 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b8994778-2265-4334-b7cf-0d750e89eb6a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922a671cad44ea595e46290a5d52380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1371996a8304dc58ee579daa535bcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:32.724304 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b8994778-2265-4334-b7cf-0d750e89eb6a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae" status: 200 len: 1499 microversion: 2.1 time: 0.606930 Aug 31 15:59:32.738769 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1272/2457] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:32 2022] GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae => generated 1499 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:32.757451 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-47cdfe3e-e965-4d24-b398-917f7ccd8f36 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:32.758244 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-47cdfe3e-e965-4d24-b398-917f7ccd8f36 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: 13cdbabc-03ef-4025-b984-4bba559857ae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:32.783522 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47cdfe3e-e965-4d24-b398-917f7ccd8f36 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:32.784373 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47cdfe3e-e965-4d24-b398-917f7ccd8f36 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:32.785021 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47cdfe3e-e965-4d24-b398-917f7ccd8f36 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:32.785950 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47cdfe3e-e965-4d24-b398-917f7ccd8f36 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:32.786708 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47cdfe3e-e965-4d24-b398-917f7ccd8f36 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:32.787386 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47cdfe3e-e965-4d24-b398-917f7ccd8f36 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:32.819353 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-47cdfe3e-e965-4d24-b398-917f7ccd8f36 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: 13cdbabc-03ef-4025-b984-4bba559857ae] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:59:32.927059 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-09bf029e-2298-44ce-9114-fdd5d8b48779 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:32.928070 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-09bf029e-2298-44ce-9114-fdd5d8b48779 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 320bf21c-eec1-43ea-a496-059fccc2642f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:32.945594 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-09bf029e-2298-44ce-9114-fdd5d8b48779 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:32.948151 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-09bf029e-2298-44ce-9114-fdd5d8b48779 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:32.949654 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-09bf029e-2298-44ce-9114-fdd5d8b48779 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:32.951740 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-09bf029e-2298-44ce-9114-fdd5d8b48779 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:32.954312 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-09bf029e-2298-44ce-9114-fdd5d8b48779 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:32.955790 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-09bf029e-2298-44ce-9114-fdd5d8b48779 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:32.970382 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:59:32.973881 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-47cdfe3e-e965-4d24-b398-917f7ccd8f36 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "DELETE /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae" status: 204 len: 0 microversion: 2.1 time: 0.220663 Aug 31 15:59:32.982974 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1186/2458] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:59:32 2022] DELETE /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:59:32.991821 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c22c663a-2d20-4c9e-b3b0-fa034202eea7 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:32.992814 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c22c663a-2d20-4c9e-b3b0-fa034202eea7 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: 13cdbabc-03ef-4025-b984-4bba559857ae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:33.001314 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c22c663a-2d20-4c9e-b3b0-fa034202eea7 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:33.002163 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c22c663a-2d20-4c9e-b3b0-fa034202eea7 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:33.002798 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c22c663a-2d20-4c9e-b3b0-fa034202eea7 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:33.004575 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c22c663a-2d20-4c9e-b3b0-fa034202eea7 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:33.005422 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c22c663a-2d20-4c9e-b3b0-fa034202eea7 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:33.006481 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c22c663a-2d20-4c9e-b3b0-fa034202eea7 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:33.837261 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-09bf029e-2298-44ce-9114-fdd5d8b48779 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:33.851596 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-09bf029e-2298-44ce-9114-fdd5d8b48779 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f" status: 200 len: 1513 microversion: 2.1 time: 0.929828 Aug 31 15:59:33.852186 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1273/2459] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:32 2022] GET /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f => generated 1513 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:59:33.862555 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1ec9694c-12ab-406f-991a-f877c5c52b55 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:33.867602 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1ec9694c-12ab-406f-991a-f877c5c52b55 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:33.892568 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:59:33.903286 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1ec9694c-12ab-406f-991a-f877c5c52b55 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:33.906829 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1ec9694c-12ab-406f-991a-f877c5c52b55 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:33.907377 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1ec9694c-12ab-406f-991a-f877c5c52b55 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:33.908207 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1ec9694c-12ab-406f-991a-f877c5c52b55 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:33.908747 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1ec9694c-12ab-406f-991a-f877c5c52b55 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:33.912543 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1ec9694c-12ab-406f-991a-f877c5c52b55 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:34.059814 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c22c663a-2d20-4c9e-b3b0-fa034202eea7 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922a671cad44ea595e46290a5d52380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1371996a8304dc58ee579daa535bcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:34.076337 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c22c663a-2d20-4c9e-b3b0-fa034202eea7 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae" status: 200 len: 1505 microversion: 2.1 time: 1.090710 Aug 31 15:59:34.077819 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1187/2460] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:32 2022] GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae => generated 1505 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:34.086041 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-719b6b75-ff8a-4c21-a10d-f4f9d04b813e tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:34.087756 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-719b6b75-ff8a-4c21-a10d-f4f9d04b813e tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:34.125464 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-719b6b75-ff8a-4c21-a10d-f4f9d04b813e tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:34.126922 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-719b6b75-ff8a-4c21-a10d-f4f9d04b813e tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:34.127953 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-719b6b75-ff8a-4c21-a10d-f4f9d04b813e tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:34.130408 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-719b6b75-ff8a-4c21-a10d-f4f9d04b813e tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:34.132572 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-719b6b75-ff8a-4c21-a10d-f4f9d04b813e tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:34.139818 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-719b6b75-ff8a-4c21-a10d-f4f9d04b813e tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:34.851634 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-719b6b75-ff8a-4c21-a10d-f4f9d04b813e tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:34.868503 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-719b6b75-ff8a-4c21-a10d-f4f9d04b813e tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:34.870122 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-719b6b75-ff8a-4c21-a10d-f4f9d04b813e tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:34.878226 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1ec9694c-12ab-406f-991a-f877c5c52b55 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:34.888061 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1ec9694c-12ab-406f-991a-f877c5c52b55 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1365 microversion: 2.1 time: 1.034262 Aug 31 15:59:34.889301 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1274/2461] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:33 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1365 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:34.894360 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1d1f3d4c-567b-4103-a18f-de90f3380c6b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:34.895188 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1d1f3d4c-567b-4103-a18f-de90f3380c6b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 320bf21c-eec1-43ea-a496-059fccc2642f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:34.896607 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-719b6b75-ff8a-4c21-a10d-f4f9d04b813e tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1537 microversion: 2.91 time: 0.817079 Aug 31 15:59:34.914718 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1188/2462] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:34 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1537 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:34.921203 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1d1f3d4c-567b-4103-a18f-de90f3380c6b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:34.921918 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1d1f3d4c-567b-4103-a18f-de90f3380c6b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:34.922518 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1d1f3d4c-567b-4103-a18f-de90f3380c6b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:34.923380 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1d1f3d4c-567b-4103-a18f-de90f3380c6b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:34.924007 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1d1f3d4c-567b-4103-a18f-de90f3380c6b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:34.924575 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1d1f3d4c-567b-4103-a18f-de90f3380c6b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:35.101828 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ab4cc35a-0bc6-4a53-89d1-a85f6ffeb352 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:35.103340 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ab4cc35a-0bc6-4a53-89d1-a85f6ffeb352 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: 13cdbabc-03ef-4025-b984-4bba559857ae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:35.121129 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab4cc35a-0bc6-4a53-89d1-a85f6ffeb352 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:35.123064 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab4cc35a-0bc6-4a53-89d1-a85f6ffeb352 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:35.123714 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab4cc35a-0bc6-4a53-89d1-a85f6ffeb352 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:35.127073 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab4cc35a-0bc6-4a53-89d1-a85f6ffeb352 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:35.129003 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab4cc35a-0bc6-4a53-89d1-a85f6ffeb352 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:35.129431 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab4cc35a-0bc6-4a53-89d1-a85f6ffeb352 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:35.313875 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1d1f3d4c-567b-4103-a18f-de90f3380c6b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:35.331133 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1d1f3d4c-567b-4103-a18f-de90f3380c6b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f" status: 200 len: 1513 microversion: 2.1 time: 0.440539 Aug 31 15:59:35.331918 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1275/2463] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:34 2022] GET /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f => generated 1513 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:35.584560 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ab4cc35a-0bc6-4a53-89d1-a85f6ffeb352 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922a671cad44ea595e46290a5d52380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1371996a8304dc58ee579daa535bcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:35.600527 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ab4cc35a-0bc6-4a53-89d1-a85f6ffeb352 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae" status: 200 len: 1505 microversion: 2.1 time: 0.496944 Aug 31 15:59:35.601199 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1189/2464] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:35 2022] GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae => generated 1505 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:35.886391 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1072353e-ce70-4c71-9aeb-1417743ab510 tempest-FloatingIPsTestJSON-1743304760 tempest-FloatingIPsTestJSON-1743304760-project] Action: 'create', calling method: .version_select at 0x7fbb4ac52ca0>, body: {"pool": null} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:59:35.911066 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9a84c771-b315-4f78-a519-43ea7c4f072c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:35.911699 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9a84c771-b315-4f78-a519-43ea7c4f072c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:35.924870 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a84c771-b315-4f78-a519-43ea7c4f072c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:35.925371 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a84c771-b315-4f78-a519-43ea7c4f072c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:35.925807 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a84c771-b315-4f78-a519-43ea7c4f072c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:35.926547 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a84c771-b315-4f78-a519-43ea7c4f072c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:35.927174 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a84c771-b315-4f78-a519-43ea7c4f072c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:35.927752 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a84c771-b315-4f78-a519-43ea7c4f072c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:36.668211 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9a84c771-b315-4f78-a519-43ea7c4f072c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:36.691724 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9a84c771-b315-4f78-a519-43ea7c4f072c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1365 microversion: 2.1 time: 0.786127 Aug 31 15:59:36.692985 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1190/2465] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:35 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1365 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 15:59:36.702717 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c38e0d34-b073-4113-b06f-000f01cce83a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:36.703715 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c38e0d34-b073-4113-b06f-000f01cce83a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:36.712968 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c38e0d34-b073-4113-b06f-000f01cce83a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:36.714039 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c38e0d34-b073-4113-b06f-000f01cce83a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:36.714691 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c38e0d34-b073-4113-b06f-000f01cce83a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:36.715603 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c38e0d34-b073-4113-b06f-000f01cce83a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:36.716387 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c38e0d34-b073-4113-b06f-000f01cce83a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:36.717223 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c38e0d34-b073-4113-b06f-000f01cce83a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:37.310288 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c38e0d34-b073-4113-b06f-000f01cce83a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:37.329779 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c38e0d34-b073-4113-b06f-000f01cce83a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:37.331678 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c38e0d34-b073-4113-b06f-000f01cce83a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:37.338030 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c38e0d34-b073-4113-b06f-000f01cce83a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1537 microversion: 2.91 time: 0.643484 Aug 31 15:59:37.342630 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1191/2466] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:36 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1537 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:37.354607 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d9ea0b26-d945-4357-9511-239e8e93b12e tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:37.355417 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d9ea0b26-d945-4357-9511-239e8e93b12e tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 320bf21c-eec1-43ea-a496-059fccc2642f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:37.366029 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9ea0b26-d945-4357-9511-239e8e93b12e tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:37.370575 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9ea0b26-d945-4357-9511-239e8e93b12e tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:37.371407 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9ea0b26-d945-4357-9511-239e8e93b12e tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:37.372373 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9ea0b26-d945-4357-9511-239e8e93b12e tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:37.374233 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9ea0b26-d945-4357-9511-239e8e93b12e tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:37.374949 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9ea0b26-d945-4357-9511-239e8e93b12e tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:37.792388 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d9ea0b26-d945-4357-9511-239e8e93b12e tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:37.805798 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d9ea0b26-d945-4357-9511-239e8e93b12e tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f" status: 200 len: 1490 microversion: 2.1 time: 0.461687 Aug 31 15:59:37.823290 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1192/2467] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:37 2022] GET /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f => generated 1490 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:37.829088 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-966ad832-f8b5-4f5a-a72d-2eefc4379d69 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:37.829979 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-966ad832-f8b5-4f5a-a72d-2eefc4379d69 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: 13cdbabc-03ef-4025-b984-4bba559857ae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:37.837309 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-966ad832-f8b5-4f5a-a72d-2eefc4379d69 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:37.838205 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-966ad832-f8b5-4f5a-a72d-2eefc4379d69 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:37.838877 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-966ad832-f8b5-4f5a-a72d-2eefc4379d69 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:37.839715 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-966ad832-f8b5-4f5a-a72d-2eefc4379d69 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:37.840258 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-966ad832-f8b5-4f5a-a72d-2eefc4379d69 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:37.841107 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-966ad832-f8b5-4f5a-a72d-2eefc4379d69 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:37.986321 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-966ad832-f8b5-4f5a-a72d-2eefc4379d69 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:37.987190 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-966ad832-f8b5-4f5a-a72d-2eefc4379d69 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:37.987987 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-966ad832-f8b5-4f5a-a72d-2eefc4379d69 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:37.988773 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-966ad832-f8b5-4f5a-a72d-2eefc4379d69 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lazy-loading 'fault' on Instance uuid 13cdbabc-03ef-4025-b984-4bba559857ae {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:59:38.108272 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-966ad832-f8b5-4f5a-a72d-2eefc4379d69 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922a671cad44ea595e46290a5d52380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1371996a8304dc58ee579daa535bcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:38.116991 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-966ad832-f8b5-4f5a-a72d-2eefc4379d69 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae" status: 200 len: 1304 microversion: 2.1 time: 0.291198 Aug 31 15:59:38.120426 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1193/2468] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:37 2022] GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae => generated 1304 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:38.148035 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-a950804f-9ef4-4a3c-9ed1-c1a6d3ad2403 req-4e311424-661e-4295-87fa-c01186f0d898 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13cdbabc-03ef-4025-b984-4bba559857ae", "name": "network-vif-deleted", "tag": "d1aa64dc-dced-4b64-b066-475595f92abb"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:59:38.176585 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a950804f-9ef4-4a3c-9ed1-c1a6d3ad2403 req-4e311424-661e-4295-87fa-c01186f0d898 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:38.177221 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a950804f-9ef4-4a3c-9ed1-c1a6d3ad2403 req-4e311424-661e-4295-87fa-c01186f0d898 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:38.178122 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a950804f-9ef4-4a3c-9ed1-c1a6d3ad2403 req-4e311424-661e-4295-87fa-c01186f0d898 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:38.197219 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-a950804f-9ef4-4a3c-9ed1-c1a6d3ad2403 req-4e311424-661e-4295-87fa-c01186f0d898 service nova] Creating event network-vif-deleted:d1aa64dc-dced-4b64-b066-475595f92abb for instance 13cdbabc-03ef-4025-b984-4bba559857ae on n-h2-833090-16 Aug 31 15:59:38.211472 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-a950804f-9ef4-4a3c-9ed1-c1a6d3ad2403 req-4e311424-661e-4295-87fa-c01186f0d898 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067831 Aug 31 15:59:38.212804 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1194/2469] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:59:38.331943 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-c136bd92-8fe8-427a-a83f-ce8d256b696e req-061b95b4-9505-486b-82e3-ae20c5e0cd50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b", "name": "network-vif-plugged", "status": "completed", "tag": "4e98deab-3424-49ec-b930-3019d71c32c7"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:59:38.373527 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c136bd92-8fe8-427a-a83f-ce8d256b696e req-061b95b4-9505-486b-82e3-ae20c5e0cd50 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:38.375510 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c136bd92-8fe8-427a-a83f-ce8d256b696e req-061b95b4-9505-486b-82e3-ae20c5e0cd50 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:38.376050 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c136bd92-8fe8-427a-a83f-ce8d256b696e req-061b95b4-9505-486b-82e3-ae20c5e0cd50 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:38.404057 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-c136bd92-8fe8-427a-a83f-ce8d256b696e req-061b95b4-9505-486b-82e3-ae20c5e0cd50 service nova] Creating event network-vif-plugged:4e98deab-3424-49ec-b930-3019d71c32c7 for instance 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b on n-h1-833090-16 Aug 31 15:59:38.413887 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-c136bd92-8fe8-427a-a83f-ce8d256b696e req-061b95b4-9505-486b-82e3-ae20c5e0cd50 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.199383 Aug 31 15:59:38.415217 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1195/2470] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:59:38.426927 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fb761ed9-8c4c-4e3b-b15d-3861f7cc1716 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:38.427991 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fb761ed9-8c4c-4e3b-b15d-3861f7cc1716 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:38.437624 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb761ed9-8c4c-4e3b-b15d-3861f7cc1716 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:38.438478 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb761ed9-8c4c-4e3b-b15d-3861f7cc1716 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:38.440216 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb761ed9-8c4c-4e3b-b15d-3861f7cc1716 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:38.441229 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb761ed9-8c4c-4e3b-b15d-3861f7cc1716 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:38.441976 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb761ed9-8c4c-4e3b-b15d-3861f7cc1716 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:38.443636 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb761ed9-8c4c-4e3b-b15d-3861f7cc1716 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:38.967228 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fb761ed9-8c4c-4e3b-b15d-3861f7cc1716 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:38.984841 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fb761ed9-8c4c-4e3b-b15d-3861f7cc1716 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1365 microversion: 2.1 time: 0.568055 Aug 31 15:59:38.996083 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1196/2471] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:38 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1365 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:39.011270 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-01529ed1-ee24-4b01-979f-63cbc7aa082b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:39.011270 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-01529ed1-ee24-4b01-979f-63cbc7aa082b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 320bf21c-eec1-43ea-a496-059fccc2642f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:39.023694 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01529ed1-ee24-4b01-979f-63cbc7aa082b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:39.024200 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01529ed1-ee24-4b01-979f-63cbc7aa082b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:39.024641 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01529ed1-ee24-4b01-979f-63cbc7aa082b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:39.025364 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01529ed1-ee24-4b01-979f-63cbc7aa082b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:39.025824 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01529ed1-ee24-4b01-979f-63cbc7aa082b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:39.026292 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01529ed1-ee24-4b01-979f-63cbc7aa082b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:39.101005 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-01529ed1-ee24-4b01-979f-63cbc7aa082b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 320bf21c-eec1-43ea-a496-059fccc2642f] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:59:39.278260 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-01529ed1-ee24-4b01-979f-63cbc7aa082b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "DELETE /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f" status: 204 len: 0 microversion: 2.1 time: 0.278190 Aug 31 15:59:39.280521 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1197/2472] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:59:38 2022] DELETE /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:59:39.293816 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f658a2db-a88b-49cb-b1f3-5b0006cc1755 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:39.298466 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f658a2db-a88b-49cb-b1f3-5b0006cc1755 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:39.319618 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f658a2db-a88b-49cb-b1f3-5b0006cc1755 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:39.321712 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f658a2db-a88b-49cb-b1f3-5b0006cc1755 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:39.322636 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f658a2db-a88b-49cb-b1f3-5b0006cc1755 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:39.326367 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f658a2db-a88b-49cb-b1f3-5b0006cc1755 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:39.331866 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f658a2db-a88b-49cb-b1f3-5b0006cc1755 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:39.334331 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f658a2db-a88b-49cb-b1f3-5b0006cc1755 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:39.556734 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f658a2db-a88b-49cb-b1f3-5b0006cc1755 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:39.569006 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f658a2db-a88b-49cb-b1f3-5b0006cc1755 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:39.571525 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f658a2db-a88b-49cb-b1f3-5b0006cc1755 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:39.586711 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f658a2db-a88b-49cb-b1f3-5b0006cc1755 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1537 microversion: 2.91 time: 0.303592 Aug 31 15:59:39.587828 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1198/2473] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:39 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1537 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:39.593234 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-de77d327-52e6-48d5-923d-7359ad47fb89 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:39.601559 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-de77d327-52e6-48d5-923d-7359ad47fb89 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: 13cdbabc-03ef-4025-b984-4bba559857ae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:39.617192 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-de77d327-52e6-48d5-923d-7359ad47fb89 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:39.618083 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-de77d327-52e6-48d5-923d-7359ad47fb89 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:39.618789 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-de77d327-52e6-48d5-923d-7359ad47fb89 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:39.620691 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-de77d327-52e6-48d5-923d-7359ad47fb89 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:39.623885 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-de77d327-52e6-48d5-923d-7359ad47fb89 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:39.627848 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-de77d327-52e6-48d5-923d-7359ad47fb89 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:39.668381 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-de77d327-52e6-48d5-923d-7359ad47fb89 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] HTTP exception thrown: Instance 13cdbabc-03ef-4025-b984-4bba559857ae could not be found. Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-de77d327-52e6-48d5-923d-7359ad47fb89 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Request method failure captured: Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae HTTP/1.1 Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4Ti-fo2ga9yAplPvo9CdYOSiUSMslNBMfBRhgeDk-9oIaNfqfi9NHE1CvbH2s3LKLpzbZmugTybWLVvWRrT1CSCIdnYYmSP2W6BIoAJZrnDA1SuRoEj5q7i_5R2yvzyKmu78ufRJvl1z51dngCusbyTnjhcnUtN8L1QBqhZ2NXGwWo Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: f1371996a8304dc58ee579daa535bcd7 Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerRescueTestJSON-1783626194 Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f1371996a8304dc58ee579daa535bcd7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f1371996a8304dc58ee579daa535bcd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f1371996a8304dc58ee579daa535bcd7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f1371996a8304dc58ee579daa535bcd7", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServerRescueTestJSON-1783626194 Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: f1371996a8304dc58ee579daa535bcd7 Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerRescueTestJSON-1783626194 Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServerRescueTestJSON-1783626194-project Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: f922a671cad44ea595e46290a5d52380 Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServerRescueTestJSON-1783626194-project Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 13cdbabc-03ef-4025-b984-4bba559857ae could not be found. Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '13cdbabc-03ef-4025-b984-4bba559857ae'} Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13cdbabc-03ef-4025-b984-4bba559857ae could not be found. Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13cdbabc-03ef-4025-b984-4bba559857ae could not be found. Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:39.670291 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:59:39.674205 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:39.674205 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:39.674205 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:39.674205 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:59:39.674205 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:59:39.674205 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13cdbabc-03ef-4025-b984-4bba559857ae could not be found. Aug 31 15:59:39.674205 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:59:39.676221 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-de77d327-52e6-48d5-923d-7359ad47fb89 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Returning 404 to user: Instance 13cdbabc-03ef-4025-b984-4bba559857ae could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:59:39.677393 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-de77d327-52e6-48d5-923d-7359ad47fb89 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae" status: 404 len: 111 microversion: 2.1 time: 0.088386 Aug 31 15:59:39.678541 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1199/2474] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:39 2022] GET /compute/v2.1/servers/13cdbabc-03ef-4025-b984-4bba559857ae => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:59:39.691655 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-887c2aeb-9b2f-49c6-ac90-f0aa647ed14c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:39.696523 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-887c2aeb-9b2f-49c6-ac90-f0aa647ed14c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 320bf21c-eec1-43ea-a496-059fccc2642f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:39.704971 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-887c2aeb-9b2f-49c6-ac90-f0aa647ed14c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:39.706000 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-887c2aeb-9b2f-49c6-ac90-f0aa647ed14c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:39.706704 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-887c2aeb-9b2f-49c6-ac90-f0aa647ed14c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:39.707680 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-887c2aeb-9b2f-49c6-ac90-f0aa647ed14c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:39.708358 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-887c2aeb-9b2f-49c6-ac90-f0aa647ed14c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:39.708993 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-887c2aeb-9b2f-49c6-ac90-f0aa647ed14c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:39.745703 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:59:40.309400 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-887c2aeb-9b2f-49c6-ac90-f0aa647ed14c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:40.358071 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-887c2aeb-9b2f-49c6-ac90-f0aa647ed14c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f" status: 200 len: 1496 microversion: 2.1 time: 0.656920 Aug 31 15:59:40.360174 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1200/2475] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:39 2022] GET /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f => generated 1496 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:40.375474 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4be4f04e-2beb-4c92-aa96-48b0f6e98b56 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:40.378994 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4be4f04e-2beb-4c92-aa96-48b0f6e98b56 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: a9448c8e-c801-4d08-b1c1-b34f279269e6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:40.402763 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4be4f04e-2beb-4c92-aa96-48b0f6e98b56 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:40.403527 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4be4f04e-2beb-4c92-aa96-48b0f6e98b56 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:40.404651 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4be4f04e-2beb-4c92-aa96-48b0f6e98b56 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:40.408633 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4be4f04e-2beb-4c92-aa96-48b0f6e98b56 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:40.410318 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4be4f04e-2beb-4c92-aa96-48b0f6e98b56 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:40.412181 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4be4f04e-2beb-4c92-aa96-48b0f6e98b56 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:40.456588 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4be4f04e-2beb-4c92-aa96-48b0f6e98b56 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: a9448c8e-c801-4d08-b1c1-b34f279269e6] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 15:59:40.635622 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4be4f04e-2beb-4c92-aa96-48b0f6e98b56 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a9448c8e-c801-4d08-b1c1-b34f279269e6" status: 204 len: 0 microversion: 2.1 time: 0.273069 Aug 31 15:59:40.635622 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1201/2476] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 15:59:40 2022] DELETE /compute/v2.1/servers/a9448c8e-c801-4d08-b1c1-b34f279269e6 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 15:59:40.643070 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6e0e8545-bf8a-4b93-a3d7-3c12b2a38b0b tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:40.643782 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6e0e8545-bf8a-4b93-a3d7-3c12b2a38b0b tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:40.655241 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6e0e8545-bf8a-4b93-a3d7-3c12b2a38b0b tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:40.655732 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6e0e8545-bf8a-4b93-a3d7-3c12b2a38b0b tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:40.656167 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6e0e8545-bf8a-4b93-a3d7-3c12b2a38b0b tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:40.656884 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6e0e8545-bf8a-4b93-a3d7-3c12b2a38b0b tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:40.663490 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6e0e8545-bf8a-4b93-a3d7-3c12b2a38b0b tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:40.663490 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6e0e8545-bf8a-4b93-a3d7-3c12b2a38b0b tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:41.168798 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6e0e8545-bf8a-4b93-a3d7-3c12b2a38b0b tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:41.190804 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6e0e8545-bf8a-4b93-a3d7-3c12b2a38b0b tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1365 microversion: 2.1 time: 0.553603 Aug 31 15:59:41.192486 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1202/2477] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:40 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1365 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:41.199471 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-beddc2ec-2993-4642-81c9-dbbd9b960628 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:41.203415 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-beddc2ec-2993-4642-81c9-dbbd9b960628 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:41.224303 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-beddc2ec-2993-4642-81c9-dbbd9b960628 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:41.225454 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-beddc2ec-2993-4642-81c9-dbbd9b960628 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:41.228672 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-beddc2ec-2993-4642-81c9-dbbd9b960628 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:41.229441 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-beddc2ec-2993-4642-81c9-dbbd9b960628 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:41.231944 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-beddc2ec-2993-4642-81c9-dbbd9b960628 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:41.232645 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-beddc2ec-2993-4642-81c9-dbbd9b960628 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:41.248858 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1072353e-ce70-4c71-9aeb-1417743ab510 tempest-FloatingIPsTestJSON-1743304760 tempest-FloatingIPsTestJSON-1743304760-project] 10.222.0.50 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.561479 Aug 31 15:59:41.250369 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1276/2478] 10.222.0.50 () {60 vars in 1170 bytes} [Wed Aug 31 15:59:35 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5564 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:59:41.256133 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-45fb3667-4bb3-46a9-ac74-66593c60cdd8 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:41.257443 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-45fb3667-4bb3-46a9-ac74-66593c60cdd8 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: a9448c8e-c801-4d08-b1c1-b34f279269e6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:41.274385 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-45fb3667-4bb3-46a9-ac74-66593c60cdd8 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:41.275227 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-45fb3667-4bb3-46a9-ac74-66593c60cdd8 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:41.276198 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-45fb3667-4bb3-46a9-ac74-66593c60cdd8 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:41.278446 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-45fb3667-4bb3-46a9-ac74-66593c60cdd8 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:41.280223 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-45fb3667-4bb3-46a9-ac74-66593c60cdd8 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:41.281796 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-45fb3667-4bb3-46a9-ac74-66593c60cdd8 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:41.581439 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-beddc2ec-2993-4642-81c9-dbbd9b960628 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:41.599109 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-beddc2ec-2993-4642-81c9-dbbd9b960628 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:41.601329 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-beddc2ec-2993-4642-81c9-dbbd9b960628 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:41.617780 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-beddc2ec-2993-4642-81c9-dbbd9b960628 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1537 microversion: 2.91 time: 0.423357 Aug 31 15:59:41.618903 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1203/2479] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:41 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1537 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:41.629830 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7edd5a3a-3f24-4faf-bb4c-76be6c23f01d tempest-FloatingIPsTestJSON-1743304760 tempest-FloatingIPsTestJSON-1743304760-project] Calling method '.version_select at 0x7fbb4ab6c790>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:41.854706 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-45fb3667-4bb3-46a9-ac74-66593c60cdd8 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922a671cad44ea595e46290a5d52380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1371996a8304dc58ee579daa535bcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:41.866565 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-45fb3667-4bb3-46a9-ac74-66593c60cdd8 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/a9448c8e-c801-4d08-b1c1-b34f279269e6" status: 200 len: 1491 microversion: 2.1 time: 0.614764 Aug 31 15:59:41.874501 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1277/2480] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:41 2022] GET /compute/v2.1/servers/a9448c8e-c801-4d08-b1c1-b34f279269e6 => generated 1491 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:41.880227 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-445b80d0-4445-4719-99b8-aa7565cfee33 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:41.886690 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-445b80d0-4445-4719-99b8-aa7565cfee33 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 320bf21c-eec1-43ea-a496-059fccc2642f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:41.897725 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-445b80d0-4445-4719-99b8-aa7565cfee33 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:41.898863 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-445b80d0-4445-4719-99b8-aa7565cfee33 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:41.899541 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-445b80d0-4445-4719-99b8-aa7565cfee33 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:41.900497 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-445b80d0-4445-4719-99b8-aa7565cfee33 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:41.902691 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-445b80d0-4445-4719-99b8-aa7565cfee33 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:41.903367 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-445b80d0-4445-4719-99b8-aa7565cfee33 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:42.053140 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7edd5a3a-3f24-4faf-bb4c-76be6c23f01d tempest-FloatingIPsTestJSON-1743304760 tempest-FloatingIPsTestJSON-1743304760-project] 10.222.0.50 "GET /compute/v2.1/os-floating-ips/e7305415-0bb4-45a8-a45c-243baa26ed16" status: 200 len: 142 microversion: 2.1 time: 0.432575 Aug 31 15:59:42.054767 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1204/2481] 10.222.0.50 () {58 vars in 1260 bytes} [Wed Aug 31 15:59:41 2022] GET /compute/v2.1/os-floating-ips/e7305415-0bb4-45a8-a45c-243baa26ed16 => generated 142 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:59:42.070786 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d05dad22-59de-45c5-9fe9-b90739105054 tempest-FloatingIPsTestJSON-1743304760 tempest-FloatingIPsTestJSON-1743304760-project] Calling method '.version_select at 0x7fbb45dc0550>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:42.449864 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-445b80d0-4445-4719-99b8-aa7565cfee33 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:42.462981 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-445b80d0-4445-4719-99b8-aa7565cfee33 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f" status: 200 len: 1496 microversion: 2.1 time: 0.587192 Aug 31 15:59:42.468306 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1278/2482] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:41 2022] GET /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f => generated 1496 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:42.478933 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a8698888-ba85-4cec-aafe-faf882f017f6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:42.481226 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a8698888-ba85-4cec-aafe-faf882f017f6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:42.497283 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a8698888-ba85-4cec-aafe-faf882f017f6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:42.499161 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a8698888-ba85-4cec-aafe-faf882f017f6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:42.499869 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a8698888-ba85-4cec-aafe-faf882f017f6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:42.502460 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a8698888-ba85-4cec-aafe-faf882f017f6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:42.504143 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a8698888-ba85-4cec-aafe-faf882f017f6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:42.505075 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a8698888-ba85-4cec-aafe-faf882f017f6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:42.708999 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d05dad22-59de-45c5-9fe9-b90739105054 tempest-FloatingIPsTestJSON-1743304760 tempest-FloatingIPsTestJSON-1743304760-project] 10.222.0.50 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.642916 Aug 31 15:59:42.710422 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1205/2483] 10.222.0.50 () {58 vars in 1149 bytes} [Wed Aug 31 15:59:42 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 15:59:42.839178 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c6c33dfe-b798-4852-94ec-2ac84ac26607 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-988385124", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "eefa5116-da2b-41a1-b131-8cada4400b07"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:59:42.977518 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-c6c33dfe-b798-4852-94ec-2ac84ac26607 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] validate_networks() for [('eefa5116-da2b-41a1-b131-8cada4400b07', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:59:43.408452 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a8698888-ba85-4cec-aafe-faf882f017f6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:43.420233 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a8698888-ba85-4cec-aafe-faf882f017f6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1552 microversion: 2.1 time: 0.950567 Aug 31 15:59:43.420826 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1279/2484] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:42 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1552 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:43.452331 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-286fb5b6-f245-4b46-8ec9-a3518363509e tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:43.453100 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-286fb5b6-f245-4b46-8ec9-a3518363509e tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:43.495420 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-286fb5b6-f245-4b46-8ec9-a3518363509e tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:43.497373 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-286fb5b6-f245-4b46-8ec9-a3518363509e tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:43.504075 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-286fb5b6-f245-4b46-8ec9-a3518363509e tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:43.507027 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-286fb5b6-f245-4b46-8ec9-a3518363509e tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:43.511122 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-286fb5b6-f245-4b46-8ec9-a3518363509e tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:43.516902 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-286fb5b6-f245-4b46-8ec9-a3518363509e tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:43.748245 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-286fb5b6-f245-4b46-8ec9-a3518363509e tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:43.763357 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-286fb5b6-f245-4b46-8ec9-a3518363509e tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:43.769452 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-286fb5b6-f245-4b46-8ec9-a3518363509e tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:43.786538 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-286fb5b6-f245-4b46-8ec9-a3518363509e tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1537 microversion: 2.91 time: 0.343142 Aug 31 15:59:43.787642 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1280/2485] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:43 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1537 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:43.799507 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-295f8415-6f00-493c-83cf-a51d134be460 tempest-FloatingIPsTestJSON-1743304760 tempest-FloatingIPsTestJSON-1743304760-project] Calling method '.version_select at 0x7fbb4ac40700>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:44.518295 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-c6c33dfe-b798-4852-94ec-2ac84ac26607 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:59:44.524296 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-c6c33dfe-b798-4852-94ec-2ac84ac26607 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:59:44.526462 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-c6c33dfe-b798-4852-94ec-2ac84ac26607 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:59:44.528613 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-c6c33dfe-b798-4852-94ec-2ac84ac26607 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:59:44.530492 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-c6c33dfe-b798-4852-94ec-2ac84ac26607 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:59:44.563934 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6c33dfe-b798-4852-94ec-2ac84ac26607 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:44.564631 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6c33dfe-b798-4852-94ec-2ac84ac26607 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:44.565169 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6c33dfe-b798-4852-94ec-2ac84ac26607 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:44.566047 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6c33dfe-b798-4852-94ec-2ac84ac26607 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:44.568064 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6c33dfe-b798-4852-94ec-2ac84ac26607 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:44.568815 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6c33dfe-b798-4852-94ec-2ac84ac26607 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:44.641596 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-c6c33dfe-b798-4852-94ec-2ac84ac26607 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Getting quotas for project 75a7c84a4ea54074bab3ccc035c5cf47. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:59:44.651216 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-c6c33dfe-b798-4852-94ec-2ac84ac26607 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Getting quotas for user 3c8476b6167a4c838eac59d7c4a40284 and project 75a7c84a4ea54074bab3ccc035c5cf47. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:59:44.670617 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c6c33dfe-b798-4852-94ec-2ac84ac26607 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:59:44.673392 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c6c33dfe-b798-4852-94ec-2ac84ac26607 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 9fd5b244-b9b6-4901-8b2f-0454d800d6b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:59:44.832290 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c6c33dfe-b798-4852-94ec-2ac84ac26607 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.120294 Aug 31 15:59:44.837189 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1206/2486] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:59:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2126 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 15:59:44.863721 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cf8fa361-906b-46b1-b768-6acf275b693a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:44.866133 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cf8fa361-906b-46b1-b768-6acf275b693a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: a9448c8e-c801-4d08-b1c1-b34f279269e6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:44.893264 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf8fa361-906b-46b1-b768-6acf275b693a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:44.894168 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf8fa361-906b-46b1-b768-6acf275b693a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:44.894763 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf8fa361-906b-46b1-b768-6acf275b693a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:44.895845 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf8fa361-906b-46b1-b768-6acf275b693a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:44.901936 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf8fa361-906b-46b1-b768-6acf275b693a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:44.903259 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf8fa361-906b-46b1-b768-6acf275b693a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:45.034473 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf8fa361-906b-46b1-b768-6acf275b693a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:45.035251 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf8fa361-906b-46b1-b768-6acf275b693a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:45.039077 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf8fa361-906b-46b1-b768-6acf275b693a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:45.039588 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-cf8fa361-906b-46b1-b768-6acf275b693a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lazy-loading 'fault' on Instance uuid a9448c8e-c801-4d08-b1c1-b34f279269e6 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 15:59:45.253051 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cf8fa361-906b-46b1-b768-6acf275b693a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f922a671cad44ea595e46290a5d52380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1371996a8304dc58ee579daa535bcd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:45.265726 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cf8fa361-906b-46b1-b768-6acf275b693a tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/a9448c8e-c801-4d08-b1c1-b34f279269e6" status: 200 len: 1304 microversion: 2.1 time: 0.421653 Aug 31 15:59:45.267065 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1207/2487] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:44 2022] GET /compute/v2.1/servers/a9448c8e-c801-4d08-b1c1-b34f279269e6 => generated 1304 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:45.451505 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-250f5992-490e-4c8a-8d7c-a65687f09b44 req-16ac9693-0520-4013-85b5-b1aa94f983c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "320bf21c-eec1-43ea-a496-059fccc2642f", "name": "network-vif-deleted", "tag": "af138e0c-ab28-4a83-bf6a-2359074606bb"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:59:45.464441 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-250f5992-490e-4c8a-8d7c-a65687f09b44 req-16ac9693-0520-4013-85b5-b1aa94f983c6 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:45.464812 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-250f5992-490e-4c8a-8d7c-a65687f09b44 req-16ac9693-0520-4013-85b5-b1aa94f983c6 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:45.492164 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-250f5992-490e-4c8a-8d7c-a65687f09b44 req-16ac9693-0520-4013-85b5-b1aa94f983c6 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:45.508438 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-250f5992-490e-4c8a-8d7c-a65687f09b44 req-16ac9693-0520-4013-85b5-b1aa94f983c6 service nova] Creating event network-vif-deleted:af138e0c-ab28-4a83-bf6a-2359074606bb for instance 320bf21c-eec1-43ea-a496-059fccc2642f on n-h1-833090-16 Aug 31 15:59:45.514745 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-250f5992-490e-4c8a-8d7c-a65687f09b44 req-16ac9693-0520-4013-85b5-b1aa94f983c6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.245640 Aug 31 15:59:45.516708 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1208/2488] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:59:45.523187 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d6de2b64-44e0-43bb-ac26-ceccf78f44d5 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:45.526183 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d6de2b64-44e0-43bb-ac26-ceccf78f44d5 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:45.534222 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6de2b64-44e0-43bb-ac26-ceccf78f44d5 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:45.535212 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6de2b64-44e0-43bb-ac26-ceccf78f44d5 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:45.535815 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6de2b64-44e0-43bb-ac26-ceccf78f44d5 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:45.536704 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6de2b64-44e0-43bb-ac26-ceccf78f44d5 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:45.537590 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6de2b64-44e0-43bb-ac26-ceccf78f44d5 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:45.538226 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6de2b64-44e0-43bb-ac26-ceccf78f44d5 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:45.877653 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d6de2b64-44e0-43bb-ac26-ceccf78f44d5 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.359311 Aug 31 15:59:45.887702 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1209/2489] 10.222.0.50 () {58 vars in 1275 bytes} [Wed Aug 31 15:59:45 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b/os-interface => generated 284 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:59:45.900022 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ef5c26fd-12b9-48a5-a0e0-93fabaed7bee tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:45.900950 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ef5c26fd-12b9-48a5-a0e0-93fabaed7bee tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 320bf21c-eec1-43ea-a496-059fccc2642f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:45.910653 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef5c26fd-12b9-48a5-a0e0-93fabaed7bee tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:45.911402 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef5c26fd-12b9-48a5-a0e0-93fabaed7bee tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:45.912054 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef5c26fd-12b9-48a5-a0e0-93fabaed7bee tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:45.915261 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef5c26fd-12b9-48a5-a0e0-93fabaed7bee tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:45.916039 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef5c26fd-12b9-48a5-a0e0-93fabaed7bee tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:45.916843 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef5c26fd-12b9-48a5-a0e0-93fabaed7bee tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:45.955745 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-ef5c26fd-12b9-48a5-a0e0-93fabaed7bee tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] HTTP exception thrown: Instance 320bf21c-eec1-43ea-a496-059fccc2642f could not be found. Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ef5c26fd-12b9-48a5-a0e0-93fabaed7bee tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Request method failure captured: Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f HTTP/1.1 Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4Q2UxjmzRUIcRyBJZeRXZe8f-kxARGQrfLNadx-PtSKRAHFDd-cfjpN41Lm2TAtWQQVK9trDHJa1Iu7P1XlF1-EYrtrhJnDHGb-ivhI0erITWpZsYkLGmnwPDtbMbW99ld2jucgWFbVY0vVDf-y4OAM7Az1owqOg13oLERSA9bN0MQ Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: dde27d282fc24e56a62eaeacff1431d5 Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-DeleteServersTestJSON-1135653165 Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_dde27d282fc24e56a62eaeacff1431d5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-DeleteServersTestJSON-1135653165 Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: dde27d282fc24e56a62eaeacff1431d5 Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-DeleteServersTestJSON-1135653165 Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-DeleteServersTestJSON-1135653165-project Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 4d4f2146c3bc4a64b5d7f72cd136b6db Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-DeleteServersTestJSON-1135653165-project Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 320bf21c-eec1-43ea-a496-059fccc2642f could not be found. Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '320bf21c-eec1-43ea-a496-059fccc2642f'} Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 320bf21c-eec1-43ea-a496-059fccc2642f could not be found. Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 320bf21c-eec1-43ea-a496-059fccc2642f could not be found. Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:45.958661 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:59:45.968141 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:45.968141 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:45.968141 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:45.968141 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:59:45.968141 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:59:45.968141 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 320bf21c-eec1-43ea-a496-059fccc2642f could not be found. Aug 31 15:59:45.968141 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 15:59:45.968141 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ef5c26fd-12b9-48a5-a0e0-93fabaed7bee tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Returning 404 to user: Instance 320bf21c-eec1-43ea-a496-059fccc2642f could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:59:45.968141 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ef5c26fd-12b9-48a5-a0e0-93fabaed7bee tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f" status: 404 len: 111 microversion: 2.1 time: 0.075665 Aug 31 15:59:45.973824 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1210/2490] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:45 2022] GET /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:59:45.982322 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d0fd99a7-8ade-410b-9010-ab335f12a187 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:45.982322 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d0fd99a7-8ade-410b-9010-ab335f12a187 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:45.990755 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0fd99a7-8ade-410b-9010-ab335f12a187 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:45.991454 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0fd99a7-8ade-410b-9010-ab335f12a187 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:45.992176 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0fd99a7-8ade-410b-9010-ab335f12a187 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:45.993282 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0fd99a7-8ade-410b-9010-ab335f12a187 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:45.993915 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0fd99a7-8ade-410b-9010-ab335f12a187 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:45.994375 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0fd99a7-8ade-410b-9010-ab335f12a187 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:46.079815 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-295f8415-6f00-493c-83cf-a51d134be460 tempest-FloatingIPsTestJSON-1743304760 tempest-FloatingIPsTestJSON-1743304760-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/e7305415-0bb4-45a8-a45c-243baa26ed16" status: 202 len: 0 microversion: 2.1 time: 2.290486 Aug 31 15:59:46.085000 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1281/2491] 10.222.0.50 () {58 vars in 1263 bytes} [Wed Aug 31 15:59:43 2022] DELETE /compute/v2.1/os-floating-ips/e7305415-0bb4-45a8-a45c-243baa26ed16 => generated 0 bytes in 2292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:59:46.092593 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9c3c6247-5566-4684-a669-6803fb0fecc4 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:46.093321 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9c3c6247-5566-4684-a669-6803fb0fecc4 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 9fd5b244-b9b6-4901-8b2f-0454d800d6b4] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:46.113776 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9c3c6247-5566-4684-a669-6803fb0fecc4 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:46.124039 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9c3c6247-5566-4684-a669-6803fb0fecc4 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:46.124552 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9c3c6247-5566-4684-a669-6803fb0fecc4 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:46.128267 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9c3c6247-5566-4684-a669-6803fb0fecc4 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:46.128842 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9c3c6247-5566-4684-a669-6803fb0fecc4 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:46.129924 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9c3c6247-5566-4684-a669-6803fb0fecc4 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:46.148146 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d0fd99a7-8ade-410b-9010-ab335f12a187 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:46.164049 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d0fd99a7-8ade-410b-9010-ab335f12a187 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:46.165816 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d0fd99a7-8ade-410b-9010-ab335f12a187 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:46.181113 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d0fd99a7-8ade-410b-9010-ab335f12a187 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1537 microversion: 2.91 time: 0.205843 Aug 31 15:59:46.186516 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1211/2492] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:45 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1537 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:46.198014 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-202aa5dd-804a-4755-865c-8e27503d5d81 tempest-FloatingIPsTestJSON-1743304760 tempest-FloatingIPsTestJSON-1743304760-project] Action: 'create', calling method: .version_select at 0x7fbb4ab4e1f0>, body: {"pool": null} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:59:46.378286 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9c3c6247-5566-4684-a669-6803fb0fecc4 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8476b6167a4c838eac59d7c4a40284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a7c84a4ea54074bab3ccc035c5cf47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:46.388817 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9c3c6247-5566-4684-a669-6803fb0fecc4 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4" status: 200 len: 1220 microversion: 2.1 time: 0.306758 Aug 31 15:59:46.392880 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1282/2493] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:46 2022] GET /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4 => generated 1220 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:46.417498 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b147704e-a9ca-40ea-9954-2c75f6785beb tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-709791245", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "e71afd64-faa4-4680-b8e0-76fe805d5df1"}]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:59:46.531158 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-b147704e-a9ca-40ea-9954-2c75f6785beb tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] validate_networks() for [('e71afd64-faa4-4680-b8e0-76fe805d5df1', None, None, None, None, None)] {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 15:59:48.087347 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-b147704e-a9ca-40ea-9954-2c75f6785beb tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 15:59:48.088435 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-b147704e-a9ca-40ea-9954-2c75f6785beb tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 15:59:48.089220 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-b147704e-a9ca-40ea-9954-2c75f6785beb tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 15:59:48.089772 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-b147704e-a9ca-40ea-9954-2c75f6785beb tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 15:59:48.090348 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-b147704e-a9ca-40ea-9954-2c75f6785beb tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 15:59:48.108890 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b147704e-a9ca-40ea-9954-2c75f6785beb tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:48.109734 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b147704e-a9ca-40ea-9954-2c75f6785beb tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:48.111468 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b147704e-a9ca-40ea-9954-2c75f6785beb tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:48.112547 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b147704e-a9ca-40ea-9954-2c75f6785beb tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:48.113221 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b147704e-a9ca-40ea-9954-2c75f6785beb tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:48.113843 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b147704e-a9ca-40ea-9954-2c75f6785beb tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:48.143141 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-b147704e-a9ca-40ea-9954-2c75f6785beb tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Getting quotas for project dde27d282fc24e56a62eaeacff1431d5. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 15:59:48.154639 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-b147704e-a9ca-40ea-9954-2c75f6785beb tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Getting quotas for user 4d4f2146c3bc4a64b5d7f72cd136b6db and project dde27d282fc24e56a62eaeacff1431d5. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 15:59:48.195666 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b147704e-a9ca-40ea-9954-2c75f6785beb tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 15:59:48.199785 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b147704e-a9ca-40ea-9954-2c75f6785beb tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 16ef09f1-c039-4f49-975a-526f26df57f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 15:59:48.398637 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b147704e-a9ca-40ea-9954-2c75f6785beb tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.002336 Aug 31 15:59:48.416527 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1283/2494] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 15:59:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2023 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 15:59:48.421786 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7d196d89-02d5-4376-8739-c79c8e9dd181 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:48.428902 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7d196d89-02d5-4376-8739-c79c8e9dd181 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] [instance: a9448c8e-c801-4d08-b1c1-b34f279269e6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:48.459678 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7d196d89-02d5-4376-8739-c79c8e9dd181 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:48.460401 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7d196d89-02d5-4376-8739-c79c8e9dd181 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:48.462907 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7d196d89-02d5-4376-8739-c79c8e9dd181 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:48.469484 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7d196d89-02d5-4376-8739-c79c8e9dd181 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:48.471109 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7d196d89-02d5-4376-8739-c79c8e9dd181 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:48.476394 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7d196d89-02d5-4376-8739-c79c8e9dd181 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:48.558132 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-7d196d89-02d5-4376-8739-c79c8e9dd181 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] HTTP exception thrown: Instance a9448c8e-c801-4d08-b1c1-b34f279269e6 could not be found. Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7d196d89-02d5-4376-8739-c79c8e9dd181 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Request method failure captured: Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/a9448c8e-c801-4d08-b1c1-b34f279269e6 HTTP/1.1 Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4Ti-fo2ga9yAplPvo9CdYOSiUSMslNBMfBRhgeDk-9oIaNfqfi9NHE1CvbH2s3LKLpzbZmugTybWLVvWRrT1CSCIdnYYmSP2W6BIoAJZrnDA1SuRoEj5q7i_5R2yvzyKmu78ufRJvl1z51dngCusbyTnjhcnUtN8L1QBqhZ2NXGwWo Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: f1371996a8304dc58ee579daa535bcd7 Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServerRescueTestJSON-1783626194 Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f1371996a8304dc58ee579daa535bcd7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f1371996a8304dc58ee579daa535bcd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f1371996a8304dc58ee579daa535bcd7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f1371996a8304dc58ee579daa535bcd7", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServerRescueTestJSON-1783626194 Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: f1371996a8304dc58ee579daa535bcd7 Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServerRescueTestJSON-1783626194 Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServerRescueTestJSON-1783626194-project Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: f922a671cad44ea595e46290a5d52380 Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServerRescueTestJSON-1783626194-project Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance a9448c8e-c801-4d08-b1c1-b34f279269e6 could not be found. Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'a9448c8e-c801-4d08-b1c1-b34f279269e6'} Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9448c8e-c801-4d08-b1c1-b34f279269e6 could not be found. Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9448c8e-c801-4d08-b1c1-b34f279269e6 could not be found. Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:48.564201 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:48.569211 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:48.569211 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:48.569211 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:48.569211 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:59:48.569211 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:59:48.569211 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9448c8e-c801-4d08-b1c1-b34f279269e6 could not be found. Aug 31 15:59:48.569211 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:48.570637 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7d196d89-02d5-4376-8739-c79c8e9dd181 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] Returning 404 to user: Instance a9448c8e-c801-4d08-b1c1-b34f279269e6 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:59:48.575234 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7d196d89-02d5-4376-8739-c79c8e9dd181 tempest-ServerRescueTestJSON-1783626194 tempest-ServerRescueTestJSON-1783626194-project] 10.222.0.50 "GET /compute/v2.1/servers/a9448c8e-c801-4d08-b1c1-b34f279269e6" status: 404 len: 111 microversion: 2.1 time: 0.157312 Aug 31 15:59:48.576759 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1284/2495] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:48 2022] GET /compute/v2.1/servers/a9448c8e-c801-4d08-b1c1-b34f279269e6 => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:59:48.587091 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d6099015-379d-4fd6-a4bb-66c864bfb998 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:48.599775 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d6099015-379d-4fd6-a4bb-66c864bfb998 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:48.633913 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d6099015-379d-4fd6-a4bb-66c864bfb998 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:48.637782 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d6099015-379d-4fd6-a4bb-66c864bfb998 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:48.639278 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d6099015-379d-4fd6-a4bb-66c864bfb998 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:48.640252 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d6099015-379d-4fd6-a4bb-66c864bfb998 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:48.640873 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d6099015-379d-4fd6-a4bb-66c864bfb998 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:48.641636 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d6099015-379d-4fd6-a4bb-66c864bfb998 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:48.963057 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d6099015-379d-4fd6-a4bb-66c864bfb998 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:48.993648 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d6099015-379d-4fd6-a4bb-66c864bfb998 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:49.000354 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d6099015-379d-4fd6-a4bb-66c864bfb998 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:49.025834 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d6099015-379d-4fd6-a4bb-66c864bfb998 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1537 microversion: 2.91 time: 0.447668 Aug 31 15:59:49.026466 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1285/2496] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:48 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1537 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:49.035364 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-82e71324-77c9-4bdc-8c53-980045250fc5 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:49.042569 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-82e71324-77c9-4bdc-8c53-980045250fc5 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 9fd5b244-b9b6-4901-8b2f-0454d800d6b4] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:49.061104 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-82e71324-77c9-4bdc-8c53-980045250fc5 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:49.061600 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-82e71324-77c9-4bdc-8c53-980045250fc5 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:49.062034 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-82e71324-77c9-4bdc-8c53-980045250fc5 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:49.064729 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-82e71324-77c9-4bdc-8c53-980045250fc5 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:49.065207 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-82e71324-77c9-4bdc-8c53-980045250fc5 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:49.065644 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-82e71324-77c9-4bdc-8c53-980045250fc5 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:49.329058 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-82e71324-77c9-4bdc-8c53-980045250fc5 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8476b6167a4c838eac59d7c4a40284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a7c84a4ea54074bab3ccc035c5cf47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:49.340643 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-82e71324-77c9-4bdc-8c53-980045250fc5 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4" status: 200 len: 1282 microversion: 2.1 time: 0.311842 Aug 31 15:59:49.341260 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1286/2497] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:49 2022] GET /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4 => generated 1282 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:49.360572 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-472bc5ba-0f0e-4529-9dac-ac4e2b82dc5b req-f47dde1d-f67d-4aa3-86ff-254c7ec998a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9448c8e-c801-4d08-b1c1-b34f279269e6", "name": "network-vif-deleted", "tag": "2099a852-2512-4fb9-8fa5-c0420a4477eb"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:59:49.372238 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-472bc5ba-0f0e-4529-9dac-ac4e2b82dc5b req-f47dde1d-f67d-4aa3-86ff-254c7ec998a8 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:49.373134 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-472bc5ba-0f0e-4529-9dac-ac4e2b82dc5b req-f47dde1d-f67d-4aa3-86ff-254c7ec998a8 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:49.373749 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-472bc5ba-0f0e-4529-9dac-ac4e2b82dc5b req-f47dde1d-f67d-4aa3-86ff-254c7ec998a8 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:49.392136 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-472bc5ba-0f0e-4529-9dac-ac4e2b82dc5b req-f47dde1d-f67d-4aa3-86ff-254c7ec998a8 service nova] Creating event network-vif-deleted:2099a852-2512-4fb9-8fa5-c0420a4477eb for instance a9448c8e-c801-4d08-b1c1-b34f279269e6 on n-h2-833090-16 Aug 31 15:59:49.400018 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-472bc5ba-0f0e-4529-9dac-ac4e2b82dc5b req-f47dde1d-f67d-4aa3-86ff-254c7ec998a8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044241 Aug 31 15:59:49.401394 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1287/2498] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:59:49.408607 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d51392e1-c60e-4c27-bc94-ae125970622c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:49.410055 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d51392e1-c60e-4c27-bc94-ae125970622c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 16ef09f1-c039-4f49-975a-526f26df57f1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:49.419614 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d51392e1-c60e-4c27-bc94-ae125970622c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:49.420404 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d51392e1-c60e-4c27-bc94-ae125970622c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:49.421930 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d51392e1-c60e-4c27-bc94-ae125970622c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:49.422820 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d51392e1-c60e-4c27-bc94-ae125970622c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:49.423610 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d51392e1-c60e-4c27-bc94-ae125970622c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:49.424364 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d51392e1-c60e-4c27-bc94-ae125970622c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:49.585795 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d51392e1-c60e-4c27-bc94-ae125970622c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:49.595062 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d51392e1-c60e-4c27-bc94-ae125970622c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/16ef09f1-c039-4f49-975a-526f26df57f1" status: 200 len: 1218 microversion: 2.1 time: 0.191997 Aug 31 15:59:49.602828 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1288/2499] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:49 2022] GET /compute/v2.1/servers/16ef09f1-c039-4f49-975a-526f26df57f1 => generated 1218 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:50.061051 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-83c82dc6-7e0f-4c44-a0be-56c3fcc48e1e tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:50.061798 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-83c82dc6-7e0f-4c44-a0be-56c3fcc48e1e tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:50.093471 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83c82dc6-7e0f-4c44-a0be-56c3fcc48e1e tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:50.095020 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83c82dc6-7e0f-4c44-a0be-56c3fcc48e1e tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:50.097513 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83c82dc6-7e0f-4c44-a0be-56c3fcc48e1e tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:50.098833 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83c82dc6-7e0f-4c44-a0be-56c3fcc48e1e tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:50.099718 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83c82dc6-7e0f-4c44-a0be-56c3fcc48e1e tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:50.100376 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83c82dc6-7e0f-4c44-a0be-56c3fcc48e1e tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:50.246986 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-83c82dc6-7e0f-4c44-a0be-56c3fcc48e1e tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:50.262057 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-83c82dc6-7e0f-4c44-a0be-56c3fcc48e1e tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:50.265842 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-83c82dc6-7e0f-4c44-a0be-56c3fcc48e1e tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:50.282037 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-83c82dc6-7e0f-4c44-a0be-56c3fcc48e1e tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1537 microversion: 2.91 time: 0.228685 Aug 31 15:59:50.284576 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1289/2500] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:50 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1537 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 15:59:50.367478 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f8c71968-c17a-4d79-898d-42456de2acb2 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:50.369177 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f8c71968-c17a-4d79-898d-42456de2acb2 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 9fd5b244-b9b6-4901-8b2f-0454d800d6b4] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:50.383777 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f8c71968-c17a-4d79-898d-42456de2acb2 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:50.386363 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f8c71968-c17a-4d79-898d-42456de2acb2 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:50.387228 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f8c71968-c17a-4d79-898d-42456de2acb2 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:50.390743 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f8c71968-c17a-4d79-898d-42456de2acb2 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:50.391451 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f8c71968-c17a-4d79-898d-42456de2acb2 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:50.394236 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f8c71968-c17a-4d79-898d-42456de2acb2 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:51.110876 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f8c71968-c17a-4d79-898d-42456de2acb2 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8476b6167a4c838eac59d7c4a40284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a7c84a4ea54074bab3ccc035c5cf47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:51.120761 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f8c71968-c17a-4d79-898d-42456de2acb2 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4" status: 200 len: 1324 microversion: 2.1 time: 0.760548 Aug 31 15:59:51.121954 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1290/2501] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:50 2022] GET /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4 => generated 1324 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:51.127538 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-21d91cee-c1e0-4541-a5d1-494b30c18924 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:51.128491 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-21d91cee-c1e0-4541-a5d1-494b30c18924 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 16ef09f1-c039-4f49-975a-526f26df57f1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:51.135370 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-21d91cee-c1e0-4541-a5d1-494b30c18924 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:51.136336 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-21d91cee-c1e0-4541-a5d1-494b30c18924 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:51.136993 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-21d91cee-c1e0-4541-a5d1-494b30c18924 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:51.137918 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-21d91cee-c1e0-4541-a5d1-494b30c18924 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:51.139057 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-21d91cee-c1e0-4541-a5d1-494b30c18924 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:51.139859 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-21d91cee-c1e0-4541-a5d1-494b30c18924 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:51.484800 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-21d91cee-c1e0-4541-a5d1-494b30c18924 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:51.506204 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-21d91cee-c1e0-4541-a5d1-494b30c18924 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/16ef09f1-c039-4f49-975a-526f26df57f1" status: 200 len: 1272 microversion: 2.1 time: 0.381785 Aug 31 15:59:51.512073 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1291/2502] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:51 2022] GET /compute/v2.1/servers/16ef09f1-c039-4f49-975a-526f26df57f1 => generated 1272 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:51.524897 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f4e9f038-3b1d-436a-8033-4a32d5b87bac tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:51.526790 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f4e9f038-3b1d-436a-8033-4a32d5b87bac tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:51.533705 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f4e9f038-3b1d-436a-8033-4a32d5b87bac tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:51.534501 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f4e9f038-3b1d-436a-8033-4a32d5b87bac tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:51.535140 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f4e9f038-3b1d-436a-8033-4a32d5b87bac tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:51.535998 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f4e9f038-3b1d-436a-8033-4a32d5b87bac tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:51.536592 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f4e9f038-3b1d-436a-8033-4a32d5b87bac tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:51.537157 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f4e9f038-3b1d-436a-8033-4a32d5b87bac tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:51.968503 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f4e9f038-3b1d-436a-8033-4a32d5b87bac tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:51.984700 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f4e9f038-3b1d-436a-8033-4a32d5b87bac tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:51.988207 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f4e9f038-3b1d-436a-8033-4a32d5b87bac tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:52.002557 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f4e9f038-3b1d-436a-8033-4a32d5b87bac tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1537 microversion: 2.91 time: 0.488007 Aug 31 15:59:52.021196 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1292/2503] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:51 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1537 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:52.027477 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-9e42cbf1-814b-4e76-bc54-a9396d5ba8df req-2c555db3-6d4e-407a-914b-028d80adb275 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b", "tag": "4e98deab-3424-49ec-b930-3019d71c32c7"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:59:52.039458 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-9e42cbf1-814b-4e76-bc54-a9396d5ba8df req-2c555db3-6d4e-407a-914b-028d80adb275 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:52.039848 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-9e42cbf1-814b-4e76-bc54-a9396d5ba8df req-2c555db3-6d4e-407a-914b-028d80adb275 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:52.040273 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-9e42cbf1-814b-4e76-bc54-a9396d5ba8df req-2c555db3-6d4e-407a-914b-028d80adb275 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:52.054703 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-9e42cbf1-814b-4e76-bc54-a9396d5ba8df req-2c555db3-6d4e-407a-914b-028d80adb275 service nova] Creating event network-changed:4e98deab-3424-49ec-b930-3019d71c32c7 for instance 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b on n-h1-833090-16 Aug 31 15:59:52.061481 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-9e42cbf1-814b-4e76-bc54-a9396d5ba8df req-2c555db3-6d4e-407a-914b-028d80adb275 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038563 Aug 31 15:59:52.062695 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1293/2504] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:59:52.101131 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-202aa5dd-804a-4755-865c-8e27503d5d81 tempest-FloatingIPsTestJSON-1743304760 tempest-FloatingIPsTestJSON-1743304760-project] 10.222.0.50 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.911861 Aug 31 15:59:52.102641 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1212/2505] 10.222.0.50 () {60 vars in 1170 bytes} [Wed Aug 31 15:59:46 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5915 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:59:52.119545 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-853e63d7-91ad-498b-8bf9-dd8bd5ca873e tempest-FloatingIPsTestJSON-1743304760 tempest-FloatingIPsTestJSON-1743304760-project] Calling method '.version_select at 0x7fbb4ac52940>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:52.174220 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cad4a376-4f47-4d9e-a3e2-04d9a087efa8 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:52.175374 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cad4a376-4f47-4d9e-a3e2-04d9a087efa8 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 9fd5b244-b9b6-4901-8b2f-0454d800d6b4] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:52.184563 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:59:52.189968 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cad4a376-4f47-4d9e-a3e2-04d9a087efa8 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:52.191098 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cad4a376-4f47-4d9e-a3e2-04d9a087efa8 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:52.191775 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cad4a376-4f47-4d9e-a3e2-04d9a087efa8 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:52.194937 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cad4a376-4f47-4d9e-a3e2-04d9a087efa8 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:52.203798 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cad4a376-4f47-4d9e-a3e2-04d9a087efa8 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:52.206643 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cad4a376-4f47-4d9e-a3e2-04d9a087efa8 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:52.964582 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cad4a376-4f47-4d9e-a3e2-04d9a087efa8 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8476b6167a4c838eac59d7c4a40284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a7c84a4ea54074bab3ccc035c5cf47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:52.982641 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cad4a376-4f47-4d9e-a3e2-04d9a087efa8 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4" status: 200 len: 1324 microversion: 2.1 time: 0.817541 Aug 31 15:59:52.984409 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1213/2506] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:52 2022] GET /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4 => generated 1324 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:52.989629 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-45842577-a873-4c90-80c5-57b880ca4350 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:52.990537 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-45842577-a873-4c90-80c5-57b880ca4350 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 16ef09f1-c039-4f49-975a-526f26df57f1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:53.009083 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45842577-a873-4c90-80c5-57b880ca4350 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:53.009944 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45842577-a873-4c90-80c5-57b880ca4350 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:53.010717 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45842577-a873-4c90-80c5-57b880ca4350 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:53.015615 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45842577-a873-4c90-80c5-57b880ca4350 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:53.015808 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45842577-a873-4c90-80c5-57b880ca4350 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:53.024772 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45842577-a873-4c90-80c5-57b880ca4350 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:53.270588 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-45842577-a873-4c90-80c5-57b880ca4350 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:53.289186 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-45842577-a873-4c90-80c5-57b880ca4350 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/16ef09f1-c039-4f49-975a-526f26df57f1" status: 200 len: 1272 microversion: 2.1 time: 0.302608 Aug 31 15:59:53.290549 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1214/2507] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:52 2022] GET /compute/v2.1/servers/16ef09f1-c039-4f49-975a-526f26df57f1 => generated 1272 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:53.299397 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f4f01321-cd1e-4219-b2c8-17555bb8d3bd tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:53.301208 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f4f01321-cd1e-4219-b2c8-17555bb8d3bd tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:53.321003 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4f01321-cd1e-4219-b2c8-17555bb8d3bd tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:53.323165 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4f01321-cd1e-4219-b2c8-17555bb8d3bd tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:53.324030 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4f01321-cd1e-4219-b2c8-17555bb8d3bd tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:53.325749 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4f01321-cd1e-4219-b2c8-17555bb8d3bd tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:53.327538 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4f01321-cd1e-4219-b2c8-17555bb8d3bd tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:53.328541 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4f01321-cd1e-4219-b2c8-17555bb8d3bd tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:53.556407 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f4f01321-cd1e-4219-b2c8-17555bb8d3bd tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:53.567153 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f4f01321-cd1e-4219-b2c8-17555bb8d3bd tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:53.569633 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f4f01321-cd1e-4219-b2c8-17555bb8d3bd tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:53.576995 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f4f01321-cd1e-4219-b2c8-17555bb8d3bd tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1537 microversion: 2.91 time: 0.285013 Aug 31 15:59:53.597356 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1215/2508] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:53 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1537 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:54.013063 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f28d098c-c933-463b-810c-93b8a6f46fbd tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:54.017592 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f28d098c-c933-463b-810c-93b8a6f46fbd tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 9fd5b244-b9b6-4901-8b2f-0454d800d6b4] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:54.072823 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f28d098c-c933-463b-810c-93b8a6f46fbd tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:54.075274 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f28d098c-c933-463b-810c-93b8a6f46fbd tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:54.078115 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f28d098c-c933-463b-810c-93b8a6f46fbd tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:54.079309 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f28d098c-c933-463b-810c-93b8a6f46fbd tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:54.080568 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f28d098c-c933-463b-810c-93b8a6f46fbd tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:54.082831 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f28d098c-c933-463b-810c-93b8a6f46fbd tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:54.587326 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:59:54.661723 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:59:55.205531 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f28d098c-c933-463b-810c-93b8a6f46fbd tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8476b6167a4c838eac59d7c4a40284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a7c84a4ea54074bab3ccc035c5cf47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:55.216662 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f28d098c-c933-463b-810c-93b8a6f46fbd tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4" status: 200 len: 1324 microversion: 2.1 time: 1.213422 Aug 31 15:59:55.235611 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1216/2509] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:54 2022] GET /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4 => generated 1324 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:55.240762 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-df6b62e8-cf3e-4ce9-aa82-2ebe08ce84cb req-14f9807c-c1de-4fd2-8164-97ec0456d4dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fd5b244-b9b6-4901-8b2f-0454d800d6b4", "tag": "c2952a3a-e5d0-4c63-8874-7dc700de780f"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:59:55.252826 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-df6b62e8-cf3e-4ce9-aa82-2ebe08ce84cb req-14f9807c-c1de-4fd2-8164-97ec0456d4dd service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:55.252826 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-df6b62e8-cf3e-4ce9-aa82-2ebe08ce84cb req-14f9807c-c1de-4fd2-8164-97ec0456d4dd service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:55.252826 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-df6b62e8-cf3e-4ce9-aa82-2ebe08ce84cb req-14f9807c-c1de-4fd2-8164-97ec0456d4dd service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:55.272069 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-df6b62e8-cf3e-4ce9-aa82-2ebe08ce84cb req-14f9807c-c1de-4fd2-8164-97ec0456d4dd service nova] Creating event network-changed:c2952a3a-e5d0-4c63-8874-7dc700de780f for instance 9fd5b244-b9b6-4901-8b2f-0454d800d6b4 on n-h2-833090-16 Aug 31 15:59:55.279611 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-df6b62e8-cf3e-4ce9-aa82-2ebe08ce84cb req-14f9807c-c1de-4fd2-8164-97ec0456d4dd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042405 Aug 31 15:59:55.280591 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1217/2510] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:59:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:59:55.285950 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-31ad8ed5-091e-4a38-b784-8c0fdf9eb8a9 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:55.287304 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-31ad8ed5-091e-4a38-b784-8c0fdf9eb8a9 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 16ef09f1-c039-4f49-975a-526f26df57f1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:55.295350 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31ad8ed5-091e-4a38-b784-8c0fdf9eb8a9 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:55.297422 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31ad8ed5-091e-4a38-b784-8c0fdf9eb8a9 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:55.298114 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31ad8ed5-091e-4a38-b784-8c0fdf9eb8a9 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:55.301751 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31ad8ed5-091e-4a38-b784-8c0fdf9eb8a9 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:55.302538 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31ad8ed5-091e-4a38-b784-8c0fdf9eb8a9 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:55.303277 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31ad8ed5-091e-4a38-b784-8c0fdf9eb8a9 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:55.941332 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-31ad8ed5-091e-4a38-b784-8c0fdf9eb8a9 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:55.962726 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-31ad8ed5-091e-4a38-b784-8c0fdf9eb8a9 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/16ef09f1-c039-4f49-975a-526f26df57f1" status: 200 len: 1314 microversion: 2.1 time: 0.679676 Aug 31 15:59:55.974969 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1218/2511] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:55 2022] GET /compute/v2.1/servers/16ef09f1-c039-4f49-975a-526f26df57f1 => generated 1314 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:55.981695 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-353a773a-2be1-4e4b-885c-3a2449dac640 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:55.982558 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-353a773a-2be1-4e4b-885c-3a2449dac640 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:55.990082 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-353a773a-2be1-4e4b-885c-3a2449dac640 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:55.990880 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-353a773a-2be1-4e4b-885c-3a2449dac640 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:55.991514 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-353a773a-2be1-4e4b-885c-3a2449dac640 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:55.992434 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-353a773a-2be1-4e4b-885c-3a2449dac640 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:55.993146 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-353a773a-2be1-4e4b-885c-3a2449dac640 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:55.993781 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-353a773a-2be1-4e4b-885c-3a2449dac640 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:56.232152 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-353a773a-2be1-4e4b-885c-3a2449dac640 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:56.247245 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-353a773a-2be1-4e4b-885c-3a2449dac640 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:56.250590 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-353a773a-2be1-4e4b-885c-3a2449dac640 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:56.262027 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-353a773a-2be1-4e4b-885c-3a2449dac640 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1537 microversion: 2.91 time: 0.285570 Aug 31 15:59:56.262951 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1219/2512] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:55 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1537 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:56.268240 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f92319af-9337-49b2-b269-0de5309080bc tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:56.269087 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f92319af-9337-49b2-b269-0de5309080bc tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 9fd5b244-b9b6-4901-8b2f-0454d800d6b4] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:56.276137 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f92319af-9337-49b2-b269-0de5309080bc tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:56.277503 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f92319af-9337-49b2-b269-0de5309080bc tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:56.278139 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f92319af-9337-49b2-b269-0de5309080bc tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:56.279257 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f92319af-9337-49b2-b269-0de5309080bc tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:56.279881 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f92319af-9337-49b2-b269-0de5309080bc tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:56.280464 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f92319af-9337-49b2-b269-0de5309080bc tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:56.662903 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-853e63d7-91ad-498b-8bf9-dd8bd5ca873e tempest-FloatingIPsTestJSON-1743304760 tempest-FloatingIPsTestJSON-1743304760-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/7cdb11a2-5bce-41dc-be2c-39fd8189cbe5" status: 202 len: 0 microversion: 2.1 time: 4.551581 Aug 31 15:59:56.664390 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1294/2513] 10.222.0.50 () {58 vars in 1263 bytes} [Wed Aug 31 15:59:52 2022] DELETE /compute/v2.1/os-floating-ips/7cdb11a2-5bce-41dc-be2c-39fd8189cbe5 => generated 0 bytes in 4554 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 15:59:56.673011 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f753f585-29db-4281-9599-9572a643a021 tempest-FloatingIPsTestJSON-1743304760 tempest-FloatingIPsTestJSON-1743304760-project] Calling method '.version_select at 0x7fbb4ac61c10>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:56.781264 n-d-833090-16 devstack@n-api.service[128864]: DEBUG neutronclient.v2_0.client [None req-f753f585-29db-4281-9599-9572a643a021 tempest-FloatingIPsTestJSON-1743304760 tempest-FloatingIPsTestJSON-1743304760-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 7cdb11a2-5bce-41dc-be2c-39fd8189cbe5 could not be found", "detail": ""}} {{(pid=128864) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 31 15:59:56.782329 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-f753f585-29db-4281-9599-9572a643a021 tempest-FloatingIPsTestJSON-1743304760 tempest-FloatingIPsTestJSON-1743304760-project] HTTP exception thrown: Floating IP not found for ID 7cdb11a2-5bce-41dc-be2c-39fd8189cbe5 Aug 31 15:59:56.784648 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f753f585-29db-4281-9599-9572a643a021 tempest-FloatingIPsTestJSON-1743304760 tempest-FloatingIPsTestJSON-1743304760-project] Request method failure captured: Aug 31 15:59:56.784648 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/os-floating-ips/7cdb11a2-5bce-41dc-be2c-39fd8189cbe5 HTTP/1.1 Aug 31 15:59:56.784648 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:59:56.784648 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:59:56.784648 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:59:56.784648 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:59:56.784648 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:59:56.784648 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:59:56.784648 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:59:56.784648 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:59:56.784648 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4Vnoawg9EKbtJgq_pMq7tDcXb535q9J2BDIAcce4p5SO9CgbMayoa5Upig00B17fmRJaQrxiycmdm-AKTlyGsH6A5X4N2Fx4kuRy8OGHiGe-ondGrTx6WyU0MWIasD859iK17blumhuFqDtThXA3QAQ1MWYZgMvoM7vHA0SIh1mmBg Aug 31 15:59:56.784648 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:59:56.784648 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:59:56.784648 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:59:56.784648 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:59:56.784648 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:59:56.784648 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:59:56.784648 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 7b95a4a339c5449aa64a8ccc777faa39 Aug 31 15:59:56.784648 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-FloatingIPsTestJSON-1743304760 Aug 31 15:59:56.784648 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:59:56.784648 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:59:56.784648 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7b95a4a339c5449aa64a8ccc777faa39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7b95a4a339c5449aa64a8ccc777faa39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7b95a4a339c5449aa64a8ccc777faa39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7b95a4a339c5449aa64a8ccc777faa39", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:59:56.784648 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-FloatingIPsTestJSON-1743304760 Aug 31 15:59:56.784648 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 7b95a4a339c5449aa64a8ccc777faa39 Aug 31 15:59:56.784648 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1743304760 Aug 31 15:59:56.784648 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-FloatingIPsTestJSON-1743304760-project Aug 31 15:59:56.784648 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:59:56.784648 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:59:56.784648 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 2d8da2e3f611440084c02bff3bf62fc2 Aug 31 15:59:56.784648 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-FloatingIPsTestJSON-1743304760-project Aug 31 15:59:56.784648 n-d-833090-16 devstack@n-api.service[128864]: method: Aug 31 15:59:56.784648 n-d-833090-16 devstack@n-api.service[128864]: exception: Floating IP not found for ID 7cdb11a2-5bce-41dc-be2c-39fd8189cbe5 Aug 31 15:59:56.784648 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '7cdb11a2-5bce-41dc-be2c-39fd8189cbe5'} Aug 31 15:59:56.784648 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:59:56.784648 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:56.784648 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 31 15:59:56.784648 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 31 15:59:56.784648 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 15:59:56.784648 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 15:59:56.784648 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 31 15:59:56.784648 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 31 15:59:56.784648 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 15:59:56.784648 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 15:59:56.784648 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 31 15:59:56.784648 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 31 15:59:56.784648 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 15:59:56.784648 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 15:59:56.784648 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 31 15:59:56.784648 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 31 15:59:56.784648 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 15:59:56.784648 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 15:59:56.784648 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 31 15:59:56.784648 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 31 15:59:56.784648 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 15:59:56.784648 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 15:59:56.784648 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 31 15:59:56.784648 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 31 15:59:56.784648 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 31 15:59:56.784648 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 31 15:59:56.784648 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 7cdb11a2-5bce-41dc-be2c-39fd8189cbe5 could not be found Aug 31 15:59:56.784648 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bedb45df-7ef8-4ecf-8ce3-f0b44dc6e1a9'] Aug 31 15:59:56.784648 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:56.788977 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:56.788977 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:56.788977 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:56.788977 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 31 15:59:56.788977 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 31 15:59:56.788977 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 31 15:59:56.788977 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 31 15:59:56.788977 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 7cdb11a2-5bce-41dc-be2c-39fd8189cbe5. Aug 31 15:59:56.788977 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:56.788977 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:56.788977 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:56.788977 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:56.788977 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:56.788977 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:56.788977 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:59:56.788977 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:59:56.788977 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:59:56.788977 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:59:56.788977 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:59:56.788977 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:59:56.788977 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 31 15:59:56.788977 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 31 15:59:56.788977 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 7cdb11a2-5bce-41dc-be2c-39fd8189cbe5 Aug 31 15:59:56.788977 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:56.788977 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:56.788977 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:56.788977 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:56.788977 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:56.788977 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:56.788977 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:59:56.788977 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:59:56.788977 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 7cdb11a2-5bce-41dc-be2c-39fd8189cbe5 Aug 31 15:59:56.788977 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:56.792880 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f753f585-29db-4281-9599-9572a643a021 tempest-FloatingIPsTestJSON-1743304760 tempest-FloatingIPsTestJSON-1743304760-project] Returning 404 to user: Floating IP not found for ID 7cdb11a2-5bce-41dc-be2c-39fd8189cbe5 {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:59:56.794444 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f753f585-29db-4281-9599-9572a643a021 tempest-FloatingIPsTestJSON-1743304760 tempest-FloatingIPsTestJSON-1743304760-project] 10.222.0.50 "GET /compute/v2.1/os-floating-ips/7cdb11a2-5bce-41dc-be2c-39fd8189cbe5" status: 404 len: 111 microversion: 2.1 time: 0.125393 Aug 31 15:59:56.799429 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1295/2514] 10.222.0.50 () {58 vars in 1260 bytes} [Wed Aug 31 15:59:56 2022] GET /compute/v2.1/os-floating-ips/7cdb11a2-5bce-41dc-be2c-39fd8189cbe5 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:59:56.805011 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-816f9da4-6a7f-411a-ad48-e140d32e3453 tempest-FloatingIPsTestJSON-1743304760 tempest-FloatingIPsTestJSON-1743304760-project] Calling method '.version_select at 0x7fbb4ac52d30>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:56.971671 n-d-833090-16 devstack@n-api.service[128864]: DEBUG neutronclient.v2_0.client [None req-816f9da4-6a7f-411a-ad48-e140d32e3453 tempest-FloatingIPsTestJSON-1743304760 tempest-FloatingIPsTestJSON-1743304760-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 7cdb11a2-5bce-41dc-be2c-39fd8189cbe5 could not be found", "detail": ""}} {{(pid=128864) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 31 15:59:56.975738 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-816f9da4-6a7f-411a-ad48-e140d32e3453 tempest-FloatingIPsTestJSON-1743304760 tempest-FloatingIPsTestJSON-1743304760-project] HTTP exception thrown: Floating IP not found for ID 7cdb11a2-5bce-41dc-be2c-39fd8189cbe5 Aug 31 15:59:56.978589 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f92319af-9337-49b2-b269-0de5309080bc tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8476b6167a4c838eac59d7c4a40284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a7c84a4ea54074bab3ccc035c5cf47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:56.992682 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-816f9da4-6a7f-411a-ad48-e140d32e3453 tempest-FloatingIPsTestJSON-1743304760 tempest-FloatingIPsTestJSON-1743304760-project] Request method failure captured: Aug 31 15:59:56.992682 n-d-833090-16 devstack@n-api.service[128864]: request: DELETE /compute/v2.1/os-floating-ips/7cdb11a2-5bce-41dc-be2c-39fd8189cbe5 HTTP/1.1 Aug 31 15:59:56.992682 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 15:59:56.992682 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 15:59:56.992682 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 15:59:56.992682 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 15:59:56.992682 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 15:59:56.992682 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 15:59:56.992682 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 15:59:56.992682 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 15:59:56.992682 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4Vnoawg9EKbtJgq_pMq7tDcXb535q9J2BDIAcce4p5SO9CgbMayoa5Upig00B17fmRJaQrxiycmdm-AKTlyGsH6A5X4N2Fx4kuRy8OGHiGe-ondGrTx6WyU0MWIasD859iK17blumhuFqDtThXA3QAQ1MWYZgMvoM7vHA0SIh1mmBg Aug 31 15:59:56.992682 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 15:59:56.992682 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 15:59:56.992682 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 15:59:56.992682 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 15:59:56.992682 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 15:59:56.992682 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 15:59:56.992682 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 7b95a4a339c5449aa64a8ccc777faa39 Aug 31 15:59:56.992682 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-FloatingIPsTestJSON-1743304760 Aug 31 15:59:56.992682 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 15:59:56.992682 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 15:59:56.992682 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7b95a4a339c5449aa64a8ccc777faa39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7b95a4a339c5449aa64a8ccc777faa39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7b95a4a339c5449aa64a8ccc777faa39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7b95a4a339c5449aa64a8ccc777faa39", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 15:59:56.992682 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-FloatingIPsTestJSON-1743304760 Aug 31 15:59:56.992682 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 7b95a4a339c5449aa64a8ccc777faa39 Aug 31 15:59:56.992682 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1743304760 Aug 31 15:59:56.992682 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-FloatingIPsTestJSON-1743304760-project Aug 31 15:59:56.992682 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 15:59:56.992682 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 15:59:56.992682 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 2d8da2e3f611440084c02bff3bf62fc2 Aug 31 15:59:56.992682 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-FloatingIPsTestJSON-1743304760-project Aug 31 15:59:56.992682 n-d-833090-16 devstack@n-api.service[128864]: method: Aug 31 15:59:56.992682 n-d-833090-16 devstack@n-api.service[128864]: exception: Floating IP not found for ID 7cdb11a2-5bce-41dc-be2c-39fd8189cbe5 Aug 31 15:59:56.992682 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '7cdb11a2-5bce-41dc-be2c-39fd8189cbe5'} Aug 31 15:59:56.992682 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 15:59:56.992682 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:56.992682 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 31 15:59:56.992682 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 31 15:59:56.992682 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 15:59:56.992682 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 15:59:56.992682 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 31 15:59:56.992682 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 31 15:59:56.992682 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 15:59:56.992682 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 15:59:56.992682 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 31 15:59:56.992682 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 31 15:59:56.992682 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 15:59:56.992682 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 15:59:56.992682 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 31 15:59:56.992682 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 31 15:59:56.992682 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 15:59:56.992682 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 15:59:56.992682 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 31 15:59:56.992682 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 31 15:59:56.992682 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 15:59:56.992682 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 15:59:56.992682 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 31 15:59:56.992682 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 31 15:59:56.992682 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 31 15:59:56.992682 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 31 15:59:56.992682 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 7cdb11a2-5bce-41dc-be2c-39fd8189cbe5 could not be found Aug 31 15:59:56.992682 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0c00d3f1-78c8-469b-9690-392f7f9e7d82'] Aug 31 15:59:56.992682 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:56.999668 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:56.999668 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:56.999668 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:56.999668 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 31 15:59:56.999668 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 31 15:59:56.999668 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 31 15:59:56.999668 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 31 15:59:56.999668 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 7cdb11a2-5bce-41dc-be2c-39fd8189cbe5. Aug 31 15:59:56.999668 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:56.999668 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:56.999668 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:56.999668 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:56.999668 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:56.999668 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:56.999668 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 15:59:56.999668 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 15:59:56.999668 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 15:59:56.999668 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 15:59:56.999668 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 15:59:56.999668 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 15:59:56.999668 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 31 15:59:56.999668 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 31 15:59:56.999668 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 7cdb11a2-5bce-41dc-be2c-39fd8189cbe5 Aug 31 15:59:56.999668 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:56.999668 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 15:59:56.999668 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:56.999668 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 15:59:56.999668 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 15:59:56.999668 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 15:59:56.999668 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 15:59:56.999668 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 15:59:56.999668 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 7cdb11a2-5bce-41dc-be2c-39fd8189cbe5 Aug 31 15:59:56.999668 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 15:59:57.007076 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f92319af-9337-49b2-b269-0de5309080bc tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4" status: 200 len: 1324 microversion: 2.1 time: 0.736176 Aug 31 15:59:57.007076 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1220/2515] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:56 2022] GET /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4 => generated 1324 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:57.007076 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8faadf04-7e05-44b6-ab02-7ee23d648b3b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:57.007626 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8faadf04-7e05-44b6-ab02-7ee23d648b3b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 16ef09f1-c039-4f49-975a-526f26df57f1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:57.012278 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-816f9da4-6a7f-411a-ad48-e140d32e3453 tempest-FloatingIPsTestJSON-1743304760 tempest-FloatingIPsTestJSON-1743304760-project] Returning 404 to user: Floating IP not found for ID 7cdb11a2-5bce-41dc-be2c-39fd8189cbe5 {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 15:59:57.016235 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-816f9da4-6a7f-411a-ad48-e140d32e3453 tempest-FloatingIPsTestJSON-1743304760 tempest-FloatingIPsTestJSON-1743304760-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/7cdb11a2-5bce-41dc-be2c-39fd8189cbe5" status: 404 len: 111 microversion: 2.1 time: 0.213901 Aug 31 15:59:57.020681 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8faadf04-7e05-44b6-ab02-7ee23d648b3b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:57.024610 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8faadf04-7e05-44b6-ab02-7ee23d648b3b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:57.025438 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8faadf04-7e05-44b6-ab02-7ee23d648b3b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:57.026598 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1296/2516] 10.222.0.50 () {58 vars in 1263 bytes} [Wed Aug 31 15:59:56 2022] DELETE /compute/v2.1/os-floating-ips/7cdb11a2-5bce-41dc-be2c-39fd8189cbe5 => generated 111 bytes in 226 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 15:59:57.027622 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8faadf04-7e05-44b6-ab02-7ee23d648b3b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:57.030833 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8faadf04-7e05-44b6-ab02-7ee23d648b3b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:57.031543 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8faadf04-7e05-44b6-ab02-7ee23d648b3b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:57.034998 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:59:57.290023 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9fe99256-3730-4a46-89a1-d8a33ff0223a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:57.290681 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9fe99256-3730-4a46-89a1-d8a33ff0223a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:57.297348 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9fe99256-3730-4a46-89a1-d8a33ff0223a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:57.298280 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9fe99256-3730-4a46-89a1-d8a33ff0223a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:57.299684 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9fe99256-3730-4a46-89a1-d8a33ff0223a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:57.300759 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9fe99256-3730-4a46-89a1-d8a33ff0223a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:57.301484 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9fe99256-3730-4a46-89a1-d8a33ff0223a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:57.302165 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9fe99256-3730-4a46-89a1-d8a33ff0223a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:57.336191 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=100 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:59:57.463336 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9fe99256-3730-4a46-89a1-d8a33ff0223a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:57.493790 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9fe99256-3730-4a46-89a1-d8a33ff0223a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:57.499302 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9fe99256-3730-4a46-89a1-d8a33ff0223a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:57.504966 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8faadf04-7e05-44b6-ab02-7ee23d648b3b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:57.518603 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8faadf04-7e05-44b6-ab02-7ee23d648b3b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/16ef09f1-c039-4f49-975a-526f26df57f1" status: 200 len: 1314 microversion: 2.1 time: 0.515986 Aug 31 15:59:57.519570 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1221/2517] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:57 2022] GET /compute/v2.1/servers/16ef09f1-c039-4f49-975a-526f26df57f1 => generated 1314 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:57.523528 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9fe99256-3730-4a46-89a1-d8a33ff0223a tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1558 microversion: 2.91 time: 0.237382 Aug 31 15:59:57.543384 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1297/2518] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:57 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1558 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:58.028948 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f147109e-fc7f-46b8-b417-60894cfa77f4 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:58.029878 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f147109e-fc7f-46b8-b417-60894cfa77f4 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 9fd5b244-b9b6-4901-8b2f-0454d800d6b4] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:58.045680 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f147109e-fc7f-46b8-b417-60894cfa77f4 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:58.046620 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f147109e-fc7f-46b8-b417-60894cfa77f4 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:58.047358 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f147109e-fc7f-46b8-b417-60894cfa77f4 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:58.048342 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f147109e-fc7f-46b8-b417-60894cfa77f4 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:58.048803 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f147109e-fc7f-46b8-b417-60894cfa77f4 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:58.050024 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f147109e-fc7f-46b8-b417-60894cfa77f4 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:58.448893 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-045617e5-d6db-4147-8d2b-0925f14ce75b req-65bd6d9c-a65e-47f6-9ca5-06ef5ede982b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16ef09f1-c039-4f49-975a-526f26df57f1", "tag": "9484c4c3-9d97-45bd-88d0-5429543bbc29"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 15:59:58.466628 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:59:58.468814 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=6 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 15:59:58.474014 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-045617e5-d6db-4147-8d2b-0925f14ce75b req-65bd6d9c-a65e-47f6-9ca5-06ef5ede982b service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:58.474895 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-045617e5-d6db-4147-8d2b-0925f14ce75b req-65bd6d9c-a65e-47f6-9ca5-06ef5ede982b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:58.475622 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-045617e5-d6db-4147-8d2b-0925f14ce75b req-65bd6d9c-a65e-47f6-9ca5-06ef5ede982b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:58.493996 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-045617e5-d6db-4147-8d2b-0925f14ce75b req-65bd6d9c-a65e-47f6-9ca5-06ef5ede982b service nova] Creating event network-changed:9484c4c3-9d97-45bd-88d0-5429543bbc29 for instance 16ef09f1-c039-4f49-975a-526f26df57f1 on n-h1-833090-16 Aug 31 15:59:58.501182 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-045617e5-d6db-4147-8d2b-0925f14ce75b req-65bd6d9c-a65e-47f6-9ca5-06ef5ede982b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060238 Aug 31 15:59:58.502605 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1298/2519] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 15:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 15:59:58.545631 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-beead947-24df-40e7-968a-9aa2c23b940a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:58.546611 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-beead947-24df-40e7-968a-9aa2c23b940a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 16ef09f1-c039-4f49-975a-526f26df57f1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:58.568180 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-beead947-24df-40e7-968a-9aa2c23b940a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:58.568900 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-beead947-24df-40e7-968a-9aa2c23b940a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:58.569490 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-beead947-24df-40e7-968a-9aa2c23b940a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:58.570723 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-beead947-24df-40e7-968a-9aa2c23b940a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:58.571536 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-beead947-24df-40e7-968a-9aa2c23b940a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:58.572248 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-beead947-24df-40e7-968a-9aa2c23b940a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:58.838229 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f147109e-fc7f-46b8-b417-60894cfa77f4 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8476b6167a4c838eac59d7c4a40284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a7c84a4ea54074bab3ccc035c5cf47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:58.871241 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f147109e-fc7f-46b8-b417-60894cfa77f4 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4" status: 200 len: 1324 microversion: 2.1 time: 0.846395 Aug 31 15:59:58.872864 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1222/2520] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:58 2022] GET /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4 => generated 1324 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:58.886166 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f9c713ae-f2c6-45cd-b650-e56e8c8175e1 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:58.891321 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f9c713ae-f2c6-45cd-b650-e56e8c8175e1 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:58.912486 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9c713ae-f2c6-45cd-b650-e56e8c8175e1 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:58.916443 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9c713ae-f2c6-45cd-b650-e56e8c8175e1 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:58.917488 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9c713ae-f2c6-45cd-b650-e56e8c8175e1 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:58.919391 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9c713ae-f2c6-45cd-b650-e56e8c8175e1 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:58.928558 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9c713ae-f2c6-45cd-b650-e56e8c8175e1 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:58.941349 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9c713ae-f2c6-45cd-b650-e56e8c8175e1 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:59.334592 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f9c713ae-f2c6-45cd-b650-e56e8c8175e1 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:59.355258 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f9c713ae-f2c6-45cd-b650-e56e8c8175e1 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:59.357602 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f9c713ae-f2c6-45cd-b650-e56e8c8175e1 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:59.373473 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f9c713ae-f2c6-45cd-b650-e56e8c8175e1 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1553 microversion: 2.91 time: 0.496413 Aug 31 15:59:59.374109 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1223/2521] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 15:59:58 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1553 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 15:59:59.529411 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-beead947-24df-40e7-968a-9aa2c23b940a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 15:59:59.557143 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-beead947-24df-40e7-968a-9aa2c23b940a tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/16ef09f1-c039-4f49-975a-526f26df57f1" status: 200 len: 1314 microversion: 2.1 time: 1.016555 Aug 31 15:59:59.558634 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1299/2522] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:58 2022] GET /compute/v2.1/servers/16ef09f1-c039-4f49-975a-526f26df57f1 => generated 1314 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 15:59:59.908435 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ed05247e-c5e7-4d0f-9120-234e9749f431 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 15:59:59.912546 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ed05247e-c5e7-4d0f-9120-234e9749f431 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 9fd5b244-b9b6-4901-8b2f-0454d800d6b4] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 15:59:59.932893 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed05247e-c5e7-4d0f-9120-234e9749f431 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:59.934596 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed05247e-c5e7-4d0f-9120-234e9749f431 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:59.935288 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed05247e-c5e7-4d0f-9120-234e9749f431 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 15:59:59.937792 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed05247e-c5e7-4d0f-9120-234e9749f431 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 15:59:59.938647 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed05247e-c5e7-4d0f-9120-234e9749f431 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 15:59:59.939236 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed05247e-c5e7-4d0f-9120-234e9749f431 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:00.411935 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-856a4141-a43d-4f00-a8bf-4eb1c02a1b19 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:00.412947 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-856a4141-a43d-4f00-a8bf-4eb1c02a1b19 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:00.436902 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-856a4141-a43d-4f00-a8bf-4eb1c02a1b19 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:00.437644 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-856a4141-a43d-4f00-a8bf-4eb1c02a1b19 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:00.438288 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-856a4141-a43d-4f00-a8bf-4eb1c02a1b19 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:00.439208 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-856a4141-a43d-4f00-a8bf-4eb1c02a1b19 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:00.439838 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-856a4141-a43d-4f00-a8bf-4eb1c02a1b19 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:00.440250 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-856a4141-a43d-4f00-a8bf-4eb1c02a1b19 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:00.695528 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-856a4141-a43d-4f00-a8bf-4eb1c02a1b19 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:00.712493 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-856a4141-a43d-4f00-a8bf-4eb1c02a1b19 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:00.715660 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-856a4141-a43d-4f00-a8bf-4eb1c02a1b19 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:00.724923 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-856a4141-a43d-4f00-a8bf-4eb1c02a1b19 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1553 microversion: 2.91 time: 0.316509 Aug 31 16:00:00.726236 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1300/2523] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:00 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1553 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:00.736105 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-74cee4d6-1608-4839-90df-107047162fc5 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:00.736956 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-74cee4d6-1608-4839-90df-107047162fc5 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 16ef09f1-c039-4f49-975a-526f26df57f1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:00.745968 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-74cee4d6-1608-4839-90df-107047162fc5 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:00.746819 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-74cee4d6-1608-4839-90df-107047162fc5 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:00.747418 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-74cee4d6-1608-4839-90df-107047162fc5 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:00.748628 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-74cee4d6-1608-4839-90df-107047162fc5 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:00.749719 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-74cee4d6-1608-4839-90df-107047162fc5 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:00.750221 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-74cee4d6-1608-4839-90df-107047162fc5 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:00.793051 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ed05247e-c5e7-4d0f-9120-234e9749f431 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8476b6167a4c838eac59d7c4a40284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a7c84a4ea54074bab3ccc035c5cf47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:00.820827 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ed05247e-c5e7-4d0f-9120-234e9749f431 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4" status: 200 len: 1324 microversion: 2.1 time: 0.928381 Aug 31 16:00:00.822572 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1224/2524] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 15:59:59 2022] GET /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4 => generated 1324 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:01.328637 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-74cee4d6-1608-4839-90df-107047162fc5 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:01.350704 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-74cee4d6-1608-4839-90df-107047162fc5 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/16ef09f1-c039-4f49-975a-526f26df57f1" status: 200 len: 1314 microversion: 2.1 time: 0.623134 Aug 31 16:00:01.357035 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1301/2525] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:00 2022] GET /compute/v2.1/servers/16ef09f1-c039-4f49-975a-526f26df57f1 => generated 1314 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:01.754460 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e19eb0d5-1101-4e47-9bb0-cffa73f5111c tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:01.755535 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e19eb0d5-1101-4e47-9bb0-cffa73f5111c tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:01.765274 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e19eb0d5-1101-4e47-9bb0-cffa73f5111c tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:01.765999 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e19eb0d5-1101-4e47-9bb0-cffa73f5111c tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:01.767785 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e19eb0d5-1101-4e47-9bb0-cffa73f5111c tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:01.769747 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e19eb0d5-1101-4e47-9bb0-cffa73f5111c tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:01.770566 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e19eb0d5-1101-4e47-9bb0-cffa73f5111c tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:01.772165 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e19eb0d5-1101-4e47-9bb0-cffa73f5111c tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:01.849630 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-76b2137d-dabe-4d51-b0e5-7ebfca89e892 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:01.852189 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-76b2137d-dabe-4d51-b0e5-7ebfca89e892 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 9fd5b244-b9b6-4901-8b2f-0454d800d6b4] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:01.868156 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76b2137d-dabe-4d51-b0e5-7ebfca89e892 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:01.868987 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76b2137d-dabe-4d51-b0e5-7ebfca89e892 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:01.869587 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76b2137d-dabe-4d51-b0e5-7ebfca89e892 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:01.870495 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76b2137d-dabe-4d51-b0e5-7ebfca89e892 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:01.871101 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76b2137d-dabe-4d51-b0e5-7ebfca89e892 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:01.871995 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76b2137d-dabe-4d51-b0e5-7ebfca89e892 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:01.997239 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e19eb0d5-1101-4e47-9bb0-cffa73f5111c tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:02.010024 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e19eb0d5-1101-4e47-9bb0-cffa73f5111c tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:02.020522 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e19eb0d5-1101-4e47-9bb0-cffa73f5111c tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:02.032445 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e19eb0d5-1101-4e47-9bb0-cffa73f5111c tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1553 microversion: 2.91 time: 0.282335 Aug 31 16:00:02.033222 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1225/2526] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:01 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1553 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:02.378266 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e7b52915-ee6a-4003-8d43-bb6ace00f28c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:02.378952 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e7b52915-ee6a-4003-8d43-bb6ace00f28c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 16ef09f1-c039-4f49-975a-526f26df57f1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:02.393095 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7b52915-ee6a-4003-8d43-bb6ace00f28c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:02.395304 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7b52915-ee6a-4003-8d43-bb6ace00f28c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:02.395761 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7b52915-ee6a-4003-8d43-bb6ace00f28c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:02.398650 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7b52915-ee6a-4003-8d43-bb6ace00f28c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:02.399175 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7b52915-ee6a-4003-8d43-bb6ace00f28c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:02.399688 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7b52915-ee6a-4003-8d43-bb6ace00f28c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:03.112761 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-76b2137d-dabe-4d51-b0e5-7ebfca89e892 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8476b6167a4c838eac59d7c4a40284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a7c84a4ea54074bab3ccc035c5cf47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:03.123187 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-76b2137d-dabe-4d51-b0e5-7ebfca89e892 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4" status: 200 len: 1324 microversion: 2.1 time: 1.277425 Aug 31 16:00:03.134489 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1302/2527] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:01 2022] GET /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4 => generated 1324 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:03.148120 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-32317398-2b07-44d4-9f8b-8f179d3a5bbf tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:03.149003 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-32317398-2b07-44d4-9f8b-8f179d3a5bbf tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:03.159820 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-32317398-2b07-44d4-9f8b-8f179d3a5bbf tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:03.161792 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-32317398-2b07-44d4-9f8b-8f179d3a5bbf tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:03.162274 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-32317398-2b07-44d4-9f8b-8f179d3a5bbf tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:03.163008 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-32317398-2b07-44d4-9f8b-8f179d3a5bbf tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:03.166508 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-32317398-2b07-44d4-9f8b-8f179d3a5bbf tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:03.169659 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-32317398-2b07-44d4-9f8b-8f179d3a5bbf tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:03.798516 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-32317398-2b07-44d4-9f8b-8f179d3a5bbf tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:03.813170 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-32317398-2b07-44d4-9f8b-8f179d3a5bbf tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:03.814985 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-32317398-2b07-44d4-9f8b-8f179d3a5bbf tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:03.829949 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-32317398-2b07-44d4-9f8b-8f179d3a5bbf tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1553 microversion: 2.91 time: 0.693808 Aug 31 16:00:03.838367 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1303/2528] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:03 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1553 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:03.849622 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-7f62e008-213f-4773-9b94-4d054ecfbaf6 req-097512af-4755-4286-bf4a-437ad5942751 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fd5b244-b9b6-4901-8b2f-0454d800d6b4", "name": "network-vif-plugged", "status": "completed", "tag": "c2952a3a-e5d0-4c63-8874-7dc700de780f"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:03.871166 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7f62e008-213f-4773-9b94-4d054ecfbaf6 req-097512af-4755-4286-bf4a-437ad5942751 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:03.871914 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7f62e008-213f-4773-9b94-4d054ecfbaf6 req-097512af-4755-4286-bf4a-437ad5942751 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:03.874533 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7f62e008-213f-4773-9b94-4d054ecfbaf6 req-097512af-4755-4286-bf4a-437ad5942751 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:03.907997 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-7f62e008-213f-4773-9b94-4d054ecfbaf6 req-097512af-4755-4286-bf4a-437ad5942751 service nova] Creating event network-vif-plugged:c2952a3a-e5d0-4c63-8874-7dc700de780f for instance 9fd5b244-b9b6-4901-8b2f-0454d800d6b4 on n-h2-833090-16 Aug 31 16:00:03.920792 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-7f62e008-213f-4773-9b94-4d054ecfbaf6 req-097512af-4755-4286-bf4a-437ad5942751 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080739 Aug 31 16:00:03.921813 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1304/2529] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:00:04.123025 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e7b52915-ee6a-4003-8d43-bb6ace00f28c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:04.131549 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e7b52915-ee6a-4003-8d43-bb6ace00f28c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/16ef09f1-c039-4f49-975a-526f26df57f1" status: 200 len: 1314 microversion: 2.1 time: 1.757216 Aug 31 16:00:04.135632 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1226/2530] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:02 2022] GET /compute/v2.1/servers/16ef09f1-c039-4f49-975a-526f26df57f1 => generated 1314 bytes in 1762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:04.145311 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b7bb3b8f-7ee6-4449-88e9-0c87f396637d tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:04.146683 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b7bb3b8f-7ee6-4449-88e9-0c87f396637d tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 9fd5b244-b9b6-4901-8b2f-0454d800d6b4] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:04.163305 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:00:04.165351 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b7bb3b8f-7ee6-4449-88e9-0c87f396637d tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:04.166174 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b7bb3b8f-7ee6-4449-88e9-0c87f396637d tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:04.166792 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b7bb3b8f-7ee6-4449-88e9-0c87f396637d tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:04.167685 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b7bb3b8f-7ee6-4449-88e9-0c87f396637d tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:04.168278 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b7bb3b8f-7ee6-4449-88e9-0c87f396637d tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:04.168844 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b7bb3b8f-7ee6-4449-88e9-0c87f396637d tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:04.865463 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-98e138e8-4f1d-40fc-954b-6e6039d8c4c4 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:04.870389 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-98e138e8-4f1d-40fc-954b-6e6039d8c4c4 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:04.911864 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98e138e8-4f1d-40fc-954b-6e6039d8c4c4 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:04.914723 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98e138e8-4f1d-40fc-954b-6e6039d8c4c4 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:04.918895 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98e138e8-4f1d-40fc-954b-6e6039d8c4c4 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:04.919833 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98e138e8-4f1d-40fc-954b-6e6039d8c4c4 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:04.922374 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98e138e8-4f1d-40fc-954b-6e6039d8c4c4 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:04.932985 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98e138e8-4f1d-40fc-954b-6e6039d8c4c4 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:05.602703 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-98e138e8-4f1d-40fc-954b-6e6039d8c4c4 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:05.616850 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-98e138e8-4f1d-40fc-954b-6e6039d8c4c4 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:05.619088 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-98e138e8-4f1d-40fc-954b-6e6039d8c4c4 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:05.634754 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-98e138e8-4f1d-40fc-954b-6e6039d8c4c4 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1553 microversion: 2.91 time: 0.774250 Aug 31 16:00:05.635788 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b7bb3b8f-7ee6-4449-88e9-0c87f396637d tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8476b6167a4c838eac59d7c4a40284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a7c84a4ea54074bab3ccc035c5cf47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:05.659480 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1227/2531] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:04 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1553 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:05.672243 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b7bb3b8f-7ee6-4449-88e9-0c87f396637d tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4" status: 200 len: 1324 microversion: 2.1 time: 1.530272 Aug 31 16:00:05.673506 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1305/2532] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:04 2022] GET /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4 => generated 1324 bytes in 1533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:05.693657 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-bcf01b48-adec-4d9d-a2c7-fb4ca8504491 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:05.699339 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-bcf01b48-adec-4d9d-a2c7-fb4ca8504491 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 16ef09f1-c039-4f49-975a-526f26df57f1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:05.730850 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bcf01b48-adec-4d9d-a2c7-fb4ca8504491 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:05.731937 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bcf01b48-adec-4d9d-a2c7-fb4ca8504491 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:05.733394 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bcf01b48-adec-4d9d-a2c7-fb4ca8504491 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:05.741086 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bcf01b48-adec-4d9d-a2c7-fb4ca8504491 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:05.741937 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bcf01b48-adec-4d9d-a2c7-fb4ca8504491 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:05.742979 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bcf01b48-adec-4d9d-a2c7-fb4ca8504491 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:06.096230 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f79d8f1d-7b56-4df3-a74b-23377c861865 tempest-VolumesNegativeTest-236939355 tempest-VolumesNegativeTest-236939355-project] Action: 'create', calling method: .version_select at 0x7fbb4ab4ee50>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-637938883", "metadata": {"Type": "work"}}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f79d8f1d-7b56-4df3-a74b-23377c861865 tempest-VolumesNegativeTest-236939355 tempest-VolumesNegativeTest-236939355-project] Request method failure captured: Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 121 Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4WEPVuGtvyeuTiXMu6VQMxxGqE5mQRD-OyGGxj6bQDFMdFjB3Y2eBQPQoJAmyjqQDpE1caq871e2JTzCuPjAbsk3JhmcvPsi7MlqDYkI8dGJ2vIZaEFfHf0HyEO_MtSPl1ToJiL1IHwDWsTxc110rTH8rxlzBlsWHD42xIPPyPZM_g Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 2b4bce7cf2b640b4a51372d20574cb92 Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-VolumesNegativeTest-236939355 Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2b4bce7cf2b640b4a51372d20574cb92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2b4bce7cf2b640b4a51372d20574cb92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2b4bce7cf2b640b4a51372d20574cb92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2b4bce7cf2b640b4a51372d20574cb92", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-VolumesNegativeTest-236939355 Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 2b4bce7cf2b640b4a51372d20574cb92 Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-VolumesNegativeTest-236939355 Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-VolumesNegativeTest-236939355-project Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: d6585a578d6e404db42fea8656e9459b Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-VolumesNegativeTest-236939355-project Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-637938883", "metadata": {"Type": "work"}}} Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: method: Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-637938883', 'metadata': {'Type': 'work'}}}} Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi '#$%' Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:00:06.106334 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:00:06.115433 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 16:00:06.115433 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:06.115433 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:06.115433 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:06.115433 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:06.115433 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:06.115433 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:06.115433 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:00:06.115433 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:00:06.115433 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 31 16:00:06.115433 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:06.115433 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f79d8f1d-7b56-4df3-a74b-23377c861865 tempest-VolumesNegativeTest-236939355 tempest-VolumesNegativeTest-236939355-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:06.115433 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f79d8f1d-7b56-4df3-a74b-23377c861865 tempest-VolumesNegativeTest-236939355 tempest-VolumesNegativeTest-236939355-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.440677 Aug 31 16:00:06.115433 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1228/2533] 10.222.0.50 () {60 vars in 1156 bytes} [Wed Aug 31 16:00:05 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 442 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:00:06.123365 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-1d90bf07-2ea6-4eb1-a0d5-eccb548caae3 req-027c5ede-ceda-47b7-9aaa-5df7178d8e25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16ef09f1-c039-4f49-975a-526f26df57f1", "name": "network-vif-plugged", "status": "completed", "tag": "9484c4c3-9d97-45bd-88d0-5429543bbc29"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:06.156910 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-1d90bf07-2ea6-4eb1-a0d5-eccb548caae3 req-027c5ede-ceda-47b7-9aaa-5df7178d8e25 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:06.157399 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-1d90bf07-2ea6-4eb1-a0d5-eccb548caae3 req-027c5ede-ceda-47b7-9aaa-5df7178d8e25 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:06.159558 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-1d90bf07-2ea6-4eb1-a0d5-eccb548caae3 req-027c5ede-ceda-47b7-9aaa-5df7178d8e25 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:06.196374 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-1d90bf07-2ea6-4eb1-a0d5-eccb548caae3 req-027c5ede-ceda-47b7-9aaa-5df7178d8e25 service nova] Creating event network-vif-plugged:9484c4c3-9d97-45bd-88d0-5429543bbc29 for instance 16ef09f1-c039-4f49-975a-526f26df57f1 on n-h1-833090-16 Aug 31 16:00:06.216557 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-1d90bf07-2ea6-4eb1-a0d5-eccb548caae3 req-027c5ede-ceda-47b7-9aaa-5df7178d8e25 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105619 Aug 31 16:00:06.224179 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1229/2534] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:00:06.252659 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-28100fe4-640f-4581-b179-79259101fa45 tempest-VolumesNegativeTest-236939355 tempest-VolumesNegativeTest-236939355-project] Action: 'create', calling method: .version_select at 0x7fbb4ab6cca0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2036036752", "metadata": {"Type": "work"}}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-28100fe4-640f-4581-b179-79259101fa45 tempest-VolumesNegativeTest-236939355 tempest-VolumesNegativeTest-236939355-project] Request method failure captured: Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 120 Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4WEPVuGtvyeuTiXMu6VQMxxGqE5mQRD-OyGGxj6bQDFMdFjB3Y2eBQPQoJAmyjqQDpE1caq871e2JTzCuPjAbsk3JhmcvPsi7MlqDYkI8dGJ2vIZaEFfHf0HyEO_MtSPl1ToJiL1IHwDWsTxc110rTH8rxlzBlsWHD42xIPPyPZM_g Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 2b4bce7cf2b640b4a51372d20574cb92 Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-VolumesNegativeTest-236939355 Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2b4bce7cf2b640b4a51372d20574cb92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2b4bce7cf2b640b4a51372d20574cb92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2b4bce7cf2b640b4a51372d20574cb92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2b4bce7cf2b640b4a51372d20574cb92", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-VolumesNegativeTest-236939355 Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 2b4bce7cf2b640b4a51372d20574cb92 Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-VolumesNegativeTest-236939355 Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-VolumesNegativeTest-236939355-project Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: d6585a578d6e404db42fea8656e9459b Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-VolumesNegativeTest-236939355-project Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2036036752", "metadata": {"Type": "work"}}} Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: method: Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2036036752', 'metadata': {'Type': 'work'}}}} Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi '0' Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:00:06.284449 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:00:06.289576 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 16:00:06.289576 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:06.289576 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:06.289576 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:06.289576 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:06.289576 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:06.289576 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:06.289576 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:00:06.289576 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:00:06.289576 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 31 16:00:06.289576 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:06.291598 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-28100fe4-640f-4581-b179-79259101fa45 tempest-VolumesNegativeTest-236939355 tempest-VolumesNegativeTest-236939355-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:06.292924 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-28100fe4-640f-4581-b179-79259101fa45 tempest-VolumesNegativeTest-236939355 tempest-VolumesNegativeTest-236939355-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.054071 Aug 31 16:00:06.301742 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1230/2535] 10.222.0.50 () {60 vars in 1156 bytes} [Wed Aug 31 16:00:06 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 77 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:00:06.321020 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-621c9e64-d3ec-4c46-a6be-46b794e62789 tempest-VolumesNegativeTest-236939355 tempest-VolumesNegativeTest-236939355-project] Action: 'create', calling method: .version_select at 0x7fbb4aba24c0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-633905260", "metadata": {"Type": "work"}}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-621c9e64-d3ec-4c46-a6be-46b794e62789 tempest-VolumesNegativeTest-236939355 tempest-VolumesNegativeTest-236939355-project] Request method failure captured: Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 118 Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4WEPVuGtvyeuTiXMu6VQMxxGqE5mQRD-OyGGxj6bQDFMdFjB3Y2eBQPQoJAmyjqQDpE1caq871e2JTzCuPjAbsk3JhmcvPsi7MlqDYkI8dGJ2vIZaEFfHf0HyEO_MtSPl1ToJiL1IHwDWsTxc110rTH8rxlzBlsWHD42xIPPyPZM_g Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 2b4bce7cf2b640b4a51372d20574cb92 Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-VolumesNegativeTest-236939355 Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2b4bce7cf2b640b4a51372d20574cb92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2b4bce7cf2b640b4a51372d20574cb92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2b4bce7cf2b640b4a51372d20574cb92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2b4bce7cf2b640b4a51372d20574cb92", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-VolumesNegativeTest-236939355 Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 2b4bce7cf2b640b4a51372d20574cb92 Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-VolumesNegativeTest-236939355 Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-VolumesNegativeTest-236939355-project Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: d6585a578d6e404db42fea8656e9459b Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-VolumesNegativeTest-236939355-project Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-633905260", "metadata": {"Type": "work"}}} Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: method: Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-633905260', 'metadata': {'Type': 'work'}}}} Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi '' Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:00:06.328561 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:00:06.335026 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 16:00:06.335026 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:06.335026 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:06.335026 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:06.335026 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:06.335026 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:06.335026 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:06.335026 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:00:06.335026 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:00:06.335026 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 31 16:00:06.335026 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:06.344664 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-621c9e64-d3ec-4c46-a6be-46b794e62789 tempest-VolumesNegativeTest-236939355 tempest-VolumesNegativeTest-236939355-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:06.346317 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-621c9e64-d3ec-4c46-a6be-46b794e62789 tempest-VolumesNegativeTest-236939355 tempest-VolumesNegativeTest-236939355-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.038930 Aug 31 16:00:06.347484 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1231/2536] 10.222.0.50 () {60 vars in 1156 bytes} [Wed Aug 31 16:00:06 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 31 16:00:06.359081 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-29705812-ee7f-4531-95af-49718e928ef0 tempest-VolumesNegativeTest-236939355 tempest-VolumesNegativeTest-236939355-project] Calling method '.version_select at 0x7fbb4abc3670>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:06.363644 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-bcf01b48-adec-4d9d-a2c7-fb4ca8504491 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:06.378161 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-bcf01b48-adec-4d9d-a2c7-fb4ca8504491 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/16ef09f1-c039-4f49-975a-526f26df57f1" status: 200 len: 1314 microversion: 2.1 time: 0.703260 Aug 31 16:00:06.385977 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1306/2537] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:05 2022] GET /compute/v2.1/servers/16ef09f1-c039-4f49-975a-526f26df57f1 => generated 1314 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:06.449767 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-29705812-ee7f-4531-95af-49718e928ef0 tempest-VolumesNegativeTest-236939355 tempest-VolumesNegativeTest-236939355-project] HTTP exception thrown: Volume tempest-invalid-2025656556 could not be found. Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-29705812-ee7f-4531-95af-49718e928ef0 tempest-VolumesNegativeTest-236939355 tempest-VolumesNegativeTest-236939355-project] Request method failure captured: Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2025656556 HTTP/1.1 Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4WEPVuGtvyeuTiXMu6VQMxxGqE5mQRD-OyGGxj6bQDFMdFjB3Y2eBQPQoJAmyjqQDpE1caq871e2JTzCuPjAbsk3JhmcvPsi7MlqDYkI8dGJ2vIZaEFfHf0HyEO_MtSPl1ToJiL1IHwDWsTxc110rTH8rxlzBlsWHD42xIPPyPZM_g Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 2b4bce7cf2b640b4a51372d20574cb92 Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-VolumesNegativeTest-236939355 Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2b4bce7cf2b640b4a51372d20574cb92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2b4bce7cf2b640b4a51372d20574cb92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2b4bce7cf2b640b4a51372d20574cb92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2b4bce7cf2b640b4a51372d20574cb92", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-VolumesNegativeTest-236939355 Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 2b4bce7cf2b640b4a51372d20574cb92 Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-VolumesNegativeTest-236939355 Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-VolumesNegativeTest-236939355-project Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: d6585a578d6e404db42fea8656e9459b Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-VolumesNegativeTest-236939355-project Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: method: Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: exception: Volume tempest-invalid-2025656556 could not be found. Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'tempest-invalid-2025656556'} Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2025656556 could not be found. (HTTP 404) (Request-ID: req-7039f2a1-0d13-41cd-8630-f4748678db24) Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 16:00:06.452441 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 16:00:06.457112 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 16:00:06.457112 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 16:00:06.457112 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 16:00:06.457112 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 16:00:06.457112 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 16:00:06.457112 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 16:00:06.457112 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 16:00:06.457112 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 16:00:06.457112 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 16:00:06.457112 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 16:00:06.457112 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 16:00:06.457112 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 16:00:06.457112 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 16:00:06.457112 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2025656556 could not be found. Aug 31 16:00:06.457112 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:06.457112 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:06.457112 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:06.457112 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:06.457112 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:06.457112 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:06.457112 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:06.457112 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:06.457112 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:00:06.457112 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:00:06.457112 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:06.457112 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:06.457112 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 16:00:06.457112 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:00:06.457112 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2025656556 could not be found. Aug 31 16:00:06.457112 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:06.457112 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:06.457112 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:06.457112 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:06.457112 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:06.457112 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:06.457112 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:00:06.457112 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:00:06.457112 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2025656556 could not be found. Aug 31 16:00:06.457112 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:06.465552 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-29705812-ee7f-4531-95af-49718e928ef0 tempest-VolumesNegativeTest-236939355 tempest-VolumesNegativeTest-236939355-project] Returning 404 to user: Volume tempest-invalid-2025656556 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:06.466831 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-29705812-ee7f-4531-95af-49718e928ef0 tempest-VolumesNegativeTest-236939355 tempest-VolumesNegativeTest-236939355-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2025656556" status: 404 len: 99 microversion: 2.1 time: 0.112869 Aug 31 16:00:06.467565 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1232/2538] 10.222.0.50 () {58 vars in 1218 bytes} [Wed Aug 31 16:00:06 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2025656556 => generated 99 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 16:00:06.477200 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-00e2d06d-84e7-4e46-845e-be07e766da2e tempest-VolumesNegativeTest-236939355 tempest-VolumesNegativeTest-236939355-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003953 Aug 31 16:00:06.485070 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1307/2539] 10.222.0.50 () {58 vars in 1140 bytes} [Wed Aug 31 16:00:06 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 31 16:00:06.493884 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b04defc4-e818-40f8-815b-5fd24943a9da tempest-VolumesNegativeTest-236939355 tempest-VolumesNegativeTest-236939355-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003992 Aug 31 16:00:06.494835 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1233/2540] 10.222.0.50 () {58 vars in 1137 bytes} [Wed Aug 31 16:00:06 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 31 16:00:06.506726 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9e5e21bb-2584-4c39-917f-8aa36a74a529 tempest-VolumesNegativeTest-236939355 tempest-VolumesNegativeTest-236939355-project] Calling method '.version_select at 0x7fbb46184ee0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:06.573413 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-9e5e21bb-2584-4c39-917f-8aa36a74a529 tempest-VolumesNegativeTest-236939355 tempest-VolumesNegativeTest-236939355-project] HTTP exception thrown: Volume 254ad184-27b5-4acd-8fb3-fab8f56f42a1 could not be found. Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9e5e21bb-2584-4c39-917f-8aa36a74a529 tempest-VolumesNegativeTest-236939355 tempest-VolumesNegativeTest-236939355-project] Request method failure captured: Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: request: DELETE /compute/v2.1/os-volumes/254ad184-27b5-4acd-8fb3-fab8f56f42a1 HTTP/1.1 Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4WEPVuGtvyeuTiXMu6VQMxxGqE5mQRD-OyGGxj6bQDFMdFjB3Y2eBQPQoJAmyjqQDpE1caq871e2JTzCuPjAbsk3JhmcvPsi7MlqDYkI8dGJ2vIZaEFfHf0HyEO_MtSPl1ToJiL1IHwDWsTxc110rTH8rxlzBlsWHD42xIPPyPZM_g Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 2b4bce7cf2b640b4a51372d20574cb92 Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-VolumesNegativeTest-236939355 Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2b4bce7cf2b640b4a51372d20574cb92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2b4bce7cf2b640b4a51372d20574cb92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2b4bce7cf2b640b4a51372d20574cb92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2b4bce7cf2b640b4a51372d20574cb92", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-VolumesNegativeTest-236939355 Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 2b4bce7cf2b640b4a51372d20574cb92 Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-VolumesNegativeTest-236939355 Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-VolumesNegativeTest-236939355-project Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: d6585a578d6e404db42fea8656e9459b Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-VolumesNegativeTest-236939355-project Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: method: Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: exception: Volume 254ad184-27b5-4acd-8fb3-fab8f56f42a1 could not be found. Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '254ad184-27b5-4acd-8fb3-fab8f56f42a1'} Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 254ad184-27b5-4acd-8fb3-fab8f56f42a1 could not be found. (HTTP 404) (Request-ID: req-ddcd1f67-0de2-436e-b561-0f6ea038242b) Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 16:00:06.576868 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 16:00:06.580990 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 16:00:06.580990 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 16:00:06.580990 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 16:00:06.580990 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 16:00:06.580990 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 16:00:06.580990 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 16:00:06.580990 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 16:00:06.580990 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 16:00:06.580990 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 16:00:06.580990 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 16:00:06.580990 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 16:00:06.580990 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 16:00:06.580990 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 16:00:06.580990 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 254ad184-27b5-4acd-8fb3-fab8f56f42a1 could not be found. Aug 31 16:00:06.580990 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:00:06.580990 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:06.580990 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:00:06.580990 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:06.580990 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:06.580990 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:06.580990 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:06.580990 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:06.580990 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:00:06.580990 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:00:06.580990 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:06.580990 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:06.580990 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 16:00:06.580990 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:00:06.580990 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 254ad184-27b5-4acd-8fb3-fab8f56f42a1 could not be found. Aug 31 16:00:06.580990 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:00:06.580990 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:06.580990 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:00:06.580990 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:06.580990 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:06.580990 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:06.580990 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:00:06.580990 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:00:06.580990 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 254ad184-27b5-4acd-8fb3-fab8f56f42a1 could not be found. Aug 31 16:00:06.580990 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:00:06.584589 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9e5e21bb-2584-4c39-917f-8aa36a74a529 tempest-VolumesNegativeTest-236939355 tempest-VolumesNegativeTest-236939355-project] Returning 404 to user: Volume 254ad184-27b5-4acd-8fb3-fab8f56f42a1 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:06.585662 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9e5e21bb-2584-4c39-917f-8aa36a74a529 tempest-VolumesNegativeTest-236939355 tempest-VolumesNegativeTest-236939355-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/254ad184-27b5-4acd-8fb3-fab8f56f42a1" status: 404 len: 109 microversion: 2.1 time: 0.083460 Aug 31 16:00:06.586718 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1308/2541] 10.222.0.50 () {58 vars in 1248 bytes} [Wed Aug 31 16:00:06 2022] DELETE /compute/v2.1/os-volumes/254ad184-27b5-4acd-8fb3-fab8f56f42a1 => generated 109 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:00:06.599206 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3408dd61-b708-4f79-b02c-df3b0d2adc86 tempest-VolumesNegativeTest-236939355 tempest-VolumesNegativeTest-236939355-project] Calling method '.version_select at 0x7fbb4aa43280>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:06.668540 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-69730f75-6f14-4ddc-8d89-7d1ec2038361 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:06.669930 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-69730f75-6f14-4ddc-8d89-7d1ec2038361 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:06.694265 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69730f75-6f14-4ddc-8d89-7d1ec2038361 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:06.695151 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69730f75-6f14-4ddc-8d89-7d1ec2038361 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:06.695816 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69730f75-6f14-4ddc-8d89-7d1ec2038361 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:06.697204 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69730f75-6f14-4ddc-8d89-7d1ec2038361 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:06.697961 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69730f75-6f14-4ddc-8d89-7d1ec2038361 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:06.698604 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69730f75-6f14-4ddc-8d89-7d1ec2038361 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:06.715400 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-3408dd61-b708-4f79-b02c-df3b0d2adc86 tempest-VolumesNegativeTest-236939355 tempest-VolumesNegativeTest-236939355-project] HTTP exception thrown: Volume 757e3605-3e98-4b5c-a187-98e29930f2d6 could not be found. Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3408dd61-b708-4f79-b02c-df3b0d2adc86 tempest-VolumesNegativeTest-236939355 tempest-VolumesNegativeTest-236939355-project] Request method failure captured: Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/os-volumes/757e3605-3e98-4b5c-a187-98e29930f2d6 HTTP/1.1 Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4WEPVuGtvyeuTiXMu6VQMxxGqE5mQRD-OyGGxj6bQDFMdFjB3Y2eBQPQoJAmyjqQDpE1caq871e2JTzCuPjAbsk3JhmcvPsi7MlqDYkI8dGJ2vIZaEFfHf0HyEO_MtSPl1ToJiL1IHwDWsTxc110rTH8rxlzBlsWHD42xIPPyPZM_g Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 2b4bce7cf2b640b4a51372d20574cb92 Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-VolumesNegativeTest-236939355 Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2b4bce7cf2b640b4a51372d20574cb92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2b4bce7cf2b640b4a51372d20574cb92"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2b4bce7cf2b640b4a51372d20574cb92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2b4bce7cf2b640b4a51372d20574cb92", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-VolumesNegativeTest-236939355 Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 2b4bce7cf2b640b4a51372d20574cb92 Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-VolumesNegativeTest-236939355 Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-VolumesNegativeTest-236939355-project Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: d6585a578d6e404db42fea8656e9459b Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-VolumesNegativeTest-236939355-project Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: method: Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: exception: Volume 757e3605-3e98-4b5c-a187-98e29930f2d6 could not be found. Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '757e3605-3e98-4b5c-a187-98e29930f2d6'} Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 757e3605-3e98-4b5c-a187-98e29930f2d6 could not be found. (HTTP 404) (Request-ID: req-71a7b229-0e22-482a-a05e-9396ba21ff7f) Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 16:00:06.717424 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 16:00:06.721744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 16:00:06.721744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 16:00:06.721744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 16:00:06.721744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 16:00:06.721744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 16:00:06.721744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 16:00:06.721744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 16:00:06.721744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 16:00:06.721744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 16:00:06.721744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 16:00:06.721744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 16:00:06.721744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 16:00:06.721744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 16:00:06.721744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 757e3605-3e98-4b5c-a187-98e29930f2d6 could not be found. Aug 31 16:00:06.721744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:06.721744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:06.721744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:06.721744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:06.721744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:06.721744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:06.721744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:06.721744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:06.721744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:00:06.721744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:00:06.721744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:06.721744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:06.721744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 16:00:06.721744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:00:06.721744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 757e3605-3e98-4b5c-a187-98e29930f2d6 could not be found. Aug 31 16:00:06.721744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:06.721744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:06.721744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:06.721744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:06.721744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:06.721744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:06.721744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:00:06.721744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:00:06.721744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 757e3605-3e98-4b5c-a187-98e29930f2d6 could not be found. Aug 31 16:00:06.721744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:06.721744 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3408dd61-b708-4f79-b02c-df3b0d2adc86 tempest-VolumesNegativeTest-236939355 tempest-VolumesNegativeTest-236939355-project] Returning 404 to user: Volume 757e3605-3e98-4b5c-a187-98e29930f2d6 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:06.721744 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3408dd61-b708-4f79-b02c-df3b0d2adc86 tempest-VolumesNegativeTest-236939355 tempest-VolumesNegativeTest-236939355-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/757e3605-3e98-4b5c-a187-98e29930f2d6" status: 404 len: 109 microversion: 2.1 time: 0.125824 Aug 31 16:00:06.724678 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1234/2542] 10.222.0.50 () {58 vars in 1245 bytes} [Wed Aug 31 16:00:06 2022] GET /compute/v2.1/os-volumes/757e3605-3e98-4b5c-a187-98e29930f2d6 => generated 109 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:00:06.754024 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b317d9d9-ecf1-442d-8740-26e6c5e7a56d tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:06.754829 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b317d9d9-ecf1-442d-8740-26e6c5e7a56d tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 9fd5b244-b9b6-4901-8b2f-0454d800d6b4] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:06.769100 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b317d9d9-ecf1-442d-8740-26e6c5e7a56d tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:06.774782 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b317d9d9-ecf1-442d-8740-26e6c5e7a56d tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:06.778231 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b317d9d9-ecf1-442d-8740-26e6c5e7a56d tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:06.779439 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b317d9d9-ecf1-442d-8740-26e6c5e7a56d tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:06.780154 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b317d9d9-ecf1-442d-8740-26e6c5e7a56d tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:06.784986 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b317d9d9-ecf1-442d-8740-26e6c5e7a56d tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:06.805629 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-69730f75-6f14-4ddc-8d89-7d1ec2038361 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:06.828574 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-69730f75-6f14-4ddc-8d89-7d1ec2038361 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:06.832137 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-69730f75-6f14-4ddc-8d89-7d1ec2038361 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:06.847062 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-69730f75-6f14-4ddc-8d89-7d1ec2038361 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1553 microversion: 2.91 time: 0.183645 Aug 31 16:00:06.850587 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1309/2543] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:06 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1553 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:07.364952 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b317d9d9-ecf1-442d-8740-26e6c5e7a56d tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8476b6167a4c838eac59d7c4a40284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a7c84a4ea54074bab3ccc035c5cf47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:07.377649 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b317d9d9-ecf1-442d-8740-26e6c5e7a56d tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4" status: 200 len: 1520 microversion: 2.1 time: 0.651765 Aug 31 16:00:07.398176 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1235/2544] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:06 2022] GET /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4 => generated 1520 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:07.404420 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7ebafa5c-8209-4403-aa59-e51a2d0dce23 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:07.405230 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7ebafa5c-8209-4403-aa59-e51a2d0dce23 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 16ef09f1-c039-4f49-975a-526f26df57f1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:07.407292 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4761a940-b971-4d18-89c3-1088334821a2 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:07.407916 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4761a940-b971-4d18-89c3-1088334821a2 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 9fd5b244-b9b6-4901-8b2f-0454d800d6b4] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:07.412924 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ebafa5c-8209-4403-aa59-e51a2d0dce23 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:07.413683 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ebafa5c-8209-4403-aa59-e51a2d0dce23 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:07.414281 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ebafa5c-8209-4403-aa59-e51a2d0dce23 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:07.415111 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ebafa5c-8209-4403-aa59-e51a2d0dce23 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:07.415748 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ebafa5c-8209-4403-aa59-e51a2d0dce23 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:07.416278 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ebafa5c-8209-4403-aa59-e51a2d0dce23 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:07.421397 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4761a940-b971-4d18-89c3-1088334821a2 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:07.424542 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4761a940-b971-4d18-89c3-1088334821a2 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:07.425016 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4761a940-b971-4d18-89c3-1088334821a2 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:07.425756 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4761a940-b971-4d18-89c3-1088334821a2 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:07.426294 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4761a940-b971-4d18-89c3-1088334821a2 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:07.444161 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4761a940-b971-4d18-89c3-1088334821a2 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:08.272466 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4761a940-b971-4d18-89c3-1088334821a2 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8476b6167a4c838eac59d7c4a40284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a7c84a4ea54074bab3ccc035c5cf47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:08.301022 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4761a940-b971-4d18-89c3-1088334821a2 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4" status: 200 len: 1520 microversion: 2.1 time: 0.897984 Aug 31 16:00:08.303731 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1236/2545] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:07 2022] GET /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4 => generated 1520 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:08.325905 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d16e1303-6b61-48ec-9da6-78311ef64625 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:08.326814 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d16e1303-6b61-48ec-9da6-78311ef64625 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:08.334517 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d16e1303-6b61-48ec-9da6-78311ef64625 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:08.335305 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d16e1303-6b61-48ec-9da6-78311ef64625 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:08.335911 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d16e1303-6b61-48ec-9da6-78311ef64625 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:08.336841 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d16e1303-6b61-48ec-9da6-78311ef64625 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:08.337515 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d16e1303-6b61-48ec-9da6-78311ef64625 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:08.338190 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d16e1303-6b61-48ec-9da6-78311ef64625 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:08.560834 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d16e1303-6b61-48ec-9da6-78311ef64625 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:08.574553 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d16e1303-6b61-48ec-9da6-78311ef64625 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:08.577964 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d16e1303-6b61-48ec-9da6-78311ef64625 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:08.599484 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d16e1303-6b61-48ec-9da6-78311ef64625 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1553 microversion: 2.91 time: 0.277959 Aug 31 16:00:08.619940 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7ebafa5c-8209-4403-aa59-e51a2d0dce23 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:08.629765 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7ebafa5c-8209-4403-aa59-e51a2d0dce23 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/16ef09f1-c039-4f49-975a-526f26df57f1" status: 200 len: 1314 microversion: 2.1 time: 1.230764 Aug 31 16:00:08.639129 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1237/2546] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:08 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1553 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:08.639477 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1310/2547] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:07 2022] GET /compute/v2.1/servers/16ef09f1-c039-4f49-975a-526f26df57f1 => generated 1314 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:08.648485 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4d78006e-c24e-4a70-af63-a5bcdaff40d4 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1478691301", "metadata": {"": ""}}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4d78006e-c24e-4a70-af63-a5bcdaff40d4 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Request method failure captured: Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4/action HTTP/1.1 Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 107 Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4VuegaF_fmy46ih3aH48SHyk9S0K5f6VgFr4AjCz2qlep55514N16M8NDogA4-FaRt5exvJysgb4a16NCF-uwnoFVaAwgVvS87_klTsI4Q1cOt4rcQPW4Ao3jepMn1MxMfgCP9op9_ywmQywVzBp5itFLK6pFxwsw-bP4gtv8ayT6Y Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 75a7c84a4ea54074bab3ccc035c5cf47 Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2143463755 Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/75a7c84a4ea54074bab3ccc035c5cf47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/75a7c84a4ea54074bab3ccc035c5cf47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/75a7c84a4ea54074bab3ccc035c5cf47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_75a7c84a4ea54074bab3ccc035c5cf47", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2143463755 Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 75a7c84a4ea54074bab3ccc035c5cf47 Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2143463755 Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ImagesOneServerNegativeTestJSON-2143463755-project Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 3c8476b6167a4c838eac59d7c4a40284 Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2143463755-project Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1478691301", "metadata": {"": ""}}} Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '9fd5b244-b9b6-4901-8b2f-0454d800d6b4', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1478691301', 'metadata': {'': ''}}}} Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi {'': ''} Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:00:08.661218 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 16:00:08.666319 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 16:00:08.666319 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:00:08.666319 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:00:08.666319 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:00:08.666319 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:00:08.666319 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 31 16:00:08.666319 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:08.666319 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:08.666319 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:08.666319 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:08.666319 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:08.666319 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:08.666319 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:00:08.666319 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:00:08.666319 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 31 16:00:08.666319 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:08.675162 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4d78006e-c24e-4a70-af63-a5bcdaff40d4 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:08.680698 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4d78006e-c24e-4a70-af63-a5bcdaff40d4 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "POST /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4/action" status: 400 len: 170 microversion: 2.1 time: 0.036639 Aug 31 16:00:08.682896 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1238/2548] 10.222.0.50 () {60 vars in 1279 bytes} [Wed Aug 31 16:00:08 2022] POST /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4/action => generated 170 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:00:08.691093 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-764026dd-2132-4d2e-888f-76983c658ac0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:08.691696 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-764026dd-2132-4d2e-888f-76983c658ac0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 9fd5b244-b9b6-4901-8b2f-0454d800d6b4] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:08.700803 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-764026dd-2132-4d2e-888f-76983c658ac0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:08.701257 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-764026dd-2132-4d2e-888f-76983c658ac0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:08.701700 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-764026dd-2132-4d2e-888f-76983c658ac0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:08.713941 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-764026dd-2132-4d2e-888f-76983c658ac0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:08.719459 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-764026dd-2132-4d2e-888f-76983c658ac0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:08.719953 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-764026dd-2132-4d2e-888f-76983c658ac0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:09.340870 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-764026dd-2132-4d2e-888f-76983c658ac0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8476b6167a4c838eac59d7c4a40284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a7c84a4ea54074bab3ccc035c5cf47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:09.355254 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-764026dd-2132-4d2e-888f-76983c658ac0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4" status: 200 len: 1520 microversion: 2.1 time: 0.668333 Aug 31 16:00:09.380414 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b5ef8359-245a-40ce-8633-830e2dacdff4 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:09.381181 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b5ef8359-245a-40ce-8633-830e2dacdff4 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 9fd5b244-b9b6-4901-8b2f-0454d800d6b4] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:09.386564 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1311/2549] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:08 2022] GET /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4 => generated 1520 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:09.396361 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5ef8359-245a-40ce-8633-830e2dacdff4 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:09.396872 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5ef8359-245a-40ce-8633-830e2dacdff4 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:09.397308 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5ef8359-245a-40ce-8633-830e2dacdff4 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:09.398232 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5ef8359-245a-40ce-8633-830e2dacdff4 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:09.400289 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5ef8359-245a-40ce-8633-830e2dacdff4 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:09.401486 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5ef8359-245a-40ce-8633-830e2dacdff4 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:09.629388 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b84350d9-8a9b-4301-af75-3b9bb8e153da tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:09.629856 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b84350d9-8a9b-4301-af75-3b9bb8e153da tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:09.641841 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b84350d9-8a9b-4301-af75-3b9bb8e153da tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:09.646059 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b84350d9-8a9b-4301-af75-3b9bb8e153da tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:09.646824 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b84350d9-8a9b-4301-af75-3b9bb8e153da tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:09.649432 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b84350d9-8a9b-4301-af75-3b9bb8e153da tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:09.651934 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b84350d9-8a9b-4301-af75-3b9bb8e153da tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:09.656915 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b84350d9-8a9b-4301-af75-3b9bb8e153da tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:10.126375 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b84350d9-8a9b-4301-af75-3b9bb8e153da tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:10.142611 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b84350d9-8a9b-4301-af75-3b9bb8e153da tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:10.144476 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b84350d9-8a9b-4301-af75-3b9bb8e153da tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:10.161171 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b84350d9-8a9b-4301-af75-3b9bb8e153da tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1553 microversion: 2.91 time: 0.535585 Aug 31 16:00:10.162279 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1312/2550] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:09 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1553 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:00:10.170642 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3bba2b73-8a12-4c2b-807c-db730f6b43e3 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:10.171641 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3bba2b73-8a12-4c2b-807c-db730f6b43e3 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 16ef09f1-c039-4f49-975a-526f26df57f1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:10.191099 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3bba2b73-8a12-4c2b-807c-db730f6b43e3 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:10.195116 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3bba2b73-8a12-4c2b-807c-db730f6b43e3 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:10.197529 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3bba2b73-8a12-4c2b-807c-db730f6b43e3 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:10.200175 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3bba2b73-8a12-4c2b-807c-db730f6b43e3 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:10.200778 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3bba2b73-8a12-4c2b-807c-db730f6b43e3 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:10.202029 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3bba2b73-8a12-4c2b-807c-db730f6b43e3 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:10.482067 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b5ef8359-245a-40ce-8633-830e2dacdff4 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8476b6167a4c838eac59d7c4a40284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a7c84a4ea54074bab3ccc035c5cf47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:10.493053 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b5ef8359-245a-40ce-8633-830e2dacdff4 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4" status: 200 len: 1520 microversion: 2.1 time: 1.118312 Aug 31 16:00:10.515109 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1239/2551] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:09 2022] GET /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4 => generated 1520 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:10.527746 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fa8cffd3-31ec-4bdf-8938-0d23226cab90 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1206088997", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:10.538268 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fa8cffd3-31ec-4bdf-8938-0d23226cab90 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Request method failure captured: Aug 31 16:00:10.538268 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4/action HTTP/1.1 Aug 31 16:00:10.538268 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:00:10.538268 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:00:10.538268 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:00:10.538268 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 619 Aug 31 16:00:10.538268 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:00:10.538268 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:00:10.538268 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:00:10.538268 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:10.538268 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4VuegaF_fmy46ih3aH48SHyk9S0K5f6VgFr4AjCz2qlep55514N16M8NDogA4-FaRt5exvJysgb4a16NCF-uwnoFVaAwgVvS87_klTsI4Q1cOt4rcQPW4Ao3jepMn1MxMfgCP9op9_ywmQywVzBp5itFLK6pFxwsw-bP4gtv8ayT6Y Aug 31 16:00:10.538268 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:00:10.538268 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:00:10.538268 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:00:10.538268 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:00:10.538268 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:00:10.538268 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:00:10.538268 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 75a7c84a4ea54074bab3ccc035c5cf47 Aug 31 16:00:10.538268 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2143463755 Aug 31 16:00:10.538268 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:00:10.538268 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:00:10.538268 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/75a7c84a4ea54074bab3ccc035c5cf47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/75a7c84a4ea54074bab3ccc035c5cf47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/75a7c84a4ea54074bab3ccc035c5cf47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_75a7c84a4ea54074bab3ccc035c5cf47", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:00:10.538268 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2143463755 Aug 31 16:00:10.538268 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 75a7c84a4ea54074bab3ccc035c5cf47 Aug 31 16:00:10.538268 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2143463755 Aug 31 16:00:10.538268 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ImagesOneServerNegativeTestJSON-2143463755-project Aug 31 16:00:10.538268 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:00:10.538268 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:00:10.538268 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 3c8476b6167a4c838eac59d7c4a40284 Aug 31 16:00:10.538268 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2143463755-project Aug 31 16:00:10.538268 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 16:00:10.538268 n-d-833090-16 devstack@n-api.service[128863]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1206088997", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Aug 31 16:00:10.538268 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:00:10.538268 n-d-833090-16 devstack@n-api.service[128863]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 31 16:00:10.538268 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '9fd5b244-b9b6-4901-8b2f-0454d800d6b4', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1206088997', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Aug 31 16:00:10.538268 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:10.538268 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:10.538268 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:00:10.538268 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:00:10.538268 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:00:10.538268 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:00:10.540904 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 31 16:00:10.540904 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:10.540904 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 31 16:00:10.540904 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 31 16:00:10.540904 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 31 16:00:10.540904 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 31 16:00:10.540904 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 31 16:00:10.540904 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:10.540904 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 31 16:00:10.540904 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Aug 31 16:00:10.540904 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:10.540904 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:10.540904 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:10.540904 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:10.540904 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:10.540904 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:10.540904 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:10.540904 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:10.540904 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:10.540904 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:10.540904 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:00:10.540904 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:00:10.540904 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 16:00:10.540904 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 16:00:10.540904 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:00:10.540904 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:00:10.540904 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:00:10.540904 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:00:10.540904 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 31 16:00:10.540904 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:10.540904 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:10.540904 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:10.540904 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:10.540904 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:10.540904 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:10.540904 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:00:10.540904 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:00:10.540904 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 31 16:00:10.540904 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:10.550144 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fa8cffd3-31ec-4bdf-8938-0d23226cab90 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:10.551388 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fa8cffd3-31ec-4bdf-8938-0d23226cab90 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "POST /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4/action" status: 400 len: 938 microversion: 2.1 time: 0.035146 Aug 31 16:00:10.556921 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1240/2552] 10.222.0.50 () {60 vars in 1279 bytes} [Wed Aug 31 16:00:10 2022] POST /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4/action => generated 938 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:00:10.564933 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a51999ed-db20-442d-9f66-7eca82e29179 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:10.570614 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a51999ed-db20-442d-9f66-7eca82e29179 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 9fd5b244-b9b6-4901-8b2f-0454d800d6b4] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:10.589839 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a51999ed-db20-442d-9f66-7eca82e29179 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:10.590730 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a51999ed-db20-442d-9f66-7eca82e29179 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:10.591404 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a51999ed-db20-442d-9f66-7eca82e29179 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:10.592364 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a51999ed-db20-442d-9f66-7eca82e29179 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:10.594675 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a51999ed-db20-442d-9f66-7eca82e29179 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:10.595394 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a51999ed-db20-442d-9f66-7eca82e29179 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:10.671343 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3bba2b73-8a12-4c2b-807c-db730f6b43e3 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:10.685737 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3bba2b73-8a12-4c2b-807c-db730f6b43e3 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/16ef09f1-c039-4f49-975a-526f26df57f1" status: 200 len: 1501 microversion: 2.1 time: 0.518698 Aug 31 16:00:10.686622 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1313/2553] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:10 2022] GET /compute/v2.1/servers/16ef09f1-c039-4f49-975a-526f26df57f1 => generated 1501 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:10.710531 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f045cd45-5319-405f-a99d-46c37a359a87 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:10.711438 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f045cd45-5319-405f-a99d-46c37a359a87 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 16ef09f1-c039-4f49-975a-526f26df57f1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:10.720016 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f045cd45-5319-405f-a99d-46c37a359a87 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:10.723911 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f045cd45-5319-405f-a99d-46c37a359a87 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:10.724647 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f045cd45-5319-405f-a99d-46c37a359a87 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:10.725607 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f045cd45-5319-405f-a99d-46c37a359a87 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:10.726337 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f045cd45-5319-405f-a99d-46c37a359a87 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:10.728263 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f045cd45-5319-405f-a99d-46c37a359a87 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:10.794771 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-f045cd45-5319-405f-a99d-46c37a359a87 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lazy-loading 'flavor' on Instance uuid 16ef09f1-c039-4f49-975a-526f26df57f1 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:00:10.944022 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f045cd45-5319-405f-a99d-46c37a359a87 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "POST /compute/v2.1/servers/16ef09f1-c039-4f49-975a-526f26df57f1/action" status: 202 len: 0 microversion: 2.1 time: 0.237367 Aug 31 16:00:10.950759 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1314/2554] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:00:10 2022] POST /compute/v2.1/servers/16ef09f1-c039-4f49-975a-526f26df57f1/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 16:00:10.956720 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7e24027e-46b4-4cb6-8f50-8f5f9d47bfda tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:10.961361 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7e24027e-46b4-4cb6-8f50-8f5f9d47bfda tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 16ef09f1-c039-4f49-975a-526f26df57f1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:10.974341 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7e24027e-46b4-4cb6-8f50-8f5f9d47bfda tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:10.979021 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7e24027e-46b4-4cb6-8f50-8f5f9d47bfda tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:10.979839 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7e24027e-46b4-4cb6-8f50-8f5f9d47bfda tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:10.981170 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7e24027e-46b4-4cb6-8f50-8f5f9d47bfda tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:10.986308 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7e24027e-46b4-4cb6-8f50-8f5f9d47bfda tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:10.987012 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7e24027e-46b4-4cb6-8f50-8f5f9d47bfda tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:11.442301 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a51999ed-db20-442d-9f66-7eca82e29179 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8476b6167a4c838eac59d7c4a40284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a7c84a4ea54074bab3ccc035c5cf47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:11.451713 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a51999ed-db20-442d-9f66-7eca82e29179 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4" status: 200 len: 1520 microversion: 2.1 time: 0.893302 Aug 31 16:00:11.480086 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1241/2555] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:10 2022] GET /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4 => generated 1520 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:11.498757 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-136470c5-e797-43cc-99b9-95d0201a8fcb tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:11.503678 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-136470c5-e797-43cc-99b9-95d0201a8fcb tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:11.529051 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-136470c5-e797-43cc-99b9-95d0201a8fcb tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:11.530286 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-136470c5-e797-43cc-99b9-95d0201a8fcb tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:11.531624 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-136470c5-e797-43cc-99b9-95d0201a8fcb tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:11.533206 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-136470c5-e797-43cc-99b9-95d0201a8fcb tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:11.535707 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-136470c5-e797-43cc-99b9-95d0201a8fcb tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:11.536458 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-136470c5-e797-43cc-99b9-95d0201a8fcb tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:11.705970 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7e24027e-46b4-4cb6-8f50-8f5f9d47bfda tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:11.713074 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:00:11.719381 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7e24027e-46b4-4cb6-8f50-8f5f9d47bfda tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/16ef09f1-c039-4f49-975a-526f26df57f1" status: 200 len: 1509 microversion: 2.1 time: 0.766971 Aug 31 16:00:11.719979 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1315/2556] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:10 2022] GET /compute/v2.1/servers/16ef09f1-c039-4f49-975a-526f26df57f1 => generated 1509 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:11.747768 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-544fb9ad-eada-40da-83c4-d63deeb5add0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:11.750150 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-544fb9ad-eada-40da-83c4-d63deeb5add0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 9fd5b244-b9b6-4901-8b2f-0454d800d6b4] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:11.766785 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-544fb9ad-eada-40da-83c4-d63deeb5add0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:11.767272 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-544fb9ad-eada-40da-83c4-d63deeb5add0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:11.767961 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-544fb9ad-eada-40da-83c4-d63deeb5add0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:11.769000 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-544fb9ad-eada-40da-83c4-d63deeb5add0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:11.769632 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-544fb9ad-eada-40da-83c4-d63deeb5add0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:11.771285 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-544fb9ad-eada-40da-83c4-d63deeb5add0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:11.859198 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-136470c5-e797-43cc-99b9-95d0201a8fcb tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:11.871660 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-136470c5-e797-43cc-99b9-95d0201a8fcb tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:11.875497 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-136470c5-e797-43cc-99b9-95d0201a8fcb tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:11.891601 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-136470c5-e797-43cc-99b9-95d0201a8fcb tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1553 microversion: 2.91 time: 0.408750 Aug 31 16:00:11.914419 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1242/2557] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:11 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1553 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:12.361393 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-544fb9ad-eada-40da-83c4-d63deeb5add0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8476b6167a4c838eac59d7c4a40284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a7c84a4ea54074bab3ccc035c5cf47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:12.369635 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-544fb9ad-eada-40da-83c4-d63deeb5add0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4" status: 200 len: 1520 microversion: 2.1 time: 0.632321 Aug 31 16:00:12.375833 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1316/2558] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:11 2022] GET /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4 => generated 1520 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:12.396363 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-49a0e6e4-a230-42cb-b4d7-3446952ca155 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:12.403393 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-49a0e6e4-a230-42cb-b4d7-3446952ca155 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Request method failure captured: Aug 31 16:00:12.403393 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4/action HTTP/1.1 Aug 31 16:00:12.403393 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:00:12.403393 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:00:12.403393 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:00:12.403393 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 285 Aug 31 16:00:12.403393 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:00:12.403393 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:00:12.403393 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:00:12.403393 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:12.403393 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4VuegaF_fmy46ih3aH48SHyk9S0K5f6VgFr4AjCz2qlep55514N16M8NDogA4-FaRt5exvJysgb4a16NCF-uwnoFVaAwgVvS87_klTsI4Q1cOt4rcQPW4Ao3jepMn1MxMfgCP9op9_ywmQywVzBp5itFLK6pFxwsw-bP4gtv8ayT6Y Aug 31 16:00:12.403393 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:00:12.403393 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:00:12.403393 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:00:12.403393 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:00:12.403393 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:00:12.403393 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:00:12.403393 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 75a7c84a4ea54074bab3ccc035c5cf47 Aug 31 16:00:12.403393 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2143463755 Aug 31 16:00:12.403393 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:00:12.403393 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:00:12.403393 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/75a7c84a4ea54074bab3ccc035c5cf47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/75a7c84a4ea54074bab3ccc035c5cf47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/75a7c84a4ea54074bab3ccc035c5cf47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_75a7c84a4ea54074bab3ccc035c5cf47", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:00:12.403393 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2143463755 Aug 31 16:00:12.403393 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 75a7c84a4ea54074bab3ccc035c5cf47 Aug 31 16:00:12.403393 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2143463755 Aug 31 16:00:12.403393 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ImagesOneServerNegativeTestJSON-2143463755-project Aug 31 16:00:12.403393 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:00:12.403393 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:00:12.403393 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 3c8476b6167a4c838eac59d7c4a40284 Aug 31 16:00:12.403393 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2143463755-project Aug 31 16:00:12.403393 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 16:00:12.403393 n-d-833090-16 devstack@n-api.service[128863]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 31 16:00:12.403393 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:00:12.403393 n-d-833090-16 devstack@n-api.service[128863]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 31 16:00:12.403393 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '9fd5b244-b9b6-4901-8b2f-0454d800d6b4', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 31 16:00:12.403393 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:12.403393 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:12.403393 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:00:12.403393 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:00:12.403393 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:00:12.403393 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:00:12.403393 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 31 16:00:12.403393 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:12.403393 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Aug 31 16:00:12.403393 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 31 16:00:12.403393 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:12.403393 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 31 16:00:12.403393 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 31 16:00:12.403393 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:12.403393 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:12.403393 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:12.408930 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:12.408930 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:12.408930 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:12.408930 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:12.408930 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:12.408930 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:12.408930 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:12.408930 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:00:12.408930 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:00:12.408930 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 16:00:12.408930 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 16:00:12.408930 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:00:12.408930 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:00:12.408930 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:00:12.408930 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:00:12.408930 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 31 16:00:12.408930 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:12.408930 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:12.408930 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:12.408930 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:12.408930 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:12.408930 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:12.408930 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:00:12.408930 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:00:12.408930 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 31 16:00:12.408930 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:12.417268 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-49a0e6e4-a230-42cb-b4d7-3446952ca155 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:12.418810 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-49a0e6e4-a230-42cb-b4d7-3446952ca155 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "POST /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4/action" status: 400 len: 619 microversion: 2.1 time: 0.027480 Aug 31 16:00:12.422386 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1243/2559] 10.222.0.50 () {60 vars in 1279 bytes} [Wed Aug 31 16:00:12 2022] POST /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4/action => generated 619 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 31 16:00:12.434692 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3172380a-c848-4bb0-9edc-dd1f158e9e2e tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:12.437718 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3172380a-c848-4bb0-9edc-dd1f158e9e2e tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 9fd5b244-b9b6-4901-8b2f-0454d800d6b4] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:12.456846 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3172380a-c848-4bb0-9edc-dd1f158e9e2e tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:12.457939 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3172380a-c848-4bb0-9edc-dd1f158e9e2e tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:12.459031 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3172380a-c848-4bb0-9edc-dd1f158e9e2e tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:12.461407 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3172380a-c848-4bb0-9edc-dd1f158e9e2e tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:12.463988 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3172380a-c848-4bb0-9edc-dd1f158e9e2e tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:12.465590 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3172380a-c848-4bb0-9edc-dd1f158e9e2e tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:12.744121 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-99ce1cd9-f468-45d4-b8d1-e4dbba54f40b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:12.746115 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-99ce1cd9-f468-45d4-b8d1-e4dbba54f40b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 16ef09f1-c039-4f49-975a-526f26df57f1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:12.764778 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99ce1cd9-f468-45d4-b8d1-e4dbba54f40b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:12.766370 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99ce1cd9-f468-45d4-b8d1-e4dbba54f40b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:12.767641 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99ce1cd9-f468-45d4-b8d1-e4dbba54f40b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:12.770578 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99ce1cd9-f468-45d4-b8d1-e4dbba54f40b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:12.772381 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99ce1cd9-f468-45d4-b8d1-e4dbba54f40b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:12.774848 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99ce1cd9-f468-45d4-b8d1-e4dbba54f40b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:12.981269 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3172380a-c848-4bb0-9edc-dd1f158e9e2e tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8476b6167a4c838eac59d7c4a40284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a7c84a4ea54074bab3ccc035c5cf47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:12.991890 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3172380a-c848-4bb0-9edc-dd1f158e9e2e tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4" status: 200 len: 1520 microversion: 2.1 time: 0.565464 Aug 31 16:00:12.995888 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1317/2560] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:12 2022] GET /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4 => generated 1520 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:13.001280 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5daefbdd-a35d-4182-83e2-d1a44bcf6745 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:13.001889 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5daefbdd-a35d-4182-83e2-d1a44bcf6745 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:13.047825 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5daefbdd-a35d-4182-83e2-d1a44bcf6745 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:13.049518 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5daefbdd-a35d-4182-83e2-d1a44bcf6745 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:13.051873 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5daefbdd-a35d-4182-83e2-d1a44bcf6745 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:13.052628 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5daefbdd-a35d-4182-83e2-d1a44bcf6745 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:13.053093 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5daefbdd-a35d-4182-83e2-d1a44bcf6745 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:13.053515 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5daefbdd-a35d-4182-83e2-d1a44bcf6745 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:13.367398 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5daefbdd-a35d-4182-83e2-d1a44bcf6745 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:13.380039 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5daefbdd-a35d-4182-83e2-d1a44bcf6745 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:13.390586 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5daefbdd-a35d-4182-83e2-d1a44bcf6745 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:13.408374 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5daefbdd-a35d-4182-83e2-d1a44bcf6745 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1553 microversion: 2.91 time: 0.411309 Aug 31 16:00:13.411351 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1318/2561] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:12 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1553 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:13.425337 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-99ce1cd9-f468-45d4-b8d1-e4dbba54f40b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:13.433117 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-134cd8a1-7537-45c5-9c33-255156cb24e7 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:13.433645 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-134cd8a1-7537-45c5-9c33-255156cb24e7 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 9fd5b244-b9b6-4901-8b2f-0454d800d6b4] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:13.440156 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-99ce1cd9-f468-45d4-b8d1-e4dbba54f40b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/16ef09f1-c039-4f49-975a-526f26df57f1" status: 200 len: 1492 microversion: 2.1 time: 0.703246 Aug 31 16:00:13.440756 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1244/2562] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:12 2022] GET /compute/v2.1/servers/16ef09f1-c039-4f49-975a-526f26df57f1 => generated 1492 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:13.448830 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-134cd8a1-7537-45c5-9c33-255156cb24e7 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:13.449557 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-134cd8a1-7537-45c5-9c33-255156cb24e7 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:13.459614 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-134cd8a1-7537-45c5-9c33-255156cb24e7 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:13.461858 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-134cd8a1-7537-45c5-9c33-255156cb24e7 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:13.462577 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-134cd8a1-7537-45c5-9c33-255156cb24e7 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:13.463218 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0bf91026-8d60-4017-8e59-e0fe1378e913 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:13.463534 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-134cd8a1-7537-45c5-9c33-255156cb24e7 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:13.465880 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0bf91026-8d60-4017-8e59-e0fe1378e913 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 16ef09f1-c039-4f49-975a-526f26df57f1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:13.485549 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0bf91026-8d60-4017-8e59-e0fe1378e913 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:13.489558 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0bf91026-8d60-4017-8e59-e0fe1378e913 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:13.494016 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0bf91026-8d60-4017-8e59-e0fe1378e913 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:13.498506 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0bf91026-8d60-4017-8e59-e0fe1378e913 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:13.499559 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0bf91026-8d60-4017-8e59-e0fe1378e913 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:13.502386 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0bf91026-8d60-4017-8e59-e0fe1378e913 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:13.582135 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0bf91026-8d60-4017-8e59-e0fe1378e913 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 16ef09f1-c039-4f49-975a-526f26df57f1] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:00:13.722145 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:00:13.808517 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0bf91026-8d60-4017-8e59-e0fe1378e913 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "DELETE /compute/v2.1/servers/16ef09f1-c039-4f49-975a-526f26df57f1" status: 204 len: 0 microversion: 2.1 time: 0.349459 Aug 31 16:00:13.810302 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1245/2563] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:00:13 2022] DELETE /compute/v2.1/servers/16ef09f1-c039-4f49-975a-526f26df57f1 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:00:13.822820 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-abdb5695-63d2-4392-a179-4ff5942d88ac tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:13.826256 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-abdb5695-63d2-4392-a179-4ff5942d88ac tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 16ef09f1-c039-4f49-975a-526f26df57f1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:13.838021 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-abdb5695-63d2-4392-a179-4ff5942d88ac tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:13.840808 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-abdb5695-63d2-4392-a179-4ff5942d88ac tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:13.842486 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-abdb5695-63d2-4392-a179-4ff5942d88ac tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:13.845073 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-abdb5695-63d2-4392-a179-4ff5942d88ac tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:13.845668 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-abdb5695-63d2-4392-a179-4ff5942d88ac tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:13.846258 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-abdb5695-63d2-4392-a179-4ff5942d88ac tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:13.985619 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-134cd8a1-7537-45c5-9c33-255156cb24e7 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8476b6167a4c838eac59d7c4a40284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a7c84a4ea54074bab3ccc035c5cf47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:13.997092 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-134cd8a1-7537-45c5-9c33-255156cb24e7 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4" status: 200 len: 1520 microversion: 2.1 time: 0.582957 Aug 31 16:00:14.003490 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1319/2564] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:13 2022] GET /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4 => generated 1520 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:14.031242 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ed41d9fb-a629-42a1-8448-11c7d119dea0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1543677189"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:14.034004 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ed41d9fb-a629-42a1-8448-11c7d119dea0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 9fd5b244-b9b6-4901-8b2f-0454d800d6b4] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:14.079812 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ed41d9fb-a629-42a1-8448-11c7d119dea0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:14.081409 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ed41d9fb-a629-42a1-8448-11c7d119dea0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:14.083919 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ed41d9fb-a629-42a1-8448-11c7d119dea0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:14.087020 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ed41d9fb-a629-42a1-8448-11c7d119dea0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:14.090323 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ed41d9fb-a629-42a1-8448-11c7d119dea0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:14.095080 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ed41d9fb-a629-42a1-8448-11c7d119dea0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:14.467930 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-abdb5695-63d2-4392-a179-4ff5942d88ac tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:14.486254 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-abdb5695-63d2-4392-a179-4ff5942d88ac tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/16ef09f1-c039-4f49-975a-526f26df57f1" status: 200 len: 1498 microversion: 2.1 time: 0.661492 Aug 31 16:00:14.486254 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1246/2565] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:13 2022] GET /compute/v2.1/servers/16ef09f1-c039-4f49-975a-526f26df57f1 => generated 1498 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:00:14.499431 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f44d9d78-965c-4eb5-aa20-9fc17b2c45d1 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:14.500044 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f44d9d78-965c-4eb5-aa20-9fc17b2c45d1 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:14.532010 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f44d9d78-965c-4eb5-aa20-9fc17b2c45d1 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:14.534586 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f44d9d78-965c-4eb5-aa20-9fc17b2c45d1 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:14.535909 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f44d9d78-965c-4eb5-aa20-9fc17b2c45d1 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:14.539863 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f44d9d78-965c-4eb5-aa20-9fc17b2c45d1 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:14.541668 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f44d9d78-965c-4eb5-aa20-9fc17b2c45d1 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:14.543689 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f44d9d78-965c-4eb5-aa20-9fc17b2c45d1 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:14.764059 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f44d9d78-965c-4eb5-aa20-9fc17b2c45d1 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:14.802585 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ed41d9fb-a629-42a1-8448-11c7d119dea0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "POST /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4/action" status: 202 len: 0 microversion: 2.1 time: 0.781024 Aug 31 16:00:14.806523 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f44d9d78-965c-4eb5-aa20-9fc17b2c45d1 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:14.808721 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f44d9d78-965c-4eb5-aa20-9fc17b2c45d1 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:14.814967 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f44d9d78-965c-4eb5-aa20-9fc17b2c45d1 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1553 microversion: 2.91 time: 0.331864 Aug 31 16:00:14.816345 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1320/2566] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:00:14 2022] POST /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4/action => generated 0 bytes in 797 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 31 16:00:14.831037 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1247/2567] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:14 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1553 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:14.831466 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e8dce5ee-5ec4-4a33-a8fa-d9d510f60973 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1453830442"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:14.839628 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e8dce5ee-5ec4-4a33-a8fa-d9d510f60973 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 9fd5b244-b9b6-4901-8b2f-0454d800d6b4] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:14.854753 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e8dce5ee-5ec4-4a33-a8fa-d9d510f60973 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:14.855559 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e8dce5ee-5ec4-4a33-a8fa-d9d510f60973 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:14.858689 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e8dce5ee-5ec4-4a33-a8fa-d9d510f60973 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:14.859683 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e8dce5ee-5ec4-4a33-a8fa-d9d510f60973 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:14.862573 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e8dce5ee-5ec4-4a33-a8fa-d9d510f60973 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:14.863712 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e8dce5ee-5ec4-4a33-a8fa-d9d510f60973 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:15.017141 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-e8dce5ee-5ec4-4a33-a8fa-d9d510f60973 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] HTTP exception thrown: Cannot 'createImage' instance 9fd5b244-b9b6-4901-8b2f-0454d800d6b4 while it is in task_state image_snapshot_pending Aug 31 16:00:15.022211 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e8dce5ee-5ec4-4a33-a8fa-d9d510f60973 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Request method failure captured: Aug 31 16:00:15.022211 n-d-833090-16 devstack@n-api.service[128864]: request: POST /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4/action HTTP/1.1 Aug 31 16:00:15.022211 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:00:15.022211 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:00:15.022211 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:00:15.022211 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 85 Aug 31 16:00:15.022211 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:00:15.022211 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:00:15.022211 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:00:15.022211 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:15.022211 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4VuegaF_fmy46ih3aH48SHyk9S0K5f6VgFr4AjCz2qlep55514N16M8NDogA4-FaRt5exvJysgb4a16NCF-uwnoFVaAwgVvS87_klTsI4Q1cOt4rcQPW4Ao3jepMn1MxMfgCP9op9_ywmQywVzBp5itFLK6pFxwsw-bP4gtv8ayT6Y Aug 31 16:00:15.022211 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:00:15.022211 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:00:15.022211 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:00:15.022211 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:00:15.022211 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:00:15.022211 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:00:15.022211 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 75a7c84a4ea54074bab3ccc035c5cf47 Aug 31 16:00:15.022211 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2143463755 Aug 31 16:00:15.022211 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:00:15.022211 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:00:15.022211 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/75a7c84a4ea54074bab3ccc035c5cf47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/75a7c84a4ea54074bab3ccc035c5cf47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/75a7c84a4ea54074bab3ccc035c5cf47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_75a7c84a4ea54074bab3ccc035c5cf47", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:00:15.022211 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2143463755 Aug 31 16:00:15.022211 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 75a7c84a4ea54074bab3ccc035c5cf47 Aug 31 16:00:15.022211 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2143463755 Aug 31 16:00:15.022211 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ImagesOneServerNegativeTestJSON-2143463755-project Aug 31 16:00:15.022211 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:00:15.022211 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:00:15.022211 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 3c8476b6167a4c838eac59d7c4a40284 Aug 31 16:00:15.022211 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2143463755-project Aug 31 16:00:15.022211 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 16:00:15.022211 n-d-833090-16 devstack@n-api.service[128864]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1453830442"}} Aug 31 16:00:15.022211 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:00:15.022211 n-d-833090-16 devstack@n-api.service[128864]: exception: Cannot 'createImage' instance 9fd5b244-b9b6-4901-8b2f-0454d800d6b4 while it is in task_state image_snapshot_pending Aug 31 16:00:15.022211 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '9fd5b244-b9b6-4901-8b2f-0454d800d6b4', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1453830442'}}} Aug 31 16:00:15.022211 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:15.022211 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:15.022211 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Aug 31 16:00:15.022211 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Aug 31 16:00:15.022211 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Aug 31 16:00:15.022211 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 16:00:15.022211 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9fd5b244-b9b6-4901-8b2f-0454d800d6b4 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Aug 31 16:00:15.022211 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:00:15.022211 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:15.022211 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:00:15.022211 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:15.022211 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:15.022211 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:15.022211 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:15.022211 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:15.022211 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:15.022211 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:15.022211 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:00:15.022211 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:00:15.022211 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:00:15.022211 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:00:15.022211 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Aug 31 16:00:15.022211 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 16:00:15.022211 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 16:00:15.022211 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 16:00:15.027215 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 9fd5b244-b9b6-4901-8b2f-0454d800d6b4 while it is in task_state image_snapshot_pending Aug 31 16:00:15.027215 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:00:15.027215 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:15.027215 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:00:15.027215 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:15.027215 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:15.027215 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:15.027215 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:00:15.027215 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:00:15.027215 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 9fd5b244-b9b6-4901-8b2f-0454d800d6b4 while it is in task_state image_snapshot_pending Aug 31 16:00:15.027215 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:00:15.027215 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e8dce5ee-5ec4-4a33-a8fa-d9d510f60973 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Returning 409 to user: Cannot 'createImage' instance 9fd5b244-b9b6-4901-8b2f-0454d800d6b4 while it is in task_state image_snapshot_pending {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:15.032973 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e8dce5ee-5ec4-4a33-a8fa-d9d510f60973 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "POST /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4/action" status: 409 len: 167 microversion: 2.1 time: 0.210486 Aug 31 16:00:15.039214 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1321/2568] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:00:14 2022] POST /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4/action => generated 167 bytes in 222 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 16:00:15.044214 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e70d08fb-ff28-40ce-8383-222cecfa1cd4 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '.version_select at 0x7fbb4abc31f0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:15.483031 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e70d08fb-ff28-40ce-8383-222cecfa1cd4 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "DELETE /compute/v2.1/images/361e9f81-a0ac-4be6-81b3-5a93980af3ad" status: 204 len: 0 microversion: 2.1 time: 0.442419 Aug 31 16:00:15.483630 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1248/2569] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:15 2022] DELETE /compute/v2.1/images/361e9f81-a0ac-4be6-81b3-5a93980af3ad => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 16:00:15.492448 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1490ca5c-81b4-4b04-9a2f-8f524ff7a086 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:15.493388 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1490ca5c-81b4-4b04-9a2f-8f524ff7a086 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 9fd5b244-b9b6-4901-8b2f-0454d800d6b4] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:15.500842 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9a8f2387-9cc6-4f11-8cdd-c62793400302 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:15.501363 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9a8f2387-9cc6-4f11-8cdd-c62793400302 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 16ef09f1-c039-4f49-975a-526f26df57f1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:15.514229 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1490ca5c-81b4-4b04-9a2f-8f524ff7a086 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:15.518922 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1490ca5c-81b4-4b04-9a2f-8f524ff7a086 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:15.521243 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1490ca5c-81b4-4b04-9a2f-8f524ff7a086 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:15.521609 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a8f2387-9cc6-4f11-8cdd-c62793400302 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:15.522262 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a8f2387-9cc6-4f11-8cdd-c62793400302 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:15.522748 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a8f2387-9cc6-4f11-8cdd-c62793400302 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:15.523367 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a8f2387-9cc6-4f11-8cdd-c62793400302 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:15.523952 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a8f2387-9cc6-4f11-8cdd-c62793400302 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:15.524231 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a8f2387-9cc6-4f11-8cdd-c62793400302 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:15.526085 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1490ca5c-81b4-4b04-9a2f-8f524ff7a086 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:15.535946 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1490ca5c-81b4-4b04-9a2f-8f524ff7a086 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:15.536780 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1490ca5c-81b4-4b04-9a2f-8f524ff7a086 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:16.473267 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9a8f2387-9cc6-4f11-8cdd-c62793400302 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:16.502649 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9a8f2387-9cc6-4f11-8cdd-c62793400302 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/16ef09f1-c039-4f49-975a-526f26df57f1" status: 200 len: 1498 microversion: 2.1 time: 1.003147 Aug 31 16:00:16.507698 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1249/2570] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:15 2022] GET /compute/v2.1/servers/16ef09f1-c039-4f49-975a-526f26df57f1 => generated 1498 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:00:16.515491 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1490ca5c-81b4-4b04-9a2f-8f524ff7a086 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8476b6167a4c838eac59d7c4a40284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a7c84a4ea54074bab3ccc035c5cf47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:16.518054 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cc0f3246-6cdb-47c6-992d-aec6baf00e10 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:16.519769 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cc0f3246-6cdb-47c6-992d-aec6baf00e10 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:16.525809 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1490ca5c-81b4-4b04-9a2f-8f524ff7a086 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4" status: 200 len: 1532 microversion: 2.1 time: 1.037420 Aug 31 16:00:16.526391 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1322/2571] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:15 2022] GET /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4 => generated 1532 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:16.549198 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cc0f3246-6cdb-47c6-992d-aec6baf00e10 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:16.549604 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cc0f3246-6cdb-47c6-992d-aec6baf00e10 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:16.550344 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cc0f3246-6cdb-47c6-992d-aec6baf00e10 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:16.551459 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cc0f3246-6cdb-47c6-992d-aec6baf00e10 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:16.553323 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cc0f3246-6cdb-47c6-992d-aec6baf00e10 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:16.553972 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cc0f3246-6cdb-47c6-992d-aec6baf00e10 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:16.662837 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cc0f3246-6cdb-47c6-992d-aec6baf00e10 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:16.672349 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cc0f3246-6cdb-47c6-992d-aec6baf00e10 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:16.675348 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cc0f3246-6cdb-47c6-992d-aec6baf00e10 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:16.682674 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cc0f3246-6cdb-47c6-992d-aec6baf00e10 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1553 microversion: 2.91 time: 0.172319 Aug 31 16:00:16.699124 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1250/2572] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:16 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1553 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:17.123148 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6abdcdf8-f2c3-4c79-a1e1-a4a296c01cd2 tempest-ListImagesTestJSON-1027552170 tempest-ListImagesTestJSON-1027552170-project] Calling method '.version_select at 0x7fbb46184670>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:17.226523 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6abdcdf8-f2c3-4c79-a1e1-a4a296c01cd2 tempest-ListImagesTestJSON-1027552170 tempest-ListImagesTestJSON-1027552170-project] 10.222.0.50 "GET /compute/v2.1/images/d715a41c-0e56-494a-a102-cac65831f6bd" status: 200 len: 784 microversion: 2.1 time: 0.694757 Aug 31 16:00:17.227106 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1323/2573] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:00:16 2022] GET /compute/v2.1/images/d715a41c-0e56-494a-a102-cac65831f6bd => generated 784 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:00:17.241642 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e7430c80-becf-4259-8bae-35643b60d6fd tempest-ListImagesTestJSON-1027552170 tempest-ListImagesTestJSON-1027552170-project] Calling method '.version_select at 0x7fbb4ac471f0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:17.360709 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e7430c80-becf-4259-8bae-35643b60d6fd tempest-ListImagesTestJSON-1027552170 tempest-ListImagesTestJSON-1027552170-project] 10.222.0.50 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.122907 Aug 31 16:00:17.362335 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1251/2574] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Aug 31 16:00:17 2022] GET /compute/v2.1/images => generated 445 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:00:17.375608 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ed27e15a-7f92-4263-82eb-c92f7d968b89 tempest-ListImagesTestJSON-1027552170 tempest-ListImagesTestJSON-1027552170-project] Calling method '.version_select at 0x7fbb47066e50>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:17.508300 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ed27e15a-7f92-4263-82eb-c92f7d968b89 tempest-ListImagesTestJSON-1027552170 tempest-ListImagesTestJSON-1027552170-project] 10.222.0.50 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.137825 Aug 31 16:00:17.509196 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1324/2575] 10.222.0.50 () {58 vars in 1143 bytes} [Wed Aug 31 16:00:17 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:00:17.528206 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c711a249-a733-4583-8bf2-9d05dcf08574 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:17.528817 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c711a249-a733-4583-8bf2-9d05dcf08574 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 16ef09f1-c039-4f49-975a-526f26df57f1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:17.555797 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-09d2cc57-b049-4aca-806f-ff74392abc40 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:17.556413 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-09d2cc57-b049-4aca-806f-ff74392abc40 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 9fd5b244-b9b6-4901-8b2f-0454d800d6b4] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:17.568250 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-09d2cc57-b049-4aca-806f-ff74392abc40 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:17.571614 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-09d2cc57-b049-4aca-806f-ff74392abc40 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:17.572342 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-09d2cc57-b049-4aca-806f-ff74392abc40 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:17.574828 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c711a249-a733-4583-8bf2-9d05dcf08574 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:17.575861 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-09d2cc57-b049-4aca-806f-ff74392abc40 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:17.579376 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c711a249-a733-4583-8bf2-9d05dcf08574 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:17.580146 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-09d2cc57-b049-4aca-806f-ff74392abc40 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:17.580770 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c711a249-a733-4583-8bf2-9d05dcf08574 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:17.585736 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-09d2cc57-b049-4aca-806f-ff74392abc40 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:17.586932 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c711a249-a733-4583-8bf2-9d05dcf08574 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:17.589878 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c711a249-a733-4583-8bf2-9d05dcf08574 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:17.592633 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c711a249-a733-4583-8bf2-9d05dcf08574 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:18.184349 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-09d2cc57-b049-4aca-806f-ff74392abc40 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8476b6167a4c838eac59d7c4a40284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a7c84a4ea54074bab3ccc035c5cf47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:18.203931 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-09d2cc57-b049-4aca-806f-ff74392abc40 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4" status: 200 len: 1532 microversion: 2.1 time: 0.652125 Aug 31 16:00:18.218402 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1325/2576] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:17 2022] GET /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4 => generated 1532 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:00:18.228646 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1d8ebfc5-502a-47d7-a242-f5e21335552e tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:18.229351 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1d8ebfc5-502a-47d7-a242-f5e21335552e tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:18.260113 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1d8ebfc5-502a-47d7-a242-f5e21335552e tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:18.260600 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1d8ebfc5-502a-47d7-a242-f5e21335552e tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:18.261143 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1d8ebfc5-502a-47d7-a242-f5e21335552e tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:18.269242 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1d8ebfc5-502a-47d7-a242-f5e21335552e tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:18.269902 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1d8ebfc5-502a-47d7-a242-f5e21335552e tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:18.273436 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1d8ebfc5-502a-47d7-a242-f5e21335552e tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:18.299520 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c711a249-a733-4583-8bf2-9d05dcf08574 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:18.316145 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c711a249-a733-4583-8bf2-9d05dcf08574 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/16ef09f1-c039-4f49-975a-526f26df57f1" status: 200 len: 1498 microversion: 2.1 time: 0.787050 Aug 31 16:00:18.318109 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1252/2577] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:17 2022] GET /compute/v2.1/servers/16ef09f1-c039-4f49-975a-526f26df57f1 => generated 1498 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:18.343316 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f6cadf58-2b85-4853-b7f9-a0449e12e922 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:18.343975 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f6cadf58-2b85-4853-b7f9-a0449e12e922 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:18.383019 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6cadf58-2b85-4853-b7f9-a0449e12e922 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:18.383553 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6cadf58-2b85-4853-b7f9-a0449e12e922 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:18.388148 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6cadf58-2b85-4853-b7f9-a0449e12e922 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:18.390554 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6cadf58-2b85-4853-b7f9-a0449e12e922 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:18.391511 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6cadf58-2b85-4853-b7f9-a0449e12e922 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:18.394638 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6cadf58-2b85-4853-b7f9-a0449e12e922 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:18.520732 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1d8ebfc5-502a-47d7-a242-f5e21335552e tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:18.533339 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1d8ebfc5-502a-47d7-a242-f5e21335552e tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:18.538285 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1d8ebfc5-502a-47d7-a242-f5e21335552e tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:18.559450 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1d8ebfc5-502a-47d7-a242-f5e21335552e tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1553 microversion: 2.91 time: 0.339570 Aug 31 16:00:18.561256 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1326/2578] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:18 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1553 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:18.831503 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f6cadf58-2b85-4853-b7f9-a0449e12e922 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:18.843148 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f6cadf58-2b85-4853-b7f9-a0449e12e922 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1671 microversion: 2.1 time: 0.518687 Aug 31 16:00:18.851806 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1253/2579] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:18 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1671 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:18.879814 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-dac9ddc7-7f19-4955-9cc2-c0e9d21a6f28 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:18.880499 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-dac9ddc7-7f19-4955-9cc2-c0e9d21a6f28 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:18.889613 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dac9ddc7-7f19-4955-9cc2-c0e9d21a6f28 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:18.889923 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dac9ddc7-7f19-4955-9cc2-c0e9d21a6f28 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:18.890400 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dac9ddc7-7f19-4955-9cc2-c0e9d21a6f28 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:18.891101 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dac9ddc7-7f19-4955-9cc2-c0e9d21a6f28 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:18.891874 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dac9ddc7-7f19-4955-9cc2-c0e9d21a6f28 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:18.892298 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dac9ddc7-7f19-4955-9cc2-c0e9d21a6f28 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:19.009854 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-af135ba4-6451-4bc7-945d-1958e80d62f6 req-79f3e7ce-c788-40b8-aae7-bd27564db9a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16ef09f1-c039-4f49-975a-526f26df57f1", "name": "network-vif-unplugged", "status": "completed", "tag": "9484c4c3-9d97-45bd-88d0-5429543bbc29"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:19.030727 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-af135ba4-6451-4bc7-945d-1958e80d62f6 req-79f3e7ce-c788-40b8-aae7-bd27564db9a7 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:19.031675 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-af135ba4-6451-4bc7-945d-1958e80d62f6 req-79f3e7ce-c788-40b8-aae7-bd27564db9a7 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:19.033742 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-af135ba4-6451-4bc7-945d-1958e80d62f6 req-79f3e7ce-c788-40b8-aae7-bd27564db9a7 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:19.070804 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-af135ba4-6451-4bc7-945d-1958e80d62f6 req-79f3e7ce-c788-40b8-aae7-bd27564db9a7 service nova] Creating event network-vif-unplugged:9484c4c3-9d97-45bd-88d0-5429543bbc29 for instance 16ef09f1-c039-4f49-975a-526f26df57f1 on n-h1-833090-16 Aug 31 16:00:19.087036 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-af135ba4-6451-4bc7-945d-1958e80d62f6 req-79f3e7ce-c788-40b8-aae7-bd27564db9a7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078997 Aug 31 16:00:19.091940 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1254/2580] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:00:19.232703 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0339d9c1-1a50-4857-8eea-2b3f1b463805 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:19.233714 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0339d9c1-1a50-4857-8eea-2b3f1b463805 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 9fd5b244-b9b6-4901-8b2f-0454d800d6b4] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:19.246605 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-dac9ddc7-7f19-4955-9cc2-c0e9d21a6f28 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:19.256924 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0339d9c1-1a50-4857-8eea-2b3f1b463805 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:19.258765 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-dac9ddc7-7f19-4955-9cc2-c0e9d21a6f28 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1671 microversion: 2.1 time: 0.384400 Aug 31 16:00:19.265650 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1327/2581] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:18 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1671 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:19.267994 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0339d9c1-1a50-4857-8eea-2b3f1b463805 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:19.268585 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0339d9c1-1a50-4857-8eea-2b3f1b463805 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:19.269329 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0339d9c1-1a50-4857-8eea-2b3f1b463805 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:19.269796 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0339d9c1-1a50-4857-8eea-2b3f1b463805 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:19.270259 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0339d9c1-1a50-4857-8eea-2b3f1b463805 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:19.303940 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-27b54d78-05ae-405d-b7e4-c552e2ac9e07 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:19.306888 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-27b54d78-05ae-405d-b7e4-c552e2ac9e07 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:19.329132 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-27b54d78-05ae-405d-b7e4-c552e2ac9e07 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:19.329622 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-27b54d78-05ae-405d-b7e4-c552e2ac9e07 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:19.330052 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-27b54d78-05ae-405d-b7e4-c552e2ac9e07 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:19.345834 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-27b54d78-05ae-405d-b7e4-c552e2ac9e07 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:19.351347 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-27b54d78-05ae-405d-b7e4-c552e2ac9e07 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:19.352119 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-27b54d78-05ae-405d-b7e4-c552e2ac9e07 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:19.700024 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0339d9c1-1a50-4857-8eea-2b3f1b463805 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8476b6167a4c838eac59d7c4a40284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a7c84a4ea54074bab3ccc035c5cf47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:19.713043 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0339d9c1-1a50-4857-8eea-2b3f1b463805 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4" status: 200 len: 1538 microversion: 2.1 time: 0.491139 Aug 31 16:00:19.720333 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1255/2582] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:19 2022] GET /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4 => generated 1538 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:00:19.726739 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b3c3ee05-50d6-4fcf-ac23-cba3e1c57874 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:19.731065 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b3c3ee05-50d6-4fcf-ac23-cba3e1c57874 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 16ef09f1-c039-4f49-975a-526f26df57f1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:19.745389 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3c3ee05-50d6-4fcf-ac23-cba3e1c57874 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:19.746660 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3c3ee05-50d6-4fcf-ac23-cba3e1c57874 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:19.748224 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3c3ee05-50d6-4fcf-ac23-cba3e1c57874 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:19.752097 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3c3ee05-50d6-4fcf-ac23-cba3e1c57874 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:19.752931 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3c3ee05-50d6-4fcf-ac23-cba3e1c57874 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:19.753545 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3c3ee05-50d6-4fcf-ac23-cba3e1c57874 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:19.913082 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b3c3ee05-50d6-4fcf-ac23-cba3e1c57874 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:19.922337 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b3c3ee05-50d6-4fcf-ac23-cba3e1c57874 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/16ef09f1-c039-4f49-975a-526f26df57f1" status: 200 len: 1456 microversion: 2.1 time: 0.200486 Aug 31 16:00:19.926053 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1256/2583] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:19 2022] GET /compute/v2.1/servers/16ef09f1-c039-4f49-975a-526f26df57f1 => generated 1456 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:19.941525 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5f1679f8-eec4-428f-93e7-d0822d354fb3 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:19.942868 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5f1679f8-eec4-428f-93e7-d0822d354fb3 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:19.950865 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-27b54d78-05ae-405d-b7e4-c552e2ac9e07 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:19.954851 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f1679f8-eec4-428f-93e7-d0822d354fb3 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:19.956879 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f1679f8-eec4-428f-93e7-d0822d354fb3 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:19.958646 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f1679f8-eec4-428f-93e7-d0822d354fb3 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:19.959666 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f1679f8-eec4-428f-93e7-d0822d354fb3 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:19.960935 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f1679f8-eec4-428f-93e7-d0822d354fb3 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:19.961623 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f1679f8-eec4-428f-93e7-d0822d354fb3 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:19.966369 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-27b54d78-05ae-405d-b7e4-c552e2ac9e07 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1671 microversion: 2.1 time: 0.681356 Aug 31 16:00:19.967568 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1328/2584] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:19 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1671 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:00:20.000511 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-888792e4-4b12-4765-b042-67d02bcc2b54 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1056101579"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:20.003687 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-888792e4-4b12-4765-b042-67d02bcc2b54 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:20.020154 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-888792e4-4b12-4765-b042-67d02bcc2b54 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:20.020893 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-888792e4-4b12-4765-b042-67d02bcc2b54 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:20.021536 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-888792e4-4b12-4765-b042-67d02bcc2b54 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:20.029983 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-888792e4-4b12-4765-b042-67d02bcc2b54 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:20.030852 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-888792e4-4b12-4765-b042-67d02bcc2b54 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:20.031494 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-888792e4-4b12-4765-b042-67d02bcc2b54 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:20.145510 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5f1679f8-eec4-428f-93e7-d0822d354fb3 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:20.181721 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5f1679f8-eec4-428f-93e7-d0822d354fb3 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:20.187988 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5f1679f8-eec4-428f-93e7-d0822d354fb3 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:20.206958 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5f1679f8-eec4-428f-93e7-d0822d354fb3 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1553 microversion: 2.91 time: 0.277055 Aug 31 16:00:20.207832 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1257/2585] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:19 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1553 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:20.430111 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-888792e4-4b12-4765-b042-67d02bcc2b54 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "POST /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b/action" status: 202 len: 0 microversion: 2.1 time: 0.435382 Aug 31 16:00:20.459972 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1329/2586] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:00:19 2022] POST /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b/action => generated 0 bytes in 465 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Aug 31 16:00:20.747380 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dcd156ae-e08e-4fc4-8850-b6d49d7feb06 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:20.748333 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dcd156ae-e08e-4fc4-8850-b6d49d7feb06 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 9fd5b244-b9b6-4901-8b2f-0454d800d6b4] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:20.755842 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcd156ae-e08e-4fc4-8850-b6d49d7feb06 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:20.758286 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcd156ae-e08e-4fc4-8850-b6d49d7feb06 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:20.759758 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcd156ae-e08e-4fc4-8850-b6d49d7feb06 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:20.763257 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcd156ae-e08e-4fc4-8850-b6d49d7feb06 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:20.764383 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcd156ae-e08e-4fc4-8850-b6d49d7feb06 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:20.765123 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcd156ae-e08e-4fc4-8850-b6d49d7feb06 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:20.846914 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-92569dab-05c2-4f29-80e7-5e30b454fb5a req-0e00e462-0a0b-4bc9-b750-e3a2421b6b35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16ef09f1-c039-4f49-975a-526f26df57f1", "name": "network-vif-deleted", "tag": "9484c4c3-9d97-45bd-88d0-5429543bbc29"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:20.908399 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-92569dab-05c2-4f29-80e7-5e30b454fb5a req-0e00e462-0a0b-4bc9-b750-e3a2421b6b35 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:20.913145 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-92569dab-05c2-4f29-80e7-5e30b454fb5a req-0e00e462-0a0b-4bc9-b750-e3a2421b6b35 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:20.914328 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-92569dab-05c2-4f29-80e7-5e30b454fb5a req-0e00e462-0a0b-4bc9-b750-e3a2421b6b35 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:20.950912 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-92569dab-05c2-4f29-80e7-5e30b454fb5a req-0e00e462-0a0b-4bc9-b750-e3a2421b6b35 service nova] Creating event network-vif-deleted:9484c4c3-9d97-45bd-88d0-5429543bbc29 for instance 16ef09f1-c039-4f49-975a-526f26df57f1 on n-h1-833090-16 Aug 31 16:00:20.961726 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-92569dab-05c2-4f29-80e7-5e30b454fb5a req-0e00e462-0a0b-4bc9-b750-e3a2421b6b35 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121710 Aug 31 16:00:20.965067 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1330/2587] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:00:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:00:20.984148 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-83a5bd30-4f6a-4e21-8ec0-05736b40fc69 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:20.994519 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-83a5bd30-4f6a-4e21-8ec0-05736b40fc69 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 16ef09f1-c039-4f49-975a-526f26df57f1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:21.002137 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83a5bd30-4f6a-4e21-8ec0-05736b40fc69 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:21.004009 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83a5bd30-4f6a-4e21-8ec0-05736b40fc69 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:21.004699 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83a5bd30-4f6a-4e21-8ec0-05736b40fc69 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:21.009171 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83a5bd30-4f6a-4e21-8ec0-05736b40fc69 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:21.009766 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83a5bd30-4f6a-4e21-8ec0-05736b40fc69 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:21.010556 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83a5bd30-4f6a-4e21-8ec0-05736b40fc69 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:21.129407 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83a5bd30-4f6a-4e21-8ec0-05736b40fc69 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:21.130175 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83a5bd30-4f6a-4e21-8ec0-05736b40fc69 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:21.130825 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83a5bd30-4f6a-4e21-8ec0-05736b40fc69 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:21.131488 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-83a5bd30-4f6a-4e21-8ec0-05736b40fc69 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lazy-loading 'fault' on Instance uuid 16ef09f1-c039-4f49-975a-526f26df57f1 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:00:21.273115 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-83a5bd30-4f6a-4e21-8ec0-05736b40fc69 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d4f2146c3bc4a64b5d7f72cd136b6db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde27d282fc24e56a62eaeacff1431d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:21.284459 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-83a5bd30-4f6a-4e21-8ec0-05736b40fc69 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/16ef09f1-c039-4f49-975a-526f26df57f1" status: 200 len: 1304 microversion: 2.1 time: 0.314131 Aug 31 16:00:21.285211 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1331/2588] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:20 2022] GET /compute/v2.1/servers/16ef09f1-c039-4f49-975a-526f26df57f1 => generated 1304 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:21.307246 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e1988c1c-3820-4ba7-9b75-b0b7dce34107 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:21.315356 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e1988c1c-3820-4ba7-9b75-b0b7dce34107 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:21.333770 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e1988c1c-3820-4ba7-9b75-b0b7dce34107 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:21.345471 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e1988c1c-3820-4ba7-9b75-b0b7dce34107 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:21.346157 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e1988c1c-3820-4ba7-9b75-b0b7dce34107 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:21.347080 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e1988c1c-3820-4ba7-9b75-b0b7dce34107 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:21.347693 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e1988c1c-3820-4ba7-9b75-b0b7dce34107 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:21.348347 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e1988c1c-3820-4ba7-9b75-b0b7dce34107 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:21.349534 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dcd156ae-e08e-4fc4-8850-b6d49d7feb06 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8476b6167a4c838eac59d7c4a40284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a7c84a4ea54074bab3ccc035c5cf47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:21.354559 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:00:21.376772 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dcd156ae-e08e-4fc4-8850-b6d49d7feb06 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4" status: 200 len: 1538 microversion: 2.1 time: 0.635409 Aug 31 16:00:21.390414 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1258/2589] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:20 2022] GET /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4 => generated 1538 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:21.535387 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e1988c1c-3820-4ba7-9b75-b0b7dce34107 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:21.559916 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e1988c1c-3820-4ba7-9b75-b0b7dce34107 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:21.562715 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e1988c1c-3820-4ba7-9b75-b0b7dce34107 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:21.574996 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e1988c1c-3820-4ba7-9b75-b0b7dce34107 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1553 microversion: 2.91 time: 0.271710 Aug 31 16:00:21.596167 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1332/2590] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:21 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1553 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:22.309135 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c208a97b-16ae-4405-9406-e77a319f1577 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:22.309798 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c208a97b-16ae-4405-9406-e77a319f1577 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 16ef09f1-c039-4f49-975a-526f26df57f1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:22.325771 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c208a97b-16ae-4405-9406-e77a319f1577 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:22.326297 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c208a97b-16ae-4405-9406-e77a319f1577 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:22.326735 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c208a97b-16ae-4405-9406-e77a319f1577 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:22.327436 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c208a97b-16ae-4405-9406-e77a319f1577 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:22.327896 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c208a97b-16ae-4405-9406-e77a319f1577 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:22.328320 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c208a97b-16ae-4405-9406-e77a319f1577 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:22.372643 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-c208a97b-16ae-4405-9406-e77a319f1577 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] HTTP exception thrown: Instance 16ef09f1-c039-4f49-975a-526f26df57f1 could not be found. Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c208a97b-16ae-4405-9406-e77a319f1577 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Request method failure captured: Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/16ef09f1-c039-4f49-975a-526f26df57f1 HTTP/1.1 Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4Q2UxjmzRUIcRyBJZeRXZe8f-kxARGQrfLNadx-PtSKRAHFDd-cfjpN41Lm2TAtWQQVK9trDHJa1Iu7P1XlF1-EYrtrhJnDHGb-ivhI0erITWpZsYkLGmnwPDtbMbW99ld2jucgWFbVY0vVDf-y4OAM7Az1owqOg13oLERSA9bN0MQ Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: dde27d282fc24e56a62eaeacff1431d5 Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-DeleteServersTestJSON-1135653165 Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_dde27d282fc24e56a62eaeacff1431d5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-DeleteServersTestJSON-1135653165 Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: dde27d282fc24e56a62eaeacff1431d5 Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-DeleteServersTestJSON-1135653165 Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-DeleteServersTestJSON-1135653165-project Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 4d4f2146c3bc4a64b5d7f72cd136b6db Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-DeleteServersTestJSON-1135653165-project Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 16ef09f1-c039-4f49-975a-526f26df57f1 could not be found. Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '16ef09f1-c039-4f49-975a-526f26df57f1'} Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16ef09f1-c039-4f49-975a-526f26df57f1 could not be found. Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16ef09f1-c039-4f49-975a-526f26df57f1 could not be found. Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:22.377804 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:00:22.382499 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:22.382499 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:22.382499 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:22.382499 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:00:22.382499 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:00:22.382499 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16ef09f1-c039-4f49-975a-526f26df57f1 could not be found. Aug 31 16:00:22.382499 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:00:22.385683 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c208a97b-16ae-4405-9406-e77a319f1577 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Returning 404 to user: Instance 16ef09f1-c039-4f49-975a-526f26df57f1 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:22.389089 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c208a97b-16ae-4405-9406-e77a319f1577 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/16ef09f1-c039-4f49-975a-526f26df57f1" status: 404 len: 111 microversion: 2.1 time: 0.084092 Aug 31 16:00:22.391451 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1333/2591] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:22 2022] GET /compute/v2.1/servers/16ef09f1-c039-4f49-975a-526f26df57f1 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:00:22.404668 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2cbc90c6-f750-4786-b75e-1520686702ed tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:22.408681 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2cbc90c6-f750-4786-b75e-1520686702ed tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 16ef09f1-c039-4f49-975a-526f26df57f1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:22.425668 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2cbc90c6-f750-4786-b75e-1520686702ed tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:22.430855 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2cbc90c6-f750-4786-b75e-1520686702ed tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:22.432455 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2cbc90c6-f750-4786-b75e-1520686702ed tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:22.435833 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2cbc90c6-f750-4786-b75e-1520686702ed tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:22.436519 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2cbc90c6-f750-4786-b75e-1520686702ed tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:22.437780 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2cbc90c6-f750-4786-b75e-1520686702ed tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:22.478686 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-2cbc90c6-f750-4786-b75e-1520686702ed tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] HTTP exception thrown: Instance 16ef09f1-c039-4f49-975a-526f26df57f1 could not be found. Aug 31 16:00:22.483304 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2cbc90c6-f750-4786-b75e-1520686702ed tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Request method failure captured: Aug 31 16:00:22.483304 n-d-833090-16 devstack@n-api.service[128864]: request: DELETE /compute/v2.1/servers/16ef09f1-c039-4f49-975a-526f26df57f1 HTTP/1.1 Aug 31 16:00:22.483304 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:00:22.483304 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:00:22.483304 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:00:22.483304 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:00:22.483304 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:00:22.483304 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:00:22.483304 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:00:22.483304 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:22.483304 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4Q2UxjmzRUIcRyBJZeRXZe8f-kxARGQrfLNadx-PtSKRAHFDd-cfjpN41Lm2TAtWQQVK9trDHJa1Iu7P1XlF1-EYrtrhJnDHGb-ivhI0erITWpZsYkLGmnwPDtbMbW99ld2jucgWFbVY0vVDf-y4OAM7Az1owqOg13oLERSA9bN0MQ Aug 31 16:00:22.483304 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:00:22.483304 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:00:22.483304 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:00:22.483304 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:00:22.483304 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:00:22.483304 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:00:22.483304 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: dde27d282fc24e56a62eaeacff1431d5 Aug 31 16:00:22.483304 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-DeleteServersTestJSON-1135653165 Aug 31 16:00:22.483304 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:00:22.483304 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:00:22.483304 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_dde27d282fc24e56a62eaeacff1431d5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:00:22.483304 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-DeleteServersTestJSON-1135653165 Aug 31 16:00:22.483304 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: dde27d282fc24e56a62eaeacff1431d5 Aug 31 16:00:22.483304 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-DeleteServersTestJSON-1135653165 Aug 31 16:00:22.483304 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-DeleteServersTestJSON-1135653165-project Aug 31 16:00:22.483304 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:00:22.483304 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:00:22.483304 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 4d4f2146c3bc4a64b5d7f72cd136b6db Aug 31 16:00:22.483304 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-DeleteServersTestJSON-1135653165-project Aug 31 16:00:22.483304 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:00:22.483304 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 16ef09f1-c039-4f49-975a-526f26df57f1 could not be found. Aug 31 16:00:22.483304 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '16ef09f1-c039-4f49-975a-526f26df57f1'} Aug 31 16:00:22.483304 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:22.483304 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:22.483304 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:00:22.483304 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:00:22.483304 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:00:22.483304 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:00:22.483304 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:00:22.483304 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:00:22.483304 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:00:22.483304 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:00:22.483304 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16ef09f1-c039-4f49-975a-526f26df57f1 could not be found. Aug 31 16:00:22.483304 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:00:22.483304 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:22.483304 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:00:22.483304 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:22.483304 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:22.483304 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:22.483304 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:22.483304 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:22.483304 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:22.483304 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:22.483304 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:00:22.483304 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:00:22.483304 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:00:22.483304 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:00:22.483304 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:00:22.483304 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:00:22.483304 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:00:22.483304 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:00:22.487755 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16ef09f1-c039-4f49-975a-526f26df57f1 could not be found. Aug 31 16:00:22.487755 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:00:22.487755 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:22.487755 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:00:22.487755 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:22.487755 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:22.487755 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:22.487755 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:00:22.487755 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:00:22.487755 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16ef09f1-c039-4f49-975a-526f26df57f1 could not be found. Aug 31 16:00:22.487755 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:00:22.492019 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2cbc90c6-f750-4786-b75e-1520686702ed tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Returning 404 to user: Instance 16ef09f1-c039-4f49-975a-526f26df57f1 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:22.496423 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2cbc90c6-f750-4786-b75e-1520686702ed tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "DELETE /compute/v2.1/servers/16ef09f1-c039-4f49-975a-526f26df57f1" status: 404 len: 111 microversion: 2.1 time: 0.096726 Aug 31 16:00:22.498878 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1334/2592] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:00:22 2022] DELETE /compute/v2.1/servers/16ef09f1-c039-4f49-975a-526f26df57f1 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:00:22.509215 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-97ad7b12-8660-4df1-a9ce-5e2130f82a3f tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:22.511529 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-97ad7b12-8660-4df1-a9ce-5e2130f82a3f tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 9fd5b244-b9b6-4901-8b2f-0454d800d6b4] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:22.526216 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-97ad7b12-8660-4df1-a9ce-5e2130f82a3f tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:22.528905 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-97ad7b12-8660-4df1-a9ce-5e2130f82a3f tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:22.529811 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-97ad7b12-8660-4df1-a9ce-5e2130f82a3f tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:22.532154 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-97ad7b12-8660-4df1-a9ce-5e2130f82a3f tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:22.538264 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-97ad7b12-8660-4df1-a9ce-5e2130f82a3f tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:22.539112 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-97ad7b12-8660-4df1-a9ce-5e2130f82a3f tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:22.858697 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-41634be0-afe2-4d65-a04a-e1a907186a65 tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] Action: 'create', calling method: .version_select at 0x7fbb4ab4ee50>, body: {"keypair": {"name": "tempest-keypair-333821406", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDx0jAzEmYU5gMixkjnf3TxJtmM+yyInMiSxwXju46ea04sxs35FhkUDvNj6YTblrhS46Plt8B7A2FIqF4x7Z3mTR+kp4+Fk8cyN/KU5DSPQv3fUf++1/XPACvQNKJuuzg=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:22.869509 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:00:22.882871 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-97ad7b12-8660-4df1-a9ce-5e2130f82a3f tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8476b6167a4c838eac59d7c4a40284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a7c84a4ea54074bab3ccc035c5cf47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:22.900048 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-97ad7b12-8660-4df1-a9ce-5e2130f82a3f tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4" status: 200 len: 1538 microversion: 2.1 time: 0.399844 Aug 31 16:00:22.907206 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1335/2593] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:22 2022] GET /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4 => generated 1538 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:22.920352 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-41634be0-afe2-4d65-a04a-e1a907186a65 tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] Getting quotas for project 5ec7ef57e7bf48568170e6afb53efdb0. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:00:22.925571 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1bc29aad-06df-4a52-afd8-f425ad807331 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:22.927473 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1bc29aad-06df-4a52-afd8-f425ad807331 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 16ef09f1-c039-4f49-975a-526f26df57f1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:22.944764 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-41634be0-afe2-4d65-a04a-e1a907186a65 tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] Getting quotas for user 08279c461cd34088be9bb71f59cf393f and project 5ec7ef57e7bf48568170e6afb53efdb0. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:00:22.948283 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1bc29aad-06df-4a52-afd8-f425ad807331 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:22.954824 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1bc29aad-06df-4a52-afd8-f425ad807331 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:22.955650 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1bc29aad-06df-4a52-afd8-f425ad807331 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:22.957914 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1bc29aad-06df-4a52-afd8-f425ad807331 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:22.959591 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1bc29aad-06df-4a52-afd8-f425ad807331 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:22.961105 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1bc29aad-06df-4a52-afd8-f425ad807331 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:23.025215 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-1bc29aad-06df-4a52-afd8-f425ad807331 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] HTTP exception thrown: Instance 16ef09f1-c039-4f49-975a-526f26df57f1 could not be found. Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1bc29aad-06df-4a52-afd8-f425ad807331 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Request method failure captured: Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/16ef09f1-c039-4f49-975a-526f26df57f1 HTTP/1.1 Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4Q2UxjmzRUIcRyBJZeRXZe8f-kxARGQrfLNadx-PtSKRAHFDd-cfjpN41Lm2TAtWQQVK9trDHJa1Iu7P1XlF1-EYrtrhJnDHGb-ivhI0erITWpZsYkLGmnwPDtbMbW99ld2jucgWFbVY0vVDf-y4OAM7Az1owqOg13oLERSA9bN0MQ Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: dde27d282fc24e56a62eaeacff1431d5 Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-DeleteServersTestJSON-1135653165 Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_dde27d282fc24e56a62eaeacff1431d5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-DeleteServersTestJSON-1135653165 Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: dde27d282fc24e56a62eaeacff1431d5 Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-DeleteServersTestJSON-1135653165 Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-DeleteServersTestJSON-1135653165-project Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 4d4f2146c3bc4a64b5d7f72cd136b6db Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-DeleteServersTestJSON-1135653165-project Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 16ef09f1-c039-4f49-975a-526f26df57f1 could not be found. Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '16ef09f1-c039-4f49-975a-526f26df57f1'} Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16ef09f1-c039-4f49-975a-526f26df57f1 could not be found. Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16ef09f1-c039-4f49-975a-526f26df57f1 could not be found. Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:23.030499 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:00:23.034344 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:23.034344 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:23.034344 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:23.034344 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:00:23.034344 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:00:23.034344 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16ef09f1-c039-4f49-975a-526f26df57f1 could not be found. Aug 31 16:00:23.034344 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:00:23.040727 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-41634be0-afe2-4d65-a04a-e1a907186a65 tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.768280 Aug 31 16:00:23.042171 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1259/2594] 10.222.0.50 () {62 vars in 1199 bytes} [Wed Aug 31 16:00:22 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 771 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 31 16:00:23.042938 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1bc29aad-06df-4a52-afd8-f425ad807331 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Returning 404 to user: Instance 16ef09f1-c039-4f49-975a-526f26df57f1 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:23.043814 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1bc29aad-06df-4a52-afd8-f425ad807331 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/16ef09f1-c039-4f49-975a-526f26df57f1" status: 404 len: 111 microversion: 2.1 time: 0.135172 Aug 31 16:00:23.054227 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1336/2595] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:22 2022] GET /compute/v2.1/servers/16ef09f1-c039-4f49-975a-526f26df57f1 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:00:23.054733 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-798baddb-2880-4914-9805-cb6a4b7f2160 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:23.055615 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-798baddb-2880-4914-9805-cb6a4b7f2160 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:23.069097 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8f4748e8-f0ce-4c3f-bf5d-eb6d4121bfcd tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] Calling method '.version_select at 0x7fbb4ab210d0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:23.070410 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-798baddb-2880-4914-9805-cb6a4b7f2160 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:23.073129 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-798baddb-2880-4914-9805-cb6a4b7f2160 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:23.074026 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-798baddb-2880-4914-9805-cb6a4b7f2160 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:23.077410 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-798baddb-2880-4914-9805-cb6a4b7f2160 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:23.078212 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-798baddb-2880-4914-9805-cb6a4b7f2160 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:23.078878 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-798baddb-2880-4914-9805-cb6a4b7f2160 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:23.097549 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8f4748e8-f0ce-4c3f-bf5d-eb6d4121bfcd tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] 10.222.0.50 "GET /compute/v2.1/os-keypairs/tempest-keypair-333821406" status: 200 len: 512 microversion: 2.2 time: 0.042123 Aug 31 16:00:23.100040 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1337/2596] 10.222.0.50 () {60 vars in 1255 bytes} [Wed Aug 31 16:00:23 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-333821406 => generated 512 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:00:23.111808 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e75b52c1-a377-4fac-9335-12c27e18ec3b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:23.124008 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e75b52c1-a377-4fac-9335-12c27e18ec3b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 320bf21c-eec1-43ea-a496-059fccc2642f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:23.162293 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e75b52c1-a377-4fac-9335-12c27e18ec3b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:23.167982 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e75b52c1-a377-4fac-9335-12c27e18ec3b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:23.173310 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e75b52c1-a377-4fac-9335-12c27e18ec3b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:23.176608 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e75b52c1-a377-4fac-9335-12c27e18ec3b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:23.179899 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e75b52c1-a377-4fac-9335-12c27e18ec3b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:23.183434 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e75b52c1-a377-4fac-9335-12c27e18ec3b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:23.247611 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-e75b52c1-a377-4fac-9335-12c27e18ec3b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] HTTP exception thrown: Instance 320bf21c-eec1-43ea-a496-059fccc2642f could not be found. Aug 31 16:00:23.251399 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e75b52c1-a377-4fac-9335-12c27e18ec3b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Request method failure captured: Aug 31 16:00:23.251399 n-d-833090-16 devstack@n-api.service[128864]: request: DELETE /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f HTTP/1.1 Aug 31 16:00:23.251399 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:00:23.251399 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:00:23.251399 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:00:23.251399 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:00:23.251399 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:00:23.251399 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:00:23.251399 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:00:23.251399 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:23.251399 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4Q2UxjmzRUIcRyBJZeRXZe8f-kxARGQrfLNadx-PtSKRAHFDd-cfjpN41Lm2TAtWQQVK9trDHJa1Iu7P1XlF1-EYrtrhJnDHGb-ivhI0erITWpZsYkLGmnwPDtbMbW99ld2jucgWFbVY0vVDf-y4OAM7Az1owqOg13oLERSA9bN0MQ Aug 31 16:00:23.251399 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:00:23.251399 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:00:23.251399 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:00:23.251399 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:00:23.251399 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:00:23.251399 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:00:23.251399 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: dde27d282fc24e56a62eaeacff1431d5 Aug 31 16:00:23.251399 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-DeleteServersTestJSON-1135653165 Aug 31 16:00:23.251399 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:00:23.251399 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:00:23.251399 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_dde27d282fc24e56a62eaeacff1431d5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:00:23.251399 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-DeleteServersTestJSON-1135653165 Aug 31 16:00:23.251399 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: dde27d282fc24e56a62eaeacff1431d5 Aug 31 16:00:23.251399 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-DeleteServersTestJSON-1135653165 Aug 31 16:00:23.251399 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-DeleteServersTestJSON-1135653165-project Aug 31 16:00:23.251399 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:00:23.251399 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:00:23.251399 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 4d4f2146c3bc4a64b5d7f72cd136b6db Aug 31 16:00:23.251399 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-DeleteServersTestJSON-1135653165-project Aug 31 16:00:23.251399 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:00:23.251399 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 320bf21c-eec1-43ea-a496-059fccc2642f could not be found. Aug 31 16:00:23.251399 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '320bf21c-eec1-43ea-a496-059fccc2642f'} Aug 31 16:00:23.251399 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:23.251399 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:23.251399 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:00:23.251399 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:00:23.251399 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:00:23.251399 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:00:23.251399 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:00:23.251399 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:00:23.251399 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:00:23.251399 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:00:23.251399 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 320bf21c-eec1-43ea-a496-059fccc2642f could not be found. Aug 31 16:00:23.251399 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:00:23.251399 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:23.251399 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:00:23.251399 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:23.251399 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:23.251399 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:23.251399 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:23.251399 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:23.251399 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:23.251399 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:23.251399 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:00:23.251399 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:00:23.251399 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:00:23.251399 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:00:23.251399 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:00:23.251399 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:00:23.251399 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:00:23.251399 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:00:23.256004 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 320bf21c-eec1-43ea-a496-059fccc2642f could not be found. Aug 31 16:00:23.256004 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:00:23.256004 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:23.256004 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:00:23.256004 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:23.256004 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:23.256004 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:23.256004 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:00:23.256004 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:00:23.256004 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 320bf21c-eec1-43ea-a496-059fccc2642f could not be found. Aug 31 16:00:23.256004 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:00:23.259183 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e75b52c1-a377-4fac-9335-12c27e18ec3b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Returning 404 to user: Instance 320bf21c-eec1-43ea-a496-059fccc2642f could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:23.260438 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e75b52c1-a377-4fac-9335-12c27e18ec3b tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "DELETE /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f" status: 404 len: 111 microversion: 2.1 time: 0.154975 Aug 31 16:00:23.269881 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1338/2597] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:00:23 2022] DELETE /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f => generated 111 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:00:23.276317 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-79288809-24da-478a-b233-9f08145105a5 tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] Calling method '.version_select at 0x7fbb4ab36280>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:23.329122 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-79288809-24da-478a-b233-9f08145105a5 tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-333821406" status: 204 len: 0 microversion: 2.2 time: 0.056208 Aug 31 16:00:23.330020 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1339/2598] 10.222.0.50 () {60 vars in 1258 bytes} [Wed Aug 31 16:00:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-333821406 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:00:23.341807 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-798baddb-2880-4914-9805-cb6a4b7f2160 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:23.351065 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-cb1f1757-de5d-4ad6-9e5e-6510a7607a32 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:23.351760 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-798baddb-2880-4914-9805-cb6a4b7f2160 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:23.353216 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-798baddb-2880-4914-9805-cb6a4b7f2160 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:23.353886 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-cb1f1757-de5d-4ad6-9e5e-6510a7607a32 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 320bf21c-eec1-43ea-a496-059fccc2642f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:23.374675 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-798baddb-2880-4914-9805-cb6a4b7f2160 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1553 microversion: 2.91 time: 0.330638 Aug 31 16:00:23.375553 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb1f1757-de5d-4ad6-9e5e-6510a7607a32 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:23.375708 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1260/2599] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:23 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1553 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:23.376446 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb1f1757-de5d-4ad6-9e5e-6510a7607a32 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:23.377527 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb1f1757-de5d-4ad6-9e5e-6510a7607a32 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:23.381227 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb1f1757-de5d-4ad6-9e5e-6510a7607a32 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:23.382268 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-070d4188-57b5-4a7a-be33-56598349c3b6 tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] Action: 'create', calling method: .version_select at 0x7fbb45dc0d30>, body: {"keypair": {"name": "tempest-keypair-1960221163", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCopYpWkMuLgPs7FbtCLfVVHAzmh5mGyf1pMcobPPOg3Hs/3ol7X2gqGnDPVZdhPkC828hbZPMPLN1Emvn8WAoqrxIUcHRoYpYYx2OTbz1p8WPQHoU5bEZ+HMatauzvDEg=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:23.383137 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb1f1757-de5d-4ad6-9e5e-6510a7607a32 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:23.384066 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb1f1757-de5d-4ad6-9e5e-6510a7607a32 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:23.420076 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-cb1f1757-de5d-4ad6-9e5e-6510a7607a32 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] HTTP exception thrown: Instance 320bf21c-eec1-43ea-a496-059fccc2642f could not be found. Aug 31 16:00:23.420472 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-070d4188-57b5-4a7a-be33-56598349c3b6 tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] Getting quotas for project 5ec7ef57e7bf48568170e6afb53efdb0. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-cb1f1757-de5d-4ad6-9e5e-6510a7607a32 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Request method failure captured: Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f HTTP/1.1 Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4Q2UxjmzRUIcRyBJZeRXZe8f-kxARGQrfLNadx-PtSKRAHFDd-cfjpN41Lm2TAtWQQVK9trDHJa1Iu7P1XlF1-EYrtrhJnDHGb-ivhI0erITWpZsYkLGmnwPDtbMbW99ld2jucgWFbVY0vVDf-y4OAM7Az1owqOg13oLERSA9bN0MQ Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: dde27d282fc24e56a62eaeacff1431d5 Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-DeleteServersTestJSON-1135653165 Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_dde27d282fc24e56a62eaeacff1431d5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-DeleteServersTestJSON-1135653165 Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: dde27d282fc24e56a62eaeacff1431d5 Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-DeleteServersTestJSON-1135653165 Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-DeleteServersTestJSON-1135653165-project Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 4d4f2146c3bc4a64b5d7f72cd136b6db Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-DeleteServersTestJSON-1135653165-project Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 320bf21c-eec1-43ea-a496-059fccc2642f could not be found. Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '320bf21c-eec1-43ea-a496-059fccc2642f'} Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 320bf21c-eec1-43ea-a496-059fccc2642f could not be found. Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 320bf21c-eec1-43ea-a496-059fccc2642f could not be found. Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:23.423016 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:00:23.427666 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:23.427666 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:23.427666 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:23.427666 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:00:23.427666 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:00:23.427666 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 320bf21c-eec1-43ea-a496-059fccc2642f could not be found. Aug 31 16:00:23.427666 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:00:23.429061 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-cb1f1757-de5d-4ad6-9e5e-6510a7607a32 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Returning 404 to user: Instance 320bf21c-eec1-43ea-a496-059fccc2642f could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:23.429582 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-070d4188-57b5-4a7a-be33-56598349c3b6 tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] Getting quotas for user 08279c461cd34088be9bb71f59cf393f and project 5ec7ef57e7bf48568170e6afb53efdb0. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:00:23.430782 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-cb1f1757-de5d-4ad6-9e5e-6510a7607a32 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f" status: 404 len: 111 microversion: 2.1 time: 0.089987 Aug 31 16:00:23.431810 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1340/2600] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:23 2022] GET /compute/v2.1/servers/320bf21c-eec1-43ea-a496-059fccc2642f => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:00:23.445444 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-356e582e-3b69-4e70-9a6b-bb15012bd2cd tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:23.446449 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-356e582e-3b69-4e70-9a6b-bb15012bd2cd tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: f044dca7-71de-4182-b5ec-825299496c10] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:23.455335 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-356e582e-3b69-4e70-9a6b-bb15012bd2cd tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:23.456009 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-356e582e-3b69-4e70-9a6b-bb15012bd2cd tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:23.456733 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-356e582e-3b69-4e70-9a6b-bb15012bd2cd tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:23.457763 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-356e582e-3b69-4e70-9a6b-bb15012bd2cd tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:23.458674 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-356e582e-3b69-4e70-9a6b-bb15012bd2cd tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:23.459286 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-356e582e-3b69-4e70-9a6b-bb15012bd2cd tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:23.488244 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-070d4188-57b5-4a7a-be33-56598349c3b6 tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.108692 Aug 31 16:00:23.488244 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1261/2601] 10.222.0.50 () {62 vars in 1199 bytes} [Wed Aug 31 16:00:23 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 110 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 31 16:00:23.492465 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-356e582e-3b69-4e70-9a6b-bb15012bd2cd tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] HTTP exception thrown: Instance f044dca7-71de-4182-b5ec-825299496c10 could not be found. Aug 31 16:00:23.494610 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-356e582e-3b69-4e70-9a6b-bb15012bd2cd tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Request method failure captured: Aug 31 16:00:23.494610 n-d-833090-16 devstack@n-api.service[128864]: request: DELETE /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10 HTTP/1.1 Aug 31 16:00:23.494610 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:00:23.494610 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:00:23.494610 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:00:23.494610 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:00:23.494610 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:00:23.494610 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:00:23.494610 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:00:23.494610 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:23.494610 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4Q2UxjmzRUIcRyBJZeRXZe8f-kxARGQrfLNadx-PtSKRAHFDd-cfjpN41Lm2TAtWQQVK9trDHJa1Iu7P1XlF1-EYrtrhJnDHGb-ivhI0erITWpZsYkLGmnwPDtbMbW99ld2jucgWFbVY0vVDf-y4OAM7Az1owqOg13oLERSA9bN0MQ Aug 31 16:00:23.494610 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:00:23.494610 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:00:23.494610 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:00:23.494610 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:00:23.494610 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:00:23.494610 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:00:23.494610 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: dde27d282fc24e56a62eaeacff1431d5 Aug 31 16:00:23.494610 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-DeleteServersTestJSON-1135653165 Aug 31 16:00:23.494610 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:00:23.494610 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:00:23.494610 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_dde27d282fc24e56a62eaeacff1431d5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:00:23.494610 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-DeleteServersTestJSON-1135653165 Aug 31 16:00:23.494610 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: dde27d282fc24e56a62eaeacff1431d5 Aug 31 16:00:23.494610 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-DeleteServersTestJSON-1135653165 Aug 31 16:00:23.494610 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-DeleteServersTestJSON-1135653165-project Aug 31 16:00:23.494610 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:00:23.494610 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:00:23.494610 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 4d4f2146c3bc4a64b5d7f72cd136b6db Aug 31 16:00:23.494610 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-DeleteServersTestJSON-1135653165-project Aug 31 16:00:23.494610 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:00:23.494610 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance f044dca7-71de-4182-b5ec-825299496c10 could not be found. Aug 31 16:00:23.494610 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'f044dca7-71de-4182-b5ec-825299496c10'} Aug 31 16:00:23.494610 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:23.494610 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:23.494610 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:00:23.494610 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:00:23.494610 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:00:23.494610 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:00:23.494610 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:00:23.494610 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:00:23.494610 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:00:23.494610 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:00:23.494610 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f044dca7-71de-4182-b5ec-825299496c10 could not be found. Aug 31 16:00:23.494610 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:00:23.494610 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:23.494610 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:00:23.494610 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:23.494610 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:23.494610 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:23.494610 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:23.494610 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:23.494610 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:23.494610 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:23.494610 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:00:23.494610 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:00:23.494610 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:00:23.494610 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:00:23.494610 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:00:23.494610 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:00:23.494610 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:00:23.494610 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:00:23.499125 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f044dca7-71de-4182-b5ec-825299496c10 could not be found. Aug 31 16:00:23.499125 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:00:23.499125 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:23.499125 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:00:23.499125 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:23.499125 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:23.499125 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:23.499125 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:00:23.499125 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:00:23.499125 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f044dca7-71de-4182-b5ec-825299496c10 could not be found. Aug 31 16:00:23.499125 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:00:23.500024 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a6282bce-18d0-4094-a295-3b8c629a43f8 tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] Calling method '.version_select at 0x7fbb4ac6b5e0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:23.500825 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-356e582e-3b69-4e70-9a6b-bb15012bd2cd tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Returning 404 to user: Instance f044dca7-71de-4182-b5ec-825299496c10 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:23.502278 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-356e582e-3b69-4e70-9a6b-bb15012bd2cd tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "DELETE /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10" status: 404 len: 111 microversion: 2.1 time: 0.065755 Aug 31 16:00:23.504169 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1341/2602] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:00:23 2022] DELETE /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:00:23.517229 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-51c4d217-baba-4a9a-b68e-0bed24401872 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:23.518804 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-51c4d217-baba-4a9a-b68e-0bed24401872 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: f044dca7-71de-4182-b5ec-825299496c10] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:23.527115 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51c4d217-baba-4a9a-b68e-0bed24401872 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:23.528655 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51c4d217-baba-4a9a-b68e-0bed24401872 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:23.529250 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51c4d217-baba-4a9a-b68e-0bed24401872 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:23.530499 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51c4d217-baba-4a9a-b68e-0bed24401872 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:23.531132 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51c4d217-baba-4a9a-b68e-0bed24401872 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:23.532228 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51c4d217-baba-4a9a-b68e-0bed24401872 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:23.552225 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-51c4d217-baba-4a9a-b68e-0bed24401872 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] HTTP exception thrown: Instance f044dca7-71de-4182-b5ec-825299496c10 could not be found. Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-51c4d217-baba-4a9a-b68e-0bed24401872 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Request method failure captured: Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10 HTTP/1.1 Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4Q2UxjmzRUIcRyBJZeRXZe8f-kxARGQrfLNadx-PtSKRAHFDd-cfjpN41Lm2TAtWQQVK9trDHJa1Iu7P1XlF1-EYrtrhJnDHGb-ivhI0erITWpZsYkLGmnwPDtbMbW99ld2jucgWFbVY0vVDf-y4OAM7Az1owqOg13oLERSA9bN0MQ Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: dde27d282fc24e56a62eaeacff1431d5 Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-DeleteServersTestJSON-1135653165 Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_dde27d282fc24e56a62eaeacff1431d5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-DeleteServersTestJSON-1135653165 Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: dde27d282fc24e56a62eaeacff1431d5 Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-DeleteServersTestJSON-1135653165 Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-DeleteServersTestJSON-1135653165-project Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 4d4f2146c3bc4a64b5d7f72cd136b6db Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-DeleteServersTestJSON-1135653165-project Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance f044dca7-71de-4182-b5ec-825299496c10 could not be found. Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'f044dca7-71de-4182-b5ec-825299496c10'} Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f044dca7-71de-4182-b5ec-825299496c10 could not be found. Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f044dca7-71de-4182-b5ec-825299496c10 could not be found. Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:23.554523 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:00:23.559152 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:23.559152 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:23.559152 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:23.559152 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:00:23.559152 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:00:23.559152 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f044dca7-71de-4182-b5ec-825299496c10 could not be found. Aug 31 16:00:23.559152 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:00:23.559646 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a6282bce-18d0-4094-a295-3b8c629a43f8 tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1960221163" status: 204 len: 0 microversion: 2.2 time: 0.062739 Aug 31 16:00:23.560404 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1262/2603] 10.222.0.50 () {60 vars in 1261 bytes} [Wed Aug 31 16:00:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1960221163 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 16:00:23.560916 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-51c4d217-baba-4a9a-b68e-0bed24401872 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Returning 404 to user: Instance f044dca7-71de-4182-b5ec-825299496c10 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:23.562117 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-51c4d217-baba-4a9a-b68e-0bed24401872 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10" status: 404 len: 111 microversion: 2.1 time: 0.052358 Aug 31 16:00:23.563333 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1342/2604] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:23 2022] GET /compute/v2.1/servers/f044dca7-71de-4182-b5ec-825299496c10 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:00:23.571809 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9eab001b-ae65-4018-8a5d-130eb0ee338c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:23.571809 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9eab001b-ae65-4018-8a5d-130eb0ee338c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: b90018d3-33b8-4bbc-9b09-d4f8a62a5a79] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:23.578353 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0cfe24fd-8395-4d18-8376-fd6a162f4e5b tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] Action: 'create', calling method: .version_select at 0x7fbb4ab18700>, body: {"keypair": {"name": "tempest-keypair-2058478858", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:23.592449 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9eab001b-ae65-4018-8a5d-130eb0ee338c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:23.596337 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9eab001b-ae65-4018-8a5d-130eb0ee338c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:23.597107 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9eab001b-ae65-4018-8a5d-130eb0ee338c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:23.599082 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9eab001b-ae65-4018-8a5d-130eb0ee338c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:23.600910 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9eab001b-ae65-4018-8a5d-130eb0ee338c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:23.607292 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9eab001b-ae65-4018-8a5d-130eb0ee338c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:23.634801 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-9eab001b-ae65-4018-8a5d-130eb0ee338c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] HTTP exception thrown: Instance b90018d3-33b8-4bbc-9b09-d4f8a62a5a79 could not be found. Aug 31 16:00:23.641025 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9eab001b-ae65-4018-8a5d-130eb0ee338c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Request method failure captured: Aug 31 16:00:23.641025 n-d-833090-16 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/b90018d3-33b8-4bbc-9b09-d4f8a62a5a79 HTTP/1.1 Aug 31 16:00:23.641025 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:00:23.641025 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:00:23.641025 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:00:23.641025 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:00:23.641025 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:00:23.641025 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:00:23.641025 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:00:23.641025 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:23.641025 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4Q2UxjmzRUIcRyBJZeRXZe8f-kxARGQrfLNadx-PtSKRAHFDd-cfjpN41Lm2TAtWQQVK9trDHJa1Iu7P1XlF1-EYrtrhJnDHGb-ivhI0erITWpZsYkLGmnwPDtbMbW99ld2jucgWFbVY0vVDf-y4OAM7Az1owqOg13oLERSA9bN0MQ Aug 31 16:00:23.641025 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:00:23.641025 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:00:23.641025 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:00:23.641025 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:00:23.641025 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:00:23.641025 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:00:23.641025 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: dde27d282fc24e56a62eaeacff1431d5 Aug 31 16:00:23.641025 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-DeleteServersTestJSON-1135653165 Aug 31 16:00:23.641025 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:00:23.641025 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:00:23.641025 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_dde27d282fc24e56a62eaeacff1431d5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:00:23.641025 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-DeleteServersTestJSON-1135653165 Aug 31 16:00:23.641025 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: dde27d282fc24e56a62eaeacff1431d5 Aug 31 16:00:23.641025 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-DeleteServersTestJSON-1135653165 Aug 31 16:00:23.641025 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-DeleteServersTestJSON-1135653165-project Aug 31 16:00:23.641025 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:00:23.641025 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:00:23.641025 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 4d4f2146c3bc4a64b5d7f72cd136b6db Aug 31 16:00:23.641025 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-DeleteServersTestJSON-1135653165-project Aug 31 16:00:23.641025 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:00:23.641025 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance b90018d3-33b8-4bbc-9b09-d4f8a62a5a79 could not be found. Aug 31 16:00:23.641025 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'b90018d3-33b8-4bbc-9b09-d4f8a62a5a79'} Aug 31 16:00:23.641025 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:23.641025 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:23.641025 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:00:23.641025 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:00:23.641025 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:00:23.641025 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:00:23.641025 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:00:23.641025 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:00:23.641025 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:00:23.641025 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:00:23.641025 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b90018d3-33b8-4bbc-9b09-d4f8a62a5a79 could not be found. Aug 31 16:00:23.641025 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:23.641025 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:23.641025 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:23.641025 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:23.641025 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:23.641025 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:23.641025 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:23.641025 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:23.641025 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:23.641025 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:23.641025 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:00:23.641025 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:00:23.641025 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:00:23.641025 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:00:23.641025 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:00:23.641025 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:00:23.641025 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:00:23.641025 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:00:23.645649 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b90018d3-33b8-4bbc-9b09-d4f8a62a5a79 could not be found. Aug 31 16:00:23.645649 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:23.645649 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:23.645649 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:23.645649 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:23.645649 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:23.645649 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:23.645649 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:00:23.645649 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:00:23.645649 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b90018d3-33b8-4bbc-9b09-d4f8a62a5a79 could not be found. Aug 31 16:00:23.645649 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:23.647348 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9eab001b-ae65-4018-8a5d-130eb0ee338c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Returning 404 to user: Instance b90018d3-33b8-4bbc-9b09-d4f8a62a5a79 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:23.651330 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9eab001b-ae65-4018-8a5d-130eb0ee338c tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b90018d3-33b8-4bbc-9b09-d4f8a62a5a79" status: 404 len: 111 microversion: 2.1 time: 0.084039 Aug 31 16:00:23.655495 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1263/2605] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:00:23 2022] DELETE /compute/v2.1/servers/b90018d3-33b8-4bbc-9b09-d4f8a62a5a79 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:00:23.656144 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-0cfe24fd-8395-4d18-8376-fd6a162f4e5b tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] Getting quotas for project 5ec7ef57e7bf48568170e6afb53efdb0. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:00:23.670285 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f27722e3-26f3-4118-9cce-12296a7b794d tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:23.672419 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f27722e3-26f3-4118-9cce-12296a7b794d tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: b90018d3-33b8-4bbc-9b09-d4f8a62a5a79] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:23.678698 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-0cfe24fd-8395-4d18-8376-fd6a162f4e5b tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] Getting quotas for user 08279c461cd34088be9bb71f59cf393f and project 5ec7ef57e7bf48568170e6afb53efdb0. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:00:23.687821 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f27722e3-26f3-4118-9cce-12296a7b794d tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:23.694914 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f27722e3-26f3-4118-9cce-12296a7b794d tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:23.695752 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f27722e3-26f3-4118-9cce-12296a7b794d tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:23.696903 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f27722e3-26f3-4118-9cce-12296a7b794d tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:23.697640 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f27722e3-26f3-4118-9cce-12296a7b794d tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:23.698432 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f27722e3-26f3-4118-9cce-12296a7b794d tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:23.736612 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-f27722e3-26f3-4118-9cce-12296a7b794d tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] HTTP exception thrown: Instance b90018d3-33b8-4bbc-9b09-d4f8a62a5a79 could not be found. Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f27722e3-26f3-4118-9cce-12296a7b794d tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Request method failure captured: Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/b90018d3-33b8-4bbc-9b09-d4f8a62a5a79 HTTP/1.1 Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4Q2UxjmzRUIcRyBJZeRXZe8f-kxARGQrfLNadx-PtSKRAHFDd-cfjpN41Lm2TAtWQQVK9trDHJa1Iu7P1XlF1-EYrtrhJnDHGb-ivhI0erITWpZsYkLGmnwPDtbMbW99ld2jucgWFbVY0vVDf-y4OAM7Az1owqOg13oLERSA9bN0MQ Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: dde27d282fc24e56a62eaeacff1431d5 Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-DeleteServersTestJSON-1135653165 Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_dde27d282fc24e56a62eaeacff1431d5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-DeleteServersTestJSON-1135653165 Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: dde27d282fc24e56a62eaeacff1431d5 Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-DeleteServersTestJSON-1135653165 Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-DeleteServersTestJSON-1135653165-project Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 4d4f2146c3bc4a64b5d7f72cd136b6db Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-DeleteServersTestJSON-1135653165-project Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance b90018d3-33b8-4bbc-9b09-d4f8a62a5a79 could not be found. Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'b90018d3-33b8-4bbc-9b09-d4f8a62a5a79'} Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b90018d3-33b8-4bbc-9b09-d4f8a62a5a79 could not be found. Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b90018d3-33b8-4bbc-9b09-d4f8a62a5a79 could not be found. Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:23.738598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:23.743403 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:23.743403 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:23.743403 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:23.743403 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:00:23.743403 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:00:23.743403 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b90018d3-33b8-4bbc-9b09-d4f8a62a5a79 could not be found. Aug 31 16:00:23.743403 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:23.745517 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f27722e3-26f3-4118-9cce-12296a7b794d tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Returning 404 to user: Instance b90018d3-33b8-4bbc-9b09-d4f8a62a5a79 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:23.746703 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f27722e3-26f3-4118-9cce-12296a7b794d tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/b90018d3-33b8-4bbc-9b09-d4f8a62a5a79" status: 404 len: 111 microversion: 2.1 time: 0.086940 Aug 31 16:00:23.750845 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1264/2606] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:23 2022] GET /compute/v2.1/servers/b90018d3-33b8-4bbc-9b09-d4f8a62a5a79 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:00:23.769897 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a11dee86-b6f3-4df4-ba82-0217c6bf355d tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:23.775469 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a11dee86-b6f3-4df4-ba82-0217c6bf355d tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: d47f69b3-01f9-4cd1-a48f-53af8e3a2b8a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:23.822918 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a11dee86-b6f3-4df4-ba82-0217c6bf355d tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:23.823628 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a11dee86-b6f3-4df4-ba82-0217c6bf355d tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:23.824168 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a11dee86-b6f3-4df4-ba82-0217c6bf355d tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:23.825121 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a11dee86-b6f3-4df4-ba82-0217c6bf355d tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:23.826185 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a11dee86-b6f3-4df4-ba82-0217c6bf355d tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:23.826674 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a11dee86-b6f3-4df4-ba82-0217c6bf355d tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:23.851297 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0cfe24fd-8395-4d18-8376-fd6a162f4e5b tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.276797 Aug 31 16:00:23.852003 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1343/2607] 10.222.0.50 () {62 vars in 1199 bytes} [Wed Aug 31 16:00:23 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 278 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 31 16:00:23.863192 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4b0fed8b-00fe-4a9e-b5b0-6b6fa09c9c16 tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] Calling method '.version_select at 0x7fbb461ee820>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:23.876478 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-a11dee86-b6f3-4df4-ba82-0217c6bf355d tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] HTTP exception thrown: Instance d47f69b3-01f9-4cd1-a48f-53af8e3a2b8a could not be found. Aug 31 16:00:23.879232 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a11dee86-b6f3-4df4-ba82-0217c6bf355d tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Request method failure captured: Aug 31 16:00:23.879232 n-d-833090-16 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/d47f69b3-01f9-4cd1-a48f-53af8e3a2b8a HTTP/1.1 Aug 31 16:00:23.879232 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:00:23.879232 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:00:23.879232 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:00:23.879232 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:00:23.879232 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:00:23.879232 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:00:23.879232 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:00:23.879232 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:23.879232 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4Q2UxjmzRUIcRyBJZeRXZe8f-kxARGQrfLNadx-PtSKRAHFDd-cfjpN41Lm2TAtWQQVK9trDHJa1Iu7P1XlF1-EYrtrhJnDHGb-ivhI0erITWpZsYkLGmnwPDtbMbW99ld2jucgWFbVY0vVDf-y4OAM7Az1owqOg13oLERSA9bN0MQ Aug 31 16:00:23.879232 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:00:23.879232 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:00:23.879232 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:00:23.879232 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:00:23.879232 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:00:23.879232 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:00:23.879232 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: dde27d282fc24e56a62eaeacff1431d5 Aug 31 16:00:23.879232 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-DeleteServersTestJSON-1135653165 Aug 31 16:00:23.879232 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:00:23.879232 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:00:23.879232 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_dde27d282fc24e56a62eaeacff1431d5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:00:23.879232 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-DeleteServersTestJSON-1135653165 Aug 31 16:00:23.879232 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: dde27d282fc24e56a62eaeacff1431d5 Aug 31 16:00:23.879232 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-DeleteServersTestJSON-1135653165 Aug 31 16:00:23.879232 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-DeleteServersTestJSON-1135653165-project Aug 31 16:00:23.879232 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:00:23.879232 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:00:23.879232 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 4d4f2146c3bc4a64b5d7f72cd136b6db Aug 31 16:00:23.879232 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-DeleteServersTestJSON-1135653165-project Aug 31 16:00:23.879232 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:00:23.879232 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance d47f69b3-01f9-4cd1-a48f-53af8e3a2b8a could not be found. Aug 31 16:00:23.879232 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'd47f69b3-01f9-4cd1-a48f-53af8e3a2b8a'} Aug 31 16:00:23.879232 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:23.879232 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:23.879232 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:00:23.879232 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:00:23.879232 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:00:23.879232 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:00:23.879232 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:00:23.879232 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:00:23.879232 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:00:23.879232 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:00:23.879232 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d47f69b3-01f9-4cd1-a48f-53af8e3a2b8a could not be found. Aug 31 16:00:23.879232 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:23.879232 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:23.879232 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:23.879232 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:23.879232 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:23.879232 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:23.879232 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:23.879232 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:23.879232 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:23.879232 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:23.879232 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:00:23.879232 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:00:23.879232 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:00:23.879232 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:00:23.879232 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:00:23.879232 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:00:23.879232 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:00:23.879232 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:00:23.883339 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d47f69b3-01f9-4cd1-a48f-53af8e3a2b8a could not be found. Aug 31 16:00:23.883339 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:23.883339 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:23.883339 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:23.883339 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:23.883339 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:23.883339 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:23.883339 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:00:23.883339 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:00:23.883339 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d47f69b3-01f9-4cd1-a48f-53af8e3a2b8a could not be found. Aug 31 16:00:23.883339 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:23.887008 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a11dee86-b6f3-4df4-ba82-0217c6bf355d tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Returning 404 to user: Instance d47f69b3-01f9-4cd1-a48f-53af8e3a2b8a could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:23.888562 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a11dee86-b6f3-4df4-ba82-0217c6bf355d tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d47f69b3-01f9-4cd1-a48f-53af8e3a2b8a" status: 404 len: 111 microversion: 2.1 time: 0.132523 Aug 31 16:00:23.891250 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1265/2608] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:00:23 2022] DELETE /compute/v2.1/servers/d47f69b3-01f9-4cd1-a48f-53af8e3a2b8a => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:00:23.904523 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-051ebb78-2e3c-4bde-9251-66b0993884e0 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:23.905448 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-051ebb78-2e3c-4bde-9251-66b0993884e0 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: d47f69b3-01f9-4cd1-a48f-53af8e3a2b8a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:23.909163 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4b0fed8b-00fe-4a9e-b5b0-6b6fa09c9c16 tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2058478858" status: 204 len: 0 microversion: 2.2 time: 0.050006 Aug 31 16:00:23.916594 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1344/2609] 10.222.0.50 () {60 vars in 1261 bytes} [Wed Aug 31 16:00:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2058478858 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 16:00:23.922517 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7d53bbdc-b053-4fa2-8109-f3df39b99c78 tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] Action: 'create', calling method: .version_select at 0x7fbb461ee040>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1706125466", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBExAf5ALkw/ZCMrQPKwpr09NYLbn8Or/0jPKVwTxYFJIB9MLyrNoTmlayrPSIxygdp/2mhcnwibsf0BEQ+zFy+TpfJB2P1PwHPyvHfGHE+B29VQgyB9TS+Ww3XqIBO9n1w=="}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:23.943827 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-051ebb78-2e3c-4bde-9251-66b0993884e0 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:23.946983 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-051ebb78-2e3c-4bde-9251-66b0993884e0 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:23.947702 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-051ebb78-2e3c-4bde-9251-66b0993884e0 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:23.949079 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-051ebb78-2e3c-4bde-9251-66b0993884e0 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:23.949797 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-051ebb78-2e3c-4bde-9251-66b0993884e0 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:23.950632 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-051ebb78-2e3c-4bde-9251-66b0993884e0 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:23.958498 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:00:23.982195 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-7d53bbdc-b053-4fa2-8109-f3df39b99c78 tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] Getting quotas for project 5ec7ef57e7bf48568170e6afb53efdb0. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:00:24.003515 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-7d53bbdc-b053-4fa2-8109-f3df39b99c78 tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] Getting quotas for user 08279c461cd34088be9bb71f59cf393f and project 5ec7ef57e7bf48568170e6afb53efdb0. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:00:24.032119 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-051ebb78-2e3c-4bde-9251-66b0993884e0 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] HTTP exception thrown: Instance d47f69b3-01f9-4cd1-a48f-53af8e3a2b8a could not be found. Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-051ebb78-2e3c-4bde-9251-66b0993884e0 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Request method failure captured: Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/d47f69b3-01f9-4cd1-a48f-53af8e3a2b8a HTTP/1.1 Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4Q2UxjmzRUIcRyBJZeRXZe8f-kxARGQrfLNadx-PtSKRAHFDd-cfjpN41Lm2TAtWQQVK9trDHJa1Iu7P1XlF1-EYrtrhJnDHGb-ivhI0erITWpZsYkLGmnwPDtbMbW99ld2jucgWFbVY0vVDf-y4OAM7Az1owqOg13oLERSA9bN0MQ Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: dde27d282fc24e56a62eaeacff1431d5 Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-DeleteServersTestJSON-1135653165 Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_dde27d282fc24e56a62eaeacff1431d5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-DeleteServersTestJSON-1135653165 Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: dde27d282fc24e56a62eaeacff1431d5 Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-DeleteServersTestJSON-1135653165 Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-DeleteServersTestJSON-1135653165-project Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 4d4f2146c3bc4a64b5d7f72cd136b6db Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-DeleteServersTestJSON-1135653165-project Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance d47f69b3-01f9-4cd1-a48f-53af8e3a2b8a could not be found. Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'd47f69b3-01f9-4cd1-a48f-53af8e3a2b8a'} Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d47f69b3-01f9-4cd1-a48f-53af8e3a2b8a could not be found. Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d47f69b3-01f9-4cd1-a48f-53af8e3a2b8a could not be found. Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:24.043256 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:24.051447 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:24.051447 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:24.051447 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:24.051447 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:00:24.051447 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:00:24.051447 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d47f69b3-01f9-4cd1-a48f-53af8e3a2b8a could not be found. Aug 31 16:00:24.051447 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:24.054294 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-051ebb78-2e3c-4bde-9251-66b0993884e0 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Returning 404 to user: Instance d47f69b3-01f9-4cd1-a48f-53af8e3a2b8a could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:24.055464 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-051ebb78-2e3c-4bde-9251-66b0993884e0 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/d47f69b3-01f9-4cd1-a48f-53af8e3a2b8a" status: 404 len: 111 microversion: 2.1 time: 0.159645 Aug 31 16:00:24.058951 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1266/2610] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:23 2022] GET /compute/v2.1/servers/d47f69b3-01f9-4cd1-a48f-53af8e3a2b8a => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:00:24.066393 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f662e119-1193-42fd-b2b1-95bba69e84e2 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:24.067900 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f662e119-1193-42fd-b2b1-95bba69e84e2 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 9fd5b244-b9b6-4901-8b2f-0454d800d6b4] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:24.077451 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f662e119-1193-42fd-b2b1-95bba69e84e2 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:24.078213 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f662e119-1193-42fd-b2b1-95bba69e84e2 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:24.078902 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f662e119-1193-42fd-b2b1-95bba69e84e2 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:24.079889 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f662e119-1193-42fd-b2b1-95bba69e84e2 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:24.080610 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f662e119-1193-42fd-b2b1-95bba69e84e2 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:24.081511 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f662e119-1193-42fd-b2b1-95bba69e84e2 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:24.091069 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7d53bbdc-b053-4fa2-8109-f3df39b99c78 tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.172808 Aug 31 16:00:24.098314 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1345/2611] 10.222.0.50 () {62 vars in 1199 bytes} [Wed Aug 31 16:00:23 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 181 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 31 16:00:24.121745 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f5180860-ccaa-4dcf-af46-fd32646ce56d tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] Action: 'create', calling method: .version_select at 0x7fbb46184e50>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1339619049", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqUJLzfX270LowfJTiIaX2vwKKUi8rfj68Ks6sDYxY07ovcFjQCbolJavrIsSCETf53rF5+bGECaWzERwKsQ4YEQ3CtQMdORSKXkWB4uZEXTZKnrAVj1AuxTwYN06+jrQ=="}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:24.164980 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-f5180860-ccaa-4dcf-af46-fd32646ce56d tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] Getting quotas for project 5ec7ef57e7bf48568170e6afb53efdb0. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:00:24.175602 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-f5180860-ccaa-4dcf-af46-fd32646ce56d tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] Getting quotas for user 08279c461cd34088be9bb71f59cf393f and project 5ec7ef57e7bf48568170e6afb53efdb0. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:00:24.223224 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f5180860-ccaa-4dcf-af46-fd32646ce56d tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.115208 Aug 31 16:00:24.225106 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1346/2612] 10.222.0.50 () {62 vars in 1199 bytes} [Wed Aug 31 16:00:24 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 118 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 31 16:00:24.256347 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-30240553-a717-4132-832c-a690e8fded4b tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] Action: 'create', calling method: .version_select at 0x7fbb4ac89940>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1085321437", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPlggg7+EuqyjpriJamHnZvvf3B3q8BaExqlVLkXc66krCQZC2vvgdQ96PCSjtGUY9pyScLpsAWKFZFfS10VV3mICuPsqJ1QkTgn+Jscve46hOlqB6Wyt8WugaccFg6GZA=="}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:24.312395 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-30240553-a717-4132-832c-a690e8fded4b tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] Getting quotas for project 5ec7ef57e7bf48568170e6afb53efdb0. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:00:24.333036 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-30240553-a717-4132-832c-a690e8fded4b tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] Getting quotas for user 08279c461cd34088be9bb71f59cf393f and project 5ec7ef57e7bf48568170e6afb53efdb0. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:00:24.429479 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-30240553-a717-4132-832c-a690e8fded4b tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.186944 Aug 31 16:00:24.430558 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1347/2613] 10.222.0.50 () {62 vars in 1199 bytes} [Wed Aug 31 16:00:24 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 193 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 31 16:00:24.445020 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4379c229-6264-40dd-992a-81cbe532a703 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:24.445658 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4379c229-6264-40dd-992a-81cbe532a703 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:24.465253 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4379c229-6264-40dd-992a-81cbe532a703 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:24.465754 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4379c229-6264-40dd-992a-81cbe532a703 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:24.468569 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4379c229-6264-40dd-992a-81cbe532a703 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:24.472451 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4379c229-6264-40dd-992a-81cbe532a703 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:24.475223 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4379c229-6264-40dd-992a-81cbe532a703 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:24.478316 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4379c229-6264-40dd-992a-81cbe532a703 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:24.749654 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4379c229-6264-40dd-992a-81cbe532a703 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:24.768875 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4379c229-6264-40dd-992a-81cbe532a703 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:24.773977 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4379c229-6264-40dd-992a-81cbe532a703 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:24.791082 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4379c229-6264-40dd-992a-81cbe532a703 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1553 microversion: 2.91 time: 0.359074 Aug 31 16:00:24.793712 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1348/2614] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:24 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1553 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:24.805704 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8a108665-1df3-4e59-bc8c-1ec6ff4681e3 tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] Calling method '.version_select at 0x7fbb4ab21dc0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:24.822263 n-d-833090-16 devstack@n-api.service[128864]: WARNING oslo_db.sqlalchemy.utils [None req-8a108665-1df3-4e59-bc8c-1ec6ff4681e3 tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 31 16:00:24.847770 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8a108665-1df3-4e59-bc8c-1ec6ff4681e3 tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] 10.222.0.50 "GET /compute/v2.1/os-keypairs" status: 200 len: 1142 microversion: 2.2 time: 0.048698 Aug 31 16:00:24.854027 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1349/2615] 10.222.0.50 () {60 vars in 1177 bytes} [Wed Aug 31 16:00:24 2022] GET /compute/v2.1/os-keypairs => generated 1142 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:24.865661 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-738d6a17-4c44-4e12-a67c-b5f10af7061b tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] Calling method '.version_select at 0x7fbb4ac89820>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:24.921061 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-738d6a17-4c44-4e12-a67c-b5f10af7061b tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1085321437" status: 204 len: 0 microversion: 2.2 time: 0.064413 Aug 31 16:00:24.929132 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1350/2616] 10.222.0.50 () {60 vars in 1321 bytes} [Wed Aug 31 16:00:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1085321437 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 16:00:24.940226 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-46992017-63e5-4682-9e28-fa48cedee5de tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] Calling method '.version_select at 0x7fbb4ac57ee0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:24.992636 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-46992017-63e5-4682-9e28-fa48cedee5de tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1339619049" status: 204 len: 0 microversion: 2.2 time: 0.061636 Aug 31 16:00:24.993644 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1351/2617] 10.222.0.50 () {60 vars in 1321 bytes} [Wed Aug 31 16:00:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1339619049 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:00:25.007011 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d08a9559-8456-4282-a67f-4bf7db3e89f7 tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] Calling method '.version_select at 0x7fbb4ab21040>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:25.074029 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d08a9559-8456-4282-a67f-4bf7db3e89f7 tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1706125466" status: 204 len: 0 microversion: 2.2 time: 0.074655 Aug 31 16:00:25.084086 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1352/2618] 10.222.0.50 () {60 vars in 1321 bytes} [Wed Aug 31 16:00:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1706125466 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:00:25.100224 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4b7f80bd-251a-46ef-96ec-ccfbf065a3da tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] Action: 'create', calling method: .version_select at 0x7fbb461849d0>, body: {"keypair": {"name": "tempest-keypair-1869987709", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNHxKIM63qll5FAv9sA1hbpnTNFTnLegJzehpTrGlz/PGnjEg0u73BJqyTY1fGcuK43Bg2PBtt27mkn8vBYoI9O4mW1+j0+5TGkoB0RWVkKBKCanjzRG6GfO/yVUGloNOw=="}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:25.151222 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f662e119-1193-42fd-b2b1-95bba69e84e2 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8476b6167a4c838eac59d7c4a40284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a7c84a4ea54074bab3ccc035c5cf47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:25.159625 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-4b7f80bd-251a-46ef-96ec-ccfbf065a3da tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] Getting quotas for project 5ec7ef57e7bf48568170e6afb53efdb0. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:00:25.171769 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-4b7f80bd-251a-46ef-96ec-ccfbf065a3da tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] Getting quotas for user 08279c461cd34088be9bb71f59cf393f and project 5ec7ef57e7bf48568170e6afb53efdb0. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:00:25.177308 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f662e119-1193-42fd-b2b1-95bba69e84e2 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4" status: 200 len: 1520 microversion: 2.1 time: 1.106659 Aug 31 16:00:25.179542 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1267/2619] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:24 2022] GET /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4 => generated 1520 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:25.208483 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b09c1005-38f0-4bf6-9a6b-beb4f9353ce7 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:25.210327 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b09c1005-38f0-4bf6-9a6b-beb4f9353ce7 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 9fd5b244-b9b6-4901-8b2f-0454d800d6b4] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:25.210810 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4b7f80bd-251a-46ef-96ec-ccfbf065a3da tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.124012 Aug 31 16:00:25.212113 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1353/2620] 10.222.0.50 () {62 vars in 1199 bytes} [Wed Aug 31 16:00:25 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 126 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 31 16:00:25.247271 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d750e5b7-40b0-4e3c-a57a-ef08d69e08b5 tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] Calling method '.version_select at 0x7fbb461ee5e0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:25.249334 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b09c1005-38f0-4bf6-9a6b-beb4f9353ce7 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:25.251388 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b09c1005-38f0-4bf6-9a6b-beb4f9353ce7 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:25.252990 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b09c1005-38f0-4bf6-9a6b-beb4f9353ce7 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:25.260319 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b09c1005-38f0-4bf6-9a6b-beb4f9353ce7 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:25.261542 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b09c1005-38f0-4bf6-9a6b-beb4f9353ce7 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:25.264731 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b09c1005-38f0-4bf6-9a6b-beb4f9353ce7 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:25.271286 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d750e5b7-40b0-4e3c-a57a-ef08d69e08b5 tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] 10.222.0.50 "GET /compute/v2.1/os-keypairs/tempest-keypair-1869987709" status: 200 len: 513 microversion: 2.2 time: 0.036877 Aug 31 16:00:25.273062 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1354/2621] 10.222.0.50 () {60 vars in 1258 bytes} [Wed Aug 31 16:00:25 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1869987709 => generated 513 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:00:25.289395 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8671f08e-1408-4a60-a173-fb521fac3728 tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] Calling method '.version_select at 0x7fbb467e0d30>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:25.321084 n-d-833090-16 devstack@n-api.service[128864]: WARNING oslo_db.sqlalchemy.utils [None req-8671f08e-1408-4a60-a173-fb521fac3728 tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 31 16:00:25.347369 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8671f08e-1408-4a60-a173-fb521fac3728 tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] 10.222.0.50 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.066087 Aug 31 16:00:25.350791 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1355/2622] 10.222.0.50 () {60 vars in 1177 bytes} [Wed Aug 31 16:00:25 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:00:25.375072 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f7cd5841-b544-42b9-8916-5fc4de9b357d tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] Calling method '.version_select at 0x7fbb468640d0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:25.393953 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b09c1005-38f0-4bf6-9a6b-beb4f9353ce7 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 9fd5b244-b9b6-4901-8b2f-0454d800d6b4] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:00:25.464019 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f7cd5841-b544-42b9-8916-5fc4de9b357d tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1869987709" status: 204 len: 0 microversion: 2.2 time: 0.108588 Aug 31 16:00:25.475533 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1356/2623] 10.222.0.50 () {60 vars in 1261 bytes} [Wed Aug 31 16:00:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1869987709 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:00:25.501431 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ba6bbcc1-bc2b-447c-aaf2-49b34898c8de tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] Action: 'create', calling method: .version_select at 0x7fbb46aaa790>, body: {"keypair": {"name": "tempest-keypair-948256538", "type": "x509"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:25.584468 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-ba6bbcc1-bc2b-447c-aaf2-49b34898c8de tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] Getting quotas for project 5ec7ef57e7bf48568170e6afb53efdb0. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:00:25.595577 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-ba6bbcc1-bc2b-447c-aaf2-49b34898c8de tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] Getting quotas for user 08279c461cd34088be9bb71f59cf393f and project 5ec7ef57e7bf48568170e6afb53efdb0. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:00:25.622258 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.processutils [None req-ba6bbcc1-bc2b-447c-aaf2-49b34898c8de tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmps2gdn08m/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmps2gdn08m/temp.key -subj /CN=08279c461cd34088be9bb71f59cf393f -extensions v3_req_client {{(pid=128864) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 31 16:00:25.769965 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b09c1005-38f0-4bf6-9a6b-beb4f9353ce7 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "DELETE /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4" status: 204 len: 0 microversion: 2.1 time: 0.571835 Aug 31 16:00:25.774860 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1268/2624] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:00:25 2022] DELETE /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 16:00:25.784825 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-00c7188a-9305-4003-80fd-4c113a5ce344 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:25.788625 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-00c7188a-9305-4003-80fd-4c113a5ce344 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 9fd5b244-b9b6-4901-8b2f-0454d800d6b4] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:25.843817 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00c7188a-9305-4003-80fd-4c113a5ce344 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:25.853938 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00c7188a-9305-4003-80fd-4c113a5ce344 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:25.864350 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00c7188a-9305-4003-80fd-4c113a5ce344 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:25.868029 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00c7188a-9305-4003-80fd-4c113a5ce344 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:25.875205 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00c7188a-9305-4003-80fd-4c113a5ce344 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:25.880226 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00c7188a-9305-4003-80fd-4c113a5ce344 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:25.956817 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:00:26.588029 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.processutils [None req-ba6bbcc1-bc2b-447c-aaf2-49b34898c8de tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmps2gdn08m/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmps2gdn08m/temp.key -subj /CN=08279c461cd34088be9bb71f59cf393f -extensions v3_req_client" returned: 0 in 0.965s {{(pid=128864) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 31 16:00:26.590968 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.processutils [None req-ba6bbcc1-bc2b-447c-aaf2-49b34898c8de tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmps2gdn08m/temp.key -password pass: {{(pid=128864) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 31 16:00:26.631368 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-00c7188a-9305-4003-80fd-4c113a5ce344 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8476b6167a4c838eac59d7c4a40284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a7c84a4ea54074bab3ccc035c5cf47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:26.639752 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-00c7188a-9305-4003-80fd-4c113a5ce344 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4" status: 200 len: 1526 microversion: 2.1 time: 0.859879 Aug 31 16:00:26.660306 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1269/2625] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:25 2022] GET /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4 => generated 1526 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:00:26.674933 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.processutils [None req-ba6bbcc1-bc2b-447c-aaf2-49b34898c8de tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] CMD "openssl pkcs12 -export -inkey /tmp/tmps2gdn08m/temp.key -password pass:" returned: 0 in 0.083s {{(pid=128864) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 31 16:00:26.687492 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c4268dee-76c3-436b-81a4-090adf99a430 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:26.689381 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c4268dee-76c3-436b-81a4-090adf99a430 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:26.728881 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4268dee-76c3-436b-81a4-090adf99a430 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:26.730117 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4268dee-76c3-436b-81a4-090adf99a430 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:26.733445 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4268dee-76c3-436b-81a4-090adf99a430 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:26.734729 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4268dee-76c3-436b-81a4-090adf99a430 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:26.736097 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4268dee-76c3-436b-81a4-090adf99a430 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:26.739138 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4268dee-76c3-436b-81a4-090adf99a430 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:26.768316 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-ba6bbcc1-bc2b-447c-aaf2-49b34898c8de tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] Getting quotas for project 5ec7ef57e7bf48568170e6afb53efdb0. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:00:26.787152 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-ba6bbcc1-bc2b-447c-aaf2-49b34898c8de tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] Getting quotas for user 08279c461cd34088be9bb71f59cf393f and project 5ec7ef57e7bf48568170e6afb53efdb0. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:00:26.866718 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ba6bbcc1-bc2b-447c-aaf2-49b34898c8de tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 1.383154 Aug 31 16:00:26.873830 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1357/2626] 10.222.0.50 () {62 vars in 1198 bytes} [Wed Aug 31 16:00:25 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 1392 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:00:26.883028 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a716ba79-15d1-471c-8e63-8e3d65a1fdef tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] Calling method '.version_select at 0x7fbb4ac89a60>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:26.898179 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a716ba79-15d1-471c-8e63-8e3d65a1fdef tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] 10.222.0.50 "GET /compute/v2.1/os-keypairs/tempest-keypair-948256538" status: 200 len: 1533 microversion: 2.2 time: 0.021955 Aug 31 16:00:26.906724 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1358/2627] 10.222.0.50 () {60 vars in 1255 bytes} [Wed Aug 31 16:00:26 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-948256538 => generated 1533 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:26.914597 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5712910b-f9a6-4bb4-9cf0-c9b9d6a32638 tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] Calling method '.version_select at 0x7fbb4ac57c10>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:26.919408 n-d-833090-16 devstack@n-api.service[128864]: WARNING oslo_db.sqlalchemy.utils [None req-5712910b-f9a6-4bb4-9cf0-c9b9d6a32638 tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 31 16:00:26.926281 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5712910b-f9a6-4bb4-9cf0-c9b9d6a32638 tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] 10.222.0.50 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.017530 Aug 31 16:00:26.933437 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1359/2628] 10.222.0.50 () {60 vars in 1177 bytes} [Wed Aug 31 16:00:26 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:26.940038 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-bd9b049f-f1b1-49dc-8ba1-bb46c9cbb902 tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] Calling method '.version_select at 0x7fbb467889d0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:26.969074 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=5,nova_api:DELETE=4 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:00:26.982554 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-bd9b049f-f1b1-49dc-8ba1-bb46c9cbb902 tempest-KeyPairsV22TestJSON-194904138 tempest-KeyPairsV22TestJSON-194904138-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-948256538" status: 204 len: 0 microversion: 2.2 time: 0.046980 Aug 31 16:00:26.989290 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1360/2629] 10.222.0.50 () {60 vars in 1258 bytes} [Wed Aug 31 16:00:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-948256538 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:00:27.075452 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c4268dee-76c3-436b-81a4-090adf99a430 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:27.087180 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c4268dee-76c3-436b-81a4-090adf99a430 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:27.089898 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c4268dee-76c3-436b-81a4-090adf99a430 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:27.109187 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c4268dee-76c3-436b-81a4-090adf99a430 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1535 microversion: 2.91 time: 0.436932 Aug 31 16:00:27.124351 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1270/2630] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:26 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1535 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:27.643536 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-1ee314fb-8f61-43e2-af71-ee0f3de4fa92 req-23346aff-8882-427e-a311-11978bc6447d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fd5b244-b9b6-4901-8b2f-0454d800d6b4", "name": "network-vif-plugged", "status": "completed", "tag": "c2952a3a-e5d0-4c63-8874-7dc700de780f"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:27.660808 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-12cef2f8-0242-4711-a80d-caa389ab83f0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:27.661676 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-12cef2f8-0242-4711-a80d-caa389ab83f0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 9fd5b244-b9b6-4901-8b2f-0454d800d6b4] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:27.679818 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-1ee314fb-8f61-43e2-af71-ee0f3de4fa92 req-23346aff-8882-427e-a311-11978bc6447d service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:27.684295 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-1ee314fb-8f61-43e2-af71-ee0f3de4fa92 req-23346aff-8882-427e-a311-11978bc6447d service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:27.684964 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-1ee314fb-8f61-43e2-af71-ee0f3de4fa92 req-23346aff-8882-427e-a311-11978bc6447d service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:27.695265 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12cef2f8-0242-4711-a80d-caa389ab83f0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:27.704635 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12cef2f8-0242-4711-a80d-caa389ab83f0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:27.709473 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12cef2f8-0242-4711-a80d-caa389ab83f0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:27.718629 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12cef2f8-0242-4711-a80d-caa389ab83f0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:27.730723 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12cef2f8-0242-4711-a80d-caa389ab83f0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:27.731177 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-1ee314fb-8f61-43e2-af71-ee0f3de4fa92 req-23346aff-8882-427e-a311-11978bc6447d service nova] Creating event network-vif-plugged:c2952a3a-e5d0-4c63-8874-7dc700de780f for instance 9fd5b244-b9b6-4901-8b2f-0454d800d6b4 on n-h2-833090-16 Aug 31 16:00:27.731533 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12cef2f8-0242-4711-a80d-caa389ab83f0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:27.753914 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-1ee314fb-8f61-43e2-af71-ee0f3de4fa92 req-23346aff-8882-427e-a311-11978bc6447d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110153 Aug 31 16:00:27.754734 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1361/2631] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:00:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:00:28.146269 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3d054394-63a4-498e-be08-612e05bc8f65 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:28.146577 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3d054394-63a4-498e-be08-612e05bc8f65 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:28.163236 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3d054394-63a4-498e-be08-612e05bc8f65 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:28.166169 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3d054394-63a4-498e-be08-612e05bc8f65 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:28.166303 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-12cef2f8-0242-4711-a80d-caa389ab83f0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8476b6167a4c838eac59d7c4a40284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a7c84a4ea54074bab3ccc035c5cf47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:28.166782 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3d054394-63a4-498e-be08-612e05bc8f65 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:28.169948 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3d054394-63a4-498e-be08-612e05bc8f65 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:28.170151 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3d054394-63a4-498e-be08-612e05bc8f65 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:28.172608 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3d054394-63a4-498e-be08-612e05bc8f65 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:28.175040 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-12cef2f8-0242-4711-a80d-caa389ab83f0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4" status: 200 len: 1526 microversion: 2.1 time: 0.517997 Aug 31 16:00:28.182942 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1271/2632] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:27 2022] GET /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4 => generated 1526 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:00:28.332499 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3d054394-63a4-498e-be08-612e05bc8f65 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:28.345904 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3d054394-63a4-498e-be08-612e05bc8f65 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:28.354746 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3d054394-63a4-498e-be08-612e05bc8f65 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:28.375477 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3d054394-63a4-498e-be08-612e05bc8f65 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1535 microversion: 2.91 time: 0.232439 Aug 31 16:00:28.377982 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1362/2633] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:28 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1535 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:29.209108 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9b002639-f3a1-4e09-8428-66602550f9d0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:29.210385 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9b002639-f3a1-4e09-8428-66602550f9d0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 9fd5b244-b9b6-4901-8b2f-0454d800d6b4] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:29.224594 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b002639-f3a1-4e09-8428-66602550f9d0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:29.225589 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b002639-f3a1-4e09-8428-66602550f9d0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:29.227791 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b002639-f3a1-4e09-8428-66602550f9d0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:29.228884 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b002639-f3a1-4e09-8428-66602550f9d0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:29.231087 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b002639-f3a1-4e09-8428-66602550f9d0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:29.232093 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b002639-f3a1-4e09-8428-66602550f9d0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:29.649752 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e3da55f2-4f64-4366-84f3-c7db4c346e24 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-770247855", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "39370b19-7cbc-4e21-9ace-fa993a5e662f"}]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:29.793781 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-e3da55f2-4f64-4366-84f3-c7db4c346e24 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] validate_networks() for [('39370b19-7cbc-4e21-9ace-fa993a5e662f', None, None, None, None, None)] {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:00:30.699974 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9b002639-f3a1-4e09-8428-66602550f9d0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8476b6167a4c838eac59d7c4a40284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a7c84a4ea54074bab3ccc035c5cf47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:30.719579 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9b002639-f3a1-4e09-8428-66602550f9d0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4" status: 200 len: 1526 microversion: 2.1 time: 1.514205 Aug 31 16:00:30.739902 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1272/2634] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:29 2022] GET /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4 => generated 1526 bytes in 1534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:30.763382 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-78e52877-3e56-4d9b-bba2-e24d08f89aef tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:30.764427 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-78e52877-3e56-4d9b-bba2-e24d08f89aef tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:30.799604 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78e52877-3e56-4d9b-bba2-e24d08f89aef tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:30.804284 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78e52877-3e56-4d9b-bba2-e24d08f89aef tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:30.814546 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78e52877-3e56-4d9b-bba2-e24d08f89aef tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:30.816000 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78e52877-3e56-4d9b-bba2-e24d08f89aef tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:30.816699 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78e52877-3e56-4d9b-bba2-e24d08f89aef tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:30.817367 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78e52877-3e56-4d9b-bba2-e24d08f89aef tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:31.578340 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-78e52877-3e56-4d9b-bba2-e24d08f89aef tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:31.591634 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-78e52877-3e56-4d9b-bba2-e24d08f89aef tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:31.597545 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-78e52877-3e56-4d9b-bba2-e24d08f89aef tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:31.612208 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-78e52877-3e56-4d9b-bba2-e24d08f89aef tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1478 microversion: 2.91 time: 0.868948 Aug 31 16:00:31.613981 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1273/2635] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:30 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1478 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:31.639453 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-aabf1257-a9e6-4043-a1b4-52f462aa565a req-edc94f79-61ca-4dc2-80ad-4a1129dacfd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b", "name": "network-vif-plugged", "status": "completed", "tag": "4e98deab-3424-49ec-b930-3019d71c32c7"}, {"server_uuid": "9fd5b244-b9b6-4901-8b2f-0454d800d6b4", "name": "network-vif-unplugged", "status": "completed", "tag": "c2952a3a-e5d0-4c63-8874-7dc700de780f"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:31.660946 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-aabf1257-a9e6-4043-a1b4-52f462aa565a req-edc94f79-61ca-4dc2-80ad-4a1129dacfd0 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:31.661426 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-aabf1257-a9e6-4043-a1b4-52f462aa565a req-edc94f79-61ca-4dc2-80ad-4a1129dacfd0 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:31.661854 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-aabf1257-a9e6-4043-a1b4-52f462aa565a req-edc94f79-61ca-4dc2-80ad-4a1129dacfd0 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:31.700498 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-aabf1257-a9e6-4043-a1b4-52f462aa565a req-edc94f79-61ca-4dc2-80ad-4a1129dacfd0 service nova] Creating event network-vif-plugged:4e98deab-3424-49ec-b930-3019d71c32c7 for instance 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b on n-h1-833090-16 Aug 31 16:00:31.703316 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-aabf1257-a9e6-4043-a1b4-52f462aa565a req-edc94f79-61ca-4dc2-80ad-4a1129dacfd0 service nova] Creating event network-vif-unplugged:c2952a3a-e5d0-4c63-8874-7dc700de780f for instance 9fd5b244-b9b6-4901-8b2f-0454d800d6b4 on n-h2-833090-16 Aug 31 16:00:31.741406 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-aabf1257-a9e6-4043-a1b4-52f462aa565a req-edc94f79-61ca-4dc2-80ad-4a1129dacfd0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.116547 Aug 31 16:00:31.742118 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1274/2636] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:00:31 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:00:31.765205 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-7ae7b061-ec8e-4af2-b9b4-216fba4b3155 req-911d5798-0d8d-4f97-bb6f-db080e938e89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fd5b244-b9b6-4901-8b2f-0454d800d6b4", "name": "network-vif-deleted", "tag": "c2952a3a-e5d0-4c63-8874-7dc700de780f"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:31.802328 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7ae7b061-ec8e-4af2-b9b4-216fba4b3155 req-911d5798-0d8d-4f97-bb6f-db080e938e89 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:31.803722 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7ae7b061-ec8e-4af2-b9b4-216fba4b3155 req-911d5798-0d8d-4f97-bb6f-db080e938e89 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:31.805849 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7ae7b061-ec8e-4af2-b9b4-216fba4b3155 req-911d5798-0d8d-4f97-bb6f-db080e938e89 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:31.867558 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-7ae7b061-ec8e-4af2-b9b4-216fba4b3155 req-911d5798-0d8d-4f97-bb6f-db080e938e89 service nova] Creating event network-vif-deleted:c2952a3a-e5d0-4c63-8874-7dc700de780f for instance 9fd5b244-b9b6-4901-8b2f-0454d800d6b4 on n-h2-833090-16 Aug 31 16:00:31.879611 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-7ae7b061-ec8e-4af2-b9b4-216fba4b3155 req-911d5798-0d8d-4f97-bb6f-db080e938e89 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131323 Aug 31 16:00:31.882255 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1275/2637] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:00:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:00:31.896458 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b0df1627-2dff-4e7b-ba4d-93665136607c tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-833090-16"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:31.917074 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b0df1627-2dff-4e7b-ba4d-93665136607c tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:31.940769 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0df1627-2dff-4e7b-ba4d-93665136607c tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:31.949104 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0df1627-2dff-4e7b-ba4d-93665136607c tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:31.954753 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0df1627-2dff-4e7b-ba4d-93665136607c tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:31.957048 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0df1627-2dff-4e7b-ba4d-93665136607c tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:31.957680 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0df1627-2dff-4e7b-ba4d-93665136607c tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:31.958300 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0df1627-2dff-4e7b-ba4d-93665136607c tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:32.429967 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-e3da55f2-4f64-4366-84f3-c7db4c346e24 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:00:32.430532 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-e3da55f2-4f64-4366-84f3-c7db4c346e24 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:00:32.430986 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-e3da55f2-4f64-4366-84f3-c7db4c346e24 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:00:32.431562 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-e3da55f2-4f64-4366-84f3-c7db4c346e24 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:00:32.432199 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-e3da55f2-4f64-4366-84f3-c7db4c346e24 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:00:32.452966 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e3da55f2-4f64-4366-84f3-c7db4c346e24 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:32.466823 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e3da55f2-4f64-4366-84f3-c7db4c346e24 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:32.467316 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e3da55f2-4f64-4366-84f3-c7db4c346e24 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:32.468251 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e3da55f2-4f64-4366-84f3-c7db4c346e24 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:32.468743 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e3da55f2-4f64-4366-84f3-c7db4c346e24 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:32.469178 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e3da55f2-4f64-4366-84f3-c7db4c346e24 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:32.555242 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-e3da55f2-4f64-4366-84f3-c7db4c346e24 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Getting quotas for project 1355779c2e2d4cfeb0825b76968867b1. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:00:32.577955 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-e3da55f2-4f64-4366-84f3-c7db4c346e24 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Getting quotas for user b9840c71c4ec49c1a60ef97943d173ef and project 1355779c2e2d4cfeb0825b76968867b1. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:00:32.641211 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e3da55f2-4f64-4366-84f3-c7db4c346e24 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:00:32.649736 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e3da55f2-4f64-4366-84f3-c7db4c346e24 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 8701d926-4a72-483d-b0a3-57d8ee5f50c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:00:32.710143 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b0df1627-2dff-4e7b-ba4d-93665136607c tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-833090-16". {{(pid=128863) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 16:00:32.852451 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b0df1627-2dff-4e7b-ba4d-93665136607c tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78/action" status: 202 len: 0 microversion: 2.91 time: 0.967286 Aug 31 16:00:32.857946 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1276/2638] 10.222.0.50 () {62 vars in 1319 bytes} [Wed Aug 31 16:00:31 2022] POST /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78/action => generated 0 bytes in 974 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:00:32.893258 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e3da55f2-4f64-4366-84f3-c7db4c346e24 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.522542 Aug 31 16:00:32.901736 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0ec2029b-738b-4b4a-bf26-ebf33254ec3f tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:32.906125 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1363/2639] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:00:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 3551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 16:00:32.911379 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6a001203-9196-4e65-8594-257bcf0f43bb tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:32.911644 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6a001203-9196-4e65-8594-257bcf0f43bb tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 11bf6774-dc05-481c-a9f9-29c2ebd4531f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:32.912878 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0ec2029b-738b-4b4a-bf26-ebf33254ec3f tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 9fd5b244-b9b6-4901-8b2f-0454d800d6b4] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:32.959400 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ec2029b-738b-4b4a-bf26-ebf33254ec3f tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:32.960033 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ec2029b-738b-4b4a-bf26-ebf33254ec3f tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:32.960487 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ec2029b-738b-4b4a-bf26-ebf33254ec3f tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:32.976152 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ec2029b-738b-4b4a-bf26-ebf33254ec3f tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:32.976824 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ec2029b-738b-4b4a-bf26-ebf33254ec3f tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:32.977707 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ec2029b-738b-4b4a-bf26-ebf33254ec3f tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:32.989522 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6a001203-9196-4e65-8594-257bcf0f43bb tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:32.993169 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6a001203-9196-4e65-8594-257bcf0f43bb tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:32.993942 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6a001203-9196-4e65-8594-257bcf0f43bb tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:32.997865 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6a001203-9196-4e65-8594-257bcf0f43bb tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:32.998410 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6a001203-9196-4e65-8594-257bcf0f43bb tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:32.998763 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6a001203-9196-4e65-8594-257bcf0f43bb tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:33.062891 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-0ec2029b-738b-4b4a-bf26-ebf33254ec3f tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] HTTP exception thrown: Instance 9fd5b244-b9b6-4901-8b2f-0454d800d6b4 could not be found. Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0ec2029b-738b-4b4a-bf26-ebf33254ec3f tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Request method failure captured: Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4 HTTP/1.1 Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4VuegaF_fmy46ih3aH48SHyk9S0K5f6VgFr4AjCz2qlep55514N16M8NDogA4-FaRt5exvJysgb4a16NCF-uwnoFVaAwgVvS87_klTsI4Q1cOt4rcQPW4Ao3jepMn1MxMfgCP9op9_ywmQywVzBp5itFLK6pFxwsw-bP4gtv8ayT6Y Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 75a7c84a4ea54074bab3ccc035c5cf47 Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2143463755 Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/75a7c84a4ea54074bab3ccc035c5cf47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/75a7c84a4ea54074bab3ccc035c5cf47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/75a7c84a4ea54074bab3ccc035c5cf47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_75a7c84a4ea54074bab3ccc035c5cf47", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2143463755 Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 75a7c84a4ea54074bab3ccc035c5cf47 Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2143463755 Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ImagesOneServerNegativeTestJSON-2143463755-project Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 3c8476b6167a4c838eac59d7c4a40284 Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2143463755-project Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 9fd5b244-b9b6-4901-8b2f-0454d800d6b4 could not be found. Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '9fd5b244-b9b6-4901-8b2f-0454d800d6b4'} Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fd5b244-b9b6-4901-8b2f-0454d800d6b4 could not be found. Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fd5b244-b9b6-4901-8b2f-0454d800d6b4 could not be found. Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:33.080548 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:33.085235 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:33.085235 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:33.085235 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:33.085235 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:33.085235 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:00:33.085235 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:00:33.085235 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fd5b244-b9b6-4901-8b2f-0454d800d6b4 could not be found. Aug 31 16:00:33.085235 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:33.090281 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0ec2029b-738b-4b4a-bf26-ebf33254ec3f tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Returning 404 to user: Instance 9fd5b244-b9b6-4901-8b2f-0454d800d6b4 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:33.092247 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0ec2029b-738b-4b4a-bf26-ebf33254ec3f tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4" status: 404 len: 111 microversion: 2.1 time: 0.232904 Aug 31 16:00:33.095447 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-6a001203-9196-4e65-8594-257bcf0f43bb tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] HTTP exception thrown: Instance 11bf6774-dc05-481c-a9f9-29c2ebd4531f could not be found. Aug 31 16:00:33.098843 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1277/2640] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:32 2022] GET /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4 => generated 111 bytes in 238 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:00:33.115681 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6a001203-9196-4e65-8594-257bcf0f43bb tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Request method failure captured: Aug 31 16:00:33.115681 n-d-833090-16 devstack@n-api.service[128864]: request: DELETE /compute/v2.1/servers/11bf6774-dc05-481c-a9f9-29c2ebd4531f HTTP/1.1 Aug 31 16:00:33.115681 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:00:33.115681 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:00:33.115681 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:00:33.115681 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:00:33.115681 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:00:33.115681 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:00:33.115681 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:00:33.115681 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:33.115681 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4Q2UxjmzRUIcRyBJZeRXZe8f-kxARGQrfLNadx-PtSKRAHFDd-cfjpN41Lm2TAtWQQVK9trDHJa1Iu7P1XlF1-EYrtrhJnDHGb-ivhI0erITWpZsYkLGmnwPDtbMbW99ld2jucgWFbVY0vVDf-y4OAM7Az1owqOg13oLERSA9bN0MQ Aug 31 16:00:33.115681 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:00:33.115681 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:00:33.115681 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:00:33.115681 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:00:33.115681 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:00:33.115681 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:00:33.115681 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: dde27d282fc24e56a62eaeacff1431d5 Aug 31 16:00:33.115681 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-DeleteServersTestJSON-1135653165 Aug 31 16:00:33.115681 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:00:33.115681 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:00:33.115681 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_dde27d282fc24e56a62eaeacff1431d5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:00:33.115681 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-DeleteServersTestJSON-1135653165 Aug 31 16:00:33.115681 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: dde27d282fc24e56a62eaeacff1431d5 Aug 31 16:00:33.115681 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-DeleteServersTestJSON-1135653165 Aug 31 16:00:33.115681 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-DeleteServersTestJSON-1135653165-project Aug 31 16:00:33.115681 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:00:33.115681 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:00:33.115681 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 4d4f2146c3bc4a64b5d7f72cd136b6db Aug 31 16:00:33.115681 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-DeleteServersTestJSON-1135653165-project Aug 31 16:00:33.115681 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:00:33.115681 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 11bf6774-dc05-481c-a9f9-29c2ebd4531f could not be found. Aug 31 16:00:33.115681 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '11bf6774-dc05-481c-a9f9-29c2ebd4531f'} Aug 31 16:00:33.115681 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:33.115681 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:33.115681 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:00:33.115681 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:00:33.115681 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:00:33.115681 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:00:33.115681 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:00:33.115681 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:00:33.115681 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:00:33.115681 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:00:33.115681 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11bf6774-dc05-481c-a9f9-29c2ebd4531f could not be found. Aug 31 16:00:33.115681 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:00:33.115681 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:33.115681 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:00:33.115681 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:33.115681 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:33.115681 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:33.115681 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:33.115681 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:33.115681 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:33.115681 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:33.115681 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:00:33.115681 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:00:33.115681 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:00:33.115681 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:00:33.115681 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:00:33.115681 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:00:33.115681 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:00:33.115681 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:00:33.121045 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11bf6774-dc05-481c-a9f9-29c2ebd4531f could not be found. Aug 31 16:00:33.121045 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:00:33.121045 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:33.121045 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:00:33.121045 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:33.121045 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:33.121045 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:33.121045 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:00:33.121045 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:00:33.121045 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11bf6774-dc05-481c-a9f9-29c2ebd4531f could not be found. Aug 31 16:00:33.121045 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:00:33.127178 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6a001203-9196-4e65-8594-257bcf0f43bb tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Returning 404 to user: Instance 11bf6774-dc05-481c-a9f9-29c2ebd4531f could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:33.134414 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6a001203-9196-4e65-8594-257bcf0f43bb tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "DELETE /compute/v2.1/servers/11bf6774-dc05-481c-a9f9-29c2ebd4531f" status: 404 len: 111 microversion: 2.1 time: 0.222845 Aug 31 16:00:33.136897 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1364/2641] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:00:32 2022] DELETE /compute/v2.1/servers/11bf6774-dc05-481c-a9f9-29c2ebd4531f => generated 111 bytes in 230 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:00:33.141785 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1c75f06d-113d-46dc-a748-088241752689 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:33.151939 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1c75f06d-113d-46dc-a748-088241752689 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:33.170737 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6dc6f330-e793-4be9-b46b-65d98c718050 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:33.171455 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6dc6f330-e793-4be9-b46b-65d98c718050 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 8701d926-4a72-483d-b0a3-57d8ee5f50c8] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:33.178232 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c75f06d-113d-46dc-a748-088241752689 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:33.180508 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c75f06d-113d-46dc-a748-088241752689 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:33.185625 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c75f06d-113d-46dc-a748-088241752689 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:33.190030 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c75f06d-113d-46dc-a748-088241752689 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:33.193017 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c75f06d-113d-46dc-a748-088241752689 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:33.195757 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c75f06d-113d-46dc-a748-088241752689 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:33.363510 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6dc6f330-e793-4be9-b46b-65d98c718050 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:33.383971 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6dc6f330-e793-4be9-b46b-65d98c718050 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8" status: 200 len: 1210 microversion: 2.1 time: 0.237398 Aug 31 16:00:33.399668 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1365/2642] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:33 2022] GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8 => generated 1210 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:33.419691 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-44193e46-fc40-49e0-af25-22d318976034 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Action: 'create', calling method: .version_select at 0x7fbb4ac893a0>, body: {"keypair": {"name": "tempest-keypair-1563122384", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKhWwsXDpU+ej8rjU+le/5bZeS8vgI9erIyV30JPRxd+yxY3Bl122mkz7RuNie2PhnUKZGBpD1EM4QvvHM/L4A8v23mC+uih0Pv8xPrw8/S4moBFou1hYxLLWuArGFEvQ=="}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:33.450875 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=8 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:00:33.480604 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-44193e46-fc40-49e0-af25-22d318976034 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Getting quotas for project 75a7c84a4ea54074bab3ccc035c5cf47. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:00:33.495888 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1c75f06d-113d-46dc-a748-088241752689 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:33.504610 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-44193e46-fc40-49e0-af25-22d318976034 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Getting quotas for user 3c8476b6167a4c838eac59d7c4a40284 and project 75a7c84a4ea54074bab3ccc035c5cf47. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:00:33.517704 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1c75f06d-113d-46dc-a748-088241752689 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:33.521396 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1c75f06d-113d-46dc-a748-088241752689 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:33.553954 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1c75f06d-113d-46dc-a748-088241752689 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1486 microversion: 2.91 time: 0.453661 Aug 31 16:00:33.555037 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1278/2643] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:33 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1486 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:33.577833 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a47e431d-b913-4869-8ebb-d581bb04b695 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:33.581854 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a47e431d-b913-4869-8ebb-d581bb04b695 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: 11bf6774-dc05-481c-a9f9-29c2ebd4531f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:33.587267 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-44193e46-fc40-49e0-af25-22d318976034 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.186378 Aug 31 16:00:33.588776 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1366/2644] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 31 16:00:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:00:33.614637 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a47e431d-b913-4869-8ebb-d581bb04b695 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:33.615638 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a47e431d-b913-4869-8ebb-d581bb04b695 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:33.616073 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a47e431d-b913-4869-8ebb-d581bb04b695 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:33.621036 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a47e431d-b913-4869-8ebb-d581bb04b695 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:33.621637 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a47e431d-b913-4869-8ebb-d581bb04b695 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:33.622086 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a47e431d-b913-4869-8ebb-d581bb04b695 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:33.655621 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-a47e431d-b913-4869-8ebb-d581bb04b695 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] HTTP exception thrown: Instance 11bf6774-dc05-481c-a9f9-29c2ebd4531f could not be found. Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a47e431d-b913-4869-8ebb-d581bb04b695 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Request method failure captured: Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/11bf6774-dc05-481c-a9f9-29c2ebd4531f HTTP/1.1 Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4Q2UxjmzRUIcRyBJZeRXZe8f-kxARGQrfLNadx-PtSKRAHFDd-cfjpN41Lm2TAtWQQVK9trDHJa1Iu7P1XlF1-EYrtrhJnDHGb-ivhI0erITWpZsYkLGmnwPDtbMbW99ld2jucgWFbVY0vVDf-y4OAM7Az1owqOg13oLERSA9bN0MQ Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: dde27d282fc24e56a62eaeacff1431d5 Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-DeleteServersTestJSON-1135653165 Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_dde27d282fc24e56a62eaeacff1431d5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-DeleteServersTestJSON-1135653165 Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: dde27d282fc24e56a62eaeacff1431d5 Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-DeleteServersTestJSON-1135653165 Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-DeleteServersTestJSON-1135653165-project Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 4d4f2146c3bc4a64b5d7f72cd136b6db Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-DeleteServersTestJSON-1135653165-project Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 11bf6774-dc05-481c-a9f9-29c2ebd4531f could not be found. Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '11bf6774-dc05-481c-a9f9-29c2ebd4531f'} Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11bf6774-dc05-481c-a9f9-29c2ebd4531f could not be found. Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11bf6774-dc05-481c-a9f9-29c2ebd4531f could not be found. Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:33.665591 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:33.670380 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:33.670380 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:33.670380 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:33.670380 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:00:33.670380 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:00:33.670380 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11bf6774-dc05-481c-a9f9-29c2ebd4531f could not be found. Aug 31 16:00:33.670380 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:33.673216 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a47e431d-b913-4869-8ebb-d581bb04b695 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Returning 404 to user: Instance 11bf6774-dc05-481c-a9f9-29c2ebd4531f could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:33.675999 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a47e431d-b913-4869-8ebb-d581bb04b695 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/11bf6774-dc05-481c-a9f9-29c2ebd4531f" status: 404 len: 111 microversion: 2.1 time: 0.113390 Aug 31 16:00:33.686882 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-29018e65-3185-4ad6-b3d1-f309f5586736 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:33.688151 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-29018e65-3185-4ad6-b3d1-f309f5586736 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: a8003433-1952-4dca-9b3d-43c41d2b70f5] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:33.694870 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1279/2645] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:33 2022] GET /compute/v2.1/servers/11bf6774-dc05-481c-a9f9-29c2ebd4531f => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:00:33.700944 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-29018e65-3185-4ad6-b3d1-f309f5586736 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:33.703961 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-29018e65-3185-4ad6-b3d1-f309f5586736 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:33.704624 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-29018e65-3185-4ad6-b3d1-f309f5586736 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:33.706708 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-29018e65-3185-4ad6-b3d1-f309f5586736 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:33.711592 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-29018e65-3185-4ad6-b3d1-f309f5586736 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:33.713739 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-29018e65-3185-4ad6-b3d1-f309f5586736 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:33.786788 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-29018e65-3185-4ad6-b3d1-f309f5586736 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] HTTP exception thrown: Instance a8003433-1952-4dca-9b3d-43c41d2b70f5 could not be found. Aug 31 16:00:33.794789 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-29018e65-3185-4ad6-b3d1-f309f5586736 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Request method failure captured: Aug 31 16:00:33.794789 n-d-833090-16 devstack@n-api.service[128864]: request: DELETE /compute/v2.1/servers/a8003433-1952-4dca-9b3d-43c41d2b70f5 HTTP/1.1 Aug 31 16:00:33.794789 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:00:33.794789 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:00:33.794789 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:00:33.794789 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:00:33.794789 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:00:33.794789 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:00:33.794789 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:00:33.794789 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:33.794789 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4Q2UxjmzRUIcRyBJZeRXZe8f-kxARGQrfLNadx-PtSKRAHFDd-cfjpN41Lm2TAtWQQVK9trDHJa1Iu7P1XlF1-EYrtrhJnDHGb-ivhI0erITWpZsYkLGmnwPDtbMbW99ld2jucgWFbVY0vVDf-y4OAM7Az1owqOg13oLERSA9bN0MQ Aug 31 16:00:33.794789 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:00:33.794789 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:00:33.794789 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:00:33.794789 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:00:33.794789 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:00:33.794789 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:00:33.794789 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: dde27d282fc24e56a62eaeacff1431d5 Aug 31 16:00:33.794789 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-DeleteServersTestJSON-1135653165 Aug 31 16:00:33.794789 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:00:33.794789 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:00:33.794789 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_dde27d282fc24e56a62eaeacff1431d5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:00:33.794789 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-DeleteServersTestJSON-1135653165 Aug 31 16:00:33.794789 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: dde27d282fc24e56a62eaeacff1431d5 Aug 31 16:00:33.794789 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-DeleteServersTestJSON-1135653165 Aug 31 16:00:33.794789 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-DeleteServersTestJSON-1135653165-project Aug 31 16:00:33.794789 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:00:33.794789 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:00:33.794789 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 4d4f2146c3bc4a64b5d7f72cd136b6db Aug 31 16:00:33.794789 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-DeleteServersTestJSON-1135653165-project Aug 31 16:00:33.794789 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:00:33.794789 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance a8003433-1952-4dca-9b3d-43c41d2b70f5 could not be found. Aug 31 16:00:33.794789 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'a8003433-1952-4dca-9b3d-43c41d2b70f5'} Aug 31 16:00:33.794789 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:33.794789 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:33.794789 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:00:33.794789 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:00:33.794789 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:00:33.794789 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:00:33.794789 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:00:33.794789 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:00:33.794789 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:00:33.794789 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:00:33.794789 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8003433-1952-4dca-9b3d-43c41d2b70f5 could not be found. Aug 31 16:00:33.794789 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:00:33.794789 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:33.794789 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:00:33.794789 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:33.794789 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:33.794789 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:33.794789 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:33.794789 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:33.794789 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:33.794789 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:33.794789 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:00:33.794789 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:00:33.794789 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:00:33.794789 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:00:33.794789 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:00:33.794789 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:00:33.794789 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:00:33.794789 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:00:33.799127 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8003433-1952-4dca-9b3d-43c41d2b70f5 could not be found. Aug 31 16:00:33.799127 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:00:33.799127 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:33.799127 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:00:33.799127 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:33.799127 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:33.799127 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:33.799127 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:00:33.799127 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:00:33.799127 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8003433-1952-4dca-9b3d-43c41d2b70f5 could not be found. Aug 31 16:00:33.799127 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:00:33.799127 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-29018e65-3185-4ad6-b3d1-f309f5586736 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Returning 404 to user: Instance a8003433-1952-4dca-9b3d-43c41d2b70f5 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:33.799127 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-29018e65-3185-4ad6-b3d1-f309f5586736 tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a8003433-1952-4dca-9b3d-43c41d2b70f5" status: 404 len: 111 microversion: 2.1 time: 0.115301 Aug 31 16:00:33.806534 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2758e7af-2a4a-486f-ba62-c289bcf7066e tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:33.807209 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2758e7af-2a4a-486f-ba62-c289bcf7066e tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] [instance: a8003433-1952-4dca-9b3d-43c41d2b70f5] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:33.823022 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1367/2646] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:00:33 2022] DELETE /compute/v2.1/servers/a8003433-1952-4dca-9b3d-43c41d2b70f5 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:00:33.829670 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2758e7af-2a4a-486f-ba62-c289bcf7066e tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:33.830297 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2758e7af-2a4a-486f-ba62-c289bcf7066e tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:33.835311 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2758e7af-2a4a-486f-ba62-c289bcf7066e tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:33.840466 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2758e7af-2a4a-486f-ba62-c289bcf7066e tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:33.843018 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2758e7af-2a4a-486f-ba62-c289bcf7066e tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:33.843668 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2758e7af-2a4a-486f-ba62-c289bcf7066e tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:33.961751 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-2758e7af-2a4a-486f-ba62-c289bcf7066e tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] HTTP exception thrown: Instance a8003433-1952-4dca-9b3d-43c41d2b70f5 could not be found. Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2758e7af-2a4a-486f-ba62-c289bcf7066e tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Request method failure captured: Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/a8003433-1952-4dca-9b3d-43c41d2b70f5 HTTP/1.1 Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4Q2UxjmzRUIcRyBJZeRXZe8f-kxARGQrfLNadx-PtSKRAHFDd-cfjpN41Lm2TAtWQQVK9trDHJa1Iu7P1XlF1-EYrtrhJnDHGb-ivhI0erITWpZsYkLGmnwPDtbMbW99ld2jucgWFbVY0vVDf-y4OAM7Az1owqOg13oLERSA9bN0MQ Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: dde27d282fc24e56a62eaeacff1431d5 Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-DeleteServersTestJSON-1135653165 Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/dde27d282fc24e56a62eaeacff1431d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_dde27d282fc24e56a62eaeacff1431d5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-DeleteServersTestJSON-1135653165 Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: dde27d282fc24e56a62eaeacff1431d5 Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-DeleteServersTestJSON-1135653165 Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-DeleteServersTestJSON-1135653165-project Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 4d4f2146c3bc4a64b5d7f72cd136b6db Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-DeleteServersTestJSON-1135653165-project Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance a8003433-1952-4dca-9b3d-43c41d2b70f5 could not be found. Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'a8003433-1952-4dca-9b3d-43c41d2b70f5'} Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8003433-1952-4dca-9b3d-43c41d2b70f5 could not be found. Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8003433-1952-4dca-9b3d-43c41d2b70f5 could not be found. Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:00:33.966629 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:33.970548 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:00:33.970548 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:00:33.970548 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:00:33.970548 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:00:33.970548 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:00:33.970548 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8003433-1952-4dca-9b3d-43c41d2b70f5 could not be found. Aug 31 16:00:33.970548 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:00:33.978058 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2758e7af-2a4a-486f-ba62-c289bcf7066e tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] Returning 404 to user: Instance a8003433-1952-4dca-9b3d-43c41d2b70f5 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:00:33.980619 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2758e7af-2a4a-486f-ba62-c289bcf7066e tempest-DeleteServersTestJSON-1135653165 tempest-DeleteServersTestJSON-1135653165-project] 10.222.0.50 "GET /compute/v2.1/servers/a8003433-1952-4dca-9b3d-43c41d2b70f5" status: 404 len: 111 microversion: 2.1 time: 0.179452 Aug 31 16:00:33.985883 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1280/2647] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:33 2022] GET /compute/v2.1/servers/a8003433-1952-4dca-9b3d-43c41d2b70f5 => generated 111 bytes in 185 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:00:34.411698 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e05e1110-f37c-46bb-bea4-dcb23b8b8d45 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:34.412564 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e05e1110-f37c-46bb-bea4-dcb23b8b8d45 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 8701d926-4a72-483d-b0a3-57d8ee5f50c8] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:34.585796 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a19b53fe-871b-4572-b434-e11110d47935 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:34.586789 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a19b53fe-871b-4572-b434-e11110d47935 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:34.623003 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a19b53fe-871b-4572-b434-e11110d47935 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:34.625008 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a19b53fe-871b-4572-b434-e11110d47935 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:34.625684 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a19b53fe-871b-4572-b434-e11110d47935 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:34.627491 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a19b53fe-871b-4572-b434-e11110d47935 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:34.635525 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a19b53fe-871b-4572-b434-e11110d47935 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:34.636353 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a19b53fe-871b-4572-b434-e11110d47935 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:34.727308 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e05e1110-f37c-46bb-bea4-dcb23b8b8d45 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:34.761453 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e05e1110-f37c-46bb-bea4-dcb23b8b8d45 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8" status: 200 len: 1210 microversion: 2.1 time: 0.348813 Aug 31 16:00:34.763582 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1368/2648] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:34 2022] GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8 => generated 1210 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:34.980852 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a19b53fe-871b-4572-b434-e11110d47935 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:35.000148 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a19b53fe-871b-4572-b434-e11110d47935 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:35.008316 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a19b53fe-871b-4572-b434-e11110d47935 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:35.028155 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a19b53fe-871b-4572-b434-e11110d47935 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1488 microversion: 2.91 time: 0.446486 Aug 31 16:00:35.047134 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1281/2649] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:34 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1488 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:35.786735 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-bf02cdce-49bc-4b5d-82f1-7ae758129111 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:35.787944 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-bf02cdce-49bc-4b5d-82f1-7ae758129111 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 8701d926-4a72-483d-b0a3-57d8ee5f50c8] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:35.812048 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bf02cdce-49bc-4b5d-82f1-7ae758129111 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:35.813297 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bf02cdce-49bc-4b5d-82f1-7ae758129111 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:35.813901 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bf02cdce-49bc-4b5d-82f1-7ae758129111 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:35.814799 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bf02cdce-49bc-4b5d-82f1-7ae758129111 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:35.816112 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bf02cdce-49bc-4b5d-82f1-7ae758129111 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:35.816112 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bf02cdce-49bc-4b5d-82f1-7ae758129111 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:36.065055 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3a90777f-31cb-45d1-a12e-1e1fef41ce24 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:36.066549 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3a90777f-31cb-45d1-a12e-1e1fef41ce24 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:36.086266 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a90777f-31cb-45d1-a12e-1e1fef41ce24 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:36.088354 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a90777f-31cb-45d1-a12e-1e1fef41ce24 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:36.089196 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a90777f-31cb-45d1-a12e-1e1fef41ce24 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:36.091411 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a90777f-31cb-45d1-a12e-1e1fef41ce24 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:36.097557 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a90777f-31cb-45d1-a12e-1e1fef41ce24 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:36.098586 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a90777f-31cb-45d1-a12e-1e1fef41ce24 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:36.487381 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-bf02cdce-49bc-4b5d-82f1-7ae758129111 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:36.512852 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-bf02cdce-49bc-4b5d-82f1-7ae758129111 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8" status: 200 len: 1262 microversion: 2.1 time: 0.732400 Aug 31 16:00:36.517635 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1369/2650] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:35 2022] GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8 => generated 1262 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:36.696135 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3a90777f-31cb-45d1-a12e-1e1fef41ce24 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:36.708085 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3a90777f-31cb-45d1-a12e-1e1fef41ce24 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:36.712744 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3a90777f-31cb-45d1-a12e-1e1fef41ce24 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:36.766522 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3a90777f-31cb-45d1-a12e-1e1fef41ce24 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1544 microversion: 2.91 time: 0.708766 Aug 31 16:00:36.782713 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1282/2651] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:36 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1544 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:37.541487 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ac67c6cc-8e9e-4da7-ab59-1706d8b70937 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:37.542700 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ac67c6cc-8e9e-4da7-ab59-1706d8b70937 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 8701d926-4a72-483d-b0a3-57d8ee5f50c8] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:37.577210 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ac67c6cc-8e9e-4da7-ab59-1706d8b70937 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:37.577708 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ac67c6cc-8e9e-4da7-ab59-1706d8b70937 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:37.586542 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ac67c6cc-8e9e-4da7-ab59-1706d8b70937 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:37.587391 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ac67c6cc-8e9e-4da7-ab59-1706d8b70937 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:37.587882 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ac67c6cc-8e9e-4da7-ab59-1706d8b70937 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:37.588319 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ac67c6cc-8e9e-4da7-ab59-1706d8b70937 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:37.800194 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1fd5826e-5ae0-443d-bba9-df33f97cffa8 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:37.801523 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1fd5826e-5ae0-443d-bba9-df33f97cffa8 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:37.825064 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1fd5826e-5ae0-443d-bba9-df33f97cffa8 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:37.831329 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1fd5826e-5ae0-443d-bba9-df33f97cffa8 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:37.832201 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1fd5826e-5ae0-443d-bba9-df33f97cffa8 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:37.835157 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1fd5826e-5ae0-443d-bba9-df33f97cffa8 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:37.836982 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1fd5826e-5ae0-443d-bba9-df33f97cffa8 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:37.837708 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1fd5826e-5ae0-443d-bba9-df33f97cffa8 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:38.009297 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ac67c6cc-8e9e-4da7-ab59-1706d8b70937 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:38.017482 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ac67c6cc-8e9e-4da7-ab59-1706d8b70937 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8" status: 200 len: 1268 microversion: 2.1 time: 0.480558 Aug 31 16:00:38.028757 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1370/2652] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:37 2022] GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8 => generated 1268 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:38.109215 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1fd5826e-5ae0-443d-bba9-df33f97cffa8 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:38.130636 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1fd5826e-5ae0-443d-bba9-df33f97cffa8 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:38.134878 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1fd5826e-5ae0-443d-bba9-df33f97cffa8 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:38.159659 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1fd5826e-5ae0-443d-bba9-df33f97cffa8 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1544 microversion: 2.91 time: 0.366160 Aug 31 16:00:38.179695 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1283/2653] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:37 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1544 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:39.044990 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6349b9f5-67ee-4aa7-982b-8ea1e40a2787 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:39.045632 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6349b9f5-67ee-4aa7-982b-8ea1e40a2787 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 8701d926-4a72-483d-b0a3-57d8ee5f50c8] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:39.065606 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6349b9f5-67ee-4aa7-982b-8ea1e40a2787 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:39.068957 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6349b9f5-67ee-4aa7-982b-8ea1e40a2787 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:39.069661 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6349b9f5-67ee-4aa7-982b-8ea1e40a2787 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:39.070719 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6349b9f5-67ee-4aa7-982b-8ea1e40a2787 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:39.072102 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6349b9f5-67ee-4aa7-982b-8ea1e40a2787 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:39.073245 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6349b9f5-67ee-4aa7-982b-8ea1e40a2787 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:39.203105 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f07fa537-e561-4736-96af-95da2fc42077 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:39.204294 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f07fa537-e561-4736-96af-95da2fc42077 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:39.225494 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f07fa537-e561-4736-96af-95da2fc42077 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:39.233378 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f07fa537-e561-4736-96af-95da2fc42077 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:39.233937 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f07fa537-e561-4736-96af-95da2fc42077 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:39.234731 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f07fa537-e561-4736-96af-95da2fc42077 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:39.235291 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f07fa537-e561-4736-96af-95da2fc42077 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:39.235826 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f07fa537-e561-4736-96af-95da2fc42077 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:41.352802 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f07fa537-e561-4736-96af-95da2fc42077 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:41.386047 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f07fa537-e561-4736-96af-95da2fc42077 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:41.391439 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f07fa537-e561-4736-96af-95da2fc42077 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:41.412028 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f07fa537-e561-4736-96af-95da2fc42077 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1544 microversion: 2.91 time: 2.213816 Aug 31 16:00:41.421926 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1284/2654] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:39 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1544 bytes in 2224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:41.489063 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6349b9f5-67ee-4aa7-982b-8ea1e40a2787 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:41.500849 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6349b9f5-67ee-4aa7-982b-8ea1e40a2787 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8" status: 200 len: 1310 microversion: 2.1 time: 2.460767 Aug 31 16:00:41.512063 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1371/2655] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:39 2022] GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8 => generated 1310 bytes in 2473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:42.457054 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-10007247-ad07-4b00-8420-e2c161cef464 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:42.458332 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-10007247-ad07-4b00-8420-e2c161cef464 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:42.460981 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=2,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:00:42.480969 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10007247-ad07-4b00-8420-e2c161cef464 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:42.481463 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10007247-ad07-4b00-8420-e2c161cef464 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:42.492072 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10007247-ad07-4b00-8420-e2c161cef464 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:42.493557 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10007247-ad07-4b00-8420-e2c161cef464 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:42.494911 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10007247-ad07-4b00-8420-e2c161cef464 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:42.495555 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10007247-ad07-4b00-8420-e2c161cef464 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:42.535123 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-615ccc78-69c8-4a46-b309-77331521e7fd tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:42.536442 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-615ccc78-69c8-4a46-b309-77331521e7fd tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 8701d926-4a72-483d-b0a3-57d8ee5f50c8] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:42.557019 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:00:42.558829 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-615ccc78-69c8-4a46-b309-77331521e7fd tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:42.564058 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-615ccc78-69c8-4a46-b309-77331521e7fd tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:42.564796 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-615ccc78-69c8-4a46-b309-77331521e7fd tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:42.574807 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-615ccc78-69c8-4a46-b309-77331521e7fd tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:42.575998 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-615ccc78-69c8-4a46-b309-77331521e7fd tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:42.576443 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-615ccc78-69c8-4a46-b309-77331521e7fd tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:43.876148 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-10007247-ad07-4b00-8420-e2c161cef464 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:43.885447 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-10007247-ad07-4b00-8420-e2c161cef464 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:43.894464 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-10007247-ad07-4b00-8420-e2c161cef464 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:43.917339 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-10007247-ad07-4b00-8420-e2c161cef464 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1544 microversion: 2.91 time: 1.464187 Aug 31 16:00:43.918178 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1285/2656] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:42 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1544 bytes in 1466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:00:44.746884 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=42 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:00:44.817896 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-615ccc78-69c8-4a46-b309-77331521e7fd tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:44.874056 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-615ccc78-69c8-4a46-b309-77331521e7fd tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8" status: 200 len: 1310 microversion: 2.1 time: 2.342744 Aug 31 16:00:44.899789 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1372/2657] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:42 2022] GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8 => generated 1310 bytes in 2369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:44.953313 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fdbfa5b7-25c5-4707-9a3e-6e787aa21332 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:44.953952 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fdbfa5b7-25c5-4707-9a3e-6e787aa21332 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:44.969449 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fdbfa5b7-25c5-4707-9a3e-6e787aa21332 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:44.970000 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fdbfa5b7-25c5-4707-9a3e-6e787aa21332 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:44.970468 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fdbfa5b7-25c5-4707-9a3e-6e787aa21332 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:44.971302 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fdbfa5b7-25c5-4707-9a3e-6e787aa21332 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:44.971836 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fdbfa5b7-25c5-4707-9a3e-6e787aa21332 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:44.972462 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fdbfa5b7-25c5-4707-9a3e-6e787aa21332 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:45.299422 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fdbfa5b7-25c5-4707-9a3e-6e787aa21332 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:45.309641 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fdbfa5b7-25c5-4707-9a3e-6e787aa21332 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:45.311316 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fdbfa5b7-25c5-4707-9a3e-6e787aa21332 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:45.339007 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fdbfa5b7-25c5-4707-9a3e-6e787aa21332 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1544 microversion: 2.91 time: 0.386930 Aug 31 16:00:45.342525 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1286/2658] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:44 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1544 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:00:45.925283 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d4455af8-355f-4682-bcb4-f95a10f19ad5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:45.925904 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d4455af8-355f-4682-bcb4-f95a10f19ad5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 8701d926-4a72-483d-b0a3-57d8ee5f50c8] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:45.948779 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d4455af8-355f-4682-bcb4-f95a10f19ad5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:45.950390 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d4455af8-355f-4682-bcb4-f95a10f19ad5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:45.954191 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d4455af8-355f-4682-bcb4-f95a10f19ad5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:45.955142 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d4455af8-355f-4682-bcb4-f95a10f19ad5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:45.957529 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d4455af8-355f-4682-bcb4-f95a10f19ad5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:45.960395 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d4455af8-355f-4682-bcb4-f95a10f19ad5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:46.373009 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-148dca3e-b044-41fb-9e21-61093af99c58 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:46.374566 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-148dca3e-b044-41fb-9e21-61093af99c58 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:46.393447 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-148dca3e-b044-41fb-9e21-61093af99c58 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:46.402566 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-148dca3e-b044-41fb-9e21-61093af99c58 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:46.403813 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-148dca3e-b044-41fb-9e21-61093af99c58 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:46.406569 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-148dca3e-b044-41fb-9e21-61093af99c58 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:46.413858 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-148dca3e-b044-41fb-9e21-61093af99c58 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:46.416276 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-148dca3e-b044-41fb-9e21-61093af99c58 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:47.984584 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-148dca3e-b044-41fb-9e21-61093af99c58 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:47.999018 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:00:48.008933 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-148dca3e-b044-41fb-9e21-61093af99c58 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:48.012120 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-148dca3e-b044-41fb-9e21-61093af99c58 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:48.031758 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-148dca3e-b044-41fb-9e21-61093af99c58 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1544 microversion: 2.91 time: 1.662232 Aug 31 16:00:48.036348 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1287/2659] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:46 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1544 bytes in 1668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:48.210437 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d4455af8-355f-4682-bcb4-f95a10f19ad5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:48.223875 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d4455af8-355f-4682-bcb4-f95a10f19ad5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8" status: 200 len: 1310 microversion: 2.1 time: 2.303231 Aug 31 16:00:48.227039 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1373/2660] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:45 2022] GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8 => generated 1310 bytes in 2307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:48.660526 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2ad61818-a92f-4503-875e-ec3098e97f5d tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1820589414", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:49.071025 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d197d351-92c9-4c08-ad8f-8ac9a73eea44 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:49.071943 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d197d351-92c9-4c08-ad8f-8ac9a73eea44 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:49.094109 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d197d351-92c9-4c08-ad8f-8ac9a73eea44 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:49.095380 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d197d351-92c9-4c08-ad8f-8ac9a73eea44 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:49.099869 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d197d351-92c9-4c08-ad8f-8ac9a73eea44 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:49.101123 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d197d351-92c9-4c08-ad8f-8ac9a73eea44 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:49.101766 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d197d351-92c9-4c08-ad8f-8ac9a73eea44 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:49.105639 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d197d351-92c9-4c08-ad8f-8ac9a73eea44 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:49.941752 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d197d351-92c9-4c08-ad8f-8ac9a73eea44 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:49.973030 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d197d351-92c9-4c08-ad8f-8ac9a73eea44 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:49.989444 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d197d351-92c9-4c08-ad8f-8ac9a73eea44 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:50.007012 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d197d351-92c9-4c08-ad8f-8ac9a73eea44 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1544 microversion: 2.91 time: 0.943450 Aug 31 16:00:50.008224 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1374/2661] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:49 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1544 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:50.025654 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9a99a6d9-b0ef-4b13-9061-06dfaa284275 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:50.026690 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9a99a6d9-b0ef-4b13-9061-06dfaa284275 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 8701d926-4a72-483d-b0a3-57d8ee5f50c8] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:50.047342 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9a99a6d9-b0ef-4b13-9061-06dfaa284275 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:50.048958 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9a99a6d9-b0ef-4b13-9061-06dfaa284275 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:50.053582 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9a99a6d9-b0ef-4b13-9061-06dfaa284275 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:50.055814 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9a99a6d9-b0ef-4b13-9061-06dfaa284275 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:50.057026 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9a99a6d9-b0ef-4b13-9061-06dfaa284275 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:50.058009 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9a99a6d9-b0ef-4b13-9061-06dfaa284275 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:51.083432 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9a99a6d9-b0ef-4b13-9061-06dfaa284275 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:51.094992 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9a99a6d9-b0ef-4b13-9061-06dfaa284275 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8" status: 200 len: 1310 microversion: 2.1 time: 1.084369 Aug 31 16:00:51.100475 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1375/2662] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:50 2022] GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8 => generated 1310 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:51.473291 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-07b7538e-fdfa-4a08-8338-25fdfa71aace req-2781cde7-49d4-47c3-b65b-299cab564f6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8701d926-4a72-483d-b0a3-57d8ee5f50c8", "tag": "003c66a3-ae1f-4cd7-a8a9-471d61697901"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:51.494044 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-07b7538e-fdfa-4a08-8338-25fdfa71aace req-2781cde7-49d4-47c3-b65b-299cab564f6a service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:51.499071 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-07b7538e-fdfa-4a08-8338-25fdfa71aace req-2781cde7-49d4-47c3-b65b-299cab564f6a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:51.500784 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-07b7538e-fdfa-4a08-8338-25fdfa71aace req-2781cde7-49d4-47c3-b65b-299cab564f6a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:51.512386 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=87 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:00:51.534548 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-07b7538e-fdfa-4a08-8338-25fdfa71aace req-2781cde7-49d4-47c3-b65b-299cab564f6a service nova] Creating event network-changed:003c66a3-ae1f-4cd7-a8a9-471d61697901 for instance 8701d926-4a72-483d-b0a3-57d8ee5f50c8 on n-h2-833090-16 Aug 31 16:00:51.550039 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-07b7538e-fdfa-4a08-8338-25fdfa71aace req-2781cde7-49d4-47c3-b65b-299cab564f6a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.448233 Aug 31 16:00:51.554941 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1376/2663] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:00:51.570964 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-dab5b1d1-5984-45e0-b111-60e965d0613c tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:51.572760 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-dab5b1d1-5984-45e0-b111-60e965d0613c tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:51.596851 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dab5b1d1-5984-45e0-b111-60e965d0613c tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:51.597680 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dab5b1d1-5984-45e0-b111-60e965d0613c tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:51.598275 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dab5b1d1-5984-45e0-b111-60e965d0613c tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:51.599206 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dab5b1d1-5984-45e0-b111-60e965d0613c tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:51.599786 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dab5b1d1-5984-45e0-b111-60e965d0613c tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:51.601821 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dab5b1d1-5984-45e0-b111-60e965d0613c tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:51.904366 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-dab5b1d1-5984-45e0-b111-60e965d0613c tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:51.921387 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-dab5b1d1-5984-45e0-b111-60e965d0613c tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:51.946036 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-dab5b1d1-5984-45e0-b111-60e965d0613c tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:51.968639 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-dab5b1d1-5984-45e0-b111-60e965d0613c tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1544 microversion: 2.91 time: 0.411899 Aug 31 16:00:51.983593 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1377/2664] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:51 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1544 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:52.118848 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6298a35b-3be2-4c89-ad2a-9649bfb0be79 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:52.119478 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6298a35b-3be2-4c89-ad2a-9649bfb0be79 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 8701d926-4a72-483d-b0a3-57d8ee5f50c8] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:52.134693 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6298a35b-3be2-4c89-ad2a-9649bfb0be79 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:52.142889 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6298a35b-3be2-4c89-ad2a-9649bfb0be79 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:52.159819 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6298a35b-3be2-4c89-ad2a-9649bfb0be79 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:52.163941 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6298a35b-3be2-4c89-ad2a-9649bfb0be79 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:52.170623 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6298a35b-3be2-4c89-ad2a-9649bfb0be79 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:52.172197 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6298a35b-3be2-4c89-ad2a-9649bfb0be79 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:53.183863 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-2ad61818-a92f-4503-875e-ec3098e97f5d tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] validate_networks() for [('eefa5116-da2b-41a1-b131-8cada4400b07', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:00:53.393600 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6298a35b-3be2-4c89-ad2a-9649bfb0be79 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:53.403053 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6298a35b-3be2-4c89-ad2a-9649bfb0be79 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8" status: 200 len: 1310 microversion: 2.1 time: 1.287983 Aug 31 16:00:53.408633 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1378/2665] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:52 2022] GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8 => generated 1310 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:00:53.420248 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-88821e43-6e30-4ca9-8ae9-d61cedecf084 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:53.426405 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-88821e43-6e30-4ca9-8ae9-d61cedecf084 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:53.435306 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-88821e43-6e30-4ca9-8ae9-d61cedecf084 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:53.435803 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-88821e43-6e30-4ca9-8ae9-d61cedecf084 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:53.436231 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-88821e43-6e30-4ca9-8ae9-d61cedecf084 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:53.446984 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-88821e43-6e30-4ca9-8ae9-d61cedecf084 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:53.448057 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-88821e43-6e30-4ca9-8ae9-d61cedecf084 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:53.448946 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-88821e43-6e30-4ca9-8ae9-d61cedecf084 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:53.722843 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-88821e43-6e30-4ca9-8ae9-d61cedecf084 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:53.744219 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-88821e43-6e30-4ca9-8ae9-d61cedecf084 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:53.747721 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-88821e43-6e30-4ca9-8ae9-d61cedecf084 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:53.772032 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-88821e43-6e30-4ca9-8ae9-d61cedecf084 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1544 microversion: 2.91 time: 0.361933 Aug 31 16:00:53.774335 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1379/2666] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:53 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1544 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:53.780955 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f3b53d05-ef39-4e42-bc1c-b71820e43b91 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:53.782337 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f3b53d05-ef39-4e42-bc1c-b71820e43b91 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:53.803551 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f3b53d05-ef39-4e42-bc1c-b71820e43b91 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:53.806447 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f3b53d05-ef39-4e42-bc1c-b71820e43b91 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:53.815006 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f3b53d05-ef39-4e42-bc1c-b71820e43b91 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:53.817295 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f3b53d05-ef39-4e42-bc1c-b71820e43b91 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:53.818570 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f3b53d05-ef39-4e42-bc1c-b71820e43b91 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:53.819333 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f3b53d05-ef39-4e42-bc1c-b71820e43b91 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:55.289560 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f3b53d05-ef39-4e42-bc1c-b71820e43b91 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:55.300980 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f3b53d05-ef39-4e42-bc1c-b71820e43b91 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1671 microversion: 2.1 time: 1.524989 Aug 31 16:00:55.301598 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1380/2667] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:53 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1671 bytes in 1526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:55.319140 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-2ad61818-a92f-4503-875e-ec3098e97f5d tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:00:55.319639 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-2ad61818-a92f-4503-875e-ec3098e97f5d tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:00:55.320024 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-2ad61818-a92f-4503-875e-ec3098e97f5d tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:00:55.320439 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-2ad61818-a92f-4503-875e-ec3098e97f5d tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:00:55.321178 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-2ad61818-a92f-4503-875e-ec3098e97f5d tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:00:55.327975 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4ab0080d-5f25-46f5-a935-41ff9fce17e9 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:55.328592 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4ab0080d-5f25-46f5-a935-41ff9fce17e9 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 8701d926-4a72-483d-b0a3-57d8ee5f50c8] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:55.337904 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ad61818-a92f-4503-875e-ec3098e97f5d tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:55.338446 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ad61818-a92f-4503-875e-ec3098e97f5d tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:55.338881 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ad61818-a92f-4503-875e-ec3098e97f5d tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:55.339618 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ad61818-a92f-4503-875e-ec3098e97f5d tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:55.340078 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ad61818-a92f-4503-875e-ec3098e97f5d tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:55.348236 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ad61818-a92f-4503-875e-ec3098e97f5d tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:55.352962 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4ab0080d-5f25-46f5-a935-41ff9fce17e9 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:55.353461 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4ab0080d-5f25-46f5-a935-41ff9fce17e9 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:55.353893 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4ab0080d-5f25-46f5-a935-41ff9fce17e9 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:55.354634 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4ab0080d-5f25-46f5-a935-41ff9fce17e9 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:55.355079 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4ab0080d-5f25-46f5-a935-41ff9fce17e9 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:55.363088 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4ab0080d-5f25-46f5-a935-41ff9fce17e9 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:55.427460 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-2ad61818-a92f-4503-875e-ec3098e97f5d tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Getting quotas for project 75a7c84a4ea54074bab3ccc035c5cf47. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:00:55.446178 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-2ad61818-a92f-4503-875e-ec3098e97f5d tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Getting quotas for user 3c8476b6167a4c838eac59d7c4a40284 and project 75a7c84a4ea54074bab3ccc035c5cf47. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:00:55.481595 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2ad61818-a92f-4503-875e-ec3098e97f5d tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:00:55.485253 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2ad61818-a92f-4503-875e-ec3098e97f5d tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 0a301f9c-b1b8-4962-9d46-28981c195069] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:00:55.673626 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2ad61818-a92f-4503-875e-ec3098e97f5d tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 7.016307 Aug 31 16:00:55.685617 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1288/2668] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:00:48 2022] POST /compute/v2.1/servers => generated 383 bytes in 7021 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:00:55.692817 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d2f5bd75-3d1b-48b4-b007-98cd5771bd4d tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:55.700698 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d2f5bd75-3d1b-48b4-b007-98cd5771bd4d tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:55.725125 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2f5bd75-3d1b-48b4-b007-98cd5771bd4d tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:55.725794 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2f5bd75-3d1b-48b4-b007-98cd5771bd4d tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:55.726464 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2f5bd75-3d1b-48b4-b007-98cd5771bd4d tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:55.734535 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2f5bd75-3d1b-48b4-b007-98cd5771bd4d tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:55.735707 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2f5bd75-3d1b-48b4-b007-98cd5771bd4d tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:55.736318 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2f5bd75-3d1b-48b4-b007-98cd5771bd4d tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:55.948749 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d2f5bd75-3d1b-48b4-b007-98cd5771bd4d tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:55.970681 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d2f5bd75-3d1b-48b4-b007-98cd5771bd4d tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:55.972514 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d2f5bd75-3d1b-48b4-b007-98cd5771bd4d tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:56.009415 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d2f5bd75-3d1b-48b4-b007-98cd5771bd4d tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1544 microversion: 2.91 time: 0.331335 Aug 31 16:00:56.010030 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1289/2669] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:55 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1544 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:56.035923 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b96498b3-2925-4dc1-8a78-2327686f5ca1 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-340433631"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:56.047939 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b96498b3-2925-4dc1-8a78-2327686f5ca1 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:56.068469 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b96498b3-2925-4dc1-8a78-2327686f5ca1 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:56.068972 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b96498b3-2925-4dc1-8a78-2327686f5ca1 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:56.069471 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b96498b3-2925-4dc1-8a78-2327686f5ca1 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:56.070273 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b96498b3-2925-4dc1-8a78-2327686f5ca1 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:56.070862 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b96498b3-2925-4dc1-8a78-2327686f5ca1 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:56.071302 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b96498b3-2925-4dc1-8a78-2327686f5ca1 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:56.682636 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b96498b3-2925-4dc1-8a78-2327686f5ca1 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "POST /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b/action" status: 202 len: 0 microversion: 2.1 time: 0.634764 Aug 31 16:00:56.704349 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1290/2670] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:00:56 2022] POST /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b/action => generated 0 bytes in 678 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 31 16:00:56.766171 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e979c851-75c1-4466-a1ec-f708693a7892 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:56.772213 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e979c851-75c1-4466-a1ec-f708693a7892 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 0a301f9c-b1b8-4962-9d46-28981c195069] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:57.480986 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4ab0080d-5f25-46f5-a935-41ff9fce17e9 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:57.498899 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4ab0080d-5f25-46f5-a935-41ff9fce17e9 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8" status: 200 len: 1310 microversion: 2.1 time: 2.181530 Aug 31 16:00:57.499864 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1381/2671] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:55 2022] GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8 => generated 1310 bytes in 2198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:57.529159 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-07b9b217-3e31-499a-b1b3-009ac3bf96a2 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:57.531309 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-07b9b217-3e31-499a-b1b3-009ac3bf96a2 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:57.564409 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-07b9b217-3e31-499a-b1b3-009ac3bf96a2 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:57.565781 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-07b9b217-3e31-499a-b1b3-009ac3bf96a2 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:57.568182 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-07b9b217-3e31-499a-b1b3-009ac3bf96a2 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:57.569286 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-07b9b217-3e31-499a-b1b3-009ac3bf96a2 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:57.570627 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-07b9b217-3e31-499a-b1b3-009ac3bf96a2 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:57.573216 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-07b9b217-3e31-499a-b1b3-009ac3bf96a2 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:57.582082 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e979c851-75c1-4466-a1ec-f708693a7892 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8476b6167a4c838eac59d7c4a40284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a7c84a4ea54074bab3ccc035c5cf47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:57.590297 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e979c851-75c1-4466-a1ec-f708693a7892 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/0a301f9c-b1b8-4962-9d46-28981c195069" status: 200 len: 1225 microversion: 2.1 time: 0.866616 Aug 31 16:00:57.614130 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1291/2672] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:56 2022] GET /compute/v2.1/servers/0a301f9c-b1b8-4962-9d46-28981c195069 => generated 1225 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:57.935398 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-07b9b217-3e31-499a-b1b3-009ac3bf96a2 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:57.951371 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-07b9b217-3e31-499a-b1b3-009ac3bf96a2 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:57.959721 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-07b9b217-3e31-499a-b1b3-009ac3bf96a2 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:57.981608 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=77,nova_api:INSERT=4 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:00:57.984879 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-07b9b217-3e31-499a-b1b3-009ac3bf96a2 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1544 microversion: 2.91 time: 0.478470 Aug 31 16:00:57.995121 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1382/2673] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:57 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1544 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:58.519997 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0b4b6cc4-efe0-46b7-8996-c16fa4338499 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:58.520710 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0b4b6cc4-efe0-46b7-8996-c16fa4338499 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 8701d926-4a72-483d-b0a3-57d8ee5f50c8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:58.536499 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0b4b6cc4-efe0-46b7-8996-c16fa4338499 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:58.537169 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0b4b6cc4-efe0-46b7-8996-c16fa4338499 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:58.538952 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0b4b6cc4-efe0-46b7-8996-c16fa4338499 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:58.540058 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0b4b6cc4-efe0-46b7-8996-c16fa4338499 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:58.542682 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0b4b6cc4-efe0-46b7-8996-c16fa4338499 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:58.543330 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0b4b6cc4-efe0-46b7-8996-c16fa4338499 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:58.579095 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-cae32dca-a66d-442c-852b-47f7803af90c req-824974d5-779f-4098-9a31-0ae47cf54e86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b", "name": "network-vif-unplugged", "status": "completed", "tag": "4e98deab-3424-49ec-b930-3019d71c32c7"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:00:58.602055 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-cae32dca-a66d-442c-852b-47f7803af90c req-824974d5-779f-4098-9a31-0ae47cf54e86 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:58.610881 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-cae32dca-a66d-442c-852b-47f7803af90c req-824974d5-779f-4098-9a31-0ae47cf54e86 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:58.617287 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-cae32dca-a66d-442c-852b-47f7803af90c req-824974d5-779f-4098-9a31-0ae47cf54e86 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:58.654957 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-cae32dca-a66d-442c-852b-47f7803af90c req-824974d5-779f-4098-9a31-0ae47cf54e86 service nova] Creating event network-vif-unplugged:4e98deab-3424-49ec-b930-3019d71c32c7 for instance 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b on n-h1-833090-16 Aug 31 16:00:58.667715 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-cae32dca-a66d-442c-852b-47f7803af90c req-824974d5-779f-4098-9a31-0ae47cf54e86 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092773 Aug 31 16:00:58.670659 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1383/2674] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:00:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:00:58.684701 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f3613a1f-33ab-45a4-937c-16c9d6707b66 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:58.685558 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f3613a1f-33ab-45a4-937c-16c9d6707b66 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 0a301f9c-b1b8-4962-9d46-28981c195069] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:58.698485 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f3613a1f-33ab-45a4-937c-16c9d6707b66 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:58.699407 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f3613a1f-33ab-45a4-937c-16c9d6707b66 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:58.700107 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f3613a1f-33ab-45a4-937c-16c9d6707b66 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:58.704134 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f3613a1f-33ab-45a4-937c-16c9d6707b66 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:58.704903 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f3613a1f-33ab-45a4-937c-16c9d6707b66 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:58.705607 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f3613a1f-33ab-45a4-937c-16c9d6707b66 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:59.114262 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f3613a1f-33ab-45a4-937c-16c9d6707b66 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8476b6167a4c838eac59d7c4a40284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a7c84a4ea54074bab3ccc035c5cf47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:59.137399 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f3613a1f-33ab-45a4-937c-16c9d6707b66 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/0a301f9c-b1b8-4962-9d46-28981c195069" status: 200 len: 1295 microversion: 2.1 time: 0.464439 Aug 31 16:00:59.138528 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1384/2675] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:58 2022] GET /compute/v2.1/servers/0a301f9c-b1b8-4962-9d46-28981c195069 => generated 1295 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:00:59.157402 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a341d038-683e-454c-bcf0-0117981e7ccc tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:00:59.158024 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a341d038-683e-454c-bcf0-0117981e7ccc tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:00:59.173666 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a341d038-683e-454c-bcf0-0117981e7ccc tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:59.174190 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a341d038-683e-454c-bcf0-0117981e7ccc tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:59.174827 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a341d038-683e-454c-bcf0-0117981e7ccc tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:59.177508 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a341d038-683e-454c-bcf0-0117981e7ccc tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:00:59.178182 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a341d038-683e-454c-bcf0-0117981e7ccc tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:00:59.180857 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a341d038-683e-454c-bcf0-0117981e7ccc tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:00:59.385850 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a341d038-683e-454c-bcf0-0117981e7ccc tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:59.402872 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a341d038-683e-454c-bcf0-0117981e7ccc tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:59.406435 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a341d038-683e-454c-bcf0-0117981e7ccc tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:59.419250 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a341d038-683e-454c-bcf0-0117981e7ccc tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1544 microversion: 2.91 time: 0.279167 Aug 31 16:00:59.423333 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1385/2676] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:00:59 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1544 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:00:59.532578 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0b4b6cc4-efe0-46b7-8996-c16fa4338499 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:00:59.550876 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0b4b6cc4-efe0-46b7-8996-c16fa4338499 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8" status: 200 len: 1310 microversion: 2.1 time: 1.034776 Aug 31 16:00:59.551465 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1292/2677] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:00:58 2022] GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8 => generated 1310 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:00.160968 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7a0492e9-017d-4b10-acd6-7da9e3b2d334 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:00.162293 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7a0492e9-017d-4b10-acd6-7da9e3b2d334 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 0a301f9c-b1b8-4962-9d46-28981c195069] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:00.181462 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7a0492e9-017d-4b10-acd6-7da9e3b2d334 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:00.193640 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7a0492e9-017d-4b10-acd6-7da9e3b2d334 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:00.194133 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7a0492e9-017d-4b10-acd6-7da9e3b2d334 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:00.201721 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7a0492e9-017d-4b10-acd6-7da9e3b2d334 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:00.203389 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7a0492e9-017d-4b10-acd6-7da9e3b2d334 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:00.204518 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7a0492e9-017d-4b10-acd6-7da9e3b2d334 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:00.320720 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7a0492e9-017d-4b10-acd6-7da9e3b2d334 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8476b6167a4c838eac59d7c4a40284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a7c84a4ea54074bab3ccc035c5cf47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:00.336682 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7a0492e9-017d-4b10-acd6-7da9e3b2d334 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/0a301f9c-b1b8-4962-9d46-28981c195069" status: 200 len: 1283 microversion: 2.1 time: 0.180501 Aug 31 16:01:00.343378 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1386/2678] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:00 2022] GET /compute/v2.1/servers/0a301f9c-b1b8-4962-9d46-28981c195069 => generated 1283 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:00.450992 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d981aec1-2d53-4bc1-b5ae-a2d2afe1d825 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:00.452026 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d981aec1-2d53-4bc1-b5ae-a2d2afe1d825 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:00.472720 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d981aec1-2d53-4bc1-b5ae-a2d2afe1d825 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:00.473696 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d981aec1-2d53-4bc1-b5ae-a2d2afe1d825 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:00.474339 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d981aec1-2d53-4bc1-b5ae-a2d2afe1d825 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:00.476471 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d981aec1-2d53-4bc1-b5ae-a2d2afe1d825 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:00.477239 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d981aec1-2d53-4bc1-b5ae-a2d2afe1d825 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:00.477772 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d981aec1-2d53-4bc1-b5ae-a2d2afe1d825 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:00.577212 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b8de6fcb-430c-4384-bd1d-3989d3b9f884 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:00.578613 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b8de6fcb-430c-4384-bd1d-3989d3b9f884 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 8701d926-4a72-483d-b0a3-57d8ee5f50c8] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:00.603008 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b8de6fcb-430c-4384-bd1d-3989d3b9f884 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:00.607885 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b8de6fcb-430c-4384-bd1d-3989d3b9f884 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:00.610710 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b8de6fcb-430c-4384-bd1d-3989d3b9f884 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:00.621366 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b8de6fcb-430c-4384-bd1d-3989d3b9f884 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:00.627538 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b8de6fcb-430c-4384-bd1d-3989d3b9f884 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:00.630765 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b8de6fcb-430c-4384-bd1d-3989d3b9f884 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:00.914950 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d981aec1-2d53-4bc1-b5ae-a2d2afe1d825 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:00.925437 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d981aec1-2d53-4bc1-b5ae-a2d2afe1d825 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:00.939547 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d981aec1-2d53-4bc1-b5ae-a2d2afe1d825 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:00.979915 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d981aec1-2d53-4bc1-b5ae-a2d2afe1d825 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1544 microversion: 2.91 time: 0.533728 Aug 31 16:01:00.993838 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1293/2679] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:01:00 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1544 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:01:01.365204 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-12b4c215-cbe1-47a7-b80b-163731e68482 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:01.366818 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-12b4c215-cbe1-47a7-b80b-163731e68482 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 0a301f9c-b1b8-4962-9d46-28981c195069] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:01.384782 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12b4c215-cbe1-47a7-b80b-163731e68482 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:01.388140 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12b4c215-cbe1-47a7-b80b-163731e68482 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:01.388631 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12b4c215-cbe1-47a7-b80b-163731e68482 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:01.389412 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12b4c215-cbe1-47a7-b80b-163731e68482 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:01.389866 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12b4c215-cbe1-47a7-b80b-163731e68482 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:01.399309 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12b4c215-cbe1-47a7-b80b-163731e68482 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:01.503015 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b8de6fcb-430c-4384-bd1d-3989d3b9f884 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:01.512406 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b8de6fcb-430c-4384-bd1d-3989d3b9f884 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8" status: 200 len: 1310 microversion: 2.1 time: 0.941039 Aug 31 16:01:01.519288 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1387/2680] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:00 2022] GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8 => generated 1310 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:01.951244 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-12b4c215-cbe1-47a7-b80b-163731e68482 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8476b6167a4c838eac59d7c4a40284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a7c84a4ea54074bab3ccc035c5cf47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:01.959624 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-12b4c215-cbe1-47a7-b80b-163731e68482 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/0a301f9c-b1b8-4962-9d46-28981c195069" status: 200 len: 1325 microversion: 2.1 time: 0.600713 Aug 31 16:01:01.966735 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1294/2681] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:01 2022] GET /compute/v2.1/servers/0a301f9c-b1b8-4962-9d46-28981c195069 => generated 1325 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:02.015449 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-873cfbe7-a673-4177-8f3a-078e9a995149 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:02.016084 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-873cfbe7-a673-4177-8f3a-078e9a995149 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:02.027032 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-873cfbe7-a673-4177-8f3a-078e9a995149 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:02.027538 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-873cfbe7-a673-4177-8f3a-078e9a995149 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:02.027979 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-873cfbe7-a673-4177-8f3a-078e9a995149 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:02.028787 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-873cfbe7-a673-4177-8f3a-078e9a995149 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:02.029241 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-873cfbe7-a673-4177-8f3a-078e9a995149 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:02.029673 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-873cfbe7-a673-4177-8f3a-078e9a995149 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:02.418241 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-873cfbe7-a673-4177-8f3a-078e9a995149 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:02.443241 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-873cfbe7-a673-4177-8f3a-078e9a995149 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:02.464720 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-873cfbe7-a673-4177-8f3a-078e9a995149 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:02.500185 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-873cfbe7-a673-4177-8f3a-078e9a995149 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1544 microversion: 2.91 time: 0.486862 Aug 31 16:01:02.506388 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1388/2682] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:01:02 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1544 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:01:02.564793 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-06d04288-7ef9-4ebf-ba08-968bbf46fe34 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:02.586002 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-06d04288-7ef9-4ebf-ba08-968bbf46fe34 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 8701d926-4a72-483d-b0a3-57d8ee5f50c8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:02.609507 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06d04288-7ef9-4ebf-ba08-968bbf46fe34 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:02.620817 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06d04288-7ef9-4ebf-ba08-968bbf46fe34 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:02.623799 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06d04288-7ef9-4ebf-ba08-968bbf46fe34 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:02.630319 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06d04288-7ef9-4ebf-ba08-968bbf46fe34 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:02.631077 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06d04288-7ef9-4ebf-ba08-968bbf46fe34 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:02.634282 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06d04288-7ef9-4ebf-ba08-968bbf46fe34 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:02.795744 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-811288df-644e-4da6-b8c6-fd070b0a1946 req-c63784e1-8f7d-4be2-a99e-541cfe297e65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a301f9c-b1b8-4962-9d46-28981c195069", "tag": "0a0f2e12-4320-44b5-b0bd-10f8f9c2d4d4"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:01:02.821483 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-811288df-644e-4da6-b8c6-fd070b0a1946 req-c63784e1-8f7d-4be2-a99e-541cfe297e65 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:02.821978 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-811288df-644e-4da6-b8c6-fd070b0a1946 req-c63784e1-8f7d-4be2-a99e-541cfe297e65 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:02.822457 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-811288df-644e-4da6-b8c6-fd070b0a1946 req-c63784e1-8f7d-4be2-a99e-541cfe297e65 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:02.855338 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-811288df-644e-4da6-b8c6-fd070b0a1946 req-c63784e1-8f7d-4be2-a99e-541cfe297e65 service nova] Creating event network-changed:0a0f2e12-4320-44b5-b0bd-10f8f9c2d4d4 for instance 0a301f9c-b1b8-4962-9d46-28981c195069 on n-h1-833090-16 Aug 31 16:01:02.867147 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-811288df-644e-4da6-b8c6-fd070b0a1946 req-c63784e1-8f7d-4be2-a99e-541cfe297e65 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075968 Aug 31 16:01:02.869589 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1389/2683] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:01:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:01:02.981894 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-642d8e27-92e5-429d-9891-4747653de1b4 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:02.982631 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-642d8e27-92e5-429d-9891-4747653de1b4 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 0a301f9c-b1b8-4962-9d46-28981c195069] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:03.002209 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-642d8e27-92e5-429d-9891-4747653de1b4 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:03.005964 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-642d8e27-92e5-429d-9891-4747653de1b4 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:03.009676 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-642d8e27-92e5-429d-9891-4747653de1b4 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:03.010650 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-642d8e27-92e5-429d-9891-4747653de1b4 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:03.013939 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-642d8e27-92e5-429d-9891-4747653de1b4 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:03.014649 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-642d8e27-92e5-429d-9891-4747653de1b4 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:03.614166 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-06d04288-7ef9-4ebf-ba08-968bbf46fe34 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:03.623304 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-06d04288-7ef9-4ebf-ba08-968bbf46fe34 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8" status: 200 len: 1310 microversion: 2.1 time: 1.080807 Aug 31 16:01:03.628061 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1295/2684] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:02 2022] GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8 => generated 1310 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:03.641813 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dd5bdb36-cc68-46b1-99c8-846f0e28ab9f tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:03.642787 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dd5bdb36-cc68-46b1-99c8-846f0e28ab9f tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:03.658136 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd5bdb36-cc68-46b1-99c8-846f0e28ab9f tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:03.658969 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd5bdb36-cc68-46b1-99c8-846f0e28ab9f tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:03.661914 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd5bdb36-cc68-46b1-99c8-846f0e28ab9f tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:03.663181 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd5bdb36-cc68-46b1-99c8-846f0e28ab9f tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:03.663806 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd5bdb36-cc68-46b1-99c8-846f0e28ab9f tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:03.665390 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd5bdb36-cc68-46b1-99c8-846f0e28ab9f tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:03.996149 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dd5bdb36-cc68-46b1-99c8-846f0e28ab9f tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:04.014621 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dd5bdb36-cc68-46b1-99c8-846f0e28ab9f tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:04.020103 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dd5bdb36-cc68-46b1-99c8-846f0e28ab9f tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:04.056659 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dd5bdb36-cc68-46b1-99c8-846f0e28ab9f tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1544 microversion: 2.91 time: 0.427137 Aug 31 16:01:04.059038 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1296/2685] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:01:03 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1544 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:01:04.182223 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-642d8e27-92e5-429d-9891-4747653de1b4 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8476b6167a4c838eac59d7c4a40284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a7c84a4ea54074bab3ccc035c5cf47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:04.209322 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-642d8e27-92e5-429d-9891-4747653de1b4 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/0a301f9c-b1b8-4962-9d46-28981c195069" status: 200 len: 1325 microversion: 2.1 time: 1.228801 Aug 31 16:01:04.213655 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1390/2686] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:02 2022] GET /compute/v2.1/servers/0a301f9c-b1b8-4962-9d46-28981c195069 => generated 1325 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:04.651644 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-62069833-bfd6-4804-9983-7687506d78e0 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:04.652939 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-62069833-bfd6-4804-9983-7687506d78e0 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 8701d926-4a72-483d-b0a3-57d8ee5f50c8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:04.681088 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62069833-bfd6-4804-9983-7687506d78e0 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:04.682502 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62069833-bfd6-4804-9983-7687506d78e0 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:04.685783 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62069833-bfd6-4804-9983-7687506d78e0 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:04.694746 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62069833-bfd6-4804-9983-7687506d78e0 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:04.708397 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62069833-bfd6-4804-9983-7687506d78e0 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:04.708397 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62069833-bfd6-4804-9983-7687506d78e0 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:05.086214 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c256ed59-b5b3-4144-803c-d9ebbd7b83bb tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:05.086916 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c256ed59-b5b3-4144-803c-d9ebbd7b83bb tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:05.098972 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c256ed59-b5b3-4144-803c-d9ebbd7b83bb tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:05.104256 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c256ed59-b5b3-4144-803c-d9ebbd7b83bb tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:05.104860 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c256ed59-b5b3-4144-803c-d9ebbd7b83bb tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:05.117949 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c256ed59-b5b3-4144-803c-d9ebbd7b83bb tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:05.125352 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c256ed59-b5b3-4144-803c-d9ebbd7b83bb tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:05.127777 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c256ed59-b5b3-4144-803c-d9ebbd7b83bb tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:05.388262 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:01:05.574733 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c256ed59-b5b3-4144-803c-d9ebbd7b83bb tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:05.587782 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c256ed59-b5b3-4144-803c-d9ebbd7b83bb tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:05.596027 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c256ed59-b5b3-4144-803c-d9ebbd7b83bb tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:05.608150 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c256ed59-b5b3-4144-803c-d9ebbd7b83bb tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1544 microversion: 2.91 time: 0.526109 Aug 31 16:01:05.612738 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1391/2687] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:01:05 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1544 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:01:05.626263 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-db753fe4-f85c-473b-84fb-4443f97dfae9 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:05.630364 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-db753fe4-f85c-473b-84fb-4443f97dfae9 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 0a301f9c-b1b8-4962-9d46-28981c195069] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:05.644256 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db753fe4-f85c-473b-84fb-4443f97dfae9 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:05.665429 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db753fe4-f85c-473b-84fb-4443f97dfae9 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:05.666916 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db753fe4-f85c-473b-84fb-4443f97dfae9 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:05.668555 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db753fe4-f85c-473b-84fb-4443f97dfae9 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:05.671270 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db753fe4-f85c-473b-84fb-4443f97dfae9 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:05.672188 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db753fe4-f85c-473b-84fb-4443f97dfae9 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:06.056585 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-62069833-bfd6-4804-9983-7687506d78e0 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:06.078151 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-62069833-bfd6-4804-9983-7687506d78e0 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8" status: 200 len: 1310 microversion: 2.1 time: 1.427490 Aug 31 16:01:06.087014 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1297/2688] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:04 2022] GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8 => generated 1310 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:06.581924 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-db753fe4-f85c-473b-84fb-4443f97dfae9 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8476b6167a4c838eac59d7c4a40284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a7c84a4ea54074bab3ccc035c5cf47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:06.593365 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-db753fe4-f85c-473b-84fb-4443f97dfae9 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/0a301f9c-b1b8-4962-9d46-28981c195069" status: 200 len: 1325 microversion: 2.1 time: 0.973568 Aug 31 16:01:06.600713 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1392/2689] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:05 2022] GET /compute/v2.1/servers/0a301f9c-b1b8-4962-9d46-28981c195069 => generated 1325 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:06.642530 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-610e8233-24e8-42b6-a3f6-a9b5a92e38a1 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:06.643904 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-610e8233-24e8-42b6-a3f6-a9b5a92e38a1 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:06.675309 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-610e8233-24e8-42b6-a3f6-a9b5a92e38a1 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:06.679565 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-610e8233-24e8-42b6-a3f6-a9b5a92e38a1 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:06.680506 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-610e8233-24e8-42b6-a3f6-a9b5a92e38a1 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:06.681521 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-610e8233-24e8-42b6-a3f6-a9b5a92e38a1 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:06.684330 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-610e8233-24e8-42b6-a3f6-a9b5a92e38a1 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:06.687490 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-610e8233-24e8-42b6-a3f6-a9b5a92e38a1 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:06.951836 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-610e8233-24e8-42b6-a3f6-a9b5a92e38a1 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:06.972060 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-610e8233-24e8-42b6-a3f6-a9b5a92e38a1 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:06.973407 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-610e8233-24e8-42b6-a3f6-a9b5a92e38a1 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:06.991099 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-610e8233-24e8-42b6-a3f6-a9b5a92e38a1 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1544 microversion: 2.91 time: 0.353777 Aug 31 16:01:06.991618 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1298/2690] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:01:06 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1544 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:01:07.101808 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1a19390d-1466-4243-b159-93960ddfd785 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:07.102808 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1a19390d-1466-4243-b159-93960ddfd785 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 8701d926-4a72-483d-b0a3-57d8ee5f50c8] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:07.117030 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a19390d-1466-4243-b159-93960ddfd785 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:07.120983 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a19390d-1466-4243-b159-93960ddfd785 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:07.122968 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a19390d-1466-4243-b159-93960ddfd785 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:07.125180 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a19390d-1466-4243-b159-93960ddfd785 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:07.126494 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a19390d-1466-4243-b159-93960ddfd785 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:07.128776 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a19390d-1466-4243-b159-93960ddfd785 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:07.632439 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1a315f28-3eae-4671-942f-18f8ed99e76c tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:07.633087 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1a315f28-3eae-4671-942f-18f8ed99e76c tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 0a301f9c-b1b8-4962-9d46-28981c195069] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:07.638025 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=8 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:01:07.653157 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a315f28-3eae-4671-942f-18f8ed99e76c tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:07.653766 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a315f28-3eae-4671-942f-18f8ed99e76c tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:07.654457 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a315f28-3eae-4671-942f-18f8ed99e76c tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:07.660649 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a315f28-3eae-4671-942f-18f8ed99e76c tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:07.667976 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a315f28-3eae-4671-942f-18f8ed99e76c tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:07.668735 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a315f28-3eae-4671-942f-18f8ed99e76c tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:08.854147 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1a315f28-3eae-4671-942f-18f8ed99e76c tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8476b6167a4c838eac59d7c4a40284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a7c84a4ea54074bab3ccc035c5cf47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:08.896912 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1a315f28-3eae-4671-942f-18f8ed99e76c tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/0a301f9c-b1b8-4962-9d46-28981c195069" status: 200 len: 1325 microversion: 2.1 time: 1.269922 Aug 31 16:01:08.899456 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1299/2691] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:07 2022] GET /compute/v2.1/servers/0a301f9c-b1b8-4962-9d46-28981c195069 => generated 1325 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:08.911568 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3425a6d6-bd63-4d9b-aee4-e957c12c78b8 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:08.928104 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3425a6d6-bd63-4d9b-aee4-e957c12c78b8 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:08.949911 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3425a6d6-bd63-4d9b-aee4-e957c12c78b8 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:08.950698 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3425a6d6-bd63-4d9b-aee4-e957c12c78b8 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:08.955488 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3425a6d6-bd63-4d9b-aee4-e957c12c78b8 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:08.958507 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3425a6d6-bd63-4d9b-aee4-e957c12c78b8 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:08.959106 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3425a6d6-bd63-4d9b-aee4-e957c12c78b8 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:08.959692 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3425a6d6-bd63-4d9b-aee4-e957c12c78b8 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:09.554377 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3425a6d6-bd63-4d9b-aee4-e957c12c78b8 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:09.595761 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1a19390d-1466-4243-b159-93960ddfd785 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:09.602083 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3425a6d6-bd63-4d9b-aee4-e957c12c78b8 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:09.615201 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3425a6d6-bd63-4d9b-aee4-e957c12c78b8 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:09.616546 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1a19390d-1466-4243-b159-93960ddfd785 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8" status: 200 len: 1310 microversion: 2.1 time: 2.519660 Aug 31 16:01:09.617251 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1393/2692] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:07 2022] GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8 => generated 1310 bytes in 2521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:09.645511 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3425a6d6-bd63-4d9b-aee4-e957c12c78b8 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1544 microversion: 2.91 time: 0.737975 Aug 31 16:01:09.646223 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1300/2693] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:01:08 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1544 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:01:09.652570 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-8dfa5d91-4e44-4d80-a8c4-81bb8598d75b req-3247cc8b-f932-4dd9-8f7a-ec29a06dc49f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b", "name": "network-vif-plugged", "status": "completed", "tag": "4e98deab-3424-49ec-b930-3019d71c32c7"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:01:09.689001 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-8dfa5d91-4e44-4d80-a8c4-81bb8598d75b req-3247cc8b-f932-4dd9-8f7a-ec29a06dc49f service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:09.697339 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-8dfa5d91-4e44-4d80-a8c4-81bb8598d75b req-3247cc8b-f932-4dd9-8f7a-ec29a06dc49f service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:09.697860 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-8dfa5d91-4e44-4d80-a8c4-81bb8598d75b req-3247cc8b-f932-4dd9-8f7a-ec29a06dc49f service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:09.738023 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-8dfa5d91-4e44-4d80-a8c4-81bb8598d75b req-3247cc8b-f932-4dd9-8f7a-ec29a06dc49f service nova] Creating event network-vif-plugged:4e98deab-3424-49ec-b930-3019d71c32c7 for instance 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b on n-h1-833090-16 Aug 31 16:01:09.761095 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-8dfa5d91-4e44-4d80-a8c4-81bb8598d75b req-3247cc8b-f932-4dd9-8f7a-ec29a06dc49f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120626 Aug 31 16:01:09.762047 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1394/2694] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:01:09.924768 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-648eee63-775a-400d-8cf1-a89aece1734c tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:09.926070 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-648eee63-775a-400d-8cf1-a89aece1734c tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 0a301f9c-b1b8-4962-9d46-28981c195069] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:09.948186 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-648eee63-775a-400d-8cf1-a89aece1734c tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:09.948682 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-648eee63-775a-400d-8cf1-a89aece1734c tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:09.949117 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-648eee63-775a-400d-8cf1-a89aece1734c tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:09.949841 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-648eee63-775a-400d-8cf1-a89aece1734c tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:09.957612 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-648eee63-775a-400d-8cf1-a89aece1734c tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:09.958790 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-648eee63-775a-400d-8cf1-a89aece1734c tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:10.643059 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0cfc5e9a-41ac-4f47-bedc-8945e66aace5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:10.645149 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0cfc5e9a-41ac-4f47-bedc-8945e66aace5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 8701d926-4a72-483d-b0a3-57d8ee5f50c8] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:10.668997 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0cfc5e9a-41ac-4f47-bedc-8945e66aace5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:10.674539 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0cfc5e9a-41ac-4f47-bedc-8945e66aace5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:10.675849 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0cfc5e9a-41ac-4f47-bedc-8945e66aace5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:10.678323 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0cfc5e9a-41ac-4f47-bedc-8945e66aace5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:10.682674 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0cfc5e9a-41ac-4f47-bedc-8945e66aace5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:10.683697 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0cfc5e9a-41ac-4f47-bedc-8945e66aace5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:10.755281 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=100 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:01:10.794188 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-648eee63-775a-400d-8cf1-a89aece1734c tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8476b6167a4c838eac59d7c4a40284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a7c84a4ea54074bab3ccc035c5cf47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:10.813755 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-648eee63-775a-400d-8cf1-a89aece1734c tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/0a301f9c-b1b8-4962-9d46-28981c195069" status: 200 len: 1325 microversion: 2.1 time: 0.893308 Aug 31 16:01:10.814532 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1301/2695] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:09 2022] GET /compute/v2.1/servers/0a301f9c-b1b8-4962-9d46-28981c195069 => generated 1325 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:10.820892 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ba442756-928e-44be-9692-c8d6de60a56e tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:10.821843 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ba442756-928e-44be-9692-c8d6de60a56e tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:10.830978 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba442756-928e-44be-9692-c8d6de60a56e tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:10.831569 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba442756-928e-44be-9692-c8d6de60a56e tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:10.832212 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba442756-928e-44be-9692-c8d6de60a56e tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:10.833006 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba442756-928e-44be-9692-c8d6de60a56e tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:10.833550 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba442756-928e-44be-9692-c8d6de60a56e tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:10.834065 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba442756-928e-44be-9692-c8d6de60a56e tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:11.942440 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ba442756-928e-44be-9692-c8d6de60a56e tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:11.961665 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ba442756-928e-44be-9692-c8d6de60a56e tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:11.972607 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ba442756-928e-44be-9692-c8d6de60a56e tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:11.994348 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ba442756-928e-44be-9692-c8d6de60a56e tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1531 microversion: 2.91 time: 1.173245 Aug 31 16:01:12.018800 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1302/2696] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:01:10 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1531 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:01:12.036057 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8d3b22d7-b0dc-4cc9-bc6c-542421216e04 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:12.041182 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8d3b22d7-b0dc-4cc9-bc6c-542421216e04 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 0a301f9c-b1b8-4962-9d46-28981c195069] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:12.051155 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d3b22d7-b0dc-4cc9-bc6c-542421216e04 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:12.055073 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d3b22d7-b0dc-4cc9-bc6c-542421216e04 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:12.055788 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d3b22d7-b0dc-4cc9-bc6c-542421216e04 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:12.057676 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d3b22d7-b0dc-4cc9-bc6c-542421216e04 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:12.061235 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d3b22d7-b0dc-4cc9-bc6c-542421216e04 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:12.061944 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d3b22d7-b0dc-4cc9-bc6c-542421216e04 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:12.171803 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0cfc5e9a-41ac-4f47-bedc-8945e66aace5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:12.184518 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0cfc5e9a-41ac-4f47-bedc-8945e66aace5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8" status: 200 len: 1310 microversion: 2.1 time: 1.546695 Aug 31 16:01:12.186765 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1395/2697] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:10 2022] GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8 => generated 1310 bytes in 1551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:12.196380 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7485cafc-7192-415b-911a-e336da6b6832 tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:12.199781 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7485cafc-7192-415b-911a-e336da6b6832 tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:12.215125 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7485cafc-7192-415b-911a-e336da6b6832 tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:12.218803 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7485cafc-7192-415b-911a-e336da6b6832 tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:12.220110 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7485cafc-7192-415b-911a-e336da6b6832 tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:12.228598 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7485cafc-7192-415b-911a-e336da6b6832 tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:12.233431 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7485cafc-7192-415b-911a-e336da6b6832 tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:12.234829 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7485cafc-7192-415b-911a-e336da6b6832 tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:12.720422 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-7485cafc-7192-415b-911a-e336da6b6832 tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] Lazy-loading 'services' on Instance uuid 05236fda-96c7-419a-95f9-9d90d6e4ce78 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:01:12.760183 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7485cafc-7192-415b-911a-e336da6b6832 tempest-UnshelveToHostMultiNodesTest-1227636099 tempest-UnshelveToHostMultiNodesTest-1227636099-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1938 microversion: 2.91 time: 0.571074 Aug 31 16:01:12.782693 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1396/2698] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:01:12 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1938 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:01:12.782693 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-26bed7e3-6c0d-4457-a6c9-b03b0b8c28dc req-428be7e5-1366-41ba-a752-1a51a8304185 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8701d926-4a72-483d-b0a3-57d8ee5f50c8", "name": "network-vif-plugged", "status": "completed", "tag": "003c66a3-ae1f-4cd7-a8a9-471d61697901"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:01:12.784361 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-26bed7e3-6c0d-4457-a6c9-b03b0b8c28dc req-428be7e5-1366-41ba-a752-1a51a8304185 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:12.786118 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-26bed7e3-6c0d-4457-a6c9-b03b0b8c28dc req-428be7e5-1366-41ba-a752-1a51a8304185 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:12.786786 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-26bed7e3-6c0d-4457-a6c9-b03b0b8c28dc req-428be7e5-1366-41ba-a752-1a51a8304185 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:12.859711 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-26bed7e3-6c0d-4457-a6c9-b03b0b8c28dc req-428be7e5-1366-41ba-a752-1a51a8304185 service nova] Creating event network-vif-plugged:003c66a3-ae1f-4cd7-a8a9-471d61697901 for instance 8701d926-4a72-483d-b0a3-57d8ee5f50c8 on n-h2-833090-16 Aug 31 16:01:12.866031 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-26bed7e3-6c0d-4457-a6c9-b03b0b8c28dc req-428be7e5-1366-41ba-a752-1a51a8304185 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102823 Aug 31 16:01:12.867804 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1397/2699] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:01:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:01:12.876091 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d6b8c33a-8352-4d63-b7b4-2a27b0788281 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:12.877445 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d6b8c33a-8352-4d63-b7b4-2a27b0788281 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:12.892172 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d6b8c33a-8352-4d63-b7b4-2a27b0788281 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:12.892951 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d6b8c33a-8352-4d63-b7b4-2a27b0788281 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:12.893671 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d6b8c33a-8352-4d63-b7b4-2a27b0788281 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:12.894605 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d6b8c33a-8352-4d63-b7b4-2a27b0788281 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:12.895211 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d6b8c33a-8352-4d63-b7b4-2a27b0788281 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:12.896452 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d6b8c33a-8352-4d63-b7b4-2a27b0788281 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:12.980422 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d6b8c33a-8352-4d63-b7b4-2a27b0788281 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:01:13.277954 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d6b8c33a-8352-4d63-b7b4-2a27b0788281 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "DELETE /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 204 len: 0 microversion: 2.91 time: 0.408080 Aug 31 16:01:13.282110 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1398/2700] 10.222.0.50 () {60 vars in 1280 bytes} [Wed Aug 31 16:01:12 2022] DELETE /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 16:01:13.302992 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-88670249-1042-404d-9db4-260c00d2a81d tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:13.306517 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-88670249-1042-404d-9db4-260c00d2a81d tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 8701d926-4a72-483d-b0a3-57d8ee5f50c8] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:13.332399 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-88670249-1042-404d-9db4-260c00d2a81d tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:13.335027 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-88670249-1042-404d-9db4-260c00d2a81d tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:13.337504 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-88670249-1042-404d-9db4-260c00d2a81d tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:13.339862 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-88670249-1042-404d-9db4-260c00d2a81d tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:13.343834 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-88670249-1042-404d-9db4-260c00d2a81d tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:13.352008 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-88670249-1042-404d-9db4-260c00d2a81d tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:14.239215 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8d3b22d7-b0dc-4cc9-bc6c-542421216e04 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8476b6167a4c838eac59d7c4a40284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a7c84a4ea54074bab3ccc035c5cf47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:14.252475 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8d3b22d7-b0dc-4cc9-bc6c-542421216e04 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/0a301f9c-b1b8-4962-9d46-28981c195069" status: 200 len: 1325 microversion: 2.1 time: 2.232197 Aug 31 16:01:14.253071 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1303/2701] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:12 2022] GET /compute/v2.1/servers/0a301f9c-b1b8-4962-9d46-28981c195069 => generated 1325 bytes in 2233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:14.264607 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6acd5d8f-2e63-4345-842a-b297d1499ed7 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:14.271755 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6acd5d8f-2e63-4345-842a-b297d1499ed7 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:14.286715 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:01:14.292183 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6acd5d8f-2e63-4345-842a-b297d1499ed7 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:14.294901 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6acd5d8f-2e63-4345-842a-b297d1499ed7 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:14.295627 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6acd5d8f-2e63-4345-842a-b297d1499ed7 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:14.297382 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6acd5d8f-2e63-4345-842a-b297d1499ed7 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:14.305042 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6acd5d8f-2e63-4345-842a-b297d1499ed7 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:14.306531 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6acd5d8f-2e63-4345-842a-b297d1499ed7 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:14.578518 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6acd5d8f-2e63-4345-842a-b297d1499ed7 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:14.581488 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:01:14.598817 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6acd5d8f-2e63-4345-842a-b297d1499ed7 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:14.602754 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-88670249-1042-404d-9db4-260c00d2a81d tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:14.613490 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-88670249-1042-404d-9db4-260c00d2a81d tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8" status: 200 len: 1310 microversion: 2.1 time: 1.328110 Aug 31 16:01:14.622939 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1399/2702] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:13 2022] GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8 => generated 1310 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:14.628343 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6acd5d8f-2e63-4345-842a-b297d1499ed7 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:14.643977 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6acd5d8f-2e63-4345-842a-b297d1499ed7 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1537 microversion: 2.91 time: 0.380923 Aug 31 16:01:14.655075 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1304/2703] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:01:14 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1537 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:01:15.161576 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-d3ecc2d3-43e7-4877-bc45-5c7e2f4891f5 req-24f93447-fdce-40e7-982a-538a29efea66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a301f9c-b1b8-4962-9d46-28981c195069", "name": "network-vif-plugged", "status": "completed", "tag": "0a0f2e12-4320-44b5-b0bd-10f8f9c2d4d4"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:01:15.201644 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-d3ecc2d3-43e7-4877-bc45-5c7e2f4891f5 req-24f93447-fdce-40e7-982a-538a29efea66 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:15.202271 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-d3ecc2d3-43e7-4877-bc45-5c7e2f4891f5 req-24f93447-fdce-40e7-982a-538a29efea66 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:15.213318 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-d3ecc2d3-43e7-4877-bc45-5c7e2f4891f5 req-24f93447-fdce-40e7-982a-538a29efea66 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:15.243626 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-d3ecc2d3-43e7-4877-bc45-5c7e2f4891f5 req-24f93447-fdce-40e7-982a-538a29efea66 service nova] Creating event network-vif-plugged:0a0f2e12-4320-44b5-b0bd-10f8f9c2d4d4 for instance 0a301f9c-b1b8-4962-9d46-28981c195069 on n-h1-833090-16 Aug 31 16:01:15.252940 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-d3ecc2d3-43e7-4877-bc45-5c7e2f4891f5 req-24f93447-fdce-40e7-982a-538a29efea66 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098802 Aug 31 16:01:15.255819 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1400/2704] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:01:15.273312 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a038a05e-b6a0-4361-8ed1-0653854ae6a0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:15.275198 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a038a05e-b6a0-4361-8ed1-0653854ae6a0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 0a301f9c-b1b8-4962-9d46-28981c195069] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:15.313341 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a038a05e-b6a0-4361-8ed1-0653854ae6a0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:15.320340 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a038a05e-b6a0-4361-8ed1-0653854ae6a0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:15.323572 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a038a05e-b6a0-4361-8ed1-0653854ae6a0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:15.325430 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a038a05e-b6a0-4361-8ed1-0653854ae6a0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:15.329186 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a038a05e-b6a0-4361-8ed1-0653854ae6a0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:15.332486 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a038a05e-b6a0-4361-8ed1-0653854ae6a0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:15.650435 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2ef6de34-090e-4638-8690-3b76fd2069c7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:15.652076 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2ef6de34-090e-4638-8690-3b76fd2069c7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 8701d926-4a72-483d-b0a3-57d8ee5f50c8] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:15.698018 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2ef6de34-090e-4638-8690-3b76fd2069c7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:15.699614 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2ef6de34-090e-4638-8690-3b76fd2069c7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:15.704684 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2ef6de34-090e-4638-8690-3b76fd2069c7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:15.706321 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2ef6de34-090e-4638-8690-3b76fd2069c7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:15.710737 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2ef6de34-090e-4638-8690-3b76fd2069c7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:15.713854 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2ef6de34-090e-4638-8690-3b76fd2069c7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:16.259861 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a038a05e-b6a0-4361-8ed1-0653854ae6a0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8476b6167a4c838eac59d7c4a40284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a7c84a4ea54074bab3ccc035c5cf47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:16.277920 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a038a05e-b6a0-4361-8ed1-0653854ae6a0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/0a301f9c-b1b8-4962-9d46-28981c195069" status: 200 len: 1325 microversion: 2.1 time: 1.007415 Aug 31 16:01:16.281750 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1305/2705] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:15 2022] GET /compute/v2.1/servers/0a301f9c-b1b8-4962-9d46-28981c195069 => generated 1325 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:16.290711 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-18478c97-e3aa-42e7-9a09-df0acfc1ccde tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:16.303714 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-18478c97-e3aa-42e7-9a09-df0acfc1ccde tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:16.319787 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-18478c97-e3aa-42e7-9a09-df0acfc1ccde tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:16.327274 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-18478c97-e3aa-42e7-9a09-df0acfc1ccde tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:16.328160 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-18478c97-e3aa-42e7-9a09-df0acfc1ccde tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:16.329278 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-18478c97-e3aa-42e7-9a09-df0acfc1ccde tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:16.329945 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-18478c97-e3aa-42e7-9a09-df0acfc1ccde tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:16.330609 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-18478c97-e3aa-42e7-9a09-df0acfc1ccde tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:16.423235 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2ef6de34-090e-4638-8690-3b76fd2069c7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:16.437528 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2ef6de34-090e-4638-8690-3b76fd2069c7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8" status: 200 len: 1310 microversion: 2.1 time: 0.792999 Aug 31 16:01:16.442892 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1401/2706] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:15 2022] GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8 => generated 1310 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:16.533037 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-18478c97-e3aa-42e7-9a09-df0acfc1ccde tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:16.561826 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-18478c97-e3aa-42e7-9a09-df0acfc1ccde tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:16.565746 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-18478c97-e3aa-42e7-9a09-df0acfc1ccde tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'acbc85a6cc2347dfb0834848e9fa5fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '273e7f33aad24bd89d3880179c838d8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:16.581976 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-18478c97-e3aa-42e7-9a09-df0acfc1ccde tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 200 len: 1537 microversion: 2.91 time: 0.297173 Aug 31 16:01:16.583373 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1306/2707] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:01:16 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 1537 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:01:17.307804 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3c0b0abf-0b89-427d-af46-0e033add66e9 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:17.309021 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3c0b0abf-0b89-427d-af46-0e033add66e9 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 0a301f9c-b1b8-4962-9d46-28981c195069] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:17.329470 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3c0b0abf-0b89-427d-af46-0e033add66e9 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:17.335023 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3c0b0abf-0b89-427d-af46-0e033add66e9 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:17.335713 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3c0b0abf-0b89-427d-af46-0e033add66e9 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:17.336618 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3c0b0abf-0b89-427d-af46-0e033add66e9 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:17.341239 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3c0b0abf-0b89-427d-af46-0e033add66e9 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:17.342487 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3c0b0abf-0b89-427d-af46-0e033add66e9 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:17.466484 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fadaa294-cb42-45a8-8113-0071ffdfcbf1 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:17.467168 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fadaa294-cb42-45a8-8113-0071ffdfcbf1 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 8701d926-4a72-483d-b0a3-57d8ee5f50c8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:17.478262 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fadaa294-cb42-45a8-8113-0071ffdfcbf1 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:17.478757 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fadaa294-cb42-45a8-8113-0071ffdfcbf1 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:17.479190 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fadaa294-cb42-45a8-8113-0071ffdfcbf1 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:17.485047 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fadaa294-cb42-45a8-8113-0071ffdfcbf1 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:17.485975 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fadaa294-cb42-45a8-8113-0071ffdfcbf1 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:17.486607 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fadaa294-cb42-45a8-8113-0071ffdfcbf1 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:18.119538 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3c0b0abf-0b89-427d-af46-0e033add66e9 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8476b6167a4c838eac59d7c4a40284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a7c84a4ea54074bab3ccc035c5cf47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:18.140785 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3c0b0abf-0b89-427d-af46-0e033add66e9 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/0a301f9c-b1b8-4962-9d46-28981c195069" status: 200 len: 1521 microversion: 2.1 time: 0.834216 Aug 31 16:01:18.143810 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1402/2708] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:17 2022] GET /compute/v2.1/servers/0a301f9c-b1b8-4962-9d46-28981c195069 => generated 1521 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:18.159101 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-02431b2f-e7f9-4312-801a-22680a456622 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:18.160066 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-02431b2f-e7f9-4312-801a-22680a456622 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] [instance: 05236fda-96c7-419a-95f9-9d90d6e4ce78] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:18.177322 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-02431b2f-e7f9-4312-801a-22680a456622 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:18.178084 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-02431b2f-e7f9-4312-801a-22680a456622 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:18.178731 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-02431b2f-e7f9-4312-801a-22680a456622 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:18.180128 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-02431b2f-e7f9-4312-801a-22680a456622 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:18.180865 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-02431b2f-e7f9-4312-801a-22680a456622 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:18.181453 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-02431b2f-e7f9-4312-801a-22680a456622 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:18.219749 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-02431b2f-e7f9-4312-801a-22680a456622 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] HTTP exception thrown: Instance 05236fda-96c7-419a-95f9-9d90d6e4ce78 could not be found. Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-02431b2f-e7f9-4312-801a-22680a456622 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Request method failure captured: Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 HTTP/1.1 Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4T8jbYEAGbTCMjrB4BvqODruXIdB4HKRfq6enaCAbftMie1VSHNk7gvoCf6rUYxFH5lp4kGWfNqDBtVU2lVy2PQusbtj2llygKvNi_IZw8DnopcSfTUYJILzBiDYlJj9D-gkWxrzRBI_tLl-pCAbK6hqTJ7tQhjlO3nzgA8QHZoxTc Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: X-Openstack-Nova-Api-Version: 2.91 Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 273e7f33aad24bd89d3880179c838d8f Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-2082448690 Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/273e7f33aad24bd89d3880179c838d8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/273e7f33aad24bd89d3880179c838d8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/273e7f33aad24bd89d3880179c838d8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_273e7f33aad24bd89d3880179c838d8f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-2082448690 Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 273e7f33aad24bd89d3880179c838d8f Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-2082448690 Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-UnshelveToHostMultiNodesTest-2082448690-project Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: acbc85a6cc2347dfb0834848e9fa5fcd Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-2082448690-project Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 05236fda-96c7-419a-95f9-9d90d6e4ce78 could not be found. Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '05236fda-96c7-419a-95f9-9d90d6e4ce78'} Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05236fda-96c7-419a-95f9-9d90d6e4ce78 could not be found. Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05236fda-96c7-419a-95f9-9d90d6e4ce78 could not be found. Aug 31 16:01:18.222001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:01:18.228796 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:01:18.228796 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:01:18.228796 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:01:18.228796 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:01:18.228796 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:01:18.228796 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:01:18.228796 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:01:18.228796 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05236fda-96c7-419a-95f9-9d90d6e4ce78 could not be found. Aug 31 16:01:18.228796 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:01:18.228796 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-02431b2f-e7f9-4312-801a-22680a456622 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] Returning 404 to user: Instance 05236fda-96c7-419a-95f9-9d90d6e4ce78 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:01:18.228796 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-02431b2f-e7f9-4312-801a-22680a456622 tempest-UnshelveToHostMultiNodesTest-2082448690 tempest-UnshelveToHostMultiNodesTest-2082448690-project] 10.222.0.50 "GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78" status: 404 len: 111 microversion: 2.91 time: 0.077868 Aug 31 16:01:18.228796 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1403/2709] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:01:18 2022] GET /compute/v2.1/servers/05236fda-96c7-419a-95f9-9d90d6e4ce78 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:01:18.249130 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c72d7214-2141-41b6-b8f8-95d9bb2862b5 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:18.249777 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c72d7214-2141-41b6-b8f8-95d9bb2862b5 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 0a301f9c-b1b8-4962-9d46-28981c195069] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:18.266183 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c72d7214-2141-41b6-b8f8-95d9bb2862b5 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:18.267028 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c72d7214-2141-41b6-b8f8-95d9bb2862b5 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:18.268768 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c72d7214-2141-41b6-b8f8-95d9bb2862b5 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:18.270027 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c72d7214-2141-41b6-b8f8-95d9bb2862b5 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:18.271014 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c72d7214-2141-41b6-b8f8-95d9bb2862b5 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:18.271667 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c72d7214-2141-41b6-b8f8-95d9bb2862b5 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:18.721922 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fadaa294-cb42-45a8-8113-0071ffdfcbf1 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:18.731327 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fadaa294-cb42-45a8-8113-0071ffdfcbf1 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8" status: 200 len: 1493 microversion: 2.1 time: 1.268986 Aug 31 16:01:18.744766 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1307/2710] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:17 2022] GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8 => generated 1493 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:01:18.940779 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c72d7214-2141-41b6-b8f8-95d9bb2862b5 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8476b6167a4c838eac59d7c4a40284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a7c84a4ea54074bab3ccc035c5cf47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:18.971363 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c72d7214-2141-41b6-b8f8-95d9bb2862b5 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/0a301f9c-b1b8-4962-9d46-28981c195069" status: 200 len: 1521 microversion: 2.1 time: 0.746195 Aug 31 16:01:18.971983 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1404/2711] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:18 2022] GET /compute/v2.1/servers/0a301f9c-b1b8-4962-9d46-28981c195069 => generated 1521 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:18.999754 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d1d6b1f6-65b1-4dd4-9e41-a07fe79ef8d8 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1964777893"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:01:19.018365 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d1d6b1f6-65b1-4dd4-9e41-a07fe79ef8d8 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 0a301f9c-b1b8-4962-9d46-28981c195069] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:19.031670 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d1d6b1f6-65b1-4dd4-9e41-a07fe79ef8d8 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:19.035095 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d1d6b1f6-65b1-4dd4-9e41-a07fe79ef8d8 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:19.035944 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d1d6b1f6-65b1-4dd4-9e41-a07fe79ef8d8 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:19.036991 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d1d6b1f6-65b1-4dd4-9e41-a07fe79ef8d8 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:19.038825 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d1d6b1f6-65b1-4dd4-9e41-a07fe79ef8d8 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:19.039509 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d1d6b1f6-65b1-4dd4-9e41-a07fe79ef8d8 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:19.512396 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d1d6b1f6-65b1-4dd4-9e41-a07fe79ef8d8 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "POST /compute/v2.1/servers/0a301f9c-b1b8-4962-9d46-28981c195069/action" status: 202 len: 0 microversion: 2.1 time: 0.502428 Aug 31 16:01:19.526037 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1405/2712] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:01:18 2022] POST /compute/v2.1/servers/0a301f9c-b1b8-4962-9d46-28981c195069/action => generated 0 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 31 16:01:19.541880 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a691061b-c730-430d-8d4d-7856f334eba9 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '.version_select at 0x7fbb460009d0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:19.833071 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6b4aafa3-e5c0-4a5c-93ec-466c51f382fa tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:19.833684 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6b4aafa3-e5c0-4a5c-93ec-466c51f382fa tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] [instance: 8701d926-4a72-483d-b0a3-57d8ee5f50c8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:19.844101 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b4aafa3-e5c0-4a5c-93ec-466c51f382fa tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:19.844656 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b4aafa3-e5c0-4a5c-93ec-466c51f382fa tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:19.845032 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b4aafa3-e5c0-4a5c-93ec-466c51f382fa tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:19.845737 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b4aafa3-e5c0-4a5c-93ec-466c51f382fa tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:19.846226 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b4aafa3-e5c0-4a5c-93ec-466c51f382fa tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:19.846646 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b4aafa3-e5c0-4a5c-93ec-466c51f382fa tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:19.959247 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a691061b-c730-430d-8d4d-7856f334eba9 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "DELETE /compute/v2.1/images/3eed9ace-8553-40e5-a219-0648d54c9edd" status: 204 len: 0 microversion: 2.1 time: 0.424030 Aug 31 16:01:19.961397 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1406/2713] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:19 2022] DELETE /compute/v2.1/images/3eed9ace-8553-40e5-a219-0648d54c9edd => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:01:19.978611 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-cfbcfd80-5453-40a2-87b8-bad679991231 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '.version_select at 0x7fbb46000310>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:20.036777 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-cfbcfd80-5453-40a2-87b8-bad679991231 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] HTTP exception thrown: Image not found. Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-cfbcfd80-5453-40a2-87b8-bad679991231 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Request method failure captured: Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/images/3eed9ace-8553-40e5-a219-0648d54c9edd HTTP/1.1 Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4VuegaF_fmy46ih3aH48SHyk9S0K5f6VgFr4AjCz2qlep55514N16M8NDogA4-FaRt5exvJysgb4a16NCF-uwnoFVaAwgVvS87_klTsI4Q1cOt4rcQPW4Ao3jepMn1MxMfgCP9op9_ywmQywVzBp5itFLK6pFxwsw-bP4gtv8ayT6Y Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 75a7c84a4ea54074bab3ccc035c5cf47 Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2143463755 Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/75a7c84a4ea54074bab3ccc035c5cf47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/75a7c84a4ea54074bab3ccc035c5cf47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/75a7c84a4ea54074bab3ccc035c5cf47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_75a7c84a4ea54074bab3ccc035c5cf47", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2143463755 Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 75a7c84a4ea54074bab3ccc035c5cf47 Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2143463755 Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ImagesOneServerNegativeTestJSON-2143463755-project Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 3c8476b6167a4c838eac59d7c4a40284 Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2143463755-project Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: method: Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: exception: Image not found. Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '3eed9ace-8553-40e5-a219-0648d54c9edd'} Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 3eed9ace-8553-40e5-a219-0648d54c9edd Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 31 16:01:20.039823 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 31 16:01:20.043770 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 31 16:01:20.043770 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 31 16:01:20.043770 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 31 16:01:20.043770 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 16:01:20.043770 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 16:01:20.043770 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 31 16:01:20.043770 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 31 16:01:20.043770 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 16:01:20.043770 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 16:01:20.043770 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 31 16:01:20.043770 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 31 16:01:20.043770 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 31 16:01:20.043770 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 31 16:01:20.043770 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 16:01:20.043770 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 16:01:20.043770 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 16:01:20.043770 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 16:01:20.043770 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3eed9ace-8553-40e5-a219-0648d54c9edd could not be found. Aug 31 16:01:20.043770 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:01:20.043770 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:01:20.043770 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:01:20.043770 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:01:20.043770 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:01:20.043770 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:01:20.043770 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:01:20.043770 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:01:20.043770 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:01:20.043770 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:01:20.043770 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:01:20.043770 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:01:20.043770 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 31 16:01:20.043770 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 31 16:01:20.043770 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 31 16:01:20.043770 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:01:20.043770 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:01:20.043770 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:01:20.043770 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:01:20.043770 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:01:20.043770 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:01:20.043770 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:01:20.043770 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:01:20.043770 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 31 16:01:20.043770 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:01:20.053168 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-cfbcfd80-5453-40a2-87b8-bad679991231 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Returning 404 to user: Image not found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:01:20.054434 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-cfbcfd80-5453-40a2-87b8-bad679991231 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/images/3eed9ace-8553-40e5-a219-0648d54c9edd" status: 404 len: 62 microversion: 2.1 time: 0.088704 Aug 31 16:01:20.056287 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1407/2714] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:01:19 2022] GET /compute/v2.1/images/3eed9ace-8553-40e5-a219-0648d54c9edd => generated 62 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 16:01:20.074733 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-72f64c00-b302-4275-aa1f-77d6e431129f tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:20.075563 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-72f64c00-b302-4275-aa1f-77d6e431129f tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 0a301f9c-b1b8-4962-9d46-28981c195069] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:20.106605 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-72f64c00-b302-4275-aa1f-77d6e431129f tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:20.107126 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-72f64c00-b302-4275-aa1f-77d6e431129f tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:20.107720 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-72f64c00-b302-4275-aa1f-77d6e431129f tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:20.116444 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-72f64c00-b302-4275-aa1f-77d6e431129f tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:20.117072 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-72f64c00-b302-4275-aa1f-77d6e431129f tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:20.118815 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-72f64c00-b302-4275-aa1f-77d6e431129f tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:21.092749 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6b4aafa3-e5c0-4a5c-93ec-466c51f382fa tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8" status: 200 len: 1646 microversion: 2.1 time: 2.330117 Aug 31 16:01:21.102360 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1308/2715] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:18 2022] GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8 => generated 1646 bytes in 2336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:21.124031 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c8ccd795-0743-456d-b438-edf862fb7f1b tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:21.127619 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c8ccd795-0743-456d-b438-edf862fb7f1b tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] [instance: 8701d926-4a72-483d-b0a3-57d8ee5f50c8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:21.152023 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8ccd795-0743-456d-b438-edf862fb7f1b tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:21.155269 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8ccd795-0743-456d-b438-edf862fb7f1b tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:21.156067 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8ccd795-0743-456d-b438-edf862fb7f1b tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:21.157638 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8ccd795-0743-456d-b438-edf862fb7f1b tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:21.162054 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8ccd795-0743-456d-b438-edf862fb7f1b tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:21.163373 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8ccd795-0743-456d-b438-edf862fb7f1b tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:22.318813 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-72f64c00-b302-4275-aa1f-77d6e431129f tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8476b6167a4c838eac59d7c4a40284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a7c84a4ea54074bab3ccc035c5cf47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:22.338373 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-72f64c00-b302-4275-aa1f-77d6e431129f tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/0a301f9c-b1b8-4962-9d46-28981c195069" status: 200 len: 1533 microversion: 2.1 time: 2.277761 Aug 31 16:01:22.355144 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1408/2716] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:20 2022] GET /compute/v2.1/servers/0a301f9c-b1b8-4962-9d46-28981c195069 => generated 1533 bytes in 2295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:23.112308 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c8ccd795-0743-456d-b438-edf862fb7f1b tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8" status: 200 len: 1646 microversion: 2.1 time: 1.998836 Aug 31 16:01:23.114206 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1309/2717] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:21 2022] GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8 => generated 1646 bytes in 2002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:23.145667 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-db61498b-8a2c-4ec7-aabb-40b4558a6200 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:23.149896 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db61498b-8a2c-4ec7-aabb-40b4558a6200 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:23.152871 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db61498b-8a2c-4ec7-aabb-40b4558a6200 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:23.153493 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db61498b-8a2c-4ec7-aabb-40b4558a6200 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:23.157304 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db61498b-8a2c-4ec7-aabb-40b4558a6200 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:23.158492 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db61498b-8a2c-4ec7-aabb-40b4558a6200 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:23.159467 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db61498b-8a2c-4ec7-aabb-40b4558a6200 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:23.251466 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-db61498b-8a2c-4ec7-aabb-40b4558a6200 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.110716 Aug 31 16:01:23.252741 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1409/2718] 10.222.0.50 () {58 vars in 1176 bytes} [Wed Aug 31 16:01:23 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:01:23.264667 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-330150db-beed-4f0c-acfc-3080bd787773 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-833090-16", "block_migration": true, "disk_over_commit": false}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:01:23.268243 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-330150db-beed-4f0c-acfc-3080bd787773 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] [instance: 8701d926-4a72-483d-b0a3-57d8ee5f50c8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:23.286814 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-330150db-beed-4f0c-acfc-3080bd787773 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:23.291345 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-330150db-beed-4f0c-acfc-3080bd787773 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:23.294492 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-330150db-beed-4f0c-acfc-3080bd787773 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:23.297749 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-330150db-beed-4f0c-acfc-3080bd787773 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:23.299667 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-330150db-beed-4f0c-acfc-3080bd787773 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:23.300116 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-330150db-beed-4f0c-acfc-3080bd787773 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:23.380818 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-36d888b4-69d9-480f-943a-e7513c4900d1 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:23.382021 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-36d888b4-69d9-480f-943a-e7513c4900d1 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 0a301f9c-b1b8-4962-9d46-28981c195069] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:23.391416 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-330150db-beed-4f0c-acfc-3080bd787773 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lazy-loading 'flavor' on Instance uuid 8701d926-4a72-483d-b0a3-57d8ee5f50c8 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:01:23.411525 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-36d888b4-69d9-480f-943a-e7513c4900d1 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:23.421375 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-36d888b4-69d9-480f-943a-e7513c4900d1 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:23.422071 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-36d888b4-69d9-480f-943a-e7513c4900d1 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:23.425552 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-36d888b4-69d9-480f-943a-e7513c4900d1 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:23.429562 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-36d888b4-69d9-480f-943a-e7513c4900d1 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:23.433068 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-36d888b4-69d9-480f-943a-e7513c4900d1 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:23.472411 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-330150db-beed-4f0c-acfc-3080bd787773 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] [instance: 8701d926-4a72-483d-b0a3-57d8ee5f50c8] Going to try to live migrate instance to n-h1-833090-16 {{(pid=128863) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 31 16:01:24.950869 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-36d888b4-69d9-480f-943a-e7513c4900d1 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8476b6167a4c838eac59d7c4a40284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a7c84a4ea54074bab3ccc035c5cf47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:24.964666 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-36d888b4-69d9-480f-943a-e7513c4900d1 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/0a301f9c-b1b8-4962-9d46-28981c195069" status: 200 len: 1521 microversion: 2.1 time: 1.590062 Aug 31 16:01:24.976280 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1410/2719] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:23 2022] GET /compute/v2.1/servers/0a301f9c-b1b8-4962-9d46-28981c195069 => generated 1521 bytes in 1602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:25.006440 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7291efb3-d6f9-4ba1-87fe-7231d05c8cfa tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:25.010826 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7291efb3-d6f9-4ba1-87fe-7231d05c8cfa tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 0a301f9c-b1b8-4962-9d46-28981c195069] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:25.037651 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7291efb3-d6f9-4ba1-87fe-7231d05c8cfa tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:25.046832 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7291efb3-d6f9-4ba1-87fe-7231d05c8cfa tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:25.049831 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7291efb3-d6f9-4ba1-87fe-7231d05c8cfa tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:25.055289 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7291efb3-d6f9-4ba1-87fe-7231d05c8cfa tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:25.057051 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7291efb3-d6f9-4ba1-87fe-7231d05c8cfa tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:25.058971 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7291efb3-d6f9-4ba1-87fe-7231d05c8cfa tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:25.169310 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7291efb3-d6f9-4ba1-87fe-7231d05c8cfa tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 0a301f9c-b1b8-4962-9d46-28981c195069] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:01:25.365054 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:01:25.455165 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7291efb3-d6f9-4ba1-87fe-7231d05c8cfa tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0a301f9c-b1b8-4962-9d46-28981c195069" status: 204 len: 0 microversion: 2.1 time: 0.471020 Aug 31 16:01:25.459630 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1411/2720] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:01:24 2022] DELETE /compute/v2.1/servers/0a301f9c-b1b8-4962-9d46-28981c195069 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:01:25.476013 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-af66679c-444d-4f64-affd-95dd7f7f8a69 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:25.477130 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-af66679c-444d-4f64-affd-95dd7f7f8a69 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 0a301f9c-b1b8-4962-9d46-28981c195069] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:25.490789 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-af66679c-444d-4f64-affd-95dd7f7f8a69 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:25.491645 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-af66679c-444d-4f64-affd-95dd7f7f8a69 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:25.492305 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-af66679c-444d-4f64-affd-95dd7f7f8a69 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:25.493249 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-af66679c-444d-4f64-affd-95dd7f7f8a69 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:25.493911 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-af66679c-444d-4f64-affd-95dd7f7f8a69 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:25.501034 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-af66679c-444d-4f64-affd-95dd7f7f8a69 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:26.330655 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-af66679c-444d-4f64-affd-95dd7f7f8a69 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8476b6167a4c838eac59d7c4a40284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a7c84a4ea54074bab3ccc035c5cf47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:26.344466 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-af66679c-444d-4f64-affd-95dd7f7f8a69 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/0a301f9c-b1b8-4962-9d46-28981c195069" status: 200 len: 1527 microversion: 2.1 time: 0.883113 Aug 31 16:01:26.352553 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1412/2721] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:25 2022] GET /compute/v2.1/servers/0a301f9c-b1b8-4962-9d46-28981c195069 => generated 1527 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:27.374565 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1baa1cd4-68f5-4df5-b372-38773fb1175e tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:27.375539 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1baa1cd4-68f5-4df5-b372-38773fb1175e tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 0a301f9c-b1b8-4962-9d46-28981c195069] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:27.391391 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1baa1cd4-68f5-4df5-b372-38773fb1175e tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:27.412415 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1baa1cd4-68f5-4df5-b372-38773fb1175e tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:27.413476 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1baa1cd4-68f5-4df5-b372-38773fb1175e tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:27.416208 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1baa1cd4-68f5-4df5-b372-38773fb1175e tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:27.420430 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1baa1cd4-68f5-4df5-b372-38773fb1175e tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:27.421216 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1baa1cd4-68f5-4df5-b372-38773fb1175e tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:28.273622 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1baa1cd4-68f5-4df5-b372-38773fb1175e tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8476b6167a4c838eac59d7c4a40284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a7c84a4ea54074bab3ccc035c5cf47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:28.285164 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1baa1cd4-68f5-4df5-b372-38773fb1175e tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/0a301f9c-b1b8-4962-9d46-28981c195069" status: 200 len: 1527 microversion: 2.1 time: 0.915879 Aug 31 16:01:28.285775 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1413/2722] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:27 2022] GET /compute/v2.1/servers/0a301f9c-b1b8-4962-9d46-28981c195069 => generated 1527 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:28.529456 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-330150db-beed-4f0c-acfc-3080bd787773 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8/action" status: 202 len: 0 microversion: 2.1 time: 5.268736 Aug 31 16:01:28.531354 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1310/2723] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:01:23 2022] POST /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8/action => generated 0 bytes in 5271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:01:28.538565 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1a4d7dab-b514-422a-b4e6-932e9f1411c6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:28.539656 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1a4d7dab-b514-422a-b4e6-932e9f1411c6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 8701d926-4a72-483d-b0a3-57d8ee5f50c8] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:28.556251 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a4d7dab-b514-422a-b4e6-932e9f1411c6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:28.557718 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a4d7dab-b514-422a-b4e6-932e9f1411c6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:28.562908 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a4d7dab-b514-422a-b4e6-932e9f1411c6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:28.565107 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a4d7dab-b514-422a-b4e6-932e9f1411c6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:28.567572 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a4d7dab-b514-422a-b4e6-932e9f1411c6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:28.569661 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a4d7dab-b514-422a-b4e6-932e9f1411c6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:28.861147 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-e569c036-6eed-43ba-a1ab-d8f3a5a962e0 req-e5bbf212-fb73-46c4-b48a-8a0e9ff6e589 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a301f9c-b1b8-4962-9d46-28981c195069", "name": "network-vif-deleted", "tag": "0a0f2e12-4320-44b5-b0bd-10f8f9c2d4d4"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:01:28.901223 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e569c036-6eed-43ba-a1ab-d8f3a5a962e0 req-e5bbf212-fb73-46c4-b48a-8a0e9ff6e589 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:28.901879 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e569c036-6eed-43ba-a1ab-d8f3a5a962e0 req-e5bbf212-fb73-46c4-b48a-8a0e9ff6e589 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:28.905292 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e569c036-6eed-43ba-a1ab-d8f3a5a962e0 req-e5bbf212-fb73-46c4-b48a-8a0e9ff6e589 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:28.988175 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-e569c036-6eed-43ba-a1ab-d8f3a5a962e0 req-e5bbf212-fb73-46c4-b48a-8a0e9ff6e589 service nova] Creating event network-vif-deleted:0a0f2e12-4320-44b5-b0bd-10f8f9c2d4d4 for instance 0a301f9c-b1b8-4962-9d46-28981c195069 on n-h1-833090-16 Aug 31 16:01:29.019387 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-e569c036-6eed-43ba-a1ab-d8f3a5a962e0 req-e5bbf212-fb73-46c4-b48a-8a0e9ff6e589 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163163 Aug 31 16:01:29.020009 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1311/2724] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:01:29.308694 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-13b32467-8e89-49f8-bdfb-8a3eeccc1aac tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:29.309797 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-13b32467-8e89-49f8-bdfb-8a3eeccc1aac tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 0a301f9c-b1b8-4962-9d46-28981c195069] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:29.323361 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13b32467-8e89-49f8-bdfb-8a3eeccc1aac tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:29.323845 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13b32467-8e89-49f8-bdfb-8a3eeccc1aac tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:29.328946 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13b32467-8e89-49f8-bdfb-8a3eeccc1aac tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:29.331587 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13b32467-8e89-49f8-bdfb-8a3eeccc1aac tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:29.337176 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13b32467-8e89-49f8-bdfb-8a3eeccc1aac tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:29.337914 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13b32467-8e89-49f8-bdfb-8a3eeccc1aac tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:29.403768 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1a4d7dab-b514-422a-b4e6-932e9f1411c6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:29.423728 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1a4d7dab-b514-422a-b4e6-932e9f1411c6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8" status: 200 len: 1503 microversion: 2.1 time: 0.889114 Aug 31 16:01:29.426845 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1414/2725] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:28 2022] GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8 => generated 1503 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:29.441740 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13b32467-8e89-49f8-bdfb-8a3eeccc1aac tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:29.442523 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13b32467-8e89-49f8-bdfb-8a3eeccc1aac tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:29.443227 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13b32467-8e89-49f8-bdfb-8a3eeccc1aac tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:29.443834 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-13b32467-8e89-49f8-bdfb-8a3eeccc1aac tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lazy-loading 'fault' on Instance uuid 0a301f9c-b1b8-4962-9d46-28981c195069 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:01:29.628033 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-13b32467-8e89-49f8-bdfb-8a3eeccc1aac tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8476b6167a4c838eac59d7c4a40284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a7c84a4ea54074bab3ccc035c5cf47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:29.643111 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-13b32467-8e89-49f8-bdfb-8a3eeccc1aac tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/0a301f9c-b1b8-4962-9d46-28981c195069" status: 200 len: 1315 microversion: 2.1 time: 0.338870 Aug 31 16:01:29.654607 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1312/2726] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:29 2022] GET /compute/v2.1/servers/0a301f9c-b1b8-4962-9d46-28981c195069 => generated 1315 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:01:30.448986 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5585f1af-7011-4e2f-9de7-b9caabe91295 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:30.450655 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5585f1af-7011-4e2f-9de7-b9caabe91295 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 8701d926-4a72-483d-b0a3-57d8ee5f50c8] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:30.454936 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:01:30.492771 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5585f1af-7011-4e2f-9de7-b9caabe91295 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:30.495148 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5585f1af-7011-4e2f-9de7-b9caabe91295 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:30.495778 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5585f1af-7011-4e2f-9de7-b9caabe91295 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:30.501239 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5585f1af-7011-4e2f-9de7-b9caabe91295 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:30.503638 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5585f1af-7011-4e2f-9de7-b9caabe91295 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:30.505219 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5585f1af-7011-4e2f-9de7-b9caabe91295 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:30.673259 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d8e4866a-9241-4c51-9ec8-faada8c69662 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:30.674955 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d8e4866a-9241-4c51-9ec8-faada8c69662 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 0a301f9c-b1b8-4962-9d46-28981c195069] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:30.739459 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8e4866a-9241-4c51-9ec8-faada8c69662 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:30.753106 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8e4866a-9241-4c51-9ec8-faada8c69662 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:30.760972 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8e4866a-9241-4c51-9ec8-faada8c69662 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:30.790727 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8e4866a-9241-4c51-9ec8-faada8c69662 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:30.796340 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8e4866a-9241-4c51-9ec8-faada8c69662 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:30.801837 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8e4866a-9241-4c51-9ec8-faada8c69662 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:30.978232 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-d8e4866a-9241-4c51-9ec8-faada8c69662 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] HTTP exception thrown: Instance 0a301f9c-b1b8-4962-9d46-28981c195069 could not be found. Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d8e4866a-9241-4c51-9ec8-faada8c69662 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Request method failure captured: Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/0a301f9c-b1b8-4962-9d46-28981c195069 HTTP/1.1 Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4VuegaF_fmy46ih3aH48SHyk9S0K5f6VgFr4AjCz2qlep55514N16M8NDogA4-FaRt5exvJysgb4a16NCF-uwnoFVaAwgVvS87_klTsI4Q1cOt4rcQPW4Ao3jepMn1MxMfgCP9op9_ywmQywVzBp5itFLK6pFxwsw-bP4gtv8ayT6Y Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 75a7c84a4ea54074bab3ccc035c5cf47 Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2143463755 Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/75a7c84a4ea54074bab3ccc035c5cf47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/75a7c84a4ea54074bab3ccc035c5cf47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/75a7c84a4ea54074bab3ccc035c5cf47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_75a7c84a4ea54074bab3ccc035c5cf47", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2143463755 Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 75a7c84a4ea54074bab3ccc035c5cf47 Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2143463755 Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ImagesOneServerNegativeTestJSON-2143463755-project Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 3c8476b6167a4c838eac59d7c4a40284 Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2143463755-project Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 0a301f9c-b1b8-4962-9d46-28981c195069 could not be found. Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '0a301f9c-b1b8-4962-9d46-28981c195069'} Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a301f9c-b1b8-4962-9d46-28981c195069 could not be found. Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a301f9c-b1b8-4962-9d46-28981c195069 could not be found. Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:01:31.013699 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:01:31.022880 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:01:31.022880 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:01:31.022880 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:01:31.022880 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:01:31.022880 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:01:31.022880 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:01:31.022880 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a301f9c-b1b8-4962-9d46-28981c195069 could not be found. Aug 31 16:01:31.022880 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:01:31.027677 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d8e4866a-9241-4c51-9ec8-faada8c69662 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Returning 404 to user: Instance 0a301f9c-b1b8-4962-9d46-28981c195069 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:01:31.038456 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d8e4866a-9241-4c51-9ec8-faada8c69662 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/0a301f9c-b1b8-4962-9d46-28981c195069" status: 404 len: 111 microversion: 2.1 time: 0.368694 Aug 31 16:01:31.052685 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1313/2727] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:30 2022] GET /compute/v2.1/servers/0a301f9c-b1b8-4962-9d46-28981c195069 => generated 111 bytes in 378 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:01:31.360324 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7493247c-05dd-4b4d-bbc7-548f2527cf43 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1786512964", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:01:32.184911 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5585f1af-7011-4e2f-9de7-b9caabe91295 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:32.205155 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5585f1af-7011-4e2f-9de7-b9caabe91295 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8" status: 200 len: 1503 microversion: 2.1 time: 1.762691 Aug 31 16:01:32.206653 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1415/2728] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:30 2022] GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8 => generated 1503 bytes in 1766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:33.231489 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-772dc60a-cd34-4141-ae2e-e839bcd1008b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:33.232139 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-772dc60a-cd34-4141-ae2e-e839bcd1008b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 8701d926-4a72-483d-b0a3-57d8ee5f50c8] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:33.235957 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:01:33.276141 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-772dc60a-cd34-4141-ae2e-e839bcd1008b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:33.276631 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-772dc60a-cd34-4141-ae2e-e839bcd1008b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:33.277065 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-772dc60a-cd34-4141-ae2e-e839bcd1008b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:33.283920 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-772dc60a-cd34-4141-ae2e-e839bcd1008b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:33.290229 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-772dc60a-cd34-4141-ae2e-e839bcd1008b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:33.292114 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-772dc60a-cd34-4141-ae2e-e839bcd1008b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:34.449175 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-772dc60a-cd34-4141-ae2e-e839bcd1008b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:34.466496 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-772dc60a-cd34-4141-ae2e-e839bcd1008b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8" status: 200 len: 1503 microversion: 2.1 time: 1.240332 Aug 31 16:01:34.497312 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1416/2729] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:33 2022] GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8 => generated 1503 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:01:35.048952 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-43af29e8-f299-4b93-bc8d-bc4ba896ea25 req-7f6f2982-5684-4bff-97f7-351a66ac5466 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8701d926-4a72-483d-b0a3-57d8ee5f50c8", "name": "network-vif-unplugged", "status": "completed", "tag": "003c66a3-ae1f-4cd7-a8a9-471d61697901"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:01:35.075841 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-43af29e8-f299-4b93-bc8d-bc4ba896ea25 req-7f6f2982-5684-4bff-97f7-351a66ac5466 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:35.076340 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-43af29e8-f299-4b93-bc8d-bc4ba896ea25 req-7f6f2982-5684-4bff-97f7-351a66ac5466 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:35.076792 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-43af29e8-f299-4b93-bc8d-bc4ba896ea25 req-7f6f2982-5684-4bff-97f7-351a66ac5466 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:35.116386 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-43af29e8-f299-4b93-bc8d-bc4ba896ea25 req-7f6f2982-5684-4bff-97f7-351a66ac5466 service nova] Creating event network-vif-unplugged:003c66a3-ae1f-4cd7-a8a9-471d61697901 for instance 8701d926-4a72-483d-b0a3-57d8ee5f50c8 on n-h2-833090-16 Aug 31 16:01:35.133847 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-43af29e8-f299-4b93-bc8d-bc4ba896ea25 req-7f6f2982-5684-4bff-97f7-351a66ac5466 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089259 Aug 31 16:01:35.140569 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1417/2730] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:01:35.491885 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c67a2a8f-fd6a-48db-8c22-2f519b0470b2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:35.493340 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c67a2a8f-fd6a-48db-8c22-2f519b0470b2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 8701d926-4a72-483d-b0a3-57d8ee5f50c8] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:35.507914 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c67a2a8f-fd6a-48db-8c22-2f519b0470b2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:35.521853 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c67a2a8f-fd6a-48db-8c22-2f519b0470b2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:35.522496 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c67a2a8f-fd6a-48db-8c22-2f519b0470b2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:35.525081 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c67a2a8f-fd6a-48db-8c22-2f519b0470b2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:35.527259 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c67a2a8f-fd6a-48db-8c22-2f519b0470b2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:35.528607 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c67a2a8f-fd6a-48db-8c22-2f519b0470b2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:35.966606 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-7493247c-05dd-4b4d-bbc7-548f2527cf43 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] validate_networks() for [('eefa5116-da2b-41a1-b131-8cada4400b07', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:01:36.230852 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c67a2a8f-fd6a-48db-8c22-2f519b0470b2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:36.258075 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c67a2a8f-fd6a-48db-8c22-2f519b0470b2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8" status: 200 len: 1503 microversion: 2.1 time: 0.770539 Aug 31 16:01:36.258710 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1418/2731] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:35 2022] GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8 => generated 1503 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:36.304670 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-29cd34b9-d96a-45c3-bce2-972a5a5ce693 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:36.306471 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-29cd34b9-d96a-45c3-bce2-972a5a5ce693 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:36.335213 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-29cd34b9-d96a-45c3-bce2-972a5a5ce693 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:36.335716 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-29cd34b9-d96a-45c3-bce2-972a5a5ce693 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:36.348318 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-29cd34b9-d96a-45c3-bce2-972a5a5ce693 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:36.350636 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-29cd34b9-d96a-45c3-bce2-972a5a5ce693 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:36.351938 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-29cd34b9-d96a-45c3-bce2-972a5a5ce693 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:36.355887 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-29cd34b9-d96a-45c3-bce2-972a5a5ce693 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:37.749764 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-29cd34b9-d96a-45c3-bce2-972a5a5ce693 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:37.761791 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-29cd34b9-d96a-45c3-bce2-972a5a5ce693 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1684 microversion: 2.1 time: 1.482661 Aug 31 16:01:37.770473 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1419/2732] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:36 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1684 bytes in 1511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:37.780101 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d6ad1bf7-612a-4ef3-b158-18bc563532c2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:37.781521 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d6ad1bf7-612a-4ef3-b158-18bc563532c2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 8701d926-4a72-483d-b0a3-57d8ee5f50c8] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:37.798463 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d6ad1bf7-612a-4ef3-b158-18bc563532c2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:37.798996 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d6ad1bf7-612a-4ef3-b158-18bc563532c2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:37.799492 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d6ad1bf7-612a-4ef3-b158-18bc563532c2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:37.800219 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d6ad1bf7-612a-4ef3-b158-18bc563532c2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:37.800704 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d6ad1bf7-612a-4ef3-b158-18bc563532c2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:37.801123 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d6ad1bf7-612a-4ef3-b158-18bc563532c2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:38.436473 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d6ad1bf7-612a-4ef3-b158-18bc563532c2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:38.449690 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d6ad1bf7-612a-4ef3-b158-18bc563532c2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8" status: 200 len: 1503 microversion: 2.1 time: 0.677687 Aug 31 16:01:38.450460 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1420/2733] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:37 2022] GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8 => generated 1503 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:38.469463 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-fb92de8a-3158-4226-b68b-4574ff20e8fd req-1bd5ce02-dff6-40f5-92c6-2702437955c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8701d926-4a72-483d-b0a3-57d8ee5f50c8", "tag": "003c66a3-ae1f-4cd7-a8a9-471d61697901"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:01:38.540787 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-fb92de8a-3158-4226-b68b-4574ff20e8fd req-1bd5ce02-dff6-40f5-92c6-2702437955c6 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:38.541740 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-fb92de8a-3158-4226-b68b-4574ff20e8fd req-1bd5ce02-dff6-40f5-92c6-2702437955c6 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:38.542481 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-fb92de8a-3158-4226-b68b-4574ff20e8fd req-1bd5ce02-dff6-40f5-92c6-2702437955c6 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:38.598672 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-fb92de8a-3158-4226-b68b-4574ff20e8fd req-1bd5ce02-dff6-40f5-92c6-2702437955c6 service nova] Creating event network-changed:003c66a3-ae1f-4cd7-a8a9-471d61697901 for instance 8701d926-4a72-483d-b0a3-57d8ee5f50c8 on n-h2-833090-16 Aug 31 16:01:38.620926 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-fb92de8a-3158-4226-b68b-4574ff20e8fd req-1bd5ce02-dff6-40f5-92c6-2702437955c6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155370 Aug 31 16:01:38.631755 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1421/2734] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:01:38.795632 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-05298e69-afa3-4c2e-a9fc-fb5c0a5d1062 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:38.796649 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-05298e69-afa3-4c2e-a9fc-fb5c0a5d1062 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:38.819195 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-05298e69-afa3-4c2e-a9fc-fb5c0a5d1062 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:38.819739 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-05298e69-afa3-4c2e-a9fc-fb5c0a5d1062 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:38.824451 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-05298e69-afa3-4c2e-a9fc-fb5c0a5d1062 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:38.829547 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-05298e69-afa3-4c2e-a9fc-fb5c0a5d1062 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:38.834006 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-05298e69-afa3-4c2e-a9fc-fb5c0a5d1062 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:38.839689 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-05298e69-afa3-4c2e-a9fc-fb5c0a5d1062 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:39.196001 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-7493247c-05dd-4b4d-bbc7-548f2527cf43 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:01:39.197751 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-7493247c-05dd-4b4d-bbc7-548f2527cf43 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:01:39.198528 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-7493247c-05dd-4b4d-bbc7-548f2527cf43 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:01:39.199196 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-7493247c-05dd-4b4d-bbc7-548f2527cf43 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:01:39.199779 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-7493247c-05dd-4b4d-bbc7-548f2527cf43 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:01:39.231181 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7493247c-05dd-4b4d-bbc7-548f2527cf43 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:39.233857 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7493247c-05dd-4b4d-bbc7-548f2527cf43 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:39.236611 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7493247c-05dd-4b4d-bbc7-548f2527cf43 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:39.239529 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7493247c-05dd-4b4d-bbc7-548f2527cf43 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:39.240044 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7493247c-05dd-4b4d-bbc7-548f2527cf43 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:39.240489 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7493247c-05dd-4b4d-bbc7-548f2527cf43 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:39.346734 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-7493247c-05dd-4b4d-bbc7-548f2527cf43 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Getting quotas for project 75a7c84a4ea54074bab3ccc035c5cf47. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:01:39.372538 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-7493247c-05dd-4b4d-bbc7-548f2527cf43 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Getting quotas for user 3c8476b6167a4c838eac59d7c4a40284 and project 75a7c84a4ea54074bab3ccc035c5cf47. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:01:39.448452 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7493247c-05dd-4b4d-bbc7-548f2527cf43 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:01:39.461702 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7493247c-05dd-4b4d-bbc7-548f2527cf43 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 8b94785f-e6ed-4958-84e4-41e521d3d36e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:01:39.616665 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7493247c-05dd-4b4d-bbc7-548f2527cf43 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 8.261109 Aug 31 16:01:39.624779 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1314/2735] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:01:31 2022] POST /compute/v2.1/servers => generated 383 bytes in 8264 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 16:01:39.641730 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9fa21cc7-4dea-4d31-89f3-3c141fe184b3 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:39.642726 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9fa21cc7-4dea-4d31-89f3-3c141fe184b3 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 8701d926-4a72-483d-b0a3-57d8ee5f50c8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:39.717202 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9fa21cc7-4dea-4d31-89f3-3c141fe184b3 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:39.723521 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9fa21cc7-4dea-4d31-89f3-3c141fe184b3 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:39.723774 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9fa21cc7-4dea-4d31-89f3-3c141fe184b3 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:39.731812 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9fa21cc7-4dea-4d31-89f3-3c141fe184b3 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:39.732410 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9fa21cc7-4dea-4d31-89f3-3c141fe184b3 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:39.739013 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9fa21cc7-4dea-4d31-89f3-3c141fe184b3 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:40.279113 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-05298e69-afa3-4c2e-a9fc-fb5c0a5d1062 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:40.293086 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-05298e69-afa3-4c2e-a9fc-fb5c0a5d1062 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1671 microversion: 2.1 time: 1.505618 Aug 31 16:01:40.293712 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1422/2736] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:38 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1671 bytes in 1510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:40.316925 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e096c6ff-3d3d-48a5-beb8-529ee49124f7 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:40.317576 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e096c6ff-3d3d-48a5-beb8-529ee49124f7 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 8b94785f-e6ed-4958-84e4-41e521d3d36e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:40.798620 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e096c6ff-3d3d-48a5-beb8-529ee49124f7 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8476b6167a4c838eac59d7c4a40284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a7c84a4ea54074bab3ccc035c5cf47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:40.808235 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e096c6ff-3d3d-48a5-beb8-529ee49124f7 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/8b94785f-e6ed-4958-84e4-41e521d3d36e" status: 200 len: 1225 microversion: 2.1 time: 0.513388 Aug 31 16:01:40.811574 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1423/2737] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:40 2022] GET /compute/v2.1/servers/8b94785f-e6ed-4958-84e4-41e521d3d36e => generated 1225 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:40.826835 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-acefe75e-99d9-45c9-87bf-992585d604ee tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-2033248269"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:01:40.830906 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-acefe75e-99d9-45c9-87bf-992585d604ee tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:40.851915 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-acefe75e-99d9-45c9-87bf-992585d604ee tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:40.852395 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-acefe75e-99d9-45c9-87bf-992585d604ee tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:40.856372 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-acefe75e-99d9-45c9-87bf-992585d604ee tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:40.857356 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-acefe75e-99d9-45c9-87bf-992585d604ee tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:40.858799 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-acefe75e-99d9-45c9-87bf-992585d604ee tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:40.863121 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-acefe75e-99d9-45c9-87bf-992585d604ee tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:41.028532 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9fa21cc7-4dea-4d31-89f3-3c141fe184b3 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:41.040723 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9fa21cc7-4dea-4d31-89f3-3c141fe184b3 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8" status: 200 len: 1503 microversion: 2.1 time: 1.412886 Aug 31 16:01:41.046894 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1315/2738] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:39 2022] GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8 => generated 1503 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:41.384009 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-acefe75e-99d9-45c9-87bf-992585d604ee tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "POST /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b/action" status: 202 len: 0 microversion: 2.1 time: 0.571024 Aug 31 16:01:41.388054 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1424/2739] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:01:40 2022] POST /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b/action => generated 0 bytes in 576 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 31 16:01:41.413588 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d23dc57b-8235-4f6a-9090-281634cf93ff tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:41.420906 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d23dc57b-8235-4f6a-9090-281634cf93ff tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:41.450633 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d23dc57b-8235-4f6a-9090-281634cf93ff tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:41.452957 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d23dc57b-8235-4f6a-9090-281634cf93ff tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:41.455090 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d23dc57b-8235-4f6a-9090-281634cf93ff tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:41.456375 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d23dc57b-8235-4f6a-9090-281634cf93ff tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:41.458589 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d23dc57b-8235-4f6a-9090-281634cf93ff tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:41.460047 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d23dc57b-8235-4f6a-9090-281634cf93ff tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:41.731874 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d74f4c15-41a0-4e18-84a6-19851b4149e3 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1419387383", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "73c1c7bb-002c-4b7e-9aff-6189e5ddb8fe"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:01:41.862743 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-d74f4c15-41a0-4e18-84a6-19851b4149e3 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] validate_networks() for [('73c1c7bb-002c-4b7e-9aff-6189e5ddb8fe', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:01:43.383868 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d23dc57b-8235-4f6a-9090-281634cf93ff tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:43.410008 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d23dc57b-8235-4f6a-9090-281634cf93ff tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1681 microversion: 2.1 time: 2.019683 Aug 31 16:01:43.414618 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1425/2740] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:41 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1681 bytes in 2025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:43.425514 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9c2ccf8d-c4f7-43d8-bf81-39f14a1a0fbb tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:43.426702 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9c2ccf8d-c4f7-43d8-bf81-39f14a1a0fbb tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 8b94785f-e6ed-4958-84e4-41e521d3d36e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:43.454573 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9c2ccf8d-c4f7-43d8-bf81-39f14a1a0fbb tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:43.457042 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9c2ccf8d-c4f7-43d8-bf81-39f14a1a0fbb tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:43.459128 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9c2ccf8d-c4f7-43d8-bf81-39f14a1a0fbb tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:43.461124 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9c2ccf8d-c4f7-43d8-bf81-39f14a1a0fbb tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:43.463299 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9c2ccf8d-c4f7-43d8-bf81-39f14a1a0fbb tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:43.464117 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9c2ccf8d-c4f7-43d8-bf81-39f14a1a0fbb tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:43.654579 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9c2ccf8d-c4f7-43d8-bf81-39f14a1a0fbb tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8476b6167a4c838eac59d7c4a40284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a7c84a4ea54074bab3ccc035c5cf47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:43.678042 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9c2ccf8d-c4f7-43d8-bf81-39f14a1a0fbb tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/8b94785f-e6ed-4958-84e4-41e521d3d36e" status: 200 len: 1283 microversion: 2.1 time: 0.260811 Aug 31 16:01:43.694205 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1426/2741] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:43 2022] GET /compute/v2.1/servers/8b94785f-e6ed-4958-84e4-41e521d3d36e => generated 1283 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:43.714833 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-bd59895b-296a-4c8c-ab59-e28112218a7b req-8f89adc9-bf04-4380-abc0-62a14300f676 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b", "name": "network-vif-unplugged", "status": "completed", "tag": "4e98deab-3424-49ec-b930-3019d71c32c7"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:01:43.768624 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-bd59895b-296a-4c8c-ab59-e28112218a7b req-8f89adc9-bf04-4380-abc0-62a14300f676 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:43.769478 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-bd59895b-296a-4c8c-ab59-e28112218a7b req-8f89adc9-bf04-4380-abc0-62a14300f676 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:43.772415 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-bd59895b-296a-4c8c-ab59-e28112218a7b req-8f89adc9-bf04-4380-abc0-62a14300f676 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:43.818359 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-bd59895b-296a-4c8c-ab59-e28112218a7b req-8f89adc9-bf04-4380-abc0-62a14300f676 service nova] Creating event network-vif-unplugged:4e98deab-3424-49ec-b930-3019d71c32c7 for instance 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b on n-h1-833090-16 Aug 31 16:01:43.850438 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-bd59895b-296a-4c8c-ab59-e28112218a7b req-8f89adc9-bf04-4380-abc0-62a14300f676 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.157222 Aug 31 16:01:43.854617 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1427/2742] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:01:43.891987 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-044f7030-2d84-4cfa-aab1-404119af96af tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:43.895291 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-044f7030-2d84-4cfa-aab1-404119af96af tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 8701d926-4a72-483d-b0a3-57d8ee5f50c8] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:43.904706 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-044f7030-2d84-4cfa-aab1-404119af96af tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:43.905541 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-044f7030-2d84-4cfa-aab1-404119af96af tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:43.906279 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-044f7030-2d84-4cfa-aab1-404119af96af tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:43.914468 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-044f7030-2d84-4cfa-aab1-404119af96af tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:43.916657 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-044f7030-2d84-4cfa-aab1-404119af96af tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:43.917998 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-044f7030-2d84-4cfa-aab1-404119af96af tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:44.773829 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-044f7030-2d84-4cfa-aab1-404119af96af tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:44.783933 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-044f7030-2d84-4cfa-aab1-404119af96af tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8" status: 200 len: 1503 microversion: 2.1 time: 0.926813 Aug 31 16:01:44.786984 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1428/2743] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:43 2022] GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8 => generated 1503 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:44.797826 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3b24ba6a-e11b-4ce8-834f-34dd2a266db0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:44.801634 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3b24ba6a-e11b-4ce8-834f-34dd2a266db0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:44.813775 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3b24ba6a-e11b-4ce8-834f-34dd2a266db0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:44.826231 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3b24ba6a-e11b-4ce8-834f-34dd2a266db0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:44.826966 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3b24ba6a-e11b-4ce8-834f-34dd2a266db0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:44.827985 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3b24ba6a-e11b-4ce8-834f-34dd2a266db0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:44.828728 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3b24ba6a-e11b-4ce8-834f-34dd2a266db0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:44.829388 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3b24ba6a-e11b-4ce8-834f-34dd2a266db0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:45.716187 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-d74f4c15-41a0-4e18-84a6-19851b4149e3 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:01:45.717473 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-d74f4c15-41a0-4e18-84a6-19851b4149e3 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:01:45.718403 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-d74f4c15-41a0-4e18-84a6-19851b4149e3 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:01:45.719024 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-d74f4c15-41a0-4e18-84a6-19851b4149e3 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:01:45.720139 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-d74f4c15-41a0-4e18-84a6-19851b4149e3 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:01:45.723327 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:01:45.772186 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d74f4c15-41a0-4e18-84a6-19851b4149e3 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:45.773228 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d74f4c15-41a0-4e18-84a6-19851b4149e3 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:45.775768 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d74f4c15-41a0-4e18-84a6-19851b4149e3 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:45.777221 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d74f4c15-41a0-4e18-84a6-19851b4149e3 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:45.779030 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d74f4c15-41a0-4e18-84a6-19851b4149e3 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:45.784797 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d74f4c15-41a0-4e18-84a6-19851b4149e3 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:45.830250 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:01:45.895052 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-d74f4c15-41a0-4e18-84a6-19851b4149e3 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Getting quotas for project abd7cf0fb56d40dca0d158268001b107. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:01:45.904031 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-d74f4c15-41a0-4e18-84a6-19851b4149e3 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Getting quotas for user d3c15400d81847c09c81b04b668560b7 and project abd7cf0fb56d40dca0d158268001b107. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:01:45.926136 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d74f4c15-41a0-4e18-84a6-19851b4149e3 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:01:45.932768 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d74f4c15-41a0-4e18-84a6-19851b4149e3 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] [instance: d18fee50-f30d-44c3-9ac5-18aaace88e65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:01:45.989541 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3b24ba6a-e11b-4ce8-834f-34dd2a266db0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:46.004327 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3b24ba6a-e11b-4ce8-834f-34dd2a266db0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1689 microversion: 2.1 time: 1.216150 Aug 31 16:01:46.036706 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1429/2744] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:44 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1689 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:46.047839 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e2633be1-4993-476c-8297-6311fd4aeee1 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:46.049135 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e2633be1-4993-476c-8297-6311fd4aeee1 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 8b94785f-e6ed-4958-84e4-41e521d3d36e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:46.059174 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e2633be1-4993-476c-8297-6311fd4aeee1 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:46.061128 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e2633be1-4993-476c-8297-6311fd4aeee1 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:46.062746 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e2633be1-4993-476c-8297-6311fd4aeee1 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:46.067637 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e2633be1-4993-476c-8297-6311fd4aeee1 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:46.068426 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e2633be1-4993-476c-8297-6311fd4aeee1 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:46.069102 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e2633be1-4993-476c-8297-6311fd4aeee1 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:46.095953 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:01:46.096669 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d74f4c15-41a0-4e18-84a6-19851b4149e3 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.048201 Aug 31 16:01:46.116530 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1316/2745] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:01:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 5068 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:01:46.135127 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3302bc9c-315a-4611-9ca5-426272b49249 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:46.135744 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3302bc9c-315a-4611-9ca5-426272b49249 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 8701d926-4a72-483d-b0a3-57d8ee5f50c8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:46.184375 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3302bc9c-315a-4611-9ca5-426272b49249 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:46.186826 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3302bc9c-315a-4611-9ca5-426272b49249 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:46.187279 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3302bc9c-315a-4611-9ca5-426272b49249 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:46.193896 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3302bc9c-315a-4611-9ca5-426272b49249 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:46.194438 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3302bc9c-315a-4611-9ca5-426272b49249 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:46.194883 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3302bc9c-315a-4611-9ca5-426272b49249 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:46.412321 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e2633be1-4993-476c-8297-6311fd4aeee1 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8476b6167a4c838eac59d7c4a40284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a7c84a4ea54074bab3ccc035c5cf47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:46.439719 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e2633be1-4993-476c-8297-6311fd4aeee1 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/8b94785f-e6ed-4958-84e4-41e521d3d36e" status: 200 len: 1283 microversion: 2.1 time: 0.400802 Aug 31 16:01:46.458180 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1430/2746] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:46 2022] GET /compute/v2.1/servers/8b94785f-e6ed-4958-84e4-41e521d3d36e => generated 1283 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:46.475944 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a057736b-d099-4187-b460-9224387d011c tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:46.480010 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a057736b-d099-4187-b460-9224387d011c tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] [instance: d18fee50-f30d-44c3-9ac5-18aaace88e65] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:46.926354 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a057736b-d099-4187-b460-9224387d011c tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c15400d81847c09c81b04b668560b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd7cf0fb56d40dca0d158268001b107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:46.947994 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a057736b-d099-4187-b460-9224387d011c tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] 10.222.0.50 "GET /compute/v2.1/servers/d18fee50-f30d-44c3-9ac5-18aaace88e65" status: 200 len: 1224 microversion: 2.1 time: 0.478173 Aug 31 16:01:46.949308 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1431/2747] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:46 2022] GET /compute/v2.1/servers/d18fee50-f30d-44c3-9ac5-18aaace88e65 => generated 1224 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:47.031712 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7f62704f-82a6-4124-b724-3a6bd86268f5 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:47.032569 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7f62704f-82a6-4124-b724-3a6bd86268f5 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:47.045711 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f62704f-82a6-4124-b724-3a6bd86268f5 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:47.050879 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f62704f-82a6-4124-b724-3a6bd86268f5 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:47.053683 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f62704f-82a6-4124-b724-3a6bd86268f5 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:47.054684 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f62704f-82a6-4124-b724-3a6bd86268f5 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:47.059256 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f62704f-82a6-4124-b724-3a6bd86268f5 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:47.065883 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f62704f-82a6-4124-b724-3a6bd86268f5 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:48.800835 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3302bc9c-315a-4611-9ca5-426272b49249 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:48.857467 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3302bc9c-315a-4611-9ca5-426272b49249 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8" status: 200 len: 1503 microversion: 2.1 time: 2.736166 Aug 31 16:01:48.864962 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1317/2748] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:46 2022] GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8 => generated 1503 bytes in 2748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:48.894376 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-03c23c69-a5f5-455e-8be5-c6c6534d9eec tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:48.896501 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-03c23c69-a5f5-455e-8be5-c6c6534d9eec tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 8b94785f-e6ed-4958-84e4-41e521d3d36e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:48.925077 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03c23c69-a5f5-455e-8be5-c6c6534d9eec tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:48.926054 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03c23c69-a5f5-455e-8be5-c6c6534d9eec tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:48.926764 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03c23c69-a5f5-455e-8be5-c6c6534d9eec tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:48.927925 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03c23c69-a5f5-455e-8be5-c6c6534d9eec tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:48.928555 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03c23c69-a5f5-455e-8be5-c6c6534d9eec tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:48.929155 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03c23c69-a5f5-455e-8be5-c6c6534d9eec tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:50.693427 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7f62704f-82a6-4124-b724-3a6bd86268f5 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:50.717010 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7f62704f-82a6-4124-b724-3a6bd86268f5 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1684 microversion: 2.1 time: 3.691272 Aug 31 16:01:50.736815 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1432/2749] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:47 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1684 bytes in 3711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:50.770605 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-725c02bf-1ea8-4e45-be00-41928de1cede tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:50.774785 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-725c02bf-1ea8-4e45-be00-41928de1cede tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] [instance: d18fee50-f30d-44c3-9ac5-18aaace88e65] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:50.822926 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-725c02bf-1ea8-4e45-be00-41928de1cede tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:50.841104 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-725c02bf-1ea8-4e45-be00-41928de1cede tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:50.844580 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-725c02bf-1ea8-4e45-be00-41928de1cede tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:50.847016 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-725c02bf-1ea8-4e45-be00-41928de1cede tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:50.856059 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-725c02bf-1ea8-4e45-be00-41928de1cede tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:50.857349 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-725c02bf-1ea8-4e45-be00-41928de1cede tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:52.288455 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-03c23c69-a5f5-455e-8be5-c6c6534d9eec tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8476b6167a4c838eac59d7c4a40284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a7c84a4ea54074bab3ccc035c5cf47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:52.325950 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-03c23c69-a5f5-455e-8be5-c6c6534d9eec tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/8b94785f-e6ed-4958-84e4-41e521d3d36e" status: 200 len: 1325 microversion: 2.1 time: 3.453424 Aug 31 16:01:52.333407 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1318/2750] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:48 2022] GET /compute/v2.1/servers/8b94785f-e6ed-4958-84e4-41e521d3d36e => generated 1325 bytes in 3467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:52.349990 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8c1f625f-9217-4f89-913a-6781af05eda5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:52.353895 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8c1f625f-9217-4f89-913a-6781af05eda5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 8701d926-4a72-483d-b0a3-57d8ee5f50c8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:52.381205 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c1f625f-9217-4f89-913a-6781af05eda5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:52.384561 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c1f625f-9217-4f89-913a-6781af05eda5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:52.385227 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c1f625f-9217-4f89-913a-6781af05eda5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:52.402011 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c1f625f-9217-4f89-913a-6781af05eda5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:52.409265 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c1f625f-9217-4f89-913a-6781af05eda5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:52.410321 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c1f625f-9217-4f89-913a-6781af05eda5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:52.568914 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-725c02bf-1ea8-4e45-be00-41928de1cede tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c15400d81847c09c81b04b668560b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd7cf0fb56d40dca0d158268001b107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:52.583903 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-725c02bf-1ea8-4e45-be00-41928de1cede tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] 10.222.0.50 "GET /compute/v2.1/servers/d18fee50-f30d-44c3-9ac5-18aaace88e65" status: 200 len: 1324 microversion: 2.1 time: 1.845574 Aug 31 16:01:52.604682 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1433/2751] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:50 2022] GET /compute/v2.1/servers/d18fee50-f30d-44c3-9ac5-18aaace88e65 => generated 1324 bytes in 1867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:52.638750 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-2d8a657a-a10c-46b9-9fd0-ed243f3a9bdb req-15ba2ee1-8d43-4a3c-921e-85ea13e41187 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b", "name": "network-vif-plugged", "status": "completed", "tag": "4e98deab-3424-49ec-b930-3019d71c32c7"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:01:52.675868 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-2d8a657a-a10c-46b9-9fd0-ed243f3a9bdb req-15ba2ee1-8d43-4a3c-921e-85ea13e41187 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:52.684260 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-2d8a657a-a10c-46b9-9fd0-ed243f3a9bdb req-15ba2ee1-8d43-4a3c-921e-85ea13e41187 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:52.684939 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-2d8a657a-a10c-46b9-9fd0-ed243f3a9bdb req-15ba2ee1-8d43-4a3c-921e-85ea13e41187 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:52.734105 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-2d8a657a-a10c-46b9-9fd0-ed243f3a9bdb req-15ba2ee1-8d43-4a3c-921e-85ea13e41187 service nova] Creating event network-vif-plugged:4e98deab-3424-49ec-b930-3019d71c32c7 for instance 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b on n-h1-833090-16 Aug 31 16:01:52.752244 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-2d8a657a-a10c-46b9-9fd0-ed243f3a9bdb req-15ba2ee1-8d43-4a3c-921e-85ea13e41187 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143967 Aug 31 16:01:52.757456 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1434/2752] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:01:52.773156 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e594b902-0050-448c-9ea5-06a569a413d3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:52.773861 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e594b902-0050-448c-9ea5-06a569a413d3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:52.821038 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e594b902-0050-448c-9ea5-06a569a413d3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:52.824653 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e594b902-0050-448c-9ea5-06a569a413d3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:52.825171 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e594b902-0050-448c-9ea5-06a569a413d3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:52.825922 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e594b902-0050-448c-9ea5-06a569a413d3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:52.826416 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e594b902-0050-448c-9ea5-06a569a413d3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:52.826834 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e594b902-0050-448c-9ea5-06a569a413d3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:53.339108 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8c1f625f-9217-4f89-913a-6781af05eda5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:53.348730 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8c1f625f-9217-4f89-913a-6781af05eda5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8" status: 200 len: 1503 microversion: 2.1 time: 1.013852 Aug 31 16:01:53.358598 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1319/2753] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:52 2022] GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8 => generated 1503 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:53.387298 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7fe440d5-0885-452f-a396-2bb1f728ebb8 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:53.392679 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7fe440d5-0885-452f-a396-2bb1f728ebb8 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 8b94785f-e6ed-4958-84e4-41e521d3d36e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:53.423268 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fe440d5-0885-452f-a396-2bb1f728ebb8 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:53.429059 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fe440d5-0885-452f-a396-2bb1f728ebb8 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:53.432211 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fe440d5-0885-452f-a396-2bb1f728ebb8 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:53.434987 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fe440d5-0885-452f-a396-2bb1f728ebb8 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:53.446619 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fe440d5-0885-452f-a396-2bb1f728ebb8 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:53.447050 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fe440d5-0885-452f-a396-2bb1f728ebb8 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:54.347077 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e594b902-0050-448c-9ea5-06a569a413d3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:54.358421 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e594b902-0050-448c-9ea5-06a569a413d3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1684 microversion: 2.1 time: 1.599558 Aug 31 16:01:54.359113 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1435/2754] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:52 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1684 bytes in 1601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:54.384282 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-079074cd-08d5-41ab-918f-8c15093b6be6 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:54.386520 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-079074cd-08d5-41ab-918f-8c15093b6be6 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] [instance: d18fee50-f30d-44c3-9ac5-18aaace88e65] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:54.408337 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-079074cd-08d5-41ab-918f-8c15093b6be6 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:54.412707 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-079074cd-08d5-41ab-918f-8c15093b6be6 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:54.413391 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-079074cd-08d5-41ab-918f-8c15093b6be6 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:54.414332 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-079074cd-08d5-41ab-918f-8c15093b6be6 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:54.414938 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-079074cd-08d5-41ab-918f-8c15093b6be6 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:54.416152 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-079074cd-08d5-41ab-918f-8c15093b6be6 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:54.731158 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7fe440d5-0885-452f-a396-2bb1f728ebb8 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8476b6167a4c838eac59d7c4a40284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a7c84a4ea54074bab3ccc035c5cf47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:54.744764 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7fe440d5-0885-452f-a396-2bb1f728ebb8 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/8b94785f-e6ed-4958-84e4-41e521d3d36e" status: 200 len: 1325 microversion: 2.1 time: 1.383067 Aug 31 16:01:54.751687 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1320/2755] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:53 2022] GET /compute/v2.1/servers/8b94785f-e6ed-4958-84e4-41e521d3d36e => generated 1325 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:54.764794 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-daacff07-7c3f-4966-9936-c1ada46b09da tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:54.765636 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-daacff07-7c3f-4966-9936-c1ada46b09da tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 8701d926-4a72-483d-b0a3-57d8ee5f50c8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:54.783574 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-daacff07-7c3f-4966-9936-c1ada46b09da tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:54.787008 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-daacff07-7c3f-4966-9936-c1ada46b09da tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:54.787751 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-daacff07-7c3f-4966-9936-c1ada46b09da tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:54.789051 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-daacff07-7c3f-4966-9936-c1ada46b09da tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:54.789945 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-daacff07-7c3f-4966-9936-c1ada46b09da tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:54.795543 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-daacff07-7c3f-4966-9936-c1ada46b09da tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:55.610704 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-079074cd-08d5-41ab-918f-8c15093b6be6 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c15400d81847c09c81b04b668560b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd7cf0fb56d40dca0d158268001b107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:55.622953 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-079074cd-08d5-41ab-918f-8c15093b6be6 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] 10.222.0.50 "GET /compute/v2.1/servers/d18fee50-f30d-44c3-9ac5-18aaace88e65" status: 200 len: 1324 microversion: 2.1 time: 1.250429 Aug 31 16:01:55.628110 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1436/2756] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:54 2022] GET /compute/v2.1/servers/d18fee50-f30d-44c3-9ac5-18aaace88e65 => generated 1324 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:55.648374 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-0008597b-dbf6-40bf-ac71-83d6b3127f56 req-c9f5cade-82da-40a5-8d9e-f2779454e9ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d18fee50-f30d-44c3-9ac5-18aaace88e65", "tag": "f657e99c-7a4f-44d8-93b1-1e4f5d4feb75"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:01:55.696002 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-0008597b-dbf6-40bf-ac71-83d6b3127f56 req-c9f5cade-82da-40a5-8d9e-f2779454e9ce service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:55.700535 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-0008597b-dbf6-40bf-ac71-83d6b3127f56 req-c9f5cade-82da-40a5-8d9e-f2779454e9ce service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:55.701894 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-0008597b-dbf6-40bf-ac71-83d6b3127f56 req-c9f5cade-82da-40a5-8d9e-f2779454e9ce service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:55.756461 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-0008597b-dbf6-40bf-ac71-83d6b3127f56 req-c9f5cade-82da-40a5-8d9e-f2779454e9ce service nova] Creating event network-changed:f657e99c-7a4f-44d8-93b1-1e4f5d4feb75 for instance d18fee50-f30d-44c3-9ac5-18aaace88e65 on n-h2-833090-16 Aug 31 16:01:55.777429 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-0008597b-dbf6-40bf-ac71-83d6b3127f56 req-c9f5cade-82da-40a5-8d9e-f2779454e9ce service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145131 Aug 31 16:01:55.785571 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1437/2757] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:01:55.810212 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e75fc59f-43d9-49b9-a552-9ce823e22494 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:55.811189 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e75fc59f-43d9-49b9-a552-9ce823e22494 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:55.821932 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:01:55.834717 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e75fc59f-43d9-49b9-a552-9ce823e22494 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:55.835181 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e75fc59f-43d9-49b9-a552-9ce823e22494 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:55.835626 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e75fc59f-43d9-49b9-a552-9ce823e22494 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:55.854592 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e75fc59f-43d9-49b9-a552-9ce823e22494 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:55.855198 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e75fc59f-43d9-49b9-a552-9ce823e22494 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:55.858690 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e75fc59f-43d9-49b9-a552-9ce823e22494 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:55.916225 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=12 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:01:56.079220 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-daacff07-7c3f-4966-9936-c1ada46b09da tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:56.103287 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-daacff07-7c3f-4966-9936-c1ada46b09da tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8" status: 200 len: 1503 microversion: 2.1 time: 1.350087 Aug 31 16:01:56.116873 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1321/2758] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:54 2022] GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8 => generated 1503 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:56.142348 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3ab0d598-0a37-469d-8a2b-303067aea29f tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:56.144238 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3ab0d598-0a37-469d-8a2b-303067aea29f tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 8b94785f-e6ed-4958-84e4-41e521d3d36e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:56.196346 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ab0d598-0a37-469d-8a2b-303067aea29f tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:56.196927 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ab0d598-0a37-469d-8a2b-303067aea29f tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:56.197382 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ab0d598-0a37-469d-8a2b-303067aea29f tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:56.198156 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ab0d598-0a37-469d-8a2b-303067aea29f tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:56.198621 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ab0d598-0a37-469d-8a2b-303067aea29f tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:56.199049 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ab0d598-0a37-469d-8a2b-303067aea29f tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:56.937909 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=4 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:01:57.633975 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e75fc59f-43d9-49b9-a552-9ce823e22494 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:57.643360 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e75fc59f-43d9-49b9-a552-9ce823e22494 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1684 microversion: 2.1 time: 1.855786 Aug 31 16:01:57.651398 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1438/2759] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:55 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1684 bytes in 1865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:57.657252 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-23e97ef9-454b-40c3-a7e3-7889c0680dff tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:57.667184 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-23e97ef9-454b-40c3-a7e3-7889c0680dff tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] [instance: d18fee50-f30d-44c3-9ac5-18aaace88e65] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:57.678738 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-23e97ef9-454b-40c3-a7e3-7889c0680dff tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:57.679639 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-23e97ef9-454b-40c3-a7e3-7889c0680dff tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:57.680849 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-23e97ef9-454b-40c3-a7e3-7889c0680dff tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:57.682161 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-23e97ef9-454b-40c3-a7e3-7889c0680dff tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:57.689047 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-23e97ef9-454b-40c3-a7e3-7889c0680dff tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:57.689797 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-23e97ef9-454b-40c3-a7e3-7889c0680dff tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:57.889774 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3ab0d598-0a37-469d-8a2b-303067aea29f tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8476b6167a4c838eac59d7c4a40284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a7c84a4ea54074bab3ccc035c5cf47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:57.924631 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3ab0d598-0a37-469d-8a2b-303067aea29f tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/8b94785f-e6ed-4958-84e4-41e521d3d36e" status: 200 len: 1325 microversion: 2.1 time: 1.806315 Aug 31 16:01:57.925636 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1322/2760] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:56 2022] GET /compute/v2.1/servers/8b94785f-e6ed-4958-84e4-41e521d3d36e => generated 1325 bytes in 1808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:57.943343 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-30485c1e-a75a-45d7-9074-4e810d5cb0da tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:57.944638 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-30485c1e-a75a-45d7-9074-4e810d5cb0da tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 8701d926-4a72-483d-b0a3-57d8ee5f50c8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:57.972049 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-30485c1e-a75a-45d7-9074-4e810d5cb0da tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:57.977016 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-30485c1e-a75a-45d7-9074-4e810d5cb0da tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:57.977526 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-30485c1e-a75a-45d7-9074-4e810d5cb0da tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:57.978894 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-30485c1e-a75a-45d7-9074-4e810d5cb0da tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:57.979686 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-30485c1e-a75a-45d7-9074-4e810d5cb0da tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:57.980122 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-30485c1e-a75a-45d7-9074-4e810d5cb0da tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:59.259235 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-30485c1e-a75a-45d7-9074-4e810d5cb0da tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:59.280078 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-30485c1e-a75a-45d7-9074-4e810d5cb0da tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8" status: 200 len: 1493 microversion: 2.1 time: 1.349476 Aug 31 16:01:59.287654 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-23e97ef9-454b-40c3-a7e3-7889c0680dff tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c15400d81847c09c81b04b668560b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd7cf0fb56d40dca0d158268001b107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:01:59.289249 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1323/2761] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:57 2022] GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8 => generated 1493 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:59.298075 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-23e97ef9-454b-40c3-a7e3-7889c0680dff tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] 10.222.0.50 "GET /compute/v2.1/servers/d18fee50-f30d-44c3-9ac5-18aaace88e65" status: 200 len: 1324 microversion: 2.1 time: 1.645194 Aug 31 16:01:59.301613 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-8a896093-b45b-4ff9-ba57-741f74a4219c req-64026480-6a18-4b6f-9c8a-5c19e2969afe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b94785f-e6ed-4958-84e4-41e521d3d36e", "tag": "a229b4ae-457d-4d53-bb5c-d7ba527587a2"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:01:59.302418 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1439/2762] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:57 2022] GET /compute/v2.1/servers/d18fee50-f30d-44c3-9ac5-18aaace88e65 => generated 1324 bytes in 1650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:01:59.309469 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7b4acc1c-9a57-4064-a1c5-6dd013f20a33 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:59.311122 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7b4acc1c-9a57-4064-a1c5-6dd013f20a33 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:59.320234 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7b4acc1c-9a57-4064-a1c5-6dd013f20a33 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:59.321372 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7b4acc1c-9a57-4064-a1c5-6dd013f20a33 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:59.328172 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8a896093-b45b-4ff9-ba57-741f74a4219c req-64026480-6a18-4b6f-9c8a-5c19e2969afe service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:59.328557 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7b4acc1c-9a57-4064-a1c5-6dd013f20a33 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:59.328675 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8a896093-b45b-4ff9-ba57-741f74a4219c req-64026480-6a18-4b6f-9c8a-5c19e2969afe service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:59.329088 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8a896093-b45b-4ff9-ba57-741f74a4219c req-64026480-6a18-4b6f-9c8a-5c19e2969afe service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:59.329949 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7b4acc1c-9a57-4064-a1c5-6dd013f20a33 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:59.330739 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7b4acc1c-9a57-4064-a1c5-6dd013f20a33 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:59.331634 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7b4acc1c-9a57-4064-a1c5-6dd013f20a33 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:59.356957 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-8a896093-b45b-4ff9-ba57-741f74a4219c req-64026480-6a18-4b6f-9c8a-5c19e2969afe service nova] Creating event network-changed:a229b4ae-457d-4d53-bb5c-d7ba527587a2 for instance 8b94785f-e6ed-4958-84e4-41e521d3d36e on n-h1-833090-16 Aug 31 16:01:59.373867 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-8a896093-b45b-4ff9-ba57-741f74a4219c req-64026480-6a18-4b6f-9c8a-5c19e2969afe service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077962 Aug 31 16:01:59.374598 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1324/2763] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:01:59.407173 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fbc90f75-2f98-464d-8db1-bb4c8c8d9fa0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:01:59.418471 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fbc90f75-2f98-464d-8db1-bb4c8c8d9fa0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 8b94785f-e6ed-4958-84e4-41e521d3d36e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:01:59.432374 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbc90f75-2f98-464d-8db1-bb4c8c8d9fa0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:59.438314 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbc90f75-2f98-464d-8db1-bb4c8c8d9fa0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:59.438888 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbc90f75-2f98-464d-8db1-bb4c8c8d9fa0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:01:59.439656 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbc90f75-2f98-464d-8db1-bb4c8c8d9fa0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:01:59.440130 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbc90f75-2f98-464d-8db1-bb4c8c8d9fa0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:01:59.440556 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbc90f75-2f98-464d-8db1-bb4c8c8d9fa0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:00.126980 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7b4acc1c-9a57-4064-a1c5-6dd013f20a33 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:00.140985 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7b4acc1c-9a57-4064-a1c5-6dd013f20a33 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1684 microversion: 2.1 time: 0.835088 Aug 31 16:02:00.146362 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1440/2764] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:59 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1684 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:00.157320 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2117e3d9-2416-4e2a-90d3-e237ec5fb279 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Calling method '.version_select at 0x7fbb460a88b0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:00.174461 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2117e3d9-2416-4e2a-90d3-e237ec5fb279 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:00.183949 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2117e3d9-2416-4e2a-90d3-e237ec5fb279 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:00.184758 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2117e3d9-2416-4e2a-90d3-e237ec5fb279 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:00.200958 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2117e3d9-2416-4e2a-90d3-e237ec5fb279 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] 10.222.0.50 "GET /compute/v2.1/os-migrations" status: 200 len: 402 microversion: 2.1 time: 0.052302 Aug 31 16:02:00.206834 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1441/2765] 10.222.0.50 () {58 vars in 1143 bytes} [Wed Aug 31 16:02:00 2022] GET /compute/v2.1/os-migrations => generated 402 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:02:00.216314 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-18298e34-d110-432a-814b-7f3e47f20cbc tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:00.217329 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-18298e34-d110-432a-814b-7f3e47f20cbc tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] [instance: 8701d926-4a72-483d-b0a3-57d8ee5f50c8] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:00.230497 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-18298e34-d110-432a-814b-7f3e47f20cbc tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:00.231351 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-18298e34-d110-432a-814b-7f3e47f20cbc tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:00.237103 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fbc90f75-2f98-464d-8db1-bb4c8c8d9fa0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8476b6167a4c838eac59d7c4a40284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a7c84a4ea54074bab3ccc035c5cf47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:00.241666 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-18298e34-d110-432a-814b-7f3e47f20cbc tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:00.246506 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fbc90f75-2f98-464d-8db1-bb4c8c8d9fa0 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/8b94785f-e6ed-4958-84e4-41e521d3d36e" status: 200 len: 1325 microversion: 2.1 time: 0.866532 Aug 31 16:02:00.248969 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-18298e34-d110-432a-814b-7f3e47f20cbc tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:00.251190 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-18298e34-d110-432a-814b-7f3e47f20cbc tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:00.252153 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1325/2766] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:01:59 2022] GET /compute/v2.1/servers/8b94785f-e6ed-4958-84e4-41e521d3d36e => generated 1325 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:00.252853 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-18298e34-d110-432a-814b-7f3e47f20cbc tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:00.318327 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-13c687a2-a9ae-4225-9b2a-ed7fac51a23f tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:00.319665 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-13c687a2-a9ae-4225-9b2a-ed7fac51a23f tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] [instance: d18fee50-f30d-44c3-9ac5-18aaace88e65] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:00.334927 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13c687a2-a9ae-4225-9b2a-ed7fac51a23f tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:00.335895 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13c687a2-a9ae-4225-9b2a-ed7fac51a23f tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:00.336558 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13c687a2-a9ae-4225-9b2a-ed7fac51a23f tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:00.337516 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13c687a2-a9ae-4225-9b2a-ed7fac51a23f tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:00.338227 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13c687a2-a9ae-4225-9b2a-ed7fac51a23f tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:00.338873 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13c687a2-a9ae-4225-9b2a-ed7fac51a23f tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:00.851743 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-18298e34-d110-432a-814b-7f3e47f20cbc tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8" status: 200 len: 1646 microversion: 2.1 time: 0.639508 Aug 31 16:02:00.854826 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1442/2767] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:00 2022] GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8 => generated 1646 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:02:00.875553 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-13c687a2-a9ae-4225-9b2a-ed7fac51a23f tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c15400d81847c09c81b04b668560b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd7cf0fb56d40dca0d158268001b107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:00.890998 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-13c687a2-a9ae-4225-9b2a-ed7fac51a23f tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] 10.222.0.50 "GET /compute/v2.1/servers/d18fee50-f30d-44c3-9ac5-18aaace88e65" status: 200 len: 1324 microversion: 2.1 time: 0.576265 Aug 31 16:02:00.897112 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1326/2768] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:00 2022] GET /compute/v2.1/servers/d18fee50-f30d-44c3-9ac5-18aaace88e65 => generated 1324 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:01.103190 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-daba968c-a857-4fd5-90a2-19486a69180c tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1736596527", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "39370b19-7cbc-4e21-9ace-fa993a5e662f"}]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:01.149529 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=58 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:02:01.173224 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5b1f7f75-5f34-426b-a1a2-fbaec5d8736f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:01.173829 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5b1f7f75-5f34-426b-a1a2-fbaec5d8736f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:01.191902 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b1f7f75-5f34-426b-a1a2-fbaec5d8736f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:01.192398 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b1f7f75-5f34-426b-a1a2-fbaec5d8736f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:01.192831 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b1f7f75-5f34-426b-a1a2-fbaec5d8736f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:01.194581 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b1f7f75-5f34-426b-a1a2-fbaec5d8736f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:01.195042 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b1f7f75-5f34-426b-a1a2-fbaec5d8736f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:01.195483 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b1f7f75-5f34-426b-a1a2-fbaec5d8736f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:01.886526 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5b1f7f75-5f34-426b-a1a2-fbaec5d8736f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:01.898818 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5b1f7f75-5f34-426b-a1a2-fbaec5d8736f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1684 microversion: 2.1 time: 0.735879 Aug 31 16:02:01.902143 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1327/2769] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:01 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1684 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:01.916642 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-95936e6a-2618-4f71-b48d-ad3aa8066c22 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:01.917501 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-95936e6a-2618-4f71-b48d-ad3aa8066c22 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 8b94785f-e6ed-4958-84e4-41e521d3d36e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:01.924306 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95936e6a-2618-4f71-b48d-ad3aa8066c22 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:01.925328 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95936e6a-2618-4f71-b48d-ad3aa8066c22 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:01.928175 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95936e6a-2618-4f71-b48d-ad3aa8066c22 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:01.929161 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95936e6a-2618-4f71-b48d-ad3aa8066c22 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:01.929804 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95936e6a-2618-4f71-b48d-ad3aa8066c22 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:01.932113 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95936e6a-2618-4f71-b48d-ad3aa8066c22 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:02.431634 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-95936e6a-2618-4f71-b48d-ad3aa8066c22 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8476b6167a4c838eac59d7c4a40284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a7c84a4ea54074bab3ccc035c5cf47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:02.450907 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-95936e6a-2618-4f71-b48d-ad3aa8066c22 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/8b94785f-e6ed-4958-84e4-41e521d3d36e" status: 200 len: 1325 microversion: 2.1 time: 0.550099 Aug 31 16:02:02.465899 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1328/2770] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:01 2022] GET /compute/v2.1/servers/8b94785f-e6ed-4958-84e4-41e521d3d36e => generated 1325 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:02.477293 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-eeabf947-0b42-49ed-9da9-ee0d9760b06c tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:02.479088 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-eeabf947-0b42-49ed-9da9-ee0d9760b06c tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] [instance: d18fee50-f30d-44c3-9ac5-18aaace88e65] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:02.489545 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eeabf947-0b42-49ed-9da9-ee0d9760b06c tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:02.492110 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eeabf947-0b42-49ed-9da9-ee0d9760b06c tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:02.493355 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eeabf947-0b42-49ed-9da9-ee0d9760b06c tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:02.494924 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eeabf947-0b42-49ed-9da9-ee0d9760b06c tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:02.496322 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eeabf947-0b42-49ed-9da9-ee0d9760b06c tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:02.497622 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eeabf947-0b42-49ed-9da9-ee0d9760b06c tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:03.129946 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-eeabf947-0b42-49ed-9da9-ee0d9760b06c tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c15400d81847c09c81b04b668560b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd7cf0fb56d40dca0d158268001b107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:03.143758 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-eeabf947-0b42-49ed-9da9-ee0d9760b06c tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] 10.222.0.50 "GET /compute/v2.1/servers/d18fee50-f30d-44c3-9ac5-18aaace88e65" status: 200 len: 1324 microversion: 2.1 time: 0.675461 Aug 31 16:02:03.147654 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1329/2771] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:02 2022] GET /compute/v2.1/servers/d18fee50-f30d-44c3-9ac5-18aaace88e65 => generated 1324 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:03.159775 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-71cd6ca3-3a59-4d86-99f4-4a956511b9eb tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:03.160743 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-71cd6ca3-3a59-4d86-99f4-4a956511b9eb tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:03.205475 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-71cd6ca3-3a59-4d86-99f4-4a956511b9eb tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:03.205973 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-71cd6ca3-3a59-4d86-99f4-4a956511b9eb tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:03.206438 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-71cd6ca3-3a59-4d86-99f4-4a956511b9eb tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:03.207150 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-71cd6ca3-3a59-4d86-99f4-4a956511b9eb tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:03.216883 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-71cd6ca3-3a59-4d86-99f4-4a956511b9eb tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:03.217393 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-71cd6ca3-3a59-4d86-99f4-4a956511b9eb tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:03.445568 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-71cd6ca3-3a59-4d86-99f4-4a956511b9eb tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:03.455991 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-71cd6ca3-3a59-4d86-99f4-4a956511b9eb tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1684 microversion: 2.1 time: 0.307000 Aug 31 16:02:03.458156 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1330/2772] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:03 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1684 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:03.475069 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-428dfb03-9dcb-4c1a-97c7-e7f8d6fe28f8 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:03.476067 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-428dfb03-9dcb-4c1a-97c7-e7f8d6fe28f8 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 8b94785f-e6ed-4958-84e4-41e521d3d36e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:03.495048 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-428dfb03-9dcb-4c1a-97c7-e7f8d6fe28f8 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:03.496089 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-428dfb03-9dcb-4c1a-97c7-e7f8d6fe28f8 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:03.499035 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-428dfb03-9dcb-4c1a-97c7-e7f8d6fe28f8 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:03.500021 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-428dfb03-9dcb-4c1a-97c7-e7f8d6fe28f8 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:03.501822 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-428dfb03-9dcb-4c1a-97c7-e7f8d6fe28f8 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:03.503596 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-428dfb03-9dcb-4c1a-97c7-e7f8d6fe28f8 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:03.733708 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-428dfb03-9dcb-4c1a-97c7-e7f8d6fe28f8 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8476b6167a4c838eac59d7c4a40284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a7c84a4ea54074bab3ccc035c5cf47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:03.743810 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-428dfb03-9dcb-4c1a-97c7-e7f8d6fe28f8 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/8b94785f-e6ed-4958-84e4-41e521d3d36e" status: 200 len: 1325 microversion: 2.1 time: 0.275751 Aug 31 16:02:03.745094 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1331/2773] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:03 2022] GET /compute/v2.1/servers/8b94785f-e6ed-4958-84e4-41e521d3d36e => generated 1325 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:02:04.169405 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0a41b111-3d36-4da9-a2fd-253969fb15b0 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:04.170143 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0a41b111-3d36-4da9-a2fd-253969fb15b0 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] [instance: d18fee50-f30d-44c3-9ac5-18aaace88e65] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:04.183010 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a41b111-3d36-4da9-a2fd-253969fb15b0 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:04.184282 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a41b111-3d36-4da9-a2fd-253969fb15b0 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:04.186288 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a41b111-3d36-4da9-a2fd-253969fb15b0 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:04.187911 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a41b111-3d36-4da9-a2fd-253969fb15b0 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:04.189684 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a41b111-3d36-4da9-a2fd-253969fb15b0 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:04.191024 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a41b111-3d36-4da9-a2fd-253969fb15b0 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:04.525752 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0a41b111-3d36-4da9-a2fd-253969fb15b0 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c15400d81847c09c81b04b668560b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd7cf0fb56d40dca0d158268001b107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:04.535771 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0a41b111-3d36-4da9-a2fd-253969fb15b0 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] 10.222.0.50 "GET /compute/v2.1/servers/d18fee50-f30d-44c3-9ac5-18aaace88e65" status: 200 len: 1324 microversion: 2.1 time: 0.370316 Aug 31 16:02:04.551483 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1332/2774] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:04 2022] GET /compute/v2.1/servers/d18fee50-f30d-44c3-9ac5-18aaace88e65 => generated 1324 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:02:04.559223 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-19d3fbd4-f8f8-4fb5-ae36-04d586ddbe80 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:04.560114 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-19d3fbd4-f8f8-4fb5-ae36-04d586ddbe80 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:04.568776 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19d3fbd4-f8f8-4fb5-ae36-04d586ddbe80 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:04.569599 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19d3fbd4-f8f8-4fb5-ae36-04d586ddbe80 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:04.570223 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19d3fbd4-f8f8-4fb5-ae36-04d586ddbe80 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:04.571533 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19d3fbd4-f8f8-4fb5-ae36-04d586ddbe80 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:04.572151 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19d3fbd4-f8f8-4fb5-ae36-04d586ddbe80 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:04.572724 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19d3fbd4-f8f8-4fb5-ae36-04d586ddbe80 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:04.957680 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-19d3fbd4-f8f8-4fb5-ae36-04d586ddbe80 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:04.972206 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-19d3fbd4-f8f8-4fb5-ae36-04d586ddbe80 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1684 microversion: 2.1 time: 0.419118 Aug 31 16:02:04.972811 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1333/2775] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:04 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1684 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:04.977720 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a17beada-a79a-4352-8dc7-76bbeeb354e7 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:04.978460 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a17beada-a79a-4352-8dc7-76bbeeb354e7 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 8b94785f-e6ed-4958-84e4-41e521d3d36e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:04.987472 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a17beada-a79a-4352-8dc7-76bbeeb354e7 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:04.988254 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a17beada-a79a-4352-8dc7-76bbeeb354e7 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:04.988886 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a17beada-a79a-4352-8dc7-76bbeeb354e7 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:04.989953 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a17beada-a79a-4352-8dc7-76bbeeb354e7 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:04.990638 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a17beada-a79a-4352-8dc7-76bbeeb354e7 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:04.991335 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a17beada-a79a-4352-8dc7-76bbeeb354e7 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:04.994876 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:02:05.427409 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a17beada-a79a-4352-8dc7-76bbeeb354e7 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8476b6167a4c838eac59d7c4a40284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a7c84a4ea54074bab3ccc035c5cf47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:05.451207 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a17beada-a79a-4352-8dc7-76bbeeb354e7 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/8b94785f-e6ed-4958-84e4-41e521d3d36e" status: 200 len: 1325 microversion: 2.1 time: 0.477244 Aug 31 16:02:05.455293 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1334/2776] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:04 2022] GET /compute/v2.1/servers/8b94785f-e6ed-4958-84e4-41e521d3d36e => generated 1325 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:05.463052 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-0626e72a-29e1-4466-baef-fc7259ef273b req-da5bb364-b310-437d-a400-bc9f27b42e0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d18fee50-f30d-44c3-9ac5-18aaace88e65", "name": "network-vif-plugged", "status": "completed", "tag": "f657e99c-7a4f-44d8-93b1-1e4f5d4feb75"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:05.477685 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-0626e72a-29e1-4466-baef-fc7259ef273b req-da5bb364-b310-437d-a400-bc9f27b42e0d service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:05.478672 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-0626e72a-29e1-4466-baef-fc7259ef273b req-da5bb364-b310-437d-a400-bc9f27b42e0d service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:05.480042 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-0626e72a-29e1-4466-baef-fc7259ef273b req-da5bb364-b310-437d-a400-bc9f27b42e0d service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:05.495020 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-0626e72a-29e1-4466-baef-fc7259ef273b req-da5bb364-b310-437d-a400-bc9f27b42e0d service nova] Creating event network-vif-plugged:f657e99c-7a4f-44d8-93b1-1e4f5d4feb75 for instance d18fee50-f30d-44c3-9ac5-18aaace88e65 on n-h2-833090-16 Aug 31 16:02:05.504553 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-0626e72a-29e1-4466-baef-fc7259ef273b req-da5bb364-b310-437d-a400-bc9f27b42e0d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045151 Aug 31 16:02:05.506078 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1335/2777] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:02:05.566316 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-13f69e48-1529-4099-bfc1-ace92f20595e tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:05.568131 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-13f69e48-1529-4099-bfc1-ace92f20595e tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] [instance: d18fee50-f30d-44c3-9ac5-18aaace88e65] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:05.597706 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13f69e48-1529-4099-bfc1-ace92f20595e tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:05.601218 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13f69e48-1529-4099-bfc1-ace92f20595e tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:05.607093 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13f69e48-1529-4099-bfc1-ace92f20595e tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:05.617814 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13f69e48-1529-4099-bfc1-ace92f20595e tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:05.618837 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13f69e48-1529-4099-bfc1-ace92f20595e tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:05.630322 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13f69e48-1529-4099-bfc1-ace92f20595e tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:05.953587 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-13f69e48-1529-4099-bfc1-ace92f20595e tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c15400d81847c09c81b04b668560b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd7cf0fb56d40dca0d158268001b107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:05.964374 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-13f69e48-1529-4099-bfc1-ace92f20595e tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] 10.222.0.50 "GET /compute/v2.1/servers/d18fee50-f30d-44c3-9ac5-18aaace88e65" status: 200 len: 1324 microversion: 2.1 time: 0.404151 Aug 31 16:02:05.965374 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1336/2778] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:05 2022] GET /compute/v2.1/servers/d18fee50-f30d-44c3-9ac5-18aaace88e65 => generated 1324 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:05.999848 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9692bcaa-5984-447c-9824-3a979844b81d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:06.000832 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9692bcaa-5984-447c-9824-3a979844b81d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:06.010502 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9692bcaa-5984-447c-9824-3a979844b81d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:06.011006 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9692bcaa-5984-447c-9824-3a979844b81d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:06.011450 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9692bcaa-5984-447c-9824-3a979844b81d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:06.012166 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9692bcaa-5984-447c-9824-3a979844b81d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:06.012631 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9692bcaa-5984-447c-9824-3a979844b81d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:06.013062 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9692bcaa-5984-447c-9824-3a979844b81d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:06.511045 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9692bcaa-5984-447c-9824-3a979844b81d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:06.524624 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9692bcaa-5984-447c-9824-3a979844b81d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1684 microversion: 2.1 time: 0.528748 Aug 31 16:02:06.538791 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1337/2779] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:05 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1684 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:02:06.552003 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a8bf24fb-94c6-4fc7-bc43-2c4aaa62b00b tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:06.553448 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a8bf24fb-94c6-4fc7-bc43-2c4aaa62b00b tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 8b94785f-e6ed-4958-84e4-41e521d3d36e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:06.568168 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a8bf24fb-94c6-4fc7-bc43-2c4aaa62b00b tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:06.569793 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a8bf24fb-94c6-4fc7-bc43-2c4aaa62b00b tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:06.570575 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a8bf24fb-94c6-4fc7-bc43-2c4aaa62b00b tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:06.571604 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a8bf24fb-94c6-4fc7-bc43-2c4aaa62b00b tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:06.573970 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a8bf24fb-94c6-4fc7-bc43-2c4aaa62b00b tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:06.578512 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a8bf24fb-94c6-4fc7-bc43-2c4aaa62b00b tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:06.847497 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a8bf24fb-94c6-4fc7-bc43-2c4aaa62b00b tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8476b6167a4c838eac59d7c4a40284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a7c84a4ea54074bab3ccc035c5cf47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:06.864828 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a8bf24fb-94c6-4fc7-bc43-2c4aaa62b00b tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/8b94785f-e6ed-4958-84e4-41e521d3d36e" status: 200 len: 1325 microversion: 2.1 time: 0.329350 Aug 31 16:02:06.866706 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1338/2780] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:06 2022] GET /compute/v2.1/servers/8b94785f-e6ed-4958-84e4-41e521d3d36e => generated 1325 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:06.991220 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8d1a18f6-9327-4044-b3b5-bca4a17301ef tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:06.992084 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8d1a18f6-9327-4044-b3b5-bca4a17301ef tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] [instance: d18fee50-f30d-44c3-9ac5-18aaace88e65] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:07.009732 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d1a18f6-9327-4044-b3b5-bca4a17301ef tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:07.012910 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d1a18f6-9327-4044-b3b5-bca4a17301ef tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:07.013568 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d1a18f6-9327-4044-b3b5-bca4a17301ef tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:07.014689 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d1a18f6-9327-4044-b3b5-bca4a17301ef tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:07.015312 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d1a18f6-9327-4044-b3b5-bca4a17301ef tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:07.018144 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d1a18f6-9327-4044-b3b5-bca4a17301ef tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:07.514268 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8d1a18f6-9327-4044-b3b5-bca4a17301ef tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c15400d81847c09c81b04b668560b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd7cf0fb56d40dca0d158268001b107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:07.526734 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8d1a18f6-9327-4044-b3b5-bca4a17301ef tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] 10.222.0.50 "GET /compute/v2.1/servers/d18fee50-f30d-44c3-9ac5-18aaace88e65" status: 200 len: 1324 microversion: 2.1 time: 0.543182 Aug 31 16:02:07.529323 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1339/2781] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:06 2022] GET /compute/v2.1/servers/d18fee50-f30d-44c3-9ac5-18aaace88e65 => generated 1324 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:07.552708 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8f312900-231c-4f8b-bfba-57a726771da1 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:07.553725 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8f312900-231c-4f8b-bfba-57a726771da1 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:07.564656 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f312900-231c-4f8b-bfba-57a726771da1 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:07.565418 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f312900-231c-4f8b-bfba-57a726771da1 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:07.567466 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f312900-231c-4f8b-bfba-57a726771da1 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:07.568414 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f312900-231c-4f8b-bfba-57a726771da1 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:07.570671 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f312900-231c-4f8b-bfba-57a726771da1 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:07.571297 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f312900-231c-4f8b-bfba-57a726771da1 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:07.826798 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8f312900-231c-4f8b-bfba-57a726771da1 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:07.842076 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8f312900-231c-4f8b-bfba-57a726771da1 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1684 microversion: 2.1 time: 0.296182 Aug 31 16:02:07.856879 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1340/2782] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:07 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1684 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:07.866477 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-1b023503-e9e2-4d05-80ac-1db24ac1fdd8 req-f547877b-eb98-46bd-979f-b754e48e9f87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b94785f-e6ed-4958-84e4-41e521d3d36e", "name": "network-vif-plugged", "status": "completed", "tag": "a229b4ae-457d-4d53-bb5c-d7ba527587a2"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:07.892577 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-1b023503-e9e2-4d05-80ac-1db24ac1fdd8 req-f547877b-eb98-46bd-979f-b754e48e9f87 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:07.894739 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-1b023503-e9e2-4d05-80ac-1db24ac1fdd8 req-f547877b-eb98-46bd-979f-b754e48e9f87 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:07.896120 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-1b023503-e9e2-4d05-80ac-1db24ac1fdd8 req-f547877b-eb98-46bd-979f-b754e48e9f87 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:07.952088 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-1b023503-e9e2-4d05-80ac-1db24ac1fdd8 req-f547877b-eb98-46bd-979f-b754e48e9f87 service nova] Creating event network-vif-plugged:a229b4ae-457d-4d53-bb5c-d7ba527587a2 for instance 8b94785f-e6ed-4958-84e4-41e521d3d36e on n-h1-833090-16 Aug 31 16:02:07.968686 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-1b023503-e9e2-4d05-80ac-1db24ac1fdd8 req-f547877b-eb98-46bd-979f-b754e48e9f87 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110386 Aug 31 16:02:07.972674 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1341/2783] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:02:07.978306 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e13daa4f-4c0e-4d68-b646-1b349d4180ab tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:07.979016 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e13daa4f-4c0e-4d68-b646-1b349d4180ab tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 8b94785f-e6ed-4958-84e4-41e521d3d36e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:08.004068 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e13daa4f-4c0e-4d68-b646-1b349d4180ab tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:08.004574 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e13daa4f-4c0e-4d68-b646-1b349d4180ab tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:08.005011 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e13daa4f-4c0e-4d68-b646-1b349d4180ab tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:08.005725 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e13daa4f-4c0e-4d68-b646-1b349d4180ab tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:08.006211 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e13daa4f-4c0e-4d68-b646-1b349d4180ab tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:08.006656 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e13daa4f-4c0e-4d68-b646-1b349d4180ab tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:08.570025 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e13daa4f-4c0e-4d68-b646-1b349d4180ab tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8476b6167a4c838eac59d7c4a40284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a7c84a4ea54074bab3ccc035c5cf47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:08.584364 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e13daa4f-4c0e-4d68-b646-1b349d4180ab tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/8b94785f-e6ed-4958-84e4-41e521d3d36e" status: 200 len: 1325 microversion: 2.1 time: 0.607103 Aug 31 16:02:08.599723 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1342/2784] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:07 2022] GET /compute/v2.1/servers/8b94785f-e6ed-4958-84e4-41e521d3d36e => generated 1325 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:08.610799 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e73585f5-eb93-4d46-9b1a-4db78312db31 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:08.612961 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e73585f5-eb93-4d46-9b1a-4db78312db31 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] [instance: d18fee50-f30d-44c3-9ac5-18aaace88e65] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:08.630569 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e73585f5-eb93-4d46-9b1a-4db78312db31 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:08.631335 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e73585f5-eb93-4d46-9b1a-4db78312db31 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:08.632014 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e73585f5-eb93-4d46-9b1a-4db78312db31 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:08.632947 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e73585f5-eb93-4d46-9b1a-4db78312db31 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:08.635156 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e73585f5-eb93-4d46-9b1a-4db78312db31 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:08.653565 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e73585f5-eb93-4d46-9b1a-4db78312db31 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:08.907056 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e73585f5-eb93-4d46-9b1a-4db78312db31 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c15400d81847c09c81b04b668560b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd7cf0fb56d40dca0d158268001b107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:08.923242 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e73585f5-eb93-4d46-9b1a-4db78312db31 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] 10.222.0.50 "GET /compute/v2.1/servers/d18fee50-f30d-44c3-9ac5-18aaace88e65" status: 200 len: 1521 microversion: 2.1 time: 0.321174 Aug 31 16:02:08.925464 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1343/2785] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:08 2022] GET /compute/v2.1/servers/d18fee50-f30d-44c3-9ac5-18aaace88e65 => generated 1521 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:08.935781 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-91e27698-9b09-469f-8f07-9bc054fdeef4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:08.938935 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-91e27698-9b09-469f-8f07-9bc054fdeef4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:08.955218 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91e27698-9b09-469f-8f07-9bc054fdeef4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:08.957523 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91e27698-9b09-469f-8f07-9bc054fdeef4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:08.958169 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91e27698-9b09-469f-8f07-9bc054fdeef4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:08.962327 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91e27698-9b09-469f-8f07-9bc054fdeef4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:08.963078 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91e27698-9b09-469f-8f07-9bc054fdeef4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:08.966712 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91e27698-9b09-469f-8f07-9bc054fdeef4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:09.158497 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-91e27698-9b09-469f-8f07-9bc054fdeef4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:09.168082 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-91e27698-9b09-469f-8f07-9bc054fdeef4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1684 microversion: 2.1 time: 0.240756 Aug 31 16:02:09.169393 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1344/2786] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:08 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1684 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:09.187339 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-03114fb2-12b4-49f7-b6b2-815654057b81 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Action: 'create', calling method: .version_select at 0x7fbb46bd9310>, body: {"pool": null} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:10.850515 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=59 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:02:11.191955 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:02:11.296918 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-03114fb2-12b4-49f7-b6b2-815654057b81 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] 10.222.0.50 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.126321 Aug 31 16:02:11.311972 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1345/2787] 10.222.0.50 () {60 vars in 1170 bytes} [Wed Aug 31 16:02:09 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:02:11.318172 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-80f5a341-1329-4470-888e-3ab2e0808637 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:11.319014 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-80f5a341-1329-4470-888e-3ab2e0808637 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 8b94785f-e6ed-4958-84e4-41e521d3d36e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:11.327013 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80f5a341-1329-4470-888e-3ab2e0808637 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:11.327759 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80f5a341-1329-4470-888e-3ab2e0808637 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:11.328546 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80f5a341-1329-4470-888e-3ab2e0808637 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:11.329443 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80f5a341-1329-4470-888e-3ab2e0808637 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:11.330075 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80f5a341-1329-4470-888e-3ab2e0808637 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:11.330700 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80f5a341-1329-4470-888e-3ab2e0808637 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:11.573344 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-80f5a341-1329-4470-888e-3ab2e0808637 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8476b6167a4c838eac59d7c4a40284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a7c84a4ea54074bab3ccc035c5cf47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:11.582973 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-80f5a341-1329-4470-888e-3ab2e0808637 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/8b94785f-e6ed-4958-84e4-41e521d3d36e" status: 200 len: 1521 microversion: 2.1 time: 0.269408 Aug 31 16:02:11.605248 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1346/2788] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:11 2022] GET /compute/v2.1/servers/8b94785f-e6ed-4958-84e4-41e521d3d36e => generated 1521 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:11.611122 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-db33deca-ae81-4da9-85b0-4bd4de9ebbb1 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:11.612845 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-db33deca-ae81-4da9-85b0-4bd4de9ebbb1 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:11.625685 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db33deca-ae81-4da9-85b0-4bd4de9ebbb1 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:11.627163 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db33deca-ae81-4da9-85b0-4bd4de9ebbb1 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:11.627784 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db33deca-ae81-4da9-85b0-4bd4de9ebbb1 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:11.629334 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db33deca-ae81-4da9-85b0-4bd4de9ebbb1 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:11.629953 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db33deca-ae81-4da9-85b0-4bd4de9ebbb1 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:11.630584 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db33deca-ae81-4da9-85b0-4bd4de9ebbb1 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:11.889530 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-db33deca-ae81-4da9-85b0-4bd4de9ebbb1 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:11.900847 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-db33deca-ae81-4da9-85b0-4bd4de9ebbb1 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1684 microversion: 2.1 time: 0.294186 Aug 31 16:02:11.901692 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1347/2789] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:11 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1684 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:11.931651 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ba2d07a3-1298-457d-b5df-161516267423 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1118669599", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "73c1c7bb-002c-4b7e-9aff-6189e5ddb8fe"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:14.130204 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-daba968c-a857-4fd5-90a2-19486a69180c tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] validate_networks() for [('39370b19-7cbc-4e21-9ace-fa993a5e662f', None, None, None, None, None)] {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:02:14.246003 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-ba2d07a3-1298-457d-b5df-161516267423 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] validate_networks() for [('73c1c7bb-002c-4b7e-9aff-6189e5ddb8fe', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:02:15.600343 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ba2d07a3-1298-457d-b5df-161516267423 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:02:15.600904 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ba2d07a3-1298-457d-b5df-161516267423 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:02:15.601302 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ba2d07a3-1298-457d-b5df-161516267423 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:02:15.601744 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ba2d07a3-1298-457d-b5df-161516267423 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:02:15.602354 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ba2d07a3-1298-457d-b5df-161516267423 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:02:15.603244 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-daba968c-a857-4fd5-90a2-19486a69180c tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:02:15.603722 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-daba968c-a857-4fd5-90a2-19486a69180c tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:02:15.604298 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-daba968c-a857-4fd5-90a2-19486a69180c tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:02:15.606799 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-daba968c-a857-4fd5-90a2-19486a69180c tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:02:15.607423 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-daba968c-a857-4fd5-90a2-19486a69180c tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:02:15.633908 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba2d07a3-1298-457d-b5df-161516267423 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:15.636120 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba2d07a3-1298-457d-b5df-161516267423 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:15.638498 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba2d07a3-1298-457d-b5df-161516267423 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:15.640115 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba2d07a3-1298-457d-b5df-161516267423 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:15.640263 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-daba968c-a857-4fd5-90a2-19486a69180c tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:15.642520 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-daba968c-a857-4fd5-90a2-19486a69180c tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:15.642846 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba2d07a3-1298-457d-b5df-161516267423 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:15.642978 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-daba968c-a857-4fd5-90a2-19486a69180c tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:15.643569 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba2d07a3-1298-457d-b5df-161516267423 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:15.646797 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-daba968c-a857-4fd5-90a2-19486a69180c tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:15.647346 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-daba968c-a857-4fd5-90a2-19486a69180c tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:15.647780 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-daba968c-a857-4fd5-90a2-19486a69180c tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:15.705350 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-ba2d07a3-1298-457d-b5df-161516267423 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Getting quotas for project abd7cf0fb56d40dca0d158268001b107. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:02:15.705547 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-daba968c-a857-4fd5-90a2-19486a69180c tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Getting quotas for project 1355779c2e2d4cfeb0825b76968867b1. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:02:15.714345 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-ba2d07a3-1298-457d-b5df-161516267423 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Getting quotas for user d3c15400d81847c09c81b04b668560b7 and project abd7cf0fb56d40dca0d158268001b107. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:02:15.730636 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-daba968c-a857-4fd5-90a2-19486a69180c tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Getting quotas for user b9840c71c4ec49c1a60ef97943d173ef and project 1355779c2e2d4cfeb0825b76968867b1. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:02:15.745467 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ba2d07a3-1298-457d-b5df-161516267423 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:02:15.747907 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ba2d07a3-1298-457d-b5df-161516267423 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] [instance: 6bd8b697-3187-47f8-bec9-5784c425a9ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:02:15.784621 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-daba968c-a857-4fd5-90a2-19486a69180c tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:02:15.793662 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-daba968c-a857-4fd5-90a2-19486a69180c tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 96bec4d7-3a20-4974-8865-51ef8fd087f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:02:15.852112 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:02:15.904302 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ba2d07a3-1298-457d-b5df-161516267423 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.001293 Aug 31 16:02:15.904971 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1348/2790] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:02:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 4003 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:02:15.923613 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-47a51834-c125-4b8b-b432-72be93a32fda tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:15.924041 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-47a51834-c125-4b8b-b432-72be93a32fda tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 8b94785f-e6ed-4958-84e4-41e521d3d36e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:15.931998 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-daba968c-a857-4fd5-90a2-19486a69180c tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 14.833580 Aug 31 16:02:15.940493 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1443/2791] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:02:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 14843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 16:02:15.946310 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2bbc85dc-6c66-4bc9-accc-0274ce2b0bda tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:15.946929 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2bbc85dc-6c66-4bc9-accc-0274ce2b0bda tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:15.950778 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47a51834-c125-4b8b-b432-72be93a32fda tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:15.951281 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47a51834-c125-4b8b-b432-72be93a32fda tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:15.951718 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47a51834-c125-4b8b-b432-72be93a32fda tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:15.954160 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47a51834-c125-4b8b-b432-72be93a32fda tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:15.955554 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47a51834-c125-4b8b-b432-72be93a32fda tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:15.956317 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47a51834-c125-4b8b-b432-72be93a32fda tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:15.975730 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2bbc85dc-6c66-4bc9-accc-0274ce2b0bda tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:15.976233 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2bbc85dc-6c66-4bc9-accc-0274ce2b0bda tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:15.976671 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2bbc85dc-6c66-4bc9-accc-0274ce2b0bda tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:15.977375 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2bbc85dc-6c66-4bc9-accc-0274ce2b0bda tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:15.977827 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2bbc85dc-6c66-4bc9-accc-0274ce2b0bda tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:15.978294 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2bbc85dc-6c66-4bc9-accc-0274ce2b0bda tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:16.070589 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-47a51834-c125-4b8b-b432-72be93a32fda tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 8b94785f-e6ed-4958-84e4-41e521d3d36e] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:02:16.300159 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2bbc85dc-6c66-4bc9-accc-0274ce2b0bda tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:16.312707 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2bbc85dc-6c66-4bc9-accc-0274ce2b0bda tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1671 microversion: 2.1 time: 0.371053 Aug 31 16:02:16.318722 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1444/2792] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:15 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1671 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:16.363335 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2613c5ee-2fbd-480d-89ca-581e3299e218 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:16.367362 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2613c5ee-2fbd-480d-89ca-581e3299e218 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] [instance: 6bd8b697-3187-47f8-bec9-5784c425a9ce] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:16.403753 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-47a51834-c125-4b8b-b432-72be93a32fda tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "DELETE /compute/v2.1/servers/8b94785f-e6ed-4958-84e4-41e521d3d36e" status: 204 len: 0 microversion: 2.1 time: 0.494005 Aug 31 16:02:16.406684 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1349/2793] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:02:15 2022] DELETE /compute/v2.1/servers/8b94785f-e6ed-4958-84e4-41e521d3d36e => generated 0 bytes in 501 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:02:16.463628 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c4aa8f80-6f4b-4c6c-9cce-9dec172cc035 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:16.463628 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c4aa8f80-6f4b-4c6c-9cce-9dec172cc035 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 96bec4d7-3a20-4974-8865-51ef8fd087f6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:16.679805 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2613c5ee-2fbd-480d-89ca-581e3299e218 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c15400d81847c09c81b04b668560b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd7cf0fb56d40dca0d158268001b107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:16.693607 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2613c5ee-2fbd-480d-89ca-581e3299e218 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] 10.222.0.50 "GET /compute/v2.1/servers/6bd8b697-3187-47f8-bec9-5784c425a9ce" status: 200 len: 1224 microversion: 2.1 time: 0.369154 Aug 31 16:02:16.697824 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1445/2794] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:16 2022] GET /compute/v2.1/servers/6bd8b697-3187-47f8-bec9-5784c425a9ce => generated 1224 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:16.720487 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6fc282bb-0d53-485c-84e4-94156d57d807 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:16.741570 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6fc282bb-0d53-485c-84e4-94156d57d807 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 8b94785f-e6ed-4958-84e4-41e521d3d36e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:16.793446 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6fc282bb-0d53-485c-84e4-94156d57d807 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:16.795900 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6fc282bb-0d53-485c-84e4-94156d57d807 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:16.796925 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6fc282bb-0d53-485c-84e4-94156d57d807 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:16.800264 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6fc282bb-0d53-485c-84e4-94156d57d807 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:16.801349 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6fc282bb-0d53-485c-84e4-94156d57d807 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:16.802936 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6fc282bb-0d53-485c-84e4-94156d57d807 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:16.853976 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c4aa8f80-6f4b-4c6c-9cce-9dec172cc035 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:16.875044 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c4aa8f80-6f4b-4c6c-9cce-9dec172cc035 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/96bec4d7-3a20-4974-8865-51ef8fd087f6" status: 200 len: 1211 microversion: 2.1 time: 0.463680 Aug 31 16:02:16.891096 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1350/2795] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:16 2022] GET /compute/v2.1/servers/96bec4d7-3a20-4974-8865-51ef8fd087f6 => generated 1211 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:16.897823 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-aafc7867-81b1-4209-a8f9-c487c7e7e3c4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:16.898904 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-aafc7867-81b1-4209-a8f9-c487c7e7e3c4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:16.910335 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aafc7867-81b1-4209-a8f9-c487c7e7e3c4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:16.911112 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aafc7867-81b1-4209-a8f9-c487c7e7e3c4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:16.911858 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aafc7867-81b1-4209-a8f9-c487c7e7e3c4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:16.912988 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aafc7867-81b1-4209-a8f9-c487c7e7e3c4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:16.913663 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aafc7867-81b1-4209-a8f9-c487c7e7e3c4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:16.914401 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aafc7867-81b1-4209-a8f9-c487c7e7e3c4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:17.795588 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6fc282bb-0d53-485c-84e4-94156d57d807 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8476b6167a4c838eac59d7c4a40284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a7c84a4ea54074bab3ccc035c5cf47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:17.812780 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6fc282bb-0d53-485c-84e4-94156d57d807 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/8b94785f-e6ed-4958-84e4-41e521d3d36e" status: 200 len: 1527 microversion: 2.1 time: 1.111556 Aug 31 16:02:17.814271 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1446/2796] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:16 2022] GET /compute/v2.1/servers/8b94785f-e6ed-4958-84e4-41e521d3d36e => generated 1527 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:17.832944 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-e0d1ab2e-43d7-43f0-ad35-1198f7f7d966 req-4d67f592-a01f-4701-92ae-bfc2e76bb14a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b", "name": "network-vif-unplugged", "status": "completed", "tag": "4e98deab-3424-49ec-b930-3019d71c32c7"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:17.889100 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-e0d1ab2e-43d7-43f0-ad35-1198f7f7d966 req-4d67f592-a01f-4701-92ae-bfc2e76bb14a service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:17.889767 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-e0d1ab2e-43d7-43f0-ad35-1198f7f7d966 req-4d67f592-a01f-4701-92ae-bfc2e76bb14a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:17.891604 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-e0d1ab2e-43d7-43f0-ad35-1198f7f7d966 req-4d67f592-a01f-4701-92ae-bfc2e76bb14a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:17.935800 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-e0d1ab2e-43d7-43f0-ad35-1198f7f7d966 req-4d67f592-a01f-4701-92ae-bfc2e76bb14a service nova] Creating event network-vif-unplugged:4e98deab-3424-49ec-b930-3019d71c32c7 for instance 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b on n-h1-833090-16 Aug 31 16:02:17.947876 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-e0d1ab2e-43d7-43f0-ad35-1198f7f7d966 req-4d67f592-a01f-4701-92ae-bfc2e76bb14a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.130687 Aug 31 16:02:17.951826 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1447/2797] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:02:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:02:17.965926 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f67c03e0-517a-42b8-99ea-5850c048c76f tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:17.968214 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f67c03e0-517a-42b8-99ea-5850c048c76f tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] [instance: 6bd8b697-3187-47f8-bec9-5784c425a9ce] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:17.989266 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f67c03e0-517a-42b8-99ea-5850c048c76f tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:17.992900 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f67c03e0-517a-42b8-99ea-5850c048c76f tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:17.995830 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f67c03e0-517a-42b8-99ea-5850c048c76f tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:17.998001 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f67c03e0-517a-42b8-99ea-5850c048c76f tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:18.008252 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f67c03e0-517a-42b8-99ea-5850c048c76f tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:18.009227 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f67c03e0-517a-42b8-99ea-5850c048c76f tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:18.192116 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-aafc7867-81b1-4209-a8f9-c487c7e7e3c4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:18.206978 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-aafc7867-81b1-4209-a8f9-c487c7e7e3c4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1671 microversion: 2.1 time: 1.313792 Aug 31 16:02:18.207615 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1351/2798] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:16 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1671 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:18.220376 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6e50beef-e8e9-42f0-91b8-df05119429b6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:18.242629 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6e50beef-e8e9-42f0-91b8-df05119429b6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 96bec4d7-3a20-4974-8865-51ef8fd087f6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:18.264930 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6e50beef-e8e9-42f0-91b8-df05119429b6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:18.265430 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6e50beef-e8e9-42f0-91b8-df05119429b6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:18.265876 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6e50beef-e8e9-42f0-91b8-df05119429b6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:18.266709 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6e50beef-e8e9-42f0-91b8-df05119429b6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:18.267181 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6e50beef-e8e9-42f0-91b8-df05119429b6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:18.283195 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6e50beef-e8e9-42f0-91b8-df05119429b6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:18.335968 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f67c03e0-517a-42b8-99ea-5850c048c76f tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c15400d81847c09c81b04b668560b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd7cf0fb56d40dca0d158268001b107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:18.351532 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f67c03e0-517a-42b8-99ea-5850c048c76f tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] 10.222.0.50 "GET /compute/v2.1/servers/6bd8b697-3187-47f8-bec9-5784c425a9ce" status: 200 len: 1276 microversion: 2.1 time: 0.397652 Aug 31 16:02:18.360026 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1448/2799] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:17 2022] GET /compute/v2.1/servers/6bd8b697-3187-47f8-bec9-5784c425a9ce => generated 1276 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:18.620459 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6e50beef-e8e9-42f0-91b8-df05119429b6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:18.638431 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6e50beef-e8e9-42f0-91b8-df05119429b6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/96bec4d7-3a20-4974-8865-51ef8fd087f6" status: 200 len: 1263 microversion: 2.1 time: 0.426248 Aug 31 16:02:18.658836 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1352/2800] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:18 2022] GET /compute/v2.1/servers/96bec4d7-3a20-4974-8865-51ef8fd087f6 => generated 1263 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:18.842375 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-532c9dc7-4762-4340-8953-1b5bd7b15c12 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:18.846940 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-532c9dc7-4762-4340-8953-1b5bd7b15c12 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 8b94785f-e6ed-4958-84e4-41e521d3d36e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:18.866740 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-532c9dc7-4762-4340-8953-1b5bd7b15c12 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:18.871575 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-532c9dc7-4762-4340-8953-1b5bd7b15c12 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:18.872339 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-532c9dc7-4762-4340-8953-1b5bd7b15c12 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:18.878849 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-532c9dc7-4762-4340-8953-1b5bd7b15c12 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:18.879547 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-532c9dc7-4762-4340-8953-1b5bd7b15c12 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:18.881071 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-532c9dc7-4762-4340-8953-1b5bd7b15c12 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:19.381245 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-65748b49-4a40-4ae6-829e-2089ea96318a tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:19.382522 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-65748b49-4a40-4ae6-829e-2089ea96318a tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] [instance: 6bd8b697-3187-47f8-bec9-5784c425a9ce] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:19.397053 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65748b49-4a40-4ae6-829e-2089ea96318a tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:19.397551 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65748b49-4a40-4ae6-829e-2089ea96318a tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:19.397984 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65748b49-4a40-4ae6-829e-2089ea96318a tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:19.427228 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65748b49-4a40-4ae6-829e-2089ea96318a tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:19.427711 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65748b49-4a40-4ae6-829e-2089ea96318a tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:19.428144 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65748b49-4a40-4ae6-829e-2089ea96318a tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:19.503632 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:02:19.701711 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-65748b49-4a40-4ae6-829e-2089ea96318a tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c15400d81847c09c81b04b668560b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd7cf0fb56d40dca0d158268001b107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:19.710623 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-65748b49-4a40-4ae6-829e-2089ea96318a tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] 10.222.0.50 "GET /compute/v2.1/servers/6bd8b697-3187-47f8-bec9-5784c425a9ce" status: 200 len: 1294 microversion: 2.1 time: 0.333521 Aug 31 16:02:19.727594 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1353/2801] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:19 2022] GET /compute/v2.1/servers/6bd8b697-3187-47f8-bec9-5784c425a9ce => generated 1294 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:02:19.742191 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-de8d8ec4-c891-44f1-950e-a63f32301087 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:19.745162 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-de8d8ec4-c891-44f1-950e-a63f32301087 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 96bec4d7-3a20-4974-8865-51ef8fd087f6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:19.761639 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-de8d8ec4-c891-44f1-950e-a63f32301087 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:19.762779 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-de8d8ec4-c891-44f1-950e-a63f32301087 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:19.763368 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-de8d8ec4-c891-44f1-950e-a63f32301087 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:19.764465 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-de8d8ec4-c891-44f1-950e-a63f32301087 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:19.765075 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-de8d8ec4-c891-44f1-950e-a63f32301087 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:19.767228 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-de8d8ec4-c891-44f1-950e-a63f32301087 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:19.951457 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-de8d8ec4-c891-44f1-950e-a63f32301087 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:19.976166 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-de8d8ec4-c891-44f1-950e-a63f32301087 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/96bec4d7-3a20-4974-8865-51ef8fd087f6" status: 200 len: 1269 microversion: 2.1 time: 0.246367 Aug 31 16:02:19.994750 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1354/2802] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:19 2022] GET /compute/v2.1/servers/96bec4d7-3a20-4974-8865-51ef8fd087f6 => generated 1269 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:20.134380 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-532c9dc7-4762-4340-8953-1b5bd7b15c12 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8476b6167a4c838eac59d7c4a40284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a7c84a4ea54074bab3ccc035c5cf47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:20.169517 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-532c9dc7-4762-4340-8953-1b5bd7b15c12 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/8b94785f-e6ed-4958-84e4-41e521d3d36e" status: 200 len: 1527 microversion: 2.1 time: 1.336148 Aug 31 16:02:20.185290 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1449/2803] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:18 2022] GET /compute/v2.1/servers/8b94785f-e6ed-4958-84e4-41e521d3d36e => generated 1527 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:20.743409 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fcc7debc-8904-4063-99b5-ca96dfb1ca69 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:20.744830 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fcc7debc-8904-4063-99b5-ca96dfb1ca69 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] [instance: 6bd8b697-3187-47f8-bec9-5784c425a9ce] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:20.761243 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fcc7debc-8904-4063-99b5-ca96dfb1ca69 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:20.764288 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fcc7debc-8904-4063-99b5-ca96dfb1ca69 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:20.764982 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fcc7debc-8904-4063-99b5-ca96dfb1ca69 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:20.766025 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fcc7debc-8904-4063-99b5-ca96dfb1ca69 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:20.770430 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fcc7debc-8904-4063-99b5-ca96dfb1ca69 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:20.771144 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fcc7debc-8904-4063-99b5-ca96dfb1ca69 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:20.982558 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fcc7debc-8904-4063-99b5-ca96dfb1ca69 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c15400d81847c09c81b04b668560b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd7cf0fb56d40dca0d158268001b107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:21.012683 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fcc7debc-8904-4063-99b5-ca96dfb1ca69 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] 10.222.0.50 "GET /compute/v2.1/servers/6bd8b697-3187-47f8-bec9-5784c425a9ce" status: 200 len: 1282 microversion: 2.1 time: 0.259226 Aug 31 16:02:21.012683 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1355/2804] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:20 2022] GET /compute/v2.1/servers/6bd8b697-3187-47f8-bec9-5784c425a9ce => generated 1282 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:21.013189 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-29f87b37-4a16-47a3-9ac5-8afcdd77b465 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:21.013189 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-29f87b37-4a16-47a3-9ac5-8afcdd77b465 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 96bec4d7-3a20-4974-8865-51ef8fd087f6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:21.044588 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-29f87b37-4a16-47a3-9ac5-8afcdd77b465 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:21.052088 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-29f87b37-4a16-47a3-9ac5-8afcdd77b465 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:21.060502 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-29f87b37-4a16-47a3-9ac5-8afcdd77b465 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:21.063999 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-29f87b37-4a16-47a3-9ac5-8afcdd77b465 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:21.065185 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-29f87b37-4a16-47a3-9ac5-8afcdd77b465 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:21.067316 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-29f87b37-4a16-47a3-9ac5-8afcdd77b465 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:21.197946 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b7e02cb4-bd0c-4770-a3d7-79b2e49734ce tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:21.198647 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b7e02cb4-bd0c-4770-a3d7-79b2e49734ce tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 8b94785f-e6ed-4958-84e4-41e521d3d36e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:21.223800 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7e02cb4-bd0c-4770-a3d7-79b2e49734ce tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:21.227552 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7e02cb4-bd0c-4770-a3d7-79b2e49734ce tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:21.228146 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7e02cb4-bd0c-4770-a3d7-79b2e49734ce tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:21.229024 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7e02cb4-bd0c-4770-a3d7-79b2e49734ce tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:21.241902 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7e02cb4-bd0c-4770-a3d7-79b2e49734ce tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:21.242687 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7e02cb4-bd0c-4770-a3d7-79b2e49734ce tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:21.419130 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-29f87b37-4a16-47a3-9ac5-8afcdd77b465 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:21.434675 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-29f87b37-4a16-47a3-9ac5-8afcdd77b465 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/96bec4d7-3a20-4974-8865-51ef8fd087f6" status: 200 len: 1269 microversion: 2.1 time: 0.437309 Aug 31 16:02:21.436311 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1450/2805] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:20 2022] GET /compute/v2.1/servers/96bec4d7-3a20-4974-8865-51ef8fd087f6 => generated 1269 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:21.445632 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3c38ed35-d618-4cf3-85a2-7dcbb6c1886d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:21.446909 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3c38ed35-d618-4cf3-85a2-7dcbb6c1886d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:21.459220 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3c38ed35-d618-4cf3-85a2-7dcbb6c1886d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:21.460180 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3c38ed35-d618-4cf3-85a2-7dcbb6c1886d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:21.461348 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3c38ed35-d618-4cf3-85a2-7dcbb6c1886d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:21.463662 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3c38ed35-d618-4cf3-85a2-7dcbb6c1886d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:21.464682 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3c38ed35-d618-4cf3-85a2-7dcbb6c1886d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:21.465386 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3c38ed35-d618-4cf3-85a2-7dcbb6c1886d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:22.176983 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b7e02cb4-bd0c-4770-a3d7-79b2e49734ce tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8476b6167a4c838eac59d7c4a40284', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75a7c84a4ea54074bab3ccc035c5cf47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:22.193307 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b7e02cb4-bd0c-4770-a3d7-79b2e49734ce tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/8b94785f-e6ed-4958-84e4-41e521d3d36e" status: 200 len: 1485 microversion: 2.1 time: 1.001766 Aug 31 16:02:22.197597 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1356/2806] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:21 2022] GET /compute/v2.1/servers/8b94785f-e6ed-4958-84e4-41e521d3d36e => generated 1485 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:02:22.270150 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1ca15d92-4682-4b66-8243-a400ae13b45f tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:22.271077 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1ca15d92-4682-4b66-8243-a400ae13b45f tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] [instance: 6bd8b697-3187-47f8-bec9-5784c425a9ce] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:22.286742 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ca15d92-4682-4b66-8243-a400ae13b45f tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:22.288541 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ca15d92-4682-4b66-8243-a400ae13b45f tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:22.289401 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ca15d92-4682-4b66-8243-a400ae13b45f tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:22.290332 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ca15d92-4682-4b66-8243-a400ae13b45f tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:22.292310 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ca15d92-4682-4b66-8243-a400ae13b45f tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:22.293157 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ca15d92-4682-4b66-8243-a400ae13b45f tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:22.555930 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1ca15d92-4682-4b66-8243-a400ae13b45f tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c15400d81847c09c81b04b668560b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd7cf0fb56d40dca0d158268001b107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:22.560071 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3c38ed35-d618-4cf3-85a2-7dcbb6c1886d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:22.570387 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3c38ed35-d618-4cf3-85a2-7dcbb6c1886d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1671 microversion: 2.1 time: 1.131715 Aug 31 16:02:22.573604 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1451/2807] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:21 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1671 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:22.578922 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1ca15d92-4682-4b66-8243-a400ae13b45f tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] 10.222.0.50 "GET /compute/v2.1/servers/6bd8b697-3187-47f8-bec9-5784c425a9ce" status: 200 len: 1282 microversion: 2.1 time: 0.377669 Aug 31 16:02:22.580859 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1357/2808] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:22 2022] GET /compute/v2.1/servers/6bd8b697-3187-47f8-bec9-5784c425a9ce => generated 1282 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:22.586234 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b65cde75-96b7-4cc3-88c9-3074d075ad34 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:22.587035 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b65cde75-96b7-4cc3-88c9-3074d075ad34 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 96bec4d7-3a20-4974-8865-51ef8fd087f6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:22.612006 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-6bab7292-42f7-48bb-98b1-88af6152d54e req-fd4e3d7a-d969-4502-b6a4-709394aaeb9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b94785f-e6ed-4958-84e4-41e521d3d36e", "name": "network-vif-deleted", "tag": "a229b4ae-457d-4d53-bb5c-d7ba527587a2"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:22.614627 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b65cde75-96b7-4cc3-88c9-3074d075ad34 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:22.618938 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b65cde75-96b7-4cc3-88c9-3074d075ad34 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:22.621907 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b65cde75-96b7-4cc3-88c9-3074d075ad34 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:22.625581 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b65cde75-96b7-4cc3-88c9-3074d075ad34 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:22.628499 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b65cde75-96b7-4cc3-88c9-3074d075ad34 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:22.629155 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b65cde75-96b7-4cc3-88c9-3074d075ad34 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:22.650743 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-6bab7292-42f7-48bb-98b1-88af6152d54e req-fd4e3d7a-d969-4502-b6a4-709394aaeb9f service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:22.652182 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-6bab7292-42f7-48bb-98b1-88af6152d54e req-fd4e3d7a-d969-4502-b6a4-709394aaeb9f service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:22.657633 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-6bab7292-42f7-48bb-98b1-88af6152d54e req-fd4e3d7a-d969-4502-b6a4-709394aaeb9f service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:22.701036 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-6bab7292-42f7-48bb-98b1-88af6152d54e req-fd4e3d7a-d969-4502-b6a4-709394aaeb9f service nova] Creating event network-vif-deleted:a229b4ae-457d-4d53-bb5c-d7ba527587a2 for instance 8b94785f-e6ed-4958-84e4-41e521d3d36e on n-h1-833090-16 Aug 31 16:02:22.721736 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-6bab7292-42f7-48bb-98b1-88af6152d54e req-fd4e3d7a-d969-4502-b6a4-709394aaeb9f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146169 Aug 31 16:02:22.724411 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1452/2809] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:02:22.760118 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-42d7a0e4-b9c5-4e62-ac14-eee1668b8fa9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:22.762049 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-42d7a0e4-b9c5-4e62-ac14-eee1668b8fa9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:22.787756 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-42d7a0e4-b9c5-4e62-ac14-eee1668b8fa9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:22.789869 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-42d7a0e4-b9c5-4e62-ac14-eee1668b8fa9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:22.791391 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-42d7a0e4-b9c5-4e62-ac14-eee1668b8fa9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:22.794155 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-42d7a0e4-b9c5-4e62-ac14-eee1668b8fa9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:22.795544 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-42d7a0e4-b9c5-4e62-ac14-eee1668b8fa9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:22.796944 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-42d7a0e4-b9c5-4e62-ac14-eee1668b8fa9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:23.453447 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b65cde75-96b7-4cc3-88c9-3074d075ad34 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:23.463753 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b65cde75-96b7-4cc3-88c9-3074d075ad34 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/96bec4d7-3a20-4974-8865-51ef8fd087f6" status: 200 len: 1311 microversion: 2.1 time: 0.881609 Aug 31 16:02:23.471511 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1358/2810] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:22 2022] GET /compute/v2.1/servers/96bec4d7-3a20-4974-8865-51ef8fd087f6 => generated 1311 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:23.490520 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0b1a725a-9ad2-4deb-b877-159dee9628a4 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:23.492784 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0b1a725a-9ad2-4deb-b877-159dee9628a4 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 8b94785f-e6ed-4958-84e4-41e521d3d36e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:23.500076 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-42d7a0e4-b9c5-4e62-ac14-eee1668b8fa9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:23.519133 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-42d7a0e4-b9c5-4e62-ac14-eee1668b8fa9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1671 microversion: 2.1 time: 0.790654 Aug 31 16:02:23.521462 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1453/2811] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:22 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1671 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:23.523340 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0b1a725a-9ad2-4deb-b877-159dee9628a4 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:23.524800 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0b1a725a-9ad2-4deb-b877-159dee9628a4 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:23.525407 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0b1a725a-9ad2-4deb-b877-159dee9628a4 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:23.526298 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0b1a725a-9ad2-4deb-b877-159dee9628a4 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:23.526918 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0b1a725a-9ad2-4deb-b877-159dee9628a4 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:23.527490 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0b1a725a-9ad2-4deb-b877-159dee9628a4 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:23.541105 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c5e87c2c-361f-4cfc-896e-8d15f98aaf25 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:23.541714 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c5e87c2c-361f-4cfc-896e-8d15f98aaf25 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:23.570548 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c5e87c2c-361f-4cfc-896e-8d15f98aaf25 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:23.573495 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c5e87c2c-361f-4cfc-896e-8d15f98aaf25 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:23.574717 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c5e87c2c-361f-4cfc-896e-8d15f98aaf25 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:23.579084 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c5e87c2c-361f-4cfc-896e-8d15f98aaf25 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:23.581775 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c5e87c2c-361f-4cfc-896e-8d15f98aaf25 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:23.582675 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c5e87c2c-361f-4cfc-896e-8d15f98aaf25 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:23.592727 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-0b1a725a-9ad2-4deb-b877-159dee9628a4 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] HTTP exception thrown: Instance 8b94785f-e6ed-4958-84e4-41e521d3d36e could not be found. Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0b1a725a-9ad2-4deb-b877-159dee9628a4 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Request method failure captured: Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/8b94785f-e6ed-4958-84e4-41e521d3d36e HTTP/1.1 Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4VuegaF_fmy46ih3aH48SHyk9S0K5f6VgFr4AjCz2qlep55514N16M8NDogA4-FaRt5exvJysgb4a16NCF-uwnoFVaAwgVvS87_klTsI4Q1cOt4rcQPW4Ao3jepMn1MxMfgCP9op9_ywmQywVzBp5itFLK6pFxwsw-bP4gtv8ayT6Y Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 75a7c84a4ea54074bab3ccc035c5cf47 Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2143463755 Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/75a7c84a4ea54074bab3ccc035c5cf47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/75a7c84a4ea54074bab3ccc035c5cf47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/75a7c84a4ea54074bab3ccc035c5cf47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_75a7c84a4ea54074bab3ccc035c5cf47", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2143463755 Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 75a7c84a4ea54074bab3ccc035c5cf47 Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2143463755 Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ImagesOneServerNegativeTestJSON-2143463755-project Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 3c8476b6167a4c838eac59d7c4a40284 Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2143463755-project Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 8b94785f-e6ed-4958-84e4-41e521d3d36e could not be found. Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '8b94785f-e6ed-4958-84e4-41e521d3d36e'} Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b94785f-e6ed-4958-84e4-41e521d3d36e could not be found. Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b94785f-e6ed-4958-84e4-41e521d3d36e could not be found. Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:02:23.597678 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:02:23.602863 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:02:23.602863 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:02:23.602863 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:02:23.602863 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:02:23.602863 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:02:23.602863 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:02:23.602863 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b94785f-e6ed-4958-84e4-41e521d3d36e could not be found. Aug 31 16:02:23.602863 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:02:23.619655 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0b1a725a-9ad2-4deb-b877-159dee9628a4 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Returning 404 to user: Instance 8b94785f-e6ed-4958-84e4-41e521d3d36e could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:02:23.620532 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0b1a725a-9ad2-4deb-b877-159dee9628a4 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/8b94785f-e6ed-4958-84e4-41e521d3d36e" status: 404 len: 111 microversion: 2.1 time: 0.147497 Aug 31 16:02:23.628959 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1359/2812] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:23 2022] GET /compute/v2.1/servers/8b94785f-e6ed-4958-84e4-41e521d3d36e => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:02:23.648138 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dbca588f-33f3-406e-ad1c-2ae85e48a18e tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:23.649134 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dbca588f-33f3-406e-ad1c-2ae85e48a18e tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] [instance: 6bd8b697-3187-47f8-bec9-5784c425a9ce] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:23.671921 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dbca588f-33f3-406e-ad1c-2ae85e48a18e tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:23.672442 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dbca588f-33f3-406e-ad1c-2ae85e48a18e tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:23.673022 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dbca588f-33f3-406e-ad1c-2ae85e48a18e tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:23.681185 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dbca588f-33f3-406e-ad1c-2ae85e48a18e tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:23.682069 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dbca588f-33f3-406e-ad1c-2ae85e48a18e tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:23.682550 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dbca588f-33f3-406e-ad1c-2ae85e48a18e tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:24.042269 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c5e87c2c-361f-4cfc-896e-8d15f98aaf25 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:24.055024 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c5e87c2c-361f-4cfc-896e-8d15f98aaf25 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1671 microversion: 2.1 time: 0.517764 Aug 31 16:02:24.060316 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1454/2813] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:23 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1671 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:24.074345 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a0d92120-bf14-44ae-b5e3-b639654cde73 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '.version_select at 0x7fbb460118b0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:24.133013 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-a0d92120-bf14-44ae-b5e3-b639654cde73 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] HTTP exception thrown: Image not found. Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a0d92120-bf14-44ae-b5e3-b639654cde73 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Request method failure captured: Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: request: DELETE /compute/v2.1/images/3eed9ace-8553-40e5-a219-0648d54c9edd HTTP/1.1 Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4VuegaF_fmy46ih3aH48SHyk9S0K5f6VgFr4AjCz2qlep55514N16M8NDogA4-FaRt5exvJysgb4a16NCF-uwnoFVaAwgVvS87_klTsI4Q1cOt4rcQPW4Ao3jepMn1MxMfgCP9op9_ywmQywVzBp5itFLK6pFxwsw-bP4gtv8ayT6Y Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 75a7c84a4ea54074bab3ccc035c5cf47 Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2143463755 Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/75a7c84a4ea54074bab3ccc035c5cf47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/75a7c84a4ea54074bab3ccc035c5cf47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/75a7c84a4ea54074bab3ccc035c5cf47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_75a7c84a4ea54074bab3ccc035c5cf47", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2143463755 Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 75a7c84a4ea54074bab3ccc035c5cf47 Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2143463755 Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ImagesOneServerNegativeTestJSON-2143463755-project Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 3c8476b6167a4c838eac59d7c4a40284 Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2143463755-project Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: method: Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: exception: Image not found. Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '3eed9ace-8553-40e5-a219-0648d54c9edd'} Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 3eed9ace-8553-40e5-a219-0648d54c9edd to delete Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3eed9ace-8553-40e5-a219-0648d54c9edd could not be found. Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:02:24.135066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:02:24.139929 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:02:24.139929 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:02:24.139929 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:02:24.139929 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:02:24.139929 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:02:24.139929 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:02:24.139929 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:02:24.139929 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:02:24.139929 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:02:24.139929 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 31 16:02:24.139929 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 31 16:02:24.139929 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 31 16:02:24.139929 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:02:24.139929 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:02:24.139929 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:02:24.139929 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:02:24.139929 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:02:24.139929 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:02:24.139929 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:02:24.139929 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:02:24.139929 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 31 16:02:24.139929 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:02:24.139929 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a0d92120-bf14-44ae-b5e3-b639654cde73 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Returning 404 to user: Image not found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:02:24.142552 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a0d92120-bf14-44ae-b5e3-b639654cde73 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "DELETE /compute/v2.1/images/3eed9ace-8553-40e5-a219-0648d54c9edd" status: 404 len: 62 microversion: 2.1 time: 0.081074 Aug 31 16:02:24.143537 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1455/2814] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:24 2022] DELETE /compute/v2.1/images/3eed9ace-8553-40e5-a219-0648d54c9edd => generated 62 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 16:02:24.150035 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2a6e0cdf-c3ba-4a7e-91d1-820ea53cb8b0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:24.153745 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2a6e0cdf-c3ba-4a7e-91d1-820ea53cb8b0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:24.186796 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2a6e0cdf-c3ba-4a7e-91d1-820ea53cb8b0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:24.189739 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2a6e0cdf-c3ba-4a7e-91d1-820ea53cb8b0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:24.190361 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2a6e0cdf-c3ba-4a7e-91d1-820ea53cb8b0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:24.192749 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2a6e0cdf-c3ba-4a7e-91d1-820ea53cb8b0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:24.193362 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2a6e0cdf-c3ba-4a7e-91d1-820ea53cb8b0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:24.196348 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2a6e0cdf-c3ba-4a7e-91d1-820ea53cb8b0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:24.254582 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dbca588f-33f3-406e-ad1c-2ae85e48a18e tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c15400d81847c09c81b04b668560b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd7cf0fb56d40dca0d158268001b107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:24.268955 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dbca588f-33f3-406e-ad1c-2ae85e48a18e tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] 10.222.0.50 "GET /compute/v2.1/servers/6bd8b697-3187-47f8-bec9-5784c425a9ce" status: 200 len: 1324 microversion: 2.1 time: 0.641983 Aug 31 16:02:24.269686 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1360/2815] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:23 2022] GET /compute/v2.1/servers/6bd8b697-3187-47f8-bec9-5784c425a9ce => generated 1324 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:24.284232 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-368460fb-5222-4bd3-bd7c-10cf9daf4b5c tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:24.284232 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-368460fb-5222-4bd3-bd7c-10cf9daf4b5c tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 0a301f9c-b1b8-4962-9d46-28981c195069] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:24.296238 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-368460fb-5222-4bd3-bd7c-10cf9daf4b5c tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:24.297891 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-368460fb-5222-4bd3-bd7c-10cf9daf4b5c tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:24.298375 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-368460fb-5222-4bd3-bd7c-10cf9daf4b5c tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:24.301480 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-368460fb-5222-4bd3-bd7c-10cf9daf4b5c tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:24.303095 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-368460fb-5222-4bd3-bd7c-10cf9daf4b5c tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:24.304077 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-368460fb-5222-4bd3-bd7c-10cf9daf4b5c tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:24.345573 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-368460fb-5222-4bd3-bd7c-10cf9daf4b5c tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] HTTP exception thrown: Instance 0a301f9c-b1b8-4962-9d46-28981c195069 could not be found. Aug 31 16:02:24.352295 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-368460fb-5222-4bd3-bd7c-10cf9daf4b5c tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Request method failure captured: Aug 31 16:02:24.352295 n-d-833090-16 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/0a301f9c-b1b8-4962-9d46-28981c195069 HTTP/1.1 Aug 31 16:02:24.352295 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:02:24.352295 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:02:24.352295 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:02:24.352295 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:02:24.352295 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:02:24.352295 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:02:24.352295 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:02:24.352295 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:02:24.352295 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4VuegaF_fmy46ih3aH48SHyk9S0K5f6VgFr4AjCz2qlep55514N16M8NDogA4-FaRt5exvJysgb4a16NCF-uwnoFVaAwgVvS87_klTsI4Q1cOt4rcQPW4Ao3jepMn1MxMfgCP9op9_ywmQywVzBp5itFLK6pFxwsw-bP4gtv8ayT6Y Aug 31 16:02:24.352295 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:02:24.352295 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:02:24.352295 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:02:24.352295 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:02:24.352295 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:02:24.352295 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:02:24.352295 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 75a7c84a4ea54074bab3ccc035c5cf47 Aug 31 16:02:24.352295 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2143463755 Aug 31 16:02:24.352295 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:02:24.352295 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:02:24.352295 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/75a7c84a4ea54074bab3ccc035c5cf47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/75a7c84a4ea54074bab3ccc035c5cf47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/75a7c84a4ea54074bab3ccc035c5cf47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_75a7c84a4ea54074bab3ccc035c5cf47", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:02:24.352295 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2143463755 Aug 31 16:02:24.352295 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 75a7c84a4ea54074bab3ccc035c5cf47 Aug 31 16:02:24.352295 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2143463755 Aug 31 16:02:24.352295 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ImagesOneServerNegativeTestJSON-2143463755-project Aug 31 16:02:24.352295 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:02:24.352295 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:02:24.352295 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 3c8476b6167a4c838eac59d7c4a40284 Aug 31 16:02:24.352295 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2143463755-project Aug 31 16:02:24.352295 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:02:24.352295 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 0a301f9c-b1b8-4962-9d46-28981c195069 could not be found. Aug 31 16:02:24.352295 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '0a301f9c-b1b8-4962-9d46-28981c195069'} Aug 31 16:02:24.352295 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:02:24.352295 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:02:24.352295 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:02:24.352295 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:02:24.352295 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:02:24.352295 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:02:24.352295 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:02:24.352295 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:02:24.352295 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:02:24.352295 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:02:24.352295 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a301f9c-b1b8-4962-9d46-28981c195069 could not be found. Aug 31 16:02:24.352295 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:02:24.352295 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:02:24.352295 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:02:24.352295 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:02:24.352295 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:02:24.352295 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:02:24.352295 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:02:24.352295 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:02:24.352295 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:02:24.352295 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:02:24.352295 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:02:24.352295 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:02:24.352295 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:02:24.352295 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:02:24.352295 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:02:24.352295 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:02:24.352295 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:02:24.352295 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:02:24.358463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a301f9c-b1b8-4962-9d46-28981c195069 could not be found. Aug 31 16:02:24.358463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:02:24.358463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:02:24.358463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:02:24.358463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:02:24.358463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:02:24.358463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:02:24.358463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:02:24.358463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:02:24.358463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a301f9c-b1b8-4962-9d46-28981c195069 could not be found. Aug 31 16:02:24.358463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:02:24.362285 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-368460fb-5222-4bd3-bd7c-10cf9daf4b5c tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Returning 404 to user: Instance 0a301f9c-b1b8-4962-9d46-28981c195069 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:02:24.363227 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-368460fb-5222-4bd3-bd7c-10cf9daf4b5c tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0a301f9c-b1b8-4962-9d46-28981c195069" status: 404 len: 111 microversion: 2.1 time: 0.091698 Aug 31 16:02:24.364340 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1361/2816] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:02:24 2022] DELETE /compute/v2.1/servers/0a301f9c-b1b8-4962-9d46-28981c195069 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:02:24.373395 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2a6e0cdf-c3ba-4a7e-91d1-820ea53cb8b0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "POST /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b/action" status: 202 len: 0 microversion: 2.1 time: 0.228616 Aug 31 16:02:24.380115 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1456/2817] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:02:24 2022] POST /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:02:24.393895 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b46a73f8-4fe6-4930-9860-961eee4af8e0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:24.395685 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b2109c3b-e4f9-416c-8acb-37a0bca05c1c tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:24.396383 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b2109c3b-e4f9-416c-8acb-37a0bca05c1c tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 0a301f9c-b1b8-4962-9d46-28981c195069] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:24.396859 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b46a73f8-4fe6-4930-9860-961eee4af8e0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:24.411664 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b46a73f8-4fe6-4930-9860-961eee4af8e0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:24.416065 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b46a73f8-4fe6-4930-9860-961eee4af8e0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:24.416688 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b46a73f8-4fe6-4930-9860-961eee4af8e0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:24.418421 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b2109c3b-e4f9-416c-8acb-37a0bca05c1c tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:24.421502 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b2109c3b-e4f9-416c-8acb-37a0bca05c1c tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:24.421848 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b46a73f8-4fe6-4930-9860-961eee4af8e0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:24.422375 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b46a73f8-4fe6-4930-9860-961eee4af8e0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:24.423099 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b46a73f8-4fe6-4930-9860-961eee4af8e0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:24.423483 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b2109c3b-e4f9-416c-8acb-37a0bca05c1c tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:24.433372 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b2109c3b-e4f9-416c-8acb-37a0bca05c1c tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:24.434761 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b2109c3b-e4f9-416c-8acb-37a0bca05c1c tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:24.438166 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b2109c3b-e4f9-416c-8acb-37a0bca05c1c tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:24.510391 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-b2109c3b-e4f9-416c-8acb-37a0bca05c1c tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] HTTP exception thrown: Instance 0a301f9c-b1b8-4962-9d46-28981c195069 could not be found. Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b2109c3b-e4f9-416c-8acb-37a0bca05c1c tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Request method failure captured: Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/0a301f9c-b1b8-4962-9d46-28981c195069 HTTP/1.1 Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4VuegaF_fmy46ih3aH48SHyk9S0K5f6VgFr4AjCz2qlep55514N16M8NDogA4-FaRt5exvJysgb4a16NCF-uwnoFVaAwgVvS87_klTsI4Q1cOt4rcQPW4Ao3jepMn1MxMfgCP9op9_ywmQywVzBp5itFLK6pFxwsw-bP4gtv8ayT6Y Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 75a7c84a4ea54074bab3ccc035c5cf47 Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2143463755 Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/75a7c84a4ea54074bab3ccc035c5cf47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/75a7c84a4ea54074bab3ccc035c5cf47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/75a7c84a4ea54074bab3ccc035c5cf47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_75a7c84a4ea54074bab3ccc035c5cf47", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2143463755 Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 75a7c84a4ea54074bab3ccc035c5cf47 Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2143463755 Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ImagesOneServerNegativeTestJSON-2143463755-project Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 3c8476b6167a4c838eac59d7c4a40284 Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2143463755-project Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 0a301f9c-b1b8-4962-9d46-28981c195069 could not be found. Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '0a301f9c-b1b8-4962-9d46-28981c195069'} Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a301f9c-b1b8-4962-9d46-28981c195069 could not be found. Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a301f9c-b1b8-4962-9d46-28981c195069 could not be found. Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:02:24.513784 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:02:24.518419 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:02:24.518419 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:02:24.518419 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:02:24.518419 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:02:24.518419 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:02:24.518419 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:02:24.518419 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a301f9c-b1b8-4962-9d46-28981c195069 could not be found. Aug 31 16:02:24.518419 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:02:24.524674 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b2109c3b-e4f9-416c-8acb-37a0bca05c1c tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Returning 404 to user: Instance 0a301f9c-b1b8-4962-9d46-28981c195069 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:02:24.526321 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b2109c3b-e4f9-416c-8acb-37a0bca05c1c tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/0a301f9c-b1b8-4962-9d46-28981c195069" status: 404 len: 111 microversion: 2.1 time: 0.157610 Aug 31 16:02:24.527514 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1362/2818] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:24 2022] GET /compute/v2.1/servers/0a301f9c-b1b8-4962-9d46-28981c195069 => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:02:24.537566 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-79831d55-82c5-4c3e-bdc3-77990f4608b3 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:24.538527 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-79831d55-82c5-4c3e-bdc3-77990f4608b3 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 96bec4d7-3a20-4974-8865-51ef8fd087f6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:24.545984 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79831d55-82c5-4c3e-bdc3-77990f4608b3 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:24.566943 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79831d55-82c5-4c3e-bdc3-77990f4608b3 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:24.569023 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79831d55-82c5-4c3e-bdc3-77990f4608b3 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:24.570120 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79831d55-82c5-4c3e-bdc3-77990f4608b3 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:24.574853 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79831d55-82c5-4c3e-bdc3-77990f4608b3 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:24.577063 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79831d55-82c5-4c3e-bdc3-77990f4608b3 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:25.330971 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-79831d55-82c5-4c3e-bdc3-77990f4608b3 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:25.349346 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-79831d55-82c5-4c3e-bdc3-77990f4608b3 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/96bec4d7-3a20-4974-8865-51ef8fd087f6" status: 200 len: 1311 microversion: 2.1 time: 0.817975 Aug 31 16:02:25.350797 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1363/2819] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:24 2022] GET /compute/v2.1/servers/96bec4d7-3a20-4974-8865-51ef8fd087f6 => generated 1311 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:25.386816 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7621a0ab-23a6-47e5-9ced-84f84a2c9624 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '.version_select at 0x7fbb464f6c10>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:25.434262 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b46a73f8-4fe6-4930-9860-961eee4af8e0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:25.449820 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b46a73f8-4fe6-4930-9860-961eee4af8e0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1673 microversion: 2.1 time: 1.068278 Aug 31 16:02:25.450477 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1457/2820] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:24 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1673 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:25.460643 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7621a0ab-23a6-47e5-9ced-84f84a2c9624 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1563122384" status: 202 len: 0 microversion: 2.1 time: 0.092436 Aug 31 16:02:25.461311 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1364/2821] 10.222.0.50 () {58 vars in 1221 bytes} [Wed Aug 31 16:02:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1563122384 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:02:25.467351 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-66da3ea1-035a-46b5-bc95-d0f3b163c13b req-e520b8e8-0cd7-4365-b2e8-3499120816c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96bec4d7-3a20-4974-8865-51ef8fd087f6", "tag": "88ac1c93-1d43-4270-990d-911112bbebb5"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:25.472887 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-acf88451-caa0-4743-abc1-69069129fb8f tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:25.478759 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-acf88451-caa0-4743-abc1-69069129fb8f tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] [instance: 6bd8b697-3187-47f8-bec9-5784c425a9ce] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:25.486956 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-acf88451-caa0-4743-abc1-69069129fb8f tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:25.487925 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-acf88451-caa0-4743-abc1-69069129fb8f tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:25.489547 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-acf88451-caa0-4743-abc1-69069129fb8f tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:25.490858 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-acf88451-caa0-4743-abc1-69069129fb8f tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:25.491777 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-acf88451-caa0-4743-abc1-69069129fb8f tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:25.492659 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-acf88451-caa0-4743-abc1-69069129fb8f tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:25.505351 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-66da3ea1-035a-46b5-bc95-d0f3b163c13b req-e520b8e8-0cd7-4365-b2e8-3499120816c0 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:25.506230 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-66da3ea1-035a-46b5-bc95-d0f3b163c13b req-e520b8e8-0cd7-4365-b2e8-3499120816c0 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:25.507070 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-66da3ea1-035a-46b5-bc95-d0f3b163c13b req-e520b8e8-0cd7-4365-b2e8-3499120816c0 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:25.521350 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-66da3ea1-035a-46b5-bc95-d0f3b163c13b req-e520b8e8-0cd7-4365-b2e8-3499120816c0 service nova] Creating event network-changed:88ac1c93-1d43-4270-990d-911112bbebb5 for instance 96bec4d7-3a20-4974-8865-51ef8fd087f6 on n-h2-833090-16 Aug 31 16:02:25.535379 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-66da3ea1-035a-46b5-bc95-d0f3b163c13b req-e520b8e8-0cd7-4365-b2e8-3499120816c0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074776 Aug 31 16:02:25.541917 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1458/2822] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:02:25.667672 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:02:26.298588 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-acf88451-caa0-4743-abc1-69069129fb8f tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c15400d81847c09c81b04b668560b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd7cf0fb56d40dca0d158268001b107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:26.334476 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-acf88451-caa0-4743-abc1-69069129fb8f tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] 10.222.0.50 "GET /compute/v2.1/servers/6bd8b697-3187-47f8-bec9-5784c425a9ce" status: 200 len: 1324 microversion: 2.1 time: 0.871810 Aug 31 16:02:26.335081 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1365/2823] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:25 2022] GET /compute/v2.1/servers/6bd8b697-3187-47f8-bec9-5784c425a9ce => generated 1324 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:26.375462 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7b0cb899-8af8-4b9b-a627-59741246242b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:26.376879 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7b0cb899-8af8-4b9b-a627-59741246242b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 96bec4d7-3a20-4974-8865-51ef8fd087f6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:26.379245 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:02:26.420867 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7b0cb899-8af8-4b9b-a627-59741246242b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:26.424923 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7b0cb899-8af8-4b9b-a627-59741246242b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:26.427819 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7b0cb899-8af8-4b9b-a627-59741246242b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:26.435984 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7b0cb899-8af8-4b9b-a627-59741246242b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:26.441450 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7b0cb899-8af8-4b9b-a627-59741246242b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:26.454461 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7b0cb899-8af8-4b9b-a627-59741246242b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:26.460280 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-7e4aaf23-017e-4ddf-a293-5d324a6ff11b req-1658bf3e-92ae-4f68-b64f-f39636e8d481 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bd8b697-3187-47f8-bec9-5784c425a9ce", "tag": "5f2a5d63-d2e4-4ad2-a495-66a5cea1e3ce"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:26.489214 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7e4aaf23-017e-4ddf-a293-5d324a6ff11b req-1658bf3e-92ae-4f68-b64f-f39636e8d481 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:26.497352 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7e4aaf23-017e-4ddf-a293-5d324a6ff11b req-1658bf3e-92ae-4f68-b64f-f39636e8d481 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:26.497791 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7e4aaf23-017e-4ddf-a293-5d324a6ff11b req-1658bf3e-92ae-4f68-b64f-f39636e8d481 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:26.532601 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-7e4aaf23-017e-4ddf-a293-5d324a6ff11b req-1658bf3e-92ae-4f68-b64f-f39636e8d481 service nova] Creating event network-changed:5f2a5d63-d2e4-4ad2-a495-66a5cea1e3ce for instance 6bd8b697-3187-47f8-bec9-5784c425a9ce on n-h2-833090-16 Aug 31 16:02:26.542476 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-7e4aaf23-017e-4ddf-a293-5d324a6ff11b req-1658bf3e-92ae-4f68-b64f-f39636e8d481 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084144 Aug 31 16:02:26.543457 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1366/2824] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:02:26.555573 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e381a67b-29e7-44de-9546-346fc52afc83 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:26.556495 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e381a67b-29e7-44de-9546-346fc52afc83 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:26.574288 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e381a67b-29e7-44de-9546-346fc52afc83 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:26.574767 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e381a67b-29e7-44de-9546-346fc52afc83 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:26.575202 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e381a67b-29e7-44de-9546-346fc52afc83 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:26.575943 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e381a67b-29e7-44de-9546-346fc52afc83 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:26.576670 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e381a67b-29e7-44de-9546-346fc52afc83 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:26.576918 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e381a67b-29e7-44de-9546-346fc52afc83 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:26.684908 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=8 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:02:26.866738 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=8 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:02:27.195034 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e381a67b-29e7-44de-9546-346fc52afc83 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:27.223210 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e381a67b-29e7-44de-9546-346fc52afc83 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1673 microversion: 2.1 time: 0.677696 Aug 31 16:02:27.224415 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1367/2825] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:26 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1673 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:27.278760 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7b0cb899-8af8-4b9b-a627-59741246242b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:27.316115 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7b0cb899-8af8-4b9b-a627-59741246242b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/96bec4d7-3a20-4974-8865-51ef8fd087f6" status: 200 len: 1311 microversion: 2.1 time: 0.944424 Aug 31 16:02:27.317389 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1459/2826] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:26 2022] GET /compute/v2.1/servers/96bec4d7-3a20-4974-8865-51ef8fd087f6 => generated 1311 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:02:27.396957 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-83288d48-dd9d-42f0-b89d-ff1f6636e2dc tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:27.400684 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-83288d48-dd9d-42f0-b89d-ff1f6636e2dc tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] [instance: 6bd8b697-3187-47f8-bec9-5784c425a9ce] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:27.464659 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83288d48-dd9d-42f0-b89d-ff1f6636e2dc tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:27.469256 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83288d48-dd9d-42f0-b89d-ff1f6636e2dc tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:27.501201 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83288d48-dd9d-42f0-b89d-ff1f6636e2dc tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:27.501974 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83288d48-dd9d-42f0-b89d-ff1f6636e2dc tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:27.505408 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83288d48-dd9d-42f0-b89d-ff1f6636e2dc tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:27.507271 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83288d48-dd9d-42f0-b89d-ff1f6636e2dc tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:27.888341 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-057ed6aa-54ab-48ae-bf13-356af87ce36d tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '.version_select at 0x7fbb45fc0ca0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:27.902839 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-83288d48-dd9d-42f0-b89d-ff1f6636e2dc tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c15400d81847c09c81b04b668560b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd7cf0fb56d40dca0d158268001b107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:27.914625 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-83288d48-dd9d-42f0-b89d-ff1f6636e2dc tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] 10.222.0.50 "GET /compute/v2.1/servers/6bd8b697-3187-47f8-bec9-5784c425a9ce" status: 200 len: 1324 microversion: 2.1 time: 0.549716 Aug 31 16:02:27.915231 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1368/2827] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:27 2022] GET /compute/v2.1/servers/6bd8b697-3187-47f8-bec9-5784c425a9ce => generated 1324 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:27.942305 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-057ed6aa-54ab-48ae-bf13-356af87ce36d tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] HTTP exception thrown: Image not found. Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-057ed6aa-54ab-48ae-bf13-356af87ce36d tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Request method failure captured: Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: request: DELETE /compute/v2.1/images/361e9f81-a0ac-4be6-81b3-5a93980af3ad HTTP/1.1 Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4VuegaF_fmy46ih3aH48SHyk9S0K5f6VgFr4AjCz2qlep55514N16M8NDogA4-FaRt5exvJysgb4a16NCF-uwnoFVaAwgVvS87_klTsI4Q1cOt4rcQPW4Ao3jepMn1MxMfgCP9op9_ywmQywVzBp5itFLK6pFxwsw-bP4gtv8ayT6Y Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 75a7c84a4ea54074bab3ccc035c5cf47 Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2143463755 Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/75a7c84a4ea54074bab3ccc035c5cf47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/75a7c84a4ea54074bab3ccc035c5cf47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/75a7c84a4ea54074bab3ccc035c5cf47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_75a7c84a4ea54074bab3ccc035c5cf47", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2143463755 Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 75a7c84a4ea54074bab3ccc035c5cf47 Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2143463755 Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ImagesOneServerNegativeTestJSON-2143463755-project Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 3c8476b6167a4c838eac59d7c4a40284 Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2143463755-project Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: method: Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: exception: Image not found. Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '361e9f81-a0ac-4be6-81b3-5a93980af3ad'} Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 361e9f81-a0ac-4be6-81b3-5a93980af3ad to delete Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 361e9f81-a0ac-4be6-81b3-5a93980af3ad could not be found. Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:02:27.945530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:02:27.951266 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:02:27.951266 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:02:27.951266 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:02:27.951266 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:02:27.951266 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:02:27.951266 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:02:27.951266 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:02:27.951266 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:02:27.951266 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:02:27.951266 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 31 16:02:27.951266 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 31 16:02:27.951266 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 31 16:02:27.951266 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:02:27.951266 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:02:27.951266 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:02:27.951266 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:02:27.951266 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:02:27.951266 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:02:27.951266 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:02:27.951266 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:02:27.951266 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 31 16:02:27.951266 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:02:27.954046 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-057ed6aa-54ab-48ae-bf13-356af87ce36d tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Returning 404 to user: Image not found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:02:27.955204 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-057ed6aa-54ab-48ae-bf13-356af87ce36d tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "DELETE /compute/v2.1/images/361e9f81-a0ac-4be6-81b3-5a93980af3ad" status: 404 len: 62 microversion: 2.1 time: 0.070838 Aug 31 16:02:27.956233 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1460/2828] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:27 2022] DELETE /compute/v2.1/images/361e9f81-a0ac-4be6-81b3-5a93980af3ad => generated 62 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 16:02:27.965215 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d214e7bb-1166-4648-968a-ff6a1c11bd69 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:27.965708 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d214e7bb-1166-4648-968a-ff6a1c11bd69 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 9fd5b244-b9b6-4901-8b2f-0454d800d6b4] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:27.975961 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d214e7bb-1166-4648-968a-ff6a1c11bd69 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:27.976451 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d214e7bb-1166-4648-968a-ff6a1c11bd69 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:27.976882 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d214e7bb-1166-4648-968a-ff6a1c11bd69 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:27.977583 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d214e7bb-1166-4648-968a-ff6a1c11bd69 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:27.978034 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d214e7bb-1166-4648-968a-ff6a1c11bd69 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:27.978477 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d214e7bb-1166-4648-968a-ff6a1c11bd69 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:28.015566 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-d214e7bb-1166-4648-968a-ff6a1c11bd69 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] HTTP exception thrown: Instance 9fd5b244-b9b6-4901-8b2f-0454d800d6b4 could not be found. Aug 31 16:02:28.017469 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d214e7bb-1166-4648-968a-ff6a1c11bd69 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Request method failure captured: Aug 31 16:02:28.017469 n-d-833090-16 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4 HTTP/1.1 Aug 31 16:02:28.017469 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:02:28.017469 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:02:28.017469 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:02:28.017469 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:02:28.017469 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:02:28.017469 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:02:28.017469 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:02:28.017469 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:02:28.017469 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4VuegaF_fmy46ih3aH48SHyk9S0K5f6VgFr4AjCz2qlep55514N16M8NDogA4-FaRt5exvJysgb4a16NCF-uwnoFVaAwgVvS87_klTsI4Q1cOt4rcQPW4Ao3jepMn1MxMfgCP9op9_ywmQywVzBp5itFLK6pFxwsw-bP4gtv8ayT6Y Aug 31 16:02:28.017469 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:02:28.017469 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:02:28.017469 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:02:28.017469 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:02:28.017469 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:02:28.017469 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:02:28.017469 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 75a7c84a4ea54074bab3ccc035c5cf47 Aug 31 16:02:28.017469 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2143463755 Aug 31 16:02:28.017469 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:02:28.017469 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:02:28.017469 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/75a7c84a4ea54074bab3ccc035c5cf47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/75a7c84a4ea54074bab3ccc035c5cf47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/75a7c84a4ea54074bab3ccc035c5cf47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_75a7c84a4ea54074bab3ccc035c5cf47", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:02:28.017469 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2143463755 Aug 31 16:02:28.017469 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 75a7c84a4ea54074bab3ccc035c5cf47 Aug 31 16:02:28.017469 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2143463755 Aug 31 16:02:28.017469 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ImagesOneServerNegativeTestJSON-2143463755-project Aug 31 16:02:28.017469 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:02:28.017469 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:02:28.017469 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 3c8476b6167a4c838eac59d7c4a40284 Aug 31 16:02:28.017469 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2143463755-project Aug 31 16:02:28.017469 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:02:28.017469 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 9fd5b244-b9b6-4901-8b2f-0454d800d6b4 could not be found. Aug 31 16:02:28.017469 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '9fd5b244-b9b6-4901-8b2f-0454d800d6b4'} Aug 31 16:02:28.017469 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:02:28.017469 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:02:28.017469 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:02:28.017469 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:02:28.017469 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:02:28.017469 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:02:28.017469 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:02:28.017469 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:02:28.017469 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:02:28.017469 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:02:28.017469 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fd5b244-b9b6-4901-8b2f-0454d800d6b4 could not be found. Aug 31 16:02:28.017469 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:02:28.017469 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:02:28.017469 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:02:28.017469 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:02:28.017469 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:02:28.017469 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:02:28.017469 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:02:28.017469 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:02:28.017469 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:02:28.017469 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:02:28.017469 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:02:28.017469 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:02:28.017469 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:02:28.017469 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:02:28.017469 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:02:28.017469 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:02:28.017469 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:02:28.017469 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:02:28.023928 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fd5b244-b9b6-4901-8b2f-0454d800d6b4 could not be found. Aug 31 16:02:28.023928 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:02:28.023928 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:02:28.023928 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:02:28.023928 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:02:28.023928 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:02:28.023928 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:02:28.023928 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:02:28.023928 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:02:28.023928 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fd5b244-b9b6-4901-8b2f-0454d800d6b4 could not be found. Aug 31 16:02:28.023928 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:02:28.023928 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d214e7bb-1166-4648-968a-ff6a1c11bd69 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Returning 404 to user: Instance 9fd5b244-b9b6-4901-8b2f-0454d800d6b4 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:02:28.023928 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d214e7bb-1166-4648-968a-ff6a1c11bd69 tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "DELETE /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4" status: 404 len: 111 microversion: 2.1 time: 0.058213 Aug 31 16:02:28.023928 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1369/2829] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:02:27 2022] DELETE /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:02:28.029287 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fc3a7286-92b8-41f2-80a2-634dd13faa9a tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:28.030209 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fc3a7286-92b8-41f2-80a2-634dd13faa9a tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] [instance: 9fd5b244-b9b6-4901-8b2f-0454d800d6b4] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:28.044844 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fc3a7286-92b8-41f2-80a2-634dd13faa9a tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:28.045595 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fc3a7286-92b8-41f2-80a2-634dd13faa9a tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:28.046255 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fc3a7286-92b8-41f2-80a2-634dd13faa9a tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:28.047245 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fc3a7286-92b8-41f2-80a2-634dd13faa9a tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:28.048118 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fc3a7286-92b8-41f2-80a2-634dd13faa9a tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:28.048720 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fc3a7286-92b8-41f2-80a2-634dd13faa9a tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:28.071236 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-fc3a7286-92b8-41f2-80a2-634dd13faa9a tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] HTTP exception thrown: Instance 9fd5b244-b9b6-4901-8b2f-0454d800d6b4 could not be found. Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fc3a7286-92b8-41f2-80a2-634dd13faa9a tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Request method failure captured: Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4 HTTP/1.1 Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4VuegaF_fmy46ih3aH48SHyk9S0K5f6VgFr4AjCz2qlep55514N16M8NDogA4-FaRt5exvJysgb4a16NCF-uwnoFVaAwgVvS87_klTsI4Q1cOt4rcQPW4Ao3jepMn1MxMfgCP9op9_ywmQywVzBp5itFLK6pFxwsw-bP4gtv8ayT6Y Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 75a7c84a4ea54074bab3ccc035c5cf47 Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2143463755 Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/75a7c84a4ea54074bab3ccc035c5cf47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/75a7c84a4ea54074bab3ccc035c5cf47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/75a7c84a4ea54074bab3ccc035c5cf47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_75a7c84a4ea54074bab3ccc035c5cf47", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2143463755 Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 75a7c84a4ea54074bab3ccc035c5cf47 Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2143463755 Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ImagesOneServerNegativeTestJSON-2143463755-project Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 3c8476b6167a4c838eac59d7c4a40284 Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2143463755-project Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 9fd5b244-b9b6-4901-8b2f-0454d800d6b4 could not be found. Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '9fd5b244-b9b6-4901-8b2f-0454d800d6b4'} Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fd5b244-b9b6-4901-8b2f-0454d800d6b4 could not be found. Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fd5b244-b9b6-4901-8b2f-0454d800d6b4 could not be found. Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:02:28.072795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:02:28.078248 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:02:28.078248 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:02:28.078248 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:02:28.078248 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:02:28.078248 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:02:28.078248 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:02:28.078248 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fd5b244-b9b6-4901-8b2f-0454d800d6b4 could not be found. Aug 31 16:02:28.078248 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:02:28.078248 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fc3a7286-92b8-41f2-80a2-634dd13faa9a tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] Returning 404 to user: Instance 9fd5b244-b9b6-4901-8b2f-0454d800d6b4 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:02:28.078248 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fc3a7286-92b8-41f2-80a2-634dd13faa9a tempest-ImagesOneServerNegativeTestJSON-2143463755 tempest-ImagesOneServerNegativeTestJSON-2143463755-project] 10.222.0.50 "GET /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4" status: 404 len: 111 microversion: 2.1 time: 0.050466 Aug 31 16:02:28.091475 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1461/2830] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:28 2022] GET /compute/v2.1/servers/9fd5b244-b9b6-4901-8b2f-0454d800d6b4 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:02:28.250564 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5cb63774-8af0-4d58-9321-4e95226be1e9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:28.252229 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5cb63774-8af0-4d58-9321-4e95226be1e9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:28.264432 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5cb63774-8af0-4d58-9321-4e95226be1e9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:28.265182 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5cb63774-8af0-4d58-9321-4e95226be1e9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:28.265812 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5cb63774-8af0-4d58-9321-4e95226be1e9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:28.267217 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5cb63774-8af0-4d58-9321-4e95226be1e9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:28.267839 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5cb63774-8af0-4d58-9321-4e95226be1e9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:28.268471 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5cb63774-8af0-4d58-9321-4e95226be1e9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:28.339039 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-537e5d34-df6a-4326-a482-15498db49416 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:28.339956 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-537e5d34-df6a-4326-a482-15498db49416 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 96bec4d7-3a20-4974-8865-51ef8fd087f6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:28.349994 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-537e5d34-df6a-4326-a482-15498db49416 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:28.350559 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-537e5d34-df6a-4326-a482-15498db49416 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:28.351055 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-537e5d34-df6a-4326-a482-15498db49416 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:28.351770 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-537e5d34-df6a-4326-a482-15498db49416 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:28.352228 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-537e5d34-df6a-4326-a482-15498db49416 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:28.352656 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-537e5d34-df6a-4326-a482-15498db49416 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:28.577386 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5cb63774-8af0-4d58-9321-4e95226be1e9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:28.631138 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5cb63774-8af0-4d58-9321-4e95226be1e9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1671 microversion: 2.1 time: 0.385216 Aug 31 16:02:28.647533 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1370/2831] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:28 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1671 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:28.659806 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3bcb5ec6-8ae7-4f8b-918d-56a37bf1d9b6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:28.662579 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3bcb5ec6-8ae7-4f8b-918d-56a37bf1d9b6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:28.678073 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bcb5ec6-8ae7-4f8b-918d-56a37bf1d9b6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:28.679190 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bcb5ec6-8ae7-4f8b-918d-56a37bf1d9b6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:28.679958 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bcb5ec6-8ae7-4f8b-918d-56a37bf1d9b6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:28.683027 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bcb5ec6-8ae7-4f8b-918d-56a37bf1d9b6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:28.684638 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bcb5ec6-8ae7-4f8b-918d-56a37bf1d9b6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:28.685301 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bcb5ec6-8ae7-4f8b-918d-56a37bf1d9b6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:28.689240 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-537e5d34-df6a-4326-a482-15498db49416 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:28.700889 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-537e5d34-df6a-4326-a482-15498db49416 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/96bec4d7-3a20-4974-8865-51ef8fd087f6" status: 200 len: 1311 microversion: 2.1 time: 0.365940 Aug 31 16:02:28.707780 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1462/2832] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:28 2022] GET /compute/v2.1/servers/96bec4d7-3a20-4974-8865-51ef8fd087f6 => generated 1311 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:28.794659 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3bcb5ec6-8ae7-4f8b-918d-56a37bf1d9b6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "POST /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b/action" status: 200 len: 322 microversion: 2.1 time: 0.139708 Aug 31 16:02:28.796521 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1371/2833] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:02:28 2022] POST /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b/action => generated 322 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:02:28.806350 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-42a08d46-902d-4356-acd3-cc1ffc871ddd tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:28.806976 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-42a08d46-902d-4356-acd3-cc1ffc871ddd tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:28.819951 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-42a08d46-902d-4356-acd3-cc1ffc871ddd tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:28.820449 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-42a08d46-902d-4356-acd3-cc1ffc871ddd tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:28.820880 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-42a08d46-902d-4356-acd3-cc1ffc871ddd tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:28.826968 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-42a08d46-902d-4356-acd3-cc1ffc871ddd tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:28.827474 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-42a08d46-902d-4356-acd3-cc1ffc871ddd tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:28.827907 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-42a08d46-902d-4356-acd3-cc1ffc871ddd tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:28.937151 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-686bc8fd-e4e6-43de-ac0d-8a90fc007fee tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:28.939332 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-686bc8fd-e4e6-43de-ac0d-8a90fc007fee tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] [instance: 6bd8b697-3187-47f8-bec9-5784c425a9ce] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:28.956248 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-686bc8fd-e4e6-43de-ac0d-8a90fc007fee tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:28.958286 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-686bc8fd-e4e6-43de-ac0d-8a90fc007fee tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:28.959893 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-686bc8fd-e4e6-43de-ac0d-8a90fc007fee tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:28.962336 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-686bc8fd-e4e6-43de-ac0d-8a90fc007fee tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:28.964078 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-686bc8fd-e4e6-43de-ac0d-8a90fc007fee tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:28.965203 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-686bc8fd-e4e6-43de-ac0d-8a90fc007fee tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:29.194720 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-42a08d46-902d-4356-acd3-cc1ffc871ddd tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:29.206638 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-42a08d46-902d-4356-acd3-cc1ffc871ddd tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1671 microversion: 2.1 time: 0.404341 Aug 31 16:02:29.208051 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1463/2834] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:28 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1671 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:29.232481 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-87cf3d46-fb95-4359-9892-22b97ca2b4f7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:29.233230 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-87cf3d46-fb95-4359-9892-22b97ca2b4f7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:29.248271 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-87cf3d46-fb95-4359-9892-22b97ca2b4f7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:29.249596 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-87cf3d46-fb95-4359-9892-22b97ca2b4f7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:29.250868 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-87cf3d46-fb95-4359-9892-22b97ca2b4f7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:29.252535 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-87cf3d46-fb95-4359-9892-22b97ca2b4f7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:29.254271 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-87cf3d46-fb95-4359-9892-22b97ca2b4f7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:29.256946 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-87cf3d46-fb95-4359-9892-22b97ca2b4f7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:29.262381 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-686bc8fd-e4e6-43de-ac0d-8a90fc007fee tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c15400d81847c09c81b04b668560b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd7cf0fb56d40dca0d158268001b107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:29.271499 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-686bc8fd-e4e6-43de-ac0d-8a90fc007fee tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] 10.222.0.50 "GET /compute/v2.1/servers/6bd8b697-3187-47f8-bec9-5784c425a9ce" status: 200 len: 1324 microversion: 2.1 time: 0.339425 Aug 31 16:02:29.273287 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1372/2835] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:28 2022] GET /compute/v2.1/servers/6bd8b697-3187-47f8-bec9-5784c425a9ce => generated 1324 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:29.567905 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-87cf3d46-fb95-4359-9892-22b97ca2b4f7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:29.581422 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:02:29.593043 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-87cf3d46-fb95-4359-9892-22b97ca2b4f7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1671 microversion: 2.1 time: 0.365712 Aug 31 16:02:29.607452 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1464/2836] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:29 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1671 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:02:29.615696 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-939d11e4-5f90-4990-b4ab-24b036e8796f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:29.616820 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-939d11e4-5f90-4990-b4ab-24b036e8796f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:29.625895 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-939d11e4-5f90-4990-b4ab-24b036e8796f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:29.627095 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-939d11e4-5f90-4990-b4ab-24b036e8796f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:29.630585 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-939d11e4-5f90-4990-b4ab-24b036e8796f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:29.631589 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-939d11e4-5f90-4990-b4ab-24b036e8796f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:29.632266 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-939d11e4-5f90-4990-b4ab-24b036e8796f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:29.632910 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-939d11e4-5f90-4990-b4ab-24b036e8796f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:29.734706 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-efa47f83-7b5b-44e0-b5a6-db0beda97ca6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:29.736278 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-efa47f83-7b5b-44e0-b5a6-db0beda97ca6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 96bec4d7-3a20-4974-8865-51ef8fd087f6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:29.751456 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-efa47f83-7b5b-44e0-b5a6-db0beda97ca6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:29.755457 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-efa47f83-7b5b-44e0-b5a6-db0beda97ca6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:29.756197 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-efa47f83-7b5b-44e0-b5a6-db0beda97ca6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:29.757850 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-efa47f83-7b5b-44e0-b5a6-db0beda97ca6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:29.759814 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-efa47f83-7b5b-44e0-b5a6-db0beda97ca6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:29.760860 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-efa47f83-7b5b-44e0-b5a6-db0beda97ca6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:30.163711 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-939d11e4-5f90-4990-b4ab-24b036e8796f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:30.176968 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-939d11e4-5f90-4990-b4ab-24b036e8796f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1671 microversion: 2.1 time: 0.565288 Aug 31 16:02:30.177593 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1373/2837] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:29 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1671 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:02:30.204228 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e13d48a8-d676-421b-804b-a508b19ecfd7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:30.204848 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e13d48a8-d676-421b-804b-a508b19ecfd7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:30.216338 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-efa47f83-7b5b-44e0-b5a6-db0beda97ca6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:30.229565 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-efa47f83-7b5b-44e0-b5a6-db0beda97ca6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/96bec4d7-3a20-4974-8865-51ef8fd087f6" status: 200 len: 1311 microversion: 2.1 time: 0.501557 Aug 31 16:02:30.233890 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1465/2838] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:29 2022] GET /compute/v2.1/servers/96bec4d7-3a20-4974-8865-51ef8fd087f6 => generated 1311 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:02:30.236903 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e13d48a8-d676-421b-804b-a508b19ecfd7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:30.238048 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e13d48a8-d676-421b-804b-a508b19ecfd7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:30.238712 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e13d48a8-d676-421b-804b-a508b19ecfd7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:30.239636 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e13d48a8-d676-421b-804b-a508b19ecfd7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:30.240243 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e13d48a8-d676-421b-804b-a508b19ecfd7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:30.240889 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e13d48a8-d676-421b-804b-a508b19ecfd7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:30.260921 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:02:30.320502 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1e9a2a23-7dc4-4d58-8991-e7a695f9b655 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:30.321132 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1e9a2a23-7dc4-4d58-8991-e7a695f9b655 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] [instance: 6bd8b697-3187-47f8-bec9-5784c425a9ce] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:30.337873 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e9a2a23-7dc4-4d58-8991-e7a695f9b655 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:30.338471 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e9a2a23-7dc4-4d58-8991-e7a695f9b655 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:30.342872 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e9a2a23-7dc4-4d58-8991-e7a695f9b655 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:30.343649 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e9a2a23-7dc4-4d58-8991-e7a695f9b655 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:30.344134 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e9a2a23-7dc4-4d58-8991-e7a695f9b655 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:30.344593 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e9a2a23-7dc4-4d58-8991-e7a695f9b655 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:30.785900 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e13d48a8-d676-421b-804b-a508b19ecfd7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:30.797198 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e13d48a8-d676-421b-804b-a508b19ecfd7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1671 microversion: 2.1 time: 0.597782 Aug 31 16:02:30.817244 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1374/2839] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:30 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1671 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:02:30.830365 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1e9a2a23-7dc4-4d58-8991-e7a695f9b655 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c15400d81847c09c81b04b668560b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd7cf0fb56d40dca0d158268001b107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:30.847953 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1e9a2a23-7dc4-4d58-8991-e7a695f9b655 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] 10.222.0.50 "GET /compute/v2.1/servers/6bd8b697-3187-47f8-bec9-5784c425a9ce" status: 200 len: 1324 microversion: 2.1 time: 0.555550 Aug 31 16:02:30.851564 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1466/2840] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:30 2022] GET /compute/v2.1/servers/6bd8b697-3187-47f8-bec9-5784c425a9ce => generated 1324 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:31.055517 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c292764e-7f56-401e-b377-4c7d31fbd992 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1919231116", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "4df1d88e-baa2-45b2-bf09-1af39b3d8e2f"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:31.118832 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-c292764e-7f56-401e-b377-4c7d31fbd992 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] validate_networks() for [('4df1d88e-baa2-45b2-bf09-1af39b3d8e2f', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:02:31.271491 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d110ee8e-c0ce-489a-b7b4-fe7a431c15c7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:31.272031 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d110ee8e-c0ce-489a-b7b4-fe7a431c15c7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 96bec4d7-3a20-4974-8865-51ef8fd087f6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:31.284406 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d110ee8e-c0ce-489a-b7b4-fe7a431c15c7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:31.287094 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d110ee8e-c0ce-489a-b7b4-fe7a431c15c7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:31.289174 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d110ee8e-c0ce-489a-b7b4-fe7a431c15c7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:31.290334 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d110ee8e-c0ce-489a-b7b4-fe7a431c15c7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:31.297847 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d110ee8e-c0ce-489a-b7b4-fe7a431c15c7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:31.298333 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d110ee8e-c0ce-489a-b7b4-fe7a431c15c7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:32.419528 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d110ee8e-c0ce-489a-b7b4-fe7a431c15c7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:32.435798 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d110ee8e-c0ce-489a-b7b4-fe7a431c15c7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/96bec4d7-3a20-4974-8865-51ef8fd087f6" status: 200 len: 1311 microversion: 2.1 time: 1.168134 Aug 31 16:02:32.439304 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1467/2841] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:31 2022] GET /compute/v2.1/servers/96bec4d7-3a20-4974-8865-51ef8fd087f6 => generated 1311 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:32.446351 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fb89176a-4f8e-4ae0-940f-ee97da4dc50b tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:32.447119 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fb89176a-4f8e-4ae0-940f-ee97da4dc50b tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] [instance: 6bd8b697-3187-47f8-bec9-5784c425a9ce] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:32.462373 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb89176a-4f8e-4ae0-940f-ee97da4dc50b tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:32.463124 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb89176a-4f8e-4ae0-940f-ee97da4dc50b tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:32.463577 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb89176a-4f8e-4ae0-940f-ee97da4dc50b tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:32.464340 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb89176a-4f8e-4ae0-940f-ee97da4dc50b tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:32.464816 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb89176a-4f8e-4ae0-940f-ee97da4dc50b tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:32.465229 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb89176a-4f8e-4ae0-940f-ee97da4dc50b tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:33.134654 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-c292764e-7f56-401e-b377-4c7d31fbd992 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:02:33.136687 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-c292764e-7f56-401e-b377-4c7d31fbd992 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:02:33.137837 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-c292764e-7f56-401e-b377-4c7d31fbd992 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:02:33.138832 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-c292764e-7f56-401e-b377-4c7d31fbd992 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:02:33.139926 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-c292764e-7f56-401e-b377-4c7d31fbd992 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:02:33.180979 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c292764e-7f56-401e-b377-4c7d31fbd992 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:33.181820 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c292764e-7f56-401e-b377-4c7d31fbd992 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:33.182623 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c292764e-7f56-401e-b377-4c7d31fbd992 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:33.183744 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c292764e-7f56-401e-b377-4c7d31fbd992 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:33.184963 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c292764e-7f56-401e-b377-4c7d31fbd992 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:33.190165 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c292764e-7f56-401e-b377-4c7d31fbd992 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:33.264937 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-c292764e-7f56-401e-b377-4c7d31fbd992 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Getting quotas for project 11ef5102f83142d1a52befe52c3595d4. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:02:33.273676 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-c292764e-7f56-401e-b377-4c7d31fbd992 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Getting quotas for user aeeaf32202f747c8a2b98836f503aa7e and project 11ef5102f83142d1a52befe52c3595d4. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:02:33.290913 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c292764e-7f56-401e-b377-4c7d31fbd992 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:02:33.293968 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c292764e-7f56-401e-b377-4c7d31fbd992 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: b242124a-1ecd-4762-babd-96246ccb7ceb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:02:33.320172 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-fb89176a-4f8e-4ae0-940f-ee97da4dc50b tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c15400d81847c09c81b04b668560b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd7cf0fb56d40dca0d158268001b107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:33.334233 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fb89176a-4f8e-4ae0-940f-ee97da4dc50b tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] 10.222.0.50 "GET /compute/v2.1/servers/6bd8b697-3187-47f8-bec9-5784c425a9ce" status: 200 len: 1324 microversion: 2.1 time: 0.893245 Aug 31 16:02:33.336982 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1468/2842] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:32 2022] GET /compute/v2.1/servers/6bd8b697-3187-47f8-bec9-5784c425a9ce => generated 1324 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:33.346240 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-fc4fc325-c320-448d-a3a4-6dd7dfb00a13 req-2fe73cd6-4f8e-430b-9a80-cac99f30e6bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96bec4d7-3a20-4974-8865-51ef8fd087f6", "name": "network-vif-plugged", "status": "completed", "tag": "88ac1c93-1d43-4270-990d-911112bbebb5"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:33.372702 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-fc4fc325-c320-448d-a3a4-6dd7dfb00a13 req-2fe73cd6-4f8e-430b-9a80-cac99f30e6bb service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:33.374246 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-fc4fc325-c320-448d-a3a4-6dd7dfb00a13 req-2fe73cd6-4f8e-430b-9a80-cac99f30e6bb service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:33.376694 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-fc4fc325-c320-448d-a3a4-6dd7dfb00a13 req-2fe73cd6-4f8e-430b-9a80-cac99f30e6bb service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:33.424137 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-fc4fc325-c320-448d-a3a4-6dd7dfb00a13 req-2fe73cd6-4f8e-430b-9a80-cac99f30e6bb service nova] Creating event network-vif-plugged:88ac1c93-1d43-4270-990d-911112bbebb5 for instance 96bec4d7-3a20-4974-8865-51ef8fd087f6 on n-h2-833090-16 Aug 31 16:02:33.437533 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-fc4fc325-c320-448d-a3a4-6dd7dfb00a13 req-2fe73cd6-4f8e-430b-9a80-cac99f30e6bb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097871 Aug 31 16:02:33.438422 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1469/2843] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:02:33.440584 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c292764e-7f56-401e-b377-4c7d31fbd992 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.378895 Aug 31 16:02:33.447439 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1375/2844] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:02:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2397 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:02:33.456822 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b1740343-2de5-451c-81f6-27711db9ccb6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:33.457506 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b1740343-2de5-451c-81f6-27711db9ccb6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 96bec4d7-3a20-4974-8865-51ef8fd087f6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:33.458982 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9359a630-b4dd-46c7-a442-9121dc5bb05e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:33.459639 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9359a630-b4dd-46c7-a442-9121dc5bb05e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: b242124a-1ecd-4762-babd-96246ccb7ceb] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:33.470216 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1740343-2de5-451c-81f6-27711db9ccb6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:33.483631 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1740343-2de5-451c-81f6-27711db9ccb6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:33.486044 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1740343-2de5-451c-81f6-27711db9ccb6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:33.489508 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1740343-2de5-451c-81f6-27711db9ccb6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:33.497205 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1740343-2de5-451c-81f6-27711db9ccb6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:33.498844 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1740343-2de5-451c-81f6-27711db9ccb6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:33.821470 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9359a630-b4dd-46c7-a442-9121dc5bb05e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:33.830070 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9359a630-b4dd-46c7-a442-9121dc5bb05e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/b242124a-1ecd-4762-babd-96246ccb7ceb" status: 200 len: 1215 microversion: 2.1 time: 0.380974 Aug 31 16:02:33.830663 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1470/2845] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:33 2022] GET /compute/v2.1/servers/b242124a-1ecd-4762-babd-96246ccb7ceb => generated 1215 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:34.358686 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-679da264-e6a1-4eb3-963e-61bf7aeba0a3 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:34.359671 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-679da264-e6a1-4eb3-963e-61bf7aeba0a3 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] [instance: 6bd8b697-3187-47f8-bec9-5784c425a9ce] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:34.377123 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-679da264-e6a1-4eb3-963e-61bf7aeba0a3 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:34.377675 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-679da264-e6a1-4eb3-963e-61bf7aeba0a3 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:34.380810 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-679da264-e6a1-4eb3-963e-61bf7aeba0a3 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:34.381709 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-679da264-e6a1-4eb3-963e-61bf7aeba0a3 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:34.384313 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-679da264-e6a1-4eb3-963e-61bf7aeba0a3 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:34.384747 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-679da264-e6a1-4eb3-963e-61bf7aeba0a3 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:34.523990 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b1740343-2de5-451c-81f6-27711db9ccb6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:34.538985 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b1740343-2de5-451c-81f6-27711db9ccb6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/96bec4d7-3a20-4974-8865-51ef8fd087f6" status: 200 len: 1311 microversion: 2.1 time: 1.084190 Aug 31 16:02:34.539837 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1376/2846] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:33 2022] GET /compute/v2.1/servers/96bec4d7-3a20-4974-8865-51ef8fd087f6 => generated 1311 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:02:34.852001 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bc9b8879-5ee2-4480-b337-2385e5081bd4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:34.852764 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bc9b8879-5ee2-4480-b337-2385e5081bd4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: b242124a-1ecd-4762-babd-96246ccb7ceb] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:34.864359 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc9b8879-5ee2-4480-b337-2385e5081bd4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:34.866750 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc9b8879-5ee2-4480-b337-2385e5081bd4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:34.868667 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc9b8879-5ee2-4480-b337-2385e5081bd4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:34.875176 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc9b8879-5ee2-4480-b337-2385e5081bd4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:34.880907 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc9b8879-5ee2-4480-b337-2385e5081bd4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:34.881582 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc9b8879-5ee2-4480-b337-2385e5081bd4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:34.980615 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-679da264-e6a1-4eb3-963e-61bf7aeba0a3 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c15400d81847c09c81b04b668560b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd7cf0fb56d40dca0d158268001b107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:34.994275 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-679da264-e6a1-4eb3-963e-61bf7aeba0a3 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] 10.222.0.50 "GET /compute/v2.1/servers/6bd8b697-3187-47f8-bec9-5784c425a9ce" status: 200 len: 1324 microversion: 2.1 time: 0.641064 Aug 31 16:02:34.994896 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1471/2847] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:34 2022] GET /compute/v2.1/servers/6bd8b697-3187-47f8-bec9-5784c425a9ce => generated 1324 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:35.151899 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bc9b8879-5ee2-4480-b337-2385e5081bd4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:35.162021 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bc9b8879-5ee2-4480-b337-2385e5081bd4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/b242124a-1ecd-4762-babd-96246ccb7ceb" status: 200 len: 1267 microversion: 2.1 time: 0.314718 Aug 31 16:02:35.170799 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1377/2848] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:34 2022] GET /compute/v2.1/servers/b242124a-1ecd-4762-babd-96246ccb7ceb => generated 1267 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:35.564428 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6dec6eac-01b8-4de4-8dac-10fb4168243a tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:35.565074 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6dec6eac-01b8-4de4-8dac-10fb4168243a tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 96bec4d7-3a20-4974-8865-51ef8fd087f6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:35.576835 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6dec6eac-01b8-4de4-8dac-10fb4168243a tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:35.577469 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6dec6eac-01b8-4de4-8dac-10fb4168243a tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:35.578227 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6dec6eac-01b8-4de4-8dac-10fb4168243a tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:35.578955 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6dec6eac-01b8-4de4-8dac-10fb4168243a tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:35.579724 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6dec6eac-01b8-4de4-8dac-10fb4168243a tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:35.580569 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6dec6eac-01b8-4de4-8dac-10fb4168243a tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:36.038179 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-244b01c8-250d-4402-9030-f866a18c0b6a tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:36.041100 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-244b01c8-250d-4402-9030-f866a18c0b6a tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] [instance: 6bd8b697-3187-47f8-bec9-5784c425a9ce] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:36.077719 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-244b01c8-250d-4402-9030-f866a18c0b6a tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:36.079787 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-244b01c8-250d-4402-9030-f866a18c0b6a tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:36.083482 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-244b01c8-250d-4402-9030-f866a18c0b6a tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:36.084550 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-244b01c8-250d-4402-9030-f866a18c0b6a tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:36.087341 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-244b01c8-250d-4402-9030-f866a18c0b6a tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:36.088262 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-244b01c8-250d-4402-9030-f866a18c0b6a tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:36.188932 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6dec6eac-01b8-4de4-8dac-10fb4168243a tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:36.231712 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6dec6eac-01b8-4de4-8dac-10fb4168243a tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/96bec4d7-3a20-4974-8865-51ef8fd087f6" status: 200 len: 1311 microversion: 2.1 time: 0.673655 Aug 31 16:02:36.236245 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1472/2849] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:35 2022] GET /compute/v2.1/servers/96bec4d7-3a20-4974-8865-51ef8fd087f6 => generated 1311 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:36.245415 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fc326a2f-30ed-4045-96e5-a3acf353296c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:36.255469 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fc326a2f-30ed-4045-96e5-a3acf353296c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: b242124a-1ecd-4762-babd-96246ccb7ceb] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:36.267766 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fc326a2f-30ed-4045-96e5-a3acf353296c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:36.269401 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fc326a2f-30ed-4045-96e5-a3acf353296c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:36.274484 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fc326a2f-30ed-4045-96e5-a3acf353296c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:36.275453 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fc326a2f-30ed-4045-96e5-a3acf353296c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:36.276084 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fc326a2f-30ed-4045-96e5-a3acf353296c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:36.276669 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fc326a2f-30ed-4045-96e5-a3acf353296c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:36.491989 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-fc326a2f-30ed-4045-96e5-a3acf353296c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:36.507707 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fc326a2f-30ed-4045-96e5-a3acf353296c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/b242124a-1ecd-4762-babd-96246ccb7ceb" status: 200 len: 1273 microversion: 2.1 time: 0.268305 Aug 31 16:02:36.523680 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1473/2850] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:36 2022] GET /compute/v2.1/servers/b242124a-1ecd-4762-babd-96246ccb7ceb => generated 1273 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:36.801718 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-244b01c8-250d-4402-9030-f866a18c0b6a tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c15400d81847c09c81b04b668560b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd7cf0fb56d40dca0d158268001b107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:36.829042 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-244b01c8-250d-4402-9030-f866a18c0b6a tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] 10.222.0.50 "GET /compute/v2.1/servers/6bd8b697-3187-47f8-bec9-5784c425a9ce" status: 200 len: 1324 microversion: 2.1 time: 0.811527 Aug 31 16:02:36.844662 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1378/2851] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:36 2022] GET /compute/v2.1/servers/6bd8b697-3187-47f8-bec9-5784c425a9ce => generated 1324 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:37.258114 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0cc5405f-d22a-4f27-a2d9-186538ceefa7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:37.259400 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0cc5405f-d22a-4f27-a2d9-186538ceefa7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 96bec4d7-3a20-4974-8865-51ef8fd087f6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:37.271923 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0cc5405f-d22a-4f27-a2d9-186538ceefa7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:37.272425 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0cc5405f-d22a-4f27-a2d9-186538ceefa7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:37.272834 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0cc5405f-d22a-4f27-a2d9-186538ceefa7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:37.273544 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0cc5405f-d22a-4f27-a2d9-186538ceefa7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:37.280364 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0cc5405f-d22a-4f27-a2d9-186538ceefa7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:37.287049 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0cc5405f-d22a-4f27-a2d9-186538ceefa7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:37.532471 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fb90df0f-4a80-4e3e-a1fa-4b5c47efc212 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:37.534011 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fb90df0f-4a80-4e3e-a1fa-4b5c47efc212 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: b242124a-1ecd-4762-babd-96246ccb7ceb] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:37.553562 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb90df0f-4a80-4e3e-a1fa-4b5c47efc212 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:37.554356 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb90df0f-4a80-4e3e-a1fa-4b5c47efc212 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:37.554982 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb90df0f-4a80-4e3e-a1fa-4b5c47efc212 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:37.555903 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb90df0f-4a80-4e3e-a1fa-4b5c47efc212 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:37.556513 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb90df0f-4a80-4e3e-a1fa-4b5c47efc212 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:37.557232 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb90df0f-4a80-4e3e-a1fa-4b5c47efc212 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:38.042943 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fb90df0f-4a80-4e3e-a1fa-4b5c47efc212 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:38.055282 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fb90df0f-4a80-4e3e-a1fa-4b5c47efc212 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/b242124a-1ecd-4762-babd-96246ccb7ceb" status: 200 len: 1273 microversion: 2.1 time: 0.526700 Aug 31 16:02:38.069630 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1379/2852] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:37 2022] GET /compute/v2.1/servers/b242124a-1ecd-4762-babd-96246ccb7ceb => generated 1273 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:02:38.075065 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-65484902-344b-47a4-8360-66248ca06834 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:38.085081 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-65484902-344b-47a4-8360-66248ca06834 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] [instance: 6bd8b697-3187-47f8-bec9-5784c425a9ce] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:38.093736 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65484902-344b-47a4-8360-66248ca06834 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:38.094271 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65484902-344b-47a4-8360-66248ca06834 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:38.094738 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65484902-344b-47a4-8360-66248ca06834 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:38.095657 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65484902-344b-47a4-8360-66248ca06834 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:38.111134 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65484902-344b-47a4-8360-66248ca06834 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:38.111901 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65484902-344b-47a4-8360-66248ca06834 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:38.447601 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0cc5405f-d22a-4f27-a2d9-186538ceefa7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:38.460974 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0cc5405f-d22a-4f27-a2d9-186538ceefa7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/96bec4d7-3a20-4974-8865-51ef8fd087f6" status: 200 len: 1495 microversion: 2.1 time: 1.209188 Aug 31 16:02:38.461916 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1474/2853] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:37 2022] GET /compute/v2.1/servers/96bec4d7-3a20-4974-8865-51ef8fd087f6 => generated 1495 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:38.476160 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-c65c1b5b-b8d8-4f16-a698-6f9bc239e3c6 req-6322a4a1-a95b-4e04-8368-13e721937829 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bd8b697-3187-47f8-bec9-5784c425a9ce", "name": "network-vif-plugged", "status": "completed", "tag": "5f2a5d63-d2e4-4ad2-a495-66a5cea1e3ce"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:38.514121 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-c65c1b5b-b8d8-4f16-a698-6f9bc239e3c6 req-6322a4a1-a95b-4e04-8368-13e721937829 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:38.515954 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-c65c1b5b-b8d8-4f16-a698-6f9bc239e3c6 req-6322a4a1-a95b-4e04-8368-13e721937829 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:38.516397 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-c65c1b5b-b8d8-4f16-a698-6f9bc239e3c6 req-6322a4a1-a95b-4e04-8368-13e721937829 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:38.611852 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-c65c1b5b-b8d8-4f16-a698-6f9bc239e3c6 req-6322a4a1-a95b-4e04-8368-13e721937829 service nova] Creating event network-vif-plugged:5f2a5d63-d2e4-4ad2-a495-66a5cea1e3ce for instance 6bd8b697-3187-47f8-bec9-5784c425a9ce on n-h2-833090-16 Aug 31 16:02:38.634078 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-c65c1b5b-b8d8-4f16-a698-6f9bc239e3c6 req-6322a4a1-a95b-4e04-8368-13e721937829 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169110 Aug 31 16:02:38.642396 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1475/2854] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:02:38.676209 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c385efb1-defe-41b9-bccc-28e1f5eeaedb tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:38.680054 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c385efb1-defe-41b9-bccc-28e1f5eeaedb tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] [instance: 96bec4d7-3a20-4974-8865-51ef8fd087f6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:38.713499 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c385efb1-defe-41b9-bccc-28e1f5eeaedb tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:38.714819 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c385efb1-defe-41b9-bccc-28e1f5eeaedb tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:38.716722 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c385efb1-defe-41b9-bccc-28e1f5eeaedb tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:38.730266 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-65484902-344b-47a4-8360-66248ca06834 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c15400d81847c09c81b04b668560b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd7cf0fb56d40dca0d158268001b107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:38.740903 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c385efb1-defe-41b9-bccc-28e1f5eeaedb tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:38.743161 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c385efb1-defe-41b9-bccc-28e1f5eeaedb tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:38.744937 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c385efb1-defe-41b9-bccc-28e1f5eeaedb tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:38.755291 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-65484902-344b-47a4-8360-66248ca06834 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] 10.222.0.50 "GET /compute/v2.1/servers/6bd8b697-3187-47f8-bec9-5784c425a9ce" status: 200 len: 1324 microversion: 2.1 time: 0.683607 Aug 31 16:02:38.761596 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1380/2855] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:38 2022] GET /compute/v2.1/servers/6bd8b697-3187-47f8-bec9-5784c425a9ce => generated 1324 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:39.092412 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5f9b87eb-3513-415c-9807-f1124c29e2b0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:39.096737 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5f9b87eb-3513-415c-9807-f1124c29e2b0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: b242124a-1ecd-4762-babd-96246ccb7ceb] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:39.105931 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f9b87eb-3513-415c-9807-f1124c29e2b0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:39.106810 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f9b87eb-3513-415c-9807-f1124c29e2b0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:39.107483 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f9b87eb-3513-415c-9807-f1124c29e2b0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:39.109463 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f9b87eb-3513-415c-9807-f1124c29e2b0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:39.110554 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f9b87eb-3513-415c-9807-f1124c29e2b0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:39.111382 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f9b87eb-3513-415c-9807-f1124c29e2b0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:40.059425 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c385efb1-defe-41b9-bccc-28e1f5eeaedb tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/96bec4d7-3a20-4974-8865-51ef8fd087f6" status: 200 len: 1648 microversion: 2.1 time: 1.415596 Aug 31 16:02:40.068058 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1476/2856] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:38 2022] GET /compute/v2.1/servers/96bec4d7-3a20-4974-8865-51ef8fd087f6 => generated 1648 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:40.087323 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-cad80111-2080-46e9-b99c-0557c4f60acd tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:40.087950 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-cad80111-2080-46e9-b99c-0557c4f60acd tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] [instance: 6bd8b697-3187-47f8-bec9-5784c425a9ce] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:40.097230 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cad80111-2080-46e9-b99c-0557c4f60acd tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:40.099772 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cad80111-2080-46e9-b99c-0557c4f60acd tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:40.101183 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cad80111-2080-46e9-b99c-0557c4f60acd tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:40.106998 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cad80111-2080-46e9-b99c-0557c4f60acd tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:40.107545 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cad80111-2080-46e9-b99c-0557c4f60acd tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:40.107994 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cad80111-2080-46e9-b99c-0557c4f60acd tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:40.145454 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5f9b87eb-3513-415c-9807-f1124c29e2b0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:40.160573 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5f9b87eb-3513-415c-9807-f1124c29e2b0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/b242124a-1ecd-4762-babd-96246ccb7ceb" status: 200 len: 1315 microversion: 2.1 time: 1.087434 Aug 31 16:02:40.161574 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1381/2857] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:39 2022] GET /compute/v2.1/servers/b242124a-1ecd-4762-babd-96246ccb7ceb => generated 1315 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:40.181452 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c6118049-389a-4eb0-aef9-1c831f608532 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:40.182426 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c6118049-389a-4eb0-aef9-1c831f608532 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] [instance: 96bec4d7-3a20-4974-8865-51ef8fd087f6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:40.190060 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6118049-389a-4eb0-aef9-1c831f608532 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:40.190866 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6118049-389a-4eb0-aef9-1c831f608532 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:40.191473 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6118049-389a-4eb0-aef9-1c831f608532 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:40.192364 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6118049-389a-4eb0-aef9-1c831f608532 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:40.193013 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6118049-389a-4eb0-aef9-1c831f608532 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:40.193600 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6118049-389a-4eb0-aef9-1c831f608532 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:40.649654 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-cad80111-2080-46e9-b99c-0557c4f60acd tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c15400d81847c09c81b04b668560b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd7cf0fb56d40dca0d158268001b107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:40.691297 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-cad80111-2080-46e9-b99c-0557c4f60acd tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] 10.222.0.50 "GET /compute/v2.1/servers/6bd8b697-3187-47f8-bec9-5784c425a9ce" status: 200 len: 1324 microversion: 2.1 time: 0.621837 Aug 31 16:02:40.694828 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1477/2858] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:40 2022] GET /compute/v2.1/servers/6bd8b697-3187-47f8-bec9-5784c425a9ce => generated 1324 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:40.868247 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c6118049-389a-4eb0-aef9-1c831f608532 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/96bec4d7-3a20-4974-8865-51ef8fd087f6" status: 200 len: 1648 microversion: 2.1 time: 0.705346 Aug 31 16:02:40.870464 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1382/2859] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:40 2022] GET /compute/v2.1/servers/96bec4d7-3a20-4974-8865-51ef8fd087f6 => generated 1648 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:40.894660 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f09ffe56-3138-4784-8b24-c3da035fb573 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:40.901201 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f09ffe56-3138-4784-8b24-c3da035fb573 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:40.902085 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f09ffe56-3138-4784-8b24-c3da035fb573 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:40.902757 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f09ffe56-3138-4784-8b24-c3da035fb573 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:40.903777 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f09ffe56-3138-4784-8b24-c3da035fb573 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:40.904418 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f09ffe56-3138-4784-8b24-c3da035fb573 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:40.905026 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f09ffe56-3138-4784-8b24-c3da035fb573 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:40.938967 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f09ffe56-3138-4784-8b24-c3da035fb573 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.047936 Aug 31 16:02:40.955648 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1478/2860] 10.222.0.50 () {58 vars in 1176 bytes} [Wed Aug 31 16:02:40 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:02:40.976149 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b5adcda6-dc28-400e-a2ad-9420d15c10a1 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:40.976843 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b5adcda6-dc28-400e-a2ad-9420d15c10a1 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] [instance: 96bec4d7-3a20-4974-8865-51ef8fd087f6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:40.993308 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5adcda6-dc28-400e-a2ad-9420d15c10a1 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:40.994950 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5adcda6-dc28-400e-a2ad-9420d15c10a1 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:40.995962 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5adcda6-dc28-400e-a2ad-9420d15c10a1 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:40.997392 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5adcda6-dc28-400e-a2ad-9420d15c10a1 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:40.999135 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5adcda6-dc28-400e-a2ad-9420d15c10a1 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:41.000901 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5adcda6-dc28-400e-a2ad-9420d15c10a1 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:41.123382 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-58525eec-f8af-4bac-bf7b-0b697076c619 req-61d56fe5-ea69-4853-98c3-1a93f7f2be11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b242124a-1ecd-4762-babd-96246ccb7ceb", "tag": "fb90c64b-73f7-4ccf-b3d5-d0d828934bc7"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:41.161647 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-58525eec-f8af-4bac-bf7b-0b697076c619 req-61d56fe5-ea69-4853-98c3-1a93f7f2be11 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:41.162567 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-58525eec-f8af-4bac-bf7b-0b697076c619 req-61d56fe5-ea69-4853-98c3-1a93f7f2be11 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:41.166346 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-58525eec-f8af-4bac-bf7b-0b697076c619 req-61d56fe5-ea69-4853-98c3-1a93f7f2be11 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:41.198814 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-58525eec-f8af-4bac-bf7b-0b697076c619 req-61d56fe5-ea69-4853-98c3-1a93f7f2be11 service nova] Creating event network-changed:fb90c64b-73f7-4ccf-b3d5-d0d828934bc7 for instance b242124a-1ecd-4762-babd-96246ccb7ceb on n-h1-833090-16 Aug 31 16:02:41.213306 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-58525eec-f8af-4bac-bf7b-0b697076c619 req-61d56fe5-ea69-4853-98c3-1a93f7f2be11 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095619 Aug 31 16:02:41.222066 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1479/2861] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:02:41.228263 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-cfe1fe41-c4de-477c-8498-03f1931ef7a2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:41.230365 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-cfe1fe41-c4de-477c-8498-03f1931ef7a2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: b242124a-1ecd-4762-babd-96246ccb7ceb] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:41.240226 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:02:41.246855 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b5adcda6-dc28-400e-a2ad-9420d15c10a1 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/96bec4d7-3a20-4974-8865-51ef8fd087f6/action" status: 202 len: 0 microversion: 2.1 time: 0.292478 Aug 31 16:02:41.255045 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1383/2862] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:02:40 2022] POST /compute/v2.1/servers/96bec4d7-3a20-4974-8865-51ef8fd087f6/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:02:41.265033 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cfe1fe41-c4de-477c-8498-03f1931ef7a2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:41.265776 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cfe1fe41-c4de-477c-8498-03f1931ef7a2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:41.266358 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cfe1fe41-c4de-477c-8498-03f1931ef7a2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:41.268479 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cfe1fe41-c4de-477c-8498-03f1931ef7a2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:41.269537 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cfe1fe41-c4de-477c-8498-03f1931ef7a2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:41.270929 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cfe1fe41-c4de-477c-8498-03f1931ef7a2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:41.274725 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-28cf4f04-bf3c-48df-8cea-3031244882b0 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:41.277683 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-28cf4f04-bf3c-48df-8cea-3031244882b0 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] [instance: 96bec4d7-3a20-4974-8865-51ef8fd087f6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:41.299362 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28cf4f04-bf3c-48df-8cea-3031244882b0 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:41.299362 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28cf4f04-bf3c-48df-8cea-3031244882b0 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:41.303042 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28cf4f04-bf3c-48df-8cea-3031244882b0 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:41.306169 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28cf4f04-bf3c-48df-8cea-3031244882b0 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:41.309923 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28cf4f04-bf3c-48df-8cea-3031244882b0 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:41.311389 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28cf4f04-bf3c-48df-8cea-3031244882b0 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:41.866069 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-28cf4f04-bf3c-48df-8cea-3031244882b0 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/96bec4d7-3a20-4974-8865-51ef8fd087f6" status: 200 len: 1653 microversion: 2.1 time: 0.608551 Aug 31 16:02:41.871523 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1384/2863] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:41 2022] GET /compute/v2.1/servers/96bec4d7-3a20-4974-8865-51ef8fd087f6 => generated 1653 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:41.882928 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-45077c16-f08c-45d0-b5b1-d6a527b4cd12 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:41.883892 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-45077c16-f08c-45d0-b5b1-d6a527b4cd12 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] [instance: 6bd8b697-3187-47f8-bec9-5784c425a9ce] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:41.902128 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:02:41.912426 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45077c16-f08c-45d0-b5b1-d6a527b4cd12 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:41.912934 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45077c16-f08c-45d0-b5b1-d6a527b4cd12 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:41.913370 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45077c16-f08c-45d0-b5b1-d6a527b4cd12 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:41.917952 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45077c16-f08c-45d0-b5b1-d6a527b4cd12 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:41.920906 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45077c16-f08c-45d0-b5b1-d6a527b4cd12 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:41.923189 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45077c16-f08c-45d0-b5b1-d6a527b4cd12 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:42.513784 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-cfe1fe41-c4de-477c-8498-03f1931ef7a2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:42.529873 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-cfe1fe41-c4de-477c-8498-03f1931ef7a2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/b242124a-1ecd-4762-babd-96246ccb7ceb" status: 200 len: 1315 microversion: 2.1 time: 1.303916 Aug 31 16:02:42.545084 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1480/2864] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:41 2022] GET /compute/v2.1/servers/b242124a-1ecd-4762-babd-96246ccb7ceb => generated 1315 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:42.567917 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-45077c16-f08c-45d0-b5b1-d6a527b4cd12 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c15400d81847c09c81b04b668560b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd7cf0fb56d40dca0d158268001b107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:42.581548 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-45077c16-f08c-45d0-b5b1-d6a527b4cd12 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] 10.222.0.50 "GET /compute/v2.1/servers/6bd8b697-3187-47f8-bec9-5784c425a9ce" status: 200 len: 1521 microversion: 2.1 time: 0.704818 Aug 31 16:02:42.582549 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1385/2865] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:41 2022] GET /compute/v2.1/servers/6bd8b697-3187-47f8-bec9-5784c425a9ce => generated 1521 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:42.606157 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-85a5ddf5-a20f-4256-bd7b-f850ccbaa704 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.185"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:42.609407 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-85a5ddf5-a20f-4256-bd7b-f850ccbaa704 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] [instance: d18fee50-f30d-44c3-9ac5-18aaace88e65] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:42.623510 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85a5ddf5-a20f-4256-bd7b-f850ccbaa704 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:42.624007 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85a5ddf5-a20f-4256-bd7b-f850ccbaa704 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:42.624444 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85a5ddf5-a20f-4256-bd7b-f850ccbaa704 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:42.625219 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85a5ddf5-a20f-4256-bd7b-f850ccbaa704 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:42.625681 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85a5ddf5-a20f-4256-bd7b-f850ccbaa704 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:42.626156 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85a5ddf5-a20f-4256-bd7b-f850ccbaa704 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:42.678250 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85a5ddf5-a20f-4256-bd7b-f850ccbaa704 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "refresh_cache-d18fee50-f30d-44c3-9ac5-18aaace88e65" {{(pid=128864) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 16:02:42.679315 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85a5ddf5-a20f-4256-bd7b-f850ccbaa704 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquired lock "refresh_cache-d18fee50-f30d-44c3-9ac5-18aaace88e65" {{(pid=128864) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 16:02:42.895781 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cb1a8c4a-783e-4184-b36e-8409bc084ef0 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:42.896520 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cb1a8c4a-783e-4184-b36e-8409bc084ef0 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] [instance: 96bec4d7-3a20-4974-8865-51ef8fd087f6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:42.907724 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb1a8c4a-783e-4184-b36e-8409bc084ef0 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:42.908421 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb1a8c4a-783e-4184-b36e-8409bc084ef0 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:42.912109 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb1a8c4a-783e-4184-b36e-8409bc084ef0 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:42.913109 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb1a8c4a-783e-4184-b36e-8409bc084ef0 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:42.913765 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb1a8c4a-783e-4184-b36e-8409bc084ef0 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:42.916374 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb1a8c4a-783e-4184-b36e-8409bc084ef0 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:43.213930 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:02:43.285591 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:02:43.784914 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cb1a8c4a-783e-4184-b36e-8409bc084ef0 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/96bec4d7-3a20-4974-8865-51ef8fd087f6" status: 200 len: 1633 microversion: 2.1 time: 0.892846 Aug 31 16:02:43.805563 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1386/2866] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:42 2022] GET /compute/v2.1/servers/96bec4d7-3a20-4974-8865-51ef8fd087f6 => generated 1633 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:43.815344 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3d7662cd-094a-4cbb-b4e7-f2729c7526c4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:43.815972 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3d7662cd-094a-4cbb-b4e7-f2729c7526c4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: b242124a-1ecd-4762-babd-96246ccb7ceb] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:43.826710 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:02:43.831619 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d7662cd-094a-4cbb-b4e7-f2729c7526c4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:43.832120 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d7662cd-094a-4cbb-b4e7-f2729c7526c4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:43.832550 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d7662cd-094a-4cbb-b4e7-f2729c7526c4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:43.835732 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d7662cd-094a-4cbb-b4e7-f2729c7526c4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:43.836445 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d7662cd-094a-4cbb-b4e7-f2729c7526c4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:43.837046 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d7662cd-094a-4cbb-b4e7-f2729c7526c4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:44.363742 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3d7662cd-094a-4cbb-b4e7-f2729c7526c4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:44.415380 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3d7662cd-094a-4cbb-b4e7-f2729c7526c4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/b242124a-1ecd-4762-babd-96246ccb7ceb" status: 200 len: 1315 microversion: 2.1 time: 0.608442 Aug 31 16:02:44.425004 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1387/2867] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:43 2022] GET /compute/v2.1/servers/b242124a-1ecd-4762-babd-96246ccb7ceb => generated 1315 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:44.479155 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8f53125e-91ad-4393-b72e-88090fff6592 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Action: 'create', calling method: .version_select at 0x7fbb464a1e50>, body: {"keypair": {"name": "tempest-keypair-1453039412", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7uDNe493ehIvR/1SvD5/PmPxZU8uzyonwlWDGy1xV1+Qp+xb3qcYDI1iRrV0GrhlonE6zIixvf1pEipq5ubcAijzItT3bbSiDeZJUpVT7f4Et1WZ81gF9J3hjwTF+sPQ=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:44.536525 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-8f53125e-91ad-4393-b72e-88090fff6592 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Getting quotas for project 6550e3f42bfe4992aee45af34476da97. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:02:44.570386 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-8f53125e-91ad-4393-b72e-88090fff6592 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Getting quotas for user e8f9f728562f4d66b8039435235c655c and project 6550e3f42bfe4992aee45af34476da97. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:02:44.634954 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8f53125e-91ad-4393-b72e-88090fff6592 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.206497 Aug 31 16:02:44.641081 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1388/2868] 10.222.0.50 () {62 vars in 1200 bytes} [Wed Aug 31 16:02:44 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 213 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 31 16:02:44.655948 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-37e264da-2fa7-4910-af25-95a96c7047a1 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-833090-16", "block_migration": true, "disk_over_commit": false}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:44.665998 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-37e264da-2fa7-4910-af25-95a96c7047a1 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] [instance: 96bec4d7-3a20-4974-8865-51ef8fd087f6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:44.698544 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37e264da-2fa7-4910-af25-95a96c7047a1 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:44.700145 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37e264da-2fa7-4910-af25-95a96c7047a1 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:44.706175 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37e264da-2fa7-4910-af25-95a96c7047a1 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:44.710632 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37e264da-2fa7-4910-af25-95a96c7047a1 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:44.711903 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37e264da-2fa7-4910-af25-95a96c7047a1 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:44.714483 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37e264da-2fa7-4910-af25-95a96c7047a1 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:44.791003 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-37e264da-2fa7-4910-af25-95a96c7047a1 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lazy-loading 'flavor' on Instance uuid 96bec4d7-3a20-4974-8865-51ef8fd087f6 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:02:44.806272 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-37e264da-2fa7-4910-af25-95a96c7047a1 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] [instance: 96bec4d7-3a20-4974-8865-51ef8fd087f6] Going to try to live migrate instance to n-h1-833090-16 {{(pid=128863) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 31 16:02:44.893877 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:02:47.225573 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-85a5ddf5-a20f-4256-bd7b-f850ccbaa704 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] [instance: d18fee50-f30d-44c3-9ac5-18aaace88e65] Building network info cache for instance {{(pid=128864) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 31 16:02:48.454132 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-37e264da-2fa7-4910-af25-95a96c7047a1 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/96bec4d7-3a20-4974-8865-51ef8fd087f6/action" status: 202 len: 0 microversion: 2.1 time: 3.811377 Aug 31 16:02:48.455928 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1389/2869] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:02:44 2022] POST /compute/v2.1/servers/96bec4d7-3a20-4974-8865-51ef8fd087f6/action => generated 0 bytes in 3814 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:02:48.467069 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b8304b1e-ec68-4f07-8dad-72927bf0fd09 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:48.472353 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b8304b1e-ec68-4f07-8dad-72927bf0fd09 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: b242124a-1ecd-4762-babd-96246ccb7ceb] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:48.489525 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8304b1e-ec68-4f07-8dad-72927bf0fd09 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:48.490454 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8304b1e-ec68-4f07-8dad-72927bf0fd09 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:48.491358 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8304b1e-ec68-4f07-8dad-72927bf0fd09 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:48.492302 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8304b1e-ec68-4f07-8dad-72927bf0fd09 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:48.493591 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8304b1e-ec68-4f07-8dad-72927bf0fd09 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:48.494738 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8304b1e-ec68-4f07-8dad-72927bf0fd09 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:48.957892 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-85a5ddf5-a20f-4256-bd7b-f850ccbaa704 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] [instance: d18fee50-f30d-44c3-9ac5-18aaace88e65] Updating instance_info_cache with network_info: [{"id": "f657e99c-7a4f-44d8-93b1-1e4f5d4feb75", "address": "fa:16:3e:e5:79:5b", "network": {"id": "73c1c7bb-002c-4b7e-9aff-6189e5ddb8fe", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1975144358-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "abd7cf0fb56d40dca0d158268001b107", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf657e99c-7a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128864) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 31 16:02:48.986922 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b8304b1e-ec68-4f07-8dad-72927bf0fd09 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:49.003312 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85a5ddf5-a20f-4256-bd7b-f850ccbaa704 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Releasing lock "refresh_cache-d18fee50-f30d-44c3-9ac5-18aaace88e65" {{(pid=128864) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 16:02:49.008065 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b8304b1e-ec68-4f07-8dad-72927bf0fd09 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/b242124a-1ecd-4762-babd-96246ccb7ceb" status: 200 len: 1315 microversion: 2.1 time: 0.547474 Aug 31 16:02:49.020222 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-85a5ddf5-a20f-4256-bd7b-f850ccbaa704 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] 10.222.0.50 "POST /compute/v2.1/servers/d18fee50-f30d-44c3-9ac5-18aaace88e65/action" status: 202 len: 0 microversion: 2.1 time: 6.405377 Aug 31 16:02:49.020222 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1481/2870] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:02:42 2022] POST /compute/v2.1/servers/d18fee50-f30d-44c3-9ac5-18aaace88e65/action => generated 0 bytes in 6414 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 31 16:02:49.020222 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-7c621d38-623e-4b5e-a2cc-513096d17d0d req-99bf7a27-de28-42a8-8670-dbb96906633b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d18fee50-f30d-44c3-9ac5-18aaace88e65", "tag": "f657e99c-7a4f-44d8-93b1-1e4f5d4feb75"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:49.023206 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1390/2871] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:48 2022] GET /compute/v2.1/servers/b242124a-1ecd-4762-babd-96246ccb7ceb => generated 1315 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:49.030057 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-88a53bb1-fa4d-41e3-9b52-287fcf39e19e tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:49.031049 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-88a53bb1-fa4d-41e3-9b52-287fcf39e19e tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 96bec4d7-3a20-4974-8865-51ef8fd087f6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:49.044774 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88a53bb1-fa4d-41e3-9b52-287fcf39e19e tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:49.045745 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88a53bb1-fa4d-41e3-9b52-287fcf39e19e tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:49.046504 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88a53bb1-fa4d-41e3-9b52-287fcf39e19e tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:49.047730 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88a53bb1-fa4d-41e3-9b52-287fcf39e19e tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:49.048673 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7c621d38-623e-4b5e-a2cc-513096d17d0d req-99bf7a27-de28-42a8-8670-dbb96906633b service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:49.048989 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88a53bb1-fa4d-41e3-9b52-287fcf39e19e tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:49.049495 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7c621d38-623e-4b5e-a2cc-513096d17d0d req-99bf7a27-de28-42a8-8670-dbb96906633b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:49.050428 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7c621d38-623e-4b5e-a2cc-513096d17d0d req-99bf7a27-de28-42a8-8670-dbb96906633b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:49.051058 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88a53bb1-fa4d-41e3-9b52-287fcf39e19e tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:49.072053 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-7c621d38-623e-4b5e-a2cc-513096d17d0d req-99bf7a27-de28-42a8-8670-dbb96906633b service nova] Creating event network-changed:f657e99c-7a4f-44d8-93b1-1e4f5d4feb75 for instance d18fee50-f30d-44c3-9ac5-18aaace88e65 on n-h2-833090-16 Aug 31 16:02:49.082062 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-7c621d38-623e-4b5e-a2cc-513096d17d0d req-99bf7a27-de28-42a8-8670-dbb96906633b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068105 Aug 31 16:02:49.082732 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1482/2872] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:02:49.095941 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d2c81ddd-0f85-4f7f-8320-13300843e798 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.185"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:49.098683 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d2c81ddd-0f85-4f7f-8320-13300843e798 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] [instance: 6bd8b697-3187-47f8-bec9-5784c425a9ce] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:49.110401 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d2c81ddd-0f85-4f7f-8320-13300843e798 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:49.111796 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d2c81ddd-0f85-4f7f-8320-13300843e798 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:49.112513 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d2c81ddd-0f85-4f7f-8320-13300843e798 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:49.114858 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d2c81ddd-0f85-4f7f-8320-13300843e798 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:49.115918 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d2c81ddd-0f85-4f7f-8320-13300843e798 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:49.116600 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d2c81ddd-0f85-4f7f-8320-13300843e798 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:49.152653 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d2c81ddd-0f85-4f7f-8320-13300843e798 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "refresh_cache-6bd8b697-3187-47f8-bec9-5784c425a9ce" {{(pid=128864) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 16:02:49.153298 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d2c81ddd-0f85-4f7f-8320-13300843e798 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquired lock "refresh_cache-6bd8b697-3187-47f8-bec9-5784c425a9ce" {{(pid=128864) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 16:02:49.604767 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-88a53bb1-fa4d-41e3-9b52-287fcf39e19e tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:49.615068 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-88a53bb1-fa4d-41e3-9b52-287fcf39e19e tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/96bec4d7-3a20-4974-8865-51ef8fd087f6" status: 200 len: 1505 microversion: 2.1 time: 0.590378 Aug 31 16:02:49.632696 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1391/2873] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:49 2022] GET /compute/v2.1/servers/96bec4d7-3a20-4974-8865-51ef8fd087f6 => generated 1505 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:50.044891 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4b328a2c-0004-4ebe-9bfd-c5404b1eaf17 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:50.045602 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4b328a2c-0004-4ebe-9bfd-c5404b1eaf17 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: b242124a-1ecd-4762-babd-96246ccb7ceb] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:50.076621 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b328a2c-0004-4ebe-9bfd-c5404b1eaf17 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:50.083483 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b328a2c-0004-4ebe-9bfd-c5404b1eaf17 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:50.084135 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b328a2c-0004-4ebe-9bfd-c5404b1eaf17 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:50.085403 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b328a2c-0004-4ebe-9bfd-c5404b1eaf17 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:50.086541 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b328a2c-0004-4ebe-9bfd-c5404b1eaf17 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:50.087833 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b328a2c-0004-4ebe-9bfd-c5404b1eaf17 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:50.912870 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:02:51.117677 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4b328a2c-0004-4ebe-9bfd-c5404b1eaf17 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:51.128767 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4b328a2c-0004-4ebe-9bfd-c5404b1eaf17 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/b242124a-1ecd-4762-babd-96246ccb7ceb" status: 200 len: 1315 microversion: 2.1 time: 1.089387 Aug 31 16:02:51.131128 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1392/2874] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:50 2022] GET /compute/v2.1/servers/b242124a-1ecd-4762-babd-96246ccb7ceb => generated 1315 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:51.138040 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-aa689f4a-1409-4b50-be41-faa5de3d301d tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Action: 'create', calling method: .version_select at 0x7fbb4ab6c700>, body: {"keypair": {"name": "tempest-keypair-838981112", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKYm/Ne3eQha8VtDq1kPiEv70S2dQZP7l9xRHrAf7a9DauxOkeTVs6KvGSVv74rwPytCQFWwg48cmJgZ8X4mGcvArRc7BLrSjUHdRyuI308E2SgclHBNTLCJG8tHCwL+Q=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:51.199844 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-aa689f4a-1409-4b50-be41-faa5de3d301d tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Getting quotas for project c08474001ff6477cb14547afb2b6a72d. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:02:51.220780 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-aa689f4a-1409-4b50-be41-faa5de3d301d tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Getting quotas for user a9fe7107d5e94104bda2d567394753fe and project c08474001ff6477cb14547afb2b6a72d. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:02:51.284427 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-aa689f4a-1409-4b50-be41-faa5de3d301d tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.151980 Aug 31 16:02:51.287288 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1393/2875] 10.222.0.50 () {62 vars in 1200 bytes} [Wed Aug 31 16:02:51 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 153 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 31 16:02:51.296219 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-3c6e95d5-7e46-4f24-86a0-74936ed65e0a req-eb058c34-6d93-418c-8d11-c41c6ec9be37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b242124a-1ecd-4762-babd-96246ccb7ceb", "name": "network-vif-plugged", "status": "completed", "tag": "fb90c64b-73f7-4ccf-b3d5-d0d828934bc7"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:51.318303 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3c6e95d5-7e46-4f24-86a0-74936ed65e0a req-eb058c34-6d93-418c-8d11-c41c6ec9be37 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:51.326856 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3c6e95d5-7e46-4f24-86a0-74936ed65e0a req-eb058c34-6d93-418c-8d11-c41c6ec9be37 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:51.327797 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3c6e95d5-7e46-4f24-86a0-74936ed65e0a req-eb058c34-6d93-418c-8d11-c41c6ec9be37 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:51.361353 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-3c6e95d5-7e46-4f24-86a0-74936ed65e0a req-eb058c34-6d93-418c-8d11-c41c6ec9be37 service nova] Creating event network-vif-plugged:fb90c64b-73f7-4ccf-b3d5-d0d828934bc7 for instance b242124a-1ecd-4762-babd-96246ccb7ceb on n-h1-833090-16 Aug 31 16:02:51.380829 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-3c6e95d5-7e46-4f24-86a0-74936ed65e0a req-eb058c34-6d93-418c-8d11-c41c6ec9be37 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087937 Aug 31 16:02:51.387643 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1394/2876] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:02:51.407466 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0d5e5662-967f-4bc1-ad47-8f90347f404a tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:51.410924 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0d5e5662-967f-4bc1-ad47-8f90347f404a tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 96bec4d7-3a20-4974-8865-51ef8fd087f6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:51.428487 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0d5e5662-967f-4bc1-ad47-8f90347f404a tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:51.431568 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0d5e5662-967f-4bc1-ad47-8f90347f404a tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:51.432275 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0d5e5662-967f-4bc1-ad47-8f90347f404a tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:51.435182 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0d5e5662-967f-4bc1-ad47-8f90347f404a tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:51.441359 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0d5e5662-967f-4bc1-ad47-8f90347f404a tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:51.442007 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0d5e5662-967f-4bc1-ad47-8f90347f404a tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:52.496028 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0d5e5662-967f-4bc1-ad47-8f90347f404a tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:52.517708 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0d5e5662-967f-4bc1-ad47-8f90347f404a tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/96bec4d7-3a20-4974-8865-51ef8fd087f6" status: 200 len: 1505 microversion: 2.1 time: 1.126595 Aug 31 16:02:52.518847 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1395/2877] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:51 2022] GET /compute/v2.1/servers/96bec4d7-3a20-4974-8865-51ef8fd087f6 => generated 1505 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:52.526238 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7841a6c8-4a3f-4dc6-9177-26db7c7b75f9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:52.528465 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7841a6c8-4a3f-4dc6-9177-26db7c7b75f9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: b242124a-1ecd-4762-babd-96246ccb7ceb] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:52.549218 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7841a6c8-4a3f-4dc6-9177-26db7c7b75f9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:52.550263 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7841a6c8-4a3f-4dc6-9177-26db7c7b75f9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:52.551562 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7841a6c8-4a3f-4dc6-9177-26db7c7b75f9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:52.553114 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7841a6c8-4a3f-4dc6-9177-26db7c7b75f9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:52.553896 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7841a6c8-4a3f-4dc6-9177-26db7c7b75f9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:52.557442 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7841a6c8-4a3f-4dc6-9177-26db7c7b75f9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:53.426163 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7841a6c8-4a3f-4dc6-9177-26db7c7b75f9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:53.439692 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7841a6c8-4a3f-4dc6-9177-26db7c7b75f9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/b242124a-1ecd-4762-babd-96246ccb7ceb" status: 200 len: 1315 microversion: 2.1 time: 0.915150 Aug 31 16:02:53.441606 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1396/2878] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:52 2022] GET /compute/v2.1/servers/b242124a-1ecd-4762-babd-96246ccb7ceb => generated 1315 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:02:53.540806 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d6c9ab54-0647-4418-9fd9-645793a33347 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:02:53.542163 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d6c9ab54-0647-4418-9fd9-645793a33347 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 96bec4d7-3a20-4974-8865-51ef8fd087f6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:02:53.550925 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6c9ab54-0647-4418-9fd9-645793a33347 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:53.552860 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6c9ab54-0647-4418-9fd9-645793a33347 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:53.558761 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6c9ab54-0647-4418-9fd9-645793a33347 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:53.560458 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6c9ab54-0647-4418-9fd9-645793a33347 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:02:53.561103 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6c9ab54-0647-4418-9fd9-645793a33347 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:02:53.561892 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6c9ab54-0647-4418-9fd9-645793a33347 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:02:54.771615 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d6c9ab54-0647-4418-9fd9-645793a33347 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:02:54.780884 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d6c9ab54-0647-4418-9fd9-645793a33347 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/96bec4d7-3a20-4974-8865-51ef8fd087f6" status: 200 len: 1505 microversion: 2.1 time: 1.244677 Aug 31 16:02:54.792578 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1397/2879] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:02:53 2022] GET /compute/v2.1/servers/96bec4d7-3a20-4974-8865-51ef8fd087f6 => generated 1505 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:02:54.807388 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ed0ca75d-16b1-4d31-9c6b-e5e6f50da7cc tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1753529705", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "db52983a-31f6-4659-bfea-b5e3f5acd1f6"}, {"port": "505cceaf-e4cc-4b2b-8615-77bc0c7bf80e", "tag": "port-1"}, {"port": "3445d58d-1bed-4c5b-82a7-a81a67db5f67", "tag": "port-2"}, {"uuid": "ecbc6a69-cc38-478e-9bb8-f05c01090a58", "tag": "net-1"}, {"uuid": "ecbc6a69-cc38-478e-9bb8-f05c01090a58"}, {"uuid": "bb5677e3-064a-482e-bc60-ebb0ad110b53", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "bb5677e3-064a-482e-bc60-ebb0ad110b53", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "1385ad02-cba6-4d13-a6d8-cd6648b3316c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "7c4639d8-c5a6-4d9f-a475-956908bec951", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "a43fc1fe-a00e-4cd6-8411-e0309709349d", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--462534045"}], "key_name": "tempest-keypair-1453039412", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:02:55.235051 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-ed0ca75d-16b1-4d31-9c6b-e5e6f50da7cc tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] validate_networks() for [('db52983a-31f6-4659-bfea-b5e3f5acd1f6', None, None, None, None, None), (None, None, '505cceaf-e4cc-4b2b-8615-77bc0c7bf80e', None, None, None), (None, None, '3445d58d-1bed-4c5b-82a7-a81a67db5f67', None, None, None), ('ecbc6a69-cc38-478e-9bb8-f05c01090a58', None, None, None, None, None), ('ecbc6a69-cc38-478e-9bb8-f05c01090a58', None, None, None, None, None), ('bb5677e3-064a-482e-bc60-ebb0ad110b53', '10.2.2.100', None, None, None, None), ('bb5677e3-064a-482e-bc60-ebb0ad110b53', '10.2.2.200', None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:02:59.110493 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=7 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:02:59.148519 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=88,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:03:00.124926 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.network.neutron [None req-d2c81ddd-0f85-4f7f-8320-13300843e798 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] [instance: 6bd8b697-3187-47f8-bec9-5784c425a9ce] re-assign floating IP 172.25.9.185 from instance d18fee50-f30d-44c3-9ac5-18aaace88e65 Aug 31 16:03:00.196454 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-d2c81ddd-0f85-4f7f-8320-13300843e798 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] [instance: d18fee50-f30d-44c3-9ac5-18aaace88e65] Building network info cache for instance {{(pid=128864) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 31 16:03:01.245702 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=8 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:03:02.539130 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-d2c81ddd-0f85-4f7f-8320-13300843e798 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] [instance: d18fee50-f30d-44c3-9ac5-18aaace88e65] Updating instance_info_cache with network_info: [{"id": "f657e99c-7a4f-44d8-93b1-1e4f5d4feb75", "address": "fa:16:3e:e5:79:5b", "network": {"id": "73c1c7bb-002c-4b7e-9aff-6189e5ddb8fe", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1975144358-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "abd7cf0fb56d40dca0d158268001b107", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf657e99c-7a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128864) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 31 16:03:02.554603 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-d2c81ddd-0f85-4f7f-8320-13300843e798 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] [instance: 6bd8b697-3187-47f8-bec9-5784c425a9ce] Building network info cache for instance {{(pid=128864) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 31 16:03:04.095798 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ed0ca75d-16b1-4d31-9c6b-e5e6f50da7cc tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:03:04.098146 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ed0ca75d-16b1-4d31-9c6b-e5e6f50da7cc tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:03:04.098855 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ed0ca75d-16b1-4d31-9c6b-e5e6f50da7cc tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:03:04.099188 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ed0ca75d-16b1-4d31-9c6b-e5e6f50da7cc tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:03:04.099592 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ed0ca75d-16b1-4d31-9c6b-e5e6f50da7cc tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:03:04.114555 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed0ca75d-16b1-4d31-9c6b-e5e6f50da7cc tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:04.115073 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed0ca75d-16b1-4d31-9c6b-e5e6f50da7cc tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:04.115516 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed0ca75d-16b1-4d31-9c6b-e5e6f50da7cc tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:04.116290 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed0ca75d-16b1-4d31-9c6b-e5e6f50da7cc tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:04.116823 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed0ca75d-16b1-4d31-9c6b-e5e6f50da7cc tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:04.117397 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed0ca75d-16b1-4d31-9c6b-e5e6f50da7cc tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:04.149288 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-ed0ca75d-16b1-4d31-9c6b-e5e6f50da7cc tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Getting quotas for project 6550e3f42bfe4992aee45af34476da97. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:03:04.155834 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-ed0ca75d-16b1-4d31-9c6b-e5e6f50da7cc tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Getting quotas for user e8f9f728562f4d66b8039435235c655c and project 6550e3f42bfe4992aee45af34476da97. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:03:04.349448 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-d2c81ddd-0f85-4f7f-8320-13300843e798 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] [instance: 6bd8b697-3187-47f8-bec9-5784c425a9ce] Updating instance_info_cache with network_info: [{"id": "5f2a5d63-d2e4-4ad2-a495-66a5cea1e3ce", "address": "fa:16:3e:13:9f:d0", "network": {"id": "73c1c7bb-002c-4b7e-9aff-6189e5ddb8fe", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1975144358-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "abd7cf0fb56d40dca0d158268001b107", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap5f2a5d63-d2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128864) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 31 16:03:04.370086 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d2c81ddd-0f85-4f7f-8320-13300843e798 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Releasing lock "refresh_cache-6bd8b697-3187-47f8-bec9-5784c425a9ce" {{(pid=128864) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 16:03:04.371621 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d2c81ddd-0f85-4f7f-8320-13300843e798 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] 10.222.0.50 "POST /compute/v2.1/servers/6bd8b697-3187-47f8-bec9-5784c425a9ce/action" status: 202 len: 0 microversion: 2.1 time: 15.287654 Aug 31 16:03:04.373014 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1483/2880] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:02:49 2022] POST /compute/v2.1/servers/6bd8b697-3187-47f8-bec9-5784c425a9ce/action => generated 0 bytes in 15290 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 31 16:03:04.382886 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-742a6e78-c770-4919-924a-742957b9428d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:04.384070 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-742a6e78-c770-4919-924a-742957b9428d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: b242124a-1ecd-4762-babd-96246ccb7ceb] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:04.393222 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-742a6e78-c770-4919-924a-742957b9428d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:04.394074 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-742a6e78-c770-4919-924a-742957b9428d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:04.394713 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-742a6e78-c770-4919-924a-742957b9428d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:04.396633 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-742a6e78-c770-4919-924a-742957b9428d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:04.397271 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-742a6e78-c770-4919-924a-742957b9428d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:04.398047 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-742a6e78-c770-4919-924a-742957b9428d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:04.443215 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ed0ca75d-16b1-4d31-9c6b-e5e6f50da7cc tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:03:04.447669 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ed0ca75d-16b1-4d31-9c6b-e5e6f50da7cc tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='1385ad02-cba6-4d13-a6d8-cd6648b3316c',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='7c4639d8-c5a6-4d9f-a475-956908bec951',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a43fc1fe-a00e-4cd6-8411-e0309709349d',volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:03:04.725594 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-742a6e78-c770-4919-924a-742957b9428d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:04.741208 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-742a6e78-c770-4919-924a-742957b9428d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/b242124a-1ecd-4762-babd-96246ccb7ceb" status: 200 len: 1502 microversion: 2.1 time: 0.361970 Aug 31 16:03:04.747303 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1484/2881] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:04 2022] GET /compute/v2.1/servers/b242124a-1ecd-4762-babd-96246ccb7ceb => generated 1502 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:04.765995 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-42bdd83b-74ba-4b86-b1f6-c751546aad2c req-89fe6d61-935c-4815-a287-841c7556d74f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96bec4d7-3a20-4974-8865-51ef8fd087f6", "name": "network-vif-unplugged", "status": "completed", "tag": "88ac1c93-1d43-4270-990d-911112bbebb5"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:04.820760 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-42bdd83b-74ba-4b86-b1f6-c751546aad2c req-89fe6d61-935c-4815-a287-841c7556d74f service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:04.821632 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-42bdd83b-74ba-4b86-b1f6-c751546aad2c req-89fe6d61-935c-4815-a287-841c7556d74f service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:04.822346 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-42bdd83b-74ba-4b86-b1f6-c751546aad2c req-89fe6d61-935c-4815-a287-841c7556d74f service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:04.874508 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-42bdd83b-74ba-4b86-b1f6-c751546aad2c req-89fe6d61-935c-4815-a287-841c7556d74f service nova] Creating event network-vif-unplugged:88ac1c93-1d43-4270-990d-911112bbebb5 for instance 96bec4d7-3a20-4974-8865-51ef8fd087f6 on n-h1-833090-16 Aug 31 16:03:04.889913 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-42bdd83b-74ba-4b86-b1f6-c751546aad2c req-89fe6d61-935c-4815-a287-841c7556d74f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.141313 Aug 31 16:03:04.891131 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1485/2882] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:03:04.931268 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f931ab58-61a5-47a8-a77d-c6bf025dec35 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:04.933352 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f931ab58-61a5-47a8-a77d-c6bf025dec35 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 96bec4d7-3a20-4974-8865-51ef8fd087f6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:04.950701 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f931ab58-61a5-47a8-a77d-c6bf025dec35 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:04.951919 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f931ab58-61a5-47a8-a77d-c6bf025dec35 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:04.954384 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f931ab58-61a5-47a8-a77d-c6bf025dec35 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:04.956269 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f931ab58-61a5-47a8-a77d-c6bf025dec35 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:04.957113 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f931ab58-61a5-47a8-a77d-c6bf025dec35 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:04.957794 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f931ab58-61a5-47a8-a77d-c6bf025dec35 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:05.125056 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ed0ca75d-16b1-4d31-9c6b-e5e6f50da7cc tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 10.330808 Aug 31 16:03:05.126748 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1398/2883] 10.222.0.50 () {62 vars in 1189 bytes} [Wed Aug 31 16:02:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 10333 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 31 16:03:05.132595 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-56af0f4c-e7ca-4381-b5b1-da01e362b648 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-753332564", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "10de8e15-f0e5-4450-b5d2-07f98d4a63d6"}, {"port": "0e3734e2-2119-411e-bd8e-c6da7c160678", "tag": "port-1"}, {"port": "f9cdc28e-e2d4-4e82-a9fd-a5a05b15a14c", "tag": "port-2"}, {"uuid": "e3ba2310-8e3c-4e6c-9ce4-fe76e172a251", "tag": "net-1"}, {"uuid": "e3ba2310-8e3c-4e6c-9ce4-fe76e172a251"}, {"uuid": "a8922dbb-c9ea-4343-bbeb-426a2fcf0887", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "a8922dbb-c9ea-4343-bbeb-426a2fcf0887", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "93da21cd-a976-48a1-b536-41cc02e681af", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "92bff37b-0f46-4c2a-a700-e2fd346acb61", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "787819a1-f45c-4ffb-b9d8-18eb60b002f8", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1085746222"}], "key_name": "tempest-keypair-838981112", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:05.257534 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f931ab58-61a5-47a8-a77d-c6bf025dec35 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:05.287562 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f931ab58-61a5-47a8-a77d-c6bf025dec35 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/96bec4d7-3a20-4974-8865-51ef8fd087f6" status: 200 len: 1480 microversion: 2.1 time: 0.386340 Aug 31 16:03:05.290830 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1486/2884] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:04 2022] GET /compute/v2.1/servers/96bec4d7-3a20-4974-8865-51ef8fd087f6 => generated 1480 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:05.393586 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-56af0f4c-e7ca-4381-b5b1-da01e362b648 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] validate_networks() for [('10de8e15-f0e5-4450-b5d2-07f98d4a63d6', None, None, None, None, None), (None, None, '0e3734e2-2119-411e-bd8e-c6da7c160678', None, None, None), (None, None, 'f9cdc28e-e2d4-4e82-a9fd-a5a05b15a14c', None, None, None), ('e3ba2310-8e3c-4e6c-9ce4-fe76e172a251', None, None, None, None, None), ('e3ba2310-8e3c-4e6c-9ce4-fe76e172a251', None, None, None, None, None), ('a8922dbb-c9ea-4343-bbeb-426a2fcf0887', '10.2.2.100', None, None, None, None), ('a8922dbb-c9ea-4343-bbeb-426a2fcf0887', '10.2.2.200', None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:03:05.671113 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-df043614-d5ce-48ee-a89a-da6067c78373 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Action: 'create', calling method: .version_select at 0x7fbb45f7a310>, body: {"keypair": {"name": "tempest-keypair-1523192079", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCvrqIG3oh7oJ1lrpxUZlxusF9mZ9bF5jdw5hIhb4b1byQXrfiHtCvJMBZQErAKJTSpwaiZ6UF/U0+S8Uw2FONV+XjfcMkDchu2nKP+8moH3WrWnNjlecd4QG2djBjXt0A=="}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:05.696984 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-df043614-d5ce-48ee-a89a-da6067c78373 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Getting quotas for project dfbd02718e4848ab9e6ff73dbbb469d9. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:03:05.702785 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-df043614-d5ce-48ee-a89a-da6067c78373 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Getting quotas for user 250769b38a2d48db928fdc20a8c64d28 and project dfbd02718e4848ab9e6ff73dbbb469d9. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:03:05.718908 n-d-833090-16 devstack@n-api.service[128864]: ERROR oslo.messaging._drivers.impl_rabbit [None req-df043614-d5ce-48ee-a89a-da6067c78373 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] [178b73f2-a464-4c5c-bbc3-290eb235843a] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 16:03:06.729842 n-d-833090-16 devstack@n-api.service[128864]: INFO oslo.messaging._drivers.impl_rabbit [None req-df043614-d5ce-48ee-a89a-da6067c78373 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] [178b73f2-a464-4c5c-bbc3-290eb235843a] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 59180. Aug 31 16:03:06.757881 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-df043614-d5ce-48ee-a89a-da6067c78373 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.465197 Aug 31 16:03:06.778438 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1487/2885] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 31 16:03:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:03:06.785641 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-529892d1-1044-487a-8f83-24244589833d tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.185"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:07.373389 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-529892d1-1044-487a-8f83-24244589833d tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] [instance: 6bd8b697-3187-47f8-bec9-5784c425a9ce] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:07.390246 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-529892d1-1044-487a-8f83-24244589833d tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:07.390757 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-529892d1-1044-487a-8f83-24244589833d tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:07.391196 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-529892d1-1044-487a-8f83-24244589833d tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:07.391913 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-529892d1-1044-487a-8f83-24244589833d tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:07.392439 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-529892d1-1044-487a-8f83-24244589833d tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:07.393050 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-529892d1-1044-487a-8f83-24244589833d tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:07.892003 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-529892d1-1044-487a-8f83-24244589833d tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] HTTP exception thrown: Floating IP 172.25.9.185 is not associated with instance d18fee50-f30d-44c3-9ac5-18aaace88e65. Aug 31 16:03:07.894980 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-529892d1-1044-487a-8f83-24244589833d tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Request method failure captured: Aug 31 16:03:07.894980 n-d-833090-16 devstack@n-api.service[128864]: request: POST /compute/v2.1/servers/d18fee50-f30d-44c3-9ac5-18aaace88e65/action HTTP/1.1 Aug 31 16:03:07.894980 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:03:07.894980 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:03:07.894980 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:03:07.894980 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 49 Aug 31 16:03:07.894980 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:03:07.894980 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:03:07.894980 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:03:07.894980 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:03:07.894980 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4Xkkepu06Zbr2QwlxAeYAXaprRnFLOozcB075W5HET-0b_KmsqaghYLku7x9bCOqGS5t1k5-3UhWEgO1NSLk4QWKtGimBw8A6V9-N9zhLGYN2voGaci99gzG5KwpsRzdRxzK8dkUekeW9DM4vpgrB0a3SN7t-cexkft6h2SiyXsVJo Aug 31 16:03:07.894980 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:03:07.894980 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:03:07.894980 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:03:07.894980 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:03:07.894980 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:03:07.894980 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:03:07.894980 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: abd7cf0fb56d40dca0d158268001b107 Aug 31 16:03:07.894980 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1451141319 Aug 31 16:03:07.894980 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:03:07.894980 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:03:07.894980 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/abd7cf0fb56d40dca0d158268001b107"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/abd7cf0fb56d40dca0d158268001b107"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/abd7cf0fb56d40dca0d158268001b107"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_abd7cf0fb56d40dca0d158268001b107", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:03:07.894980 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1451141319 Aug 31 16:03:07.894980 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: abd7cf0fb56d40dca0d158268001b107 Aug 31 16:03:07.894980 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1451141319 Aug 31 16:03:07.894980 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-FloatingIPsAssociationTestJSON-1451141319-project Aug 31 16:03:07.894980 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:03:07.894980 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:03:07.894980 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: d3c15400d81847c09c81b04b668560b7 Aug 31 16:03:07.894980 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1451141319-project Aug 31 16:03:07.894980 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 16:03:07.894980 n-d-833090-16 devstack@n-api.service[128864]: {"removeFloatingIp": {"address": "172.25.9.185"}} Aug 31 16:03:07.894980 n-d-833090-16 devstack@n-api.service[128864]: method: Aug 31 16:03:07.894980 n-d-833090-16 devstack@n-api.service[128864]: exception: Floating IP 172.25.9.185 is not associated with instance d18fee50-f30d-44c3-9ac5-18aaace88e65. Aug 31 16:03:07.894980 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'd18fee50-f30d-44c3-9ac5-18aaace88e65', 'body': {'removeFloatingIp': {'address': '172.25.9.185'}}} Aug 31 16:03:07.894980 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:03:07.894980 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:03:07.894980 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:03:07.894980 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:03:07.894980 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:03:07.894980 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:03:07.894980 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:03:07.894980 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:03:07.894980 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:03:07.894980 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:03:07.894980 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:03:07.894980 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:03:07.894980 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Aug 31 16:03:07.894980 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 16:03:07.894980 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.9.185 is not associated with instance d18fee50-f30d-44c3-9ac5-18aaace88e65. Aug 31 16:03:07.894980 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:03:07.894980 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:03:07.894980 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:03:07.894980 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:03:07.894980 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:03:07.894980 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:03:07.894980 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:03:07.894980 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:03:07.894980 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.9.185 is not associated with instance d18fee50-f30d-44c3-9ac5-18aaace88e65. Aug 31 16:03:07.894980 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:03:07.900326 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-529892d1-1044-487a-8f83-24244589833d tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Returning 409 to user: Floating IP 172.25.9.185 is not associated with instance d18fee50-f30d-44c3-9ac5-18aaace88e65. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:03:07.900326 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-529892d1-1044-487a-8f83-24244589833d tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] 10.222.0.50 "POST /compute/v2.1/servers/d18fee50-f30d-44c3-9ac5-18aaace88e65/action" status: 409 len: 146 microversion: 2.1 time: 1.119921 Aug 31 16:03:07.901138 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1488/2886] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:03:06 2022] POST /compute/v2.1/servers/d18fee50-f30d-44c3-9ac5-18aaace88e65/action => generated 146 bytes in 1122 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 16:03:07.909622 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-790e6535-5642-4bd4-9fc2-73d4151ea616 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:07.927381 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-790e6535-5642-4bd4-9fc2-73d4151ea616 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:07.928266 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-790e6535-5642-4bd4-9fc2-73d4151ea616 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:07.928931 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-790e6535-5642-4bd4-9fc2-73d4151ea616 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:07.969769 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-790e6535-5642-4bd4-9fc2-73d4151ea616 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: b242124a-1ecd-4762-babd-96246ccb7ceb] Going to try to stop instance {{(pid=128864) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 16:03:08.070329 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-790e6535-5642-4bd4-9fc2-73d4151ea616 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "POST /compute/v2.1/servers/b242124a-1ecd-4762-babd-96246ccb7ceb/action" status: 202 len: 0 microversion: 2.1 time: 0.166528 Aug 31 16:03:08.087353 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1489/2887] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:03:07 2022] POST /compute/v2.1/servers/b242124a-1ecd-4762-babd-96246ccb7ceb/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:03:08.099987 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6482ba5e-44f3-4c71-b370-671d453e4b64 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:08.105135 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6482ba5e-44f3-4c71-b370-671d453e4b64 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:08.117124 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6482ba5e-44f3-4c71-b370-671d453e4b64 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:08.117911 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6482ba5e-44f3-4c71-b370-671d453e4b64 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:08.120591 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6482ba5e-44f3-4c71-b370-671d453e4b64 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:08.122299 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6482ba5e-44f3-4c71-b370-671d453e4b64 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:08.124210 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6482ba5e-44f3-4c71-b370-671d453e4b64 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:08.124967 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6482ba5e-44f3-4c71-b370-671d453e4b64 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:08.225271 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6482ba5e-44f3-4c71-b370-671d453e4b64 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:08.238122 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6482ba5e-44f3-4c71-b370-671d453e4b64 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:08.246715 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6482ba5e-44f3-4c71-b370-671d453e4b64 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:08.247908 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6482ba5e-44f3-4c71-b370-671d453e4b64 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 1594 microversion: 2.42 time: 0.157594 Aug 31 16:03:08.248460 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1490/2888] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:03:08 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 1594 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:03:08.256101 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1c255bc2-12f6-493d-b9da-d55bc82ae82e tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Calling method '.version_select at 0x7fbb4ab7e4c0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:08.259517 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1c255bc2-12f6-493d-b9da-d55bc82ae82e tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:08.259993 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1c255bc2-12f6-493d-b9da-d55bc82ae82e tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:08.260424 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1c255bc2-12f6-493d-b9da-d55bc82ae82e tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:08.280755 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1c255bc2-12f6-493d-b9da-d55bc82ae82e tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] 10.222.0.50 "GET /compute/v2.1/os-migrations" status: 200 len: 793 microversion: 2.1 time: 0.027928 Aug 31 16:03:08.282065 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1491/2889] 10.222.0.50 () {58 vars in 1143 bytes} [Wed Aug 31 16:03:08 2022] GET /compute/v2.1/os-migrations => generated 793 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:03:08.289283 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-7b38b85e-b2f0-4119-bb83-3f2a0b0465d9 req-bb2b039e-1e6e-4518-9795-d4ee92d40c4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96bec4d7-3a20-4974-8865-51ef8fd087f6", "tag": "88ac1c93-1d43-4270-990d-911112bbebb5"}, {"name": "network-changed", "server_uuid": "d18fee50-f30d-44c3-9ac5-18aaace88e65", "tag": "f657e99c-7a4f-44d8-93b1-1e4f5d4feb75"}, {"name": "network-changed", "server_uuid": "6bd8b697-3187-47f8-bec9-5784c425a9ce", "tag": "5f2a5d63-d2e4-4ad2-a495-66a5cea1e3ce"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:08.309149 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7b38b85e-b2f0-4119-bb83-3f2a0b0465d9 req-bb2b039e-1e6e-4518-9795-d4ee92d40c4e service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:08.309617 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7b38b85e-b2f0-4119-bb83-3f2a0b0465d9 req-bb2b039e-1e6e-4518-9795-d4ee92d40c4e service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:08.311763 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7b38b85e-b2f0-4119-bb83-3f2a0b0465d9 req-bb2b039e-1e6e-4518-9795-d4ee92d40c4e service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:08.331383 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-7b38b85e-b2f0-4119-bb83-3f2a0b0465d9 req-bb2b039e-1e6e-4518-9795-d4ee92d40c4e service nova] Creating event network-changed:88ac1c93-1d43-4270-990d-911112bbebb5 for instance 96bec4d7-3a20-4974-8865-51ef8fd087f6 on n-h1-833090-16 Aug 31 16:03:08.332130 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-7b38b85e-b2f0-4119-bb83-3f2a0b0465d9 req-bb2b039e-1e6e-4518-9795-d4ee92d40c4e service nova] Creating event network-changed:f657e99c-7a4f-44d8-93b1-1e4f5d4feb75 for instance d18fee50-f30d-44c3-9ac5-18aaace88e65 on n-h2-833090-16 Aug 31 16:03:08.332930 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-7b38b85e-b2f0-4119-bb83-3f2a0b0465d9 req-bb2b039e-1e6e-4518-9795-d4ee92d40c4e service nova] Creating event network-changed:5f2a5d63-d2e4-4ad2-a495-66a5cea1e3ce for instance 6bd8b697-3187-47f8-bec9-5784c425a9ce on n-h2-833090-16 Aug 31 16:03:08.356059 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-7b38b85e-b2f0-4119-bb83-3f2a0b0465d9 req-bb2b039e-1e6e-4518-9795-d4ee92d40c4e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.072128 Aug 31 16:03:08.357059 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1492/2890] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:03:08 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:03:08.370317 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-38821cf7-7afa-4774-a8d5-94af424768f2 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.185"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:08.939768 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-38821cf7-7afa-4774-a8d5-94af424768f2 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] [instance: 6bd8b697-3187-47f8-bec9-5784c425a9ce] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:08.954509 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-38821cf7-7afa-4774-a8d5-94af424768f2 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:08.956132 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-38821cf7-7afa-4774-a8d5-94af424768f2 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:08.957458 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-38821cf7-7afa-4774-a8d5-94af424768f2 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:08.958483 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-38821cf7-7afa-4774-a8d5-94af424768f2 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:08.959382 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-38821cf7-7afa-4774-a8d5-94af424768f2 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:08.960038 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-38821cf7-7afa-4774-a8d5-94af424768f2 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:10.115831 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-38821cf7-7afa-4774-a8d5-94af424768f2 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "refresh_cache-6bd8b697-3187-47f8-bec9-5784c425a9ce" {{(pid=128864) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 16:03:10.116398 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-38821cf7-7afa-4774-a8d5-94af424768f2 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquired lock "refresh_cache-6bd8b697-3187-47f8-bec9-5784c425a9ce" {{(pid=128864) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 16:03:12.831070 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-38821cf7-7afa-4774-a8d5-94af424768f2 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] [instance: 6bd8b697-3187-47f8-bec9-5784c425a9ce] Building network info cache for instance {{(pid=128864) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 31 16:03:13.193016 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-56af0f4c-e7ca-4381-b5b1-da01e362b648 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:03:13.194003 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-56af0f4c-e7ca-4381-b5b1-da01e362b648 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:03:13.194669 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-56af0f4c-e7ca-4381-b5b1-da01e362b648 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:03:13.195890 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-56af0f4c-e7ca-4381-b5b1-da01e362b648 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:03:13.196469 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-56af0f4c-e7ca-4381-b5b1-da01e362b648 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:03:13.212189 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=5 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:03:13.232307 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56af0f4c-e7ca-4381-b5b1-da01e362b648 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:13.232804 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56af0f4c-e7ca-4381-b5b1-da01e362b648 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:13.233272 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56af0f4c-e7ca-4381-b5b1-da01e362b648 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:13.234004 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56af0f4c-e7ca-4381-b5b1-da01e362b648 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:13.234491 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56af0f4c-e7ca-4381-b5b1-da01e362b648 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:13.234911 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56af0f4c-e7ca-4381-b5b1-da01e362b648 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:13.289628 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-56af0f4c-e7ca-4381-b5b1-da01e362b648 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Getting quotas for project c08474001ff6477cb14547afb2b6a72d. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:03:13.303226 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-56af0f4c-e7ca-4381-b5b1-da01e362b648 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Getting quotas for user a9fe7107d5e94104bda2d567394753fe and project c08474001ff6477cb14547afb2b6a72d. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:03:13.634753 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-56af0f4c-e7ca-4381-b5b1-da01e362b648 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:03:13.637580 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-56af0f4c-e7ca-4381-b5b1-da01e362b648 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='93da21cd-a976-48a1-b536-41cc02e681af',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='92bff37b-0f46-4c2a-a700-e2fd346acb61',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='787819a1-f45c-4ffb-b9d8-18eb60b002f8',volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:03:14.355416 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-56af0f4c-e7ca-4381-b5b1-da01e362b648 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 9.226668 Aug 31 16:03:14.359243 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1399/2891] 10.222.0.50 () {62 vars in 1189 bytes} [Wed Aug 31 16:03:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 9231 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 31 16:03:14.380573 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-64ae674c-a113-4335-9b54-c5ff593de143 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:14.382513 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-64ae674c-a113-4335-9b54-c5ff593de143 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: b242124a-1ecd-4762-babd-96246ccb7ceb] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:14.413073 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64ae674c-a113-4335-9b54-c5ff593de143 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:14.413506 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64ae674c-a113-4335-9b54-c5ff593de143 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:14.420519 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64ae674c-a113-4335-9b54-c5ff593de143 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:14.425365 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64ae674c-a113-4335-9b54-c5ff593de143 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:14.429502 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64ae674c-a113-4335-9b54-c5ff593de143 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:14.431439 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64ae674c-a113-4335-9b54-c5ff593de143 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:14.464073 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-38821cf7-7afa-4774-a8d5-94af424768f2 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] [instance: 6bd8b697-3187-47f8-bec9-5784c425a9ce] Updating instance_info_cache with network_info: [{"id": "5f2a5d63-d2e4-4ad2-a495-66a5cea1e3ce", "address": "fa:16:3e:13:9f:d0", "network": {"id": "73c1c7bb-002c-4b7e-9aff-6189e5ddb8fe", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1975144358-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "abd7cf0fb56d40dca0d158268001b107", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap5f2a5d63-d2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128864) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 31 16:03:14.479307 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-38821cf7-7afa-4774-a8d5-94af424768f2 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Releasing lock "refresh_cache-6bd8b697-3187-47f8-bec9-5784c425a9ce" {{(pid=128864) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 16:03:14.480561 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-38821cf7-7afa-4774-a8d5-94af424768f2 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] 10.222.0.50 "POST /compute/v2.1/servers/6bd8b697-3187-47f8-bec9-5784c425a9ce/action" status: 202 len: 0 microversion: 2.1 time: 6.121974 Aug 31 16:03:14.481223 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1493/2892] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:03:08 2022] POST /compute/v2.1/servers/6bd8b697-3187-47f8-bec9-5784c425a9ce/action => generated 0 bytes in 6123 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 31 16:03:14.492692 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f197e84e-2765-4c0d-8be1-7e1cfb2a25dd tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:14.493313 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f197e84e-2765-4c0d-8be1-7e1cfb2a25dd tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] [instance: 96bec4d7-3a20-4974-8865-51ef8fd087f6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:14.508019 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f197e84e-2765-4c0d-8be1-7e1cfb2a25dd tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:14.508642 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f197e84e-2765-4c0d-8be1-7e1cfb2a25dd tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:14.509284 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f197e84e-2765-4c0d-8be1-7e1cfb2a25dd tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:14.510801 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f197e84e-2765-4c0d-8be1-7e1cfb2a25dd tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:14.511298 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f197e84e-2765-4c0d-8be1-7e1cfb2a25dd tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:14.511759 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f197e84e-2765-4c0d-8be1-7e1cfb2a25dd tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:14.997545 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-64ae674c-a113-4335-9b54-c5ff593de143 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:14.999172 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=47 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:03:15.009442 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-64ae674c-a113-4335-9b54-c5ff593de143 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/b242124a-1ecd-4762-babd-96246ccb7ceb" status: 200 len: 1512 microversion: 2.1 time: 0.648468 Aug 31 16:03:15.010109 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1400/2893] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:14 2022] GET /compute/v2.1/servers/b242124a-1ecd-4762-babd-96246ccb7ceb => generated 1512 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:15.027794 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3f333a0e-bb7c-4c1d-9231-ff5e36adb741 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:15.035877 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3f333a0e-bb7c-4c1d-9231-ff5e36adb741 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:15.042514 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f333a0e-bb7c-4c1d-9231-ff5e36adb741 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:15.043013 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f333a0e-bb7c-4c1d-9231-ff5e36adb741 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:15.043498 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f333a0e-bb7c-4c1d-9231-ff5e36adb741 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:15.044204 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f333a0e-bb7c-4c1d-9231-ff5e36adb741 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:15.055719 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f333a0e-bb7c-4c1d-9231-ff5e36adb741 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:15.056190 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f333a0e-bb7c-4c1d-9231-ff5e36adb741 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:15.175864 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f197e84e-2765-4c0d-8be1-7e1cfb2a25dd tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/96bec4d7-3a20-4974-8865-51ef8fd087f6" status: 200 len: 1633 microversion: 2.1 time: 0.690345 Aug 31 16:03:15.179017 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1494/2894] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:14 2022] GET /compute/v2.1/servers/96bec4d7-3a20-4974-8865-51ef8fd087f6 => generated 1633 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:15.185887 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-88e4d4fa-4b94-4465-a995-863c25aa5183 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "52047663-5ab0-46c8-b052-b20da08d1475"}], "security_groups": [{"name": "tempest-securitygroup--495557933"}], "key_name": "tempest-keypair-1523192079", "user_data": "}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:15.521929 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-88e4d4fa-4b94-4465-a995-863c25aa5183 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] validate_networks() for [('52047663-5ab0-46c8-b052-b20da08d1475', None, None, None, None, None)] {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:03:15.712242 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=4 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:03:15.766908 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3f333a0e-bb7c-4c1d-9231-ff5e36adb741 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:15.789426 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3f333a0e-bb7c-4c1d-9231-ff5e36adb741 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:15.792752 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3f333a0e-bb7c-4c1d-9231-ff5e36adb741 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:15.798678 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3f333a0e-bb7c-4c1d-9231-ff5e36adb741 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 1799 microversion: 2.42 time: 0.787428 Aug 31 16:03:15.800276 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1401/2895] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:03:15 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 1799 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:03:15.806695 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-fae69271-6c17-44a0-b7ae-096c0d55472b req-75480fc6-9eb4-40aa-98cf-30df3fcc5f8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bd8b697-3187-47f8-bec9-5784c425a9ce", "tag": "5f2a5d63-d2e4-4ad2-a495-66a5cea1e3ce"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:15.824423 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-fae69271-6c17-44a0-b7ae-096c0d55472b req-75480fc6-9eb4-40aa-98cf-30df3fcc5f8b service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:15.828701 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-fae69271-6c17-44a0-b7ae-096c0d55472b req-75480fc6-9eb4-40aa-98cf-30df3fcc5f8b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:15.830718 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-fae69271-6c17-44a0-b7ae-096c0d55472b req-75480fc6-9eb4-40aa-98cf-30df3fcc5f8b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:15.864905 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-fae69271-6c17-44a0-b7ae-096c0d55472b req-75480fc6-9eb4-40aa-98cf-30df3fcc5f8b service nova] Creating event network-changed:5f2a5d63-d2e4-4ad2-a495-66a5cea1e3ce for instance 6bd8b697-3187-47f8-bec9-5784c425a9ce on n-h2-833090-16 Aug 31 16:03:15.880826 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-fae69271-6c17-44a0-b7ae-096c0d55472b req-75480fc6-9eb4-40aa-98cf-30df3fcc5f8b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078971 Aug 31 16:03:15.883803 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1402/2896] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:03:15.895708 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bba57b14-7e59-4e98-8911-5d8b3ca13d35 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:15.898731 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bba57b14-7e59-4e98-8911-5d8b3ca13d35 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:16.082328 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bba57b14-7e59-4e98-8911-5d8b3ca13d35 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:16.092212 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bba57b14-7e59-4e98-8911-5d8b3ca13d35 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:16.095898 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bba57b14-7e59-4e98-8911-5d8b3ca13d35 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:16.099486 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bba57b14-7e59-4e98-8911-5d8b3ca13d35 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1284 microversion: 2.32 time: 0.214435 Aug 31 16:03:16.102408 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1403/2897] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:03:15 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1284 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:03:16.123395 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c06340dd-e741-41e1-8af8-c99aeb105b99 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:16.127930 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c06340dd-e741-41e1-8af8-c99aeb105b99 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] [instance: 6bd8b697-3187-47f8-bec9-5784c425a9ce] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:16.162494 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c06340dd-e741-41e1-8af8-c99aeb105b99 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:16.163522 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c06340dd-e741-41e1-8af8-c99aeb105b99 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:16.166419 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c06340dd-e741-41e1-8af8-c99aeb105b99 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:16.169780 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c06340dd-e741-41e1-8af8-c99aeb105b99 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:16.170925 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c06340dd-e741-41e1-8af8-c99aeb105b99 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:16.173013 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c06340dd-e741-41e1-8af8-c99aeb105b99 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:16.254551 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c06340dd-e741-41e1-8af8-c99aeb105b99 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] [instance: 6bd8b697-3187-47f8-bec9-5784c425a9ce] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:03:16.466131 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c06340dd-e741-41e1-8af8-c99aeb105b99 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] 10.222.0.50 "DELETE /compute/v2.1/servers/6bd8b697-3187-47f8-bec9-5784c425a9ce" status: 204 len: 0 microversion: 2.1 time: 0.349066 Aug 31 16:03:16.480077 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1404/2898] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:03:16 2022] DELETE /compute/v2.1/servers/6bd8b697-3187-47f8-bec9-5784c425a9ce => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:03:16.507629 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2c35d952-2ae5-4f03-a1e3-32f95aae2591 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Action: 'create', calling method: .version_select at 0x7fbb4645dee0>, body: {"keypair": {"name": "tempest-keypair-1726072840", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrCJuDenAMOhulTWsoEa4yl/TYw0ozCQ2O57b7yibOOxthzz6GyBgPxOSVUq56rEToN0W13qZGtcIo48fr4r1K2GFBuchMIN+dsGzOXIZ5SWDAR15MdMfErJyg5h656uA=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:16.576847 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-2c35d952-2ae5-4f03-a1e3-32f95aae2591 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Getting quotas for project 1355779c2e2d4cfeb0825b76968867b1. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:03:16.634548 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-2c35d952-2ae5-4f03-a1e3-32f95aae2591 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Getting quotas for user b9840c71c4ec49c1a60ef97943d173ef and project 1355779c2e2d4cfeb0825b76968867b1. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:03:16.734611 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2c35d952-2ae5-4f03-a1e3-32f95aae2591 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.251232 Aug 31 16:03:16.736643 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1405/2899] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 31 16:03:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:03:16.753101 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-26384b6c-d304-4e42-8de7-4b85e2f5d6e0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:16.755893 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-26384b6c-d304-4e42-8de7-4b85e2f5d6e0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: b242124a-1ecd-4762-babd-96246ccb7ceb] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:16.770264 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26384b6c-d304-4e42-8de7-4b85e2f5d6e0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:16.772552 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26384b6c-d304-4e42-8de7-4b85e2f5d6e0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:16.774048 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26384b6c-d304-4e42-8de7-4b85e2f5d6e0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:16.775974 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26384b6c-d304-4e42-8de7-4b85e2f5d6e0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:16.778239 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26384b6c-d304-4e42-8de7-4b85e2f5d6e0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:16.779591 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26384b6c-d304-4e42-8de7-4b85e2f5d6e0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:16.868864 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-88e4d4fa-4b94-4465-a995-863c25aa5183 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:03:16.869405 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-88e4d4fa-4b94-4465-a995-863c25aa5183 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:03:16.869881 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-88e4d4fa-4b94-4465-a995-863c25aa5183 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:03:16.870695 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-88e4d4fa-4b94-4465-a995-863c25aa5183 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:03:16.871287 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-88e4d4fa-4b94-4465-a995-863c25aa5183 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:03:16.894121 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-88e4d4fa-4b94-4465-a995-863c25aa5183 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:16.894763 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-88e4d4fa-4b94-4465-a995-863c25aa5183 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:16.895211 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-88e4d4fa-4b94-4465-a995-863c25aa5183 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:16.895961 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-88e4d4fa-4b94-4465-a995-863c25aa5183 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:16.896416 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-88e4d4fa-4b94-4465-a995-863c25aa5183 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:16.896860 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-88e4d4fa-4b94-4465-a995-863c25aa5183 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:16.946633 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-88e4d4fa-4b94-4465-a995-863c25aa5183 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Getting quotas for project dfbd02718e4848ab9e6ff73dbbb469d9. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:03:16.961134 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-88e4d4fa-4b94-4465-a995-863c25aa5183 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Getting quotas for user 250769b38a2d48db928fdc20a8c64d28 and project dfbd02718e4848ab9e6ff73dbbb469d9. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:03:16.992845 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-88e4d4fa-4b94-4465-a995-863c25aa5183 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:03:17.000005 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-88e4d4fa-4b94-4465-a995-863c25aa5183 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] [instance: 23c0eef8-3969-41a5-9da9-4bae125f024f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:03:17.109383 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-26384b6c-d304-4e42-8de7-4b85e2f5d6e0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:17.121970 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-88e4d4fa-4b94-4465-a995-863c25aa5183 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.940022 Aug 31 16:03:17.123923 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1495/2900] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:03:15 2022] POST /compute/v2.1/servers => generated 408 bytes in 1944 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:03:17.126246 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-26384b6c-d304-4e42-8de7-4b85e2f5d6e0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/b242124a-1ecd-4762-babd-96246ccb7ceb" status: 200 len: 1512 microversion: 2.1 time: 0.386872 Aug 31 16:03:17.127734 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1406/2901] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:16 2022] GET /compute/v2.1/servers/b242124a-1ecd-4762-babd-96246ccb7ceb => generated 1512 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:17.130703 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6c68f5d9-74f9-45f0-a693-b0e1e4fdea80 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.185"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:17.134529 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6c68f5d9-74f9-45f0-a693-b0e1e4fdea80 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] [instance: d18fee50-f30d-44c3-9ac5-18aaace88e65] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:17.140812 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-323e9e35-4718-4d82-92e7-881e15c811eb tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:17.141950 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-323e9e35-4718-4d82-92e7-881e15c811eb tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:17.142531 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6c68f5d9-74f9-45f0-a693-b0e1e4fdea80 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:17.143376 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6c68f5d9-74f9-45f0-a693-b0e1e4fdea80 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:17.144459 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6c68f5d9-74f9-45f0-a693-b0e1e4fdea80 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:17.145550 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6c68f5d9-74f9-45f0-a693-b0e1e4fdea80 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:17.146277 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6c68f5d9-74f9-45f0-a693-b0e1e4fdea80 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:17.147046 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6c68f5d9-74f9-45f0-a693-b0e1e4fdea80 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:17.155293 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-323e9e35-4718-4d82-92e7-881e15c811eb tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:17.172136 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-323e9e35-4718-4d82-92e7-881e15c811eb tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:17.172901 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-323e9e35-4718-4d82-92e7-881e15c811eb tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:17.192484 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-323e9e35-4718-4d82-92e7-881e15c811eb tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:17.193013 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-323e9e35-4718-4d82-92e7-881e15c811eb tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:17.193872 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-323e9e35-4718-4d82-92e7-881e15c811eb tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:17.198434 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6c68f5d9-74f9-45f0-a693-b0e1e4fdea80 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "refresh_cache-d18fee50-f30d-44c3-9ac5-18aaace88e65" {{(pid=128864) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 16:03:17.198920 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6c68f5d9-74f9-45f0-a693-b0e1e4fdea80 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquired lock "refresh_cache-d18fee50-f30d-44c3-9ac5-18aaace88e65" {{(pid=128864) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 16:03:17.880953 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-323e9e35-4718-4d82-92e7-881e15c811eb tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:17.901414 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-323e9e35-4718-4d82-92e7-881e15c811eb tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:17.910238 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-323e9e35-4718-4d82-92e7-881e15c811eb tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:17.911487 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-323e9e35-4718-4d82-92e7-881e15c811eb tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 1845 microversion: 2.42 time: 0.782520 Aug 31 16:03:17.912074 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1407/2902] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:03:17 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 1845 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:03:17.928734 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1b80e46d-fbc4-4be6-b16d-5f555066b66e tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:17.929360 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1b80e46d-fbc4-4be6-b16d-5f555066b66e tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:17.952212 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b80e46d-fbc4-4be6-b16d-5f555066b66e tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:17.957760 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b80e46d-fbc4-4be6-b16d-5f555066b66e tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:17.958432 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b80e46d-fbc4-4be6-b16d-5f555066b66e tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:17.959578 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b80e46d-fbc4-4be6-b16d-5f555066b66e tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:17.960348 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b80e46d-fbc4-4be6-b16d-5f555066b66e tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:17.961024 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b80e46d-fbc4-4be6-b16d-5f555066b66e tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:18.304055 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1b80e46d-fbc4-4be6-b16d-5f555066b66e tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:18.333888 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1b80e46d-fbc4-4be6-b16d-5f555066b66e tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:18.337369 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1b80e46d-fbc4-4be6-b16d-5f555066b66e tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:18.347719 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1b80e46d-fbc4-4be6-b16d-5f555066b66e tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1518 microversion: 2.32 time: 0.429340 Aug 31 16:03:18.351980 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1408/2903] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:03:17 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1518 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:03:18.362652 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0e415991-d890-4225-bef9-3ba92acaf3e3 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:18.364436 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0e415991-d890-4225-bef9-3ba92acaf3e3 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] [instance: 23c0eef8-3969-41a5-9da9-4bae125f024f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:18.402295 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e415991-d890-4225-bef9-3ba92acaf3e3 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:18.403678 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e415991-d890-4225-bef9-3ba92acaf3e3 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:18.406043 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e415991-d890-4225-bef9-3ba92acaf3e3 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:18.406928 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e415991-d890-4225-bef9-3ba92acaf3e3 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:18.410076 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e415991-d890-4225-bef9-3ba92acaf3e3 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:18.411222 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e415991-d890-4225-bef9-3ba92acaf3e3 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:18.570025 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0e415991-d890-4225-bef9-3ba92acaf3e3 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250769b38a2d48db928fdc20a8c64d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfbd02718e4848ab9e6ff73dbbb469d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:18.581544 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0e415991-d890-4225-bef9-3ba92acaf3e3 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] 10.222.0.50 "GET /compute/v2.1/servers/23c0eef8-3969-41a5-9da9-4bae125f024f" status: 200 len: 1222 microversion: 2.1 time: 0.228105 Aug 31 16:03:18.584288 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1409/2904] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:18 2022] GET /compute/v2.1/servers/23c0eef8-3969-41a5-9da9-4bae125f024f => generated 1222 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:18.594179 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6a2fd935-cd87-4cd3-923d-e09b0cac6df3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:18.601709 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6a2fd935-cd87-4cd3-923d-e09b0cac6df3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: b242124a-1ecd-4762-babd-96246ccb7ceb] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:18.612504 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a2fd935-cd87-4cd3-923d-e09b0cac6df3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:18.613055 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a2fd935-cd87-4cd3-923d-e09b0cac6df3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:18.613591 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a2fd935-cd87-4cd3-923d-e09b0cac6df3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:18.614731 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a2fd935-cd87-4cd3-923d-e09b0cac6df3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:18.617971 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a2fd935-cd87-4cd3-923d-e09b0cac6df3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:18.618643 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a2fd935-cd87-4cd3-923d-e09b0cac6df3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:19.130317 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6a2fd935-cd87-4cd3-923d-e09b0cac6df3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:19.148091 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6a2fd935-cd87-4cd3-923d-e09b0cac6df3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/b242124a-1ecd-4762-babd-96246ccb7ceb" status: 200 len: 1512 microversion: 2.1 time: 0.562487 Aug 31 16:03:19.160352 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1410/2905] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:18 2022] GET /compute/v2.1/servers/b242124a-1ecd-4762-babd-96246ccb7ceb => generated 1512 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:19.186982 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b135b8c8-8239-4ec8-b571-16f7fc6bae8f tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:19.187904 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b135b8c8-8239-4ec8-b571-16f7fc6bae8f tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:19.196758 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b135b8c8-8239-4ec8-b571-16f7fc6bae8f tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:19.197416 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b135b8c8-8239-4ec8-b571-16f7fc6bae8f tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:19.198022 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b135b8c8-8239-4ec8-b571-16f7fc6bae8f tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:19.198921 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b135b8c8-8239-4ec8-b571-16f7fc6bae8f tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:19.199668 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b135b8c8-8239-4ec8-b571-16f7fc6bae8f tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:19.200314 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b135b8c8-8239-4ec8-b571-16f7fc6bae8f tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:20.355246 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b135b8c8-8239-4ec8-b571-16f7fc6bae8f tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:20.372855 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b135b8c8-8239-4ec8-b571-16f7fc6bae8f tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:20.374530 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b135b8c8-8239-4ec8-b571-16f7fc6bae8f tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:20.375914 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b135b8c8-8239-4ec8-b571-16f7fc6bae8f tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 1845 microversion: 2.42 time: 1.212936 Aug 31 16:03:20.381668 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1411/2906] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:03:19 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 1845 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:03:20.386698 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bff3fa50-85d2-4518-aefb-083e8f9d4346 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:20.403866 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bff3fa50-85d2-4518-aefb-083e8f9d4346 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:20.418062 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bff3fa50-85d2-4518-aefb-083e8f9d4346 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:20.424705 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bff3fa50-85d2-4518-aefb-083e8f9d4346 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:20.427267 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bff3fa50-85d2-4518-aefb-083e8f9d4346 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:20.429153 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bff3fa50-85d2-4518-aefb-083e8f9d4346 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:20.431062 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bff3fa50-85d2-4518-aefb-083e8f9d4346 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:20.432107 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bff3fa50-85d2-4518-aefb-083e8f9d4346 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:20.583292 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bff3fa50-85d2-4518-aefb-083e8f9d4346 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:20.596155 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bff3fa50-85d2-4518-aefb-083e8f9d4346 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:20.598075 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bff3fa50-85d2-4518-aefb-083e8f9d4346 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:20.599550 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bff3fa50-85d2-4518-aefb-083e8f9d4346 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1592 microversion: 2.32 time: 0.216699 Aug 31 16:03:20.600479 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1412/2907] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:03:20 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1592 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:03:20.605720 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-052eaf94-35c9-4f7f-9554-927f9b74cd71 req-568f6b14-c8e8-4c7d-ae74-242faf1179b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e89e500-ddc5-4549-8631-9d62545016d1", "tag": "1caee438-a350-4a78-8297-f52725db29bb"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:20.618235 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-052eaf94-35c9-4f7f-9554-927f9b74cd71 req-568f6b14-c8e8-4c7d-ae74-242faf1179b4 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:20.619076 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-052eaf94-35c9-4f7f-9554-927f9b74cd71 req-568f6b14-c8e8-4c7d-ae74-242faf1179b4 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:20.619834 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-052eaf94-35c9-4f7f-9554-927f9b74cd71 req-568f6b14-c8e8-4c7d-ae74-242faf1179b4 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:20.633476 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-052eaf94-35c9-4f7f-9554-927f9b74cd71 req-568f6b14-c8e8-4c7d-ae74-242faf1179b4 service nova] Creating event network-changed:1caee438-a350-4a78-8297-f52725db29bb for instance 0e89e500-ddc5-4549-8631-9d62545016d1 on n-h2-833090-16 Aug 31 16:03:20.640618 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-052eaf94-35c9-4f7f-9554-927f9b74cd71 req-568f6b14-c8e8-4c7d-ae74-242faf1179b4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038707 Aug 31 16:03:20.641927 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1413/2908] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:03:20.648515 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c81d7b85-0c4a-47e0-96b4-7fd960994f1c tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:20.649676 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c81d7b85-0c4a-47e0-96b4-7fd960994f1c tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] [instance: 23c0eef8-3969-41a5-9da9-4bae125f024f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:20.659124 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c81d7b85-0c4a-47e0-96b4-7fd960994f1c tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:20.660256 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c81d7b85-0c4a-47e0-96b4-7fd960994f1c tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:20.660966 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c81d7b85-0c4a-47e0-96b4-7fd960994f1c tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:20.661925 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c81d7b85-0c4a-47e0-96b4-7fd960994f1c tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:20.662635 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c81d7b85-0c4a-47e0-96b4-7fd960994f1c tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:20.663287 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c81d7b85-0c4a-47e0-96b4-7fd960994f1c tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:20.827693 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c81d7b85-0c4a-47e0-96b4-7fd960994f1c tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250769b38a2d48db928fdc20a8c64d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfbd02718e4848ab9e6ff73dbbb469d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:20.845456 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c81d7b85-0c4a-47e0-96b4-7fd960994f1c tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] 10.222.0.50 "GET /compute/v2.1/servers/23c0eef8-3969-41a5-9da9-4bae125f024f" status: 200 len: 1284 microversion: 2.1 time: 0.201844 Aug 31 16:03:20.848829 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1414/2909] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:20 2022] GET /compute/v2.1/servers/23c0eef8-3969-41a5-9da9-4bae125f024f => generated 1284 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:20.859932 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-089840d2-7501-4348-b2cc-f080a54428d0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:20.863286 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-089840d2-7501-4348-b2cc-f080a54428d0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: b242124a-1ecd-4762-babd-96246ccb7ceb] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:20.876737 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-089840d2-7501-4348-b2cc-f080a54428d0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:20.882781 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-089840d2-7501-4348-b2cc-f080a54428d0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:20.883584 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-089840d2-7501-4348-b2cc-f080a54428d0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:20.885190 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-089840d2-7501-4348-b2cc-f080a54428d0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:20.888072 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-089840d2-7501-4348-b2cc-f080a54428d0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:20.888898 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-089840d2-7501-4348-b2cc-f080a54428d0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:21.400398 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-089840d2-7501-4348-b2cc-f080a54428d0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:21.409712 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-089840d2-7501-4348-b2cc-f080a54428d0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/b242124a-1ecd-4762-babd-96246ccb7ceb" status: 200 len: 1512 microversion: 2.1 time: 0.559628 Aug 31 16:03:21.422832 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1415/2910] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:20 2022] GET /compute/v2.1/servers/b242124a-1ecd-4762-babd-96246ccb7ceb => generated 1512 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:21.432361 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a5071293-6906-4a4d-a1a7-44a0358940a8 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:21.433371 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a5071293-6906-4a4d-a1a7-44a0358940a8 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:21.440695 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5071293-6906-4a4d-a1a7-44a0358940a8 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:21.441656 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5071293-6906-4a4d-a1a7-44a0358940a8 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:21.442336 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5071293-6906-4a4d-a1a7-44a0358940a8 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:21.443473 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5071293-6906-4a4d-a1a7-44a0358940a8 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:21.444143 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5071293-6906-4a4d-a1a7-44a0358940a8 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:21.444774 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5071293-6906-4a4d-a1a7-44a0358940a8 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:21.802559 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a5071293-6906-4a4d-a1a7-44a0358940a8 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:21.820819 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-6c68f5d9-74f9-45f0-a693-b0e1e4fdea80 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] [instance: d18fee50-f30d-44c3-9ac5-18aaace88e65] Building network info cache for instance {{(pid=128864) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 31 16:03:21.822223 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a5071293-6906-4a4d-a1a7-44a0358940a8 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:21.825840 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a5071293-6906-4a4d-a1a7-44a0358940a8 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:21.827267 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a5071293-6906-4a4d-a1a7-44a0358940a8 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 1845 microversion: 2.42 time: 0.400913 Aug 31 16:03:21.837751 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1416/2911] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:03:21 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 1845 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:03:21.843751 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-57188e50-a0f6-44e8-9454-b6bd73666cd1 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:21.849935 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-57188e50-a0f6-44e8-9454-b6bd73666cd1 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:21.862950 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57188e50-a0f6-44e8-9454-b6bd73666cd1 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:21.868252 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57188e50-a0f6-44e8-9454-b6bd73666cd1 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:21.868775 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57188e50-a0f6-44e8-9454-b6bd73666cd1 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:21.869663 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57188e50-a0f6-44e8-9454-b6bd73666cd1 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:21.870306 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57188e50-a0f6-44e8-9454-b6bd73666cd1 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:21.870732 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57188e50-a0f6-44e8-9454-b6bd73666cd1 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:22.063144 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-57188e50-a0f6-44e8-9454-b6bd73666cd1 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:22.078872 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-57188e50-a0f6-44e8-9454-b6bd73666cd1 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:22.080578 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-57188e50-a0f6-44e8-9454-b6bd73666cd1 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:22.084019 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-57188e50-a0f6-44e8-9454-b6bd73666cd1 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1592 microversion: 2.32 time: 0.244960 Aug 31 16:03:22.093581 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1417/2912] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:03:21 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1592 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:03:22.099182 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-8162af1f-5b54-4cc5-84cc-424773b3ca5f req-fa078a80-be9e-496c-8415-dfdd75c7db52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d18fee50-f30d-44c3-9ac5-18aaace88e65", "tag": "f657e99c-7a4f-44d8-93b1-1e4f5d4feb75"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:22.120106 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8162af1f-5b54-4cc5-84cc-424773b3ca5f req-fa078a80-be9e-496c-8415-dfdd75c7db52 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:22.120969 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8162af1f-5b54-4cc5-84cc-424773b3ca5f req-fa078a80-be9e-496c-8415-dfdd75c7db52 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:22.121652 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8162af1f-5b54-4cc5-84cc-424773b3ca5f req-fa078a80-be9e-496c-8415-dfdd75c7db52 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:22.155260 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-8162af1f-5b54-4cc5-84cc-424773b3ca5f req-fa078a80-be9e-496c-8415-dfdd75c7db52 service nova] Creating event network-changed:f657e99c-7a4f-44d8-93b1-1e4f5d4feb75 for instance d18fee50-f30d-44c3-9ac5-18aaace88e65 on n-h2-833090-16 Aug 31 16:03:22.165626 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-8162af1f-5b54-4cc5-84cc-424773b3ca5f req-fa078a80-be9e-496c-8415-dfdd75c7db52 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070283 Aug 31 16:03:22.166628 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1418/2913] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:03:22.171898 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1c0d846d-d8b2-47bb-b3b8-4ed15a161048 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:22.179963 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1c0d846d-d8b2-47bb-b3b8-4ed15a161048 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] [instance: 23c0eef8-3969-41a5-9da9-4bae125f024f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:22.196492 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c0d846d-d8b2-47bb-b3b8-4ed15a161048 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:22.198017 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c0d846d-d8b2-47bb-b3b8-4ed15a161048 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:22.198490 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c0d846d-d8b2-47bb-b3b8-4ed15a161048 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:22.201049 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c0d846d-d8b2-47bb-b3b8-4ed15a161048 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:22.201522 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c0d846d-d8b2-47bb-b3b8-4ed15a161048 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:22.202283 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c0d846d-d8b2-47bb-b3b8-4ed15a161048 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:22.336359 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1c0d846d-d8b2-47bb-b3b8-4ed15a161048 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250769b38a2d48db928fdc20a8c64d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfbd02718e4848ab9e6ff73dbbb469d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:22.346409 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:03:22.356474 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1c0d846d-d8b2-47bb-b3b8-4ed15a161048 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] 10.222.0.50 "GET /compute/v2.1/servers/23c0eef8-3969-41a5-9da9-4bae125f024f" status: 200 len: 1284 microversion: 2.1 time: 0.185206 Aug 31 16:03:22.372191 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1419/2914] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:22 2022] GET /compute/v2.1/servers/23c0eef8-3969-41a5-9da9-4bae125f024f => generated 1284 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:22.433018 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a79eb66a-2e2e-4405-ba21-e02236333100 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:22.434611 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a79eb66a-2e2e-4405-ba21-e02236333100 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: b242124a-1ecd-4762-babd-96246ccb7ceb] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:22.446786 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a79eb66a-2e2e-4405-ba21-e02236333100 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:22.447358 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a79eb66a-2e2e-4405-ba21-e02236333100 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:22.447788 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a79eb66a-2e2e-4405-ba21-e02236333100 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:22.448493 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a79eb66a-2e2e-4405-ba21-e02236333100 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:22.448944 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a79eb66a-2e2e-4405-ba21-e02236333100 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:22.449359 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a79eb66a-2e2e-4405-ba21-e02236333100 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:22.904721 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a79eb66a-2e2e-4405-ba21-e02236333100 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:22.913522 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a79eb66a-2e2e-4405-ba21-e02236333100 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/b242124a-1ecd-4762-babd-96246ccb7ceb" status: 200 len: 1512 microversion: 2.1 time: 0.484596 Aug 31 16:03:22.914144 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1420/2915] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:22 2022] GET /compute/v2.1/servers/b242124a-1ecd-4762-babd-96246ccb7ceb => generated 1512 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:03:22.932798 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5d832e3e-13e4-45e7-ba15-52d99f3d18be tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:22.933419 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5d832e3e-13e4-45e7-ba15-52d99f3d18be tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:22.950040 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d832e3e-13e4-45e7-ba15-52d99f3d18be tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:22.951292 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d832e3e-13e4-45e7-ba15-52d99f3d18be tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:22.954050 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d832e3e-13e4-45e7-ba15-52d99f3d18be tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:22.955025 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d832e3e-13e4-45e7-ba15-52d99f3d18be tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:22.959033 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d832e3e-13e4-45e7-ba15-52d99f3d18be tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:22.959735 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d832e3e-13e4-45e7-ba15-52d99f3d18be tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:23.122769 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-6c68f5d9-74f9-45f0-a693-b0e1e4fdea80 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] [instance: d18fee50-f30d-44c3-9ac5-18aaace88e65] Updating instance_info_cache with network_info: [{"id": "f657e99c-7a4f-44d8-93b1-1e4f5d4feb75", "address": "fa:16:3e:e5:79:5b", "network": {"id": "73c1c7bb-002c-4b7e-9aff-6189e5ddb8fe", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1975144358-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "abd7cf0fb56d40dca0d158268001b107", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf657e99c-7a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128864) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 31 16:03:23.143099 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6c68f5d9-74f9-45f0-a693-b0e1e4fdea80 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Releasing lock "refresh_cache-d18fee50-f30d-44c3-9ac5-18aaace88e65" {{(pid=128864) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 16:03:23.146417 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6c68f5d9-74f9-45f0-a693-b0e1e4fdea80 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] 10.222.0.50 "POST /compute/v2.1/servers/d18fee50-f30d-44c3-9ac5-18aaace88e65/action" status: 202 len: 0 microversion: 2.1 time: 6.019540 Aug 31 16:03:23.151108 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1496/2916] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:03:17 2022] POST /compute/v2.1/servers/d18fee50-f30d-44c3-9ac5-18aaace88e65/action => generated 0 bytes in 6026 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 31 16:03:23.157460 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d65782a0-e08a-487e-bccc-3f4d9426fa1f tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:23.158610 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d65782a0-e08a-487e-bccc-3f4d9426fa1f tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:23.165950 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d65782a0-e08a-487e-bccc-3f4d9426fa1f tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:23.166949 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d65782a0-e08a-487e-bccc-3f4d9426fa1f tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:23.167673 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d65782a0-e08a-487e-bccc-3f4d9426fa1f tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:23.168906 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d65782a0-e08a-487e-bccc-3f4d9426fa1f tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:23.169685 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d65782a0-e08a-487e-bccc-3f4d9426fa1f tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:23.170385 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d65782a0-e08a-487e-bccc-3f4d9426fa1f tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:23.271415 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:03:23.376798 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d65782a0-e08a-487e-bccc-3f4d9426fa1f tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:23.411855 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d65782a0-e08a-487e-bccc-3f4d9426fa1f tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:23.420889 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d65782a0-e08a-487e-bccc-3f4d9426fa1f tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:23.427226 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d65782a0-e08a-487e-bccc-3f4d9426fa1f tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1592 microversion: 2.32 time: 0.273418 Aug 31 16:03:23.430826 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1497/2917] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:03:23 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1592 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:03:23.465907 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3f2ceb2f-9d92-42b2-a440-bf7a140506ec tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Calling method '.version_select at 0x7fbb460a8700>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:24.014282 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5d832e3e-13e4-45e7-ba15-52d99f3d18be tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:24.024450 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5d832e3e-13e4-45e7-ba15-52d99f3d18be tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:24.029741 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5d832e3e-13e4-45e7-ba15-52d99f3d18be tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:24.045481 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5d832e3e-13e4-45e7-ba15-52d99f3d18be tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 1866 microversion: 2.42 time: 1.108265 Aug 31 16:03:24.045481 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1421/2918] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:03:22 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 1866 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:03:24.059395 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-22b1f1b6-3385-4e8a-ab7e-ffc17863ee2d tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:24.065917 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-22b1f1b6-3385-4e8a-ab7e-ffc17863ee2d tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] [instance: 23c0eef8-3969-41a5-9da9-4bae125f024f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:24.100978 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-22b1f1b6-3385-4e8a-ab7e-ffc17863ee2d tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:24.101491 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-22b1f1b6-3385-4e8a-ab7e-ffc17863ee2d tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:24.105776 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-22b1f1b6-3385-4e8a-ab7e-ffc17863ee2d tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:24.107005 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-22b1f1b6-3385-4e8a-ab7e-ffc17863ee2d tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:24.111103 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-22b1f1b6-3385-4e8a-ab7e-ffc17863ee2d tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:24.113325 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-22b1f1b6-3385-4e8a-ab7e-ffc17863ee2d tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:24.378364 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3f2ceb2f-9d92-42b2-a440-bf7a140506ec tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] 10.222.0.50 "GET /compute/v2.1/os-floating-ips/ec1b763e-fe2e-4eed-ad10-7c2d93813728" status: 200 len: 185 microversion: 2.1 time: 0.943672 Aug 31 16:03:24.386279 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1498/2919] 10.222.0.50 () {58 vars in 1260 bytes} [Wed Aug 31 16:03:23 2022] GET /compute/v2.1/os-floating-ips/ec1b763e-fe2e-4eed-ad10-7c2d93813728 => generated 185 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:03:24.391522 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-335cc853-b716-458b-a0dc-56e1fa3a4625 req-2e018047-0083-4280-8c05-33db4d86b877 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bd8b697-3187-47f8-bec9-5784c425a9ce", "name": "network-vif-deleted", "tag": "5f2a5d63-d2e4-4ad2-a495-66a5cea1e3ce"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:24.423720 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-335cc853-b716-458b-a0dc-56e1fa3a4625 req-2e018047-0083-4280-8c05-33db4d86b877 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:24.424438 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-335cc853-b716-458b-a0dc-56e1fa3a4625 req-2e018047-0083-4280-8c05-33db4d86b877 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:24.425062 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-335cc853-b716-458b-a0dc-56e1fa3a4625 req-2e018047-0083-4280-8c05-33db4d86b877 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:24.442495 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-335cc853-b716-458b-a0dc-56e1fa3a4625 req-2e018047-0083-4280-8c05-33db4d86b877 service nova] Creating event network-vif-deleted:5f2a5d63-d2e4-4ad2-a495-66a5cea1e3ce for instance 6bd8b697-3187-47f8-bec9-5784c425a9ce on n-h2-833090-16 Aug 31 16:03:24.459250 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-335cc853-b716-458b-a0dc-56e1fa3a4625 req-2e018047-0083-4280-8c05-33db4d86b877 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071002 Aug 31 16:03:24.460189 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1499/2920] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:03:24.469919 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-dcdd53df-7eb3-4938-ae7e-1c6744888289 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:24.479103 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-dcdd53df-7eb3-4938-ae7e-1c6744888289 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: b242124a-1ecd-4762-babd-96246ccb7ceb] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:24.492709 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dcdd53df-7eb3-4938-ae7e-1c6744888289 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:24.493743 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dcdd53df-7eb3-4938-ae7e-1c6744888289 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:24.494430 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dcdd53df-7eb3-4938-ae7e-1c6744888289 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:24.495340 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dcdd53df-7eb3-4938-ae7e-1c6744888289 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:24.495981 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dcdd53df-7eb3-4938-ae7e-1c6744888289 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:24.496590 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dcdd53df-7eb3-4938-ae7e-1c6744888289 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:25.207362 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-dcdd53df-7eb3-4938-ae7e-1c6744888289 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:25.218564 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-dcdd53df-7eb3-4938-ae7e-1c6744888289 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/b242124a-1ecd-4762-babd-96246ccb7ceb" status: 200 len: 1489 microversion: 2.1 time: 0.756922 Aug 31 16:03:25.219181 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1500/2921] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:24 2022] GET /compute/v2.1/servers/b242124a-1ecd-4762-babd-96246ccb7ceb => generated 1489 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:25.230925 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b6c9e4f3-da7d-4c49-b4f3-89dd4e75f9fd tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.185"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:25.244133 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-22b1f1b6-3385-4e8a-ab7e-ffc17863ee2d tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250769b38a2d48db928fdc20a8c64d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfbd02718e4848ab9e6ff73dbbb469d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:25.254406 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-22b1f1b6-3385-4e8a-ab7e-ffc17863ee2d tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] 10.222.0.50 "GET /compute/v2.1/servers/23c0eef8-3969-41a5-9da9-4bae125f024f" status: 200 len: 1351 microversion: 2.1 time: 1.213553 Aug 31 16:03:25.272451 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1422/2922] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:24 2022] GET /compute/v2.1/servers/23c0eef8-3969-41a5-9da9-4bae125f024f => generated 1351 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:25.279362 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3e83b2bc-ecfd-4052-aee6-9dbd361e7cf9 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:25.280379 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3e83b2bc-ecfd-4052-aee6-9dbd361e7cf9 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:25.287791 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e83b2bc-ecfd-4052-aee6-9dbd361e7cf9 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:25.288556 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e83b2bc-ecfd-4052-aee6-9dbd361e7cf9 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:25.289250 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e83b2bc-ecfd-4052-aee6-9dbd361e7cf9 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:25.290255 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e83b2bc-ecfd-4052-aee6-9dbd361e7cf9 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:25.290922 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e83b2bc-ecfd-4052-aee6-9dbd361e7cf9 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:25.291615 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e83b2bc-ecfd-4052-aee6-9dbd361e7cf9 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:25.521412 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b6c9e4f3-da7d-4c49-b4f3-89dd4e75f9fd tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] [instance: d18fee50-f30d-44c3-9ac5-18aaace88e65] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:25.527933 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b6c9e4f3-da7d-4c49-b4f3-89dd4e75f9fd tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:25.528426 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b6c9e4f3-da7d-4c49-b4f3-89dd4e75f9fd tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:25.528862 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b6c9e4f3-da7d-4c49-b4f3-89dd4e75f9fd tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:25.530459 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b6c9e4f3-da7d-4c49-b4f3-89dd4e75f9fd tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:25.531119 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b6c9e4f3-da7d-4c49-b4f3-89dd4e75f9fd tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:25.531920 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b6c9e4f3-da7d-4c49-b4f3-89dd4e75f9fd tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:25.544420 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=87,nova_cell1:SAVEPOINT=4,nova_cell1:UPDATE=4,nova_cell1:RELEASE=4,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:03:25.708832 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3e83b2bc-ecfd-4052-aee6-9dbd361e7cf9 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:25.721444 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3e83b2bc-ecfd-4052-aee6-9dbd361e7cf9 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:25.723401 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3e83b2bc-ecfd-4052-aee6-9dbd361e7cf9 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:25.724815 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3e83b2bc-ecfd-4052-aee6-9dbd361e7cf9 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1660 microversion: 2.32 time: 0.450940 Aug 31 16:03:25.726142 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1423/2923] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:03:25 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1660 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:03:25.732613 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dada820f-42e2-484f-8117-9b63ecc1985b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:25.733413 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dada820f-42e2-484f-8117-9b63ecc1985b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:25.740848 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dada820f-42e2-484f-8117-9b63ecc1985b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:25.741550 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dada820f-42e2-484f-8117-9b63ecc1985b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:25.742261 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dada820f-42e2-484f-8117-9b63ecc1985b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:25.743220 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dada820f-42e2-484f-8117-9b63ecc1985b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:25.743820 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dada820f-42e2-484f-8117-9b63ecc1985b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:25.744513 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dada820f-42e2-484f-8117-9b63ecc1985b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:26.034469 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b6c9e4f3-da7d-4c49-b4f3-89dd4e75f9fd tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "refresh_cache-d18fee50-f30d-44c3-9ac5-18aaace88e65" {{(pid=128864) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 16:03:26.035149 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b6c9e4f3-da7d-4c49-b4f3-89dd4e75f9fd tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquired lock "refresh_cache-d18fee50-f30d-44c3-9ac5-18aaace88e65" {{(pid=128864) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 16:03:26.211719 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dada820f-42e2-484f-8117-9b63ecc1985b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:26.231750 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dada820f-42e2-484f-8117-9b63ecc1985b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:26.233483 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dada820f-42e2-484f-8117-9b63ecc1985b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:26.241142 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dada820f-42e2-484f-8117-9b63ecc1985b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 1887 microversion: 2.42 time: 0.513649 Aug 31 16:03:26.242573 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1424/2924] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:03:25 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 1887 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:03:26.259479 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f4e17997-2c19-4b45-842b-ed6b10470a00 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:26.263305 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f4e17997-2c19-4b45-842b-ed6b10470a00 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:26.274809 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4e17997-2c19-4b45-842b-ed6b10470a00 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:26.275330 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4e17997-2c19-4b45-842b-ed6b10470a00 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:26.284472 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4e17997-2c19-4b45-842b-ed6b10470a00 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:26.285312 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4e17997-2c19-4b45-842b-ed6b10470a00 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:26.286003 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4e17997-2c19-4b45-842b-ed6b10470a00 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:26.286686 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4e17997-2c19-4b45-842b-ed6b10470a00 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:26.375096 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f4e17997-2c19-4b45-842b-ed6b10470a00 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "POST /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b/action" status: 200 len: 149 microversion: 2.1 time: 0.130859 Aug 31 16:03:26.375755 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1425/2925] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:03:26 2022] POST /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b/action => generated 149 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:03:26.384712 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-03ffd0ea-4ee0-41a0-8b4a-fe41c1fd826c tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-164970816", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "39370b19-7cbc-4e21-9ace-fa993a5e662f"}], "security_groups": [{"name": "tempest-securitygroup--316847261"}], "key_name": "tempest-keypair-1726072840", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:26.672047 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=18 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:03:26.730926 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-03ffd0ea-4ee0-41a0-8b4a-fe41c1fd826c tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] validate_networks() for [('39370b19-7cbc-4e21-9ace-fa993a5e662f', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:03:26.920467 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:03:26.975869 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=6 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:03:27.983614 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-b6c9e4f3-da7d-4c49-b4f3-89dd4e75f9fd tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] [instance: d18fee50-f30d-44c3-9ac5-18aaace88e65] Building network info cache for instance {{(pid=128864) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 31 16:03:28.008292 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-03ffd0ea-4ee0-41a0-8b4a-fe41c1fd826c tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:03:28.008800 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-03ffd0ea-4ee0-41a0-8b4a-fe41c1fd826c tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:03:28.012497 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-03ffd0ea-4ee0-41a0-8b4a-fe41c1fd826c tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:03:28.014017 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-03ffd0ea-4ee0-41a0-8b4a-fe41c1fd826c tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:03:28.015083 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-03ffd0ea-4ee0-41a0-8b4a-fe41c1fd826c tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:03:28.046589 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03ffd0ea-4ee0-41a0-8b4a-fe41c1fd826c tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:28.052573 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03ffd0ea-4ee0-41a0-8b4a-fe41c1fd826c tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:28.054129 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03ffd0ea-4ee0-41a0-8b4a-fe41c1fd826c tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:28.061943 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03ffd0ea-4ee0-41a0-8b4a-fe41c1fd826c tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:28.062922 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03ffd0ea-4ee0-41a0-8b4a-fe41c1fd826c tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:28.064164 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03ffd0ea-4ee0-41a0-8b4a-fe41c1fd826c tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:28.146714 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-03ffd0ea-4ee0-41a0-8b4a-fe41c1fd826c tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Getting quotas for project 1355779c2e2d4cfeb0825b76968867b1. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:03:28.174270 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-03ffd0ea-4ee0-41a0-8b4a-fe41c1fd826c tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Getting quotas for user b9840c71c4ec49c1a60ef97943d173ef and project 1355779c2e2d4cfeb0825b76968867b1. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:03:28.209875 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-03ffd0ea-4ee0-41a0-8b4a-fe41c1fd826c tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:03:28.232149 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-03ffd0ea-4ee0-41a0-8b4a-fe41c1fd826c tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:03:28.308358 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:03:28.380721 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-03ffd0ea-4ee0-41a0-8b4a-fe41c1fd826c tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.003511 Aug 31 16:03:28.385991 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1426/2926] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:03:26 2022] POST /compute/v2.1/servers => generated 405 bytes in 2009 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:03:28.400653 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-628e6cd5-59ba-486e-ae78-f219a18bbb01 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:28.402962 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-628e6cd5-59ba-486e-ae78-f219a18bbb01 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] [instance: 23c0eef8-3969-41a5-9da9-4bae125f024f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:28.418049 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-628e6cd5-59ba-486e-ae78-f219a18bbb01 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:28.423558 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-628e6cd5-59ba-486e-ae78-f219a18bbb01 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:28.424923 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-628e6cd5-59ba-486e-ae78-f219a18bbb01 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:28.427614 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-628e6cd5-59ba-486e-ae78-f219a18bbb01 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:28.428312 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-628e6cd5-59ba-486e-ae78-f219a18bbb01 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:28.429974 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-628e6cd5-59ba-486e-ae78-f219a18bbb01 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:29.692861 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-628e6cd5-59ba-486e-ae78-f219a18bbb01 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250769b38a2d48db928fdc20a8c64d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfbd02718e4848ab9e6ff73dbbb469d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:29.707200 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-628e6cd5-59ba-486e-ae78-f219a18bbb01 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] 10.222.0.50 "GET /compute/v2.1/servers/23c0eef8-3969-41a5-9da9-4bae125f024f" status: 200 len: 1351 microversion: 2.1 time: 1.319758 Aug 31 16:03:29.710867 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1427/2927] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:28 2022] GET /compute/v2.1/servers/23c0eef8-3969-41a5-9da9-4bae125f024f => generated 1351 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:29.720395 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-51b0a8fa-074d-4080-9c13-20f26b941a04 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:29.727320 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-51b0a8fa-074d-4080-9c13-20f26b941a04 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:29.744293 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-51b0a8fa-074d-4080-9c13-20f26b941a04 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:29.745596 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-51b0a8fa-074d-4080-9c13-20f26b941a04 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:29.748550 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-51b0a8fa-074d-4080-9c13-20f26b941a04 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:29.751575 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-51b0a8fa-074d-4080-9c13-20f26b941a04 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:29.752397 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-51b0a8fa-074d-4080-9c13-20f26b941a04 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:29.754172 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-51b0a8fa-074d-4080-9c13-20f26b941a04 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:30.247352 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-51b0a8fa-074d-4080-9c13-20f26b941a04 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:30.257534 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-51b0a8fa-074d-4080-9c13-20f26b941a04 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1671 microversion: 2.1 time: 0.544832 Aug 31 16:03:30.264762 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1428/2928] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:29 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1671 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:30.270404 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-be242274-85ca-467e-83dd-414549106e89 req-7f8a1cbd-496f-4c32-a98d-a46b865f641b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e89e500-ddc5-4549-8631-9d62545016d1", "tag": "505cceaf-e4cc-4b2b-8615-77bc0c7bf80e"}, {"name": "network-changed", "server_uuid": "0e89e500-ddc5-4549-8631-9d62545016d1", "tag": "3445d58d-1bed-4c5b-82a7-a81a67db5f67"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:30.296470 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-be242274-85ca-467e-83dd-414549106e89 req-7f8a1cbd-496f-4c32-a98d-a46b865f641b service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:30.306903 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-be242274-85ca-467e-83dd-414549106e89 req-7f8a1cbd-496f-4c32-a98d-a46b865f641b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:30.307961 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-be242274-85ca-467e-83dd-414549106e89 req-7f8a1cbd-496f-4c32-a98d-a46b865f641b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:30.322208 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-be242274-85ca-467e-83dd-414549106e89 req-7f8a1cbd-496f-4c32-a98d-a46b865f641b service nova] Creating event network-changed:505cceaf-e4cc-4b2b-8615-77bc0c7bf80e for instance 0e89e500-ddc5-4549-8631-9d62545016d1 on n-h2-833090-16 Aug 31 16:03:30.335004 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-be242274-85ca-467e-83dd-414549106e89 req-7f8a1cbd-496f-4c32-a98d-a46b865f641b service nova] Creating event network-changed:3445d58d-1bed-4c5b-82a7-a81a67db5f67 for instance 0e89e500-ddc5-4549-8631-9d62545016d1 on n-h2-833090-16 Aug 31 16:03:30.340876 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-be242274-85ca-467e-83dd-414549106e89 req-7f8a1cbd-496f-4c32-a98d-a46b865f641b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.074564 Aug 31 16:03:30.342125 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1429/2929] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:03:30 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:03:30.347702 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0ec73184-9532-4c88-90f6-0d16fa6d86dc tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:30.354645 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0ec73184-9532-4c88-90f6-0d16fa6d86dc tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:30.375965 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ec73184-9532-4c88-90f6-0d16fa6d86dc tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:30.376585 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ec73184-9532-4c88-90f6-0d16fa6d86dc tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:30.377250 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ec73184-9532-4c88-90f6-0d16fa6d86dc tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:30.378046 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ec73184-9532-4c88-90f6-0d16fa6d86dc tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:30.378765 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ec73184-9532-4c88-90f6-0d16fa6d86dc tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:30.379526 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ec73184-9532-4c88-90f6-0d16fa6d86dc tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:30.763889 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0ec73184-9532-4c88-90f6-0d16fa6d86dc tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:30.783823 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0ec73184-9532-4c88-90f6-0d16fa6d86dc tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:30.787901 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0ec73184-9532-4c88-90f6-0d16fa6d86dc tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:30.790079 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0ec73184-9532-4c88-90f6-0d16fa6d86dc tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1754 microversion: 2.32 time: 0.446147 Aug 31 16:03:30.791245 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1430/2930] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:03:30 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1754 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:03:30.798621 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-aa8af763-60e2-4899-8c27-e66eebf34b65 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:30.800663 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-aa8af763-60e2-4899-8c27-e66eebf34b65 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:30.807707 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-b6c9e4f3-da7d-4c49-b4f3-89dd4e75f9fd tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] [instance: d18fee50-f30d-44c3-9ac5-18aaace88e65] Updating instance_info_cache with network_info: [{"id": "f657e99c-7a4f-44d8-93b1-1e4f5d4feb75", "address": "fa:16:3e:e5:79:5b", "network": {"id": "73c1c7bb-002c-4b7e-9aff-6189e5ddb8fe", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1975144358-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "abd7cf0fb56d40dca0d158268001b107", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf657e99c-7a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128864) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 31 16:03:30.812018 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa8af763-60e2-4899-8c27-e66eebf34b65 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:30.813785 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa8af763-60e2-4899-8c27-e66eebf34b65 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:30.815487 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa8af763-60e2-4899-8c27-e66eebf34b65 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:30.816994 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa8af763-60e2-4899-8c27-e66eebf34b65 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:30.819553 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa8af763-60e2-4899-8c27-e66eebf34b65 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:30.821322 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa8af763-60e2-4899-8c27-e66eebf34b65 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:30.828371 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b6c9e4f3-da7d-4c49-b4f3-89dd4e75f9fd tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Releasing lock "refresh_cache-d18fee50-f30d-44c3-9ac5-18aaace88e65" {{(pid=128864) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 16:03:30.829408 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b6c9e4f3-da7d-4c49-b4f3-89dd4e75f9fd tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] 10.222.0.50 "POST /compute/v2.1/servers/d18fee50-f30d-44c3-9ac5-18aaace88e65/action" status: 202 len: 0 microversion: 2.1 time: 5.602809 Aug 31 16:03:30.830371 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1501/2931] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:03:25 2022] POST /compute/v2.1/servers/d18fee50-f30d-44c3-9ac5-18aaace88e65/action => generated 0 bytes in 5604 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 31 16:03:30.838729 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-a4d7d19b-5321-4a29-a4db-60402ec3291e req-025fa61d-8361-424f-afa7-45b1ecb534af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d18fee50-f30d-44c3-9ac5-18aaace88e65", "tag": "f657e99c-7a4f-44d8-93b1-1e4f5d4feb75"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:30.853276 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=4 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:03:30.864078 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-a4d7d19b-5321-4a29-a4db-60402ec3291e req-025fa61d-8361-424f-afa7-45b1ecb534af service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:30.865146 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-a4d7d19b-5321-4a29-a4db-60402ec3291e req-025fa61d-8361-424f-afa7-45b1ecb534af service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:30.867683 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-a4d7d19b-5321-4a29-a4db-60402ec3291e req-025fa61d-8361-424f-afa7-45b1ecb534af service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:30.887517 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-a4d7d19b-5321-4a29-a4db-60402ec3291e req-025fa61d-8361-424f-afa7-45b1ecb534af service nova] Creating event network-changed:f657e99c-7a4f-44d8-93b1-1e4f5d4feb75 for instance d18fee50-f30d-44c3-9ac5-18aaace88e65 on n-h2-833090-16 Aug 31 16:03:30.894856 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-a4d7d19b-5321-4a29-a4db-60402ec3291e req-025fa61d-8361-424f-afa7-45b1ecb534af service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062256 Aug 31 16:03:30.895861 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1502/2932] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:03:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:03:30.903728 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4adf83dc-eed0-4c16-997c-79b1331efefa tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:30.904721 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4adf83dc-eed0-4c16-997c-79b1331efefa tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:30.914664 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4adf83dc-eed0-4c16-997c-79b1331efefa tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:30.915597 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4adf83dc-eed0-4c16-997c-79b1331efefa tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:30.916292 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4adf83dc-eed0-4c16-997c-79b1331efefa tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:30.917161 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4adf83dc-eed0-4c16-997c-79b1331efefa tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:30.918012 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4adf83dc-eed0-4c16-997c-79b1331efefa tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:30.918732 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4adf83dc-eed0-4c16-997c-79b1331efefa tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:31.073240 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4adf83dc-eed0-4c16-997c-79b1331efefa tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:31.085012 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4adf83dc-eed0-4c16-997c-79b1331efefa tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc" status: 200 len: 1292 microversion: 2.1 time: 0.187691 Aug 31 16:03:31.086262 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1503/2933] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:30 2022] GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc => generated 1292 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:31.091908 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-67b1cdb9-fc3d-4384-85b3-5996bdd6fe25 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:31.092722 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-67b1cdb9-fc3d-4384-85b3-5996bdd6fe25 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:31.100461 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-67b1cdb9-fc3d-4384-85b3-5996bdd6fe25 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:31.101532 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-67b1cdb9-fc3d-4384-85b3-5996bdd6fe25 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:31.102240 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-67b1cdb9-fc3d-4384-85b3-5996bdd6fe25 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:31.103156 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-67b1cdb9-fc3d-4384-85b3-5996bdd6fe25 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:31.103859 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-67b1cdb9-fc3d-4384-85b3-5996bdd6fe25 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:31.104478 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-67b1cdb9-fc3d-4384-85b3-5996bdd6fe25 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:31.401344 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-aa8af763-60e2-4899-8c27-e66eebf34b65 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:31.415404 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-aa8af763-60e2-4899-8c27-e66eebf34b65 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:31.417397 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-aa8af763-60e2-4899-8c27-e66eebf34b65 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:31.418862 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-aa8af763-60e2-4899-8c27-e66eebf34b65 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 1887 microversion: 2.42 time: 0.626184 Aug 31 16:03:31.419439 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1431/2934] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:03:30 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 1887 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:03:31.425368 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5c471680-3caa-46e7-b36a-f27179f6621f tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:31.426325 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5c471680-3caa-46e7-b36a-f27179f6621f tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] [instance: 23c0eef8-3969-41a5-9da9-4bae125f024f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:31.432857 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c471680-3caa-46e7-b36a-f27179f6621f tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:31.433641 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c471680-3caa-46e7-b36a-f27179f6621f tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:31.434354 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c471680-3caa-46e7-b36a-f27179f6621f tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:31.435278 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c471680-3caa-46e7-b36a-f27179f6621f tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:31.435987 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c471680-3caa-46e7-b36a-f27179f6621f tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:31.436623 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c471680-3caa-46e7-b36a-f27179f6621f tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:31.537219 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-67b1cdb9-fc3d-4384-85b3-5996bdd6fe25 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:31.546629 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-67b1cdb9-fc3d-4384-85b3-5996bdd6fe25 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1671 microversion: 2.1 time: 0.458844 Aug 31 16:03:31.547820 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1504/2935] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:31 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1671 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:31.553761 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f9ba2b62-d28c-4a34-a9fa-8264f6f2eb39 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:31.554673 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f9ba2b62-d28c-4a34-a9fa-8264f6f2eb39 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] [instance: 6bd8b697-3187-47f8-bec9-5784c425a9ce] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:31.563183 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f9ba2b62-d28c-4a34-a9fa-8264f6f2eb39 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:31.565014 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f9ba2b62-d28c-4a34-a9fa-8264f6f2eb39 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:31.566279 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f9ba2b62-d28c-4a34-a9fa-8264f6f2eb39 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:31.567359 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f9ba2b62-d28c-4a34-a9fa-8264f6f2eb39 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:31.567973 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f9ba2b62-d28c-4a34-a9fa-8264f6f2eb39 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:31.568495 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f9ba2b62-d28c-4a34-a9fa-8264f6f2eb39 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:31.593523 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-f9ba2b62-d28c-4a34-a9fa-8264f6f2eb39 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] HTTP exception thrown: Instance 6bd8b697-3187-47f8-bec9-5784c425a9ce could not be found. Aug 31 16:03:31.595276 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f9ba2b62-d28c-4a34-a9fa-8264f6f2eb39 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Request method failure captured: Aug 31 16:03:31.595276 n-d-833090-16 devstack@n-api.service[128864]: request: DELETE /compute/v2.1/servers/6bd8b697-3187-47f8-bec9-5784c425a9ce HTTP/1.1 Aug 31 16:03:31.595276 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:03:31.595276 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:03:31.595276 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:03:31.595276 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:03:31.595276 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:03:31.595276 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:03:31.595276 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:03:31.595276 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:03:31.595276 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4Xkkepu06Zbr2QwlxAeYAXaprRnFLOozcB075W5HET-0b_KmsqaghYLku7x9bCOqGS5t1k5-3UhWEgO1NSLk4QWKtGimBw8A6V9-N9zhLGYN2voGaci99gzG5KwpsRzdRxzK8dkUekeW9DM4vpgrB0a3SN7t-cexkft6h2SiyXsVJo Aug 31 16:03:31.595276 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:03:31.595276 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:03:31.595276 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:03:31.595276 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:03:31.595276 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:03:31.595276 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:03:31.595276 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: abd7cf0fb56d40dca0d158268001b107 Aug 31 16:03:31.595276 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1451141319 Aug 31 16:03:31.595276 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:03:31.595276 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:03:31.595276 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/abd7cf0fb56d40dca0d158268001b107"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/abd7cf0fb56d40dca0d158268001b107"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/abd7cf0fb56d40dca0d158268001b107"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_abd7cf0fb56d40dca0d158268001b107", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:03:31.595276 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1451141319 Aug 31 16:03:31.595276 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: abd7cf0fb56d40dca0d158268001b107 Aug 31 16:03:31.595276 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1451141319 Aug 31 16:03:31.595276 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-FloatingIPsAssociationTestJSON-1451141319-project Aug 31 16:03:31.595276 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:03:31.595276 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:03:31.595276 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: d3c15400d81847c09c81b04b668560b7 Aug 31 16:03:31.595276 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1451141319-project Aug 31 16:03:31.595276 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:03:31.595276 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 6bd8b697-3187-47f8-bec9-5784c425a9ce could not be found. Aug 31 16:03:31.595276 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '6bd8b697-3187-47f8-bec9-5784c425a9ce'} Aug 31 16:03:31.595276 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:03:31.595276 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:03:31.595276 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:03:31.595276 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:03:31.595276 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:03:31.595276 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:03:31.595276 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:03:31.595276 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:03:31.595276 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:03:31.595276 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:03:31.595276 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bd8b697-3187-47f8-bec9-5784c425a9ce could not be found. Aug 31 16:03:31.595276 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:03:31.595276 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:03:31.595276 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:03:31.595276 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:03:31.595276 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:03:31.595276 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:03:31.595276 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:03:31.595276 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:03:31.595276 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:03:31.595276 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:03:31.595276 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:03:31.595276 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:03:31.595276 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:03:31.595276 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:03:31.595276 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:03:31.595276 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:03:31.595276 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:03:31.595276 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:03:31.601130 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bd8b697-3187-47f8-bec9-5784c425a9ce could not be found. Aug 31 16:03:31.601130 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:03:31.601130 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:03:31.601130 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:03:31.601130 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:03:31.601130 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:03:31.601130 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:03:31.601130 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:03:31.601130 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:03:31.601130 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bd8b697-3187-47f8-bec9-5784c425a9ce could not be found. Aug 31 16:03:31.601130 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:03:31.601130 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f9ba2b62-d28c-4a34-a9fa-8264f6f2eb39 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Returning 404 to user: Instance 6bd8b697-3187-47f8-bec9-5784c425a9ce could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:03:31.601130 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f9ba2b62-d28c-4a34-a9fa-8264f6f2eb39 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] 10.222.0.50 "DELETE /compute/v2.1/servers/6bd8b697-3187-47f8-bec9-5784c425a9ce" status: 404 len: 111 microversion: 2.1 time: 0.047773 Aug 31 16:03:31.601130 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1505/2936] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:03:31 2022] DELETE /compute/v2.1/servers/6bd8b697-3187-47f8-bec9-5784c425a9ce => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:03:31.605728 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7e19bcb8-d165-47b2-9618-23a8fc28c21b tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:31.606841 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7e19bcb8-d165-47b2-9618-23a8fc28c21b tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:31.619421 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7e19bcb8-d165-47b2-9618-23a8fc28c21b tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:31.619913 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7e19bcb8-d165-47b2-9618-23a8fc28c21b tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:31.620352 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7e19bcb8-d165-47b2-9618-23a8fc28c21b tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:31.621060 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7e19bcb8-d165-47b2-9618-23a8fc28c21b tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:31.621511 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7e19bcb8-d165-47b2-9618-23a8fc28c21b tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:31.623040 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7e19bcb8-d165-47b2-9618-23a8fc28c21b tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:31.918502 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5c471680-3caa-46e7-b36a-f27179f6621f tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250769b38a2d48db928fdc20a8c64d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfbd02718e4848ab9e6ff73dbbb469d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:31.935756 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5c471680-3caa-46e7-b36a-f27179f6621f tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] 10.222.0.50 "GET /compute/v2.1/servers/23c0eef8-3969-41a5-9da9-4bae125f024f" status: 200 len: 1351 microversion: 2.1 time: 0.515005 Aug 31 16:03:31.936839 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1432/2937] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:31 2022] GET /compute/v2.1/servers/23c0eef8-3969-41a5-9da9-4bae125f024f => generated 1351 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:31.943837 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a51b349c-27ef-41ed-bc2c-89ce7996ab61 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:31.945008 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a51b349c-27ef-41ed-bc2c-89ce7996ab61 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] [instance: 6bd8b697-3187-47f8-bec9-5784c425a9ce] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:31.953059 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a51b349c-27ef-41ed-bc2c-89ce7996ab61 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:31.953843 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a51b349c-27ef-41ed-bc2c-89ce7996ab61 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:31.954479 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a51b349c-27ef-41ed-bc2c-89ce7996ab61 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:31.955420 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a51b349c-27ef-41ed-bc2c-89ce7996ab61 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:31.956045 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a51b349c-27ef-41ed-bc2c-89ce7996ab61 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:31.956813 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a51b349c-27ef-41ed-bc2c-89ce7996ab61 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:31.978275 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-a51b349c-27ef-41ed-bc2c-89ce7996ab61 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] HTTP exception thrown: Instance 6bd8b697-3187-47f8-bec9-5784c425a9ce could not be found. Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a51b349c-27ef-41ed-bc2c-89ce7996ab61 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Request method failure captured: Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/6bd8b697-3187-47f8-bec9-5784c425a9ce HTTP/1.1 Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4Xkkepu06Zbr2QwlxAeYAXaprRnFLOozcB075W5HET-0b_KmsqaghYLku7x9bCOqGS5t1k5-3UhWEgO1NSLk4QWKtGimBw8A6V9-N9zhLGYN2voGaci99gzG5KwpsRzdRxzK8dkUekeW9DM4vpgrB0a3SN7t-cexkft6h2SiyXsVJo Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: abd7cf0fb56d40dca0d158268001b107 Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1451141319 Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/abd7cf0fb56d40dca0d158268001b107"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/abd7cf0fb56d40dca0d158268001b107"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/abd7cf0fb56d40dca0d158268001b107"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_abd7cf0fb56d40dca0d158268001b107", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1451141319 Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: abd7cf0fb56d40dca0d158268001b107 Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1451141319 Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-FloatingIPsAssociationTestJSON-1451141319-project Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: d3c15400d81847c09c81b04b668560b7 Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1451141319-project Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 6bd8b697-3187-47f8-bec9-5784c425a9ce could not be found. Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '6bd8b697-3187-47f8-bec9-5784c425a9ce'} Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bd8b697-3187-47f8-bec9-5784c425a9ce could not be found. Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bd8b697-3187-47f8-bec9-5784c425a9ce could not be found. Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:03:31.982204 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:03:31.988169 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:03:31.988169 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:03:31.988169 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:03:31.988169 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:03:31.988169 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:03:31.988169 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:03:31.988169 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bd8b697-3187-47f8-bec9-5784c425a9ce could not be found. Aug 31 16:03:31.988169 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:03:31.988169 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a51b349c-27ef-41ed-bc2c-89ce7996ab61 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Returning 404 to user: Instance 6bd8b697-3187-47f8-bec9-5784c425a9ce could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:03:31.989660 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a51b349c-27ef-41ed-bc2c-89ce7996ab61 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] 10.222.0.50 "GET /compute/v2.1/servers/6bd8b697-3187-47f8-bec9-5784c425a9ce" status: 404 len: 111 microversion: 2.1 time: 0.048349 Aug 31 16:03:31.989660 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1433/2938] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:31 2022] GET /compute/v2.1/servers/6bd8b697-3187-47f8-bec9-5784c425a9ce => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:03:31.998262 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fb30089f-7a11-4656-9e77-57711f57f5b9 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:31.998900 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fb30089f-7a11-4656-9e77-57711f57f5b9 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:32.010121 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb30089f-7a11-4656-9e77-57711f57f5b9 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:32.010808 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb30089f-7a11-4656-9e77-57711f57f5b9 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:32.011501 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb30089f-7a11-4656-9e77-57711f57f5b9 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:32.012229 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb30089f-7a11-4656-9e77-57711f57f5b9 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:32.012687 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb30089f-7a11-4656-9e77-57711f57f5b9 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:32.013110 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb30089f-7a11-4656-9e77-57711f57f5b9 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:32.042224 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7e19bcb8-d165-47b2-9618-23a8fc28c21b tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:32.051761 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7e19bcb8-d165-47b2-9618-23a8fc28c21b tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1671 microversion: 2.1 time: 0.450788 Aug 31 16:03:32.052876 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1506/2939] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:31 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1671 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:32.059072 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4ea63ed3-3011-4c68-9191-8e6b2027b4d9 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Calling method '.version_select at 0x7fbb4ac20b80>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:32.978995 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fb30089f-7a11-4656-9e77-57711f57f5b9 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:33.004093 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fb30089f-7a11-4656-9e77-57711f57f5b9 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:33.009314 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fb30089f-7a11-4656-9e77-57711f57f5b9 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:33.011969 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fb30089f-7a11-4656-9e77-57711f57f5b9 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1801 microversion: 2.32 time: 1.020165 Aug 31 16:03:33.013619 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1434/2940] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:03:31 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1801 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:03:33.025355 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7fe0564e-d641-4266-9e0d-472d54478bc6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:33.027611 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7fe0564e-d641-4266-9e0d-472d54478bc6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:33.050537 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fe0564e-d641-4266-9e0d-472d54478bc6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:33.052292 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fe0564e-d641-4266-9e0d-472d54478bc6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:33.054188 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fe0564e-d641-4266-9e0d-472d54478bc6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:33.055764 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fe0564e-d641-4266-9e0d-472d54478bc6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:33.059870 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fe0564e-d641-4266-9e0d-472d54478bc6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:33.061388 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fe0564e-d641-4266-9e0d-472d54478bc6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:34.111420 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7fe0564e-d641-4266-9e0d-472d54478bc6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:34.134216 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7fe0564e-d641-4266-9e0d-472d54478bc6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1671 microversion: 2.1 time: 1.118495 Aug 31 16:03:34.140952 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1435/2941] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:33 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1671 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:34.155782 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-edf036b1-6480-4ff6-ab89-3d79f31b3497 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:34.157141 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-edf036b1-6480-4ff6-ab89-3d79f31b3497 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:34.184082 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-edf036b1-6480-4ff6-ab89-3d79f31b3497 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:34.185645 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-edf036b1-6480-4ff6-ab89-3d79f31b3497 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:34.186298 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-edf036b1-6480-4ff6-ab89-3d79f31b3497 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:34.187593 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-edf036b1-6480-4ff6-ab89-3d79f31b3497 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:34.193559 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-edf036b1-6480-4ff6-ab89-3d79f31b3497 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:34.195273 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-edf036b1-6480-4ff6-ab89-3d79f31b3497 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:35.266521 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-edf036b1-6480-4ff6-ab89-3d79f31b3497 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:35.275528 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-edf036b1-6480-4ff6-ab89-3d79f31b3497 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc" status: 200 len: 1359 microversion: 2.1 time: 1.132523 Aug 31 16:03:35.293412 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1436/2942] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:34 2022] GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc => generated 1359 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:35.298446 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-06cdb907-16a3-44c9-aa3a-6d6816725853 req-823d6d8b-f5fd-410c-9fe6-cf370b91552e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23c0eef8-3969-41a5-9da9-4bae125f024f", "tag": "e7ccecd2-97d6-4aed-a87b-af665446815e"}, {"name": "network-changed", "server_uuid": "0e89e500-ddc5-4549-8631-9d62545016d1", "tag": "68c44d14-1c71-4e2c-a5ab-c43c22e7f048"}, {"name": "network-changed", "server_uuid": "0e89e500-ddc5-4549-8631-9d62545016d1", "tag": "57f3869c-b000-4d3c-afe9-a2a6741a014c"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:35.333628 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-06cdb907-16a3-44c9-aa3a-6d6816725853 req-823d6d8b-f5fd-410c-9fe6-cf370b91552e service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:35.334494 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-06cdb907-16a3-44c9-aa3a-6d6816725853 req-823d6d8b-f5fd-410c-9fe6-cf370b91552e service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:35.336332 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-06cdb907-16a3-44c9-aa3a-6d6816725853 req-823d6d8b-f5fd-410c-9fe6-cf370b91552e service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:35.369873 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-06cdb907-16a3-44c9-aa3a-6d6816725853 req-823d6d8b-f5fd-410c-9fe6-cf370b91552e service nova] Creating event network-changed:e7ccecd2-97d6-4aed-a87b-af665446815e for instance 23c0eef8-3969-41a5-9da9-4bae125f024f on n-h2-833090-16 Aug 31 16:03:35.375870 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-06cdb907-16a3-44c9-aa3a-6d6816725853 req-823d6d8b-f5fd-410c-9fe6-cf370b91552e service nova] Creating event network-changed:68c44d14-1c71-4e2c-a5ab-c43c22e7f048 for instance 0e89e500-ddc5-4549-8631-9d62545016d1 on n-h2-833090-16 Aug 31 16:03:35.376696 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-06cdb907-16a3-44c9-aa3a-6d6816725853 req-823d6d8b-f5fd-410c-9fe6-cf370b91552e service nova] Creating event network-changed:57f3869c-b000-4d3c-afe9-a2a6741a014c for instance 0e89e500-ddc5-4549-8631-9d62545016d1 on n-h2-833090-16 Aug 31 16:03:35.399655 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-06cdb907-16a3-44c9-aa3a-6d6816725853 req-823d6d8b-f5fd-410c-9fe6-cf370b91552e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.104739 Aug 31 16:03:35.402322 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1437/2943] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:03:35.412645 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7e481986-a762-4c75-a56f-6134131b992a tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:35.427248 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7e481986-a762-4c75-a56f-6134131b992a tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:35.446303 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e481986-a762-4c75-a56f-6134131b992a tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:35.449682 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e481986-a762-4c75-a56f-6134131b992a tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:35.450411 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e481986-a762-4c75-a56f-6134131b992a tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:35.452650 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e481986-a762-4c75-a56f-6134131b992a tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:35.454117 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e481986-a762-4c75-a56f-6134131b992a tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:35.456959 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e481986-a762-4c75-a56f-6134131b992a tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:35.840917 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7e481986-a762-4c75-a56f-6134131b992a tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:35.872412 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7e481986-a762-4c75-a56f-6134131b992a tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:35.874464 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7e481986-a762-4c75-a56f-6134131b992a tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:35.877012 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7e481986-a762-4c75-a56f-6134131b992a tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 1887 microversion: 2.42 time: 0.473390 Aug 31 16:03:35.880557 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1438/2944] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:03:35 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 1887 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:03:35.903227 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-73c7bd34-0057-4e8a-a2a8-1e61db9d7be6 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:35.909435 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-73c7bd34-0057-4e8a-a2a8-1e61db9d7be6 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] [instance: 23c0eef8-3969-41a5-9da9-4bae125f024f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:35.928816 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-73c7bd34-0057-4e8a-a2a8-1e61db9d7be6 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:35.939128 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-73c7bd34-0057-4e8a-a2a8-1e61db9d7be6 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:35.940124 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-73c7bd34-0057-4e8a-a2a8-1e61db9d7be6 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:35.941123 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-73c7bd34-0057-4e8a-a2a8-1e61db9d7be6 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:35.941832 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-73c7bd34-0057-4e8a-a2a8-1e61db9d7be6 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:35.942520 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-73c7bd34-0057-4e8a-a2a8-1e61db9d7be6 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:35.977265 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:03:36.087705 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4ea63ed3-3011-4c68-9191-8e6b2027b4d9 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/ec1b763e-fe2e-4eed-ad10-7c2d93813728" status: 202 len: 0 microversion: 2.1 time: 4.031984 Aug 31 16:03:36.098670 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1507/2945] 10.222.0.50 () {58 vars in 1263 bytes} [Wed Aug 31 16:03:32 2022] DELETE /compute/v2.1/os-floating-ips/ec1b763e-fe2e-4eed-ad10-7c2d93813728 => generated 0 bytes in 4044 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:03:36.110486 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-73a52ede-1d03-4223-9559-ca8c43a22a76 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:36.113356 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-73a52ede-1d03-4223-9559-ca8c43a22a76 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:36.130841 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-73a52ede-1d03-4223-9559-ca8c43a22a76 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:36.131400 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-73a52ede-1d03-4223-9559-ca8c43a22a76 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:36.131929 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-73a52ede-1d03-4223-9559-ca8c43a22a76 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:36.132723 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-73a52ede-1d03-4223-9559-ca8c43a22a76 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:36.133190 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-73a52ede-1d03-4223-9559-ca8c43a22a76 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:36.133652 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-73a52ede-1d03-4223-9559-ca8c43a22a76 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:36.492552 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-73c7bd34-0057-4e8a-a2a8-1e61db9d7be6 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250769b38a2d48db928fdc20a8c64d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfbd02718e4848ab9e6ff73dbbb469d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:36.504779 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-73c7bd34-0057-4e8a-a2a8-1e61db9d7be6 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] 10.222.0.50 "GET /compute/v2.1/servers/23c0eef8-3969-41a5-9da9-4bae125f024f" status: 200 len: 1351 microversion: 2.1 time: 0.621608 Aug 31 16:03:36.510503 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1439/2946] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:35 2022] GET /compute/v2.1/servers/23c0eef8-3969-41a5-9da9-4bae125f024f => generated 1351 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:36.524864 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-aead9d2d-1783-4ca2-b5a1-889c92003ad9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-374989811", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "4df1d88e-baa2-45b2-bf09-1af39b3d8e2f"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:36.598222 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-aead9d2d-1783-4ca2-b5a1-889c92003ad9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] validate_networks() for [('4df1d88e-baa2-45b2-bf09-1af39b3d8e2f', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:03:36.626385 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-73a52ede-1d03-4223-9559-ca8c43a22a76 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:36.641290 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-73a52ede-1d03-4223-9559-ca8c43a22a76 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:36.642985 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-73a52ede-1d03-4223-9559-ca8c43a22a76 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:36.644914 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-73a52ede-1d03-4223-9559-ca8c43a22a76 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1801 microversion: 2.32 time: 0.544468 Aug 31 16:03:36.645676 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1508/2947] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:03:36 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1801 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:03:36.665587 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-098d691a-8f7c-4ed1-b434-22394846c005 req-06f3b57a-296e-456f-b115-f106ab9a4b73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23c0eef8-3969-41a5-9da9-4bae125f024f", "name": "network-vif-plugged", "status": "completed", "tag": "e7ccecd2-97d6-4aed-a87b-af665446815e"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:36.677350 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-098d691a-8f7c-4ed1-b434-22394846c005 req-06f3b57a-296e-456f-b115-f106ab9a4b73 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:36.678125 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-098d691a-8f7c-4ed1-b434-22394846c005 req-06f3b57a-296e-456f-b115-f106ab9a4b73 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:36.678784 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-098d691a-8f7c-4ed1-b434-22394846c005 req-06f3b57a-296e-456f-b115-f106ab9a4b73 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:36.693708 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-098d691a-8f7c-4ed1-b434-22394846c005 req-06f3b57a-296e-456f-b115-f106ab9a4b73 service nova] Creating event network-vif-plugged:e7ccecd2-97d6-4aed-a87b-af665446815e for instance 23c0eef8-3969-41a5-9da9-4bae125f024f on n-h2-833090-16 Aug 31 16:03:36.699743 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-098d691a-8f7c-4ed1-b434-22394846c005 req-06f3b57a-296e-456f-b115-f106ab9a4b73 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037850 Aug 31 16:03:36.702227 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1509/2948] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:03:36.711912 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a065ec38-e23b-41c6-ab6f-455555c196f8 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:36.712935 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a065ec38-e23b-41c6-ab6f-455555c196f8 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] [instance: d18fee50-f30d-44c3-9ac5-18aaace88e65] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:36.724187 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a065ec38-e23b-41c6-ab6f-455555c196f8 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:36.725062 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a065ec38-e23b-41c6-ab6f-455555c196f8 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:36.726180 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a065ec38-e23b-41c6-ab6f-455555c196f8 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:36.728016 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a065ec38-e23b-41c6-ab6f-455555c196f8 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:36.728869 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a065ec38-e23b-41c6-ab6f-455555c196f8 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:36.729561 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a065ec38-e23b-41c6-ab6f-455555c196f8 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:36.771023 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a065ec38-e23b-41c6-ab6f-455555c196f8 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] [instance: d18fee50-f30d-44c3-9ac5-18aaace88e65] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:03:36.917655 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a065ec38-e23b-41c6-ab6f-455555c196f8 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d18fee50-f30d-44c3-9ac5-18aaace88e65" status: 204 len: 0 microversion: 2.1 time: 0.212059 Aug 31 16:03:36.919420 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1510/2949] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:03:36 2022] DELETE /compute/v2.1/servers/d18fee50-f30d-44c3-9ac5-18aaace88e65 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:03:36.926365 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6e6d4b48-f20c-4a11-8549-478cccda86d0 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:36.927413 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6e6d4b48-f20c-4a11-8549-478cccda86d0 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:36.938015 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6e6d4b48-f20c-4a11-8549-478cccda86d0 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:36.938843 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6e6d4b48-f20c-4a11-8549-478cccda86d0 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:36.939463 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6e6d4b48-f20c-4a11-8549-478cccda86d0 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:36.940904 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6e6d4b48-f20c-4a11-8549-478cccda86d0 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:36.941625 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6e6d4b48-f20c-4a11-8549-478cccda86d0 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:36.942635 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6e6d4b48-f20c-4a11-8549-478cccda86d0 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:37.527165 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6e6d4b48-f20c-4a11-8549-478cccda86d0 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:37.542452 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6e6d4b48-f20c-4a11-8549-478cccda86d0 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc" status: 200 len: 1359 microversion: 2.1 time: 0.621342 Aug 31 16:03:37.544644 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1511/2950] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:36 2022] GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc => generated 1359 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:37.551103 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-cf301778-46e3-45b4-a224-4af34a9443fd tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:37.552101 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-cf301778-46e3-45b4-a224-4af34a9443fd tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:37.560972 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cf301778-46e3-45b4-a224-4af34a9443fd tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:37.561599 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cf301778-46e3-45b4-a224-4af34a9443fd tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:37.562164 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cf301778-46e3-45b4-a224-4af34a9443fd tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:37.562979 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cf301778-46e3-45b4-a224-4af34a9443fd tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:37.565048 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cf301778-46e3-45b4-a224-4af34a9443fd tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:37.565499 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cf301778-46e3-45b4-a224-4af34a9443fd tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:38.028334 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-cf301778-46e3-45b4-a224-4af34a9443fd tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:38.076657 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-cf301778-46e3-45b4-a224-4af34a9443fd tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:38.083580 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-cf301778-46e3-45b4-a224-4af34a9443fd tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:38.101437 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:03:38.107668 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-cf301778-46e3-45b4-a224-4af34a9443fd tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 1875 microversion: 2.42 time: 0.560210 Aug 31 16:03:38.108866 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1512/2951] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:03:37 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 1875 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:03:38.119995 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-cff82634-461f-445a-8cc9-4a1e09a26960 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:38.127156 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-cff82634-461f-445a-8cc9-4a1e09a26960 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] [instance: d18fee50-f30d-44c3-9ac5-18aaace88e65] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:38.149613 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cff82634-461f-445a-8cc9-4a1e09a26960 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:38.151947 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cff82634-461f-445a-8cc9-4a1e09a26960 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:38.152578 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cff82634-461f-445a-8cc9-4a1e09a26960 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:38.153504 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cff82634-461f-445a-8cc9-4a1e09a26960 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:38.154981 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cff82634-461f-445a-8cc9-4a1e09a26960 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:38.157311 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cff82634-461f-445a-8cc9-4a1e09a26960 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:38.199257 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:03:38.375517 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-aead9d2d-1783-4ca2-b5a1-889c92003ad9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:03:38.376260 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-aead9d2d-1783-4ca2-b5a1-889c92003ad9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:03:38.376957 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-aead9d2d-1783-4ca2-b5a1-889c92003ad9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:03:38.377645 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-aead9d2d-1783-4ca2-b5a1-889c92003ad9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:03:38.378336 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-aead9d2d-1783-4ca2-b5a1-889c92003ad9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:03:38.401405 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aead9d2d-1783-4ca2-b5a1-889c92003ad9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:38.402411 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aead9d2d-1783-4ca2-b5a1-889c92003ad9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:38.403082 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aead9d2d-1783-4ca2-b5a1-889c92003ad9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:38.404104 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aead9d2d-1783-4ca2-b5a1-889c92003ad9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:38.405144 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aead9d2d-1783-4ca2-b5a1-889c92003ad9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:38.405781 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aead9d2d-1783-4ca2-b5a1-889c92003ad9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:38.436349 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-aead9d2d-1783-4ca2-b5a1-889c92003ad9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Getting quotas for project 11ef5102f83142d1a52befe52c3595d4. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:03:38.445823 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-aead9d2d-1783-4ca2-b5a1-889c92003ad9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Getting quotas for user aeeaf32202f747c8a2b98836f503aa7e and project 11ef5102f83142d1a52befe52c3595d4. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:03:38.467420 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-aead9d2d-1783-4ca2-b5a1-889c92003ad9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:03:38.471169 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-aead9d2d-1783-4ca2-b5a1-889c92003ad9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 99a904a8-aa6f-468e-a869-07cb3c5a1053] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:03:38.556113 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-aead9d2d-1783-4ca2-b5a1-889c92003ad9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.042104 Aug 31 16:03:38.558347 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1440/2952] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:03:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2046 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:03:38.565506 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-3eb189cf-4f27-4133-9475-cb1e3e398cf2 req-86112520-6a83-4802-a08e-3645a300e7ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e89e500-ddc5-4549-8631-9d62545016d1", "tag": "757b9501-0859-4dd6-8292-391612616a92"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:38.582123 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3eb189cf-4f27-4133-9475-cb1e3e398cf2 req-86112520-6a83-4802-a08e-3645a300e7ea service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:38.582998 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3eb189cf-4f27-4133-9475-cb1e3e398cf2 req-86112520-6a83-4802-a08e-3645a300e7ea service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:38.583734 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3eb189cf-4f27-4133-9475-cb1e3e398cf2 req-86112520-6a83-4802-a08e-3645a300e7ea service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:38.601271 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-3eb189cf-4f27-4133-9475-cb1e3e398cf2 req-86112520-6a83-4802-a08e-3645a300e7ea service nova] Creating event network-changed:757b9501-0859-4dd6-8292-391612616a92 for instance 0e89e500-ddc5-4549-8631-9d62545016d1 on n-h2-833090-16 Aug 31 16:03:38.628096 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-3eb189cf-4f27-4133-9475-cb1e3e398cf2 req-86112520-6a83-4802-a08e-3645a300e7ea service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067749 Aug 31 16:03:38.642752 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1441/2953] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:03:38.648547 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-069cbc10-a83a-431d-956b-bb30f74152fe tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:38.652301 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-069cbc10-a83a-431d-956b-bb30f74152fe tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] [instance: 23c0eef8-3969-41a5-9da9-4bae125f024f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:38.664111 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-069cbc10-a83a-431d-956b-bb30f74152fe tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:38.664603 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-069cbc10-a83a-431d-956b-bb30f74152fe tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:38.665036 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-069cbc10-a83a-431d-956b-bb30f74152fe tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:38.672832 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-069cbc10-a83a-431d-956b-bb30f74152fe tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:38.673484 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-069cbc10-a83a-431d-956b-bb30f74152fe tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:38.674081 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-069cbc10-a83a-431d-956b-bb30f74152fe tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:39.038505 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-cff82634-461f-445a-8cc9-4a1e09a26960 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c15400d81847c09c81b04b668560b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd7cf0fb56d40dca0d158268001b107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:39.062716 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-cff82634-461f-445a-8cc9-4a1e09a26960 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] 10.222.0.50 "GET /compute/v2.1/servers/d18fee50-f30d-44c3-9ac5-18aaace88e65" status: 200 len: 1527 microversion: 2.1 time: 0.951327 Aug 31 16:03:39.084771 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1513/2954] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:38 2022] GET /compute/v2.1/servers/d18fee50-f30d-44c3-9ac5-18aaace88e65 => generated 1527 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:39.092332 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-39de59a6-08bb-4fdf-956a-8d061b420bf3 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:39.093223 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-39de59a6-08bb-4fdf-956a-8d061b420bf3 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:39.100982 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-39de59a6-08bb-4fdf-956a-8d061b420bf3 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:39.101740 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-39de59a6-08bb-4fdf-956a-8d061b420bf3 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:39.102430 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-39de59a6-08bb-4fdf-956a-8d061b420bf3 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:39.103379 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-39de59a6-08bb-4fdf-956a-8d061b420bf3 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:39.104087 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-39de59a6-08bb-4fdf-956a-8d061b420bf3 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:39.104754 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-39de59a6-08bb-4fdf-956a-8d061b420bf3 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:39.209391 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-069cbc10-a83a-431d-956b-bb30f74152fe tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250769b38a2d48db928fdc20a8c64d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfbd02718e4848ab9e6ff73dbbb469d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:39.224301 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-069cbc10-a83a-431d-956b-bb30f74152fe tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] 10.222.0.50 "GET /compute/v2.1/servers/23c0eef8-3969-41a5-9da9-4bae125f024f" status: 200 len: 1351 microversion: 2.1 time: 0.579857 Aug 31 16:03:39.248859 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1442/2955] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:38 2022] GET /compute/v2.1/servers/23c0eef8-3969-41a5-9da9-4bae125f024f => generated 1351 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:39.254225 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-278227e5-e137-4006-8f16-c2fea7aa5864 req-727ce998-45e3-4798-9243-e340f8e154a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "027ef860-8ede-472c-9099-befdc2cde7bc", "tag": "f3ddf80b-0487-4257-b3e5-b64f7214f531"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:39.270036 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-278227e5-e137-4006-8f16-c2fea7aa5864 req-727ce998-45e3-4798-9243-e340f8e154a5 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:39.270855 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-278227e5-e137-4006-8f16-c2fea7aa5864 req-727ce998-45e3-4798-9243-e340f8e154a5 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:39.271526 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-278227e5-e137-4006-8f16-c2fea7aa5864 req-727ce998-45e3-4798-9243-e340f8e154a5 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:39.284353 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-278227e5-e137-4006-8f16-c2fea7aa5864 req-727ce998-45e3-4798-9243-e340f8e154a5 service nova] Creating event network-changed:f3ddf80b-0487-4257-b3e5-b64f7214f531 for instance 027ef860-8ede-472c-9099-befdc2cde7bc on n-h1-833090-16 Aug 31 16:03:39.290745 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-278227e5-e137-4006-8f16-c2fea7aa5864 req-727ce998-45e3-4798-9243-e340f8e154a5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040341 Aug 31 16:03:39.291965 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1443/2956] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:03:39.297530 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5b8ad6a0-726d-4cb3-86c5-2dd950200f74 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:39.298610 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5b8ad6a0-726d-4cb3-86c5-2dd950200f74 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:39.307605 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b8ad6a0-726d-4cb3-86c5-2dd950200f74 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:39.308409 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b8ad6a0-726d-4cb3-86c5-2dd950200f74 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:39.309101 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b8ad6a0-726d-4cb3-86c5-2dd950200f74 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:39.310249 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b8ad6a0-726d-4cb3-86c5-2dd950200f74 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:39.310945 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b8ad6a0-726d-4cb3-86c5-2dd950200f74 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:39.311582 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b8ad6a0-726d-4cb3-86c5-2dd950200f74 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:39.668963 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-39de59a6-08bb-4fdf-956a-8d061b420bf3 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:39.683499 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-39de59a6-08bb-4fdf-956a-8d061b420bf3 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:39.687491 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-39de59a6-08bb-4fdf-956a-8d061b420bf3 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:39.688726 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-39de59a6-08bb-4fdf-956a-8d061b420bf3 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1848 microversion: 2.32 time: 0.600565 Aug 31 16:03:39.689318 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1514/2957] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:03:39 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1848 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:03:39.704349 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a5a577d7-0b2b-4d86-bfa4-1e5bd4e0c5b8 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:39.706189 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a5a577d7-0b2b-4d86-bfa4-1e5bd4e0c5b8 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 99a904a8-aa6f-468e-a869-07cb3c5a1053] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:39.715440 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5a577d7-0b2b-4d86-bfa4-1e5bd4e0c5b8 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:39.717627 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5a577d7-0b2b-4d86-bfa4-1e5bd4e0c5b8 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:39.718403 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5a577d7-0b2b-4d86-bfa4-1e5bd4e0c5b8 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:39.721877 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5a577d7-0b2b-4d86-bfa4-1e5bd4e0c5b8 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:39.724373 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5a577d7-0b2b-4d86-bfa4-1e5bd4e0c5b8 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:39.725100 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5a577d7-0b2b-4d86-bfa4-1e5bd4e0c5b8 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:39.903411 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5b8ad6a0-726d-4cb3-86c5-2dd950200f74 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:39.912624 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5b8ad6a0-726d-4cb3-86c5-2dd950200f74 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc" status: 200 len: 1359 microversion: 2.1 time: 0.619234 Aug 31 16:03:39.913858 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1444/2958] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:39 2022] GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc => generated 1359 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:39.919619 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ab890cc9-7028-4ddf-ab3c-9d1d5707098e tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:39.920428 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ab890cc9-7028-4ddf-ab3c-9d1d5707098e tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:39.928441 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab890cc9-7028-4ddf-ab3c-9d1d5707098e tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:39.928923 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab890cc9-7028-4ddf-ab3c-9d1d5707098e tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:39.929536 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab890cc9-7028-4ddf-ab3c-9d1d5707098e tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:39.930273 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab890cc9-7028-4ddf-ab3c-9d1d5707098e tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:39.930995 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab890cc9-7028-4ddf-ab3c-9d1d5707098e tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:39.932016 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab890cc9-7028-4ddf-ab3c-9d1d5707098e tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:40.016906 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a5a577d7-0b2b-4d86-bfa4-1e5bd4e0c5b8 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:40.035950 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a5a577d7-0b2b-4d86-bfa4-1e5bd4e0c5b8 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/99a904a8-aa6f-468e-a869-07cb3c5a1053" status: 200 len: 1266 microversion: 2.1 time: 0.341803 Aug 31 16:03:40.036554 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1515/2959] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:39 2022] GET /compute/v2.1/servers/99a904a8-aa6f-468e-a869-07cb3c5a1053 => generated 1266 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:40.092057 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-edae5e0d-9f02-4c71-94fe-b7e716ffedea tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:40.092863 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-edae5e0d-9f02-4c71-94fe-b7e716ffedea tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] [instance: d18fee50-f30d-44c3-9ac5-18aaace88e65] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:40.101909 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-edae5e0d-9f02-4c71-94fe-b7e716ffedea tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:40.107105 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-edae5e0d-9f02-4c71-94fe-b7e716ffedea tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:40.107675 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-edae5e0d-9f02-4c71-94fe-b7e716ffedea tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:40.110157 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-edae5e0d-9f02-4c71-94fe-b7e716ffedea tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:40.110783 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-edae5e0d-9f02-4c71-94fe-b7e716ffedea tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:40.111830 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-edae5e0d-9f02-4c71-94fe-b7e716ffedea tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:40.441913 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ab890cc9-7028-4ddf-ab3c-9d1d5707098e tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:40.460467 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ab890cc9-7028-4ddf-ab3c-9d1d5707098e tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:40.462400 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ab890cc9-7028-4ddf-ab3c-9d1d5707098e tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:40.464947 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ab890cc9-7028-4ddf-ab3c-9d1d5707098e tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 1875 microversion: 2.42 time: 0.549743 Aug 31 16:03:40.466266 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1445/2960] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:03:39 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 1875 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:03:40.480537 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-df669483-c5ea-4330-b61f-f4513341af0f tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:40.481392 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-df669483-c5ea-4330-b61f-f4513341af0f tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] [instance: 23c0eef8-3969-41a5-9da9-4bae125f024f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:40.485089 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-edae5e0d-9f02-4c71-94fe-b7e716ffedea tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c15400d81847c09c81b04b668560b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd7cf0fb56d40dca0d158268001b107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:40.497242 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-edae5e0d-9f02-4c71-94fe-b7e716ffedea tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] 10.222.0.50 "GET /compute/v2.1/servers/d18fee50-f30d-44c3-9ac5-18aaace88e65" status: 200 len: 1527 microversion: 2.1 time: 0.408364 Aug 31 16:03:40.510393 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1516/2961] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:40 2022] GET /compute/v2.1/servers/d18fee50-f30d-44c3-9ac5-18aaace88e65 => generated 1527 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:03:40.510811 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df669483-c5ea-4330-b61f-f4513341af0f tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:40.511525 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df669483-c5ea-4330-b61f-f4513341af0f tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:40.512173 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df669483-c5ea-4330-b61f-f4513341af0f tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:40.513307 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df669483-c5ea-4330-b61f-f4513341af0f tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:40.515963 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df669483-c5ea-4330-b61f-f4513341af0f tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:40.516631 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df669483-c5ea-4330-b61f-f4513341af0f tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:40.715822 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9b5d2377-9955-48be-94e5-a9412b42e537 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:40.716428 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9b5d2377-9955-48be-94e5-a9412b42e537 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:40.728052 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9b5d2377-9955-48be-94e5-a9412b42e537 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:40.728553 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9b5d2377-9955-48be-94e5-a9412b42e537 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:40.730764 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9b5d2377-9955-48be-94e5-a9412b42e537 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:40.733113 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9b5d2377-9955-48be-94e5-a9412b42e537 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:40.734847 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9b5d2377-9955-48be-94e5-a9412b42e537 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:40.735288 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9b5d2377-9955-48be-94e5-a9412b42e537 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:40.979075 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-df669483-c5ea-4330-b61f-f4513341af0f tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250769b38a2d48db928fdc20a8c64d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfbd02718e4848ab9e6ff73dbbb469d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:40.988156 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-df669483-c5ea-4330-b61f-f4513341af0f tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] 10.222.0.50 "GET /compute/v2.1/servers/23c0eef8-3969-41a5-9da9-4bae125f024f" status: 200 len: 1540 microversion: 2.1 time: 0.520323 Aug 31 16:03:40.991537 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1446/2962] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:40 2022] GET /compute/v2.1/servers/23c0eef8-3969-41a5-9da9-4bae125f024f => generated 1540 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:41.013663 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-e0792b68-fad9-4487-ab25-7e6989412bde req-23ba1668-af38-4c54-bb1a-43a0d74d61ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e89e500-ddc5-4549-8631-9d62545016d1", "tag": "6be52102-ccae-4668-bb69-c84a894fc971"}, {"name": "network-changed", "server_uuid": "a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9", "tag": "988b704e-8f3a-4c8f-903a-1661f7c99521"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:41.043534 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e0792b68-fad9-4487-ab25-7e6989412bde req-23ba1668-af38-4c54-bb1a-43a0d74d61ce service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:41.048053 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e0792b68-fad9-4487-ab25-7e6989412bde req-23ba1668-af38-4c54-bb1a-43a0d74d61ce service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:41.048638 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e0792b68-fad9-4487-ab25-7e6989412bde req-23ba1668-af38-4c54-bb1a-43a0d74d61ce service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:41.078465 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-e0792b68-fad9-4487-ab25-7e6989412bde req-23ba1668-af38-4c54-bb1a-43a0d74d61ce service nova] Creating event network-changed:6be52102-ccae-4668-bb69-c84a894fc971 for instance 0e89e500-ddc5-4549-8631-9d62545016d1 on n-h2-833090-16 Aug 31 16:03:41.079393 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-e0792b68-fad9-4487-ab25-7e6989412bde req-23ba1668-af38-4c54-bb1a-43a0d74d61ce service nova] Creating event network-changed:988b704e-8f3a-4c8f-903a-1661f7c99521 for instance a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 on n-h2-833090-16 Aug 31 16:03:41.090458 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-e0792b68-fad9-4487-ab25-7e6989412bde req-23ba1668-af38-4c54-bb1a-43a0d74d61ce service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.080883 Aug 31 16:03:41.091790 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1447/2963] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:03:41.097260 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-abbbbd71-15d2-4469-91c2-2ec26d19f7ad tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:41.098331 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-abbbbd71-15d2-4469-91c2-2ec26d19f7ad tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:41.107148 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-abbbbd71-15d2-4469-91c2-2ec26d19f7ad tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:41.108797 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-abbbbd71-15d2-4469-91c2-2ec26d19f7ad tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:41.109897 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-abbbbd71-15d2-4469-91c2-2ec26d19f7ad tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:41.111912 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-abbbbd71-15d2-4469-91c2-2ec26d19f7ad tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:41.112627 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-abbbbd71-15d2-4469-91c2-2ec26d19f7ad tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:41.113319 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-abbbbd71-15d2-4469-91c2-2ec26d19f7ad tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:41.498788 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9b5d2377-9955-48be-94e5-a9412b42e537 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:41.521738 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9b5d2377-9955-48be-94e5-a9412b42e537 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:41.523849 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9b5d2377-9955-48be-94e5-a9412b42e537 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:41.525280 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9b5d2377-9955-48be-94e5-a9412b42e537 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1848 microversion: 2.32 time: 0.813705 Aug 31 16:03:41.527366 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1517/2964] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:03:40 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1848 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:03:41.535918 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f253ae6d-00aa-41a6-a506-d7e666ceac1b tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:41.542173 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f253ae6d-00aa-41a6-a506-d7e666ceac1b tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] [instance: 23c0eef8-3969-41a5-9da9-4bae125f024f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:41.554380 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f253ae6d-00aa-41a6-a506-d7e666ceac1b tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:41.555149 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f253ae6d-00aa-41a6-a506-d7e666ceac1b tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:41.557389 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f253ae6d-00aa-41a6-a506-d7e666ceac1b tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:41.560050 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f253ae6d-00aa-41a6-a506-d7e666ceac1b tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:41.561964 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f253ae6d-00aa-41a6-a506-d7e666ceac1b tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:41.564139 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f253ae6d-00aa-41a6-a506-d7e666ceac1b tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:41.576190 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:03:42.054232 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-abbbbd71-15d2-4469-91c2-2ec26d19f7ad tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:42.063104 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-abbbbd71-15d2-4469-91c2-2ec26d19f7ad tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc" status: 200 len: 1359 microversion: 2.1 time: 0.969856 Aug 31 16:03:42.079335 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1448/2965] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:41 2022] GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc => generated 1359 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:42.098531 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ef7bd1bc-5775-4be7-b8ad-342b22389545 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:42.099840 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ef7bd1bc-5775-4be7-b8ad-342b22389545 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 99a904a8-aa6f-468e-a869-07cb3c5a1053] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:42.123558 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef7bd1bc-5775-4be7-b8ad-342b22389545 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:42.124087 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef7bd1bc-5775-4be7-b8ad-342b22389545 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:42.124537 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef7bd1bc-5775-4be7-b8ad-342b22389545 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:42.125239 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef7bd1bc-5775-4be7-b8ad-342b22389545 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:42.125817 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef7bd1bc-5775-4be7-b8ad-342b22389545 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:42.126177 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef7bd1bc-5775-4be7-b8ad-342b22389545 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:42.210562 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f253ae6d-00aa-41a6-a506-d7e666ceac1b tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] 10.222.0.50 "GET /compute/v2.1/servers/23c0eef8-3969-41a5-9da9-4bae125f024f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.680893 Aug 31 16:03:42.212461 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1518/2966] 10.222.0.50 () {58 vars in 1275 bytes} [Wed Aug 31 16:03:41 2022] GET /compute/v2.1/servers/23c0eef8-3969-41a5-9da9-4bae125f024f/os-interface => generated 284 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:03:42.220003 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-67ab6210-6edd-4051-8ae1-ad487b63eeb6 req-81c6c114-f5ac-4ec8-acfb-a9d10feeab22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d18fee50-f30d-44c3-9ac5-18aaace88e65", "name": "network-vif-deleted", "tag": "f657e99c-7a4f-44d8-93b1-1e4f5d4feb75"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:42.246737 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ef7bd1bc-5775-4be7-b8ad-342b22389545 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:42.266986 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ef7bd1bc-5775-4be7-b8ad-342b22389545 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/99a904a8-aa6f-468e-a869-07cb3c5a1053" status: 200 len: 1272 microversion: 2.1 time: 0.182876 Aug 31 16:03:42.269374 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-67ab6210-6edd-4051-8ae1-ad487b63eeb6 req-81c6c114-f5ac-4ec8-acfb-a9d10feeab22 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:42.271767 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-67ab6210-6edd-4051-8ae1-ad487b63eeb6 req-81c6c114-f5ac-4ec8-acfb-a9d10feeab22 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:42.272223 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-67ab6210-6edd-4051-8ae1-ad487b63eeb6 req-81c6c114-f5ac-4ec8-acfb-a9d10feeab22 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:42.303888 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-67ab6210-6edd-4051-8ae1-ad487b63eeb6 req-81c6c114-f5ac-4ec8-acfb-a9d10feeab22 service nova] Creating event network-vif-deleted:f657e99c-7a4f-44d8-93b1-1e4f5d4feb75 for instance d18fee50-f30d-44c3-9ac5-18aaace88e65 on n-h2-833090-16 Aug 31 16:03:42.307493 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1449/2967] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:42 2022] GET /compute/v2.1/servers/99a904a8-aa6f-468e-a869-07cb3c5a1053 => generated 1272 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:42.321106 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-67ab6210-6edd-4051-8ae1-ad487b63eeb6 req-81c6c114-f5ac-4ec8-acfb-a9d10feeab22 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106721 Aug 31 16:03:42.321833 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1519/2968] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:03:42.325207 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fd8f83b1-e75f-4936-b46c-5df33382cd17 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:42.327769 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-86f5a41e-e975-4e0b-918f-9ad767e4df49 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:42.328644 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-86f5a41e-e975-4e0b-918f-9ad767e4df49 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] [instance: d18fee50-f30d-44c3-9ac5-18aaace88e65] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:42.329485 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fd8f83b1-e75f-4936-b46c-5df33382cd17 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:42.346505 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-86f5a41e-e975-4e0b-918f-9ad767e4df49 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:42.347825 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-86f5a41e-e975-4e0b-918f-9ad767e4df49 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:42.348451 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-86f5a41e-e975-4e0b-918f-9ad767e4df49 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:42.349251 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-86f5a41e-e975-4e0b-918f-9ad767e4df49 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:42.352836 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-86f5a41e-e975-4e0b-918f-9ad767e4df49 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:42.353418 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-86f5a41e-e975-4e0b-918f-9ad767e4df49 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:42.370345 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd8f83b1-e75f-4936-b46c-5df33382cd17 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:42.373016 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd8f83b1-e75f-4936-b46c-5df33382cd17 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:42.373688 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd8f83b1-e75f-4936-b46c-5df33382cd17 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:42.375976 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd8f83b1-e75f-4936-b46c-5df33382cd17 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:42.378609 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd8f83b1-e75f-4936-b46c-5df33382cd17 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:42.382878 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd8f83b1-e75f-4936-b46c-5df33382cd17 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:42.437072 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-86f5a41e-e975-4e0b-918f-9ad767e4df49 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:42.438305 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-86f5a41e-e975-4e0b-918f-9ad767e4df49 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:42.439189 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-86f5a41e-e975-4e0b-918f-9ad767e4df49 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:42.440154 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-86f5a41e-e975-4e0b-918f-9ad767e4df49 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lazy-loading 'fault' on Instance uuid d18fee50-f30d-44c3-9ac5-18aaace88e65 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:03:43.198550 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-86f5a41e-e975-4e0b-918f-9ad767e4df49 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3c15400d81847c09c81b04b668560b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd7cf0fb56d40dca0d158268001b107', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:43.215695 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-86f5a41e-e975-4e0b-918f-9ad767e4df49 tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] 10.222.0.50 "GET /compute/v2.1/servers/d18fee50-f30d-44c3-9ac5-18aaace88e65" status: 200 len: 1314 microversion: 2.1 time: 0.892238 Aug 31 16:03:43.224552 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1520/2969] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:42 2022] GET /compute/v2.1/servers/d18fee50-f30d-44c3-9ac5-18aaace88e65 => generated 1314 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:43.237348 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-73837f5d-3777-4054-8200-25af7b23529c tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:43.238979 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-73837f5d-3777-4054-8200-25af7b23529c tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:43.285178 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-73837f5d-3777-4054-8200-25af7b23529c tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:43.286608 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-73837f5d-3777-4054-8200-25af7b23529c tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:43.289538 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-73837f5d-3777-4054-8200-25af7b23529c tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:43.291727 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-73837f5d-3777-4054-8200-25af7b23529c tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:43.294042 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-73837f5d-3777-4054-8200-25af7b23529c tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:43.295953 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-73837f5d-3777-4054-8200-25af7b23529c tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:44.152720 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fd8f83b1-e75f-4936-b46c-5df33382cd17 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:44.164754 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fd8f83b1-e75f-4936-b46c-5df33382cd17 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:44.176785 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fd8f83b1-e75f-4936-b46c-5df33382cd17 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:44.178357 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fd8f83b1-e75f-4936-b46c-5df33382cd17 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 1875 microversion: 2.42 time: 1.868932 Aug 31 16:03:44.179157 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1450/2970] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:03:42 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 1875 bytes in 1871 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:03:44.184336 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a4b01c1f-2a04-43ee-abf8-5bfe9abe9792 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:44.195088 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a4b01c1f-2a04-43ee-abf8-5bfe9abe9792 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:44.201532 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4b01c1f-2a04-43ee-abf8-5bfe9abe9792 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:44.211969 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4b01c1f-2a04-43ee-abf8-5bfe9abe9792 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:44.212614 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4b01c1f-2a04-43ee-abf8-5bfe9abe9792 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:44.213531 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4b01c1f-2a04-43ee-abf8-5bfe9abe9792 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:44.214173 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4b01c1f-2a04-43ee-abf8-5bfe9abe9792 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:44.214775 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4b01c1f-2a04-43ee-abf8-5bfe9abe9792 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:44.292197 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-73837f5d-3777-4054-8200-25af7b23529c tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:44.302054 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-73837f5d-3777-4054-8200-25af7b23529c tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:44.312043 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-73837f5d-3777-4054-8200-25af7b23529c tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:44.313217 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-73837f5d-3777-4054-8200-25af7b23529c tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1869 microversion: 2.32 time: 1.087267 Aug 31 16:03:44.328956 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1521/2971] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:03:43 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1869 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:03:44.328956 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-cbef654b-e192-402d-873c-30f43a8954c3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:44.328956 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-cbef654b-e192-402d-873c-30f43a8954c3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 99a904a8-aa6f-468e-a869-07cb3c5a1053] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:44.337857 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cbef654b-e192-402d-873c-30f43a8954c3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:44.338404 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cbef654b-e192-402d-873c-30f43a8954c3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:44.338847 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cbef654b-e192-402d-873c-30f43a8954c3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:44.339576 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cbef654b-e192-402d-873c-30f43a8954c3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:44.344677 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cbef654b-e192-402d-873c-30f43a8954c3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:44.345811 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cbef654b-e192-402d-873c-30f43a8954c3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:44.508227 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-cbef654b-e192-402d-873c-30f43a8954c3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:44.519834 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-cbef654b-e192-402d-873c-30f43a8954c3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/99a904a8-aa6f-468e-a869-07cb3c5a1053" status: 200 len: 1272 microversion: 2.1 time: 0.204353 Aug 31 16:03:44.522480 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1522/2972] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:44 2022] GET /compute/v2.1/servers/99a904a8-aa6f-468e-a869-07cb3c5a1053 => generated 1272 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:44.536354 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3fb0ee15-4fae-4362-9e84-0cc47eb96faf tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:44.536780 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3fb0ee15-4fae-4362-9e84-0cc47eb96faf tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] [instance: d18fee50-f30d-44c3-9ac5-18aaace88e65] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:44.548757 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3fb0ee15-4fae-4362-9e84-0cc47eb96faf tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:44.549364 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3fb0ee15-4fae-4362-9e84-0cc47eb96faf tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:44.549816 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3fb0ee15-4fae-4362-9e84-0cc47eb96faf tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:44.550560 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3fb0ee15-4fae-4362-9e84-0cc47eb96faf tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:44.551079 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3fb0ee15-4fae-4362-9e84-0cc47eb96faf tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:44.551669 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3fb0ee15-4fae-4362-9e84-0cc47eb96faf tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:44.575572 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-3fb0ee15-4fae-4362-9e84-0cc47eb96faf tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] HTTP exception thrown: Instance d18fee50-f30d-44c3-9ac5-18aaace88e65 could not be found. Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3fb0ee15-4fae-4362-9e84-0cc47eb96faf tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Request method failure captured: Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/d18fee50-f30d-44c3-9ac5-18aaace88e65 HTTP/1.1 Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4Xkkepu06Zbr2QwlxAeYAXaprRnFLOozcB075W5HET-0b_KmsqaghYLku7x9bCOqGS5t1k5-3UhWEgO1NSLk4QWKtGimBw8A6V9-N9zhLGYN2voGaci99gzG5KwpsRzdRxzK8dkUekeW9DM4vpgrB0a3SN7t-cexkft6h2SiyXsVJo Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: abd7cf0fb56d40dca0d158268001b107 Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1451141319 Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/abd7cf0fb56d40dca0d158268001b107"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/abd7cf0fb56d40dca0d158268001b107"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/abd7cf0fb56d40dca0d158268001b107"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_abd7cf0fb56d40dca0d158268001b107", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1451141319 Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: abd7cf0fb56d40dca0d158268001b107 Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1451141319 Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-FloatingIPsAssociationTestJSON-1451141319-project Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: d3c15400d81847c09c81b04b668560b7 Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1451141319-project Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance d18fee50-f30d-44c3-9ac5-18aaace88e65 could not be found. Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'd18fee50-f30d-44c3-9ac5-18aaace88e65'} Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d18fee50-f30d-44c3-9ac5-18aaace88e65 could not be found. Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d18fee50-f30d-44c3-9ac5-18aaace88e65 could not be found. Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:03:44.578011 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:03:44.584424 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:03:44.584424 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:03:44.584424 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:03:44.584424 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:03:44.584424 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:03:44.584424 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:03:44.584424 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d18fee50-f30d-44c3-9ac5-18aaace88e65 could not be found. Aug 31 16:03:44.584424 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:03:44.584424 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3fb0ee15-4fae-4362-9e84-0cc47eb96faf tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] Returning 404 to user: Instance d18fee50-f30d-44c3-9ac5-18aaace88e65 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:03:44.584424 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3fb0ee15-4fae-4362-9e84-0cc47eb96faf tempest-FloatingIPsAssociationTestJSON-1451141319 tempest-FloatingIPsAssociationTestJSON-1451141319-project] 10.222.0.50 "GET /compute/v2.1/servers/d18fee50-f30d-44c3-9ac5-18aaace88e65" status: 404 len: 111 microversion: 2.1 time: 0.055456 Aug 31 16:03:44.584424 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1523/2973] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:44 2022] GET /compute/v2.1/servers/d18fee50-f30d-44c3-9ac5-18aaace88e65 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:03:44.628325 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-15680699-f165-460b-ad51-f4b33fa80c43 req-0c8492ce-f245-4bdc-bdfb-ae3c47bd0b79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9", "tag": "0e3734e2-2119-411e-bd8e-c6da7c160678"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:44.642225 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-15680699-f165-460b-ad51-f4b33fa80c43 req-0c8492ce-f245-4bdc-bdfb-ae3c47bd0b79 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:44.642702 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-15680699-f165-460b-ad51-f4b33fa80c43 req-0c8492ce-f245-4bdc-bdfb-ae3c47bd0b79 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:44.644998 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-15680699-f165-460b-ad51-f4b33fa80c43 req-0c8492ce-f245-4bdc-bdfb-ae3c47bd0b79 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:44.674680 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-15680699-f165-460b-ad51-f4b33fa80c43 req-0c8492ce-f245-4bdc-bdfb-ae3c47bd0b79 service nova] Creating event network-changed:0e3734e2-2119-411e-bd8e-c6da7c160678 for instance a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 on n-h2-833090-16 Aug 31 16:03:44.696658 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-15680699-f165-460b-ad51-f4b33fa80c43 req-0c8492ce-f245-4bdc-bdfb-ae3c47bd0b79 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079693 Aug 31 16:03:44.698864 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1524/2974] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:03:44.859125 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a4b01c1f-2a04-43ee-abf8-5bfe9abe9792 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:44.879363 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a4b01c1f-2a04-43ee-abf8-5bfe9abe9792 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc" status: 200 len: 1359 microversion: 2.1 time: 0.698814 Aug 31 16:03:44.904183 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1451/2975] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:44 2022] GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc => generated 1359 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:45.203955 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-efee84c7-a8e6-4ce4-ae74-64719704142d tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:45.205283 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-efee84c7-a8e6-4ce4-ae74-64719704142d tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:45.217133 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-efee84c7-a8e6-4ce4-ae74-64719704142d tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:45.217644 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-efee84c7-a8e6-4ce4-ae74-64719704142d tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:45.218077 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-efee84c7-a8e6-4ce4-ae74-64719704142d tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:45.222737 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-efee84c7-a8e6-4ce4-ae74-64719704142d tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:45.223227 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-efee84c7-a8e6-4ce4-ae74-64719704142d tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:45.225161 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-efee84c7-a8e6-4ce4-ae74-64719704142d tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:45.337545 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-28f0eda1-f65c-4762-b608-b0bc08fef1c9 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:45.338924 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-28f0eda1-f65c-4762-b608-b0bc08fef1c9 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:45.353981 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28f0eda1-f65c-4762-b608-b0bc08fef1c9 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:45.354897 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28f0eda1-f65c-4762-b608-b0bc08fef1c9 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:45.355561 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28f0eda1-f65c-4762-b608-b0bc08fef1c9 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:45.356486 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28f0eda1-f65c-4762-b608-b0bc08fef1c9 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:45.357157 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28f0eda1-f65c-4762-b608-b0bc08fef1c9 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:45.357796 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28f0eda1-f65c-4762-b608-b0bc08fef1c9 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:46.617503 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-efee84c7-a8e6-4ce4-ae74-64719704142d tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:46.638012 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-efee84c7-a8e6-4ce4-ae74-64719704142d tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:46.640803 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-efee84c7-a8e6-4ce4-ae74-64719704142d tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:46.646742 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-efee84c7-a8e6-4ce4-ae74-64719704142d tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 1875 microversion: 2.42 time: 1.447573 Aug 31 16:03:46.648720 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1525/2976] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:03:45 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 1875 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:03:46.659429 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-01e2e33c-d11c-4af0-87eb-bf4bce9cb8af tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:46.662905 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-01e2e33c-d11c-4af0-87eb-bf4bce9cb8af tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 99a904a8-aa6f-468e-a869-07cb3c5a1053] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:46.683872 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01e2e33c-d11c-4af0-87eb-bf4bce9cb8af tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:46.687637 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01e2e33c-d11c-4af0-87eb-bf4bce9cb8af tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:46.688312 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01e2e33c-d11c-4af0-87eb-bf4bce9cb8af tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:46.689273 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01e2e33c-d11c-4af0-87eb-bf4bce9cb8af tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:46.692183 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01e2e33c-d11c-4af0-87eb-bf4bce9cb8af tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:46.692901 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01e2e33c-d11c-4af0-87eb-bf4bce9cb8af tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:46.921704 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-28f0eda1-f65c-4762-b608-b0bc08fef1c9 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:46.941315 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-28f0eda1-f65c-4762-b608-b0bc08fef1c9 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:46.943720 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-28f0eda1-f65c-4762-b608-b0bc08fef1c9 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:46.945496 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-28f0eda1-f65c-4762-b608-b0bc08fef1c9 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1869 microversion: 2.32 time: 1.611783 Aug 31 16:03:46.958948 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1452/2977] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:03:45 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1869 bytes in 1626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:03:46.968773 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-78978eb4-670f-48ae-a6ff-083ba6f68ee1 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:46.969783 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-78978eb4-670f-48ae-a6ff-083ba6f68ee1 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:46.979430 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78978eb4-670f-48ae-a6ff-083ba6f68ee1 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:46.980472 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78978eb4-670f-48ae-a6ff-083ba6f68ee1 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:46.981163 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78978eb4-670f-48ae-a6ff-083ba6f68ee1 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:46.982360 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78978eb4-670f-48ae-a6ff-083ba6f68ee1 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:46.983047 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78978eb4-670f-48ae-a6ff-083ba6f68ee1 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:46.983706 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78978eb4-670f-48ae-a6ff-083ba6f68ee1 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:47.140485 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-01e2e33c-d11c-4af0-87eb-bf4bce9cb8af tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:47.154481 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-01e2e33c-d11c-4af0-87eb-bf4bce9cb8af tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/99a904a8-aa6f-468e-a869-07cb3c5a1053" status: 200 len: 1314 microversion: 2.1 time: 0.499984 Aug 31 16:03:47.158465 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1526/2978] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:46 2022] GET /compute/v2.1/servers/99a904a8-aa6f-468e-a869-07cb3c5a1053 => generated 1314 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:47.163759 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-db0abf77-1a62-42ac-99e2-756cd1ce2ba4 req-08876d3c-3a94-41ec-9b4f-60f3d2033c38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "027ef860-8ede-472c-9099-befdc2cde7bc", "name": "network-vif-plugged", "status": "completed", "tag": "f3ddf80b-0487-4257-b3e5-b64f7214f531"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:47.195457 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-db0abf77-1a62-42ac-99e2-756cd1ce2ba4 req-08876d3c-3a94-41ec-9b4f-60f3d2033c38 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:47.196325 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-db0abf77-1a62-42ac-99e2-756cd1ce2ba4 req-08876d3c-3a94-41ec-9b4f-60f3d2033c38 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:47.197002 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-db0abf77-1a62-42ac-99e2-756cd1ce2ba4 req-08876d3c-3a94-41ec-9b4f-60f3d2033c38 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:47.230409 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-db0abf77-1a62-42ac-99e2-756cd1ce2ba4 req-08876d3c-3a94-41ec-9b4f-60f3d2033c38 service nova] Creating event network-vif-plugged:f3ddf80b-0487-4257-b3e5-b64f7214f531 for instance 027ef860-8ede-472c-9099-befdc2cde7bc on n-h1-833090-16 Aug 31 16:03:47.246709 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-db0abf77-1a62-42ac-99e2-756cd1ce2ba4 req-08876d3c-3a94-41ec-9b4f-60f3d2033c38 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086456 Aug 31 16:03:47.251807 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1527/2979] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:03:47.681945 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c804c4d6-f96c-489f-a868-74bdaf91a1e9 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:47.684099 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c804c4d6-f96c-489f-a868-74bdaf91a1e9 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:47.695658 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c804c4d6-f96c-489f-a868-74bdaf91a1e9 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:47.696439 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c804c4d6-f96c-489f-a868-74bdaf91a1e9 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:47.697171 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c804c4d6-f96c-489f-a868-74bdaf91a1e9 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:47.698734 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c804c4d6-f96c-489f-a868-74bdaf91a1e9 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:47.700265 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c804c4d6-f96c-489f-a868-74bdaf91a1e9 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:47.700935 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c804c4d6-f96c-489f-a868-74bdaf91a1e9 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:47.996808 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-78978eb4-670f-48ae-a6ff-083ba6f68ee1 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:48.008776 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-78978eb4-670f-48ae-a6ff-083ba6f68ee1 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc" status: 200 len: 1359 microversion: 2.1 time: 1.048234 Aug 31 16:03:48.022633 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1453/2980] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:46 2022] GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc => generated 1359 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:48.022633 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-353fd2ab-dae3-41bd-8ad4-bcb5d889c79c tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:48.022633 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-353fd2ab-dae3-41bd-8ad4-bcb5d889c79c tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:48.024723 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-353fd2ab-dae3-41bd-8ad4-bcb5d889c79c tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:48.025374 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-353fd2ab-dae3-41bd-8ad4-bcb5d889c79c tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:48.025663 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-353fd2ab-dae3-41bd-8ad4-bcb5d889c79c tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:48.026409 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-353fd2ab-dae3-41bd-8ad4-bcb5d889c79c tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:48.026864 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-353fd2ab-dae3-41bd-8ad4-bcb5d889c79c tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:48.027287 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-353fd2ab-dae3-41bd-8ad4-bcb5d889c79c tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:48.421125 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:03:48.461497 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:03:48.733208 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-353fd2ab-dae3-41bd-8ad4-bcb5d889c79c tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:48.747387 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-353fd2ab-dae3-41bd-8ad4-bcb5d889c79c tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:48.753245 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-353fd2ab-dae3-41bd-8ad4-bcb5d889c79c tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:48.754792 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-353fd2ab-dae3-41bd-8ad4-bcb5d889c79c tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1890 microversion: 2.32 time: 0.743799 Aug 31 16:03:48.755111 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1454/2981] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:03:48 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1890 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:03:48.776616 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3ee74894-dbd9-4b61-9e25-27e71d0f61f2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:48.777260 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3ee74894-dbd9-4b61-9e25-27e71d0f61f2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 99a904a8-aa6f-468e-a869-07cb3c5a1053] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:48.784105 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ee74894-dbd9-4b61-9e25-27e71d0f61f2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:48.784792 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ee74894-dbd9-4b61-9e25-27e71d0f61f2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:48.785237 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ee74894-dbd9-4b61-9e25-27e71d0f61f2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:48.786021 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ee74894-dbd9-4b61-9e25-27e71d0f61f2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:48.786617 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ee74894-dbd9-4b61-9e25-27e71d0f61f2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:48.787048 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ee74894-dbd9-4b61-9e25-27e71d0f61f2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:48.905507 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c804c4d6-f96c-489f-a868-74bdaf91a1e9 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:48.939120 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c804c4d6-f96c-489f-a868-74bdaf91a1e9 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:48.946212 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c804c4d6-f96c-489f-a868-74bdaf91a1e9 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:48.956831 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c804c4d6-f96c-489f-a868-74bdaf91a1e9 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 1875 microversion: 2.42 time: 1.281859 Aug 31 16:03:48.970872 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1528/2982] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:03:47 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 1875 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:03:48.991695 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-72cb68d6-d4a3-4afa-8a9f-6e2f386cc8c3 req-7be72225-9788-4d73-9be8-28560e526670 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23c0eef8-3969-41a5-9da9-4bae125f024f", "tag": "e7ccecd2-97d6-4aed-a87b-af665446815e"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:49.004056 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-72cb68d6-d4a3-4afa-8a9f-6e2f386cc8c3 req-7be72225-9788-4d73-9be8-28560e526670 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:49.004925 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-72cb68d6-d4a3-4afa-8a9f-6e2f386cc8c3 req-7be72225-9788-4d73-9be8-28560e526670 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:49.005645 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-72cb68d6-d4a3-4afa-8a9f-6e2f386cc8c3 req-7be72225-9788-4d73-9be8-28560e526670 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:49.020832 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-72cb68d6-d4a3-4afa-8a9f-6e2f386cc8c3 req-7be72225-9788-4d73-9be8-28560e526670 service nova] Creating event network-changed:e7ccecd2-97d6-4aed-a87b-af665446815e for instance 23c0eef8-3969-41a5-9da9-4bae125f024f on n-h2-833090-16 Aug 31 16:03:49.027997 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-72cb68d6-d4a3-4afa-8a9f-6e2f386cc8c3 req-7be72225-9788-4d73-9be8-28560e526670 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054868 Aug 31 16:03:49.028968 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1529/2983] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:03:49.035273 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-aee218ed-cf05-4be3-aaa6-db2331f4371a req-711eb83c-6b9a-45fb-ad69-1963cea4295a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9", "tag": "f9cdc28e-e2d4-4e82-a9fd-a5a05b15a14c"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:49.053522 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-aee218ed-cf05-4be3-aaa6-db2331f4371a req-711eb83c-6b9a-45fb-ad69-1963cea4295a service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:49.054338 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-aee218ed-cf05-4be3-aaa6-db2331f4371a req-711eb83c-6b9a-45fb-ad69-1963cea4295a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:49.054987 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-aee218ed-cf05-4be3-aaa6-db2331f4371a req-711eb83c-6b9a-45fb-ad69-1963cea4295a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:49.073001 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-aee218ed-cf05-4be3-aaa6-db2331f4371a req-711eb83c-6b9a-45fb-ad69-1963cea4295a service nova] Creating event network-changed:f9cdc28e-e2d4-4e82-a9fd-a5a05b15a14c for instance a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 on n-h2-833090-16 Aug 31 16:03:49.085064 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-aee218ed-cf05-4be3-aaa6-db2331f4371a req-711eb83c-6b9a-45fb-ad69-1963cea4295a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053167 Aug 31 16:03:49.086824 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1530/2984] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:03:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:03:49.097440 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-bfd6e80b-d8a9-4a96-a4ad-1400cf2a6dc9 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:49.100269 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-bfd6e80b-d8a9-4a96-a4ad-1400cf2a6dc9 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:49.114429 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bfd6e80b-d8a9-4a96-a4ad-1400cf2a6dc9 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:49.115486 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bfd6e80b-d8a9-4a96-a4ad-1400cf2a6dc9 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:49.116170 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bfd6e80b-d8a9-4a96-a4ad-1400cf2a6dc9 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:49.117199 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bfd6e80b-d8a9-4a96-a4ad-1400cf2a6dc9 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:49.117931 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bfd6e80b-d8a9-4a96-a4ad-1400cf2a6dc9 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:49.118642 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bfd6e80b-d8a9-4a96-a4ad-1400cf2a6dc9 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:49.600908 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3ee74894-dbd9-4b61-9e25-27e71d0f61f2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:49.617338 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3ee74894-dbd9-4b61-9e25-27e71d0f61f2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/99a904a8-aa6f-468e-a869-07cb3c5a1053" status: 200 len: 1314 microversion: 2.1 time: 0.844478 Aug 31 16:03:49.617943 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1455/2985] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:48 2022] GET /compute/v2.1/servers/99a904a8-aa6f-468e-a869-07cb3c5a1053 => generated 1314 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:49.715620 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-bfd6e80b-d8a9-4a96-a4ad-1400cf2a6dc9 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:49.725898 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-bfd6e80b-d8a9-4a96-a4ad-1400cf2a6dc9 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc" status: 200 len: 1359 microversion: 2.1 time: 0.637058 Aug 31 16:03:49.727246 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1531/2986] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:49 2022] GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc => generated 1359 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:49.779833 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-17dd8704-0f1c-464d-8472-54773fe959cb tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:49.790758 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-17dd8704-0f1c-464d-8472-54773fe959cb tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:49.799923 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-17dd8704-0f1c-464d-8472-54773fe959cb tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:49.800884 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-17dd8704-0f1c-464d-8472-54773fe959cb tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:49.802164 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-17dd8704-0f1c-464d-8472-54773fe959cb tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:49.803457 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-17dd8704-0f1c-464d-8472-54773fe959cb tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:49.804936 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-17dd8704-0f1c-464d-8472-54773fe959cb tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:49.806332 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-17dd8704-0f1c-464d-8472-54773fe959cb tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:50.004080 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6b164a99-f286-4b6e-a33b-a3019b1c96b8 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:50.005052 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6b164a99-f286-4b6e-a33b-a3019b1c96b8 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:50.039755 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6b164a99-f286-4b6e-a33b-a3019b1c96b8 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:50.040607 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6b164a99-f286-4b6e-a33b-a3019b1c96b8 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:50.041311 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6b164a99-f286-4b6e-a33b-a3019b1c96b8 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:50.042350 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6b164a99-f286-4b6e-a33b-a3019b1c96b8 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:50.043012 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6b164a99-f286-4b6e-a33b-a3019b1c96b8 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:50.048095 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6b164a99-f286-4b6e-a33b-a3019b1c96b8 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:50.860914 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-17dd8704-0f1c-464d-8472-54773fe959cb tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:50.877517 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-17dd8704-0f1c-464d-8472-54773fe959cb tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:50.882463 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-17dd8704-0f1c-464d-8472-54773fe959cb tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:50.885071 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-17dd8704-0f1c-464d-8472-54773fe959cb tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1890 microversion: 2.32 time: 1.109447 Aug 31 16:03:50.887485 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1456/2987] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:03:49 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1890 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:03:50.894810 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6e3d3fac-b79b-4f93-b528-55d78b8c6189 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:50.896037 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6e3d3fac-b79b-4f93-b528-55d78b8c6189 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 99a904a8-aa6f-468e-a869-07cb3c5a1053] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:50.904891 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6e3d3fac-b79b-4f93-b528-55d78b8c6189 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:50.906715 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6e3d3fac-b79b-4f93-b528-55d78b8c6189 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:50.907165 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6e3d3fac-b79b-4f93-b528-55d78b8c6189 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:50.907920 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6e3d3fac-b79b-4f93-b528-55d78b8c6189 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:50.908474 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6e3d3fac-b79b-4f93-b528-55d78b8c6189 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:50.911805 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6e3d3fac-b79b-4f93-b528-55d78b8c6189 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:50.949216 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6b164a99-f286-4b6e-a33b-a3019b1c96b8 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:50.965355 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6b164a99-f286-4b6e-a33b-a3019b1c96b8 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:50.967673 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6b164a99-f286-4b6e-a33b-a3019b1c96b8 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:50.972699 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6b164a99-f286-4b6e-a33b-a3019b1c96b8 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 1875 microversion: 2.42 time: 0.974581 Aug 31 16:03:50.974638 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1532/2988] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:03:49 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 1875 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:03:50.980935 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9187c3a7-5a42-4cb3-b992-4f9cd895a092 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:50.982428 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9187c3a7-5a42-4cb3-b992-4f9cd895a092 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:50.990855 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9187c3a7-5a42-4cb3-b992-4f9cd895a092 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:50.992814 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9187c3a7-5a42-4cb3-b992-4f9cd895a092 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:50.993463 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9187c3a7-5a42-4cb3-b992-4f9cd895a092 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:50.994656 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9187c3a7-5a42-4cb3-b992-4f9cd895a092 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:50.995281 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9187c3a7-5a42-4cb3-b992-4f9cd895a092 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:50.995863 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9187c3a7-5a42-4cb3-b992-4f9cd895a092 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:51.464095 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6e3d3fac-b79b-4f93-b528-55d78b8c6189 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:51.475047 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6e3d3fac-b79b-4f93-b528-55d78b8c6189 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/99a904a8-aa6f-468e-a869-07cb3c5a1053" status: 200 len: 1314 microversion: 2.1 time: 0.585652 Aug 31 16:03:51.477417 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1457/2989] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:50 2022] GET /compute/v2.1/servers/99a904a8-aa6f-468e-a869-07cb3c5a1053 => generated 1314 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:51.482696 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-0e3f63cb-dfdd-45fd-9b1f-df286d0b02db req-3a59f96a-bd07-45b4-b469-e5e1ca5ef566 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99a904a8-aa6f-468e-a869-07cb3c5a1053", "tag": "62908a26-9d9f-46fd-ab15-e46806202bf5"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:51.500215 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-0e3f63cb-dfdd-45fd-9b1f-df286d0b02db req-3a59f96a-bd07-45b4-b469-e5e1ca5ef566 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:51.500697 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-0e3f63cb-dfdd-45fd-9b1f-df286d0b02db req-3a59f96a-bd07-45b4-b469-e5e1ca5ef566 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:51.501127 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-0e3f63cb-dfdd-45fd-9b1f-df286d0b02db req-3a59f96a-bd07-45b4-b469-e5e1ca5ef566 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:51.515431 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-0e3f63cb-dfdd-45fd-9b1f-df286d0b02db req-3a59f96a-bd07-45b4-b469-e5e1ca5ef566 service nova] Creating event network-changed:62908a26-9d9f-46fd-ab15-e46806202bf5 for instance 99a904a8-aa6f-468e-a869-07cb3c5a1053 on n-h1-833090-16 Aug 31 16:03:51.521789 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-0e3f63cb-dfdd-45fd-9b1f-df286d0b02db req-3a59f96a-bd07-45b4-b469-e5e1ca5ef566 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042763 Aug 31 16:03:51.524051 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1458/2990] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:03:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:03:51.535349 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9187c3a7-5a42-4cb3-b992-4f9cd895a092 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:51.548536 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9187c3a7-5a42-4cb3-b992-4f9cd895a092 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc" status: 200 len: 1542 microversion: 2.1 time: 0.572572 Aug 31 16:03:51.549448 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1533/2991] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:50 2022] GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc => generated 1542 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:51.572464 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4581de89-bb47-40b5-99b2-49d29463c83a tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:51.573150 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4581de89-bb47-40b5-99b2-49d29463c83a tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:51.591547 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4581de89-bb47-40b5-99b2-49d29463c83a tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:51.592158 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4581de89-bb47-40b5-99b2-49d29463c83a tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:51.592679 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4581de89-bb47-40b5-99b2-49d29463c83a tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:51.593479 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4581de89-bb47-40b5-99b2-49d29463c83a tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:51.594019 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4581de89-bb47-40b5-99b2-49d29463c83a tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:51.594543 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4581de89-bb47-40b5-99b2-49d29463c83a tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:51.611359 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:03:51.725581 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4581de89-bb47-40b5-99b2-49d29463c83a tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.157257 Aug 31 16:03:51.727604 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1459/2992] 10.222.0.50 () {58 vars in 1275 bytes} [Wed Aug 31 16:03:51 2022] GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc/os-interface => generated 284 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:03:51.910578 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c1b1769c-3a9a-4050-a3b7-e73357c131f5 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:51.911570 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c1b1769c-3a9a-4050-a3b7-e73357c131f5 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:51.925979 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c1b1769c-3a9a-4050-a3b7-e73357c131f5 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:51.927161 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c1b1769c-3a9a-4050-a3b7-e73357c131f5 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:51.929694 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c1b1769c-3a9a-4050-a3b7-e73357c131f5 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:51.930717 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c1b1769c-3a9a-4050-a3b7-e73357c131f5 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:51.932625 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c1b1769c-3a9a-4050-a3b7-e73357c131f5 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:51.933834 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c1b1769c-3a9a-4050-a3b7-e73357c131f5 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:52.004540 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b0aaec50-104d-48bd-9865-9400bc1cff23 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:52.006882 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b0aaec50-104d-48bd-9865-9400bc1cff23 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:52.017287 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0aaec50-104d-48bd-9865-9400bc1cff23 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:52.019551 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0aaec50-104d-48bd-9865-9400bc1cff23 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:52.021002 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0aaec50-104d-48bd-9865-9400bc1cff23 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:52.023120 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0aaec50-104d-48bd-9865-9400bc1cff23 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:52.024295 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0aaec50-104d-48bd-9865-9400bc1cff23 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:52.025370 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0aaec50-104d-48bd-9865-9400bc1cff23 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:52.685547 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c1b1769c-3a9a-4050-a3b7-e73357c131f5 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:52.702321 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c1b1769c-3a9a-4050-a3b7-e73357c131f5 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:52.705505 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c1b1769c-3a9a-4050-a3b7-e73357c131f5 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:52.710781 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c1b1769c-3a9a-4050-a3b7-e73357c131f5 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1878 microversion: 2.32 time: 0.802647 Aug 31 16:03:52.713926 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1534/2993] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:03:51 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1878 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:03:52.724156 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-89988f91-f245-42e8-9664-ff6f5ef36ad9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:52.727632 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-89988f91-f245-42e8-9664-ff6f5ef36ad9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 99a904a8-aa6f-468e-a869-07cb3c5a1053] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:52.748351 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-89988f91-f245-42e8-9664-ff6f5ef36ad9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:52.749515 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-89988f91-f245-42e8-9664-ff6f5ef36ad9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:52.750601 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-89988f91-f245-42e8-9664-ff6f5ef36ad9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:52.753909 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-89988f91-f245-42e8-9664-ff6f5ef36ad9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:52.755118 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-89988f91-f245-42e8-9664-ff6f5ef36ad9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:52.755762 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-89988f91-f245-42e8-9664-ff6f5ef36ad9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:53.359558 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b0aaec50-104d-48bd-9865-9400bc1cff23 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:53.375356 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b0aaec50-104d-48bd-9865-9400bc1cff23 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:53.380016 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b0aaec50-104d-48bd-9865-9400bc1cff23 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:53.387335 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b0aaec50-104d-48bd-9865-9400bc1cff23 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 1875 microversion: 2.42 time: 1.386203 Aug 31 16:03:53.390886 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1460/2994] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:03:51 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 1875 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:03:53.622921 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-89988f91-f245-42e8-9664-ff6f5ef36ad9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:53.637845 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-89988f91-f245-42e8-9664-ff6f5ef36ad9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/99a904a8-aa6f-468e-a869-07cb3c5a1053" status: 200 len: 1314 microversion: 2.1 time: 0.922475 Aug 31 16:03:53.638831 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1535/2995] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:52 2022] GET /compute/v2.1/servers/99a904a8-aa6f-468e-a869-07cb3c5a1053 => generated 1314 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:53.741333 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-df4d5189-4d8e-4eeb-a90e-48e4924380de tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:53.742273 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-df4d5189-4d8e-4eeb-a90e-48e4924380de tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:53.756612 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df4d5189-4d8e-4eeb-a90e-48e4924380de tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:53.758783 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df4d5189-4d8e-4eeb-a90e-48e4924380de tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:53.760261 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df4d5189-4d8e-4eeb-a90e-48e4924380de tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:53.763341 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df4d5189-4d8e-4eeb-a90e-48e4924380de tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:53.767152 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df4d5189-4d8e-4eeb-a90e-48e4924380de tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:53.767891 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df4d5189-4d8e-4eeb-a90e-48e4924380de tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:53.926934 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-2c2afabc-8912-4b56-9dc6-276e80a7342e req-12c75ed9-346e-41d3-bf38-bf8a1610853d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9", "tag": "01d2be63-7429-490a-bba0-954dc6039768"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:53.939433 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-2c2afabc-8912-4b56-9dc6-276e80a7342e req-12c75ed9-346e-41d3-bf38-bf8a1610853d service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:53.939912 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-2c2afabc-8912-4b56-9dc6-276e80a7342e req-12c75ed9-346e-41d3-bf38-bf8a1610853d service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:53.940607 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-2c2afabc-8912-4b56-9dc6-276e80a7342e req-12c75ed9-346e-41d3-bf38-bf8a1610853d service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:53.963684 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-2c2afabc-8912-4b56-9dc6-276e80a7342e req-12c75ed9-346e-41d3-bf38-bf8a1610853d service nova] Creating event network-changed:01d2be63-7429-490a-bba0-954dc6039768 for instance a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 on n-h2-833090-16 Aug 31 16:03:53.974654 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-2c2afabc-8912-4b56-9dc6-276e80a7342e req-12c75ed9-346e-41d3-bf38-bf8a1610853d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051132 Aug 31 16:03:53.976177 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1536/2996] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:03:54.415442 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2e70aa2c-a786-45a6-9926-3a135d1219c7 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:54.416977 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2e70aa2c-a786-45a6-9926-3a135d1219c7 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:54.427181 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2e70aa2c-a786-45a6-9926-3a135d1219c7 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:54.427602 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2e70aa2c-a786-45a6-9926-3a135d1219c7 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:54.428042 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2e70aa2c-a786-45a6-9926-3a135d1219c7 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:54.428797 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2e70aa2c-a786-45a6-9926-3a135d1219c7 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:54.429256 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2e70aa2c-a786-45a6-9926-3a135d1219c7 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:54.429681 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2e70aa2c-a786-45a6-9926-3a135d1219c7 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:54.544840 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-df4d5189-4d8e-4eeb-a90e-48e4924380de tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:54.561576 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-df4d5189-4d8e-4eeb-a90e-48e4924380de tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:54.569290 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-df4d5189-4d8e-4eeb-a90e-48e4924380de tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:54.571580 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-df4d5189-4d8e-4eeb-a90e-48e4924380de tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1878 microversion: 2.32 time: 0.835648 Aug 31 16:03:54.572803 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1461/2997] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:03:53 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1878 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:03:54.671212 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ca8e223b-f7cd-4e6e-b637-d92a8adb23e7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:54.673970 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ca8e223b-f7cd-4e6e-b637-d92a8adb23e7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 99a904a8-aa6f-468e-a869-07cb3c5a1053] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:54.690364 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca8e223b-f7cd-4e6e-b637-d92a8adb23e7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:54.692160 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca8e223b-f7cd-4e6e-b637-d92a8adb23e7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:54.694432 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca8e223b-f7cd-4e6e-b637-d92a8adb23e7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:54.699879 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca8e223b-f7cd-4e6e-b637-d92a8adb23e7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:54.701279 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca8e223b-f7cd-4e6e-b637-d92a8adb23e7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:54.704611 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca8e223b-f7cd-4e6e-b637-d92a8adb23e7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:55.050278 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2e70aa2c-a786-45a6-9926-3a135d1219c7 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:55.084513 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2e70aa2c-a786-45a6-9926-3a135d1219c7 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:55.096838 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2e70aa2c-a786-45a6-9926-3a135d1219c7 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:55.108331 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2e70aa2c-a786-45a6-9926-3a135d1219c7 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 1875 microversion: 2.42 time: 0.691998 Aug 31 16:03:55.111210 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1537/2998] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:03:54 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 1875 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:03:55.495735 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-18ca05f6-1eae-4611-ac69-5611d3c60a9c req-71f402ee-bb78-4225-8414-554f79602643 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "027ef860-8ede-472c-9099-befdc2cde7bc", "tag": "f3ddf80b-0487-4257-b3e5-b64f7214f531"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:55.524066 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-18ca05f6-1eae-4611-ac69-5611d3c60a9c req-71f402ee-bb78-4225-8414-554f79602643 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:55.524953 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-18ca05f6-1eae-4611-ac69-5611d3c60a9c req-71f402ee-bb78-4225-8414-554f79602643 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:55.527187 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-18ca05f6-1eae-4611-ac69-5611d3c60a9c req-71f402ee-bb78-4225-8414-554f79602643 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:55.571202 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-18ca05f6-1eae-4611-ac69-5611d3c60a9c req-71f402ee-bb78-4225-8414-554f79602643 service nova] Creating event network-changed:f3ddf80b-0487-4257-b3e5-b64f7214f531 for instance 027ef860-8ede-472c-9099-befdc2cde7bc on n-h1-833090-16 Aug 31 16:03:55.580875 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-18ca05f6-1eae-4611-ac69-5611d3c60a9c req-71f402ee-bb78-4225-8414-554f79602643 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087885 Aug 31 16:03:55.582310 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1538/2999] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:03:55.631918 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ca8e223b-f7cd-4e6e-b637-d92a8adb23e7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:55.645368 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ca8e223b-f7cd-4e6e-b637-d92a8adb23e7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/99a904a8-aa6f-468e-a869-07cb3c5a1053" status: 200 len: 1314 microversion: 2.1 time: 0.983330 Aug 31 16:03:55.647245 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1462/3000] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:54 2022] GET /compute/v2.1/servers/99a904a8-aa6f-468e-a869-07cb3c5a1053 => generated 1314 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:55.649001 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e67708a2-555d-4965-9a7c-08c786c6dd0d tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:55.649785 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e67708a2-555d-4965-9a7c-08c786c6dd0d tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:55.664967 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e67708a2-555d-4965-9a7c-08c786c6dd0d tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:55.665560 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e67708a2-555d-4965-9a7c-08c786c6dd0d tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:55.666588 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e67708a2-555d-4965-9a7c-08c786c6dd0d tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:55.667868 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e67708a2-555d-4965-9a7c-08c786c6dd0d tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:55.669397 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e67708a2-555d-4965-9a7c-08c786c6dd0d tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:55.670039 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e67708a2-555d-4965-9a7c-08c786c6dd0d tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:56.143633 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3f8c717c-6800-4aec-a2b0-ab45cffeddcb tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:56.144716 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3f8c717c-6800-4aec-a2b0-ab45cffeddcb tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:56.171287 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f8c717c-6800-4aec-a2b0-ab45cffeddcb tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:56.172556 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f8c717c-6800-4aec-a2b0-ab45cffeddcb tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:56.177548 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f8c717c-6800-4aec-a2b0-ab45cffeddcb tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:56.178069 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f8c717c-6800-4aec-a2b0-ab45cffeddcb tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:56.178570 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f8c717c-6800-4aec-a2b0-ab45cffeddcb tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:56.179003 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f8c717c-6800-4aec-a2b0-ab45cffeddcb tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:56.951184 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e67708a2-555d-4965-9a7c-08c786c6dd0d tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:56.965373 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e67708a2-555d-4965-9a7c-08c786c6dd0d tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:56.969776 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e67708a2-555d-4965-9a7c-08c786c6dd0d tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:56.974031 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e67708a2-555d-4965-9a7c-08c786c6dd0d tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1878 microversion: 2.32 time: 1.339138 Aug 31 16:03:56.974998 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1539/3001] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:03:55 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1878 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:03:56.986419 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-34ac2dd2-67b8-44c4-8b58-12614e6f8379 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:56.987657 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-34ac2dd2-67b8-44c4-8b58-12614e6f8379 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 99a904a8-aa6f-468e-a869-07cb3c5a1053] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:57.000537 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-34ac2dd2-67b8-44c4-8b58-12614e6f8379 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:57.005162 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-34ac2dd2-67b8-44c4-8b58-12614e6f8379 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:57.005893 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-34ac2dd2-67b8-44c4-8b58-12614e6f8379 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:57.007749 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-34ac2dd2-67b8-44c4-8b58-12614e6f8379 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:57.008421 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-34ac2dd2-67b8-44c4-8b58-12614e6f8379 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:57.009058 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-34ac2dd2-67b8-44c4-8b58-12614e6f8379 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:57.022889 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=100 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:03:57.290735 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3f8c717c-6800-4aec-a2b0-ab45cffeddcb tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:57.305112 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3f8c717c-6800-4aec-a2b0-ab45cffeddcb tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:57.307226 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3f8c717c-6800-4aec-a2b0-ab45cffeddcb tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:57.310224 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3f8c717c-6800-4aec-a2b0-ab45cffeddcb tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 1875 microversion: 2.42 time: 1.178220 Aug 31 16:03:57.317686 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1463/3002] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:03:56 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 1875 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:03:57.578300 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-071f7bc1-e3b6-4bd0-bb5e-4fd114dba2b6 req-f7abbae1-e1e7-4150-a579-6fd9c50bc004 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9", "tag": "cad2dd93-6ee0-4ee0-917c-bbf5d5f4da1d"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:57.629520 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-071f7bc1-e3b6-4bd0-bb5e-4fd114dba2b6 req-f7abbae1-e1e7-4150-a579-6fd9c50bc004 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:57.630346 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-071f7bc1-e3b6-4bd0-bb5e-4fd114dba2b6 req-f7abbae1-e1e7-4150-a579-6fd9c50bc004 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:57.636715 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-071f7bc1-e3b6-4bd0-bb5e-4fd114dba2b6 req-f7abbae1-e1e7-4150-a579-6fd9c50bc004 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:57.699164 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-071f7bc1-e3b6-4bd0-bb5e-4fd114dba2b6 req-f7abbae1-e1e7-4150-a579-6fd9c50bc004 service nova] Creating event network-changed:cad2dd93-6ee0-4ee0-917c-bbf5d5f4da1d for instance a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 on n-h2-833090-16 Aug 31 16:03:57.713658 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-071f7bc1-e3b6-4bd0-bb5e-4fd114dba2b6 req-f7abbae1-e1e7-4150-a579-6fd9c50bc004 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149747 Aug 31 16:03:57.717528 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1464/3003] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:03:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:03:57.960222 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-34ac2dd2-67b8-44c4-8b58-12614e6f8379 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:57.974327 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-34ac2dd2-67b8-44c4-8b58-12614e6f8379 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/99a904a8-aa6f-468e-a869-07cb3c5a1053" status: 200 len: 1314 microversion: 2.1 time: 0.996446 Aug 31 16:03:57.974965 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1540/3004] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:56 2022] GET /compute/v2.1/servers/99a904a8-aa6f-468e-a869-07cb3c5a1053 => generated 1314 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:03:58.002815 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3137bcf6-8773-4bb2-b5f4-9559e8b42bc0 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:58.003742 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3137bcf6-8773-4bb2-b5f4-9559e8b42bc0 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:58.027770 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3137bcf6-8773-4bb2-b5f4-9559e8b42bc0 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:58.031205 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3137bcf6-8773-4bb2-b5f4-9559e8b42bc0 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:58.031829 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3137bcf6-8773-4bb2-b5f4-9559e8b42bc0 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:58.032920 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3137bcf6-8773-4bb2-b5f4-9559e8b42bc0 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:58.033600 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3137bcf6-8773-4bb2-b5f4-9559e8b42bc0 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:58.038057 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3137bcf6-8773-4bb2-b5f4-9559e8b42bc0 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:58.349977 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-abc401af-ae36-410e-a5a2-1c09f1cbca02 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:58.351082 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-abc401af-ae36-410e-a5a2-1c09f1cbca02 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:58.364989 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-abc401af-ae36-410e-a5a2-1c09f1cbca02 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:58.366709 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-abc401af-ae36-410e-a5a2-1c09f1cbca02 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:58.368805 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-abc401af-ae36-410e-a5a2-1c09f1cbca02 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:58.370329 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-abc401af-ae36-410e-a5a2-1c09f1cbca02 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:58.372883 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-abc401af-ae36-410e-a5a2-1c09f1cbca02 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:58.373648 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-abc401af-ae36-410e-a5a2-1c09f1cbca02 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:59.373576 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3137bcf6-8773-4bb2-b5f4-9559e8b42bc0 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:59.387696 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3137bcf6-8773-4bb2-b5f4-9559e8b42bc0 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:59.396860 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3137bcf6-8773-4bb2-b5f4-9559e8b42bc0 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:59.405582 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-abc401af-ae36-410e-a5a2-1c09f1cbca02 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:59.414921 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3137bcf6-8773-4bb2-b5f4-9559e8b42bc0 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1878 microversion: 2.32 time: 1.412582 Aug 31 16:03:59.418207 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1465/3005] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:03:57 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1878 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:03:59.428157 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fa56e1d1-2766-4d7e-aa77-1ae5cf50f0c4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:03:59.430768 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fa56e1d1-2766-4d7e-aa77-1ae5cf50f0c4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 99a904a8-aa6f-468e-a869-07cb3c5a1053] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:03:59.442693 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=90 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:03:59.447146 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa56e1d1-2766-4d7e-aa77-1ae5cf50f0c4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:59.448471 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-abc401af-ae36-410e-a5a2-1c09f1cbca02 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:59.448978 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa56e1d1-2766-4d7e-aa77-1ae5cf50f0c4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:59.449843 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa56e1d1-2766-4d7e-aa77-1ae5cf50f0c4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:59.451886 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa56e1d1-2766-4d7e-aa77-1ae5cf50f0c4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:59.452655 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa56e1d1-2766-4d7e-aa77-1ae5cf50f0c4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:59.454677 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa56e1d1-2766-4d7e-aa77-1ae5cf50f0c4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:03:59.455820 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-abc401af-ae36-410e-a5a2-1c09f1cbca02 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:03:59.462824 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-abc401af-ae36-410e-a5a2-1c09f1cbca02 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 1875 microversion: 2.42 time: 1.114663 Aug 31 16:03:59.463929 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1541/3006] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:03:58 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 1875 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:03:59.942149 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-350ff5e8-8534-42d3-9f41-f6f275a089cd req-770ffe3b-8891-489c-8a8d-ddbb14045359 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99a904a8-aa6f-468e-a869-07cb3c5a1053", "name": "network-vif-plugged", "status": "completed", "tag": "62908a26-9d9f-46fd-ab15-e46806202bf5"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:03:59.990619 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-350ff5e8-8534-42d3-9f41-f6f275a089cd req-770ffe3b-8891-489c-8a8d-ddbb14045359 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:03:59.993159 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-350ff5e8-8534-42d3-9f41-f6f275a089cd req-770ffe3b-8891-489c-8a8d-ddbb14045359 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:03:59.993794 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-350ff5e8-8534-42d3-9f41-f6f275a089cd req-770ffe3b-8891-489c-8a8d-ddbb14045359 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:00.040159 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-350ff5e8-8534-42d3-9f41-f6f275a089cd req-770ffe3b-8891-489c-8a8d-ddbb14045359 service nova] Creating event network-vif-plugged:62908a26-9d9f-46fd-ab15-e46806202bf5 for instance 99a904a8-aa6f-468e-a869-07cb3c5a1053 on n-h1-833090-16 Aug 31 16:04:00.050006 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-350ff5e8-8534-42d3-9f41-f6f275a089cd req-770ffe3b-8891-489c-8a8d-ddbb14045359 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116679 Aug 31 16:04:00.051043 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1542/3007] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:04:00.061226 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-5257bb4b-e13b-498c-8b00-8b18fe412197 req-c1e3e25e-4343-4410-8723-309c7685894c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9", "tag": "18f5d3ba-5072-4e6c-8f7b-bfb9589950de"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:00.124871 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-5257bb4b-e13b-498c-8b00-8b18fe412197 req-c1e3e25e-4343-4410-8723-309c7685894c service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:00.125418 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-5257bb4b-e13b-498c-8b00-8b18fe412197 req-c1e3e25e-4343-4410-8723-309c7685894c service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:00.130879 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-5257bb4b-e13b-498c-8b00-8b18fe412197 req-c1e3e25e-4343-4410-8723-309c7685894c service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:00.180766 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-5257bb4b-e13b-498c-8b00-8b18fe412197 req-c1e3e25e-4343-4410-8723-309c7685894c service nova] Creating event network-changed:18f5d3ba-5072-4e6c-8f7b-bfb9589950de for instance a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 on n-h2-833090-16 Aug 31 16:04:00.202429 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-5257bb4b-e13b-498c-8b00-8b18fe412197 req-c1e3e25e-4343-4410-8723-309c7685894c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149434 Aug 31 16:04:00.203358 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1543/3008] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:04:00.298654 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fa56e1d1-2766-4d7e-aa77-1ae5cf50f0c4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:00.324486 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fa56e1d1-2766-4d7e-aa77-1ae5cf50f0c4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/99a904a8-aa6f-468e-a869-07cb3c5a1053" status: 200 len: 1314 microversion: 2.1 time: 0.903425 Aug 31 16:04:00.328896 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1466/3009] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:03:59 2022] GET /compute/v2.1/servers/99a904a8-aa6f-468e-a869-07cb3c5a1053 => generated 1314 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:00.455044 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fd5189fe-62f5-49aa-b1eb-1bd8c27433c2 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:00.460423 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fd5189fe-62f5-49aa-b1eb-1bd8c27433c2 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:00.487031 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fd5189fe-62f5-49aa-b1eb-1bd8c27433c2 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:00.502127 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fd5189fe-62f5-49aa-b1eb-1bd8c27433c2 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:00.504103 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fd5189fe-62f5-49aa-b1eb-1bd8c27433c2 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:00.508658 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fd5189fe-62f5-49aa-b1eb-1bd8c27433c2 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:00.511741 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fd5189fe-62f5-49aa-b1eb-1bd8c27433c2 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:00.513457 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fd5189fe-62f5-49aa-b1eb-1bd8c27433c2 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:00.520784 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-08bdefb7-6eb5-40a0-b925-d3cc35017e15 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:00.535408 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-08bdefb7-6eb5-40a0-b925-d3cc35017e15 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:00.582332 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-08bdefb7-6eb5-40a0-b925-d3cc35017e15 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:00.586355 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-08bdefb7-6eb5-40a0-b925-d3cc35017e15 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:00.587595 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-08bdefb7-6eb5-40a0-b925-d3cc35017e15 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:00.592614 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-08bdefb7-6eb5-40a0-b925-d3cc35017e15 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:00.593887 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-08bdefb7-6eb5-40a0-b925-d3cc35017e15 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:00.594952 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-08bdefb7-6eb5-40a0-b925-d3cc35017e15 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:01.886873 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-fd5189fe-62f5-49aa-b1eb-1bd8c27433c2 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:01.902783 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-fd5189fe-62f5-49aa-b1eb-1bd8c27433c2 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:01.907622 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-fd5189fe-62f5-49aa-b1eb-1bd8c27433c2 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:01.908972 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fd5189fe-62f5-49aa-b1eb-1bd8c27433c2 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1878 microversion: 2.32 time: 1.465156 Aug 31 16:04:01.909800 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1544/3010] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:00 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1878 bytes in 1468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:01.919938 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c0365893-56ee-4c63-b52e-83fead1d30be tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:01.920855 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c0365893-56ee-4c63-b52e-83fead1d30be tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 99a904a8-aa6f-468e-a869-07cb3c5a1053] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:01.940116 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:04:01.943310 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c0365893-56ee-4c63-b52e-83fead1d30be tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:01.944097 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c0365893-56ee-4c63-b52e-83fead1d30be tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:01.944758 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c0365893-56ee-4c63-b52e-83fead1d30be tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:01.946038 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c0365893-56ee-4c63-b52e-83fead1d30be tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:01.946734 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c0365893-56ee-4c63-b52e-83fead1d30be tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:01.947361 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c0365893-56ee-4c63-b52e-83fead1d30be tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:02.175331 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-08bdefb7-6eb5-40a0-b925-d3cc35017e15 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:02.200306 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-08bdefb7-6eb5-40a0-b925-d3cc35017e15 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:02.204030 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-08bdefb7-6eb5-40a0-b925-d3cc35017e15 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:02.208637 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-08bdefb7-6eb5-40a0-b925-d3cc35017e15 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 1875 microversion: 2.42 time: 1.706396 Aug 31 16:04:02.210679 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1467/3011] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:00 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 1875 bytes in 1710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:02.452701 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c0365893-56ee-4c63-b52e-83fead1d30be tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:02.462822 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c0365893-56ee-4c63-b52e-83fead1d30be tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/99a904a8-aa6f-468e-a869-07cb3c5a1053" status: 200 len: 1314 microversion: 2.1 time: 0.551706 Aug 31 16:04:02.463413 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1545/3012] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:01 2022] GET /compute/v2.1/servers/99a904a8-aa6f-468e-a869-07cb3c5a1053 => generated 1314 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:02.708401 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-5b85cb05-a1ab-46ce-92d1-22cc7d9481a2 req-960c0ccd-2a06-49b6-9cfe-cb015b3273fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9", "tag": "ddeb3d0d-f40d-487e-8c19-0d1274291781"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:02.733345 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5b85cb05-a1ab-46ce-92d1-22cc7d9481a2 req-960c0ccd-2a06-49b6-9cfe-cb015b3273fb service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:02.733828 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5b85cb05-a1ab-46ce-92d1-22cc7d9481a2 req-960c0ccd-2a06-49b6-9cfe-cb015b3273fb service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:02.734284 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5b85cb05-a1ab-46ce-92d1-22cc7d9481a2 req-960c0ccd-2a06-49b6-9cfe-cb015b3273fb service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:02.762066 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-5b85cb05-a1ab-46ce-92d1-22cc7d9481a2 req-960c0ccd-2a06-49b6-9cfe-cb015b3273fb service nova] Creating event network-changed:ddeb3d0d-f40d-487e-8c19-0d1274291781 for instance a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 on n-h2-833090-16 Aug 31 16:04:02.775245 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-5b85cb05-a1ab-46ce-92d1-22cc7d9481a2 req-960c0ccd-2a06-49b6-9cfe-cb015b3273fb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072219 Aug 31 16:04:02.778797 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1468/3013] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:04:02.935666 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-edbb3b10-43ce-4889-b19d-46b32b49e7f7 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:02.936291 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-edbb3b10-43ce-4889-b19d-46b32b49e7f7 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:02.956703 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-edbb3b10-43ce-4889-b19d-46b32b49e7f7 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:02.957337 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-edbb3b10-43ce-4889-b19d-46b32b49e7f7 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:02.957789 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-edbb3b10-43ce-4889-b19d-46b32b49e7f7 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:02.958946 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-edbb3b10-43ce-4889-b19d-46b32b49e7f7 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:02.959413 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-edbb3b10-43ce-4889-b19d-46b32b49e7f7 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:02.959843 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-edbb3b10-43ce-4889-b19d-46b32b49e7f7 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:03.244531 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-447dcf48-677d-4ab6-aba1-a4e08bfcbddd tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:03.248044 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-447dcf48-677d-4ab6-aba1-a4e08bfcbddd tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:03.260004 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-447dcf48-677d-4ab6-aba1-a4e08bfcbddd tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:03.261366 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-447dcf48-677d-4ab6-aba1-a4e08bfcbddd tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:03.262447 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-447dcf48-677d-4ab6-aba1-a4e08bfcbddd tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:03.264661 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-447dcf48-677d-4ab6-aba1-a4e08bfcbddd tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:03.265690 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-447dcf48-677d-4ab6-aba1-a4e08bfcbddd tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:03.266426 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-447dcf48-677d-4ab6-aba1-a4e08bfcbddd tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:03.555662 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-edbb3b10-43ce-4889-b19d-46b32b49e7f7 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:03.568373 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-edbb3b10-43ce-4889-b19d-46b32b49e7f7 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:03.569992 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-edbb3b10-43ce-4889-b19d-46b32b49e7f7 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:03.571486 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-edbb3b10-43ce-4889-b19d-46b32b49e7f7 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1878 microversion: 2.32 time: 0.640384 Aug 31 16:04:03.572642 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1546/3014] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:02 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1878 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:03.586592 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2cb65b79-0b2a-4e79-b226-76e4e4f767f7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:03.587647 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2cb65b79-0b2a-4e79-b226-76e4e4f767f7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 99a904a8-aa6f-468e-a869-07cb3c5a1053] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:03.598590 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2cb65b79-0b2a-4e79-b226-76e4e4f767f7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:03.599099 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2cb65b79-0b2a-4e79-b226-76e4e4f767f7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:03.599541 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2cb65b79-0b2a-4e79-b226-76e4e4f767f7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:03.600256 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2cb65b79-0b2a-4e79-b226-76e4e4f767f7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:03.601003 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2cb65b79-0b2a-4e79-b226-76e4e4f767f7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:03.601588 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2cb65b79-0b2a-4e79-b226-76e4e4f767f7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:03.888367 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-447dcf48-677d-4ab6-aba1-a4e08bfcbddd tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:03.901625 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-447dcf48-677d-4ab6-aba1-a4e08bfcbddd tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:03.903399 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-447dcf48-677d-4ab6-aba1-a4e08bfcbddd tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:03.904948 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-447dcf48-677d-4ab6-aba1-a4e08bfcbddd tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 1875 microversion: 2.42 time: 0.672860 Aug 31 16:04:03.906210 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1469/3015] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:03 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 1875 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:04.005781 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2cb65b79-0b2a-4e79-b226-76e4e4f767f7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:04.015819 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2cb65b79-0b2a-4e79-b226-76e4e4f767f7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/99a904a8-aa6f-468e-a869-07cb3c5a1053" status: 200 len: 1501 microversion: 2.1 time: 0.441873 Aug 31 16:04:04.016450 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1547/3016] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:03 2022] GET /compute/v2.1/servers/99a904a8-aa6f-468e-a869-07cb3c5a1053 => generated 1501 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:04.037376 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c7194839-06f9-4056-aea3-698a10db361c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:04.039640 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c7194839-06f9-4056-aea3-698a10db361c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 99a904a8-aa6f-468e-a869-07cb3c5a1053] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:04.045909 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7194839-06f9-4056-aea3-698a10db361c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:04.047095 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7194839-06f9-4056-aea3-698a10db361c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:04.047844 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7194839-06f9-4056-aea3-698a10db361c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:04.049012 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7194839-06f9-4056-aea3-698a10db361c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:04.049796 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7194839-06f9-4056-aea3-698a10db361c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:04.051300 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7194839-06f9-4056-aea3-698a10db361c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:04.098839 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c7194839-06f9-4056-aea3-698a10db361c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "POST /compute/v2.1/servers/99a904a8-aa6f-468e-a869-07cb3c5a1053/action" status: 200 len: 14 microversion: 2.1 time: 0.065644 Aug 31 16:04:04.099926 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1470/3017] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:04:04 2022] POST /compute/v2.1/servers/99a904a8-aa6f-468e-a869-07cb3c5a1053/action => generated 14 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:04:04.605274 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5be22683-06c9-4d52-93c6-91d131ab9eb7 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:04.606691 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5be22683-06c9-4d52-93c6-91d131ab9eb7 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:04.616225 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5be22683-06c9-4d52-93c6-91d131ab9eb7 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:04.617687 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5be22683-06c9-4d52-93c6-91d131ab9eb7 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:04.618577 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5be22683-06c9-4d52-93c6-91d131ab9eb7 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:04.620943 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5be22683-06c9-4d52-93c6-91d131ab9eb7 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:04.621876 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5be22683-06c9-4d52-93c6-91d131ab9eb7 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:04.623257 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5be22683-06c9-4d52-93c6-91d131ab9eb7 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:04.930654 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5f75f69b-60bd-44f4-941d-d0c4967b7615 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:04.931139 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5f75f69b-60bd-44f4-941d-d0c4967b7615 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:04.949625 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f75f69b-60bd-44f4-941d-d0c4967b7615 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:04.950421 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f75f69b-60bd-44f4-941d-d0c4967b7615 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:04.951017 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f75f69b-60bd-44f4-941d-d0c4967b7615 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:04.953361 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f75f69b-60bd-44f4-941d-d0c4967b7615 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:04.954121 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f75f69b-60bd-44f4-941d-d0c4967b7615 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:04.955382 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f75f69b-60bd-44f4-941d-d0c4967b7615 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:04.988058 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5be22683-06c9-4d52-93c6-91d131ab9eb7 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:05.006640 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5be22683-06c9-4d52-93c6-91d131ab9eb7 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:05.022421 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5be22683-06c9-4d52-93c6-91d131ab9eb7 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:05.024090 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5be22683-06c9-4d52-93c6-91d131ab9eb7 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1878 microversion: 2.32 time: 0.424204 Aug 31 16:04:05.025185 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1548/3018] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:04 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1878 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:04:05.118322 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-753608a7-88e2-4855-a44b-82aee2bafccb tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:05.125643 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-753608a7-88e2-4855-a44b-82aee2bafccb tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 99a904a8-aa6f-468e-a869-07cb3c5a1053] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:05.151581 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-753608a7-88e2-4855-a44b-82aee2bafccb tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:05.152091 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-753608a7-88e2-4855-a44b-82aee2bafccb tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:05.153161 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-753608a7-88e2-4855-a44b-82aee2bafccb tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:05.153938 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-753608a7-88e2-4855-a44b-82aee2bafccb tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:05.154436 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-753608a7-88e2-4855-a44b-82aee2bafccb tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:05.156261 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-753608a7-88e2-4855-a44b-82aee2bafccb tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:05.227973 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-753608a7-88e2-4855-a44b-82aee2bafccb tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "POST /compute/v2.1/servers/99a904a8-aa6f-468e-a869-07cb3c5a1053/action" status: 200 len: 14 microversion: 2.1 time: 0.119682 Aug 31 16:04:05.229611 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1549/3019] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:04:05 2022] POST /compute/v2.1/servers/99a904a8-aa6f-468e-a869-07cb3c5a1053/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:04:05.522054 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5f75f69b-60bd-44f4-941d-d0c4967b7615 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:05.546379 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5f75f69b-60bd-44f4-941d-d0c4967b7615 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:05.548297 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5f75f69b-60bd-44f4-941d-d0c4967b7615 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:05.549764 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5f75f69b-60bd-44f4-941d-d0c4967b7615 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 1875 microversion: 2.42 time: 0.623657 Aug 31 16:04:05.550548 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1471/3020] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:04 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 1875 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:04:06.065573 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-85e81a08-e698-4c05-baa8-311851f49933 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:06.067826 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-85e81a08-e698-4c05-baa8-311851f49933 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:06.101882 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85e81a08-e698-4c05-baa8-311851f49933 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:06.105075 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85e81a08-e698-4c05-baa8-311851f49933 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:06.105712 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85e81a08-e698-4c05-baa8-311851f49933 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:06.106697 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85e81a08-e698-4c05-baa8-311851f49933 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:06.107457 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85e81a08-e698-4c05-baa8-311851f49933 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:06.108027 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85e81a08-e698-4c05-baa8-311851f49933 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:06.245599 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9eec1d70-9c87-4830-bb99-70a8b859c84c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:06.248690 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9eec1d70-9c87-4830-bb99-70a8b859c84c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 99a904a8-aa6f-468e-a869-07cb3c5a1053] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:06.273292 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9eec1d70-9c87-4830-bb99-70a8b859c84c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:06.274167 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9eec1d70-9c87-4830-bb99-70a8b859c84c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:06.274935 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9eec1d70-9c87-4830-bb99-70a8b859c84c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:06.276024 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9eec1d70-9c87-4830-bb99-70a8b859c84c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:06.276660 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9eec1d70-9c87-4830-bb99-70a8b859c84c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:06.277898 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9eec1d70-9c87-4830-bb99-70a8b859c84c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:06.362250 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9eec1d70-9c87-4830-bb99-70a8b859c84c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "POST /compute/v2.1/servers/99a904a8-aa6f-468e-a869-07cb3c5a1053/action" status: 200 len: 14 microversion: 2.1 time: 0.120677 Aug 31 16:04:06.364025 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1472/3021] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:04:06 2022] POST /compute/v2.1/servers/99a904a8-aa6f-468e-a869-07cb3c5a1053/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 16:04:06.579995 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a1fd7554-892e-497c-863e-e3ab39fcdc95 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:06.581364 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a1fd7554-892e-497c-863e-e3ab39fcdc95 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:06.603864 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-85e81a08-e698-4c05-baa8-311851f49933 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:06.610614 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1fd7554-892e-497c-863e-e3ab39fcdc95 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:06.611123 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1fd7554-892e-497c-863e-e3ab39fcdc95 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:06.611535 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1fd7554-892e-497c-863e-e3ab39fcdc95 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:06.612329 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1fd7554-892e-497c-863e-e3ab39fcdc95 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:06.612779 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1fd7554-892e-497c-863e-e3ab39fcdc95 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:06.613201 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1fd7554-892e-497c-863e-e3ab39fcdc95 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:06.625442 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-85e81a08-e698-4c05-baa8-311851f49933 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:06.631485 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-85e81a08-e698-4c05-baa8-311851f49933 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:06.632958 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-85e81a08-e698-4c05-baa8-311851f49933 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1878 microversion: 2.32 time: 0.579228 Aug 31 16:04:06.647440 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1550/3022] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:06 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1878 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:07.712719 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a1fd7554-892e-497c-863e-e3ab39fcdc95 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:07.731203 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a1fd7554-892e-497c-863e-e3ab39fcdc95 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:07.733928 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a1fd7554-892e-497c-863e-e3ab39fcdc95 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:07.735690 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a1fd7554-892e-497c-863e-e3ab39fcdc95 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 1875 microversion: 2.42 time: 1.160647 Aug 31 16:04:07.764001 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1473/3023] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:06 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 1875 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:04:07.776756 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-00580e72-cda7-4115-aaa5-f25680d65bbb tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:07.778385 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-00580e72-cda7-4115-aaa5-f25680d65bbb tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:07.795419 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00580e72-cda7-4115-aaa5-f25680d65bbb tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:07.796394 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00580e72-cda7-4115-aaa5-f25680d65bbb tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:07.797235 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00580e72-cda7-4115-aaa5-f25680d65bbb tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:07.798735 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00580e72-cda7-4115-aaa5-f25680d65bbb tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:07.799960 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00580e72-cda7-4115-aaa5-f25680d65bbb tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:07.801727 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00580e72-cda7-4115-aaa5-f25680d65bbb tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:07.962854 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6236e94a-db22-4cbf-a74b-facb04eef280 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:07.966755 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6236e94a-db22-4cbf-a74b-facb04eef280 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 99a904a8-aa6f-468e-a869-07cb3c5a1053] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:07.985959 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6236e94a-db22-4cbf-a74b-facb04eef280 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:07.986562 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6236e94a-db22-4cbf-a74b-facb04eef280 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:07.987536 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6236e94a-db22-4cbf-a74b-facb04eef280 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:07.990171 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6236e94a-db22-4cbf-a74b-facb04eef280 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:07.990950 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6236e94a-db22-4cbf-a74b-facb04eef280 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:07.994814 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6236e94a-db22-4cbf-a74b-facb04eef280 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:08.072009 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6236e94a-db22-4cbf-a74b-facb04eef280 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "POST /compute/v2.1/servers/99a904a8-aa6f-468e-a869-07cb3c5a1053/action" status: 200 len: 14 microversion: 2.1 time: 0.697362 Aug 31 16:04:08.076466 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1551/3024] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:04:07 2022] POST /compute/v2.1/servers/99a904a8-aa6f-468e-a869-07cb3c5a1053/action => generated 14 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 16:04:08.256354 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-00580e72-cda7-4115-aaa5-f25680d65bbb tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:08.273592 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-00580e72-cda7-4115-aaa5-f25680d65bbb tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:08.275153 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-00580e72-cda7-4115-aaa5-f25680d65bbb tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:08.276365 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-00580e72-cda7-4115-aaa5-f25680d65bbb tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1878 microversion: 2.32 time: 0.510115 Aug 31 16:04:08.302779 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1474/3025] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:07 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1878 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:08.759594 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d5981be9-0fe6-4d4c-9c68-a26ebc7356a5 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:08.760573 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d5981be9-0fe6-4d4c-9c68-a26ebc7356a5 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:08.768251 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d5981be9-0fe6-4d4c-9c68-a26ebc7356a5 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:08.778886 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d5981be9-0fe6-4d4c-9c68-a26ebc7356a5 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:08.779645 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d5981be9-0fe6-4d4c-9c68-a26ebc7356a5 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:08.780605 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d5981be9-0fe6-4d4c-9c68-a26ebc7356a5 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:08.781063 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d5981be9-0fe6-4d4c-9c68-a26ebc7356a5 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:08.781499 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d5981be9-0fe6-4d4c-9c68-a26ebc7356a5 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:09.090153 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-48e005ce-0048-4e06-b873-7e2f30465ed6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:09.097233 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-48e005ce-0048-4e06-b873-7e2f30465ed6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 99a904a8-aa6f-468e-a869-07cb3c5a1053] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:09.116520 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-48e005ce-0048-4e06-b873-7e2f30465ed6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:09.116674 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d5981be9-0fe6-4d4c-9c68-a26ebc7356a5 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:09.117166 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-48e005ce-0048-4e06-b873-7e2f30465ed6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:09.118054 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-48e005ce-0048-4e06-b873-7e2f30465ed6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:09.119091 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-48e005ce-0048-4e06-b873-7e2f30465ed6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:09.119869 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-48e005ce-0048-4e06-b873-7e2f30465ed6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:09.120482 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-48e005ce-0048-4e06-b873-7e2f30465ed6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:09.134031 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d5981be9-0fe6-4d4c-9c68-a26ebc7356a5 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:09.144142 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d5981be9-0fe6-4d4c-9c68-a26ebc7356a5 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:09.145587 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d5981be9-0fe6-4d4c-9c68-a26ebc7356a5 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 1875 microversion: 2.42 time: 0.390266 Aug 31 16:04:09.147724 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1552/3026] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:08 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 1875 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:09.199314 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-48e005ce-0048-4e06-b873-7e2f30465ed6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "POST /compute/v2.1/servers/99a904a8-aa6f-468e-a869-07cb3c5a1053/action" status: 200 len: 14 microversion: 2.1 time: 0.118081 Aug 31 16:04:09.201218 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1475/3027] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:04:09 2022] POST /compute/v2.1/servers/99a904a8-aa6f-468e-a869-07cb3c5a1053/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:04:09.319042 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-941f5b63-f4e4-48ce-84e9-1993f31613d2 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:09.321573 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-941f5b63-f4e4-48ce-84e9-1993f31613d2 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:09.347175 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-941f5b63-f4e4-48ce-84e9-1993f31613d2 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:09.349154 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-941f5b63-f4e4-48ce-84e9-1993f31613d2 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:09.350024 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-941f5b63-f4e4-48ce-84e9-1993f31613d2 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:09.352505 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-941f5b63-f4e4-48ce-84e9-1993f31613d2 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:09.353318 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-941f5b63-f4e4-48ce-84e9-1993f31613d2 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:09.355886 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-941f5b63-f4e4-48ce-84e9-1993f31613d2 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:09.708734 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-941f5b63-f4e4-48ce-84e9-1993f31613d2 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:09.732255 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-941f5b63-f4e4-48ce-84e9-1993f31613d2 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:09.736498 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-941f5b63-f4e4-48ce-84e9-1993f31613d2 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:09.739547 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-941f5b63-f4e4-48ce-84e9-1993f31613d2 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1878 microversion: 2.32 time: 0.437413 Aug 31 16:04:09.764945 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1553/3028] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:09 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1878 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:10.174767 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-546056fa-c980-4dea-ba62-79618bcbc955 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:10.177450 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-546056fa-c980-4dea-ba62-79618bcbc955 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:10.185635 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-546056fa-c980-4dea-ba62-79618bcbc955 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:10.186550 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-546056fa-c980-4dea-ba62-79618bcbc955 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:10.187223 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-546056fa-c980-4dea-ba62-79618bcbc955 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:10.188175 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-546056fa-c980-4dea-ba62-79618bcbc955 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:10.188848 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-546056fa-c980-4dea-ba62-79618bcbc955 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:10.189500 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-546056fa-c980-4dea-ba62-79618bcbc955 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:10.215508 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1eb1db58-727a-48c4-9eda-87057ad0ff2b tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:10.220106 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1eb1db58-727a-48c4-9eda-87057ad0ff2b tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 99a904a8-aa6f-468e-a869-07cb3c5a1053] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:10.240564 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1eb1db58-727a-48c4-9eda-87057ad0ff2b tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:10.241867 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1eb1db58-727a-48c4-9eda-87057ad0ff2b tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:10.242898 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1eb1db58-727a-48c4-9eda-87057ad0ff2b tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:10.244751 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1eb1db58-727a-48c4-9eda-87057ad0ff2b tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:10.246428 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1eb1db58-727a-48c4-9eda-87057ad0ff2b tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:10.247275 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1eb1db58-727a-48c4-9eda-87057ad0ff2b tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:10.301354 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1eb1db58-727a-48c4-9eda-87057ad0ff2b tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "POST /compute/v2.1/servers/99a904a8-aa6f-468e-a869-07cb3c5a1053/action" status: 200 len: 14 microversion: 2.1 time: 0.090676 Aug 31 16:04:10.302308 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1554/3029] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:04:10 2022] POST /compute/v2.1/servers/99a904a8-aa6f-468e-a869-07cb3c5a1053/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:04:10.486288 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-546056fa-c980-4dea-ba62-79618bcbc955 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:10.502920 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-546056fa-c980-4dea-ba62-79618bcbc955 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:10.507267 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-546056fa-c980-4dea-ba62-79618bcbc955 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:10.510144 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-546056fa-c980-4dea-ba62-79618bcbc955 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 1875 microversion: 2.42 time: 0.339582 Aug 31 16:04:10.512001 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1476/3030] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:10 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 1875 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:10.792922 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-cc5340a7-e187-490f-b19d-dd413bf7ba31 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:10.806301 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-cc5340a7-e187-490f-b19d-dd413bf7ba31 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:10.827796 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cc5340a7-e187-490f-b19d-dd413bf7ba31 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:10.828286 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cc5340a7-e187-490f-b19d-dd413bf7ba31 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:10.828725 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cc5340a7-e187-490f-b19d-dd413bf7ba31 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:10.829436 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cc5340a7-e187-490f-b19d-dd413bf7ba31 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:10.829886 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cc5340a7-e187-490f-b19d-dd413bf7ba31 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:10.830336 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cc5340a7-e187-490f-b19d-dd413bf7ba31 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:11.150489 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-cc5340a7-e187-490f-b19d-dd413bf7ba31 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:11.171668 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-cc5340a7-e187-490f-b19d-dd413bf7ba31 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:11.171668 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-cc5340a7-e187-490f-b19d-dd413bf7ba31 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:11.173296 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-cc5340a7-e187-490f-b19d-dd413bf7ba31 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1878 microversion: 2.32 time: 0.397969 Aug 31 16:04:11.174609 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1555/3031] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:10 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1878 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:11.317062 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ed85cc5f-7d0d-4d98-8fa4-3ee77b7dd346 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:11.322431 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ed85cc5f-7d0d-4d98-8fa4-3ee77b7dd346 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 99a904a8-aa6f-468e-a869-07cb3c5a1053] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:11.335730 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed85cc5f-7d0d-4d98-8fa4-3ee77b7dd346 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:11.336751 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed85cc5f-7d0d-4d98-8fa4-3ee77b7dd346 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:11.336959 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed85cc5f-7d0d-4d98-8fa4-3ee77b7dd346 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:11.337778 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed85cc5f-7d0d-4d98-8fa4-3ee77b7dd346 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:11.338398 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed85cc5f-7d0d-4d98-8fa4-3ee77b7dd346 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:11.339074 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed85cc5f-7d0d-4d98-8fa4-3ee77b7dd346 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:11.394732 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ed85cc5f-7d0d-4d98-8fa4-3ee77b7dd346 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "POST /compute/v2.1/servers/99a904a8-aa6f-468e-a869-07cb3c5a1053/action" status: 200 len: 14 microversion: 2.1 time: 0.083925 Aug 31 16:04:11.400360 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1477/3032] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:04:11 2022] POST /compute/v2.1/servers/99a904a8-aa6f-468e-a869-07cb3c5a1053/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:04:11.541598 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a365459b-91f1-4f51-8892-25333a0e8fb9 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:11.543112 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a365459b-91f1-4f51-8892-25333a0e8fb9 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:11.558920 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a365459b-91f1-4f51-8892-25333a0e8fb9 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:11.559864 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a365459b-91f1-4f51-8892-25333a0e8fb9 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:11.560975 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a365459b-91f1-4f51-8892-25333a0e8fb9 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:11.562767 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a365459b-91f1-4f51-8892-25333a0e8fb9 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:11.564238 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a365459b-91f1-4f51-8892-25333a0e8fb9 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:11.564879 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a365459b-91f1-4f51-8892-25333a0e8fb9 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:11.872848 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a365459b-91f1-4f51-8892-25333a0e8fb9 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:11.905149 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a365459b-91f1-4f51-8892-25333a0e8fb9 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:11.907946 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a365459b-91f1-4f51-8892-25333a0e8fb9 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:11.910696 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a365459b-91f1-4f51-8892-25333a0e8fb9 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 1875 microversion: 2.42 time: 0.378895 Aug 31 16:04:11.940981 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1556/3033] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:11 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 1875 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:12.214064 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8a168246-04ab-4803-b87a-75fd52e427a8 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:12.216640 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8a168246-04ab-4803-b87a-75fd52e427a8 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:12.234360 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a168246-04ab-4803-b87a-75fd52e427a8 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:12.235478 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a168246-04ab-4803-b87a-75fd52e427a8 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:12.236450 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a168246-04ab-4803-b87a-75fd52e427a8 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:12.239690 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a168246-04ab-4803-b87a-75fd52e427a8 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:12.242530 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a168246-04ab-4803-b87a-75fd52e427a8 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:12.243542 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a168246-04ab-4803-b87a-75fd52e427a8 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:12.417589 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6b06590c-0a67-4c08-9378-4302a2610f3f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:12.425588 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6b06590c-0a67-4c08-9378-4302a2610f3f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 99a904a8-aa6f-468e-a869-07cb3c5a1053] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:12.442085 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6b06590c-0a67-4c08-9378-4302a2610f3f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:12.442815 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6b06590c-0a67-4c08-9378-4302a2610f3f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:12.443328 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6b06590c-0a67-4c08-9378-4302a2610f3f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:12.449913 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6b06590c-0a67-4c08-9378-4302a2610f3f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:12.451026 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6b06590c-0a67-4c08-9378-4302a2610f3f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:12.452279 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6b06590c-0a67-4c08-9378-4302a2610f3f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:12.509223 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6b06590c-0a67-4c08-9378-4302a2610f3f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "POST /compute/v2.1/servers/99a904a8-aa6f-468e-a869-07cb3c5a1053/action" status: 200 len: 14 microversion: 2.1 time: 0.104691 Aug 31 16:04:12.509912 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1557/3034] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:04:12 2022] POST /compute/v2.1/servers/99a904a8-aa6f-468e-a869-07cb3c5a1053/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:04:12.718576 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8a168246-04ab-4803-b87a-75fd52e427a8 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:12.731070 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8a168246-04ab-4803-b87a-75fd52e427a8 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:12.732877 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8a168246-04ab-4803-b87a-75fd52e427a8 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:12.734338 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8a168246-04ab-4803-b87a-75fd52e427a8 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1878 microversion: 2.32 time: 0.530355 Aug 31 16:04:12.757009 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1478/3035] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:12 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1878 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:12.959279 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-678add58-ed31-4c82-a9f7-8d176be370d4 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:12.960206 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-678add58-ed31-4c82-a9f7-8d176be370d4 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:12.975136 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-678add58-ed31-4c82-a9f7-8d176be370d4 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:12.981869 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-678add58-ed31-4c82-a9f7-8d176be370d4 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:12.981869 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-678add58-ed31-4c82-a9f7-8d176be370d4 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:12.981869 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-678add58-ed31-4c82-a9f7-8d176be370d4 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:12.981869 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-678add58-ed31-4c82-a9f7-8d176be370d4 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:12.981869 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-678add58-ed31-4c82-a9f7-8d176be370d4 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:13.524798 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-caee2f56-0e0a-4d0e-9f92-fde2005995b8 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:13.539770 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-caee2f56-0e0a-4d0e-9f92-fde2005995b8 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 99a904a8-aa6f-468e-a869-07cb3c5a1053] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:13.553872 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-caee2f56-0e0a-4d0e-9f92-fde2005995b8 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:13.557556 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-caee2f56-0e0a-4d0e-9f92-fde2005995b8 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:13.558137 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-caee2f56-0e0a-4d0e-9f92-fde2005995b8 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:13.558894 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-caee2f56-0e0a-4d0e-9f92-fde2005995b8 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:13.559360 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-caee2f56-0e0a-4d0e-9f92-fde2005995b8 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:13.559806 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-caee2f56-0e0a-4d0e-9f92-fde2005995b8 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:13.565643 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:04:13.630670 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-caee2f56-0e0a-4d0e-9f92-fde2005995b8 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "POST /compute/v2.1/servers/99a904a8-aa6f-468e-a869-07cb3c5a1053/action" status: 200 len: 14 microversion: 2.1 time: 0.110130 Aug 31 16:04:13.631967 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1479/3036] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:04:13 2022] POST /compute/v2.1/servers/99a904a8-aa6f-468e-a869-07cb3c5a1053/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:04:13.658446 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-678add58-ed31-4c82-a9f7-8d176be370d4 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:13.677910 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-678add58-ed31-4c82-a9f7-8d176be370d4 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:13.680702 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-678add58-ed31-4c82-a9f7-8d176be370d4 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:13.682428 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-678add58-ed31-4c82-a9f7-8d176be370d4 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 1875 microversion: 2.42 time: 0.733701 Aug 31 16:04:13.695850 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1558/3037] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:12 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 1875 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:13.758587 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-84fa349e-7b51-42c5-a9c5-40314194bc80 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:13.759856 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-84fa349e-7b51-42c5-a9c5-40314194bc80 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:13.775141 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-84fa349e-7b51-42c5-a9c5-40314194bc80 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:13.777268 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-84fa349e-7b51-42c5-a9c5-40314194bc80 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:13.780595 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-84fa349e-7b51-42c5-a9c5-40314194bc80 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:13.781810 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-84fa349e-7b51-42c5-a9c5-40314194bc80 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:13.785930 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-84fa349e-7b51-42c5-a9c5-40314194bc80 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:13.786732 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-84fa349e-7b51-42c5-a9c5-40314194bc80 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:13.847711 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=100 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:04:13.970625 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4f6bd824-10d7-4b34-86ca-2aa2239917b9 tempest-FloatingIPDetailsTestJSON-712446971 tempest-FloatingIPDetailsTestJSON-712446971-project] Action: 'create', calling method: .version_select at 0x7fbb45e2e280>, body: {"pool": null} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:14.297101 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-84fa349e-7b51-42c5-a9c5-40314194bc80 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:14.321341 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-84fa349e-7b51-42c5-a9c5-40314194bc80 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:14.322835 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-84fa349e-7b51-42c5-a9c5-40314194bc80 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:14.324773 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-84fa349e-7b51-42c5-a9c5-40314194bc80 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1878 microversion: 2.32 time: 0.570996 Aug 31 16:04:14.344993 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1559/3038] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:13 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1878 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:14.645111 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0e008c2f-b8d5-4f20-941c-731467369fcf tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:14.647683 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0e008c2f-b8d5-4f20-941c-731467369fcf tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 99a904a8-aa6f-468e-a869-07cb3c5a1053] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:14.667103 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0e008c2f-b8d5-4f20-941c-731467369fcf tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:14.667695 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0e008c2f-b8d5-4f20-941c-731467369fcf tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:14.668203 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0e008c2f-b8d5-4f20-941c-731467369fcf tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:14.668958 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0e008c2f-b8d5-4f20-941c-731467369fcf tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:14.669449 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0e008c2f-b8d5-4f20-941c-731467369fcf tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:14.670070 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0e008c2f-b8d5-4f20-941c-731467369fcf tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:14.780519 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0e008c2f-b8d5-4f20-941c-731467369fcf tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "POST /compute/v2.1/servers/99a904a8-aa6f-468e-a869-07cb3c5a1053/action" status: 200 len: 14 microversion: 2.1 time: 0.140008 Aug 31 16:04:14.781396 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1560/3039] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:04:14 2022] POST /compute/v2.1/servers/99a904a8-aa6f-468e-a869-07cb3c5a1053/action => generated 14 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 16:04:14.793481 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7cdfe53d-e671-49c3-972b-a969102651cf tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:14.794608 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7cdfe53d-e671-49c3-972b-a969102651cf tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:14.803862 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7cdfe53d-e671-49c3-972b-a969102651cf tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:14.804812 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7cdfe53d-e671-49c3-972b-a969102651cf tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:14.805456 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7cdfe53d-e671-49c3-972b-a969102651cf tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:14.807120 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7cdfe53d-e671-49c3-972b-a969102651cf tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:14.807761 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7cdfe53d-e671-49c3-972b-a969102651cf tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:14.808502 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7cdfe53d-e671-49c3-972b-a969102651cf tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:15.392563 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7cdfe53d-e671-49c3-972b-a969102651cf tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:15.430892 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7cdfe53d-e671-49c3-972b-a969102651cf tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:15.435037 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7cdfe53d-e671-49c3-972b-a969102651cf tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:15.440862 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7cdfe53d-e671-49c3-972b-a969102651cf tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 1875 microversion: 2.42 time: 0.652109 Aug 31 16:04:15.445397 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1561/3040] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:14 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 1875 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:15.455570 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7ee5446c-b578-48a7-9289-4d0648ebce76 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:15.456835 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7ee5446c-b578-48a7-9289-4d0648ebce76 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:15.479028 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ee5446c-b578-48a7-9289-4d0648ebce76 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:15.481147 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ee5446c-b578-48a7-9289-4d0648ebce76 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:15.481868 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ee5446c-b578-48a7-9289-4d0648ebce76 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:15.485852 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ee5446c-b578-48a7-9289-4d0648ebce76 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:15.486443 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ee5446c-b578-48a7-9289-4d0648ebce76 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:15.486902 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ee5446c-b578-48a7-9289-4d0648ebce76 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:16.017246 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7ee5446c-b578-48a7-9289-4d0648ebce76 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:16.027802 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7ee5446c-b578-48a7-9289-4d0648ebce76 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:16.029282 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7ee5446c-b578-48a7-9289-4d0648ebce76 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:16.030549 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7ee5446c-b578-48a7-9289-4d0648ebce76 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1878 microversion: 2.32 time: 0.584059 Aug 31 16:04:16.031129 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1562/3041] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:15 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1878 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:16.041140 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c87b03bd-245f-4572-a253-5e8a57b73294 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:16.046412 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c87b03bd-245f-4572-a253-5e8a57b73294 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 99a904a8-aa6f-468e-a869-07cb3c5a1053] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:16.054899 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c87b03bd-245f-4572-a253-5e8a57b73294 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:16.055685 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c87b03bd-245f-4572-a253-5e8a57b73294 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:16.056308 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c87b03bd-245f-4572-a253-5e8a57b73294 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:16.057213 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c87b03bd-245f-4572-a253-5e8a57b73294 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:16.057849 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c87b03bd-245f-4572-a253-5e8a57b73294 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:16.058474 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c87b03bd-245f-4572-a253-5e8a57b73294 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:16.128203 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c87b03bd-245f-4572-a253-5e8a57b73294 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "POST /compute/v2.1/servers/99a904a8-aa6f-468e-a869-07cb3c5a1053/action" status: 200 len: 8208 microversion: 2.1 time: 0.095401 Aug 31 16:04:16.130326 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1563/3042] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:04:16 2022] POST /compute/v2.1/servers/99a904a8-aa6f-468e-a869-07cb3c5a1053/action => generated 8208 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:16.150462 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-232137df-ef47-4da0-bb2f-dba2460cf6f6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:16.154652 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-232137df-ef47-4da0-bb2f-dba2460cf6f6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:16.173199 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-232137df-ef47-4da0-bb2f-dba2460cf6f6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:16.174510 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-232137df-ef47-4da0-bb2f-dba2460cf6f6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:16.175651 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-232137df-ef47-4da0-bb2f-dba2460cf6f6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:16.177040 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-232137df-ef47-4da0-bb2f-dba2460cf6f6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:16.177823 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-232137df-ef47-4da0-bb2f-dba2460cf6f6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:16.178526 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-232137df-ef47-4da0-bb2f-dba2460cf6f6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:16.519974 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-232137df-ef47-4da0-bb2f-dba2460cf6f6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:16.528243 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-232137df-ef47-4da0-bb2f-dba2460cf6f6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1671 microversion: 2.1 time: 0.391953 Aug 31 16:04:16.534235 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1564/3043] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:16 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1671 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:04:16.539381 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8f435ba3-4ffa-4908-b3cd-a9ff1dc0bf8b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:16.543950 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8f435ba3-4ffa-4908-b3cd-a9ff1dc0bf8b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:16.554785 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8f435ba3-4ffa-4908-b3cd-a9ff1dc0bf8b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:16.555569 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8f435ba3-4ffa-4908-b3cd-a9ff1dc0bf8b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:16.560448 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8f435ba3-4ffa-4908-b3cd-a9ff1dc0bf8b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:16.561703 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8f435ba3-4ffa-4908-b3cd-a9ff1dc0bf8b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:16.562644 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8f435ba3-4ffa-4908-b3cd-a9ff1dc0bf8b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:16.563361 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8f435ba3-4ffa-4908-b3cd-a9ff1dc0bf8b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:17.022056 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8f435ba3-4ffa-4908-b3cd-a9ff1dc0bf8b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:17.035834 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8f435ba3-4ffa-4908-b3cd-a9ff1dc0bf8b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:17.043596 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8f435ba3-4ffa-4908-b3cd-a9ff1dc0bf8b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:17.044944 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8f435ba3-4ffa-4908-b3cd-a9ff1dc0bf8b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 1875 microversion: 2.42 time: 0.509470 Aug 31 16:04:17.045524 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1565/3044] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:16 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 1875 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:17.071332 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f05606d6-a1df-458e-b456-c12568a6f3ea tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:17.074452 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f05606d6-a1df-458e-b456-c12568a6f3ea tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:17.097806 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f05606d6-a1df-458e-b456-c12568a6f3ea tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:17.099438 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f05606d6-a1df-458e-b456-c12568a6f3ea tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:17.102852 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f05606d6-a1df-458e-b456-c12568a6f3ea tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:17.103763 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f05606d6-a1df-458e-b456-c12568a6f3ea tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:17.104250 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f05606d6-a1df-458e-b456-c12568a6f3ea tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:17.104682 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f05606d6-a1df-458e-b456-c12568a6f3ea tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:17.434481 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4f6bd824-10d7-4b34-86ca-2aa2239917b9 tempest-FloatingIPDetailsTestJSON-712446971 tempest-FloatingIPDetailsTestJSON-712446971-project] 10.222.0.50 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.736552 Aug 31 16:04:17.435592 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1480/3045] 10.222.0.50 () {60 vars in 1170 bytes} [Wed Aug 31 16:04:13 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3738 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:04:17.440245 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e077db7b-cfb9-4c86-973f-06bf49997f93 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:17.444251 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e077db7b-cfb9-4c86-973f-06bf49997f93 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:17.476570 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e077db7b-cfb9-4c86-973f-06bf49997f93 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:17.477324 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e077db7b-cfb9-4c86-973f-06bf49997f93 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:17.478058 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e077db7b-cfb9-4c86-973f-06bf49997f93 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:17.482447 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e077db7b-cfb9-4c86-973f-06bf49997f93 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:17.483118 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e077db7b-cfb9-4c86-973f-06bf49997f93 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:17.483712 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e077db7b-cfb9-4c86-973f-06bf49997f93 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:17.486752 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f05606d6-a1df-458e-b456-c12568a6f3ea tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:17.501543 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f05606d6-a1df-458e-b456-c12568a6f3ea tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1671 microversion: 2.1 time: 0.443901 Aug 31 16:04:17.508423 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1566/3046] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:17 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1671 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:17.518239 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-baf6db09-9557-4b8b-a3dc-446ce052567d tempest-FloatingIPDetailsTestJSON-712446971 tempest-FloatingIPDetailsTestJSON-712446971-project] Action: 'create', calling method: .version_select at 0x7fbb45fc4af0>, body: {"pool": null} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:18.048652 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e077db7b-cfb9-4c86-973f-06bf49997f93 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:18.079061 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e077db7b-cfb9-4c86-973f-06bf49997f93 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:18.085444 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e077db7b-cfb9-4c86-973f-06bf49997f93 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:18.097769 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e077db7b-cfb9-4c86-973f-06bf49997f93 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1878 microversion: 2.32 time: 0.660910 Aug 31 16:04:18.098963 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1481/3047] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:17 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1878 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:18.104325 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3ba35781-372c-4b29-9e5b-b3d87fe8b9f8 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:18.105196 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3ba35781-372c-4b29-9e5b-b3d87fe8b9f8 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:18.112445 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ba35781-372c-4b29-9e5b-b3d87fe8b9f8 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:18.113283 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ba35781-372c-4b29-9e5b-b3d87fe8b9f8 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:18.113993 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ba35781-372c-4b29-9e5b-b3d87fe8b9f8 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:18.115230 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ba35781-372c-4b29-9e5b-b3d87fe8b9f8 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:18.116259 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ba35781-372c-4b29-9e5b-b3d87fe8b9f8 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:18.116858 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ba35781-372c-4b29-9e5b-b3d87fe8b9f8 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:18.988669 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3ba35781-372c-4b29-9e5b-b3d87fe8b9f8 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:19.008058 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3ba35781-372c-4b29-9e5b-b3d87fe8b9f8 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1671 microversion: 2.1 time: 0.907738 Aug 31 16:04:19.022122 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1482/3048] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:18 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1671 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:19.025259 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5ed834c6-e8e2-4889-b8ef-1045e9e7710c tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:19.026143 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5ed834c6-e8e2-4889-b8ef-1045e9e7710c tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:19.046669 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ed834c6-e8e2-4889-b8ef-1045e9e7710c tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:19.047092 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ed834c6-e8e2-4889-b8ef-1045e9e7710c tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:19.047537 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ed834c6-e8e2-4889-b8ef-1045e9e7710c tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:19.048269 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ed834c6-e8e2-4889-b8ef-1045e9e7710c tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:19.048731 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ed834c6-e8e2-4889-b8ef-1045e9e7710c tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:19.049154 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ed834c6-e8e2-4889-b8ef-1045e9e7710c tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:19.587048 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5ed834c6-e8e2-4889-b8ef-1045e9e7710c tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:19.608629 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5ed834c6-e8e2-4889-b8ef-1045e9e7710c tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:19.614485 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5ed834c6-e8e2-4889-b8ef-1045e9e7710c tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:19.617357 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5ed834c6-e8e2-4889-b8ef-1045e9e7710c tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 1875 microversion: 2.42 time: 0.604769 Aug 31 16:04:19.618199 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1483/3049] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:19 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 1875 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:19.635053 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-02738a89-1880-4bb5-9098-718fd3afa7a3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:19.635584 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-02738a89-1880-4bb5-9098-718fd3afa7a3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:19.643344 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02738a89-1880-4bb5-9098-718fd3afa7a3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:19.643868 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02738a89-1880-4bb5-9098-718fd3afa7a3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:19.645200 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02738a89-1880-4bb5-9098-718fd3afa7a3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:19.646004 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02738a89-1880-4bb5-9098-718fd3afa7a3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:19.646578 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02738a89-1880-4bb5-9098-718fd3afa7a3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:19.647489 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02738a89-1880-4bb5-9098-718fd3afa7a3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:19.992770 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-02738a89-1880-4bb5-9098-718fd3afa7a3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:20.003879 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-02738a89-1880-4bb5-9098-718fd3afa7a3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1671 microversion: 2.1 time: 0.383053 Aug 31 16:04:20.006649 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1484/3050] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:19 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1671 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:20.022596 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-43b24322-72e9-4149-bc7e-44cb3931c446 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:20.022596 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-43b24322-72e9-4149-bc7e-44cb3931c446 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:20.023056 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43b24322-72e9-4149-bc7e-44cb3931c446 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:20.023163 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43b24322-72e9-4149-bc7e-44cb3931c446 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:20.023540 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43b24322-72e9-4149-bc7e-44cb3931c446 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:20.024434 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43b24322-72e9-4149-bc7e-44cb3931c446 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:20.025100 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43b24322-72e9-4149-bc7e-44cb3931c446 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:20.025889 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43b24322-72e9-4149-bc7e-44cb3931c446 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:20.348281 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-43b24322-72e9-4149-bc7e-44cb3931c446 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:20.364828 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-43b24322-72e9-4149-bc7e-44cb3931c446 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:20.367227 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-43b24322-72e9-4149-bc7e-44cb3931c446 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:20.373025 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-43b24322-72e9-4149-bc7e-44cb3931c446 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1878 microversion: 2.32 time: 0.365276 Aug 31 16:04:20.373729 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1485/3051] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:20 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1878 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:20.388700 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8490bf6c-7e9a-4865-9b7b-895948104ba6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:20.389524 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8490bf6c-7e9a-4865-9b7b-895948104ba6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:20.411936 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8490bf6c-7e9a-4865-9b7b-895948104ba6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:20.412655 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8490bf6c-7e9a-4865-9b7b-895948104ba6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:20.413463 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8490bf6c-7e9a-4865-9b7b-895948104ba6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:20.414487 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8490bf6c-7e9a-4865-9b7b-895948104ba6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:20.415116 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8490bf6c-7e9a-4865-9b7b-895948104ba6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:20.415727 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8490bf6c-7e9a-4865-9b7b-895948104ba6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:20.486494 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8490bf6c-7e9a-4865-9b7b-895948104ba6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Locking {{(pid=128863) lock /opt/stack/nova/nova/compute/api.py:4843}} Aug 31 16:04:20.573958 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8490bf6c-7e9a-4865-9b7b-895948104ba6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "POST /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b/action" status: 202 len: 0 microversion: 2.1 time: 0.188857 Aug 31 16:04:20.581226 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1486/3052] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:04:20 2022] POST /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:04:20.598500 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d6156259-cdde-4110-81a0-65aef13050e2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:20.599229 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d6156259-cdde-4110-81a0-65aef13050e2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:20.607543 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6156259-cdde-4110-81a0-65aef13050e2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:20.608422 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6156259-cdde-4110-81a0-65aef13050e2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:20.608956 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6156259-cdde-4110-81a0-65aef13050e2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:20.609672 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6156259-cdde-4110-81a0-65aef13050e2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:20.610173 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6156259-cdde-4110-81a0-65aef13050e2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:20.612172 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6156259-cdde-4110-81a0-65aef13050e2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:20.896725 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-baf6db09-9557-4b8b-a3dc-446ce052567d tempest-FloatingIPDetailsTestJSON-712446971 tempest-FloatingIPDetailsTestJSON-712446971-project] 10.222.0.50 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.385560 Aug 31 16:04:20.901065 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d6156259-cdde-4110-81a0-65aef13050e2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:20.906014 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1567/3053] 10.222.0.50 () {60 vars in 1170 bytes} [Wed Aug 31 16:04:17 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:04:20.910601 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8b15c3cc-7087-4358-9e87-ff6f9b2c55fd tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:20.911242 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8b15c3cc-7087-4358-9e87-ff6f9b2c55fd tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:20.911884 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d6156259-cdde-4110-81a0-65aef13050e2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1671 microversion: 2.1 time: 0.328768 Aug 31 16:04:20.918610 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1487/3054] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:20 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1671 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:20.918869 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b15c3cc-7087-4358-9e87-ff6f9b2c55fd tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:20.919004 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b15c3cc-7087-4358-9e87-ff6f9b2c55fd tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:20.919610 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b15c3cc-7087-4358-9e87-ff6f9b2c55fd tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:20.920546 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b15c3cc-7087-4358-9e87-ff6f9b2c55fd tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:20.921147 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b15c3cc-7087-4358-9e87-ff6f9b2c55fd tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:20.921729 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b15c3cc-7087-4358-9e87-ff6f9b2c55fd tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:20.923993 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-386955c3-c9f6-4b93-9112-9bd80626d160 tempest-FloatingIPDetailsTestJSON-712446971 tempest-FloatingIPDetailsTestJSON-712446971-project] Action: 'create', calling method: .version_select at 0x7fbb4aa9cd30>, body: {"pool": null} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:21.271778 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8b15c3cc-7087-4358-9e87-ff6f9b2c55fd tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:21.283642 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8b15c3cc-7087-4358-9e87-ff6f9b2c55fd tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:21.286040 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8b15c3cc-7087-4358-9e87-ff6f9b2c55fd tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:21.287762 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8b15c3cc-7087-4358-9e87-ff6f9b2c55fd tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 1875 microversion: 2.42 time: 0.381648 Aug 31 16:04:21.288796 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1568/3055] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:20 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 1875 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:21.293972 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f6572c72-a8f0-4675-bc98-77977f5cf216 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:21.300946 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f6572c72-a8f0-4675-bc98-77977f5cf216 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:21.301916 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f6572c72-a8f0-4675-bc98-77977f5cf216 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:21.302491 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f6572c72-a8f0-4675-bc98-77977f5cf216 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:21.328799 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-f6572c72-a8f0-4675-bc98-77977f5cf216 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] HTTP exception thrown: Instance 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b is locked Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f6572c72-a8f0-4675-bc98-77977f5cf216 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Request method failure captured: Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: request: POST /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b/action HTTP/1.1 Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 15 Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4VKUAYKz-WFBtmk16aIOyXYR2HhyYuZ36VRZsBRjqviBnc5RSPRJJqpoARQYteX5NSEljs3qX5_RMCYaeMof8M6i0ZB3mJgVdRhk2nIL2yk-7L_KhuV1lL_MMec1r7AAygDhG-639IQUe0ED7x0P_yoZ7NSrcY8NXkYeyVxFn3mUyo Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 11ef5102f83142d1a52befe52c3595d4 Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServerActionsTestJSON-1629819008 Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/11ef5102f83142d1a52befe52c3595d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/11ef5102f83142d1a52befe52c3595d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/11ef5102f83142d1a52befe52c3595d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_11ef5102f83142d1a52befe52c3595d4", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServerActionsTestJSON-1629819008 Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 11ef5102f83142d1a52befe52c3595d4 Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServerActionsTestJSON-1629819008 Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServerActionsTestJSON-1629819008-project Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: aeeaf32202f747c8a2b98836f503aa7e Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServerActionsTestJSON-1629819008-project Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: {"os-stop": {}} Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b is locked Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b', 'body': {'os-stop': {}}} Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b is locked Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b is locked Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b is locked Aug 31 16:04:21.330742 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:04:21.338568 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f6572c72-a8f0-4675-bc98-77977f5cf216 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Returning 409 to user: Instance 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b is locked {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:04:21.339697 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f6572c72-a8f0-4675-bc98-77977f5cf216 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "POST /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b/action" status: 409 len: 107 microversion: 2.1 time: 0.049707 Aug 31 16:04:21.340523 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1569/3056] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:04:21 2022] POST /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b/action => generated 107 bytes in 51 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 16:04:21.350273 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-733c4e2c-dc49-4746-92cb-148a044e7a66 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:21.351270 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-733c4e2c-dc49-4746-92cb-148a044e7a66 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:21.359100 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-733c4e2c-dc49-4746-92cb-148a044e7a66 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:21.359941 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-733c4e2c-dc49-4746-92cb-148a044e7a66 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:21.361235 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-733c4e2c-dc49-4746-92cb-148a044e7a66 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:21.362480 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-733c4e2c-dc49-4746-92cb-148a044e7a66 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:21.364784 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-733c4e2c-dc49-4746-92cb-148a044e7a66 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:21.367211 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-733c4e2c-dc49-4746-92cb-148a044e7a66 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:21.442805 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-733c4e2c-dc49-4746-92cb-148a044e7a66 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Unlocking {{(pid=128864) unlock /opt/stack/nova/nova/compute/api.py:4872}} Aug 31 16:04:21.544105 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-733c4e2c-dc49-4746-92cb-148a044e7a66 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "POST /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b/action" status: 202 len: 0 microversion: 2.1 time: 0.198417 Aug 31 16:04:21.546983 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1570/3057] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:04:21 2022] POST /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 16:04:21.554917 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1710e135-4b1e-4973-83c6-ff19997f8132 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:21.556068 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1710e135-4b1e-4973-83c6-ff19997f8132 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:21.563986 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1710e135-4b1e-4973-83c6-ff19997f8132 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:21.564861 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1710e135-4b1e-4973-83c6-ff19997f8132 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:21.566750 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1710e135-4b1e-4973-83c6-ff19997f8132 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:21.569133 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1710e135-4b1e-4973-83c6-ff19997f8132 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:21.570131 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1710e135-4b1e-4973-83c6-ff19997f8132 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:21.570701 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1710e135-4b1e-4973-83c6-ff19997f8132 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:21.944273 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1710e135-4b1e-4973-83c6-ff19997f8132 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:21.958167 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1710e135-4b1e-4973-83c6-ff19997f8132 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:21.959642 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1710e135-4b1e-4973-83c6-ff19997f8132 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:21.960866 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1710e135-4b1e-4973-83c6-ff19997f8132 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1878 microversion: 2.32 time: 0.411921 Aug 31 16:04:21.965102 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1571/3058] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:21 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1878 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:21.977444 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fbce9a2e-0691-4dfc-8fb4-097e2e59d83d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:21.992192 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fbce9a2e-0691-4dfc-8fb4-097e2e59d83d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:21.992689 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fbce9a2e-0691-4dfc-8fb4-097e2e59d83d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:21.993122 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fbce9a2e-0691-4dfc-8fb4-097e2e59d83d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:22.025498 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fbce9a2e-0691-4dfc-8fb4-097e2e59d83d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Going to try to stop instance {{(pid=128864) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 16:04:22.126740 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fbce9a2e-0691-4dfc-8fb4-097e2e59d83d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "POST /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b/action" status: 202 len: 0 microversion: 2.1 time: 0.158127 Aug 31 16:04:22.133091 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1572/3059] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:04:21 2022] POST /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:04:22.139644 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fb81d767-e1da-46b0-bb77-971581f6d09f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:22.140746 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fb81d767-e1da-46b0-bb77-971581f6d09f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:22.153027 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb81d767-e1da-46b0-bb77-971581f6d09f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:22.154361 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb81d767-e1da-46b0-bb77-971581f6d09f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:22.155109 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb81d767-e1da-46b0-bb77-971581f6d09f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:22.156456 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb81d767-e1da-46b0-bb77-971581f6d09f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:22.157175 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb81d767-e1da-46b0-bb77-971581f6d09f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:22.157991 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb81d767-e1da-46b0-bb77-971581f6d09f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:22.450325 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-fb81d767-e1da-46b0-bb77-971581f6d09f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:22.465793 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fb81d767-e1da-46b0-bb77-971581f6d09f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1681 microversion: 2.1 time: 0.330517 Aug 31 16:04:22.467734 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1573/3060] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:22 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1681 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:22.479751 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-68970fa4-e3ce-469e-8d45-67e1d5f6188d tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:22.482476 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-68970fa4-e3ce-469e-8d45-67e1d5f6188d tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:22.494224 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68970fa4-e3ce-469e-8d45-67e1d5f6188d tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:22.498325 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68970fa4-e3ce-469e-8d45-67e1d5f6188d tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:22.500099 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68970fa4-e3ce-469e-8d45-67e1d5f6188d tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:22.503763 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68970fa4-e3ce-469e-8d45-67e1d5f6188d tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:22.505200 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68970fa4-e3ce-469e-8d45-67e1d5f6188d tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:22.508250 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68970fa4-e3ce-469e-8d45-67e1d5f6188d tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:22.949453 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-68970fa4-e3ce-469e-8d45-67e1d5f6188d tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:22.952051 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:04:22.968844 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-68970fa4-e3ce-469e-8d45-67e1d5f6188d tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:22.971052 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-68970fa4-e3ce-469e-8d45-67e1d5f6188d tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:22.972793 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-68970fa4-e3ce-469e-8d45-67e1d5f6188d tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 1875 microversion: 2.42 time: 0.502650 Aug 31 16:04:22.973958 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1574/3061] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:22 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 1875 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:22.999997 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-a8d677bd-856c-4608-810c-8d2a1d209115 req-e3c3e6af-a8dc-44a4-8022-bf1179f424e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e89e500-ddc5-4549-8631-9d62545016d1", "name": "network-vif-plugged", "status": "completed", "tag": "3445d58d-1bed-4c5b-82a7-a81a67db5f67"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:23.018371 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-a8d677bd-856c-4608-810c-8d2a1d209115 req-e3c3e6af-a8dc-44a4-8022-bf1179f424e4 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:23.019121 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-a8d677bd-856c-4608-810c-8d2a1d209115 req-e3c3e6af-a8dc-44a4-8022-bf1179f424e4 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:23.019901 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-a8d677bd-856c-4608-810c-8d2a1d209115 req-e3c3e6af-a8dc-44a4-8022-bf1179f424e4 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:23.039902 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-a8d677bd-856c-4608-810c-8d2a1d209115 req-e3c3e6af-a8dc-44a4-8022-bf1179f424e4 service nova] Creating event network-vif-plugged:3445d58d-1bed-4c5b-82a7-a81a67db5f67 for instance 0e89e500-ddc5-4549-8631-9d62545016d1 on n-h2-833090-16 Aug 31 16:04:23.046126 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-a8d677bd-856c-4608-810c-8d2a1d209115 req-e3c3e6af-a8dc-44a4-8022-bf1179f424e4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052175 Aug 31 16:04:23.047515 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1575/3062] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:04:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:04:23.057157 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-04738d4f-8fa8-4e72-ba04-39d8e6e1f48b tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:23.058957 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-04738d4f-8fa8-4e72-ba04-39d8e6e1f48b tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:23.073084 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-04738d4f-8fa8-4e72-ba04-39d8e6e1f48b tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:23.074290 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-04738d4f-8fa8-4e72-ba04-39d8e6e1f48b tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:23.075731 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-04738d4f-8fa8-4e72-ba04-39d8e6e1f48b tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:23.077227 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-04738d4f-8fa8-4e72-ba04-39d8e6e1f48b tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:23.078314 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-04738d4f-8fa8-4e72-ba04-39d8e6e1f48b tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:23.079333 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-04738d4f-8fa8-4e72-ba04-39d8e6e1f48b tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:23.551877 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-04738d4f-8fa8-4e72-ba04-39d8e6e1f48b tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:23.587237 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-04738d4f-8fa8-4e72-ba04-39d8e6e1f48b tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:23.593203 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-04738d4f-8fa8-4e72-ba04-39d8e6e1f48b tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:23.599931 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-04738d4f-8fa8-4e72-ba04-39d8e6e1f48b tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1878 microversion: 2.32 time: 0.550744 Aug 31 16:04:23.600887 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1576/3063] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:23 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1878 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:23.606048 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-92a85ab2-e222-4c8f-be1c-d4b15809cd12 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:23.607115 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-92a85ab2-e222-4c8f-be1c-d4b15809cd12 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:23.614313 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-92a85ab2-e222-4c8f-be1c-d4b15809cd12 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:23.615535 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-92a85ab2-e222-4c8f-be1c-d4b15809cd12 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:23.616229 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-92a85ab2-e222-4c8f-be1c-d4b15809cd12 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:23.617222 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-92a85ab2-e222-4c8f-be1c-d4b15809cd12 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:23.617734 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-92a85ab2-e222-4c8f-be1c-d4b15809cd12 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:23.618396 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-92a85ab2-e222-4c8f-be1c-d4b15809cd12 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:23.910543 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-386955c3-c9f6-4b93-9112-9bd80626d160 tempest-FloatingIPDetailsTestJSON-712446971 tempest-FloatingIPDetailsTestJSON-712446971-project] 10.222.0.50 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.996730 Aug 31 16:04:23.912197 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1488/3064] 10.222.0.50 () {60 vars in 1170 bytes} [Wed Aug 31 16:04:20 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2999 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:04:23.927063 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6c174d89-8d7f-4dc6-9f6f-abb3bbc316a3 tempest-FloatingIPDetailsTestJSON-712446971 tempest-FloatingIPDetailsTestJSON-712446971-project] Action: 'create', calling method: .version_select at 0x7fbb4aa39310>, body: {"pool": null} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:23.932163 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-92a85ab2-e222-4c8f-be1c-d4b15809cd12 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:23.945424 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-92a85ab2-e222-4c8f-be1c-d4b15809cd12 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1681 microversion: 2.1 time: 0.341385 Aug 31 16:04:23.949308 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1577/3065] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:23 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1681 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:24.008565 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4d72c71b-b482-4a46-a681-ca93b7ef4aa9 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:24.009462 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4d72c71b-b482-4a46-a681-ca93b7ef4aa9 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:24.035457 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4d72c71b-b482-4a46-a681-ca93b7ef4aa9 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:24.036167 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4d72c71b-b482-4a46-a681-ca93b7ef4aa9 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:24.036629 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4d72c71b-b482-4a46-a681-ca93b7ef4aa9 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:24.042695 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4d72c71b-b482-4a46-a681-ca93b7ef4aa9 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:24.046040 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4d72c71b-b482-4a46-a681-ca93b7ef4aa9 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:24.047537 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4d72c71b-b482-4a46-a681-ca93b7ef4aa9 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:24.439154 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4d72c71b-b482-4a46-a681-ca93b7ef4aa9 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:24.450009 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4d72c71b-b482-4a46-a681-ca93b7ef4aa9 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:24.453165 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4d72c71b-b482-4a46-a681-ca93b7ef4aa9 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:24.454756 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4d72c71b-b482-4a46-a681-ca93b7ef4aa9 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 1875 microversion: 2.42 time: 0.451145 Aug 31 16:04:24.458251 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1578/3066] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:24 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 1875 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:24.629533 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c04dee3c-3f5c-4f77-a39a-21327a6a1c99 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:24.630226 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c04dee3c-3f5c-4f77-a39a-21327a6a1c99 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:24.637591 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c04dee3c-3f5c-4f77-a39a-21327a6a1c99 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:24.638326 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c04dee3c-3f5c-4f77-a39a-21327a6a1c99 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:24.639698 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c04dee3c-3f5c-4f77-a39a-21327a6a1c99 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:24.641245 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c04dee3c-3f5c-4f77-a39a-21327a6a1c99 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:24.642155 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c04dee3c-3f5c-4f77-a39a-21327a6a1c99 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:24.642946 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c04dee3c-3f5c-4f77-a39a-21327a6a1c99 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:24.943311 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c04dee3c-3f5c-4f77-a39a-21327a6a1c99 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:24.959047 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c04dee3c-3f5c-4f77-a39a-21327a6a1c99 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:24.960604 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c04dee3c-3f5c-4f77-a39a-21327a6a1c99 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:24.962003 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c04dee3c-3f5c-4f77-a39a-21327a6a1c99 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1878 microversion: 2.32 time: 0.336600 Aug 31 16:04:24.962607 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1579/3067] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:24 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1878 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:25.057644 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f37c3392-a0b3-422e-83d8-fedc13387832 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:25.070553 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f37c3392-a0b3-422e-83d8-fedc13387832 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:25.078508 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f37c3392-a0b3-422e-83d8-fedc13387832 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:25.079598 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f37c3392-a0b3-422e-83d8-fedc13387832 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:25.080266 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f37c3392-a0b3-422e-83d8-fedc13387832 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:25.081746 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f37c3392-a0b3-422e-83d8-fedc13387832 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:25.082512 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f37c3392-a0b3-422e-83d8-fedc13387832 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:25.083041 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f37c3392-a0b3-422e-83d8-fedc13387832 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:25.300365 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f37c3392-a0b3-422e-83d8-fedc13387832 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:25.310880 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f37c3392-a0b3-422e-83d8-fedc13387832 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1681 microversion: 2.1 time: 0.257757 Aug 31 16:04:25.316696 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1580/3068] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:25 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1681 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:04:25.334329 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-cce97810-77fd-46d4-9135-eb583051ac2c req-4cc0e11e-03cd-4fbd-a7b3-fa5e096c142e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e89e500-ddc5-4549-8631-9d62545016d1", "name": "network-vif-plugged", "status": "completed", "tag": "6be52102-ccae-4668-bb69-c84a894fc971"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:25.356842 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-cce97810-77fd-46d4-9135-eb583051ac2c req-4cc0e11e-03cd-4fbd-a7b3-fa5e096c142e service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:25.359989 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-cce97810-77fd-46d4-9135-eb583051ac2c req-4cc0e11e-03cd-4fbd-a7b3-fa5e096c142e service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:25.360695 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-cce97810-77fd-46d4-9135-eb583051ac2c req-4cc0e11e-03cd-4fbd-a7b3-fa5e096c142e service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:25.391010 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-cce97810-77fd-46d4-9135-eb583051ac2c req-4cc0e11e-03cd-4fbd-a7b3-fa5e096c142e service nova] Creating event network-vif-plugged:6be52102-ccae-4668-bb69-c84a894fc971 for instance 0e89e500-ddc5-4549-8631-9d62545016d1 on n-h2-833090-16 Aug 31 16:04:25.397695 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-cce97810-77fd-46d4-9135-eb583051ac2c req-4cc0e11e-03cd-4fbd-a7b3-fa5e096c142e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078676 Aug 31 16:04:25.399132 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1581/3069] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:04:25.489235 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-39b94f78-8597-47db-bd29-4b78c70b5da8 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:25.491030 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-39b94f78-8597-47db-bd29-4b78c70b5da8 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:25.498649 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-39b94f78-8597-47db-bd29-4b78c70b5da8 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:25.499574 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-39b94f78-8597-47db-bd29-4b78c70b5da8 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:25.500239 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-39b94f78-8597-47db-bd29-4b78c70b5da8 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:25.501351 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-39b94f78-8597-47db-bd29-4b78c70b5da8 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:25.502013 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-39b94f78-8597-47db-bd29-4b78c70b5da8 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:25.502824 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-39b94f78-8597-47db-bd29-4b78c70b5da8 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:25.902134 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-39b94f78-8597-47db-bd29-4b78c70b5da8 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:25.922922 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-39b94f78-8597-47db-bd29-4b78c70b5da8 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:25.925385 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-39b94f78-8597-47db-bd29-4b78c70b5da8 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:25.926696 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-39b94f78-8597-47db-bd29-4b78c70b5da8 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 1875 microversion: 2.42 time: 0.444336 Aug 31 16:04:25.927274 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1582/3070] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:25 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 1875 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:04:25.990805 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a72cb19d-8ec1-493b-b6e7-6bec508e2248 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:25.991753 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a72cb19d-8ec1-493b-b6e7-6bec508e2248 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:26.000596 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a72cb19d-8ec1-493b-b6e7-6bec508e2248 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:26.001359 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a72cb19d-8ec1-493b-b6e7-6bec508e2248 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:26.002110 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a72cb19d-8ec1-493b-b6e7-6bec508e2248 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:26.003940 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a72cb19d-8ec1-493b-b6e7-6bec508e2248 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:26.004710 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a72cb19d-8ec1-493b-b6e7-6bec508e2248 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:26.005255 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a72cb19d-8ec1-493b-b6e7-6bec508e2248 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:26.147596 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6c174d89-8d7f-4dc6-9f6f-abb3bbc316a3 tempest-FloatingIPDetailsTestJSON-712446971 tempest-FloatingIPDetailsTestJSON-712446971-project] 10.222.0.50 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.224589 Aug 31 16:04:26.150008 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1489/3071] 10.222.0.50 () {60 vars in 1170 bytes} [Wed Aug 31 16:04:23 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:04:26.167087 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-95ffbc65-540d-4588-9dcb-d999c0011859 tempest-FloatingIPDetailsTestJSON-712446971 tempest-FloatingIPDetailsTestJSON-712446971-project] Calling method '.version_select at 0x7fbb4aa2aaf0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:26.384225 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a72cb19d-8ec1-493b-b6e7-6bec508e2248 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:26.412599 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a72cb19d-8ec1-493b-b6e7-6bec508e2248 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:26.420062 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a72cb19d-8ec1-493b-b6e7-6bec508e2248 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:26.423776 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a72cb19d-8ec1-493b-b6e7-6bec508e2248 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1878 microversion: 2.32 time: 0.440394 Aug 31 16:04:26.426545 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1583/3072] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:25 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1878 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:26.444205 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-287672bb-91db-4748-b767-caa904e99197 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:26.445886 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-287672bb-91db-4748-b767-caa904e99197 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:26.457767 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-287672bb-91db-4748-b767-caa904e99197 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:26.459174 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-287672bb-91db-4748-b767-caa904e99197 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:26.460409 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-287672bb-91db-4748-b767-caa904e99197 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:26.461783 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-287672bb-91db-4748-b767-caa904e99197 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:26.462675 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-287672bb-91db-4748-b767-caa904e99197 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:26.463438 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-287672bb-91db-4748-b767-caa904e99197 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:26.527044 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-95ffbc65-540d-4588-9dcb-d999c0011859 tempest-FloatingIPDetailsTestJSON-712446971 tempest-FloatingIPDetailsTestJSON-712446971-project] 10.222.0.50 "GET /compute/v2.1/os-floating-ips/96a75ac4-0ddf-417f-b344-6179b4f3330d" status: 200 len: 141 microversion: 2.1 time: 0.363933 Aug 31 16:04:26.538162 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1490/3073] 10.222.0.50 () {58 vars in 1260 bytes} [Wed Aug 31 16:04:26 2022] GET /compute/v2.1/os-floating-ips/96a75ac4-0ddf-417f-b344-6179b4f3330d => generated 141 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:04:26.555172 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dc5bb820-b166-4bb0-8578-d93a986a840b tempest-FloatingIPDetailsTestJSON-712446971 tempest-FloatingIPDetailsTestJSON-712446971-project] Calling method '.version_select at 0x7fbb4aa96430>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:26.792179 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-287672bb-91db-4748-b767-caa904e99197 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:26.801595 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-287672bb-91db-4748-b767-caa904e99197 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1681 microversion: 2.1 time: 0.371841 Aug 31 16:04:26.802548 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1584/3074] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:26 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1681 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:26.965851 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9409768a-84ee-47de-ac71-f5bc03b8a9f8 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:26.968691 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9409768a-84ee-47de-ac71-f5bc03b8a9f8 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:26.979352 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9409768a-84ee-47de-ac71-f5bc03b8a9f8 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:26.980807 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9409768a-84ee-47de-ac71-f5bc03b8a9f8 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:26.981253 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9409768a-84ee-47de-ac71-f5bc03b8a9f8 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:26.981982 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9409768a-84ee-47de-ac71-f5bc03b8a9f8 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:26.984208 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9409768a-84ee-47de-ac71-f5bc03b8a9f8 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:26.985355 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9409768a-84ee-47de-ac71-f5bc03b8a9f8 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:27.805027 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9409768a-84ee-47de-ac71-f5bc03b8a9f8 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:27.819602 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9409768a-84ee-47de-ac71-f5bc03b8a9f8 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:27.823010 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9409768a-84ee-47de-ac71-f5bc03b8a9f8 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:27.827461 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9409768a-84ee-47de-ac71-f5bc03b8a9f8 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 1875 microversion: 2.42 time: 0.867986 Aug 31 16:04:27.829714 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1585/3075] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:26 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 1875 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:04:27.838849 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-51f28f91-072e-4340-a7aa-765370142ec1 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:27.839721 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-51f28f91-072e-4340-a7aa-765370142ec1 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:27.846394 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51f28f91-072e-4340-a7aa-765370142ec1 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:27.847244 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51f28f91-072e-4340-a7aa-765370142ec1 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:27.848670 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51f28f91-072e-4340-a7aa-765370142ec1 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:27.849634 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51f28f91-072e-4340-a7aa-765370142ec1 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:27.850357 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51f28f91-072e-4340-a7aa-765370142ec1 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:27.850974 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51f28f91-072e-4340-a7aa-765370142ec1 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:28.162142 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-51f28f91-072e-4340-a7aa-765370142ec1 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:28.173182 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-51f28f91-072e-4340-a7aa-765370142ec1 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:28.175721 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-51f28f91-072e-4340-a7aa-765370142ec1 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:28.177329 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-51f28f91-072e-4340-a7aa-765370142ec1 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1878 microversion: 2.32 time: 0.345600 Aug 31 16:04:28.193852 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1586/3076] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:27 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1878 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:28.200297 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-495a032f-de10-476d-aa58-2bf2a47fd32e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:28.201573 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-495a032f-de10-476d-aa58-2bf2a47fd32e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:28.213999 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-495a032f-de10-476d-aa58-2bf2a47fd32e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:28.214797 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-495a032f-de10-476d-aa58-2bf2a47fd32e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:28.215248 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-495a032f-de10-476d-aa58-2bf2a47fd32e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:28.216680 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-495a032f-de10-476d-aa58-2bf2a47fd32e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:28.216815 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-495a032f-de10-476d-aa58-2bf2a47fd32e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:28.217194 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-495a032f-de10-476d-aa58-2bf2a47fd32e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:28.377207 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dc5bb820-b166-4bb0-8578-d93a986a840b tempest-FloatingIPDetailsTestJSON-712446971 tempest-FloatingIPDetailsTestJSON-712446971-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/96a75ac4-0ddf-417f-b344-6179b4f3330d" status: 202 len: 0 microversion: 2.1 time: 1.836063 Aug 31 16:04:28.386803 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1491/3077] 10.222.0.50 () {58 vars in 1263 bytes} [Wed Aug 31 16:04:26 2022] DELETE /compute/v2.1/os-floating-ips/96a75ac4-0ddf-417f-b344-6179b4f3330d => generated 0 bytes in 1847 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 16:04:28.399944 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f13d441b-045c-4297-adea-a1f98127b420 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:28.401422 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f13d441b-045c-4297-adea-a1f98127b420 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:28.419332 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f13d441b-045c-4297-adea-a1f98127b420 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:28.421281 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f13d441b-045c-4297-adea-a1f98127b420 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:28.427738 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f13d441b-045c-4297-adea-a1f98127b420 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:28.430161 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f13d441b-045c-4297-adea-a1f98127b420 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:28.432068 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f13d441b-045c-4297-adea-a1f98127b420 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:28.433023 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f13d441b-045c-4297-adea-a1f98127b420 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:28.451957 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-495a032f-de10-476d-aa58-2bf2a47fd32e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:28.463145 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-495a032f-de10-476d-aa58-2bf2a47fd32e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1681 microversion: 2.1 time: 0.271175 Aug 31 16:04:28.478284 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1587/3078] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:28 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1681 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:28.484402 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f066115c-6e78-4bd7-b6f4-abd73b2422f6 tempest-FloatingIPDetailsTestJSON-712446971 tempest-FloatingIPDetailsTestJSON-712446971-project] Calling method '.version_select at 0x7fbb4ac52e50>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:28.853541 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f066115c-6e78-4bd7-b6f4-abd73b2422f6 tempest-FloatingIPDetailsTestJSON-712446971 tempest-FloatingIPDetailsTestJSON-712446971-project] 10.222.0.50 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.373401 Aug 31 16:04:28.854633 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1588/3079] 10.222.0.50 () {58 vars in 1164 bytes} [Wed Aug 31 16:04:28 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:04:28.869698 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-863eaa86-4a31-493d-b7ea-d52d3406f8e3 req-2170b7f3-1395-442d-aabc-6a3e1f999d91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e89e500-ddc5-4549-8631-9d62545016d1", "name": "network-vif-plugged", "status": "completed", "tag": "57f3869c-b000-4d3c-afe9-a2a6741a014c"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:28.900568 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-863eaa86-4a31-493d-b7ea-d52d3406f8e3 req-2170b7f3-1395-442d-aabc-6a3e1f999d91 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:28.901077 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-863eaa86-4a31-493d-b7ea-d52d3406f8e3 req-2170b7f3-1395-442d-aabc-6a3e1f999d91 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:28.901510 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-863eaa86-4a31-493d-b7ea-d52d3406f8e3 req-2170b7f3-1395-442d-aabc-6a3e1f999d91 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:28.929399 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-863eaa86-4a31-493d-b7ea-d52d3406f8e3 req-2170b7f3-1395-442d-aabc-6a3e1f999d91 service nova] Creating event network-vif-plugged:57f3869c-b000-4d3c-afe9-a2a6741a014c for instance 0e89e500-ddc5-4549-8631-9d62545016d1 on n-h2-833090-16 Aug 31 16:04:28.937704 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-863eaa86-4a31-493d-b7ea-d52d3406f8e3 req-2170b7f3-1395-442d-aabc-6a3e1f999d91 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072340 Aug 31 16:04:28.939105 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1589/3080] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:04:28.940453 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f13d441b-045c-4297-adea-a1f98127b420 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc" status: 200 len: 1814 microversion: 2.1 time: 0.551242 Aug 31 16:04:28.954951 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-352d8cd3-7da3-4821-a120-faaad8f2f2ff tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:28.954951 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-352d8cd3-7da3-4821-a120-faaad8f2f2ff tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:28.955400 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-352d8cd3-7da3-4821-a120-faaad8f2f2ff tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:28.956425 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-352d8cd3-7da3-4821-a120-faaad8f2f2ff tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:28.957085 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-352d8cd3-7da3-4821-a120-faaad8f2f2ff tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:28.958014 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-352d8cd3-7da3-4821-a120-faaad8f2f2ff tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:28.958723 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-352d8cd3-7da3-4821-a120-faaad8f2f2ff tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:28.959725 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-352d8cd3-7da3-4821-a120-faaad8f2f2ff tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:28.967689 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1492/3081] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:28 2022] GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc => generated 1814 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:28.977131 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-45e075c8-0d64-49fe-bae3-5ab86cebe986 tempest-FloatingIPDetailsTestJSON-712446971 tempest-FloatingIPDetailsTestJSON-712446971-project] Calling method '.version_select at 0x7fbb4aa43dc0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:29.388812 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-45e075c8-0d64-49fe-bae3-5ab86cebe986 tempest-FloatingIPDetailsTestJSON-712446971 tempest-FloatingIPDetailsTestJSON-712446971-project] 10.222.0.50 "GET /compute/v2.1/os-floating-ips" status: 200 len: 396 microversion: 2.1 time: 0.419615 Aug 31 16:04:29.389542 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1493/3082] 10.222.0.50 () {58 vars in 1149 bytes} [Wed Aug 31 16:04:28 2022] GET /compute/v2.1/os-floating-ips => generated 396 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:04:29.403833 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-04f2f730-86c9-49dd-a724-7fb22f46e5ea tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:29.410128 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04f2f730-86c9-49dd-a724-7fb22f46e5ea tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:29.412046 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04f2f730-86c9-49dd-a724-7fb22f46e5ea tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:29.412971 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04f2f730-86c9-49dd-a724-7fb22f46e5ea tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:29.414361 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04f2f730-86c9-49dd-a724-7fb22f46e5ea tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:29.415145 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04f2f730-86c9-49dd-a724-7fb22f46e5ea tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:29.415972 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04f2f730-86c9-49dd-a724-7fb22f46e5ea tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:29.433485 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-352d8cd3-7da3-4821-a120-faaad8f2f2ff tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:29.447291 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-352d8cd3-7da3-4821-a120-faaad8f2f2ff tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:29.450047 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-352d8cd3-7da3-4821-a120-faaad8f2f2ff tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:29.450901 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-04f2f730-86c9-49dd-a724-7fb22f46e5ea tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.051395 Aug 31 16:04:29.452162 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-352d8cd3-7da3-4821-a120-faaad8f2f2ff tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 1875 microversion: 2.42 time: 0.511286 Aug 31 16:04:29.454711 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1590/3083] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:28 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 1875 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:29.458304 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1494/3084] 10.222.0.50 () {58 vars in 1176 bytes} [Wed Aug 31 16:04:29 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:04:29.467757 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fa1e5f33-6dd2-4742-aa78-7a60eea0dbe5 tempest-FloatingIPDetailsTestJSON-712446971 tempest-FloatingIPDetailsTestJSON-712446971-project] Calling method '.version_select at 0x7fbb45d74ee0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:29.473156 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-999321d0-4778-4b0f-aead-180507fe51e6 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:29.479264 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-999321d0-4778-4b0f-aead-180507fe51e6 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:29.495089 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-999321d0-4778-4b0f-aead-180507fe51e6 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:29.501958 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-999321d0-4778-4b0f-aead-180507fe51e6 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:29.502734 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-999321d0-4778-4b0f-aead-180507fe51e6 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:29.503965 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-999321d0-4778-4b0f-aead-180507fe51e6 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:29.504604 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-999321d0-4778-4b0f-aead-180507fe51e6 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:29.505769 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-999321d0-4778-4b0f-aead-180507fe51e6 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:30.089884 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-999321d0-4778-4b0f-aead-180507fe51e6 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:30.109640 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-999321d0-4778-4b0f-aead-180507fe51e6 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:30.118727 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-999321d0-4778-4b0f-aead-180507fe51e6 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:30.121541 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-999321d0-4778-4b0f-aead-180507fe51e6 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1878 microversion: 2.32 time: 0.664947 Aug 31 16:04:30.124882 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1591/3085] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:29 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1878 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:30.147233 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-afc2269c-8570-4c3b-8846-feb6743d5a09 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:30.151776 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-afc2269c-8570-4c3b-8846-feb6743d5a09 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:30.172577 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-afc2269c-8570-4c3b-8846-feb6743d5a09 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:30.173183 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-afc2269c-8570-4c3b-8846-feb6743d5a09 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:30.173561 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-afc2269c-8570-4c3b-8846-feb6743d5a09 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:30.179143 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-afc2269c-8570-4c3b-8846-feb6743d5a09 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:30.179664 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-afc2269c-8570-4c3b-8846-feb6743d5a09 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:30.180095 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-afc2269c-8570-4c3b-8846-feb6743d5a09 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:30.546330 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-afc2269c-8570-4c3b-8846-feb6743d5a09 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:30.559384 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-afc2269c-8570-4c3b-8846-feb6743d5a09 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1681 microversion: 2.1 time: 0.431391 Aug 31 16:04:30.570701 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1592/3086] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:30 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1681 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:30.575814 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ef365c3c-1a87-4713-98db-64fd19e24de5 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:30.576720 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ef365c3c-1a87-4713-98db-64fd19e24de5 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:30.591993 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ef365c3c-1a87-4713-98db-64fd19e24de5 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:30.592776 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ef365c3c-1a87-4713-98db-64fd19e24de5 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:30.593214 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ef365c3c-1a87-4713-98db-64fd19e24de5 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:30.593921 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ef365c3c-1a87-4713-98db-64fd19e24de5 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:30.594448 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ef365c3c-1a87-4713-98db-64fd19e24de5 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:30.594878 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ef365c3c-1a87-4713-98db-64fd19e24de5 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:30.912652 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ef365c3c-1a87-4713-98db-64fd19e24de5 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:30.935978 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ef365c3c-1a87-4713-98db-64fd19e24de5 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:30.937583 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ef365c3c-1a87-4713-98db-64fd19e24de5 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:30.940631 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ef365c3c-1a87-4713-98db-64fd19e24de5 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 1875 microversion: 2.42 time: 0.368670 Aug 31 16:04:30.961987 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1593/3087] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:30 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 1875 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:30.974724 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-0b2f381d-7caa-4483-b9b4-da17ef3ad53f req-2dc027b6-0907-4896-afba-d41f9a5b411b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e89e500-ddc5-4549-8631-9d62545016d1", "name": "network-vif-plugged", "status": "completed", "tag": "757b9501-0859-4dd6-8292-391612616a92"}, {"server_uuid": "0e89e500-ddc5-4549-8631-9d62545016d1", "name": "network-vif-plugged", "status": "completed", "tag": "505cceaf-e4cc-4b2b-8615-77bc0c7bf80e"}, {"server_uuid": "0e89e500-ddc5-4549-8631-9d62545016d1", "name": "network-vif-plugged", "status": "completed", "tag": "68c44d14-1c71-4e2c-a5ab-c43c22e7f048"}, {"server_uuid": "0e89e500-ddc5-4549-8631-9d62545016d1", "name": "network-vif-plugged", "status": "completed", "tag": "1caee438-a350-4a78-8297-f52725db29bb"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:31.004338 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-0b2f381d-7caa-4483-b9b4-da17ef3ad53f req-2dc027b6-0907-4896-afba-d41f9a5b411b service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:31.009461 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-0b2f381d-7caa-4483-b9b4-da17ef3ad53f req-2dc027b6-0907-4896-afba-d41f9a5b411b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:31.013031 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-0b2f381d-7caa-4483-b9b4-da17ef3ad53f req-2dc027b6-0907-4896-afba-d41f9a5b411b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:31.057118 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-0b2f381d-7caa-4483-b9b4-da17ef3ad53f req-2dc027b6-0907-4896-afba-d41f9a5b411b service nova] Creating event network-vif-plugged:757b9501-0859-4dd6-8292-391612616a92 for instance 0e89e500-ddc5-4549-8631-9d62545016d1 on n-h2-833090-16 Aug 31 16:04:31.057663 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-0b2f381d-7caa-4483-b9b4-da17ef3ad53f req-2dc027b6-0907-4896-afba-d41f9a5b411b service nova] Creating event network-vif-plugged:505cceaf-e4cc-4b2b-8615-77bc0c7bf80e for instance 0e89e500-ddc5-4549-8631-9d62545016d1 on n-h2-833090-16 Aug 31 16:04:31.059660 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-0b2f381d-7caa-4483-b9b4-da17ef3ad53f req-2dc027b6-0907-4896-afba-d41f9a5b411b service nova] Creating event network-vif-plugged:68c44d14-1c71-4e2c-a5ab-c43c22e7f048 for instance 0e89e500-ddc5-4549-8631-9d62545016d1 on n-h2-833090-16 Aug 31 16:04:31.060854 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-0b2f381d-7caa-4483-b9b4-da17ef3ad53f req-2dc027b6-0907-4896-afba-d41f9a5b411b service nova] Creating event network-vif-plugged:1caee438-a350-4a78-8297-f52725db29bb for instance 0e89e500-ddc5-4549-8631-9d62545016d1 on n-h2-833090-16 Aug 31 16:04:31.074162 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-0b2f381d-7caa-4483-b9b4-da17ef3ad53f req-2dc027b6-0907-4896-afba-d41f9a5b411b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.110269 Aug 31 16:04:31.080284 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1594/3088] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:04:31.149971 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9a89f273-7f6f-4da8-b58e-b4019eba4f91 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:31.150918 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9a89f273-7f6f-4da8-b58e-b4019eba4f91 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:31.162286 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9a89f273-7f6f-4da8-b58e-b4019eba4f91 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:31.163864 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9a89f273-7f6f-4da8-b58e-b4019eba4f91 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:31.164488 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9a89f273-7f6f-4da8-b58e-b4019eba4f91 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:31.165439 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9a89f273-7f6f-4da8-b58e-b4019eba4f91 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:31.167008 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9a89f273-7f6f-4da8-b58e-b4019eba4f91 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:31.167625 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9a89f273-7f6f-4da8-b58e-b4019eba4f91 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:31.226169 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=100 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:04:31.592079 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9a89f273-7f6f-4da8-b58e-b4019eba4f91 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:31.592852 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fa1e5f33-6dd2-4742-aa78-7a60eea0dbe5 tempest-FloatingIPDetailsTestJSON-712446971 tempest-FloatingIPDetailsTestJSON-712446971-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/4531249d-3824-4cd2-a299-bad6bb37d913" status: 202 len: 0 microversion: 2.1 time: 2.132342 Aug 31 16:04:31.595191 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1495/3089] 10.222.0.50 () {58 vars in 1263 bytes} [Wed Aug 31 16:04:29 2022] DELETE /compute/v2.1/os-floating-ips/4531249d-3824-4cd2-a299-bad6bb37d913 => generated 0 bytes in 2136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:04:31.608301 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9a89f273-7f6f-4da8-b58e-b4019eba4f91 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:31.610231 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9a89f273-7f6f-4da8-b58e-b4019eba4f91 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:31.611709 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9a89f273-7f6f-4da8-b58e-b4019eba4f91 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1878 microversion: 2.32 time: 0.466440 Aug 31 16:04:31.614377 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8be0b89d-f647-4b50-b92f-b195ee65de8c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:31.615509 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8be0b89d-f647-4b50-b92f-b195ee65de8c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:31.618540 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=48 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:04:31.627021 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1595/3090] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:31 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1878 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:04:31.631081 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8be0b89d-f647-4b50-b92f-b195ee65de8c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:31.631847 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8be0b89d-f647-4b50-b92f-b195ee65de8c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:31.633144 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8be0b89d-f647-4b50-b92f-b195ee65de8c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:31.634394 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8be0b89d-f647-4b50-b92f-b195ee65de8c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:31.634847 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8be0b89d-f647-4b50-b92f-b195ee65de8c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:31.635435 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8be0b89d-f647-4b50-b92f-b195ee65de8c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:31.652536 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ce78c461-0a48-4bc3-9df9-69bb6881d6a5 tempest-FloatingIPDetailsTestJSON-712446971 tempest-FloatingIPDetailsTestJSON-712446971-project] Calling method '.version_select at 0x7fbb46857a60>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:31.953536 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8be0b89d-f647-4b50-b92f-b195ee65de8c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:31.964470 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8be0b89d-f647-4b50-b92f-b195ee65de8c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1681 microversion: 2.1 time: 0.367892 Aug 31 16:04:31.978848 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1496/3091] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:31 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1681 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:31.978848 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0a00a28f-99d4-4d1c-9567-9f66b6a667f9 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:31.978848 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0a00a28f-99d4-4d1c-9567-9f66b6a667f9 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:31.984303 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a00a28f-99d4-4d1c-9567-9f66b6a667f9 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:31.984938 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a00a28f-99d4-4d1c-9567-9f66b6a667f9 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:31.985638 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a00a28f-99d4-4d1c-9567-9f66b6a667f9 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:31.989891 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a00a28f-99d4-4d1c-9567-9f66b6a667f9 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:31.991466 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a00a28f-99d4-4d1c-9567-9f66b6a667f9 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:31.992078 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a00a28f-99d4-4d1c-9567-9f66b6a667f9 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:32.555348 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0a00a28f-99d4-4d1c-9567-9f66b6a667f9 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:32.580594 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0a00a28f-99d4-4d1c-9567-9f66b6a667f9 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:32.586902 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0a00a28f-99d4-4d1c-9567-9f66b6a667f9 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:32.589769 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0a00a28f-99d4-4d1c-9567-9f66b6a667f9 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 1875 microversion: 2.42 time: 0.622121 Aug 31 16:04:32.592583 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1497/3092] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:31 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 1875 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:32.617648 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c6477efd-88af-4781-94c1-4db75a0e43f4 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bb35befd-ac43-4726-b646-26dccee9305d", "device": "/dev/xvdb"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:32.633140 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c6477efd-88af-4781-94c1-4db75a0e43f4 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:32.644811 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6477efd-88af-4781-94c1-4db75a0e43f4 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:32.645297 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6477efd-88af-4781-94c1-4db75a0e43f4 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:32.646730 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6477efd-88af-4781-94c1-4db75a0e43f4 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:32.647796 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6477efd-88af-4781-94c1-4db75a0e43f4 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:32.648258 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6477efd-88af-4781-94c1-4db75a0e43f4 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:32.648679 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6477efd-88af-4781-94c1-4db75a0e43f4 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:33.202509 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ce78c461-0a48-4bc3-9df9-69bb6881d6a5 tempest-FloatingIPDetailsTestJSON-712446971 tempest-FloatingIPDetailsTestJSON-712446971-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/b797c2c3-ba17-4216-939e-fb582e501bad" status: 202 len: 0 microversion: 2.1 time: 1.573847 Aug 31 16:04:33.205140 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1596/3093] 10.222.0.50 () {58 vars in 1263 bytes} [Wed Aug 31 16:04:31 2022] DELETE /compute/v2.1/os-floating-ips/b797c2c3-ba17-4216-939e-fb582e501bad => generated 0 bytes in 1577 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:04:33.220123 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f2ba3d15-64dd-4e29-bc44-4160852a5978 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:33.222206 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f2ba3d15-64dd-4e29-bc44-4160852a5978 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:33.238491 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=98 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:04:33.240768 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f2ba3d15-64dd-4e29-bc44-4160852a5978 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:33.241276 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f2ba3d15-64dd-4e29-bc44-4160852a5978 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:33.241719 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f2ba3d15-64dd-4e29-bc44-4160852a5978 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:33.244935 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f2ba3d15-64dd-4e29-bc44-4160852a5978 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:33.245862 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f2ba3d15-64dd-4e29-bc44-4160852a5978 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:33.246411 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f2ba3d15-64dd-4e29-bc44-4160852a5978 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:33.318161 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c6477efd-88af-4781-94c1-4db75a0e43f4 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "POST /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.719970 Aug 31 16:04:33.321641 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1498/3094] 10.222.0.50 () {60 vars in 1323 bytes} [Wed Aug 31 16:04:32 2022] POST /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc/os-volume_attachments => generated 194 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:04:33.347568 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f6eb940b-b1dc-4920-90e1-f9075f619f29 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:33.351920 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f6eb940b-b1dc-4920-90e1-f9075f619f29 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:33.370760 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6eb940b-b1dc-4920-90e1-f9075f619f29 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:33.371474 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6eb940b-b1dc-4920-90e1-f9075f619f29 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:33.374731 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6eb940b-b1dc-4920-90e1-f9075f619f29 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:33.375829 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6eb940b-b1dc-4920-90e1-f9075f619f29 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:33.376592 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6eb940b-b1dc-4920-90e1-f9075f619f29 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:33.383097 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6eb940b-b1dc-4920-90e1-f9075f619f29 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:33.801535 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f2ba3d15-64dd-4e29-bc44-4160852a5978 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:33.832557 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f2ba3d15-64dd-4e29-bc44-4160852a5978 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:33.836659 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f6eb940b-b1dc-4920-90e1-f9075f619f29 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:33.837885 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f2ba3d15-64dd-4e29-bc44-4160852a5978 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:33.840308 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f2ba3d15-64dd-4e29-bc44-4160852a5978 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1878 microversion: 2.32 time: 0.628896 Aug 31 16:04:33.845163 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1597/3095] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:33 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1878 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:33.851440 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:04:33.855305 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f6eb940b-b1dc-4920-90e1-f9075f619f29 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1658 microversion: 2.1 time: 0.531644 Aug 31 16:04:33.860354 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-821bdffa-efde-4e47-a0dc-1ae27254083b tempest-FloatingIPDetailsTestJSON-712446971 tempest-FloatingIPDetailsTestJSON-712446971-project] Calling method '.version_select at 0x7fbb46f6c790>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:33.871053 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1499/3096] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:33 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1658 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:33.880645 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dd227e99-e9d0-4a32-96e4-2c6c21d92bad tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:33.881672 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dd227e99-e9d0-4a32-96e4-2c6c21d92bad tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:33.892002 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd227e99-e9d0-4a32-96e4-2c6c21d92bad tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:33.892807 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd227e99-e9d0-4a32-96e4-2c6c21d92bad tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:33.893459 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd227e99-e9d0-4a32-96e4-2c6c21d92bad tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:33.894660 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd227e99-e9d0-4a32-96e4-2c6c21d92bad tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:33.895312 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd227e99-e9d0-4a32-96e4-2c6c21d92bad tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:33.895910 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd227e99-e9d0-4a32-96e4-2c6c21d92bad tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:34.663629 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dd227e99-e9d0-4a32-96e4-2c6c21d92bad tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:34.684355 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dd227e99-e9d0-4a32-96e4-2c6c21d92bad tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:34.686487 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dd227e99-e9d0-4a32-96e4-2c6c21d92bad tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:34.706759 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dd227e99-e9d0-4a32-96e4-2c6c21d92bad tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 1875 microversion: 2.42 time: 0.815858 Aug 31 16:04:34.711851 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1500/3097] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:33 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 1875 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:34.725135 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-81b35cac-0d74-46f5-b5b6-4e2e3a54a184 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:34.738696 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-81b35cac-0d74-46f5-b5b6-4e2e3a54a184 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:34.746696 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-81b35cac-0d74-46f5-b5b6-4e2e3a54a184 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:34.750382 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-81b35cac-0d74-46f5-b5b6-4e2e3a54a184 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:34.817330 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-81b35cac-0d74-46f5-b5b6-4e2e3a54a184 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Going to try to start instance {{(pid=128863) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 31 16:04:34.948127 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-81b35cac-0d74-46f5-b5b6-4e2e3a54a184 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "POST /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b/action" status: 202 len: 0 microversion: 2.1 time: 0.229593 Aug 31 16:04:34.949167 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1501/3098] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:04:34 2022] POST /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:04:34.966990 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5dbd335c-db01-4174-8c9c-476f2ad70714 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:34.968229 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5dbd335c-db01-4174-8c9c-476f2ad70714 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:35.007027 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5dbd335c-db01-4174-8c9c-476f2ad70714 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:35.007557 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5dbd335c-db01-4174-8c9c-476f2ad70714 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:35.007968 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5dbd335c-db01-4174-8c9c-476f2ad70714 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:35.008697 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5dbd335c-db01-4174-8c9c-476f2ad70714 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:35.009453 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5dbd335c-db01-4174-8c9c-476f2ad70714 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:35.009651 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5dbd335c-db01-4174-8c9c-476f2ad70714 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:35.576102 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5dbd335c-db01-4174-8c9c-476f2ad70714 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:35.602114 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5dbd335c-db01-4174-8c9c-476f2ad70714 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:35.603605 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5dbd335c-db01-4174-8c9c-476f2ad70714 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:35.605328 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5dbd335c-db01-4174-8c9c-476f2ad70714 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1878 microversion: 2.32 time: 0.654805 Aug 31 16:04:35.607237 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1502/3099] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:34 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1878 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:35.628610 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d0b0c8a1-b8e7-4812-9fc7-99770f2f1170 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:35.636859 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d0b0c8a1-b8e7-4812-9fc7-99770f2f1170 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:35.655010 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0b0c8a1-b8e7-4812-9fc7-99770f2f1170 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:35.658823 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0b0c8a1-b8e7-4812-9fc7-99770f2f1170 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:35.659434 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0b0c8a1-b8e7-4812-9fc7-99770f2f1170 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:35.686045 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0b0c8a1-b8e7-4812-9fc7-99770f2f1170 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:35.687188 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0b0c8a1-b8e7-4812-9fc7-99770f2f1170 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:35.689360 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0b0c8a1-b8e7-4812-9fc7-99770f2f1170 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:36.169017 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d0b0c8a1-b8e7-4812-9fc7-99770f2f1170 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:36.190890 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d0b0c8a1-b8e7-4812-9fc7-99770f2f1170 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1667 microversion: 2.1 time: 0.571785 Aug 31 16:04:36.197632 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1503/3100] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:35 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1667 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:36.204183 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c75380ef-b273-4622-8b6d-73eef3267921 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:36.204808 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c75380ef-b273-4622-8b6d-73eef3267921 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:36.230040 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c75380ef-b273-4622-8b6d-73eef3267921 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:36.230950 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c75380ef-b273-4622-8b6d-73eef3267921 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:36.234294 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c75380ef-b273-4622-8b6d-73eef3267921 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:36.237827 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c75380ef-b273-4622-8b6d-73eef3267921 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:36.239836 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c75380ef-b273-4622-8b6d-73eef3267921 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:36.242439 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c75380ef-b273-4622-8b6d-73eef3267921 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:37.282974 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-821bdffa-efde-4e47-a0dc-1ae27254083b tempest-FloatingIPDetailsTestJSON-712446971 tempest-FloatingIPDetailsTestJSON-712446971-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/e0b40b44-54b1-49ca-a5f8-9caaf6a38f4a" status: 202 len: 0 microversion: 2.1 time: 3.432415 Aug 31 16:04:37.284518 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1598/3101] 10.222.0.50 () {58 vars in 1263 bytes} [Wed Aug 31 16:04:33 2022] DELETE /compute/v2.1/os-floating-ips/e0b40b44-54b1-49ca-a5f8-9caaf6a38f4a => generated 0 bytes in 3438 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:04:37.290415 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-08e74e5c-1d7e-427f-8fcf-5534b1494b84 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:37.291306 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-08e74e5c-1d7e-427f-8fcf-5534b1494b84 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:37.306962 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-08e74e5c-1d7e-427f-8fcf-5534b1494b84 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:37.311543 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-08e74e5c-1d7e-427f-8fcf-5534b1494b84 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:37.312220 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-08e74e5c-1d7e-427f-8fcf-5534b1494b84 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:37.314258 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-08e74e5c-1d7e-427f-8fcf-5534b1494b84 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:37.318903 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-08e74e5c-1d7e-427f-8fcf-5534b1494b84 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:37.321052 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-08e74e5c-1d7e-427f-8fcf-5534b1494b84 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:37.506226 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c75380ef-b273-4622-8b6d-73eef3267921 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:37.530915 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c75380ef-b273-4622-8b6d-73eef3267921 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:37.535301 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c75380ef-b273-4622-8b6d-73eef3267921 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:37.540021 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c75380ef-b273-4622-8b6d-73eef3267921 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 2834 microversion: 2.42 time: 1.340605 Aug 31 16:04:37.541822 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1504/3102] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:36 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 2834 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:37.550286 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a502d77b-0322-4f6c-baf7-4c52afaab574 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:37.551738 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a502d77b-0322-4f6c-baf7-4c52afaab574 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:37.559854 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a502d77b-0322-4f6c-baf7-4c52afaab574 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:37.560837 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a502d77b-0322-4f6c-baf7-4c52afaab574 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:37.561438 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a502d77b-0322-4f6c-baf7-4c52afaab574 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:37.562735 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a502d77b-0322-4f6c-baf7-4c52afaab574 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:37.563796 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a502d77b-0322-4f6c-baf7-4c52afaab574 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:37.564380 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a502d77b-0322-4f6c-baf7-4c52afaab574 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:38.262779 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-08e74e5c-1d7e-427f-8fcf-5534b1494b84 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:38.276794 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-08e74e5c-1d7e-427f-8fcf-5534b1494b84 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:38.278856 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-08e74e5c-1d7e-427f-8fcf-5534b1494b84 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:38.282170 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-08e74e5c-1d7e-427f-8fcf-5534b1494b84 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1878 microversion: 2.32 time: 0.995998 Aug 31 16:04:38.295571 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1599/3103] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:37 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1878 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:38.312204 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-02b3c911-c784-46e3-8dc5-9d347700513f tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:38.313171 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-02b3c911-c784-46e3-8dc5-9d347700513f tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:38.326049 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-02b3c911-c784-46e3-8dc5-9d347700513f tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:38.328583 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-02b3c911-c784-46e3-8dc5-9d347700513f tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:38.329463 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-02b3c911-c784-46e3-8dc5-9d347700513f tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:38.332330 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-02b3c911-c784-46e3-8dc5-9d347700513f tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:38.333900 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-02b3c911-c784-46e3-8dc5-9d347700513f tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:38.334593 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-02b3c911-c784-46e3-8dc5-9d347700513f tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:38.383024 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a502d77b-0322-4f6c-baf7-4c52afaab574 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:38.395710 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a502d77b-0322-4f6c-baf7-4c52afaab574 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1667 microversion: 2.1 time: 0.852112 Aug 31 16:04:38.407229 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1505/3104] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:37 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1667 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:38.645985 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-02b3c911-c784-46e3-8dc5-9d347700513f tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.347484 Aug 31 16:04:38.655431 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1600/3105] 10.222.0.50 () {60 vars in 1316 bytes} [Wed Aug 31 16:04:38 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1/os-interface => generated 1831 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:39.316144 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-df2ad5c3-f316-46b6-bd9c-9270178167ee tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:39.318323 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-df2ad5c3-f316-46b6-bd9c-9270178167ee tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:39.342554 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df2ad5c3-f316-46b6-bd9c-9270178167ee tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:39.347779 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df2ad5c3-f316-46b6-bd9c-9270178167ee tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:39.348660 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df2ad5c3-f316-46b6-bd9c-9270178167ee tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:39.350574 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df2ad5c3-f316-46b6-bd9c-9270178167ee tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:39.354758 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df2ad5c3-f316-46b6-bd9c-9270178167ee tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:39.355545 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df2ad5c3-f316-46b6-bd9c-9270178167ee tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:39.436056 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6ea84032-c720-48a9-8875-2071fd6cb03d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:39.437992 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6ea84032-c720-48a9-8875-2071fd6cb03d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:39.452483 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:04:39.457359 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6ea84032-c720-48a9-8875-2071fd6cb03d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:39.459731 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6ea84032-c720-48a9-8875-2071fd6cb03d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:39.460902 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6ea84032-c720-48a9-8875-2071fd6cb03d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:39.463952 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6ea84032-c720-48a9-8875-2071fd6cb03d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:39.466136 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6ea84032-c720-48a9-8875-2071fd6cb03d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:39.467748 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6ea84032-c720-48a9-8875-2071fd6cb03d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:40.297029 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6ea84032-c720-48a9-8875-2071fd6cb03d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:40.315720 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6ea84032-c720-48a9-8875-2071fd6cb03d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1671 microversion: 2.1 time: 0.886413 Aug 31 16:04:40.333965 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1601/3106] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:39 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1671 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:40.367702 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5bf88409-1801-4ccc-abf2-a8e3006e0a11 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:40.368378 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5bf88409-1801-4ccc-abf2-a8e3006e0a11 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:40.391507 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5bf88409-1801-4ccc-abf2-a8e3006e0a11 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:40.392302 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5bf88409-1801-4ccc-abf2-a8e3006e0a11 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:40.392501 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5bf88409-1801-4ccc-abf2-a8e3006e0a11 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:40.393148 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5bf88409-1801-4ccc-abf2-a8e3006e0a11 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:40.395196 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5bf88409-1801-4ccc-abf2-a8e3006e0a11 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:40.397021 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5bf88409-1801-4ccc-abf2-a8e3006e0a11 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:40.574762 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-df2ad5c3-f316-46b6-bd9c-9270178167ee tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:40.640384 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-df2ad5c3-f316-46b6-bd9c-9270178167ee tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:40.659648 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-df2ad5c3-f316-46b6-bd9c-9270178167ee tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:40.661664 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-df2ad5c3-f316-46b6-bd9c-9270178167ee tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1878 microversion: 2.32 time: 1.351903 Aug 31 16:04:40.666025 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1506/3107] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:39 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1878 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:40.884528 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5bf88409-1801-4ccc-abf2-a8e3006e0a11 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:40.894635 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5bf88409-1801-4ccc-abf2-a8e3006e0a11 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1671 microversion: 2.1 time: 0.556226 Aug 31 16:04:40.895238 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1602/3108] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:40 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1671 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:40.915721 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-db5e4515-0787-4bff-8694-83fd605ad87f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:40.916177 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-db5e4515-0787-4bff-8694-83fd605ad87f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:40.933092 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db5e4515-0787-4bff-8694-83fd605ad87f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:40.938219 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db5e4515-0787-4bff-8694-83fd605ad87f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:40.943171 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db5e4515-0787-4bff-8694-83fd605ad87f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:40.943936 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db5e4515-0787-4bff-8694-83fd605ad87f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:40.944401 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db5e4515-0787-4bff-8694-83fd605ad87f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:40.946810 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db5e4515-0787-4bff-8694-83fd605ad87f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:41.076928 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-db5e4515-0787-4bff-8694-83fd605ad87f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Unlocking {{(pid=128863) unlock /opt/stack/nova/nova/compute/api.py:4872}} Aug 31 16:04:41.177238 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-db5e4515-0787-4bff-8694-83fd605ad87f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "POST /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b/action" status: 202 len: 0 microversion: 2.1 time: 0.265621 Aug 31 16:04:41.179117 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1507/3109] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:04:40 2022] POST /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:04:41.195052 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-87f24f72-5c0b-4de7-b58b-31f0201159eb tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:41.196260 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-87f24f72-5c0b-4de7-b58b-31f0201159eb tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:41.211098 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-87f24f72-5c0b-4de7-b58b-31f0201159eb tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:41.211967 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-87f24f72-5c0b-4de7-b58b-31f0201159eb tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:41.212593 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-87f24f72-5c0b-4de7-b58b-31f0201159eb tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:41.213320 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-87f24f72-5c0b-4de7-b58b-31f0201159eb tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:41.213773 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-87f24f72-5c0b-4de7-b58b-31f0201159eb tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:41.214219 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-87f24f72-5c0b-4de7-b58b-31f0201159eb tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:41.681896 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-c71a024a-2fac-4097-b83e-cf96c535bcbb req-528a0df3-5cc7-450f-8bb9-dae470126a7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e89e500-ddc5-4549-8631-9d62545016d1", "tag": "1caee438-a350-4a78-8297-f52725db29bb"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:41.702951 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c71a024a-2fac-4097-b83e-cf96c535bcbb req-528a0df3-5cc7-450f-8bb9-dae470126a7f service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:41.705613 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c71a024a-2fac-4097-b83e-cf96c535bcbb req-528a0df3-5cc7-450f-8bb9-dae470126a7f service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:41.706735 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c71a024a-2fac-4097-b83e-cf96c535bcbb req-528a0df3-5cc7-450f-8bb9-dae470126a7f service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:41.744702 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-c71a024a-2fac-4097-b83e-cf96c535bcbb req-528a0df3-5cc7-450f-8bb9-dae470126a7f service nova] Creating event network-changed:1caee438-a350-4a78-8297-f52725db29bb for instance 0e89e500-ddc5-4549-8631-9d62545016d1 on n-h2-833090-16 Aug 31 16:04:41.745819 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-87f24f72-5c0b-4de7-b58b-31f0201159eb tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:41.752626 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-c71a024a-2fac-4097-b83e-cf96c535bcbb req-528a0df3-5cc7-450f-8bb9-dae470126a7f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075015 Aug 31 16:04:41.755200 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-87f24f72-5c0b-4de7-b58b-31f0201159eb tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1671 microversion: 2.1 time: 0.564077 Aug 31 16:04:41.761231 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1508/3110] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:04:41.768955 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f2a10be4-ec6e-4e8a-93ef-9c340194ea9c tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:41.772106 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f2a10be4-ec6e-4e8a-93ef-9c340194ea9c tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:41.784867 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f2a10be4-ec6e-4e8a-93ef-9c340194ea9c tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:41.787394 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1603/3111] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:41 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1671 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:41.789381 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f2a10be4-ec6e-4e8a-93ef-9c340194ea9c tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:41.790596 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f2a10be4-ec6e-4e8a-93ef-9c340194ea9c tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:41.793351 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f2a10be4-ec6e-4e8a-93ef-9c340194ea9c tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:41.794012 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f2a10be4-ec6e-4e8a-93ef-9c340194ea9c tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:41.794647 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f2a10be4-ec6e-4e8a-93ef-9c340194ea9c tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:41.794892 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a83e5028-248a-4848-9f81-ef047a0815db tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:41.810735 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a83e5028-248a-4848-9f81-ef047a0815db tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:41.833523 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a83e5028-248a-4848-9f81-ef047a0815db tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:41.834335 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a83e5028-248a-4848-9f81-ef047a0815db tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:41.834949 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a83e5028-248a-4848-9f81-ef047a0815db tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:41.835817 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a83e5028-248a-4848-9f81-ef047a0815db tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:41.836426 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a83e5028-248a-4848-9f81-ef047a0815db tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:41.837019 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a83e5028-248a-4848-9f81-ef047a0815db tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:42.569540 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a83e5028-248a-4848-9f81-ef047a0815db tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:42.580272 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a83e5028-248a-4848-9f81-ef047a0815db tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1671 microversion: 2.1 time: 0.788047 Aug 31 16:04:42.580889 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1604/3112] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:41 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1671 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:42.605683 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f869deae-7b32-4a9a-8cb5-94cd78691756 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:42.612810 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f869deae-7b32-4a9a-8cb5-94cd78691756 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:42.634199 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f869deae-7b32-4a9a-8cb5-94cd78691756 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:42.634629 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f869deae-7b32-4a9a-8cb5-94cd78691756 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:42.635147 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f869deae-7b32-4a9a-8cb5-94cd78691756 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:42.635952 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f869deae-7b32-4a9a-8cb5-94cd78691756 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:42.636890 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f869deae-7b32-4a9a-8cb5-94cd78691756 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:42.637525 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f869deae-7b32-4a9a-8cb5-94cd78691756 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:42.721067 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f2a10be4-ec6e-4e8a-93ef-9c340194ea9c tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:42.746302 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f2a10be4-ec6e-4e8a-93ef-9c340194ea9c tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:42.747818 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f2a10be4-ec6e-4e8a-93ef-9c340194ea9c tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:42.752487 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f2a10be4-ec6e-4e8a-93ef-9c340194ea9c tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1878 microversion: 2.32 time: 0.989669 Aug 31 16:04:42.753622 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1509/3113] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:41 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1878 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:43.031927 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f869deae-7b32-4a9a-8cb5-94cd78691756 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:43.044128 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f869deae-7b32-4a9a-8cb5-94cd78691756 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1671 microversion: 2.1 time: 0.442226 Aug 31 16:04:43.046302 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1605/3114] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:42 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1671 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:04:43.069256 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-552b88b0-978c-4bad-b1b7-b7eb456c05e9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:43.069792 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-552b88b0-978c-4bad-b1b7-b7eb456c05e9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:43.078107 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-552b88b0-978c-4bad-b1b7-b7eb456c05e9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:43.078608 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-552b88b0-978c-4bad-b1b7-b7eb456c05e9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:43.079041 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-552b88b0-978c-4bad-b1b7-b7eb456c05e9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:43.079756 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-552b88b0-978c-4bad-b1b7-b7eb456c05e9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:43.080187 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-552b88b0-978c-4bad-b1b7-b7eb456c05e9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:43.080606 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-552b88b0-978c-4bad-b1b7-b7eb456c05e9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:43.290501 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-552b88b0-978c-4bad-b1b7-b7eb456c05e9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "POST /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b/action" status: 202 len: 0 microversion: 2.1 time: 0.224967 Aug 31 16:04:43.291787 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1510/3115] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:04:43 2022] POST /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:04:43.310929 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3dc236e6-156c-470d-9bae-fe21e248f3a2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:43.311690 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3dc236e6-156c-470d-9bae-fe21e248f3a2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:43.333193 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3dc236e6-156c-470d-9bae-fe21e248f3a2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:43.333817 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3dc236e6-156c-470d-9bae-fe21e248f3a2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:43.334321 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3dc236e6-156c-470d-9bae-fe21e248f3a2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:43.335159 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3dc236e6-156c-470d-9bae-fe21e248f3a2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:43.335614 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3dc236e6-156c-470d-9bae-fe21e248f3a2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:43.342157 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3dc236e6-156c-470d-9bae-fe21e248f3a2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:43.788244 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6ebf19ac-a24a-4496-ab6d-17cf3ef395b8 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:43.789550 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6ebf19ac-a24a-4496-ab6d-17cf3ef395b8 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:43.804531 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ebf19ac-a24a-4496-ab6d-17cf3ef395b8 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:43.807182 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ebf19ac-a24a-4496-ab6d-17cf3ef395b8 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:43.810864 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ebf19ac-a24a-4496-ab6d-17cf3ef395b8 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:43.811667 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ebf19ac-a24a-4496-ab6d-17cf3ef395b8 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:43.815444 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ebf19ac-a24a-4496-ab6d-17cf3ef395b8 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:43.816281 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ebf19ac-a24a-4496-ab6d-17cf3ef395b8 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:43.887352 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3dc236e6-156c-470d-9bae-fe21e248f3a2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:43.901487 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3dc236e6-156c-470d-9bae-fe21e248f3a2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1676 microversion: 2.1 time: 0.605650 Aug 31 16:04:43.902144 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1606/3116] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:43 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1676 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:44.570290 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6ebf19ac-a24a-4496-ab6d-17cf3ef395b8 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:44.590761 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6ebf19ac-a24a-4496-ab6d-17cf3ef395b8 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:44.593611 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6ebf19ac-a24a-4496-ab6d-17cf3ef395b8 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:44.595522 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6ebf19ac-a24a-4496-ab6d-17cf3ef395b8 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1878 microversion: 2.32 time: 0.811645 Aug 31 16:04:44.600962 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1511/3117] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:43 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1878 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:44.934857 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9aea66a7-ed6b-4c3a-8cca-27001f1383c3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:44.936207 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9aea66a7-ed6b-4c3a-8cca-27001f1383c3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:44.954075 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9aea66a7-ed6b-4c3a-8cca-27001f1383c3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:44.957221 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9aea66a7-ed6b-4c3a-8cca-27001f1383c3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:44.958650 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9aea66a7-ed6b-4c3a-8cca-27001f1383c3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:44.961498 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9aea66a7-ed6b-4c3a-8cca-27001f1383c3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:44.963103 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9aea66a7-ed6b-4c3a-8cca-27001f1383c3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:44.966063 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9aea66a7-ed6b-4c3a-8cca-27001f1383c3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:45.638660 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-5cbe0511-680a-4e6f-b1fe-3414de5cac9d req-fb04156a-925c-4826-afc7-1f928d1d2550 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9", "name": "network-vif-plugged", "status": "completed", "tag": "f9cdc28e-e2d4-4e82-a9fd-a5a05b15a14c"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:45.658702 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5cbe0511-680a-4e6f-b1fe-3414de5cac9d req-fb04156a-925c-4826-afc7-1f928d1d2550 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:45.664996 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5cbe0511-680a-4e6f-b1fe-3414de5cac9d req-fb04156a-925c-4826-afc7-1f928d1d2550 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:45.669227 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5cbe0511-680a-4e6f-b1fe-3414de5cac9d req-fb04156a-925c-4826-afc7-1f928d1d2550 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:45.699129 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-5cbe0511-680a-4e6f-b1fe-3414de5cac9d req-fb04156a-925c-4826-afc7-1f928d1d2550 service nova] Creating event network-vif-plugged:f9cdc28e-e2d4-4e82-a9fd-a5a05b15a14c for instance a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 on n-h2-833090-16 Aug 31 16:04:45.706925 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-5cbe0511-680a-4e6f-b1fe-3414de5cac9d req-fb04156a-925c-4826-afc7-1f928d1d2550 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.317209 Aug 31 16:04:45.708946 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1512/3118] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:04:45.715748 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-867de912-3569-48de-9053-e94d774345f5 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:45.716873 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-867de912-3569-48de-9053-e94d774345f5 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:45.725513 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-867de912-3569-48de-9053-e94d774345f5 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:45.726914 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-867de912-3569-48de-9053-e94d774345f5 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:45.727647 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-867de912-3569-48de-9053-e94d774345f5 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:45.728623 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-867de912-3569-48de-9053-e94d774345f5 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:45.730453 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-867de912-3569-48de-9053-e94d774345f5 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:45.731103 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-867de912-3569-48de-9053-e94d774345f5 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:45.757440 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9aea66a7-ed6b-4c3a-8cca-27001f1383c3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:45.770447 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9aea66a7-ed6b-4c3a-8cca-27001f1383c3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1656 microversion: 2.1 time: 0.845747 Aug 31 16:04:45.770962 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1607/3119] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:44 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1656 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:45.785742 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:04:45.814158 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9cbb88ac-4c01-4405-b96b-a73f309e454f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:45.814158 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9cbb88ac-4c01-4405-b96b-a73f309e454f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:45.836244 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9cbb88ac-4c01-4405-b96b-a73f309e454f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:45.836710 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9cbb88ac-4c01-4405-b96b-a73f309e454f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:45.837191 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9cbb88ac-4c01-4405-b96b-a73f309e454f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:45.837975 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9cbb88ac-4c01-4405-b96b-a73f309e454f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:45.838517 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9cbb88ac-4c01-4405-b96b-a73f309e454f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:45.838891 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9cbb88ac-4c01-4405-b96b-a73f309e454f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:46.037439 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9cbb88ac-4c01-4405-b96b-a73f309e454f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "POST /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b/action" status: 202 len: 0 microversion: 2.1 time: 0.242611 Aug 31 16:04:46.046264 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1608/3120] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:04:45 2022] POST /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:04:46.059817 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-778a513e-fcf8-4a2c-a812-3d6dfba4915f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:46.063042 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-778a513e-fcf8-4a2c-a812-3d6dfba4915f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:46.091194 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-778a513e-fcf8-4a2c-a812-3d6dfba4915f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:46.094133 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-778a513e-fcf8-4a2c-a812-3d6dfba4915f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:46.094724 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-778a513e-fcf8-4a2c-a812-3d6dfba4915f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:46.096501 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-778a513e-fcf8-4a2c-a812-3d6dfba4915f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:46.098719 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-778a513e-fcf8-4a2c-a812-3d6dfba4915f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:46.099281 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-778a513e-fcf8-4a2c-a812-3d6dfba4915f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:46.825727 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-867de912-3569-48de-9053-e94d774345f5 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:46.839528 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-778a513e-fcf8-4a2c-a812-3d6dfba4915f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:46.860341 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-867de912-3569-48de-9053-e94d774345f5 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:46.863013 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-778a513e-fcf8-4a2c-a812-3d6dfba4915f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1663 microversion: 2.1 time: 0.814919 Aug 31 16:04:46.863644 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1609/3121] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:46 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1663 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:46.876929 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-867de912-3569-48de-9053-e94d774345f5 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:46.876929 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-867de912-3569-48de-9053-e94d774345f5 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1878 microversion: 2.32 time: 1.163572 Aug 31 16:04:46.876929 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1513/3122] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:45 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1878 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:47.748777 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-24f6b820-fe9a-4811-a330-ab0c58de2c2c req-c1cd7e42-5f39-4770-95d0-b3e32242f91b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9", "name": "network-vif-plugged", "status": "completed", "tag": "01d2be63-7429-490a-bba0-954dc6039768"}, {"server_uuid": "a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9", "name": "network-vif-plugged", "status": "completed", "tag": "0e3734e2-2119-411e-bd8e-c6da7c160678"}, {"server_uuid": "a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9", "name": "network-vif-plugged", "status": "completed", "tag": "988b704e-8f3a-4c8f-903a-1661f7c99521"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:47.764980 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-24f6b820-fe9a-4811-a330-ab0c58de2c2c req-c1cd7e42-5f39-4770-95d0-b3e32242f91b service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:47.766004 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-24f6b820-fe9a-4811-a330-ab0c58de2c2c req-c1cd7e42-5f39-4770-95d0-b3e32242f91b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:47.766575 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-24f6b820-fe9a-4811-a330-ab0c58de2c2c req-c1cd7e42-5f39-4770-95d0-b3e32242f91b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:47.791600 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-24f6b820-fe9a-4811-a330-ab0c58de2c2c req-c1cd7e42-5f39-4770-95d0-b3e32242f91b service nova] Creating event network-vif-plugged:01d2be63-7429-490a-bba0-954dc6039768 for instance a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 on n-h2-833090-16 Aug 31 16:04:47.792772 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-24f6b820-fe9a-4811-a330-ab0c58de2c2c req-c1cd7e42-5f39-4770-95d0-b3e32242f91b service nova] Creating event network-vif-plugged:0e3734e2-2119-411e-bd8e-c6da7c160678 for instance a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 on n-h2-833090-16 Aug 31 16:04:47.796060 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-24f6b820-fe9a-4811-a330-ab0c58de2c2c req-c1cd7e42-5f39-4770-95d0-b3e32242f91b service nova] Creating event network-vif-plugged:988b704e-8f3a-4c8f-903a-1661f7c99521 for instance a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 on n-h2-833090-16 Aug 31 16:04:47.808734 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-24f6b820-fe9a-4811-a330-ab0c58de2c2c req-c1cd7e42-5f39-4770-95d0-b3e32242f91b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.063648 Aug 31 16:04:47.809850 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1610/3123] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:04:47.893712 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-406bd422-7316-4bc7-bf47-66118c8f9009 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:47.894567 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-406bd422-7316-4bc7-bf47-66118c8f9009 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:47.904898 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-406bd422-7316-4bc7-bf47-66118c8f9009 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:47.906762 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-406bd422-7316-4bc7-bf47-66118c8f9009 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:47.907481 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-406bd422-7316-4bc7-bf47-66118c8f9009 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:47.908496 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-406bd422-7316-4bc7-bf47-66118c8f9009 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:47.910126 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-406bd422-7316-4bc7-bf47-66118c8f9009 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:47.911586 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-406bd422-7316-4bc7-bf47-66118c8f9009 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:47.921463 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-564f455e-c53d-416b-84fd-e6d5986e6684 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:47.926685 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-564f455e-c53d-416b-84fd-e6d5986e6684 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:47.942147 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-564f455e-c53d-416b-84fd-e6d5986e6684 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:47.944708 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-564f455e-c53d-416b-84fd-e6d5986e6684 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:47.946241 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-564f455e-c53d-416b-84fd-e6d5986e6684 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:47.947171 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-564f455e-c53d-416b-84fd-e6d5986e6684 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:47.950261 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-564f455e-c53d-416b-84fd-e6d5986e6684 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:47.951027 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-564f455e-c53d-416b-84fd-e6d5986e6684 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:48.322234 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-406bd422-7316-4bc7-bf47-66118c8f9009 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:48.340467 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-406bd422-7316-4bc7-bf47-66118c8f9009 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1671 microversion: 2.1 time: 0.452831 Aug 31 16:04:48.341507 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1514/3124] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:47 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1671 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:48.363501 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a9ec574e-4a79-466a-be01-698f44f159f4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:48.364110 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a9ec574e-4a79-466a-be01-698f44f159f4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:48.372608 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9ec574e-4a79-466a-be01-698f44f159f4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:48.373275 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9ec574e-4a79-466a-be01-698f44f159f4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:48.373877 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9ec574e-4a79-466a-be01-698f44f159f4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:48.375064 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9ec574e-4a79-466a-be01-698f44f159f4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:48.376093 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9ec574e-4a79-466a-be01-698f44f159f4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:48.377570 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9ec574e-4a79-466a-be01-698f44f159f4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:48.433422 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-564f455e-c53d-416b-84fd-e6d5986e6684 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:48.453502 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-564f455e-c53d-416b-84fd-e6d5986e6684 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:48.455032 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-564f455e-c53d-416b-84fd-e6d5986e6684 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:48.456477 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-564f455e-c53d-416b-84fd-e6d5986e6684 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1878 microversion: 2.32 time: 0.552178 Aug 31 16:04:48.471116 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1611/3125] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:47 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1878 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:48.675034 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a9ec574e-4a79-466a-be01-698f44f159f4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:48.686387 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a9ec574e-4a79-466a-be01-698f44f159f4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1671 microversion: 2.1 time: 0.326864 Aug 31 16:04:48.688375 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1515/3126] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:48 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1671 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:04:48.714752 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fb3802e1-ebbc-4922-9d22-5e00fdcf08ce tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:48.715481 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fb3802e1-ebbc-4922-9d22-5e00fdcf08ce tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:48.722449 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb3802e1-ebbc-4922-9d22-5e00fdcf08ce tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:48.722956 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb3802e1-ebbc-4922-9d22-5e00fdcf08ce tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:48.723375 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb3802e1-ebbc-4922-9d22-5e00fdcf08ce tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:48.724258 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb3802e1-ebbc-4922-9d22-5e00fdcf08ce tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:48.724884 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb3802e1-ebbc-4922-9d22-5e00fdcf08ce tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:48.725680 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb3802e1-ebbc-4922-9d22-5e00fdcf08ce tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:48.987788 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-fb3802e1-ebbc-4922-9d22-5e00fdcf08ce tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:49.002808 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fb3802e1-ebbc-4922-9d22-5e00fdcf08ce tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1671 microversion: 2.1 time: 0.293298 Aug 31 16:04:49.004310 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1612/3127] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:48 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1671 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:49.037143 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c4f7cf06-1c55-4cab-a11b-6e7ee877eae1 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:49.051372 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c4f7cf06-1c55-4cab-a11b-6e7ee877eae1 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:49.073542 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4f7cf06-1c55-4cab-a11b-6e7ee877eae1 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:49.074053 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4f7cf06-1c55-4cab-a11b-6e7ee877eae1 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:49.074516 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4f7cf06-1c55-4cab-a11b-6e7ee877eae1 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:49.075906 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4f7cf06-1c55-4cab-a11b-6e7ee877eae1 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:49.077013 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4f7cf06-1c55-4cab-a11b-6e7ee877eae1 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:49.078021 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4f7cf06-1c55-4cab-a11b-6e7ee877eae1 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:49.484832 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-01711e38-775b-4864-a1f5-60613ced558f tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:49.487848 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-01711e38-775b-4864-a1f5-60613ced558f tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:49.503927 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01711e38-775b-4864-a1f5-60613ced558f tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:49.506575 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01711e38-775b-4864-a1f5-60613ced558f tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:49.507033 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01711e38-775b-4864-a1f5-60613ced558f tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:49.507786 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01711e38-775b-4864-a1f5-60613ced558f tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:49.508245 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01711e38-775b-4864-a1f5-60613ced558f tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:49.510438 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01711e38-775b-4864-a1f5-60613ced558f tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:49.788622 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c4f7cf06-1c55-4cab-a11b-6e7ee877eae1 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:49.797595 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c4f7cf06-1c55-4cab-a11b-6e7ee877eae1 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1671 microversion: 2.1 time: 0.764621 Aug 31 16:04:49.817196 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1516/3128] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:49 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1671 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:49.822930 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2522ed55-33fc-4a2d-b736-c0180f77baa1 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:49.824244 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2522ed55-33fc-4a2d-b736-c0180f77baa1 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:49.832265 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2522ed55-33fc-4a2d-b736-c0180f77baa1 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:49.833078 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2522ed55-33fc-4a2d-b736-c0180f77baa1 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:49.833686 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2522ed55-33fc-4a2d-b736-c0180f77baa1 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:49.834704 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2522ed55-33fc-4a2d-b736-c0180f77baa1 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:49.835352 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2522ed55-33fc-4a2d-b736-c0180f77baa1 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:49.835985 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2522ed55-33fc-4a2d-b736-c0180f77baa1 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:50.131612 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-01711e38-775b-4864-a1f5-60613ced558f tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:50.138235 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:04:50.168482 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-01711e38-775b-4864-a1f5-60613ced558f tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:50.174266 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-01711e38-775b-4864-a1f5-60613ced558f tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:50.175895 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-01711e38-775b-4864-a1f5-60613ced558f tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1878 microversion: 2.32 time: 0.696677 Aug 31 16:04:50.176586 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1613/3129] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:49 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1878 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:50.296082 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2522ed55-33fc-4a2d-b736-c0180f77baa1 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:50.323038 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2522ed55-33fc-4a2d-b736-c0180f77baa1 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1671 microversion: 2.1 time: 0.504556 Aug 31 16:04:50.324340 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1517/3130] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:49 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1671 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:50.351440 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5c5ed922-30c2-4773-8eb7-284a99fa8276 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:50.352396 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5c5ed922-30c2-4773-8eb7-284a99fa8276 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:50.362664 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5c5ed922-30c2-4773-8eb7-284a99fa8276 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:50.364018 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5c5ed922-30c2-4773-8eb7-284a99fa8276 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:50.365674 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5c5ed922-30c2-4773-8eb7-284a99fa8276 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:50.367356 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5c5ed922-30c2-4773-8eb7-284a99fa8276 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:50.368526 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5c5ed922-30c2-4773-8eb7-284a99fa8276 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:50.369565 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5c5ed922-30c2-4773-8eb7-284a99fa8276 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:50.604665 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5c5ed922-30c2-4773-8eb7-284a99fa8276 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:50.631834 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-c8ffea90-f8e3-41b6-a79d-f83c15d9e898 req-5b8788f9-bf3a-4b0b-bb85-26e76b53b8c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9", "name": "network-vif-plugged", "status": "completed", "tag": "cad2dd93-6ee0-4ee0-917c-bbf5d5f4da1d"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:50.647127 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5c5ed922-30c2-4773-8eb7-284a99fa8276 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1671 microversion: 2.1 time: 0.302331 Aug 31 16:04:50.650134 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1614/3131] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:50 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1671 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:50.653258 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c8ffea90-f8e3-41b6-a79d-f83c15d9e898 req-5b8788f9-bf3a-4b0b-bb85-26e76b53b8c1 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:50.653979 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c8ffea90-f8e3-41b6-a79d-f83c15d9e898 req-5b8788f9-bf3a-4b0b-bb85-26e76b53b8c1 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:50.654802 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c8ffea90-f8e3-41b6-a79d-f83c15d9e898 req-5b8788f9-bf3a-4b0b-bb85-26e76b53b8c1 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:50.671170 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-c8ffea90-f8e3-41b6-a79d-f83c15d9e898 req-5b8788f9-bf3a-4b0b-bb85-26e76b53b8c1 service nova] Creating event network-vif-plugged:cad2dd93-6ee0-4ee0-917c-bbf5d5f4da1d for instance a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 on n-h2-833090-16 Aug 31 16:04:50.680037 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-c8ffea90-f8e3-41b6-a79d-f83c15d9e898 req-5b8788f9-bf3a-4b0b-bb85-26e76b53b8c1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065043 Aug 31 16:04:50.681997 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1518/3132] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:04:50.712355 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-95b07da1-35c8-4ae9-a21b-07bf7cc30691 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:50.712997 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-95b07da1-35c8-4ae9-a21b-07bf7cc30691 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:50.733372 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95b07da1-35c8-4ae9-a21b-07bf7cc30691 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:50.734084 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95b07da1-35c8-4ae9-a21b-07bf7cc30691 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:50.736631 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95b07da1-35c8-4ae9-a21b-07bf7cc30691 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:50.738256 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95b07da1-35c8-4ae9-a21b-07bf7cc30691 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:50.738937 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95b07da1-35c8-4ae9-a21b-07bf7cc30691 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:50.739377 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95b07da1-35c8-4ae9-a21b-07bf7cc30691 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:51.100041 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-95b07da1-35c8-4ae9-a21b-07bf7cc30691 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc" status: 200 len: 1860 microversion: 2.1 time: 0.386508 Aug 31 16:04:51.104685 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1615/3133] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:50 2022] GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc => generated 1860 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:51.138940 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1ee732e3-56fb-4185-81ac-4539ff90bc8c tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-833090-16", "block_migration": true, "disk_over_commit": false}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:51.143960 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1ee732e3-56fb-4185-81ac-4539ff90bc8c tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:51.157279 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ee732e3-56fb-4185-81ac-4539ff90bc8c tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:51.157774 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ee732e3-56fb-4185-81ac-4539ff90bc8c tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:51.159363 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ee732e3-56fb-4185-81ac-4539ff90bc8c tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:51.160199 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ee732e3-56fb-4185-81ac-4539ff90bc8c tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:51.161880 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ee732e3-56fb-4185-81ac-4539ff90bc8c tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:51.162582 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ee732e3-56fb-4185-81ac-4539ff90bc8c tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:51.200301 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-646ed88f-d6e5-4fd2-a84a-17fceac12347 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:51.201143 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-646ed88f-d6e5-4fd2-a84a-17fceac12347 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:51.211902 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-646ed88f-d6e5-4fd2-a84a-17fceac12347 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:51.212395 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-646ed88f-d6e5-4fd2-a84a-17fceac12347 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:51.213034 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-646ed88f-d6e5-4fd2-a84a-17fceac12347 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:51.214044 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-646ed88f-d6e5-4fd2-a84a-17fceac12347 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:51.217748 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-646ed88f-d6e5-4fd2-a84a-17fceac12347 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:51.219643 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-646ed88f-d6e5-4fd2-a84a-17fceac12347 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:51.234875 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-1ee732e3-56fb-4185-81ac-4539ff90bc8c tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lazy-loading 'flavor' on Instance uuid 027ef860-8ede-472c-9099-befdc2cde7bc {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:04:51.265770 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1ee732e3-56fb-4185-81ac-4539ff90bc8c tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Going to try to live migrate instance to n-h2-833090-16 {{(pid=128863) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 31 16:04:51.860681 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-646ed88f-d6e5-4fd2-a84a-17fceac12347 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:51.889435 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-646ed88f-d6e5-4fd2-a84a-17fceac12347 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:51.895994 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-646ed88f-d6e5-4fd2-a84a-17fceac12347 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:51.898384 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-646ed88f-d6e5-4fd2-a84a-17fceac12347 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1878 microversion: 2.32 time: 0.701843 Aug 31 16:04:51.914194 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1616/3134] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:51 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1878 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:04:52.709589 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-30aacb52-ef9f-4850-8be1-26ab20812f5e req-d9e310b4-1543-4857-9484-ff1370f999b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9", "name": "network-vif-plugged", "status": "completed", "tag": "18f5d3ba-5072-4e6c-8f7b-bfb9589950de"}, {"server_uuid": "a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9", "name": "network-vif-plugged", "status": "completed", "tag": "ddeb3d0d-f40d-487e-8c19-0d1274291781"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:04:52.720486 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-30aacb52-ef9f-4850-8be1-26ab20812f5e req-d9e310b4-1543-4857-9484-ff1370f999b4 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:52.720970 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-30aacb52-ef9f-4850-8be1-26ab20812f5e req-d9e310b4-1543-4857-9484-ff1370f999b4 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:52.721384 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-30aacb52-ef9f-4850-8be1-26ab20812f5e req-d9e310b4-1543-4857-9484-ff1370f999b4 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:52.735105 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-30aacb52-ef9f-4850-8be1-26ab20812f5e req-d9e310b4-1543-4857-9484-ff1370f999b4 service nova] Creating event network-vif-plugged:18f5d3ba-5072-4e6c-8f7b-bfb9589950de for instance a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 on n-h2-833090-16 Aug 31 16:04:52.735904 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-30aacb52-ef9f-4850-8be1-26ab20812f5e req-d9e310b4-1543-4857-9484-ff1370f999b4 service nova] Creating event network-vif-plugged:ddeb3d0d-f40d-487e-8c19-0d1274291781 for instance a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 on n-h2-833090-16 Aug 31 16:04:52.742881 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-30aacb52-ef9f-4850-8be1-26ab20812f5e req-d9e310b4-1543-4857-9484-ff1370f999b4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036820 Aug 31 16:04:52.750156 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1617/3135] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:04:52.891102 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1ee732e3-56fb-4185-81ac-4539ff90bc8c tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc/action" status: 202 len: 0 microversion: 2.1 time: 1.757688 Aug 31 16:04:52.892359 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1519/3136] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:04:51 2022] POST /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc/action => generated 0 bytes in 1760 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:04:52.901450 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-990c2f30-7f48-4642-b663-e0dad227dd59 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:52.903169 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-990c2f30-7f48-4642-b663-e0dad227dd59 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:52.911850 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-990c2f30-7f48-4642-b663-e0dad227dd59 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:52.924414 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-990c2f30-7f48-4642-b663-e0dad227dd59 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:52.924989 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-990c2f30-7f48-4642-b663-e0dad227dd59 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:52.926006 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-990c2f30-7f48-4642-b663-e0dad227dd59 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:52.929457 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-990c2f30-7f48-4642-b663-e0dad227dd59 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:52.930157 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-990c2f30-7f48-4642-b663-e0dad227dd59 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:52.938743 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a6e29a0e-d432-4e8f-ab80-e4511c902b7e tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:52.939476 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a6e29a0e-d432-4e8f-ab80-e4511c902b7e tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:52.963466 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a6e29a0e-d432-4e8f-ab80-e4511c902b7e tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:52.964355 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a6e29a0e-d432-4e8f-ab80-e4511c902b7e tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:52.965031 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a6e29a0e-d432-4e8f-ab80-e4511c902b7e tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:52.965958 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a6e29a0e-d432-4e8f-ab80-e4511c902b7e tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:52.967255 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a6e29a0e-d432-4e8f-ab80-e4511c902b7e tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:52.967855 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a6e29a0e-d432-4e8f-ab80-e4511c902b7e tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:53.275064 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-990c2f30-7f48-4642-b663-e0dad227dd59 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:53.291665 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-990c2f30-7f48-4642-b663-e0dad227dd59 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc" status: 200 len: 1717 microversion: 2.1 time: 0.394380 Aug 31 16:04:53.292294 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1618/3137] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:52 2022] GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc => generated 1717 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:53.322802 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a6e29a0e-d432-4e8f-ab80-e4511c902b7e tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:53.340270 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a6e29a0e-d432-4e8f-ab80-e4511c902b7e tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:53.344705 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a6e29a0e-d432-4e8f-ab80-e4511c902b7e tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:53.349721 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a6e29a0e-d432-4e8f-ab80-e4511c902b7e tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1878 microversion: 2.32 time: 0.424602 Aug 31 16:04:53.351081 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1520/3138] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:52 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1878 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:54.318538 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1d9a066f-37c5-490e-b3f8-ba7d339e3890 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:54.319373 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1d9a066f-37c5-490e-b3f8-ba7d339e3890 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:54.327689 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1d9a066f-37c5-490e-b3f8-ba7d339e3890 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:54.328598 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1d9a066f-37c5-490e-b3f8-ba7d339e3890 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:54.329303 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1d9a066f-37c5-490e-b3f8-ba7d339e3890 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:54.330184 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1d9a066f-37c5-490e-b3f8-ba7d339e3890 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:54.330897 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1d9a066f-37c5-490e-b3f8-ba7d339e3890 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:54.333395 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1d9a066f-37c5-490e-b3f8-ba7d339e3890 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:54.381343 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e08d7811-f45c-478d-a4d9-cc3c632f7bec tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:54.382715 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e08d7811-f45c-478d-a4d9-cc3c632f7bec tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:54.403741 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e08d7811-f45c-478d-a4d9-cc3c632f7bec tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:54.404523 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e08d7811-f45c-478d-a4d9-cc3c632f7bec tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:54.405133 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e08d7811-f45c-478d-a4d9-cc3c632f7bec tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:54.406290 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e08d7811-f45c-478d-a4d9-cc3c632f7bec tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:54.407067 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e08d7811-f45c-478d-a4d9-cc3c632f7bec tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:54.407955 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e08d7811-f45c-478d-a4d9-cc3c632f7bec tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:54.643774 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1d9a066f-37c5-490e-b3f8-ba7d339e3890 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:54.654483 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1d9a066f-37c5-490e-b3f8-ba7d339e3890 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc" status: 200 len: 1717 microversion: 2.1 time: 0.340683 Aug 31 16:04:54.658848 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1619/3139] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:54 2022] GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc => generated 1717 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:54.701530 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e08d7811-f45c-478d-a4d9-cc3c632f7bec tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:54.717692 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e08d7811-f45c-478d-a4d9-cc3c632f7bec tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:54.726063 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e08d7811-f45c-478d-a4d9-cc3c632f7bec tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:54.727993 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e08d7811-f45c-478d-a4d9-cc3c632f7bec tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1878 microversion: 2.32 time: 0.351646 Aug 31 16:04:54.728583 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1521/3140] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:54 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1878 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:04:55.681002 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-64442448-7cbe-4981-ae90-fa82dfae6924 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:55.682992 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-64442448-7cbe-4981-ae90-fa82dfae6924 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:55.691458 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-64442448-7cbe-4981-ae90-fa82dfae6924 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:55.692442 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-64442448-7cbe-4981-ae90-fa82dfae6924 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:55.693096 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-64442448-7cbe-4981-ae90-fa82dfae6924 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:55.693997 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-64442448-7cbe-4981-ae90-fa82dfae6924 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:55.694644 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-64442448-7cbe-4981-ae90-fa82dfae6924 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:55.695232 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-64442448-7cbe-4981-ae90-fa82dfae6924 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:55.765432 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e6d1d005-c409-4723-9e36-4d7bee3dddcb tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:55.766691 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e6d1d005-c409-4723-9e36-4d7bee3dddcb tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:55.778506 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6d1d005-c409-4723-9e36-4d7bee3dddcb tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:55.782771 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6d1d005-c409-4723-9e36-4d7bee3dddcb tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:55.785898 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6d1d005-c409-4723-9e36-4d7bee3dddcb tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:55.790930 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6d1d005-c409-4723-9e36-4d7bee3dddcb tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:55.794970 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6d1d005-c409-4723-9e36-4d7bee3dddcb tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:55.795439 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6d1d005-c409-4723-9e36-4d7bee3dddcb tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:56.252227 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-64442448-7cbe-4981-ae90-fa82dfae6924 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:56.288046 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-64442448-7cbe-4981-ae90-fa82dfae6924 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc" status: 200 len: 1717 microversion: 2.1 time: 0.613290 Aug 31 16:04:56.290748 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1620/3141] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:55 2022] GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc => generated 1717 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:56.359771 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e6d1d005-c409-4723-9e36-4d7bee3dddcb tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:56.390551 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e6d1d005-c409-4723-9e36-4d7bee3dddcb tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:56.392405 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e6d1d005-c409-4723-9e36-4d7bee3dddcb tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:56.403782 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e6d1d005-c409-4723-9e36-4d7bee3dddcb tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1878 microversion: 2.32 time: 0.642619 Aug 31 16:04:56.405130 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1522/3142] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:55 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1878 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:04:57.317651 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2e89b00d-9781-47e7-b6b0-70088b486368 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:57.318240 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2e89b00d-9781-47e7-b6b0-70088b486368 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:57.333240 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2e89b00d-9781-47e7-b6b0-70088b486368 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:57.334041 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2e89b00d-9781-47e7-b6b0-70088b486368 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:57.334523 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2e89b00d-9781-47e7-b6b0-70088b486368 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:57.339598 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2e89b00d-9781-47e7-b6b0-70088b486368 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:57.340410 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2e89b00d-9781-47e7-b6b0-70088b486368 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:57.345130 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2e89b00d-9781-47e7-b6b0-70088b486368 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:57.445275 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5e1f707a-2068-461b-aba2-fca5ea3c105a tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:57.448449 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5e1f707a-2068-461b-aba2-fca5ea3c105a tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:57.456737 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5e1f707a-2068-461b-aba2-fca5ea3c105a tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:57.457539 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5e1f707a-2068-461b-aba2-fca5ea3c105a tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:57.458509 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5e1f707a-2068-461b-aba2-fca5ea3c105a tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:57.464131 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5e1f707a-2068-461b-aba2-fca5ea3c105a tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:57.464866 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5e1f707a-2068-461b-aba2-fca5ea3c105a tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:57.470069 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5e1f707a-2068-461b-aba2-fca5ea3c105a tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:58.154598 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2e89b00d-9781-47e7-b6b0-70088b486368 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:58.192111 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2e89b00d-9781-47e7-b6b0-70088b486368 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc" status: 200 len: 1717 microversion: 2.1 time: 0.878656 Aug 31 16:04:58.208738 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1621/3143] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:57 2022] GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc => generated 1717 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:04:58.226534 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5e1f707a-2068-461b-aba2-fca5ea3c105a tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:58.252686 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5e1f707a-2068-461b-aba2-fca5ea3c105a tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:58.254382 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5e1f707a-2068-461b-aba2-fca5ea3c105a tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:04:58.266605 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5e1f707a-2068-461b-aba2-fca5ea3c105a tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 2832 microversion: 2.32 time: 0.837204 Aug 31 16:04:58.268420 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1523/3144] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:04:57 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 2832 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:04:58.295270 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c8b684cc-248d-438c-9676-1c947591af3b tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:58.296062 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c8b684cc-248d-438c-9676-1c947591af3b tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:58.309267 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8b684cc-248d-438c-9676-1c947591af3b tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:58.315510 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8b684cc-248d-438c-9676-1c947591af3b tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:58.318514 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8b684cc-248d-438c-9676-1c947591af3b tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:58.324233 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8b684cc-248d-438c-9676-1c947591af3b tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:58.326355 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8b684cc-248d-438c-9676-1c947591af3b tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:58.327131 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8b684cc-248d-438c-9676-1c947591af3b tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:58.543964 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c8b684cc-248d-438c-9676-1c947591af3b tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.253319 Aug 31 16:04:58.554896 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1622/3145] 10.222.0.50 () {60 vars in 1316 bytes} [Wed Aug 31 16:04:58 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9/os-interface => generated 1832 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:04:59.227472 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0c555eb7-6014-409f-8ffc-5a4e047219f0 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:04:59.228108 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0c555eb7-6014-409f-8ffc-5a4e047219f0 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:04:59.248159 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c555eb7-6014-409f-8ffc-5a4e047219f0 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:59.251479 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c555eb7-6014-409f-8ffc-5a4e047219f0 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:59.253536 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c555eb7-6014-409f-8ffc-5a4e047219f0 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:04:59.254980 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c555eb7-6014-409f-8ffc-5a4e047219f0 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:04:59.258706 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c555eb7-6014-409f-8ffc-5a4e047219f0 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:04:59.260067 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c555eb7-6014-409f-8ffc-5a4e047219f0 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:00.040047 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0c555eb7-6014-409f-8ffc-5a4e047219f0 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:00.056275 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0c555eb7-6014-409f-8ffc-5a4e047219f0 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc" status: 200 len: 1717 microversion: 2.1 time: 0.838763 Aug 31 16:05:00.057205 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1524/3146] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:04:59 2022] GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc => generated 1717 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:01.085464 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-17cf73fe-4458-4f52-aaa2-7bdf00adaf77 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:01.086914 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-17cf73fe-4458-4f52-aaa2-7bdf00adaf77 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:01.116224 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-17cf73fe-4458-4f52-aaa2-7bdf00adaf77 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:01.116744 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-17cf73fe-4458-4f52-aaa2-7bdf00adaf77 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:01.117217 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-17cf73fe-4458-4f52-aaa2-7bdf00adaf77 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:01.117990 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-17cf73fe-4458-4f52-aaa2-7bdf00adaf77 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:01.118515 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-17cf73fe-4458-4f52-aaa2-7bdf00adaf77 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:01.133445 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-17cf73fe-4458-4f52-aaa2-7bdf00adaf77 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:01.405611 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-da79260b-a162-4873-9672-48709b1719cc tempest-FloatingIPDetailsNegativeTestJSON-1011207481 tempest-FloatingIPDetailsNegativeTestJSON-1011207481-project] Calling method '.version_select at 0x7fbb45d38e50>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:01.496148 n-d-833090-16 devstack@n-api.service[128863]: DEBUG neutronclient.v2_0.client [None req-da79260b-a162-4873-9672-48709b1719cc tempest-FloatingIPDetailsNegativeTestJSON-1011207481 tempest-FloatingIPDetailsNegativeTestJSON-1011207481-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP d80000dd-b3a3-4b60-8cde-f6aa8d4f4cc1 could not be found", "detail": ""}} {{(pid=128863) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 31 16:05:01.497152 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-da79260b-a162-4873-9672-48709b1719cc tempest-FloatingIPDetailsNegativeTestJSON-1011207481 tempest-FloatingIPDetailsNegativeTestJSON-1011207481-project] HTTP exception thrown: Floating IP not found for ID d80000dd-b3a3-4b60-8cde-f6aa8d4f4cc1 Aug 31 16:05:01.499499 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-da79260b-a162-4873-9672-48709b1719cc tempest-FloatingIPDetailsNegativeTestJSON-1011207481 tempest-FloatingIPDetailsNegativeTestJSON-1011207481-project] Request method failure captured: Aug 31 16:05:01.499499 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/os-floating-ips/d80000dd-b3a3-4b60-8cde-f6aa8d4f4cc1 HTTP/1.1 Aug 31 16:05:01.499499 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:05:01.499499 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:05:01.499499 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:05:01.499499 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:05:01.499499 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:05:01.499499 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:05:01.499499 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:05:01.499499 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:05:01.499499 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4asVFP0twgZP2bvIScv0NXpHVXRWiNCbCyc_YrSDEseDVrCjemjwxfHV6tn1JyRiTuN6zj5fW0n3AoYP5fqb2Kz3QikaJuA4NRVOedjKie7L-YkG9XEyyQVy2doSGt37hxQzhLzwRt5yJMtOROVx0X93T2tdxr2HMXwdaGFt5HSS3w Aug 31 16:05:01.499499 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:05:01.499499 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:05:01.499499 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:05:01.499499 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:05:01.499499 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:05:01.499499 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:05:01.499499 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 5552da55d0cc4276a35839cedfc9adb9 Aug 31 16:05:01.499499 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1011207481 Aug 31 16:05:01.499499 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:05:01.499499 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:05:01.499499 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5552da55d0cc4276a35839cedfc9adb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5552da55d0cc4276a35839cedfc9adb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5552da55d0cc4276a35839cedfc9adb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5552da55d0cc4276a35839cedfc9adb9", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:05:01.499499 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1011207481 Aug 31 16:05:01.499499 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 5552da55d0cc4276a35839cedfc9adb9 Aug 31 16:05:01.499499 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1011207481 Aug 31 16:05:01.499499 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1011207481-project Aug 31 16:05:01.499499 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:05:01.499499 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:05:01.499499 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 8d9d20441be945d981983a1e96596138 Aug 31 16:05:01.499499 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1011207481-project Aug 31 16:05:01.499499 n-d-833090-16 devstack@n-api.service[128863]: method: Aug 31 16:05:01.499499 n-d-833090-16 devstack@n-api.service[128863]: exception: Floating IP not found for ID d80000dd-b3a3-4b60-8cde-f6aa8d4f4cc1 Aug 31 16:05:01.499499 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'd80000dd-b3a3-4b60-8cde-f6aa8d4f4cc1'} Aug 31 16:05:01.499499 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:05:01.499499 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:05:01.499499 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 31 16:05:01.499499 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 31 16:05:01.499499 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:05:01.499499 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:05:01.499499 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 31 16:05:01.499499 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 31 16:05:01.499499 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:05:01.499499 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:05:01.499499 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 31 16:05:01.499499 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 31 16:05:01.499499 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:05:01.499499 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:05:01.499499 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 31 16:05:01.499499 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 31 16:05:01.499499 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:05:01.499499 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:05:01.499499 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 31 16:05:01.499499 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 31 16:05:01.499499 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:05:01.499499 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:05:01.499499 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 31 16:05:01.499499 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 31 16:05:01.499499 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 31 16:05:01.499499 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 31 16:05:01.499499 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP d80000dd-b3a3-4b60-8cde-f6aa8d4f4cc1 could not be found Aug 31 16:05:01.505505 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-67a3cf1f-ea50-4bb0-87f0-fddb24083bc7'] Aug 31 16:05:01.505505 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:05:01.505505 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:05:01.505505 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:05:01.505505 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:05:01.505505 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 31 16:05:01.505505 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 31 16:05:01.505505 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 31 16:05:01.505505 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 31 16:05:01.505505 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID d80000dd-b3a3-4b60-8cde-f6aa8d4f4cc1. Aug 31 16:05:01.505505 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:05:01.505505 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:05:01.505505 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:05:01.505505 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:05:01.505505 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:05:01.505505 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:05:01.505505 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:05:01.505505 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:05:01.505505 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:05:01.505505 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:05:01.505505 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:05:01.505505 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:05:01.505505 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 31 16:05:01.505505 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 31 16:05:01.505505 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID d80000dd-b3a3-4b60-8cde-f6aa8d4f4cc1 Aug 31 16:05:01.505505 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:05:01.505505 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:05:01.505505 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:05:01.505505 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:05:01.505505 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:05:01.505505 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:05:01.505505 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:05:01.505505 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:05:01.505505 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID d80000dd-b3a3-4b60-8cde-f6aa8d4f4cc1 Aug 31 16:05:01.505505 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:05:01.509585 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-da79260b-a162-4873-9672-48709b1719cc tempest-FloatingIPDetailsNegativeTestJSON-1011207481 tempest-FloatingIPDetailsNegativeTestJSON-1011207481-project] Returning 404 to user: Floating IP not found for ID d80000dd-b3a3-4b60-8cde-f6aa8d4f4cc1 {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:05:01.510519 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-da79260b-a162-4873-9672-48709b1719cc tempest-FloatingIPDetailsNegativeTestJSON-1011207481 tempest-FloatingIPDetailsNegativeTestJSON-1011207481-project] 10.222.0.50 "GET /compute/v2.1/os-floating-ips/d80000dd-b3a3-4b60-8cde-f6aa8d4f4cc1" status: 404 len: 111 microversion: 2.1 time: 0.396477 Aug 31 16:05:01.511645 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1525/3147] 10.222.0.50 () {58 vars in 1260 bytes} [Wed Aug 31 16:05:01 2022] GET /compute/v2.1/os-floating-ips/d80000dd-b3a3-4b60-8cde-f6aa8d4f4cc1 => generated 111 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:05:01.941950 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-17cf73fe-4458-4f52-aaa2-7bdf00adaf77 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:01.955551 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-17cf73fe-4458-4f52-aaa2-7bdf00adaf77 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc" status: 200 len: 1717 microversion: 2.1 time: 0.875580 Aug 31 16:05:01.959123 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1623/3148] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:01 2022] GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc => generated 1717 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:01.979356 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-6eeef5a8-4ed6-42b6-b172-4d88ff1e5559 req-07bed740-189f-4fc8-81dd-d96b51913d05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9", "tag": "988b704e-8f3a-4c8f-903a-1661f7c99521"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:05:01.994654 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=60 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:05:01.999073 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-6eeef5a8-4ed6-42b6-b172-4d88ff1e5559 req-07bed740-189f-4fc8-81dd-d96b51913d05 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:01.999554 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-6eeef5a8-4ed6-42b6-b172-4d88ff1e5559 req-07bed740-189f-4fc8-81dd-d96b51913d05 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:01.999980 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-6eeef5a8-4ed6-42b6-b172-4d88ff1e5559 req-07bed740-189f-4fc8-81dd-d96b51913d05 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:02.060901 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-6eeef5a8-4ed6-42b6-b172-4d88ff1e5559 req-07bed740-189f-4fc8-81dd-d96b51913d05 service nova] Creating event network-changed:988b704e-8f3a-4c8f-903a-1661f7c99521 for instance a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 on n-h2-833090-16 Aug 31 16:05:02.087420 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-6eeef5a8-4ed6-42b6-b172-4d88ff1e5559 req-07bed740-189f-4fc8-81dd-d96b51913d05 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114084 Aug 31 16:05:02.091492 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1526/3149] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:05:02.983607 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-32f46d26-e528-493d-8374-fc5d9fecd2d7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:02.984242 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-32f46d26-e528-493d-8374-fc5d9fecd2d7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:03.000097 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-32f46d26-e528-493d-8374-fc5d9fecd2d7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:03.000737 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-32f46d26-e528-493d-8374-fc5d9fecd2d7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:03.002648 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-32f46d26-e528-493d-8374-fc5d9fecd2d7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:03.006506 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-32f46d26-e528-493d-8374-fc5d9fecd2d7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:03.007425 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-32f46d26-e528-493d-8374-fc5d9fecd2d7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:03.008420 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-32f46d26-e528-493d-8374-fc5d9fecd2d7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:03.636097 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-32f46d26-e528-493d-8374-fc5d9fecd2d7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:03.648379 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-32f46d26-e528-493d-8374-fc5d9fecd2d7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc" status: 200 len: 1717 microversion: 2.1 time: 0.668641 Aug 31 16:05:03.654454 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1624/3150] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:02 2022] GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc => generated 1717 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:04.688033 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bac09b01-846f-4d4d-bd50-bd123df43b49 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:04.689781 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bac09b01-846f-4d4d-bd50-bd123df43b49 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:04.712588 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bac09b01-846f-4d4d-bd50-bd123df43b49 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:04.718244 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bac09b01-846f-4d4d-bd50-bd123df43b49 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:04.719200 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bac09b01-846f-4d4d-bd50-bd123df43b49 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:04.724752 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bac09b01-846f-4d4d-bd50-bd123df43b49 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:04.727771 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bac09b01-846f-4d4d-bd50-bd123df43b49 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:04.729650 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bac09b01-846f-4d4d-bd50-bd123df43b49 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:05.508112 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bac09b01-846f-4d4d-bd50-bd123df43b49 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:05.535366 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bac09b01-846f-4d4d-bd50-bd123df43b49 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc" status: 200 len: 1717 microversion: 2.1 time: 0.852172 Aug 31 16:05:05.537925 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1527/3151] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:04 2022] GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc => generated 1717 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:06.148797 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-661cd155-40ac-4a91-9734-1e76154874b9 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:06.155958 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-661cd155-40ac-4a91-9734-1e76154874b9 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] [instance: 23c0eef8-3969-41a5-9da9-4bae125f024f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:06.191215 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=54 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:05:06.194872 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-661cd155-40ac-4a91-9734-1e76154874b9 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:06.196262 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-661cd155-40ac-4a91-9734-1e76154874b9 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:06.197375 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-661cd155-40ac-4a91-9734-1e76154874b9 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:06.199053 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-661cd155-40ac-4a91-9734-1e76154874b9 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:06.200434 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-661cd155-40ac-4a91-9734-1e76154874b9 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:06.201656 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-661cd155-40ac-4a91-9734-1e76154874b9 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:06.293776 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-661cd155-40ac-4a91-9734-1e76154874b9 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] [instance: 23c0eef8-3969-41a5-9da9-4bae125f024f] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:05:06.511829 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-661cd155-40ac-4a91-9734-1e76154874b9 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] 10.222.0.50 "DELETE /compute/v2.1/servers/23c0eef8-3969-41a5-9da9-4bae125f024f" status: 204 len: 0 microversion: 2.1 time: 0.369528 Aug 31 16:05:06.513493 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1625/3152] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:05:06 2022] DELETE /compute/v2.1/servers/23c0eef8-3969-41a5-9da9-4bae125f024f => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:05:06.524540 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-87c77115-52c9-48dc-b800-8ae1fa2b904b tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:06.525358 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-87c77115-52c9-48dc-b800-8ae1fa2b904b tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] [instance: 23c0eef8-3969-41a5-9da9-4bae125f024f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:06.544821 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-87c77115-52c9-48dc-b800-8ae1fa2b904b tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:06.545308 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-87c77115-52c9-48dc-b800-8ae1fa2b904b tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:06.545752 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-87c77115-52c9-48dc-b800-8ae1fa2b904b tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:06.546960 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-87c77115-52c9-48dc-b800-8ae1fa2b904b tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:06.547827 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-87c77115-52c9-48dc-b800-8ae1fa2b904b tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:06.549508 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-87c77115-52c9-48dc-b800-8ae1fa2b904b tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:06.570128 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c8cc9d2c-9f86-4585-a391-4b1c3455dd30 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:06.571074 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c8cc9d2c-9f86-4585-a391-4b1c3455dd30 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:06.592253 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8cc9d2c-9f86-4585-a391-4b1c3455dd30 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:06.595962 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8cc9d2c-9f86-4585-a391-4b1c3455dd30 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:06.596669 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8cc9d2c-9f86-4585-a391-4b1c3455dd30 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:06.600805 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8cc9d2c-9f86-4585-a391-4b1c3455dd30 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:06.604792 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8cc9d2c-9f86-4585-a391-4b1c3455dd30 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:06.605251 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8cc9d2c-9f86-4585-a391-4b1c3455dd30 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:06.920512 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-87c77115-52c9-48dc-b800-8ae1fa2b904b tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250769b38a2d48db928fdc20a8c64d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfbd02718e4848ab9e6ff73dbbb469d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:06.936735 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-87c77115-52c9-48dc-b800-8ae1fa2b904b tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] 10.222.0.50 "GET /compute/v2.1/servers/23c0eef8-3969-41a5-9da9-4bae125f024f" status: 200 len: 1665 microversion: 2.1 time: 0.418465 Aug 31 16:05:06.941458 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1528/3153] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:06 2022] GET /compute/v2.1/servers/23c0eef8-3969-41a5-9da9-4bae125f024f => generated 1665 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:07.044545 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c8cc9d2c-9f86-4585-a391-4b1c3455dd30 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:07.060073 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c8cc9d2c-9f86-4585-a391-4b1c3455dd30 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc" status: 200 len: 1717 microversion: 2.1 time: 0.495127 Aug 31 16:05:07.081280 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1626/3154] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:06 2022] GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc => generated 1717 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:07.967414 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a4fc7137-5e83-4812-aa24-555810215cce tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:07.970923 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a4fc7137-5e83-4812-aa24-555810215cce tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] [instance: 23c0eef8-3969-41a5-9da9-4bae125f024f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:07.981584 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4fc7137-5e83-4812-aa24-555810215cce tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:07.983398 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4fc7137-5e83-4812-aa24-555810215cce tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:07.984586 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4fc7137-5e83-4812-aa24-555810215cce tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:07.986474 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4fc7137-5e83-4812-aa24-555810215cce tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:07.989008 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4fc7137-5e83-4812-aa24-555810215cce tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:07.990167 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4fc7137-5e83-4812-aa24-555810215cce tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:08.100035 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9aa6d4d4-0a98-492f-a4a2-7d473c97216e tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:08.103686 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9aa6d4d4-0a98-492f-a4a2-7d473c97216e tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:08.123283 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9aa6d4d4-0a98-492f-a4a2-7d473c97216e tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:08.124529 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9aa6d4d4-0a98-492f-a4a2-7d473c97216e tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:08.125419 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9aa6d4d4-0a98-492f-a4a2-7d473c97216e tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:08.128717 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9aa6d4d4-0a98-492f-a4a2-7d473c97216e tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:08.129883 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9aa6d4d4-0a98-492f-a4a2-7d473c97216e tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:08.131207 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9aa6d4d4-0a98-492f-a4a2-7d473c97216e tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:08.397416 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a4fc7137-5e83-4812-aa24-555810215cce tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250769b38a2d48db928fdc20a8c64d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfbd02718e4848ab9e6ff73dbbb469d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:08.418184 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a4fc7137-5e83-4812-aa24-555810215cce tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] 10.222.0.50 "GET /compute/v2.1/servers/23c0eef8-3969-41a5-9da9-4bae125f024f" status: 200 len: 1665 microversion: 2.1 time: 0.453589 Aug 31 16:05:08.418184 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1529/3155] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:07 2022] GET /compute/v2.1/servers/23c0eef8-3969-41a5-9da9-4bae125f024f => generated 1665 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:05:08.443302 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9aa6d4d4-0a98-492f-a4a2-7d473c97216e tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:08.457346 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9aa6d4d4-0a98-492f-a4a2-7d473c97216e tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc" status: 200 len: 1717 microversion: 2.1 time: 0.370092 Aug 31 16:05:08.458048 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1627/3156] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:08 2022] GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc => generated 1717 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:09.444568 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2dc90048-5175-4791-99fd-7a47583c831b tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:09.445613 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2dc90048-5175-4791-99fd-7a47583c831b tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] [instance: 23c0eef8-3969-41a5-9da9-4bae125f024f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:09.480937 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-af7061b6-aec3-43c4-a754-1461c66ac2a5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:09.482750 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-af7061b6-aec3-43c4-a754-1461c66ac2a5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:09.507991 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-af7061b6-aec3-43c4-a754-1461c66ac2a5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:09.518513 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-af7061b6-aec3-43c4-a754-1461c66ac2a5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:09.519186 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2dc90048-5175-4791-99fd-7a47583c831b tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:09.524801 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-af7061b6-aec3-43c4-a754-1461c66ac2a5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:09.526588 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2dc90048-5175-4791-99fd-7a47583c831b tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:09.527290 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2dc90048-5175-4791-99fd-7a47583c831b tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:09.531636 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2dc90048-5175-4791-99fd-7a47583c831b tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:09.532062 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2dc90048-5175-4791-99fd-7a47583c831b tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:09.532802 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-af7061b6-aec3-43c4-a754-1461c66ac2a5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:09.535331 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-af7061b6-aec3-43c4-a754-1461c66ac2a5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:09.536195 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-af7061b6-aec3-43c4-a754-1461c66ac2a5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:09.540936 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2dc90048-5175-4791-99fd-7a47583c831b tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:09.572607 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:05:10.433969 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2dc90048-5175-4791-99fd-7a47583c831b tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250769b38a2d48db928fdc20a8c64d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfbd02718e4848ab9e6ff73dbbb469d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:10.443771 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2dc90048-5175-4791-99fd-7a47583c831b tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] 10.222.0.50 "GET /compute/v2.1/servers/23c0eef8-3969-41a5-9da9-4bae125f024f" status: 200 len: 1665 microversion: 2.1 time: 1.004185 Aug 31 16:05:10.444619 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1530/3157] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:09 2022] GET /compute/v2.1/servers/23c0eef8-3969-41a5-9da9-4bae125f024f => generated 1665 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:10.449467 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-af7061b6-aec3-43c4-a754-1461c66ac2a5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:10.459146 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-af7061b6-aec3-43c4-a754-1461c66ac2a5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc" status: 200 len: 1717 microversion: 2.1 time: 0.982094 Aug 31 16:05:10.473412 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1628/3158] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:09 2022] GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc => generated 1717 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:11.316450 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-7880c185-3686-47be-b5db-4b1b32b2152a req-82182b79-27c3-43e9-97fd-5153425bf628 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23c0eef8-3969-41a5-9da9-4bae125f024f", "name": "network-vif-deleted", "tag": "e7ccecd2-97d6-4aed-a87b-af665446815e"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:05:11.326840 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7880c185-3686-47be-b5db-4b1b32b2152a req-82182b79-27c3-43e9-97fd-5153425bf628 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:11.327569 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7880c185-3686-47be-b5db-4b1b32b2152a req-82182b79-27c3-43e9-97fd-5153425bf628 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:11.328334 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7880c185-3686-47be-b5db-4b1b32b2152a req-82182b79-27c3-43e9-97fd-5153425bf628 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:11.345814 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-7880c185-3686-47be-b5db-4b1b32b2152a req-82182b79-27c3-43e9-97fd-5153425bf628 service nova] Creating event network-vif-deleted:e7ccecd2-97d6-4aed-a87b-af665446815e for instance 23c0eef8-3969-41a5-9da9-4bae125f024f on n-h2-833090-16 Aug 31 16:05:11.354201 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-7880c185-3686-47be-b5db-4b1b32b2152a req-82182b79-27c3-43e9-97fd-5153425bf628 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.298201 Aug 31 16:05:11.355745 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1531/3159] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:05:11.464662 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-12fa43ed-0644-4b70-9e52-66c07647d8d0 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:11.465420 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-12fa43ed-0644-4b70-9e52-66c07647d8d0 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] [instance: 23c0eef8-3969-41a5-9da9-4bae125f024f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:11.474431 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-12fa43ed-0644-4b70-9e52-66c07647d8d0 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:11.475380 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-12fa43ed-0644-4b70-9e52-66c07647d8d0 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:11.476040 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-12fa43ed-0644-4b70-9e52-66c07647d8d0 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:11.477195 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-12fa43ed-0644-4b70-9e52-66c07647d8d0 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:11.478745 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-12fa43ed-0644-4b70-9e52-66c07647d8d0 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:11.479462 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-12fa43ed-0644-4b70-9e52-66c07647d8d0 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:11.481304 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-939bee77-3c60-4669-87a4-e993d2c09936 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:11.483017 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-939bee77-3c60-4669-87a4-e993d2c09936 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:11.496997 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-939bee77-3c60-4669-87a4-e993d2c09936 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:11.498141 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-939bee77-3c60-4669-87a4-e993d2c09936 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:11.498788 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-939bee77-3c60-4669-87a4-e993d2c09936 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:11.500691 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-939bee77-3c60-4669-87a4-e993d2c09936 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:11.501801 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-939bee77-3c60-4669-87a4-e993d2c09936 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:11.504279 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-939bee77-3c60-4669-87a4-e993d2c09936 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:11.523199 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-12fa43ed-0644-4b70-9e52-66c07647d8d0 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:11.524037 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-12fa43ed-0644-4b70-9e52-66c07647d8d0 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:11.525690 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-12fa43ed-0644-4b70-9e52-66c07647d8d0 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:11.526402 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-12fa43ed-0644-4b70-9e52-66c07647d8d0 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lazy-loading 'fault' on Instance uuid 23c0eef8-3969-41a5-9da9-4bae125f024f {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:05:11.532693 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:05:11.589947 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-12fa43ed-0644-4b70-9e52-66c07647d8d0 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '250769b38a2d48db928fdc20a8c64d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfbd02718e4848ab9e6ff73dbbb469d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:11.601261 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-12fa43ed-0644-4b70-9e52-66c07647d8d0 tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] 10.222.0.50 "GET /compute/v2.1/servers/23c0eef8-3969-41a5-9da9-4bae125f024f" status: 200 len: 1316 microversion: 2.1 time: 0.140261 Aug 31 16:05:11.611605 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1629/3160] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:11 2022] GET /compute/v2.1/servers/23c0eef8-3969-41a5-9da9-4bae125f024f => generated 1316 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:11.856051 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-939bee77-3c60-4669-87a4-e993d2c09936 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:11.869469 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-939bee77-3c60-4669-87a4-e993d2c09936 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc" status: 200 len: 1717 microversion: 2.1 time: 0.392943 Aug 31 16:05:11.888311 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1532/3161] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:11 2022] GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc => generated 1717 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:05:12.640884 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7458db58-0cbf-4fc0-ad7a-3a30db4e92df tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:12.642335 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7458db58-0cbf-4fc0-ad7a-3a30db4e92df tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] [instance: 23c0eef8-3969-41a5-9da9-4bae125f024f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:12.651061 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7458db58-0cbf-4fc0-ad7a-3a30db4e92df tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:12.651924 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7458db58-0cbf-4fc0-ad7a-3a30db4e92df tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:12.652609 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7458db58-0cbf-4fc0-ad7a-3a30db4e92df tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:12.653774 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7458db58-0cbf-4fc0-ad7a-3a30db4e92df tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:12.654579 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7458db58-0cbf-4fc0-ad7a-3a30db4e92df tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:12.655171 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7458db58-0cbf-4fc0-ad7a-3a30db4e92df tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:12.677011 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-7458db58-0cbf-4fc0-ad7a-3a30db4e92df tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] HTTP exception thrown: Instance 23c0eef8-3969-41a5-9da9-4bae125f024f could not be found. Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7458db58-0cbf-4fc0-ad7a-3a30db4e92df tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Request method failure captured: Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/23c0eef8-3969-41a5-9da9-4bae125f024f HTTP/1.1 Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4Yz2lzHsDCziwoocZMd4gMZnBC1prI-OfPl9uPXG3gZSAybv49Nx0A0_l8dwqQSyQwE2x7CtsmuCMHdh3-qspsbl2GnFuDj2xxQImTy4_Aqn-1w9Wt6BMse4tUpzao9EO07jzyIMWM1TUaIFt2gqRq0Kpeb1MOE9MWHBbSwrEloD-Q Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: dfbd02718e4848ab9e6ff73dbbb469d9 Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersTestFqdnHostnames-59279899 Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dfbd02718e4848ab9e6ff73dbbb469d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dfbd02718e4848ab9e6ff73dbbb469d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/dfbd02718e4848ab9e6ff73dbbb469d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_dfbd02718e4848ab9e6ff73dbbb469d9", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServersTestFqdnHostnames-59279899 Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: dfbd02718e4848ab9e6ff73dbbb469d9 Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-59279899 Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServersTestFqdnHostnames-59279899-project Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 250769b38a2d48db928fdc20a8c64d28 Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServersTestFqdnHostnames-59279899-project Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 23c0eef8-3969-41a5-9da9-4bae125f024f could not be found. Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '23c0eef8-3969-41a5-9da9-4bae125f024f'} Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23c0eef8-3969-41a5-9da9-4bae125f024f could not be found. Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23c0eef8-3969-41a5-9da9-4bae125f024f could not be found. Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:05:12.679207 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:05:12.684533 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:05:12.684533 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:05:12.684533 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:05:12.684533 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:05:12.684533 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:05:12.684533 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23c0eef8-3969-41a5-9da9-4bae125f024f could not be found. Aug 31 16:05:12.684533 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:05:12.691681 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7458db58-0cbf-4fc0-ad7a-3a30db4e92df tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Returning 404 to user: Instance 23c0eef8-3969-41a5-9da9-4bae125f024f could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:05:12.696397 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7458db58-0cbf-4fc0-ad7a-3a30db4e92df tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] 10.222.0.50 "GET /compute/v2.1/servers/23c0eef8-3969-41a5-9da9-4bae125f024f" status: 404 len: 111 microversion: 2.1 time: 0.056663 Aug 31 16:05:12.696397 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1533/3162] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:12 2022] GET /compute/v2.1/servers/23c0eef8-3969-41a5-9da9-4bae125f024f => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:05:12.704701 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1db51cbf-7ead-4de1-a19e-26233c332edc tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] Calling method '.version_select at 0x7fbb45d43940>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:12.742318 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1db51cbf-7ead-4de1-a19e-26233c332edc tempest-ServersTestFqdnHostnames-59279899 tempest-ServersTestFqdnHostnames-59279899-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1523192079" status: 202 len: 0 microversion: 2.1 time: 0.042025 Aug 31 16:05:12.745000 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1534/3163] 10.222.0.50 () {58 vars in 1221 bytes} [Wed Aug 31 16:05:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1523192079 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:05:12.862877 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2c7b1d86-9bf8-4d0e-a52f-8a1850175c6e tempest-ImagesMetadataNegativeTestJSON-652619562 tempest-ImagesMetadataNegativeTestJSON-652619562-project] Calling method '.version_select at 0x7fbb467b9280>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:12.896661 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-db6d63f2-fad7-4c80-a10d-022dd4e9b773 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:12.897626 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-2c7b1d86-9bf8-4d0e-a52f-8a1850175c6e tempest-ImagesMetadataNegativeTestJSON-652619562 tempest-ImagesMetadataNegativeTestJSON-652619562-project] HTTP exception thrown: Image not found. Aug 31 16:05:12.897849 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-db6d63f2-fad7-4c80-a10d-022dd4e9b773 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:12.904528 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2c7b1d86-9bf8-4d0e-a52f-8a1850175c6e tempest-ImagesMetadataNegativeTestJSON-652619562 tempest-ImagesMetadataNegativeTestJSON-652619562-project] Request method failure captured: Aug 31 16:05:12.904528 n-d-833090-16 devstack@n-api.service[128864]: request: DELETE /compute/v2.1/images/e5ef9ae3-bcb0-47f2-97c8-61f8b66b6629/metadata/os_distro HTTP/1.1 Aug 31 16:05:12.904528 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:05:12.904528 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:05:12.904528 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:05:12.904528 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:05:12.904528 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:05:12.904528 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:05:12.904528 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:05:12.904528 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:05:12.904528 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4a4sUYHvDgNPUV23iB2ciE3iKedDfrS60WzaD8PNMR1mYVnbnhNIWnsa7hugtSeObZwCfK0eXqVv5WiNAynCqeLFGPaOjgWLvamqcTYL0Yx9uHSfzj24EvPLCILWvKli2hwMrWloVjTxW7rWvTJCjkrFpFprG_dZ8UmtDXVLPmC7iM Aug 31 16:05:12.904528 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:05:12.904528 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:05:12.904528 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:05:12.904528 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:05:12.904528 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:05:12.904528 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:05:12.904528 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: ef72d29bccc64547b03887c7ae4f78b4 Aug 31 16:05:12.904528 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-652619562 Aug 31 16:05:12.904528 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:05:12.904528 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:05:12.904528 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ef72d29bccc64547b03887c7ae4f78b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ef72d29bccc64547b03887c7ae4f78b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ef72d29bccc64547b03887c7ae4f78b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ef72d29bccc64547b03887c7ae4f78b4", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:05:12.904528 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-652619562 Aug 31 16:05:12.904528 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: ef72d29bccc64547b03887c7ae4f78b4 Aug 31 16:05:12.904528 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-652619562 Aug 31 16:05:12.904528 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ImagesMetadataNegativeTestJSON-652619562-project Aug 31 16:05:12.904528 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:05:12.904528 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:05:12.904528 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 8762703f56ce416dad3e90b38d0e2a78 Aug 31 16:05:12.904528 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-652619562-project Aug 31 16:05:12.904528 n-d-833090-16 devstack@n-api.service[128864]: method: Aug 31 16:05:12.904528 n-d-833090-16 devstack@n-api.service[128864]: exception: Image not found. Aug 31 16:05:12.904528 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'image_id': 'e5ef9ae3-bcb0-47f2-97c8-61f8b66b6629', 'id': 'os_distro'} Aug 31 16:05:12.904528 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:05:12.904528 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:05:12.904528 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 31 16:05:12.904528 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 31 16:05:12.904528 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 16:05:12.904528 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 16:05:12.904528 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 31 16:05:12.904528 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 31 16:05:12.904528 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 16:05:12.904528 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 16:05:12.904528 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 31 16:05:12.904528 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 31 16:05:12.904528 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 31 16:05:12.904528 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 31 16:05:12.904528 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 16:05:12.904528 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 16:05:12.904528 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 16:05:12.904528 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 16:05:12.904528 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e5ef9ae3-bcb0-47f2-97c8-61f8b66b6629 Aug 31 16:05:12.904528 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:05:12.904528 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:05:12.904528 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:05:12.904528 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:05:12.904528 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 31 16:05:12.904528 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 31 16:05:12.904528 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 31 16:05:12.904528 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 31 16:05:12.904528 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 31 16:05:12.904528 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 31 16:05:12.910445 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 31 16:05:12.910445 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 31 16:05:12.910445 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 31 16:05:12.910445 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 31 16:05:12.910445 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 16:05:12.910445 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 16:05:12.910445 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 31 16:05:12.910445 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 31 16:05:12.910445 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 16:05:12.910445 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 16:05:12.910445 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 31 16:05:12.910445 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 31 16:05:12.910445 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 31 16:05:12.910445 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 31 16:05:12.910445 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 16:05:12.910445 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 16:05:12.910445 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 16:05:12.910445 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 16:05:12.910445 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e5ef9ae3-bcb0-47f2-97c8-61f8b66b6629 could not be found. Aug 31 16:05:12.910445 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:05:12.910445 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:05:12.910445 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:05:12.910445 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:05:12.910445 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:05:12.910445 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:05:12.910445 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:05:12.910445 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:05:12.910445 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:05:12.910445 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:05:12.910445 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:05:12.910445 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:05:12.910445 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Aug 31 16:05:12.910445 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 31 16:05:12.910445 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 31 16:05:12.910445 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 31 16:05:12.910445 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 31 16:05:12.910445 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:05:12.910445 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:05:12.910445 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:05:12.910445 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:05:12.910445 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:05:12.910445 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:05:12.910445 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:05:12.910445 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:05:12.910445 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 31 16:05:12.910445 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:05:12.917313 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db6d63f2-fad7-4c80-a10d-022dd4e9b773 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:12.917313 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db6d63f2-fad7-4c80-a10d-022dd4e9b773 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:12.917313 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db6d63f2-fad7-4c80-a10d-022dd4e9b773 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:12.917313 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db6d63f2-fad7-4c80-a10d-022dd4e9b773 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:12.917313 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db6d63f2-fad7-4c80-a10d-022dd4e9b773 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:12.920034 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2c7b1d86-9bf8-4d0e-a52f-8a1850175c6e tempest-ImagesMetadataNegativeTestJSON-652619562 tempest-ImagesMetadataNegativeTestJSON-652619562-project] Returning 404 to user: Image not found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:05:12.920917 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2c7b1d86-9bf8-4d0e-a52f-8a1850175c6e tempest-ImagesMetadataNegativeTestJSON-652619562 tempest-ImagesMetadataNegativeTestJSON-652619562-project] 10.222.0.50 "DELETE /compute/v2.1/images/e5ef9ae3-bcb0-47f2-97c8-61f8b66b6629/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.320066 Aug 31 16:05:12.921516 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1630/3164] 10.222.0.50 () {58 vars in 1293 bytes} [Wed Aug 31 16:05:12 2022] DELETE /compute/v2.1/images/e5ef9ae3-bcb0-47f2-97c8-61f8b66b6629/metadata/os_distro => generated 62 bytes in 321 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 16:05:12.926588 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db6d63f2-fad7-4c80-a10d-022dd4e9b773 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:12.944549 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8c02cfd0-efab-4b0e-b18b-3c9aefee8ec5 tempest-ImagesMetadataNegativeTestJSON-652619562 tempest-ImagesMetadataNegativeTestJSON-652619562-project] Calling method '.version_select at 0x7fbb467b9670>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:12.987906 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-8c02cfd0-efab-4b0e-b18b-3c9aefee8ec5 tempest-ImagesMetadataNegativeTestJSON-652619562 tempest-ImagesMetadataNegativeTestJSON-652619562-project] HTTP exception thrown: Image not found. Aug 31 16:05:12.990584 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8c02cfd0-efab-4b0e-b18b-3c9aefee8ec5 tempest-ImagesMetadataNegativeTestJSON-652619562 tempest-ImagesMetadataNegativeTestJSON-652619562-project] Request method failure captured: Aug 31 16:05:12.990584 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/images/431b43a7-420c-496c-8653-fb0671147dba/metadata/os_version HTTP/1.1 Aug 31 16:05:12.990584 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:05:12.990584 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:05:12.990584 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:05:12.990584 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:05:12.990584 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:05:12.990584 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:05:12.990584 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:05:12.990584 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:05:12.990584 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4a4sUYHvDgNPUV23iB2ciE3iKedDfrS60WzaD8PNMR1mYVnbnhNIWnsa7hugtSeObZwCfK0eXqVv5WiNAynCqeLFGPaOjgWLvamqcTYL0Yx9uHSfzj24EvPLCILWvKli2hwMrWloVjTxW7rWvTJCjkrFpFprG_dZ8UmtDXVLPmC7iM Aug 31 16:05:12.990584 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:05:12.990584 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:05:12.990584 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:05:12.990584 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:05:12.990584 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:05:12.990584 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:05:12.990584 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: ef72d29bccc64547b03887c7ae4f78b4 Aug 31 16:05:12.990584 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-652619562 Aug 31 16:05:12.990584 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:05:12.990584 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:05:12.990584 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ef72d29bccc64547b03887c7ae4f78b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ef72d29bccc64547b03887c7ae4f78b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ef72d29bccc64547b03887c7ae4f78b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ef72d29bccc64547b03887c7ae4f78b4", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:05:12.990584 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-652619562 Aug 31 16:05:12.990584 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: ef72d29bccc64547b03887c7ae4f78b4 Aug 31 16:05:12.990584 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-652619562 Aug 31 16:05:12.990584 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ImagesMetadataNegativeTestJSON-652619562-project Aug 31 16:05:12.990584 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:05:12.990584 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:05:12.990584 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 8762703f56ce416dad3e90b38d0e2a78 Aug 31 16:05:12.990584 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-652619562-project Aug 31 16:05:12.990584 n-d-833090-16 devstack@n-api.service[128864]: method: Aug 31 16:05:12.990584 n-d-833090-16 devstack@n-api.service[128864]: exception: Image not found. Aug 31 16:05:12.990584 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'image_id': '431b43a7-420c-496c-8653-fb0671147dba', 'id': 'os_version'} Aug 31 16:05:12.990584 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:05:12.990584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:05:12.990584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 31 16:05:12.990584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 31 16:05:12.990584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 16:05:12.990584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 16:05:12.990584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 31 16:05:12.990584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 31 16:05:12.990584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 16:05:12.990584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 16:05:12.990584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 31 16:05:12.990584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 31 16:05:12.990584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 31 16:05:12.990584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 31 16:05:12.990584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 16:05:12.990584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 16:05:12.990584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 16:05:12.990584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 16:05:12.990584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 431b43a7-420c-496c-8653-fb0671147dba Aug 31 16:05:12.990584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:05:12.990584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:05:12.990584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:05:12.990584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:05:12.990584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 31 16:05:12.990584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 31 16:05:12.990584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 31 16:05:12.990584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 31 16:05:12.990584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 31 16:05:12.990584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 31 16:05:13.007771 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 31 16:05:13.007771 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 31 16:05:13.007771 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 31 16:05:13.007771 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 31 16:05:13.007771 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 16:05:13.007771 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 16:05:13.007771 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 31 16:05:13.007771 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 31 16:05:13.007771 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 16:05:13.007771 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 16:05:13.007771 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 31 16:05:13.007771 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 31 16:05:13.007771 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 31 16:05:13.007771 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 31 16:05:13.007771 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 16:05:13.007771 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 16:05:13.007771 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 16:05:13.007771 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 16:05:13.007771 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 431b43a7-420c-496c-8653-fb0671147dba could not be found. Aug 31 16:05:13.007771 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:05:13.007771 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:05:13.007771 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:05:13.007771 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:05:13.007771 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:05:13.007771 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:05:13.007771 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:05:13.007771 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:05:13.007771 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:05:13.007771 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:05:13.007771 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:05:13.007771 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:05:13.007771 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Aug 31 16:05:13.007771 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 31 16:05:13.007771 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 31 16:05:13.007771 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 31 16:05:13.007771 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 31 16:05:13.007771 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:05:13.007771 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:05:13.007771 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:05:13.007771 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:05:13.007771 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:05:13.007771 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:05:13.007771 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:05:13.007771 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:05:13.007771 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 31 16:05:13.007771 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:05:13.007771 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8c02cfd0-efab-4b0e-b18b-3c9aefee8ec5 tempest-ImagesMetadataNegativeTestJSON-652619562 tempest-ImagesMetadataNegativeTestJSON-652619562-project] Returning 404 to user: Image not found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:05:13.007771 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8c02cfd0-efab-4b0e-b18b-3c9aefee8ec5 tempest-ImagesMetadataNegativeTestJSON-652619562 tempest-ImagesMetadataNegativeTestJSON-652619562-project] 10.222.0.50 "GET /compute/v2.1/images/431b43a7-420c-496c-8653-fb0671147dba/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.063466 Aug 31 16:05:13.007771 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1631/3165] 10.222.0.50 () {58 vars in 1293 bytes} [Wed Aug 31 16:05:12 2022] GET /compute/v2.1/images/431b43a7-420c-496c-8653-fb0671147dba/metadata/os_version => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 16:05:13.015496 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4d72755f-51af-4d86-a8a9-844c55764913 tempest-ImagesMetadataNegativeTestJSON-652619562 tempest-ImagesMetadataNegativeTestJSON-652619562-project] Calling method '.version_select at 0x7fbb47066e50>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:13.069767 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-4d72755f-51af-4d86-a8a9-844c55764913 tempest-ImagesMetadataNegativeTestJSON-652619562 tempest-ImagesMetadataNegativeTestJSON-652619562-project] HTTP exception thrown: Image not found. Aug 31 16:05:13.069767 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4d72755f-51af-4d86-a8a9-844c55764913 tempest-ImagesMetadataNegativeTestJSON-652619562 tempest-ImagesMetadataNegativeTestJSON-652619562-project] Request method failure captured: Aug 31 16:05:13.069767 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/images/127832af-5da1-42b3-b6aa-7fb6ccff40e5/metadata HTTP/1.1 Aug 31 16:05:13.069767 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:05:13.069767 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:05:13.069767 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:05:13.069767 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:05:13.069767 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:05:13.069767 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:05:13.069767 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:05:13.069767 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:05:13.069767 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4a4sUYHvDgNPUV23iB2ciE3iKedDfrS60WzaD8PNMR1mYVnbnhNIWnsa7hugtSeObZwCfK0eXqVv5WiNAynCqeLFGPaOjgWLvamqcTYL0Yx9uHSfzj24EvPLCILWvKli2hwMrWloVjTxW7rWvTJCjkrFpFprG_dZ8UmtDXVLPmC7iM Aug 31 16:05:13.069767 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:05:13.069767 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:05:13.069767 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:05:13.069767 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:05:13.069767 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:05:13.069767 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:05:13.069767 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: ef72d29bccc64547b03887c7ae4f78b4 Aug 31 16:05:13.069767 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-652619562 Aug 31 16:05:13.069767 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:05:13.069767 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:05:13.069767 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ef72d29bccc64547b03887c7ae4f78b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ef72d29bccc64547b03887c7ae4f78b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ef72d29bccc64547b03887c7ae4f78b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ef72d29bccc64547b03887c7ae4f78b4", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:05:13.069767 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-652619562 Aug 31 16:05:13.069767 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: ef72d29bccc64547b03887c7ae4f78b4 Aug 31 16:05:13.069767 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-652619562 Aug 31 16:05:13.069767 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ImagesMetadataNegativeTestJSON-652619562-project Aug 31 16:05:13.069767 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:05:13.069767 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:05:13.069767 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 8762703f56ce416dad3e90b38d0e2a78 Aug 31 16:05:13.069767 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-652619562-project Aug 31 16:05:13.069767 n-d-833090-16 devstack@n-api.service[128864]: method: Aug 31 16:05:13.069767 n-d-833090-16 devstack@n-api.service[128864]: exception: Image not found. Aug 31 16:05:13.069767 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'image_id': '127832af-5da1-42b3-b6aa-7fb6ccff40e5'} Aug 31 16:05:13.069767 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:05:13.069767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:05:13.069767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 31 16:05:13.069767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 31 16:05:13.069767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 16:05:13.069767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 16:05:13.069767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 31 16:05:13.069767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 31 16:05:13.069767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 16:05:13.069767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 16:05:13.069767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 31 16:05:13.069767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 31 16:05:13.069767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 31 16:05:13.069767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 31 16:05:13.069767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 16:05:13.069767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 16:05:13.069767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 16:05:13.069767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 16:05:13.069767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 127832af-5da1-42b3-b6aa-7fb6ccff40e5 Aug 31 16:05:13.069767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:05:13.069767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:05:13.069767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:05:13.069767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:05:13.069767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 31 16:05:13.069767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 31 16:05:13.069767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 31 16:05:13.069767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 31 16:05:13.079401 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 31 16:05:13.079401 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 31 16:05:13.079401 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 31 16:05:13.079401 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 31 16:05:13.079401 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 31 16:05:13.079401 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 31 16:05:13.079401 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 16:05:13.079401 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 16:05:13.079401 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 31 16:05:13.079401 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 31 16:05:13.079401 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 16:05:13.079401 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 16:05:13.079401 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 31 16:05:13.079401 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 31 16:05:13.079401 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 31 16:05:13.079401 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 31 16:05:13.079401 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 16:05:13.079401 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 16:05:13.079401 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 16:05:13.079401 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 16:05:13.079401 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 127832af-5da1-42b3-b6aa-7fb6ccff40e5 could not be found. Aug 31 16:05:13.079401 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:05:13.079401 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:05:13.079401 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:05:13.079401 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:05:13.079401 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:05:13.079401 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:05:13.079401 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:05:13.079401 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:05:13.079401 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:05:13.079401 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:05:13.079401 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:05:13.079401 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:05:13.079401 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Aug 31 16:05:13.079401 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 31 16:05:13.079401 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 31 16:05:13.079401 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 31 16:05:13.079401 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 31 16:05:13.079401 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:05:13.079401 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:05:13.079401 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:05:13.079401 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:05:13.079401 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:05:13.079401 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:05:13.079401 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:05:13.079401 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:05:13.079401 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 31 16:05:13.079401 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:05:13.079401 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4d72755f-51af-4d86-a8a9-844c55764913 tempest-ImagesMetadataNegativeTestJSON-652619562 tempest-ImagesMetadataNegativeTestJSON-652619562-project] Returning 404 to user: Image not found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:05:13.079401 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4d72755f-51af-4d86-a8a9-844c55764913 tempest-ImagesMetadataNegativeTestJSON-652619562 tempest-ImagesMetadataNegativeTestJSON-652619562-project] 10.222.0.50 "GET /compute/v2.1/images/127832af-5da1-42b3-b6aa-7fb6ccff40e5/metadata" status: 404 len: 62 microversion: 2.1 time: 0.069994 Aug 31 16:05:13.079401 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1632/3166] 10.222.0.50 () {58 vars in 1260 bytes} [Wed Aug 31 16:05:12 2022] GET /compute/v2.1/images/127832af-5da1-42b3-b6aa-7fb6ccff40e5/metadata => generated 62 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 16:05:13.089054 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8a9d7779-8066-49af-b984-0e0e1c173294 tempest-ImagesMetadataNegativeTestJSON-652619562 tempest-ImagesMetadataNegativeTestJSON-652619562-project] Action: 'update_all', calling method: .version_select at 0x7fbb4ac3ca60>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:05:13.120204 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-8a9d7779-8066-49af-b984-0e0e1c173294 tempest-ImagesMetadataNegativeTestJSON-652619562 tempest-ImagesMetadataNegativeTestJSON-652619562-project] HTTP exception thrown: Image not found. Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8a9d7779-8066-49af-b984-0e0e1c173294 tempest-ImagesMetadataNegativeTestJSON-652619562 tempest-ImagesMetadataNegativeTestJSON-652619562-project] Request method failure captured: Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: request: PUT /compute/v2.1/images/5d75551b-fed8-4168-a724-fa0b18b4eada/metadata HTTP/1.1 Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 57 Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4a4sUYHvDgNPUV23iB2ciE3iKedDfrS60WzaD8PNMR1mYVnbnhNIWnsa7hugtSeObZwCfK0eXqVv5WiNAynCqeLFGPaOjgWLvamqcTYL0Yx9uHSfzj24EvPLCILWvKli2hwMrWloVjTxW7rWvTJCjkrFpFprG_dZ8UmtDXVLPmC7iM Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: ef72d29bccc64547b03887c7ae4f78b4 Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-652619562 Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ef72d29bccc64547b03887c7ae4f78b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ef72d29bccc64547b03887c7ae4f78b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ef72d29bccc64547b03887c7ae4f78b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ef72d29bccc64547b03887c7ae4f78b4", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-652619562 Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: ef72d29bccc64547b03887c7ae4f78b4 Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-652619562 Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ImagesMetadataNegativeTestJSON-652619562-project Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 8762703f56ce416dad3e90b38d0e2a78 Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-652619562-project Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: method: Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: exception: Image not found. Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'image_id': '5d75551b-fed8-4168-a724-fa0b18b4eada', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5d75551b-fed8-4168-a724-fa0b18b4eada Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 31 16:05:13.122813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 31 16:05:13.132020 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 31 16:05:13.132020 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 31 16:05:13.132020 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 31 16:05:13.132020 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 31 16:05:13.132020 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 16:05:13.132020 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 16:05:13.132020 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 31 16:05:13.132020 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 31 16:05:13.132020 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 16:05:13.132020 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 16:05:13.132020 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 31 16:05:13.132020 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 31 16:05:13.132020 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 31 16:05:13.132020 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 31 16:05:13.132020 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 16:05:13.132020 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 16:05:13.132020 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 16:05:13.132020 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 16:05:13.132020 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5d75551b-fed8-4168-a724-fa0b18b4eada could not be found. Aug 31 16:05:13.132020 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:05:13.132020 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:05:13.132020 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:05:13.132020 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:05:13.132020 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:05:13.132020 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:05:13.132020 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:05:13.132020 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:05:13.132020 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:05:13.132020 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:05:13.132020 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:05:13.132020 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:05:13.132020 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:05:13.132020 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:05:13.132020 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Aug 31 16:05:13.132020 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 31 16:05:13.132020 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 31 16:05:13.132020 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 31 16:05:13.132020 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 31 16:05:13.132020 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:05:13.132020 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:05:13.132020 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:05:13.132020 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:05:13.132020 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:05:13.132020 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:05:13.132020 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:05:13.132020 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:05:13.132020 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 31 16:05:13.132020 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:05:13.132020 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8a9d7779-8066-49af-b984-0e0e1c173294 tempest-ImagesMetadataNegativeTestJSON-652619562 tempest-ImagesMetadataNegativeTestJSON-652619562-project] Returning 404 to user: Image not found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:05:13.132020 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8a9d7779-8066-49af-b984-0e0e1c173294 tempest-ImagesMetadataNegativeTestJSON-652619562 tempest-ImagesMetadataNegativeTestJSON-652619562-project] 10.222.0.50 "PUT /compute/v2.1/images/5d75551b-fed8-4168-a724-fa0b18b4eada/metadata" status: 404 len: 62 microversion: 2.1 time: 0.050220 Aug 31 16:05:13.132020 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1633/3167] 10.222.0.50 () {60 vars in 1280 bytes} [Wed Aug 31 16:05:13 2022] PUT /compute/v2.1/images/5d75551b-fed8-4168-a724-fa0b18b4eada/metadata => generated 62 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 16:05:13.148145 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4e211a93-64bd-435d-9717-fcd92fabe1a3 tempest-ImagesMetadataNegativeTestJSON-652619562 tempest-ImagesMetadataNegativeTestJSON-652619562-project] Action: 'update', calling method: .version_select at 0x7fbb461b2d30>, body: {"meta": {"os_distro": "alt"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:05:13.170078 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-4e211a93-64bd-435d-9717-fcd92fabe1a3 tempest-ImagesMetadataNegativeTestJSON-652619562 tempest-ImagesMetadataNegativeTestJSON-652619562-project] HTTP exception thrown: Image not found. Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4e211a93-64bd-435d-9717-fcd92fabe1a3 tempest-ImagesMetadataNegativeTestJSON-652619562 tempest-ImagesMetadataNegativeTestJSON-652619562-project] Request method failure captured: Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: request: PUT /compute/v2.1/images/44fe5df8-383c-482f-9f8a-efd9eb3b3e36/metadata/os_distro HTTP/1.1 Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 30 Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4a4sUYHvDgNPUV23iB2ciE3iKedDfrS60WzaD8PNMR1mYVnbnhNIWnsa7hugtSeObZwCfK0eXqVv5WiNAynCqeLFGPaOjgWLvamqcTYL0Yx9uHSfzj24EvPLCILWvKli2hwMrWloVjTxW7rWvTJCjkrFpFprG_dZ8UmtDXVLPmC7iM Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: ef72d29bccc64547b03887c7ae4f78b4 Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-652619562 Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ef72d29bccc64547b03887c7ae4f78b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ef72d29bccc64547b03887c7ae4f78b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ef72d29bccc64547b03887c7ae4f78b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ef72d29bccc64547b03887c7ae4f78b4", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-652619562 Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: ef72d29bccc64547b03887c7ae4f78b4 Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-652619562 Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ImagesMetadataNegativeTestJSON-652619562-project Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 8762703f56ce416dad3e90b38d0e2a78 Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-652619562-project Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: {"meta": {"os_distro": "alt"}} Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: method: Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: exception: Image not found. Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'image_id': '44fe5df8-383c-482f-9f8a-efd9eb3b3e36', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 44fe5df8-383c-482f-9f8a-efd9eb3b3e36 Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 31 16:05:13.172516 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 31 16:05:13.178615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 31 16:05:13.178615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 31 16:05:13.178615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 31 16:05:13.178615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 31 16:05:13.178615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 16:05:13.178615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 16:05:13.178615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 31 16:05:13.178615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 31 16:05:13.178615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 16:05:13.178615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 16:05:13.178615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 31 16:05:13.178615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 31 16:05:13.178615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 31 16:05:13.178615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 31 16:05:13.178615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 16:05:13.178615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 16:05:13.178615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 16:05:13.178615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 16:05:13.178615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 44fe5df8-383c-482f-9f8a-efd9eb3b3e36 could not be found. Aug 31 16:05:13.178615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:05:13.178615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:05:13.178615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:05:13.178615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:05:13.178615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:05:13.178615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:05:13.178615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:05:13.178615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:05:13.178615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:05:13.178615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:05:13.178615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:05:13.178615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:05:13.178615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:05:13.178615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:05:13.178615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Aug 31 16:05:13.178615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 31 16:05:13.178615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 31 16:05:13.178615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 31 16:05:13.178615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 31 16:05:13.178615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:05:13.178615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:05:13.178615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:05:13.178615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:05:13.178615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:05:13.178615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:05:13.178615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:05:13.178615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:05:13.178615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 31 16:05:13.178615 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:05:13.184670 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4e211a93-64bd-435d-9717-fcd92fabe1a3 tempest-ImagesMetadataNegativeTestJSON-652619562 tempest-ImagesMetadataNegativeTestJSON-652619562-project] Returning 404 to user: Image not found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:05:13.187029 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4e211a93-64bd-435d-9717-fcd92fabe1a3 tempest-ImagesMetadataNegativeTestJSON-652619562 tempest-ImagesMetadataNegativeTestJSON-652619562-project] 10.222.0.50 "PUT /compute/v2.1/images/44fe5df8-383c-482f-9f8a-efd9eb3b3e36/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.051328 Aug 31 16:05:13.195059 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1634/3168] 10.222.0.50 () {60 vars in 1310 bytes} [Wed Aug 31 16:05:13 2022] PUT /compute/v2.1/images/44fe5df8-383c-482f-9f8a-efd9eb3b3e36/metadata/os_distro => generated 62 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 16:05:13.201598 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e3f35e41-9ba3-496a-9058-230cfb523cab tempest-ImagesMetadataNegativeTestJSON-652619562 tempest-ImagesMetadataNegativeTestJSON-652619562-project] Action: 'create', calling method: .version_select at 0x7fbb46788280>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:05:13.248286 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-e3f35e41-9ba3-496a-9058-230cfb523cab tempest-ImagesMetadataNegativeTestJSON-652619562 tempest-ImagesMetadataNegativeTestJSON-652619562-project] HTTP exception thrown: Image not found. Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e3f35e41-9ba3-496a-9058-230cfb523cab tempest-ImagesMetadataNegativeTestJSON-652619562 tempest-ImagesMetadataNegativeTestJSON-652619562-project] Request method failure captured: Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: request: POST /compute/v2.1/images/fe6bac70-b3c8-4206-ba7d-1d6609cac352/metadata HTTP/1.1 Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 57 Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4a4sUYHvDgNPUV23iB2ciE3iKedDfrS60WzaD8PNMR1mYVnbnhNIWnsa7hugtSeObZwCfK0eXqVv5WiNAynCqeLFGPaOjgWLvamqcTYL0Yx9uHSfzj24EvPLCILWvKli2hwMrWloVjTxW7rWvTJCjkrFpFprG_dZ8UmtDXVLPmC7iM Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: ef72d29bccc64547b03887c7ae4f78b4 Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-652619562 Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ef72d29bccc64547b03887c7ae4f78b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ef72d29bccc64547b03887c7ae4f78b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ef72d29bccc64547b03887c7ae4f78b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ef72d29bccc64547b03887c7ae4f78b4", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-652619562 Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: ef72d29bccc64547b03887c7ae4f78b4 Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-652619562 Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ImagesMetadataNegativeTestJSON-652619562-project Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 8762703f56ce416dad3e90b38d0e2a78 Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-652619562-project Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: method: Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: exception: Image not found. Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'image_id': 'fe6bac70-b3c8-4206-ba7d-1d6609cac352', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID fe6bac70-b3c8-4206-ba7d-1d6609cac352 Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 31 16:05:13.259630 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 31 16:05:13.264813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 31 16:05:13.264813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 31 16:05:13.264813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 31 16:05:13.264813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 31 16:05:13.264813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 31 16:05:13.264813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 31 16:05:13.264813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 31 16:05:13.264813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 31 16:05:13.264813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 31 16:05:13.264813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 31 16:05:13.264813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 31 16:05:13.264813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 31 16:05:13.264813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 31 16:05:13.264813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 31 16:05:13.264813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 31 16:05:13.264813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 31 16:05:13.264813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 31 16:05:13.264813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 31 16:05:13.264813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fe6bac70-b3c8-4206-ba7d-1d6609cac352 could not be found. Aug 31 16:05:13.264813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:05:13.264813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:05:13.264813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:05:13.264813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:05:13.264813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:05:13.264813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:05:13.264813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:05:13.264813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:05:13.264813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:05:13.264813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:05:13.264813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:05:13.264813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:05:13.264813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:05:13.264813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:05:13.264813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Aug 31 16:05:13.264813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 31 16:05:13.264813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 31 16:05:13.264813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 31 16:05:13.264813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 31 16:05:13.264813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:05:13.264813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:05:13.264813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:05:13.264813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:05:13.264813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:05:13.264813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:05:13.264813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:05:13.264813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:05:13.264813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 31 16:05:13.264813 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:05:13.275857 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e3f35e41-9ba3-496a-9058-230cfb523cab tempest-ImagesMetadataNegativeTestJSON-652619562 tempest-ImagesMetadataNegativeTestJSON-652619562-project] Returning 404 to user: Image not found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:05:13.275857 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e3f35e41-9ba3-496a-9058-230cfb523cab tempest-ImagesMetadataNegativeTestJSON-652619562 tempest-ImagesMetadataNegativeTestJSON-652619562-project] 10.222.0.50 "POST /compute/v2.1/images/fe6bac70-b3c8-4206-ba7d-1d6609cac352/metadata" status: 404 len: 62 microversion: 2.1 time: 0.079099 Aug 31 16:05:13.275857 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1635/3169] 10.222.0.50 () {60 vars in 1281 bytes} [Wed Aug 31 16:05:13 2022] POST /compute/v2.1/images/fe6bac70-b3c8-4206-ba7d-1d6609cac352/metadata => generated 62 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 31 16:05:13.424628 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-db6d63f2-fad7-4c80-a10d-022dd4e9b773 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:13.467304 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-db6d63f2-fad7-4c80-a10d-022dd4e9b773 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc" status: 200 len: 1717 microversion: 2.1 time: 0.557199 Aug 31 16:05:13.468617 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1535/3170] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:12 2022] GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc => generated 1717 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:05:14.498957 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9e421328-72d1-4749-834f-424f48c1525b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:14.500755 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9e421328-72d1-4749-834f-424f48c1525b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:14.513605 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9e421328-72d1-4749-834f-424f48c1525b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:14.518767 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9e421328-72d1-4749-834f-424f48c1525b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:14.519766 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9e421328-72d1-4749-834f-424f48c1525b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:14.521430 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9e421328-72d1-4749-834f-424f48c1525b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:14.522443 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9e421328-72d1-4749-834f-424f48c1525b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:14.523196 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9e421328-72d1-4749-834f-424f48c1525b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:15.054894 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9e421328-72d1-4749-834f-424f48c1525b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:15.058555 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9e421328-72d1-4749-834f-424f48c1525b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc" status: 200 len: 1717 microversion: 2.1 time: 0.564932 Aug 31 16:05:15.062225 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1636/3171] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:14 2022] GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc => generated 1717 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:16.084103 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-da639904-1b1f-46b5-ba1a-8bf7321e76ec tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:16.085888 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-da639904-1b1f-46b5-ba1a-8bf7321e76ec tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:16.107199 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da639904-1b1f-46b5-ba1a-8bf7321e76ec tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:16.107693 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da639904-1b1f-46b5-ba1a-8bf7321e76ec tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:16.108126 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da639904-1b1f-46b5-ba1a-8bf7321e76ec tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:16.108816 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da639904-1b1f-46b5-ba1a-8bf7321e76ec tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:16.110860 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da639904-1b1f-46b5-ba1a-8bf7321e76ec tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:16.112616 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da639904-1b1f-46b5-ba1a-8bf7321e76ec tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:16.168918 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-db56c68f-83fa-4fcd-931a-4dc392bd1bae req-2080ff95-5ed3-4014-88d1-94eb141b99d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "027ef860-8ede-472c-9099-befdc2cde7bc", "name": "network-vif-unplugged", "status": "completed", "tag": "f3ddf80b-0487-4257-b3e5-b64f7214f531"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:05:16.199118 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-db56c68f-83fa-4fcd-931a-4dc392bd1bae req-2080ff95-5ed3-4014-88d1-94eb141b99d8 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:16.199573 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-db56c68f-83fa-4fcd-931a-4dc392bd1bae req-2080ff95-5ed3-4014-88d1-94eb141b99d8 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:16.200234 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-db56c68f-83fa-4fcd-931a-4dc392bd1bae req-2080ff95-5ed3-4014-88d1-94eb141b99d8 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:16.233634 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-db56c68f-83fa-4fcd-931a-4dc392bd1bae req-2080ff95-5ed3-4014-88d1-94eb141b99d8 service nova] Creating event network-vif-unplugged:f3ddf80b-0487-4257-b3e5-b64f7214f531 for instance 027ef860-8ede-472c-9099-befdc2cde7bc on n-h1-833090-16 Aug 31 16:05:16.241389 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-db56c68f-83fa-4fcd-931a-4dc392bd1bae req-2080ff95-5ed3-4014-88d1-94eb141b99d8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076142 Aug 31 16:05:16.244377 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1637/3172] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:05:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:05:16.779375 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-da639904-1b1f-46b5-ba1a-8bf7321e76ec tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:16.803627 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-da639904-1b1f-46b5-ba1a-8bf7321e76ec tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc" status: 200 len: 1717 microversion: 2.1 time: 0.723606 Aug 31 16:05:16.818215 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1536/3173] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:16 2022] GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc => generated 1717 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:17.836804 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f2632468-c646-4cba-bba5-1c0ca86d0e6b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:17.839003 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f2632468-c646-4cba-bba5-1c0ca86d0e6b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:17.854658 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f2632468-c646-4cba-bba5-1c0ca86d0e6b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:17.856338 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f2632468-c646-4cba-bba5-1c0ca86d0e6b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:17.857624 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f2632468-c646-4cba-bba5-1c0ca86d0e6b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:17.879179 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f2632468-c646-4cba-bba5-1c0ca86d0e6b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:17.880413 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f2632468-c646-4cba-bba5-1c0ca86d0e6b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:17.884551 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f2632468-c646-4cba-bba5-1c0ca86d0e6b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:18.217812 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f2632468-c646-4cba-bba5-1c0ca86d0e6b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:18.231502 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f2632468-c646-4cba-bba5-1c0ca86d0e6b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc" status: 200 len: 1717 microversion: 2.1 time: 0.400733 Aug 31 16:05:18.248608 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1638/3174] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:17 2022] GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc => generated 1717 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:18.308860 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-9915d510-da56-4a7e-85c1-fb8cd32f18bb req-3ed5b56a-124d-45b9-b28c-dcd7f81c01b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "027ef860-8ede-472c-9099-befdc2cde7bc", "tag": "f3ddf80b-0487-4257-b3e5-b64f7214f531"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:05:18.324184 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9915d510-da56-4a7e-85c1-fb8cd32f18bb req-3ed5b56a-124d-45b9-b28c-dcd7f81c01b0 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:18.324670 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9915d510-da56-4a7e-85c1-fb8cd32f18bb req-3ed5b56a-124d-45b9-b28c-dcd7f81c01b0 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:18.325101 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9915d510-da56-4a7e-85c1-fb8cd32f18bb req-3ed5b56a-124d-45b9-b28c-dcd7f81c01b0 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:18.352028 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-9915d510-da56-4a7e-85c1-fb8cd32f18bb req-3ed5b56a-124d-45b9-b28c-dcd7f81c01b0 service nova] Creating event network-changed:f3ddf80b-0487-4257-b3e5-b64f7214f531 for instance 027ef860-8ede-472c-9099-befdc2cde7bc on n-h1-833090-16 Aug 31 16:05:18.362282 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-9915d510-da56-4a7e-85c1-fb8cd32f18bb req-3ed5b56a-124d-45b9-b28c-dcd7f81c01b0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056914 Aug 31 16:05:18.362971 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1537/3175] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:05:19.225319 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6590b7ad-3105-41d1-a20f-4d85bd653222 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb4ac61a60>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:19.259457 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ff45a65f-9a70-4be6-a663-fa3999d9a071 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:19.260670 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ff45a65f-9a70-4be6-a663-fa3999d9a071 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:19.279376 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ff45a65f-9a70-4be6-a663-fa3999d9a071 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:19.286694 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ff45a65f-9a70-4be6-a663-fa3999d9a071 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:19.287505 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ff45a65f-9a70-4be6-a663-fa3999d9a071 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:19.291204 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ff45a65f-9a70-4be6-a663-fa3999d9a071 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:19.291710 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ff45a65f-9a70-4be6-a663-fa3999d9a071 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:19.294829 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ff45a65f-9a70-4be6-a663-fa3999d9a071 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:19.305382 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6590b7ad-3105-41d1-a20f-4d85bd653222 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/d7e0dca3-d47c-40e7-985e-2c9bca850623" status: 200 len: 661 microversion: 2.1 time: 0.084322 Aug 31 16:05:19.306448 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1639/3176] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:05:19 2022] GET /compute/v2.1/images/d7e0dca3-d47c-40e7-985e-2c9bca850623 => generated 661 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:05:19.319730 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f1f81d17-db49-4118-a66d-72c8f799aac8 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb46acd670>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:19.401049 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f1f81d17-db49-4118-a66d-72c8f799aac8 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/d7e0dca3-d47c-40e7-985e-2c9bca850623" status: 200 len: 661 microversion: 2.1 time: 0.085496 Aug 31 16:05:19.401915 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1640/3177] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:05:19 2022] GET /compute/v2.1/images/d7e0dca3-d47c-40e7-985e-2c9bca850623 => generated 661 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:05:19.999534 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ff45a65f-9a70-4be6-a663-fa3999d9a071 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:20.015026 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ff45a65f-9a70-4be6-a663-fa3999d9a071 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc" status: 200 len: 1717 microversion: 2.1 time: 0.763231 Aug 31 16:05:20.026846 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1538/3178] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:19 2022] GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc => generated 1717 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:21.056218 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f9be910f-9aa3-41bd-b9b5-a506bf8bbcf3 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:21.057137 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f9be910f-9aa3-41bd-b9b5-a506bf8bbcf3 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:21.065628 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f9be910f-9aa3-41bd-b9b5-a506bf8bbcf3 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:21.066679 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f9be910f-9aa3-41bd-b9b5-a506bf8bbcf3 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:21.068142 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f9be910f-9aa3-41bd-b9b5-a506bf8bbcf3 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:21.069074 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f9be910f-9aa3-41bd-b9b5-a506bf8bbcf3 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:21.069735 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f9be910f-9aa3-41bd-b9b5-a506bf8bbcf3 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:21.070283 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f9be910f-9aa3-41bd-b9b5-a506bf8bbcf3 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:21.219226 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-df50b5b9-cf8c-4798-8922-9613e20d02fe tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb45d47550>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:21.297141 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-df50b5b9-cf8c-4798-8922-9613e20d02fe tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/98cb2f85-bd63-450a-b78c-f064201f1592" status: 200 len: 662 microversion: 2.1 time: 0.082579 Aug 31 16:05:21.307121 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1539/3179] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:05:21 2022] GET /compute/v2.1/images/98cb2f85-bd63-450a-b78c-f064201f1592 => generated 662 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:05:21.314784 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7f5db150-e92d-49d6-a418-403ff1637045 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb45d91dc0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:21.374005 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7f5db150-e92d-49d6-a418-403ff1637045 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/98cb2f85-bd63-450a-b78c-f064201f1592" status: 200 len: 662 microversion: 2.1 time: 0.065068 Aug 31 16:05:21.375105 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1540/3180] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:05:21 2022] GET /compute/v2.1/images/98cb2f85-bd63-450a-b78c-f064201f1592 => generated 662 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:05:21.735202 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f9be910f-9aa3-41bd-b9b5-a506bf8bbcf3 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:21.768379 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f9be910f-9aa3-41bd-b9b5-a506bf8bbcf3 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc" status: 200 len: 1717 microversion: 2.1 time: 0.731014 Aug 31 16:05:21.770406 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1641/3181] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:21 2022] GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc => generated 1717 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:22.800661 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7aeb85de-a4ce-4e2a-826b-89f95175d1bf tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:22.802353 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7aeb85de-a4ce-4e2a-826b-89f95175d1bf tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:22.815166 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7aeb85de-a4ce-4e2a-826b-89f95175d1bf tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:22.826630 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7aeb85de-a4ce-4e2a-826b-89f95175d1bf tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:22.827965 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7aeb85de-a4ce-4e2a-826b-89f95175d1bf tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:22.829200 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7aeb85de-a4ce-4e2a-826b-89f95175d1bf tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:22.830045 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7aeb85de-a4ce-4e2a-826b-89f95175d1bf tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:22.832056 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7aeb85de-a4ce-4e2a-826b-89f95175d1bf tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:23.029098 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4db1844d-ed0c-4aee-9452-77275d54907b tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb4ac4ed30>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:23.103433 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4db1844d-ed0c-4aee-9452-77275d54907b tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/0df0e9ae-9048-4f03-87bf-ad0fc4379256" status: 200 len: 662 microversion: 2.1 time: 0.078407 Aug 31 16:05:23.103997 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1642/3182] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:05:23 2022] GET /compute/v2.1/images/0df0e9ae-9048-4f03-87bf-ad0fc4379256 => generated 662 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:05:23.131790 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2a8bd3f9-1574-4062-86c6-dcbc0d6d8af4 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb4682e3a0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:23.193968 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2a8bd3f9-1574-4062-86c6-dcbc0d6d8af4 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/0df0e9ae-9048-4f03-87bf-ad0fc4379256" status: 200 len: 662 microversion: 2.1 time: 0.074536 Aug 31 16:05:23.195479 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1643/3183] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:05:23 2022] GET /compute/v2.1/images/0df0e9ae-9048-4f03-87bf-ad0fc4379256 => generated 662 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:05:23.197742 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7aeb85de-a4ce-4e2a-826b-89f95175d1bf tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:23.207245 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7aeb85de-a4ce-4e2a-826b-89f95175d1bf tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc" status: 200 len: 1717 microversion: 2.1 time: 0.412818 Aug 31 16:05:23.208498 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1541/3184] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:22 2022] GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc => generated 1717 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:23.380782 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9a7c3b43-63c7-45b8-9836-727e00f0b736 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-436181458", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:05:23.505241 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2d008a20-1e21-4ab8-9430-8c3dd0597c5e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:05:23.510403 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2d008a20-1e21-4ab8-9430-8c3dd0597c5e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:23.513564 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-9a7c3b43-63c7-45b8-9836-727e00f0b736 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] validate_networks() for None {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:05:23.526631 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d008a20-1e21-4ab8-9430-8c3dd0597c5e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:23.527596 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d008a20-1e21-4ab8-9430-8c3dd0597c5e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:23.528120 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d008a20-1e21-4ab8-9430-8c3dd0597c5e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:23.528962 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d008a20-1e21-4ab8-9430-8c3dd0597c5e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:23.529423 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d008a20-1e21-4ab8-9430-8c3dd0597c5e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:23.529846 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d008a20-1e21-4ab8-9430-8c3dd0597c5e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:23.653218 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2d008a20-1e21-4ab8-9430-8c3dd0597c5e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "POST /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b/action" status: 202 len: 0 microversion: 2.1 time: 0.157758 Aug 31 16:05:23.655769 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1542/3185] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:05:23 2022] POST /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:05:23.680060 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-95f7d2f9-1e58-4b1c-a296-3354148a0702 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:23.686244 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-95f7d2f9-1e58-4b1c-a296-3354148a0702 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:23.708270 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95f7d2f9-1e58-4b1c-a296-3354148a0702 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:23.709352 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95f7d2f9-1e58-4b1c-a296-3354148a0702 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:23.710068 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95f7d2f9-1e58-4b1c-a296-3354148a0702 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:23.711227 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95f7d2f9-1e58-4b1c-a296-3354148a0702 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:23.712006 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95f7d2f9-1e58-4b1c-a296-3354148a0702 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:23.713127 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95f7d2f9-1e58-4b1c-a296-3354148a0702 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:24.334296 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-95f7d2f9-1e58-4b1c-a296-3354148a0702 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:24.339645 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-9a7c3b43-63c7-45b8-9836-727e00f0b736 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:05:24.341801 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-9a7c3b43-63c7-45b8-9836-727e00f0b736 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:05:24.343056 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-9a7c3b43-63c7-45b8-9836-727e00f0b736 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:05:24.347541 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-9a7c3b43-63c7-45b8-9836-727e00f0b736 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:05:24.348049 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-9a7c3b43-63c7-45b8-9836-727e00f0b736 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:05:24.348396 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-95f7d2f9-1e58-4b1c-a296-3354148a0702 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1673 microversion: 2.1 time: 0.688991 Aug 31 16:05:24.363421 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1543/3186] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:23 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1673 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:24.371647 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3d2d51be-b3ff-449c-8491-59e4e538f4b1 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:24.373596 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3d2d51be-b3ff-449c-8491-59e4e538f4b1 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:24.375359 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9a7c3b43-63c7-45b8-9836-727e00f0b736 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:24.376527 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9a7c3b43-63c7-45b8-9836-727e00f0b736 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:24.377219 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9a7c3b43-63c7-45b8-9836-727e00f0b736 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:24.378926 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9a7c3b43-63c7-45b8-9836-727e00f0b736 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:24.379804 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9a7c3b43-63c7-45b8-9836-727e00f0b736 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:24.383843 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9a7c3b43-63c7-45b8-9836-727e00f0b736 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:24.386121 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d2d51be-b3ff-449c-8491-59e4e538f4b1 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:24.386899 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d2d51be-b3ff-449c-8491-59e4e538f4b1 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:24.387473 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d2d51be-b3ff-449c-8491-59e4e538f4b1 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:24.388683 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d2d51be-b3ff-449c-8491-59e4e538f4b1 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:24.389233 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d2d51be-b3ff-449c-8491-59e4e538f4b1 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:24.389933 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d2d51be-b3ff-449c-8491-59e4e538f4b1 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:24.458476 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-9a7c3b43-63c7-45b8-9836-727e00f0b736 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Getting quotas for project 5d1a33aeb63a416a9d046e2b67b93f30. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:05:24.474546 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-9a7c3b43-63c7-45b8-9836-727e00f0b736 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Getting quotas for user fae96c057d884eafb9c2032dd5db9e2e and project 5d1a33aeb63a416a9d046e2b67b93f30. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:05:24.513697 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9a7c3b43-63c7-45b8-9836-727e00f0b736 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:05:24.521568 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9a7c3b43-63c7-45b8-9836-727e00f0b736 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] [instance: d3255935-3cff-4bb0-aad2-a8f401028a59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:05:24.630503 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9a7c3b43-63c7-45b8-9836-727e00f0b736 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.255491 Aug 31 16:05:24.631195 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1644/3187] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:05:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1257 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:05:24.838223 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3d2d51be-b3ff-449c-8491-59e4e538f4b1 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:24.850529 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3d2d51be-b3ff-449c-8491-59e4e538f4b1 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc" status: 200 len: 1717 microversion: 2.1 time: 0.485882 Aug 31 16:05:24.869153 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1544/3188] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:24 2022] GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc => generated 1717 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:25.020887 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a16c7b36-efb7-4a0f-840d-56faa4e429b0 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-639637216", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:05:25.210797 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-a16c7b36-efb7-4a0f-840d-56faa4e429b0 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] validate_networks() for None {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:05:25.381112 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7d4e5946-ad77-4014-a48c-a0dd01e01558 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:25.386514 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7d4e5946-ad77-4014-a48c-a0dd01e01558 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:25.408914 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d4e5946-ad77-4014-a48c-a0dd01e01558 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:25.410653 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d4e5946-ad77-4014-a48c-a0dd01e01558 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:25.412302 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d4e5946-ad77-4014-a48c-a0dd01e01558 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:25.413883 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d4e5946-ad77-4014-a48c-a0dd01e01558 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:25.414979 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d4e5946-ad77-4014-a48c-a0dd01e01558 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:25.416556 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d4e5946-ad77-4014-a48c-a0dd01e01558 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:25.742989 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7d4e5946-ad77-4014-a48c-a0dd01e01558 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:25.760497 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7d4e5946-ad77-4014-a48c-a0dd01e01558 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1678 microversion: 2.1 time: 0.389144 Aug 31 16:05:25.766540 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1545/3189] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:25 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1678 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:25.813619 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-a16c7b36-efb7-4a0f-840d-56faa4e429b0 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:05:25.814153 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-a16c7b36-efb7-4a0f-840d-56faa4e429b0 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:05:25.814570 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-a16c7b36-efb7-4a0f-840d-56faa4e429b0 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:05:25.815115 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-a16c7b36-efb7-4a0f-840d-56faa4e429b0 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:05:25.816077 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-a16c7b36-efb7-4a0f-840d-56faa4e429b0 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:05:25.826221 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a16c7b36-efb7-4a0f-840d-56faa4e429b0 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:25.826840 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a16c7b36-efb7-4a0f-840d-56faa4e429b0 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:25.827544 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a16c7b36-efb7-4a0f-840d-56faa4e429b0 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:25.828639 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a16c7b36-efb7-4a0f-840d-56faa4e429b0 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:25.829419 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a16c7b36-efb7-4a0f-840d-56faa4e429b0 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:25.829887 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a16c7b36-efb7-4a0f-840d-56faa4e429b0 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:25.853399 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-a16c7b36-efb7-4a0f-840d-56faa4e429b0 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Getting quotas for project 5d1a33aeb63a416a9d046e2b67b93f30. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:05:25.860870 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-a16c7b36-efb7-4a0f-840d-56faa4e429b0 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Getting quotas for user fae96c057d884eafb9c2032dd5db9e2e and project 5d1a33aeb63a416a9d046e2b67b93f30. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:05:25.877330 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-62e906c8-76bd-4cd6-8125-32e5e4438e7e tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:25.878427 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-62e906c8-76bd-4cd6-8125-32e5e4438e7e tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:25.892612 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62e906c8-76bd-4cd6-8125-32e5e4438e7e tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:25.896664 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62e906c8-76bd-4cd6-8125-32e5e4438e7e tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:25.897412 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62e906c8-76bd-4cd6-8125-32e5e4438e7e tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:25.899933 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a16c7b36-efb7-4a0f-840d-56faa4e429b0 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:05:25.903241 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62e906c8-76bd-4cd6-8125-32e5e4438e7e tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:25.903931 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62e906c8-76bd-4cd6-8125-32e5e4438e7e tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:25.904734 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62e906c8-76bd-4cd6-8125-32e5e4438e7e tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:25.907265 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a16c7b36-efb7-4a0f-840d-56faa4e429b0 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] [instance: 5c81c9a3-8ba0-4573-a3e8-68292edc1ae2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:05:26.048508 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a16c7b36-efb7-4a0f-840d-56faa4e429b0 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.032704 Aug 31 16:05:26.052261 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1645/3190] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:05:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1038 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:05:26.090034 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-19e966de-a036-4f49-82e9-706b922e1666 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:26.092745 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-19e966de-a036-4f49-82e9-706b922e1666 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] [instance: 5c81c9a3-8ba0-4573-a3e8-68292edc1ae2] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:26.238380 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-19e966de-a036-4f49-82e9-706b922e1666 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae96c057d884eafb9c2032dd5db9e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a33aeb63a416a9d046e2b67b93f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:26.262355 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-19e966de-a036-4f49-82e9-706b922e1666 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/servers/5c81c9a3-8ba0-4573-a3e8-68292edc1ae2" status: 200 len: 1217 microversion: 2.1 time: 0.190446 Aug 31 16:05:26.266181 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1646/3191] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:26 2022] GET /compute/v2.1/servers/5c81c9a3-8ba0-4573-a3e8-68292edc1ae2 => generated 1217 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:26.501049 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-62e906c8-76bd-4cd6-8125-32e5e4438e7e tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:26.538074 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-62e906c8-76bd-4cd6-8125-32e5e4438e7e tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc" status: 200 len: 1717 microversion: 2.1 time: 0.664927 Aug 31 16:05:26.569985 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1546/3192] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:25 2022] GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc => generated 1717 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:26.787812 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f9b35465-42bf-4b5b-a86c-f4c95a58e92c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:26.788562 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f9b35465-42bf-4b5b-a86c-f4c95a58e92c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:26.803388 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f9b35465-42bf-4b5b-a86c-f4c95a58e92c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:26.808834 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f9b35465-42bf-4b5b-a86c-f4c95a58e92c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:26.809297 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f9b35465-42bf-4b5b-a86c-f4c95a58e92c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:26.811222 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f9b35465-42bf-4b5b-a86c-f4c95a58e92c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:26.822476 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f9b35465-42bf-4b5b-a86c-f4c95a58e92c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:26.824313 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f9b35465-42bf-4b5b-a86c-f4c95a58e92c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:27.195034 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f9b35465-42bf-4b5b-a86c-f4c95a58e92c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:27.227521 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f9b35465-42bf-4b5b-a86c-f4c95a58e92c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1671 microversion: 2.1 time: 0.444580 Aug 31 16:05:27.233196 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1647/3193] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:26 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1671 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:27.289414 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-43cd3ea3-8218-4826-9936-ef4fef61d361 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:27.290533 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-43cd3ea3-8218-4826-9936-ef4fef61d361 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] [instance: 5c81c9a3-8ba0-4573-a3e8-68292edc1ae2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:27.517850 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-43cd3ea3-8218-4826-9936-ef4fef61d361 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae96c057d884eafb9c2032dd5db9e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a33aeb63a416a9d046e2b67b93f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:27.526598 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-43cd3ea3-8218-4826-9936-ef4fef61d361 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/servers/5c81c9a3-8ba0-4573-a3e8-68292edc1ae2" status: 200 len: 1217 microversion: 2.1 time: 0.242558 Aug 31 16:05:27.530849 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1547/3194] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:27 2022] GET /compute/v2.1/servers/5c81c9a3-8ba0-4573-a3e8-68292edc1ae2 => generated 1217 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:05:27.586383 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ab2b05d4-b90a-456b-b2f8-e823245448a5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:27.587873 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ab2b05d4-b90a-456b-b2f8-e823245448a5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:27.617109 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ab2b05d4-b90a-456b-b2f8-e823245448a5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:27.619876 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ab2b05d4-b90a-456b-b2f8-e823245448a5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:27.621556 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ab2b05d4-b90a-456b-b2f8-e823245448a5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:27.626745 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ab2b05d4-b90a-456b-b2f8-e823245448a5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:27.629556 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ab2b05d4-b90a-456b-b2f8-e823245448a5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:27.629664 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ab2b05d4-b90a-456b-b2f8-e823245448a5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:28.111129 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ab2b05d4-b90a-456b-b2f8-e823245448a5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:28.150809 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ab2b05d4-b90a-456b-b2f8-e823245448a5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc" status: 200 len: 1717 microversion: 2.1 time: 0.571569 Aug 31 16:05:28.151586 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1648/3195] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:27 2022] GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc => generated 1717 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:28.556017 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-89a4540e-6274-4ea8-abcb-2923b572456f tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:28.556639 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-89a4540e-6274-4ea8-abcb-2923b572456f tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] [instance: 5c81c9a3-8ba0-4573-a3e8-68292edc1ae2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:28.585767 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-89a4540e-6274-4ea8-abcb-2923b572456f tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:28.586417 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-89a4540e-6274-4ea8-abcb-2923b572456f tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:28.586873 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-89a4540e-6274-4ea8-abcb-2923b572456f tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:28.587616 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-89a4540e-6274-4ea8-abcb-2923b572456f tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:28.588092 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-89a4540e-6274-4ea8-abcb-2923b572456f tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:28.598662 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-89a4540e-6274-4ea8-abcb-2923b572456f tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:28.949040 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-89a4540e-6274-4ea8-abcb-2923b572456f tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae96c057d884eafb9c2032dd5db9e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a33aeb63a416a9d046e2b67b93f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:28.965630 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-89a4540e-6274-4ea8-abcb-2923b572456f tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/servers/5c81c9a3-8ba0-4573-a3e8-68292edc1ae2" status: 200 len: 1269 microversion: 2.1 time: 0.412168 Aug 31 16:05:28.979650 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1548/3196] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:28 2022] GET /compute/v2.1/servers/5c81c9a3-8ba0-4573-a3e8-68292edc1ae2 => generated 1269 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:29.183550 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-91023c0e-6160-47f0-a73d-e8a338cf7fc2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:29.185935 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-91023c0e-6160-47f0-a73d-e8a338cf7fc2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:29.201843 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91023c0e-6160-47f0-a73d-e8a338cf7fc2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:29.206560 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91023c0e-6160-47f0-a73d-e8a338cf7fc2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:29.207334 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91023c0e-6160-47f0-a73d-e8a338cf7fc2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:29.209268 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91023c0e-6160-47f0-a73d-e8a338cf7fc2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:29.209966 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91023c0e-6160-47f0-a73d-e8a338cf7fc2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:29.210853 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91023c0e-6160-47f0-a73d-e8a338cf7fc2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:29.994246 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d3ab6294-218b-491c-a805-0bcdd0ac0542 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:29.995128 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d3ab6294-218b-491c-a805-0bcdd0ac0542 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] [instance: 5c81c9a3-8ba0-4573-a3e8-68292edc1ae2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:30.007386 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d3ab6294-218b-491c-a805-0bcdd0ac0542 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:30.013937 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d3ab6294-218b-491c-a805-0bcdd0ac0542 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:30.014718 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d3ab6294-218b-491c-a805-0bcdd0ac0542 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:30.015786 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d3ab6294-218b-491c-a805-0bcdd0ac0542 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:30.016415 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d3ab6294-218b-491c-a805-0bcdd0ac0542 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:30.020270 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d3ab6294-218b-491c-a805-0bcdd0ac0542 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:30.109781 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-91023c0e-6160-47f0-a73d-e8a338cf7fc2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:30.125174 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-91023c0e-6160-47f0-a73d-e8a338cf7fc2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc" status: 200 len: 1717 microversion: 2.1 time: 0.947538 Aug 31 16:05:30.132373 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1649/3197] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:29 2022] GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc => generated 1717 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:30.211723 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d3ab6294-218b-491c-a805-0bcdd0ac0542 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae96c057d884eafb9c2032dd5db9e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a33aeb63a416a9d046e2b67b93f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:30.221723 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d3ab6294-218b-491c-a805-0bcdd0ac0542 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/servers/5c81c9a3-8ba0-4573-a3e8-68292edc1ae2" status: 200 len: 1275 microversion: 2.1 time: 0.234108 Aug 31 16:05:30.238186 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1549/3198] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:29 2022] GET /compute/v2.1/servers/5c81c9a3-8ba0-4573-a3e8-68292edc1ae2 => generated 1275 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:31.154458 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-24586b1d-d4fc-4373-9a6f-e357ab14b920 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:31.155818 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-24586b1d-d4fc-4373-9a6f-e357ab14b920 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:31.183256 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-24586b1d-d4fc-4373-9a6f-e357ab14b920 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:31.186849 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-24586b1d-d4fc-4373-9a6f-e357ab14b920 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:31.190511 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-24586b1d-d4fc-4373-9a6f-e357ab14b920 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:31.198783 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-24586b1d-d4fc-4373-9a6f-e357ab14b920 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:31.200444 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-24586b1d-d4fc-4373-9a6f-e357ab14b920 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:31.202424 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-24586b1d-d4fc-4373-9a6f-e357ab14b920 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:31.245030 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b9cbc004-edd1-4ec4-b70e-e72888ca4ceb tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:31.247357 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b9cbc004-edd1-4ec4-b70e-e72888ca4ceb tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] [instance: 5c81c9a3-8ba0-4573-a3e8-68292edc1ae2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:31.269464 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9cbc004-edd1-4ec4-b70e-e72888ca4ceb tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:31.277727 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9cbc004-edd1-4ec4-b70e-e72888ca4ceb tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:31.279804 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9cbc004-edd1-4ec4-b70e-e72888ca4ceb tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:31.282306 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9cbc004-edd1-4ec4-b70e-e72888ca4ceb tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:31.284045 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9cbc004-edd1-4ec4-b70e-e72888ca4ceb tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:31.286722 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9cbc004-edd1-4ec4-b70e-e72888ca4ceb tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:31.600243 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b9cbc004-edd1-4ec4-b70e-e72888ca4ceb tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae96c057d884eafb9c2032dd5db9e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a33aeb63a416a9d046e2b67b93f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:31.621632 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b9cbc004-edd1-4ec4-b70e-e72888ca4ceb tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/servers/5c81c9a3-8ba0-4573-a3e8-68292edc1ae2" status: 200 len: 1275 microversion: 2.1 time: 0.380392 Aug 31 16:05:31.628795 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1550/3199] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:31 2022] GET /compute/v2.1/servers/5c81c9a3-8ba0-4573-a3e8-68292edc1ae2 => generated 1275 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:05:31.639956 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ee81d9c0-e2c0-4d77-9673-65245ae807c8 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:31.644274 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ee81d9c0-e2c0-4d77-9673-65245ae807c8 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:31.661593 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee81d9c0-e2c0-4d77-9673-65245ae807c8 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:31.662008 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee81d9c0-e2c0-4d77-9673-65245ae807c8 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:31.668450 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee81d9c0-e2c0-4d77-9673-65245ae807c8 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:31.668450 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee81d9c0-e2c0-4d77-9673-65245ae807c8 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:31.668450 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee81d9c0-e2c0-4d77-9673-65245ae807c8 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:31.672167 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee81d9c0-e2c0-4d77-9673-65245ae807c8 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:31.869729 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-24586b1d-d4fc-4373-9a6f-e357ab14b920 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:31.885423 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-24586b1d-d4fc-4373-9a6f-e357ab14b920 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc" status: 200 len: 1717 microversion: 2.1 time: 0.735354 Aug 31 16:05:31.888053 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1650/3200] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:31 2022] GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc => generated 1717 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:32.417688 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ee81d9c0-e2c0-4d77-9673-65245ae807c8 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:32.438798 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ee81d9c0-e2c0-4d77-9673-65245ae807c8 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:32.443888 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ee81d9c0-e2c0-4d77-9673-65245ae807c8 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:32.449289 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ee81d9c0-e2c0-4d77-9673-65245ae807c8 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 2952 microversion: 2.42 time: 0.818752 Aug 31 16:05:32.450909 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1551/3201] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:05:31 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 2952 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:05:32.499768 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d6e9c65b-3e60-46ae-9d6d-abb30d0ec838 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:32.501407 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d6e9c65b-3e60-46ae-9d6d-abb30d0ec838 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:32.530868 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d6e9c65b-3e60-46ae-9d6d-abb30d0ec838 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:32.532330 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d6e9c65b-3e60-46ae-9d6d-abb30d0ec838 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:32.535264 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d6e9c65b-3e60-46ae-9d6d-abb30d0ec838 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:32.543354 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d6e9c65b-3e60-46ae-9d6d-abb30d0ec838 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:32.544751 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d6e9c65b-3e60-46ae-9d6d-abb30d0ec838 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:32.546026 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d6e9c65b-3e60-46ae-9d6d-abb30d0ec838 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:32.663008 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0095bd3e-0171-4714-b50c-3ad324694c52 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:32.663008 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0095bd3e-0171-4714-b50c-3ad324694c52 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] [instance: 5c81c9a3-8ba0-4573-a3e8-68292edc1ae2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:32.674875 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:05:32.692287 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0095bd3e-0171-4714-b50c-3ad324694c52 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:32.694160 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0095bd3e-0171-4714-b50c-3ad324694c52 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:32.695943 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0095bd3e-0171-4714-b50c-3ad324694c52 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:32.697038 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0095bd3e-0171-4714-b50c-3ad324694c52 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:32.698811 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0095bd3e-0171-4714-b50c-3ad324694c52 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:32.700552 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0095bd3e-0171-4714-b50c-3ad324694c52 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:32.713757 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:05:33.233801 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d6e9c65b-3e60-46ae-9d6d-abb30d0ec838 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.741112 Aug 31 16:05:33.234684 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1651/3202] 10.222.0.50 () {60 vars in 1316 bytes} [Wed Aug 31 16:05:32 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1/os-interface => generated 1831 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:05:33.239752 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-cf8869c9-16c7-466d-aacd-602f5bf3b4e1 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:33.241033 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-cf8869c9-16c7-466d-aacd-602f5bf3b4e1 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:33.262501 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cf8869c9-16c7-466d-aacd-602f5bf3b4e1 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:33.263349 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cf8869c9-16c7-466d-aacd-602f5bf3b4e1 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:33.263966 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cf8869c9-16c7-466d-aacd-602f5bf3b4e1 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:33.264873 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cf8869c9-16c7-466d-aacd-602f5bf3b4e1 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:33.265521 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cf8869c9-16c7-466d-aacd-602f5bf3b4e1 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:33.269345 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cf8869c9-16c7-466d-aacd-602f5bf3b4e1 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:33.724027 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0095bd3e-0171-4714-b50c-3ad324694c52 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae96c057d884eafb9c2032dd5db9e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a33aeb63a416a9d046e2b67b93f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:33.739490 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0095bd3e-0171-4714-b50c-3ad324694c52 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/servers/5c81c9a3-8ba0-4573-a3e8-68292edc1ae2" status: 200 len: 1317 microversion: 2.1 time: 1.084637 Aug 31 16:05:33.741855 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1552/3203] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:32 2022] GET /compute/v2.1/servers/5c81c9a3-8ba0-4573-a3e8-68292edc1ae2 => generated 1317 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:33.925450 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-cf8869c9-16c7-466d-aacd-602f5bf3b4e1 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:33.967668 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-cf8869c9-16c7-466d-aacd-602f5bf3b4e1 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc" status: 200 len: 1717 microversion: 2.1 time: 0.725398 Aug 31 16:05:33.968182 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1652/3204] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:33 2022] GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc => generated 1717 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:34.184689 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-962a814f-b240-46b6-8e26-b602053fef5f req-3549db81-5dc1-4cfb-a205-17f4bceffd68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3255935-3cff-4bb0-aad2-a8f401028a59", "tag": "21dd4917-2780-427e-86cb-ca75980a35b5"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:05:34.217203 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-962a814f-b240-46b6-8e26-b602053fef5f req-3549db81-5dc1-4cfb-a205-17f4bceffd68 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:34.219385 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-962a814f-b240-46b6-8e26-b602053fef5f req-3549db81-5dc1-4cfb-a205-17f4bceffd68 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:34.220618 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-962a814f-b240-46b6-8e26-b602053fef5f req-3549db81-5dc1-4cfb-a205-17f4bceffd68 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:34.261442 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-962a814f-b240-46b6-8e26-b602053fef5f req-3549db81-5dc1-4cfb-a205-17f4bceffd68 service nova] Creating event network-changed:21dd4917-2780-427e-86cb-ca75980a35b5 for instance d3255935-3cff-4bb0-aad2-a8f401028a59 on n-h2-833090-16 Aug 31 16:05:34.269417 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-962a814f-b240-46b6-8e26-b602053fef5f req-3549db81-5dc1-4cfb-a205-17f4bceffd68 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102682 Aug 31 16:05:34.271200 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1553/3205] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:05:34.781155 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e848b1f6-12db-475b-9c3e-f9fbb0503dd3 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:34.781846 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e848b1f6-12db-475b-9c3e-f9fbb0503dd3 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] [instance: 5c81c9a3-8ba0-4573-a3e8-68292edc1ae2] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:34.799003 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e848b1f6-12db-475b-9c3e-f9fbb0503dd3 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:34.804654 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e848b1f6-12db-475b-9c3e-f9fbb0503dd3 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:34.804654 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e848b1f6-12db-475b-9c3e-f9fbb0503dd3 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:34.804654 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e848b1f6-12db-475b-9c3e-f9fbb0503dd3 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:34.804654 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e848b1f6-12db-475b-9c3e-f9fbb0503dd3 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:34.804654 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e848b1f6-12db-475b-9c3e-f9fbb0503dd3 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:34.997764 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-00041e15-00e7-4eda-a231-d4ab1b8e7abc tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:34.999064 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-00041e15-00e7-4eda-a231-d4ab1b8e7abc tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:35.022487 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00041e15-00e7-4eda-a231-d4ab1b8e7abc tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:35.023146 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00041e15-00e7-4eda-a231-d4ab1b8e7abc tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:35.023940 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00041e15-00e7-4eda-a231-d4ab1b8e7abc tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:35.025314 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00041e15-00e7-4eda-a231-d4ab1b8e7abc tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:35.026445 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00041e15-00e7-4eda-a231-d4ab1b8e7abc tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:35.027478 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00041e15-00e7-4eda-a231-d4ab1b8e7abc tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:35.840584 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=4 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:05:35.897359 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e848b1f6-12db-475b-9c3e-f9fbb0503dd3 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae96c057d884eafb9c2032dd5db9e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a33aeb63a416a9d046e2b67b93f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:35.907563 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e848b1f6-12db-475b-9c3e-f9fbb0503dd3 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/servers/5c81c9a3-8ba0-4573-a3e8-68292edc1ae2" status: 200 len: 1317 microversion: 2.1 time: 1.134814 Aug 31 16:05:35.918628 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1653/3206] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:34 2022] GET /compute/v2.1/servers/5c81c9a3-8ba0-4573-a3e8-68292edc1ae2 => generated 1317 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:36.031447 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-00041e15-00e7-4eda-a231-d4ab1b8e7abc tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:36.048717 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-00041e15-00e7-4eda-a231-d4ab1b8e7abc tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc" status: 200 len: 1717 microversion: 2.1 time: 1.056072 Aug 31 16:05:36.050023 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1554/3207] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:34 2022] GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc => generated 1717 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:36.451843 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-bc9c999d-f876-4ea0-8060-8cb27b5f89ac req-d356cf0b-1f31-404d-999e-69e7ec0add64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c81c9a3-8ba0-4573-a3e8-68292edc1ae2", "tag": "fe966be1-351a-44fb-bfbd-7233088e6030"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:05:36.463084 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=14 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:05:36.464967 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:05:36.492892 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-bc9c999d-f876-4ea0-8060-8cb27b5f89ac req-d356cf0b-1f31-404d-999e-69e7ec0add64 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:36.493859 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-bc9c999d-f876-4ea0-8060-8cb27b5f89ac req-d356cf0b-1f31-404d-999e-69e7ec0add64 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:36.495508 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-bc9c999d-f876-4ea0-8060-8cb27b5f89ac req-d356cf0b-1f31-404d-999e-69e7ec0add64 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:36.532377 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-bc9c999d-f876-4ea0-8060-8cb27b5f89ac req-d356cf0b-1f31-404d-999e-69e7ec0add64 service nova] Creating event network-changed:fe966be1-351a-44fb-bfbd-7233088e6030 for instance 5c81c9a3-8ba0-4573-a3e8-68292edc1ae2 on n-h2-833090-16 Aug 31 16:05:36.547200 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-bc9c999d-f876-4ea0-8060-8cb27b5f89ac req-d356cf0b-1f31-404d-999e-69e7ec0add64 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100662 Aug 31 16:05:36.548645 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1654/3208] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:05:36.943083 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-118b7bd2-6332-472d-85ef-60802b451a87 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:36.953411 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-118b7bd2-6332-472d-85ef-60802b451a87 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] [instance: 5c81c9a3-8ba0-4573-a3e8-68292edc1ae2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:36.985130 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-118b7bd2-6332-472d-85ef-60802b451a87 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:36.987434 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-118b7bd2-6332-472d-85ef-60802b451a87 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:37.012246 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-118b7bd2-6332-472d-85ef-60802b451a87 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:37.019114 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-118b7bd2-6332-472d-85ef-60802b451a87 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:37.020270 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-118b7bd2-6332-472d-85ef-60802b451a87 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:37.025967 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-118b7bd2-6332-472d-85ef-60802b451a87 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:37.137586 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-693473ac-9f4a-4390-9586-0109eb9f3bb5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:37.141153 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-693473ac-9f4a-4390-9586-0109eb9f3bb5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:37.180916 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-693473ac-9f4a-4390-9586-0109eb9f3bb5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:37.182907 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-693473ac-9f4a-4390-9586-0109eb9f3bb5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:37.183651 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-693473ac-9f4a-4390-9586-0109eb9f3bb5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:37.184930 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-693473ac-9f4a-4390-9586-0109eb9f3bb5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:37.185778 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-693473ac-9f4a-4390-9586-0109eb9f3bb5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:37.187512 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-693473ac-9f4a-4390-9586-0109eb9f3bb5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:37.523709 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:05:38.105823 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-693473ac-9f4a-4390-9586-0109eb9f3bb5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:38.124536 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-693473ac-9f4a-4390-9586-0109eb9f3bb5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc" status: 200 len: 1717 microversion: 2.1 time: 1.045179 Aug 31 16:05:38.125174 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1655/3209] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:37 2022] GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc => generated 1717 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:38.403096 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-118b7bd2-6332-472d-85ef-60802b451a87 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae96c057d884eafb9c2032dd5db9e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a33aeb63a416a9d046e2b67b93f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:38.433344 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-118b7bd2-6332-472d-85ef-60802b451a87 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/servers/5c81c9a3-8ba0-4573-a3e8-68292edc1ae2" status: 200 len: 1317 microversion: 2.1 time: 1.500560 Aug 31 16:05:38.437715 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1555/3210] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:36 2022] GET /compute/v2.1/servers/5c81c9a3-8ba0-4573-a3e8-68292edc1ae2 => generated 1317 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:39.159238 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-daba122f-3283-483c-b127-3c4241b475cb tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:39.160845 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-daba122f-3283-483c-b127-3c4241b475cb tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:39.191569 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-daba122f-3283-483c-b127-3c4241b475cb tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:39.199025 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-daba122f-3283-483c-b127-3c4241b475cb tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:39.199931 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-daba122f-3283-483c-b127-3c4241b475cb tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:39.205534 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-daba122f-3283-483c-b127-3c4241b475cb tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:39.206971 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-daba122f-3283-483c-b127-3c4241b475cb tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:39.212081 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-daba122f-3283-483c-b127-3c4241b475cb tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:39.477096 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f1db944c-49d4-4c7d-a3ec-93c79a8f9f27 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:39.477875 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f1db944c-49d4-4c7d-a3ec-93c79a8f9f27 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] [instance: 5c81c9a3-8ba0-4573-a3e8-68292edc1ae2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:39.507582 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f1db944c-49d4-4c7d-a3ec-93c79a8f9f27 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:39.508219 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f1db944c-49d4-4c7d-a3ec-93c79a8f9f27 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:39.508646 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f1db944c-49d4-4c7d-a3ec-93c79a8f9f27 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:39.509575 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f1db944c-49d4-4c7d-a3ec-93c79a8f9f27 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:39.510215 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f1db944c-49d4-4c7d-a3ec-93c79a8f9f27 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:39.510892 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f1db944c-49d4-4c7d-a3ec-93c79a8f9f27 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:39.883990 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-daba122f-3283-483c-b127-3c4241b475cb tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:39.909639 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-daba122f-3283-483c-b127-3c4241b475cb tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc" status: 200 len: 1717 microversion: 2.1 time: 0.756237 Aug 31 16:05:39.910275 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1656/3211] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:39 2022] GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc => generated 1717 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:40.263991 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f1db944c-49d4-4c7d-a3ec-93c79a8f9f27 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae96c057d884eafb9c2032dd5db9e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a33aeb63a416a9d046e2b67b93f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:40.285081 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f1db944c-49d4-4c7d-a3ec-93c79a8f9f27 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/servers/5c81c9a3-8ba0-4573-a3e8-68292edc1ae2" status: 200 len: 1317 microversion: 2.1 time: 0.811992 Aug 31 16:05:40.296306 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1556/3212] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:39 2022] GET /compute/v2.1/servers/5c81c9a3-8ba0-4573-a3e8-68292edc1ae2 => generated 1317 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:40.934242 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5b95d51a-2547-4d6e-b7aa-41e4d7ac6e8b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:40.935037 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5b95d51a-2547-4d6e-b7aa-41e4d7ac6e8b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:40.945388 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5b95d51a-2547-4d6e-b7aa-41e4d7ac6e8b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:40.945893 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5b95d51a-2547-4d6e-b7aa-41e4d7ac6e8b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:40.946351 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5b95d51a-2547-4d6e-b7aa-41e4d7ac6e8b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:40.951866 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5b95d51a-2547-4d6e-b7aa-41e4d7ac6e8b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:40.953376 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5b95d51a-2547-4d6e-b7aa-41e4d7ac6e8b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:40.955514 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5b95d51a-2547-4d6e-b7aa-41e4d7ac6e8b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:41.329572 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1dd84504-2fd6-4e19-a4cb-d26e05171dcb tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:41.330986 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1dd84504-2fd6-4e19-a4cb-d26e05171dcb tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] [instance: 5c81c9a3-8ba0-4573-a3e8-68292edc1ae2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:41.346263 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1dd84504-2fd6-4e19-a4cb-d26e05171dcb tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:41.353215 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1dd84504-2fd6-4e19-a4cb-d26e05171dcb tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:41.354253 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1dd84504-2fd6-4e19-a4cb-d26e05171dcb tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:41.356458 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1dd84504-2fd6-4e19-a4cb-d26e05171dcb tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:41.358328 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1dd84504-2fd6-4e19-a4cb-d26e05171dcb tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:41.360102 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1dd84504-2fd6-4e19-a4cb-d26e05171dcb tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:42.020132 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1dd84504-2fd6-4e19-a4cb-d26e05171dcb tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae96c057d884eafb9c2032dd5db9e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a33aeb63a416a9d046e2b67b93f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:42.049774 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1dd84504-2fd6-4e19-a4cb-d26e05171dcb tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/servers/5c81c9a3-8ba0-4573-a3e8-68292edc1ae2" status: 200 len: 1317 microversion: 2.1 time: 0.724296 Aug 31 16:05:42.052604 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1557/3213] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:41 2022] GET /compute/v2.1/servers/5c81c9a3-8ba0-4573-a3e8-68292edc1ae2 => generated 1317 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:05:42.067844 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5b95d51a-2547-4d6e-b7aa-41e4d7ac6e8b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:42.120463 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=86 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:05:42.135207 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5b95d51a-2547-4d6e-b7aa-41e4d7ac6e8b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc" status: 200 len: 1717 microversion: 2.1 time: 1.202842 Aug 31 16:05:42.151650 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1657/3214] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:40 2022] GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc => generated 1717 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:42.809631 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-77d37962-694c-4ea5-8bdb-d07a78fb25d1 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-2068024901", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "bc5dd7ee-3e97-48d0-a10a-a3fa7148126f"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:05:42.922650 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-77d37962-694c-4ea5-8bdb-d07a78fb25d1 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] validate_networks() for [('bc5dd7ee-3e97-48d0-a10a-a3fa7148126f', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:05:43.079036 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6f8b0545-5584-4d47-ae2f-dd432b0b666a tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:43.079759 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6f8b0545-5584-4d47-ae2f-dd432b0b666a tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] [instance: 5c81c9a3-8ba0-4573-a3e8-68292edc1ae2] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:43.103118 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f8b0545-5584-4d47-ae2f-dd432b0b666a tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:43.104848 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f8b0545-5584-4d47-ae2f-dd432b0b666a tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:43.110784 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f8b0545-5584-4d47-ae2f-dd432b0b666a tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:43.116884 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f8b0545-5584-4d47-ae2f-dd432b0b666a tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:43.121104 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f8b0545-5584-4d47-ae2f-dd432b0b666a tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:43.124130 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f8b0545-5584-4d47-ae2f-dd432b0b666a tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:43.690179 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6f8b0545-5584-4d47-ae2f-dd432b0b666a tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae96c057d884eafb9c2032dd5db9e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a33aeb63a416a9d046e2b67b93f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:43.708782 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6f8b0545-5584-4d47-ae2f-dd432b0b666a tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/servers/5c81c9a3-8ba0-4573-a3e8-68292edc1ae2" status: 200 len: 1317 microversion: 2.1 time: 0.635532 Aug 31 16:05:43.718856 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1658/3215] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:43 2022] GET /compute/v2.1/servers/5c81c9a3-8ba0-4573-a3e8-68292edc1ae2 => generated 1317 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:05:43.728127 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ef00beb6-af6c-4d4f-ab37-8655a2864f69 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:43.738884 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ef00beb6-af6c-4d4f-ab37-8655a2864f69 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:43.748312 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ef00beb6-af6c-4d4f-ab37-8655a2864f69 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:43.748841 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ef00beb6-af6c-4d4f-ab37-8655a2864f69 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:43.749688 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ef00beb6-af6c-4d4f-ab37-8655a2864f69 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:43.750767 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ef00beb6-af6c-4d4f-ab37-8655a2864f69 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:43.751247 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ef00beb6-af6c-4d4f-ab37-8655a2864f69 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:43.752009 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ef00beb6-af6c-4d4f-ab37-8655a2864f69 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:44.244001 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ef00beb6-af6c-4d4f-ab37-8655a2864f69 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:44.270069 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ef00beb6-af6c-4d4f-ab37-8655a2864f69 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc" status: 200 len: 1707 microversion: 2.1 time: 0.549102 Aug 31 16:05:44.271037 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1659/3216] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:43 2022] GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc => generated 1707 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:44.306940 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a911584c-8d32-4890-ab15-97d0b28f46ba tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Calling method '.version_select at 0x7fbb46d5e8b0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:44.322520 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a911584c-8d32-4890-ab15-97d0b28f46ba tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:44.328194 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a911584c-8d32-4890-ab15-97d0b28f46ba tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:44.329247 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a911584c-8d32-4890-ab15-97d0b28f46ba tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:44.373915 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a911584c-8d32-4890-ab15-97d0b28f46ba tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] 10.222.0.50 "GET /compute/v2.1/os-migrations" status: 200 len: 1182 microversion: 2.1 time: 0.067293 Aug 31 16:05:44.385601 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1660/3217] 10.222.0.50 () {58 vars in 1143 bytes} [Wed Aug 31 16:05:44 2022] GET /compute/v2.1/os-migrations => generated 1182 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:05:44.393563 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-523fdb3a-cf45-484a-99d9-9fbc731a5561 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:44.395021 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-523fdb3a-cf45-484a-99d9-9fbc731a5561 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:44.415634 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-523fdb3a-cf45-484a-99d9-9fbc731a5561 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:44.416318 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-523fdb3a-cf45-484a-99d9-9fbc731a5561 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:44.416883 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-523fdb3a-cf45-484a-99d9-9fbc731a5561 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:44.417754 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-523fdb3a-cf45-484a-99d9-9fbc731a5561 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:44.418407 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-523fdb3a-cf45-484a-99d9-9fbc731a5561 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:44.418953 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-523fdb3a-cf45-484a-99d9-9fbc731a5561 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:44.610692 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-77d37962-694c-4ea5-8bdb-d07a78fb25d1 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:05:44.613527 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-77d37962-694c-4ea5-8bdb-d07a78fb25d1 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:05:44.614756 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-77d37962-694c-4ea5-8bdb-d07a78fb25d1 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:05:44.616449 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-77d37962-694c-4ea5-8bdb-d07a78fb25d1 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:05:44.619657 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-77d37962-694c-4ea5-8bdb-d07a78fb25d1 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:05:44.651164 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-77d37962-694c-4ea5-8bdb-d07a78fb25d1 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:44.652798 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-77d37962-694c-4ea5-8bdb-d07a78fb25d1 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:44.655291 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-77d37962-694c-4ea5-8bdb-d07a78fb25d1 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:44.659398 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-77d37962-694c-4ea5-8bdb-d07a78fb25d1 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:44.662975 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-77d37962-694c-4ea5-8bdb-d07a78fb25d1 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:44.665373 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-77d37962-694c-4ea5-8bdb-d07a78fb25d1 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:44.707997 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-77d37962-694c-4ea5-8bdb-d07a78fb25d1 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Getting quotas for project d6c6ed5ff0f44dd1a70b4d568b3b9e3a. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:05:44.714943 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-523fdb3a-cf45-484a-99d9-9fbc731a5561 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc" status: 200 len: 1860 microversion: 2.1 time: 0.325988 Aug 31 16:05:44.717131 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1661/3218] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:44 2022] GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc => generated 1860 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:44.725073 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-77d37962-694c-4ea5-8bdb-d07a78fb25d1 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Getting quotas for user 6460603c59ec4751bd6cb557bb8c458c and project d6c6ed5ff0f44dd1a70b4d568b3b9e3a. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:05:44.744014 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-31ba7368-ea1d-485d-a74d-156b2bc9eaa9 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:44.744658 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-31ba7368-ea1d-485d-a74d-156b2bc9eaa9 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:44.746742 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-77d37962-694c-4ea5-8bdb-d07a78fb25d1 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:05:44.752513 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-77d37962-694c-4ea5-8bdb-d07a78fb25d1 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] [instance: ef734c11-5fd1-4179-9dc2-8976812d7715] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:05:44.765435 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-31ba7368-ea1d-485d-a74d-156b2bc9eaa9 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:44.766151 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-31ba7368-ea1d-485d-a74d-156b2bc9eaa9 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:44.766786 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-31ba7368-ea1d-485d-a74d-156b2bc9eaa9 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:44.767885 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-31ba7368-ea1d-485d-a74d-156b2bc9eaa9 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:44.768342 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-31ba7368-ea1d-485d-a74d-156b2bc9eaa9 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:44.771582 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-31ba7368-ea1d-485d-a74d-156b2bc9eaa9 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:44.836331 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-77d37962-694c-4ea5-8bdb-d07a78fb25d1 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.479896 Aug 31 16:05:44.837932 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1558/3219] 10.222.0.50 () {62 vars in 1188 bytes} [Wed Aug 31 16:05:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2489 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 31 16:05:44.843347 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6af73856-af9e-4025-b3a9-2cb11e610238 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:44.844529 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6af73856-af9e-4025-b3a9-2cb11e610238 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] [instance: 5c81c9a3-8ba0-4573-a3e8-68292edc1ae2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:44.853640 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6af73856-af9e-4025-b3a9-2cb11e610238 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:44.855097 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6af73856-af9e-4025-b3a9-2cb11e610238 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:44.855908 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6af73856-af9e-4025-b3a9-2cb11e610238 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:44.857190 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6af73856-af9e-4025-b3a9-2cb11e610238 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:44.858782 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6af73856-af9e-4025-b3a9-2cb11e610238 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:44.859614 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6af73856-af9e-4025-b3a9-2cb11e610238 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:45.325934 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-31ba7368-ea1d-485d-a74d-156b2bc9eaa9 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc" status: 200 len: 1860 microversion: 2.1 time: 0.583731 Aug 31 16:05:45.345827 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1662/3220] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:44 2022] GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc => generated 1860 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:05:45.379398 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4e219016-842b-498b-86fb-23a9835196dd tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:45.382282 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4e219016-842b-498b-86fb-23a9835196dd tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] [instance: ef734c11-5fd1-4179-9dc2-8976812d7715] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:45.455736 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6af73856-af9e-4025-b3a9-2cb11e610238 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae96c057d884eafb9c2032dd5db9e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a33aeb63a416a9d046e2b67b93f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:45.488130 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6af73856-af9e-4025-b3a9-2cb11e610238 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/servers/5c81c9a3-8ba0-4573-a3e8-68292edc1ae2" status: 200 len: 1317 microversion: 2.1 time: 0.648264 Aug 31 16:05:45.510992 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1559/3221] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:44 2022] GET /compute/v2.1/servers/5c81c9a3-8ba0-4573-a3e8-68292edc1ae2 => generated 1317 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:45.525841 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-720e3d95-6d1c-4a10-b138-b0feb4925b96 req-b7c54d6e-a495-4b43-a099-3d73ba6c613e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3255935-3cff-4bb0-aad2-a8f401028a59", "name": "network-vif-plugged", "status": "completed", "tag": "21dd4917-2780-427e-86cb-ca75980a35b5"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:05:45.575590 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-720e3d95-6d1c-4a10-b138-b0feb4925b96 req-b7c54d6e-a495-4b43-a099-3d73ba6c613e service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:45.576158 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-720e3d95-6d1c-4a10-b138-b0feb4925b96 req-b7c54d6e-a495-4b43-a099-3d73ba6c613e service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:45.586133 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-720e3d95-6d1c-4a10-b138-b0feb4925b96 req-b7c54d6e-a495-4b43-a099-3d73ba6c613e service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:45.607024 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4e219016-842b-498b-86fb-23a9835196dd tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6460603c59ec4751bd6cb557bb8c458c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c6ed5ff0f44dd1a70b4d568b3b9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:45.620208 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4e219016-842b-498b-86fb-23a9835196dd tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6460603c59ec4751bd6cb557bb8c458c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c6ed5ff0f44dd1a70b4d568b3b9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:45.621656 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4e219016-842b-498b-86fb-23a9835196dd tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6460603c59ec4751bd6cb557bb8c458c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c6ed5ff0f44dd1a70b4d568b3b9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:45.622821 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4e219016-842b-498b-86fb-23a9835196dd tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] 10.222.0.50 "GET /compute/v2.1/servers/ef734c11-5fd1-4179-9dc2-8976812d7715" status: 200 len: 1259 microversion: 2.21 time: 0.275316 Aug 31 16:05:45.623377 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1663/3222] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:05:45 2022] GET /compute/v2.1/servers/ef734c11-5fd1-4179-9dc2-8976812d7715 => generated 1259 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:05:45.644368 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e450f5c0-253a-44c7-bb38-6f02eb9352d5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:45.645082 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e450f5c0-253a-44c7-bb38-6f02eb9352d5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:45.650399 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-720e3d95-6d1c-4a10-b138-b0feb4925b96 req-b7c54d6e-a495-4b43-a099-3d73ba6c613e service nova] Creating event network-vif-plugged:21dd4917-2780-427e-86cb-ca75980a35b5 for instance d3255935-3cff-4bb0-aad2-a8f401028a59 on n-h2-833090-16 Aug 31 16:05:45.653168 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e450f5c0-253a-44c7-bb38-6f02eb9352d5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:45.654383 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e450f5c0-253a-44c7-bb38-6f02eb9352d5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:45.655114 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e450f5c0-253a-44c7-bb38-6f02eb9352d5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:45.656084 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e450f5c0-253a-44c7-bb38-6f02eb9352d5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:45.656694 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e450f5c0-253a-44c7-bb38-6f02eb9352d5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:45.657269 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e450f5c0-253a-44c7-bb38-6f02eb9352d5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:45.674422 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-720e3d95-6d1c-4a10-b138-b0feb4925b96 req-b7c54d6e-a495-4b43-a099-3d73ba6c613e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171266 Aug 31 16:05:45.684279 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1560/3223] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:05:46.137906 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-e450f5c0-253a-44c7-bb38-6f02eb9352d5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lazy-loading 'services' on Instance uuid 027ef860-8ede-472c-9099-befdc2cde7bc {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:05:46.479212 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e450f5c0-253a-44c7-bb38-6f02eb9352d5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "DELETE /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc/os-volume_attachments/bb35befd-ac43-4726-b646-26dccee9305d" status: 202 len: 0 microversion: 2.1 time: 0.837480 Aug 31 16:05:46.497218 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1664/3224] 10.222.0.50 () {58 vars in 1416 bytes} [Wed Aug 31 16:05:45 2022] DELETE /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc/os-volume_attachments/bb35befd-ac43-4726-b646-26dccee9305d => generated 0 bytes in 858 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:05:46.526538 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3d7316b8-15e3-4a1b-8403-6dab7d9de2ad tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:46.532716 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3d7316b8-15e3-4a1b-8403-6dab7d9de2ad tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:46.543195 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c180ae83-aed4-4bd9-a2e4-a2a1054abb30 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:46.548342 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c180ae83-aed4-4bd9-a2e4-a2a1054abb30 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] [instance: 5c81c9a3-8ba0-4573-a3e8-68292edc1ae2] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:46.557327 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d7316b8-15e3-4a1b-8403-6dab7d9de2ad tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:46.559112 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d7316b8-15e3-4a1b-8403-6dab7d9de2ad tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:46.560823 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d7316b8-15e3-4a1b-8403-6dab7d9de2ad tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:46.562685 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d7316b8-15e3-4a1b-8403-6dab7d9de2ad tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:46.566673 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d7316b8-15e3-4a1b-8403-6dab7d9de2ad tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:46.572413 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d7316b8-15e3-4a1b-8403-6dab7d9de2ad tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:46.573552 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c180ae83-aed4-4bd9-a2e4-a2a1054abb30 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:46.577973 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c180ae83-aed4-4bd9-a2e4-a2a1054abb30 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:46.580188 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c180ae83-aed4-4bd9-a2e4-a2a1054abb30 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:46.584453 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c180ae83-aed4-4bd9-a2e4-a2a1054abb30 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:46.590339 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c180ae83-aed4-4bd9-a2e4-a2a1054abb30 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:46.594356 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c180ae83-aed4-4bd9-a2e4-a2a1054abb30 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:46.761785 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3d7316b8-15e3-4a1b-8403-6dab7d9de2ad tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.257722 Aug 31 16:05:46.762892 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1561/3225] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:05:46 2022] GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc/os-volume_attachments => generated 197 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:05:46.810929 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-56cd16ae-fbf6-4a63-a1bd-db8a7c8b5a3d tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:46.821910 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-56cd16ae-fbf6-4a63-a1bd-db8a7c8b5a3d tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] [instance: ef734c11-5fd1-4179-9dc2-8976812d7715] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:46.853060 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56cd16ae-fbf6-4a63-a1bd-db8a7c8b5a3d tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:46.853574 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56cd16ae-fbf6-4a63-a1bd-db8a7c8b5a3d tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:46.854364 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56cd16ae-fbf6-4a63-a1bd-db8a7c8b5a3d tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:46.855747 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56cd16ae-fbf6-4a63-a1bd-db8a7c8b5a3d tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:46.863081 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56cd16ae-fbf6-4a63-a1bd-db8a7c8b5a3d tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:46.864062 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56cd16ae-fbf6-4a63-a1bd-db8a7c8b5a3d tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:47.146665 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-56cd16ae-fbf6-4a63-a1bd-db8a7c8b5a3d tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6460603c59ec4751bd6cb557bb8c458c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c6ed5ff0f44dd1a70b4d568b3b9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:47.165180 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-56cd16ae-fbf6-4a63-a1bd-db8a7c8b5a3d tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6460603c59ec4751bd6cb557bb8c458c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c6ed5ff0f44dd1a70b4d568b3b9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:47.167218 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-56cd16ae-fbf6-4a63-a1bd-db8a7c8b5a3d tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6460603c59ec4751bd6cb557bb8c458c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c6ed5ff0f44dd1a70b4d568b3b9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:47.173627 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-56cd16ae-fbf6-4a63-a1bd-db8a7c8b5a3d tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] 10.222.0.50 "GET /compute/v2.1/servers/ef734c11-5fd1-4179-9dc2-8976812d7715" status: 200 len: 1311 microversion: 2.21 time: 0.388851 Aug 31 16:05:47.193746 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1562/3226] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:05:46 2022] GET /compute/v2.1/servers/ef734c11-5fd1-4179-9dc2-8976812d7715 => generated 1311 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:05:47.325830 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c180ae83-aed4-4bd9-a2e4-a2a1054abb30 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae96c057d884eafb9c2032dd5db9e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a33aeb63a416a9d046e2b67b93f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:47.340496 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c180ae83-aed4-4bd9-a2e4-a2a1054abb30 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/servers/5c81c9a3-8ba0-4573-a3e8-68292edc1ae2" status: 200 len: 1317 microversion: 2.1 time: 0.821342 Aug 31 16:05:47.342132 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1665/3227] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:46 2022] GET /compute/v2.1/servers/5c81c9a3-8ba0-4573-a3e8-68292edc1ae2 => generated 1317 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:47.782398 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-403caed6-56a9-4cd5-a313-54df1682a09f tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:47.791761 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-403caed6-56a9-4cd5-a313-54df1682a09f tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:47.832198 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-403caed6-56a9-4cd5-a313-54df1682a09f tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:47.833657 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-403caed6-56a9-4cd5-a313-54df1682a09f tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:47.834770 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-403caed6-56a9-4cd5-a313-54df1682a09f tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:47.840917 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-403caed6-56a9-4cd5-a313-54df1682a09f tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:47.843099 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-403caed6-56a9-4cd5-a313-54df1682a09f tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:47.843872 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-403caed6-56a9-4cd5-a313-54df1682a09f tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:47.921790 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-403caed6-56a9-4cd5-a313-54df1682a09f tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147416 Aug 31 16:05:47.924682 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1563/3228] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:05:47 2022] GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:05:48.215019 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d5e41d5d-c1ca-4aef-baf1-4d82bbe59e06 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:48.217622 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d5e41d5d-c1ca-4aef-baf1-4d82bbe59e06 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] [instance: ef734c11-5fd1-4179-9dc2-8976812d7715] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:48.264128 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d5e41d5d-c1ca-4aef-baf1-4d82bbe59e06 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:48.264883 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d5e41d5d-c1ca-4aef-baf1-4d82bbe59e06 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:48.265653 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d5e41d5d-c1ca-4aef-baf1-4d82bbe59e06 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:48.272694 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d5e41d5d-c1ca-4aef-baf1-4d82bbe59e06 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:48.273580 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d5e41d5d-c1ca-4aef-baf1-4d82bbe59e06 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:48.289410 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d5e41d5d-c1ca-4aef-baf1-4d82bbe59e06 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:48.377935 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1432cb36-3c68-40ce-a9c8-3db4304d8cfd tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:48.378963 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1432cb36-3c68-40ce-a9c8-3db4304d8cfd tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] [instance: 5c81c9a3-8ba0-4573-a3e8-68292edc1ae2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:48.403167 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1432cb36-3c68-40ce-a9c8-3db4304d8cfd tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:48.403842 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1432cb36-3c68-40ce-a9c8-3db4304d8cfd tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:48.408253 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1432cb36-3c68-40ce-a9c8-3db4304d8cfd tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:48.412074 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1432cb36-3c68-40ce-a9c8-3db4304d8cfd tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:48.416992 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1432cb36-3c68-40ce-a9c8-3db4304d8cfd tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:48.417562 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1432cb36-3c68-40ce-a9c8-3db4304d8cfd tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:48.855862 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d5e41d5d-c1ca-4aef-baf1-4d82bbe59e06 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6460603c59ec4751bd6cb557bb8c458c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c6ed5ff0f44dd1a70b4d568b3b9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:48.873910 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d5e41d5d-c1ca-4aef-baf1-4d82bbe59e06 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6460603c59ec4751bd6cb557bb8c458c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c6ed5ff0f44dd1a70b4d568b3b9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:48.878559 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d5e41d5d-c1ca-4aef-baf1-4d82bbe59e06 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6460603c59ec4751bd6cb557bb8c458c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c6ed5ff0f44dd1a70b4d568b3b9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:48.884536 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d5e41d5d-c1ca-4aef-baf1-4d82bbe59e06 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] 10.222.0.50 "GET /compute/v2.1/servers/ef734c11-5fd1-4179-9dc2-8976812d7715" status: 200 len: 1329 microversion: 2.21 time: 0.684083 Aug 31 16:05:48.889181 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1666/3229] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:05:48 2022] GET /compute/v2.1/servers/ef734c11-5fd1-4179-9dc2-8976812d7715 => generated 1329 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:05:48.949460 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5b5d5981-f02f-47e5-bbba-8f8fb5027210 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:48.960753 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5b5d5981-f02f-47e5-bbba-8f8fb5027210 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:48.996956 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5b5d5981-f02f-47e5-bbba-8f8fb5027210 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:48.997634 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5b5d5981-f02f-47e5-bbba-8f8fb5027210 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:49.002531 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5b5d5981-f02f-47e5-bbba-8f8fb5027210 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:49.003434 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5b5d5981-f02f-47e5-bbba-8f8fb5027210 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:49.003906 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5b5d5981-f02f-47e5-bbba-8f8fb5027210 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:49.007744 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5b5d5981-f02f-47e5-bbba-8f8fb5027210 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:49.108476 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5b5d5981-f02f-47e5-bbba-8f8fb5027210 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.172438 Aug 31 16:05:49.110659 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1667/3230] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:05:48 2022] GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc/os-volume_attachments => generated 197 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:05:49.217023 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1432cb36-3c68-40ce-a9c8-3db4304d8cfd tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae96c057d884eafb9c2032dd5db9e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a33aeb63a416a9d046e2b67b93f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:49.232468 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1432cb36-3c68-40ce-a9c8-3db4304d8cfd tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/servers/5c81c9a3-8ba0-4573-a3e8-68292edc1ae2" status: 200 len: 1317 microversion: 2.1 time: 0.867899 Aug 31 16:05:49.239114 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1564/3231] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:48 2022] GET /compute/v2.1/servers/5c81c9a3-8ba0-4573-a3e8-68292edc1ae2 => generated 1317 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:49.923709 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-20320f09-16b8-4ddb-9e15-cc52b1944777 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:49.924437 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-20320f09-16b8-4ddb-9e15-cc52b1944777 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] [instance: ef734c11-5fd1-4179-9dc2-8976812d7715] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:49.935419 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-20320f09-16b8-4ddb-9e15-cc52b1944777 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:49.936183 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-20320f09-16b8-4ddb-9e15-cc52b1944777 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:49.936814 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-20320f09-16b8-4ddb-9e15-cc52b1944777 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:49.937842 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-20320f09-16b8-4ddb-9e15-cc52b1944777 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:49.938610 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-20320f09-16b8-4ddb-9e15-cc52b1944777 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:49.939460 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-20320f09-16b8-4ddb-9e15-cc52b1944777 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:50.113360 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-20320f09-16b8-4ddb-9e15-cc52b1944777 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6460603c59ec4751bd6cb557bb8c458c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c6ed5ff0f44dd1a70b4d568b3b9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:50.125338 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ee9a5c0e-44f7-4122-b4ec-ca783eccc6b9 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:50.126262 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-20320f09-16b8-4ddb-9e15-cc52b1944777 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6460603c59ec4751bd6cb557bb8c458c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c6ed5ff0f44dd1a70b4d568b3b9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:50.128969 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-20320f09-16b8-4ddb-9e15-cc52b1944777 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6460603c59ec4751bd6cb557bb8c458c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c6ed5ff0f44dd1a70b4d568b3b9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:50.129808 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ee9a5c0e-44f7-4122-b4ec-ca783eccc6b9 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:50.132587 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-20320f09-16b8-4ddb-9e15-cc52b1944777 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] 10.222.0.50 "GET /compute/v2.1/servers/ef734c11-5fd1-4179-9dc2-8976812d7715" status: 200 len: 1317 microversion: 2.21 time: 0.211748 Aug 31 16:05:50.135639 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1668/3232] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:05:49 2022] GET /compute/v2.1/servers/ef734c11-5fd1-4179-9dc2-8976812d7715 => generated 1317 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:05:50.168220 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee9a5c0e-44f7-4122-b4ec-ca783eccc6b9 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:50.168976 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee9a5c0e-44f7-4122-b4ec-ca783eccc6b9 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:50.169573 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee9a5c0e-44f7-4122-b4ec-ca783eccc6b9 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:50.170500 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee9a5c0e-44f7-4122-b4ec-ca783eccc6b9 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:50.171127 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee9a5c0e-44f7-4122-b4ec-ca783eccc6b9 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:50.172239 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee9a5c0e-44f7-4122-b4ec-ca783eccc6b9 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:50.277445 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-35412092-433d-4cbf-b1d0-47dc3816be8f tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:50.278575 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-35412092-433d-4cbf-b1d0-47dc3816be8f tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] [instance: 5c81c9a3-8ba0-4573-a3e8-68292edc1ae2] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:50.293853 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ee9a5c0e-44f7-4122-b4ec-ca783eccc6b9 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.174241 Aug 31 16:05:50.298450 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1565/3233] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:05:50 2022] GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc/os-volume_attachments => generated 197 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:05:50.299465 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-35412092-433d-4cbf-b1d0-47dc3816be8f tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:50.300050 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-35412092-433d-4cbf-b1d0-47dc3816be8f tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:50.301089 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-35412092-433d-4cbf-b1d0-47dc3816be8f tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:50.301244 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-35412092-433d-4cbf-b1d0-47dc3816be8f tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:50.301607 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-35412092-433d-4cbf-b1d0-47dc3816be8f tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:50.302026 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-35412092-433d-4cbf-b1d0-47dc3816be8f tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:50.677956 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-35412092-433d-4cbf-b1d0-47dc3816be8f tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae96c057d884eafb9c2032dd5db9e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a33aeb63a416a9d046e2b67b93f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:50.690295 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-35412092-433d-4cbf-b1d0-47dc3816be8f tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/servers/5c81c9a3-8ba0-4573-a3e8-68292edc1ae2" status: 200 len: 1317 microversion: 2.1 time: 0.418035 Aug 31 16:05:50.692659 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1669/3234] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:50 2022] GET /compute/v2.1/servers/5c81c9a3-8ba0-4573-a3e8-68292edc1ae2 => generated 1317 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:05:51.163634 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f1227b66-b478-4cf2-97d5-7cf60865ab07 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:51.164741 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f1227b66-b478-4cf2-97d5-7cf60865ab07 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] [instance: ef734c11-5fd1-4179-9dc2-8976812d7715] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:51.188482 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f1227b66-b478-4cf2-97d5-7cf60865ab07 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:51.195904 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f1227b66-b478-4cf2-97d5-7cf60865ab07 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:51.197426 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f1227b66-b478-4cf2-97d5-7cf60865ab07 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:51.209034 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f1227b66-b478-4cf2-97d5-7cf60865ab07 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:51.209905 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f1227b66-b478-4cf2-97d5-7cf60865ab07 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:51.211972 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f1227b66-b478-4cf2-97d5-7cf60865ab07 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:51.321903 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-836a08b0-6521-471d-80ce-2ec05e49072b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:51.333964 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-836a08b0-6521-471d-80ce-2ec05e49072b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:51.395873 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-836a08b0-6521-471d-80ce-2ec05e49072b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:51.397220 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-836a08b0-6521-471d-80ce-2ec05e49072b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:51.399868 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-836a08b0-6521-471d-80ce-2ec05e49072b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:51.419930 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-836a08b0-6521-471d-80ce-2ec05e49072b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:51.420946 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-836a08b0-6521-471d-80ce-2ec05e49072b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:51.421691 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-836a08b0-6521-471d-80ce-2ec05e49072b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:51.530364 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-836a08b0-6521-471d-80ce-2ec05e49072b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.220481 Aug 31 16:05:51.539421 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1670/3235] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:05:51 2022] GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc/os-volume_attachments => generated 197 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:05:51.545071 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8bce5451-a833-48ee-b8a9-02eb7b97a1b9 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:51.554050 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8bce5451-a833-48ee-b8a9-02eb7b97a1b9 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:51.591725 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8bce5451-a833-48ee-b8a9-02eb7b97a1b9 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:51.598373 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8bce5451-a833-48ee-b8a9-02eb7b97a1b9 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:51.601569 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8bce5451-a833-48ee-b8a9-02eb7b97a1b9 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:51.607401 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8bce5451-a833-48ee-b8a9-02eb7b97a1b9 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:51.609243 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8bce5451-a833-48ee-b8a9-02eb7b97a1b9 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:51.612162 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8bce5451-a833-48ee-b8a9-02eb7b97a1b9 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:52.047524 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f1227b66-b478-4cf2-97d5-7cf60865ab07 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6460603c59ec4751bd6cb557bb8c458c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c6ed5ff0f44dd1a70b4d568b3b9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:52.066337 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f1227b66-b478-4cf2-97d5-7cf60865ab07 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6460603c59ec4751bd6cb557bb8c458c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c6ed5ff0f44dd1a70b4d568b3b9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:52.068180 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f1227b66-b478-4cf2-97d5-7cf60865ab07 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6460603c59ec4751bd6cb557bb8c458c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c6ed5ff0f44dd1a70b4d568b3b9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:52.076261 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f1227b66-b478-4cf2-97d5-7cf60865ab07 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] 10.222.0.50 "GET /compute/v2.1/servers/ef734c11-5fd1-4179-9dc2-8976812d7715" status: 200 len: 1359 microversion: 2.21 time: 0.920763 Aug 31 16:05:52.080634 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1566/3236] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:05:51 2022] GET /compute/v2.1/servers/ef734c11-5fd1-4179-9dc2-8976812d7715 => generated 1359 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:05:52.096327 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-ab2d7410-bdb6-4d7b-ba37-126bcdddc7c3 req-fd3f26bb-5e8f-4115-aef5-d27291ff6444 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c81c9a3-8ba0-4573-a3e8-68292edc1ae2", "name": "network-vif-plugged", "status": "completed", "tag": "fe966be1-351a-44fb-bfbd-7233088e6030"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:05:52.142500 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ab2d7410-bdb6-4d7b-ba37-126bcdddc7c3 req-fd3f26bb-5e8f-4115-aef5-d27291ff6444 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:52.143804 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ab2d7410-bdb6-4d7b-ba37-126bcdddc7c3 req-fd3f26bb-5e8f-4115-aef5-d27291ff6444 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:52.144799 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ab2d7410-bdb6-4d7b-ba37-126bcdddc7c3 req-fd3f26bb-5e8f-4115-aef5-d27291ff6444 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:52.178153 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-ab2d7410-bdb6-4d7b-ba37-126bcdddc7c3 req-fd3f26bb-5e8f-4115-aef5-d27291ff6444 service nova] Creating event network-vif-plugged:fe966be1-351a-44fb-bfbd-7233088e6030 for instance 5c81c9a3-8ba0-4573-a3e8-68292edc1ae2 on n-h2-833090-16 Aug 31 16:05:52.189374 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-ab2d7410-bdb6-4d7b-ba37-126bcdddc7c3 req-fd3f26bb-5e8f-4115-aef5-d27291ff6444 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105402 Aug 31 16:05:52.191155 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1567/3237] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:05:52.213157 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-01947710-b3a4-4507-ac17-a196e3319fad tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:52.216946 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-01947710-b3a4-4507-ac17-a196e3319fad tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] [instance: 5c81c9a3-8ba0-4573-a3e8-68292edc1ae2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:52.266351 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01947710-b3a4-4507-ac17-a196e3319fad tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:52.267487 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01947710-b3a4-4507-ac17-a196e3319fad tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:52.268811 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01947710-b3a4-4507-ac17-a196e3319fad tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:52.274499 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01947710-b3a4-4507-ac17-a196e3319fad tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:52.275684 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01947710-b3a4-4507-ac17-a196e3319fad tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:52.280150 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01947710-b3a4-4507-ac17-a196e3319fad tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:52.430751 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8bce5451-a833-48ee-b8a9-02eb7b97a1b9 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:52.458904 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8bce5451-a833-48ee-b8a9-02eb7b97a1b9 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:52.462308 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8bce5451-a833-48ee-b8a9-02eb7b97a1b9 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:52.465832 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8bce5451-a833-48ee-b8a9-02eb7b97a1b9 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 2951 microversion: 2.32 time: 0.924661 Aug 31 16:05:52.467252 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1671/3238] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:05:51 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 2951 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:05:52.513155 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-04c775f5-bd3d-435b-bbeb-38b589d566fe tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:52.514541 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-04c775f5-bd3d-435b-bbeb-38b589d566fe tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:52.538928 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-04c775f5-bd3d-435b-bbeb-38b589d566fe tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:52.540347 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-04c775f5-bd3d-435b-bbeb-38b589d566fe tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:52.543796 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-04c775f5-bd3d-435b-bbeb-38b589d566fe tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:52.545368 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-04c775f5-bd3d-435b-bbeb-38b589d566fe tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:52.559376 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-04c775f5-bd3d-435b-bbeb-38b589d566fe tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:52.560626 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-04c775f5-bd3d-435b-bbeb-38b589d566fe tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:53.032974 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-04c775f5-bd3d-435b-bbeb-38b589d566fe tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.526611 Aug 31 16:05:53.034382 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1672/3239] 10.222.0.50 () {60 vars in 1316 bytes} [Wed Aug 31 16:05:52 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9/os-interface => generated 1832 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:05:53.080646 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-025e7841-2c30-4198-b08c-0b947c4da65f tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:53.093210 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-025e7841-2c30-4198-b08c-0b947c4da65f tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:53.131244 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-025e7841-2c30-4198-b08c-0b947c4da65f tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:53.134326 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-025e7841-2c30-4198-b08c-0b947c4da65f tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:53.137476 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-025e7841-2c30-4198-b08c-0b947c4da65f tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:53.141161 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-025e7841-2c30-4198-b08c-0b947c4da65f tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:53.147006 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-025e7841-2c30-4198-b08c-0b947c4da65f tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:53.149164 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-025e7841-2c30-4198-b08c-0b947c4da65f tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:53.161837 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-01947710-b3a4-4507-ac17-a196e3319fad tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae96c057d884eafb9c2032dd5db9e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a33aeb63a416a9d046e2b67b93f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:53.174603 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-01947710-b3a4-4507-ac17-a196e3319fad tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/servers/5c81c9a3-8ba0-4573-a3e8-68292edc1ae2" status: 200 len: 1317 microversion: 2.1 time: 0.981218 Aug 31 16:05:53.180398 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1568/3240] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:52 2022] GET /compute/v2.1/servers/5c81c9a3-8ba0-4573-a3e8-68292edc1ae2 => generated 1317 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:53.208721 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7fea2744-d25e-49c6-a791-c8644805990b tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:53.209904 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7fea2744-d25e-49c6-a791-c8644805990b tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] [instance: ef734c11-5fd1-4179-9dc2-8976812d7715] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:53.224782 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fea2744-d25e-49c6-a791-c8644805990b tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:53.228646 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fea2744-d25e-49c6-a791-c8644805990b tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:53.229933 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fea2744-d25e-49c6-a791-c8644805990b tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:53.234841 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fea2744-d25e-49c6-a791-c8644805990b tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:53.236112 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fea2744-d25e-49c6-a791-c8644805990b tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:53.236964 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fea2744-d25e-49c6-a791-c8644805990b tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:53.267082 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-025e7841-2c30-4198-b08c-0b947c4da65f tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.211280 Aug 31 16:05:53.267776 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1673/3241] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:05:53 2022] GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc/os-volume_attachments => generated 197 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:05:53.628888 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-11fdb630-1aeb-4938-a738-3da4c6fb8cfc req-1d871bf9-11ed-4a95-8ef4-8634e2010909 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef734c11-5fd1-4179-9dc2-8976812d7715", "tag": "1dd2652a-004c-4af2-8a03-f0fc9de3f292"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:05:53.673400 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-11fdb630-1aeb-4938-a738-3da4c6fb8cfc req-1d871bf9-11ed-4a95-8ef4-8634e2010909 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:53.673886 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-11fdb630-1aeb-4938-a738-3da4c6fb8cfc req-1d871bf9-11ed-4a95-8ef4-8634e2010909 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:53.674353 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-11fdb630-1aeb-4938-a738-3da4c6fb8cfc req-1d871bf9-11ed-4a95-8ef4-8634e2010909 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:53.709652 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-11fdb630-1aeb-4938-a738-3da4c6fb8cfc req-1d871bf9-11ed-4a95-8ef4-8634e2010909 service nova] Creating event network-changed:1dd2652a-004c-4af2-8a03-f0fc9de3f292 for instance ef734c11-5fd1-4179-9dc2-8976812d7715 on n-h1-833090-16 Aug 31 16:05:53.716908 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-11fdb630-1aeb-4938-a738-3da4c6fb8cfc req-1d871bf9-11ed-4a95-8ef4-8634e2010909 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.238349 Aug 31 16:05:53.720619 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1674/3242] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:05:54.021671 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7fea2744-d25e-49c6-a791-c8644805990b tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6460603c59ec4751bd6cb557bb8c458c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c6ed5ff0f44dd1a70b4d568b3b9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:54.052515 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7fea2744-d25e-49c6-a791-c8644805990b tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6460603c59ec4751bd6cb557bb8c458c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c6ed5ff0f44dd1a70b4d568b3b9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:54.062689 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7fea2744-d25e-49c6-a791-c8644805990b tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6460603c59ec4751bd6cb557bb8c458c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c6ed5ff0f44dd1a70b4d568b3b9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:54.080831 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7fea2744-d25e-49c6-a791-c8644805990b tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] 10.222.0.50 "GET /compute/v2.1/servers/ef734c11-5fd1-4179-9dc2-8976812d7715" status: 200 len: 1359 microversion: 2.21 time: 0.883618 Aug 31 16:05:54.085346 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1569/3243] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:05:53 2022] GET /compute/v2.1/servers/ef734c11-5fd1-4179-9dc2-8976812d7715 => generated 1359 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:05:54.224489 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ee5e1227-b29a-4d93-9759-9922af649236 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:54.225343 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ee5e1227-b29a-4d93-9759-9922af649236 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] [instance: 5c81c9a3-8ba0-4573-a3e8-68292edc1ae2] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:54.248612 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ee5e1227-b29a-4d93-9759-9922af649236 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:54.259461 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ee5e1227-b29a-4d93-9759-9922af649236 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:54.263863 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ee5e1227-b29a-4d93-9759-9922af649236 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:54.265280 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ee5e1227-b29a-4d93-9759-9922af649236 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:54.266377 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ee5e1227-b29a-4d93-9759-9922af649236 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:54.269426 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ee5e1227-b29a-4d93-9759-9922af649236 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:54.289972 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e0308692-1151-4a96-8be1-91274fe61f82 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:54.311378 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e0308692-1151-4a96-8be1-91274fe61f82 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:54.360814 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0308692-1151-4a96-8be1-91274fe61f82 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:54.377758 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0308692-1151-4a96-8be1-91274fe61f82 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:54.381041 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0308692-1151-4a96-8be1-91274fe61f82 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:54.385942 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0308692-1151-4a96-8be1-91274fe61f82 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:54.389251 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0308692-1151-4a96-8be1-91274fe61f82 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:54.390506 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0308692-1151-4a96-8be1-91274fe61f82 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:54.517974 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e0308692-1151-4a96-8be1-91274fe61f82 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.239082 Aug 31 16:05:54.521842 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1570/3244] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:05:54 2022] GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc/os-volume_attachments => generated 197 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:05:55.120408 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2dcaf1fc-2884-4092-9c09-ad331ce20a12 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:55.123602 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2dcaf1fc-2884-4092-9c09-ad331ce20a12 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] [instance: ef734c11-5fd1-4179-9dc2-8976812d7715] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:55.145860 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:05:55.149183 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:05:55.171925 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2dcaf1fc-2884-4092-9c09-ad331ce20a12 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:55.178855 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2dcaf1fc-2884-4092-9c09-ad331ce20a12 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:55.179671 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2dcaf1fc-2884-4092-9c09-ad331ce20a12 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:55.181356 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2dcaf1fc-2884-4092-9c09-ad331ce20a12 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:55.183484 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2dcaf1fc-2884-4092-9c09-ad331ce20a12 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:55.186796 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2dcaf1fc-2884-4092-9c09-ad331ce20a12 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:55.245618 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:05:55.592253 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ee5e1227-b29a-4d93-9759-9922af649236 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae96c057d884eafb9c2032dd5db9e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a33aeb63a416a9d046e2b67b93f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:55.611873 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:05:55.623447 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ee5e1227-b29a-4d93-9759-9922af649236 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/servers/5c81c9a3-8ba0-4573-a3e8-68292edc1ae2" status: 200 len: 1317 microversion: 2.1 time: 1.405221 Aug 31 16:05:55.630400 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1675/3245] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:54 2022] GET /compute/v2.1/servers/5c81c9a3-8ba0-4573-a3e8-68292edc1ae2 => generated 1317 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:55.654063 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-38eefbbe-7261-4ac3-a4ac-29187b49c398 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:55.670646 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-38eefbbe-7261-4ac3-a4ac-29187b49c398 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:55.692835 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-38eefbbe-7261-4ac3-a4ac-29187b49c398 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:55.698687 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-38eefbbe-7261-4ac3-a4ac-29187b49c398 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:55.699792 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-38eefbbe-7261-4ac3-a4ac-29187b49c398 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:55.714458 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-38eefbbe-7261-4ac3-a4ac-29187b49c398 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:55.716482 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-38eefbbe-7261-4ac3-a4ac-29187b49c398 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:55.717718 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-38eefbbe-7261-4ac3-a4ac-29187b49c398 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:55.793450 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:05:55.880456 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-38eefbbe-7261-4ac3-a4ac-29187b49c398 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.247744 Aug 31 16:05:55.881994 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1676/3246] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:05:55 2022] GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc/os-volume_attachments => generated 197 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:05:56.237161 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2dcaf1fc-2884-4092-9c09-ad331ce20a12 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6460603c59ec4751bd6cb557bb8c458c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c6ed5ff0f44dd1a70b4d568b3b9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:56.263358 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2dcaf1fc-2884-4092-9c09-ad331ce20a12 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6460603c59ec4751bd6cb557bb8c458c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c6ed5ff0f44dd1a70b4d568b3b9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:56.265379 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2dcaf1fc-2884-4092-9c09-ad331ce20a12 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6460603c59ec4751bd6cb557bb8c458c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c6ed5ff0f44dd1a70b4d568b3b9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:56.266634 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2dcaf1fc-2884-4092-9c09-ad331ce20a12 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] 10.222.0.50 "GET /compute/v2.1/servers/ef734c11-5fd1-4179-9dc2-8976812d7715" status: 200 len: 1359 microversion: 2.21 time: 1.157891 Aug 31 16:05:56.269449 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1571/3247] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:05:55 2022] GET /compute/v2.1/servers/ef734c11-5fd1-4179-9dc2-8976812d7715 => generated 1359 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:05:56.671221 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-69781e8a-02a1-42b3-b31b-ad1708054334 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:56.674260 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-69781e8a-02a1-42b3-b31b-ad1708054334 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] [instance: 5c81c9a3-8ba0-4573-a3e8-68292edc1ae2] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:56.687497 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69781e8a-02a1-42b3-b31b-ad1708054334 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:56.688365 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69781e8a-02a1-42b3-b31b-ad1708054334 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:56.689623 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69781e8a-02a1-42b3-b31b-ad1708054334 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:56.691261 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69781e8a-02a1-42b3-b31b-ad1708054334 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:56.692294 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69781e8a-02a1-42b3-b31b-ad1708054334 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:56.693272 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69781e8a-02a1-42b3-b31b-ad1708054334 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:56.896757 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-62aa68db-b4ee-428f-a185-573e957f341f tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:56.898961 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-62aa68db-b4ee-428f-a185-573e957f341f tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:56.907737 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62aa68db-b4ee-428f-a185-573e957f341f tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:56.908522 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62aa68db-b4ee-428f-a185-573e957f341f tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:56.909244 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62aa68db-b4ee-428f-a185-573e957f341f tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:56.910323 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62aa68db-b4ee-428f-a185-573e957f341f tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:56.911222 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62aa68db-b4ee-428f-a185-573e957f341f tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:56.912051 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62aa68db-b4ee-428f-a185-573e957f341f tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:56.979634 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-62aa68db-b4ee-428f-a185-573e957f341f tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086893 Aug 31 16:05:56.980745 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1572/3248] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:05:56 2022] GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:05:57.068272 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-69781e8a-02a1-42b3-b31b-ad1708054334 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae96c057d884eafb9c2032dd5db9e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a33aeb63a416a9d046e2b67b93f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:57.091804 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-69781e8a-02a1-42b3-b31b-ad1708054334 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/servers/5c81c9a3-8ba0-4573-a3e8-68292edc1ae2" status: 200 len: 1467 microversion: 2.1 time: 0.428341 Aug 31 16:05:57.119567 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1677/3249] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:56 2022] GET /compute/v2.1/servers/5c81c9a3-8ba0-4573-a3e8-68292edc1ae2 => generated 1467 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:57.124544 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-72040c21-c5f0-441b-abe9-cd88f89b9958 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:57.126337 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-72040c21-c5f0-441b-abe9-cd88f89b9958 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] [instance: d3255935-3cff-4bb0-aad2-a8f401028a59] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:57.134243 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72040c21-c5f0-441b-abe9-cd88f89b9958 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:57.135075 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72040c21-c5f0-441b-abe9-cd88f89b9958 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:57.135598 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72040c21-c5f0-441b-abe9-cd88f89b9958 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:57.136569 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72040c21-c5f0-441b-abe9-cd88f89b9958 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:57.137247 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72040c21-c5f0-441b-abe9-cd88f89b9958 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:57.137909 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72040c21-c5f0-441b-abe9-cd88f89b9958 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:57.304724 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-cdea21cf-8d11-47d3-bbea-b8d14fc94bfd tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:57.305587 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-cdea21cf-8d11-47d3-bbea-b8d14fc94bfd tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] [instance: ef734c11-5fd1-4179-9dc2-8976812d7715] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:57.312223 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cdea21cf-8d11-47d3-bbea-b8d14fc94bfd tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:57.312718 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cdea21cf-8d11-47d3-bbea-b8d14fc94bfd tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:57.313152 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cdea21cf-8d11-47d3-bbea-b8d14fc94bfd tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:57.313864 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cdea21cf-8d11-47d3-bbea-b8d14fc94bfd tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:57.314351 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cdea21cf-8d11-47d3-bbea-b8d14fc94bfd tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:57.314993 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cdea21cf-8d11-47d3-bbea-b8d14fc94bfd tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:57.650519 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-72040c21-c5f0-441b-abe9-cd88f89b9958 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae96c057d884eafb9c2032dd5db9e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a33aeb63a416a9d046e2b67b93f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:57.680895 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-72040c21-c5f0-441b-abe9-cd88f89b9958 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/servers/d3255935-3cff-4bb0-aad2-a8f401028a59" status: 200 len: 1467 microversion: 2.1 time: 0.559690 Aug 31 16:05:57.698346 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1573/3250] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:57 2022] GET /compute/v2.1/servers/d3255935-3cff-4bb0-aad2-a8f401028a59 => generated 1467 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:05:57.727281 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-cdea21cf-8d11-47d3-bbea-b8d14fc94bfd tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6460603c59ec4751bd6cb557bb8c458c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c6ed5ff0f44dd1a70b4d568b3b9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:57.732094 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-698daef8-f9d4-421e-b500-9c136f198a58 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-410128601"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:05:57.735451 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-698daef8-f9d4-421e-b500-9c136f198a58 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] [instance: d3255935-3cff-4bb0-aad2-a8f401028a59] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:57.749141 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-698daef8-f9d4-421e-b500-9c136f198a58 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:57.749625 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-698daef8-f9d4-421e-b500-9c136f198a58 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:57.750033 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-cdea21cf-8d11-47d3-bbea-b8d14fc94bfd tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6460603c59ec4751bd6cb557bb8c458c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c6ed5ff0f44dd1a70b4d568b3b9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:57.751493 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-698daef8-f9d4-421e-b500-9c136f198a58 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:57.752429 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-698daef8-f9d4-421e-b500-9c136f198a58 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:57.755430 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-cdea21cf-8d11-47d3-bbea-b8d14fc94bfd tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6460603c59ec4751bd6cb557bb8c458c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c6ed5ff0f44dd1a70b4d568b3b9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:57.756536 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-698daef8-f9d4-421e-b500-9c136f198a58 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:57.757695 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-698daef8-f9d4-421e-b500-9c136f198a58 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:57.757976 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-cdea21cf-8d11-47d3-bbea-b8d14fc94bfd tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] 10.222.0.50 "GET /compute/v2.1/servers/ef734c11-5fd1-4179-9dc2-8976812d7715" status: 200 len: 1359 microversion: 2.21 time: 0.460936 Aug 31 16:05:57.759811 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1678/3251] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:05:57 2022] GET /compute/v2.1/servers/ef734c11-5fd1-4179-9dc2-8976812d7715 => generated 1359 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:05:57.997221 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2b5fbfbe-36e4-4bf2-ac31-86567fb903e8 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:58.008716 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2b5fbfbe-36e4-4bf2-ac31-86567fb903e8 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:58.029047 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b5fbfbe-36e4-4bf2-ac31-86567fb903e8 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:58.029896 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b5fbfbe-36e4-4bf2-ac31-86567fb903e8 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:58.034659 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b5fbfbe-36e4-4bf2-ac31-86567fb903e8 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:58.035825 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b5fbfbe-36e4-4bf2-ac31-86567fb903e8 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:58.036588 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b5fbfbe-36e4-4bf2-ac31-86567fb903e8 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:58.040190 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b5fbfbe-36e4-4bf2-ac31-86567fb903e8 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:58.125052 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2b5fbfbe-36e4-4bf2-ac31-86567fb903e8 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.134797 Aug 31 16:05:58.135763 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1679/3252] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:05:57 2022] GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc/os-volume_attachments => generated 25 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:05:58.175494 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-698daef8-f9d4-421e-b500-9c136f198a58 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "POST /compute/v2.1/servers/d3255935-3cff-4bb0-aad2-a8f401028a59/action" status: 202 len: 0 microversion: 2.1 time: 0.447162 Aug 31 16:05:58.185848 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1574/3253] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:05:57 2022] POST /compute/v2.1/servers/d3255935-3cff-4bb0-aad2-a8f401028a59/action => generated 0 bytes in 459 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 31 16:05:58.199214 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2c421858-795d-496e-9e83-de38653f8faf tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb4ac613a0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:58.311923 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2c421858-795d-496e-9e83-de38653f8faf tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/5cdd7779-2b38-4dda-9001-a2279d998ba4" status: 200 len: 1454 microversion: 2.1 time: 0.118315 Aug 31 16:05:58.324064 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1680/3254] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:05:58 2022] GET /compute/v2.1/images/5cdd7779-2b38-4dda-9001-a2279d998ba4 => generated 1454 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:05:58.804364 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5716e24f-2a79-4977-a90d-bbf8c2fa19d7 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:58.806007 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5716e24f-2a79-4977-a90d-bbf8c2fa19d7 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] [instance: ef734c11-5fd1-4179-9dc2-8976812d7715] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:58.817934 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5716e24f-2a79-4977-a90d-bbf8c2fa19d7 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:58.819099 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5716e24f-2a79-4977-a90d-bbf8c2fa19d7 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:58.819831 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5716e24f-2a79-4977-a90d-bbf8c2fa19d7 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:58.820840 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5716e24f-2a79-4977-a90d-bbf8c2fa19d7 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:58.821820 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5716e24f-2a79-4977-a90d-bbf8c2fa19d7 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:58.822393 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5716e24f-2a79-4977-a90d-bbf8c2fa19d7 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:59.336558 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5716e24f-2a79-4977-a90d-bbf8c2fa19d7 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6460603c59ec4751bd6cb557bb8c458c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c6ed5ff0f44dd1a70b4d568b3b9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:59.352999 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d1754d65-cba1-4fa6-8d0b-d8b5437e18f5 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb4ab36ee0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:59.364828 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5716e24f-2a79-4977-a90d-bbf8c2fa19d7 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6460603c59ec4751bd6cb557bb8c458c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c6ed5ff0f44dd1a70b4d568b3b9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:59.377115 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5716e24f-2a79-4977-a90d-bbf8c2fa19d7 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6460603c59ec4751bd6cb557bb8c458c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c6ed5ff0f44dd1a70b4d568b3b9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:59.384298 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5716e24f-2a79-4977-a90d-bbf8c2fa19d7 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] 10.222.0.50 "GET /compute/v2.1/servers/ef734c11-5fd1-4179-9dc2-8976812d7715" status: 200 len: 1359 microversion: 2.21 time: 0.586347 Aug 31 16:05:59.389268 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1575/3255] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:05:58 2022] GET /compute/v2.1/servers/ef734c11-5fd1-4179-9dc2-8976812d7715 => generated 1359 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:05:59.442745 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d1754d65-cba1-4fa6-8d0b-d8b5437e18f5 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/5cdd7779-2b38-4dda-9001-a2279d998ba4" status: 200 len: 1454 microversion: 2.1 time: 0.103118 Aug 31 16:05:59.443647 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9817dd6e-d3fe-469d-8d94-29dff8a09842 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:05:59.446210 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9817dd6e-d3fe-469d-8d94-29dff8a09842 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:05:59.455862 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1681/3256] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:05:59 2022] GET /compute/v2.1/images/5cdd7779-2b38-4dda-9001-a2279d998ba4 => generated 1454 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:05:59.463443 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9817dd6e-d3fe-469d-8d94-29dff8a09842 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:59.463942 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9817dd6e-d3fe-469d-8d94-29dff8a09842 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:59.464373 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9817dd6e-d3fe-469d-8d94-29dff8a09842 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:59.466954 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9817dd6e-d3fe-469d-8d94-29dff8a09842 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:05:59.467757 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9817dd6e-d3fe-469d-8d94-29dff8a09842 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:05:59.468692 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9817dd6e-d3fe-469d-8d94-29dff8a09842 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:05:59.981137 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9817dd6e-d3fe-469d-8d94-29dff8a09842 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:05:59.998428 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9817dd6e-d3fe-469d-8d94-29dff8a09842 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1671 microversion: 2.1 time: 0.562063 Aug 31 16:06:00.002440 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1576/3257] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:05:59 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1671 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:06:00.046011 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-64eac935-ac09-4844-b12c-f3aa7f81781d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:00.046904 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-64eac935-ac09-4844-b12c-f3aa7f81781d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:00.068809 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-64eac935-ac09-4844-b12c-f3aa7f81781d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:00.073329 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-64eac935-ac09-4844-b12c-f3aa7f81781d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:00.074074 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-64eac935-ac09-4844-b12c-f3aa7f81781d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:00.075546 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-64eac935-ac09-4844-b12c-f3aa7f81781d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:00.076483 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-64eac935-ac09-4844-b12c-f3aa7f81781d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:00.077263 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-64eac935-ac09-4844-b12c-f3aa7f81781d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:00.424179 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2012bed2-870f-4930-b23c-933d2cb2406b tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:00.425936 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2012bed2-870f-4930-b23c-933d2cb2406b tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] [instance: ef734c11-5fd1-4179-9dc2-8976812d7715] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:00.437978 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2012bed2-870f-4930-b23c-933d2cb2406b tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:00.440260 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2012bed2-870f-4930-b23c-933d2cb2406b tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:00.441378 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2012bed2-870f-4930-b23c-933d2cb2406b tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:00.443495 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2012bed2-870f-4930-b23c-933d2cb2406b tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:00.444801 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2012bed2-870f-4930-b23c-933d2cb2406b tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:00.445615 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2012bed2-870f-4930-b23c-933d2cb2406b tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:00.509709 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-64eac935-ac09-4844-b12c-f3aa7f81781d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:00.526327 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-64eac935-ac09-4844-b12c-f3aa7f81781d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1671 microversion: 2.1 time: 0.487660 Aug 31 16:06:00.527674 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1682/3258] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:00 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1671 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:06:00.549645 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b7b2c45e-af56-4bb5-9bab-7c4f2b57fd1f tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb46f6c3a0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:00.611706 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b7b2c45e-af56-4bb5-9bab-7c4f2b57fd1f tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/5cdd7779-2b38-4dda-9001-a2279d998ba4" status: 200 len: 1454 microversion: 2.1 time: 0.082225 Aug 31 16:06:00.612439 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1683/3259] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:06:00 2022] GET /compute/v2.1/images/5cdd7779-2b38-4dda-9001-a2279d998ba4 => generated 1454 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:00.618295 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5e6894e5-9e03-441c-91fa-9aeaed030b85 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:00.619152 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5e6894e5-9e03-441c-91fa-9aeaed030b85 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:00.627320 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e6894e5-9e03-441c-91fa-9aeaed030b85 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:00.628482 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e6894e5-9e03-441c-91fa-9aeaed030b85 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:00.629127 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e6894e5-9e03-441c-91fa-9aeaed030b85 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:00.630328 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e6894e5-9e03-441c-91fa-9aeaed030b85 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:00.630909 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e6894e5-9e03-441c-91fa-9aeaed030b85 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:00.631339 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e6894e5-9e03-441c-91fa-9aeaed030b85 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:00.841296 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2012bed2-870f-4930-b23c-933d2cb2406b tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6460603c59ec4751bd6cb557bb8c458c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c6ed5ff0f44dd1a70b4d568b3b9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:00.853187 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2012bed2-870f-4930-b23c-933d2cb2406b tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6460603c59ec4751bd6cb557bb8c458c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c6ed5ff0f44dd1a70b4d568b3b9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:00.855736 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2012bed2-870f-4930-b23c-933d2cb2406b tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6460603c59ec4751bd6cb557bb8c458c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c6ed5ff0f44dd1a70b4d568b3b9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:00.857112 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2012bed2-870f-4930-b23c-933d2cb2406b tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] 10.222.0.50 "GET /compute/v2.1/servers/ef734c11-5fd1-4179-9dc2-8976812d7715" status: 200 len: 1359 microversion: 2.21 time: 0.442223 Aug 31 16:06:00.858905 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1577/3260] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:06:00 2022] GET /compute/v2.1/servers/ef734c11-5fd1-4179-9dc2-8976812d7715 => generated 1359 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:06:01.027804 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5e6894e5-9e03-441c-91fa-9aeaed030b85 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:01.043734 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5e6894e5-9e03-441c-91fa-9aeaed030b85 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1671 microversion: 2.1 time: 0.429916 Aug 31 16:06:01.045236 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1684/3261] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:00 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1671 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:01.077149 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-653df04e-816a-4e9b-8728-7ca87e6cad76 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:01.079532 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-653df04e-816a-4e9b-8728-7ca87e6cad76 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:01.091352 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-653df04e-816a-4e9b-8728-7ca87e6cad76 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:01.094587 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-653df04e-816a-4e9b-8728-7ca87e6cad76 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:01.094587 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-653df04e-816a-4e9b-8728-7ca87e6cad76 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:01.094587 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-653df04e-816a-4e9b-8728-7ca87e6cad76 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:01.096584 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-653df04e-816a-4e9b-8728-7ca87e6cad76 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:01.097869 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-653df04e-816a-4e9b-8728-7ca87e6cad76 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:01.420813 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-653df04e-816a-4e9b-8728-7ca87e6cad76 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:01.447542 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-653df04e-816a-4e9b-8728-7ca87e6cad76 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1671 microversion: 2.1 time: 0.380971 Aug 31 16:06:01.448298 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1578/3262] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:01 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1671 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:01.629957 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b65f87cc-3b3e-45e1-ba7d-47b15028d1d3 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb469949d0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:01.640227 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b980ee41-834f-4b79-9e8d-f855c89dd5bf tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1049119194", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "4df1d88e-baa2-45b2-bf09-1af39b3d8e2f"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:06:01.770290 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b65f87cc-3b3e-45e1-ba7d-47b15028d1d3 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/5cdd7779-2b38-4dda-9001-a2279d998ba4" status: 200 len: 1454 microversion: 2.1 time: 0.145641 Aug 31 16:06:01.771055 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1685/3263] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:06:01 2022] GET /compute/v2.1/images/5cdd7779-2b38-4dda-9001-a2279d998ba4 => generated 1454 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:06:01.786799 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-b980ee41-834f-4b79-9e8d-f855c89dd5bf tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] validate_networks() for [('4df1d88e-baa2-45b2-bf09-1af39b3d8e2f', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:06:01.914877 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b83d726d-1c80-4d32-aacf-9612d46e519c tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:01.917791 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b83d726d-1c80-4d32-aacf-9612d46e519c tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] [instance: ef734c11-5fd1-4179-9dc2-8976812d7715] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:01.956719 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b83d726d-1c80-4d32-aacf-9612d46e519c tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:01.958609 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b83d726d-1c80-4d32-aacf-9612d46e519c tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:01.962791 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b83d726d-1c80-4d32-aacf-9612d46e519c tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:01.963647 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b83d726d-1c80-4d32-aacf-9612d46e519c tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:01.964134 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b83d726d-1c80-4d32-aacf-9612d46e519c tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:01.964571 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b83d726d-1c80-4d32-aacf-9612d46e519c tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:02.271715 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b83d726d-1c80-4d32-aacf-9612d46e519c tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6460603c59ec4751bd6cb557bb8c458c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c6ed5ff0f44dd1a70b4d568b3b9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:02.282057 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b83d726d-1c80-4d32-aacf-9612d46e519c tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6460603c59ec4751bd6cb557bb8c458c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c6ed5ff0f44dd1a70b4d568b3b9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:02.288613 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b83d726d-1c80-4d32-aacf-9612d46e519c tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6460603c59ec4751bd6cb557bb8c458c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c6ed5ff0f44dd1a70b4d568b3b9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:02.291338 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b83d726d-1c80-4d32-aacf-9612d46e519c tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] 10.222.0.50 "GET /compute/v2.1/servers/ef734c11-5fd1-4179-9dc2-8976812d7715" status: 200 len: 1359 microversion: 2.21 time: 0.395070 Aug 31 16:06:02.291928 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1686/3264] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:06:01 2022] GET /compute/v2.1/servers/ef734c11-5fd1-4179-9dc2-8976812d7715 => generated 1359 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:06:02.519483 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b980ee41-834f-4b79-9e8d-f855c89dd5bf tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:06:02.520935 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b980ee41-834f-4b79-9e8d-f855c89dd5bf tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:06:02.522070 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b980ee41-834f-4b79-9e8d-f855c89dd5bf tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:06:02.523079 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b980ee41-834f-4b79-9e8d-f855c89dd5bf tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:06:02.523913 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b980ee41-834f-4b79-9e8d-f855c89dd5bf tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:06:02.559908 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b980ee41-834f-4b79-9e8d-f855c89dd5bf tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:02.560378 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b980ee41-834f-4b79-9e8d-f855c89dd5bf tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:02.563451 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b980ee41-834f-4b79-9e8d-f855c89dd5bf tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:02.564596 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b980ee41-834f-4b79-9e8d-f855c89dd5bf tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:02.565317 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b980ee41-834f-4b79-9e8d-f855c89dd5bf tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:02.566949 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b980ee41-834f-4b79-9e8d-f855c89dd5bf tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:02.591826 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-b980ee41-834f-4b79-9e8d-f855c89dd5bf tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Getting quotas for project 11ef5102f83142d1a52befe52c3595d4. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:06:02.602064 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-b980ee41-834f-4b79-9e8d-f855c89dd5bf tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Getting quotas for user aeeaf32202f747c8a2b98836f503aa7e and project 11ef5102f83142d1a52befe52c3595d4. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:06:02.622770 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b980ee41-834f-4b79-9e8d-f855c89dd5bf tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:06:02.628281 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b980ee41-834f-4b79-9e8d-f855c89dd5bf tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: f61252b4-88c9-422d-9849-c7dec9b67380] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:06:02.652303 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-bdcae327-41b7-4012-8150-3ea41a7ae045 req-6fd3ea8b-f481-4924-ac98-e20dc54cbaeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef734c11-5fd1-4179-9dc2-8976812d7715", "name": "network-vif-plugged", "status": "completed", "tag": "1dd2652a-004c-4af2-8a03-f0fc9de3f292"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:06:02.710013 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-bdcae327-41b7-4012-8150-3ea41a7ae045 req-6fd3ea8b-f481-4924-ac98-e20dc54cbaeb service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:02.710513 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-bdcae327-41b7-4012-8150-3ea41a7ae045 req-6fd3ea8b-f481-4924-ac98-e20dc54cbaeb service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:02.719556 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-bdcae327-41b7-4012-8150-3ea41a7ae045 req-6fd3ea8b-f481-4924-ac98-e20dc54cbaeb service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:02.748026 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b980ee41-834f-4b79-9e8d-f855c89dd5bf tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.109017 Aug 31 16:06:02.750461 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1579/3265] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:06:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1115 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 16:06:02.786063 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-bdcae327-41b7-4012-8150-3ea41a7ae045 req-6fd3ea8b-f481-4924-ac98-e20dc54cbaeb service nova] Creating event network-vif-plugged:1dd2652a-004c-4af2-8a03-f0fc9de3f292 for instance ef734c11-5fd1-4179-9dc2-8976812d7715 on n-h1-833090-16 Aug 31 16:06:02.786727 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f8790606-2791-478e-b51c-21fe0d1234b7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:02.791537 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f8790606-2791-478e-b51c-21fe0d1234b7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: f61252b4-88c9-422d-9849-c7dec9b67380] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:02.809074 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-bdcae327-41b7-4012-8150-3ea41a7ae045 req-6fd3ea8b-f481-4924-ac98-e20dc54cbaeb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165903 Aug 31 16:06:02.810412 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1687/3266] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:06:02.813045 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:06:02.821733 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-dc8a6af9-cbe3-4aa0-9158-04625e335bd6 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb4aa65d30>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:02.933209 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-dc8a6af9-cbe3-4aa0-9158-04625e335bd6 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/5cdd7779-2b38-4dda-9001-a2279d998ba4" status: 200 len: 1454 microversion: 2.1 time: 0.121147 Aug 31 16:06:02.933820 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1688/3267] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:06:02 2022] GET /compute/v2.1/images/5cdd7779-2b38-4dda-9001-a2279d998ba4 => generated 1454 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:03.185087 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f8790606-2791-478e-b51c-21fe0d1234b7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:03.199779 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f8790606-2791-478e-b51c-21fe0d1234b7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/f61252b4-88c9-422d-9849-c7dec9b67380" status: 200 len: 1215 microversion: 2.1 time: 0.437752 Aug 31 16:06:03.202454 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1580/3268] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:02 2022] GET /compute/v2.1/servers/f61252b4-88c9-422d-9849-c7dec9b67380 => generated 1215 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:06:03.338575 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-41ab8246-4edf-48b8-b9e8-d29b691fde27 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:03.340522 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-41ab8246-4edf-48b8-b9e8-d29b691fde27 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] [instance: ef734c11-5fd1-4179-9dc2-8976812d7715] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:03.368228 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-41ab8246-4edf-48b8-b9e8-d29b691fde27 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:03.376310 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-41ab8246-4edf-48b8-b9e8-d29b691fde27 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:03.377178 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-41ab8246-4edf-48b8-b9e8-d29b691fde27 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:03.381366 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-41ab8246-4edf-48b8-b9e8-d29b691fde27 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:03.382238 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-41ab8246-4edf-48b8-b9e8-d29b691fde27 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:03.385099 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-41ab8246-4edf-48b8-b9e8-d29b691fde27 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:03.955963 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b1cbb263-d7b8-4ffe-85bc-f1c6d83e7fa6 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb45d11550>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:04.065383 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b1cbb263-d7b8-4ffe-85bc-f1c6d83e7fa6 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/5cdd7779-2b38-4dda-9001-a2279d998ba4" status: 200 len: 1454 microversion: 2.1 time: 0.116621 Aug 31 16:06:04.066929 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1581/3269] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:06:03 2022] GET /compute/v2.1/images/5cdd7779-2b38-4dda-9001-a2279d998ba4 => generated 1454 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:04.227446 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-230bd7a5-0a9f-48db-9928-54a4fbb7337c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:04.229212 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-230bd7a5-0a9f-48db-9928-54a4fbb7337c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: f61252b4-88c9-422d-9849-c7dec9b67380] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:04.277288 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-230bd7a5-0a9f-48db-9928-54a4fbb7337c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:04.278847 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-230bd7a5-0a9f-48db-9928-54a4fbb7337c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:04.281113 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-230bd7a5-0a9f-48db-9928-54a4fbb7337c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:04.282933 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-230bd7a5-0a9f-48db-9928-54a4fbb7337c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:04.286354 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-230bd7a5-0a9f-48db-9928-54a4fbb7337c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:04.287849 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-230bd7a5-0a9f-48db-9928-54a4fbb7337c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:04.498243 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-41ab8246-4edf-48b8-b9e8-d29b691fde27 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6460603c59ec4751bd6cb557bb8c458c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c6ed5ff0f44dd1a70b4d568b3b9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:04.513616 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-41ab8246-4edf-48b8-b9e8-d29b691fde27 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6460603c59ec4751bd6cb557bb8c458c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c6ed5ff0f44dd1a70b4d568b3b9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:04.516784 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-41ab8246-4edf-48b8-b9e8-d29b691fde27 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6460603c59ec4751bd6cb557bb8c458c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c6ed5ff0f44dd1a70b4d568b3b9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:04.527818 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-41ab8246-4edf-48b8-b9e8-d29b691fde27 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] 10.222.0.50 "GET /compute/v2.1/servers/ef734c11-5fd1-4179-9dc2-8976812d7715" status: 200 len: 1359 microversion: 2.21 time: 1.210185 Aug 31 16:06:04.528889 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1689/3270] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:06:03 2022] GET /compute/v2.1/servers/ef734c11-5fd1-4179-9dc2-8976812d7715 => generated 1359 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:06:04.559376 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-230bd7a5-0a9f-48db-9928-54a4fbb7337c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:04.575648 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-230bd7a5-0a9f-48db-9928-54a4fbb7337c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/f61252b4-88c9-422d-9849-c7dec9b67380" status: 200 len: 1211 microversion: 2.1 time: 0.357625 Aug 31 16:06:04.577159 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1582/3271] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:04 2022] GET /compute/v2.1/servers/f61252b4-88c9-422d-9849-c7dec9b67380 => generated 1211 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:06:05.103565 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ee3e1664-3bda-473d-93a4-26abcf3dd811 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb47066e50>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:05.217112 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ee3e1664-3bda-473d-93a4-26abcf3dd811 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/5cdd7779-2b38-4dda-9001-a2279d998ba4" status: 200 len: 1454 microversion: 2.1 time: 0.129655 Aug 31 16:06:05.218633 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1690/3272] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:06:05 2022] GET /compute/v2.1/images/5cdd7779-2b38-4dda-9001-a2279d998ba4 => generated 1454 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:05.271830 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-05bc64ca-8a0d-4c4f-a292-09733f0c6e67 req-6a688cb1-a1f2-419c-9f3f-7042b41de00a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3255935-3cff-4bb0-aad2-a8f401028a59", "name": "network-vif-plugged", "status": "completed", "tag": "21dd4917-2780-427e-86cb-ca75980a35b5"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:06:05.321724 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-05bc64ca-8a0d-4c4f-a292-09733f0c6e67 req-6a688cb1-a1f2-419c-9f3f-7042b41de00a service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:05.322684 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-05bc64ca-8a0d-4c4f-a292-09733f0c6e67 req-6a688cb1-a1f2-419c-9f3f-7042b41de00a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:05.323703 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-05bc64ca-8a0d-4c4f-a292-09733f0c6e67 req-6a688cb1-a1f2-419c-9f3f-7042b41de00a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:05.366362 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-05bc64ca-8a0d-4c4f-a292-09733f0c6e67 req-6a688cb1-a1f2-419c-9f3f-7042b41de00a service nova] Creating event network-vif-plugged:21dd4917-2780-427e-86cb-ca75980a35b5 for instance d3255935-3cff-4bb0-aad2-a8f401028a59 on n-h2-833090-16 Aug 31 16:06:05.387138 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-05bc64ca-8a0d-4c4f-a292-09733f0c6e67 req-6a688cb1-a1f2-419c-9f3f-7042b41de00a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123100 Aug 31 16:06:05.388122 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1583/3273] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:06:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:06:05.574144 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-588ee4ca-f3c6-4298-8d3e-a9ca206b5a89 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:05.580428 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-588ee4ca-f3c6-4298-8d3e-a9ca206b5a89 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] [instance: ef734c11-5fd1-4179-9dc2-8976812d7715] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:05.601849 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-56ed5a2f-e6f9-4ef3-93b9-90e873254a64 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:05.603293 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-56ed5a2f-e6f9-4ef3-93b9-90e873254a64 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: f61252b4-88c9-422d-9849-c7dec9b67380] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:05.616513 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-588ee4ca-f3c6-4298-8d3e-a9ca206b5a89 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:05.616992 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-588ee4ca-f3c6-4298-8d3e-a9ca206b5a89 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:05.621608 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-588ee4ca-f3c6-4298-8d3e-a9ca206b5a89 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:05.625549 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-588ee4ca-f3c6-4298-8d3e-a9ca206b5a89 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:05.626552 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-588ee4ca-f3c6-4298-8d3e-a9ca206b5a89 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:05.627248 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-588ee4ca-f3c6-4298-8d3e-a9ca206b5a89 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:05.627467 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56ed5a2f-e6f9-4ef3-93b9-90e873254a64 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:05.628825 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56ed5a2f-e6f9-4ef3-93b9-90e873254a64 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:05.631042 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56ed5a2f-e6f9-4ef3-93b9-90e873254a64 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:05.640370 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56ed5a2f-e6f9-4ef3-93b9-90e873254a64 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:05.641864 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56ed5a2f-e6f9-4ef3-93b9-90e873254a64 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:05.643668 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56ed5a2f-e6f9-4ef3-93b9-90e873254a64 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:06.313366 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-56ed5a2f-e6f9-4ef3-93b9-90e873254a64 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:06.352047 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-56ed5a2f-e6f9-4ef3-93b9-90e873254a64 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/f61252b4-88c9-422d-9849-c7dec9b67380" status: 200 len: 1275 microversion: 2.1 time: 0.752892 Aug 31 16:06:06.356094 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1584/3274] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:05 2022] GET /compute/v2.1/servers/f61252b4-88c9-422d-9849-c7dec9b67380 => generated 1275 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:06.377528 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6368fde9-e823-4dd2-98ad-a65e481b0fef tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb4642a790>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:06.531437 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6368fde9-e823-4dd2-98ad-a65e481b0fef tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/5cdd7779-2b38-4dda-9001-a2279d998ba4" status: 200 len: 1454 microversion: 2.1 time: 0.173063 Aug 31 16:06:06.546569 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1585/3275] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:06:06 2022] GET /compute/v2.1/images/5cdd7779-2b38-4dda-9001-a2279d998ba4 => generated 1454 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:06.696515 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-588ee4ca-f3c6-4298-8d3e-a9ca206b5a89 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6460603c59ec4751bd6cb557bb8c458c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c6ed5ff0f44dd1a70b4d568b3b9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:06.733573 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-588ee4ca-f3c6-4298-8d3e-a9ca206b5a89 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6460603c59ec4751bd6cb557bb8c458c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c6ed5ff0f44dd1a70b4d568b3b9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:06.737764 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-588ee4ca-f3c6-4298-8d3e-a9ca206b5a89 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6460603c59ec4751bd6cb557bb8c458c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c6ed5ff0f44dd1a70b4d568b3b9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:06.763097 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-588ee4ca-f3c6-4298-8d3e-a9ca206b5a89 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] 10.222.0.50 "GET /compute/v2.1/servers/ef734c11-5fd1-4179-9dc2-8976812d7715" status: 200 len: 1553 microversion: 2.21 time: 1.196558 Aug 31 16:06:06.774600 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1691/3276] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:06:05 2022] GET /compute/v2.1/servers/ef734c11-5fd1-4179-9dc2-8976812d7715 => generated 1553 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:06:06.817225 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3aede297-eb8c-4652-bdf8-1e169b463f09 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:06.820527 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3aede297-eb8c-4652-bdf8-1e169b463f09 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] [instance: ef734c11-5fd1-4179-9dc2-8976812d7715] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:06.844821 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3aede297-eb8c-4652-bdf8-1e169b463f09 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:06.847261 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3aede297-eb8c-4652-bdf8-1e169b463f09 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:06.851548 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3aede297-eb8c-4652-bdf8-1e169b463f09 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:06.854409 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3aede297-eb8c-4652-bdf8-1e169b463f09 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:06.856045 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3aede297-eb8c-4652-bdf8-1e169b463f09 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:06.857691 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3aede297-eb8c-4652-bdf8-1e169b463f09 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:06.938821 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3aede297-eb8c-4652-bdf8-1e169b463f09 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] [instance: ef734c11-5fd1-4179-9dc2-8976812d7715] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:06:07.141613 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3aede297-eb8c-4652-bdf8-1e169b463f09 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ef734c11-5fd1-4179-9dc2-8976812d7715" status: 204 len: 0 microversion: 2.21 time: 0.335155 Aug 31 16:06:07.154698 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6b255f70-868b-47ee-847c-80d0913ec72d tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:07.155389 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6b255f70-868b-47ee-847c-80d0913ec72d tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] [instance: ef734c11-5fd1-4179-9dc2-8976812d7715] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:07.159212 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1586/3277] 10.222.0.50 () {60 vars in 1280 bytes} [Wed Aug 31 16:06:06 2022] DELETE /compute/v2.1/servers/ef734c11-5fd1-4179-9dc2-8976812d7715 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 16:06:07.163074 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=64 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:06:07.187089 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6b255f70-868b-47ee-847c-80d0913ec72d tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:07.189285 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6b255f70-868b-47ee-847c-80d0913ec72d tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:07.192119 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6b255f70-868b-47ee-847c-80d0913ec72d tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:07.195448 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6b255f70-868b-47ee-847c-80d0913ec72d tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:07.196872 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6b255f70-868b-47ee-847c-80d0913ec72d tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:07.199695 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6b255f70-868b-47ee-847c-80d0913ec72d tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:07.376445 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5d5d6d11-6349-4809-bbb5-4a0c7ee76191 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:07.377253 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5d5d6d11-6349-4809-bbb5-4a0c7ee76191 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: f61252b4-88c9-422d-9849-c7dec9b67380] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:07.407487 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d5d6d11-6349-4809-bbb5-4a0c7ee76191 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:07.408904 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d5d6d11-6349-4809-bbb5-4a0c7ee76191 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:07.412491 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d5d6d11-6349-4809-bbb5-4a0c7ee76191 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:07.416787 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d5d6d11-6349-4809-bbb5-4a0c7ee76191 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:07.423405 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d5d6d11-6349-4809-bbb5-4a0c7ee76191 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:07.431724 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d5d6d11-6349-4809-bbb5-4a0c7ee76191 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:07.684280 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5d5d6d11-6349-4809-bbb5-4a0c7ee76191 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:07.707807 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5d5d6d11-6349-4809-bbb5-4a0c7ee76191 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/f61252b4-88c9-422d-9849-c7dec9b67380" status: 200 len: 1273 microversion: 2.1 time: 0.335642 Aug 31 16:06:07.708966 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1587/3278] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:07 2022] GET /compute/v2.1/servers/f61252b4-88c9-422d-9849-c7dec9b67380 => generated 1273 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:07.730478 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c45584ad-2095-4489-b38c-2088d9b42f5c tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb45d11ee0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:08.013719 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6b255f70-868b-47ee-847c-80d0913ec72d tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6460603c59ec4751bd6cb557bb8c458c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c6ed5ff0f44dd1a70b4d568b3b9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:08.030185 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6b255f70-868b-47ee-847c-80d0913ec72d tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6460603c59ec4751bd6cb557bb8c458c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c6ed5ff0f44dd1a70b4d568b3b9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:08.032765 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6b255f70-868b-47ee-847c-80d0913ec72d tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6460603c59ec4751bd6cb557bb8c458c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c6ed5ff0f44dd1a70b4d568b3b9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:08.034639 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6b255f70-868b-47ee-847c-80d0913ec72d tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] 10.222.0.50 "GET /compute/v2.1/servers/ef734c11-5fd1-4179-9dc2-8976812d7715" status: 200 len: 1559 microversion: 2.21 time: 0.884362 Aug 31 16:06:08.036070 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1692/3279] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:06:07 2022] GET /compute/v2.1/servers/ef734c11-5fd1-4179-9dc2-8976812d7715 => generated 1559 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:06:08.748984 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a3451548-24a0-47fe-9ab5-36a7cad60505 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:08.751430 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a3451548-24a0-47fe-9ab5-36a7cad60505 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: f61252b4-88c9-422d-9849-c7dec9b67380] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:08.775053 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a3451548-24a0-47fe-9ab5-36a7cad60505 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:08.776000 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a3451548-24a0-47fe-9ab5-36a7cad60505 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:08.780224 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a3451548-24a0-47fe-9ab5-36a7cad60505 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:08.781733 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a3451548-24a0-47fe-9ab5-36a7cad60505 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:08.784727 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a3451548-24a0-47fe-9ab5-36a7cad60505 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:08.786888 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a3451548-24a0-47fe-9ab5-36a7cad60505 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:10.018592 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a3451548-24a0-47fe-9ab5-36a7cad60505 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:10.046062 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a3451548-24a0-47fe-9ab5-36a7cad60505 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/f61252b4-88c9-422d-9849-c7dec9b67380" status: 200 len: 1315 microversion: 2.1 time: 1.297121 Aug 31 16:06:10.062123 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1693/3280] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:08 2022] GET /compute/v2.1/servers/f61252b4-88c9-422d-9849-c7dec9b67380 => generated 1315 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:10.087276 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b1ddcb67-4a55-468b-8928-92778ec95ec2 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:10.087900 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b1ddcb67-4a55-468b-8928-92778ec95ec2 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] [instance: ef734c11-5fd1-4179-9dc2-8976812d7715] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:10.122438 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1ddcb67-4a55-468b-8928-92778ec95ec2 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:10.123004 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1ddcb67-4a55-468b-8928-92778ec95ec2 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:10.123464 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1ddcb67-4a55-468b-8928-92778ec95ec2 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:10.130708 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1ddcb67-4a55-468b-8928-92778ec95ec2 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:10.137468 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1ddcb67-4a55-468b-8928-92778ec95ec2 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:10.138798 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1ddcb67-4a55-468b-8928-92778ec95ec2 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:11.136239 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b1ddcb67-4a55-468b-8928-92778ec95ec2 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6460603c59ec4751bd6cb557bb8c458c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c6ed5ff0f44dd1a70b4d568b3b9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:11.168837 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b1ddcb67-4a55-468b-8928-92778ec95ec2 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6460603c59ec4751bd6cb557bb8c458c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c6ed5ff0f44dd1a70b4d568b3b9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:11.171143 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b1ddcb67-4a55-468b-8928-92778ec95ec2 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6460603c59ec4751bd6cb557bb8c458c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c6ed5ff0f44dd1a70b4d568b3b9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:11.172813 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b1ddcb67-4a55-468b-8928-92778ec95ec2 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] 10.222.0.50 "GET /compute/v2.1/servers/ef734c11-5fd1-4179-9dc2-8976812d7715" status: 200 len: 1559 microversion: 2.21 time: 1.105964 Aug 31 16:06:11.173830 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1694/3281] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:06:10 2022] GET /compute/v2.1/servers/ef734c11-5fd1-4179-9dc2-8976812d7715 => generated 1559 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:06:11.190117 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2d7e18b5-4620-4923-addd-5771d9ca7e3e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:11.191441 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2d7e18b5-4620-4923-addd-5771d9ca7e3e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: f61252b4-88c9-422d-9849-c7dec9b67380] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:11.198373 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2d7e18b5-4620-4923-addd-5771d9ca7e3e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:11.199239 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2d7e18b5-4620-4923-addd-5771d9ca7e3e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:11.199914 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2d7e18b5-4620-4923-addd-5771d9ca7e3e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:11.200838 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2d7e18b5-4620-4923-addd-5771d9ca7e3e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:11.201514 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2d7e18b5-4620-4923-addd-5771d9ca7e3e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:11.202357 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2d7e18b5-4620-4923-addd-5771d9ca7e3e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:11.586355 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2d7e18b5-4620-4923-addd-5771d9ca7e3e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:11.627709 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2d7e18b5-4620-4923-addd-5771d9ca7e3e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/f61252b4-88c9-422d-9849-c7dec9b67380" status: 200 len: 1315 microversion: 2.1 time: 0.450687 Aug 31 16:06:11.660301 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1695/3282] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:11 2022] GET /compute/v2.1/servers/f61252b4-88c9-422d-9849-c7dec9b67380 => generated 1315 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:12.220307 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6d41d5b2-b41e-4c7d-b8e1-f7106ed32839 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:12.224580 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6d41d5b2-b41e-4c7d-b8e1-f7106ed32839 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] [instance: ef734c11-5fd1-4179-9dc2-8976812d7715] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:12.261737 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d41d5b2-b41e-4c7d-b8e1-f7106ed32839 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:12.270059 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d41d5b2-b41e-4c7d-b8e1-f7106ed32839 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:12.273602 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d41d5b2-b41e-4c7d-b8e1-f7106ed32839 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:12.279035 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d41d5b2-b41e-4c7d-b8e1-f7106ed32839 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:12.281116 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d41d5b2-b41e-4c7d-b8e1-f7106ed32839 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:12.282930 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d41d5b2-b41e-4c7d-b8e1-f7106ed32839 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:12.587495 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:06:12.693690 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6d41d5b2-b41e-4c7d-b8e1-f7106ed32839 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6460603c59ec4751bd6cb557bb8c458c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c6ed5ff0f44dd1a70b4d568b3b9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:12.728539 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6d41d5b2-b41e-4c7d-b8e1-f7106ed32839 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6460603c59ec4751bd6cb557bb8c458c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c6ed5ff0f44dd1a70b4d568b3b9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:12.739817 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6d41d5b2-b41e-4c7d-b8e1-f7106ed32839 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6460603c59ec4751bd6cb557bb8c458c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c6ed5ff0f44dd1a70b4d568b3b9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:12.748775 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6d41d5b2-b41e-4c7d-b8e1-f7106ed32839 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] 10.222.0.50 "GET /compute/v2.1/servers/ef734c11-5fd1-4179-9dc2-8976812d7715" status: 200 len: 1517 microversion: 2.21 time: 0.535644 Aug 31 16:06:12.771382 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1696/3283] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:06:12 2022] GET /compute/v2.1/servers/ef734c11-5fd1-4179-9dc2-8976812d7715 => generated 1517 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:06:12.808440 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-ecbb7f5e-0b5e-4029-a5f2-ff6af7fa95eb req-38fa6394-6631-4a62-abf5-1557fe6a1e46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef734c11-5fd1-4179-9dc2-8976812d7715", "name": "network-vif-deleted", "tag": "1dd2652a-004c-4af2-8a03-f0fc9de3f292"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:06:12.890482 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-ecbb7f5e-0b5e-4029-a5f2-ff6af7fa95eb req-38fa6394-6631-4a62-abf5-1557fe6a1e46 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:12.892088 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-ecbb7f5e-0b5e-4029-a5f2-ff6af7fa95eb req-38fa6394-6631-4a62-abf5-1557fe6a1e46 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:12.893184 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-ecbb7f5e-0b5e-4029-a5f2-ff6af7fa95eb req-38fa6394-6631-4a62-abf5-1557fe6a1e46 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:12.969793 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-ecbb7f5e-0b5e-4029-a5f2-ff6af7fa95eb req-38fa6394-6631-4a62-abf5-1557fe6a1e46 service nova] Creating event network-vif-deleted:1dd2652a-004c-4af2-8a03-f0fc9de3f292 for instance ef734c11-5fd1-4179-9dc2-8976812d7715 on n-h1-833090-16 Aug 31 16:06:13.015028 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-ecbb7f5e-0b5e-4029-a5f2-ff6af7fa95eb req-38fa6394-6631-4a62-abf5-1557fe6a1e46 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.231143 Aug 31 16:06:13.019047 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1697/3284] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:06:13.053684 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b079add9-25d3-402d-8e05-e755eec68c48 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:13.056181 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b079add9-25d3-402d-8e05-e755eec68c48 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: f61252b4-88c9-422d-9849-c7dec9b67380] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:13.105446 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b079add9-25d3-402d-8e05-e755eec68c48 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:13.117233 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b079add9-25d3-402d-8e05-e755eec68c48 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:13.117997 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b079add9-25d3-402d-8e05-e755eec68c48 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:13.119186 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b079add9-25d3-402d-8e05-e755eec68c48 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:13.131990 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b079add9-25d3-402d-8e05-e755eec68c48 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:13.141092 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b079add9-25d3-402d-8e05-e755eec68c48 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:13.198412 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=8 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:06:13.946017 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b079add9-25d3-402d-8e05-e755eec68c48 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:13.993305 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b079add9-25d3-402d-8e05-e755eec68c48 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/f61252b4-88c9-422d-9849-c7dec9b67380" status: 200 len: 1315 microversion: 2.1 time: 0.967548 Aug 31 16:06:14.000753 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1698/3285] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:13 2022] GET /compute/v2.1/servers/f61252b4-88c9-422d-9849-c7dec9b67380 => generated 1315 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:14.037184 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a86f297d-f1ab-4c38-aa96-c1d63f31a21a tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:14.041684 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a86f297d-f1ab-4c38-aa96-c1d63f31a21a tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] [instance: ef734c11-5fd1-4179-9dc2-8976812d7715] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:14.079303 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a86f297d-f1ab-4c38-aa96-c1d63f31a21a tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:14.088792 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a86f297d-f1ab-4c38-aa96-c1d63f31a21a tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:14.104023 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a86f297d-f1ab-4c38-aa96-c1d63f31a21a tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:14.105963 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a86f297d-f1ab-4c38-aa96-c1d63f31a21a tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:14.107415 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a86f297d-f1ab-4c38-aa96-c1d63f31a21a tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:14.108721 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a86f297d-f1ab-4c38-aa96-c1d63f31a21a tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:14.245064 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a86f297d-f1ab-4c38-aa96-c1d63f31a21a tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:14.246038 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a86f297d-f1ab-4c38-aa96-c1d63f31a21a tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:14.246860 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a86f297d-f1ab-4c38-aa96-c1d63f31a21a tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:14.247679 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-a86f297d-f1ab-4c38-aa96-c1d63f31a21a tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lazy-loading 'fault' on Instance uuid ef734c11-5fd1-4179-9dc2-8976812d7715 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:06:14.634618 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a86f297d-f1ab-4c38-aa96-c1d63f31a21a tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6460603c59ec4751bd6cb557bb8c458c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c6ed5ff0f44dd1a70b4d568b3b9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:14.671404 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a86f297d-f1ab-4c38-aa96-c1d63f31a21a tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6460603c59ec4751bd6cb557bb8c458c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c6ed5ff0f44dd1a70b4d568b3b9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:14.675023 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a86f297d-f1ab-4c38-aa96-c1d63f31a21a tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6460603c59ec4751bd6cb557bb8c458c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c6ed5ff0f44dd1a70b4d568b3b9e3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:14.677641 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a86f297d-f1ab-4c38-aa96-c1d63f31a21a tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] 10.222.0.50 "GET /compute/v2.1/servers/ef734c11-5fd1-4179-9dc2-8976812d7715" status: 200 len: 1349 microversion: 2.21 time: 0.665682 Aug 31 16:06:14.730128 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1699/3286] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:06:14 2022] GET /compute/v2.1/servers/ef734c11-5fd1-4179-9dc2-8976812d7715 => generated 1349 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:06:15.035237 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ad67cdd0-970b-4581-b386-ad74fed4c1f2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:15.036201 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ad67cdd0-970b-4581-b386-ad74fed4c1f2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: f61252b4-88c9-422d-9849-c7dec9b67380] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:15.066963 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ad67cdd0-970b-4581-b386-ad74fed4c1f2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:15.069300 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ad67cdd0-970b-4581-b386-ad74fed4c1f2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:15.074434 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ad67cdd0-970b-4581-b386-ad74fed4c1f2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:15.087974 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ad67cdd0-970b-4581-b386-ad74fed4c1f2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:15.091249 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ad67cdd0-970b-4581-b386-ad74fed4c1f2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:15.094494 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ad67cdd0-970b-4581-b386-ad74fed4c1f2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:15.101640 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=100 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:06:15.629581 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ad67cdd0-970b-4581-b386-ad74fed4c1f2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:15.662138 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ad67cdd0-970b-4581-b386-ad74fed4c1f2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/f61252b4-88c9-422d-9849-c7dec9b67380" status: 200 len: 1315 microversion: 2.1 time: 0.628542 Aug 31 16:06:15.665197 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1700/3287] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:15 2022] GET /compute/v2.1/servers/f61252b4-88c9-422d-9849-c7dec9b67380 => generated 1315 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:06:15.677689 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-d96b95a5-c23b-4b69-9f21-5d607c1d5782 req-ebcb588a-e495-42a4-851d-f42d603e0bd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f61252b4-88c9-422d-9849-c7dec9b67380", "tag": "6e091963-d476-442f-be98-d698e8835325"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:06:15.710297 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-d96b95a5-c23b-4b69-9f21-5d607c1d5782 req-ebcb588a-e495-42a4-851d-f42d603e0bd9 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:15.711167 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-d96b95a5-c23b-4b69-9f21-5d607c1d5782 req-ebcb588a-e495-42a4-851d-f42d603e0bd9 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:15.711846 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-d96b95a5-c23b-4b69-9f21-5d607c1d5782 req-ebcb588a-e495-42a4-851d-f42d603e0bd9 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:15.735363 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-d96b95a5-c23b-4b69-9f21-5d607c1d5782 req-ebcb588a-e495-42a4-851d-f42d603e0bd9 service nova] Creating event network-changed:6e091963-d476-442f-be98-d698e8835325 for instance f61252b4-88c9-422d-9849-c7dec9b67380 on n-h1-833090-16 Aug 31 16:06:15.744942 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-d96b95a5-c23b-4b69-9f21-5d607c1d5782 req-ebcb588a-e495-42a4-851d-f42d603e0bd9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077894 Aug 31 16:06:15.745614 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1701/3288] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:06:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:06:15.766173 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-caf71894-d02e-4717-9ec4-2f0b1d63caeb tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:15.767432 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-caf71894-d02e-4717-9ec4-2f0b1d63caeb tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] [instance: ef734c11-5fd1-4179-9dc2-8976812d7715] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:15.778685 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-caf71894-d02e-4717-9ec4-2f0b1d63caeb tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:15.779499 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-caf71894-d02e-4717-9ec4-2f0b1d63caeb tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:15.780361 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-caf71894-d02e-4717-9ec4-2f0b1d63caeb tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:15.781333 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-caf71894-d02e-4717-9ec4-2f0b1d63caeb tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:15.782130 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-caf71894-d02e-4717-9ec4-2f0b1d63caeb tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:15.782780 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-caf71894-d02e-4717-9ec4-2f0b1d63caeb tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:15.877506 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-caf71894-d02e-4717-9ec4-2f0b1d63caeb tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] HTTP exception thrown: Instance ef734c11-5fd1-4179-9dc2-8976812d7715 could not be found. Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-caf71894-d02e-4717-9ec4-2f0b1d63caeb tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Request method failure captured: Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/ef734c11-5fd1-4179-9dc2-8976812d7715 HTTP/1.1 Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4bVykVuA8Jl2KQ45I2Oeu0BLAdaZrMOgUott91comU_Z0Tj9H9MhuJT_-jZhs4JHlsKuukx_KG81ZNbXSUZNcBlXRGTw0NQVWCJ8ezYqjmyqc7pXz82GoxTi5i1dahXLt_5YZq3aJ3d1R5y35_sdMBapmAqn0G5VX5vLCjG-d-JB7o Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: X-Openstack-Nova-Api-Version: 2.21 Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: d6c6ed5ff0f44dd1a70b4d568b3b9e3a Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-InstanceActionsV221TestJSON-96715814 Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d6c6ed5ff0f44dd1a70b4d568b3b9e3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d6c6ed5ff0f44dd1a70b4d568b3b9e3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d6c6ed5ff0f44dd1a70b4d568b3b9e3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d6c6ed5ff0f44dd1a70b4d568b3b9e3a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-InstanceActionsV221TestJSON-96715814 Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: d6c6ed5ff0f44dd1a70b4d568b3b9e3a Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-96715814 Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-InstanceActionsV221TestJSON-96715814-project Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 6460603c59ec4751bd6cb557bb8c458c Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-InstanceActionsV221TestJSON-96715814-project Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance ef734c11-5fd1-4179-9dc2-8976812d7715 could not be found. Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'ef734c11-5fd1-4179-9dc2-8976812d7715'} Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef734c11-5fd1-4179-9dc2-8976812d7715 could not be found. Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef734c11-5fd1-4179-9dc2-8976812d7715 could not be found. Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:06:15.885725 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:06:15.893046 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:06:15.893046 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:06:15.893046 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:06:15.893046 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:06:15.893046 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:06:15.893046 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:06:15.893046 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef734c11-5fd1-4179-9dc2-8976812d7715 could not be found. Aug 31 16:06:15.893046 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:06:15.895289 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-caf71894-d02e-4717-9ec4-2f0b1d63caeb tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Returning 404 to user: Instance ef734c11-5fd1-4179-9dc2-8976812d7715 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:06:15.898784 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-caf71894-d02e-4717-9ec4-2f0b1d63caeb tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] 10.222.0.50 "GET /compute/v2.1/servers/ef734c11-5fd1-4179-9dc2-8976812d7715" status: 404 len: 111 microversion: 2.21 time: 0.141582 Aug 31 16:06:15.900224 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1702/3289] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:06:15 2022] GET /compute/v2.1/servers/ef734c11-5fd1-4179-9dc2-8976812d7715 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:06:15.923669 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-338e9d8b-3d26-4783-b79f-d1dfc1592a02 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Calling method '.version_select at 0x7fbb4aa64b80>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:15.924736 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-338e9d8b-3d26-4783-b79f-d1dfc1592a02 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] [instance: ef734c11-5fd1-4179-9dc2-8976812d7715] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:15.953451 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-338e9d8b-3d26-4783-b79f-d1dfc1592a02 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:15.954456 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-338e9d8b-3d26-4783-b79f-d1dfc1592a02 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:15.955364 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-338e9d8b-3d26-4783-b79f-d1dfc1592a02 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:15.962140 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-338e9d8b-3d26-4783-b79f-d1dfc1592a02 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:15.962856 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-338e9d8b-3d26-4783-b79f-d1dfc1592a02 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:15.966002 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-338e9d8b-3d26-4783-b79f-d1dfc1592a02 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:16.395418 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-338e9d8b-3d26-4783-b79f-d1dfc1592a02 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] 10.222.0.50 "GET /compute/v2.1/servers/ef734c11-5fd1-4179-9dc2-8976812d7715/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.488575 Aug 31 16:06:16.397893 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1703/3290] 10.222.0.50 () {60 vars in 1337 bytes} [Wed Aug 31 16:06:15 2022] GET /compute/v2.1/servers/ef734c11-5fd1-4179-9dc2-8976812d7715/os-instance-actions => generated 611 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:06:16.426573 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6604ef5b-69bd-4683-b7d2-5b599296e36d tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:16.431166 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6604ef5b-69bd-4683-b7d2-5b599296e36d tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] [instance: ef734c11-5fd1-4179-9dc2-8976812d7715] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:16.445440 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6604ef5b-69bd-4683-b7d2-5b599296e36d tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:16.446755 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6604ef5b-69bd-4683-b7d2-5b599296e36d tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:16.447814 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6604ef5b-69bd-4683-b7d2-5b599296e36d tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:16.450046 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6604ef5b-69bd-4683-b7d2-5b599296e36d tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:16.451580 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6604ef5b-69bd-4683-b7d2-5b599296e36d tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:16.452672 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6604ef5b-69bd-4683-b7d2-5b599296e36d tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:16.500503 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-6604ef5b-69bd-4683-b7d2-5b599296e36d tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] HTTP exception thrown: Instance ef734c11-5fd1-4179-9dc2-8976812d7715 could not be found. Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6604ef5b-69bd-4683-b7d2-5b599296e36d tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Request method failure captured: Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: request: DELETE /compute/v2.1/servers/ef734c11-5fd1-4179-9dc2-8976812d7715 HTTP/1.1 Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4bVykVuA8Jl2KQ45I2Oeu0BLAdaZrMOgUott91comU_Z0Tj9H9MhuJT_-jZhs4JHlsKuukx_KG81ZNbXSUZNcBlXRGTw0NQVWCJ8ezYqjmyqc7pXz82GoxTi5i1dahXLt_5YZq3aJ3d1R5y35_sdMBapmAqn0G5VX5vLCjG-d-JB7o Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: X-Openstack-Nova-Api-Version: 2.21 Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: d6c6ed5ff0f44dd1a70b4d568b3b9e3a Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-InstanceActionsV221TestJSON-96715814 Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d6c6ed5ff0f44dd1a70b4d568b3b9e3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d6c6ed5ff0f44dd1a70b4d568b3b9e3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d6c6ed5ff0f44dd1a70b4d568b3b9e3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d6c6ed5ff0f44dd1a70b4d568b3b9e3a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-InstanceActionsV221TestJSON-96715814 Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: d6c6ed5ff0f44dd1a70b4d568b3b9e3a Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-96715814 Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-InstanceActionsV221TestJSON-96715814-project Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 6460603c59ec4751bd6cb557bb8c458c Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-InstanceActionsV221TestJSON-96715814-project Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance ef734c11-5fd1-4179-9dc2-8976812d7715 could not be found. Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'ef734c11-5fd1-4179-9dc2-8976812d7715'} Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef734c11-5fd1-4179-9dc2-8976812d7715 could not be found. Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:06:16.506059 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:06:16.518443 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef734c11-5fd1-4179-9dc2-8976812d7715 could not be found. Aug 31 16:06:16.518443 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:06:16.518443 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:06:16.518443 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:06:16.518443 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:06:16.518443 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:06:16.518443 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:06:16.518443 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:06:16.518443 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:06:16.518443 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef734c11-5fd1-4179-9dc2-8976812d7715 could not be found. Aug 31 16:06:16.518443 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:06:16.537153 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6604ef5b-69bd-4683-b7d2-5b599296e36d tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Returning 404 to user: Instance ef734c11-5fd1-4179-9dc2-8976812d7715 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:06:16.537153 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6604ef5b-69bd-4683-b7d2-5b599296e36d tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ef734c11-5fd1-4179-9dc2-8976812d7715" status: 404 len: 111 microversion: 2.21 time: 0.116604 Aug 31 16:06:16.537153 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1704/3291] 10.222.0.50 () {60 vars in 1280 bytes} [Wed Aug 31 16:06:16 2022] DELETE /compute/v2.1/servers/ef734c11-5fd1-4179-9dc2-8976812d7715 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 31 16:06:16.588315 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4e597ad8-ade1-4a18-bf21-49ba3c10b820 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:16.619130 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4e597ad8-ade1-4a18-bf21-49ba3c10b820 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] [instance: ef734c11-5fd1-4179-9dc2-8976812d7715] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:16.639987 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4e597ad8-ade1-4a18-bf21-49ba3c10b820 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:16.640476 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4e597ad8-ade1-4a18-bf21-49ba3c10b820 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:16.645606 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4e597ad8-ade1-4a18-bf21-49ba3c10b820 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:16.646685 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4e597ad8-ade1-4a18-bf21-49ba3c10b820 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:16.647331 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4e597ad8-ade1-4a18-bf21-49ba3c10b820 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:16.651920 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4e597ad8-ade1-4a18-bf21-49ba3c10b820 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:16.678562 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-4e597ad8-ade1-4a18-bf21-49ba3c10b820 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] HTTP exception thrown: Instance ef734c11-5fd1-4179-9dc2-8976812d7715 could not be found. Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4e597ad8-ade1-4a18-bf21-49ba3c10b820 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Request method failure captured: Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/ef734c11-5fd1-4179-9dc2-8976812d7715 HTTP/1.1 Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4bVykVuA8Jl2KQ45I2Oeu0BLAdaZrMOgUott91comU_Z0Tj9H9MhuJT_-jZhs4JHlsKuukx_KG81ZNbXSUZNcBlXRGTw0NQVWCJ8ezYqjmyqc7pXz82GoxTi5i1dahXLt_5YZq3aJ3d1R5y35_sdMBapmAqn0G5VX5vLCjG-d-JB7o Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: X-Openstack-Nova-Api-Version: 2.21 Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: d6c6ed5ff0f44dd1a70b4d568b3b9e3a Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-InstanceActionsV221TestJSON-96715814 Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d6c6ed5ff0f44dd1a70b4d568b3b9e3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d6c6ed5ff0f44dd1a70b4d568b3b9e3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d6c6ed5ff0f44dd1a70b4d568b3b9e3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d6c6ed5ff0f44dd1a70b4d568b3b9e3a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-InstanceActionsV221TestJSON-96715814 Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: d6c6ed5ff0f44dd1a70b4d568b3b9e3a Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-96715814 Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-InstanceActionsV221TestJSON-96715814-project Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 6460603c59ec4751bd6cb557bb8c458c Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-InstanceActionsV221TestJSON-96715814-project Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance ef734c11-5fd1-4179-9dc2-8976812d7715 could not be found. Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'ef734c11-5fd1-4179-9dc2-8976812d7715'} Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef734c11-5fd1-4179-9dc2-8976812d7715 could not be found. Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef734c11-5fd1-4179-9dc2-8976812d7715 could not be found. Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:06:16.680402 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:06:16.687913 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:06:16.687913 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:06:16.687913 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:06:16.687913 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:06:16.687913 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:06:16.687913 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:06:16.687913 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef734c11-5fd1-4179-9dc2-8976812d7715 could not be found. Aug 31 16:06:16.687913 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:06:16.690730 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4e597ad8-ade1-4a18-bf21-49ba3c10b820 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] Returning 404 to user: Instance ef734c11-5fd1-4179-9dc2-8976812d7715 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:06:16.692106 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4e597ad8-ade1-4a18-bf21-49ba3c10b820 tempest-InstanceActionsV221TestJSON-96715814 tempest-InstanceActionsV221TestJSON-96715814-project] 10.222.0.50 "GET /compute/v2.1/servers/ef734c11-5fd1-4179-9dc2-8976812d7715" status: 404 len: 111 microversion: 2.21 time: 0.135262 Aug 31 16:06:16.693608 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1705/3292] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:06:16 2022] GET /compute/v2.1/servers/ef734c11-5fd1-4179-9dc2-8976812d7715 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:06:16.731534 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7c51c1f3-9876-477c-8e79-f02b0cc829d2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:16.737617 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7c51c1f3-9876-477c-8e79-f02b0cc829d2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: f61252b4-88c9-422d-9849-c7dec9b67380] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:16.778257 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7c51c1f3-9876-477c-8e79-f02b0cc829d2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:16.781446 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7c51c1f3-9876-477c-8e79-f02b0cc829d2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:16.787330 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7c51c1f3-9876-477c-8e79-f02b0cc829d2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:16.790420 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7c51c1f3-9876-477c-8e79-f02b0cc829d2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:16.790618 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7c51c1f3-9876-477c-8e79-f02b0cc829d2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:16.791855 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7c51c1f3-9876-477c-8e79-f02b0cc829d2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:17.398772 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:06:17.493396 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7c51c1f3-9876-477c-8e79-f02b0cc829d2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:17.552769 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7c51c1f3-9876-477c-8e79-f02b0cc829d2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/f61252b4-88c9-422d-9849-c7dec9b67380" status: 200 len: 1315 microversion: 2.1 time: 0.851098 Aug 31 16:06:17.578574 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1706/3293] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:16 2022] GET /compute/v2.1/servers/f61252b4-88c9-422d-9849-c7dec9b67380 => generated 1315 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:17.707369 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:06:18.598814 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0468d45d-99f4-46f4-bffd-cab85f8065ca tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:18.600284 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0468d45d-99f4-46f4-bffd-cab85f8065ca tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: f61252b4-88c9-422d-9849-c7dec9b67380] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:18.641940 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0468d45d-99f4-46f4-bffd-cab85f8065ca tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:18.643142 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0468d45d-99f4-46f4-bffd-cab85f8065ca tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:18.644260 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0468d45d-99f4-46f4-bffd-cab85f8065ca tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:18.645538 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0468d45d-99f4-46f4-bffd-cab85f8065ca tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:18.646415 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0468d45d-99f4-46f4-bffd-cab85f8065ca tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:18.647171 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0468d45d-99f4-46f4-bffd-cab85f8065ca tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:20.258075 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0468d45d-99f4-46f4-bffd-cab85f8065ca tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:20.282395 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0468d45d-99f4-46f4-bffd-cab85f8065ca tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/f61252b4-88c9-422d-9849-c7dec9b67380" status: 200 len: 1315 microversion: 2.1 time: 1.685199 Aug 31 16:06:20.302385 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1707/3294] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:18 2022] GET /compute/v2.1/servers/f61252b4-88c9-422d-9849-c7dec9b67380 => generated 1315 bytes in 1700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:21.328912 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-41d359a8-ed67-4640-82dc-12e3a18972c4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:21.330150 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-41d359a8-ed67-4640-82dc-12e3a18972c4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: f61252b4-88c9-422d-9849-c7dec9b67380] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:21.385015 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-41d359a8-ed67-4640-82dc-12e3a18972c4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:21.395343 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-41d359a8-ed67-4640-82dc-12e3a18972c4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:21.406950 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-41d359a8-ed67-4640-82dc-12e3a18972c4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:21.408160 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-41d359a8-ed67-4640-82dc-12e3a18972c4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:21.412572 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-41d359a8-ed67-4640-82dc-12e3a18972c4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:21.439396 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-41d359a8-ed67-4640-82dc-12e3a18972c4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:22.238524 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-41d359a8-ed67-4640-82dc-12e3a18972c4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:22.251223 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-41d359a8-ed67-4640-82dc-12e3a18972c4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/f61252b4-88c9-422d-9849-c7dec9b67380" status: 200 len: 1315 microversion: 2.1 time: 0.929707 Aug 31 16:06:22.271351 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1708/3295] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:21 2022] GET /compute/v2.1/servers/f61252b4-88c9-422d-9849-c7dec9b67380 => generated 1315 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:06:23.025016 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-cf86b9e1-1e12-46b1-ab14-3b5ab696d597 req-8573c1a5-e8d5-4c2b-88c9-49ecaff4bd82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f61252b4-88c9-422d-9849-c7dec9b67380", "name": "network-vif-plugged", "status": "completed", "tag": "6e091963-d476-442f-be98-d698e8835325"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:06:23.098055 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-cf86b9e1-1e12-46b1-ab14-3b5ab696d597 req-8573c1a5-e8d5-4c2b-88c9-49ecaff4bd82 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:23.102364 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-cf86b9e1-1e12-46b1-ab14-3b5ab696d597 req-8573c1a5-e8d5-4c2b-88c9-49ecaff4bd82 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:23.105488 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-cf86b9e1-1e12-46b1-ab14-3b5ab696d597 req-8573c1a5-e8d5-4c2b-88c9-49ecaff4bd82 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:23.166684 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-cf86b9e1-1e12-46b1-ab14-3b5ab696d597 req-8573c1a5-e8d5-4c2b-88c9-49ecaff4bd82 service nova] Creating event network-vif-plugged:6e091963-d476-442f-be98-d698e8835325 for instance f61252b4-88c9-422d-9849-c7dec9b67380 on n-h1-833090-16 Aug 31 16:06:23.181025 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-cf86b9e1-1e12-46b1-ab14-3b5ab696d597 req-8573c1a5-e8d5-4c2b-88c9-49ecaff4bd82 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162218 Aug 31 16:06:23.181585 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1709/3296] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:06:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:06:23.279159 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2dd8a9d7-e9be-4282-a106-820019aca14d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:23.280377 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2dd8a9d7-e9be-4282-a106-820019aca14d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: f61252b4-88c9-422d-9849-c7dec9b67380] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:23.296029 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2dd8a9d7-e9be-4282-a106-820019aca14d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:23.297477 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2dd8a9d7-e9be-4282-a106-820019aca14d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:23.298416 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2dd8a9d7-e9be-4282-a106-820019aca14d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:23.301294 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2dd8a9d7-e9be-4282-a106-820019aca14d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:23.303744 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2dd8a9d7-e9be-4282-a106-820019aca14d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:23.308167 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2dd8a9d7-e9be-4282-a106-820019aca14d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:23.959232 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2dd8a9d7-e9be-4282-a106-820019aca14d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:23.983443 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2dd8a9d7-e9be-4282-a106-820019aca14d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/f61252b4-88c9-422d-9849-c7dec9b67380" status: 200 len: 1315 microversion: 2.1 time: 0.709163 Aug 31 16:06:23.997654 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1710/3297] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:23 2022] GET /compute/v2.1/servers/f61252b4-88c9-422d-9849-c7dec9b67380 => generated 1315 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:06:25.033425 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d1cfab69-85e7-4ed3-bc98-f6d6e9731d56 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:25.035654 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d1cfab69-85e7-4ed3-bc98-f6d6e9731d56 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: f61252b4-88c9-422d-9849-c7dec9b67380] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:25.064492 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d1cfab69-85e7-4ed3-bc98-f6d6e9731d56 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:25.069444 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d1cfab69-85e7-4ed3-bc98-f6d6e9731d56 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:25.072204 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d1cfab69-85e7-4ed3-bc98-f6d6e9731d56 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:25.073646 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d1cfab69-85e7-4ed3-bc98-f6d6e9731d56 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:25.077862 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d1cfab69-85e7-4ed3-bc98-f6d6e9731d56 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:25.078796 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d1cfab69-85e7-4ed3-bc98-f6d6e9731d56 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:25.813617 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d1cfab69-85e7-4ed3-bc98-f6d6e9731d56 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:25.831702 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d1cfab69-85e7-4ed3-bc98-f6d6e9731d56 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/f61252b4-88c9-422d-9849-c7dec9b67380" status: 200 len: 1502 microversion: 2.1 time: 0.802932 Aug 31 16:06:25.834469 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1711/3298] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:25 2022] GET /compute/v2.1/servers/f61252b4-88c9-422d-9849-c7dec9b67380 => generated 1502 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:06:25.864677 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-447cc12e-be88-4a90-b9f8-ab8c0543b172 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:06:25.869126 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-447cc12e-be88-4a90-b9f8-ab8c0543b172 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: f61252b4-88c9-422d-9849-c7dec9b67380] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:25.888258 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-447cc12e-be88-4a90-b9f8-ab8c0543b172 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:25.891765 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-447cc12e-be88-4a90-b9f8-ab8c0543b172 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:25.892474 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-447cc12e-be88-4a90-b9f8-ab8c0543b172 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:25.896819 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-447cc12e-be88-4a90-b9f8-ab8c0543b172 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:25.897633 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-447cc12e-be88-4a90-b9f8-ab8c0543b172 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:25.898317 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-447cc12e-be88-4a90-b9f8-ab8c0543b172 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:26.389308 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.network.security_group_api [None req-447cc12e-be88-4a90-b9f8-ab8c0543b172 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Removing security group 8b5f886f-74da-439b-b55c-353738474412 from port 6e091963-d476-442f-be98-d698e8835325 Aug 31 16:06:27.698541 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-447cc12e-be88-4a90-b9f8-ab8c0543b172 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "POST /compute/v2.1/servers/f61252b4-88c9-422d-9849-c7dec9b67380/action" status: 202 len: 0 microversion: 2.1 time: 1.838122 Aug 31 16:06:27.706344 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1712/3299] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:06:25 2022] POST /compute/v2.1/servers/f61252b4-88c9-422d-9849-c7dec9b67380/action => generated 0 bytes in 1846 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 16:06:27.732862 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4fb8e561-425a-4800-9b91-7b41de7f12da tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:27.733696 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4fb8e561-425a-4800-9b91-7b41de7f12da tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: f61252b4-88c9-422d-9849-c7dec9b67380] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:27.756399 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4fb8e561-425a-4800-9b91-7b41de7f12da tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:27.756900 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4fb8e561-425a-4800-9b91-7b41de7f12da tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:27.757345 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4fb8e561-425a-4800-9b91-7b41de7f12da tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:27.758047 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4fb8e561-425a-4800-9b91-7b41de7f12da tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:27.758532 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4fb8e561-425a-4800-9b91-7b41de7f12da tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:27.758961 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4fb8e561-425a-4800-9b91-7b41de7f12da tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:29.192234 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4fb8e561-425a-4800-9b91-7b41de7f12da tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:29.210420 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4fb8e561-425a-4800-9b91-7b41de7f12da tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/f61252b4-88c9-422d-9849-c7dec9b67380" status: 200 len: 1460 microversion: 2.1 time: 1.500700 Aug 31 16:06:29.219516 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1713/3300] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:27 2022] GET /compute/v2.1/servers/f61252b4-88c9-422d-9849-c7dec9b67380 => generated 1460 bytes in 1509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:29.232515 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-20b61442-116a-468c-892e-60a7e64891c2 req-0a326ec2-e464-4e70-ae9c-d929d9cbf2d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f61252b4-88c9-422d-9849-c7dec9b67380", "tag": "6e091963-d476-442f-be98-d698e8835325"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:06:29.280008 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-20b61442-116a-468c-892e-60a7e64891c2 req-0a326ec2-e464-4e70-ae9c-d929d9cbf2d6 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:29.284415 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-20b61442-116a-468c-892e-60a7e64891c2 req-0a326ec2-e464-4e70-ae9c-d929d9cbf2d6 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:29.285656 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-20b61442-116a-468c-892e-60a7e64891c2 req-0a326ec2-e464-4e70-ae9c-d929d9cbf2d6 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:29.338731 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-20b61442-116a-468c-892e-60a7e64891c2 req-0a326ec2-e464-4e70-ae9c-d929d9cbf2d6 service nova] Creating event network-changed:6e091963-d476-442f-be98-d698e8835325 for instance f61252b4-88c9-422d-9849-c7dec9b67380 on n-h1-833090-16 Aug 31 16:06:29.348229 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-20b61442-116a-468c-892e-60a7e64891c2 req-0a326ec2-e464-4e70-ae9c-d929d9cbf2d6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126269 Aug 31 16:06:29.356192 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1714/3301] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:06:29.433073 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fd77c1ac-d4f6-464f-9309-f58e16f5dde4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:29.434425 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fd77c1ac-d4f6-464f-9309-f58e16f5dde4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:29.497309 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c45584ad-2095-4489-b38c-2088d9b42f5c tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/5cdd7779-2b38-4dda-9001-a2279d998ba4" status: 200 len: 1454 microversion: 2.1 time: 21.782236 Aug 31 16:06:29.498720 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fd77c1ac-d4f6-464f-9309-f58e16f5dde4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:29.499841 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fd77c1ac-d4f6-464f-9309-f58e16f5dde4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:29.502440 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1588/3302] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:06:07 2022] GET /compute/v2.1/images/5cdd7779-2b38-4dda-9001-a2279d998ba4 => generated 1454 bytes in 21791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:29.504470 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fd77c1ac-d4f6-464f-9309-f58e16f5dde4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:29.505516 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fd77c1ac-d4f6-464f-9309-f58e16f5dde4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:29.512372 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fd77c1ac-d4f6-464f-9309-f58e16f5dde4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:29.518742 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fd77c1ac-d4f6-464f-9309-f58e16f5dde4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:30.205399 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-fd77c1ac-d4f6-464f-9309-f58e16f5dde4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:30.251783 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fd77c1ac-d4f6-464f-9309-f58e16f5dde4 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1671 microversion: 2.1 time: 0.875328 Aug 31 16:06:30.278350 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1715/3303] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:29 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1671 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:30.290435 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-36122a95-e4be-47d2-a8fa-d423fba22efa tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:30.291069 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-36122a95-e4be-47d2-a8fa-d423fba22efa tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:30.312143 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-36122a95-e4be-47d2-a8fa-d423fba22efa tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:30.312653 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-36122a95-e4be-47d2-a8fa-d423fba22efa tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:30.313266 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-36122a95-e4be-47d2-a8fa-d423fba22efa tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:30.315805 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-36122a95-e4be-47d2-a8fa-d423fba22efa tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:30.316519 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-36122a95-e4be-47d2-a8fa-d423fba22efa tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:30.316732 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-36122a95-e4be-47d2-a8fa-d423fba22efa tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:30.515333 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-40ca497c-3140-442c-99a5-597efd6f13a6 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb4613d4c0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:30.639920 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-40ca497c-3140-442c-99a5-597efd6f13a6 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/5cdd7779-2b38-4dda-9001-a2279d998ba4" status: 200 len: 1454 microversion: 2.1 time: 0.130552 Aug 31 16:06:30.647018 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1716/3304] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:06:30 2022] GET /compute/v2.1/images/5cdd7779-2b38-4dda-9001-a2279d998ba4 => generated 1454 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:30.875624 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-36122a95-e4be-47d2-a8fa-d423fba22efa tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:30.892634 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-36122a95-e4be-47d2-a8fa-d423fba22efa tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1671 microversion: 2.1 time: 0.607757 Aug 31 16:06:30.944741 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1589/3305] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:30 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1671 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:30.973184 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b8cb0b95-c21c-44f2-9ed0-0d746f3080da tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:30.973813 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b8cb0b95-c21c-44f2-9ed0-0d746f3080da tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:30.988400 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b8cb0b95-c21c-44f2-9ed0-0d746f3080da tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:30.989292 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b8cb0b95-c21c-44f2-9ed0-0d746f3080da tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:30.989913 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b8cb0b95-c21c-44f2-9ed0-0d746f3080da tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:30.993611 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b8cb0b95-c21c-44f2-9ed0-0d746f3080da tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:30.994556 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b8cb0b95-c21c-44f2-9ed0-0d746f3080da tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:30.995365 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b8cb0b95-c21c-44f2-9ed0-0d746f3080da tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:31.374633 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b8cb0b95-c21c-44f2-9ed0-0d746f3080da tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:31.386903 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b8cb0b95-c21c-44f2-9ed0-0d746f3080da tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1671 microversion: 2.1 time: 0.416556 Aug 31 16:06:31.388020 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1717/3306] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:30 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1671 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:06:31.413612 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dc745970-7fec-4852-b256-0201d99b9804 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:31.414511 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dc745970-7fec-4852-b256-0201d99b9804 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:31.428141 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc745970-7fec-4852-b256-0201d99b9804 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:31.431377 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc745970-7fec-4852-b256-0201d99b9804 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:31.432148 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc745970-7fec-4852-b256-0201d99b9804 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:31.434067 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc745970-7fec-4852-b256-0201d99b9804 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:31.437477 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc745970-7fec-4852-b256-0201d99b9804 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:31.438404 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc745970-7fec-4852-b256-0201d99b9804 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:31.658315 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0b9449ce-bd00-4c10-808a-249d05619a98 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb461dcb80>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:31.786850 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0b9449ce-bd00-4c10-808a-249d05619a98 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/5cdd7779-2b38-4dda-9001-a2279d998ba4" status: 200 len: 1454 microversion: 2.1 time: 0.133323 Aug 31 16:06:31.787653 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1718/3307] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:06:31 2022] GET /compute/v2.1/images/5cdd7779-2b38-4dda-9001-a2279d998ba4 => generated 1454 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:31.916448 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dc745970-7fec-4852-b256-0201d99b9804 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:31.930777 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dc745970-7fec-4852-b256-0201d99b9804 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1671 microversion: 2.1 time: 0.522370 Aug 31 16:06:31.947060 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1590/3308] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:31 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1671 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:32.076286 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c1c1ae82-75a6-43ad-8852-b6f84141db75 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-817584702", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "4df1d88e-baa2-45b2-bf09-1af39b3d8e2f"}]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:06:32.204684 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-c1c1ae82-75a6-43ad-8852-b6f84141db75 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] validate_networks() for [('4df1d88e-baa2-45b2-bf09-1af39b3d8e2f', None, None, None, None, None)] {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:06:32.807673 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-32af5ba0-40f6-452e-85aa-aeb215bc473c tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb45e18820>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:32.916722 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-32af5ba0-40f6-452e-85aa-aeb215bc473c tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/5cdd7779-2b38-4dda-9001-a2279d998ba4" status: 200 len: 1454 microversion: 2.1 time: 0.112942 Aug 31 16:06:32.918058 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1591/3309] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:06:32 2022] GET /compute/v2.1/images/5cdd7779-2b38-4dda-9001-a2279d998ba4 => generated 1454 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:06:33.700350 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-c1c1ae82-75a6-43ad-8852-b6f84141db75 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:06:33.701034 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-c1c1ae82-75a6-43ad-8852-b6f84141db75 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:06:33.701655 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-c1c1ae82-75a6-43ad-8852-b6f84141db75 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:06:33.702144 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-c1c1ae82-75a6-43ad-8852-b6f84141db75 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:06:33.702690 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-c1c1ae82-75a6-43ad-8852-b6f84141db75 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:06:33.737827 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c1c1ae82-75a6-43ad-8852-b6f84141db75 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:33.738392 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c1c1ae82-75a6-43ad-8852-b6f84141db75 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:33.738829 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c1c1ae82-75a6-43ad-8852-b6f84141db75 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:33.739569 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c1c1ae82-75a6-43ad-8852-b6f84141db75 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:33.740013 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c1c1ae82-75a6-43ad-8852-b6f84141db75 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:33.740735 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c1c1ae82-75a6-43ad-8852-b6f84141db75 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:33.795155 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-c1c1ae82-75a6-43ad-8852-b6f84141db75 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Getting quotas for project 11ef5102f83142d1a52befe52c3595d4. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:06:33.808555 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-c1c1ae82-75a6-43ad-8852-b6f84141db75 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Getting quotas for user aeeaf32202f747c8a2b98836f503aa7e and project 11ef5102f83142d1a52befe52c3595d4. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:06:33.850527 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c1c1ae82-75a6-43ad-8852-b6f84141db75 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:06:33.855955 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c1c1ae82-75a6-43ad-8852-b6f84141db75 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: ac18e976-69d9-4131-be61-fdbcf1b04173] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:06:33.942901 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a7e5d102-e89d-47cb-88e0-71b5bf093ea9 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb45d11160>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:33.978255 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c1c1ae82-75a6-43ad-8852-b6f84141db75 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.903639 Aug 31 16:06:33.995403 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1719/3310] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:06:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1925 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:06:34.008978 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ec687bb7-e3a4-4050-a40a-e93805a996d6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:34.010064 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ec687bb7-e3a4-4050-a40a-e93805a996d6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: ac18e976-69d9-4131-be61-fdbcf1b04173] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:34.154366 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a7e5d102-e89d-47cb-88e0-71b5bf093ea9 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/5cdd7779-2b38-4dda-9001-a2279d998ba4" status: 200 len: 1454 microversion: 2.1 time: 0.216829 Aug 31 16:06:34.155636 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1592/3311] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:06:33 2022] GET /compute/v2.1/images/5cdd7779-2b38-4dda-9001-a2279d998ba4 => generated 1454 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:34.233032 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ec687bb7-e3a4-4050-a40a-e93805a996d6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:34.242111 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ec687bb7-e3a4-4050-a40a-e93805a996d6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173" status: 200 len: 1214 microversion: 2.1 time: 0.244849 Aug 31 16:06:34.242703 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1720/3312] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:33 2022] GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173 => generated 1214 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:35.172038 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9b43cd32-ce98-4c74-ab0d-c77e1538add2 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb45d3c550>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:35.269691 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-558f7a2b-378a-412f-a193-5e6d7b1e350d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:35.270383 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-558f7a2b-378a-412f-a193-5e6d7b1e350d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: ac18e976-69d9-4131-be61-fdbcf1b04173] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:35.306561 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9b43cd32-ce98-4c74-ab0d-c77e1538add2 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/5cdd7779-2b38-4dda-9001-a2279d998ba4" status: 200 len: 1454 microversion: 2.1 time: 0.139457 Aug 31 16:06:35.307152 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1593/3313] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:06:35 2022] GET /compute/v2.1/images/5cdd7779-2b38-4dda-9001-a2279d998ba4 => generated 1454 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:06:35.680905 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-558f7a2b-378a-412f-a193-5e6d7b1e350d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:35.690171 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-558f7a2b-378a-412f-a193-5e6d7b1e350d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173" status: 200 len: 1214 microversion: 2.1 time: 0.425255 Aug 31 16:06:35.698148 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1721/3314] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:35 2022] GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173 => generated 1214 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:36.324345 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7e5fa6dc-36cc-40cf-afe9-81051cf16222 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb45d114c0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:36.587722 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7e5fa6dc-36cc-40cf-afe9-81051cf16222 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/5cdd7779-2b38-4dda-9001-a2279d998ba4" status: 200 len: 1454 microversion: 2.1 time: 0.268354 Aug 31 16:06:36.594520 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1594/3315] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:06:36 2022] GET /compute/v2.1/images/5cdd7779-2b38-4dda-9001-a2279d998ba4 => generated 1454 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:36.720304 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-71a54074-7f4c-451b-984c-cdc38eb6f93f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:36.720861 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-71a54074-7f4c-451b-984c-cdc38eb6f93f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: ac18e976-69d9-4131-be61-fdbcf1b04173] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:36.748649 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-71a54074-7f4c-451b-984c-cdc38eb6f93f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:36.749151 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-71a54074-7f4c-451b-984c-cdc38eb6f93f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:36.749734 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-71a54074-7f4c-451b-984c-cdc38eb6f93f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:36.762847 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-71a54074-7f4c-451b-984c-cdc38eb6f93f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:36.763363 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-71a54074-7f4c-451b-984c-cdc38eb6f93f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:36.774494 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-71a54074-7f4c-451b-984c-cdc38eb6f93f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:37.049068 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-71a54074-7f4c-451b-984c-cdc38eb6f93f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:37.072052 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-71a54074-7f4c-451b-984c-cdc38eb6f93f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173" status: 200 len: 1266 microversion: 2.1 time: 0.356405 Aug 31 16:06:37.090691 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1722/3316] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:36 2022] GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173 => generated 1266 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:37.624957 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ba182dd7-fab5-41e9-ba5b-d55e32fe49da tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb45d38280>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:37.785406 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ba182dd7-fab5-41e9-ba5b-d55e32fe49da tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/5cdd7779-2b38-4dda-9001-a2279d998ba4" status: 200 len: 1454 microversion: 2.1 time: 0.176661 Aug 31 16:06:37.786210 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1595/3317] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:06:37 2022] GET /compute/v2.1/images/5cdd7779-2b38-4dda-9001-a2279d998ba4 => generated 1454 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:38.110764 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9f98e544-e058-43ee-baff-c88260566db2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:38.112244 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9f98e544-e058-43ee-baff-c88260566db2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: ac18e976-69d9-4131-be61-fdbcf1b04173] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:38.116445 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:06:38.166429 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9f98e544-e058-43ee-baff-c88260566db2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:38.173700 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9f98e544-e058-43ee-baff-c88260566db2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:38.175682 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9f98e544-e058-43ee-baff-c88260566db2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:38.181579 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9f98e544-e058-43ee-baff-c88260566db2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:38.185040 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9f98e544-e058-43ee-baff-c88260566db2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:38.189692 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9f98e544-e058-43ee-baff-c88260566db2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:38.480321 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9f98e544-e058-43ee-baff-c88260566db2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:38.517122 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9f98e544-e058-43ee-baff-c88260566db2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173" status: 200 len: 1272 microversion: 2.1 time: 0.407778 Aug 31 16:06:38.526543 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1723/3318] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:38 2022] GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173 => generated 1272 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:38.804234 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-db24c66a-83f3-44ec-8a2b-51e4f748899f tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb45cc3430>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:38.894561 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-db24c66a-83f3-44ec-8a2b-51e4f748899f tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/5cdd7779-2b38-4dda-9001-a2279d998ba4" status: 200 len: 1454 microversion: 2.1 time: 0.094957 Aug 31 16:06:38.901923 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1596/3319] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:06:38 2022] GET /compute/v2.1/images/5cdd7779-2b38-4dda-9001-a2279d998ba4 => generated 1454 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:39.561947 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-60557e04-53ce-49f6-aba8-0da9594d015c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:39.563109 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-60557e04-53ce-49f6-aba8-0da9594d015c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: ac18e976-69d9-4131-be61-fdbcf1b04173] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:39.583191 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-60557e04-53ce-49f6-aba8-0da9594d015c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:39.585679 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-60557e04-53ce-49f6-aba8-0da9594d015c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:39.586982 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-60557e04-53ce-49f6-aba8-0da9594d015c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:39.589981 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-60557e04-53ce-49f6-aba8-0da9594d015c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:39.591340 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-60557e04-53ce-49f6-aba8-0da9594d015c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:39.592011 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-60557e04-53ce-49f6-aba8-0da9594d015c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:39.918675 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ba6af968-803e-49d5-a59a-a0657591d090 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb45d38c10>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:40.009885 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ba6af968-803e-49d5-a59a-a0657591d090 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/5cdd7779-2b38-4dda-9001-a2279d998ba4" status: 200 len: 1454 microversion: 2.1 time: 0.104548 Aug 31 16:06:40.021037 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1597/3320] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:06:39 2022] GET /compute/v2.1/images/5cdd7779-2b38-4dda-9001-a2279d998ba4 => generated 1454 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:40.171511 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-60557e04-53ce-49f6-aba8-0da9594d015c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:40.183217 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-60557e04-53ce-49f6-aba8-0da9594d015c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173" status: 200 len: 1272 microversion: 2.1 time: 0.625788 Aug 31 16:06:40.186923 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1724/3321] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:39 2022] GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173 => generated 1272 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:06:41.029627 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2cc463e3-2c0b-48eb-8349-b8f9ee49a520 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb45d21310>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:41.141410 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2cc463e3-2c0b-48eb-8349-b8f9ee49a520 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/5cdd7779-2b38-4dda-9001-a2279d998ba4" status: 200 len: 1454 microversion: 2.1 time: 0.116600 Aug 31 16:06:41.149982 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1598/3322] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:06:41 2022] GET /compute/v2.1/images/5cdd7779-2b38-4dda-9001-a2279d998ba4 => generated 1454 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:41.211172 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d43d6105-b1e4-4dc4-b7a4-bbac815ac283 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:41.211976 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d43d6105-b1e4-4dc4-b7a4-bbac815ac283 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: ac18e976-69d9-4131-be61-fdbcf1b04173] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:41.242212 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d43d6105-b1e4-4dc4-b7a4-bbac815ac283 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:41.255289 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d43d6105-b1e4-4dc4-b7a4-bbac815ac283 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:41.259163 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d43d6105-b1e4-4dc4-b7a4-bbac815ac283 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:41.263747 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d43d6105-b1e4-4dc4-b7a4-bbac815ac283 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:41.265247 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d43d6105-b1e4-4dc4-b7a4-bbac815ac283 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:41.267381 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d43d6105-b1e4-4dc4-b7a4-bbac815ac283 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:42.155383 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:06:42.157411 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=12 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:06:42.172676 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e5ef0df2-5b00-472d-b82a-719685d32d9f tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb45d38700>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:42.264288 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e5ef0df2-5b00-472d-b82a-719685d32d9f tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/5cdd7779-2b38-4dda-9001-a2279d998ba4" status: 200 len: 1454 microversion: 2.1 time: 0.110884 Aug 31 16:06:42.271837 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1599/3323] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:06:42 2022] GET /compute/v2.1/images/5cdd7779-2b38-4dda-9001-a2279d998ba4 => generated 1454 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:42.618764 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d43d6105-b1e4-4dc4-b7a4-bbac815ac283 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:42.635690 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=100 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:06:42.649422 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d43d6105-b1e4-4dc4-b7a4-bbac815ac283 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173" status: 200 len: 1314 microversion: 2.1 time: 1.444706 Aug 31 16:06:42.650479 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1725/3324] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:41 2022] GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173 => generated 1314 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:43.282244 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2d1b2d83-1fcf-4a8b-88c8-e3fbbb9762c6 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb45d21670>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:43.370888 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2d1b2d83-1fcf-4a8b-88c8-e3fbbb9762c6 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/5cdd7779-2b38-4dda-9001-a2279d998ba4" status: 200 len: 1463 microversion: 2.1 time: 0.093600 Aug 31 16:06:43.388462 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-918f2c76-ed17-4020-9507-e8fdfe46e7f9 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb4ac575e0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:43.394624 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1600/3325] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:06:43 2022] GET /compute/v2.1/images/5cdd7779-2b38-4dda-9001-a2279d998ba4 => generated 1463 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:43.489586 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-918f2c76-ed17-4020-9507-e8fdfe46e7f9 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/5cdd7779-2b38-4dda-9001-a2279d998ba4" status: 200 len: 1463 microversion: 2.1 time: 0.106097 Aug 31 16:06:43.516155 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1726/3326] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:06:43 2022] GET /compute/v2.1/images/5cdd7779-2b38-4dda-9001-a2279d998ba4 => generated 1463 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:06:43.523458 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2184ccce-33b3-4b85-8e68-8db2219afb3e tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:43.524072 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2184ccce-33b3-4b85-8e68-8db2219afb3e tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] [instance: d3255935-3cff-4bb0-aad2-a8f401028a59] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:43.532448 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2184ccce-33b3-4b85-8e68-8db2219afb3e tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:43.535382 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2184ccce-33b3-4b85-8e68-8db2219afb3e tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:43.536176 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2184ccce-33b3-4b85-8e68-8db2219afb3e tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:43.538954 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2184ccce-33b3-4b85-8e68-8db2219afb3e tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:43.539725 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2184ccce-33b3-4b85-8e68-8db2219afb3e tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:43.542681 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2184ccce-33b3-4b85-8e68-8db2219afb3e tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:43.690946 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f9d8f533-de5d-4112-af0f-9167b13fd918 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:43.692226 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f9d8f533-de5d-4112-af0f-9167b13fd918 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: ac18e976-69d9-4131-be61-fdbcf1b04173] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:43.720782 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f9d8f533-de5d-4112-af0f-9167b13fd918 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:43.737386 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f9d8f533-de5d-4112-af0f-9167b13fd918 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:43.744258 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f9d8f533-de5d-4112-af0f-9167b13fd918 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:43.744258 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f9d8f533-de5d-4112-af0f-9167b13fd918 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:43.744258 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f9d8f533-de5d-4112-af0f-9167b13fd918 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:43.744803 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f9d8f533-de5d-4112-af0f-9167b13fd918 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:43.824575 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:06:44.292108 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2184ccce-33b3-4b85-8e68-8db2219afb3e tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae96c057d884eafb9c2032dd5db9e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a33aeb63a416a9d046e2b67b93f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:44.317611 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2184ccce-33b3-4b85-8e68-8db2219afb3e tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/servers/d3255935-3cff-4bb0-aad2-a8f401028a59" status: 200 len: 1480 microversion: 2.1 time: 0.797873 Aug 31 16:06:44.331475 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1601/3327] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:43 2022] GET /compute/v2.1/servers/d3255935-3cff-4bb0-aad2-a8f401028a59 => generated 1480 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:06:44.343202 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-f7d9b178-333c-479a-9950-2b94faa6d037 req-86f62c54-3a2e-4c1e-af49-b7c5d781e62f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac18e976-69d9-4131-be61-fdbcf1b04173", "tag": "cfd88315-b685-44a6-8390-699b793813af"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:06:44.356730 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f7d9b178-333c-479a-9950-2b94faa6d037 req-86f62c54-3a2e-4c1e-af49-b7c5d781e62f service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:44.357461 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f7d9b178-333c-479a-9950-2b94faa6d037 req-86f62c54-3a2e-4c1e-af49-b7c5d781e62f service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:44.358127 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f7d9b178-333c-479a-9950-2b94faa6d037 req-86f62c54-3a2e-4c1e-af49-b7c5d781e62f service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:44.376487 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-f7d9b178-333c-479a-9950-2b94faa6d037 req-86f62c54-3a2e-4c1e-af49-b7c5d781e62f service nova] Creating event network-changed:cfd88315-b685-44a6-8390-699b793813af for instance ac18e976-69d9-4131-be61-fdbcf1b04173 on n-h2-833090-16 Aug 31 16:06:44.387338 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-f7d9b178-333c-479a-9950-2b94faa6d037 req-86f62c54-3a2e-4c1e-af49-b7c5d781e62f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054475 Aug 31 16:06:44.388501 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1602/3328] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:06:44.696085 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f9d8f533-de5d-4112-af0f-9167b13fd918 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:44.720054 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f9d8f533-de5d-4112-af0f-9167b13fd918 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173" status: 200 len: 1314 microversion: 2.1 time: 1.036067 Aug 31 16:06:44.733478 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1727/3329] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:43 2022] GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173 => generated 1314 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:06:45.360098 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e7343905-b0a9-4ec8-b9cf-35a58d5a344b tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:45.371628 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e7343905-b0a9-4ec8-b9cf-35a58d5a344b tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] [instance: d3255935-3cff-4bb0-aad2-a8f401028a59] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:45.441160 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7343905-b0a9-4ec8-b9cf-35a58d5a344b tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:45.449894 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7343905-b0a9-4ec8-b9cf-35a58d5a344b tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:45.451987 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7343905-b0a9-4ec8-b9cf-35a58d5a344b tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:45.458483 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7343905-b0a9-4ec8-b9cf-35a58d5a344b tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:45.465202 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7343905-b0a9-4ec8-b9cf-35a58d5a344b tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:45.473300 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7343905-b0a9-4ec8-b9cf-35a58d5a344b tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:45.793120 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-de5c1c7d-85ef-4a21-afca-418e8883138e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:45.793883 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-de5c1c7d-85ef-4a21-afca-418e8883138e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: ac18e976-69d9-4131-be61-fdbcf1b04173] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:45.822973 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=10 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:06:45.860118 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-de5c1c7d-85ef-4a21-afca-418e8883138e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:45.866875 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-de5c1c7d-85ef-4a21-afca-418e8883138e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:45.867610 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-de5c1c7d-85ef-4a21-afca-418e8883138e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:45.868547 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-de5c1c7d-85ef-4a21-afca-418e8883138e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:45.869207 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-de5c1c7d-85ef-4a21-afca-418e8883138e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:45.870133 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-de5c1c7d-85ef-4a21-afca-418e8883138e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:46.730390 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e7343905-b0a9-4ec8-b9cf-35a58d5a344b tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae96c057d884eafb9c2032dd5db9e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a33aeb63a416a9d046e2b67b93f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:46.743416 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e7343905-b0a9-4ec8-b9cf-35a58d5a344b tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/servers/d3255935-3cff-4bb0-aad2-a8f401028a59" status: 200 len: 1467 microversion: 2.1 time: 1.401809 Aug 31 16:06:46.744372 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1603/3330] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:45 2022] GET /compute/v2.1/servers/d3255935-3cff-4bb0-aad2-a8f401028a59 => generated 1467 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:46.761533 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-de5c1c7d-85ef-4a21-afca-418e8883138e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:46.771350 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9f5bd5c8-3921-4503-ae3d-668534409977 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-266443599"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:06:46.773614 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9f5bd5c8-3921-4503-ae3d-668534409977 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] [instance: 5c81c9a3-8ba0-4573-a3e8-68292edc1ae2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:46.776364 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-de5c1c7d-85ef-4a21-afca-418e8883138e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173" status: 200 len: 1314 microversion: 2.1 time: 1.017091 Aug 31 16:06:46.779422 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1728/3331] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:45 2022] GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173 => generated 1314 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:46.804960 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f5bd5c8-3921-4503-ae3d-668534409977 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:46.816685 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f5bd5c8-3921-4503-ae3d-668534409977 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:46.817049 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f5bd5c8-3921-4503-ae3d-668534409977 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:46.817761 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f5bd5c8-3921-4503-ae3d-668534409977 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:46.818295 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f5bd5c8-3921-4503-ae3d-668534409977 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:46.818909 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f5bd5c8-3921-4503-ae3d-668534409977 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:47.249729 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9f5bd5c8-3921-4503-ae3d-668534409977 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "POST /compute/v2.1/servers/5c81c9a3-8ba0-4573-a3e8-68292edc1ae2/action" status: 202 len: 0 microversion: 2.1 time: 0.483024 Aug 31 16:06:47.257748 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1604/3332] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:06:46 2022] POST /compute/v2.1/servers/5c81c9a3-8ba0-4573-a3e8-68292edc1ae2/action => generated 0 bytes in 492 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 31 16:06:47.263772 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9d62b517-ca1b-4aa1-81f7-21c9b478efc0 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb4618e700>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:47.357343 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9d62b517-ca1b-4aa1-81f7-21c9b478efc0 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/7eadb01c-f356-40d0-ba94-14397b0d5ed2" status: 200 len: 1454 microversion: 2.1 time: 0.098668 Aug 31 16:06:47.358038 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1729/3333] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:06:47 2022] GET /compute/v2.1/images/7eadb01c-f356-40d0-ba94-14397b0d5ed2 => generated 1454 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:47.809644 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3a726a27-03b7-475e-96a3-b53edc47d901 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:47.816149 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3a726a27-03b7-475e-96a3-b53edc47d901 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: ac18e976-69d9-4131-be61-fdbcf1b04173] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:47.841319 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a726a27-03b7-475e-96a3-b53edc47d901 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:47.842038 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a726a27-03b7-475e-96a3-b53edc47d901 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:47.843900 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a726a27-03b7-475e-96a3-b53edc47d901 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:47.845101 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a726a27-03b7-475e-96a3-b53edc47d901 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:47.845833 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a726a27-03b7-475e-96a3-b53edc47d901 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:47.846614 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a726a27-03b7-475e-96a3-b53edc47d901 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:48.173439 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-54e77e43-2fce-4519-b2f3-d5cc48492d73 req-1d593019-4ad7-4f50-a14f-9731e2ca8955 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3255935-3cff-4bb0-aad2-a8f401028a59", "name": "network-vif-unplugged", "status": "completed", "tag": "21dd4917-2780-427e-86cb-ca75980a35b5"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:06:48.205274 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-54e77e43-2fce-4519-b2f3-d5cc48492d73 req-1d593019-4ad7-4f50-a14f-9731e2ca8955 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:48.206070 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-54e77e43-2fce-4519-b2f3-d5cc48492d73 req-1d593019-4ad7-4f50-a14f-9731e2ca8955 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:48.206753 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-54e77e43-2fce-4519-b2f3-d5cc48492d73 req-1d593019-4ad7-4f50-a14f-9731e2ca8955 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:48.229259 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-54e77e43-2fce-4519-b2f3-d5cc48492d73 req-1d593019-4ad7-4f50-a14f-9731e2ca8955 service nova] Creating event network-vif-unplugged:21dd4917-2780-427e-86cb-ca75980a35b5 for instance d3255935-3cff-4bb0-aad2-a8f401028a59 on n-h2-833090-16 Aug 31 16:06:48.238851 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-54e77e43-2fce-4519-b2f3-d5cc48492d73 req-1d593019-4ad7-4f50-a14f-9731e2ca8955 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070922 Aug 31 16:06:48.239918 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1730/3334] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:06:48.379844 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e4ee5b11-aa8a-40f8-9d52-c80fe210ade9 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb4618e790>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:48.487247 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3a726a27-03b7-475e-96a3-b53edc47d901 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:48.522233 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3a726a27-03b7-475e-96a3-b53edc47d901 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173" status: 200 len: 1314 microversion: 2.1 time: 0.721372 Aug 31 16:06:48.527476 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1605/3335] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:47 2022] GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173 => generated 1314 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:48.548731 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e4ee5b11-aa8a-40f8-9d52-c80fe210ade9 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/7eadb01c-f356-40d0-ba94-14397b0d5ed2" status: 200 len: 1454 microversion: 2.1 time: 0.168984 Aug 31 16:06:48.552125 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1731/3336] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:06:48 2022] GET /compute/v2.1/images/7eadb01c-f356-40d0-ba94-14397b0d5ed2 => generated 1454 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:06:48.568738 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-15f5593a-ce73-44c8-bbc0-66f9a35d88d0 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-453824310", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "39370b19-7cbc-4e21-9ace-fa993a5e662f"}], "block_device_mapping_v2": [{"uuid": "ce33ddaf-ba1b-47ea-a414-8a080cf97726", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:06:48.800647 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-15f5593a-ce73-44c8-bbc0-66f9a35d88d0 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] validate_networks() for [('39370b19-7cbc-4e21-9ace-fa993a5e662f', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:06:49.553841 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-303f9552-e1aa-4cd0-a22f-2b6cd8f85fdf tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:49.554995 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-303f9552-e1aa-4cd0-a22f-2b6cd8f85fdf tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: ac18e976-69d9-4131-be61-fdbcf1b04173] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:49.594569 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-303f9552-e1aa-4cd0-a22f-2b6cd8f85fdf tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:49.598229 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-303f9552-e1aa-4cd0-a22f-2b6cd8f85fdf tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:49.598874 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-303f9552-e1aa-4cd0-a22f-2b6cd8f85fdf tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:49.599984 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-303f9552-e1aa-4cd0-a22f-2b6cd8f85fdf tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:49.601796 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-303f9552-e1aa-4cd0-a22f-2b6cd8f85fdf tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:49.601796 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-303f9552-e1aa-4cd0-a22f-2b6cd8f85fdf tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:50.038502 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-15f5593a-ce73-44c8-bbc0-66f9a35d88d0 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:06:50.039022 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-15f5593a-ce73-44c8-bbc0-66f9a35d88d0 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:06:50.039618 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-15f5593a-ce73-44c8-bbc0-66f9a35d88d0 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:06:50.040663 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-15f5593a-ce73-44c8-bbc0-66f9a35d88d0 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:06:50.041289 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-15f5593a-ce73-44c8-bbc0-66f9a35d88d0 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:06:50.062682 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-15f5593a-ce73-44c8-bbc0-66f9a35d88d0 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:50.063431 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-15f5593a-ce73-44c8-bbc0-66f9a35d88d0 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:50.063865 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-15f5593a-ce73-44c8-bbc0-66f9a35d88d0 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:50.064979 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-15f5593a-ce73-44c8-bbc0-66f9a35d88d0 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:50.066083 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-15f5593a-ce73-44c8-bbc0-66f9a35d88d0 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:50.066757 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-15f5593a-ce73-44c8-bbc0-66f9a35d88d0 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:50.112828 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-15f5593a-ce73-44c8-bbc0-66f9a35d88d0 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Getting quotas for project 1355779c2e2d4cfeb0825b76968867b1. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:06:50.125069 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-15f5593a-ce73-44c8-bbc0-66f9a35d88d0 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Getting quotas for user b9840c71c4ec49c1a60ef97943d173ef and project 1355779c2e2d4cfeb0825b76968867b1. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:06:50.337847 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-15f5593a-ce73-44c8-bbc0-66f9a35d88d0 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:06:50.341231 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-15f5593a-ce73-44c8-bbc0-66f9a35d88d0 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ce33ddaf-ba1b-47ea-a414-8a080cf97726',volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:06:50.573286 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-303f9552-e1aa-4cd0-a22f-2b6cd8f85fdf tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:50.595471 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-303f9552-e1aa-4cd0-a22f-2b6cd8f85fdf tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173" status: 200 len: 1314 microversion: 2.1 time: 1.046208 Aug 31 16:06:50.639503 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1732/3337] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:49 2022] GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173 => generated 1314 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:06:50.656036 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1b463ad1-85b9-45ff-8199-f03a62ffc87b tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb4aa0da60>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:50.670536 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-15f5593a-ce73-44c8-bbc0-66f9a35d88d0 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.137666 Aug 31 16:06:50.671649 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1606/3338] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:06:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 2144 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:06:50.694273 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-76564c83-c62a-4090-96c4-29fb37492263 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:50.695172 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-76564c83-c62a-4090-96c4-29fb37492263 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:50.746207 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1b463ad1-85b9-45ff-8199-f03a62ffc87b tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/7eadb01c-f356-40d0-ba94-14397b0d5ed2" status: 200 len: 1454 microversion: 2.1 time: 0.104448 Aug 31 16:06:50.747006 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1733/3339] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:06:50 2022] GET /compute/v2.1/images/7eadb01c-f356-40d0-ba94-14397b0d5ed2 => generated 1454 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:50.822054 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-76564c83-c62a-4090-96c4-29fb37492263 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:50.832157 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-76564c83-c62a-4090-96c4-29fb37492263 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2" status: 200 len: 1052 microversion: 2.1 time: 0.143033 Aug 31 16:06:50.838597 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1607/3340] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:50 2022] GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2 => generated 1052 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:51.666633 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-39db4c1a-8c92-45d0-aa3b-b54987a4f635 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:51.667549 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-39db4c1a-8c92-45d0-aa3b-b54987a4f635 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: ac18e976-69d9-4131-be61-fdbcf1b04173] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:51.682829 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-39db4c1a-8c92-45d0-aa3b-b54987a4f635 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:51.695111 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-39db4c1a-8c92-45d0-aa3b-b54987a4f635 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:51.695972 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-39db4c1a-8c92-45d0-aa3b-b54987a4f635 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:51.697181 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-39db4c1a-8c92-45d0-aa3b-b54987a4f635 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:51.700248 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-39db4c1a-8c92-45d0-aa3b-b54987a4f635 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:51.701026 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-39db4c1a-8c92-45d0-aa3b-b54987a4f635 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:51.765970 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-37f4ff55-5766-4450-9a73-78ee95ee7849 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb45e2ea60>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:51.922728 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-37f4ff55-5766-4450-9a73-78ee95ee7849 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/7eadb01c-f356-40d0-ba94-14397b0d5ed2" status: 200 len: 1454 microversion: 2.1 time: 0.164256 Aug 31 16:06:51.923844 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1608/3341] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:06:51 2022] GET /compute/v2.1/images/7eadb01c-f356-40d0-ba94-14397b0d5ed2 => generated 1454 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:06:51.946651 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c9eec667-7e1d-4a90-a779-fc2edd224d87 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:51.948987 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c9eec667-7e1d-4a90-a779-fc2edd224d87 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:51.976435 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9eec667-7e1d-4a90-a779-fc2edd224d87 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:51.977033 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9eec667-7e1d-4a90-a779-fc2edd224d87 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:51.979763 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9eec667-7e1d-4a90-a779-fc2edd224d87 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:51.980586 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9eec667-7e1d-4a90-a779-fc2edd224d87 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:51.982331 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9eec667-7e1d-4a90-a779-fc2edd224d87 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:51.984549 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9eec667-7e1d-4a90-a779-fc2edd224d87 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:52.181970 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c9eec667-7e1d-4a90-a779-fc2edd224d87 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:52.199934 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c9eec667-7e1d-4a90-a779-fc2edd224d87 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2" status: 200 len: 1102 microversion: 2.1 time: 0.272449 Aug 31 16:06:52.204077 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1609/3342] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:51 2022] GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2 => generated 1102 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:52.408406 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-39db4c1a-8c92-45d0-aa3b-b54987a4f635 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:52.431759 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-39db4c1a-8c92-45d0-aa3b-b54987a4f635 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173" status: 200 len: 1314 microversion: 2.1 time: 0.770358 Aug 31 16:06:52.433138 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1734/3343] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:51 2022] GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173 => generated 1314 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:52.949991 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1651a437-c5a8-4dad-ba1c-ca2359476639 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb45d5c0d0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:53.047717 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1651a437-c5a8-4dad-ba1c-ca2359476639 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/7eadb01c-f356-40d0-ba94-14397b0d5ed2" status: 200 len: 1454 microversion: 2.1 time: 0.097310 Aug 31 16:06:53.056607 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1610/3344] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:06:52 2022] GET /compute/v2.1/images/7eadb01c-f356-40d0-ba94-14397b0d5ed2 => generated 1454 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:53.229294 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c5a31dcb-7a3c-406b-ba0b-7a07f3cbc233 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:53.230921 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c5a31dcb-7a3c-406b-ba0b-7a07f3cbc233 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:53.245291 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c5a31dcb-7a3c-406b-ba0b-7a07f3cbc233 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:53.248376 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c5a31dcb-7a3c-406b-ba0b-7a07f3cbc233 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:53.249164 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c5a31dcb-7a3c-406b-ba0b-7a07f3cbc233 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:53.255199 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c5a31dcb-7a3c-406b-ba0b-7a07f3cbc233 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:53.256153 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c5a31dcb-7a3c-406b-ba0b-7a07f3cbc233 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:53.258806 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c5a31dcb-7a3c-406b-ba0b-7a07f3cbc233 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:53.467963 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-34dfd63a-268e-4b11-a314-f73fa2d5043e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:53.469051 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-34dfd63a-268e-4b11-a314-f73fa2d5043e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: ac18e976-69d9-4131-be61-fdbcf1b04173] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:53.496089 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-34dfd63a-268e-4b11-a314-f73fa2d5043e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:53.497492 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-34dfd63a-268e-4b11-a314-f73fa2d5043e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:53.498206 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-34dfd63a-268e-4b11-a314-f73fa2d5043e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:53.499885 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-34dfd63a-268e-4b11-a314-f73fa2d5043e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:53.501623 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-34dfd63a-268e-4b11-a314-f73fa2d5043e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:53.505801 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-34dfd63a-268e-4b11-a314-f73fa2d5043e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:53.788860 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c5a31dcb-7a3c-406b-ba0b-7a07f3cbc233 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:53.797923 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c5a31dcb-7a3c-406b-ba0b-7a07f3cbc233 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2" status: 200 len: 1150 microversion: 2.1 time: 0.573234 Aug 31 16:06:53.799062 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1735/3345] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:53 2022] GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2 => generated 1150 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:54.069127 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-488babe2-98c1-4e26-a9ac-6b5164962d4f tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb46176c10>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:54.153558 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-488babe2-98c1-4e26-a9ac-6b5164962d4f tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/7eadb01c-f356-40d0-ba94-14397b0d5ed2" status: 200 len: 1454 microversion: 2.1 time: 0.089960 Aug 31 16:06:54.154917 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1736/3346] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:06:54 2022] GET /compute/v2.1/images/7eadb01c-f356-40d0-ba94-14397b0d5ed2 => generated 1454 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:54.245485 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-34dfd63a-268e-4b11-a314-f73fa2d5043e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:54.259118 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-34dfd63a-268e-4b11-a314-f73fa2d5043e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173" status: 200 len: 1314 microversion: 2.1 time: 0.795518 Aug 31 16:06:54.259756 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1611/3347] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:53 2022] GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173 => generated 1314 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:06:54.850482 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3723f9f1-8bad-443a-8341-885ec7b7bcf4 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:54.855430 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3723f9f1-8bad-443a-8341-885ec7b7bcf4 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:54.898729 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3723f9f1-8bad-443a-8341-885ec7b7bcf4 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:54.905474 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3723f9f1-8bad-443a-8341-885ec7b7bcf4 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:54.906795 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3723f9f1-8bad-443a-8341-885ec7b7bcf4 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:54.909177 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3723f9f1-8bad-443a-8341-885ec7b7bcf4 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:54.910643 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3723f9f1-8bad-443a-8341-885ec7b7bcf4 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:54.914717 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3723f9f1-8bad-443a-8341-885ec7b7bcf4 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:55.101354 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3723f9f1-8bad-443a-8341-885ec7b7bcf4 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:55.114837 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3723f9f1-8bad-443a-8341-885ec7b7bcf4 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2" status: 200 len: 1168 microversion: 2.1 time: 0.285564 Aug 31 16:06:55.118785 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1737/3348] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:54 2022] GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2 => generated 1168 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:55.170302 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-667ac174-0f8f-4085-bcbc-0341607337c6 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb45daab80>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:55.244943 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-667ac174-0f8f-4085-bcbc-0341607337c6 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/7eadb01c-f356-40d0-ba94-14397b0d5ed2" status: 200 len: 1454 microversion: 2.1 time: 0.079675 Aug 31 16:06:55.245862 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1612/3349] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:06:55 2022] GET /compute/v2.1/images/7eadb01c-f356-40d0-ba94-14397b0d5ed2 => generated 1454 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:55.281018 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a5981916-2b58-447c-9740-13e45b1b2bad tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:55.281631 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a5981916-2b58-447c-9740-13e45b1b2bad tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: ac18e976-69d9-4131-be61-fdbcf1b04173] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:55.292495 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5981916-2b58-447c-9740-13e45b1b2bad tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:55.293005 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5981916-2b58-447c-9740-13e45b1b2bad tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:55.293441 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5981916-2b58-447c-9740-13e45b1b2bad tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:55.294418 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5981916-2b58-447c-9740-13e45b1b2bad tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:55.294981 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5981916-2b58-447c-9740-13e45b1b2bad tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:55.295432 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5981916-2b58-447c-9740-13e45b1b2bad tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:55.809404 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a5981916-2b58-447c-9740-13e45b1b2bad tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:55.830470 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a5981916-2b58-447c-9740-13e45b1b2bad tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173" status: 200 len: 1314 microversion: 2.1 time: 0.553173 Aug 31 16:06:55.849084 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1738/3350] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:55 2022] GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173 => generated 1314 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:55.931193 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-efe75787-6040-46eb-8e71-d8b711af846d req-706844de-b915-485e-b6f5-63874e724026 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac18e976-69d9-4131-be61-fdbcf1b04173", "name": "network-vif-plugged", "status": "completed", "tag": "cfd88315-b685-44a6-8390-699b793813af"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:06:55.951668 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-efe75787-6040-46eb-8e71-d8b711af846d req-706844de-b915-485e-b6f5-63874e724026 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:55.953837 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-efe75787-6040-46eb-8e71-d8b711af846d req-706844de-b915-485e-b6f5-63874e724026 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:55.954414 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-efe75787-6040-46eb-8e71-d8b711af846d req-706844de-b915-485e-b6f5-63874e724026 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:55.981270 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-efe75787-6040-46eb-8e71-d8b711af846d req-706844de-b915-485e-b6f5-63874e724026 service nova] Creating event network-vif-plugged:cfd88315-b685-44a6-8390-699b793813af for instance ac18e976-69d9-4131-be61-fdbcf1b04173 on n-h2-833090-16 Aug 31 16:06:56.000033 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-efe75787-6040-46eb-8e71-d8b711af846d req-706844de-b915-485e-b6f5-63874e724026 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072601 Aug 31 16:06:56.002464 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1613/3351] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:06:56.139359 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0f089411-f27e-47cc-b280-784362291559 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:56.141132 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0f089411-f27e-47cc-b280-784362291559 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:56.153660 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0f089411-f27e-47cc-b280-784362291559 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:56.154474 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0f089411-f27e-47cc-b280-784362291559 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:56.159169 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0f089411-f27e-47cc-b280-784362291559 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:56.160152 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0f089411-f27e-47cc-b280-784362291559 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:56.160790 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0f089411-f27e-47cc-b280-784362291559 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:56.161363 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0f089411-f27e-47cc-b280-784362291559 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:56.261075 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-60ca3184-32de-43d6-b99b-9ed7b60c5063 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb45d98a60>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:56.313577 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-60ca3184-32de-43d6-b99b-9ed7b60c5063 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/7eadb01c-f356-40d0-ba94-14397b0d5ed2" status: 200 len: 1454 microversion: 2.1 time: 0.056910 Aug 31 16:06:56.314849 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1614/3352] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:06:56 2022] GET /compute/v2.1/images/7eadb01c-f356-40d0-ba94-14397b0d5ed2 => generated 1454 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:56.456065 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0f089411-f27e-47cc-b280-784362291559 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:56.475613 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0f089411-f27e-47cc-b280-784362291559 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2" status: 200 len: 1168 microversion: 2.1 time: 0.336957 Aug 31 16:06:56.476180 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1739/3353] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:56 2022] GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2 => generated 1168 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:56.855994 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-075cc6bd-32eb-4551-ac16-07e5ee8ae6c9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:56.857489 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-075cc6bd-32eb-4551-ac16-07e5ee8ae6c9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: ac18e976-69d9-4131-be61-fdbcf1b04173] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:56.870457 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-075cc6bd-32eb-4551-ac16-07e5ee8ae6c9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:56.874127 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-075cc6bd-32eb-4551-ac16-07e5ee8ae6c9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:56.874630 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-075cc6bd-32eb-4551-ac16-07e5ee8ae6c9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:56.875925 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-075cc6bd-32eb-4551-ac16-07e5ee8ae6c9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:56.876386 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-075cc6bd-32eb-4551-ac16-07e5ee8ae6c9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:56.879096 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-075cc6bd-32eb-4551-ac16-07e5ee8ae6c9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:57.077219 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c26b2ccf-ecea-41b0-b546-046dc9603a2c tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-265933648", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "36bfd2bd-b0b1-487d-9fc4-77b72f85faef"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:06:57.177759 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-c26b2ccf-ecea-41b0-b546-046dc9603a2c tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] validate_networks() for [('36bfd2bd-b0b1-487d-9fc4-77b72f85faef', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:06:57.741389 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-075cc6bd-32eb-4551-ac16-07e5ee8ae6c9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:57.756344 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-075cc6bd-32eb-4551-ac16-07e5ee8ae6c9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173" status: 200 len: 1314 microversion: 2.1 time: 0.905280 Aug 31 16:06:57.758262 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1740/3354] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:56 2022] GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173 => generated 1314 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:57.777270 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e3b29ecc-31ce-4c05-9510-19c412de6360 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb4613d790>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:57.842981 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e3b29ecc-31ce-4c05-9510-19c412de6360 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/7eadb01c-f356-40d0-ba94-14397b0d5ed2" status: 200 len: 1454 microversion: 2.1 time: 0.080688 Aug 31 16:06:57.843578 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1741/3355] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:06:57 2022] GET /compute/v2.1/images/7eadb01c-f356-40d0-ba94-14397b0d5ed2 => generated 1454 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:57.856153 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-43cc584e-59ce-4145-98a4-55e7ed542378 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:57.870625 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-43cc584e-59ce-4145-98a4-55e7ed542378 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:57.877723 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-43cc584e-59ce-4145-98a4-55e7ed542378 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:57.878599 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-43cc584e-59ce-4145-98a4-55e7ed542378 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:57.879197 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-43cc584e-59ce-4145-98a4-55e7ed542378 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:57.879922 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-43cc584e-59ce-4145-98a4-55e7ed542378 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:57.880379 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-43cc584e-59ce-4145-98a4-55e7ed542378 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:57.880806 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-43cc584e-59ce-4145-98a4-55e7ed542378 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:58.248896 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-43cc584e-59ce-4145-98a4-55e7ed542378 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:58.297956 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-43cc584e-59ce-4145-98a4-55e7ed542378 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2" status: 200 len: 1210 microversion: 2.1 time: 0.445466 Aug 31 16:06:58.300551 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1742/3356] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:57 2022] GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2 => generated 1210 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:58.436446 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-46a1f17e-ac7b-41d2-a2d8-b0e8071826a7 req-a3202bcf-5cd2-4b70-ae4d-31c8f8d93f42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4729162e-f8a9-4952-a3e0-be75936208f2", "tag": "cba9d0d4-250d-490b-a5a2-c919d3ee3547"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:06:58.470060 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-46a1f17e-ac7b-41d2-a2d8-b0e8071826a7 req-a3202bcf-5cd2-4b70-ae4d-31c8f8d93f42 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:58.475651 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-46a1f17e-ac7b-41d2-a2d8-b0e8071826a7 req-a3202bcf-5cd2-4b70-ae4d-31c8f8d93f42 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:58.476250 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-46a1f17e-ac7b-41d2-a2d8-b0e8071826a7 req-a3202bcf-5cd2-4b70-ae4d-31c8f8d93f42 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:58.507707 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-46a1f17e-ac7b-41d2-a2d8-b0e8071826a7 req-a3202bcf-5cd2-4b70-ae4d-31c8f8d93f42 service nova] Creating event network-changed:cba9d0d4-250d-490b-a5a2-c919d3ee3547 for instance 4729162e-f8a9-4952-a3e0-be75936208f2 on n-h1-833090-16 Aug 31 16:06:58.523431 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-46a1f17e-ac7b-41d2-a2d8-b0e8071826a7 req-a3202bcf-5cd2-4b70-ae4d-31c8f8d93f42 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090013 Aug 31 16:06:58.524756 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1743/3357] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:06:58.544990 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-c26b2ccf-ecea-41b0-b546-046dc9603a2c tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:06:58.545493 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-c26b2ccf-ecea-41b0-b546-046dc9603a2c tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:06:58.546189 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-c26b2ccf-ecea-41b0-b546-046dc9603a2c tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:06:58.546690 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-c26b2ccf-ecea-41b0-b546-046dc9603a2c tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:06:58.547189 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-c26b2ccf-ecea-41b0-b546-046dc9603a2c tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:06:58.578448 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c26b2ccf-ecea-41b0-b546-046dc9603a2c tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:58.579798 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c26b2ccf-ecea-41b0-b546-046dc9603a2c tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:58.592631 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c26b2ccf-ecea-41b0-b546-046dc9603a2c tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:58.593762 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c26b2ccf-ecea-41b0-b546-046dc9603a2c tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:58.594416 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c26b2ccf-ecea-41b0-b546-046dc9603a2c tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:58.595608 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c26b2ccf-ecea-41b0-b546-046dc9603a2c tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:58.708457 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-c26b2ccf-ecea-41b0-b546-046dc9603a2c tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Getting quotas for project 12ef34f80f184d78bca45976af8b1f48. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:06:58.726664 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-c26b2ccf-ecea-41b0-b546-046dc9603a2c tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Getting quotas for user fc9490c5b9774ac7827b27af8e151bb7 and project 12ef34f80f184d78bca45976af8b1f48. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:06:58.765178 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c26b2ccf-ecea-41b0-b546-046dc9603a2c tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:06:58.771064 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c26b2ccf-ecea-41b0-b546-046dc9603a2c tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] [instance: 5c3dd875-58f6-4ddc-847b-c2518e193470] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:06:58.790552 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-af05ef6e-0181-46f5-8cab-992fb086b4f9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:58.791816 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-af05ef6e-0181-46f5-8cab-992fb086b4f9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: ac18e976-69d9-4131-be61-fdbcf1b04173] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:58.815433 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-af05ef6e-0181-46f5-8cab-992fb086b4f9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:58.822664 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-af05ef6e-0181-46f5-8cab-992fb086b4f9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:58.824132 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-af05ef6e-0181-46f5-8cab-992fb086b4f9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:58.828890 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-af05ef6e-0181-46f5-8cab-992fb086b4f9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:58.833813 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-af05ef6e-0181-46f5-8cab-992fb086b4f9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:58.837314 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-af05ef6e-0181-46f5-8cab-992fb086b4f9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:58.932919 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c26b2ccf-ecea-41b0-b546-046dc9603a2c tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.118061 Aug 31 16:06:58.949431 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1615/3358] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:06:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 2133 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:06:58.972365 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f75f38a7-14f6-4d23-bd25-5a652fd96bdb tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb45d26e50>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:59.111941 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f75f38a7-14f6-4d23-bd25-5a652fd96bdb tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/7eadb01c-f356-40d0-ba94-14397b0d5ed2" status: 200 len: 1454 microversion: 2.1 time: 0.154688 Aug 31 16:06:59.115663 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1616/3359] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:06:58 2022] GET /compute/v2.1/images/7eadb01c-f356-40d0-ba94-14397b0d5ed2 => generated 1454 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:59.136092 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-231979d2-2e27-44ff-b05c-19c886326b80 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:59.136740 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-231979d2-2e27-44ff-b05c-19c886326b80 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] [instance: 5c3dd875-58f6-4ddc-847b-c2518e193470] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:59.375662 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-231979d2-2e27-44ff-b05c-19c886326b80 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9490c5b9774ac7827b27af8e151bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ef34f80f184d78bca45976af8b1f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:59.392197 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-231979d2-2e27-44ff-b05c-19c886326b80 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] 10.222.0.50 "GET /compute/v2.1/servers/5c3dd875-58f6-4ddc-847b-c2518e193470" status: 200 len: 1224 microversion: 2.1 time: 0.269960 Aug 31 16:06:59.395800 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1617/3360] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:59 2022] GET /compute/v2.1/servers/5c3dd875-58f6-4ddc-847b-c2518e193470 => generated 1224 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:59.412307 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2e4500c4-d682-42d6-b8e2-db1b2ad87a04 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:59.413566 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2e4500c4-d682-42d6-b8e2-db1b2ad87a04 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:59.429007 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e4500c4-d682-42d6-b8e2-db1b2ad87a04 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:59.430211 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e4500c4-d682-42d6-b8e2-db1b2ad87a04 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:59.431782 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e4500c4-d682-42d6-b8e2-db1b2ad87a04 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:59.432868 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e4500c4-d682-42d6-b8e2-db1b2ad87a04 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:59.435860 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e4500c4-d682-42d6-b8e2-db1b2ad87a04 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:59.436467 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e4500c4-d682-42d6-b8e2-db1b2ad87a04 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:59.598564 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-af05ef6e-0181-46f5-8cab-992fb086b4f9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:06:59.645474 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-af05ef6e-0181-46f5-8cab-992fb086b4f9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173" status: 200 len: 1501 microversion: 2.1 time: 0.853653 Aug 31 16:06:59.658495 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1744/3361] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:58 2022] GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173 => generated 1501 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:06:59.669059 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6f7d0d91-4d55-41f5-9749-b8f39e4e7c13 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:06:59.670387 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6f7d0d91-4d55-41f5-9749-b8f39e4e7c13 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: ac18e976-69d9-4131-be61-fdbcf1b04173] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:59.684333 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f7d0d91-4d55-41f5-9749-b8f39e4e7c13 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:59.684879 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f7d0d91-4d55-41f5-9749-b8f39e4e7c13 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:59.685456 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f7d0d91-4d55-41f5-9749-b8f39e4e7c13 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:59.686295 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f7d0d91-4d55-41f5-9749-b8f39e4e7c13 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:59.686795 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f7d0d91-4d55-41f5-9749-b8f39e4e7c13 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:59.687257 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f7d0d91-4d55-41f5-9749-b8f39e4e7c13 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:59.896480 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6f7d0d91-4d55-41f5-9749-b8f39e4e7c13 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "POST /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173/action" status: 202 len: 0 microversion: 2.1 time: 0.228371 Aug 31 16:06:59.900880 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1745/3362] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:06:59 2022] POST /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:06:59.914631 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f53a91dd-671c-43a0-9052-5fa0792980c3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:06:59.937783 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f53a91dd-671c-43a0-9052-5fa0792980c3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: ac18e976-69d9-4131-be61-fdbcf1b04173] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:06:59.962518 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f53a91dd-671c-43a0-9052-5fa0792980c3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:59.963017 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f53a91dd-671c-43a0-9052-5fa0792980c3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:59.963457 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f53a91dd-671c-43a0-9052-5fa0792980c3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:06:59.964170 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f53a91dd-671c-43a0-9052-5fa0792980c3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:06:59.964634 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f53a91dd-671c-43a0-9052-5fa0792980c3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:06:59.965176 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f53a91dd-671c-43a0-9052-5fa0792980c3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:00.056979 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2e4500c4-d682-42d6-b8e2-db1b2ad87a04 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:00.067281 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2e4500c4-d682-42d6-b8e2-db1b2ad87a04 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2" status: 200 len: 1210 microversion: 2.1 time: 0.669900 Aug 31 16:07:00.073604 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1618/3363] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:59 2022] GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2 => generated 1210 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:00.130040 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c97ff203-34df-4df9-8b2f-c02a6863f83d tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb4aa9cf70>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:00.238144 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c97ff203-34df-4df9-8b2f-c02a6863f83d tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/7eadb01c-f356-40d0-ba94-14397b0d5ed2" status: 200 len: 1454 microversion: 2.1 time: 0.111971 Aug 31 16:07:00.239443 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1619/3364] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:07:00 2022] GET /compute/v2.1/images/7eadb01c-f356-40d0-ba94-14397b0d5ed2 => generated 1454 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:00.413282 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-996cf102-b220-41a3-8b5a-c57f5f9ba24d tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:00.414370 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-996cf102-b220-41a3-8b5a-c57f5f9ba24d tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] [instance: 5c3dd875-58f6-4ddc-847b-c2518e193470] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:00.427761 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-996cf102-b220-41a3-8b5a-c57f5f9ba24d tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:00.431098 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-996cf102-b220-41a3-8b5a-c57f5f9ba24d tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:00.434837 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-996cf102-b220-41a3-8b5a-c57f5f9ba24d tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:00.434837 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-996cf102-b220-41a3-8b5a-c57f5f9ba24d tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:00.434837 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-996cf102-b220-41a3-8b5a-c57f5f9ba24d tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:00.434837 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-996cf102-b220-41a3-8b5a-c57f5f9ba24d tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:00.742753 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-996cf102-b220-41a3-8b5a-c57f5f9ba24d tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9490c5b9774ac7827b27af8e151bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ef34f80f184d78bca45976af8b1f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:00.756772 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-996cf102-b220-41a3-8b5a-c57f5f9ba24d tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] 10.222.0.50 "GET /compute/v2.1/servers/5c3dd875-58f6-4ddc-847b-c2518e193470" status: 200 len: 1220 microversion: 2.1 time: 0.345937 Aug 31 16:07:00.760784 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1620/3365] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:00 2022] GET /compute/v2.1/servers/5c3dd875-58f6-4ddc-847b-c2518e193470 => generated 1220 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:07:00.845662 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f53a91dd-671c-43a0-9052-5fa0792980c3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:00.879335 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f53a91dd-671c-43a0-9052-5fa0792980c3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173" status: 200 len: 1506 microversion: 2.1 time: 0.969608 Aug 31 16:07:00.879939 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1746/3366] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:06:59 2022] GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173 => generated 1506 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:01.094511 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4ece6683-12ba-450a-be17-1b45fc62f424 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:01.095145 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4ece6683-12ba-450a-be17-1b45fc62f424 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:01.145020 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ece6683-12ba-450a-be17-1b45fc62f424 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:01.145554 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ece6683-12ba-450a-be17-1b45fc62f424 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:01.146079 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ece6683-12ba-450a-be17-1b45fc62f424 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:01.153551 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ece6683-12ba-450a-be17-1b45fc62f424 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:01.154059 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ece6683-12ba-450a-be17-1b45fc62f424 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:01.160217 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ece6683-12ba-450a-be17-1b45fc62f424 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:01.256101 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5c43d054-feb6-4a44-9de8-6c18ac44c4ed tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb461dcd30>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:01.375841 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5c43d054-feb6-4a44-9de8-6c18ac44c4ed tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/7eadb01c-f356-40d0-ba94-14397b0d5ed2" status: 200 len: 1454 microversion: 2.1 time: 0.124426 Aug 31 16:07:01.376700 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1747/3367] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:07:01 2022] GET /compute/v2.1/images/7eadb01c-f356-40d0-ba94-14397b0d5ed2 => generated 1454 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:01.803545 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-91eaf545-84d5-4e6a-9f4b-68a63e26728b tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:01.804455 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-91eaf545-84d5-4e6a-9f4b-68a63e26728b tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] [instance: 5c3dd875-58f6-4ddc-847b-c2518e193470] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:01.820368 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91eaf545-84d5-4e6a-9f4b-68a63e26728b tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:01.824370 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91eaf545-84d5-4e6a-9f4b-68a63e26728b tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:01.825935 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91eaf545-84d5-4e6a-9f4b-68a63e26728b tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:01.828438 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91eaf545-84d5-4e6a-9f4b-68a63e26728b tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:01.829325 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91eaf545-84d5-4e6a-9f4b-68a63e26728b tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:01.831636 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91eaf545-84d5-4e6a-9f4b-68a63e26728b tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:02.401068 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-91eaf545-84d5-4e6a-9f4b-68a63e26728b tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9490c5b9774ac7827b27af8e151bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ef34f80f184d78bca45976af8b1f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:02.437651 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-91eaf545-84d5-4e6a-9f4b-68a63e26728b tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] 10.222.0.50 "GET /compute/v2.1/servers/5c3dd875-58f6-4ddc-847b-c2518e193470" status: 200 len: 1276 microversion: 2.1 time: 0.639654 Aug 31 16:07:02.455103 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1748/3368] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:01 2022] GET /compute/v2.1/servers/5c3dd875-58f6-4ddc-847b-c2518e193470 => generated 1276 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:07:02.481641 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-43a5100d-83a2-40d1-b0f0-6dabceef0294 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:02.496251 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-43a5100d-83a2-40d1-b0f0-6dabceef0294 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: ac18e976-69d9-4131-be61-fdbcf1b04173] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:02.514802 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-43a5100d-83a2-40d1-b0f0-6dabceef0294 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:02.515730 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-43a5100d-83a2-40d1-b0f0-6dabceef0294 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:02.519120 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-43a5100d-83a2-40d1-b0f0-6dabceef0294 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:02.520034 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-43a5100d-83a2-40d1-b0f0-6dabceef0294 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:02.523342 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-43a5100d-83a2-40d1-b0f0-6dabceef0294 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:02.523919 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-43a5100d-83a2-40d1-b0f0-6dabceef0294 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:04.323444 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4ece6683-12ba-450a-be17-1b45fc62f424 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:04.357122 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4ece6683-12ba-450a-be17-1b45fc62f424 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2" status: 200 len: 1210 microversion: 2.1 time: 3.267463 Aug 31 16:07:04.360128 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1621/3369] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:01 2022] GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2 => generated 1210 bytes in 3271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:04.365351 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-56664de6-4da2-44fa-8535-2e937cf04de8 req-16082b7b-c4c5-490c-9b69-5f88e29c2aac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c81c9a3-8ba0-4573-a3e8-68292edc1ae2", "name": "network-vif-plugged", "status": "completed", "tag": "fe966be1-351a-44fb-bfbd-7233088e6030"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:07:04.416450 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-56664de6-4da2-44fa-8535-2e937cf04de8 req-16082b7b-c4c5-490c-9b69-5f88e29c2aac service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:04.416930 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-56664de6-4da2-44fa-8535-2e937cf04de8 req-16082b7b-c4c5-490c-9b69-5f88e29c2aac service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:04.417360 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-56664de6-4da2-44fa-8535-2e937cf04de8 req-16082b7b-c4c5-490c-9b69-5f88e29c2aac service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:04.493472 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-56664de6-4da2-44fa-8535-2e937cf04de8 req-16082b7b-c4c5-490c-9b69-5f88e29c2aac service nova] Creating event network-vif-plugged:fe966be1-351a-44fb-bfbd-7233088e6030 for instance 5c81c9a3-8ba0-4573-a3e8-68292edc1ae2 on n-h2-833090-16 Aug 31 16:07:04.513220 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-56664de6-4da2-44fa-8535-2e937cf04de8 req-16082b7b-c4c5-490c-9b69-5f88e29c2aac service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151733 Aug 31 16:07:04.513844 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1622/3370] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:07:04.544959 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1cdc3ed5-ac11-4761-a40e-86af27176016 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb45cc2160>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:04.654223 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1cdc3ed5-ac11-4761-a40e-86af27176016 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/7eadb01c-f356-40d0-ba94-14397b0d5ed2" status: 200 len: 1454 microversion: 2.1 time: 0.128115 Aug 31 16:07:04.654809 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1623/3371] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:07:04 2022] GET /compute/v2.1/images/7eadb01c-f356-40d0-ba94-14397b0d5ed2 => generated 1454 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:04.665758 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4b478226-75e8-4b38-8d1c-ec24ec8bead9 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:04.685902 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4b478226-75e8-4b38-8d1c-ec24ec8bead9 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] [instance: 5c3dd875-58f6-4ddc-847b-c2518e193470] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:04.715964 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b478226-75e8-4b38-8d1c-ec24ec8bead9 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:04.716482 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b478226-75e8-4b38-8d1c-ec24ec8bead9 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:04.716909 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b478226-75e8-4b38-8d1c-ec24ec8bead9 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:04.720864 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b478226-75e8-4b38-8d1c-ec24ec8bead9 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:04.721418 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b478226-75e8-4b38-8d1c-ec24ec8bead9 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:04.721855 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b478226-75e8-4b38-8d1c-ec24ec8bead9 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:04.772168 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-43a5100d-83a2-40d1-b0f0-6dabceef0294 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:04.774569 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:07:04.792670 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-43a5100d-83a2-40d1-b0f0-6dabceef0294 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173" status: 200 len: 1486 microversion: 2.1 time: 2.336020 Aug 31 16:07:04.793368 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1749/3372] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:02 2022] GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173 => generated 1486 bytes in 2338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:04.819742 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-177798bf-b58a-4090-ad86-59afe1d085f9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:07:04.820944 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-177798bf-b58a-4090-ad86-59afe1d085f9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: ac18e976-69d9-4131-be61-fdbcf1b04173] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:04.841633 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-177798bf-b58a-4090-ad86-59afe1d085f9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:04.854912 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-177798bf-b58a-4090-ad86-59afe1d085f9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:04.858301 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-177798bf-b58a-4090-ad86-59afe1d085f9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:04.859814 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-177798bf-b58a-4090-ad86-59afe1d085f9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:04.867310 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-177798bf-b58a-4090-ad86-59afe1d085f9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:04.868174 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-177798bf-b58a-4090-ad86-59afe1d085f9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:04.966320 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-177798bf-b58a-4090-ad86-59afe1d085f9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lazy-loading 'flavor' on Instance uuid ac18e976-69d9-4131-be61-fdbcf1b04173 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:07:05.242863 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4b478226-75e8-4b38-8d1c-ec24ec8bead9 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9490c5b9774ac7827b27af8e151bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ef34f80f184d78bca45976af8b1f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:05.262824 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4b478226-75e8-4b38-8d1c-ec24ec8bead9 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] 10.222.0.50 "GET /compute/v2.1/servers/5c3dd875-58f6-4ddc-847b-c2518e193470" status: 200 len: 1282 microversion: 2.1 time: 0.602553 Aug 31 16:07:05.263768 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1624/3373] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:04 2022] GET /compute/v2.1/servers/5c3dd875-58f6-4ddc-847b-c2518e193470 => generated 1282 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:05.382261 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-73129717-175d-4e60-a26c-54f30bf7cd48 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:05.383329 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-73129717-175d-4e60-a26c-54f30bf7cd48 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:05.426054 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-73129717-175d-4e60-a26c-54f30bf7cd48 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:05.426903 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-73129717-175d-4e60-a26c-54f30bf7cd48 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:05.427632 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-73129717-175d-4e60-a26c-54f30bf7cd48 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:05.428788 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-73129717-175d-4e60-a26c-54f30bf7cd48 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:05.429556 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-73129717-175d-4e60-a26c-54f30bf7cd48 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:05.451084 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-73129717-175d-4e60-a26c-54f30bf7cd48 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:05.519833 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-177798bf-b58a-4090-ad86-59afe1d085f9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "POST /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173/action" status: 202 len: 0 microversion: 2.1 time: 0.703135 Aug 31 16:07:05.538268 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1750/3374] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:07:04 2022] POST /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173/action => generated 0 bytes in 725 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:07:05.570771 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-60d0453f-3fba-4ccb-b134-4df8c69d976e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:05.574401 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-60d0453f-3fba-4ccb-b134-4df8c69d976e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: ac18e976-69d9-4131-be61-fdbcf1b04173] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:05.638028 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-60d0453f-3fba-4ccb-b134-4df8c69d976e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:05.643345 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-60d0453f-3fba-4ccb-b134-4df8c69d976e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:05.644769 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-60d0453f-3fba-4ccb-b134-4df8c69d976e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:05.649360 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-60d0453f-3fba-4ccb-b134-4df8c69d976e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:05.650431 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-60d0453f-3fba-4ccb-b134-4df8c69d976e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:05.652012 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-60d0453f-3fba-4ccb-b134-4df8c69d976e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:06.033714 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-73129717-175d-4e60-a26c-54f30bf7cd48 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:06.067092 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-73129717-175d-4e60-a26c-54f30bf7cd48 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2" status: 200 len: 1210 microversion: 2.1 time: 0.691181 Aug 31 16:07:06.076092 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1625/3375] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:05 2022] GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2 => generated 1210 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:07:06.094007 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-823afc5a-8777-4fd3-983d-3d2bd8243fdf tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb45d3c3a0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:06.155891 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-60d0453f-3fba-4ccb-b134-4df8c69d976e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:06.171648 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-60d0453f-3fba-4ccb-b134-4df8c69d976e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173" status: 200 len: 1492 microversion: 2.1 time: 0.621788 Aug 31 16:07:06.175670 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1751/3376] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:05 2022] GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173 => generated 1492 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:06.202993 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-823afc5a-8777-4fd3-983d-3d2bd8243fdf tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/7eadb01c-f356-40d0-ba94-14397b0d5ed2" status: 200 len: 1454 microversion: 2.1 time: 0.124936 Aug 31 16:07:06.203597 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1626/3377] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:07:06 2022] GET /compute/v2.1/images/7eadb01c-f356-40d0-ba94-14397b0d5ed2 => generated 1454 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:06.289179 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6d90de4e-42f4-4dd4-99a2-86b1afa9525f tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:06.290764 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6d90de4e-42f4-4dd4-99a2-86b1afa9525f tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] [instance: 5c3dd875-58f6-4ddc-847b-c2518e193470] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:06.314265 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d90de4e-42f4-4dd4-99a2-86b1afa9525f tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:06.315826 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d90de4e-42f4-4dd4-99a2-86b1afa9525f tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:06.316569 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d90de4e-42f4-4dd4-99a2-86b1afa9525f tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:06.317590 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d90de4e-42f4-4dd4-99a2-86b1afa9525f tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:06.318342 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d90de4e-42f4-4dd4-99a2-86b1afa9525f tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:06.319845 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d90de4e-42f4-4dd4-99a2-86b1afa9525f tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:06.417241 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6d90de4e-42f4-4dd4-99a2-86b1afa9525f tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9490c5b9774ac7827b27af8e151bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ef34f80f184d78bca45976af8b1f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:06.427941 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6d90de4e-42f4-4dd4-99a2-86b1afa9525f tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] 10.222.0.50 "GET /compute/v2.1/servers/5c3dd875-58f6-4ddc-847b-c2518e193470" status: 200 len: 1282 microversion: 2.1 time: 0.145516 Aug 31 16:07:06.429201 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1752/3378] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:06 2022] GET /compute/v2.1/servers/5c3dd875-58f6-4ddc-847b-c2518e193470 => generated 1282 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:07.112086 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a16446e6-b363-4650-8f0d-4fce1f5bce0e tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:07.116525 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a16446e6-b363-4650-8f0d-4fce1f5bce0e tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:07.152844 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a16446e6-b363-4650-8f0d-4fce1f5bce0e tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:07.154971 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a16446e6-b363-4650-8f0d-4fce1f5bce0e tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:07.157910 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a16446e6-b363-4650-8f0d-4fce1f5bce0e tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:07.159239 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a16446e6-b363-4650-8f0d-4fce1f5bce0e tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:07.160206 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a16446e6-b363-4650-8f0d-4fce1f5bce0e tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:07.161655 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a16446e6-b363-4650-8f0d-4fce1f5bce0e tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:07.200726 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-75de0fed-cd4e-4615-bb8e-784dcde7371b tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:07.202725 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-75de0fed-cd4e-4615-bb8e-784dcde7371b tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: ac18e976-69d9-4131-be61-fdbcf1b04173] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:07.238131 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-75de0fed-cd4e-4615-bb8e-784dcde7371b tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:07.242715 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-75de0fed-cd4e-4615-bb8e-784dcde7371b tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:07.246456 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-75de0fed-cd4e-4615-bb8e-784dcde7371b tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:07.251122 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-75de0fed-cd4e-4615-bb8e-784dcde7371b tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:07.254377 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-75de0fed-cd4e-4615-bb8e-784dcde7371b tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:07.257790 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-75de0fed-cd4e-4615-bb8e-784dcde7371b tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:07.596701 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a16446e6-b363-4650-8f0d-4fce1f5bce0e tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:07.619015 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a16446e6-b363-4650-8f0d-4fce1f5bce0e tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2" status: 200 len: 1210 microversion: 2.1 time: 0.525127 Aug 31 16:07:07.619964 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1627/3379] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:07 2022] GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2 => generated 1210 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:07.630840 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b1f5e4b9-efb1-4b9c-b53e-c48485b4a516 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb45cc2280>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:07.709704 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b1f5e4b9-efb1-4b9c-b53e-c48485b4a516 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/7eadb01c-f356-40d0-ba94-14397b0d5ed2" status: 200 len: 1454 microversion: 2.1 time: 0.087405 Aug 31 16:07:07.714905 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1628/3380] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:07:07 2022] GET /compute/v2.1/images/7eadb01c-f356-40d0-ba94-14397b0d5ed2 => generated 1454 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:07.723437 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e72d0e00-6de6-431c-9de9-4e20b6faf474 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:07.727442 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e72d0e00-6de6-431c-9de9-4e20b6faf474 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] [instance: 5c3dd875-58f6-4ddc-847b-c2518e193470] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:07.743399 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e72d0e00-6de6-431c-9de9-4e20b6faf474 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:07.747615 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e72d0e00-6de6-431c-9de9-4e20b6faf474 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:07.748373 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e72d0e00-6de6-431c-9de9-4e20b6faf474 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:07.750637 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e72d0e00-6de6-431c-9de9-4e20b6faf474 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:07.751420 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e72d0e00-6de6-431c-9de9-4e20b6faf474 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:07.752088 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e72d0e00-6de6-431c-9de9-4e20b6faf474 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:07.789061 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-75de0fed-cd4e-4615-bb8e-784dcde7371b tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:07.810655 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-75de0fed-cd4e-4615-bb8e-784dcde7371b tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173" status: 200 len: 1492 microversion: 2.1 time: 0.621372 Aug 31 16:07:07.816856 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1753/3381] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:07 2022] GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173 => generated 1492 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:07:08.126325 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e72d0e00-6de6-431c-9de9-4e20b6faf474 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9490c5b9774ac7827b27af8e151bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ef34f80f184d78bca45976af8b1f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:08.145009 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e72d0e00-6de6-431c-9de9-4e20b6faf474 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] 10.222.0.50 "GET /compute/v2.1/servers/5c3dd875-58f6-4ddc-847b-c2518e193470" status: 200 len: 1324 microversion: 2.1 time: 0.428576 Aug 31 16:07:08.146161 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1629/3382] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:07 2022] GET /compute/v2.1/servers/5c3dd875-58f6-4ddc-847b-c2518e193470 => generated 1324 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:08.640963 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9cca413b-b811-439d-947f-928e295547e7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:08.641641 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9cca413b-b811-439d-947f-928e295547e7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:08.645011 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=48 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:07:08.665709 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9cca413b-b811-439d-947f-928e295547e7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:08.670027 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9cca413b-b811-439d-947f-928e295547e7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:08.673215 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9cca413b-b811-439d-947f-928e295547e7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:08.680010 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9cca413b-b811-439d-947f-928e295547e7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:08.682825 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9cca413b-b811-439d-947f-928e295547e7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:08.683394 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9cca413b-b811-439d-947f-928e295547e7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:08.759895 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-44648719-bfd5-4440-ab27-b8edff85d5db tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb45d984c0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:08.796200 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:07:09.100736 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9cca413b-b811-439d-947f-928e295547e7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:09.111548 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9cca413b-b811-439d-947f-928e295547e7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2" status: 200 len: 1198 microversion: 2.1 time: 0.474605 Aug 31 16:07:09.115134 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1754/3383] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:08 2022] GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2 => generated 1198 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:09.132462 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f05f221c-9f63-47aa-8393-453a31c5e341 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:09.138637 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f05f221c-9f63-47aa-8393-453a31c5e341 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: ac18e976-69d9-4131-be61-fdbcf1b04173] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:09.151333 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f05f221c-9f63-47aa-8393-453a31c5e341 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:09.157965 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f05f221c-9f63-47aa-8393-453a31c5e341 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:09.158466 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f05f221c-9f63-47aa-8393-453a31c5e341 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:09.159265 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f05f221c-9f63-47aa-8393-453a31c5e341 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:09.159730 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f05f221c-9f63-47aa-8393-453a31c5e341 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:09.160158 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f05f221c-9f63-47aa-8393-453a31c5e341 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:09.383664 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=16 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:07:09.456813 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f05f221c-9f63-47aa-8393-453a31c5e341 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:09.473248 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f05f221c-9f63-47aa-8393-453a31c5e341 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173" status: 200 len: 1513 microversion: 2.1 time: 0.353449 Aug 31 16:07:09.473865 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1755/3384] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:09 2022] GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173 => generated 1513 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:09.511595 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-99b8b721-4e58-44cc-847d-3273d8e200d9 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:09.512248 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-99b8b721-4e58-44cc-847d-3273d8e200d9 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] [instance: 5c3dd875-58f6-4ddc-847b-c2518e193470] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:09.526238 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-99b8b721-4e58-44cc-847d-3273d8e200d9 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:09.526918 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-99b8b721-4e58-44cc-847d-3273d8e200d9 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:09.527597 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-99b8b721-4e58-44cc-847d-3273d8e200d9 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:09.528519 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-99b8b721-4e58-44cc-847d-3273d8e200d9 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:09.529145 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-99b8b721-4e58-44cc-847d-3273d8e200d9 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:09.529837 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-99b8b721-4e58-44cc-847d-3273d8e200d9 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:09.832958 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-99b8b721-4e58-44cc-847d-3273d8e200d9 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9490c5b9774ac7827b27af8e151bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ef34f80f184d78bca45976af8b1f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:09.855243 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-99b8b721-4e58-44cc-847d-3273d8e200d9 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] 10.222.0.50 "GET /compute/v2.1/servers/5c3dd875-58f6-4ddc-847b-c2518e193470" status: 200 len: 1324 microversion: 2.1 time: 0.359136 Aug 31 16:07:09.856630 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1756/3385] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:09 2022] GET /compute/v2.1/servers/5c3dd875-58f6-4ddc-847b-c2518e193470 => generated 1324 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:10.051732 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-2b542b44-c4d7-4da6-84ef-5dc8775e43ab req-c528dfac-1137-4477-bdaf-c410002912a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c3dd875-58f6-4ddc-847b-c2518e193470", "tag": "44a33b5e-ea58-4246-8900-67ca022aa00f"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:07:10.080673 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-2b542b44-c4d7-4da6-84ef-5dc8775e43ab req-c528dfac-1137-4477-bdaf-c410002912a5 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:10.086437 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-2b542b44-c4d7-4da6-84ef-5dc8775e43ab req-c528dfac-1137-4477-bdaf-c410002912a5 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:10.087279 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-2b542b44-c4d7-4da6-84ef-5dc8775e43ab req-c528dfac-1137-4477-bdaf-c410002912a5 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:10.110519 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-2b542b44-c4d7-4da6-84ef-5dc8775e43ab req-c528dfac-1137-4477-bdaf-c410002912a5 service nova] Creating event network-changed:44a33b5e-ea58-4246-8900-67ca022aa00f for instance 5c3dd875-58f6-4ddc-847b-c2518e193470 on n-h2-833090-16 Aug 31 16:07:10.131849 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-2b542b44-c4d7-4da6-84ef-5dc8775e43ab req-c528dfac-1137-4477-bdaf-c410002912a5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091346 Aug 31 16:07:10.133061 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1757/3386] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:07:10.144321 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9ee2f22d-d790-4179-9367-4ab23989a0c7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:10.146340 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9ee2f22d-d790-4179-9367-4ab23989a0c7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:10.170003 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ee2f22d-d790-4179-9367-4ab23989a0c7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:10.170952 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ee2f22d-d790-4179-9367-4ab23989a0c7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:10.171646 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ee2f22d-d790-4179-9367-4ab23989a0c7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:10.172622 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ee2f22d-d790-4179-9367-4ab23989a0c7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:10.173321 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ee2f22d-d790-4179-9367-4ab23989a0c7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:10.173971 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ee2f22d-d790-4179-9367-4ab23989a0c7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:10.429807 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9ee2f22d-d790-4179-9367-4ab23989a0c7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:10.447129 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9ee2f22d-d790-4179-9367-4ab23989a0c7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2" status: 200 len: 1198 microversion: 2.1 time: 0.312430 Aug 31 16:07:10.449796 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1758/3387] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:10 2022] GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2 => generated 1198 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:10.495974 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d95fc2db-f519-422e-9cc7-77adb99f360d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:10.496751 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d95fc2db-f519-422e-9cc7-77adb99f360d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: ac18e976-69d9-4131-be61-fdbcf1b04173] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:10.516832 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d95fc2db-f519-422e-9cc7-77adb99f360d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:10.517485 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d95fc2db-f519-422e-9cc7-77adb99f360d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:10.518064 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d95fc2db-f519-422e-9cc7-77adb99f360d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:10.518890 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d95fc2db-f519-422e-9cc7-77adb99f360d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:10.519609 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d95fc2db-f519-422e-9cc7-77adb99f360d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:10.520477 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d95fc2db-f519-422e-9cc7-77adb99f360d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:10.905132 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d95fc2db-f519-422e-9cc7-77adb99f360d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:10.936494 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d95fc2db-f519-422e-9cc7-77adb99f360d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173" status: 200 len: 1513 microversion: 2.1 time: 0.443434 Aug 31 16:07:10.936494 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1759/3388] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:10 2022] GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173 => generated 1513 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:10.960865 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-deb15621-822d-49fb-8c8c-061ff35faeb5 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:10.977537 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-deb15621-822d-49fb-8c8c-061ff35faeb5 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] [instance: 5c3dd875-58f6-4ddc-847b-c2518e193470] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:10.999164 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-deb15621-822d-49fb-8c8c-061ff35faeb5 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:10.999665 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-deb15621-822d-49fb-8c8c-061ff35faeb5 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:11.000104 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-deb15621-822d-49fb-8c8c-061ff35faeb5 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:11.000835 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-deb15621-822d-49fb-8c8c-061ff35faeb5 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:11.001292 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-deb15621-822d-49fb-8c8c-061ff35faeb5 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:11.004752 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-deb15621-822d-49fb-8c8c-061ff35faeb5 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:11.458293 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-deb15621-822d-49fb-8c8c-061ff35faeb5 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9490c5b9774ac7827b27af8e151bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ef34f80f184d78bca45976af8b1f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:11.473315 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-deb15621-822d-49fb-8c8c-061ff35faeb5 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] 10.222.0.50 "GET /compute/v2.1/servers/5c3dd875-58f6-4ddc-847b-c2518e193470" status: 200 len: 1324 microversion: 2.1 time: 0.535408 Aug 31 16:07:11.489577 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1760/3389] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:10 2022] GET /compute/v2.1/servers/5c3dd875-58f6-4ddc-847b-c2518e193470 => generated 1324 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:11.497863 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-78712be0-b224-4b79-a811-0b79030d2039 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:11.501602 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-78712be0-b224-4b79-a811-0b79030d2039 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:11.523606 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-78712be0-b224-4b79-a811-0b79030d2039 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:11.525579 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-78712be0-b224-4b79-a811-0b79030d2039 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:11.527851 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-78712be0-b224-4b79-a811-0b79030d2039 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:11.528856 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-78712be0-b224-4b79-a811-0b79030d2039 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:11.531509 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-78712be0-b224-4b79-a811-0b79030d2039 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:11.532193 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-78712be0-b224-4b79-a811-0b79030d2039 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:11.834771 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-78712be0-b224-4b79-a811-0b79030d2039 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:11.844253 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-78712be0-b224-4b79-a811-0b79030d2039 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2" status: 200 len: 1198 microversion: 2.1 time: 0.350121 Aug 31 16:07:11.845293 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1761/3390] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:11 2022] GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2 => generated 1198 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:11.852286 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-82c7bd39-ad76-4953-aaf5-b4402147b202 req-85f7a1b6-6c0c-4636-8190-a7a60751f1f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac18e976-69d9-4131-be61-fdbcf1b04173", "name": "network-vif-plugged", "status": "completed", "tag": "cfd88315-b685-44a6-8390-699b793813af"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:07:11.872008 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-82c7bd39-ad76-4953-aaf5-b4402147b202 req-85f7a1b6-6c0c-4636-8190-a7a60751f1f1 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:11.873749 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-82c7bd39-ad76-4953-aaf5-b4402147b202 req-85f7a1b6-6c0c-4636-8190-a7a60751f1f1 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:11.874713 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-82c7bd39-ad76-4953-aaf5-b4402147b202 req-85f7a1b6-6c0c-4636-8190-a7a60751f1f1 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:11.910989 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-82c7bd39-ad76-4953-aaf5-b4402147b202 req-85f7a1b6-6c0c-4636-8190-a7a60751f1f1 service nova] Creating event network-vif-plugged:cfd88315-b685-44a6-8390-699b793813af for instance ac18e976-69d9-4131-be61-fdbcf1b04173 on n-h2-833090-16 Aug 31 16:07:11.920517 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-82c7bd39-ad76-4953-aaf5-b4402147b202 req-85f7a1b6-6c0c-4636-8190-a7a60751f1f1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073754 Aug 31 16:07:11.924440 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1762/3391] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:07:11.963847 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-76874013-76f5-4d57-b0c9-df9eb6104d34 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:11.965107 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-76874013-76f5-4d57-b0c9-df9eb6104d34 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: ac18e976-69d9-4131-be61-fdbcf1b04173] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:11.976112 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76874013-76f5-4d57-b0c9-df9eb6104d34 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:11.976811 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76874013-76f5-4d57-b0c9-df9eb6104d34 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:11.977240 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76874013-76f5-4d57-b0c9-df9eb6104d34 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:11.978084 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76874013-76f5-4d57-b0c9-df9eb6104d34 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:11.978710 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76874013-76f5-4d57-b0c9-df9eb6104d34 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:11.979289 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76874013-76f5-4d57-b0c9-df9eb6104d34 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:12.318527 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-76874013-76f5-4d57-b0c9-df9eb6104d34 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:12.331227 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-76874013-76f5-4d57-b0c9-df9eb6104d34 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173" status: 200 len: 1513 microversion: 2.1 time: 0.371827 Aug 31 16:07:12.334954 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1763/3392] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:11 2022] GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173 => generated 1513 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:07:12.511098 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2793b2a3-bc6b-481d-a848-0f65cef1328d tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:12.511971 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2793b2a3-bc6b-481d-a848-0f65cef1328d tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] [instance: 5c3dd875-58f6-4ddc-847b-c2518e193470] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:12.533482 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2793b2a3-bc6b-481d-a848-0f65cef1328d tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:12.534910 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2793b2a3-bc6b-481d-a848-0f65cef1328d tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:12.535859 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2793b2a3-bc6b-481d-a848-0f65cef1328d tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:12.538272 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2793b2a3-bc6b-481d-a848-0f65cef1328d tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:12.540273 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2793b2a3-bc6b-481d-a848-0f65cef1328d tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:12.541379 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2793b2a3-bc6b-481d-a848-0f65cef1328d tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:12.811346 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2793b2a3-bc6b-481d-a848-0f65cef1328d tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9490c5b9774ac7827b27af8e151bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ef34f80f184d78bca45976af8b1f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:12.820579 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2793b2a3-bc6b-481d-a848-0f65cef1328d tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] 10.222.0.50 "GET /compute/v2.1/servers/5c3dd875-58f6-4ddc-847b-c2518e193470" status: 200 len: 1324 microversion: 2.1 time: 0.328355 Aug 31 16:07:12.821181 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1764/3393] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:12 2022] GET /compute/v2.1/servers/5c3dd875-58f6-4ddc-847b-c2518e193470 => generated 1324 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:07:12.874381 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-89bab28e-efec-4e6f-ae52-69f2214047f2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:12.874998 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-89bab28e-efec-4e6f-ae52-69f2214047f2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:12.888311 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-89bab28e-efec-4e6f-ae52-69f2214047f2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:12.888814 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-89bab28e-efec-4e6f-ae52-69f2214047f2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:12.889249 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-89bab28e-efec-4e6f-ae52-69f2214047f2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:12.889957 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-89bab28e-efec-4e6f-ae52-69f2214047f2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:12.890437 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-89bab28e-efec-4e6f-ae52-69f2214047f2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:12.890858 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-89bab28e-efec-4e6f-ae52-69f2214047f2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:13.196513 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-89bab28e-efec-4e6f-ae52-69f2214047f2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:13.204941 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:07:13.214448 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-89bab28e-efec-4e6f-ae52-69f2214047f2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2" status: 200 len: 1198 microversion: 2.1 time: 0.342114 Aug 31 16:07:13.216103 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1765/3394] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:12 2022] GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2 => generated 1198 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:07:13.357348 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f4d37ed1-df55-4e14-9f78-fd2bf70e94ff tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:13.361006 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f4d37ed1-df55-4e14-9f78-fd2bf70e94ff tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: ac18e976-69d9-4131-be61-fdbcf1b04173] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:13.375928 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f4d37ed1-df55-4e14-9f78-fd2bf70e94ff tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:13.377474 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f4d37ed1-df55-4e14-9f78-fd2bf70e94ff tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:13.378325 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f4d37ed1-df55-4e14-9f78-fd2bf70e94ff tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:13.381696 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f4d37ed1-df55-4e14-9f78-fd2bf70e94ff tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:13.382494 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f4d37ed1-df55-4e14-9f78-fd2bf70e94ff tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:13.383198 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f4d37ed1-df55-4e14-9f78-fd2bf70e94ff tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:13.643995 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f4d37ed1-df55-4e14-9f78-fd2bf70e94ff tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:13.653550 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f4d37ed1-df55-4e14-9f78-fd2bf70e94ff tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173" status: 200 len: 1513 microversion: 2.1 time: 0.303781 Aug 31 16:07:13.654809 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1766/3395] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:13 2022] GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173 => generated 1513 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:13.844405 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-229de225-e317-4b8f-b21d-e13e7b9948e3 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:13.845022 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-229de225-e317-4b8f-b21d-e13e7b9948e3 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] [instance: 5c3dd875-58f6-4ddc-847b-c2518e193470] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:13.859850 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-229de225-e317-4b8f-b21d-e13e7b9948e3 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:13.860339 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-229de225-e317-4b8f-b21d-e13e7b9948e3 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:13.860771 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-229de225-e317-4b8f-b21d-e13e7b9948e3 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:13.861470 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-229de225-e317-4b8f-b21d-e13e7b9948e3 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:13.863008 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-229de225-e317-4b8f-b21d-e13e7b9948e3 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:13.863008 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-229de225-e317-4b8f-b21d-e13e7b9948e3 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:14.090944 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-229de225-e317-4b8f-b21d-e13e7b9948e3 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9490c5b9774ac7827b27af8e151bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ef34f80f184d78bca45976af8b1f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:14.109728 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-229de225-e317-4b8f-b21d-e13e7b9948e3 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] 10.222.0.50 "GET /compute/v2.1/servers/5c3dd875-58f6-4ddc-847b-c2518e193470" status: 200 len: 1324 microversion: 2.1 time: 0.269480 Aug 31 16:07:14.111175 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1767/3396] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:13 2022] GET /compute/v2.1/servers/5c3dd875-58f6-4ddc-847b-c2518e193470 => generated 1324 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:14.237955 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0fe59bca-2523-4ffc-9c16-2b85e6f1e303 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:14.239636 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0fe59bca-2523-4ffc-9c16-2b85e6f1e303 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:14.251536 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0fe59bca-2523-4ffc-9c16-2b85e6f1e303 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:14.260747 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0fe59bca-2523-4ffc-9c16-2b85e6f1e303 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:14.261316 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0fe59bca-2523-4ffc-9c16-2b85e6f1e303 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:14.262337 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0fe59bca-2523-4ffc-9c16-2b85e6f1e303 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:14.263000 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0fe59bca-2523-4ffc-9c16-2b85e6f1e303 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:14.263614 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0fe59bca-2523-4ffc-9c16-2b85e6f1e303 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:14.652048 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0fe59bca-2523-4ffc-9c16-2b85e6f1e303 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:14.666895 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0fe59bca-2523-4ffc-9c16-2b85e6f1e303 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2" status: 200 len: 1198 microversion: 2.1 time: 0.429955 Aug 31 16:07:14.666895 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1768/3397] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:14 2022] GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2 => generated 1198 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:14.678336 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1390355f-0675-4f36-bb68-c009be042fa7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:14.680461 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1390355f-0675-4f36-bb68-c009be042fa7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: ac18e976-69d9-4131-be61-fdbcf1b04173] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:14.701108 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1390355f-0675-4f36-bb68-c009be042fa7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:14.703159 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1390355f-0675-4f36-bb68-c009be042fa7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:14.703804 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1390355f-0675-4f36-bb68-c009be042fa7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:14.708685 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1390355f-0675-4f36-bb68-c009be042fa7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:14.710358 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1390355f-0675-4f36-bb68-c009be042fa7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:14.710810 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1390355f-0675-4f36-bb68-c009be042fa7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:15.051571 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1390355f-0675-4f36-bb68-c009be042fa7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:15.061298 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1390355f-0675-4f36-bb68-c009be042fa7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173" status: 200 len: 1513 microversion: 2.1 time: 0.386939 Aug 31 16:07:15.062562 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1769/3398] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:14 2022] GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173 => generated 1513 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:07:15.137957 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9e689dc7-21f5-4d4f-8eef-4a0c6ce41745 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:15.140170 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9e689dc7-21f5-4d4f-8eef-4a0c6ce41745 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] [instance: 5c3dd875-58f6-4ddc-847b-c2518e193470] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:15.156565 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9e689dc7-21f5-4d4f-8eef-4a0c6ce41745 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:15.158152 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9e689dc7-21f5-4d4f-8eef-4a0c6ce41745 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:15.158904 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9e689dc7-21f5-4d4f-8eef-4a0c6ce41745 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:15.160399 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9e689dc7-21f5-4d4f-8eef-4a0c6ce41745 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:15.163024 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9e689dc7-21f5-4d4f-8eef-4a0c6ce41745 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:15.165184 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9e689dc7-21f5-4d4f-8eef-4a0c6ce41745 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:15.441701 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9e689dc7-21f5-4d4f-8eef-4a0c6ce41745 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9490c5b9774ac7827b27af8e151bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ef34f80f184d78bca45976af8b1f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:15.461443 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9e689dc7-21f5-4d4f-8eef-4a0c6ce41745 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] 10.222.0.50 "GET /compute/v2.1/servers/5c3dd875-58f6-4ddc-847b-c2518e193470" status: 200 len: 1324 microversion: 2.1 time: 0.331406 Aug 31 16:07:15.465455 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1770/3399] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:15 2022] GET /compute/v2.1/servers/5c3dd875-58f6-4ddc-847b-c2518e193470 => generated 1324 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:15.692439 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6a95031a-25fb-4716-a9cf-3d2b4fbe3aee tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:15.693420 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6a95031a-25fb-4716-a9cf-3d2b4fbe3aee tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:15.722867 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6a95031a-25fb-4716-a9cf-3d2b4fbe3aee tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:15.726761 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6a95031a-25fb-4716-a9cf-3d2b4fbe3aee tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:15.729854 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6a95031a-25fb-4716-a9cf-3d2b4fbe3aee tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:15.730843 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6a95031a-25fb-4716-a9cf-3d2b4fbe3aee tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:15.732275 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6a95031a-25fb-4716-a9cf-3d2b4fbe3aee tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:15.733501 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6a95031a-25fb-4716-a9cf-3d2b4fbe3aee tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:15.986170 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6a95031a-25fb-4716-a9cf-3d2b4fbe3aee tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:15.997439 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6a95031a-25fb-4716-a9cf-3d2b4fbe3aee tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2" status: 200 len: 1198 microversion: 2.1 time: 0.316233 Aug 31 16:07:16.014647 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1771/3400] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:15 2022] GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2 => generated 1198 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:07:16.086427 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0ea34288-eb00-4c08-82bb-1e7fe2f22490 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:16.087404 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0ea34288-eb00-4c08-82bb-1e7fe2f22490 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: ac18e976-69d9-4131-be61-fdbcf1b04173] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:16.099808 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0ea34288-eb00-4c08-82bb-1e7fe2f22490 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:16.101557 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0ea34288-eb00-4c08-82bb-1e7fe2f22490 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:16.104759 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0ea34288-eb00-4c08-82bb-1e7fe2f22490 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:16.106554 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0ea34288-eb00-4c08-82bb-1e7fe2f22490 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:16.107322 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0ea34288-eb00-4c08-82bb-1e7fe2f22490 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:16.111716 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0ea34288-eb00-4c08-82bb-1e7fe2f22490 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:16.301810 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0ea34288-eb00-4c08-82bb-1e7fe2f22490 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:16.313241 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0ea34288-eb00-4c08-82bb-1e7fe2f22490 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173" status: 200 len: 1513 microversion: 2.1 time: 0.231656 Aug 31 16:07:16.314892 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1772/3401] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:16 2022] GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173 => generated 1513 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:16.489573 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0c062e80-de84-40d2-9d4e-101085ed2987 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:16.491410 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0c062e80-de84-40d2-9d4e-101085ed2987 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] [instance: 5c3dd875-58f6-4ddc-847b-c2518e193470] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:16.502885 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0c062e80-de84-40d2-9d4e-101085ed2987 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:16.505960 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0c062e80-de84-40d2-9d4e-101085ed2987 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:16.506522 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0c062e80-de84-40d2-9d4e-101085ed2987 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:16.507388 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0c062e80-de84-40d2-9d4e-101085ed2987 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:16.508810 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0c062e80-de84-40d2-9d4e-101085ed2987 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:16.509849 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0c062e80-de84-40d2-9d4e-101085ed2987 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:16.721884 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0c062e80-de84-40d2-9d4e-101085ed2987 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9490c5b9774ac7827b27af8e151bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ef34f80f184d78bca45976af8b1f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:16.733296 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0c062e80-de84-40d2-9d4e-101085ed2987 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] 10.222.0.50 "GET /compute/v2.1/servers/5c3dd875-58f6-4ddc-847b-c2518e193470" status: 200 len: 1324 microversion: 2.1 time: 0.245698 Aug 31 16:07:16.734465 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1773/3402] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:16 2022] GET /compute/v2.1/servers/5c3dd875-58f6-4ddc-847b-c2518e193470 => generated 1324 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:17.022251 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fb6ea9ec-e5e0-48a7-8ad2-ae8e89ca6f9d tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:17.026966 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fb6ea9ec-e5e0-48a7-8ad2-ae8e89ca6f9d tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:17.041567 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb6ea9ec-e5e0-48a7-8ad2-ae8e89ca6f9d tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:17.042543 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb6ea9ec-e5e0-48a7-8ad2-ae8e89ca6f9d tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:17.043258 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb6ea9ec-e5e0-48a7-8ad2-ae8e89ca6f9d tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:17.044265 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb6ea9ec-e5e0-48a7-8ad2-ae8e89ca6f9d tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:17.050773 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb6ea9ec-e5e0-48a7-8ad2-ae8e89ca6f9d tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:17.051684 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb6ea9ec-e5e0-48a7-8ad2-ae8e89ca6f9d tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:17.482346 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-fb6ea9ec-e5e0-48a7-8ad2-ae8e89ca6f9d tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:17.508057 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fb6ea9ec-e5e0-48a7-8ad2-ae8e89ca6f9d tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2" status: 200 len: 1198 microversion: 2.1 time: 0.489894 Aug 31 16:07:17.525283 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1774/3403] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:17 2022] GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2 => generated 1198 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:17.542265 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2c7bde8f-d418-4f78-9e7f-4162666f64e3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:17.542907 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2c7bde8f-d418-4f78-9e7f-4162666f64e3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: ac18e976-69d9-4131-be61-fdbcf1b04173] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:17.566685 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2c7bde8f-d418-4f78-9e7f-4162666f64e3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:17.568126 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2c7bde8f-d418-4f78-9e7f-4162666f64e3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:17.572372 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2c7bde8f-d418-4f78-9e7f-4162666f64e3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:17.577393 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2c7bde8f-d418-4f78-9e7f-4162666f64e3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:17.583039 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2c7bde8f-d418-4f78-9e7f-4162666f64e3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:17.586752 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2c7bde8f-d418-4f78-9e7f-4162666f64e3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:17.742810 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:07:18.135482 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:07:18.243413 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2c7bde8f-d418-4f78-9e7f-4162666f64e3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:18.260729 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2c7bde8f-d418-4f78-9e7f-4162666f64e3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173" status: 200 len: 1508 microversion: 2.1 time: 0.725667 Aug 31 16:07:18.262464 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1775/3404] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:17 2022] GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173 => generated 1508 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:18.276800 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-efbab557-0af1-431b-a63c-99d500f3c478 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:18.277519 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-efbab557-0af1-431b-a63c-99d500f3c478 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] [instance: 5c3dd875-58f6-4ddc-847b-c2518e193470] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:18.290925 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-efbab557-0af1-431b-a63c-99d500f3c478 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:18.291413 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-efbab557-0af1-431b-a63c-99d500f3c478 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:18.291842 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-efbab557-0af1-431b-a63c-99d500f3c478 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:18.292550 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-efbab557-0af1-431b-a63c-99d500f3c478 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:18.312956 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-efbab557-0af1-431b-a63c-99d500f3c478 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:18.313923 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-efbab557-0af1-431b-a63c-99d500f3c478 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:18.926779 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-efbab557-0af1-431b-a63c-99d500f3c478 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9490c5b9774ac7827b27af8e151bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ef34f80f184d78bca45976af8b1f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:18.939257 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-efbab557-0af1-431b-a63c-99d500f3c478 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] 10.222.0.50 "GET /compute/v2.1/servers/5c3dd875-58f6-4ddc-847b-c2518e193470" status: 200 len: 1324 microversion: 2.1 time: 0.674008 Aug 31 16:07:18.940219 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1776/3405] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:18 2022] GET /compute/v2.1/servers/5c3dd875-58f6-4ddc-847b-c2518e193470 => generated 1324 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:18.969195 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f4c3c78e-2b0f-4ea7-91bc-1287239b64af tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:18.969817 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f4c3c78e-2b0f-4ea7-91bc-1287239b64af tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:18.995139 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f4c3c78e-2b0f-4ea7-91bc-1287239b64af tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:18.995628 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f4c3c78e-2b0f-4ea7-91bc-1287239b64af tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:18.996064 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f4c3c78e-2b0f-4ea7-91bc-1287239b64af tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:18.996781 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f4c3c78e-2b0f-4ea7-91bc-1287239b64af tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:18.997231 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f4c3c78e-2b0f-4ea7-91bc-1287239b64af tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:18.997649 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f4c3c78e-2b0f-4ea7-91bc-1287239b64af tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:19.568795 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f4c3c78e-2b0f-4ea7-91bc-1287239b64af tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:19.611361 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f4c3c78e-2b0f-4ea7-91bc-1287239b64af tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2" status: 200 len: 1198 microversion: 2.1 time: 0.654763 Aug 31 16:07:19.612607 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1777/3406] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:18 2022] GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2 => generated 1198 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:19.642175 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1bbba478-4a26-4fac-9f39-c6a2a0400555 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:19.646930 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1bbba478-4a26-4fac-9f39-c6a2a0400555 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: ac18e976-69d9-4131-be61-fdbcf1b04173] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:19.688247 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1bbba478-4a26-4fac-9f39-c6a2a0400555 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:19.693464 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1bbba478-4a26-4fac-9f39-c6a2a0400555 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:19.698465 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1bbba478-4a26-4fac-9f39-c6a2a0400555 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:19.700353 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1bbba478-4a26-4fac-9f39-c6a2a0400555 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:19.705421 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1bbba478-4a26-4fac-9f39-c6a2a0400555 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:19.712293 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1bbba478-4a26-4fac-9f39-c6a2a0400555 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:20.395059 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1bbba478-4a26-4fac-9f39-c6a2a0400555 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:20.410647 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1bbba478-4a26-4fac-9f39-c6a2a0400555 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173" status: 200 len: 1508 microversion: 2.1 time: 0.791279 Aug 31 16:07:20.411922 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1778/3407] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:19 2022] GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173 => generated 1508 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:20.444883 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ad9d0bd6-2593-4f3c-b613-dc1b92084dbd tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:20.445946 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ad9d0bd6-2593-4f3c-b613-dc1b92084dbd tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] [instance: 5c3dd875-58f6-4ddc-847b-c2518e193470] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:20.458725 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ad9d0bd6-2593-4f3c-b613-dc1b92084dbd tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:20.464768 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ad9d0bd6-2593-4f3c-b613-dc1b92084dbd tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:20.469416 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ad9d0bd6-2593-4f3c-b613-dc1b92084dbd tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:20.471167 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ad9d0bd6-2593-4f3c-b613-dc1b92084dbd tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:20.475964 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ad9d0bd6-2593-4f3c-b613-dc1b92084dbd tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:20.476765 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ad9d0bd6-2593-4f3c-b613-dc1b92084dbd tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:20.745234 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ad9d0bd6-2593-4f3c-b613-dc1b92084dbd tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9490c5b9774ac7827b27af8e151bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ef34f80f184d78bca45976af8b1f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:20.754909 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ad9d0bd6-2593-4f3c-b613-dc1b92084dbd tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] 10.222.0.50 "GET /compute/v2.1/servers/5c3dd875-58f6-4ddc-847b-c2518e193470" status: 200 len: 1324 microversion: 2.1 time: 0.321863 Aug 31 16:07:20.761032 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1779/3408] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:20 2022] GET /compute/v2.1/servers/5c3dd875-58f6-4ddc-847b-c2518e193470 => generated 1324 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:20.775328 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-ae39b65b-41de-4496-8e68-4882e71f212d req-e4d356a5-2b66-411e-9bad-36fdc7f80e45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c3dd875-58f6-4ddc-847b-c2518e193470", "name": "network-vif-plugged", "status": "completed", "tag": "44a33b5e-ea58-4246-8900-67ca022aa00f"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:07:20.826042 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-ae39b65b-41de-4496-8e68-4882e71f212d req-e4d356a5-2b66-411e-9bad-36fdc7f80e45 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:20.829435 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-ae39b65b-41de-4496-8e68-4882e71f212d req-e4d356a5-2b66-411e-9bad-36fdc7f80e45 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:20.831635 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-ae39b65b-41de-4496-8e68-4882e71f212d req-e4d356a5-2b66-411e-9bad-36fdc7f80e45 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:20.870857 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-ae39b65b-41de-4496-8e68-4882e71f212d req-e4d356a5-2b66-411e-9bad-36fdc7f80e45 service nova] Creating event network-vif-plugged:44a33b5e-ea58-4246-8900-67ca022aa00f for instance 5c3dd875-58f6-4ddc-847b-c2518e193470 on n-h2-833090-16 Aug 31 16:07:20.900286 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-ae39b65b-41de-4496-8e68-4882e71f212d req-e4d356a5-2b66-411e-9bad-36fdc7f80e45 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133376 Aug 31 16:07:20.902378 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1780/3409] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:07:20.908455 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7ab530e2-ceed-46c6-abf4-f1768dccd815 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:20.909967 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7ab530e2-ceed-46c6-abf4-f1768dccd815 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:20.918208 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ab530e2-ceed-46c6-abf4-f1768dccd815 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:20.918915 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ab530e2-ceed-46c6-abf4-f1768dccd815 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:20.919595 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ab530e2-ceed-46c6-abf4-f1768dccd815 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:20.920506 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ab530e2-ceed-46c6-abf4-f1768dccd815 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:20.921134 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ab530e2-ceed-46c6-abf4-f1768dccd815 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:20.924340 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ab530e2-ceed-46c6-abf4-f1768dccd815 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:21.596393 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7ab530e2-ceed-46c6-abf4-f1768dccd815 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:21.612626 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7ab530e2-ceed-46c6-abf4-f1768dccd815 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2" status: 200 len: 1198 microversion: 2.1 time: 0.701693 Aug 31 16:07:21.631004 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1781/3410] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:20 2022] GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2 => generated 1198 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:21.645079 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-61842752-4c11-4737-b1b5-eb7cbd66cefd tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:21.658361 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-61842752-4c11-4737-b1b5-eb7cbd66cefd tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: ac18e976-69d9-4131-be61-fdbcf1b04173] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:21.671197 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-61842752-4c11-4737-b1b5-eb7cbd66cefd tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:21.674212 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-61842752-4c11-4737-b1b5-eb7cbd66cefd tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:21.674886 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-61842752-4c11-4737-b1b5-eb7cbd66cefd tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:21.678871 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-61842752-4c11-4737-b1b5-eb7cbd66cefd tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:21.679560 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-61842752-4c11-4737-b1b5-eb7cbd66cefd tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:21.680161 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-61842752-4c11-4737-b1b5-eb7cbd66cefd tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:22.005479 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-61842752-4c11-4737-b1b5-eb7cbd66cefd tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:22.024438 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-61842752-4c11-4737-b1b5-eb7cbd66cefd tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173" status: 200 len: 1508 microversion: 2.1 time: 0.388700 Aug 31 16:07:22.025041 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1782/3411] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:21 2022] GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173 => generated 1508 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:22.029973 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3131002e-0b7d-4e99-a97f-833a21577624 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:22.034249 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3131002e-0b7d-4e99-a97f-833a21577624 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] [instance: 5c3dd875-58f6-4ddc-847b-c2518e193470] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:22.060220 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3131002e-0b7d-4e99-a97f-833a21577624 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:22.068582 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3131002e-0b7d-4e99-a97f-833a21577624 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:22.069427 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3131002e-0b7d-4e99-a97f-833a21577624 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:22.070859 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3131002e-0b7d-4e99-a97f-833a21577624 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:22.071471 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3131002e-0b7d-4e99-a97f-833a21577624 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:22.072258 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3131002e-0b7d-4e99-a97f-833a21577624 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:22.075799 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=100 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:07:22.453496 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3131002e-0b7d-4e99-a97f-833a21577624 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9490c5b9774ac7827b27af8e151bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ef34f80f184d78bca45976af8b1f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:22.464138 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3131002e-0b7d-4e99-a97f-833a21577624 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] 10.222.0.50 "GET /compute/v2.1/servers/5c3dd875-58f6-4ddc-847b-c2518e193470" status: 200 len: 1324 microversion: 2.1 time: 0.438029 Aug 31 16:07:22.466453 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1783/3412] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:22 2022] GET /compute/v2.1/servers/5c3dd875-58f6-4ddc-847b-c2518e193470 => generated 1324 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:22.641234 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b9218542-5ced-49ae-95b2-aecfcd367b3d tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:22.642882 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b9218542-5ced-49ae-95b2-aecfcd367b3d tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:22.655744 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b9218542-5ced-49ae-95b2-aecfcd367b3d tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:22.656838 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b9218542-5ced-49ae-95b2-aecfcd367b3d tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:22.657471 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b9218542-5ced-49ae-95b2-aecfcd367b3d tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:22.658393 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b9218542-5ced-49ae-95b2-aecfcd367b3d tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:22.659281 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b9218542-5ced-49ae-95b2-aecfcd367b3d tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:22.660384 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b9218542-5ced-49ae-95b2-aecfcd367b3d tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:22.960796 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b9218542-5ced-49ae-95b2-aecfcd367b3d tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:22.981474 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b9218542-5ced-49ae-95b2-aecfcd367b3d tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2" status: 200 len: 1198 microversion: 2.1 time: 0.341495 Aug 31 16:07:22.982977 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1784/3413] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:22 2022] GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2 => generated 1198 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:22.991706 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-f6809efb-ee41-4d73-a2bd-9053e5cf38d7 req-6f05eb6c-d5e9-4be6-8642-556a1e292c2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4729162e-f8a9-4952-a3e0-be75936208f2", "name": "network-vif-plugged", "status": "completed", "tag": "cba9d0d4-250d-490b-a5a2-c919d3ee3547"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:07:23.012219 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-f6809efb-ee41-4d73-a2bd-9053e5cf38d7 req-6f05eb6c-d5e9-4be6-8642-556a1e292c2c service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:23.013399 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-f6809efb-ee41-4d73-a2bd-9053e5cf38d7 req-6f05eb6c-d5e9-4be6-8642-556a1e292c2c service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:23.017153 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-f6809efb-ee41-4d73-a2bd-9053e5cf38d7 req-6f05eb6c-d5e9-4be6-8642-556a1e292c2c service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:23.042802 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-f6809efb-ee41-4d73-a2bd-9053e5cf38d7 req-6f05eb6c-d5e9-4be6-8642-556a1e292c2c service nova] Creating event network-vif-plugged:cba9d0d4-250d-490b-a5a2-c919d3ee3547 for instance 4729162e-f8a9-4952-a3e0-be75936208f2 on n-h1-833090-16 Aug 31 16:07:23.060041 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-f6809efb-ee41-4d73-a2bd-9053e5cf38d7 req-6f05eb6c-d5e9-4be6-8642-556a1e292c2c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072651 Aug 31 16:07:23.061850 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1785/3414] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:07:23.071586 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-91b4dbb2-eaf9-4cb2-be4f-abb35f16b70e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:23.073385 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-91b4dbb2-eaf9-4cb2-be4f-abb35f16b70e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: ac18e976-69d9-4131-be61-fdbcf1b04173] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:23.083385 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91b4dbb2-eaf9-4cb2-be4f-abb35f16b70e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:23.084138 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91b4dbb2-eaf9-4cb2-be4f-abb35f16b70e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:23.091838 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91b4dbb2-eaf9-4cb2-be4f-abb35f16b70e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:23.093001 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91b4dbb2-eaf9-4cb2-be4f-abb35f16b70e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:23.093715 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91b4dbb2-eaf9-4cb2-be4f-abb35f16b70e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:23.095037 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91b4dbb2-eaf9-4cb2-be4f-abb35f16b70e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:23.488172 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-91b4dbb2-eaf9-4cb2-be4f-abb35f16b70e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:23.498600 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-91b4dbb2-eaf9-4cb2-be4f-abb35f16b70e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173" status: 200 len: 1508 microversion: 2.1 time: 0.434604 Aug 31 16:07:23.499860 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1786/3415] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:23 2022] GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173 => generated 1508 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:23.504949 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-33d05ddb-e0f2-4a4c-b29d-a6185c5db7a0 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:23.510656 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-33d05ddb-e0f2-4a4c-b29d-a6185c5db7a0 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] [instance: 5c3dd875-58f6-4ddc-847b-c2518e193470] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:23.527784 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33d05ddb-e0f2-4a4c-b29d-a6185c5db7a0 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:23.528695 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33d05ddb-e0f2-4a4c-b29d-a6185c5db7a0 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:23.529301 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33d05ddb-e0f2-4a4c-b29d-a6185c5db7a0 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:23.531840 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33d05ddb-e0f2-4a4c-b29d-a6185c5db7a0 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:23.533350 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33d05ddb-e0f2-4a4c-b29d-a6185c5db7a0 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:23.535965 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33d05ddb-e0f2-4a4c-b29d-a6185c5db7a0 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:23.913856 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-33d05ddb-e0f2-4a4c-b29d-a6185c5db7a0 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9490c5b9774ac7827b27af8e151bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ef34f80f184d78bca45976af8b1f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:23.926672 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-33d05ddb-e0f2-4a4c-b29d-a6185c5db7a0 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] 10.222.0.50 "GET /compute/v2.1/servers/5c3dd875-58f6-4ddc-847b-c2518e193470" status: 200 len: 1324 microversion: 2.1 time: 0.423212 Aug 31 16:07:23.926672 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1787/3416] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:23 2022] GET /compute/v2.1/servers/5c3dd875-58f6-4ddc-847b-c2518e193470 => generated 1324 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:24.010200 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ce816aaf-38f9-4ae2-a97b-f807bf3ea901 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:24.010922 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ce816aaf-38f9-4ae2-a97b-f807bf3ea901 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:24.031535 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ce816aaf-38f9-4ae2-a97b-f807bf3ea901 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:24.034269 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ce816aaf-38f9-4ae2-a97b-f807bf3ea901 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:24.038701 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ce816aaf-38f9-4ae2-a97b-f807bf3ea901 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:24.040090 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ce816aaf-38f9-4ae2-a97b-f807bf3ea901 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:24.041088 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ce816aaf-38f9-4ae2-a97b-f807bf3ea901 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:24.041838 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ce816aaf-38f9-4ae2-a97b-f807bf3ea901 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:24.331272 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ce816aaf-38f9-4ae2-a97b-f807bf3ea901 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:24.341758 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ce816aaf-38f9-4ae2-a97b-f807bf3ea901 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2" status: 200 len: 1198 microversion: 2.1 time: 0.341443 Aug 31 16:07:24.362150 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1788/3417] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:23 2022] GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2 => generated 1198 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:24.525546 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8b6cccad-eecf-41f5-a08f-0fb20b9da769 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:24.526484 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8b6cccad-eecf-41f5-a08f-0fb20b9da769 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: ac18e976-69d9-4131-be61-fdbcf1b04173] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:24.538585 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b6cccad-eecf-41f5-a08f-0fb20b9da769 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:24.542310 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b6cccad-eecf-41f5-a08f-0fb20b9da769 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:24.543370 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b6cccad-eecf-41f5-a08f-0fb20b9da769 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:24.545575 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b6cccad-eecf-41f5-a08f-0fb20b9da769 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:24.548598 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b6cccad-eecf-41f5-a08f-0fb20b9da769 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:24.552203 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b6cccad-eecf-41f5-a08f-0fb20b9da769 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:24.925671 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8b6cccad-eecf-41f5-a08f-0fb20b9da769 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:24.934214 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8b6cccad-eecf-41f5-a08f-0fb20b9da769 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173" status: 200 len: 1508 microversion: 2.1 time: 0.412835 Aug 31 16:07:24.935269 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1789/3418] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:24 2022] GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173 => generated 1508 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:24.945308 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b70638bc-ebbd-4fd0-90f8-9e1beb003578 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:24.946547 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b70638bc-ebbd-4fd0-90f8-9e1beb003578 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] [instance: 5c3dd875-58f6-4ddc-847b-c2518e193470] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:24.963312 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b70638bc-ebbd-4fd0-90f8-9e1beb003578 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:24.964759 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b70638bc-ebbd-4fd0-90f8-9e1beb003578 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:24.965200 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b70638bc-ebbd-4fd0-90f8-9e1beb003578 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:24.965930 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b70638bc-ebbd-4fd0-90f8-9e1beb003578 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:24.966404 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b70638bc-ebbd-4fd0-90f8-9e1beb003578 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:24.966821 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b70638bc-ebbd-4fd0-90f8-9e1beb003578 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:25.173061 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b70638bc-ebbd-4fd0-90f8-9e1beb003578 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9490c5b9774ac7827b27af8e151bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ef34f80f184d78bca45976af8b1f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:25.186872 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b70638bc-ebbd-4fd0-90f8-9e1beb003578 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] 10.222.0.50 "GET /compute/v2.1/servers/5c3dd875-58f6-4ddc-847b-c2518e193470" status: 200 len: 1520 microversion: 2.1 time: 0.244034 Aug 31 16:07:25.208975 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1790/3419] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:24 2022] GET /compute/v2.1/servers/5c3dd875-58f6-4ddc-847b-c2518e193470 => generated 1520 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:07:25.215135 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9636da9a-14c4-4de9-abe9-7acf7cf6caba tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:25.216446 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9636da9a-14c4-4de9-abe9-7acf7cf6caba tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] [instance: 5c3dd875-58f6-4ddc-847b-c2518e193470] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:25.224122 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9636da9a-14c4-4de9-abe9-7acf7cf6caba tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:25.224814 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9636da9a-14c4-4de9-abe9-7acf7cf6caba tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:25.225445 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9636da9a-14c4-4de9-abe9-7acf7cf6caba tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:25.226387 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9636da9a-14c4-4de9-abe9-7acf7cf6caba tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:25.227011 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9636da9a-14c4-4de9-abe9-7acf7cf6caba tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:25.227604 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9636da9a-14c4-4de9-abe9-7acf7cf6caba tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:25.268183 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-9636da9a-14c4-4de9-abe9-7acf7cf6caba tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] HTTP exception thrown: Action 999 not found Aug 31 16:07:25.290262 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9636da9a-14c4-4de9-abe9-7acf7cf6caba tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Request method failure captured: Aug 31 16:07:25.290262 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/5c3dd875-58f6-4ddc-847b-c2518e193470/os-instance-actions/999 HTTP/1.1 Aug 31 16:07:25.290262 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:07:25.290262 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:07:25.290262 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:07:25.290262 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:07:25.290262 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:07:25.290262 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:07:25.290262 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:07:25.290262 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:07:25.290262 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4cgH2d7EzPHUz5O9FfrArqPbgfzIq_JpLOyDKYNkDXgiHO47PPTyEu0QM1eLz2POA6bSZNbOPU68oBoKGy78438AufnEoZOEveDRLvXswD2DqA3u-h24G3dRxojBXJ6BT0oI_L_j85xpz_HoZFDMOTBSdAE-L-rCqCoJl_G6VvCHAI Aug 31 16:07:25.290262 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:07:25.290262 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:07:25.290262 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:07:25.290262 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:07:25.290262 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:07:25.290262 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:07:25.290262 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 12ef34f80f184d78bca45976af8b1f48 Aug 31 16:07:25.290262 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-11121017 Aug 31 16:07:25.290262 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:07:25.290262 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:07:25.290262 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/12ef34f80f184d78bca45976af8b1f48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/12ef34f80f184d78bca45976af8b1f48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/12ef34f80f184d78bca45976af8b1f48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_12ef34f80f184d78bca45976af8b1f48", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:07:25.290262 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-11121017 Aug 31 16:07:25.290262 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 12ef34f80f184d78bca45976af8b1f48 Aug 31 16:07:25.290262 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-11121017 Aug 31 16:07:25.290262 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-InstanceActionsNegativeTestJSON-11121017-project Aug 31 16:07:25.290262 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:07:25.290262 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:07:25.290262 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: fc9490c5b9774ac7827b27af8e151bb7 Aug 31 16:07:25.290262 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-11121017-project Aug 31 16:07:25.290262 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:07:25.290262 n-d-833090-16 devstack@n-api.service[128864]: exception: Action 999 not found Aug 31 16:07:25.290262 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'server_id': '5c3dd875-58f6-4ddc-847b-c2518e193470', 'id': '999'} Aug 31 16:07:25.290262 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:07:25.290262 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:07:25.290262 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:07:25.290262 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:07:25.290262 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:07:25.290262 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:07:25.290262 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:07:25.290262 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:07:25.290262 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Aug 31 16:07:25.290262 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 31 16:07:25.290262 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Aug 31 16:07:25.290262 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:07:25.290262 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:07:25.290262 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:07:25.290262 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:07:25.290262 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:07:25.290262 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:07:25.290262 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:07:25.290262 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:07:25.290262 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Aug 31 16:07:25.290262 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:07:25.295147 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9636da9a-14c4-4de9-abe9-7acf7cf6caba tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Returning 404 to user: Action 999 not found {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:07:25.295147 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9636da9a-14c4-4de9-abe9-7acf7cf6caba tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] 10.222.0.50 "GET /compute/v2.1/servers/5c3dd875-58f6-4ddc-847b-c2518e193470/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.081802 Aug 31 16:07:25.295147 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1791/3420] 10.222.0.50 () {58 vars in 1308 bytes} [Wed Aug 31 16:07:25 2022] GET /compute/v2.1/servers/5c3dd875-58f6-4ddc-847b-c2518e193470/os-instance-actions/999 => generated 66 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 16:07:25.305267 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-58724f2c-a023-4af5-b65f-3b07dad7abe3 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Calling method '.version_select at 0x7fbb46176820>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:25.311684 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-58724f2c-a023-4af5-b65f-3b07dad7abe3 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] [instance: de0af7ac-3fbf-4a7c-a273-935539f58aa0] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:25.321856 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-58724f2c-a023-4af5-b65f-3b07dad7abe3 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] HTTP exception thrown: Instance de0af7ac-3fbf-4a7c-a273-935539f58aa0 could not be found. Aug 31 16:07:25.329793 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-58724f2c-a023-4af5-b65f-3b07dad7abe3 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Request method failure captured: Aug 31 16:07:25.329793 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/de0af7ac-3fbf-4a7c-a273-935539f58aa0/os-instance-actions HTTP/1.1 Aug 31 16:07:25.329793 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:07:25.329793 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:07:25.329793 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:07:25.329793 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:07:25.329793 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:07:25.329793 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:07:25.329793 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:07:25.329793 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:07:25.329793 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4cgH2d7EzPHUz5O9FfrArqPbgfzIq_JpLOyDKYNkDXgiHO47PPTyEu0QM1eLz2POA6bSZNbOPU68oBoKGy78438AufnEoZOEveDRLvXswD2DqA3u-h24G3dRxojBXJ6BT0oI_L_j85xpz_HoZFDMOTBSdAE-L-rCqCoJl_G6VvCHAI Aug 31 16:07:25.329793 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:07:25.329793 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:07:25.329793 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:07:25.329793 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:07:25.329793 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:07:25.329793 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:07:25.329793 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 12ef34f80f184d78bca45976af8b1f48 Aug 31 16:07:25.329793 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-11121017 Aug 31 16:07:25.329793 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:07:25.329793 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:07:25.329793 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/12ef34f80f184d78bca45976af8b1f48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/12ef34f80f184d78bca45976af8b1f48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/12ef34f80f184d78bca45976af8b1f48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_12ef34f80f184d78bca45976af8b1f48", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:07:25.329793 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-11121017 Aug 31 16:07:25.329793 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 12ef34f80f184d78bca45976af8b1f48 Aug 31 16:07:25.329793 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-11121017 Aug 31 16:07:25.329793 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-InstanceActionsNegativeTestJSON-11121017-project Aug 31 16:07:25.329793 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:07:25.329793 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:07:25.329793 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: fc9490c5b9774ac7827b27af8e151bb7 Aug 31 16:07:25.329793 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-11121017-project Aug 31 16:07:25.329793 n-d-833090-16 devstack@n-api.service[128864]: method: Aug 31 16:07:25.329793 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance de0af7ac-3fbf-4a7c-a273-935539f58aa0 could not be found. Aug 31 16:07:25.329793 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'server_id': 'de0af7ac-3fbf-4a7c-a273-935539f58aa0'} Aug 31 16:07:25.329793 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:07:25.329793 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:07:25.329793 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:07:25.329793 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:07:25.329793 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:07:25.329793 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:07:25.329793 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 31 16:07:25.329793 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 31 16:07:25.329793 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de0af7ac-3fbf-4a7c-a273-935539f58aa0 could not be found. Aug 31 16:07:25.329793 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:07:25.329793 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:07:25.329793 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:07:25.329793 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:07:25.329793 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:07:25.329793 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:07:25.329793 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:07:25.329793 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:07:25.329793 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:07:25.329793 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:07:25.329793 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:07:25.329793 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:07:25.329793 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Aug 31 16:07:25.329793 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Aug 31 16:07:25.329793 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:07:25.329793 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:07:25.329793 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Aug 31 16:07:25.329793 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Aug 31 16:07:25.329793 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:07:25.329793 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:07:25.335440 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de0af7ac-3fbf-4a7c-a273-935539f58aa0 could not be found. Aug 31 16:07:25.335440 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:07:25.335440 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:07:25.335440 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:07:25.335440 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:07:25.335440 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:07:25.335440 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:07:25.335440 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:07:25.335440 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:07:25.335440 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de0af7ac-3fbf-4a7c-a273-935539f58aa0 could not be found. Aug 31 16:07:25.335440 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:07:25.343209 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-58724f2c-a023-4af5-b65f-3b07dad7abe3 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Returning 404 to user: Instance de0af7ac-3fbf-4a7c-a273-935539f58aa0 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:07:25.344325 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-58724f2c-a023-4af5-b65f-3b07dad7abe3 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] 10.222.0.50 "GET /compute/v2.1/servers/de0af7ac-3fbf-4a7c-a273-935539f58aa0/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.046055 Aug 31 16:07:25.349462 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1792/3421] 10.222.0.50 () {58 vars in 1296 bytes} [Wed Aug 31 16:07:25 2022] GET /compute/v2.1/servers/de0af7ac-3fbf-4a7c-a273-935539f58aa0/os-instance-actions => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:07:25.354614 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9b72f21a-0e44-4491-bdd6-d784632b151a tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:25.355347 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9b72f21a-0e44-4491-bdd6-d784632b151a tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] [instance: 5c3dd875-58f6-4ddc-847b-c2518e193470] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:25.365145 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9b72f21a-0e44-4491-bdd6-d784632b151a tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:25.365941 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9b72f21a-0e44-4491-bdd6-d784632b151a tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:25.368612 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9b72f21a-0e44-4491-bdd6-d784632b151a tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:25.369605 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9b72f21a-0e44-4491-bdd6-d784632b151a tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:25.370271 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9b72f21a-0e44-4491-bdd6-d784632b151a tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:25.371053 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9b72f21a-0e44-4491-bdd6-d784632b151a tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:25.406379 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9b72f21a-0e44-4491-bdd6-d784632b151a tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] [instance: 5c3dd875-58f6-4ddc-847b-c2518e193470] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:07:25.566190 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9b72f21a-0e44-4491-bdd6-d784632b151a tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5c3dd875-58f6-4ddc-847b-c2518e193470" status: 204 len: 0 microversion: 2.1 time: 0.214955 Aug 31 16:07:25.568856 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1793/3422] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:07:25 2022] DELETE /compute/v2.1/servers/5c3dd875-58f6-4ddc-847b-c2518e193470 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:07:25.582541 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b30ff518-e24d-43a1-9fa5-e8ab6d5c7ef7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:25.583500 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b30ff518-e24d-43a1-9fa5-e8ab6d5c7ef7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:25.602074 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b30ff518-e24d-43a1-9fa5-e8ab6d5c7ef7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:25.602610 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b30ff518-e24d-43a1-9fa5-e8ab6d5c7ef7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:25.606008 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b30ff518-e24d-43a1-9fa5-e8ab6d5c7ef7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:25.606872 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b30ff518-e24d-43a1-9fa5-e8ab6d5c7ef7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:25.607360 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b30ff518-e24d-43a1-9fa5-e8ab6d5c7ef7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:25.607789 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b30ff518-e24d-43a1-9fa5-e8ab6d5c7ef7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:25.877910 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b30ff518-e24d-43a1-9fa5-e8ab6d5c7ef7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:25.890696 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b30ff518-e24d-43a1-9fa5-e8ab6d5c7ef7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2" status: 200 len: 1382 microversion: 2.1 time: 0.317944 Aug 31 16:07:25.892056 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1794/3423] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:25 2022] GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2 => generated 1382 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:25.904324 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-12867441-49d9-4741-9532-a9496e0b4043 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:25.906858 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-12867441-49d9-4741-9532-a9496e0b4043 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] [instance: 5c3dd875-58f6-4ddc-847b-c2518e193470] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:25.919956 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-12867441-49d9-4741-9532-a9496e0b4043 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:25.920605 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-12867441-49d9-4741-9532-a9496e0b4043 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:25.921463 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-12867441-49d9-4741-9532-a9496e0b4043 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:25.922472 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-12867441-49d9-4741-9532-a9496e0b4043 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:25.923354 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-12867441-49d9-4741-9532-a9496e0b4043 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:25.924029 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-12867441-49d9-4741-9532-a9496e0b4043 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:26.145863 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-12867441-49d9-4741-9532-a9496e0b4043 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9490c5b9774ac7827b27af8e151bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ef34f80f184d78bca45976af8b1f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:26.159584 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-12867441-49d9-4741-9532-a9496e0b4043 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] 10.222.0.50 "GET /compute/v2.1/servers/5c3dd875-58f6-4ddc-847b-c2518e193470" status: 200 len: 1526 microversion: 2.1 time: 0.265394 Aug 31 16:07:26.172392 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1795/3424] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:25 2022] GET /compute/v2.1/servers/5c3dd875-58f6-4ddc-847b-c2518e193470 => generated 1526 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:26.534287 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8ca7c8f8-89e4-429c-b79f-53f0246de2ec tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:26.535141 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8ca7c8f8-89e4-429c-b79f-53f0246de2ec tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:26.551199 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-44648719-bfd5-4440-ab27-b8edff85d5db tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/7eadb01c-f356-40d0-ba94-14397b0d5ed2" status: 200 len: 1463 microversion: 2.1 time: 17.815450 Aug 31 16:07:26.558773 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1630/3425] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:07:08 2022] GET /compute/v2.1/images/7eadb01c-f356-40d0-ba94-14397b0d5ed2 => generated 1463 bytes in 17823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:26.564333 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8ca7c8f8-89e4-429c-b79f-53f0246de2ec tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:26.565178 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8ca7c8f8-89e4-429c-b79f-53f0246de2ec tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:26.565740 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8ca7c8f8-89e4-429c-b79f-53f0246de2ec tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:26.566685 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8ca7c8f8-89e4-429c-b79f-53f0246de2ec tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:26.567208 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8ca7c8f8-89e4-429c-b79f-53f0246de2ec tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:26.568057 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8ca7c8f8-89e4-429c-b79f-53f0246de2ec tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:26.569974 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-16c4be02-6aa6-4dae-9fbc-f8515e3b6955 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:26.570636 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-16c4be02-6aa6-4dae-9fbc-f8515e3b6955 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: ac18e976-69d9-4131-be61-fdbcf1b04173] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:26.584727 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16c4be02-6aa6-4dae-9fbc-f8515e3b6955 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:26.585232 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16c4be02-6aa6-4dae-9fbc-f8515e3b6955 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:26.585671 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16c4be02-6aa6-4dae-9fbc-f8515e3b6955 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:26.586438 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16c4be02-6aa6-4dae-9fbc-f8515e3b6955 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:26.587112 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16c4be02-6aa6-4dae-9fbc-f8515e3b6955 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:26.587707 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16c4be02-6aa6-4dae-9fbc-f8515e3b6955 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:26.854127 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8ca7c8f8-89e4-429c-b79f-53f0246de2ec tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2" status: 200 len: 1535 microversion: 2.1 time: 0.679127 Aug 31 16:07:26.854831 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1796/3426] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:26 2022] GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2 => generated 1535 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:26.861329 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6626ccc6-a61f-45f9-9033-3b9ab5fc9438 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb45ee7e50>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:26.909075 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-16c4be02-6aa6-4dae-9fbc-f8515e3b6955 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:26.917328 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-16c4be02-6aa6-4dae-9fbc-f8515e3b6955 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173" status: 200 len: 1508 microversion: 2.1 time: 0.356960 Aug 31 16:07:26.917948 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1631/3427] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:26 2022] GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173 => generated 1508 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:26.924676 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c2a7e0e0-ce7f-4cea-9594-b1a95a620fc7 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:26.925496 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c2a7e0e0-ce7f-4cea-9594-b1a95a620fc7 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:26.958844 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2a7e0e0-ce7f-4cea-9594-b1a95a620fc7 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:26.959748 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2a7e0e0-ce7f-4cea-9594-b1a95a620fc7 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:26.960612 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2a7e0e0-ce7f-4cea-9594-b1a95a620fc7 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:26.961730 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2a7e0e0-ce7f-4cea-9594-b1a95a620fc7 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:26.962632 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2a7e0e0-ce7f-4cea-9594-b1a95a620fc7 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:26.963299 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2a7e0e0-ce7f-4cea-9594-b1a95a620fc7 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:27.107162 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6626ccc6-a61f-45f9-9033-3b9ab5fc9438 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/7eadb01c-f356-40d0-ba94-14397b0d5ed2" status: 200 len: 1463 microversion: 2.1 time: 0.250908 Aug 31 16:07:27.118716 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1797/3428] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:07:26 2022] GET /compute/v2.1/images/7eadb01c-f356-40d0-ba94-14397b0d5ed2 => generated 1463 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:27.125028 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-67f244fa-76e8-4955-899b-8650a1d1b680 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:27.125934 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-67f244fa-76e8-4955-899b-8650a1d1b680 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] [instance: 5c81c9a3-8ba0-4573-a3e8-68292edc1ae2] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:27.133337 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-67f244fa-76e8-4955-899b-8650a1d1b680 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:27.134212 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-67f244fa-76e8-4955-899b-8650a1d1b680 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:27.134580 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c2a7e0e0-ce7f-4cea-9594-b1a95a620fc7 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2" status: 200 len: 1535 microversion: 2.1 time: 0.214800 Aug 31 16:07:27.135091 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-67f244fa-76e8-4955-899b-8650a1d1b680 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:27.136002 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-67f244fa-76e8-4955-899b-8650a1d1b680 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:27.136717 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-67f244fa-76e8-4955-899b-8650a1d1b680 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:27.137332 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-67f244fa-76e8-4955-899b-8650a1d1b680 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:27.138863 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1632/3429] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:26 2022] GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2 => generated 1535 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:27.157268 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0374b1b2-dd89-4145-8217-c2793ce1ed1a tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:27.166747 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0374b1b2-dd89-4145-8217-c2793ce1ed1a tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:27.167235 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0374b1b2-dd89-4145-8217-c2793ce1ed1a tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:27.167777 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0374b1b2-dd89-4145-8217-c2793ce1ed1a tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:27.177800 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0374b1b2-dd89-4145-8217-c2793ce1ed1a tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:27.178874 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0374b1b2-dd89-4145-8217-c2793ce1ed1a tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:27.179412 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0374b1b2-dd89-4145-8217-c2793ce1ed1a tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:27.212398 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0374b1b2-dd89-4145-8217-c2793ce1ed1a tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.060872 Aug 31 16:07:27.213645 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1633/3430] 10.222.0.50 () {58 vars in 1176 bytes} [Wed Aug 31 16:07:27 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:07:27.219063 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4fec0e76-7594-4e8a-ae74-b4c09bbe85a0 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:27.219983 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4fec0e76-7594-4e8a-ae74-b4c09bbe85a0 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] [instance: 5c3dd875-58f6-4ddc-847b-c2518e193470] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:27.227358 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4fec0e76-7594-4e8a-ae74-b4c09bbe85a0 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:27.228258 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4fec0e76-7594-4e8a-ae74-b4c09bbe85a0 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:27.228920 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4fec0e76-7594-4e8a-ae74-b4c09bbe85a0 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:27.231378 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4fec0e76-7594-4e8a-ae74-b4c09bbe85a0 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:27.232086 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4fec0e76-7594-4e8a-ae74-b4c09bbe85a0 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:27.232773 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4fec0e76-7594-4e8a-ae74-b4c09bbe85a0 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:27.363548 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-67f244fa-76e8-4955-899b-8650a1d1b680 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae96c057d884eafb9c2032dd5db9e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a33aeb63a416a9d046e2b67b93f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:27.373912 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-67f244fa-76e8-4955-899b-8650a1d1b680 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/servers/5c81c9a3-8ba0-4573-a3e8-68292edc1ae2" status: 200 len: 1480 microversion: 2.1 time: 0.253250 Aug 31 16:07:27.390175 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1798/3431] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:27 2022] GET /compute/v2.1/servers/5c81c9a3-8ba0-4573-a3e8-68292edc1ae2 => generated 1480 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:27.397706 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d80526e8-cb90-44ec-a688-4923d944ce80 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-833090-16", "block_migration": false, "disk_over_commit": false}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:07:27.400608 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d80526e8-cb90-44ec-a688-4923d944ce80 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:27.407900 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d80526e8-cb90-44ec-a688-4923d944ce80 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:27.408765 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d80526e8-cb90-44ec-a688-4923d944ce80 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:27.410192 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d80526e8-cb90-44ec-a688-4923d944ce80 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:27.411653 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d80526e8-cb90-44ec-a688-4923d944ce80 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:27.412311 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d80526e8-cb90-44ec-a688-4923d944ce80 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:27.413115 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d80526e8-cb90-44ec-a688-4923d944ce80 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:27.552239 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-d80526e8-cb90-44ec-a688-4923d944ce80 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lazy-loading 'flavor' on Instance uuid 4729162e-f8a9-4952-a3e0-be75936208f2 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:07:27.564534 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4fec0e76-7594-4e8a-ae74-b4c09bbe85a0 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9490c5b9774ac7827b27af8e151bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ef34f80f184d78bca45976af8b1f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:27.567714 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d80526e8-cb90-44ec-a688-4923d944ce80 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] Going to try to live migrate instance to n-h2-833090-16 {{(pid=128864) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 31 16:07:27.589366 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4fec0e76-7594-4e8a-ae74-b4c09bbe85a0 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] 10.222.0.50 "GET /compute/v2.1/servers/5c3dd875-58f6-4ddc-847b-c2518e193470" status: 200 len: 1526 microversion: 2.1 time: 0.368112 Aug 31 16:07:27.590802 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1634/3432] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:27 2022] GET /compute/v2.1/servers/5c3dd875-58f6-4ddc-847b-c2518e193470 => generated 1526 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:27.634716 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:07:27.942338 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ae837c5d-c66e-4b6f-9761-28f48e75bcff tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:27.944449 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ae837c5d-c66e-4b6f-9761-28f48e75bcff tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: ac18e976-69d9-4131-be61-fdbcf1b04173] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:27.956106 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae837c5d-c66e-4b6f-9761-28f48e75bcff tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:27.959098 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae837c5d-c66e-4b6f-9761-28f48e75bcff tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:27.959575 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae837c5d-c66e-4b6f-9761-28f48e75bcff tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:27.963353 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae837c5d-c66e-4b6f-9761-28f48e75bcff tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:27.964198 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae837c5d-c66e-4b6f-9761-28f48e75bcff tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:27.964859 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae837c5d-c66e-4b6f-9761-28f48e75bcff tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:29.028388 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ae837c5d-c66e-4b6f-9761-28f48e75bcff tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:29.040767 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ae837c5d-c66e-4b6f-9761-28f48e75bcff tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173" status: 200 len: 1508 microversion: 2.1 time: 1.104622 Aug 31 16:07:29.058358 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1635/3433] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:27 2022] GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173 => generated 1508 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:07:29.063565 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0601ed90-498d-413e-9597-62f322251455 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:29.064440 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0601ed90-498d-413e-9597-62f322251455 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] [instance: 5c81c9a3-8ba0-4573-a3e8-68292edc1ae2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:29.072256 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0601ed90-498d-413e-9597-62f322251455 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:29.073106 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0601ed90-498d-413e-9597-62f322251455 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:29.073728 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0601ed90-498d-413e-9597-62f322251455 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:29.074919 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0601ed90-498d-413e-9597-62f322251455 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:29.075549 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0601ed90-498d-413e-9597-62f322251455 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:29.076215 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0601ed90-498d-413e-9597-62f322251455 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:29.579962 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0601ed90-498d-413e-9597-62f322251455 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae96c057d884eafb9c2032dd5db9e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a33aeb63a416a9d046e2b67b93f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:29.609324 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0601ed90-498d-413e-9597-62f322251455 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/servers/5c81c9a3-8ba0-4573-a3e8-68292edc1ae2" status: 200 len: 1467 microversion: 2.1 time: 0.544746 Aug 31 16:07:29.610498 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1636/3434] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:29 2022] GET /compute/v2.1/servers/5c81c9a3-8ba0-4573-a3e8-68292edc1ae2 => generated 1467 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:29.631291 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e19a5dac-e437-46a8-b7a0-915f749b2bfa tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:29.650805 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e19a5dac-e437-46a8-b7a0-915f749b2bfa tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] [instance: 5c3dd875-58f6-4ddc-847b-c2518e193470] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:29.672177 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e19a5dac-e437-46a8-b7a0-915f749b2bfa tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:29.673055 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e19a5dac-e437-46a8-b7a0-915f749b2bfa tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:29.673677 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e19a5dac-e437-46a8-b7a0-915f749b2bfa tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:29.676806 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e19a5dac-e437-46a8-b7a0-915f749b2bfa tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:29.677455 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e19a5dac-e437-46a8-b7a0-915f749b2bfa tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:29.679552 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e19a5dac-e437-46a8-b7a0-915f749b2bfa tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:29.730801 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e19a5dac-e437-46a8-b7a0-915f749b2bfa tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:29.731566 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e19a5dac-e437-46a8-b7a0-915f749b2bfa tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:29.732212 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e19a5dac-e437-46a8-b7a0-915f749b2bfa tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:29.732710 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-e19a5dac-e437-46a8-b7a0-915f749b2bfa tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lazy-loading 'fault' on Instance uuid 5c3dd875-58f6-4ddc-847b-c2518e193470 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:07:29.817826 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e19a5dac-e437-46a8-b7a0-915f749b2bfa tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc9490c5b9774ac7827b27af8e151bb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ef34f80f184d78bca45976af8b1f48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:29.837912 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e19a5dac-e437-46a8-b7a0-915f749b2bfa tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] 10.222.0.50 "GET /compute/v2.1/servers/5c3dd875-58f6-4ddc-847b-c2518e193470" status: 200 len: 1314 microversion: 2.1 time: 0.212022 Aug 31 16:07:29.840415 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1637/3435] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:29 2022] GET /compute/v2.1/servers/5c3dd875-58f6-4ddc-847b-c2518e193470 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:29.851341 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-64d26052-629b-450f-bf7a-f0bcc1b7b01b req-dac6009c-67fa-47ad-ab53-1d51703064ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c3dd875-58f6-4ddc-847b-c2518e193470", "name": "network-vif-deleted", "tag": "44a33b5e-ea58-4246-8900-67ca022aa00f"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:07:29.882724 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-64d26052-629b-450f-bf7a-f0bcc1b7b01b req-dac6009c-67fa-47ad-ab53-1d51703064ab service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:29.883221 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-64d26052-629b-450f-bf7a-f0bcc1b7b01b req-dac6009c-67fa-47ad-ab53-1d51703064ab service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:29.887981 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-64d26052-629b-450f-bf7a-f0bcc1b7b01b req-dac6009c-67fa-47ad-ab53-1d51703064ab service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:29.912807 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-64d26052-629b-450f-bf7a-f0bcc1b7b01b req-dac6009c-67fa-47ad-ab53-1d51703064ab service nova] Creating event network-vif-deleted:44a33b5e-ea58-4246-8900-67ca022aa00f for instance 5c3dd875-58f6-4ddc-847b-c2518e193470 on n-h2-833090-16 Aug 31 16:07:29.923338 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-64d26052-629b-450f-bf7a-f0bcc1b7b01b req-dac6009c-67fa-47ad-ab53-1d51703064ab service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081414 Aug 31 16:07:29.928012 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1638/3436] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:07:29.942544 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2ad05698-de90-44e3-87a3-eedb0645a3aa tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-218965585"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:07:29.947088 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2ad05698-de90-44e3-87a3-eedb0645a3aa tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] [instance: d3255935-3cff-4bb0-aad2-a8f401028a59] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:29.956245 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ad05698-de90-44e3-87a3-eedb0645a3aa tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:29.957635 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ad05698-de90-44e3-87a3-eedb0645a3aa tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:29.958684 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ad05698-de90-44e3-87a3-eedb0645a3aa tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:29.959660 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ad05698-de90-44e3-87a3-eedb0645a3aa tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:29.960343 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ad05698-de90-44e3-87a3-eedb0645a3aa tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:29.961257 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ad05698-de90-44e3-87a3-eedb0645a3aa tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:29.962169 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d80526e8-cb90-44ec-a688-4923d944ce80 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2/action" status: 202 len: 0 microversion: 2.1 time: 2.568958 Aug 31 16:07:29.963384 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1799/3437] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:07:27 2022] POST /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2/action => generated 0 bytes in 2572 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:07:29.974880 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-00a56828-9f27-4b45-8320-a25b1a649a3e tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:29.976667 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-00a56828-9f27-4b45-8320-a25b1a649a3e tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:30.010857 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-00a56828-9f27-4b45-8320-a25b1a649a3e tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:30.016600 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-00a56828-9f27-4b45-8320-a25b1a649a3e tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:30.019965 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-00a56828-9f27-4b45-8320-a25b1a649a3e tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:30.024098 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-00a56828-9f27-4b45-8320-a25b1a649a3e tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:30.025592 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-00a56828-9f27-4b45-8320-a25b1a649a3e tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:30.026028 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-00a56828-9f27-4b45-8320-a25b1a649a3e tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:30.293068 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-00a56828-9f27-4b45-8320-a25b1a649a3e tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:30.305248 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-00a56828-9f27-4b45-8320-a25b1a649a3e tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2" status: 200 len: 1392 microversion: 2.1 time: 0.335325 Aug 31 16:07:30.306196 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1800/3438] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:29 2022] GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2 => generated 1392 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:30.326620 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6615286e-8471-4b0b-9dc6-69f9d5b815d0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:30.327349 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6615286e-8471-4b0b-9dc6-69f9d5b815d0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: ac18e976-69d9-4131-be61-fdbcf1b04173] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:30.329277 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:07:30.348735 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6615286e-8471-4b0b-9dc6-69f9d5b815d0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:30.349224 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6615286e-8471-4b0b-9dc6-69f9d5b815d0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:30.349656 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6615286e-8471-4b0b-9dc6-69f9d5b815d0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:30.356309 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6615286e-8471-4b0b-9dc6-69f9d5b815d0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:30.361138 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2ad05698-de90-44e3-87a3-eedb0645a3aa tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "POST /compute/v2.1/servers/d3255935-3cff-4bb0-aad2-a8f401028a59/action" status: 202 len: 0 microversion: 2.1 time: 0.430474 Aug 31 16:07:30.366354 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6615286e-8471-4b0b-9dc6-69f9d5b815d0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:30.371926 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1639/3439] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:07:29 2022] POST /compute/v2.1/servers/d3255935-3cff-4bb0-aad2-a8f401028a59/action => generated 0 bytes in 441 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 31 16:07:30.374869 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6615286e-8471-4b0b-9dc6-69f9d5b815d0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:30.390535 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0cf8049c-5ea8-4e3f-aaa4-306b00d176fd tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb45daadc0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:30.484768 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0cf8049c-5ea8-4e3f-aaa4-306b00d176fd tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/88312359-8e02-42d2-90a9-c8d56bdfe0fb" status: 200 len: 1454 microversion: 2.1 time: 0.107971 Aug 31 16:07:30.485555 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1640/3440] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:07:30 2022] GET /compute/v2.1/images/88312359-8e02-42d2-90a9-c8d56bdfe0fb => generated 1454 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:30.754238 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6615286e-8471-4b0b-9dc6-69f9d5b815d0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:30.776139 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6615286e-8471-4b0b-9dc6-69f9d5b815d0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173" status: 200 len: 1508 microversion: 2.1 time: 0.465877 Aug 31 16:07:30.791052 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1801/3441] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:30 2022] GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173 => generated 1508 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:30.864950 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9d4082f3-5a79-4e74-a905-a0417e148c81 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:30.865962 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9d4082f3-5a79-4e74-a905-a0417e148c81 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] [instance: 5c3dd875-58f6-4ddc-847b-c2518e193470] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:30.880637 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d4082f3-5a79-4e74-a905-a0417e148c81 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:30.882383 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d4082f3-5a79-4e74-a905-a0417e148c81 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:30.884010 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d4082f3-5a79-4e74-a905-a0417e148c81 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:30.888186 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d4082f3-5a79-4e74-a905-a0417e148c81 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:30.889460 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d4082f3-5a79-4e74-a905-a0417e148c81 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:30.890144 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d4082f3-5a79-4e74-a905-a0417e148c81 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:30.932230 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-9d4082f3-5a79-4e74-a905-a0417e148c81 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] HTTP exception thrown: Instance 5c3dd875-58f6-4ddc-847b-c2518e193470 could not be found. Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9d4082f3-5a79-4e74-a905-a0417e148c81 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Request method failure captured: Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/5c3dd875-58f6-4ddc-847b-c2518e193470 HTTP/1.1 Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4cgH2d7EzPHUz5O9FfrArqPbgfzIq_JpLOyDKYNkDXgiHO47PPTyEu0QM1eLz2POA6bSZNbOPU68oBoKGy78438AufnEoZOEveDRLvXswD2DqA3u-h24G3dRxojBXJ6BT0oI_L_j85xpz_HoZFDMOTBSdAE-L-rCqCoJl_G6VvCHAI Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 12ef34f80f184d78bca45976af8b1f48 Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-11121017 Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/12ef34f80f184d78bca45976af8b1f48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/12ef34f80f184d78bca45976af8b1f48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/12ef34f80f184d78bca45976af8b1f48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_12ef34f80f184d78bca45976af8b1f48", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-11121017 Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 12ef34f80f184d78bca45976af8b1f48 Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-11121017 Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-InstanceActionsNegativeTestJSON-11121017-project Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: fc9490c5b9774ac7827b27af8e151bb7 Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-11121017-project Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 5c3dd875-58f6-4ddc-847b-c2518e193470 could not be found. Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '5c3dd875-58f6-4ddc-847b-c2518e193470'} Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c3dd875-58f6-4ddc-847b-c2518e193470 could not be found. Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c3dd875-58f6-4ddc-847b-c2518e193470 could not be found. Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:07:30.935064 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:07:30.940408 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:07:30.940408 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:07:30.940408 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:07:30.940408 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:07:30.940408 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:07:30.940408 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:07:30.940408 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c3dd875-58f6-4ddc-847b-c2518e193470 could not be found. Aug 31 16:07:30.940408 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:07:30.942462 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9d4082f3-5a79-4e74-a905-a0417e148c81 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] Returning 404 to user: Instance 5c3dd875-58f6-4ddc-847b-c2518e193470 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:07:30.943844 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9d4082f3-5a79-4e74-a905-a0417e148c81 tempest-InstanceActionsNegativeTestJSON-11121017 tempest-InstanceActionsNegativeTestJSON-11121017-project] 10.222.0.50 "GET /compute/v2.1/servers/5c3dd875-58f6-4ddc-847b-c2518e193470" status: 404 len: 111 microversion: 2.1 time: 0.086934 Aug 31 16:07:30.945273 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1641/3442] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:30 2022] GET /compute/v2.1/servers/5c3dd875-58f6-4ddc-847b-c2518e193470 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:07:31.079034 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-d556aca2-5f04-4ec7-87d8-c478d5009bca req-c41d8de0-ca37-4ba9-82f3-51c4499172f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c81c9a3-8ba0-4573-a3e8-68292edc1ae2", "name": "network-vif-unplugged", "status": "completed", "tag": "fe966be1-351a-44fb-bfbd-7233088e6030"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:07:31.107905 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-d556aca2-5f04-4ec7-87d8-c478d5009bca req-c41d8de0-ca37-4ba9-82f3-51c4499172f0 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:31.108719 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-d556aca2-5f04-4ec7-87d8-c478d5009bca req-c41d8de0-ca37-4ba9-82f3-51c4499172f0 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:31.109336 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-d556aca2-5f04-4ec7-87d8-c478d5009bca req-c41d8de0-ca37-4ba9-82f3-51c4499172f0 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:31.129178 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-d556aca2-5f04-4ec7-87d8-c478d5009bca req-c41d8de0-ca37-4ba9-82f3-51c4499172f0 service nova] Creating event network-vif-unplugged:fe966be1-351a-44fb-bfbd-7233088e6030 for instance 5c81c9a3-8ba0-4573-a3e8-68292edc1ae2 on n-h2-833090-16 Aug 31 16:07:31.152121 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-d556aca2-5f04-4ec7-87d8-c478d5009bca req-c41d8de0-ca37-4ba9-82f3-51c4499172f0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077030 Aug 31 16:07:31.155843 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1802/3443] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:07:31.333277 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2b531c33-7ba0-4200-a61b-ef54a74f8255 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:31.333922 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2b531c33-7ba0-4200-a61b-ef54a74f8255 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:31.341682 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2b531c33-7ba0-4200-a61b-ef54a74f8255 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:31.342204 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2b531c33-7ba0-4200-a61b-ef54a74f8255 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:31.342798 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2b531c33-7ba0-4200-a61b-ef54a74f8255 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:31.344035 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2b531c33-7ba0-4200-a61b-ef54a74f8255 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:31.344495 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2b531c33-7ba0-4200-a61b-ef54a74f8255 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:31.344917 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2b531c33-7ba0-4200-a61b-ef54a74f8255 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:31.502169 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-abf01617-81b0-4e41-977c-27e052eecbf1 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb4613d040>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:31.575272 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-abf01617-81b0-4e41-977c-27e052eecbf1 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/88312359-8e02-42d2-90a9-c8d56bdfe0fb" status: 200 len: 1454 microversion: 2.1 time: 0.079231 Aug 31 16:07:31.582562 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1803/3444] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:07:31 2022] GET /compute/v2.1/images/88312359-8e02-42d2-90a9-c8d56bdfe0fb => generated 1454 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:07:31.716347 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2b531c33-7ba0-4200-a61b-ef54a74f8255 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:31.737419 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2b531c33-7ba0-4200-a61b-ef54a74f8255 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2" status: 200 len: 1392 microversion: 2.1 time: 0.414069 Aug 31 16:07:31.741152 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1642/3445] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:31 2022] GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2 => generated 1392 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:31.804561 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-dc15eaeb-4c3d-4ecc-8cf7-1657145fd1e9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:31.809731 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-dc15eaeb-4c3d-4ecc-8cf7-1657145fd1e9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: ac18e976-69d9-4131-be61-fdbcf1b04173] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:31.840918 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dc15eaeb-4c3d-4ecc-8cf7-1657145fd1e9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:31.847286 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dc15eaeb-4c3d-4ecc-8cf7-1657145fd1e9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:31.848080 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dc15eaeb-4c3d-4ecc-8cf7-1657145fd1e9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:31.852509 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dc15eaeb-4c3d-4ecc-8cf7-1657145fd1e9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:31.853282 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dc15eaeb-4c3d-4ecc-8cf7-1657145fd1e9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:31.853953 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dc15eaeb-4c3d-4ecc-8cf7-1657145fd1e9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:32.387860 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-dc15eaeb-4c3d-4ecc-8cf7-1657145fd1e9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:32.396918 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-dc15eaeb-4c3d-4ecc-8cf7-1657145fd1e9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173" status: 200 len: 1508 microversion: 2.1 time: 0.598366 Aug 31 16:07:32.402878 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1804/3446] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:31 2022] GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173 => generated 1508 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:32.598321 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-67ed6990-a163-44be-b960-503704eb5a02 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb45d38c10>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:32.727125 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-67ed6990-a163-44be-b960-503704eb5a02 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/88312359-8e02-42d2-90a9-c8d56bdfe0fb" status: 200 len: 1454 microversion: 2.1 time: 0.134167 Aug 31 16:07:32.728593 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1643/3447] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:07:32 2022] GET /compute/v2.1/images/88312359-8e02-42d2-90a9-c8d56bdfe0fb => generated 1454 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:32.760783 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-179bd6f4-a29d-48a4-98f4-38b3525f3957 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:32.762453 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-179bd6f4-a29d-48a4-98f4-38b3525f3957 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:32.775963 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-179bd6f4-a29d-48a4-98f4-38b3525f3957 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:32.777403 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-179bd6f4-a29d-48a4-98f4-38b3525f3957 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:32.779875 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-179bd6f4-a29d-48a4-98f4-38b3525f3957 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:32.782819 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-179bd6f4-a29d-48a4-98f4-38b3525f3957 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:32.783677 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-179bd6f4-a29d-48a4-98f4-38b3525f3957 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:32.786650 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-179bd6f4-a29d-48a4-98f4-38b3525f3957 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:33.431240 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5a5b600e-db38-41d7-ad0f-ac1e80ca238e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:33.432681 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5a5b600e-db38-41d7-ad0f-ac1e80ca238e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: ac18e976-69d9-4131-be61-fdbcf1b04173] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:33.442330 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a5b600e-db38-41d7-ad0f-ac1e80ca238e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:33.443097 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a5b600e-db38-41d7-ad0f-ac1e80ca238e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:33.443729 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a5b600e-db38-41d7-ad0f-ac1e80ca238e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:33.444638 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a5b600e-db38-41d7-ad0f-ac1e80ca238e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:33.446401 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a5b600e-db38-41d7-ad0f-ac1e80ca238e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:33.447079 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a5b600e-db38-41d7-ad0f-ac1e80ca238e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:33.564689 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-179bd6f4-a29d-48a4-98f4-38b3525f3957 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:33.574476 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-179bd6f4-a29d-48a4-98f4-38b3525f3957 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2" status: 200 len: 1392 microversion: 2.1 time: 0.817395 Aug 31 16:07:33.578135 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1805/3448] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:32 2022] GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2 => generated 1392 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:33.745645 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6119f51c-457c-4dbb-a380-58fce8b30631 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb4aa0d310>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:33.847488 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6119f51c-457c-4dbb-a380-58fce8b30631 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/88312359-8e02-42d2-90a9-c8d56bdfe0fb" status: 200 len: 1454 microversion: 2.1 time: 0.108251 Aug 31 16:07:33.856897 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1806/3449] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:07:33 2022] GET /compute/v2.1/images/88312359-8e02-42d2-90a9-c8d56bdfe0fb => generated 1454 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:07:33.914762 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5a5b600e-db38-41d7-ad0f-ac1e80ca238e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:33.924433 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5a5b600e-db38-41d7-ad0f-ac1e80ca238e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173" status: 200 len: 1508 microversion: 2.1 time: 0.506741 Aug 31 16:07:33.931375 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1644/3450] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:33 2022] GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173 => generated 1508 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:34.599329 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c32ce64e-cde5-40b4-9f90-e56a4d556a89 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:34.600786 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c32ce64e-cde5-40b4-9f90-e56a4d556a89 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:34.612744 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c32ce64e-cde5-40b4-9f90-e56a4d556a89 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:34.613924 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c32ce64e-cde5-40b4-9f90-e56a4d556a89 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:34.614963 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c32ce64e-cde5-40b4-9f90-e56a4d556a89 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:34.625703 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c32ce64e-cde5-40b4-9f90-e56a4d556a89 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:34.626818 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c32ce64e-cde5-40b4-9f90-e56a4d556a89 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:34.629105 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c32ce64e-cde5-40b4-9f90-e56a4d556a89 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:34.864069 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b2bc16f2-dd41-446f-a16d-fffc5b14957e tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb45d11e50>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:34.962805 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b2bc16f2-dd41-446f-a16d-fffc5b14957e tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/88312359-8e02-42d2-90a9-c8d56bdfe0fb" status: 200 len: 1454 microversion: 2.1 time: 0.104209 Aug 31 16:07:34.971048 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1645/3451] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:07:34 2022] GET /compute/v2.1/images/88312359-8e02-42d2-90a9-c8d56bdfe0fb => generated 1454 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:07:34.987414 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-149f13d8-f15e-4bfe-b330-6d5ae5fb758f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:34.990584 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-149f13d8-f15e-4bfe-b330-6d5ae5fb758f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: ac18e976-69d9-4131-be61-fdbcf1b04173] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:35.007333 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-149f13d8-f15e-4bfe-b330-6d5ae5fb758f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:35.010729 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-149f13d8-f15e-4bfe-b330-6d5ae5fb758f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:35.011270 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-149f13d8-f15e-4bfe-b330-6d5ae5fb758f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:35.012217 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-149f13d8-f15e-4bfe-b330-6d5ae5fb758f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:35.012970 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-149f13d8-f15e-4bfe-b330-6d5ae5fb758f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:35.013644 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-149f13d8-f15e-4bfe-b330-6d5ae5fb758f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:35.207238 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c32ce64e-cde5-40b4-9f90-e56a4d556a89 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:35.225739 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c32ce64e-cde5-40b4-9f90-e56a4d556a89 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2" status: 200 len: 1392 microversion: 2.1 time: 0.631428 Aug 31 16:07:35.253333 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1807/3452] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:34 2022] GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2 => generated 1392 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:35.537620 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-149f13d8-f15e-4bfe-b330-6d5ae5fb758f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:35.551864 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-149f13d8-f15e-4bfe-b330-6d5ae5fb758f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173" status: 200 len: 1508 microversion: 2.1 time: 0.579228 Aug 31 16:07:35.565635 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1646/3453] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:34 2022] GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173 => generated 1508 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:35.978958 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-95c28895-2186-487c-ab33-9acfc1b00e44 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb45ea18b0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:36.084861 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-95c28895-2186-487c-ab33-9acfc1b00e44 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/88312359-8e02-42d2-90a9-c8d56bdfe0fb" status: 200 len: 1454 microversion: 2.1 time: 0.111297 Aug 31 16:07:36.095725 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1808/3454] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:07:35 2022] GET /compute/v2.1/images/88312359-8e02-42d2-90a9-c8d56bdfe0fb => generated 1454 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:36.269510 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a9b6170e-b37d-44ae-9e4a-e78d69a096e1 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:36.274386 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a9b6170e-b37d-44ae-9e4a-e78d69a096e1 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:36.300587 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9b6170e-b37d-44ae-9e4a-e78d69a096e1 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:36.302260 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9b6170e-b37d-44ae-9e4a-e78d69a096e1 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:36.305336 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9b6170e-b37d-44ae-9e4a-e78d69a096e1 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:36.317854 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9b6170e-b37d-44ae-9e4a-e78d69a096e1 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:36.321200 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9b6170e-b37d-44ae-9e4a-e78d69a096e1 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:36.321993 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9b6170e-b37d-44ae-9e4a-e78d69a096e1 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:36.580095 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c47b9782-cc46-4b82-8570-b50a78f34e51 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:36.581480 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c47b9782-cc46-4b82-8570-b50a78f34e51 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: ac18e976-69d9-4131-be61-fdbcf1b04173] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:36.609260 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c47b9782-cc46-4b82-8570-b50a78f34e51 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:36.610743 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c47b9782-cc46-4b82-8570-b50a78f34e51 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:36.613132 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c47b9782-cc46-4b82-8570-b50a78f34e51 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:36.614829 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c47b9782-cc46-4b82-8570-b50a78f34e51 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:36.616847 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c47b9782-cc46-4b82-8570-b50a78f34e51 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:36.620615 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c47b9782-cc46-4b82-8570-b50a78f34e51 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:37.191226 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:07:37.509200 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a9b6170e-b37d-44ae-9e4a-e78d69a096e1 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:37.521180 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a9b6170e-b37d-44ae-9e4a-e78d69a096e1 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2" status: 200 len: 1392 microversion: 2.1 time: 1.263299 Aug 31 16:07:37.525134 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1647/3455] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:36 2022] GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2 => generated 1392 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:37.536443 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6fab22b8-5e80-4d06-b1e1-95d606f17585 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb46672430>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:37.602814 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c47b9782-cc46-4b82-8570-b50a78f34e51 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:37.611370 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c47b9782-cc46-4b82-8570-b50a78f34e51 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173" status: 200 len: 1508 microversion: 2.1 time: 1.041647 Aug 31 16:07:37.619576 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1809/3456] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:36 2022] GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173 => generated 1508 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:37.653398 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6fab22b8-5e80-4d06-b1e1-95d606f17585 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/88312359-8e02-42d2-90a9-c8d56bdfe0fb" status: 200 len: 1454 microversion: 2.1 time: 0.126868 Aug 31 16:07:37.655585 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1648/3457] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:07:37 2022] GET /compute/v2.1/images/88312359-8e02-42d2-90a9-c8d56bdfe0fb => generated 1454 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:38.549657 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e00b44f1-6307-4f88-88ee-4a7bbdf9f183 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:38.550466 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e00b44f1-6307-4f88-88ee-4a7bbdf9f183 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:38.584374 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e00b44f1-6307-4f88-88ee-4a7bbdf9f183 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:38.584896 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e00b44f1-6307-4f88-88ee-4a7bbdf9f183 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:38.585343 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e00b44f1-6307-4f88-88ee-4a7bbdf9f183 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:38.586121 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e00b44f1-6307-4f88-88ee-4a7bbdf9f183 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:38.586588 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e00b44f1-6307-4f88-88ee-4a7bbdf9f183 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:38.587020 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e00b44f1-6307-4f88-88ee-4a7bbdf9f183 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:38.913790 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6516eb71-e905-4239-8520-0322c5b68d7b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:38.914389 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6516eb71-e905-4239-8520-0322c5b68d7b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:38.921559 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6516eb71-e905-4239-8520-0322c5b68d7b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:38.922063 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6516eb71-e905-4239-8520-0322c5b68d7b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:38.922536 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6516eb71-e905-4239-8520-0322c5b68d7b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:38.937427 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6516eb71-e905-4239-8520-0322c5b68d7b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:38.938220 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6516eb71-e905-4239-8520-0322c5b68d7b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:38.938842 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6516eb71-e905-4239-8520-0322c5b68d7b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:39.011977 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6516eb71-e905-4239-8520-0322c5b68d7b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:07:39.256775 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6516eb71-e905-4239-8520-0322c5b68d7b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 204 len: 0 microversion: 2.42 time: 0.851868 Aug 31 16:07:39.260907 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1810/3458] 10.222.0.50 () {60 vars in 1280 bytes} [Wed Aug 31 16:07:38 2022] DELETE /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 0 bytes in 857 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 16:07:39.270403 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ac874341-f603-4fac-a8cd-5ad1cfd926a6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:39.277781 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ac874341-f603-4fac-a8cd-5ad1cfd926a6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: ac18e976-69d9-4131-be61-fdbcf1b04173] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:39.295742 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ac874341-f603-4fac-a8cd-5ad1cfd926a6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:39.296569 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ac874341-f603-4fac-a8cd-5ad1cfd926a6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:39.297204 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ac874341-f603-4fac-a8cd-5ad1cfd926a6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:39.298131 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ac874341-f603-4fac-a8cd-5ad1cfd926a6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:39.298764 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ac874341-f603-4fac-a8cd-5ad1cfd926a6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:39.299449 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ac874341-f603-4fac-a8cd-5ad1cfd926a6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:39.337294 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e00b44f1-6307-4f88-88ee-4a7bbdf9f183 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:39.361738 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e00b44f1-6307-4f88-88ee-4a7bbdf9f183 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2" status: 200 len: 1392 microversion: 2.1 time: 0.817208 Aug 31 16:07:39.366665 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1649/3459] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:38 2022] GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2 => generated 1392 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:39.375632 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8964ef8f-268c-4cbe-b114-ed73dec413e7 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb45d29d30>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:39.553414 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8964ef8f-268c-4cbe-b114-ed73dec413e7 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/88312359-8e02-42d2-90a9-c8d56bdfe0fb" status: 200 len: 1454 microversion: 2.1 time: 0.185018 Aug 31 16:07:39.555777 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1650/3460] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:07:39 2022] GET /compute/v2.1/images/88312359-8e02-42d2-90a9-c8d56bdfe0fb => generated 1454 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:39.580031 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d6229c1c-534f-44cf-b2c9-7476b832c45b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:39.585293 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d6229c1c-534f-44cf-b2c9-7476b832c45b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:39.600964 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6229c1c-534f-44cf-b2c9-7476b832c45b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:39.601463 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6229c1c-534f-44cf-b2c9-7476b832c45b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:39.601893 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6229c1c-534f-44cf-b2c9-7476b832c45b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:39.617046 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6229c1c-534f-44cf-b2c9-7476b832c45b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:39.621384 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6229c1c-534f-44cf-b2c9-7476b832c45b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:39.622339 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6229c1c-534f-44cf-b2c9-7476b832c45b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:39.713119 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ac874341-f603-4fac-a8cd-5ad1cfd926a6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:39.721655 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ac874341-f603-4fac-a8cd-5ad1cfd926a6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173" status: 200 len: 1508 microversion: 2.1 time: 0.457978 Aug 31 16:07:39.728677 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1811/3461] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:39 2022] GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173 => generated 1508 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:40.137849 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d6229c1c-534f-44cf-b2c9-7476b832c45b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:40.161282 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d6229c1c-534f-44cf-b2c9-7476b832c45b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:40.163082 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d6229c1c-534f-44cf-b2c9-7476b832c45b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:40.164547 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d6229c1c-534f-44cf-b2c9-7476b832c45b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 2958 microversion: 2.42 time: 0.605126 Aug 31 16:07:40.165602 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1651/3462] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:07:39 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 2958 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:07:40.385382 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9beb5301-5f06-4388-a699-b23d43019892 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:40.385994 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9beb5301-5f06-4388-a699-b23d43019892 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:40.401355 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9beb5301-5f06-4388-a699-b23d43019892 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:40.402391 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9beb5301-5f06-4388-a699-b23d43019892 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:40.403196 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9beb5301-5f06-4388-a699-b23d43019892 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:40.404576 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9beb5301-5f06-4388-a699-b23d43019892 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:40.406602 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9beb5301-5f06-4388-a699-b23d43019892 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:40.407494 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9beb5301-5f06-4388-a699-b23d43019892 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:40.573245 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9867c104-9ef1-47c8-b7f0-28b98b7e47a9 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb45d21a60>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:40.711341 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9867c104-9ef1-47c8-b7f0-28b98b7e47a9 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/88312359-8e02-42d2-90a9-c8d56bdfe0fb" status: 200 len: 1454 microversion: 2.1 time: 0.144754 Aug 31 16:07:40.713171 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1652/3463] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:07:40 2022] GET /compute/v2.1/images/88312359-8e02-42d2-90a9-c8d56bdfe0fb => generated 1454 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:40.724093 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9beb5301-5f06-4388-a699-b23d43019892 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:40.736970 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9beb5301-5f06-4388-a699-b23d43019892 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2" status: 200 len: 1392 microversion: 2.1 time: 0.355492 Aug 31 16:07:40.756768 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1812/3464] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:40 2022] GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2 => generated 1392 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:40.764690 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-91881bbc-4bc3-4dcc-a621-7808267e9e93 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:40.769409 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-91881bbc-4bc3-4dcc-a621-7808267e9e93 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: ac18e976-69d9-4131-be61-fdbcf1b04173] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:40.841633 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91881bbc-4bc3-4dcc-a621-7808267e9e93 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:40.860294 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91881bbc-4bc3-4dcc-a621-7808267e9e93 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:40.866246 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91881bbc-4bc3-4dcc-a621-7808267e9e93 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:40.868641 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91881bbc-4bc3-4dcc-a621-7808267e9e93 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:40.872657 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91881bbc-4bc3-4dcc-a621-7808267e9e93 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:40.874254 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91881bbc-4bc3-4dcc-a621-7808267e9e93 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:41.193381 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4d2d3bbf-5aee-466e-a0fe-ee02e8378251 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:41.193994 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4d2d3bbf-5aee-466e-a0fe-ee02e8378251 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:41.215365 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4d2d3bbf-5aee-466e-a0fe-ee02e8378251 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:41.215999 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4d2d3bbf-5aee-466e-a0fe-ee02e8378251 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:41.216437 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4d2d3bbf-5aee-466e-a0fe-ee02e8378251 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:41.217147 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4d2d3bbf-5aee-466e-a0fe-ee02e8378251 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:41.217601 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4d2d3bbf-5aee-466e-a0fe-ee02e8378251 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:41.218025 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4d2d3bbf-5aee-466e-a0fe-ee02e8378251 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:41.248967 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-91881bbc-4bc3-4dcc-a621-7808267e9e93 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:41.257198 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:07:41.261385 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-91881bbc-4bc3-4dcc-a621-7808267e9e93 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173" status: 200 len: 1508 microversion: 2.1 time: 0.511959 Aug 31 16:07:41.262541 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1653/3465] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:40 2022] GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173 => generated 1508 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:41.289917 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-fac3b147-c665-42af-acc4-4905dfb8f5eb req-65b3587a-dd86-4a50-a75d-9618cdb7ec16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3255935-3cff-4bb0-aad2-a8f401028a59", "name": "network-vif-plugged", "status": "completed", "tag": "21dd4917-2780-427e-86cb-ca75980a35b5"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:07:41.320390 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-fac3b147-c665-42af-acc4-4905dfb8f5eb req-65b3587a-dd86-4a50-a75d-9618cdb7ec16 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:41.321946 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-fac3b147-c665-42af-acc4-4905dfb8f5eb req-65b3587a-dd86-4a50-a75d-9618cdb7ec16 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:41.339246 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-fac3b147-c665-42af-acc4-4905dfb8f5eb req-65b3587a-dd86-4a50-a75d-9618cdb7ec16 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:41.386211 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-fac3b147-c665-42af-acc4-4905dfb8f5eb req-65b3587a-dd86-4a50-a75d-9618cdb7ec16 service nova] Creating event network-vif-plugged:21dd4917-2780-427e-86cb-ca75980a35b5 for instance d3255935-3cff-4bb0-aad2-a8f401028a59 on n-h2-833090-16 Aug 31 16:07:41.398909 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-fac3b147-c665-42af-acc4-4905dfb8f5eb req-65b3587a-dd86-4a50-a75d-9618cdb7ec16 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132116 Aug 31 16:07:41.402254 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1654/3466] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:07:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:07:41.620921 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4d2d3bbf-5aee-466e-a0fe-ee02e8378251 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:41.655076 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4d2d3bbf-5aee-466e-a0fe-ee02e8378251 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:41.659641 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4d2d3bbf-5aee-466e-a0fe-ee02e8378251 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:41.661836 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4d2d3bbf-5aee-466e-a0fe-ee02e8378251 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 2958 microversion: 2.42 time: 0.473015 Aug 31 16:07:41.685073 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1813/3467] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:07:41 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 2958 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:07:41.730550 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-96513de1-937e-4b5f-a6bf-b96d15902ae4 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb4aa2aaf0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:41.764467 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-dfea6b38-1615-42f5-9c5d-54a3e23a197c tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:41.766584 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-dfea6b38-1615-42f5-9c5d-54a3e23a197c tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:41.785750 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dfea6b38-1615-42f5-9c5d-54a3e23a197c tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:41.786394 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dfea6b38-1615-42f5-9c5d-54a3e23a197c tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:41.786825 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dfea6b38-1615-42f5-9c5d-54a3e23a197c tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:41.795273 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dfea6b38-1615-42f5-9c5d-54a3e23a197c tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:41.797020 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dfea6b38-1615-42f5-9c5d-54a3e23a197c tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:41.799500 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dfea6b38-1615-42f5-9c5d-54a3e23a197c tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:41.815059 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-96513de1-937e-4b5f-a6bf-b96d15902ae4 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/88312359-8e02-42d2-90a9-c8d56bdfe0fb" status: 200 len: 1454 microversion: 2.1 time: 0.090992 Aug 31 16:07:41.823316 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1655/3468] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:07:41 2022] GET /compute/v2.1/images/88312359-8e02-42d2-90a9-c8d56bdfe0fb => generated 1454 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:42.174221 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-dfea6b38-1615-42f5-9c5d-54a3e23a197c tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:42.187530 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-dfea6b38-1615-42f5-9c5d-54a3e23a197c tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2" status: 200 len: 1392 microversion: 2.1 time: 0.424209 Aug 31 16:07:42.188189 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1814/3469] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:41 2022] GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2 => generated 1392 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:42.285549 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f4296208-c681-436c-aedb-4e5601bb9e8a tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:42.286349 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f4296208-c681-436c-aedb-4e5601bb9e8a tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: ac18e976-69d9-4131-be61-fdbcf1b04173] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:42.306370 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4296208-c681-436c-aedb-4e5601bb9e8a tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:42.308852 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4296208-c681-436c-aedb-4e5601bb9e8a tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:42.309482 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4296208-c681-436c-aedb-4e5601bb9e8a tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:42.314021 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4296208-c681-436c-aedb-4e5601bb9e8a tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:42.315061 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4296208-c681-436c-aedb-4e5601bb9e8a tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:42.315958 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4296208-c681-436c-aedb-4e5601bb9e8a tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:42.695682 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-87f1a022-73b9-44a7-8c9c-1ae7185ce130 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:42.696722 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-87f1a022-73b9-44a7-8c9c-1ae7185ce130 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:42.725780 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-87f1a022-73b9-44a7-8c9c-1ae7185ce130 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:42.726888 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-87f1a022-73b9-44a7-8c9c-1ae7185ce130 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:42.727349 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-87f1a022-73b9-44a7-8c9c-1ae7185ce130 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:42.728071 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f4296208-c681-436c-aedb-4e5601bb9e8a tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:42.728228 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-87f1a022-73b9-44a7-8c9c-1ae7185ce130 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:42.728535 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-87f1a022-73b9-44a7-8c9c-1ae7185ce130 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:42.728956 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-87f1a022-73b9-44a7-8c9c-1ae7185ce130 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:42.743905 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f4296208-c681-436c-aedb-4e5601bb9e8a tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173" status: 200 len: 1508 microversion: 2.1 time: 0.462667 Aug 31 16:07:42.757010 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1656/3470] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:42 2022] GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173 => generated 1508 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:42.834269 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f7e650d9-258a-41aa-8d26-e4fb6412da54 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb4aa398b0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:42.965272 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f7e650d9-258a-41aa-8d26-e4fb6412da54 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/88312359-8e02-42d2-90a9-c8d56bdfe0fb" status: 200 len: 1454 microversion: 2.1 time: 0.138108 Aug 31 16:07:42.975254 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1657/3471] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:07:42 2022] GET /compute/v2.1/images/88312359-8e02-42d2-90a9-c8d56bdfe0fb => generated 1454 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:43.189183 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-87f1a022-73b9-44a7-8c9c-1ae7185ce130 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:43.212061 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7b641e9d-c5dc-4dd4-812b-4b202958e2b6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:43.212876 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7b641e9d-c5dc-4dd4-812b-4b202958e2b6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:43.226448 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-87f1a022-73b9-44a7-8c9c-1ae7185ce130 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:43.232261 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-87f1a022-73b9-44a7-8c9c-1ae7185ce130 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:43.233145 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b641e9d-c5dc-4dd4-812b-4b202958e2b6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:43.234847 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b641e9d-c5dc-4dd4-812b-4b202958e2b6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:43.237872 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b641e9d-c5dc-4dd4-812b-4b202958e2b6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:43.241273 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b641e9d-c5dc-4dd4-812b-4b202958e2b6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:43.241964 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-87f1a022-73b9-44a7-8c9c-1ae7185ce130 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 2958 microversion: 2.42 time: 0.546726 Aug 31 16:07:43.244507 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b641e9d-c5dc-4dd4-812b-4b202958e2b6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:43.245694 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1815/3472] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:07:42 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 2958 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:07:43.246954 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b641e9d-c5dc-4dd4-812b-4b202958e2b6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:43.732039 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7b641e9d-c5dc-4dd4-812b-4b202958e2b6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:43.753591 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7b641e9d-c5dc-4dd4-812b-4b202958e2b6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2" status: 200 len: 1392 microversion: 2.1 time: 0.543560 Aug 31 16:07:43.761029 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1658/3473] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:43 2022] GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2 => generated 1392 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:07:43.770779 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d41df8a1-1282-4666-8914-b4c084c4dfb6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:43.771557 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d41df8a1-1282-4666-8914-b4c084c4dfb6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: ac18e976-69d9-4131-be61-fdbcf1b04173] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:43.808473 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d41df8a1-1282-4666-8914-b4c084c4dfb6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:43.811406 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d41df8a1-1282-4666-8914-b4c084c4dfb6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:43.814279 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d41df8a1-1282-4666-8914-b4c084c4dfb6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:43.816577 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d41df8a1-1282-4666-8914-b4c084c4dfb6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:43.819830 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d41df8a1-1282-4666-8914-b4c084c4dfb6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:43.821506 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d41df8a1-1282-4666-8914-b4c084c4dfb6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:43.980967 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-585e635a-53c3-492d-a144-f090120ed818 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb4aa9c1f0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:44.093621 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d41df8a1-1282-4666-8914-b4c084c4dfb6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:44.112975 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d41df8a1-1282-4666-8914-b4c084c4dfb6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173" status: 200 len: 1508 microversion: 2.1 time: 0.348794 Aug 31 16:07:44.130538 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1816/3474] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:43 2022] GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173 => generated 1508 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:44.273043 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-be7417d2-5d0a-463f-bbde-5c2134aa6855 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:44.275197 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-be7417d2-5d0a-463f-bbde-5c2134aa6855 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:44.300471 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-be7417d2-5d0a-463f-bbde-5c2134aa6855 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:44.302891 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-be7417d2-5d0a-463f-bbde-5c2134aa6855 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:44.304325 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-be7417d2-5d0a-463f-bbde-5c2134aa6855 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:44.306732 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-be7417d2-5d0a-463f-bbde-5c2134aa6855 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:44.308501 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-be7417d2-5d0a-463f-bbde-5c2134aa6855 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:44.312875 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-be7417d2-5d0a-463f-bbde-5c2134aa6855 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:44.396233 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:07:45.005111 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-be7417d2-5d0a-463f-bbde-5c2134aa6855 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:45.026467 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-be7417d2-5d0a-463f-bbde-5c2134aa6855 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:45.044742 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-be7417d2-5d0a-463f-bbde-5c2134aa6855 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:45.046116 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-be7417d2-5d0a-463f-bbde-5c2134aa6855 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 2958 microversion: 2.42 time: 0.778788 Aug 31 16:07:45.050501 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1817/3475] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:07:44 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 2958 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:07:45.064185 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4a55ac34-201a-44e3-a687-58c1e0d9b0c2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:45.066018 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4a55ac34-201a-44e3-a687-58c1e0d9b0c2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:45.083286 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4a55ac34-201a-44e3-a687-58c1e0d9b0c2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:45.083985 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4a55ac34-201a-44e3-a687-58c1e0d9b0c2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:45.084433 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4a55ac34-201a-44e3-a687-58c1e0d9b0c2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:45.090148 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4a55ac34-201a-44e3-a687-58c1e0d9b0c2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:45.094645 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4a55ac34-201a-44e3-a687-58c1e0d9b0c2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:45.095526 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4a55ac34-201a-44e3-a687-58c1e0d9b0c2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:47.087311 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4a55ac34-201a-44e3-a687-58c1e0d9b0c2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:47.097697 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4a55ac34-201a-44e3-a687-58c1e0d9b0c2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2" status: 200 len: 1392 microversion: 2.1 time: 2.045727 Aug 31 16:07:47.110128 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1818/3476] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:45 2022] GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2 => generated 1392 bytes in 2053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:47.115582 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-01308213-42f9-4c87-af83-9d4d2f1f36a7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:47.115582 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-01308213-42f9-4c87-af83-9d4d2f1f36a7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: ac18e976-69d9-4131-be61-fdbcf1b04173] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:47.148143 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01308213-42f9-4c87-af83-9d4d2f1f36a7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:47.148678 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01308213-42f9-4c87-af83-9d4d2f1f36a7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:47.149081 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01308213-42f9-4c87-af83-9d4d2f1f36a7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:47.149785 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01308213-42f9-4c87-af83-9d4d2f1f36a7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:47.151314 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01308213-42f9-4c87-af83-9d4d2f1f36a7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:47.151743 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01308213-42f9-4c87-af83-9d4d2f1f36a7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:47.643851 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-01308213-42f9-4c87-af83-9d4d2f1f36a7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:47.656135 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-01308213-42f9-4c87-af83-9d4d2f1f36a7 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173" status: 200 len: 1508 microversion: 2.1 time: 0.549898 Aug 31 16:07:47.671211 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1819/3477] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:47 2022] GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173 => generated 1508 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:47.685894 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-aa235b7f-52cd-42c0-96c4-ff8a34c6af12 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:47.686691 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-aa235b7f-52cd-42c0-96c4-ff8a34c6af12 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:47.701400 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aa235b7f-52cd-42c0-96c4-ff8a34c6af12 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:47.702231 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aa235b7f-52cd-42c0-96c4-ff8a34c6af12 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:47.703402 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aa235b7f-52cd-42c0-96c4-ff8a34c6af12 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:47.704680 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aa235b7f-52cd-42c0-96c4-ff8a34c6af12 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:47.707762 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aa235b7f-52cd-42c0-96c4-ff8a34c6af12 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:47.709312 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aa235b7f-52cd-42c0-96c4-ff8a34c6af12 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:48.053452 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-aa235b7f-52cd-42c0-96c4-ff8a34c6af12 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:48.065354 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-aa235b7f-52cd-42c0-96c4-ff8a34c6af12 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:48.067315 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-aa235b7f-52cd-42c0-96c4-ff8a34c6af12 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:48.068895 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-aa235b7f-52cd-42c0-96c4-ff8a34c6af12 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 2937 microversion: 2.42 time: 0.396278 Aug 31 16:07:48.069696 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1820/3478] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:07:47 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 2937 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:07:48.091242 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-05a1fd53-a22f-43e8-aeda-867bdc4a3caf req-2c6a4390-ad38-4049-a3dc-12480d641137 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e89e500-ddc5-4549-8631-9d62545016d1", "name": "network-vif-unplugged", "status": "completed", "tag": "6be52102-ccae-4668-bb69-c84a894fc971"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:07:48.121326 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-05a1fd53-a22f-43e8-aeda-867bdc4a3caf req-2c6a4390-ad38-4049-a3dc-12480d641137 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:48.121954 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-05a1fd53-a22f-43e8-aeda-867bdc4a3caf req-2c6a4390-ad38-4049-a3dc-12480d641137 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:48.124243 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-05a1fd53-a22f-43e8-aeda-867bdc4a3caf req-2c6a4390-ad38-4049-a3dc-12480d641137 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:48.162636 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-05a1fd53-a22f-43e8-aeda-867bdc4a3caf req-2c6a4390-ad38-4049-a3dc-12480d641137 service nova] Creating event network-vif-unplugged:6be52102-ccae-4668-bb69-c84a894fc971 for instance 0e89e500-ddc5-4549-8631-9d62545016d1 on n-h2-833090-16 Aug 31 16:07:48.181663 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-05a1fd53-a22f-43e8-aeda-867bdc4a3caf req-2c6a4390-ad38-4049-a3dc-12480d641137 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106070 Aug 31 16:07:48.182422 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1821/3479] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:07:48.193951 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2a70f987-d668-4b15-bfac-cbfbac1d4c13 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:48.201056 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2a70f987-d668-4b15-bfac-cbfbac1d4c13 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:48.228705 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2a70f987-d668-4b15-bfac-cbfbac1d4c13 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:48.233938 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2a70f987-d668-4b15-bfac-cbfbac1d4c13 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:48.243560 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2a70f987-d668-4b15-bfac-cbfbac1d4c13 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:48.244909 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2a70f987-d668-4b15-bfac-cbfbac1d4c13 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:48.254529 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2a70f987-d668-4b15-bfac-cbfbac1d4c13 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:48.256105 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2a70f987-d668-4b15-bfac-cbfbac1d4c13 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:48.638600 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2a70f987-d668-4b15-bfac-cbfbac1d4c13 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:48.668469 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2a70f987-d668-4b15-bfac-cbfbac1d4c13 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2" status: 200 len: 1392 microversion: 2.1 time: 0.476928 Aug 31 16:07:48.685469 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1822/3480] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:48 2022] GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2 => generated 1392 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:48.701393 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b9c2f853-f2ef-45be-a123-e92d48c4af94 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:48.702396 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b9c2f853-f2ef-45be-a123-e92d48c4af94 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: ac18e976-69d9-4131-be61-fdbcf1b04173] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:48.718274 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b9c2f853-f2ef-45be-a123-e92d48c4af94 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:48.720696 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b9c2f853-f2ef-45be-a123-e92d48c4af94 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:48.721911 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b9c2f853-f2ef-45be-a123-e92d48c4af94 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:48.723052 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b9c2f853-f2ef-45be-a123-e92d48c4af94 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:48.737034 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b9c2f853-f2ef-45be-a123-e92d48c4af94 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:48.742065 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b9c2f853-f2ef-45be-a123-e92d48c4af94 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:49.161298 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b9c2f853-f2ef-45be-a123-e92d48c4af94 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:49.191191 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b9c2f853-f2ef-45be-a123-e92d48c4af94 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173" status: 200 len: 1508 microversion: 2.1 time: 0.495321 Aug 31 16:07:49.195037 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1823/3481] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:48 2022] GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173 => generated 1508 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:49.207003 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2a1f2ae4-c295-4d33-81b8-aa1a3a2cd562 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:49.209775 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2a1f2ae4-c295-4d33-81b8-aa1a3a2cd562 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:49.232252 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2a1f2ae4-c295-4d33-81b8-aa1a3a2cd562 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:49.233109 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2a1f2ae4-c295-4d33-81b8-aa1a3a2cd562 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:49.236005 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2a1f2ae4-c295-4d33-81b8-aa1a3a2cd562 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:49.240626 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2a1f2ae4-c295-4d33-81b8-aa1a3a2cd562 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:49.242576 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2a1f2ae4-c295-4d33-81b8-aa1a3a2cd562 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:49.244717 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2a1f2ae4-c295-4d33-81b8-aa1a3a2cd562 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:50.552868 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2a1f2ae4-c295-4d33-81b8-aa1a3a2cd562 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:50.572068 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2a1f2ae4-c295-4d33-81b8-aa1a3a2cd562 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:50.577678 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2a1f2ae4-c295-4d33-81b8-aa1a3a2cd562 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:50.587012 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2a1f2ae4-c295-4d33-81b8-aa1a3a2cd562 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 2916 microversion: 2.42 time: 1.384184 Aug 31 16:07:50.592665 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1824/3482] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:07:49 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 2916 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:07:50.612483 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ff0581dd-d301-4ad5-b58a-813d9e2ab2dd tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:50.613645 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ff0581dd-d301-4ad5-b58a-813d9e2ab2dd tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:50.635576 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ff0581dd-d301-4ad5-b58a-813d9e2ab2dd tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:50.637000 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ff0581dd-d301-4ad5-b58a-813d9e2ab2dd tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:50.642418 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ff0581dd-d301-4ad5-b58a-813d9e2ab2dd tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:50.644953 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ff0581dd-d301-4ad5-b58a-813d9e2ab2dd tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:50.645615 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ff0581dd-d301-4ad5-b58a-813d9e2ab2dd tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:50.648018 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ff0581dd-d301-4ad5-b58a-813d9e2ab2dd tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:50.981977 n-d-833090-16 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 16:07:50.982582 n-d-833090-16 devstack@n-api.service[128863]: Wed Aug 31 16:07:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/images/88312359-8e02-42d2-90a9-c8d56bdfe0fb (ip 10.222.0.50) !!! Aug 31 16:07:51.780663 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ff0581dd-d301-4ad5-b58a-813d9e2ab2dd tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:51.872002 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ff0581dd-d301-4ad5-b58a-813d9e2ab2dd tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2" status: 200 len: 1392 microversion: 2.1 time: 1.268045 Aug 31 16:07:51.915563 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1825/3483] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:50 2022] GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2 => generated 1392 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:51.947939 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e59d07b2-3f5e-42fe-aece-d95c86ba3245 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:51.955496 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e59d07b2-3f5e-42fe-aece-d95c86ba3245 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: ac18e976-69d9-4131-be61-fdbcf1b04173] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:51.983181 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e59d07b2-3f5e-42fe-aece-d95c86ba3245 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:51.983855 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e59d07b2-3f5e-42fe-aece-d95c86ba3245 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:51.984603 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e59d07b2-3f5e-42fe-aece-d95c86ba3245 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:51.991617 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e59d07b2-3f5e-42fe-aece-d95c86ba3245 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:51.992387 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e59d07b2-3f5e-42fe-aece-d95c86ba3245 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:51.992823 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e59d07b2-3f5e-42fe-aece-d95c86ba3245 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:52.970850 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e59d07b2-3f5e-42fe-aece-d95c86ba3245 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:53.003027 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e59d07b2-3f5e-42fe-aece-d95c86ba3245 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173" status: 200 len: 1508 microversion: 2.1 time: 1.080830 Aug 31 16:07:53.027101 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1826/3484] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:51 2022] GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173 => generated 1508 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:53.060412 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-7a0764c5-c003-4dfc-9202-0ee8aa8f6e98 req-9dd90ccd-882a-4e17-abb1-76a6b9f29ca3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e89e500-ddc5-4549-8631-9d62545016d1", "name": "network-vif-unplugged", "status": "completed", "tag": "57f3869c-b000-4d3c-afe9-a2a6741a014c"}, {"server_uuid": "0e89e500-ddc5-4549-8631-9d62545016d1", "name": "network-vif-unplugged", "status": "completed", "tag": "757b9501-0859-4dd6-8292-391612616a92"}, {"server_uuid": "0e89e500-ddc5-4549-8631-9d62545016d1", "name": "network-vif-unplugged", "status": "completed", "tag": "505cceaf-e4cc-4b2b-8615-77bc0c7bf80e"}, {"server_uuid": "0e89e500-ddc5-4549-8631-9d62545016d1", "name": "network-vif-unplugged", "status": "completed", "tag": "68c44d14-1c71-4e2c-a5ab-c43c22e7f048"}, {"server_uuid": "0e89e500-ddc5-4549-8631-9d62545016d1", "name": "network-vif-unplugged", "status": "completed", "tag": "1caee438-a350-4a78-8297-f52725db29bb"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:07:53.106758 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7a0764c5-c003-4dfc-9202-0ee8aa8f6e98 req-9dd90ccd-882a-4e17-abb1-76a6b9f29ca3 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:53.107474 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7a0764c5-c003-4dfc-9202-0ee8aa8f6e98 req-9dd90ccd-882a-4e17-abb1-76a6b9f29ca3 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:53.115396 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7a0764c5-c003-4dfc-9202-0ee8aa8f6e98 req-9dd90ccd-882a-4e17-abb1-76a6b9f29ca3 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:53.185360 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-7a0764c5-c003-4dfc-9202-0ee8aa8f6e98 req-9dd90ccd-882a-4e17-abb1-76a6b9f29ca3 service nova] Creating event network-vif-unplugged:57f3869c-b000-4d3c-afe9-a2a6741a014c for instance 0e89e500-ddc5-4549-8631-9d62545016d1 on n-h2-833090-16 Aug 31 16:07:53.190936 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-7a0764c5-c003-4dfc-9202-0ee8aa8f6e98 req-9dd90ccd-882a-4e17-abb1-76a6b9f29ca3 service nova] Creating event network-vif-unplugged:757b9501-0859-4dd6-8292-391612616a92 for instance 0e89e500-ddc5-4549-8631-9d62545016d1 on n-h2-833090-16 Aug 31 16:07:53.191642 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-7a0764c5-c003-4dfc-9202-0ee8aa8f6e98 req-9dd90ccd-882a-4e17-abb1-76a6b9f29ca3 service nova] Creating event network-vif-unplugged:505cceaf-e4cc-4b2b-8615-77bc0c7bf80e for instance 0e89e500-ddc5-4549-8631-9d62545016d1 on n-h2-833090-16 Aug 31 16:07:53.202971 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-7a0764c5-c003-4dfc-9202-0ee8aa8f6e98 req-9dd90ccd-882a-4e17-abb1-76a6b9f29ca3 service nova] Creating event network-vif-unplugged:68c44d14-1c71-4e2c-a5ab-c43c22e7f048 for instance 0e89e500-ddc5-4549-8631-9d62545016d1 on n-h2-833090-16 Aug 31 16:07:53.203703 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-7a0764c5-c003-4dfc-9202-0ee8aa8f6e98 req-9dd90ccd-882a-4e17-abb1-76a6b9f29ca3 service nova] Creating event network-vif-unplugged:1caee438-a350-4a78-8297-f52725db29bb for instance 0e89e500-ddc5-4549-8631-9d62545016d1 on n-h2-833090-16 Aug 31 16:07:53.227924 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-7a0764c5-c003-4dfc-9202-0ee8aa8f6e98 req-9dd90ccd-882a-4e17-abb1-76a6b9f29ca3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 877 microversion: 2.1 time: 0.198848 Aug 31 16:07:53.229493 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=44 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:07:53.236697 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1827/3485] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 877 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:07:53.249624 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-237ea308-13e0-4d62-9fc9-3fd769b428bc req-25979036-c410-46b1-afad-24b6851fcc09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e89e500-ddc5-4549-8631-9d62545016d1", "name": "network-vif-deleted", "tag": "1caee438-a350-4a78-8297-f52725db29bb"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:07:53.296213 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-237ea308-13e0-4d62-9fc9-3fd769b428bc req-25979036-c410-46b1-afad-24b6851fcc09 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:53.310590 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-237ea308-13e0-4d62-9fc9-3fd769b428bc req-25979036-c410-46b1-afad-24b6851fcc09 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:53.311233 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-237ea308-13e0-4d62-9fc9-3fd769b428bc req-25979036-c410-46b1-afad-24b6851fcc09 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:53.369285 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-237ea308-13e0-4d62-9fc9-3fd769b428bc req-25979036-c410-46b1-afad-24b6851fcc09 service nova] Creating event network-vif-deleted:1caee438-a350-4a78-8297-f52725db29bb for instance 0e89e500-ddc5-4549-8631-9d62545016d1 on n-h2-833090-16 Aug 31 16:07:53.390328 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-237ea308-13e0-4d62-9fc9-3fd769b428bc req-25979036-c410-46b1-afad-24b6851fcc09 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151901 Aug 31 16:07:53.394193 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1828/3486] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:07:53.409979 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8da2a654-7b37-4bf3-a23e-47d95fc8944d tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:53.438638 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8da2a654-7b37-4bf3-a23e-47d95fc8944d tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:53.461488 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8da2a654-7b37-4bf3-a23e-47d95fc8944d tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:53.468966 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8da2a654-7b37-4bf3-a23e-47d95fc8944d tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:53.469724 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8da2a654-7b37-4bf3-a23e-47d95fc8944d tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:53.470750 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8da2a654-7b37-4bf3-a23e-47d95fc8944d tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:53.477758 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8da2a654-7b37-4bf3-a23e-47d95fc8944d tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:53.478725 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8da2a654-7b37-4bf3-a23e-47d95fc8944d tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:53.743528 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=14 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:07:54.815759 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-585e635a-53c3-492d-a144-f090120ed818 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/88312359-8e02-42d2-90a9-c8d56bdfe0fb" status: 200 len: 1454 microversion: 2.1 time: 10.838300 Aug 31 16:07:54.817988 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1659/3487] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:07:43 2022] GET /compute/v2.1/images/88312359-8e02-42d2-90a9-c8d56bdfe0fb => generated 1454 bytes in 10842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:07:54.843989 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-eeefbdde-0e91-41e1-928d-34a3dc9781b5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:54.858971 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-eeefbdde-0e91-41e1-928d-34a3dc9781b5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:54.870741 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8da2a654-7b37-4bf3-a23e-47d95fc8944d tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:54.872926 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eeefbdde-0e91-41e1-928d-34a3dc9781b5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:54.873953 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eeefbdde-0e91-41e1-928d-34a3dc9781b5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:54.874738 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eeefbdde-0e91-41e1-928d-34a3dc9781b5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:54.881803 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eeefbdde-0e91-41e1-928d-34a3dc9781b5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:54.882821 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eeefbdde-0e91-41e1-928d-34a3dc9781b5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:54.883518 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eeefbdde-0e91-41e1-928d-34a3dc9781b5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:54.885513 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8da2a654-7b37-4bf3-a23e-47d95fc8944d tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:54.888413 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8da2a654-7b37-4bf3-a23e-47d95fc8944d tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:54.896637 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8da2a654-7b37-4bf3-a23e-47d95fc8944d tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 2578 microversion: 2.42 time: 1.500288 Aug 31 16:07:54.898929 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1829/3488] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:07:53 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 2578 bytes in 1503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:07:54.914332 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1538b6ec-d932-49e0-9dc0-1a006327edcd tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:54.915972 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1538b6ec-d932-49e0-9dc0-1a006327edcd tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: ac18e976-69d9-4131-be61-fdbcf1b04173] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:54.930687 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1538b6ec-d932-49e0-9dc0-1a006327edcd tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:54.938913 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1538b6ec-d932-49e0-9dc0-1a006327edcd tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:54.939892 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1538b6ec-d932-49e0-9dc0-1a006327edcd tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:54.940902 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1538b6ec-d932-49e0-9dc0-1a006327edcd tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:54.942070 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1538b6ec-d932-49e0-9dc0-1a006327edcd tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:54.942828 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1538b6ec-d932-49e0-9dc0-1a006327edcd tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:55.906416 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-eeefbdde-0e91-41e1-928d-34a3dc9781b5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:55.927225 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-eeefbdde-0e91-41e1-928d-34a3dc9781b5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2" status: 200 len: 1392 microversion: 2.1 time: 1.101776 Aug 31 16:07:55.930381 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1660/3489] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:54 2022] GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2 => generated 1392 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:55.938529 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1538b6ec-d932-49e0-9dc0-1a006327edcd tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:55.958216 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1538b6ec-d932-49e0-9dc0-1a006327edcd tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173" status: 200 len: 1508 microversion: 2.1 time: 1.056369 Aug 31 16:07:55.965553 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1830/3490] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:54 2022] GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173 => generated 1508 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:55.969887 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-a1ee68b2-7c3c-4a74-8eee-8a5223afaaaf req-7f3a22c4-ccc3-4d61-97c5-25c124c2aab2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e89e500-ddc5-4549-8631-9d62545016d1", "name": "network-vif-deleted", "tag": "757b9501-0859-4dd6-8292-391612616a92"}, {"server_uuid": "4729162e-f8a9-4952-a3e0-be75936208f2", "name": "network-vif-unplugged", "status": "completed", "tag": "cba9d0d4-250d-490b-a5a2-c919d3ee3547"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:07:55.999588 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-94916ef1-29e9-4df6-9e5d-ffdfb7a3b565 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb467b9790>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:56.049002 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a1ee68b2-7c3c-4a74-8eee-8a5223afaaaf req-7f3a22c4-ccc3-4d61-97c5-25c124c2aab2 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:56.052721 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a1ee68b2-7c3c-4a74-8eee-8a5223afaaaf req-7f3a22c4-ccc3-4d61-97c5-25c124c2aab2 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:56.053474 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a1ee68b2-7c3c-4a74-8eee-8a5223afaaaf req-7f3a22c4-ccc3-4d61-97c5-25c124c2aab2 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:56.098355 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-94916ef1-29e9-4df6-9e5d-ffdfb7a3b565 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/88312359-8e02-42d2-90a9-c8d56bdfe0fb" status: 200 len: 1454 microversion: 2.1 time: 0.129217 Aug 31 16:07:56.098940 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1831/3491] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:07:55 2022] GET /compute/v2.1/images/88312359-8e02-42d2-90a9-c8d56bdfe0fb => generated 1454 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:56.117114 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c6909198-92f4-476d-aae5-73c8914e2379 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:56.119078 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c6909198-92f4-476d-aae5-73c8914e2379 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:56.137153 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-a1ee68b2-7c3c-4a74-8eee-8a5223afaaaf req-7f3a22c4-ccc3-4d61-97c5-25c124c2aab2 service nova] Creating event network-vif-deleted:757b9501-0859-4dd6-8292-391612616a92 for instance 0e89e500-ddc5-4549-8631-9d62545016d1 on n-h2-833090-16 Aug 31 16:07:56.139287 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-a1ee68b2-7c3c-4a74-8eee-8a5223afaaaf req-7f3a22c4-ccc3-4d61-97c5-25c124c2aab2 service nova] Creating event network-vif-unplugged:cba9d0d4-250d-490b-a5a2-c919d3ee3547 for instance 4729162e-f8a9-4952-a3e0-be75936208f2 on n-h1-833090-16 Aug 31 16:07:56.149739 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c6909198-92f4-476d-aae5-73c8914e2379 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:56.150597 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c6909198-92f4-476d-aae5-73c8914e2379 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:56.151188 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c6909198-92f4-476d-aae5-73c8914e2379 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:56.154473 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c6909198-92f4-476d-aae5-73c8914e2379 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:56.155196 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c6909198-92f4-476d-aae5-73c8914e2379 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:56.157153 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c6909198-92f4-476d-aae5-73c8914e2379 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:56.195593 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-a1ee68b2-7c3c-4a74-8eee-8a5223afaaaf req-7f3a22c4-ccc3-4d61-97c5-25c124c2aab2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.262671 Aug 31 16:07:56.199016 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1661/3492] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:07:56.874329 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c6909198-92f4-476d-aae5-73c8914e2379 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:56.897625 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c6909198-92f4-476d-aae5-73c8914e2379 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:56.905020 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c6909198-92f4-476d-aae5-73c8914e2379 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:56.908168 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c6909198-92f4-476d-aae5-73c8914e2379 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 2532 microversion: 2.42 time: 0.806873 Aug 31 16:07:56.911378 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1832/3493] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:07:56 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 2532 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:07:56.955778 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3a08ac96-173e-4d97-8c0f-955f11521b8c tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:56.956862 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3a08ac96-173e-4d97-8c0f-955f11521b8c tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:56.973719 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a08ac96-173e-4d97-8c0f-955f11521b8c tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:56.978841 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a08ac96-173e-4d97-8c0f-955f11521b8c tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:56.981669 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a08ac96-173e-4d97-8c0f-955f11521b8c tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:56.982712 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a08ac96-173e-4d97-8c0f-955f11521b8c tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:56.984088 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a08ac96-173e-4d97-8c0f-955f11521b8c tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:56.989898 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a08ac96-173e-4d97-8c0f-955f11521b8c tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:56.992489 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0fb43a7f-8a91-4137-a77e-eae1530df15c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:56.994331 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0fb43a7f-8a91-4137-a77e-eae1530df15c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: ac18e976-69d9-4131-be61-fdbcf1b04173] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:57.008000 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0fb43a7f-8a91-4137-a77e-eae1530df15c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:57.012632 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0fb43a7f-8a91-4137-a77e-eae1530df15c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:57.015490 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0fb43a7f-8a91-4137-a77e-eae1530df15c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:57.016520 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0fb43a7f-8a91-4137-a77e-eae1530df15c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:57.018130 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0fb43a7f-8a91-4137-a77e-eae1530df15c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:57.018842 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0fb43a7f-8a91-4137-a77e-eae1530df15c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:59.063226 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3a08ac96-173e-4d97-8c0f-955f11521b8c tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:59.079184 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3a08ac96-173e-4d97-8c0f-955f11521b8c tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2" status: 200 len: 1392 microversion: 2.1 time: 2.130369 Aug 31 16:07:59.112696 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1662/3494] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:56 2022] GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2 => generated 1392 bytes in 2165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:59.119083 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-21a8d67b-8590-4f60-b961-a5a0b322dbc6 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb45e2e8b0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:59.219499 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-21a8d67b-8590-4f60-b961-a5a0b322dbc6 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/88312359-8e02-42d2-90a9-c8d56bdfe0fb" status: 200 len: 1454 microversion: 2.1 time: 0.104982 Aug 31 16:07:59.221149 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1663/3495] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:07:59 2022] GET /compute/v2.1/images/88312359-8e02-42d2-90a9-c8d56bdfe0fb => generated 1454 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:59.225921 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-51b596ce-ac6f-4f13-bf9c-15f8e7be4c95 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:59.234255 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-51b596ce-ac6f-4f13-bf9c-15f8e7be4c95 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:59.247663 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-51b596ce-ac6f-4f13-bf9c-15f8e7be4c95 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:59.248388 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-51b596ce-ac6f-4f13-bf9c-15f8e7be4c95 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:59.250664 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-51b596ce-ac6f-4f13-bf9c-15f8e7be4c95 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:59.251615 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-51b596ce-ac6f-4f13-bf9c-15f8e7be4c95 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:59.252372 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-51b596ce-ac6f-4f13-bf9c-15f8e7be4c95 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:59.254631 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-51b596ce-ac6f-4f13-bf9c-15f8e7be4c95 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:59.278029 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0fb43a7f-8a91-4137-a77e-eae1530df15c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:59.288981 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0fb43a7f-8a91-4137-a77e-eae1530df15c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173" status: 200 len: 1505 microversion: 2.1 time: 2.302950 Aug 31 16:07:59.298478 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1833/3496] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:07:56 2022] GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173 => generated 1505 bytes in 2313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:07:59.718657 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1186175d-2e5e-4d60-8548-4b9a1a6b949e tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:07:59.719781 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1186175d-2e5e-4d60-8548-4b9a1a6b949e tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:07:59.744796 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1186175d-2e5e-4d60-8548-4b9a1a6b949e tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:59.747863 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1186175d-2e5e-4d60-8548-4b9a1a6b949e tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:59.748633 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1186175d-2e5e-4d60-8548-4b9a1a6b949e tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:59.750486 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1186175d-2e5e-4d60-8548-4b9a1a6b949e tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:07:59.750973 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1186175d-2e5e-4d60-8548-4b9a1a6b949e tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:07:59.752608 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1186175d-2e5e-4d60-8548-4b9a1a6b949e tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:07:59.813578 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1186175d-2e5e-4d60-8548-4b9a1a6b949e tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:07:59.945067 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-51b596ce-ac6f-4f13-bf9c-15f8e7be4c95 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:59.967266 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-51b596ce-ac6f-4f13-bf9c-15f8e7be4c95 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:59.978228 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-51b596ce-ac6f-4f13-bf9c-15f8e7be4c95 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:07:59.979673 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-51b596ce-ac6f-4f13-bf9c-15f8e7be4c95 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 2326 microversion: 2.42 time: 0.757444 Aug 31 16:07:59.980682 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1664/3497] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:07:59 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 2326 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:07:59.985626 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-3619c510-4afd-4c84-a578-f807bd15e6d8 req-59e3d328-0ee0-461a-8641-5a4b0690acee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4729162e-f8a9-4952-a3e0-be75936208f2", "tag": "cba9d0d4-250d-490b-a5a2-c919d3ee3547"}, {"server_uuid": "0e89e500-ddc5-4549-8631-9d62545016d1", "name": "network-vif-deleted", "tag": "68c44d14-1c71-4e2c-a5ab-c43c22e7f048"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:00.012106 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3619c510-4afd-4c84-a578-f807bd15e6d8 req-59e3d328-0ee0-461a-8641-5a4b0690acee service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:00.012834 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3619c510-4afd-4c84-a578-f807bd15e6d8 req-59e3d328-0ee0-461a-8641-5a4b0690acee service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:00.014610 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3619c510-4afd-4c84-a578-f807bd15e6d8 req-59e3d328-0ee0-461a-8641-5a4b0690acee service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:00.063665 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-3619c510-4afd-4c84-a578-f807bd15e6d8 req-59e3d328-0ee0-461a-8641-5a4b0690acee service nova] Creating event network-changed:cba9d0d4-250d-490b-a5a2-c919d3ee3547 for instance 4729162e-f8a9-4952-a3e0-be75936208f2 on n-h1-833090-16 Aug 31 16:08:00.068466 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-3619c510-4afd-4c84-a578-f807bd15e6d8 req-59e3d328-0ee0-461a-8641-5a4b0690acee service nova] Creating event network-vif-deleted:68c44d14-1c71-4e2c-a5ab-c43c22e7f048 for instance 0e89e500-ddc5-4549-8631-9d62545016d1 on n-h2-833090-16 Aug 31 16:08:00.080118 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1186175d-2e5e-4d60-8548-4b9a1a6b949e tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 204 len: 0 microversion: 2.32 time: 0.775584 Aug 31 16:08:00.089256 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1834/3498] 10.222.0.50 () {60 vars in 1280 bytes} [Wed Aug 31 16:07:59 2022] DELETE /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 0 bytes in 787 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 16:08:00.092714 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-3619c510-4afd-4c84-a578-f807bd15e6d8 req-59e3d328-0ee0-461a-8641-5a4b0690acee service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.110581 Aug 31 16:08:00.097960 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-80dce034-6be9-4f8d-b166-1614abc5821d req-44c01b17-4616-4eb1-89dd-179017bd722c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac18e976-69d9-4131-be61-fdbcf1b04173", "name": "network-vif-unplugged", "status": "completed", "tag": "cfd88315-b685-44a6-8390-699b793813af"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:00.108184 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1665/3499] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:00.113275 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-80dce034-6be9-4f8d-b166-1614abc5821d req-44c01b17-4616-4eb1-89dd-179017bd722c service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:00.113769 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-80dce034-6be9-4f8d-b166-1614abc5821d req-44c01b17-4616-4eb1-89dd-179017bd722c service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:00.115066 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-80dce034-6be9-4f8d-b166-1614abc5821d req-44c01b17-4616-4eb1-89dd-179017bd722c service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:00.124760 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-04bafa24-dff0-49f4-97e8-a70c7fb59d56 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:00.125467 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-04bafa24-dff0-49f4-97e8-a70c7fb59d56 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:00.143000 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-80dce034-6be9-4f8d-b166-1614abc5821d req-44c01b17-4616-4eb1-89dd-179017bd722c service nova] Creating event network-vif-unplugged:cfd88315-b685-44a6-8390-699b793813af for instance ac18e976-69d9-4131-be61-fdbcf1b04173 on n-h2-833090-16 Aug 31 16:08:00.146123 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04bafa24-dff0-49f4-97e8-a70c7fb59d56 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:00.146666 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04bafa24-dff0-49f4-97e8-a70c7fb59d56 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:00.147218 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04bafa24-dff0-49f4-97e8-a70c7fb59d56 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:00.150789 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04bafa24-dff0-49f4-97e8-a70c7fb59d56 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:00.151500 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-80dce034-6be9-4f8d-b166-1614abc5821d req-44c01b17-4616-4eb1-89dd-179017bd722c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063127 Aug 31 16:08:00.152534 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04bafa24-dff0-49f4-97e8-a70c7fb59d56 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:00.152637 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1835/3500] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:00.154687 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04bafa24-dff0-49f4-97e8-a70c7fb59d56 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:00.164147 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7a758a78-0b51-4691-9045-4ac4f35049e2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:00.166346 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7a758a78-0b51-4691-9045-4ac4f35049e2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:00.177085 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7a758a78-0b51-4691-9045-4ac4f35049e2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:00.178361 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7a758a78-0b51-4691-9045-4ac4f35049e2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:00.179152 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7a758a78-0b51-4691-9045-4ac4f35049e2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:00.180164 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7a758a78-0b51-4691-9045-4ac4f35049e2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:00.181528 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7a758a78-0b51-4691-9045-4ac4f35049e2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:00.182277 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7a758a78-0b51-4691-9045-4ac4f35049e2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:00.212278 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:08:00.565853 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7a758a78-0b51-4691-9045-4ac4f35049e2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:00.587823 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7a758a78-0b51-4691-9045-4ac4f35049e2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2" status: 200 len: 1392 microversion: 2.1 time: 0.432031 Aug 31 16:08:00.589587 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1836/3501] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:00 2022] GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2 => generated 1392 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:00.595500 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-aa270db0-2a87-4f4e-8afb-5d6ca005abf4 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb45e69280>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:00.677729 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-aa270db0-2a87-4f4e-8afb-5d6ca005abf4 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/88312359-8e02-42d2-90a9-c8d56bdfe0fb" status: 200 len: 1454 microversion: 2.1 time: 0.085675 Aug 31 16:08:00.680309 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1837/3502] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:08:00 2022] GET /compute/v2.1/images/88312359-8e02-42d2-90a9-c8d56bdfe0fb => generated 1454 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:00.690067 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b5231c01-f78c-404d-a1f2-c2f7cf361e51 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:00.695185 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b5231c01-f78c-404d-a1f2-c2f7cf361e51 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: ac18e976-69d9-4131-be61-fdbcf1b04173] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:00.707999 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:08:00.712021 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b5231c01-f78c-404d-a1f2-c2f7cf361e51 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:00.715879 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b5231c01-f78c-404d-a1f2-c2f7cf361e51 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:00.724182 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b5231c01-f78c-404d-a1f2-c2f7cf361e51 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:00.725574 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b5231c01-f78c-404d-a1f2-c2f7cf361e51 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:00.726525 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b5231c01-f78c-404d-a1f2-c2f7cf361e51 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:00.727296 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b5231c01-f78c-404d-a1f2-c2f7cf361e51 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:01.440949 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-04bafa24-dff0-49f4-97e8-a70c7fb59d56 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:01.493543 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-04bafa24-dff0-49f4-97e8-a70c7fb59d56 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:01.498453 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-04bafa24-dff0-49f4-97e8-a70c7fb59d56 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:01.508777 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-04bafa24-dff0-49f4-97e8-a70c7fb59d56 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 2957 microversion: 2.32 time: 1.391716 Aug 31 16:08:01.510751 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1666/3503] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:08:00 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 2957 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:08:01.549329 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b07d4bd7-2c05-446c-8c69-c1f030b8b847 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:01.552350 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b07d4bd7-2c05-446c-8c69-c1f030b8b847 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:01.587598 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b07d4bd7-2c05-446c-8c69-c1f030b8b847 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:01.591958 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b07d4bd7-2c05-446c-8c69-c1f030b8b847 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:01.605788 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b07d4bd7-2c05-446c-8c69-c1f030b8b847 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:01.609982 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b07d4bd7-2c05-446c-8c69-c1f030b8b847 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:01.621572 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b07d4bd7-2c05-446c-8c69-c1f030b8b847 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:01.623482 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b07d4bd7-2c05-446c-8c69-c1f030b8b847 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:02.053752 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b07d4bd7-2c05-446c-8c69-c1f030b8b847 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:02.069423 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b07d4bd7-2c05-446c-8c69-c1f030b8b847 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:02.074337 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b5231c01-f78c-404d-a1f2-c2f7cf361e51 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:02.084635 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b07d4bd7-2c05-446c-8c69-c1f030b8b847 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:02.085890 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b07d4bd7-2c05-446c-8c69-c1f030b8b847 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 2259 microversion: 2.42 time: 0.567009 Aug 31 16:08:02.101647 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b5231c01-f78c-404d-a1f2-c2f7cf361e51 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173" status: 200 len: 1505 microversion: 2.1 time: 1.419987 Aug 31 16:08:02.104526 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1838/3504] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:00 2022] GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173 => generated 1505 bytes in 1423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:02.131066 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1667/3505] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:08:01 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 2259 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:08:02.142501 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cf1a43b2-74b6-408b-8b34-53b710c056ff tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb45cebd30>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:02.146140 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5a38f863-aa6a-4ad2-978c-5b8ee8b94d60 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:02.156398 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5a38f863-aa6a-4ad2-978c-5b8ee8b94d60 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:02.177909 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5a38f863-aa6a-4ad2-978c-5b8ee8b94d60 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:02.190028 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5a38f863-aa6a-4ad2-978c-5b8ee8b94d60 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:02.194883 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5a38f863-aa6a-4ad2-978c-5b8ee8b94d60 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:02.195651 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5a38f863-aa6a-4ad2-978c-5b8ee8b94d60 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:02.196131 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5a38f863-aa6a-4ad2-978c-5b8ee8b94d60 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:02.196552 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5a38f863-aa6a-4ad2-978c-5b8ee8b94d60 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:02.309854 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cf1a43b2-74b6-408b-8b34-53b710c056ff tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/88312359-8e02-42d2-90a9-c8d56bdfe0fb" status: 200 len: 1454 microversion: 2.1 time: 0.176989 Aug 31 16:08:02.310721 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1668/3506] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:08:02 2022] GET /compute/v2.1/images/88312359-8e02-42d2-90a9-c8d56bdfe0fb => generated 1454 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:02.326740 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-28487453-42c2-4345-8b85-b71f18f0c79e req-63049ae1-c68a-43da-8dab-c46c0738f9a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e89e500-ddc5-4549-8631-9d62545016d1", "name": "network-vif-deleted", "tag": "6be52102-ccae-4668-bb69-c84a894fc971"}, {"server_uuid": "0e89e500-ddc5-4549-8631-9d62545016d1", "name": "network-vif-deleted", "tag": "57f3869c-b000-4d3c-afe9-a2a6741a014c"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:02.386717 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-28487453-42c2-4345-8b85-b71f18f0c79e req-63049ae1-c68a-43da-8dab-c46c0738f9a3 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:02.387580 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-28487453-42c2-4345-8b85-b71f18f0c79e req-63049ae1-c68a-43da-8dab-c46c0738f9a3 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:02.388657 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-28487453-42c2-4345-8b85-b71f18f0c79e req-63049ae1-c68a-43da-8dab-c46c0738f9a3 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:02.421588 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-28487453-42c2-4345-8b85-b71f18f0c79e req-63049ae1-c68a-43da-8dab-c46c0738f9a3 service nova] Creating event network-vif-deleted:6be52102-ccae-4668-bb69-c84a894fc971 for instance 0e89e500-ddc5-4549-8631-9d62545016d1 on n-h2-833090-16 Aug 31 16:08:02.427507 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-28487453-42c2-4345-8b85-b71f18f0c79e req-63049ae1-c68a-43da-8dab-c46c0738f9a3 service nova] Creating event network-vif-deleted:57f3869c-b000-4d3c-afe9-a2a6741a014c for instance 0e89e500-ddc5-4549-8631-9d62545016d1 on n-h2-833090-16 Aug 31 16:08:02.446277 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-28487453-42c2-4345-8b85-b71f18f0c79e req-63049ae1-c68a-43da-8dab-c46c0738f9a3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.124980 Aug 31 16:08:02.456688 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1669/3507] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:08:02 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:02.559904 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-09ccf5b3-c57d-4ded-8f52-caa1d29e7f97 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:02.564959 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-09ccf5b3-c57d-4ded-8f52-caa1d29e7f97 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:02.576728 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09ccf5b3-c57d-4ded-8f52-caa1d29e7f97 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:02.577593 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09ccf5b3-c57d-4ded-8f52-caa1d29e7f97 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:02.578215 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09ccf5b3-c57d-4ded-8f52-caa1d29e7f97 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:02.579151 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09ccf5b3-c57d-4ded-8f52-caa1d29e7f97 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:02.579753 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09ccf5b3-c57d-4ded-8f52-caa1d29e7f97 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:02.581164 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09ccf5b3-c57d-4ded-8f52-caa1d29e7f97 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:03.760545 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5a38f863-aa6a-4ad2-978c-5b8ee8b94d60 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:03.778931 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5a38f863-aa6a-4ad2-978c-5b8ee8b94d60 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2" status: 200 len: 1392 microversion: 2.1 time: 1.647113 Aug 31 16:08:03.779104 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1839/3508] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:02 2022] GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2 => generated 1392 bytes in 1664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:03.790604 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3e598337-fd22-4549-8f45-44a03be0bdbc tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:03.793165 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3e598337-fd22-4549-8f45-44a03be0bdbc tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: ac18e976-69d9-4131-be61-fdbcf1b04173] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:03.830861 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3e598337-fd22-4549-8f45-44a03be0bdbc tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:03.831679 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3e598337-fd22-4549-8f45-44a03be0bdbc tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:03.837489 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3e598337-fd22-4549-8f45-44a03be0bdbc tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:03.838622 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3e598337-fd22-4549-8f45-44a03be0bdbc tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:03.840439 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3e598337-fd22-4549-8f45-44a03be0bdbc tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:03.847912 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3e598337-fd22-4549-8f45-44a03be0bdbc tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:05.393578 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-09ccf5b3-c57d-4ded-8f52-caa1d29e7f97 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:05.420132 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3e598337-fd22-4549-8f45-44a03be0bdbc tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:05.429779 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-09ccf5b3-c57d-4ded-8f52-caa1d29e7f97 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:05.436239 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-09ccf5b3-c57d-4ded-8f52-caa1d29e7f97 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:05.447449 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-09ccf5b3-c57d-4ded-8f52-caa1d29e7f97 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 2957 microversion: 2.32 time: 2.902821 Aug 31 16:08:05.467483 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1670/3509] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:08:02 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 2957 bytes in 2928 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:08:05.470723 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3e598337-fd22-4549-8f45-44a03be0bdbc tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173" status: 200 len: 1505 microversion: 2.1 time: 1.687784 Aug 31 16:08:05.480397 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1840/3510] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:03 2022] GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173 => generated 1505 bytes in 1697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:05.500019 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c398cf32-a699-478b-ae3d-e740b3dcb958 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb4aa0dc10>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:05.500758 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1116e40a-41c4-4dfa-95ad-31aa2497676a tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:05.502145 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1116e40a-41c4-4dfa-95ad-31aa2497676a tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:05.543212 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1116e40a-41c4-4dfa-95ad-31aa2497676a tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:05.543852 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1116e40a-41c4-4dfa-95ad-31aa2497676a tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:05.544217 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1116e40a-41c4-4dfa-95ad-31aa2497676a tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:05.549325 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1116e40a-41c4-4dfa-95ad-31aa2497676a tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:05.551502 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1116e40a-41c4-4dfa-95ad-31aa2497676a tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:05.552084 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1116e40a-41c4-4dfa-95ad-31aa2497676a tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:05.594390 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c398cf32-a699-478b-ae3d-e740b3dcb958 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/88312359-8e02-42d2-90a9-c8d56bdfe0fb" status: 200 len: 1454 microversion: 2.1 time: 0.111435 Aug 31 16:08:05.599704 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1841/3511] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:08:05 2022] GET /compute/v2.1/images/88312359-8e02-42d2-90a9-c8d56bdfe0fb => generated 1454 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:05.646271 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2dd989a3-9756-4bd8-9517-8899954057c2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:05.646979 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2dd989a3-9756-4bd8-9517-8899954057c2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:05.673804 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2dd989a3-9756-4bd8-9517-8899954057c2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:05.674987 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2dd989a3-9756-4bd8-9517-8899954057c2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:05.680247 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2dd989a3-9756-4bd8-9517-8899954057c2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:05.681344 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2dd989a3-9756-4bd8-9517-8899954057c2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:05.682067 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2dd989a3-9756-4bd8-9517-8899954057c2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:05.682825 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2dd989a3-9756-4bd8-9517-8899954057c2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:05.826785 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1116e40a-41c4-4dfa-95ad-31aa2497676a tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:05.850577 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1116e40a-41c4-4dfa-95ad-31aa2497676a tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:05.860506 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1116e40a-41c4-4dfa-95ad-31aa2497676a tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:05.865648 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1116e40a-41c4-4dfa-95ad-31aa2497676a tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 1874 microversion: 2.42 time: 0.395625 Aug 31 16:08:05.868218 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1671/3512] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:08:05 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 1874 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:08:06.497942 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-04550b82-e5d0-4040-8594-69b67b35034b tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:06.498628 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-04550b82-e5d0-4040-8594-69b67b35034b tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:06.530141 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04550b82-e5d0-4040-8594-69b67b35034b tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:06.533737 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04550b82-e5d0-4040-8594-69b67b35034b tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:06.537166 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04550b82-e5d0-4040-8594-69b67b35034b tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:06.538298 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04550b82-e5d0-4040-8594-69b67b35034b tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:06.542488 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04550b82-e5d0-4040-8594-69b67b35034b tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:06.547181 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04550b82-e5d0-4040-8594-69b67b35034b tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:07.138392 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2dd989a3-9756-4bd8-9517-8899954057c2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:07.150815 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2dd989a3-9756-4bd8-9517-8899954057c2 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2" status: 200 len: 1392 microversion: 2.1 time: 1.520558 Aug 31 16:08:07.152357 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1842/3513] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:05 2022] GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2 => generated 1392 bytes in 1552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:07.166497 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b70b1db5-dad5-4b6a-ac33-dfdf76a5837d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:07.167365 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b70b1db5-dad5-4b6a-ac33-dfdf76a5837d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: ac18e976-69d9-4131-be61-fdbcf1b04173] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:07.177729 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b70b1db5-dad5-4b6a-ac33-dfdf76a5837d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:07.179875 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b70b1db5-dad5-4b6a-ac33-dfdf76a5837d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:07.185961 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b70b1db5-dad5-4b6a-ac33-dfdf76a5837d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:07.189291 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b70b1db5-dad5-4b6a-ac33-dfdf76a5837d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:07.189968 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b70b1db5-dad5-4b6a-ac33-dfdf76a5837d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:07.190673 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b70b1db5-dad5-4b6a-ac33-dfdf76a5837d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:07.584427 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-04550b82-e5d0-4040-8594-69b67b35034b tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:07.633556 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-04550b82-e5d0-4040-8594-69b67b35034b tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:07.647336 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-04550b82-e5d0-4040-8594-69b67b35034b tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:07.676615 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-04550b82-e5d0-4040-8594-69b67b35034b tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 2957 microversion: 2.32 time: 1.178546 Aug 31 16:08:07.694128 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1672/3514] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:08:06 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 2957 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:08:07.704488 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7d377da8-830b-4ddc-b4ec-4457a97f2fd2 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb45c70b80>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:07.824343 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7d377da8-830b-4ddc-b4ec-4457a97f2fd2 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/88312359-8e02-42d2-90a9-c8d56bdfe0fb" status: 200 len: 1454 microversion: 2.1 time: 0.138415 Aug 31 16:08:07.826683 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1673/3515] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:08:07 2022] GET /compute/v2.1/images/88312359-8e02-42d2-90a9-c8d56bdfe0fb => generated 1454 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:07.840024 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-078caae2-7b4d-44a3-a541-8fa9e11fa44b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:07.840692 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-078caae2-7b4d-44a3-a541-8fa9e11fa44b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:07.862591 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-078caae2-7b4d-44a3-a541-8fa9e11fa44b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:07.863100 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-078caae2-7b4d-44a3-a541-8fa9e11fa44b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:07.865523 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-078caae2-7b4d-44a3-a541-8fa9e11fa44b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:07.869431 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-078caae2-7b4d-44a3-a541-8fa9e11fa44b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:07.870786 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-078caae2-7b4d-44a3-a541-8fa9e11fa44b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:07.872981 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-078caae2-7b4d-44a3-a541-8fa9e11fa44b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:08.484687 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-078caae2-7b4d-44a3-a541-8fa9e11fa44b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:08.504608 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-078caae2-7b4d-44a3-a541-8fa9e11fa44b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:08.511018 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-078caae2-7b4d-44a3-a541-8fa9e11fa44b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:08.515964 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-078caae2-7b4d-44a3-a541-8fa9e11fa44b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 1874 microversion: 2.42 time: 0.685372 Aug 31 16:08:08.528608 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1674/3516] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:08:07 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 1874 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:08:08.537807 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-4b43cfde-26b7-4541-85b5-5148353f0023 req-61849438-0187-4e4f-84ac-1dea5862d0c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9", "name": "network-vif-unplugged", "status": "completed", "tag": "01d2be63-7429-490a-bba0-954dc6039768"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:08.571253 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4b43cfde-26b7-4541-85b5-5148353f0023 req-61849438-0187-4e4f-84ac-1dea5862d0c3 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:08.573728 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4b43cfde-26b7-4541-85b5-5148353f0023 req-61849438-0187-4e4f-84ac-1dea5862d0c3 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:08.575427 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4b43cfde-26b7-4541-85b5-5148353f0023 req-61849438-0187-4e4f-84ac-1dea5862d0c3 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:08.638772 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-4b43cfde-26b7-4541-85b5-5148353f0023 req-61849438-0187-4e4f-84ac-1dea5862d0c3 service nova] Creating event network-vif-unplugged:01d2be63-7429-490a-bba0-954dc6039768 for instance a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 on n-h2-833090-16 Aug 31 16:08:08.659460 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-4b43cfde-26b7-4541-85b5-5148353f0023 req-61849438-0187-4e4f-84ac-1dea5862d0c3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.126259 Aug 31 16:08:08.664481 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1675/3517] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:08.683989 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2713fb12-352e-45d2-a2d0-41c0b8a55aab tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:08.684996 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2713fb12-352e-45d2-a2d0-41c0b8a55aab tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:08.717234 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2713fb12-352e-45d2-a2d0-41c0b8a55aab tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:08.717906 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2713fb12-352e-45d2-a2d0-41c0b8a55aab tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:08.718591 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2713fb12-352e-45d2-a2d0-41c0b8a55aab tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:08.719318 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2713fb12-352e-45d2-a2d0-41c0b8a55aab tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:08.719767 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2713fb12-352e-45d2-a2d0-41c0b8a55aab tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:08.723490 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2713fb12-352e-45d2-a2d0-41c0b8a55aab tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:08.782065 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b70b1db5-dad5-4b6a-ac33-dfdf76a5837d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:08.796730 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b70b1db5-dad5-4b6a-ac33-dfdf76a5837d tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173" status: 200 len: 1448 microversion: 2.1 time: 1.639544 Aug 31 16:08:08.808854 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1843/3518] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:07 2022] GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173 => generated 1448 bytes in 1655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:08.821514 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3d6fdb41-cc7e-47a6-815c-d3165ff9e8e6 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:08.827588 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3d6fdb41-cc7e-47a6-815c-d3165ff9e8e6 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:08.855042 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3d6fdb41-cc7e-47a6-815c-d3165ff9e8e6 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:08.857202 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3d6fdb41-cc7e-47a6-815c-d3165ff9e8e6 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:08.859548 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3d6fdb41-cc7e-47a6-815c-d3165ff9e8e6 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:08.860660 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3d6fdb41-cc7e-47a6-815c-d3165ff9e8e6 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:08.863306 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3d6fdb41-cc7e-47a6-815c-d3165ff9e8e6 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:08.865589 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3d6fdb41-cc7e-47a6-815c-d3165ff9e8e6 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:09.733161 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2713fb12-352e-45d2-a2d0-41c0b8a55aab tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:09.753548 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2713fb12-352e-45d2-a2d0-41c0b8a55aab tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2" status: 200 len: 1392 microversion: 2.1 time: 1.085629 Aug 31 16:08:09.754879 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1676/3519] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:08 2022] GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2 => generated 1392 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:09.781359 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d7ce28cf-fb95-43a1-a97d-56ee0a4dbac3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:09.781990 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d7ce28cf-fb95-43a1-a97d-56ee0a4dbac3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:09.803399 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7ce28cf-fb95-43a1-a97d-56ee0a4dbac3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:09.803947 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7ce28cf-fb95-43a1-a97d-56ee0a4dbac3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:09.804564 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7ce28cf-fb95-43a1-a97d-56ee0a4dbac3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:09.805447 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7ce28cf-fb95-43a1-a97d-56ee0a4dbac3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:09.812452 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7ce28cf-fb95-43a1-a97d-56ee0a4dbac3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:09.813097 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7ce28cf-fb95-43a1-a97d-56ee0a4dbac3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:10.586485 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3d6fdb41-cc7e-47a6-815c-d3165ff9e8e6 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:10.597733 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3d6fdb41-cc7e-47a6-815c-d3165ff9e8e6 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:10.599247 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3d6fdb41-cc7e-47a6-815c-d3165ff9e8e6 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:10.600548 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3d6fdb41-cc7e-47a6-815c-d3165ff9e8e6 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 2957 microversion: 2.32 time: 1.790136 Aug 31 16:08:10.601112 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1844/3520] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:08:08 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 2957 bytes in 1791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:08:10.672917 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-57557c53-99ba-4a05-b865-be9f5a88e734 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb45e3f040>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:10.793785 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-57557c53-99ba-4a05-b865-be9f5a88e734 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/88312359-8e02-42d2-90a9-c8d56bdfe0fb" status: 200 len: 1454 microversion: 2.1 time: 0.131526 Aug 31 16:08:10.795078 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1845/3521] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:08:10 2022] GET /compute/v2.1/images/88312359-8e02-42d2-90a9-c8d56bdfe0fb => generated 1454 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:10.805771 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f51b0143-3066-46c0-8293-10c7fd97972a tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:10.809333 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f51b0143-3066-46c0-8293-10c7fd97972a tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:10.831464 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f51b0143-3066-46c0-8293-10c7fd97972a tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:10.832325 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f51b0143-3066-46c0-8293-10c7fd97972a tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:10.832986 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f51b0143-3066-46c0-8293-10c7fd97972a tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:10.834031 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f51b0143-3066-46c0-8293-10c7fd97972a tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:10.834938 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f51b0143-3066-46c0-8293-10c7fd97972a tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:10.835549 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f51b0143-3066-46c0-8293-10c7fd97972a tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:11.073599 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d7ce28cf-fb95-43a1-a97d-56ee0a4dbac3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:11.089361 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d7ce28cf-fb95-43a1-a97d-56ee0a4dbac3 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1671 microversion: 2.1 time: 1.331692 Aug 31 16:08:11.090463 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f51b0143-3066-46c0-8293-10c7fd97972a tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:11.091715 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1677/3522] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:09 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1671 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:11.099389 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-ab88fa8d-ed4b-457b-bed4-9d6cdff722cf req-beb61db1-c27c-40de-a690-0133507dda9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9", "name": "network-vif-unplugged", "status": "completed", "tag": "f9cdc28e-e2d4-4e82-a9fd-a5a05b15a14c"}, {"server_uuid": "a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9", "name": "network-vif-unplugged", "status": "completed", "tag": "988b704e-8f3a-4c8f-903a-1661f7c99521"}, {"server_uuid": "a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9", "name": "network-vif-unplugged", "status": "completed", "tag": "18f5d3ba-5072-4e6c-8f7b-bfb9589950de"}, {"server_uuid": "a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9", "name": "network-vif-unplugged", "status": "completed", "tag": "ddeb3d0d-f40d-487e-8c19-0d1274291781"}, {"server_uuid": "a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9", "name": "network-vif-unplugged", "status": "completed", "tag": "0e3734e2-2119-411e-bd8e-c6da7c160678"}, {"server_uuid": "a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9", "name": "network-vif-unplugged", "status": "completed", "tag": "cad2dd93-6ee0-4ee0-917c-bbf5d5f4da1d"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:11.114550 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ab88fa8d-ed4b-457b-bed4-9d6cdff722cf req-beb61db1-c27c-40de-a690-0133507dda9b service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:11.115852 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ab88fa8d-ed4b-457b-bed4-9d6cdff722cf req-beb61db1-c27c-40de-a690-0133507dda9b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:11.116600 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ab88fa8d-ed4b-457b-bed4-9d6cdff722cf req-beb61db1-c27c-40de-a690-0133507dda9b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:11.131602 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f51b0143-3066-46c0-8293-10c7fd97972a tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:11.133173 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f51b0143-3066-46c0-8293-10c7fd97972a tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:11.134465 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f51b0143-3066-46c0-8293-10c7fd97972a tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 1874 microversion: 2.42 time: 0.336065 Aug 31 16:08:11.142613 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1846/3523] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:08:10 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 1874 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:08:11.145715 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-ab88fa8d-ed4b-457b-bed4-9d6cdff722cf req-beb61db1-c27c-40de-a690-0133507dda9b service nova] Creating event network-vif-unplugged:f9cdc28e-e2d4-4e82-a9fd-a5a05b15a14c for instance a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 on n-h2-833090-16 Aug 31 16:08:11.147337 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-ab88fa8d-ed4b-457b-bed4-9d6cdff722cf req-beb61db1-c27c-40de-a690-0133507dda9b service nova] Creating event network-vif-unplugged:988b704e-8f3a-4c8f-903a-1661f7c99521 for instance a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 on n-h2-833090-16 Aug 31 16:08:11.147725 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-815e12c9-9391-4c33-b450-98b9ad691ae4 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:11.148604 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-815e12c9-9391-4c33-b450-98b9ad691ae4 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:11.156761 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-ab88fa8d-ed4b-457b-bed4-9d6cdff722cf req-beb61db1-c27c-40de-a690-0133507dda9b service nova] Creating event network-vif-unplugged:18f5d3ba-5072-4e6c-8f7b-bfb9589950de for instance a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 on n-h2-833090-16 Aug 31 16:08:11.157232 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-ab88fa8d-ed4b-457b-bed4-9d6cdff722cf req-beb61db1-c27c-40de-a690-0133507dda9b service nova] Creating event network-vif-unplugged:ddeb3d0d-f40d-487e-8c19-0d1274291781 for instance a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 on n-h2-833090-16 Aug 31 16:08:11.157747 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-ab88fa8d-ed4b-457b-bed4-9d6cdff722cf req-beb61db1-c27c-40de-a690-0133507dda9b service nova] Creating event network-vif-unplugged:0e3734e2-2119-411e-bd8e-c6da7c160678 for instance a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 on n-h2-833090-16 Aug 31 16:08:11.158616 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-ab88fa8d-ed4b-457b-bed4-9d6cdff722cf req-beb61db1-c27c-40de-a690-0133507dda9b service nova] Creating event network-vif-unplugged:cad2dd93-6ee0-4ee0-917c-bbf5d5f4da1d for instance a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 on n-h2-833090-16 Aug 31 16:08:11.172687 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-ab88fa8d-ed4b-457b-bed4-9d6cdff722cf req-beb61db1-c27c-40de-a690-0133507dda9b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1050 microversion: 2.1 time: 0.078996 Aug 31 16:08:11.173304 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1678/3524] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 1050 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:11.173927 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-815e12c9-9391-4c33-b450-98b9ad691ae4 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:11.175272 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-815e12c9-9391-4c33-b450-98b9ad691ae4 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:11.176443 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-815e12c9-9391-4c33-b450-98b9ad691ae4 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:11.177498 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-815e12c9-9391-4c33-b450-98b9ad691ae4 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:11.178335 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-815e12c9-9391-4c33-b450-98b9ad691ae4 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:11.179058 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-815e12c9-9391-4c33-b450-98b9ad691ae4 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:11.183109 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d0989164-ad03-4ad1-908f-311154710e75 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:11.184185 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d0989164-ad03-4ad1-908f-311154710e75 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:11.198630 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0989164-ad03-4ad1-908f-311154710e75 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:11.201875 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0989164-ad03-4ad1-908f-311154710e75 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:11.202610 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0989164-ad03-4ad1-908f-311154710e75 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:11.203567 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0989164-ad03-4ad1-908f-311154710e75 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:11.204238 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0989164-ad03-4ad1-908f-311154710e75 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:11.204947 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0989164-ad03-4ad1-908f-311154710e75 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:11.764521 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-815e12c9-9391-4c33-b450-98b9ad691ae4 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:11.781279 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-815e12c9-9391-4c33-b450-98b9ad691ae4 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2" status: 200 len: 1392 microversion: 2.1 time: 0.644611 Aug 31 16:08:11.795403 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1847/3525] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:11 2022] GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2 => generated 1392 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:11.808066 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d5034dfc-867e-48e3-bc72-ea5fce226a79 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:11.808903 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d5034dfc-867e-48e3-bc72-ea5fce226a79 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:11.822630 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d5034dfc-867e-48e3-bc72-ea5fce226a79 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:11.826720 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d5034dfc-867e-48e3-bc72-ea5fce226a79 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:11.827346 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d5034dfc-867e-48e3-bc72-ea5fce226a79 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:11.828229 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d5034dfc-867e-48e3-bc72-ea5fce226a79 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:11.830385 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d5034dfc-867e-48e3-bc72-ea5fce226a79 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:11.830977 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d5034dfc-867e-48e3-bc72-ea5fce226a79 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:11.921584 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d0989164-ad03-4ad1-908f-311154710e75 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:11.937242 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d0989164-ad03-4ad1-908f-311154710e75 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1671 microversion: 2.1 time: 0.761482 Aug 31 16:08:11.940382 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1679/3526] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:11 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1671 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:11.954442 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-708034f4-f6ec-4f30-bae7-1b0887a89f1f tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb45d29430>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:12.059732 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-708034f4-f6ec-4f30-bae7-1b0887a89f1f tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/88312359-8e02-42d2-90a9-c8d56bdfe0fb" status: 200 len: 1454 microversion: 2.1 time: 0.115844 Aug 31 16:08:12.061315 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1680/3527] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:08:11 2022] GET /compute/v2.1/images/88312359-8e02-42d2-90a9-c8d56bdfe0fb => generated 1454 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:12.070252 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-73ed992d-12da-4312-a266-d99ee089b012 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:12.074961 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-73ed992d-12da-4312-a266-d99ee089b012 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:12.090424 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-73ed992d-12da-4312-a266-d99ee089b012 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:12.096902 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-73ed992d-12da-4312-a266-d99ee089b012 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:12.105279 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-73ed992d-12da-4312-a266-d99ee089b012 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:12.106512 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-73ed992d-12da-4312-a266-d99ee089b012 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:12.107101 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-73ed992d-12da-4312-a266-d99ee089b012 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:12.107617 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-73ed992d-12da-4312-a266-d99ee089b012 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:12.969692 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d5034dfc-867e-48e3-bc72-ea5fce226a79 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:12.982450 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d5034dfc-867e-48e3-bc72-ea5fce226a79 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:12.986374 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d5034dfc-867e-48e3-bc72-ea5fce226a79 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:12.990703 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d5034dfc-867e-48e3-bc72-ea5fce226a79 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 2936 microversion: 2.32 time: 1.193924 Aug 31 16:08:12.995785 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1848/3528] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:08:11 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 2936 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:08:13.010765 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-cf6c3e84-7a89-45fc-ac8f-15eeb68da28e tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:13.011646 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-cf6c3e84-7a89-45fc-ac8f-15eeb68da28e tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:13.021194 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cf6c3e84-7a89-45fc-ac8f-15eeb68da28e tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:13.023554 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cf6c3e84-7a89-45fc-ac8f-15eeb68da28e tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:13.025188 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cf6c3e84-7a89-45fc-ac8f-15eeb68da28e tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:13.028064 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cf6c3e84-7a89-45fc-ac8f-15eeb68da28e tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:13.028712 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cf6c3e84-7a89-45fc-ac8f-15eeb68da28e tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:13.031699 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cf6c3e84-7a89-45fc-ac8f-15eeb68da28e tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:13.087205 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-73ed992d-12da-4312-a266-d99ee089b012 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:13.098648 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-73ed992d-12da-4312-a266-d99ee089b012 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1671 microversion: 2.1 time: 1.033965 Aug 31 16:08:13.101276 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1681/3529] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:12 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1671 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:13.123133 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7c78cd83-9341-4fa2-82f3-432ed6e3c33b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:13.124001 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7c78cd83-9341-4fa2-82f3-432ed6e3c33b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:13.141947 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c78cd83-9341-4fa2-82f3-432ed6e3c33b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:13.149853 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c78cd83-9341-4fa2-82f3-432ed6e3c33b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:13.150610 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c78cd83-9341-4fa2-82f3-432ed6e3c33b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:13.151570 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c78cd83-9341-4fa2-82f3-432ed6e3c33b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:13.152244 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c78cd83-9341-4fa2-82f3-432ed6e3c33b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:13.152978 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c78cd83-9341-4fa2-82f3-432ed6e3c33b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:13.398884 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7c78cd83-9341-4fa2-82f3-432ed6e3c33b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:13.407544 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7c78cd83-9341-4fa2-82f3-432ed6e3c33b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2" status: 200 len: 1392 microversion: 2.1 time: 0.303520 Aug 31 16:08:13.414699 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1682/3530] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:13 2022] GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2 => generated 1392 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:13.423239 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-cf6c3e84-7a89-45fc-ac8f-15eeb68da28e tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:13.447301 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-cf6c3e84-7a89-45fc-ac8f-15eeb68da28e tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:13.453772 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-cf6c3e84-7a89-45fc-ac8f-15eeb68da28e tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:13.455927 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-cf6c3e84-7a89-45fc-ac8f-15eeb68da28e tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 1874 microversion: 2.42 time: 0.458897 Aug 31 16:08:13.458723 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1849/3531] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:08:12 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 1874 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:08:13.470740 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-af47f16c-3ab0-44eb-a8f2-632548c5f141 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb45e2edc0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:13.550776 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-af47f16c-3ab0-44eb-a8f2-632548c5f141 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/88312359-8e02-42d2-90a9-c8d56bdfe0fb" status: 200 len: 1454 microversion: 2.1 time: 0.087751 Aug 31 16:08:13.551760 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1850/3532] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:08:13 2022] GET /compute/v2.1/images/88312359-8e02-42d2-90a9-c8d56bdfe0fb => generated 1454 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:13.565233 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e7db0362-4e27-41f6-9125-4f8a09b06489 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:13.566771 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e7db0362-4e27-41f6-9125-4f8a09b06489 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:13.584489 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7db0362-4e27-41f6-9125-4f8a09b06489 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:13.586681 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7db0362-4e27-41f6-9125-4f8a09b06489 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:13.587371 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7db0362-4e27-41f6-9125-4f8a09b06489 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:13.591345 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7db0362-4e27-41f6-9125-4f8a09b06489 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:13.592108 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7db0362-4e27-41f6-9125-4f8a09b06489 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:13.592743 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7db0362-4e27-41f6-9125-4f8a09b06489 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:13.707267 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5e5b8581-9596-4ff5-b1aa-e1e1d77713f3 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-946430154", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "a9df689d-6779-4cd2-8efc-f8ab63a90582"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:13.845959 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-5e5b8581-9596-4ff5-b1aa-e1e1d77713f3 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] validate_networks() for [('a9df689d-6779-4cd2-8efc-f8ab63a90582', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:08:15.138781 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e7db0362-4e27-41f6-9125-4f8a09b06489 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:15.159793 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e7db0362-4e27-41f6-9125-4f8a09b06489 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1671 microversion: 2.1 time: 1.605906 Aug 31 16:08:15.161298 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1851/3533] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:13 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1671 bytes in 1609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:15.180021 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-036d5d0e-2935-4e6a-a794-b5adb8fdb9cf tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:15.183630 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-036d5d0e-2935-4e6a-a794-b5adb8fdb9cf tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:15.197025 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-036d5d0e-2935-4e6a-a794-b5adb8fdb9cf tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:15.197977 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-036d5d0e-2935-4e6a-a794-b5adb8fdb9cf tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:15.198683 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-036d5d0e-2935-4e6a-a794-b5adb8fdb9cf tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:15.199630 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-036d5d0e-2935-4e6a-a794-b5adb8fdb9cf tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:15.200689 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-036d5d0e-2935-4e6a-a794-b5adb8fdb9cf tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:15.201339 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-036d5d0e-2935-4e6a-a794-b5adb8fdb9cf tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:16.204913 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-036d5d0e-2935-4e6a-a794-b5adb8fdb9cf tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:16.224455 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-036d5d0e-2935-4e6a-a794-b5adb8fdb9cf tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:16.226208 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-036d5d0e-2935-4e6a-a794-b5adb8fdb9cf tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:16.227703 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-036d5d0e-2935-4e6a-a794-b5adb8fdb9cf tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 2915 microversion: 2.32 time: 1.064597 Aug 31 16:08:16.238564 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1852/3534] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:08:15 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 2915 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:08:16.256964 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0d5c04a7-144f-4ec8-ac83-7765619e01bc tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:16.260397 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0d5c04a7-144f-4ec8-ac83-7765619e01bc tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:16.275925 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0d5c04a7-144f-4ec8-ac83-7765619e01bc tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:16.280893 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0d5c04a7-144f-4ec8-ac83-7765619e01bc tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:16.281573 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0d5c04a7-144f-4ec8-ac83-7765619e01bc tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:16.282512 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0d5c04a7-144f-4ec8-ac83-7765619e01bc tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:16.283382 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0d5c04a7-144f-4ec8-ac83-7765619e01bc tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:16.284072 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0d5c04a7-144f-4ec8-ac83-7765619e01bc tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:16.537186 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-5e5b8581-9596-4ff5-b1aa-e1e1d77713f3 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:08:16.538369 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-5e5b8581-9596-4ff5-b1aa-e1e1d77713f3 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:08:16.539084 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-5e5b8581-9596-4ff5-b1aa-e1e1d77713f3 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:08:16.539767 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-5e5b8581-9596-4ff5-b1aa-e1e1d77713f3 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:08:16.540413 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-5e5b8581-9596-4ff5-b1aa-e1e1d77713f3 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:08:16.564547 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5e5b8581-9596-4ff5-b1aa-e1e1d77713f3 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:16.565402 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5e5b8581-9596-4ff5-b1aa-e1e1d77713f3 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:16.566069 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5e5b8581-9596-4ff5-b1aa-e1e1d77713f3 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:16.567152 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5e5b8581-9596-4ff5-b1aa-e1e1d77713f3 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:16.567852 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5e5b8581-9596-4ff5-b1aa-e1e1d77713f3 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:16.568478 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5e5b8581-9596-4ff5-b1aa-e1e1d77713f3 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:16.621445 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-5e5b8581-9596-4ff5-b1aa-e1e1d77713f3 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Getting quotas for project 1c0154660c274106ab83ae50927348c8. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:08:16.640055 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-5e5b8581-9596-4ff5-b1aa-e1e1d77713f3 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Getting quotas for user 4717b2fc0a654a77b40da565e599203f and project 1c0154660c274106ab83ae50927348c8. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:08:16.669818 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5e5b8581-9596-4ff5-b1aa-e1e1d77713f3 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Going to run 2 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:08:16.672619 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5e5b8581-9596-4ff5-b1aa-e1e1d77713f3 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] [instance: 91f7f5e0-19f8-40ba-a692-2c2b6cb6a0be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:08:16.746471 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5e5b8581-9596-4ff5-b1aa-e1e1d77713f3 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] [instance: cf602736-d01a-4673-a20b-ed1ae5750eea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=91f7f5e0-19f8-40ba-a692-2c2b6cb6a0be,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:08:16.817411 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0d5c04a7-144f-4ec8-ac83-7765619e01bc tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:16.835771 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0d5c04a7-144f-4ec8-ac83-7765619e01bc tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2" status: 200 len: 1382 microversion: 2.1 time: 0.595434 Aug 31 16:08:16.838149 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1853/3535] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:16 2022] GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2 => generated 1382 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:16.845093 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9d756981-5bf8-4e5a-ac8f-4b6355baea9b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:16.846011 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9d756981-5bf8-4e5a-ac8f-4b6355baea9b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:16.864390 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9d756981-5bf8-4e5a-ac8f-4b6355baea9b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:16.864894 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9d756981-5bf8-4e5a-ac8f-4b6355baea9b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:16.865337 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9d756981-5bf8-4e5a-ac8f-4b6355baea9b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:16.866063 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9d756981-5bf8-4e5a-ac8f-4b6355baea9b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:16.867708 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9d756981-5bf8-4e5a-ac8f-4b6355baea9b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:16.868214 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9d756981-5bf8-4e5a-ac8f-4b6355baea9b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:16.943267 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5e5b8581-9596-4ff5-b1aa-e1e1d77713f3 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.527255 Aug 31 16:08:16.951330 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1683/3536] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:08:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 3536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:08:16.958347 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3b4cd4ba-2e5f-4a36-978a-d0f10ef768e2 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb45db8280>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:17.073870 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3b4cd4ba-2e5f-4a36-978a-d0f10ef768e2 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/88312359-8e02-42d2-90a9-c8d56bdfe0fb" status: 200 len: 1463 microversion: 2.1 time: 0.120930 Aug 31 16:08:17.095569 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1684/3537] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:08:16 2022] GET /compute/v2.1/images/88312359-8e02-42d2-90a9-c8d56bdfe0fb => generated 1463 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:17.101765 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0797f24f-9cf3-40a6-b358-c47ebbd42743 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:17.118722 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0797f24f-9cf3-40a6-b358-c47ebbd42743 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:17.128014 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0797f24f-9cf3-40a6-b358-c47ebbd42743 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:17.128812 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0797f24f-9cf3-40a6-b358-c47ebbd42743 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:17.160745 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9d756981-5bf8-4e5a-ac8f-4b6355baea9b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:17.163947 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:08:17.193084 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0797f24f-9cf3-40a6-b358-c47ebbd42743 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Going to try to stop instance {{(pid=128863) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 16:08:17.210391 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9d756981-5bf8-4e5a-ac8f-4b6355baea9b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:17.213544 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9d756981-5bf8-4e5a-ac8f-4b6355baea9b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:17.215910 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9d756981-5bf8-4e5a-ac8f-4b6355baea9b tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 1874 microversion: 2.42 time: 0.376293 Aug 31 16:08:17.228956 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1854/3538] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:08:16 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 1874 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:08:17.245395 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0e3a94a8-ec4f-4267-a6c1-73e43b6cc2d1 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Calling method '.version_select at 0x7fbb45e84280>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:17.275955 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0e3a94a8-ec4f-4267-a6c1-73e43b6cc2d1 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:17.277115 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0e3a94a8-ec4f-4267-a6c1-73e43b6cc2d1 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:17.283910 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0e3a94a8-ec4f-4267-a6c1-73e43b6cc2d1 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:17.296785 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0797f24f-9cf3-40a6-b358-c47ebbd42743 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "POST /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b/action" status: 202 len: 0 microversion: 2.1 time: 0.199437 Aug 31 16:08:17.298187 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1685/3539] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:08:17 2022] POST /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:08:17.309734 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bdfe8c45-4dca-4d2c-8f6d-d402542b6383 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:17.333888 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bdfe8c45-4dca-4d2c-8f6d-d402542b6383 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4717b2fc0a654a77b40da565e599203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0154660c274106ab83ae50927348c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:17.337931 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0e3a94a8-ec4f-4267-a6c1-73e43b6cc2d1 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] 10.222.0.50 "GET /compute/v2.1/os-migrations" status: 200 len: 1571 microversion: 2.1 time: 0.106958 Aug 31 16:08:17.346379 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bdfe8c45-4dca-4d2c-8f6d-d402542b6383 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Searching by: {'deleted': False, 'project_id': '1c0154660c274106ab83ae50927348c8'} {{(pid=128863) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:08:17.346747 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1855/3540] 10.222.0.50 () {58 vars in 1143 bytes} [Wed Aug 31 16:08:17 2022] GET /compute/v2.1/os-migrations => generated 1571 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:17.372374 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ba7e96ce-0cf7-4f68-9bcd-6171754e7411 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb45e3f700>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:17.395584 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bdfe8c45-4dca-4d2c-8f6d-d402542b6383 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:17.405475 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bdfe8c45-4dca-4d2c-8f6d-d402542b6383 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:17.406482 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bdfe8c45-4dca-4d2c-8f6d-d402542b6383 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:17.410354 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bdfe8c45-4dca-4d2c-8f6d-d402542b6383 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:17.411504 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bdfe8c45-4dca-4d2c-8f6d-d402542b6383 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:17.413777 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bdfe8c45-4dca-4d2c-8f6d-d402542b6383 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:17.472006 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bdfe8c45-4dca-4d2c-8f6d-d402542b6383 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.171401 Aug 31 16:08:17.482689 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1686/3541] 10.222.0.50 () {58 vars in 1125 bytes} [Wed Aug 31 16:08:17 2022] GET /compute/v2.1/servers => generated 675 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:17.514763 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f000f054-a6cd-456b-8231-8bc757d362ce tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:17.519228 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f000f054-a6cd-456b-8231-8bc757d362ce tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:17.552346 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f000f054-a6cd-456b-8231-8bc757d362ce tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:17.552969 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f000f054-a6cd-456b-8231-8bc757d362ce tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:17.555951 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ba7e96ce-0cf7-4f68-9bcd-6171754e7411 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/88312359-8e02-42d2-90a9-c8d56bdfe0fb" status: 200 len: 1463 microversion: 2.1 time: 0.207324 Aug 31 16:08:17.561619 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1856/3542] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:08:17 2022] GET /compute/v2.1/images/88312359-8e02-42d2-90a9-c8d56bdfe0fb => generated 1463 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:17.567157 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d68bedf2-30d1-4758-b22d-edc2ebc65075 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:17.583241 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f000f054-a6cd-456b-8231-8bc757d362ce tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:17.584876 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f000f054-a6cd-456b-8231-8bc757d362ce tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:17.588588 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d68bedf2-30d1-4758-b22d-edc2ebc65075 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:17.589484 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f000f054-a6cd-456b-8231-8bc757d362ce tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:17.590266 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f000f054-a6cd-456b-8231-8bc757d362ce tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:17.613770 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d68bedf2-30d1-4758-b22d-edc2ebc65075 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:17.618948 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d68bedf2-30d1-4758-b22d-edc2ebc65075 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:17.637238 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d68bedf2-30d1-4758-b22d-edc2ebc65075 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:17.638043 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d68bedf2-30d1-4758-b22d-edc2ebc65075 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:17.638577 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d68bedf2-30d1-4758-b22d-edc2ebc65075 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:17.639118 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d68bedf2-30d1-4758-b22d-edc2ebc65075 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:18.334668 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f000f054-a6cd-456b-8231-8bc757d362ce tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:18.362790 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f000f054-a6cd-456b-8231-8bc757d362ce tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:18.364545 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f000f054-a6cd-456b-8231-8bc757d362ce tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:18.366080 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f000f054-a6cd-456b-8231-8bc757d362ce tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 2915 microversion: 2.32 time: 0.882122 Aug 31 16:08:18.366674 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1687/3543] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:08:17 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 2915 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:08:18.394309 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d68bedf2-30d1-4758-b22d-edc2ebc65075 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:18.403081 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d68bedf2-30d1-4758-b22d-edc2ebc65075 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1681 microversion: 2.1 time: 0.839931 Aug 31 16:08:18.442403 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1857/3544] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:17 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1681 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:18.448120 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8f95e817-a575-4cc9-b988-6e6b349ff925 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:18.448716 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8f95e817-a575-4cc9-b988-6e6b349ff925 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] [instance: cf602736-d01a-4673-a20b-ed1ae5750eea] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:18.456540 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-29ed42dd-5b0b-415a-9bc0-067798309727 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:18.457165 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-29ed42dd-5b0b-415a-9bc0-067798309727 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:18.477484 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29ed42dd-5b0b-415a-9bc0-067798309727 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:18.477965 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29ed42dd-5b0b-415a-9bc0-067798309727 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:18.478434 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29ed42dd-5b0b-415a-9bc0-067798309727 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:18.479138 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29ed42dd-5b0b-415a-9bc0-067798309727 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:18.484828 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29ed42dd-5b0b-415a-9bc0-067798309727 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:18.485299 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29ed42dd-5b0b-415a-9bc0-067798309727 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:18.646420 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8f95e817-a575-4cc9-b988-6e6b349ff925 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4717b2fc0a654a77b40da565e599203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0154660c274106ab83ae50927348c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:18.655134 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8f95e817-a575-4cc9-b988-6e6b349ff925 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] 10.222.0.50 "GET /compute/v2.1/servers/cf602736-d01a-4673-a20b-ed1ae5750eea" status: 200 len: 1219 microversion: 2.1 time: 0.211375 Aug 31 16:08:18.655724 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1858/3545] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:18 2022] GET /compute/v2.1/servers/cf602736-d01a-4673-a20b-ed1ae5750eea => generated 1219 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:18.681161 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-60ba51f6-3158-4f67-a391-9f7980cab37c tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:18.682135 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-60ba51f6-3158-4f67-a391-9f7980cab37c tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] [instance: d3255935-3cff-4bb0-aad2-a8f401028a59] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:18.702258 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-60ba51f6-3158-4f67-a391-9f7980cab37c tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:18.711985 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-60ba51f6-3158-4f67-a391-9f7980cab37c tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:18.712901 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-60ba51f6-3158-4f67-a391-9f7980cab37c tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:18.713945 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-60ba51f6-3158-4f67-a391-9f7980cab37c tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:18.716795 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-60ba51f6-3158-4f67-a391-9f7980cab37c tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:18.717505 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-60ba51f6-3158-4f67-a391-9f7980cab37c tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:18.786684 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=100 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:08:18.855519 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-29ed42dd-5b0b-415a-9bc0-067798309727 tempest-LiveMigrationTest-844560669 tempest-LiveMigrationTest-844560669-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2" status: 200 len: 1535 microversion: 2.1 time: 0.425232 Aug 31 16:08:18.858352 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1688/3546] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:18 2022] GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2 => generated 1535 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:18.863842 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-7e5ec3fa-2e3a-43a0-8198-a24cd345271f req-f436dfc9-17bf-4ce5-b200-da38bdc787b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3255935-3cff-4bb0-aad2-a8f401028a59", "name": "network-vif-unplugged", "status": "completed", "tag": "21dd4917-2780-427e-86cb-ca75980a35b5"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:18.888981 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7e5ec3fa-2e3a-43a0-8198-a24cd345271f req-f436dfc9-17bf-4ce5-b200-da38bdc787b7 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:18.894352 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7e5ec3fa-2e3a-43a0-8198-a24cd345271f req-f436dfc9-17bf-4ce5-b200-da38bdc787b7 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:18.895021 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7e5ec3fa-2e3a-43a0-8198-a24cd345271f req-f436dfc9-17bf-4ce5-b200-da38bdc787b7 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:18.920666 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-7e5ec3fa-2e3a-43a0-8198-a24cd345271f req-f436dfc9-17bf-4ce5-b200-da38bdc787b7 service nova] Creating event network-vif-unplugged:21dd4917-2780-427e-86cb-ca75980a35b5 for instance d3255935-3cff-4bb0-aad2-a8f401028a59 on n-h2-833090-16 Aug 31 16:08:18.929805 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-7e5ec3fa-2e3a-43a0-8198-a24cd345271f req-f436dfc9-17bf-4ce5-b200-da38bdc787b7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069529 Aug 31 16:08:18.936679 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1689/3547] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:18.942424 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e11c2e09-a9b8-4d3b-9bca-9b07baeae15d tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:18.943137 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e11c2e09-a9b8-4d3b-9bca-9b07baeae15d tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:18.965321 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e11c2e09-a9b8-4d3b-9bca-9b07baeae15d tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:18.971617 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e11c2e09-a9b8-4d3b-9bca-9b07baeae15d tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:18.972237 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e11c2e09-a9b8-4d3b-9bca-9b07baeae15d tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:18.973145 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e11c2e09-a9b8-4d3b-9bca-9b07baeae15d tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:18.973906 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e11c2e09-a9b8-4d3b-9bca-9b07baeae15d tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:18.974510 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e11c2e09-a9b8-4d3b-9bca-9b07baeae15d tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:19.132629 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e11c2e09-a9b8-4d3b-9bca-9b07baeae15d tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:19.169909 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e11c2e09-a9b8-4d3b-9bca-9b07baeae15d tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:19.173062 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e11c2e09-a9b8-4d3b-9bca-9b07baeae15d tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:19.175288 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e11c2e09-a9b8-4d3b-9bca-9b07baeae15d tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 1874 microversion: 2.42 time: 0.237152 Aug 31 16:08:19.179385 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1690/3548] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:08:18 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 1874 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:08:19.204865 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a81f09e9-8247-463a-9d31-e2bb356d23d0 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:19.207859 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a81f09e9-8247-463a-9d31-e2bb356d23d0 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:19.234026 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a81f09e9-8247-463a-9d31-e2bb356d23d0 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:19.235972 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a81f09e9-8247-463a-9d31-e2bb356d23d0 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:19.239403 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a81f09e9-8247-463a-9d31-e2bb356d23d0 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:19.247061 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a81f09e9-8247-463a-9d31-e2bb356d23d0 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:19.247926 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a81f09e9-8247-463a-9d31-e2bb356d23d0 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:19.249578 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a81f09e9-8247-463a-9d31-e2bb356d23d0 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:19.322893 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a81f09e9-8247-463a-9d31-e2bb356d23d0 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:08:19.399615 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-60ba51f6-3158-4f67-a391-9f7980cab37c tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae96c057d884eafb9c2032dd5db9e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a33aeb63a416a9d046e2b67b93f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:19.414884 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-60ba51f6-3158-4f67-a391-9f7980cab37c tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/servers/d3255935-3cff-4bb0-aad2-a8f401028a59" status: 200 len: 1467 microversion: 2.1 time: 0.751508 Aug 31 16:08:19.430519 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1859/3549] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:18 2022] GET /compute/v2.1/servers/d3255935-3cff-4bb0-aad2-a8f401028a59 => generated 1467 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:19.437942 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6d994e91-f9db-4eec-b0ef-44c02d52c0d1 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:19.438685 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6d994e91-f9db-4eec-b0ef-44c02d52c0d1 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:19.463268 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d994e91-f9db-4eec-b0ef-44c02d52c0d1 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:19.463769 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d994e91-f9db-4eec-b0ef-44c02d52c0d1 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:19.464206 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d994e91-f9db-4eec-b0ef-44c02d52c0d1 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:19.464919 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d994e91-f9db-4eec-b0ef-44c02d52c0d1 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:19.465371 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d994e91-f9db-4eec-b0ef-44c02d52c0d1 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:19.465793 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d994e91-f9db-4eec-b0ef-44c02d52c0d1 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:19.589830 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a81f09e9-8247-463a-9d31-e2bb356d23d0 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "DELETE /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2" status: 204 len: 0 microversion: 2.1 time: 0.397845 Aug 31 16:08:19.591238 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1691/3550] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:08:19 2022] DELETE /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:08:19.600640 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-78963373-a718-4c09-b4e0-69dd00d3fc01 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:19.603796 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-78963373-a718-4c09-b4e0-69dd00d3fc01 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:19.644269 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78963373-a718-4c09-b4e0-69dd00d3fc01 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:19.644770 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78963373-a718-4c09-b4e0-69dd00d3fc01 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:19.645215 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78963373-a718-4c09-b4e0-69dd00d3fc01 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:19.645937 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78963373-a718-4c09-b4e0-69dd00d3fc01 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:19.649515 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78963373-a718-4c09-b4e0-69dd00d3fc01 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:19.650622 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78963373-a718-4c09-b4e0-69dd00d3fc01 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:20.354793 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-78963373-a718-4c09-b4e0-69dd00d3fc01 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:20.365005 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-78963373-a718-4c09-b4e0-69dd00d3fc01 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1681 microversion: 2.1 time: 0.772077 Aug 31 16:08:20.368754 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1692/3551] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:19 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1681 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:20.382114 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cf7cdb93-4931-43d8-a765-cd66c0f1d956 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb4aac5670>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:20.637599 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cf7cdb93-4931-43d8-a765-cd66c0f1d956 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images?changes-since=2022-08-31T16%3A05%3A21Z" status: 200 len: 2374 microversion: 2.1 time: 0.255623 Aug 31 16:08:20.637599 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1693/3552] 10.222.0.50 () {58 vars in 1199 bytes} [Wed Aug 31 16:08:20 2022] GET /compute/v2.1/images?changes-since=2022-08-31T16%3A05%3A21Z => generated 2374 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:20.661411 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fea0688f-91a6-47c7-8206-f18fed142bdd tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:20.662065 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fea0688f-91a6-47c7-8206-f18fed142bdd tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:20.685168 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fea0688f-91a6-47c7-8206-f18fed142bdd tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:20.685667 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fea0688f-91a6-47c7-8206-f18fed142bdd tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:20.686149 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fea0688f-91a6-47c7-8206-f18fed142bdd tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:20.686858 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fea0688f-91a6-47c7-8206-f18fed142bdd tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:20.687311 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fea0688f-91a6-47c7-8206-f18fed142bdd tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:20.687740 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fea0688f-91a6-47c7-8206-f18fed142bdd tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:20.756558 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6d994e91-f9db-4eec-b0ef-44c02d52c0d1 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:20.785334 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6d994e91-f9db-4eec-b0ef-44c02d52c0d1 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:20.795347 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6d994e91-f9db-4eec-b0ef-44c02d52c0d1 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:20.800645 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6d994e91-f9db-4eec-b0ef-44c02d52c0d1 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 2868 microversion: 2.32 time: 1.367377 Aug 31 16:08:20.823995 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1860/3553] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:08:19 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 2868 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:08:20.855384 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-253b83bd-9249-47bc-b18d-34ba9ab16cea tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:20.860821 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-253b83bd-9249-47bc-b18d-34ba9ab16cea tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] [instance: cf602736-d01a-4673-a20b-ed1ae5750eea] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:20.885345 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-253b83bd-9249-47bc-b18d-34ba9ab16cea tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:20.890204 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-253b83bd-9249-47bc-b18d-34ba9ab16cea tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:20.890920 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-253b83bd-9249-47bc-b18d-34ba9ab16cea tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:20.893221 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-253b83bd-9249-47bc-b18d-34ba9ab16cea tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:20.894835 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-253b83bd-9249-47bc-b18d-34ba9ab16cea tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:20.895923 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-253b83bd-9249-47bc-b18d-34ba9ab16cea tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:21.246599 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-253b83bd-9249-47bc-b18d-34ba9ab16cea tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4717b2fc0a654a77b40da565e599203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0154660c274106ab83ae50927348c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:21.264419 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-253b83bd-9249-47bc-b18d-34ba9ab16cea tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] 10.222.0.50 "GET /compute/v2.1/servers/cf602736-d01a-4673-a20b-ed1ae5750eea" status: 200 len: 1279 microversion: 2.1 time: 0.426691 Aug 31 16:08:21.270489 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1861/3554] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:20 2022] GET /compute/v2.1/servers/cf602736-d01a-4673-a20b-ed1ae5750eea => generated 1279 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:21.275806 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-af9a3fa4-47e3-45a4-a2bc-771d71467700 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:21.276689 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-af9a3fa4-47e3-45a4-a2bc-771d71467700 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:21.304208 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-af9a3fa4-47e3-45a4-a2bc-771d71467700 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:21.304752 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-af9a3fa4-47e3-45a4-a2bc-771d71467700 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:21.305200 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-af9a3fa4-47e3-45a4-a2bc-771d71467700 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:21.310960 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-af9a3fa4-47e3-45a4-a2bc-771d71467700 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:21.311723 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-af9a3fa4-47e3-45a4-a2bc-771d71467700 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:21.312211 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-af9a3fa4-47e3-45a4-a2bc-771d71467700 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:21.571377 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-af9a3fa4-47e3-45a4-a2bc-771d71467700 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:21.590242 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-af9a3fa4-47e3-45a4-a2bc-771d71467700 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:21.591869 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-af9a3fa4-47e3-45a4-a2bc-771d71467700 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:21.593169 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-af9a3fa4-47e3-45a4-a2bc-771d71467700 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 1874 microversion: 2.42 time: 0.321241 Aug 31 16:08:21.606129 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1862/3555] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:08:21 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 1874 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:08:21.606129 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-fce08bfd-6674-49e9-873f-8f3f17f1ecde req-18c91bbb-32b1-4c75-a43e-8d5ad4455f29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9", "name": "network-vif-deleted", "tag": "988b704e-8f3a-4c8f-903a-1661f7c99521"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:21.646051 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-fce08bfd-6674-49e9-873f-8f3f17f1ecde req-18c91bbb-32b1-4c75-a43e-8d5ad4455f29 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:21.650004 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-fce08bfd-6674-49e9-873f-8f3f17f1ecde req-18c91bbb-32b1-4c75-a43e-8d5ad4455f29 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:21.650750 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-fce08bfd-6674-49e9-873f-8f3f17f1ecde req-18c91bbb-32b1-4c75-a43e-8d5ad4455f29 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:21.683143 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fea0688f-91a6-47c7-8206-f18fed142bdd tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:21.685092 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-fce08bfd-6674-49e9-873f-8f3f17f1ecde req-18c91bbb-32b1-4c75-a43e-8d5ad4455f29 service nova] Creating event network-vif-deleted:988b704e-8f3a-4c8f-903a-1661f7c99521 for instance a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 on n-h2-833090-16 Aug 31 16:08:21.693314 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fea0688f-91a6-47c7-8206-f18fed142bdd tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2" status: 200 len: 1388 microversion: 2.1 time: 1.045940 Aug 31 16:08:21.698156 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1694/3556] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:20 2022] GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2 => generated 1388 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:21.701947 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-fce08bfd-6674-49e9-873f-8f3f17f1ecde req-18c91bbb-32b1-4c75-a43e-8d5ad4455f29 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105282 Aug 31 16:08:21.705300 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1863/3557] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:21.718583 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e92d39a1-aa30-4e64-ae2d-c3ce6783d036 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:21.722126 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e92d39a1-aa30-4e64-ae2d-c3ce6783d036 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:21.725936 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-27d07ac1-6ad9-4619-948f-e6eee16fc32a tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb45c709d0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:21.754606 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e92d39a1-aa30-4e64-ae2d-c3ce6783d036 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:21.756220 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e92d39a1-aa30-4e64-ae2d-c3ce6783d036 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:21.757207 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e92d39a1-aa30-4e64-ae2d-c3ce6783d036 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:21.760597 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e92d39a1-aa30-4e64-ae2d-c3ce6783d036 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:21.764030 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e92d39a1-aa30-4e64-ae2d-c3ce6783d036 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:21.764771 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e92d39a1-aa30-4e64-ae2d-c3ce6783d036 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:21.943153 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-27d07ac1-6ad9-4619-948f-e6eee16fc32a tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-308704984" status: 200 len: 484 microversion: 2.1 time: 0.227658 Aug 31 16:08:21.951405 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1695/3558] 10.222.0.50 () {58 vars in 1229 bytes} [Wed Aug 31 16:08:21 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-308704984 => generated 484 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:21.965553 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e6cea3fa-a7b9-49ec-83d9-5a1ec4f14a1e tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:21.966442 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e6cea3fa-a7b9-49ec-83d9-5a1ec4f14a1e tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:21.977393 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6cea3fa-a7b9-49ec-83d9-5a1ec4f14a1e tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:21.981132 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6cea3fa-a7b9-49ec-83d9-5a1ec4f14a1e tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:21.981783 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6cea3fa-a7b9-49ec-83d9-5a1ec4f14a1e tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:22.004773 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6cea3fa-a7b9-49ec-83d9-5a1ec4f14a1e tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:22.011636 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6cea3fa-a7b9-49ec-83d9-5a1ec4f14a1e tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:22.013225 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6cea3fa-a7b9-49ec-83d9-5a1ec4f14a1e tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:23.333537 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e92d39a1-aa30-4e64-ae2d-c3ce6783d036 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:23.341814 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e92d39a1-aa30-4e64-ae2d-c3ce6783d036 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1681 microversion: 2.1 time: 1.634068 Aug 31 16:08:23.342429 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1864/3559] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:21 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1681 bytes in 1637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:23.351087 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-588829d5-0531-4799-ba53-e6a162bfa493 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb45e12c10>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:23.411969 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e6cea3fa-a7b9-49ec-83d9-5a1ec4f14a1e tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:23.422876 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e6cea3fa-a7b9-49ec-83d9-5a1ec4f14a1e tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:23.440124 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e6cea3fa-a7b9-49ec-83d9-5a1ec4f14a1e tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:23.441664 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e6cea3fa-a7b9-49ec-83d9-5a1ec4f14a1e tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 2581 microversion: 2.32 time: 1.488864 Aug 31 16:08:23.442420 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1696/3560] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:08:21 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 2581 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:08:23.466746 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-3965e2b2-89c3-4194-b40e-a352c0c47975 req-53d5d08e-3455-4f3d-a290-8b98e64782c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4729162e-f8a9-4952-a3e0-be75936208f2", "name": "network-vif-deleted", "tag": "cba9d0d4-250d-490b-a5a2-c919d3ee3547"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:23.476565 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:08:23.479420 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3965e2b2-89c3-4194-b40e-a352c0c47975 req-53d5d08e-3455-4f3d-a290-8b98e64782c5 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:23.480121 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3965e2b2-89c3-4194-b40e-a352c0c47975 req-53d5d08e-3455-4f3d-a290-8b98e64782c5 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:23.480725 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3965e2b2-89c3-4194-b40e-a352c0c47975 req-53d5d08e-3455-4f3d-a290-8b98e64782c5 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:23.492315 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-588829d5-0531-4799-ba53-e6a162bfa493 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images?server=d3255935-3cff-4bb0-aad2-a8f401028a59" status: 200 len: 956 microversion: 2.1 time: 0.144587 Aug 31 16:08:23.497724 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1865/3561] 10.222.0.50 () {58 vars in 1209 bytes} [Wed Aug 31 16:08:23 2022] GET /compute/v2.1/images?server=d3255935-3cff-4bb0-aad2-a8f401028a59 => generated 956 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:23.498672 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-3965e2b2-89c3-4194-b40e-a352c0c47975 req-53d5d08e-3455-4f3d-a290-8b98e64782c5 service nova] Creating event network-vif-deleted:cba9d0d4-250d-490b-a5a2-c919d3ee3547 for instance 4729162e-f8a9-4952-a3e0-be75936208f2 on n-h2-833090-16 Aug 31 16:08:23.510887 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-3965e2b2-89c3-4194-b40e-a352c0c47975 req-53d5d08e-3455-4f3d-a290-8b98e64782c5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051417 Aug 31 16:08:23.511564 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c61cb6ee-fb33-4f3c-a323-892706696ab9 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:23.512170 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c61cb6ee-fb33-4f3c-a323-892706696ab9 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] [instance: cf602736-d01a-4673-a20b-ed1ae5750eea] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:23.512400 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1697/3562] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:23.517993 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a900a13d-7f66-4ec6-bfd0-3a2b3fa4c2db tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:23.519854 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a900a13d-7f66-4ec6-bfd0-3a2b3fa4c2db tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:23.531838 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c61cb6ee-fb33-4f3c-a323-892706696ab9 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:23.532212 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a900a13d-7f66-4ec6-bfd0-3a2b3fa4c2db tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:23.533147 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a900a13d-7f66-4ec6-bfd0-3a2b3fa4c2db tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:23.533911 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c61cb6ee-fb33-4f3c-a323-892706696ab9 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:23.534621 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a900a13d-7f66-4ec6-bfd0-3a2b3fa4c2db tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:23.535293 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c61cb6ee-fb33-4f3c-a323-892706696ab9 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:23.536230 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a900a13d-7f66-4ec6-bfd0-3a2b3fa4c2db tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:23.537153 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c61cb6ee-fb33-4f3c-a323-892706696ab9 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:23.537809 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a900a13d-7f66-4ec6-bfd0-3a2b3fa4c2db tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:23.538489 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c61cb6ee-fb33-4f3c-a323-892706696ab9 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:23.539128 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a900a13d-7f66-4ec6-bfd0-3a2b3fa4c2db tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:23.539758 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c61cb6ee-fb33-4f3c-a323-892706696ab9 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:23.706400 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c61cb6ee-fb33-4f3c-a323-892706696ab9 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4717b2fc0a654a77b40da565e599203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0154660c274106ab83ae50927348c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:23.716718 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c61cb6ee-fb33-4f3c-a323-892706696ab9 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] 10.222.0.50 "GET /compute/v2.1/servers/cf602736-d01a-4673-a20b-ed1ae5750eea" status: 200 len: 1277 microversion: 2.1 time: 0.208983 Aug 31 16:08:23.718955 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1866/3563] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:23 2022] GET /compute/v2.1/servers/cf602736-d01a-4673-a20b-ed1ae5750eea => generated 1277 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:23.727596 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7b50dd8a-d357-4cda-ba28-7028a1855ada tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:23.728525 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7b50dd8a-d357-4cda-ba28-7028a1855ada tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:23.741839 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7b50dd8a-d357-4cda-ba28-7028a1855ada tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:23.742880 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7b50dd8a-d357-4cda-ba28-7028a1855ada tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:23.745556 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7b50dd8a-d357-4cda-ba28-7028a1855ada tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:23.746752 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a900a13d-7f66-4ec6-bfd0-3a2b3fa4c2db tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:23.747631 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7b50dd8a-d357-4cda-ba28-7028a1855ada tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:23.748263 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7b50dd8a-d357-4cda-ba28-7028a1855ada tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:23.748761 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7b50dd8a-d357-4cda-ba28-7028a1855ada tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:23.756834 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a900a13d-7f66-4ec6-bfd0-3a2b3fa4c2db tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:23.770559 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a900a13d-7f66-4ec6-bfd0-3a2b3fa4c2db tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:23.772622 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a900a13d-7f66-4ec6-bfd0-3a2b3fa4c2db tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 1874 microversion: 2.42 time: 0.259230 Aug 31 16:08:23.773662 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1698/3564] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:08:23 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 1874 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:08:23.790645 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3d4ee1f9-9e4a-4f21-ac5e-9b40c8c02605 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb4aa9c940>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:23.862701 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3d4ee1f9-9e4a-4f21-ac5e-9b40c8c02605 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.50%2Fcompute%2Fv2.1%2Fservers%2F5c81c9a3-8ba0-4573-a3e8-68292edc1ae2" status: 200 len: 484 microversion: 2.1 time: 0.087181 Aug 31 16:08:23.872492 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1699/3565] 10.222.0.50 () {58 vars in 1317 bytes} [Wed Aug 31 16:08:23 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.50%2Fcompute%2Fv2.1%2Fservers%2F5c81c9a3-8ba0-4573-a3e8-68292edc1ae2 => generated 484 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:23.879217 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-af065265-853d-4c58-bfb4-0b2d1e783bef tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb4aa2ad30>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:23.951043 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-af065265-853d-4c58-bfb4-0b2d1e783bef tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.50%2Fcompute%2Fservers%2F5c81c9a3-8ba0-4573-a3e8-68292edc1ae2" status: 200 len: 484 microversion: 2.1 time: 0.077082 Aug 31 16:08:23.959819 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7b50dd8a-d357-4cda-ba28-7028a1855ada tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:23.960375 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1700/3566] 10.222.0.50 () {58 vars in 1303 bytes} [Wed Aug 31 16:08:23 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.50%2Fcompute%2Fservers%2F5c81c9a3-8ba0-4573-a3e8-68292edc1ae2 => generated 484 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:23.965432 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-315b4b22-b3c7-4028-b2b8-d905de4595c9 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb4aa9c700>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:23.968557 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7b50dd8a-d357-4cda-ba28-7028a1855ada tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2" status: 200 len: 1183 microversion: 2.1 time: 0.248120 Aug 31 16:08:23.973221 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1867/3567] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:23 2022] GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2 => generated 1183 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:24.100582 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-0c1e45f2-04b9-400d-a16e-dfcaf0b29af4 req-f292cccf-6043-456a-899a-d7e675834a0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9", "name": "network-vif-deleted", "tag": "ddeb3d0d-f40d-487e-8c19-0d1274291781"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:24.119308 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-315b4b22-b3c7-4028-b2b8-d905de4595c9 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3279 microversion: 2.1 time: 0.157492 Aug 31 16:08:24.120162 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1701/3568] 10.222.0.50 () {58 vars in 1149 bytes} [Wed Aug 31 16:08:23 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3279 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:24.123302 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-0c1e45f2-04b9-400d-a16e-dfcaf0b29af4 req-f292cccf-6043-456a-899a-d7e675834a0d service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:24.123957 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-0c1e45f2-04b9-400d-a16e-dfcaf0b29af4 req-f292cccf-6043-456a-899a-d7e675834a0d service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:24.124530 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-0c1e45f2-04b9-400d-a16e-dfcaf0b29af4 req-f292cccf-6043-456a-899a-d7e675834a0d service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:24.140666 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7372c52e-ed72-402b-be6b-62d348def82b tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb45e11b80>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:24.147304 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-0c1e45f2-04b9-400d-a16e-dfcaf0b29af4 req-f292cccf-6043-456a-899a-d7e675834a0d service nova] Creating event network-vif-deleted:ddeb3d0d-f40d-487e-8c19-0d1274291781 for instance a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 on n-h2-833090-16 Aug 31 16:08:24.163034 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-0c1e45f2-04b9-400d-a16e-dfcaf0b29af4 req-f292cccf-6043-456a-899a-d7e675834a0d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067632 Aug 31 16:08:24.164221 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1868/3569] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:08:24.249766 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7372c52e-ed72-402b-be6b-62d348def82b tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1428 microversion: 2.1 time: 0.116643 Aug 31 16:08:24.259019 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1702/3570] 10.222.0.50 () {58 vars in 1149 bytes} [Wed Aug 31 16:08:24 2022] GET /compute/v2.1/images?type=snapshot => generated 1428 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:24.263994 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7a9178ad-19c7-4ae0-bcf3-6b7406220832 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb45e26940>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:24.365177 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5cae359b-e6e6-4115-aca8-f3325fae11d5 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:24.365936 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5cae359b-e6e6-4115-aca8-f3325fae11d5 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:24.371394 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7a9178ad-19c7-4ae0-bcf3-6b7406220832 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.111480 Aug 31 16:08:24.372338 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1869/3571] 10.222.0.50 () {58 vars in 1137 bytes} [Wed Aug 31 16:08:24 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:24.377623 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5cae359b-e6e6-4115-aca8-f3325fae11d5 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:24.378503 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5cae359b-e6e6-4115-aca8-f3325fae11d5 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:24.379111 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5cae359b-e6e6-4115-aca8-f3325fae11d5 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:24.380407 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5cae359b-e6e6-4115-aca8-f3325fae11d5 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:24.381244 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5cae359b-e6e6-4115-aca8-f3325fae11d5 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:24.381894 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5cae359b-e6e6-4115-aca8-f3325fae11d5 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:24.389723 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8d23be1a-7a80-44fc-a2e1-da675e0d9e29 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb45e129d0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:24.513856 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8d23be1a-7a80-44fc-a2e1-da675e0d9e29 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/detail?changes-since=2022-08-31T16%3A05%3A17Z" status: 200 len: 6332 microversion: 2.1 time: 0.132837 Aug 31 16:08:24.515243 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1870/3572] 10.222.0.50 () {58 vars in 1220 bytes} [Wed Aug 31 16:08:24 2022] GET /compute/v2.1/images/detail?changes-since=2022-08-31T16%3A05%3A17Z => generated 6332 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:08:24.520532 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-82c0b969-4890-417f-a06d-d43fe7ecc71a tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:24.521561 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-82c0b969-4890-417f-a06d-d43fe7ecc71a tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:24.530484 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-82c0b969-4890-417f-a06d-d43fe7ecc71a tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:24.531204 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-82c0b969-4890-417f-a06d-d43fe7ecc71a tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:24.531909 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-82c0b969-4890-417f-a06d-d43fe7ecc71a tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:24.532998 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-82c0b969-4890-417f-a06d-d43fe7ecc71a tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:24.533679 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-82c0b969-4890-417f-a06d-d43fe7ecc71a tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:24.534339 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-82c0b969-4890-417f-a06d-d43fe7ecc71a tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:25.032106 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-82c0b969-4890-417f-a06d-d43fe7ecc71a tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:25.039095 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-82c0b969-4890-417f-a06d-d43fe7ecc71a tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:25.040525 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-82c0b969-4890-417f-a06d-d43fe7ecc71a tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:25.041787 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-82c0b969-4890-417f-a06d-d43fe7ecc71a tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 2373 microversion: 2.32 time: 0.525307 Aug 31 16:08:25.042555 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1871/3573] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:08:24 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 2373 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:08:25.059460 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5cae359b-e6e6-4115-aca8-f3325fae11d5 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:25.064617 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-84682af4-b4dd-4393-bca5-555d85baf24f tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb45e121f0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:25.070066 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5cae359b-e6e6-4115-aca8-f3325fae11d5 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1681 microversion: 2.1 time: 0.709974 Aug 31 16:08:25.082166 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1703/3574] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:24 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1681 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:08:25.088364 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-23eaad6a-f9b7-4f5d-9e1b-8814e0bd5647 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:25.089355 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-23eaad6a-f9b7-4f5d-9e1b-8814e0bd5647 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] [instance: cf602736-d01a-4673-a20b-ed1ae5750eea] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:25.104031 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23eaad6a-f9b7-4f5d-9e1b-8814e0bd5647 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:25.110367 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23eaad6a-f9b7-4f5d-9e1b-8814e0bd5647 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:25.113242 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23eaad6a-f9b7-4f5d-9e1b-8814e0bd5647 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:25.118498 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23eaad6a-f9b7-4f5d-9e1b-8814e0bd5647 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:25.122835 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23eaad6a-f9b7-4f5d-9e1b-8814e0bd5647 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:25.123289 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-23eaad6a-f9b7-4f5d-9e1b-8814e0bd5647 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:25.174610 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-84682af4-b4dd-4393-bca5-555d85baf24f tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-308704984" status: 200 len: 664 microversion: 2.1 time: 0.111109 Aug 31 16:08:25.176406 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1872/3575] 10.222.0.50 () {58 vars in 1250 bytes} [Wed Aug 31 16:08:25 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-308704984 => generated 664 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:25.188945 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b52e2b2b-ba98-4073-8ad7-4ff11e2f0c07 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:25.191868 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b52e2b2b-ba98-4073-8ad7-4ff11e2f0c07 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:25.202701 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b52e2b2b-ba98-4073-8ad7-4ff11e2f0c07 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:25.203189 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b52e2b2b-ba98-4073-8ad7-4ff11e2f0c07 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:25.203620 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b52e2b2b-ba98-4073-8ad7-4ff11e2f0c07 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:25.204546 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b52e2b2b-ba98-4073-8ad7-4ff11e2f0c07 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:25.205364 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b52e2b2b-ba98-4073-8ad7-4ff11e2f0c07 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:25.206186 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b52e2b2b-ba98-4073-8ad7-4ff11e2f0c07 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:25.405364 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b52e2b2b-ba98-4073-8ad7-4ff11e2f0c07 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:25.417642 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b52e2b2b-ba98-4073-8ad7-4ff11e2f0c07 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:25.425116 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b52e2b2b-ba98-4073-8ad7-4ff11e2f0c07 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:25.426582 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b52e2b2b-ba98-4073-8ad7-4ff11e2f0c07 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 1874 microversion: 2.42 time: 0.247822 Aug 31 16:08:25.427140 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1873/3576] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:08:25 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 1874 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:08:25.431601 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2c0380ee-879f-4fb5-a51d-bf4fd81e84c7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:25.432199 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2c0380ee-879f-4fb5-a51d-bf4fd81e84c7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:25.451191 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2c0380ee-879f-4fb5-a51d-bf4fd81e84c7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:25.451913 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2c0380ee-879f-4fb5-a51d-bf4fd81e84c7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:25.452563 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2c0380ee-879f-4fb5-a51d-bf4fd81e84c7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:25.453779 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2c0380ee-879f-4fb5-a51d-bf4fd81e84c7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:25.454618 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2c0380ee-879f-4fb5-a51d-bf4fd81e84c7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:25.455502 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2c0380ee-879f-4fb5-a51d-bf4fd81e84c7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:25.587617 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2c0380ee-879f-4fb5-a51d-bf4fd81e84c7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:25.601085 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2c0380ee-879f-4fb5-a51d-bf4fd81e84c7 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2" status: 200 len: 1183 microversion: 2.1 time: 0.172843 Aug 31 16:08:25.601694 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1874/3577] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:25 2022] GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2 => generated 1183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:25.607021 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fd89e6e2-035f-4318-91eb-8aa7bfd9cd72 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb45ead1f0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:25.762026 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fd89e6e2-035f-4318-91eb-8aa7bfd9cd72 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.50%2Fcompute%2Fv2.1%2Fservers%2F5c81c9a3-8ba0-4573-a3e8-68292edc1ae2" status: 200 len: 1466 microversion: 2.1 time: 0.158752 Aug 31 16:08:25.764540 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-23eaad6a-f9b7-4f5d-9e1b-8814e0bd5647 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4717b2fc0a654a77b40da565e599203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0154660c274106ab83ae50927348c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:25.767923 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1875/3578] 10.222.0.50 () {58 vars in 1338 bytes} [Wed Aug 31 16:08:25 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.50%2Fcompute%2Fv2.1%2Fservers%2F5c81c9a3-8ba0-4573-a3e8-68292edc1ae2 => generated 1466 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:25.775266 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-23eaad6a-f9b7-4f5d-9e1b-8814e0bd5647 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] 10.222.0.50 "GET /compute/v2.1/servers/cf602736-d01a-4673-a20b-ed1ae5750eea" status: 200 len: 1319 microversion: 2.1 time: 0.691555 Aug 31 16:08:25.777099 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1704/3579] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:25 2022] GET /compute/v2.1/servers/cf602736-d01a-4673-a20b-ed1ae5750eea => generated 1319 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:25.779718 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-01bdfced-0f62-4a2d-8699-24fdd9316d66 req-aeccc795-1bad-46d3-940e-c03f0225e164 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91f7f5e0-19f8-40ba-a692-2c2b6cb6a0be", "tag": "a83602be-36bb-49f4-a8f9-4ba66e314a64"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:25.783042 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-17879b57-2993-441e-b92b-27e2839b5958 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb45e11700>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:25.803516 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-01bdfced-0f62-4a2d-8699-24fdd9316d66 req-aeccc795-1bad-46d3-940e-c03f0225e164 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:25.804130 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-01bdfced-0f62-4a2d-8699-24fdd9316d66 req-aeccc795-1bad-46d3-940e-c03f0225e164 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:25.804557 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-01bdfced-0f62-4a2d-8699-24fdd9316d66 req-aeccc795-1bad-46d3-940e-c03f0225e164 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:25.821167 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-01bdfced-0f62-4a2d-8699-24fdd9316d66 req-aeccc795-1bad-46d3-940e-c03f0225e164 service nova] Creating event network-changed:a83602be-36bb-49f4-a8f9-4ba66e314a64 for instance 91f7f5e0-19f8-40ba-a692-2c2b6cb6a0be on n-h2-833090-16 Aug 31 16:08:25.829737 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-01bdfced-0f62-4a2d-8699-24fdd9316d66 req-aeccc795-1bad-46d3-940e-c03f0225e164 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059481 Aug 31 16:08:25.831512 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1876/3580] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:25.845194 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-17879b57-2993-441e-b92b-27e2839b5958 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.50%2Fcompute%2Fservers%2F5c81c9a3-8ba0-4573-a3e8-68292edc1ae2" status: 200 len: 1466 microversion: 2.1 time: 0.066634 Aug 31 16:08:25.846481 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1705/3581] 10.222.0.50 () {58 vars in 1324 bytes} [Wed Aug 31 16:08:25 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.50%2Fcompute%2Fservers%2F5c81c9a3-8ba0-4573-a3e8-68292edc1ae2 => generated 1466 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:25.862732 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-bb4923db-9dd8-40a9-a121-ff67ac2b07cb tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb45e3f670>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:26.008279 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-bb4923db-9dd8-40a9-a121-ff67ac2b07cb tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7107 microversion: 2.1 time: 0.149977 Aug 31 16:08:26.020948 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1877/3582] 10.222.0.50 () {58 vars in 1170 bytes} [Wed Aug 31 16:08:25 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7107 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:26.034879 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4338c092-1442-4aa7-8a4e-5a596a9a65b0 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb4aa9cb80>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:26.078707 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7378cc31-04f7-4c54-a57f-bac8b4fa952a tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:26.079637 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7378cc31-04f7-4c54-a57f-bac8b4fa952a tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:26.091371 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7378cc31-04f7-4c54-a57f-bac8b4fa952a tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:26.093835 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7378cc31-04f7-4c54-a57f-bac8b4fa952a tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:26.094582 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7378cc31-04f7-4c54-a57f-bac8b4fa952a tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:26.096883 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7378cc31-04f7-4c54-a57f-bac8b4fa952a tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:26.097573 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7378cc31-04f7-4c54-a57f-bac8b4fa952a tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:26.098585 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7378cc31-04f7-4c54-a57f-bac8b4fa952a tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:26.166941 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4338c092-1442-4aa7-8a4e-5a596a9a65b0 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4374 microversion: 2.1 time: 0.139894 Aug 31 16:08:26.167956 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1706/3583] 10.222.0.50 () {58 vars in 1170 bytes} [Wed Aug 31 16:08:26 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4374 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:26.182519 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-660a3b35-99a3-4522-a020-f1de22301adb tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:26.183503 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-660a3b35-99a3-4522-a020-f1de22301adb tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:26.200832 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-660a3b35-99a3-4522-a020-f1de22301adb tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:26.201712 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-660a3b35-99a3-4522-a020-f1de22301adb tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:26.202976 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-660a3b35-99a3-4522-a020-f1de22301adb tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:26.203835 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-660a3b35-99a3-4522-a020-f1de22301adb tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:26.204393 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-660a3b35-99a3-4522-a020-f1de22301adb tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:26.205023 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-660a3b35-99a3-4522-a020-f1de22301adb tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:26.617334 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7378cc31-04f7-4c54-a57f-bac8b4fa952a tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:26.632809 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7378cc31-04f7-4c54-a57f-bac8b4fa952a tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:26.637690 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7378cc31-04f7-4c54-a57f-bac8b4fa952a tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:26.641545 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7378cc31-04f7-4c54-a57f-bac8b4fa952a tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 2326 microversion: 2.32 time: 0.572950 Aug 31 16:08:26.644094 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1878/3584] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:08:26 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 2326 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:08:26.650048 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:08:26.653804 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-26f034a2-828f-4bf8-8bd8-ef73b0505ce5 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb45e3f310>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:26.697626 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-660a3b35-99a3-4522-a020-f1de22301adb tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:26.710460 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-660a3b35-99a3-4522-a020-f1de22301adb tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1681 microversion: 2.1 time: 0.538332 Aug 31 16:08:26.711754 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1707/3585] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:26 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1681 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:26.721314 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-93650342-2097-458c-9576-5e5bcf7ae283 req-1b10dbbb-f3f9-40e2-91fa-963b8b53c85e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9", "name": "network-vif-deleted", "tag": "18f5d3ba-5072-4e6c-8f7b-bfb9589950de"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:26.739171 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-93650342-2097-458c-9576-5e5bcf7ae283 req-1b10dbbb-f3f9-40e2-91fa-963b8b53c85e service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:26.740634 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-93650342-2097-458c-9576-5e5bcf7ae283 req-1b10dbbb-f3f9-40e2-91fa-963b8b53c85e service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:26.741419 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-93650342-2097-458c-9576-5e5bcf7ae283 req-1b10dbbb-f3f9-40e2-91fa-963b8b53c85e service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:26.754731 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-26f034a2-828f-4bf8-8bd8-ef73b0505ce5 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/d715a41c-0e56-494a-a102-cac65831f6bd" status: 200 len: 784 microversion: 2.1 time: 0.108987 Aug 31 16:08:26.765581 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1879/3586] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Aug 31 16:08:26 2022] GET /compute/v2.1/images/d715a41c-0e56-494a-a102-cac65831f6bd => generated 784 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:26.773451 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-93650342-2097-458c-9576-5e5bcf7ae283 req-1b10dbbb-f3f9-40e2-91fa-963b8b53c85e service nova] Creating event network-vif-deleted:18f5d3ba-5072-4e6c-8f7b-bfb9589950de for instance a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 on n-h2-833090-16 Aug 31 16:08:26.779322 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-93650342-2097-458c-9576-5e5bcf7ae283 req-1b10dbbb-f3f9-40e2-91fa-963b8b53c85e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065759 Aug 31 16:08:26.780364 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1708/3587] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:26.781148 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-16c1cd33-0aa4-46d1-a51d-34e40c592aff tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:26.782823 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-16c1cd33-0aa4-46d1-a51d-34e40c592aff tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:26.791524 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-16c1cd33-0aa4-46d1-a51d-34e40c592aff tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:26.792281 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-16c1cd33-0aa4-46d1-a51d-34e40c592aff tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:26.793051 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-16c1cd33-0aa4-46d1-a51d-34e40c592aff tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:26.794270 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-16c1cd33-0aa4-46d1-a51d-34e40c592aff tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:26.795045 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-16c1cd33-0aa4-46d1-a51d-34e40c592aff tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:26.795639 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-16c1cd33-0aa4-46d1-a51d-34e40c592aff tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:26.802695 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7f00a029-862b-4c68-9dbc-e2c3256e5cd9 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:26.803899 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7f00a029-862b-4c68-9dbc-e2c3256e5cd9 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:26.815517 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f00a029-862b-4c68-9dbc-e2c3256e5cd9 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:26.816120 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f00a029-862b-4c68-9dbc-e2c3256e5cd9 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:26.816788 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f00a029-862b-4c68-9dbc-e2c3256e5cd9 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:26.818207 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f00a029-862b-4c68-9dbc-e2c3256e5cd9 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:26.819037 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f00a029-862b-4c68-9dbc-e2c3256e5cd9 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:26.819699 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f00a029-862b-4c68-9dbc-e2c3256e5cd9 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:26.920237 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-16c1cd33-0aa4-46d1-a51d-34e40c592aff tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:26.943370 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7f00a029-862b-4c68-9dbc-e2c3256e5cd9 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:26.958728 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-16c1cd33-0aa4-46d1-a51d-34e40c592aff tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:26.961379 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-16c1cd33-0aa4-46d1-a51d-34e40c592aff tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:26.963443 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-16c1cd33-0aa4-46d1-a51d-34e40c592aff tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 1874 microversion: 2.42 time: 0.196301 Aug 31 16:08:26.964177 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7f00a029-862b-4c68-9dbc-e2c3256e5cd9 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2" status: 200 len: 1183 microversion: 2.1 time: 0.175717 Aug 31 16:08:26.965525 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1709/3588] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:26 2022] GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2 => generated 1183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:26.967716 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1880/3589] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:08:26 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 1874 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:08:26.977495 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-847b2382-c8d9-4dee-bfde-08598e1f875b tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb45c70670>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:26.978470 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b753b93b-5092-4231-b391-e80d8c177e5f tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:26.979297 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b753b93b-5092-4231-b391-e80d8c177e5f tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] [instance: cf602736-d01a-4673-a20b-ed1ae5750eea] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:26.993493 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b753b93b-5092-4231-b391-e80d8c177e5f tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:26.993983 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b753b93b-5092-4231-b391-e80d8c177e5f tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:26.999586 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b753b93b-5092-4231-b391-e80d8c177e5f tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:27.000352 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b753b93b-5092-4231-b391-e80d8c177e5f tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:27.000832 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b753b93b-5092-4231-b391-e80d8c177e5f tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:27.001254 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b753b93b-5092-4231-b391-e80d8c177e5f tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:27.038602 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-847b2382-c8d9-4dee-bfde-08598e1f875b tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1610 microversion: 2.1 time: 0.072397 Aug 31 16:08:27.047836 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1710/3590] 10.222.0.50 () {58 vars in 1158 bytes} [Wed Aug 31 16:08:26 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1610 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:27.060413 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f8f58bfd-bf5d-41e7-bbe1-907a479ec747 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb4aa2a670>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:27.418784 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b753b93b-5092-4231-b391-e80d8c177e5f tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4717b2fc0a654a77b40da565e599203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0154660c274106ab83ae50927348c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:27.433084 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b753b93b-5092-4231-b391-e80d8c177e5f tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] 10.222.0.50 "GET /compute/v2.1/servers/cf602736-d01a-4673-a20b-ed1ae5750eea" status: 200 len: 1319 microversion: 2.1 time: 0.464082 Aug 31 16:08:27.435013 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:08:27.436162 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1881/3591] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:26 2022] GET /compute/v2.1/servers/cf602736-d01a-4673-a20b-ed1ae5750eea => generated 1319 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:27.679260 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-aca7a7c0-39fa-487c-b5e2-0ad679a2f705 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:27.680566 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-aca7a7c0-39fa-487c-b5e2-0ad679a2f705 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:27.690927 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aca7a7c0-39fa-487c-b5e2-0ad679a2f705 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:27.691795 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aca7a7c0-39fa-487c-b5e2-0ad679a2f705 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:27.693127 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aca7a7c0-39fa-487c-b5e2-0ad679a2f705 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:27.694217 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aca7a7c0-39fa-487c-b5e2-0ad679a2f705 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:27.694832 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aca7a7c0-39fa-487c-b5e2-0ad679a2f705 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:27.695392 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aca7a7c0-39fa-487c-b5e2-0ad679a2f705 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:27.974192 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f8f58bfd-bf5d-41e7-bbe1-907a479ec747 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "DELETE /compute/v2.1/images/88312359-8e02-42d2-90a9-c8d56bdfe0fb" status: 204 len: 0 microversion: 2.1 time: 0.917079 Aug 31 16:08:27.976002 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1711/3592] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:27 2022] DELETE /compute/v2.1/images/88312359-8e02-42d2-90a9-c8d56bdfe0fb => generated 0 bytes in 921 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 16:08:27.995935 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ebd8e37b-4e94-4aed-ac68-81568774d409 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:27.997166 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ebd8e37b-4e94-4aed-ac68-81568774d409 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:28.007018 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebd8e37b-4e94-4aed-ac68-81568774d409 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:28.007749 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebd8e37b-4e94-4aed-ac68-81568774d409 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:28.008326 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebd8e37b-4e94-4aed-ac68-81568774d409 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:28.009179 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebd8e37b-4e94-4aed-ac68-81568774d409 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:28.009771 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebd8e37b-4e94-4aed-ac68-81568774d409 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:28.010586 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebd8e37b-4e94-4aed-ac68-81568774d409 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:28.021753 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:08:28.307551 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-aca7a7c0-39fa-487c-b5e2-0ad679a2f705 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:28.323881 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-aca7a7c0-39fa-487c-b5e2-0ad679a2f705 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:28.327160 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-aca7a7c0-39fa-487c-b5e2-0ad679a2f705 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:28.330346 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-aca7a7c0-39fa-487c-b5e2-0ad679a2f705 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 2168 microversion: 2.32 time: 0.655392 Aug 31 16:08:28.331593 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1882/3593] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:08:27 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 2168 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:08:28.339836 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d6b79cc5-47ad-41e1-8443-703b218bc747 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb45e2e160>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:28.396632 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ebd8e37b-4e94-4aed-ac68-81568774d409 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:28.405512 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ebd8e37b-4e94-4aed-ac68-81568774d409 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1658 microversion: 2.1 time: 0.428140 Aug 31 16:08:28.422796 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1712/3594] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:27 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1658 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:28.429890 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c2659a2a-22d2-484b-9994-ac935888a410 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:28.430775 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c2659a2a-22d2-484b-9994-ac935888a410 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:28.438405 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2659a2a-22d2-484b-9994-ac935888a410 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:28.439586 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2659a2a-22d2-484b-9994-ac935888a410 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:28.440161 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2659a2a-22d2-484b-9994-ac935888a410 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:28.441041 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2659a2a-22d2-484b-9994-ac935888a410 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:28.441630 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2659a2a-22d2-484b-9994-ac935888a410 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:28.442229 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2659a2a-22d2-484b-9994-ac935888a410 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:28.655311 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:08:28.673786 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c2659a2a-22d2-484b-9994-ac935888a410 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:28.713724 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c2659a2a-22d2-484b-9994-ac935888a410 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2" status: 200 len: 1183 microversion: 2.1 time: 0.288386 Aug 31 16:08:28.714771 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1713/3595] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:28 2022] GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2 => generated 1183 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:28.727643 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dfd866b4-cbd9-4710-9998-937fb949a676 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:28.739344 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dfd866b4-cbd9-4710-9998-937fb949a676 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:28.745749 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfd866b4-cbd9-4710-9998-937fb949a676 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:28.746261 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfd866b4-cbd9-4710-9998-937fb949a676 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:28.746687 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfd866b4-cbd9-4710-9998-937fb949a676 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:28.747429 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfd866b4-cbd9-4710-9998-937fb949a676 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:28.747822 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfd866b4-cbd9-4710-9998-937fb949a676 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:28.748266 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfd866b4-cbd9-4710-9998-937fb949a676 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:28.878042 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dfd866b4-cbd9-4710-9998-937fb949a676 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:28.896718 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dfd866b4-cbd9-4710-9998-937fb949a676 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:28.905478 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dfd866b4-cbd9-4710-9998-937fb949a676 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:28.910466 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dfd866b4-cbd9-4710-9998-937fb949a676 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 1874 microversion: 2.42 time: 0.194921 Aug 31 16:08:28.913937 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1714/3596] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:08:28 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 1874 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:08:28.920385 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-991d0391-275c-4f18-b309-a9d2202c7fad tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:28.945573 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-991d0391-275c-4f18-b309-a9d2202c7fad tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:28.946599 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-991d0391-275c-4f18-b309-a9d2202c7fad tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:28.952539 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-991d0391-275c-4f18-b309-a9d2202c7fad tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:28.993208 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-991d0391-275c-4f18-b309-a9d2202c7fad tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Going to try to start instance {{(pid=128863) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 31 16:08:29.061559 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d6b79cc5-47ad-41e1-8443-703b218bc747 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "DELETE /compute/v2.1/images/7eadb01c-f356-40d0-ba94-14397b0d5ed2" status: 204 len: 0 microversion: 2.1 time: 0.727395 Aug 31 16:08:29.062326 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1883/3597] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:28 2022] DELETE /compute/v2.1/images/7eadb01c-f356-40d0-ba94-14397b0d5ed2 => generated 0 bytes in 730 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:08:29.067629 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b0392edb-b614-43c2-b5f6-162c512d8760 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:29.068272 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b0392edb-b614-43c2-b5f6-162c512d8760 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] [instance: cf602736-d01a-4673-a20b-ed1ae5750eea] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:29.096916 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b0392edb-b614-43c2-b5f6-162c512d8760 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:29.097678 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b0392edb-b614-43c2-b5f6-162c512d8760 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:29.098333 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b0392edb-b614-43c2-b5f6-162c512d8760 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:29.099520 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b0392edb-b614-43c2-b5f6-162c512d8760 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:29.099866 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-991d0391-275c-4f18-b309-a9d2202c7fad tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "POST /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b/action" status: 202 len: 0 microversion: 2.1 time: 0.184371 Aug 31 16:08:29.100487 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1715/3598] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:08:28 2022] POST /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:08:29.100598 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b0392edb-b614-43c2-b5f6-162c512d8760 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:29.101331 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b0392edb-b614-43c2-b5f6-162c512d8760 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:29.115502 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-82bd9b91-7895-40cb-b429-0438a20ba87d req-5c21eece-145d-44d4-adde-139e83952079 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9", "name": "network-vif-deleted", "tag": "01d2be63-7429-490a-bba0-954dc6039768"}, {"name": "network-changed", "server_uuid": "cf602736-d01a-4673-a20b-ed1ae5750eea", "tag": "91efca61-e4a7-4cd3-9a23-3049abf1fa19"}, {"server_uuid": "a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9", "name": "network-vif-deleted", "tag": "cad2dd93-6ee0-4ee0-917c-bbf5d5f4da1d"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:29.140572 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-82bd9b91-7895-40cb-b429-0438a20ba87d req-5c21eece-145d-44d4-adde-139e83952079 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:29.141206 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-82bd9b91-7895-40cb-b429-0438a20ba87d req-5c21eece-145d-44d4-adde-139e83952079 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:29.141671 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-82bd9b91-7895-40cb-b429-0438a20ba87d req-5c21eece-145d-44d4-adde-139e83952079 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:29.171225 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-82bd9b91-7895-40cb-b429-0438a20ba87d req-5c21eece-145d-44d4-adde-139e83952079 service nova] Creating event network-vif-deleted:01d2be63-7429-490a-bba0-954dc6039768 for instance a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 on n-h2-833090-16 Aug 31 16:08:29.172693 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-82bd9b91-7895-40cb-b429-0438a20ba87d req-5c21eece-145d-44d4-adde-139e83952079 service nova] Creating event network-changed:91efca61-e4a7-4cd3-9a23-3049abf1fa19 for instance cf602736-d01a-4673-a20b-ed1ae5750eea on n-h1-833090-16 Aug 31 16:08:29.173639 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-82bd9b91-7895-40cb-b429-0438a20ba87d req-5c21eece-145d-44d4-adde-139e83952079 service nova] Creating event network-vif-deleted:cad2dd93-6ee0-4ee0-917c-bbf5d5f4da1d for instance a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 on n-h2-833090-16 Aug 31 16:08:29.183946 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-82bd9b91-7895-40cb-b429-0438a20ba87d req-5c21eece-145d-44d4-adde-139e83952079 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.078332 Aug 31 16:08:29.185142 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1716/3599] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:29.193331 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2b78e210-847a-4ece-a317-04b138f32dfb tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb45d29430>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:30.041577 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2b78e210-847a-4ece-a317-04b138f32dfb tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "DELETE /compute/v2.1/images/5cdd7779-2b38-4dda-9001-a2279d998ba4" status: 204 len: 0 microversion: 2.1 time: 0.853393 Aug 31 16:08:30.044177 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1717/3600] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:29 2022] DELETE /compute/v2.1/images/5cdd7779-2b38-4dda-9001-a2279d998ba4 => generated 0 bytes in 858 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:08:30.051441 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c969adaa-8e10-47d1-8a6c-d8d7a61037fb tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:30.056762 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c969adaa-8e10-47d1-8a6c-d8d7a61037fb tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:30.078705 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c969adaa-8e10-47d1-8a6c-d8d7a61037fb tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:30.079210 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c969adaa-8e10-47d1-8a6c-d8d7a61037fb tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:30.082523 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c969adaa-8e10-47d1-8a6c-d8d7a61037fb tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:30.083386 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c969adaa-8e10-47d1-8a6c-d8d7a61037fb tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:30.084411 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c969adaa-8e10-47d1-8a6c-d8d7a61037fb tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:30.090563 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c969adaa-8e10-47d1-8a6c-d8d7a61037fb tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:30.519430 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b0392edb-b614-43c2-b5f6-162c512d8760 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4717b2fc0a654a77b40da565e599203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0154660c274106ab83ae50927348c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:30.535337 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b0392edb-b614-43c2-b5f6-162c512d8760 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] 10.222.0.50 "GET /compute/v2.1/servers/cf602736-d01a-4673-a20b-ed1ae5750eea" status: 200 len: 1319 microversion: 2.1 time: 1.471171 Aug 31 16:08:30.536242 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1884/3601] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:29 2022] GET /compute/v2.1/servers/cf602736-d01a-4673-a20b-ed1ae5750eea => generated 1319 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:30.548803 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8bf4acf0-8f96-40f3-9320-7fa5fb1d62b1 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:30.550383 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8bf4acf0-8f96-40f3-9320-7fa5fb1d62b1 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:30.559343 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8bf4acf0-8f96-40f3-9320-7fa5fb1d62b1 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:30.560286 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8bf4acf0-8f96-40f3-9320-7fa5fb1d62b1 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:30.561461 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8bf4acf0-8f96-40f3-9320-7fa5fb1d62b1 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:30.563487 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8bf4acf0-8f96-40f3-9320-7fa5fb1d62b1 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:30.564420 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8bf4acf0-8f96-40f3-9320-7fa5fb1d62b1 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:30.565342 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8bf4acf0-8f96-40f3-9320-7fa5fb1d62b1 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:30.727413 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8bf4acf0-8f96-40f3-9320-7fa5fb1d62b1 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:30.739981 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8bf4acf0-8f96-40f3-9320-7fa5fb1d62b1 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:30.743097 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8bf4acf0-8f96-40f3-9320-7fa5fb1d62b1 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:30.745420 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8bf4acf0-8f96-40f3-9320-7fa5fb1d62b1 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1603 microversion: 2.32 time: 0.207597 Aug 31 16:08:30.763010 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1885/3602] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:08:30 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1603 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:08:30.764151 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c969adaa-8e10-47d1-8a6c-d8d7a61037fb tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:30.770721 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fe761f4f-324b-4694-9afe-376a1497f375 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:30.771656 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fe761f4f-324b-4694-9afe-376a1497f375 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:30.772674 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c969adaa-8e10-47d1-8a6c-d8d7a61037fb tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1667 microversion: 2.1 time: 0.727035 Aug 31 16:08:30.773272 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1718/3603] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:30 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1667 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:30.780124 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fe761f4f-324b-4694-9afe-376a1497f375 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:30.780755 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fe761f4f-324b-4694-9afe-376a1497f375 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:30.781309 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fe761f4f-324b-4694-9afe-376a1497f375 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:30.782120 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fe761f4f-324b-4694-9afe-376a1497f375 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:30.782721 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fe761f4f-324b-4694-9afe-376a1497f375 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:30.783389 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fe761f4f-324b-4694-9afe-376a1497f375 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:30.788763 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=100 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:08:30.790660 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9c5fce84-8874-448f-b703-c159d2257b0d tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:30.791576 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9c5fce84-8874-448f-b703-c159d2257b0d tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:30.808598 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c5fce84-8874-448f-b703-c159d2257b0d tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:30.809279 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c5fce84-8874-448f-b703-c159d2257b0d tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:30.809894 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c5fce84-8874-448f-b703-c159d2257b0d tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:30.810796 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c5fce84-8874-448f-b703-c159d2257b0d tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:30.811527 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c5fce84-8874-448f-b703-c159d2257b0d tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:30.812219 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c5fce84-8874-448f-b703-c159d2257b0d tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:30.977161 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-fe761f4f-324b-4694-9afe-376a1497f375 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:30.982122 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9c5fce84-8874-448f-b703-c159d2257b0d tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:30.985511 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fe761f4f-324b-4694-9afe-376a1497f375 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2" status: 200 len: 1183 microversion: 2.1 time: 0.220963 Aug 31 16:08:30.999123 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1886/3604] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:30 2022] GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2 => generated 1183 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:30.999780 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9c5fce84-8874-448f-b703-c159d2257b0d tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:31.001671 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9c5fce84-8874-448f-b703-c159d2257b0d tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:31.005838 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3fa93501-9f79-4f0b-b8b0-5c260267f761 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:31.006592 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3fa93501-9f79-4f0b-b8b0-5c260267f761 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] [instance: 5c81c9a3-8ba0-4573-a3e8-68292edc1ae2] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:31.013452 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=74 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:08:31.015633 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3fa93501-9f79-4f0b-b8b0-5c260267f761 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:31.016281 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9c5fce84-8874-448f-b703-c159d2257b0d tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 1874 microversion: 2.42 time: 0.241340 Aug 31 16:08:31.016599 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3fa93501-9f79-4f0b-b8b0-5c260267f761 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:31.016921 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1719/3605] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:08:30 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 1874 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:08:31.032815 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3fa93501-9f79-4f0b-b8b0-5c260267f761 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:31.033474 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3fa93501-9f79-4f0b-b8b0-5c260267f761 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:31.033955 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3fa93501-9f79-4f0b-b8b0-5c260267f761 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:31.034428 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3fa93501-9f79-4f0b-b8b0-5c260267f761 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:31.074792 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3fa93501-9f79-4f0b-b8b0-5c260267f761 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] [instance: 5c81c9a3-8ba0-4573-a3e8-68292edc1ae2] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:08:31.194980 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3fa93501-9f79-4f0b-b8b0-5c260267f761 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5c81c9a3-8ba0-4573-a3e8-68292edc1ae2" status: 204 len: 0 microversion: 2.1 time: 0.193481 Aug 31 16:08:31.195758 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1887/3606] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:08:30 2022] DELETE /compute/v2.1/servers/5c81c9a3-8ba0-4573-a3e8-68292edc1ae2 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:08:31.206505 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-09cd0d06-f352-4aef-957c-3bd62995f125 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:31.207812 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-09cd0d06-f352-4aef-957c-3bd62995f125 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] [instance: 5c81c9a3-8ba0-4573-a3e8-68292edc1ae2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:31.216420 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09cd0d06-f352-4aef-957c-3bd62995f125 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:31.217299 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09cd0d06-f352-4aef-957c-3bd62995f125 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:31.217963 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09cd0d06-f352-4aef-957c-3bd62995f125 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:31.219463 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09cd0d06-f352-4aef-957c-3bd62995f125 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:31.220195 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09cd0d06-f352-4aef-957c-3bd62995f125 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:31.221095 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09cd0d06-f352-4aef-957c-3bd62995f125 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:31.435460 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-09cd0d06-f352-4aef-957c-3bd62995f125 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae96c057d884eafb9c2032dd5db9e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a33aeb63a416a9d046e2b67b93f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:31.447075 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-09cd0d06-f352-4aef-957c-3bd62995f125 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/servers/5c81c9a3-8ba0-4573-a3e8-68292edc1ae2" status: 200 len: 1473 microversion: 2.1 time: 0.245552 Aug 31 16:08:31.463781 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1720/3607] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:31 2022] GET /compute/v2.1/servers/5c81c9a3-8ba0-4573-a3e8-68292edc1ae2 => generated 1473 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:31.561740 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4acfb602-ab5a-4bae-a57d-0e7b09c28c9f tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:31.562293 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4acfb602-ab5a-4bae-a57d-0e7b09c28c9f tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] [instance: cf602736-d01a-4673-a20b-ed1ae5750eea] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:31.576313 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4acfb602-ab5a-4bae-a57d-0e7b09c28c9f tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:31.578895 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4acfb602-ab5a-4bae-a57d-0e7b09c28c9f tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:31.579672 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4acfb602-ab5a-4bae-a57d-0e7b09c28c9f tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:31.581644 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4acfb602-ab5a-4bae-a57d-0e7b09c28c9f tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:31.582375 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4acfb602-ab5a-4bae-a57d-0e7b09c28c9f tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:31.583135 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4acfb602-ab5a-4bae-a57d-0e7b09c28c9f tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:31.644103 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-e67e69ed-c119-4268-b5c9-526397557c1b req-9293b550-4100-413e-bcd5-b4f21f11504c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91f7f5e0-19f8-40ba-a692-2c2b6cb6a0be", "name": "network-vif-plugged", "status": "completed", "tag": "a83602be-36bb-49f4-a8f9-4ba66e314a64"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:31.657311 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e67e69ed-c119-4268-b5c9-526397557c1b req-9293b550-4100-413e-bcd5-b4f21f11504c service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:31.658051 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e67e69ed-c119-4268-b5c9-526397557c1b req-9293b550-4100-413e-bcd5-b4f21f11504c service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:31.658506 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e67e69ed-c119-4268-b5c9-526397557c1b req-9293b550-4100-413e-bcd5-b4f21f11504c service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:31.677652 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-e67e69ed-c119-4268-b5c9-526397557c1b req-9293b550-4100-413e-bcd5-b4f21f11504c service nova] Creating event network-vif-plugged:a83602be-36bb-49f4-a8f9-4ba66e314a64 for instance 91f7f5e0-19f8-40ba-a692-2c2b6cb6a0be on n-h2-833090-16 Aug 31 16:08:31.684791 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-e67e69ed-c119-4268-b5c9-526397557c1b req-9293b550-4100-413e-bcd5-b4f21f11504c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046150 Aug 31 16:08:31.685932 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1721/3608] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:08:31.770410 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8af622b5-5f0e-4acd-8e79-9e5ee686a5e4 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:31.771129 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8af622b5-5f0e-4acd-8e79-9e5ee686a5e4 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:31.789237 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8af622b5-5f0e-4acd-8e79-9e5ee686a5e4 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:31.789740 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8af622b5-5f0e-4acd-8e79-9e5ee686a5e4 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:31.790197 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8af622b5-5f0e-4acd-8e79-9e5ee686a5e4 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:31.790911 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8af622b5-5f0e-4acd-8e79-9e5ee686a5e4 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:31.791363 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8af622b5-5f0e-4acd-8e79-9e5ee686a5e4 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:31.791776 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8af622b5-5f0e-4acd-8e79-9e5ee686a5e4 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:31.809418 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4acfb602-ab5a-4bae-a57d-0e7b09c28c9f tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4717b2fc0a654a77b40da565e599203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0154660c274106ab83ae50927348c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:31.819495 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4acfb602-ab5a-4bae-a57d-0e7b09c28c9f tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] 10.222.0.50 "GET /compute/v2.1/servers/cf602736-d01a-4673-a20b-ed1ae5750eea" status: 200 len: 1319 microversion: 2.1 time: 0.262230 Aug 31 16:08:31.824059 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1888/3609] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:31 2022] GET /compute/v2.1/servers/cf602736-d01a-4673-a20b-ed1ae5750eea => generated 1319 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:31.835484 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c5b1f39b-35f5-4c36-8055-3db702eaa5f9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:31.850302 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c5b1f39b-35f5-4c36-8055-3db702eaa5f9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:31.857175 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c5b1f39b-35f5-4c36-8055-3db702eaa5f9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:31.857974 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c5b1f39b-35f5-4c36-8055-3db702eaa5f9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:31.858717 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c5b1f39b-35f5-4c36-8055-3db702eaa5f9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:31.859812 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c5b1f39b-35f5-4c36-8055-3db702eaa5f9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:31.860287 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c5b1f39b-35f5-4c36-8055-3db702eaa5f9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:31.860788 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c5b1f39b-35f5-4c36-8055-3db702eaa5f9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:31.909733 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8af622b5-5f0e-4acd-8e79-9e5ee686a5e4 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:31.926444 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8af622b5-5f0e-4acd-8e79-9e5ee686a5e4 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:31.928634 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8af622b5-5f0e-4acd-8e79-9e5ee686a5e4 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:31.930055 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8af622b5-5f0e-4acd-8e79-9e5ee686a5e4 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1603 microversion: 2.32 time: 0.164756 Aug 31 16:08:31.931216 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1722/3610] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:08:31 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1603 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:08:32.009461 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1d9d453c-a32d-4a6a-9451-7cbdaa2d1d6d tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:32.010083 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1d9d453c-a32d-4a6a-9451-7cbdaa2d1d6d tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:32.022176 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d9d453c-a32d-4a6a-9451-7cbdaa2d1d6d tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:32.022724 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d9d453c-a32d-4a6a-9451-7cbdaa2d1d6d tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:32.023168 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d9d453c-a32d-4a6a-9451-7cbdaa2d1d6d tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:32.023889 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d9d453c-a32d-4a6a-9451-7cbdaa2d1d6d tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:32.027028 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d9d453c-a32d-4a6a-9451-7cbdaa2d1d6d tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:32.027693 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d9d453c-a32d-4a6a-9451-7cbdaa2d1d6d tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:32.081227 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c5b1f39b-35f5-4c36-8055-3db702eaa5f9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:32.095635 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c5b1f39b-35f5-4c36-8055-3db702eaa5f9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1667 microversion: 2.1 time: 0.269348 Aug 31 16:08:32.109250 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1889/3611] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:31 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1667 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:32.129221 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fca277ee-fe46-4b98-8511-b373665506d4 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:32.133962 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fca277ee-fe46-4b98-8511-b373665506d4 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:32.148274 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fca277ee-fe46-4b98-8511-b373665506d4 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:32.154983 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fca277ee-fe46-4b98-8511-b373665506d4 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:32.155700 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fca277ee-fe46-4b98-8511-b373665506d4 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:32.155985 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1d9d453c-a32d-4a6a-9451-7cbdaa2d1d6d tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:32.156906 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fca277ee-fe46-4b98-8511-b373665506d4 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:32.157781 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fca277ee-fe46-4b98-8511-b373665506d4 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:32.158506 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fca277ee-fe46-4b98-8511-b373665506d4 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:32.171392 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1d9d453c-a32d-4a6a-9451-7cbdaa2d1d6d tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2" status: 200 len: 1183 microversion: 2.1 time: 0.165874 Aug 31 16:08:32.173556 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1723/3612] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:32 2022] GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2 => generated 1183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:08:32.259775 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-fca277ee-fe46-4b98-8511-b373665506d4 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:32.270061 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-fca277ee-fe46-4b98-8511-b373665506d4 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:32.272237 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-fca277ee-fe46-4b98-8511-b373665506d4 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:32.274186 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fca277ee-fe46-4b98-8511-b373665506d4 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 1874 microversion: 2.42 time: 0.163150 Aug 31 16:08:32.275169 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1890/3613] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:08:32 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 1874 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:08:32.469679 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-139cd09d-af21-4cfd-a912-569cf0464631 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:32.470552 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-139cd09d-af21-4cfd-a912-569cf0464631 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] [instance: 5c81c9a3-8ba0-4573-a3e8-68292edc1ae2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:32.477907 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-139cd09d-af21-4cfd-a912-569cf0464631 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:32.478510 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-139cd09d-af21-4cfd-a912-569cf0464631 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:32.479051 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-139cd09d-af21-4cfd-a912-569cf0464631 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:32.479823 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-139cd09d-af21-4cfd-a912-569cf0464631 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:32.480368 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-139cd09d-af21-4cfd-a912-569cf0464631 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:32.480854 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-139cd09d-af21-4cfd-a912-569cf0464631 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:32.728282 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-139cd09d-af21-4cfd-a912-569cf0464631 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae96c057d884eafb9c2032dd5db9e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a33aeb63a416a9d046e2b67b93f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:32.743204 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-139cd09d-af21-4cfd-a912-569cf0464631 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/servers/5c81c9a3-8ba0-4573-a3e8-68292edc1ae2" status: 200 len: 1473 microversion: 2.1 time: 0.277107 Aug 31 16:08:32.745095 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1724/3614] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:32 2022] GET /compute/v2.1/servers/5c81c9a3-8ba0-4573-a3e8-68292edc1ae2 => generated 1473 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:32.845234 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d6edcecb-9cfb-404f-a18f-8db4b0590532 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:32.846025 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d6edcecb-9cfb-404f-a18f-8db4b0590532 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] [instance: cf602736-d01a-4673-a20b-ed1ae5750eea] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:32.853010 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d6edcecb-9cfb-404f-a18f-8db4b0590532 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:32.853793 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d6edcecb-9cfb-404f-a18f-8db4b0590532 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:32.854496 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d6edcecb-9cfb-404f-a18f-8db4b0590532 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:32.855429 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d6edcecb-9cfb-404f-a18f-8db4b0590532 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:32.856213 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d6edcecb-9cfb-404f-a18f-8db4b0590532 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:32.856883 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d6edcecb-9cfb-404f-a18f-8db4b0590532 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:32.958466 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0832c9ec-7702-477c-8e05-c1bce53da55c tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:32.959545 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0832c9ec-7702-477c-8e05-c1bce53da55c tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:32.970734 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0832c9ec-7702-477c-8e05-c1bce53da55c tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:32.971590 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0832c9ec-7702-477c-8e05-c1bce53da55c tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:32.972224 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0832c9ec-7702-477c-8e05-c1bce53da55c tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:32.974575 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0832c9ec-7702-477c-8e05-c1bce53da55c tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:32.975678 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0832c9ec-7702-477c-8e05-c1bce53da55c tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:32.976323 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0832c9ec-7702-477c-8e05-c1bce53da55c tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:33.025705 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d6edcecb-9cfb-404f-a18f-8db4b0590532 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4717b2fc0a654a77b40da565e599203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0154660c274106ab83ae50927348c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:33.040455 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d6edcecb-9cfb-404f-a18f-8db4b0590532 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] 10.222.0.50 "GET /compute/v2.1/servers/cf602736-d01a-4673-a20b-ed1ae5750eea" status: 200 len: 1319 microversion: 2.1 time: 0.199198 Aug 31 16:08:33.042670 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1891/3615] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:32 2022] GET /compute/v2.1/servers/cf602736-d01a-4673-a20b-ed1ae5750eea => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:33.085746 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0832c9ec-7702-477c-8e05-c1bce53da55c tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:33.102422 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0832c9ec-7702-477c-8e05-c1bce53da55c tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:33.105640 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0832c9ec-7702-477c-8e05-c1bce53da55c tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:33.107222 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0832c9ec-7702-477c-8e05-c1bce53da55c tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1603 microversion: 2.32 time: 0.157027 Aug 31 16:08:33.108309 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1725/3616] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:08:32 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1603 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:08:33.128112 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1dd67300-ca92-4e9c-b216-a78119c766f6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:33.128943 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1dd67300-ca92-4e9c-b216-a78119c766f6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:33.135671 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1dd67300-ca92-4e9c-b216-a78119c766f6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:33.136415 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1dd67300-ca92-4e9c-b216-a78119c766f6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:33.136989 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1dd67300-ca92-4e9c-b216-a78119c766f6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:33.137829 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1dd67300-ca92-4e9c-b216-a78119c766f6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:33.138449 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1dd67300-ca92-4e9c-b216-a78119c766f6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:33.139008 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1dd67300-ca92-4e9c-b216-a78119c766f6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:33.195023 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2a014f15-e920-427a-bb04-5f99d3b8b7dc tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:33.196051 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2a014f15-e920-427a-bb04-5f99d3b8b7dc tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:33.203998 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a014f15-e920-427a-bb04-5f99d3b8b7dc tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:33.205018 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a014f15-e920-427a-bb04-5f99d3b8b7dc tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:33.205864 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a014f15-e920-427a-bb04-5f99d3b8b7dc tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:33.206847 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a014f15-e920-427a-bb04-5f99d3b8b7dc tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:33.207474 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a014f15-e920-427a-bb04-5f99d3b8b7dc tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:33.208289 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2a014f15-e920-427a-bb04-5f99d3b8b7dc tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:33.320172 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2a014f15-e920-427a-bb04-5f99d3b8b7dc tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:33.331496 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2a014f15-e920-427a-bb04-5f99d3b8b7dc tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2" status: 200 len: 1183 microversion: 2.1 time: 0.140238 Aug 31 16:08:33.342413 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1726/3617] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:33 2022] GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2 => generated 1183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:33.342413 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-746f2ef1-21c2-45f9-a7a4-69eed30608ef tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:33.342413 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-746f2ef1-21c2-45f9-a7a4-69eed30608ef tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:33.353125 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-746f2ef1-21c2-45f9-a7a4-69eed30608ef tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:33.353424 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-746f2ef1-21c2-45f9-a7a4-69eed30608ef tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:33.353873 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-746f2ef1-21c2-45f9-a7a4-69eed30608ef tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:33.354767 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-746f2ef1-21c2-45f9-a7a4-69eed30608ef tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:33.355053 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-746f2ef1-21c2-45f9-a7a4-69eed30608ef tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:33.355466 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-746f2ef1-21c2-45f9-a7a4-69eed30608ef tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:33.391960 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1dd67300-ca92-4e9c-b216-a78119c766f6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:33.401251 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1dd67300-ca92-4e9c-b216-a78119c766f6 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1671 microversion: 2.1 time: 0.277621 Aug 31 16:08:33.402042 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1892/3618] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:33 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1671 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:33.422285 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-da071fb2-fb55-4a14-b68d-4f553e433d86 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:33.422901 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-da071fb2-fb55-4a14-b68d-4f553e433d86 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:33.429545 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-da071fb2-fb55-4a14-b68d-4f553e433d86 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:33.430242 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-da071fb2-fb55-4a14-b68d-4f553e433d86 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:33.430827 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-da071fb2-fb55-4a14-b68d-4f553e433d86 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:33.431678 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-da071fb2-fb55-4a14-b68d-4f553e433d86 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:33.431794 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-746f2ef1-21c2-45f9-a7a4-69eed30608ef tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:33.432417 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-da071fb2-fb55-4a14-b68d-4f553e433d86 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:33.432987 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-da071fb2-fb55-4a14-b68d-4f553e433d86 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:33.448711 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-746f2ef1-21c2-45f9-a7a4-69eed30608ef tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:33.451357 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-746f2ef1-21c2-45f9-a7a4-69eed30608ef tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:33.453418 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-746f2ef1-21c2-45f9-a7a4-69eed30608ef tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 1874 microversion: 2.42 time: 0.119606 Aug 31 16:08:33.470205 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1727/3619] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:08:33 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 1874 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:08:33.635607 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-da071fb2-fb55-4a14-b68d-4f553e433d86 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:33.646676 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-da071fb2-fb55-4a14-b68d-4f553e433d86 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1671 microversion: 2.1 time: 0.228168 Aug 31 16:08:33.647562 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1893/3620] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:33 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1671 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:08:33.671850 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8702034b-71a4-42fe-b290-93c3f5e3cc12 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:33.672676 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8702034b-71a4-42fe-b290-93c3f5e3cc12 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:33.681932 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8702034b-71a4-42fe-b290-93c3f5e3cc12 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:33.682715 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8702034b-71a4-42fe-b290-93c3f5e3cc12 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:33.683284 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8702034b-71a4-42fe-b290-93c3f5e3cc12 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:33.684375 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8702034b-71a4-42fe-b290-93c3f5e3cc12 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:33.684938 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8702034b-71a4-42fe-b290-93c3f5e3cc12 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:33.685462 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8702034b-71a4-42fe-b290-93c3f5e3cc12 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:33.702923 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-27b77a8b-d974-4fbb-8fc7-fc4848e06b2c req-e4cfd423-4352-41f8-8fc5-8add101c382e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf602736-d01a-4673-a20b-ed1ae5750eea", "name": "network-vif-plugged", "status": "completed", "tag": "91efca61-e4a7-4cd3-9a23-3049abf1fa19"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:33.713833 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-27b77a8b-d974-4fbb-8fc7-fc4848e06b2c req-e4cfd423-4352-41f8-8fc5-8add101c382e service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:33.714693 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-27b77a8b-d974-4fbb-8fc7-fc4848e06b2c req-e4cfd423-4352-41f8-8fc5-8add101c382e service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:33.715523 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-27b77a8b-d974-4fbb-8fc7-fc4848e06b2c req-e4cfd423-4352-41f8-8fc5-8add101c382e service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:33.731172 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-27b77a8b-d974-4fbb-8fc7-fc4848e06b2c req-e4cfd423-4352-41f8-8fc5-8add101c382e service nova] Creating event network-vif-plugged:91efca61-e4a7-4cd3-9a23-3049abf1fa19 for instance cf602736-d01a-4673-a20b-ed1ae5750eea on n-h1-833090-16 Aug 31 16:08:33.738131 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-27b77a8b-d974-4fbb-8fc7-fc4848e06b2c req-e4cfd423-4352-41f8-8fc5-8add101c382e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039168 Aug 31 16:08:33.739903 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1894/3621] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:08:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:08:33.772714 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-69da0899-1f21-4694-8799-67f2021c32a9 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:33.773565 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-69da0899-1f21-4694-8799-67f2021c32a9 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] [instance: 5c81c9a3-8ba0-4573-a3e8-68292edc1ae2] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:33.781632 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69da0899-1f21-4694-8799-67f2021c32a9 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:33.782158 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69da0899-1f21-4694-8799-67f2021c32a9 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:33.783220 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69da0899-1f21-4694-8799-67f2021c32a9 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:33.784230 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69da0899-1f21-4694-8799-67f2021c32a9 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:33.784690 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69da0899-1f21-4694-8799-67f2021c32a9 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:33.785123 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69da0899-1f21-4694-8799-67f2021c32a9 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:34.075278 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8702034b-71a4-42fe-b290-93c3f5e3cc12 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:34.085049 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8702034b-71a4-42fe-b290-93c3f5e3cc12 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1671 microversion: 2.1 time: 0.416172 Aug 31 16:08:34.086161 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1728/3622] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:33 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1671 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:08:34.091057 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-876b3d04-0609-4b3d-a837-fd59367bf00f tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:34.091781 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-876b3d04-0609-4b3d-a837-fd59367bf00f tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] [instance: cf602736-d01a-4673-a20b-ed1ae5750eea] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:34.099252 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-876b3d04-0609-4b3d-a837-fd59367bf00f tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:34.100080 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-876b3d04-0609-4b3d-a837-fd59367bf00f tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:34.100880 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-876b3d04-0609-4b3d-a837-fd59367bf00f tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:34.101825 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-876b3d04-0609-4b3d-a837-fd59367bf00f tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:34.102543 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-876b3d04-0609-4b3d-a837-fd59367bf00f tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:34.104126 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-876b3d04-0609-4b3d-a837-fd59367bf00f tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:34.146862 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-69da0899-1f21-4694-8799-67f2021c32a9 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae96c057d884eafb9c2032dd5db9e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a33aeb63a416a9d046e2b67b93f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:34.155793 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-69da0899-1f21-4694-8799-67f2021c32a9 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/servers/5c81c9a3-8ba0-4573-a3e8-68292edc1ae2" status: 200 len: 1473 microversion: 2.1 time: 0.389251 Aug 31 16:08:34.158519 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1895/3623] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:33 2022] GET /compute/v2.1/servers/5c81c9a3-8ba0-4573-a3e8-68292edc1ae2 => generated 1473 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:34.179472 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b676d0f5-cd92-4a5b-be9a-ea38fc1640b8 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:34.180915 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b676d0f5-cd92-4a5b-be9a-ea38fc1640b8 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:34.187996 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b676d0f5-cd92-4a5b-be9a-ea38fc1640b8 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:34.189703 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b676d0f5-cd92-4a5b-be9a-ea38fc1640b8 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:34.193792 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b676d0f5-cd92-4a5b-be9a-ea38fc1640b8 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:34.194911 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b676d0f5-cd92-4a5b-be9a-ea38fc1640b8 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:34.195601 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b676d0f5-cd92-4a5b-be9a-ea38fc1640b8 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:34.196239 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b676d0f5-cd92-4a5b-be9a-ea38fc1640b8 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:34.487558 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-876b3d04-0609-4b3d-a837-fd59367bf00f tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4717b2fc0a654a77b40da565e599203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0154660c274106ab83ae50927348c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:34.499518 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-876b3d04-0609-4b3d-a837-fd59367bf00f tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] 10.222.0.50 "GET /compute/v2.1/servers/cf602736-d01a-4673-a20b-ed1ae5750eea" status: 200 len: 1319 microversion: 2.1 time: 0.412178 Aug 31 16:08:34.501357 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1729/3624] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:34 2022] GET /compute/v2.1/servers/cf602736-d01a-4673-a20b-ed1ae5750eea => generated 1319 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:34.508554 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-43d0387f-dd64-462e-a6dc-49736b4491e6 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:34.509709 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-43d0387f-dd64-462e-a6dc-49736b4491e6 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:34.521021 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b676d0f5-cd92-4a5b-be9a-ea38fc1640b8 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:34.536674 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43d0387f-dd64-462e-a6dc-49736b4491e6 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:34.540886 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43d0387f-dd64-462e-a6dc-49736b4491e6 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:34.541564 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43d0387f-dd64-462e-a6dc-49736b4491e6 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:34.542568 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43d0387f-dd64-462e-a6dc-49736b4491e6 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:34.543250 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43d0387f-dd64-462e-a6dc-49736b4491e6 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:34.543832 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43d0387f-dd64-462e-a6dc-49736b4491e6 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:34.543938 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b676d0f5-cd92-4a5b-be9a-ea38fc1640b8 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1671 microversion: 2.1 time: 0.369452 Aug 31 16:08:34.544737 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1896/3625] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:34 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1671 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:34.557736 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c5d19161-82be-4bfa-ae6a-44304cfd9209 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:34.558734 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c5d19161-82be-4bfa-ae6a-44304cfd9209 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:34.582485 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c5d19161-82be-4bfa-ae6a-44304cfd9209 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:34.583407 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c5d19161-82be-4bfa-ae6a-44304cfd9209 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:34.594014 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c5d19161-82be-4bfa-ae6a-44304cfd9209 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:34.596717 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c5d19161-82be-4bfa-ae6a-44304cfd9209 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:34.597202 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:08:34.598488 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c5d19161-82be-4bfa-ae6a-44304cfd9209 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:34.599717 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c5d19161-82be-4bfa-ae6a-44304cfd9209 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:34.817492 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-43d0387f-dd64-462e-a6dc-49736b4491e6 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:34.834931 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-43d0387f-dd64-462e-a6dc-49736b4491e6 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:34.840399 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-43d0387f-dd64-462e-a6dc-49736b4491e6 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:34.844538 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-43d0387f-dd64-462e-a6dc-49736b4491e6 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1603 microversion: 2.32 time: 0.341495 Aug 31 16:08:34.849860 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1730/3626] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:08:34 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1603 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:08:34.854281 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c5d19161-82be-4bfa-ae6a-44304cfd9209 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:34.859122 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8f8c5cae-b3d5-49c4-8827-3ef1e3893004 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:34.859834 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8f8c5cae-b3d5-49c4-8827-3ef1e3893004 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:34.875838 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f8c5cae-b3d5-49c4-8827-3ef1e3893004 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:34.876463 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f8c5cae-b3d5-49c4-8827-3ef1e3893004 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:34.879845 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c5d19161-82be-4bfa-ae6a-44304cfd9209 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2" status: 200 len: 1183 microversion: 2.1 time: 0.330323 Aug 31 16:08:34.882237 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1897/3627] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:34 2022] GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2 => generated 1183 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:34.885559 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f8c5cae-b3d5-49c4-8827-3ef1e3893004 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:34.886363 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f8c5cae-b3d5-49c4-8827-3ef1e3893004 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:34.886837 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f8c5cae-b3d5-49c4-8827-3ef1e3893004 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:34.887267 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f8c5cae-b3d5-49c4-8827-3ef1e3893004 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:34.895284 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-91d214a4-add8-4e70-a942-1b03e626844a tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:34.905319 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-91d214a4-add8-4e70-a942-1b03e626844a tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:34.925370 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91d214a4-add8-4e70-a942-1b03e626844a tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:34.926729 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91d214a4-add8-4e70-a942-1b03e626844a tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:34.929876 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91d214a4-add8-4e70-a942-1b03e626844a tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:34.932130 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91d214a4-add8-4e70-a942-1b03e626844a tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:34.934120 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91d214a4-add8-4e70-a942-1b03e626844a tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:34.934843 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91d214a4-add8-4e70-a942-1b03e626844a tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:34.978854 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8f8c5cae-b3d5-49c4-8827-3ef1e3893004 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:34.996533 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8f8c5cae-b3d5-49c4-8827-3ef1e3893004 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:34.998056 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8f8c5cae-b3d5-49c4-8827-3ef1e3893004 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:35.000429 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8f8c5cae-b3d5-49c4-8827-3ef1e3893004 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 1874 microversion: 2.42 time: 0.149148 Aug 31 16:08:35.005456 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1731/3628] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:08:34 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 1874 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:08:35.190526 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2ac9fedb-2e29-4a80-9466-87cc81c99620 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:35.190526 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2ac9fedb-2e29-4a80-9466-87cc81c99620 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] [instance: 5c81c9a3-8ba0-4573-a3e8-68292edc1ae2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:35.198657 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ac9fedb-2e29-4a80-9466-87cc81c99620 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:35.205280 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ac9fedb-2e29-4a80-9466-87cc81c99620 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:35.205861 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ac9fedb-2e29-4a80-9466-87cc81c99620 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:35.206727 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ac9fedb-2e29-4a80-9466-87cc81c99620 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:35.207195 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ac9fedb-2e29-4a80-9466-87cc81c99620 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:35.207623 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ac9fedb-2e29-4a80-9466-87cc81c99620 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:35.299987 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2ac9fedb-2e29-4a80-9466-87cc81c99620 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae96c057d884eafb9c2032dd5db9e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a33aeb63a416a9d046e2b67b93f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:35.310414 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2ac9fedb-2e29-4a80-9466-87cc81c99620 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/servers/5c81c9a3-8ba0-4573-a3e8-68292edc1ae2" status: 200 len: 1431 microversion: 2.1 time: 0.125240 Aug 31 16:08:35.325450 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1732/3629] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:35 2022] GET /compute/v2.1/servers/5c81c9a3-8ba0-4573-a3e8-68292edc1ae2 => generated 1431 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:35.340258 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-4bfe5067-2ba1-400b-a222-e144a8fc3fda req-ee6545f6-6721-4da5-8bd3-56204f152e39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c81c9a3-8ba0-4573-a3e8-68292edc1ae2", "name": "network-vif-deleted", "tag": "fe966be1-351a-44fb-bfbd-7233088e6030"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:35.356953 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4bfe5067-2ba1-400b-a222-e144a8fc3fda req-ee6545f6-6721-4da5-8bd3-56204f152e39 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:35.358413 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4bfe5067-2ba1-400b-a222-e144a8fc3fda req-ee6545f6-6721-4da5-8bd3-56204f152e39 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:35.359493 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4bfe5067-2ba1-400b-a222-e144a8fc3fda req-ee6545f6-6721-4da5-8bd3-56204f152e39 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:35.381691 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-4bfe5067-2ba1-400b-a222-e144a8fc3fda req-ee6545f6-6721-4da5-8bd3-56204f152e39 service nova] Creating event network-vif-deleted:fe966be1-351a-44fb-bfbd-7233088e6030 for instance 5c81c9a3-8ba0-4573-a3e8-68292edc1ae2 on n-h2-833090-16 Aug 31 16:08:35.387669 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-4bfe5067-2ba1-400b-a222-e144a8fc3fda req-ee6545f6-6721-4da5-8bd3-56204f152e39 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052617 Aug 31 16:08:35.388916 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1733/3630] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:35.442944 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-91d214a4-add8-4e70-a942-1b03e626844a tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:35.453242 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-91d214a4-add8-4e70-a942-1b03e626844a tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1671 microversion: 2.1 time: 0.569168 Aug 31 16:08:35.454601 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1898/3631] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:34 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1671 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:35.486399 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-362ca323-5bcf-47ca-b777-829b4d2cb8d0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:35.487045 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-362ca323-5bcf-47ca-b777-829b4d2cb8d0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:35.500995 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-362ca323-5bcf-47ca-b777-829b4d2cb8d0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:35.502523 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-362ca323-5bcf-47ca-b777-829b4d2cb8d0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:35.513882 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-362ca323-5bcf-47ca-b777-829b4d2cb8d0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:35.518493 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-362ca323-5bcf-47ca-b777-829b4d2cb8d0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:35.519078 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-362ca323-5bcf-47ca-b777-829b4d2cb8d0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:35.519533 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-362ca323-5bcf-47ca-b777-829b4d2cb8d0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:35.527432 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c5be3d4a-e432-46ba-abb2-9f8dbf512950 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:35.528254 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c5be3d4a-e432-46ba-abb2-9f8dbf512950 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] [instance: cf602736-d01a-4673-a20b-ed1ae5750eea] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:35.539230 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c5be3d4a-e432-46ba-abb2-9f8dbf512950 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:35.546683 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c5be3d4a-e432-46ba-abb2-9f8dbf512950 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:35.547331 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c5be3d4a-e432-46ba-abb2-9f8dbf512950 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:35.548219 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c5be3d4a-e432-46ba-abb2-9f8dbf512950 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:35.548788 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c5be3d4a-e432-46ba-abb2-9f8dbf512950 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:35.549426 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c5be3d4a-e432-46ba-abb2-9f8dbf512950 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:35.594519 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-362ca323-5bcf-47ca-b777-829b4d2cb8d0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lazy-loading 'flavor' on Instance uuid 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:08:35.786157 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-362ca323-5bcf-47ca-b777-829b4d2cb8d0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "POST /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b/action" status: 202 len: 0 microversion: 2.1 time: 0.308634 Aug 31 16:08:35.787446 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1734/3632] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:08:35 2022] POST /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b/action => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:08:35.806216 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c5be3d4a-e432-46ba-abb2-9f8dbf512950 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4717b2fc0a654a77b40da565e599203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0154660c274106ab83ae50927348c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:35.817234 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c5be3d4a-e432-46ba-abb2-9f8dbf512950 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] 10.222.0.50 "GET /compute/v2.1/servers/cf602736-d01a-4673-a20b-ed1ae5750eea" status: 200 len: 1506 microversion: 2.1 time: 0.294643 Aug 31 16:08:35.819937 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a91595b3-0416-45dd-9fe9-64c0a786b5cd tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:35.821250 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a91595b3-0416-45dd-9fe9-64c0a786b5cd tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:35.822502 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1899/3633] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:35 2022] GET /compute/v2.1/servers/cf602736-d01a-4673-a20b-ed1ae5750eea => generated 1506 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:35.836559 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a91595b3-0416-45dd-9fe9-64c0a786b5cd tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:35.837130 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a91595b3-0416-45dd-9fe9-64c0a786b5cd tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:35.837653 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a91595b3-0416-45dd-9fe9-64c0a786b5cd tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:35.838702 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a91595b3-0416-45dd-9fe9-64c0a786b5cd tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:35.839545 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a91595b3-0416-45dd-9fe9-64c0a786b5cd tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:35.839981 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a91595b3-0416-45dd-9fe9-64c0a786b5cd tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:35.842835 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e2c2b38f-b49b-4e05-8af6-a6b9733b63aa tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:35.843584 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e2c2b38f-b49b-4e05-8af6-a6b9733b63aa tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] [instance: 91f7f5e0-19f8-40ba-a692-2c2b6cb6a0be] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:35.851094 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e2c2b38f-b49b-4e05-8af6-a6b9733b63aa tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:35.851901 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e2c2b38f-b49b-4e05-8af6-a6b9733b63aa tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:35.852773 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e2c2b38f-b49b-4e05-8af6-a6b9733b63aa tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:35.853761 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e2c2b38f-b49b-4e05-8af6-a6b9733b63aa tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:35.854577 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e2c2b38f-b49b-4e05-8af6-a6b9733b63aa tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:35.855416 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e2c2b38f-b49b-4e05-8af6-a6b9733b63aa tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:36.193935 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e2c2b38f-b49b-4e05-8af6-a6b9733b63aa tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4717b2fc0a654a77b40da565e599203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0154660c274106ab83ae50927348c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:36.203374 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e2c2b38f-b49b-4e05-8af6-a6b9733b63aa tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] 10.222.0.50 "GET /compute/v2.1/servers/91f7f5e0-19f8-40ba-a692-2c2b6cb6a0be" status: 200 len: 1506 microversion: 2.1 time: 0.365247 Aug 31 16:08:36.208926 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1900/3634] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:35 2022] GET /compute/v2.1/servers/91f7f5e0-19f8-40ba-a692-2c2b6cb6a0be => generated 1506 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:36.216917 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a91595b3-0416-45dd-9fe9-64c0a786b5cd tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:36.231091 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f4dc3e44-8263-4213-864f-ad05aae4babf tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:36.232060 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f4dc3e44-8263-4213-864f-ad05aae4babf tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:36.237521 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a91595b3-0416-45dd-9fe9-64c0a786b5cd tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1679 microversion: 2.1 time: 0.436065 Aug 31 16:08:36.238141 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1735/3635] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:35 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1679 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:36.249350 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4bd2469b-43a3-4fe8-9c5d-afbe1fa3e505 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:36.255216 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f4dc3e44-8263-4213-864f-ad05aae4babf tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:36.260609 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f4dc3e44-8263-4213-864f-ad05aae4babf tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:36.264362 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f4dc3e44-8263-4213-864f-ad05aae4babf tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:36.264949 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4bd2469b-43a3-4fe8-9c5d-afbe1fa3e505 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:36.266493 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f4dc3e44-8263-4213-864f-ad05aae4babf tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:36.270323 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f4dc3e44-8263-4213-864f-ad05aae4babf tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:36.273085 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f4dc3e44-8263-4213-864f-ad05aae4babf tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:36.286286 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4bd2469b-43a3-4fe8-9c5d-afbe1fa3e505 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:36.287467 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4bd2469b-43a3-4fe8-9c5d-afbe1fa3e505 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:36.288520 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4bd2469b-43a3-4fe8-9c5d-afbe1fa3e505 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:36.289930 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4bd2469b-43a3-4fe8-9c5d-afbe1fa3e505 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:36.290838 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4bd2469b-43a3-4fe8-9c5d-afbe1fa3e505 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:36.292937 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4bd2469b-43a3-4fe8-9c5d-afbe1fa3e505 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:36.395789 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4bd2469b-43a3-4fe8-9c5d-afbe1fa3e505 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:36.405312 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4bd2469b-43a3-4fe8-9c5d-afbe1fa3e505 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2" status: 200 len: 1183 microversion: 2.1 time: 0.159716 Aug 31 16:08:36.406247 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1736/3636] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:36 2022] GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2 => generated 1183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:36.424195 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8f8e7a31-aeff-49a6-a5bb-e5ba28e05101 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:36.424821 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8f8e7a31-aeff-49a6-a5bb-e5ba28e05101 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:36.431375 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f8e7a31-aeff-49a6-a5bb-e5ba28e05101 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:36.432619 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f8e7a31-aeff-49a6-a5bb-e5ba28e05101 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:36.432619 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f8e7a31-aeff-49a6-a5bb-e5ba28e05101 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:36.433446 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f8e7a31-aeff-49a6-a5bb-e5ba28e05101 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:36.433821 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f8e7a31-aeff-49a6-a5bb-e5ba28e05101 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:36.434005 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f8e7a31-aeff-49a6-a5bb-e5ba28e05101 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:36.440952 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f4dc3e44-8263-4213-864f-ad05aae4babf tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:36.443353 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:08:36.453077 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f4dc3e44-8263-4213-864f-ad05aae4babf tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:36.455717 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f4dc3e44-8263-4213-864f-ad05aae4babf tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:36.457778 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f4dc3e44-8263-4213-864f-ad05aae4babf tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1603 microversion: 2.32 time: 0.247648 Aug 31 16:08:36.458898 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1901/3637] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:08:36 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1603 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:08:36.463915 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-bf0841bc-4549-47c5-bffd-c3b9edc6c531 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:36.464584 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-bf0841bc-4549-47c5-bffd-c3b9edc6c531 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] [instance: 91f7f5e0-19f8-40ba-a692-2c2b6cb6a0be] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:36.471276 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bf0841bc-4549-47c5-bffd-c3b9edc6c531 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:36.472001 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bf0841bc-4549-47c5-bffd-c3b9edc6c531 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:36.472586 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bf0841bc-4549-47c5-bffd-c3b9edc6c531 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:36.473476 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bf0841bc-4549-47c5-bffd-c3b9edc6c531 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:36.474078 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bf0841bc-4549-47c5-bffd-c3b9edc6c531 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:36.474704 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bf0841bc-4549-47c5-bffd-c3b9edc6c531 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:36.520567 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-bf0841bc-4549-47c5-bffd-c3b9edc6c531 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] [instance: 91f7f5e0-19f8-40ba-a692-2c2b6cb6a0be] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:08:36.596457 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8f8e7a31-aeff-49a6-a5bb-e5ba28e05101 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:36.617468 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8f8e7a31-aeff-49a6-a5bb-e5ba28e05101 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:36.620884 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8f8e7a31-aeff-49a6-a5bb-e5ba28e05101 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:36.623989 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8f8e7a31-aeff-49a6-a5bb-e5ba28e05101 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 1874 microversion: 2.42 time: 0.204150 Aug 31 16:08:36.626528 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1737/3638] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:08:36 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 1874 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:08:36.637412 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-92c2bffd-d8b9-4d1f-9a5d-27ffb1d3fc0d tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:36.639638 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-92c2bffd-d8b9-4d1f-9a5d-27ffb1d3fc0d tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] [instance: 5c81c9a3-8ba0-4573-a3e8-68292edc1ae2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:36.653920 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92c2bffd-d8b9-4d1f-9a5d-27ffb1d3fc0d tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:36.655069 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92c2bffd-d8b9-4d1f-9a5d-27ffb1d3fc0d tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:36.656167 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92c2bffd-d8b9-4d1f-9a5d-27ffb1d3fc0d tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:36.660613 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92c2bffd-d8b9-4d1f-9a5d-27ffb1d3fc0d tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:36.662397 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92c2bffd-d8b9-4d1f-9a5d-27ffb1d3fc0d tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:36.663009 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92c2bffd-d8b9-4d1f-9a5d-27ffb1d3fc0d tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:36.703428 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-92c2bffd-d8b9-4d1f-9a5d-27ffb1d3fc0d tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] HTTP exception thrown: Instance 5c81c9a3-8ba0-4573-a3e8-68292edc1ae2 could not be found. Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-92c2bffd-d8b9-4d1f-9a5d-27ffb1d3fc0d tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Request method failure captured: Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/5c81c9a3-8ba0-4573-a3e8-68292edc1ae2 HTTP/1.1 Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4a8xQaTw-l8IP581KUlzjc60BVOx7JT6NuYXnq_JeSoCmBgxPGJVvs_Zo745_i8cqVLtle2uEsh4CXsVPL01yNCiv7S-_07ChuRBNdVVEAFVzzNAn22Kda79PiLJ8ylEH53mgDlP876igpuHdLvUtsm2WV0DYrKT6wyGNBG8-lFJnk Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 5d1a33aeb63a416a9d046e2b67b93f30 Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ListImageFiltersTestJSON-1338441779 Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5d1a33aeb63a416a9d046e2b67b93f30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5d1a33aeb63a416a9d046e2b67b93f30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5d1a33aeb63a416a9d046e2b67b93f30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5d1a33aeb63a416a9d046e2b67b93f30", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ListImageFiltersTestJSON-1338441779 Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 5d1a33aeb63a416a9d046e2b67b93f30 Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1338441779 Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ListImageFiltersTestJSON-1338441779-project Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: fae96c057d884eafb9c2032dd5db9e2e Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ListImageFiltersTestJSON-1338441779-project Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 5c81c9a3-8ba0-4573-a3e8-68292edc1ae2 could not be found. Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '5c81c9a3-8ba0-4573-a3e8-68292edc1ae2'} Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c81c9a3-8ba0-4573-a3e8-68292edc1ae2 could not be found. Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c81c9a3-8ba0-4573-a3e8-68292edc1ae2 could not be found. Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:08:36.709707 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:08:36.714808 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:36.714808 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:08:36.714808 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:08:36.714808 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:08:36.714808 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:08:36.714808 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c81c9a3-8ba0-4573-a3e8-68292edc1ae2 could not be found. Aug 31 16:08:36.714808 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:08:36.718442 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-92c2bffd-d8b9-4d1f-9a5d-27ffb1d3fc0d tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Returning 404 to user: Instance 5c81c9a3-8ba0-4573-a3e8-68292edc1ae2 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:08:36.719492 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-92c2bffd-d8b9-4d1f-9a5d-27ffb1d3fc0d tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/servers/5c81c9a3-8ba0-4573-a3e8-68292edc1ae2" status: 404 len: 111 microversion: 2.1 time: 0.090549 Aug 31 16:08:36.725241 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1738/3639] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:36 2022] GET /compute/v2.1/servers/5c81c9a3-8ba0-4573-a3e8-68292edc1ae2 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:08:36.736339 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-bf0841bc-4549-47c5-bffd-c3b9edc6c531 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] 10.222.0.50 "DELETE /compute/v2.1/servers/91f7f5e0-19f8-40ba-a692-2c2b6cb6a0be" status: 204 len: 0 microversion: 2.1 time: 0.276031 Aug 31 16:08:36.737823 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1902/3640] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:08:36 2022] DELETE /compute/v2.1/servers/91f7f5e0-19f8-40ba-a692-2c2b6cb6a0be => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:08:36.740302 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9ea5ad4b-d17a-4b88-8e5b-a4bb7b266477 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:36.740958 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9ea5ad4b-d17a-4b88-8e5b-a4bb7b266477 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] [instance: d3255935-3cff-4bb0-aad2-a8f401028a59] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:36.749602 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9ea5ad4b-d17a-4b88-8e5b-a4bb7b266477 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:36.750445 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9ea5ad4b-d17a-4b88-8e5b-a4bb7b266477 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:36.751012 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9ea5ad4b-d17a-4b88-8e5b-a4bb7b266477 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:36.752020 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9ea5ad4b-d17a-4b88-8e5b-a4bb7b266477 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:36.752847 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9ea5ad4b-d17a-4b88-8e5b-a4bb7b266477 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:36.753672 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9ea5ad4b-d17a-4b88-8e5b-a4bb7b266477 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:36.759353 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3b9b6a82-710b-4b08-bf38-b5aa0ff2ebe1 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:36.760240 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3b9b6a82-710b-4b08-bf38-b5aa0ff2ebe1 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] [instance: cf602736-d01a-4673-a20b-ed1ae5750eea] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:36.774517 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3b9b6a82-710b-4b08-bf38-b5aa0ff2ebe1 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:36.775303 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3b9b6a82-710b-4b08-bf38-b5aa0ff2ebe1 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:36.777155 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3b9b6a82-710b-4b08-bf38-b5aa0ff2ebe1 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:36.777896 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3b9b6a82-710b-4b08-bf38-b5aa0ff2ebe1 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:36.778440 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3b9b6a82-710b-4b08-bf38-b5aa0ff2ebe1 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:36.778869 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3b9b6a82-710b-4b08-bf38-b5aa0ff2ebe1 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:36.785660 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9ea5ad4b-d17a-4b88-8e5b-a4bb7b266477 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] [instance: d3255935-3cff-4bb0-aad2-a8f401028a59] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:08:36.825401 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3b9b6a82-710b-4b08-bf38-b5aa0ff2ebe1 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] [instance: cf602736-d01a-4673-a20b-ed1ae5750eea] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:08:36.902828 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9ea5ad4b-d17a-4b88-8e5b-a4bb7b266477 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d3255935-3cff-4bb0-aad2-a8f401028a59" status: 204 len: 0 microversion: 2.1 time: 0.173282 Aug 31 16:08:36.904856 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1739/3641] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:08:36 2022] DELETE /compute/v2.1/servers/d3255935-3cff-4bb0-aad2-a8f401028a59 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:08:36.914462 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a435aa7e-b4a1-41ad-ad0b-02e41f7b763a tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:36.915327 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a435aa7e-b4a1-41ad-ad0b-02e41f7b763a tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] [instance: d3255935-3cff-4bb0-aad2-a8f401028a59] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:36.922261 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a435aa7e-b4a1-41ad-ad0b-02e41f7b763a tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:36.922772 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a435aa7e-b4a1-41ad-ad0b-02e41f7b763a tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:36.923359 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a435aa7e-b4a1-41ad-ad0b-02e41f7b763a tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:36.924228 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a435aa7e-b4a1-41ad-ad0b-02e41f7b763a tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:36.924745 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a435aa7e-b4a1-41ad-ad0b-02e41f7b763a tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:36.925241 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a435aa7e-b4a1-41ad-ad0b-02e41f7b763a tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:36.968563 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3b9b6a82-710b-4b08-bf38-b5aa0ff2ebe1 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] 10.222.0.50 "DELETE /compute/v2.1/servers/cf602736-d01a-4673-a20b-ed1ae5750eea" status: 204 len: 0 microversion: 2.1 time: 0.224084 Aug 31 16:08:36.978652 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1903/3642] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:08:36 2022] DELETE /compute/v2.1/servers/cf602736-d01a-4673-a20b-ed1ae5750eea => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:08:37.206194 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-aa3cb7c8-528a-4655-aaa7-5b0e81af49c1 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-67207596", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "a9df689d-6779-4cd2-8efc-f8ab63a90582"}]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:37.213885 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a435aa7e-b4a1-41ad-ad0b-02e41f7b763a tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae96c057d884eafb9c2032dd5db9e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a33aeb63a416a9d046e2b67b93f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:37.226269 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a435aa7e-b4a1-41ad-ad0b-02e41f7b763a tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/servers/d3255935-3cff-4bb0-aad2-a8f401028a59" status: 200 len: 1473 microversion: 2.1 time: 0.316082 Aug 31 16:08:37.227236 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1740/3643] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:36 2022] GET /compute/v2.1/servers/d3255935-3cff-4bb0-aad2-a8f401028a59 => generated 1473 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:37.271383 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e87196c7-543f-47b9-8482-f1f92d174305 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:37.272164 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e87196c7-543f-47b9-8482-f1f92d174305 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:37.295373 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e87196c7-543f-47b9-8482-f1f92d174305 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:37.299153 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e87196c7-543f-47b9-8482-f1f92d174305 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:37.300767 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e87196c7-543f-47b9-8482-f1f92d174305 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:37.302595 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e87196c7-543f-47b9-8482-f1f92d174305 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:37.303321 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e87196c7-543f-47b9-8482-f1f92d174305 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:37.304717 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e87196c7-543f-47b9-8482-f1f92d174305 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:37.331098 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-aa3cb7c8-528a-4655-aaa7-5b0e81af49c1 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] validate_networks() for [('a9df689d-6779-4cd2-8efc-f8ab63a90582', None, None, None, None, None)] {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:08:37.798314 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e87196c7-543f-47b9-8482-f1f92d174305 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:37.809842 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e87196c7-543f-47b9-8482-f1f92d174305 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1662 microversion: 2.1 time: 0.544094 Aug 31 16:08:37.823899 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1741/3644] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:37 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1662 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:37.838290 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0efbe2bd-9a57-4c14-a2f7-aa86b2d53fa6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:37.839927 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0efbe2bd-9a57-4c14-a2f7-aa86b2d53fa6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:37.848498 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0efbe2bd-9a57-4c14-a2f7-aa86b2d53fa6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:37.849201 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0efbe2bd-9a57-4c14-a2f7-aa86b2d53fa6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:37.849784 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0efbe2bd-9a57-4c14-a2f7-aa86b2d53fa6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:37.850694 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0efbe2bd-9a57-4c14-a2f7-aa86b2d53fa6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:37.851333 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0efbe2bd-9a57-4c14-a2f7-aa86b2d53fa6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:37.851910 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0efbe2bd-9a57-4c14-a2f7-aa86b2d53fa6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:37.909700 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0efbe2bd-9a57-4c14-a2f7-aa86b2d53fa6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:37.910411 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0efbe2bd-9a57-4c14-a2f7-aa86b2d53fa6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:37.911083 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0efbe2bd-9a57-4c14-a2f7-aa86b2d53fa6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:37.911807 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-0efbe2bd-9a57-4c14-a2f7-aa86b2d53fa6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lazy-loading 'fault' on Instance uuid 4729162e-f8a9-4952-a3e0-be75936208f2 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:08:38.089423 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0efbe2bd-9a57-4c14-a2f7-aa86b2d53fa6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:38.098250 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0efbe2bd-9a57-4c14-a2f7-aa86b2d53fa6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2" status: 200 len: 1188 microversion: 2.1 time: 0.272700 Aug 31 16:08:38.099504 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1742/3645] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:37 2022] GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2 => generated 1188 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:38.104660 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d66d521c-3753-459f-ba79-353014a70e1f tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:38.107299 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d66d521c-3753-459f-ba79-353014a70e1f tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:38.125558 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d66d521c-3753-459f-ba79-353014a70e1f tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:38.126393 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d66d521c-3753-459f-ba79-353014a70e1f tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:38.126970 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d66d521c-3753-459f-ba79-353014a70e1f tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:38.127924 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d66d521c-3753-459f-ba79-353014a70e1f tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:38.128530 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d66d521c-3753-459f-ba79-353014a70e1f tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:38.129097 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d66d521c-3753-459f-ba79-353014a70e1f tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:38.232815 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-aa3cb7c8-528a-4655-aaa7-5b0e81af49c1 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:08:38.233966 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-aa3cb7c8-528a-4655-aaa7-5b0e81af49c1 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:08:38.234677 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-aa3cb7c8-528a-4655-aaa7-5b0e81af49c1 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:08:38.235501 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-aa3cb7c8-528a-4655-aaa7-5b0e81af49c1 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:08:38.236772 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-aa3cb7c8-528a-4655-aaa7-5b0e81af49c1 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:08:38.244270 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d66d521c-3753-459f-ba79-353014a70e1f tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:38.264755 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aa3cb7c8-528a-4655-aaa7-5b0e81af49c1 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:38.265840 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aa3cb7c8-528a-4655-aaa7-5b0e81af49c1 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:38.266491 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aa3cb7c8-528a-4655-aaa7-5b0e81af49c1 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:38.268310 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aa3cb7c8-528a-4655-aaa7-5b0e81af49c1 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:38.269224 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aa3cb7c8-528a-4655-aaa7-5b0e81af49c1 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:38.270659 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aa3cb7c8-528a-4655-aaa7-5b0e81af49c1 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:38.272310 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d66d521c-3753-459f-ba79-353014a70e1f tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:38.281351 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d66d521c-3753-459f-ba79-353014a70e1f tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:38.282852 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d66d521c-3753-459f-ba79-353014a70e1f tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1603 microversion: 2.32 time: 0.182008 Aug 31 16:08:38.283350 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1743/3646] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:08:38 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1603 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:08:38.299753 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f71de551-d9c9-4cc5-bf6c-490024ccffa6 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:38.300917 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-aa3cb7c8-528a-4655-aaa7-5b0e81af49c1 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Getting quotas for project 1c0154660c274106ab83ae50927348c8. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:08:38.301106 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f71de551-d9c9-4cc5-bf6c-490024ccffa6 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:38.310903 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-aa3cb7c8-528a-4655-aaa7-5b0e81af49c1 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Getting quotas for user 4717b2fc0a654a77b40da565e599203f and project 1c0154660c274106ab83ae50927348c8. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:08:38.320073 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f71de551-d9c9-4cc5-bf6c-490024ccffa6 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:38.321874 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f71de551-d9c9-4cc5-bf6c-490024ccffa6 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:38.322360 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f71de551-d9c9-4cc5-bf6c-490024ccffa6 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:38.325998 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f71de551-d9c9-4cc5-bf6c-490024ccffa6 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:38.326730 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f71de551-d9c9-4cc5-bf6c-490024ccffa6 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:38.327480 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f71de551-d9c9-4cc5-bf6c-490024ccffa6 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:38.335556 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-aa3cb7c8-528a-4655-aaa7-5b0e81af49c1 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Going to run 2 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:08:38.341120 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-aa3cb7c8-528a-4655-aaa7-5b0e81af49c1 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] [instance: ad0b8fd6-eec9-42fe-91af-a7904d758c93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:08:38.377693 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:08:38.390281 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-aa3cb7c8-528a-4655-aaa7-5b0e81af49c1 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] [instance: 1dc405fa-b1a4-4acc-8236-06a24e979f5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=ad0b8fd6-eec9-42fe-91af-a7904d758c93,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:08:38.409582 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f71de551-d9c9-4cc5-bf6c-490024ccffa6 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:38.410074 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f71de551-d9c9-4cc5-bf6c-490024ccffa6 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:38.410535 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f71de551-d9c9-4cc5-bf6c-490024ccffa6 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:38.411211 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-f71de551-d9c9-4cc5-bf6c-490024ccffa6 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lazy-loading 'fault' on Instance uuid 0e89e500-ddc5-4549-8631-9d62545016d1 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:08:38.471302 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-aa3cb7c8-528a-4655-aaa7-5b0e81af49c1 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.270898 Aug 31 16:08:38.472299 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1904/3647] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:08:37 2022] POST /compute/v2.1/servers => generated 32 bytes in 1276 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Aug 31 16:08:38.483203 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-477536f0-8294-482a-a35d-99d578fdba2f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:38.485158 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-477536f0-8294-482a-a35d-99d578fdba2f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:38.505543 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-477536f0-8294-482a-a35d-99d578fdba2f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:38.507725 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-477536f0-8294-482a-a35d-99d578fdba2f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:38.509439 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-477536f0-8294-482a-a35d-99d578fdba2f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:38.510712 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-477536f0-8294-482a-a35d-99d578fdba2f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:38.511388 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-477536f0-8294-482a-a35d-99d578fdba2f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:38.512020 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-477536f0-8294-482a-a35d-99d578fdba2f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:38.538294 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f71de551-d9c9-4cc5-bf6c-490024ccffa6 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:38.554605 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f71de551-d9c9-4cc5-bf6c-490024ccffa6 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:38.556159 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f71de551-d9c9-4cc5-bf6c-490024ccffa6 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:38.559652 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f71de551-d9c9-4cc5-bf6c-490024ccffa6 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 1879 microversion: 2.42 time: 0.275340 Aug 31 16:08:38.560235 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1744/3648] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:08:38 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 1879 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:08:38.576544 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8fe76791-2f2d-403d-a2cb-1c498f334551 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:38.577162 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8fe76791-2f2d-403d-a2cb-1c498f334551 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] [instance: d3255935-3cff-4bb0-aad2-a8f401028a59] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:38.585759 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8fe76791-2f2d-403d-a2cb-1c498f334551 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:38.593829 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8fe76791-2f2d-403d-a2cb-1c498f334551 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:38.594455 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8fe76791-2f2d-403d-a2cb-1c498f334551 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:38.595395 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8fe76791-2f2d-403d-a2cb-1c498f334551 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:38.596331 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8fe76791-2f2d-403d-a2cb-1c498f334551 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:38.597294 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8fe76791-2f2d-403d-a2cb-1c498f334551 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:38.642541 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-477536f0-8294-482a-a35d-99d578fdba2f tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "POST /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b/action" status: 202 len: 0 microversion: 2.1 time: 0.165395 Aug 31 16:08:38.647479 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1905/3649] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:08:38 2022] POST /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:08:38.667508 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c0440bef-0f39-4456-b952-da652d4634e7 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:38.684445 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c0440bef-0f39-4456-b952-da652d4634e7 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4717b2fc0a654a77b40da565e599203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0154660c274106ab83ae50927348c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:38.685493 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c0440bef-0f39-4456-b952-da652d4634e7 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Searching by: {'deleted': False, 'project_id': '1c0154660c274106ab83ae50927348c8'} {{(pid=128864) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:08:38.723469 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c0440bef-0f39-4456-b952-da652d4634e7 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:38.724251 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c0440bef-0f39-4456-b952-da652d4634e7 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:38.724845 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c0440bef-0f39-4456-b952-da652d4634e7 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:38.725876 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c0440bef-0f39-4456-b952-da652d4634e7 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:38.726650 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c0440bef-0f39-4456-b952-da652d4634e7 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:38.727176 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c0440bef-0f39-4456-b952-da652d4634e7 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:38.925452 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.multi_cell_list [None req-c0440bef-0f39-4456-b952-da652d4634e7 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=128864) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:08:39.129599 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c0440bef-0f39-4456-b952-da652d4634e7 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 1331 microversion: 2.1 time: 0.478499 Aug 31 16:08:39.137654 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1906/3650] 10.222.0.50 () {58 vars in 1125 bytes} [Wed Aug 31 16:08:38 2022] GET /compute/v2.1/servers => generated 1331 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:39.142024 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c5b5cd03-96ed-4eb6-967c-4064ef885242 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:39.143113 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c5b5cd03-96ed-4eb6-967c-4064ef885242 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:39.161287 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c5b5cd03-96ed-4eb6-967c-4064ef885242 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:39.161783 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c5b5cd03-96ed-4eb6-967c-4064ef885242 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:39.162276 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c5b5cd03-96ed-4eb6-967c-4064ef885242 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:39.163047 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c5b5cd03-96ed-4eb6-967c-4064ef885242 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:39.163491 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c5b5cd03-96ed-4eb6-967c-4064ef885242 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:39.163835 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c5b5cd03-96ed-4eb6-967c-4064ef885242 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:39.841417 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8fe76791-2f2d-403d-a2cb-1c498f334551 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae96c057d884eafb9c2032dd5db9e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a33aeb63a416a9d046e2b67b93f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:39.873626 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8fe76791-2f2d-403d-a2cb-1c498f334551 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/servers/d3255935-3cff-4bb0-aad2-a8f401028a59" status: 200 len: 1473 microversion: 2.1 time: 1.312261 Aug 31 16:08:39.876596 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1745/3651] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:38 2022] GET /compute/v2.1/servers/d3255935-3cff-4bb0-aad2-a8f401028a59 => generated 1473 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:39.900953 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e549bfd1-2d1f-4466-9905-083b23bc610b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:39.902461 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e549bfd1-2d1f-4466-9905-083b23bc610b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 4729162e-f8a9-4952-a3e0-be75936208f2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:39.926281 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e549bfd1-2d1f-4466-9905-083b23bc610b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:39.930590 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e549bfd1-2d1f-4466-9905-083b23bc610b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:39.931537 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e549bfd1-2d1f-4466-9905-083b23bc610b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:39.934900 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e549bfd1-2d1f-4466-9905-083b23bc610b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:39.935732 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e549bfd1-2d1f-4466-9905-083b23bc610b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:39.940935 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e549bfd1-2d1f-4466-9905-083b23bc610b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:39.994956 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-e549bfd1-2d1f-4466-9905-083b23bc610b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] HTTP exception thrown: Instance 4729162e-f8a9-4952-a3e0-be75936208f2 could not be found. Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e549bfd1-2d1f-4466-9905-083b23bc610b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Request method failure captured: Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2 HTTP/1.1 Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4WKvsbO08EL2S91UDZkibdodc8Ncpnx96A_z7G6JzDTVReVRJt4eaxqEagrCjiIt0sQK9L2XFjpe1FXBkALlUJ8tsVxARkQX1aQaJHXvorlxZYJqMjBiHR2B48FsHGsA1J11nYBrZ1wp73HofSCco1Rnc1vXSjVfKEu_sBy_NCjrg0 Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 1355779c2e2d4cfeb0825b76968867b1 Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-LiveMigrationTest-299357202 Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1355779c2e2d4cfeb0825b76968867b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1355779c2e2d4cfeb0825b76968867b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/1355779c2e2d4cfeb0825b76968867b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_1355779c2e2d4cfeb0825b76968867b1", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-LiveMigrationTest-299357202 Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 1355779c2e2d4cfeb0825b76968867b1 Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-LiveMigrationTest-299357202 Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-LiveMigrationTest-299357202-project Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: b9840c71c4ec49c1a60ef97943d173ef Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-LiveMigrationTest-299357202-project Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 4729162e-f8a9-4952-a3e0-be75936208f2 could not be found. Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '4729162e-f8a9-4952-a3e0-be75936208f2'} Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4729162e-f8a9-4952-a3e0-be75936208f2 could not be found. Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4729162e-f8a9-4952-a3e0-be75936208f2 could not be found. Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:08:40.003886 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:08:40.008073 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:40.008073 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:08:40.008073 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:08:40.008073 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:08:40.008073 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:08:40.008073 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4729162e-f8a9-4952-a3e0-be75936208f2 could not be found. Aug 31 16:08:40.008073 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:08:40.011607 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e549bfd1-2d1f-4466-9905-083b23bc610b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Returning 404 to user: Instance 4729162e-f8a9-4952-a3e0-be75936208f2 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:08:40.013400 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e549bfd1-2d1f-4466-9905-083b23bc610b tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2" status: 404 len: 111 microversion: 2.1 time: 0.132813 Aug 31 16:08:40.016161 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1746/3652] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:39 2022] GET /compute/v2.1/servers/4729162e-f8a9-4952-a3e0-be75936208f2 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:08:40.043173 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-21a8c02e-ccaf-41f8-b466-9f7abc1a0092 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:40.046716 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-21a8c02e-ccaf-41f8-b466-9f7abc1a0092 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] [instance: 1dc405fa-b1a4-4acc-8236-06a24e979f5e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:40.064950 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-21a8c02e-ccaf-41f8-b466-9f7abc1a0092 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:40.066124 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-21a8c02e-ccaf-41f8-b466-9f7abc1a0092 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:40.070255 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-21a8c02e-ccaf-41f8-b466-9f7abc1a0092 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:40.073044 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-21a8c02e-ccaf-41f8-b466-9f7abc1a0092 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:40.075961 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-21a8c02e-ccaf-41f8-b466-9f7abc1a0092 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:40.078237 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c5b5cd03-96ed-4eb6-967c-4064ef885242 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:40.079064 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-21a8c02e-ccaf-41f8-b466-9f7abc1a0092 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:40.127010 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c5b5cd03-96ed-4eb6-967c-4064ef885242 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1668 microversion: 2.1 time: 0.977426 Aug 31 16:08:40.130401 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1907/3653] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:39 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1668 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:40.161158 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-671ecda0-6b98-4593-93c2-707517275384 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:40.162696 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-671ecda0-6b98-4593-93c2-707517275384 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:40.220113 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-671ecda0-6b98-4593-93c2-707517275384 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:40.221820 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-671ecda0-6b98-4593-93c2-707517275384 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:40.223842 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-671ecda0-6b98-4593-93c2-707517275384 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:40.225363 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-671ecda0-6b98-4593-93c2-707517275384 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:40.226534 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-671ecda0-6b98-4593-93c2-707517275384 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:40.227395 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-671ecda0-6b98-4593-93c2-707517275384 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:40.365883 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-21a8c02e-ccaf-41f8-b466-9f7abc1a0092 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4717b2fc0a654a77b40da565e599203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0154660c274106ab83ae50927348c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:40.389960 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-21a8c02e-ccaf-41f8-b466-9f7abc1a0092 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] 10.222.0.50 "GET /compute/v2.1/servers/1dc405fa-b1a4-4acc-8236-06a24e979f5e" status: 200 len: 1212 microversion: 2.1 time: 0.363643 Aug 31 16:08:40.392319 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1747/3654] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:40 2022] GET /compute/v2.1/servers/1dc405fa-b1a4-4acc-8236-06a24e979f5e => generated 1212 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:40.414211 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dd8ccbfb-c257-4f16-8e66-f4d9cfd5ac21 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:40.419412 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dd8ccbfb-c257-4f16-8e66-f4d9cfd5ac21 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:40.447648 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd8ccbfb-c257-4f16-8e66-f4d9cfd5ac21 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:40.449212 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd8ccbfb-c257-4f16-8e66-f4d9cfd5ac21 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:40.450265 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd8ccbfb-c257-4f16-8e66-f4d9cfd5ac21 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:40.451653 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd8ccbfb-c257-4f16-8e66-f4d9cfd5ac21 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:40.452655 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd8ccbfb-c257-4f16-8e66-f4d9cfd5ac21 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:40.453677 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd8ccbfb-c257-4f16-8e66-f4d9cfd5ac21 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:40.573976 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd8ccbfb-c257-4f16-8e66-f4d9cfd5ac21 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:40.574773 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd8ccbfb-c257-4f16-8e66-f4d9cfd5ac21 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:40.575364 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd8ccbfb-c257-4f16-8e66-f4d9cfd5ac21 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:40.576114 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-dd8ccbfb-c257-4f16-8e66-f4d9cfd5ac21 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lazy-loading 'fault' on Instance uuid 0e89e500-ddc5-4549-8631-9d62545016d1 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:08:41.351697 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-671ecda0-6b98-4593-93c2-707517275384 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:41.381287 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-671ecda0-6b98-4593-93c2-707517275384 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:41.387570 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-671ecda0-6b98-4593-93c2-707517275384 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:41.387849 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dd8ccbfb-c257-4f16-8e66-f4d9cfd5ac21 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:41.391636 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-671ecda0-6b98-4593-93c2-707517275384 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1603 microversion: 2.32 time: 1.250639 Aug 31 16:08:41.396047 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1908/3655] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:08:40 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1603 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:08:41.398765 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dd8ccbfb-c257-4f16-8e66-f4d9cfd5ac21 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:41.404534 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dd8ccbfb-c257-4f16-8e66-f4d9cfd5ac21 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9f728562f4d66b8039435235c655c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550e3f42bfe4992aee45af34476da97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:41.408300 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dd8ccbfb-c257-4f16-8e66-f4d9cfd5ac21 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 200 len: 1641 microversion: 2.42 time: 1.014045 Aug 31 16:08:41.408805 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f83f6259-3af8-4adc-a00b-45c0926803a5 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:41.411664 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f83f6259-3af8-4adc-a00b-45c0926803a5 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] [instance: d3255935-3cff-4bb0-aad2-a8f401028a59] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:41.412929 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1748/3656] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:08:40 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 1641 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:08:41.430828 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3f97b379-53ef-40ae-8ebe-eddb15756679 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:41.431951 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3f97b379-53ef-40ae-8ebe-eddb15756679 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:41.445078 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f83f6259-3af8-4adc-a00b-45c0926803a5 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:41.446029 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f83f6259-3af8-4adc-a00b-45c0926803a5 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:41.446528 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f83f6259-3af8-4adc-a00b-45c0926803a5 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:41.447348 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f83f6259-3af8-4adc-a00b-45c0926803a5 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:41.447892 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f83f6259-3af8-4adc-a00b-45c0926803a5 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:41.448666 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f83f6259-3af8-4adc-a00b-45c0926803a5 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:41.467970 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f97b379-53ef-40ae-8ebe-eddb15756679 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:41.470266 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f97b379-53ef-40ae-8ebe-eddb15756679 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:41.475662 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f97b379-53ef-40ae-8ebe-eddb15756679 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:41.476695 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f97b379-53ef-40ae-8ebe-eddb15756679 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:41.477349 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f97b379-53ef-40ae-8ebe-eddb15756679 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:41.478651 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f97b379-53ef-40ae-8ebe-eddb15756679 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:43.080974 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f83f6259-3af8-4adc-a00b-45c0926803a5 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae96c057d884eafb9c2032dd5db9e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a33aeb63a416a9d046e2b67b93f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:43.095656 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f83f6259-3af8-4adc-a00b-45c0926803a5 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/servers/d3255935-3cff-4bb0-aad2-a8f401028a59" status: 200 len: 1473 microversion: 2.1 time: 1.698372 Aug 31 16:08:43.102282 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1909/3657] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:41 2022] GET /compute/v2.1/servers/d3255935-3cff-4bb0-aad2-a8f401028a59 => generated 1473 bytes in 1705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:43.111774 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4b50623f-adfc-42bd-88a5-e2e17375438e tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:43.116760 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4b50623f-adfc-42bd-88a5-e2e17375438e tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] [instance: 1dc405fa-b1a4-4acc-8236-06a24e979f5e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:43.149323 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4b50623f-adfc-42bd-88a5-e2e17375438e tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:43.150722 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4b50623f-adfc-42bd-88a5-e2e17375438e tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:43.154832 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4b50623f-adfc-42bd-88a5-e2e17375438e tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:43.155805 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4b50623f-adfc-42bd-88a5-e2e17375438e tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:43.156475 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4b50623f-adfc-42bd-88a5-e2e17375438e tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:43.157072 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4b50623f-adfc-42bd-88a5-e2e17375438e tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:43.401989 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4b50623f-adfc-42bd-88a5-e2e17375438e tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4717b2fc0a654a77b40da565e599203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0154660c274106ab83ae50927348c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:43.412879 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4b50623f-adfc-42bd-88a5-e2e17375438e tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] 10.222.0.50 "GET /compute/v2.1/servers/1dc405fa-b1a4-4acc-8236-06a24e979f5e" status: 200 len: 1274 microversion: 2.1 time: 0.309189 Aug 31 16:08:43.421491 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1910/3658] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:43 2022] GET /compute/v2.1/servers/1dc405fa-b1a4-4acc-8236-06a24e979f5e => generated 1274 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:43.426980 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-35dee4eb-7860-4d2d-b2ed-f1fa6a070e18 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:43.438722 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-35dee4eb-7860-4d2d-b2ed-f1fa6a070e18 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:43.450181 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-35dee4eb-7860-4d2d-b2ed-f1fa6a070e18 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:43.452493 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-35dee4eb-7860-4d2d-b2ed-f1fa6a070e18 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:43.458456 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-35dee4eb-7860-4d2d-b2ed-f1fa6a070e18 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:43.459473 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-35dee4eb-7860-4d2d-b2ed-f1fa6a070e18 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:43.459947 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-35dee4eb-7860-4d2d-b2ed-f1fa6a070e18 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:43.460514 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-35dee4eb-7860-4d2d-b2ed-f1fa6a070e18 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:43.489783 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3f97b379-53ef-40ae-8ebe-eddb15756679 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:43.507921 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3f97b379-53ef-40ae-8ebe-eddb15756679 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1668 microversion: 2.1 time: 2.084644 Aug 31 16:08:43.522123 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1749/3659] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:41 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1668 bytes in 2097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:43.525497 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-72fd0235-1220-4fdd-91d0-37c0d4dae920 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:43.528238 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-72fd0235-1220-4fdd-91d0-37c0d4dae920 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:43.542027 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:08:43.560481 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72fd0235-1220-4fdd-91d0-37c0d4dae920 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:43.562519 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72fd0235-1220-4fdd-91d0-37c0d4dae920 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:43.564536 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72fd0235-1220-4fdd-91d0-37c0d4dae920 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:43.568560 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72fd0235-1220-4fdd-91d0-37c0d4dae920 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:43.569254 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72fd0235-1220-4fdd-91d0-37c0d4dae920 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:43.572745 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72fd0235-1220-4fdd-91d0-37c0d4dae920 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:43.634831 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-72fd0235-1220-4fdd-91d0-37c0d4dae920 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] HTTP exception thrown: Instance 0e89e500-ddc5-4549-8631-9d62545016d1 could not be found. Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-72fd0235-1220-4fdd-91d0-37c0d4dae920 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Request method failure captured: Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 HTTP/1.1 Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4W3pxsmI_O0CKYqbSnKeXjFih872LQR3ir6CewyOdbcDSh01P8ru0Q2zH7N2eAZX2kU7monFnXBdcnh6BjsJwBfg-ade-bQlv9wbNsSvVwB23U5Ea03g6bAigOHHca7KQMOBmWarPE8vZEqv7lMRHOciAOH48VE_jQtCknDj7JkCtI Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: X-Openstack-Nova-Api-Version: 2.42 Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 6550e3f42bfe4992aee45af34476da97 Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-109748479 Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6550e3f42bfe4992aee45af34476da97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6550e3f42bfe4992aee45af34476da97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6550e3f42bfe4992aee45af34476da97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6550e3f42bfe4992aee45af34476da97", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-TaggedBootDevicesTest_v242-109748479 Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 6550e3f42bfe4992aee45af34476da97 Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-109748479 Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-TaggedBootDevicesTest_v242-109748479-project Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: e8f9f728562f4d66b8039435235c655c Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-TaggedBootDevicesTest_v242-109748479-project Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 0e89e500-ddc5-4549-8631-9d62545016d1 could not be found. Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '0e89e500-ddc5-4549-8631-9d62545016d1'} Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e89e500-ddc5-4549-8631-9d62545016d1 could not be found. Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e89e500-ddc5-4549-8631-9d62545016d1 could not be found. Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:08:43.640625 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:08:43.649918 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:08:43.649918 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:43.649918 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:08:43.649918 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:08:43.649918 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:08:43.649918 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:08:43.649918 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e89e500-ddc5-4549-8631-9d62545016d1 could not be found. Aug 31 16:08:43.649918 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:08:43.649918 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-72fd0235-1220-4fdd-91d0-37c0d4dae920 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Returning 404 to user: Instance 0e89e500-ddc5-4549-8631-9d62545016d1 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:08:43.649918 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-72fd0235-1220-4fdd-91d0-37c0d4dae920 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 404 len: 111 microversion: 2.42 time: 0.130089 Aug 31 16:08:43.649918 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1750/3660] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:08:43 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:08:43.680697 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-8a7d5311-40a5-4575-b27d-c6c50f79ac34 req-b0d6b990-b769-4b5c-ad3c-68f94c02c5fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf602736-d01a-4673-a20b-ed1ae5750eea", "name": "network-vif-deleted", "tag": "91efca61-e4a7-4cd3-9a23-3049abf1fa19"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:43.706077 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-35dee4eb-7860-4d2d-b2ed-f1fa6a070e18 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:43.727197 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8a7d5311-40a5-4575-b27d-c6c50f79ac34 req-b0d6b990-b769-4b5c-ad3c-68f94c02c5fe service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:43.727813 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8a7d5311-40a5-4575-b27d-c6c50f79ac34 req-b0d6b990-b769-4b5c-ad3c-68f94c02c5fe service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:43.728247 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8a7d5311-40a5-4575-b27d-c6c50f79ac34 req-b0d6b990-b769-4b5c-ad3c-68f94c02c5fe service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:43.760503 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-35dee4eb-7860-4d2d-b2ed-f1fa6a070e18 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:43.770807 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-35dee4eb-7860-4d2d-b2ed-f1fa6a070e18 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:43.777626 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-35dee4eb-7860-4d2d-b2ed-f1fa6a070e18 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1603 microversion: 2.32 time: 0.354579 Aug 31 16:08:43.778149 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-8a7d5311-40a5-4575-b27d-c6c50f79ac34 req-b0d6b990-b769-4b5c-ad3c-68f94c02c5fe service nova] Creating event network-vif-deleted:91efca61-e4a7-4cd3-9a23-3049abf1fa19 for instance cf602736-d01a-4673-a20b-ed1ae5750eea on n-h1-833090-16 Aug 31 16:08:43.801749 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-8a7d5311-40a5-4575-b27d-c6c50f79ac34 req-b0d6b990-b769-4b5c-ad3c-68f94c02c5fe service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145065 Aug 31 16:08:43.802228 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1751/3661] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:43.805320 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1911/3662] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:08:43 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1603 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:08:43.817702 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-85cddb14-07b4-47a0-883c-6f654e5ce6b7 req-6655f9e9-8e8a-419d-b2d6-00acb3178a72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3255935-3cff-4bb0-aad2-a8f401028a59", "name": "network-vif-deleted", "tag": "21dd4917-2780-427e-86cb-ca75980a35b5"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:43.821032 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e63b1488-7368-4a0c-9b07-d65f5bbb3c87 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '.version_select at 0x7fbb4ac250d0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:43.858739 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-85cddb14-07b4-47a0-883c-6f654e5ce6b7 req-6655f9e9-8e8a-419d-b2d6-00acb3178a72 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:43.860897 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-85cddb14-07b4-47a0-883c-6f654e5ce6b7 req-6655f9e9-8e8a-419d-b2d6-00acb3178a72 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:43.862718 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-85cddb14-07b4-47a0-883c-6f654e5ce6b7 req-6655f9e9-8e8a-419d-b2d6-00acb3178a72 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:43.937630 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-85cddb14-07b4-47a0-883c-6f654e5ce6b7 req-6655f9e9-8e8a-419d-b2d6-00acb3178a72 service nova] Creating event network-vif-deleted:21dd4917-2780-427e-86cb-ca75980a35b5 for instance d3255935-3cff-4bb0-aad2-a8f401028a59 on n-h2-833090-16 Aug 31 16:08:43.955668 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-85cddb14-07b4-47a0-883c-6f654e5ce6b7 req-6655f9e9-8e8a-419d-b2d6-00acb3178a72 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144599 Aug 31 16:08:43.956501 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1912/3663] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:43.965270 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e63b1488-7368-4a0c-9b07-d65f5bbb3c87 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1453039412" status: 204 len: 0 microversion: 2.42 time: 0.150743 Aug 31 16:08:43.967515 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1752/3664] 10.222.0.50 () {60 vars in 1262 bytes} [Wed Aug 31 16:08:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1453039412 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 16:08:44.131937 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-23055820-0f2f-4073-b814-5d830e51c89e tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:44.135218 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-23055820-0f2f-4073-b814-5d830e51c89e tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] [instance: d3255935-3cff-4bb0-aad2-a8f401028a59] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:44.157978 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-23055820-0f2f-4073-b814-5d830e51c89e tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:44.159675 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-23055820-0f2f-4073-b814-5d830e51c89e tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:44.160314 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-23055820-0f2f-4073-b814-5d830e51c89e tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:44.162296 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-23055820-0f2f-4073-b814-5d830e51c89e tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:44.163609 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-23055820-0f2f-4073-b814-5d830e51c89e tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:44.165116 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-23055820-0f2f-4073-b814-5d830e51c89e tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:44.449117 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0a4868f8-64c2-4ef3-bc4a-61f2bfbbda7c tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:44.453629 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0a4868f8-64c2-4ef3-bc4a-61f2bfbbda7c tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] [instance: 1dc405fa-b1a4-4acc-8236-06a24e979f5e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:44.502506 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a4868f8-64c2-4ef3-bc4a-61f2bfbbda7c tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:44.507078 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a4868f8-64c2-4ef3-bc4a-61f2bfbbda7c tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:44.509345 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a4868f8-64c2-4ef3-bc4a-61f2bfbbda7c tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:44.514984 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a4868f8-64c2-4ef3-bc4a-61f2bfbbda7c tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:44.522499 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a4868f8-64c2-4ef3-bc4a-61f2bfbbda7c tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:44.524904 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a4868f8-64c2-4ef3-bc4a-61f2bfbbda7c tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:44.872751 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-23055820-0f2f-4073-b814-5d830e51c89e tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fae96c057d884eafb9c2032dd5db9e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a33aeb63a416a9d046e2b67b93f30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:44.910189 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-23055820-0f2f-4073-b814-5d830e51c89e tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/servers/d3255935-3cff-4bb0-aad2-a8f401028a59" status: 200 len: 1302 microversion: 2.1 time: 0.782669 Aug 31 16:08:44.914212 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1913/3665] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:44 2022] GET /compute/v2.1/servers/d3255935-3cff-4bb0-aad2-a8f401028a59 => generated 1302 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:08:44.930289 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a93e126d-9f2d-44b5-9141-7bc70e4a0643 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:44.931222 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a93e126d-9f2d-44b5-9141-7bc70e4a0643 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:44.947419 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a93e126d-9f2d-44b5-9141-7bc70e4a0643 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:44.947915 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a93e126d-9f2d-44b5-9141-7bc70e4a0643 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:44.948355 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a93e126d-9f2d-44b5-9141-7bc70e4a0643 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:44.949094 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a93e126d-9f2d-44b5-9141-7bc70e4a0643 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:44.949660 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a93e126d-9f2d-44b5-9141-7bc70e4a0643 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:44.949965 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a93e126d-9f2d-44b5-9141-7bc70e4a0643 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:44.986007 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0a4868f8-64c2-4ef3-bc4a-61f2bfbbda7c tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4717b2fc0a654a77b40da565e599203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0154660c274106ab83ae50927348c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:44.998823 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0a4868f8-64c2-4ef3-bc4a-61f2bfbbda7c tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] 10.222.0.50 "GET /compute/v2.1/servers/1dc405fa-b1a4-4acc-8236-06a24e979f5e" status: 200 len: 1274 microversion: 2.1 time: 0.561069 Aug 31 16:08:44.999738 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1753/3666] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:44 2022] GET /compute/v2.1/servers/1dc405fa-b1a4-4acc-8236-06a24e979f5e => generated 1274 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:45.004916 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e6e203fe-b6e5-4738-8b8d-989f496d9e47 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:45.005534 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e6e203fe-b6e5-4738-8b8d-989f496d9e47 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:45.027805 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6e203fe-b6e5-4738-8b8d-989f496d9e47 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:45.028591 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6e203fe-b6e5-4738-8b8d-989f496d9e47 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:45.029218 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6e203fe-b6e5-4738-8b8d-989f496d9e47 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:45.030280 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6e203fe-b6e5-4738-8b8d-989f496d9e47 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:45.030924 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6e203fe-b6e5-4738-8b8d-989f496d9e47 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:45.031506 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e6e203fe-b6e5-4738-8b8d-989f496d9e47 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:45.261479 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e6e203fe-b6e5-4738-8b8d-989f496d9e47 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:45.272919 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e6e203fe-b6e5-4738-8b8d-989f496d9e47 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:45.302475 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e6e203fe-b6e5-4738-8b8d-989f496d9e47 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:45.304029 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e6e203fe-b6e5-4738-8b8d-989f496d9e47 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1603 microversion: 2.32 time: 0.303263 Aug 31 16:08:45.304625 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1754/3667] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:08:44 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1603 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:08:45.536051 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a93e126d-9f2d-44b5-9141-7bc70e4a0643 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:45.555622 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a93e126d-9f2d-44b5-9141-7bc70e4a0643 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1671 microversion: 2.1 time: 0.638167 Aug 31 16:08:45.556672 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1914/3668] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:44 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1671 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:45.585577 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-35f4f429-356d-48b5-927a-a9447bac1f95 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:45.586796 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-35f4f429-356d-48b5-927a-a9447bac1f95 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:45.632736 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-35f4f429-356d-48b5-927a-a9447bac1f95 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:45.654915 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-35f4f429-356d-48b5-927a-a9447bac1f95 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:45.655672 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-35f4f429-356d-48b5-927a-a9447bac1f95 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:45.656610 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-35f4f429-356d-48b5-927a-a9447bac1f95 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:45.660175 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-35f4f429-356d-48b5-927a-a9447bac1f95 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:45.660900 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-35f4f429-356d-48b5-927a-a9447bac1f95 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:45.883818 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-298c72e7-3845-4905-b303-92f61506e850 req-cd2c36eb-b5d5-45ee-ac1d-497ece0b85b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91f7f5e0-19f8-40ba-a692-2c2b6cb6a0be", "name": "network-vif-deleted", "tag": "a83602be-36bb-49f4-a8f9-4ba66e314a64"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:45.913595 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-298c72e7-3845-4905-b303-92f61506e850 req-cd2c36eb-b5d5-45ee-ac1d-497ece0b85b1 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:45.914664 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-298c72e7-3845-4905-b303-92f61506e850 req-cd2c36eb-b5d5-45ee-ac1d-497ece0b85b1 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:45.915750 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-298c72e7-3845-4905-b303-92f61506e850 req-cd2c36eb-b5d5-45ee-ac1d-497ece0b85b1 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:45.984410 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:08:46.031129 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-298c72e7-3845-4905-b303-92f61506e850 req-cd2c36eb-b5d5-45ee-ac1d-497ece0b85b1 service nova] Creating event network-vif-deleted:a83602be-36bb-49f4-a8f9-4ba66e314a64 for instance 91f7f5e0-19f8-40ba-a692-2c2b6cb6a0be on n-h2-833090-16 Aug 31 16:08:46.056430 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-298c72e7-3845-4905-b303-92f61506e850 req-cd2c36eb-b5d5-45ee-ac1d-497ece0b85b1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173849 Aug 31 16:08:46.059494 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1915/3669] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:08:46.073604 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-15fc75ba-7acd-4f7f-987a-bbc1be5827b3 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:46.074596 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-15fc75ba-7acd-4f7f-987a-bbc1be5827b3 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] [instance: d3255935-3cff-4bb0-aad2-a8f401028a59] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:46.095833 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-15fc75ba-7acd-4f7f-987a-bbc1be5827b3 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:46.100518 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-15fc75ba-7acd-4f7f-987a-bbc1be5827b3 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:46.101227 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-15fc75ba-7acd-4f7f-987a-bbc1be5827b3 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:46.102995 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-15fc75ba-7acd-4f7f-987a-bbc1be5827b3 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:46.103985 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-15fc75ba-7acd-4f7f-987a-bbc1be5827b3 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:46.105952 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-15fc75ba-7acd-4f7f-987a-bbc1be5827b3 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:46.140442 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-15fc75ba-7acd-4f7f-987a-bbc1be5827b3 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] HTTP exception thrown: Instance d3255935-3cff-4bb0-aad2-a8f401028a59 could not be found. Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-15fc75ba-7acd-4f7f-987a-bbc1be5827b3 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Request method failure captured: Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/d3255935-3cff-4bb0-aad2-a8f401028a59 HTTP/1.1 Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4a8xQaTw-l8IP581KUlzjc60BVOx7JT6NuYXnq_JeSoCmBgxPGJVvs_Zo745_i8cqVLtle2uEsh4CXsVPL01yNCiv7S-_07ChuRBNdVVEAFVzzNAn22Kda79PiLJ8ylEH53mgDlP876igpuHdLvUtsm2WV0DYrKT6wyGNBG8-lFJnk Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 5d1a33aeb63a416a9d046e2b67b93f30 Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ListImageFiltersTestJSON-1338441779 Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5d1a33aeb63a416a9d046e2b67b93f30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5d1a33aeb63a416a9d046e2b67b93f30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5d1a33aeb63a416a9d046e2b67b93f30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5d1a33aeb63a416a9d046e2b67b93f30", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ListImageFiltersTestJSON-1338441779 Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 5d1a33aeb63a416a9d046e2b67b93f30 Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1338441779 Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ListImageFiltersTestJSON-1338441779-project Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: fae96c057d884eafb9c2032dd5db9e2e Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ListImageFiltersTestJSON-1338441779-project Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance d3255935-3cff-4bb0-aad2-a8f401028a59 could not be found. Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'd3255935-3cff-4bb0-aad2-a8f401028a59'} Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3255935-3cff-4bb0-aad2-a8f401028a59 could not be found. Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3255935-3cff-4bb0-aad2-a8f401028a59 could not be found. Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:08:46.142416 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:08:46.146736 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:46.146736 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:08:46.146736 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:08:46.146736 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:08:46.146736 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:08:46.146736 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3255935-3cff-4bb0-aad2-a8f401028a59 could not be found. Aug 31 16:08:46.146736 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:08:46.149561 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-15fc75ba-7acd-4f7f-987a-bbc1be5827b3 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Returning 404 to user: Instance d3255935-3cff-4bb0-aad2-a8f401028a59 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:08:46.152093 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-15fc75ba-7acd-4f7f-987a-bbc1be5827b3 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "GET /compute/v2.1/servers/d3255935-3cff-4bb0-aad2-a8f401028a59" status: 404 len: 111 microversion: 2.1 time: 0.091167 Aug 31 16:08:46.156757 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1916/3670] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:46 2022] GET /compute/v2.1/servers/d3255935-3cff-4bb0-aad2-a8f401028a59 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:08:46.178858 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-47ce559d-ec43-4851-a776-7e15cdb0b8c4 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:46.179799 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-47ce559d-ec43-4851-a776-7e15cdb0b8c4 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] [instance: 1dc405fa-b1a4-4acc-8236-06a24e979f5e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:46.188006 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-47ce559d-ec43-4851-a776-7e15cdb0b8c4 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:46.189473 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-47ce559d-ec43-4851-a776-7e15cdb0b8c4 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:46.190080 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-47ce559d-ec43-4851-a776-7e15cdb0b8c4 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:46.190977 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-47ce559d-ec43-4851-a776-7e15cdb0b8c4 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:46.191596 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-47ce559d-ec43-4851-a776-7e15cdb0b8c4 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:46.192858 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-47ce559d-ec43-4851-a776-7e15cdb0b8c4 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:46.499597 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-35f4f429-356d-48b5-927a-a9447bac1f95 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:46.522121 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-35f4f429-356d-48b5-927a-a9447bac1f95 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1671 microversion: 2.1 time: 0.937350 Aug 31 16:08:46.526037 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1755/3671] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:45 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1671 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:46.545511 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dec6da16-bf79-4cdd-847f-622eeebb1fea tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb4aa2a0d0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:47.149122 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-47ce559d-ec43-4851-a776-7e15cdb0b8c4 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4717b2fc0a654a77b40da565e599203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0154660c274106ab83ae50927348c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:47.170960 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-47ce559d-ec43-4851-a776-7e15cdb0b8c4 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] 10.222.0.50 "GET /compute/v2.1/servers/1dc405fa-b1a4-4acc-8236-06a24e979f5e" status: 200 len: 1316 microversion: 2.1 time: 1.011249 Aug 31 16:08:47.187532 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1917/3672] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:46 2022] GET /compute/v2.1/servers/1dc405fa-b1a4-4acc-8236-06a24e979f5e => generated 1316 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:47.201346 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9bdddead-d3f2-4ccf-845c-ec845f01db3f tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:47.201797 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9bdddead-d3f2-4ccf-845c-ec845f01db3f tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:47.229615 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9bdddead-d3f2-4ccf-845c-ec845f01db3f tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:47.230482 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9bdddead-d3f2-4ccf-845c-ec845f01db3f tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:47.230993 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9bdddead-d3f2-4ccf-845c-ec845f01db3f tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:47.231750 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9bdddead-d3f2-4ccf-845c-ec845f01db3f tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:47.232347 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9bdddead-d3f2-4ccf-845c-ec845f01db3f tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:47.237358 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9bdddead-d3f2-4ccf-845c-ec845f01db3f tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:47.394188 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dec6da16-bf79-4cdd-847f-622eeebb1fea tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "DELETE /compute/v2.1/images/0df0e9ae-9048-4f03-87bf-ad0fc4379256" status: 204 len: 0 microversion: 2.1 time: 0.866621 Aug 31 16:08:47.396043 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1756/3673] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:46 2022] DELETE /compute/v2.1/images/0df0e9ae-9048-4f03-87bf-ad0fc4379256 => generated 0 bytes in 868 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:08:47.400738 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ea4441d7-c962-4b29-9dc4-35a83bc853ed tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:47.401311 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ea4441d7-c962-4b29-9dc4-35a83bc853ed tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: ac18e976-69d9-4131-be61-fdbcf1b04173] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:47.430322 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea4441d7-c962-4b29-9dc4-35a83bc853ed tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:47.438461 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea4441d7-c962-4b29-9dc4-35a83bc853ed tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:47.440443 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea4441d7-c962-4b29-9dc4-35a83bc853ed tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:47.445049 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea4441d7-c962-4b29-9dc4-35a83bc853ed tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:47.447108 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea4441d7-c962-4b29-9dc4-35a83bc853ed tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:47.449624 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea4441d7-c962-4b29-9dc4-35a83bc853ed tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:47.566567 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ea4441d7-c962-4b29-9dc4-35a83bc853ed tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: ac18e976-69d9-4131-be61-fdbcf1b04173] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:08:47.596932 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.compute.api [None req-ea4441d7-c962-4b29-9dc4-35a83bc853ed tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: ac18e976-69d9-4131-be61-fdbcf1b04173] Working on deleting snapshot fc4fae5a-a598-4db9-9173-2493db6462de from shelved instance... Aug 31 16:08:47.710809 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9bdddead-d3f2-4ccf-845c-ec845f01db3f tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:47.732225 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9bdddead-d3f2-4ccf-845c-ec845f01db3f tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:47.734417 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9bdddead-d3f2-4ccf-845c-ec845f01db3f tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:47.736409 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9bdddead-d3f2-4ccf-845c-ec845f01db3f tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1603 microversion: 2.32 time: 0.547156 Aug 31 16:08:47.737371 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1918/3674] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:08:47 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1603 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:08:47.743123 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1605f3ef-1792-4d23-a7c4-1d7e10de55e2 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb46991790>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:48.322517 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=6 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:08:48.474751 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1605f3ef-1792-4d23-a7c4-1d7e10de55e2 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "DELETE /compute/v2.1/images/98cb2f85-bd63-450a-b78c-f064201f1592" status: 204 len: 0 microversion: 2.1 time: 0.735989 Aug 31 16:08:48.478411 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1919/3675] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:47 2022] DELETE /compute/v2.1/images/98cb2f85-bd63-450a-b78c-f064201f1592 => generated 0 bytes in 737 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:08:48.481912 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ed51b77e-e002-4917-a387-22a639581978 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:48.482955 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ed51b77e-e002-4917-a387-22a639581978 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] [instance: 1dc405fa-b1a4-4acc-8236-06a24e979f5e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:48.514050 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=3,nova_api:INSERT=6 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:08:48.528143 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ed51b77e-e002-4917-a387-22a639581978 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:48.532258 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ed51b77e-e002-4917-a387-22a639581978 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:48.534171 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ed51b77e-e002-4917-a387-22a639581978 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:48.537283 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ed51b77e-e002-4917-a387-22a639581978 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:48.537832 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ed51b77e-e002-4917-a387-22a639581978 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:48.538321 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ed51b77e-e002-4917-a387-22a639581978 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:48.729528 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ea4441d7-c962-4b29-9dc4-35a83bc853ed tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: ac18e976-69d9-4131-be61-fdbcf1b04173] Doing local delete in cell ff6ab154-5f51-4e0d-922a-904eb5aa20da(cell1) {{(pid=128863) _delete /opt/stack/nova/nova/compute/api.py:2546}} Aug 31 16:08:48.730332 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea4441d7-c962-4b29-9dc4-35a83bc853ed tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:48.735184 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea4441d7-c962-4b29-9dc4-35a83bc853ed tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:48.736028 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea4441d7-c962-4b29-9dc4-35a83bc853ed tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:48.740864 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.compute.api [None req-ea4441d7-c962-4b29-9dc4-35a83bc853ed tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: ac18e976-69d9-4131-be61-fdbcf1b04173] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 31 16:08:48.751743 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-ea4441d7-c962-4b29-9dc4-35a83bc853ed tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: ac18e976-69d9-4131-be61-fdbcf1b04173] deallocate_for_instance() {{(pid=128863) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 31 16:08:48.788554 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=4 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:08:50.297540 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ed51b77e-e002-4917-a387-22a639581978 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4717b2fc0a654a77b40da565e599203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0154660c274106ab83ae50927348c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:50.320265 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ed51b77e-e002-4917-a387-22a639581978 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] 10.222.0.50 "GET /compute/v2.1/servers/1dc405fa-b1a4-4acc-8236-06a24e979f5e" status: 200 len: 1316 microversion: 2.1 time: 1.843147 Aug 31 16:08:50.321269 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1920/3676] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:48 2022] GET /compute/v2.1/servers/1dc405fa-b1a4-4acc-8236-06a24e979f5e => generated 1316 bytes in 1845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:50.344316 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1fc3ac1d-e9a5-46fe-ae1e-c994849792b7 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] Calling method '.version_select at 0x7fbb4615d670>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:51.139805 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-ea4441d7-c962-4b29-9dc4-35a83bc853ed tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: ac18e976-69d9-4131-be61-fdbcf1b04173] Updating instance_info_cache with network_info: [] {{(pid=128863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 31 16:08:52.038888 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1fc3ac1d-e9a5-46fe-ae1e-c994849792b7 tempest-ListImageFiltersTestJSON-1338441779 tempest-ListImageFiltersTestJSON-1338441779-project] 10.222.0.50 "DELETE /compute/v2.1/images/d7e0dca3-d47c-40e7-985e-2c9bca850623" status: 204 len: 0 microversion: 2.1 time: 1.716319 Aug 31 16:08:52.039413 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1921/3677] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:50 2022] DELETE /compute/v2.1/images/d7e0dca3-d47c-40e7-985e-2c9bca850623 => generated 0 bytes in 1718 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:08:52.044486 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-11bc51b2-8abf-4cf5-99cc-9155b580d3f0 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:52.045165 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-11bc51b2-8abf-4cf5-99cc-9155b580d3f0 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:52.070993 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11bc51b2-8abf-4cf5-99cc-9155b580d3f0 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:52.071659 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11bc51b2-8abf-4cf5-99cc-9155b580d3f0 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:52.072288 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11bc51b2-8abf-4cf5-99cc-9155b580d3f0 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:52.073184 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11bc51b2-8abf-4cf5-99cc-9155b580d3f0 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:52.076810 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ea4441d7-c962-4b29-9dc4-35a83bc853ed tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173" status: 204 len: 0 microversion: 2.1 time: 4.680480 Aug 31 16:08:52.077734 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11bc51b2-8abf-4cf5-99cc-9155b580d3f0 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:52.084737 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1757/3678] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:08:47 2022] DELETE /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173 => generated 0 bytes in 4689 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:08:52.085665 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11bc51b2-8abf-4cf5-99cc-9155b580d3f0 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:52.093391 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-623e3deb-df87-4019-bc19-7d04bfb009d8 req-45fc7388-44cc-4e4d-ae0f-fab4fa2cb6db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad0b8fd6-eec9-42fe-91af-a7904d758c93", "tag": "71c89454-6693-4742-a290-7b5d85bf00d5"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:52.138968 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-623e3deb-df87-4019-bc19-7d04bfb009d8 req-45fc7388-44cc-4e4d-ae0f-fab4fa2cb6db service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:52.143819 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-623e3deb-df87-4019-bc19-7d04bfb009d8 req-45fc7388-44cc-4e4d-ae0f-fab4fa2cb6db service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:52.145880 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-623e3deb-df87-4019-bc19-7d04bfb009d8 req-45fc7388-44cc-4e4d-ae0f-fab4fa2cb6db service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:52.176979 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:08:52.182908 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-623e3deb-df87-4019-bc19-7d04bfb009d8 req-45fc7388-44cc-4e4d-ae0f-fab4fa2cb6db service nova] Creating event network-changed:71c89454-6693-4742-a290-7b5d85bf00d5 for instance ad0b8fd6-eec9-42fe-91af-a7904d758c93 on n-h2-833090-16 Aug 31 16:08:52.196220 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-623e3deb-df87-4019-bc19-7d04bfb009d8 req-45fc7388-44cc-4e4d-ae0f-fab4fa2cb6db service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109076 Aug 31 16:08:52.197580 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1758/3679] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:52.210158 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-0deec544-f4eb-45ad-ae73-59b368538740 req-11ba19f7-44ba-4098-9490-3b4f4ce25852 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac18e976-69d9-4131-be61-fdbcf1b04173", "name": "network-vif-deleted", "tag": "cfd88315-b685-44a6-8390-699b793813af"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:52.289884 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-0deec544-f4eb-45ad-ae73-59b368538740 req-11ba19f7-44ba-4098-9490-3b4f4ce25852 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:52.297149 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-0deec544-f4eb-45ad-ae73-59b368538740 req-11ba19f7-44ba-4098-9490-3b4f4ce25852 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:52.299541 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-0deec544-f4eb-45ad-ae73-59b368538740 req-11ba19f7-44ba-4098-9490-3b4f4ce25852 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:52.344534 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.compute.server_external_events [req-0deec544-f4eb-45ad-ae73-59b368538740 req-11ba19f7-44ba-4098-9490-3b4f4ce25852 service nova] Unable to find a host for instance ac18e976-69d9-4131-be61-fdbcf1b04173. Dropping event network-vif-deleted {{(pid=128863) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 31 16:08:52.345822 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-0deec544-f4eb-45ad-ae73-59b368538740 req-11ba19f7-44ba-4098-9490-3b4f4ce25852 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.147254 Aug 31 16:08:52.350489 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1759/3680] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 152 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 31 16:08:52.364874 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ddf6c0db-c04e-4627-9dac-3287f5a40d3b tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:52.366328 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ddf6c0db-c04e-4627-9dac-3287f5a40d3b tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] [instance: 1dc405fa-b1a4-4acc-8236-06a24e979f5e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:52.375485 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ddf6c0db-c04e-4627-9dac-3287f5a40d3b tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:52.376553 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ddf6c0db-c04e-4627-9dac-3287f5a40d3b tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:52.376553 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ddf6c0db-c04e-4627-9dac-3287f5a40d3b tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:52.377969 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ddf6c0db-c04e-4627-9dac-3287f5a40d3b tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:52.378669 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ddf6c0db-c04e-4627-9dac-3287f5a40d3b tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:52.380193 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ddf6c0db-c04e-4627-9dac-3287f5a40d3b tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:52.544130 n-d-833090-16 devstack@n-api.service[128864]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 16:08:52.544635 n-d-833090-16 devstack@n-api.service[128864]: Wed Aug 31 16:08:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 (ip 10.222.0.50) !!! Aug 31 16:08:52.789455 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-11bc51b2-8abf-4cf5-99cc-9155b580d3f0 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:52.808361 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-11bc51b2-8abf-4cf5-99cc-9155b580d3f0 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:52.820315 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-11bc51b2-8abf-4cf5-99cc-9155b580d3f0 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:52.821851 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-11bc51b2-8abf-4cf5-99cc-9155b580d3f0 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1603 microversion: 2.32 time: 0.781460 Aug 31 16:08:52.822530 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1922/3681] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:08:52 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1603 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:08:52.828507 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6987e7f7-b689-46cb-8f55-1261e19e6002 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:52.841479 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6987e7f7-b689-46cb-8f55-1261e19e6002 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: ac18e976-69d9-4131-be61-fdbcf1b04173] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:52.855339 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6987e7f7-b689-46cb-8f55-1261e19e6002 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:52.855966 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6987e7f7-b689-46cb-8f55-1261e19e6002 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:52.866408 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6987e7f7-b689-46cb-8f55-1261e19e6002 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:52.867339 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6987e7f7-b689-46cb-8f55-1261e19e6002 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:52.867949 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6987e7f7-b689-46cb-8f55-1261e19e6002 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:52.868487 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6987e7f7-b689-46cb-8f55-1261e19e6002 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:52.919972 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-6987e7f7-b689-46cb-8f55-1261e19e6002 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] HTTP exception thrown: Instance ac18e976-69d9-4131-be61-fdbcf1b04173 could not be found. Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6987e7f7-b689-46cb-8f55-1261e19e6002 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Request method failure captured: Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173 HTTP/1.1 Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4VKUAYKz-WFBtmk16aIOyXYR2HhyYuZ36VRZsBRjqviBnc5RSPRJJqpoARQYteX5NSEljs3qX5_RMCYaeMof8M6i0ZB3mJgVdRhk2nIL2yk-7L_KhuV1lL_MMec1r7AAygDhG-639IQUe0ED7x0P_yoZ7NSrcY8NXkYeyVxFn3mUyo Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 11ef5102f83142d1a52befe52c3595d4 Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServerActionsTestJSON-1629819008 Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/11ef5102f83142d1a52befe52c3595d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/11ef5102f83142d1a52befe52c3595d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/11ef5102f83142d1a52befe52c3595d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_11ef5102f83142d1a52befe52c3595d4", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServerActionsTestJSON-1629819008 Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 11ef5102f83142d1a52befe52c3595d4 Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServerActionsTestJSON-1629819008 Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServerActionsTestJSON-1629819008-project Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: aeeaf32202f747c8a2b98836f503aa7e Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServerActionsTestJSON-1629819008-project Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance ac18e976-69d9-4131-be61-fdbcf1b04173 could not be found. Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'ac18e976-69d9-4131-be61-fdbcf1b04173'} Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac18e976-69d9-4131-be61-fdbcf1b04173 could not be found. Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac18e976-69d9-4131-be61-fdbcf1b04173 could not be found. Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:08:52.921753 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:08:52.926835 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:52.926835 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:08:52.926835 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:08:52.926835 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:08:52.926835 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:08:52.926835 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac18e976-69d9-4131-be61-fdbcf1b04173 could not be found. Aug 31 16:08:52.926835 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:08:52.926835 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6987e7f7-b689-46cb-8f55-1261e19e6002 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Returning 404 to user: Instance ac18e976-69d9-4131-be61-fdbcf1b04173 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:08:52.927914 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6987e7f7-b689-46cb-8f55-1261e19e6002 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173" status: 404 len: 111 microversion: 2.1 time: 0.103612 Aug 31 16:08:52.929992 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1923/3682] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:52 2022] GET /compute/v2.1/servers/ac18e976-69d9-4131-be61-fdbcf1b04173 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:08:52.938878 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3892a794-35a8-4a2a-918d-c1c0f4e8c324 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:52.942705 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3892a794-35a8-4a2a-918d-c1c0f4e8c324 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: f61252b4-88c9-422d-9849-c7dec9b67380] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:52.953975 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3892a794-35a8-4a2a-918d-c1c0f4e8c324 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:52.960319 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3892a794-35a8-4a2a-918d-c1c0f4e8c324 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:52.971004 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3892a794-35a8-4a2a-918d-c1c0f4e8c324 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:52.971958 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3892a794-35a8-4a2a-918d-c1c0f4e8c324 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:52.972658 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3892a794-35a8-4a2a-918d-c1c0f4e8c324 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:52.973231 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3892a794-35a8-4a2a-918d-c1c0f4e8c324 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:53.057366 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3892a794-35a8-4a2a-918d-c1c0f4e8c324 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: f61252b4-88c9-422d-9849-c7dec9b67380] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:08:53.190517 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ddf6c0db-c04e-4627-9dac-3287f5a40d3b tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4717b2fc0a654a77b40da565e599203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0154660c274106ab83ae50927348c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:53.202690 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ddf6c0db-c04e-4627-9dac-3287f5a40d3b tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] 10.222.0.50 "GET /compute/v2.1/servers/1dc405fa-b1a4-4acc-8236-06a24e979f5e" status: 200 len: 1316 microversion: 2.1 time: 0.850074 Aug 31 16:08:53.215518 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1760/3683] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:52 2022] GET /compute/v2.1/servers/1dc405fa-b1a4-4acc-8236-06a24e979f5e => generated 1316 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:53.289380 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3892a794-35a8-4a2a-918d-c1c0f4e8c324 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "DELETE /compute/v2.1/servers/f61252b4-88c9-422d-9849-c7dec9b67380" status: 204 len: 0 microversion: 2.1 time: 0.354505 Aug 31 16:08:53.289978 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1924/3684] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:08:52 2022] DELETE /compute/v2.1/servers/f61252b4-88c9-422d-9849-c7dec9b67380 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:08:53.300893 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bcc84a43-0d4d-4ccf-b816-d9cca823be19 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:53.302040 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bcc84a43-0d4d-4ccf-b816-d9cca823be19 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: f61252b4-88c9-422d-9849-c7dec9b67380] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:53.319976 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bcc84a43-0d4d-4ccf-b816-d9cca823be19 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:53.320573 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bcc84a43-0d4d-4ccf-b816-d9cca823be19 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:53.321031 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bcc84a43-0d4d-4ccf-b816-d9cca823be19 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:53.322652 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bcc84a43-0d4d-4ccf-b816-d9cca823be19 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:53.323127 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bcc84a43-0d4d-4ccf-b816-d9cca823be19 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:53.325828 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bcc84a43-0d4d-4ccf-b816-d9cca823be19 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:53.851711 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ad525180-3fac-4d49-b91a-d064fe69f4d8 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:53.852508 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ad525180-3fac-4d49-b91a-d064fe69f4d8 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:53.887545 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ad525180-3fac-4d49-b91a-d064fe69f4d8 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:53.892681 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ad525180-3fac-4d49-b91a-d064fe69f4d8 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:53.900431 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ad525180-3fac-4d49-b91a-d064fe69f4d8 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:53.901442 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ad525180-3fac-4d49-b91a-d064fe69f4d8 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:53.903452 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ad525180-3fac-4d49-b91a-d064fe69f4d8 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:53.904072 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ad525180-3fac-4d49-b91a-d064fe69f4d8 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:53.999337 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bcc84a43-0d4d-4ccf-b816-d9cca823be19 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:54.019669 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bcc84a43-0d4d-4ccf-b816-d9cca823be19 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/f61252b4-88c9-422d-9849-c7dec9b67380" status: 200 len: 1466 microversion: 2.1 time: 0.723617 Aug 31 16:08:54.035296 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1761/3685] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:53 2022] GET /compute/v2.1/servers/f61252b4-88c9-422d-9849-c7dec9b67380 => generated 1466 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:54.154044 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ad525180-3fac-4d49-b91a-d064fe69f4d8 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:54.196207 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ad525180-3fac-4d49-b91a-d064fe69f4d8 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:54.198636 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ad525180-3fac-4d49-b91a-d064fe69f4d8 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:54.208069 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ad525180-3fac-4d49-b91a-d064fe69f4d8 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1603 microversion: 2.32 time: 0.366793 Aug 31 16:08:54.210172 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1925/3686] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:08:53 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1603 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:08:54.233406 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5f97169e-659e-4c9f-b342-4f25803d823c tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:54.235147 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5f97169e-659e-4c9f-b342-4f25803d823c tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] [instance: 1dc405fa-b1a4-4acc-8236-06a24e979f5e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:54.269208 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f97169e-659e-4c9f-b342-4f25803d823c tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:54.270181 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f97169e-659e-4c9f-b342-4f25803d823c tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:54.270953 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f97169e-659e-4c9f-b342-4f25803d823c tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:54.274952 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f97169e-659e-4c9f-b342-4f25803d823c tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:54.276418 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f97169e-659e-4c9f-b342-4f25803d823c tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:54.283033 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f97169e-659e-4c9f-b342-4f25803d823c tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:54.417043 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-3c27c666-4c74-47b3-8ebb-5f032253ee79 req-3ee27865-8255-4510-9a98-1355cc77b830 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dc405fa-b1a4-4acc-8236-06a24e979f5e", "tag": "b43723c2-c0d3-4a50-abf3-a3313299f8e1"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:54.443258 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-3c27c666-4c74-47b3-8ebb-5f032253ee79 req-3ee27865-8255-4510-9a98-1355cc77b830 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:54.455285 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-3c27c666-4c74-47b3-8ebb-5f032253ee79 req-3ee27865-8255-4510-9a98-1355cc77b830 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:54.456064 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-3c27c666-4c74-47b3-8ebb-5f032253ee79 req-3ee27865-8255-4510-9a98-1355cc77b830 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:54.495153 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-3c27c666-4c74-47b3-8ebb-5f032253ee79 req-3ee27865-8255-4510-9a98-1355cc77b830 service nova] Creating event network-changed:b43723c2-c0d3-4a50-abf3-a3313299f8e1 for instance 1dc405fa-b1a4-4acc-8236-06a24e979f5e on n-h1-833090-16 Aug 31 16:08:54.501955 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-3c27c666-4c74-47b3-8ebb-5f032253ee79 req-3ee27865-8255-4510-9a98-1355cc77b830 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088595 Aug 31 16:08:54.503295 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1926/3687] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:08:55.047087 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2140bf8a-fb04-4d3f-97d6-e3c652fb16b0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:55.048135 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2140bf8a-fb04-4d3f-97d6-e3c652fb16b0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: f61252b4-88c9-422d-9849-c7dec9b67380] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:55.063711 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2140bf8a-fb04-4d3f-97d6-e3c652fb16b0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:55.069166 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2140bf8a-fb04-4d3f-97d6-e3c652fb16b0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:55.069967 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2140bf8a-fb04-4d3f-97d6-e3c652fb16b0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:55.071135 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2140bf8a-fb04-4d3f-97d6-e3c652fb16b0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:55.071857 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2140bf8a-fb04-4d3f-97d6-e3c652fb16b0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:55.073142 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2140bf8a-fb04-4d3f-97d6-e3c652fb16b0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:55.774834 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5f97169e-659e-4c9f-b342-4f25803d823c tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4717b2fc0a654a77b40da565e599203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0154660c274106ab83ae50927348c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:55.793014 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5f97169e-659e-4c9f-b342-4f25803d823c tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] 10.222.0.50 "GET /compute/v2.1/servers/1dc405fa-b1a4-4acc-8236-06a24e979f5e" status: 200 len: 1316 microversion: 2.1 time: 1.565159 Aug 31 16:08:55.799307 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1762/3688] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:54 2022] GET /compute/v2.1/servers/1dc405fa-b1a4-4acc-8236-06a24e979f5e => generated 1316 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:55.823258 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f7389163-3c3e-4cd5-a012-72651d7b93e3 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:55.825216 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2140bf8a-fb04-4d3f-97d6-e3c652fb16b0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:55.825740 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f7389163-3c3e-4cd5-a012-72651d7b93e3 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:55.835510 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2140bf8a-fb04-4d3f-97d6-e3c652fb16b0 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/f61252b4-88c9-422d-9849-c7dec9b67380" status: 200 len: 1466 microversion: 2.1 time: 0.794158 Aug 31 16:08:55.836125 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1927/3689] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:55 2022] GET /compute/v2.1/servers/f61252b4-88c9-422d-9849-c7dec9b67380 => generated 1466 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:08:55.855908 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2c04f28a-3a8e-48c3-a990-c4fdaaef8d41 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:55.856413 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2c04f28a-3a8e-48c3-a990-c4fdaaef8d41 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:55.874954 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7389163-3c3e-4cd5-a012-72651d7b93e3 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:55.877866 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2c04f28a-3a8e-48c3-a990-c4fdaaef8d41 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:55.878056 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7389163-3c3e-4cd5-a012-72651d7b93e3 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:55.883781 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7389163-3c3e-4cd5-a012-72651d7b93e3 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:55.884694 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7389163-3c3e-4cd5-a012-72651d7b93e3 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:55.885184 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7389163-3c3e-4cd5-a012-72651d7b93e3 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:55.885675 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2c04f28a-3a8e-48c3-a990-c4fdaaef8d41 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:55.890649 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2c04f28a-3a8e-48c3-a990-c4fdaaef8d41 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:55.891834 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2c04f28a-3a8e-48c3-a990-c4fdaaef8d41 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:55.892202 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2c04f28a-3a8e-48c3-a990-c4fdaaef8d41 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:55.892640 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2c04f28a-3a8e-48c3-a990-c4fdaaef8d41 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:55.892808 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7389163-3c3e-4cd5-a012-72651d7b93e3 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:55.986881 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2c04f28a-3a8e-48c3-a990-c4fdaaef8d41 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:08:56.149234 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f7389163-3c3e-4cd5-a012-72651d7b93e3 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:56.178482 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f7389163-3c3e-4cd5-a012-72651d7b93e3 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:56.185007 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f7389163-3c3e-4cd5-a012-72651d7b93e3 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:56.194729 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f7389163-3c3e-4cd5-a012-72651d7b93e3 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1603 microversion: 2.32 time: 0.388539 Aug 31 16:08:56.197609 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1763/3690] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:08:55 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1603 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:08:56.259556 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2c04f28a-3a8e-48c3-a990-c4fdaaef8d41 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "DELETE /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc" status: 204 len: 0 microversion: 2.1 time: 0.416736 Aug 31 16:08:56.263336 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1928/3691] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:08:55 2022] DELETE /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:08:56.272881 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a9e41541-d5b5-47b3-abbc-2cf9e0d3420f tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:56.273945 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a9e41541-d5b5-47b3-abbc-2cf9e0d3420f tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:56.288024 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9e41541-d5b5-47b3-abbc-2cf9e0d3420f tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:56.288024 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9e41541-d5b5-47b3-abbc-2cf9e0d3420f tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:56.288320 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9e41541-d5b5-47b3-abbc-2cf9e0d3420f tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:56.288822 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9e41541-d5b5-47b3-abbc-2cf9e0d3420f tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:56.289269 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9e41541-d5b5-47b3-abbc-2cf9e0d3420f tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:56.293149 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9e41541-d5b5-47b3-abbc-2cf9e0d3420f tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:56.820814 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a158f8ba-1a5c-433e-b62b-35453f1c9ba4 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:56.822301 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a158f8ba-1a5c-433e-b62b-35453f1c9ba4 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] [instance: 1dc405fa-b1a4-4acc-8236-06a24e979f5e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:56.852009 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a158f8ba-1a5c-433e-b62b-35453f1c9ba4 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:56.853866 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a158f8ba-1a5c-433e-b62b-35453f1c9ba4 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:56.855743 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a158f8ba-1a5c-433e-b62b-35453f1c9ba4 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:56.856666 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a158f8ba-1a5c-433e-b62b-35453f1c9ba4 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:56.858675 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a158f8ba-1a5c-433e-b62b-35453f1c9ba4 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:56.860547 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a158f8ba-1a5c-433e-b62b-35453f1c9ba4 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:57.600786 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a9e41541-d5b5-47b3-abbc-2cf9e0d3420f tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:57.633587 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a9e41541-d5b5-47b3-abbc-2cf9e0d3420f tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc" status: 200 len: 1667 microversion: 2.1 time: 1.351938 Aug 31 16:08:57.636228 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1764/3692] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:56 2022] GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc => generated 1667 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:57.647050 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ba8b1bb9-466c-451f-a72e-e2a838383196 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:57.650832 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ba8b1bb9-466c-451f-a72e-e2a838383196 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: f61252b4-88c9-422d-9849-c7dec9b67380] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:57.675343 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba8b1bb9-466c-451f-a72e-e2a838383196 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:57.676098 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba8b1bb9-466c-451f-a72e-e2a838383196 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:57.676689 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba8b1bb9-466c-451f-a72e-e2a838383196 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:57.677556 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba8b1bb9-466c-451f-a72e-e2a838383196 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:57.679874 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba8b1bb9-466c-451f-a72e-e2a838383196 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:57.682369 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba8b1bb9-466c-451f-a72e-e2a838383196 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:58.109558 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ba8b1bb9-466c-451f-a72e-e2a838383196 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:58.123700 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ba8b1bb9-466c-451f-a72e-e2a838383196 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/f61252b4-88c9-422d-9849-c7dec9b67380" status: 200 len: 1466 microversion: 2.1 time: 0.481503 Aug 31 16:08:58.124242 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1765/3693] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:57 2022] GET /compute/v2.1/servers/f61252b4-88c9-422d-9849-c7dec9b67380 => generated 1466 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:58.325159 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0c4d9c18-6c4f-43a7-a637-8a3bd86ad39d tempest-AZV2TestJSON-1238103686 tempest-AZV2TestJSON-1238103686-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:58.327086 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c4d9c18-6c4f-43a7-a637-8a3bd86ad39d tempest-AZV2TestJSON-1238103686 tempest-AZV2TestJSON-1238103686-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:58.327724 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c4d9c18-6c4f-43a7-a637-8a3bd86ad39d tempest-AZV2TestJSON-1238103686 tempest-AZV2TestJSON-1238103686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:58.328336 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c4d9c18-6c4f-43a7-a637-8a3bd86ad39d tempest-AZV2TestJSON-1238103686 tempest-AZV2TestJSON-1238103686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:58.330569 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c4d9c18-6c4f-43a7-a637-8a3bd86ad39d tempest-AZV2TestJSON-1238103686 tempest-AZV2TestJSON-1238103686-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:58.333264 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c4d9c18-6c4f-43a7-a637-8a3bd86ad39d tempest-AZV2TestJSON-1238103686 tempest-AZV2TestJSON-1238103686-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:58.333720 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c4d9c18-6c4f-43a7-a637-8a3bd86ad39d tempest-AZV2TestJSON-1238103686 tempest-AZV2TestJSON-1238103686-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:58.480233 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0c4d9c18-6c4f-43a7-a637-8a3bd86ad39d tempest-AZV2TestJSON-1238103686 tempest-AZV2TestJSON-1238103686-project] 10.222.0.50 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.341248 Aug 31 16:08:58.480919 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1766/3694] 10.222.0.50 () {58 vars in 1164 bytes} [Wed Aug 31 16:08:58 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:08:58.503678 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-910ebb0b-41ec-4964-87bd-cb5879806659 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:58.508044 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-910ebb0b-41ec-4964-87bd-cb5879806659 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:58.534978 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-910ebb0b-41ec-4964-87bd-cb5879806659 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:58.535485 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-910ebb0b-41ec-4964-87bd-cb5879806659 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:58.535926 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-910ebb0b-41ec-4964-87bd-cb5879806659 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:58.542152 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-910ebb0b-41ec-4964-87bd-cb5879806659 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:58.543609 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-910ebb0b-41ec-4964-87bd-cb5879806659 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:58.544069 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-910ebb0b-41ec-4964-87bd-cb5879806659 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:58.590977 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a158f8ba-1a5c-433e-b62b-35453f1c9ba4 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4717b2fc0a654a77b40da565e599203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0154660c274106ab83ae50927348c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:58.614451 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a158f8ba-1a5c-433e-b62b-35453f1c9ba4 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] 10.222.0.50 "GET /compute/v2.1/servers/1dc405fa-b1a4-4acc-8236-06a24e979f5e" status: 200 len: 1316 microversion: 2.1 time: 1.788815 Aug 31 16:08:58.631697 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1929/3695] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:56 2022] GET /compute/v2.1/servers/1dc405fa-b1a4-4acc-8236-06a24e979f5e => generated 1316 bytes in 1818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:58.643128 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-4e26d235-4e43-4089-b757-af5ba4996384 req-2b3ae629-172e-4290-8d4c-fc410bb48e2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f61252b4-88c9-422d-9849-c7dec9b67380", "name": "network-vif-deleted", "tag": "6e091963-d476-442f-be98-d698e8835325"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:08:58.671634 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-4e26d235-4e43-4089-b757-af5ba4996384 req-2b3ae629-172e-4290-8d4c-fc410bb48e2c service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:58.675092 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-4e26d235-4e43-4089-b757-af5ba4996384 req-2b3ae629-172e-4290-8d4c-fc410bb48e2c service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:58.676216 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-4e26d235-4e43-4089-b757-af5ba4996384 req-2b3ae629-172e-4290-8d4c-fc410bb48e2c service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:58.713577 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-4e26d235-4e43-4089-b757-af5ba4996384 req-2b3ae629-172e-4290-8d4c-fc410bb48e2c service nova] Creating event network-vif-deleted:6e091963-d476-442f-be98-d698e8835325 for instance f61252b4-88c9-422d-9849-c7dec9b67380 on n-h1-833090-16 Aug 31 16:08:58.733164 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-4e26d235-4e43-4089-b757-af5ba4996384 req-2b3ae629-172e-4290-8d4c-fc410bb48e2c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099114 Aug 31 16:08:58.735714 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1930/3696] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:08:58.753879 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f6815f9f-c8d0-468f-b361-289e353065da tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:58.756263 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f6815f9f-c8d0-468f-b361-289e353065da tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:58.774755 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f6815f9f-c8d0-468f-b361-289e353065da tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:58.775735 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f6815f9f-c8d0-468f-b361-289e353065da tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:58.776438 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f6815f9f-c8d0-468f-b361-289e353065da tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:58.777466 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f6815f9f-c8d0-468f-b361-289e353065da tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:58.778255 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f6815f9f-c8d0-468f-b361-289e353065da tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:58.778941 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f6815f9f-c8d0-468f-b361-289e353065da tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:58.868036 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-910ebb0b-41ec-4964-87bd-cb5879806659 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:58.894545 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-910ebb0b-41ec-4964-87bd-cb5879806659 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:58.903422 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-910ebb0b-41ec-4964-87bd-cb5879806659 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:58.912467 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-910ebb0b-41ec-4964-87bd-cb5879806659 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1603 microversion: 2.32 time: 0.415141 Aug 31 16:08:58.915036 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1767/3697] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:08:58 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1603 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:08:59.025368 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f6815f9f-c8d0-468f-b361-289e353065da tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:08:59.046254 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f6815f9f-c8d0-468f-b361-289e353065da tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc" status: 200 len: 1600 microversion: 2.1 time: 0.308349 Aug 31 16:08:59.067880 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1931/3698] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:58 2022] GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc => generated 1600 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:08:59.146644 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a6fb5204-c61b-45e8-8c52-959dc3c5ba87 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:59.147752 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a6fb5204-c61b-45e8-8c52-959dc3c5ba87 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: f61252b4-88c9-422d-9849-c7dec9b67380] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:59.170129 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a6fb5204-c61b-45e8-8c52-959dc3c5ba87 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:59.174000 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a6fb5204-c61b-45e8-8c52-959dc3c5ba87 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:59.175660 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a6fb5204-c61b-45e8-8c52-959dc3c5ba87 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:59.176827 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a6fb5204-c61b-45e8-8c52-959dc3c5ba87 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:59.184854 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a6fb5204-c61b-45e8-8c52-959dc3c5ba87 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:59.187325 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a6fb5204-c61b-45e8-8c52-959dc3c5ba87 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:59.221999 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-a6fb5204-c61b-45e8-8c52-959dc3c5ba87 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] HTTP exception thrown: Instance f61252b4-88c9-422d-9849-c7dec9b67380 could not be found. Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a6fb5204-c61b-45e8-8c52-959dc3c5ba87 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Request method failure captured: Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/f61252b4-88c9-422d-9849-c7dec9b67380 HTTP/1.1 Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4VKUAYKz-WFBtmk16aIOyXYR2HhyYuZ36VRZsBRjqviBnc5RSPRJJqpoARQYteX5NSEljs3qX5_RMCYaeMof8M6i0ZB3mJgVdRhk2nIL2yk-7L_KhuV1lL_MMec1r7AAygDhG-639IQUe0ED7x0P_yoZ7NSrcY8NXkYeyVxFn3mUyo Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 11ef5102f83142d1a52befe52c3595d4 Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerActionsTestJSON-1629819008 Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/11ef5102f83142d1a52befe52c3595d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/11ef5102f83142d1a52befe52c3595d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/11ef5102f83142d1a52befe52c3595d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_11ef5102f83142d1a52befe52c3595d4", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServerActionsTestJSON-1629819008 Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 11ef5102f83142d1a52befe52c3595d4 Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerActionsTestJSON-1629819008 Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServerActionsTestJSON-1629819008-project Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: aeeaf32202f747c8a2b98836f503aa7e Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServerActionsTestJSON-1629819008-project Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance f61252b4-88c9-422d-9849-c7dec9b67380 could not be found. Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'f61252b4-88c9-422d-9849-c7dec9b67380'} Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f61252b4-88c9-422d-9849-c7dec9b67380 could not be found. Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f61252b4-88c9-422d-9849-c7dec9b67380 could not be found. Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:08:59.223724 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:08:59.227149 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:08:59.227149 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:08:59.227149 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:08:59.227149 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:08:59.227149 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:08:59.227149 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f61252b4-88c9-422d-9849-c7dec9b67380 could not be found. Aug 31 16:08:59.227149 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:08:59.233684 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a6fb5204-c61b-45e8-8c52-959dc3c5ba87 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Returning 404 to user: Instance f61252b4-88c9-422d-9849-c7dec9b67380 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:08:59.234827 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a6fb5204-c61b-45e8-8c52-959dc3c5ba87 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/f61252b4-88c9-422d-9849-c7dec9b67380" status: 404 len: 111 microversion: 2.1 time: 0.093247 Aug 31 16:08:59.235758 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1768/3699] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:59 2022] GET /compute/v2.1/servers/f61252b4-88c9-422d-9849-c7dec9b67380 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:08:59.244549 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c460aa16-c97e-42c9-b7b2-597089e7e5a8 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:59.245378 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c460aa16-c97e-42c9-b7b2-597089e7e5a8 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 99a904a8-aa6f-468e-a869-07cb3c5a1053] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:59.260949 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c460aa16-c97e-42c9-b7b2-597089e7e5a8 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:59.263428 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c460aa16-c97e-42c9-b7b2-597089e7e5a8 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:59.270954 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c460aa16-c97e-42c9-b7b2-597089e7e5a8 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:59.272477 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c460aa16-c97e-42c9-b7b2-597089e7e5a8 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:59.274933 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c460aa16-c97e-42c9-b7b2-597089e7e5a8 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:59.275655 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c460aa16-c97e-42c9-b7b2-597089e7e5a8 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:59.365921 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c460aa16-c97e-42c9-b7b2-597089e7e5a8 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 99a904a8-aa6f-468e-a869-07cb3c5a1053] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:08:59.506983 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:08:59.639685 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-af116c17-aa15-46d7-99a7-547778e58c2e tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:59.640365 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-af116c17-aa15-46d7-99a7-547778e58c2e tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] [instance: 1dc405fa-b1a4-4acc-8236-06a24e979f5e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:59.652041 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af116c17-aa15-46d7-99a7-547778e58c2e tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:59.652813 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af116c17-aa15-46d7-99a7-547778e58c2e tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:59.653565 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af116c17-aa15-46d7-99a7-547778e58c2e tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:59.654751 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af116c17-aa15-46d7-99a7-547778e58c2e tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:59.655503 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af116c17-aa15-46d7-99a7-547778e58c2e tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:59.656274 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af116c17-aa15-46d7-99a7-547778e58c2e tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:59.662423 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c460aa16-c97e-42c9-b7b2-597089e7e5a8 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "DELETE /compute/v2.1/servers/99a904a8-aa6f-468e-a869-07cb3c5a1053" status: 204 len: 0 microversion: 2.1 time: 0.421139 Aug 31 16:08:59.663909 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1932/3700] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:08:59 2022] DELETE /compute/v2.1/servers/99a904a8-aa6f-468e-a869-07cb3c5a1053 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:08:59.674972 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-256743a5-72a5-40b1-938a-aefa10add8f1 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:08:59.675717 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-256743a5-72a5-40b1-938a-aefa10add8f1 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 99a904a8-aa6f-468e-a869-07cb3c5a1053] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:08:59.693438 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-256743a5-72a5-40b1-938a-aefa10add8f1 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:59.693935 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-256743a5-72a5-40b1-938a-aefa10add8f1 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:59.694408 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-256743a5-72a5-40b1-938a-aefa10add8f1 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:08:59.695114 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-256743a5-72a5-40b1-938a-aefa10add8f1 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:08:59.695562 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-256743a5-72a5-40b1-938a-aefa10add8f1 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:08:59.695978 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-256743a5-72a5-40b1-938a-aefa10add8f1 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:00.570993 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-256743a5-72a5-40b1-938a-aefa10add8f1 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:00.585371 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-af116c17-aa15-46d7-99a7-547778e58c2e tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4717b2fc0a654a77b40da565e599203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0154660c274106ab83ae50927348c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:00.585940 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-256743a5-72a5-40b1-938a-aefa10add8f1 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/99a904a8-aa6f-468e-a869-07cb3c5a1053" status: 200 len: 1507 microversion: 2.1 time: 0.917349 Aug 31 16:09:00.586844 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1933/3701] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:59 2022] GET /compute/v2.1/servers/99a904a8-aa6f-468e-a869-07cb3c5a1053 => generated 1507 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:09:00.598619 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-4fe19e28-b135-4981-9eab-8269e2eabf48 req-3a9f3f60-de36-4837-99c4-24b7bbed1c8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dc405fa-b1a4-4acc-8236-06a24e979f5e", "name": "network-vif-plugged", "status": "completed", "tag": "b43723c2-c0d3-4a50-abf3-a3313299f8e1"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:09:00.616646 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-af116c17-aa15-46d7-99a7-547778e58c2e tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] 10.222.0.50 "GET /compute/v2.1/servers/1dc405fa-b1a4-4acc-8236-06a24e979f5e" status: 200 len: 1316 microversion: 2.1 time: 0.982311 Aug 31 16:09:00.618369 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1769/3702] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:08:59 2022] GET /compute/v2.1/servers/1dc405fa-b1a4-4acc-8236-06a24e979f5e => generated 1316 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:09:00.634042 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-4fe19e28-b135-4981-9eab-8269e2eabf48 req-3a9f3f60-de36-4837-99c4-24b7bbed1c8f service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:00.634919 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-4fe19e28-b135-4981-9eab-8269e2eabf48 req-3a9f3f60-de36-4837-99c4-24b7bbed1c8f service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:00.635530 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-4fe19e28-b135-4981-9eab-8269e2eabf48 req-3a9f3f60-de36-4837-99c4-24b7bbed1c8f service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:00.639700 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ce5b7374-acc0-4242-b073-14548575fec6 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:00.645299 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ce5b7374-acc0-4242-b073-14548575fec6 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:00.651740 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-4fe19e28-b135-4981-9eab-8269e2eabf48 req-3a9f3f60-de36-4837-99c4-24b7bbed1c8f service nova] Creating event network-vif-plugged:b43723c2-c0d3-4a50-abf3-a3313299f8e1 for instance 1dc405fa-b1a4-4acc-8236-06a24e979f5e on n-h1-833090-16 Aug 31 16:09:00.660517 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-4fe19e28-b135-4981-9eab-8269e2eabf48 req-3a9f3f60-de36-4837-99c4-24b7bbed1c8f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071558 Aug 31 16:09:00.662567 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1934/3703] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:09:00.672884 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-60fd0b3d-c5c5-4f77-8dfc-3281e1f54063 req-a14c43b0-f456-4860-9fc2-bdcba652b5a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "027ef860-8ede-472c-9099-befdc2cde7bc", "name": "network-vif-deleted", "tag": "f3ddf80b-0487-4257-b3e5-b64f7214f531"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:09:00.680793 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce5b7374-acc0-4242-b073-14548575fec6 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:00.681278 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce5b7374-acc0-4242-b073-14548575fec6 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:00.696774 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-60fd0b3d-c5c5-4f77-8dfc-3281e1f54063 req-a14c43b0-f456-4860-9fc2-bdcba652b5a6 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:00.699726 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-60fd0b3d-c5c5-4f77-8dfc-3281e1f54063 req-a14c43b0-f456-4860-9fc2-bdcba652b5a6 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:00.702066 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-60fd0b3d-c5c5-4f77-8dfc-3281e1f54063 req-a14c43b0-f456-4860-9fc2-bdcba652b5a6 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:00.702496 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce5b7374-acc0-4242-b073-14548575fec6 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:00.703457 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce5b7374-acc0-4242-b073-14548575fec6 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:00.706205 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce5b7374-acc0-4242-b073-14548575fec6 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:00.708673 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce5b7374-acc0-4242-b073-14548575fec6 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:00.724682 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-60fd0b3d-c5c5-4f77-8dfc-3281e1f54063 req-a14c43b0-f456-4860-9fc2-bdcba652b5a6 service nova] Creating event network-vif-deleted:f3ddf80b-0487-4257-b3e5-b64f7214f531 for instance 027ef860-8ede-472c-9099-befdc2cde7bc on n-h2-833090-16 Aug 31 16:09:00.732831 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-60fd0b3d-c5c5-4f77-8dfc-3281e1f54063 req-a14c43b0-f456-4860-9fc2-bdcba652b5a6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067810 Aug 31 16:09:00.733999 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1935/3704] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:09:00.741393 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c89c2ec5-c56b-47b7-9e22-b974c7cb9858 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:00.742873 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c89c2ec5-c56b-47b7-9e22-b974c7cb9858 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:00.752278 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c89c2ec5-c56b-47b7-9e22-b974c7cb9858 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:00.753120 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c89c2ec5-c56b-47b7-9e22-b974c7cb9858 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:00.753715 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c89c2ec5-c56b-47b7-9e22-b974c7cb9858 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:00.754632 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c89c2ec5-c56b-47b7-9e22-b974c7cb9858 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:00.755285 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c89c2ec5-c56b-47b7-9e22-b974c7cb9858 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:00.756552 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c89c2ec5-c56b-47b7-9e22-b974c7cb9858 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:00.818302 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c89c2ec5-c56b-47b7-9e22-b974c7cb9858 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:00.820475 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c89c2ec5-c56b-47b7-9e22-b974c7cb9858 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:00.821794 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c89c2ec5-c56b-47b7-9e22-b974c7cb9858 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:00.822666 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-c89c2ec5-c56b-47b7-9e22-b974c7cb9858 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lazy-loading 'fault' on Instance uuid 027ef860-8ede-472c-9099-befdc2cde7bc {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:09:00.924802 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ce5b7374-acc0-4242-b073-14548575fec6 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:00.948096 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ce5b7374-acc0-4242-b073-14548575fec6 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:00.952151 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ce5b7374-acc0-4242-b073-14548575fec6 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:00.956368 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ce5b7374-acc0-4242-b073-14548575fec6 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1603 microversion: 2.32 time: 0.336809 Aug 31 16:09:00.978223 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1770/3705] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:09:00 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1603 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:09:01.295055 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c89c2ec5-c56b-47b7-9e22-b974c7cb9858 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:01.308344 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c89c2ec5-c56b-47b7-9e22-b974c7cb9858 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc" status: 200 len: 1324 microversion: 2.1 time: 0.571788 Aug 31 16:09:01.310758 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1936/3706] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:00 2022] GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc => generated 1324 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:01.611934 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4c544af4-063a-46d8-a613-c8b333a02523 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:01.612724 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4c544af4-063a-46d8-a613-c8b333a02523 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 99a904a8-aa6f-468e-a869-07cb3c5a1053] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:01.636664 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c544af4-063a-46d8-a613-c8b333a02523 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:01.640148 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c544af4-063a-46d8-a613-c8b333a02523 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:01.645178 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c544af4-063a-46d8-a613-c8b333a02523 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:01.651849 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8c333f76-230c-4fd3-bb7a-e318b7ad3d08 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:01.653722 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8c333f76-230c-4fd3-bb7a-e318b7ad3d08 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] [instance: 1dc405fa-b1a4-4acc-8236-06a24e979f5e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:01.658543 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c544af4-063a-46d8-a613-c8b333a02523 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:01.659396 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c544af4-063a-46d8-a613-c8b333a02523 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:01.661376 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c544af4-063a-46d8-a613-c8b333a02523 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:01.672504 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8c333f76-230c-4fd3-bb7a-e318b7ad3d08 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:01.673710 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8c333f76-230c-4fd3-bb7a-e318b7ad3d08 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:01.675453 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8c333f76-230c-4fd3-bb7a-e318b7ad3d08 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:01.682023 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8c333f76-230c-4fd3-bb7a-e318b7ad3d08 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:01.684854 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8c333f76-230c-4fd3-bb7a-e318b7ad3d08 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:01.685612 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8c333f76-230c-4fd3-bb7a-e318b7ad3d08 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:02.161850 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4c544af4-063a-46d8-a613-c8b333a02523 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:02.181555 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4c544af4-063a-46d8-a613-c8b333a02523 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/99a904a8-aa6f-468e-a869-07cb3c5a1053" status: 200 len: 1507 microversion: 2.1 time: 0.577272 Aug 31 16:09:02.182174 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1771/3707] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:01 2022] GET /compute/v2.1/servers/99a904a8-aa6f-468e-a869-07cb3c5a1053 => generated 1507 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:02.200238 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-da719be3-494f-40b1-9dc7-43b8f8b62ed1 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:02.202705 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-da719be3-494f-40b1-9dc7-43b8f8b62ed1 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:02.219071 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da719be3-494f-40b1-9dc7-43b8f8b62ed1 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:02.223786 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da719be3-494f-40b1-9dc7-43b8f8b62ed1 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:02.224436 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da719be3-494f-40b1-9dc7-43b8f8b62ed1 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:02.225463 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da719be3-494f-40b1-9dc7-43b8f8b62ed1 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:02.226061 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da719be3-494f-40b1-9dc7-43b8f8b62ed1 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:02.226717 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da719be3-494f-40b1-9dc7-43b8f8b62ed1 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:02.274401 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-da719be3-494f-40b1-9dc7-43b8f8b62ed1 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] HTTP exception thrown: Instance 0e89e500-ddc5-4549-8631-9d62545016d1 could not be found. Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-da719be3-494f-40b1-9dc7-43b8f8b62ed1 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Request method failure captured: Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 HTTP/1.1 Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4W3pxsmI_O0CKYqbSnKeXjFih872LQR3ir6CewyOdbcDSh01P8ru0Q2zH7N2eAZX2kU7monFnXBdcnh6BjsJwBfg-ade-bQlv9wbNsSvVwB23U5Ea03g6bAigOHHca7KQMOBmWarPE8vZEqv7lMRHOciAOH48VE_jQtCknDj7JkCtI Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: X-Openstack-Nova-Api-Version: 2.42 Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 6550e3f42bfe4992aee45af34476da97 Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-109748479 Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6550e3f42bfe4992aee45af34476da97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6550e3f42bfe4992aee45af34476da97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6550e3f42bfe4992aee45af34476da97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6550e3f42bfe4992aee45af34476da97", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-TaggedBootDevicesTest_v242-109748479 Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 6550e3f42bfe4992aee45af34476da97 Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-109748479 Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-TaggedBootDevicesTest_v242-109748479-project Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: e8f9f728562f4d66b8039435235c655c Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-TaggedBootDevicesTest_v242-109748479-project Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 0e89e500-ddc5-4549-8631-9d62545016d1 could not be found. Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '0e89e500-ddc5-4549-8631-9d62545016d1'} Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e89e500-ddc5-4549-8631-9d62545016d1 could not be found. Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:09:02.277299 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:09:02.280728 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e89e500-ddc5-4549-8631-9d62545016d1 could not be found. Aug 31 16:09:02.280728 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:09:02.280728 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:09:02.280728 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:09:02.280728 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:02.280728 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:09:02.280728 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:09:02.280728 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:09:02.280728 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:09:02.280728 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e89e500-ddc5-4549-8631-9d62545016d1 could not be found. Aug 31 16:09:02.280728 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:09:02.283138 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-da719be3-494f-40b1-9dc7-43b8f8b62ed1 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Returning 404 to user: Instance 0e89e500-ddc5-4549-8631-9d62545016d1 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:09:02.285140 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-da719be3-494f-40b1-9dc7-43b8f8b62ed1 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 404 len: 111 microversion: 2.42 time: 0.096771 Aug 31 16:09:02.286433 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1772/3708] 10.222.0.50 () {60 vars in 1280 bytes} [Wed Aug 31 16:09:02 2022] DELETE /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:09:02.300923 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f114b173-d6a0-4b88-b285-ab2ce1c3b9f4 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:02.301562 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f114b173-d6a0-4b88-b285-ab2ce1c3b9f4 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:02.346452 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f114b173-d6a0-4b88-b285-ab2ce1c3b9f4 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:02.346953 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f114b173-d6a0-4b88-b285-ab2ce1c3b9f4 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:02.350940 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f114b173-d6a0-4b88-b285-ab2ce1c3b9f4 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:02.351704 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f114b173-d6a0-4b88-b285-ab2ce1c3b9f4 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:02.353532 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f114b173-d6a0-4b88-b285-ab2ce1c3b9f4 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:02.356256 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f114b173-d6a0-4b88-b285-ab2ce1c3b9f4 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:02.399442 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8c333f76-230c-4fd3-bb7a-e318b7ad3d08 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4717b2fc0a654a77b40da565e599203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0154660c274106ab83ae50927348c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:02.413097 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8c333f76-230c-4fd3-bb7a-e318b7ad3d08 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] 10.222.0.50 "GET /compute/v2.1/servers/1dc405fa-b1a4-4acc-8236-06a24e979f5e" status: 200 len: 1316 microversion: 2.1 time: 0.761198 Aug 31 16:09:02.426639 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1937/3709] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:01 2022] GET /compute/v2.1/servers/1dc405fa-b1a4-4acc-8236-06a24e979f5e => generated 1316 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:09:02.436894 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ac4b1875-d014-4d72-9332-9556f6865fa4 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:02.437979 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ac4b1875-d014-4d72-9332-9556f6865fa4 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] [instance: 0e89e500-ddc5-4549-8631-9d62545016d1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:02.455890 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ac4b1875-d014-4d72-9332-9556f6865fa4 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:02.457104 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ac4b1875-d014-4d72-9332-9556f6865fa4 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:02.459427 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ac4b1875-d014-4d72-9332-9556f6865fa4 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:02.461209 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ac4b1875-d014-4d72-9332-9556f6865fa4 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:02.461842 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ac4b1875-d014-4d72-9332-9556f6865fa4 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:02.463876 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ac4b1875-d014-4d72-9332-9556f6865fa4 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:02.531598 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-ac4b1875-d014-4d72-9332-9556f6865fa4 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] HTTP exception thrown: Instance 0e89e500-ddc5-4549-8631-9d62545016d1 could not be found. Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ac4b1875-d014-4d72-9332-9556f6865fa4 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Request method failure captured: Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 HTTP/1.1 Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4W3pxsmI_O0CKYqbSnKeXjFih872LQR3ir6CewyOdbcDSh01P8ru0Q2zH7N2eAZX2kU7monFnXBdcnh6BjsJwBfg-ade-bQlv9wbNsSvVwB23U5Ea03g6bAigOHHca7KQMOBmWarPE8vZEqv7lMRHOciAOH48VE_jQtCknDj7JkCtI Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: X-Openstack-Nova-Api-Version: 2.42 Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 6550e3f42bfe4992aee45af34476da97 Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-109748479 Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6550e3f42bfe4992aee45af34476da97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6550e3f42bfe4992aee45af34476da97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6550e3f42bfe4992aee45af34476da97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6550e3f42bfe4992aee45af34476da97", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-TaggedBootDevicesTest_v242-109748479 Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 6550e3f42bfe4992aee45af34476da97 Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-109748479 Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-TaggedBootDevicesTest_v242-109748479-project Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: e8f9f728562f4d66b8039435235c655c Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-TaggedBootDevicesTest_v242-109748479-project Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 0e89e500-ddc5-4549-8631-9d62545016d1 could not be found. Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '0e89e500-ddc5-4549-8631-9d62545016d1'} Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e89e500-ddc5-4549-8631-9d62545016d1 could not be found. Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e89e500-ddc5-4549-8631-9d62545016d1 could not be found. Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:09:02.540423 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:09:02.543946 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:09:02.543946 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:02.543946 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:09:02.543946 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:09:02.543946 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:09:02.543946 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:09:02.543946 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e89e500-ddc5-4549-8631-9d62545016d1 could not be found. Aug 31 16:09:02.543946 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:09:02.543946 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ac4b1875-d014-4d72-9332-9556f6865fa4 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] Returning 404 to user: Instance 0e89e500-ddc5-4549-8631-9d62545016d1 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:09:02.545116 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ac4b1875-d014-4d72-9332-9556f6865fa4 tempest-TaggedBootDevicesTest_v242-109748479 tempest-TaggedBootDevicesTest_v242-109748479-project] 10.222.0.50 "GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1" status: 404 len: 111 microversion: 2.42 time: 0.117220 Aug 31 16:09:02.550791 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1938/3710] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:09:02 2022] GET /compute/v2.1/servers/0e89e500-ddc5-4549-8631-9d62545016d1 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:09:02.564980 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-49fea196-b646-4594-bf9b-cad5f60113ff tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:02.565812 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-49fea196-b646-4594-bf9b-cad5f60113ff tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 027ef860-8ede-472c-9099-befdc2cde7bc] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:02.573749 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f114b173-d6a0-4b88-b285-ab2ce1c3b9f4 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:02.584077 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-49fea196-b646-4594-bf9b-cad5f60113ff tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:02.586775 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-49fea196-b646-4594-bf9b-cad5f60113ff tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:02.588094 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-49fea196-b646-4594-bf9b-cad5f60113ff tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:02.589391 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-49fea196-b646-4594-bf9b-cad5f60113ff tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:02.591754 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-49fea196-b646-4594-bf9b-cad5f60113ff tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:02.593374 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-49fea196-b646-4594-bf9b-cad5f60113ff tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:02.595988 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f114b173-d6a0-4b88-b285-ab2ce1c3b9f4 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:02.599409 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f114b173-d6a0-4b88-b285-ab2ce1c3b9f4 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:02.609571 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f114b173-d6a0-4b88-b285-ab2ce1c3b9f4 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1603 microversion: 2.32 time: 0.318967 Aug 31 16:09:02.610903 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1773/3711] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:09:02 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1603 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:09:02.622479 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-b512e936-8bd7-474c-b955-07a0ae1ec2a3 req-95e23d32-31d8-4ee4-9cb6-84ab534e13e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99a904a8-aa6f-468e-a869-07cb3c5a1053", "name": "network-vif-deleted", "tag": "62908a26-9d9f-46fd-ab15-e46806202bf5"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:09:02.623142 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-49fea196-b646-4594-bf9b-cad5f60113ff tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] HTTP exception thrown: Instance 027ef860-8ede-472c-9099-befdc2cde7bc could not be found. Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-49fea196-b646-4594-bf9b-cad5f60113ff tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Request method failure captured: Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc HTTP/1.1 Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4WKvsbO08EL2S91UDZkibdodc8Ncpnx96A_z7G6JzDTVReVRJt4eaxqEagrCjiIt0sQK9L2XFjpe1FXBkALlUJ8tsVxARkQX1aQaJHXvorlxZYJqMjBiHR2B48FsHGsA1J11nYBrZ1wp73HofSCco1Rnc1vXSjVfKEu_sBy_NCjrg0 Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 1355779c2e2d4cfeb0825b76968867b1 Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-LiveMigrationTest-299357202 Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1355779c2e2d4cfeb0825b76968867b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1355779c2e2d4cfeb0825b76968867b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/1355779c2e2d4cfeb0825b76968867b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_1355779c2e2d4cfeb0825b76968867b1", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-LiveMigrationTest-299357202 Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 1355779c2e2d4cfeb0825b76968867b1 Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-LiveMigrationTest-299357202 Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-LiveMigrationTest-299357202-project Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: b9840c71c4ec49c1a60ef97943d173ef Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-LiveMigrationTest-299357202-project Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 027ef860-8ede-472c-9099-befdc2cde7bc could not be found. Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '027ef860-8ede-472c-9099-befdc2cde7bc'} Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 027ef860-8ede-472c-9099-befdc2cde7bc could not be found. Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 027ef860-8ede-472c-9099-befdc2cde7bc could not be found. Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:09:02.624767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:09:02.628470 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:02.628470 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:09:02.628470 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:09:02.628470 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:09:02.628470 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:09:02.628470 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 027ef860-8ede-472c-9099-befdc2cde7bc could not be found. Aug 31 16:09:02.628470 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:09:02.628470 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-49fea196-b646-4594-bf9b-cad5f60113ff tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Returning 404 to user: Instance 027ef860-8ede-472c-9099-befdc2cde7bc could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:09:02.632789 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-49fea196-b646-4594-bf9b-cad5f60113ff tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc" status: 404 len: 111 microversion: 2.1 time: 0.074906 Aug 31 16:09:02.638969 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1939/3712] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:02 2022] GET /compute/v2.1/servers/027ef860-8ede-472c-9099-befdc2cde7bc => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:09:02.654766 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b512e936-8bd7-474c-b955-07a0ae1ec2a3 req-95e23d32-31d8-4ee4-9cb6-84ab534e13e1 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:02.655400 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b512e936-8bd7-474c-b955-07a0ae1ec2a3 req-95e23d32-31d8-4ee4-9cb6-84ab534e13e1 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:02.655978 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b512e936-8bd7-474c-b955-07a0ae1ec2a3 req-95e23d32-31d8-4ee4-9cb6-84ab534e13e1 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:02.662065 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6669fa7f-224d-46e3-b8cc-13dee49ffaa6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '.version_select at 0x7fbb4613d670>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:02.689544 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-b512e936-8bd7-474c-b955-07a0ae1ec2a3 req-95e23d32-31d8-4ee4-9cb6-84ab534e13e1 service nova] Creating event network-vif-deleted:62908a26-9d9f-46fd-ab15-e46806202bf5 for instance 99a904a8-aa6f-468e-a869-07cb3c5a1053 on n-h1-833090-16 Aug 31 16:09:02.698760 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-b512e936-8bd7-474c-b955-07a0ae1ec2a3 req-95e23d32-31d8-4ee4-9cb6-84ab534e13e1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086080 Aug 31 16:09:02.699623 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1774/3713] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:09:02.731999 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6669fa7f-224d-46e3-b8cc-13dee49ffaa6 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1726072840" status: 202 len: 0 microversion: 2.1 time: 0.089431 Aug 31 16:09:02.736092 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1940/3714] 10.222.0.50 () {58 vars in 1221 bytes} [Wed Aug 31 16:09:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1726072840 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:09:02.777687 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-29a1cd5a-4eee-496c-bc81-c805dd969a39 req-487c25b5-a900-4c3e-93c7-ae081d6950f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad0b8fd6-eec9-42fe-91af-a7904d758c93", "name": "network-vif-plugged", "status": "completed", "tag": "71c89454-6693-4742-a290-7b5d85bf00d5"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:09:02.801209 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-29a1cd5a-4eee-496c-bc81-c805dd969a39 req-487c25b5-a900-4c3e-93c7-ae081d6950f7 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:02.804533 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-29a1cd5a-4eee-496c-bc81-c805dd969a39 req-487c25b5-a900-4c3e-93c7-ae081d6950f7 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:02.806313 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-29a1cd5a-4eee-496c-bc81-c805dd969a39 req-487c25b5-a900-4c3e-93c7-ae081d6950f7 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:02.844695 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-29a1cd5a-4eee-496c-bc81-c805dd969a39 req-487c25b5-a900-4c3e-93c7-ae081d6950f7 service nova] Creating event network-vif-plugged:71c89454-6693-4742-a290-7b5d85bf00d5 for instance ad0b8fd6-eec9-42fe-91af-a7904d758c93 on n-h2-833090-16 Aug 31 16:09:02.858583 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-29a1cd5a-4eee-496c-bc81-c805dd969a39 req-487c25b5-a900-4c3e-93c7-ae081d6950f7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083312 Aug 31 16:09:02.861920 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1775/3715] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:09:03.209476 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1530b14e-5295-47ef-a3b0-72e3c0f87899 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:03.210119 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1530b14e-5295-47ef-a3b0-72e3c0f87899 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 99a904a8-aa6f-468e-a869-07cb3c5a1053] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:03.225814 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1530b14e-5295-47ef-a3b0-72e3c0f87899 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:03.226440 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1530b14e-5295-47ef-a3b0-72e3c0f87899 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:03.226902 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1530b14e-5295-47ef-a3b0-72e3c0f87899 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:03.231758 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1530b14e-5295-47ef-a3b0-72e3c0f87899 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:03.232168 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1530b14e-5295-47ef-a3b0-72e3c0f87899 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:03.232798 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1530b14e-5295-47ef-a3b0-72e3c0f87899 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:03.311479 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1530b14e-5295-47ef-a3b0-72e3c0f87899 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:03.312001 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1530b14e-5295-47ef-a3b0-72e3c0f87899 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:03.312456 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1530b14e-5295-47ef-a3b0-72e3c0f87899 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:03.313110 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-1530b14e-5295-47ef-a3b0-72e3c0f87899 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lazy-loading 'fault' on Instance uuid 99a904a8-aa6f-468e-a869-07cb3c5a1053 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:09:03.450476 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-aba41503-0002-482f-bb6c-55cabaddb60a tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:03.451313 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-aba41503-0002-482f-bb6c-55cabaddb60a tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] [instance: 1dc405fa-b1a4-4acc-8236-06a24e979f5e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:03.468122 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aba41503-0002-482f-bb6c-55cabaddb60a tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:03.468684 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aba41503-0002-482f-bb6c-55cabaddb60a tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:03.470859 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aba41503-0002-482f-bb6c-55cabaddb60a tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:03.471608 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aba41503-0002-482f-bb6c-55cabaddb60a tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:03.472102 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aba41503-0002-482f-bb6c-55cabaddb60a tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:03.472580 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aba41503-0002-482f-bb6c-55cabaddb60a tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:03.527902 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1530b14e-5295-47ef-a3b0-72e3c0f87899 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:03.544977 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1530b14e-5295-47ef-a3b0-72e3c0f87899 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/99a904a8-aa6f-468e-a869-07cb3c5a1053" status: 200 len: 1304 microversion: 2.1 time: 0.338835 Aug 31 16:09:03.548151 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1941/3716] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:03 2022] GET /compute/v2.1/servers/99a904a8-aa6f-468e-a869-07cb3c5a1053 => generated 1304 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:03.639572 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-51842c36-2098-4982-9753-2f5012492227 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:03.641062 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-51842c36-2098-4982-9753-2f5012492227 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:03.651821 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51842c36-2098-4982-9753-2f5012492227 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:03.654019 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51842c36-2098-4982-9753-2f5012492227 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:03.659228 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51842c36-2098-4982-9753-2f5012492227 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:03.660288 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51842c36-2098-4982-9753-2f5012492227 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:03.660942 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51842c36-2098-4982-9753-2f5012492227 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:03.661549 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51842c36-2098-4982-9753-2f5012492227 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:04.109278 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-51842c36-2098-4982-9753-2f5012492227 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:04.136812 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-51842c36-2098-4982-9753-2f5012492227 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:04.139700 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-51842c36-2098-4982-9753-2f5012492227 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:04.142441 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-51842c36-2098-4982-9753-2f5012492227 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1603 microversion: 2.32 time: 0.507442 Aug 31 16:09:04.143619 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1942/3717] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:09:03 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1603 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:09:04.150630 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3e7b5d2c-9e08-4e28-b242-f48a5f780c18 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-771056693", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:09:04.216703 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-3e7b5d2c-9e08-4e28-b242-f48a5f780c18 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] validate_networks() for None {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:09:04.531439 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-aba41503-0002-482f-bb6c-55cabaddb60a tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4717b2fc0a654a77b40da565e599203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0154660c274106ab83ae50927348c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:04.554476 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-aba41503-0002-482f-bb6c-55cabaddb60a tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] 10.222.0.50 "GET /compute/v2.1/servers/1dc405fa-b1a4-4acc-8236-06a24e979f5e" status: 200 len: 1503 microversion: 2.1 time: 1.119231 Aug 31 16:09:04.555313 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1776/3718] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:03 2022] GET /compute/v2.1/servers/1dc405fa-b1a4-4acc-8236-06a24e979f5e => generated 1503 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:09:04.569235 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ab9a991c-957b-420e-b18f-0c7c1edb7207 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:04.570695 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ab9a991c-957b-420e-b18f-0c7c1edb7207 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 99a904a8-aa6f-468e-a869-07cb3c5a1053] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:04.590947 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab9a991c-957b-420e-b18f-0c7c1edb7207 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:04.591623 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab9a991c-957b-420e-b18f-0c7c1edb7207 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:04.592254 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab9a991c-957b-420e-b18f-0c7c1edb7207 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:04.593330 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab9a991c-957b-420e-b18f-0c7c1edb7207 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:04.598814 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab9a991c-957b-420e-b18f-0c7c1edb7207 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:04.599593 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab9a991c-957b-420e-b18f-0c7c1edb7207 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:04.633076 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-ab9a991c-957b-420e-b18f-0c7c1edb7207 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] HTTP exception thrown: Instance 99a904a8-aa6f-468e-a869-07cb3c5a1053 could not be found. Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ab9a991c-957b-420e-b18f-0c7c1edb7207 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Request method failure captured: Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/99a904a8-aa6f-468e-a869-07cb3c5a1053 HTTP/1.1 Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4VKUAYKz-WFBtmk16aIOyXYR2HhyYuZ36VRZsBRjqviBnc5RSPRJJqpoARQYteX5NSEljs3qX5_RMCYaeMof8M6i0ZB3mJgVdRhk2nIL2yk-7L_KhuV1lL_MMec1r7AAygDhG-639IQUe0ED7x0P_yoZ7NSrcY8NXkYeyVxFn3mUyo Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 11ef5102f83142d1a52befe52c3595d4 Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerActionsTestJSON-1629819008 Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/11ef5102f83142d1a52befe52c3595d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/11ef5102f83142d1a52befe52c3595d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/11ef5102f83142d1a52befe52c3595d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_11ef5102f83142d1a52befe52c3595d4", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServerActionsTestJSON-1629819008 Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 11ef5102f83142d1a52befe52c3595d4 Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerActionsTestJSON-1629819008 Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServerActionsTestJSON-1629819008-project Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: aeeaf32202f747c8a2b98836f503aa7e Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServerActionsTestJSON-1629819008-project Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 99a904a8-aa6f-468e-a869-07cb3c5a1053 could not be found. Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '99a904a8-aa6f-468e-a869-07cb3c5a1053'} Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99a904a8-aa6f-468e-a869-07cb3c5a1053 could not be found. Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99a904a8-aa6f-468e-a869-07cb3c5a1053 could not be found. Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:09:04.639379 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:09:04.643526 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:04.643526 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:09:04.643526 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:09:04.643526 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:09:04.643526 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:09:04.643526 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99a904a8-aa6f-468e-a869-07cb3c5a1053 could not be found. Aug 31 16:09:04.643526 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:09:04.645686 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ab9a991c-957b-420e-b18f-0c7c1edb7207 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Returning 404 to user: Instance 99a904a8-aa6f-468e-a869-07cb3c5a1053 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:09:04.651086 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ab9a991c-957b-420e-b18f-0c7c1edb7207 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/99a904a8-aa6f-468e-a869-07cb3c5a1053" status: 404 len: 111 microversion: 2.1 time: 0.085812 Aug 31 16:09:04.652016 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1777/3719] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:04 2022] GET /compute/v2.1/servers/99a904a8-aa6f-468e-a869-07cb3c5a1053 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:09:04.660469 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c2aa8464-a24d-4d23-9fd4-32071f1bb7de tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:04.662983 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c2aa8464-a24d-4d23-9fd4-32071f1bb7de tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] [instance: ad0b8fd6-eec9-42fe-91af-a7904d758c93] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:04.677438 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2aa8464-a24d-4d23-9fd4-32071f1bb7de tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:04.686643 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2aa8464-a24d-4d23-9fd4-32071f1bb7de tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:04.687370 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2aa8464-a24d-4d23-9fd4-32071f1bb7de tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:04.688826 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2aa8464-a24d-4d23-9fd4-32071f1bb7de tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:04.689764 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2aa8464-a24d-4d23-9fd4-32071f1bb7de tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:04.690474 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2aa8464-a24d-4d23-9fd4-32071f1bb7de tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:04.777801 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-3e7b5d2c-9e08-4e28-b242-f48a5f780c18 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:09:04.778250 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-3e7b5d2c-9e08-4e28-b242-f48a5f780c18 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:09:04.779581 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-3e7b5d2c-9e08-4e28-b242-f48a5f780c18 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:09:04.779995 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-3e7b5d2c-9e08-4e28-b242-f48a5f780c18 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:09:04.780461 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-3e7b5d2c-9e08-4e28-b242-f48a5f780c18 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:09:04.803186 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3e7b5d2c-9e08-4e28-b242-f48a5f780c18 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:04.803678 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3e7b5d2c-9e08-4e28-b242-f48a5f780c18 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:04.804879 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3e7b5d2c-9e08-4e28-b242-f48a5f780c18 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:04.808526 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3e7b5d2c-9e08-4e28-b242-f48a5f780c18 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:04.809242 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3e7b5d2c-9e08-4e28-b242-f48a5f780c18 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:04.811474 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3e7b5d2c-9e08-4e28-b242-f48a5f780c18 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:04.871133 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-3e7b5d2c-9e08-4e28-b242-f48a5f780c18 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Getting quotas for project 2d874dc06bb94a3daffe23f9805ed0d2. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:09:04.887683 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-3e7b5d2c-9e08-4e28-b242-f48a5f780c18 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Getting quotas for user 2a92ad15ba984304b27f1e337f1bae65 and project 2d874dc06bb94a3daffe23f9805ed0d2. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:09:04.928309 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3e7b5d2c-9e08-4e28-b242-f48a5f780c18 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:09:04.935821 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3e7b5d2c-9e08-4e28-b242-f48a5f780c18 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] [instance: 76a65fbc-5d3d-4759-ba22-cf7751f0a6b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:09:05.035029 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3e7b5d2c-9e08-4e28-b242-f48a5f780c18 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.889419 Aug 31 16:09:05.036136 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1943/3720] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:09:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:09:05.049285 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9c68847e-0939-4749-b6be-1c4d86432d25 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:05.050458 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9c68847e-0939-4749-b6be-1c4d86432d25 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 96bec4d7-3a20-4974-8865-51ef8fd087f6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:05.057942 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9c68847e-0939-4749-b6be-1c4d86432d25 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:05.058902 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9c68847e-0939-4749-b6be-1c4d86432d25 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:05.059547 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9c68847e-0939-4749-b6be-1c4d86432d25 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:05.061085 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9c68847e-0939-4749-b6be-1c4d86432d25 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:05.061802 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9c68847e-0939-4749-b6be-1c4d86432d25 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:05.062477 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9c68847e-0939-4749-b6be-1c4d86432d25 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:05.098547 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9c68847e-0939-4749-b6be-1c4d86432d25 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 96bec4d7-3a20-4974-8865-51ef8fd087f6] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:09:05.263975 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9c68847e-0939-4749-b6be-1c4d86432d25 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "DELETE /compute/v2.1/servers/96bec4d7-3a20-4974-8865-51ef8fd087f6" status: 204 len: 0 microversion: 2.1 time: 0.219182 Aug 31 16:09:05.268493 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1944/3721] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:09:05 2022] DELETE /compute/v2.1/servers/96bec4d7-3a20-4974-8865-51ef8fd087f6 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:09:05.276146 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e04f6bf5-6adc-47c6-87da-68d3d6ab94fe tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:05.276952 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e04f6bf5-6adc-47c6-87da-68d3d6ab94fe tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: b242124a-1ecd-4762-babd-96246ccb7ceb] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:05.292944 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e04f6bf5-6adc-47c6-87da-68d3d6ab94fe tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:05.293511 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e04f6bf5-6adc-47c6-87da-68d3d6ab94fe tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:05.293987 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e04f6bf5-6adc-47c6-87da-68d3d6ab94fe tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:05.295117 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e04f6bf5-6adc-47c6-87da-68d3d6ab94fe tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:05.295665 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e04f6bf5-6adc-47c6-87da-68d3d6ab94fe tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:05.296342 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e04f6bf5-6adc-47c6-87da-68d3d6ab94fe tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:05.418535 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e04f6bf5-6adc-47c6-87da-68d3d6ab94fe tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: b242124a-1ecd-4762-babd-96246ccb7ceb] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:09:05.758765 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e04f6bf5-6adc-47c6-87da-68d3d6ab94fe tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b242124a-1ecd-4762-babd-96246ccb7ceb" status: 204 len: 0 microversion: 2.1 time: 0.487324 Aug 31 16:09:05.760902 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1945/3722] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:09:05 2022] DELETE /compute/v2.1/servers/b242124a-1ecd-4762-babd-96246ccb7ceb => generated 0 bytes in 492 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:09:05.778827 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8ef3fc56-67d7-4a54-8639-75f6aa901722 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:05.779736 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8ef3fc56-67d7-4a54-8639-75f6aa901722 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] [instance: 76a65fbc-5d3d-4759-ba22-cf7751f0a6b3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:05.782143 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=5,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:09:05.925864 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8ef3fc56-67d7-4a54-8639-75f6aa901722 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a92ad15ba984304b27f1e337f1bae65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d874dc06bb94a3daffe23f9805ed0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:05.936731 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8ef3fc56-67d7-4a54-8639-75f6aa901722 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] 10.222.0.50 "GET /compute/v2.1/servers/76a65fbc-5d3d-4759-ba22-cf7751f0a6b3" status: 200 len: 1214 microversion: 2.1 time: 0.171482 Aug 31 16:09:05.938767 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1946/3723] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:05 2022] GET /compute/v2.1/servers/76a65fbc-5d3d-4759-ba22-cf7751f0a6b3 => generated 1214 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:05.952894 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4da95302-7d0e-40db-b7d1-e1df683ef2a9 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:05.956946 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4da95302-7d0e-40db-b7d1-e1df683ef2a9 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:05.975678 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4da95302-7d0e-40db-b7d1-e1df683ef2a9 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:05.976360 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4da95302-7d0e-40db-b7d1-e1df683ef2a9 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:05.977412 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4da95302-7d0e-40db-b7d1-e1df683ef2a9 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:05.978755 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4da95302-7d0e-40db-b7d1-e1df683ef2a9 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:05.980702 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4da95302-7d0e-40db-b7d1-e1df683ef2a9 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:05.982379 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4da95302-7d0e-40db-b7d1-e1df683ef2a9 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:06.168706 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c2aa8464-a24d-4d23-9fd4-32071f1bb7de tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4717b2fc0a654a77b40da565e599203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0154660c274106ab83ae50927348c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:06.181135 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c2aa8464-a24d-4d23-9fd4-32071f1bb7de tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] 10.222.0.50 "GET /compute/v2.1/servers/ad0b8fd6-eec9-42fe-91af-a7904d758c93" status: 200 len: 1316 microversion: 2.1 time: 1.527301 Aug 31 16:09:06.184330 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1778/3724] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:04 2022] GET /compute/v2.1/servers/ad0b8fd6-eec9-42fe-91af-a7904d758c93 => generated 1316 bytes in 1531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:06.194458 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-eb7a6035-b336-4624-9da6-a6e2dc9ac344 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:06.197501 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-eb7a6035-b336-4624-9da6-a6e2dc9ac344 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 96bec4d7-3a20-4974-8865-51ef8fd087f6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:06.210164 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb7a6035-b336-4624-9da6-a6e2dc9ac344 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:06.211927 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb7a6035-b336-4624-9da6-a6e2dc9ac344 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:06.214114 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb7a6035-b336-4624-9da6-a6e2dc9ac344 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:06.215076 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb7a6035-b336-4624-9da6-a6e2dc9ac344 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:06.215690 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb7a6035-b336-4624-9da6-a6e2dc9ac344 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:06.216255 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb7a6035-b336-4624-9da6-a6e2dc9ac344 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:06.260832 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4da95302-7d0e-40db-b7d1-e1df683ef2a9 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:06.279323 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4da95302-7d0e-40db-b7d1-e1df683ef2a9 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:06.285233 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4da95302-7d0e-40db-b7d1-e1df683ef2a9 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:06.289070 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4da95302-7d0e-40db-b7d1-e1df683ef2a9 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1603 microversion: 2.32 time: 0.348527 Aug 31 16:09:06.298384 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1947/3725] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:09:05 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1603 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:09:06.306668 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ee264c11-097c-41bf-843f-d66ab98f6b89 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:06.309587 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ee264c11-097c-41bf-843f-d66ab98f6b89 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: b242124a-1ecd-4762-babd-96246ccb7ceb] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:06.326688 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ee264c11-097c-41bf-843f-d66ab98f6b89 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:06.332132 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ee264c11-097c-41bf-843f-d66ab98f6b89 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:06.334495 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ee264c11-097c-41bf-843f-d66ab98f6b89 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:06.336565 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ee264c11-097c-41bf-843f-d66ab98f6b89 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:06.341867 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ee264c11-097c-41bf-843f-d66ab98f6b89 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:06.342757 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ee264c11-097c-41bf-843f-d66ab98f6b89 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:06.722587 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-eb7a6035-b336-4624-9da6-a6e2dc9ac344 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:06.746969 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-eb7a6035-b336-4624-9da6-a6e2dc9ac344 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/96bec4d7-3a20-4974-8865-51ef8fd087f6" status: 200 len: 1486 microversion: 2.1 time: 0.560525 Aug 31 16:09:06.749423 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1779/3726] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:06 2022] GET /compute/v2.1/servers/96bec4d7-3a20-4974-8865-51ef8fd087f6 => generated 1486 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:06.759204 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ee264c11-097c-41bf-843f-d66ab98f6b89 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:06.784712 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ee264c11-097c-41bf-843f-d66ab98f6b89 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/b242124a-1ecd-4762-babd-96246ccb7ceb" status: 200 len: 1495 microversion: 2.1 time: 0.493406 Aug 31 16:09:06.787772 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1948/3727] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:06 2022] GET /compute/v2.1/servers/b242124a-1ecd-4762-babd-96246ccb7ceb => generated 1495 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:06.960495 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-42bb0c73-0f16-4422-94db-f8596588d92a tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:06.961775 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-42bb0c73-0f16-4422-94db-f8596588d92a tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] [instance: 76a65fbc-5d3d-4759-ba22-cf7751f0a6b3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:06.975562 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-42bb0c73-0f16-4422-94db-f8596588d92a tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:06.976054 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-42bb0c73-0f16-4422-94db-f8596588d92a tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:06.976481 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-42bb0c73-0f16-4422-94db-f8596588d92a tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:06.977176 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-42bb0c73-0f16-4422-94db-f8596588d92a tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:06.977621 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-42bb0c73-0f16-4422-94db-f8596588d92a tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:06.978034 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-42bb0c73-0f16-4422-94db-f8596588d92a tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:06.992914 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:09:07.124423 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-42bb0c73-0f16-4422-94db-f8596588d92a tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a92ad15ba984304b27f1e337f1bae65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d874dc06bb94a3daffe23f9805ed0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:07.156359 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-42bb0c73-0f16-4422-94db-f8596588d92a tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] 10.222.0.50 "GET /compute/v2.1/servers/76a65fbc-5d3d-4759-ba22-cf7751f0a6b3" status: 200 len: 1266 microversion: 2.1 time: 0.193965 Aug 31 16:09:07.157368 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1780/3728] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:06 2022] GET /compute/v2.1/servers/76a65fbc-5d3d-4759-ba22-cf7751f0a6b3 => generated 1266 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:07.210741 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5261627b-c9bb-4741-86f5-dca7ef6aa119 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:07.211448 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5261627b-c9bb-4741-86f5-dca7ef6aa119 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] [instance: ad0b8fd6-eec9-42fe-91af-a7904d758c93] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:07.249813 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-fb995c97-8066-40a5-91e6-f1d3b38ff7d2 req-72ede2c6-59ae-46ea-a5fe-34f6eab93680 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96bec4d7-3a20-4974-8865-51ef8fd087f6", "name": "network-vif-deleted", "tag": "88ac1c93-1d43-4270-990d-911112bbebb5"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:09:07.261213 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5261627b-c9bb-4741-86f5-dca7ef6aa119 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:07.261747 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5261627b-c9bb-4741-86f5-dca7ef6aa119 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:07.281179 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5261627b-c9bb-4741-86f5-dca7ef6aa119 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:07.282028 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5261627b-c9bb-4741-86f5-dca7ef6aa119 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:07.287164 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5261627b-c9bb-4741-86f5-dca7ef6aa119 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:07.287809 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5261627b-c9bb-4741-86f5-dca7ef6aa119 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:07.304852 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-fb995c97-8066-40a5-91e6-f1d3b38ff7d2 req-72ede2c6-59ae-46ea-a5fe-34f6eab93680 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:07.309102 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-fb995c97-8066-40a5-91e6-f1d3b38ff7d2 req-72ede2c6-59ae-46ea-a5fe-34f6eab93680 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:07.313325 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-fb995c97-8066-40a5-91e6-f1d3b38ff7d2 req-72ede2c6-59ae-46ea-a5fe-34f6eab93680 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:07.359534 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-fb995c97-8066-40a5-91e6-f1d3b38ff7d2 req-72ede2c6-59ae-46ea-a5fe-34f6eab93680 service nova] Creating event network-vif-deleted:88ac1c93-1d43-4270-990d-911112bbebb5 for instance 96bec4d7-3a20-4974-8865-51ef8fd087f6 on n-h1-833090-16 Aug 31 16:09:07.378963 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-fb995c97-8066-40a5-91e6-f1d3b38ff7d2 req-72ede2c6-59ae-46ea-a5fe-34f6eab93680 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136591 Aug 31 16:09:07.385170 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1781/3729] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:09:07.408680 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c1bd0f72-ca44-4de9-a13d-ce55c0beaacd tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:07.409391 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c1bd0f72-ca44-4de9-a13d-ce55c0beaacd tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:07.430788 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c1bd0f72-ca44-4de9-a13d-ce55c0beaacd tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:07.433198 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c1bd0f72-ca44-4de9-a13d-ce55c0beaacd tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:07.433642 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c1bd0f72-ca44-4de9-a13d-ce55c0beaacd tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:07.435991 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c1bd0f72-ca44-4de9-a13d-ce55c0beaacd tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:07.438270 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c1bd0f72-ca44-4de9-a13d-ce55c0beaacd tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:07.438985 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c1bd0f72-ca44-4de9-a13d-ce55c0beaacd tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:07.674856 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c1bd0f72-ca44-4de9-a13d-ce55c0beaacd tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:07.691327 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c1bd0f72-ca44-4de9-a13d-ce55c0beaacd tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:07.693487 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c1bd0f72-ca44-4de9-a13d-ce55c0beaacd tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:07.695011 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c1bd0f72-ca44-4de9-a13d-ce55c0beaacd tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1603 microversion: 2.32 time: 0.308137 Aug 31 16:09:07.696436 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1782/3730] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:09:07 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1603 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:09:07.757355 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5261627b-c9bb-4741-86f5-dca7ef6aa119 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4717b2fc0a654a77b40da565e599203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0154660c274106ab83ae50927348c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:07.772687 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5261627b-c9bb-4741-86f5-dca7ef6aa119 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] 10.222.0.50 "GET /compute/v2.1/servers/ad0b8fd6-eec9-42fe-91af-a7904d758c93" status: 200 len: 1503 microversion: 2.1 time: 0.571765 Aug 31 16:09:07.781025 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-86ddc1e6-a405-410c-b2b7-a6964c7f7c67 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:07.781861 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-86ddc1e6-a405-410c-b2b7-a6964c7f7c67 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 96bec4d7-3a20-4974-8865-51ef8fd087f6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:07.786662 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1949/3731] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:07 2022] GET /compute/v2.1/servers/ad0b8fd6-eec9-42fe-91af-a7904d758c93 => generated 1503 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:07.795406 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86ddc1e6-a405-410c-b2b7-a6964c7f7c67 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:07.796360 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86ddc1e6-a405-410c-b2b7-a6964c7f7c67 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:07.805380 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-68c3b875-dda0-4259-b4dc-afed14009983 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:07.807779 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-68c3b875-dda0-4259-b4dc-afed14009983 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] [instance: ad0b8fd6-eec9-42fe-91af-a7904d758c93] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:07.810692 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86ddc1e6-a405-410c-b2b7-a6964c7f7c67 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:07.814603 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86ddc1e6-a405-410c-b2b7-a6964c7f7c67 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:07.816929 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86ddc1e6-a405-410c-b2b7-a6964c7f7c67 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:07.818963 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86ddc1e6-a405-410c-b2b7-a6964c7f7c67 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:07.823083 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68c3b875-dda0-4259-b4dc-afed14009983 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:07.823715 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68c3b875-dda0-4259-b4dc-afed14009983 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:07.837331 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68c3b875-dda0-4259-b4dc-afed14009983 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:07.847674 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68c3b875-dda0-4259-b4dc-afed14009983 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:07.848408 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68c3b875-dda0-4259-b4dc-afed14009983 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:07.848862 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68c3b875-dda0-4259-b4dc-afed14009983 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:07.865376 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:09:07.933762 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86ddc1e6-a405-410c-b2b7-a6964c7f7c67 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:07.936761 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86ddc1e6-a405-410c-b2b7-a6964c7f7c67 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:07.937252 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86ddc1e6-a405-410c-b2b7-a6964c7f7c67 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:07.937728 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-86ddc1e6-a405-410c-b2b7-a6964c7f7c67 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lazy-loading 'fault' on Instance uuid 96bec4d7-3a20-4974-8865-51ef8fd087f6 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:09:07.955676 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-68c3b875-dda0-4259-b4dc-afed14009983 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] [instance: ad0b8fd6-eec9-42fe-91af-a7904d758c93] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:09:08.040558 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-86ddc1e6-a405-410c-b2b7-a6964c7f7c67 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:08.056479 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-86ddc1e6-a405-410c-b2b7-a6964c7f7c67 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/96bec4d7-3a20-4974-8865-51ef8fd087f6" status: 200 len: 1301 microversion: 2.1 time: 0.285456 Aug 31 16:09:08.059831 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1783/3732] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:07 2022] GET /compute/v2.1/servers/96bec4d7-3a20-4974-8865-51ef8fd087f6 => generated 1301 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:09:08.254356 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-68c3b875-dda0-4259-b4dc-afed14009983 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ad0b8fd6-eec9-42fe-91af-a7904d758c93" status: 204 len: 0 microversion: 2.1 time: 0.457540 Aug 31 16:09:08.256738 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1950/3733] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:09:07 2022] DELETE /compute/v2.1/servers/ad0b8fd6-eec9-42fe-91af-a7904d758c93 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:09:08.272414 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-13a3eb3f-f3f0-468b-b774-ca6f3fe343d1 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:08.275236 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-13a3eb3f-f3f0-468b-b774-ca6f3fe343d1 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] [instance: 76a65fbc-5d3d-4759-ba22-cf7751f0a6b3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:08.292848 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-13a3eb3f-f3f0-468b-b774-ca6f3fe343d1 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:08.296836 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-13a3eb3f-f3f0-468b-b774-ca6f3fe343d1 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:08.299008 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-13a3eb3f-f3f0-468b-b774-ca6f3fe343d1 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:08.302165 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-13a3eb3f-f3f0-468b-b774-ca6f3fe343d1 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:08.303666 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-13a3eb3f-f3f0-468b-b774-ca6f3fe343d1 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:08.305023 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-13a3eb3f-f3f0-468b-b774-ca6f3fe343d1 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:08.361838 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:09:08.494636 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-13a3eb3f-f3f0-468b-b774-ca6f3fe343d1 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a92ad15ba984304b27f1e337f1bae65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d874dc06bb94a3daffe23f9805ed0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:08.507297 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-13a3eb3f-f3f0-468b-b774-ca6f3fe343d1 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] 10.222.0.50 "GET /compute/v2.1/servers/76a65fbc-5d3d-4759-ba22-cf7751f0a6b3" status: 200 len: 1272 microversion: 2.1 time: 0.246687 Aug 31 16:09:08.510620 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1951/3734] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:08 2022] GET /compute/v2.1/servers/76a65fbc-5d3d-4759-ba22-cf7751f0a6b3 => generated 1272 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:08.516599 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-16f516ab-668b-4434-ac09-7906f5b75d03 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:08.517362 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-16f516ab-668b-4434-ac09-7906f5b75d03 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] [instance: 1dc405fa-b1a4-4acc-8236-06a24e979f5e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:08.524314 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-16f516ab-668b-4434-ac09-7906f5b75d03 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:08.525013 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-16f516ab-668b-4434-ac09-7906f5b75d03 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:08.525616 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-16f516ab-668b-4434-ac09-7906f5b75d03 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:08.526708 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-16f516ab-668b-4434-ac09-7906f5b75d03 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:08.527338 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-16f516ab-668b-4434-ac09-7906f5b75d03 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:08.527908 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-16f516ab-668b-4434-ac09-7906f5b75d03 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:08.560154 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-16f516ab-668b-4434-ac09-7906f5b75d03 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] [instance: 1dc405fa-b1a4-4acc-8236-06a24e979f5e] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:09:08.745897 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-16f516ab-668b-4434-ac09-7906f5b75d03 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] 10.222.0.50 "DELETE /compute/v2.1/servers/1dc405fa-b1a4-4acc-8236-06a24e979f5e" status: 204 len: 0 microversion: 2.1 time: 0.233554 Aug 31 16:09:08.752154 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1952/3735] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:09:08 2022] DELETE /compute/v2.1/servers/1dc405fa-b1a4-4acc-8236-06a24e979f5e => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:09:08.782775 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-a94752ab-5f8d-4b1f-a689-5952115e4a23 req-d5a42e24-6751-4516-ba5d-cf0151115965 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b242124a-1ecd-4762-babd-96246ccb7ceb", "name": "network-vif-deleted", "tag": "fb90c64b-73f7-4ccf-b3d5-d0d828934bc7"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:09:08.811819 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-a94752ab-5f8d-4b1f-a689-5952115e4a23 req-d5a42e24-6751-4516-ba5d-cf0151115965 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:08.812296 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-a94752ab-5f8d-4b1f-a689-5952115e4a23 req-d5a42e24-6751-4516-ba5d-cf0151115965 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:08.812721 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-a94752ab-5f8d-4b1f-a689-5952115e4a23 req-d5a42e24-6751-4516-ba5d-cf0151115965 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:08.831864 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dfdb16e9-4e74-4c06-a150-cab19f15ab2e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:08.832481 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dfdb16e9-4e74-4c06-a150-cab19f15ab2e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: b242124a-1ecd-4762-babd-96246ccb7ceb] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:08.849670 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-a94752ab-5f8d-4b1f-a689-5952115e4a23 req-d5a42e24-6751-4516-ba5d-cf0151115965 service nova] Creating event network-vif-deleted:fb90c64b-73f7-4ccf-b3d5-d0d828934bc7 for instance b242124a-1ecd-4762-babd-96246ccb7ceb on n-h1-833090-16 Aug 31 16:09:08.852810 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfdb16e9-4e74-4c06-a150-cab19f15ab2e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:08.853315 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfdb16e9-4e74-4c06-a150-cab19f15ab2e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:08.856601 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-a94752ab-5f8d-4b1f-a689-5952115e4a23 req-d5a42e24-6751-4516-ba5d-cf0151115965 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104823 Aug 31 16:09:08.857837 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1953/3736] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:09:08.863843 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6b52b1a7-a8c5-4428-b446-9952a3a3dc10 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:08.865169 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6b52b1a7-a8c5-4428-b446-9952a3a3dc10 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:08.867774 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfdb16e9-4e74-4c06-a150-cab19f15ab2e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:08.868708 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfdb16e9-4e74-4c06-a150-cab19f15ab2e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:08.869224 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfdb16e9-4e74-4c06-a150-cab19f15ab2e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:08.869681 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfdb16e9-4e74-4c06-a150-cab19f15ab2e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:08.873552 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6b52b1a7-a8c5-4428-b446-9952a3a3dc10 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:08.874721 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6b52b1a7-a8c5-4428-b446-9952a3a3dc10 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:08.875513 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6b52b1a7-a8c5-4428-b446-9952a3a3dc10 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:08.876746 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6b52b1a7-a8c5-4428-b446-9952a3a3dc10 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:08.877446 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6b52b1a7-a8c5-4428-b446-9952a3a3dc10 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:08.899405 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6b52b1a7-a8c5-4428-b446-9952a3a3dc10 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:08.983051 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6b52b1a7-a8c5-4428-b446-9952a3a3dc10 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:08.996328 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6b52b1a7-a8c5-4428-b446-9952a3a3dc10 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:08.998027 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6b52b1a7-a8c5-4428-b446-9952a3a3dc10 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:09.000228 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6b52b1a7-a8c5-4428-b446-9952a3a3dc10 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1603 microversion: 2.32 time: 0.141076 Aug 31 16:09:09.001327 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1954/3737] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:09:08 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1603 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:09:09.007135 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c98a33f6-7986-4e3a-8a22-75a775e45203 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:09.007962 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c98a33f6-7986-4e3a-8a22-75a775e45203 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] [instance: ad0b8fd6-eec9-42fe-91af-a7904d758c93] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:09.016981 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c98a33f6-7986-4e3a-8a22-75a775e45203 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:09.017788 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c98a33f6-7986-4e3a-8a22-75a775e45203 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:09.018465 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c98a33f6-7986-4e3a-8a22-75a775e45203 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:09.019551 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c98a33f6-7986-4e3a-8a22-75a775e45203 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:09.020200 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c98a33f6-7986-4e3a-8a22-75a775e45203 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:09.020821 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c98a33f6-7986-4e3a-8a22-75a775e45203 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:09.040270 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfdb16e9-4e74-4c06-a150-cab19f15ab2e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:09.040772 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfdb16e9-4e74-4c06-a150-cab19f15ab2e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:09.041250 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfdb16e9-4e74-4c06-a150-cab19f15ab2e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:09.041711 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-dfdb16e9-4e74-4c06-a150-cab19f15ab2e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lazy-loading 'fault' on Instance uuid b242124a-1ecd-4762-babd-96246ccb7ceb {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:09:09.185803 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dfdb16e9-4e74-4c06-a150-cab19f15ab2e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:09.196584 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dfdb16e9-4e74-4c06-a150-cab19f15ab2e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/b242124a-1ecd-4762-babd-96246ccb7ceb" status: 200 len: 1305 microversion: 2.1 time: 1.134925 Aug 31 16:09:09.201732 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1784/3738] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:08 2022] GET /compute/v2.1/servers/b242124a-1ecd-4762-babd-96246ccb7ceb => generated 1305 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:09.211940 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fdaca47b-bdfb-43a3-bc09-a197b63539b5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:09.214817 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fdaca47b-bdfb-43a3-bc09-a197b63539b5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 96bec4d7-3a20-4974-8865-51ef8fd087f6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:09.228710 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fdaca47b-bdfb-43a3-bc09-a197b63539b5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:09.233829 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fdaca47b-bdfb-43a3-bc09-a197b63539b5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:09.234554 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fdaca47b-bdfb-43a3-bc09-a197b63539b5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:09.236354 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fdaca47b-bdfb-43a3-bc09-a197b63539b5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:09.238922 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fdaca47b-bdfb-43a3-bc09-a197b63539b5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:09.239573 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fdaca47b-bdfb-43a3-bc09-a197b63539b5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:09.273627 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-fdaca47b-bdfb-43a3-bc09-a197b63539b5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] HTTP exception thrown: Instance 96bec4d7-3a20-4974-8865-51ef8fd087f6 could not be found. Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fdaca47b-bdfb-43a3-bc09-a197b63539b5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Request method failure captured: Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/96bec4d7-3a20-4974-8865-51ef8fd087f6 HTTP/1.1 Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4WKvsbO08EL2S91UDZkibdodc8Ncpnx96A_z7G6JzDTVReVRJt4eaxqEagrCjiIt0sQK9L2XFjpe1FXBkALlUJ8tsVxARkQX1aQaJHXvorlxZYJqMjBiHR2B48FsHGsA1J11nYBrZ1wp73HofSCco1Rnc1vXSjVfKEu_sBy_NCjrg0 Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 1355779c2e2d4cfeb0825b76968867b1 Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-LiveMigrationTest-299357202 Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1355779c2e2d4cfeb0825b76968867b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1355779c2e2d4cfeb0825b76968867b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/1355779c2e2d4cfeb0825b76968867b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_1355779c2e2d4cfeb0825b76968867b1", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-LiveMigrationTest-299357202 Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 1355779c2e2d4cfeb0825b76968867b1 Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-LiveMigrationTest-299357202 Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-LiveMigrationTest-299357202-project Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: b9840c71c4ec49c1a60ef97943d173ef Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-LiveMigrationTest-299357202-project Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 96bec4d7-3a20-4974-8865-51ef8fd087f6 could not be found. Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '96bec4d7-3a20-4974-8865-51ef8fd087f6'} Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96bec4d7-3a20-4974-8865-51ef8fd087f6 could not be found. Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96bec4d7-3a20-4974-8865-51ef8fd087f6 could not be found. Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:09:09.277539 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:09:09.281110 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:09.281110 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:09:09.281110 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:09:09.281110 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:09:09.281110 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:09:09.281110 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96bec4d7-3a20-4974-8865-51ef8fd087f6 could not be found. Aug 31 16:09:09.281110 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:09:09.288104 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fdaca47b-bdfb-43a3-bc09-a197b63539b5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Returning 404 to user: Instance 96bec4d7-3a20-4974-8865-51ef8fd087f6 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:09:09.289368 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fdaca47b-bdfb-43a3-bc09-a197b63539b5 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/96bec4d7-3a20-4974-8865-51ef8fd087f6" status: 404 len: 111 microversion: 2.1 time: 0.085722 Aug 31 16:09:09.290152 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1785/3739] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:09 2022] GET /compute/v2.1/servers/96bec4d7-3a20-4974-8865-51ef8fd087f6 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:09:09.317496 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-14893089-2b77-4268-a3ff-cacac283b332 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:09.319656 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-14893089-2b77-4268-a3ff-cacac283b332 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 8701d926-4a72-483d-b0a3-57d8ee5f50c8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:09.331811 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c98a33f6-7986-4e3a-8a22-75a775e45203 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4717b2fc0a654a77b40da565e599203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0154660c274106ab83ae50927348c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:09.342574 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c98a33f6-7986-4e3a-8a22-75a775e45203 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] 10.222.0.50 "GET /compute/v2.1/servers/ad0b8fd6-eec9-42fe-91af-a7904d758c93" status: 200 len: 1509 microversion: 2.1 time: 0.339622 Aug 31 16:09:09.348521 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14893089-2b77-4268-a3ff-cacac283b332 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:09.349237 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14893089-2b77-4268-a3ff-cacac283b332 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:09.349865 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14893089-2b77-4268-a3ff-cacac283b332 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:09.350897 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14893089-2b77-4268-a3ff-cacac283b332 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:09.351174 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1955/3740] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:09 2022] GET /compute/v2.1/servers/ad0b8fd6-eec9-42fe-91af-a7904d758c93 => generated 1509 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:09.351791 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14893089-2b77-4268-a3ff-cacac283b332 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:09.352405 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14893089-2b77-4268-a3ff-cacac283b332 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:09.387100 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-14893089-2b77-4268-a3ff-cacac283b332 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 8701d926-4a72-483d-b0a3-57d8ee5f50c8] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:09:09.535374 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b300553a-a596-46b4-ac90-0b07d7e72d6f tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:09.535998 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b300553a-a596-46b4-ac90-0b07d7e72d6f tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] [instance: 76a65fbc-5d3d-4759-ba22-cf7751f0a6b3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:09.557892 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b300553a-a596-46b4-ac90-0b07d7e72d6f tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:09.558427 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b300553a-a596-46b4-ac90-0b07d7e72d6f tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:09.558868 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b300553a-a596-46b4-ac90-0b07d7e72d6f tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:09.559587 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b300553a-a596-46b4-ac90-0b07d7e72d6f tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:09.560683 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b300553a-a596-46b4-ac90-0b07d7e72d6f tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:09.560683 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b300553a-a596-46b4-ac90-0b07d7e72d6f tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:09.615791 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-14893089-2b77-4268-a3ff-cacac283b332 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "DELETE /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8" status: 204 len: 0 microversion: 2.1 time: 0.320188 Aug 31 16:09:09.617024 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1786/3741] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:09:09 2022] DELETE /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 16:09:09.631280 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ad8cbea9-ff57-4666-ba45-deace1710e2a tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:09.635328 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ad8cbea9-ff57-4666-ba45-deace1710e2a tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 8701d926-4a72-483d-b0a3-57d8ee5f50c8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:09.651857 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ad8cbea9-ff57-4666-ba45-deace1710e2a tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:09.652746 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ad8cbea9-ff57-4666-ba45-deace1710e2a tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:09.662129 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ad8cbea9-ff57-4666-ba45-deace1710e2a tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:09.663902 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ad8cbea9-ff57-4666-ba45-deace1710e2a tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:09.664936 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ad8cbea9-ff57-4666-ba45-deace1710e2a tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:09.665889 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ad8cbea9-ff57-4666-ba45-deace1710e2a tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:09.791838 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b300553a-a596-46b4-ac90-0b07d7e72d6f tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a92ad15ba984304b27f1e337f1bae65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d874dc06bb94a3daffe23f9805ed0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:09.808027 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b300553a-a596-46b4-ac90-0b07d7e72d6f tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] 10.222.0.50 "GET /compute/v2.1/servers/76a65fbc-5d3d-4759-ba22-cf7751f0a6b3" status: 200 len: 1272 microversion: 2.1 time: 0.277040 Aug 31 16:09:09.808810 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1956/3742] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:09 2022] GET /compute/v2.1/servers/76a65fbc-5d3d-4759-ba22-cf7751f0a6b3 => generated 1272 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:10.029333 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1e2098d8-a89a-47e8-83d8-2349e2e7a279 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:10.029856 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1e2098d8-a89a-47e8-83d8-2349e2e7a279 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:10.032649 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ad8cbea9-ff57-4666-ba45-deace1710e2a tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:10.045489 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ad8cbea9-ff57-4666-ba45-deace1710e2a tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8" status: 200 len: 1499 microversion: 2.1 time: 0.422933 Aug 31 16:09:10.046567 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1787/3743] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:09 2022] GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8 => generated 1499 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:10.051710 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e2098d8-a89a-47e8-83d8-2349e2e7a279 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:10.052221 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e2098d8-a89a-47e8-83d8-2349e2e7a279 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:10.052663 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e2098d8-a89a-47e8-83d8-2349e2e7a279 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:10.053616 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e2098d8-a89a-47e8-83d8-2349e2e7a279 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:10.053913 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e2098d8-a89a-47e8-83d8-2349e2e7a279 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:10.054368 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e2098d8-a89a-47e8-83d8-2349e2e7a279 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:10.231793 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-560bb8db-7db4-486f-8459-b3798475e26c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:10.232400 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-560bb8db-7db4-486f-8459-b3798475e26c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: b242124a-1ecd-4762-babd-96246ccb7ceb] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:10.255583 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1e2098d8-a89a-47e8-83d8-2349e2e7a279 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:10.256946 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-560bb8db-7db4-486f-8459-b3798475e26c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:10.257442 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-560bb8db-7db4-486f-8459-b3798475e26c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:10.259491 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-560bb8db-7db4-486f-8459-b3798475e26c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:10.260365 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-560bb8db-7db4-486f-8459-b3798475e26c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:10.261642 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-560bb8db-7db4-486f-8459-b3798475e26c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:10.263125 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-560bb8db-7db4-486f-8459-b3798475e26c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:10.270051 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1e2098d8-a89a-47e8-83d8-2349e2e7a279 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:10.276026 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1e2098d8-a89a-47e8-83d8-2349e2e7a279 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:10.280232 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1e2098d8-a89a-47e8-83d8-2349e2e7a279 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1603 microversion: 2.32 time: 0.255082 Aug 31 16:09:10.283116 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1957/3744] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:09:10 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1603 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:09:10.375137 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-62ae59be-f2c9-45c3-8304-341f5dd399b2 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:10.376532 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-62ae59be-f2c9-45c3-8304-341f5dd399b2 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] [instance: ad0b8fd6-eec9-42fe-91af-a7904d758c93] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:10.395114 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-62ae59be-f2c9-45c3-8304-341f5dd399b2 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:10.395875 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-62ae59be-f2c9-45c3-8304-341f5dd399b2 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:10.396477 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-62ae59be-f2c9-45c3-8304-341f5dd399b2 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:10.397571 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-62ae59be-f2c9-45c3-8304-341f5dd399b2 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:10.403458 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-62ae59be-f2c9-45c3-8304-341f5dd399b2 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:10.404669 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-62ae59be-f2c9-45c3-8304-341f5dd399b2 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:10.419224 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-560bb8db-7db4-486f-8459-b3798475e26c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:10.419715 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-560bb8db-7db4-486f-8459-b3798475e26c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:10.420281 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-560bb8db-7db4-486f-8459-b3798475e26c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:10.428361 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-560bb8db-7db4-486f-8459-b3798475e26c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lazy-loading 'fault' on Instance uuid b242124a-1ecd-4762-babd-96246ccb7ceb {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:09:10.596997 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-560bb8db-7db4-486f-8459-b3798475e26c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:10.631272 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-560bb8db-7db4-486f-8459-b3798475e26c tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/b242124a-1ecd-4762-babd-96246ccb7ceb" status: 200 len: 1305 microversion: 2.1 time: 0.386119 Aug 31 16:09:10.631957 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1788/3745] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:10 2022] GET /compute/v2.1/servers/b242124a-1ecd-4762-babd-96246ccb7ceb => generated 1305 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:10.835154 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-06e7413e-3668-487a-8090-0390dec85b2c tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:10.837271 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-06e7413e-3668-487a-8090-0390dec85b2c tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] [instance: 76a65fbc-5d3d-4759-ba22-cf7751f0a6b3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:10.840744 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:09:10.848529 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06e7413e-3668-487a-8090-0390dec85b2c tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:10.849388 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06e7413e-3668-487a-8090-0390dec85b2c tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:10.850070 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06e7413e-3668-487a-8090-0390dec85b2c tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:10.850976 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06e7413e-3668-487a-8090-0390dec85b2c tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:10.851579 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06e7413e-3668-487a-8090-0390dec85b2c tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:10.852150 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06e7413e-3668-487a-8090-0390dec85b2c tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:11.205415 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-06e7413e-3668-487a-8090-0390dec85b2c tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a92ad15ba984304b27f1e337f1bae65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d874dc06bb94a3daffe23f9805ed0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:11.218661 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-06e7413e-3668-487a-8090-0390dec85b2c tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] 10.222.0.50 "GET /compute/v2.1/servers/76a65fbc-5d3d-4759-ba22-cf7751f0a6b3" status: 200 len: 1272 microversion: 2.1 time: 0.393115 Aug 31 16:09:11.232625 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1789/3746] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:10 2022] GET /compute/v2.1/servers/76a65fbc-5d3d-4759-ba22-cf7751f0a6b3 => generated 1272 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:11.232625 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f4e6a0ad-f89d-4e5a-b366-e6a7421c0b79 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:11.232625 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f4e6a0ad-f89d-4e5a-b366-e6a7421c0b79 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 8701d926-4a72-483d-b0a3-57d8ee5f50c8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:11.249600 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4e6a0ad-f89d-4e5a-b366-e6a7421c0b79 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:11.250118 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4e6a0ad-f89d-4e5a-b366-e6a7421c0b79 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:11.250589 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4e6a0ad-f89d-4e5a-b366-e6a7421c0b79 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:11.251975 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4e6a0ad-f89d-4e5a-b366-e6a7421c0b79 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:11.251975 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4e6a0ad-f89d-4e5a-b366-e6a7421c0b79 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:11.252234 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4e6a0ad-f89d-4e5a-b366-e6a7421c0b79 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:11.318874 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-62ae59be-f2c9-45c3-8304-341f5dd399b2 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4717b2fc0a654a77b40da565e599203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0154660c274106ab83ae50927348c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:11.328276 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-62ae59be-f2c9-45c3-8304-341f5dd399b2 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] 10.222.0.50 "GET /compute/v2.1/servers/ad0b8fd6-eec9-42fe-91af-a7904d758c93" status: 200 len: 1509 microversion: 2.1 time: 0.957426 Aug 31 16:09:11.342910 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1958/3747] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:10 2022] GET /compute/v2.1/servers/ad0b8fd6-eec9-42fe-91af-a7904d758c93 => generated 1509 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:09:11.348423 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b9c8edf8-7d99-485b-b307-9f0d5c8d73c8 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:11.349356 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b9c8edf8-7d99-485b-b307-9f0d5c8d73c8 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:11.364816 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b9c8edf8-7d99-485b-b307-9f0d5c8d73c8 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:11.365698 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b9c8edf8-7d99-485b-b307-9f0d5c8d73c8 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:11.366795 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b9c8edf8-7d99-485b-b307-9f0d5c8d73c8 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:11.367801 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b9c8edf8-7d99-485b-b307-9f0d5c8d73c8 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:11.368499 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b9c8edf8-7d99-485b-b307-9f0d5c8d73c8 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:11.369364 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b9c8edf8-7d99-485b-b307-9f0d5c8d73c8 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:11.407501 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b9c8edf8-7d99-485b-b307-9f0d5c8d73c8 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:11.408809 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b9c8edf8-7d99-485b-b307-9f0d5c8d73c8 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:11.410211 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b9c8edf8-7d99-485b-b307-9f0d5c8d73c8 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:11.410948 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-b9c8edf8-7d99-485b-b307-9f0d5c8d73c8 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lazy-loading 'fault' on Instance uuid a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:09:11.597749 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b9c8edf8-7d99-485b-b307-9f0d5c8d73c8 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:11.607420 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b9c8edf8-7d99-485b-b307-9f0d5c8d73c8 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:11.615221 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b9c8edf8-7d99-485b-b307-9f0d5c8d73c8 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9fe7107d5e94104bda2d567394753fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08474001ff6477cb14547afb2b6a72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:11.623846 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b9c8edf8-7d99-485b-b307-9f0d5c8d73c8 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 200 len: 1608 microversion: 2.32 time: 0.279376 Aug 31 16:09:11.625000 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1959/3748] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:09:11 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 1608 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:09:11.653326 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0497853a-ba1e-4428-b643-0c2d94bcae68 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:11.654133 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0497853a-ba1e-4428-b643-0c2d94bcae68 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: b242124a-1ecd-4762-babd-96246ccb7ceb] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:11.665931 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0497853a-ba1e-4428-b643-0c2d94bcae68 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:11.667424 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0497853a-ba1e-4428-b643-0c2d94bcae68 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:11.668006 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0497853a-ba1e-4428-b643-0c2d94bcae68 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:11.668865 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0497853a-ba1e-4428-b643-0c2d94bcae68 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:11.670387 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0497853a-ba1e-4428-b643-0c2d94bcae68 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:11.674995 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0497853a-ba1e-4428-b643-0c2d94bcae68 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:11.708173 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-0497853a-ba1e-4428-b643-0c2d94bcae68 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] HTTP exception thrown: Instance b242124a-1ecd-4762-babd-96246ccb7ceb could not be found. Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0497853a-ba1e-4428-b643-0c2d94bcae68 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Request method failure captured: Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/b242124a-1ecd-4762-babd-96246ccb7ceb HTTP/1.1 Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4VKUAYKz-WFBtmk16aIOyXYR2HhyYuZ36VRZsBRjqviBnc5RSPRJJqpoARQYteX5NSEljs3qX5_RMCYaeMof8M6i0ZB3mJgVdRhk2nIL2yk-7L_KhuV1lL_MMec1r7AAygDhG-639IQUe0ED7x0P_yoZ7NSrcY8NXkYeyVxFn3mUyo Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 11ef5102f83142d1a52befe52c3595d4 Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServerActionsTestJSON-1629819008 Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/11ef5102f83142d1a52befe52c3595d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/11ef5102f83142d1a52befe52c3595d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/11ef5102f83142d1a52befe52c3595d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_11ef5102f83142d1a52befe52c3595d4", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServerActionsTestJSON-1629819008 Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 11ef5102f83142d1a52befe52c3595d4 Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServerActionsTestJSON-1629819008 Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServerActionsTestJSON-1629819008-project Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: aeeaf32202f747c8a2b98836f503aa7e Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServerActionsTestJSON-1629819008-project Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance b242124a-1ecd-4762-babd-96246ccb7ceb could not be found. Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'b242124a-1ecd-4762-babd-96246ccb7ceb'} Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b242124a-1ecd-4762-babd-96246ccb7ceb could not be found. Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b242124a-1ecd-4762-babd-96246ccb7ceb could not be found. Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:09:11.711592 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:09:11.716133 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:11.716133 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:09:11.716133 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:09:11.716133 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:09:11.716133 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:09:11.716133 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b242124a-1ecd-4762-babd-96246ccb7ceb could not be found. Aug 31 16:09:11.716133 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:09:11.718453 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0497853a-ba1e-4428-b643-0c2d94bcae68 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Returning 404 to user: Instance b242124a-1ecd-4762-babd-96246ccb7ceb could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:09:11.719660 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0497853a-ba1e-4428-b643-0c2d94bcae68 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/b242124a-1ecd-4762-babd-96246ccb7ceb" status: 404 len: 111 microversion: 2.1 time: 0.070722 Aug 31 16:09:11.727170 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1960/3749] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:11 2022] GET /compute/v2.1/servers/b242124a-1ecd-4762-babd-96246ccb7ceb => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:09:11.739941 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0b48601e-056c-4ade-accd-3404dff51c8b tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:11.751078 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0b48601e-056c-4ade-accd-3404dff51c8b tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:11.764755 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0b48601e-056c-4ade-accd-3404dff51c8b tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:11.766743 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0b48601e-056c-4ade-accd-3404dff51c8b tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:11.767545 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0b48601e-056c-4ade-accd-3404dff51c8b tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:11.769203 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0b48601e-056c-4ade-accd-3404dff51c8b tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:11.771334 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0b48601e-056c-4ade-accd-3404dff51c8b tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:11.773755 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0b48601e-056c-4ade-accd-3404dff51c8b tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:11.835801 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0b48601e-056c-4ade-accd-3404dff51c8b tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:09:11.895651 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f4e6a0ad-f89d-4e5a-b366-e6a7421c0b79 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:11.912059 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f4e6a0ad-f89d-4e5a-b366-e6a7421c0b79 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8" status: 200 len: 1499 microversion: 2.1 time: 0.688890 Aug 31 16:09:11.914932 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1790/3750] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:11 2022] GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8 => generated 1499 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:12.037762 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0b48601e-056c-4ade-accd-3404dff51c8b tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "DELETE /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 204 len: 0 microversion: 2.1 time: 0.307633 Aug 31 16:09:12.038777 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1961/3751] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:09:11 2022] DELETE /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:09:12.047463 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a1fffb2e-387c-4980-a64c-2b8f56977dfd tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:12.048131 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a1fffb2e-387c-4980-a64c-2b8f56977dfd tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:12.058919 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1fffb2e-387c-4980-a64c-2b8f56977dfd tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:12.066925 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1fffb2e-387c-4980-a64c-2b8f56977dfd tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:12.067602 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1fffb2e-387c-4980-a64c-2b8f56977dfd tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:12.068500 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1fffb2e-387c-4980-a64c-2b8f56977dfd tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:12.069102 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1fffb2e-387c-4980-a64c-2b8f56977dfd tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:12.069789 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1fffb2e-387c-4980-a64c-2b8f56977dfd tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:12.245401 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3570be7f-9eab-48ee-83f2-a48bc45005e4 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:12.250261 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3570be7f-9eab-48ee-83f2-a48bc45005e4 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] [instance: 76a65fbc-5d3d-4759-ba22-cf7751f0a6b3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:12.273648 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3570be7f-9eab-48ee-83f2-a48bc45005e4 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:12.274133 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3570be7f-9eab-48ee-83f2-a48bc45005e4 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:12.274650 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3570be7f-9eab-48ee-83f2-a48bc45005e4 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:12.275371 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3570be7f-9eab-48ee-83f2-a48bc45005e4 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:12.275825 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3570be7f-9eab-48ee-83f2-a48bc45005e4 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:12.276249 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3570be7f-9eab-48ee-83f2-a48bc45005e4 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:12.634006 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3570be7f-9eab-48ee-83f2-a48bc45005e4 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a92ad15ba984304b27f1e337f1bae65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d874dc06bb94a3daffe23f9805ed0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:12.641794 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:09:12.648652 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3570be7f-9eab-48ee-83f2-a48bc45005e4 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] 10.222.0.50 "GET /compute/v2.1/servers/76a65fbc-5d3d-4759-ba22-cf7751f0a6b3" status: 200 len: 1272 microversion: 2.1 time: 0.410683 Aug 31 16:09:12.650635 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1962/3752] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:12 2022] GET /compute/v2.1/servers/76a65fbc-5d3d-4759-ba22-cf7751f0a6b3 => generated 1272 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:12.657750 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1d02002c-bc8e-477e-9eee-a009996ee267 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:12.669779 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1d02002c-bc8e-477e-9eee-a009996ee267 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] [instance: ad0b8fd6-eec9-42fe-91af-a7904d758c93] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:12.684243 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1d02002c-bc8e-477e-9eee-a009996ee267 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:12.685819 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1d02002c-bc8e-477e-9eee-a009996ee267 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:12.689374 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1d02002c-bc8e-477e-9eee-a009996ee267 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:12.690653 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1d02002c-bc8e-477e-9eee-a009996ee267 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:12.691278 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1d02002c-bc8e-477e-9eee-a009996ee267 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:12.695319 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1d02002c-bc8e-477e-9eee-a009996ee267 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:12.889010 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a1fffb2e-387c-4980-a64c-2b8f56977dfd tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:12.904190 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a1fffb2e-387c-4980-a64c-2b8f56977dfd tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1677 microversion: 2.1 time: 0.858776 Aug 31 16:09:12.906185 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1791/3753] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:12 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1677 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:12.920469 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3c3fbea0-b4ea-4b39-994a-8975a7d17351 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:12.921098 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3c3fbea0-b4ea-4b39-994a-8975a7d17351 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:12.938892 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c3fbea0-b4ea-4b39-994a-8975a7d17351 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:12.948646 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c3fbea0-b4ea-4b39-994a-8975a7d17351 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:12.953267 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c3fbea0-b4ea-4b39-994a-8975a7d17351 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:12.958163 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c3fbea0-b4ea-4b39-994a-8975a7d17351 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:12.960377 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c3fbea0-b4ea-4b39-994a-8975a7d17351 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:12.961794 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c3fbea0-b4ea-4b39-994a-8975a7d17351 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:12.970398 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1d02002c-bc8e-477e-9eee-a009996ee267 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4717b2fc0a654a77b40da565e599203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0154660c274106ab83ae50927348c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:12.994030 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1d02002c-bc8e-477e-9eee-a009996ee267 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] 10.222.0.50 "GET /compute/v2.1/servers/ad0b8fd6-eec9-42fe-91af-a7904d758c93" status: 200 len: 1467 microversion: 2.1 time: 0.342131 Aug 31 16:09:13.000012 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1963/3754] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:12 2022] GET /compute/v2.1/servers/ad0b8fd6-eec9-42fe-91af-a7904d758c93 => generated 1467 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:13.005476 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-24cd5e73-a660-43fa-a68f-7e880e9460c4 req-cf74b3d5-d723-4b92-9fab-b52643f0874f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8701d926-4a72-483d-b0a3-57d8ee5f50c8", "name": "network-vif-deleted", "tag": "003c66a3-ae1f-4cd7-a8a9-471d61697901"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:09:13.039842 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-24cd5e73-a660-43fa-a68f-7e880e9460c4 req-cf74b3d5-d723-4b92-9fab-b52643f0874f service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:13.040502 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-24cd5e73-a660-43fa-a68f-7e880e9460c4 req-cf74b3d5-d723-4b92-9fab-b52643f0874f service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:13.041102 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-24cd5e73-a660-43fa-a68f-7e880e9460c4 req-cf74b3d5-d723-4b92-9fab-b52643f0874f service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:13.074754 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-24cd5e73-a660-43fa-a68f-7e880e9460c4 req-cf74b3d5-d723-4b92-9fab-b52643f0874f service nova] Creating event network-vif-deleted:003c66a3-ae1f-4cd7-a8a9-471d61697901 for instance 8701d926-4a72-483d-b0a3-57d8ee5f50c8 on n-h1-833090-16 Aug 31 16:09:13.075269 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-3c3fbea0-b4ea-4b39-994a-8975a7d17351 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] HTTP exception thrown: Instance a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 could not be found. Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3c3fbea0-b4ea-4b39-994a-8975a7d17351 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Request method failure captured: Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 HTTP/1.1 Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4XPXBvA9ZhlG0UIexiD-216oinlT-pvF5ChaZP2Bbs7cqUfK77sqqNYMxGffNv2Yrr6s_ZCgAtjf20--sil5Q6y54rbumQ12DK2jfulGKFYW2nL0hxGvMf4CXTOxmgJopbFVSOQXbtz3jpYnUgiff2OySgVYUlAkn-2zSjP61_BUW8 Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: X-Openstack-Nova-Api-Version: 2.32 Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: c08474001ff6477cb14547afb2b6a72d Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-TaggedBootDevicesTest-1084764623 Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c08474001ff6477cb14547afb2b6a72d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c08474001ff6477cb14547afb2b6a72d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c08474001ff6477cb14547afb2b6a72d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c08474001ff6477cb14547afb2b6a72d", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-TaggedBootDevicesTest-1084764623 Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: c08474001ff6477cb14547afb2b6a72d Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1084764623 Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-TaggedBootDevicesTest-1084764623-project Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: a9fe7107d5e94104bda2d567394753fe Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-TaggedBootDevicesTest-1084764623-project Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 could not be found. Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9'} Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 could not be found. Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 could not be found. Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:09:13.081107 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:09:13.085645 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:09:13.085645 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:13.085645 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:09:13.085645 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:09:13.085645 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:09:13.085645 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:09:13.085645 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 could not be found. Aug 31 16:09:13.085645 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:09:13.090254 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3c3fbea0-b4ea-4b39-994a-8975a7d17351 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Returning 404 to user: Instance a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:09:13.091624 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3c3fbea0-b4ea-4b39-994a-8975a7d17351 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 404 len: 111 microversion: 2.32 time: 0.184240 Aug 31 16:09:13.094763 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1792/3755] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:09:12 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 111 bytes in 188 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:09:13.100633 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-24cd5e73-a660-43fa-a68f-7e880e9460c4 req-cf74b3d5-d723-4b92-9fab-b52643f0874f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098589 Aug 31 16:09:13.111278 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b51e19df-a831-4a12-bbac-238e29d28400 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:13.112161 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b51e19df-a831-4a12-bbac-238e29d28400 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 8701d926-4a72-483d-b0a3-57d8ee5f50c8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:13.118477 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1964/3756] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:09:13.130744 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b51e19df-a831-4a12-bbac-238e29d28400 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:13.133245 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b51e19df-a831-4a12-bbac-238e29d28400 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:13.134376 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b51e19df-a831-4a12-bbac-238e29d28400 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:13.135285 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b51e19df-a831-4a12-bbac-238e29d28400 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:13.136956 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b51e19df-a831-4a12-bbac-238e29d28400 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:13.138865 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b51e19df-a831-4a12-bbac-238e29d28400 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:13.151270 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-bec1dd74-9de3-4e74-b3dc-3b668b7295ff req-e40dbb32-c006-461c-abda-81b9b00619fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dc405fa-b1a4-4acc-8236-06a24e979f5e", "name": "network-vif-deleted", "tag": "b43723c2-c0d3-4a50-abf3-a3313299f8e1"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:09:13.177878 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-bec1dd74-9de3-4e74-b3dc-3b668b7295ff req-e40dbb32-c006-461c-abda-81b9b00619fb service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:13.183611 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-bec1dd74-9de3-4e74-b3dc-3b668b7295ff req-e40dbb32-c006-461c-abda-81b9b00619fb service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:13.184416 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-bec1dd74-9de3-4e74-b3dc-3b668b7295ff req-e40dbb32-c006-461c-abda-81b9b00619fb service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:13.206060 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-bec1dd74-9de3-4e74-b3dc-3b668b7295ff req-e40dbb32-c006-461c-abda-81b9b00619fb service nova] Creating event network-vif-deleted:b43723c2-c0d3-4a50-abf3-a3313299f8e1 for instance 1dc405fa-b1a4-4acc-8236-06a24e979f5e on n-h1-833090-16 Aug 31 16:09:13.233517 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-bec1dd74-9de3-4e74-b3dc-3b668b7295ff req-e40dbb32-c006-461c-abda-81b9b00619fb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113232 Aug 31 16:09:13.236948 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1965/3757] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:09:13.243917 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-50082438-b6b5-48e8-86a4-5236777f7f67 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '.version_select at 0x7fbb4aa5c700>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:13.325381 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-50082438-b6b5-48e8-86a4-5236777f7f67 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-838981112" status: 204 len: 0 microversion: 2.32 time: 0.086703 Aug 31 16:09:13.329408 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1966/3758] 10.222.0.50 () {60 vars in 1259 bytes} [Wed Aug 31 16:09:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-838981112 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 16:09:13.423866 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b51e19df-a831-4a12-bbac-238e29d28400 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9840c71c4ec49c1a60ef97943d173ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1355779c2e2d4cfeb0825b76968867b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:13.439712 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b51e19df-a831-4a12-bbac-238e29d28400 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8" status: 200 len: 1457 microversion: 2.1 time: 0.341528 Aug 31 16:09:13.445109 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1793/3759] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:13 2022] GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8 => generated 1457 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:13.670998 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a3c678ce-dcdb-4288-9c13-a2011a4bda2b tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:13.681064 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a3c678ce-dcdb-4288-9c13-a2011a4bda2b tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] [instance: 76a65fbc-5d3d-4759-ba22-cf7751f0a6b3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:13.712237 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a3c678ce-dcdb-4288-9c13-a2011a4bda2b tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:13.712237 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a3c678ce-dcdb-4288-9c13-a2011a4bda2b tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:13.712237 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a3c678ce-dcdb-4288-9c13-a2011a4bda2b tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:13.712237 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a3c678ce-dcdb-4288-9c13-a2011a4bda2b tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:13.712237 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a3c678ce-dcdb-4288-9c13-a2011a4bda2b tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:13.712237 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a3c678ce-dcdb-4288-9c13-a2011a4bda2b tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:13.930675 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-27578f1f-e4e0-4677-9372-04377b606844 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:13.931925 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-27578f1f-e4e0-4677-9372-04377b606844 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:13.944634 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27578f1f-e4e0-4677-9372-04377b606844 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:13.945386 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27578f1f-e4e0-4677-9372-04377b606844 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:13.945980 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27578f1f-e4e0-4677-9372-04377b606844 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:13.946909 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27578f1f-e4e0-4677-9372-04377b606844 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:13.953239 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27578f1f-e4e0-4677-9372-04377b606844 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:13.954120 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27578f1f-e4e0-4677-9372-04377b606844 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:14.235924 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a3c678ce-dcdb-4288-9c13-a2011a4bda2b tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a92ad15ba984304b27f1e337f1bae65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d874dc06bb94a3daffe23f9805ed0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:14.247443 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a3c678ce-dcdb-4288-9c13-a2011a4bda2b tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] 10.222.0.50 "GET /compute/v2.1/servers/76a65fbc-5d3d-4759-ba22-cf7751f0a6b3" status: 200 len: 1314 microversion: 2.1 time: 0.580921 Aug 31 16:09:14.250689 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1967/3760] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:13 2022] GET /compute/v2.1/servers/76a65fbc-5d3d-4759-ba22-cf7751f0a6b3 => generated 1314 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:14.274513 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a46d08b2-0d15-4bdc-b4ab-808f4a13833a tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:14.275910 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a46d08b2-0d15-4bdc-b4ab-808f4a13833a tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] [instance: ad0b8fd6-eec9-42fe-91af-a7904d758c93] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:14.284654 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a46d08b2-0d15-4bdc-b4ab-808f4a13833a tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:14.299756 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a46d08b2-0d15-4bdc-b4ab-808f4a13833a tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:14.300931 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a46d08b2-0d15-4bdc-b4ab-808f4a13833a tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:14.302086 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a46d08b2-0d15-4bdc-b4ab-808f4a13833a tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:14.303880 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a46d08b2-0d15-4bdc-b4ab-808f4a13833a tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:14.307163 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a46d08b2-0d15-4bdc-b4ab-808f4a13833a tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:14.409399 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a46d08b2-0d15-4bdc-b4ab-808f4a13833a tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:14.413153 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a46d08b2-0d15-4bdc-b4ab-808f4a13833a tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:14.413986 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a46d08b2-0d15-4bdc-b4ab-808f4a13833a tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:14.415720 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-a46d08b2-0d15-4bdc-b4ab-808f4a13833a tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lazy-loading 'fault' on Instance uuid ad0b8fd6-eec9-42fe-91af-a7904d758c93 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:09:14.560873 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a46d08b2-0d15-4bdc-b4ab-808f4a13833a tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4717b2fc0a654a77b40da565e599203f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c0154660c274106ab83ae50927348c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:14.570958 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a46d08b2-0d15-4bdc-b4ab-808f4a13833a tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] 10.222.0.50 "GET /compute/v2.1/servers/ad0b8fd6-eec9-42fe-91af-a7904d758c93" status: 200 len: 1306 microversion: 2.1 time: 0.319053 Aug 31 16:09:14.573320 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1968/3761] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:14 2022] GET /compute/v2.1/servers/ad0b8fd6-eec9-42fe-91af-a7904d758c93 => generated 1306 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:14.592749 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-da614a3d-0488-4232-923f-a11ac70b1140 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:14.596409 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-da614a3d-0488-4232-923f-a11ac70b1140 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] [instance: 8701d926-4a72-483d-b0a3-57d8ee5f50c8] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:14.636726 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-da614a3d-0488-4232-923f-a11ac70b1140 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:14.642871 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-da614a3d-0488-4232-923f-a11ac70b1140 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:14.644487 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-da614a3d-0488-4232-923f-a11ac70b1140 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:14.645344 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-da614a3d-0488-4232-923f-a11ac70b1140 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:14.646825 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-da614a3d-0488-4232-923f-a11ac70b1140 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:14.647359 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-da614a3d-0488-4232-923f-a11ac70b1140 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:14.725530 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-da614a3d-0488-4232-923f-a11ac70b1140 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] HTTP exception thrown: Instance 8701d926-4a72-483d-b0a3-57d8ee5f50c8 could not be found. Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-da614a3d-0488-4232-923f-a11ac70b1140 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Request method failure captured: Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8 HTTP/1.1 Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4WKvsbO08EL2S91UDZkibdodc8Ncpnx96A_z7G6JzDTVReVRJt4eaxqEagrCjiIt0sQK9L2XFjpe1FXBkALlUJ8tsVxARkQX1aQaJHXvorlxZYJqMjBiHR2B48FsHGsA1J11nYBrZ1wp73HofSCco1Rnc1vXSjVfKEu_sBy_NCjrg0 Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 1355779c2e2d4cfeb0825b76968867b1 Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-LiveMigrationTest-299357202 Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1355779c2e2d4cfeb0825b76968867b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1355779c2e2d4cfeb0825b76968867b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/1355779c2e2d4cfeb0825b76968867b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_1355779c2e2d4cfeb0825b76968867b1", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-LiveMigrationTest-299357202 Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 1355779c2e2d4cfeb0825b76968867b1 Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-LiveMigrationTest-299357202 Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-LiveMigrationTest-299357202-project Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: b9840c71c4ec49c1a60ef97943d173ef Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-LiveMigrationTest-299357202-project Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 8701d926-4a72-483d-b0a3-57d8ee5f50c8 could not be found. Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '8701d926-4a72-483d-b0a3-57d8ee5f50c8'} Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8701d926-4a72-483d-b0a3-57d8ee5f50c8 could not be found. Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8701d926-4a72-483d-b0a3-57d8ee5f50c8 could not be found. Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:09:14.737502 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:09:14.745159 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:14.745159 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:09:14.745159 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:09:14.745159 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:09:14.745159 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:09:14.745159 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8701d926-4a72-483d-b0a3-57d8ee5f50c8 could not be found. Aug 31 16:09:14.745159 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:09:14.745159 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-da614a3d-0488-4232-923f-a11ac70b1140 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] Returning 404 to user: Instance 8701d926-4a72-483d-b0a3-57d8ee5f50c8 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:09:14.747336 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-da614a3d-0488-4232-923f-a11ac70b1140 tempest-LiveMigrationTest-299357202 tempest-LiveMigrationTest-299357202-project] 10.222.0.50 "GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8" status: 404 len: 111 microversion: 2.1 time: 0.164412 Aug 31 16:09:14.757431 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1969/3762] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:14 2022] GET /compute/v2.1/servers/8701d926-4a72-483d-b0a3-57d8ee5f50c8 => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:09:14.761502 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-27578f1f-e4e0-4677-9372-04377b606844 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:14.792597 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-27578f1f-e4e0-4677-9372-04377b606844 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1677 microversion: 2.1 time: 0.863086 Aug 31 16:09:14.810166 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1794/3763] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:13 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1677 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:15.272905 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-4135e2b9-46fc-41cd-a05c-30aab8ab035c req-eb718917-83c8-4436-90d4-3f3d6c5b0150 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad0b8fd6-eec9-42fe-91af-a7904d758c93", "name": "network-vif-deleted", "tag": "71c89454-6693-4742-a290-7b5d85bf00d5"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:09:15.276238 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dbdd35e3-06f2-4386-87de-bdac1e0c9e04 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:15.276862 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dbdd35e3-06f2-4386-87de-bdac1e0c9e04 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] [instance: 76a65fbc-5d3d-4759-ba22-cf7751f0a6b3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:15.301071 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dbdd35e3-06f2-4386-87de-bdac1e0c9e04 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:15.301855 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dbdd35e3-06f2-4386-87de-bdac1e0c9e04 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:15.302511 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dbdd35e3-06f2-4386-87de-bdac1e0c9e04 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:15.320929 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dbdd35e3-06f2-4386-87de-bdac1e0c9e04 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:15.321745 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dbdd35e3-06f2-4386-87de-bdac1e0c9e04 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:15.326303 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dbdd35e3-06f2-4386-87de-bdac1e0c9e04 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:15.339901 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:09:15.346777 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-4135e2b9-46fc-41cd-a05c-30aab8ab035c req-eb718917-83c8-4436-90d4-3f3d6c5b0150 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:15.357883 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-4135e2b9-46fc-41cd-a05c-30aab8ab035c req-eb718917-83c8-4436-90d4-3f3d6c5b0150 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:15.358642 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-4135e2b9-46fc-41cd-a05c-30aab8ab035c req-eb718917-83c8-4436-90d4-3f3d6c5b0150 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:15.395461 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-4135e2b9-46fc-41cd-a05c-30aab8ab035c req-eb718917-83c8-4436-90d4-3f3d6c5b0150 service nova] Creating event network-vif-deleted:71c89454-6693-4742-a290-7b5d85bf00d5 for instance ad0b8fd6-eec9-42fe-91af-a7904d758c93 on n-h2-833090-16 Aug 31 16:09:15.412920 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-4135e2b9-46fc-41cd-a05c-30aab8ab035c req-eb718917-83c8-4436-90d4-3f3d6c5b0150 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148138 Aug 31 16:09:15.420889 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1970/3764] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:09:15.594565 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-be3e2ddf-a4e2-49e9-9f64-c7ae4e7eb412 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:15.595559 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-be3e2ddf-a4e2-49e9-9f64-c7ae4e7eb412 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] [instance: ad0b8fd6-eec9-42fe-91af-a7904d758c93] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:15.615791 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-be3e2ddf-a4e2-49e9-9f64-c7ae4e7eb412 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:15.617935 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-be3e2ddf-a4e2-49e9-9f64-c7ae4e7eb412 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:15.620079 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-be3e2ddf-a4e2-49e9-9f64-c7ae4e7eb412 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:15.620988 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-be3e2ddf-a4e2-49e9-9f64-c7ae4e7eb412 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:15.621584 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-be3e2ddf-a4e2-49e9-9f64-c7ae4e7eb412 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:15.622199 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-be3e2ddf-a4e2-49e9-9f64-c7ae4e7eb412 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:15.659522 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-be3e2ddf-a4e2-49e9-9f64-c7ae4e7eb412 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] HTTP exception thrown: Instance ad0b8fd6-eec9-42fe-91af-a7904d758c93 could not be found. Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-be3e2ddf-a4e2-49e9-9f64-c7ae4e7eb412 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Request method failure captured: Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/ad0b8fd6-eec9-42fe-91af-a7904d758c93 HTTP/1.1 Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4dsmvz_tw24h1frHyLks1v2j9MPHZLgx30j5yBX-fEoFx3-KDVl8SvFX4voSJq-1gSROym8EoLhPZKoPs_5JFb9B_WYkBaDiiGNJ3w0HCbSqYtlp0EaNfy7x4g2YeFlQKqvMefR7Hgz8JvxTiF8IpPFY3zXI4kqedmJensp26zWKyU Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 1c0154660c274106ab83ae50927348c8 Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-MultipleCreateTestJSON-711256623 Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1c0154660c274106ab83ae50927348c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1c0154660c274106ab83ae50927348c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/1c0154660c274106ab83ae50927348c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_1c0154660c274106ab83ae50927348c8", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-MultipleCreateTestJSON-711256623 Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 1c0154660c274106ab83ae50927348c8 Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-MultipleCreateTestJSON-711256623 Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-MultipleCreateTestJSON-711256623-project Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 4717b2fc0a654a77b40da565e599203f Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-MultipleCreateTestJSON-711256623-project Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance ad0b8fd6-eec9-42fe-91af-a7904d758c93 could not be found. Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'ad0b8fd6-eec9-42fe-91af-a7904d758c93'} Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad0b8fd6-eec9-42fe-91af-a7904d758c93 could not be found. Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad0b8fd6-eec9-42fe-91af-a7904d758c93 could not be found. Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:09:15.664033 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:09:15.668562 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:15.668562 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:09:15.668562 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:09:15.668562 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:09:15.668562 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:09:15.668562 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad0b8fd6-eec9-42fe-91af-a7904d758c93 could not be found. Aug 31 16:09:15.668562 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:09:15.679003 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-be3e2ddf-a4e2-49e9-9f64-c7ae4e7eb412 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Returning 404 to user: Instance ad0b8fd6-eec9-42fe-91af-a7904d758c93 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:09:15.680119 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-be3e2ddf-a4e2-49e9-9f64-c7ae4e7eb412 tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] 10.222.0.50 "GET /compute/v2.1/servers/ad0b8fd6-eec9-42fe-91af-a7904d758c93" status: 404 len: 111 microversion: 2.1 time: 0.090000 Aug 31 16:09:15.680888 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1971/3765] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:15 2022] GET /compute/v2.1/servers/ad0b8fd6-eec9-42fe-91af-a7904d758c93 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:09:15.689797 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3da1e50d-1dd0-40cb-b38d-9cd95421130c tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:15.690458 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3da1e50d-1dd0-40cb-b38d-9cd95421130c tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] [instance: 1dc405fa-b1a4-4acc-8236-06a24e979f5e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:15.701071 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3da1e50d-1dd0-40cb-b38d-9cd95421130c tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:15.701896 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3da1e50d-1dd0-40cb-b38d-9cd95421130c tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:15.702294 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3da1e50d-1dd0-40cb-b38d-9cd95421130c tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:15.704903 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3da1e50d-1dd0-40cb-b38d-9cd95421130c tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:15.705515 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3da1e50d-1dd0-40cb-b38d-9cd95421130c tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:15.708816 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3da1e50d-1dd0-40cb-b38d-9cd95421130c tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:15.744873 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-3da1e50d-1dd0-40cb-b38d-9cd95421130c tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] HTTP exception thrown: Instance 1dc405fa-b1a4-4acc-8236-06a24e979f5e could not be found. Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3da1e50d-1dd0-40cb-b38d-9cd95421130c tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Request method failure captured: Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/1dc405fa-b1a4-4acc-8236-06a24e979f5e HTTP/1.1 Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4dsmvz_tw24h1frHyLks1v2j9MPHZLgx30j5yBX-fEoFx3-KDVl8SvFX4voSJq-1gSROym8EoLhPZKoPs_5JFb9B_WYkBaDiiGNJ3w0HCbSqYtlp0EaNfy7x4g2YeFlQKqvMefR7Hgz8JvxTiF8IpPFY3zXI4kqedmJensp26zWKyU Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 1c0154660c274106ab83ae50927348c8 Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-MultipleCreateTestJSON-711256623 Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1c0154660c274106ab83ae50927348c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1c0154660c274106ab83ae50927348c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/1c0154660c274106ab83ae50927348c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_1c0154660c274106ab83ae50927348c8", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-MultipleCreateTestJSON-711256623 Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 1c0154660c274106ab83ae50927348c8 Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-MultipleCreateTestJSON-711256623 Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-MultipleCreateTestJSON-711256623-project Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 4717b2fc0a654a77b40da565e599203f Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-MultipleCreateTestJSON-711256623-project Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 1dc405fa-b1a4-4acc-8236-06a24e979f5e could not be found. Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '1dc405fa-b1a4-4acc-8236-06a24e979f5e'} Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1dc405fa-b1a4-4acc-8236-06a24e979f5e could not be found. Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1dc405fa-b1a4-4acc-8236-06a24e979f5e could not be found. Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:09:15.747172 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:09:15.750974 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:15.750974 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:09:15.750974 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:09:15.750974 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:09:15.750974 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:09:15.750974 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1dc405fa-b1a4-4acc-8236-06a24e979f5e could not be found. Aug 31 16:09:15.750974 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:09:15.752375 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3da1e50d-1dd0-40cb-b38d-9cd95421130c tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] Returning 404 to user: Instance 1dc405fa-b1a4-4acc-8236-06a24e979f5e could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:09:15.753380 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3da1e50d-1dd0-40cb-b38d-9cd95421130c tempest-MultipleCreateTestJSON-711256623 tempest-MultipleCreateTestJSON-711256623-project] 10.222.0.50 "GET /compute/v2.1/servers/1dc405fa-b1a4-4acc-8236-06a24e979f5e" status: 404 len: 111 microversion: 2.1 time: 0.067966 Aug 31 16:09:15.754477 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1972/3766] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:15 2022] GET /compute/v2.1/servers/1dc405fa-b1a4-4acc-8236-06a24e979f5e => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:09:15.818000 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d56b7eb5-5d43-42c2-9af2-7524fef40e5a tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:15.818799 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d56b7eb5-5d43-42c2-9af2-7524fef40e5a tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:15.828009 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d56b7eb5-5d43-42c2-9af2-7524fef40e5a tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:15.830824 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d56b7eb5-5d43-42c2-9af2-7524fef40e5a tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:15.834833 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d56b7eb5-5d43-42c2-9af2-7524fef40e5a tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:15.841885 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d56b7eb5-5d43-42c2-9af2-7524fef40e5a tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:15.843394 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d56b7eb5-5d43-42c2-9af2-7524fef40e5a tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:15.845469 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d56b7eb5-5d43-42c2-9af2-7524fef40e5a tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:15.859540 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dbdd35e3-06f2-4386-87de-bdac1e0c9e04 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a92ad15ba984304b27f1e337f1bae65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d874dc06bb94a3daffe23f9805ed0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:15.868285 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dbdd35e3-06f2-4386-87de-bdac1e0c9e04 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] 10.222.0.50 "GET /compute/v2.1/servers/76a65fbc-5d3d-4759-ba22-cf7751f0a6b3" status: 200 len: 1314 microversion: 2.1 time: 0.596262 Aug 31 16:09:15.868713 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1795/3767] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:15 2022] GET /compute/v2.1/servers/76a65fbc-5d3d-4759-ba22-cf7751f0a6b3 => generated 1314 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:15.932785 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=8 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:09:16.233347 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d56b7eb5-5d43-42c2-9af2-7524fef40e5a tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:16.248849 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d56b7eb5-5d43-42c2-9af2-7524fef40e5a tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1677 microversion: 2.1 time: 0.430597 Aug 31 16:09:16.249525 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1973/3768] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:15 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1677 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:09:16.889490 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7ac74211-f8c3-4010-9b43-6beddcfcfa93 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:16.890142 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7ac74211-f8c3-4010-9b43-6beddcfcfa93 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] [instance: 76a65fbc-5d3d-4759-ba22-cf7751f0a6b3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:16.908432 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ac74211-f8c3-4010-9b43-6beddcfcfa93 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:16.909641 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ac74211-f8c3-4010-9b43-6beddcfcfa93 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:16.909789 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ac74211-f8c3-4010-9b43-6beddcfcfa93 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:16.910736 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ac74211-f8c3-4010-9b43-6beddcfcfa93 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:16.911348 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ac74211-f8c3-4010-9b43-6beddcfcfa93 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:16.911917 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ac74211-f8c3-4010-9b43-6beddcfcfa93 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:16.917008 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:09:17.277727 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b82090f1-3de8-40f4-8c5a-278d21cc98b9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:17.279322 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b82090f1-3de8-40f4-8c5a-278d21cc98b9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:17.302000 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b82090f1-3de8-40f4-8c5a-278d21cc98b9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:17.307376 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b82090f1-3de8-40f4-8c5a-278d21cc98b9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:17.310890 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b82090f1-3de8-40f4-8c5a-278d21cc98b9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:17.314187 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b82090f1-3de8-40f4-8c5a-278d21cc98b9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:17.315821 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b82090f1-3de8-40f4-8c5a-278d21cc98b9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:17.318467 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b82090f1-3de8-40f4-8c5a-278d21cc98b9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:17.568294 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b82090f1-3de8-40f4-8c5a-278d21cc98b9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:17.585030 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b82090f1-3de8-40f4-8c5a-278d21cc98b9 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1609 microversion: 2.1 time: 0.313354 Aug 31 16:09:17.588953 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1974/3769] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:17 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1609 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:17.846335 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7ac74211-f8c3-4010-9b43-6beddcfcfa93 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a92ad15ba984304b27f1e337f1bae65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d874dc06bb94a3daffe23f9805ed0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:17.868002 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7ac74211-f8c3-4010-9b43-6beddcfcfa93 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] 10.222.0.50 "GET /compute/v2.1/servers/76a65fbc-5d3d-4759-ba22-cf7751f0a6b3" status: 200 len: 1314 microversion: 2.1 time: 0.982023 Aug 31 16:09:17.869334 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1796/3770] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:16 2022] GET /compute/v2.1/servers/76a65fbc-5d3d-4759-ba22-cf7751f0a6b3 => generated 1314 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:18.607340 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6cdd120c-1eca-402c-acf5-32a03916fa99 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:18.608652 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6cdd120c-1eca-402c-acf5-32a03916fa99 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:18.623276 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6cdd120c-1eca-402c-acf5-32a03916fa99 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:18.637104 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6cdd120c-1eca-402c-acf5-32a03916fa99 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:18.640223 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6cdd120c-1eca-402c-acf5-32a03916fa99 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:18.643707 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6cdd120c-1eca-402c-acf5-32a03916fa99 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:18.649481 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6cdd120c-1eca-402c-acf5-32a03916fa99 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:18.660550 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6cdd120c-1eca-402c-acf5-32a03916fa99 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:18.752265 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d59ba1fe-b4ae-4cc2-aafb-86a9b0b3a98d tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Action: 'create', calling method: .version_select at 0x7fbb4731c310>, body: {"keypair": {"name": "tempest-keypair-1327393296", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQLP/pBB0g/R82QMxqnKs1Cj4Q5BKwNAMt0ZztKPKcxHu9vm0pKHMOBZDaFvnOJGWCGjdun8OZqGXgLDbz2htndZD786VxxPbpsHhigfc5gDHKLNPI4X/xKUtY0pdkKCQ=="}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:09:18.843815 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-d59ba1fe-b4ae-4cc2-aafb-86a9b0b3a98d tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Getting quotas for project fc4ea8520b024e0a8a3d8bbc2991504d. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:09:18.874561 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-d59ba1fe-b4ae-4cc2-aafb-86a9b0b3a98d tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Getting quotas for user a631b69c25264974a5d9af3045c248f1 and project fc4ea8520b024e0a8a3d8bbc2991504d. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:09:18.906566 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6cdd120c-1eca-402c-acf5-32a03916fa99 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:18.946999 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6cdd120c-1eca-402c-acf5-32a03916fa99 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1609 microversion: 2.1 time: 0.343551 Aug 31 16:09:18.950405 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1797/3771] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:18 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1609 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:18.961698 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-20b0d12f-921d-4c1d-b9ed-7ad720b0219d tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:18.987563 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-20b0d12f-921d-4c1d-b9ed-7ad720b0219d tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] [instance: 76a65fbc-5d3d-4759-ba22-cf7751f0a6b3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:19.002337 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d59ba1fe-b4ae-4cc2-aafb-86a9b0b3a98d tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.468488 Aug 31 16:09:19.007555 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1975/3772] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 31 16:09:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:09:19.011479 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20b0d12f-921d-4c1d-b9ed-7ad720b0219d tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:19.018926 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20b0d12f-921d-4c1d-b9ed-7ad720b0219d tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:19.023457 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20b0d12f-921d-4c1d-b9ed-7ad720b0219d tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:19.031232 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20b0d12f-921d-4c1d-b9ed-7ad720b0219d tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:19.032101 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20b0d12f-921d-4c1d-b9ed-7ad720b0219d tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:19.032899 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20b0d12f-921d-4c1d-b9ed-7ad720b0219d tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:19.423709 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-b3ff9b31-5b3a-4a13-8380-b93e8276853e req-f6bf1f36-79ab-47c9-af12-77ac7c2022e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76a65fbc-5d3d-4759-ba22-cf7751f0a6b3", "tag": "17b71f61-175c-428f-8ce2-e58c60b3831b"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:09:19.464953 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-b3ff9b31-5b3a-4a13-8380-b93e8276853e req-f6bf1f36-79ab-47c9-af12-77ac7c2022e2 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:19.465785 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-b3ff9b31-5b3a-4a13-8380-b93e8276853e req-f6bf1f36-79ab-47c9-af12-77ac7c2022e2 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:19.466605 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-b3ff9b31-5b3a-4a13-8380-b93e8276853e req-f6bf1f36-79ab-47c9-af12-77ac7c2022e2 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:19.540758 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-b3ff9b31-5b3a-4a13-8380-b93e8276853e req-f6bf1f36-79ab-47c9-af12-77ac7c2022e2 service nova] Creating event network-changed:17b71f61-175c-428f-8ce2-e58c60b3831b for instance 76a65fbc-5d3d-4759-ba22-cf7751f0a6b3 on n-h2-833090-16 Aug 31 16:09:19.587365 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-b3ff9b31-5b3a-4a13-8380-b93e8276853e req-f6bf1f36-79ab-47c9-af12-77ac7c2022e2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153370 Aug 31 16:09:19.590678 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1976/3773] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:09:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:09:19.973633 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-085ae6cf-256f-45e0-b9a4-72a1f7a1bce2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:19.974335 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-085ae6cf-256f-45e0-b9a4-72a1f7a1bce2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:20.006818 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-085ae6cf-256f-45e0-b9a4-72a1f7a1bce2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:20.007558 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-085ae6cf-256f-45e0-b9a4-72a1f7a1bce2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:20.008024 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-085ae6cf-256f-45e0-b9a4-72a1f7a1bce2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:20.008782 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-085ae6cf-256f-45e0-b9a4-72a1f7a1bce2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:20.009247 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-085ae6cf-256f-45e0-b9a4-72a1f7a1bce2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:20.009676 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-085ae6cf-256f-45e0-b9a4-72a1f7a1bce2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:20.161933 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:09:20.163734 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-085ae6cf-256f-45e0-b9a4-72a1f7a1bce2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:20.170566 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-085ae6cf-256f-45e0-b9a4-72a1f7a1bce2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:20.171297 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-085ae6cf-256f-45e0-b9a4-72a1f7a1bce2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:20.179221 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-085ae6cf-256f-45e0-b9a4-72a1f7a1bce2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lazy-loading 'fault' on Instance uuid 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:09:20.429996 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-20b0d12f-921d-4c1d-b9ed-7ad720b0219d tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a92ad15ba984304b27f1e337f1bae65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d874dc06bb94a3daffe23f9805ed0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:20.439404 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-20b0d12f-921d-4c1d-b9ed-7ad720b0219d tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] 10.222.0.50 "GET /compute/v2.1/servers/76a65fbc-5d3d-4759-ba22-cf7751f0a6b3" status: 200 len: 1314 microversion: 2.1 time: 1.487672 Aug 31 16:09:20.440064 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1798/3774] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:18 2022] GET /compute/v2.1/servers/76a65fbc-5d3d-4759-ba22-cf7751f0a6b3 => generated 1314 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:20.581159 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-085ae6cf-256f-45e0-b9a4-72a1f7a1bce2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeeaf32202f747c8a2b98836f503aa7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11ef5102f83142d1a52befe52c3595d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:20.589136 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-085ae6cf-256f-45e0-b9a4-72a1f7a1bce2 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 200 len: 1329 microversion: 2.1 time: 0.620020 Aug 31 16:09:20.618292 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1977/3775] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:19 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 1329 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:21.464421 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-053f4477-5576-4fc1-932f-00edefc12fb8 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:21.465735 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-053f4477-5576-4fc1-932f-00edefc12fb8 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] [instance: 76a65fbc-5d3d-4759-ba22-cf7751f0a6b3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:21.479584 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-053f4477-5576-4fc1-932f-00edefc12fb8 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:21.482775 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-053f4477-5576-4fc1-932f-00edefc12fb8 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:21.484598 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-053f4477-5576-4fc1-932f-00edefc12fb8 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:21.485643 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-053f4477-5576-4fc1-932f-00edefc12fb8 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:21.493543 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-053f4477-5576-4fc1-932f-00edefc12fb8 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:21.494438 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-053f4477-5576-4fc1-932f-00edefc12fb8 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:21.615157 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b538748d-82ab-444e-9ed8-a7d0b928973e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:21.615906 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b538748d-82ab-444e-9ed8-a7d0b928973e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] [instance: 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:21.629822 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b538748d-82ab-444e-9ed8-a7d0b928973e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:21.635160 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b538748d-82ab-444e-9ed8-a7d0b928973e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:21.635935 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b538748d-82ab-444e-9ed8-a7d0b928973e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:21.637689 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b538748d-82ab-444e-9ed8-a7d0b928973e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:21.639410 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b538748d-82ab-444e-9ed8-a7d0b928973e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:21.639952 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b538748d-82ab-444e-9ed8-a7d0b928973e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:21.680443 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-b538748d-82ab-444e-9ed8-a7d0b928973e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] HTTP exception thrown: Instance 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b could not be found. Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b538748d-82ab-444e-9ed8-a7d0b928973e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Request method failure captured: Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b HTTP/1.1 Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4VKUAYKz-WFBtmk16aIOyXYR2HhyYuZ36VRZsBRjqviBnc5RSPRJJqpoARQYteX5NSEljs3qX5_RMCYaeMof8M6i0ZB3mJgVdRhk2nIL2yk-7L_KhuV1lL_MMec1r7AAygDhG-639IQUe0ED7x0P_yoZ7NSrcY8NXkYeyVxFn3mUyo Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 11ef5102f83142d1a52befe52c3595d4 Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServerActionsTestJSON-1629819008 Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/11ef5102f83142d1a52befe52c3595d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/11ef5102f83142d1a52befe52c3595d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/11ef5102f83142d1a52befe52c3595d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_11ef5102f83142d1a52befe52c3595d4", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServerActionsTestJSON-1629819008 Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 11ef5102f83142d1a52befe52c3595d4 Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServerActionsTestJSON-1629819008 Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServerActionsTestJSON-1629819008-project Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: aeeaf32202f747c8a2b98836f503aa7e Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServerActionsTestJSON-1629819008-project Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b could not be found. Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b'} Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b could not be found. Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b could not be found. Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:09:21.682529 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:09:21.686837 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:21.686837 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:09:21.686837 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:09:21.686837 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:09:21.686837 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:09:21.686837 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b could not be found. Aug 31 16:09:21.686837 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:09:21.689135 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b538748d-82ab-444e-9ed8-a7d0b928973e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Returning 404 to user: Instance 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:09:21.691198 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b538748d-82ab-444e-9ed8-a7d0b928973e tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b" status: 404 len: 111 microversion: 2.1 time: 0.080703 Aug 31 16:09:21.697089 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1978/3776] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:21 2022] GET /compute/v2.1/servers/6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:09:21.705392 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-718549f5-1812-48eb-9bff-9d50ba535f74 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] Calling method '.version_select at 0x7fbb46bfaa60>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:21.746121 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-718549f5-1812-48eb-9bff-9d50ba535f74 tempest-ServerActionsTestJSON-1629819008 tempest-ServerActionsTestJSON-1629819008-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1324800784" status: 202 len: 0 microversion: 2.1 time: 0.044711 Aug 31 16:09:21.746713 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1979/3777] 10.222.0.50 () {58 vars in 1221 bytes} [Wed Aug 31 16:09:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1324800784 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 16:09:21.775409 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-983f53d4-4882-48e0-bbe1-97acfffff7f7 req-dbabb3f5-213c-499f-9464-5881c49259f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b", "name": "network-vif-deleted", "tag": "4e98deab-3424-49ec-b930-3019d71c32c7"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:09:21.796912 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-983f53d4-4882-48e0-bbe1-97acfffff7f7 req-dbabb3f5-213c-499f-9464-5881c49259f9 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:21.796912 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-983f53d4-4882-48e0-bbe1-97acfffff7f7 req-dbabb3f5-213c-499f-9464-5881c49259f9 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:21.797163 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-983f53d4-4882-48e0-bbe1-97acfffff7f7 req-dbabb3f5-213c-499f-9464-5881c49259f9 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:21.825411 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-983f53d4-4882-48e0-bbe1-97acfffff7f7 req-dbabb3f5-213c-499f-9464-5881c49259f9 service nova] Creating event network-vif-deleted:4e98deab-3424-49ec-b930-3019d71c32c7 for instance 6dd2c0ca-f19c-473d-9a9b-00cb0c32f16b on n-h1-833090-16 Aug 31 16:09:21.837662 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-983f53d4-4882-48e0-bbe1-97acfffff7f7 req-dbabb3f5-213c-499f-9464-5881c49259f9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066342 Aug 31 16:09:21.838746 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1980/3778] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:09:22.204009 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-053f4477-5576-4fc1-932f-00edefc12fb8 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a92ad15ba984304b27f1e337f1bae65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d874dc06bb94a3daffe23f9805ed0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:22.232667 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-053f4477-5576-4fc1-932f-00edefc12fb8 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] 10.222.0.50 "GET /compute/v2.1/servers/76a65fbc-5d3d-4759-ba22-cf7751f0a6b3" status: 200 len: 1314 microversion: 2.1 time: 0.772170 Aug 31 16:09:22.242828 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1799/3779] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:21 2022] GET /compute/v2.1/servers/76a65fbc-5d3d-4759-ba22-cf7751f0a6b3 => generated 1314 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:23.268690 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-44fb7b74-7f23-4b1c-96d2-ca0fce7fc0c8 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:23.270029 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-44fb7b74-7f23-4b1c-96d2-ca0fce7fc0c8 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] [instance: 76a65fbc-5d3d-4759-ba22-cf7751f0a6b3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:23.288251 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-44fb7b74-7f23-4b1c-96d2-ca0fce7fc0c8 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:23.288993 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-44fb7b74-7f23-4b1c-96d2-ca0fce7fc0c8 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:23.289601 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-44fb7b74-7f23-4b1c-96d2-ca0fce7fc0c8 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:23.290507 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-44fb7b74-7f23-4b1c-96d2-ca0fce7fc0c8 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:23.291128 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-44fb7b74-7f23-4b1c-96d2-ca0fce7fc0c8 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:23.291705 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-44fb7b74-7f23-4b1c-96d2-ca0fce7fc0c8 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:24.977187 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-44fb7b74-7f23-4b1c-96d2-ca0fce7fc0c8 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a92ad15ba984304b27f1e337f1bae65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d874dc06bb94a3daffe23f9805ed0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:24.992186 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-44fb7b74-7f23-4b1c-96d2-ca0fce7fc0c8 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] 10.222.0.50 "GET /compute/v2.1/servers/76a65fbc-5d3d-4759-ba22-cf7751f0a6b3" status: 200 len: 1314 microversion: 2.1 time: 1.729181 Aug 31 16:09:24.996247 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1981/3780] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:23 2022] GET /compute/v2.1/servers/76a65fbc-5d3d-4759-ba22-cf7751f0a6b3 => generated 1314 bytes in 1734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:26.020944 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-71875081-2ebf-4ade-96d2-90a27b965952 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:26.021861 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-71875081-2ebf-4ade-96d2-90a27b965952 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] [instance: 76a65fbc-5d3d-4759-ba22-cf7751f0a6b3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:26.060261 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-71875081-2ebf-4ade-96d2-90a27b965952 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:26.068823 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-71875081-2ebf-4ade-96d2-90a27b965952 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:26.069469 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-71875081-2ebf-4ade-96d2-90a27b965952 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:26.070278 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-71875081-2ebf-4ade-96d2-90a27b965952 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:26.075621 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-71875081-2ebf-4ade-96d2-90a27b965952 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:26.076125 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-71875081-2ebf-4ade-96d2-90a27b965952 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:27.181915 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-71875081-2ebf-4ade-96d2-90a27b965952 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a92ad15ba984304b27f1e337f1bae65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d874dc06bb94a3daffe23f9805ed0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:27.197175 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-71875081-2ebf-4ade-96d2-90a27b965952 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] 10.222.0.50 "GET /compute/v2.1/servers/76a65fbc-5d3d-4759-ba22-cf7751f0a6b3" status: 200 len: 1314 microversion: 2.1 time: 1.182153 Aug 31 16:09:27.197896 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1800/3781] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:26 2022] GET /compute/v2.1/servers/76a65fbc-5d3d-4759-ba22-cf7751f0a6b3 => generated 1314 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:09:28.225029 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a3b4e261-7d76-414c-9b07-8566ee36fc7b tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:28.228128 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a3b4e261-7d76-414c-9b07-8566ee36fc7b tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] [instance: 76a65fbc-5d3d-4759-ba22-cf7751f0a6b3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:28.268970 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a3b4e261-7d76-414c-9b07-8566ee36fc7b tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:28.271459 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a3b4e261-7d76-414c-9b07-8566ee36fc7b tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:28.272311 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a3b4e261-7d76-414c-9b07-8566ee36fc7b tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:28.275110 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a3b4e261-7d76-414c-9b07-8566ee36fc7b tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:28.276390 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a3b4e261-7d76-414c-9b07-8566ee36fc7b tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:28.278745 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a3b4e261-7d76-414c-9b07-8566ee36fc7b tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:28.415134 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-372c832d-a852-4dcb-8995-0040a08c84b2 req-059ba062-8181-4a8b-af1a-552918d51708 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76a65fbc-5d3d-4759-ba22-cf7751f0a6b3", "name": "network-vif-plugged", "status": "completed", "tag": "17b71f61-175c-428f-8ce2-e58c60b3831b"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:09:28.473270 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-372c832d-a852-4dcb-8995-0040a08c84b2 req-059ba062-8181-4a8b-af1a-552918d51708 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:28.474083 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-372c832d-a852-4dcb-8995-0040a08c84b2 req-059ba062-8181-4a8b-af1a-552918d51708 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:28.476625 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-372c832d-a852-4dcb-8995-0040a08c84b2 req-059ba062-8181-4a8b-af1a-552918d51708 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:28.505265 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-372c832d-a852-4dcb-8995-0040a08c84b2 req-059ba062-8181-4a8b-af1a-552918d51708 service nova] Creating event network-vif-plugged:17b71f61-175c-428f-8ce2-e58c60b3831b for instance 76a65fbc-5d3d-4759-ba22-cf7751f0a6b3 on n-h2-833090-16 Aug 31 16:09:28.515579 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-372c832d-a852-4dcb-8995-0040a08c84b2 req-059ba062-8181-4a8b-af1a-552918d51708 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105872 Aug 31 16:09:28.517876 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1801/3782] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:09:28.940563 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=4 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:09:29.538128 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a3b4e261-7d76-414c-9b07-8566ee36fc7b tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a92ad15ba984304b27f1e337f1bae65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d874dc06bb94a3daffe23f9805ed0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:29.549913 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a3b4e261-7d76-414c-9b07-8566ee36fc7b tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] 10.222.0.50 "GET /compute/v2.1/servers/76a65fbc-5d3d-4759-ba22-cf7751f0a6b3" status: 200 len: 1314 microversion: 2.1 time: 1.331585 Aug 31 16:09:29.565875 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1982/3783] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:28 2022] GET /compute/v2.1/servers/76a65fbc-5d3d-4759-ba22-cf7751f0a6b3 => generated 1314 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:30.334056 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b1fbed26-b912-41ee-bc13-d77cd93b9dc2 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1843925840", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "a3e10090-e412-487c-8b4b-5fcb3e902bb9"}], "security_groups": [{"name": "tempest-securitygroup--77845780"}], "key_name": "tempest-keypair-1327393296", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:09:30.572504 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-954b34c2-ebf8-4622-bdeb-1c39c6d9fe03 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:30.573229 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-954b34c2-ebf8-4622-bdeb-1c39c6d9fe03 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] [instance: 76a65fbc-5d3d-4759-ba22-cf7751f0a6b3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:30.614609 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-954b34c2-ebf8-4622-bdeb-1c39c6d9fe03 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:30.615291 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-954b34c2-ebf8-4622-bdeb-1c39c6d9fe03 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:30.615841 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-954b34c2-ebf8-4622-bdeb-1c39c6d9fe03 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:30.616762 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-954b34c2-ebf8-4622-bdeb-1c39c6d9fe03 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:30.617395 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-954b34c2-ebf8-4622-bdeb-1c39c6d9fe03 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:30.617983 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-954b34c2-ebf8-4622-bdeb-1c39c6d9fe03 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:31.287647 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-b1fbed26-b912-41ee-bc13-d77cd93b9dc2 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] validate_networks() for [('a3e10090-e412-487c-8b4b-5fcb3e902bb9', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:09:31.664435 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-954b34c2-ebf8-4622-bdeb-1c39c6d9fe03 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a92ad15ba984304b27f1e337f1bae65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d874dc06bb94a3daffe23f9805ed0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:31.680652 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-954b34c2-ebf8-4622-bdeb-1c39c6d9fe03 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] 10.222.0.50 "GET /compute/v2.1/servers/76a65fbc-5d3d-4759-ba22-cf7751f0a6b3" status: 200 len: 1314 microversion: 2.1 time: 1.111197 Aug 31 16:09:31.683182 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1983/3784] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:30 2022] GET /compute/v2.1/servers/76a65fbc-5d3d-4759-ba22-cf7751f0a6b3 => generated 1314 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:09:31.688870 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8841c496-e7fd-46f9-9c1d-750e569d2d0c tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:31.689358 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8841c496-e7fd-46f9-9c1d-750e569d2d0c tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:31.706146 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8841c496-e7fd-46f9-9c1d-750e569d2d0c tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:31.706373 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8841c496-e7fd-46f9-9c1d-750e569d2d0c tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:31.707152 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8841c496-e7fd-46f9-9c1d-750e569d2d0c tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:31.708174 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8841c496-e7fd-46f9-9c1d-750e569d2d0c tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:31.708880 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8841c496-e7fd-46f9-9c1d-750e569d2d0c tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:31.710617 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8841c496-e7fd-46f9-9c1d-750e569d2d0c tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:31.769332 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-8841c496-e7fd-46f9-9c1d-750e569d2d0c tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] HTTP exception thrown: Instance a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 could not be found. Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8841c496-e7fd-46f9-9c1d-750e569d2d0c tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Request method failure captured: Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: request: DELETE /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 HTTP/1.1 Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4XPXBvA9ZhlG0UIexiD-216oinlT-pvF5ChaZP2Bbs7cqUfK77sqqNYMxGffNv2Yrr6s_ZCgAtjf20--sil5Q6y54rbumQ12DK2jfulGKFYW2nL0hxGvMf4CXTOxmgJopbFVSOQXbtz3jpYnUgiff2OySgVYUlAkn-2zSjP61_BUW8 Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: X-Openstack-Nova-Api-Version: 2.32 Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: c08474001ff6477cb14547afb2b6a72d Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-TaggedBootDevicesTest-1084764623 Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c08474001ff6477cb14547afb2b6a72d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c08474001ff6477cb14547afb2b6a72d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c08474001ff6477cb14547afb2b6a72d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c08474001ff6477cb14547afb2b6a72d", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-TaggedBootDevicesTest-1084764623 Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: c08474001ff6477cb14547afb2b6a72d Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1084764623 Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-TaggedBootDevicesTest-1084764623-project Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: a9fe7107d5e94104bda2d567394753fe Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-TaggedBootDevicesTest-1084764623-project Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 could not be found. Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9'} Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 could not be found. Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:09:31.775478 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:09:31.779870 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 could not be found. Aug 31 16:09:31.779870 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:09:31.779870 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:09:31.779870 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:09:31.779870 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:31.779870 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:09:31.779870 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:09:31.779870 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:09:31.779870 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:09:31.779870 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 could not be found. Aug 31 16:09:31.779870 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:09:31.782856 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8841c496-e7fd-46f9-9c1d-750e569d2d0c tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Returning 404 to user: Instance a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:09:31.786629 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8841c496-e7fd-46f9-9c1d-750e569d2d0c tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 404 len: 111 microversion: 2.32 time: 0.102279 Aug 31 16:09:31.790532 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1984/3785] 10.222.0.50 () {60 vars in 1280 bytes} [Wed Aug 31 16:09:31 2022] DELETE /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:09:31.807532 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2cbd08a7-d8e8-48d0-856c-a86c6cdcfb34 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:31.808801 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2cbd08a7-d8e8-48d0-856c-a86c6cdcfb34 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] [instance: a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:31.832198 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2cbd08a7-d8e8-48d0-856c-a86c6cdcfb34 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:31.834474 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2cbd08a7-d8e8-48d0-856c-a86c6cdcfb34 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:31.835113 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2cbd08a7-d8e8-48d0-856c-a86c6cdcfb34 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:31.838287 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2cbd08a7-d8e8-48d0-856c-a86c6cdcfb34 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:31.838987 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2cbd08a7-d8e8-48d0-856c-a86c6cdcfb34 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:31.839593 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2cbd08a7-d8e8-48d0-856c-a86c6cdcfb34 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:31.896140 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-2cbd08a7-d8e8-48d0-856c-a86c6cdcfb34 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] HTTP exception thrown: Instance a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 could not be found. Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2cbd08a7-d8e8-48d0-856c-a86c6cdcfb34 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Request method failure captured: Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 HTTP/1.1 Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4XPXBvA9ZhlG0UIexiD-216oinlT-pvF5ChaZP2Bbs7cqUfK77sqqNYMxGffNv2Yrr6s_ZCgAtjf20--sil5Q6y54rbumQ12DK2jfulGKFYW2nL0hxGvMf4CXTOxmgJopbFVSOQXbtz3jpYnUgiff2OySgVYUlAkn-2zSjP61_BUW8 Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: X-Openstack-Nova-Api-Version: 2.32 Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: c08474001ff6477cb14547afb2b6a72d Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-TaggedBootDevicesTest-1084764623 Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c08474001ff6477cb14547afb2b6a72d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c08474001ff6477cb14547afb2b6a72d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c08474001ff6477cb14547afb2b6a72d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c08474001ff6477cb14547afb2b6a72d", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-TaggedBootDevicesTest-1084764623 Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: c08474001ff6477cb14547afb2b6a72d Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1084764623 Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-TaggedBootDevicesTest-1084764623-project Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: a9fe7107d5e94104bda2d567394753fe Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-TaggedBootDevicesTest-1084764623-project Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 could not be found. Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9'} Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 could not be found. Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 could not be found. Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:09:31.898792 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:09:31.903406 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:09:31.903406 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:31.903406 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:09:31.903406 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:09:31.903406 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:09:31.903406 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:09:31.903406 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 could not be found. Aug 31 16:09:31.903406 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:09:31.904811 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2cbd08a7-d8e8-48d0-856c-a86c6cdcfb34 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] Returning 404 to user: Instance a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:09:31.909454 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2cbd08a7-d8e8-48d0-856c-a86c6cdcfb34 tempest-TaggedBootDevicesTest-1084764623 tempest-TaggedBootDevicesTest-1084764623-project] 10.222.0.50 "GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9" status: 404 len: 111 microversion: 2.32 time: 0.109441 Aug 31 16:09:31.910293 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1985/3786] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:09:31 2022] GET /compute/v2.1/servers/a5c25c8a-1f60-42ea-8582-eb3a6ba30bc9 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:09:32.703632 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6959111f-ad63-4aad-a7b8-b1c5275dd477 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:32.704599 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6959111f-ad63-4aad-a7b8-b1c5275dd477 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] [instance: 76a65fbc-5d3d-4759-ba22-cf7751f0a6b3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:32.740909 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6959111f-ad63-4aad-a7b8-b1c5275dd477 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:32.744165 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6959111f-ad63-4aad-a7b8-b1c5275dd477 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:32.744637 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6959111f-ad63-4aad-a7b8-b1c5275dd477 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:32.745564 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6959111f-ad63-4aad-a7b8-b1c5275dd477 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:32.746072 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6959111f-ad63-4aad-a7b8-b1c5275dd477 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:32.746527 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6959111f-ad63-4aad-a7b8-b1c5275dd477 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:33.595089 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6959111f-ad63-4aad-a7b8-b1c5275dd477 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a92ad15ba984304b27f1e337f1bae65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d874dc06bb94a3daffe23f9805ed0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:33.661530 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6959111f-ad63-4aad-a7b8-b1c5275dd477 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] 10.222.0.50 "GET /compute/v2.1/servers/76a65fbc-5d3d-4759-ba22-cf7751f0a6b3" status: 200 len: 1464 microversion: 2.1 time: 0.962531 Aug 31 16:09:33.664340 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1986/3787] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:32 2022] GET /compute/v2.1/servers/76a65fbc-5d3d-4759-ba22-cf7751f0a6b3 => generated 1464 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:09:33.673642 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-b1fbed26-b912-41ee-bc13-d77cd93b9dc2 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Getting quotas for project fc4ea8520b024e0a8a3d8bbc2991504d. Resources: dict_keys(['metadata_items']) {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:09:33.694410 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-b1fbed26-b912-41ee-bc13-d77cd93b9dc2 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Getting quotas for user a631b69c25264974a5d9af3045c248f1 and project fc4ea8520b024e0a8a3d8bbc2991504d. Resources: dict_keys(['metadata_items']) {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:09:33.749949 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5c5fcc45-eaf7-434a-91d2-f0fa262ca3e3 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:33.751331 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5c5fcc45-eaf7-434a-91d2-f0fa262ca3e3 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] [instance: 76a65fbc-5d3d-4759-ba22-cf7751f0a6b3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:33.763972 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5c5fcc45-eaf7-434a-91d2-f0fa262ca3e3 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:33.764992 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b1fbed26-b912-41ee-bc13-d77cd93b9dc2 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:09:33.765410 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b1fbed26-b912-41ee-bc13-d77cd93b9dc2 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:09:33.770986 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b1fbed26-b912-41ee-bc13-d77cd93b9dc2 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:09:33.771175 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5c5fcc45-eaf7-434a-91d2-f0fa262ca3e3 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:33.771714 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5c5fcc45-eaf7-434a-91d2-f0fa262ca3e3 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:33.773216 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5c5fcc45-eaf7-434a-91d2-f0fa262ca3e3 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:33.774071 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5c5fcc45-eaf7-434a-91d2-f0fa262ca3e3 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:33.774730 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5c5fcc45-eaf7-434a-91d2-f0fa262ca3e3 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:33.778901 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b1fbed26-b912-41ee-bc13-d77cd93b9dc2 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:09:33.779350 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b1fbed26-b912-41ee-bc13-d77cd93b9dc2 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:09:33.811317 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1fbed26-b912-41ee-bc13-d77cd93b9dc2 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:33.812116 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1fbed26-b912-41ee-bc13-d77cd93b9dc2 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:33.813063 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1fbed26-b912-41ee-bc13-d77cd93b9dc2 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:33.814081 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1fbed26-b912-41ee-bc13-d77cd93b9dc2 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:33.830906 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1fbed26-b912-41ee-bc13-d77cd93b9dc2 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:33.831614 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1fbed26-b912-41ee-bc13-d77cd93b9dc2 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:33.850541 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5c5fcc45-eaf7-434a-91d2-f0fa262ca3e3 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] [instance: 76a65fbc-5d3d-4759-ba22-cf7751f0a6b3] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:09:33.918318 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-b1fbed26-b912-41ee-bc13-d77cd93b9dc2 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Getting quotas for project fc4ea8520b024e0a8a3d8bbc2991504d. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:09:33.943634 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-b1fbed26-b912-41ee-bc13-d77cd93b9dc2 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Getting quotas for user a631b69c25264974a5d9af3045c248f1 and project fc4ea8520b024e0a8a3d8bbc2991504d. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:09:33.976761 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b1fbed26-b912-41ee-bc13-d77cd93b9dc2 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:09:33.986595 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b1fbed26-b912-41ee-bc13-d77cd93b9dc2 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] [instance: f6f12af7-92ac-4c99-a4f7-282d970356c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:09:34.069696 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:09:34.202854 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b1fbed26-b912-41ee-bc13-d77cd93b9dc2 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 3.875773 Aug 31 16:09:34.205892 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1802/3788] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:09:30 2022] POST /compute/v2.1/servers => generated 407 bytes in 3881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:09:34.213913 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5c5fcc45-eaf7-434a-91d2-f0fa262ca3e3 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] 10.222.0.50 "DELETE /compute/v2.1/servers/76a65fbc-5d3d-4759-ba22-cf7751f0a6b3" status: 204 len: 0 microversion: 2.1 time: 0.468612 Aug 31 16:09:34.220404 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1987/3789] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:09:33 2022] DELETE /compute/v2.1/servers/76a65fbc-5d3d-4759-ba22-cf7751f0a6b3 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 16:09:34.224625 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0806cfaf-958c-4640-a210-2ba2ec0c7ddc tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:34.225931 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0806cfaf-958c-4640-a210-2ba2ec0c7ddc tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] [instance: f6f12af7-92ac-4c99-a4f7-282d970356c6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:34.226160 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-506457bb-d94f-421e-a1b3-2fe8141f519c tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:34.226744 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-506457bb-d94f-421e-a1b3-2fe8141f519c tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] [instance: 76a65fbc-5d3d-4759-ba22-cf7751f0a6b3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:34.264315 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-506457bb-d94f-421e-a1b3-2fe8141f519c tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:34.265401 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-506457bb-d94f-421e-a1b3-2fe8141f519c tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:34.268476 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-506457bb-d94f-421e-a1b3-2fe8141f519c tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:34.269429 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-506457bb-d94f-421e-a1b3-2fe8141f519c tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:34.270048 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-506457bb-d94f-421e-a1b3-2fe8141f519c tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:34.272380 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-506457bb-d94f-421e-a1b3-2fe8141f519c tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:34.705525 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0806cfaf-958c-4640-a210-2ba2ec0c7ddc tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a631b69c25264974a5d9af3045c248f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4ea8520b024e0a8a3d8bbc2991504d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:34.738191 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0806cfaf-958c-4640-a210-2ba2ec0c7ddc tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] 10.222.0.50 "GET /compute/v2.1/servers/f6f12af7-92ac-4c99-a4f7-282d970356c6" status: 200 len: 1278 microversion: 2.1 time: 0.512630 Aug 31 16:09:34.742028 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1803/3790] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:34 2022] GET /compute/v2.1/servers/f6f12af7-92ac-4c99-a4f7-282d970356c6 => generated 1278 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:35.371850 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-506457bb-d94f-421e-a1b3-2fe8141f519c tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a92ad15ba984304b27f1e337f1bae65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d874dc06bb94a3daffe23f9805ed0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:35.387692 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-506457bb-d94f-421e-a1b3-2fe8141f519c tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] 10.222.0.50 "GET /compute/v2.1/servers/76a65fbc-5d3d-4759-ba22-cf7751f0a6b3" status: 200 len: 1470 microversion: 2.1 time: 1.165631 Aug 31 16:09:35.407458 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1988/3791] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:34 2022] GET /compute/v2.1/servers/76a65fbc-5d3d-4759-ba22-cf7751f0a6b3 => generated 1470 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:35.786850 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f46204cf-5df4-49b3-b671-5beeef3cd1ea tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:35.788187 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f46204cf-5df4-49b3-b671-5beeef3cd1ea tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] [instance: f6f12af7-92ac-4c99-a4f7-282d970356c6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:35.811513 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f46204cf-5df4-49b3-b671-5beeef3cd1ea tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:35.812020 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f46204cf-5df4-49b3-b671-5beeef3cd1ea tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:35.812464 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f46204cf-5df4-49b3-b671-5beeef3cd1ea tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:35.813255 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f46204cf-5df4-49b3-b671-5beeef3cd1ea tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:35.813704 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f46204cf-5df4-49b3-b671-5beeef3cd1ea tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:35.820045 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f46204cf-5df4-49b3-b671-5beeef3cd1ea tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:36.018399 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f46204cf-5df4-49b3-b671-5beeef3cd1ea tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a631b69c25264974a5d9af3045c248f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4ea8520b024e0a8a3d8bbc2991504d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:36.037691 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f46204cf-5df4-49b3-b671-5beeef3cd1ea tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] 10.222.0.50 "GET /compute/v2.1/servers/f6f12af7-92ac-4c99-a4f7-282d970356c6" status: 200 len: 1282 microversion: 2.1 time: 0.255239 Aug 31 16:09:36.072125 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1804/3792] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:35 2022] GET /compute/v2.1/servers/f6f12af7-92ac-4c99-a4f7-282d970356c6 => generated 1282 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:09:36.429422 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-232da8f1-ba17-4aab-88cd-a5988b0390ba tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:36.430108 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-232da8f1-ba17-4aab-88cd-a5988b0390ba tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] [instance: 76a65fbc-5d3d-4759-ba22-cf7751f0a6b3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:36.444633 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-232da8f1-ba17-4aab-88cd-a5988b0390ba tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:36.445282 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-232da8f1-ba17-4aab-88cd-a5988b0390ba tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:36.446019 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-232da8f1-ba17-4aab-88cd-a5988b0390ba tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:36.447172 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-232da8f1-ba17-4aab-88cd-a5988b0390ba tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:36.447873 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-232da8f1-ba17-4aab-88cd-a5988b0390ba tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:36.450448 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-232da8f1-ba17-4aab-88cd-a5988b0390ba tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:37.079564 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5eb1995b-64a8-43af-8ddd-f97c12e9d857 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:37.080436 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5eb1995b-64a8-43af-8ddd-f97c12e9d857 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] [instance: f6f12af7-92ac-4c99-a4f7-282d970356c6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:37.096251 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5eb1995b-64a8-43af-8ddd-f97c12e9d857 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:37.096822 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5eb1995b-64a8-43af-8ddd-f97c12e9d857 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:37.099186 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5eb1995b-64a8-43af-8ddd-f97c12e9d857 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:37.100145 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5eb1995b-64a8-43af-8ddd-f97c12e9d857 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:37.102245 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5eb1995b-64a8-43af-8ddd-f97c12e9d857 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:37.104908 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5eb1995b-64a8-43af-8ddd-f97c12e9d857 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:37.676643 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5eb1995b-64a8-43af-8ddd-f97c12e9d857 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a631b69c25264974a5d9af3045c248f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4ea8520b024e0a8a3d8bbc2991504d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:37.681346 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-232da8f1-ba17-4aab-88cd-a5988b0390ba tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a92ad15ba984304b27f1e337f1bae65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d874dc06bb94a3daffe23f9805ed0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:37.691286 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-232da8f1-ba17-4aab-88cd-a5988b0390ba tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] 10.222.0.50 "GET /compute/v2.1/servers/76a65fbc-5d3d-4759-ba22-cf7751f0a6b3" status: 200 len: 1470 microversion: 2.1 time: 1.266015 Aug 31 16:09:37.692539 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1989/3793] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:36 2022] GET /compute/v2.1/servers/76a65fbc-5d3d-4759-ba22-cf7751f0a6b3 => generated 1470 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:37.697004 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5eb1995b-64a8-43af-8ddd-f97c12e9d857 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] 10.222.0.50 "GET /compute/v2.1/servers/f6f12af7-92ac-4c99-a4f7-282d970356c6" status: 200 len: 1336 microversion: 2.1 time: 0.623879 Aug 31 16:09:37.697613 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1805/3794] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:37 2022] GET /compute/v2.1/servers/f6f12af7-92ac-4c99-a4f7-282d970356c6 => generated 1336 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:09:38.716088 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-91ad7ef2-f47d-4e4b-ba42-714f1e1963d3 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:38.716704 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-91ad7ef2-f47d-4e4b-ba42-714f1e1963d3 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] [instance: 76a65fbc-5d3d-4759-ba22-cf7751f0a6b3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:38.720934 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6b06ecff-21b0-465b-a89d-e9650b7b369b tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:38.722141 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6b06ecff-21b0-465b-a89d-e9650b7b369b tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] [instance: f6f12af7-92ac-4c99-a4f7-282d970356c6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:38.729177 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91ad7ef2-f47d-4e4b-ba42-714f1e1963d3 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:38.729938 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91ad7ef2-f47d-4e4b-ba42-714f1e1963d3 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:38.730436 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91ad7ef2-f47d-4e4b-ba42-714f1e1963d3 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:38.731157 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91ad7ef2-f47d-4e4b-ba42-714f1e1963d3 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:38.735644 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b06ecff-21b0-465b-a89d-e9650b7b369b tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:38.736360 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b06ecff-21b0-465b-a89d-e9650b7b369b tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:38.737055 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b06ecff-21b0-465b-a89d-e9650b7b369b tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:38.741043 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b06ecff-21b0-465b-a89d-e9650b7b369b tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:38.741874 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b06ecff-21b0-465b-a89d-e9650b7b369b tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:38.742523 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b06ecff-21b0-465b-a89d-e9650b7b369b tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:38.747614 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91ad7ef2-f47d-4e4b-ba42-714f1e1963d3 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:38.748283 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91ad7ef2-f47d-4e4b-ba42-714f1e1963d3 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:39.100200 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-91ad7ef2-f47d-4e4b-ba42-714f1e1963d3 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a92ad15ba984304b27f1e337f1bae65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d874dc06bb94a3daffe23f9805ed0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:39.117770 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-91ad7ef2-f47d-4e4b-ba42-714f1e1963d3 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] 10.222.0.50 "GET /compute/v2.1/servers/76a65fbc-5d3d-4759-ba22-cf7751f0a6b3" status: 200 len: 1428 microversion: 2.1 time: 0.406883 Aug 31 16:09:39.126230 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1990/3795] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:38 2022] GET /compute/v2.1/servers/76a65fbc-5d3d-4759-ba22-cf7751f0a6b3 => generated 1428 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:39.247108 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-1a208c35-8946-4c97-85f7-a0d4688f5663 req-f34ed888-813d-4570-a9dd-39b2b9f86f94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76a65fbc-5d3d-4759-ba22-cf7751f0a6b3", "name": "network-vif-deleted", "tag": "17b71f61-175c-428f-8ce2-e58c60b3831b"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:09:39.326952 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-1a208c35-8946-4c97-85f7-a0d4688f5663 req-f34ed888-813d-4570-a9dd-39b2b9f86f94 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:39.327455 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-1a208c35-8946-4c97-85f7-a0d4688f5663 req-f34ed888-813d-4570-a9dd-39b2b9f86f94 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:39.339190 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-1a208c35-8946-4c97-85f7-a0d4688f5663 req-f34ed888-813d-4570-a9dd-39b2b9f86f94 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:39.359077 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6b06ecff-21b0-465b-a89d-e9650b7b369b tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a631b69c25264974a5d9af3045c248f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4ea8520b024e0a8a3d8bbc2991504d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:39.385931 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-1a208c35-8946-4c97-85f7-a0d4688f5663 req-f34ed888-813d-4570-a9dd-39b2b9f86f94 service nova] Creating event network-vif-deleted:17b71f61-175c-428f-8ce2-e58c60b3831b for instance 76a65fbc-5d3d-4759-ba22-cf7751f0a6b3 on n-h2-833090-16 Aug 31 16:09:39.393185 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6b06ecff-21b0-465b-a89d-e9650b7b369b tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] 10.222.0.50 "GET /compute/v2.1/servers/f6f12af7-92ac-4c99-a4f7-282d970356c6" status: 200 len: 1336 microversion: 2.1 time: 0.676766 Aug 31 16:09:39.410666 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-1a208c35-8946-4c97-85f7-a0d4688f5663 req-f34ed888-813d-4570-a9dd-39b2b9f86f94 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177644 Aug 31 16:09:39.411891 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1991/3796] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:09:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:09:39.414265 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1806/3797] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:38 2022] GET /compute/v2.1/servers/f6f12af7-92ac-4c99-a4f7-282d970356c6 => generated 1336 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:40.163706 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-879eb5a7-a53f-4296-8909-b70ae7de07a5 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:40.167392 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-879eb5a7-a53f-4296-8909-b70ae7de07a5 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] [instance: 76a65fbc-5d3d-4759-ba22-cf7751f0a6b3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:40.193163 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-879eb5a7-a53f-4296-8909-b70ae7de07a5 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:40.195786 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-879eb5a7-a53f-4296-8909-b70ae7de07a5 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:40.198281 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-879eb5a7-a53f-4296-8909-b70ae7de07a5 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:40.201724 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-879eb5a7-a53f-4296-8909-b70ae7de07a5 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:40.205704 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-879eb5a7-a53f-4296-8909-b70ae7de07a5 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:40.208703 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-879eb5a7-a53f-4296-8909-b70ae7de07a5 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:40.295718 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-879eb5a7-a53f-4296-8909-b70ae7de07a5 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:40.296228 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-879eb5a7-a53f-4296-8909-b70ae7de07a5 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:40.296671 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-879eb5a7-a53f-4296-8909-b70ae7de07a5 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:40.303007 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-879eb5a7-a53f-4296-8909-b70ae7de07a5 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lazy-loading 'fault' on Instance uuid 76a65fbc-5d3d-4759-ba22-cf7751f0a6b3 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:09:40.415758 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b4a0952f-99bf-46b5-93fb-3f42b33128bf tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:40.417245 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b4a0952f-99bf-46b5-93fb-3f42b33128bf tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] [instance: f6f12af7-92ac-4c99-a4f7-282d970356c6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:40.432806 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4a0952f-99bf-46b5-93fb-3f42b33128bf tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:40.435793 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4a0952f-99bf-46b5-93fb-3f42b33128bf tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:40.436487 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4a0952f-99bf-46b5-93fb-3f42b33128bf tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:40.450182 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4a0952f-99bf-46b5-93fb-3f42b33128bf tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:40.450932 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4a0952f-99bf-46b5-93fb-3f42b33128bf tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:40.451530 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4a0952f-99bf-46b5-93fb-3f42b33128bf tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:40.502128 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-879eb5a7-a53f-4296-8909-b70ae7de07a5 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a92ad15ba984304b27f1e337f1bae65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d874dc06bb94a3daffe23f9805ed0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:40.512839 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-879eb5a7-a53f-4296-8909-b70ae7de07a5 tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] 10.222.0.50 "GET /compute/v2.1/servers/76a65fbc-5d3d-4759-ba22-cf7751f0a6b3" status: 200 len: 1304 microversion: 2.1 time: 0.360553 Aug 31 16:09:40.518730 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1992/3798] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:40 2022] GET /compute/v2.1/servers/76a65fbc-5d3d-4759-ba22-cf7751f0a6b3 => generated 1304 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:40.752653 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b4a0952f-99bf-46b5-93fb-3f42b33128bf tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a631b69c25264974a5d9af3045c248f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4ea8520b024e0a8a3d8bbc2991504d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:40.768305 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b4a0952f-99bf-46b5-93fb-3f42b33128bf tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] 10.222.0.50 "GET /compute/v2.1/servers/f6f12af7-92ac-4c99-a4f7-282d970356c6" status: 200 len: 1336 microversion: 2.1 time: 0.356896 Aug 31 16:09:40.776954 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1807/3799] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:40 2022] GET /compute/v2.1/servers/f6f12af7-92ac-4c99-a4f7-282d970356c6 => generated 1336 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:41.549770 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-45fb8906-6fe4-49ff-97b6-7d122a0334ad tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:41.563830 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-45fb8906-6fe4-49ff-97b6-7d122a0334ad tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] [instance: 76a65fbc-5d3d-4759-ba22-cf7751f0a6b3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:41.590934 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-45fb8906-6fe4-49ff-97b6-7d122a0334ad tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:41.592312 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-45fb8906-6fe4-49ff-97b6-7d122a0334ad tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:41.593112 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-45fb8906-6fe4-49ff-97b6-7d122a0334ad tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:41.600233 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-45fb8906-6fe4-49ff-97b6-7d122a0334ad tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:41.601042 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-45fb8906-6fe4-49ff-97b6-7d122a0334ad tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:41.601926 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-45fb8906-6fe4-49ff-97b6-7d122a0334ad tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:41.638870 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-45fb8906-6fe4-49ff-97b6-7d122a0334ad tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] HTTP exception thrown: Instance 76a65fbc-5d3d-4759-ba22-cf7751f0a6b3 could not be found. Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-45fb8906-6fe4-49ff-97b6-7d122a0334ad tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Request method failure captured: Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/76a65fbc-5d3d-4759-ba22-cf7751f0a6b3 HTTP/1.1 Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4eczpgg-479evLWgzy1PObz8MJOHXbZ6aXKTEVL2NNvpEg7HpYXMiG0zX4srA8EHrVb5enSW_42RozPyJJO2ToOTEhfFI6DOkxu-ig1GpFOCekvftXobzCTz75uzVrlOJ5TXQqgTtwmgwaDI6wjGkTIj0NduUxHaqQ-UzM2NHoN6-s Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 2d874dc06bb94a3daffe23f9805ed0d2 Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-VolumesNegativeTest-1801301126 Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2d874dc06bb94a3daffe23f9805ed0d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2d874dc06bb94a3daffe23f9805ed0d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2d874dc06bb94a3daffe23f9805ed0d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2d874dc06bb94a3daffe23f9805ed0d2", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-VolumesNegativeTest-1801301126 Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 2d874dc06bb94a3daffe23f9805ed0d2 Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-VolumesNegativeTest-1801301126 Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-VolumesNegativeTest-1801301126-project Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 2a92ad15ba984304b27f1e337f1bae65 Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-VolumesNegativeTest-1801301126-project Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 76a65fbc-5d3d-4759-ba22-cf7751f0a6b3 could not be found. Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '76a65fbc-5d3d-4759-ba22-cf7751f0a6b3'} Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76a65fbc-5d3d-4759-ba22-cf7751f0a6b3 could not be found. Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76a65fbc-5d3d-4759-ba22-cf7751f0a6b3 could not be found. Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:09:41.642055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:09:41.645769 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:09:41.645769 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:09:41.645769 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:09:41.645769 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:09:41.645769 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:09:41.645769 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76a65fbc-5d3d-4759-ba22-cf7751f0a6b3 could not be found. Aug 31 16:09:41.645769 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:09:41.647665 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-45fb8906-6fe4-49ff-97b6-7d122a0334ad tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] Returning 404 to user: Instance 76a65fbc-5d3d-4759-ba22-cf7751f0a6b3 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:09:41.649025 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-45fb8906-6fe4-49ff-97b6-7d122a0334ad tempest-VolumesNegativeTest-1801301126 tempest-VolumesNegativeTest-1801301126-project] 10.222.0.50 "GET /compute/v2.1/servers/76a65fbc-5d3d-4759-ba22-cf7751f0a6b3" status: 404 len: 111 microversion: 2.1 time: 0.117965 Aug 31 16:09:41.650405 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1993/3800] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:41 2022] GET /compute/v2.1/servers/76a65fbc-5d3d-4759-ba22-cf7751f0a6b3 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:09:41.796882 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b8138788-c687-4907-ab26-138ee97e1360 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:41.797751 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b8138788-c687-4907-ab26-138ee97e1360 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] [instance: f6f12af7-92ac-4c99-a4f7-282d970356c6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:41.835803 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:09:41.843963 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8138788-c687-4907-ab26-138ee97e1360 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:41.852637 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8138788-c687-4907-ab26-138ee97e1360 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:41.853575 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8138788-c687-4907-ab26-138ee97e1360 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:41.855688 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8138788-c687-4907-ab26-138ee97e1360 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:41.863661 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8138788-c687-4907-ab26-138ee97e1360 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:41.864589 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8138788-c687-4907-ab26-138ee97e1360 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:42.158369 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b8138788-c687-4907-ab26-138ee97e1360 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a631b69c25264974a5d9af3045c248f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4ea8520b024e0a8a3d8bbc2991504d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:42.171837 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b8138788-c687-4907-ab26-138ee97e1360 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] 10.222.0.50 "GET /compute/v2.1/servers/f6f12af7-92ac-4c99-a4f7-282d970356c6" status: 200 len: 1336 microversion: 2.1 time: 0.380407 Aug 31 16:09:42.179943 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1808/3801] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:41 2022] GET /compute/v2.1/servers/f6f12af7-92ac-4c99-a4f7-282d970356c6 => generated 1336 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:43.206085 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c506444a-fd79-4c21-857f-57cf032b0169 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:43.207686 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c506444a-fd79-4c21-857f-57cf032b0169 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] [instance: f6f12af7-92ac-4c99-a4f7-282d970356c6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:43.235052 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c506444a-fd79-4c21-857f-57cf032b0169 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:43.237446 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c506444a-fd79-4c21-857f-57cf032b0169 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:43.240044 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c506444a-fd79-4c21-857f-57cf032b0169 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:43.245564 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c506444a-fd79-4c21-857f-57cf032b0169 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:43.246616 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c506444a-fd79-4c21-857f-57cf032b0169 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:43.247850 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c506444a-fd79-4c21-857f-57cf032b0169 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:43.582270 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c506444a-fd79-4c21-857f-57cf032b0169 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a631b69c25264974a5d9af3045c248f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4ea8520b024e0a8a3d8bbc2991504d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:43.606999 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c506444a-fd79-4c21-857f-57cf032b0169 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] 10.222.0.50 "GET /compute/v2.1/servers/f6f12af7-92ac-4c99-a4f7-282d970356c6" status: 200 len: 1336 microversion: 2.1 time: 0.406505 Aug 31 16:09:43.613931 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1994/3802] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:43 2022] GET /compute/v2.1/servers/f6f12af7-92ac-4c99-a4f7-282d970356c6 => generated 1336 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:44.631852 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-149ed33c-5dc6-48b3-9855-fd4730251d6d tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:44.632520 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-149ed33c-5dc6-48b3-9855-fd4730251d6d tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] [instance: f6f12af7-92ac-4c99-a4f7-282d970356c6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:44.635630 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:09:44.653466 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-149ed33c-5dc6-48b3-9855-fd4730251d6d tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:44.653974 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-149ed33c-5dc6-48b3-9855-fd4730251d6d tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:44.654452 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-149ed33c-5dc6-48b3-9855-fd4730251d6d tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:44.655498 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-149ed33c-5dc6-48b3-9855-fd4730251d6d tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:44.655963 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-149ed33c-5dc6-48b3-9855-fd4730251d6d tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:44.656439 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-149ed33c-5dc6-48b3-9855-fd4730251d6d tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:44.715982 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=12 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:09:45.213308 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-149ed33c-5dc6-48b3-9855-fd4730251d6d tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a631b69c25264974a5d9af3045c248f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4ea8520b024e0a8a3d8bbc2991504d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:45.244618 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-149ed33c-5dc6-48b3-9855-fd4730251d6d tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] 10.222.0.50 "GET /compute/v2.1/servers/f6f12af7-92ac-4c99-a4f7-282d970356c6" status: 200 len: 1402 microversion: 2.1 time: 0.616719 Aug 31 16:09:45.245681 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1809/3803] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:44 2022] GET /compute/v2.1/servers/f6f12af7-92ac-4c99-a4f7-282d970356c6 => generated 1402 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:46.274238 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-26fde666-bd96-4332-9954-88f668e22201 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:46.275677 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-26fde666-bd96-4332-9954-88f668e22201 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] [instance: f6f12af7-92ac-4c99-a4f7-282d970356c6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:46.304080 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26fde666-bd96-4332-9954-88f668e22201 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:46.308882 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26fde666-bd96-4332-9954-88f668e22201 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:46.310644 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26fde666-bd96-4332-9954-88f668e22201 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:46.311794 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26fde666-bd96-4332-9954-88f668e22201 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:46.320916 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26fde666-bd96-4332-9954-88f668e22201 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:46.321530 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26fde666-bd96-4332-9954-88f668e22201 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:47.579584 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-26fde666-bd96-4332-9954-88f668e22201 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a631b69c25264974a5d9af3045c248f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4ea8520b024e0a8a3d8bbc2991504d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:47.616754 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-26fde666-bd96-4332-9954-88f668e22201 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] 10.222.0.50 "GET /compute/v2.1/servers/f6f12af7-92ac-4c99-a4f7-282d970356c6" status: 200 len: 1402 microversion: 2.1 time: 1.346149 Aug 31 16:09:47.621314 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1995/3804] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:46 2022] GET /compute/v2.1/servers/f6f12af7-92ac-4c99-a4f7-282d970356c6 => generated 1402 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:48.637726 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a21c4506-467a-4a55-a2ff-902a33da5eb9 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:48.638287 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a21c4506-467a-4a55-a2ff-902a33da5eb9 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] [instance: f6f12af7-92ac-4c99-a4f7-282d970356c6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:48.653801 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a21c4506-467a-4a55-a2ff-902a33da5eb9 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:48.656354 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a21c4506-467a-4a55-a2ff-902a33da5eb9 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:48.660149 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a21c4506-467a-4a55-a2ff-902a33da5eb9 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:48.661465 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a21c4506-467a-4a55-a2ff-902a33da5eb9 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:48.662126 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a21c4506-467a-4a55-a2ff-902a33da5eb9 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:48.662938 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a21c4506-467a-4a55-a2ff-902a33da5eb9 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:48.685805 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=69 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:09:49.380144 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a21c4506-467a-4a55-a2ff-902a33da5eb9 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a631b69c25264974a5d9af3045c248f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4ea8520b024e0a8a3d8bbc2991504d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:49.397208 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a21c4506-467a-4a55-a2ff-902a33da5eb9 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] 10.222.0.50 "GET /compute/v2.1/servers/f6f12af7-92ac-4c99-a4f7-282d970356c6" status: 200 len: 1402 microversion: 2.1 time: 0.763425 Aug 31 16:09:49.416261 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1810/3805] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:48 2022] GET /compute/v2.1/servers/f6f12af7-92ac-4c99-a4f7-282d970356c6 => generated 1402 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:50.426926 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e18c5646-3a3b-4f23-be81-8bee0f24205a tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:50.428325 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e18c5646-3a3b-4f23-be81-8bee0f24205a tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] [instance: f6f12af7-92ac-4c99-a4f7-282d970356c6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:50.431430 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-2b1e18a3-20bc-42d5-852a-8089131879aa req-8f52369b-36a5-4b70-bd9d-0800162e153f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6f12af7-92ac-4c99-a4f7-282d970356c6", "tag": "cb1443c0-c90b-4b06-8ef8-7cc658349ef0"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:09:50.448783 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:09:50.461311 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e18c5646-3a3b-4f23-be81-8bee0f24205a tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:50.462673 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e18c5646-3a3b-4f23-be81-8bee0f24205a tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:50.463262 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e18c5646-3a3b-4f23-be81-8bee0f24205a tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:50.464418 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e18c5646-3a3b-4f23-be81-8bee0f24205a tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:50.465047 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e18c5646-3a3b-4f23-be81-8bee0f24205a tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:50.469575 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e18c5646-3a3b-4f23-be81-8bee0f24205a tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:50.499604 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2b1e18a3-20bc-42d5-852a-8089131879aa req-8f52369b-36a5-4b70-bd9d-0800162e153f service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:50.502846 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2b1e18a3-20bc-42d5-852a-8089131879aa req-8f52369b-36a5-4b70-bd9d-0800162e153f service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:50.505089 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2b1e18a3-20bc-42d5-852a-8089131879aa req-8f52369b-36a5-4b70-bd9d-0800162e153f service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:50.540533 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-2b1e18a3-20bc-42d5-852a-8089131879aa req-8f52369b-36a5-4b70-bd9d-0800162e153f service nova] Creating event network-changed:cb1443c0-c90b-4b06-8ef8-7cc658349ef0 for instance f6f12af7-92ac-4c99-a4f7-282d970356c6 on n-h1-833090-16 Aug 31 16:09:50.561663 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-2b1e18a3-20bc-42d5-852a-8089131879aa req-8f52369b-36a5-4b70-bd9d-0800162e153f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132993 Aug 31 16:09:50.574532 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1811/3806] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:09:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:09:51.054284 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e18c5646-3a3b-4f23-be81-8bee0f24205a tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a631b69c25264974a5d9af3045c248f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4ea8520b024e0a8a3d8bbc2991504d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:51.069055 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e18c5646-3a3b-4f23-be81-8bee0f24205a tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] 10.222.0.50 "GET /compute/v2.1/servers/f6f12af7-92ac-4c99-a4f7-282d970356c6" status: 200 len: 1402 microversion: 2.1 time: 0.651626 Aug 31 16:09:51.071760 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1996/3807] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:50 2022] GET /compute/v2.1/servers/f6f12af7-92ac-4c99-a4f7-282d970356c6 => generated 1402 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:52.193401 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dba3b05f-e064-4656-a13b-f348eddaa1d0 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:52.206376 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dba3b05f-e064-4656-a13b-f348eddaa1d0 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] [instance: f6f12af7-92ac-4c99-a4f7-282d970356c6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:52.233912 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dba3b05f-e064-4656-a13b-f348eddaa1d0 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:52.248057 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dba3b05f-e064-4656-a13b-f348eddaa1d0 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:52.248849 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dba3b05f-e064-4656-a13b-f348eddaa1d0 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:52.250200 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dba3b05f-e064-4656-a13b-f348eddaa1d0 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:52.251043 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dba3b05f-e064-4656-a13b-f348eddaa1d0 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:52.251485 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dba3b05f-e064-4656-a13b-f348eddaa1d0 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:52.643618 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dba3b05f-e064-4656-a13b-f348eddaa1d0 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a631b69c25264974a5d9af3045c248f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4ea8520b024e0a8a3d8bbc2991504d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:52.660272 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dba3b05f-e064-4656-a13b-f348eddaa1d0 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] 10.222.0.50 "GET /compute/v2.1/servers/f6f12af7-92ac-4c99-a4f7-282d970356c6" status: 200 len: 1402 microversion: 2.1 time: 0.472430 Aug 31 16:09:52.661594 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1812/3808] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:52 2022] GET /compute/v2.1/servers/f6f12af7-92ac-4c99-a4f7-282d970356c6 => generated 1402 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:53.687629 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fa224f69-88e2-486c-8ee8-f502a8716302 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:53.688465 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fa224f69-88e2-486c-8ee8-f502a8716302 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] [instance: f6f12af7-92ac-4c99-a4f7-282d970356c6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:53.715716 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fa224f69-88e2-486c-8ee8-f502a8716302 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:53.722177 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fa224f69-88e2-486c-8ee8-f502a8716302 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:53.723049 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fa224f69-88e2-486c-8ee8-f502a8716302 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:53.724298 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fa224f69-88e2-486c-8ee8-f502a8716302 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:53.725106 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fa224f69-88e2-486c-8ee8-f502a8716302 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:53.725688 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fa224f69-88e2-486c-8ee8-f502a8716302 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:54.446750 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-fa224f69-88e2-486c-8ee8-f502a8716302 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a631b69c25264974a5d9af3045c248f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4ea8520b024e0a8a3d8bbc2991504d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:54.470696 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fa224f69-88e2-486c-8ee8-f502a8716302 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] 10.222.0.50 "GET /compute/v2.1/servers/f6f12af7-92ac-4c99-a4f7-282d970356c6" status: 200 len: 1402 microversion: 2.1 time: 0.791498 Aug 31 16:09:54.488332 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1997/3809] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:53 2022] GET /compute/v2.1/servers/f6f12af7-92ac-4c99-a4f7-282d970356c6 => generated 1402 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:55.494741 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5ccfbdb8-9c32-45d8-a54b-9e3646a90d86 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:55.495361 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5ccfbdb8-9c32-45d8-a54b-9e3646a90d86 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] [instance: f6f12af7-92ac-4c99-a4f7-282d970356c6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:55.505086 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ccfbdb8-9c32-45d8-a54b-9e3646a90d86 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:55.505614 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ccfbdb8-9c32-45d8-a54b-9e3646a90d86 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:55.506046 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ccfbdb8-9c32-45d8-a54b-9e3646a90d86 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:55.513442 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ccfbdb8-9c32-45d8-a54b-9e3646a90d86 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:55.513936 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ccfbdb8-9c32-45d8-a54b-9e3646a90d86 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:55.514401 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ccfbdb8-9c32-45d8-a54b-9e3646a90d86 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:56.116485 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5ccfbdb8-9c32-45d8-a54b-9e3646a90d86 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a631b69c25264974a5d9af3045c248f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4ea8520b024e0a8a3d8bbc2991504d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:56.135792 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5ccfbdb8-9c32-45d8-a54b-9e3646a90d86 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] 10.222.0.50 "GET /compute/v2.1/servers/f6f12af7-92ac-4c99-a4f7-282d970356c6" status: 200 len: 1402 microversion: 2.1 time: 0.644997 Aug 31 16:09:56.136386 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1813/3810] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:55 2022] GET /compute/v2.1/servers/f6f12af7-92ac-4c99-a4f7-282d970356c6 => generated 1402 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:57.162167 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-58120aac-9d2d-4959-a090-3232cf6f7a31 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:57.162793 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-58120aac-9d2d-4959-a090-3232cf6f7a31 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] [instance: f6f12af7-92ac-4c99-a4f7-282d970356c6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:57.181763 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-58120aac-9d2d-4959-a090-3232cf6f7a31 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:57.182287 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-58120aac-9d2d-4959-a090-3232cf6f7a31 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:57.190788 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-58120aac-9d2d-4959-a090-3232cf6f7a31 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:57.191770 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-58120aac-9d2d-4959-a090-3232cf6f7a31 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:57.192392 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-58120aac-9d2d-4959-a090-3232cf6f7a31 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:57.192996 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-58120aac-9d2d-4959-a090-3232cf6f7a31 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:57.493678 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-58120aac-9d2d-4959-a090-3232cf6f7a31 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a631b69c25264974a5d9af3045c248f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4ea8520b024e0a8a3d8bbc2991504d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:57.506365 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-58120aac-9d2d-4959-a090-3232cf6f7a31 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] 10.222.0.50 "GET /compute/v2.1/servers/f6f12af7-92ac-4c99-a4f7-282d970356c6" status: 200 len: 1402 microversion: 2.1 time: 0.349226 Aug 31 16:09:57.506967 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1998/3811] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:57 2022] GET /compute/v2.1/servers/f6f12af7-92ac-4c99-a4f7-282d970356c6 => generated 1402 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:58.533423 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6e1ebcf3-3789-4aaf-ad0a-6886f7fff018 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:09:58.534720 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6e1ebcf3-3789-4aaf-ad0a-6886f7fff018 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] [instance: f6f12af7-92ac-4c99-a4f7-282d970356c6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:09:58.549337 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6e1ebcf3-3789-4aaf-ad0a-6886f7fff018 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:58.557600 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6e1ebcf3-3789-4aaf-ad0a-6886f7fff018 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:58.558414 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6e1ebcf3-3789-4aaf-ad0a-6886f7fff018 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:58.559351 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6e1ebcf3-3789-4aaf-ad0a-6886f7fff018 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:58.561535 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6e1ebcf3-3789-4aaf-ad0a-6886f7fff018 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:58.562277 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6e1ebcf3-3789-4aaf-ad0a-6886f7fff018 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:59.224903 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6e1ebcf3-3789-4aaf-ad0a-6886f7fff018 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a631b69c25264974a5d9af3045c248f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4ea8520b024e0a8a3d8bbc2991504d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:09:59.242175 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6e1ebcf3-3789-4aaf-ad0a-6886f7fff018 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] 10.222.0.50 "GET /compute/v2.1/servers/f6f12af7-92ac-4c99-a4f7-282d970356c6" status: 200 len: 1402 microversion: 2.1 time: 0.714016 Aug 31 16:09:59.246218 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1814/3812] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:09:58 2022] GET /compute/v2.1/servers/f6f12af7-92ac-4c99-a4f7-282d970356c6 => generated 1402 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:09:59.277459 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-f0818b71-fe9b-46f0-aeb2-bff3cbadb860 req-429c9e13-6367-4c1b-a3be-f0625e354f11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6f12af7-92ac-4c99-a4f7-282d970356c6", "name": "network-vif-plugged", "status": "completed", "tag": "cb1443c0-c90b-4b06-8ef8-7cc658349ef0"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:09:59.299147 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-f0818b71-fe9b-46f0-aeb2-bff3cbadb860 req-429c9e13-6367-4c1b-a3be-f0625e354f11 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:09:59.301423 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-f0818b71-fe9b-46f0-aeb2-bff3cbadb860 req-429c9e13-6367-4c1b-a3be-f0625e354f11 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:09:59.302840 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-f0818b71-fe9b-46f0-aeb2-bff3cbadb860 req-429c9e13-6367-4c1b-a3be-f0625e354f11 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:09:59.335612 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-f0818b71-fe9b-46f0-aeb2-bff3cbadb860 req-429c9e13-6367-4c1b-a3be-f0625e354f11 service nova] Creating event network-vif-plugged:cb1443c0-c90b-4b06-8ef8-7cc658349ef0 for instance f6f12af7-92ac-4c99-a4f7-282d970356c6 on n-h1-833090-16 Aug 31 16:09:59.350609 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-f0818b71-fe9b-46f0-aeb2-bff3cbadb860 req-429c9e13-6367-4c1b-a3be-f0625e354f11 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.539058 Aug 31 16:09:59.355586 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 1999/3813] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:10:00.278275 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ddecc046-f8ea-4d8d-9f02-9032f991ac7a tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:00.280295 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ddecc046-f8ea-4d8d-9f02-9032f991ac7a tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] [instance: f6f12af7-92ac-4c99-a4f7-282d970356c6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:00.300707 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ddecc046-f8ea-4d8d-9f02-9032f991ac7a tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:00.303083 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ddecc046-f8ea-4d8d-9f02-9032f991ac7a tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:00.303756 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ddecc046-f8ea-4d8d-9f02-9032f991ac7a tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:00.305243 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ddecc046-f8ea-4d8d-9f02-9032f991ac7a tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:00.307212 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ddecc046-f8ea-4d8d-9f02-9032f991ac7a tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:00.309053 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ddecc046-f8ea-4d8d-9f02-9032f991ac7a tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:00.801291 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8d0b764d-2318-4265-8cfc-d762c4951226 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Action: 'create', calling method: .version_select at 0x7fbb4ac30b80>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1055623987", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLw4pGImJ5uGJZd1crxK5Go3gLDm1A+z7s3xvh5qawO47wmIxALYdibPPZeyXNNyP9wkEMH3j23uYa4pWmUmpDbeC6fHE+3yOS1JdC47ZYfVQoYioxdD3xOdQXO960HseA=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:00.894278 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-8d0b764d-2318-4265-8cfc-d762c4951226 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Getting quotas for project 3397e8a2a042486eb323432c47dfd392. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:10:00.914204 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-8d0b764d-2318-4265-8cfc-d762c4951226 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Getting quotas for user 87f8241df6664aa59ba669d733e53871 and project 3397e8a2a042486eb323432c47dfd392. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:10:01.007742 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8d0b764d-2318-4265-8cfc-d762c4951226 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.806717 Aug 31 16:10:01.008703 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1815/3814] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 31 16:10:00 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:10:01.115218 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dffe9ace-f8b3-4851-9f38-c1a9e09b54d4 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-2092529158", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:01.255651 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-dffe9ace-f8b3-4851-9f38-c1a9e09b54d4 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] validate_networks() for None {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:10:01.424206 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ddecc046-f8ea-4d8d-9f02-9032f991ac7a tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a631b69c25264974a5d9af3045c248f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4ea8520b024e0a8a3d8bbc2991504d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:01.453869 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ddecc046-f8ea-4d8d-9f02-9032f991ac7a tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] 10.222.0.50 "GET /compute/v2.1/servers/f6f12af7-92ac-4c99-a4f7-282d970356c6" status: 200 len: 1402 microversion: 2.1 time: 1.178841 Aug 31 16:10:01.468289 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2000/3815] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:00 2022] GET /compute/v2.1/servers/f6f12af7-92ac-4c99-a4f7-282d970356c6 => generated 1402 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:10:02.194980 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-dffe9ace-f8b3-4851-9f38-c1a9e09b54d4 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:10:02.196375 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-dffe9ace-f8b3-4851-9f38-c1a9e09b54d4 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:10:02.197075 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-dffe9ace-f8b3-4851-9f38-c1a9e09b54d4 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:10:02.197685 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-dffe9ace-f8b3-4851-9f38-c1a9e09b54d4 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:10:02.198368 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-dffe9ace-f8b3-4851-9f38-c1a9e09b54d4 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:10:02.220125 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dffe9ace-f8b3-4851-9f38-c1a9e09b54d4 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:02.224496 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dffe9ace-f8b3-4851-9f38-c1a9e09b54d4 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:02.226556 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dffe9ace-f8b3-4851-9f38-c1a9e09b54d4 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:02.228965 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dffe9ace-f8b3-4851-9f38-c1a9e09b54d4 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:02.230640 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dffe9ace-f8b3-4851-9f38-c1a9e09b54d4 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:02.231256 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dffe9ace-f8b3-4851-9f38-c1a9e09b54d4 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:02.286221 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-dffe9ace-f8b3-4851-9f38-c1a9e09b54d4 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Getting quotas for project 2a9210acd39546b4b6fba9cda27a0aed. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:10:02.300787 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-dffe9ace-f8b3-4851-9f38-c1a9e09b54d4 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Getting quotas for user 4669ae0dec2c4ad8be74acd9ebf4d80a and project 2a9210acd39546b4b6fba9cda27a0aed. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:10:02.338506 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dffe9ace-f8b3-4851-9f38-c1a9e09b54d4 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:10:02.348337 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dffe9ace-f8b3-4851-9f38-c1a9e09b54d4 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 5923807d-1058-45ab-b8d1-c6700ea8c142] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:10:02.484023 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dffe9ace-f8b3-4851-9f38-c1a9e09b54d4 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.472797 Aug 31 16:10:02.494693 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1816/3816] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:10:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1485 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:10:02.499745 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-91fda35e-e7c5-45e0-be47-9b9d65027366 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:02.501467 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-91fda35e-e7c5-45e0-be47-9b9d65027366 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] [instance: f6f12af7-92ac-4c99-a4f7-282d970356c6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:02.516216 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91fda35e-e7c5-45e0-be47-9b9d65027366 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:02.518168 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91fda35e-e7c5-45e0-be47-9b9d65027366 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:02.519169 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91fda35e-e7c5-45e0-be47-9b9d65027366 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:02.520176 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91fda35e-e7c5-45e0-be47-9b9d65027366 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:02.520872 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91fda35e-e7c5-45e0-be47-9b9d65027366 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:02.542840 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91fda35e-e7c5-45e0-be47-9b9d65027366 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:02.696081 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-76d62d18-15d4-4ff0-8383-64b6e9ca52e9 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-5840932", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:02.799064 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-76d62d18-15d4-4ff0-8383-64b6e9ca52e9 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] validate_networks() for None {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:10:04.185130 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-91fda35e-e7c5-45e0-be47-9b9d65027366 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a631b69c25264974a5d9af3045c248f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4ea8520b024e0a8a3d8bbc2991504d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:04.193115 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=75,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:10:04.210121 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-91fda35e-e7c5-45e0-be47-9b9d65027366 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] 10.222.0.50 "GET /compute/v2.1/servers/f6f12af7-92ac-4c99-a4f7-282d970356c6" status: 200 len: 1590 microversion: 2.1 time: 1.724509 Aug 31 16:10:04.210820 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2001/3817] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:02 2022] GET /compute/v2.1/servers/f6f12af7-92ac-4c99-a4f7-282d970356c6 => generated 1590 bytes in 1726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:04.249350 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-47d65a55-f07f-410f-9d7a-ad65cfc4229f tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:04.250357 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-47d65a55-f07f-410f-9d7a-ad65cfc4229f tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] [instance: f6f12af7-92ac-4c99-a4f7-282d970356c6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:04.276007 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-47d65a55-f07f-410f-9d7a-ad65cfc4229f tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:04.276536 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-47d65a55-f07f-410f-9d7a-ad65cfc4229f tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:04.276997 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-47d65a55-f07f-410f-9d7a-ad65cfc4229f tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:04.277725 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-47d65a55-f07f-410f-9d7a-ad65cfc4229f tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:04.278202 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-47d65a55-f07f-410f-9d7a-ad65cfc4229f tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:04.279414 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-47d65a55-f07f-410f-9d7a-ad65cfc4229f tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:04.766824 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-47d65a55-f07f-410f-9d7a-ad65cfc4229f tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] 10.222.0.50 "GET /compute/v2.1/servers/f6f12af7-92ac-4c99-a4f7-282d970356c6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.525624 Aug 31 16:10:04.768407 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2002/3818] 10.222.0.50 () {58 vars in 1275 bytes} [Wed Aug 31 16:10:04 2022] GET /compute/v2.1/servers/f6f12af7-92ac-4c99-a4f7-282d970356c6/os-interface => generated 285 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:10:04.913829 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-03dc5ec7-2805-4bb2-983b-2acd4815de15 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1040445088", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "00194b7c-6891-4cf9-8c59-235de2b40a38"}]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:05.028192 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-03dc5ec7-2805-4bb2-983b-2acd4815de15 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] validate_networks() for [('00194b7c-6891-4cf9-8c59-235de2b40a38', None, None, None, None, None)] {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:10:05.507178 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-76d62d18-15d4-4ff0-8383-64b6e9ca52e9 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:10:05.508307 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-76d62d18-15d4-4ff0-8383-64b6e9ca52e9 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:10:05.509002 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-76d62d18-15d4-4ff0-8383-64b6e9ca52e9 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:10:05.517000 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-76d62d18-15d4-4ff0-8383-64b6e9ca52e9 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:10:05.517765 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-76d62d18-15d4-4ff0-8383-64b6e9ca52e9 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:10:05.539759 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76d62d18-15d4-4ff0-8383-64b6e9ca52e9 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:05.540428 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76d62d18-15d4-4ff0-8383-64b6e9ca52e9 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:05.541009 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76d62d18-15d4-4ff0-8383-64b6e9ca52e9 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:05.541907 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76d62d18-15d4-4ff0-8383-64b6e9ca52e9 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:05.542791 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76d62d18-15d4-4ff0-8383-64b6e9ca52e9 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:05.543613 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76d62d18-15d4-4ff0-8383-64b6e9ca52e9 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:05.571179 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-76d62d18-15d4-4ff0-8383-64b6e9ca52e9 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Getting quotas for project 2a9210acd39546b4b6fba9cda27a0aed. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:10:05.584583 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-76d62d18-15d4-4ff0-8383-64b6e9ca52e9 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Getting quotas for user 4669ae0dec2c4ad8be74acd9ebf4d80a and project 2a9210acd39546b4b6fba9cda27a0aed. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:10:05.602402 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-76d62d18-15d4-4ff0-8383-64b6e9ca52e9 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:10:05.617526 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-76d62d18-15d4-4ff0-8383-64b6e9ca52e9 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 306160c1-762b-4b9e-aa09-3dd60f0c7ce3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:10:05.685273 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-76d62d18-15d4-4ff0-8383-64b6e9ca52e9 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.993174 Aug 31 16:10:05.686315 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1817/3819] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:10:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 2995 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:10:05.710410 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7982ffed-9c04-4bd5-bb44-725d9937858c tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:05.714138 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7982ffed-9c04-4bd5-bb44-725d9937858c tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 306160c1-762b-4b9e-aa09-3dd60f0c7ce3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:06.805251 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7982ffed-9c04-4bd5-bb44-725d9937858c tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:06.820806 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7982ffed-9c04-4bd5-bb44-725d9937858c tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/306160c1-762b-4b9e-aa09-3dd60f0c7ce3" status: 200 len: 1211 microversion: 2.1 time: 1.127537 Aug 31 16:10:06.824622 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1818/3820] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:05 2022] GET /compute/v2.1/servers/306160c1-762b-4b9e-aa09-3dd60f0c7ce3 => generated 1211 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:07.853512 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8e9b6eeb-a318-4e84-8e84-360f37e43b1d tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:07.858388 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8e9b6eeb-a318-4e84-8e84-360f37e43b1d tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 306160c1-762b-4b9e-aa09-3dd60f0c7ce3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:07.875070 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e9b6eeb-a318-4e84-8e84-360f37e43b1d tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:07.876940 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e9b6eeb-a318-4e84-8e84-360f37e43b1d tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:07.878328 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e9b6eeb-a318-4e84-8e84-360f37e43b1d tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:07.879472 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e9b6eeb-a318-4e84-8e84-360f37e43b1d tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:07.889931 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e9b6eeb-a318-4e84-8e84-360f37e43b1d tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:07.892836 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e9b6eeb-a318-4e84-8e84-360f37e43b1d tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:08.045676 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-03dc5ec7-2805-4bb2-983b-2acd4815de15 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:10:08.047194 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-03dc5ec7-2805-4bb2-983b-2acd4815de15 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:10:08.048011 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-03dc5ec7-2805-4bb2-983b-2acd4815de15 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:10:08.048569 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-03dc5ec7-2805-4bb2-983b-2acd4815de15 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:10:08.049201 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-03dc5ec7-2805-4bb2-983b-2acd4815de15 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:10:08.068675 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-03dc5ec7-2805-4bb2-983b-2acd4815de15 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:08.069176 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-03dc5ec7-2805-4bb2-983b-2acd4815de15 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:08.070026 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-03dc5ec7-2805-4bb2-983b-2acd4815de15 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:08.072633 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-03dc5ec7-2805-4bb2-983b-2acd4815de15 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:08.076689 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-03dc5ec7-2805-4bb2-983b-2acd4815de15 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:08.080509 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-03dc5ec7-2805-4bb2-983b-2acd4815de15 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:08.141835 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-03dc5ec7-2805-4bb2-983b-2acd4815de15 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Getting quotas for project 84f42648e1a343b9a5ab9b89c91bea0d. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:10:08.152515 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-03dc5ec7-2805-4bb2-983b-2acd4815de15 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Getting quotas for user 3ebce87993504550914c2c3702eebb17 and project 84f42648e1a343b9a5ab9b89c91bea0d. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:10:08.171088 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8e9b6eeb-a318-4e84-8e84-360f37e43b1d tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:08.182651 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8e9b6eeb-a318-4e84-8e84-360f37e43b1d tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/306160c1-762b-4b9e-aa09-3dd60f0c7ce3" status: 200 len: 1281 microversion: 2.1 time: 0.334221 Aug 31 16:10:08.186313 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1819/3821] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:07 2022] GET /compute/v2.1/servers/306160c1-762b-4b9e-aa09-3dd60f0c7ce3 => generated 1281 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:08.206167 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-03dc5ec7-2805-4bb2-983b-2acd4815de15 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:10:08.208729 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-03dc5ec7-2805-4bb2-983b-2acd4815de15 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 2c93da9d-54d5-408f-85d4-768f397294b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:10:08.313756 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-03dc5ec7-2805-4bb2-983b-2acd4815de15 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.543952 Aug 31 16:10:08.321568 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2003/3822] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:10:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 3552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:10:08.329650 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b51931be-c86c-4249-b2ad-5157b54ef87f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:08.330533 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b51931be-c86c-4249-b2ad-5157b54ef87f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 2c93da9d-54d5-408f-85d4-768f397294b6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:08.819622 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b51931be-c86c-4249-b2ad-5157b54ef87f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:08.829506 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b51931be-c86c-4249-b2ad-5157b54ef87f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/2c93da9d-54d5-408f-85d4-768f397294b6" status: 200 len: 1193 microversion: 2.1 time: 0.505761 Aug 31 16:10:08.832192 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1820/3823] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:08 2022] GET /compute/v2.1/servers/2c93da9d-54d5-408f-85d4-768f397294b6 => generated 1193 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:09.212545 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fc348140-06df-4765-931d-626c03c33f23 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:09.213748 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fc348140-06df-4765-931d-626c03c33f23 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 306160c1-762b-4b9e-aa09-3dd60f0c7ce3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:09.220881 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fc348140-06df-4765-931d-626c03c33f23 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:09.221613 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fc348140-06df-4765-931d-626c03c33f23 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:09.222781 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fc348140-06df-4765-931d-626c03c33f23 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:09.223665 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fc348140-06df-4765-931d-626c03c33f23 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:09.224278 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fc348140-06df-4765-931d-626c03c33f23 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:09.224857 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fc348140-06df-4765-931d-626c03c33f23 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:09.856661 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bc41af47-5e2c-487d-8a94-fbdd9325e009 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:09.875356 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bc41af47-5e2c-487d-8a94-fbdd9325e009 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 2c93da9d-54d5-408f-85d4-768f397294b6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:09.900389 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc41af47-5e2c-487d-8a94-fbdd9325e009 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:09.902443 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc41af47-5e2c-487d-8a94-fbdd9325e009 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:09.903934 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc41af47-5e2c-487d-8a94-fbdd9325e009 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:09.905803 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc41af47-5e2c-487d-8a94-fbdd9325e009 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:09.907019 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc41af47-5e2c-487d-8a94-fbdd9325e009 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:09.907862 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc41af47-5e2c-487d-8a94-fbdd9325e009 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:09.934927 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-fc348140-06df-4765-931d-626c03c33f23 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:09.964973 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fc348140-06df-4765-931d-626c03c33f23 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/306160c1-762b-4b9e-aa09-3dd60f0c7ce3" status: 200 len: 1269 microversion: 2.1 time: 0.758040 Aug 31 16:10:09.968388 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2004/3824] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:09 2022] GET /compute/v2.1/servers/306160c1-762b-4b9e-aa09-3dd60f0c7ce3 => generated 1269 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:10.401732 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bc41af47-5e2c-487d-8a94-fbdd9325e009 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:10.417734 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bc41af47-5e2c-487d-8a94-fbdd9325e009 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/2c93da9d-54d5-408f-85d4-768f397294b6" status: 200 len: 1245 microversion: 2.1 time: 0.567888 Aug 31 16:10:10.418453 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1821/3825] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:09 2022] GET /compute/v2.1/servers/2c93da9d-54d5-408f-85d4-768f397294b6 => generated 1245 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:10:10.995223 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7e68087a-302e-4f4e-bb9a-0174d4c85423 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:10.995915 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7e68087a-302e-4f4e-bb9a-0174d4c85423 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 306160c1-762b-4b9e-aa09-3dd60f0c7ce3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:11.010698 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7e68087a-302e-4f4e-bb9a-0174d4c85423 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:11.011380 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7e68087a-302e-4f4e-bb9a-0174d4c85423 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:11.015653 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7e68087a-302e-4f4e-bb9a-0174d4c85423 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:11.016412 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7e68087a-302e-4f4e-bb9a-0174d4c85423 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:11.016881 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7e68087a-302e-4f4e-bb9a-0174d4c85423 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:11.017305 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7e68087a-302e-4f4e-bb9a-0174d4c85423 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:11.245301 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a086ff90-459c-414f-96e6-347b66bb6658 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:11.245919 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a086ff90-459c-414f-96e6-347b66bb6658 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] [instance: f6f12af7-92ac-4c99-a4f7-282d970356c6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:11.269821 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a086ff90-459c-414f-96e6-347b66bb6658 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:11.270630 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a086ff90-459c-414f-96e6-347b66bb6658 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:11.271178 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a086ff90-459c-414f-96e6-347b66bb6658 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:11.272016 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a086ff90-459c-414f-96e6-347b66bb6658 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:11.273863 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a086ff90-459c-414f-96e6-347b66bb6658 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:11.274437 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a086ff90-459c-414f-96e6-347b66bb6658 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:11.643977 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7e68087a-302e-4f4e-bb9a-0174d4c85423 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:11.659827 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7e68087a-302e-4f4e-bb9a-0174d4c85423 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/306160c1-762b-4b9e-aa09-3dd60f0c7ce3" status: 200 len: 1269 microversion: 2.1 time: 0.673861 Aug 31 16:10:11.678634 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2005/3826] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:10 2022] GET /compute/v2.1/servers/306160c1-762b-4b9e-aa09-3dd60f0c7ce3 => generated 1269 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:11.691598 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d2a3122c-8f88-4b28-9a90-d5ce30c7782c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:11.692296 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d2a3122c-8f88-4b28-9a90-d5ce30c7782c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 2c93da9d-54d5-408f-85d4-768f397294b6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:11.705949 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d2a3122c-8f88-4b28-9a90-d5ce30c7782c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:11.706649 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d2a3122c-8f88-4b28-9a90-d5ce30c7782c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:11.708727 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d2a3122c-8f88-4b28-9a90-d5ce30c7782c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:11.710877 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d2a3122c-8f88-4b28-9a90-d5ce30c7782c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:11.716072 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d2a3122c-8f88-4b28-9a90-d5ce30c7782c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:11.716734 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d2a3122c-8f88-4b28-9a90-d5ce30c7782c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:11.895066 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d2a3122c-8f88-4b28-9a90-d5ce30c7782c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:11.906149 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d2a3122c-8f88-4b28-9a90-d5ce30c7782c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/2c93da9d-54d5-408f-85d4-768f397294b6" status: 200 len: 1251 microversion: 2.1 time: 0.223287 Aug 31 16:10:11.907275 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2006/3827] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:11 2022] GET /compute/v2.1/servers/2c93da9d-54d5-408f-85d4-768f397294b6 => generated 1251 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:11.914210 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-66d872a8-3101-47b3-a427-033643fbecee req-7d3b576e-d778-4cf7-922d-dc40580afc13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6f12af7-92ac-4c99-a4f7-282d970356c6", "tag": "cb1443c0-c90b-4b06-8ef8-7cc658349ef0"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:11.932924 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-66d872a8-3101-47b3-a427-033643fbecee req-7d3b576e-d778-4cf7-922d-dc40580afc13 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:11.933692 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-66d872a8-3101-47b3-a427-033643fbecee req-7d3b576e-d778-4cf7-922d-dc40580afc13 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:11.934998 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-66d872a8-3101-47b3-a427-033643fbecee req-7d3b576e-d778-4cf7-922d-dc40580afc13 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:11.951308 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-66d872a8-3101-47b3-a427-033643fbecee req-7d3b576e-d778-4cf7-922d-dc40580afc13 service nova] Creating event network-changed:cb1443c0-c90b-4b06-8ef8-7cc658349ef0 for instance f6f12af7-92ac-4c99-a4f7-282d970356c6 on n-h1-833090-16 Aug 31 16:10:11.961131 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-66d872a8-3101-47b3-a427-033643fbecee req-7d3b576e-d778-4cf7-922d-dc40580afc13 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050781 Aug 31 16:10:11.963176 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2007/3828] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:10:12.309408 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a086ff90-459c-414f-96e6-347b66bb6658 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a631b69c25264974a5d9af3045c248f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4ea8520b024e0a8a3d8bbc2991504d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:12.338572 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a086ff90-459c-414f-96e6-347b66bb6658 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] 10.222.0.50 "GET /compute/v2.1/servers/f6f12af7-92ac-4c99-a4f7-282d970356c6" status: 200 len: 1590 microversion: 2.1 time: 1.096461 Aug 31 16:10:12.356594 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1822/3829] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:11 2022] GET /compute/v2.1/servers/f6f12af7-92ac-4c99-a4f7-282d970356c6 => generated 1590 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:12.686062 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d6946e95-d765-4f49-9a07-a3842ceb6867 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:12.686896 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d6946e95-d765-4f49-9a07-a3842ceb6867 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 306160c1-762b-4b9e-aa09-3dd60f0c7ce3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:12.689496 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=7 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:10:12.721239 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6946e95-d765-4f49-9a07-a3842ceb6867 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:12.721847 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6946e95-d765-4f49-9a07-a3842ceb6867 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:12.723614 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6946e95-d765-4f49-9a07-a3842ceb6867 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:12.728345 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6946e95-d765-4f49-9a07-a3842ceb6867 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:12.729494 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6946e95-d765-4f49-9a07-a3842ceb6867 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:12.733381 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6946e95-d765-4f49-9a07-a3842ceb6867 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:12.776814 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a74a300d-69f0-466a-b95b-c9834ef903ab tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Action: 'create', calling method: .version_select at 0x7fbb4ac4ed30>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1270965966", "policies": ["affinity"]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:12.828520 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-a74a300d-69f0-466a-b95b-c9834ef903ab tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Getting quotas for project cb60bef197c84b18aa1bfb27172dcc83. Resources: {'server_groups'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:10:12.847787 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-a74a300d-69f0-466a-b95b-c9834ef903ab tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Getting quotas for user ab5d33bcaf2846cb83e0cf83f8acdd94 and project cb60bef197c84b18aa1bfb27172dcc83. Resources: {'server_groups'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:10:12.945857 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-a74a300d-69f0-466a-b95b-c9834ef903ab tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Getting quotas for project cb60bef197c84b18aa1bfb27172dcc83. Resources: {'server_groups'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:10:12.956164 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-a74a300d-69f0-466a-b95b-c9834ef903ab tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Getting quotas for user ab5d33bcaf2846cb83e0cf83f8acdd94 and project cb60bef197c84b18aa1bfb27172dcc83. Resources: {'server_groups'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:10:12.998202 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a74a300d-69f0-466a-b95b-c9834ef903ab tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] 10.222.0.50 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.351902 Aug 31 16:10:13.000053 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2008/3830] 10.222.0.50 () {60 vars in 1174 bytes} [Wed Aug 31 16:10:12 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:10:13.007306 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-cc72fea6-bbb6-405f-9a31-d4ad5de77a68 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:13.008705 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-cc72fea6-bbb6-405f-9a31-d4ad5de77a68 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 2c93da9d-54d5-408f-85d4-768f397294b6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:13.016584 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cc72fea6-bbb6-405f-9a31-d4ad5de77a68 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:13.023341 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cc72fea6-bbb6-405f-9a31-d4ad5de77a68 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:13.024406 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cc72fea6-bbb6-405f-9a31-d4ad5de77a68 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:13.025910 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cc72fea6-bbb6-405f-9a31-d4ad5de77a68 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:13.026975 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cc72fea6-bbb6-405f-9a31-d4ad5de77a68 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:13.028031 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cc72fea6-bbb6-405f-9a31-d4ad5de77a68 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:13.867876 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-cc72fea6-bbb6-405f-9a31-d4ad5de77a68 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:13.886593 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-cc72fea6-bbb6-405f-9a31-d4ad5de77a68 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/2c93da9d-54d5-408f-85d4-768f397294b6" status: 200 len: 1293 microversion: 2.1 time: 0.884379 Aug 31 16:10:13.887829 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2009/3831] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:13 2022] GET /compute/v2.1/servers/2c93da9d-54d5-408f-85d4-768f397294b6 => generated 1293 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:13.899543 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1cd63521-c026-43a9-9aa9-bc144fdd5187 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Action: 'create', calling method: .version_select at 0x7fbb46c1cb80>, body: {"server_group": {"name": "tempest-server-group-58253685", "policies": ["affinity"]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:13.944501 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-1cd63521-c026-43a9-9aa9-bc144fdd5187 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Getting quotas for project cb60bef197c84b18aa1bfb27172dcc83. Resources: {'server_groups'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:10:13.964357 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-1cd63521-c026-43a9-9aa9-bc144fdd5187 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Getting quotas for user ab5d33bcaf2846cb83e0cf83f8acdd94 and project cb60bef197c84b18aa1bfb27172dcc83. Resources: {'server_groups'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:10:14.057007 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-1cd63521-c026-43a9-9aa9-bc144fdd5187 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Getting quotas for project cb60bef197c84b18aa1bfb27172dcc83. Resources: {'server_groups'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:10:14.072055 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-1cd63521-c026-43a9-9aa9-bc144fdd5187 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Getting quotas for user ab5d33bcaf2846cb83e0cf83f8acdd94 and project cb60bef197c84b18aa1bfb27172dcc83. Resources: {'server_groups'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:10:14.099766 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d6946e95-d765-4f49-9a07-a3842ceb6867 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:14.108682 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d6946e95-d765-4f49-9a07-a3842ceb6867 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/306160c1-762b-4b9e-aa09-3dd60f0c7ce3" status: 200 len: 1311 microversion: 2.1 time: 1.428833 Aug 31 16:10:14.118972 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1cd63521-c026-43a9-9aa9-bc144fdd5187 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] 10.222.0.50 "POST /compute/v2.1/os-server-groups" status: 200 len: 162 microversion: 2.1 time: 0.210754 Aug 31 16:10:14.118972 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2010/3832] 10.222.0.50 () {60 vars in 1173 bytes} [Wed Aug 31 16:10:13 2022] POST /compute/v2.1/os-server-groups => generated 162 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:10:14.121161 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1823/3833] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:12 2022] GET /compute/v2.1/servers/306160c1-762b-4b9e-aa09-3dd60f0c7ce3 => generated 1311 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:10:14.147545 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0ac50738-aa80-4b23-9fe2-21479e736f0e tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Action: 'create', calling method: .version_select at 0x7fbb46faee50>, body: {"server_group": {"name": "tempest-server-group-58253685", "policies": ["affinity"]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:14.235667 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-0ac50738-aa80-4b23-9fe2-21479e736f0e tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Getting quotas for project cb60bef197c84b18aa1bfb27172dcc83. Resources: {'server_groups'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:10:14.250448 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:10:14.252997 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-0ac50738-aa80-4b23-9fe2-21479e736f0e tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Getting quotas for user ab5d33bcaf2846cb83e0cf83f8acdd94 and project cb60bef197c84b18aa1bfb27172dcc83. Resources: {'server_groups'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:10:14.349294 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-0ac50738-aa80-4b23-9fe2-21479e736f0e tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Getting quotas for project cb60bef197c84b18aa1bfb27172dcc83. Resources: {'server_groups'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:10:14.356414 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-0ac50738-aa80-4b23-9fe2-21479e736f0e tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Getting quotas for user ab5d33bcaf2846cb83e0cf83f8acdd94 and project cb60bef197c84b18aa1bfb27172dcc83. Resources: {'server_groups'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:10:14.382516 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0ac50738-aa80-4b23-9fe2-21479e736f0e tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] 10.222.0.50 "POST /compute/v2.1/os-server-groups" status: 200 len: 162 microversion: 2.1 time: 0.264120 Aug 31 16:10:14.385334 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2011/3834] 10.222.0.50 () {60 vars in 1173 bytes} [Wed Aug 31 16:10:14 2022] POST /compute/v2.1/os-server-groups => generated 162 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:10:14.399146 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-29dfa284-6012-42e1-89b0-a8ef278d3247 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:14.459709 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-29dfa284-6012-42e1-89b0-a8ef278d3247 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/96548961-d693-4010-9586-442155be69ae" status: 204 len: 0 microversion: 2.1 time: 0.066726 Aug 31 16:10:14.460547 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1824/3835] 10.222.0.50 () {58 vars in 1266 bytes} [Wed Aug 31 16:10:14 2022] DELETE /compute/v2.1/os-server-groups/96548961-d693-4010-9586-442155be69ae => generated 0 bytes in 69 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:10:14.470577 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ab2e618b-8dd9-44a5-8d41-7909b2e9bfba tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:14.495315 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ab2e618b-8dd9-44a5-8d41-7909b2e9bfba tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] 10.222.0.50 "GET /compute/v2.1/os-server-groups" status: 200 len: 333 microversion: 2.1 time: 0.030258 Aug 31 16:10:14.495905 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2012/3836] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Aug 31 16:10:14 2022] GET /compute/v2.1/os-server-groups => generated 333 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:10:14.508562 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2deb6410-76f9-4817-a33c-5348958ed281 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:14.553953 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2deb6410-76f9-4817-a33c-5348958ed281 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/163c1bba-391e-4cff-a9dc-c98ea6220c97" status: 204 len: 0 microversion: 2.1 time: 0.049819 Aug 31 16:10:14.557091 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1825/3837] 10.222.0.50 () {58 vars in 1266 bytes} [Wed Aug 31 16:10:14 2022] DELETE /compute/v2.1/os-server-groups/163c1bba-391e-4cff-a9dc-c98ea6220c97 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 16:10:14.566195 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f06d79cf-9033-436d-800b-c1bf514ffe04 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:14.590828 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f06d79cf-9033-436d-800b-c1bf514ffe04 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] 10.222.0.50 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.028596 Aug 31 16:10:14.591496 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2013/3838] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Aug 31 16:10:14 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:10:14.606702 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b25a47ea-e59a-4bc9-9b37-5812b3c8ea56 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Action: 'create', calling method: .version_select at 0x7fbb46601a60>, body: {"server_group": {"name": "tempest-server-group-1580346034", "policies": ["affinity"]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:14.652727 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-b25a47ea-e59a-4bc9-9b37-5812b3c8ea56 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Getting quotas for project cb60bef197c84b18aa1bfb27172dcc83. Resources: {'server_groups'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:10:14.674382 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-b25a47ea-e59a-4bc9-9b37-5812b3c8ea56 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Getting quotas for user ab5d33bcaf2846cb83e0cf83f8acdd94 and project cb60bef197c84b18aa1bfb27172dcc83. Resources: {'server_groups'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:10:14.813694 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-b25a47ea-e59a-4bc9-9b37-5812b3c8ea56 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Getting quotas for project cb60bef197c84b18aa1bfb27172dcc83. Resources: {'server_groups'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:10:14.840860 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-b25a47ea-e59a-4bc9-9b37-5812b3c8ea56 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Getting quotas for user ab5d33bcaf2846cb83e0cf83f8acdd94 and project cb60bef197c84b18aa1bfb27172dcc83. Resources: {'server_groups'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:10:14.883659 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b25a47ea-e59a-4bc9-9b37-5812b3c8ea56 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] 10.222.0.50 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.281140 Aug 31 16:10:14.885065 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1826/3839] 10.222.0.50 () {60 vars in 1173 bytes} [Wed Aug 31 16:10:14 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:10:14.905845 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e9511c38-8055-4c29-8c95-5a26b3815aa0 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:14.937753 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-989efdf2-8e56-4028-9586-a9fa32e68cc4 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:14.940275 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-989efdf2-8e56-4028-9586-a9fa32e68cc4 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 2c93da9d-54d5-408f-85d4-768f397294b6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:15.005447 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-989efdf2-8e56-4028-9586-a9fa32e68cc4 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:15.005989 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-989efdf2-8e56-4028-9586-a9fa32e68cc4 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:15.014853 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-989efdf2-8e56-4028-9586-a9fa32e68cc4 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:15.018666 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-989efdf2-8e56-4028-9586-a9fa32e68cc4 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:15.022906 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-989efdf2-8e56-4028-9586-a9fa32e68cc4 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:15.023826 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-989efdf2-8e56-4028-9586-a9fa32e68cc4 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:15.057897 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e9511c38-8055-4c29-8c95-5a26b3815aa0 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/cbeee18d-37fd-4f08-b103-0f7bcee8985b" status: 204 len: 0 microversion: 2.1 time: 0.164272 Aug 31 16:10:15.062350 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2014/3840] 10.222.0.50 () {58 vars in 1266 bytes} [Wed Aug 31 16:10:14 2022] DELETE /compute/v2.1/os-server-groups/cbeee18d-37fd-4f08-b103-0f7bcee8985b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:10:15.077901 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fe89f850-7549-4dc8-8ff5-9a221ef5a611 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:15.114709 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fe89f850-7549-4dc8-8ff5-9a221ef5a611 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] 10.222.0.50 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.044601 Aug 31 16:10:15.118230 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2015/3841] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Aug 31 16:10:15 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:10:15.137206 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-cbf20a2c-eb85-4719-b9bc-d7275ea55548 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:15.138128 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-cbf20a2c-eb85-4719-b9bc-d7275ea55548 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 306160c1-762b-4b9e-aa09-3dd60f0c7ce3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:15.148333 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cbf20a2c-eb85-4719-b9bc-d7275ea55548 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:15.149171 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cbf20a2c-eb85-4719-b9bc-d7275ea55548 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:15.149769 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cbf20a2c-eb85-4719-b9bc-d7275ea55548 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:15.150963 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cbf20a2c-eb85-4719-b9bc-d7275ea55548 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:15.151655 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cbf20a2c-eb85-4719-b9bc-d7275ea55548 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:15.152232 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cbf20a2c-eb85-4719-b9bc-d7275ea55548 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:15.555163 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:10:15.716207 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-989efdf2-8e56-4028-9586-a9fa32e68cc4 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:15.728384 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-989efdf2-8e56-4028-9586-a9fa32e68cc4 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/2c93da9d-54d5-408f-85d4-768f397294b6" status: 200 len: 1293 microversion: 2.1 time: 0.817224 Aug 31 16:10:15.729760 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1827/3842] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:14 2022] GET /compute/v2.1/servers/2c93da9d-54d5-408f-85d4-768f397294b6 => generated 1293 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:15.737924 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-84b913b8-72ca-4297-bbdd-3d7a6c66b292 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Action: 'create', calling method: .version_select at 0x7fbb46f57430>, body: {"server_group": {"name": "tempest-server-group-1628409411", "policies": ["anti-affinity"]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:15.811120 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-84b913b8-72ca-4297-bbdd-3d7a6c66b292 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Getting quotas for project cb60bef197c84b18aa1bfb27172dcc83. Resources: {'server_groups'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:10:15.821992 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-84b913b8-72ca-4297-bbdd-3d7a6c66b292 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Getting quotas for user ab5d33bcaf2846cb83e0cf83f8acdd94 and project cb60bef197c84b18aa1bfb27172dcc83. Resources: {'server_groups'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:10:15.917807 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-84b913b8-72ca-4297-bbdd-3d7a6c66b292 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Getting quotas for project cb60bef197c84b18aa1bfb27172dcc83. Resources: {'server_groups'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:10:15.958013 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-84b913b8-72ca-4297-bbdd-3d7a6c66b292 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Getting quotas for user ab5d33bcaf2846cb83e0cf83f8acdd94 and project cb60bef197c84b18aa1bfb27172dcc83. Resources: {'server_groups'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:10:15.988116 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-84b913b8-72ca-4297-bbdd-3d7a6c66b292 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] 10.222.0.50 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.254357 Aug 31 16:10:15.989320 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1828/3843] 10.222.0.50 () {60 vars in 1173 bytes} [Wed Aug 31 16:10:15 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:10:16.006071 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4b2a54ad-a559-4e15-a180-41211c1ed334 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:16.009580 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-cbf20a2c-eb85-4719-b9bc-d7275ea55548 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:16.023105 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-cbf20a2c-eb85-4719-b9bc-d7275ea55548 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/306160c1-762b-4b9e-aa09-3dd60f0c7ce3" status: 200 len: 1311 microversion: 2.1 time: 0.896295 Aug 31 16:10:16.031908 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2016/3844] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:15 2022] GET /compute/v2.1/servers/306160c1-762b-4b9e-aa09-3dd60f0c7ce3 => generated 1311 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:10:16.104813 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4b2a54ad-a559-4e15-a180-41211c1ed334 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/41f47d2b-969b-4714-bdbd-390b39e2da08" status: 204 len: 0 microversion: 2.1 time: 0.106209 Aug 31 16:10:16.109207 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1829/3845] 10.222.0.50 () {58 vars in 1266 bytes} [Wed Aug 31 16:10:15 2022] DELETE /compute/v2.1/os-server-groups/41f47d2b-969b-4714-bdbd-390b39e2da08 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:10:16.120104 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2589257a-ecd9-4516-ae0f-01c668049ee2 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:16.145805 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2589257a-ecd9-4516-ae0f-01c668049ee2 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] 10.222.0.50 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.030782 Aug 31 16:10:16.146484 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2017/3846] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Aug 31 16:10:16 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:10:16.217699 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e3992adb-fc92-4958-9236-744399000dfb tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-8580354", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "c837163b-8c34-46c0-9feb-4fec1830d14e"}]}, "os:scheduler_hints": {"group": "223532c7-d681-4adc-9f43-915273068c99"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:16.323297 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-e3992adb-fc92-4958-9236-744399000dfb tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] validate_networks() for [('c837163b-8c34-46c0-9feb-4fec1830d14e', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:10:16.786759 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0d8c28f7-ec69-4e95-b594-f0b1aa5656ec tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:16.788245 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0d8c28f7-ec69-4e95-b594-f0b1aa5656ec tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 2c93da9d-54d5-408f-85d4-768f397294b6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:16.798430 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0d8c28f7-ec69-4e95-b594-f0b1aa5656ec tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:16.801429 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0d8c28f7-ec69-4e95-b594-f0b1aa5656ec tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:16.802314 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0d8c28f7-ec69-4e95-b594-f0b1aa5656ec tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:16.803316 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0d8c28f7-ec69-4e95-b594-f0b1aa5656ec tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:16.805916 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0d8c28f7-ec69-4e95-b594-f0b1aa5656ec tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:16.806445 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0d8c28f7-ec69-4e95-b594-f0b1aa5656ec tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:17.343837 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0d8c28f7-ec69-4e95-b594-f0b1aa5656ec tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:17.354444 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0d8c28f7-ec69-4e95-b594-f0b1aa5656ec tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/2c93da9d-54d5-408f-85d4-768f397294b6" status: 200 len: 1293 microversion: 2.1 time: 0.592440 Aug 31 16:10:17.361356 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2018/3847] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:16 2022] GET /compute/v2.1/servers/2c93da9d-54d5-408f-85d4-768f397294b6 => generated 1293 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:17.483115 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-e3992adb-fc92-4958-9236-744399000dfb tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:10:17.484945 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-e3992adb-fc92-4958-9236-744399000dfb tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:10:17.486299 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-e3992adb-fc92-4958-9236-744399000dfb tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:10:17.491407 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-e3992adb-fc92-4958-9236-744399000dfb tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:10:17.492082 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-e3992adb-fc92-4958-9236-744399000dfb tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:10:17.492921 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-a1baacd8-7cb4-4e76-93c2-118b271ba4ab req-cbc02cbd-ae2e-4509-a4c8-95045518975b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5923807d-1058-45ab-b8d1-c6700ea8c142", "tag": "b92f4d7a-9fe1-49d2-9d35-67e9a518bfc4"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:17.520648 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-a1baacd8-7cb4-4e76-93c2-118b271ba4ab req-cbc02cbd-ae2e-4509-a4c8-95045518975b service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:17.521623 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-a1baacd8-7cb4-4e76-93c2-118b271ba4ab req-cbc02cbd-ae2e-4509-a4c8-95045518975b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:17.522502 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-a1baacd8-7cb4-4e76-93c2-118b271ba4ab req-cbc02cbd-ae2e-4509-a4c8-95045518975b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:17.538700 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3992adb-fc92-4958-9236-744399000dfb tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:17.539216 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3992adb-fc92-4958-9236-744399000dfb tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:17.539653 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3992adb-fc92-4958-9236-744399000dfb tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:17.543281 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3992adb-fc92-4958-9236-744399000dfb tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:17.543764 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3992adb-fc92-4958-9236-744399000dfb tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:17.544195 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3992adb-fc92-4958-9236-744399000dfb tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:17.552394 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-a1baacd8-7cb4-4e76-93c2-118b271ba4ab req-cbc02cbd-ae2e-4509-a4c8-95045518975b service nova] Creating event network-changed:b92f4d7a-9fe1-49d2-9d35-67e9a518bfc4 for instance 5923807d-1058-45ab-b8d1-c6700ea8c142 on n-h2-833090-16 Aug 31 16:10:17.566330 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-a1baacd8-7cb4-4e76-93c2-118b271ba4ab req-cbc02cbd-ae2e-4509-a4c8-95045518975b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.203012 Aug 31 16:10:17.567681 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2019/3848] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:10:17.575638 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-615d0b2c-bf0a-4c4f-9b3d-e5a14ff85a88 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:17.576686 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-615d0b2c-bf0a-4c4f-9b3d-e5a14ff85a88 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 306160c1-762b-4b9e-aa09-3dd60f0c7ce3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:17.592654 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-615d0b2c-bf0a-4c4f-9b3d-e5a14ff85a88 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:17.593841 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-615d0b2c-bf0a-4c4f-9b3d-e5a14ff85a88 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:17.594549 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-615d0b2c-bf0a-4c4f-9b3d-e5a14ff85a88 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:17.596646 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-615d0b2c-bf0a-4c4f-9b3d-e5a14ff85a88 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:17.597317 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-615d0b2c-bf0a-4c4f-9b3d-e5a14ff85a88 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:17.600080 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-615d0b2c-bf0a-4c4f-9b3d-e5a14ff85a88 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:17.623512 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-e3992adb-fc92-4958-9236-744399000dfb tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Getting quotas for project cb60bef197c84b18aa1bfb27172dcc83. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:10:17.654837 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-e3992adb-fc92-4958-9236-744399000dfb tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Getting quotas for user ab5d33bcaf2846cb83e0cf83f8acdd94 and project cb60bef197c84b18aa1bfb27172dcc83. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:10:17.694246 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e3992adb-fc92-4958-9236-744399000dfb tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:10:17.697447 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e3992adb-fc92-4958-9236-744399000dfb tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] [instance: 9844cf26-6118-4f36-8c4d-736062782c20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:10:17.748569 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=9,nova_api:INSERT=7 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:10:17.780093 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-e3992adb-fc92-4958-9236-744399000dfb tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Getting quotas for project cb60bef197c84b18aa1bfb27172dcc83. Resources: {'server_group_members'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:10:17.788790 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-e3992adb-fc92-4958-9236-744399000dfb tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Getting quotas for user ab5d33bcaf2846cb83e0cf83f8acdd94 and project cb60bef197c84b18aa1bfb27172dcc83. Resources: {'server_group_members'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:10:17.856688 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-e3992adb-fc92-4958-9236-744399000dfb tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Getting quotas for project cb60bef197c84b18aa1bfb27172dcc83. Resources: {'server_group_members'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:10:17.871130 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-e3992adb-fc92-4958-9236-744399000dfb tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Getting quotas for user ab5d33bcaf2846cb83e0cf83f8acdd94 and project cb60bef197c84b18aa1bfb27172dcc83. Resources: {'server_group_members'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:10:17.980354 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e3992adb-fc92-4958-9236-744399000dfb tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.772697 Aug 31 16:10:17.981071 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1830/3849] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:10:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:10:18.005173 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-e1ee2598-5f55-400e-a1c5-0e93dcabb40c req-3d2e1ba7-1928-4f86-8d61-b1036b224f7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c93da9d-54d5-408f-85d4-768f397294b6", "tag": "7c6332dc-5d4c-478e-93c8-9fa795380cdd"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:18.059546 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e1ee2598-5f55-400e-a1c5-0e93dcabb40c req-3d2e1ba7-1928-4f86-8d61-b1036b224f7e service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:18.060408 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e1ee2598-5f55-400e-a1c5-0e93dcabb40c req-3d2e1ba7-1928-4f86-8d61-b1036b224f7e service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:18.066695 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e1ee2598-5f55-400e-a1c5-0e93dcabb40c req-3d2e1ba7-1928-4f86-8d61-b1036b224f7e service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:18.097375 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:10:18.123628 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-e1ee2598-5f55-400e-a1c5-0e93dcabb40c req-3d2e1ba7-1928-4f86-8d61-b1036b224f7e service nova] Creating event network-changed:7c6332dc-5d4c-478e-93c8-9fa795380cdd for instance 2c93da9d-54d5-408f-85d4-768f397294b6 on n-h2-833090-16 Aug 31 16:10:18.134955 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-e1ee2598-5f55-400e-a1c5-0e93dcabb40c req-3d2e1ba7-1928-4f86-8d61-b1036b224f7e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144793 Aug 31 16:10:18.135816 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1831/3850] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:10:18.156646 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b009936b-692b-4c9b-98d3-13a48752082a tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:18.157583 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b009936b-692b-4c9b-98d3-13a48752082a tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] [instance: 9844cf26-6118-4f36-8c4d-736062782c20] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:18.180666 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-615d0b2c-bf0a-4c4f-9b3d-e5a14ff85a88 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:18.204474 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-615d0b2c-bf0a-4c4f-9b3d-e5a14ff85a88 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/306160c1-762b-4b9e-aa09-3dd60f0c7ce3" status: 200 len: 1311 microversion: 2.1 time: 0.635345 Aug 31 16:10:18.210202 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2020/3851] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:17 2022] GET /compute/v2.1/servers/306160c1-762b-4b9e-aa09-3dd60f0c7ce3 => generated 1311 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:18.387729 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4a168bd6-c7f3-45d1-a717-3b406f884d02 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:18.387729 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4a168bd6-c7f3-45d1-a717-3b406f884d02 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 2c93da9d-54d5-408f-85d4-768f397294b6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:18.406004 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4a168bd6-c7f3-45d1-a717-3b406f884d02 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:18.408691 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4a168bd6-c7f3-45d1-a717-3b406f884d02 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:18.410445 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4a168bd6-c7f3-45d1-a717-3b406f884d02 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:18.415057 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4a168bd6-c7f3-45d1-a717-3b406f884d02 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:18.421926 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4a168bd6-c7f3-45d1-a717-3b406f884d02 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:18.422651 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4a168bd6-c7f3-45d1-a717-3b406f884d02 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:18.481597 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b009936b-692b-4c9b-98d3-13a48752082a tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5d33bcaf2846cb83e0cf83f8acdd94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb60bef197c84b18aa1bfb27172dcc83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:18.507158 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b009936b-692b-4c9b-98d3-13a48752082a tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] 10.222.0.50 "GET /compute/v2.1/servers/9844cf26-6118-4f36-8c4d-736062782c20" status: 200 len: 1210 microversion: 2.1 time: 0.367516 Aug 31 16:10:18.516410 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1832/3852] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:18 2022] GET /compute/v2.1/servers/9844cf26-6118-4f36-8c4d-736062782c20 => generated 1210 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:19.171780 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4a168bd6-c7f3-45d1-a717-3b406f884d02 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:19.188792 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4a168bd6-c7f3-45d1-a717-3b406f884d02 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/2c93da9d-54d5-408f-85d4-768f397294b6" status: 200 len: 1293 microversion: 2.1 time: 0.806238 Aug 31 16:10:19.189753 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2021/3853] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:18 2022] GET /compute/v2.1/servers/2c93da9d-54d5-408f-85d4-768f397294b6 => generated 1293 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:19.239346 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bc86f68d-827d-43a9-aad7-648054fd5ecc tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:19.240152 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bc86f68d-827d-43a9-aad7-648054fd5ecc tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 306160c1-762b-4b9e-aa09-3dd60f0c7ce3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:19.264209 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc86f68d-827d-43a9-aad7-648054fd5ecc tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:19.264964 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc86f68d-827d-43a9-aad7-648054fd5ecc tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:19.266250 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc86f68d-827d-43a9-aad7-648054fd5ecc tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:19.267278 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc86f68d-827d-43a9-aad7-648054fd5ecc tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:19.268066 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc86f68d-827d-43a9-aad7-648054fd5ecc tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:19.268711 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc86f68d-827d-43a9-aad7-648054fd5ecc tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:19.273832 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=64 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:10:19.536230 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fbb87fc0-c94f-45d1-8f9a-521d2af71dcd tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:19.538136 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fbb87fc0-c94f-45d1-8f9a-521d2af71dcd tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] [instance: 9844cf26-6118-4f36-8c4d-736062782c20] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:19.552578 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fbb87fc0-c94f-45d1-8f9a-521d2af71dcd tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:19.553133 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fbb87fc0-c94f-45d1-8f9a-521d2af71dcd tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:19.553526 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fbb87fc0-c94f-45d1-8f9a-521d2af71dcd tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:19.554294 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fbb87fc0-c94f-45d1-8f9a-521d2af71dcd tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:19.554752 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fbb87fc0-c94f-45d1-8f9a-521d2af71dcd tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:19.559425 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fbb87fc0-c94f-45d1-8f9a-521d2af71dcd tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:19.696835 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-fbb87fc0-c94f-45d1-8f9a-521d2af71dcd tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5d33bcaf2846cb83e0cf83f8acdd94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb60bef197c84b18aa1bfb27172dcc83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:19.708557 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fbb87fc0-c94f-45d1-8f9a-521d2af71dcd tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] 10.222.0.50 "GET /compute/v2.1/servers/9844cf26-6118-4f36-8c4d-736062782c20" status: 200 len: 1214 microversion: 2.1 time: 0.177723 Aug 31 16:10:19.728153 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2022/3854] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:19 2022] GET /compute/v2.1/servers/9844cf26-6118-4f36-8c4d-736062782c20 => generated 1214 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:19.844749 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bc86f68d-827d-43a9-aad7-648054fd5ecc tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:19.855862 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bc86f68d-827d-43a9-aad7-648054fd5ecc tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/306160c1-762b-4b9e-aa09-3dd60f0c7ce3" status: 200 len: 1311 microversion: 2.1 time: 0.623203 Aug 31 16:10:19.856909 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1833/3855] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:19 2022] GET /compute/v2.1/servers/306160c1-762b-4b9e-aa09-3dd60f0c7ce3 => generated 1311 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:20.155839 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-b68f0e89-f87b-442d-abb0-c43cf27e9d06 req-e798475d-cc6e-4848-9a4e-d75927c3f2e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "306160c1-762b-4b9e-aa09-3dd60f0c7ce3", "tag": "c302a76d-c1bd-4ef3-9a00-d5e28f3fdde8"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:20.174351 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-b68f0e89-f87b-442d-abb0-c43cf27e9d06 req-e798475d-cc6e-4848-9a4e-d75927c3f2e6 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:20.178925 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-b68f0e89-f87b-442d-abb0-c43cf27e9d06 req-e798475d-cc6e-4848-9a4e-d75927c3f2e6 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:20.179847 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-b68f0e89-f87b-442d-abb0-c43cf27e9d06 req-e798475d-cc6e-4848-9a4e-d75927c3f2e6 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:20.213708 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4272ab7b-e8f6-4687-8962-9eb0099415a5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:20.215105 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4272ab7b-e8f6-4687-8962-9eb0099415a5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 2c93da9d-54d5-408f-85d4-768f397294b6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:20.228713 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-b68f0e89-f87b-442d-abb0-c43cf27e9d06 req-e798475d-cc6e-4848-9a4e-d75927c3f2e6 service nova] Creating event network-changed:c302a76d-c1bd-4ef3-9a00-d5e28f3fdde8 for instance 306160c1-762b-4b9e-aa09-3dd60f0c7ce3 on n-h1-833090-16 Aug 31 16:10:20.237690 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-b68f0e89-f87b-442d-abb0-c43cf27e9d06 req-e798475d-cc6e-4848-9a4e-d75927c3f2e6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087126 Aug 31 16:10:20.242380 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4272ab7b-e8f6-4687-8962-9eb0099415a5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:20.244120 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4272ab7b-e8f6-4687-8962-9eb0099415a5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:20.247000 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2023/3856] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:10:20.247825 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4272ab7b-e8f6-4687-8962-9eb0099415a5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:20.253217 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4272ab7b-e8f6-4687-8962-9eb0099415a5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:20.254066 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4272ab7b-e8f6-4687-8962-9eb0099415a5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:20.261783 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4272ab7b-e8f6-4687-8962-9eb0099415a5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:20.731439 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-04f08776-7b08-4a4e-a5bf-ad0c13cd3d69 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:20.732294 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-04f08776-7b08-4a4e-a5bf-ad0c13cd3d69 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] [instance: 9844cf26-6118-4f36-8c4d-736062782c20] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:20.754999 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-04f08776-7b08-4a4e-a5bf-ad0c13cd3d69 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:20.755691 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-04f08776-7b08-4a4e-a5bf-ad0c13cd3d69 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:20.756427 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-04f08776-7b08-4a4e-a5bf-ad0c13cd3d69 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:20.757485 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-04f08776-7b08-4a4e-a5bf-ad0c13cd3d69 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:20.758190 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-04f08776-7b08-4a4e-a5bf-ad0c13cd3d69 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:20.758845 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-04f08776-7b08-4a4e-a5bf-ad0c13cd3d69 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:21.386218 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-04f08776-7b08-4a4e-a5bf-ad0c13cd3d69 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5d33bcaf2846cb83e0cf83f8acdd94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb60bef197c84b18aa1bfb27172dcc83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:21.388323 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4272ab7b-e8f6-4687-8962-9eb0099415a5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:21.397706 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4272ab7b-e8f6-4687-8962-9eb0099415a5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/2c93da9d-54d5-408f-85d4-768f397294b6" status: 200 len: 1293 microversion: 2.1 time: 1.189338 Aug 31 16:10:21.400546 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-04f08776-7b08-4a4e-a5bf-ad0c13cd3d69 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] 10.222.0.50 "GET /compute/v2.1/servers/9844cf26-6118-4f36-8c4d-736062782c20" status: 200 len: 1214 microversion: 2.1 time: 0.672987 Aug 31 16:10:21.402290 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2024/3857] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:20 2022] GET /compute/v2.1/servers/9844cf26-6118-4f36-8c4d-736062782c20 => generated 1214 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:21.404763 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1834/3858] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:20 2022] GET /compute/v2.1/servers/2c93da9d-54d5-408f-85d4-768f397294b6 => generated 1293 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:21.416207 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2078d14b-1705-45a3-8d69-36ebdce94ed9 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:21.417715 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2078d14b-1705-45a3-8d69-36ebdce94ed9 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 306160c1-762b-4b9e-aa09-3dd60f0c7ce3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:21.445009 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2078d14b-1705-45a3-8d69-36ebdce94ed9 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:21.448742 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2078d14b-1705-45a3-8d69-36ebdce94ed9 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:21.452434 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2078d14b-1705-45a3-8d69-36ebdce94ed9 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:21.472009 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2078d14b-1705-45a3-8d69-36ebdce94ed9 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:21.474415 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2078d14b-1705-45a3-8d69-36ebdce94ed9 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:21.476313 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2078d14b-1705-45a3-8d69-36ebdce94ed9 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:21.964720 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2078d14b-1705-45a3-8d69-36ebdce94ed9 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:21.977330 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2078d14b-1705-45a3-8d69-36ebdce94ed9 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/306160c1-762b-4b9e-aa09-3dd60f0c7ce3" status: 200 len: 1311 microversion: 2.1 time: 0.573181 Aug 31 16:10:21.978625 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2025/3859] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:21 2022] GET /compute/v2.1/servers/306160c1-762b-4b9e-aa09-3dd60f0c7ce3 => generated 1311 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:22.421354 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2e71edc6-2472-4717-aa79-ef4c70bac6ea tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:22.422185 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2e71edc6-2472-4717-aa79-ef4c70bac6ea tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 2c93da9d-54d5-408f-85d4-768f397294b6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:22.422758 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e0187976-2c17-4d4d-94e6-c334f8817f2a tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:22.423471 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e0187976-2c17-4d4d-94e6-c334f8817f2a tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] [instance: 9844cf26-6118-4f36-8c4d-736062782c20] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:22.433823 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e0187976-2c17-4d4d-94e6-c334f8817f2a tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:22.437509 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e0187976-2c17-4d4d-94e6-c334f8817f2a tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:22.438560 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e0187976-2c17-4d4d-94e6-c334f8817f2a tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:22.439620 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e0187976-2c17-4d4d-94e6-c334f8817f2a tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:22.443295 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e0187976-2c17-4d4d-94e6-c334f8817f2a tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:22.443992 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e71edc6-2472-4717-aa79-ef4c70bac6ea tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:22.444484 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e71edc6-2472-4717-aa79-ef4c70bac6ea tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:22.444793 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e0187976-2c17-4d4d-94e6-c334f8817f2a tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:22.444903 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e71edc6-2472-4717-aa79-ef4c70bac6ea tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:22.445739 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e71edc6-2472-4717-aa79-ef4c70bac6ea tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:22.446034 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e71edc6-2472-4717-aa79-ef4c70bac6ea tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:22.446484 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e71edc6-2472-4717-aa79-ef4c70bac6ea tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:22.888695 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e0187976-2c17-4d4d-94e6-c334f8817f2a tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5d33bcaf2846cb83e0cf83f8acdd94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb60bef197c84b18aa1bfb27172dcc83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:22.903797 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e0187976-2c17-4d4d-94e6-c334f8817f2a tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] 10.222.0.50 "GET /compute/v2.1/servers/9844cf26-6118-4f36-8c4d-736062782c20" status: 200 len: 1214 microversion: 2.1 time: 0.485205 Aug 31 16:10:22.918561 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2026/3860] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:22 2022] GET /compute/v2.1/servers/9844cf26-6118-4f36-8c4d-736062782c20 => generated 1214 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:10:23.005561 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d767ff39-020c-4dbe-b829-da27d0368cea tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:23.006440 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d767ff39-020c-4dbe-b829-da27d0368cea tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 306160c1-762b-4b9e-aa09-3dd60f0c7ce3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:23.014813 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d767ff39-020c-4dbe-b829-da27d0368cea tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:23.020077 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d767ff39-020c-4dbe-b829-da27d0368cea tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:23.026879 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d767ff39-020c-4dbe-b829-da27d0368cea tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:23.028203 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d767ff39-020c-4dbe-b829-da27d0368cea tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:23.028903 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d767ff39-020c-4dbe-b829-da27d0368cea tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:23.029534 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d767ff39-020c-4dbe-b829-da27d0368cea tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:23.712952 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2e71edc6-2472-4717-aa79-ef4c70bac6ea tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:23.745778 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2e71edc6-2472-4717-aa79-ef4c70bac6ea tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/2c93da9d-54d5-408f-85d4-768f397294b6" status: 200 len: 1293 microversion: 2.1 time: 1.324660 Aug 31 16:10:23.750113 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1835/3861] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:22 2022] GET /compute/v2.1/servers/2c93da9d-54d5-408f-85d4-768f397294b6 => generated 1293 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:23.927710 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d767ff39-020c-4dbe-b829-da27d0368cea tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:23.935727 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-291fb2dd-aa1d-44ad-a988-a01b467a7ec5 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:23.936503 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-291fb2dd-aa1d-44ad-a988-a01b467a7ec5 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] [instance: 9844cf26-6118-4f36-8c4d-736062782c20] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:23.949943 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d767ff39-020c-4dbe-b829-da27d0368cea tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/306160c1-762b-4b9e-aa09-3dd60f0c7ce3" status: 200 len: 1311 microversion: 2.1 time: 0.948800 Aug 31 16:10:23.950641 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2027/3862] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:22 2022] GET /compute/v2.1/servers/306160c1-762b-4b9e-aa09-3dd60f0c7ce3 => generated 1311 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:23.952096 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-291fb2dd-aa1d-44ad-a988-a01b467a7ec5 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:23.952716 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-291fb2dd-aa1d-44ad-a988-a01b467a7ec5 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:23.953152 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-291fb2dd-aa1d-44ad-a988-a01b467a7ec5 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:23.956896 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-291fb2dd-aa1d-44ad-a988-a01b467a7ec5 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:23.958894 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-291fb2dd-aa1d-44ad-a988-a01b467a7ec5 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:23.959326 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-291fb2dd-aa1d-44ad-a988-a01b467a7ec5 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:24.300925 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-291fb2dd-aa1d-44ad-a988-a01b467a7ec5 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5d33bcaf2846cb83e0cf83f8acdd94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb60bef197c84b18aa1bfb27172dcc83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:24.338556 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-291fb2dd-aa1d-44ad-a988-a01b467a7ec5 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] 10.222.0.50 "GET /compute/v2.1/servers/9844cf26-6118-4f36-8c4d-736062782c20" status: 200 len: 1262 microversion: 2.1 time: 0.410797 Aug 31 16:10:24.343422 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1836/3863] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:23 2022] GET /compute/v2.1/servers/9844cf26-6118-4f36-8c4d-736062782c20 => generated 1262 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:24.791173 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-667f0b0a-a451-4fc0-b1e2-55db41a12e31 req-7a79ff1d-de3c-46fc-b4eb-963157255841 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "306160c1-762b-4b9e-aa09-3dd60f0c7ce3", "name": "network-vif-plugged", "status": "completed", "tag": "c302a76d-c1bd-4ef3-9a00-d5e28f3fdde8"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:24.803438 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-29f93563-bdbe-4cb7-b8c3-33821d5185e5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:24.804552 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-29f93563-bdbe-4cb7-b8c3-33821d5185e5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 2c93da9d-54d5-408f-85d4-768f397294b6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:24.843788 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=30 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:10:24.886951 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29f93563-bdbe-4cb7-b8c3-33821d5185e5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:24.887762 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29f93563-bdbe-4cb7-b8c3-33821d5185e5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:24.896138 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-667f0b0a-a451-4fc0-b1e2-55db41a12e31 req-7a79ff1d-de3c-46fc-b4eb-963157255841 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:24.900278 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-667f0b0a-a451-4fc0-b1e2-55db41a12e31 req-7a79ff1d-de3c-46fc-b4eb-963157255841 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:24.901192 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-667f0b0a-a451-4fc0-b1e2-55db41a12e31 req-7a79ff1d-de3c-46fc-b4eb-963157255841 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:24.905358 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29f93563-bdbe-4cb7-b8c3-33821d5185e5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:24.910512 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29f93563-bdbe-4cb7-b8c3-33821d5185e5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:24.912052 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29f93563-bdbe-4cb7-b8c3-33821d5185e5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:24.913057 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29f93563-bdbe-4cb7-b8c3-33821d5185e5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:24.932817 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-667f0b0a-a451-4fc0-b1e2-55db41a12e31 req-7a79ff1d-de3c-46fc-b4eb-963157255841 service nova] Creating event network-vif-plugged:c302a76d-c1bd-4ef3-9a00-d5e28f3fdde8 for instance 306160c1-762b-4b9e-aa09-3dd60f0c7ce3 on n-h1-833090-16 Aug 31 16:10:24.946936 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-667f0b0a-a451-4fc0-b1e2-55db41a12e31 req-7a79ff1d-de3c-46fc-b4eb-963157255841 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.187061 Aug 31 16:10:24.948402 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2028/3864] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:10:24.995274 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-cb5b9314-95d3-43cf-8780-7f0b4f760fac tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:24.999239 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-cb5b9314-95d3-43cf-8780-7f0b4f760fac tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 306160c1-762b-4b9e-aa09-3dd60f0c7ce3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:25.028667 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb5b9314-95d3-43cf-8780-7f0b4f760fac tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:25.029849 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb5b9314-95d3-43cf-8780-7f0b4f760fac tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:25.033283 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb5b9314-95d3-43cf-8780-7f0b4f760fac tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:25.035456 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb5b9314-95d3-43cf-8780-7f0b4f760fac tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:25.041643 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb5b9314-95d3-43cf-8780-7f0b4f760fac tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:25.042621 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb5b9314-95d3-43cf-8780-7f0b4f760fac tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:25.686452 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-29f93563-bdbe-4cb7-b8c3-33821d5185e5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:25.712575 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-29f93563-bdbe-4cb7-b8c3-33821d5185e5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/2c93da9d-54d5-408f-85d4-768f397294b6" status: 200 len: 1293 microversion: 2.1 time: 0.942382 Aug 31 16:10:25.746626 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1837/3865] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:24 2022] GET /compute/v2.1/servers/2c93da9d-54d5-408f-85d4-768f397294b6 => generated 1293 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:25.757132 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e2e0eb02-e6b5-49f2-993b-aecbf954470f tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:25.770975 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e2e0eb02-e6b5-49f2-993b-aecbf954470f tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] [instance: 9844cf26-6118-4f36-8c4d-736062782c20] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:25.783846 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2e0eb02-e6b5-49f2-993b-aecbf954470f tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:25.789757 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2e0eb02-e6b5-49f2-993b-aecbf954470f tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:25.794363 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2e0eb02-e6b5-49f2-993b-aecbf954470f tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:25.795432 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2e0eb02-e6b5-49f2-993b-aecbf954470f tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:25.796236 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2e0eb02-e6b5-49f2-993b-aecbf954470f tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:25.796826 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2e0eb02-e6b5-49f2-993b-aecbf954470f tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:25.896903 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-cb5b9314-95d3-43cf-8780-7f0b4f760fac tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:25.912187 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-cb5b9314-95d3-43cf-8780-7f0b4f760fac tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/306160c1-762b-4b9e-aa09-3dd60f0c7ce3" status: 200 len: 1311 microversion: 2.1 time: 0.941714 Aug 31 16:10:25.926054 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2029/3866] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:24 2022] GET /compute/v2.1/servers/306160c1-762b-4b9e-aa09-3dd60f0c7ce3 => generated 1311 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:26.027937 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e2e0eb02-e6b5-49f2-993b-aecbf954470f tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5d33bcaf2846cb83e0cf83f8acdd94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb60bef197c84b18aa1bfb27172dcc83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:26.039532 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e2e0eb02-e6b5-49f2-993b-aecbf954470f tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] 10.222.0.50 "GET /compute/v2.1/servers/9844cf26-6118-4f36-8c4d-736062782c20" status: 200 len: 1268 microversion: 2.1 time: 0.291383 Aug 31 16:10:26.043497 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1838/3867] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:25 2022] GET /compute/v2.1/servers/9844cf26-6118-4f36-8c4d-736062782c20 => generated 1268 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:26.334661 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-06c175d1-cb89-4560-ae4c-bc2f23abb6f6 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1568385742", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "6e75e888-e14d-4362-99a8-79dffb5a2c05"}]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:26.422348 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-06c175d1-cb89-4560-ae4c-bc2f23abb6f6 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] validate_networks() for [('6e75e888-e14d-4362-99a8-79dffb5a2c05', None, None, None, None, None)] {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:10:26.736450 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9c256954-ae2e-4f56-ae45-fc6d45f603ad tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:26.743815 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9c256954-ae2e-4f56-ae45-fc6d45f603ad tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 2c93da9d-54d5-408f-85d4-768f397294b6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:26.769245 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c256954-ae2e-4f56-ae45-fc6d45f603ad tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:26.771103 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c256954-ae2e-4f56-ae45-fc6d45f603ad tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:26.772808 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c256954-ae2e-4f56-ae45-fc6d45f603ad tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:26.773740 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c256954-ae2e-4f56-ae45-fc6d45f603ad tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:26.776849 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c256954-ae2e-4f56-ae45-fc6d45f603ad tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:26.777501 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c256954-ae2e-4f56-ae45-fc6d45f603ad tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:27.309236 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9c256954-ae2e-4f56-ae45-fc6d45f603ad tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:27.319044 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9c256954-ae2e-4f56-ae45-fc6d45f603ad tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/2c93da9d-54d5-408f-85d4-768f397294b6" status: 200 len: 1293 microversion: 2.1 time: 0.587770 Aug 31 16:10:27.323358 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1839/3868] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:26 2022] GET /compute/v2.1/servers/2c93da9d-54d5-408f-85d4-768f397294b6 => generated 1293 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:10:27.338086 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9dffeade-11c4-47a5-a278-81ef2484ca4f tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:27.339326 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9dffeade-11c4-47a5-a278-81ef2484ca4f tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 306160c1-762b-4b9e-aa09-3dd60f0c7ce3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:27.353324 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9dffeade-11c4-47a5-a278-81ef2484ca4f tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:27.354400 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9dffeade-11c4-47a5-a278-81ef2484ca4f tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:27.355337 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9dffeade-11c4-47a5-a278-81ef2484ca4f tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:27.356255 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9dffeade-11c4-47a5-a278-81ef2484ca4f tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:27.356870 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9dffeade-11c4-47a5-a278-81ef2484ca4f tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:27.357437 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9dffeade-11c4-47a5-a278-81ef2484ca4f tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:27.573111 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:10:28.387748 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-06c175d1-cb89-4560-ae4c-bc2f23abb6f6 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:10:28.388638 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-06c175d1-cb89-4560-ae4c-bc2f23abb6f6 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:10:28.389256 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-06c175d1-cb89-4560-ae4c-bc2f23abb6f6 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:10:28.389843 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-06c175d1-cb89-4560-ae4c-bc2f23abb6f6 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:10:28.390606 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-06c175d1-cb89-4560-ae4c-bc2f23abb6f6 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:10:28.409525 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06c175d1-cb89-4560-ae4c-bc2f23abb6f6 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:28.410018 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06c175d1-cb89-4560-ae4c-bc2f23abb6f6 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:28.422871 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06c175d1-cb89-4560-ae4c-bc2f23abb6f6 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:28.436416 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06c175d1-cb89-4560-ae4c-bc2f23abb6f6 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:28.438614 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06c175d1-cb89-4560-ae4c-bc2f23abb6f6 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:28.481350 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06c175d1-cb89-4560-ae4c-bc2f23abb6f6 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.039s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:28.490050 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9dffeade-11c4-47a5-a278-81ef2484ca4f tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:28.499041 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=100 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:10:28.511743 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=52 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:10:28.513591 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-06c175d1-cb89-4560-ae4c-bc2f23abb6f6 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Getting quotas for project 0e180149a99546f6ba25e638e4b4218b. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:10:28.514465 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9dffeade-11c4-47a5-a278-81ef2484ca4f tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/306160c1-762b-4b9e-aa09-3dd60f0c7ce3" status: 200 len: 1460 microversion: 2.1 time: 1.189191 Aug 31 16:10:28.515569 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1840/3869] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:27 2022] GET /compute/v2.1/servers/306160c1-762b-4b9e-aa09-3dd60f0c7ce3 => generated 1460 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:28.528038 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-06c175d1-cb89-4560-ae4c-bc2f23abb6f6 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Getting quotas for user 1c4753a903d44ed89955218d54375bc9 and project 0e180149a99546f6ba25e638e4b4218b. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:10:28.537568 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bd9d8e27-fc2a-4c65-845f-71576adebf4f tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:28.538255 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bd9d8e27-fc2a-4c65-845f-71576adebf4f tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] [instance: 9844cf26-6118-4f36-8c4d-736062782c20] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:28.543596 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-06c175d1-cb89-4560-ae4c-bc2f23abb6f6 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:10:28.546202 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bd9d8e27-fc2a-4c65-845f-71576adebf4f tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:28.547309 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bd9d8e27-fc2a-4c65-845f-71576adebf4f tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:28.547948 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bd9d8e27-fc2a-4c65-845f-71576adebf4f tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:28.548854 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bd9d8e27-fc2a-4c65-845f-71576adebf4f tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:28.548977 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-06c175d1-cb89-4560-ae4c-bc2f23abb6f6 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: 5116a4af-d819-456a-b188-7dcf94b7b35c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:10:28.549610 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bd9d8e27-fc2a-4c65-845f-71576adebf4f tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:28.550491 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bd9d8e27-fc2a-4c65-845f-71576adebf4f tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:28.648720 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-06c175d1-cb89-4560-ae4c-bc2f23abb6f6 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.407449 Aug 31 16:10:28.651297 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2030/3870] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:10:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2411 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:10:28.667023 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-becd8108-19d6-4753-829a-509efa110bdb tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:28.671813 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-becd8108-19d6-4753-829a-509efa110bdb tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 2c93da9d-54d5-408f-85d4-768f397294b6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:28.707428 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-becd8108-19d6-4753-829a-509efa110bdb tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:28.708072 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-becd8108-19d6-4753-829a-509efa110bdb tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:28.709389 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-becd8108-19d6-4753-829a-509efa110bdb tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:28.710277 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-becd8108-19d6-4753-829a-509efa110bdb tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:28.710835 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-becd8108-19d6-4753-829a-509efa110bdb tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:28.711349 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-becd8108-19d6-4753-829a-509efa110bdb tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:28.769738 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bd9d8e27-fc2a-4c65-845f-71576adebf4f tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5d33bcaf2846cb83e0cf83f8acdd94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb60bef197c84b18aa1bfb27172dcc83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:28.783832 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bd9d8e27-fc2a-4c65-845f-71576adebf4f tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] 10.222.0.50 "GET /compute/v2.1/servers/9844cf26-6118-4f36-8c4d-736062782c20" status: 200 len: 1310 microversion: 2.1 time: 0.250551 Aug 31 16:10:28.784812 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1841/3871] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:28 2022] GET /compute/v2.1/servers/9844cf26-6118-4f36-8c4d-736062782c20 => generated 1310 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:28.810978 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e581ce6c-8d0a-4172-81b9-2ee172247935 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:28.812055 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e581ce6c-8d0a-4172-81b9-2ee172247935 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 5923807d-1058-45ab-b8d1-c6700ea8c142] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:28.827196 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e581ce6c-8d0a-4172-81b9-2ee172247935 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:28.829148 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e581ce6c-8d0a-4172-81b9-2ee172247935 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:28.829594 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e581ce6c-8d0a-4172-81b9-2ee172247935 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:28.832542 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e581ce6c-8d0a-4172-81b9-2ee172247935 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:28.833203 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e581ce6c-8d0a-4172-81b9-2ee172247935 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:28.833653 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e581ce6c-8d0a-4172-81b9-2ee172247935 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:29.194120 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e581ce6c-8d0a-4172-81b9-2ee172247935 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:29.212083 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e581ce6c-8d0a-4172-81b9-2ee172247935 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142" status: 200 len: 1314 microversion: 2.1 time: 0.416149 Aug 31 16:10:29.214185 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1842/3872] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:28 2022] GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142 => generated 1314 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:29.226478 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-becd8108-19d6-4753-829a-509efa110bdb tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:29.231188 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-becd8108-19d6-4753-829a-509efa110bdb tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/2c93da9d-54d5-408f-85d4-768f397294b6" status: 200 len: 1293 microversion: 2.1 time: 0.576803 Aug 31 16:10:29.246132 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2031/3873] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:28 2022] GET /compute/v2.1/servers/2c93da9d-54d5-408f-85d4-768f397294b6 => generated 1293 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:29.255318 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a14c7f69-f282-4aca-ab1d-3c62c0426e25 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:29.256016 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a14c7f69-f282-4aca-ab1d-3c62c0426e25 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: 5116a4af-d819-456a-b188-7dcf94b7b35c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:29.263785 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-554514b1-92e3-499b-a792-478ae8867be3 req-d852cdf4-1caa-44fc-bac2-e7e0baffa03b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5923807d-1058-45ab-b8d1-c6700ea8c142", "name": "network-vif-plugged", "status": "completed", "tag": "b92f4d7a-9fe1-49d2-9d35-67e9a518bfc4"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:29.305743 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-554514b1-92e3-499b-a792-478ae8867be3 req-d852cdf4-1caa-44fc-bac2-e7e0baffa03b service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:29.308574 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-554514b1-92e3-499b-a792-478ae8867be3 req-d852cdf4-1caa-44fc-bac2-e7e0baffa03b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:29.309119 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-554514b1-92e3-499b-a792-478ae8867be3 req-d852cdf4-1caa-44fc-bac2-e7e0baffa03b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:29.374913 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-554514b1-92e3-499b-a792-478ae8867be3 req-d852cdf4-1caa-44fc-bac2-e7e0baffa03b service nova] Creating event network-vif-plugged:b92f4d7a-9fe1-49d2-9d35-67e9a518bfc4 for instance 5923807d-1058-45ab-b8d1-c6700ea8c142 on n-h2-833090-16 Aug 31 16:10:29.401497 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-554514b1-92e3-499b-a792-478ae8867be3 req-d852cdf4-1caa-44fc-bac2-e7e0baffa03b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147231 Aug 31 16:10:29.403855 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2032/3874] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:10:29.447694 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a14c7f69-f282-4aca-ab1d-3c62c0426e25 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:29.459669 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a14c7f69-f282-4aca-ab1d-3c62c0426e25 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c" status: 200 len: 1218 microversion: 2.1 time: 0.219525 Aug 31 16:10:29.461938 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1843/3875] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:29 2022] GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c => generated 1218 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:29.817727 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d8092537-7ef9-4d39-8c4f-ac86ed5364cb tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:29.820480 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d8092537-7ef9-4d39-8c4f-ac86ed5364cb tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] [instance: 9844cf26-6118-4f36-8c4d-736062782c20] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:29.833682 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d8092537-7ef9-4d39-8c4f-ac86ed5364cb tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:29.849876 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d8092537-7ef9-4d39-8c4f-ac86ed5364cb tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:29.855179 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d8092537-7ef9-4d39-8c4f-ac86ed5364cb tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:29.856492 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d8092537-7ef9-4d39-8c4f-ac86ed5364cb tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:29.864311 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d8092537-7ef9-4d39-8c4f-ac86ed5364cb tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:29.868744 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d8092537-7ef9-4d39-8c4f-ac86ed5364cb tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:30.236541 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ba18c982-bca5-4cb2-aff4-5fe8d2851353 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:30.237656 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ba18c982-bca5-4cb2-aff4-5fe8d2851353 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 5923807d-1058-45ab-b8d1-c6700ea8c142] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:30.250963 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba18c982-bca5-4cb2-aff4-5fe8d2851353 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:30.252145 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba18c982-bca5-4cb2-aff4-5fe8d2851353 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:30.252600 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba18c982-bca5-4cb2-aff4-5fe8d2851353 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:30.258689 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba18c982-bca5-4cb2-aff4-5fe8d2851353 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:30.267026 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba18c982-bca5-4cb2-aff4-5fe8d2851353 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:30.267509 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba18c982-bca5-4cb2-aff4-5fe8d2851353 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:30.517257 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d8092537-7ef9-4d39-8c4f-ac86ed5364cb tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5d33bcaf2846cb83e0cf83f8acdd94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb60bef197c84b18aa1bfb27172dcc83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:30.535573 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d8092537-7ef9-4d39-8c4f-ac86ed5364cb tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] 10.222.0.50 "GET /compute/v2.1/servers/9844cf26-6118-4f36-8c4d-736062782c20" status: 200 len: 1310 microversion: 2.1 time: 0.721100 Aug 31 16:10:30.536904 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2033/3876] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:29 2022] GET /compute/v2.1/servers/9844cf26-6118-4f36-8c4d-736062782c20 => generated 1310 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:30.565072 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a8670598-d6a4-4f6d-80e7-f0fdc7a2d750 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:30.569399 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a8670598-d6a4-4f6d-80e7-f0fdc7a2d750 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 2c93da9d-54d5-408f-85d4-768f397294b6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:30.586998 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a8670598-d6a4-4f6d-80e7-f0fdc7a2d750 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:30.591363 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a8670598-d6a4-4f6d-80e7-f0fdc7a2d750 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:30.591363 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a8670598-d6a4-4f6d-80e7-f0fdc7a2d750 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:30.591363 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a8670598-d6a4-4f6d-80e7-f0fdc7a2d750 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:30.591363 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a8670598-d6a4-4f6d-80e7-f0fdc7a2d750 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:30.591363 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a8670598-d6a4-4f6d-80e7-f0fdc7a2d750 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:30.975875 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ba18c982-bca5-4cb2-aff4-5fe8d2851353 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:30.994446 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ba18c982-bca5-4cb2-aff4-5fe8d2851353 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142" status: 200 len: 1314 microversion: 2.1 time: 0.760846 Aug 31 16:10:31.019348 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1844/3877] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:30 2022] GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142 => generated 1314 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:31.041181 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-2253593f-851e-42e8-8529-0f56e9ef624c req-1c42f8d9-9c69-4bda-97e5-3713c04030a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9844cf26-6118-4f36-8c4d-736062782c20", "tag": "4fe3a23e-879c-41bd-9f25-3777d5ae0406"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:31.056879 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2253593f-851e-42e8-8529-0f56e9ef624c req-1c42f8d9-9c69-4bda-97e5-3713c04030a4 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:31.057803 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2253593f-851e-42e8-8529-0f56e9ef624c req-1c42f8d9-9c69-4bda-97e5-3713c04030a4 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:31.058435 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2253593f-851e-42e8-8529-0f56e9ef624c req-1c42f8d9-9c69-4bda-97e5-3713c04030a4 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:31.130434 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-2253593f-851e-42e8-8529-0f56e9ef624c req-1c42f8d9-9c69-4bda-97e5-3713c04030a4 service nova] Creating event network-changed:4fe3a23e-879c-41bd-9f25-3777d5ae0406 for instance 9844cf26-6118-4f36-8c4d-736062782c20 on n-h2-833090-16 Aug 31 16:10:31.143313 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-2253593f-851e-42e8-8529-0f56e9ef624c req-1c42f8d9-9c69-4bda-97e5-3713c04030a4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116276 Aug 31 16:10:31.143991 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1845/3878] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:10:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:10:31.158129 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-df4a48f2-a55b-45ff-b15d-e0312d215c70 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:31.159107 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-df4a48f2-a55b-45ff-b15d-e0312d215c70 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: 5116a4af-d819-456a-b188-7dcf94b7b35c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:31.175108 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df4a48f2-a55b-45ff-b15d-e0312d215c70 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:31.177274 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df4a48f2-a55b-45ff-b15d-e0312d215c70 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:31.179189 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df4a48f2-a55b-45ff-b15d-e0312d215c70 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:31.182665 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df4a48f2-a55b-45ff-b15d-e0312d215c70 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:31.184870 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df4a48f2-a55b-45ff-b15d-e0312d215c70 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:31.189303 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df4a48f2-a55b-45ff-b15d-e0312d215c70 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:31.240238 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a8670598-d6a4-4f6d-80e7-f0fdc7a2d750 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:31.260934 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a8670598-d6a4-4f6d-80e7-f0fdc7a2d750 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/2c93da9d-54d5-408f-85d4-768f397294b6" status: 200 len: 1293 microversion: 2.1 time: 0.720201 Aug 31 16:10:31.265881 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2034/3879] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:30 2022] GET /compute/v2.1/servers/2c93da9d-54d5-408f-85d4-768f397294b6 => generated 1293 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:31.481344 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-df4a48f2-a55b-45ff-b15d-e0312d215c70 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:31.512293 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-df4a48f2-a55b-45ff-b15d-e0312d215c70 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c" status: 200 len: 1278 microversion: 2.1 time: 0.361331 Aug 31 16:10:31.514707 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1846/3880] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:31 2022] GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c => generated 1278 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:31.525083 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-83bafb66-0b8d-407f-a752-266cedc1f409 req-687a81ed-e44a-4535-8bc7-e51b638d21b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c93da9d-54d5-408f-85d4-768f397294b6", "name": "network-vif-plugged", "status": "completed", "tag": "7c6332dc-5d4c-478e-93c8-9fa795380cdd"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:31.565775 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fde9753c-07b4-4cee-b8cf-4a7ebc550148 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:31.566642 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fde9753c-07b4-4cee-b8cf-4a7ebc550148 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] [instance: 9844cf26-6118-4f36-8c4d-736062782c20] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:31.574580 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-83bafb66-0b8d-407f-a752-266cedc1f409 req-687a81ed-e44a-4535-8bc7-e51b638d21b9 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:31.576547 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-83bafb66-0b8d-407f-a752-266cedc1f409 req-687a81ed-e44a-4535-8bc7-e51b638d21b9 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:31.581213 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-83bafb66-0b8d-407f-a752-266cedc1f409 req-687a81ed-e44a-4535-8bc7-e51b638d21b9 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:31.594699 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fde9753c-07b4-4cee-b8cf-4a7ebc550148 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:31.597433 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fde9753c-07b4-4cee-b8cf-4a7ebc550148 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:31.599292 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fde9753c-07b4-4cee-b8cf-4a7ebc550148 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:31.602558 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fde9753c-07b4-4cee-b8cf-4a7ebc550148 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:31.611914 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fde9753c-07b4-4cee-b8cf-4a7ebc550148 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:31.615411 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fde9753c-07b4-4cee-b8cf-4a7ebc550148 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:31.652844 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-83bafb66-0b8d-407f-a752-266cedc1f409 req-687a81ed-e44a-4535-8bc7-e51b638d21b9 service nova] Creating event network-vif-plugged:7c6332dc-5d4c-478e-93c8-9fa795380cdd for instance 2c93da9d-54d5-408f-85d4-768f397294b6 on n-h2-833090-16 Aug 31 16:10:31.668762 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-83bafb66-0b8d-407f-a752-266cedc1f409 req-687a81ed-e44a-4535-8bc7-e51b638d21b9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155478 Aug 31 16:10:31.672242 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2035/3881] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:10:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:10:32.040439 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-df7ed2a3-84ff-4938-a9cd-da6ea1c4c467 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:32.048928 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-df7ed2a3-84ff-4938-a9cd-da6ea1c4c467 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 5923807d-1058-45ab-b8d1-c6700ea8c142] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:32.119842 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-df7ed2a3-84ff-4938-a9cd-da6ea1c4c467 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:32.120606 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-df7ed2a3-84ff-4938-a9cd-da6ea1c4c467 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:32.121235 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-df7ed2a3-84ff-4938-a9cd-da6ea1c4c467 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:32.123730 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-df7ed2a3-84ff-4938-a9cd-da6ea1c4c467 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:32.125070 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-df7ed2a3-84ff-4938-a9cd-da6ea1c4c467 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:32.126784 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-df7ed2a3-84ff-4938-a9cd-da6ea1c4c467 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:32.587457 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fde9753c-07b4-4cee-b8cf-4a7ebc550148 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5d33bcaf2846cb83e0cf83f8acdd94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb60bef197c84b18aa1bfb27172dcc83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:32.605888 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fde9753c-07b4-4cee-b8cf-4a7ebc550148 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] 10.222.0.50 "GET /compute/v2.1/servers/9844cf26-6118-4f36-8c4d-736062782c20" status: 200 len: 1310 microversion: 2.1 time: 1.048934 Aug 31 16:10:32.609292 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1847/3882] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:31 2022] GET /compute/v2.1/servers/9844cf26-6118-4f36-8c4d-736062782c20 => generated 1310 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:32.620191 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e9c6a4db-ee29-4d03-b844-01f2374084a9 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:32.621250 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e9c6a4db-ee29-4d03-b844-01f2374084a9 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 2c93da9d-54d5-408f-85d4-768f397294b6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:32.641715 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9c6a4db-ee29-4d03-b844-01f2374084a9 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:32.642732 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9c6a4db-ee29-4d03-b844-01f2374084a9 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:32.644066 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9c6a4db-ee29-4d03-b844-01f2374084a9 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:32.644998 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9c6a4db-ee29-4d03-b844-01f2374084a9 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:32.645655 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9c6a4db-ee29-4d03-b844-01f2374084a9 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:32.646312 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9c6a4db-ee29-4d03-b844-01f2374084a9 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:32.920670 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-df7ed2a3-84ff-4938-a9cd-da6ea1c4c467 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:32.933752 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-df7ed2a3-84ff-4938-a9cd-da6ea1c4c467 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142" status: 200 len: 1464 microversion: 2.1 time: 0.915061 Aug 31 16:10:32.934709 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2036/3883] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:32 2022] GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142 => generated 1464 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:32.954417 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-32756bfe-5866-4e46-8b3b-96bb08ebec7f tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:32.955358 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-32756bfe-5866-4e46-8b3b-96bb08ebec7f tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: 5116a4af-d819-456a-b188-7dcf94b7b35c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:32.969618 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-32756bfe-5866-4e46-8b3b-96bb08ebec7f tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:32.970397 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-32756bfe-5866-4e46-8b3b-96bb08ebec7f tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:32.972577 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-32756bfe-5866-4e46-8b3b-96bb08ebec7f tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:32.973665 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-32756bfe-5866-4e46-8b3b-96bb08ebec7f tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:32.975328 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-32756bfe-5866-4e46-8b3b-96bb08ebec7f tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:32.977798 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-32756bfe-5866-4e46-8b3b-96bb08ebec7f tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:33.280455 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-32756bfe-5866-4e46-8b3b-96bb08ebec7f tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:33.290087 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e9c6a4db-ee29-4d03-b844-01f2374084a9 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:33.306683 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e9c6a4db-ee29-4d03-b844-01f2374084a9 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/2c93da9d-54d5-408f-85d4-768f397294b6" status: 200 len: 1293 microversion: 2.1 time: 0.694988 Aug 31 16:10:33.309944 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-32756bfe-5866-4e46-8b3b-96bb08ebec7f tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c" status: 200 len: 1276 microversion: 2.1 time: 0.370460 Aug 31 16:10:33.311593 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1848/3884] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:32 2022] GET /compute/v2.1/servers/2c93da9d-54d5-408f-85d4-768f397294b6 => generated 1293 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:33.312342 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2037/3885] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:32 2022] GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c => generated 1276 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:33.341517 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-742a17c2-e95f-42a7-867c-6db683a7e7bf tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1322831235", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "5923807d-1058-45ab-b8d1-c6700ea8c142"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:33.452077 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-742a17c2-e95f-42a7-867c-6db683a7e7bf tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] validate_networks() for None {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:10:33.635849 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c1d1fec4-67e2-4d9d-9c40-3ffa47cb5c8c tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:33.637207 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c1d1fec4-67e2-4d9d-9c40-3ffa47cb5c8c tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] [instance: 9844cf26-6118-4f36-8c4d-736062782c20] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:33.648017 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c1d1fec4-67e2-4d9d-9c40-3ffa47cb5c8c tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:33.648698 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c1d1fec4-67e2-4d9d-9c40-3ffa47cb5c8c tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:33.649557 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c1d1fec4-67e2-4d9d-9c40-3ffa47cb5c8c tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:33.652056 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c1d1fec4-67e2-4d9d-9c40-3ffa47cb5c8c tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:33.652961 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c1d1fec4-67e2-4d9d-9c40-3ffa47cb5c8c tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:33.653557 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c1d1fec4-67e2-4d9d-9c40-3ffa47cb5c8c tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:34.860057 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c1d1fec4-67e2-4d9d-9c40-3ffa47cb5c8c tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5d33bcaf2846cb83e0cf83f8acdd94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb60bef197c84b18aa1bfb27172dcc83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:34.873487 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c1d1fec4-67e2-4d9d-9c40-3ffa47cb5c8c tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] 10.222.0.50 "GET /compute/v2.1/servers/9844cf26-6118-4f36-8c4d-736062782c20" status: 200 len: 1310 microversion: 2.1 time: 1.244469 Aug 31 16:10:34.875206 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2038/3886] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:33 2022] GET /compute/v2.1/servers/9844cf26-6118-4f36-8c4d-736062782c20 => generated 1310 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:10:34.971891 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-742a17c2-e95f-42a7-867c-6db683a7e7bf tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:10:34.973162 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-742a17c2-e95f-42a7-867c-6db683a7e7bf tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:10:34.973657 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-742a17c2-e95f-42a7-867c-6db683a7e7bf tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:10:34.974078 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-742a17c2-e95f-42a7-867c-6db683a7e7bf tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:10:34.975696 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-742a17c2-e95f-42a7-867c-6db683a7e7bf tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:10:35.001729 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-742a17c2-e95f-42a7-867c-6db683a7e7bf tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:35.002285 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-742a17c2-e95f-42a7-867c-6db683a7e7bf tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:35.002756 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-742a17c2-e95f-42a7-867c-6db683a7e7bf tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:35.003686 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-742a17c2-e95f-42a7-867c-6db683a7e7bf tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:35.004259 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-742a17c2-e95f-42a7-867c-6db683a7e7bf tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:35.011817 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-742a17c2-e95f-42a7-867c-6db683a7e7bf tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:35.038366 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-742a17c2-e95f-42a7-867c-6db683a7e7bf tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Getting quotas for project 2a9210acd39546b4b6fba9cda27a0aed. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:10:35.047927 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-742a17c2-e95f-42a7-867c-6db683a7e7bf tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Getting quotas for user 4669ae0dec2c4ad8be74acd9ebf4d80a and project 2a9210acd39546b4b6fba9cda27a0aed. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:10:35.067287 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-742a17c2-e95f-42a7-867c-6db683a7e7bf tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:10:35.071907 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-742a17c2-e95f-42a7-867c-6db683a7e7bf tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 817afb89-f414-4d1d-bc89-5357dd4e1cb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:10:35.126858 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-14214f6e-adc4-4ae8-93fe-3ee797bc3ef4 tempest-MultipleCreateNegativeTestJSON-1020485589 tempest-MultipleCreateNegativeTestJSON-1020485589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1005892200", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:35.133741 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-14214f6e-adc4-4ae8-93fe-3ee797bc3ef4 tempest-MultipleCreateNegativeTestJSON-1020485589 tempest-MultipleCreateNegativeTestJSON-1020485589-project] HTTP exception thrown: min_count must be <= max_count Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-14214f6e-adc4-4ae8-93fe-3ee797bc3ef4 tempest-MultipleCreateNegativeTestJSON-1020485589 tempest-MultipleCreateNegativeTestJSON-1020485589-project] Request method failure captured: Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 184 Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4f63BiZgiID_RxLigSFFhHzwYqf2aM4fb69ZffguR7MQj2fkQX9hdPaKlk0SnRaUcOS9Qe5bW55ATlAoPMPX1x4FwgLQVCjYhV0kxa1YmbdNCVJUBttAcQYkcccemPO2iNo0Am3J1KRxJpKrSvx6tgN1ZYtGmqQgePTDGyWpJ9bfsk Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: b0442fc5daf9408682daa1dec34f6b04 Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1020485589 Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b0442fc5daf9408682daa1dec34f6b04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b0442fc5daf9408682daa1dec34f6b04"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b0442fc5daf9408682daa1dec34f6b04"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b0442fc5daf9408682daa1dec34f6b04", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1020485589 Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: b0442fc5daf9408682daa1dec34f6b04 Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1020485589 Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-MultipleCreateNegativeTestJSON-1020485589-project Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: a26c27409e3640978345226b00825be4 Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1020485589-project Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1005892200", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "min_count": 3, "max_count": 2}} Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: exception: min_count must be <= max_count Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1005892200', 'imageRef': 'd715a41c-0e56-494a-a102-cac65831f6bd', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Aug 31 16:10:35.136550 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:10:35.151669 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-742a17c2-e95f-42a7-867c-6db683a7e7bf tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.828726 Aug 31 16:10:35.155877 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-14214f6e-adc4-4ae8-93fe-3ee797bc3ef4 tempest-MultipleCreateNegativeTestJSON-1020485589 tempest-MultipleCreateNegativeTestJSON-1020485589-project] Returning 400 to user: min_count must be <= max_count {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:10:35.156938 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-14214f6e-adc4-4ae8-93fe-3ee797bc3ef4 tempest-MultipleCreateNegativeTestJSON-1020485589 tempest-MultipleCreateNegativeTestJSON-1020485589-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.280406 Aug 31 16:10:35.157561 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2039/3887] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:10:34 2022] POST /compute/v2.1/servers => generated 74 bytes in 282 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 31 16:10:35.168807 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1849/3888] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:10:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1856 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:10:35.181139 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5b3d1cda-2db6-433f-9dc9-096f7d448730 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:35.181790 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5b3d1cda-2db6-433f-9dc9-096f7d448730 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: 5116a4af-d819-456a-b188-7dcf94b7b35c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:35.195523 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e547fe85-d809-42f4-8b1a-3f6c469b1cd9 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:35.196418 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e547fe85-d809-42f4-8b1a-3f6c469b1cd9 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 2c93da9d-54d5-408f-85d4-768f397294b6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:35.203058 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b3d1cda-2db6-433f-9dc9-096f7d448730 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:35.203593 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b3d1cda-2db6-433f-9dc9-096f7d448730 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:35.204177 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b3d1cda-2db6-433f-9dc9-096f7d448730 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:35.205230 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b3d1cda-2db6-433f-9dc9-096f7d448730 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:35.205740 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b3d1cda-2db6-433f-9dc9-096f7d448730 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:35.214789 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b3d1cda-2db6-433f-9dc9-096f7d448730 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:35.246446 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e547fe85-d809-42f4-8b1a-3f6c469b1cd9 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:35.249017 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e547fe85-d809-42f4-8b1a-3f6c469b1cd9 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:35.251217 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e547fe85-d809-42f4-8b1a-3f6c469b1cd9 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:35.253528 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e547fe85-d809-42f4-8b1a-3f6c469b1cd9 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:35.256355 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e547fe85-d809-42f4-8b1a-3f6c469b1cd9 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:35.259921 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e547fe85-d809-42f4-8b1a-3f6c469b1cd9 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:36.977072 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e547fe85-d809-42f4-8b1a-3f6c469b1cd9 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:36.993196 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e547fe85-d809-42f4-8b1a-3f6c469b1cd9 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/2c93da9d-54d5-408f-85d4-768f397294b6" status: 200 len: 1293 microversion: 2.1 time: 1.834514 Aug 31 16:10:36.993798 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2040/3889] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:35 2022] GET /compute/v2.1/servers/2c93da9d-54d5-408f-85d4-768f397294b6 => generated 1293 bytes in 1836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:37.012028 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a9679d02-8825-449e-8f2c-b5f0fbaf708f tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:37.020333 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a9679d02-8825-449e-8f2c-b5f0fbaf708f tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 817afb89-f414-4d1d-bc89-5357dd4e1cb8] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:37.032686 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5b3d1cda-2db6-433f-9dc9-096f7d448730 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:37.037130 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a9679d02-8825-449e-8f2c-b5f0fbaf708f tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:37.037851 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a9679d02-8825-449e-8f2c-b5f0fbaf708f tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:37.038475 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a9679d02-8825-449e-8f2c-b5f0fbaf708f tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:37.039470 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a9679d02-8825-449e-8f2c-b5f0fbaf708f tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:37.040084 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a9679d02-8825-449e-8f2c-b5f0fbaf708f tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:37.040685 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a9679d02-8825-449e-8f2c-b5f0fbaf708f tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:37.064866 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5b3d1cda-2db6-433f-9dc9-096f7d448730 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c" status: 200 len: 1318 microversion: 2.1 time: 1.894567 Aug 31 16:10:37.066534 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1850/3890] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:35 2022] GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c => generated 1318 bytes in 1897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:37.099161 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-61632939-0b32-482a-9be3-4ecc6679bf3d tempest-MultipleCreateNegativeTestJSON-1020485589 tempest-MultipleCreateNegativeTestJSON-1020485589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-481087542", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "max_count": 0}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-61632939-0b32-482a-9be3-4ecc6679bf3d tempest-MultipleCreateNegativeTestJSON-1020485589 tempest-MultipleCreateNegativeTestJSON-1020485589-project] Request method failure captured: Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 167 Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4f63BiZgiID_RxLigSFFhHzwYqf2aM4fb69ZffguR7MQj2fkQX9hdPaKlk0SnRaUcOS9Qe5bW55ATlAoPMPX1x4FwgLQVCjYhV0kxa1YmbdNCVJUBttAcQYkcccemPO2iNo0Am3J1KRxJpKrSvx6tgN1ZYtGmqQgePTDGyWpJ9bfsk Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: b0442fc5daf9408682daa1dec34f6b04 Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1020485589 Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b0442fc5daf9408682daa1dec34f6b04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b0442fc5daf9408682daa1dec34f6b04"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b0442fc5daf9408682daa1dec34f6b04"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b0442fc5daf9408682daa1dec34f6b04", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1020485589 Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: b0442fc5daf9408682daa1dec34f6b04 Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1020485589 Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-MultipleCreateNegativeTestJSON-1020485589-project Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: a26c27409e3640978345226b00825be4 Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1020485589-project Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-481087542", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "max_count": 0}} Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-481087542', 'imageRef': 'd715a41c-0e56-494a-a102-cac65831f6bd', 'flavorRef': '452', 'max_count': 0}}} Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 0 Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 16:10:37.104746 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 16:10:37.112318 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:10:37.112318 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:10:37.112318 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:10:37.112318 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:10:37.112318 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 31 16:10:37.112318 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:10:37.112318 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:37.112318 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:10:37.112318 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:37.112318 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:37.112318 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:37.112318 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:10:37.112318 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:10:37.112318 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 31 16:10:37.112318 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:10:37.115818 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-61632939-0b32-482a-9be3-4ecc6679bf3d tempest-MultipleCreateNegativeTestJSON-1020485589 tempest-MultipleCreateNegativeTestJSON-1020485589-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:10:37.118913 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-61632939-0b32-482a-9be3-4ecc6679bf3d tempest-MultipleCreateNegativeTestJSON-1020485589 tempest-MultipleCreateNegativeTestJSON-1020485589-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.028470 Aug 31 16:10:37.120223 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1851/3891] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:10:37 2022] POST /compute/v2.1/servers => generated 130 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:10:37.139997 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0049fc32-a335-4709-b439-d5907d0c3a2c tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:37.140849 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0049fc32-a335-4709-b439-d5907d0c3a2c tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] [instance: 9844cf26-6118-4f36-8c4d-736062782c20] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:37.151881 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0049fc32-a335-4709-b439-d5907d0c3a2c tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:37.152390 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0049fc32-a335-4709-b439-d5907d0c3a2c tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:37.153929 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0049fc32-a335-4709-b439-d5907d0c3a2c tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:37.155434 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0049fc32-a335-4709-b439-d5907d0c3a2c tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:37.155927 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0049fc32-a335-4709-b439-d5907d0c3a2c tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:37.157120 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0049fc32-a335-4709-b439-d5907d0c3a2c tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:37.295700 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a9679d02-8825-449e-8f2c-b5f0fbaf708f tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:37.306140 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a9679d02-8825-449e-8f2c-b5f0fbaf708f tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/817afb89-f414-4d1d-bc89-5357dd4e1cb8" status: 200 len: 1266 microversion: 2.1 time: 0.298431 Aug 31 16:10:37.307216 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2041/3892] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:36 2022] GET /compute/v2.1/servers/817afb89-f414-4d1d-bc89-5357dd4e1cb8 => generated 1266 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:37.324197 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5e1bf1ca-51d9-4eea-a3b4-7339635119f7 tempest-MultipleCreateNegativeTestJSON-1020485589 tempest-MultipleCreateNegativeTestJSON-1020485589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1667751141", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "max_count": 2.5}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5e1bf1ca-51d9-4eea-a3b4-7339635119f7 tempest-MultipleCreateNegativeTestJSON-1020485589 tempest-MultipleCreateNegativeTestJSON-1020485589-project] Request method failure captured: Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 170 Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4f63BiZgiID_RxLigSFFhHzwYqf2aM4fb69ZffguR7MQj2fkQX9hdPaKlk0SnRaUcOS9Qe5bW55ATlAoPMPX1x4FwgLQVCjYhV0kxa1YmbdNCVJUBttAcQYkcccemPO2iNo0Am3J1KRxJpKrSvx6tgN1ZYtGmqQgePTDGyWpJ9bfsk Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: b0442fc5daf9408682daa1dec34f6b04 Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1020485589 Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b0442fc5daf9408682daa1dec34f6b04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b0442fc5daf9408682daa1dec34f6b04"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b0442fc5daf9408682daa1dec34f6b04"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b0442fc5daf9408682daa1dec34f6b04", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1020485589 Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: b0442fc5daf9408682daa1dec34f6b04 Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1020485589 Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-MultipleCreateNegativeTestJSON-1020485589-project Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: a26c27409e3640978345226b00825be4 Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1020485589-project Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1667751141", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "max_count": 2.5}} Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1667751141', 'imageRef': 'd715a41c-0e56-494a-a102-cac65831f6bd', 'flavorRef': '452', 'max_count': 2.5}}} Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi 2.5 Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 16:10:37.333023 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 16:10:37.342755 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:10:37.342755 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:10:37.342755 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:10:37.342755 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:10:37.342755 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 31 16:10:37.342755 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:10:37.342755 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:37.342755 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:10:37.342755 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:37.342755 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:37.342755 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:37.342755 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:10:37.342755 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:10:37.342755 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 31 16:10:37.342755 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:10:37.342755 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5e1bf1ca-51d9-4eea-a3b4-7339635119f7 tempest-MultipleCreateNegativeTestJSON-1020485589 tempest-MultipleCreateNegativeTestJSON-1020485589-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:10:37.342755 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5e1bf1ca-51d9-4eea-a3b4-7339635119f7 tempest-MultipleCreateNegativeTestJSON-1020485589 tempest-MultipleCreateNegativeTestJSON-1020485589-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.024603 Aug 31 16:10:37.348014 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2042/3893] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:10:37 2022] POST /compute/v2.1/servers => generated 139 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:10:37.416501 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1f135fa6-8770-48ce-a4bc-976d15df1049 tempest-MultipleCreateNegativeTestJSON-1020485589 tempest-MultipleCreateNegativeTestJSON-1020485589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1796539645", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "min_count": 0}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1f135fa6-8770-48ce-a4bc-976d15df1049 tempest-MultipleCreateNegativeTestJSON-1020485589 tempest-MultipleCreateNegativeTestJSON-1020485589-project] Request method failure captured: Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 168 Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4f63BiZgiID_RxLigSFFhHzwYqf2aM4fb69ZffguR7MQj2fkQX9hdPaKlk0SnRaUcOS9Qe5bW55ATlAoPMPX1x4FwgLQVCjYhV0kxa1YmbdNCVJUBttAcQYkcccemPO2iNo0Am3J1KRxJpKrSvx6tgN1ZYtGmqQgePTDGyWpJ9bfsk Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: b0442fc5daf9408682daa1dec34f6b04 Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1020485589 Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b0442fc5daf9408682daa1dec34f6b04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b0442fc5daf9408682daa1dec34f6b04"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b0442fc5daf9408682daa1dec34f6b04"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b0442fc5daf9408682daa1dec34f6b04", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1020485589 Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: b0442fc5daf9408682daa1dec34f6b04 Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1020485589 Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-MultipleCreateNegativeTestJSON-1020485589-project Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: a26c27409e3640978345226b00825be4 Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1020485589-project Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1796539645", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "min_count": 0}} Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1796539645', 'imageRef': 'd715a41c-0e56-494a-a102-cac65831f6bd', 'flavorRef': '452', 'min_count': 0}}} Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi 0 Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 16:10:37.420558 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 16:10:37.428624 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:10:37.428624 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:10:37.428624 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:10:37.428624 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:10:37.428624 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 31 16:10:37.428624 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:10:37.428624 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:37.428624 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:10:37.428624 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:37.428624 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:37.428624 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:37.428624 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:10:37.428624 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:10:37.428624 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 31 16:10:37.428624 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:10:37.428624 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1f135fa6-8770-48ce-a4bc-976d15df1049 tempest-MultipleCreateNegativeTestJSON-1020485589 tempest-MultipleCreateNegativeTestJSON-1020485589-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:10:37.428624 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1f135fa6-8770-48ce-a4bc-976d15df1049 tempest-MultipleCreateNegativeTestJSON-1020485589 tempest-MultipleCreateNegativeTestJSON-1020485589-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.009483 Aug 31 16:10:37.433048 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2043/3894] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:10:37 2022] POST /compute/v2.1/servers => generated 130 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:10:37.518792 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9de8faf8-bfad-499f-a2a4-5442431fc92b tempest-MultipleCreateNegativeTestJSON-1020485589 tempest-MultipleCreateNegativeTestJSON-1020485589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-597408724", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "min_count": 2.5}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9de8faf8-bfad-499f-a2a4-5442431fc92b tempest-MultipleCreateNegativeTestJSON-1020485589 tempest-MultipleCreateNegativeTestJSON-1020485589-project] Request method failure captured: Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 169 Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4f63BiZgiID_RxLigSFFhHzwYqf2aM4fb69ZffguR7MQj2fkQX9hdPaKlk0SnRaUcOS9Qe5bW55ATlAoPMPX1x4FwgLQVCjYhV0kxa1YmbdNCVJUBttAcQYkcccemPO2iNo0Am3J1KRxJpKrSvx6tgN1ZYtGmqQgePTDGyWpJ9bfsk Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: b0442fc5daf9408682daa1dec34f6b04 Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1020485589 Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b0442fc5daf9408682daa1dec34f6b04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b0442fc5daf9408682daa1dec34f6b04"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b0442fc5daf9408682daa1dec34f6b04"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b0442fc5daf9408682daa1dec34f6b04", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1020485589 Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: b0442fc5daf9408682daa1dec34f6b04 Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1020485589 Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-MultipleCreateNegativeTestJSON-1020485589-project Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: a26c27409e3640978345226b00825be4 Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1020485589-project Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-597408724", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "min_count": 2.5}} Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-597408724', 'imageRef': 'd715a41c-0e56-494a-a102-cac65831f6bd', 'flavorRef': '452', 'min_count': 2.5}}} Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi 2.5 Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 16:10:37.525159 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 16:10:37.532526 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:10:37.532526 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:10:37.532526 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:10:37.532526 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:10:37.532526 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 31 16:10:37.532526 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:10:37.532526 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:37.532526 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:10:37.532526 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:37.532526 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:37.532526 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:37.532526 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:10:37.532526 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:10:37.532526 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 31 16:10:37.532526 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:10:37.539716 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9de8faf8-bfad-499f-a2a4-5442431fc92b tempest-MultipleCreateNegativeTestJSON-1020485589 tempest-MultipleCreateNegativeTestJSON-1020485589-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:10:37.554783 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9de8faf8-bfad-499f-a2a4-5442431fc92b tempest-MultipleCreateNegativeTestJSON-1020485589 tempest-MultipleCreateNegativeTestJSON-1020485589-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.030934 Aug 31 16:10:37.560184 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2044/3895] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:10:37 2022] POST /compute/v2.1/servers => generated 139 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:10:37.705558 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0049fc32-a335-4709-b439-d5907d0c3a2c tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5d33bcaf2846cb83e0cf83f8acdd94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb60bef197c84b18aa1bfb27172dcc83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:37.746406 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0049fc32-a335-4709-b439-d5907d0c3a2c tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] 10.222.0.50 "GET /compute/v2.1/servers/9844cf26-6118-4f36-8c4d-736062782c20" status: 200 len: 1310 microversion: 2.1 time: 0.611792 Aug 31 16:10:37.747329 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1852/3896] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:37 2022] GET /compute/v2.1/servers/9844cf26-6118-4f36-8c4d-736062782c20 => generated 1310 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:37.849861 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-db9d4798-8587-417b-912f-17c2d95650d0 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1595307659", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "27fa1d8f-21c3-43c9-9a49-c254e9a2d007"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1055623987", "security_groups": [{"name": "tempest-secgroup-smoke-24343255"}]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:37.905740 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:10:38.020705 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9fe8f6b3-a122-4f75-bc61-20844c429d3f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:38.021321 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9fe8f6b3-a122-4f75-bc61-20844c429d3f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 2c93da9d-54d5-408f-85d4-768f397294b6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:38.032672 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9fe8f6b3-a122-4f75-bc61-20844c429d3f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:38.033396 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9fe8f6b3-a122-4f75-bc61-20844c429d3f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:38.035634 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9fe8f6b3-a122-4f75-bc61-20844c429d3f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:38.036540 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9fe8f6b3-a122-4f75-bc61-20844c429d3f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:38.037698 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9fe8f6b3-a122-4f75-bc61-20844c429d3f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:38.039075 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9fe8f6b3-a122-4f75-bc61-20844c429d3f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:38.099785 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:10:38.337656 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-db9d4798-8587-417b-912f-17c2d95650d0 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] validate_networks() for [('27fa1d8f-21c3-43c9-9a49-c254e9a2d007', None, None, None, None, None)] {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:10:38.500217 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:10:38.529203 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=6 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:10:38.569189 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9fe8f6b3-a122-4f75-bc61-20844c429d3f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:38.635474 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9fe8f6b3-a122-4f75-bc61-20844c429d3f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/2c93da9d-54d5-408f-85d4-768f397294b6" status: 200 len: 1475 microversion: 2.1 time: 0.617345 Aug 31 16:10:38.637160 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1853/3897] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:38 2022] GET /compute/v2.1/servers/2c93da9d-54d5-408f-85d4-768f397294b6 => generated 1475 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:38.651985 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-336ef99a-cd6e-4fe0-84f5-9cacd39cd0e3 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:38.652949 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-336ef99a-cd6e-4fe0-84f5-9cacd39cd0e3 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: 5116a4af-d819-456a-b188-7dcf94b7b35c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:38.665903 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-336ef99a-cd6e-4fe0-84f5-9cacd39cd0e3 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:38.668150 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-336ef99a-cd6e-4fe0-84f5-9cacd39cd0e3 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:38.669077 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-336ef99a-cd6e-4fe0-84f5-9cacd39cd0e3 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:38.674234 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-336ef99a-cd6e-4fe0-84f5-9cacd39cd0e3 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:38.675375 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-336ef99a-cd6e-4fe0-84f5-9cacd39cd0e3 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:38.678307 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-336ef99a-cd6e-4fe0-84f5-9cacd39cd0e3 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:39.269942 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-336ef99a-cd6e-4fe0-84f5-9cacd39cd0e3 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:39.295253 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-336ef99a-cd6e-4fe0-84f5-9cacd39cd0e3 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c" status: 200 len: 1318 microversion: 2.1 time: 0.656375 Aug 31 16:10:39.299397 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1854/3898] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:38 2022] GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c => generated 1318 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:39.315598 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f64f9478-59be-4b15-b22e-da544f60fb33 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:39.317642 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f64f9478-59be-4b15-b22e-da544f60fb33 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 817afb89-f414-4d1d-bc89-5357dd4e1cb8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:39.331615 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f64f9478-59be-4b15-b22e-da544f60fb33 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:39.342471 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f64f9478-59be-4b15-b22e-da544f60fb33 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:39.343804 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f64f9478-59be-4b15-b22e-da544f60fb33 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:39.344210 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f64f9478-59be-4b15-b22e-da544f60fb33 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:39.344757 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f64f9478-59be-4b15-b22e-da544f60fb33 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:39.345225 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f64f9478-59be-4b15-b22e-da544f60fb33 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:39.767145 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f64f9478-59be-4b15-b22e-da544f60fb33 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:39.785335 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f64f9478-59be-4b15-b22e-da544f60fb33 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/817afb89-f414-4d1d-bc89-5357dd4e1cb8" status: 200 len: 1272 microversion: 2.1 time: 0.476879 Aug 31 16:10:39.789681 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1855/3899] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:39 2022] GET /compute/v2.1/servers/817afb89-f414-4d1d-bc89-5357dd4e1cb8 => generated 1272 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:39.808989 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bfe3b2e5-f189-495a-96e1-c2e9fc240921 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:39.815024 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bfe3b2e5-f189-495a-96e1-c2e9fc240921 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a631b69c25264974a5d9af3045c248f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4ea8520b024e0a8a3d8bbc2991504d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:39.818328 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bfe3b2e5-f189-495a-96e1-c2e9fc240921 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Searching by: {'deleted': False, 'project_id': 'fc4ea8520b024e0a8a3d8bbc2991504d'} {{(pid=128863) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:10:39.845538 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfe3b2e5-f189-495a-96e1-c2e9fc240921 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:39.846868 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfe3b2e5-f189-495a-96e1-c2e9fc240921 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:39.847971 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfe3b2e5-f189-495a-96e1-c2e9fc240921 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:39.849664 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfe3b2e5-f189-495a-96e1-c2e9fc240921 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:39.851744 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfe3b2e5-f189-495a-96e1-c2e9fc240921 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:39.852643 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfe3b2e5-f189-495a-96e1-c2e9fc240921 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:39.903065 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.multi_cell_list [None req-bfe3b2e5-f189-495a-96e1-c2e9fc240921 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128863) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:10:39.950974 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bfe3b2e5-f189-495a-96e1-c2e9fc240921 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.159062 Aug 31 16:10:39.951922 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1856/3900] 10.222.0.50 () {58 vars in 1125 bytes} [Wed Aug 31 16:10:39 2022] GET /compute/v2.1/servers => generated 340 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:10:39.973611 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cf2cb6a9-c04e-4439-b0ee-257452ff0da9 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:39.975094 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cf2cb6a9-c04e-4439-b0ee-257452ff0da9 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] [instance: 9844cf26-6118-4f36-8c4d-736062782c20] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:39.985073 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf2cb6a9-c04e-4439-b0ee-257452ff0da9 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:39.986329 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf2cb6a9-c04e-4439-b0ee-257452ff0da9 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:39.987408 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf2cb6a9-c04e-4439-b0ee-257452ff0da9 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:39.989255 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf2cb6a9-c04e-4439-b0ee-257452ff0da9 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:39.990308 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf2cb6a9-c04e-4439-b0ee-257452ff0da9 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:39.991094 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf2cb6a9-c04e-4439-b0ee-257452ff0da9 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:40.590246 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-db9d4798-8587-417b-912f-17c2d95650d0 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:10:40.590825 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-db9d4798-8587-417b-912f-17c2d95650d0 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:10:40.591390 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-db9d4798-8587-417b-912f-17c2d95650d0 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:10:40.592198 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-db9d4798-8587-417b-912f-17c2d95650d0 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:10:40.593224 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-db9d4798-8587-417b-912f-17c2d95650d0 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:10:40.655702 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cf2cb6a9-c04e-4439-b0ee-257452ff0da9 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5d33bcaf2846cb83e0cf83f8acdd94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb60bef197c84b18aa1bfb27172dcc83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:40.667206 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db9d4798-8587-417b-912f-17c2d95650d0 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:40.668330 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db9d4798-8587-417b-912f-17c2d95650d0 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:40.669220 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db9d4798-8587-417b-912f-17c2d95650d0 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:40.671167 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db9d4798-8587-417b-912f-17c2d95650d0 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:40.676800 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db9d4798-8587-417b-912f-17c2d95650d0 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:40.679105 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db9d4798-8587-417b-912f-17c2d95650d0 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:40.684987 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cf2cb6a9-c04e-4439-b0ee-257452ff0da9 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] 10.222.0.50 "GET /compute/v2.1/servers/9844cf26-6118-4f36-8c4d-736062782c20" status: 200 len: 1310 microversion: 2.1 time: 0.720004 Aug 31 16:10:40.695021 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1857/3901] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:39 2022] GET /compute/v2.1/servers/9844cf26-6118-4f36-8c4d-736062782c20 => generated 1310 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:40.726483 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e7f31375-361f-4ea4-b9ab-0b2e4407fdc7 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1422622465", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:40.755696 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-db9d4798-8587-417b-912f-17c2d95650d0 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Getting quotas for project 3397e8a2a042486eb323432c47dfd392. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:10:40.777464 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-db9d4798-8587-417b-912f-17c2d95650d0 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Getting quotas for user 87f8241df6664aa59ba669d733e53871 and project 3397e8a2a042486eb323432c47dfd392. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:10:40.885610 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-db9d4798-8587-417b-912f-17c2d95650d0 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:10:40.891641 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-e7f31375-361f-4ea4-b9ab-0b2e4407fdc7 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] validate_networks() for [('00194b7c-6891-4cf9-8c59-235de2b40a38', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:10:40.899183 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-db9d4798-8587-417b-912f-17c2d95650d0 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: f6e41791-366b-4790-8338-2a52f4ebed89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:10:41.020434 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-db9d4798-8587-417b-912f-17c2d95650d0 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 3.177599 Aug 31 16:10:41.021456 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2045/3902] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:10:37 2022] POST /compute/v2.1/servers => generated 404 bytes in 3180 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:10:41.026683 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-4793f4fb-0501-4d0f-b681-1f95de8a03f7 req-1c0c4212-9a82-4e87-a537-484dcadd4fb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9844cf26-6118-4f36-8c4d-736062782c20", "name": "network-vif-plugged", "status": "completed", "tag": "4fe3a23e-879c-41bd-9f25-3777d5ae0406"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:41.044293 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-4793f4fb-0501-4d0f-b681-1f95de8a03f7 req-1c0c4212-9a82-4e87-a537-484dcadd4fb2 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:41.045335 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-4793f4fb-0501-4d0f-b681-1f95de8a03f7 req-1c0c4212-9a82-4e87-a537-484dcadd4fb2 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:41.046873 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-4793f4fb-0501-4d0f-b681-1f95de8a03f7 req-1c0c4212-9a82-4e87-a537-484dcadd4fb2 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:41.071132 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-4793f4fb-0501-4d0f-b681-1f95de8a03f7 req-1c0c4212-9a82-4e87-a537-484dcadd4fb2 service nova] Creating event network-vif-plugged:4fe3a23e-879c-41bd-9f25-3777d5ae0406 for instance 9844cf26-6118-4f36-8c4d-736062782c20 on n-h2-833090-16 Aug 31 16:10:41.100373 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-4793f4fb-0501-4d0f-b681-1f95de8a03f7 req-1c0c4212-9a82-4e87-a537-484dcadd4fb2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073858 Aug 31 16:10:41.101214 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2046/3903] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:10:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:10:41.122857 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-21aa8a4e-5041-4c26-a0d9-450655fda8e4 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:41.148359 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-21aa8a4e-5041-4c26-a0d9-450655fda8e4 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a631b69c25264974a5d9af3045c248f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4ea8520b024e0a8a3d8bbc2991504d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:41.168850 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-21aa8a4e-5041-4c26-a0d9-450655fda8e4 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Searching by: {'deleted': False, 'project_id': 'fc4ea8520b024e0a8a3d8bbc2991504d'} {{(pid=128864) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:10:41.178481 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-21aa8a4e-5041-4c26-a0d9-450655fda8e4 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:41.179253 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-21aa8a4e-5041-4c26-a0d9-450655fda8e4 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:41.179868 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-21aa8a4e-5041-4c26-a0d9-450655fda8e4 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:41.181130 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-21aa8a4e-5041-4c26-a0d9-450655fda8e4 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:41.181989 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-21aa8a4e-5041-4c26-a0d9-450655fda8e4 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:41.182751 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-21aa8a4e-5041-4c26-a0d9-450655fda8e4 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:41.416725 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.multi_cell_list [None req-21aa8a4e-5041-4c26-a0d9-450655fda8e4 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128864) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:10:41.562353 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-21aa8a4e-5041-4c26-a0d9-450655fda8e4 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a631b69c25264974a5d9af3045c248f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4ea8520b024e0a8a3d8bbc2991504d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:41.574655 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-21aa8a4e-5041-4c26-a0d9-450655fda8e4 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:41.575446 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-21aa8a4e-5041-4c26-a0d9-450655fda8e4 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:41.576189 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-21aa8a4e-5041-4c26-a0d9-450655fda8e4 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:42.040390 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-21aa8a4e-5041-4c26-a0d9-450655fda8e4 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] 10.222.0.50 "GET /compute/v2.1/servers/detail" status: 200 len: 1712 microversion: 2.1 time: 0.934411 Aug 31 16:10:42.042400 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2047/3904] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 31 16:10:41 2022] GET /compute/v2.1/servers/detail => generated 1712 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:42.063947 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c8237af3-1bab-48a2-bd9c-1b902f33d2d1 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:42.065083 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c8237af3-1bab-48a2-bd9c-1b902f33d2d1 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: 5116a4af-d819-456a-b188-7dcf94b7b35c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:42.086600 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8237af3-1bab-48a2-bd9c-1b902f33d2d1 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:42.087464 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8237af3-1bab-48a2-bd9c-1b902f33d2d1 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:42.088390 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8237af3-1bab-48a2-bd9c-1b902f33d2d1 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:42.089586 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8237af3-1bab-48a2-bd9c-1b902f33d2d1 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:42.090608 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8237af3-1bab-48a2-bd9c-1b902f33d2d1 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:42.091176 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8237af3-1bab-48a2-bd9c-1b902f33d2d1 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:42.744837 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c8237af3-1bab-48a2-bd9c-1b902f33d2d1 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:42.808293 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c8237af3-1bab-48a2-bd9c-1b902f33d2d1 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c" status: 200 len: 1318 microversion: 2.1 time: 0.764480 Aug 31 16:10:42.837335 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2048/3905] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:42 2022] GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c => generated 1318 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:42.851928 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5b24826d-81a2-41c6-8ae5-166efe6d15a4 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:42.852843 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5b24826d-81a2-41c6-8ae5-166efe6d15a4 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 817afb89-f414-4d1d-bc89-5357dd4e1cb8] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:42.871542 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5b24826d-81a2-41c6-8ae5-166efe6d15a4 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:42.876081 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5b24826d-81a2-41c6-8ae5-166efe6d15a4 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:42.877833 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5b24826d-81a2-41c6-8ae5-166efe6d15a4 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:42.879088 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5b24826d-81a2-41c6-8ae5-166efe6d15a4 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:42.881332 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5b24826d-81a2-41c6-8ae5-166efe6d15a4 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:42.883039 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5b24826d-81a2-41c6-8ae5-166efe6d15a4 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:42.980771 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-e7f31375-361f-4ea4-b9ab-0b2e4407fdc7 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:10:42.981679 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-e7f31375-361f-4ea4-b9ab-0b2e4407fdc7 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:10:42.981871 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-e7f31375-361f-4ea4-b9ab-0b2e4407fdc7 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:10:42.982199 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-e7f31375-361f-4ea4-b9ab-0b2e4407fdc7 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:10:42.982834 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-e7f31375-361f-4ea4-b9ab-0b2e4407fdc7 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:10:43.020092 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7f31375-361f-4ea4-b9ab-0b2e4407fdc7 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:43.020995 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7f31375-361f-4ea4-b9ab-0b2e4407fdc7 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:43.021494 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7f31375-361f-4ea4-b9ab-0b2e4407fdc7 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:43.022381 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7f31375-361f-4ea4-b9ab-0b2e4407fdc7 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:43.022883 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7f31375-361f-4ea4-b9ab-0b2e4407fdc7 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:43.023376 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7f31375-361f-4ea4-b9ab-0b2e4407fdc7 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:43.094291 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-e7f31375-361f-4ea4-b9ab-0b2e4407fdc7 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Getting quotas for project 84f42648e1a343b9a5ab9b89c91bea0d. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:10:43.099457 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:10:43.108454 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-e7f31375-361f-4ea4-b9ab-0b2e4407fdc7 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Getting quotas for user 3ebce87993504550914c2c3702eebb17 and project 84f42648e1a343b9a5ab9b89c91bea0d. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:10:43.172688 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e7f31375-361f-4ea4-b9ab-0b2e4407fdc7 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:10:43.191224 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e7f31375-361f-4ea4-b9ab-0b2e4407fdc7 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 022989f7-8dec-4596-a677-badd5e10336a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:10:43.329099 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e7f31375-361f-4ea4-b9ab-0b2e4407fdc7 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.632444 Aug 31 16:10:43.332290 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1858/3906] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:10:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:10:43.338889 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d5830525-ebec-44e5-8e13-2db9520b6ddc tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:43.342951 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d5830525-ebec-44e5-8e13-2db9520b6ddc tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: f6e41791-366b-4790-8338-2a52f4ebed89] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:43.364715 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5830525-ebec-44e5-8e13-2db9520b6ddc tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:43.365575 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5830525-ebec-44e5-8e13-2db9520b6ddc tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:43.368594 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5830525-ebec-44e5-8e13-2db9520b6ddc tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:43.369658 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5830525-ebec-44e5-8e13-2db9520b6ddc tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:43.370422 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5830525-ebec-44e5-8e13-2db9520b6ddc tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:43.373902 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5830525-ebec-44e5-8e13-2db9520b6ddc tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:43.882306 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5b24826d-81a2-41c6-8ae5-166efe6d15a4 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:43.908009 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d5830525-ebec-44e5-8e13-2db9520b6ddc tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:43.915147 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5b24826d-81a2-41c6-8ae5-166efe6d15a4 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/817afb89-f414-4d1d-bc89-5357dd4e1cb8" status: 200 len: 1314 microversion: 2.1 time: 1.074303 Aug 31 16:10:43.917448 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2049/3907] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:42 2022] GET /compute/v2.1/servers/817afb89-f414-4d1d-bc89-5357dd4e1cb8 => generated 1314 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:43.929410 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d5830525-ebec-44e5-8e13-2db9520b6ddc tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89" status: 200 len: 1319 microversion: 2.1 time: 0.593575 Aug 31 16:10:43.942159 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1859/3908] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:43 2022] GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89 => generated 1319 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:43.942159 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5a2d6ea1-85c0-4eb4-8992-b257f62f26e3 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:43.942159 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5a2d6ea1-85c0-4eb4-8992-b257f62f26e3 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] [instance: 9844cf26-6118-4f36-8c4d-736062782c20] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:43.948752 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-bc93f502-cb65-488d-a8fb-3f60bed38404 req-9e04893c-93e2-4ba5-be8b-c4dd1487a397 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5116a4af-d819-456a-b188-7dcf94b7b35c", "tag": "367272f4-dbf2-4acc-ba34-c1c2c1d4bee7"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:43.970036 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a2d6ea1-85c0-4eb4-8992-b257f62f26e3 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:43.970585 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a2d6ea1-85c0-4eb4-8992-b257f62f26e3 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:43.971299 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a2d6ea1-85c0-4eb4-8992-b257f62f26e3 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:43.978153 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a2d6ea1-85c0-4eb4-8992-b257f62f26e3 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:43.980268 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a2d6ea1-85c0-4eb4-8992-b257f62f26e3 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:43.981652 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a2d6ea1-85c0-4eb4-8992-b257f62f26e3 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:43.990911 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-bc93f502-cb65-488d-a8fb-3f60bed38404 req-9e04893c-93e2-4ba5-be8b-c4dd1487a397 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:43.998249 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-bc93f502-cb65-488d-a8fb-3f60bed38404 req-9e04893c-93e2-4ba5-be8b-c4dd1487a397 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:44.000973 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-bc93f502-cb65-488d-a8fb-3f60bed38404 req-9e04893c-93e2-4ba5-be8b-c4dd1487a397 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:44.060766 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-bc93f502-cb65-488d-a8fb-3f60bed38404 req-9e04893c-93e2-4ba5-be8b-c4dd1487a397 service nova] Creating event network-changed:367272f4-dbf2-4acc-ba34-c1c2c1d4bee7 for instance 5116a4af-d819-456a-b188-7dcf94b7b35c on n-h1-833090-16 Aug 31 16:10:44.070512 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-bc93f502-cb65-488d-a8fb-3f60bed38404 req-9e04893c-93e2-4ba5-be8b-c4dd1487a397 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149991 Aug 31 16:10:44.071747 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2050/3909] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:10:44.077793 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9677759e-938f-46f1-b120-5d5f2874118a tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:44.098316 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9677759e-938f-46f1-b120-5d5f2874118a tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024859 Aug 31 16:10:44.101793 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2051/3910] 10.222.0.50 () {58 vars in 1137 bytes} [Wed Aug 31 16:10:44 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:10:44.116121 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-03c93739-f8ad-4b30-b481-d27030fbd4db req-7dcf0e61-b85c-4181-b9ef-0eb089b5a3bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "817afb89-f414-4d1d-bc89-5357dd4e1cb8", "tag": "0d01462c-4840-4402-8f7a-ce1a7f173698"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:44.153624 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-03c93739-f8ad-4b30-b481-d27030fbd4db req-7dcf0e61-b85c-4181-b9ef-0eb089b5a3bd service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:44.155197 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-03c93739-f8ad-4b30-b481-d27030fbd4db req-7dcf0e61-b85c-4181-b9ef-0eb089b5a3bd service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:44.158542 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-03c93739-f8ad-4b30-b481-d27030fbd4db req-7dcf0e61-b85c-4181-b9ef-0eb089b5a3bd service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:44.201201 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-03c93739-f8ad-4b30-b481-d27030fbd4db req-7dcf0e61-b85c-4181-b9ef-0eb089b5a3bd service nova] Creating event network-changed:0d01462c-4840-4402-8f7a-ce1a7f173698 for instance 817afb89-f414-4d1d-bc89-5357dd4e1cb8 on n-h2-833090-16 Aug 31 16:10:44.207632 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-03c93739-f8ad-4b30-b481-d27030fbd4db req-7dcf0e61-b85c-4181-b9ef-0eb089b5a3bd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103726 Aug 31 16:10:44.208638 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2052/3911] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:10:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:10:44.216335 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-dfd15c87-8af5-4a61-a619-dfdda3478c77 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:44.217793 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-dfd15c87-8af5-4a61-a619-dfdda3478c77 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 022989f7-8dec-4596-a677-badd5e10336a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:44.255458 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-dfd15c87-8af5-4a61-a619-dfdda3478c77 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 022989f7-8dec-4596-a677-badd5e10336a] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:10:44.365179 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5a2d6ea1-85c0-4eb4-8992-b257f62f26e3 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5d33bcaf2846cb83e0cf83f8acdd94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb60bef197c84b18aa1bfb27172dcc83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:44.381438 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5a2d6ea1-85c0-4eb4-8992-b257f62f26e3 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] 10.222.0.50 "GET /compute/v2.1/servers/9844cf26-6118-4f36-8c4d-736062782c20" status: 200 len: 1496 microversion: 2.1 time: 0.447428 Aug 31 16:10:44.382950 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1860/3912] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:43 2022] GET /compute/v2.1/servers/9844cf26-6118-4f36-8c4d-736062782c20 => generated 1496 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:44.419277 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4854c77a-28bb-46e2-a13f-f6c2e311767b tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:44.420138 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4854c77a-28bb-46e2-a13f-f6c2e311767b tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: 5116a4af-d819-456a-b188-7dcf94b7b35c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:44.437741 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4854c77a-28bb-46e2-a13f-f6c2e311767b tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:44.439225 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4854c77a-28bb-46e2-a13f-f6c2e311767b tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:44.441375 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4854c77a-28bb-46e2-a13f-f6c2e311767b tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:44.442301 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4854c77a-28bb-46e2-a13f-f6c2e311767b tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:44.444118 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4854c77a-28bb-46e2-a13f-f6c2e311767b tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:44.444665 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4854c77a-28bb-46e2-a13f-f6c2e311767b tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:44.818047 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4854c77a-28bb-46e2-a13f-f6c2e311767b tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:44.833886 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4854c77a-28bb-46e2-a13f-f6c2e311767b tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c" status: 200 len: 1318 microversion: 2.1 time: 0.429596 Aug 31 16:10:44.835581 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1861/3913] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:44 2022] GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c => generated 1318 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:44.840976 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1c5baf7b-24ce-4dae-9d2c-a5ab21008509 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:44.891294 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.compute.server_groups [None req-1c5baf7b-24ce-4dae-9d2c-a5ab21008509 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Querying cell ff6ab154-5f51-4e0d-922a-904eb5aa20da(cell1) for 1 instances {{(pid=128863) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 31 16:10:44.892341 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c5baf7b-24ce-4dae-9d2c-a5ab21008509 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:44.893134 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c5baf7b-24ce-4dae-9d2c-a5ab21008509 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:44.893777 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c5baf7b-24ce-4dae-9d2c-a5ab21008509 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:44.919040 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1c5baf7b-24ce-4dae-9d2c-a5ab21008509 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] 10.222.0.50 "GET /compute/v2.1/os-server-groups/223532c7-d681-4adc-9f43-915273068c99" status: 200 len: 222 microversion: 2.1 time: 0.081427 Aug 31 16:10:44.920326 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1862/3914] 10.222.0.50 () {58 vars in 1263 bytes} [Wed Aug 31 16:10:44 2022] GET /compute/v2.1/os-server-groups/223532c7-d681-4adc-9f43-915273068c99 => generated 222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:10:44.926947 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2449d4f2-9669-4199-967c-78bd57e8dbc0 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:44.927653 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2449d4f2-9669-4199-967c-78bd57e8dbc0 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] [instance: f6f12af7-92ac-4c99-a4f7-282d970356c6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:44.936662 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2449d4f2-9669-4199-967c-78bd57e8dbc0 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:44.937588 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2449d4f2-9669-4199-967c-78bd57e8dbc0 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:44.938214 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2449d4f2-9669-4199-967c-78bd57e8dbc0 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:44.939406 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2449d4f2-9669-4199-967c-78bd57e8dbc0 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:44.940025 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2449d4f2-9669-4199-967c-78bd57e8dbc0 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:44.940730 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2449d4f2-9669-4199-967c-78bd57e8dbc0 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:44.986060 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.scheduler.client.report [None req-dfd15c87-8af5-4a61-a619-dfdda3478c77 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Deleted allocations for instance 022989f7-8dec-4596-a677-badd5e10336a Aug 31 16:10:44.996828 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2449d4f2-9669-4199-967c-78bd57e8dbc0 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] [instance: f6f12af7-92ac-4c99-a4f7-282d970356c6] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:10:45.018613 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-dfd15c87-8af5-4a61-a619-dfdda3478c77 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "DELETE /compute/v2.1/servers/022989f7-8dec-4596-a677-badd5e10336a" status: 204 len: 0 microversion: 2.1 time: 0.808015 Aug 31 16:10:45.020526 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2053/3915] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:10:44 2022] DELETE /compute/v2.1/servers/022989f7-8dec-4596-a677-badd5e10336a => generated 0 bytes in 811 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:10:45.035346 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b2f8a701-b517-4e2c-92af-c4915eca8e56 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:45.037512 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b2f8a701-b517-4e2c-92af-c4915eca8e56 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] [instance: 9844cf26-6118-4f36-8c4d-736062782c20] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:45.064226 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b2f8a701-b517-4e2c-92af-c4915eca8e56 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:45.065312 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b2f8a701-b517-4e2c-92af-c4915eca8e56 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:45.066412 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b2f8a701-b517-4e2c-92af-c4915eca8e56 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:45.067503 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b2f8a701-b517-4e2c-92af-c4915eca8e56 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:45.068168 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b2f8a701-b517-4e2c-92af-c4915eca8e56 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:45.068842 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b2f8a701-b517-4e2c-92af-c4915eca8e56 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:45.121836 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2449d4f2-9669-4199-967c-78bd57e8dbc0 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] 10.222.0.50 "DELETE /compute/v2.1/servers/f6f12af7-92ac-4c99-a4f7-282d970356c6" status: 204 len: 0 microversion: 2.1 time: 0.199815 Aug 31 16:10:45.123634 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1863/3916] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:10:44 2022] DELETE /compute/v2.1/servers/f6f12af7-92ac-4c99-a4f7-282d970356c6 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:10:45.130584 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-13401075-b173-425f-adfc-98e1d111c2e9 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:45.132300 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-13401075-b173-425f-adfc-98e1d111c2e9 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 817afb89-f414-4d1d-bc89-5357dd4e1cb8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:45.143963 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13401075-b173-425f-adfc-98e1d111c2e9 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:45.145528 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13401075-b173-425f-adfc-98e1d111c2e9 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:45.147503 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13401075-b173-425f-adfc-98e1d111c2e9 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:45.148791 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13401075-b173-425f-adfc-98e1d111c2e9 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:45.149683 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13401075-b173-425f-adfc-98e1d111c2e9 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:45.151085 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13401075-b173-425f-adfc-98e1d111c2e9 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:45.153297 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b2f8a701-b517-4e2c-92af-c4915eca8e56 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] [instance: 9844cf26-6118-4f36-8c4d-736062782c20] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:10:45.339789 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b2f8a701-b517-4e2c-92af-c4915eca8e56 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] 10.222.0.50 "DELETE /compute/v2.1/servers/9844cf26-6118-4f36-8c4d-736062782c20" status: 204 len: 0 microversion: 2.1 time: 0.317286 Aug 31 16:10:45.340520 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2054/3917] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:10:45 2022] DELETE /compute/v2.1/servers/9844cf26-6118-4f36-8c4d-736062782c20 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:10:45.346674 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2892773f-844c-42a9-b7a9-c66b8eadfcab tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:45.348114 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2892773f-844c-42a9-b7a9-c66b8eadfcab tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: f6e41791-366b-4790-8338-2a52f4ebed89] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:45.363555 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2892773f-844c-42a9-b7a9-c66b8eadfcab tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:45.364600 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2892773f-844c-42a9-b7a9-c66b8eadfcab tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:45.365421 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2892773f-844c-42a9-b7a9-c66b8eadfcab tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:45.367665 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2892773f-844c-42a9-b7a9-c66b8eadfcab tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:45.368502 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2892773f-844c-42a9-b7a9-c66b8eadfcab tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:45.369437 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2892773f-844c-42a9-b7a9-c66b8eadfcab tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:45.375618 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:10:45.563602 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2892773f-844c-42a9-b7a9-c66b8eadfcab tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:45.578349 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-13401075-b173-425f-adfc-98e1d111c2e9 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:45.589159 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-13401075-b173-425f-adfc-98e1d111c2e9 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/817afb89-f414-4d1d-bc89-5357dd4e1cb8" status: 200 len: 1314 microversion: 2.1 time: 0.463531 Aug 31 16:10:45.589501 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2892773f-844c-42a9-b7a9-c66b8eadfcab tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89" status: 200 len: 1325 microversion: 2.1 time: 0.246942 Aug 31 16:10:45.590439 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1864/3918] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:45 2022] GET /compute/v2.1/servers/817afb89-f414-4d1d-bc89-5357dd4e1cb8 => generated 1314 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:45.607487 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8a63f9f5-3503-4313-a7d4-5b6dfc30568f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:45.608537 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8a63f9f5-3503-4313-a7d4-5b6dfc30568f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 022989f7-8dec-4596-a677-badd5e10336a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:45.636423 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a63f9f5-3503-4313-a7d4-5b6dfc30568f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:45.641834 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a63f9f5-3503-4313-a7d4-5b6dfc30568f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:45.643099 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a63f9f5-3503-4313-a7d4-5b6dfc30568f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:45.648399 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a63f9f5-3503-4313-a7d4-5b6dfc30568f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:45.650917 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a63f9f5-3503-4313-a7d4-5b6dfc30568f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:45.653218 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a63f9f5-3503-4313-a7d4-5b6dfc30568f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:45.653614 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2055/3919] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:45 2022] GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89 => generated 1325 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:45.665820 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b4583491-7d2f-4c8f-9fad-6b0bac868ccc tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:45.670794 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b4583491-7d2f-4c8f-9fad-6b0bac868ccc tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] [instance: f6f12af7-92ac-4c99-a4f7-282d970356c6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:45.684564 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b4583491-7d2f-4c8f-9fad-6b0bac868ccc tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:45.685960 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b4583491-7d2f-4c8f-9fad-6b0bac868ccc tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:45.686593 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-8a63f9f5-3503-4313-a7d4-5b6dfc30568f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] HTTP exception thrown: Instance 022989f7-8dec-4596-a677-badd5e10336a could not be found. Aug 31 16:10:45.688156 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b4583491-7d2f-4c8f-9fad-6b0bac868ccc tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8a63f9f5-3503-4313-a7d4-5b6dfc30568f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Request method failure captured: Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/022989f7-8dec-4596-a677-badd5e10336a HTTP/1.1 Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4fcRMLera6TLJp6OFOd_B19-rdZe1qr5LTGcbsBroFhPQ8_L89JW9hpsNJPnNpQCXW4WKWxdTwWZTYVgRah_OPLrb5JBnrA64ZgN8VfXgRvkXORTfvSkZvZgjCL7371tDtPpfcPNp0NcyRfiYHxIldtsDdYZVFbQTa8WMsjzib7kZ0 Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 84f42648e1a343b9a5ab9b89c91bea0d Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersTestJSON-1527984429 Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_84f42648e1a343b9a5ab9b89c91bea0d", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServersTestJSON-1527984429 Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 84f42648e1a343b9a5ab9b89c91bea0d Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersTestJSON-1527984429 Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServersTestJSON-1527984429-project Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 3ebce87993504550914c2c3702eebb17 Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServersTestJSON-1527984429-project Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 022989f7-8dec-4596-a677-badd5e10336a could not be found. Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '022989f7-8dec-4596-a677-badd5e10336a'} Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 022989f7-8dec-4596-a677-badd5e10336a could not be found. Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 022989f7-8dec-4596-a677-badd5e10336a could not be found. Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:45.688369 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:10:45.706645 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:45.706645 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:45.706645 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:45.706645 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:10:45.706645 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:10:45.706645 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 022989f7-8dec-4596-a677-badd5e10336a could not be found. Aug 31 16:10:45.706645 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:10:45.706645 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8a63f9f5-3503-4313-a7d4-5b6dfc30568f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Returning 404 to user: Instance 022989f7-8dec-4596-a677-badd5e10336a could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:10:45.706645 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8a63f9f5-3503-4313-a7d4-5b6dfc30568f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/022989f7-8dec-4596-a677-badd5e10336a" status: 404 len: 111 microversion: 2.1 time: 0.098582 Aug 31 16:10:45.709927 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b4583491-7d2f-4c8f-9fad-6b0bac868ccc tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:45.709927 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b4583491-7d2f-4c8f-9fad-6b0bac868ccc tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:45.709927 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b4583491-7d2f-4c8f-9fad-6b0bac868ccc tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:45.720712 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1865/3920] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:45 2022] GET /compute/v2.1/servers/022989f7-8dec-4596-a677-badd5e10336a => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:10:45.729001 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f5510db9-eaad-4f53-8607-9d70832cf253 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:45.747103 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f5510db9-eaad-4f53-8607-9d70832cf253 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] [instance: 9844cf26-6118-4f36-8c4d-736062782c20] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:45.767212 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5510db9-eaad-4f53-8607-9d70832cf253 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:45.769087 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5510db9-eaad-4f53-8607-9d70832cf253 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:45.773616 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5510db9-eaad-4f53-8607-9d70832cf253 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:45.774649 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5510db9-eaad-4f53-8607-9d70832cf253 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:45.775697 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5510db9-eaad-4f53-8607-9d70832cf253 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:45.778746 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5510db9-eaad-4f53-8607-9d70832cf253 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:46.497418 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b4583491-7d2f-4c8f-9fad-6b0bac868ccc tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a631b69c25264974a5d9af3045c248f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4ea8520b024e0a8a3d8bbc2991504d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:46.508087 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b4583491-7d2f-4c8f-9fad-6b0bac868ccc tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] 10.222.0.50 "GET /compute/v2.1/servers/f6f12af7-92ac-4c99-a4f7-282d970356c6" status: 200 len: 1715 microversion: 2.1 time: 0.851675 Aug 31 16:10:46.526670 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2056/3921] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:45 2022] GET /compute/v2.1/servers/f6f12af7-92ac-4c99-a4f7-282d970356c6 => generated 1715 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:46.532379 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-09bd07d5-03c4-43e0-871d-4e2888ee952b tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:46.540947 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-09bd07d5-03c4-43e0-871d-4e2888ee952b tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: 5116a4af-d819-456a-b188-7dcf94b7b35c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:46.568027 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-09bd07d5-03c4-43e0-871d-4e2888ee952b tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:46.568857 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-09bd07d5-03c4-43e0-871d-4e2888ee952b tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:46.569506 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-09bd07d5-03c4-43e0-871d-4e2888ee952b tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:46.570472 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-09bd07d5-03c4-43e0-871d-4e2888ee952b tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:46.571110 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-09bd07d5-03c4-43e0-871d-4e2888ee952b tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:46.571698 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-09bd07d5-03c4-43e0-871d-4e2888ee952b tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:46.608088 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f5510db9-eaad-4f53-8607-9d70832cf253 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5d33bcaf2846cb83e0cf83f8acdd94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb60bef197c84b18aa1bfb27172dcc83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:46.639789 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f5510db9-eaad-4f53-8607-9d70832cf253 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] 10.222.0.50 "GET /compute/v2.1/servers/9844cf26-6118-4f36-8c4d-736062782c20" status: 200 len: 1502 microversion: 2.1 time: 0.914699 Aug 31 16:10:46.643841 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1866/3922] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:45 2022] GET /compute/v2.1/servers/9844cf26-6118-4f36-8c4d-736062782c20 => generated 1502 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:46.655137 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0eb27814-7000-4c85-8f15-a1ec1f48c2a8 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-987103164", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "00194b7c-6891-4cf9-8c59-235de2b40a38"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:46.794626 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-0eb27814-7000-4c85-8f15-a1ec1f48c2a8 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] validate_networks() for [('00194b7c-6891-4cf9-8c59-235de2b40a38', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:10:47.964786 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-09bd07d5-03c4-43e0-871d-4e2888ee952b tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:48.004257 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-09bd07d5-03c4-43e0-871d-4e2888ee952b tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c" status: 200 len: 1318 microversion: 2.1 time: 1.476021 Aug 31 16:10:48.019424 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2057/3923] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:46 2022] GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c => generated 1318 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:48.038002 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-bbda897a-42ac-496e-a6cc-d04f501790ab tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:48.041693 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-bbda897a-42ac-496e-a6cc-d04f501790ab tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 817afb89-f414-4d1d-bc89-5357dd4e1cb8] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:48.087609 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bbda897a-42ac-496e-a6cc-d04f501790ab tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:48.095346 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bbda897a-42ac-496e-a6cc-d04f501790ab tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:48.096592 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bbda897a-42ac-496e-a6cc-d04f501790ab tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:48.101239 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bbda897a-42ac-496e-a6cc-d04f501790ab tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:48.102477 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bbda897a-42ac-496e-a6cc-d04f501790ab tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:48.103501 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bbda897a-42ac-496e-a6cc-d04f501790ab tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:48.848844 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-bbda897a-42ac-496e-a6cc-d04f501790ab tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:48.865044 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-bbda897a-42ac-496e-a6cc-d04f501790ab tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/817afb89-f414-4d1d-bc89-5357dd4e1cb8" status: 200 len: 1314 microversion: 2.1 time: 0.843616 Aug 31 16:10:48.865977 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2058/3924] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:48 2022] GET /compute/v2.1/servers/817afb89-f414-4d1d-bc89-5357dd4e1cb8 => generated 1314 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:48.896100 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-cafc623d-ebc9-4419-978f-50a2981bd520 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:48.896729 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-cafc623d-ebc9-4419-978f-50a2981bd520 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: f6e41791-366b-4790-8338-2a52f4ebed89] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:48.914949 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cafc623d-ebc9-4419-978f-50a2981bd520 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:48.918492 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cafc623d-ebc9-4419-978f-50a2981bd520 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:48.922085 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cafc623d-ebc9-4419-978f-50a2981bd520 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:48.924477 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cafc623d-ebc9-4419-978f-50a2981bd520 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:48.925253 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cafc623d-ebc9-4419-978f-50a2981bd520 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:48.925892 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cafc623d-ebc9-4419-978f-50a2981bd520 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:49.585247 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-cafc623d-ebc9-4419-978f-50a2981bd520 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:49.607016 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-cafc623d-ebc9-4419-978f-50a2981bd520 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89" status: 200 len: 1391 microversion: 2.1 time: 0.738789 Aug 31 16:10:49.618644 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2059/3925] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:48 2022] GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89 => generated 1391 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:49.640119 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-0eb27814-7000-4c85-8f15-a1ec1f48c2a8 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:10:49.644105 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-0eb27814-7000-4c85-8f15-a1ec1f48c2a8 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:10:49.644406 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-d5c59d1a-03a2-4a1f-9e49-1c5bf1514d0d req-4b0ea5c8-8430-4777-8e24-5528b2e41dee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6e41791-366b-4790-8338-2a52f4ebed89", "tag": "0507378d-ba87-41ae-8199-9dd64dc20873"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:49.646452 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-0eb27814-7000-4c85-8f15-a1ec1f48c2a8 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:10:49.647481 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-0eb27814-7000-4c85-8f15-a1ec1f48c2a8 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:10:49.648704 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-0eb27814-7000-4c85-8f15-a1ec1f48c2a8 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:10:49.655709 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-d5c59d1a-03a2-4a1f-9e49-1c5bf1514d0d req-4b0ea5c8-8430-4777-8e24-5528b2e41dee service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:49.656189 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-d5c59d1a-03a2-4a1f-9e49-1c5bf1514d0d req-4b0ea5c8-8430-4777-8e24-5528b2e41dee service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:49.656616 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-d5c59d1a-03a2-4a1f-9e49-1c5bf1514d0d req-4b0ea5c8-8430-4777-8e24-5528b2e41dee service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:49.671356 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-d5c59d1a-03a2-4a1f-9e49-1c5bf1514d0d req-4b0ea5c8-8430-4777-8e24-5528b2e41dee service nova] Creating event network-changed:0507378d-ba87-41ae-8199-9dd64dc20873 for instance f6e41791-366b-4790-8338-2a52f4ebed89 on n-h1-833090-16 Aug 31 16:10:49.678949 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-d5c59d1a-03a2-4a1f-9e49-1c5bf1514d0d req-4b0ea5c8-8430-4777-8e24-5528b2e41dee service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056858 Aug 31 16:10:49.681440 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0eb27814-7000-4c85-8f15-a1ec1f48c2a8 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:49.682390 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0eb27814-7000-4c85-8f15-a1ec1f48c2a8 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:49.683375 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0eb27814-7000-4c85-8f15-a1ec1f48c2a8 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:49.684552 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0eb27814-7000-4c85-8f15-a1ec1f48c2a8 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:49.685744 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0eb27814-7000-4c85-8f15-a1ec1f48c2a8 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:49.689126 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2060/3926] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:10:49.706333 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9fe59aad-fded-445b-b585-167f45270da0 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:49.707224 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9fe59aad-fded-445b-b585-167f45270da0 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] [instance: f6f12af7-92ac-4c99-a4f7-282d970356c6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:49.716118 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0eb27814-7000-4c85-8f15-a1ec1f48c2a8 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:49.724267 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9fe59aad-fded-445b-b585-167f45270da0 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:49.725162 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9fe59aad-fded-445b-b585-167f45270da0 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:49.725764 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9fe59aad-fded-445b-b585-167f45270da0 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:49.726807 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9fe59aad-fded-445b-b585-167f45270da0 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:49.727452 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9fe59aad-fded-445b-b585-167f45270da0 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:49.728027 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9fe59aad-fded-445b-b585-167f45270da0 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:49.781573 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-0eb27814-7000-4c85-8f15-a1ec1f48c2a8 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Getting quotas for project 84f42648e1a343b9a5ab9b89c91bea0d. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:10:49.797081 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-0eb27814-7000-4c85-8f15-a1ec1f48c2a8 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Getting quotas for user 3ebce87993504550914c2c3702eebb17 and project 84f42648e1a343b9a5ab9b89c91bea0d. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:10:49.818772 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0eb27814-7000-4c85-8f15-a1ec1f48c2a8 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:10:49.822517 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0eb27814-7000-4c85-8f15-a1ec1f48c2a8 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 30d31a1b-0872-4fd2-a9a7-06067b151a68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:10:49.912115 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9fe59aad-fded-445b-b585-167f45270da0 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a631b69c25264974a5d9af3045c248f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4ea8520b024e0a8a3d8bbc2991504d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:49.917752 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0eb27814-7000-4c85-8f15-a1ec1f48c2a8 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.260511 Aug 31 16:10:49.923955 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1867/3927] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:10:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 3274 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:10:49.929901 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d0ff30a8-8af0-4a4d-917f-1f3c8e7111e4 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:49.930773 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d0ff30a8-8af0-4a4d-917f-1f3c8e7111e4 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] [instance: 9844cf26-6118-4f36-8c4d-736062782c20] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:49.936152 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9fe59aad-fded-445b-b585-167f45270da0 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] 10.222.0.50 "GET /compute/v2.1/servers/f6f12af7-92ac-4c99-a4f7-282d970356c6" status: 200 len: 1649 microversion: 2.1 time: 0.242864 Aug 31 16:10:49.950127 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2061/3928] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:49 2022] GET /compute/v2.1/servers/f6f12af7-92ac-4c99-a4f7-282d970356c6 => generated 1649 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:49.951008 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0ff30a8-8af0-4a4d-917f-1f3c8e7111e4 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:49.954298 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-811f42b1-dac8-4a4a-99bc-1e5c1520d580 req-36eeb669-74cd-47dd-92b8-3d0c91ccff4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5116a4af-d819-456a-b188-7dcf94b7b35c", "name": "network-vif-plugged", "status": "completed", "tag": "367272f4-dbf2-4acc-ba34-c1c2c1d4bee7"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:49.956144 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0ff30a8-8af0-4a4d-917f-1f3c8e7111e4 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:49.957131 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0ff30a8-8af0-4a4d-917f-1f3c8e7111e4 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:49.962943 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0ff30a8-8af0-4a4d-917f-1f3c8e7111e4 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:49.964557 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0ff30a8-8af0-4a4d-917f-1f3c8e7111e4 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:49.980726 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0ff30a8-8af0-4a4d-917f-1f3c8e7111e4 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:50.005928 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-811f42b1-dac8-4a4a-99bc-1e5c1520d580 req-36eeb669-74cd-47dd-92b8-3d0c91ccff4a service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:50.006455 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-811f42b1-dac8-4a4a-99bc-1e5c1520d580 req-36eeb669-74cd-47dd-92b8-3d0c91ccff4a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:50.006901 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-811f42b1-dac8-4a4a-99bc-1e5c1520d580 req-36eeb669-74cd-47dd-92b8-3d0c91ccff4a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:50.039993 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-811f42b1-dac8-4a4a-99bc-1e5c1520d580 req-36eeb669-74cd-47dd-92b8-3d0c91ccff4a service nova] Creating event network-vif-plugged:367272f4-dbf2-4acc-ba34-c1c2c1d4bee7 for instance 5116a4af-d819-456a-b188-7dcf94b7b35c on n-h1-833090-16 Aug 31 16:10:50.053691 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-811f42b1-dac8-4a4a-99bc-1e5c1520d580 req-36eeb669-74cd-47dd-92b8-3d0c91ccff4a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114306 Aug 31 16:10:50.054983 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2062/3929] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:10:50.067882 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-afba0fa4-5417-4908-b8d6-64fbd7621fcd tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:50.076051 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-afba0fa4-5417-4908-b8d6-64fbd7621fcd tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: 5116a4af-d819-456a-b188-7dcf94b7b35c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:50.090645 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-afba0fa4-5417-4908-b8d6-64fbd7621fcd tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:50.091549 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-afba0fa4-5417-4908-b8d6-64fbd7621fcd tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:50.092847 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-afba0fa4-5417-4908-b8d6-64fbd7621fcd tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:50.096739 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-afba0fa4-5417-4908-b8d6-64fbd7621fcd tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:50.097452 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-afba0fa4-5417-4908-b8d6-64fbd7621fcd tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:50.102391 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-afba0fa4-5417-4908-b8d6-64fbd7621fcd tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:50.856013 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d0ff30a8-8af0-4a4d-917f-1f3c8e7111e4 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5d33bcaf2846cb83e0cf83f8acdd94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb60bef197c84b18aa1bfb27172dcc83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:50.875065 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d0ff30a8-8af0-4a4d-917f-1f3c8e7111e4 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] 10.222.0.50 "GET /compute/v2.1/servers/9844cf26-6118-4f36-8c4d-736062782c20" status: 200 len: 1502 microversion: 2.1 time: 0.954387 Aug 31 16:10:50.876960 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1868/3930] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:49 2022] GET /compute/v2.1/servers/9844cf26-6118-4f36-8c4d-736062782c20 => generated 1502 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:50.893641 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-754c5f38-fe8b-4da7-a527-279a702d2ebc tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:50.905777 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-754c5f38-fe8b-4da7-a527-279a702d2ebc tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 817afb89-f414-4d1d-bc89-5357dd4e1cb8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:50.936119 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-754c5f38-fe8b-4da7-a527-279a702d2ebc tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:50.937367 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-754c5f38-fe8b-4da7-a527-279a702d2ebc tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:50.938233 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-754c5f38-fe8b-4da7-a527-279a702d2ebc tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:50.941088 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-754c5f38-fe8b-4da7-a527-279a702d2ebc tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:50.943911 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-754c5f38-fe8b-4da7-a527-279a702d2ebc tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:50.945039 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-754c5f38-fe8b-4da7-a527-279a702d2ebc tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:50.958456 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-afba0fa4-5417-4908-b8d6-64fbd7621fcd tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:51.009669 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-afba0fa4-5417-4908-b8d6-64fbd7621fcd tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c" status: 200 len: 1318 microversion: 2.1 time: 0.952035 Aug 31 16:10:51.016205 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2063/3931] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:50 2022] GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c => generated 1318 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:51.035688 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-725c8d8a-54be-4d69-ad27-1e8e8f66205f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:51.037615 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-725c8d8a-54be-4d69-ad27-1e8e8f66205f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 30d31a1b-0872-4fd2-a9a7-06067b151a68] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:51.049125 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-725c8d8a-54be-4d69-ad27-1e8e8f66205f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:51.050394 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-725c8d8a-54be-4d69-ad27-1e8e8f66205f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:51.052613 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-725c8d8a-54be-4d69-ad27-1e8e8f66205f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:51.054136 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-725c8d8a-54be-4d69-ad27-1e8e8f66205f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:51.055035 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-725c8d8a-54be-4d69-ad27-1e8e8f66205f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:51.055863 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-725c8d8a-54be-4d69-ad27-1e8e8f66205f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:51.255710 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-725c8d8a-54be-4d69-ad27-1e8e8f66205f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:51.299282 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=4 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:10:51.309405 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-725c8d8a-54be-4d69-ad27-1e8e8f66205f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/30d31a1b-0872-4fd2-a9a7-06067b151a68" status: 200 len: 1216 microversion: 2.1 time: 0.289905 Aug 31 16:10:51.328748 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2064/3932] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:51 2022] GET /compute/v2.1/servers/30d31a1b-0872-4fd2-a9a7-06067b151a68 => generated 1216 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:51.344182 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-37edc000-345f-4bd9-97b5-fd1e67f661d6 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:51.345146 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-37edc000-345f-4bd9-97b5-fd1e67f661d6 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: f6e41791-366b-4790-8338-2a52f4ebed89] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:51.362335 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-37edc000-345f-4bd9-97b5-fd1e67f661d6 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:51.363196 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-37edc000-345f-4bd9-97b5-fd1e67f661d6 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:51.365450 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-37edc000-345f-4bd9-97b5-fd1e67f661d6 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:51.366443 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-37edc000-345f-4bd9-97b5-fd1e67f661d6 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:51.368311 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-37edc000-345f-4bd9-97b5-fd1e67f661d6 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:51.369353 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-37edc000-345f-4bd9-97b5-fd1e67f661d6 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:51.656139 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-754c5f38-fe8b-4da7-a527-279a702d2ebc tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:51.672133 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-754c5f38-fe8b-4da7-a527-279a702d2ebc tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/817afb89-f414-4d1d-bc89-5357dd4e1cb8" status: 200 len: 1314 microversion: 2.1 time: 0.793313 Aug 31 16:10:51.676418 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1869/3933] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:50 2022] GET /compute/v2.1/servers/817afb89-f414-4d1d-bc89-5357dd4e1cb8 => generated 1314 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:51.685957 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ca17d62b-7cb1-4853-8c41-df3d6fe369a4 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:51.687198 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ca17d62b-7cb1-4853-8c41-df3d6fe369a4 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] [instance: f6f12af7-92ac-4c99-a4f7-282d970356c6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:51.721401 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca17d62b-7cb1-4853-8c41-df3d6fe369a4 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:51.723886 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca17d62b-7cb1-4853-8c41-df3d6fe369a4 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:51.729426 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca17d62b-7cb1-4853-8c41-df3d6fe369a4 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:51.738716 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca17d62b-7cb1-4853-8c41-df3d6fe369a4 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:51.739827 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca17d62b-7cb1-4853-8c41-df3d6fe369a4 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:51.744673 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca17d62b-7cb1-4853-8c41-df3d6fe369a4 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:51.756031 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:10:52.220062 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-37edc000-345f-4bd9-97b5-fd1e67f661d6 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:52.229362 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ca17d62b-7cb1-4853-8c41-df3d6fe369a4 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a631b69c25264974a5d9af3045c248f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4ea8520b024e0a8a3d8bbc2991504d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:52.233850 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-37edc000-345f-4bd9-97b5-fd1e67f661d6 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89" status: 200 len: 1391 microversion: 2.1 time: 0.901683 Aug 31 16:10:52.234623 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2065/3934] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:51 2022] GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89 => generated 1391 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:52.258469 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ca17d62b-7cb1-4853-8c41-df3d6fe369a4 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] 10.222.0.50 "GET /compute/v2.1/servers/f6f12af7-92ac-4c99-a4f7-282d970356c6" status: 200 len: 1649 microversion: 2.1 time: 0.579865 Aug 31 16:10:52.261379 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1870/3935] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:51 2022] GET /compute/v2.1/servers/f6f12af7-92ac-4c99-a4f7-282d970356c6 => generated 1649 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:52.272855 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-50902d63-72a7-4376-b97e-b647f26a6dbf tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:52.273805 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-aa8fd9c8-681a-4c00-86c2-ff03a1f779bb req-335d6416-4207-4b3f-8f91-afabbee17f33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6f12af7-92ac-4c99-a4f7-282d970356c6", "name": "network-vif-deleted", "tag": "cb1443c0-c90b-4b06-8ef8-7cc658349ef0"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:52.279094 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-50902d63-72a7-4376-b97e-b647f26a6dbf tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] [instance: 9844cf26-6118-4f36-8c4d-736062782c20] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:52.295606 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50902d63-72a7-4376-b97e-b647f26a6dbf tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:52.297183 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50902d63-72a7-4376-b97e-b647f26a6dbf tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:52.305614 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50902d63-72a7-4376-b97e-b647f26a6dbf tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:52.307633 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50902d63-72a7-4376-b97e-b647f26a6dbf tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:52.308766 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50902d63-72a7-4376-b97e-b647f26a6dbf tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:52.309816 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50902d63-72a7-4376-b97e-b647f26a6dbf tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:52.331259 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-aa8fd9c8-681a-4c00-86c2-ff03a1f779bb req-335d6416-4207-4b3f-8f91-afabbee17f33 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:52.334225 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-aa8fd9c8-681a-4c00-86c2-ff03a1f779bb req-335d6416-4207-4b3f-8f91-afabbee17f33 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:52.334693 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-aa8fd9c8-681a-4c00-86c2-ff03a1f779bb req-335d6416-4207-4b3f-8f91-afabbee17f33 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:52.402574 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-aa8fd9c8-681a-4c00-86c2-ff03a1f779bb req-335d6416-4207-4b3f-8f91-afabbee17f33 service nova] Creating event network-vif-deleted:cb1443c0-c90b-4b06-8ef8-7cc658349ef0 for instance f6f12af7-92ac-4c99-a4f7-282d970356c6 on n-h1-833090-16 Aug 31 16:10:52.447055 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-aa8fd9c8-681a-4c00-86c2-ff03a1f779bb req-335d6416-4207-4b3f-8f91-afabbee17f33 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.204842 Aug 31 16:10:52.448054 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2066/3936] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:10:52.474779 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-25cd0737-4493-4817-bbe2-70bf82a4db8c tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:52.475685 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-25cd0737-4493-4817-bbe2-70bf82a4db8c tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: 5116a4af-d819-456a-b188-7dcf94b7b35c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:52.516009 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-25cd0737-4493-4817-bbe2-70bf82a4db8c tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:52.518611 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-25cd0737-4493-4817-bbe2-70bf82a4db8c tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:52.520861 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-25cd0737-4493-4817-bbe2-70bf82a4db8c tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:52.524020 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-25cd0737-4493-4817-bbe2-70bf82a4db8c tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:52.524680 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-25cd0737-4493-4817-bbe2-70bf82a4db8c tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:52.526702 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-25cd0737-4493-4817-bbe2-70bf82a4db8c tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:52.589925 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-50902d63-72a7-4376-b97e-b647f26a6dbf tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab5d33bcaf2846cb83e0cf83f8acdd94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb60bef197c84b18aa1bfb27172dcc83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:52.600415 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-50902d63-72a7-4376-b97e-b647f26a6dbf tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] 10.222.0.50 "GET /compute/v2.1/servers/9844cf26-6118-4f36-8c4d-736062782c20" status: 200 len: 1295 microversion: 2.1 time: 0.337078 Aug 31 16:10:52.616783 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1871/3937] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:52 2022] GET /compute/v2.1/servers/9844cf26-6118-4f36-8c4d-736062782c20 => generated 1295 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:52.627485 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-c0fd7a4e-f83f-410d-8422-afc7107aaee7 req-981c15bd-e821-4cf9-999a-77fa0cf4d502 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9844cf26-6118-4f36-8c4d-736062782c20", "name": "network-vif-deleted", "tag": "4fe3a23e-879c-41bd-9f25-3777d5ae0406"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:52.647013 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c0fd7a4e-f83f-410d-8422-afc7107aaee7 req-981c15bd-e821-4cf9-999a-77fa0cf4d502 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:52.652798 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c0fd7a4e-f83f-410d-8422-afc7107aaee7 req-981c15bd-e821-4cf9-999a-77fa0cf4d502 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:52.664451 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c0fd7a4e-f83f-410d-8422-afc7107aaee7 req-981c15bd-e821-4cf9-999a-77fa0cf4d502 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:52.694468 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-c0fd7a4e-f83f-410d-8422-afc7107aaee7 req-981c15bd-e821-4cf9-999a-77fa0cf4d502 service nova] Creating event network-vif-deleted:4fe3a23e-879c-41bd-9f25-3777d5ae0406 for instance 9844cf26-6118-4f36-8c4d-736062782c20 on n-h2-833090-16 Aug 31 16:10:52.702875 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-c0fd7a4e-f83f-410d-8422-afc7107aaee7 req-981c15bd-e821-4cf9-999a-77fa0cf4d502 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081455 Aug 31 16:10:52.704704 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1872/3938] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:10:52.711116 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f87f518c-9b02-4da2-8a9b-e964fab74dec tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:52.712684 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f87f518c-9b02-4da2-8a9b-e964fab74dec tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 30d31a1b-0872-4fd2-a9a7-06067b151a68] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:52.725657 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f87f518c-9b02-4da2-8a9b-e964fab74dec tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:52.727946 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f87f518c-9b02-4da2-8a9b-e964fab74dec tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:52.728594 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f87f518c-9b02-4da2-8a9b-e964fab74dec tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:52.729712 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f87f518c-9b02-4da2-8a9b-e964fab74dec tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:52.730400 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f87f518c-9b02-4da2-8a9b-e964fab74dec tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:52.731076 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f87f518c-9b02-4da2-8a9b-e964fab74dec tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:52.882843 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f87f518c-9b02-4da2-8a9b-e964fab74dec tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:52.911637 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f87f518c-9b02-4da2-8a9b-e964fab74dec tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/30d31a1b-0872-4fd2-a9a7-06067b151a68" status: 200 len: 1278 microversion: 2.1 time: 0.205232 Aug 31 16:10:52.912250 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1873/3939] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:52 2022] GET /compute/v2.1/servers/30d31a1b-0872-4fd2-a9a7-06067b151a68 => generated 1278 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:52.934632 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-80b29d70-f69e-47e3-bc73-a1f3a10b0de7 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:52.935860 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-80b29d70-f69e-47e3-bc73-a1f3a10b0de7 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 817afb89-f414-4d1d-bc89-5357dd4e1cb8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:52.948645 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80b29d70-f69e-47e3-bc73-a1f3a10b0de7 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:52.957313 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80b29d70-f69e-47e3-bc73-a1f3a10b0de7 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:52.958275 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80b29d70-f69e-47e3-bc73-a1f3a10b0de7 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:52.959484 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80b29d70-f69e-47e3-bc73-a1f3a10b0de7 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:52.960164 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80b29d70-f69e-47e3-bc73-a1f3a10b0de7 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:52.960922 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80b29d70-f69e-47e3-bc73-a1f3a10b0de7 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:53.017236 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-25cd0737-4493-4817-bbe2-70bf82a4db8c tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:53.033715 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-25cd0737-4493-4817-bbe2-70bf82a4db8c tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c" status: 200 len: 1508 microversion: 2.1 time: 0.580045 Aug 31 16:10:53.042612 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2067/3940] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:52 2022] GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c => generated 1508 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:53.049356 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-8be5e2d9-2976-45c2-9b43-c1e58a2c1768 req-9285b3f5-d5ef-4ade-9b03-fbffde8f94d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6f12af7-92ac-4c99-a4f7-282d970356c6", "name": "network-vif-unplugged", "status": "completed", "tag": "cb1443c0-c90b-4b06-8ef8-7cc658349ef0"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:53.064687 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-8be5e2d9-2976-45c2-9b43-c1e58a2c1768 req-9285b3f5-d5ef-4ade-9b03-fbffde8f94d7 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:53.065256 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-8be5e2d9-2976-45c2-9b43-c1e58a2c1768 req-9285b3f5-d5ef-4ade-9b03-fbffde8f94d7 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:53.065864 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-8be5e2d9-2976-45c2-9b43-c1e58a2c1768 req-9285b3f5-d5ef-4ade-9b03-fbffde8f94d7 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:53.083227 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-8be5e2d9-2976-45c2-9b43-c1e58a2c1768 req-9285b3f5-d5ef-4ade-9b03-fbffde8f94d7 service nova] Creating event network-vif-unplugged:cb1443c0-c90b-4b06-8ef8-7cc658349ef0 for instance f6f12af7-92ac-4c99-a4f7-282d970356c6 on n-h1-833090-16 Aug 31 16:10:53.089306 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-8be5e2d9-2976-45c2-9b43-c1e58a2c1768 req-9285b3f5-d5ef-4ade-9b03-fbffde8f94d7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044765 Aug 31 16:10:53.090053 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2068/3941] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:10:53.099185 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d67a18d1-ef5d-42e6-b3f5-62f8bdf81896 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:53.100366 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d67a18d1-ef5d-42e6-b3f5-62f8bdf81896 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: 5116a4af-d819-456a-b188-7dcf94b7b35c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:53.110032 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d67a18d1-ef5d-42e6-b3f5-62f8bdf81896 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:53.111128 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d67a18d1-ef5d-42e6-b3f5-62f8bdf81896 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:53.112836 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d67a18d1-ef5d-42e6-b3f5-62f8bdf81896 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:53.114189 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d67a18d1-ef5d-42e6-b3f5-62f8bdf81896 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:53.115253 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d67a18d1-ef5d-42e6-b3f5-62f8bdf81896 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:53.116048 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d67a18d1-ef5d-42e6-b3f5-62f8bdf81896 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:53.337059 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-80b29d70-f69e-47e3-bc73-a1f3a10b0de7 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:53.355074 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-80b29d70-f69e-47e3-bc73-a1f3a10b0de7 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/817afb89-f414-4d1d-bc89-5357dd4e1cb8" status: 200 len: 1314 microversion: 2.1 time: 0.434375 Aug 31 16:10:53.381953 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1874/3942] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:52 2022] GET /compute/v2.1/servers/817afb89-f414-4d1d-bc89-5357dd4e1cb8 => generated 1314 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:53.393140 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-266e51a0-ca55-4e62-8f0c-d19428d1d0ca tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:53.394326 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-266e51a0-ca55-4e62-8f0c-d19428d1d0ca tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: f6e41791-366b-4790-8338-2a52f4ebed89] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:53.402379 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-266e51a0-ca55-4e62-8f0c-d19428d1d0ca tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:53.403208 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-266e51a0-ca55-4e62-8f0c-d19428d1d0ca tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:53.403925 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-266e51a0-ca55-4e62-8f0c-d19428d1d0ca tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:53.405056 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-266e51a0-ca55-4e62-8f0c-d19428d1d0ca tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:53.405941 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-266e51a0-ca55-4e62-8f0c-d19428d1d0ca tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:53.407223 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-266e51a0-ca55-4e62-8f0c-d19428d1d0ca tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:53.677447 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d67a18d1-ef5d-42e6-b3f5-62f8bdf81896 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:53.712453 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d67a18d1-ef5d-42e6-b3f5-62f8bdf81896 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c" status: 200 len: 1508 microversion: 2.1 time: 0.619356 Aug 31 16:10:53.714621 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2069/3943] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:53 2022] GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c => generated 1508 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:53.725953 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-77ef07cc-9204-43e8-94b3-e052f385e13d tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:53.727566 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-77ef07cc-9204-43e8-94b3-e052f385e13d tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] [instance: f6f12af7-92ac-4c99-a4f7-282d970356c6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:53.740088 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-77ef07cc-9204-43e8-94b3-e052f385e13d tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:53.740943 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-77ef07cc-9204-43e8-94b3-e052f385e13d tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:53.742054 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-77ef07cc-9204-43e8-94b3-e052f385e13d tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:53.744710 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-77ef07cc-9204-43e8-94b3-e052f385e13d tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:53.746070 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-77ef07cc-9204-43e8-94b3-e052f385e13d tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:53.746697 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-77ef07cc-9204-43e8-94b3-e052f385e13d tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:53.762045 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-266e51a0-ca55-4e62-8f0c-d19428d1d0ca tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:53.773341 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-266e51a0-ca55-4e62-8f0c-d19428d1d0ca tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89" status: 200 len: 1391 microversion: 2.1 time: 0.386810 Aug 31 16:10:53.786150 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-77ef07cc-9204-43e8-94b3-e052f385e13d tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] HTTP exception thrown: Instance f6f12af7-92ac-4c99-a4f7-282d970356c6 could not be found. Aug 31 16:10:53.786150 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-77ef07cc-9204-43e8-94b3-e052f385e13d tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Request method failure captured: Aug 31 16:10:53.786150 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/f6f12af7-92ac-4c99-a4f7-282d970356c6 HTTP/1.1 Aug 31 16:10:53.786150 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:10:53.786150 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:10:53.786150 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:10:53.786150 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:10:53.786150 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:10:53.786150 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:10:53.786150 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:10:53.786150 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:10:53.786150 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4euFFUO9s1y-49sFUwFB5NGjH6a2t5hgXZCY754rTg8zF_sKvvUdWBT-DWg91k6Ms7c-FgtOk6bNBlSFaypDGtehtHfycO-4sKdJCiDIeDnzn7dGuVV8Yr02Hf_mrX63Tdpj58LfTba3HbpcgMpez-A65nrOolodg_hEqFWrYcFLTM Aug 31 16:10:53.786150 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:10:53.786150 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:10:53.786150 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:10:53.786150 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:10:53.786150 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:10:53.786150 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:10:53.786150 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: fc4ea8520b024e0a8a3d8bbc2991504d Aug 31 16:10:53.786150 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServersTestManualDisk-55122600 Aug 31 16:10:53.786150 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:10:53.786150 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:10:53.786150 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fc4ea8520b024e0a8a3d8bbc2991504d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fc4ea8520b024e0a8a3d8bbc2991504d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/fc4ea8520b024e0a8a3d8bbc2991504d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_fc4ea8520b024e0a8a3d8bbc2991504d", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:10:53.786150 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServersTestManualDisk-55122600 Aug 31 16:10:53.786150 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: fc4ea8520b024e0a8a3d8bbc2991504d Aug 31 16:10:53.786150 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServersTestManualDisk-55122600 Aug 31 16:10:53.786150 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServersTestManualDisk-55122600-project Aug 31 16:10:53.786150 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:10:53.786150 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:10:53.786150 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: a631b69c25264974a5d9af3045c248f1 Aug 31 16:10:53.786150 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServersTestManualDisk-55122600-project Aug 31 16:10:53.786150 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:10:53.786150 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance f6f12af7-92ac-4c99-a4f7-282d970356c6 could not be found. Aug 31 16:10:53.786150 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'f6f12af7-92ac-4c99-a4f7-282d970356c6'} Aug 31 16:10:53.786150 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:10:53.786150 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:53.786150 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:10:53.786150 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:10:53.786150 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:10:53.786150 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:10:53.786150 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:10:53.786150 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:10:53.786150 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:10:53.786150 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:10:53.786150 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6f12af7-92ac-4c99-a4f7-282d970356c6 could not be found. Aug 31 16:10:53.786150 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:10:53.786150 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:53.786150 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:10:53.786150 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:53.786150 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:53.786150 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:53.786150 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:10:53.786150 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:10:53.786150 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:10:53.786150 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:10:53.786150 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:10:53.786150 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:10:53.786150 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:10:53.786150 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:10:53.786150 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:10:53.786150 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:10:53.794448 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6f12af7-92ac-4c99-a4f7-282d970356c6 could not be found. Aug 31 16:10:53.794448 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:10:53.794448 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:53.794448 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:10:53.794448 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:53.794448 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:53.794448 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:53.794448 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:10:53.794448 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:10:53.794448 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6f12af7-92ac-4c99-a4f7-282d970356c6 could not be found. Aug 31 16:10:53.794448 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:10:53.794448 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-77ef07cc-9204-43e8-94b3-e052f385e13d tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Returning 404 to user: Instance f6f12af7-92ac-4c99-a4f7-282d970356c6 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:10:53.794448 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-77ef07cc-9204-43e8-94b3-e052f385e13d tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] 10.222.0.50 "GET /compute/v2.1/servers/f6f12af7-92ac-4c99-a4f7-282d970356c6" status: 404 len: 111 microversion: 2.1 time: 0.069170 Aug 31 16:10:53.794448 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2070/3944] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:53 2022] GET /compute/v2.1/servers/f6f12af7-92ac-4c99-a4f7-282d970356c6 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:10:53.798279 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1875/3945] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:53 2022] GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89 => generated 1391 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:53.799501 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3667ca45-80f1-45b1-86fa-081af696cb2d tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:53.800206 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3667ca45-80f1-45b1-86fa-081af696cb2d tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] [instance: 9844cf26-6118-4f36-8c4d-736062782c20] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:53.808298 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9d320b9d-90c0-4d2c-91d8-9eddf00563e7 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "OS-DCF:diskConfig": "AUTO"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:53.812069 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9d320b9d-90c0-4d2c-91d8-9eddf00563e7 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: 5116a4af-d819-456a-b188-7dcf94b7b35c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:53.817249 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3667ca45-80f1-45b1-86fa-081af696cb2d tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:53.817757 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3667ca45-80f1-45b1-86fa-081af696cb2d tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:53.818235 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3667ca45-80f1-45b1-86fa-081af696cb2d tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:53.818954 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3667ca45-80f1-45b1-86fa-081af696cb2d tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:53.819412 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3667ca45-80f1-45b1-86fa-081af696cb2d tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:53.819837 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3667ca45-80f1-45b1-86fa-081af696cb2d tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:53.829486 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d320b9d-90c0-4d2c-91d8-9eddf00563e7 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:53.830813 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d320b9d-90c0-4d2c-91d8-9eddf00563e7 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:53.835270 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d320b9d-90c0-4d2c-91d8-9eddf00563e7 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:53.836840 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-3667ca45-80f1-45b1-86fa-081af696cb2d tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] HTTP exception thrown: Instance 9844cf26-6118-4f36-8c4d-736062782c20 could not be found. Aug 31 16:10:53.837544 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d320b9d-90c0-4d2c-91d8-9eddf00563e7 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3667ca45-80f1-45b1-86fa-081af696cb2d tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Request method failure captured: Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/9844cf26-6118-4f36-8c4d-736062782c20 HTTP/1.1 Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4fkHP9_s_Vrj4DIphBAFFeHQq3Pa_DQNtbHBDPa4VzdOqGj0YYYBc_PjdgWZlTjYzQWlMSXt7Zl0Jircp7BwVqAMq6WCGHo7HfbhyllyuVh0fiwqUx_S0Wzm7jI2UTemNfuYJMK9mDu-Pb9h3sdqQUZSCA1RovktCL2ZRZ82BAqXwE Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: cb60bef197c84b18aa1bfb27172dcc83 Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServerGroupTestJSON-1708659432 Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cb60bef197c84b18aa1bfb27172dcc83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cb60bef197c84b18aa1bfb27172dcc83"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cb60bef197c84b18aa1bfb27172dcc83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cb60bef197c84b18aa1bfb27172dcc83", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServerGroupTestJSON-1708659432 Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: cb60bef197c84b18aa1bfb27172dcc83 Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServerGroupTestJSON-1708659432 Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServerGroupTestJSON-1708659432-project Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: ab5d33bcaf2846cb83e0cf83f8acdd94 Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServerGroupTestJSON-1708659432-project Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 9844cf26-6118-4f36-8c4d-736062782c20 could not be found. Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '9844cf26-6118-4f36-8c4d-736062782c20'} Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9844cf26-6118-4f36-8c4d-736062782c20 could not be found. Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9844cf26-6118-4f36-8c4d-736062782c20 could not be found. Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:53.838484 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:10:53.844513 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:53.844513 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:53.844513 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:53.844513 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:10:53.844513 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:10:53.844513 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9844cf26-6118-4f36-8c4d-736062782c20 could not be found. Aug 31 16:10:53.844513 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:10:53.844513 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3667ca45-80f1-45b1-86fa-081af696cb2d tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Returning 404 to user: Instance 9844cf26-6118-4f36-8c4d-736062782c20 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:10:53.844513 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3667ca45-80f1-45b1-86fa-081af696cb2d tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] 10.222.0.50 "GET /compute/v2.1/servers/9844cf26-6118-4f36-8c4d-736062782c20" status: 404 len: 111 microversion: 2.1 time: 0.051422 Aug 31 16:10:53.847146 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d320b9d-90c0-4d2c-91d8-9eddf00563e7 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:53.848633 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d320b9d-90c0-4d2c-91d8-9eddf00563e7 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:53.850239 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2071/3946] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:53 2022] GET /compute/v2.1/servers/9844cf26-6118-4f36-8c4d-736062782c20 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:10:53.855551 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ac303823-e7e9-480f-9273-030f97339004 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] Calling method '.version_select at 0x7fbb4aa373a0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:53.879429 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ac303823-e7e9-480f-9273-030f97339004 tempest-ServersTestManualDisk-55122600 tempest-ServersTestManualDisk-55122600-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1327393296" status: 202 len: 0 microversion: 2.1 time: 0.027927 Aug 31 16:10:53.880494 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2072/3947] 10.222.0.50 () {58 vars in 1221 bytes} [Wed Aug 31 16:10:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1327393296 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:10:53.887314 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a48f75ad-04a3-46d3-a60e-71af8566de28 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:53.908035 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.compute.server_groups [None req-a48f75ad-04a3-46d3-a60e-71af8566de28 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Querying cell ff6ab154-5f51-4e0d-922a-904eb5aa20da(cell1) for 1 instances {{(pid=128864) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 31 16:10:53.908821 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a48f75ad-04a3-46d3-a60e-71af8566de28 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:53.909304 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a48f75ad-04a3-46d3-a60e-71af8566de28 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:53.909738 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a48f75ad-04a3-46d3-a60e-71af8566de28 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:53.952106 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a48f75ad-04a3-46d3-a60e-71af8566de28 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] 10.222.0.50 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.069816 Aug 31 16:10:53.952632 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2073/3948] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Aug 31 16:10:53 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:10:53.975936 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-bf932c57-6f62-42a3-8fbc-372568caacec tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:53.976940 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-bf932c57-6f62-42a3-8fbc-372568caacec tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 30d31a1b-0872-4fd2-a9a7-06067b151a68] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:53.982426 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:DELETE=2,nova_api:UPDATE=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:10:53.992084 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bf932c57-6f62-42a3-8fbc-372568caacec tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:53.993294 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bf932c57-6f62-42a3-8fbc-372568caacec tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:53.993755 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bf932c57-6f62-42a3-8fbc-372568caacec tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:53.994520 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bf932c57-6f62-42a3-8fbc-372568caacec tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:53.995055 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bf932c57-6f62-42a3-8fbc-372568caacec tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:53.995501 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bf932c57-6f62-42a3-8fbc-372568caacec tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:54.006906 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-9d320b9d-90c0-4d2c-91d8-9eddf00563e7 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:10:54.007588 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-9d320b9d-90c0-4d2c-91d8-9eddf00563e7 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:10:54.039288 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-9d320b9d-90c0-4d2c-91d8-9eddf00563e7 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:10:54.039985 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-9d320b9d-90c0-4d2c-91d8-9eddf00563e7 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:10:54.040602 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-9d320b9d-90c0-4d2c-91d8-9eddf00563e7 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:10:54.186789 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-bf932c57-6f62-42a3-8fbc-372568caacec tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:54.200944 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-bf932c57-6f62-42a3-8fbc-372568caacec tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/30d31a1b-0872-4fd2-a9a7-06067b151a68" status: 200 len: 1278 microversion: 2.1 time: 0.237526 Aug 31 16:10:54.210777 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2074/3949] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:53 2022] GET /compute/v2.1/servers/30d31a1b-0872-4fd2-a9a7-06067b151a68 => generated 1278 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:54.225459 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9d320b9d-90c0-4d2c-91d8-9eddf00563e7 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: 5116a4af-d819-456a-b188-7dcf94b7b35c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:54.293344 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6555ca48-a192-42ff-9a5d-2b311b9ca1f5 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:54.335205 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d320b9d-90c0-4d2c-91d8-9eddf00563e7 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:54.347100 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d320b9d-90c0-4d2c-91d8-9eddf00563e7 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:54.352748 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d320b9d-90c0-4d2c-91d8-9eddf00563e7 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:54.360513 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d320b9d-90c0-4d2c-91d8-9eddf00563e7 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:54.365509 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d320b9d-90c0-4d2c-91d8-9eddf00563e7 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:54.370627 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d320b9d-90c0-4d2c-91d8-9eddf00563e7 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:54.448186 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.compute.server_groups [None req-6555ca48-a192-42ff-9a5d-2b311b9ca1f5 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Querying cell ff6ab154-5f51-4e0d-922a-904eb5aa20da(cell1) for 1 instances {{(pid=128864) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 31 16:10:54.452453 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6555ca48-a192-42ff-9a5d-2b311b9ca1f5 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:54.453912 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6555ca48-a192-42ff-9a5d-2b311b9ca1f5 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:54.456279 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6555ca48-a192-42ff-9a5d-2b311b9ca1f5 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:54.462152 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=10 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:10:54.514518 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9d320b9d-90c0-4d2c-91d8-9eddf00563e7 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "POST /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c/action" status: 202 len: 1110 microversion: 2.1 time: 0.714010 Aug 31 16:10:54.520359 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6555ca48-a192-42ff-9a5d-2b311b9ca1f5 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] 10.222.0.50 "GET /compute/v2.1/os-server-groups/223532c7-d681-4adc-9f43-915273068c99" status: 200 len: 184 microversion: 2.1 time: 0.308144 Aug 31 16:10:54.532214 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1876/3950] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:10:53 2022] POST /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c/action => generated 1110 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 31 16:10:54.533299 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2075/3951] 10.222.0.50 () {58 vars in 1263 bytes} [Wed Aug 31 16:10:54 2022] GET /compute/v2.1/os-server-groups/223532c7-d681-4adc-9f43-915273068c99 => generated 184 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:10:54.548851 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a5e0287c-8723-43fe-a44b-e1b3cb073f08 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:54.558544 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9d648d29-5a51-4a9d-816c-0b6bc55bd1eb tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:54.559663 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9d648d29-5a51-4a9d-816c-0b6bc55bd1eb tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 817afb89-f414-4d1d-bc89-5357dd4e1cb8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:54.565646 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a5e0287c-8723-43fe-a44b-e1b3cb073f08 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] [instance: 9844cf26-6118-4f36-8c4d-736062782c20] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:54.587428 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5e0287c-8723-43fe-a44b-e1b3cb073f08 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:54.588553 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5e0287c-8723-43fe-a44b-e1b3cb073f08 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:54.588815 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d648d29-5a51-4a9d-816c-0b6bc55bd1eb tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:54.589527 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d648d29-5a51-4a9d-816c-0b6bc55bd1eb tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:54.590063 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d648d29-5a51-4a9d-816c-0b6bc55bd1eb tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:54.594352 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d648d29-5a51-4a9d-816c-0b6bc55bd1eb tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:54.594986 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d648d29-5a51-4a9d-816c-0b6bc55bd1eb tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:54.596422 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d648d29-5a51-4a9d-816c-0b6bc55bd1eb tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:54.612135 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5e0287c-8723-43fe-a44b-e1b3cb073f08 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:54.614343 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5e0287c-8723-43fe-a44b-e1b3cb073f08 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:54.617041 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5e0287c-8723-43fe-a44b-e1b3cb073f08 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:54.622713 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5e0287c-8723-43fe-a44b-e1b3cb073f08 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:54.717046 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-a5e0287c-8723-43fe-a44b-e1b3cb073f08 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] HTTP exception thrown: Instance 9844cf26-6118-4f36-8c4d-736062782c20 could not be found. Aug 31 16:10:54.736921 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a5e0287c-8723-43fe-a44b-e1b3cb073f08 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Request method failure captured: Aug 31 16:10:54.736921 n-d-833090-16 devstack@n-api.service[128864]: request: DELETE /compute/v2.1/servers/9844cf26-6118-4f36-8c4d-736062782c20 HTTP/1.1 Aug 31 16:10:54.736921 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:10:54.736921 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:10:54.736921 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:10:54.736921 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:10:54.736921 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:10:54.736921 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:10:54.736921 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:10:54.736921 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:10:54.736921 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4fkHP9_s_Vrj4DIphBAFFeHQq3Pa_DQNtbHBDPa4VzdOqGj0YYYBc_PjdgWZlTjYzQWlMSXt7Zl0Jircp7BwVqAMq6WCGHo7HfbhyllyuVh0fiwqUx_S0Wzm7jI2UTemNfuYJMK9mDu-Pb9h3sdqQUZSCA1RovktCL2ZRZ82BAqXwE Aug 31 16:10:54.736921 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:10:54.736921 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:10:54.736921 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:10:54.736921 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:10:54.736921 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:10:54.736921 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:10:54.736921 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: cb60bef197c84b18aa1bfb27172dcc83 Aug 31 16:10:54.736921 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServerGroupTestJSON-1708659432 Aug 31 16:10:54.736921 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:10:54.736921 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:10:54.736921 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cb60bef197c84b18aa1bfb27172dcc83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cb60bef197c84b18aa1bfb27172dcc83"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cb60bef197c84b18aa1bfb27172dcc83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cb60bef197c84b18aa1bfb27172dcc83", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:10:54.736921 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServerGroupTestJSON-1708659432 Aug 31 16:10:54.736921 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: cb60bef197c84b18aa1bfb27172dcc83 Aug 31 16:10:54.736921 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServerGroupTestJSON-1708659432 Aug 31 16:10:54.736921 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServerGroupTestJSON-1708659432-project Aug 31 16:10:54.736921 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:10:54.736921 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:10:54.736921 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: ab5d33bcaf2846cb83e0cf83f8acdd94 Aug 31 16:10:54.736921 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServerGroupTestJSON-1708659432-project Aug 31 16:10:54.736921 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:10:54.736921 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 9844cf26-6118-4f36-8c4d-736062782c20 could not be found. Aug 31 16:10:54.736921 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '9844cf26-6118-4f36-8c4d-736062782c20'} Aug 31 16:10:54.736921 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:10:54.736921 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:54.736921 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:10:54.736921 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:10:54.736921 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:10:54.736921 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:10:54.736921 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:10:54.736921 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:10:54.736921 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:10:54.736921 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:10:54.736921 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9844cf26-6118-4f36-8c4d-736062782c20 could not be found. Aug 31 16:10:54.736921 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:10:54.736921 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:54.736921 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:10:54.736921 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:54.736921 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:54.736921 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:54.736921 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:10:54.736921 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:10:54.736921 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:10:54.736921 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:10:54.736921 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:10:54.736921 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:10:54.736921 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:10:54.736921 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:10:54.736921 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:10:54.736921 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:10:54.736921 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:10:54.736921 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:10:54.741491 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9844cf26-6118-4f36-8c4d-736062782c20 could not be found. Aug 31 16:10:54.741491 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:10:54.741491 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:54.741491 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:10:54.741491 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:54.741491 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:54.741491 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:54.741491 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:10:54.741491 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:10:54.741491 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9844cf26-6118-4f36-8c4d-736062782c20 could not be found. Aug 31 16:10:54.741491 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:10:54.741491 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a5e0287c-8723-43fe-a44b-e1b3cb073f08 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Returning 404 to user: Instance 9844cf26-6118-4f36-8c4d-736062782c20 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:10:54.741491 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a5e0287c-8723-43fe-a44b-e1b3cb073f08 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] 10.222.0.50 "DELETE /compute/v2.1/servers/9844cf26-6118-4f36-8c4d-736062782c20" status: 404 len: 111 microversion: 2.1 time: 0.203566 Aug 31 16:10:54.752439 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2076/3952] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:10:54 2022] DELETE /compute/v2.1/servers/9844cf26-6118-4f36-8c4d-736062782c20 => generated 111 bytes in 218 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:10:54.768386 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1c267f50-e4dd-4576-82ed-ff8f26873965 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:54.769147 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1c267f50-e4dd-4576-82ed-ff8f26873965 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: 5116a4af-d819-456a-b188-7dcf94b7b35c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:54.791340 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1c267f50-e4dd-4576-82ed-ff8f26873965 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:54.792067 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1c267f50-e4dd-4576-82ed-ff8f26873965 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:54.792686 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1c267f50-e4dd-4576-82ed-ff8f26873965 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:54.793561 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1c267f50-e4dd-4576-82ed-ff8f26873965 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:54.797462 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1c267f50-e4dd-4576-82ed-ff8f26873965 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:54.798524 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1c267f50-e4dd-4576-82ed-ff8f26873965 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:55.844040 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9d648d29-5a51-4a9d-816c-0b6bc55bd1eb tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:55.862955 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9d648d29-5a51-4a9d-816c-0b6bc55bd1eb tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/817afb89-f414-4d1d-bc89-5357dd4e1cb8" status: 200 len: 1314 microversion: 2.1 time: 1.323195 Aug 31 16:10:55.866394 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1877/3953] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:54 2022] GET /compute/v2.1/servers/817afb89-f414-4d1d-bc89-5357dd4e1cb8 => generated 1314 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:55.887482 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4b608bb8-c0bf-4ab9-8cb0-be63eea0a60b tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:55.888161 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4b608bb8-c0bf-4ab9-8cb0-be63eea0a60b tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] [instance: 9844cf26-6118-4f36-8c4d-736062782c20] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:55.904642 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b608bb8-c0bf-4ab9-8cb0-be63eea0a60b tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:55.905298 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b608bb8-c0bf-4ab9-8cb0-be63eea0a60b tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:55.905963 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b608bb8-c0bf-4ab9-8cb0-be63eea0a60b tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:55.907875 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b608bb8-c0bf-4ab9-8cb0-be63eea0a60b tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:55.908645 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b608bb8-c0bf-4ab9-8cb0-be63eea0a60b tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:55.909139 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b608bb8-c0bf-4ab9-8cb0-be63eea0a60b tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:55.958959 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-4b608bb8-c0bf-4ab9-8cb0-be63eea0a60b tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] HTTP exception thrown: Instance 9844cf26-6118-4f36-8c4d-736062782c20 could not be found. Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4b608bb8-c0bf-4ab9-8cb0-be63eea0a60b tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Request method failure captured: Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/9844cf26-6118-4f36-8c4d-736062782c20 HTTP/1.1 Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4fkHP9_s_Vrj4DIphBAFFeHQq3Pa_DQNtbHBDPa4VzdOqGj0YYYBc_PjdgWZlTjYzQWlMSXt7Zl0Jircp7BwVqAMq6WCGHo7HfbhyllyuVh0fiwqUx_S0Wzm7jI2UTemNfuYJMK9mDu-Pb9h3sdqQUZSCA1RovktCL2ZRZ82BAqXwE Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: cb60bef197c84b18aa1bfb27172dcc83 Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerGroupTestJSON-1708659432 Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cb60bef197c84b18aa1bfb27172dcc83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cb60bef197c84b18aa1bfb27172dcc83"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cb60bef197c84b18aa1bfb27172dcc83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cb60bef197c84b18aa1bfb27172dcc83", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServerGroupTestJSON-1708659432 Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: cb60bef197c84b18aa1bfb27172dcc83 Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerGroupTestJSON-1708659432 Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServerGroupTestJSON-1708659432-project Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: ab5d33bcaf2846cb83e0cf83f8acdd94 Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServerGroupTestJSON-1708659432-project Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 9844cf26-6118-4f36-8c4d-736062782c20 could not be found. Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '9844cf26-6118-4f36-8c4d-736062782c20'} Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9844cf26-6118-4f36-8c4d-736062782c20 could not be found. Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9844cf26-6118-4f36-8c4d-736062782c20 could not be found. Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:55.962567 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:10:55.967050 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:55.967050 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:55.967050 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:55.967050 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:10:55.967050 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:10:55.967050 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9844cf26-6118-4f36-8c4d-736062782c20 could not be found. Aug 31 16:10:55.967050 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:10:55.977830 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4b608bb8-c0bf-4ab9-8cb0-be63eea0a60b tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Returning 404 to user: Instance 9844cf26-6118-4f36-8c4d-736062782c20 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:10:55.979172 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4b608bb8-c0bf-4ab9-8cb0-be63eea0a60b tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] 10.222.0.50 "GET /compute/v2.1/servers/9844cf26-6118-4f36-8c4d-736062782c20" status: 404 len: 111 microversion: 2.1 time: 0.108739 Aug 31 16:10:55.980295 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1878/3954] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:55 2022] GET /compute/v2.1/servers/9844cf26-6118-4f36-8c4d-736062782c20 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:10:55.987988 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-929a36f4-f036-46eb-af62-e6327cdac899 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:55.990124 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1c267f50-e4dd-4576-82ed-ff8f26873965 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:55.994556 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-929a36f4-f036-46eb-af62-e6327cdac899 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: f6e41791-366b-4790-8338-2a52f4ebed89] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:56.007447 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1c267f50-e4dd-4576-82ed-ff8f26873965 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c" status: 200 len: 1515 microversion: 2.1 time: 1.252320 Aug 31 16:10:56.010902 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2077/3955] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:54 2022] GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c => generated 1515 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:56.012437 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-929a36f4-f036-46eb-af62-e6327cdac899 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:56.013219 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-929a36f4-f036-46eb-af62-e6327cdac899 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:56.014292 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-929a36f4-f036-46eb-af62-e6327cdac899 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:56.015395 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-929a36f4-f036-46eb-af62-e6327cdac899 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:56.018341 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a3e92def-df9f-4b60-820d-c2d795c5697f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:56.019758 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-929a36f4-f036-46eb-af62-e6327cdac899 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:56.020777 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-929a36f4-f036-46eb-af62-e6327cdac899 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:56.021176 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a3e92def-df9f-4b60-820d-c2d795c5697f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 30d31a1b-0872-4fd2-a9a7-06067b151a68] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:56.038480 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a3e92def-df9f-4b60-820d-c2d795c5697f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:56.039151 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a3e92def-df9f-4b60-820d-c2d795c5697f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:56.039696 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a3e92def-df9f-4b60-820d-c2d795c5697f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:56.040569 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a3e92def-df9f-4b60-820d-c2d795c5697f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:56.041180 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a3e92def-df9f-4b60-820d-c2d795c5697f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:56.041837 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a3e92def-df9f-4b60-820d-c2d795c5697f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:56.472858 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-929a36f4-f036-46eb-af62-e6327cdac899 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:56.483448 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-929a36f4-f036-46eb-af62-e6327cdac899 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89" status: 200 len: 1391 microversion: 2.1 time: 0.501734 Aug 31 16:10:56.495225 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1879/3956] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:55 2022] GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89 => generated 1391 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:56.500824 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-3e15bd3c-96fa-4e6b-a22c-c933aa04e1cb req-af868504-5d5e-4174-b0b0-e5ca5fd13e80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "817afb89-f414-4d1d-bc89-5357dd4e1cb8", "name": "network-vif-plugged", "status": "completed", "tag": "0d01462c-4840-4402-8f7a-ce1a7f173698"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:56.518547 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3e15bd3c-96fa-4e6b-a22c-c933aa04e1cb req-af868504-5d5e-4174-b0b0-e5ca5fd13e80 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:56.522932 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3e15bd3c-96fa-4e6b-a22c-c933aa04e1cb req-af868504-5d5e-4174-b0b0-e5ca5fd13e80 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:56.523731 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3e15bd3c-96fa-4e6b-a22c-c933aa04e1cb req-af868504-5d5e-4174-b0b0-e5ca5fd13e80 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:56.556749 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-3e15bd3c-96fa-4e6b-a22c-c933aa04e1cb req-af868504-5d5e-4174-b0b0-e5ca5fd13e80 service nova] Creating event network-vif-plugged:0d01462c-4840-4402-8f7a-ce1a7f173698 for instance 817afb89-f414-4d1d-bc89-5357dd4e1cb8 on n-h2-833090-16 Aug 31 16:10:56.570657 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-3e15bd3c-96fa-4e6b-a22c-c933aa04e1cb req-af868504-5d5e-4174-b0b0-e5ca5fd13e80 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071095 Aug 31 16:10:56.571405 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1880/3957] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:10:56.585096 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a3e92def-df9f-4b60-820d-c2d795c5697f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:56.587914 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=100 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:10:56.593663 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-637db270-83f8-4ad0-a7f6-e4adf880fea2 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:56.601139 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a3e92def-df9f-4b60-820d-c2d795c5697f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/30d31a1b-0872-4fd2-a9a7-06067b151a68" status: 200 len: 1320 microversion: 2.1 time: 0.589071 Aug 31 16:10:56.605075 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2078/3958] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:56 2022] GET /compute/v2.1/servers/30d31a1b-0872-4fd2-a9a7-06067b151a68 => generated 1320 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:56.653436 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-637db270-83f8-4ad0-a7f6-e4adf880fea2 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] HTTP exception thrown: Instance group 41f47d2b-969b-4714-bdbd-390b39e2da08 could not be found. Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-637db270-83f8-4ad0-a7f6-e4adf880fea2 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Request method failure captured: Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/os-server-groups/41f47d2b-969b-4714-bdbd-390b39e2da08 HTTP/1.1 Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4fkHP9_s_Vrj4DIphBAFFeHQq3Pa_DQNtbHBDPa4VzdOqGj0YYYBc_PjdgWZlTjYzQWlMSXt7Zl0Jircp7BwVqAMq6WCGHo7HfbhyllyuVh0fiwqUx_S0Wzm7jI2UTemNfuYJMK9mDu-Pb9h3sdqQUZSCA1RovktCL2ZRZ82BAqXwE Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: cb60bef197c84b18aa1bfb27172dcc83 Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerGroupTestJSON-1708659432 Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cb60bef197c84b18aa1bfb27172dcc83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cb60bef197c84b18aa1bfb27172dcc83"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cb60bef197c84b18aa1bfb27172dcc83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cb60bef197c84b18aa1bfb27172dcc83", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServerGroupTestJSON-1708659432 Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: cb60bef197c84b18aa1bfb27172dcc83 Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerGroupTestJSON-1708659432 Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServerGroupTestJSON-1708659432-project Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: ab5d33bcaf2846cb83e0cf83f8acdd94 Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServerGroupTestJSON-1708659432-project Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance group 41f47d2b-969b-4714-bdbd-390b39e2da08 could not be found. Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '41f47d2b-969b-4714-bdbd-390b39e2da08'} Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 41f47d2b-969b-4714-bdbd-390b39e2da08 could not be found. Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 41f47d2b-969b-4714-bdbd-390b39e2da08 could not be found. Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:10:56.667976 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:56.672176 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:56.672176 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:56.672176 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:10:56.672176 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:10:56.672176 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 41f47d2b-969b-4714-bdbd-390b39e2da08 could not be found. Aug 31 16:10:56.672176 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:10:56.676225 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-637db270-83f8-4ad0-a7f6-e4adf880fea2 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Returning 404 to user: Instance group 41f47d2b-969b-4714-bdbd-390b39e2da08 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:10:56.679301 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-637db270-83f8-4ad0-a7f6-e4adf880fea2 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/41f47d2b-969b-4714-bdbd-390b39e2da08" status: 404 len: 117 microversion: 2.1 time: 0.098934 Aug 31 16:10:56.683344 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1881/3959] 10.222.0.50 () {58 vars in 1266 bytes} [Wed Aug 31 16:10:56 2022] DELETE /compute/v2.1/os-server-groups/41f47d2b-969b-4714-bdbd-390b39e2da08 => generated 117 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:10:56.692678 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-58c0eac3-f268-4e5c-ba4a-4893467c8ec9 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:56.701333 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-58c0eac3-f268-4e5c-ba4a-4893467c8ec9 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] HTTP exception thrown: Instance group cbeee18d-37fd-4f08-b103-0f7bcee8985b could not be found. Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-58c0eac3-f268-4e5c-ba4a-4893467c8ec9 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Request method failure captured: Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: request: DELETE /compute/v2.1/os-server-groups/cbeee18d-37fd-4f08-b103-0f7bcee8985b HTTP/1.1 Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4fkHP9_s_Vrj4DIphBAFFeHQq3Pa_DQNtbHBDPa4VzdOqGj0YYYBc_PjdgWZlTjYzQWlMSXt7Zl0Jircp7BwVqAMq6WCGHo7HfbhyllyuVh0fiwqUx_S0Wzm7jI2UTemNfuYJMK9mDu-Pb9h3sdqQUZSCA1RovktCL2ZRZ82BAqXwE Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: cb60bef197c84b18aa1bfb27172dcc83 Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServerGroupTestJSON-1708659432 Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cb60bef197c84b18aa1bfb27172dcc83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cb60bef197c84b18aa1bfb27172dcc83"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cb60bef197c84b18aa1bfb27172dcc83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cb60bef197c84b18aa1bfb27172dcc83", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServerGroupTestJSON-1708659432 Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: cb60bef197c84b18aa1bfb27172dcc83 Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServerGroupTestJSON-1708659432 Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServerGroupTestJSON-1708659432-project Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: ab5d33bcaf2846cb83e0cf83f8acdd94 Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServerGroupTestJSON-1708659432-project Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance group cbeee18d-37fd-4f08-b103-0f7bcee8985b could not be found. Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'cbeee18d-37fd-4f08-b103-0f7bcee8985b'} Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group cbeee18d-37fd-4f08-b103-0f7bcee8985b could not be found. Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group cbeee18d-37fd-4f08-b103-0f7bcee8985b could not be found. Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:10:56.702968 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:56.708389 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:56.708389 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:56.708389 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:10:56.708389 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:10:56.708389 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group cbeee18d-37fd-4f08-b103-0f7bcee8985b could not be found. Aug 31 16:10:56.708389 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:10:56.708389 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-58c0eac3-f268-4e5c-ba4a-4893467c8ec9 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Returning 404 to user: Instance group cbeee18d-37fd-4f08-b103-0f7bcee8985b could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:10:56.708389 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-58c0eac3-f268-4e5c-ba4a-4893467c8ec9 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/cbeee18d-37fd-4f08-b103-0f7bcee8985b" status: 404 len: 117 microversion: 2.1 time: 0.015606 Aug 31 16:10:56.708389 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2079/3960] 10.222.0.50 () {58 vars in 1266 bytes} [Wed Aug 31 16:10:56 2022] DELETE /compute/v2.1/os-server-groups/cbeee18d-37fd-4f08-b103-0f7bcee8985b => generated 117 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:10:56.719391 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4fdd6404-f47a-4215-a6d5-e639a023c2bf tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:56.733005 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-4fdd6404-f47a-4215-a6d5-e639a023c2bf tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] HTTP exception thrown: Instance group 163c1bba-391e-4cff-a9dc-c98ea6220c97 could not be found. Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4fdd6404-f47a-4215-a6d5-e639a023c2bf tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Request method failure captured: Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/os-server-groups/163c1bba-391e-4cff-a9dc-c98ea6220c97 HTTP/1.1 Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4fkHP9_s_Vrj4DIphBAFFeHQq3Pa_DQNtbHBDPa4VzdOqGj0YYYBc_PjdgWZlTjYzQWlMSXt7Zl0Jircp7BwVqAMq6WCGHo7HfbhyllyuVh0fiwqUx_S0Wzm7jI2UTemNfuYJMK9mDu-Pb9h3sdqQUZSCA1RovktCL2ZRZ82BAqXwE Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: cb60bef197c84b18aa1bfb27172dcc83 Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerGroupTestJSON-1708659432 Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cb60bef197c84b18aa1bfb27172dcc83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cb60bef197c84b18aa1bfb27172dcc83"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cb60bef197c84b18aa1bfb27172dcc83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cb60bef197c84b18aa1bfb27172dcc83", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServerGroupTestJSON-1708659432 Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: cb60bef197c84b18aa1bfb27172dcc83 Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerGroupTestJSON-1708659432 Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServerGroupTestJSON-1708659432-project Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: ab5d33bcaf2846cb83e0cf83f8acdd94 Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServerGroupTestJSON-1708659432-project Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance group 163c1bba-391e-4cff-a9dc-c98ea6220c97 could not be found. Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '163c1bba-391e-4cff-a9dc-c98ea6220c97'} Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 163c1bba-391e-4cff-a9dc-c98ea6220c97 could not be found. Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 163c1bba-391e-4cff-a9dc-c98ea6220c97 could not be found. Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:10:56.735172 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:56.739297 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:56.739297 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:56.739297 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:10:56.739297 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:10:56.739297 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 163c1bba-391e-4cff-a9dc-c98ea6220c97 could not be found. Aug 31 16:10:56.739297 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:10:56.742229 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4fdd6404-f47a-4215-a6d5-e639a023c2bf tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Returning 404 to user: Instance group 163c1bba-391e-4cff-a9dc-c98ea6220c97 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:10:56.743541 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4fdd6404-f47a-4215-a6d5-e639a023c2bf tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/163c1bba-391e-4cff-a9dc-c98ea6220c97" status: 404 len: 117 microversion: 2.1 time: 0.030646 Aug 31 16:10:56.744967 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1882/3961] 10.222.0.50 () {58 vars in 1266 bytes} [Wed Aug 31 16:10:56 2022] DELETE /compute/v2.1/os-server-groups/163c1bba-391e-4cff-a9dc-c98ea6220c97 => generated 117 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:10:56.759740 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-efa95c65-65b6-4625-9644-1c3355918623 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:56.770602 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-efa95c65-65b6-4625-9644-1c3355918623 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] HTTP exception thrown: Instance group 96548961-d693-4010-9586-442155be69ae could not be found. Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-efa95c65-65b6-4625-9644-1c3355918623 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Request method failure captured: Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: request: DELETE /compute/v2.1/os-server-groups/96548961-d693-4010-9586-442155be69ae HTTP/1.1 Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4fkHP9_s_Vrj4DIphBAFFeHQq3Pa_DQNtbHBDPa4VzdOqGj0YYYBc_PjdgWZlTjYzQWlMSXt7Zl0Jircp7BwVqAMq6WCGHo7HfbhyllyuVh0fiwqUx_S0Wzm7jI2UTemNfuYJMK9mDu-Pb9h3sdqQUZSCA1RovktCL2ZRZ82BAqXwE Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: cb60bef197c84b18aa1bfb27172dcc83 Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServerGroupTestJSON-1708659432 Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cb60bef197c84b18aa1bfb27172dcc83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cb60bef197c84b18aa1bfb27172dcc83"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cb60bef197c84b18aa1bfb27172dcc83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cb60bef197c84b18aa1bfb27172dcc83", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServerGroupTestJSON-1708659432 Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: cb60bef197c84b18aa1bfb27172dcc83 Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServerGroupTestJSON-1708659432 Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServerGroupTestJSON-1708659432-project Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: ab5d33bcaf2846cb83e0cf83f8acdd94 Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServerGroupTestJSON-1708659432-project Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance group 96548961-d693-4010-9586-442155be69ae could not be found. Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '96548961-d693-4010-9586-442155be69ae'} Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 96548961-d693-4010-9586-442155be69ae could not be found. Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 96548961-d693-4010-9586-442155be69ae could not be found. Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:10:56.773636 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:10:56.777597 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:10:56.777597 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:10:56.777597 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:10:56.777597 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:10:56.777597 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 96548961-d693-4010-9586-442155be69ae could not be found. Aug 31 16:10:56.777597 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:10:56.780135 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-efa95c65-65b6-4625-9644-1c3355918623 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Returning 404 to user: Instance group 96548961-d693-4010-9586-442155be69ae could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:10:56.782816 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-efa95c65-65b6-4625-9644-1c3355918623 tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/96548961-d693-4010-9586-442155be69ae" status: 404 len: 117 microversion: 2.1 time: 0.030174 Aug 31 16:10:56.784365 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2080/3962] 10.222.0.50 () {58 vars in 1266 bytes} [Wed Aug 31 16:10:56 2022] DELETE /compute/v2.1/os-server-groups/96548961-d693-4010-9586-442155be69ae => generated 117 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:10:56.792754 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2589894d-d1b2-4b88-a196-1bc7424a3fad tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:56.843994 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2589894d-d1b2-4b88-a196-1bc7424a3fad tempest-ServerGroupTestJSON-1708659432 tempest-ServerGroupTestJSON-1708659432-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/223532c7-d681-4adc-9f43-915273068c99" status: 204 len: 0 microversion: 2.1 time: 0.054869 Aug 31 16:10:56.845369 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1883/3963] 10.222.0.50 () {58 vars in 1266 bytes} [Wed Aug 31 16:10:56 2022] DELETE /compute/v2.1/os-server-groups/223532c7-d681-4adc-9f43-915273068c99 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:10:56.890629 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-81f97518-1c9e-4421-b298-0761dbe73c7f tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:56.891593 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-81f97518-1c9e-4421-b298-0761dbe73c7f tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 817afb89-f414-4d1d-bc89-5357dd4e1cb8] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:56.908077 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-81f97518-1c9e-4421-b298-0761dbe73c7f tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:56.910926 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-81f97518-1c9e-4421-b298-0761dbe73c7f tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:56.911678 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-81f97518-1c9e-4421-b298-0761dbe73c7f tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:56.912655 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-81f97518-1c9e-4421-b298-0761dbe73c7f tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:56.916810 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-81f97518-1c9e-4421-b298-0761dbe73c7f tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:56.920513 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-81f97518-1c9e-4421-b298-0761dbe73c7f tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:57.039343 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6c6d79a1-e976-4fee-88d2-36771d425286 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:57.040559 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6c6d79a1-e976-4fee-88d2-36771d425286 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: 5116a4af-d819-456a-b188-7dcf94b7b35c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:57.055623 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c6d79a1-e976-4fee-88d2-36771d425286 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:57.056195 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c6d79a1-e976-4fee-88d2-36771d425286 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:57.058804 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c6d79a1-e976-4fee-88d2-36771d425286 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:57.070003 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c6d79a1-e976-4fee-88d2-36771d425286 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:57.070003 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c6d79a1-e976-4fee-88d2-36771d425286 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:57.070003 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c6d79a1-e976-4fee-88d2-36771d425286 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:57.819060 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6c6d79a1-e976-4fee-88d2-36771d425286 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:57.829725 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6c6d79a1-e976-4fee-88d2-36771d425286 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c" status: 200 len: 1515 microversion: 2.1 time: 0.795735 Aug 31 16:10:57.842773 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1884/3964] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:57 2022] GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c => generated 1515 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:57.849885 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-931ab199-2985-48d6-ab2d-0bf9f387cfda req-57a49cb9-4bda-4a7f-b330-eba637d1a588 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30d31a1b-0872-4fd2-a9a7-06067b151a68", "tag": "7fee9d54-ce6f-4bad-8db6-1ed766cd69e1"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:57.874718 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-931ab199-2985-48d6-ab2d-0bf9f387cfda req-57a49cb9-4bda-4a7f-b330-eba637d1a588 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:57.875333 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-931ab199-2985-48d6-ab2d-0bf9f387cfda req-57a49cb9-4bda-4a7f-b330-eba637d1a588 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:57.875632 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-931ab199-2985-48d6-ab2d-0bf9f387cfda req-57a49cb9-4bda-4a7f-b330-eba637d1a588 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:57.891296 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-81f97518-1c9e-4421-b298-0761dbe73c7f tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:57.908297 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-81f97518-1c9e-4421-b298-0761dbe73c7f tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/817afb89-f414-4d1d-bc89-5357dd4e1cb8" status: 200 len: 1314 microversion: 2.1 time: 1.024520 Aug 31 16:10:57.908524 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-931ab199-2985-48d6-ab2d-0bf9f387cfda req-57a49cb9-4bda-4a7f-b330-eba637d1a588 service nova] Creating event network-changed:7fee9d54-ce6f-4bad-8db6-1ed766cd69e1 for instance 30d31a1b-0872-4fd2-a9a7-06067b151a68 on n-h2-833090-16 Aug 31 16:10:57.909141 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2081/3965] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:56 2022] GET /compute/v2.1/servers/817afb89-f414-4d1d-bc89-5357dd4e1cb8 => generated 1314 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:57.915403 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-931ab199-2985-48d6-ab2d-0bf9f387cfda req-57a49cb9-4bda-4a7f-b330-eba637d1a588 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071120 Aug 31 16:10:57.917419 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1885/3966] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:10:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:10:57.919811 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9671e25e-c190-427d-915c-54b77a148bc1 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:57.920798 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9671e25e-c190-427d-915c-54b77a148bc1 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: f6e41791-366b-4790-8338-2a52f4ebed89] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:57.940355 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b4c027ba-89ce-4b6c-8465-9501a9aa1f04 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:57.942406 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b4c027ba-89ce-4b6c-8465-9501a9aa1f04 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 30d31a1b-0872-4fd2-a9a7-06067b151a68] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:57.947715 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9671e25e-c190-427d-915c-54b77a148bc1 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:57.948464 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9671e25e-c190-427d-915c-54b77a148bc1 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:57.950864 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9671e25e-c190-427d-915c-54b77a148bc1 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:57.952317 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9671e25e-c190-427d-915c-54b77a148bc1 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:57.955645 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4c027ba-89ce-4b6c-8465-9501a9aa1f04 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:57.957478 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4c027ba-89ce-4b6c-8465-9501a9aa1f04 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:57.958419 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4c027ba-89ce-4b6c-8465-9501a9aa1f04 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:57.958772 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9671e25e-c190-427d-915c-54b77a148bc1 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:57.959279 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9671e25e-c190-427d-915c-54b77a148bc1 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:57.960551 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4c027ba-89ce-4b6c-8465-9501a9aa1f04 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:57.962163 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4c027ba-89ce-4b6c-8465-9501a9aa1f04 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:57.965364 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4c027ba-89ce-4b6c-8465-9501a9aa1f04 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:58.602790 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9671e25e-c190-427d-915c-54b77a148bc1 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:58.616463 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9671e25e-c190-427d-915c-54b77a148bc1 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89" status: 200 len: 1391 microversion: 2.1 time: 0.706138 Aug 31 16:10:58.616970 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2082/3967] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:57 2022] GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89 => generated 1391 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:58.638055 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-7fc2465c-70a2-49c3-a6cd-8f678effd27e req-7f8e56e4-13ca-480a-b925-63bd62a10fe3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6e41791-366b-4790-8338-2a52f4ebed89", "name": "network-vif-plugged", "status": "completed", "tag": "0507378d-ba87-41ae-8199-9dd64dc20873"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:10:58.660435 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7fc2465c-70a2-49c3-a6cd-8f678effd27e req-7f8e56e4-13ca-480a-b925-63bd62a10fe3 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:58.660843 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7fc2465c-70a2-49c3-a6cd-8f678effd27e req-7f8e56e4-13ca-480a-b925-63bd62a10fe3 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:58.662817 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7fc2465c-70a2-49c3-a6cd-8f678effd27e req-7f8e56e4-13ca-480a-b925-63bd62a10fe3 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:58.702679 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-7fc2465c-70a2-49c3-a6cd-8f678effd27e req-7f8e56e4-13ca-480a-b925-63bd62a10fe3 service nova] Creating event network-vif-plugged:0507378d-ba87-41ae-8199-9dd64dc20873 for instance f6e41791-366b-4790-8338-2a52f4ebed89 on n-h1-833090-16 Aug 31 16:10:58.709589 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b4c027ba-89ce-4b6c-8465-9501a9aa1f04 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:58.719012 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-7fc2465c-70a2-49c3-a6cd-8f678effd27e req-7f8e56e4-13ca-480a-b925-63bd62a10fe3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096577 Aug 31 16:10:58.721882 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2083/3968] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:10:58.727127 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b4c027ba-89ce-4b6c-8465-9501a9aa1f04 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/30d31a1b-0872-4fd2-a9a7-06067b151a68" status: 200 len: 1320 microversion: 2.1 time: 0.803643 Aug 31 16:10:58.727866 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1886/3969] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:57 2022] GET /compute/v2.1/servers/30d31a1b-0872-4fd2-a9a7-06067b151a68 => generated 1320 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:58.872237 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ea9877a4-7e05-4c2a-952e-6fcbb99b0610 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:58.873400 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ea9877a4-7e05-4c2a-952e-6fcbb99b0610 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: 5116a4af-d819-456a-b188-7dcf94b7b35c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:58.882472 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ea9877a4-7e05-4c2a-952e-6fcbb99b0610 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:58.890741 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ea9877a4-7e05-4c2a-952e-6fcbb99b0610 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:58.891841 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ea9877a4-7e05-4c2a-952e-6fcbb99b0610 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:58.892831 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ea9877a4-7e05-4c2a-952e-6fcbb99b0610 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:58.893031 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ea9877a4-7e05-4c2a-952e-6fcbb99b0610 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:58.897188 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ea9877a4-7e05-4c2a-952e-6fcbb99b0610 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:58.963221 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5a1343b9-b723-43f5-a3c6-fd013c810ef8 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:58.966534 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5a1343b9-b723-43f5-a3c6-fd013c810ef8 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 817afb89-f414-4d1d-bc89-5357dd4e1cb8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:59.009597 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a1343b9-b723-43f5-a3c6-fd013c810ef8 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:59.013725 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a1343b9-b723-43f5-a3c6-fd013c810ef8 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:59.015101 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a1343b9-b723-43f5-a3c6-fd013c810ef8 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:59.016290 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a1343b9-b723-43f5-a3c6-fd013c810ef8 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:59.016772 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a1343b9-b723-43f5-a3c6-fd013c810ef8 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:59.017200 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a1343b9-b723-43f5-a3c6-fd013c810ef8 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:59.527211 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ea9877a4-7e05-4c2a-952e-6fcbb99b0610 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:59.539722 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ea9877a4-7e05-4c2a-952e-6fcbb99b0610 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c" status: 200 len: 1515 microversion: 2.1 time: 0.671714 Aug 31 16:10:59.564419 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2084/3970] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:58 2022] GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c => generated 1515 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:59.645346 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7f51d966-a03a-46d7-abf6-aa3896008b2a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:59.645958 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7f51d966-a03a-46d7-abf6-aa3896008b2a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: f6e41791-366b-4790-8338-2a52f4ebed89] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:59.656438 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f51d966-a03a-46d7-abf6-aa3896008b2a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:59.657023 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f51d966-a03a-46d7-abf6-aa3896008b2a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:59.657742 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f51d966-a03a-46d7-abf6-aa3896008b2a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:59.658823 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f51d966-a03a-46d7-abf6-aa3896008b2a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:59.659562 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f51d966-a03a-46d7-abf6-aa3896008b2a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:59.660019 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f51d966-a03a-46d7-abf6-aa3896008b2a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:59.751125 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=8 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:10:59.812170 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=20 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:10:59.827247 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5a1343b9-b723-43f5-a3c6-fd013c810ef8 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:10:59.840757 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5a1343b9-b723-43f5-a3c6-fd013c810ef8 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/817afb89-f414-4d1d-bc89-5357dd4e1cb8" status: 200 len: 1464 microversion: 2.1 time: 0.893480 Aug 31 16:10:59.859436 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1887/3971] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:58 2022] GET /compute/v2.1/servers/817afb89-f414-4d1d-bc89-5357dd4e1cb8 => generated 1464 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:10:59.866704 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b12ec4f2-8c78-435d-950c-821c2b1ee95c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:10:59.867306 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b12ec4f2-8c78-435d-950c-821c2b1ee95c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 30d31a1b-0872-4fd2-a9a7-06067b151a68] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:10:59.871800 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:10:59.894357 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b12ec4f2-8c78-435d-950c-821c2b1ee95c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:59.898455 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b12ec4f2-8c78-435d-950c-821c2b1ee95c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:59.898956 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b12ec4f2-8c78-435d-950c-821c2b1ee95c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:10:59.899803 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b12ec4f2-8c78-435d-950c-821c2b1ee95c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:10:59.900534 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b12ec4f2-8c78-435d-950c-821c2b1ee95c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:10:59.901040 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b12ec4f2-8c78-435d-950c-821c2b1ee95c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:00.416772 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7f51d966-a03a-46d7-abf6-aa3896008b2a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:00.437592 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7f51d966-a03a-46d7-abf6-aa3896008b2a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89" status: 200 len: 1391 microversion: 2.1 time: 0.796263 Aug 31 16:11:00.450310 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2085/3972] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:59 2022] GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89 => generated 1391 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:11:00.567377 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b12ec4f2-8c78-435d-950c-821c2b1ee95c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:00.581830 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b12ec4f2-8c78-435d-950c-821c2b1ee95c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/30d31a1b-0872-4fd2-a9a7-06067b151a68" status: 200 len: 1320 microversion: 2.1 time: 0.721245 Aug 31 16:11:00.590665 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1888/3973] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:10:59 2022] GET /compute/v2.1/servers/30d31a1b-0872-4fd2-a9a7-06067b151a68 => generated 1320 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:00.610999 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f8897d74-541c-4028-b307-181a481fe965 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:00.613165 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f8897d74-541c-4028-b307-181a481fe965 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: 5116a4af-d819-456a-b188-7dcf94b7b35c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:00.658822 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8897d74-541c-4028-b307-181a481fe965 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:00.663443 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8897d74-541c-4028-b307-181a481fe965 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:00.669755 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8897d74-541c-4028-b307-181a481fe965 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:00.671072 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8897d74-541c-4028-b307-181a481fe965 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:00.673750 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8897d74-541c-4028-b307-181a481fe965 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:00.674488 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8897d74-541c-4028-b307-181a481fe965 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:00.864059 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ce394b02-e4e1-4ae0-ada0-6d6fa52c1b75 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:00.869605 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ce394b02-e4e1-4ae0-ada0-6d6fa52c1b75 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Searching by: {'deleted': False, 'project_id': '34309f8c35be44bd8d53402e1d66b468'} {{(pid=128864) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:11:00.884361 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ce394b02-e4e1-4ae0-ada0-6d6fa52c1b75 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:00.886311 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ce394b02-e4e1-4ae0-ada0-6d6fa52c1b75 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:00.886762 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ce394b02-e4e1-4ae0-ada0-6d6fa52c1b75 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:00.887568 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ce394b02-e4e1-4ae0-ada0-6d6fa52c1b75 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:00.888039 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ce394b02-e4e1-4ae0-ada0-6d6fa52c1b75 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:00.888452 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ce394b02-e4e1-4ae0-ada0-6d6fa52c1b75 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:00.986435 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ce394b02-e4e1-4ae0-ada0-6d6fa52c1b75 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.534006 Aug 31 16:11:00.989566 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2086/3974] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 31 16:11:00 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:11:01.011013 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-692570f6-b4fd-42e6-b855-264650488d84 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:01.024833 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-692570f6-b4fd-42e6-b855-264650488d84 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Searching by: {'deleted': False} {{(pid=128864) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:11:01.035023 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-692570f6-b4fd-42e6-b855-264650488d84 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:01.036648 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-692570f6-b4fd-42e6-b855-264650488d84 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:01.037638 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-692570f6-b4fd-42e6-b855-264650488d84 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:01.041920 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-692570f6-b4fd-42e6-b855-264650488d84 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:01.043151 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-692570f6-b4fd-42e6-b855-264650488d84 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:01.044007 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-692570f6-b4fd-42e6-b855-264650488d84 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:01.267054 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.multi_cell_list [None req-692570f6-b4fd-42e6-b855-264650488d84 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Listed batch of 7 results from cell out of 1000 limit. Returned 7 total so far. {{(pid=128864) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:11:01.568824 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-692570f6-b4fd-42e6-b855-264650488d84 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:01.569965 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-692570f6-b4fd-42e6-b855-264650488d84 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:01.570855 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-692570f6-b4fd-42e6-b855-264650488d84 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:02.048846 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f8897d74-541c-4028-b307-181a481fe965 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:02.062561 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f8897d74-541c-4028-b307-181a481fe965 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c" status: 200 len: 1515 microversion: 2.1 time: 1.469686 Aug 31 16:11:02.064621 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1889/3975] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:00 2022] GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c => generated 1515 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:02.073314 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-752018c7-9010-42aa-a620-64ea91615f72 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:02.074365 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-752018c7-9010-42aa-a620-64ea91615f72 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: f6e41791-366b-4790-8338-2a52f4ebed89] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:02.121996 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-752018c7-9010-42aa-a620-64ea91615f72 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:02.125068 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-752018c7-9010-42aa-a620-64ea91615f72 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:02.125651 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-752018c7-9010-42aa-a620-64ea91615f72 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:02.129547 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-752018c7-9010-42aa-a620-64ea91615f72 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:02.134869 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-752018c7-9010-42aa-a620-64ea91615f72 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:02.139044 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-752018c7-9010-42aa-a620-64ea91615f72 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:02.211374 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:11:02.738555 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-752018c7-9010-42aa-a620-64ea91615f72 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:02.778413 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-752018c7-9010-42aa-a620-64ea91615f72 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89" status: 200 len: 1564 microversion: 2.1 time: 0.700568 Aug 31 16:11:02.780505 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1890/3976] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:02 2022] GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89 => generated 1564 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:02.809972 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-645f367f-3e47-4ca2-9aa9-462e4c97382a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:02.810999 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-645f367f-3e47-4ca2-9aa9-462e4c97382a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 30d31a1b-0872-4fd2-a9a7-06067b151a68] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:02.818611 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-645f367f-3e47-4ca2-9aa9-462e4c97382a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:02.825157 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-645f367f-3e47-4ca2-9aa9-462e4c97382a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:02.825957 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-645f367f-3e47-4ca2-9aa9-462e4c97382a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:02.826994 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-645f367f-3e47-4ca2-9aa9-462e4c97382a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:02.830819 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-645f367f-3e47-4ca2-9aa9-462e4c97382a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:02.831263 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-645f367f-3e47-4ca2-9aa9-462e4c97382a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:02.852613 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-692570f6-b4fd-42e6-b855-264650488d84 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 11276 microversion: 2.1 time: 1.846069 Aug 31 16:11:02.854614 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2087/3977] 10.222.0.50 () {58 vars in 1171 bytes} [Wed Aug 31 16:11:01 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 11276 bytes in 1849 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 16:11:03.484753 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f2b86158-c66f-461c-93e9-cbbee81473f6 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-156785157", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:03.494855 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-645f367f-3e47-4ca2-9aa9-462e4c97382a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:03.516304 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-645f367f-3e47-4ca2-9aa9-462e4c97382a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/30d31a1b-0872-4fd2-a9a7-06067b151a68" status: 200 len: 1320 microversion: 2.1 time: 0.732712 Aug 31 16:11:03.518127 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1891/3978] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:02 2022] GET /compute/v2.1/servers/30d31a1b-0872-4fd2-a9a7-06067b151a68 => generated 1320 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:03.528685 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-73fa0206-4057-4d3c-895b-744ff820e0cf tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:03.530137 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-73fa0206-4057-4d3c-895b-744ff820e0cf tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: f6e41791-366b-4790-8338-2a52f4ebed89] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:03.543300 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-73fa0206-4057-4d3c-895b-744ff820e0cf tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:03.546928 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-73fa0206-4057-4d3c-895b-744ff820e0cf tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:03.548137 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-73fa0206-4057-4d3c-895b-744ff820e0cf tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:03.550010 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-73fa0206-4057-4d3c-895b-744ff820e0cf tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:03.551166 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-73fa0206-4057-4d3c-895b-744ff820e0cf tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:03.552115 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-73fa0206-4057-4d3c-895b-744ff820e0cf tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:03.617201 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-f2b86158-c66f-461c-93e9-cbbee81473f6 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] validate_networks() for [('f6ace697-e44d-4f5a-951b-7b62351dd654', None, None, None, None, None)] {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:11:03.960686 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-73fa0206-4057-4d3c-895b-744ff820e0cf tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:03.978244 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-73fa0206-4057-4d3c-895b-744ff820e0cf tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89" status: 200 len: 1564 microversion: 2.1 time: 0.458260 Aug 31 16:11:03.983481 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1892/3979] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:03 2022] GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89 => generated 1564 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:04.006413 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fcb1dc1a-aa36-41d7-9bfc-c1110e709c80 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:04.032046 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fcb1dc1a-aa36-41d7-9bfc-c1110e709c80 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Searching by: {'deleted': False, 'project_id': '34309f8c35be44bd8d53402e1d66b468'} {{(pid=128863) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:11:04.054783 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fcb1dc1a-aa36-41d7-9bfc-c1110e709c80 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:04.055275 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fcb1dc1a-aa36-41d7-9bfc-c1110e709c80 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:04.055703 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fcb1dc1a-aa36-41d7-9bfc-c1110e709c80 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:04.056422 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fcb1dc1a-aa36-41d7-9bfc-c1110e709c80 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:04.056869 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fcb1dc1a-aa36-41d7-9bfc-c1110e709c80 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:04.057285 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fcb1dc1a-aa36-41d7-9bfc-c1110e709c80 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:04.136615 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fcb1dc1a-aa36-41d7-9bfc-c1110e709c80 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/detail?tenant_id=2a9210acd39546b4b6fba9cda27a0aed" status: 200 len: 15 microversion: 2.1 time: 0.146765 Aug 31 16:11:04.137225 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1893/3980] 10.222.0.50 () {58 vars in 1231 bytes} [Wed Aug 31 16:11:03 2022] GET /compute/v2.1/servers/detail?tenant_id=2a9210acd39546b4b6fba9cda27a0aed => generated 15 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:11:04.150312 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4d6c109e-f241-400e-9afb-54c2cb7e4807 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:04.159847 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4d6c109e-f241-400e-9afb-54c2cb7e4807 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: 5116a4af-d819-456a-b188-7dcf94b7b35c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:04.172931 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d6c109e-f241-400e-9afb-54c2cb7e4807 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:04.176774 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d6c109e-f241-400e-9afb-54c2cb7e4807 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:04.177217 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d6c109e-f241-400e-9afb-54c2cb7e4807 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:04.179036 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d6c109e-f241-400e-9afb-54c2cb7e4807 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:04.179506 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d6c109e-f241-400e-9afb-54c2cb7e4807 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:04.179936 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d6c109e-f241-400e-9afb-54c2cb7e4807 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:04.831969 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4d6c109e-f241-400e-9afb-54c2cb7e4807 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:04.842437 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4d6c109e-f241-400e-9afb-54c2cb7e4807 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c" status: 200 len: 1515 microversion: 2.1 time: 0.700342 Aug 31 16:11:04.864494 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1894/3981] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:04 2022] GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c => generated 1515 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:04.870543 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-de151935-a802-45ee-a56e-4624be902e02 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:04.881798 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-de151935-a802-45ee-a56e-4624be902e02 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Searching by: {'tenant_id': '2a9210acd39546b4b6fba9cda27a0aed', 'deleted': False} {{(pid=128863) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:11:04.922855 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-de151935-a802-45ee-a56e-4624be902e02 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:04.923689 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-de151935-a802-45ee-a56e-4624be902e02 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:04.924433 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-de151935-a802-45ee-a56e-4624be902e02 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:04.936597 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-de151935-a802-45ee-a56e-4624be902e02 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:04.937362 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-de151935-a802-45ee-a56e-4624be902e02 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:04.937958 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-de151935-a802-45ee-a56e-4624be902e02 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:05.038438 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.multi_cell_list [None req-de151935-a802-45ee-a56e-4624be902e02 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128863) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:11:05.113357 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-de151935-a802-45ee-a56e-4624be902e02 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:05.114965 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-de151935-a802-45ee-a56e-4624be902e02 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:05.115873 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-de151935-a802-45ee-a56e-4624be902e02 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:05.774609 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-f2b86158-c66f-461c-93e9-cbbee81473f6 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:11:05.776426 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-f2b86158-c66f-461c-93e9-cbbee81473f6 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:11:05.777288 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-f2b86158-c66f-461c-93e9-cbbee81473f6 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:11:05.778728 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-f2b86158-c66f-461c-93e9-cbbee81473f6 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:11:05.779609 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-f2b86158-c66f-461c-93e9-cbbee81473f6 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:11:05.784894 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-de151935-a802-45ee-a56e-4624be902e02 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=2a9210acd39546b4b6fba9cda27a0aed" status: 200 len: 4830 microversion: 2.1 time: 0.918631 Aug 31 16:11:05.785797 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1895/3982] 10.222.0.50 () {58 vars in 1257 bytes} [Wed Aug 31 16:11:04 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=2a9210acd39546b4b6fba9cda27a0aed => generated 4830 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:05.792965 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-04dae3fb-2702-4de1-b3a7-7531dff19489 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:05.796123 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-04dae3fb-2702-4de1-b3a7-7531dff19489 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 30d31a1b-0872-4fd2-a9a7-06067b151a68] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:05.813078 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04dae3fb-2702-4de1-b3a7-7531dff19489 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:05.817005 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04dae3fb-2702-4de1-b3a7-7531dff19489 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:05.818245 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04dae3fb-2702-4de1-b3a7-7531dff19489 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:05.839532 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04dae3fb-2702-4de1-b3a7-7531dff19489 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:05.841077 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04dae3fb-2702-4de1-b3a7-7531dff19489 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:05.841779 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04dae3fb-2702-4de1-b3a7-7531dff19489 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:05.866997 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f2b86158-c66f-461c-93e9-cbbee81473f6 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:05.868085 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f2b86158-c66f-461c-93e9-cbbee81473f6 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:05.872005 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f2b86158-c66f-461c-93e9-cbbee81473f6 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:05.876088 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f2b86158-c66f-461c-93e9-cbbee81473f6 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:05.877729 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f2b86158-c66f-461c-93e9-cbbee81473f6 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:05.879011 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f2b86158-c66f-461c-93e9-cbbee81473f6 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:06.007268 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-f2b86158-c66f-461c-93e9-cbbee81473f6 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Getting quotas for project 18b9eaf2ea58471390358e3d3c4a9689. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:11:06.023747 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-f2b86158-c66f-461c-93e9-cbbee81473f6 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Getting quotas for user 19802f8112a04f1d94a35a1956188452 and project 18b9eaf2ea58471390358e3d3c4a9689. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:11:06.085681 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f2b86158-c66f-461c-93e9-cbbee81473f6 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:11:06.093830 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f2b86158-c66f-461c-93e9-cbbee81473f6 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] [instance: da3e4266-a9bc-4433-a335-580713bac164] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:11:06.264069 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f2b86158-c66f-461c-93e9-cbbee81473f6 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.391837 Aug 31 16:11:06.269148 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2088/3983] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:11:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 3414 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:11:06.288804 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-69fe1edb-a319-4e99-9775-6579517d9636 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:06.309045 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-69fe1edb-a319-4e99-9775-6579517d9636 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Searching by: {'tenant_id': '34309f8c35be44bd8d53402e1d66b468', 'deleted': False} {{(pid=128864) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:11:06.327544 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69fe1edb-a319-4e99-9775-6579517d9636 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:06.328035 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69fe1edb-a319-4e99-9775-6579517d9636 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:06.334121 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69fe1edb-a319-4e99-9775-6579517d9636 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:06.337765 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69fe1edb-a319-4e99-9775-6579517d9636 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:06.345171 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69fe1edb-a319-4e99-9775-6579517d9636 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:06.345918 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69fe1edb-a319-4e99-9775-6579517d9636 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:06.450044 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-69fe1edb-a319-4e99-9775-6579517d9636 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=34309f8c35be44bd8d53402e1d66b468" status: 200 len: 15 microversion: 2.1 time: 0.179294 Aug 31 16:11:06.452278 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2089/3984] 10.222.0.50 () {58 vars in 1257 bytes} [Wed Aug 31 16:11:06 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=34309f8c35be44bd8d53402e1d66b468 => generated 15 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:11:06.461420 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-dacf3585-db49-4b9a-a034-769b8ffa3d5d tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:06.470678 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-dacf3585-db49-4b9a-a034-769b8ffa3d5d tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: 5116a4af-d819-456a-b188-7dcf94b7b35c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:06.489434 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dacf3585-db49-4b9a-a034-769b8ffa3d5d tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:06.490792 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dacf3585-db49-4b9a-a034-769b8ffa3d5d tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:06.491565 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dacf3585-db49-4b9a-a034-769b8ffa3d5d tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:06.492793 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dacf3585-db49-4b9a-a034-769b8ffa3d5d tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:06.493813 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dacf3585-db49-4b9a-a034-769b8ffa3d5d tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:06.494596 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dacf3585-db49-4b9a-a034-769b8ffa3d5d tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:07.851060 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-04dae3fb-2702-4de1-b3a7-7531dff19489 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:07.886958 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-04dae3fb-2702-4de1-b3a7-7531dff19489 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/30d31a1b-0872-4fd2-a9a7-06067b151a68" status: 200 len: 1320 microversion: 2.1 time: 2.082146 Aug 31 16:11:07.893703 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1896/3985] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:05 2022] GET /compute/v2.1/servers/30d31a1b-0872-4fd2-a9a7-06067b151a68 => generated 1320 bytes in 2107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:07.899369 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0428cc44-4c58-43ba-a596-2659ff05fd14 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:07.902261 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0428cc44-4c58-43ba-a596-2659ff05fd14 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] [instance: da3e4266-a9bc-4433-a335-580713bac164] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:07.923297 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0428cc44-4c58-43ba-a596-2659ff05fd14 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:07.924057 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0428cc44-4c58-43ba-a596-2659ff05fd14 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:07.924671 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0428cc44-4c58-43ba-a596-2659ff05fd14 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:07.925693 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0428cc44-4c58-43ba-a596-2659ff05fd14 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:07.933159 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0428cc44-4c58-43ba-a596-2659ff05fd14 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:07.933813 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0428cc44-4c58-43ba-a596-2659ff05fd14 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:08.238537 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-dacf3585-db49-4b9a-a034-769b8ffa3d5d tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:08.263829 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-dacf3585-db49-4b9a-a034-769b8ffa3d5d tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c" status: 200 len: 1515 microversion: 2.1 time: 1.809294 Aug 31 16:11:08.270761 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2090/3986] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:06 2022] GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c => generated 1515 bytes in 1818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:08.284738 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8e10ce57-92fa-4edc-be97-4b89dc121fa5 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:08.300658 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0428cc44-4c58-43ba-a596-2659ff05fd14 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19802f8112a04f1d94a35a1956188452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9eaf2ea58471390358e3d3c4a9689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:08.303211 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8e10ce57-92fa-4edc-be97-4b89dc121fa5 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.028292 Aug 31 16:11:08.307089 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2091/3987] 10.222.0.50 () {58 vars in 1189 bytes} [Wed Aug 31 16:11:08 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:11:08.317001 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0428cc44-4c58-43ba-a596-2659ff05fd14 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] 10.222.0.50 "GET /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164" status: 200 len: 1218 microversion: 2.1 time: 0.418952 Aug 31 16:11:08.317637 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1897/3988] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:07 2022] GET /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164 => generated 1218 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:08.345828 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-71f2da0d-e8bc-4ffc-a208-f1919de056e3 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:08.348290 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-71f2da0d-e8bc-4ffc-a208-f1919de056e3 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] [instance: 5923807d-1058-45ab-b8d1-c6700ea8c142] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:08.373174 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-71f2da0d-e8bc-4ffc-a208-f1919de056e3 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:08.376741 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-71f2da0d-e8bc-4ffc-a208-f1919de056e3 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:08.377540 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-71f2da0d-e8bc-4ffc-a208-f1919de056e3 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:08.378547 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-71f2da0d-e8bc-4ffc-a208-f1919de056e3 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:08.381144 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-71f2da0d-e8bc-4ffc-a208-f1919de056e3 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:08.384974 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-71f2da0d-e8bc-4ffc-a208-f1919de056e3 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:08.684053 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-71f2da0d-e8bc-4ffc-a208-f1919de056e3 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142/action" status: 202 len: 0 microversion: 2.1 time: 0.347360 Aug 31 16:11:08.688304 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2092/3989] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:11:08 2022] POST /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142/action => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:11:08.704811 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-244495f6-b3f6-4b86-ba23-2b62f0eb936e tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:08.734118 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-244495f6-b3f6-4b86-ba23-2b62f0eb936e tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:08.735714 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-244495f6-b3f6-4b86-ba23-2b62f0eb936e tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed'} {{(pid=128863) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:11:08.751654 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-244495f6-b3f6-4b86-ba23-2b62f0eb936e tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:08.752297 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-244495f6-b3f6-4b86-ba23-2b62f0eb936e tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:08.752814 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-244495f6-b3f6-4b86-ba23-2b62f0eb936e tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:08.761137 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-244495f6-b3f6-4b86-ba23-2b62f0eb936e tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:08.762572 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-244495f6-b3f6-4b86-ba23-2b62f0eb936e tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:08.763297 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-244495f6-b3f6-4b86-ba23-2b62f0eb936e tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:08.925555 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ba091428-d4f5-491d-a8ef-1cace3b870ce tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:08.926712 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ba091428-d4f5-491d-a8ef-1cace3b870ce tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 30d31a1b-0872-4fd2-a9a7-06067b151a68] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:08.960382 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ba091428-d4f5-491d-a8ef-1cace3b870ce tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:08.961270 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ba091428-d4f5-491d-a8ef-1cace3b870ce tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:08.971441 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ba091428-d4f5-491d-a8ef-1cace3b870ce tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:08.972725 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ba091428-d4f5-491d-a8ef-1cace3b870ce tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:08.973577 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ba091428-d4f5-491d-a8ef-1cace3b870ce tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:08.974386 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ba091428-d4f5-491d-a8ef-1cace3b870ce tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:09.053751 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.multi_cell_list [None req-244495f6-b3f6-4b86-ba23-2b62f0eb936e tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128863) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:11:09.174797 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-244495f6-b3f6-4b86-ba23-2b62f0eb936e tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.482146 Aug 31 16:11:09.176149 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1898/3990] 10.222.0.50 () {58 vars in 1150 bytes} [Wed Aug 31 16:11:08 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:11:09.211339 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b3f50249-ac25-456b-8b8f-9761a44ec47a tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:09.215088 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b3f50249-ac25-456b-8b8f-9761a44ec47a tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] [instance: 5923807d-1058-45ab-b8d1-c6700ea8c142] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:09.234762 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3f50249-ac25-456b-8b8f-9761a44ec47a tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:09.235597 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3f50249-ac25-456b-8b8f-9761a44ec47a tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:09.236527 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3f50249-ac25-456b-8b8f-9761a44ec47a tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:09.237528 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3f50249-ac25-456b-8b8f-9761a44ec47a tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:09.238227 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3f50249-ac25-456b-8b8f-9761a44ec47a tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:09.239026 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3f50249-ac25-456b-8b8f-9761a44ec47a tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:09.549637 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b3f50249-ac25-456b-8b8f-9761a44ec47a tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142/action" status: 202 len: 0 microversion: 2.1 time: 0.360332 Aug 31 16:11:09.555203 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1899/3991] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:11:09 2022] POST /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142/action => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:11:09.564885 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-daa4f493-8535-42b6-982d-9d07cda70a12 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:09.575391 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-daa4f493-8535-42b6-982d-9d07cda70a12 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: 5116a4af-d819-456a-b188-7dcf94b7b35c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:09.594679 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-daa4f493-8535-42b6-982d-9d07cda70a12 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:09.595376 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-daa4f493-8535-42b6-982d-9d07cda70a12 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:09.595977 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-daa4f493-8535-42b6-982d-9d07cda70a12 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:09.596907 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-daa4f493-8535-42b6-982d-9d07cda70a12 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:09.597525 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-daa4f493-8535-42b6-982d-9d07cda70a12 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:09.598286 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-daa4f493-8535-42b6-982d-9d07cda70a12 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:09.913612 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ba091428-d4f5-491d-a8ef-1cace3b870ce tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:09.931563 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ba091428-d4f5-491d-a8ef-1cace3b870ce tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/30d31a1b-0872-4fd2-a9a7-06067b151a68" status: 200 len: 1320 microversion: 2.1 time: 1.028567 Aug 31 16:11:09.932704 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2093/3992] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:08 2022] GET /compute/v2.1/servers/30d31a1b-0872-4fd2-a9a7-06067b151a68 => generated 1320 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:09.953287 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d967d57f-d543-4372-9c20-59f1775fd2cc tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:09.954255 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d967d57f-d543-4372-9c20-59f1775fd2cc tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] [instance: da3e4266-a9bc-4433-a335-580713bac164] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:09.964664 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d967d57f-d543-4372-9c20-59f1775fd2cc tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:09.965444 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d967d57f-d543-4372-9c20-59f1775fd2cc tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:09.966144 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d967d57f-d543-4372-9c20-59f1775fd2cc tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:09.967436 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d967d57f-d543-4372-9c20-59f1775fd2cc tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:09.968288 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d967d57f-d543-4372-9c20-59f1775fd2cc tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:09.968884 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d967d57f-d543-4372-9c20-59f1775fd2cc tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:10.157866 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d967d57f-d543-4372-9c20-59f1775fd2cc tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19802f8112a04f1d94a35a1956188452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9eaf2ea58471390358e3d3c4a9689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:10.169783 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d967d57f-d543-4372-9c20-59f1775fd2cc tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] 10.222.0.50 "GET /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164" status: 200 len: 1280 microversion: 2.1 time: 0.235675 Aug 31 16:11:10.171918 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2094/3993] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:09 2022] GET /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164 => generated 1280 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:10.177096 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-bb187f24-a51d-40a2-bf12-ec41ff1efd42 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:10.177811 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-bb187f24-a51d-40a2-bf12-ec41ff1efd42 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] [instance: 5923807d-1058-45ab-b8d1-c6700ea8c142] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:10.184044 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bb187f24-a51d-40a2-bf12-ec41ff1efd42 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:10.184809 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bb187f24-a51d-40a2-bf12-ec41ff1efd42 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:10.185373 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bb187f24-a51d-40a2-bf12-ec41ff1efd42 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:10.186681 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bb187f24-a51d-40a2-bf12-ec41ff1efd42 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:10.187708 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bb187f24-a51d-40a2-bf12-ec41ff1efd42 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:10.187708 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bb187f24-a51d-40a2-bf12-ec41ff1efd42 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:10.405818 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-daa4f493-8535-42b6-982d-9d07cda70a12 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:10.422332 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-daa4f493-8535-42b6-982d-9d07cda70a12 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c" status: 200 len: 1515 microversion: 2.1 time: 0.863206 Aug 31 16:11:10.423499 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1900/3994] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:09 2022] GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c => generated 1515 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:10.429010 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-51b34b80-6a59-4f92-ba61-aecaed1db4e8 req-e4dcad0b-c9aa-4c3b-9c6e-a8515cddb944 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30d31a1b-0872-4fd2-a9a7-06067b151a68", "name": "network-vif-plugged", "status": "completed", "tag": "7fee9d54-ce6f-4bad-8db6-1ed766cd69e1"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:10.442795 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-51b34b80-6a59-4f92-ba61-aecaed1db4e8 req-e4dcad0b-c9aa-4c3b-9c6e-a8515cddb944 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:10.443790 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-51b34b80-6a59-4f92-ba61-aecaed1db4e8 req-e4dcad0b-c9aa-4c3b-9c6e-a8515cddb944 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:10.445102 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-51b34b80-6a59-4f92-ba61-aecaed1db4e8 req-e4dcad0b-c9aa-4c3b-9c6e-a8515cddb944 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:10.463550 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-51b34b80-6a59-4f92-ba61-aecaed1db4e8 req-e4dcad0b-c9aa-4c3b-9c6e-a8515cddb944 service nova] Creating event network-vif-plugged:7fee9d54-ce6f-4bad-8db6-1ed766cd69e1 for instance 30d31a1b-0872-4fd2-a9a7-06067b151a68 on n-h2-833090-16 Aug 31 16:11:10.472376 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-51b34b80-6a59-4f92-ba61-aecaed1db4e8 req-e4dcad0b-c9aa-4c3b-9c6e-a8515cddb944 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047244 Aug 31 16:11:10.473610 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1901/3995] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:11:10.738270 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-bb187f24-a51d-40a2-bf12-ec41ff1efd42 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142" status: 200 len: 1617 microversion: 2.1 time: 0.562219 Aug 31 16:11:10.739279 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2095/3996] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:10 2022] GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142 => generated 1617 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:10.769430 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-253f3fb2-6367-48ed-b1b3-bc5761e3bfcf tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:10.770474 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-253f3fb2-6367-48ed-b1b3-bc5761e3bfcf tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] [instance: 5923807d-1058-45ab-b8d1-c6700ea8c142] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:10.783335 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-253f3fb2-6367-48ed-b1b3-bc5761e3bfcf tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:10.783845 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-253f3fb2-6367-48ed-b1b3-bc5761e3bfcf tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:10.784307 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-253f3fb2-6367-48ed-b1b3-bc5761e3bfcf tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:10.785544 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-253f3fb2-6367-48ed-b1b3-bc5761e3bfcf tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:10.786348 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-253f3fb2-6367-48ed-b1b3-bc5761e3bfcf tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:10.787433 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-253f3fb2-6367-48ed-b1b3-bc5761e3bfcf tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:10.962913 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7ea065d0-b894-4ebd-8533-895e946424f9 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:10.963522 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7ea065d0-b894-4ebd-8533-895e946424f9 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 30d31a1b-0872-4fd2-a9a7-06067b151a68] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:10.987255 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ea065d0-b894-4ebd-8533-895e946424f9 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:10.987750 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ea065d0-b894-4ebd-8533-895e946424f9 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:10.988218 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ea065d0-b894-4ebd-8533-895e946424f9 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:10.989040 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ea065d0-b894-4ebd-8533-895e946424f9 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:10.989359 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ea065d0-b894-4ebd-8533-895e946424f9 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:10.990437 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ea065d0-b894-4ebd-8533-895e946424f9 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:11.214692 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-253f3fb2-6367-48ed-b1b3-bc5761e3bfcf tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142" status: 200 len: 1617 microversion: 2.1 time: 0.454498 Aug 31 16:11:11.217074 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1902/3997] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:10 2022] GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142 => generated 1617 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:11.236802 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ecfc5b3d-4ecc-4252-a7f0-b19d52b292d6 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:11.238628 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ecfc5b3d-4ecc-4252-a7f0-b19d52b292d6 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] [instance: da3e4266-a9bc-4433-a335-580713bac164] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:11.263495 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ecfc5b3d-4ecc-4252-a7f0-b19d52b292d6 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:11.264632 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ecfc5b3d-4ecc-4252-a7f0-b19d52b292d6 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:11.265464 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ecfc5b3d-4ecc-4252-a7f0-b19d52b292d6 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:11.267032 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ecfc5b3d-4ecc-4252-a7f0-b19d52b292d6 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:11.268071 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ecfc5b3d-4ecc-4252-a7f0-b19d52b292d6 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:11.269050 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ecfc5b3d-4ecc-4252-a7f0-b19d52b292d6 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:11.503658 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7ea065d0-b894-4ebd-8533-895e946424f9 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:11.525098 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7ea065d0-b894-4ebd-8533-895e946424f9 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/30d31a1b-0872-4fd2-a9a7-06067b151a68" status: 200 len: 1320 microversion: 2.1 time: 0.568992 Aug 31 16:11:11.546772 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2096/3998] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:10 2022] GET /compute/v2.1/servers/30d31a1b-0872-4fd2-a9a7-06067b151a68 => generated 1320 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:11:11.554062 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c9b4f42e-b808-4244-bb40-93a10100505e tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:11.571662 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c9b4f42e-b808-4244-bb40-93a10100505e tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Searching by: {'host': 'n-h2-833090-16', 'deleted': False} {{(pid=128864) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:11:11.588401 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c9b4f42e-b808-4244-bb40-93a10100505e tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:11.593203 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c9b4f42e-b808-4244-bb40-93a10100505e tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:11.595668 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c9b4f42e-b808-4244-bb40-93a10100505e tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:11.597001 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c9b4f42e-b808-4244-bb40-93a10100505e tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:11.600473 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c9b4f42e-b808-4244-bb40-93a10100505e tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:11.601097 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c9b4f42e-b808-4244-bb40-93a10100505e tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:11.668719 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ecfc5b3d-4ecc-4252-a7f0-b19d52b292d6 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19802f8112a04f1d94a35a1956188452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9eaf2ea58471390358e3d3c4a9689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:11.687669 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ecfc5b3d-4ecc-4252-a7f0-b19d52b292d6 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] 10.222.0.50 "GET /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164" status: 200 len: 1280 microversion: 2.1 time: 0.467735 Aug 31 16:11:11.704499 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1903/3999] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:11 2022] GET /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164 => generated 1280 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:11.721688 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ef26bf14-d6b9-41ca-a2c6-b66ea8190118 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:11.722515 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ef26bf14-d6b9-41ca-a2c6-b66ea8190118 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: 5116a4af-d819-456a-b188-7dcf94b7b35c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:11.734187 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef26bf14-d6b9-41ca-a2c6-b66ea8190118 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:11.734946 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef26bf14-d6b9-41ca-a2c6-b66ea8190118 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:11.735614 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef26bf14-d6b9-41ca-a2c6-b66ea8190118 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:11.737100 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef26bf14-d6b9-41ca-a2c6-b66ea8190118 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:11.737886 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef26bf14-d6b9-41ca-a2c6-b66ea8190118 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:11.747704 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef26bf14-d6b9-41ca-a2c6-b66ea8190118 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:11.855282 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.multi_cell_list [None req-c9b4f42e-b808-4244-bb40-93a10100505e tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Listed batch of 4 results from cell out of 1000 limit. Returned 4 total so far. {{(pid=128864) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:11:11.925516 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c9b4f42e-b808-4244-bb40-93a10100505e tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] 10.222.0.50 "GET /compute/v2.1/servers?host=n-h2-833090-16&all_tenants=1" status: 200 len: 1290 microversion: 2.1 time: 0.376890 Aug 31 16:11:11.937309 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2097/4000] 10.222.0.50 () {58 vars in 1192 bytes} [Wed Aug 31 16:11:11 2022] GET /compute/v2.1/servers?host=n-h2-833090-16&all_tenants=1 => generated 1290 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:11.942429 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-786b64a6-2728-4a41-ae3d-2aaebc91310f tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:11.949213 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-786b64a6-2728-4a41-ae3d-2aaebc91310f tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=128864) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:11:11.954985 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-786b64a6-2728-4a41-ae3d-2aaebc91310f tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:11.955475 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-786b64a6-2728-4a41-ae3d-2aaebc91310f tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:11.955911 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-786b64a6-2728-4a41-ae3d-2aaebc91310f tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:11.956707 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-786b64a6-2728-4a41-ae3d-2aaebc91310f tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:11.957484 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-786b64a6-2728-4a41-ae3d-2aaebc91310f tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:11.957927 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-786b64a6-2728-4a41-ae3d-2aaebc91310f tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:11.982973 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-786b64a6-2728-4a41-ae3d-2aaebc91310f tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] 10.222.0.50 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.044254 Aug 31 16:11:11.991025 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2098/4001] 10.222.0.50 () {58 vars in 1196 bytes} [Wed Aug 31 16:11:11 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:11:11.996926 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b1c90b25-adbd-42a7-a335-2c4ae6d26b17 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:12.000063 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b1c90b25-adbd-42a7-a335-2c4ae6d26b17 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] [instance: 5923807d-1058-45ab-b8d1-c6700ea8c142] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:12.008060 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1c90b25-adbd-42a7-a335-2c4ae6d26b17 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:12.008988 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1c90b25-adbd-42a7-a335-2c4ae6d26b17 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:12.009654 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1c90b25-adbd-42a7-a335-2c4ae6d26b17 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:12.010724 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1c90b25-adbd-42a7-a335-2c4ae6d26b17 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:12.012244 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1c90b25-adbd-42a7-a335-2c4ae6d26b17 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:12.013077 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1c90b25-adbd-42a7-a335-2c4ae6d26b17 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:12.054513 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:11:12.168294 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b1c90b25-adbd-42a7-a335-2c4ae6d26b17 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142/action" status: 202 len: 0 microversion: 2.1 time: 0.172318 Aug 31 16:11:12.175278 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2099/4002] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:11:11 2022] POST /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:11:12.181187 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0f5674a6-6dd7-4fb3-8d78-6562dc47453a tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:12.198862 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0f5674a6-6dd7-4fb3-8d78-6562dc47453a tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 5923807d-1058-45ab-b8d1-c6700ea8c142] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:12.214919 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0f5674a6-6dd7-4fb3-8d78-6562dc47453a tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:12.215745 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0f5674a6-6dd7-4fb3-8d78-6562dc47453a tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:12.216505 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0f5674a6-6dd7-4fb3-8d78-6562dc47453a tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:12.217636 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0f5674a6-6dd7-4fb3-8d78-6562dc47453a tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:12.218520 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0f5674a6-6dd7-4fb3-8d78-6562dc47453a tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:12.219164 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0f5674a6-6dd7-4fb3-8d78-6562dc47453a tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:12.328466 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-0f5674a6-6dd7-4fb3-8d78-6562dc47453a tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:11:12.328904 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-0f5674a6-6dd7-4fb3-8d78-6562dc47453a tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:11:12.329389 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-0f5674a6-6dd7-4fb3-8d78-6562dc47453a tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:11:12.329798 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-0f5674a6-6dd7-4fb3-8d78-6562dc47453a tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:11:12.330251 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-0f5674a6-6dd7-4fb3-8d78-6562dc47453a tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:11:12.476627 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0f5674a6-6dd7-4fb3-8d78-6562dc47453a tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 5923807d-1058-45ab-b8d1-c6700ea8c142] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:12.484986 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0f5674a6-6dd7-4fb3-8d78-6562dc47453a tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:12.485506 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0f5674a6-6dd7-4fb3-8d78-6562dc47453a tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:12.486543 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0f5674a6-6dd7-4fb3-8d78-6562dc47453a tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:12.487380 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0f5674a6-6dd7-4fb3-8d78-6562dc47453a tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:12.488992 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0f5674a6-6dd7-4fb3-8d78-6562dc47453a tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:12.489286 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0f5674a6-6dd7-4fb3-8d78-6562dc47453a tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:12.527740 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0f5674a6-6dd7-4fb3-8d78-6562dc47453a tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "POST /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142/action" status: 202 len: 1068 microversion: 2.1 time: 0.351068 Aug 31 16:11:12.532720 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2100/4003] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:11:12 2022] POST /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142/action => generated 1068 bytes in 355 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 31 16:11:12.580577 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-027070d2-3c21-4d32-9383-9304a085e0e2 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:12.589293 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-027070d2-3c21-4d32-9383-9304a085e0e2 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 5923807d-1058-45ab-b8d1-c6700ea8c142] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:12.611052 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-027070d2-3c21-4d32-9383-9304a085e0e2 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:12.611634 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-027070d2-3c21-4d32-9383-9304a085e0e2 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:12.612139 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-027070d2-3c21-4d32-9383-9304a085e0e2 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:12.613053 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-027070d2-3c21-4d32-9383-9304a085e0e2 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:12.613528 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-027070d2-3c21-4d32-9383-9304a085e0e2 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:12.613958 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-027070d2-3c21-4d32-9383-9304a085e0e2 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:12.972286 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ef26bf14-d6b9-41ca-a2c6-b66ea8190118 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:13.004058 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ef26bf14-d6b9-41ca-a2c6-b66ea8190118 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c" status: 200 len: 1515 microversion: 2.1 time: 1.291204 Aug 31 16:11:13.010572 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1904/4004] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:11 2022] GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c => generated 1515 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:13.024006 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-aaabb52e-2332-44c1-9673-90d0db7d64ba tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:13.027819 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-aaabb52e-2332-44c1-9673-90d0db7d64ba tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 30d31a1b-0872-4fd2-a9a7-06067b151a68] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:13.043253 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aaabb52e-2332-44c1-9673-90d0db7d64ba tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:13.044395 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aaabb52e-2332-44c1-9673-90d0db7d64ba tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:13.046513 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aaabb52e-2332-44c1-9673-90d0db7d64ba tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:13.048590 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aaabb52e-2332-44c1-9673-90d0db7d64ba tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:13.049581 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aaabb52e-2332-44c1-9673-90d0db7d64ba tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:13.050446 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aaabb52e-2332-44c1-9673-90d0db7d64ba tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:13.484620 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-027070d2-3c21-4d32-9383-9304a085e0e2 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:13.510010 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-027070d2-3c21-4d32-9383-9304a085e0e2 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142" status: 200 len: 1472 microversion: 2.1 time: 0.955011 Aug 31 16:11:13.522323 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2101/4005] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:12 2022] GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142 => generated 1472 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:11:13.528706 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-54b58b95-73a2-4998-aa37-aeec9532b20d tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:13.530199 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-54b58b95-73a2-4998-aa37-aeec9532b20d tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] [instance: da3e4266-a9bc-4433-a335-580713bac164] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:13.540403 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-54b58b95-73a2-4998-aa37-aeec9532b20d tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:13.541732 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-54b58b95-73a2-4998-aa37-aeec9532b20d tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:13.543199 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-54b58b95-73a2-4998-aa37-aeec9532b20d tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:13.545048 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-54b58b95-73a2-4998-aa37-aeec9532b20d tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:13.546327 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-54b58b95-73a2-4998-aa37-aeec9532b20d tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:13.547336 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-54b58b95-73a2-4998-aa37-aeec9532b20d tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:13.662308 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-aaabb52e-2332-44c1-9673-90d0db7d64ba tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:13.666291 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:11:13.671736 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-aaabb52e-2332-44c1-9673-90d0db7d64ba tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/30d31a1b-0872-4fd2-a9a7-06067b151a68" status: 200 len: 1501 microversion: 2.1 time: 0.658968 Aug 31 16:11:13.680818 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1905/4006] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:13 2022] GET /compute/v2.1/servers/30d31a1b-0872-4fd2-a9a7-06067b151a68 => generated 1501 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:13.692588 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-21adac3d-d34c-4903-b01c-b0680cb41e9a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:13.693302 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-21adac3d-d34c-4903-b01c-b0680cb41e9a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 30d31a1b-0872-4fd2-a9a7-06067b151a68] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:13.702243 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-21adac3d-d34c-4903-b01c-b0680cb41e9a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:13.702919 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-21adac3d-d34c-4903-b01c-b0680cb41e9a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:13.703757 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-21adac3d-d34c-4903-b01c-b0680cb41e9a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:13.705164 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-21adac3d-d34c-4903-b01c-b0680cb41e9a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:13.706071 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-21adac3d-d34c-4903-b01c-b0680cb41e9a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:13.706764 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-21adac3d-d34c-4903-b01c-b0680cb41e9a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:14.161159 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-21adac3d-d34c-4903-b01c-b0680cb41e9a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:14.175857 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-21adac3d-d34c-4903-b01c-b0680cb41e9a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/30d31a1b-0872-4fd2-a9a7-06067b151a68" status: 200 len: 1501 microversion: 2.1 time: 0.487495 Aug 31 16:11:14.176459 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1906/4007] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:13 2022] GET /compute/v2.1/servers/30d31a1b-0872-4fd2-a9a7-06067b151a68 => generated 1501 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:11:14.190467 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-59694c4c-9591-455d-91a8-0dba8506fa14 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:14.191105 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-59694c4c-9591-455d-91a8-0dba8506fa14 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: 5116a4af-d819-456a-b188-7dcf94b7b35c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:14.200737 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-59694c4c-9591-455d-91a8-0dba8506fa14 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:14.201422 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-59694c4c-9591-455d-91a8-0dba8506fa14 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:14.201860 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-59694c4c-9591-455d-91a8-0dba8506fa14 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:14.202711 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-59694c4c-9591-455d-91a8-0dba8506fa14 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:14.203176 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-59694c4c-9591-455d-91a8-0dba8506fa14 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:14.203609 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-59694c4c-9591-455d-91a8-0dba8506fa14 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:14.225861 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-54b58b95-73a2-4998-aa37-aeec9532b20d tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19802f8112a04f1d94a35a1956188452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9eaf2ea58471390358e3d3c4a9689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:14.251063 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-54b58b95-73a2-4998-aa37-aeec9532b20d tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] 10.222.0.50 "GET /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164" status: 200 len: 1322 microversion: 2.1 time: 0.724460 Aug 31 16:11:14.254756 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2102/4008] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:13 2022] GET /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164 => generated 1322 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:14.304364 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-45d1ef96-930e-46ce-a2a5-4c16c6708823 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:14.308152 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-45d1ef96-930e-46ce-a2a5-4c16c6708823 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 30d31a1b-0872-4fd2-a9a7-06067b151a68] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:14.321705 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-45d1ef96-930e-46ce-a2a5-4c16c6708823 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:14.322989 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-45d1ef96-930e-46ce-a2a5-4c16c6708823 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:14.324039 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-45d1ef96-930e-46ce-a2a5-4c16c6708823 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:14.325694 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-45d1ef96-930e-46ce-a2a5-4c16c6708823 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:14.327942 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-45d1ef96-930e-46ce-a2a5-4c16c6708823 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:14.329553 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-45d1ef96-930e-46ce-a2a5-4c16c6708823 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:14.419175 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-45d1ef96-930e-46ce-a2a5-4c16c6708823 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 30d31a1b-0872-4fd2-a9a7-06067b151a68] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:11:14.723796 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-45d1ef96-930e-46ce-a2a5-4c16c6708823 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "DELETE /compute/v2.1/servers/30d31a1b-0872-4fd2-a9a7-06067b151a68" status: 204 len: 0 microversion: 2.1 time: 0.464793 Aug 31 16:11:14.724958 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2103/4009] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:11:14 2022] DELETE /compute/v2.1/servers/30d31a1b-0872-4fd2-a9a7-06067b151a68 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:11:14.733460 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f31c15c5-0b62-4b92-82da-4a574a5ff025 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:14.734467 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f31c15c5-0b62-4b92-82da-4a574a5ff025 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 5923807d-1058-45ab-b8d1-c6700ea8c142] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:14.743670 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f31c15c5-0b62-4b92-82da-4a574a5ff025 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:14.744167 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f31c15c5-0b62-4b92-82da-4a574a5ff025 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:14.744899 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f31c15c5-0b62-4b92-82da-4a574a5ff025 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:14.746471 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f31c15c5-0b62-4b92-82da-4a574a5ff025 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:14.747328 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f31c15c5-0b62-4b92-82da-4a574a5ff025 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:14.747865 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f31c15c5-0b62-4b92-82da-4a574a5ff025 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:14.853830 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-59694c4c-9591-455d-91a8-0dba8506fa14 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:14.880581 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-59694c4c-9591-455d-91a8-0dba8506fa14 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c" status: 200 len: 1515 microversion: 2.1 time: 0.702263 Aug 31 16:11:14.883804 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1907/4010] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:14 2022] GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c => generated 1515 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:14.901005 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-620fb8b6-c733-4e89-92ea-5f89e0231b2c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:14.902234 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-620fb8b6-c733-4e89-92ea-5f89e0231b2c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: f6e41791-366b-4790-8338-2a52f4ebed89] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:14.919268 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-620fb8b6-c733-4e89-92ea-5f89e0231b2c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:14.920973 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-620fb8b6-c733-4e89-92ea-5f89e0231b2c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:14.921911 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-620fb8b6-c733-4e89-92ea-5f89e0231b2c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:14.923570 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-620fb8b6-c733-4e89-92ea-5f89e0231b2c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:14.924752 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-620fb8b6-c733-4e89-92ea-5f89e0231b2c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:14.926037 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-620fb8b6-c733-4e89-92ea-5f89e0231b2c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:15.100551 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:11:15.253009 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f31c15c5-0b62-4b92-82da-4a574a5ff025 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:15.266624 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f31c15c5-0b62-4b92-82da-4a574a5ff025 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142" status: 200 len: 1472 microversion: 2.1 time: 0.540157 Aug 31 16:11:15.287504 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2104/4011] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:14 2022] GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142 => generated 1472 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:15.427964 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-620fb8b6-c733-4e89-92ea-5f89e0231b2c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:15.474844 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-620fb8b6-c733-4e89-92ea-5f89e0231b2c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89" status: 200 len: 1564 microversion: 2.1 time: 0.575143 Aug 31 16:11:15.477531 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1908/4012] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:14 2022] GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89 => generated 1564 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:15.509469 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c5f09743-7bcb-4e77-8d00-f0a1caaf01d5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:15.510306 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c5f09743-7bcb-4e77-8d00-f0a1caaf01d5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 30d31a1b-0872-4fd2-a9a7-06067b151a68] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:15.519578 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c5f09743-7bcb-4e77-8d00-f0a1caaf01d5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:15.520379 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c5f09743-7bcb-4e77-8d00-f0a1caaf01d5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:15.521092 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c5f09743-7bcb-4e77-8d00-f0a1caaf01d5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:15.522047 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c5f09743-7bcb-4e77-8d00-f0a1caaf01d5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:15.523094 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c5f09743-7bcb-4e77-8d00-f0a1caaf01d5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:15.523982 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c5f09743-7bcb-4e77-8d00-f0a1caaf01d5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:15.883226 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-6357ac53-f5b2-4036-b600-3a87dae53eb5 req-791ada4f-81ab-497e-a31e-1cd428ff6a2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6e41791-366b-4790-8338-2a52f4ebed89", "tag": "0507378d-ba87-41ae-8199-9dd64dc20873"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:15.917978 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-6357ac53-f5b2-4036-b600-3a87dae53eb5 req-791ada4f-81ab-497e-a31e-1cd428ff6a2a service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:15.920884 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-6357ac53-f5b2-4036-b600-3a87dae53eb5 req-791ada4f-81ab-497e-a31e-1cd428ff6a2a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:15.921039 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-6357ac53-f5b2-4036-b600-3a87dae53eb5 req-791ada4f-81ab-497e-a31e-1cd428ff6a2a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:15.941456 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c5f09743-7bcb-4e77-8d00-f0a1caaf01d5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:15.951971 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-6357ac53-f5b2-4036-b600-3a87dae53eb5 req-791ada4f-81ab-497e-a31e-1cd428ff6a2a service nova] Creating event network-changed:0507378d-ba87-41ae-8199-9dd64dc20873 for instance f6e41791-366b-4790-8338-2a52f4ebed89 on n-h1-833090-16 Aug 31 16:11:15.957725 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-6357ac53-f5b2-4036-b600-3a87dae53eb5 req-791ada4f-81ab-497e-a31e-1cd428ff6a2a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.668388 Aug 31 16:11:15.960869 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2105/4013] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:11:15.961420 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c5f09743-7bcb-4e77-8d00-f0a1caaf01d5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/30d31a1b-0872-4fd2-a9a7-06067b151a68" status: 200 len: 1507 microversion: 2.1 time: 0.468145 Aug 31 16:11:15.962216 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1909/4014] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:15 2022] GET /compute/v2.1/servers/30d31a1b-0872-4fd2-a9a7-06067b151a68 => generated 1507 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:15.972354 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4ba24834-ca84-46ab-b0b3-af63db50fb26 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:15.975872 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4ba24834-ca84-46ab-b0b3-af63db50fb26 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: 5116a4af-d819-456a-b188-7dcf94b7b35c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:15.994265 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ba24834-ca84-46ab-b0b3-af63db50fb26 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:15.996862 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ba24834-ca84-46ab-b0b3-af63db50fb26 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:15.997614 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ba24834-ca84-46ab-b0b3-af63db50fb26 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:15.998730 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ba24834-ca84-46ab-b0b3-af63db50fb26 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:15.999462 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ba24834-ca84-46ab-b0b3-af63db50fb26 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:16.000126 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ba24834-ca84-46ab-b0b3-af63db50fb26 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:16.017576 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6daa6554-6e04-49f5-b9a7-855e0256205e tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:16.018329 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6daa6554-6e04-49f5-b9a7-855e0256205e tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] [instance: da3e4266-a9bc-4433-a335-580713bac164] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:16.032192 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6daa6554-6e04-49f5-b9a7-855e0256205e tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:16.034408 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6daa6554-6e04-49f5-b9a7-855e0256205e tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:16.034861 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6daa6554-6e04-49f5-b9a7-855e0256205e tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:16.035603 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6daa6554-6e04-49f5-b9a7-855e0256205e tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:16.036055 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6daa6554-6e04-49f5-b9a7-855e0256205e tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:16.036470 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6daa6554-6e04-49f5-b9a7-855e0256205e tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:16.165178 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=8 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:11:17.111934 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4ba24834-ca84-46ab-b0b3-af63db50fb26 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:17.134289 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4ba24834-ca84-46ab-b0b3-af63db50fb26 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c" status: 200 len: 1515 microversion: 2.1 time: 1.170752 Aug 31 16:11:17.136169 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1910/4015] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:15 2022] GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c => generated 1515 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:17.172104 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d293540f-7087-4681-b7ef-decffb8c88f4 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:17.173404 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d293540f-7087-4681-b7ef-decffb8c88f4 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 5923807d-1058-45ab-b8d1-c6700ea8c142] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:17.196084 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d293540f-7087-4681-b7ef-decffb8c88f4 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:17.198644 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d293540f-7087-4681-b7ef-decffb8c88f4 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:17.199839 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d293540f-7087-4681-b7ef-decffb8c88f4 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:17.201684 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d293540f-7087-4681-b7ef-decffb8c88f4 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:17.202645 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d293540f-7087-4681-b7ef-decffb8c88f4 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:17.203324 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d293540f-7087-4681-b7ef-decffb8c88f4 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:17.390428 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6daa6554-6e04-49f5-b9a7-855e0256205e tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19802f8112a04f1d94a35a1956188452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9eaf2ea58471390358e3d3c4a9689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:17.411659 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6daa6554-6e04-49f5-b9a7-855e0256205e tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] 10.222.0.50 "GET /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164" status: 200 len: 1322 microversion: 2.1 time: 1.449171 Aug 31 16:11:17.419039 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2106/4016] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:15 2022] GET /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164 => generated 1322 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:17.428476 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a88149fa-4d92-42c4-a879-d20f340789fd tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:17.431933 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a88149fa-4d92-42c4-a879-d20f340789fd tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 30d31a1b-0872-4fd2-a9a7-06067b151a68] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:17.447470 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a88149fa-4d92-42c4-a879-d20f340789fd tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:17.455274 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a88149fa-4d92-42c4-a879-d20f340789fd tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:17.457369 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a88149fa-4d92-42c4-a879-d20f340789fd tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:17.460755 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a88149fa-4d92-42c4-a879-d20f340789fd tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:17.463807 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a88149fa-4d92-42c4-a879-d20f340789fd tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:17.466121 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a88149fa-4d92-42c4-a879-d20f340789fd tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:17.824753 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d293540f-7087-4681-b7ef-decffb8c88f4 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:17.855664 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d293540f-7087-4681-b7ef-decffb8c88f4 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142" status: 200 len: 1472 microversion: 2.1 time: 0.714267 Aug 31 16:11:17.855991 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1911/4017] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:17 2022] GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142 => generated 1472 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:18.167041 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4eacdc01-22be-4749-ad0b-825cb5d4a184 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:18.168759 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4eacdc01-22be-4749-ad0b-825cb5d4a184 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: 5116a4af-d819-456a-b188-7dcf94b7b35c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:18.187827 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4eacdc01-22be-4749-ad0b-825cb5d4a184 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:18.188607 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4eacdc01-22be-4749-ad0b-825cb5d4a184 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:18.189205 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4eacdc01-22be-4749-ad0b-825cb5d4a184 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:18.190119 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4eacdc01-22be-4749-ad0b-825cb5d4a184 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:18.191146 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4eacdc01-22be-4749-ad0b-825cb5d4a184 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:18.191819 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4eacdc01-22be-4749-ad0b-825cb5d4a184 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:18.841854 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:11:19.225151 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a88149fa-4d92-42c4-a879-d20f340789fd tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:19.256166 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a88149fa-4d92-42c4-a879-d20f340789fd tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/30d31a1b-0872-4fd2-a9a7-06067b151a68" status: 200 len: 1507 microversion: 2.1 time: 1.835469 Aug 31 16:11:19.261367 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2107/4018] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:17 2022] GET /compute/v2.1/servers/30d31a1b-0872-4fd2-a9a7-06067b151a68 => generated 1507 bytes in 1842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:19.275910 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8d7c522b-023d-48dd-834c-b017105e98bb tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:19.280214 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8d7c522b-023d-48dd-834c-b017105e98bb tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] [instance: da3e4266-a9bc-4433-a335-580713bac164] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:19.319211 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4eacdc01-22be-4749-ad0b-825cb5d4a184 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:19.331674 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4eacdc01-22be-4749-ad0b-825cb5d4a184 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c" status: 200 len: 1515 microversion: 2.1 time: 1.170856 Aug 31 16:11:19.334047 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1912/4019] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:18 2022] GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c => generated 1515 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:19.336786 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8d7c522b-023d-48dd-834c-b017105e98bb tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:19.343034 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8d7c522b-023d-48dd-834c-b017105e98bb tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:19.345044 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8d7c522b-023d-48dd-834c-b017105e98bb tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:19.346052 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-012a5f70-6405-455f-811b-821de11c1c38 req-bf02148f-74c3-47cc-800b-9388a0957db8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da3e4266-a9bc-4433-a335-580713bac164", "tag": "3fbcf647-bed8-4bd1-8cb6-2c28f9c026e1"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:19.351965 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8d7c522b-023d-48dd-834c-b017105e98bb tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:19.352477 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8d7c522b-023d-48dd-834c-b017105e98bb tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:19.353081 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8d7c522b-023d-48dd-834c-b017105e98bb tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:19.365039 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-012a5f70-6405-455f-811b-821de11c1c38 req-bf02148f-74c3-47cc-800b-9388a0957db8 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:19.366849 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-012a5f70-6405-455f-811b-821de11c1c38 req-bf02148f-74c3-47cc-800b-9388a0957db8 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:19.368104 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-012a5f70-6405-455f-811b-821de11c1c38 req-bf02148f-74c3-47cc-800b-9388a0957db8 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:19.388259 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-012a5f70-6405-455f-811b-821de11c1c38 req-bf02148f-74c3-47cc-800b-9388a0957db8 service nova] Creating event network-changed:3fbcf647-bed8-4bd1-8cb6-2c28f9c026e1 for instance da3e4266-a9bc-4433-a335-580713bac164 on n-h1-833090-16 Aug 31 16:11:19.397568 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-012a5f70-6405-455f-811b-821de11c1c38 req-bf02148f-74c3-47cc-800b-9388a0957db8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061126 Aug 31 16:11:19.398433 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1913/4020] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:11:19.406223 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ded0a4f4-6928-4c1e-ba50-12e76f014d7a tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:19.407848 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ded0a4f4-6928-4c1e-ba50-12e76f014d7a tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 5923807d-1058-45ab-b8d1-c6700ea8c142] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:19.423973 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ded0a4f4-6928-4c1e-ba50-12e76f014d7a tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:19.425163 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ded0a4f4-6928-4c1e-ba50-12e76f014d7a tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:19.426150 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ded0a4f4-6928-4c1e-ba50-12e76f014d7a tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:19.427631 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ded0a4f4-6928-4c1e-ba50-12e76f014d7a tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:19.428558 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ded0a4f4-6928-4c1e-ba50-12e76f014d7a tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:19.429225 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ded0a4f4-6928-4c1e-ba50-12e76f014d7a tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:20.057683 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8d7c522b-023d-48dd-834c-b017105e98bb tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19802f8112a04f1d94a35a1956188452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9eaf2ea58471390358e3d3c4a9689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:20.080200 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8d7c522b-023d-48dd-834c-b017105e98bb tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] 10.222.0.50 "GET /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164" status: 200 len: 1322 microversion: 2.1 time: 0.816344 Aug 31 16:11:20.080806 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2108/4021] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:19 2022] GET /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164 => generated 1322 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:20.096501 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ded0a4f4-6928-4c1e-ba50-12e76f014d7a tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:20.108701 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ded0a4f4-6928-4c1e-ba50-12e76f014d7a tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142" status: 200 len: 1472 microversion: 2.1 time: 0.708723 Aug 31 16:11:20.109894 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1914/4022] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:19 2022] GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142 => generated 1472 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:20.286258 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0b0d83e1-45ba-4a16-97e1-0a415a580d92 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:20.287003 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0b0d83e1-45ba-4a16-97e1-0a415a580d92 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 30d31a1b-0872-4fd2-a9a7-06067b151a68] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:20.292986 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:11:20.295820 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0b0d83e1-45ba-4a16-97e1-0a415a580d92 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:20.297649 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0b0d83e1-45ba-4a16-97e1-0a415a580d92 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:20.298567 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0b0d83e1-45ba-4a16-97e1-0a415a580d92 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:20.301913 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0b0d83e1-45ba-4a16-97e1-0a415a580d92 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:20.303830 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0b0d83e1-45ba-4a16-97e1-0a415a580d92 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:20.304449 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0b0d83e1-45ba-4a16-97e1-0a415a580d92 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:20.359329 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-467666d3-3843-4eee-8d22-6e011276ec93 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:20.360443 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-467666d3-3843-4eee-8d22-6e011276ec93 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: 5116a4af-d819-456a-b188-7dcf94b7b35c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:20.369163 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-467666d3-3843-4eee-8d22-6e011276ec93 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:20.369672 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-467666d3-3843-4eee-8d22-6e011276ec93 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:20.370182 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-467666d3-3843-4eee-8d22-6e011276ec93 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:20.370889 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-467666d3-3843-4eee-8d22-6e011276ec93 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:20.371353 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-467666d3-3843-4eee-8d22-6e011276ec93 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:20.371905 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-467666d3-3843-4eee-8d22-6e011276ec93 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:20.790121 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0b0d83e1-45ba-4a16-97e1-0a415a580d92 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:20.813965 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0b0d83e1-45ba-4a16-97e1-0a415a580d92 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/30d31a1b-0872-4fd2-a9a7-06067b151a68" status: 200 len: 1507 microversion: 2.1 time: 0.529607 Aug 31 16:11:20.818534 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2109/4023] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:20 2022] GET /compute/v2.1/servers/30d31a1b-0872-4fd2-a9a7-06067b151a68 => generated 1507 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:20.935217 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-467666d3-3843-4eee-8d22-6e011276ec93 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:20.954467 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-467666d3-3843-4eee-8d22-6e011276ec93 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c" status: 200 len: 1515 microversion: 2.1 time: 0.599592 Aug 31 16:11:20.956571 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1915/4024] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:20 2022] GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c => generated 1515 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:21.129353 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b150cb42-172e-4dfe-9f0c-77a2fbd427e0 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:21.130354 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b150cb42-172e-4dfe-9f0c-77a2fbd427e0 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] [instance: da3e4266-a9bc-4433-a335-580713bac164] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:21.138568 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-20a21e85-3e0b-4490-97e9-bcc2f49fa96f tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:21.139278 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b150cb42-172e-4dfe-9f0c-77a2fbd427e0 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:21.139961 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b150cb42-172e-4dfe-9f0c-77a2fbd427e0 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:21.140389 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-20a21e85-3e0b-4490-97e9-bcc2f49fa96f tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 5923807d-1058-45ab-b8d1-c6700ea8c142] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:21.140767 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b150cb42-172e-4dfe-9f0c-77a2fbd427e0 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:21.141678 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b150cb42-172e-4dfe-9f0c-77a2fbd427e0 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:21.142332 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b150cb42-172e-4dfe-9f0c-77a2fbd427e0 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:21.142921 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b150cb42-172e-4dfe-9f0c-77a2fbd427e0 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:21.155130 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20a21e85-3e0b-4490-97e9-bcc2f49fa96f tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:21.155871 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20a21e85-3e0b-4490-97e9-bcc2f49fa96f tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:21.156545 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20a21e85-3e0b-4490-97e9-bcc2f49fa96f tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:21.157756 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20a21e85-3e0b-4490-97e9-bcc2f49fa96f tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:21.158652 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20a21e85-3e0b-4490-97e9-bcc2f49fa96f tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:21.159185 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20a21e85-3e0b-4490-97e9-bcc2f49fa96f tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:21.455476 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b150cb42-172e-4dfe-9f0c-77a2fbd427e0 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19802f8112a04f1d94a35a1956188452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9eaf2ea58471390358e3d3c4a9689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:21.479389 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b150cb42-172e-4dfe-9f0c-77a2fbd427e0 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] 10.222.0.50 "GET /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164" status: 200 len: 1322 microversion: 2.1 time: 0.373674 Aug 31 16:11:21.482834 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2110/4025] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:21 2022] GET /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164 => generated 1322 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:21.502236 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-20a21e85-3e0b-4490-97e9-bcc2f49fa96f tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:21.504875 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-a820ea4f-3493-46e5-8e63-b797dc1db4f9 req-61099c90-2c51-44b7-95c4-34a8525f860f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30d31a1b-0872-4fd2-a9a7-06067b151a68", "name": "network-vif-deleted", "tag": "7fee9d54-ce6f-4bad-8db6-1ed766cd69e1"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:21.514990 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-20a21e85-3e0b-4490-97e9-bcc2f49fa96f tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142" status: 200 len: 1472 microversion: 2.1 time: 0.384407 Aug 31 16:11:21.518181 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1916/4026] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:21 2022] GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142 => generated 1472 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:21.544543 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-a820ea4f-3493-46e5-8e63-b797dc1db4f9 req-61099c90-2c51-44b7-95c4-34a8525f860f service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:21.547106 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-a820ea4f-3493-46e5-8e63-b797dc1db4f9 req-61099c90-2c51-44b7-95c4-34a8525f860f service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:21.547565 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-a820ea4f-3493-46e5-8e63-b797dc1db4f9 req-61099c90-2c51-44b7-95c4-34a8525f860f service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:21.588530 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-a820ea4f-3493-46e5-8e63-b797dc1db4f9 req-61099c90-2c51-44b7-95c4-34a8525f860f service nova] Creating event network-vif-deleted:7fee9d54-ce6f-4bad-8db6-1ed766cd69e1 for instance 30d31a1b-0872-4fd2-a9a7-06067b151a68 on n-h2-833090-16 Aug 31 16:11:21.601542 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-a820ea4f-3493-46e5-8e63-b797dc1db4f9 req-61099c90-2c51-44b7-95c4-34a8525f860f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114899 Aug 31 16:11:21.604692 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2111/4027] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:11:21.850300 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-25ae4978-7006-4136-b329-c6c9d8869ad5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:21.851159 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-25ae4978-7006-4136-b329-c6c9d8869ad5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 30d31a1b-0872-4fd2-a9a7-06067b151a68] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:21.868437 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25ae4978-7006-4136-b329-c6c9d8869ad5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:21.870991 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25ae4978-7006-4136-b329-c6c9d8869ad5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:21.871668 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25ae4978-7006-4136-b329-c6c9d8869ad5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:21.874785 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25ae4978-7006-4136-b329-c6c9d8869ad5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:21.877124 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25ae4978-7006-4136-b329-c6c9d8869ad5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:21.878062 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25ae4978-7006-4136-b329-c6c9d8869ad5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:21.945302 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25ae4978-7006-4136-b329-c6c9d8869ad5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:21.945933 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25ae4978-7006-4136-b329-c6c9d8869ad5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:21.946822 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25ae4978-7006-4136-b329-c6c9d8869ad5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:21.947357 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-25ae4978-7006-4136-b329-c6c9d8869ad5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lazy-loading 'fault' on Instance uuid 30d31a1b-0872-4fd2-a9a7-06067b151a68 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:11:21.976751 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f37bbc9b-a824-4709-a0f2-4e395637ad1e tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:21.977473 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f37bbc9b-a824-4709-a0f2-4e395637ad1e tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: 5116a4af-d819-456a-b188-7dcf94b7b35c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:21.986866 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=12 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:11:22.004338 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f37bbc9b-a824-4709-a0f2-4e395637ad1e tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:22.007161 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f37bbc9b-a824-4709-a0f2-4e395637ad1e tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:22.008548 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f37bbc9b-a824-4709-a0f2-4e395637ad1e tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:22.013763 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f37bbc9b-a824-4709-a0f2-4e395637ad1e tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:22.016783 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f37bbc9b-a824-4709-a0f2-4e395637ad1e tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:22.017754 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f37bbc9b-a824-4709-a0f2-4e395637ad1e tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:22.091324 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:11:22.170839 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-25ae4978-7006-4136-b329-c6c9d8869ad5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:22.186323 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-25ae4978-7006-4136-b329-c6c9d8869ad5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/30d31a1b-0872-4fd2-a9a7-06067b151a68" status: 200 len: 1310 microversion: 2.1 time: 0.342373 Aug 31 16:11:22.198667 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1917/4028] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:21 2022] GET /compute/v2.1/servers/30d31a1b-0872-4fd2-a9a7-06067b151a68 => generated 1310 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:22.364655 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f37bbc9b-a824-4709-a0f2-4e395637ad1e tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:22.390538 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f37bbc9b-a824-4709-a0f2-4e395637ad1e tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c" status: 200 len: 1521 microversion: 2.1 time: 0.418136 Aug 31 16:11:22.395153 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2112/4029] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:21 2022] GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c => generated 1521 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:22.505748 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8b281f5e-9d11-4af7-b152-ce815fb3838b tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:22.506686 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8b281f5e-9d11-4af7-b152-ce815fb3838b tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] [instance: da3e4266-a9bc-4433-a335-580713bac164] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:22.517606 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b281f5e-9d11-4af7-b152-ce815fb3838b tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:22.518730 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b281f5e-9d11-4af7-b152-ce815fb3838b tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:22.520256 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b281f5e-9d11-4af7-b152-ce815fb3838b tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:22.521579 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b281f5e-9d11-4af7-b152-ce815fb3838b tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:22.522677 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b281f5e-9d11-4af7-b152-ce815fb3838b tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:22.524319 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b281f5e-9d11-4af7-b152-ce815fb3838b tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:22.542801 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d662286d-671c-4419-9483-429b80e613e8 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:22.545246 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d662286d-671c-4419-9483-429b80e613e8 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 5923807d-1058-45ab-b8d1-c6700ea8c142] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:22.563585 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d662286d-671c-4419-9483-429b80e613e8 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:22.565511 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d662286d-671c-4419-9483-429b80e613e8 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:22.569626 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d662286d-671c-4419-9483-429b80e613e8 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:22.571761 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d662286d-671c-4419-9483-429b80e613e8 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:22.573091 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d662286d-671c-4419-9483-429b80e613e8 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:22.574865 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d662286d-671c-4419-9483-429b80e613e8 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:22.921404 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d662286d-671c-4419-9483-429b80e613e8 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:22.935371 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d662286d-671c-4419-9483-429b80e613e8 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142" status: 200 len: 1472 microversion: 2.1 time: 0.397656 Aug 31 16:11:22.950773 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2113/4030] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:22 2022] GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142 => generated 1472 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:22.957167 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8b281f5e-9d11-4af7-b152-ce815fb3838b tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19802f8112a04f1d94a35a1956188452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9eaf2ea58471390358e3d3c4a9689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:22.971382 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8b281f5e-9d11-4af7-b152-ce815fb3838b tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] 10.222.0.50 "GET /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164" status: 200 len: 1322 microversion: 2.1 time: 0.470196 Aug 31 16:11:22.972680 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1918/4031] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:22 2022] GET /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164 => generated 1322 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:23.218177 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-008a4af4-a07b-4f3f-98b5-56ba0c9ac0bf tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:23.218795 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-008a4af4-a07b-4f3f-98b5-56ba0c9ac0bf tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 30d31a1b-0872-4fd2-a9a7-06067b151a68] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:23.225733 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-008a4af4-a07b-4f3f-98b5-56ba0c9ac0bf tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:23.226559 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-008a4af4-a07b-4f3f-98b5-56ba0c9ac0bf tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:23.227245 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-008a4af4-a07b-4f3f-98b5-56ba0c9ac0bf tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:23.228013 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-008a4af4-a07b-4f3f-98b5-56ba0c9ac0bf tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:23.228527 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-008a4af4-a07b-4f3f-98b5-56ba0c9ac0bf tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:23.229001 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-008a4af4-a07b-4f3f-98b5-56ba0c9ac0bf tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:23.266569 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-008a4af4-a07b-4f3f-98b5-56ba0c9ac0bf tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] HTTP exception thrown: Instance 30d31a1b-0872-4fd2-a9a7-06067b151a68 could not be found. Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-008a4af4-a07b-4f3f-98b5-56ba0c9ac0bf tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Request method failure captured: Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/30d31a1b-0872-4fd2-a9a7-06067b151a68 HTTP/1.1 Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4fcRMLera6TLJp6OFOd_B19-rdZe1qr5LTGcbsBroFhPQ8_L89JW9hpsNJPnNpQCXW4WKWxdTwWZTYVgRah_OPLrb5JBnrA64ZgN8VfXgRvkXORTfvSkZvZgjCL7371tDtPpfcPNp0NcyRfiYHxIldtsDdYZVFbQTa8WMsjzib7kZ0 Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 84f42648e1a343b9a5ab9b89c91bea0d Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServersTestJSON-1527984429 Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_84f42648e1a343b9a5ab9b89c91bea0d", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServersTestJSON-1527984429 Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 84f42648e1a343b9a5ab9b89c91bea0d Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServersTestJSON-1527984429 Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServersTestJSON-1527984429-project Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 3ebce87993504550914c2c3702eebb17 Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServersTestJSON-1527984429-project Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 30d31a1b-0872-4fd2-a9a7-06067b151a68 could not be found. Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '30d31a1b-0872-4fd2-a9a7-06067b151a68'} Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30d31a1b-0872-4fd2-a9a7-06067b151a68 could not be found. Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30d31a1b-0872-4fd2-a9a7-06067b151a68 could not be found. Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:11:23.268768 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:11:23.277716 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:11:23.277716 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:11:23.277716 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:11:23.277716 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:11:23.277716 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:11:23.277716 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30d31a1b-0872-4fd2-a9a7-06067b151a68 could not be found. Aug 31 16:11:23.277716 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:11:23.277716 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-008a4af4-a07b-4f3f-98b5-56ba0c9ac0bf tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Returning 404 to user: Instance 30d31a1b-0872-4fd2-a9a7-06067b151a68 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:11:23.277716 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-008a4af4-a07b-4f3f-98b5-56ba0c9ac0bf tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/30d31a1b-0872-4fd2-a9a7-06067b151a68" status: 404 len: 111 microversion: 2.1 time: 0.057190 Aug 31 16:11:23.277716 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2114/4032] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:23 2022] GET /compute/v2.1/servers/30d31a1b-0872-4fd2-a9a7-06067b151a68 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:11:23.302923 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c7167b00-1c88-4863-9048-c0dc23ebcffa tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Action: 'create', calling method: .version_select at 0x7fbb45daa8b0>, body: {"keypair": {"name": "tempest-key-1344000419", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJuwuwEse/U7xxSApVJNeHz/ORuZac0mOe5I3y83GYktaxglOvOGUGx6MAhrOZR9i7fqIYP0QxZg3ei0ot0MYPXLgQcKJe2S72bbSpGuvUAGibPjEEPpkOhFesHV7ULmuQ=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:23.328203 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-c7167b00-1c88-4863-9048-c0dc23ebcffa tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Getting quotas for project 84f42648e1a343b9a5ab9b89c91bea0d. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:11:23.336913 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-c7167b00-1c88-4863-9048-c0dc23ebcffa tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Getting quotas for user 3ebce87993504550914c2c3702eebb17 and project 84f42648e1a343b9a5ab9b89c91bea0d. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:11:23.382425 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c7167b00-1c88-4863-9048-c0dc23ebcffa tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.086574 Aug 31 16:11:23.383776 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1919/4033] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 31 16:11:23 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:11:23.396836 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4fee36de-1d3b-4008-a55f-f5fc21a3735d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '.version_select at 0x7fbb46000040>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:23.402983 n-d-833090-16 devstack@n-api.service[128864]: WARNING oslo_db.sqlalchemy.utils [None req-4fee36de-1d3b-4008-a55f-f5fc21a3735d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 31 16:11:23.411003 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4fee36de-1d3b-4008-a55f-f5fc21a3735d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.017921 Aug 31 16:11:23.412448 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2115/4034] 10.222.0.50 () {58 vars in 1137 bytes} [Wed Aug 31 16:11:23 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:11:23.432103 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f2235353-1916-43a4-9acf-ec0b30c20a52 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:23.440955 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f2235353-1916-43a4-9acf-ec0b30c20a52 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: 5116a4af-d819-456a-b188-7dcf94b7b35c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:23.470440 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f2235353-1916-43a4-9acf-ec0b30c20a52 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:23.471378 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f2235353-1916-43a4-9acf-ec0b30c20a52 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:23.472301 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f2235353-1916-43a4-9acf-ec0b30c20a52 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:23.477521 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f2235353-1916-43a4-9acf-ec0b30c20a52 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:23.478497 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f2235353-1916-43a4-9acf-ec0b30c20a52 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:23.481302 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f2235353-1916-43a4-9acf-ec0b30c20a52 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:23.634475 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ecd7160c-9ed1-42fc-ba0b-7670fd7d095d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-727483288", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "key_name": "tempest-key-1344000419", "networks": [{"uuid": "00194b7c-6891-4cf9-8c59-235de2b40a38"}]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:23.732719 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-ecd7160c-9ed1-42fc-ba0b-7670fd7d095d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] validate_networks() for [('00194b7c-6891-4cf9-8c59-235de2b40a38', None, None, None, None, None)] {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:11:23.893643 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f2235353-1916-43a4-9acf-ec0b30c20a52 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:23.913654 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f2235353-1916-43a4-9acf-ec0b30c20a52 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c" status: 200 len: 1521 microversion: 2.1 time: 0.485716 Aug 31 16:11:23.915037 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1920/4035] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:23 2022] GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c => generated 1521 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:23.971940 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7dc499cc-f657-42d3-8c60-162972f2e11e tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:23.972772 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7dc499cc-f657-42d3-8c60-162972f2e11e tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 5923807d-1058-45ab-b8d1-c6700ea8c142] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:23.984622 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7dc499cc-f657-42d3-8c60-162972f2e11e tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:23.985189 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7dc499cc-f657-42d3-8c60-162972f2e11e tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:23.986012 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7dc499cc-f657-42d3-8c60-162972f2e11e tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:23.986824 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7dc499cc-f657-42d3-8c60-162972f2e11e tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:23.991475 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7dc499cc-f657-42d3-8c60-162972f2e11e tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:23.991978 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7dc499cc-f657-42d3-8c60-162972f2e11e tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:24.604126 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7dc499cc-f657-42d3-8c60-162972f2e11e tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:24.621469 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7dc499cc-f657-42d3-8c60-162972f2e11e tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142" status: 200 len: 1472 microversion: 2.1 time: 0.653643 Aug 31 16:11:24.627539 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1921/4036] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:23 2022] GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142 => generated 1472 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:11:24.635392 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2656c2a6-1cda-4969-a2d0-e2208dea3854 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:24.636399 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2656c2a6-1cda-4969-a2d0-e2208dea3854 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] [instance: da3e4266-a9bc-4433-a335-580713bac164] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:24.646159 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2656c2a6-1cda-4969-a2d0-e2208dea3854 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:24.647146 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2656c2a6-1cda-4969-a2d0-e2208dea3854 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:24.647945 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2656c2a6-1cda-4969-a2d0-e2208dea3854 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:24.650605 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2656c2a6-1cda-4969-a2d0-e2208dea3854 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:24.651687 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2656c2a6-1cda-4969-a2d0-e2208dea3854 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:24.653110 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2656c2a6-1cda-4969-a2d0-e2208dea3854 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:24.701019 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-ecd7160c-9ed1-42fc-ba0b-7670fd7d095d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:11:24.702652 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-ecd7160c-9ed1-42fc-ba0b-7670fd7d095d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:11:24.703733 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-ecd7160c-9ed1-42fc-ba0b-7670fd7d095d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:11:24.704922 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-ecd7160c-9ed1-42fc-ba0b-7670fd7d095d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:11:24.705875 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-ecd7160c-9ed1-42fc-ba0b-7670fd7d095d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:11:24.728279 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ecd7160c-9ed1-42fc-ba0b-7670fd7d095d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:24.729547 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ecd7160c-9ed1-42fc-ba0b-7670fd7d095d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:24.730672 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ecd7160c-9ed1-42fc-ba0b-7670fd7d095d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:24.732182 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ecd7160c-9ed1-42fc-ba0b-7670fd7d095d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:24.733178 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ecd7160c-9ed1-42fc-ba0b-7670fd7d095d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:24.734395 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ecd7160c-9ed1-42fc-ba0b-7670fd7d095d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:24.776813 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-ecd7160c-9ed1-42fc-ba0b-7670fd7d095d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Getting quotas for project 84f42648e1a343b9a5ab9b89c91bea0d. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:11:24.790980 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-ecd7160c-9ed1-42fc-ba0b-7670fd7d095d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Getting quotas for user 3ebce87993504550914c2c3702eebb17 and project 84f42648e1a343b9a5ab9b89c91bea0d. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:11:24.824639 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ecd7160c-9ed1-42fc-ba0b-7670fd7d095d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:11:24.832322 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ecd7160c-9ed1-42fc-ba0b-7670fd7d095d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: adb50b8a-afc7-4d23-a44c-7d4d75c33ad3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:11:25.079847 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ecd7160c-9ed1-42fc-ba0b-7670fd7d095d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.449687 Aug 31 16:11:25.089190 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2116/4037] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:11:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1463 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:11:25.118271 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-bcaa4be5-759a-46f8-9e66-7be789818e8c tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:25.122943 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-bcaa4be5-759a-46f8-9e66-7be789818e8c tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: 5116a4af-d819-456a-b188-7dcf94b7b35c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:25.133327 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2656c2a6-1cda-4969-a2d0-e2208dea3854 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19802f8112a04f1d94a35a1956188452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9eaf2ea58471390358e3d3c4a9689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:25.152215 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bcaa4be5-759a-46f8-9e66-7be789818e8c tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:25.159711 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bcaa4be5-759a-46f8-9e66-7be789818e8c tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:25.160671 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bcaa4be5-759a-46f8-9e66-7be789818e8c tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:25.162084 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bcaa4be5-759a-46f8-9e66-7be789818e8c tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:25.162974 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bcaa4be5-759a-46f8-9e66-7be789818e8c tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:25.168076 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bcaa4be5-759a-46f8-9e66-7be789818e8c tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:25.187100 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2656c2a6-1cda-4969-a2d0-e2208dea3854 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] 10.222.0.50 "GET /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164" status: 200 len: 1322 microversion: 2.1 time: 0.557286 Aug 31 16:11:25.203493 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1922/4038] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:24 2022] GET /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164 => generated 1322 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:25.236477 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9b3c525e-88c8-4b63-b865-eb5f151de14a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:25.238247 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9b3c525e-88c8-4b63-b865-eb5f151de14a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: adb50b8a-afc7-4d23-a44c-7d4d75c33ad3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:25.513563 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9b3c525e-88c8-4b63-b865-eb5f151de14a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:25.537508 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9b3c525e-88c8-4b63-b865-eb5f151de14a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/adb50b8a-afc7-4d23-a44c-7d4d75c33ad3" status: 200 len: 1228 microversion: 2.1 time: 0.329626 Aug 31 16:11:25.541940 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1923/4039] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:25 2022] GET /compute/v2.1/servers/adb50b8a-afc7-4d23-a44c-7d4d75c33ad3 => generated 1228 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:25.593421 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-bcaa4be5-759a-46f8-9e66-7be789818e8c tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:25.609729 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-bcaa4be5-759a-46f8-9e66-7be789818e8c tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c" status: 200 len: 1521 microversion: 2.1 time: 0.515083 Aug 31 16:11:25.611788 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2117/4040] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:25 2022] GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c => generated 1521 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:25.668913 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ebbdab15-27a8-4d44-af57-1e94a028cde2 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:25.670143 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ebbdab15-27a8-4d44-af57-1e94a028cde2 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 5923807d-1058-45ab-b8d1-c6700ea8c142] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:25.683775 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-f7414cbc-4b78-4eff-8931-8696647b15a4 req-ed430074-8bee-42b5-872f-3c195d737e58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da3e4266-a9bc-4433-a335-580713bac164", "name": "network-vif-plugged", "status": "completed", "tag": "3fbcf647-bed8-4bd1-8cb6-2c28f9c026e1"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:25.702881 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-f7414cbc-4b78-4eff-8931-8696647b15a4 req-ed430074-8bee-42b5-872f-3c195d737e58 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:25.705937 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebbdab15-27a8-4d44-af57-1e94a028cde2 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:25.706581 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebbdab15-27a8-4d44-af57-1e94a028cde2 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:25.707121 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebbdab15-27a8-4d44-af57-1e94a028cde2 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:25.707819 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-f7414cbc-4b78-4eff-8931-8696647b15a4 req-ed430074-8bee-42b5-872f-3c195d737e58 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:25.710039 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebbdab15-27a8-4d44-af57-1e94a028cde2 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:25.710455 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-f7414cbc-4b78-4eff-8931-8696647b15a4 req-ed430074-8bee-42b5-872f-3c195d737e58 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:25.713390 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebbdab15-27a8-4d44-af57-1e94a028cde2 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:25.713987 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebbdab15-27a8-4d44-af57-1e94a028cde2 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:25.746728 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-f7414cbc-4b78-4eff-8931-8696647b15a4 req-ed430074-8bee-42b5-872f-3c195d737e58 service nova] Creating event network-vif-plugged:3fbcf647-bed8-4bd1-8cb6-2c28f9c026e1 for instance da3e4266-a9bc-4433-a335-580713bac164 on n-h1-833090-16 Aug 31 16:11:25.761212 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-f7414cbc-4b78-4eff-8931-8696647b15a4 req-ed430074-8bee-42b5-872f-3c195d737e58 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081380 Aug 31 16:11:25.764024 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2118/4041] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:11:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:11:26.096967 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ebbdab15-27a8-4d44-af57-1e94a028cde2 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:26.102955 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:11:26.121583 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ebbdab15-27a8-4d44-af57-1e94a028cde2 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142" status: 200 len: 1478 microversion: 2.1 time: 0.465681 Aug 31 16:11:26.128102 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1924/4042] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:25 2022] GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142 => generated 1478 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:26.245293 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-305c8487-9fa3-43d6-9f89-0f683f1495a1 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:26.250427 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-305c8487-9fa3-43d6-9f89-0f683f1495a1 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] [instance: da3e4266-a9bc-4433-a335-580713bac164] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:26.276821 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-305c8487-9fa3-43d6-9f89-0f683f1495a1 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:26.282765 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-305c8487-9fa3-43d6-9f89-0f683f1495a1 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:26.286344 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-305c8487-9fa3-43d6-9f89-0f683f1495a1 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:26.289496 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-305c8487-9fa3-43d6-9f89-0f683f1495a1 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:26.290952 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-305c8487-9fa3-43d6-9f89-0f683f1495a1 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:26.294380 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-305c8487-9fa3-43d6-9f89-0f683f1495a1 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:26.567422 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ba76fd6c-e4a5-4683-986e-e7e017d6d019 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:26.567968 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ba76fd6c-e4a5-4683-986e-e7e017d6d019 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: adb50b8a-afc7-4d23-a44c-7d4d75c33ad3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:26.585451 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba76fd6c-e4a5-4683-986e-e7e017d6d019 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:26.591086 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba76fd6c-e4a5-4683-986e-e7e017d6d019 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:26.591681 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba76fd6c-e4a5-4683-986e-e7e017d6d019 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:26.596997 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba76fd6c-e4a5-4683-986e-e7e017d6d019 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:26.600633 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba76fd6c-e4a5-4683-986e-e7e017d6d019 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:26.601679 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba76fd6c-e4a5-4683-986e-e7e017d6d019 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:26.679459 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-305c8487-9fa3-43d6-9f89-0f683f1495a1 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19802f8112a04f1d94a35a1956188452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9eaf2ea58471390358e3d3c4a9689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:26.700146 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-305c8487-9fa3-43d6-9f89-0f683f1495a1 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] 10.222.0.50 "GET /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164" status: 200 len: 1322 microversion: 2.1 time: 0.474889 Aug 31 16:11:26.719679 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2119/4043] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:26 2022] GET /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164 => generated 1322 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:26.728227 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-33797bb2-c176-402a-bc98-8467f7206211 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:26.730925 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-33797bb2-c176-402a-bc98-8467f7206211 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: 5116a4af-d819-456a-b188-7dcf94b7b35c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:26.755362 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33797bb2-c176-402a-bc98-8467f7206211 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:26.760263 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33797bb2-c176-402a-bc98-8467f7206211 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:26.760991 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33797bb2-c176-402a-bc98-8467f7206211 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:26.761639 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33797bb2-c176-402a-bc98-8467f7206211 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:26.766823 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33797bb2-c176-402a-bc98-8467f7206211 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:26.767071 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33797bb2-c176-402a-bc98-8467f7206211 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:26.828432 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ba76fd6c-e4a5-4683-986e-e7e017d6d019 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:26.841512 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ba76fd6c-e4a5-4683-986e-e7e017d6d019 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/adb50b8a-afc7-4d23-a44c-7d4d75c33ad3" status: 200 len: 1232 microversion: 2.1 time: 0.278126 Aug 31 16:11:26.844750 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1925/4044] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:26 2022] GET /compute/v2.1/servers/adb50b8a-afc7-4d23-a44c-7d4d75c33ad3 => generated 1232 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:27.112091 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-33797bb2-c176-402a-bc98-8467f7206211 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:27.134582 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-33797bb2-c176-402a-bc98-8467f7206211 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c" status: 200 len: 1521 microversion: 2.1 time: 0.413744 Aug 31 16:11:27.159946 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-842e48c4-7f23-4518-8f43-a301f0d1ead4 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:27.161039 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-842e48c4-7f23-4518-8f43-a301f0d1ead4 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 5923807d-1058-45ab-b8d1-c6700ea8c142] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:27.169409 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2120/4045] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:26 2022] GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c => generated 1521 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:27.189564 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-842e48c4-7f23-4518-8f43-a301f0d1ead4 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:27.191181 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-842e48c4-7f23-4518-8f43-a301f0d1ead4 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:27.192252 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-842e48c4-7f23-4518-8f43-a301f0d1ead4 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:27.203134 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-842e48c4-7f23-4518-8f43-a301f0d1ead4 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:27.205890 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-842e48c4-7f23-4518-8f43-a301f0d1ead4 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:27.208561 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-842e48c4-7f23-4518-8f43-a301f0d1ead4 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:27.696401 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-842e48c4-7f23-4518-8f43-a301f0d1ead4 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:27.714764 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-842e48c4-7f23-4518-8f43-a301f0d1ead4 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142" status: 200 len: 1478 microversion: 2.1 time: 0.559642 Aug 31 16:11:27.715816 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1926/4046] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:27 2022] GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142 => generated 1478 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:11:27.733488 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-506ec576-42a9-4dcb-b3b5-3f6226177e36 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:27.735826 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-506ec576-42a9-4dcb-b3b5-3f6226177e36 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] [instance: da3e4266-a9bc-4433-a335-580713bac164] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:27.756284 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-506ec576-42a9-4dcb-b3b5-3f6226177e36 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:27.757435 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-506ec576-42a9-4dcb-b3b5-3f6226177e36 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:27.758114 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-506ec576-42a9-4dcb-b3b5-3f6226177e36 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:27.759042 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-506ec576-42a9-4dcb-b3b5-3f6226177e36 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:27.759739 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-506ec576-42a9-4dcb-b3b5-3f6226177e36 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:27.760541 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-506ec576-42a9-4dcb-b3b5-3f6226177e36 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:27.886971 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-464fee15-7ab1-4e9b-9425-fe53aa317ffe tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:27.887604 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-464fee15-7ab1-4e9b-9425-fe53aa317ffe tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: adb50b8a-afc7-4d23-a44c-7d4d75c33ad3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:27.900741 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-464fee15-7ab1-4e9b-9425-fe53aa317ffe tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:27.901521 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-464fee15-7ab1-4e9b-9425-fe53aa317ffe tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:27.902326 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-464fee15-7ab1-4e9b-9425-fe53aa317ffe tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:27.904083 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-464fee15-7ab1-4e9b-9425-fe53aa317ffe tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:27.904778 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-464fee15-7ab1-4e9b-9425-fe53aa317ffe tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:27.905763 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-464fee15-7ab1-4e9b-9425-fe53aa317ffe tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:28.048760 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-506ec576-42a9-4dcb-b3b5-3f6226177e36 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19802f8112a04f1d94a35a1956188452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9eaf2ea58471390358e3d3c4a9689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:28.067261 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-506ec576-42a9-4dcb-b3b5-3f6226177e36 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] 10.222.0.50 "GET /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164" status: 200 len: 1517 microversion: 2.1 time: 0.332568 Aug 31 16:11:28.083063 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2121/4047] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:27 2022] GET /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164 => generated 1517 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:28.090513 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1dfb4b80-5331-499c-83b6-fc76a8ebe2d7 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:28.093991 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1dfb4b80-5331-499c-83b6-fc76a8ebe2d7 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] [instance: da3e4266-a9bc-4433-a335-580713bac164] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:28.104235 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1dfb4b80-5331-499c-83b6-fc76a8ebe2d7 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:28.105109 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1dfb4b80-5331-499c-83b6-fc76a8ebe2d7 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:28.105895 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1dfb4b80-5331-499c-83b6-fc76a8ebe2d7 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:28.107233 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1dfb4b80-5331-499c-83b6-fc76a8ebe2d7 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:28.107927 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1dfb4b80-5331-499c-83b6-fc76a8ebe2d7 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:28.109005 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1dfb4b80-5331-499c-83b6-fc76a8ebe2d7 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:28.149872 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-1dfb4b80-5331-499c-83b6-fc76a8ebe2d7 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lazy-loading 'flavor' on Instance uuid da3e4266-a9bc-4433-a335-580713bac164 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:11:28.212564 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-464fee15-7ab1-4e9b-9425-fe53aa317ffe tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:28.234550 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-464fee15-7ab1-4e9b-9425-fe53aa317ffe tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/adb50b8a-afc7-4d23-a44c-7d4d75c33ad3" status: 200 len: 1232 microversion: 2.1 time: 0.352619 Aug 31 16:11:28.253219 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1927/4048] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:27 2022] GET /compute/v2.1/servers/adb50b8a-afc7-4d23-a44c-7d4d75c33ad3 => generated 1232 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:28.264347 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a02c0674-7384-4c2b-b9af-19c0f0d51bff tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:28.265059 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a02c0674-7384-4c2b-b9af-19c0f0d51bff tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: 5116a4af-d819-456a-b188-7dcf94b7b35c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:28.272388 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a02c0674-7384-4c2b-b9af-19c0f0d51bff tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:28.272909 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a02c0674-7384-4c2b-b9af-19c0f0d51bff tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:28.273379 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a02c0674-7384-4c2b-b9af-19c0f0d51bff tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:28.274213 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a02c0674-7384-4c2b-b9af-19c0f0d51bff tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:28.274898 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a02c0674-7384-4c2b-b9af-19c0f0d51bff tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:28.275700 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a02c0674-7384-4c2b-b9af-19c0f0d51bff tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:28.355666 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1dfb4b80-5331-499c-83b6-fc76a8ebe2d7 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] 10.222.0.50 "POST /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164/action" status: 200 len: 32 microversion: 2.1 time: 0.270020 Aug 31 16:11:28.367907 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2122/4049] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:11:28 2022] POST /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164/action => generated 32 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 16:11:28.393886 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-14e46de8-8aa5-4eff-9dc9-97fdfb07a922 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:28.417777 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-14e46de8-8aa5-4eff-9dc9-97fdfb07a922 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: f6e41791-366b-4790-8338-2a52f4ebed89] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:28.470020 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-14e46de8-8aa5-4eff-9dc9-97fdfb07a922 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:28.470771 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-14e46de8-8aa5-4eff-9dc9-97fdfb07a922 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:28.471315 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-14e46de8-8aa5-4eff-9dc9-97fdfb07a922 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:28.475758 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-14e46de8-8aa5-4eff-9dc9-97fdfb07a922 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:28.476630 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-14e46de8-8aa5-4eff-9dc9-97fdfb07a922 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:28.477269 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-14e46de8-8aa5-4eff-9dc9-97fdfb07a922 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:28.552249 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-14e46de8-8aa5-4eff-9dc9-97fdfb07a922 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "POST /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89/action" status: 200 len: 24563 microversion: 2.1 time: 0.177521 Aug 31 16:11:28.554212 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2123/4050] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:11:28 2022] POST /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89/action => generated 24563 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:11:28.570341 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f66908c6-1d8a-4ead-971d-decb63b82c2c tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:28.572735 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f66908c6-1d8a-4ead-971d-decb63b82c2c tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] [instance: da3e4266-a9bc-4433-a335-580713bac164] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:28.582421 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f66908c6-1d8a-4ead-971d-decb63b82c2c tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:28.583335 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f66908c6-1d8a-4ead-971d-decb63b82c2c tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:28.584632 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f66908c6-1d8a-4ead-971d-decb63b82c2c tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:28.585817 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f66908c6-1d8a-4ead-971d-decb63b82c2c tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:28.586502 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f66908c6-1d8a-4ead-971d-decb63b82c2c tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:28.587251 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f66908c6-1d8a-4ead-971d-decb63b82c2c tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:29.184380 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a02c0674-7384-4c2b-b9af-19c0f0d51bff tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:29.211276 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a02c0674-7384-4c2b-b9af-19c0f0d51bff tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c" status: 200 len: 1521 microversion: 2.1 time: 0.956111 Aug 31 16:11:29.211877 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1928/4051] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:28 2022] GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c => generated 1521 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:29.239593 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ecf0e65a-095f-4711-b96a-a306000fa9ed tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:29.241181 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ecf0e65a-095f-4711-b96a-a306000fa9ed tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 5923807d-1058-45ab-b8d1-c6700ea8c142] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:29.255908 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:11:29.260298 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ecf0e65a-095f-4711-b96a-a306000fa9ed tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:29.261468 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ecf0e65a-095f-4711-b96a-a306000fa9ed tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:29.262439 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ecf0e65a-095f-4711-b96a-a306000fa9ed tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:29.264691 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ecf0e65a-095f-4711-b96a-a306000fa9ed tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:29.266724 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ecf0e65a-095f-4711-b96a-a306000fa9ed tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:29.269643 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ecf0e65a-095f-4711-b96a-a306000fa9ed tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:29.836504 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f66908c6-1d8a-4ead-971d-decb63b82c2c tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19802f8112a04f1d94a35a1956188452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9eaf2ea58471390358e3d3c4a9689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:29.860849 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f66908c6-1d8a-4ead-971d-decb63b82c2c tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] 10.222.0.50 "GET /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164" status: 200 len: 1523 microversion: 2.1 time: 1.304458 Aug 31 16:11:29.863354 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2124/4052] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:28 2022] GET /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164 => generated 1523 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:29.871442 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0dd9644f-7958-4628-bf3b-6183a369a252 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:29.872772 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0dd9644f-7958-4628-bf3b-6183a369a252 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: adb50b8a-afc7-4d23-a44c-7d4d75c33ad3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:29.887131 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0dd9644f-7958-4628-bf3b-6183a369a252 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:29.888911 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0dd9644f-7958-4628-bf3b-6183a369a252 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:29.889932 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0dd9644f-7958-4628-bf3b-6183a369a252 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:29.891461 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0dd9644f-7958-4628-bf3b-6183a369a252 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:29.892510 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0dd9644f-7958-4628-bf3b-6183a369a252 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:29.894040 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0dd9644f-7958-4628-bf3b-6183a369a252 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:30.083662 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0dd9644f-7958-4628-bf3b-6183a369a252 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:30.096615 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0dd9644f-7958-4628-bf3b-6183a369a252 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/adb50b8a-afc7-4d23-a44c-7d4d75c33ad3" status: 200 len: 1280 microversion: 2.1 time: 0.228684 Aug 31 16:11:30.115020 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2125/4053] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:29 2022] GET /compute/v2.1/servers/adb50b8a-afc7-4d23-a44c-7d4d75c33ad3 => generated 1280 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:30.115020 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-121d3532-adce-4305-9daa-e92ed079fc44 req-7df8192e-4f3d-45d5-8bda-978fb7832e31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5923807d-1058-45ab-b8d1-c6700ea8c142", "name": "network-vif-unplugged", "status": "completed", "tag": "b92f4d7a-9fe1-49d2-9d35-67e9a518bfc4"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:30.155942 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-121d3532-adce-4305-9daa-e92ed079fc44 req-7df8192e-4f3d-45d5-8bda-978fb7832e31 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:30.158727 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-121d3532-adce-4305-9daa-e92ed079fc44 req-7df8192e-4f3d-45d5-8bda-978fb7832e31 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:30.166037 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-121d3532-adce-4305-9daa-e92ed079fc44 req-7df8192e-4f3d-45d5-8bda-978fb7832e31 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:30.217594 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-121d3532-adce-4305-9daa-e92ed079fc44 req-7df8192e-4f3d-45d5-8bda-978fb7832e31 service nova] Creating event network-vif-unplugged:b92f4d7a-9fe1-49d2-9d35-67e9a518bfc4 for instance 5923807d-1058-45ab-b8d1-c6700ea8c142 on n-h2-833090-16 Aug 31 16:11:30.242542 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-121d3532-adce-4305-9daa-e92ed079fc44 req-7df8192e-4f3d-45d5-8bda-978fb7832e31 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.138826 Aug 31 16:11:30.250633 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2126/4054] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:11:30.259360 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5df649af-7cfd-48c7-81b6-e0f3b53179d9 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:30.260376 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5df649af-7cfd-48c7-81b6-e0f3b53179d9 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: 5116a4af-d819-456a-b188-7dcf94b7b35c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:30.281952 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5df649af-7cfd-48c7-81b6-e0f3b53179d9 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:30.282466 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5df649af-7cfd-48c7-81b6-e0f3b53179d9 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:30.283482 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5df649af-7cfd-48c7-81b6-e0f3b53179d9 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:30.284207 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5df649af-7cfd-48c7-81b6-e0f3b53179d9 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:30.284686 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5df649af-7cfd-48c7-81b6-e0f3b53179d9 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:30.285112 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5df649af-7cfd-48c7-81b6-e0f3b53179d9 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:30.439588 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ecf0e65a-095f-4711-b96a-a306000fa9ed tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:30.458709 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ecf0e65a-095f-4711-b96a-a306000fa9ed tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142" status: 200 len: 1478 microversion: 2.1 time: 1.245728 Aug 31 16:11:30.459319 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1929/4055] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:29 2022] GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142 => generated 1478 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:30.899286 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5df649af-7cfd-48c7-81b6-e0f3b53179d9 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:30.912110 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5df649af-7cfd-48c7-81b6-e0f3b53179d9 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c" status: 200 len: 1521 microversion: 2.1 time: 0.659981 Aug 31 16:11:30.930269 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2127/4056] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:30 2022] GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c => generated 1521 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:30.974548 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f064b556-48fc-4ef6-9c7d-3636e163e8d4 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:30.985937 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f064b556-48fc-4ef6-9c7d-3636e163e8d4 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] [instance: da3e4266-a9bc-4433-a335-580713bac164] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:31.004136 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f064b556-48fc-4ef6-9c7d-3636e163e8d4 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:31.005584 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f064b556-48fc-4ef6-9c7d-3636e163e8d4 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:31.006372 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f064b556-48fc-4ef6-9c7d-3636e163e8d4 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:31.010820 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f064b556-48fc-4ef6-9c7d-3636e163e8d4 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:31.012877 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f064b556-48fc-4ef6-9c7d-3636e163e8d4 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:31.014060 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f064b556-48fc-4ef6-9c7d-3636e163e8d4 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:31.239262 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7b9005c3-6238-40a2-bdb2-79c7a8aab131 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1862308540", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:31.357318 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-7b9005c3-6238-40a2-bdb2-79c7a8aab131 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] validate_networks() for [('a76d6272-2ae3-4409-a447-8c2fdf7af56f', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:11:31.576749 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f064b556-48fc-4ef6-9c7d-3636e163e8d4 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19802f8112a04f1d94a35a1956188452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9eaf2ea58471390358e3d3c4a9689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:31.594503 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f064b556-48fc-4ef6-9c7d-3636e163e8d4 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] 10.222.0.50 "GET /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164" status: 200 len: 1523 microversion: 2.1 time: 0.647352 Aug 31 16:11:31.615852 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2128/4057] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:30 2022] GET /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164 => generated 1523 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:31.633994 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fce4403a-de6a-4e20-a55c-fd5a36ac82d8 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:31.640740 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fce4403a-de6a-4e20-a55c-fd5a36ac82d8 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: adb50b8a-afc7-4d23-a44c-7d4d75c33ad3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:31.670474 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fce4403a-de6a-4e20-a55c-fd5a36ac82d8 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:31.671416 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fce4403a-de6a-4e20-a55c-fd5a36ac82d8 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:31.671884 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fce4403a-de6a-4e20-a55c-fd5a36ac82d8 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:31.672760 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fce4403a-de6a-4e20-a55c-fd5a36ac82d8 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:31.673392 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fce4403a-de6a-4e20-a55c-fd5a36ac82d8 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:31.673862 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fce4403a-de6a-4e20-a55c-fd5a36ac82d8 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:31.850343 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-fce4403a-de6a-4e20-a55c-fd5a36ac82d8 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:31.875664 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fce4403a-de6a-4e20-a55c-fd5a36ac82d8 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/adb50b8a-afc7-4d23-a44c-7d4d75c33ad3" status: 200 len: 1286 microversion: 2.1 time: 0.256775 Aug 31 16:11:31.883007 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2129/4058] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:31 2022] GET /compute/v2.1/servers/adb50b8a-afc7-4d23-a44c-7d4d75c33ad3 => generated 1286 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:31.909217 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-df521720-471a-43e6-907f-4224c00df66e tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:31.910694 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-df521720-471a-43e6-907f-4224c00df66e tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 5923807d-1058-45ab-b8d1-c6700ea8c142] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:31.918663 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-df521720-471a-43e6-907f-4224c00df66e tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:31.920101 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-df521720-471a-43e6-907f-4224c00df66e tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:31.920792 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-df521720-471a-43e6-907f-4224c00df66e tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:31.922598 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-df521720-471a-43e6-907f-4224c00df66e tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:31.923500 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-df521720-471a-43e6-907f-4224c00df66e tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:31.924133 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-df521720-471a-43e6-907f-4224c00df66e tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:32.401893 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-df521720-471a-43e6-907f-4224c00df66e tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:32.405795 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:11:32.420684 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-df521720-471a-43e6-907f-4224c00df66e tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142" status: 200 len: 1478 microversion: 2.1 time: 0.534544 Aug 31 16:11:32.426017 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2130/4059] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:31 2022] GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142 => generated 1478 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:32.437664 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f50b900c-34a1-472d-a0bb-563f872f1f2c tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:32.440919 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f50b900c-34a1-472d-a0bb-563f872f1f2c tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: 5116a4af-d819-456a-b188-7dcf94b7b35c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:32.461457 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f50b900c-34a1-472d-a0bb-563f872f1f2c tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:32.464227 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f50b900c-34a1-472d-a0bb-563f872f1f2c tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:32.468052 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f50b900c-34a1-472d-a0bb-563f872f1f2c tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:32.469332 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f50b900c-34a1-472d-a0bb-563f872f1f2c tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:32.472367 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f50b900c-34a1-472d-a0bb-563f872f1f2c tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:32.473890 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f50b900c-34a1-472d-a0bb-563f872f1f2c tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:32.563977 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-7b9005c3-6238-40a2-bdb2-79c7a8aab131 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:11:32.564546 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-7b9005c3-6238-40a2-bdb2-79c7a8aab131 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:11:32.565139 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-7b9005c3-6238-40a2-bdb2-79c7a8aab131 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:11:32.565542 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-7b9005c3-6238-40a2-bdb2-79c7a8aab131 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:11:32.565946 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-7b9005c3-6238-40a2-bdb2-79c7a8aab131 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:11:32.602158 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b9005c3-6238-40a2-bdb2-79c7a8aab131 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:32.602389 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b9005c3-6238-40a2-bdb2-79c7a8aab131 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:32.606371 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b9005c3-6238-40a2-bdb2-79c7a8aab131 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:32.607555 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b9005c3-6238-40a2-bdb2-79c7a8aab131 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:32.608039 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b9005c3-6238-40a2-bdb2-79c7a8aab131 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:32.608474 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b9005c3-6238-40a2-bdb2-79c7a8aab131 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:32.709898 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-7b9005c3-6238-40a2-bdb2-79c7a8aab131 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Getting quotas for project d25e1b1938b2401bab27dafadc9745d5. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:11:32.727917 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-7b9005c3-6238-40a2-bdb2-79c7a8aab131 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Getting quotas for user b5f67b54e87c46d28e7d5217bf49ca57 and project d25e1b1938b2401bab27dafadc9745d5. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:11:32.738201 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f50b900c-34a1-472d-a0bb-563f872f1f2c tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:32.749558 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f50b900c-34a1-472d-a0bb-563f872f1f2c tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c" status: 200 len: 1521 microversion: 2.1 time: 0.321960 Aug 31 16:11:32.762189 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2131/4060] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:32 2022] GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c => generated 1521 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:32.768299 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-37887a7c-e903-4d8f-b484-b8032666aaaf req-b2266e61-094f-462f-b2c2-08cf3d0b97d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5116a4af-d819-456a-b188-7dcf94b7b35c", "name": "network-vif-plugged", "status": "completed", "tag": "367272f4-dbf2-4acc-ba34-c1c2c1d4bee7"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:32.773434 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7b9005c3-6238-40a2-bdb2-79c7a8aab131 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:11:32.775910 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7b9005c3-6238-40a2-bdb2-79c7a8aab131 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 14167776-553f-4203-887b-3cb8e4cc0a2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:11:32.788912 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-37887a7c-e903-4d8f-b484-b8032666aaaf req-b2266e61-094f-462f-b2c2-08cf3d0b97d1 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:32.794275 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-37887a7c-e903-4d8f-b484-b8032666aaaf req-b2266e61-094f-462f-b2c2-08cf3d0b97d1 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:32.794780 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-37887a7c-e903-4d8f-b484-b8032666aaaf req-b2266e61-094f-462f-b2c2-08cf3d0b97d1 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:32.832153 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-37887a7c-e903-4d8f-b484-b8032666aaaf req-b2266e61-094f-462f-b2c2-08cf3d0b97d1 service nova] Creating event network-vif-plugged:367272f4-dbf2-4acc-ba34-c1c2c1d4bee7 for instance 5116a4af-d819-456a-b188-7dcf94b7b35c on n-h1-833090-16 Aug 31 16:11:32.843809 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-37887a7c-e903-4d8f-b484-b8032666aaaf req-b2266e61-094f-462f-b2c2-08cf3d0b97d1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088506 Aug 31 16:11:32.844433 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2132/4061] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:11:32.854395 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a26387ca-22a2-45ad-aa62-4fbd9f0a3c21 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:32.859739 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a26387ca-22a2-45ad-aa62-4fbd9f0a3c21 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] [instance: da3e4266-a9bc-4433-a335-580713bac164] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:32.888895 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a26387ca-22a2-45ad-aa62-4fbd9f0a3c21 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:32.889466 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a26387ca-22a2-45ad-aa62-4fbd9f0a3c21 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:32.894438 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a26387ca-22a2-45ad-aa62-4fbd9f0a3c21 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:32.897123 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a26387ca-22a2-45ad-aa62-4fbd9f0a3c21 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:32.898979 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a26387ca-22a2-45ad-aa62-4fbd9f0a3c21 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:32.899388 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a26387ca-22a2-45ad-aa62-4fbd9f0a3c21 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:32.950277 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7b9005c3-6238-40a2-bdb2-79c7a8aab131 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.110203 Aug 31 16:11:32.960795 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1930/4062] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:11:30 2022] POST /compute/v2.1/servers => generated 383 bytes in 2122 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 16:11:33.247224 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7c5e9e5c-d603-4851-b390-7b9afc6a8eb4 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-167361369", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "d99c5be6-d432-4c4f-8ce6-9e8ddc028f37"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:33.375404 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-7c5e9e5c-d603-4851-b390-7b9afc6a8eb4 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] validate_networks() for [('d99c5be6-d432-4c4f-8ce6-9e8ddc028f37', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:11:33.402128 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a26387ca-22a2-45ad-aa62-4fbd9f0a3c21 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19802f8112a04f1d94a35a1956188452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9eaf2ea58471390358e3d3c4a9689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:33.421157 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a26387ca-22a2-45ad-aa62-4fbd9f0a3c21 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] 10.222.0.50 "GET /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164" status: 200 len: 1523 microversion: 2.1 time: 0.569936 Aug 31 16:11:33.421822 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2133/4063] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:32 2022] GET /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164 => generated 1523 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:33.437037 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2ff47763-2a4b-4bd7-8764-12f5809e3445 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:33.437654 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2ff47763-2a4b-4bd7-8764-12f5809e3445 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: adb50b8a-afc7-4d23-a44c-7d4d75c33ad3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:33.480201 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2ff47763-2a4b-4bd7-8764-12f5809e3445 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:33.484059 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2ff47763-2a4b-4bd7-8764-12f5809e3445 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:33.484651 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2ff47763-2a4b-4bd7-8764-12f5809e3445 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:33.485750 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2ff47763-2a4b-4bd7-8764-12f5809e3445 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:33.486266 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2ff47763-2a4b-4bd7-8764-12f5809e3445 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:33.486700 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2ff47763-2a4b-4bd7-8764-12f5809e3445 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:33.927052 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2ff47763-2a4b-4bd7-8764-12f5809e3445 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:33.943052 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2ff47763-2a4b-4bd7-8764-12f5809e3445 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/adb50b8a-afc7-4d23-a44c-7d4d75c33ad3" status: 200 len: 1328 microversion: 2.1 time: 0.520047 Aug 31 16:11:33.943662 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2134/4064] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:33 2022] GET /compute/v2.1/servers/adb50b8a-afc7-4d23-a44c-7d4d75c33ad3 => generated 1328 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:33.954934 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-baab6d50-0f2c-46fe-b1d9-54c293785c79 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:33.955560 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-baab6d50-0f2c-46fe-b1d9-54c293785c79 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 14167776-553f-4203-887b-3cb8e4cc0a2a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:33.978415 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-baab6d50-0f2c-46fe-b1d9-54c293785c79 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:33.978550 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-baab6d50-0f2c-46fe-b1d9-54c293785c79 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:33.978949 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-baab6d50-0f2c-46fe-b1d9-54c293785c79 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:33.980540 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-baab6d50-0f2c-46fe-b1d9-54c293785c79 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:33.981003 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-baab6d50-0f2c-46fe-b1d9-54c293785c79 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:33.981436 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-baab6d50-0f2c-46fe-b1d9-54c293785c79 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:34.193370 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-baab6d50-0f2c-46fe-b1d9-54c293785c79 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:34.207925 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-baab6d50-0f2c-46fe-b1d9-54c293785c79 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a" status: 200 len: 1226 microversion: 2.1 time: 0.259949 Aug 31 16:11:34.209536 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2135/4065] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:33 2022] GET /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a => generated 1226 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:34.214613 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0273b42d-f33b-49df-8c9f-f7b91cc11725 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:34.214954 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0273b42d-f33b-49df-8c9f-f7b91cc11725 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 5923807d-1058-45ab-b8d1-c6700ea8c142] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:34.268583 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0273b42d-f33b-49df-8c9f-f7b91cc11725 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:34.270506 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0273b42d-f33b-49df-8c9f-f7b91cc11725 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:34.271305 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0273b42d-f33b-49df-8c9f-f7b91cc11725 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:34.272422 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0273b42d-f33b-49df-8c9f-f7b91cc11725 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:34.277291 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0273b42d-f33b-49df-8c9f-f7b91cc11725 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:34.278189 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0273b42d-f33b-49df-8c9f-f7b91cc11725 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:34.764115 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:11:34.809254 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=6 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:11:35.530118 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0273b42d-f33b-49df-8c9f-f7b91cc11725 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:35.542924 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0273b42d-f33b-49df-8c9f-f7b91cc11725 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142" status: 200 len: 1478 microversion: 2.1 time: 1.332271 Aug 31 16:11:35.543525 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2136/4066] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:34 2022] GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142 => generated 1478 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:35.554818 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-7c5e9e5c-d603-4851-b390-7b9afc6a8eb4 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:11:35.555326 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-7c5e9e5c-d603-4851-b390-7b9afc6a8eb4 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:11:35.555685 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-7c5e9e5c-d603-4851-b390-7b9afc6a8eb4 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:11:35.556092 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-7c5e9e5c-d603-4851-b390-7b9afc6a8eb4 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:11:35.556500 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-7c5e9e5c-d603-4851-b390-7b9afc6a8eb4 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:11:35.567767 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7f983db0-cb75-4866-a433-dafd4de248ff tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:35.568394 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7f983db0-cb75-4866-a433-dafd4de248ff tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: 5116a4af-d819-456a-b188-7dcf94b7b35c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:35.577335 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c5e9e5c-d603-4851-b390-7b9afc6a8eb4 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:35.577870 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c5e9e5c-d603-4851-b390-7b9afc6a8eb4 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:35.578345 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c5e9e5c-d603-4851-b390-7b9afc6a8eb4 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:35.579144 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c5e9e5c-d603-4851-b390-7b9afc6a8eb4 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:35.579598 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c5e9e5c-d603-4851-b390-7b9afc6a8eb4 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:35.580025 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c5e9e5c-d603-4851-b390-7b9afc6a8eb4 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:35.596462 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f983db0-cb75-4866-a433-dafd4de248ff tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:35.596959 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f983db0-cb75-4866-a433-dafd4de248ff tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:35.597391 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f983db0-cb75-4866-a433-dafd4de248ff tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:35.598321 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f983db0-cb75-4866-a433-dafd4de248ff tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:35.600521 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f983db0-cb75-4866-a433-dafd4de248ff tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:35.601144 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f983db0-cb75-4866-a433-dafd4de248ff tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:35.655715 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-7c5e9e5c-d603-4851-b390-7b9afc6a8eb4 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Getting quotas for project da1f95b9a87a4f1389c03f6a3f592a2e. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:11:35.681298 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-7c5e9e5c-d603-4851-b390-7b9afc6a8eb4 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Getting quotas for user 391c4c8e6ae4483e82a247957a6faad9 and project da1f95b9a87a4f1389c03f6a3f592a2e. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:11:35.714422 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7c5e9e5c-d603-4851-b390-7b9afc6a8eb4 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Going to run 3 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:11:35.717088 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7c5e9e5c-d603-4851-b390-7b9afc6a8eb4 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] [instance: b778dc34-fa8e-4c9e-9cb6-5ececdf1074c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:11:35.780912 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7c5e9e5c-d603-4851-b390-7b9afc6a8eb4 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] [instance: 2af572bd-8a8b-4db7-9196-7203de031375] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=b778dc34-fa8e-4c9e-9cb6-5ececdf1074c,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:11:35.834604 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7c5e9e5c-d603-4851-b390-7b9afc6a8eb4 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] [instance: 4754015c-cda0-4f0a-9096-06bebe3d33b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=2af572bd-8a8b-4db7-9196-7203de031375,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:11:35.938439 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7f983db0-cb75-4866-a433-dafd4de248ff tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:35.953655 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7f983db0-cb75-4866-a433-dafd4de248ff tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c" status: 200 len: 1506 microversion: 2.1 time: 0.404709 Aug 31 16:11:35.959217 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2137/4067] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:35 2022] GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c => generated 1506 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:35.976845 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-55b68e9f-64c3-449e-a18f-9ed60f75f8e1 req-eb4705b7-4bc9-4798-9a69-cc1205887374 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adb50b8a-afc7-4d23-a44c-7d4d75c33ad3", "tag": "35074f3b-1243-4414-be68-4f5321bd13d7"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:36.029805 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-55b68e9f-64c3-449e-a18f-9ed60f75f8e1 req-eb4705b7-4bc9-4798-9a69-cc1205887374 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:36.030482 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-55b68e9f-64c3-449e-a18f-9ed60f75f8e1 req-eb4705b7-4bc9-4798-9a69-cc1205887374 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:36.030914 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-55b68e9f-64c3-449e-a18f-9ed60f75f8e1 req-eb4705b7-4bc9-4798-9a69-cc1205887374 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:36.035184 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7c5e9e5c-d603-4851-b390-7b9afc6a8eb4 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.071340 Aug 31 16:11:36.037504 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1931/4068] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:11:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 3076 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:11:36.057357 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-76bb5ff7-c299-4c9b-8a3a-a35759542cec tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:36.064025 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-76bb5ff7-c299-4c9b-8a3a-a35759542cec tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] [instance: da3e4266-a9bc-4433-a335-580713bac164] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:36.069034 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-55b68e9f-64c3-449e-a18f-9ed60f75f8e1 req-eb4705b7-4bc9-4798-9a69-cc1205887374 service nova] Creating event network-changed:35074f3b-1243-4414-be68-4f5321bd13d7 for instance adb50b8a-afc7-4d23-a44c-7d4d75c33ad3 on n-h2-833090-16 Aug 31 16:11:36.083639 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76bb5ff7-c299-4c9b-8a3a-a35759542cec tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:36.087717 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-55b68e9f-64c3-449e-a18f-9ed60f75f8e1 req-eb4705b7-4bc9-4798-9a69-cc1205887374 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121109 Aug 31 16:11:36.088354 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76bb5ff7-c299-4c9b-8a3a-a35759542cec tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:36.089059 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76bb5ff7-c299-4c9b-8a3a-a35759542cec tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:36.090603 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76bb5ff7-c299-4c9b-8a3a-a35759542cec tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:36.090881 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2138/4069] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:11:36.093891 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76bb5ff7-c299-4c9b-8a3a-a35759542cec tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:36.095421 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76bb5ff7-c299-4c9b-8a3a-a35759542cec tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:36.111739 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9daaef07-e565-4d8c-b677-543b81b92871 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1672451798", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:36.260334 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-9daaef07-e565-4d8c-b677-543b81b92871 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] validate_networks() for [('a76d6272-2ae3-4409-a447-8c2fdf7af56f', None, None, None, None, None)] {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:11:36.448009 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-76bb5ff7-c299-4c9b-8a3a-a35759542cec tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19802f8112a04f1d94a35a1956188452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9eaf2ea58471390358e3d3c4a9689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:36.465980 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-76bb5ff7-c299-4c9b-8a3a-a35759542cec tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] 10.222.0.50 "GET /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164" status: 200 len: 1523 microversion: 2.1 time: 0.427307 Aug 31 16:11:36.468039 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1932/4070] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:36 2022] GET /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164 => generated 1523 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:36.492162 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-54e45b0f-68d6-44d7-93b1-0cea2e6eb51d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:36.492784 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-54e45b0f-68d6-44d7-93b1-0cea2e6eb51d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: adb50b8a-afc7-4d23-a44c-7d4d75c33ad3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:36.503475 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-54e45b0f-68d6-44d7-93b1-0cea2e6eb51d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:36.505032 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-54e45b0f-68d6-44d7-93b1-0cea2e6eb51d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:36.506761 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-54e45b0f-68d6-44d7-93b1-0cea2e6eb51d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:36.508051 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-54e45b0f-68d6-44d7-93b1-0cea2e6eb51d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:36.509005 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-54e45b0f-68d6-44d7-93b1-0cea2e6eb51d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:36.510114 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-54e45b0f-68d6-44d7-93b1-0cea2e6eb51d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:37.453280 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-54e45b0f-68d6-44d7-93b1-0cea2e6eb51d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:37.478608 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-54e45b0f-68d6-44d7-93b1-0cea2e6eb51d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/adb50b8a-afc7-4d23-a44c-7d4d75c33ad3" status: 200 len: 1328 microversion: 2.1 time: 0.993808 Aug 31 16:11:37.479649 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1933/4071] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:36 2022] GET /compute/v2.1/servers/adb50b8a-afc7-4d23-a44c-7d4d75c33ad3 => generated 1328 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:37.529863 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f485b1cd-3738-48e0-af84-7c6e25afa6a4 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:37.531017 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f485b1cd-3738-48e0-af84-7c6e25afa6a4 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] [instance: f6e41791-366b-4790-8338-2a52f4ebed89] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:37.553179 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f485b1cd-3738-48e0-af84-7c6e25afa6a4 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:37.554014 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f485b1cd-3738-48e0-af84-7c6e25afa6a4 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:37.560483 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f485b1cd-3738-48e0-af84-7c6e25afa6a4 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:37.562232 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f485b1cd-3738-48e0-af84-7c6e25afa6a4 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:37.569804 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f485b1cd-3738-48e0-af84-7c6e25afa6a4 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:37.570871 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f485b1cd-3738-48e0-af84-7c6e25afa6a4 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:37.813611 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-9daaef07-e565-4d8c-b677-543b81b92871 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:11:37.814372 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-9daaef07-e565-4d8c-b677-543b81b92871 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:11:37.814538 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-9daaef07-e565-4d8c-b677-543b81b92871 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:11:37.814899 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-9daaef07-e565-4d8c-b677-543b81b92871 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:11:37.815302 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-9daaef07-e565-4d8c-b677-543b81b92871 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:11:37.837045 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9daaef07-e565-4d8c-b677-543b81b92871 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:37.841868 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9daaef07-e565-4d8c-b677-543b81b92871 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:37.842887 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9daaef07-e565-4d8c-b677-543b81b92871 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:37.844310 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9daaef07-e565-4d8c-b677-543b81b92871 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:37.844310 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9daaef07-e565-4d8c-b677-543b81b92871 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:37.846923 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9daaef07-e565-4d8c-b677-543b81b92871 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:37.896522 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-9daaef07-e565-4d8c-b677-543b81b92871 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Getting quotas for project d25e1b1938b2401bab27dafadc9745d5. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:11:37.912875 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-9daaef07-e565-4d8c-b677-543b81b92871 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Getting quotas for user b5f67b54e87c46d28e7d5217bf49ca57 and project d25e1b1938b2401bab27dafadc9745d5. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:11:37.936954 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9daaef07-e565-4d8c-b677-543b81b92871 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:11:37.940970 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9daaef07-e565-4d8c-b677-543b81b92871 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:11:38.033327 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9daaef07-e565-4d8c-b677-543b81b92871 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.939208 Aug 31 16:11:38.036107 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2139/4072] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:11:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 1945 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:11:38.048489 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-16fc781a-ae89-4fcb-a7c5-8d7ebfb62c83 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:38.050456 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-16fc781a-ae89-4fcb-a7c5-8d7ebfb62c83 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: 5116a4af-d819-456a-b188-7dcf94b7b35c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:38.069501 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-16fc781a-ae89-4fcb-a7c5-8d7ebfb62c83 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:38.072429 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-16fc781a-ae89-4fcb-a7c5-8d7ebfb62c83 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:38.073072 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-16fc781a-ae89-4fcb-a7c5-8d7ebfb62c83 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:38.074005 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-16fc781a-ae89-4fcb-a7c5-8d7ebfb62c83 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:38.074509 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-16fc781a-ae89-4fcb-a7c5-8d7ebfb62c83 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:38.074930 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-16fc781a-ae89-4fcb-a7c5-8d7ebfb62c83 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:38.320567 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f485b1cd-3738-48e0-af84-7c6e25afa6a4 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89" status: 200 len: 1836 microversion: 2.1 time: 0.805245 Aug 31 16:11:38.322740 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1934/4073] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:37 2022] GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89 => generated 1836 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:38.330568 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-08459ab6-fe05-41f4-8d35-8bea409066ae tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:38.348832 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-08459ab6-fe05-41f4-8d35-8bea409066ae tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '391c4c8e6ae4483e82a247957a6faad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1f95b9a87a4f1389c03f6a3f592a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:38.352966 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-08459ab6-fe05-41f4-8d35-8bea409066ae tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Searching by: {'deleted': False, 'project_id': 'da1f95b9a87a4f1389c03f6a3f592a2e'} {{(pid=128863) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:11:38.376084 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-08459ab6-fe05-41f4-8d35-8bea409066ae tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:38.380376 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-08459ab6-fe05-41f4-8d35-8bea409066ae tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:38.383836 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-08459ab6-fe05-41f4-8d35-8bea409066ae tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:38.384908 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-08459ab6-fe05-41f4-8d35-8bea409066ae tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:38.387153 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-08459ab6-fe05-41f4-8d35-8bea409066ae tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:38.388360 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-08459ab6-fe05-41f4-8d35-8bea409066ae tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:38.447636 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.multi_cell_list [None req-08459ab6-fe05-41f4-8d35-8bea409066ae tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128863) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:11:38.493054 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-16fc781a-ae89-4fcb-a7c5-8d7ebfb62c83 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:38.504144 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-16fc781a-ae89-4fcb-a7c5-8d7ebfb62c83 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c" status: 200 len: 1506 microversion: 2.1 time: 0.466189 Aug 31 16:11:38.506521 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2140/4074] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:38 2022] GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c => generated 1506 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:38.514156 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-5c3731bf-fa20-45e5-8b5e-2b238301a979 req-c36fa3f3-6850-4e13-ba04-1d8bca357a73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5923807d-1058-45ab-b8d1-c6700ea8c142", "name": "network-vif-plugged", "status": "completed", "tag": "b92f4d7a-9fe1-49d2-9d35-67e9a518bfc4"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:38.531098 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-5c3731bf-fa20-45e5-8b5e-2b238301a979 req-c36fa3f3-6850-4e13-ba04-1d8bca357a73 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:38.531583 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-5c3731bf-fa20-45e5-8b5e-2b238301a979 req-c36fa3f3-6850-4e13-ba04-1d8bca357a73 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:38.532008 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-5c3731bf-fa20-45e5-8b5e-2b238301a979 req-c36fa3f3-6850-4e13-ba04-1d8bca357a73 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:38.550813 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-5c3731bf-fa20-45e5-8b5e-2b238301a979 req-c36fa3f3-6850-4e13-ba04-1d8bca357a73 service nova] Creating event network-vif-plugged:b92f4d7a-9fe1-49d2-9d35-67e9a518bfc4 for instance 5923807d-1058-45ab-b8d1-c6700ea8c142 on n-h2-833090-16 Aug 31 16:11:38.563004 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-5c3731bf-fa20-45e5-8b5e-2b238301a979 req-c36fa3f3-6850-4e13-ba04-1d8bca357a73 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054145 Aug 31 16:11:38.565295 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2141/4075] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:11:38.571353 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-08459ab6-fe05-41f4-8d35-8bea409066ae tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.247641 Aug 31 16:11:38.572834 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-40ddd772-003a-4649-81c2-d89c8c0f8c5d tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:38.573542 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-40ddd772-003a-4649-81c2-d89c8c0f8c5d tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 5923807d-1058-45ab-b8d1-c6700ea8c142] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:38.587743 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1935/4076] 10.222.0.50 () {58 vars in 1125 bytes} [Wed Aug 31 16:11:38 2022] GET /compute/v2.1/servers => generated 1015 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:38.599813 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-40ddd772-003a-4649-81c2-d89c8c0f8c5d tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:38.600527 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-40ddd772-003a-4649-81c2-d89c8c0f8c5d tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:38.603942 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-40ddd772-003a-4649-81c2-d89c8c0f8c5d tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:38.605574 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-76bdbe36-adb7-442f-bac7-e33e855be491 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:38.611276 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-76bdbe36-adb7-442f-bac7-e33e855be491 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] [instance: da3e4266-a9bc-4433-a335-580713bac164] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:38.617412 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-40ddd772-003a-4649-81c2-d89c8c0f8c5d tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:38.618598 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-40ddd772-003a-4649-81c2-d89c8c0f8c5d tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:38.619242 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-40ddd772-003a-4649-81c2-d89c8c0f8c5d tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:38.635239 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76bdbe36-adb7-442f-bac7-e33e855be491 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:38.635755 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76bdbe36-adb7-442f-bac7-e33e855be491 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:38.636528 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76bdbe36-adb7-442f-bac7-e33e855be491 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:38.637323 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76bdbe36-adb7-442f-bac7-e33e855be491 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:38.637797 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76bdbe36-adb7-442f-bac7-e33e855be491 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:38.638520 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76bdbe36-adb7-442f-bac7-e33e855be491 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:39.256292 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-40ddd772-003a-4649-81c2-d89c8c0f8c5d tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:39.268638 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-40ddd772-003a-4649-81c2-d89c8c0f8c5d tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142" status: 200 len: 1478 microversion: 2.1 time: 0.698732 Aug 31 16:11:39.282853 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2142/4077] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:38 2022] GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142 => generated 1478 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:39.294939 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-37e16a72-3d5c-4a8e-ae2b-4e2503228167 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:39.296816 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-37e16a72-3d5c-4a8e-ae2b-4e2503228167 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:39.316805 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-37e16a72-3d5c-4a8e-ae2b-4e2503228167 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:39.317497 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-37e16a72-3d5c-4a8e-ae2b-4e2503228167 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:39.319228 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-37e16a72-3d5c-4a8e-ae2b-4e2503228167 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:39.325024 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-37e16a72-3d5c-4a8e-ae2b-4e2503228167 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:39.327245 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-37e16a72-3d5c-4a8e-ae2b-4e2503228167 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:39.327949 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-37e16a72-3d5c-4a8e-ae2b-4e2503228167 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:39.575820 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-37e16a72-3d5c-4a8e-ae2b-4e2503228167 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:39.592393 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-37e16a72-3d5c-4a8e-ae2b-4e2503228167 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f" status: 200 len: 1226 microversion: 2.1 time: 0.307048 Aug 31 16:11:39.597378 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2143/4078] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:39 2022] GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f => generated 1226 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:39.619235 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f046534b-d884-46cf-8575-92c529ef74bd tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:39.620230 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f046534b-d884-46cf-8575-92c529ef74bd tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: f6e41791-366b-4790-8338-2a52f4ebed89] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:39.624035 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:11:39.632747 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f046534b-d884-46cf-8575-92c529ef74bd tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:39.636169 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f046534b-d884-46cf-8575-92c529ef74bd tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:39.638532 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f046534b-d884-46cf-8575-92c529ef74bd tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:39.643377 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f046534b-d884-46cf-8575-92c529ef74bd tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:39.644188 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f046534b-d884-46cf-8575-92c529ef74bd tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:39.644851 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f046534b-d884-46cf-8575-92c529ef74bd tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:39.722790 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-76bdbe36-adb7-442f-bac7-e33e855be491 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19802f8112a04f1d94a35a1956188452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9eaf2ea58471390358e3d3c4a9689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:39.734124 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-76bdbe36-adb7-442f-bac7-e33e855be491 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] 10.222.0.50 "GET /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164" status: 200 len: 1523 microversion: 2.1 time: 1.143989 Aug 31 16:11:39.739519 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1936/4079] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:38 2022] GET /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164 => generated 1523 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:39.757638 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-26ec7bc5-aea0-4f5e-868e-a415ea0fc110 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:39.766499 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-26ec7bc5-aea0-4f5e-868e-a415ea0fc110 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: adb50b8a-afc7-4d23-a44c-7d4d75c33ad3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:39.782085 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26ec7bc5-aea0-4f5e-868e-a415ea0fc110 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:39.789630 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26ec7bc5-aea0-4f5e-868e-a415ea0fc110 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:39.790227 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26ec7bc5-aea0-4f5e-868e-a415ea0fc110 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:39.792518 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26ec7bc5-aea0-4f5e-868e-a415ea0fc110 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:39.793112 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26ec7bc5-aea0-4f5e-868e-a415ea0fc110 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:39.794969 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26ec7bc5-aea0-4f5e-868e-a415ea0fc110 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:40.314786 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f046534b-d884-46cf-8575-92c529ef74bd tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:40.319878 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-26ec7bc5-aea0-4f5e-868e-a415ea0fc110 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:40.345268 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-26ec7bc5-aea0-4f5e-868e-a415ea0fc110 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/adb50b8a-afc7-4d23-a44c-7d4d75c33ad3" status: 200 len: 1328 microversion: 2.1 time: 0.599850 Aug 31 16:11:40.347058 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f046534b-d884-46cf-8575-92c529ef74bd tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89" status: 200 len: 1683 microversion: 2.1 time: 0.748472 Aug 31 16:11:40.347587 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1937/4080] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:39 2022] GET /compute/v2.1/servers/adb50b8a-afc7-4d23-a44c-7d4d75c33ad3 => generated 1328 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:40.373470 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-05d13274-b47f-46c7-80ab-d47342d2340e tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:40.373927 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2144/4081] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:39 2022] GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89 => generated 1683 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:40.379581 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-014e7f33-53fb-49b3-8881-745f333e3cb4 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:40.380388 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-014e7f33-53fb-49b3-8881-745f333e3cb4 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] [instance: 2af572bd-8a8b-4db7-9196-7203de031375] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:40.384170 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-05d13274-b47f-46c7-80ab-d47342d2340e tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: 5116a4af-d819-456a-b188-7dcf94b7b35c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:40.392083 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-014e7f33-53fb-49b3-8881-745f333e3cb4 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:40.394977 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-014e7f33-53fb-49b3-8881-745f333e3cb4 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:40.396911 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-014e7f33-53fb-49b3-8881-745f333e3cb4 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:40.397833 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-014e7f33-53fb-49b3-8881-745f333e3cb4 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:40.400304 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05d13274-b47f-46c7-80ab-d47342d2340e tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:40.401641 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-014e7f33-53fb-49b3-8881-745f333e3cb4 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:40.402193 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-014e7f33-53fb-49b3-8881-745f333e3cb4 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:40.407722 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05d13274-b47f-46c7-80ab-d47342d2340e tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:40.408302 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05d13274-b47f-46c7-80ab-d47342d2340e tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:40.409205 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05d13274-b47f-46c7-80ab-d47342d2340e tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:40.409679 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05d13274-b47f-46c7-80ab-d47342d2340e tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:40.410111 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05d13274-b47f-46c7-80ab-d47342d2340e tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:40.475269 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-05d13274-b47f-46c7-80ab-d47342d2340e tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: 5116a4af-d819-456a-b188-7dcf94b7b35c] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:11:40.582039 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-014e7f33-53fb-49b3-8881-745f333e3cb4 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391c4c8e6ae4483e82a247957a6faad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1f95b9a87a4f1389c03f6a3f592a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:40.599136 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-014e7f33-53fb-49b3-8881-745f333e3cb4 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] 10.222.0.50 "GET /compute/v2.1/servers/2af572bd-8a8b-4db7-9196-7203de031375" status: 200 len: 1280 microversion: 2.1 time: 0.223346 Aug 31 16:11:40.615065 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2145/4082] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:40 2022] GET /compute/v2.1/servers/2af572bd-8a8b-4db7-9196-7203de031375 => generated 1280 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:40.633780 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-33bb3ffd-6ab6-4814-87f0-ff0a5c7596a6 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:40.636361 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-33bb3ffd-6ab6-4814-87f0-ff0a5c7596a6 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 5923807d-1058-45ab-b8d1-c6700ea8c142] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:40.641422 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-05d13274-b47f-46c7-80ab-d47342d2340e tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c" status: 204 len: 0 microversion: 2.1 time: 0.286803 Aug 31 16:11:40.642627 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1938/4083] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:11:40 2022] DELETE /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:11:40.677551 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b0a7e61b-958f-4fdc-b81d-9a4f72f0d8f4 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:40.684211 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33bb3ffd-6ab6-4814-87f0-ff0a5c7596a6 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:40.688667 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33bb3ffd-6ab6-4814-87f0-ff0a5c7596a6 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:40.690070 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b0a7e61b-958f-4fdc-b81d-9a4f72f0d8f4 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: f6e41791-366b-4790-8338-2a52f4ebed89] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:40.692875 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33bb3ffd-6ab6-4814-87f0-ff0a5c7596a6 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:40.693917 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33bb3ffd-6ab6-4814-87f0-ff0a5c7596a6 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:40.694347 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33bb3ffd-6ab6-4814-87f0-ff0a5c7596a6 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:40.703581 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0a7e61b-958f-4fdc-b81d-9a4f72f0d8f4 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:40.704801 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33bb3ffd-6ab6-4814-87f0-ff0a5c7596a6 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:40.707626 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0a7e61b-958f-4fdc-b81d-9a4f72f0d8f4 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:40.711200 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0a7e61b-958f-4fdc-b81d-9a4f72f0d8f4 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:40.714467 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0a7e61b-958f-4fdc-b81d-9a4f72f0d8f4 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:40.720362 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0a7e61b-958f-4fdc-b81d-9a4f72f0d8f4 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:40.736842 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0a7e61b-958f-4fdc-b81d-9a4f72f0d8f4 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:41.166838 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-33bb3ffd-6ab6-4814-87f0-ff0a5c7596a6 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:41.176978 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-33bb3ffd-6ab6-4814-87f0-ff0a5c7596a6 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142" status: 200 len: 1478 microversion: 2.1 time: 0.556565 Aug 31 16:11:41.193289 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2146/4084] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:40 2022] GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142 => generated 1478 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:41.198767 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-22daa29a-bd04-413b-b4ca-b8fe6c488671 req-71ee0acc-0d4a-4057-9fe8-d1ddeb3e4347 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14167776-553f-4203-887b-3cb8e4cc0a2a", "tag": "0173af77-c960-4ebc-83db-2830c6fe35dd"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:41.211646 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-22daa29a-bd04-413b-b4ca-b8fe6c488671 req-71ee0acc-0d4a-4057-9fe8-d1ddeb3e4347 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:41.212691 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-22daa29a-bd04-413b-b4ca-b8fe6c488671 req-71ee0acc-0d4a-4057-9fe8-d1ddeb3e4347 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:41.213279 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-22daa29a-bd04-413b-b4ca-b8fe6c488671 req-71ee0acc-0d4a-4057-9fe8-d1ddeb3e4347 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:41.228226 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-22daa29a-bd04-413b-b4ca-b8fe6c488671 req-71ee0acc-0d4a-4057-9fe8-d1ddeb3e4347 service nova] Creating event network-changed:0173af77-c960-4ebc-83db-2830c6fe35dd for instance 14167776-553f-4203-887b-3cb8e4cc0a2a on n-h2-833090-16 Aug 31 16:11:41.235576 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-22daa29a-bd04-413b-b4ca-b8fe6c488671 req-71ee0acc-0d4a-4057-9fe8-d1ddeb3e4347 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040216 Aug 31 16:11:41.240003 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2147/4085] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:11:41.247418 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8c30e012-e227-4a0f-a06e-a39a30683e3b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:41.248936 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8c30e012-e227-4a0f-a06e-a39a30683e3b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:41.256732 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8c30e012-e227-4a0f-a06e-a39a30683e3b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:41.257587 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8c30e012-e227-4a0f-a06e-a39a30683e3b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:41.258296 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8c30e012-e227-4a0f-a06e-a39a30683e3b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:41.271413 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8c30e012-e227-4a0f-a06e-a39a30683e3b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:41.275046 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8c30e012-e227-4a0f-a06e-a39a30683e3b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:41.275769 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8c30e012-e227-4a0f-a06e-a39a30683e3b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:41.613189 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8c30e012-e227-4a0f-a06e-a39a30683e3b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:41.631656 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8c30e012-e227-4a0f-a06e-a39a30683e3b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f" status: 200 len: 1274 microversion: 2.1 time: 0.389722 Aug 31 16:11:41.632452 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2148/4086] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:41 2022] GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f => generated 1274 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:41.637071 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9d9c3b59-5095-4427-9fbd-b55f0d86db0d tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:41.637600 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9d9c3b59-5095-4427-9fbd-b55f0d86db0d tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] [instance: da3e4266-a9bc-4433-a335-580713bac164] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:41.651159 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9d9c3b59-5095-4427-9fbd-b55f0d86db0d tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:41.652433 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9d9c3b59-5095-4427-9fbd-b55f0d86db0d tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:41.654129 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9d9c3b59-5095-4427-9fbd-b55f0d86db0d tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:41.654919 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9d9c3b59-5095-4427-9fbd-b55f0d86db0d tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:41.655377 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9d9c3b59-5095-4427-9fbd-b55f0d86db0d tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:41.655875 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9d9c3b59-5095-4427-9fbd-b55f0d86db0d tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:41.826803 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b0a7e61b-958f-4fdc-b81d-9a4f72f0d8f4 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "POST /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89/action" status: 200 len: 32635 microversion: 2.1 time: 1.182153 Aug 31 16:11:41.838170 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1939/4087] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:11:40 2022] POST /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89/action => generated 32635 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:11:41.843884 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2da289a5-4435-4af4-b33a-a45a66925dc2 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1722795686", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "6e75e888-e14d-4362-99a8-79dffb5a2c05"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:41.910233 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-2da289a5-4435-4af4-b33a-a45a66925dc2 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] validate_networks() for [('6e75e888-e14d-4362-99a8-79dffb5a2c05', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:11:42.086135 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9d9c3b59-5095-4427-9fbd-b55f0d86db0d tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19802f8112a04f1d94a35a1956188452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9eaf2ea58471390358e3d3c4a9689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:42.101406 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9d9c3b59-5095-4427-9fbd-b55f0d86db0d tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] 10.222.0.50 "GET /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164" status: 200 len: 1523 microversion: 2.1 time: 0.467830 Aug 31 16:11:42.101999 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2149/4088] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:41 2022] GET /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164 => generated 1523 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:42.120763 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-528f8659-ecf9-467c-84f4-6ed7e0daa298 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:42.122165 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-528f8659-ecf9-467c-84f4-6ed7e0daa298 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: adb50b8a-afc7-4d23-a44c-7d4d75c33ad3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:42.133944 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-528f8659-ecf9-467c-84f4-6ed7e0daa298 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:42.136777 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-528f8659-ecf9-467c-84f4-6ed7e0daa298 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:42.137555 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-528f8659-ecf9-467c-84f4-6ed7e0daa298 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:42.138969 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-528f8659-ecf9-467c-84f4-6ed7e0daa298 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:42.139810 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-528f8659-ecf9-467c-84f4-6ed7e0daa298 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:42.140776 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-528f8659-ecf9-467c-84f4-6ed7e0daa298 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:42.791571 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-528f8659-ecf9-467c-84f4-6ed7e0daa298 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:42.794653 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=100 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:11:42.811330 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-528f8659-ecf9-467c-84f4-6ed7e0daa298 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/adb50b8a-afc7-4d23-a44c-7d4d75c33ad3" status: 200 len: 1328 microversion: 2.1 time: 0.698352 Aug 31 16:11:42.826283 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2150/4089] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:42 2022] GET /compute/v2.1/servers/adb50b8a-afc7-4d23-a44c-7d4d75c33ad3 => generated 1328 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:42.840750 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9f394abb-e08e-48f7-a09a-e5a3328462eb tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:42.855098 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9f394abb-e08e-48f7-a09a-e5a3328462eb tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] [instance: 2af572bd-8a8b-4db7-9196-7203de031375] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:42.871478 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9f394abb-e08e-48f7-a09a-e5a3328462eb tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:42.872423 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9f394abb-e08e-48f7-a09a-e5a3328462eb tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:42.884279 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9f394abb-e08e-48f7-a09a-e5a3328462eb tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:42.885521 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9f394abb-e08e-48f7-a09a-e5a3328462eb tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:42.892037 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9f394abb-e08e-48f7-a09a-e5a3328462eb tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:42.892829 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9f394abb-e08e-48f7-a09a-e5a3328462eb tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:43.631036 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-2da289a5-4435-4af4-b33a-a45a66925dc2 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:11:43.631706 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-2da289a5-4435-4af4-b33a-a45a66925dc2 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:11:43.632532 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-2da289a5-4435-4af4-b33a-a45a66925dc2 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:11:43.633249 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-2da289a5-4435-4af4-b33a-a45a66925dc2 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:11:43.634319 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-2da289a5-4435-4af4-b33a-a45a66925dc2 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:11:43.738322 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2da289a5-4435-4af4-b33a-a45a66925dc2 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:43.739726 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2da289a5-4435-4af4-b33a-a45a66925dc2 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:43.740859 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2da289a5-4435-4af4-b33a-a45a66925dc2 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:43.746433 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2da289a5-4435-4af4-b33a-a45a66925dc2 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:43.748055 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2da289a5-4435-4af4-b33a-a45a66925dc2 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:43.753040 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2da289a5-4435-4af4-b33a-a45a66925dc2 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:43.800580 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-2da289a5-4435-4af4-b33a-a45a66925dc2 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Getting quotas for project 0e180149a99546f6ba25e638e4b4218b. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:11:43.809575 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-2da289a5-4435-4af4-b33a-a45a66925dc2 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Getting quotas for user 1c4753a903d44ed89955218d54375bc9 and project 0e180149a99546f6ba25e638e4b4218b. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:11:43.832900 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2da289a5-4435-4af4-b33a-a45a66925dc2 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:11:43.836038 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2da289a5-4435-4af4-b33a-a45a66925dc2 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: b60b7363-fd13-4b81-9c4b-0aabf39c5a6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:11:43.912913 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2da289a5-4435-4af4-b33a-a45a66925dc2 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.073290 Aug 31 16:11:43.913933 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1940/4090] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:11:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2075 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:11:43.926061 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-61bf28f4-cd9c-4a8c-9d00-7336bab045b7 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:43.926688 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-61bf28f4-cd9c-4a8c-9d00-7336bab045b7 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] [instance: f6e41791-366b-4790-8338-2a52f4ebed89] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:43.935622 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61bf28f4-cd9c-4a8c-9d00-7336bab045b7 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:43.936814 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61bf28f4-cd9c-4a8c-9d00-7336bab045b7 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:43.937539 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61bf28f4-cd9c-4a8c-9d00-7336bab045b7 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:43.938513 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61bf28f4-cd9c-4a8c-9d00-7336bab045b7 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:43.939135 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61bf28f4-cd9c-4a8c-9d00-7336bab045b7 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:43.939719 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61bf28f4-cd9c-4a8c-9d00-7336bab045b7 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:44.297145 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9f394abb-e08e-48f7-a09a-e5a3328462eb tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391c4c8e6ae4483e82a247957a6faad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1f95b9a87a4f1389c03f6a3f592a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:44.335032 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9f394abb-e08e-48f7-a09a-e5a3328462eb tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] 10.222.0.50 "GET /compute/v2.1/servers/2af572bd-8a8b-4db7-9196-7203de031375" status: 200 len: 1322 microversion: 2.1 time: 1.501825 Aug 31 16:11:44.339827 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2151/4091] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:42 2022] GET /compute/v2.1/servers/2af572bd-8a8b-4db7-9196-7203de031375 => generated 1322 bytes in 1510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:44.353290 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a18714e3-756d-41be-8071-da93995c23a5 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:44.355206 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a18714e3-756d-41be-8071-da93995c23a5 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 5923807d-1058-45ab-b8d1-c6700ea8c142] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:44.366844 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a18714e3-756d-41be-8071-da93995c23a5 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:44.368053 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a18714e3-756d-41be-8071-da93995c23a5 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:44.369035 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a18714e3-756d-41be-8071-da93995c23a5 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:44.370255 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a18714e3-756d-41be-8071-da93995c23a5 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:44.370878 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a18714e3-756d-41be-8071-da93995c23a5 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:44.371484 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a18714e3-756d-41be-8071-da93995c23a5 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:44.446743 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-61bf28f4-cd9c-4a8c-9d00-7336bab045b7 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '61d9d91371ea4bc9b2893beaca99473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f549385563d444e1a36de6f85caeb877', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:44.447749 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-61bf28f4-cd9c-4a8c-9d00-7336bab045b7 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] [instance: f6e41791-366b-4790-8338-2a52f4ebed89] flavor_id is None. Assuming migration. {{(pid=128863) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 31 16:11:44.448149 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-61bf28f4-cd9c-4a8c-9d00-7336bab045b7 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] [instance: f6e41791-366b-4790-8338-2a52f4ebed89] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128863) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 31 16:11:44.456198 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:11:44.901817 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-61bf28f4-cd9c-4a8c-9d00-7336bab045b7 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89/action" status: 202 len: 0 microversion: 2.1 time: 0.979753 Aug 31 16:11:44.902918 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1941/4092] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:11:43 2022] POST /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89/action => generated 0 bytes in 982 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:11:44.922704 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dc1d5ffc-6af5-401a-94e9-4d5dbae6091e tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:44.924949 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dc1d5ffc-6af5-401a-94e9-4d5dbae6091e tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:44.945065 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc1d5ffc-6af5-401a-94e9-4d5dbae6091e tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:44.951052 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc1d5ffc-6af5-401a-94e9-4d5dbae6091e tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:44.952865 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc1d5ffc-6af5-401a-94e9-4d5dbae6091e tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:44.959455 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc1d5ffc-6af5-401a-94e9-4d5dbae6091e tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:44.960057 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc1d5ffc-6af5-401a-94e9-4d5dbae6091e tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:44.967257 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc1d5ffc-6af5-401a-94e9-4d5dbae6091e tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:45.160440 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a18714e3-756d-41be-8071-da93995c23a5 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:45.172661 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a18714e3-756d-41be-8071-da93995c23a5 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142" status: 200 len: 1464 microversion: 2.1 time: 0.830631 Aug 31 16:11:45.190798 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2152/4093] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:44 2022] GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142 => generated 1464 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:45.207757 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a3fb65c5-4258-4462-9025-e058f525cda4 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:45.214015 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a3fb65c5-4258-4462-9025-e058f525cda4 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] [instance: da3e4266-a9bc-4433-a335-580713bac164] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:45.228193 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a3fb65c5-4258-4462-9025-e058f525cda4 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:45.229141 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a3fb65c5-4258-4462-9025-e058f525cda4 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:45.230220 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a3fb65c5-4258-4462-9025-e058f525cda4 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:45.232311 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a3fb65c5-4258-4462-9025-e058f525cda4 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:45.233339 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a3fb65c5-4258-4462-9025-e058f525cda4 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:45.234133 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a3fb65c5-4258-4462-9025-e058f525cda4 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:45.289161 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dc1d5ffc-6af5-401a-94e9-4d5dbae6091e tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:45.298466 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dc1d5ffc-6af5-401a-94e9-4d5dbae6091e tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f" status: 200 len: 1280 microversion: 2.1 time: 0.394261 Aug 31 16:11:45.299066 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1942/4094] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:44 2022] GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f => generated 1280 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:45.326535 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-464c8efd-5e79-4fa1-9d3a-2fdb22194010 req-6e16d8d1-e882-433c-95f9-a31e9e205553 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adb50b8a-afc7-4d23-a44c-7d4d75c33ad3", "name": "network-vif-plugged", "status": "completed", "tag": "35074f3b-1243-4414-be68-4f5321bd13d7"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:45.347629 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-464c8efd-5e79-4fa1-9d3a-2fdb22194010 req-6e16d8d1-e882-433c-95f9-a31e9e205553 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:45.348366 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-464c8efd-5e79-4fa1-9d3a-2fdb22194010 req-6e16d8d1-e882-433c-95f9-a31e9e205553 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:45.348950 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-464c8efd-5e79-4fa1-9d3a-2fdb22194010 req-6e16d8d1-e882-433c-95f9-a31e9e205553 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:45.388034 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-464c8efd-5e79-4fa1-9d3a-2fdb22194010 req-6e16d8d1-e882-433c-95f9-a31e9e205553 service nova] Creating event network-vif-plugged:35074f3b-1243-4414-be68-4f5321bd13d7 for instance adb50b8a-afc7-4d23-a44c-7d4d75c33ad3 on n-h2-833090-16 Aug 31 16:11:45.400244 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-464c8efd-5e79-4fa1-9d3a-2fdb22194010 req-6e16d8d1-e882-433c-95f9-a31e9e205553 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092364 Aug 31 16:11:45.401457 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1943/4095] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:11:45.408639 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a2acbb2e-7d0c-43e1-b3ab-6b217a155f5b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:45.423762 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a2acbb2e-7d0c-43e1-b3ab-6b217a155f5b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: adb50b8a-afc7-4d23-a44c-7d4d75c33ad3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:45.435974 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a2acbb2e-7d0c-43e1-b3ab-6b217a155f5b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:45.447069 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a2acbb2e-7d0c-43e1-b3ab-6b217a155f5b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:45.447534 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a2acbb2e-7d0c-43e1-b3ab-6b217a155f5b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:45.448286 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a2acbb2e-7d0c-43e1-b3ab-6b217a155f5b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:45.448756 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a2acbb2e-7d0c-43e1-b3ab-6b217a155f5b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:45.449200 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a2acbb2e-7d0c-43e1-b3ab-6b217a155f5b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:46.250655 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a3fb65c5-4258-4462-9025-e058f525cda4 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19802f8112a04f1d94a35a1956188452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9eaf2ea58471390358e3d3c4a9689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:46.281062 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a3fb65c5-4258-4462-9025-e058f525cda4 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] 10.222.0.50 "GET /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164" status: 200 len: 1523 microversion: 2.1 time: 1.088380 Aug 31 16:11:46.298391 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2153/4096] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:45 2022] GET /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164 => generated 1523 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:46.303661 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-22c9324d-496b-4e0a-8db8-a965ef18511d tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:46.304272 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-22c9324d-496b-4e0a-8db8-a965ef18511d tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: b60b7363-fd13-4b81-9c4b-0aabf39c5a6a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:46.338898 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-22c9324d-496b-4e0a-8db8-a965ef18511d tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:46.339411 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-22c9324d-496b-4e0a-8db8-a965ef18511d tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:46.339911 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-22c9324d-496b-4e0a-8db8-a965ef18511d tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:46.344527 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-22c9324d-496b-4e0a-8db8-a965ef18511d tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:46.347310 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-22c9324d-496b-4e0a-8db8-a965ef18511d tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:46.348036 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-22c9324d-496b-4e0a-8db8-a965ef18511d tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:46.397080 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a2acbb2e-7d0c-43e1-b3ab-6b217a155f5b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:46.445953 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a2acbb2e-7d0c-43e1-b3ab-6b217a155f5b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/adb50b8a-afc7-4d23-a44c-7d4d75c33ad3" status: 200 len: 1328 microversion: 2.1 time: 1.042873 Aug 31 16:11:46.448681 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1944/4097] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:45 2022] GET /compute/v2.1/servers/adb50b8a-afc7-4d23-a44c-7d4d75c33ad3 => generated 1328 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:46.462640 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8b149916-8afb-469b-953d-8a867dea6ad3 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:46.464523 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8b149916-8afb-469b-953d-8a867dea6ad3 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: f6e41791-366b-4790-8338-2a52f4ebed89] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:46.529994 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b149916-8afb-469b-953d-8a867dea6ad3 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:46.533297 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b149916-8afb-469b-953d-8a867dea6ad3 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:46.539236 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b149916-8afb-469b-953d-8a867dea6ad3 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:46.546130 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b149916-8afb-469b-953d-8a867dea6ad3 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:46.547308 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b149916-8afb-469b-953d-8a867dea6ad3 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:46.552345 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b149916-8afb-469b-953d-8a867dea6ad3 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:46.639810 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-22c9324d-496b-4e0a-8db8-a965ef18511d tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:46.651139 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-22c9324d-496b-4e0a-8db8-a965ef18511d tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a" status: 200 len: 1270 microversion: 2.1 time: 0.351460 Aug 31 16:11:46.656197 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2154/4098] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:46 2022] GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a => generated 1270 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:46.673596 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4f3bc95c-7b71-43ec-9d6b-6231e130e27f tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:46.674899 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4f3bc95c-7b71-43ec-9d6b-6231e130e27f tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 5923807d-1058-45ab-b8d1-c6700ea8c142] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:46.696685 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4f3bc95c-7b71-43ec-9d6b-6231e130e27f tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:46.697434 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4f3bc95c-7b71-43ec-9d6b-6231e130e27f tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:46.698613 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4f3bc95c-7b71-43ec-9d6b-6231e130e27f tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:46.703081 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4f3bc95c-7b71-43ec-9d6b-6231e130e27f tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:46.704005 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4f3bc95c-7b71-43ec-9d6b-6231e130e27f tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:46.704624 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4f3bc95c-7b71-43ec-9d6b-6231e130e27f tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:47.388748 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8b149916-8afb-469b-953d-8a867dea6ad3 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:47.428053 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8b149916-8afb-469b-953d-8a867dea6ad3 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89" status: 200 len: 1692 microversion: 2.1 time: 0.977533 Aug 31 16:11:47.429100 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4f3bc95c-7b71-43ec-9d6b-6231e130e27f tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:47.431210 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1945/4099] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:46 2022] GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89 => generated 1692 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:47.441777 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1fd2450f-13e4-49ee-83fb-3b17b20d856d tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:47.448340 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4f3bc95c-7b71-43ec-9d6b-6231e130e27f tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142" status: 200 len: 1464 microversion: 2.1 time: 0.783939 Aug 31 16:11:47.449671 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2155/4100] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:46 2022] GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142 => generated 1464 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:47.452157 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1fd2450f-13e4-49ee-83fb-3b17b20d856d tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] [instance: 2af572bd-8a8b-4db7-9196-7203de031375] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:47.467668 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-f1351907-1e59-4ac7-b823-6cc8e8d59d89 req-4deeaab3-b6e8-4aa7-bed6-f406ac3e17e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5116a4af-d819-456a-b188-7dcf94b7b35c", "name": "network-vif-deleted", "tag": "367272f4-dbf2-4acc-ba34-c1c2c1d4bee7"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:47.479870 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1fd2450f-13e4-49ee-83fb-3b17b20d856d tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:47.493514 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1fd2450f-13e4-49ee-83fb-3b17b20d856d tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:47.494490 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1fd2450f-13e4-49ee-83fb-3b17b20d856d tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:47.495665 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1fd2450f-13e4-49ee-83fb-3b17b20d856d tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:47.496787 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-f1351907-1e59-4ac7-b823-6cc8e8d59d89 req-4deeaab3-b6e8-4aa7-bed6-f406ac3e17e7 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:47.497370 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-f1351907-1e59-4ac7-b823-6cc8e8d59d89 req-4deeaab3-b6e8-4aa7-bed6-f406ac3e17e7 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:47.497805 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-f1351907-1e59-4ac7-b823-6cc8e8d59d89 req-4deeaab3-b6e8-4aa7-bed6-f406ac3e17e7 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:47.498739 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1fd2450f-13e4-49ee-83fb-3b17b20d856d tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:47.500565 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1fd2450f-13e4-49ee-83fb-3b17b20d856d tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:47.539683 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-f1351907-1e59-4ac7-b823-6cc8e8d59d89 req-4deeaab3-b6e8-4aa7-bed6-f406ac3e17e7 service nova] Creating event network-vif-deleted:367272f4-dbf2-4acc-ba34-c1c2c1d4bee7 for instance 5116a4af-d819-456a-b188-7dcf94b7b35c on n-h1-833090-16 Aug 31 16:11:47.557978 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-f1351907-1e59-4ac7-b823-6cc8e8d59d89 req-4deeaab3-b6e8-4aa7-bed6-f406ac3e17e7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106498 Aug 31 16:11:47.559022 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2156/4101] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:11:47.567613 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3a8ee8de-4ad6-49a3-8a64-6bcbe25a8075 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:47.568315 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3a8ee8de-4ad6-49a3-8a64-6bcbe25a8075 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:47.592519 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3a8ee8de-4ad6-49a3-8a64-6bcbe25a8075 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:47.593015 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3a8ee8de-4ad6-49a3-8a64-6bcbe25a8075 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:47.593456 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3a8ee8de-4ad6-49a3-8a64-6bcbe25a8075 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:47.597762 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3a8ee8de-4ad6-49a3-8a64-6bcbe25a8075 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:47.598458 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3a8ee8de-4ad6-49a3-8a64-6bcbe25a8075 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:47.598687 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3a8ee8de-4ad6-49a3-8a64-6bcbe25a8075 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:47.866081 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:11:47.930195 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=6 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:11:48.186145 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1fd2450f-13e4-49ee-83fb-3b17b20d856d tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391c4c8e6ae4483e82a247957a6faad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1f95b9a87a4f1389c03f6a3f592a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:48.212541 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1fd2450f-13e4-49ee-83fb-3b17b20d856d tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] 10.222.0.50 "GET /compute/v2.1/servers/2af572bd-8a8b-4db7-9196-7203de031375" status: 200 len: 1322 microversion: 2.1 time: 0.778093 Aug 31 16:11:48.215246 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1946/4102] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:47 2022] GET /compute/v2.1/servers/2af572bd-8a8b-4db7-9196-7203de031375 => generated 1322 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:48.227065 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8adec98e-488c-46c0-ba74-dcafefa6b1a6 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:48.227879 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8adec98e-488c-46c0-ba74-dcafefa6b1a6 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] [instance: da3e4266-a9bc-4433-a335-580713bac164] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:48.241493 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8adec98e-488c-46c0-ba74-dcafefa6b1a6 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:48.248693 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8adec98e-488c-46c0-ba74-dcafefa6b1a6 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:48.249560 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8adec98e-488c-46c0-ba74-dcafefa6b1a6 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:48.250570 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8adec98e-488c-46c0-ba74-dcafefa6b1a6 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:48.251208 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8adec98e-488c-46c0-ba74-dcafefa6b1a6 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:48.251784 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8adec98e-488c-46c0-ba74-dcafefa6b1a6 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:48.323704 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3a8ee8de-4ad6-49a3-8a64-6bcbe25a8075 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:48.333508 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3a8ee8de-4ad6-49a3-8a64-6bcbe25a8075 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f" status: 200 len: 1322 microversion: 2.1 time: 0.773045 Aug 31 16:11:48.335352 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2157/4103] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:47 2022] GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f => generated 1322 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:48.342075 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7d0c2eb5-1e4f-45b6-a0af-ff187bf7e876 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:48.344216 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7d0c2eb5-1e4f-45b6-a0af-ff187bf7e876 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: adb50b8a-afc7-4d23-a44c-7d4d75c33ad3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:48.362437 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7d0c2eb5-1e4f-45b6-a0af-ff187bf7e876 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:48.363432 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7d0c2eb5-1e4f-45b6-a0af-ff187bf7e876 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:48.364110 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7d0c2eb5-1e4f-45b6-a0af-ff187bf7e876 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:48.365753 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7d0c2eb5-1e4f-45b6-a0af-ff187bf7e876 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:48.366581 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7d0c2eb5-1e4f-45b6-a0af-ff187bf7e876 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:48.368145 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7d0c2eb5-1e4f-45b6-a0af-ff187bf7e876 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:48.934335 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8adec98e-488c-46c0-ba74-dcafefa6b1a6 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19802f8112a04f1d94a35a1956188452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9eaf2ea58471390358e3d3c4a9689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:48.952451 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8adec98e-488c-46c0-ba74-dcafefa6b1a6 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] 10.222.0.50 "GET /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164" status: 200 len: 1523 microversion: 2.1 time: 0.735482 Aug 31 16:11:48.963180 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1947/4104] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:48 2022] GET /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164 => generated 1523 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:48.978473 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-72f105a9-b0aa-4a67-a300-351b54d7b139 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:48.978473 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-72f105a9-b0aa-4a67-a300-351b54d7b139 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 5923807d-1058-45ab-b8d1-c6700ea8c142] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:48.987996 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72f105a9-b0aa-4a67-a300-351b54d7b139 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:48.989206 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72f105a9-b0aa-4a67-a300-351b54d7b139 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:48.989856 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72f105a9-b0aa-4a67-a300-351b54d7b139 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:48.992639 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72f105a9-b0aa-4a67-a300-351b54d7b139 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:48.993837 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72f105a9-b0aa-4a67-a300-351b54d7b139 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:48.994454 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72f105a9-b0aa-4a67-a300-351b54d7b139 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:49.057290 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7d0c2eb5-1e4f-45b6-a0af-ff187bf7e876 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:49.066164 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7d0c2eb5-1e4f-45b6-a0af-ff187bf7e876 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/adb50b8a-afc7-4d23-a44c-7d4d75c33ad3" status: 200 len: 1328 microversion: 2.1 time: 0.729301 Aug 31 16:11:49.103384 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2158/4105] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:48 2022] GET /compute/v2.1/servers/adb50b8a-afc7-4d23-a44c-7d4d75c33ad3 => generated 1328 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:49.109225 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-bf1c8776-e456-4dbd-a0f8-24c3293025fe tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:49.123700 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-bf1c8776-e456-4dbd-a0f8-24c3293025fe tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: b60b7363-fd13-4b81-9c4b-0aabf39c5a6a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:49.129191 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-72f105a9-b0aa-4a67-a300-351b54d7b139 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:11:49.130524 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-72f105a9-b0aa-4a67-a300-351b54d7b139 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:11:49.130927 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bf1c8776-e456-4dbd-a0f8-24c3293025fe tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:49.131660 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bf1c8776-e456-4dbd-a0f8-24c3293025fe tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:49.132302 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bf1c8776-e456-4dbd-a0f8-24c3293025fe tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:49.132788 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-72f105a9-b0aa-4a67-a300-351b54d7b139 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:11:49.133735 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bf1c8776-e456-4dbd-a0f8-24c3293025fe tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:49.133928 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-72f105a9-b0aa-4a67-a300-351b54d7b139 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:11:49.136127 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-72f105a9-b0aa-4a67-a300-351b54d7b139 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:11:49.136727 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bf1c8776-e456-4dbd-a0f8-24c3293025fe tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:49.137249 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bf1c8776-e456-4dbd-a0f8-24c3293025fe tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:49.245318 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-72f105a9-b0aa-4a67-a300-351b54d7b139 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 5923807d-1058-45ab-b8d1-c6700ea8c142] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:49.261517 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=15,nova_api:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:11:49.266498 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72f105a9-b0aa-4a67-a300-351b54d7b139 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:49.267141 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72f105a9-b0aa-4a67-a300-351b54d7b139 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:49.267938 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72f105a9-b0aa-4a67-a300-351b54d7b139 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:49.276286 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72f105a9-b0aa-4a67-a300-351b54d7b139 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:49.276960 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72f105a9-b0aa-4a67-a300-351b54d7b139 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:49.278924 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72f105a9-b0aa-4a67-a300-351b54d7b139 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:49.363979 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-72f105a9-b0aa-4a67-a300-351b54d7b139 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "POST /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142/action" status: 202 len: 1068 microversion: 2.1 time: 0.399540 Aug 31 16:11:49.365286 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1948/4106] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:11:48 2022] POST /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142/action => generated 1068 bytes in 401 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 31 16:11:49.370793 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-37d6e187-74a7-4d4d-9ab7-7c37e8c23818 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:49.371410 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-37d6e187-74a7-4d4d-9ab7-7c37e8c23818 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: f6e41791-366b-4790-8338-2a52f4ebed89] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:49.388274 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-bf1c8776-e456-4dbd-a0f8-24c3293025fe tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:49.397937 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-bf1c8776-e456-4dbd-a0f8-24c3293025fe tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a" status: 200 len: 1276 microversion: 2.1 time: 0.293005 Aug 31 16:11:49.406784 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37d6e187-74a7-4d4d-9ab7-7c37e8c23818 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:49.407345 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37d6e187-74a7-4d4d-9ab7-7c37e8c23818 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:49.407801 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37d6e187-74a7-4d4d-9ab7-7c37e8c23818 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:49.408552 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37d6e187-74a7-4d4d-9ab7-7c37e8c23818 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:49.409062 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37d6e187-74a7-4d4d-9ab7-7c37e8c23818 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:49.409437 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37d6e187-74a7-4d4d-9ab7-7c37e8c23818 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:49.422560 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2159/4107] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:49 2022] GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a => generated 1276 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:49.435017 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9368c42d-8c16-4474-95f0-709ceec0a52b tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:49.436058 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9368c42d-8c16-4474-95f0-709ceec0a52b tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] [instance: 2af572bd-8a8b-4db7-9196-7203de031375] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:49.449322 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9368c42d-8c16-4474-95f0-709ceec0a52b tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:49.450504 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9368c42d-8c16-4474-95f0-709ceec0a52b tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:49.452081 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9368c42d-8c16-4474-95f0-709ceec0a52b tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:49.453376 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9368c42d-8c16-4474-95f0-709ceec0a52b tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:49.454051 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9368c42d-8c16-4474-95f0-709ceec0a52b tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:49.454700 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9368c42d-8c16-4474-95f0-709ceec0a52b tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:51.016151 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9368c42d-8c16-4474-95f0-709ceec0a52b tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391c4c8e6ae4483e82a247957a6faad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1f95b9a87a4f1389c03f6a3f592a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:51.034418 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9368c42d-8c16-4474-95f0-709ceec0a52b tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] 10.222.0.50 "GET /compute/v2.1/servers/2af572bd-8a8b-4db7-9196-7203de031375" status: 200 len: 1322 microversion: 2.1 time: 1.610210 Aug 31 16:11:51.048759 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2160/4108] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:49 2022] GET /compute/v2.1/servers/2af572bd-8a8b-4db7-9196-7203de031375 => generated 1322 bytes in 1625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:51.054268 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a5ef951a-d9cb-4384-81d7-13273d1ee671 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:51.055235 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a5ef951a-d9cb-4384-81d7-13273d1ee671 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:51.065748 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5ef951a-d9cb-4384-81d7-13273d1ee671 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:51.072859 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5ef951a-d9cb-4384-81d7-13273d1ee671 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:51.073570 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5ef951a-d9cb-4384-81d7-13273d1ee671 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:51.074620 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5ef951a-d9cb-4384-81d7-13273d1ee671 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:51.080132 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-37d6e187-74a7-4d4d-9ab7-7c37e8c23818 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:51.088440 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5ef951a-d9cb-4384-81d7-13273d1ee671 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:51.089109 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5ef951a-d9cb-4384-81d7-13273d1ee671 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:51.097153 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-37d6e187-74a7-4d4d-9ab7-7c37e8c23818 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89" status: 200 len: 1692 microversion: 2.1 time: 1.728894 Aug 31 16:11:51.099342 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1949/4109] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:49 2022] GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89 => generated 1692 bytes in 1733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:51.114715 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d0778654-07a9-4883-8a94-4b91eaf0089b tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:51.116155 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d0778654-07a9-4883-8a94-4b91eaf0089b tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 5923807d-1058-45ab-b8d1-c6700ea8c142] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:51.146746 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0778654-07a9-4883-8a94-4b91eaf0089b tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:51.150961 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0778654-07a9-4883-8a94-4b91eaf0089b tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:51.152473 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0778654-07a9-4883-8a94-4b91eaf0089b tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:51.154052 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0778654-07a9-4883-8a94-4b91eaf0089b tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:51.154724 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0778654-07a9-4883-8a94-4b91eaf0089b tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:51.155428 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0778654-07a9-4883-8a94-4b91eaf0089b tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:51.795077 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d0778654-07a9-4883-8a94-4b91eaf0089b tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:51.808441 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d0778654-07a9-4883-8a94-4b91eaf0089b tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142" status: 200 len: 1473 microversion: 2.1 time: 0.703324 Aug 31 16:11:51.810654 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1950/4110] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:51 2022] GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142 => generated 1473 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:51.834170 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-9c2e8989-4d36-4b0f-972e-58145ea7e367 req-52dbaab1-2e3f-41cb-b4f8-48fd38db8741 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2af572bd-8a8b-4db7-9196-7203de031375", "tag": "130df408-bb0d-484e-9def-4bf6e6d5c614"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:51.838180 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a5ef951a-d9cb-4384-81d7-13273d1ee671 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:51.846244 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9c2e8989-4d36-4b0f-972e-58145ea7e367 req-52dbaab1-2e3f-41cb-b4f8-48fd38db8741 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:51.846988 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9c2e8989-4d36-4b0f-972e-58145ea7e367 req-52dbaab1-2e3f-41cb-b4f8-48fd38db8741 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:51.847550 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9c2e8989-4d36-4b0f-972e-58145ea7e367 req-52dbaab1-2e3f-41cb-b4f8-48fd38db8741 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:51.856408 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a5ef951a-d9cb-4384-81d7-13273d1ee671 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f" status: 200 len: 1322 microversion: 2.1 time: 0.805732 Aug 31 16:11:51.857606 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2161/4111] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:51 2022] GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f => generated 1322 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:51.866187 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-9c2e8989-4d36-4b0f-972e-58145ea7e367 req-52dbaab1-2e3f-41cb-b4f8-48fd38db8741 service nova] Creating event network-changed:130df408-bb0d-484e-9def-4bf6e6d5c614 for instance 2af572bd-8a8b-4db7-9196-7203de031375 on n-h1-833090-16 Aug 31 16:11:51.866347 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-32094214-7000-4eeb-b3f3-46a1a7fede03 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:51.872599 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-32094214-7000-4eeb-b3f3-46a1a7fede03 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] [instance: da3e4266-a9bc-4433-a335-580713bac164] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:51.873378 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-9c2e8989-4d36-4b0f-972e-58145ea7e367 req-52dbaab1-2e3f-41cb-b4f8-48fd38db8741 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047722 Aug 31 16:11:51.874583 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1951/4112] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:11:51.880844 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-64fe1077-55e6-43b6-8c70-d63fec2b99d6 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:51.881835 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-64fe1077-55e6-43b6-8c70-d63fec2b99d6 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: adb50b8a-afc7-4d23-a44c-7d4d75c33ad3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:51.887201 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-32094214-7000-4eeb-b3f3-46a1a7fede03 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:51.889418 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-32094214-7000-4eeb-b3f3-46a1a7fede03 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:51.889983 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-32094214-7000-4eeb-b3f3-46a1a7fede03 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:51.890859 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-32094214-7000-4eeb-b3f3-46a1a7fede03 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:51.893216 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-32094214-7000-4eeb-b3f3-46a1a7fede03 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:51.894702 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-32094214-7000-4eeb-b3f3-46a1a7fede03 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:51.895686 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64fe1077-55e6-43b6-8c70-d63fec2b99d6 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:51.896446 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64fe1077-55e6-43b6-8c70-d63fec2b99d6 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:51.897124 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64fe1077-55e6-43b6-8c70-d63fec2b99d6 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:51.898296 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64fe1077-55e6-43b6-8c70-d63fec2b99d6 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:51.899016 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64fe1077-55e6-43b6-8c70-d63fec2b99d6 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:51.899589 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64fe1077-55e6-43b6-8c70-d63fec2b99d6 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:52.434234 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-64fe1077-55e6-43b6-8c70-d63fec2b99d6 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:52.446254 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-32094214-7000-4eeb-b3f3-46a1a7fede03 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19802f8112a04f1d94a35a1956188452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9eaf2ea58471390358e3d3c4a9689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:52.447959 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-64fe1077-55e6-43b6-8c70-d63fec2b99d6 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/adb50b8a-afc7-4d23-a44c-7d4d75c33ad3" status: 200 len: 1510 microversion: 2.1 time: 0.571844 Aug 31 16:11:52.448557 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1952/4113] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:51 2022] GET /compute/v2.1/servers/adb50b8a-afc7-4d23-a44c-7d4d75c33ad3 => generated 1510 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:52.456284 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-a71d3949-6c53-40a9-9a14-69d8e4d99515 req-6f536781-cb2d-4a80-8fe4-511e247d9a02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f", "tag": "d706c52d-7294-4df5-8605-e5eb47c15dca"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:52.460199 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-32094214-7000-4eeb-b3f3-46a1a7fede03 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] 10.222.0.50 "GET /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164" status: 200 len: 1523 microversion: 2.1 time: 0.600709 Aug 31 16:11:52.461015 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2162/4114] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:51 2022] GET /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164 => generated 1523 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:52.470748 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e4606f40-eea6-49f8-9e7e-408ed7654801 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:52.474221 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e4606f40-eea6-49f8-9e7e-408ed7654801 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: b60b7363-fd13-4b81-9c4b-0aabf39c5a6a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:52.476961 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a71d3949-6c53-40a9-9a14-69d8e4d99515 req-6f536781-cb2d-4a80-8fe4-511e247d9a02 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:52.477444 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a71d3949-6c53-40a9-9a14-69d8e4d99515 req-6f536781-cb2d-4a80-8fe4-511e247d9a02 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:52.477866 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a71d3949-6c53-40a9-9a14-69d8e4d99515 req-6f536781-cb2d-4a80-8fe4-511e247d9a02 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:52.493712 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4606f40-eea6-49f8-9e7e-408ed7654801 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:52.494756 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4606f40-eea6-49f8-9e7e-408ed7654801 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:52.495367 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4606f40-eea6-49f8-9e7e-408ed7654801 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:52.496259 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4606f40-eea6-49f8-9e7e-408ed7654801 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:52.496856 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4606f40-eea6-49f8-9e7e-408ed7654801 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:52.497753 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4606f40-eea6-49f8-9e7e-408ed7654801 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:52.507772 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-a71d3949-6c53-40a9-9a14-69d8e4d99515 req-6f536781-cb2d-4a80-8fe4-511e247d9a02 service nova] Creating event network-changed:d706c52d-7294-4df5-8605-e5eb47c15dca for instance 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f on n-h2-833090-16 Aug 31 16:11:52.515844 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-a71d3949-6c53-40a9-9a14-69d8e4d99515 req-6f536781-cb2d-4a80-8fe4-511e247d9a02 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066083 Aug 31 16:11:52.517137 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1953/4115] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:11:52.522481 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-035b74ce-c965-42d6-88cf-48c1eb1b13a1 req-a364c04d-4202-429f-ac50-361a9328db00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14167776-553f-4203-887b-3cb8e4cc0a2a", "name": "network-vif-plugged", "status": "completed", "tag": "0173af77-c960-4ebc-83db-2830c6fe35dd"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:52.539609 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-035b74ce-c965-42d6-88cf-48c1eb1b13a1 req-a364c04d-4202-429f-ac50-361a9328db00 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:52.540563 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-035b74ce-c965-42d6-88cf-48c1eb1b13a1 req-a364c04d-4202-429f-ac50-361a9328db00 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:52.541142 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-035b74ce-c965-42d6-88cf-48c1eb1b13a1 req-a364c04d-4202-429f-ac50-361a9328db00 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:52.568787 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-035b74ce-c965-42d6-88cf-48c1eb1b13a1 req-a364c04d-4202-429f-ac50-361a9328db00 service nova] Creating event network-vif-plugged:0173af77-c960-4ebc-83db-2830c6fe35dd for instance 14167776-553f-4203-887b-3cb8e4cc0a2a on n-h2-833090-16 Aug 31 16:11:52.574284 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-035b74ce-c965-42d6-88cf-48c1eb1b13a1 req-a364c04d-4202-429f-ac50-361a9328db00 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055560 Aug 31 16:11:52.575331 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1954/4116] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:11:52.581407 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0a362269-4972-42ce-8d72-b5db95df903d tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:52.582391 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0a362269-4972-42ce-8d72-b5db95df903d tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] [instance: 2af572bd-8a8b-4db7-9196-7203de031375] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:52.598187 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a362269-4972-42ce-8d72-b5db95df903d tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:52.598651 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a362269-4972-42ce-8d72-b5db95df903d tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:52.599081 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a362269-4972-42ce-8d72-b5db95df903d tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:52.599778 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a362269-4972-42ce-8d72-b5db95df903d tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:52.600222 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a362269-4972-42ce-8d72-b5db95df903d tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:52.600647 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a362269-4972-42ce-8d72-b5db95df903d tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:53.190122 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0a362269-4972-42ce-8d72-b5db95df903d tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391c4c8e6ae4483e82a247957a6faad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1f95b9a87a4f1389c03f6a3f592a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:53.225164 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e4606f40-eea6-49f8-9e7e-408ed7654801 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:53.234339 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e4606f40-eea6-49f8-9e7e-408ed7654801 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a" status: 200 len: 1318 microversion: 2.1 time: 0.767899 Aug 31 16:11:53.248719 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0a362269-4972-42ce-8d72-b5db95df903d tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] 10.222.0.50 "GET /compute/v2.1/servers/2af572bd-8a8b-4db7-9196-7203de031375" status: 200 len: 1322 microversion: 2.1 time: 0.667434 Aug 31 16:11:53.249703 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2163/4117] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:52 2022] GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a => generated 1318 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:53.249844 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1955/4118] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:52 2022] GET /compute/v2.1/servers/2af572bd-8a8b-4db7-9196-7203de031375 => generated 1322 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:53.255739 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-43551d66-663b-49b6-a9cf-87e9c1d402fb tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:53.257379 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-43551d66-663b-49b6-a9cf-87e9c1d402fb tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: f6e41791-366b-4790-8338-2a52f4ebed89] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:53.267427 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-43551d66-663b-49b6-a9cf-87e9c1d402fb tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:53.267591 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-667ca399-d220-4f46-b3fa-be209d9ca3d7 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:53.268382 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-43551d66-663b-49b6-a9cf-87e9c1d402fb tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:53.268985 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-43551d66-663b-49b6-a9cf-87e9c1d402fb tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:53.270172 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-667ca399-d220-4f46-b3fa-be209d9ca3d7 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: adb50b8a-afc7-4d23-a44c-7d4d75c33ad3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:53.270736 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-43551d66-663b-49b6-a9cf-87e9c1d402fb tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:53.271436 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-43551d66-663b-49b6-a9cf-87e9c1d402fb tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:53.272111 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-43551d66-663b-49b6-a9cf-87e9c1d402fb tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:53.287696 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-667ca399-d220-4f46-b3fa-be209d9ca3d7 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:53.288191 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-667ca399-d220-4f46-b3fa-be209d9ca3d7 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:53.288615 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-667ca399-d220-4f46-b3fa-be209d9ca3d7 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:53.289316 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-667ca399-d220-4f46-b3fa-be209d9ca3d7 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:53.296044 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-667ca399-d220-4f46-b3fa-be209d9ca3d7 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:53.296807 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-667ca399-d220-4f46-b3fa-be209d9ca3d7 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:53.611624 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-43551d66-663b-49b6-a9cf-87e9c1d402fb tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:53.622149 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-43551d66-663b-49b6-a9cf-87e9c1d402fb tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89" status: 200 len: 1697 microversion: 2.1 time: 0.370531 Aug 31 16:11:53.630793 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2164/4119] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:53 2022] GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89 => generated 1697 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:53.633979 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7e62ce7f-f235-437d-be89-2237a4a3aaf7 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:53.634750 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7e62ce7f-f235-437d-be89-2237a4a3aaf7 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 5923807d-1058-45ab-b8d1-c6700ea8c142] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:53.643587 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7e62ce7f-f235-437d-be89-2237a4a3aaf7 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:53.644160 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7e62ce7f-f235-437d-be89-2237a4a3aaf7 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:53.644592 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7e62ce7f-f235-437d-be89-2237a4a3aaf7 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:53.645286 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7e62ce7f-f235-437d-be89-2237a4a3aaf7 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:53.645732 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7e62ce7f-f235-437d-be89-2237a4a3aaf7 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:53.646241 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7e62ce7f-f235-437d-be89-2237a4a3aaf7 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:53.675486 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-667ca399-d220-4f46-b3fa-be209d9ca3d7 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:53.686643 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-667ca399-d220-4f46-b3fa-be209d9ca3d7 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/adb50b8a-afc7-4d23-a44c-7d4d75c33ad3" status: 200 len: 1510 microversion: 2.1 time: 0.435071 Aug 31 16:11:53.687362 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1956/4120] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:53 2022] GET /compute/v2.1/servers/adb50b8a-afc7-4d23-a44c-7d4d75c33ad3 => generated 1510 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:53.695362 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3dcd17b9-d582-4f17-9c48-7c4e47030ef9 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:53.696358 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3dcd17b9-d582-4f17-9c48-7c4e47030ef9 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:53.704269 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3dcd17b9-d582-4f17-9c48-7c4e47030ef9 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:53.704859 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3dcd17b9-d582-4f17-9c48-7c4e47030ef9 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:53.705371 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3dcd17b9-d582-4f17-9c48-7c4e47030ef9 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:53.706158 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3dcd17b9-d582-4f17-9c48-7c4e47030ef9 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:53.706688 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3dcd17b9-d582-4f17-9c48-7c4e47030ef9 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:53.707190 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3dcd17b9-d582-4f17-9c48-7c4e47030ef9 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:53.727609 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:11:53.786798 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=8 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:11:53.824133 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=24 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:11:53.944228 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7e62ce7f-f235-437d-be89-2237a4a3aaf7 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:53.955232 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7e62ce7f-f235-437d-be89-2237a4a3aaf7 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142" status: 200 len: 1473 microversion: 2.1 time: 0.326800 Aug 31 16:11:53.956536 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2165/4121] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:53 2022] GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142 => generated 1473 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:53.962514 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-80193393-0406-4535-97db-35b1a46f13e7 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:53.964202 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-80193393-0406-4535-97db-35b1a46f13e7 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] [instance: da3e4266-a9bc-4433-a335-580713bac164] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:53.972550 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-80193393-0406-4535-97db-35b1a46f13e7 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:53.973224 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-80193393-0406-4535-97db-35b1a46f13e7 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:53.973684 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-80193393-0406-4535-97db-35b1a46f13e7 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:53.974584 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-80193393-0406-4535-97db-35b1a46f13e7 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:53.976584 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-80193393-0406-4535-97db-35b1a46f13e7 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:53.976584 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-80193393-0406-4535-97db-35b1a46f13e7 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:54.089193 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3dcd17b9-d582-4f17-9c48-7c4e47030ef9 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:54.110957 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3dcd17b9-d582-4f17-9c48-7c4e47030ef9 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f" status: 200 len: 1322 microversion: 2.1 time: 0.422266 Aug 31 16:11:54.111671 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1957/4122] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:53 2022] GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f => generated 1322 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:54.133489 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e576bbdf-2573-45ca-af13-90a4704fd027 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:54.134692 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e576bbdf-2573-45ca-af13-90a4704fd027 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: adb50b8a-afc7-4d23-a44c-7d4d75c33ad3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:54.142431 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e576bbdf-2573-45ca-af13-90a4704fd027 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:54.144115 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e576bbdf-2573-45ca-af13-90a4704fd027 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:54.145245 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e576bbdf-2573-45ca-af13-90a4704fd027 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:54.146518 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e576bbdf-2573-45ca-af13-90a4704fd027 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:54.148098 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e576bbdf-2573-45ca-af13-90a4704fd027 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:54.148691 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e576bbdf-2573-45ca-af13-90a4704fd027 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:54.195394 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e576bbdf-2573-45ca-af13-90a4704fd027 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: adb50b8a-afc7-4d23-a44c-7d4d75c33ad3] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:11:54.265903 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-80193393-0406-4535-97db-35b1a46f13e7 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19802f8112a04f1d94a35a1956188452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9eaf2ea58471390358e3d3c4a9689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:54.276786 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-80193393-0406-4535-97db-35b1a46f13e7 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] 10.222.0.50 "GET /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164" status: 200 len: 1523 microversion: 2.1 time: 0.318711 Aug 31 16:11:54.279178 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2166/4123] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:53 2022] GET /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164 => generated 1523 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:54.287565 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-6cd25b36-c815-49c1-9e75-da08cee1c682 req-6c4ade27-7cad-4d58-be84-d41487703da7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4754015c-cda0-4f0a-9096-06bebe3d33b1", "tag": "814755c5-78ef-4411-a17e-1bef500926b3"}, {"name": "network-changed", "server_uuid": "b60b7363-fd13-4b81-9c4b-0aabf39c5a6a", "tag": "498f733b-bbc6-4db1-9c7b-1cc502f31161"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:54.303070 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-6cd25b36-c815-49c1-9e75-da08cee1c682 req-6c4ade27-7cad-4d58-be84-d41487703da7 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:54.303620 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-6cd25b36-c815-49c1-9e75-da08cee1c682 req-6c4ade27-7cad-4d58-be84-d41487703da7 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:54.304271 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-6cd25b36-c815-49c1-9e75-da08cee1c682 req-6c4ade27-7cad-4d58-be84-d41487703da7 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:54.320607 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-6cd25b36-c815-49c1-9e75-da08cee1c682 req-6c4ade27-7cad-4d58-be84-d41487703da7 service nova] Creating event network-changed:814755c5-78ef-4411-a17e-1bef500926b3 for instance 4754015c-cda0-4f0a-9096-06bebe3d33b1 on n-h2-833090-16 Aug 31 16:11:54.321109 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-6cd25b36-c815-49c1-9e75-da08cee1c682 req-6c4ade27-7cad-4d58-be84-d41487703da7 service nova] Creating event network-changed:498f733b-bbc6-4db1-9c7b-1cc502f31161 for instance b60b7363-fd13-4b81-9c4b-0aabf39c5a6a on n-h1-833090-16 Aug 31 16:11:54.332705 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-6cd25b36-c815-49c1-9e75-da08cee1c682 req-6c4ade27-7cad-4d58-be84-d41487703da7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.053297 Aug 31 16:11:54.333925 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2167/4124] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:11:54.335796 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e576bbdf-2573-45ca-af13-90a4704fd027 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "DELETE /compute/v2.1/servers/adb50b8a-afc7-4d23-a44c-7d4d75c33ad3" status: 204 len: 0 microversion: 2.1 time: 0.222499 Aug 31 16:11:54.337059 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1958/4125] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:11:54 2022] DELETE /compute/v2.1/servers/adb50b8a-afc7-4d23-a44c-7d4d75c33ad3 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:11:54.340206 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0aa64a72-3bf9-46ec-9b1c-0310f658e0c6 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:54.341496 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0aa64a72-3bf9-46ec-9b1c-0310f658e0c6 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: b60b7363-fd13-4b81-9c4b-0aabf39c5a6a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:54.349699 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-365bca94-94ab-4ae3-88f2-900124961f4d tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:54.351068 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-365bca94-94ab-4ae3-88f2-900124961f4d tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] [instance: 2af572bd-8a8b-4db7-9196-7203de031375] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:54.351558 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0aa64a72-3bf9-46ec-9b1c-0310f658e0c6 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:54.352242 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0aa64a72-3bf9-46ec-9b1c-0310f658e0c6 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:54.352864 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0aa64a72-3bf9-46ec-9b1c-0310f658e0c6 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:54.353908 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0aa64a72-3bf9-46ec-9b1c-0310f658e0c6 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:54.354572 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0aa64a72-3bf9-46ec-9b1c-0310f658e0c6 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:54.355137 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0aa64a72-3bf9-46ec-9b1c-0310f658e0c6 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:54.359673 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-365bca94-94ab-4ae3-88f2-900124961f4d tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:54.360641 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-365bca94-94ab-4ae3-88f2-900124961f4d tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:54.361118 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-365bca94-94ab-4ae3-88f2-900124961f4d tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:54.361912 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-365bca94-94ab-4ae3-88f2-900124961f4d tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:54.362438 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-365bca94-94ab-4ae3-88f2-900124961f4d tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:54.363086 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-365bca94-94ab-4ae3-88f2-900124961f4d tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:54.679102 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0aa64a72-3bf9-46ec-9b1c-0310f658e0c6 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:54.681844 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-365bca94-94ab-4ae3-88f2-900124961f4d tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391c4c8e6ae4483e82a247957a6faad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1f95b9a87a4f1389c03f6a3f592a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:54.684629 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=100 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:11:54.693102 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-365bca94-94ab-4ae3-88f2-900124961f4d tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] 10.222.0.50 "GET /compute/v2.1/servers/2af572bd-8a8b-4db7-9196-7203de031375" status: 200 len: 1322 microversion: 2.1 time: 0.349116 Aug 31 16:11:54.694145 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1959/4126] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:54 2022] GET /compute/v2.1/servers/2af572bd-8a8b-4db7-9196-7203de031375 => generated 1322 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:54.699295 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-80ec76bb-7526-424f-9ef2-01f62b403e00 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:54.700655 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-80ec76bb-7526-424f-9ef2-01f62b403e00 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: adb50b8a-afc7-4d23-a44c-7d4d75c33ad3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:54.707289 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80ec76bb-7526-424f-9ef2-01f62b403e00 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:54.707950 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80ec76bb-7526-424f-9ef2-01f62b403e00 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:54.708702 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80ec76bb-7526-424f-9ef2-01f62b403e00 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:54.709412 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80ec76bb-7526-424f-9ef2-01f62b403e00 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:54.709944 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80ec76bb-7526-424f-9ef2-01f62b403e00 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:54.710336 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80ec76bb-7526-424f-9ef2-01f62b403e00 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:54.712817 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0aa64a72-3bf9-46ec-9b1c-0310f658e0c6 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a" status: 200 len: 1318 microversion: 2.1 time: 0.374735 Aug 31 16:11:54.713460 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2168/4127] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:54 2022] GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a => generated 1318 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:54.718541 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-2cdb8e71-fc64-441f-bacb-9507df38bbae req-cb1a4465-ed89-46ee-97a9-d70e0ea408cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b778dc34-fa8e-4c9e-9cb6-5ececdf1074c", "tag": "5e5f3434-7ea4-46ba-92cd-1bf5d821731c"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:54.730763 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-2cdb8e71-fc64-441f-bacb-9507df38bbae req-cb1a4465-ed89-46ee-97a9-d70e0ea408cb service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:54.731777 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-2cdb8e71-fc64-441f-bacb-9507df38bbae req-cb1a4465-ed89-46ee-97a9-d70e0ea408cb service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:54.732573 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-2cdb8e71-fc64-441f-bacb-9507df38bbae req-cb1a4465-ed89-46ee-97a9-d70e0ea408cb service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:54.749784 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-2cdb8e71-fc64-441f-bacb-9507df38bbae req-cb1a4465-ed89-46ee-97a9-d70e0ea408cb service nova] Creating event network-changed:5e5f3434-7ea4-46ba-92cd-1bf5d821731c for instance b778dc34-fa8e-4c9e-9cb6-5ececdf1074c on n-h2-833090-16 Aug 31 16:11:54.756121 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-2cdb8e71-fc64-441f-bacb-9507df38bbae req-cb1a4465-ed89-46ee-97a9-d70e0ea408cb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041291 Aug 31 16:11:54.757284 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2169/4128] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:11:54.763308 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-57ce0b0b-830b-4b49-abd2-34680d37dbc1 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:54.764462 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-57ce0b0b-830b-4b49-abd2-34680d37dbc1 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: f6e41791-366b-4790-8338-2a52f4ebed89] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:54.774634 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-57ce0b0b-830b-4b49-abd2-34680d37dbc1 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:54.775933 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-57ce0b0b-830b-4b49-abd2-34680d37dbc1 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:54.776855 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-57ce0b0b-830b-4b49-abd2-34680d37dbc1 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:54.777796 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-57ce0b0b-830b-4b49-abd2-34680d37dbc1 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:54.778747 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-57ce0b0b-830b-4b49-abd2-34680d37dbc1 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:54.779379 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-57ce0b0b-830b-4b49-abd2-34680d37dbc1 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:54.953263 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-80ec76bb-7526-424f-9ef2-01f62b403e00 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:54.964328 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-80ec76bb-7526-424f-9ef2-01f62b403e00 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/adb50b8a-afc7-4d23-a44c-7d4d75c33ad3" status: 200 len: 1516 microversion: 2.1 time: 0.268456 Aug 31 16:11:54.965432 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1960/4129] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:54 2022] GET /compute/v2.1/servers/adb50b8a-afc7-4d23-a44c-7d4d75c33ad3 => generated 1516 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:54.987164 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-f94f7b45-1292-4540-91c5-96cfb80f244d req-2589707e-18c8-4efc-a462-44912870805d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2af572bd-8a8b-4db7-9196-7203de031375", "name": "network-vif-plugged", "status": "completed", "tag": "130df408-bb0d-484e-9def-4bf6e6d5c614"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:54.991443 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-57ce0b0b-830b-4b49-abd2-34680d37dbc1 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:55.000795 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-57ce0b0b-830b-4b49-abd2-34680d37dbc1 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89" status: 200 len: 1697 microversion: 2.1 time: 0.241448 Aug 31 16:11:55.001528 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2170/4130] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:54 2022] GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89 => generated 1697 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:55.002260 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f94f7b45-1292-4540-91c5-96cfb80f244d req-2589707e-18c8-4efc-a462-44912870805d service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:55.003165 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f94f7b45-1292-4540-91c5-96cfb80f244d req-2589707e-18c8-4efc-a462-44912870805d service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:55.003737 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f94f7b45-1292-4540-91c5-96cfb80f244d req-2589707e-18c8-4efc-a462-44912870805d service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:55.021079 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-f94f7b45-1292-4540-91c5-96cfb80f244d req-2589707e-18c8-4efc-a462-44912870805d service nova] Creating event network-vif-plugged:130df408-bb0d-484e-9def-4bf6e6d5c614 for instance 2af572bd-8a8b-4db7-9196-7203de031375 on n-h1-833090-16 Aug 31 16:11:55.021387 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-bddea0f9-b902-4017-b3c7-8837dab3af93 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:55.022544 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-bddea0f9-b902-4017-b3c7-8837dab3af93 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 5923807d-1058-45ab-b8d1-c6700ea8c142] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:55.030158 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-f94f7b45-1292-4540-91c5-96cfb80f244d req-2589707e-18c8-4efc-a462-44912870805d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053471 Aug 31 16:11:55.031272 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1961/4131] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:11:55.034292 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bddea0f9-b902-4017-b3c7-8837dab3af93 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:55.035117 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bddea0f9-b902-4017-b3c7-8837dab3af93 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:55.035680 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bddea0f9-b902-4017-b3c7-8837dab3af93 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:55.036656 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bddea0f9-b902-4017-b3c7-8837dab3af93 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:55.037172 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bddea0f9-b902-4017-b3c7-8837dab3af93 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:55.037758 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bddea0f9-b902-4017-b3c7-8837dab3af93 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:55.138779 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-477872b1-4376-448d-aa68-ce130fec2a0a tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:55.139550 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-477872b1-4376-448d-aa68-ce130fec2a0a tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:55.151011 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-477872b1-4376-448d-aa68-ce130fec2a0a tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:55.151829 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-477872b1-4376-448d-aa68-ce130fec2a0a tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:55.152265 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-477872b1-4376-448d-aa68-ce130fec2a0a tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:55.153038 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-477872b1-4376-448d-aa68-ce130fec2a0a tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:55.153552 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-477872b1-4376-448d-aa68-ce130fec2a0a tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:55.154250 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-477872b1-4376-448d-aa68-ce130fec2a0a tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:55.206766 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-bddea0f9-b902-4017-b3c7-8837dab3af93 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:55.220238 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-bddea0f9-b902-4017-b3c7-8837dab3af93 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142" status: 200 len: 1473 microversion: 2.1 time: 0.217526 Aug 31 16:11:55.222151 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2171/4132] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:55 2022] GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142 => generated 1473 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:55.301987 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d5c701e4-d0c7-44eb-a005-82859c3b7e7d tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:55.302716 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d5c701e4-d0c7-44eb-a005-82859c3b7e7d tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] [instance: da3e4266-a9bc-4433-a335-580713bac164] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:55.309961 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d5c701e4-d0c7-44eb-a005-82859c3b7e7d tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:55.310488 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d5c701e4-d0c7-44eb-a005-82859c3b7e7d tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:55.310930 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d5c701e4-d0c7-44eb-a005-82859c3b7e7d tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:55.311634 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d5c701e4-d0c7-44eb-a005-82859c3b7e7d tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:55.312101 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d5c701e4-d0c7-44eb-a005-82859c3b7e7d tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:55.312504 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d5c701e4-d0c7-44eb-a005-82859c3b7e7d tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:55.327243 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-477872b1-4376-448d-aa68-ce130fec2a0a tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:55.335380 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-477872b1-4376-448d-aa68-ce130fec2a0a tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f" status: 200 len: 1322 microversion: 2.1 time: 0.201250 Aug 31 16:11:55.336218 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1962/4133] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:55 2022] GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f => generated 1322 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:11:55.487276 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d5c701e4-d0c7-44eb-a005-82859c3b7e7d tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19802f8112a04f1d94a35a1956188452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9eaf2ea58471390358e3d3c4a9689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:55.495368 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d5c701e4-d0c7-44eb-a005-82859c3b7e7d tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] 10.222.0.50 "GET /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164" status: 200 len: 1523 microversion: 2.1 time: 0.199771 Aug 31 16:11:55.495942 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2172/4134] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:55 2022] GET /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164 => generated 1523 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:11:55.719667 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a65bf1c4-b088-4a59-b101-099e9b10600d tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:55.721101 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a65bf1c4-b088-4a59-b101-099e9b10600d tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] [instance: 2af572bd-8a8b-4db7-9196-7203de031375] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:55.737686 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-67200262-c298-4b96-92dd-f3f2da796435 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:55.740199 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-67200262-c298-4b96-92dd-f3f2da796435 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: b60b7363-fd13-4b81-9c4b-0aabf39c5a6a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:55.750814 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a65bf1c4-b088-4a59-b101-099e9b10600d tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:55.753121 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a65bf1c4-b088-4a59-b101-099e9b10600d tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:55.753868 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a65bf1c4-b088-4a59-b101-099e9b10600d tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:55.755137 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a65bf1c4-b088-4a59-b101-099e9b10600d tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:55.768248 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a65bf1c4-b088-4a59-b101-099e9b10600d tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:55.769155 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a65bf1c4-b088-4a59-b101-099e9b10600d tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:55.773640 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-67200262-c298-4b96-92dd-f3f2da796435 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:55.777310 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-67200262-c298-4b96-92dd-f3f2da796435 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:55.780339 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-67200262-c298-4b96-92dd-f3f2da796435 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:55.783500 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-67200262-c298-4b96-92dd-f3f2da796435 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:55.785994 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-67200262-c298-4b96-92dd-f3f2da796435 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:55.788001 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-67200262-c298-4b96-92dd-f3f2da796435 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:56.563512 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-67200262-c298-4b96-92dd-f3f2da796435 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:56.564291 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a65bf1c4-b088-4a59-b101-099e9b10600d tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391c4c8e6ae4483e82a247957a6faad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1f95b9a87a4f1389c03f6a3f592a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:56.573012 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a65bf1c4-b088-4a59-b101-099e9b10600d tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] 10.222.0.50 "GET /compute/v2.1/servers/2af572bd-8a8b-4db7-9196-7203de031375" status: 200 len: 1322 microversion: 2.1 time: 0.860950 Aug 31 16:11:56.574623 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1963/4135] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:55 2022] GET /compute/v2.1/servers/2af572bd-8a8b-4db7-9196-7203de031375 => generated 1322 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:56.586143 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-67200262-c298-4b96-92dd-f3f2da796435 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a" status: 200 len: 1318 microversion: 2.1 time: 0.856290 Aug 31 16:11:56.588073 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7d944ac7-2a8b-48d1-8b45-b6553e88c007 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:56.589422 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7d944ac7-2a8b-48d1-8b45-b6553e88c007 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: adb50b8a-afc7-4d23-a44c-7d4d75c33ad3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:56.591505 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2173/4136] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:55 2022] GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a => generated 1318 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:11:56.599294 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e484d264-3a2a-452a-a944-21f9a9788d8d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:56.603237 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d944ac7-2a8b-48d1-8b45-b6553e88c007 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:56.603787 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d944ac7-2a8b-48d1-8b45-b6553e88c007 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:56.604608 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e484d264-3a2a-452a-a944-21f9a9788d8d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: f6e41791-366b-4790-8338-2a52f4ebed89] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:56.613714 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d944ac7-2a8b-48d1-8b45-b6553e88c007 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:56.615089 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d944ac7-2a8b-48d1-8b45-b6553e88c007 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:56.615810 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d944ac7-2a8b-48d1-8b45-b6553e88c007 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:56.616613 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d944ac7-2a8b-48d1-8b45-b6553e88c007 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:56.627344 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e484d264-3a2a-452a-a944-21f9a9788d8d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:56.628322 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e484d264-3a2a-452a-a944-21f9a9788d8d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:56.628780 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e484d264-3a2a-452a-a944-21f9a9788d8d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:56.629683 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e484d264-3a2a-452a-a944-21f9a9788d8d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:56.630429 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e484d264-3a2a-452a-a944-21f9a9788d8d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:56.631189 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e484d264-3a2a-452a-a944-21f9a9788d8d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:56.954059 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7d944ac7-2a8b-48d1-8b45-b6553e88c007 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:56.957597 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e484d264-3a2a-452a-a944-21f9a9788d8d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:56.963230 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7d944ac7-2a8b-48d1-8b45-b6553e88c007 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/adb50b8a-afc7-4d23-a44c-7d4d75c33ad3" status: 200 len: 1516 microversion: 2.1 time: 0.387250 Aug 31 16:11:56.964034 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1964/4137] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:56 2022] GET /compute/v2.1/servers/adb50b8a-afc7-4d23-a44c-7d4d75c33ad3 => generated 1516 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:56.968055 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e484d264-3a2a-452a-a944-21f9a9788d8d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89" status: 200 len: 1697 microversion: 2.1 time: 0.374523 Aug 31 16:11:56.969230 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2174/4138] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:56 2022] GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89 => generated 1697 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:56.971500 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c148002f-51bf-4388-b678-93d77a938217 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:56.972835 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c148002f-51bf-4388-b678-93d77a938217 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 5923807d-1058-45ab-b8d1-c6700ea8c142] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:56.982229 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-238397b8-c072-4f79-9d39-9b6210499b71 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:56.982748 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c148002f-51bf-4388-b678-93d77a938217 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:56.983129 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c148002f-51bf-4388-b678-93d77a938217 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:56.983572 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c148002f-51bf-4388-b678-93d77a938217 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:56.984460 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c148002f-51bf-4388-b678-93d77a938217 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:56.985377 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c148002f-51bf-4388-b678-93d77a938217 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:56.985811 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c148002f-51bf-4388-b678-93d77a938217 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:56.986451 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-238397b8-c072-4f79-9d39-9b6210499b71 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:56.995218 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-238397b8-c072-4f79-9d39-9b6210499b71 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:56.995890 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-238397b8-c072-4f79-9d39-9b6210499b71 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:56.996323 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-238397b8-c072-4f79-9d39-9b6210499b71 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:56.997029 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-238397b8-c072-4f79-9d39-9b6210499b71 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:56.997793 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-238397b8-c072-4f79-9d39-9b6210499b71 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:56.998442 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-238397b8-c072-4f79-9d39-9b6210499b71 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:57.195279 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c148002f-51bf-4388-b678-93d77a938217 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:57.204614 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c148002f-51bf-4388-b678-93d77a938217 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142" status: 200 len: 1473 microversion: 2.1 time: 0.239156 Aug 31 16:11:57.218379 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1965/4139] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:56 2022] GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142 => generated 1473 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:57.223277 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0ac80bc4-6c21-4725-a6f6-b3da432c2dc8 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:57.224568 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0ac80bc4-6c21-4725-a6f6-b3da432c2dc8 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] [instance: da3e4266-a9bc-4433-a335-580713bac164] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:57.232453 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ac80bc4-6c21-4725-a6f6-b3da432c2dc8 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:57.232994 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ac80bc4-6c21-4725-a6f6-b3da432c2dc8 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:57.233380 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ac80bc4-6c21-4725-a6f6-b3da432c2dc8 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:57.234127 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ac80bc4-6c21-4725-a6f6-b3da432c2dc8 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:57.234660 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ac80bc4-6c21-4725-a6f6-b3da432c2dc8 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:57.235393 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ac80bc4-6c21-4725-a6f6-b3da432c2dc8 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:57.276692 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-238397b8-c072-4f79-9d39-9b6210499b71 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:57.287543 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-238397b8-c072-4f79-9d39-9b6210499b71 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f" status: 200 len: 1322 microversion: 2.1 time: 0.316503 Aug 31 16:11:57.288135 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2175/4140] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:56 2022] GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f => generated 1322 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:57.446053 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0ac80bc4-6c21-4725-a6f6-b3da432c2dc8 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19802f8112a04f1d94a35a1956188452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9eaf2ea58471390358e3d3c4a9689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:57.455741 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0ac80bc4-6c21-4725-a6f6-b3da432c2dc8 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] 10.222.0.50 "GET /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164" status: 200 len: 1523 microversion: 2.1 time: 0.249553 Aug 31 16:11:57.456328 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1966/4141] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:57 2022] GET /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164 => generated 1523 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:57.602748 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e4887c1e-babc-4d68-bce0-23296bce9318 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:57.603354 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e4887c1e-babc-4d68-bce0-23296bce9318 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] [instance: 2af572bd-8a8b-4db7-9196-7203de031375] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:57.611066 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4887c1e-babc-4d68-bce0-23296bce9318 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:57.611537 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4887c1e-babc-4d68-bce0-23296bce9318 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:57.612002 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4887c1e-babc-4d68-bce0-23296bce9318 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:57.612694 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4887c1e-babc-4d68-bce0-23296bce9318 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:57.613142 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4887c1e-babc-4d68-bce0-23296bce9318 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:57.613555 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4887c1e-babc-4d68-bce0-23296bce9318 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:57.625526 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b22fe049-447e-4f58-b3ec-a3f22a53e22d tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:57.627068 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b22fe049-447e-4f58-b3ec-a3f22a53e22d tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: b60b7363-fd13-4b81-9c4b-0aabf39c5a6a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:57.637180 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b22fe049-447e-4f58-b3ec-a3f22a53e22d tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:57.637764 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b22fe049-447e-4f58-b3ec-a3f22a53e22d tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:57.638605 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b22fe049-447e-4f58-b3ec-a3f22a53e22d tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:57.639716 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b22fe049-447e-4f58-b3ec-a3f22a53e22d tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:57.640723 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b22fe049-447e-4f58-b3ec-a3f22a53e22d tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:57.641395 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b22fe049-447e-4f58-b3ec-a3f22a53e22d tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:57.851753 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e4887c1e-babc-4d68-bce0-23296bce9318 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391c4c8e6ae4483e82a247957a6faad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1f95b9a87a4f1389c03f6a3f592a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:57.861316 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e4887c1e-babc-4d68-bce0-23296bce9318 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] 10.222.0.50 "GET /compute/v2.1/servers/2af572bd-8a8b-4db7-9196-7203de031375" status: 200 len: 1322 microversion: 2.1 time: 0.262438 Aug 31 16:11:57.861899 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2176/4142] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:57 2022] GET /compute/v2.1/servers/2af572bd-8a8b-4db7-9196-7203de031375 => generated 1322 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:57.878934 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b22fe049-447e-4f58-b3ec-a3f22a53e22d tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:57.887740 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b22fe049-447e-4f58-b3ec-a3f22a53e22d tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a" status: 200 len: 1318 microversion: 2.1 time: 0.265991 Aug 31 16:11:57.888314 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1967/4143] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:57 2022] GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a => generated 1318 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:57.999823 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3d95db66-dd28-4a81-9ede-d99dc1261421 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:58.000647 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3d95db66-dd28-4a81-9ede-d99dc1261421 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: f6e41791-366b-4790-8338-2a52f4ebed89] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:58.003261 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0f935843-6c0c-4a71-a9db-f174504640b1 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:58.007376 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0f935843-6c0c-4a71-a9db-f174504640b1 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: adb50b8a-afc7-4d23-a44c-7d4d75c33ad3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:58.015269 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f935843-6c0c-4a71-a9db-f174504640b1 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:58.015998 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f935843-6c0c-4a71-a9db-f174504640b1 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:58.016443 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f935843-6c0c-4a71-a9db-f174504640b1 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:58.017128 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f935843-6c0c-4a71-a9db-f174504640b1 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:58.017654 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f935843-6c0c-4a71-a9db-f174504640b1 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:58.018394 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f935843-6c0c-4a71-a9db-f174504640b1 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:58.029393 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3d95db66-dd28-4a81-9ede-d99dc1261421 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:58.033082 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3d95db66-dd28-4a81-9ede-d99dc1261421 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:58.033768 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3d95db66-dd28-4a81-9ede-d99dc1261421 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:58.037408 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3d95db66-dd28-4a81-9ede-d99dc1261421 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:58.037890 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3d95db66-dd28-4a81-9ede-d99dc1261421 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:58.038362 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3d95db66-dd28-4a81-9ede-d99dc1261421 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:58.331645 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0f935843-6c0c-4a71-a9db-f174504640b1 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:58.342539 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0f935843-6c0c-4a71-a9db-f174504640b1 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/adb50b8a-afc7-4d23-a44c-7d4d75c33ad3" status: 200 len: 1516 microversion: 2.1 time: 0.345493 Aug 31 16:11:58.354785 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1968/4144] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:57 2022] GET /compute/v2.1/servers/adb50b8a-afc7-4d23-a44c-7d4d75c33ad3 => generated 1516 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:58.370226 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3d95db66-dd28-4a81-9ede-d99dc1261421 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:58.371958 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-b363d12f-be5d-4f54-99de-1dc2b68cb6f9 req-cfb67a72-1359-4824-875b-d271a5756e22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f", "name": "network-vif-plugged", "status": "completed", "tag": "d706c52d-7294-4df5-8605-e5eb47c15dca"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:11:58.383003 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3d95db66-dd28-4a81-9ede-d99dc1261421 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89" status: 200 len: 1697 microversion: 2.1 time: 0.394208 Aug 31 16:11:58.384792 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2177/4145] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:57 2022] GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89 => generated 1697 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:58.391746 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-68f396f6-ea7f-4176-9dca-1619154780a9 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:58.392906 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-68f396f6-ea7f-4176-9dca-1619154780a9 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 5923807d-1058-45ab-b8d1-c6700ea8c142] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:58.401518 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68f396f6-ea7f-4176-9dca-1619154780a9 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:58.401718 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b363d12f-be5d-4f54-99de-1dc2b68cb6f9 req-cfb67a72-1359-4824-875b-d271a5756e22 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:58.402354 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b363d12f-be5d-4f54-99de-1dc2b68cb6f9 req-cfb67a72-1359-4824-875b-d271a5756e22 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:58.402726 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68f396f6-ea7f-4176-9dca-1619154780a9 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:58.403063 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b363d12f-be5d-4f54-99de-1dc2b68cb6f9 req-cfb67a72-1359-4824-875b-d271a5756e22 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:58.404280 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68f396f6-ea7f-4176-9dca-1619154780a9 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:58.405783 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68f396f6-ea7f-4176-9dca-1619154780a9 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:58.406860 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68f396f6-ea7f-4176-9dca-1619154780a9 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:58.407610 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68f396f6-ea7f-4176-9dca-1619154780a9 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:58.416808 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-b363d12f-be5d-4f54-99de-1dc2b68cb6f9 req-cfb67a72-1359-4824-875b-d271a5756e22 service nova] Creating event network-vif-plugged:d706c52d-7294-4df5-8605-e5eb47c15dca for instance 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f on n-h2-833090-16 Aug 31 16:11:58.421801 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-b363d12f-be5d-4f54-99de-1dc2b68cb6f9 req-cfb67a72-1359-4824-875b-d271a5756e22 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056573 Aug 31 16:11:58.422717 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1969/4146] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:11:58.427924 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-057b301b-4046-4afc-aada-412c9d9a9aca tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:58.428623 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-057b301b-4046-4afc-aada-412c9d9a9aca tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:58.435287 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-057b301b-4046-4afc-aada-412c9d9a9aca tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:58.435843 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-057b301b-4046-4afc-aada-412c9d9a9aca tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:58.436281 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-057b301b-4046-4afc-aada-412c9d9a9aca tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:58.436979 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-057b301b-4046-4afc-aada-412c9d9a9aca tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:58.437426 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-057b301b-4046-4afc-aada-412c9d9a9aca tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:58.437839 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-057b301b-4046-4afc-aada-412c9d9a9aca tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:58.709136 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-68f396f6-ea7f-4176-9dca-1619154780a9 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:58.734008 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-68f396f6-ea7f-4176-9dca-1619154780a9 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142" status: 200 len: 1473 microversion: 2.1 time: 0.346198 Aug 31 16:11:58.734632 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2178/4147] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:58 2022] GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142 => generated 1473 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:58.737337 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-057b301b-4046-4afc-aada-412c9d9a9aca tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:58.749639 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-057b301b-4046-4afc-aada-412c9d9a9aca tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f" status: 200 len: 1322 microversion: 2.1 time: 0.325899 Aug 31 16:11:58.764481 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1a4bd6da-f96b-421b-a9c0-8a18f24876a8 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:58.769247 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1970/4148] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:58 2022] GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f => generated 1322 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:58.769455 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1a4bd6da-f96b-421b-a9c0-8a18f24876a8 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] [instance: da3e4266-a9bc-4433-a335-580713bac164] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:58.781119 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a4bd6da-f96b-421b-a9c0-8a18f24876a8 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:58.781626 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a4bd6da-f96b-421b-a9c0-8a18f24876a8 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:58.782940 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a4bd6da-f96b-421b-a9c0-8a18f24876a8 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:58.784333 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a4bd6da-f96b-421b-a9c0-8a18f24876a8 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:58.784981 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a4bd6da-f96b-421b-a9c0-8a18f24876a8 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:58.785448 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a4bd6da-f96b-421b-a9c0-8a18f24876a8 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:58.883993 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-21a291a3-8deb-4aa5-8c46-9f83b793c104 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:58.886966 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-21a291a3-8deb-4aa5-8c46-9f83b793c104 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] [instance: 2af572bd-8a8b-4db7-9196-7203de031375] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:58.905305 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-21a291a3-8deb-4aa5-8c46-9f83b793c104 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:58.905805 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-21a291a3-8deb-4aa5-8c46-9f83b793c104 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:58.906498 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-21a291a3-8deb-4aa5-8c46-9f83b793c104 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:58.907545 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-21a291a3-8deb-4aa5-8c46-9f83b793c104 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:58.908281 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-21a291a3-8deb-4aa5-8c46-9f83b793c104 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:58.909709 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-21a291a3-8deb-4aa5-8c46-9f83b793c104 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:59.351647 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-21a291a3-8deb-4aa5-8c46-9f83b793c104 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391c4c8e6ae4483e82a247957a6faad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1f95b9a87a4f1389c03f6a3f592a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:59.375854 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-21a291a3-8deb-4aa5-8c46-9f83b793c104 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] 10.222.0.50 "GET /compute/v2.1/servers/2af572bd-8a8b-4db7-9196-7203de031375" status: 200 len: 1515 microversion: 2.1 time: 0.496175 Aug 31 16:11:59.379198 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1971/4149] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:58 2022] GET /compute/v2.1/servers/2af572bd-8a8b-4db7-9196-7203de031375 => generated 1515 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:59.387889 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b7e24660-950e-4bf5-b1d2-6403a9fb1477 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:59.397135 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b7e24660-950e-4bf5-b1d2-6403a9fb1477 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: b60b7363-fd13-4b81-9c4b-0aabf39c5a6a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:59.412221 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7e24660-950e-4bf5-b1d2-6403a9fb1477 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:59.415699 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7e24660-950e-4bf5-b1d2-6403a9fb1477 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:59.416273 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7e24660-950e-4bf5-b1d2-6403a9fb1477 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:59.417302 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7e24660-950e-4bf5-b1d2-6403a9fb1477 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:59.417946 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7e24660-950e-4bf5-b1d2-6403a9fb1477 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:59.426647 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7e24660-950e-4bf5-b1d2-6403a9fb1477 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:59.661980 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1a4bd6da-f96b-421b-a9c0-8a18f24876a8 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19802f8112a04f1d94a35a1956188452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9eaf2ea58471390358e3d3c4a9689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:59.672957 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1a4bd6da-f96b-421b-a9c0-8a18f24876a8 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] 10.222.0.50 "GET /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164" status: 200 len: 1523 microversion: 2.1 time: 0.936588 Aug 31 16:11:59.677263 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2179/4150] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:58 2022] GET /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164 => generated 1523 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:59.684376 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-91195cbf-42da-4633-a1b3-2be928719afe tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:59.685379 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-91195cbf-42da-4633-a1b3-2be928719afe tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: adb50b8a-afc7-4d23-a44c-7d4d75c33ad3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:59.694521 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91195cbf-42da-4633-a1b3-2be928719afe tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:59.695842 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91195cbf-42da-4633-a1b3-2be928719afe tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:59.696958 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91195cbf-42da-4633-a1b3-2be928719afe tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:59.698436 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91195cbf-42da-4633-a1b3-2be928719afe tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:59.699737 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91195cbf-42da-4633-a1b3-2be928719afe tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:59.701202 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91195cbf-42da-4633-a1b3-2be928719afe tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:59.844965 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b7e24660-950e-4bf5-b1d2-6403a9fb1477 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:11:59.855925 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b7e24660-950e-4bf5-b1d2-6403a9fb1477 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a" status: 200 len: 1318 microversion: 2.1 time: 0.475036 Aug 31 16:11:59.856676 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1972/4151] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:59 2022] GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a => generated 1318 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:11:59.870384 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bd37b09d-7438-42fc-ba0a-b18e7d87f136 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:11:59.871003 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bd37b09d-7438-42fc-ba0a-b18e7d87f136 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] [instance: 4754015c-cda0-4f0a-9096-06bebe3d33b1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:11:59.882666 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bd37b09d-7438-42fc-ba0a-b18e7d87f136 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:59.883125 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bd37b09d-7438-42fc-ba0a-b18e7d87f136 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:59.883748 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bd37b09d-7438-42fc-ba0a-b18e7d87f136 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:11:59.884623 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bd37b09d-7438-42fc-ba0a-b18e7d87f136 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:11:59.889615 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bd37b09d-7438-42fc-ba0a-b18e7d87f136 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:11:59.890327 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bd37b09d-7438-42fc-ba0a-b18e7d87f136 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:00.237501 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-91195cbf-42da-4633-a1b3-2be928719afe tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:00.255200 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-91195cbf-42da-4633-a1b3-2be928719afe tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/adb50b8a-afc7-4d23-a44c-7d4d75c33ad3" status: 200 len: 1516 microversion: 2.1 time: 0.574996 Aug 31 16:12:00.255951 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2180/4152] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:59 2022] GET /compute/v2.1/servers/adb50b8a-afc7-4d23-a44c-7d4d75c33ad3 => generated 1516 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:00.281742 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-50110e19-3bce-4c9c-b368-d07e140d99f6 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:00.283644 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-50110e19-3bce-4c9c-b368-d07e140d99f6 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: f6e41791-366b-4790-8338-2a52f4ebed89] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:00.318679 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-50110e19-3bce-4c9c-b368-d07e140d99f6 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:00.321068 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-50110e19-3bce-4c9c-b368-d07e140d99f6 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:00.322872 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-50110e19-3bce-4c9c-b368-d07e140d99f6 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:00.325684 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-50110e19-3bce-4c9c-b368-d07e140d99f6 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:00.327321 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-50110e19-3bce-4c9c-b368-d07e140d99f6 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:00.329265 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-50110e19-3bce-4c9c-b368-d07e140d99f6 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:00.368656 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bd37b09d-7438-42fc-ba0a-b18e7d87f136 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391c4c8e6ae4483e82a247957a6faad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1f95b9a87a4f1389c03f6a3f592a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:00.373436 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:12:00.386116 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bd37b09d-7438-42fc-ba0a-b18e7d87f136 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] 10.222.0.50 "GET /compute/v2.1/servers/4754015c-cda0-4f0a-9096-06bebe3d33b1" status: 200 len: 1322 microversion: 2.1 time: 0.528266 Aug 31 16:12:00.390378 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1973/4153] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:11:59 2022] GET /compute/v2.1/servers/4754015c-cda0-4f0a-9096-06bebe3d33b1 => generated 1322 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:00.410031 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ab2e9a36-d012-457c-869a-2ce1deb2ebf2 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:00.412011 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ab2e9a36-d012-457c-869a-2ce1deb2ebf2 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 5923807d-1058-45ab-b8d1-c6700ea8c142] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:00.438750 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab2e9a36-d012-457c-869a-2ce1deb2ebf2 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:00.439526 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab2e9a36-d012-457c-869a-2ce1deb2ebf2 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:00.443758 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab2e9a36-d012-457c-869a-2ce1deb2ebf2 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:00.444756 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab2e9a36-d012-457c-869a-2ce1deb2ebf2 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:00.445531 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab2e9a36-d012-457c-869a-2ce1deb2ebf2 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:00.446182 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab2e9a36-d012-457c-869a-2ce1deb2ebf2 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:00.769311 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-50110e19-3bce-4c9c-b368-d07e140d99f6 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:00.788963 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-50110e19-3bce-4c9c-b368-d07e140d99f6 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89" status: 200 len: 1697 microversion: 2.1 time: 0.516044 Aug 31 16:12:00.793246 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2181/4154] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:00 2022] GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89 => generated 1697 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:00.813051 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e58cd6f8-61c3-4f80-b960-1a0a29ba7bcd tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:00.813667 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e58cd6f8-61c3-4f80-b960-1a0a29ba7bcd tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:00.821890 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e58cd6f8-61c3-4f80-b960-1a0a29ba7bcd tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:00.822781 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e58cd6f8-61c3-4f80-b960-1a0a29ba7bcd tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:00.824193 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e58cd6f8-61c3-4f80-b960-1a0a29ba7bcd tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:00.825814 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e58cd6f8-61c3-4f80-b960-1a0a29ba7bcd tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:00.826620 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e58cd6f8-61c3-4f80-b960-1a0a29ba7bcd tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:00.827236 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e58cd6f8-61c3-4f80-b960-1a0a29ba7bcd tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:00.917206 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ab2e9a36-d012-457c-869a-2ce1deb2ebf2 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:00.935197 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ab2e9a36-d012-457c-869a-2ce1deb2ebf2 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142" status: 200 len: 1473 microversion: 2.1 time: 0.543221 Aug 31 16:12:00.947054 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1974/4155] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:00 2022] GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142 => generated 1473 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:00.958381 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-72a72c00-67e9-480f-8514-791537a90f9d tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:00.959860 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-72a72c00-67e9-480f-8514-791537a90f9d tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] [instance: da3e4266-a9bc-4433-a335-580713bac164] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:00.968944 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72a72c00-67e9-480f-8514-791537a90f9d tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:00.970275 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72a72c00-67e9-480f-8514-791537a90f9d tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:00.971083 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72a72c00-67e9-480f-8514-791537a90f9d tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:00.972506 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72a72c00-67e9-480f-8514-791537a90f9d tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:00.973233 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72a72c00-67e9-480f-8514-791537a90f9d tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:00.973847 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72a72c00-67e9-480f-8514-791537a90f9d tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:01.141192 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e58cd6f8-61c3-4f80-b960-1a0a29ba7bcd tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:01.153240 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e58cd6f8-61c3-4f80-b960-1a0a29ba7bcd tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f" status: 200 len: 1322 microversion: 2.1 time: 0.358008 Aug 31 16:12:01.154774 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2182/4156] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:00 2022] GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f => generated 1322 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:01.162940 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-5b129855-8cba-4fca-be85-ebe66ca69ef9 req-a607b19b-9bbd-414c-88a9-eadf61a546f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b60b7363-fd13-4b81-9c4b-0aabf39c5a6a", "name": "network-vif-plugged", "status": "completed", "tag": "498f733b-bbc6-4db1-9c7b-1cc502f31161"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:01.181641 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-5b129855-8cba-4fca-be85-ebe66ca69ef9 req-a607b19b-9bbd-414c-88a9-eadf61a546f3 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:01.182519 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-5b129855-8cba-4fca-be85-ebe66ca69ef9 req-a607b19b-9bbd-414c-88a9-eadf61a546f3 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:01.183374 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-5b129855-8cba-4fca-be85-ebe66ca69ef9 req-a607b19b-9bbd-414c-88a9-eadf61a546f3 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:01.205869 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-5b129855-8cba-4fca-be85-ebe66ca69ef9 req-a607b19b-9bbd-414c-88a9-eadf61a546f3 service nova] Creating event network-vif-plugged:498f733b-bbc6-4db1-9c7b-1cc502f31161 for instance b60b7363-fd13-4b81-9c4b-0aabf39c5a6a on n-h1-833090-16 Aug 31 16:12:01.213272 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-5b129855-8cba-4fca-be85-ebe66ca69ef9 req-a607b19b-9bbd-414c-88a9-eadf61a546f3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055056 Aug 31 16:12:01.214480 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2183/4157] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:01.224544 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d15f1b69-1bff-4b18-90c7-f62926b2d255 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:01.227512 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d15f1b69-1bff-4b18-90c7-f62926b2d255 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: b60b7363-fd13-4b81-9c4b-0aabf39c5a6a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:01.258659 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d15f1b69-1bff-4b18-90c7-f62926b2d255 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:01.258865 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-72a72c00-67e9-480f-8514-791537a90f9d tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19802f8112a04f1d94a35a1956188452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9eaf2ea58471390358e3d3c4a9689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:01.263943 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d15f1b69-1bff-4b18-90c7-f62926b2d255 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:01.266584 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d15f1b69-1bff-4b18-90c7-f62926b2d255 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:01.271494 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-72a72c00-67e9-480f-8514-791537a90f9d tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] 10.222.0.50 "GET /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164" status: 200 len: 1503 microversion: 2.1 time: 0.322424 Aug 31 16:12:01.272425 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d15f1b69-1bff-4b18-90c7-f62926b2d255 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:01.272911 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d15f1b69-1bff-4b18-90c7-f62926b2d255 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:01.282458 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d15f1b69-1bff-4b18-90c7-f62926b2d255 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:01.283412 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1975/4158] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:00 2022] GET /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164 => generated 1503 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:01.300558 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-89ab84fb-fd96-47ca-ab7b-16ece4e3e0d8 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:01.302672 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-89ab84fb-fd96-47ca-ab7b-16ece4e3e0d8 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: adb50b8a-afc7-4d23-a44c-7d4d75c33ad3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:01.320573 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-89ab84fb-fd96-47ca-ab7b-16ece4e3e0d8 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:01.324070 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-89ab84fb-fd96-47ca-ab7b-16ece4e3e0d8 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:01.324878 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-89ab84fb-fd96-47ca-ab7b-16ece4e3e0d8 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:01.327037 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-89ab84fb-fd96-47ca-ab7b-16ece4e3e0d8 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:01.328129 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-89ab84fb-fd96-47ca-ab7b-16ece4e3e0d8 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:01.328746 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-89ab84fb-fd96-47ca-ab7b-16ece4e3e0d8 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:01.518233 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-89ab84fb-fd96-47ca-ab7b-16ece4e3e0d8 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:01.550358 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-89ab84fb-fd96-47ca-ab7b-16ece4e3e0d8 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/adb50b8a-afc7-4d23-a44c-7d4d75c33ad3" status: 200 len: 1474 microversion: 2.1 time: 0.262237 Aug 31 16:12:01.551138 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1976/4159] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:01 2022] GET /compute/v2.1/servers/adb50b8a-afc7-4d23-a44c-7d4d75c33ad3 => generated 1474 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:01.558986 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ccc5f677-0c78-4fbe-83b9-b6b2e865abe3 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Action: 'create', calling method: .version_select at 0x7fbb45bede50>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1745158800", "description": "tempest-description-1624931971"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:01.647491 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d15f1b69-1bff-4b18-90c7-f62926b2d255 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:01.661885 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d15f1b69-1bff-4b18-90c7-f62926b2d255 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a" status: 200 len: 1318 microversion: 2.1 time: 0.445247 Aug 31 16:12:01.674201 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2184/4160] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:01 2022] GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a => generated 1318 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:01.674201 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fc90f9f0-6eb8-4d5b-ad85-ec765e7ede26 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:01.674201 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fc90f9f0-6eb8-4d5b-ad85-ec765e7ede26 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] [instance: 4754015c-cda0-4f0a-9096-06bebe3d33b1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:01.681195 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fc90f9f0-6eb8-4d5b-ad85-ec765e7ede26 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:01.681814 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fc90f9f0-6eb8-4d5b-ad85-ec765e7ede26 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:01.682405 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fc90f9f0-6eb8-4d5b-ad85-ec765e7ede26 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:01.683237 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fc90f9f0-6eb8-4d5b-ad85-ec765e7ede26 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:01.683829 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fc90f9f0-6eb8-4d5b-ad85-ec765e7ede26 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:01.685769 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fc90f9f0-6eb8-4d5b-ad85-ec765e7ede26 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:01.919168 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ccc5f677-0c78-4fbe-83b9-b6b2e865abe3 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 0.366283 Aug 31 16:12:01.919773 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1977/4161] 10.222.0.50 () {60 vars in 1180 bytes} [Wed Aug 31 16:12:01 2022] POST /compute/v2.1/os-security-groups => generated 251 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:01.934582 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-6a219fb9-4fd1-4b5c-8f6f-e650783fc58d req-cc9b0baf-2aac-49c6-a793-aa86460c5ff7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adb50b8a-afc7-4d23-a44c-7d4d75c33ad3", "name": "network-vif-deleted", "tag": "35074f3b-1243-4414-be68-4f5321bd13d7"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:01.946497 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-6a219fb9-4fd1-4b5c-8f6f-e650783fc58d req-cc9b0baf-2aac-49c6-a793-aa86460c5ff7 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:01.947233 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-6a219fb9-4fd1-4b5c-8f6f-e650783fc58d req-cc9b0baf-2aac-49c6-a793-aa86460c5ff7 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:01.947874 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-6a219fb9-4fd1-4b5c-8f6f-e650783fc58d req-cc9b0baf-2aac-49c6-a793-aa86460c5ff7 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:01.966759 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-6a219fb9-4fd1-4b5c-8f6f-e650783fc58d req-cc9b0baf-2aac-49c6-a793-aa86460c5ff7 service nova] Creating event network-vif-deleted:35074f3b-1243-4414-be68-4f5321bd13d7 for instance adb50b8a-afc7-4d23-a44c-7d4d75c33ad3 on n-h2-833090-16 Aug 31 16:12:01.973173 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-6a219fb9-4fd1-4b5c-8f6f-e650783fc58d req-cc9b0baf-2aac-49c6-a793-aa86460c5ff7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051897 Aug 31 16:12:01.974671 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1978/4162] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:01.991172 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-701e0bcc-f84b-4796-8593-ce1daf016136 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:01.991339 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-fc90f9f0-6eb8-4d5b-ad85-ec765e7ede26 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391c4c8e6ae4483e82a247957a6faad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1f95b9a87a4f1389c03f6a3f592a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:01.993267 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-701e0bcc-f84b-4796-8593-ce1daf016136 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: f6e41791-366b-4790-8338-2a52f4ebed89] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:02.001256 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fc90f9f0-6eb8-4d5b-ad85-ec765e7ede26 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] 10.222.0.50 "GET /compute/v2.1/servers/4754015c-cda0-4f0a-9096-06bebe3d33b1" status: 200 len: 1322 microversion: 2.1 time: 0.336987 Aug 31 16:12:02.001835 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2185/4163] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:01 2022] GET /compute/v2.1/servers/4754015c-cda0-4f0a-9096-06bebe3d33b1 => generated 1322 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:02.006663 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-701e0bcc-f84b-4796-8593-ce1daf016136 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:02.007381 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-701e0bcc-f84b-4796-8593-ce1daf016136 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:02.007913 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-701e0bcc-f84b-4796-8593-ce1daf016136 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:02.008566 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fe393c84-175d-45fc-8259-8e6bc2996fef tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1745158800"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:02.008799 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-701e0bcc-f84b-4796-8593-ce1daf016136 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:02.009350 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-701e0bcc-f84b-4796-8593-ce1daf016136 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:02.009854 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fe393c84-175d-45fc-8259-8e6bc2996fef tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] [instance: da3e4266-a9bc-4433-a335-580713bac164] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:02.010001 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-701e0bcc-f84b-4796-8593-ce1daf016136 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:02.017917 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fe393c84-175d-45fc-8259-8e6bc2996fef tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:02.018928 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fe393c84-175d-45fc-8259-8e6bc2996fef tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:02.019714 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fe393c84-175d-45fc-8259-8e6bc2996fef tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:02.020690 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fe393c84-175d-45fc-8259-8e6bc2996fef tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:02.021297 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fe393c84-175d-45fc-8259-8e6bc2996fef tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:02.021900 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fe393c84-175d-45fc-8259-8e6bc2996fef tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:02.280313 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-701e0bcc-f84b-4796-8593-ce1daf016136 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:02.295276 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.network.security_group_api [None req-fe393c84-175d-45fc-8259-8e6bc2996fef tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Adding security group e5e57a91-b3c0-4dc5-9cc4-04883dd76420 to port 3fbcf647-bed8-4bd1-8cb6-2c28f9c026e1 Aug 31 16:12:02.296399 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-701e0bcc-f84b-4796-8593-ce1daf016136 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89" status: 200 len: 1697 microversion: 2.1 time: 0.319761 Aug 31 16:12:02.297415 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1979/4164] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:01 2022] GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89 => generated 1697 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:02.307064 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8f64a2fb-5478-4b22-bada-1d797db79caa tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:02.308437 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8f64a2fb-5478-4b22-bada-1d797db79caa tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 5923807d-1058-45ab-b8d1-c6700ea8c142] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:02.322365 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f64a2fb-5478-4b22-bada-1d797db79caa tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:02.323615 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f64a2fb-5478-4b22-bada-1d797db79caa tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:02.324643 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f64a2fb-5478-4b22-bada-1d797db79caa tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:02.326562 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f64a2fb-5478-4b22-bada-1d797db79caa tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:02.327670 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f64a2fb-5478-4b22-bada-1d797db79caa tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:02.328630 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f64a2fb-5478-4b22-bada-1d797db79caa tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:03.042471 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8f64a2fb-5478-4b22-bada-1d797db79caa tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:03.052279 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8f64a2fb-5478-4b22-bada-1d797db79caa tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142" status: 200 len: 1473 microversion: 2.1 time: 0.752789 Aug 31 16:12:03.053153 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1980/4165] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:02 2022] GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142 => generated 1473 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:03.063706 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-05d66cfc-077d-4b09-bde3-79d8cb8f1c79 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:03.064773 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-05d66cfc-077d-4b09-bde3-79d8cb8f1c79 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:03.073569 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05d66cfc-077d-4b09-bde3-79d8cb8f1c79 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:03.074355 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05d66cfc-077d-4b09-bde3-79d8cb8f1c79 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:03.075589 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05d66cfc-077d-4b09-bde3-79d8cb8f1c79 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:03.076828 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05d66cfc-077d-4b09-bde3-79d8cb8f1c79 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:03.077277 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05d66cfc-077d-4b09-bde3-79d8cb8f1c79 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:03.077903 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05d66cfc-077d-4b09-bde3-79d8cb8f1c79 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:03.513346 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-05d66cfc-077d-4b09-bde3-79d8cb8f1c79 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:03.531394 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-05d66cfc-077d-4b09-bde3-79d8cb8f1c79 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f" status: 200 len: 1515 microversion: 2.1 time: 0.476834 Aug 31 16:12:03.533344 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1981/4166] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:03 2022] GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f => generated 1515 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:03.547159 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-363bcace-3068-47a8-b8e3-ce149f552b65 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:03.548312 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-363bcace-3068-47a8-b8e3-ce149f552b65 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: adb50b8a-afc7-4d23-a44c-7d4d75c33ad3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:03.560989 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-363bcace-3068-47a8-b8e3-ce149f552b65 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:03.561789 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-363bcace-3068-47a8-b8e3-ce149f552b65 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:03.562755 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-363bcace-3068-47a8-b8e3-ce149f552b65 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:03.563910 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-363bcace-3068-47a8-b8e3-ce149f552b65 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:03.564518 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-363bcace-3068-47a8-b8e3-ce149f552b65 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:03.565091 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-363bcace-3068-47a8-b8e3-ce149f552b65 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:03.641240 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fe393c84-175d-45fc-8259-8e6bc2996fef tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] 10.222.0.50 "POST /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164/action" status: 202 len: 0 microversion: 2.1 time: 1.636744 Aug 31 16:12:03.645190 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2186/4167] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:12:02 2022] POST /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164/action => generated 0 bytes in 1642 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:12:03.651577 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c2297161-0b33-44e8-955e-4e5fd9987b45 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:03.652846 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c2297161-0b33-44e8-955e-4e5fd9987b45 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: b60b7363-fd13-4b81-9c4b-0aabf39c5a6a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:03.670404 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c2297161-0b33-44e8-955e-4e5fd9987b45 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:03.672492 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c2297161-0b33-44e8-955e-4e5fd9987b45 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:03.674651 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c2297161-0b33-44e8-955e-4e5fd9987b45 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:03.675587 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c2297161-0b33-44e8-955e-4e5fd9987b45 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:03.677686 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-363bcace-3068-47a8-b8e3-ce149f552b65 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:03.678416 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c2297161-0b33-44e8-955e-4e5fd9987b45 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:03.679497 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c2297161-0b33-44e8-955e-4e5fd9987b45 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:03.682115 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-363bcace-3068-47a8-b8e3-ce149f552b65 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:03.683987 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-363bcace-3068-47a8-b8e3-ce149f552b65 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:03.686295 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-363bcace-3068-47a8-b8e3-ce149f552b65 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lazy-loading 'fault' on Instance uuid adb50b8a-afc7-4d23-a44c-7d4d75c33ad3 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:12:03.722979 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=100 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:12:03.756866 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-363bcace-3068-47a8-b8e3-ce149f552b65 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:03.782738 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-363bcace-3068-47a8-b8e3-ce149f552b65 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/adb50b8a-afc7-4d23-a44c-7d4d75c33ad3" status: 200 len: 1318 microversion: 2.1 time: 0.247761 Aug 31 16:12:03.785439 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1982/4168] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:03 2022] GET /compute/v2.1/servers/adb50b8a-afc7-4d23-a44c-7d4d75c33ad3 => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:03.797378 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fc63e72c-3db0-4ff8-b74f-0103e91fe8e5 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:03.798372 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fc63e72c-3db0-4ff8-b74f-0103e91fe8e5 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] [instance: 4754015c-cda0-4f0a-9096-06bebe3d33b1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:03.819193 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc63e72c-3db0-4ff8-b74f-0103e91fe8e5 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:03.821663 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc63e72c-3db0-4ff8-b74f-0103e91fe8e5 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:03.822551 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc63e72c-3db0-4ff8-b74f-0103e91fe8e5 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:03.824575 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc63e72c-3db0-4ff8-b74f-0103e91fe8e5 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:03.825942 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc63e72c-3db0-4ff8-b74f-0103e91fe8e5 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:03.827083 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc63e72c-3db0-4ff8-b74f-0103e91fe8e5 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:03.913665 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c2297161-0b33-44e8-955e-4e5fd9987b45 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:03.925836 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c2297161-0b33-44e8-955e-4e5fd9987b45 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a" status: 200 len: 1508 microversion: 2.1 time: 0.279236 Aug 31 16:12:03.926832 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2187/4169] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:03 2022] GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a => generated 1508 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:03.933554 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-08f55132-2602-45cd-b991-85a22cb8e82a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:03.934599 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-08f55132-2602-45cd-b991-85a22cb8e82a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: f6e41791-366b-4790-8338-2a52f4ebed89] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:03.941176 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-08f55132-2602-45cd-b991-85a22cb8e82a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:03.941963 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-08f55132-2602-45cd-b991-85a22cb8e82a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:03.943898 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-08f55132-2602-45cd-b991-85a22cb8e82a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:03.944898 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-08f55132-2602-45cd-b991-85a22cb8e82a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:03.945579 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-08f55132-2602-45cd-b991-85a22cb8e82a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:03.946274 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-08f55132-2602-45cd-b991-85a22cb8e82a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:04.165242 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fc63e72c-3db0-4ff8-b74f-0103e91fe8e5 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391c4c8e6ae4483e82a247957a6faad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1f95b9a87a4f1389c03f6a3f592a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:04.182272 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fc63e72c-3db0-4ff8-b74f-0103e91fe8e5 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] 10.222.0.50 "GET /compute/v2.1/servers/4754015c-cda0-4f0a-9096-06bebe3d33b1" status: 200 len: 1322 microversion: 2.1 time: 0.392253 Aug 31 16:12:04.186233 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1983/4170] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:03 2022] GET /compute/v2.1/servers/4754015c-cda0-4f0a-9096-06bebe3d33b1 => generated 1322 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:04.198917 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-d86e0af8-7525-4c62-bc45-51a85ea50b9d req-074cd51e-9c23-4a0b-aa5a-d52dbdd62db5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b778dc34-fa8e-4c9e-9cb6-5ececdf1074c", "name": "network-vif-plugged", "status": "completed", "tag": "5e5f3434-7ea4-46ba-92cd-1bf5d821731c"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:04.230686 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d86e0af8-7525-4c62-bc45-51a85ea50b9d req-074cd51e-9c23-4a0b-aa5a-d52dbdd62db5 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:04.233729 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d86e0af8-7525-4c62-bc45-51a85ea50b9d req-074cd51e-9c23-4a0b-aa5a-d52dbdd62db5 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:04.235736 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d86e0af8-7525-4c62-bc45-51a85ea50b9d req-074cd51e-9c23-4a0b-aa5a-d52dbdd62db5 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:04.266640 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-08f55132-2602-45cd-b991-85a22cb8e82a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:04.271176 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-d86e0af8-7525-4c62-bc45-51a85ea50b9d req-074cd51e-9c23-4a0b-aa5a-d52dbdd62db5 service nova] Creating event network-vif-plugged:5e5f3434-7ea4-46ba-92cd-1bf5d821731c for instance b778dc34-fa8e-4c9e-9cb6-5ececdf1074c on n-h2-833090-16 Aug 31 16:12:04.280931 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-d86e0af8-7525-4c62-bc45-51a85ea50b9d req-074cd51e-9c23-4a0b-aa5a-d52dbdd62db5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092744 Aug 31 16:12:04.281142 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-08f55132-2602-45cd-b991-85a22cb8e82a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89" status: 200 len: 1697 microversion: 2.1 time: 0.352244 Aug 31 16:12:04.281610 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2188/4171] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:03 2022] GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89 => generated 1697 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:04.281885 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1984/4172] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:04.288183 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a828372f-e7aa-4449-a5d0-08ec575456f5 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1745158800"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:04.288491 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-de9ab359-46f0-4d38-9c7a-c76c61cce473 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:04.289412 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a828372f-e7aa-4449-a5d0-08ec575456f5 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] [instance: da3e4266-a9bc-4433-a335-580713bac164] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:04.292209 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-de9ab359-46f0-4d38-9c7a-c76c61cce473 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:04.299780 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a828372f-e7aa-4449-a5d0-08ec575456f5 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:04.300742 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a828372f-e7aa-4449-a5d0-08ec575456f5 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:04.301197 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a828372f-e7aa-4449-a5d0-08ec575456f5 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:04.302034 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a828372f-e7aa-4449-a5d0-08ec575456f5 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:04.302531 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a828372f-e7aa-4449-a5d0-08ec575456f5 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:04.302958 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a828372f-e7aa-4449-a5d0-08ec575456f5 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:04.304877 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-de9ab359-46f0-4d38-9c7a-c76c61cce473 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:04.305638 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-de9ab359-46f0-4d38-9c7a-c76c61cce473 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:04.306780 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-de9ab359-46f0-4d38-9c7a-c76c61cce473 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:04.308055 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-de9ab359-46f0-4d38-9c7a-c76c61cce473 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:04.308773 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-de9ab359-46f0-4d38-9c7a-c76c61cce473 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:04.309315 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-de9ab359-46f0-4d38-9c7a-c76c61cce473 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:04.340154 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-de9ab359-46f0-4d38-9c7a-c76c61cce473 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lazy-loading 'flavor' on Instance uuid 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:12:04.480068 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-de9ab359-46f0-4d38-9c7a-c76c61cce473 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "POST /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f/action" status: 200 len: 32 microversion: 2.1 time: 0.195566 Aug 31 16:12:04.481217 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1985/4173] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:12:04 2022] POST /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f/action => generated 32 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:12:04.493431 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9fbcecf2-be79-414f-b883-ef21f594536c tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:04.495007 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9fbcecf2-be79-414f-b883-ef21f594536c tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: b60b7363-fd13-4b81-9c4b-0aabf39c5a6a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:04.510290 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9fbcecf2-be79-414f-b883-ef21f594536c tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:04.511202 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9fbcecf2-be79-414f-b883-ef21f594536c tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:04.512026 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9fbcecf2-be79-414f-b883-ef21f594536c tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:04.514426 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9fbcecf2-be79-414f-b883-ef21f594536c tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:04.515824 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9fbcecf2-be79-414f-b883-ef21f594536c tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:04.517016 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9fbcecf2-be79-414f-b883-ef21f594536c tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:04.519989 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.network.security_group_api [None req-a828372f-e7aa-4449-a5d0-08ec575456f5 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Removing security group e5e57a91-b3c0-4dc5-9cc4-04883dd76420 from port 3fbcf647-bed8-4bd1-8cb6-2c28f9c026e1 Aug 31 16:12:04.793728 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9fbcecf2-be79-414f-b883-ef21f594536c tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:04.803055 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9fbcecf2-be79-414f-b883-ef21f594536c tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a" status: 200 len: 1508 microversion: 2.1 time: 0.318514 Aug 31 16:12:04.804162 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1986/4174] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:04 2022] GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a => generated 1508 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:04.809544 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-12b2ec27-1f80-4870-9bd7-1fff4b5b614d req-492f1559-5675-4bf7-9af2-2ecf9a3d4f76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da3e4266-a9bc-4433-a335-580713bac164", "tag": "3fbcf647-bed8-4bd1-8cb6-2c28f9c026e1"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:04.819397 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-12b2ec27-1f80-4870-9bd7-1fff4b5b614d req-492f1559-5675-4bf7-9af2-2ecf9a3d4f76 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:04.820193 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-12b2ec27-1f80-4870-9bd7-1fff4b5b614d req-492f1559-5675-4bf7-9af2-2ecf9a3d4f76 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:04.820844 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-12b2ec27-1f80-4870-9bd7-1fff4b5b614d req-492f1559-5675-4bf7-9af2-2ecf9a3d4f76 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:04.833185 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-12b2ec27-1f80-4870-9bd7-1fff4b5b614d req-492f1559-5675-4bf7-9af2-2ecf9a3d4f76 service nova] Creating event network-changed:3fbcf647-bed8-4bd1-8cb6-2c28f9c026e1 for instance da3e4266-a9bc-4433-a335-580713bac164 on n-h1-833090-16 Aug 31 16:12:04.838347 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-12b2ec27-1f80-4870-9bd7-1fff4b5b614d req-492f1559-5675-4bf7-9af2-2ecf9a3d4f76 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032860 Aug 31 16:12:04.839096 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1987/4175] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:04.844406 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bb318eb0-acae-4d60-aaaf-6555c52782df tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:04.845102 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bb318eb0-acae-4d60-aaaf-6555c52782df tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 5923807d-1058-45ab-b8d1-c6700ea8c142] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:04.863216 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bb318eb0-acae-4d60-aaaf-6555c52782df tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:04.864052 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bb318eb0-acae-4d60-aaaf-6555c52782df tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:04.864484 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bb318eb0-acae-4d60-aaaf-6555c52782df tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:04.865355 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bb318eb0-acae-4d60-aaaf-6555c52782df tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:04.865971 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bb318eb0-acae-4d60-aaaf-6555c52782df tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:04.866422 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bb318eb0-acae-4d60-aaaf-6555c52782df tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:05.247358 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a828372f-e7aa-4449-a5d0-08ec575456f5 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] 10.222.0.50 "POST /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164/action" status: 202 len: 0 microversion: 2.1 time: 0.963264 Aug 31 16:12:05.248973 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2189/4176] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:12:04 2022] POST /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164/action => generated 0 bytes in 966 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:12:05.261955 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8108abc3-33af-435a-844d-fb5023d1eb7a tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:05.263814 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8108abc3-33af-435a-844d-fb5023d1eb7a tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:05.273196 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bb318eb0-acae-4d60-aaaf-6555c52782df tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:05.274856 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8108abc3-33af-435a-844d-fb5023d1eb7a tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:05.275800 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8108abc3-33af-435a-844d-fb5023d1eb7a tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:05.276476 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8108abc3-33af-435a-844d-fb5023d1eb7a tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:05.277512 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8108abc3-33af-435a-844d-fb5023d1eb7a tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:05.278253 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8108abc3-33af-435a-844d-fb5023d1eb7a tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:05.279084 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8108abc3-33af-435a-844d-fb5023d1eb7a tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:05.281790 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bb318eb0-acae-4d60-aaaf-6555c52782df tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142" status: 200 len: 1473 microversion: 2.1 time: 0.441310 Aug 31 16:12:05.286964 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1988/4177] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:04 2022] GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142 => generated 1473 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:05.293957 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-91744014-9425-45ed-b100-9c7afa21f14e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:05.294966 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-91744014-9425-45ed-b100-9c7afa21f14e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: adb50b8a-afc7-4d23-a44c-7d4d75c33ad3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:05.311895 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91744014-9425-45ed-b100-9c7afa21f14e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:05.312695 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91744014-9425-45ed-b100-9c7afa21f14e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:05.313451 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91744014-9425-45ed-b100-9c7afa21f14e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:05.315112 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91744014-9425-45ed-b100-9c7afa21f14e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:05.315800 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91744014-9425-45ed-b100-9c7afa21f14e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:05.316379 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91744014-9425-45ed-b100-9c7afa21f14e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:05.363618 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91744014-9425-45ed-b100-9c7afa21f14e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:05.364930 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91744014-9425-45ed-b100-9c7afa21f14e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:05.365529 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91744014-9425-45ed-b100-9c7afa21f14e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:05.366672 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-91744014-9425-45ed-b100-9c7afa21f14e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lazy-loading 'fault' on Instance uuid adb50b8a-afc7-4d23-a44c-7d4d75c33ad3 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:12:05.501446 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-91744014-9425-45ed-b100-9c7afa21f14e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:05.519671 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-91744014-9425-45ed-b100-9c7afa21f14e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/adb50b8a-afc7-4d23-a44c-7d4d75c33ad3" status: 200 len: 1318 microversion: 2.1 time: 0.230891 Aug 31 16:12:05.521180 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1989/4178] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:05 2022] GET /compute/v2.1/servers/adb50b8a-afc7-4d23-a44c-7d4d75c33ad3 => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:05.526906 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-58737448-6fb7-483c-bfff-e44fa1e89531 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:05.530222 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-58737448-6fb7-483c-bfff-e44fa1e89531 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: b60b7363-fd13-4b81-9c4b-0aabf39c5a6a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:05.537367 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58737448-6fb7-483c-bfff-e44fa1e89531 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:05.537854 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58737448-6fb7-483c-bfff-e44fa1e89531 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:05.538345 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58737448-6fb7-483c-bfff-e44fa1e89531 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:05.539249 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58737448-6fb7-483c-bfff-e44fa1e89531 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:05.539712 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58737448-6fb7-483c-bfff-e44fa1e89531 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:05.540126 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58737448-6fb7-483c-bfff-e44fa1e89531 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:05.665267 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:12:05.677405 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-58737448-6fb7-483c-bfff-e44fa1e89531 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "PUT /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a" status: 200 len: 1080 microversion: 2.1 time: 0.155009 Aug 31 16:12:05.679447 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1990/4179] 10.222.0.50 () {60 vars in 1256 bytes} [Wed Aug 31 16:12:05 2022] PUT /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a => generated 1080 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:05.686758 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3fffbc06-e07d-4fa9-b97c-454f3683b261 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:05.687708 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3fffbc06-e07d-4fa9-b97c-454f3683b261 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] [instance: 4754015c-cda0-4f0a-9096-06bebe3d33b1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:05.695978 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3fffbc06-e07d-4fa9-b97c-454f3683b261 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:05.697355 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3fffbc06-e07d-4fa9-b97c-454f3683b261 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:05.697811 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8108abc3-33af-435a-844d-fb5023d1eb7a tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:05.698298 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3fffbc06-e07d-4fa9-b97c-454f3683b261 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:05.699326 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3fffbc06-e07d-4fa9-b97c-454f3683b261 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:05.700207 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3fffbc06-e07d-4fa9-b97c-454f3683b261 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:05.700828 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3fffbc06-e07d-4fa9-b97c-454f3683b261 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:05.709256 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8108abc3-33af-435a-844d-fb5023d1eb7a tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f" status: 200 len: 1521 microversion: 2.1 time: 0.457740 Aug 31 16:12:05.725859 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2190/4180] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:05 2022] GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f => generated 1521 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:05.725859 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f5ad6efe-da23-4775-bca9-8cbe00721284 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Action: 'create', calling method: .version_select at 0x7fbb460a8160>, body: {"pool": null} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:06.094948 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3fffbc06-e07d-4fa9-b97c-454f3683b261 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391c4c8e6ae4483e82a247957a6faad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1f95b9a87a4f1389c03f6a3f592a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:06.104176 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3fffbc06-e07d-4fa9-b97c-454f3683b261 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] 10.222.0.50 "GET /compute/v2.1/servers/4754015c-cda0-4f0a-9096-06bebe3d33b1" status: 200 len: 1322 microversion: 2.1 time: 0.422863 Aug 31 16:12:06.113154 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1991/4181] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:05 2022] GET /compute/v2.1/servers/4754015c-cda0-4f0a-9096-06bebe3d33b1 => generated 1322 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:06.123689 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-19ea4c6c-000d-4589-a840-8c34c3420285 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:06.124796 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-19ea4c6c-000d-4589-a840-8c34c3420285 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: f6e41791-366b-4790-8338-2a52f4ebed89] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:06.134351 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19ea4c6c-000d-4589-a840-8c34c3420285 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:06.135453 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19ea4c6c-000d-4589-a840-8c34c3420285 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:06.136215 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19ea4c6c-000d-4589-a840-8c34c3420285 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:06.137370 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19ea4c6c-000d-4589-a840-8c34c3420285 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:06.138081 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19ea4c6c-000d-4589-a840-8c34c3420285 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:06.140091 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19ea4c6c-000d-4589-a840-8c34c3420285 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:06.396700 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-19ea4c6c-000d-4589-a840-8c34c3420285 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:06.408856 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-19ea4c6c-000d-4589-a840-8c34c3420285 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89" status: 200 len: 1697 microversion: 2.1 time: 0.302686 Aug 31 16:12:06.409709 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1992/4182] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:06 2022] GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89 => generated 1697 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:06.415363 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-415a5ef1-df8f-4bfd-84bb-d0dfe04ce93e tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:06.416462 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-415a5ef1-df8f-4bfd-84bb-d0dfe04ce93e tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: b60b7363-fd13-4b81-9c4b-0aabf39c5a6a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:06.423928 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-415a5ef1-df8f-4bfd-84bb-d0dfe04ce93e tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:06.424928 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-415a5ef1-df8f-4bfd-84bb-d0dfe04ce93e tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:06.425573 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-415a5ef1-df8f-4bfd-84bb-d0dfe04ce93e tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:06.426565 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-415a5ef1-df8f-4bfd-84bb-d0dfe04ce93e tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:06.427972 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-415a5ef1-df8f-4bfd-84bb-d0dfe04ce93e tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:06.428617 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-415a5ef1-df8f-4bfd-84bb-d0dfe04ce93e tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:06.643988 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-415a5ef1-df8f-4bfd-84bb-d0dfe04ce93e tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:06.652730 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-415a5ef1-df8f-4bfd-84bb-d0dfe04ce93e tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a" status: 200 len: 1506 microversion: 2.1 time: 0.241503 Aug 31 16:12:06.658905 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1993/4183] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:06 2022] GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a => generated 1506 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:06.658905 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-76ed1d84-4af7-4525-b08e-5b5546745295 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:06.659567 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-76ed1d84-4af7-4525-b08e-5b5546745295 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 5923807d-1058-45ab-b8d1-c6700ea8c142] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:06.665381 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:12:06.667447 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76ed1d84-4af7-4525-b08e-5b5546745295 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:06.667975 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76ed1d84-4af7-4525-b08e-5b5546745295 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:06.668554 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76ed1d84-4af7-4525-b08e-5b5546745295 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:06.669202 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76ed1d84-4af7-4525-b08e-5b5546745295 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:06.669779 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76ed1d84-4af7-4525-b08e-5b5546745295 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:06.670273 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76ed1d84-4af7-4525-b08e-5b5546745295 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:06.940027 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-76ed1d84-4af7-4525-b08e-5b5546745295 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:06.949514 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-76ed1d84-4af7-4525-b08e-5b5546745295 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142" status: 200 len: 1473 microversion: 2.1 time: 0.294519 Aug 31 16:12:06.950638 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1994/4184] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:06 2022] GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142 => generated 1473 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:06.957806 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4c539557-6d2e-478e-ab7c-c6558f74672b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:06.958719 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4c539557-6d2e-478e-ab7c-c6558f74672b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: adb50b8a-afc7-4d23-a44c-7d4d75c33ad3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:06.970819 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c539557-6d2e-478e-ab7c-c6558f74672b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:06.971706 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c539557-6d2e-478e-ab7c-c6558f74672b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:06.972380 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c539557-6d2e-478e-ab7c-c6558f74672b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:06.973427 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c539557-6d2e-478e-ab7c-c6558f74672b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:06.973920 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c539557-6d2e-478e-ab7c-c6558f74672b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:06.974466 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c539557-6d2e-478e-ab7c-c6558f74672b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:07.025389 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c539557-6d2e-478e-ab7c-c6558f74672b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:07.025863 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c539557-6d2e-478e-ab7c-c6558f74672b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:07.026498 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c539557-6d2e-478e-ab7c-c6558f74672b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:07.027135 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-4c539557-6d2e-478e-ab7c-c6558f74672b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lazy-loading 'fault' on Instance uuid adb50b8a-afc7-4d23-a44c-7d4d75c33ad3 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:12:07.107778 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4c539557-6d2e-478e-ab7c-c6558f74672b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:07.127380 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4c539557-6d2e-478e-ab7c-c6558f74672b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/adb50b8a-afc7-4d23-a44c-7d4d75c33ad3" status: 200 len: 1318 microversion: 2.1 time: 0.171645 Aug 31 16:12:07.127380 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1995/4185] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:06 2022] GET /compute/v2.1/servers/adb50b8a-afc7-4d23-a44c-7d4d75c33ad3 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:07.143234 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8f68dcde-cf38-4a07-bf41-13929749d162 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:07.144254 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8f68dcde-cf38-4a07-bf41-13929749d162 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: b60b7363-fd13-4b81-9c4b-0aabf39c5a6a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:07.156254 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f68dcde-cf38-4a07-bf41-13929749d162 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:07.157170 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f68dcde-cf38-4a07-bf41-13929749d162 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:07.157888 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f68dcde-cf38-4a07-bf41-13929749d162 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:07.159219 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f68dcde-cf38-4a07-bf41-13929749d162 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:07.159832 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f68dcde-cf38-4a07-bf41-13929749d162 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:07.160627 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f68dcde-cf38-4a07-bf41-13929749d162 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:07.469793 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8f68dcde-cf38-4a07-bf41-13929749d162 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:07.479779 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8f68dcde-cf38-4a07-bf41-13929749d162 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a" status: 200 len: 1506 microversion: 2.1 time: 0.352704 Aug 31 16:12:07.480317 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1996/4186] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:07 2022] GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a => generated 1506 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:07.501003 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-359e4f76-443f-4e1f-ac17-262255c57f02 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:07.501894 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-359e4f76-443f-4e1f-ac17-262255c57f02 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:07.513818 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-359e4f76-443f-4e1f-ac17-262255c57f02 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:07.514978 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-359e4f76-443f-4e1f-ac17-262255c57f02 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:07.515899 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-359e4f76-443f-4e1f-ac17-262255c57f02 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:07.518044 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-359e4f76-443f-4e1f-ac17-262255c57f02 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:07.518969 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-359e4f76-443f-4e1f-ac17-262255c57f02 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:07.519918 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-359e4f76-443f-4e1f-ac17-262255c57f02 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:07.743943 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f5ad6efe-da23-4775-bca9-8cbe00721284 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] 10.222.0.50 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.031094 Aug 31 16:12:07.751065 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2191/4187] 10.222.0.50 () {60 vars in 1170 bytes} [Wed Aug 31 16:12:05 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2039 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:07.768332 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-0a381686-8c41-4baa-bcf8-6e5e5b7440f4 req-e66180a0-2cd9-41fb-8674-8095189660d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da3e4266-a9bc-4433-a335-580713bac164", "tag": "3fbcf647-bed8-4bd1-8cb6-2c28f9c026e1"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:07.770907 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-359e4f76-443f-4e1f-ac17-262255c57f02 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:07.781937 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-359e4f76-443f-4e1f-ac17-262255c57f02 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f" status: 200 len: 1521 microversion: 2.1 time: 0.300278 Aug 31 16:12:07.797055 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1997/4188] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:07 2022] GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f => generated 1521 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:07.802779 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7d5abcb3-30ea-4487-8a48-26d0b960a9e9 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:07.803636 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7d5abcb3-30ea-4487-8a48-26d0b960a9e9 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] [instance: 4754015c-cda0-4f0a-9096-06bebe3d33b1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:07.805615 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-0a381686-8c41-4baa-bcf8-6e5e5b7440f4 req-e66180a0-2cd9-41fb-8674-8095189660d5 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:07.806343 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-0a381686-8c41-4baa-bcf8-6e5e5b7440f4 req-e66180a0-2cd9-41fb-8674-8095189660d5 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:07.807980 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-0a381686-8c41-4baa-bcf8-6e5e5b7440f4 req-e66180a0-2cd9-41fb-8674-8095189660d5 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:07.812089 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d5abcb3-30ea-4487-8a48-26d0b960a9e9 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:07.813033 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d5abcb3-30ea-4487-8a48-26d0b960a9e9 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:07.813171 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d5abcb3-30ea-4487-8a48-26d0b960a9e9 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:07.813923 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d5abcb3-30ea-4487-8a48-26d0b960a9e9 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:07.814473 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d5abcb3-30ea-4487-8a48-26d0b960a9e9 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:07.814961 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d5abcb3-30ea-4487-8a48-26d0b960a9e9 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:07.829081 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-0a381686-8c41-4baa-bcf8-6e5e5b7440f4 req-e66180a0-2cd9-41fb-8674-8095189660d5 service nova] Creating event network-changed:3fbcf647-bed8-4bd1-8cb6-2c28f9c026e1 for instance da3e4266-a9bc-4433-a335-580713bac164 on n-h1-833090-16 Aug 31 16:12:07.837007 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-0a381686-8c41-4baa-bcf8-6e5e5b7440f4 req-e66180a0-2cd9-41fb-8674-8095189660d5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084105 Aug 31 16:12:07.838978 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2192/4189] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:07.847725 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-acc60e8c-2779-43e0-80e7-289311f88433 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:07.849280 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-acc60e8c-2779-43e0-80e7-289311f88433 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: f6e41791-366b-4790-8338-2a52f4ebed89] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:07.860135 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-acc60e8c-2779-43e0-80e7-289311f88433 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:07.860950 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-acc60e8c-2779-43e0-80e7-289311f88433 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:07.861669 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-acc60e8c-2779-43e0-80e7-289311f88433 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:07.862742 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-acc60e8c-2779-43e0-80e7-289311f88433 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:07.863611 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-acc60e8c-2779-43e0-80e7-289311f88433 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:07.864347 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-acc60e8c-2779-43e0-80e7-289311f88433 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:08.223135 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-acc60e8c-2779-43e0-80e7-289311f88433 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:08.233662 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-acc60e8c-2779-43e0-80e7-289311f88433 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89" status: 200 len: 1697 microversion: 2.1 time: 0.392610 Aug 31 16:12:08.233932 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2193/4190] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:07 2022] GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89 => generated 1697 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:08.239133 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0782bc34-f074-434f-bfd6-5df68c53a243 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:08.241884 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0782bc34-f074-434f-bfd6-5df68c53a243 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: b60b7363-fd13-4b81-9c4b-0aabf39c5a6a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:08.248613 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0782bc34-f074-434f-bfd6-5df68c53a243 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:08.249103 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0782bc34-f074-434f-bfd6-5df68c53a243 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:08.249541 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0782bc34-f074-434f-bfd6-5df68c53a243 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:08.250285 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0782bc34-f074-434f-bfd6-5df68c53a243 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:08.250796 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0782bc34-f074-434f-bfd6-5df68c53a243 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:08.251280 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0782bc34-f074-434f-bfd6-5df68c53a243 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:08.302292 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7d5abcb3-30ea-4487-8a48-26d0b960a9e9 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391c4c8e6ae4483e82a247957a6faad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1f95b9a87a4f1389c03f6a3f592a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:08.313522 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7d5abcb3-30ea-4487-8a48-26d0b960a9e9 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] 10.222.0.50 "GET /compute/v2.1/servers/4754015c-cda0-4f0a-9096-06bebe3d33b1" status: 200 len: 1322 microversion: 2.1 time: 0.514756 Aug 31 16:12:08.328087 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1998/4191] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:07 2022] GET /compute/v2.1/servers/4754015c-cda0-4f0a-9096-06bebe3d33b1 => generated 1322 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:08.334384 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-739d0f1e-4963-471e-a81e-f89b5edecfef tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.241"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:08.337880 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-739d0f1e-4963-471e-a81e-f89b5edecfef tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] [instance: da3e4266-a9bc-4433-a335-580713bac164] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:08.344554 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-739d0f1e-4963-471e-a81e-f89b5edecfef tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:08.345191 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-739d0f1e-4963-471e-a81e-f89b5edecfef tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:08.345703 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-739d0f1e-4963-471e-a81e-f89b5edecfef tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:08.346532 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-739d0f1e-4963-471e-a81e-f89b5edecfef tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:08.347052 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-739d0f1e-4963-471e-a81e-f89b5edecfef tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:08.347637 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-739d0f1e-4963-471e-a81e-f89b5edecfef tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:08.351529 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=100 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:12:08.355712 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-0782bc34-f074-434f-bfd6-5df68c53a243 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:12:08.357773 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-0782bc34-f074-434f-bfd6-5df68c53a243 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:12:08.359477 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-0782bc34-f074-434f-bfd6-5df68c53a243 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:12:08.360414 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-0782bc34-f074-434f-bfd6-5df68c53a243 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:12:08.360995 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-0782bc34-f074-434f-bfd6-5df68c53a243 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:12:08.377613 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-739d0f1e-4963-471e-a81e-f89b5edecfef tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "refresh_cache-da3e4266-a9bc-4433-a335-580713bac164" {{(pid=128863) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 16:12:08.378040 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-739d0f1e-4963-471e-a81e-f89b5edecfef tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquired lock "refresh_cache-da3e4266-a9bc-4433-a335-580713bac164" {{(pid=128863) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 16:12:08.450083 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0782bc34-f074-434f-bfd6-5df68c53a243 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: b60b7363-fd13-4b81-9c4b-0aabf39c5a6a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:08.462128 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0782bc34-f074-434f-bfd6-5df68c53a243 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:08.463219 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0782bc34-f074-434f-bfd6-5df68c53a243 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:08.463975 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0782bc34-f074-434f-bfd6-5df68c53a243 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:08.465176 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0782bc34-f074-434f-bfd6-5df68c53a243 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:08.465993 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0782bc34-f074-434f-bfd6-5df68c53a243 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:08.466740 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0782bc34-f074-434f-bfd6-5df68c53a243 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:08.500386 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0782bc34-f074-434f-bfd6-5df68c53a243 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "POST /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a/action" status: 202 len: 1112 microversion: 2.1 time: 0.265364 Aug 31 16:12:08.501210 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2194/4192] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:12:08 2022] POST /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a/action => generated 1112 bytes in 267 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 31 16:12:08.520218 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0ae1b703-2afc-429a-ba94-3e1d4afab093 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:08.520897 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0ae1b703-2afc-429a-ba94-3e1d4afab093 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 5923807d-1058-45ab-b8d1-c6700ea8c142] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:08.530051 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0ae1b703-2afc-429a-ba94-3e1d4afab093 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:08.530709 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0ae1b703-2afc-429a-ba94-3e1d4afab093 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:08.531253 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0ae1b703-2afc-429a-ba94-3e1d4afab093 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:08.532040 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0ae1b703-2afc-429a-ba94-3e1d4afab093 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:08.532619 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0ae1b703-2afc-429a-ba94-3e1d4afab093 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:08.533329 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0ae1b703-2afc-429a-ba94-3e1d4afab093 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:09.471372 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0ae1b703-2afc-429a-ba94-3e1d4afab093 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:09.480233 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0ae1b703-2afc-429a-ba94-3e1d4afab093 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142" status: 200 len: 1473 microversion: 2.1 time: 0.977685 Aug 31 16:12:09.481179 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2195/4193] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:08 2022] GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142 => generated 1473 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:09.486693 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a09c0c41-d396-4c86-bdc7-78b1e7e544f6 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:09.487601 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a09c0c41-d396-4c86-bdc7-78b1e7e544f6 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: adb50b8a-afc7-4d23-a44c-7d4d75c33ad3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:09.503338 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a09c0c41-d396-4c86-bdc7-78b1e7e544f6 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:09.503831 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a09c0c41-d396-4c86-bdc7-78b1e7e544f6 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:09.504332 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a09c0c41-d396-4c86-bdc7-78b1e7e544f6 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:09.505813 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a09c0c41-d396-4c86-bdc7-78b1e7e544f6 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:09.506314 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a09c0c41-d396-4c86-bdc7-78b1e7e544f6 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:09.506734 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a09c0c41-d396-4c86-bdc7-78b1e7e544f6 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:09.537597 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-a09c0c41-d396-4c86-bdc7-78b1e7e544f6 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] HTTP exception thrown: Instance adb50b8a-afc7-4d23-a44c-7d4d75c33ad3 could not be found. Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a09c0c41-d396-4c86-bdc7-78b1e7e544f6 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Request method failure captured: Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/adb50b8a-afc7-4d23-a44c-7d4d75c33ad3 HTTP/1.1 Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4fcRMLera6TLJp6OFOd_B19-rdZe1qr5LTGcbsBroFhPQ8_L89JW9hpsNJPnNpQCXW4WKWxdTwWZTYVgRah_OPLrb5JBnrA64ZgN8VfXgRvkXORTfvSkZvZgjCL7371tDtPpfcPNp0NcyRfiYHxIldtsDdYZVFbQTa8WMsjzib7kZ0 Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 84f42648e1a343b9a5ab9b89c91bea0d Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServersTestJSON-1527984429 Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_84f42648e1a343b9a5ab9b89c91bea0d", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServersTestJSON-1527984429 Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 84f42648e1a343b9a5ab9b89c91bea0d Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServersTestJSON-1527984429 Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServersTestJSON-1527984429-project Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 3ebce87993504550914c2c3702eebb17 Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServersTestJSON-1527984429-project Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance adb50b8a-afc7-4d23-a44c-7d4d75c33ad3 could not be found. Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'adb50b8a-afc7-4d23-a44c-7d4d75c33ad3'} Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adb50b8a-afc7-4d23-a44c-7d4d75c33ad3 could not be found. Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adb50b8a-afc7-4d23-a44c-7d4d75c33ad3 could not be found. Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:09.540584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:12:09.544817 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:09.544817 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:09.544817 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:09.544817 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:12:09.544817 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:12:09.544817 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adb50b8a-afc7-4d23-a44c-7d4d75c33ad3 could not be found. Aug 31 16:12:09.544817 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:12:09.546454 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a09c0c41-d396-4c86-bdc7-78b1e7e544f6 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Returning 404 to user: Instance adb50b8a-afc7-4d23-a44c-7d4d75c33ad3 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:12:09.547472 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a09c0c41-d396-4c86-bdc7-78b1e7e544f6 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/adb50b8a-afc7-4d23-a44c-7d4d75c33ad3" status: 404 len: 111 microversion: 2.1 time: 0.064815 Aug 31 16:12:09.551698 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2196/4194] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:09 2022] GET /compute/v2.1/servers/adb50b8a-afc7-4d23-a44c-7d4d75c33ad3 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:12:09.557951 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a254653f-c4e1-4e8b-80a8-a8907fb3ef86 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:09.558935 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a254653f-c4e1-4e8b-80a8-a8907fb3ef86 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: b60b7363-fd13-4b81-9c4b-0aabf39c5a6a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:09.578291 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a254653f-c4e1-4e8b-80a8-a8907fb3ef86 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:09.582608 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a254653f-c4e1-4e8b-80a8-a8907fb3ef86 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:09.584921 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a254653f-c4e1-4e8b-80a8-a8907fb3ef86 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:09.586260 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a254653f-c4e1-4e8b-80a8-a8907fb3ef86 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:09.587799 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a254653f-c4e1-4e8b-80a8-a8907fb3ef86 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:09.588679 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a254653f-c4e1-4e8b-80a8-a8907fb3ef86 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:09.897451 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a254653f-c4e1-4e8b-80a8-a8907fb3ef86 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:09.911106 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a254653f-c4e1-4e8b-80a8-a8907fb3ef86 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a" status: 200 len: 1517 microversion: 2.1 time: 0.357689 Aug 31 16:12:09.912263 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2197/4195] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:09 2022] GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a => generated 1517 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:09.920861 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a0c6f02e-fe7c-43d0-9741-50a73f89c074 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:09.922365 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a0c6f02e-fe7c-43d0-9741-50a73f89c074 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:09.930640 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a0c6f02e-fe7c-43d0-9741-50a73f89c074 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:09.931654 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a0c6f02e-fe7c-43d0-9741-50a73f89c074 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:09.932286 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a0c6f02e-fe7c-43d0-9741-50a73f89c074 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:09.933259 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a0c6f02e-fe7c-43d0-9741-50a73f89c074 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:09.933876 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a0c6f02e-fe7c-43d0-9741-50a73f89c074 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:09.934623 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a0c6f02e-fe7c-43d0-9741-50a73f89c074 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:10.275030 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a0c6f02e-fe7c-43d0-9741-50a73f89c074 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:10.285815 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a0c6f02e-fe7c-43d0-9741-50a73f89c074 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f" status: 200 len: 1521 microversion: 2.1 time: 0.371970 Aug 31 16:12:10.287056 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2198/4196] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:09 2022] GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f => generated 1521 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:10.308110 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9f6bd127-74f3-4fdb-9f89-ff2b822196f7 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:10.309561 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9f6bd127-74f3-4fdb-9f89-ff2b822196f7 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: f6e41791-366b-4790-8338-2a52f4ebed89] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:10.320495 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9f6bd127-74f3-4fdb-9f89-ff2b822196f7 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:10.321251 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9f6bd127-74f3-4fdb-9f89-ff2b822196f7 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:10.321994 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9f6bd127-74f3-4fdb-9f89-ff2b822196f7 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:10.323322 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9f6bd127-74f3-4fdb-9f89-ff2b822196f7 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:10.324146 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9f6bd127-74f3-4fdb-9f89-ff2b822196f7 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:10.324825 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9f6bd127-74f3-4fdb-9f89-ff2b822196f7 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:10.859083 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9f6bd127-74f3-4fdb-9f89-ff2b822196f7 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:10.878050 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9f6bd127-74f3-4fdb-9f89-ff2b822196f7 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89" status: 200 len: 1697 microversion: 2.1 time: 0.577811 Aug 31 16:12:10.887676 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2199/4197] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:10 2022] GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89 => generated 1697 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:10.901051 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7f852371-c91b-4a9a-b888-2c4a5d1dd2cd tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:10.907150 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7f852371-c91b-4a9a-b888-2c4a5d1dd2cd tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] [instance: 4754015c-cda0-4f0a-9096-06bebe3d33b1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:10.937921 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f852371-c91b-4a9a-b888-2c4a5d1dd2cd tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:10.940174 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f852371-c91b-4a9a-b888-2c4a5d1dd2cd tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:10.940796 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f852371-c91b-4a9a-b888-2c4a5d1dd2cd tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:10.945860 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f852371-c91b-4a9a-b888-2c4a5d1dd2cd tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:10.946944 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f852371-c91b-4a9a-b888-2c4a5d1dd2cd tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:10.947635 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f852371-c91b-4a9a-b888-2c4a5d1dd2cd tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:11.463296 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7f852371-c91b-4a9a-b888-2c4a5d1dd2cd tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391c4c8e6ae4483e82a247957a6faad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1f95b9a87a4f1389c03f6a3f592a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:11.485527 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7f852371-c91b-4a9a-b888-2c4a5d1dd2cd tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] 10.222.0.50 "GET /compute/v2.1/servers/4754015c-cda0-4f0a-9096-06bebe3d33b1" status: 200 len: 1322 microversion: 2.1 time: 0.595850 Aug 31 16:12:11.491687 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2200/4198] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:10 2022] GET /compute/v2.1/servers/4754015c-cda0-4f0a-9096-06bebe3d33b1 => generated 1322 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:11.497654 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-efb628b4-5afd-476a-a735-f613ada01523 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '.version_select at 0x7fbb45f7a310>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:11.547416 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-efb628b4-5afd-476a-a735-f613ada01523 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-key-1344000419" status: 202 len: 0 microversion: 2.1 time: 0.054275 Aug 31 16:12:11.548379 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2201/4199] 10.222.0.50 () {58 vars in 1209 bytes} [Wed Aug 31 16:12:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1344000419 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:12:11.567153 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0a30ef30-839d-44db-94bf-ae40ed6ec603 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:11.568173 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0a30ef30-839d-44db-94bf-ae40ed6ec603 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 5923807d-1058-45ab-b8d1-c6700ea8c142] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:11.577001 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0a30ef30-839d-44db-94bf-ae40ed6ec603 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:11.577754 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0a30ef30-839d-44db-94bf-ae40ed6ec603 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:11.578332 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0a30ef30-839d-44db-94bf-ae40ed6ec603 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:11.589558 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0a30ef30-839d-44db-94bf-ae40ed6ec603 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:11.592541 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0a30ef30-839d-44db-94bf-ae40ed6ec603 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:11.593884 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0a30ef30-839d-44db-94bf-ae40ed6ec603 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:11.708578 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-739d0f1e-4963-471e-a81e-f89b5edecfef tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] [instance: da3e4266-a9bc-4433-a335-580713bac164] Building network info cache for instance {{(pid=128863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 31 16:12:11.979128 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0a30ef30-839d-44db-94bf-ae40ed6ec603 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:11.996111 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0a30ef30-839d-44db-94bf-ae40ed6ec603 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142" status: 200 len: 1473 microversion: 2.1 time: 0.446202 Aug 31 16:12:11.996798 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2202/4200] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:11 2022] GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142 => generated 1473 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:12.027711 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9ef1ee80-12fd-41f3-b974-2ad6ff0ecfdf tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:12.029235 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9ef1ee80-12fd-41f3-b974-2ad6ff0ecfdf tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: b60b7363-fd13-4b81-9c4b-0aabf39c5a6a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:12.040293 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ef1ee80-12fd-41f3-b974-2ad6ff0ecfdf tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:12.041041 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ef1ee80-12fd-41f3-b974-2ad6ff0ecfdf tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:12.041642 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ef1ee80-12fd-41f3-b974-2ad6ff0ecfdf tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:12.042547 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ef1ee80-12fd-41f3-b974-2ad6ff0ecfdf tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:12.043240 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ef1ee80-12fd-41f3-b974-2ad6ff0ecfdf tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:12.043878 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ef1ee80-12fd-41f3-b974-2ad6ff0ecfdf tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:12.433729 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9ef1ee80-12fd-41f3-b974-2ad6ff0ecfdf tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:12.452431 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9ef1ee80-12fd-41f3-b974-2ad6ff0ecfdf tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a" status: 200 len: 1517 microversion: 2.1 time: 0.433933 Aug 31 16:12:12.453921 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2203/4201] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:12 2022] GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a => generated 1517 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:12.476122 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-07aad679-c12d-4599-bc33-1fe1133c8c4b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:12.486428 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-07aad679-c12d-4599-bc33-1fe1133c8c4b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:12.495992 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-07aad679-c12d-4599-bc33-1fe1133c8c4b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:12.496474 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-07aad679-c12d-4599-bc33-1fe1133c8c4b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:12.498221 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-07aad679-c12d-4599-bc33-1fe1133c8c4b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:12.499119 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-07aad679-c12d-4599-bc33-1fe1133c8c4b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:12.499592 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-07aad679-c12d-4599-bc33-1fe1133c8c4b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:12.500234 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-07aad679-c12d-4599-bc33-1fe1133c8c4b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:12.783247 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-739d0f1e-4963-471e-a81e-f89b5edecfef tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] [instance: da3e4266-a9bc-4433-a335-580713bac164] Updating instance_info_cache with network_info: [{"id": "3fbcf647-bed8-4bd1-8cb6-2c28f9c026e1", "address": "fa:16:3e:86:67:8a", "network": {"id": "f6ace697-e44d-4f5a-951b-7b62351dd654", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-256068840-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "18b9eaf2ea58471390358e3d3c4a9689", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3fbcf647-be", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 31 16:12:12.786527 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-07aad679-c12d-4599-bc33-1fe1133c8c4b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:12.798725 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-07aad679-c12d-4599-bc33-1fe1133c8c4b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f" status: 200 len: 1521 microversion: 2.1 time: 0.335822 Aug 31 16:12:12.814524 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2204/4202] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:12 2022] GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f => generated 1521 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:12.819013 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-739d0f1e-4963-471e-a81e-f89b5edecfef tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Releasing lock "refresh_cache-da3e4266-a9bc-4433-a335-580713bac164" {{(pid=128863) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 16:12:12.820715 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-39644f8b-fdcd-43ce-b63c-3dc1fcf11e47 req-ea06751a-e700-4790-9009-92681884695e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6e41791-366b-4790-8338-2a52f4ebed89", "name": "network-vif-unplugged", "status": "completed", "tag": "0507378d-ba87-41ae-8199-9dd64dc20873"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:12.821597 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-739d0f1e-4963-471e-a81e-f89b5edecfef tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] 10.222.0.50 "POST /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164/action" status: 202 len: 0 microversion: 2.1 time: 4.491396 Aug 31 16:12:12.823020 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 1999/4203] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:12:08 2022] POST /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164/action => generated 0 bytes in 4495 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 31 16:12:12.833188 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-39644f8b-fdcd-43ce-b63c-3dc1fcf11e47 req-ea06751a-e700-4790-9009-92681884695e service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:12.833188 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-39644f8b-fdcd-43ce-b63c-3dc1fcf11e47 req-ea06751a-e700-4790-9009-92681884695e service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:12.833827 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-39644f8b-fdcd-43ce-b63c-3dc1fcf11e47 req-ea06751a-e700-4790-9009-92681884695e service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:12.841071 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-57de27ee-493b-4e71-89ff-09cfc87510db req-3f337cba-f872-45b0-92eb-34379c08d316 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4754015c-cda0-4f0a-9096-06bebe3d33b1", "name": "network-vif-plugged", "status": "completed", "tag": "814755c5-78ef-4411-a17e-1bef500926b3"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:12.855801 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-57de27ee-493b-4e71-89ff-09cfc87510db req-3f337cba-f872-45b0-92eb-34379c08d316 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:12.856777 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-57de27ee-493b-4e71-89ff-09cfc87510db req-3f337cba-f872-45b0-92eb-34379c08d316 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:12.857904 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-57de27ee-493b-4e71-89ff-09cfc87510db req-3f337cba-f872-45b0-92eb-34379c08d316 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:12.872010 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-39644f8b-fdcd-43ce-b63c-3dc1fcf11e47 req-ea06751a-e700-4790-9009-92681884695e service nova] Creating event network-vif-unplugged:0507378d-ba87-41ae-8199-9dd64dc20873 for instance f6e41791-366b-4790-8338-2a52f4ebed89 on n-h2-833090-16 Aug 31 16:12:12.875763 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-57de27ee-493b-4e71-89ff-09cfc87510db req-3f337cba-f872-45b0-92eb-34379c08d316 service nova] Creating event network-vif-plugged:814755c5-78ef-4411-a17e-1bef500926b3 for instance 4754015c-cda0-4f0a-9096-06bebe3d33b1 on n-h2-833090-16 Aug 31 16:12:12.876230 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:12:12.882245 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [req-39644f8b-fdcd-43ce-b63c-3dc1fcf11e47 req-ea06751a-e700-4790-9009-92681884695e service nova] Instance f6e41791-366b-4790-8338-2a52f4ebed89 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-833090-16', 'n-h1-833090-16'} {{(pid=128864) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 16:12:12.885346 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-57de27ee-493b-4e71-89ff-09cfc87510db req-3f337cba-f872-45b0-92eb-34379c08d316 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059257 Aug 31 16:12:12.887137 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2000/4204] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:12.898999 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-39644f8b-fdcd-43ce-b63c-3dc1fcf11e47 req-ea06751a-e700-4790-9009-92681884695e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082909 Aug 31 16:12:12.900371 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2205/4205] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:12.901543 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-54ec8a89-2035-42e6-8fcf-1c68b5bc029f req-fefc9fa0-6571-4e15-bed4-ac7f2fd688b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da3e4266-a9bc-4433-a335-580713bac164", "tag": "3fbcf647-bed8-4bd1-8cb6-2c28f9c026e1"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:12.908841 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fa60b2f8-b9c4-4ee3-b045-81403f4ae76d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1438125722", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "00194b7c-6891-4cf9-8c59-235de2b40a38"}]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:12.920443 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-54ec8a89-2035-42e6-8fcf-1c68b5bc029f req-fefc9fa0-6571-4e15-bed4-ac7f2fd688b8 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:12.923062 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-54ec8a89-2035-42e6-8fcf-1c68b5bc029f req-fefc9fa0-6571-4e15-bed4-ac7f2fd688b8 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:12.923574 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-54ec8a89-2035-42e6-8fcf-1c68b5bc029f req-fefc9fa0-6571-4e15-bed4-ac7f2fd688b8 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:12.967023 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-54ec8a89-2035-42e6-8fcf-1c68b5bc029f req-fefc9fa0-6571-4e15-bed4-ac7f2fd688b8 service nova] Creating event network-changed:3fbcf647-bed8-4bd1-8cb6-2c28f9c026e1 for instance da3e4266-a9bc-4433-a335-580713bac164 on n-h1-833090-16 Aug 31 16:12:12.979415 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-54ec8a89-2035-42e6-8fcf-1c68b5bc029f req-fefc9fa0-6571-4e15-bed4-ac7f2fd688b8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087949 Aug 31 16:12:12.980912 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2001/4206] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:13.002998 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-fa60b2f8-b9c4-4ee3-b045-81403f4ae76d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] validate_networks() for [('00194b7c-6891-4cf9-8c59-235de2b40a38', None, None, None, None, None)] {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:12:13.005134 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a1331e07-8495-4c37-b782-1fb62406a472 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:13.005854 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a1331e07-8495-4c37-b782-1fb62406a472 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: f6e41791-366b-4790-8338-2a52f4ebed89] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:13.026419 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1331e07-8495-4c37-b782-1fb62406a472 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:13.026598 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1331e07-8495-4c37-b782-1fb62406a472 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:13.034642 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1331e07-8495-4c37-b782-1fb62406a472 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:13.034642 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1331e07-8495-4c37-b782-1fb62406a472 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:13.034642 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1331e07-8495-4c37-b782-1fb62406a472 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:13.034642 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1331e07-8495-4c37-b782-1fb62406a472 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:14.066417 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a1331e07-8495-4c37-b782-1fb62406a472 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:14.076442 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a1331e07-8495-4c37-b782-1fb62406a472 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89" status: 200 len: 1696 microversion: 2.1 time: 1.094266 Aug 31 16:12:14.077806 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2002/4207] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:12 2022] GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89 => generated 1696 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:14.084928 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b1520cfa-9906-48f9-ac98-4ff7976e9c81 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:14.085698 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b1520cfa-9906-48f9-ac98-4ff7976e9c81 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] [instance: 4754015c-cda0-4f0a-9096-06bebe3d33b1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:14.103509 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1520cfa-9906-48f9-ac98-4ff7976e9c81 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:14.104512 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1520cfa-9906-48f9-ac98-4ff7976e9c81 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:14.105186 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1520cfa-9906-48f9-ac98-4ff7976e9c81 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:14.106240 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1520cfa-9906-48f9-ac98-4ff7976e9c81 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:14.106934 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1520cfa-9906-48f9-ac98-4ff7976e9c81 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:14.107539 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b1520cfa-9906-48f9-ac98-4ff7976e9c81 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:14.404048 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b1520cfa-9906-48f9-ac98-4ff7976e9c81 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391c4c8e6ae4483e82a247957a6faad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1f95b9a87a4f1389c03f6a3f592a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:14.413019 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b1520cfa-9906-48f9-ac98-4ff7976e9c81 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] 10.222.0.50 "GET /compute/v2.1/servers/4754015c-cda0-4f0a-9096-06bebe3d33b1" status: 200 len: 1322 microversion: 2.1 time: 0.333837 Aug 31 16:12:14.413995 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2003/4208] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:14 2022] GET /compute/v2.1/servers/4754015c-cda0-4f0a-9096-06bebe3d33b1 => generated 1322 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:14.430880 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8efa2fd4-640b-4e8c-bc1d-5b1d50441038 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.241"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:14.565714 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-fa60b2f8-b9c4-4ee3-b045-81403f4ae76d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:12:14.566610 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-fa60b2f8-b9c4-4ee3-b045-81403f4ae76d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:12:14.567180 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-fa60b2f8-b9c4-4ee3-b045-81403f4ae76d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:12:14.568035 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-fa60b2f8-b9c4-4ee3-b045-81403f4ae76d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:12:14.568513 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-fa60b2f8-b9c4-4ee3-b045-81403f4ae76d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:12:14.581510 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fa60b2f8-b9c4-4ee3-b045-81403f4ae76d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:14.582153 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fa60b2f8-b9c4-4ee3-b045-81403f4ae76d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:14.582707 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fa60b2f8-b9c4-4ee3-b045-81403f4ae76d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:14.583541 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fa60b2f8-b9c4-4ee3-b045-81403f4ae76d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:14.583993 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fa60b2f8-b9c4-4ee3-b045-81403f4ae76d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:14.584412 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fa60b2f8-b9c4-4ee3-b045-81403f4ae76d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:14.621027 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-fa60b2f8-b9c4-4ee3-b045-81403f4ae76d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Getting quotas for project 84f42648e1a343b9a5ab9b89c91bea0d. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:12:14.632907 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-fa60b2f8-b9c4-4ee3-b045-81403f4ae76d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Getting quotas for user 3ebce87993504550914c2c3702eebb17 and project 84f42648e1a343b9a5ab9b89c91bea0d. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:12:14.650562 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fa60b2f8-b9c4-4ee3-b045-81403f4ae76d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:12:14.653851 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fa60b2f8-b9c4-4ee3-b045-81403f4ae76d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: eb6e0169-ac40-4675-b6e9-2a3ea7b13f40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:12:14.712576 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fa60b2f8-b9c4-4ee3-b045-81403f4ae76d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.810221 Aug 31 16:12:14.713558 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2206/4209] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:12:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:12:14.719744 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-318afc03-d426-4d8c-8206-bde203fff2bb tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:14.726789 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-318afc03-d426-4d8c-8206-bde203fff2bb tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 5923807d-1058-45ab-b8d1-c6700ea8c142] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:14.742926 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-318afc03-d426-4d8c-8206-bde203fff2bb tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:14.744210 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-318afc03-d426-4d8c-8206-bde203fff2bb tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:14.745357 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-318afc03-d426-4d8c-8206-bde203fff2bb tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:14.746423 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-318afc03-d426-4d8c-8206-bde203fff2bb tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:14.747784 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-318afc03-d426-4d8c-8206-bde203fff2bb tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:14.748377 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-318afc03-d426-4d8c-8206-bde203fff2bb tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:14.759349 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8efa2fd4-640b-4e8c-bc1d-5b1d50441038 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] [instance: da3e4266-a9bc-4433-a335-580713bac164] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:14.769351 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8efa2fd4-640b-4e8c-bc1d-5b1d50441038 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:14.770082 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8efa2fd4-640b-4e8c-bc1d-5b1d50441038 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:14.770702 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8efa2fd4-640b-4e8c-bc1d-5b1d50441038 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:14.772026 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8efa2fd4-640b-4e8c-bc1d-5b1d50441038 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:14.772026 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8efa2fd4-640b-4e8c-bc1d-5b1d50441038 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:14.775733 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8efa2fd4-640b-4e8c-bc1d-5b1d50441038 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:15.087378 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-318afc03-d426-4d8c-8206-bde203fff2bb tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:15.099770 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-318afc03-d426-4d8c-8206-bde203fff2bb tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142" status: 200 len: 1473 microversion: 2.1 time: 0.385133 Aug 31 16:12:15.101028 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2207/4210] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:14 2022] GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142 => generated 1473 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:15.114063 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-823830bd-acaf-464a-bb37-005408251505 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:15.115617 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-823830bd-acaf-464a-bb37-005408251505 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: b60b7363-fd13-4b81-9c4b-0aabf39c5a6a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:15.123557 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-823830bd-acaf-464a-bb37-005408251505 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:15.124125 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-823830bd-acaf-464a-bb37-005408251505 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:15.124708 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-823830bd-acaf-464a-bb37-005408251505 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:15.125386 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-823830bd-acaf-464a-bb37-005408251505 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:15.125895 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-823830bd-acaf-464a-bb37-005408251505 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:15.126402 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-823830bd-acaf-464a-bb37-005408251505 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:15.223417 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8efa2fd4-640b-4e8c-bc1d-5b1d50441038 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "refresh_cache-da3e4266-a9bc-4433-a335-580713bac164" {{(pid=128863) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 31 16:12:15.224629 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8efa2fd4-640b-4e8c-bc1d-5b1d50441038 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquired lock "refresh_cache-da3e4266-a9bc-4433-a335-580713bac164" {{(pid=128863) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 31 16:12:15.484222 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-823830bd-acaf-464a-bb37-005408251505 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:15.507791 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-823830bd-acaf-464a-bb37-005408251505 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a" status: 200 len: 1517 microversion: 2.1 time: 0.405248 Aug 31 16:12:15.508771 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2208/4211] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:15 2022] GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a => generated 1517 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:15.517374 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-aeda5e2d-bc25-46ff-ba22-4650ea1ccabd tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:15.518497 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-aeda5e2d-bc25-46ff-ba22-4650ea1ccabd tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:15.533528 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aeda5e2d-bc25-46ff-ba22-4650ea1ccabd tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:15.534249 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aeda5e2d-bc25-46ff-ba22-4650ea1ccabd tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:15.534807 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aeda5e2d-bc25-46ff-ba22-4650ea1ccabd tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:15.535910 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aeda5e2d-bc25-46ff-ba22-4650ea1ccabd tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:15.536480 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aeda5e2d-bc25-46ff-ba22-4650ea1ccabd tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:15.537061 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aeda5e2d-bc25-46ff-ba22-4650ea1ccabd tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:15.851849 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-aeda5e2d-bc25-46ff-ba22-4650ea1ccabd tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:15.870318 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-aeda5e2d-bc25-46ff-ba22-4650ea1ccabd tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f" status: 200 len: 1521 microversion: 2.1 time: 0.359986 Aug 31 16:12:15.871246 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2209/4212] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:15 2022] GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f => generated 1521 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:15.876534 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9535c44b-53a3-4b23-8b1c-af7784786df1 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:15.877281 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9535c44b-53a3-4b23-8b1c-af7784786df1 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: eb6e0169-ac40-4675-b6e9-2a3ea7b13f40] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:15.895700 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9535c44b-53a3-4b23-8b1c-af7784786df1 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:15.896189 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9535c44b-53a3-4b23-8b1c-af7784786df1 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:15.896888 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9535c44b-53a3-4b23-8b1c-af7784786df1 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:15.897750 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9535c44b-53a3-4b23-8b1c-af7784786df1 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:15.899197 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9535c44b-53a3-4b23-8b1c-af7784786df1 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:15.899865 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9535c44b-53a3-4b23-8b1c-af7784786df1 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:16.004379 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9535c44b-53a3-4b23-8b1c-af7784786df1 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:16.013579 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9535c44b-53a3-4b23-8b1c-af7784786df1 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/eb6e0169-ac40-4675-b6e9-2a3ea7b13f40" status: 200 len: 1261 microversion: 2.1 time: 0.140371 Aug 31 16:12:16.014236 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2210/4213] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:15 2022] GET /compute/v2.1/servers/eb6e0169-ac40-4675-b6e9-2a3ea7b13f40 => generated 1261 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:16.020045 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-66be99fe-cab8-4ddf-9eb3-2c7f0dae9642 req-d1681c9b-86ef-4a1c-b9bb-c9e8b39b9fef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6e41791-366b-4790-8338-2a52f4ebed89", "tag": "0507378d-ba87-41ae-8199-9dd64dc20873"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:16.030898 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-66be99fe-cab8-4ddf-9eb3-2c7f0dae9642 req-d1681c9b-86ef-4a1c-b9bb-c9e8b39b9fef service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:16.031657 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-66be99fe-cab8-4ddf-9eb3-2c7f0dae9642 req-d1681c9b-86ef-4a1c-b9bb-c9e8b39b9fef service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:16.032259 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-66be99fe-cab8-4ddf-9eb3-2c7f0dae9642 req-d1681c9b-86ef-4a1c-b9bb-c9e8b39b9fef service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:16.048457 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-66be99fe-cab8-4ddf-9eb3-2c7f0dae9642 req-d1681c9b-86ef-4a1c-b9bb-c9e8b39b9fef service nova] Creating event network-changed:0507378d-ba87-41ae-8199-9dd64dc20873 for instance f6e41791-366b-4790-8338-2a52f4ebed89 on n-h2-833090-16 Aug 31 16:12:16.054780 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [req-66be99fe-cab8-4ddf-9eb3-2c7f0dae9642 req-d1681c9b-86ef-4a1c-b9bb-c9e8b39b9fef service nova] Instance f6e41791-366b-4790-8338-2a52f4ebed89 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-833090-16', 'n-h1-833090-16'} {{(pid=128864) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 16:12:16.067037 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-66be99fe-cab8-4ddf-9eb3-2c7f0dae9642 req-d1681c9b-86ef-4a1c-b9bb-c9e8b39b9fef service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051369 Aug 31 16:12:16.067750 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2211/4214] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:12:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:16.078501 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-319043b4-b4d2-4b32-a505-99a2e11ac1ad tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:16.078981 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-319043b4-b4d2-4b32-a505-99a2e11ac1ad tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: f6e41791-366b-4790-8338-2a52f4ebed89] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:16.087387 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-319043b4-b4d2-4b32-a505-99a2e11ac1ad tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:16.087387 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-319043b4-b4d2-4b32-a505-99a2e11ac1ad tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:16.087387 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-319043b4-b4d2-4b32-a505-99a2e11ac1ad tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:16.088025 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-319043b4-b4d2-4b32-a505-99a2e11ac1ad tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:16.088496 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-319043b4-b4d2-4b32-a505-99a2e11ac1ad tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:16.088916 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-319043b4-b4d2-4b32-a505-99a2e11ac1ad tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:16.310958 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-8efa2fd4-640b-4e8c-bc1d-5b1d50441038 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] [instance: da3e4266-a9bc-4433-a335-580713bac164] Building network info cache for instance {{(pid=128863) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 31 16:12:16.540279 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-319043b4-b4d2-4b32-a505-99a2e11ac1ad tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:16.548956 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-319043b4-b4d2-4b32-a505-99a2e11ac1ad tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89" status: 200 len: 1694 microversion: 2.1 time: 0.477396 Aug 31 16:12:16.562758 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2212/4215] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:16 2022] GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89 => generated 1694 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:16.574780 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a017c754-01f4-4014-a0a1-d925a4e45fc5 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:16.575514 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a017c754-01f4-4014-a0a1-d925a4e45fc5 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] [instance: 4754015c-cda0-4f0a-9096-06bebe3d33b1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:16.593634 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a017c754-01f4-4014-a0a1-d925a4e45fc5 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:16.594385 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a017c754-01f4-4014-a0a1-d925a4e45fc5 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:16.594832 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a017c754-01f4-4014-a0a1-d925a4e45fc5 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:16.598978 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a017c754-01f4-4014-a0a1-d925a4e45fc5 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:16.599467 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a017c754-01f4-4014-a0a1-d925a4e45fc5 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:16.599901 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a017c754-01f4-4014-a0a1-d925a4e45fc5 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:17.064825 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a017c754-01f4-4014-a0a1-d925a4e45fc5 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391c4c8e6ae4483e82a247957a6faad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1f95b9a87a4f1389c03f6a3f592a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:17.076761 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a017c754-01f4-4014-a0a1-d925a4e45fc5 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] 10.222.0.50 "GET /compute/v2.1/servers/4754015c-cda0-4f0a-9096-06bebe3d33b1" status: 200 len: 1515 microversion: 2.1 time: 0.512673 Aug 31 16:12:17.078085 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2213/4216] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:16 2022] GET /compute/v2.1/servers/4754015c-cda0-4f0a-9096-06bebe3d33b1 => generated 1515 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:17.093257 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5209fb43-8bec-4fcc-8888-ee8d29807c80 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:17.094335 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5209fb43-8bec-4fcc-8888-ee8d29807c80 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 5923807d-1058-45ab-b8d1-c6700ea8c142] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:17.104081 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5209fb43-8bec-4fcc-8888-ee8d29807c80 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:17.104859 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5209fb43-8bec-4fcc-8888-ee8d29807c80 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:17.105532 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5209fb43-8bec-4fcc-8888-ee8d29807c80 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:17.111877 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5209fb43-8bec-4fcc-8888-ee8d29807c80 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:17.112727 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5209fb43-8bec-4fcc-8888-ee8d29807c80 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:17.113387 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5209fb43-8bec-4fcc-8888-ee8d29807c80 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:18.009917 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5209fb43-8bec-4fcc-8888-ee8d29807c80 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:18.025634 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5209fb43-8bec-4fcc-8888-ee8d29807c80 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142" status: 200 len: 1473 microversion: 2.1 time: 0.944519 Aug 31 16:12:18.027275 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2214/4217] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:17 2022] GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142 => generated 1473 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:18.036009 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-b665a6fe-d0c3-465a-9ffa-910cd7c7ce76 req-b0c9d89e-8a98-405c-a14a-cceddb2db8c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da3e4266-a9bc-4433-a335-580713bac164", "tag": "3fbcf647-bed8-4bd1-8cb6-2c28f9c026e1"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:18.049888 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-b665a6fe-d0c3-465a-9ffa-910cd7c7ce76 req-b0c9d89e-8a98-405c-a14a-cceddb2db8c0 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:18.050880 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-b665a6fe-d0c3-465a-9ffa-910cd7c7ce76 req-b0c9d89e-8a98-405c-a14a-cceddb2db8c0 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:18.051452 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-b665a6fe-d0c3-465a-9ffa-910cd7c7ce76 req-b0c9d89e-8a98-405c-a14a-cceddb2db8c0 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:18.088040 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-b665a6fe-d0c3-465a-9ffa-910cd7c7ce76 req-b0c9d89e-8a98-405c-a14a-cceddb2db8c0 service nova] Creating event network-changed:3fbcf647-bed8-4bd1-8cb6-2c28f9c026e1 for instance da3e4266-a9bc-4433-a335-580713bac164 on n-h1-833090-16 Aug 31 16:12:18.099053 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-b665a6fe-d0c3-465a-9ffa-910cd7c7ce76 req-b0c9d89e-8a98-405c-a14a-cceddb2db8c0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069618 Aug 31 16:12:18.100590 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2215/4218] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:12:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:18.132120 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b6b353b5-dfa0-4d88-8e48-4d5bbb65220a tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:18.133662 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b6b353b5-dfa0-4d88-8e48-4d5bbb65220a tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: b60b7363-fd13-4b81-9c4b-0aabf39c5a6a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:18.170391 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b6b353b5-dfa0-4d88-8e48-4d5bbb65220a tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:18.173140 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b6b353b5-dfa0-4d88-8e48-4d5bbb65220a tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:18.173583 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b6b353b5-dfa0-4d88-8e48-4d5bbb65220a tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:18.177937 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b6b353b5-dfa0-4d88-8e48-4d5bbb65220a tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:18.180557 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b6b353b5-dfa0-4d88-8e48-4d5bbb65220a tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:18.182794 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b6b353b5-dfa0-4d88-8e48-4d5bbb65220a tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:18.483245 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-8efa2fd4-640b-4e8c-bc1d-5b1d50441038 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] [instance: da3e4266-a9bc-4433-a335-580713bac164] Updating instance_info_cache with network_info: [{"id": "3fbcf647-bed8-4bd1-8cb6-2c28f9c026e1", "address": "fa:16:3e:86:67:8a", "network": {"id": "f6ace697-e44d-4f5a-951b-7b62351dd654", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-256068840-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "18b9eaf2ea58471390358e3d3c4a9689", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3fbcf647-be", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128863) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 31 16:12:18.507696 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8efa2fd4-640b-4e8c-bc1d-5b1d50441038 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Releasing lock "refresh_cache-da3e4266-a9bc-4433-a335-580713bac164" {{(pid=128863) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 31 16:12:18.508914 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8efa2fd4-640b-4e8c-bc1d-5b1d50441038 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] 10.222.0.50 "POST /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164/action" status: 202 len: 0 microversion: 2.1 time: 4.083828 Aug 31 16:12:18.509794 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2004/4219] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:12:14 2022] POST /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164/action => generated 0 bytes in 4095 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 31 16:12:18.534028 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-16694d75-011c-43b5-9877-f1ac05ac3298 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:18.539097 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-16694d75-011c-43b5-9877-f1ac05ac3298 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:18.558730 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16694d75-011c-43b5-9877-f1ac05ac3298 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:18.559327 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16694d75-011c-43b5-9877-f1ac05ac3298 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:18.559775 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16694d75-011c-43b5-9877-f1ac05ac3298 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:18.560457 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16694d75-011c-43b5-9877-f1ac05ac3298 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:18.560895 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16694d75-011c-43b5-9877-f1ac05ac3298 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:18.561312 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16694d75-011c-43b5-9877-f1ac05ac3298 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:18.673604 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b6b353b5-dfa0-4d88-8e48-4d5bbb65220a tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:18.697477 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b6b353b5-dfa0-4d88-8e48-4d5bbb65220a tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a" status: 200 len: 1517 microversion: 2.1 time: 0.594164 Aug 31 16:12:18.702860 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2216/4220] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:18 2022] GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a => generated 1517 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:18.719515 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-708adf79-1a48-4e7c-b44e-b2c0bfe8bd7a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:18.720395 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-708adf79-1a48-4e7c-b44e-b2c0bfe8bd7a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: eb6e0169-ac40-4675-b6e9-2a3ea7b13f40] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:18.741358 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-708adf79-1a48-4e7c-b44e-b2c0bfe8bd7a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:18.741860 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-708adf79-1a48-4e7c-b44e-b2c0bfe8bd7a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:18.748282 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-708adf79-1a48-4e7c-b44e-b2c0bfe8bd7a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:18.752859 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-708adf79-1a48-4e7c-b44e-b2c0bfe8bd7a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:18.753606 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-708adf79-1a48-4e7c-b44e-b2c0bfe8bd7a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:18.755959 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-708adf79-1a48-4e7c-b44e-b2c0bfe8bd7a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:19.301496 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-708adf79-1a48-4e7c-b44e-b2c0bfe8bd7a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:19.322120 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-708adf79-1a48-4e7c-b44e-b2c0bfe8bd7a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/eb6e0169-ac40-4675-b6e9-2a3ea7b13f40" status: 200 len: 1309 microversion: 2.1 time: 0.616137 Aug 31 16:12:19.322770 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2217/4221] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:18 2022] GET /compute/v2.1/servers/eb6e0169-ac40-4675-b6e9-2a3ea7b13f40 => generated 1309 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:19.334202 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-16694d75-011c-43b5-9877-f1ac05ac3298 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:19.346491 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-15bf992f-ad8a-4c02-bf6b-3779f8477058 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:19.347161 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-15bf992f-ad8a-4c02-bf6b-3779f8477058 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] [instance: b778dc34-fa8e-4c9e-9cb6-5ececdf1074c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:19.355556 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-15bf992f-ad8a-4c02-bf6b-3779f8477058 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:19.356282 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-15bf992f-ad8a-4c02-bf6b-3779f8477058 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:19.356797 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-15bf992f-ad8a-4c02-bf6b-3779f8477058 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:19.357561 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-15bf992f-ad8a-4c02-bf6b-3779f8477058 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:19.358064 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-15bf992f-ad8a-4c02-bf6b-3779f8477058 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:19.358500 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-16694d75-011c-43b5-9877-f1ac05ac3298 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f" status: 200 len: 1521 microversion: 2.1 time: 0.841040 Aug 31 16:12:19.359973 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-15bf992f-ad8a-4c02-bf6b-3779f8477058 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:19.362254 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2005/4222] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:18 2022] GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f => generated 1521 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:19.369490 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-86e47b76-f256-4d2b-9e08-8be9086825b1 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:19.375504 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-86e47b76-f256-4d2b-9e08-8be9086825b1 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: f6e41791-366b-4790-8338-2a52f4ebed89] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:19.393109 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86e47b76-f256-4d2b-9e08-8be9086825b1 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:19.394364 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86e47b76-f256-4d2b-9e08-8be9086825b1 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:19.399215 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86e47b76-f256-4d2b-9e08-8be9086825b1 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:19.400151 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86e47b76-f256-4d2b-9e08-8be9086825b1 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:19.400743 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86e47b76-f256-4d2b-9e08-8be9086825b1 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:19.401286 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86e47b76-f256-4d2b-9e08-8be9086825b1 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:19.444862 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:12:19.829350 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-15bf992f-ad8a-4c02-bf6b-3779f8477058 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391c4c8e6ae4483e82a247957a6faad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1f95b9a87a4f1389c03f6a3f592a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:19.845677 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-15bf992f-ad8a-4c02-bf6b-3779f8477058 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] 10.222.0.50 "GET /compute/v2.1/servers/b778dc34-fa8e-4c9e-9cb6-5ececdf1074c" status: 200 len: 1515 microversion: 2.1 time: 0.516317 Aug 31 16:12:19.846058 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-86e47b76-f256-4d2b-9e08-8be9086825b1 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:19.848312 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2218/4223] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:19 2022] GET /compute/v2.1/servers/b778dc34-fa8e-4c9e-9cb6-5ececdf1074c => generated 1515 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:19.854730 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0fe804b9-1e1b-47c7-8558-0e67336eb2c0 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Calling method '.version_select at 0x7fbb4ac528b0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:19.861668 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-86e47b76-f256-4d2b-9e08-8be9086825b1 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89" status: 200 len: 1694 microversion: 2.1 time: 0.498182 Aug 31 16:12:19.862482 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2006/4224] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:19 2022] GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89 => generated 1694 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:19.870884 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-01c1e347-91bc-4999-8816-ef29a3b47d09 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:19.876371 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-01c1e347-91bc-4999-8816-ef29a3b47d09 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 5923807d-1058-45ab-b8d1-c6700ea8c142] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:19.894464 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01c1e347-91bc-4999-8816-ef29a3b47d09 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:19.895039 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01c1e347-91bc-4999-8816-ef29a3b47d09 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:19.895507 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01c1e347-91bc-4999-8816-ef29a3b47d09 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:19.896257 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01c1e347-91bc-4999-8816-ef29a3b47d09 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:19.896740 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01c1e347-91bc-4999-8816-ef29a3b47d09 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:19.897194 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01c1e347-91bc-4999-8816-ef29a3b47d09 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:20.301935 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-01c1e347-91bc-4999-8816-ef29a3b47d09 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:20.320119 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-01c1e347-91bc-4999-8816-ef29a3b47d09 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142" status: 200 len: 1473 microversion: 2.1 time: 0.456072 Aug 31 16:12:20.334894 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2007/4225] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:19 2022] GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142 => generated 1473 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:20.346822 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-265532eb-394d-4fd0-a581-639ee4618041 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:20.347635 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-265532eb-394d-4fd0-a581-639ee4618041 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: b60b7363-fd13-4b81-9c4b-0aabf39c5a6a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:20.357791 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-265532eb-394d-4fd0-a581-639ee4618041 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:20.358486 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-265532eb-394d-4fd0-a581-639ee4618041 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:20.359749 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-265532eb-394d-4fd0-a581-639ee4618041 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:20.360818 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-265532eb-394d-4fd0-a581-639ee4618041 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:20.361647 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-265532eb-394d-4fd0-a581-639ee4618041 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:20.362349 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-265532eb-394d-4fd0-a581-639ee4618041 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:20.773218 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-265532eb-394d-4fd0-a581-639ee4618041 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:20.783682 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-265532eb-394d-4fd0-a581-639ee4618041 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a" status: 200 len: 1517 microversion: 2.1 time: 0.446399 Aug 31 16:12:20.784665 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2008/4226] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:20 2022] GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a => generated 1517 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:20.790253 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d478068f-550d-46bb-823e-57ce7cc116cc tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:20.790556 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d478068f-550d-46bb-823e-57ce7cc116cc tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] [instance: b778dc34-fa8e-4c9e-9cb6-5ececdf1074c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:20.799556 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d478068f-550d-46bb-823e-57ce7cc116cc tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:20.799556 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d478068f-550d-46bb-823e-57ce7cc116cc tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:20.800145 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d478068f-550d-46bb-823e-57ce7cc116cc tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:20.800908 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d478068f-550d-46bb-823e-57ce7cc116cc tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:20.801546 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d478068f-550d-46bb-823e-57ce7cc116cc tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:20.801972 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d478068f-550d-46bb-823e-57ce7cc116cc tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:20.830228 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d478068f-550d-46bb-823e-57ce7cc116cc tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] [instance: b778dc34-fa8e-4c9e-9cb6-5ececdf1074c] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:12:20.943648 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d478068f-550d-46bb-823e-57ce7cc116cc tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b778dc34-fa8e-4c9e-9cb6-5ececdf1074c" status: 204 len: 0 microversion: 2.1 time: 0.157417 Aug 31 16:12:20.944596 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2009/4227] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:12:20 2022] DELETE /compute/v2.1/servers/b778dc34-fa8e-4c9e-9cb6-5ececdf1074c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:12:20.955237 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7d0d0554-0918-44ca-8e92-fe50fc75dfd2 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:20.955936 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7d0d0554-0918-44ca-8e92-fe50fc75dfd2 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: eb6e0169-ac40-4675-b6e9-2a3ea7b13f40] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:20.962645 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d0d0554-0918-44ca-8e92-fe50fc75dfd2 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:20.963127 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d0d0554-0918-44ca-8e92-fe50fc75dfd2 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:20.963551 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d0d0554-0918-44ca-8e92-fe50fc75dfd2 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:20.964246 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d0d0554-0918-44ca-8e92-fe50fc75dfd2 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:20.964687 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d0d0554-0918-44ca-8e92-fe50fc75dfd2 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:20.965321 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d0d0554-0918-44ca-8e92-fe50fc75dfd2 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:21.294411 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7d0d0554-0918-44ca-8e92-fe50fc75dfd2 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:21.304068 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7d0d0554-0918-44ca-8e92-fe50fc75dfd2 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/eb6e0169-ac40-4675-b6e9-2a3ea7b13f40" status: 200 len: 1309 microversion: 2.1 time: 0.357933 Aug 31 16:12:21.304933 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2010/4228] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:20 2022] GET /compute/v2.1/servers/eb6e0169-ac40-4675-b6e9-2a3ea7b13f40 => generated 1309 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:21.311569 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8f73117c-9068-4911-8737-25b058c545ff tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:21.312536 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8f73117c-9068-4911-8737-25b058c545ff tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:21.321332 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f73117c-9068-4911-8737-25b058c545ff tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:21.322053 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f73117c-9068-4911-8737-25b058c545ff tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:21.322840 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f73117c-9068-4911-8737-25b058c545ff tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:21.323738 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f73117c-9068-4911-8737-25b058c545ff tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:21.324363 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f73117c-9068-4911-8737-25b058c545ff tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:21.325615 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f73117c-9068-4911-8737-25b058c545ff tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:21.648318 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8f73117c-9068-4911-8737-25b058c545ff tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:21.658998 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8f73117c-9068-4911-8737-25b058c545ff tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f" status: 200 len: 1521 microversion: 2.1 time: 0.352536 Aug 31 16:12:21.659603 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2011/4229] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:21 2022] GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f => generated 1521 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:21.671265 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e1680859-1537-4a21-a293-7d52ab8dfe01 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:21.671265 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e1680859-1537-4a21-a293-7d52ab8dfe01 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: f6e41791-366b-4790-8338-2a52f4ebed89] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:21.672518 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e1680859-1537-4a21-a293-7d52ab8dfe01 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:21.673011 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e1680859-1537-4a21-a293-7d52ab8dfe01 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:21.673444 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e1680859-1537-4a21-a293-7d52ab8dfe01 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:21.674775 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e1680859-1537-4a21-a293-7d52ab8dfe01 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:21.675234 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e1680859-1537-4a21-a293-7d52ab8dfe01 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:21.675650 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e1680859-1537-4a21-a293-7d52ab8dfe01 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:21.729428 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0fe804b9-1e1b-47c7-8558-0e67336eb2c0 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/382fcbbc-057a-4b56-8875-0c8ee24f2b85" status: 202 len: 0 microversion: 2.1 time: 1.879396 Aug 31 16:12:21.730014 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2219/4230] 10.222.0.50 () {58 vars in 1263 bytes} [Wed Aug 31 16:12:19 2022] DELETE /compute/v2.1/os-floating-ips/382fcbbc-057a-4b56-8875-0c8ee24f2b85 => generated 0 bytes in 1881 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:12:21.735523 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1e690ec1-4761-4100-945f-f7de541d4590 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:21.736402 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1e690ec1-4761-4100-945f-f7de541d4590 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] [instance: b778dc34-fa8e-4c9e-9cb6-5ececdf1074c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:21.744318 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e690ec1-4761-4100-945f-f7de541d4590 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:21.745031 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e690ec1-4761-4100-945f-f7de541d4590 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:21.745484 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e690ec1-4761-4100-945f-f7de541d4590 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:21.746215 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e690ec1-4761-4100-945f-f7de541d4590 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:21.746885 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e690ec1-4761-4100-945f-f7de541d4590 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:21.747504 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e690ec1-4761-4100-945f-f7de541d4590 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:21.969933 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e1680859-1537-4a21-a293-7d52ab8dfe01 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:21.980836 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e1680859-1537-4a21-a293-7d52ab8dfe01 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89" status: 200 len: 1694 microversion: 2.1 time: 0.320151 Aug 31 16:12:21.982345 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2012/4231] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:21 2022] GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89 => generated 1694 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:21.989421 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-3df69236-87ff-484c-b2fe-ef8221e0bfaa req-701dfa05-57ed-4e96-986a-04ed9399ca17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb6e0169-ac40-4675-b6e9-2a3ea7b13f40", "tag": "54ca58a1-2958-4476-a9f8-df32a84cc26a"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:22.003508 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3df69236-87ff-484c-b2fe-ef8221e0bfaa req-701dfa05-57ed-4e96-986a-04ed9399ca17 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:22.004138 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3df69236-87ff-484c-b2fe-ef8221e0bfaa req-701dfa05-57ed-4e96-986a-04ed9399ca17 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:22.004570 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3df69236-87ff-484c-b2fe-ef8221e0bfaa req-701dfa05-57ed-4e96-986a-04ed9399ca17 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:22.020250 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-3df69236-87ff-484c-b2fe-ef8221e0bfaa req-701dfa05-57ed-4e96-986a-04ed9399ca17 service nova] Creating event network-changed:54ca58a1-2958-4476-a9f8-df32a84cc26a for instance eb6e0169-ac40-4675-b6e9-2a3ea7b13f40 on n-h1-833090-16 Aug 31 16:12:22.026138 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-3df69236-87ff-484c-b2fe-ef8221e0bfaa req-701dfa05-57ed-4e96-986a-04ed9399ca17 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041358 Aug 31 16:12:22.026970 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2013/4232] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:12:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:22.030304 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1e690ec1-4761-4100-945f-f7de541d4590 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391c4c8e6ae4483e82a247957a6faad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1f95b9a87a4f1389c03f6a3f592a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:22.034415 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8a5e3870-3672-4cad-a6ff-2d7ee5096c51 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:22.035491 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8a5e3870-3672-4cad-a6ff-2d7ee5096c51 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 5923807d-1058-45ab-b8d1-c6700ea8c142] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:22.040696 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1e690ec1-4761-4100-945f-f7de541d4590 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] 10.222.0.50 "GET /compute/v2.1/servers/b778dc34-fa8e-4c9e-9cb6-5ececdf1074c" status: 200 len: 1521 microversion: 2.1 time: 0.308766 Aug 31 16:12:22.042142 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2220/4233] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:21 2022] GET /compute/v2.1/servers/b778dc34-fa8e-4c9e-9cb6-5ececdf1074c => generated 1521 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:22.047110 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a5e3870-3672-4cad-a6ff-2d7ee5096c51 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:22.047330 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4c31191f-2d60-494d-9ddc-de6f1f01cdb0 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Calling method '.version_select at 0x7fbb467528b0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:22.048099 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a5e3870-3672-4cad-a6ff-2d7ee5096c51 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:22.048634 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a5e3870-3672-4cad-a6ff-2d7ee5096c51 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:22.049438 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a5e3870-3672-4cad-a6ff-2d7ee5096c51 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:22.049990 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a5e3870-3672-4cad-a6ff-2d7ee5096c51 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:22.050552 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a5e3870-3672-4cad-a6ff-2d7ee5096c51 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:22.316922 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8a5e3870-3672-4cad-a6ff-2d7ee5096c51 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:22.327104 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8a5e3870-3672-4cad-a6ff-2d7ee5096c51 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142" status: 200 len: 1473 microversion: 2.1 time: 0.297800 Aug 31 16:12:22.330603 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2014/4234] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:22 2022] GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142 => generated 1473 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:22.339057 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d4c5640c-4d85-47f5-b7fc-e35203e48d35 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:22.339961 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d4c5640c-4d85-47f5-b7fc-e35203e48d35 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: b60b7363-fd13-4b81-9c4b-0aabf39c5a6a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:22.358971 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4c5640c-4d85-47f5-b7fc-e35203e48d35 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:22.367531 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4c31191f-2d60-494d-9ddc-de6f1f01cdb0 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/e5e57a91-b3c0-4dc5-9cc4-04883dd76420" status: 202 len: 0 microversion: 2.1 time: 0.323974 Aug 31 16:12:22.371484 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4c5640c-4d85-47f5-b7fc-e35203e48d35 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:22.371484 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4c5640c-4d85-47f5-b7fc-e35203e48d35 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:22.371484 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4c5640c-4d85-47f5-b7fc-e35203e48d35 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:22.371484 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4c5640c-4d85-47f5-b7fc-e35203e48d35 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:22.371484 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4c5640c-4d85-47f5-b7fc-e35203e48d35 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:22.374399 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2221/4235] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 31 16:12:22 2022] DELETE /compute/v2.1/os-security-groups/e5e57a91-b3c0-4dc5-9cc4-04883dd76420 => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:12:22.382955 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5b195f52-d2c2-4648-8c5b-2eb167a8f04b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:22.383716 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5b195f52-d2c2-4648-8c5b-2eb167a8f04b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: eb6e0169-ac40-4675-b6e9-2a3ea7b13f40] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:22.394321 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5b195f52-d2c2-4648-8c5b-2eb167a8f04b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:22.395906 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5b195f52-d2c2-4648-8c5b-2eb167a8f04b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:22.397329 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5b195f52-d2c2-4648-8c5b-2eb167a8f04b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:22.399349 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5b195f52-d2c2-4648-8c5b-2eb167a8f04b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:22.400176 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5b195f52-d2c2-4648-8c5b-2eb167a8f04b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:22.400577 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5b195f52-d2c2-4648-8c5b-2eb167a8f04b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:22.599362 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d4c5640c-4d85-47f5-b7fc-e35203e48d35 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:22.610443 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d4c5640c-4d85-47f5-b7fc-e35203e48d35 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a" status: 200 len: 1517 microversion: 2.1 time: 0.275497 Aug 31 16:12:22.611161 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2015/4236] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:22 2022] GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a => generated 1517 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:22.616227 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7b0d7c47-f69d-4bc6-a010-7c65feacd857 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:22.616809 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7b0d7c47-f69d-4bc6-a010-7c65feacd857 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] [instance: da3e4266-a9bc-4433-a335-580713bac164] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:22.624520 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b0d7c47-f69d-4bc6-a010-7c65feacd857 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:22.624703 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b0d7c47-f69d-4bc6-a010-7c65feacd857 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:22.625230 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b0d7c47-f69d-4bc6-a010-7c65feacd857 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:22.626176 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b0d7c47-f69d-4bc6-a010-7c65feacd857 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:22.626710 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b0d7c47-f69d-4bc6-a010-7c65feacd857 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:22.627214 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7b0d7c47-f69d-4bc6-a010-7c65feacd857 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:22.642576 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5b195f52-d2c2-4648-8c5b-2eb167a8f04b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:22.651246 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5b195f52-d2c2-4648-8c5b-2eb167a8f04b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/eb6e0169-ac40-4675-b6e9-2a3ea7b13f40" status: 200 len: 1309 microversion: 2.1 time: 0.274944 Aug 31 16:12:22.652163 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2222/4237] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:22 2022] GET /compute/v2.1/servers/eb6e0169-ac40-4675-b6e9-2a3ea7b13f40 => generated 1309 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:22.657105 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7b0d7c47-f69d-4bc6-a010-7c65feacd857 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] [instance: da3e4266-a9bc-4433-a335-580713bac164] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:12:22.683379 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-62ab6f95-19da-49f5-9ebb-1ee7a02464a2 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:22.684248 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-62ab6f95-19da-49f5-9ebb-1ee7a02464a2 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:22.707912 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-62ab6f95-19da-49f5-9ebb-1ee7a02464a2 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:22.708442 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-62ab6f95-19da-49f5-9ebb-1ee7a02464a2 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:22.709066 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-62ab6f95-19da-49f5-9ebb-1ee7a02464a2 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:22.709619 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-62ab6f95-19da-49f5-9ebb-1ee7a02464a2 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:22.710188 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-62ab6f95-19da-49f5-9ebb-1ee7a02464a2 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:22.710572 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-62ab6f95-19da-49f5-9ebb-1ee7a02464a2 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:22.780714 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7b0d7c47-f69d-4bc6-a010-7c65feacd857 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] 10.222.0.50 "DELETE /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164" status: 204 len: 0 microversion: 2.1 time: 0.168067 Aug 31 16:12:22.781461 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2016/4238] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:12:22 2022] DELETE /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:12:22.789922 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3e1f441f-080a-44d0-9d74-eb73a3e9136a tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:22.802630 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3e1f441f-080a-44d0-9d74-eb73a3e9136a tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] [instance: da3e4266-a9bc-4433-a335-580713bac164] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:22.812254 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e1f441f-080a-44d0-9d74-eb73a3e9136a tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:22.813810 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e1f441f-080a-44d0-9d74-eb73a3e9136a tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:22.814466 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e1f441f-080a-44d0-9d74-eb73a3e9136a tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:22.815368 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e1f441f-080a-44d0-9d74-eb73a3e9136a tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:22.815964 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e1f441f-080a-44d0-9d74-eb73a3e9136a tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:22.816534 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e1f441f-080a-44d0-9d74-eb73a3e9136a tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:23.459409 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-62ab6f95-19da-49f5-9ebb-1ee7a02464a2 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:23.469296 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-62ab6f95-19da-49f5-9ebb-1ee7a02464a2 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f" status: 200 len: 1521 microversion: 2.1 time: 0.789613 Aug 31 16:12:23.469931 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2223/4239] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:22 2022] GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f => generated 1521 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:12:23.475204 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7cdcb6c0-4a72-4aea-9f59-2d8fec5e9878 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:23.475874 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7cdcb6c0-4a72-4aea-9f59-2d8fec5e9878 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: f6e41791-366b-4790-8338-2a52f4ebed89] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:23.483110 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7cdcb6c0-4a72-4aea-9f59-2d8fec5e9878 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:23.483604 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7cdcb6c0-4a72-4aea-9f59-2d8fec5e9878 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:23.484086 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7cdcb6c0-4a72-4aea-9f59-2d8fec5e9878 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:23.485155 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7cdcb6c0-4a72-4aea-9f59-2d8fec5e9878 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:23.485820 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7cdcb6c0-4a72-4aea-9f59-2d8fec5e9878 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:23.486300 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7cdcb6c0-4a72-4aea-9f59-2d8fec5e9878 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:23.507824 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3e1f441f-080a-44d0-9d74-eb73a3e9136a tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19802f8112a04f1d94a35a1956188452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9eaf2ea58471390358e3d3c4a9689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:23.519475 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3e1f441f-080a-44d0-9d74-eb73a3e9136a tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] 10.222.0.50 "GET /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164" status: 200 len: 1509 microversion: 2.1 time: 0.733662 Aug 31 16:12:23.534393 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2017/4240] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:22 2022] GET /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164 => generated 1509 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:12:23.534393 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-547af7e1-2615-4cc9-bffb-549dfc6a51d8 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:23.534393 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-547af7e1-2615-4cc9-bffb-549dfc6a51d8 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] [instance: b778dc34-fa8e-4c9e-9cb6-5ececdf1074c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:23.534393 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-547af7e1-2615-4cc9-bffb-549dfc6a51d8 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:23.534393 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-547af7e1-2615-4cc9-bffb-549dfc6a51d8 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:23.534393 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-547af7e1-2615-4cc9-bffb-549dfc6a51d8 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:23.534393 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-547af7e1-2615-4cc9-bffb-549dfc6a51d8 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:23.535650 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-547af7e1-2615-4cc9-bffb-549dfc6a51d8 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:23.535650 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-547af7e1-2615-4cc9-bffb-549dfc6a51d8 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:23.722151 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7cdcb6c0-4a72-4aea-9f59-2d8fec5e9878 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:23.736483 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7cdcb6c0-4a72-4aea-9f59-2d8fec5e9878 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89" status: 200 len: 1691 microversion: 2.1 time: 0.264869 Aug 31 16:12:23.751895 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2224/4241] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:23 2022] GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89 => generated 1691 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:23.765472 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3c0a3c4f-af41-4d26-b6f4-10d72ef9a412 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:23.765980 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3c0a3c4f-af41-4d26-b6f4-10d72ef9a412 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 5923807d-1058-45ab-b8d1-c6700ea8c142] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:23.767254 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-547af7e1-2615-4cc9-bffb-549dfc6a51d8 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391c4c8e6ae4483e82a247957a6faad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1f95b9a87a4f1389c03f6a3f592a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:23.773082 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3c0a3c4f-af41-4d26-b6f4-10d72ef9a412 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:23.773993 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3c0a3c4f-af41-4d26-b6f4-10d72ef9a412 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:23.774627 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3c0a3c4f-af41-4d26-b6f4-10d72ef9a412 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:23.775512 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3c0a3c4f-af41-4d26-b6f4-10d72ef9a412 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:23.776120 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3c0a3c4f-af41-4d26-b6f4-10d72ef9a412 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:23.776695 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3c0a3c4f-af41-4d26-b6f4-10d72ef9a412 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:23.778626 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-547af7e1-2615-4cc9-bffb-549dfc6a51d8 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] 10.222.0.50 "GET /compute/v2.1/servers/b778dc34-fa8e-4c9e-9cb6-5ececdf1074c" status: 200 len: 1521 microversion: 2.1 time: 0.257457 Aug 31 16:12:23.781123 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2018/4242] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:23 2022] GET /compute/v2.1/servers/b778dc34-fa8e-4c9e-9cb6-5ececdf1074c => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:23.788724 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6aceeaba-c230-41b3-8a01-45b35aaf58a2 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:23.789425 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6aceeaba-c230-41b3-8a01-45b35aaf58a2 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: b60b7363-fd13-4b81-9c4b-0aabf39c5a6a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:23.804236 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6aceeaba-c230-41b3-8a01-45b35aaf58a2 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:23.805126 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6aceeaba-c230-41b3-8a01-45b35aaf58a2 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:23.807928 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6aceeaba-c230-41b3-8a01-45b35aaf58a2 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:23.809716 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6aceeaba-c230-41b3-8a01-45b35aaf58a2 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:23.810435 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6aceeaba-c230-41b3-8a01-45b35aaf58a2 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:23.811228 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6aceeaba-c230-41b3-8a01-45b35aaf58a2 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:24.072232 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3c0a3c4f-af41-4d26-b6f4-10d72ef9a412 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:24.088276 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3c0a3c4f-af41-4d26-b6f4-10d72ef9a412 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142" status: 200 len: 1479 microversion: 2.1 time: 0.326603 Aug 31 16:12:24.089749 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2225/4243] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:23 2022] GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142 => generated 1479 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:24.096891 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-65ee162d-b91f-41e1-9ce9-e5ddb4db0901 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:24.098131 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-65ee162d-b91f-41e1-9ce9-e5ddb4db0901 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: eb6e0169-ac40-4675-b6e9-2a3ea7b13f40] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:24.128625 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-65ee162d-b91f-41e1-9ce9-e5ddb4db0901 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:24.130012 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-65ee162d-b91f-41e1-9ce9-e5ddb4db0901 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:24.130732 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-65ee162d-b91f-41e1-9ce9-e5ddb4db0901 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:24.133650 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-65ee162d-b91f-41e1-9ce9-e5ddb4db0901 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:24.134889 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-65ee162d-b91f-41e1-9ce9-e5ddb4db0901 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:24.135892 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-65ee162d-b91f-41e1-9ce9-e5ddb4db0901 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:24.136281 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6aceeaba-c230-41b3-8a01-45b35aaf58a2 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:24.148157 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=100 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:12:24.148394 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6aceeaba-c230-41b3-8a01-45b35aaf58a2 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a" status: 200 len: 1517 microversion: 2.1 time: 0.365544 Aug 31 16:12:24.162125 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2019/4244] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:23 2022] GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a => generated 1517 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:24.162125 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-65bf6862-9b09-407d-ab6f-07820bdc698a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:24.162125 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-65bf6862-9b09-407d-ab6f-07820bdc698a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: f6e41791-366b-4790-8338-2a52f4ebed89] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:24.173396 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65bf6862-9b09-407d-ab6f-07820bdc698a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:24.173937 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65bf6862-9b09-407d-ab6f-07820bdc698a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:24.175328 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65bf6862-9b09-407d-ab6f-07820bdc698a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:24.176533 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65bf6862-9b09-407d-ab6f-07820bdc698a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:24.177630 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65bf6862-9b09-407d-ab6f-07820bdc698a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:24.178616 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65bf6862-9b09-407d-ab6f-07820bdc698a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:24.186541 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:12:24.307743 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-65bf6862-9b09-407d-ab6f-07820bdc698a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "POST /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89/action" status: 204 len: 0 microversion: 2.1 time: 0.155799 Aug 31 16:12:24.308672 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2020/4245] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:12:24 2022] POST /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89/action => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:12:24.323810 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-39d0aa69-906f-48fc-bf8e-5f6f7a1e9f03 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:24.330335 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-39d0aa69-906f-48fc-bf8e-5f6f7a1e9f03 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: f6e41791-366b-4790-8338-2a52f4ebed89] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:24.358877 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39d0aa69-906f-48fc-bf8e-5f6f7a1e9f03 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:24.359426 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39d0aa69-906f-48fc-bf8e-5f6f7a1e9f03 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:24.359674 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39d0aa69-906f-48fc-bf8e-5f6f7a1e9f03 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:24.363815 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39d0aa69-906f-48fc-bf8e-5f6f7a1e9f03 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:24.364579 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39d0aa69-906f-48fc-bf8e-5f6f7a1e9f03 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:24.365167 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39d0aa69-906f-48fc-bf8e-5f6f7a1e9f03 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:24.593392 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:12:24.635538 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-65ee162d-b91f-41e1-9ce9-e5ddb4db0901 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:24.656801 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=6 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:12:24.660071 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-65ee162d-b91f-41e1-9ce9-e5ddb4db0901 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/eb6e0169-ac40-4675-b6e9-2a3ea7b13f40" status: 200 len: 1309 microversion: 2.1 time: 0.568279 Aug 31 16:12:24.662863 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2226/4246] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:24 2022] GET /compute/v2.1/servers/eb6e0169-ac40-4675-b6e9-2a3ea7b13f40 => generated 1309 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:24.670695 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-e6749f95-b54f-4a35-b7e2-5186265264e8 req-95ce7138-ee8a-475d-b388-8cddd653128b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6e41791-366b-4790-8338-2a52f4ebed89", "name": "network-vif-plugged", "status": "completed", "tag": "0507378d-ba87-41ae-8199-9dd64dc20873"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:24.677407 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-39d0aa69-906f-48fc-bf8e-5f6f7a1e9f03 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:24.686058 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-e6749f95-b54f-4a35-b7e2-5186265264e8 req-95ce7138-ee8a-475d-b388-8cddd653128b service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:24.686790 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-e6749f95-b54f-4a35-b7e2-5186265264e8 req-95ce7138-ee8a-475d-b388-8cddd653128b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:24.687564 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-e6749f95-b54f-4a35-b7e2-5186265264e8 req-95ce7138-ee8a-475d-b388-8cddd653128b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:24.688040 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-39d0aa69-906f-48fc-bf8e-5f6f7a1e9f03 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89" status: 200 len: 1691 microversion: 2.1 time: 0.368502 Aug 31 16:12:24.690033 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2021/4247] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:24 2022] GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89 => generated 1691 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:24.695596 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6b778397-8b51-4b80-91f8-798763506252 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:24.695924 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6b778397-8b51-4b80-91f8-798763506252 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:24.705396 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-e6749f95-b54f-4a35-b7e2-5186265264e8 req-95ce7138-ee8a-475d-b388-8cddd653128b service nova] Creating event network-vif-plugged:0507378d-ba87-41ae-8199-9dd64dc20873 for instance f6e41791-366b-4790-8338-2a52f4ebed89 on n-h2-833090-16 Aug 31 16:12:24.712244 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b778397-8b51-4b80-91f8-798763506252 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:24.712905 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b778397-8b51-4b80-91f8-798763506252 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:24.713545 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b778397-8b51-4b80-91f8-798763506252 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:24.714371 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [req-e6749f95-b54f-4a35-b7e2-5186265264e8 req-95ce7138-ee8a-475d-b388-8cddd653128b service nova] Instance f6e41791-366b-4790-8338-2a52f4ebed89 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-833090-16', 'n-h1-833090-16'} {{(pid=128864) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 16:12:24.714867 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b778397-8b51-4b80-91f8-798763506252 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:24.715714 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b778397-8b51-4b80-91f8-798763506252 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:24.716564 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b778397-8b51-4b80-91f8-798763506252 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:24.746018 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-e6749f95-b54f-4a35-b7e2-5186265264e8 req-95ce7138-ee8a-475d-b388-8cddd653128b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071694 Aug 31 16:12:24.747358 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2227/4248] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:24.755934 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-b4638f1e-c1e5-4758-8955-43342593431e req-829c5c63-d21d-4917-aa90-d50f91fbb430 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b778dc34-fa8e-4c9e-9cb6-5ececdf1074c", "name": "network-vif-deleted", "tag": "5e5f3434-7ea4-46ba-92cd-1bf5d821731c"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:24.769096 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-b4638f1e-c1e5-4758-8955-43342593431e req-829c5c63-d21d-4917-aa90-d50f91fbb430 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:24.770110 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-b4638f1e-c1e5-4758-8955-43342593431e req-829c5c63-d21d-4917-aa90-d50f91fbb430 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:24.770738 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-b4638f1e-c1e5-4758-8955-43342593431e req-829c5c63-d21d-4917-aa90-d50f91fbb430 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:24.810599 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-b4638f1e-c1e5-4758-8955-43342593431e req-829c5c63-d21d-4917-aa90-d50f91fbb430 service nova] Creating event network-vif-deleted:5e5f3434-7ea4-46ba-92cd-1bf5d821731c for instance b778dc34-fa8e-4c9e-9cb6-5ececdf1074c on n-h2-833090-16 Aug 31 16:12:24.821481 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-b4638f1e-c1e5-4758-8955-43342593431e req-829c5c63-d21d-4917-aa90-d50f91fbb430 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070817 Aug 31 16:12:24.822378 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2228/4249] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:24.831624 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-98861afa-d82a-4130-bd62-7457f5cb2bf0 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:24.832662 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-98861afa-d82a-4130-bd62-7457f5cb2bf0 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] [instance: da3e4266-a9bc-4433-a335-580713bac164] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:24.841430 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-98861afa-d82a-4130-bd62-7457f5cb2bf0 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:24.842243 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-98861afa-d82a-4130-bd62-7457f5cb2bf0 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:24.842904 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-98861afa-d82a-4130-bd62-7457f5cb2bf0 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:24.843920 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-98861afa-d82a-4130-bd62-7457f5cb2bf0 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:24.844537 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-98861afa-d82a-4130-bd62-7457f5cb2bf0 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:24.845119 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-98861afa-d82a-4130-bd62-7457f5cb2bf0 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:24.987771 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6b778397-8b51-4b80-91f8-798763506252 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:24.999326 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6b778397-8b51-4b80-91f8-798763506252 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f" status: 200 len: 1521 microversion: 2.1 time: 0.308163 Aug 31 16:12:25.001114 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2022/4250] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:24 2022] GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f => generated 1521 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:25.008410 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-462fd8c2-23eb-43bb-a7dd-9e5677321a1e tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:25.009341 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-462fd8c2-23eb-43bb-a7dd-9e5677321a1e tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] [instance: b778dc34-fa8e-4c9e-9cb6-5ececdf1074c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:25.018241 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-462fd8c2-23eb-43bb-a7dd-9e5677321a1e tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:25.019053 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-462fd8c2-23eb-43bb-a7dd-9e5677321a1e tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:25.020445 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-462fd8c2-23eb-43bb-a7dd-9e5677321a1e tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:25.021411 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-462fd8c2-23eb-43bb-a7dd-9e5677321a1e tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:25.022969 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-462fd8c2-23eb-43bb-a7dd-9e5677321a1e tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:25.023578 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-462fd8c2-23eb-43bb-a7dd-9e5677321a1e tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:25.060087 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-98861afa-d82a-4130-bd62-7457f5cb2bf0 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19802f8112a04f1d94a35a1956188452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9eaf2ea58471390358e3d3c4a9689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:25.074075 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-98861afa-d82a-4130-bd62-7457f5cb2bf0 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] 10.222.0.50 "GET /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164" status: 200 len: 1509 microversion: 2.1 time: 0.246996 Aug 31 16:12:25.076240 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2229/4251] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:24 2022] GET /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164 => generated 1509 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:25.116180 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a6e13328-2982-48d7-a3d0-ed4fa023ac66 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:25.116806 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a6e13328-2982-48d7-a3d0-ed4fa023ac66 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 5923807d-1058-45ab-b8d1-c6700ea8c142] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:25.126632 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-462fd8c2-23eb-43bb-a7dd-9e5677321a1e tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391c4c8e6ae4483e82a247957a6faad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1f95b9a87a4f1389c03f6a3f592a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:25.127744 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a6e13328-2982-48d7-a3d0-ed4fa023ac66 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:25.128353 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a6e13328-2982-48d7-a3d0-ed4fa023ac66 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:25.129112 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a6e13328-2982-48d7-a3d0-ed4fa023ac66 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:25.130243 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a6e13328-2982-48d7-a3d0-ed4fa023ac66 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:25.131107 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a6e13328-2982-48d7-a3d0-ed4fa023ac66 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:25.131735 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a6e13328-2982-48d7-a3d0-ed4fa023ac66 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:25.137066 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-462fd8c2-23eb-43bb-a7dd-9e5677321a1e tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] 10.222.0.50 "GET /compute/v2.1/servers/b778dc34-fa8e-4c9e-9cb6-5ececdf1074c" status: 200 len: 1479 microversion: 2.1 time: 0.133900 Aug 31 16:12:25.139765 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2023/4252] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:25 2022] GET /compute/v2.1/servers/b778dc34-fa8e-4c9e-9cb6-5ececdf1074c => generated 1479 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:25.179078 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-93d69143-2af9-46ea-8851-05bf7a83696a tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:25.180039 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-93d69143-2af9-46ea-8851-05bf7a83696a tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: b60b7363-fd13-4b81-9c4b-0aabf39c5a6a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:25.191746 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-93d69143-2af9-46ea-8851-05bf7a83696a tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:25.192462 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-93d69143-2af9-46ea-8851-05bf7a83696a tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:25.193087 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-93d69143-2af9-46ea-8851-05bf7a83696a tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:25.193990 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-93d69143-2af9-46ea-8851-05bf7a83696a tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:25.194644 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-93d69143-2af9-46ea-8851-05bf7a83696a tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:25.195232 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-93d69143-2af9-46ea-8851-05bf7a83696a tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:25.383751 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a6e13328-2982-48d7-a3d0-ed4fa023ac66 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:25.399973 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a6e13328-2982-48d7-a3d0-ed4fa023ac66 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142" status: 200 len: 1479 microversion: 2.1 time: 0.287424 Aug 31 16:12:25.402400 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2230/4253] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:25 2022] GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142 => generated 1479 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:12:25.430418 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-93d69143-2af9-46ea-8851-05bf7a83696a tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:25.440633 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-93d69143-2af9-46ea-8851-05bf7a83696a tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a" status: 200 len: 1517 microversion: 2.1 time: 0.266624 Aug 31 16:12:25.441055 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2024/4254] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:25 2022] GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a => generated 1517 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:12:25.688551 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2e21aadd-0531-41fb-a357-f15d4b158db8 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:25.690002 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2e21aadd-0531-41fb-a357-f15d4b158db8 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: eb6e0169-ac40-4675-b6e9-2a3ea7b13f40] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:25.703784 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2e21aadd-0531-41fb-a357-f15d4b158db8 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:25.704594 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2e21aadd-0531-41fb-a357-f15d4b158db8 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:25.705347 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2e21aadd-0531-41fb-a357-f15d4b158db8 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:25.712721 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-964a5adc-ec41-4641-9329-bd92dc9bf7be tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:25.714793 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-964a5adc-ec41-4641-9329-bd92dc9bf7be tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: f6e41791-366b-4790-8338-2a52f4ebed89] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:25.721928 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2e21aadd-0531-41fb-a357-f15d4b158db8 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:25.722704 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2e21aadd-0531-41fb-a357-f15d4b158db8 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:25.723159 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2e21aadd-0531-41fb-a357-f15d4b158db8 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:25.726715 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-964a5adc-ec41-4641-9329-bd92dc9bf7be tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:25.727129 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-964a5adc-ec41-4641-9329-bd92dc9bf7be tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:25.727563 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-964a5adc-ec41-4641-9329-bd92dc9bf7be tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:25.733967 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-964a5adc-ec41-4641-9329-bd92dc9bf7be tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:25.734809 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-964a5adc-ec41-4641-9329-bd92dc9bf7be tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:25.735255 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-964a5adc-ec41-4641-9329-bd92dc9bf7be tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:26.228731 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2e21aadd-0531-41fb-a357-f15d4b158db8 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:26.244210 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2e21aadd-0531-41fb-a357-f15d4b158db8 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/eb6e0169-ac40-4675-b6e9-2a3ea7b13f40" status: 200 len: 1309 microversion: 2.1 time: 0.559605 Aug 31 16:12:26.262449 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2231/4255] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:25 2022] GET /compute/v2.1/servers/eb6e0169-ac40-4675-b6e9-2a3ea7b13f40 => generated 1309 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:26.275028 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-022385fd-9188-4298-98ab-a6501dfb9ab9 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:26.275798 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-022385fd-9188-4298-98ab-a6501dfb9ab9 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:26.284473 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-022385fd-9188-4298-98ab-a6501dfb9ab9 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:26.285081 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-022385fd-9188-4298-98ab-a6501dfb9ab9 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:26.285718 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-022385fd-9188-4298-98ab-a6501dfb9ab9 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:26.286540 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-022385fd-9188-4298-98ab-a6501dfb9ab9 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:26.287085 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-022385fd-9188-4298-98ab-a6501dfb9ab9 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:26.287586 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-022385fd-9188-4298-98ab-a6501dfb9ab9 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:26.361009 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-964a5adc-ec41-4641-9329-bd92dc9bf7be tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:26.370057 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-964a5adc-ec41-4641-9329-bd92dc9bf7be tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89" status: 200 len: 1691 microversion: 2.1 time: 0.663026 Aug 31 16:12:26.380570 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2025/4256] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:25 2022] GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89 => generated 1691 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:12:26.385618 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-14fc85ab-bfa4-470b-8d40-90908b851bb9 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:26.386482 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-14fc85ab-bfa4-470b-8d40-90908b851bb9 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] [instance: da3e4266-a9bc-4433-a335-580713bac164] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:26.403085 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14fc85ab-bfa4-470b-8d40-90908b851bb9 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:26.403570 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14fc85ab-bfa4-470b-8d40-90908b851bb9 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:26.404197 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14fc85ab-bfa4-470b-8d40-90908b851bb9 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:26.404910 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14fc85ab-bfa4-470b-8d40-90908b851bb9 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:26.405357 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14fc85ab-bfa4-470b-8d40-90908b851bb9 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:26.406039 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14fc85ab-bfa4-470b-8d40-90908b851bb9 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:26.798792 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-022385fd-9188-4298-98ab-a6501dfb9ab9 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:26.810421 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-022385fd-9188-4298-98ab-a6501dfb9ab9 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f" status: 200 len: 1521 microversion: 2.1 time: 0.546294 Aug 31 16:12:26.811408 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2232/4257] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:26 2022] GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f => generated 1521 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:26.823589 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-48027119-3621-4f27-b009-a1440ef4754e tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:26.824667 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-48027119-3621-4f27-b009-a1440ef4754e tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] [instance: b778dc34-fa8e-4c9e-9cb6-5ececdf1074c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:26.863398 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-48027119-3621-4f27-b009-a1440ef4754e tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:26.864627 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-48027119-3621-4f27-b009-a1440ef4754e tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:26.865323 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-48027119-3621-4f27-b009-a1440ef4754e tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:26.866478 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-48027119-3621-4f27-b009-a1440ef4754e tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:26.867106 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-48027119-3621-4f27-b009-a1440ef4754e tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:26.867866 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-48027119-3621-4f27-b009-a1440ef4754e tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:26.920262 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-14fc85ab-bfa4-470b-8d40-90908b851bb9 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19802f8112a04f1d94a35a1956188452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9eaf2ea58471390358e3d3c4a9689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:26.936578 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-14fc85ab-bfa4-470b-8d40-90908b851bb9 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] 10.222.0.50 "GET /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164" status: 200 len: 1509 microversion: 2.1 time: 0.554515 Aug 31 16:12:26.937194 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2026/4258] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:26 2022] GET /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164 => generated 1509 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:26.955686 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f61bbe36-e65d-49b4-86c1-61b50ec3e5ba tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:26.956620 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f61bbe36-e65d-49b4-86c1-61b50ec3e5ba tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 5923807d-1058-45ab-b8d1-c6700ea8c142] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:26.963879 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f61bbe36-e65d-49b4-86c1-61b50ec3e5ba tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:26.964657 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f61bbe36-e65d-49b4-86c1-61b50ec3e5ba tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:26.965405 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f61bbe36-e65d-49b4-86c1-61b50ec3e5ba tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:26.966347 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f61bbe36-e65d-49b4-86c1-61b50ec3e5ba tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:26.967157 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f61bbe36-e65d-49b4-86c1-61b50ec3e5ba tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:26.968687 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f61bbe36-e65d-49b4-86c1-61b50ec3e5ba tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:27.134713 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-48027119-3621-4f27-b009-a1440ef4754e tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391c4c8e6ae4483e82a247957a6faad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1f95b9a87a4f1389c03f6a3f592a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:27.171754 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-48027119-3621-4f27-b009-a1440ef4754e tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] 10.222.0.50 "GET /compute/v2.1/servers/b778dc34-fa8e-4c9e-9cb6-5ececdf1074c" status: 200 len: 1479 microversion: 2.1 time: 0.347538 Aug 31 16:12:27.172737 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2233/4259] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:26 2022] GET /compute/v2.1/servers/b778dc34-fa8e-4c9e-9cb6-5ececdf1074c => generated 1479 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:27.182951 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-294fd391-3f1b-45ee-b972-a5399683a5c1 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:27.184529 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-294fd391-3f1b-45ee-b972-a5399683a5c1 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: b60b7363-fd13-4b81-9c4b-0aabf39c5a6a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:27.194390 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-294fd391-3f1b-45ee-b972-a5399683a5c1 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:27.195535 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-294fd391-3f1b-45ee-b972-a5399683a5c1 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:27.196370 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-294fd391-3f1b-45ee-b972-a5399683a5c1 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:27.197521 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-294fd391-3f1b-45ee-b972-a5399683a5c1 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:27.198703 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-294fd391-3f1b-45ee-b972-a5399683a5c1 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:27.199500 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-294fd391-3f1b-45ee-b972-a5399683a5c1 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:27.250869 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f61bbe36-e65d-49b4-86c1-61b50ec3e5ba tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:27.260572 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f61bbe36-e65d-49b4-86c1-61b50ec3e5ba tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142" status: 200 len: 1479 microversion: 2.1 time: 0.309091 Aug 31 16:12:27.269725 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2027/4260] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:26 2022] GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142 => generated 1479 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:27.275161 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-4e054ca2-723b-4362-9293-a51819147fad req-a890b21d-626c-40af-8c4b-352783c81223 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5923807d-1058-45ab-b8d1-c6700ea8c142", "name": "network-vif-unplugged", "status": "completed", "tag": "b92f4d7a-9fe1-49d2-9d35-67e9a518bfc4"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:27.296188 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4e054ca2-723b-4362-9293-a51819147fad req-a890b21d-626c-40af-8c4b-352783c81223 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:27.302283 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4e054ca2-723b-4362-9293-a51819147fad req-a890b21d-626c-40af-8c4b-352783c81223 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:27.306223 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4e054ca2-723b-4362-9293-a51819147fad req-a890b21d-626c-40af-8c4b-352783c81223 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:27.331147 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-4e054ca2-723b-4362-9293-a51819147fad req-a890b21d-626c-40af-8c4b-352783c81223 service nova] Creating event network-vif-unplugged:b92f4d7a-9fe1-49d2-9d35-67e9a518bfc4 for instance 5923807d-1058-45ab-b8d1-c6700ea8c142 on n-h2-833090-16 Aug 31 16:12:27.349879 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-4e054ca2-723b-4362-9293-a51819147fad req-a890b21d-626c-40af-8c4b-352783c81223 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077949 Aug 31 16:12:27.351775 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2028/4261] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:27.366761 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-7780af30-6e4c-4fb3-b0e4-051fe073718a req-b10fafb2-f3ac-47de-9add-059407858d8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da3e4266-a9bc-4433-a335-580713bac164", "name": "network-vif-deleted", "tag": "3fbcf647-bed8-4bd1-8cb6-2c28f9c026e1"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:27.392014 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7780af30-6e4c-4fb3-b0e4-051fe073718a req-b10fafb2-f3ac-47de-9add-059407858d8e service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:27.393061 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7780af30-6e4c-4fb3-b0e4-051fe073718a req-b10fafb2-f3ac-47de-9add-059407858d8e service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:27.393660 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7780af30-6e4c-4fb3-b0e4-051fe073718a req-b10fafb2-f3ac-47de-9add-059407858d8e service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:27.409562 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-7780af30-6e4c-4fb3-b0e4-051fe073718a req-b10fafb2-f3ac-47de-9add-059407858d8e service nova] Creating event network-vif-deleted:3fbcf647-bed8-4bd1-8cb6-2c28f9c026e1 for instance da3e4266-a9bc-4433-a335-580713bac164 on n-h1-833090-16 Aug 31 16:12:27.415697 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-7780af30-6e4c-4fb3-b0e4-051fe073718a req-b10fafb2-f3ac-47de-9add-059407858d8e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061911 Aug 31 16:12:27.416881 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2029/4262] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:27.435282 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4b1632b3-a078-4f48-b684-ee8dfed9e514 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:27.436895 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4b1632b3-a078-4f48-b684-ee8dfed9e514 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: eb6e0169-ac40-4675-b6e9-2a3ea7b13f40] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:27.444627 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b1632b3-a078-4f48-b684-ee8dfed9e514 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:27.445467 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b1632b3-a078-4f48-b684-ee8dfed9e514 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:27.446165 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b1632b3-a078-4f48-b684-ee8dfed9e514 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:27.447103 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b1632b3-a078-4f48-b684-ee8dfed9e514 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:27.447810 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b1632b3-a078-4f48-b684-ee8dfed9e514 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:27.448443 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b1632b3-a078-4f48-b684-ee8dfed9e514 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:27.612221 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-294fd391-3f1b-45ee-b972-a5399683a5c1 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:27.628484 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-294fd391-3f1b-45ee-b972-a5399683a5c1 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a" status: 200 len: 1517 microversion: 2.1 time: 0.452933 Aug 31 16:12:27.629598 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2234/4263] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:27 2022] GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a => generated 1517 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:27.634686 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c3958783-74b9-4b0f-ab9b-fe56f43c1ac9 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:27.643971 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c3958783-74b9-4b0f-ab9b-fe56f43c1ac9 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: f6e41791-366b-4790-8338-2a52f4ebed89] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:27.665435 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3958783-74b9-4b0f-ab9b-fe56f43c1ac9 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:27.668142 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3958783-74b9-4b0f-ab9b-fe56f43c1ac9 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:27.669076 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3958783-74b9-4b0f-ab9b-fe56f43c1ac9 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:27.670993 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3958783-74b9-4b0f-ab9b-fe56f43c1ac9 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:27.683639 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3958783-74b9-4b0f-ab9b-fe56f43c1ac9 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:27.684909 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3958783-74b9-4b0f-ab9b-fe56f43c1ac9 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:27.797601 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4b1632b3-a078-4f48-b684-ee8dfed9e514 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:27.814374 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4b1632b3-a078-4f48-b684-ee8dfed9e514 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/eb6e0169-ac40-4675-b6e9-2a3ea7b13f40" status: 200 len: 1309 microversion: 2.1 time: 0.394475 Aug 31 16:12:27.815441 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2030/4264] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:27 2022] GET /compute/v2.1/servers/eb6e0169-ac40-4675-b6e9-2a3ea7b13f40 => generated 1309 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:27.839371 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c1857004-b6a7-41f1-9268-d3a9255e2335 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:27.840419 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c1857004-b6a7-41f1-9268-d3a9255e2335 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:27.848504 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c1857004-b6a7-41f1-9268-d3a9255e2335 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:27.849623 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c1857004-b6a7-41f1-9268-d3a9255e2335 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:27.850393 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c1857004-b6a7-41f1-9268-d3a9255e2335 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:27.851414 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c1857004-b6a7-41f1-9268-d3a9255e2335 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:27.852072 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c1857004-b6a7-41f1-9268-d3a9255e2335 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:27.852690 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c1857004-b6a7-41f1-9268-d3a9255e2335 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:28.147199 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c3958783-74b9-4b0f-ab9b-fe56f43c1ac9 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:28.151890 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c1857004-b6a7-41f1-9268-d3a9255e2335 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:28.161765 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c3958783-74b9-4b0f-ab9b-fe56f43c1ac9 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89" status: 200 len: 1691 microversion: 2.1 time: 0.531184 Aug 31 16:12:28.170271 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2235/4265] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:27 2022] GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89 => generated 1691 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:28.178291 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-537285bb-84a2-4f5d-b95e-989236d9eea3 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:28.180471 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-537285bb-84a2-4f5d-b95e-989236d9eea3 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] [instance: da3e4266-a9bc-4433-a335-580713bac164] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:28.182698 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c1857004-b6a7-41f1-9268-d3a9255e2335 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f" status: 200 len: 1521 microversion: 2.1 time: 0.344340 Aug 31 16:12:28.186321 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2031/4266] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:27 2022] GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f => generated 1521 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:28.195703 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-537285bb-84a2-4f5d-b95e-989236d9eea3 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:28.200880 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-537285bb-84a2-4f5d-b95e-989236d9eea3 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:28.201698 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-537285bb-84a2-4f5d-b95e-989236d9eea3 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:28.202736 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-537285bb-84a2-4f5d-b95e-989236d9eea3 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:28.203374 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-537285bb-84a2-4f5d-b95e-989236d9eea3 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:28.203964 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-537285bb-84a2-4f5d-b95e-989236d9eea3 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:28.205975 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3b0a6b14-5cd5-42bc-8b5f-c338c5fb1806 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:28.207604 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3b0a6b14-5cd5-42bc-8b5f-c338c5fb1806 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] [instance: b778dc34-fa8e-4c9e-9cb6-5ececdf1074c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:28.222679 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b0a6b14-5cd5-42bc-8b5f-c338c5fb1806 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:28.223951 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b0a6b14-5cd5-42bc-8b5f-c338c5fb1806 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:28.224985 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b0a6b14-5cd5-42bc-8b5f-c338c5fb1806 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:28.226066 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b0a6b14-5cd5-42bc-8b5f-c338c5fb1806 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:28.227316 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b0a6b14-5cd5-42bc-8b5f-c338c5fb1806 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:28.228050 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b0a6b14-5cd5-42bc-8b5f-c338c5fb1806 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:28.280967 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:12:28.287145 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-537285bb-84a2-4f5d-b95e-989236d9eea3 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:28.288660 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-537285bb-84a2-4f5d-b95e-989236d9eea3 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:28.289708 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-537285bb-84a2-4f5d-b95e-989236d9eea3 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:28.290469 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-537285bb-84a2-4f5d-b95e-989236d9eea3 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lazy-loading 'fault' on Instance uuid da3e4266-a9bc-4433-a335-580713bac164 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:12:28.314502 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b0a6b14-5cd5-42bc-8b5f-c338c5fb1806 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:28.315268 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b0a6b14-5cd5-42bc-8b5f-c338c5fb1806 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:28.316230 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b0a6b14-5cd5-42bc-8b5f-c338c5fb1806 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:28.317027 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-3b0a6b14-5cd5-42bc-8b5f-c338c5fb1806 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lazy-loading 'fault' on Instance uuid b778dc34-fa8e-4c9e-9cb6-5ececdf1074c {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:12:28.358551 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-537285bb-84a2-4f5d-b95e-989236d9eea3 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19802f8112a04f1d94a35a1956188452', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b9eaf2ea58471390358e3d3c4a9689', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:28.368640 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-537285bb-84a2-4f5d-b95e-989236d9eea3 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] 10.222.0.50 "GET /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164" status: 200 len: 1312 microversion: 2.1 time: 0.196712 Aug 31 16:12:28.369520 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2236/4267] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:28 2022] GET /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164 => generated 1312 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:28.380210 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-58e06a88-ea36-4a98-a4d3-92149b6f510a tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:28.392341 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-58e06a88-ea36-4a98-a4d3-92149b6f510a tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 5923807d-1058-45ab-b8d1-c6700ea8c142] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:28.399841 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-58e06a88-ea36-4a98-a4d3-92149b6f510a tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:28.400879 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-58e06a88-ea36-4a98-a4d3-92149b6f510a tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:28.401790 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-58e06a88-ea36-4a98-a4d3-92149b6f510a tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:28.404249 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-58e06a88-ea36-4a98-a4d3-92149b6f510a tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:28.405475 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-58e06a88-ea36-4a98-a4d3-92149b6f510a tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:28.406575 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-58e06a88-ea36-4a98-a4d3-92149b6f510a tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:28.424131 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3b0a6b14-5cd5-42bc-8b5f-c338c5fb1806 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391c4c8e6ae4483e82a247957a6faad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1f95b9a87a4f1389c03f6a3f592a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:28.436435 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3b0a6b14-5cd5-42bc-8b5f-c338c5fb1806 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] 10.222.0.50 "GET /compute/v2.1/servers/b778dc34-fa8e-4c9e-9cb6-5ececdf1074c" status: 200 len: 1312 microversion: 2.1 time: 0.237693 Aug 31 16:12:28.437110 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2032/4268] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:28 2022] GET /compute/v2.1/servers/b778dc34-fa8e-4c9e-9cb6-5ececdf1074c => generated 1312 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:28.580339 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-58e06a88-ea36-4a98-a4d3-92149b6f510a tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:28.592495 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-58e06a88-ea36-4a98-a4d3-92149b6f510a tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142" status: 200 len: 1479 microversion: 2.1 time: 0.221462 Aug 31 16:12:28.593492 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2237/4269] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:28 2022] GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142 => generated 1479 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:28.651047 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a4f5002f-e7c3-479a-a9ac-999bf06c6e2a tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:28.651516 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a4f5002f-e7c3-479a-a9ac-999bf06c6e2a tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: b60b7363-fd13-4b81-9c4b-0aabf39c5a6a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:28.658522 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4f5002f-e7c3-479a-a9ac-999bf06c6e2a tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:28.659061 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4f5002f-e7c3-479a-a9ac-999bf06c6e2a tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:28.659482 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4f5002f-e7c3-479a-a9ac-999bf06c6e2a tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:28.660187 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4f5002f-e7c3-479a-a9ac-999bf06c6e2a tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:28.660630 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4f5002f-e7c3-479a-a9ac-999bf06c6e2a tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:28.661056 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4f5002f-e7c3-479a-a9ac-999bf06c6e2a tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:28.850447 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-15818a7c-ea15-4e97-a37c-69be700bc171 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:28.851780 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-15818a7c-ea15-4e97-a37c-69be700bc171 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: eb6e0169-ac40-4675-b6e9-2a3ea7b13f40] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:28.861912 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-15818a7c-ea15-4e97-a37c-69be700bc171 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:28.862757 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-15818a7c-ea15-4e97-a37c-69be700bc171 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:28.863824 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-15818a7c-ea15-4e97-a37c-69be700bc171 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:28.865350 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-15818a7c-ea15-4e97-a37c-69be700bc171 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:28.866453 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-15818a7c-ea15-4e97-a37c-69be700bc171 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:28.867090 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-15818a7c-ea15-4e97-a37c-69be700bc171 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:28.886404 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a4f5002f-e7c3-479a-a9ac-999bf06c6e2a tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:28.906842 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a4f5002f-e7c3-479a-a9ac-999bf06c6e2a tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a" status: 200 len: 1517 microversion: 2.1 time: 0.259148 Aug 31 16:12:28.921617 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2033/4270] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:28 2022] GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a => generated 1517 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:29.088905 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-15818a7c-ea15-4e97-a37c-69be700bc171 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:29.131444 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-15818a7c-ea15-4e97-a37c-69be700bc171 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/eb6e0169-ac40-4675-b6e9-2a3ea7b13f40" status: 200 len: 1309 microversion: 2.1 time: 0.285022 Aug 31 16:12:29.132565 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2238/4271] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:28 2022] GET /compute/v2.1/servers/eb6e0169-ac40-4675-b6e9-2a3ea7b13f40 => generated 1309 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:29.190908 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2d766a7a-e3d0-4f10-a844-a84de311736f tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:29.192101 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2d766a7a-e3d0-4f10-a844-a84de311736f tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: f6e41791-366b-4790-8338-2a52f4ebed89] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:29.202388 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d766a7a-e3d0-4f10-a844-a84de311736f tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:29.203688 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d766a7a-e3d0-4f10-a844-a84de311736f tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:29.204741 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d766a7a-e3d0-4f10-a844-a84de311736f tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:29.206792 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d766a7a-e3d0-4f10-a844-a84de311736f tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:29.207904 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d766a7a-e3d0-4f10-a844-a84de311736f tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:29.208947 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d766a7a-e3d0-4f10-a844-a84de311736f tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:29.219003 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c8766513-9ef6-4b31-a4d5-3382b6a8427d tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:29.219587 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c8766513-9ef6-4b31-a4d5-3382b6a8427d tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:29.229372 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8766513-9ef6-4b31-a4d5-3382b6a8427d tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:29.232838 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8766513-9ef6-4b31-a4d5-3382b6a8427d tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:29.234380 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8766513-9ef6-4b31-a4d5-3382b6a8427d tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:29.235449 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8766513-9ef6-4b31-a4d5-3382b6a8427d tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:29.236267 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8766513-9ef6-4b31-a4d5-3382b6a8427d tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:29.238326 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8766513-9ef6-4b31-a4d5-3382b6a8427d tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:29.538725 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c8766513-9ef6-4b31-a4d5-3382b6a8427d tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:29.552275 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c8766513-9ef6-4b31-a4d5-3382b6a8427d tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f" status: 200 len: 1521 microversion: 2.1 time: 0.338197 Aug 31 16:12:29.554207 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2239/4272] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:29 2022] GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f => generated 1521 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:29.559997 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-63ab308a-ec4c-4ce2-b427-49fa8e60446e req-bd3fab75-1c2d-4e4a-b6b8-45356c5347a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb6e0169-ac40-4675-b6e9-2a3ea7b13f40", "name": "network-vif-plugged", "status": "completed", "tag": "54ca58a1-2958-4476-a9f8-df32a84cc26a"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:29.579873 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2d766a7a-e3d0-4f10-a844-a84de311736f tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:29.583186 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-63ab308a-ec4c-4ce2-b427-49fa8e60446e req-bd3fab75-1c2d-4e4a-b6b8-45356c5347a9 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:29.584210 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-63ab308a-ec4c-4ce2-b427-49fa8e60446e req-bd3fab75-1c2d-4e4a-b6b8-45356c5347a9 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:29.584901 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-63ab308a-ec4c-4ce2-b427-49fa8e60446e req-bd3fab75-1c2d-4e4a-b6b8-45356c5347a9 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:29.593868 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2d766a7a-e3d0-4f10-a844-a84de311736f tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89" status: 200 len: 1683 microversion: 2.1 time: 0.406648 Aug 31 16:12:29.601059 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-63ab308a-ec4c-4ce2-b427-49fa8e60446e req-bd3fab75-1c2d-4e4a-b6b8-45356c5347a9 service nova] Creating event network-vif-plugged:54ca58a1-2958-4476-a9f8-df32a84cc26a for instance eb6e0169-ac40-4675-b6e9-2a3ea7b13f40 on n-h1-833090-16 Aug 31 16:12:29.606884 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2034/4273] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:29 2022] GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89 => generated 1683 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:12:29.615163 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-63ab308a-ec4c-4ce2-b427-49fa8e60446e req-bd3fab75-1c2d-4e4a-b6b8-45356c5347a9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059560 Aug 31 16:12:29.618830 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b243fd87-ff20-409e-b5af-faf1032dc552 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:29.619455 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b243fd87-ff20-409e-b5af-faf1032dc552 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] [instance: da3e4266-a9bc-4433-a335-580713bac164] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:29.625538 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2240/4274] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:29.627784 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b243fd87-ff20-409e-b5af-faf1032dc552 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:29.628373 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b243fd87-ff20-409e-b5af-faf1032dc552 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:29.628700 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b243fd87-ff20-409e-b5af-faf1032dc552 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:29.629433 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b243fd87-ff20-409e-b5af-faf1032dc552 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:29.629874 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b243fd87-ff20-409e-b5af-faf1032dc552 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:29.630366 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b243fd87-ff20-409e-b5af-faf1032dc552 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:29.637998 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ed143412-7868-4f9a-bc7c-1d2fc68c727e tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:29.639950 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ed143412-7868-4f9a-bc7c-1d2fc68c727e tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] [instance: b778dc34-fa8e-4c9e-9cb6-5ececdf1074c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:29.647289 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-b243fd87-ff20-409e-b5af-faf1032dc552 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] HTTP exception thrown: Instance da3e4266-a9bc-4433-a335-580713bac164 could not be found. Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b243fd87-ff20-409e-b5af-faf1032dc552 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Request method failure captured: Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164 HTTP/1.1 Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4gWgX64KdpFUeRja_c3xIycKXmTStr2sJk3YZ__cyOyyLy0ngA0nl7Nm3fMe02MQRSkxW5DaZA3z4EFzruI3YfpOdzbh5H7hLPvj345N--XVnjBpUnXqXZvDi6H4-CnIMvhKrnxhLaq3MGWUP59Hn0TY9yI5P3H2MoDRSWZHBX0t44 Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 18b9eaf2ea58471390358e3d3c4a9689 Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1486651920 Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/18b9eaf2ea58471390358e3d3c4a9689"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/18b9eaf2ea58471390358e3d3c4a9689"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/18b9eaf2ea58471390358e3d3c4a9689"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_18b9eaf2ea58471390358e3d3c4a9689", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1486651920 Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 18b9eaf2ea58471390358e3d3c4a9689 Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1486651920 Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServerRescueTestJSONUnderV235-1486651920-project Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 19802f8112a04f1d94a35a1956188452 Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1486651920-project Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance da3e4266-a9bc-4433-a335-580713bac164 could not be found. Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'da3e4266-a9bc-4433-a335-580713bac164'} Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da3e4266-a9bc-4433-a335-580713bac164 could not be found. Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da3e4266-a9bc-4433-a335-580713bac164 could not be found. Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:12:29.648974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:29.654472 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:12:29.654472 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:29.654472 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:29.654472 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:29.654472 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:12:29.654472 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:12:29.654472 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da3e4266-a9bc-4433-a335-580713bac164 could not be found. Aug 31 16:12:29.654472 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:12:29.654472 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b243fd87-ff20-409e-b5af-faf1032dc552 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] Returning 404 to user: Instance da3e4266-a9bc-4433-a335-580713bac164 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:12:29.654472 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b243fd87-ff20-409e-b5af-faf1032dc552 tempest-ServerRescueTestJSONUnderV235-1486651920 tempest-ServerRescueTestJSONUnderV235-1486651920-project] 10.222.0.50 "GET /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164" status: 404 len: 111 microversion: 2.1 time: 0.042289 Aug 31 16:12:29.654472 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2035/4275] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:29 2022] GET /compute/v2.1/servers/da3e4266-a9bc-4433-a335-580713bac164 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:12:29.655663 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ed143412-7868-4f9a-bc7c-1d2fc68c727e tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:29.655663 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ed143412-7868-4f9a-bc7c-1d2fc68c727e tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:29.656630 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f0ebf714-f3cb-4974-ac5e-4332e5141c2c tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:29.657381 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f0ebf714-f3cb-4974-ac5e-4332e5141c2c tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 5923807d-1058-45ab-b8d1-c6700ea8c142] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:29.664482 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:12:29.666070 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f0ebf714-f3cb-4974-ac5e-4332e5141c2c tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:29.666688 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f0ebf714-f3cb-4974-ac5e-4332e5141c2c tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:29.667215 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f0ebf714-f3cb-4974-ac5e-4332e5141c2c tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:29.669161 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f0ebf714-f3cb-4974-ac5e-4332e5141c2c tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:29.669695 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f0ebf714-f3cb-4974-ac5e-4332e5141c2c tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:29.670209 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f0ebf714-f3cb-4974-ac5e-4332e5141c2c tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:29.673306 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ed143412-7868-4f9a-bc7c-1d2fc68c727e tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:29.677951 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ed143412-7868-4f9a-bc7c-1d2fc68c727e tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:29.678867 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ed143412-7868-4f9a-bc7c-1d2fc68c727e tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:29.681647 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ed143412-7868-4f9a-bc7c-1d2fc68c727e tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:29.803005 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ed143412-7868-4f9a-bc7c-1d2fc68c727e tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:29.803636 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ed143412-7868-4f9a-bc7c-1d2fc68c727e tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:29.804283 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ed143412-7868-4f9a-bc7c-1d2fc68c727e tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:29.806634 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-ed143412-7868-4f9a-bc7c-1d2fc68c727e tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lazy-loading 'fault' on Instance uuid b778dc34-fa8e-4c9e-9cb6-5ececdf1074c {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:12:30.048464 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ed143412-7868-4f9a-bc7c-1d2fc68c727e tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391c4c8e6ae4483e82a247957a6faad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1f95b9a87a4f1389c03f6a3f592a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:30.058475 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ed143412-7868-4f9a-bc7c-1d2fc68c727e tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] 10.222.0.50 "GET /compute/v2.1/servers/b778dc34-fa8e-4c9e-9cb6-5ececdf1074c" status: 200 len: 1312 microversion: 2.1 time: 0.428689 Aug 31 16:12:30.059512 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2241/4276] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:29 2022] GET /compute/v2.1/servers/b778dc34-fa8e-4c9e-9cb6-5ececdf1074c => generated 1312 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:30.065290 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-49c0fd9e-7517-4d09-a0b9-86a989f45e81 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:30.066296 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-49c0fd9e-7517-4d09-a0b9-86a989f45e81 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: b60b7363-fd13-4b81-9c4b-0aabf39c5a6a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:30.081912 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-49c0fd9e-7517-4d09-a0b9-86a989f45e81 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:30.084516 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-49c0fd9e-7517-4d09-a0b9-86a989f45e81 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:30.085216 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-49c0fd9e-7517-4d09-a0b9-86a989f45e81 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:30.086261 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-49c0fd9e-7517-4d09-a0b9-86a989f45e81 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:30.086868 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-49c0fd9e-7517-4d09-a0b9-86a989f45e81 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:30.087432 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-49c0fd9e-7517-4d09-a0b9-86a989f45e81 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:30.237803 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f0ebf714-f3cb-4974-ac5e-4332e5141c2c tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:30.250757 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f0ebf714-f3cb-4974-ac5e-4332e5141c2c tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142" status: 200 len: 1479 microversion: 2.1 time: 0.598441 Aug 31 16:12:30.262675 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2036/4277] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:29 2022] GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142 => generated 1479 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:30.274510 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d1294b8b-5fcd-4764-966b-f14e79f44370 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:30.279196 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d1294b8b-5fcd-4764-966b-f14e79f44370 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: eb6e0169-ac40-4675-b6e9-2a3ea7b13f40] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:30.297376 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d1294b8b-5fcd-4764-966b-f14e79f44370 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:30.300246 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d1294b8b-5fcd-4764-966b-f14e79f44370 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:30.303342 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d1294b8b-5fcd-4764-966b-f14e79f44370 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:30.307432 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d1294b8b-5fcd-4764-966b-f14e79f44370 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:30.307877 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d1294b8b-5fcd-4764-966b-f14e79f44370 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:30.310465 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d1294b8b-5fcd-4764-966b-f14e79f44370 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:30.338491 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:12:30.437680 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-49c0fd9e-7517-4d09-a0b9-86a989f45e81 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:30.446201 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-49c0fd9e-7517-4d09-a0b9-86a989f45e81 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a" status: 200 len: 1517 microversion: 2.1 time: 0.385423 Aug 31 16:12:30.452219 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2242/4278] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:30 2022] GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a => generated 1517 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:30.591740 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d1294b8b-5fcd-4764-966b-f14e79f44370 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:30.592432 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-914f378b-b837-45b8-a89a-978824b8f5d0 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:30.595373 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-914f378b-b837-45b8-a89a-978824b8f5d0 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:30.605153 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-914f378b-b837-45b8-a89a-978824b8f5d0 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:30.605862 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-914f378b-b837-45b8-a89a-978824b8f5d0 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:30.606521 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-914f378b-b837-45b8-a89a-978824b8f5d0 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:30.607233 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-914f378b-b837-45b8-a89a-978824b8f5d0 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:30.607885 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-914f378b-b837-45b8-a89a-978824b8f5d0 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:30.608110 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-914f378b-b837-45b8-a89a-978824b8f5d0 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:30.615096 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d1294b8b-5fcd-4764-966b-f14e79f44370 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/eb6e0169-ac40-4675-b6e9-2a3ea7b13f40" status: 200 len: 1309 microversion: 2.1 time: 0.350906 Aug 31 16:12:30.617455 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2037/4279] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:30 2022] GET /compute/v2.1/servers/eb6e0169-ac40-4675-b6e9-2a3ea7b13f40 => generated 1309 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:31.092520 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-49018fd4-d3cb-48c6-81bb-656094d9d766 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:31.094528 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-49018fd4-d3cb-48c6-81bb-656094d9d766 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] [instance: b778dc34-fa8e-4c9e-9cb6-5ececdf1074c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:31.115091 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49018fd4-d3cb-48c6-81bb-656094d9d766 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:31.115810 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49018fd4-d3cb-48c6-81bb-656094d9d766 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:31.116064 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49018fd4-d3cb-48c6-81bb-656094d9d766 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:31.116884 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49018fd4-d3cb-48c6-81bb-656094d9d766 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:31.118786 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49018fd4-d3cb-48c6-81bb-656094d9d766 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:31.119832 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49018fd4-d3cb-48c6-81bb-656094d9d766 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:31.158838 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-49018fd4-d3cb-48c6-81bb-656094d9d766 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] HTTP exception thrown: Instance b778dc34-fa8e-4c9e-9cb6-5ececdf1074c could not be found. Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-49018fd4-d3cb-48c6-81bb-656094d9d766 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Request method failure captured: Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/b778dc34-fa8e-4c9e-9cb6-5ececdf1074c HTTP/1.1 Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4g0HBrOe3wDfhuaYhqKGu3WkNFVOs6Tovezlwo0yNYaL0Uccq6SS4YieQYY7KJlsHPn_bZ_JeN4ZOREtDj022X92N6opwgAFx4DAKiCiGVqB8N11NaoHAq9VpgmVpbljNeD0639QpPRSmRzilo2IzLt_h5xj5YxHeRUrr0Kc2PLkVI Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: da1f95b9a87a4f1389c03f6a3f592a2e Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ListServersNegativeTestJSON-1597045337 Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/da1f95b9a87a4f1389c03f6a3f592a2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/da1f95b9a87a4f1389c03f6a3f592a2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/da1f95b9a87a4f1389c03f6a3f592a2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_da1f95b9a87a4f1389c03f6a3f592a2e", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ListServersNegativeTestJSON-1597045337 Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: da1f95b9a87a4f1389c03f6a3f592a2e Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1597045337 Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ListServersNegativeTestJSON-1597045337-project Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 391c4c8e6ae4483e82a247957a6faad9 Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ListServersNegativeTestJSON-1597045337-project Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance b778dc34-fa8e-4c9e-9cb6-5ececdf1074c could not be found. Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'b778dc34-fa8e-4c9e-9cb6-5ececdf1074c'} Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b778dc34-fa8e-4c9e-9cb6-5ececdf1074c could not be found. Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b778dc34-fa8e-4c9e-9cb6-5ececdf1074c could not be found. Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:12:31.160900 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:31.176867 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:12:31.176867 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:31.176867 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:31.176867 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:31.176867 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:12:31.176867 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:12:31.176867 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b778dc34-fa8e-4c9e-9cb6-5ececdf1074c could not be found. Aug 31 16:12:31.176867 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:12:31.176867 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-49018fd4-d3cb-48c6-81bb-656094d9d766 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Returning 404 to user: Instance b778dc34-fa8e-4c9e-9cb6-5ececdf1074c could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:12:31.176867 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-49018fd4-d3cb-48c6-81bb-656094d9d766 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] 10.222.0.50 "GET /compute/v2.1/servers/b778dc34-fa8e-4c9e-9cb6-5ececdf1074c" status: 404 len: 111 microversion: 2.1 time: 0.073918 Aug 31 16:12:31.176867 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2038/4280] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:31 2022] GET /compute/v2.1/servers/b778dc34-fa8e-4c9e-9cb6-5ececdf1074c => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:12:31.179584 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-336ad4fc-1ac6-4b09-8b9f-990e88712145 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:31.189789 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-336ad4fc-1ac6-4b09-8b9f-990e88712145 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '391c4c8e6ae4483e82a247957a6faad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1f95b9a87a4f1389c03f6a3f592a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:31.192298 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-336ad4fc-1ac6-4b09-8b9f-990e88712145 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'da1f95b9a87a4f1389c03f6a3f592a2e'} {{(pid=128863) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:12:31.198081 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-336ad4fc-1ac6-4b09-8b9f-990e88712145 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:31.198801 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-336ad4fc-1ac6-4b09-8b9f-990e88712145 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:31.199011 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-336ad4fc-1ac6-4b09-8b9f-990e88712145 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:31.199813 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-336ad4fc-1ac6-4b09-8b9f-990e88712145 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:31.200260 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-336ad4fc-1ac6-4b09-8b9f-990e88712145 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:31.200678 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-336ad4fc-1ac6-4b09-8b9f-990e88712145 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:31.300385 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-336ad4fc-1ac6-4b09-8b9f-990e88712145 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] 10.222.0.50 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.127235 Aug 31 16:12:31.302217 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2039/4281] 10.222.0.50 () {58 vars in 1230 bytes} [Wed Aug 31 16:12:31 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:12:31.302749 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-914f378b-b837-45b8-a89a-978824b8f5d0 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:31.305321 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=100 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:12:31.313461 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-914f378b-b837-45b8-a89a-978824b8f5d0 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f" status: 200 len: 1521 microversion: 2.1 time: 0.732251 Aug 31 16:12:31.315677 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a5000728-a479-460f-968d-aaea3aca1d00 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:31.316306 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a5000728-a479-460f-968d-aaea3aca1d00 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 5923807d-1058-45ab-b8d1-c6700ea8c142] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:31.318741 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2243/4282] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:30 2022] GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f => generated 1521 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:12:31.329852 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a3a0ca48-bd96-45df-a5ee-3c8f03be28bc tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:31.339774 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5000728-a479-460f-968d-aaea3aca1d00 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a3a0ca48-bd96-45df-a5ee-3c8f03be28bc tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Request method failure captured: Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4g0HBrOe3wDfhuaYhqKGu3WkNFVOs6Tovezlwo0yNYaL0Uccq6SS4YieQYY7KJlsHPn_bZ_JeN4ZOREtDj022X92N6opwgAFx4DAKiCiGVqB8N11NaoHAq9VpgmVpbljNeD0639QpPRSmRzilo2IzLt_h5xj5YxHeRUrr0Kc2PLkVI Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: da1f95b9a87a4f1389c03f6a3f592a2e Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ListServersNegativeTestJSON-1597045337 Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/da1f95b9a87a4f1389c03f6a3f592a2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/da1f95b9a87a4f1389c03f6a3f592a2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/da1f95b9a87a4f1389c03f6a3f592a2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_da1f95b9a87a4f1389c03f6a3f592a2e", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ListServersNegativeTestJSON-1597045337 Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: da1f95b9a87a4f1389c03f6a3f592a2e Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1597045337 Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ListServersNegativeTestJSON-1597045337-project Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 391c4c8e6ae4483e82a247957a6faad9 Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ListServersNegativeTestJSON-1597045337-project Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: action_args: {} Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi '2011/01/01' Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 31 16:12:31.340170 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:12:31.345160 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:12:31.345160 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:12:31.345160 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:12:31.345160 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 31 16:12:31.345160 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:12:31.345160 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:31.345160 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:12:31.345160 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:31.345160 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:31.345160 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:31.345160 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:12:31.345160 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:12:31.345160 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 31 16:12:31.345160 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:12:31.346186 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5000728-a479-460f-968d-aaea3aca1d00 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:31.346186 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5000728-a479-460f-968d-aaea3aca1d00 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:31.346186 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5000728-a479-460f-968d-aaea3aca1d00 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:31.346186 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5000728-a479-460f-968d-aaea3aca1d00 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:31.346186 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5000728-a479-460f-968d-aaea3aca1d00 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:31.350215 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a3a0ca48-bd96-45df-a5ee-3c8f03be28bc tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:12:31.351501 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a3a0ca48-bd96-45df-a5ee-3c8f03be28bc tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] 10.222.0.50 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.031527 Aug 31 16:12:31.353086 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2244/4283] 10.222.0.50 () {58 vars in 1182 bytes} [Wed Aug 31 16:12:31 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:12:31.363272 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5ad33c7f-3609-4d0c-845c-d1dece42791f tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:31.374260 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5ad33c7f-3609-4d0c-845c-d1dece42791f tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '391c4c8e6ae4483e82a247957a6faad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1f95b9a87a4f1389c03f6a3f592a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:31.375303 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5ad33c7f-3609-4d0c-845c-d1dece42791f tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Searching by: {'deleted': False, 'project_id': 'da1f95b9a87a4f1389c03f6a3f592a2e'} {{(pid=128864) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:12:31.381557 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5ad33c7f-3609-4d0c-845c-d1dece42791f tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:31.382521 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5ad33c7f-3609-4d0c-845c-d1dece42791f tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:31.383313 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5ad33c7f-3609-4d0c-845c-d1dece42791f tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:31.384242 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5ad33c7f-3609-4d0c-845c-d1dece42791f tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:31.384880 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5ad33c7f-3609-4d0c-845c-d1dece42791f tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:31.385462 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5ad33c7f-3609-4d0c-845c-d1dece42791f tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:31.435333 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.multi_cell_list [None req-5ad33c7f-3609-4d0c-845c-d1dece42791f tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128864) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:12:31.505429 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5ad33c7f-3609-4d0c-845c-d1dece42791f tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.146727 Aug 31 16:12:31.507155 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2245/4284] 10.222.0.50 () {58 vars in 1125 bytes} [Wed Aug 31 16:12:31 2022] GET /compute/v2.1/servers => generated 681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:12:31.513301 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-98e4932d-62ee-4bba-a01c-6ad65f622ebd tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:31.514466 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-98e4932d-62ee-4bba-a01c-6ad65f622ebd tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: b60b7363-fd13-4b81-9c4b-0aabf39c5a6a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:31.522826 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-98e4932d-62ee-4bba-a01c-6ad65f622ebd tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:31.523717 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-98e4932d-62ee-4bba-a01c-6ad65f622ebd tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:31.524327 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-98e4932d-62ee-4bba-a01c-6ad65f622ebd tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:31.525220 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-98e4932d-62ee-4bba-a01c-6ad65f622ebd tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:31.525815 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-98e4932d-62ee-4bba-a01c-6ad65f622ebd tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:31.526421 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-98e4932d-62ee-4bba-a01c-6ad65f622ebd tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:31.838863 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-98e4932d-62ee-4bba-a01c-6ad65f622ebd tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:31.847530 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-98e4932d-62ee-4bba-a01c-6ad65f622ebd tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a" status: 200 len: 1517 microversion: 2.1 time: 0.338913 Aug 31 16:12:31.848193 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2246/4285] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:31 2022] GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a => generated 1517 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:31.853038 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d677b274-4fe8-4bc3-b160-4d21b73a425c tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:31.860073 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d677b274-4fe8-4bc3-b160-4d21b73a425c tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '391c4c8e6ae4483e82a247957a6faad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1f95b9a87a4f1389c03f6a3f592a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:31.860073 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.compute.servers [None req-d677b274-4fe8-4bc3-b160-4d21b73a425c tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Removing options 'limit' from query {{(pid=128864) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 31 16:12:31.864056 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d677b274-4fe8-4bc3-b160-4d21b73a425c tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Searching by: {'deleted': False, 'project_id': 'da1f95b9a87a4f1389c03f6a3f592a2e'} {{(pid=128864) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:12:31.866357 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d677b274-4fe8-4bc3-b160-4d21b73a425c tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:31.866857 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d677b274-4fe8-4bc3-b160-4d21b73a425c tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:31.867294 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d677b274-4fe8-4bc3-b160-4d21b73a425c tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:31.868013 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d677b274-4fe8-4bc3-b160-4d21b73a425c tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:31.868720 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d677b274-4fe8-4bc3-b160-4d21b73a425c tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:31.868887 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d677b274-4fe8-4bc3-b160-4d21b73a425c tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:31.906399 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.multi_cell_list [None req-d677b274-4fe8-4bc3-b160-4d21b73a425c tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=128864) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:12:31.940716 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d677b274-4fe8-4bc3-b160-4d21b73a425c tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] 10.222.0.50 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.090849 Aug 31 16:12:31.950994 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2247/4286] 10.222.0.50 () {58 vars in 1144 bytes} [Wed Aug 31 16:12:31 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:31.956596 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-80ad70c3-1b9a-4877-bb60-0308b6c2510c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:31.957198 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-80ad70c3-1b9a-4877-bb60-0308b6c2510c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: eb6e0169-ac40-4675-b6e9-2a3ea7b13f40] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:31.965627 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-80ad70c3-1b9a-4877-bb60-0308b6c2510c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:31.965627 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-80ad70c3-1b9a-4877-bb60-0308b6c2510c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:31.966166 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-80ad70c3-1b9a-4877-bb60-0308b6c2510c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:31.967625 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-80ad70c3-1b9a-4877-bb60-0308b6c2510c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:31.967625 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-80ad70c3-1b9a-4877-bb60-0308b6c2510c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:31.967625 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-80ad70c3-1b9a-4877-bb60-0308b6c2510c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:31.976965 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a5000728-a479-460f-968d-aaea3aca1d00 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:31.986549 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a5000728-a479-460f-968d-aaea3aca1d00 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142" status: 200 len: 1464 microversion: 2.1 time: 0.674482 Aug 31 16:12:31.987429 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2040/4287] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:31 2022] GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142 => generated 1464 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:31.999106 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2eb0fc11-da22-4484-b321-86296fcfb9fb tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2eb0fc11-da22-4484-b321-86296fcfb9fb tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Request method failure captured: Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4g0HBrOe3wDfhuaYhqKGu3WkNFVOs6Tovezlwo0yNYaL0Uccq6SS4YieQYY7KJlsHPn_bZ_JeN4ZOREtDj022X92N6opwgAFx4DAKiCiGVqB8N11NaoHAq9VpgmVpbljNeD0639QpPRSmRzilo2IzLt_h5xj5YxHeRUrr0Kc2PLkVI Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: da1f95b9a87a4f1389c03f6a3f592a2e Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ListServersNegativeTestJSON-1597045337 Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/da1f95b9a87a4f1389c03f6a3f592a2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/da1f95b9a87a4f1389c03f6a3f592a2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/da1f95b9a87a4f1389c03f6a3f592a2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_da1f95b9a87a4f1389c03f6a3f592a2e", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ListServersNegativeTestJSON-1597045337 Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: da1f95b9a87a4f1389c03f6a3f592a2e Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1597045337 Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ListServersNegativeTestJSON-1597045337-project Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 391c4c8e6ae4483e82a247957a6faad9 Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ListServersNegativeTestJSON-1597045337-project Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: action_args: {} Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi '-1' Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 31 16:12:32.016702 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 31 16:12:32.023663 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:12:32.023663 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:12:32.023663 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:12:32.023663 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:12:32.023663 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 31 16:12:32.023663 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:12:32.023663 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:32.023663 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:12:32.023663 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:32.023663 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:32.023663 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:32.023663 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:12:32.023663 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:12:32.023663 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 31 16:12:32.023663 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:12:32.023663 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2eb0fc11-da22-4484-b321-86296fcfb9fb tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:12:32.023663 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2eb0fc11-da22-4484-b321-86296fcfb9fb tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] 10.222.0.50 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.025293 Aug 31 16:12:32.023663 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2041/4288] 10.222.0.50 () {58 vars in 1142 bytes} [Wed Aug 31 16:12:31 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:12:32.026720 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-731831c5-534d-4c16-8455-05d02d8e2091 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:32.029658 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-731831c5-534d-4c16-8455-05d02d8e2091 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] [instance: 5923807d-1058-45ab-b8d1-c6700ea8c142] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:32.038349 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-731831c5-534d-4c16-8455-05d02d8e2091 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:32.038870 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-731831c5-534d-4c16-8455-05d02d8e2091 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:32.039305 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-731831c5-534d-4c16-8455-05d02d8e2091 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:32.040000 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-731831c5-534d-4c16-8455-05d02d8e2091 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:32.040651 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-731831c5-534d-4c16-8455-05d02d8e2091 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:32.040882 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-731831c5-534d-4c16-8455-05d02d8e2091 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:32.150348 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-731831c5-534d-4c16-8455-05d02d8e2091 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142/action" status: 202 len: 0 microversion: 2.1 time: 0.130508 Aug 31 16:12:32.154768 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2042/4289] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:12:32 2022] POST /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:12:32.161904 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fa1de9a7-2245-4520-9f53-fe31b8014b76 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fa1de9a7-2245-4520-9f53-fe31b8014b76 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Request method failure captured: Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4g0HBrOe3wDfhuaYhqKGu3WkNFVOs6Tovezlwo0yNYaL0Uccq6SS4YieQYY7KJlsHPn_bZ_JeN4ZOREtDj022X92N6opwgAFx4DAKiCiGVqB8N11NaoHAq9VpgmVpbljNeD0639QpPRSmRzilo2IzLt_h5xj5YxHeRUrr0Kc2PLkVI Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: da1f95b9a87a4f1389c03f6a3f592a2e Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ListServersNegativeTestJSON-1597045337 Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/da1f95b9a87a4f1389c03f6a3f592a2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/da1f95b9a87a4f1389c03f6a3f592a2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/da1f95b9a87a4f1389c03f6a3f592a2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_da1f95b9a87a4f1389c03f6a3f592a2e", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ListServersNegativeTestJSON-1597045337 Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: da1f95b9a87a4f1389c03f6a3f592a2e Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1597045337 Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ListServersNegativeTestJSON-1597045337-project Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 391c4c8e6ae4483e82a247957a6faad9 Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ListServersNegativeTestJSON-1597045337-project Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: action_args: {} Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'testing' Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 31 16:12:32.165979 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 31 16:12:32.176240 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:12:32.176240 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:12:32.176240 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:12:32.176240 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:12:32.176240 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 31 16:12:32.176240 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:12:32.176240 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:32.176240 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:12:32.176240 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:32.176240 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:32.176240 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:32.176240 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:12:32.176240 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:12:32.176240 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 31 16:12:32.176240 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:12:32.176240 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fa1de9a7-2245-4520-9f53-fe31b8014b76 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:12:32.176240 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fa1de9a7-2245-4520-9f53-fe31b8014b76 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] 10.222.0.50 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.011902 Aug 31 16:12:32.176240 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2043/4290] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Aug 31 16:12:32 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:12:32.176240 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-67e706c0-0d8d-44d9-9068-7e1d2eea1ef8 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:32.176240 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-67e706c0-0d8d-44d9-9068-7e1d2eea1ef8 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] [instance: 5923807d-1058-45ab-b8d1-c6700ea8c142] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:32.188331 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-67e706c0-0d8d-44d9-9068-7e1d2eea1ef8 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:32.188331 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-67e706c0-0d8d-44d9-9068-7e1d2eea1ef8 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:32.188593 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-67e706c0-0d8d-44d9-9068-7e1d2eea1ef8 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:32.189960 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-67e706c0-0d8d-44d9-9068-7e1d2eea1ef8 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:32.192828 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-67e706c0-0d8d-44d9-9068-7e1d2eea1ef8 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:32.192828 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-67e706c0-0d8d-44d9-9068-7e1d2eea1ef8 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:32.236890 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-67e706c0-0d8d-44d9-9068-7e1d2eea1ef8 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:32.237395 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-67e706c0-0d8d-44d9-9068-7e1d2eea1ef8 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:32.237835 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-67e706c0-0d8d-44d9-9068-7e1d2eea1ef8 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:32.238524 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-67e706c0-0d8d-44d9-9068-7e1d2eea1ef8 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lazy-loading 'fault' on Instance uuid 5923807d-1058-45ab-b8d1-c6700ea8c142 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:12:32.275960 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-80ad70c3-1b9a-4877-bb60-0308b6c2510c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:32.286975 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-80ad70c3-1b9a-4877-bb60-0308b6c2510c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/eb6e0169-ac40-4675-b6e9-2a3ea7b13f40" status: 200 len: 1490 microversion: 2.1 time: 0.334269 Aug 31 16:12:32.307641 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2248/4291] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:31 2022] GET /compute/v2.1/servers/eb6e0169-ac40-4675-b6e9-2a3ea7b13f40 => generated 1490 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:32.314130 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-859a8c51-9992-4523-a354-f7bd390f5085 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:32.321838 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-859a8c51-9992-4523-a354-f7bd390f5085 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '391c4c8e6ae4483e82a247957a6faad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1f95b9a87a4f1389c03f6a3f592a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:32.322552 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-859a8c51-9992-4523-a354-f7bd390f5085 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'da1f95b9a87a4f1389c03f6a3f592a2e'} {{(pid=128864) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:12:32.339462 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.compute.servers [None req-859a8c51-9992-4523-a354-f7bd390f5085 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Flavor 'non_existing_flavor' could not be found {{(pid=128864) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Aug 31 16:12:32.344094 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-859a8c51-9992-4523-a354-f7bd390f5085 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] 10.222.0.50 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.034245 Aug 31 16:12:32.352758 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2249/4292] 10.222.0.50 () {58 vars in 1178 bytes} [Wed Aug 31 16:12:32 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:12:32.355215 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-88d1c7fa-53c1-4f60-8f31-ee92564191ab tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:32.357554 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-88d1c7fa-53c1-4f60-8f31-ee92564191ab tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:32.369304 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-88d1c7fa-53c1-4f60-8f31-ee92564191ab tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:32.370538 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-88d1c7fa-53c1-4f60-8f31-ee92564191ab tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:32.371525 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-88d1c7fa-53c1-4f60-8f31-ee92564191ab tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:32.372963 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-88d1c7fa-53c1-4f60-8f31-ee92564191ab tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:32.373866 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-88d1c7fa-53c1-4f60-8f31-ee92564191ab tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:32.374695 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-88d1c7fa-53c1-4f60-8f31-ee92564191ab tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:32.564109 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-67e706c0-0d8d-44d9-9068-7e1d2eea1ef8 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142" status: 200 len: 1600 microversion: 2.1 time: 0.393911 Aug 31 16:12:32.578621 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2044/4293] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:32 2022] GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142 => generated 1600 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:32.591777 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5fef09b2-f009-492f-a27c-5bcd361c1a4e tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:32.599637 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5fef09b2-f009-492f-a27c-5bcd361c1a4e tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '391c4c8e6ae4483e82a247957a6faad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1f95b9a87a4f1389c03f6a3f592a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:32.600793 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5fef09b2-f009-492f-a27c-5bcd361c1a4e tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'da1f95b9a87a4f1389c03f6a3f592a2e'} {{(pid=128863) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:12:32.619327 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5fef09b2-f009-492f-a27c-5bcd361c1a4e tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:32.629597 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5fef09b2-f009-492f-a27c-5bcd361c1a4e tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:32.630174 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5fef09b2-f009-492f-a27c-5bcd361c1a4e tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:32.631278 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5fef09b2-f009-492f-a27c-5bcd361c1a4e tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:32.632004 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5fef09b2-f009-492f-a27c-5bcd361c1a4e tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:32.632890 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5fef09b2-f009-492f-a27c-5bcd361c1a4e tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:32.769502 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-88d1c7fa-53c1-4f60-8f31-ee92564191ab tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:32.785559 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-88d1c7fa-53c1-4f60-8f31-ee92564191ab tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f" status: 200 len: 1521 microversion: 2.1 time: 0.437033 Aug 31 16:12:32.788914 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2250/4294] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:32 2022] GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f => generated 1521 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:32.794855 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0c47cc6f-b605-432e-ae9f-36ff1d14238e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1438125722", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "00194b7c-6891-4cf9-8c59-235de2b40a38"}]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:32.801687 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5fef09b2-f009-492f-a27c-5bcd361c1a4e tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] 10.222.0.50 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.221409 Aug 31 16:12:32.806255 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2045/4295] 10.222.0.50 () {58 vars in 1174 bytes} [Wed Aug 31 16:12:32 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:12:32.815477 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bef855a3-edaf-4648-b892-9b9596f51d09 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:32.817670 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bef855a3-edaf-4648-b892-9b9596f51d09 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] [instance: 5923807d-1058-45ab-b8d1-c6700ea8c142] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:32.829410 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bef855a3-edaf-4648-b892-9b9596f51d09 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:32.830074 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bef855a3-edaf-4648-b892-9b9596f51d09 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:32.830678 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bef855a3-edaf-4648-b892-9b9596f51d09 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:32.831527 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bef855a3-edaf-4648-b892-9b9596f51d09 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:32.832038 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bef855a3-edaf-4648-b892-9b9596f51d09 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:32.832462 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bef855a3-edaf-4648-b892-9b9596f51d09 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:32.883005 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-0c47cc6f-b605-432e-ae9f-36ff1d14238e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] validate_networks() for [('00194b7c-6891-4cf9-8c59-235de2b40a38', None, None, None, None, None)] {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:12:33.023902 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bef855a3-edaf-4648-b892-9b9596f51d09 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142/action" status: 202 len: 0 microversion: 2.1 time: 0.212867 Aug 31 16:12:33.025274 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2046/4296] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:12:32 2022] POST /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:12:33.031017 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8b8ce051-4b19-4e58-90e6-47afb5968362 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:33.036949 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8b8ce051-4b19-4e58-90e6-47afb5968362 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '391c4c8e6ae4483e82a247957a6faad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1f95b9a87a4f1389c03f6a3f592a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:33.038182 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8b8ce051-4b19-4e58-90e6-47afb5968362 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'da1f95b9a87a4f1389c03f6a3f592a2e'} {{(pid=128863) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:12:33.043905 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b8ce051-4b19-4e58-90e6-47afb5968362 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:33.044554 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b8ce051-4b19-4e58-90e6-47afb5968362 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:33.045131 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b8ce051-4b19-4e58-90e6-47afb5968362 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:33.046487 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b8ce051-4b19-4e58-90e6-47afb5968362 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:33.047089 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b8ce051-4b19-4e58-90e6-47afb5968362 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:33.047773 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b8ce051-4b19-4e58-90e6-47afb5968362 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:33.140537 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8b8ce051-4b19-4e58-90e6-47afb5968362 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] 10.222.0.50 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.114004 Aug 31 16:12:33.152736 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2047/4297] 10.222.0.50 () {58 vars in 1184 bytes} [Wed Aug 31 16:12:33 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:12:33.152736 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3e51d744-0145-4d96-8d87-22389940a896 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:33.152736 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3e51d744-0145-4d96-8d87-22389940a896 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: b60b7363-fd13-4b81-9c4b-0aabf39c5a6a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:33.159331 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e51d744-0145-4d96-8d87-22389940a896 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:33.159977 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e51d744-0145-4d96-8d87-22389940a896 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:33.160591 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e51d744-0145-4d96-8d87-22389940a896 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:33.163456 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e51d744-0145-4d96-8d87-22389940a896 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:33.164036 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e51d744-0145-4d96-8d87-22389940a896 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:33.164702 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e51d744-0145-4d96-8d87-22389940a896 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:33.426132 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3e51d744-0145-4d96-8d87-22389940a896 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:33.434636 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3e51d744-0145-4d96-8d87-22389940a896 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a" status: 200 len: 1517 microversion: 2.1 time: 0.291918 Aug 31 16:12:33.435993 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2048/4298] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:33 2022] GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a => generated 1517 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:33.440195 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-229085c5-1ba7-4608-abba-d0db450fce76 req-c8da50dc-2032-434d-82c8-9e7031daeac0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5923807d-1058-45ab-b8d1-c6700ea8c142", "name": "network-vif-plugged", "status": "completed", "tag": "b92f4d7a-9fe1-49d2-9d35-67e9a518bfc4"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:33.450430 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-229085c5-1ba7-4608-abba-d0db450fce76 req-c8da50dc-2032-434d-82c8-9e7031daeac0 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:33.450913 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-229085c5-1ba7-4608-abba-d0db450fce76 req-c8da50dc-2032-434d-82c8-9e7031daeac0 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:33.451340 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-229085c5-1ba7-4608-abba-d0db450fce76 req-c8da50dc-2032-434d-82c8-9e7031daeac0 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:33.469052 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-229085c5-1ba7-4608-abba-d0db450fce76 req-c8da50dc-2032-434d-82c8-9e7031daeac0 service nova] Creating event network-vif-plugged:b92f4d7a-9fe1-49d2-9d35-67e9a518bfc4 for instance 5923807d-1058-45ab-b8d1-c6700ea8c142 on n-h2-833090-16 Aug 31 16:12:33.489110 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-229085c5-1ba7-4608-abba-d0db450fce76 req-c8da50dc-2032-434d-82c8-9e7031daeac0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052186 Aug 31 16:12:33.496661 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2049/4299] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:33.501864 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3487526c-034f-4394-a128-bfaa84176666 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:33.506113 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3487526c-034f-4394-a128-bfaa84176666 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] [instance: 5923807d-1058-45ab-b8d1-c6700ea8c142] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:33.519154 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3487526c-034f-4394-a128-bfaa84176666 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:33.520208 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3487526c-034f-4394-a128-bfaa84176666 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:33.520338 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3487526c-034f-4394-a128-bfaa84176666 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:33.521111 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3487526c-034f-4394-a128-bfaa84176666 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:33.522466 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3487526c-034f-4394-a128-bfaa84176666 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:33.523013 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3487526c-034f-4394-a128-bfaa84176666 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:33.844997 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3487526c-034f-4394-a128-bfaa84176666 tempest-ServersAdminTestJSON-1659791783 tempest-ServersAdminTestJSON-1659791783-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142" status: 200 len: 1617 microversion: 2.1 time: 0.346185 Aug 31 16:12:33.863221 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2050/4300] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:33 2022] GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142 => generated 1617 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:33.878497 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b49121e4-f687-4ca9-8854-d4ed8ce1bde5 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:33.885824 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b49121e4-f687-4ca9-8854-d4ed8ce1bde5 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '391c4c8e6ae4483e82a247957a6faad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1f95b9a87a4f1389c03f6a3f592a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:33.887954 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b49121e4-f687-4ca9-8854-d4ed8ce1bde5 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Searching by: {'deleted': False, 'project_id': 'da1f95b9a87a4f1389c03f6a3f592a2e'} {{(pid=128863) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:12:33.898965 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b49121e4-f687-4ca9-8854-d4ed8ce1bde5 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:33.899187 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b49121e4-f687-4ca9-8854-d4ed8ce1bde5 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:33.899944 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b49121e4-f687-4ca9-8854-d4ed8ce1bde5 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:33.900300 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b49121e4-f687-4ca9-8854-d4ed8ce1bde5 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:33.900761 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b49121e4-f687-4ca9-8854-d4ed8ce1bde5 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:33.901293 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b49121e4-f687-4ca9-8854-d4ed8ce1bde5 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:33.908837 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-0c47cc6f-b605-432e-ae9f-36ff1d14238e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:12:33.910815 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-0c47cc6f-b605-432e-ae9f-36ff1d14238e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:12:33.911371 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-0c47cc6f-b605-432e-ae9f-36ff1d14238e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:12:33.911841 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-0c47cc6f-b605-432e-ae9f-36ff1d14238e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:12:33.912337 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-0c47cc6f-b605-432e-ae9f-36ff1d14238e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:12:33.924668 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0c47cc6f-b605-432e-ae9f-36ff1d14238e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:33.925829 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0c47cc6f-b605-432e-ae9f-36ff1d14238e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:33.927001 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0c47cc6f-b605-432e-ae9f-36ff1d14238e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:33.928016 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0c47cc6f-b605-432e-ae9f-36ff1d14238e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:33.928724 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0c47cc6f-b605-432e-ae9f-36ff1d14238e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:33.929394 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0c47cc6f-b605-432e-ae9f-36ff1d14238e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:33.932882 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.multi_cell_list [None req-b49121e4-f687-4ca9-8854-d4ed8ce1bde5 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128863) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:12:33.971566 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b49121e4-f687-4ca9-8854-d4ed8ce1bde5 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391c4c8e6ae4483e82a247957a6faad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1f95b9a87a4f1389c03f6a3f592a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:33.972781 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-0c47cc6f-b605-432e-ae9f-36ff1d14238e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Getting quotas for project 84f42648e1a343b9a5ab9b89c91bea0d. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:12:33.978621 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b49121e4-f687-4ca9-8854-d4ed8ce1bde5 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:33.978907 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b49121e4-f687-4ca9-8854-d4ed8ce1bde5 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:33.979332 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b49121e4-f687-4ca9-8854-d4ed8ce1bde5 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:34.014190 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-0c47cc6f-b605-432e-ae9f-36ff1d14238e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Getting quotas for user 3ebce87993504550914c2c3702eebb17 and project 84f42648e1a343b9a5ab9b89c91bea0d. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:12:34.033046 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0c47cc6f-b605-432e-ae9f-36ff1d14238e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:12:34.036271 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0c47cc6f-b605-432e-ae9f-36ff1d14238e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ddb49409-d019-4682-b5c4-2d9b09cf7f9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:12:34.118481 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0c47cc6f-b605-432e-ae9f-36ff1d14238e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.328178 Aug 31 16:12:34.119231 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2251/4301] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:12:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1330 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:12:34.131612 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b2817db2-2f60-400c-a98a-8c20a182187d tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:34.132231 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b2817db2-2f60-400c-a98a-8c20a182187d tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:34.137418 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b49121e4-f687-4ca9-8854-d4ed8ce1bde5 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] 10.222.0.50 "GET /compute/v2.1/servers/detail" status: 200 len: 3023 microversion: 2.1 time: 0.272357 Aug 31 16:12:34.138420 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2051/4302] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 31 16:12:33 2022] GET /compute/v2.1/servers/detail => generated 3023 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:34.140073 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b2817db2-2f60-400c-a98a-8c20a182187d tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:34.140567 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b2817db2-2f60-400c-a98a-8c20a182187d tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:34.141005 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b2817db2-2f60-400c-a98a-8c20a182187d tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:34.141740 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b2817db2-2f60-400c-a98a-8c20a182187d tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:34.142332 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b2817db2-2f60-400c-a98a-8c20a182187d tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:34.142811 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b2817db2-2f60-400c-a98a-8c20a182187d tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:34.144232 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0e97910f-ea13-4c5a-957c-010ac1f42599 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:34.145088 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0e97910f-ea13-4c5a-957c-010ac1f42599 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 817afb89-f414-4d1d-bc89-5357dd4e1cb8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:34.163949 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e97910f-ea13-4c5a-957c-010ac1f42599 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:34.167609 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e97910f-ea13-4c5a-957c-010ac1f42599 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:34.173535 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e97910f-ea13-4c5a-957c-010ac1f42599 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:34.178945 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e97910f-ea13-4c5a-957c-010ac1f42599 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:34.182594 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e97910f-ea13-4c5a-957c-010ac1f42599 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:34.183064 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e97910f-ea13-4c5a-957c-010ac1f42599 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:34.247534 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0e97910f-ea13-4c5a-957c-010ac1f42599 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 817afb89-f414-4d1d-bc89-5357dd4e1cb8] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:12:34.440261 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0e97910f-ea13-4c5a-957c-010ac1f42599 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "DELETE /compute/v2.1/servers/817afb89-f414-4d1d-bc89-5357dd4e1cb8" status: 204 len: 0 microversion: 2.1 time: 0.300358 Aug 31 16:12:34.441667 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2052/4303] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:12:34 2022] DELETE /compute/v2.1/servers/817afb89-f414-4d1d-bc89-5357dd4e1cb8 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:12:34.449097 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9e6cbfc1-49bf-469e-8339-c29a277e2217 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:34.450873 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9e6cbfc1-49bf-469e-8339-c29a277e2217 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ddb49409-d019-4682-b5c4-2d9b09cf7f9d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:34.492621 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b2817db2-2f60-400c-a98a-8c20a182187d tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:34.503113 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b2817db2-2f60-400c-a98a-8c20a182187d tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f" status: 200 len: 1521 microversion: 2.1 time: 0.375811 Aug 31 16:12:34.504345 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2252/4304] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:34 2022] GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f => generated 1521 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:34.510162 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6aa04fd0-3fd1-48ee-8087-4cd1152d07b5 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:34.517363 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6aa04fd0-3fd1-48ee-8087-4cd1152d07b5 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '391c4c8e6ae4483e82a247957a6faad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1f95b9a87a4f1389c03f6a3f592a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:34.521098 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6aa04fd0-3fd1-48ee-8087-4cd1152d07b5 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] 10.222.0.50 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.015230 Aug 31 16:12:34.532906 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2253/4305] 10.222.0.50 () {58 vars in 1178 bytes} [Wed Aug 31 16:12:34 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:12:34.532906 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b12c09b3-0946-40e6-ad7b-d2b60268527a tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:34.532906 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b12c09b3-0946-40e6-ad7b-d2b60268527a tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 817afb89-f414-4d1d-bc89-5357dd4e1cb8] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:34.552110 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b12c09b3-0946-40e6-ad7b-d2b60268527a tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:34.552628 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b12c09b3-0946-40e6-ad7b-d2b60268527a tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:34.553277 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b12c09b3-0946-40e6-ad7b-d2b60268527a tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:34.554061 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b12c09b3-0946-40e6-ad7b-d2b60268527a tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:34.554556 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b12c09b3-0946-40e6-ad7b-d2b60268527a tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:34.554998 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b12c09b3-0946-40e6-ad7b-d2b60268527a tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:34.580850 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9e6cbfc1-49bf-469e-8339-c29a277e2217 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:34.588814 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9e6cbfc1-49bf-469e-8339-c29a277e2217 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/ddb49409-d019-4682-b5c4-2d9b09cf7f9d" status: 200 len: 1209 microversion: 2.1 time: 0.144925 Aug 31 16:12:34.589357 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2053/4306] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:34 2022] GET /compute/v2.1/servers/ddb49409-d019-4682-b5c4-2d9b09cf7f9d => generated 1209 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:34.595659 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3dd6f2b7-916d-48f7-add2-5334416650fb tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:34.596562 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3dd6f2b7-916d-48f7-add2-5334416650fb tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: b60b7363-fd13-4b81-9c4b-0aabf39c5a6a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:34.605163 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3dd6f2b7-916d-48f7-add2-5334416650fb tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:34.606531 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3dd6f2b7-916d-48f7-add2-5334416650fb tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:34.607126 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3dd6f2b7-916d-48f7-add2-5334416650fb tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:34.608177 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3dd6f2b7-916d-48f7-add2-5334416650fb tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:34.609193 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3dd6f2b7-916d-48f7-add2-5334416650fb tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:34.609793 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3dd6f2b7-916d-48f7-add2-5334416650fb tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:34.833182 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b12c09b3-0946-40e6-ad7b-d2b60268527a tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:34.842377 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b12c09b3-0946-40e6-ad7b-d2b60268527a tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/817afb89-f414-4d1d-bc89-5357dd4e1cb8" status: 200 len: 1470 microversion: 2.1 time: 0.318761 Aug 31 16:12:34.845382 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2254/4307] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:34 2022] GET /compute/v2.1/servers/817afb89-f414-4d1d-bc89-5357dd4e1cb8 => generated 1470 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:34.864321 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3dd6f2b7-916d-48f7-add2-5334416650fb tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:34.868228 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:12:34.874477 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3dd6f2b7-916d-48f7-add2-5334416650fb tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a" status: 200 len: 1517 microversion: 2.1 time: 0.283242 Aug 31 16:12:34.874986 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c91aa2c6-dc12-42cb-8547-97e26a01ec7f tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:34.880873 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2054/4308] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:34 2022] GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a => generated 1517 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:34.887210 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c91aa2c6-dc12-42cb-8547-97e26a01ec7f tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '391c4c8e6ae4483e82a247957a6faad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1f95b9a87a4f1389c03f6a3f592a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:34.888361 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c91aa2c6-dc12-42cb-8547-97e26a01ec7f tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Searching by: {'deleted': False, 'project_id': 'da1f95b9a87a4f1389c03f6a3f592a2e'} {{(pid=128864) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:12:34.900448 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c91aa2c6-dc12-42cb-8547-97e26a01ec7f tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:34.901013 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c91aa2c6-dc12-42cb-8547-97e26a01ec7f tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:34.901448 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c91aa2c6-dc12-42cb-8547-97e26a01ec7f tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:34.902365 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c91aa2c6-dc12-42cb-8547-97e26a01ec7f tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:34.903002 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c91aa2c6-dc12-42cb-8547-97e26a01ec7f tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:34.903613 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c91aa2c6-dc12-42cb-8547-97e26a01ec7f tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:34.936947 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.multi_cell_list [None req-c91aa2c6-dc12-42cb-8547-97e26a01ec7f tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128864) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:12:34.967634 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c91aa2c6-dc12-42cb-8547-97e26a01ec7f tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.120349 Aug 31 16:12:34.968210 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2255/4309] 10.222.0.50 () {58 vars in 1125 bytes} [Wed Aug 31 16:12:34 2022] GET /compute/v2.1/servers => generated 681 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:34.981382 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5285ba9f-3878-4651-b59e-8b2792021d07 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:34.981930 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5285ba9f-3878-4651-b59e-8b2792021d07 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] [instance: b778dc34-fa8e-4c9e-9cb6-5ececdf1074c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:34.989483 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5285ba9f-3878-4651-b59e-8b2792021d07 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:34.989999 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5285ba9f-3878-4651-b59e-8b2792021d07 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:34.990494 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5285ba9f-3878-4651-b59e-8b2792021d07 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:34.991189 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5285ba9f-3878-4651-b59e-8b2792021d07 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:34.991667 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5285ba9f-3878-4651-b59e-8b2792021d07 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:34.992086 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5285ba9f-3878-4651-b59e-8b2792021d07 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:35.007113 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-5285ba9f-3878-4651-b59e-8b2792021d07 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] HTTP exception thrown: Instance b778dc34-fa8e-4c9e-9cb6-5ececdf1074c could not be found. Aug 31 16:12:35.008800 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5285ba9f-3878-4651-b59e-8b2792021d07 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Request method failure captured: Aug 31 16:12:35.008800 n-d-833090-16 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/b778dc34-fa8e-4c9e-9cb6-5ececdf1074c HTTP/1.1 Aug 31 16:12:35.008800 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:12:35.008800 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:12:35.008800 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:12:35.008800 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:12:35.008800 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:12:35.008800 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:12:35.008800 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:12:35.008800 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:12:35.008800 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4g0HBrOe3wDfhuaYhqKGu3WkNFVOs6Tovezlwo0yNYaL0Uccq6SS4YieQYY7KJlsHPn_bZ_JeN4ZOREtDj022X92N6opwgAFx4DAKiCiGVqB8N11NaoHAq9VpgmVpbljNeD0639QpPRSmRzilo2IzLt_h5xj5YxHeRUrr0Kc2PLkVI Aug 31 16:12:35.008800 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:12:35.008800 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:12:35.008800 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:12:35.008800 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:12:35.008800 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:12:35.008800 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:12:35.008800 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: da1f95b9a87a4f1389c03f6a3f592a2e Aug 31 16:12:35.008800 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ListServersNegativeTestJSON-1597045337 Aug 31 16:12:35.008800 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:12:35.008800 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:12:35.008800 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/da1f95b9a87a4f1389c03f6a3f592a2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/da1f95b9a87a4f1389c03f6a3f592a2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/da1f95b9a87a4f1389c03f6a3f592a2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_da1f95b9a87a4f1389c03f6a3f592a2e", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:12:35.008800 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ListServersNegativeTestJSON-1597045337 Aug 31 16:12:35.008800 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: da1f95b9a87a4f1389c03f6a3f592a2e Aug 31 16:12:35.008800 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1597045337 Aug 31 16:12:35.008800 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ListServersNegativeTestJSON-1597045337-project Aug 31 16:12:35.008800 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:12:35.008800 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:12:35.008800 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 391c4c8e6ae4483e82a247957a6faad9 Aug 31 16:12:35.008800 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ListServersNegativeTestJSON-1597045337-project Aug 31 16:12:35.008800 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:12:35.008800 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance b778dc34-fa8e-4c9e-9cb6-5ececdf1074c could not be found. Aug 31 16:12:35.008800 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'b778dc34-fa8e-4c9e-9cb6-5ececdf1074c'} Aug 31 16:12:35.008800 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:12:35.008800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:35.008800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:12:35.008800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:12:35.008800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:12:35.008800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:12:35.008800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:12:35.008800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:12:35.008800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:12:35.008800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:12:35.008800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b778dc34-fa8e-4c9e-9cb6-5ececdf1074c could not be found. Aug 31 16:12:35.008800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:12:35.008800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:35.008800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:12:35.008800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:35.008800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:35.008800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:35.008800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:12:35.008800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:12:35.008800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:12:35.008800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:12:35.008800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:12:35.008800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:12:35.008800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:12:35.008800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:12:35.008800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:12:35.008800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:12:35.008800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:12:35.008800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:12:35.013314 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b778dc34-fa8e-4c9e-9cb6-5ececdf1074c could not be found. Aug 31 16:12:35.013314 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:12:35.013314 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:35.013314 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:12:35.013314 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:35.013314 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:35.013314 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:35.013314 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:12:35.013314 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:12:35.013314 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b778dc34-fa8e-4c9e-9cb6-5ececdf1074c could not be found. Aug 31 16:12:35.013314 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:12:35.013314 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5285ba9f-3878-4651-b59e-8b2792021d07 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Returning 404 to user: Instance b778dc34-fa8e-4c9e-9cb6-5ececdf1074c could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:12:35.013314 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5285ba9f-3878-4651-b59e-8b2792021d07 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b778dc34-fa8e-4c9e-9cb6-5ececdf1074c" status: 404 len: 111 microversion: 2.1 time: 0.032904 Aug 31 16:12:35.014395 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2055/4310] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:12:34 2022] DELETE /compute/v2.1/servers/b778dc34-fa8e-4c9e-9cb6-5ececdf1074c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:12:35.020110 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-91d01cf2-e7df-4858-8898-a7cfffeaa698 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:35.020705 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-91d01cf2-e7df-4858-8898-a7cfffeaa698 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] [instance: 4754015c-cda0-4f0a-9096-06bebe3d33b1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:35.027623 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91d01cf2-e7df-4858-8898-a7cfffeaa698 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:35.028122 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91d01cf2-e7df-4858-8898-a7cfffeaa698 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:35.028527 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91d01cf2-e7df-4858-8898-a7cfffeaa698 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:35.029414 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91d01cf2-e7df-4858-8898-a7cfffeaa698 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:35.029871 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91d01cf2-e7df-4858-8898-a7cfffeaa698 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:35.030314 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91d01cf2-e7df-4858-8898-a7cfffeaa698 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:35.057226 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-91d01cf2-e7df-4858-8898-a7cfffeaa698 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] [instance: 4754015c-cda0-4f0a-9096-06bebe3d33b1] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:12:35.153466 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-91d01cf2-e7df-4858-8898-a7cfffeaa698 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] 10.222.0.50 "DELETE /compute/v2.1/servers/4754015c-cda0-4f0a-9096-06bebe3d33b1" status: 204 len: 0 microversion: 2.1 time: 0.136867 Aug 31 16:12:35.154297 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2256/4311] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:12:35 2022] DELETE /compute/v2.1/servers/4754015c-cda0-4f0a-9096-06bebe3d33b1 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:12:35.162322 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1f6e961f-e6e7-4c23-b922-2ac9f92b6ff1 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:35.162870 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1f6e961f-e6e7-4c23-b922-2ac9f92b6ff1 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] [instance: 2af572bd-8a8b-4db7-9196-7203de031375] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:35.169826 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f6e961f-e6e7-4c23-b922-2ac9f92b6ff1 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:35.170379 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f6e961f-e6e7-4c23-b922-2ac9f92b6ff1 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:35.170966 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f6e961f-e6e7-4c23-b922-2ac9f92b6ff1 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:35.171672 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f6e961f-e6e7-4c23-b922-2ac9f92b6ff1 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:35.172127 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f6e961f-e6e7-4c23-b922-2ac9f92b6ff1 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:35.172552 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f6e961f-e6e7-4c23-b922-2ac9f92b6ff1 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:35.198602 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1f6e961f-e6e7-4c23-b922-2ac9f92b6ff1 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] [instance: 2af572bd-8a8b-4db7-9196-7203de031375] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:12:35.288621 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1f6e961f-e6e7-4c23-b922-2ac9f92b6ff1 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] 10.222.0.50 "DELETE /compute/v2.1/servers/2af572bd-8a8b-4db7-9196-7203de031375" status: 204 len: 0 microversion: 2.1 time: 0.130021 Aug 31 16:12:35.289498 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2056/4312] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:12:35 2022] DELETE /compute/v2.1/servers/2af572bd-8a8b-4db7-9196-7203de031375 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:12:35.299303 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6517ece8-3daa-42ae-b270-9ada135fe95c tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:35.300058 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6517ece8-3daa-42ae-b270-9ada135fe95c tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] [instance: b778dc34-fa8e-4c9e-9cb6-5ececdf1074c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:35.314886 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6517ece8-3daa-42ae-b270-9ada135fe95c tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:35.315860 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6517ece8-3daa-42ae-b270-9ada135fe95c tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:35.316843 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6517ece8-3daa-42ae-b270-9ada135fe95c tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:35.318676 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6517ece8-3daa-42ae-b270-9ada135fe95c tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:35.320832 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6517ece8-3daa-42ae-b270-9ada135fe95c tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:35.321751 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6517ece8-3daa-42ae-b270-9ada135fe95c tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:35.345055 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-6517ece8-3daa-42ae-b270-9ada135fe95c tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] HTTP exception thrown: Instance b778dc34-fa8e-4c9e-9cb6-5ececdf1074c could not be found. Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6517ece8-3daa-42ae-b270-9ada135fe95c tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Request method failure captured: Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/b778dc34-fa8e-4c9e-9cb6-5ececdf1074c HTTP/1.1 Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4g0HBrOe3wDfhuaYhqKGu3WkNFVOs6Tovezlwo0yNYaL0Uccq6SS4YieQYY7KJlsHPn_bZ_JeN4ZOREtDj022X92N6opwgAFx4DAKiCiGVqB8N11NaoHAq9VpgmVpbljNeD0639QpPRSmRzilo2IzLt_h5xj5YxHeRUrr0Kc2PLkVI Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: da1f95b9a87a4f1389c03f6a3f592a2e Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ListServersNegativeTestJSON-1597045337 Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/da1f95b9a87a4f1389c03f6a3f592a2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/da1f95b9a87a4f1389c03f6a3f592a2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/da1f95b9a87a4f1389c03f6a3f592a2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_da1f95b9a87a4f1389c03f6a3f592a2e", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ListServersNegativeTestJSON-1597045337 Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: da1f95b9a87a4f1389c03f6a3f592a2e Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1597045337 Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ListServersNegativeTestJSON-1597045337-project Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 391c4c8e6ae4483e82a247957a6faad9 Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ListServersNegativeTestJSON-1597045337-project Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance b778dc34-fa8e-4c9e-9cb6-5ececdf1074c could not be found. Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'b778dc34-fa8e-4c9e-9cb6-5ececdf1074c'} Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b778dc34-fa8e-4c9e-9cb6-5ececdf1074c could not be found. Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b778dc34-fa8e-4c9e-9cb6-5ececdf1074c could not be found. Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:12:35.352306 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:35.357767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:12:35.357767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:35.357767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:35.357767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:35.357767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:12:35.357767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:12:35.357767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b778dc34-fa8e-4c9e-9cb6-5ececdf1074c could not be found. Aug 31 16:12:35.357767 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:12:35.357767 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6517ece8-3daa-42ae-b270-9ada135fe95c tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Returning 404 to user: Instance b778dc34-fa8e-4c9e-9cb6-5ececdf1074c could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:12:35.357767 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6517ece8-3daa-42ae-b270-9ada135fe95c tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] 10.222.0.50 "GET /compute/v2.1/servers/b778dc34-fa8e-4c9e-9cb6-5ececdf1074c" status: 404 len: 111 microversion: 2.1 time: 0.059556 Aug 31 16:12:35.361627 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2257/4313] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:35 2022] GET /compute/v2.1/servers/b778dc34-fa8e-4c9e-9cb6-5ececdf1074c => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:12:35.365639 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4888f889-0e1d-4976-8782-37b6f66804f5 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:35.366396 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4888f889-0e1d-4976-8782-37b6f66804f5 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] [instance: 4754015c-cda0-4f0a-9096-06bebe3d33b1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:35.379556 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4888f889-0e1d-4976-8782-37b6f66804f5 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:35.380310 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4888f889-0e1d-4976-8782-37b6f66804f5 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:35.380936 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4888f889-0e1d-4976-8782-37b6f66804f5 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:35.381841 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4888f889-0e1d-4976-8782-37b6f66804f5 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:35.382478 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4888f889-0e1d-4976-8782-37b6f66804f5 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:35.383064 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4888f889-0e1d-4976-8782-37b6f66804f5 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:35.529112 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a63a5f95-ea6f-4113-9182-51c3d79931a1 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:35.529680 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a63a5f95-ea6f-4113-9182-51c3d79931a1 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:35.541192 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a63a5f95-ea6f-4113-9182-51c3d79931a1 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:35.546040 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a63a5f95-ea6f-4113-9182-51c3d79931a1 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:35.546661 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a63a5f95-ea6f-4113-9182-51c3d79931a1 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:35.547421 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a63a5f95-ea6f-4113-9182-51c3d79931a1 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:35.547896 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a63a5f95-ea6f-4113-9182-51c3d79931a1 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:35.548327 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a63a5f95-ea6f-4113-9182-51c3d79931a1 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:35.665286 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4888f889-0e1d-4976-8782-37b6f66804f5 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391c4c8e6ae4483e82a247957a6faad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1f95b9a87a4f1389c03f6a3f592a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:35.678981 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4888f889-0e1d-4976-8782-37b6f66804f5 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] 10.222.0.50 "GET /compute/v2.1/servers/4754015c-cda0-4f0a-9096-06bebe3d33b1" status: 200 len: 1521 microversion: 2.1 time: 0.317903 Aug 31 16:12:35.685261 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2057/4314] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:35 2022] GET /compute/v2.1/servers/4754015c-cda0-4f0a-9096-06bebe3d33b1 => generated 1521 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:35.692950 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-92c36ee9-cd62-4804-b99f-80569ce0912b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:35.693794 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-92c36ee9-cd62-4804-b99f-80569ce0912b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ddb49409-d019-4682-b5c4-2d9b09cf7f9d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:35.721304 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92c36ee9-cd62-4804-b99f-80569ce0912b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:35.721770 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92c36ee9-cd62-4804-b99f-80569ce0912b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:35.722686 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92c36ee9-cd62-4804-b99f-80569ce0912b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:35.724219 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92c36ee9-cd62-4804-b99f-80569ce0912b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:35.724979 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92c36ee9-cd62-4804-b99f-80569ce0912b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:35.725412 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-92c36ee9-cd62-4804-b99f-80569ce0912b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:35.805038 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a63a5f95-ea6f-4113-9182-51c3d79931a1 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:35.815847 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a63a5f95-ea6f-4113-9182-51c3d79931a1 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f" status: 200 len: 1521 microversion: 2.1 time: 0.291934 Aug 31 16:12:35.832989 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2258/4315] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:35 2022] GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f => generated 1521 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:12:35.840431 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-92c36ee9-cd62-4804-b99f-80569ce0912b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:35.850966 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-92c36ee9-cd62-4804-b99f-80569ce0912b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/ddb49409-d019-4682-b5c4-2d9b09cf7f9d" status: 200 len: 1213 microversion: 2.1 time: 0.164225 Aug 31 16:12:35.852207 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2058/4316] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:35 2022] GET /compute/v2.1/servers/ddb49409-d019-4682-b5c4-2d9b09cf7f9d => generated 1213 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:35.867221 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7f0f558e-39da-40eb-a04c-452ac29ea9f0 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:35.867996 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7f0f558e-39da-40eb-a04c-452ac29ea9f0 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 817afb89-f414-4d1d-bc89-5357dd4e1cb8] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:35.874789 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f0f558e-39da-40eb-a04c-452ac29ea9f0 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:35.875401 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f0f558e-39da-40eb-a04c-452ac29ea9f0 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:35.875936 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f0f558e-39da-40eb-a04c-452ac29ea9f0 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:35.876728 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f0f558e-39da-40eb-a04c-452ac29ea9f0 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:35.877269 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f0f558e-39da-40eb-a04c-452ac29ea9f0 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:35.877780 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f0f558e-39da-40eb-a04c-452ac29ea9f0 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:35.904939 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-98298f2a-e163-4bfb-afa0-bf8c08201889 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:35.906147 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-98298f2a-e163-4bfb-afa0-bf8c08201889 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: b60b7363-fd13-4b81-9c4b-0aabf39c5a6a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:35.913596 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98298f2a-e163-4bfb-afa0-bf8c08201889 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:35.914124 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98298f2a-e163-4bfb-afa0-bf8c08201889 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:35.914685 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98298f2a-e163-4bfb-afa0-bf8c08201889 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:35.915391 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98298f2a-e163-4bfb-afa0-bf8c08201889 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:35.915852 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98298f2a-e163-4bfb-afa0-bf8c08201889 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:35.916277 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98298f2a-e163-4bfb-afa0-bf8c08201889 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:36.182197 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7f0f558e-39da-40eb-a04c-452ac29ea9f0 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:36.186018 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-98298f2a-e163-4bfb-afa0-bf8c08201889 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:36.197836 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7f0f558e-39da-40eb-a04c-452ac29ea9f0 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/817afb89-f414-4d1d-bc89-5357dd4e1cb8" status: 200 len: 1470 microversion: 2.1 time: 0.334830 Aug 31 16:12:36.202643 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-98298f2a-e163-4bfb-afa0-bf8c08201889 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a" status: 200 len: 1517 microversion: 2.1 time: 0.302002 Aug 31 16:12:36.203587 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2259/4317] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:35 2022] GET /compute/v2.1/servers/817afb89-f414-4d1d-bc89-5357dd4e1cb8 => generated 1470 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:36.204393 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2059/4318] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:35 2022] GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a => generated 1517 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:12:36.704541 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-303e74dc-cf30-48d0-bf16-0b109335879f tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:36.706180 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-303e74dc-cf30-48d0-bf16-0b109335879f tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] [instance: 4754015c-cda0-4f0a-9096-06bebe3d33b1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:36.713783 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-303e74dc-cf30-48d0-bf16-0b109335879f tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:36.715150 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-303e74dc-cf30-48d0-bf16-0b109335879f tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:36.716999 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-303e74dc-cf30-48d0-bf16-0b109335879f tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:36.717875 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-303e74dc-cf30-48d0-bf16-0b109335879f tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:36.718593 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-303e74dc-cf30-48d0-bf16-0b109335879f tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:36.719383 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-303e74dc-cf30-48d0-bf16-0b109335879f tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:36.847757 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1fd2c906-0634-4313-885c-2fa77d36a654 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:36.854515 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1fd2c906-0634-4313-885c-2fa77d36a654 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:36.873583 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1fd2c906-0634-4313-885c-2fa77d36a654 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:36.874083 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1fd2c906-0634-4313-885c-2fa77d36a654 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:36.874565 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1fd2c906-0634-4313-885c-2fa77d36a654 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:36.882955 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1fd2c906-0634-4313-885c-2fa77d36a654 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:36.883527 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1fd2c906-0634-4313-885c-2fa77d36a654 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:36.884043 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1fd2c906-0634-4313-885c-2fa77d36a654 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:36.965943 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-303e74dc-cf30-48d0-bf16-0b109335879f tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391c4c8e6ae4483e82a247957a6faad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1f95b9a87a4f1389c03f6a3f592a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:36.976842 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-303e74dc-cf30-48d0-bf16-0b109335879f tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] 10.222.0.50 "GET /compute/v2.1/servers/4754015c-cda0-4f0a-9096-06bebe3d33b1" status: 200 len: 1521 microversion: 2.1 time: 0.276431 Aug 31 16:12:36.977831 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2260/4319] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:36 2022] GET /compute/v2.1/servers/4754015c-cda0-4f0a-9096-06bebe3d33b1 => generated 1521 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:36.983046 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-614f0a50-cb73-496c-ae39-e659e87c2681 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:36.984340 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-614f0a50-cb73-496c-ae39-e659e87c2681 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ddb49409-d019-4682-b5c4-2d9b09cf7f9d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:36.992248 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-614f0a50-cb73-496c-ae39-e659e87c2681 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:36.993096 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-614f0a50-cb73-496c-ae39-e659e87c2681 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:36.993656 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-614f0a50-cb73-496c-ae39-e659e87c2681 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:36.994541 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-614f0a50-cb73-496c-ae39-e659e87c2681 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:36.995327 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-614f0a50-cb73-496c-ae39-e659e87c2681 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:36.996021 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-614f0a50-cb73-496c-ae39-e659e87c2681 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:37.101255 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-614f0a50-cb73-496c-ae39-e659e87c2681 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:37.137995 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-614f0a50-cb73-496c-ae39-e659e87c2681 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/ddb49409-d019-4682-b5c4-2d9b09cf7f9d" status: 200 len: 1261 microversion: 2.1 time: 0.158586 Aug 31 16:12:37.138723 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2261/4320] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:36 2022] GET /compute/v2.1/servers/ddb49409-d019-4682-b5c4-2d9b09cf7f9d => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:37.169661 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1fd2c906-0634-4313-885c-2fa77d36a654 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:37.182554 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1fd2c906-0634-4313-885c-2fa77d36a654 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f" status: 200 len: 1521 microversion: 2.1 time: 0.346003 Aug 31 16:12:37.183135 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2060/4321] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:36 2022] GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f => generated 1521 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:37.225047 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-941cd141-049f-49e2-969c-150e61163a3e tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:37.225670 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-941cd141-049f-49e2-969c-150e61163a3e tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: b60b7363-fd13-4b81-9c4b-0aabf39c5a6a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:37.226140 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d7e301c3-948b-48e5-9d92-f33fcfc37d0a tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:37.227675 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d7e301c3-948b-48e5-9d92-f33fcfc37d0a tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 817afb89-f414-4d1d-bc89-5357dd4e1cb8] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:37.234497 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d7e301c3-948b-48e5-9d92-f33fcfc37d0a tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:37.234693 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-941cd141-049f-49e2-969c-150e61163a3e tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:37.234988 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d7e301c3-948b-48e5-9d92-f33fcfc37d0a tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:37.235296 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-941cd141-049f-49e2-969c-150e61163a3e tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:37.235606 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d7e301c3-948b-48e5-9d92-f33fcfc37d0a tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:37.235750 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-941cd141-049f-49e2-969c-150e61163a3e tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:37.236617 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-941cd141-049f-49e2-969c-150e61163a3e tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:37.236785 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d7e301c3-948b-48e5-9d92-f33fcfc37d0a tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:37.237078 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-941cd141-049f-49e2-969c-150e61163a3e tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:37.237489 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d7e301c3-948b-48e5-9d92-f33fcfc37d0a tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:37.237673 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-941cd141-049f-49e2-969c-150e61163a3e tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:37.237906 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d7e301c3-948b-48e5-9d92-f33fcfc37d0a tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:37.244209 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:12:37.520443 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-941cd141-049f-49e2-969c-150e61163a3e tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:37.542056 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-941cd141-049f-49e2-969c-150e61163a3e tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a" status: 200 len: 1523 microversion: 2.1 time: 0.320987 Aug 31 16:12:37.545607 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2061/4322] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:37 2022] GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a => generated 1523 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:37.577210 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d7e301c3-948b-48e5-9d92-f33fcfc37d0a tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:37.585691 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d7e301c3-948b-48e5-9d92-f33fcfc37d0a tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/817afb89-f414-4d1d-bc89-5357dd4e1cb8" status: 200 len: 1470 microversion: 2.1 time: 0.363297 Aug 31 16:12:37.586126 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2262/4323] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:37 2022] GET /compute/v2.1/servers/817afb89-f414-4d1d-bc89-5357dd4e1cb8 => generated 1470 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:38.008591 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0d5ae57b-8801-4aee-be30-caefb407afaa tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:38.009946 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0d5ae57b-8801-4aee-be30-caefb407afaa tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] [instance: 4754015c-cda0-4f0a-9096-06bebe3d33b1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:38.023031 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0d5ae57b-8801-4aee-be30-caefb407afaa tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:38.024254 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0d5ae57b-8801-4aee-be30-caefb407afaa tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:38.025245 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0d5ae57b-8801-4aee-be30-caefb407afaa tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:38.027055 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0d5ae57b-8801-4aee-be30-caefb407afaa tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:38.028225 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0d5ae57b-8801-4aee-be30-caefb407afaa tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:38.029171 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0d5ae57b-8801-4aee-be30-caefb407afaa tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:38.166457 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-97bd1c19-aaad-4ee0-ad74-11dbc0b9170e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:38.167320 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-97bd1c19-aaad-4ee0-ad74-11dbc0b9170e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ddb49409-d019-4682-b5c4-2d9b09cf7f9d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:38.174888 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-97bd1c19-aaad-4ee0-ad74-11dbc0b9170e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:38.175649 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-97bd1c19-aaad-4ee0-ad74-11dbc0b9170e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:38.176262 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-97bd1c19-aaad-4ee0-ad74-11dbc0b9170e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:38.177130 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-97bd1c19-aaad-4ee0-ad74-11dbc0b9170e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:38.177735 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-97bd1c19-aaad-4ee0-ad74-11dbc0b9170e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:38.178341 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-97bd1c19-aaad-4ee0-ad74-11dbc0b9170e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:38.271901 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-97bd1c19-aaad-4ee0-ad74-11dbc0b9170e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:38.286843 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-97bd1c19-aaad-4ee0-ad74-11dbc0b9170e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/ddb49409-d019-4682-b5c4-2d9b09cf7f9d" status: 200 len: 1261 microversion: 2.1 time: 0.124240 Aug 31 16:12:38.288814 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2263/4324] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:38 2022] GET /compute/v2.1/servers/ddb49409-d019-4682-b5c4-2d9b09cf7f9d => generated 1261 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:12:38.296127 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-22dd1953-901c-4d37-88f7-a9c47d48bc0e tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:38.297088 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-22dd1953-901c-4d37-88f7-a9c47d48bc0e tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:38.303930 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-22dd1953-901c-4d37-88f7-a9c47d48bc0e tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:38.304730 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-22dd1953-901c-4d37-88f7-a9c47d48bc0e tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:38.311636 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-22dd1953-901c-4d37-88f7-a9c47d48bc0e tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:38.313614 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-22dd1953-901c-4d37-88f7-a9c47d48bc0e tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:38.314308 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-22dd1953-901c-4d37-88f7-a9c47d48bc0e tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:38.314917 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-22dd1953-901c-4d37-88f7-a9c47d48bc0e tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:38.329397 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0d5ae57b-8801-4aee-be30-caefb407afaa tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391c4c8e6ae4483e82a247957a6faad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1f95b9a87a4f1389c03f6a3f592a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:38.342595 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0d5ae57b-8801-4aee-be30-caefb407afaa tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] 10.222.0.50 "GET /compute/v2.1/servers/4754015c-cda0-4f0a-9096-06bebe3d33b1" status: 200 len: 1521 microversion: 2.1 time: 0.340771 Aug 31 16:12:38.343977 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2062/4325] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:37 2022] GET /compute/v2.1/servers/4754015c-cda0-4f0a-9096-06bebe3d33b1 => generated 1521 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:38.567174 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-89989b6a-1812-4544-a619-b510c17752db tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:38.568782 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-89989b6a-1812-4544-a619-b510c17752db tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: b60b7363-fd13-4b81-9c4b-0aabf39c5a6a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:38.584789 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-89989b6a-1812-4544-a619-b510c17752db tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:38.587208 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-89989b6a-1812-4544-a619-b510c17752db tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:38.588289 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-89989b6a-1812-4544-a619-b510c17752db tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:38.590849 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-89989b6a-1812-4544-a619-b510c17752db tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:38.594041 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-89989b6a-1812-4544-a619-b510c17752db tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:38.595813 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-89989b6a-1812-4544-a619-b510c17752db tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:38.621351 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-22dd1953-901c-4d37-88f7-a9c47d48bc0e tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:38.637923 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-22dd1953-901c-4d37-88f7-a9c47d48bc0e tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f" status: 200 len: 1521 microversion: 2.1 time: 0.347693 Aug 31 16:12:38.640469 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2264/4326] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:38 2022] GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f => generated 1521 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:38.650257 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-71d3f693-cdcf-48f6-98bc-c9f0ed6e0048 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:38.651032 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-71d3f693-cdcf-48f6-98bc-c9f0ed6e0048 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 817afb89-f414-4d1d-bc89-5357dd4e1cb8] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:38.658807 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-71d3f693-cdcf-48f6-98bc-c9f0ed6e0048 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:38.659335 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-71d3f693-cdcf-48f6-98bc-c9f0ed6e0048 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:38.659770 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-71d3f693-cdcf-48f6-98bc-c9f0ed6e0048 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:38.660465 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-71d3f693-cdcf-48f6-98bc-c9f0ed6e0048 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:38.661063 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-71d3f693-cdcf-48f6-98bc-c9f0ed6e0048 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:38.661488 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-71d3f693-cdcf-48f6-98bc-c9f0ed6e0048 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:38.928709 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-71d3f693-cdcf-48f6-98bc-c9f0ed6e0048 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:38.938660 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-71d3f693-cdcf-48f6-98bc-c9f0ed6e0048 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/817afb89-f414-4d1d-bc89-5357dd4e1cb8" status: 200 len: 1470 microversion: 2.1 time: 0.296891 Aug 31 16:12:38.952262 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2265/4327] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:38 2022] GET /compute/v2.1/servers/817afb89-f414-4d1d-bc89-5357dd4e1cb8 => generated 1470 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:38.957437 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-5641f6e8-aee6-4c84-8272-27551803c2b4 req-3d260371-9893-41d5-934b-b267c5e50823 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2af572bd-8a8b-4db7-9196-7203de031375", "name": "network-vif-deleted", "tag": "130df408-bb0d-484e-9def-4bf6e6d5c614"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:38.986868 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-5641f6e8-aee6-4c84-8272-27551803c2b4 req-3d260371-9893-41d5-934b-b267c5e50823 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:38.991370 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-5641f6e8-aee6-4c84-8272-27551803c2b4 req-3d260371-9893-41d5-934b-b267c5e50823 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:38.993915 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-5641f6e8-aee6-4c84-8272-27551803c2b4 req-3d260371-9893-41d5-934b-b267c5e50823 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:39.017713 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-89989b6a-1812-4544-a619-b510c17752db tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:39.029834 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-89989b6a-1812-4544-a619-b510c17752db tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a" status: 200 len: 1523 microversion: 2.1 time: 0.468382 Aug 31 16:12:39.031955 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2063/4328] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:38 2022] GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a => generated 1523 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:39.039882 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-5641f6e8-aee6-4c84-8272-27551803c2b4 req-3d260371-9893-41d5-934b-b267c5e50823 service nova] Creating event network-vif-deleted:130df408-bb0d-484e-9def-4bf6e6d5c614 for instance 2af572bd-8a8b-4db7-9196-7203de031375 on n-h1-833090-16 Aug 31 16:12:39.052841 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-5641f6e8-aee6-4c84-8272-27551803c2b4 req-3d260371-9893-41d5-934b-b267c5e50823 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098057 Aug 31 16:12:39.056474 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2266/4329] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:39.309730 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c15fd0b0-ccac-4afa-aceb-db0425775775 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:39.310459 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c15fd0b0-ccac-4afa-aceb-db0425775775 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ddb49409-d019-4682-b5c4-2d9b09cf7f9d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:39.324506 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c15fd0b0-ccac-4afa-aceb-db0425775775 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:39.325678 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c15fd0b0-ccac-4afa-aceb-db0425775775 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:39.327286 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c15fd0b0-ccac-4afa-aceb-db0425775775 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:39.328792 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c15fd0b0-ccac-4afa-aceb-db0425775775 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:39.330720 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c15fd0b0-ccac-4afa-aceb-db0425775775 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:39.332700 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c15fd0b0-ccac-4afa-aceb-db0425775775 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:39.384133 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1868318a-4f6e-4e2d-b75e-41363106e19d tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:39.389176 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1868318a-4f6e-4e2d-b75e-41363106e19d tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] [instance: 4754015c-cda0-4f0a-9096-06bebe3d33b1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:39.411083 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1868318a-4f6e-4e2d-b75e-41363106e19d tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:39.412938 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1868318a-4f6e-4e2d-b75e-41363106e19d tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:39.414542 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1868318a-4f6e-4e2d-b75e-41363106e19d tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:39.418863 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1868318a-4f6e-4e2d-b75e-41363106e19d tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:39.419579 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1868318a-4f6e-4e2d-b75e-41363106e19d tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:39.420554 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1868318a-4f6e-4e2d-b75e-41363106e19d tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:39.496789 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c15fd0b0-ccac-4afa-aceb-db0425775775 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:39.506259 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c15fd0b0-ccac-4afa-aceb-db0425775775 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/ddb49409-d019-4682-b5c4-2d9b09cf7f9d" status: 200 len: 1267 microversion: 2.1 time: 0.200864 Aug 31 16:12:39.509483 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2064/4330] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:39 2022] GET /compute/v2.1/servers/ddb49409-d019-4682-b5c4-2d9b09cf7f9d => generated 1267 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:39.654591 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1868318a-4f6e-4e2d-b75e-41363106e19d tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391c4c8e6ae4483e82a247957a6faad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1f95b9a87a4f1389c03f6a3f592a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:39.661433 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-83c73ef5-ac38-4b46-9941-69660e8b2b05 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:39.662446 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-83c73ef5-ac38-4b46-9941-69660e8b2b05 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:39.664100 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1868318a-4f6e-4e2d-b75e-41363106e19d tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] 10.222.0.50 "GET /compute/v2.1/servers/4754015c-cda0-4f0a-9096-06bebe3d33b1" status: 200 len: 1521 microversion: 2.1 time: 0.302569 Aug 31 16:12:39.665845 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2267/4331] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:39 2022] GET /compute/v2.1/servers/4754015c-cda0-4f0a-9096-06bebe3d33b1 => generated 1521 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:39.672637 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83c73ef5-ac38-4b46-9941-69660e8b2b05 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:39.673494 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83c73ef5-ac38-4b46-9941-69660e8b2b05 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:39.674301 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83c73ef5-ac38-4b46-9941-69660e8b2b05 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:39.677838 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83c73ef5-ac38-4b46-9941-69660e8b2b05 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:39.678373 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83c73ef5-ac38-4b46-9941-69660e8b2b05 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:39.679543 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83c73ef5-ac38-4b46-9941-69660e8b2b05 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:39.867372 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-83c73ef5-ac38-4b46-9941-69660e8b2b05 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:39.880195 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-83c73ef5-ac38-4b46-9941-69660e8b2b05 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f" status: 200 len: 1521 microversion: 2.1 time: 0.224749 Aug 31 16:12:39.895222 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2065/4332] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:39 2022] GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:12:39.967037 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-00a531ab-266a-4d8c-ad6d-c59a3dbf1485 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:39.969505 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-00a531ab-266a-4d8c-ad6d-c59a3dbf1485 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 817afb89-f414-4d1d-bc89-5357dd4e1cb8] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:39.978807 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-00a531ab-266a-4d8c-ad6d-c59a3dbf1485 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:39.980036 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-00a531ab-266a-4d8c-ad6d-c59a3dbf1485 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:39.981430 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-00a531ab-266a-4d8c-ad6d-c59a3dbf1485 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:39.982701 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-00a531ab-266a-4d8c-ad6d-c59a3dbf1485 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:39.983523 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-00a531ab-266a-4d8c-ad6d-c59a3dbf1485 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:39.984691 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-00a531ab-266a-4d8c-ad6d-c59a3dbf1485 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:40.054436 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e05ce6fc-dc8e-4eb5-a36e-3d6e00155d2b tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:40.055341 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e05ce6fc-dc8e-4eb5-a36e-3d6e00155d2b tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: b60b7363-fd13-4b81-9c4b-0aabf39c5a6a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:40.076952 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e05ce6fc-dc8e-4eb5-a36e-3d6e00155d2b tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:40.077458 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e05ce6fc-dc8e-4eb5-a36e-3d6e00155d2b tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:40.077892 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e05ce6fc-dc8e-4eb5-a36e-3d6e00155d2b tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:40.083097 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e05ce6fc-dc8e-4eb5-a36e-3d6e00155d2b tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:40.083610 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e05ce6fc-dc8e-4eb5-a36e-3d6e00155d2b tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:40.084053 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e05ce6fc-dc8e-4eb5-a36e-3d6e00155d2b tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:40.086022 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-00a531ab-266a-4d8c-ad6d-c59a3dbf1485 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:40.100329 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-00a531ab-266a-4d8c-ad6d-c59a3dbf1485 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/817afb89-f414-4d1d-bc89-5357dd4e1cb8" status: 200 len: 1428 microversion: 2.1 time: 0.142175 Aug 31 16:12:40.100867 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2268/4333] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:39 2022] GET /compute/v2.1/servers/817afb89-f414-4d1d-bc89-5357dd4e1cb8 => generated 1428 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:40.329221 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e05ce6fc-dc8e-4eb5-a36e-3d6e00155d2b tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:40.344592 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e05ce6fc-dc8e-4eb5-a36e-3d6e00155d2b tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a" status: 200 len: 1523 microversion: 2.1 time: 0.296585 Aug 31 16:12:40.350608 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2066/4334] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:40 2022] GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a => generated 1523 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:12:40.491009 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-0b910583-4880-486f-b009-5054b63ddde8 req-04eef315-e85e-471d-9e29-2e2623a95b9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "817afb89-f414-4d1d-bc89-5357dd4e1cb8", "name": "network-vif-deleted", "tag": "0d01462c-4840-4402-8f7a-ce1a7f173698"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:40.504343 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-0b910583-4880-486f-b009-5054b63ddde8 req-04eef315-e85e-471d-9e29-2e2623a95b9f service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:40.504832 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-0b910583-4880-486f-b009-5054b63ddde8 req-04eef315-e85e-471d-9e29-2e2623a95b9f service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:40.505274 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-0b910583-4880-486f-b009-5054b63ddde8 req-04eef315-e85e-471d-9e29-2e2623a95b9f service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:40.519298 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-0b910583-4880-486f-b009-5054b63ddde8 req-04eef315-e85e-471d-9e29-2e2623a95b9f service nova] Creating event network-vif-deleted:0d01462c-4840-4402-8f7a-ce1a7f173698 for instance 817afb89-f414-4d1d-bc89-5357dd4e1cb8 on n-h2-833090-16 Aug 31 16:12:40.529828 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4c371140-83f9-4e3a-b75b-e6971d57d885 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:40.530666 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4c371140-83f9-4e3a-b75b-e6971d57d885 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ddb49409-d019-4682-b5c4-2d9b09cf7f9d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:40.535543 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-0b910583-4880-486f-b009-5054b63ddde8 req-04eef315-e85e-471d-9e29-2e2623a95b9f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048787 Aug 31 16:12:40.536931 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2269/4335] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:40.539450 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c371140-83f9-4e3a-b75b-e6971d57d885 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:40.540223 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c371140-83f9-4e3a-b75b-e6971d57d885 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:40.540864 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c371140-83f9-4e3a-b75b-e6971d57d885 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:40.542007 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c371140-83f9-4e3a-b75b-e6971d57d885 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:40.542796 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c371140-83f9-4e3a-b75b-e6971d57d885 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:40.543476 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c371140-83f9-4e3a-b75b-e6971d57d885 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:40.637522 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4c371140-83f9-4e3a-b75b-e6971d57d885 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:40.653208 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4c371140-83f9-4e3a-b75b-e6971d57d885 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/ddb49409-d019-4682-b5c4-2d9b09cf7f9d" status: 200 len: 1267 microversion: 2.1 time: 0.127378 Aug 31 16:12:40.657199 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2067/4336] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:40 2022] GET /compute/v2.1/servers/ddb49409-d019-4682-b5c4-2d9b09cf7f9d => generated 1267 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:40.688206 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1188b757-2013-4389-9526-960a8aef78fe tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:40.689141 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1188b757-2013-4389-9526-960a8aef78fe tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] [instance: 4754015c-cda0-4f0a-9096-06bebe3d33b1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:40.703484 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1188b757-2013-4389-9526-960a8aef78fe tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:40.706193 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1188b757-2013-4389-9526-960a8aef78fe tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:40.706941 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1188b757-2013-4389-9526-960a8aef78fe tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:40.709801 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1188b757-2013-4389-9526-960a8aef78fe tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:40.711671 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1188b757-2013-4389-9526-960a8aef78fe tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:40.713844 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1188b757-2013-4389-9526-960a8aef78fe tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:40.910198 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a3adf472-054c-45ee-9371-0251b43847ca tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:40.914737 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a3adf472-054c-45ee-9371-0251b43847ca tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:40.935795 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a3adf472-054c-45ee-9371-0251b43847ca tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:40.942448 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a3adf472-054c-45ee-9371-0251b43847ca tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:40.943606 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a3adf472-054c-45ee-9371-0251b43847ca tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:40.947144 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a3adf472-054c-45ee-9371-0251b43847ca tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:40.949987 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a3adf472-054c-45ee-9371-0251b43847ca tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:40.950828 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a3adf472-054c-45ee-9371-0251b43847ca tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:40.997191 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1188b757-2013-4389-9526-960a8aef78fe tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391c4c8e6ae4483e82a247957a6faad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1f95b9a87a4f1389c03f6a3f592a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:41.015739 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1188b757-2013-4389-9526-960a8aef78fe tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] 10.222.0.50 "GET /compute/v2.1/servers/4754015c-cda0-4f0a-9096-06bebe3d33b1" status: 200 len: 1479 microversion: 2.1 time: 0.333745 Aug 31 16:12:41.020498 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2270/4337] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:40 2022] GET /compute/v2.1/servers/4754015c-cda0-4f0a-9096-06bebe3d33b1 => generated 1479 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:41.122659 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e5b89248-634f-4f2b-8f8c-46bfcbaf25b7 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:41.123626 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e5b89248-634f-4f2b-8f8c-46bfcbaf25b7 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 817afb89-f414-4d1d-bc89-5357dd4e1cb8] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:41.138086 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e5b89248-634f-4f2b-8f8c-46bfcbaf25b7 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:41.138915 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e5b89248-634f-4f2b-8f8c-46bfcbaf25b7 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:41.141055 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e5b89248-634f-4f2b-8f8c-46bfcbaf25b7 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:41.144124 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e5b89248-634f-4f2b-8f8c-46bfcbaf25b7 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:41.145067 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e5b89248-634f-4f2b-8f8c-46bfcbaf25b7 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:41.146775 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e5b89248-634f-4f2b-8f8c-46bfcbaf25b7 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:41.246401 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e5b89248-634f-4f2b-8f8c-46bfcbaf25b7 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:41.248494 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e5b89248-634f-4f2b-8f8c-46bfcbaf25b7 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:41.249277 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e5b89248-634f-4f2b-8f8c-46bfcbaf25b7 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:41.252412 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-e5b89248-634f-4f2b-8f8c-46bfcbaf25b7 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lazy-loading 'fault' on Instance uuid 817afb89-f414-4d1d-bc89-5357dd4e1cb8 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:12:41.342033 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e5b89248-634f-4f2b-8f8c-46bfcbaf25b7 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:41.380468 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e5b89248-634f-4f2b-8f8c-46bfcbaf25b7 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/817afb89-f414-4d1d-bc89-5357dd4e1cb8" status: 200 len: 1304 microversion: 2.1 time: 0.262958 Aug 31 16:12:41.381072 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2271/4338] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:41 2022] GET /compute/v2.1/servers/817afb89-f414-4d1d-bc89-5357dd4e1cb8 => generated 1304 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:12:41.403758 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c594d5cd-3238-457c-9c04-9b0976ade849 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:41.407400 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c594d5cd-3238-457c-9c04-9b0976ade849 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: b60b7363-fd13-4b81-9c4b-0aabf39c5a6a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:41.417295 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c594d5cd-3238-457c-9c04-9b0976ade849 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:41.419372 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c594d5cd-3238-457c-9c04-9b0976ade849 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:41.420169 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c594d5cd-3238-457c-9c04-9b0976ade849 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:41.421415 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c594d5cd-3238-457c-9c04-9b0976ade849 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:41.422943 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c594d5cd-3238-457c-9c04-9b0976ade849 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:41.423532 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c594d5cd-3238-457c-9c04-9b0976ade849 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:42.108403 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a3adf472-054c-45ee-9371-0251b43847ca tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:42.117749 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a3adf472-054c-45ee-9371-0251b43847ca tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f" status: 200 len: 1521 microversion: 2.1 time: 1.217927 Aug 31 16:12:42.139335 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2068/4339] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:40 2022] GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f => generated 1521 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:42.144732 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7f83c6b4-9968-48ed-8787-127ebd936902 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:42.149986 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7f83c6b4-9968-48ed-8787-127ebd936902 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ddb49409-d019-4682-b5c4-2d9b09cf7f9d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:42.165142 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f83c6b4-9968-48ed-8787-127ebd936902 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:42.166025 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f83c6b4-9968-48ed-8787-127ebd936902 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:42.166734 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f83c6b4-9968-48ed-8787-127ebd936902 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:42.172943 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f83c6b4-9968-48ed-8787-127ebd936902 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:42.173810 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f83c6b4-9968-48ed-8787-127ebd936902 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:42.174493 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f83c6b4-9968-48ed-8787-127ebd936902 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:42.481834 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c594d5cd-3238-457c-9c04-9b0976ade849 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:42.493914 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c594d5cd-3238-457c-9c04-9b0976ade849 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a" status: 200 len: 1523 microversion: 2.1 time: 1.111755 Aug 31 16:12:42.494548 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2272/4340] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:41 2022] GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a => generated 1523 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:42.505525 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2654fa53-3c5d-4c45-a9ce-de7442ba008f tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:42.509072 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2654fa53-3c5d-4c45-a9ce-de7442ba008f tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] [instance: 4754015c-cda0-4f0a-9096-06bebe3d33b1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:42.525714 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2654fa53-3c5d-4c45-a9ce-de7442ba008f tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:42.526232 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2654fa53-3c5d-4c45-a9ce-de7442ba008f tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:42.526669 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2654fa53-3c5d-4c45-a9ce-de7442ba008f tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:42.527452 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2654fa53-3c5d-4c45-a9ce-de7442ba008f tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:42.528130 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2654fa53-3c5d-4c45-a9ce-de7442ba008f tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:42.528558 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2654fa53-3c5d-4c45-a9ce-de7442ba008f tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:42.629155 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2654fa53-3c5d-4c45-a9ce-de7442ba008f tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:42.629893 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2654fa53-3c5d-4c45-a9ce-de7442ba008f tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:42.630872 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2654fa53-3c5d-4c45-a9ce-de7442ba008f tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:42.632797 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-2654fa53-3c5d-4c45-a9ce-de7442ba008f tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lazy-loading 'fault' on Instance uuid 4754015c-cda0-4f0a-9096-06bebe3d33b1 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:12:42.708908 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2654fa53-3c5d-4c45-a9ce-de7442ba008f tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391c4c8e6ae4483e82a247957a6faad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1f95b9a87a4f1389c03f6a3f592a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:42.722384 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2654fa53-3c5d-4c45-a9ce-de7442ba008f tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] 10.222.0.50 "GET /compute/v2.1/servers/4754015c-cda0-4f0a-9096-06bebe3d33b1" status: 200 len: 1312 microversion: 2.1 time: 0.226736 Aug 31 16:12:42.734128 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2273/4341] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:42 2022] GET /compute/v2.1/servers/4754015c-cda0-4f0a-9096-06bebe3d33b1 => generated 1312 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:42.734128 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-866647d7-a8bf-4df3-ac3d-046998f737da req-cdba7535-91d7-4acb-be2e-bc58384d7eab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b60b7363-fd13-4b81-9c4b-0aabf39c5a6a", "name": "network-vif-plugged", "status": "completed", "tag": "498f733b-bbc6-4db1-9c7b-1cc502f31161"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:42.752416 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-866647d7-a8bf-4df3-ac3d-046998f737da req-cdba7535-91d7-4acb-be2e-bc58384d7eab service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:42.752890 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-866647d7-a8bf-4df3-ac3d-046998f737da req-cdba7535-91d7-4acb-be2e-bc58384d7eab service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:42.754077 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-866647d7-a8bf-4df3-ac3d-046998f737da req-cdba7535-91d7-4acb-be2e-bc58384d7eab service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:42.775519 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-866647d7-a8bf-4df3-ac3d-046998f737da req-cdba7535-91d7-4acb-be2e-bc58384d7eab service nova] Creating event network-vif-plugged:498f733b-bbc6-4db1-9c7b-1cc502f31161 for instance b60b7363-fd13-4b81-9c4b-0aabf39c5a6a on n-h1-833090-16 Aug 31 16:12:42.781811 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-866647d7-a8bf-4df3-ac3d-046998f737da req-cdba7535-91d7-4acb-be2e-bc58384d7eab service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057217 Aug 31 16:12:42.783317 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2274/4342] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:42.787818 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7f83c6b4-9968-48ed-8787-127ebd936902 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:42.789326 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1b200542-ffe5-4e67-aa82-0a69ed8bda30 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:42.790128 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1b200542-ffe5-4e67-aa82-0a69ed8bda30 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 817afb89-f414-4d1d-bc89-5357dd4e1cb8] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:42.796815 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:12:42.799123 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1b200542-ffe5-4e67-aa82-0a69ed8bda30 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:42.799716 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1b200542-ffe5-4e67-aa82-0a69ed8bda30 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:42.800158 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1b200542-ffe5-4e67-aa82-0a69ed8bda30 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:42.800555 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7f83c6b4-9968-48ed-8787-127ebd936902 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/ddb49409-d019-4682-b5c4-2d9b09cf7f9d" status: 200 len: 1309 microversion: 2.1 time: 0.659595 Aug 31 16:12:42.800869 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1b200542-ffe5-4e67-aa82-0a69ed8bda30 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:42.810123 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1b200542-ffe5-4e67-aa82-0a69ed8bda30 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:42.810320 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2069/4343] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:42 2022] GET /compute/v2.1/servers/ddb49409-d019-4682-b5c4-2d9b09cf7f9d => generated 1309 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:42.810410 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1b200542-ffe5-4e67-aa82-0a69ed8bda30 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:42.810489 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-2441783e-5812-4a6c-9069-bcf2a6e17edb req-a4374260-dd29-4da7-85ca-ebf0a389af1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4754015c-cda0-4f0a-9096-06bebe3d33b1", "name": "network-vif-deleted", "tag": "814755c5-78ef-4411-a17e-1bef500926b3"}, {"name": "network-changed", "server_uuid": "ddb49409-d019-4682-b5c4-2d9b09cf7f9d", "tag": "7e4f8fe9-01f9-45ad-b58e-4eda10a64363"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:42.839668 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2441783e-5812-4a6c-9069-bcf2a6e17edb req-a4374260-dd29-4da7-85ca-ebf0a389af1e service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:42.840135 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2441783e-5812-4a6c-9069-bcf2a6e17edb req-a4374260-dd29-4da7-85ca-ebf0a389af1e service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:42.840571 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2441783e-5812-4a6c-9069-bcf2a6e17edb req-a4374260-dd29-4da7-85ca-ebf0a389af1e service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:42.851864 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-1b200542-ffe5-4e67-aa82-0a69ed8bda30 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] HTTP exception thrown: Instance 817afb89-f414-4d1d-bc89-5357dd4e1cb8 could not be found. Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1b200542-ffe5-4e67-aa82-0a69ed8bda30 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Request method failure captured: Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/817afb89-f414-4d1d-bc89-5357dd4e1cb8 HTTP/1.1 Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4fVb5lng7pw9SFQg8OO7U0FJ2ZnoT-odFJVbhbpcc2-iZIBffn8SoZkXFiAUS3GAi9tlAH1-cvA0TolX_WwF0slh0oNLzBKfcOjQ4yIOwUT0PsjgWRrjv2JB_CGO-yYeabtbeMLXxPy7mYzLlbFtGkvXplUyH3koXsl37FMbtgZ9o8 Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 2a9210acd39546b4b6fba9cda27a0aed Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServersAdminTestJSON-709682883 Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2a9210acd39546b4b6fba9cda27a0aed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2a9210acd39546b4b6fba9cda27a0aed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2a9210acd39546b4b6fba9cda27a0aed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2a9210acd39546b4b6fba9cda27a0aed", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServersAdminTestJSON-709682883 Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 2a9210acd39546b4b6fba9cda27a0aed Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServersAdminTestJSON-709682883 Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServersAdminTestJSON-709682883-project Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 4669ae0dec2c4ad8be74acd9ebf4d80a Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServersAdminTestJSON-709682883-project Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 817afb89-f414-4d1d-bc89-5357dd4e1cb8 could not be found. Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '817afb89-f414-4d1d-bc89-5357dd4e1cb8'} Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 817afb89-f414-4d1d-bc89-5357dd4e1cb8 could not be found. Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 817afb89-f414-4d1d-bc89-5357dd4e1cb8 could not be found. Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:42.853570 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:12:42.859366 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:42.859366 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:42.859366 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:42.859366 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:12:42.859366 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:12:42.859366 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 817afb89-f414-4d1d-bc89-5357dd4e1cb8 could not be found. Aug 31 16:12:42.859366 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:12:42.867357 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1b200542-ffe5-4e67-aa82-0a69ed8bda30 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Returning 404 to user: Instance 817afb89-f414-4d1d-bc89-5357dd4e1cb8 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:12:42.868587 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1b200542-ffe5-4e67-aa82-0a69ed8bda30 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/817afb89-f414-4d1d-bc89-5357dd4e1cb8" status: 404 len: 111 microversion: 2.1 time: 0.084039 Aug 31 16:12:42.869710 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2275/4344] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:42 2022] GET /compute/v2.1/servers/817afb89-f414-4d1d-bc89-5357dd4e1cb8 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:12:42.877092 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-2441783e-5812-4a6c-9069-bcf2a6e17edb req-a4374260-dd29-4da7-85ca-ebf0a389af1e service nova] Creating event network-vif-deleted:814755c5-78ef-4411-a17e-1bef500926b3 for instance 4754015c-cda0-4f0a-9096-06bebe3d33b1 on n-h2-833090-16 Aug 31 16:12:42.878764 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-2441783e-5812-4a6c-9069-bcf2a6e17edb req-a4374260-dd29-4da7-85ca-ebf0a389af1e service nova] Creating event network-changed:7e4f8fe9-01f9-45ad-b58e-4eda10a64363 for instance ddb49409-d019-4682-b5c4-2d9b09cf7f9d on n-h1-833090-16 Aug 31 16:12:42.882535 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9f94b8f9-4db4-4228-b6c0-e05c2bf062ee tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:42.889355 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9f94b8f9-4db4-4228-b6c0-e05c2bf062ee tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 306160c1-762b-4b9e-aa09-3dd60f0c7ce3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:42.900235 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-2441783e-5812-4a6c-9069-bcf2a6e17edb req-a4374260-dd29-4da7-85ca-ebf0a389af1e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.094652 Aug 31 16:12:42.900866 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2070/4345] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:42.901466 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9f94b8f9-4db4-4228-b6c0-e05c2bf062ee tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:42.902481 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9f94b8f9-4db4-4228-b6c0-e05c2bf062ee tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:42.903136 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9f94b8f9-4db4-4228-b6c0-e05c2bf062ee tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:42.904015 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9f94b8f9-4db4-4228-b6c0-e05c2bf062ee tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:42.904803 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9f94b8f9-4db4-4228-b6c0-e05c2bf062ee tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:42.905393 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9f94b8f9-4db4-4228-b6c0-e05c2bf062ee tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:42.960942 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9f94b8f9-4db4-4228-b6c0-e05c2bf062ee tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 306160c1-762b-4b9e-aa09-3dd60f0c7ce3] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:12:43.135502 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9f94b8f9-4db4-4228-b6c0-e05c2bf062ee tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "DELETE /compute/v2.1/servers/306160c1-762b-4b9e-aa09-3dd60f0c7ce3" status: 204 len: 0 microversion: 2.1 time: 0.260302 Aug 31 16:12:43.140462 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2276/4346] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:12:42 2022] DELETE /compute/v2.1/servers/306160c1-762b-4b9e-aa09-3dd60f0c7ce3 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:12:43.147031 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f9acfa7c-0743-4dd3-a6a4-6a97849e56c9 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:43.148456 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f9acfa7c-0743-4dd3-a6a4-6a97849e56c9 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:43.157293 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-439f5c23-3333-4730-811d-b16e27fd6c48 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:43.158204 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-439f5c23-3333-4730-811d-b16e27fd6c48 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 306160c1-762b-4b9e-aa09-3dd60f0c7ce3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:43.162061 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9acfa7c-0743-4dd3-a6a4-6a97849e56c9 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:43.171417 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9acfa7c-0743-4dd3-a6a4-6a97849e56c9 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:43.172104 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9acfa7c-0743-4dd3-a6a4-6a97849e56c9 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:43.173044 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9acfa7c-0743-4dd3-a6a4-6a97849e56c9 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:43.173661 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9acfa7c-0743-4dd3-a6a4-6a97849e56c9 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:43.174435 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9acfa7c-0743-4dd3-a6a4-6a97849e56c9 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:43.178784 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-439f5c23-3333-4730-811d-b16e27fd6c48 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:43.179977 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-439f5c23-3333-4730-811d-b16e27fd6c48 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:43.179977 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-439f5c23-3333-4730-811d-b16e27fd6c48 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:43.180440 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-439f5c23-3333-4730-811d-b16e27fd6c48 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:43.182435 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:12:43.188904 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-439f5c23-3333-4730-811d-b16e27fd6c48 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:43.189509 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-439f5c23-3333-4730-811d-b16e27fd6c48 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:43.628520 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-439f5c23-3333-4730-811d-b16e27fd6c48 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:43.631503 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f9acfa7c-0743-4dd3-a6a4-6a97849e56c9 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:43.639983 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f9acfa7c-0743-4dd3-a6a4-6a97849e56c9 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f" status: 200 len: 1521 microversion: 2.1 time: 0.497880 Aug 31 16:12:43.640714 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-439f5c23-3333-4730-811d-b16e27fd6c48 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/306160c1-762b-4b9e-aa09-3dd60f0c7ce3" status: 200 len: 1466 microversion: 2.1 time: 0.497707 Aug 31 16:12:43.641473 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2071/4347] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:43 2022] GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f => generated 1521 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:43.646367 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1a6da884-027a-4693-9f13-fba4738e256d tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:43.647436 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1a6da884-027a-4693-9f13-fba4738e256d tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: b60b7363-fd13-4b81-9c4b-0aabf39c5a6a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:43.654957 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a6da884-027a-4693-9f13-fba4738e256d tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:43.655767 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a6da884-027a-4693-9f13-fba4738e256d tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:43.656673 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a6da884-027a-4693-9f13-fba4738e256d tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:43.658053 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a6da884-027a-4693-9f13-fba4738e256d tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:43.658273 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2277/4348] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:43 2022] GET /compute/v2.1/servers/306160c1-762b-4b9e-aa09-3dd60f0c7ce3 => generated 1466 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:43.659047 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a6da884-027a-4693-9f13-fba4738e256d tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:43.659615 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a6da884-027a-4693-9f13-fba4738e256d tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:43.747581 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2b4ddaa8-89f9-4364-b3da-584fe7315710 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:43.748117 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2b4ddaa8-89f9-4364-b3da-584fe7315710 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] [instance: 4754015c-cda0-4f0a-9096-06bebe3d33b1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:43.754864 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b4ddaa8-89f9-4364-b3da-584fe7315710 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:43.756003 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b4ddaa8-89f9-4364-b3da-584fe7315710 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:43.756003 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b4ddaa8-89f9-4364-b3da-584fe7315710 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:43.756569 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b4ddaa8-89f9-4364-b3da-584fe7315710 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:43.758590 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b4ddaa8-89f9-4364-b3da-584fe7315710 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:43.761537 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b4ddaa8-89f9-4364-b3da-584fe7315710 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:43.806319 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b4ddaa8-89f9-4364-b3da-584fe7315710 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:43.807229 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b4ddaa8-89f9-4364-b3da-584fe7315710 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:43.807828 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b4ddaa8-89f9-4364-b3da-584fe7315710 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:43.808516 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-2b4ddaa8-89f9-4364-b3da-584fe7315710 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lazy-loading 'fault' on Instance uuid 4754015c-cda0-4f0a-9096-06bebe3d33b1 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:12:43.908547 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=8 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:12:43.910951 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2b4ddaa8-89f9-4364-b3da-584fe7315710 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '391c4c8e6ae4483e82a247957a6faad9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da1f95b9a87a4f1389c03f6a3f592a2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:43.915972 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:12:43.924884 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2b4ddaa8-89f9-4364-b3da-584fe7315710 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] 10.222.0.50 "GET /compute/v2.1/servers/4754015c-cda0-4f0a-9096-06bebe3d33b1" status: 200 len: 1312 microversion: 2.1 time: 0.181596 Aug 31 16:12:43.925885 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2278/4349] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:43 2022] GET /compute/v2.1/servers/4754015c-cda0-4f0a-9096-06bebe3d33b1 => generated 1312 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:12:43.930615 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5f8df384-6bd7-4a09-b871-c79014c1e564 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:43.931297 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5f8df384-6bd7-4a09-b871-c79014c1e564 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ddb49409-d019-4682-b5c4-2d9b09cf7f9d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:43.938538 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5f8df384-6bd7-4a09-b871-c79014c1e564 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:43.939103 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5f8df384-6bd7-4a09-b871-c79014c1e564 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:43.939606 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5f8df384-6bd7-4a09-b871-c79014c1e564 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:43.940382 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5f8df384-6bd7-4a09-b871-c79014c1e564 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:43.941061 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5f8df384-6bd7-4a09-b871-c79014c1e564 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:43.941548 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5f8df384-6bd7-4a09-b871-c79014c1e564 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:43.962718 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1a6da884-027a-4693-9f13-fba4738e256d tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:43.983416 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1a6da884-027a-4693-9f13-fba4738e256d tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a" status: 200 len: 1523 microversion: 2.1 time: 0.340554 Aug 31 16:12:43.993060 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2072/4350] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:43 2022] GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a => generated 1523 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:44.028004 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=6 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:12:44.247065 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5f8df384-6bd7-4a09-b871-c79014c1e564 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:44.258360 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5f8df384-6bd7-4a09-b871-c79014c1e564 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/ddb49409-d019-4682-b5c4-2d9b09cf7f9d" status: 200 len: 1309 microversion: 2.1 time: 0.329671 Aug 31 16:12:44.261702 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2279/4351] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:43 2022] GET /compute/v2.1/servers/ddb49409-d019-4682-b5c4-2d9b09cf7f9d => generated 1309 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:44.669719 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-64d97bb6-73c5-4927-bcfc-f99d18207e44 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:44.671209 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-64d97bb6-73c5-4927-bcfc-f99d18207e44 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:44.678394 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-18105161-ff34-44ac-8324-2bd0ab3d07a4 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:44.679591 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-18105161-ff34-44ac-8324-2bd0ab3d07a4 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 306160c1-762b-4b9e-aa09-3dd60f0c7ce3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:44.685273 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:12:44.689173 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64d97bb6-73c5-4927-bcfc-f99d18207e44 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:44.691793 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-18105161-ff34-44ac-8324-2bd0ab3d07a4 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:44.692492 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-18105161-ff34-44ac-8324-2bd0ab3d07a4 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:44.693162 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64d97bb6-73c5-4927-bcfc-f99d18207e44 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:44.693777 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-18105161-ff34-44ac-8324-2bd0ab3d07a4 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:44.696246 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64d97bb6-73c5-4927-bcfc-f99d18207e44 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:44.697206 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64d97bb6-73c5-4927-bcfc-f99d18207e44 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:44.697593 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-18105161-ff34-44ac-8324-2bd0ab3d07a4 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:44.697891 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64d97bb6-73c5-4927-bcfc-f99d18207e44 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:44.698406 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-18105161-ff34-44ac-8324-2bd0ab3d07a4 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:44.699202 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-18105161-ff34-44ac-8324-2bd0ab3d07a4 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:44.699486 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64d97bb6-73c5-4927-bcfc-f99d18207e44 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:44.910757 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=8 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:12:45.177995 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-64d97bb6-73c5-4927-bcfc-f99d18207e44 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:45.192302 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-64d97bb6-73c5-4927-bcfc-f99d18207e44 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f" status: 200 len: 1521 microversion: 2.1 time: 0.528984 Aug 31 16:12:45.207940 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2073/4352] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:44 2022] GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f => generated 1521 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:45.223115 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ef4d6df4-1e17-4aec-b972-ea0a71ed764e tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:45.224262 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ef4d6df4-1e17-4aec-b972-ea0a71ed764e tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] [instance: 4754015c-cda0-4f0a-9096-06bebe3d33b1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:45.244064 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef4d6df4-1e17-4aec-b972-ea0a71ed764e tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:45.245059 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef4d6df4-1e17-4aec-b972-ea0a71ed764e tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:45.247269 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef4d6df4-1e17-4aec-b972-ea0a71ed764e tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:45.249304 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef4d6df4-1e17-4aec-b972-ea0a71ed764e tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:45.250050 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef4d6df4-1e17-4aec-b972-ea0a71ed764e tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:45.253075 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef4d6df4-1e17-4aec-b972-ea0a71ed764e tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:45.287372 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-ef4d6df4-1e17-4aec-b972-ea0a71ed764e tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] HTTP exception thrown: Instance 4754015c-cda0-4f0a-9096-06bebe3d33b1 could not be found. Aug 31 16:12:45.294819 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-18105161-ff34-44ac-8324-2bd0ab3d07a4 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ef4d6df4-1e17-4aec-b972-ea0a71ed764e tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Request method failure captured: Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/4754015c-cda0-4f0a-9096-06bebe3d33b1 HTTP/1.1 Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4g0HBrOe3wDfhuaYhqKGu3WkNFVOs6Tovezlwo0yNYaL0Uccq6SS4YieQYY7KJlsHPn_bZ_JeN4ZOREtDj022X92N6opwgAFx4DAKiCiGVqB8N11NaoHAq9VpgmVpbljNeD0639QpPRSmRzilo2IzLt_h5xj5YxHeRUrr0Kc2PLkVI Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: da1f95b9a87a4f1389c03f6a3f592a2e Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ListServersNegativeTestJSON-1597045337 Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/da1f95b9a87a4f1389c03f6a3f592a2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/da1f95b9a87a4f1389c03f6a3f592a2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/da1f95b9a87a4f1389c03f6a3f592a2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_da1f95b9a87a4f1389c03f6a3f592a2e", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ListServersNegativeTestJSON-1597045337 Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: da1f95b9a87a4f1389c03f6a3f592a2e Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1597045337 Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ListServersNegativeTestJSON-1597045337-project Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 391c4c8e6ae4483e82a247957a6faad9 Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ListServersNegativeTestJSON-1597045337-project Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 4754015c-cda0-4f0a-9096-06bebe3d33b1 could not be found. Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '4754015c-cda0-4f0a-9096-06bebe3d33b1'} Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4754015c-cda0-4f0a-9096-06bebe3d33b1 could not be found. Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4754015c-cda0-4f0a-9096-06bebe3d33b1 could not be found. Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:12:45.301949 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:45.306669 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:12:45.306669 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:45.306669 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:45.306669 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:45.306669 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:12:45.306669 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:12:45.306669 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4754015c-cda0-4f0a-9096-06bebe3d33b1 could not be found. Aug 31 16:12:45.306669 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:12:45.310818 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ef4d6df4-1e17-4aec-b972-ea0a71ed764e tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Returning 404 to user: Instance 4754015c-cda0-4f0a-9096-06bebe3d33b1 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:12:45.311399 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-18105161-ff34-44ac-8324-2bd0ab3d07a4 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/306160c1-762b-4b9e-aa09-3dd60f0c7ce3" status: 200 len: 1466 microversion: 2.1 time: 0.636691 Aug 31 16:12:45.313779 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2280/4353] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:44 2022] GET /compute/v2.1/servers/306160c1-762b-4b9e-aa09-3dd60f0c7ce3 => generated 1466 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:12:45.314014 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ef4d6df4-1e17-4aec-b972-ea0a71ed764e tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] 10.222.0.50 "GET /compute/v2.1/servers/4754015c-cda0-4f0a-9096-06bebe3d33b1" status: 404 len: 111 microversion: 2.1 time: 0.099786 Aug 31 16:12:45.314750 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2074/4354] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:45 2022] GET /compute/v2.1/servers/4754015c-cda0-4f0a-9096-06bebe3d33b1 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:12:45.321090 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f4db152a-373d-47e0-8a28-35278ee10594 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:45.321395 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3b154803-b0b4-4d0f-acc3-721429adcc27 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:45.322003 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3b154803-b0b4-4d0f-acc3-721429adcc27 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: b60b7363-fd13-4b81-9c4b-0aabf39c5a6a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:45.323501 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f4db152a-373d-47e0-8a28-35278ee10594 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ddb49409-d019-4682-b5c4-2d9b09cf7f9d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:45.358141 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4db152a-373d-47e0-8a28-35278ee10594 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:45.360807 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4db152a-373d-47e0-8a28-35278ee10594 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:45.361362 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3b154803-b0b4-4d0f-acc3-721429adcc27 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:45.361970 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3b154803-b0b4-4d0f-acc3-721429adcc27 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:45.362578 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3b154803-b0b4-4d0f-acc3-721429adcc27 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:45.363128 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4db152a-373d-47e0-8a28-35278ee10594 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:45.363922 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3b154803-b0b4-4d0f-acc3-721429adcc27 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:45.366400 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3b154803-b0b4-4d0f-acc3-721429adcc27 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:45.366981 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3b154803-b0b4-4d0f-acc3-721429adcc27 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:45.367437 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4db152a-373d-47e0-8a28-35278ee10594 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:45.368088 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4db152a-373d-47e0-8a28-35278ee10594 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:45.368696 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4db152a-373d-47e0-8a28-35278ee10594 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:45.946521 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f4db152a-373d-47e0-8a28-35278ee10594 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:45.963262 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f4db152a-373d-47e0-8a28-35278ee10594 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/ddb49409-d019-4682-b5c4-2d9b09cf7f9d" status: 200 len: 1309 microversion: 2.1 time: 0.647167 Aug 31 16:12:45.971262 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2075/4355] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:45 2022] GET /compute/v2.1/servers/ddb49409-d019-4682-b5c4-2d9b09cf7f9d => generated 1309 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:45.981091 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c1f7372b-db7d-4b8b-983d-115d91da8d28 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:45.982011 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c1f7372b-db7d-4b8b-983d-115d91da8d28 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] [instance: 2af572bd-8a8b-4db7-9196-7203de031375] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:46.001446 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c1f7372b-db7d-4b8b-983d-115d91da8d28 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:46.002907 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c1f7372b-db7d-4b8b-983d-115d91da8d28 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:46.003508 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c1f7372b-db7d-4b8b-983d-115d91da8d28 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:46.004503 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c1f7372b-db7d-4b8b-983d-115d91da8d28 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:46.005122 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c1f7372b-db7d-4b8b-983d-115d91da8d28 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:46.005858 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c1f7372b-db7d-4b8b-983d-115d91da8d28 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:46.037926 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-c1f7372b-db7d-4b8b-983d-115d91da8d28 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] HTTP exception thrown: Instance 2af572bd-8a8b-4db7-9196-7203de031375 could not be found. Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c1f7372b-db7d-4b8b-983d-115d91da8d28 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Request method failure captured: Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/2af572bd-8a8b-4db7-9196-7203de031375 HTTP/1.1 Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4g0HBrOe3wDfhuaYhqKGu3WkNFVOs6Tovezlwo0yNYaL0Uccq6SS4YieQYY7KJlsHPn_bZ_JeN4ZOREtDj022X92N6opwgAFx4DAKiCiGVqB8N11NaoHAq9VpgmVpbljNeD0639QpPRSmRzilo2IzLt_h5xj5YxHeRUrr0Kc2PLkVI Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: da1f95b9a87a4f1389c03f6a3f592a2e Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ListServersNegativeTestJSON-1597045337 Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/da1f95b9a87a4f1389c03f6a3f592a2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/da1f95b9a87a4f1389c03f6a3f592a2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/da1f95b9a87a4f1389c03f6a3f592a2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_da1f95b9a87a4f1389c03f6a3f592a2e", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ListServersNegativeTestJSON-1597045337 Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: da1f95b9a87a4f1389c03f6a3f592a2e Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1597045337 Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ListServersNegativeTestJSON-1597045337-project Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 391c4c8e6ae4483e82a247957a6faad9 Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ListServersNegativeTestJSON-1597045337-project Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 2af572bd-8a8b-4db7-9196-7203de031375 could not be found. Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '2af572bd-8a8b-4db7-9196-7203de031375'} Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2af572bd-8a8b-4db7-9196-7203de031375 could not be found. Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2af572bd-8a8b-4db7-9196-7203de031375 could not be found. Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:12:46.044290 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:46.050375 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:12:46.050375 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:46.050375 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:46.050375 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:46.050375 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:12:46.050375 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:12:46.050375 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2af572bd-8a8b-4db7-9196-7203de031375 could not be found. Aug 31 16:12:46.050375 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:12:46.063057 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c1f7372b-db7d-4b8b-983d-115d91da8d28 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] Returning 404 to user: Instance 2af572bd-8a8b-4db7-9196-7203de031375 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:12:46.064181 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c1f7372b-db7d-4b8b-983d-115d91da8d28 tempest-ListServersNegativeTestJSON-1597045337 tempest-ListServersNegativeTestJSON-1597045337-project] 10.222.0.50 "GET /compute/v2.1/servers/2af572bd-8a8b-4db7-9196-7203de031375" status: 404 len: 111 microversion: 2.1 time: 0.091463 Aug 31 16:12:46.064932 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2076/4356] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:45 2022] GET /compute/v2.1/servers/2af572bd-8a8b-4db7-9196-7203de031375 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:12:46.223672 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f4c135e3-9cf2-429d-9dfe-03643b4acee5 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:46.224634 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f4c135e3-9cf2-429d-9dfe-03643b4acee5 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:46.234650 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4c135e3-9cf2-429d-9dfe-03643b4acee5 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:46.235542 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4c135e3-9cf2-429d-9dfe-03643b4acee5 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:46.236184 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4c135e3-9cf2-429d-9dfe-03643b4acee5 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:46.237098 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4c135e3-9cf2-429d-9dfe-03643b4acee5 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:46.237770 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4c135e3-9cf2-429d-9dfe-03643b4acee5 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:46.241296 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4c135e3-9cf2-429d-9dfe-03643b4acee5 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:46.382737 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3b154803-b0b4-4d0f-acc3-721429adcc27 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:46.394640 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3b154803-b0b4-4d0f-acc3-721429adcc27 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a" status: 200 len: 1523 microversion: 2.1 time: 1.078713 Aug 31 16:12:46.410135 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2281/4357] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:45 2022] GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a => generated 1523 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:46.412830 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5a3ed562-d7b2-4783-8f36-94958da0c74c tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:46.413087 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5a3ed562-d7b2-4783-8f36-94958da0c74c tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 306160c1-762b-4b9e-aa09-3dd60f0c7ce3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:46.426933 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5a3ed562-d7b2-4783-8f36-94958da0c74c tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:46.431450 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5a3ed562-d7b2-4783-8f36-94958da0c74c tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:46.431938 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5a3ed562-d7b2-4783-8f36-94958da0c74c tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:46.432712 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5a3ed562-d7b2-4783-8f36-94958da0c74c tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:46.437479 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5a3ed562-d7b2-4783-8f36-94958da0c74c tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:46.437479 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5a3ed562-d7b2-4783-8f36-94958da0c74c tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:47.821542 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f4c135e3-9cf2-429d-9dfe-03643b4acee5 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:47.839967 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f4c135e3-9cf2-429d-9dfe-03643b4acee5 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f" status: 200 len: 1501 microversion: 2.1 time: 1.625409 Aug 31 16:12:47.840873 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2077/4358] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:46 2022] GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f => generated 1501 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:12:47.845736 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ecf7d79e-6d10-4206-ab71-b13544a99c85 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:47.846576 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ecf7d79e-6d10-4206-ab71-b13544a99c85 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ddb49409-d019-4682-b5c4-2d9b09cf7f9d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:47.862072 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ecf7d79e-6d10-4206-ab71-b13544a99c85 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:47.862656 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ecf7d79e-6d10-4206-ab71-b13544a99c85 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:47.863039 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ecf7d79e-6d10-4206-ab71-b13544a99c85 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:47.863750 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ecf7d79e-6d10-4206-ab71-b13544a99c85 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:47.864201 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ecf7d79e-6d10-4206-ab71-b13544a99c85 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:47.864619 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ecf7d79e-6d10-4206-ab71-b13544a99c85 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:47.998448 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5a3ed562-d7b2-4783-8f36-94958da0c74c tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:48.013672 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5a3ed562-d7b2-4783-8f36-94958da0c74c tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/306160c1-762b-4b9e-aa09-3dd60f0c7ce3" status: 200 len: 1466 microversion: 2.1 time: 1.611170 Aug 31 16:12:48.014346 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2282/4359] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:46 2022] GET /compute/v2.1/servers/306160c1-762b-4b9e-aa09-3dd60f0c7ce3 => generated 1466 bytes in 1616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:48.019170 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-0512614d-9704-4452-b786-1b7f83afe47c req-2a7034da-2cc3-424f-80ff-318004c24cec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "306160c1-762b-4b9e-aa09-3dd60f0c7ce3", "name": "network-vif-deleted", "tag": "c302a76d-c1bd-4ef3-9a00-d5e28f3fdde8"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:48.032581 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-0512614d-9704-4452-b786-1b7f83afe47c req-2a7034da-2cc3-424f-80ff-318004c24cec service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:48.033634 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-0512614d-9704-4452-b786-1b7f83afe47c req-2a7034da-2cc3-424f-80ff-318004c24cec service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:48.034281 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-0512614d-9704-4452-b786-1b7f83afe47c req-2a7034da-2cc3-424f-80ff-318004c24cec service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:48.047197 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-0512614d-9704-4452-b786-1b7f83afe47c req-2a7034da-2cc3-424f-80ff-318004c24cec service nova] Creating event network-vif-deleted:c302a76d-c1bd-4ef3-9a00-d5e28f3fdde8 for instance 306160c1-762b-4b9e-aa09-3dd60f0c7ce3 on n-h1-833090-16 Aug 31 16:12:48.052623 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-0512614d-9704-4452-b786-1b7f83afe47c req-2a7034da-2cc3-424f-80ff-318004c24cec service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036676 Aug 31 16:12:48.053583 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2283/4360] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:48.063294 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b8b42432-12ab-458b-8c69-6ef5962c37c9 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:48.064085 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b8b42432-12ab-458b-8c69-6ef5962c37c9 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: b60b7363-fd13-4b81-9c4b-0aabf39c5a6a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:48.070618 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b8b42432-12ab-458b-8c69-6ef5962c37c9 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:48.071190 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b8b42432-12ab-458b-8c69-6ef5962c37c9 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:48.071691 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b8b42432-12ab-458b-8c69-6ef5962c37c9 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:48.072441 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b8b42432-12ab-458b-8c69-6ef5962c37c9 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:48.072964 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b8b42432-12ab-458b-8c69-6ef5962c37c9 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:48.073463 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b8b42432-12ab-458b-8c69-6ef5962c37c9 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:48.379523 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ecf7d79e-6d10-4206-ab71-b13544a99c85 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:48.387819 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ecf7d79e-6d10-4206-ab71-b13544a99c85 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/ddb49409-d019-4682-b5c4-2d9b09cf7f9d" status: 200 len: 1309 microversion: 2.1 time: 0.545713 Aug 31 16:12:48.388485 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2078/4361] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:47 2022] GET /compute/v2.1/servers/ddb49409-d019-4682-b5c4-2d9b09cf7f9d => generated 1309 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:48.398177 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d68caf0a-43d8-4661-9ed5-581ee3a1a2eb tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:48.398177 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d68caf0a-43d8-4661-9ed5-581ee3a1a2eb tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 14167776-553f-4203-887b-3cb8e4cc0a2a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:48.398177 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:12:48.400934 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d68caf0a-43d8-4661-9ed5-581ee3a1a2eb tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:48.401479 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d68caf0a-43d8-4661-9ed5-581ee3a1a2eb tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:48.402012 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d68caf0a-43d8-4661-9ed5-581ee3a1a2eb tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:48.402879 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d68caf0a-43d8-4661-9ed5-581ee3a1a2eb tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:48.404019 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d68caf0a-43d8-4661-9ed5-581ee3a1a2eb tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:48.404505 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d68caf0a-43d8-4661-9ed5-581ee3a1a2eb tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:48.567559 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b8b42432-12ab-458b-8c69-6ef5962c37c9 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:48.579916 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b8b42432-12ab-458b-8c69-6ef5962c37c9 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a" status: 200 len: 1508 microversion: 2.1 time: 0.524512 Aug 31 16:12:48.580500 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2284/4362] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:48 2022] GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a => generated 1508 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:48.601676 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ad88efd1-db9a-4231-934e-9c07c0d5099d tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:48.602313 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ad88efd1-db9a-4231-934e-9c07c0d5099d tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: b60b7363-fd13-4b81-9c4b-0aabf39c5a6a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:48.609313 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ad88efd1-db9a-4231-934e-9c07c0d5099d tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:48.609909 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ad88efd1-db9a-4231-934e-9c07c0d5099d tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:48.610625 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ad88efd1-db9a-4231-934e-9c07c0d5099d tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:48.611483 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ad88efd1-db9a-4231-934e-9c07c0d5099d tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:48.612143 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ad88efd1-db9a-4231-934e-9c07c0d5099d tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:48.612637 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ad88efd1-db9a-4231-934e-9c07c0d5099d tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:48.952528 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d68caf0a-43d8-4661-9ed5-581ee3a1a2eb tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:48.964117 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d68caf0a-43d8-4661-9ed5-581ee3a1a2eb tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a" status: 200 len: 1515 microversion: 2.1 time: 0.574465 Aug 31 16:12:48.965432 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2079/4363] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:48 2022] GET /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a => generated 1515 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:48.992128 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-73b0431f-5491-467c-ac99-c0606a1969b9 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:48.994774 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-73b0431f-5491-467c-ac99-c0606a1969b9 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: ea5c76be-de43-4f46-9fd2-b9b6743e631c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:49.001943 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-73b0431f-5491-467c-ac99-c0606a1969b9 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] HTTP exception thrown: Instance ea5c76be-de43-4f46-9fd2-b9b6743e631c could not be found. Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-73b0431f-5491-467c-ac99-c0606a1969b9 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Request method failure captured: Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers/ea5c76be-de43-4f46-9fd2-b9b6743e631c/action HTTP/1.1 Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 14 Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4gyS9s2L5B9hQNj6-3Bq9VaD0LX3rcaQEx2TULT5jAIwE_syzV3-H131XTbmJBlDQO8oVuY07kOMzEcgw7jqBoRJefg3cpTEEDA9_ABXOKuvCpOJqmPJLOqW4m5eFAB54B22EgPHkAmNh0-egef1rV97h7ELSV4bCzsJF6Z18KMZ5s Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: d25e1b1938b2401bab27dafadc9745d5 Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-961929748 Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d25e1b1938b2401bab27dafadc9745d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d25e1b1938b2401bab27dafadc9745d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d25e1b1938b2401bab27dafadc9745d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d25e1b1938b2401bab27dafadc9745d5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServerRescueNegativeTestJSON-961929748 Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: d25e1b1938b2401bab27dafadc9745d5 Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-961929748 Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServerRescueNegativeTestJSON-961929748-project Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: b5f67b54e87c46d28e7d5217bf49ca57 Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServerRescueNegativeTestJSON-961929748-project Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: {"rescue": {}} Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance ea5c76be-de43-4f46-9fd2-b9b6743e631c could not be found. Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'ea5c76be-de43-4f46-9fd2-b9b6743e631c', 'body': {'rescue': {}}} Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea5c76be-de43-4f46-9fd2-b9b6743e631c could not be found. Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea5c76be-de43-4f46-9fd2-b9b6743e631c could not be found. Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:12:49.008461 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:49.014259 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:49.014259 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:49.014259 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:12:49.014259 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:12:49.014259 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea5c76be-de43-4f46-9fd2-b9b6743e631c could not be found. Aug 31 16:12:49.014259 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:12:49.015485 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-73b0431f-5491-467c-ac99-c0606a1969b9 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Returning 404 to user: Instance ea5c76be-de43-4f46-9fd2-b9b6743e631c could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:12:49.016365 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-73b0431f-5491-467c-ac99-c0606a1969b9 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "POST /compute/v2.1/servers/ea5c76be-de43-4f46-9fd2-b9b6743e631c/action" status: 404 len: 111 microversion: 2.1 time: 0.028342 Aug 31 16:12:49.021427 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2080/4364] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:12:48 2022] POST /compute/v2.1/servers/ea5c76be-de43-4f46-9fd2-b9b6743e631c/action => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:12:49.026778 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-25b0f874-2bf8-4a83-854f-4c0c85df72c1 req-dcf5f4bd-2fda-40fa-a5f0-e07cfb0b8c4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddb49409-d019-4682-b5c4-2d9b09cf7f9d", "name": "network-vif-plugged", "status": "completed", "tag": "7e4f8fe9-01f9-45ad-b58e-4eda10a64363"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:49.047279 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-25b0f874-2bf8-4a83-854f-4c0c85df72c1 req-dcf5f4bd-2fda-40fa-a5f0-e07cfb0b8c4a service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:49.047770 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-25b0f874-2bf8-4a83-854f-4c0c85df72c1 req-dcf5f4bd-2fda-40fa-a5f0-e07cfb0b8c4a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:49.048206 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-25b0f874-2bf8-4a83-854f-4c0c85df72c1 req-dcf5f4bd-2fda-40fa-a5f0-e07cfb0b8c4a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:49.062661 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-25b0f874-2bf8-4a83-854f-4c0c85df72c1 req-dcf5f4bd-2fda-40fa-a5f0-e07cfb0b8c4a service nova] Creating event network-vif-plugged:7e4f8fe9-01f9-45ad-b58e-4eda10a64363 for instance ddb49409-d019-4682-b5c4-2d9b09cf7f9d on n-h1-833090-16 Aug 31 16:12:49.067899 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-25b0f874-2bf8-4a83-854f-4c0c85df72c1 req-dcf5f4bd-2fda-40fa-a5f0-e07cfb0b8c4a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045043 Aug 31 16:12:49.068856 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2081/4365] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:49.075129 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8e52a556-c7cf-4013-a0e1-22708bb3b03b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:49.075766 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8e52a556-c7cf-4013-a0e1-22708bb3b03b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 14167776-553f-4203-887b-3cb8e4cc0a2a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:49.084161 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e52a556-c7cf-4013-a0e1-22708bb3b03b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:49.085247 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e52a556-c7cf-4013-a0e1-22708bb3b03b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:49.085959 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e52a556-c7cf-4013-a0e1-22708bb3b03b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:49.086941 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e52a556-c7cf-4013-a0e1-22708bb3b03b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:49.088798 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e52a556-c7cf-4013-a0e1-22708bb3b03b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:49.089561 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e52a556-c7cf-4013-a0e1-22708bb3b03b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:49.104946 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ad88efd1-db9a-4231-934e-9c07c0d5099d tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:49.142499 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ad88efd1-db9a-4231-934e-9c07c0d5099d tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a" status: 200 len: 1508 microversion: 2.1 time: 0.545333 Aug 31 16:12:49.158683 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2285/4366] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:48 2022] GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a => generated 1508 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:49.175360 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d1c85f2f-07fe-4813-b9b8-10ad3d18220f tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:49.177449 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d1c85f2f-07fe-4813-b9b8-10ad3d18220f tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 306160c1-762b-4b9e-aa09-3dd60f0c7ce3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:49.184702 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d1c85f2f-07fe-4813-b9b8-10ad3d18220f tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:49.185522 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d1c85f2f-07fe-4813-b9b8-10ad3d18220f tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:49.186179 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d1c85f2f-07fe-4813-b9b8-10ad3d18220f tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:49.187122 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d1c85f2f-07fe-4813-b9b8-10ad3d18220f tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:49.187787 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d1c85f2f-07fe-4813-b9b8-10ad3d18220f tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:49.188701 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d1c85f2f-07fe-4813-b9b8-10ad3d18220f tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:49.190386 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8e52a556-c7cf-4013-a0e1-22708bb3b03b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "POST /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a/action" status: 202 len: 0 microversion: 2.1 time: 0.119631 Aug 31 16:12:49.191401 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2082/4367] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:12:49 2022] POST /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:12:49.200911 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3890fa1d-2edc-40a0-8524-d67818033ebf tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:49.201512 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3890fa1d-2edc-40a0-8524-d67818033ebf tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: b60b7363-fd13-4b81-9c4b-0aabf39c5a6a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:49.211043 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-d1c85f2f-07fe-4813-b9b8-10ad3d18220f tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] HTTP exception thrown: Instance 306160c1-762b-4b9e-aa09-3dd60f0c7ce3 could not be found. Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d1c85f2f-07fe-4813-b9b8-10ad3d18220f tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Request method failure captured: Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/306160c1-762b-4b9e-aa09-3dd60f0c7ce3 HTTP/1.1 Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4fVb5lng7pw9SFQg8OO7U0FJ2ZnoT-odFJVbhbpcc2-iZIBffn8SoZkXFiAUS3GAi9tlAH1-cvA0TolX_WwF0slh0oNLzBKfcOjQ4yIOwUT0PsjgWRrjv2JB_CGO-yYeabtbeMLXxPy7mYzLlbFtGkvXplUyH3koXsl37FMbtgZ9o8 Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 2a9210acd39546b4b6fba9cda27a0aed Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServersAdminTestJSON-709682883 Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2a9210acd39546b4b6fba9cda27a0aed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2a9210acd39546b4b6fba9cda27a0aed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2a9210acd39546b4b6fba9cda27a0aed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2a9210acd39546b4b6fba9cda27a0aed", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServersAdminTestJSON-709682883 Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 2a9210acd39546b4b6fba9cda27a0aed Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServersAdminTestJSON-709682883 Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServersAdminTestJSON-709682883-project Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 4669ae0dec2c4ad8be74acd9ebf4d80a Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServersAdminTestJSON-709682883-project Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 306160c1-762b-4b9e-aa09-3dd60f0c7ce3 could not be found. Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '306160c1-762b-4b9e-aa09-3dd60f0c7ce3'} Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 306160c1-762b-4b9e-aa09-3dd60f0c7ce3 could not be found. Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 306160c1-762b-4b9e-aa09-3dd60f0c7ce3 could not be found. Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:49.215497 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:12:49.220970 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:49.220970 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:49.220970 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:49.220970 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:12:49.220970 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:12:49.220970 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 306160c1-762b-4b9e-aa09-3dd60f0c7ce3 could not be found. Aug 31 16:12:49.220970 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:12:49.220970 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d1c85f2f-07fe-4813-b9b8-10ad3d18220f tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Returning 404 to user: Instance 306160c1-762b-4b9e-aa09-3dd60f0c7ce3 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:12:49.222548 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3890fa1d-2edc-40a0-8524-d67818033ebf tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:49.224526 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3890fa1d-2edc-40a0-8524-d67818033ebf tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:49.224830 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d1c85f2f-07fe-4813-b9b8-10ad3d18220f tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/306160c1-762b-4b9e-aa09-3dd60f0c7ce3" status: 404 len: 111 microversion: 2.1 time: 0.058895 Aug 31 16:12:49.225461 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3890fa1d-2edc-40a0-8524-d67818033ebf tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:49.226525 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3890fa1d-2edc-40a0-8524-d67818033ebf tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:49.226919 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2286/4368] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:49 2022] GET /compute/v2.1/servers/306160c1-762b-4b9e-aa09-3dd60f0c7ce3 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:12:49.227499 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3890fa1d-2edc-40a0-8524-d67818033ebf tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:49.228203 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3890fa1d-2edc-40a0-8524-d67818033ebf tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:49.232827 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-817f736a-24f4-4b8b-b2aa-c7eb3bc95016 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:49.233946 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-817f736a-24f4-4b8b-b2aa-c7eb3bc95016 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 14167776-553f-4203-887b-3cb8e4cc0a2a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:49.241775 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-817f736a-24f4-4b8b-b2aa-c7eb3bc95016 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:49.242470 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-817f736a-24f4-4b8b-b2aa-c7eb3bc95016 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:49.243007 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-817f736a-24f4-4b8b-b2aa-c7eb3bc95016 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:49.244583 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-817f736a-24f4-4b8b-b2aa-c7eb3bc95016 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:49.245153 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-817f736a-24f4-4b8b-b2aa-c7eb3bc95016 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:49.245920 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-817f736a-24f4-4b8b-b2aa-c7eb3bc95016 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:49.272525 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3890fa1d-2edc-40a0-8524-d67818033ebf tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: b60b7363-fd13-4b81-9c4b-0aabf39c5a6a] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:12:49.398984 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3890fa1d-2edc-40a0-8524-d67818033ebf tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a" status: 204 len: 0 microversion: 2.1 time: 0.203947 Aug 31 16:12:49.400280 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2083/4369] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:12:49 2022] DELETE /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:12:49.428525 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5daab367-5382-43b9-b679-2171a839431e tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:49.429842 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5daab367-5382-43b9-b679-2171a839431e tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 5923807d-1058-45ab-b8d1-c6700ea8c142] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:49.445756 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5daab367-5382-43b9-b679-2171a839431e tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:49.446641 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5daab367-5382-43b9-b679-2171a839431e tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:49.450572 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5daab367-5382-43b9-b679-2171a839431e tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:49.451627 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5daab367-5382-43b9-b679-2171a839431e tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:49.452247 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5daab367-5382-43b9-b679-2171a839431e tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:49.453154 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5daab367-5382-43b9-b679-2171a839431e tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:49.515377 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5daab367-5382-43b9-b679-2171a839431e tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 5923807d-1058-45ab-b8d1-c6700ea8c142] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:12:49.616515 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5daab367-5382-43b9-b679-2171a839431e tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142" status: 204 len: 0 microversion: 2.1 time: 0.214612 Aug 31 16:12:49.617893 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2084/4370] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:12:49 2022] DELETE /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:12:49.621149 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-817f736a-24f4-4b8b-b2aa-c7eb3bc95016 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:49.624890 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-14ff5e56-c80d-44f9-9fdd-8ba14951b404 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:49.625620 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-14ff5e56-c80d-44f9-9fdd-8ba14951b404 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ddb49409-d019-4682-b5c4-2d9b09cf7f9d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:49.634772 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-817f736a-24f4-4b8b-b2aa-c7eb3bc95016 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a" status: 200 len: 1520 microversion: 2.1 time: 0.406095 Aug 31 16:12:49.636085 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14ff5e56-c80d-44f9-9fdd-8ba14951b404 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:49.637953 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14ff5e56-c80d-44f9-9fdd-8ba14951b404 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:49.638528 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14ff5e56-c80d-44f9-9fdd-8ba14951b404 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:49.639361 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14ff5e56-c80d-44f9-9fdd-8ba14951b404 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:49.640871 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14ff5e56-c80d-44f9-9fdd-8ba14951b404 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:49.641378 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14ff5e56-c80d-44f9-9fdd-8ba14951b404 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:49.650840 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2287/4371] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:49 2022] GET /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a => generated 1520 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:49.656745 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9e794fb5-415d-45e3-a4df-20d4e49b4088 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1350479907", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "6e75e888-e14d-4362-99a8-79dffb5a2c05"}]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:49.715219 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-9e794fb5-415d-45e3-a4df-20d4e49b4088 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] validate_networks() for [('6e75e888-e14d-4362-99a8-79dffb5a2c05', None, None, None, None, None)] {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:12:50.065748 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-14ff5e56-c80d-44f9-9fdd-8ba14951b404 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:50.075001 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-14ff5e56-c80d-44f9-9fdd-8ba14951b404 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/ddb49409-d019-4682-b5c4-2d9b09cf7f9d" status: 200 len: 1309 microversion: 2.1 time: 0.454851 Aug 31 16:12:50.075583 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2085/4372] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:49 2022] GET /compute/v2.1/servers/ddb49409-d019-4682-b5c4-2d9b09cf7f9d => generated 1309 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:50.080268 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9615f71a-4415-4be3-adaa-ebed7e2cf240 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:50.081677 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9615f71a-4415-4be3-adaa-ebed7e2cf240 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 5923807d-1058-45ab-b8d1-c6700ea8c142] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:50.088727 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9615f71a-4415-4be3-adaa-ebed7e2cf240 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:50.089210 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9615f71a-4415-4be3-adaa-ebed7e2cf240 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:50.090436 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9615f71a-4415-4be3-adaa-ebed7e2cf240 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:50.091166 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9615f71a-4415-4be3-adaa-ebed7e2cf240 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:50.091626 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9615f71a-4415-4be3-adaa-ebed7e2cf240 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:50.092059 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9615f71a-4415-4be3-adaa-ebed7e2cf240 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:50.109309 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:12:50.508177 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9615f71a-4415-4be3-adaa-ebed7e2cf240 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:50.546708 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9615f71a-4415-4be3-adaa-ebed7e2cf240 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142" status: 200 len: 1470 microversion: 2.1 time: 0.469316 Aug 31 16:12:50.548209 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2086/4373] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:50 2022] GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142 => generated 1470 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:50.658579 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7d919d03-29d0-419b-bc33-7fd74f843a9b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:50.659490 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7d919d03-29d0-419b-bc33-7fd74f843a9b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 14167776-553f-4203-887b-3cb8e4cc0a2a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:50.669439 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d919d03-29d0-419b-bc33-7fd74f843a9b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:50.669938 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d919d03-29d0-419b-bc33-7fd74f843a9b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:50.670415 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d919d03-29d0-419b-bc33-7fd74f843a9b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:50.671479 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d919d03-29d0-419b-bc33-7fd74f843a9b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:50.671935 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d919d03-29d0-419b-bc33-7fd74f843a9b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:50.672356 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d919d03-29d0-419b-bc33-7fd74f843a9b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:51.372453 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-9e794fb5-415d-45e3-a4df-20d4e49b4088 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:12:51.372976 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-9e794fb5-415d-45e3-a4df-20d4e49b4088 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:12:51.373476 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-9e794fb5-415d-45e3-a4df-20d4e49b4088 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:12:51.374247 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-9e794fb5-415d-45e3-a4df-20d4e49b4088 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:12:51.374661 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-9e794fb5-415d-45e3-a4df-20d4e49b4088 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:12:51.386720 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9e794fb5-415d-45e3-a4df-20d4e49b4088 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:51.387199 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9e794fb5-415d-45e3-a4df-20d4e49b4088 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:51.387688 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9e794fb5-415d-45e3-a4df-20d4e49b4088 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:51.388369 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9e794fb5-415d-45e3-a4df-20d4e49b4088 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:51.388822 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9e794fb5-415d-45e3-a4df-20d4e49b4088 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:51.389244 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9e794fb5-415d-45e3-a4df-20d4e49b4088 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:51.407577 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-9e794fb5-415d-45e3-a4df-20d4e49b4088 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Getting quotas for project 0e180149a99546f6ba25e638e4b4218b. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:12:51.413040 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-9e794fb5-415d-45e3-a4df-20d4e49b4088 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Getting quotas for user 1c4753a903d44ed89955218d54375bc9 and project 0e180149a99546f6ba25e638e4b4218b. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:12:51.425886 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9e794fb5-415d-45e3-a4df-20d4e49b4088 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:12:51.428474 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9e794fb5-415d-45e3-a4df-20d4e49b4088 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: af48d367-7828-47f9-a178-5d07cbaa26aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:12:51.442927 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7d919d03-29d0-419b-bc33-7fd74f843a9b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:51.458888 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7d919d03-29d0-419b-bc33-7fd74f843a9b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a" status: 200 len: 1500 microversion: 2.1 time: 0.804410 Aug 31 16:12:51.460054 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2087/4374] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:50 2022] GET /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a => generated 1500 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:51.467855 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d89782d7-f60c-48f5-901e-cd9b8d415601 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:51.469121 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d89782d7-f60c-48f5-901e-cd9b8d415601 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ddb49409-d019-4682-b5c4-2d9b09cf7f9d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:51.478060 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d89782d7-f60c-48f5-901e-cd9b8d415601 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:51.478703 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d89782d7-f60c-48f5-901e-cd9b8d415601 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:51.479169 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d89782d7-f60c-48f5-901e-cd9b8d415601 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:51.480144 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d89782d7-f60c-48f5-901e-cd9b8d415601 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:51.480850 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d89782d7-f60c-48f5-901e-cd9b8d415601 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:51.481507 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d89782d7-f60c-48f5-901e-cd9b8d415601 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:51.492700 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9e794fb5-415d-45e3-a4df-20d4e49b4088 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.840111 Aug 31 16:12:51.493682 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2288/4375] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:12:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1842 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:12:51.499609 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-88c00085-f70a-4a27-b318-0577205e3623 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:51.502423 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-88c00085-f70a-4a27-b318-0577205e3623 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 14167776-553f-4203-887b-3cb8e4cc0a2a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:51.514362 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-88c00085-f70a-4a27-b318-0577205e3623 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:51.544303 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-88c00085-f70a-4a27-b318-0577205e3623 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:51.545215 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-88c00085-f70a-4a27-b318-0577205e3623 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:51.546331 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-88c00085-f70a-4a27-b318-0577205e3623 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:51.547005 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-88c00085-f70a-4a27-b318-0577205e3623 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:51.547623 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-88c00085-f70a-4a27-b318-0577205e3623 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:51.591614 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-88c00085-f70a-4a27-b318-0577205e3623 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lazy-loading 'flavor' on Instance uuid 14167776-553f-4203-887b-3cb8e4cc0a2a {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:12:51.618266 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-88c00085-f70a-4a27-b318-0577205e3623 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] HTTP exception thrown: Cannot 'rescue' instance 14167776-553f-4203-887b-3cb8e4cc0a2a while it is in vm_state paused Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-88c00085-f70a-4a27-b318-0577205e3623 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Request method failure captured: Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: request: POST /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a/action HTTP/1.1 Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 14 Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4gyS9s2L5B9hQNj6-3Bq9VaD0LX3rcaQEx2TULT5jAIwE_syzV3-H131XTbmJBlDQO8oVuY07kOMzEcgw7jqBoRJefg3cpTEEDA9_ABXOKuvCpOJqmPJLOqW4m5eFAB54B22EgPHkAmNh0-egef1rV97h7ELSV4bCzsJF6Z18KMZ5s Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: d25e1b1938b2401bab27dafadc9745d5 Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-961929748 Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d25e1b1938b2401bab27dafadc9745d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d25e1b1938b2401bab27dafadc9745d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d25e1b1938b2401bab27dafadc9745d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d25e1b1938b2401bab27dafadc9745d5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServerRescueNegativeTestJSON-961929748 Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: d25e1b1938b2401bab27dafadc9745d5 Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-961929748 Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServerRescueNegativeTestJSON-961929748-project Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: b5f67b54e87c46d28e7d5217bf49ca57 Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServerRescueNegativeTestJSON-961929748-project Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: {"rescue": {}} Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: exception: Cannot 'rescue' instance 14167776-553f-4203-887b-3cb8e4cc0a2a while it is in vm_state paused Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '14167776-553f-4203-887b-3cb8e4cc0a2a', 'body': {'rescue': {}}} Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 14167776-553f-4203-887b-3cb8e4cc0a2a in vm_state paused. Cannot rescue while the instance is in this state. Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 14167776-553f-4203-887b-3cb8e4cc0a2a while it is in vm_state paused Aug 31 16:12:51.621045 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:12:51.630972 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:51.630972 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:12:51.630972 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:51.630972 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:51.630972 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:51.630972 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:12:51.630972 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:12:51.630972 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 14167776-553f-4203-887b-3cb8e4cc0a2a while it is in vm_state paused Aug 31 16:12:51.630972 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:12:51.640405 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-88c00085-f70a-4a27-b318-0577205e3623 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Returning 409 to user: Cannot 'rescue' instance 14167776-553f-4203-887b-3cb8e4cc0a2a while it is in vm_state paused {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:12:51.641781 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-88c00085-f70a-4a27-b318-0577205e3623 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "POST /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a/action" status: 409 len: 144 microversion: 2.1 time: 0.146697 Aug 31 16:12:51.649125 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2289/4376] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:12:51 2022] POST /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a/action => generated 144 bytes in 149 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 16:12:51.654898 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8a3b2764-6c50-4a36-98f0-7ff4783be2a1 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:51.656818 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8a3b2764-6c50-4a36-98f0-7ff4783be2a1 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: af48d367-7828-47f9-a178-5d07cbaa26aa] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:51.856567 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8a3b2764-6c50-4a36-98f0-7ff4783be2a1 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:51.867273 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8a3b2764-6c50-4a36-98f0-7ff4783be2a1 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/af48d367-7828-47f9-a178-5d07cbaa26aa" status: 200 len: 1218 microversion: 2.1 time: 0.221925 Aug 31 16:12:51.868613 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2290/4377] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:51 2022] GET /compute/v2.1/servers/af48d367-7828-47f9-a178-5d07cbaa26aa => generated 1218 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:51.891481 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-300fdf40-205c-4c4e-b4a6-8163b0dccdcf tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:51.892591 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-300fdf40-205c-4c4e-b4a6-8163b0dccdcf tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 5923807d-1058-45ab-b8d1-c6700ea8c142] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:51.903609 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-300fdf40-205c-4c4e-b4a6-8163b0dccdcf tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:51.904115 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-300fdf40-205c-4c4e-b4a6-8163b0dccdcf tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:51.904551 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-300fdf40-205c-4c4e-b4a6-8163b0dccdcf tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:51.905698 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-300fdf40-205c-4c4e-b4a6-8163b0dccdcf tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:51.906559 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-300fdf40-205c-4c4e-b4a6-8163b0dccdcf tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:51.907401 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-300fdf40-205c-4c4e-b4a6-8163b0dccdcf tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:51.993213 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d89782d7-f60c-48f5-901e-cd9b8d415601 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:52.003735 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d89782d7-f60c-48f5-901e-cd9b8d415601 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/ddb49409-d019-4682-b5c4-2d9b09cf7f9d" status: 200 len: 1309 microversion: 2.1 time: 0.541673 Aug 31 16:12:52.004712 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2088/4378] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:51 2022] GET /compute/v2.1/servers/ddb49409-d019-4682-b5c4-2d9b09cf7f9d => generated 1309 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:52.019672 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ae9672a0-ce40-429f-869a-f42237751175 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:52.020339 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ae9672a0-ce40-429f-869a-f42237751175 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 14167776-553f-4203-887b-3cb8e4cc0a2a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:52.038480 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae9672a0-ce40-429f-869a-f42237751175 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:52.041391 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae9672a0-ce40-429f-869a-f42237751175 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:52.042295 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae9672a0-ce40-429f-869a-f42237751175 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:52.044637 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae9672a0-ce40-429f-869a-f42237751175 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:52.047570 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae9672a0-ce40-429f-869a-f42237751175 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:52.048476 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae9672a0-ce40-429f-869a-f42237751175 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:52.254149 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ae9672a0-ce40-429f-869a-f42237751175 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "POST /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a/action" status: 202 len: 0 microversion: 2.1 time: 0.247404 Aug 31 16:12:52.258572 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2089/4379] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:12:52 2022] POST /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:12:52.269930 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-109bb0f6-0f79-464d-84c8-2241d0f2c97f tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:52.271079 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-109bb0f6-0f79-464d-84c8-2241d0f2c97f tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 14167776-553f-4203-887b-3cb8e4cc0a2a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:52.295012 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-109bb0f6-0f79-464d-84c8-2241d0f2c97f tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:52.296208 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-109bb0f6-0f79-464d-84c8-2241d0f2c97f tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:52.299993 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-109bb0f6-0f79-464d-84c8-2241d0f2c97f tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:52.301055 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-109bb0f6-0f79-464d-84c8-2241d0f2c97f tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:52.301729 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-109bb0f6-0f79-464d-84c8-2241d0f2c97f tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:52.302502 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-109bb0f6-0f79-464d-84c8-2241d0f2c97f tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:52.429728 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-300fdf40-205c-4c4e-b4a6-8163b0dccdcf tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:52.442907 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-300fdf40-205c-4c4e-b4a6-8163b0dccdcf tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142" status: 200 len: 1470 microversion: 2.1 time: 0.557094 Aug 31 16:12:52.443445 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2291/4380] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:51 2022] GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142 => generated 1470 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:52.701630 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-109bb0f6-0f79-464d-84c8-2241d0f2c97f tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:52.720053 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-109bb0f6-0f79-464d-84c8-2241d0f2c97f tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a" status: 200 len: 1507 microversion: 2.1 time: 0.455221 Aug 31 16:12:52.736506 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2090/4381] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:52 2022] GET /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a => generated 1507 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:52.753500 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-947ce8ec-899e-4945-b684-a77c75e7b173 req-aa0481a7-d990-45c4-b011-da6c4554ab78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5923807d-1058-45ab-b8d1-c6700ea8c142", "name": "network-vif-deleted", "tag": "b92f4d7a-9fe1-49d2-9d35-67e9a518bfc4"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:52.781585 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-947ce8ec-899e-4945-b684-a77c75e7b173 req-aa0481a7-d990-45c4-b011-da6c4554ab78 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:52.782108 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-947ce8ec-899e-4945-b684-a77c75e7b173 req-aa0481a7-d990-45c4-b011-da6c4554ab78 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:52.782570 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-947ce8ec-899e-4945-b684-a77c75e7b173 req-aa0481a7-d990-45c4-b011-da6c4554ab78 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:52.783190 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e3a4f9da-7b30-4779-a82c-6c99f8b2b783 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1739224846", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "0bc451a1-d542-48f0-bc5e-c6b3488d4cbd"}]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:52.831391 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-947ce8ec-899e-4945-b684-a77c75e7b173 req-aa0481a7-d990-45c4-b011-da6c4554ab78 service nova] Creating event network-vif-deleted:b92f4d7a-9fe1-49d2-9d35-67e9a518bfc4 for instance 5923807d-1058-45ab-b8d1-c6700ea8c142 on n-h2-833090-16 Aug 31 16:12:52.851861 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-947ce8ec-899e-4945-b684-a77c75e7b173 req-aa0481a7-d990-45c4-b011-da6c4554ab78 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113182 Aug 31 16:12:52.859421 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2091/4382] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:12:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:52.902312 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bb09a68b-514c-4fd0-9959-f40784f7764f tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:52.903596 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bb09a68b-514c-4fd0-9959-f40784f7764f tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: af48d367-7828-47f9-a178-5d07cbaa26aa] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:52.921136 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bb09a68b-514c-4fd0-9959-f40784f7764f tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:52.922282 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bb09a68b-514c-4fd0-9959-f40784f7764f tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:52.931083 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bb09a68b-514c-4fd0-9959-f40784f7764f tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:52.938068 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-e3a4f9da-7b30-4779-a82c-6c99f8b2b783 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] validate_networks() for [('0bc451a1-d542-48f0-bc5e-c6b3488d4cbd', None, None, None, None, None)] {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:12:52.940840 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bb09a68b-514c-4fd0-9959-f40784f7764f tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:52.941363 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bb09a68b-514c-4fd0-9959-f40784f7764f tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:52.941811 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bb09a68b-514c-4fd0-9959-f40784f7764f tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:53.530438 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bb09a68b-514c-4fd0-9959-f40784f7764f tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:53.540497 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bb09a68b-514c-4fd0-9959-f40784f7764f tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/af48d367-7828-47f9-a178-5d07cbaa26aa" status: 200 len: 1270 microversion: 2.1 time: 0.655233 Aug 31 16:12:53.545406 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2092/4383] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:52 2022] GET /compute/v2.1/servers/af48d367-7828-47f9-a178-5d07cbaa26aa => generated 1270 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:53.552791 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-702a3359-4db2-4009-bc82-a596f607ae93 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:53.554333 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-702a3359-4db2-4009-bc82-a596f607ae93 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ddb49409-d019-4682-b5c4-2d9b09cf7f9d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:53.565136 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-702a3359-4db2-4009-bc82-a596f607ae93 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:53.566315 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-702a3359-4db2-4009-bc82-a596f607ae93 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:53.567754 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-702a3359-4db2-4009-bc82-a596f607ae93 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:53.568987 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-702a3359-4db2-4009-bc82-a596f607ae93 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:53.569843 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-702a3359-4db2-4009-bc82-a596f607ae93 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:53.571975 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-702a3359-4db2-4009-bc82-a596f607ae93 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:53.909167 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-702a3359-4db2-4009-bc82-a596f607ae93 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:53.924255 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-702a3359-4db2-4009-bc82-a596f607ae93 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/ddb49409-d019-4682-b5c4-2d9b09cf7f9d" status: 200 len: 1490 microversion: 2.1 time: 0.377308 Aug 31 16:12:53.924852 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2093/4384] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:53 2022] GET /compute/v2.1/servers/ddb49409-d019-4682-b5c4-2d9b09cf7f9d => generated 1490 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:53.931402 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-6217e8ec-29d4-43cd-ae4e-554fdec6e1fb req-6141cd6d-1c05-4831-85ba-017fcdfea970 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b60b7363-fd13-4b81-9c4b-0aabf39c5a6a", "name": "network-vif-deleted", "tag": "498f733b-bbc6-4db1-9c7b-1cc502f31161"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:53.954483 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-6217e8ec-29d4-43cd-ae4e-554fdec6e1fb req-6141cd6d-1c05-4831-85ba-017fcdfea970 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:53.955222 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-6217e8ec-29d4-43cd-ae4e-554fdec6e1fb req-6141cd6d-1c05-4831-85ba-017fcdfea970 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:53.955880 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-6217e8ec-29d4-43cd-ae4e-554fdec6e1fb req-6141cd6d-1c05-4831-85ba-017fcdfea970 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:53.984920 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-6217e8ec-29d4-43cd-ae4e-554fdec6e1fb req-6141cd6d-1c05-4831-85ba-017fcdfea970 service nova] Creating event network-vif-deleted:498f733b-bbc6-4db1-9c7b-1cc502f31161 for instance b60b7363-fd13-4b81-9c4b-0aabf39c5a6a on n-h1-833090-16 Aug 31 16:12:53.994168 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-6217e8ec-29d4-43cd-ae4e-554fdec6e1fb req-6141cd6d-1c05-4831-85ba-017fcdfea970 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065751 Aug 31 16:12:53.995230 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2094/4385] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:54.003357 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4d14b79d-a735-4f95-a9a9-123038eb7911 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:54.004540 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4d14b79d-a735-4f95-a9a9-123038eb7911 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 5923807d-1058-45ab-b8d1-c6700ea8c142] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:54.014697 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d14b79d-a735-4f95-a9a9-123038eb7911 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:54.015641 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d14b79d-a735-4f95-a9a9-123038eb7911 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:54.016325 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d14b79d-a735-4f95-a9a9-123038eb7911 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:54.017283 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d14b79d-a735-4f95-a9a9-123038eb7911 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:54.018021 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d14b79d-a735-4f95-a9a9-123038eb7911 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:54.019113 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d14b79d-a735-4f95-a9a9-123038eb7911 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:54.069861 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d14b79d-a735-4f95-a9a9-123038eb7911 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:54.070722 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d14b79d-a735-4f95-a9a9-123038eb7911 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:54.071797 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d14b79d-a735-4f95-a9a9-123038eb7911 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:54.072500 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-4d14b79d-a735-4f95-a9a9-123038eb7911 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lazy-loading 'fault' on Instance uuid 5923807d-1058-45ab-b8d1-c6700ea8c142 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:12:54.193918 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4d14b79d-a735-4f95-a9a9-123038eb7911 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4669ae0dec2c4ad8be74acd9ebf4d80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9210acd39546b4b6fba9cda27a0aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:54.206920 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4d14b79d-a735-4f95-a9a9-123038eb7911 tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142" status: 200 len: 1304 microversion: 2.1 time: 0.209417 Aug 31 16:12:54.208220 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2095/4386] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:53 2022] GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142 => generated 1304 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:54.209671 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-e3a4f9da-7b30-4779-a82c-6c99f8b2b783 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:12:54.210992 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-e3a4f9da-7b30-4779-a82c-6c99f8b2b783 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:12:54.211566 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-e3a4f9da-7b30-4779-a82c-6c99f8b2b783 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:12:54.212073 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-e3a4f9da-7b30-4779-a82c-6c99f8b2b783 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:12:54.212487 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-e3a4f9da-7b30-4779-a82c-6c99f8b2b783 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:12:54.225339 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-77fcaf94-477a-44ce-8c02-123efedb6ed2 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:54.226880 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-77fcaf94-477a-44ce-8c02-123efedb6ed2 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 14167776-553f-4203-887b-3cb8e4cc0a2a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:54.231177 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e3a4f9da-7b30-4779-a82c-6c99f8b2b783 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:54.233832 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e3a4f9da-7b30-4779-a82c-6c99f8b2b783 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:54.236616 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e3a4f9da-7b30-4779-a82c-6c99f8b2b783 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:54.237776 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e3a4f9da-7b30-4779-a82c-6c99f8b2b783 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:54.238452 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e3a4f9da-7b30-4779-a82c-6c99f8b2b783 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:54.242916 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e3a4f9da-7b30-4779-a82c-6c99f8b2b783 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:54.245176 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-77fcaf94-477a-44ce-8c02-123efedb6ed2 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:54.246947 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-77fcaf94-477a-44ce-8c02-123efedb6ed2 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:54.248170 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-77fcaf94-477a-44ce-8c02-123efedb6ed2 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:54.249836 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-77fcaf94-477a-44ce-8c02-123efedb6ed2 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:54.251812 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-77fcaf94-477a-44ce-8c02-123efedb6ed2 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:54.252678 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-77fcaf94-477a-44ce-8c02-123efedb6ed2 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:54.302143 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-e3a4f9da-7b30-4779-a82c-6c99f8b2b783 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Getting quotas for project 90b4f8a1c71745c6b860b5723acf164b. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:12:54.318834 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-e3a4f9da-7b30-4779-a82c-6c99f8b2b783 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Getting quotas for user 6ecd9e924c54474690f780576adc3a86 and project 90b4f8a1c71745c6b860b5723acf164b. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:12:54.359881 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e3a4f9da-7b30-4779-a82c-6c99f8b2b783 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:12:54.366281 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e3a4f9da-7b30-4779-a82c-6c99f8b2b783 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] [instance: 7a118055-6c34-44a8-a30e-f5ff8bb66fba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:12:54.458385 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e3a4f9da-7b30-4779-a82c-6c99f8b2b783 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 2.013334 Aug 31 16:12:54.467943 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2292/4387] 10.222.0.50 () {62 vars in 1188 bytes} [Wed Aug 31 16:12:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2024 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 31 16:12:54.476988 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e4ae8a7c-f4a5-4527-b556-4136de10c582 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:54.478628 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e4ae8a7c-f4a5-4527-b556-4136de10c582 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: eb6e0169-ac40-4675-b6e9-2a3ea7b13f40] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:54.489527 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4ae8a7c-f4a5-4527-b556-4136de10c582 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:54.490408 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4ae8a7c-f4a5-4527-b556-4136de10c582 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:54.491016 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4ae8a7c-f4a5-4527-b556-4136de10c582 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:54.492100 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4ae8a7c-f4a5-4527-b556-4136de10c582 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:54.493075 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4ae8a7c-f4a5-4527-b556-4136de10c582 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:54.493843 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4ae8a7c-f4a5-4527-b556-4136de10c582 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:54.511095 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-77fcaf94-477a-44ce-8c02-123efedb6ed2 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:54.521446 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-77fcaf94-477a-44ce-8c02-123efedb6ed2 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a" status: 200 len: 1515 microversion: 2.1 time: 0.311954 Aug 31 16:12:54.522351 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2096/4388] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:54 2022] GET /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a => generated 1515 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:54.527941 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bc2a98e7-0dd3-49a9-a614-484c1d358d64 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:54.528574 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bc2a98e7-0dd3-49a9-a614-484c1d358d64 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] [instance: 7a118055-6c34-44a8-a30e-f5ff8bb66fba] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:54.598031 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bc2a98e7-0dd3-49a9-a614-484c1d358d64 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecd9e924c54474690f780576adc3a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b4f8a1c71745c6b860b5723acf164b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:54.618817 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bc2a98e7-0dd3-49a9-a614-484c1d358d64 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ecd9e924c54474690f780576adc3a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b4f8a1c71745c6b860b5723acf164b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:54.632404 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bc2a98e7-0dd3-49a9-a614-484c1d358d64 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ecd9e924c54474690f780576adc3a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b4f8a1c71745c6b860b5723acf164b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:54.635053 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bc2a98e7-0dd3-49a9-a614-484c1d358d64 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] 10.222.0.50 "GET /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba" status: 200 len: 1262 microversion: 2.26 time: 0.111575 Aug 31 16:12:54.636594 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2097/4389] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:12:54 2022] GET /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba => generated 1262 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:12:54.643795 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f53bf1b2-6177-421d-bc8d-5bec850b3072 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:54.644714 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f53bf1b2-6177-421d-bc8d-5bec850b3072 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: af48d367-7828-47f9-a178-5d07cbaa26aa] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:54.653649 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f53bf1b2-6177-421d-bc8d-5bec850b3072 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:54.654379 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f53bf1b2-6177-421d-bc8d-5bec850b3072 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:54.655023 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f53bf1b2-6177-421d-bc8d-5bec850b3072 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:54.655897 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f53bf1b2-6177-421d-bc8d-5bec850b3072 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:54.656510 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f53bf1b2-6177-421d-bc8d-5bec850b3072 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:54.657096 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f53bf1b2-6177-421d-bc8d-5bec850b3072 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:54.928789 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f53bf1b2-6177-421d-bc8d-5bec850b3072 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:54.939260 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f53bf1b2-6177-421d-bc8d-5bec850b3072 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/af48d367-7828-47f9-a178-5d07cbaa26aa" status: 200 len: 1276 microversion: 2.1 time: 0.300466 Aug 31 16:12:54.942388 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2098/4390] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:54 2022] GET /compute/v2.1/servers/af48d367-7828-47f9-a178-5d07cbaa26aa => generated 1276 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:54.952042 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e4ae8a7c-f4a5-4527-b556-4136de10c582 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:54.965336 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e4ae8a7c-f4a5-4527-b556-4136de10c582 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/eb6e0169-ac40-4675-b6e9-2a3ea7b13f40" status: 200 len: 1490 microversion: 2.1 time: 0.495199 Aug 31 16:12:54.967779 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2293/4391] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:54 2022] GET /compute/v2.1/servers/eb6e0169-ac40-4675-b6e9-2a3ea7b13f40 => generated 1490 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:54.994741 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-89b67b45-491b-4711-b3f1-31929f706a13 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:54.995446 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-89b67b45-491b-4711-b3f1-31929f706a13 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ddb49409-d019-4682-b5c4-2d9b09cf7f9d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:55.011652 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-89b67b45-491b-4711-b3f1-31929f706a13 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:55.013569 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-89b67b45-491b-4711-b3f1-31929f706a13 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:55.014161 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-89b67b45-491b-4711-b3f1-31929f706a13 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:55.015618 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-89b67b45-491b-4711-b3f1-31929f706a13 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:55.017242 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-89b67b45-491b-4711-b3f1-31929f706a13 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:55.019162 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-89b67b45-491b-4711-b3f1-31929f706a13 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:55.234725 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3ea1ab37-d7dc-4449-b59f-b0b51c2a51ec tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:55.235442 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3ea1ab37-d7dc-4449-b59f-b0b51c2a51ec tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] [instance: 5923807d-1058-45ab-b8d1-c6700ea8c142] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:55.243120 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3ea1ab37-d7dc-4449-b59f-b0b51c2a51ec tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:55.244377 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3ea1ab37-d7dc-4449-b59f-b0b51c2a51ec tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:55.245235 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3ea1ab37-d7dc-4449-b59f-b0b51c2a51ec tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:55.246686 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3ea1ab37-d7dc-4449-b59f-b0b51c2a51ec tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:55.248685 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3ea1ab37-d7dc-4449-b59f-b0b51c2a51ec tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:55.249868 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3ea1ab37-d7dc-4449-b59f-b0b51c2a51ec tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:55.286173 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-3ea1ab37-d7dc-4449-b59f-b0b51c2a51ec tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] HTTP exception thrown: Instance 5923807d-1058-45ab-b8d1-c6700ea8c142 could not be found. Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3ea1ab37-d7dc-4449-b59f-b0b51c2a51ec tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Request method failure captured: Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142 HTTP/1.1 Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4fVb5lng7pw9SFQg8OO7U0FJ2ZnoT-odFJVbhbpcc2-iZIBffn8SoZkXFiAUS3GAi9tlAH1-cvA0TolX_WwF0slh0oNLzBKfcOjQ4yIOwUT0PsjgWRrjv2JB_CGO-yYeabtbeMLXxPy7mYzLlbFtGkvXplUyH3koXsl37FMbtgZ9o8 Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 2a9210acd39546b4b6fba9cda27a0aed Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServersAdminTestJSON-709682883 Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2a9210acd39546b4b6fba9cda27a0aed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2a9210acd39546b4b6fba9cda27a0aed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2a9210acd39546b4b6fba9cda27a0aed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2a9210acd39546b4b6fba9cda27a0aed", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServersAdminTestJSON-709682883 Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 2a9210acd39546b4b6fba9cda27a0aed Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServersAdminTestJSON-709682883 Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServersAdminTestJSON-709682883-project Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 4669ae0dec2c4ad8be74acd9ebf4d80a Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServersAdminTestJSON-709682883-project Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 5923807d-1058-45ab-b8d1-c6700ea8c142 could not be found. Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '5923807d-1058-45ab-b8d1-c6700ea8c142'} Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5923807d-1058-45ab-b8d1-c6700ea8c142 could not be found. Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5923807d-1058-45ab-b8d1-c6700ea8c142 could not be found. Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:12:55.289037 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:12:55.297025 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:12:55.297025 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:12:55.297025 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:12:55.297025 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:12:55.297025 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:12:55.297025 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5923807d-1058-45ab-b8d1-c6700ea8c142 could not be found. Aug 31 16:12:55.297025 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:12:55.301364 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3ea1ab37-d7dc-4449-b59f-b0b51c2a51ec tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] Returning 404 to user: Instance 5923807d-1058-45ab-b8d1-c6700ea8c142 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:12:55.302334 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3ea1ab37-d7dc-4449-b59f-b0b51c2a51ec tempest-ServersAdminTestJSON-709682883 tempest-ServersAdminTestJSON-709682883-project] 10.222.0.50 "GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142" status: 404 len: 111 microversion: 2.1 time: 0.075026 Aug 31 16:12:55.329838 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2294/4392] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:55 2022] GET /compute/v2.1/servers/5923807d-1058-45ab-b8d1-c6700ea8c142 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:12:55.385393 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-89b67b45-491b-4711-b3f1-31929f706a13 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:55.419241 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-89b67b45-491b-4711-b3f1-31929f706a13 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/ddb49409-d019-4682-b5c4-2d9b09cf7f9d" status: 200 len: 1490 microversion: 2.1 time: 0.417964 Aug 31 16:12:55.420517 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2099/4393] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:54 2022] GET /compute/v2.1/servers/ddb49409-d019-4682-b5c4-2d9b09cf7f9d => generated 1490 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:55.456192 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6d32dab7-4f52-4fb2-9c5b-2a088001e40c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:55.456776 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6d32dab7-4f52-4fb2-9c5b-2a088001e40c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ddb49409-d019-4682-b5c4-2d9b09cf7f9d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:55.471670 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d32dab7-4f52-4fb2-9c5b-2a088001e40c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:55.475554 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d32dab7-4f52-4fb2-9c5b-2a088001e40c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:55.477059 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d32dab7-4f52-4fb2-9c5b-2a088001e40c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:55.483035 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d32dab7-4f52-4fb2-9c5b-2a088001e40c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:55.485146 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d32dab7-4f52-4fb2-9c5b-2a088001e40c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:55.486217 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d32dab7-4f52-4fb2-9c5b-2a088001e40c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:55.548259 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6d32dab7-4f52-4fb2-9c5b-2a088001e40c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ddb49409-d019-4682-b5c4-2d9b09cf7f9d] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:12:55.658237 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d1afb379-d37e-4c24-b544-35b23dbcc915 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:55.658939 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d1afb379-d37e-4c24-b544-35b23dbcc915 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] [instance: 7a118055-6c34-44a8-a30e-f5ff8bb66fba] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:55.668244 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d1afb379-d37e-4c24-b544-35b23dbcc915 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:55.668835 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d1afb379-d37e-4c24-b544-35b23dbcc915 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:55.669377 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d1afb379-d37e-4c24-b544-35b23dbcc915 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:55.670359 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d1afb379-d37e-4c24-b544-35b23dbcc915 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:55.671303 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d1afb379-d37e-4c24-b544-35b23dbcc915 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:55.672068 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d1afb379-d37e-4c24-b544-35b23dbcc915 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:55.780247 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6d32dab7-4f52-4fb2-9c5b-2a088001e40c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ddb49409-d019-4682-b5c4-2d9b09cf7f9d" status: 204 len: 0 microversion: 2.1 time: 0.327885 Aug 31 16:12:55.787702 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2295/4394] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:12:55 2022] DELETE /compute/v2.1/servers/ddb49409-d019-4682-b5c4-2d9b09cf7f9d => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:12:55.794488 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-76502a20-e797-458a-9e6d-aa57f7d67a9c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:55.795486 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-76502a20-e797-458a-9e6d-aa57f7d67a9c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ddb49409-d019-4682-b5c4-2d9b09cf7f9d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:55.813670 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76502a20-e797-458a-9e6d-aa57f7d67a9c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:55.815514 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76502a20-e797-458a-9e6d-aa57f7d67a9c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:55.817644 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76502a20-e797-458a-9e6d-aa57f7d67a9c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:55.818677 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76502a20-e797-458a-9e6d-aa57f7d67a9c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:55.821823 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76502a20-e797-458a-9e6d-aa57f7d67a9c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:55.822497 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76502a20-e797-458a-9e6d-aa57f7d67a9c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:55.879009 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d1afb379-d37e-4c24-b544-35b23dbcc915 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecd9e924c54474690f780576adc3a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b4f8a1c71745c6b860b5723acf164b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:55.945242 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d1afb379-d37e-4c24-b544-35b23dbcc915 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ecd9e924c54474690f780576adc3a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b4f8a1c71745c6b860b5723acf164b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:55.966262 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d1afb379-d37e-4c24-b544-35b23dbcc915 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ecd9e924c54474690f780576adc3a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b4f8a1c71745c6b860b5723acf164b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:55.970790 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d1afb379-d37e-4c24-b544-35b23dbcc915 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] 10.222.0.50 "GET /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba" status: 200 len: 1266 microversion: 2.26 time: 0.316192 Aug 31 16:12:56.010334 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2100/4395] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:12:55 2022] GET /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba => generated 1266 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:12:56.059381 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a729b32f-3352-4f05-98df-2bbfdfb3fb3c tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:56.062269 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a729b32f-3352-4f05-98df-2bbfdfb3fb3c tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: af48d367-7828-47f9-a178-5d07cbaa26aa] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:56.093596 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a729b32f-3352-4f05-98df-2bbfdfb3fb3c tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:56.095964 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a729b32f-3352-4f05-98df-2bbfdfb3fb3c tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:56.098237 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a729b32f-3352-4f05-98df-2bbfdfb3fb3c tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:56.099101 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a729b32f-3352-4f05-98df-2bbfdfb3fb3c tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:56.101881 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a729b32f-3352-4f05-98df-2bbfdfb3fb3c tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:56.102743 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a729b32f-3352-4f05-98df-2bbfdfb3fb3c tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:56.291751 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-76502a20-e797-458a-9e6d-aa57f7d67a9c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:56.298823 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a729b32f-3352-4f05-98df-2bbfdfb3fb3c tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:56.305830 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-76502a20-e797-458a-9e6d-aa57f7d67a9c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/ddb49409-d019-4682-b5c4-2d9b09cf7f9d" status: 200 len: 1496 microversion: 2.1 time: 0.516341 Aug 31 16:12:56.306656 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2296/4396] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:55 2022] GET /compute/v2.1/servers/ddb49409-d019-4682-b5c4-2d9b09cf7f9d => generated 1496 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:56.321880 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a729b32f-3352-4f05-98df-2bbfdfb3fb3c tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/af48d367-7828-47f9-a178-5d07cbaa26aa" status: 200 len: 1276 microversion: 2.1 time: 0.304994 Aug 31 16:12:56.323701 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2101/4397] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:56 2022] GET /compute/v2.1/servers/af48d367-7828-47f9-a178-5d07cbaa26aa => generated 1276 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:57.045804 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f1791860-638e-41f9-a4ab-2f1e6b992f1d tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:57.046893 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f1791860-638e-41f9-a4ab-2f1e6b992f1d tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] [instance: 7a118055-6c34-44a8-a30e-f5ff8bb66fba] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:57.059202 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f1791860-638e-41f9-a4ab-2f1e6b992f1d tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:57.062897 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f1791860-638e-41f9-a4ab-2f1e6b992f1d tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:57.067274 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f1791860-638e-41f9-a4ab-2f1e6b992f1d tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:57.068139 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f1791860-638e-41f9-a4ab-2f1e6b992f1d tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:57.068900 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f1791860-638e-41f9-a4ab-2f1e6b992f1d tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:57.070507 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f1791860-638e-41f9-a4ab-2f1e6b992f1d tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:57.204597 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f1791860-638e-41f9-a4ab-2f1e6b992f1d tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecd9e924c54474690f780576adc3a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b4f8a1c71745c6b860b5723acf164b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:57.213716 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f1791860-638e-41f9-a4ab-2f1e6b992f1d tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ecd9e924c54474690f780576adc3a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b4f8a1c71745c6b860b5723acf164b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:57.219359 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f1791860-638e-41f9-a4ab-2f1e6b992f1d tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ecd9e924c54474690f780576adc3a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b4f8a1c71745c6b860b5723acf164b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:57.220561 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f1791860-638e-41f9-a4ab-2f1e6b992f1d tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] 10.222.0.50 "GET /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba" status: 200 len: 1258 microversion: 2.26 time: 0.180017 Aug 31 16:12:57.225827 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2297/4398] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:12:57 2022] GET /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba => generated 1258 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:12:57.281288 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8cf45e66-8189-47f5-9540-2dd6ba27d768 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:57.284470 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8cf45e66-8189-47f5-9540-2dd6ba27d768 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 14167776-553f-4203-887b-3cb8e4cc0a2a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:57.302786 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8cf45e66-8189-47f5-9540-2dd6ba27d768 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:57.304088 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8cf45e66-8189-47f5-9540-2dd6ba27d768 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:57.304608 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8cf45e66-8189-47f5-9540-2dd6ba27d768 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:57.305409 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8cf45e66-8189-47f5-9540-2dd6ba27d768 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:57.307413 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8cf45e66-8189-47f5-9540-2dd6ba27d768 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:57.308109 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8cf45e66-8189-47f5-9540-2dd6ba27d768 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:57.327638 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e9d58488-2556-41dd-95e1-eeda26c7387b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:57.328845 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e9d58488-2556-41dd-95e1-eeda26c7387b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ddb49409-d019-4682-b5c4-2d9b09cf7f9d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:57.342782 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-8cf45e66-8189-47f5-9540-2dd6ba27d768 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lazy-loading 'flavor' on Instance uuid 14167776-553f-4203-887b-3cb8e4cc0a2a {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:12:57.343010 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e9d58488-2556-41dd-95e1-eeda26c7387b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:57.343314 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e9d58488-2556-41dd-95e1-eeda26c7387b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:57.343761 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e9d58488-2556-41dd-95e1-eeda26c7387b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:57.344471 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e9d58488-2556-41dd-95e1-eeda26c7387b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:57.344928 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e9d58488-2556-41dd-95e1-eeda26c7387b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:57.345357 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e9d58488-2556-41dd-95e1-eeda26c7387b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:57.405378 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:12:57.500504 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:12:57.554147 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8cf45e66-8189-47f5-9540-2dd6ba27d768 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "POST /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a/action" status: 200 len: 32 microversion: 2.1 time: 0.278012 Aug 31 16:12:57.556953 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2102/4399] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:12:57 2022] POST /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a/action => generated 32 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:12:57.563375 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-104fe32a-faa5-4b9c-b277-e90628c2d21a tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:57.564382 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-104fe32a-faa5-4b9c-b277-e90628c2d21a tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: af48d367-7828-47f9-a178-5d07cbaa26aa] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:57.573743 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-104fe32a-faa5-4b9c-b277-e90628c2d21a tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:57.575006 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-104fe32a-faa5-4b9c-b277-e90628c2d21a tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:57.575739 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-104fe32a-faa5-4b9c-b277-e90628c2d21a tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:57.576731 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-104fe32a-faa5-4b9c-b277-e90628c2d21a tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:57.577495 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-104fe32a-faa5-4b9c-b277-e90628c2d21a tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:57.578169 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-104fe32a-faa5-4b9c-b277-e90628c2d21a tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:57.717656 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e9d58488-2556-41dd-95e1-eeda26c7387b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:57.726754 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e9d58488-2556-41dd-95e1-eeda26c7387b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/ddb49409-d019-4682-b5c4-2d9b09cf7f9d" status: 200 len: 1496 microversion: 2.1 time: 0.403159 Aug 31 16:12:57.752782 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2298/4400] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:57 2022] GET /compute/v2.1/servers/ddb49409-d019-4682-b5c4-2d9b09cf7f9d => generated 1496 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:12:57.758164 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4cfafff4-309e-420c-9837-1088327e2569 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:57.759082 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4cfafff4-309e-420c-9837-1088327e2569 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 14167776-553f-4203-887b-3cb8e4cc0a2a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:57.769209 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4cfafff4-309e-420c-9837-1088327e2569 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:57.782822 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4cfafff4-309e-420c-9837-1088327e2569 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:57.784185 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4cfafff4-309e-420c-9837-1088327e2569 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:57.784693 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4cfafff4-309e-420c-9837-1088327e2569 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:57.785449 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4cfafff4-309e-420c-9837-1088327e2569 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:57.786178 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4cfafff4-309e-420c-9837-1088327e2569 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:58.135009 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-104fe32a-faa5-4b9c-b277-e90628c2d21a tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:58.143318 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-104fe32a-faa5-4b9c-b277-e90628c2d21a tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/af48d367-7828-47f9-a178-5d07cbaa26aa" status: 200 len: 1318 microversion: 2.1 time: 0.584826 Aug 31 16:12:58.144189 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2103/4401] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:57 2022] GET /compute/v2.1/servers/af48d367-7828-47f9-a178-5d07cbaa26aa => generated 1318 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:58.219536 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4cfafff4-309e-420c-9837-1088327e2569 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:58.237162 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4cfafff4-309e-420c-9837-1088327e2569 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a" status: 200 len: 1521 microversion: 2.1 time: 0.482841 Aug 31 16:12:58.237762 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2299/4402] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:57 2022] GET /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a => generated 1521 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:58.248369 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6e0e168c-f6ff-4a12-b0fd-f4f7da3dfc38 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:58.249143 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6e0e168c-f6ff-4a12-b0fd-f4f7da3dfc38 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] [instance: 7a118055-6c34-44a8-a30e-f5ff8bb66fba] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:58.255694 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6e0e168c-f6ff-4a12-b0fd-f4f7da3dfc38 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:58.256274 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6e0e168c-f6ff-4a12-b0fd-f4f7da3dfc38 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:58.256772 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6e0e168c-f6ff-4a12-b0fd-f4f7da3dfc38 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:58.257537 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6e0e168c-f6ff-4a12-b0fd-f4f7da3dfc38 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:58.258211 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6e0e168c-f6ff-4a12-b0fd-f4f7da3dfc38 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:58.258682 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6e0e168c-f6ff-4a12-b0fd-f4f7da3dfc38 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:58.389976 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6e0e168c-f6ff-4a12-b0fd-f4f7da3dfc38 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecd9e924c54474690f780576adc3a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b4f8a1c71745c6b860b5723acf164b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:58.399633 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6e0e168c-f6ff-4a12-b0fd-f4f7da3dfc38 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ecd9e924c54474690f780576adc3a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b4f8a1c71745c6b860b5723acf164b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:58.401659 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6e0e168c-f6ff-4a12-b0fd-f4f7da3dfc38 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ecd9e924c54474690f780576adc3a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b4f8a1c71745c6b860b5723acf164b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:58.403067 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6e0e168c-f6ff-4a12-b0fd-f4f7da3dfc38 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] 10.222.0.50 "GET /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba" status: 200 len: 1320 microversion: 2.26 time: 0.158859 Aug 31 16:12:58.404160 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2104/4403] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:12:58 2022] GET /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba => generated 1320 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:12:58.764269 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c0d74f7e-0b74-41ba-bf79-1c8b967c6461 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:58.765469 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c0d74f7e-0b74-41ba-bf79-1c8b967c6461 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ddb49409-d019-4682-b5c4-2d9b09cf7f9d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:58.778962 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c0d74f7e-0b74-41ba-bf79-1c8b967c6461 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:58.780886 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c0d74f7e-0b74-41ba-bf79-1c8b967c6461 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:58.782260 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c0d74f7e-0b74-41ba-bf79-1c8b967c6461 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:58.788015 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c0d74f7e-0b74-41ba-bf79-1c8b967c6461 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:58.789139 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c0d74f7e-0b74-41ba-bf79-1c8b967c6461 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:58.789796 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c0d74f7e-0b74-41ba-bf79-1c8b967c6461 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:59.164818 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4905c1cc-d42f-486a-bb7e-b967eabe4770 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:59.165457 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4905c1cc-d42f-486a-bb7e-b967eabe4770 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: af48d367-7828-47f9-a178-5d07cbaa26aa] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:59.185878 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4905c1cc-d42f-486a-bb7e-b967eabe4770 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:59.186435 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4905c1cc-d42f-486a-bb7e-b967eabe4770 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:59.186914 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4905c1cc-d42f-486a-bb7e-b967eabe4770 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:59.187637 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4905c1cc-d42f-486a-bb7e-b967eabe4770 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:59.192035 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4905c1cc-d42f-486a-bb7e-b967eabe4770 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:59.192897 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4905c1cc-d42f-486a-bb7e-b967eabe4770 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:59.222241 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c0d74f7e-0b74-41ba-bf79-1c8b967c6461 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:59.239317 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c0d74f7e-0b74-41ba-bf79-1c8b967c6461 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/ddb49409-d019-4682-b5c4-2d9b09cf7f9d" status: 200 len: 1454 microversion: 2.1 time: 0.481411 Aug 31 16:12:59.240237 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2300/4404] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:58 2022] GET /compute/v2.1/servers/ddb49409-d019-4682-b5c4-2d9b09cf7f9d => generated 1454 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:59.269501 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-db4ba497-ead3-421d-84fd-7f006a42b4f0 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:59.270448 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-db4ba497-ead3-421d-84fd-7f006a42b4f0 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 14167776-553f-4203-887b-3cb8e4cc0a2a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:59.290316 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db4ba497-ead3-421d-84fd-7f006a42b4f0 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:59.292087 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db4ba497-ead3-421d-84fd-7f006a42b4f0 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:59.292630 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db4ba497-ead3-421d-84fd-7f006a42b4f0 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:59.295524 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db4ba497-ead3-421d-84fd-7f006a42b4f0 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:59.296685 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db4ba497-ead3-421d-84fd-7f006a42b4f0 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:59.297452 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db4ba497-ead3-421d-84fd-7f006a42b4f0 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:59.638986 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-db4ba497-ead3-421d-84fd-7f006a42b4f0 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:59.643059 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4905c1cc-d42f-486a-bb7e-b967eabe4770 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:59.649259 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-db4ba497-ead3-421d-84fd-7f006a42b4f0 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a" status: 200 len: 1521 microversion: 2.1 time: 0.391703 Aug 31 16:12:59.650152 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2301/4405] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:59 2022] GET /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a => generated 1521 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:59.656396 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-2deb01bb-d23d-4306-9a15-5d7ffe5b1b24 req-f4fea654-12e8-44bc-9f78-3c800c9cfe4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddb49409-d019-4682-b5c4-2d9b09cf7f9d", "name": "network-vif-deleted", "tag": "7e4f8fe9-01f9-45ad-b58e-4eda10a64363"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:59.664804 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4905c1cc-d42f-486a-bb7e-b967eabe4770 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/af48d367-7828-47f9-a178-5d07cbaa26aa" status: 200 len: 1318 microversion: 2.1 time: 0.497334 Aug 31 16:12:59.665650 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2105/4406] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:12:59 2022] GET /compute/v2.1/servers/af48d367-7828-47f9-a178-5d07cbaa26aa => generated 1318 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:12:59.670066 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-2deb01bb-d23d-4306-9a15-5d7ffe5b1b24 req-f4fea654-12e8-44bc-9f78-3c800c9cfe4e service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:59.670876 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-2deb01bb-d23d-4306-9a15-5d7ffe5b1b24 req-f4fea654-12e8-44bc-9f78-3c800c9cfe4e service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:59.671719 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-2deb01bb-d23d-4306-9a15-5d7ffe5b1b24 req-f4fea654-12e8-44bc-9f78-3c800c9cfe4e service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:59.685379 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-97935061-34e8-43e8-8d6e-bd62cf9f7ad9 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:12:59.688651 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-97935061-34e8-43e8-8d6e-bd62cf9f7ad9 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] [instance: 7a118055-6c34-44a8-a30e-f5ff8bb66fba] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:12:59.693496 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-2deb01bb-d23d-4306-9a15-5d7ffe5b1b24 req-f4fea654-12e8-44bc-9f78-3c800c9cfe4e service nova] Creating event network-vif-deleted:7e4f8fe9-01f9-45ad-b58e-4eda10a64363 for instance ddb49409-d019-4682-b5c4-2d9b09cf7f9d on n-h1-833090-16 Aug 31 16:12:59.696560 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97935061-34e8-43e8-8d6e-bd62cf9f7ad9 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:59.697433 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97935061-34e8-43e8-8d6e-bd62cf9f7ad9 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:59.698374 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97935061-34e8-43e8-8d6e-bd62cf9f7ad9 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:59.701023 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97935061-34e8-43e8-8d6e-bd62cf9f7ad9 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:59.701904 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97935061-34e8-43e8-8d6e-bd62cf9f7ad9 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:59.702811 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97935061-34e8-43e8-8d6e-bd62cf9f7ad9 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:59.718257 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-2deb01bb-d23d-4306-9a15-5d7ffe5b1b24 req-f4fea654-12e8-44bc-9f78-3c800c9cfe4e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066556 Aug 31 16:12:59.723574 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2302/4407] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:12:59.829798 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-97935061-34e8-43e8-8d6e-bd62cf9f7ad9 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecd9e924c54474690f780576adc3a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b4f8a1c71745c6b860b5723acf164b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:59.842581 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-97935061-34e8-43e8-8d6e-bd62cf9f7ad9 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ecd9e924c54474690f780576adc3a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b4f8a1c71745c6b860b5723acf164b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:59.844460 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-97935061-34e8-43e8-8d6e-bd62cf9f7ad9 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ecd9e924c54474690f780576adc3a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b4f8a1c71745c6b860b5723acf164b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:12:59.845893 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-97935061-34e8-43e8-8d6e-bd62cf9f7ad9 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] 10.222.0.50 "GET /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba" status: 200 len: 1320 microversion: 2.26 time: 0.174795 Aug 31 16:12:59.850666 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2106/4408] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:12:59 2022] GET /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba => generated 1320 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:12:59.903363 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-e428db5a-9797-4c73-a6d0-6f0fd162c895 req-2c7b3c6b-e940-45db-a5f7-aae9e8ed48e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af48d367-7828-47f9-a178-5d07cbaa26aa", "tag": "3ff745c5-d339-4662-81f3-e0daa3e66a8f"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:12:59.911286 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:12:59.915973 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-e428db5a-9797-4c73-a6d0-6f0fd162c895 req-2c7b3c6b-e940-45db-a5f7-aae9e8ed48e7 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:12:59.916807 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-e428db5a-9797-4c73-a6d0-6f0fd162c895 req-2c7b3c6b-e940-45db-a5f7-aae9e8ed48e7 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:12:59.918495 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-e428db5a-9797-4c73-a6d0-6f0fd162c895 req-2c7b3c6b-e940-45db-a5f7-aae9e8ed48e7 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:12:59.935461 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-e428db5a-9797-4c73-a6d0-6f0fd162c895 req-2c7b3c6b-e940-45db-a5f7-aae9e8ed48e7 service nova] Creating event network-changed:3ff745c5-d339-4662-81f3-e0daa3e66a8f for instance af48d367-7828-47f9-a178-5d07cbaa26aa on n-h2-833090-16 Aug 31 16:12:59.941975 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-e428db5a-9797-4c73-a6d0-6f0fd162c895 req-2c7b3c6b-e940-45db-a5f7-aae9e8ed48e7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043305 Aug 31 16:12:59.943007 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2303/4409] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:00.265304 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-544e35dc-bc77-4a4f-93b8-aa82e59c6794 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:00.266833 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-544e35dc-bc77-4a4f-93b8-aa82e59c6794 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ddb49409-d019-4682-b5c4-2d9b09cf7f9d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:00.275901 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-544e35dc-bc77-4a4f-93b8-aa82e59c6794 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:00.277981 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-544e35dc-bc77-4a4f-93b8-aa82e59c6794 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:00.278845 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-544e35dc-bc77-4a4f-93b8-aa82e59c6794 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:00.280403 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-544e35dc-bc77-4a4f-93b8-aa82e59c6794 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:00.281157 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-544e35dc-bc77-4a4f-93b8-aa82e59c6794 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:00.281846 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-544e35dc-bc77-4a4f-93b8-aa82e59c6794 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:00.304643 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-544e35dc-bc77-4a4f-93b8-aa82e59c6794 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] HTTP exception thrown: Instance ddb49409-d019-4682-b5c4-2d9b09cf7f9d could not be found. Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-544e35dc-bc77-4a4f-93b8-aa82e59c6794 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Request method failure captured: Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/ddb49409-d019-4682-b5c4-2d9b09cf7f9d HTTP/1.1 Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4fcRMLera6TLJp6OFOd_B19-rdZe1qr5LTGcbsBroFhPQ8_L89JW9hpsNJPnNpQCXW4WKWxdTwWZTYVgRah_OPLrb5JBnrA64ZgN8VfXgRvkXORTfvSkZvZgjCL7371tDtPpfcPNp0NcyRfiYHxIldtsDdYZVFbQTa8WMsjzib7kZ0 Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 84f42648e1a343b9a5ab9b89c91bea0d Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersTestJSON-1527984429 Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_84f42648e1a343b9a5ab9b89c91bea0d", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServersTestJSON-1527984429 Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 84f42648e1a343b9a5ab9b89c91bea0d Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersTestJSON-1527984429 Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServersTestJSON-1527984429-project Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 3ebce87993504550914c2c3702eebb17 Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServersTestJSON-1527984429-project Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance ddb49409-d019-4682-b5c4-2d9b09cf7f9d could not be found. Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'ddb49409-d019-4682-b5c4-2d9b09cf7f9d'} Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddb49409-d019-4682-b5c4-2d9b09cf7f9d could not be found. Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddb49409-d019-4682-b5c4-2d9b09cf7f9d could not be found. Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:00.306619 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:00.312363 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:00.312363 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:00.312363 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:00.312363 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:13:00.312363 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:13:00.312363 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddb49409-d019-4682-b5c4-2d9b09cf7f9d could not be found. Aug 31 16:13:00.312363 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:00.312363 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-544e35dc-bc77-4a4f-93b8-aa82e59c6794 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Returning 404 to user: Instance ddb49409-d019-4682-b5c4-2d9b09cf7f9d could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:13:00.312363 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-544e35dc-bc77-4a4f-93b8-aa82e59c6794 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/ddb49409-d019-4682-b5c4-2d9b09cf7f9d" status: 404 len: 111 microversion: 2.1 time: 0.052828 Aug 31 16:13:00.313291 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2107/4410] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:00 2022] GET /compute/v2.1/servers/ddb49409-d019-4682-b5c4-2d9b09cf7f9d => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:13:00.323201 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b5cc6335-729a-46b1-91d8-fe534420908d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:00.325153 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b5cc6335-729a-46b1-91d8-fe534420908d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: eb6e0169-ac40-4675-b6e9-2a3ea7b13f40] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:00.338470 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b5cc6335-729a-46b1-91d8-fe534420908d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:00.339141 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b5cc6335-729a-46b1-91d8-fe534420908d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:00.340280 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b5cc6335-729a-46b1-91d8-fe534420908d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:00.341969 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b5cc6335-729a-46b1-91d8-fe534420908d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:00.342556 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b5cc6335-729a-46b1-91d8-fe534420908d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:00.343212 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b5cc6335-729a-46b1-91d8-fe534420908d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:00.391973 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b5cc6335-729a-46b1-91d8-fe534420908d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: eb6e0169-ac40-4675-b6e9-2a3ea7b13f40] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:13:00.540405 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b5cc6335-729a-46b1-91d8-fe534420908d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "DELETE /compute/v2.1/servers/eb6e0169-ac40-4675-b6e9-2a3ea7b13f40" status: 204 len: 0 microversion: 2.1 time: 0.219972 Aug 31 16:13:00.542241 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2304/4411] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:13:00 2022] DELETE /compute/v2.1/servers/eb6e0169-ac40-4675-b6e9-2a3ea7b13f40 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:13:00.553512 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a2e9e247-a746-4d89-abb6-9006cb9e46cd tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:00.554606 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a2e9e247-a746-4d89-abb6-9006cb9e46cd tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: eb6e0169-ac40-4675-b6e9-2a3ea7b13f40] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:00.565714 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a2e9e247-a746-4d89-abb6-9006cb9e46cd tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:00.566580 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a2e9e247-a746-4d89-abb6-9006cb9e46cd tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:00.567354 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a2e9e247-a746-4d89-abb6-9006cb9e46cd tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:00.568268 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a2e9e247-a746-4d89-abb6-9006cb9e46cd tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:00.568731 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a2e9e247-a746-4d89-abb6-9006cb9e46cd tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:00.569162 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a2e9e247-a746-4d89-abb6-9006cb9e46cd tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:00.680545 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c10986ed-dbce-450d-8fa2-03f634867c14 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:00.681944 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c10986ed-dbce-450d-8fa2-03f634867c14 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 14167776-553f-4203-887b-3cb8e4cc0a2a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:00.701596 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c10986ed-dbce-450d-8fa2-03f634867c14 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:00.703369 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c10986ed-dbce-450d-8fa2-03f634867c14 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:00.706237 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c10986ed-dbce-450d-8fa2-03f634867c14 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:00.707943 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c10986ed-dbce-450d-8fa2-03f634867c14 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:00.708625 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c10986ed-dbce-450d-8fa2-03f634867c14 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:00.710679 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c10986ed-dbce-450d-8fa2-03f634867c14 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:00.898219 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a2e9e247-a746-4d89-abb6-9006cb9e46cd tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:00.909709 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a2e9e247-a746-4d89-abb6-9006cb9e46cd tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/eb6e0169-ac40-4675-b6e9-2a3ea7b13f40" status: 200 len: 1496 microversion: 2.1 time: 0.362113 Aug 31 16:13:00.912314 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2108/4412] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:00 2022] GET /compute/v2.1/servers/eb6e0169-ac40-4675-b6e9-2a3ea7b13f40 => generated 1496 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:13:00.929539 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cb15504b-c7f5-43d4-92da-988f15cc17bd tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:00.931015 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cb15504b-c7f5-43d4-92da-988f15cc17bd tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: af48d367-7828-47f9-a178-5d07cbaa26aa] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:00.938361 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb15504b-c7f5-43d4-92da-988f15cc17bd tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:00.939033 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb15504b-c7f5-43d4-92da-988f15cc17bd tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:00.939636 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb15504b-c7f5-43d4-92da-988f15cc17bd tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:00.940494 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb15504b-c7f5-43d4-92da-988f15cc17bd tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:00.940949 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb15504b-c7f5-43d4-92da-988f15cc17bd tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:00.941372 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb15504b-c7f5-43d4-92da-988f15cc17bd tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:00.979085 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c10986ed-dbce-450d-8fa2-03f634867c14 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:00.990867 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c10986ed-dbce-450d-8fa2-03f634867c14 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a" status: 200 len: 1521 microversion: 2.1 time: 0.321907 Aug 31 16:13:00.998206 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2305/4413] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:00 2022] GET /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a => generated 1521 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:01.131492 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cb15504b-c7f5-43d4-92da-988f15cc17bd tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:01.141472 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cb15504b-c7f5-43d4-92da-988f15cc17bd tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/af48d367-7828-47f9-a178-5d07cbaa26aa" status: 200 len: 1318 microversion: 2.1 time: 0.226897 Aug 31 16:13:01.142194 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2109/4414] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:00 2022] GET /compute/v2.1/servers/af48d367-7828-47f9-a178-5d07cbaa26aa => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:01.149959 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2d43e0e6-1956-4086-8ead-383e99145cec tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:01.150603 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2d43e0e6-1956-4086-8ead-383e99145cec tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] [instance: 7a118055-6c34-44a8-a30e-f5ff8bb66fba] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:01.162239 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d43e0e6-1956-4086-8ead-383e99145cec tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:01.162855 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d43e0e6-1956-4086-8ead-383e99145cec tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:01.163889 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d43e0e6-1956-4086-8ead-383e99145cec tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:01.164735 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d43e0e6-1956-4086-8ead-383e99145cec tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:01.165307 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d43e0e6-1956-4086-8ead-383e99145cec tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:01.165729 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d43e0e6-1956-4086-8ead-383e99145cec tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:01.202494 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-258c2e6d-a5d9-4156-b515-1f5839d15451 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1192629939", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:01.269828 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-258c2e6d-a5d9-4156-b515-1f5839d15451 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] validate_networks() for None {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:13:01.361898 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2d43e0e6-1956-4086-8ead-383e99145cec tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecd9e924c54474690f780576adc3a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b4f8a1c71745c6b860b5723acf164b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:01.370456 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2d43e0e6-1956-4086-8ead-383e99145cec tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ecd9e924c54474690f780576adc3a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b4f8a1c71745c6b860b5723acf164b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:01.372071 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2d43e0e6-1956-4086-8ead-383e99145cec tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ecd9e924c54474690f780576adc3a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b4f8a1c71745c6b860b5723acf164b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:01.373565 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2d43e0e6-1956-4086-8ead-383e99145cec tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] 10.222.0.50 "GET /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba" status: 200 len: 1362 microversion: 2.26 time: 0.230227 Aug 31 16:13:01.374334 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2110/4415] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:13:01 2022] GET /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba => generated 1362 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:13:01.514436 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-258c2e6d-a5d9-4156-b515-1f5839d15451 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:13:01.514854 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-258c2e6d-a5d9-4156-b515-1f5839d15451 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:13:01.515386 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-258c2e6d-a5d9-4156-b515-1f5839d15451 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:13:01.515707 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-258c2e6d-a5d9-4156-b515-1f5839d15451 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:13:01.516134 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-258c2e6d-a5d9-4156-b515-1f5839d15451 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:13:01.525125 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-258c2e6d-a5d9-4156-b515-1f5839d15451 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:01.525620 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-258c2e6d-a5d9-4156-b515-1f5839d15451 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:01.526052 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-258c2e6d-a5d9-4156-b515-1f5839d15451 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:01.526918 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-258c2e6d-a5d9-4156-b515-1f5839d15451 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:01.527549 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-258c2e6d-a5d9-4156-b515-1f5839d15451 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:01.527968 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-258c2e6d-a5d9-4156-b515-1f5839d15451 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:01.546640 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-258c2e6d-a5d9-4156-b515-1f5839d15451 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Getting quotas for project 1c66bcd5e83f4ea89afa84ff947a36e6. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:13:01.552171 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-258c2e6d-a5d9-4156-b515-1f5839d15451 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Getting quotas for user ae7fa51caf47428fb0e89e2050b64211 and project 1c66bcd5e83f4ea89afa84ff947a36e6. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:13:01.566539 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-258c2e6d-a5d9-4156-b515-1f5839d15451 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:13:01.568875 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-258c2e6d-a5d9-4156-b515-1f5839d15451 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] [instance: 98beddf9-f152-4a63-98ac-fc3a9a1c9b63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:13:01.618653 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-258c2e6d-a5d9-4156-b515-1f5839d15451 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.625273 Aug 31 16:13:01.625467 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2306/4416] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:13:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:13:01.634608 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-53477e78-9be0-4a77-afbc-20962fd7403e tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:01.635784 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-53477e78-9be0-4a77-afbc-20962fd7403e tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] [instance: 98beddf9-f152-4a63-98ac-fc3a9a1c9b63] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:01.735720 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-53477e78-9be0-4a77-afbc-20962fd7403e tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7fa51caf47428fb0e89e2050b64211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c66bcd5e83f4ea89afa84ff947a36e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:01.752148 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-53477e78-9be0-4a77-afbc-20962fd7403e tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] 10.222.0.50 "GET /compute/v2.1/servers/98beddf9-f152-4a63-98ac-fc3a9a1c9b63" status: 200 len: 1214 microversion: 2.1 time: 0.125158 Aug 31 16:13:01.758811 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2111/4417] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:01 2022] GET /compute/v2.1/servers/98beddf9-f152-4a63-98ac-fc3a9a1c9b63 => generated 1214 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:01.938239 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f40f401d-0a03-49c8-8249-141df30d6767 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:01.939589 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f40f401d-0a03-49c8-8249-141df30d6767 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: eb6e0169-ac40-4675-b6e9-2a3ea7b13f40] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:01.950939 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f40f401d-0a03-49c8-8249-141df30d6767 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:01.951602 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f40f401d-0a03-49c8-8249-141df30d6767 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:01.952424 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f40f401d-0a03-49c8-8249-141df30d6767 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:01.956960 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f40f401d-0a03-49c8-8249-141df30d6767 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:01.957653 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f40f401d-0a03-49c8-8249-141df30d6767 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:01.958732 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f40f401d-0a03-49c8-8249-141df30d6767 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:01.964652 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-25e75679-e496-4f8a-8340-54507d96934d req-57c38d9d-a1f9-4683-b5c0-8ec0b83f37cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a118055-6c34-44a8-a30e-f5ff8bb66fba", "tag": "92575430-e651-4c65-8cb7-1a46cc1ff965"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:01.996234 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-25e75679-e496-4f8a-8340-54507d96934d req-57c38d9d-a1f9-4683-b5c0-8ec0b83f37cf service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:01.996706 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-25e75679-e496-4f8a-8340-54507d96934d req-57c38d9d-a1f9-4683-b5c0-8ec0b83f37cf service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:01.997133 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-25e75679-e496-4f8a-8340-54507d96934d req-57c38d9d-a1f9-4683-b5c0-8ec0b83f37cf service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:02.014049 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-25e75679-e496-4f8a-8340-54507d96934d req-57c38d9d-a1f9-4683-b5c0-8ec0b83f37cf service nova] Creating event network-changed:92575430-e651-4c65-8cb7-1a46cc1ff965 for instance 7a118055-6c34-44a8-a30e-f5ff8bb66fba on n-h1-833090-16 Aug 31 16:13:02.029241 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-25e75679-e496-4f8a-8340-54507d96934d req-57c38d9d-a1f9-4683-b5c0-8ec0b83f37cf service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068252 Aug 31 16:13:02.029863 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2112/4418] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:02.044675 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-82df2326-7145-49a8-a922-db23c2eee3c6 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:02.045678 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-82df2326-7145-49a8-a922-db23c2eee3c6 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 14167776-553f-4203-887b-3cb8e4cc0a2a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:02.056890 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-82df2326-7145-49a8-a922-db23c2eee3c6 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:02.059111 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-82df2326-7145-49a8-a922-db23c2eee3c6 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:02.059885 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-82df2326-7145-49a8-a922-db23c2eee3c6 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:02.060899 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-82df2326-7145-49a8-a922-db23c2eee3c6 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:02.061578 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-82df2326-7145-49a8-a922-db23c2eee3c6 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:02.062360 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-82df2326-7145-49a8-a922-db23c2eee3c6 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:02.368839 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f40f401d-0a03-49c8-8249-141df30d6767 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:02.377094 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f40f401d-0a03-49c8-8249-141df30d6767 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/eb6e0169-ac40-4675-b6e9-2a3ea7b13f40" status: 200 len: 1496 microversion: 2.1 time: 0.445795 Aug 31 16:13:02.377684 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2307/4419] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:01 2022] GET /compute/v2.1/servers/eb6e0169-ac40-4675-b6e9-2a3ea7b13f40 => generated 1496 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:02.397477 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1e353e17-33e9-437f-ba6f-52310fffd3ea tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:02.398250 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1e353e17-33e9-437f-ba6f-52310fffd3ea tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: af48d367-7828-47f9-a178-5d07cbaa26aa] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:02.405651 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e353e17-33e9-437f-ba6f-52310fffd3ea tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:02.406163 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e353e17-33e9-437f-ba6f-52310fffd3ea tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:02.406605 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e353e17-33e9-437f-ba6f-52310fffd3ea tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:02.407305 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e353e17-33e9-437f-ba6f-52310fffd3ea tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:02.407762 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e353e17-33e9-437f-ba6f-52310fffd3ea tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:02.408197 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e353e17-33e9-437f-ba6f-52310fffd3ea tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:02.515060 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-82df2326-7145-49a8-a922-db23c2eee3c6 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:02.523819 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-82df2326-7145-49a8-a922-db23c2eee3c6 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a" status: 200 len: 1521 microversion: 2.1 time: 0.492561 Aug 31 16:13:02.524411 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2113/4420] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:02 2022] GET /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a => generated 1521 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:02.543924 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2395458d-6431-40c3-acef-580aedc5a83b tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:02.544856 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2395458d-6431-40c3-acef-580aedc5a83b tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] [instance: 7a118055-6c34-44a8-a30e-f5ff8bb66fba] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:02.551475 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2395458d-6431-40c3-acef-580aedc5a83b tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:02.552250 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2395458d-6431-40c3-acef-580aedc5a83b tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:02.552675 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2395458d-6431-40c3-acef-580aedc5a83b tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:02.553378 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2395458d-6431-40c3-acef-580aedc5a83b tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:02.553826 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2395458d-6431-40c3-acef-580aedc5a83b tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:02.554276 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2395458d-6431-40c3-acef-580aedc5a83b tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:02.736030 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1e353e17-33e9-437f-ba6f-52310fffd3ea tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:02.745043 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1e353e17-33e9-437f-ba6f-52310fffd3ea tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/af48d367-7828-47f9-a178-5d07cbaa26aa" status: 200 len: 1318 microversion: 2.1 time: 0.353020 Aug 31 16:13:02.746419 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2308/4421] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:02 2022] GET /compute/v2.1/servers/af48d367-7828-47f9-a178-5d07cbaa26aa => generated 1318 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:02.788152 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1dc01ba8-a71f-4587-8a49-3b0e78760c6b tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:02.789694 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1dc01ba8-a71f-4587-8a49-3b0e78760c6b tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] [instance: 98beddf9-f152-4a63-98ac-fc3a9a1c9b63] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:02.807867 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1dc01ba8-a71f-4587-8a49-3b0e78760c6b tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:02.808803 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1dc01ba8-a71f-4587-8a49-3b0e78760c6b tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:02.810356 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1dc01ba8-a71f-4587-8a49-3b0e78760c6b tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:02.811635 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1dc01ba8-a71f-4587-8a49-3b0e78760c6b tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:02.812464 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1dc01ba8-a71f-4587-8a49-3b0e78760c6b tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:02.813157 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1dc01ba8-a71f-4587-8a49-3b0e78760c6b tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:02.845668 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2395458d-6431-40c3-acef-580aedc5a83b tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecd9e924c54474690f780576adc3a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b4f8a1c71745c6b860b5723acf164b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:02.860155 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2395458d-6431-40c3-acef-580aedc5a83b tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ecd9e924c54474690f780576adc3a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b4f8a1c71745c6b860b5723acf164b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:02.861799 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2395458d-6431-40c3-acef-580aedc5a83b tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ecd9e924c54474690f780576adc3a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b4f8a1c71745c6b860b5723acf164b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:02.867308 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2395458d-6431-40c3-acef-580aedc5a83b tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] 10.222.0.50 "GET /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba" status: 200 len: 1362 microversion: 2.26 time: 0.327294 Aug 31 16:13:02.868847 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2114/4422] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:13:02 2022] GET /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba => generated 1362 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:13:02.929521 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1dc01ba8-a71f-4587-8a49-3b0e78760c6b tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7fa51caf47428fb0e89e2050b64211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c66bcd5e83f4ea89afa84ff947a36e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:02.939220 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1dc01ba8-a71f-4587-8a49-3b0e78760c6b tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] 10.222.0.50 "GET /compute/v2.1/servers/98beddf9-f152-4a63-98ac-fc3a9a1c9b63" status: 200 len: 1266 microversion: 2.1 time: 0.162265 Aug 31 16:13:02.940458 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2309/4423] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:02 2022] GET /compute/v2.1/servers/98beddf9-f152-4a63-98ac-fc3a9a1c9b63 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:03.064034 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-8cfe1d5a-7c32-4694-8510-2cbb7cf15708 req-28a91760-4053-4b0b-81fb-5873cb591607 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb6e0169-ac40-4675-b6e9-2a3ea7b13f40", "name": "network-vif-deleted", "tag": "54ca58a1-2958-4476-a9f8-df32a84cc26a"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:03.082270 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8cfe1d5a-7c32-4694-8510-2cbb7cf15708 req-28a91760-4053-4b0b-81fb-5873cb591607 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:03.083326 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8cfe1d5a-7c32-4694-8510-2cbb7cf15708 req-28a91760-4053-4b0b-81fb-5873cb591607 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:03.084015 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8cfe1d5a-7c32-4694-8510-2cbb7cf15708 req-28a91760-4053-4b0b-81fb-5873cb591607 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:03.101436 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-8cfe1d5a-7c32-4694-8510-2cbb7cf15708 req-28a91760-4053-4b0b-81fb-5873cb591607 service nova] Creating event network-vif-deleted:54ca58a1-2958-4476-a9f8-df32a84cc26a for instance eb6e0169-ac40-4675-b6e9-2a3ea7b13f40 on n-h1-833090-16 Aug 31 16:13:03.109199 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-8cfe1d5a-7c32-4694-8510-2cbb7cf15708 req-28a91760-4053-4b0b-81fb-5873cb591607 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047759 Aug 31 16:13:03.110582 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2115/4424] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:03.402249 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-41c9429c-c9c0-4eb8-852c-9f9be1a77da5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:03.403622 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-41c9429c-c9c0-4eb8-852c-9f9be1a77da5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: eb6e0169-ac40-4675-b6e9-2a3ea7b13f40] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:03.412860 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-41c9429c-c9c0-4eb8-852c-9f9be1a77da5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:03.413739 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-41c9429c-c9c0-4eb8-852c-9f9be1a77da5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:03.414363 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-41c9429c-c9c0-4eb8-852c-9f9be1a77da5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:03.415260 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-41c9429c-c9c0-4eb8-852c-9f9be1a77da5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:03.415907 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-41c9429c-c9c0-4eb8-852c-9f9be1a77da5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:03.416600 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-41c9429c-c9c0-4eb8-852c-9f9be1a77da5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:03.481499 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-41c9429c-c9c0-4eb8-852c-9f9be1a77da5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:03.482060 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-41c9429c-c9c0-4eb8-852c-9f9be1a77da5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:03.482535 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-41c9429c-c9c0-4eb8-852c-9f9be1a77da5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:03.482994 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-41c9429c-c9c0-4eb8-852c-9f9be1a77da5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lazy-loading 'fault' on Instance uuid eb6e0169-ac40-4675-b6e9-2a3ea7b13f40 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:13:03.546086 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-73afeaf7-b630-42bf-89c4-18d1fc78e863 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:03.547232 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-73afeaf7-b630-42bf-89c4-18d1fc78e863 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 14167776-553f-4203-887b-3cb8e4cc0a2a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:03.550318 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-41c9429c-c9c0-4eb8-852c-9f9be1a77da5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:03.560871 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-73afeaf7-b630-42bf-89c4-18d1fc78e863 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:03.562395 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-73afeaf7-b630-42bf-89c4-18d1fc78e863 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:03.565329 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-73afeaf7-b630-42bf-89c4-18d1fc78e863 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:03.570706 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-73afeaf7-b630-42bf-89c4-18d1fc78e863 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:03.571563 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-73afeaf7-b630-42bf-89c4-18d1fc78e863 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:03.572255 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-73afeaf7-b630-42bf-89c4-18d1fc78e863 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:03.576181 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-41c9429c-c9c0-4eb8-852c-9f9be1a77da5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/eb6e0169-ac40-4675-b6e9-2a3ea7b13f40" status: 200 len: 1299 microversion: 2.1 time: 0.178403 Aug 31 16:13:03.604605 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2310/4425] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:03 2022] GET /compute/v2.1/servers/eb6e0169-ac40-4675-b6e9-2a3ea7b13f40 => generated 1299 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:03.771208 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-06fe5e22-8ca4-42ae-afd9-39e3185c288f tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:03.772750 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-06fe5e22-8ca4-42ae-afd9-39e3185c288f tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: af48d367-7828-47f9-a178-5d07cbaa26aa] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:03.784168 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06fe5e22-8ca4-42ae-afd9-39e3185c288f tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:03.784786 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06fe5e22-8ca4-42ae-afd9-39e3185c288f tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:03.785286 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06fe5e22-8ca4-42ae-afd9-39e3185c288f tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:03.787677 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06fe5e22-8ca4-42ae-afd9-39e3185c288f tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:03.788210 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06fe5e22-8ca4-42ae-afd9-39e3185c288f tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:03.788732 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06fe5e22-8ca4-42ae-afd9-39e3185c288f tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:03.847435 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-73afeaf7-b630-42bf-89c4-18d1fc78e863 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:03.858143 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-73afeaf7-b630-42bf-89c4-18d1fc78e863 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a" status: 200 len: 1521 microversion: 2.1 time: 0.317038 Aug 31 16:13:03.860066 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2116/4426] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:03 2022] GET /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a => generated 1521 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:13:03.891511 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-de416214-3a67-4782-8ac3-c2656ab0ec8f tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:03.892271 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-de416214-3a67-4782-8ac3-c2656ab0ec8f tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] [instance: 7a118055-6c34-44a8-a30e-f5ff8bb66fba] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:03.900124 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-de416214-3a67-4782-8ac3-c2656ab0ec8f tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:03.900545 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-de416214-3a67-4782-8ac3-c2656ab0ec8f tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:03.901086 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-de416214-3a67-4782-8ac3-c2656ab0ec8f tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:03.902164 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-de416214-3a67-4782-8ac3-c2656ab0ec8f tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:03.906814 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-de416214-3a67-4782-8ac3-c2656ab0ec8f tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:03.907467 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-de416214-3a67-4782-8ac3-c2656ab0ec8f tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:04.159380 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-06fe5e22-8ca4-42ae-afd9-39e3185c288f tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:04.172584 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-06fe5e22-8ca4-42ae-afd9-39e3185c288f tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/af48d367-7828-47f9-a178-5d07cbaa26aa" status: 200 len: 1318 microversion: 2.1 time: 0.410292 Aug 31 16:13:04.173652 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2311/4427] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:03 2022] GET /compute/v2.1/servers/af48d367-7828-47f9-a178-5d07cbaa26aa => generated 1318 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:13:04.181724 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-082f1e1a-4d4b-4b8a-b9a8-ebc6178c48db tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:04.188547 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-082f1e1a-4d4b-4b8a-b9a8-ebc6178c48db tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] [instance: 98beddf9-f152-4a63-98ac-fc3a9a1c9b63] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:04.196656 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-082f1e1a-4d4b-4b8a-b9a8-ebc6178c48db tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:04.200901 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-082f1e1a-4d4b-4b8a-b9a8-ebc6178c48db tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:04.201475 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-082f1e1a-4d4b-4b8a-b9a8-ebc6178c48db tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:04.202359 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-082f1e1a-4d4b-4b8a-b9a8-ebc6178c48db tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:04.202960 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-082f1e1a-4d4b-4b8a-b9a8-ebc6178c48db tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:04.203500 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-082f1e1a-4d4b-4b8a-b9a8-ebc6178c48db tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:04.264431 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-de416214-3a67-4782-8ac3-c2656ab0ec8f tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecd9e924c54474690f780576adc3a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b4f8a1c71745c6b860b5723acf164b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:04.273526 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-de416214-3a67-4782-8ac3-c2656ab0ec8f tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ecd9e924c54474690f780576adc3a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b4f8a1c71745c6b860b5723acf164b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:04.278027 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-de416214-3a67-4782-8ac3-c2656ab0ec8f tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ecd9e924c54474690f780576adc3a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b4f8a1c71745c6b860b5723acf164b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:04.281968 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-de416214-3a67-4782-8ac3-c2656ab0ec8f tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] 10.222.0.50 "GET /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba" status: 200 len: 1362 microversion: 2.26 time: 0.394838 Aug 31 16:13:04.288825 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2117/4428] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:13:03 2022] GET /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba => generated 1362 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:13:04.294023 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ecb286b8-b471-419a-b9d3-39e89c754377 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:04.298433 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ecb286b8-b471-419a-b9d3-39e89c754377 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: f6e41791-366b-4790-8338-2a52f4ebed89] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:04.315479 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ecb286b8-b471-419a-b9d3-39e89c754377 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:04.316338 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ecb286b8-b471-419a-b9d3-39e89c754377 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:04.316985 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ecb286b8-b471-419a-b9d3-39e89c754377 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:04.317895 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ecb286b8-b471-419a-b9d3-39e89c754377 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:04.318593 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ecb286b8-b471-419a-b9d3-39e89c754377 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:04.319207 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ecb286b8-b471-419a-b9d3-39e89c754377 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:04.372154 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-082f1e1a-4d4b-4b8a-b9a8-ebc6178c48db tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7fa51caf47428fb0e89e2050b64211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c66bcd5e83f4ea89afa84ff947a36e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:04.381764 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-082f1e1a-4d4b-4b8a-b9a8-ebc6178c48db tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] 10.222.0.50 "GET /compute/v2.1/servers/98beddf9-f152-4a63-98ac-fc3a9a1c9b63" status: 200 len: 1284 microversion: 2.1 time: 0.206914 Aug 31 16:13:04.382404 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2312/4429] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:04 2022] GET /compute/v2.1/servers/98beddf9-f152-4a63-98ac-fc3a9a1c9b63 => generated 1284 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:04.421712 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ecb286b8-b471-419a-b9d3-39e89c754377 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "POST /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89/action" status: 200 len: 24579 microversion: 2.1 time: 0.131270 Aug 31 16:13:04.423918 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2118/4430] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:13:04 2022] POST /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89/action => generated 24579 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:13:04.608701 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-daf5b416-be20-4d5a-b8a0-60563aa99069 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:04.609939 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-daf5b416-be20-4d5a-b8a0-60563aa99069 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: eb6e0169-ac40-4675-b6e9-2a3ea7b13f40] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:04.619541 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-daf5b416-be20-4d5a-b8a0-60563aa99069 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:04.620026 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-daf5b416-be20-4d5a-b8a0-60563aa99069 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:04.621089 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-daf5b416-be20-4d5a-b8a0-60563aa99069 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:04.621870 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-daf5b416-be20-4d5a-b8a0-60563aa99069 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:04.622366 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-daf5b416-be20-4d5a-b8a0-60563aa99069 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:04.622885 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-daf5b416-be20-4d5a-b8a0-60563aa99069 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:04.639089 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-daf5b416-be20-4d5a-b8a0-60563aa99069 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] HTTP exception thrown: Instance eb6e0169-ac40-4675-b6e9-2a3ea7b13f40 could not be found. Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-daf5b416-be20-4d5a-b8a0-60563aa99069 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Request method failure captured: Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/eb6e0169-ac40-4675-b6e9-2a3ea7b13f40 HTTP/1.1 Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4fcRMLera6TLJp6OFOd_B19-rdZe1qr5LTGcbsBroFhPQ8_L89JW9hpsNJPnNpQCXW4WKWxdTwWZTYVgRah_OPLrb5JBnrA64ZgN8VfXgRvkXORTfvSkZvZgjCL7371tDtPpfcPNp0NcyRfiYHxIldtsDdYZVFbQTa8WMsjzib7kZ0 Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 84f42648e1a343b9a5ab9b89c91bea0d Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServersTestJSON-1527984429 Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_84f42648e1a343b9a5ab9b89c91bea0d", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServersTestJSON-1527984429 Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 84f42648e1a343b9a5ab9b89c91bea0d Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServersTestJSON-1527984429 Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServersTestJSON-1527984429-project Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 3ebce87993504550914c2c3702eebb17 Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServersTestJSON-1527984429-project Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance eb6e0169-ac40-4675-b6e9-2a3ea7b13f40 could not be found. Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'eb6e0169-ac40-4675-b6e9-2a3ea7b13f40'} Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb6e0169-ac40-4675-b6e9-2a3ea7b13f40 could not be found. Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb6e0169-ac40-4675-b6e9-2a3ea7b13f40 could not be found. Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:04.640928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:04.647305 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:04.647305 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:04.647305 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:04.647305 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:13:04.647305 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:13:04.647305 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb6e0169-ac40-4675-b6e9-2a3ea7b13f40 could not be found. Aug 31 16:13:04.647305 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:04.647305 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-daf5b416-be20-4d5a-b8a0-60563aa99069 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Returning 404 to user: Instance eb6e0169-ac40-4675-b6e9-2a3ea7b13f40 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:13:04.647305 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-daf5b416-be20-4d5a-b8a0-60563aa99069 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/eb6e0169-ac40-4675-b6e9-2a3ea7b13f40" status: 404 len: 111 microversion: 2.1 time: 0.038529 Aug 31 16:13:04.647305 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2313/4431] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:04 2022] GET /compute/v2.1/servers/eb6e0169-ac40-4675-b6e9-2a3ea7b13f40 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:13:04.781785 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-48f27f7e-9ac6-410d-9158-710837a79f4d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-836212187", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "00194b7c-6891-4cf9-8c59-235de2b40a38"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:04.845687 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-48f27f7e-9ac6-410d-9158-710837a79f4d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] validate_networks() for [('00194b7c-6891-4cf9-8c59-235de2b40a38', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:13:04.879719 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f6bdf75b-f3ce-4d91-a762-b88404402a11 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:04.880697 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f6bdf75b-f3ce-4d91-a762-b88404402a11 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 14167776-553f-4203-887b-3cb8e4cc0a2a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:04.890637 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f6bdf75b-f3ce-4d91-a762-b88404402a11 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:04.895102 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f6bdf75b-f3ce-4d91-a762-b88404402a11 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:04.895780 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f6bdf75b-f3ce-4d91-a762-b88404402a11 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:04.897907 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f6bdf75b-f3ce-4d91-a762-b88404402a11 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:04.904364 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f6bdf75b-f3ce-4d91-a762-b88404402a11 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:04.910268 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f6bdf75b-f3ce-4d91-a762-b88404402a11 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:05.237077 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f6bdf75b-f3ce-4d91-a762-b88404402a11 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:05.245690 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f6bdf75b-f3ce-4d91-a762-b88404402a11 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a" status: 200 len: 1521 microversion: 2.1 time: 0.369698 Aug 31 16:13:05.259996 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2314/4432] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:04 2022] GET /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a => generated 1521 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:13:05.266168 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-df340b61-0dc7-4348-a270-a929665f1599 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:05.267035 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-df340b61-0dc7-4348-a270-a929665f1599 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: af48d367-7828-47f9-a178-5d07cbaa26aa] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:05.273874 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-df340b61-0dc7-4348-a270-a929665f1599 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:05.274684 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-df340b61-0dc7-4348-a270-a929665f1599 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:05.275273 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-df340b61-0dc7-4348-a270-a929665f1599 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:05.276197 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-df340b61-0dc7-4348-a270-a929665f1599 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:05.276965 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-df340b61-0dc7-4348-a270-a929665f1599 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:05.278377 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-df340b61-0dc7-4348-a270-a929665f1599 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:05.301365 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:13:05.424125 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-48f27f7e-9ac6-410d-9158-710837a79f4d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:13:05.424572 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-48f27f7e-9ac6-410d-9158-710837a79f4d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:13:05.425066 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-48f27f7e-9ac6-410d-9158-710837a79f4d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:13:05.425477 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-48f27f7e-9ac6-410d-9158-710837a79f4d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:13:05.425877 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-48f27f7e-9ac6-410d-9158-710837a79f4d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:13:05.433763 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:13:05.445691 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-48f27f7e-9ac6-410d-9158-710837a79f4d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:05.446193 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-48f27f7e-9ac6-410d-9158-710837a79f4d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:05.446630 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-48f27f7e-9ac6-410d-9158-710837a79f4d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:05.447365 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-48f27f7e-9ac6-410d-9158-710837a79f4d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:05.455384 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-48f27f7e-9ac6-410d-9158-710837a79f4d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:05.458730 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-48f27f7e-9ac6-410d-9158-710837a79f4d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:05.585196 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-48f27f7e-9ac6-410d-9158-710837a79f4d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Getting quotas for project 84f42648e1a343b9a5ab9b89c91bea0d. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:13:05.601025 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-48f27f7e-9ac6-410d-9158-710837a79f4d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Getting quotas for user 3ebce87993504550914c2c3702eebb17 and project 84f42648e1a343b9a5ab9b89c91bea0d. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:13:05.645019 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-48f27f7e-9ac6-410d-9158-710837a79f4d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:13:05.660350 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-48f27f7e-9ac6-410d-9158-710837a79f4d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 33170fbc-0d84-4284-9f70-dedb91f0d295] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:13:05.664980 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-df340b61-0dc7-4348-a270-a929665f1599 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:05.684270 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-df340b61-0dc7-4348-a270-a929665f1599 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/af48d367-7828-47f9-a178-5d07cbaa26aa" status: 200 len: 1318 microversion: 2.1 time: 0.420685 Aug 31 16:13:05.685764 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2315/4433] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:05 2022] GET /compute/v2.1/servers/af48d367-7828-47f9-a178-5d07cbaa26aa => generated 1318 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:05.698464 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f27bd113-75ce-4f0f-b079-0bd6f5f0a4bf tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:05.699563 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f27bd113-75ce-4f0f-b079-0bd6f5f0a4bf tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] [instance: 7a118055-6c34-44a8-a30e-f5ff8bb66fba] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:05.707121 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f27bd113-75ce-4f0f-b079-0bd6f5f0a4bf tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:05.710137 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f27bd113-75ce-4f0f-b079-0bd6f5f0a4bf tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:05.711080 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f27bd113-75ce-4f0f-b079-0bd6f5f0a4bf tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:05.716785 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f27bd113-75ce-4f0f-b079-0bd6f5f0a4bf tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:05.717358 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f27bd113-75ce-4f0f-b079-0bd6f5f0a4bf tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:05.717801 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f27bd113-75ce-4f0f-b079-0bd6f5f0a4bf tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:05.775295 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-48f27f7e-9ac6-410d-9158-710837a79f4d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.998876 Aug 31 16:13:05.777404 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2119/4434] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:13:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1002 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:13:05.784052 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a0710168-56f2-424e-b714-712af30bd8b0 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:05.784986 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a0710168-56f2-424e-b714-712af30bd8b0 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] [instance: 98beddf9-f152-4a63-98ac-fc3a9a1c9b63] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:05.797718 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a0710168-56f2-424e-b714-712af30bd8b0 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:05.798617 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a0710168-56f2-424e-b714-712af30bd8b0 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:05.799259 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a0710168-56f2-424e-b714-712af30bd8b0 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:05.801315 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a0710168-56f2-424e-b714-712af30bd8b0 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:05.805780 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a0710168-56f2-424e-b714-712af30bd8b0 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:05.807412 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a0710168-56f2-424e-b714-712af30bd8b0 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:05.888859 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f27bd113-75ce-4f0f-b079-0bd6f5f0a4bf tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecd9e924c54474690f780576adc3a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b4f8a1c71745c6b860b5723acf164b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:05.899204 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f27bd113-75ce-4f0f-b079-0bd6f5f0a4bf tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ecd9e924c54474690f780576adc3a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b4f8a1c71745c6b860b5723acf164b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:05.901740 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f27bd113-75ce-4f0f-b079-0bd6f5f0a4bf tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ecd9e924c54474690f780576adc3a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b4f8a1c71745c6b860b5723acf164b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:05.903479 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f27bd113-75ce-4f0f-b079-0bd6f5f0a4bf tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] 10.222.0.50 "GET /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba" status: 200 len: 1362 microversion: 2.26 time: 0.216521 Aug 31 16:13:05.915397 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2316/4435] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:13:05 2022] GET /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba => generated 1362 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:13:05.944356 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2bec148e-1958-4a1e-818a-9890b2e4d7b9 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:05.945222 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2bec148e-1958-4a1e-818a-9890b2e4d7b9 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 33170fbc-0d84-4284-9f70-dedb91f0d295] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:05.970477 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a0710168-56f2-424e-b714-712af30bd8b0 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7fa51caf47428fb0e89e2050b64211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c66bcd5e83f4ea89afa84ff947a36e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:05.983647 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a0710168-56f2-424e-b714-712af30bd8b0 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] 10.222.0.50 "GET /compute/v2.1/servers/98beddf9-f152-4a63-98ac-fc3a9a1c9b63" status: 200 len: 1272 microversion: 2.1 time: 0.204513 Aug 31 16:13:05.993333 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2120/4436] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:05 2022] GET /compute/v2.1/servers/98beddf9-f152-4a63-98ac-fc3a9a1c9b63 => generated 1272 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:06.076915 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2bec148e-1958-4a1e-818a-9890b2e4d7b9 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:06.091159 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2bec148e-1958-4a1e-818a-9890b2e4d7b9 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/33170fbc-0d84-4284-9f70-dedb91f0d295" status: 200 len: 1208 microversion: 2.1 time: 0.173854 Aug 31 16:13:06.091780 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2317/4437] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:05 2022] GET /compute/v2.1/servers/33170fbc-0d84-4284-9f70-dedb91f0d295 => generated 1208 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:06.271924 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-76d30624-ab5a-4e2c-bde5-8c49d1ee65ce tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:06.273708 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-76d30624-ab5a-4e2c-bde5-8c49d1ee65ce tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 14167776-553f-4203-887b-3cb8e4cc0a2a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:06.299754 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76d30624-ab5a-4e2c-bde5-8c49d1ee65ce tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:06.302461 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76d30624-ab5a-4e2c-bde5-8c49d1ee65ce tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:06.305335 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76d30624-ab5a-4e2c-bde5-8c49d1ee65ce tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:06.312718 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76d30624-ab5a-4e2c-bde5-8c49d1ee65ce tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:06.313461 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76d30624-ab5a-4e2c-bde5-8c49d1ee65ce tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:06.315201 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76d30624-ab5a-4e2c-bde5-8c49d1ee65ce tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:06.707810 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5fb9230c-6c9f-4aaa-90a8-8fac238c0de9 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:06.708437 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5fb9230c-6c9f-4aaa-90a8-8fac238c0de9 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: af48d367-7828-47f9-a178-5d07cbaa26aa] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:06.730427 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5fb9230c-6c9f-4aaa-90a8-8fac238c0de9 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:06.731214 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5fb9230c-6c9f-4aaa-90a8-8fac238c0de9 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:06.731649 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5fb9230c-6c9f-4aaa-90a8-8fac238c0de9 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:06.732369 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5fb9230c-6c9f-4aaa-90a8-8fac238c0de9 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:06.732817 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5fb9230c-6c9f-4aaa-90a8-8fac238c0de9 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:06.733550 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5fb9230c-6c9f-4aaa-90a8-8fac238c0de9 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:06.821256 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-76d30624-ab5a-4e2c-bde5-8c49d1ee65ce tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:06.831957 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-76d30624-ab5a-4e2c-bde5-8c49d1ee65ce tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a" status: 200 len: 1521 microversion: 2.1 time: 0.567936 Aug 31 16:13:06.832558 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2121/4438] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:06 2022] GET /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a => generated 1521 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:06.935683 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ad81682e-5376-44f5-8742-5f45b492a0bd tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:06.936688 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ad81682e-5376-44f5-8742-5f45b492a0bd tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] [instance: 7a118055-6c34-44a8-a30e-f5ff8bb66fba] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:06.958664 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ad81682e-5376-44f5-8742-5f45b492a0bd tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:06.959514 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ad81682e-5376-44f5-8742-5f45b492a0bd tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:06.962966 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ad81682e-5376-44f5-8742-5f45b492a0bd tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:06.964132 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ad81682e-5376-44f5-8742-5f45b492a0bd tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:06.965446 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ad81682e-5376-44f5-8742-5f45b492a0bd tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:06.967102 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ad81682e-5376-44f5-8742-5f45b492a0bd tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:07.074546 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5fb9230c-6c9f-4aaa-90a8-8fac238c0de9 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:07.089679 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5fb9230c-6c9f-4aaa-90a8-8fac238c0de9 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/af48d367-7828-47f9-a178-5d07cbaa26aa" status: 200 len: 1318 microversion: 2.1 time: 0.386357 Aug 31 16:13:07.091442 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2318/4439] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:06 2022] GET /compute/v2.1/servers/af48d367-7828-47f9-a178-5d07cbaa26aa => generated 1318 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:07.098298 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-85e3a7fd-7c34-49ba-8ad0-99b9413d81f6 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:07.099527 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-85e3a7fd-7c34-49ba-8ad0-99b9413d81f6 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] [instance: 98beddf9-f152-4a63-98ac-fc3a9a1c9b63] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:07.108801 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85e3a7fd-7c34-49ba-8ad0-99b9413d81f6 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:07.109524 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85e3a7fd-7c34-49ba-8ad0-99b9413d81f6 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:07.110312 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85e3a7fd-7c34-49ba-8ad0-99b9413d81f6 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:07.112150 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85e3a7fd-7c34-49ba-8ad0-99b9413d81f6 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:07.113015 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85e3a7fd-7c34-49ba-8ad0-99b9413d81f6 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:07.113866 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85e3a7fd-7c34-49ba-8ad0-99b9413d81f6 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:07.367365 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ad81682e-5376-44f5-8742-5f45b492a0bd tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecd9e924c54474690f780576adc3a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b4f8a1c71745c6b860b5723acf164b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:07.369879 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:13:07.387021 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ad81682e-5376-44f5-8742-5f45b492a0bd tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ecd9e924c54474690f780576adc3a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b4f8a1c71745c6b860b5723acf164b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:07.388428 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ad81682e-5376-44f5-8742-5f45b492a0bd tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ecd9e924c54474690f780576adc3a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b4f8a1c71745c6b860b5723acf164b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:07.389614 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ad81682e-5376-44f5-8742-5f45b492a0bd tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] 10.222.0.50 "GET /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba" status: 200 len: 1362 microversion: 2.26 time: 0.458467 Aug 31 16:13:07.402768 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2122/4440] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:13:06 2022] GET /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba => generated 1362 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:13:07.406422 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6413d9d9-3db4-44e0-8013-d0b9edfccaad tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:07.411665 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6413d9d9-3db4-44e0-8013-d0b9edfccaad tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 33170fbc-0d84-4284-9f70-dedb91f0d295] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:07.419294 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6413d9d9-3db4-44e0-8013-d0b9edfccaad tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:07.419705 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6413d9d9-3db4-44e0-8013-d0b9edfccaad tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:07.420143 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6413d9d9-3db4-44e0-8013-d0b9edfccaad tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:07.420905 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6413d9d9-3db4-44e0-8013-d0b9edfccaad tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:07.421341 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6413d9d9-3db4-44e0-8013-d0b9edfccaad tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:07.421764 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6413d9d9-3db4-44e0-8013-d0b9edfccaad tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:07.481371 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-85e3a7fd-7c34-49ba-8ad0-99b9413d81f6 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7fa51caf47428fb0e89e2050b64211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c66bcd5e83f4ea89afa84ff947a36e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:07.499296 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-85e3a7fd-7c34-49ba-8ad0-99b9413d81f6 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] 10.222.0.50 "GET /compute/v2.1/servers/98beddf9-f152-4a63-98ac-fc3a9a1c9b63" status: 200 len: 1314 microversion: 2.1 time: 0.406404 Aug 31 16:13:07.499902 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2319/4441] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:07 2022] GET /compute/v2.1/servers/98beddf9-f152-4a63-98ac-fc3a9a1c9b63 => generated 1314 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:07.504633 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-bfebd4c4-7cc0-4014-b22b-8d91e681aa2b req-0d00e53a-db5b-4dae-a9b0-5e8bcb412c00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98beddf9-f152-4a63-98ac-fc3a9a1c9b63", "tag": "1d0f47ad-5c5d-4ec7-9753-fd7a8837b4c5"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:07.527819 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-bfebd4c4-7cc0-4014-b22b-8d91e681aa2b req-0d00e53a-db5b-4dae-a9b0-5e8bcb412c00 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:07.528802 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-bfebd4c4-7cc0-4014-b22b-8d91e681aa2b req-0d00e53a-db5b-4dae-a9b0-5e8bcb412c00 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:07.529250 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-bfebd4c4-7cc0-4014-b22b-8d91e681aa2b req-0d00e53a-db5b-4dae-a9b0-5e8bcb412c00 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:07.551302 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-bfebd4c4-7cc0-4014-b22b-8d91e681aa2b req-0d00e53a-db5b-4dae-a9b0-5e8bcb412c00 service nova] Creating event network-changed:1d0f47ad-5c5d-4ec7-9753-fd7a8837b4c5 for instance 98beddf9-f152-4a63-98ac-fc3a9a1c9b63 on n-h1-833090-16 Aug 31 16:13:07.566575 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-bfebd4c4-7cc0-4014-b22b-8d91e681aa2b req-0d00e53a-db5b-4dae-a9b0-5e8bcb412c00 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065242 Aug 31 16:13:07.567253 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2320/4442] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:07.638585 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6413d9d9-3db4-44e0-8013-d0b9edfccaad tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:07.650843 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6413d9d9-3db4-44e0-8013-d0b9edfccaad tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/33170fbc-0d84-4284-9f70-dedb91f0d295" status: 200 len: 1260 microversion: 2.1 time: 0.248675 Aug 31 16:13:07.651863 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2123/4443] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:07 2022] GET /compute/v2.1/servers/33170fbc-0d84-4284-9f70-dedb91f0d295 => generated 1260 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:07.854016 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-bd19476b-6c5c-4f5d-88ba-b5b0dac05e46 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:07.855080 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-bd19476b-6c5c-4f5d-88ba-b5b0dac05e46 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 14167776-553f-4203-887b-3cb8e4cc0a2a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:07.872979 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bd19476b-6c5c-4f5d-88ba-b5b0dac05e46 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:07.875866 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bd19476b-6c5c-4f5d-88ba-b5b0dac05e46 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:07.876406 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bd19476b-6c5c-4f5d-88ba-b5b0dac05e46 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:07.878940 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bd19476b-6c5c-4f5d-88ba-b5b0dac05e46 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:07.879481 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bd19476b-6c5c-4f5d-88ba-b5b0dac05e46 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:07.880197 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bd19476b-6c5c-4f5d-88ba-b5b0dac05e46 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:08.116809 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-960a3514-1cd9-4c2d-8c65-e4cf68d6a14c tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:08.118705 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-960a3514-1cd9-4c2d-8c65-e4cf68d6a14c tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: af48d367-7828-47f9-a178-5d07cbaa26aa] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:08.128807 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-960a3514-1cd9-4c2d-8c65-e4cf68d6a14c tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:08.129590 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-960a3514-1cd9-4c2d-8c65-e4cf68d6a14c tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:08.130954 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-960a3514-1cd9-4c2d-8c65-e4cf68d6a14c tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:08.131862 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-960a3514-1cd9-4c2d-8c65-e4cf68d6a14c tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:08.132572 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-960a3514-1cd9-4c2d-8c65-e4cf68d6a14c tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:08.133893 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-960a3514-1cd9-4c2d-8c65-e4cf68d6a14c tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:08.287935 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-bd19476b-6c5c-4f5d-88ba-b5b0dac05e46 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:08.306796 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-bd19476b-6c5c-4f5d-88ba-b5b0dac05e46 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a" status: 200 len: 1521 microversion: 2.1 time: 0.457257 Aug 31 16:13:08.321179 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2321/4444] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:07 2022] GET /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a => generated 1521 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:08.421746 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f965406d-feb4-4eb6-9db0-f4cb6b797dc9 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:08.422528 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f965406d-feb4-4eb6-9db0-f4cb6b797dc9 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] [instance: 7a118055-6c34-44a8-a30e-f5ff8bb66fba] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:08.429430 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f965406d-feb4-4eb6-9db0-f4cb6b797dc9 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:08.430040 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f965406d-feb4-4eb6-9db0-f4cb6b797dc9 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:08.430567 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f965406d-feb4-4eb6-9db0-f4cb6b797dc9 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:08.431346 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f965406d-feb4-4eb6-9db0-f4cb6b797dc9 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:08.432052 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f965406d-feb4-4eb6-9db0-f4cb6b797dc9 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:08.432534 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f965406d-feb4-4eb6-9db0-f4cb6b797dc9 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:08.906335 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-960a3514-1cd9-4c2d-8c65-e4cf68d6a14c tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:08.923049 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-960a3514-1cd9-4c2d-8c65-e4cf68d6a14c tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/af48d367-7828-47f9-a178-5d07cbaa26aa" status: 200 len: 1318 microversion: 2.1 time: 0.811438 Aug 31 16:13:08.923853 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2124/4445] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:08 2022] GET /compute/v2.1/servers/af48d367-7828-47f9-a178-5d07cbaa26aa => generated 1318 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:08.928799 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cbb6db5a-f59d-4ec5-9a30-2ce7f2aa9381 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:08.929746 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cbb6db5a-f59d-4ec5-9a30-2ce7f2aa9381 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] [instance: 98beddf9-f152-4a63-98ac-fc3a9a1c9b63] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:08.947128 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbb6db5a-f59d-4ec5-9a30-2ce7f2aa9381 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:08.947902 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbb6db5a-f59d-4ec5-9a30-2ce7f2aa9381 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:08.948855 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbb6db5a-f59d-4ec5-9a30-2ce7f2aa9381 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:08.949794 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbb6db5a-f59d-4ec5-9a30-2ce7f2aa9381 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:08.950475 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbb6db5a-f59d-4ec5-9a30-2ce7f2aa9381 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:08.951098 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbb6db5a-f59d-4ec5-9a30-2ce7f2aa9381 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:09.368318 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f965406d-feb4-4eb6-9db0-f4cb6b797dc9 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecd9e924c54474690f780576adc3a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b4f8a1c71745c6b860b5723acf164b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:09.399998 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f965406d-feb4-4eb6-9db0-f4cb6b797dc9 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ecd9e924c54474690f780576adc3a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b4f8a1c71745c6b860b5723acf164b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:09.402614 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f965406d-feb4-4eb6-9db0-f4cb6b797dc9 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ecd9e924c54474690f780576adc3a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b4f8a1c71745c6b860b5723acf164b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:09.404024 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f965406d-feb4-4eb6-9db0-f4cb6b797dc9 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] 10.222.0.50 "GET /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba" status: 200 len: 1362 microversion: 2.26 time: 0.987298 Aug 31 16:13:09.421001 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2322/4446] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:13:08 2022] GET /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba => generated 1362 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:13:09.436594 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4d2997da-517e-44f6-9558-0492d39b2ecc tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:09.438812 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4d2997da-517e-44f6-9558-0492d39b2ecc tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 33170fbc-0d84-4284-9f70-dedb91f0d295] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:09.451596 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4d2997da-517e-44f6-9558-0492d39b2ecc tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:09.453006 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4d2997da-517e-44f6-9558-0492d39b2ecc tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:09.453698 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4d2997da-517e-44f6-9558-0492d39b2ecc tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:09.454678 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4d2997da-517e-44f6-9558-0492d39b2ecc tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:09.455356 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4d2997da-517e-44f6-9558-0492d39b2ecc tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:09.456015 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4d2997da-517e-44f6-9558-0492d39b2ecc tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:09.686082 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cbb6db5a-f59d-4ec5-9a30-2ce7f2aa9381 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7fa51caf47428fb0e89e2050b64211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c66bcd5e83f4ea89afa84ff947a36e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:09.698188 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cbb6db5a-f59d-4ec5-9a30-2ce7f2aa9381 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] 10.222.0.50 "GET /compute/v2.1/servers/98beddf9-f152-4a63-98ac-fc3a9a1c9b63" status: 200 len: 1314 microversion: 2.1 time: 0.772677 Aug 31 16:13:09.701005 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2125/4447] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:08 2022] GET /compute/v2.1/servers/98beddf9-f152-4a63-98ac-fc3a9a1c9b63 => generated 1314 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:09.705797 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-d55ffc98-18eb-48c1-a0b3-5bd0b2c2a011 req-46dd9acc-be7a-4f23-8234-31217c718254 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af48d367-7828-47f9-a178-5d07cbaa26aa", "name": "network-vif-plugged", "status": "completed", "tag": "3ff745c5-d339-4662-81f3-e0daa3e66a8f"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:09.727513 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d55ffc98-18eb-48c1-a0b3-5bd0b2c2a011 req-46dd9acc-be7a-4f23-8234-31217c718254 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:09.728268 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d55ffc98-18eb-48c1-a0b3-5bd0b2c2a011 req-46dd9acc-be7a-4f23-8234-31217c718254 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:09.728861 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d55ffc98-18eb-48c1-a0b3-5bd0b2c2a011 req-46dd9acc-be7a-4f23-8234-31217c718254 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:09.745955 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-d55ffc98-18eb-48c1-a0b3-5bd0b2c2a011 req-46dd9acc-be7a-4f23-8234-31217c718254 service nova] Creating event network-vif-plugged:3ff745c5-d339-4662-81f3-e0daa3e66a8f for instance af48d367-7828-47f9-a178-5d07cbaa26aa on n-h2-833090-16 Aug 31 16:13:09.754491 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-d55ffc98-18eb-48c1-a0b3-5bd0b2c2a011 req-46dd9acc-be7a-4f23-8234-31217c718254 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052127 Aug 31 16:13:09.755514 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2126/4448] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:09.761301 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3581f216-76c7-4211-90e5-5c48c402c24c tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:09.762287 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3581f216-76c7-4211-90e5-5c48c402c24c tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 14167776-553f-4203-887b-3cb8e4cc0a2a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:09.769359 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3581f216-76c7-4211-90e5-5c48c402c24c tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:09.770130 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3581f216-76c7-4211-90e5-5c48c402c24c tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:09.770733 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3581f216-76c7-4211-90e5-5c48c402c24c tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:09.771615 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3581f216-76c7-4211-90e5-5c48c402c24c tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:09.772230 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3581f216-76c7-4211-90e5-5c48c402c24c tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:09.772832 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3581f216-76c7-4211-90e5-5c48c402c24c tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:09.949744 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4d2997da-517e-44f6-9558-0492d39b2ecc tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:09.958022 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4d2997da-517e-44f6-9558-0492d39b2ecc tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/33170fbc-0d84-4284-9f70-dedb91f0d295" status: 200 len: 1308 microversion: 2.1 time: 0.545937 Aug 31 16:13:09.958964 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2323/4449] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:09 2022] GET /compute/v2.1/servers/33170fbc-0d84-4284-9f70-dedb91f0d295 => generated 1308 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:09.970385 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a27e223b-b644-4e2e-9278-b4e194c592b5 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:09.971477 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a27e223b-b644-4e2e-9278-b4e194c592b5 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: af48d367-7828-47f9-a178-5d07cbaa26aa] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:09.978355 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a27e223b-b644-4e2e-9278-b4e194c592b5 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:09.978925 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a27e223b-b644-4e2e-9278-b4e194c592b5 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:09.979908 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a27e223b-b644-4e2e-9278-b4e194c592b5 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:09.980727 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a27e223b-b644-4e2e-9278-b4e194c592b5 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:09.982017 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a27e223b-b644-4e2e-9278-b4e194c592b5 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:09.982564 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a27e223b-b644-4e2e-9278-b4e194c592b5 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:10.222786 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3581f216-76c7-4211-90e5-5c48c402c24c tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:10.236172 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3581f216-76c7-4211-90e5-5c48c402c24c tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a" status: 200 len: 1521 microversion: 2.1 time: 0.479093 Aug 31 16:13:10.236889 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2127/4450] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:09 2022] GET /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a => generated 1521 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:10.337881 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a27e223b-b644-4e2e-9278-b4e194c592b5 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:10.345994 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a27e223b-b644-4e2e-9278-b4e194c592b5 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/af48d367-7828-47f9-a178-5d07cbaa26aa" status: 200 len: 1318 microversion: 2.1 time: 0.385806 Aug 31 16:13:10.346591 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2324/4451] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:09 2022] GET /compute/v2.1/servers/af48d367-7828-47f9-a178-5d07cbaa26aa => generated 1318 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:10.429124 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8e1e0664-2e33-40a7-ad3a-cc81caecb57b tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:10.430987 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8e1e0664-2e33-40a7-ad3a-cc81caecb57b tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] [instance: 7a118055-6c34-44a8-a30e-f5ff8bb66fba] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:10.437788 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e1e0664-2e33-40a7-ad3a-cc81caecb57b tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:10.438317 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e1e0664-2e33-40a7-ad3a-cc81caecb57b tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:10.438725 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e1e0664-2e33-40a7-ad3a-cc81caecb57b tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:10.439613 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e1e0664-2e33-40a7-ad3a-cc81caecb57b tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:10.440242 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e1e0664-2e33-40a7-ad3a-cc81caecb57b tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:10.440875 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e1e0664-2e33-40a7-ad3a-cc81caecb57b tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:10.721412 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9d946e29-4e7c-46fd-84f0-c18d711e9238 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:10.722083 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9d946e29-4e7c-46fd-84f0-c18d711e9238 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] [instance: 98beddf9-f152-4a63-98ac-fc3a9a1c9b63] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:10.728466 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9d946e29-4e7c-46fd-84f0-c18d711e9238 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:10.728954 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9d946e29-4e7c-46fd-84f0-c18d711e9238 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:10.729404 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9d946e29-4e7c-46fd-84f0-c18d711e9238 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:10.730130 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9d946e29-4e7c-46fd-84f0-c18d711e9238 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:10.730785 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9d946e29-4e7c-46fd-84f0-c18d711e9238 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:10.731205 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9d946e29-4e7c-46fd-84f0-c18d711e9238 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:10.873218 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8e1e0664-2e33-40a7-ad3a-cc81caecb57b tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecd9e924c54474690f780576adc3a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b4f8a1c71745c6b860b5723acf164b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:10.881966 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8e1e0664-2e33-40a7-ad3a-cc81caecb57b tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ecd9e924c54474690f780576adc3a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b4f8a1c71745c6b860b5723acf164b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:10.883394 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8e1e0664-2e33-40a7-ad3a-cc81caecb57b tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ecd9e924c54474690f780576adc3a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b4f8a1c71745c6b860b5723acf164b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:10.884560 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8e1e0664-2e33-40a7-ad3a-cc81caecb57b tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] 10.222.0.50 "GET /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba" status: 200 len: 1362 microversion: 2.26 time: 0.459691 Aug 31 16:13:10.885121 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2128/4452] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:13:10 2022] GET /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba => generated 1362 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:13:10.996587 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-16db6662-6d81-4157-9fbb-6aaa9839c988 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:10.998882 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-16db6662-6d81-4157-9fbb-6aaa9839c988 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 33170fbc-0d84-4284-9f70-dedb91f0d295] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:11.021387 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16db6662-6d81-4157-9fbb-6aaa9839c988 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:11.021910 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16db6662-6d81-4157-9fbb-6aaa9839c988 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:11.024370 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16db6662-6d81-4157-9fbb-6aaa9839c988 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:11.025745 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16db6662-6d81-4157-9fbb-6aaa9839c988 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:11.027772 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16db6662-6d81-4157-9fbb-6aaa9839c988 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:11.031839 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16db6662-6d81-4157-9fbb-6aaa9839c988 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:11.056228 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9d946e29-4e7c-46fd-84f0-c18d711e9238 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7fa51caf47428fb0e89e2050b64211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c66bcd5e83f4ea89afa84ff947a36e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:11.069401 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9d946e29-4e7c-46fd-84f0-c18d711e9238 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] 10.222.0.50 "GET /compute/v2.1/servers/98beddf9-f152-4a63-98ac-fc3a9a1c9b63" status: 200 len: 1314 microversion: 2.1 time: 0.352187 Aug 31 16:13:11.070013 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2325/4453] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:10 2022] GET /compute/v2.1/servers/98beddf9-f152-4a63-98ac-fc3a9a1c9b63 => generated 1314 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:11.261361 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-adb07862-fb81-45cd-bbdc-6831b96b31c1 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:11.262334 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-adb07862-fb81-45cd-bbdc-6831b96b31c1 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 14167776-553f-4203-887b-3cb8e4cc0a2a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:11.274257 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-adb07862-fb81-45cd-bbdc-6831b96b31c1 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:11.274746 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-adb07862-fb81-45cd-bbdc-6831b96b31c1 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:11.275185 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-adb07862-fb81-45cd-bbdc-6831b96b31c1 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:11.275888 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-adb07862-fb81-45cd-bbdc-6831b96b31c1 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:11.276369 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-16db6662-6d81-4157-9fbb-6aaa9839c988 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:11.276557 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-adb07862-fb81-45cd-bbdc-6831b96b31c1 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:11.279449 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-adb07862-fb81-45cd-bbdc-6831b96b31c1 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:11.287054 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-16db6662-6d81-4157-9fbb-6aaa9839c988 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/33170fbc-0d84-4284-9f70-dedb91f0d295" status: 200 len: 1308 microversion: 2.1 time: 0.303901 Aug 31 16:13:11.288477 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2129/4454] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:10 2022] GET /compute/v2.1/servers/33170fbc-0d84-4284-9f70-dedb91f0d295 => generated 1308 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:11.384449 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-99f2356d-f32f-48b8-9da6-398b92ea2d8b tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-660253042", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "582a921e-879d-4256-a61c-34cd54e0cb07"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:11.483278 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-99f2356d-f32f-48b8-9da6-398b92ea2d8b tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] validate_networks() for [('582a921e-879d-4256-a61c-34cd54e0cb07', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:13:11.535656 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=6 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:13:11.737319 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-adb07862-fb81-45cd-bbdc-6831b96b31c1 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:11.752601 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-adb07862-fb81-45cd-bbdc-6831b96b31c1 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a" status: 200 len: 1521 microversion: 2.1 time: 0.497524 Aug 31 16:13:11.754145 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2326/4455] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:11 2022] GET /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a => generated 1521 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:13:11.760250 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-0fa72ead-b3c2-4ed1-a818-305ce8c3a34a req-cea60374-6dbb-4690-9f67-728c7b483366 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33170fbc-0d84-4284-9f70-dedb91f0d295", "tag": "5ed6e8f2-f1f7-413d-84bb-c5271687ea60"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:11.774542 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-0fa72ead-b3c2-4ed1-a818-305ce8c3a34a req-cea60374-6dbb-4690-9f67-728c7b483366 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:11.782310 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-0fa72ead-b3c2-4ed1-a818-305ce8c3a34a req-cea60374-6dbb-4690-9f67-728c7b483366 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:11.783658 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-0fa72ead-b3c2-4ed1-a818-305ce8c3a34a req-cea60374-6dbb-4690-9f67-728c7b483366 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:11.796247 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-0fa72ead-b3c2-4ed1-a818-305ce8c3a34a req-cea60374-6dbb-4690-9f67-728c7b483366 service nova] Creating event network-changed:5ed6e8f2-f1f7-413d-84bb-c5271687ea60 for instance 33170fbc-0d84-4284-9f70-dedb91f0d295 on n-h1-833090-16 Aug 31 16:13:11.802176 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-0fa72ead-b3c2-4ed1-a818-305ce8c3a34a req-cea60374-6dbb-4690-9f67-728c7b483366 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046079 Aug 31 16:13:11.802947 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2327/4456] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:11.808196 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d8ca4dfe-7b68-43f1-9542-ae2672e63a78 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:11.809687 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d8ca4dfe-7b68-43f1-9542-ae2672e63a78 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: af48d367-7828-47f9-a178-5d07cbaa26aa] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:11.823739 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d8ca4dfe-7b68-43f1-9542-ae2672e63a78 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:11.824224 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d8ca4dfe-7b68-43f1-9542-ae2672e63a78 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:11.824651 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d8ca4dfe-7b68-43f1-9542-ae2672e63a78 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:11.825341 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d8ca4dfe-7b68-43f1-9542-ae2672e63a78 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:11.825783 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d8ca4dfe-7b68-43f1-9542-ae2672e63a78 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:11.826226 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d8ca4dfe-7b68-43f1-9542-ae2672e63a78 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:12.155805 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d8ca4dfe-7b68-43f1-9542-ae2672e63a78 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:12.165496 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d8ca4dfe-7b68-43f1-9542-ae2672e63a78 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/af48d367-7828-47f9-a178-5d07cbaa26aa" status: 200 len: 1507 microversion: 2.1 time: 0.361238 Aug 31 16:13:12.166184 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2328/4457] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:11 2022] GET /compute/v2.1/servers/af48d367-7828-47f9-a178-5d07cbaa26aa => generated 1507 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:12.171754 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-92c3ac82-e601-48bf-b05e-d28cc55584b4 req-9ae4eaba-816f-4e6e-8b31-dbb9d28c7473 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a118055-6c34-44a8-a30e-f5ff8bb66fba", "name": "network-vif-plugged", "status": "completed", "tag": "92575430-e651-4c65-8cb7-1a46cc1ff965"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:12.182853 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-92c3ac82-e601-48bf-b05e-d28cc55584b4 req-9ae4eaba-816f-4e6e-8b31-dbb9d28c7473 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:12.183654 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-92c3ac82-e601-48bf-b05e-d28cc55584b4 req-9ae4eaba-816f-4e6e-8b31-dbb9d28c7473 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:12.184360 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-92c3ac82-e601-48bf-b05e-d28cc55584b4 req-9ae4eaba-816f-4e6e-8b31-dbb9d28c7473 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:12.197960 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-92c3ac82-e601-48bf-b05e-d28cc55584b4 req-9ae4eaba-816f-4e6e-8b31-dbb9d28c7473 service nova] Creating event network-vif-plugged:92575430-e651-4c65-8cb7-1a46cc1ff965 for instance 7a118055-6c34-44a8-a30e-f5ff8bb66fba on n-h1-833090-16 Aug 31 16:13:12.203943 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-92c3ac82-e601-48bf-b05e-d28cc55584b4 req-9ae4eaba-816f-4e6e-8b31-dbb9d28c7473 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036129 Aug 31 16:13:12.207379 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2329/4458] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:12.216179 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-21f319ba-6f7d-4590-b108-a4c6e61c5322 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:12.217519 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-21f319ba-6f7d-4590-b108-a4c6e61c5322 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] [instance: 7a118055-6c34-44a8-a30e-f5ff8bb66fba] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:12.225282 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-21f319ba-6f7d-4590-b108-a4c6e61c5322 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:12.226183 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-21f319ba-6f7d-4590-b108-a4c6e61c5322 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:12.227157 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-21f319ba-6f7d-4590-b108-a4c6e61c5322 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:12.228080 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-21f319ba-6f7d-4590-b108-a4c6e61c5322 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:12.228766 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-21f319ba-6f7d-4590-b108-a4c6e61c5322 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:12.229488 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-21f319ba-6f7d-4590-b108-a4c6e61c5322 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:12.321495 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-99f2356d-f32f-48b8-9da6-398b92ea2d8b tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:13:12.322018 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-99f2356d-f32f-48b8-9da6-398b92ea2d8b tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:13:12.322382 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-99f2356d-f32f-48b8-9da6-398b92ea2d8b tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:13:12.322959 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-99f2356d-f32f-48b8-9da6-398b92ea2d8b tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:13:12.323394 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-99f2356d-f32f-48b8-9da6-398b92ea2d8b tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:13:12.333669 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99f2356d-f32f-48b8-9da6-398b92ea2d8b tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:12.334166 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99f2356d-f32f-48b8-9da6-398b92ea2d8b tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:12.334593 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99f2356d-f32f-48b8-9da6-398b92ea2d8b tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:12.335574 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99f2356d-f32f-48b8-9da6-398b92ea2d8b tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:12.336211 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99f2356d-f32f-48b8-9da6-398b92ea2d8b tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:12.336832 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99f2356d-f32f-48b8-9da6-398b92ea2d8b tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:12.380592 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-99f2356d-f32f-48b8-9da6-398b92ea2d8b tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Getting quotas for project 7647e0ee82f148c6a4c138842d8fbf69. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:13:12.390004 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-99f2356d-f32f-48b8-9da6-398b92ea2d8b tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Getting quotas for user f5bf48d039ca4ce489212ef340ddb5ce and project 7647e0ee82f148c6a4c138842d8fbf69. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:13:12.401844 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-21f319ba-6f7d-4590-b108-a4c6e61c5322 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecd9e924c54474690f780576adc3a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b4f8a1c71745c6b860b5723acf164b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:12.405337 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-99f2356d-f32f-48b8-9da6-398b92ea2d8b tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:13:12.408018 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-99f2356d-f32f-48b8-9da6-398b92ea2d8b tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] [instance: bfb43b5d-9803-4760-8f51-f3bb651636a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:13:12.411912 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-21f319ba-6f7d-4590-b108-a4c6e61c5322 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ecd9e924c54474690f780576adc3a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b4f8a1c71745c6b860b5723acf164b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:12.413600 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-21f319ba-6f7d-4590-b108-a4c6e61c5322 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ecd9e924c54474690f780576adc3a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b4f8a1c71745c6b860b5723acf164b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:12.414787 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-21f319ba-6f7d-4590-b108-a4c6e61c5322 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] 10.222.0.50 "GET /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba" status: 200 len: 1362 microversion: 2.26 time: 0.204800 Aug 31 16:13:12.415911 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2330/4459] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:13:12 2022] GET /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba => generated 1362 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:13:12.434824 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d070de24-727e-4b8c-9415-b41f753c80f4 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:12.435521 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d070de24-727e-4b8c-9415-b41f753c80f4 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] [instance: 98beddf9-f152-4a63-98ac-fc3a9a1c9b63] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:12.441836 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d070de24-727e-4b8c-9415-b41f753c80f4 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:12.442403 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d070de24-727e-4b8c-9415-b41f753c80f4 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:12.442830 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d070de24-727e-4b8c-9415-b41f753c80f4 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:12.443526 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d070de24-727e-4b8c-9415-b41f753c80f4 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:12.443970 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d070de24-727e-4b8c-9415-b41f753c80f4 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:12.444389 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d070de24-727e-4b8c-9415-b41f753c80f4 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:12.462361 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-99f2356d-f32f-48b8-9da6-398b92ea2d8b tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.172333 Aug 31 16:13:12.463191 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2130/4460] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:13:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1174 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:13:12.470611 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-30b9731c-b3c3-4221-97ba-11283b1b977e tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:12.471490 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-30b9731c-b3c3-4221-97ba-11283b1b977e tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: af48d367-7828-47f9-a178-5d07cbaa26aa] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:12.482882 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-30b9731c-b3c3-4221-97ba-11283b1b977e tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:12.483716 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-30b9731c-b3c3-4221-97ba-11283b1b977e tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:12.484171 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-30b9731c-b3c3-4221-97ba-11283b1b977e tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:12.484872 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-30b9731c-b3c3-4221-97ba-11283b1b977e tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:12.485316 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-30b9731c-b3c3-4221-97ba-11283b1b977e tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:12.485730 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-30b9731c-b3c3-4221-97ba-11283b1b977e tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:12.696697 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-30b9731c-b3c3-4221-97ba-11283b1b977e tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:12.705567 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-30b9731c-b3c3-4221-97ba-11283b1b977e tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/af48d367-7828-47f9-a178-5d07cbaa26aa" status: 200 len: 1507 microversion: 2.1 time: 0.240969 Aug 31 16:13:12.720769 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d070de24-727e-4b8c-9415-b41f753c80f4 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7fa51caf47428fb0e89e2050b64211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c66bcd5e83f4ea89afa84ff947a36e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:12.721389 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2131/4461] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:12 2022] GET /compute/v2.1/servers/af48d367-7828-47f9-a178-5d07cbaa26aa => generated 1507 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:12.722644 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d070de24-727e-4b8c-9415-b41f753c80f4 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] 10.222.0.50 "GET /compute/v2.1/servers/98beddf9-f152-4a63-98ac-fc3a9a1c9b63" status: 200 len: 1314 microversion: 2.1 time: 0.291878 Aug 31 16:13:12.724023 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2331/4462] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:12 2022] GET /compute/v2.1/servers/98beddf9-f152-4a63-98ac-fc3a9a1c9b63 => generated 1314 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:12.726408 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8c112a34-2ea7-42c1-b082-43252f1a3d8b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:12.727210 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8c112a34-2ea7-42c1-b082-43252f1a3d8b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 33170fbc-0d84-4284-9f70-dedb91f0d295] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:12.736533 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c112a34-2ea7-42c1-b082-43252f1a3d8b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:12.737849 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1bf2a531-f681-4c62-8770-4f1407643612 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:12.738737 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1bf2a531-f681-4c62-8770-4f1407643612 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] [instance: bfb43b5d-9803-4760-8f51-f3bb651636a3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:12.739426 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c112a34-2ea7-42c1-b082-43252f1a3d8b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:12.739897 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c112a34-2ea7-42c1-b082-43252f1a3d8b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:12.740979 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c112a34-2ea7-42c1-b082-43252f1a3d8b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:12.741838 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c112a34-2ea7-42c1-b082-43252f1a3d8b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:12.749440 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c112a34-2ea7-42c1-b082-43252f1a3d8b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:12.847060 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1bf2a531-f681-4c62-8770-4f1407643612 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5bf48d039ca4ce489212ef340ddb5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7647e0ee82f148c6a4c138842d8fbf69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:12.856152 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1bf2a531-f681-4c62-8770-4f1407643612 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] 10.222.0.50 "GET /compute/v2.1/servers/bfb43b5d-9803-4760-8f51-f3bb651636a3" status: 200 len: 1223 microversion: 2.1 time: 0.130486 Aug 31 16:13:12.857267 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2332/4463] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:12 2022] GET /compute/v2.1/servers/bfb43b5d-9803-4760-8f51-f3bb651636a3 => generated 1223 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:12.864561 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9e8ff287-fdd2-4186-b638-e969572411a7 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:12.867529 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9e8ff287-fdd2-4186-b638-e969572411a7 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: af48d367-7828-47f9-a178-5d07cbaa26aa] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:12.877506 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9e8ff287-fdd2-4186-b638-e969572411a7 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:12.878437 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9e8ff287-fdd2-4186-b638-e969572411a7 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:12.879164 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9e8ff287-fdd2-4186-b638-e969572411a7 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:12.880175 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9e8ff287-fdd2-4186-b638-e969572411a7 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:12.880953 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9e8ff287-fdd2-4186-b638-e969572411a7 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:12.881673 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9e8ff287-fdd2-4186-b638-e969572411a7 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:12.971738 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8c112a34-2ea7-42c1-b082-43252f1a3d8b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:12.980899 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8c112a34-2ea7-42c1-b082-43252f1a3d8b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/33170fbc-0d84-4284-9f70-dedb91f0d295" status: 200 len: 1308 microversion: 2.1 time: 0.258228 Aug 31 16:13:12.982787 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9e8ff287-fdd2-4186-b638-e969572411a7 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "PUT /compute/v2.1/servers/af48d367-7828-47f9-a178-5d07cbaa26aa" status: 200 len: 1079 microversion: 2.1 time: 0.123932 Aug 31 16:13:12.983257 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2132/4464] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:12 2022] GET /compute/v2.1/servers/33170fbc-0d84-4284-9f70-dedb91f0d295 => generated 1308 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:12.989649 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e5568f58-59e9-4222-a210-c7f9a5e22b77 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:12.990523 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e5568f58-59e9-4222-a210-c7f9a5e22b77 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 14167776-553f-4203-887b-3cb8e4cc0a2a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:12.996117 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2333/4465] 10.222.0.50 () {60 vars in 1256 bytes} [Wed Aug 31 16:13:12 2022] PUT /compute/v2.1/servers/af48d367-7828-47f9-a178-5d07cbaa26aa => generated 1079 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:13.001227 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4a0aab64-7aef-4fd9-9ded-be7fcc5f2bea tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:13.001901 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4a0aab64-7aef-4fd9-9ded-be7fcc5f2bea tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: af48d367-7828-47f9-a178-5d07cbaa26aa] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:13.002632 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e5568f58-59e9-4222-a210-c7f9a5e22b77 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:13.003375 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e5568f58-59e9-4222-a210-c7f9a5e22b77 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:13.004048 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e5568f58-59e9-4222-a210-c7f9a5e22b77 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:13.005642 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e5568f58-59e9-4222-a210-c7f9a5e22b77 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:13.006333 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e5568f58-59e9-4222-a210-c7f9a5e22b77 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:13.006966 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e5568f58-59e9-4222-a210-c7f9a5e22b77 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:13.009520 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4a0aab64-7aef-4fd9-9ded-be7fcc5f2bea tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:13.010293 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4a0aab64-7aef-4fd9-9ded-be7fcc5f2bea tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:13.011186 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4a0aab64-7aef-4fd9-9ded-be7fcc5f2bea tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:13.012036 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4a0aab64-7aef-4fd9-9ded-be7fcc5f2bea tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:13.012502 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4a0aab64-7aef-4fd9-9ded-be7fcc5f2bea tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:13.012931 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4a0aab64-7aef-4fd9-9ded-be7fcc5f2bea tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:13.315960 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4a0aab64-7aef-4fd9-9ded-be7fcc5f2bea tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:13.329172 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4a0aab64-7aef-4fd9-9ded-be7fcc5f2bea tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/af48d367-7828-47f9-a178-5d07cbaa26aa" status: 200 len: 1505 microversion: 2.1 time: 0.331882 Aug 31 16:13:13.346444 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2334/4466] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:12 2022] GET /compute/v2.1/servers/af48d367-7828-47f9-a178-5d07cbaa26aa => generated 1505 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:13.360659 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-855fb852-b4d9-4aaa-997d-c09998557f90 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:13.361694 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-855fb852-b4d9-4aaa-997d-c09998557f90 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: af48d367-7828-47f9-a178-5d07cbaa26aa] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:13.373496 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-855fb852-b4d9-4aaa-997d-c09998557f90 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:13.377062 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-855fb852-b4d9-4aaa-997d-c09998557f90 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:13.377748 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-855fb852-b4d9-4aaa-997d-c09998557f90 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:13.378982 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-855fb852-b4d9-4aaa-997d-c09998557f90 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:13.381954 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-855fb852-b4d9-4aaa-997d-c09998557f90 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:13.382745 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-855fb852-b4d9-4aaa-997d-c09998557f90 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:13.397350 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e5568f58-59e9-4222-a210-c7f9a5e22b77 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:13.408640 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e5568f58-59e9-4222-a210-c7f9a5e22b77 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a" status: 200 len: 1521 microversion: 2.1 time: 0.423844 Aug 31 16:13:13.412673 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2133/4467] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:12 2022] GET /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a => generated 1521 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:13.430656 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:13:13.441306 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-99eeefd0-bcf2-4fb2-8b97-7ef4f334ea92 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:13.442026 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-99eeefd0-bcf2-4fb2-8b97-7ef4f334ea92 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] [instance: 7a118055-6c34-44a8-a30e-f5ff8bb66fba] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:13.472119 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99eeefd0-bcf2-4fb2-8b97-7ef4f334ea92 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:13.472735 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99eeefd0-bcf2-4fb2-8b97-7ef4f334ea92 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:13.473240 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99eeefd0-bcf2-4fb2-8b97-7ef4f334ea92 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:13.474221 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99eeefd0-bcf2-4fb2-8b97-7ef4f334ea92 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:13.474786 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99eeefd0-bcf2-4fb2-8b97-7ef4f334ea92 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:13.475944 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99eeefd0-bcf2-4fb2-8b97-7ef4f334ea92 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:13.664791 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-855fb852-b4d9-4aaa-997d-c09998557f90 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:13.674645 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-855fb852-b4d9-4aaa-997d-c09998557f90 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/af48d367-7828-47f9-a178-5d07cbaa26aa" status: 200 len: 1505 microversion: 2.1 time: 0.326694 Aug 31 16:13:13.678508 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2335/4468] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:13 2022] GET /compute/v2.1/servers/af48d367-7828-47f9-a178-5d07cbaa26aa => generated 1505 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:13.696403 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8b6d0aec-612c-475e-b6b9-d183632ef8cb tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:13.699348 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8b6d0aec-612c-475e-b6b9-d183632ef8cb tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: af48d367-7828-47f9-a178-5d07cbaa26aa] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:13.716403 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b6d0aec-612c-475e-b6b9-d183632ef8cb tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:13.717236 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b6d0aec-612c-475e-b6b9-d183632ef8cb tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:13.717779 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b6d0aec-612c-475e-b6b9-d183632ef8cb tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:13.718746 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b6d0aec-612c-475e-b6b9-d183632ef8cb tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:13.719304 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b6d0aec-612c-475e-b6b9-d183632ef8cb tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:13.719817 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b6d0aec-612c-475e-b6b9-d183632ef8cb tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:13.766958 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-99eeefd0-bcf2-4fb2-8b97-7ef4f334ea92 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecd9e924c54474690f780576adc3a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b4f8a1c71745c6b860b5723acf164b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:13.778883 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-99eeefd0-bcf2-4fb2-8b97-7ef4f334ea92 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ecd9e924c54474690f780576adc3a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b4f8a1c71745c6b860b5723acf164b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:13.783851 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-99eeefd0-bcf2-4fb2-8b97-7ef4f334ea92 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ecd9e924c54474690f780576adc3a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b4f8a1c71745c6b860b5723acf164b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:13.785824 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-99eeefd0-bcf2-4fb2-8b97-7ef4f334ea92 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] 10.222.0.50 "GET /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba" status: 200 len: 1362 microversion: 2.26 time: 0.349544 Aug 31 16:13:13.788074 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2134/4469] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:13:13 2022] GET /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba => generated 1362 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:13:13.802867 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0f21a672-b23b-47e5-8423-e838b98ddd8c tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:13.803724 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0f21a672-b23b-47e5-8423-e838b98ddd8c tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] [instance: 98beddf9-f152-4a63-98ac-fc3a9a1c9b63] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:13.815947 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f21a672-b23b-47e5-8423-e838b98ddd8c tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:13.816628 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f21a672-b23b-47e5-8423-e838b98ddd8c tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:13.817299 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f21a672-b23b-47e5-8423-e838b98ddd8c tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:13.818219 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f21a672-b23b-47e5-8423-e838b98ddd8c tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:13.818891 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f21a672-b23b-47e5-8423-e838b98ddd8c tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:13.819486 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f21a672-b23b-47e5-8423-e838b98ddd8c tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:13.849754 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8b6d0aec-612c-475e-b6b9-d183632ef8cb tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "PUT /compute/v2.1/servers/af48d367-7828-47f9-a178-5d07cbaa26aa" status: 200 len: 1081 microversion: 2.1 time: 0.157349 Aug 31 16:13:13.851023 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2336/4470] 10.222.0.50 () {60 vars in 1256 bytes} [Wed Aug 31 16:13:13 2022] PUT /compute/v2.1/servers/af48d367-7828-47f9-a178-5d07cbaa26aa => generated 1081 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:13.873323 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ea4fdf10-d4aa-45a5-a3ab-314b25899ec6 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:13.874211 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ea4fdf10-d4aa-45a5-a3ab-314b25899ec6 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: af48d367-7828-47f9-a178-5d07cbaa26aa] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:13.888149 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ea4fdf10-d4aa-45a5-a3ab-314b25899ec6 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:13.888851 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ea4fdf10-d4aa-45a5-a3ab-314b25899ec6 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:13.889481 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ea4fdf10-d4aa-45a5-a3ab-314b25899ec6 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:13.890220 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ea4fdf10-d4aa-45a5-a3ab-314b25899ec6 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:13.890672 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ea4fdf10-d4aa-45a5-a3ab-314b25899ec6 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:13.891107 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ea4fdf10-d4aa-45a5-a3ab-314b25899ec6 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:14.041399 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0f21a672-b23b-47e5-8423-e838b98ddd8c tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7fa51caf47428fb0e89e2050b64211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c66bcd5e83f4ea89afa84ff947a36e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:14.050869 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0f21a672-b23b-47e5-8423-e838b98ddd8c tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] 10.222.0.50 "GET /compute/v2.1/servers/98beddf9-f152-4a63-98ac-fc3a9a1c9b63" status: 200 len: 1314 microversion: 2.1 time: 0.259758 Aug 31 16:13:14.062154 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2135/4471] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:13 2022] GET /compute/v2.1/servers/98beddf9-f152-4a63-98ac-fc3a9a1c9b63 => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:14.070258 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0dea0b73-00e3-474b-abd8-c1c5841ede3e tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:14.076735 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0dea0b73-00e3-474b-abd8-c1c5841ede3e tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] [instance: bfb43b5d-9803-4760-8f51-f3bb651636a3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:14.080679 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ea4fdf10-d4aa-45a5-a3ab-314b25899ec6 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:14.089070 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ea4fdf10-d4aa-45a5-a3ab-314b25899ec6 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/af48d367-7828-47f9-a178-5d07cbaa26aa" status: 200 len: 1507 microversion: 2.1 time: 0.220434 Aug 31 16:13:14.090004 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2337/4472] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:13 2022] GET /compute/v2.1/servers/af48d367-7828-47f9-a178-5d07cbaa26aa => generated 1507 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:14.094836 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0dea0b73-00e3-474b-abd8-c1c5841ede3e tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:14.095393 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0dea0b73-00e3-474b-abd8-c1c5841ede3e tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:14.097188 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0dea0b73-00e3-474b-abd8-c1c5841ede3e tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:14.097951 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0dea0b73-00e3-474b-abd8-c1c5841ede3e tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:14.100209 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0dea0b73-00e3-474b-abd8-c1c5841ede3e tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:14.100990 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0dea0b73-00e3-474b-abd8-c1c5841ede3e tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:14.106769 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f6ce7283-a697-461e-8f0a-48d9549e25da tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:14.109110 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f6ce7283-a697-461e-8f0a-48d9549e25da tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 33170fbc-0d84-4284-9f70-dedb91f0d295] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:14.124403 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f6ce7283-a697-461e-8f0a-48d9549e25da tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:14.124932 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f6ce7283-a697-461e-8f0a-48d9549e25da tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:14.125370 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f6ce7283-a697-461e-8f0a-48d9549e25da tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:14.126127 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f6ce7283-a697-461e-8f0a-48d9549e25da tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:14.126578 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f6ce7283-a697-461e-8f0a-48d9549e25da tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:14.127003 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f6ce7283-a697-461e-8f0a-48d9549e25da tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:14.195679 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0dea0b73-00e3-474b-abd8-c1c5841ede3e tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5bf48d039ca4ce489212ef340ddb5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7647e0ee82f148c6a4c138842d8fbf69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:14.203373 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0dea0b73-00e3-474b-abd8-c1c5841ede3e tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] 10.222.0.50 "GET /compute/v2.1/servers/bfb43b5d-9803-4760-8f51-f3bb651636a3" status: 200 len: 1275 microversion: 2.1 time: 0.150553 Aug 31 16:13:14.203958 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2136/4473] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:14 2022] GET /compute/v2.1/servers/bfb43b5d-9803-4760-8f51-f3bb651636a3 => generated 1275 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:14.209321 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-79768112-676c-4ce1-9194-fd81a2a18543 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:14.209942 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-79768112-676c-4ce1-9194-fd81a2a18543 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: af48d367-7828-47f9-a178-5d07cbaa26aa] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:14.217752 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79768112-676c-4ce1-9194-fd81a2a18543 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:14.218324 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79768112-676c-4ce1-9194-fd81a2a18543 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:14.218782 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79768112-676c-4ce1-9194-fd81a2a18543 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:14.219783 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79768112-676c-4ce1-9194-fd81a2a18543 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:14.220238 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79768112-676c-4ce1-9194-fd81a2a18543 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:14.220914 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79768112-676c-4ce1-9194-fd81a2a18543 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:14.372403 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f6ce7283-a697-461e-8f0a-48d9549e25da tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:14.380770 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f6ce7283-a697-461e-8f0a-48d9549e25da tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/33170fbc-0d84-4284-9f70-dedb91f0d295" status: 200 len: 1308 microversion: 2.1 time: 0.289503 Aug 31 16:13:14.381606 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2338/4474] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:14 2022] GET /compute/v2.1/servers/33170fbc-0d84-4284-9f70-dedb91f0d295 => generated 1308 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:14.386360 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-5f69f7a4-3852-4a1a-af63-3cd5800e095a req-c8a8b213-3a7b-4bbb-be0c-f8f2fa2a624f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98beddf9-f152-4a63-98ac-fc3a9a1c9b63", "name": "network-vif-plugged", "status": "completed", "tag": "1d0f47ad-5c5d-4ec7-9753-fd7a8837b4c5"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:14.396414 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-5f69f7a4-3852-4a1a-af63-3cd5800e095a req-c8a8b213-3a7b-4bbb-be0c-f8f2fa2a624f service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:14.397157 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-5f69f7a4-3852-4a1a-af63-3cd5800e095a req-c8a8b213-3a7b-4bbb-be0c-f8f2fa2a624f service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:14.397749 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-5f69f7a4-3852-4a1a-af63-3cd5800e095a req-c8a8b213-3a7b-4bbb-be0c-f8f2fa2a624f service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:14.411776 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-79768112-676c-4ce1-9194-fd81a2a18543 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:14.415528 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-5f69f7a4-3852-4a1a-af63-3cd5800e095a req-c8a8b213-3a7b-4bbb-be0c-f8f2fa2a624f service nova] Creating event network-vif-plugged:1d0f47ad-5c5d-4ec7-9753-fd7a8837b4c5 for instance 98beddf9-f152-4a63-98ac-fc3a9a1c9b63 on n-h1-833090-16 Aug 31 16:13:14.420035 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-5f69f7a4-3852-4a1a-af63-3cd5800e095a req-c8a8b213-3a7b-4bbb-be0c-f8f2fa2a624f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037092 Aug 31 16:13:14.420853 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-79768112-676c-4ce1-9194-fd81a2a18543 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/af48d367-7828-47f9-a178-5d07cbaa26aa" status: 200 len: 1507 microversion: 2.1 time: 0.215874 Aug 31 16:13:14.421002 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2339/4475] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:13:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:14.421581 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2137/4476] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:14 2022] GET /compute/v2.1/servers/af48d367-7828-47f9-a178-5d07cbaa26aa => generated 1507 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:14.433496 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-cad91319-53f2-4d66-86d5-77ddb2dfc72b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:14.434292 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-cad91319-53f2-4d66-86d5-77ddb2dfc72b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 14167776-553f-4203-887b-3cb8e4cc0a2a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:14.439953 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:13:14.441688 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ec835685-a9ab-4bbc-b318-165c7f485645 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:14.441849 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cad91319-53f2-4d66-86d5-77ddb2dfc72b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:14.442228 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ec835685-a9ab-4bbc-b318-165c7f485645 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: af48d367-7828-47f9-a178-5d07cbaa26aa] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:14.442347 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cad91319-53f2-4d66-86d5-77ddb2dfc72b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:14.442737 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cad91319-53f2-4d66-86d5-77ddb2dfc72b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:14.443430 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cad91319-53f2-4d66-86d5-77ddb2dfc72b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:14.444077 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cad91319-53f2-4d66-86d5-77ddb2dfc72b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:14.444286 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cad91319-53f2-4d66-86d5-77ddb2dfc72b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:14.449123 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ec835685-a9ab-4bbc-b318-165c7f485645 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:14.449314 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ec835685-a9ab-4bbc-b318-165c7f485645 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:14.449653 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ec835685-a9ab-4bbc-b318-165c7f485645 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:14.450700 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ec835685-a9ab-4bbc-b318-165c7f485645 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:14.451156 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ec835685-a9ab-4bbc-b318-165c7f485645 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:14.452809 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ec835685-a9ab-4bbc-b318-165c7f485645 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:14.495935 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ec835685-a9ab-4bbc-b318-165c7f485645 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: af48d367-7828-47f9-a178-5d07cbaa26aa] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:13:14.646843 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ec835685-a9ab-4bbc-b318-165c7f485645 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "DELETE /compute/v2.1/servers/af48d367-7828-47f9-a178-5d07cbaa26aa" status: 204 len: 0 microversion: 2.1 time: 0.208088 Aug 31 16:13:14.652344 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2138/4477] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:13:14 2022] DELETE /compute/v2.1/servers/af48d367-7828-47f9-a178-5d07cbaa26aa => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 16:13:14.659914 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a23366c4-320b-4846-a5ac-a654c672bbee tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:14.660757 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a23366c4-320b-4846-a5ac-a654c672bbee tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: af48d367-7828-47f9-a178-5d07cbaa26aa] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:14.668064 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a23366c4-320b-4846-a5ac-a654c672bbee tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:14.668657 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a23366c4-320b-4846-a5ac-a654c672bbee tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:14.669294 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a23366c4-320b-4846-a5ac-a654c672bbee tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:14.670086 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a23366c4-320b-4846-a5ac-a654c672bbee tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:14.670894 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a23366c4-320b-4846-a5ac-a654c672bbee tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:14.671407 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a23366c4-320b-4846-a5ac-a654c672bbee tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:14.697909 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:13:14.707911 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a23366c4-320b-4846-a5ac-a654c672bbee tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: af48d367-7828-47f9-a178-5d07cbaa26aa] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:13:14.764237 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.compute.api [None req-a23366c4-320b-4846-a5ac-a654c672bbee tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: af48d367-7828-47f9-a178-5d07cbaa26aa] Instance is already in deleting state, ignoring this request Aug 31 16:13:14.765180 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a23366c4-320b-4846-a5ac-a654c672bbee tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "DELETE /compute/v2.1/servers/af48d367-7828-47f9-a178-5d07cbaa26aa" status: 204 len: 0 microversion: 2.1 time: 0.111016 Aug 31 16:13:14.766041 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2139/4478] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:13:14 2022] DELETE /compute/v2.1/servers/af48d367-7828-47f9-a178-5d07cbaa26aa => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 16:13:14.774352 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6d683a8f-c387-4e26-962e-0c1c93b4daf5 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:14.775065 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6d683a8f-c387-4e26-962e-0c1c93b4daf5 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: af48d367-7828-47f9-a178-5d07cbaa26aa] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:14.781898 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d683a8f-c387-4e26-962e-0c1c93b4daf5 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:14.782535 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d683a8f-c387-4e26-962e-0c1c93b4daf5 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:14.783033 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d683a8f-c387-4e26-962e-0c1c93b4daf5 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:14.783800 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d683a8f-c387-4e26-962e-0c1c93b4daf5 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:14.784333 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d683a8f-c387-4e26-962e-0c1c93b4daf5 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:14.784832 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d683a8f-c387-4e26-962e-0c1c93b4daf5 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:15.172263 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-cad91319-53f2-4d66-86d5-77ddb2dfc72b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:15.182860 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-cad91319-53f2-4d66-86d5-77ddb2dfc72b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a" status: 200 len: 1521 microversion: 2.1 time: 0.753426 Aug 31 16:13:15.184085 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2340/4479] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:14 2022] GET /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a => generated 1521 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:15.189650 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a9cdadbb-aef3-47c7-9535-0b04c51f9971 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:15.190521 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a9cdadbb-aef3-47c7-9535-0b04c51f9971 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] [instance: 7a118055-6c34-44a8-a30e-f5ff8bb66fba] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:15.197831 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a9cdadbb-aef3-47c7-9535-0b04c51f9971 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:15.198740 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a9cdadbb-aef3-47c7-9535-0b04c51f9971 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:15.199345 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a9cdadbb-aef3-47c7-9535-0b04c51f9971 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:15.200235 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a9cdadbb-aef3-47c7-9535-0b04c51f9971 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:15.200867 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a9cdadbb-aef3-47c7-9535-0b04c51f9971 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:15.201293 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a9cdadbb-aef3-47c7-9535-0b04c51f9971 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:15.359580 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6d683a8f-c387-4e26-962e-0c1c93b4daf5 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:15.367821 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6d683a8f-c387-4e26-962e-0c1c93b4daf5 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/af48d367-7828-47f9-a178-5d07cbaa26aa" status: 200 len: 1513 microversion: 2.1 time: 0.597548 Aug 31 16:13:15.376909 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2140/4480] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:14 2022] GET /compute/v2.1/servers/af48d367-7828-47f9-a178-5d07cbaa26aa => generated 1513 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:13:15.380210 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-37477dad-f551-461e-917b-5966a19dce7c tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:15.381127 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-37477dad-f551-461e-917b-5966a19dce7c tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] [instance: 98beddf9-f152-4a63-98ac-fc3a9a1c9b63] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:15.388859 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37477dad-f551-461e-917b-5966a19dce7c tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:15.389561 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37477dad-f551-461e-917b-5966a19dce7c tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:15.390072 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37477dad-f551-461e-917b-5966a19dce7c tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:15.390876 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37477dad-f551-461e-917b-5966a19dce7c tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:15.391333 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37477dad-f551-461e-917b-5966a19dce7c tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:15.391761 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37477dad-f551-461e-917b-5966a19dce7c tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:15.524799 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a9cdadbb-aef3-47c7-9535-0b04c51f9971 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecd9e924c54474690f780576adc3a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b4f8a1c71745c6b860b5723acf164b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:15.536087 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a9cdadbb-aef3-47c7-9535-0b04c51f9971 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ecd9e924c54474690f780576adc3a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b4f8a1c71745c6b860b5723acf164b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:15.537842 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a9cdadbb-aef3-47c7-9535-0b04c51f9971 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ecd9e924c54474690f780576adc3a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b4f8a1c71745c6b860b5723acf164b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:15.539922 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a9cdadbb-aef3-47c7-9535-0b04c51f9971 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] 10.222.0.50 "GET /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba" status: 200 len: 1547 microversion: 2.26 time: 0.354650 Aug 31 16:13:15.540598 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2341/4481] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:13:15 2022] GET /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba => generated 1547 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:13:15.545864 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-24919638-dbca-4b35-af43-56bff01cd65a tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:15.546643 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-24919638-dbca-4b35-af43-56bff01cd65a tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] [instance: bfb43b5d-9803-4760-8f51-f3bb651636a3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:15.552927 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-24919638-dbca-4b35-af43-56bff01cd65a tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:15.554253 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-24919638-dbca-4b35-af43-56bff01cd65a tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:15.554939 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-24919638-dbca-4b35-af43-56bff01cd65a tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:15.556429 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-24919638-dbca-4b35-af43-56bff01cd65a tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:15.557591 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-24919638-dbca-4b35-af43-56bff01cd65a tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:15.558309 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-24919638-dbca-4b35-af43-56bff01cd65a tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:15.686740 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-24919638-dbca-4b35-af43-56bff01cd65a tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5bf48d039ca4ce489212ef340ddb5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7647e0ee82f148c6a4c138842d8fbf69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:15.686976 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-37477dad-f551-461e-917b-5966a19dce7c tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7fa51caf47428fb0e89e2050b64211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c66bcd5e83f4ea89afa84ff947a36e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:15.695030 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-24919638-dbca-4b35-af43-56bff01cd65a tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] 10.222.0.50 "GET /compute/v2.1/servers/bfb43b5d-9803-4760-8f51-f3bb651636a3" status: 200 len: 1281 microversion: 2.1 time: 0.152894 Aug 31 16:13:15.700499 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-37477dad-f551-461e-917b-5966a19dce7c tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] 10.222.0.50 "GET /compute/v2.1/servers/98beddf9-f152-4a63-98ac-fc3a9a1c9b63" status: 200 len: 1314 microversion: 2.1 time: 0.324883 Aug 31 16:13:15.701762 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2141/4482] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:15 2022] GET /compute/v2.1/servers/98beddf9-f152-4a63-98ac-fc3a9a1c9b63 => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:15.708498 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-15b61cfa-c89c-4f3c-9897-b9bf5c8423f2 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:15.708498 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-15b61cfa-c89c-4f3c-9897-b9bf5c8423f2 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 33170fbc-0d84-4284-9f70-dedb91f0d295] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:15.710818 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2342/4483] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:15 2022] GET /compute/v2.1/servers/bfb43b5d-9803-4760-8f51-f3bb651636a3 => generated 1281 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:15.720799 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-15b61cfa-c89c-4f3c-9897-b9bf5c8423f2 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:15.721291 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-15b61cfa-c89c-4f3c-9897-b9bf5c8423f2 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:15.721767 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-877b0a08-7cc8-4772-80d8-78398dc73ab7 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Calling method '.version_select at 0x7fbb46878af0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:15.721947 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-15b61cfa-c89c-4f3c-9897-b9bf5c8423f2 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:15.723041 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-15b61cfa-c89c-4f3c-9897-b9bf5c8423f2 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:15.723780 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-15b61cfa-c89c-4f3c-9897-b9bf5c8423f2 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:15.724210 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-15b61cfa-c89c-4f3c-9897-b9bf5c8423f2 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:15.732202 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-877b0a08-7cc8-4772-80d8-78398dc73ab7 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:15.732777 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-877b0a08-7cc8-4772-80d8-78398dc73ab7 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:15.733736 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-877b0a08-7cc8-4772-80d8-78398dc73ab7 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:15.734119 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-877b0a08-7cc8-4772-80d8-78398dc73ab7 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] [instance: 7a118055-6c34-44a8-a30e-f5ff8bb66fba] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:15.740001 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-877b0a08-7cc8-4772-80d8-78398dc73ab7 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:15.740763 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-877b0a08-7cc8-4772-80d8-78398dc73ab7 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:15.741367 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-877b0a08-7cc8-4772-80d8-78398dc73ab7 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:15.742312 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-877b0a08-7cc8-4772-80d8-78398dc73ab7 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:15.743000 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-877b0a08-7cc8-4772-80d8-78398dc73ab7 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:15.743650 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-877b0a08-7cc8-4772-80d8-78398dc73ab7 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:15.773572 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-877b0a08-7cc8-4772-80d8-78398dc73ab7 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:15.774086 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-877b0a08-7cc8-4772-80d8-78398dc73ab7 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:15.774541 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-877b0a08-7cc8-4772-80d8-78398dc73ab7 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:15.792546 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-877b0a08-7cc8-4772-80d8-78398dc73ab7 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:15.793064 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-877b0a08-7cc8-4772-80d8-78398dc73ab7 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:15.793563 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-877b0a08-7cc8-4772-80d8-78398dc73ab7 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:15.826665 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-877b0a08-7cc8-4772-80d8-78398dc73ab7 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lazy-loading 'flavor' on Instance uuid 7a118055-6c34-44a8-a30e-f5ff8bb66fba {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:13:15.845735 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-877b0a08-7cc8-4772-80d8-78398dc73ab7 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] 10.222.0.50 "PUT /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba/tags/tempest-tag-463078357" status: 201 len: 0 microversion: 2.26 time: 0.133490 Aug 31 16:13:15.850800 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2343/4484] 10.222.0.50 () {62 vars in 1377 bytes} [Wed Aug 31 16:13:15 2022] PUT /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba/tags/tempest-tag-463078357 => generated 0 bytes in 135 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 31 16:13:15.856683 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-13be41c1-d568-4029-9066-2aa611155219 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Calling method '.version_select at 0x7fbb46994670>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:15.866984 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-13be41c1-d568-4029-9066-2aa611155219 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:15.867474 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-13be41c1-d568-4029-9066-2aa611155219 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:15.867904 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-13be41c1-d568-4029-9066-2aa611155219 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:15.880792 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-13be41c1-d568-4029-9066-2aa611155219 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] 10.222.0.50 "GET /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba/tags/tempest-tag-463078357" status: 204 len: 0 microversion: 2.26 time: 0.028462 Aug 31 16:13:15.881423 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2344/4485] 10.222.0.50 () {60 vars in 1358 bytes} [Wed Aug 31 16:13:15 2022] GET /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba/tags/tempest-tag-463078357 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 16:13:15.892817 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e4ad50d2-0af9-412b-8131-7f6a014057cf tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Calling method '.version_select at 0x7fbb46994040>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:15.900659 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4ad50d2-0af9-412b-8131-7f6a014057cf tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:15.901167 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4ad50d2-0af9-412b-8131-7f6a014057cf tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:15.901917 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4ad50d2-0af9-412b-8131-7f6a014057cf tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:15.902458 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e4ad50d2-0af9-412b-8131-7f6a014057cf tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] [instance: 7a118055-6c34-44a8-a30e-f5ff8bb66fba] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:15.909509 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4ad50d2-0af9-412b-8131-7f6a014057cf tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:15.909994 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4ad50d2-0af9-412b-8131-7f6a014057cf tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:15.910474 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4ad50d2-0af9-412b-8131-7f6a014057cf tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:15.911512 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4ad50d2-0af9-412b-8131-7f6a014057cf tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:15.911729 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4ad50d2-0af9-412b-8131-7f6a014057cf tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:15.912044 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4ad50d2-0af9-412b-8131-7f6a014057cf tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:15.938635 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4ad50d2-0af9-412b-8131-7f6a014057cf tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:15.939111 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4ad50d2-0af9-412b-8131-7f6a014057cf tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:15.939540 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4ad50d2-0af9-412b-8131-7f6a014057cf tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:15.954951 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-e4ad50d2-0af9-412b-8131-7f6a014057cf tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lazy-loading 'flavor' on Instance uuid 7a118055-6c34-44a8-a30e-f5ff8bb66fba {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:13:15.970466 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e4ad50d2-0af9-412b-8131-7f6a014057cf tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] 10.222.0.50 "DELETE /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba/tags" status: 204 len: 0 microversion: 2.26 time: 0.083908 Aug 31 16:13:15.971089 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2345/4486] 10.222.0.50 () {60 vars in 1295 bytes} [Wed Aug 31 16:13:15 2022] DELETE /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba/tags => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 16:13:15.981391 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6a7d8f35-92a8-45d2-9be8-ce71e8e86ed8 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Calling method '.version_select at 0x7fbb46b5fb80>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:15.989899 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6a7d8f35-92a8-45d2-9be8-ce71e8e86ed8 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:15.991271 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6a7d8f35-92a8-45d2-9be8-ce71e8e86ed8 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:15.991271 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6a7d8f35-92a8-45d2-9be8-ce71e8e86ed8 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:15.991473 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-15b61cfa-c89c-4f3c-9897-b9bf5c8423f2 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:16.000310 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-15b61cfa-c89c-4f3c-9897-b9bf5c8423f2 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/33170fbc-0d84-4284-9f70-dedb91f0d295" status: 200 len: 1308 microversion: 2.1 time: 0.297223 Aug 31 16:13:16.000674 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6a7d8f35-92a8-45d2-9be8-ce71e8e86ed8 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] 10.222.0.50 "GET /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba/tags" status: 200 len: 12 microversion: 2.26 time: 0.023679 Aug 31 16:13:16.000883 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2142/4487] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:15 2022] GET /compute/v2.1/servers/33170fbc-0d84-4284-9f70-dedb91f0d295 => generated 1308 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:16.006892 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2346/4488] 10.222.0.50 () {60 vars in 1292 bytes} [Wed Aug 31 16:13:15 2022] GET /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba/tags => generated 12 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:16.023547 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1540e0ff-2f85-47b3-bcbc-0e1cc16f93a3 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Calling method '.version_select at 0x7fbb4aa5cee0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:16.037154 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1540e0ff-2f85-47b3-bcbc-0e1cc16f93a3 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:16.039157 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1540e0ff-2f85-47b3-bcbc-0e1cc16f93a3 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:16.039641 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1540e0ff-2f85-47b3-bcbc-0e1cc16f93a3 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:16.040141 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1540e0ff-2f85-47b3-bcbc-0e1cc16f93a3 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] [instance: 7a118055-6c34-44a8-a30e-f5ff8bb66fba] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:16.049090 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1540e0ff-2f85-47b3-bcbc-0e1cc16f93a3 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:16.050198 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1540e0ff-2f85-47b3-bcbc-0e1cc16f93a3 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:16.050198 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1540e0ff-2f85-47b3-bcbc-0e1cc16f93a3 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:16.051388 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1540e0ff-2f85-47b3-bcbc-0e1cc16f93a3 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:16.051885 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1540e0ff-2f85-47b3-bcbc-0e1cc16f93a3 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:16.052406 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1540e0ff-2f85-47b3-bcbc-0e1cc16f93a3 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:16.082473 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1540e0ff-2f85-47b3-bcbc-0e1cc16f93a3 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:16.082967 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1540e0ff-2f85-47b3-bcbc-0e1cc16f93a3 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:16.083397 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1540e0ff-2f85-47b3-bcbc-0e1cc16f93a3 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:16.098583 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1540e0ff-2f85-47b3-bcbc-0e1cc16f93a3 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:16.099253 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1540e0ff-2f85-47b3-bcbc-0e1cc16f93a3 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:16.099493 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1540e0ff-2f85-47b3-bcbc-0e1cc16f93a3 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:16.130279 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-1540e0ff-2f85-47b3-bcbc-0e1cc16f93a3 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lazy-loading 'flavor' on Instance uuid 7a118055-6c34-44a8-a30e-f5ff8bb66fba {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:13:16.147106 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1540e0ff-2f85-47b3-bcbc-0e1cc16f93a3 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] 10.222.0.50 "PUT /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba/tags/tempest-tag-1940644467" status: 201 len: 0 microversion: 2.26 time: 0.131239 Aug 31 16:13:16.153604 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2143/4489] 10.222.0.50 () {62 vars in 1380 bytes} [Wed Aug 31 16:13:16 2022] PUT /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba/tags/tempest-tag-1940644467 => generated 0 bytes in 136 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Aug 31 16:13:16.168101 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f221b83a-56f3-4b2b-858f-7c45a69c314d tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Calling method '.version_select at 0x7fbb4aa559d0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:16.186681 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f221b83a-56f3-4b2b-858f-7c45a69c314d tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:16.187383 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f221b83a-56f3-4b2b-858f-7c45a69c314d tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:16.187599 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f221b83a-56f3-4b2b-858f-7c45a69c314d tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:16.209333 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2460dd8d-3150-4bc6-ae82-269aa9da42bf tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:16.210031 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2460dd8d-3150-4bc6-ae82-269aa9da42bf tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 14167776-553f-4203-887b-3cb8e4cc0a2a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:16.218006 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2460dd8d-3150-4bc6-ae82-269aa9da42bf tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:16.218686 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2460dd8d-3150-4bc6-ae82-269aa9da42bf tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:16.219059 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2460dd8d-3150-4bc6-ae82-269aa9da42bf tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:16.219871 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2460dd8d-3150-4bc6-ae82-269aa9da42bf tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:16.220160 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f221b83a-56f3-4b2b-858f-7c45a69c314d tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] 10.222.0.50 "GET /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba/tags" status: 200 len: 36 microversion: 2.26 time: 0.062241 Aug 31 16:13:16.220332 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2460dd8d-3150-4bc6-ae82-269aa9da42bf tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:16.220838 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2460dd8d-3150-4bc6-ae82-269aa9da42bf tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:16.222062 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2347/4490] 10.222.0.50 () {60 vars in 1292 bytes} [Wed Aug 31 16:13:16 2022] GET /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba/tags => generated 36 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:16.244136 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-75841bc6-df01-4e0a-a32c-f7bd7dcda4dd tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Calling method '.version_select at 0x7fbb4aa55c10>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:16.258116 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-75841bc6-df01-4e0a-a32c-f7bd7dcda4dd tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:16.259670 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-75841bc6-df01-4e0a-a32c-f7bd7dcda4dd tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:16.260357 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-75841bc6-df01-4e0a-a32c-f7bd7dcda4dd tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:16.261334 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-75841bc6-df01-4e0a-a32c-f7bd7dcda4dd tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] [instance: 7a118055-6c34-44a8-a30e-f5ff8bb66fba] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:16.271628 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-75841bc6-df01-4e0a-a32c-f7bd7dcda4dd tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:16.272236 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-75841bc6-df01-4e0a-a32c-f7bd7dcda4dd tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:16.272788 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-75841bc6-df01-4e0a-a32c-f7bd7dcda4dd tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:16.273824 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-75841bc6-df01-4e0a-a32c-f7bd7dcda4dd tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:16.274392 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-75841bc6-df01-4e0a-a32c-f7bd7dcda4dd tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:16.275339 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-75841bc6-df01-4e0a-a32c-f7bd7dcda4dd tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:16.318578 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-75841bc6-df01-4e0a-a32c-f7bd7dcda4dd tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:16.319748 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-75841bc6-df01-4e0a-a32c-f7bd7dcda4dd tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:16.320497 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-75841bc6-df01-4e0a-a32c-f7bd7dcda4dd tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:16.357422 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-75841bc6-df01-4e0a-a32c-f7bd7dcda4dd tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lazy-loading 'flavor' on Instance uuid 7a118055-6c34-44a8-a30e-f5ff8bb66fba {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:13:16.374576 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-75841bc6-df01-4e0a-a32c-f7bd7dcda4dd tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] 10.222.0.50 "DELETE /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba/tags/tempest-tag-1940644467" status: 204 len: 0 microversion: 2.26 time: 0.145280 Aug 31 16:13:16.378150 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2348/4491] 10.222.0.50 () {60 vars in 1364 bytes} [Wed Aug 31 16:13:16 2022] DELETE /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba/tags/tempest-tag-1940644467 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 16:13:16.384869 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-27fcb869-b3c0-42d8-b064-a64cd027f4ff tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Calling method '.version_select at 0x7fbb46d5e4c0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:16.393406 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-27fcb869-b3c0-42d8-b064-a64cd027f4ff tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:16.394394 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-27fcb869-b3c0-42d8-b064-a64cd027f4ff tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:16.395023 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-27fcb869-b3c0-42d8-b064-a64cd027f4ff tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:16.405866 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-27fcb869-b3c0-42d8-b064-a64cd027f4ff tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] 10.222.0.50 "GET /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba/tags" status: 200 len: 12 microversion: 2.26 time: 0.026145 Aug 31 16:13:16.406934 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2349/4492] 10.222.0.50 () {60 vars in 1292 bytes} [Wed Aug 31 16:13:16 2022] GET /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba/tags => generated 12 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:13:16.412025 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-aca22597-df05-4f84-977f-41371d705ec7 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:16.412735 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-aca22597-df05-4f84-977f-41371d705ec7 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: af48d367-7828-47f9-a178-5d07cbaa26aa] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:16.419767 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aca22597-df05-4f84-977f-41371d705ec7 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:16.420538 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aca22597-df05-4f84-977f-41371d705ec7 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:16.421298 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aca22597-df05-4f84-977f-41371d705ec7 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:16.422310 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aca22597-df05-4f84-977f-41371d705ec7 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:16.422918 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aca22597-df05-4f84-977f-41371d705ec7 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:16.423491 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aca22597-df05-4f84-977f-41371d705ec7 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:16.451965 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2460dd8d-3150-4bc6-ae82-269aa9da42bf tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:16.474815 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2460dd8d-3150-4bc6-ae82-269aa9da42bf tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a" status: 200 len: 1501 microversion: 2.1 time: 0.272178 Aug 31 16:13:16.478163 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2144/4493] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:16 2022] GET /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a => generated 1501 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:13:16.481128 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4e1f2997-8ed0-4335-b848-ea31221a5999 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Calling method '.version_select at 0x7fbb4aba2dc0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:16.489515 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e1f2997-8ed0-4335-b848-ea31221a5999 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:16.489996 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e1f2997-8ed0-4335-b848-ea31221a5999 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:16.490462 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e1f2997-8ed0-4335-b848-ea31221a5999 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:16.491016 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4e1f2997-8ed0-4335-b848-ea31221a5999 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] [instance: 7a118055-6c34-44a8-a30e-f5ff8bb66fba] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:16.499606 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e1f2997-8ed0-4335-b848-ea31221a5999 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:16.500101 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e1f2997-8ed0-4335-b848-ea31221a5999 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:16.500892 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e1f2997-8ed0-4335-b848-ea31221a5999 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:16.501605 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e1f2997-8ed0-4335-b848-ea31221a5999 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:16.502064 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e1f2997-8ed0-4335-b848-ea31221a5999 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:16.502558 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e1f2997-8ed0-4335-b848-ea31221a5999 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:16.532686 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e1f2997-8ed0-4335-b848-ea31221a5999 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:16.533211 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e1f2997-8ed0-4335-b848-ea31221a5999 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:16.533658 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e1f2997-8ed0-4335-b848-ea31221a5999 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:16.545839 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-4e1f2997-8ed0-4335-b848-ea31221a5999 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lazy-loading 'flavor' on Instance uuid 7a118055-6c34-44a8-a30e-f5ff8bb66fba {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:13:16.570572 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4e1f2997-8ed0-4335-b848-ea31221a5999 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] 10.222.0.50 "DELETE /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba/tags" status: 204 len: 0 microversion: 2.26 time: 0.093401 Aug 31 16:13:16.579452 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2145/4494] 10.222.0.50 () {60 vars in 1295 bytes} [Wed Aug 31 16:13:16 2022] DELETE /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba/tags => generated 0 bytes in 103 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 16:13:16.587837 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b6ed3c7f-878a-453d-8331-52e1998a2a64 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b5d022b-6a4f-4c03-91d2-c410beaba2db"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:16.590375 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b6ed3c7f-878a-453d-8331-52e1998a2a64 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 14167776-553f-4203-887b-3cb8e4cc0a2a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:16.604065 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6ed3c7f-878a-453d-8331-52e1998a2a64 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:16.604731 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6ed3c7f-878a-453d-8331-52e1998a2a64 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:16.605186 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6ed3c7f-878a-453d-8331-52e1998a2a64 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:16.606234 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6ed3c7f-878a-453d-8331-52e1998a2a64 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:16.606702 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6ed3c7f-878a-453d-8331-52e1998a2a64 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:16.607229 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6ed3c7f-878a-453d-8331-52e1998a2a64 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:16.637881 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-b6ed3c7f-878a-453d-8331-52e1998a2a64 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] HTTP exception thrown: Cannot 'attach_volume' instance 14167776-553f-4203-887b-3cb8e4cc0a2a while it is in vm_state rescued Aug 31 16:13:16.640144 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b6ed3c7f-878a-453d-8331-52e1998a2a64 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Request method failure captured: Aug 31 16:13:16.640144 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a/os-volume_attachments HTTP/1.1 Aug 31 16:13:16.640144 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:13:16.640144 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:13:16.640144 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:13:16.640144 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 74 Aug 31 16:13:16.640144 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:13:16.640144 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:13:16.640144 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:13:16.640144 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:13:16.640144 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4gyS9s2L5B9hQNj6-3Bq9VaD0LX3rcaQEx2TULT5jAIwE_syzV3-H131XTbmJBlDQO8oVuY07kOMzEcgw7jqBoRJefg3cpTEEDA9_ABXOKuvCpOJqmPJLOqW4m5eFAB54B22EgPHkAmNh0-egef1rV97h7ELSV4bCzsJF6Z18KMZ5s Aug 31 16:13:16.640144 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:13:16.640144 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:13:16.640144 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:13:16.640144 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:13:16.640144 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:13:16.640144 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:13:16.640144 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: d25e1b1938b2401bab27dafadc9745d5 Aug 31 16:13:16.640144 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-961929748 Aug 31 16:13:16.640144 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:13:16.640144 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:13:16.640144 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d25e1b1938b2401bab27dafadc9745d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d25e1b1938b2401bab27dafadc9745d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d25e1b1938b2401bab27dafadc9745d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d25e1b1938b2401bab27dafadc9745d5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:13:16.640144 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServerRescueNegativeTestJSON-961929748 Aug 31 16:13:16.640144 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: d25e1b1938b2401bab27dafadc9745d5 Aug 31 16:13:16.640144 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-961929748 Aug 31 16:13:16.640144 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServerRescueNegativeTestJSON-961929748-project Aug 31 16:13:16.640144 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:13:16.640144 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:13:16.640144 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: b5f67b54e87c46d28e7d5217bf49ca57 Aug 31 16:13:16.640144 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServerRescueNegativeTestJSON-961929748-project Aug 31 16:13:16.640144 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 16:13:16.640144 n-d-833090-16 devstack@n-api.service[128863]: {"volumeAttachment": {"volumeId": "2b5d022b-6a4f-4c03-91d2-c410beaba2db"}} Aug 31 16:13:16.640144 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:13:16.640144 n-d-833090-16 devstack@n-api.service[128863]: exception: Cannot 'attach_volume' instance 14167776-553f-4203-887b-3cb8e4cc0a2a while it is in vm_state rescued Aug 31 16:13:16.640144 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'server_id': '14167776-553f-4203-887b-3cb8e4cc0a2a', 'body': {'volumeAttachment': {'volumeId': '2b5d022b-6a4f-4c03-91d2-c410beaba2db'}}} Aug 31 16:13:16.640144 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:13:16.640144 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:16.640144 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 16:13:16.640144 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 16:13:16.640144 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 16:13:16.640144 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 16:13:16.640144 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 16:13:16.640144 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 16:13:16.640144 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 14167776-553f-4203-887b-3cb8e4cc0a2a in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 31 16:13:16.640144 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:16.640144 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:16.640144 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:16.640144 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:16.640144 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:16.640144 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:16.640144 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:13:16.640144 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:13:16.640144 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:13:16.640144 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:13:16.640144 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:13:16.640144 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:13:16.640144 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:13:16.640144 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:13:16.640144 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:13:16.640144 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:13:16.640144 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 31 16:13:16.640144 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 16:13:16.644966 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 16:13:16.644966 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 16:13:16.644966 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 14167776-553f-4203-887b-3cb8e4cc0a2a while it is in vm_state rescued Aug 31 16:13:16.644966 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:16.644966 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:16.644966 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:16.644966 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:16.644966 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:16.644966 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:16.644966 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:13:16.644966 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:13:16.644966 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 14167776-553f-4203-887b-3cb8e4cc0a2a while it is in vm_state rescued Aug 31 16:13:16.644966 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:16.644966 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b6ed3c7f-878a-453d-8331-52e1998a2a64 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Returning 409 to user: Cannot 'attach_volume' instance 14167776-553f-4203-887b-3cb8e4cc0a2a while it is in vm_state rescued {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:13:16.644966 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b6ed3c7f-878a-453d-8331-52e1998a2a64 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "POST /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.061697 Aug 31 16:13:16.647104 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2146/4495] 10.222.0.50 () {60 vars in 1323 bytes} [Wed Aug 31 16:13:16 2022] POST /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a/os-volume_attachments => generated 152 bytes in 67 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 16:13:16.654412 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6c744c5b-d9a4-4bd3-a9eb-3c5776413171 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Calling method '.version_select at 0x7fbb45d11af0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:16.665673 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c744c5b-d9a4-4bd3-a9eb-3c5776413171 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:16.666213 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c744c5b-d9a4-4bd3-a9eb-3c5776413171 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:16.666647 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c744c5b-d9a4-4bd3-a9eb-3c5776413171 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:16.667337 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6c744c5b-d9a4-4bd3-a9eb-3c5776413171 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] [instance: 7a118055-6c34-44a8-a30e-f5ff8bb66fba] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:16.674125 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c744c5b-d9a4-4bd3-a9eb-3c5776413171 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:16.674618 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c744c5b-d9a4-4bd3-a9eb-3c5776413171 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:16.675347 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c744c5b-d9a4-4bd3-a9eb-3c5776413171 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:16.675739 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c744c5b-d9a4-4bd3-a9eb-3c5776413171 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:16.676313 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c744c5b-d9a4-4bd3-a9eb-3c5776413171 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:16.676741 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c744c5b-d9a4-4bd3-a9eb-3c5776413171 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:16.684714 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-aca22597-df05-4f84-977f-41371d705ec7 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:16.687232 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:13:16.702009 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-aca22597-df05-4f84-977f-41371d705ec7 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/af48d367-7828-47f9-a178-5d07cbaa26aa" status: 200 len: 1513 microversion: 2.1 time: 0.293669 Aug 31 16:13:16.702864 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2350/4496] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:16 2022] GET /compute/v2.1/servers/af48d367-7828-47f9-a178-5d07cbaa26aa => generated 1513 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:16.723023 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e92e7870-654a-4f9f-b7ef-3d7891544ffc tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:16.723831 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e92e7870-654a-4f9f-b7ef-3d7891544ffc tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 14167776-553f-4203-887b-3cb8e4cc0a2a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:16.731763 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e92e7870-654a-4f9f-b7ef-3d7891544ffc tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:16.732621 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e92e7870-654a-4f9f-b7ef-3d7891544ffc tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:16.733589 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e92e7870-654a-4f9f-b7ef-3d7891544ffc tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:16.734716 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e92e7870-654a-4f9f-b7ef-3d7891544ffc tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:16.735360 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e92e7870-654a-4f9f-b7ef-3d7891544ffc tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:16.736098 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e92e7870-654a-4f9f-b7ef-3d7891544ffc tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:16.745751 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c744c5b-d9a4-4bd3-a9eb-3c5776413171 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:16.746450 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c744c5b-d9a4-4bd3-a9eb-3c5776413171 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:16.746969 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c744c5b-d9a4-4bd3-a9eb-3c5776413171 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:16.780549 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c744c5b-d9a4-4bd3-a9eb-3c5776413171 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:16.781260 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c744c5b-d9a4-4bd3-a9eb-3c5776413171 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:16.781955 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c744c5b-d9a4-4bd3-a9eb-3c5776413171 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:16.826212 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e92e7870-654a-4f9f-b7ef-3d7891544ffc tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "POST /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a/action" status: 202 len: 0 microversion: 2.1 time: 0.109089 Aug 31 16:13:16.830514 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2351/4497] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:13:16 2022] POST /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:13:16.841731 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fd02f150-650d-4115-ae72-2208165218d5 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:16.842482 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fd02f150-650d-4115-ae72-2208165218d5 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] [instance: 98beddf9-f152-4a63-98ac-fc3a9a1c9b63] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:16.845777 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-6c744c5b-d9a4-4bd3-a9eb-3c5776413171 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lazy-loading 'flavor' on Instance uuid 7a118055-6c34-44a8-a30e-f5ff8bb66fba {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:13:16.856951 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fd02f150-650d-4115-ae72-2208165218d5 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:16.857691 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fd02f150-650d-4115-ae72-2208165218d5 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:16.859179 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fd02f150-650d-4115-ae72-2208165218d5 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:16.860419 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fd02f150-650d-4115-ae72-2208165218d5 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:16.861069 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fd02f150-650d-4115-ae72-2208165218d5 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:16.861776 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fd02f150-650d-4115-ae72-2208165218d5 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:16.875457 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6c744c5b-d9a4-4bd3-a9eb-3c5776413171 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] 10.222.0.50 "PUT /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba/tags/tempest-tag-713341785" status: 201 len: 0 microversion: 2.26 time: 0.224595 Aug 31 16:13:16.876630 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2147/4498] 10.222.0.50 () {62 vars in 1377 bytes} [Wed Aug 31 16:13:16 2022] PUT /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba/tags/tempest-tag-713341785 => generated 0 bytes in 229 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 31 16:13:16.886846 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f20f56d3-ba56-41a8-82ad-93a42cfcfcbc tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:16.899016 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f20f56d3-ba56-41a8-82ad-93a42cfcfcbc tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] [instance: bfb43b5d-9803-4760-8f51-f3bb651636a3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:16.906196 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f20f56d3-ba56-41a8-82ad-93a42cfcfcbc tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:16.906196 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f20f56d3-ba56-41a8-82ad-93a42cfcfcbc tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:16.906561 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f20f56d3-ba56-41a8-82ad-93a42cfcfcbc tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:16.907275 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f20f56d3-ba56-41a8-82ad-93a42cfcfcbc tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:16.907794 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f20f56d3-ba56-41a8-82ad-93a42cfcfcbc tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:16.908226 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f20f56d3-ba56-41a8-82ad-93a42cfcfcbc tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:17.227694 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-fd02f150-650d-4115-ae72-2208165218d5 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7fa51caf47428fb0e89e2050b64211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c66bcd5e83f4ea89afa84ff947a36e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:17.244863 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fd02f150-650d-4115-ae72-2208165218d5 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] 10.222.0.50 "GET /compute/v2.1/servers/98beddf9-f152-4a63-98ac-fc3a9a1c9b63" status: 200 len: 1464 microversion: 2.1 time: 0.412414 Aug 31 16:13:17.246653 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2352/4499] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:16 2022] GET /compute/v2.1/servers/98beddf9-f152-4a63-98ac-fc3a9a1c9b63 => generated 1464 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:17.271943 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-98682aa3-cd36-47f2-ac75-c979001264bd tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:17.272823 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-98682aa3-cd36-47f2-ac75-c979001264bd tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 14167776-553f-4203-887b-3cb8e4cc0a2a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:17.274020 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f20f56d3-ba56-41a8-82ad-93a42cfcfcbc tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5bf48d039ca4ce489212ef340ddb5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7647e0ee82f148c6a4c138842d8fbf69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:17.281708 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-98682aa3-cd36-47f2-ac75-c979001264bd tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:17.282573 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-98682aa3-cd36-47f2-ac75-c979001264bd tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:17.283251 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-98682aa3-cd36-47f2-ac75-c979001264bd tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:17.286674 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f20f56d3-ba56-41a8-82ad-93a42cfcfcbc tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] 10.222.0.50 "GET /compute/v2.1/servers/bfb43b5d-9803-4760-8f51-f3bb651636a3" status: 200 len: 1323 microversion: 2.1 time: 0.403242 Aug 31 16:13:17.298117 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2148/4500] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:16 2022] GET /compute/v2.1/servers/bfb43b5d-9803-4760-8f51-f3bb651636a3 => generated 1323 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:17.298117 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0753daec-6244-4684-a525-66589bb16713 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Calling method '.version_select at 0x7fbb466bbca0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:17.305048 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0753daec-6244-4684-a525-66589bb16713 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:17.305405 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0753daec-6244-4684-a525-66589bb16713 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:17.305837 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0753daec-6244-4684-a525-66589bb16713 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:17.306629 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0753daec-6244-4684-a525-66589bb16713 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] [instance: 7a118055-6c34-44a8-a30e-f5ff8bb66fba] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:17.308390 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-98682aa3-cd36-47f2-ac75-c979001264bd tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:17.310064 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-98682aa3-cd36-47f2-ac75-c979001264bd tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:17.311217 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-98682aa3-cd36-47f2-ac75-c979001264bd tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:17.313181 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:13:17.316317 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0753daec-6244-4684-a525-66589bb16713 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:17.316317 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0753daec-6244-4684-a525-66589bb16713 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:17.317789 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0753daec-6244-4684-a525-66589bb16713 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:17.318693 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0753daec-6244-4684-a525-66589bb16713 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:17.319154 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0753daec-6244-4684-a525-66589bb16713 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:17.319578 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0753daec-6244-4684-a525-66589bb16713 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:17.363986 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0753daec-6244-4684-a525-66589bb16713 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:17.364707 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0753daec-6244-4684-a525-66589bb16713 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:17.365302 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0753daec-6244-4684-a525-66589bb16713 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:17.377044 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0753daec-6244-4684-a525-66589bb16713 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:17.377831 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0753daec-6244-4684-a525-66589bb16713 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:17.378714 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0753daec-6244-4684-a525-66589bb16713 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:17.391645 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:13:17.414228 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-0753daec-6244-4684-a525-66589bb16713 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lazy-loading 'flavor' on Instance uuid 7a118055-6c34-44a8-a30e-f5ff8bb66fba {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:13:17.431432 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0753daec-6244-4684-a525-66589bb16713 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] 10.222.0.50 "PUT /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba/tags/tempest-tag-74145585" status: 201 len: 0 microversion: 2.26 time: 0.142412 Aug 31 16:13:17.437074 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2149/4501] 10.222.0.50 () {62 vars in 1374 bytes} [Wed Aug 31 16:13:17 2022] PUT /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba/tags/tempest-tag-74145585 => generated 0 bytes in 144 msecs (HTTP/1.1 201) 10 headers in 484 bytes (1 switches on core 0) Aug 31 16:13:17.438133 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-24e7192f-4dfd-4086-944e-bd06c6bcc87f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:17.438749 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-24e7192f-4dfd-4086-944e-bd06c6bcc87f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 33170fbc-0d84-4284-9f70-dedb91f0d295] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:17.445844 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-24e7192f-4dfd-4086-944e-bd06c6bcc87f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:17.446363 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-24e7192f-4dfd-4086-944e-bd06c6bcc87f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:17.446799 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-24e7192f-4dfd-4086-944e-bd06c6bcc87f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:17.447491 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-24e7192f-4dfd-4086-944e-bd06c6bcc87f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:17.448101 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-24e7192f-4dfd-4086-944e-bd06c6bcc87f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:17.449071 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-24e7192f-4dfd-4086-944e-bd06c6bcc87f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:17.600644 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-98682aa3-cd36-47f2-ac75-c979001264bd tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:17.610761 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-98682aa3-cd36-47f2-ac75-c979001264bd tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a" status: 200 len: 1509 microversion: 2.1 time: 0.362601 Aug 31 16:13:17.622585 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2353/4502] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:17 2022] GET /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a => generated 1509 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:17.622585 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-a19c2a4c-95e5-4b22-9cb9-3ddd27b05efe req-34e93e61-5855-4749-af1c-9fe3758d631a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33170fbc-0d84-4284-9f70-dedb91f0d295", "name": "network-vif-plugged", "status": "completed", "tag": "5ed6e8f2-f1f7-413d-84bb-c5271687ea60"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:17.645261 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-a19c2a4c-95e5-4b22-9cb9-3ddd27b05efe req-34e93e61-5855-4749-af1c-9fe3758d631a service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:17.645750 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-a19c2a4c-95e5-4b22-9cb9-3ddd27b05efe req-34e93e61-5855-4749-af1c-9fe3758d631a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:17.646210 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-a19c2a4c-95e5-4b22-9cb9-3ddd27b05efe req-34e93e61-5855-4749-af1c-9fe3758d631a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:17.660504 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-a19c2a4c-95e5-4b22-9cb9-3ddd27b05efe req-34e93e61-5855-4749-af1c-9fe3758d631a service nova] Creating event network-vif-plugged:5ed6e8f2-f1f7-413d-84bb-c5271687ea60 for instance 33170fbc-0d84-4284-9f70-dedb91f0d295 on n-h1-833090-16 Aug 31 16:13:17.666021 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-a19c2a4c-95e5-4b22-9cb9-3ddd27b05efe req-34e93e61-5855-4749-af1c-9fe3758d631a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052828 Aug 31 16:13:17.667238 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2354/4503] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:17.708494 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-24e7192f-4dfd-4086-944e-bd06c6bcc87f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:17.718080 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-24e7192f-4dfd-4086-944e-bd06c6bcc87f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/33170fbc-0d84-4284-9f70-dedb91f0d295" status: 200 len: 1308 microversion: 2.1 time: 0.283964 Aug 31 16:13:17.726874 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2150/4504] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:17 2022] GET /compute/v2.1/servers/33170fbc-0d84-4284-9f70-dedb91f0d295 => generated 1308 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:17.745310 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1ffbd8a1-b0b8-4875-91c8-98087e049c9e tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Calling method '.version_select at 0x7fbb4abc3820>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:17.755686 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ffbd8a1-b0b8-4875-91c8-98087e049c9e tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:17.759419 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ffbd8a1-b0b8-4875-91c8-98087e049c9e tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:17.760039 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ffbd8a1-b0b8-4875-91c8-98087e049c9e tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:17.760747 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1ffbd8a1-b0b8-4875-91c8-98087e049c9e tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] [instance: 7a118055-6c34-44a8-a30e-f5ff8bb66fba] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:17.774629 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ffbd8a1-b0b8-4875-91c8-98087e049c9e tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:17.775135 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ffbd8a1-b0b8-4875-91c8-98087e049c9e tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:17.775553 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ffbd8a1-b0b8-4875-91c8-98087e049c9e tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:17.776293 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ffbd8a1-b0b8-4875-91c8-98087e049c9e tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:17.778878 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ffbd8a1-b0b8-4875-91c8-98087e049c9e tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:17.780620 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ffbd8a1-b0b8-4875-91c8-98087e049c9e tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:17.829534 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ffbd8a1-b0b8-4875-91c8-98087e049c9e tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:17.830448 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ffbd8a1-b0b8-4875-91c8-98087e049c9e tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:17.831680 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ffbd8a1-b0b8-4875-91c8-98087e049c9e tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:17.857563 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-1ffbd8a1-b0b8-4875-91c8-98087e049c9e tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lazy-loading 'flavor' on Instance uuid 7a118055-6c34-44a8-a30e-f5ff8bb66fba {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:13:17.860629 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e6be8b21-a107-4ffc-bd50-d245ad2e4abe tempest-TenantUsagesTestJSON-166202786 tempest-TenantUsagesTestJSON-166202786-project-admin] Calling method '.version_select at 0x7fbb4ac20a60>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:17.879470 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6be8b21-a107-4ffc-bd50-d245ad2e4abe tempest-TenantUsagesTestJSON-166202786 tempest-TenantUsagesTestJSON-166202786-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:17.879986 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6be8b21-a107-4ffc-bd50-d245ad2e4abe tempest-TenantUsagesTestJSON-166202786 tempest-TenantUsagesTestJSON-166202786-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:17.880424 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6be8b21-a107-4ffc-bd50-d245ad2e4abe tempest-TenantUsagesTestJSON-166202786 tempest-TenantUsagesTestJSON-166202786-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:17.881598 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1ffbd8a1-b0b8-4875-91c8-98087e049c9e tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] 10.222.0.50 "DELETE /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba/tags" status: 204 len: 0 microversion: 2.26 time: 0.153416 Aug 31 16:13:17.883748 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2151/4505] 10.222.0.50 () {60 vars in 1295 bytes} [Wed Aug 31 16:13:17 2022] DELETE /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba/tags => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 16:13:17.890406 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-1d33d673-da26-4e00-be0a-009965484dc0 req-025c98a0-9fac-4ae9-b9af-d5281f515c8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfb43b5d-9803-4760-8f51-f3bb651636a3", "tag": "a0afdea8-7072-4a93-bc57-51f913c8f67f"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:17.904152 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-1d33d673-da26-4e00-be0a-009965484dc0 req-025c98a0-9fac-4ae9-b9af-d5281f515c8f service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:17.905025 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-1d33d673-da26-4e00-be0a-009965484dc0 req-025c98a0-9fac-4ae9-b9af-d5281f515c8f service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:17.905680 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-1d33d673-da26-4e00-be0a-009965484dc0 req-025c98a0-9fac-4ae9-b9af-d5281f515c8f service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:17.942471 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-1d33d673-da26-4e00-be0a-009965484dc0 req-025c98a0-9fac-4ae9-b9af-d5281f515c8f service nova] Creating event network-changed:a0afdea8-7072-4a93-bc57-51f913c8f67f for instance bfb43b5d-9803-4760-8f51-f3bb651636a3 on n-h1-833090-16 Aug 31 16:13:17.955525 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6be8b21-a107-4ffc-bd50-d245ad2e4abe tempest-TenantUsagesTestJSON-166202786 tempest-TenantUsagesTestJSON-166202786-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:17.957401 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-1d33d673-da26-4e00-be0a-009965484dc0 req-025c98a0-9fac-4ae9-b9af-d5281f515c8f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072111 Aug 31 16:13:17.958391 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2152/4506] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:17.963446 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6be8b21-a107-4ffc-bd50-d245ad2e4abe tempest-TenantUsagesTestJSON-166202786 tempest-TenantUsagesTestJSON-166202786-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:17.964087 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6be8b21-a107-4ffc-bd50-d245ad2e4abe tempest-TenantUsagesTestJSON-166202786 tempest-TenantUsagesTestJSON-166202786-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:17.971037 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-840e9cf8-e57b-4ab5-bd69-cb547d05cc38 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:17.971865 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-840e9cf8-e57b-4ab5-bd69-cb547d05cc38 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: af48d367-7828-47f9-a178-5d07cbaa26aa] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:17.985687 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-840e9cf8-e57b-4ab5-bd69-cb547d05cc38 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:17.986217 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-840e9cf8-e57b-4ab5-bd69-cb547d05cc38 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:17.986649 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-840e9cf8-e57b-4ab5-bd69-cb547d05cc38 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:17.987354 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-840e9cf8-e57b-4ab5-bd69-cb547d05cc38 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:17.987814 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-840e9cf8-e57b-4ab5-bd69-cb547d05cc38 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:17.990481 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-840e9cf8-e57b-4ab5-bd69-cb547d05cc38 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:18.006246 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e6be8b21-a107-4ffc-bd50-d245ad2e4abe tempest-TenantUsagesTestJSON-166202786 tempest-TenantUsagesTestJSON-166202786-project-admin] 10.222.0.50 "GET /compute/v2.1/os-simple-tenant-usage/1c66bcd5e83f4ea89afa84ff947a36e6?start=2022-08-30T16%3A13%3A17.261198&end=2022-09-01T16%3A13%3A17.261198" status: 200 len: 695 microversion: 2.1 time: 0.337066 Aug 31 16:13:18.017567 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2355/4507] 10.222.0.50 () {58 vars in 1412 bytes} [Wed Aug 31 16:13:17 2022] GET /compute/v2.1/os-simple-tenant-usage/1c66bcd5e83f4ea89afa84ff947a36e6?start=2022-08-30T16%3A13%3A17.261198&end=2022-09-01T16%3A13%3A17.261198 => generated 695 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:18.041133 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e1708e56-3fa9-4ed2-b43a-bdc577d227ac tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Calling method '.version_select at 0x7fbb46f67790>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:18.057922 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e1708e56-3fa9-4ed2-b43a-bdc577d227ac tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:18.058661 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e1708e56-3fa9-4ed2-b43a-bdc577d227ac tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:18.058928 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e1708e56-3fa9-4ed2-b43a-bdc577d227ac tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:18.090310 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e1708e56-3fa9-4ed2-b43a-bdc577d227ac tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] 10.222.0.50 "GET /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba/tags" status: 200 len: 12 microversion: 2.26 time: 0.069931 Aug 31 16:13:18.095527 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2356/4508] 10.222.0.50 () {60 vars in 1292 bytes} [Wed Aug 31 16:13:18 2022] GET /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba/tags => generated 12 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:18.096408 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1d7b8190-3053-4318-992a-939ba648bec1 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Calling method '.version_select at 0x7fbb468571f0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:18.108259 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1d7b8190-3053-4318-992a-939ba648bec1 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:18.108747 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1d7b8190-3053-4318-992a-939ba648bec1 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:18.109181 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1d7b8190-3053-4318-992a-939ba648bec1 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:18.119639 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1d7b8190-3053-4318-992a-939ba648bec1 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:18.120249 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1d7b8190-3053-4318-992a-939ba648bec1 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:18.120687 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1d7b8190-3053-4318-992a-939ba648bec1 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:18.134183 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1d7b8190-3053-4318-992a-939ba648bec1 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] 10.222.0.50 "GET /compute/v2.1/os-simple-tenant-usage/1c66bcd5e83f4ea89afa84ff947a36e6?start=2022-08-30T16%3A13%3A17.261198&end=2022-09-01T16%3A13%3A17.261198" status: 200 len: 691 microversion: 2.1 time: 0.041730 Aug 31 16:13:18.134869 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2357/4509] 10.222.0.50 () {58 vars in 1412 bytes} [Wed Aug 31 16:13:18 2022] GET /compute/v2.1/os-simple-tenant-usage/1c66bcd5e83f4ea89afa84ff947a36e6?start=2022-08-30T16%3A13%3A17.261198&end=2022-09-01T16%3A13%3A17.261198 => generated 691 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:18.150520 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-089aa190-7ff6-4f0e-9b85-ec182ce4a5b7 req-59ffcd87-b576-4aff-8863-edb924ccde9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af48d367-7828-47f9-a178-5d07cbaa26aa", "name": "network-vif-deleted", "tag": "3ff745c5-d339-4662-81f3-e0daa3e66a8f"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:18.164995 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-089aa190-7ff6-4f0e-9b85-ec182ce4a5b7 req-59ffcd87-b576-4aff-8863-edb924ccde9f service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:18.165383 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-089aa190-7ff6-4f0e-9b85-ec182ce4a5b7 req-59ffcd87-b576-4aff-8863-edb924ccde9f service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:18.165878 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-089aa190-7ff6-4f0e-9b85-ec182ce4a5b7 req-59ffcd87-b576-4aff-8863-edb924ccde9f service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:18.177687 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-089aa190-7ff6-4f0e-9b85-ec182ce4a5b7 req-59ffcd87-b576-4aff-8863-edb924ccde9f service nova] Creating event network-vif-deleted:3ff745c5-d339-4662-81f3-e0daa3e66a8f for instance af48d367-7828-47f9-a178-5d07cbaa26aa on n-h2-833090-16 Aug 31 16:13:18.182611 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-089aa190-7ff6-4f0e-9b85-ec182ce4a5b7 req-59ffcd87-b576-4aff-8863-edb924ccde9f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035962 Aug 31 16:13:18.183881 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2358/4510] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:18.189594 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-11cf660b-0fa5-427f-81b8-08ed5b30e444 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Calling method '.version_select at 0x7fbb46994dc0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:18.197944 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11cf660b-0fa5-427f-81b8-08ed5b30e444 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:18.198608 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11cf660b-0fa5-427f-81b8-08ed5b30e444 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:18.199098 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11cf660b-0fa5-427f-81b8-08ed5b30e444 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:18.199713 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-11cf660b-0fa5-427f-81b8-08ed5b30e444 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] [instance: 7a118055-6c34-44a8-a30e-f5ff8bb66fba] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:18.205532 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11cf660b-0fa5-427f-81b8-08ed5b30e444 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:18.206004 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11cf660b-0fa5-427f-81b8-08ed5b30e444 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:18.206464 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11cf660b-0fa5-427f-81b8-08ed5b30e444 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:18.207153 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11cf660b-0fa5-427f-81b8-08ed5b30e444 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:18.207599 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11cf660b-0fa5-427f-81b8-08ed5b30e444 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:18.208018 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11cf660b-0fa5-427f-81b8-08ed5b30e444 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:18.223024 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-840e9cf8-e57b-4ab5-bd69-cb547d05cc38 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:18.238972 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11cf660b-0fa5-427f-81b8-08ed5b30e444 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:18.239627 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11cf660b-0fa5-427f-81b8-08ed5b30e444 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:18.239947 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11cf660b-0fa5-427f-81b8-08ed5b30e444 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:18.241458 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-840e9cf8-e57b-4ab5-bd69-cb547d05cc38 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/af48d367-7828-47f9-a178-5d07cbaa26aa" status: 200 len: 1471 microversion: 2.1 time: 0.281510 Aug 31 16:13:18.255696 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-11cf660b-0fa5-427f-81b8-08ed5b30e444 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lazy-loading 'flavor' on Instance uuid 7a118055-6c34-44a8-a30e-f5ff8bb66fba {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:13:18.257908 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2153/4511] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:17 2022] GET /compute/v2.1/servers/af48d367-7828-47f9-a178-5d07cbaa26aa => generated 1471 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:18.268796 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-34ccb5f5-a9e7-478d-ae68-e8348de6c0c3 tempest-TenantUsagesTestJSON-166202786 tempest-TenantUsagesTestJSON-166202786-project-admin] Calling method '.version_select at 0x7fbb4ac30820>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:18.273891 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-11cf660b-0fa5-427f-81b8-08ed5b30e444 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] 10.222.0.50 "DELETE /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba/tags" status: 204 len: 0 microversion: 2.26 time: 0.088758 Aug 31 16:13:18.275131 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2359/4512] 10.222.0.50 () {60 vars in 1295 bytes} [Wed Aug 31 16:13:18 2022] DELETE /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba/tags => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 16:13:18.282142 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-34ccb5f5-a9e7-478d-ae68-e8348de6c0c3 tempest-TenantUsagesTestJSON-166202786 tempest-TenantUsagesTestJSON-166202786-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:18.283158 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-34ccb5f5-a9e7-478d-ae68-e8348de6c0c3 tempest-TenantUsagesTestJSON-166202786 tempest-TenantUsagesTestJSON-166202786-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:18.283757 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-34ccb5f5-a9e7-478d-ae68-e8348de6c0c3 tempest-TenantUsagesTestJSON-166202786 tempest-TenantUsagesTestJSON-166202786-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:18.288850 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-49341b07-2b58-4387-ac55-9bb10f10f50b tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Calling method '.version_select at 0x7fbb46fe4d30>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:18.300040 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-49341b07-2b58-4387-ac55-9bb10f10f50b tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:18.300719 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-49341b07-2b58-4387-ac55-9bb10f10f50b tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:18.301249 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-49341b07-2b58-4387-ac55-9bb10f10f50b tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:18.301817 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-49341b07-2b58-4387-ac55-9bb10f10f50b tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] [instance: 7a118055-6c34-44a8-a30e-f5ff8bb66fba] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:18.304041 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-34ccb5f5-a9e7-478d-ae68-e8348de6c0c3 tempest-TenantUsagesTestJSON-166202786 tempest-TenantUsagesTestJSON-166202786-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:18.304762 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-34ccb5f5-a9e7-478d-ae68-e8348de6c0c3 tempest-TenantUsagesTestJSON-166202786 tempest-TenantUsagesTestJSON-166202786-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:18.305229 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-34ccb5f5-a9e7-478d-ae68-e8348de6c0c3 tempest-TenantUsagesTestJSON-166202786 tempest-TenantUsagesTestJSON-166202786-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:18.310069 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-49341b07-2b58-4387-ac55-9bb10f10f50b tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:18.311217 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-49341b07-2b58-4387-ac55-9bb10f10f50b tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:18.311403 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-49341b07-2b58-4387-ac55-9bb10f10f50b tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:18.312270 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-49341b07-2b58-4387-ac55-9bb10f10f50b tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:18.312724 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-49341b07-2b58-4387-ac55-9bb10f10f50b tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:18.313141 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-49341b07-2b58-4387-ac55-9bb10f10f50b tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:18.345086 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-49341b07-2b58-4387-ac55-9bb10f10f50b tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:18.345584 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-49341b07-2b58-4387-ac55-9bb10f10f50b tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:18.346020 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-49341b07-2b58-4387-ac55-9bb10f10f50b tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:18.357535 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-49341b07-2b58-4387-ac55-9bb10f10f50b tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:18.358373 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-49341b07-2b58-4387-ac55-9bb10f10f50b tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:18.358708 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-49341b07-2b58-4387-ac55-9bb10f10f50b tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:18.389605 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-49341b07-2b58-4387-ac55-9bb10f10f50b tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lazy-loading 'flavor' on Instance uuid 7a118055-6c34-44a8-a30e-f5ff8bb66fba {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:13:18.408742 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-49341b07-2b58-4387-ac55-9bb10f10f50b tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] 10.222.0.50 "PUT /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba/tags/tempest-tag-1218106457" status: 201 len: 0 microversion: 2.26 time: 0.124497 Aug 31 16:13:18.409738 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2360/4513] 10.222.0.50 () {62 vars in 1380 bytes} [Wed Aug 31 16:13:18 2022] PUT /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba/tags/tempest-tag-1218106457 => generated 0 bytes in 126 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 31 16:13:18.419934 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8fac6458-c820-4b66-a503-fb852379a3ac tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:18.420650 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8fac6458-c820-4b66-a503-fb852379a3ac tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] [instance: bfb43b5d-9803-4760-8f51-f3bb651636a3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:18.428002 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8fac6458-c820-4b66-a503-fb852379a3ac tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:18.428666 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8fac6458-c820-4b66-a503-fb852379a3ac tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:18.429111 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8fac6458-c820-4b66-a503-fb852379a3ac tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:18.430001 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8fac6458-c820-4b66-a503-fb852379a3ac tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:18.430469 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8fac6458-c820-4b66-a503-fb852379a3ac tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:18.431098 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8fac6458-c820-4b66-a503-fb852379a3ac tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:18.513301 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-34ccb5f5-a9e7-478d-ae68-e8348de6c0c3 tempest-TenantUsagesTestJSON-166202786 tempest-TenantUsagesTestJSON-166202786-project-admin] 10.222.0.50 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-30T16%3A13%3A17.261198&end=2022-09-01T16%3A13%3A17.261198&detailed=1" status: 200 len: 53919 microversion: 2.1 time: 0.253835 Aug 31 16:13:18.513971 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2154/4514] 10.222.0.50 () {58 vars in 1335 bytes} [Wed Aug 31 16:13:18 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-30T16%3A13%3A17.261198&end=2022-09-01T16%3A13%3A17.261198&detailed=1 => generated 53919 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:13:18.527105 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a13e2d0c-977a-452f-a65c-f6ad3857d4f2 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Calling method '.version_select at 0x7fbb4ac47a60>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:18.534946 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a13e2d0c-977a-452f-a65c-f6ad3857d4f2 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:18.535221 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a13e2d0c-977a-452f-a65c-f6ad3857d4f2 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:18.535919 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a13e2d0c-977a-452f-a65c-f6ad3857d4f2 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:18.536704 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a13e2d0c-977a-452f-a65c-f6ad3857d4f2 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] [instance: 7a118055-6c34-44a8-a30e-f5ff8bb66fba] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:18.551642 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a13e2d0c-977a-452f-a65c-f6ad3857d4f2 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:18.552130 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a13e2d0c-977a-452f-a65c-f6ad3857d4f2 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:18.552622 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a13e2d0c-977a-452f-a65c-f6ad3857d4f2 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:18.553332 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a13e2d0c-977a-452f-a65c-f6ad3857d4f2 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:18.553874 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a13e2d0c-977a-452f-a65c-f6ad3857d4f2 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:18.554529 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a13e2d0c-977a-452f-a65c-f6ad3857d4f2 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:18.589693 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a13e2d0c-977a-452f-a65c-f6ad3857d4f2 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:18.590206 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a13e2d0c-977a-452f-a65c-f6ad3857d4f2 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:18.590638 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a13e2d0c-977a-452f-a65c-f6ad3857d4f2 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:18.599817 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a13e2d0c-977a-452f-a65c-f6ad3857d4f2 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:18.600231 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a13e2d0c-977a-452f-a65c-f6ad3857d4f2 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:18.600646 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a13e2d0c-977a-452f-a65c-f6ad3857d4f2 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:18.632016 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-a13e2d0c-977a-452f-a65c-f6ad3857d4f2 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lazy-loading 'flavor' on Instance uuid 7a118055-6c34-44a8-a30e-f5ff8bb66fba {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:13:18.649421 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a13e2d0c-977a-452f-a65c-f6ad3857d4f2 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] 10.222.0.50 "PUT /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba/tags/tempest-tag-1354008080" status: 201 len: 0 microversion: 2.26 time: 0.134373 Aug 31 16:13:18.650590 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2155/4515] 10.222.0.50 () {62 vars in 1380 bytes} [Wed Aug 31 16:13:18 2022] PUT /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba/tags/tempest-tag-1354008080 => generated 0 bytes in 136 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 31 16:13:18.656815 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d96c5fdd-0a29-420f-a7af-45e9bc688a2e tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:18.657305 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d96c5fdd-0a29-420f-a7af-45e9bc688a2e tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] [instance: 98beddf9-f152-4a63-98ac-fc3a9a1c9b63] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:18.663867 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d96c5fdd-0a29-420f-a7af-45e9bc688a2e tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:18.664578 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d96c5fdd-0a29-420f-a7af-45e9bc688a2e tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:18.665206 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d96c5fdd-0a29-420f-a7af-45e9bc688a2e tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:18.665874 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d96c5fdd-0a29-420f-a7af-45e9bc688a2e tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:18.666541 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d96c5fdd-0a29-420f-a7af-45e9bc688a2e tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:18.667504 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d96c5fdd-0a29-420f-a7af-45e9bc688a2e tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:18.697355 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d96c5fdd-0a29-420f-a7af-45e9bc688a2e tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] [instance: 98beddf9-f152-4a63-98ac-fc3a9a1c9b63] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:13:18.705803 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8fac6458-c820-4b66-a503-fb852379a3ac tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5bf48d039ca4ce489212ef340ddb5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7647e0ee82f148c6a4c138842d8fbf69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:18.719046 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8fac6458-c820-4b66-a503-fb852379a3ac tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] 10.222.0.50 "GET /compute/v2.1/servers/bfb43b5d-9803-4760-8f51-f3bb651636a3" status: 200 len: 1323 microversion: 2.1 time: 0.303520 Aug 31 16:13:18.719979 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2361/4516] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:18 2022] GET /compute/v2.1/servers/bfb43b5d-9803-4760-8f51-f3bb651636a3 => generated 1323 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:18.725425 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-777d9774-730a-4447-98e2-a5102118f4d3 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:18.726281 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-777d9774-730a-4447-98e2-a5102118f4d3 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 14167776-553f-4203-887b-3cb8e4cc0a2a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:18.734110 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-777d9774-730a-4447-98e2-a5102118f4d3 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:18.734733 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-777d9774-730a-4447-98e2-a5102118f4d3 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:18.735288 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-777d9774-730a-4447-98e2-a5102118f4d3 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:18.736093 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-777d9774-730a-4447-98e2-a5102118f4d3 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:18.736699 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-777d9774-730a-4447-98e2-a5102118f4d3 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:18.737362 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-777d9774-730a-4447-98e2-a5102118f4d3 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:18.790613 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d96c5fdd-0a29-420f-a7af-45e9bc688a2e tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] 10.222.0.50 "DELETE /compute/v2.1/servers/98beddf9-f152-4a63-98ac-fc3a9a1c9b63" status: 204 len: 0 microversion: 2.1 time: 0.138439 Aug 31 16:13:18.792190 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2156/4517] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:13:18 2022] DELETE /compute/v2.1/servers/98beddf9-f152-4a63-98ac-fc3a9a1c9b63 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:13:18.798238 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bf2500dd-2a6d-4f02-8580-e5793007f2e7 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Action: 'update_all', calling method: .version_select at 0x7fbb4ac348b0>, body: {"tags": ["tempest-tag-662322950", "tempest-tag-901088577"]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:18.811891 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf2500dd-2a6d-4f02-8580-e5793007f2e7 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:18.812652 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf2500dd-2a6d-4f02-8580-e5793007f2e7 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:18.813894 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf2500dd-2a6d-4f02-8580-e5793007f2e7 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:18.814697 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bf2500dd-2a6d-4f02-8580-e5793007f2e7 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] [instance: 7a118055-6c34-44a8-a30e-f5ff8bb66fba] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:18.820928 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf2500dd-2a6d-4f02-8580-e5793007f2e7 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:18.821605 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf2500dd-2a6d-4f02-8580-e5793007f2e7 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:18.822423 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf2500dd-2a6d-4f02-8580-e5793007f2e7 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:18.823296 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf2500dd-2a6d-4f02-8580-e5793007f2e7 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:18.824179 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf2500dd-2a6d-4f02-8580-e5793007f2e7 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:18.824603 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf2500dd-2a6d-4f02-8580-e5793007f2e7 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:18.852219 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf2500dd-2a6d-4f02-8580-e5793007f2e7 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:18.852219 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf2500dd-2a6d-4f02-8580-e5793007f2e7 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:18.852432 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf2500dd-2a6d-4f02-8580-e5793007f2e7 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:18.876462 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-bf2500dd-2a6d-4f02-8580-e5793007f2e7 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lazy-loading 'flavor' on Instance uuid 7a118055-6c34-44a8-a30e-f5ff8bb66fba {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:13:18.889124 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-777d9774-730a-4447-98e2-a5102118f4d3 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:18.893676 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bf2500dd-2a6d-4f02-8580-e5793007f2e7 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] 10.222.0.50 "PUT /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba/tags" status: 200 len: 60 microversion: 2.26 time: 0.100023 Aug 31 16:13:18.894351 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2157/4518] 10.222.0.50 () {62 vars in 1312 bytes} [Wed Aug 31 16:13:18 2022] PUT /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba/tags => generated 60 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:18.900128 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8561b31a-22a7-4587-b008-981c88a61769 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:18.900727 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8561b31a-22a7-4587-b008-981c88a61769 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 33170fbc-0d84-4284-9f70-dedb91f0d295] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:18.902756 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-777d9774-730a-4447-98e2-a5102118f4d3 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a" status: 200 len: 1509 microversion: 2.1 time: 0.181240 Aug 31 16:13:18.903853 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2362/4519] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:18 2022] GET /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a => generated 1509 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:18.908821 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5868076a-1163-4773-93e3-15422c3a9c42 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:18.909625 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5868076a-1163-4773-93e3-15422c3a9c42 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] [instance: 98beddf9-f152-4a63-98ac-fc3a9a1c9b63] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:18.918346 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5868076a-1163-4773-93e3-15422c3a9c42 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:18.918667 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8561b31a-22a7-4587-b008-981c88a61769 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:18.918827 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5868076a-1163-4773-93e3-15422c3a9c42 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:18.919268 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5868076a-1163-4773-93e3-15422c3a9c42 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:18.919402 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8561b31a-22a7-4587-b008-981c88a61769 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:18.919950 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8561b31a-22a7-4587-b008-981c88a61769 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:18.920062 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5868076a-1163-4773-93e3-15422c3a9c42 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:18.920420 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5868076a-1163-4773-93e3-15422c3a9c42 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:18.920847 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5868076a-1163-4773-93e3-15422c3a9c42 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:18.920960 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8561b31a-22a7-4587-b008-981c88a61769 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:18.921431 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8561b31a-22a7-4587-b008-981c88a61769 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:18.922110 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8561b31a-22a7-4587-b008-981c88a61769 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:19.197725 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8561b31a-22a7-4587-b008-981c88a61769 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:19.201711 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5868076a-1163-4773-93e3-15422c3a9c42 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7fa51caf47428fb0e89e2050b64211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c66bcd5e83f4ea89afa84ff947a36e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:19.206039 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8561b31a-22a7-4587-b008-981c88a61769 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/33170fbc-0d84-4284-9f70-dedb91f0d295" status: 200 len: 1308 microversion: 2.1 time: 0.310518 Aug 31 16:13:19.206860 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2158/4520] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:18 2022] GET /compute/v2.1/servers/33170fbc-0d84-4284-9f70-dedb91f0d295 => generated 1308 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:19.209815 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5868076a-1163-4773-93e3-15422c3a9c42 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] 10.222.0.50 "GET /compute/v2.1/servers/98beddf9-f152-4a63-98ac-fc3a9a1c9b63" status: 200 len: 1470 microversion: 2.1 time: 0.304766 Aug 31 16:13:19.210428 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2363/4521] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:18 2022] GET /compute/v2.1/servers/98beddf9-f152-4a63-98ac-fc3a9a1c9b63 => generated 1470 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:19.215533 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c3187b20-1825-484a-9c91-9d15783fb86a tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Calling method '.version_select at 0x7fbb46466820>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:19.223403 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3187b20-1825-484a-9c91-9d15783fb86a tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:19.223899 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3187b20-1825-484a-9c91-9d15783fb86a tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:19.224329 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3187b20-1825-484a-9c91-9d15783fb86a tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:19.234635 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c3187b20-1825-484a-9c91-9d15783fb86a tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] 10.222.0.50 "GET /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba/tags" status: 200 len: 60 microversion: 2.26 time: 0.023374 Aug 31 16:13:19.235256 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2159/4522] 10.222.0.50 () {60 vars in 1292 bytes} [Wed Aug 31 16:13:19 2022] GET /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba/tags => generated 60 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:19.250830 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-18b1508f-3f9c-49d0-9901-2d6568be8f0a tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Calling method '.version_select at 0x7fbb4aa55790>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:19.261454 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-18b1508f-3f9c-49d0-9901-2d6568be8f0a tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:19.261951 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-18b1508f-3f9c-49d0-9901-2d6568be8f0a tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:19.262403 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-18b1508f-3f9c-49d0-9901-2d6568be8f0a tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:19.262873 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-18b1508f-3f9c-49d0-9901-2d6568be8f0a tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] [instance: 7a118055-6c34-44a8-a30e-f5ff8bb66fba] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:19.265542 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-43fc691b-6668-40a7-8ec4-9f789d304899 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:19.266182 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-43fc691b-6668-40a7-8ec4-9f789d304899 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: af48d367-7828-47f9-a178-5d07cbaa26aa] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:19.268910 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-18b1508f-3f9c-49d0-9901-2d6568be8f0a tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:19.269373 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-18b1508f-3f9c-49d0-9901-2d6568be8f0a tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:19.269795 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-18b1508f-3f9c-49d0-9901-2d6568be8f0a tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:19.270512 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-18b1508f-3f9c-49d0-9901-2d6568be8f0a tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:19.270961 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-18b1508f-3f9c-49d0-9901-2d6568be8f0a tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:19.271380 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-18b1508f-3f9c-49d0-9901-2d6568be8f0a tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:19.272606 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43fc691b-6668-40a7-8ec4-9f789d304899 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:19.273127 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43fc691b-6668-40a7-8ec4-9f789d304899 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:19.273594 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43fc691b-6668-40a7-8ec4-9f789d304899 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:19.274337 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43fc691b-6668-40a7-8ec4-9f789d304899 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:19.274795 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43fc691b-6668-40a7-8ec4-9f789d304899 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:19.275214 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43fc691b-6668-40a7-8ec4-9f789d304899 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:19.294022 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-18b1508f-3f9c-49d0-9901-2d6568be8f0a tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:19.294535 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-18b1508f-3f9c-49d0-9901-2d6568be8f0a tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:19.294949 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-18b1508f-3f9c-49d0-9901-2d6568be8f0a tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:19.309290 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43fc691b-6668-40a7-8ec4-9f789d304899 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:19.309776 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43fc691b-6668-40a7-8ec4-9f789d304899 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:19.310244 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43fc691b-6668-40a7-8ec4-9f789d304899 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:19.310671 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-43fc691b-6668-40a7-8ec4-9f789d304899 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lazy-loading 'fault' on Instance uuid af48d367-7828-47f9-a178-5d07cbaa26aa {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:13:19.317209 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-18b1508f-3f9c-49d0-9901-2d6568be8f0a tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lazy-loading 'flavor' on Instance uuid 7a118055-6c34-44a8-a30e-f5ff8bb66fba {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:13:19.333140 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-18b1508f-3f9c-49d0-9901-2d6568be8f0a tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] 10.222.0.50 "DELETE /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba/tags" status: 204 len: 0 microversion: 2.26 time: 0.088928 Aug 31 16:13:19.333771 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2364/4523] 10.222.0.50 () {60 vars in 1295 bytes} [Wed Aug 31 16:13:19 2022] DELETE /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba/tags => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 16:13:19.343651 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-be4e6cb9-6da0-4d4a-8eb6-6ea4ae515f5a tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:19.344153 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-be4e6cb9-6da0-4d4a-8eb6-6ea4ae515f5a tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] [instance: 7a118055-6c34-44a8-a30e-f5ff8bb66fba] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:19.350430 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-be4e6cb9-6da0-4d4a-8eb6-6ea4ae515f5a tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:19.350915 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-be4e6cb9-6da0-4d4a-8eb6-6ea4ae515f5a tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:19.351333 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-be4e6cb9-6da0-4d4a-8eb6-6ea4ae515f5a tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:19.352058 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-be4e6cb9-6da0-4d4a-8eb6-6ea4ae515f5a tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:19.352501 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-be4e6cb9-6da0-4d4a-8eb6-6ea4ae515f5a tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:19.352965 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-be4e6cb9-6da0-4d4a-8eb6-6ea4ae515f5a tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:19.360360 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-43fc691b-6668-40a7-8ec4-9f789d304899 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:19.369652 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-43fc691b-6668-40a7-8ec4-9f789d304899 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/af48d367-7828-47f9-a178-5d07cbaa26aa" status: 200 len: 1308 microversion: 2.1 time: 0.108585 Aug 31 16:13:19.374283 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2160/4524] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:19 2022] GET /compute/v2.1/servers/af48d367-7828-47f9-a178-5d07cbaa26aa => generated 1308 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:13:19.382035 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-be4e6cb9-6da0-4d4a-8eb6-6ea4ae515f5a tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] [instance: 7a118055-6c34-44a8-a30e-f5ff8bb66fba] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:13:19.418538 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=2,nova_cell1:DELETE=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:13:19.482700 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-be4e6cb9-6da0-4d4a-8eb6-6ea4ae515f5a tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] 10.222.0.50 "DELETE /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba" status: 204 len: 0 microversion: 2.26 time: 0.142596 Aug 31 16:13:19.483721 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2365/4525] 10.222.0.50 () {60 vars in 1280 bytes} [Wed Aug 31 16:13:19 2022] DELETE /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 16:13:19.492356 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-892c2cd1-5176-41d2-8eb0-77fa237952c6 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:19.492961 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-892c2cd1-5176-41d2-8eb0-77fa237952c6 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] [instance: 7a118055-6c34-44a8-a30e-f5ff8bb66fba] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:19.499523 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-892c2cd1-5176-41d2-8eb0-77fa237952c6 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:19.500011 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-892c2cd1-5176-41d2-8eb0-77fa237952c6 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:19.500438 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-892c2cd1-5176-41d2-8eb0-77fa237952c6 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:19.501122 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-892c2cd1-5176-41d2-8eb0-77fa237952c6 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:19.501537 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-892c2cd1-5176-41d2-8eb0-77fa237952c6 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:19.501948 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-892c2cd1-5176-41d2-8eb0-77fa237952c6 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:19.654667 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-892c2cd1-5176-41d2-8eb0-77fa237952c6 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecd9e924c54474690f780576adc3a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b4f8a1c71745c6b860b5723acf164b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:19.658577 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:INSERT=4,nova_cell1:RELEASE=2,nova_cell1:SELECT=90,nova_cell1:DELETE=2,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:13:19.667167 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-892c2cd1-5176-41d2-8eb0-77fa237952c6 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ecd9e924c54474690f780576adc3a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b4f8a1c71745c6b860b5723acf164b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:19.669645 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-892c2cd1-5176-41d2-8eb0-77fa237952c6 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ecd9e924c54474690f780576adc3a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b4f8a1c71745c6b860b5723acf164b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:19.671423 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-892c2cd1-5176-41d2-8eb0-77fa237952c6 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] 10.222.0.50 "GET /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba" status: 200 len: 1553 microversion: 2.26 time: 0.183174 Aug 31 16:13:19.672591 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2161/4526] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:13:19 2022] GET /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba => generated 1553 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:13:19.741858 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f423ba21-050d-46e6-b36b-72ef14efea25 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:19.742499 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f423ba21-050d-46e6-b36b-72ef14efea25 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] [instance: bfb43b5d-9803-4760-8f51-f3bb651636a3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:19.749301 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f423ba21-050d-46e6-b36b-72ef14efea25 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:19.749798 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f423ba21-050d-46e6-b36b-72ef14efea25 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:19.750250 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f423ba21-050d-46e6-b36b-72ef14efea25 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:19.750930 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f423ba21-050d-46e6-b36b-72ef14efea25 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:19.751390 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f423ba21-050d-46e6-b36b-72ef14efea25 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:19.751793 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f423ba21-050d-46e6-b36b-72ef14efea25 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:19.891189 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f423ba21-050d-46e6-b36b-72ef14efea25 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5bf48d039ca4ce489212ef340ddb5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7647e0ee82f148c6a4c138842d8fbf69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:19.899202 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f423ba21-050d-46e6-b36b-72ef14efea25 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] 10.222.0.50 "GET /compute/v2.1/servers/bfb43b5d-9803-4760-8f51-f3bb651636a3" status: 200 len: 1323 microversion: 2.1 time: 0.162012 Aug 31 16:13:19.899787 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2366/4527] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:19 2022] GET /compute/v2.1/servers/bfb43b5d-9803-4760-8f51-f3bb651636a3 => generated 1323 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:19.924047 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0d72b518-36a0-4dc7-8863-0cf27d90dbef tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:19.924603 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0d72b518-36a0-4dc7-8863-0cf27d90dbef tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 14167776-553f-4203-887b-3cb8e4cc0a2a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:19.932266 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0d72b518-36a0-4dc7-8863-0cf27d90dbef tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:19.932765 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0d72b518-36a0-4dc7-8863-0cf27d90dbef tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:19.933220 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0d72b518-36a0-4dc7-8863-0cf27d90dbef tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:19.933866 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0d72b518-36a0-4dc7-8863-0cf27d90dbef tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:19.934345 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0d72b518-36a0-4dc7-8863-0cf27d90dbef tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:19.934754 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0d72b518-36a0-4dc7-8863-0cf27d90dbef tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:20.070223 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0d72b518-36a0-4dc7-8863-0cf27d90dbef tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:20.079987 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0d72b518-36a0-4dc7-8863-0cf27d90dbef tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a" status: 200 len: 1509 microversion: 2.1 time: 0.159944 Aug 31 16:13:20.080660 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2162/4528] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:19 2022] GET /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:20.228229 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c85c7884-7add-4dcd-a6da-0052cef3b7a3 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:20.228745 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c85c7884-7add-4dcd-a6da-0052cef3b7a3 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 33170fbc-0d84-4284-9f70-dedb91f0d295] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:20.230967 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a3647347-3e8b-4932-b2c7-3df82dd4eaff tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:20.231604 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a3647347-3e8b-4932-b2c7-3df82dd4eaff tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] [instance: 98beddf9-f152-4a63-98ac-fc3a9a1c9b63] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:20.236271 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c85c7884-7add-4dcd-a6da-0052cef3b7a3 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:20.236782 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c85c7884-7add-4dcd-a6da-0052cef3b7a3 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:20.237213 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c85c7884-7add-4dcd-a6da-0052cef3b7a3 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:20.237906 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c85c7884-7add-4dcd-a6da-0052cef3b7a3 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:20.238439 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c85c7884-7add-4dcd-a6da-0052cef3b7a3 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:20.238855 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c85c7884-7add-4dcd-a6da-0052cef3b7a3 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:20.239463 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a3647347-3e8b-4932-b2c7-3df82dd4eaff tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:20.239969 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a3647347-3e8b-4932-b2c7-3df82dd4eaff tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:20.240403 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a3647347-3e8b-4932-b2c7-3df82dd4eaff tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:20.241099 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a3647347-3e8b-4932-b2c7-3df82dd4eaff tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:20.241554 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a3647347-3e8b-4932-b2c7-3df82dd4eaff tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:20.242004 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a3647347-3e8b-4932-b2c7-3df82dd4eaff tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:20.444563 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c85c7884-7add-4dcd-a6da-0052cef3b7a3 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:20.447782 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a3647347-3e8b-4932-b2c7-3df82dd4eaff tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7fa51caf47428fb0e89e2050b64211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c66bcd5e83f4ea89afa84ff947a36e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:20.453341 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c85c7884-7add-4dcd-a6da-0052cef3b7a3 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/33170fbc-0d84-4284-9f70-dedb91f0d295" status: 200 len: 1489 microversion: 2.1 time: 0.229702 Aug 31 16:13:20.453997 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2367/4529] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:20 2022] GET /compute/v2.1/servers/33170fbc-0d84-4284-9f70-dedb91f0d295 => generated 1489 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:20.455765 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a3647347-3e8b-4932-b2c7-3df82dd4eaff tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] 10.222.0.50 "GET /compute/v2.1/servers/98beddf9-f152-4a63-98ac-fc3a9a1c9b63" status: 200 len: 1470 microversion: 2.1 time: 0.229237 Aug 31 16:13:20.456332 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2163/4530] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:20 2022] GET /compute/v2.1/servers/98beddf9-f152-4a63-98ac-fc3a9a1c9b63 => generated 1470 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:20.459109 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ac6a23a9-a513-4394-b276-4a8f62fafa26 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:20.459787 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ac6a23a9-a513-4394-b276-4a8f62fafa26 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: af48d367-7828-47f9-a178-5d07cbaa26aa] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:20.467016 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ac6a23a9-a513-4394-b276-4a8f62fafa26 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:20.467596 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ac6a23a9-a513-4394-b276-4a8f62fafa26 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:20.468162 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ac6a23a9-a513-4394-b276-4a8f62fafa26 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:20.469313 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ac6a23a9-a513-4394-b276-4a8f62fafa26 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:20.469841 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ac6a23a9-a513-4394-b276-4a8f62fafa26 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:20.470367 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ac6a23a9-a513-4394-b276-4a8f62fafa26 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:20.474183 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8010cfda-2442-48bb-8603-8d0c9d7cce2c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:20.476783 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8010cfda-2442-48bb-8603-8d0c9d7cce2c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 33170fbc-0d84-4284-9f70-dedb91f0d295] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:20.483323 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8010cfda-2442-48bb-8603-8d0c9d7cce2c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:20.483736 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8010cfda-2442-48bb-8603-8d0c9d7cce2c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:20.484165 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8010cfda-2442-48bb-8603-8d0c9d7cce2c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:20.484854 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8010cfda-2442-48bb-8603-8d0c9d7cce2c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:20.485302 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8010cfda-2442-48bb-8603-8d0c9d7cce2c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:20.485710 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8010cfda-2442-48bb-8603-8d0c9d7cce2c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:20.504277 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ac6a23a9-a513-4394-b276-4a8f62fafa26 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:20.504835 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ac6a23a9-a513-4394-b276-4a8f62fafa26 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:20.505312 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ac6a23a9-a513-4394-b276-4a8f62fafa26 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:20.505924 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-ac6a23a9-a513-4394-b276-4a8f62fafa26 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lazy-loading 'fault' on Instance uuid af48d367-7828-47f9-a178-5d07cbaa26aa {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:13:20.554727 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ac6a23a9-a513-4394-b276-4a8f62fafa26 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4753a903d44ed89955218d54375bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e180149a99546f6ba25e638e4b4218b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:20.563432 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ac6a23a9-a513-4394-b276-4a8f62fafa26 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/af48d367-7828-47f9-a178-5d07cbaa26aa" status: 200 len: 1308 microversion: 2.1 time: 0.108103 Aug 31 16:13:20.564043 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2368/4531] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:20 2022] GET /compute/v2.1/servers/af48d367-7828-47f9-a178-5d07cbaa26aa => generated 1308 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:20.571035 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8010cfda-2442-48bb-8603-8d0c9d7cce2c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "PUT /compute/v2.1/servers/33170fbc-0d84-4284-9f70-dedb91f0d295" status: 200 len: 1084 microversion: 2.1 time: 0.100687 Aug 31 16:13:20.577178 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2164/4532] 10.222.0.50 () {60 vars in 1256 bytes} [Wed Aug 31 16:13:20 2022] PUT /compute/v2.1/servers/33170fbc-0d84-4284-9f70-dedb91f0d295 => generated 1084 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:20.591400 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9e6d2acf-675d-4146-93a4-fade51b0902b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:20.592205 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9e6d2acf-675d-4146-93a4-fade51b0902b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 33170fbc-0d84-4284-9f70-dedb91f0d295] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:20.601733 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9e6d2acf-675d-4146-93a4-fade51b0902b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:20.602290 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9e6d2acf-675d-4146-93a4-fade51b0902b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:20.603023 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9e6d2acf-675d-4146-93a4-fade51b0902b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:20.603796 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9e6d2acf-675d-4146-93a4-fade51b0902b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:20.604531 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9e6d2acf-675d-4146-93a4-fade51b0902b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:20.605284 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9e6d2acf-675d-4146-93a4-fade51b0902b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:20.701140 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c3d788b1-c5c2-425c-9ab7-250aa99eaa66 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:20.701878 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c3d788b1-c5c2-425c-9ab7-250aa99eaa66 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] [instance: 7a118055-6c34-44a8-a30e-f5ff8bb66fba] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:20.708671 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3d788b1-c5c2-425c-9ab7-250aa99eaa66 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:20.709436 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3d788b1-c5c2-425c-9ab7-250aa99eaa66 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:20.710038 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3d788b1-c5c2-425c-9ab7-250aa99eaa66 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:20.710950 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3d788b1-c5c2-425c-9ab7-250aa99eaa66 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:20.711564 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3d788b1-c5c2-425c-9ab7-250aa99eaa66 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:20.712140 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3d788b1-c5c2-425c-9ab7-250aa99eaa66 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:20.847656 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9e6d2acf-675d-4146-93a4-fade51b0902b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:20.860627 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9e6d2acf-675d-4146-93a4-fade51b0902b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/33170fbc-0d84-4284-9f70-dedb91f0d295" status: 200 len: 1510 microversion: 2.1 time: 0.273001 Aug 31 16:13:20.861881 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2369/4533] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:20 2022] GET /compute/v2.1/servers/33170fbc-0d84-4284-9f70-dedb91f0d295 => generated 1510 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:13:20.881766 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-853c2828-340b-46bc-9769-17b9291cd622 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:20.882481 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-853c2828-340b-46bc-9769-17b9291cd622 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 33170fbc-0d84-4284-9f70-dedb91f0d295] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:20.889574 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-853c2828-340b-46bc-9769-17b9291cd622 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:20.890071 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-853c2828-340b-46bc-9769-17b9291cd622 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:20.890608 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-853c2828-340b-46bc-9769-17b9291cd622 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:20.891270 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-853c2828-340b-46bc-9769-17b9291cd622 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:20.891730 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-853c2828-340b-46bc-9769-17b9291cd622 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:20.892804 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-853c2828-340b-46bc-9769-17b9291cd622 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:20.908752 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c3d788b1-c5c2-425c-9ab7-250aa99eaa66 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecd9e924c54474690f780576adc3a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b4f8a1c71745c6b860b5723acf164b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:20.920900 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c3d788b1-c5c2-425c-9ab7-250aa99eaa66 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ecd9e924c54474690f780576adc3a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b4f8a1c71745c6b860b5723acf164b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:20.922414 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c3d788b1-c5c2-425c-9ab7-250aa99eaa66 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ecd9e924c54474690f780576adc3a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b4f8a1c71745c6b860b5723acf164b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:20.923737 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c3d788b1-c5c2-425c-9ab7-250aa99eaa66 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] 10.222.0.50 "GET /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba" status: 200 len: 1553 microversion: 2.26 time: 0.228648 Aug 31 16:13:20.924369 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2165/4534] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:13:20 2022] GET /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba => generated 1553 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:13:20.929973 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-06cab0fb-9ca1-4976-9be7-28778724ccb8 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:20.930650 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-06cab0fb-9ca1-4976-9be7-28778724ccb8 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] [instance: bfb43b5d-9803-4760-8f51-f3bb651636a3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:20.937139 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06cab0fb-9ca1-4976-9be7-28778724ccb8 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:20.937844 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06cab0fb-9ca1-4976-9be7-28778724ccb8 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:20.938308 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06cab0fb-9ca1-4976-9be7-28778724ccb8 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:20.939157 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06cab0fb-9ca1-4976-9be7-28778724ccb8 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:20.939781 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06cab0fb-9ca1-4976-9be7-28778724ccb8 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:20.940198 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06cab0fb-9ca1-4976-9be7-28778724ccb8 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:21.096389 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-853c2828-340b-46bc-9769-17b9291cd622 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:21.105587 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-853c2828-340b-46bc-9769-17b9291cd622 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/33170fbc-0d84-4284-9f70-dedb91f0d295" status: 200 len: 1510 microversion: 2.1 time: 0.227855 Aug 31 16:13:21.106482 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2370/4535] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:20 2022] GET /compute/v2.1/servers/33170fbc-0d84-4284-9f70-dedb91f0d295 => generated 1510 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:13:21.111259 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d98d52ce-d8f4-4e34-a1dc-c1c17b816f9d tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:21.111859 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d98d52ce-d8f4-4e34-a1dc-c1c17b816f9d tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 14167776-553f-4203-887b-3cb8e4cc0a2a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:21.118211 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d98d52ce-d8f4-4e34-a1dc-c1c17b816f9d tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:21.118693 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d98d52ce-d8f4-4e34-a1dc-c1c17b816f9d tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:21.119121 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d98d52ce-d8f4-4e34-a1dc-c1c17b816f9d tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:21.119951 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d98d52ce-d8f4-4e34-a1dc-c1c17b816f9d tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:21.120416 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d98d52ce-d8f4-4e34-a1dc-c1c17b816f9d tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:21.120834 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d98d52ce-d8f4-4e34-a1dc-c1c17b816f9d tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:21.139319 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-06cab0fb-9ca1-4976-9be7-28778724ccb8 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5bf48d039ca4ce489212ef340ddb5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7647e0ee82f148c6a4c138842d8fbf69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:21.148992 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-06cab0fb-9ca1-4976-9be7-28778724ccb8 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] 10.222.0.50 "GET /compute/v2.1/servers/bfb43b5d-9803-4760-8f51-f3bb651636a3" status: 200 len: 1323 microversion: 2.1 time: 0.222856 Aug 31 16:13:21.149595 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2166/4536] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:20 2022] GET /compute/v2.1/servers/bfb43b5d-9803-4760-8f51-f3bb651636a3 => generated 1323 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:21.154846 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c24102d4-ed8e-48f1-aa31-8a0cb44ba1b4 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:21.155729 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c24102d4-ed8e-48f1-aa31-8a0cb44ba1b4 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 33170fbc-0d84-4284-9f70-dedb91f0d295] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:21.162882 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c24102d4-ed8e-48f1-aa31-8a0cb44ba1b4 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:21.163688 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c24102d4-ed8e-48f1-aa31-8a0cb44ba1b4 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:21.164463 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c24102d4-ed8e-48f1-aa31-8a0cb44ba1b4 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:21.165483 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c24102d4-ed8e-48f1-aa31-8a0cb44ba1b4 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:21.166312 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c24102d4-ed8e-48f1-aa31-8a0cb44ba1b4 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:21.167139 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c24102d4-ed8e-48f1-aa31-8a0cb44ba1b4 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:21.199500 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c24102d4-ed8e-48f1-aa31-8a0cb44ba1b4 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 33170fbc-0d84-4284-9f70-dedb91f0d295] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:13:21.264656 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d98d52ce-d8f4-4e34-a1dc-c1c17b816f9d tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:21.273333 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d98d52ce-d8f4-4e34-a1dc-c1c17b816f9d tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a" status: 200 len: 1515 microversion: 2.1 time: 0.166047 Aug 31 16:13:21.274031 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2371/4537] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:21 2022] GET /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:21.288428 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c24102d4-ed8e-48f1-aa31-8a0cb44ba1b4 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "DELETE /compute/v2.1/servers/33170fbc-0d84-4284-9f70-dedb91f0d295" status: 204 len: 0 microversion: 2.1 time: 0.137563 Aug 31 16:13:21.289419 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2167/4538] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:13:21 2022] DELETE /compute/v2.1/servers/33170fbc-0d84-4284-9f70-dedb91f0d295 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:13:21.299349 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6d559312-ec49-42d8-a191-f00bcad3e48d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:21.300041 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6d559312-ec49-42d8-a191-f00bcad3e48d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 33170fbc-0d84-4284-9f70-dedb91f0d295] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:21.306432 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d559312-ec49-42d8-a191-f00bcad3e48d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:21.306935 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d559312-ec49-42d8-a191-f00bcad3e48d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:21.307459 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d559312-ec49-42d8-a191-f00bcad3e48d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:21.308111 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d559312-ec49-42d8-a191-f00bcad3e48d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:21.308568 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d559312-ec49-42d8-a191-f00bcad3e48d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:21.308992 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d559312-ec49-42d8-a191-f00bcad3e48d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:21.454469 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6d559312-ec49-42d8-a191-f00bcad3e48d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:21.465514 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6d559312-ec49-42d8-a191-f00bcad3e48d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/33170fbc-0d84-4284-9f70-dedb91f0d295" status: 200 len: 1516 microversion: 2.1 time: 0.169487 Aug 31 16:13:21.466620 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2372/4539] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:21 2022] GET /compute/v2.1/servers/33170fbc-0d84-4284-9f70-dedb91f0d295 => generated 1516 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:21.477808 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-322746de-8597-440a-aa0c-d991f165d53c tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:21.478531 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-322746de-8597-440a-aa0c-d991f165d53c tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] [instance: 98beddf9-f152-4a63-98ac-fc3a9a1c9b63] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:21.485346 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-322746de-8597-440a-aa0c-d991f165d53c tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:21.485837 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-322746de-8597-440a-aa0c-d991f165d53c tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:21.486272 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-322746de-8597-440a-aa0c-d991f165d53c tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:21.486955 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-322746de-8597-440a-aa0c-d991f165d53c tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:21.487398 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-322746de-8597-440a-aa0c-d991f165d53c tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:21.487806 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-322746de-8597-440a-aa0c-d991f165d53c tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:21.595371 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b1cb0439-7606-414a-ab8c-dd2e4069a58d tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:21.596601 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b1cb0439-7606-414a-ab8c-dd2e4069a58d tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: af48d367-7828-47f9-a178-5d07cbaa26aa] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:21.604766 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1cb0439-7606-414a-ab8c-dd2e4069a58d tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:21.605450 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1cb0439-7606-414a-ab8c-dd2e4069a58d tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:21.605986 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1cb0439-7606-414a-ab8c-dd2e4069a58d tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:21.606790 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1cb0439-7606-414a-ab8c-dd2e4069a58d tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:21.607213 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1cb0439-7606-414a-ab8c-dd2e4069a58d tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:21.607633 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1cb0439-7606-414a-ab8c-dd2e4069a58d tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:21.625056 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-b1cb0439-7606-414a-ab8c-dd2e4069a58d tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] HTTP exception thrown: Instance af48d367-7828-47f9-a178-5d07cbaa26aa could not be found. Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b1cb0439-7606-414a-ab8c-dd2e4069a58d tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Request method failure captured: Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/af48d367-7828-47f9-a178-5d07cbaa26aa HTTP/1.1 Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4fx8dXrDPp8F-L0n04kp-zaf6ZtWlqwaa59t9vvOif4F5AytKJ4f0eMmOIMXgPQRlPvoXuxY9BFRrLrw89pnPvZMJf2BNZINdGOEbuEmddb8dXobNoMmR4cGnPaYGAV3cfBQbqYKw9Hf5KcV8G5F_gtotr2IKYMgKjb7JEaF_JOhBo Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 0e180149a99546f6ba25e638e4b4218b Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1341096730 Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0e180149a99546f6ba25e638e4b4218b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0e180149a99546f6ba25e638e4b4218b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0e180149a99546f6ba25e638e4b4218b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0e180149a99546f6ba25e638e4b4218b", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServerDiskConfigTestJSON-1341096730 Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 0e180149a99546f6ba25e638e4b4218b Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1341096730 Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServerDiskConfigTestJSON-1341096730-project Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 1c4753a903d44ed89955218d54375bc9 Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServerDiskConfigTestJSON-1341096730-project Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance af48d367-7828-47f9-a178-5d07cbaa26aa could not be found. Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'af48d367-7828-47f9-a178-5d07cbaa26aa'} Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af48d367-7828-47f9-a178-5d07cbaa26aa could not be found. Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af48d367-7828-47f9-a178-5d07cbaa26aa could not be found. Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:21.626830 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:21.631216 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:21.631216 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:21.631216 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:21.631216 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:13:21.631216 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:13:21.631216 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af48d367-7828-47f9-a178-5d07cbaa26aa could not be found. Aug 31 16:13:21.631216 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:21.631216 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b1cb0439-7606-414a-ab8c-dd2e4069a58d tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Returning 404 to user: Instance af48d367-7828-47f9-a178-5d07cbaa26aa could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:13:21.631216 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b1cb0439-7606-414a-ab8c-dd2e4069a58d tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/af48d367-7828-47f9-a178-5d07cbaa26aa" status: 404 len: 111 microversion: 2.1 time: 0.037327 Aug 31 16:13:21.632475 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2373/4540] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:21 2022] GET /compute/v2.1/servers/af48d367-7828-47f9-a178-5d07cbaa26aa => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:13:21.637262 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-242cd99c-c6dc-4fe2-b09f-0b31ed5e53e6 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:21.637764 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-242cd99c-c6dc-4fe2-b09f-0b31ed5e53e6 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: b60b7363-fd13-4b81-9c4b-0aabf39c5a6a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:21.645532 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-242cd99c-c6dc-4fe2-b09f-0b31ed5e53e6 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:21.645532 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-242cd99c-c6dc-4fe2-b09f-0b31ed5e53e6 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:21.645963 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-242cd99c-c6dc-4fe2-b09f-0b31ed5e53e6 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:21.647123 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-242cd99c-c6dc-4fe2-b09f-0b31ed5e53e6 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:21.647123 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-242cd99c-c6dc-4fe2-b09f-0b31ed5e53e6 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:21.647549 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-242cd99c-c6dc-4fe2-b09f-0b31ed5e53e6 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:21.666533 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-242cd99c-c6dc-4fe2-b09f-0b31ed5e53e6 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] HTTP exception thrown: Instance b60b7363-fd13-4b81-9c4b-0aabf39c5a6a could not be found. Aug 31 16:13:21.668478 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-242cd99c-c6dc-4fe2-b09f-0b31ed5e53e6 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Request method failure captured: Aug 31 16:13:21.668478 n-d-833090-16 devstack@n-api.service[128864]: request: DELETE /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a HTTP/1.1 Aug 31 16:13:21.668478 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:13:21.668478 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:13:21.668478 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:13:21.668478 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:13:21.668478 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:13:21.668478 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:13:21.668478 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:13:21.668478 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:13:21.668478 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4fx8dXrDPp8F-L0n04kp-zaf6ZtWlqwaa59t9vvOif4F5AytKJ4f0eMmOIMXgPQRlPvoXuxY9BFRrLrw89pnPvZMJf2BNZINdGOEbuEmddb8dXobNoMmR4cGnPaYGAV3cfBQbqYKw9Hf5KcV8G5F_gtotr2IKYMgKjb7JEaF_JOhBo Aug 31 16:13:21.668478 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:13:21.668478 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:13:21.668478 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:13:21.668478 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:13:21.668478 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:13:21.668478 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:13:21.668478 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 0e180149a99546f6ba25e638e4b4218b Aug 31 16:13:21.668478 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1341096730 Aug 31 16:13:21.668478 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:13:21.668478 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:13:21.668478 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0e180149a99546f6ba25e638e4b4218b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0e180149a99546f6ba25e638e4b4218b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0e180149a99546f6ba25e638e4b4218b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0e180149a99546f6ba25e638e4b4218b", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:13:21.668478 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServerDiskConfigTestJSON-1341096730 Aug 31 16:13:21.668478 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 0e180149a99546f6ba25e638e4b4218b Aug 31 16:13:21.668478 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1341096730 Aug 31 16:13:21.668478 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServerDiskConfigTestJSON-1341096730-project Aug 31 16:13:21.668478 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:13:21.668478 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:13:21.668478 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 1c4753a903d44ed89955218d54375bc9 Aug 31 16:13:21.668478 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServerDiskConfigTestJSON-1341096730-project Aug 31 16:13:21.668478 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:13:21.668478 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance b60b7363-fd13-4b81-9c4b-0aabf39c5a6a could not be found. Aug 31 16:13:21.668478 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'b60b7363-fd13-4b81-9c4b-0aabf39c5a6a'} Aug 31 16:13:21.668478 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:13:21.668478 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:21.668478 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:13:21.668478 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:13:21.668478 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:13:21.668478 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:13:21.668478 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:13:21.668478 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:13:21.668478 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:13:21.668478 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:13:21.668478 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b60b7363-fd13-4b81-9c4b-0aabf39c5a6a could not be found. Aug 31 16:13:21.668478 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:21.668478 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:21.668478 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:21.668478 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:21.668478 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:21.668478 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:21.668478 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:13:21.668478 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:13:21.668478 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:13:21.668478 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:13:21.668478 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:13:21.668478 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:13:21.668478 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:13:21.668478 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:13:21.668478 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:13:21.668478 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:13:21.668478 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:13:21.668478 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:13:21.672893 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b60b7363-fd13-4b81-9c4b-0aabf39c5a6a could not be found. Aug 31 16:13:21.672893 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:21.672893 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:21.672893 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:21.672893 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:21.672893 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:21.672893 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:21.672893 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:13:21.672893 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:13:21.672893 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b60b7363-fd13-4b81-9c4b-0aabf39c5a6a could not be found. Aug 31 16:13:21.672893 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:21.672893 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-242cd99c-c6dc-4fe2-b09f-0b31ed5e53e6 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Returning 404 to user: Instance b60b7363-fd13-4b81-9c4b-0aabf39c5a6a could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:13:21.672893 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-242cd99c-c6dc-4fe2-b09f-0b31ed5e53e6 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a" status: 404 len: 111 microversion: 2.1 time: 0.036872 Aug 31 16:13:21.673721 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-322746de-8597-440a-aa0c-d991f165d53c tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7fa51caf47428fb0e89e2050b64211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c66bcd5e83f4ea89afa84ff947a36e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:21.674938 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2374/4541] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:13:21 2022] DELETE /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:13:21.680367 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-03caafea-c9cf-4acf-80f4-a310f090b4b3 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:21.681155 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-03caafea-c9cf-4acf-80f4-a310f090b4b3 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: b60b7363-fd13-4b81-9c4b-0aabf39c5a6a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:21.683034 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-322746de-8597-440a-aa0c-d991f165d53c tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] 10.222.0.50 "GET /compute/v2.1/servers/98beddf9-f152-4a63-98ac-fc3a9a1c9b63" status: 200 len: 1470 microversion: 2.1 time: 0.209834 Aug 31 16:13:21.684014 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2168/4542] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:21 2022] GET /compute/v2.1/servers/98beddf9-f152-4a63-98ac-fc3a9a1c9b63 => generated 1470 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:21.688607 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-03caafea-c9cf-4acf-80f4-a310f090b4b3 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:21.689091 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-03caafea-c9cf-4acf-80f4-a310f090b4b3 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:21.689517 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-03caafea-c9cf-4acf-80f4-a310f090b4b3 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:21.690227 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-03caafea-c9cf-4acf-80f4-a310f090b4b3 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:21.690675 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-03caafea-c9cf-4acf-80f4-a310f090b4b3 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:21.691095 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-03caafea-c9cf-4acf-80f4-a310f090b4b3 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:21.707030 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-03caafea-c9cf-4acf-80f4-a310f090b4b3 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] HTTP exception thrown: Instance b60b7363-fd13-4b81-9c4b-0aabf39c5a6a could not be found. Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-03caafea-c9cf-4acf-80f4-a310f090b4b3 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Request method failure captured: Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a HTTP/1.1 Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4fx8dXrDPp8F-L0n04kp-zaf6ZtWlqwaa59t9vvOif4F5AytKJ4f0eMmOIMXgPQRlPvoXuxY9BFRrLrw89pnPvZMJf2BNZINdGOEbuEmddb8dXobNoMmR4cGnPaYGAV3cfBQbqYKw9Hf5KcV8G5F_gtotr2IKYMgKjb7JEaF_JOhBo Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 0e180149a99546f6ba25e638e4b4218b Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1341096730 Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0e180149a99546f6ba25e638e4b4218b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0e180149a99546f6ba25e638e4b4218b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0e180149a99546f6ba25e638e4b4218b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0e180149a99546f6ba25e638e4b4218b", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServerDiskConfigTestJSON-1341096730 Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 0e180149a99546f6ba25e638e4b4218b Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1341096730 Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServerDiskConfigTestJSON-1341096730-project Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 1c4753a903d44ed89955218d54375bc9 Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServerDiskConfigTestJSON-1341096730-project Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance b60b7363-fd13-4b81-9c4b-0aabf39c5a6a could not be found. Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'b60b7363-fd13-4b81-9c4b-0aabf39c5a6a'} Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b60b7363-fd13-4b81-9c4b-0aabf39c5a6a could not be found. Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b60b7363-fd13-4b81-9c4b-0aabf39c5a6a could not be found. Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:21.708656 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:21.713460 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:21.713460 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:21.713460 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:21.713460 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:13:21.713460 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:13:21.713460 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b60b7363-fd13-4b81-9c4b-0aabf39c5a6a could not be found. Aug 31 16:13:21.713460 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:21.713460 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-03caafea-c9cf-4acf-80f4-a310f090b4b3 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Returning 404 to user: Instance b60b7363-fd13-4b81-9c4b-0aabf39c5a6a could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:13:21.713460 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-03caafea-c9cf-4acf-80f4-a310f090b4b3 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a" status: 404 len: 111 microversion: 2.1 time: 0.035067 Aug 31 16:13:21.713460 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2375/4543] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:21 2022] GET /compute/v2.1/servers/b60b7363-fd13-4b81-9c4b-0aabf39c5a6a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:13:21.721715 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ab03a172-0302-449e-ac98-7a5ed01b5a4e tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:21.722255 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ab03a172-0302-449e-ac98-7a5ed01b5a4e tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: 5116a4af-d819-456a-b188-7dcf94b7b35c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:21.728589 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab03a172-0302-449e-ac98-7a5ed01b5a4e tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:21.729088 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab03a172-0302-449e-ac98-7a5ed01b5a4e tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:21.729531 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab03a172-0302-449e-ac98-7a5ed01b5a4e tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:21.730292 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab03a172-0302-449e-ac98-7a5ed01b5a4e tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:21.730750 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab03a172-0302-449e-ac98-7a5ed01b5a4e tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:21.731172 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab03a172-0302-449e-ac98-7a5ed01b5a4e tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:21.745310 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-ab03a172-0302-449e-ac98-7a5ed01b5a4e tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] HTTP exception thrown: Instance 5116a4af-d819-456a-b188-7dcf94b7b35c could not be found. Aug 31 16:13:21.747217 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ab03a172-0302-449e-ac98-7a5ed01b5a4e tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Request method failure captured: Aug 31 16:13:21.747217 n-d-833090-16 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c HTTP/1.1 Aug 31 16:13:21.747217 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:13:21.747217 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:13:21.747217 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:13:21.747217 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:13:21.747217 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:13:21.747217 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:13:21.747217 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:13:21.747217 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:13:21.747217 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4fx8dXrDPp8F-L0n04kp-zaf6ZtWlqwaa59t9vvOif4F5AytKJ4f0eMmOIMXgPQRlPvoXuxY9BFRrLrw89pnPvZMJf2BNZINdGOEbuEmddb8dXobNoMmR4cGnPaYGAV3cfBQbqYKw9Hf5KcV8G5F_gtotr2IKYMgKjb7JEaF_JOhBo Aug 31 16:13:21.747217 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:13:21.747217 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:13:21.747217 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:13:21.747217 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:13:21.747217 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:13:21.747217 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:13:21.747217 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 0e180149a99546f6ba25e638e4b4218b Aug 31 16:13:21.747217 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1341096730 Aug 31 16:13:21.747217 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:13:21.747217 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:13:21.747217 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0e180149a99546f6ba25e638e4b4218b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0e180149a99546f6ba25e638e4b4218b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0e180149a99546f6ba25e638e4b4218b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0e180149a99546f6ba25e638e4b4218b", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:13:21.747217 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServerDiskConfigTestJSON-1341096730 Aug 31 16:13:21.747217 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 0e180149a99546f6ba25e638e4b4218b Aug 31 16:13:21.747217 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1341096730 Aug 31 16:13:21.747217 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServerDiskConfigTestJSON-1341096730-project Aug 31 16:13:21.747217 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:13:21.747217 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:13:21.747217 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 1c4753a903d44ed89955218d54375bc9 Aug 31 16:13:21.747217 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServerDiskConfigTestJSON-1341096730-project Aug 31 16:13:21.747217 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:13:21.747217 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 5116a4af-d819-456a-b188-7dcf94b7b35c could not be found. Aug 31 16:13:21.747217 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '5116a4af-d819-456a-b188-7dcf94b7b35c'} Aug 31 16:13:21.747217 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:13:21.747217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:21.747217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:13:21.747217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:13:21.747217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:13:21.747217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:13:21.747217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:13:21.747217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:13:21.747217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:13:21.747217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:13:21.747217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5116a4af-d819-456a-b188-7dcf94b7b35c could not be found. Aug 31 16:13:21.747217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:21.747217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:21.747217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:21.747217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:21.747217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:21.747217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:21.747217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:13:21.747217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:13:21.747217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:13:21.747217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:13:21.747217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:13:21.747217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:13:21.747217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:13:21.747217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:13:21.747217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:13:21.747217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:13:21.747217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:13:21.747217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:13:21.751716 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5116a4af-d819-456a-b188-7dcf94b7b35c could not be found. Aug 31 16:13:21.751716 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:21.751716 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:21.751716 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:21.751716 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:21.751716 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:21.751716 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:21.751716 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:13:21.751716 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:13:21.751716 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5116a4af-d819-456a-b188-7dcf94b7b35c could not be found. Aug 31 16:13:21.751716 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:21.751716 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ab03a172-0302-449e-ac98-7a5ed01b5a4e tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Returning 404 to user: Instance 5116a4af-d819-456a-b188-7dcf94b7b35c could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:13:21.751716 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ab03a172-0302-449e-ac98-7a5ed01b5a4e tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c" status: 404 len: 111 microversion: 2.1 time: 0.030753 Aug 31 16:13:21.751716 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2169/4544] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:13:21 2022] DELETE /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:13:21.758309 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-699d2754-33c8-4593-bc61-6bfeeb358266 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:21.758919 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-699d2754-33c8-4593-bc61-6bfeeb358266 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] [instance: 5116a4af-d819-456a-b188-7dcf94b7b35c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:21.765789 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-699d2754-33c8-4593-bc61-6bfeeb358266 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:21.766405 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-699d2754-33c8-4593-bc61-6bfeeb358266 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:21.766777 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-699d2754-33c8-4593-bc61-6bfeeb358266 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:21.767482 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-699d2754-33c8-4593-bc61-6bfeeb358266 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:21.767919 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-699d2754-33c8-4593-bc61-6bfeeb358266 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:21.768334 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-699d2754-33c8-4593-bc61-6bfeeb358266 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:21.783951 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-699d2754-33c8-4593-bc61-6bfeeb358266 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] HTTP exception thrown: Instance 5116a4af-d819-456a-b188-7dcf94b7b35c could not be found. Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-699d2754-33c8-4593-bc61-6bfeeb358266 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Request method failure captured: Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c HTTP/1.1 Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4fx8dXrDPp8F-L0n04kp-zaf6ZtWlqwaa59t9vvOif4F5AytKJ4f0eMmOIMXgPQRlPvoXuxY9BFRrLrw89pnPvZMJf2BNZINdGOEbuEmddb8dXobNoMmR4cGnPaYGAV3cfBQbqYKw9Hf5KcV8G5F_gtotr2IKYMgKjb7JEaF_JOhBo Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 0e180149a99546f6ba25e638e4b4218b Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1341096730 Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0e180149a99546f6ba25e638e4b4218b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0e180149a99546f6ba25e638e4b4218b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0e180149a99546f6ba25e638e4b4218b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0e180149a99546f6ba25e638e4b4218b", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServerDiskConfigTestJSON-1341096730 Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 0e180149a99546f6ba25e638e4b4218b Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1341096730 Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServerDiskConfigTestJSON-1341096730-project Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 1c4753a903d44ed89955218d54375bc9 Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServerDiskConfigTestJSON-1341096730-project Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 5116a4af-d819-456a-b188-7dcf94b7b35c could not be found. Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '5116a4af-d819-456a-b188-7dcf94b7b35c'} Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5116a4af-d819-456a-b188-7dcf94b7b35c could not be found. Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5116a4af-d819-456a-b188-7dcf94b7b35c could not be found. Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:21.785584 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:21.790638 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:21.790638 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:21.790638 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:21.790638 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:13:21.790638 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:13:21.790638 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5116a4af-d819-456a-b188-7dcf94b7b35c could not be found. Aug 31 16:13:21.790638 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:21.790638 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-699d2754-33c8-4593-bc61-6bfeeb358266 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] Returning 404 to user: Instance 5116a4af-d819-456a-b188-7dcf94b7b35c could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:13:21.790638 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-699d2754-33c8-4593-bc61-6bfeeb358266 tempest-ServerDiskConfigTestJSON-1341096730 tempest-ServerDiskConfigTestJSON-1341096730-project] 10.222.0.50 "GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c" status: 404 len: 111 microversion: 2.1 time: 0.033718 Aug 31 16:13:21.790638 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2376/4545] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:21 2022] GET /compute/v2.1/servers/5116a4af-d819-456a-b188-7dcf94b7b35c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:13:21.947558 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e583cd48-5860-4f96-8588-c0b3e9e388e6 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:21.948870 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e583cd48-5860-4f96-8588-c0b3e9e388e6 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] [instance: 7a118055-6c34-44a8-a30e-f5ff8bb66fba] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:21.955623 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e583cd48-5860-4f96-8588-c0b3e9e388e6 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:21.956180 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e583cd48-5860-4f96-8588-c0b3e9e388e6 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:21.956933 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e583cd48-5860-4f96-8588-c0b3e9e388e6 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:21.957662 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e583cd48-5860-4f96-8588-c0b3e9e388e6 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:21.958173 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e583cd48-5860-4f96-8588-c0b3e9e388e6 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:21.958629 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e583cd48-5860-4f96-8588-c0b3e9e388e6 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:22.175165 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b05d61c0-2476-461c-be08-603de74305c8 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:22.175776 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b05d61c0-2476-461c-be08-603de74305c8 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] [instance: bfb43b5d-9803-4760-8f51-f3bb651636a3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:22.186445 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e583cd48-5860-4f96-8588-c0b3e9e388e6 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecd9e924c54474690f780576adc3a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b4f8a1c71745c6b860b5723acf164b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:22.189892 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b05d61c0-2476-461c-be08-603de74305c8 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:22.190406 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b05d61c0-2476-461c-be08-603de74305c8 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:22.195653 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b05d61c0-2476-461c-be08-603de74305c8 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:22.201118 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b05d61c0-2476-461c-be08-603de74305c8 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:22.201956 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b05d61c0-2476-461c-be08-603de74305c8 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:22.202611 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b05d61c0-2476-461c-be08-603de74305c8 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:22.212095 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e583cd48-5860-4f96-8588-c0b3e9e388e6 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ecd9e924c54474690f780576adc3a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b4f8a1c71745c6b860b5723acf164b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:22.214371 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e583cd48-5860-4f96-8588-c0b3e9e388e6 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ecd9e924c54474690f780576adc3a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b4f8a1c71745c6b860b5723acf164b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:22.216054 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e583cd48-5860-4f96-8588-c0b3e9e388e6 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] 10.222.0.50 "GET /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba" status: 200 len: 1553 microversion: 2.26 time: 0.272448 Aug 31 16:13:22.230118 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2170/4546] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:13:21 2022] GET /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba => generated 1553 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:13:22.484929 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b05d61c0-2476-461c-be08-603de74305c8 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5bf48d039ca4ce489212ef340ddb5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7647e0ee82f148c6a4c138842d8fbf69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:22.490714 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8effb080-3224-4243-9243-f769f1dd1153 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:22.491690 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8effb080-3224-4243-9243-f769f1dd1153 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 33170fbc-0d84-4284-9f70-dedb91f0d295] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:22.497210 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b05d61c0-2476-461c-be08-603de74305c8 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] 10.222.0.50 "GET /compute/v2.1/servers/bfb43b5d-9803-4760-8f51-f3bb651636a3" status: 200 len: 1323 microversion: 2.1 time: 0.328805 Aug 31 16:13:22.498323 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=16 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:13:22.504724 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8effb080-3224-4243-9243-f769f1dd1153 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:22.505495 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8effb080-3224-4243-9243-f769f1dd1153 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:22.506126 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8effb080-3224-4243-9243-f769f1dd1153 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:22.507005 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8effb080-3224-4243-9243-f769f1dd1153 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:22.507509 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8effb080-3224-4243-9243-f769f1dd1153 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:22.507936 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8effb080-3224-4243-9243-f769f1dd1153 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:22.510892 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2377/4547] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:22 2022] GET /compute/v2.1/servers/bfb43b5d-9803-4760-8f51-f3bb651636a3 => generated 1323 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:22.655072 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-535e1bcc-a7f0-4c79-aec0-9dc433606193 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Action: 'create', calling method: .version_select at 0x7fbb4aa65790>, body: {"keypair": {"name": "tempest-keypair-1689424413", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNaE1ssu8fcBhtyWyNrM3ozErOrW5HVzZa0RK+j5L7tMTQgs4y1gBd2lGazs6t41z4JBN+jJJQo5wwJmwkdjuTRYlcdmZoYXIygGLedGIBtLBZq+jDZv6nWwU2JyRa9vbg=="}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:22.670208 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=25 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:13:22.674275 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-535e1bcc-a7f0-4c79-aec0-9dc433606193 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Getting quotas for project d25e1b1938b2401bab27dafadc9745d5. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:13:22.677259 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:13:22.681499 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-535e1bcc-a7f0-4c79-aec0-9dc433606193 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Getting quotas for user b5f67b54e87c46d28e7d5217bf49ca57 and project d25e1b1938b2401bab27dafadc9745d5. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:13:22.711970 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-535e1bcc-a7f0-4c79-aec0-9dc433606193 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.060842 Aug 31 16:13:22.712521 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2378/4548] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 31 16:13:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:13:22.717396 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e62514ba-5df7-406f-8c08-b693c78d4882 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:22.718041 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e62514ba-5df7-406f-8c08-b693c78d4882 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] [instance: 98beddf9-f152-4a63-98ac-fc3a9a1c9b63] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:22.726822 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e62514ba-5df7-406f-8c08-b693c78d4882 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:22.729642 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e62514ba-5df7-406f-8c08-b693c78d4882 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:22.729642 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e62514ba-5df7-406f-8c08-b693c78d4882 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:22.729642 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e62514ba-5df7-406f-8c08-b693c78d4882 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:22.729642 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e62514ba-5df7-406f-8c08-b693c78d4882 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:22.729642 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e62514ba-5df7-406f-8c08-b693c78d4882 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:22.799925 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8effb080-3224-4243-9243-f769f1dd1153 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:22.814538 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8effb080-3224-4243-9243-f769f1dd1153 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/33170fbc-0d84-4284-9f70-dedb91f0d295" status: 200 len: 1516 microversion: 2.1 time: 0.328501 Aug 31 16:13:22.826125 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2171/4549] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:22 2022] GET /compute/v2.1/servers/33170fbc-0d84-4284-9f70-dedb91f0d295 => generated 1516 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:13:22.985449 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e62514ba-5df7-406f-8c08-b693c78d4882 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7fa51caf47428fb0e89e2050b64211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c66bcd5e83f4ea89afa84ff947a36e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:22.997800 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e62514ba-5df7-406f-8c08-b693c78d4882 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] 10.222.0.50 "GET /compute/v2.1/servers/98beddf9-f152-4a63-98ac-fc3a9a1c9b63" status: 200 len: 1470 microversion: 2.1 time: 0.284187 Aug 31 16:13:22.999140 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2379/4550] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:22 2022] GET /compute/v2.1/servers/98beddf9-f152-4a63-98ac-fc3a9a1c9b63 => generated 1470 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:23.241072 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-56fc8872-8716-4378-977b-77cc48f7a907 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:23.241886 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-56fc8872-8716-4378-977b-77cc48f7a907 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] [instance: 7a118055-6c34-44a8-a30e-f5ff8bb66fba] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:23.256352 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56fc8872-8716-4378-977b-77cc48f7a907 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:23.258192 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56fc8872-8716-4378-977b-77cc48f7a907 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:23.258731 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56fc8872-8716-4378-977b-77cc48f7a907 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:23.260977 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56fc8872-8716-4378-977b-77cc48f7a907 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:23.261728 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56fc8872-8716-4378-977b-77cc48f7a907 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:23.263403 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56fc8872-8716-4378-977b-77cc48f7a907 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:23.519943 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-917d72b0-185f-4541-8768-f03e225ddd0c tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:23.520774 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-917d72b0-185f-4541-8768-f03e225ddd0c tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] [instance: bfb43b5d-9803-4760-8f51-f3bb651636a3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:23.529161 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-917d72b0-185f-4541-8768-f03e225ddd0c tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:23.529933 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-917d72b0-185f-4541-8768-f03e225ddd0c tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:23.530575 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-917d72b0-185f-4541-8768-f03e225ddd0c tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:23.531462 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-917d72b0-185f-4541-8768-f03e225ddd0c tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:23.532760 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-917d72b0-185f-4541-8768-f03e225ddd0c tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:23.533470 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-917d72b0-185f-4541-8768-f03e225ddd0c tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:24.142833 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-56fc8872-8716-4378-977b-77cc48f7a907 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecd9e924c54474690f780576adc3a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b4f8a1c71745c6b860b5723acf164b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:24.153168 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-56fc8872-8716-4378-977b-77cc48f7a907 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ecd9e924c54474690f780576adc3a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b4f8a1c71745c6b860b5723acf164b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:24.154809 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-56fc8872-8716-4378-977b-77cc48f7a907 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ecd9e924c54474690f780576adc3a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b4f8a1c71745c6b860b5723acf164b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:24.156099 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-56fc8872-8716-4378-977b-77cc48f7a907 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] 10.222.0.50 "GET /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba" status: 200 len: 1553 microversion: 2.26 time: 0.919094 Aug 31 16:13:24.156864 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2172/4551] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:13:23 2022] GET /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba => generated 1553 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:13:24.162270 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-03c2d769-c933-4603-9ec9-b5dc07ba337f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:24.163198 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-03c2d769-c933-4603-9ec9-b5dc07ba337f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 33170fbc-0d84-4284-9f70-dedb91f0d295] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:24.190639 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03c2d769-c933-4603-9ec9-b5dc07ba337f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:24.192066 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03c2d769-c933-4603-9ec9-b5dc07ba337f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:24.192735 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03c2d769-c933-4603-9ec9-b5dc07ba337f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:24.193695 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03c2d769-c933-4603-9ec9-b5dc07ba337f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:24.194406 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03c2d769-c933-4603-9ec9-b5dc07ba337f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:24.195055 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03c2d769-c933-4603-9ec9-b5dc07ba337f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:24.431211 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-917d72b0-185f-4541-8768-f03e225ddd0c tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5bf48d039ca4ce489212ef340ddb5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7647e0ee82f148c6a4c138842d8fbf69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:24.442975 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-917d72b0-185f-4541-8768-f03e225ddd0c tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] 10.222.0.50 "GET /compute/v2.1/servers/bfb43b5d-9803-4760-8f51-f3bb651636a3" status: 200 len: 1323 microversion: 2.1 time: 0.927071 Aug 31 16:13:24.443719 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2380/4552] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:23 2022] GET /compute/v2.1/servers/bfb43b5d-9803-4760-8f51-f3bb651636a3 => generated 1323 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:24.449833 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-07c4e3c5-7026-40ea-8797-4a58240fab17 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:24.450728 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-07c4e3c5-7026-40ea-8797-4a58240fab17 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] [instance: 98beddf9-f152-4a63-98ac-fc3a9a1c9b63] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:24.458401 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-07c4e3c5-7026-40ea-8797-4a58240fab17 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:24.459482 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-07c4e3c5-7026-40ea-8797-4a58240fab17 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:24.459924 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-07c4e3c5-7026-40ea-8797-4a58240fab17 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:24.460655 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-07c4e3c5-7026-40ea-8797-4a58240fab17 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:24.461124 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-07c4e3c5-7026-40ea-8797-4a58240fab17 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:24.461545 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-07c4e3c5-7026-40ea-8797-4a58240fab17 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:24.754038 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-03c2d769-c933-4603-9ec9-b5dc07ba337f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:24.765442 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-03c2d769-c933-4603-9ec9-b5dc07ba337f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/33170fbc-0d84-4284-9f70-dedb91f0d295" status: 200 len: 1516 microversion: 2.1 time: 0.606904 Aug 31 16:13:24.782414 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2173/4553] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:24 2022] GET /compute/v2.1/servers/33170fbc-0d84-4284-9f70-dedb91f0d295 => generated 1516 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:24.945602 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-07c4e3c5-7026-40ea-8797-4a58240fab17 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7fa51caf47428fb0e89e2050b64211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c66bcd5e83f4ea89afa84ff947a36e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:24.962050 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-07c4e3c5-7026-40ea-8797-4a58240fab17 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] 10.222.0.50 "GET /compute/v2.1/servers/98beddf9-f152-4a63-98ac-fc3a9a1c9b63" status: 200 len: 1470 microversion: 2.1 time: 0.516091 Aug 31 16:13:24.979997 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2381/4554] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:24 2022] GET /compute/v2.1/servers/98beddf9-f152-4a63-98ac-fc3a9a1c9b63 => generated 1470 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:25.152870 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-16d37816-09a7-474d-82a9-79c546745cf9 req-71e7e469-9674-46e3-ad3f-9c6c20ea522b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a118055-6c34-44a8-a30e-f5ff8bb66fba", "name": "network-vif-deleted", "tag": "92575430-e651-4c65-8cb7-1a46cc1ff965"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:25.170795 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-16d37816-09a7-474d-82a9-79c546745cf9 req-71e7e469-9674-46e3-ad3f-9c6c20ea522b service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:25.182797 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-16d37816-09a7-474d-82a9-79c546745cf9 req-71e7e469-9674-46e3-ad3f-9c6c20ea522b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:25.183950 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-16d37816-09a7-474d-82a9-79c546745cf9 req-71e7e469-9674-46e3-ad3f-9c6c20ea522b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:25.185583 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-953f4efd-8b5d-421a-924d-0b9b2c424803 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:25.186559 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-953f4efd-8b5d-421a-924d-0b9b2c424803 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] [instance: 7a118055-6c34-44a8-a30e-f5ff8bb66fba] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:25.200050 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-953f4efd-8b5d-421a-924d-0b9b2c424803 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:25.200855 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-953f4efd-8b5d-421a-924d-0b9b2c424803 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:25.201513 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-953f4efd-8b5d-421a-924d-0b9b2c424803 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:25.205001 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-953f4efd-8b5d-421a-924d-0b9b2c424803 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:25.205675 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-953f4efd-8b5d-421a-924d-0b9b2c424803 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:25.206322 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-953f4efd-8b5d-421a-924d-0b9b2c424803 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:25.220856 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-16d37816-09a7-474d-82a9-79c546745cf9 req-71e7e469-9674-46e3-ad3f-9c6c20ea522b service nova] Creating event network-vif-deleted:92575430-e651-4c65-8cb7-1a46cc1ff965 for instance 7a118055-6c34-44a8-a30e-f5ff8bb66fba on n-h1-833090-16 Aug 31 16:13:25.235008 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-16d37816-09a7-474d-82a9-79c546745cf9 req-71e7e469-9674-46e3-ad3f-9c6c20ea522b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088420 Aug 31 16:13:25.238717 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2174/4555] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:25.294715 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-953f4efd-8b5d-421a-924d-0b9b2c424803 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:25.296489 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-953f4efd-8b5d-421a-924d-0b9b2c424803 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:25.297342 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-953f4efd-8b5d-421a-924d-0b9b2c424803 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:25.298360 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-953f4efd-8b5d-421a-924d-0b9b2c424803 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lazy-loading 'fault' on Instance uuid 7a118055-6c34-44a8-a30e-f5ff8bb66fba {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:13:25.468133 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-312574df-5414-4e98-9a84-6f1f7b08cd5b tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:25.469274 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-312574df-5414-4e98-9a84-6f1f7b08cd5b tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] [instance: bfb43b5d-9803-4760-8f51-f3bb651636a3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:25.485875 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-312574df-5414-4e98-9a84-6f1f7b08cd5b tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:25.486841 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-312574df-5414-4e98-9a84-6f1f7b08cd5b tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:25.489317 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-312574df-5414-4e98-9a84-6f1f7b08cd5b tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:25.490567 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-312574df-5414-4e98-9a84-6f1f7b08cd5b tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:25.491764 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-312574df-5414-4e98-9a84-6f1f7b08cd5b tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:25.493873 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-312574df-5414-4e98-9a84-6f1f7b08cd5b tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:25.557698 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-953f4efd-8b5d-421a-924d-0b9b2c424803 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ecd9e924c54474690f780576adc3a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b4f8a1c71745c6b860b5723acf164b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:25.569187 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-953f4efd-8b5d-421a-924d-0b9b2c424803 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ecd9e924c54474690f780576adc3a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b4f8a1c71745c6b860b5723acf164b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:25.573593 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-953f4efd-8b5d-421a-924d-0b9b2c424803 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ecd9e924c54474690f780576adc3a86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90b4f8a1c71745c6b860b5723acf164b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:25.582957 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-953f4efd-8b5d-421a-924d-0b9b2c424803 tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] 10.222.0.50 "GET /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba" status: 200 len: 1352 microversion: 2.26 time: 0.401417 Aug 31 16:13:25.583567 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2382/4556] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:13:25 2022] GET /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba => generated 1352 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:13:25.790660 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e6c6ae96-20ad-4a9f-b4c7-a842ef4a683e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:25.791809 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e6c6ae96-20ad-4a9f-b4c7-a842ef4a683e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 33170fbc-0d84-4284-9f70-dedb91f0d295] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:25.810134 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6c6ae96-20ad-4a9f-b4c7-a842ef4a683e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:25.813751 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6c6ae96-20ad-4a9f-b4c7-a842ef4a683e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:25.815717 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6c6ae96-20ad-4a9f-b4c7-a842ef4a683e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:25.816568 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6c6ae96-20ad-4a9f-b4c7-a842ef4a683e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:25.819102 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6c6ae96-20ad-4a9f-b4c7-a842ef4a683e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:25.819629 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6c6ae96-20ad-4a9f-b4c7-a842ef4a683e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:25.912675 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6c6ae96-20ad-4a9f-b4c7-a842ef4a683e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:25.913278 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6c6ae96-20ad-4a9f-b4c7-a842ef4a683e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:25.913792 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6c6ae96-20ad-4a9f-b4c7-a842ef4a683e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:25.914352 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-e6c6ae96-20ad-4a9f-b4c7-a842ef4a683e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lazy-loading 'fault' on Instance uuid 33170fbc-0d84-4284-9f70-dedb91f0d295 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:13:25.923382 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-312574df-5414-4e98-9a84-6f1f7b08cd5b tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5bf48d039ca4ce489212ef340ddb5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7647e0ee82f148c6a4c138842d8fbf69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:25.934667 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-312574df-5414-4e98-9a84-6f1f7b08cd5b tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] 10.222.0.50 "GET /compute/v2.1/servers/bfb43b5d-9803-4760-8f51-f3bb651636a3" status: 200 len: 1323 microversion: 2.1 time: 0.473131 Aug 31 16:13:25.953333 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2175/4557] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:25 2022] GET /compute/v2.1/servers/bfb43b5d-9803-4760-8f51-f3bb651636a3 => generated 1323 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:13:25.965882 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-6e8b2d8c-7a6a-4a07-82cb-e2eb39235733 req-28852a9b-d1f7-47b0-ba9f-68854b265ee9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98beddf9-f152-4a63-98ac-fc3a9a1c9b63", "name": "network-vif-deleted", "tag": "1d0f47ad-5c5d-4ec7-9753-fd7a8837b4c5"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:25.990044 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e6c6ae96-20ad-4a9f-b4c7-a842ef4a683e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:25.990662 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-6e8b2d8c-7a6a-4a07-82cb-e2eb39235733 req-28852a9b-d1f7-47b0-ba9f-68854b265ee9 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:25.990936 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-6e8b2d8c-7a6a-4a07-82cb-e2eb39235733 req-28852a9b-d1f7-47b0-ba9f-68854b265ee9 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:25.991371 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-6e8b2d8c-7a6a-4a07-82cb-e2eb39235733 req-28852a9b-d1f7-47b0-ba9f-68854b265ee9 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:26.004037 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e6c6ae96-20ad-4a9f-b4c7-a842ef4a683e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/33170fbc-0d84-4284-9f70-dedb91f0d295" status: 200 len: 1319 microversion: 2.1 time: 0.215322 Aug 31 16:13:26.005799 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2383/4558] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:25 2022] GET /compute/v2.1/servers/33170fbc-0d84-4284-9f70-dedb91f0d295 => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:26.024358 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-6e8b2d8c-7a6a-4a07-82cb-e2eb39235733 req-28852a9b-d1f7-47b0-ba9f-68854b265ee9 service nova] Creating event network-vif-deleted:1d0f47ad-5c5d-4ec7-9753-fd7a8837b4c5 for instance 98beddf9-f152-4a63-98ac-fc3a9a1c9b63 on n-h1-833090-16 Aug 31 16:13:26.031581 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-6e8b2d8c-7a6a-4a07-82cb-e2eb39235733 req-28852a9b-d1f7-47b0-ba9f-68854b265ee9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074340 Aug 31 16:13:26.032497 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2176/4559] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:26.035259 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-438300a1-230f-4666-a5c2-34df3f2b4c79 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:26.043003 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-438300a1-230f-4666-a5c2-34df3f2b4c79 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] [instance: 98beddf9-f152-4a63-98ac-fc3a9a1c9b63] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:26.045896 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-29fef4d3-c991-4794-9e1f-11b0ef66ad4d req-87fb6f93-beda-4808-a594-7042b4ab5092 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfb43b5d-9803-4760-8f51-f3bb651636a3", "name": "network-vif-plugged", "status": "completed", "tag": "a0afdea8-7072-4a93-bc57-51f913c8f67f"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:26.057168 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-29fef4d3-c991-4794-9e1f-11b0ef66ad4d req-87fb6f93-beda-4808-a594-7042b4ab5092 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:26.057656 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-29fef4d3-c991-4794-9e1f-11b0ef66ad4d req-87fb6f93-beda-4808-a594-7042b4ab5092 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:26.058137 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-29fef4d3-c991-4794-9e1f-11b0ef66ad4d req-87fb6f93-beda-4808-a594-7042b4ab5092 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:26.060144 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-438300a1-230f-4666-a5c2-34df3f2b4c79 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:26.060638 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-438300a1-230f-4666-a5c2-34df3f2b4c79 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:26.062874 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-438300a1-230f-4666-a5c2-34df3f2b4c79 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:26.065691 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-438300a1-230f-4666-a5c2-34df3f2b4c79 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:26.066191 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-438300a1-230f-4666-a5c2-34df3f2b4c79 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:26.066622 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-438300a1-230f-4666-a5c2-34df3f2b4c79 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:26.094703 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-29fef4d3-c991-4794-9e1f-11b0ef66ad4d req-87fb6f93-beda-4808-a594-7042b4ab5092 service nova] Creating event network-vif-plugged:a0afdea8-7072-4a93-bc57-51f913c8f67f for instance bfb43b5d-9803-4760-8f51-f3bb651636a3 on n-h1-833090-16 Aug 31 16:13:26.100837 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-29fef4d3-c991-4794-9e1f-11b0ef66ad4d req-87fb6f93-beda-4808-a594-7042b4ab5092 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059386 Aug 31 16:13:26.104351 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2177/4560] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:26.150346 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:13:26.188385 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-438300a1-230f-4666-a5c2-34df3f2b4c79 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:26.188962 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-438300a1-230f-4666-a5c2-34df3f2b4c79 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:26.189613 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-438300a1-230f-4666-a5c2-34df3f2b4c79 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:26.195131 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-438300a1-230f-4666-a5c2-34df3f2b4c79 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lazy-loading 'fault' on Instance uuid 98beddf9-f152-4a63-98ac-fc3a9a1c9b63 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:13:26.262495 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-438300a1-230f-4666-a5c2-34df3f2b4c79 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae7fa51caf47428fb0e89e2050b64211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c66bcd5e83f4ea89afa84ff947a36e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:26.272387 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-438300a1-230f-4666-a5c2-34df3f2b4c79 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] 10.222.0.50 "GET /compute/v2.1/servers/98beddf9-f152-4a63-98ac-fc3a9a1c9b63" status: 200 len: 1304 microversion: 2.1 time: 0.265471 Aug 31 16:13:26.273247 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2384/4561] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:26 2022] GET /compute/v2.1/servers/98beddf9-f152-4a63-98ac-fc3a9a1c9b63 => generated 1304 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:26.314340 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-433a1a9c-3445-420c-9aec-e3f949566d69 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1581426100", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a76d6272-2ae3-4409-a447-8c2fdf7af56f"}], "security_groups": [{"name": "tempest-securitygroup--1869873455"}], "key_name": "tempest-keypair-1689424413", "user_data": "}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:26.521582 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-433a1a9c-3445-420c-9aec-e3f949566d69 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] validate_networks() for [('a76d6272-2ae3-4409-a447-8c2fdf7af56f', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:13:26.616119 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-449d4021-8ee7-465d-8990-1a7406ce4a3a tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:26.617391 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-449d4021-8ee7-465d-8990-1a7406ce4a3a tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] [instance: 7a118055-6c34-44a8-a30e-f5ff8bb66fba] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:26.638435 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-449d4021-8ee7-465d-8990-1a7406ce4a3a tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:26.639546 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-449d4021-8ee7-465d-8990-1a7406ce4a3a tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:26.641313 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-449d4021-8ee7-465d-8990-1a7406ce4a3a tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:26.642854 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-449d4021-8ee7-465d-8990-1a7406ce4a3a tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:26.643803 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-449d4021-8ee7-465d-8990-1a7406ce4a3a tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:26.644712 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-449d4021-8ee7-465d-8990-1a7406ce4a3a tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:26.681739 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-449d4021-8ee7-465d-8990-1a7406ce4a3a tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] HTTP exception thrown: Instance 7a118055-6c34-44a8-a30e-f5ff8bb66fba could not be found. Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-449d4021-8ee7-465d-8990-1a7406ce4a3a tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Request method failure captured: Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba HTTP/1.1 Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4iDIBIOFy7jrf0pI7F7dHIAC6Pd-IzNmQMQoxV4SxCrZiLzp7-k5wd0vhPXxRG_UTC5DismWBCL386etBksQxy-igsJBbxGm2bAr_spfLKgnA6brZ3QeBqYL2Y7eLZdo-lkIvRSed2mByPBYVpsrH5FE97mFiYlVTDBdIRfs1wdm7g Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: X-Openstack-Nova-Api-Version: 2.26 Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 90b4f8a1c71745c6b860b5723acf164b Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServerTagsTestJSON-664621102 Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/90b4f8a1c71745c6b860b5723acf164b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/90b4f8a1c71745c6b860b5723acf164b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/90b4f8a1c71745c6b860b5723acf164b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_90b4f8a1c71745c6b860b5723acf164b", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServerTagsTestJSON-664621102 Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 90b4f8a1c71745c6b860b5723acf164b Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServerTagsTestJSON-664621102 Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServerTagsTestJSON-664621102-project Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 6ecd9e924c54474690f780576adc3a86 Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServerTagsTestJSON-664621102-project Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 7a118055-6c34-44a8-a30e-f5ff8bb66fba could not be found. Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '7a118055-6c34-44a8-a30e-f5ff8bb66fba'} Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a118055-6c34-44a8-a30e-f5ff8bb66fba could not be found. Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a118055-6c34-44a8-a30e-f5ff8bb66fba could not be found. Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:26.688739 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:26.699212 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:26.699212 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:26.699212 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:26.699212 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:13:26.699212 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:13:26.699212 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a118055-6c34-44a8-a30e-f5ff8bb66fba could not be found. Aug 31 16:13:26.699212 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:26.700879 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-449d4021-8ee7-465d-8990-1a7406ce4a3a tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] Returning 404 to user: Instance 7a118055-6c34-44a8-a30e-f5ff8bb66fba could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:13:26.701317 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-449d4021-8ee7-465d-8990-1a7406ce4a3a tempest-ServerTagsTestJSON-664621102 tempest-ServerTagsTestJSON-664621102-project] 10.222.0.50 "GET /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba" status: 404 len: 111 microversion: 2.26 time: 0.093909 Aug 31 16:13:26.709276 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2385/4562] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:13:26 2022] GET /compute/v2.1/servers/7a118055-6c34-44a8-a30e-f5ff8bb66fba => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 31 16:13:26.960579 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-21c3f243-68d6-4eef-947a-eeb7c139faa4 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:26.961221 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-21c3f243-68d6-4eef-947a-eeb7c139faa4 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] [instance: bfb43b5d-9803-4760-8f51-f3bb651636a3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:26.969667 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-21c3f243-68d6-4eef-947a-eeb7c139faa4 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:26.970424 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-21c3f243-68d6-4eef-947a-eeb7c139faa4 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:26.971071 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-21c3f243-68d6-4eef-947a-eeb7c139faa4 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:26.972114 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-21c3f243-68d6-4eef-947a-eeb7c139faa4 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:26.972720 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-21c3f243-68d6-4eef-947a-eeb7c139faa4 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:26.973459 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-21c3f243-68d6-4eef-947a-eeb7c139faa4 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:27.430906 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-21c3f243-68d6-4eef-947a-eeb7c139faa4 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5bf48d039ca4ce489212ef340ddb5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7647e0ee82f148c6a4c138842d8fbf69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:27.456125 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-21c3f243-68d6-4eef-947a-eeb7c139faa4 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] 10.222.0.50 "GET /compute/v2.1/servers/bfb43b5d-9803-4760-8f51-f3bb651636a3" status: 200 len: 1323 microversion: 2.1 time: 0.499944 Aug 31 16:13:27.460922 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2386/4563] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:26 2022] GET /compute/v2.1/servers/bfb43b5d-9803-4760-8f51-f3bb651636a3 => generated 1323 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:13:27.469740 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0788617e-5e11-4ce0-a494-841545062ca6 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:27.470454 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0788617e-5e11-4ce0-a494-841545062ca6 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 33170fbc-0d84-4284-9f70-dedb91f0d295] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:27.477470 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0788617e-5e11-4ce0-a494-841545062ca6 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:27.478040 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0788617e-5e11-4ce0-a494-841545062ca6 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:27.478562 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0788617e-5e11-4ce0-a494-841545062ca6 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:27.479693 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0788617e-5e11-4ce0-a494-841545062ca6 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:27.480378 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0788617e-5e11-4ce0-a494-841545062ca6 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:27.480958 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0788617e-5e11-4ce0-a494-841545062ca6 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:27.498640 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-0788617e-5e11-4ce0-a494-841545062ca6 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] HTTP exception thrown: Instance 33170fbc-0d84-4284-9f70-dedb91f0d295 could not be found. Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0788617e-5e11-4ce0-a494-841545062ca6 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Request method failure captured: Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/33170fbc-0d84-4284-9f70-dedb91f0d295 HTTP/1.1 Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4fcRMLera6TLJp6OFOd_B19-rdZe1qr5LTGcbsBroFhPQ8_L89JW9hpsNJPnNpQCXW4WKWxdTwWZTYVgRah_OPLrb5JBnrA64ZgN8VfXgRvkXORTfvSkZvZgjCL7371tDtPpfcPNp0NcyRfiYHxIldtsDdYZVFbQTa8WMsjzib7kZ0 Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 84f42648e1a343b9a5ab9b89c91bea0d Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServersTestJSON-1527984429 Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_84f42648e1a343b9a5ab9b89c91bea0d", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServersTestJSON-1527984429 Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 84f42648e1a343b9a5ab9b89c91bea0d Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServersTestJSON-1527984429 Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServersTestJSON-1527984429-project Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 3ebce87993504550914c2c3702eebb17 Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServersTestJSON-1527984429-project Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 33170fbc-0d84-4284-9f70-dedb91f0d295 could not be found. Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '33170fbc-0d84-4284-9f70-dedb91f0d295'} Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33170fbc-0d84-4284-9f70-dedb91f0d295 could not be found. Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33170fbc-0d84-4284-9f70-dedb91f0d295 could not be found. Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:27.500491 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:27.508077 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:27.508077 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:27.508077 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:27.508077 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:13:27.508077 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:13:27.508077 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33170fbc-0d84-4284-9f70-dedb91f0d295 could not be found. Aug 31 16:13:27.508077 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:27.508077 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0788617e-5e11-4ce0-a494-841545062ca6 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Returning 404 to user: Instance 33170fbc-0d84-4284-9f70-dedb91f0d295 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:13:27.508077 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0788617e-5e11-4ce0-a494-841545062ca6 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/33170fbc-0d84-4284-9f70-dedb91f0d295" status: 404 len: 111 microversion: 2.1 time: 0.037189 Aug 31 16:13:27.508077 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2387/4564] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:27 2022] GET /compute/v2.1/servers/33170fbc-0d84-4284-9f70-dedb91f0d295 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:13:27.508077 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-1717485b-1966-4fd5-8887-d9ca58f7f3a3 req-e5155c3e-6cd8-47e9-af4b-fcf358886e0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33170fbc-0d84-4284-9f70-dedb91f0d295", "name": "network-vif-deleted", "tag": "5ed6e8f2-f1f7-413d-84bb-c5271687ea60"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:27.518197 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-1717485b-1966-4fd5-8887-d9ca58f7f3a3 req-e5155c3e-6cd8-47e9-af4b-fcf358886e0f service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:27.518680 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-1717485b-1966-4fd5-8887-d9ca58f7f3a3 req-e5155c3e-6cd8-47e9-af4b-fcf358886e0f service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:27.519143 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-1717485b-1966-4fd5-8887-d9ca58f7f3a3 req-e5155c3e-6cd8-47e9-af4b-fcf358886e0f service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:27.535021 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-1717485b-1966-4fd5-8887-d9ca58f7f3a3 req-e5155c3e-6cd8-47e9-af4b-fcf358886e0f service nova] Creating event network-vif-deleted:5ed6e8f2-f1f7-413d-84bb-c5271687ea60 for instance 33170fbc-0d84-4284-9f70-dedb91f0d295 on n-h1-833090-16 Aug 31 16:13:27.540149 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-1717485b-1966-4fd5-8887-d9ca58f7f3a3 req-e5155c3e-6cd8-47e9-af4b-fcf358886e0f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036553 Aug 31 16:13:27.541482 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2388/4565] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:13:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:27.548678 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fb35e2a7-e802-4b34-b02f-596c26a480e4 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:27.551014 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fb35e2a7-e802-4b34-b02f-596c26a480e4 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] [instance: 98beddf9-f152-4a63-98ac-fc3a9a1c9b63] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:27.559355 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb35e2a7-e802-4b34-b02f-596c26a480e4 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:27.559921 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb35e2a7-e802-4b34-b02f-596c26a480e4 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:27.560302 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb35e2a7-e802-4b34-b02f-596c26a480e4 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:27.561006 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb35e2a7-e802-4b34-b02f-596c26a480e4 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:27.561464 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb35e2a7-e802-4b34-b02f-596c26a480e4 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:27.561887 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb35e2a7-e802-4b34-b02f-596c26a480e4 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:27.578247 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-fb35e2a7-e802-4b34-b02f-596c26a480e4 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] HTTP exception thrown: Instance 98beddf9-f152-4a63-98ac-fc3a9a1c9b63 could not be found. Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fb35e2a7-e802-4b34-b02f-596c26a480e4 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Request method failure captured: Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/98beddf9-f152-4a63-98ac-fc3a9a1c9b63 HTTP/1.1 Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4iLsRGwp--WVWMSolarG69ArqjGJjXiG6vS-H1y8UON3OEMhnfNGvWK1-xezy1I1z-beOu9dY-QPnS9_iPje6-2wP9ie2Zfbl-sjSlz64_prWngsE0NO3Mp1sZ7DSiypJYdNcdIWOOQDiMW_hpAYcVtoAeSOMvHkLZWM5z2VdQmLxo Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 1c66bcd5e83f4ea89afa84ff947a36e6 Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-TenantUsagesTestJSON-2070368804 Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1c66bcd5e83f4ea89afa84ff947a36e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1c66bcd5e83f4ea89afa84ff947a36e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/1c66bcd5e83f4ea89afa84ff947a36e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_1c66bcd5e83f4ea89afa84ff947a36e6", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-TenantUsagesTestJSON-2070368804 Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 1c66bcd5e83f4ea89afa84ff947a36e6 Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-TenantUsagesTestJSON-2070368804 Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-TenantUsagesTestJSON-2070368804-project Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: ae7fa51caf47428fb0e89e2050b64211 Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-TenantUsagesTestJSON-2070368804-project Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 98beddf9-f152-4a63-98ac-fc3a9a1c9b63 could not be found. Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '98beddf9-f152-4a63-98ac-fc3a9a1c9b63'} Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98beddf9-f152-4a63-98ac-fc3a9a1c9b63 could not be found. Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98beddf9-f152-4a63-98ac-fc3a9a1c9b63 could not be found. Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:27.579934 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:27.584869 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:27.584869 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:27.584869 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:27.584869 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:13:27.584869 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:13:27.584869 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98beddf9-f152-4a63-98ac-fc3a9a1c9b63 could not be found. Aug 31 16:13:27.584869 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:27.584869 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fb35e2a7-e802-4b34-b02f-596c26a480e4 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] Returning 404 to user: Instance 98beddf9-f152-4a63-98ac-fc3a9a1c9b63 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:13:27.584869 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fb35e2a7-e802-4b34-b02f-596c26a480e4 tempest-TenantUsagesTestJSON-2070368804 tempest-TenantUsagesTestJSON-2070368804-project] 10.222.0.50 "GET /compute/v2.1/servers/98beddf9-f152-4a63-98ac-fc3a9a1c9b63" status: 404 len: 111 microversion: 2.1 time: 0.037979 Aug 31 16:13:27.584869 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2389/4566] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:27 2022] GET /compute/v2.1/servers/98beddf9-f152-4a63-98ac-fc3a9a1c9b63 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:13:27.586688 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-81975d59-9551-4a52-876b-c04c66af8f96 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-147666292", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "00194b7c-6891-4cf9-8c59-235de2b40a38"}]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:27.644503 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-81975d59-9551-4a52-876b-c04c66af8f96 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] validate_networks() for [('00194b7c-6891-4cf9-8c59-235de2b40a38', None, None, None, None, None)] {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:13:27.693540 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-433a1a9c-3445-420c-9aec-e3f949566d69 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:13:27.694068 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-433a1a9c-3445-420c-9aec-e3f949566d69 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:13:27.695066 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-433a1a9c-3445-420c-9aec-e3f949566d69 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:13:27.695557 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-433a1a9c-3445-420c-9aec-e3f949566d69 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:13:27.696035 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-433a1a9c-3445-420c-9aec-e3f949566d69 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:13:27.706961 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-433a1a9c-3445-420c-9aec-e3f949566d69 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:27.707742 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-433a1a9c-3445-420c-9aec-e3f949566d69 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:27.708222 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-433a1a9c-3445-420c-9aec-e3f949566d69 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:27.708957 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-433a1a9c-3445-420c-9aec-e3f949566d69 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:27.709414 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-433a1a9c-3445-420c-9aec-e3f949566d69 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:27.709837 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-433a1a9c-3445-420c-9aec-e3f949566d69 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:27.731743 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-433a1a9c-3445-420c-9aec-e3f949566d69 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Getting quotas for project d25e1b1938b2401bab27dafadc9745d5. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:13:27.737527 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-433a1a9c-3445-420c-9aec-e3f949566d69 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Getting quotas for user b5f67b54e87c46d28e7d5217bf49ca57 and project d25e1b1938b2401bab27dafadc9745d5. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:13:27.751225 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-433a1a9c-3445-420c-9aec-e3f949566d69 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:13:27.753780 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-433a1a9c-3445-420c-9aec-e3f949566d69 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 1c40a98f-366d-4392-9034-7841f68b2050] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:13:27.848999 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-433a1a9c-3445-420c-9aec-e3f949566d69 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.541924 Aug 31 16:13:27.850274 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2178/4567] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:13:26 2022] POST /compute/v2.1/servers => generated 409 bytes in 1544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:13:27.868475 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9b5d1960-1998-4cea-8a95-74eadb4544a7 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:27.869266 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9b5d1960-1998-4cea-8a95-74eadb4544a7 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 1c40a98f-366d-4392-9034-7841f68b2050] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:28.120908 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=4 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:13:28.246906 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9b5d1960-1998-4cea-8a95-74eadb4544a7 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:28.262261 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9b5d1960-1998-4cea-8a95-74eadb4544a7 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050" status: 200 len: 1246 microversion: 2.1 time: 0.401419 Aug 31 16:13:28.272425 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2179/4568] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:27 2022] GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050 => generated 1246 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:28.476616 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-12e88d4a-75a6-4369-812e-6255fa2d1ee7 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:28.477607 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-12e88d4a-75a6-4369-812e-6255fa2d1ee7 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] [instance: bfb43b5d-9803-4760-8f51-f3bb651636a3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:28.481171 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:13:28.507951 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12e88d4a-75a6-4369-812e-6255fa2d1ee7 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:28.515390 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12e88d4a-75a6-4369-812e-6255fa2d1ee7 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:28.516289 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12e88d4a-75a6-4369-812e-6255fa2d1ee7 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:28.517662 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12e88d4a-75a6-4369-812e-6255fa2d1ee7 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:28.518629 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12e88d4a-75a6-4369-812e-6255fa2d1ee7 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:28.519490 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12e88d4a-75a6-4369-812e-6255fa2d1ee7 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:28.606081 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:13:29.056581 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-12e88d4a-75a6-4369-812e-6255fa2d1ee7 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5bf48d039ca4ce489212ef340ddb5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7647e0ee82f148c6a4c138842d8fbf69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:29.075264 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-12e88d4a-75a6-4369-812e-6255fa2d1ee7 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] 10.222.0.50 "GET /compute/v2.1/servers/bfb43b5d-9803-4760-8f51-f3bb651636a3" status: 200 len: 1520 microversion: 2.1 time: 0.603297 Aug 31 16:13:29.092148 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2180/4569] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:28 2022] GET /compute/v2.1/servers/bfb43b5d-9803-4760-8f51-f3bb651636a3 => generated 1520 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:13:29.238557 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6c161c6c-fe8d-4837-b409-dc6bfe6149d2 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-793357361", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "582a921e-879d-4256-a61c-34cd54e0cb07"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:29.244191 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6c161c6c-fe8d-4837-b409-dc6bfe6149d2 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Request method failure captured: Aug 31 16:13:29.244191 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 31 16:13:29.244191 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:13:29.244191 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:13:29.244191 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:13:29.244191 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 242 Aug 31 16:13:29.244191 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:13:29.244191 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:13:29.244191 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:13:29.244191 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:13:29.244191 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4iXaMjLB2-0bRZCrT6_sfdbgTDrsgjrtWo_V4S2VwlmSr8l1PckkbKjDcK8Uxx5TkESdx6v1T_qwEgBH9n-NYsYTjaxm8-96yTFCeQdTcXr0lNlbShNsDihMTHo5DCNOCAXB_wlA71KRK04AINBwIYKs_dRfczSvHNJMCjjtvJpCtc Aug 31 16:13:29.244191 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:13:29.244191 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:13:29.244191 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:13:29.244191 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:13:29.244191 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:13:29.244191 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:13:29.244191 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 7647e0ee82f148c6a4c138842d8fbf69 Aug 31 16:13:29.244191 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1919896754 Aug 31 16:13:29.244191 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:13:29.244191 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:13:29.244191 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7647e0ee82f148c6a4c138842d8fbf69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7647e0ee82f148c6a4c138842d8fbf69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7647e0ee82f148c6a4c138842d8fbf69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7647e0ee82f148c6a4c138842d8fbf69", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:13:29.244191 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1919896754 Aug 31 16:13:29.244191 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 7647e0ee82f148c6a4c138842d8fbf69 Aug 31 16:13:29.244191 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1919896754 Aug 31 16:13:29.244191 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServerMetadataNegativeTestJSON-1919896754-project Aug 31 16:13:29.244191 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:13:29.244191 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:13:29.244191 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: f5bf48d039ca4ce489212ef340ddb5ce Aug 31 16:13:29.244191 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1919896754-project Aug 31 16:13:29.244191 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 16:13:29.244191 n-d-833090-16 devstack@n-api.service[128863]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-793357361", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "582a921e-879d-4256-a61c-34cd54e0cb07"}]}} Aug 31 16:13:29.244191 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:13:29.244191 n-d-833090-16 devstack@n-api.service[128863]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 31 16:13:29.244191 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-793357361', 'imageRef': 'd715a41c-0e56-494a-a102-cac65831f6bd', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '582a921e-879d-4256-a61c-34cd54e0cb07'}]}}} Aug 31 16:13:29.244191 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:13:29.244191 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:29.244191 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:13:29.244191 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:13:29.244191 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:13:29.244191 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:13:29.244191 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 31 16:13:29.244191 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:29.244191 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 31 16:13:29.244191 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 31 16:13:29.244191 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 31 16:13:29.244191 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 31 16:13:29.244191 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 31 16:13:29.244191 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:29.244191 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 31 16:13:29.244191 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi {'': 'data1'} Aug 31 16:13:29.244191 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:29.244191 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:29.244191 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:29.244191 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:29.244191 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:29.244191 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:29.244191 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:13:29.244191 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:13:29.244191 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:13:29.244191 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:13:29.244191 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:13:29.249086 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:13:29.249086 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 16:13:29.249086 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 16:13:29.249086 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:13:29.249086 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:13:29.249086 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:13:29.249086 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:13:29.249086 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 31 16:13:29.249086 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:29.249086 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:29.249086 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:29.249086 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:29.249086 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:29.249086 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:29.249086 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:13:29.249086 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:13:29.249086 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 31 16:13:29.249086 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:29.251429 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6c161c6c-fe8d-4837-b409-dc6bfe6149d2 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:13:29.254003 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6c161c6c-fe8d-4837-b409-dc6bfe6149d2 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.020107 Aug 31 16:13:29.260886 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2181/4570] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:13:29 2022] POST /compute/v2.1/servers => generated 175 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:13:29.266239 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-51978b67-e7b9-4fae-b2af-d62b800e15d5 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:29.266733 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-51978b67-e7b9-4fae-b2af-d62b800e15d5 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] [instance: 3e2c9481-2582-4ce8-8e4e-1be2e7d552f1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:29.275038 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-51978b67-e7b9-4fae-b2af-d62b800e15d5 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] HTTP exception thrown: Instance 3e2c9481-2582-4ce8-8e4e-1be2e7d552f1 could not be found. Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-51978b67-e7b9-4fae-b2af-d62b800e15d5 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Request method failure captured: Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/3e2c9481-2582-4ce8-8e4e-1be2e7d552f1/metadata HTTP/1.1 Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4iXaMjLB2-0bRZCrT6_sfdbgTDrsgjrtWo_V4S2VwlmSr8l1PckkbKjDcK8Uxx5TkESdx6v1T_qwEgBH9n-NYsYTjaxm8-96yTFCeQdTcXr0lNlbShNsDihMTHo5DCNOCAXB_wlA71KRK04AINBwIYKs_dRfczSvHNJMCjjtvJpCtc Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 7647e0ee82f148c6a4c138842d8fbf69 Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1919896754 Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7647e0ee82f148c6a4c138842d8fbf69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7647e0ee82f148c6a4c138842d8fbf69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7647e0ee82f148c6a4c138842d8fbf69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7647e0ee82f148c6a4c138842d8fbf69", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1919896754 Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 7647e0ee82f148c6a4c138842d8fbf69 Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1919896754 Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServerMetadataNegativeTestJSON-1919896754-project Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: f5bf48d039ca4ce489212ef340ddb5ce Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1919896754-project Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 3e2c9481-2582-4ce8-8e4e-1be2e7d552f1 could not be found. Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'server_id': '3e2c9481-2582-4ce8-8e4e-1be2e7d552f1'} Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e2c9481-2582-4ce8-8e4e-1be2e7d552f1 could not be found. Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e2c9481-2582-4ce8-8e4e-1be2e7d552f1 could not be found. Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:29.283444 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:29.292946 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:13:29.292946 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:13:29.292946 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e2c9481-2582-4ce8-8e4e-1be2e7d552f1 could not be found. Aug 31 16:13:29.292946 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:29.292946 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-51978b67-e7b9-4fae-b2af-d62b800e15d5 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Returning 404 to user: Instance 3e2c9481-2582-4ce8-8e4e-1be2e7d552f1 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:13:29.292946 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-51978b67-e7b9-4fae-b2af-d62b800e15d5 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] 10.222.0.50 "GET /compute/v2.1/servers/3e2c9481-2582-4ce8-8e4e-1be2e7d552f1/metadata" status: 404 len: 111 microversion: 2.1 time: 0.023330 Aug 31 16:13:29.299379 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2182/4571] 10.222.0.50 () {58 vars in 1263 bytes} [Wed Aug 31 16:13:29 2022] GET /compute/v2.1/servers/3e2c9481-2582-4ce8-8e4e-1be2e7d552f1/metadata => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:13:29.336307 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c3afe9e9-5e8f-4780-9a3c-513c03cc363e tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:29.336926 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c3afe9e9-5e8f-4780-9a3c-513c03cc363e tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 1c40a98f-366d-4392-9034-7841f68b2050] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:29.360316 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3afe9e9-5e8f-4780-9a3c-513c03cc363e tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:29.361853 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-81975d59-9551-4a52-876b-c04c66af8f96 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:13:29.364811 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-81975d59-9551-4a52-876b-c04c66af8f96 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:13:29.366781 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-81975d59-9551-4a52-876b-c04c66af8f96 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:13:29.369977 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-81975d59-9551-4a52-876b-c04c66af8f96 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:13:29.370562 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-81975d59-9551-4a52-876b-c04c66af8f96 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:13:29.373153 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3afe9e9-5e8f-4780-9a3c-513c03cc363e tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:29.373631 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3afe9e9-5e8f-4780-9a3c-513c03cc363e tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:29.374359 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3afe9e9-5e8f-4780-9a3c-513c03cc363e tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:29.374851 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3afe9e9-5e8f-4780-9a3c-513c03cc363e tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:29.375274 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3afe9e9-5e8f-4780-9a3c-513c03cc363e tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:29.396248 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-81975d59-9551-4a52-876b-c04c66af8f96 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:29.397787 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-81975d59-9551-4a52-876b-c04c66af8f96 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:29.407823 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-81975d59-9551-4a52-876b-c04c66af8f96 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:29.409980 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-81975d59-9551-4a52-876b-c04c66af8f96 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:29.412212 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-81975d59-9551-4a52-876b-c04c66af8f96 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:29.412892 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-81975d59-9551-4a52-876b-c04c66af8f96 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:29.460767 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-81975d59-9551-4a52-876b-c04c66af8f96 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Getting quotas for project 84f42648e1a343b9a5ab9b89c91bea0d. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:13:29.477573 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-81975d59-9551-4a52-876b-c04c66af8f96 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Getting quotas for user 3ebce87993504550914c2c3702eebb17 and project 84f42648e1a343b9a5ab9b89c91bea0d. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:13:29.508808 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-81975d59-9551-4a52-876b-c04c66af8f96 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:13:29.518675 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-81975d59-9551-4a52-876b-c04c66af8f96 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ed9a700e-0de1-4ed3-993e-c0b6b293b02a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:13:29.547459 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c3afe9e9-5e8f-4780-9a3c-513c03cc363e tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:29.559112 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c3afe9e9-5e8f-4780-9a3c-513c03cc363e tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050" status: 200 len: 1306 microversion: 2.1 time: 0.257473 Aug 31 16:13:29.559853 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2183/4572] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:29 2022] GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050 => generated 1306 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:29.565263 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c695532c-4e29-4432-ab56-565da21df4a7 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-156880073", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "582a921e-879d-4256-a61c-34cd54e0cb07"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:29.570760 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c695532c-4e29-4432-ab56-565da21df4a7 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Request method failure captured: Aug 31 16:13:29.570760 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 31 16:13:29.570760 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:13:29.570760 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:13:29.570760 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:13:29.570760 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 498 Aug 31 16:13:29.570760 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:13:29.570760 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:13:29.570760 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:13:29.570760 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:13:29.570760 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4iXaMjLB2-0bRZCrT6_sfdbgTDrsgjrtWo_V4S2VwlmSr8l1PckkbKjDcK8Uxx5TkESdx6v1T_qwEgBH9n-NYsYTjaxm8-96yTFCeQdTcXr0lNlbShNsDihMTHo5DCNOCAXB_wlA71KRK04AINBwIYKs_dRfczSvHNJMCjjtvJpCtc Aug 31 16:13:29.570760 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:13:29.570760 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:13:29.570760 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:13:29.570760 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:13:29.570760 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:13:29.570760 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:13:29.570760 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 7647e0ee82f148c6a4c138842d8fbf69 Aug 31 16:13:29.570760 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1919896754 Aug 31 16:13:29.570760 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:13:29.570760 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:13:29.570760 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7647e0ee82f148c6a4c138842d8fbf69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7647e0ee82f148c6a4c138842d8fbf69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7647e0ee82f148c6a4c138842d8fbf69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7647e0ee82f148c6a4c138842d8fbf69", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:13:29.570760 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1919896754 Aug 31 16:13:29.570760 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 7647e0ee82f148c6a4c138842d8fbf69 Aug 31 16:13:29.570760 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1919896754 Aug 31 16:13:29.570760 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServerMetadataNegativeTestJSON-1919896754-project Aug 31 16:13:29.570760 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:13:29.570760 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:13:29.570760 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: f5bf48d039ca4ce489212ef340ddb5ce Aug 31 16:13:29.570760 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1919896754-project Aug 31 16:13:29.570760 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 16:13:29.570760 n-d-833090-16 devstack@n-api.service[128863]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-156880073", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "582a921e-879d-4256-a61c-34cd54e0cb07"}]}} Aug 31 16:13:29.570760 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:13:29.570760 n-d-833090-16 devstack@n-api.service[128863]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 31 16:13:29.570760 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-156880073', 'imageRef': 'd715a41c-0e56-494a-a102-cac65831f6bd', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '582a921e-879d-4256-a61c-34cd54e0cb07'}]}}} Aug 31 16:13:29.570760 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:13:29.570760 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:29.570760 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:13:29.570760 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:13:29.570760 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:13:29.570760 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:13:29.570760 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 31 16:13:29.570760 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:29.570760 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 31 16:13:29.570760 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 31 16:13:29.570760 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 31 16:13:29.570760 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 31 16:13:29.574355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 31 16:13:29.574355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:29.574355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 31 16:13:29.574355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 31 16:13:29.574355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:29.574355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:29.574355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:29.574355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:29.574355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:29.574355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:29.574355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:13:29.574355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:13:29.574355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:13:29.574355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:13:29.574355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:13:29.574355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:13:29.574355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 16:13:29.574355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 16:13:29.574355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:13:29.574355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:13:29.574355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:13:29.574355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:13:29.574355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 31 16:13:29.574355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:29.574355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:29.574355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:29.574355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:29.574355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:29.574355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:29.574355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:13:29.574355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:13:29.574355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 31 16:13:29.574355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:29.577841 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c695532c-4e29-4432-ab56-565da21df4a7 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:13:29.579193 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c695532c-4e29-4432-ab56-565da21df4a7 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.017753 Aug 31 16:13:29.588882 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2184/4573] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:13:29 2022] POST /compute/v2.1/servers => generated 687 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:13:29.636202 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-81975d59-9551-4a52-876b-c04c66af8f96 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.051976 Aug 31 16:13:29.645527 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-501d80c8-924e-420c-80be-58ff43fa7a24 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1552806148", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "582a921e-879d-4256-a61c-34cd54e0cb07"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:29.647695 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2390/4574] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:13:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2065 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:13:29.649403 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-501d80c8-924e-420c-80be-58ff43fa7a24 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Request method failure captured: Aug 31 16:13:29.649403 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 31 16:13:29.649403 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:13:29.649403 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:13:29.649403 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:13:29.649403 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 500 Aug 31 16:13:29.649403 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:13:29.649403 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:13:29.649403 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:13:29.649403 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:13:29.649403 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4iXaMjLB2-0bRZCrT6_sfdbgTDrsgjrtWo_V4S2VwlmSr8l1PckkbKjDcK8Uxx5TkESdx6v1T_qwEgBH9n-NYsYTjaxm8-96yTFCeQdTcXr0lNlbShNsDihMTHo5DCNOCAXB_wlA71KRK04AINBwIYKs_dRfczSvHNJMCjjtvJpCtc Aug 31 16:13:29.649403 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:13:29.649403 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:13:29.649403 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:13:29.649403 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:13:29.649403 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:13:29.649403 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:13:29.649403 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 7647e0ee82f148c6a4c138842d8fbf69 Aug 31 16:13:29.649403 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1919896754 Aug 31 16:13:29.649403 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:13:29.649403 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:13:29.649403 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7647e0ee82f148c6a4c138842d8fbf69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7647e0ee82f148c6a4c138842d8fbf69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7647e0ee82f148c6a4c138842d8fbf69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7647e0ee82f148c6a4c138842d8fbf69", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:13:29.649403 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1919896754 Aug 31 16:13:29.649403 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 7647e0ee82f148c6a4c138842d8fbf69 Aug 31 16:13:29.649403 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1919896754 Aug 31 16:13:29.649403 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServerMetadataNegativeTestJSON-1919896754-project Aug 31 16:13:29.649403 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:13:29.649403 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:13:29.649403 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: f5bf48d039ca4ce489212ef340ddb5ce Aug 31 16:13:29.649403 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1919896754-project Aug 31 16:13:29.649403 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 16:13:29.649403 n-d-833090-16 devstack@n-api.service[128863]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1552806148", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "582a921e-879d-4256-a61c-34cd54e0cb07"}]}} Aug 31 16:13:29.649403 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:13:29.649403 n-d-833090-16 devstack@n-api.service[128863]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 31 16:13:29.649403 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1552806148', 'imageRef': 'd715a41c-0e56-494a-a102-cac65831f6bd', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '582a921e-879d-4256-a61c-34cd54e0cb07'}]}}} Aug 31 16:13:29.649403 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:13:29.649403 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:29.649403 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:13:29.649403 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:13:29.649403 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:13:29.649403 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:13:29.649403 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 31 16:13:29.649403 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:29.649403 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 31 16:13:29.649403 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 31 16:13:29.649403 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 31 16:13:29.649403 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 31 16:13:29.653558 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 31 16:13:29.653558 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:29.653558 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 31 16:13:29.653558 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 31 16:13:29.653558 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:29.653558 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:29.653558 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:29.653558 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:29.653558 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:29.653558 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:29.653558 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:13:29.653558 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:13:29.653558 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:13:29.653558 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:13:29.653558 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:13:29.653558 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:13:29.653558 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 16:13:29.653558 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 16:13:29.653558 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:13:29.653558 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:13:29.653558 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:13:29.653558 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:13:29.653558 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 31 16:13:29.653558 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:29.653558 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:29.653558 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:29.653558 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:29.653558 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:29.653558 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:29.653558 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:13:29.653558 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:13:29.653558 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 31 16:13:29.653558 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:29.656579 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-501d80c8-924e-420c-80be-58ff43fa7a24 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:13:29.660336 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-501d80c8-924e-420c-80be-58ff43fa7a24 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.017901 Aug 31 16:13:29.667351 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2185/4575] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:13:29 2022] POST /compute/v2.1/servers => generated 689 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:13:29.670450 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ad017bd2-9d5c-464f-86ca-ade2406c1842 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:29.671303 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ad017bd2-9d5c-464f-86ca-ade2406c1842 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ed9a700e-0de1-4ed3-993e-c0b6b293b02a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:29.713995 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-39558f92-24e9-43e9-b6da-fbb08a9e4b8a tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1292138237", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "582a921e-879d-4256-a61c-34cd54e0cb07"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:29.733544 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-39558f92-24e9-43e9-b6da-fbb08a9e4b8a tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Request method failure captured: Aug 31 16:13:29.733544 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 31 16:13:29.733544 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:13:29.733544 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:13:29.733544 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:13:29.733544 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 754 Aug 31 16:13:29.733544 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:13:29.733544 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:13:29.733544 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:13:29.733544 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:13:29.733544 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4iXaMjLB2-0bRZCrT6_sfdbgTDrsgjrtWo_V4S2VwlmSr8l1PckkbKjDcK8Uxx5TkESdx6v1T_qwEgBH9n-NYsYTjaxm8-96yTFCeQdTcXr0lNlbShNsDihMTHo5DCNOCAXB_wlA71KRK04AINBwIYKs_dRfczSvHNJMCjjtvJpCtc Aug 31 16:13:29.733544 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:13:29.733544 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:13:29.733544 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:13:29.733544 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:13:29.733544 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:13:29.733544 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:13:29.733544 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 7647e0ee82f148c6a4c138842d8fbf69 Aug 31 16:13:29.733544 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1919896754 Aug 31 16:13:29.733544 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:13:29.733544 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:13:29.733544 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7647e0ee82f148c6a4c138842d8fbf69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7647e0ee82f148c6a4c138842d8fbf69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7647e0ee82f148c6a4c138842d8fbf69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7647e0ee82f148c6a4c138842d8fbf69", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:13:29.733544 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1919896754 Aug 31 16:13:29.733544 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 7647e0ee82f148c6a4c138842d8fbf69 Aug 31 16:13:29.733544 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1919896754 Aug 31 16:13:29.733544 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServerMetadataNegativeTestJSON-1919896754-project Aug 31 16:13:29.733544 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:13:29.733544 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:13:29.733544 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: f5bf48d039ca4ce489212ef340ddb5ce Aug 31 16:13:29.733544 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1919896754-project Aug 31 16:13:29.733544 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 16:13:29.733544 n-d-833090-16 devstack@n-api.service[128863]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1292138237", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "582a921e-879d-4256-a61c-34cd54e0cb07"}]}} Aug 31 16:13:29.733544 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:13:29.733544 n-d-833090-16 devstack@n-api.service[128863]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 31 16:13:29.733544 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1292138237', 'imageRef': 'd715a41c-0e56-494a-a102-cac65831f6bd', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '582a921e-879d-4256-a61c-34cd54e0cb07'}]}}} Aug 31 16:13:29.733544 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:13:29.733544 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:29.733544 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:13:29.733544 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:13:29.736849 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:13:29.736849 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:13:29.736849 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 31 16:13:29.736849 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:29.736849 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 31 16:13:29.736849 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 31 16:13:29.736849 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 31 16:13:29.736849 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 31 16:13:29.736849 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 31 16:13:29.736849 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:29.736849 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 31 16:13:29.736849 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 31 16:13:29.736849 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:29.736849 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:29.736849 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:29.736849 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:29.736849 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:29.736849 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:29.736849 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:13:29.736849 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:13:29.736849 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:13:29.736849 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:13:29.736849 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:13:29.736849 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:13:29.736849 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 16:13:29.736849 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 16:13:29.736849 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:13:29.736849 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:13:29.736849 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:13:29.736849 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:13:29.736849 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 31 16:13:29.736849 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:29.736849 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:29.736849 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:29.736849 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:29.736849 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:29.736849 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:29.736849 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:13:29.736849 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:13:29.740443 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 31 16:13:29.740443 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:29.740443 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-39558f92-24e9-43e9-b6da-fbb08a9e4b8a tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:13:29.741654 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-39558f92-24e9-43e9-b6da-fbb08a9e4b8a tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.033876 Aug 31 16:13:29.746286 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2186/4576] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:13:29 2022] POST /compute/v2.1/servers => generated 1197 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Aug 31 16:13:29.794962 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ad017bd2-9d5c-464f-86ca-ade2406c1842 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:29.810418 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ad017bd2-9d5c-464f-86ca-ade2406c1842 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a" status: 200 len: 1208 microversion: 2.1 time: 0.161231 Aug 31 16:13:29.813181 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2391/4577] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:29 2022] GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a => generated 1208 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:29.925718 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5b48af53-03e5-431b-87cc-0fe1e1adcae0 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1329658573", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "582a921e-879d-4256-a61c-34cd54e0cb07"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:29.932439 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5b48af53-03e5-431b-87cc-0fe1e1adcae0 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Request method failure captured: Aug 31 16:13:29.932439 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 31 16:13:29.932439 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:13:29.932439 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:13:29.932439 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:13:29.932439 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 1266 Aug 31 16:13:29.932439 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:13:29.932439 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:13:29.932439 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:13:29.932439 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:13:29.932439 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4iXaMjLB2-0bRZCrT6_sfdbgTDrsgjrtWo_V4S2VwlmSr8l1PckkbKjDcK8Uxx5TkESdx6v1T_qwEgBH9n-NYsYTjaxm8-96yTFCeQdTcXr0lNlbShNsDihMTHo5DCNOCAXB_wlA71KRK04AINBwIYKs_dRfczSvHNJMCjjtvJpCtc Aug 31 16:13:29.932439 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:13:29.932439 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:13:29.932439 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:13:29.932439 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:13:29.932439 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:13:29.932439 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:13:29.932439 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 7647e0ee82f148c6a4c138842d8fbf69 Aug 31 16:13:29.932439 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1919896754 Aug 31 16:13:29.932439 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:13:29.932439 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:13:29.932439 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7647e0ee82f148c6a4c138842d8fbf69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7647e0ee82f148c6a4c138842d8fbf69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7647e0ee82f148c6a4c138842d8fbf69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7647e0ee82f148c6a4c138842d8fbf69", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:13:29.932439 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1919896754 Aug 31 16:13:29.932439 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 7647e0ee82f148c6a4c138842d8fbf69 Aug 31 16:13:29.932439 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1919896754 Aug 31 16:13:29.932439 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServerMetadataNegativeTestJSON-1919896754-project Aug 31 16:13:29.932439 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:13:29.932439 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:13:29.932439 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: f5bf48d039ca4ce489212ef340ddb5ce Aug 31 16:13:29.932439 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1919896754-project Aug 31 16:13:29.932439 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 16:13:29.932439 n-d-833090-16 devstack@n-api.service[128863]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1329658573", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "582a921e-879d-4256-a61c-34cd54e0cb07"}]}} Aug 31 16:13:29.932439 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:13:29.934867 n-d-833090-16 devstack@n-api.service[128863]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 31 16:13:29.934867 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1329658573', 'imageRef': 'd715a41c-0e56-494a-a102-cac65831f6bd', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '582a921e-879d-4256-a61c-34cd54e0cb07'}]}}} Aug 31 16:13:29.934867 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:13:29.934867 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:29.934867 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:13:29.934867 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:13:29.934867 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:13:29.934867 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:13:29.934867 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 31 16:13:29.934867 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:29.934867 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 31 16:13:29.934867 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 31 16:13:29.934867 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 31 16:13:29.934867 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 31 16:13:29.934867 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 31 16:13:29.934867 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:29.934867 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 31 16:13:29.935948 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 31 16:13:29.935948 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:29.935948 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:29.935948 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:29.935948 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:29.935948 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:29.935948 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:29.935948 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:13:29.935948 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:13:29.935948 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:13:29.935948 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:13:29.935948 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:13:29.935948 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:13:29.935948 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 16:13:29.935948 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 16:13:29.935948 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:13:29.935948 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:13:29.935948 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:13:29.935948 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:13:29.935948 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 31 16:13:29.935948 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:29.935948 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:29.935948 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:29.935948 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:29.935948 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:29.935948 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:29.935948 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:13:29.935948 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:13:29.939404 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 31 16:13:29.939404 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:29.939404 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5b48af53-03e5-431b-87cc-0fe1e1adcae0 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:13:29.939404 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5b48af53-03e5-431b-87cc-0fe1e1adcae0 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.019246 Aug 31 16:13:29.939404 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2187/4578] 10.222.0.50 () {60 vars in 1148 bytes} [Wed Aug 31 16:13:29 2022] POST /compute/v2.1/servers => generated 2221 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Aug 31 16:13:29.953829 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fba76d0a-220e-4384-877e-864cc2f042ca tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:29.954550 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fba76d0a-220e-4384-877e-864cc2f042ca tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] [instance: 56f7ae6f-341c-4f72-99ad-0346fb93c959] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:29.960938 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-fba76d0a-220e-4384-877e-864cc2f042ca tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] HTTP exception thrown: Instance 56f7ae6f-341c-4f72-99ad-0346fb93c959 could not be found. Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fba76d0a-220e-4384-877e-864cc2f042ca tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Request method failure captured: Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/56f7ae6f-341c-4f72-99ad-0346fb93c959/metadata/test2 HTTP/1.1 Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4iXaMjLB2-0bRZCrT6_sfdbgTDrsgjrtWo_V4S2VwlmSr8l1PckkbKjDcK8Uxx5TkESdx6v1T_qwEgBH9n-NYsYTjaxm8-96yTFCeQdTcXr0lNlbShNsDihMTHo5DCNOCAXB_wlA71KRK04AINBwIYKs_dRfczSvHNJMCjjtvJpCtc Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 7647e0ee82f148c6a4c138842d8fbf69 Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1919896754 Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7647e0ee82f148c6a4c138842d8fbf69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7647e0ee82f148c6a4c138842d8fbf69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7647e0ee82f148c6a4c138842d8fbf69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7647e0ee82f148c6a4c138842d8fbf69", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1919896754 Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 7647e0ee82f148c6a4c138842d8fbf69 Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1919896754 Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServerMetadataNegativeTestJSON-1919896754-project Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: f5bf48d039ca4ce489212ef340ddb5ce Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1919896754-project Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 56f7ae6f-341c-4f72-99ad-0346fb93c959 could not be found. Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'server_id': '56f7ae6f-341c-4f72-99ad-0346fb93c959', 'id': 'test2'} Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56f7ae6f-341c-4f72-99ad-0346fb93c959 could not be found. Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56f7ae6f-341c-4f72-99ad-0346fb93c959 could not be found. Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:29.963530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:29.967639 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:13:29.967639 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:13:29.967639 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56f7ae6f-341c-4f72-99ad-0346fb93c959 could not be found. Aug 31 16:13:29.967639 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:29.969856 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fba76d0a-220e-4384-877e-864cc2f042ca tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Returning 404 to user: Instance 56f7ae6f-341c-4f72-99ad-0346fb93c959 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:13:29.971072 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fba76d0a-220e-4384-877e-864cc2f042ca tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] 10.222.0.50 "GET /compute/v2.1/servers/56f7ae6f-341c-4f72-99ad-0346fb93c959/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.024874 Aug 31 16:13:29.972115 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2392/4579] 10.222.0.50 () {58 vars in 1281 bytes} [Wed Aug 31 16:13:29 2022] GET /compute/v2.1/servers/56f7ae6f-341c-4f72-99ad-0346fb93c959/metadata/test2 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:13:29.987847 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-76ff3112-56d6-43b9-b293-a8b47afc4231 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:29.988337 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-76ff3112-56d6-43b9-b293-a8b47afc4231 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] [instance: bfb43b5d-9803-4760-8f51-f3bb651636a3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:30.014429 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76ff3112-56d6-43b9-b293-a8b47afc4231 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:30.017958 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76ff3112-56d6-43b9-b293-a8b47afc4231 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:30.018836 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76ff3112-56d6-43b9-b293-a8b47afc4231 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:30.022202 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76ff3112-56d6-43b9-b293-a8b47afc4231 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:30.022856 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76ff3112-56d6-43b9-b293-a8b47afc4231 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:30.025512 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76ff3112-56d6-43b9-b293-a8b47afc4231 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:30.106961 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-76ff3112-56d6-43b9-b293-a8b47afc4231 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] [instance: bfb43b5d-9803-4760-8f51-f3bb651636a3] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:13:30.341818 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-76ff3112-56d6-43b9-b293-a8b47afc4231 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] 10.222.0.50 "DELETE /compute/v2.1/servers/bfb43b5d-9803-4760-8f51-f3bb651636a3" status: 204 len: 0 microversion: 2.1 time: 0.358066 Aug 31 16:13:30.349036 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2188/4580] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:13:29 2022] DELETE /compute/v2.1/servers/bfb43b5d-9803-4760-8f51-f3bb651636a3 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:13:30.356414 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-69242a2d-016a-4d66-8330-26d3a082d77a tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:30.357798 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-69242a2d-016a-4d66-8330-26d3a082d77a tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] [instance: bfb43b5d-9803-4760-8f51-f3bb651636a3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:30.377355 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69242a2d-016a-4d66-8330-26d3a082d77a tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:30.378327 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69242a2d-016a-4d66-8330-26d3a082d77a tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:30.383165 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69242a2d-016a-4d66-8330-26d3a082d77a tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:30.384293 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69242a2d-016a-4d66-8330-26d3a082d77a tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:30.386543 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69242a2d-016a-4d66-8330-26d3a082d77a tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:30.387971 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69242a2d-016a-4d66-8330-26d3a082d77a tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:30.587543 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-19288487-80c4-438c-955d-892a31472dd6 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:30.590724 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-19288487-80c4-438c-955d-892a31472dd6 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 1c40a98f-366d-4392-9034-7841f68b2050] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:30.599050 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19288487-80c4-438c-955d-892a31472dd6 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:30.599540 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19288487-80c4-438c-955d-892a31472dd6 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:30.599999 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19288487-80c4-438c-955d-892a31472dd6 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:30.601018 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19288487-80c4-438c-955d-892a31472dd6 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:30.601635 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19288487-80c4-438c-955d-892a31472dd6 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:30.602060 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19288487-80c4-438c-955d-892a31472dd6 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:30.770278 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-19288487-80c4-438c-955d-892a31472dd6 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:30.784599 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-19288487-80c4-438c-955d-892a31472dd6 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050" status: 200 len: 1304 microversion: 2.1 time: 0.206102 Aug 31 16:13:30.785593 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2189/4581] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:30 2022] GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050 => generated 1304 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:30.827589 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-69242a2d-016a-4d66-8330-26d3a082d77a tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5bf48d039ca4ce489212ef340ddb5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7647e0ee82f148c6a4c138842d8fbf69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:30.835528 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e8eae35f-1fd3-433f-8195-4441bc69cd9b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:30.836728 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e8eae35f-1fd3-433f-8195-4441bc69cd9b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ed9a700e-0de1-4ed3-993e-c0b6b293b02a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:30.839376 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-69242a2d-016a-4d66-8330-26d3a082d77a tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] 10.222.0.50 "GET /compute/v2.1/servers/bfb43b5d-9803-4760-8f51-f3bb651636a3" status: 200 len: 1526 microversion: 2.1 time: 0.488458 Aug 31 16:13:30.840021 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2393/4582] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:30 2022] GET /compute/v2.1/servers/bfb43b5d-9803-4760-8f51-f3bb651636a3 => generated 1526 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:30.848026 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8eae35f-1fd3-433f-8195-4441bc69cd9b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:30.858867 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8eae35f-1fd3-433f-8195-4441bc69cd9b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:30.860494 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8eae35f-1fd3-433f-8195-4441bc69cd9b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:30.861551 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8eae35f-1fd3-433f-8195-4441bc69cd9b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:30.864952 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8eae35f-1fd3-433f-8195-4441bc69cd9b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:30.865848 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8eae35f-1fd3-433f-8195-4441bc69cd9b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:31.013260 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e8eae35f-1fd3-433f-8195-4441bc69cd9b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:31.022970 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e8eae35f-1fd3-433f-8195-4441bc69cd9b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a" status: 200 len: 1260 microversion: 2.1 time: 0.193096 Aug 31 16:13:31.024351 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2190/4583] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:30 2022] GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a => generated 1260 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:13:31.831138 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ef8e6770-b24f-48a1-a9f9-316042994f0f tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1637718212", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": "none"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:31.927264 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ceb00348-6fbf-4f5b-92da-85e0cb4f652a tempest-KeyPairsV2TestJSON-1210566218 tempest-KeyPairsV2TestJSON-1210566218-project] Action: 'create', calling method: .version_select at 0x7fbb4615d820>, body: {"keypair": {"name": "tempest-keypair-324629944", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKj9tTsCxv765TPXgttXjDrf2nVuu87vnUL2nf7cCVkFoBRyKGS7od63PR42SDLZjeATQO4kVqMbpYqXPxZklrLgA7JEvQjMrIFiRabWjEjwnB3qpq0lThBK04n300Kyg=="}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:31.940238 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ef8e6770-b24f-48a1-a9f9-316042994f0f tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:13:31.941052 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ef8e6770-b24f-48a1-a9f9-316042994f0f tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:13:31.942402 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ef8e6770-b24f-48a1-a9f9-316042994f0f tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:13:31.945673 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ef8e6770-b24f-48a1-a9f9-316042994f0f tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:13:31.945981 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ef8e6770-b24f-48a1-a9f9-316042994f0f tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:13:31.962397 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef8e6770-b24f-48a1-a9f9-316042994f0f tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:31.963934 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef8e6770-b24f-48a1-a9f9-316042994f0f tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:31.964548 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef8e6770-b24f-48a1-a9f9-316042994f0f tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:31.965483 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef8e6770-b24f-48a1-a9f9-316042994f0f tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:31.966350 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef8e6770-b24f-48a1-a9f9-316042994f0f tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:31.966964 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef8e6770-b24f-48a1-a9f9-316042994f0f tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:31.967115 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-ceb00348-6fbf-4f5b-92da-85e0cb4f652a tempest-KeyPairsV2TestJSON-1210566218 tempest-KeyPairsV2TestJSON-1210566218-project] Getting quotas for project 2e73f4577e2044309ecafd089be74070. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:13:31.973419 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-ceb00348-6fbf-4f5b-92da-85e0cb4f652a tempest-KeyPairsV2TestJSON-1210566218 tempest-KeyPairsV2TestJSON-1210566218-project] Getting quotas for user 531c6f00b56b4d6c9a8d015242be3d47 and project 2e73f4577e2044309ecafd089be74070. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:13:32.009120 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-ef8e6770-b24f-48a1-a9f9-316042994f0f tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Getting quotas for project 08088a66bb9f4fa6946be32fa4b9071a. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:13:32.025402 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-ef8e6770-b24f-48a1-a9f9-316042994f0f tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Getting quotas for user ba99802efbce47e4943f8c82d8071a73 and project 08088a66bb9f4fa6946be32fa4b9071a. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:13:32.029638 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ceb00348-6fbf-4f5b-92da-85e0cb4f652a tempest-KeyPairsV2TestJSON-1210566218 tempest-KeyPairsV2TestJSON-1210566218-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.459841 Aug 31 16:13:32.029878 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2394/4584] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 31 16:13:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:32.040437 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3c44c407-44e2-4a2a-b1c3-6864e680f76d tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:32.041760 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3c44c407-44e2-4a2a-b1c3-6864e680f76d tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 1c40a98f-366d-4392-9034-7841f68b2050] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:32.045043 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ef8e6770-b24f-48a1-a9f9-316042994f0f tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:13:32.047899 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ef8e6770-b24f-48a1-a9f9-316042994f0f tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] [instance: 524393de-26e6-483e-90b1-b2d27dcc4044] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:13:32.062567 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3c44c407-44e2-4a2a-b1c3-6864e680f76d tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:32.063293 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3c44c407-44e2-4a2a-b1c3-6864e680f76d tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:32.063865 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3c44c407-44e2-4a2a-b1c3-6864e680f76d tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:32.071269 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3c44c407-44e2-4a2a-b1c3-6864e680f76d tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:32.072057 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3c44c407-44e2-4a2a-b1c3-6864e680f76d tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:32.072788 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3c44c407-44e2-4a2a-b1c3-6864e680f76d tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:32.131925 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ef8e6770-b24f-48a1-a9f9-316042994f0f tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.485677 Aug 31 16:13:32.142735 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2191/4585] 10.222.0.50 () {62 vars in 1188 bytes} [Wed Aug 31 16:13:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 500 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 31 16:13:32.149145 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8e74bf8c-ded9-4dd8-ae1b-95161718b544 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:32.150459 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8e74bf8c-ded9-4dd8-ae1b-95161718b544 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] [instance: bfb43b5d-9803-4760-8f51-f3bb651636a3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:32.178439 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e74bf8c-ded9-4dd8-ae1b-95161718b544 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:32.183189 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e74bf8c-ded9-4dd8-ae1b-95161718b544 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:32.183873 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e74bf8c-ded9-4dd8-ae1b-95161718b544 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:32.185964 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e74bf8c-ded9-4dd8-ae1b-95161718b544 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:32.186488 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e74bf8c-ded9-4dd8-ae1b-95161718b544 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:32.186930 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e74bf8c-ded9-4dd8-ae1b-95161718b544 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:32.706673 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8e74bf8c-ded9-4dd8-ae1b-95161718b544 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5bf48d039ca4ce489212ef340ddb5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7647e0ee82f148c6a4c138842d8fbf69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:32.727200 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8e74bf8c-ded9-4dd8-ae1b-95161718b544 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] 10.222.0.50 "GET /compute/v2.1/servers/bfb43b5d-9803-4760-8f51-f3bb651636a3" status: 200 len: 1526 microversion: 2.1 time: 0.582274 Aug 31 16:13:32.728570 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2192/4586] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:32 2022] GET /compute/v2.1/servers/bfb43b5d-9803-4760-8f51-f3bb651636a3 => generated 1526 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:32.741239 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c9114e2c-f098-432b-83e3-ec57da18c1e1 tempest-KeyPairsV2TestJSON-1210566218 tempest-KeyPairsV2TestJSON-1210566218-project] Calling method '.version_select at 0x7fbb468e2160>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:32.759435 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c9114e2c-f098-432b-83e3-ec57da18c1e1 tempest-KeyPairsV2TestJSON-1210566218 tempest-KeyPairsV2TestJSON-1210566218-project] 10.222.0.50 "GET /compute/v2.1/os-keypairs/tempest-keypair-324629944" status: 200 len: 497 microversion: 2.1 time: 0.026999 Aug 31 16:13:32.761701 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2193/4587] 10.222.0.50 () {58 vars in 1215 bytes} [Wed Aug 31 16:13:32 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-324629944 => generated 497 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:32.771428 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cf37ff76-a385-4f9b-bbed-e165593b48bf tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:32.773085 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cf37ff76-a385-4f9b-bbed-e165593b48bf tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ed9a700e-0de1-4ed3-993e-c0b6b293b02a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:32.785399 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf37ff76-a385-4f9b-bbed-e165593b48bf tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:32.786465 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf37ff76-a385-4f9b-bbed-e165593b48bf tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:32.787520 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf37ff76-a385-4f9b-bbed-e165593b48bf tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:32.788897 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf37ff76-a385-4f9b-bbed-e165593b48bf tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:32.789868 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf37ff76-a385-4f9b-bbed-e165593b48bf tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:32.791043 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf37ff76-a385-4f9b-bbed-e165593b48bf tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:32.793282 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3c44c407-44e2-4a2a-b1c3-6864e680f76d tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:32.820170 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3c44c407-44e2-4a2a-b1c3-6864e680f76d tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050" status: 200 len: 1372 microversion: 2.1 time: 0.783463 Aug 31 16:13:32.826842 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2395/4588] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:32 2022] GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050 => generated 1372 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:32.844538 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4a829553-c263-44de-a2e3-2368e057e723 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:32.854748 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4a829553-c263-44de-a2e3-2368e057e723 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] [instance: 524393de-26e6-483e-90b1-b2d27dcc4044] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:33.064800 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4a829553-c263-44de-a2e3-2368e057e723 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba99802efbce47e4943f8c82d8071a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08088a66bb9f4fa6946be32fa4b9071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:33.089517 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4a829553-c263-44de-a2e3-2368e057e723 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba99802efbce47e4943f8c82d8071a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08088a66bb9f4fa6946be32fa4b9071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:33.098947 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4a829553-c263-44de-a2e3-2368e057e723 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba99802efbce47e4943f8c82d8071a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08088a66bb9f4fa6946be32fa4b9071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:33.101591 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4a829553-c263-44de-a2e3-2368e057e723 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] 10.222.0.50 "GET /compute/v2.1/servers/524393de-26e6-483e-90b1-b2d27dcc4044" status: 200 len: 1281 microversion: 2.47 time: 0.272827 Aug 31 16:13:33.103389 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2396/4589] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:13:32 2022] GET /compute/v2.1/servers/524393de-26e6-483e-90b1-b2d27dcc4044 => generated 1281 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:13:33.112620 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-07b36707-ac8b-45b0-bbd9-a9b178182d78 tempest-KeyPairsV2TestJSON-1210566218 tempest-KeyPairsV2TestJSON-1210566218-project] Calling method '.version_select at 0x7fbb468570d0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:33.132747 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cf37ff76-a385-4f9b-bbed-e165593b48bf tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:33.141593 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cf37ff76-a385-4f9b-bbed-e165593b48bf tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a" status: 200 len: 1266 microversion: 2.1 time: 0.377999 Aug 31 16:13:33.145704 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2194/4590] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:32 2022] GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a => generated 1266 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:33.163782 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-07b36707-ac8b-45b0-bbd9-a9b178182d78 tempest-KeyPairsV2TestJSON-1210566218 tempest-KeyPairsV2TestJSON-1210566218-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-324629944" status: 202 len: 0 microversion: 2.1 time: 0.058340 Aug 31 16:13:33.164845 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2397/4591] 10.222.0.50 () {58 vars in 1218 bytes} [Wed Aug 31 16:13:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-324629944 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:13:33.182797 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b938c66f-e1c1-49f2-886a-034c5d9228d2 tempest-KeyPairsV2TestJSON-1210566218 tempest-KeyPairsV2TestJSON-1210566218-project] Action: 'create', calling method: .version_select at 0x7fbb468e2550>, body: {"keypair": {"name": "tempest-keypair-1851127795", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAC2OhZW+c5kbm5nJtplvN4VVrGtpM4CCkPAJwDs1DE5Siyqg3A8u/eEAdmeSJ6EsskncjQhItisrUd5x57S0itwvng58kGuG2rWnD2QZ90cx+zXhiIMDxkD06Xq4MhREA=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:33.215405 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-b938c66f-e1c1-49f2-886a-034c5d9228d2 tempest-KeyPairsV2TestJSON-1210566218 tempest-KeyPairsV2TestJSON-1210566218-project] Getting quotas for project 2e73f4577e2044309ecafd089be74070. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:13:33.227941 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-b938c66f-e1c1-49f2-886a-034c5d9228d2 tempest-KeyPairsV2TestJSON-1210566218 tempest-KeyPairsV2TestJSON-1210566218-project] Getting quotas for user 531c6f00b56b4d6c9a8d015242be3d47 and project 2e73f4577e2044309ecafd089be74070. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:13:33.267450 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b938c66f-e1c1-49f2-886a-034c5d9228d2 tempest-KeyPairsV2TestJSON-1210566218 tempest-KeyPairsV2TestJSON-1210566218-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.088789 Aug 31 16:13:33.268724 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2195/4592] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 31 16:13:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:33.304086 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3d5ff721-9906-4dab-b3f4-7ad8f88184bc tempest-KeyPairsV2TestJSON-1210566218 tempest-KeyPairsV2TestJSON-1210566218-project] Calling method '.version_select at 0x7fbb4613dca0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:33.346187 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3d5ff721-9906-4dab-b3f4-7ad8f88184bc tempest-KeyPairsV2TestJSON-1210566218 tempest-KeyPairsV2TestJSON-1210566218-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1851127795" status: 202 len: 0 microversion: 2.1 time: 0.066676 Aug 31 16:13:33.346830 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2398/4593] 10.222.0.50 () {58 vars in 1221 bytes} [Wed Aug 31 16:13:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1851127795 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:13:33.361998 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0cf05bbc-ba6a-40b4-8dc5-34d34659f425 tempest-KeyPairsV2TestJSON-1210566218 tempest-KeyPairsV2TestJSON-1210566218-project] Action: 'create', calling method: .version_select at 0x7fbb467ad160>, body: {"keypair": {"name": "tempest-keypair-2012994234", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:33.405905 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-0cf05bbc-ba6a-40b4-8dc5-34d34659f425 tempest-KeyPairsV2TestJSON-1210566218 tempest-KeyPairsV2TestJSON-1210566218-project] Getting quotas for project 2e73f4577e2044309ecafd089be74070. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:13:33.412136 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-0cf05bbc-ba6a-40b4-8dc5-34d34659f425 tempest-KeyPairsV2TestJSON-1210566218 tempest-KeyPairsV2TestJSON-1210566218-project] Getting quotas for user 531c6f00b56b4d6c9a8d015242be3d47 and project 2e73f4577e2044309ecafd089be74070. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:13:33.488009 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0cf05bbc-ba6a-40b4-8dc5-34d34659f425 tempest-KeyPairsV2TestJSON-1210566218 tempest-KeyPairsV2TestJSON-1210566218-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.133189 Aug 31 16:13:33.490717 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2196/4594] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 31 16:13:33 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:33.504745 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-54cc1d28-6209-4e39-bfdd-a3c3483707af tempest-KeyPairsV2TestJSON-1210566218 tempest-KeyPairsV2TestJSON-1210566218-project] Calling method '.version_select at 0x7fbb468571f0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:33.554439 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-54cc1d28-6209-4e39-bfdd-a3c3483707af tempest-KeyPairsV2TestJSON-1210566218 tempest-KeyPairsV2TestJSON-1210566218-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2012994234" status: 202 len: 0 microversion: 2.1 time: 0.052137 Aug 31 16:13:33.559131 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2399/4595] 10.222.0.50 () {58 vars in 1221 bytes} [Wed Aug 31 16:13:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2012994234 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:13:33.572942 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c8343a48-626b-4d9e-807e-26f6a7882d18 tempest-KeyPairsV2TestJSON-1210566218 tempest-KeyPairsV2TestJSON-1210566218-project] Action: 'create', calling method: .version_select at 0x7fbb464085e0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-620232623", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNNoIoTctDhjZqRGvQRndxV7seCjXYgc+tzbgLyqx/SZto+xxuwPqBSamABhrBhn+UYnsokPxE6VCjP/op8aaeVT1cWln0Dgu0UHY5LHV7ed+kRjZT0izZF1pGntR0/Sbw=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:33.624969 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-c8343a48-626b-4d9e-807e-26f6a7882d18 tempest-KeyPairsV2TestJSON-1210566218 tempest-KeyPairsV2TestJSON-1210566218-project] Getting quotas for project 2e73f4577e2044309ecafd089be74070. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:13:33.639545 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-c8343a48-626b-4d9e-807e-26f6a7882d18 tempest-KeyPairsV2TestJSON-1210566218 tempest-KeyPairsV2TestJSON-1210566218-project] Getting quotas for user 531c6f00b56b4d6c9a8d015242be3d47 and project 2e73f4577e2044309ecafd089be74070. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:13:33.703619 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c8343a48-626b-4d9e-807e-26f6a7882d18 tempest-KeyPairsV2TestJSON-1210566218 tempest-KeyPairsV2TestJSON-1210566218-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.135403 Aug 31 16:13:33.704614 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2197/4596] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 31 16:13:33 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:33.721813 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2d06457b-e5ee-4283-837a-bf24985e53c8 tempest-KeyPairsV2TestJSON-1210566218 tempest-KeyPairsV2TestJSON-1210566218-project] Action: 'create', calling method: .version_select at 0x7fbb46acd1f0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1368632025", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJCyXeOnb25zCuqSY3D2WUPHanZcGrpdfg6m875mvvl4SjKZr8wkpShwCnHijdqFF7GZwDVBiVUjS1Jkz8idWXKGF6GT62ULrtQWXIbC3IRbxltRUcgpeHmPEdzrFynFug=="}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:33.754151 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-648f28a8-5101-448c-a7b5-556001ea2c0b tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:33.755094 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-648f28a8-5101-448c-a7b5-556001ea2c0b tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] [instance: bfb43b5d-9803-4760-8f51-f3bb651636a3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:33.770497 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-648f28a8-5101-448c-a7b5-556001ea2c0b tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:33.771417 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-648f28a8-5101-448c-a7b5-556001ea2c0b tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:33.772127 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-648f28a8-5101-448c-a7b5-556001ea2c0b tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:33.773090 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-648f28a8-5101-448c-a7b5-556001ea2c0b tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:33.773982 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-648f28a8-5101-448c-a7b5-556001ea2c0b tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:33.774664 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-648f28a8-5101-448c-a7b5-556001ea2c0b tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:33.817484 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-2d06457b-e5ee-4283-837a-bf24985e53c8 tempest-KeyPairsV2TestJSON-1210566218 tempest-KeyPairsV2TestJSON-1210566218-project] Getting quotas for project 2e73f4577e2044309ecafd089be74070. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:13:33.839434 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-2d06457b-e5ee-4283-837a-bf24985e53c8 tempest-KeyPairsV2TestJSON-1210566218 tempest-KeyPairsV2TestJSON-1210566218-project] Getting quotas for user 531c6f00b56b4d6c9a8d015242be3d47 and project 2e73f4577e2044309ecafd089be74070. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:13:33.896357 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:13:33.915534 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2d06457b-e5ee-4283-837a-bf24985e53c8 tempest-KeyPairsV2TestJSON-1210566218 tempest-KeyPairsV2TestJSON-1210566218-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.200746 Aug 31 16:13:33.916193 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2400/4597] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 31 16:13:33 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:33.920954 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2f12bd9d-a258-419c-9440-0ff9ecd3ca92 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:33.921569 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2f12bd9d-a258-419c-9440-0ff9ecd3ca92 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 1c40a98f-366d-4392-9034-7841f68b2050] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:33.941775 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2f12bd9d-a258-419c-9440-0ff9ecd3ca92 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:33.942313 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2f12bd9d-a258-419c-9440-0ff9ecd3ca92 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:33.942755 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2f12bd9d-a258-419c-9440-0ff9ecd3ca92 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:33.943472 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2f12bd9d-a258-419c-9440-0ff9ecd3ca92 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:33.943927 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2f12bd9d-a258-419c-9440-0ff9ecd3ca92 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:33.944347 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2f12bd9d-a258-419c-9440-0ff9ecd3ca92 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:34.346293 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-648f28a8-5101-448c-a7b5-556001ea2c0b tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5bf48d039ca4ce489212ef340ddb5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7647e0ee82f148c6a4c138842d8fbf69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:34.373660 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-648f28a8-5101-448c-a7b5-556001ea2c0b tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] 10.222.0.50 "GET /compute/v2.1/servers/bfb43b5d-9803-4760-8f51-f3bb651636a3" status: 200 len: 1484 microversion: 2.1 time: 0.622672 Aug 31 16:13:34.374947 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2198/4598] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:33 2022] GET /compute/v2.1/servers/bfb43b5d-9803-4760-8f51-f3bb651636a3 => generated 1484 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:34.383676 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ebb44a56-bba5-4a58-b16b-f880d644a419 tempest-KeyPairsV2TestJSON-1210566218 tempest-KeyPairsV2TestJSON-1210566218-project] Action: 'create', calling method: .version_select at 0x7fbb4641d160>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1054488701", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwNS77/d2X91zk8UWQO4KN6Z6nfR+ygu3U/Gx12ZW+lDEGirnlkZNDZB14oq6kJ7tCnwvVPVMpTzaLFlylKOMyiGuHE0P8O57Ur8XxxY4+jdD8YAfvBwSBh6eu6/aSfxQ=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:34.405989 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-ebb44a56-bba5-4a58-b16b-f880d644a419 tempest-KeyPairsV2TestJSON-1210566218 tempest-KeyPairsV2TestJSON-1210566218-project] Getting quotas for project 2e73f4577e2044309ecafd089be74070. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:13:34.426194 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-ebb44a56-bba5-4a58-b16b-f880d644a419 tempest-KeyPairsV2TestJSON-1210566218 tempest-KeyPairsV2TestJSON-1210566218-project] Getting quotas for user 531c6f00b56b4d6c9a8d015242be3d47 and project 2e73f4577e2044309ecafd089be74070. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:13:34.469881 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ebb44a56-bba5-4a58-b16b-f880d644a419 tempest-KeyPairsV2TestJSON-1210566218 tempest-KeyPairsV2TestJSON-1210566218-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.090933 Aug 31 16:13:34.475467 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2199/4599] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 31 16:13:34 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:34.488858 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c7c35555-c5f8-4921-8826-36e3fd060e65 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:34.489769 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c7c35555-c5f8-4921-8826-36e3fd060e65 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] [instance: 524393de-26e6-483e-90b1-b2d27dcc4044] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:34.501020 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7c35555-c5f8-4921-8826-36e3fd060e65 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:34.502126 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7c35555-c5f8-4921-8826-36e3fd060e65 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:34.502971 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7c35555-c5f8-4921-8826-36e3fd060e65 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:34.503999 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7c35555-c5f8-4921-8826-36e3fd060e65 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:34.504695 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7c35555-c5f8-4921-8826-36e3fd060e65 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:34.505397 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7c35555-c5f8-4921-8826-36e3fd060e65 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:34.609165 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2f12bd9d-a258-419c-9440-0ff9ecd3ca92 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:34.610854 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c7c35555-c5f8-4921-8826-36e3fd060e65 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba99802efbce47e4943f8c82d8071a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08088a66bb9f4fa6946be32fa4b9071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:34.629414 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c7c35555-c5f8-4921-8826-36e3fd060e65 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba99802efbce47e4943f8c82d8071a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08088a66bb9f4fa6946be32fa4b9071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:34.630966 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c7c35555-c5f8-4921-8826-36e3fd060e65 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba99802efbce47e4943f8c82d8071a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08088a66bb9f4fa6946be32fa4b9071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:34.632329 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c7c35555-c5f8-4921-8826-36e3fd060e65 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] 10.222.0.50 "GET /compute/v2.1/servers/524393de-26e6-483e-90b1-b2d27dcc4044" status: 200 len: 1339 microversion: 2.47 time: 0.160143 Aug 31 16:13:34.632873 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2f12bd9d-a258-419c-9440-0ff9ecd3ca92 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050" status: 200 len: 1372 microversion: 2.1 time: 0.715601 Aug 31 16:13:34.633393 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2200/4600] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:13:34 2022] GET /compute/v2.1/servers/524393de-26e6-483e-90b1-b2d27dcc4044 => generated 1339 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:13:34.634511 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2401/4601] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:33 2022] GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050 => generated 1372 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:34.643029 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-7e79d3fd-da3f-4c60-bb91-b61fac8d5407 req-842551c8-39b0-44fd-b1c3-0a13a743b807 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfb43b5d-9803-4760-8f51-f3bb651636a3", "name": "network-vif-deleted", "tag": "a0afdea8-7072-4a93-bc57-51f913c8f67f"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:34.650814 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c626193a-ce80-495d-a19c-41d7ff20e693 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:34.651709 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c626193a-ce80-495d-a19c-41d7ff20e693 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ed9a700e-0de1-4ed3-993e-c0b6b293b02a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:34.659390 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c626193a-ce80-495d-a19c-41d7ff20e693 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:34.659881 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c626193a-ce80-495d-a19c-41d7ff20e693 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:34.660317 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c626193a-ce80-495d-a19c-41d7ff20e693 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:34.664277 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c626193a-ce80-495d-a19c-41d7ff20e693 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:34.667116 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c626193a-ce80-495d-a19c-41d7ff20e693 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:34.667662 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c626193a-ce80-495d-a19c-41d7ff20e693 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:34.668402 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7e79d3fd-da3f-4c60-bb91-b61fac8d5407 req-842551c8-39b0-44fd-b1c3-0a13a743b807 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:34.669124 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7e79d3fd-da3f-4c60-bb91-b61fac8d5407 req-842551c8-39b0-44fd-b1c3-0a13a743b807 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:34.669786 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7e79d3fd-da3f-4c60-bb91-b61fac8d5407 req-842551c8-39b0-44fd-b1c3-0a13a743b807 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:34.688255 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-7e79d3fd-da3f-4c60-bb91-b61fac8d5407 req-842551c8-39b0-44fd-b1c3-0a13a743b807 service nova] Creating event network-vif-deleted:a0afdea8-7072-4a93-bc57-51f913c8f67f for instance bfb43b5d-9803-4760-8f51-f3bb651636a3 on n-h1-833090-16 Aug 31 16:13:34.696086 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-7e79d3fd-da3f-4c60-bb91-b61fac8d5407 req-842551c8-39b0-44fd-b1c3-0a13a743b807 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060145 Aug 31 16:13:34.697943 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2402/4602] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:34.704982 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-dc0e091b-dc49-47e8-98f6-b2abfdf43f28 tempest-KeyPairsV2TestJSON-1210566218 tempest-KeyPairsV2TestJSON-1210566218-project] Calling method '.version_select at 0x7fbb4aa64160>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:34.711396 n-d-833090-16 devstack@n-api.service[128864]: WARNING oslo_db.sqlalchemy.utils [None req-dc0e091b-dc49-47e8-98f6-b2abfdf43f28 tempest-KeyPairsV2TestJSON-1210566218 tempest-KeyPairsV2TestJSON-1210566218-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 31 16:13:34.728392 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-dc0e091b-dc49-47e8-98f6-b2abfdf43f28 tempest-KeyPairsV2TestJSON-1210566218 tempest-KeyPairsV2TestJSON-1210566218-project] 10.222.0.50 "GET /compute/v2.1/os-keypairs" status: 200 len: 1093 microversion: 2.1 time: 0.028160 Aug 31 16:13:34.729044 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2403/4603] 10.222.0.50 () {58 vars in 1137 bytes} [Wed Aug 31 16:13:34 2022] GET /compute/v2.1/os-keypairs => generated 1093 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:34.738291 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a7c96973-8595-46b6-91ab-45c7eff7be2a tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:34.739060 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a7c96973-8595-46b6-91ab-45c7eff7be2a tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] [instance: f6e41791-366b-4790-8338-2a52f4ebed89] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:34.745901 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a7c96973-8595-46b6-91ab-45c7eff7be2a tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:34.746436 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a7c96973-8595-46b6-91ab-45c7eff7be2a tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:34.747036 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a7c96973-8595-46b6-91ab-45c7eff7be2a tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:34.747926 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a7c96973-8595-46b6-91ab-45c7eff7be2a tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:34.748374 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a7c96973-8595-46b6-91ab-45c7eff7be2a tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:34.748991 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a7c96973-8595-46b6-91ab-45c7eff7be2a tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:35.075084 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c626193a-ce80-495d-a19c-41d7ff20e693 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:35.099570 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c626193a-ce80-495d-a19c-41d7ff20e693 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a" status: 200 len: 1308 microversion: 2.1 time: 0.464437 Aug 31 16:13:35.114303 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2201/4604] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:34 2022] GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a => generated 1308 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:35.114303 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-17cc1db3-b481-4fd4-88b6-26f4dbb9baf8 tempest-KeyPairsV2TestJSON-1210566218 tempest-KeyPairsV2TestJSON-1210566218-project] Calling method '.version_select at 0x7fbb463443a0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:35.131581 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a7c96973-8595-46b6-91ab-45c7eff7be2a tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89" status: 200 len: 1836 microversion: 2.1 time: 0.401362 Aug 31 16:13:35.132540 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2404/4605] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:34 2022] GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89 => generated 1836 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:35.142431 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-17cc1db3-b481-4fd4-88b6-26f4dbb9baf8 tempest-KeyPairsV2TestJSON-1210566218 tempest-KeyPairsV2TestJSON-1210566218-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1054488701" status: 202 len: 0 microversion: 2.1 time: 0.037819 Aug 31 16:13:35.143321 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2202/4606] 10.222.0.50 () {58 vars in 1278 bytes} [Wed Aug 31 16:13:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1054488701 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:13:35.161171 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ccf06e2e-fa46-452f-9a23-5bf9604e6be9 tempest-KeyPairsV2TestJSON-1210566218 tempest-KeyPairsV2TestJSON-1210566218-project] Calling method '.version_select at 0x7fbb4aa64b80>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:35.197452 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ccf06e2e-fa46-452f-9a23-5bf9604e6be9 tempest-KeyPairsV2TestJSON-1210566218 tempest-KeyPairsV2TestJSON-1210566218-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1368632025" status: 202 len: 0 microversion: 2.1 time: 0.047227 Aug 31 16:13:35.198827 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2405/4607] 10.222.0.50 () {58 vars in 1278 bytes} [Wed Aug 31 16:13:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1368632025 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:13:35.213939 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-686f918d-40fd-4614-b5c0-5c53ebb65952 tempest-KeyPairsV2TestJSON-1210566218 tempest-KeyPairsV2TestJSON-1210566218-project] Calling method '.version_select at 0x7fbb4abc3940>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:35.245548 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:13:35.265726 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-686f918d-40fd-4614-b5c0-5c53ebb65952 tempest-KeyPairsV2TestJSON-1210566218 tempest-KeyPairsV2TestJSON-1210566218-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-620232623" status: 202 len: 0 microversion: 2.1 time: 0.059627 Aug 31 16:13:35.273811 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2203/4608] 10.222.0.50 () {58 vars in 1275 bytes} [Wed Aug 31 16:13:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-620232623 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:13:35.407329 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f3c1ec4a-95dd-46ec-a029-2047f4d2197e tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:35.408089 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f3c1ec4a-95dd-46ec-a029-2047f4d2197e tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] [instance: bfb43b5d-9803-4760-8f51-f3bb651636a3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:35.422293 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f3c1ec4a-95dd-46ec-a029-2047f4d2197e tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:35.427970 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f3c1ec4a-95dd-46ec-a029-2047f4d2197e tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:35.428651 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f3c1ec4a-95dd-46ec-a029-2047f4d2197e tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:35.430920 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f3c1ec4a-95dd-46ec-a029-2047f4d2197e tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:35.432259 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f3c1ec4a-95dd-46ec-a029-2047f4d2197e tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:35.433670 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f3c1ec4a-95dd-46ec-a029-2047f4d2197e tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:35.503646 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f3c1ec4a-95dd-46ec-a029-2047f4d2197e tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:35.504148 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f3c1ec4a-95dd-46ec-a029-2047f4d2197e tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:35.504616 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f3c1ec4a-95dd-46ec-a029-2047f4d2197e tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:35.505253 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-f3c1ec4a-95dd-46ec-a029-2047f4d2197e tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lazy-loading 'fault' on Instance uuid bfb43b5d-9803-4760-8f51-f3bb651636a3 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:13:35.656312 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f3c1ec4a-95dd-46ec-a029-2047f4d2197e tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5bf48d039ca4ce489212ef340ddb5ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7647e0ee82f148c6a4c138842d8fbf69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:35.659751 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7e2301df-2525-4f84-b059-dea0efb673db tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:35.660444 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7e2301df-2525-4f84-b059-dea0efb673db tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] [instance: 524393de-26e6-483e-90b1-b2d27dcc4044] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:35.670577 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f3c1ec4a-95dd-46ec-a029-2047f4d2197e tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] 10.222.0.50 "GET /compute/v2.1/servers/bfb43b5d-9803-4760-8f51-f3bb651636a3" status: 200 len: 1313 microversion: 2.1 time: 0.268992 Aug 31 16:13:35.671348 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2406/4609] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:35 2022] GET /compute/v2.1/servers/bfb43b5d-9803-4760-8f51-f3bb651636a3 => generated 1313 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:13:35.681645 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e2301df-2525-4f84-b059-dea0efb673db tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:35.683341 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-29f83db0-2f99-4537-b4ca-9536867ba073 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:35.684822 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-29f83db0-2f99-4537-b4ca-9536867ba073 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 1c40a98f-366d-4392-9034-7841f68b2050] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:35.684912 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e2301df-2525-4f84-b059-dea0efb673db tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:35.685430 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e2301df-2525-4f84-b059-dea0efb673db tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:35.688728 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e2301df-2525-4f84-b059-dea0efb673db tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:35.690856 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e2301df-2525-4f84-b059-dea0efb673db tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:35.692104 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e2301df-2525-4f84-b059-dea0efb673db tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:35.704993 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-29f83db0-2f99-4537-b4ca-9536867ba073 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:35.705875 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-29f83db0-2f99-4537-b4ca-9536867ba073 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:35.706554 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-29f83db0-2f99-4537-b4ca-9536867ba073 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:35.707625 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-29f83db0-2f99-4537-b4ca-9536867ba073 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:35.708955 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-29f83db0-2f99-4537-b4ca-9536867ba073 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:35.709720 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-29f83db0-2f99-4537-b4ca-9536867ba073 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:35.873295 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7e2301df-2525-4f84-b059-dea0efb673db tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba99802efbce47e4943f8c82d8071a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08088a66bb9f4fa6946be32fa4b9071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:35.886202 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7e2301df-2525-4f84-b059-dea0efb673db tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba99802efbce47e4943f8c82d8071a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08088a66bb9f4fa6946be32fa4b9071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:35.887666 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7e2301df-2525-4f84-b059-dea0efb673db tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba99802efbce47e4943f8c82d8071a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08088a66bb9f4fa6946be32fa4b9071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:35.889982 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7e2301df-2525-4f84-b059-dea0efb673db tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] 10.222.0.50 "GET /compute/v2.1/servers/524393de-26e6-483e-90b1-b2d27dcc4044" status: 200 len: 1339 microversion: 2.47 time: 0.234151 Aug 31 16:13:35.890970 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2204/4610] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:13:35 2022] GET /compute/v2.1/servers/524393de-26e6-483e-90b1-b2d27dcc4044 => generated 1339 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:13:35.938448 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-04b3ebef-3888-4041-9ffe-c66a20d9f8a7 req-2bce0320-b865-4df8-b9d0-d0589c263cc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed9a700e-0de1-4ed3-993e-c0b6b293b02a", "tag": "6f8d8f6e-2b42-4279-a8a4-50ef2c9c74b4"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:35.955208 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-04b3ebef-3888-4041-9ffe-c66a20d9f8a7 req-2bce0320-b865-4df8-b9d0-d0589c263cc0 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:35.956324 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-04b3ebef-3888-4041-9ffe-c66a20d9f8a7 req-2bce0320-b865-4df8-b9d0-d0589c263cc0 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:35.956850 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-04b3ebef-3888-4041-9ffe-c66a20d9f8a7 req-2bce0320-b865-4df8-b9d0-d0589c263cc0 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:35.976687 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-04b3ebef-3888-4041-9ffe-c66a20d9f8a7 req-2bce0320-b865-4df8-b9d0-d0589c263cc0 service nova] Creating event network-changed:6f8d8f6e-2b42-4279-a8a4-50ef2c9c74b4 for instance ed9a700e-0de1-4ed3-993e-c0b6b293b02a on n-h2-833090-16 Aug 31 16:13:35.984971 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-04b3ebef-3888-4041-9ffe-c66a20d9f8a7 req-2bce0320-b865-4df8-b9d0-d0589c263cc0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079951 Aug 31 16:13:35.986451 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2205/4611] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:36.129783 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-68df8a7c-0b73-4708-90d1-7ea7613eaa36 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:36.131595 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-68df8a7c-0b73-4708-90d1-7ea7613eaa36 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ed9a700e-0de1-4ed3-993e-c0b6b293b02a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:36.159413 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68df8a7c-0b73-4708-90d1-7ea7613eaa36 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:36.160886 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68df8a7c-0b73-4708-90d1-7ea7613eaa36 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:36.165447 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68df8a7c-0b73-4708-90d1-7ea7613eaa36 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:36.166824 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68df8a7c-0b73-4708-90d1-7ea7613eaa36 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:36.167964 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68df8a7c-0b73-4708-90d1-7ea7613eaa36 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:36.168643 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68df8a7c-0b73-4708-90d1-7ea7613eaa36 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:36.211860 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-29f83db0-2f99-4537-b4ca-9536867ba073 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:36.237756 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-29f83db0-2f99-4537-b4ca-9536867ba073 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050" status: 200 len: 1372 microversion: 2.1 time: 0.565255 Aug 31 16:13:36.240733 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2407/4612] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:35 2022] GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050 => generated 1372 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:36.632732 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-68df8a7c-0b73-4708-90d1-7ea7613eaa36 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:36.639692 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-68df8a7c-0b73-4708-90d1-7ea7613eaa36 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a" status: 200 len: 1308 microversion: 2.1 time: 0.516491 Aug 31 16:13:36.640600 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2206/4613] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:36 2022] GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a => generated 1308 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:36.709897 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-90c150d7-410e-4014-bc2f-433d17006781 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:36.710663 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-90c150d7-410e-4014-bc2f-433d17006781 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] [instance: bfb43b5d-9803-4760-8f51-f3bb651636a3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:36.719385 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-90c150d7-410e-4014-bc2f-433d17006781 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:36.719967 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-90c150d7-410e-4014-bc2f-433d17006781 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:36.720595 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-90c150d7-410e-4014-bc2f-433d17006781 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:36.721416 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-90c150d7-410e-4014-bc2f-433d17006781 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:36.722063 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-90c150d7-410e-4014-bc2f-433d17006781 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:36.722728 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-90c150d7-410e-4014-bc2f-433d17006781 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:36.741705 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-90c150d7-410e-4014-bc2f-433d17006781 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] HTTP exception thrown: Instance bfb43b5d-9803-4760-8f51-f3bb651636a3 could not be found. Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-90c150d7-410e-4014-bc2f-433d17006781 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Request method failure captured: Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/bfb43b5d-9803-4760-8f51-f3bb651636a3 HTTP/1.1 Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4iXaMjLB2-0bRZCrT6_sfdbgTDrsgjrtWo_V4S2VwlmSr8l1PckkbKjDcK8Uxx5TkESdx6v1T_qwEgBH9n-NYsYTjaxm8-96yTFCeQdTcXr0lNlbShNsDihMTHo5DCNOCAXB_wlA71KRK04AINBwIYKs_dRfczSvHNJMCjjtvJpCtc Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 7647e0ee82f148c6a4c138842d8fbf69 Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1919896754 Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7647e0ee82f148c6a4c138842d8fbf69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7647e0ee82f148c6a4c138842d8fbf69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7647e0ee82f148c6a4c138842d8fbf69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7647e0ee82f148c6a4c138842d8fbf69", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1919896754 Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 7647e0ee82f148c6a4c138842d8fbf69 Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1919896754 Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServerMetadataNegativeTestJSON-1919896754-project Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: f5bf48d039ca4ce489212ef340ddb5ce Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1919896754-project Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance bfb43b5d-9803-4760-8f51-f3bb651636a3 could not be found. Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'bfb43b5d-9803-4760-8f51-f3bb651636a3'} Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfb43b5d-9803-4760-8f51-f3bb651636a3 could not be found. Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfb43b5d-9803-4760-8f51-f3bb651636a3 could not be found. Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:36.743559 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:36.749386 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:36.749386 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:36.749386 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:36.749386 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:36.749386 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:13:36.749386 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:13:36.749386 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfb43b5d-9803-4760-8f51-f3bb651636a3 could not be found. Aug 31 16:13:36.749386 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:36.749386 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-90c150d7-410e-4014-bc2f-433d17006781 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] Returning 404 to user: Instance bfb43b5d-9803-4760-8f51-f3bb651636a3 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:13:36.749386 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-90c150d7-410e-4014-bc2f-433d17006781 tempest-ServerMetadataNegativeTestJSON-1919896754 tempest-ServerMetadataNegativeTestJSON-1919896754-project] 10.222.0.50 "GET /compute/v2.1/servers/bfb43b5d-9803-4760-8f51-f3bb651636a3" status: 404 len: 111 microversion: 2.1 time: 0.043575 Aug 31 16:13:36.751794 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2408/4614] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:36 2022] GET /compute/v2.1/servers/bfb43b5d-9803-4760-8f51-f3bb651636a3 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:13:36.782709 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-b3f974f2-fefe-431f-9a60-4554366fffc8 req-e3230acb-a16a-4afb-ad7d-3b66670c7042 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c40a98f-366d-4392-9034-7841f68b2050", "tag": "d9b0901e-5dc3-4373-a2f1-0cba26b60d8b"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:36.796912 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b3f974f2-fefe-431f-9a60-4554366fffc8 req-e3230acb-a16a-4afb-ad7d-3b66670c7042 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:36.797608 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b3f974f2-fefe-431f-9a60-4554366fffc8 req-e3230acb-a16a-4afb-ad7d-3b66670c7042 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:36.798120 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b3f974f2-fefe-431f-9a60-4554366fffc8 req-e3230acb-a16a-4afb-ad7d-3b66670c7042 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:36.812539 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-b3f974f2-fefe-431f-9a60-4554366fffc8 req-e3230acb-a16a-4afb-ad7d-3b66670c7042 service nova] Creating event network-changed:d9b0901e-5dc3-4373-a2f1-0cba26b60d8b for instance 1c40a98f-366d-4392-9034-7841f68b2050 on n-h1-833090-16 Aug 31 16:13:36.824086 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-b3f974f2-fefe-431f-9a60-4554366fffc8 req-e3230acb-a16a-4afb-ad7d-3b66670c7042 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040732 Aug 31 16:13:36.825621 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2207/4615] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:13:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:36.919045 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e6343cfc-e489-4a5f-8ece-432f2e64c641 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:36.919633 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e6343cfc-e489-4a5f-8ece-432f2e64c641 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] [instance: 524393de-26e6-483e-90b1-b2d27dcc4044] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:36.958507 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6343cfc-e489-4a5f-8ece-432f2e64c641 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:36.961794 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6343cfc-e489-4a5f-8ece-432f2e64c641 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:36.963932 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6343cfc-e489-4a5f-8ece-432f2e64c641 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:36.967241 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6343cfc-e489-4a5f-8ece-432f2e64c641 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:36.972221 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6343cfc-e489-4a5f-8ece-432f2e64c641 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:36.973493 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6343cfc-e489-4a5f-8ece-432f2e64c641 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:37.152802 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e6343cfc-e489-4a5f-8ece-432f2e64c641 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba99802efbce47e4943f8c82d8071a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08088a66bb9f4fa6946be32fa4b9071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:37.172296 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e6343cfc-e489-4a5f-8ece-432f2e64c641 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba99802efbce47e4943f8c82d8071a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08088a66bb9f4fa6946be32fa4b9071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:37.174406 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e6343cfc-e489-4a5f-8ece-432f2e64c641 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba99802efbce47e4943f8c82d8071a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08088a66bb9f4fa6946be32fa4b9071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:37.176121 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e6343cfc-e489-4a5f-8ece-432f2e64c641 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] 10.222.0.50 "GET /compute/v2.1/servers/524393de-26e6-483e-90b1-b2d27dcc4044" status: 200 len: 1360 microversion: 2.47 time: 0.261360 Aug 31 16:13:37.190914 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2409/4616] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:13:36 2022] GET /compute/v2.1/servers/524393de-26e6-483e-90b1-b2d27dcc4044 => generated 1360 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:13:37.202766 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b7fb7acf-06dc-40f2-9c3a-b301a5754a3c tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1153198195"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:37.206909 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b7fb7acf-06dc-40f2-9c3a-b301a5754a3c tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] [instance: 524393de-26e6-483e-90b1-b2d27dcc4044] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:37.215453 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7fb7acf-06dc-40f2-9c3a-b301a5754a3c tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:37.215990 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7fb7acf-06dc-40f2-9c3a-b301a5754a3c tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:37.216432 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7fb7acf-06dc-40f2-9c3a-b301a5754a3c tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:37.217190 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7fb7acf-06dc-40f2-9c3a-b301a5754a3c tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:37.217646 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7fb7acf-06dc-40f2-9c3a-b301a5754a3c tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:37.218283 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7fb7acf-06dc-40f2-9c3a-b301a5754a3c tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:37.282198 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a155863e-0893-45d2-ad9f-e44a52b3af16 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:37.283144 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a155863e-0893-45d2-ad9f-e44a52b3af16 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 1c40a98f-366d-4392-9034-7841f68b2050] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:37.327554 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a155863e-0893-45d2-ad9f-e44a52b3af16 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:37.331148 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a155863e-0893-45d2-ad9f-e44a52b3af16 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:37.334470 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a155863e-0893-45d2-ad9f-e44a52b3af16 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:37.344409 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a155863e-0893-45d2-ad9f-e44a52b3af16 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:37.350002 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a155863e-0893-45d2-ad9f-e44a52b3af16 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:37.353490 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a155863e-0893-45d2-ad9f-e44a52b3af16 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:37.565362 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b7fb7acf-06dc-40f2-9c3a-b301a5754a3c tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] 10.222.0.50 "POST /compute/v2.1/servers/524393de-26e6-483e-90b1-b2d27dcc4044/action" status: 202 len: 52 microversion: 2.47 time: 0.367964 Aug 31 16:13:37.566780 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2208/4617] 10.222.0.50 () {62 vars in 1319 bytes} [Wed Aug 31 16:13:37 2022] POST /compute/v2.1/servers/524393de-26e6-483e-90b1-b2d27dcc4044/action => generated 52 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Aug 31 16:13:37.581754 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-70b0c956-0c93-40a9-97cd-3907fee739ae tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:37.582395 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-70b0c956-0c93-40a9-97cd-3907fee739ae tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] [instance: 524393de-26e6-483e-90b1-b2d27dcc4044] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:37.600845 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70b0c956-0c93-40a9-97cd-3907fee739ae tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:37.602038 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70b0c956-0c93-40a9-97cd-3907fee739ae tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:37.605391 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70b0c956-0c93-40a9-97cd-3907fee739ae tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:37.606398 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70b0c956-0c93-40a9-97cd-3907fee739ae tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:37.608208 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70b0c956-0c93-40a9-97cd-3907fee739ae tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:37.608896 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70b0c956-0c93-40a9-97cd-3907fee739ae tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:37.622869 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:13:37.663165 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-70b0c956-0c93-40a9-97cd-3907fee739ae tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] [instance: 524393de-26e6-483e-90b1-b2d27dcc4044] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:13:37.741088 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a155863e-0893-45d2-ad9f-e44a52b3af16 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:37.762631 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a155863e-0893-45d2-ad9f-e44a52b3af16 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050" status: 200 len: 1372 microversion: 2.1 time: 0.488054 Aug 31 16:13:37.769776 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2410/4618] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:37 2022] GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050 => generated 1372 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:37.789706 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e23fd45f-3c37-4eb3-baca-7f26ac772bef tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:37.793899 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e23fd45f-3c37-4eb3-baca-7f26ac772bef tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ed9a700e-0de1-4ed3-993e-c0b6b293b02a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:37.815689 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e23fd45f-3c37-4eb3-baca-7f26ac772bef tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:37.816178 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e23fd45f-3c37-4eb3-baca-7f26ac772bef tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:37.816728 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e23fd45f-3c37-4eb3-baca-7f26ac772bef tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:37.817310 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e23fd45f-3c37-4eb3-baca-7f26ac772bef tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:37.817756 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e23fd45f-3c37-4eb3-baca-7f26ac772bef tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:37.820259 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e23fd45f-3c37-4eb3-baca-7f26ac772bef tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:37.871795 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-70b0c956-0c93-40a9-97cd-3907fee739ae tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] 10.222.0.50 "DELETE /compute/v2.1/servers/524393de-26e6-483e-90b1-b2d27dcc4044" status: 204 len: 0 microversion: 2.47 time: 0.294520 Aug 31 16:13:37.873669 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2209/4619] 10.222.0.50 () {60 vars in 1280 bytes} [Wed Aug 31 16:13:37 2022] DELETE /compute/v2.1/servers/524393de-26e6-483e-90b1-b2d27dcc4044 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 16:13:37.884681 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c6d92e08-617f-4ae7-9343-216c2961c4e3 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:37.888502 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c6d92e08-617f-4ae7-9343-216c2961c4e3 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] [instance: 524393de-26e6-483e-90b1-b2d27dcc4044] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:37.910542 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6d92e08-617f-4ae7-9343-216c2961c4e3 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:37.912556 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6d92e08-617f-4ae7-9343-216c2961c4e3 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:37.918030 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6d92e08-617f-4ae7-9343-216c2961c4e3 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:37.919222 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6d92e08-617f-4ae7-9343-216c2961c4e3 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:37.923004 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6d92e08-617f-4ae7-9343-216c2961c4e3 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:37.924483 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6d92e08-617f-4ae7-9343-216c2961c4e3 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:38.184724 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c6d92e08-617f-4ae7-9343-216c2961c4e3 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba99802efbce47e4943f8c82d8071a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08088a66bb9f4fa6946be32fa4b9071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:38.209177 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c6d92e08-617f-4ae7-9343-216c2961c4e3 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba99802efbce47e4943f8c82d8071a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08088a66bb9f4fa6946be32fa4b9071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:38.213425 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c6d92e08-617f-4ae7-9343-216c2961c4e3 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba99802efbce47e4943f8c82d8071a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08088a66bb9f4fa6946be32fa4b9071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:38.227684 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c6d92e08-617f-4ae7-9343-216c2961c4e3 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] 10.222.0.50 "GET /compute/v2.1/servers/524393de-26e6-483e-90b1-b2d27dcc4044" status: 200 len: 1366 microversion: 2.47 time: 0.337291 Aug 31 16:13:38.229557 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2210/4620] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:13:37 2022] GET /compute/v2.1/servers/524393de-26e6-483e-90b1-b2d27dcc4044 => generated 1366 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:13:38.403222 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9b9d8b17-3fbc-4412-ae2a-245ad579398a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:38.404409 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9b9d8b17-3fbc-4412-ae2a-245ad579398a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: f6e41791-366b-4790-8338-2a52f4ebed89] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:38.425825 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b9d8b17-3fbc-4412-ae2a-245ad579398a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:38.426888 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b9d8b17-3fbc-4412-ae2a-245ad579398a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:38.427616 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b9d8b17-3fbc-4412-ae2a-245ad579398a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:38.428619 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b9d8b17-3fbc-4412-ae2a-245ad579398a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:38.430386 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b9d8b17-3fbc-4412-ae2a-245ad579398a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:38.431082 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b9d8b17-3fbc-4412-ae2a-245ad579398a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:38.483287 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9b9d8b17-3fbc-4412-ae2a-245ad579398a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: f6e41791-366b-4790-8338-2a52f4ebed89] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:13:38.648900 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9b9d8b17-3fbc-4412-ae2a-245ad579398a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "DELETE /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89" status: 204 len: 0 microversion: 2.1 time: 0.249236 Aug 31 16:13:38.653402 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2211/4621] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:13:38 2022] DELETE /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:13:38.669225 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-989af2c1-cc8f-4145-912a-59cc88c683ad tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:38.671280 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-989af2c1-cc8f-4145-912a-59cc88c683ad tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: f6e41791-366b-4790-8338-2a52f4ebed89] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:38.690633 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-989af2c1-cc8f-4145-912a-59cc88c683ad tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:38.694037 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-989af2c1-cc8f-4145-912a-59cc88c683ad tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:38.694678 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-989af2c1-cc8f-4145-912a-59cc88c683ad tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:38.696700 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-989af2c1-cc8f-4145-912a-59cc88c683ad tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:38.700593 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-989af2c1-cc8f-4145-912a-59cc88c683ad tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:38.701024 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-989af2c1-cc8f-4145-912a-59cc88c683ad tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:38.766753 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e23fd45f-3c37-4eb3-baca-7f26ac772bef tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:38.794283 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e23fd45f-3c37-4eb3-baca-7f26ac772bef tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a" status: 200 len: 1308 microversion: 2.1 time: 1.014861 Aug 31 16:13:38.794965 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2411/4622] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:37 2022] GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a => generated 1308 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:38.800096 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-728cf902-16ba-46ad-a882-6670a9da9fed tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:38.800715 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-728cf902-16ba-46ad-a882-6670a9da9fed tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 1c40a98f-366d-4392-9034-7841f68b2050] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:38.815859 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-728cf902-16ba-46ad-a882-6670a9da9fed tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:38.816605 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-728cf902-16ba-46ad-a882-6670a9da9fed tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:38.817636 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-728cf902-16ba-46ad-a882-6670a9da9fed tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:38.819115 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-728cf902-16ba-46ad-a882-6670a9da9fed tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:38.820226 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-728cf902-16ba-46ad-a882-6670a9da9fed tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:38.821259 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-728cf902-16ba-46ad-a882-6670a9da9fed tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:39.157947 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-728cf902-16ba-46ad-a882-6670a9da9fed tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:39.167311 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-728cf902-16ba-46ad-a882-6670a9da9fed tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050" status: 200 len: 1372 microversion: 2.1 time: 0.371026 Aug 31 16:13:39.171720 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2412/4623] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:38 2022] GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050 => generated 1372 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:39.191506 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-33bfa522-cbd0-4f8b-8cae-0f8d1469dc50 req-b6c9abcb-d63e-4ccb-8fd4-6d1d73bb0b38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6e41791-366b-4790-8338-2a52f4ebed89", "tag": "0507378d-ba87-41ae-8199-9dd64dc20873"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:39.203558 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-989af2c1-cc8f-4145-912a-59cc88c683ad tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:39.212368 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-989af2c1-cc8f-4145-912a-59cc88c683ad tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89" status: 200 len: 1689 microversion: 2.1 time: 0.553590 Aug 31 16:13:39.216830 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2212/4624] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:38 2022] GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89 => generated 1689 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:39.230972 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-33bfa522-cbd0-4f8b-8cae-0f8d1469dc50 req-b6c9abcb-d63e-4ccb-8fd4-6d1d73bb0b38 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:39.231834 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-33bfa522-cbd0-4f8b-8cae-0f8d1469dc50 req-b6c9abcb-d63e-4ccb-8fd4-6d1d73bb0b38 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:39.233026 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-33bfa522-cbd0-4f8b-8cae-0f8d1469dc50 req-b6c9abcb-d63e-4ccb-8fd4-6d1d73bb0b38 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:39.249406 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-33bfa522-cbd0-4f8b-8cae-0f8d1469dc50 req-b6c9abcb-d63e-4ccb-8fd4-6d1d73bb0b38 service nova] Creating event network-changed:0507378d-ba87-41ae-8199-9dd64dc20873 for instance f6e41791-366b-4790-8338-2a52f4ebed89 on n-h2-833090-16 Aug 31 16:13:39.256547 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-33bfa522-cbd0-4f8b-8cae-0f8d1469dc50 req-b6c9abcb-d63e-4ccb-8fd4-6d1d73bb0b38 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071254 Aug 31 16:13:39.262685 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2413/4625] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:39.270628 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f3b1599b-d4f1-4efa-b3bc-c72d5f6c449d tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:39.273058 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f3b1599b-d4f1-4efa-b3bc-c72d5f6c449d tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] [instance: 524393de-26e6-483e-90b1-b2d27dcc4044] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:39.282028 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f3b1599b-d4f1-4efa-b3bc-c72d5f6c449d tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:39.283147 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f3b1599b-d4f1-4efa-b3bc-c72d5f6c449d tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:39.284087 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f3b1599b-d4f1-4efa-b3bc-c72d5f6c449d tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:39.285086 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f3b1599b-d4f1-4efa-b3bc-c72d5f6c449d tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:39.285771 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f3b1599b-d4f1-4efa-b3bc-c72d5f6c449d tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:39.286564 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f3b1599b-d4f1-4efa-b3bc-c72d5f6c449d tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:39.411138 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f3b1599b-d4f1-4efa-b3bc-c72d5f6c449d tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba99802efbce47e4943f8c82d8071a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08088a66bb9f4fa6946be32fa4b9071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:39.425691 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f3b1599b-d4f1-4efa-b3bc-c72d5f6c449d tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba99802efbce47e4943f8c82d8071a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08088a66bb9f4fa6946be32fa4b9071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:39.439164 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f3b1599b-d4f1-4efa-b3bc-c72d5f6c449d tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba99802efbce47e4943f8c82d8071a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08088a66bb9f4fa6946be32fa4b9071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:39.440624 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f3b1599b-d4f1-4efa-b3bc-c72d5f6c449d tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] 10.222.0.50 "GET /compute/v2.1/servers/524393de-26e6-483e-90b1-b2d27dcc4044" status: 200 len: 1366 microversion: 2.47 time: 0.176345 Aug 31 16:13:39.441649 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2414/4626] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:13:39 2022] GET /compute/v2.1/servers/524393de-26e6-483e-90b1-b2d27dcc4044 => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:13:39.456430 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b9e6dc26-5527-480c-a69d-4f0fd9dc922e tempest-KeyPairsNegativeTestJSON-2022979440 tempest-KeyPairsNegativeTestJSON-2022979440-project] Action: 'create', calling method: .version_select at 0x7fbb4641dd30>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEeIeZcfoSt66Nco4bO0aEzcIPicTPZKp/cVU3Gt39E1Aq+8qgbchVfsZyxfu9hf4zA9mK3+YSv+aKX0Lk6BkGj7P4nTLRQlY+sgdP8msohwoxyXgtkiUEk6CoLQpeAPqw=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b9e6dc26-5527-480c-a69d-4f0fd9dc922e tempest-KeyPairsNegativeTestJSON-2022979440 tempest-KeyPairsNegativeTestJSON-2022979440-project] Request method failure captured: Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 257 Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4iynwZyNNjeBkSnOkE6cUtGtaLq8vCu_fHfHzjeaVu12v69m4-qEsLJqBnGyFlp0K-FHeBAzZrvkdCxm3FFwNvW3UMFVVy_1jjF5dbk1idH0M6pgCqniYw7hZVj7Oyo650ceajijEWpzQbBDZIASAdvWyNiaVwLZ_zczbcCdW8zHLc Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: d2409b9c5864440fad71a5a234a4e089 Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2022979440 Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d2409b9c5864440fad71a5a234a4e089"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d2409b9c5864440fad71a5a234a4e089"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d2409b9c5864440fad71a5a234a4e089"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d2409b9c5864440fad71a5a234a4e089", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2022979440 Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: d2409b9c5864440fad71a5a234a4e089 Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2022979440 Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-KeyPairsNegativeTestJSON-2022979440-project Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 3a9bdf13a83646419b239110988f7b2f Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2022979440-project Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEeIeZcfoSt66Nco4bO0aEzcIPicTPZKp/cVU3Gt39E1Aq+8qgbchVfsZyxfu9hf4zA9mK3+YSv+aKX0Lk6BkGj7P4nTLRQlY+sgdP8msohwoxyXgtkiUEk6CoLQpeAPqw=="}} Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: method: Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEeIeZcfoSt66Nco4bO0aEzcIPicTPZKp/cVU3Gt39E1Aq+8qgbchVfsZyxfu9hf4zA9mK3+YSv+aKX0Lk6BkGj7P4nTLRQlY+sgdP8msohwoxyXgtkiUEk6CoLQpeAPqw=='}}} Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'minLength': 1, Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Aug 31 16:13:39.462643 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:39.468423 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:39.468423 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:39.468423 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:39.468423 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:39.468423 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:39.468423 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:13:39.468423 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:13:39.468423 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:13:39.468423 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:13:39.468423 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:13:39.468423 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:13:39.468423 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:13:39.468423 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:13:39.468423 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 16:13:39.468423 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 16:13:39.468423 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:13:39.468423 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:13:39.468423 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:13:39.468423 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:13:39.468423 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 31 16:13:39.468423 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:39.468423 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:39.468423 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:39.468423 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:39.468423 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:39.468423 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:39.468423 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:13:39.468423 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:13:39.468423 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 31 16:13:39.468423 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:39.468423 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b9e6dc26-5527-480c-a69d-4f0fd9dc922e tempest-KeyPairsNegativeTestJSON-2022979440 tempest-KeyPairsNegativeTestJSON-2022979440-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:13:39.468423 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b9e6dc26-5527-480c-a69d-4f0fd9dc922e tempest-KeyPairsNegativeTestJSON-2022979440 tempest-KeyPairsNegativeTestJSON-2022979440-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.249170 Aug 31 16:13:39.471799 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2213/4627] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 31 16:13:39 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 256 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:13:39.475761 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-24169be3-2c89-477a-86dd-c623ad1ac17d tempest-KeyPairsNegativeTestJSON-2022979440 tempest-KeyPairsNegativeTestJSON-2022979440-project] Action: 'create', calling method: .version_select at 0x7fbb46994820>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-990737008", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:39.485090 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:13:39.495647 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-24169be3-2c89-477a-86dd-c623ad1ac17d tempest-KeyPairsNegativeTestJSON-2022979440 tempest-KeyPairsNegativeTestJSON-2022979440-project] Getting quotas for project d2409b9c5864440fad71a5a234a4e089. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:13:39.501459 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-24169be3-2c89-477a-86dd-c623ad1ac17d tempest-KeyPairsNegativeTestJSON-2022979440 tempest-KeyPairsNegativeTestJSON-2022979440-project] Getting quotas for user 3a9bdf13a83646419b239110988f7b2f and project d2409b9c5864440fad71a5a234a4e089. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:13:39.525097 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-24169be3-2c89-477a-86dd-c623ad1ac17d tempest-KeyPairsNegativeTestJSON-2022979440 tempest-KeyPairsNegativeTestJSON-2022979440-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 31 16:13:39.540370 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-24169be3-2c89-477a-86dd-c623ad1ac17d tempest-KeyPairsNegativeTestJSON-2022979440 tempest-KeyPairsNegativeTestJSON-2022979440-project] Request method failure captured: Aug 31 16:13:39.540370 n-d-833090-16 devstack@n-api.service[128864]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 31 16:13:39.540370 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:13:39.540370 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:13:39.540370 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:13:39.540370 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 2166 Aug 31 16:13:39.540370 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:13:39.540370 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:13:39.540370 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:13:39.540370 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:13:39.540370 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4iynwZyNNjeBkSnOkE6cUtGtaLq8vCu_fHfHzjeaVu12v69m4-qEsLJqBnGyFlp0K-FHeBAzZrvkdCxm3FFwNvW3UMFVVy_1jjF5dbk1idH0M6pgCqniYw7hZVj7Oyo650ceajijEWpzQbBDZIASAdvWyNiaVwLZ_zczbcCdW8zHLc Aug 31 16:13:39.540370 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:13:39.540370 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:13:39.540370 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:13:39.540370 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:13:39.540370 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:13:39.540370 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:13:39.540370 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: d2409b9c5864440fad71a5a234a4e089 Aug 31 16:13:39.540370 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2022979440 Aug 31 16:13:39.540370 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:13:39.540370 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:13:39.540370 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d2409b9c5864440fad71a5a234a4e089"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d2409b9c5864440fad71a5a234a4e089"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d2409b9c5864440fad71a5a234a4e089"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d2409b9c5864440fad71a5a234a4e089", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:13:39.540370 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2022979440 Aug 31 16:13:39.540370 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: d2409b9c5864440fad71a5a234a4e089 Aug 31 16:13:39.540370 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2022979440 Aug 31 16:13:39.540370 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-KeyPairsNegativeTestJSON-2022979440-project Aug 31 16:13:39.540370 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:13:39.540370 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:13:39.540370 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 3a9bdf13a83646419b239110988f7b2f Aug 31 16:13:39.540370 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2022979440-project Aug 31 16:13:39.540370 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 16:13:39.540370 n-d-833090-16 devstack@n-api.service[128864]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-990737008", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Aug 31 16:13:39.540370 n-d-833090-16 devstack@n-api.service[128864]: method: Aug 31 16:13:39.540370 n-d-833090-16 devstack@n-api.service[128864]: exception: Keypair data is invalid: failed to generate fingerprint Aug 31 16:13:39.543994 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-990737008', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Aug 31 16:13:39.543994 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:13:39.543994 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:39.543994 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 31 16:13:39.543994 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 31 16:13:39.543994 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Aug 31 16:13:39.543994 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Aug 31 16:13:39.543994 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Aug 31 16:13:39.543994 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:39.543994 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:39.543994 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:39.543994 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:39.543994 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 31 16:13:39.543994 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 31 16:13:39.543994 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 31 16:13:39.543994 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 31 16:13:39.543994 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 16:13:39.543994 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 16:13:39.543994 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 16:13:39.543994 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 16:13:39.543994 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 31 16:13:39.543994 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 31 16:13:39.543994 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 31 16:13:39.543994 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 31 16:13:39.543994 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6845, in _generate_fingerprint Aug 31 16:13:39.543994 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 31 16:13:39.543994 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 31 16:13:39.543994 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 31 16:13:39.543994 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 31 16:13:39.543994 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:39.543994 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:39.543994 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:39.543994 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:39.543994 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:39.543994 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:39.543994 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:13:39.543994 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:13:39.543994 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:13:39.543994 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:13:39.543994 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:13:39.543994 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:13:39.548159 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:13:39.548159 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:13:39.548159 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:13:39.548159 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:13:39.548159 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 31 16:13:39.548159 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 31 16:13:39.548159 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 31 16:13:39.548159 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 31 16:13:39.548159 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 31 16:13:39.548159 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:39.548159 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:39.548159 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:39.548159 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:39.548159 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:39.548159 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:39.548159 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:13:39.548159 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:13:39.548159 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 31 16:13:39.548159 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:39.548159 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-24169be3-2c89-477a-86dd-c623ad1ac17d tempest-KeyPairsNegativeTestJSON-2022979440 tempest-KeyPairsNegativeTestJSON-2022979440-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:13:39.548159 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-24169be3-2c89-477a-86dd-c623ad1ac17d tempest-KeyPairsNegativeTestJSON-2022979440 tempest-KeyPairsNegativeTestJSON-2022979440-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.070776 Aug 31 16:13:39.548159 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2415/4628] 10.222.0.50 () {60 vars in 1160 bytes} [Wed Aug 31 16:13:39 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 72 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 31 16:13:39.555002 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-de5855ab-fc4a-43d2-8532-988d1f53a024 tempest-KeyPairsNegativeTestJSON-2022979440 tempest-KeyPairsNegativeTestJSON-2022979440-project] Action: 'create', calling method: .version_select at 0x7fbb4ac6bf70>, body: {"keypair": {"name": "tempest-keypair-481305175", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCTE8Ik9+xO5pIsn02AcSGAlbHFlPiwdKX1xBajKTygXhIYuRzRlWEYn41SnGJv08/GeRqjU8lOQeHxlkMelGShtyca7ImeKL6RKQldoDO7Ve3ILGXBkiG/eHHNUxYcJtQ=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:39.572151 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-de5855ab-fc4a-43d2-8532-988d1f53a024 tempest-KeyPairsNegativeTestJSON-2022979440 tempest-KeyPairsNegativeTestJSON-2022979440-project] Getting quotas for project d2409b9c5864440fad71a5a234a4e089. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:13:39.577697 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-de5855ab-fc4a-43d2-8532-988d1f53a024 tempest-KeyPairsNegativeTestJSON-2022979440 tempest-KeyPairsNegativeTestJSON-2022979440-project] Getting quotas for user 3a9bdf13a83646419b239110988f7b2f and project d2409b9c5864440fad71a5a234a4e089. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:13:39.623644 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-de5855ab-fc4a-43d2-8532-988d1f53a024 tempest-KeyPairsNegativeTestJSON-2022979440 tempest-KeyPairsNegativeTestJSON-2022979440-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.071497 Aug 31 16:13:39.625774 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2214/4629] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 31 16:13:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:39.639804 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0f249974-75fa-411f-b365-21ad7bf32e58 tempest-KeyPairsNegativeTestJSON-2022979440 tempest-KeyPairsNegativeTestJSON-2022979440-project] Action: 'create', calling method: .version_select at 0x7fbb4618e8b0>, body: {"keypair": {"name": "tempest-keypair-481305175", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLaeUKe+J6jFlku5ygZcMQ/JdYP0lzDZhHDRrP3/TO5xTzAaytafAZJS1wZQBuoryrBChLKrTfz+pC+vs3LOKuwFGa/xqHBLKj5tm7pMOEQYWD9CpJgzoxmB6vzTvWKSVg=="}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:39.667724 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-0f249974-75fa-411f-b365-21ad7bf32e58 tempest-KeyPairsNegativeTestJSON-2022979440 tempest-KeyPairsNegativeTestJSON-2022979440-project] Getting quotas for project d2409b9c5864440fad71a5a234a4e089. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:13:39.674250 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-0f249974-75fa-411f-b365-21ad7bf32e58 tempest-KeyPairsNegativeTestJSON-2022979440 tempest-KeyPairsNegativeTestJSON-2022979440-project] Getting quotas for user 3a9bdf13a83646419b239110988f7b2f and project d2409b9c5864440fad71a5a234a4e089. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:13:39.704252 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-0f249974-75fa-411f-b365-21ad7bf32e58 tempest-KeyPairsNegativeTestJSON-2022979440 tempest-KeyPairsNegativeTestJSON-2022979440-project] HTTP exception thrown: Key pair 'tempest-keypair-481305175' already exists. Aug 31 16:13:39.716064 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0f249974-75fa-411f-b365-21ad7bf32e58 tempest-KeyPairsNegativeTestJSON-2022979440 tempest-KeyPairsNegativeTestJSON-2022979440-project] Request method failure captured: Aug 31 16:13:39.716064 n-d-833090-16 devstack@n-api.service[128864]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 31 16:13:39.716064 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:13:39.716064 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:13:39.716064 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:13:39.716064 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 272 Aug 31 16:13:39.716064 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:13:39.716064 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:13:39.716064 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:13:39.716064 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:13:39.716064 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4iynwZyNNjeBkSnOkE6cUtGtaLq8vCu_fHfHzjeaVu12v69m4-qEsLJqBnGyFlp0K-FHeBAzZrvkdCxm3FFwNvW3UMFVVy_1jjF5dbk1idH0M6pgCqniYw7hZVj7Oyo650ceajijEWpzQbBDZIASAdvWyNiaVwLZ_zczbcCdW8zHLc Aug 31 16:13:39.716064 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:13:39.716064 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:13:39.716064 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:13:39.716064 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:13:39.716064 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:13:39.716064 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:13:39.716064 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: d2409b9c5864440fad71a5a234a4e089 Aug 31 16:13:39.716064 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2022979440 Aug 31 16:13:39.716064 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:13:39.716064 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:13:39.716064 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d2409b9c5864440fad71a5a234a4e089"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d2409b9c5864440fad71a5a234a4e089"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d2409b9c5864440fad71a5a234a4e089"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d2409b9c5864440fad71a5a234a4e089", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:13:39.716064 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2022979440 Aug 31 16:13:39.716064 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: d2409b9c5864440fad71a5a234a4e089 Aug 31 16:13:39.716064 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2022979440 Aug 31 16:13:39.716064 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-KeyPairsNegativeTestJSON-2022979440-project Aug 31 16:13:39.716064 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:13:39.716064 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:13:39.716064 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 3a9bdf13a83646419b239110988f7b2f Aug 31 16:13:39.716064 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2022979440-project Aug 31 16:13:39.716064 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 16:13:39.716064 n-d-833090-16 devstack@n-api.service[128864]: {"keypair": {"name": "tempest-keypair-481305175", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLaeUKe+J6jFlku5ygZcMQ/JdYP0lzDZhHDRrP3/TO5xTzAaytafAZJS1wZQBuoryrBChLKrTfz+pC+vs3LOKuwFGa/xqHBLKj5tm7pMOEQYWD9CpJgzoxmB6vzTvWKSVg=="}} Aug 31 16:13:39.716064 n-d-833090-16 devstack@n-api.service[128864]: method: Aug 31 16:13:39.716064 n-d-833090-16 devstack@n-api.service[128864]: exception: Key pair 'tempest-keypair-481305175' already exists. Aug 31 16:13:39.716064 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-481305175', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLaeUKe+J6jFlku5ygZcMQ/JdYP0lzDZhHDRrP3/TO5xTzAaytafAZJS1wZQBuoryrBChLKrTfz+pC+vs3LOKuwFGa/xqHBLKj5tm7pMOEQYWD9CpJgzoxmB6vzTvWKSVg=='}}} Aug 31 16:13:39.716064 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:13:39.716064 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:39.716064 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 16:13:39.716064 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 31 16:13:39.716064 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 16:13:39.716064 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 31 16:13:39.716064 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 16:13:39.716064 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 31 16:13:39.716064 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 16:13:39.716064 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 31 16:13:39.716064 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 16:13:39.716064 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 16:13:39.716064 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 16:13:39.716064 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result.read() Aug 31 16:13:39.716064 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 16:13:39.716064 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 31 16:13:39.716064 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 16:13:39.716064 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 31 16:13:39.716064 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 16:13:39.716064 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 31 16:13:39.716064 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 16:13:39.716064 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 31 16:13:39.716064 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '3a9bdf13a83646419b239110988f7b2f-tempest-keypair-481305175' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 31 16:13:39.716064 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:39.722464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 31 16:13:39.722464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:39.722464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:39.722464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Aug 31 16:13:39.722464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi kp.save(context.session) Aug 31 16:13:39.722464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 31 16:13:39.722464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi session.flush() Aug 31 16:13:39.722464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 16:13:39.722464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 31 16:13:39.722464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 16:13:39.722464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 31 16:13:39.722464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 16:13:39.722464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 31 16:13:39.722464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 16:13:39.722464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception Aug 31 16:13:39.722464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 16:13:39.722464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 31 16:13:39.722464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 16:13:39.722464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 31 16:13:39.722464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 16:13:39.722464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 31 16:13:39.722464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 16:13:39.722464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 31 16:13:39.722464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 31 16:13:39.722464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 31 16:13:39.722464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 16:13:39.722464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 16:13:39.722464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 16:13:39.722464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 31 16:13:39.722464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 16:13:39.722464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 31 16:13:39.722464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 16:13:39.722464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 31 16:13:39.722464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 16:13:39.722464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 16:13:39.722464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 16:13:39.722464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception Aug 31 16:13:39.722464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 16:13:39.722464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 31 16:13:39.722464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 16:13:39.722464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 31 16:13:39.722464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 16:13:39.722464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 31 16:13:39.722464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 16:13:39.722464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 31 16:13:39.722464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 16:13:39.722464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 16:13:39.722464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 16:13:39.722464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result.read() Aug 31 16:13:39.722464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 16:13:39.722464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 31 16:13:39.722464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 16:13:39.722464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 31 16:13:39.722464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 16:13:39.722464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 31 16:13:39.722464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 16:13:39.736247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 31 16:13:39.736247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '3a9bdf13a83646419b239110988f7b2f-tempest-keypair-481305175' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 31 16:13:39.736247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Aug 31 16:13:39.736247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 31, 16, 13, 39, 695291), 'updated_at': None, 'name': 'tempest-keypair-481305175', 'user_id': '3a9bdf13a83646419b239110988f7b2f', 'fingerprint': '47:49:1a:f4:de:5d:26:7e:2f:76:44:9f:fe:a5:ec:55', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLaeUKe+J6jFlku5ygZcMQ/JdYP0lzDZhHDRrP3/TO5xTzAaytafAZJS1wZQBuoryrBChLKrTfz+pC+vs3LOKuwFGa/xqHBLKj5tm7pMOEQYWD9CpJgzoxmB6vzTvWKSVg==', 'type': 'ssh'}] Aug 31 16:13:39.736247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 16:13:39.736247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:39.736247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:39.736247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:39.736247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:39.736247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 31 16:13:39.736247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 31 16:13:39.736247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 31 16:13:39.736247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 31 16:13:39.736247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 16:13:39.736247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 16:13:39.736247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 16:13:39.736247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 16:13:39.736247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 31 16:13:39.736247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 31 16:13:39.736247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6775, in import_key_pair Aug 31 16:13:39.736247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi keypair.create() Aug 31 16:13:39.736247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 31 16:13:39.736247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 31 16:13:39.736247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Aug 31 16:13:39.736247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._create() Aug 31 16:13:39.736247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Aug 31 16:13:39.736247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Aug 31 16:13:39.736247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Aug 31 16:13:39.736247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Aug 31 16:13:39.736247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 31 16:13:39.736247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 31 16:13:39.736247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Aug 31 16:13:39.736247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Aug 31 16:13:39.736247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-481305175' already exists. Aug 31 16:13:39.736247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:39.736247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:39.736247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:39.736247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:39.736247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:39.736247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:39.736247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:13:39.736247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:13:39.736247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:13:39.736247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:13:39.736247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:13:39.736247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:13:39.736247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:13:39.736247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:13:39.736247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:13:39.736247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:13:39.736247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 31 16:13:39.736247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 31 16:13:39.736247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Aug 31 16:13:39.736247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Aug 31 16:13:39.736247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-481305175' already exists. Aug 31 16:13:39.750594 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:39.750594 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:39.750594 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:39.750594 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:39.750594 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:39.750594 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:39.750594 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:13:39.750594 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:13:39.750594 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-481305175' already exists. Aug 31 16:13:39.750594 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:39.750594 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0f249974-75fa-411f-b365-21ad7bf32e58 tempest-KeyPairsNegativeTestJSON-2022979440 tempest-KeyPairsNegativeTestJSON-2022979440-project] Returning 409 to user: Key pair 'tempest-keypair-481305175' already exists. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:13:39.750594 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0f249974-75fa-411f-b365-21ad7bf32e58 tempest-KeyPairsNegativeTestJSON-2022979440 tempest-KeyPairsNegativeTestJSON-2022979440-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.087222 Aug 31 16:13:39.750594 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2416/4630] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 31 16:13:39 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 89 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 16:13:39.753646 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9b4e0570-457e-4bd2-8cb8-de129301cf55 tempest-KeyPairsNegativeTestJSON-2022979440 tempest-KeyPairsNegativeTestJSON-2022979440-project] Calling method '.version_select at 0x7fbb4674dc10>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:39.766826 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9b4e0570-457e-4bd2-8cb8-de129301cf55 tempest-KeyPairsNegativeTestJSON-2022979440 tempest-KeyPairsNegativeTestJSON-2022979440-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-481305175" status: 202 len: 0 microversion: 2.1 time: 0.039447 Aug 31 16:13:39.774749 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2215/4631] 10.222.0.50 () {58 vars in 1218 bytes} [Wed Aug 31 16:13:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-481305175 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:13:39.780708 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-59d2d8c0-adf1-4edc-ad69-fb740b0d02c3 tempest-KeyPairsNegativeTestJSON-2022979440 tempest-KeyPairsNegativeTestJSON-2022979440-project] Action: 'create', calling method: .version_select at 0x7fbb4aa654c0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHht9j3C5cNTbcI2dzUxnGMW0viOOene+c7kkepc0sRhR2N3JOX6dPLMboLxlOcPJSq+hYbb5fWAQ9TSBjDyAULE2PJC21jun8sQCVansF5Z3QUu16H0dFoNiQDbQzl7Zg=="}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-59d2d8c0-adf1-4edc-ad69-fb740b0d02c3 tempest-KeyPairsNegativeTestJSON-2022979440 tempest-KeyPairsNegativeTestJSON-2022979440-project] Request method failure captured: Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 247 Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4iynwZyNNjeBkSnOkE6cUtGtaLq8vCu_fHfHzjeaVu12v69m4-qEsLJqBnGyFlp0K-FHeBAzZrvkdCxm3FFwNvW3UMFVVy_1jjF5dbk1idH0M6pgCqniYw7hZVj7Oyo650ceajijEWpzQbBDZIASAdvWyNiaVwLZ_zczbcCdW8zHLc Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: d2409b9c5864440fad71a5a234a4e089 Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2022979440 Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d2409b9c5864440fad71a5a234a4e089"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d2409b9c5864440fad71a5a234a4e089"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d2409b9c5864440fad71a5a234a4e089"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d2409b9c5864440fad71a5a234a4e089", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2022979440 Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: d2409b9c5864440fad71a5a234a4e089 Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2022979440 Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-KeyPairsNegativeTestJSON-2022979440-project Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 3a9bdf13a83646419b239110988f7b2f Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2022979440-project Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHht9j3C5cNTbcI2dzUxnGMW0viOOene+c7kkepc0sRhR2N3JOX6dPLMboLxlOcPJSq+hYbb5fWAQ9TSBjDyAULE2PJC21jun8sQCVansF5Z3QUu16H0dFoNiQDbQzl7Zg=="}} Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: method: Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHht9j3C5cNTbcI2dzUxnGMW0viOOene+c7kkepc0sRhR2N3JOX6dPLMboLxlOcPJSq+hYbb5fWAQ9TSBjDyAULE2PJC21jun8sQCVansF5Z3QUu16H0dFoNiQDbQzl7Zg=='}}} Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi '' Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 16:13:39.784346 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 16:13:39.789397 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:13:39.789397 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:13:39.789397 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:13:39.789397 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:13:39.789397 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 31 16:13:39.789397 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:39.789397 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:39.789397 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:39.789397 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:39.789397 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:39.789397 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:39.789397 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:13:39.789397 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:13:39.789397 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 31 16:13:39.789397 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:13:39.789397 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-59d2d8c0-adf1-4edc-ad69-fb740b0d02c3 tempest-KeyPairsNegativeTestJSON-2022979440 tempest-KeyPairsNegativeTestJSON-2022979440-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:13:39.789397 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-59d2d8c0-adf1-4edc-ad69-fb740b0d02c3 tempest-KeyPairsNegativeTestJSON-2022979440 tempest-KeyPairsNegativeTestJSON-2022979440-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.010129 Aug 31 16:13:39.792923 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2417/4632] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 31 16:13:39 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:13:39.798813 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-092890ac-e64e-42b5-82af-2743755a6b3a tempest-KeyPairsNegativeTestJSON-2022979440 tempest-KeyPairsNegativeTestJSON-2022979440-project] Action: 'create', calling method: .version_select at 0x7fbb4abc3700>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-908758469", "public_key": " "}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:39.821330 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-092890ac-e64e-42b5-82af-2743755a6b3a tempest-KeyPairsNegativeTestJSON-2022979440 tempest-KeyPairsNegativeTestJSON-2022979440-project] Getting quotas for project d2409b9c5864440fad71a5a234a4e089. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:13:39.829649 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-092890ac-e64e-42b5-82af-2743755a6b3a tempest-KeyPairsNegativeTestJSON-2022979440 tempest-KeyPairsNegativeTestJSON-2022979440-project] Getting quotas for user 3a9bdf13a83646419b239110988f7b2f and project d2409b9c5864440fad71a5a234a4e089. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:13:39.839138 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-692df37e-637c-40b9-9519-c4ea92fcb933 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:39.839911 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-692df37e-637c-40b9-9519-c4ea92fcb933 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ed9a700e-0de1-4ed3-993e-c0b6b293b02a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:39.847420 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-692df37e-637c-40b9-9519-c4ea92fcb933 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:39.848402 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-692df37e-637c-40b9-9519-c4ea92fcb933 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:39.848904 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-692df37e-637c-40b9-9519-c4ea92fcb933 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:39.850919 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-692df37e-637c-40b9-9519-c4ea92fcb933 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:39.851594 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-692df37e-637c-40b9-9519-c4ea92fcb933 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:39.852166 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-692df37e-637c-40b9-9519-c4ea92fcb933 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:39.855879 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-092890ac-e64e-42b5-82af-2743755a6b3a tempest-KeyPairsNegativeTestJSON-2022979440 tempest-KeyPairsNegativeTestJSON-2022979440-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-092890ac-e64e-42b5-82af-2743755a6b3a tempest-KeyPairsNegativeTestJSON-2022979440 tempest-KeyPairsNegativeTestJSON-2022979440-project] Request method failure captured: Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 94 Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4iynwZyNNjeBkSnOkE6cUtGtaLq8vCu_fHfHzjeaVu12v69m4-qEsLJqBnGyFlp0K-FHeBAzZrvkdCxm3FFwNvW3UMFVVy_1jjF5dbk1idH0M6pgCqniYw7hZVj7Oyo650ceajijEWpzQbBDZIASAdvWyNiaVwLZ_zczbcCdW8zHLc Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: d2409b9c5864440fad71a5a234a4e089 Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2022979440 Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d2409b9c5864440fad71a5a234a4e089"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d2409b9c5864440fad71a5a234a4e089"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d2409b9c5864440fad71a5a234a4e089"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d2409b9c5864440fad71a5a234a4e089", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2022979440 Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: d2409b9c5864440fad71a5a234a4e089 Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2022979440 Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-KeyPairsNegativeTestJSON-2022979440-project Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 3a9bdf13a83646419b239110988f7b2f Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2022979440-project Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-908758469", "public_key": " "}} Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: method: Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: exception: Keypair data is invalid: failed to generate fingerprint Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-908758469', 'public_key': ' '}}} Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6845, in _generate_fingerprint Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:39.858910 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:39.864624 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:39.864624 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:39.864624 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:39.864624 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:13:39.864624 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:13:39.864624 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:13:39.864624 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:13:39.864624 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:13:39.864624 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:13:39.864624 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:13:39.864624 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:13:39.864624 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:13:39.864624 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:13:39.864624 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 31 16:13:39.864624 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 31 16:13:39.864624 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 31 16:13:39.864624 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 31 16:13:39.864624 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 31 16:13:39.864624 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:39.864624 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:39.864624 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:39.864624 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:39.864624 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:39.864624 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:39.864624 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:13:39.864624 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:13:39.864624 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 31 16:13:39.864624 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:39.864624 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-092890ac-e64e-42b5-82af-2743755a6b3a tempest-KeyPairsNegativeTestJSON-2022979440 tempest-KeyPairsNegativeTestJSON-2022979440-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:13:39.864624 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-092890ac-e64e-42b5-82af-2743755a6b3a tempest-KeyPairsNegativeTestJSON-2022979440 tempest-KeyPairsNegativeTestJSON-2022979440-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.066334 Aug 31 16:13:39.864624 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2216/4633] 10.222.0.50 () {60 vars in 1158 bytes} [Wed Aug 31 16:13:39 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 68 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 31 16:13:39.881151 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c9b338f1-8cac-403a-9bfb-828edaba043a tempest-KeyPairsNegativeTestJSON-2022979440 tempest-KeyPairsNegativeTestJSON-2022979440-project] Action: 'create', calling method: .version_select at 0x7fbb467add30>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8JP2YQZsQi+o2x6YbSSY5knRQlUy9nnmnQCFviQs8JiAea8Wwq7s4+UUyYa0PUPt30ZVjyUbWuVfyAk5h8V263Nwon4Kf2j1jOZ3HyNXv5zGpTGgychO3QufFQP6g0vA=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:39.886453 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c9b338f1-8cac-403a-9bfb-828edaba043a tempest-KeyPairsNegativeTestJSON-2022979440 tempest-KeyPairsNegativeTestJSON-2022979440-project] Request method failure captured: Aug 31 16:13:39.886453 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 31 16:13:39.886453 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:13:39.886453 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:13:39.886453 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:13:39.886453 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 507 Aug 31 16:13:39.886453 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:13:39.886453 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:13:39.886453 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:13:39.886453 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:13:39.886453 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4iynwZyNNjeBkSnOkE6cUtGtaLq8vCu_fHfHzjeaVu12v69m4-qEsLJqBnGyFlp0K-FHeBAzZrvkdCxm3FFwNvW3UMFVVy_1jjF5dbk1idH0M6pgCqniYw7hZVj7Oyo650ceajijEWpzQbBDZIASAdvWyNiaVwLZ_zczbcCdW8zHLc Aug 31 16:13:39.886453 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:13:39.886453 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:13:39.886453 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:13:39.886453 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:13:39.886453 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:13:39.886453 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:13:39.886453 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: d2409b9c5864440fad71a5a234a4e089 Aug 31 16:13:39.886453 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2022979440 Aug 31 16:13:39.886453 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:13:39.886453 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:13:39.886453 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d2409b9c5864440fad71a5a234a4e089"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d2409b9c5864440fad71a5a234a4e089"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d2409b9c5864440fad71a5a234a4e089"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d2409b9c5864440fad71a5a234a4e089", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:13:39.886453 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2022979440 Aug 31 16:13:39.886453 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: d2409b9c5864440fad71a5a234a4e089 Aug 31 16:13:39.886453 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2022979440 Aug 31 16:13:39.886453 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-KeyPairsNegativeTestJSON-2022979440-project Aug 31 16:13:39.886453 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:13:39.886453 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:13:39.886453 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 3a9bdf13a83646419b239110988f7b2f Aug 31 16:13:39.886453 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2022979440-project Aug 31 16:13:39.886453 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 16:13:39.886453 n-d-833090-16 devstack@n-api.service[128863]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8JP2YQZsQi+o2x6YbSSY5knRQlUy9nnmnQCFviQs8JiAea8Wwq7s4+UUyYa0PUPt30ZVjyUbWuVfyAk5h8V263Nwon4Kf2j1jOZ3HyNXv5zGpTGgychO3QufFQP6g0vA=="}} Aug 31 16:13:39.886453 n-d-833090-16 devstack@n-api.service[128863]: method: Aug 31 16:13:39.886453 n-d-833090-16 devstack@n-api.service[128863]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 31 16:13:39.886453 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8JP2YQZsQi+o2x6YbSSY5knRQlUy9nnmnQCFviQs8JiAea8Wwq7s4+UUyYa0PUPt30ZVjyUbWuVfyAk5h8V263Nwon4Kf2j1jOZ3HyNXv5zGpTGgychO3QufFQP6g0vA=='}}} Aug 31 16:13:39.886453 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:13:39.886453 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:39.886453 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:13:39.886453 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:13:39.886453 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:13:39.886453 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:13:39.886453 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 31 16:13:39.886453 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:39.886453 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 31 16:13:39.886453 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 31 16:13:39.886453 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:39.886453 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 31 16:13:39.886453 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Aug 31 16:13:39.889579 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:39.889579 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:39.889579 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:39.889579 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:39.889579 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:39.889579 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:39.889579 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:13:39.889579 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:13:39.889579 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:13:39.889579 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:13:39.889579 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:13:39.889579 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:13:39.889579 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:13:39.889579 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:13:39.889579 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 16:13:39.889579 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 16:13:39.889579 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:13:39.889579 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:13:39.889579 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:13:39.889579 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:13:39.889579 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 31 16:13:39.889579 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:39.889579 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:39.889579 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:39.889579 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:39.889579 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:39.889579 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:39.889579 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:13:39.889579 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:13:39.889579 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 31 16:13:39.889579 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:39.889579 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c9b338f1-8cac-403a-9bfb-828edaba043a tempest-KeyPairsNegativeTestJSON-2022979440 tempest-KeyPairsNegativeTestJSON-2022979440-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:13:39.889579 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c9b338f1-8cac-403a-9bfb-828edaba043a tempest-KeyPairsNegativeTestJSON-2022979440 tempest-KeyPairsNegativeTestJSON-2022979440-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.012770 Aug 31 16:13:39.889579 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2217/4634] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 31 16:13:39 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:13:39.903219 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-77bd65aa-25a0-4cbe-9cb2-c557f7086a2d tempest-KeyPairsNegativeTestJSON-2022979440 tempest-KeyPairsNegativeTestJSON-2022979440-project] Action: 'create', calling method: .version_select at 0x7fbb4678c0d0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1044254753", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:39.924652 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-77bd65aa-25a0-4cbe-9cb2-c557f7086a2d tempest-KeyPairsNegativeTestJSON-2022979440 tempest-KeyPairsNegativeTestJSON-2022979440-project] Getting quotas for project d2409b9c5864440fad71a5a234a4e089. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:13:39.930479 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-77bd65aa-25a0-4cbe-9cb2-c557f7086a2d tempest-KeyPairsNegativeTestJSON-2022979440 tempest-KeyPairsNegativeTestJSON-2022979440-project] Getting quotas for user 3a9bdf13a83646419b239110988f7b2f and project d2409b9c5864440fad71a5a234a4e089. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:13:39.949756 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-77bd65aa-25a0-4cbe-9cb2-c557f7086a2d tempest-KeyPairsNegativeTestJSON-2022979440 tempest-KeyPairsNegativeTestJSON-2022979440-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-77bd65aa-25a0-4cbe-9cb2-c557f7086a2d tempest-KeyPairsNegativeTestJSON-2022979440 tempest-KeyPairsNegativeTestJSON-2022979440-project] Request method failure captured: Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 118 Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4iynwZyNNjeBkSnOkE6cUtGtaLq8vCu_fHfHzjeaVu12v69m4-qEsLJqBnGyFlp0K-FHeBAzZrvkdCxm3FFwNvW3UMFVVy_1jjF5dbk1idH0M6pgCqniYw7hZVj7Oyo650ceajijEWpzQbBDZIASAdvWyNiaVwLZ_zczbcCdW8zHLc Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: d2409b9c5864440fad71a5a234a4e089 Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2022979440 Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d2409b9c5864440fad71a5a234a4e089"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d2409b9c5864440fad71a5a234a4e089"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d2409b9c5864440fad71a5a234a4e089"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d2409b9c5864440fad71a5a234a4e089", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2022979440 Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: d2409b9c5864440fad71a5a234a4e089 Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2022979440 Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-KeyPairsNegativeTestJSON-2022979440-project Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 3a9bdf13a83646419b239110988f7b2f Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2022979440-project Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1044254753", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: method: Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: exception: Keypair data is invalid: failed to generate fingerprint Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1044254753', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6845, in _generate_fingerprint Aug 31 16:13:39.952238 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 31 16:13:39.957895 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 31 16:13:39.957895 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 31 16:13:39.957895 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 31 16:13:39.957895 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:39.957895 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:39.957895 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:39.957895 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:39.957895 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:39.957895 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:39.957895 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:13:39.957895 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:13:39.957895 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:13:39.957895 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:13:39.957895 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:13:39.957895 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:13:39.957895 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:13:39.957895 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:13:39.957895 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:13:39.957895 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:13:39.957895 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 31 16:13:39.957895 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 31 16:13:39.957895 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 31 16:13:39.957895 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 31 16:13:39.957895 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 31 16:13:39.957895 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:39.957895 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:39.957895 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:39.957895 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:39.957895 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:39.957895 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:39.957895 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:13:39.957895 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:13:39.957895 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 31 16:13:39.957895 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:39.963911 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-77bd65aa-25a0-4cbe-9cb2-c557f7086a2d tempest-KeyPairsNegativeTestJSON-2022979440 tempest-KeyPairsNegativeTestJSON-2022979440-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:13:39.965211 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-77bd65aa-25a0-4cbe-9cb2-c557f7086a2d tempest-KeyPairsNegativeTestJSON-2022979440 tempest-KeyPairsNegativeTestJSON-2022979440-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.067122 Aug 31 16:13:39.966424 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2218/4635] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 31 16:13:39 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 69 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Aug 31 16:13:39.982238 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-92f78a38-9a7a-454f-a943-d8d690358b71 tempest-KeyPairsNegativeTestJSON-2022979440 tempest-KeyPairsNegativeTestJSON-2022979440-project] Calling method '.version_select at 0x7fbb4674be50>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:39.997826 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-92f78a38-9a7a-454f-a943-d8d690358b71 tempest-KeyPairsNegativeTestJSON-2022979440 tempest-KeyPairsNegativeTestJSON-2022979440-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-507591420 not found for user 3a9bdf13a83646419b239110988f7b2f Aug 31 16:13:40.000414 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-92f78a38-9a7a-454f-a943-d8d690358b71 tempest-KeyPairsNegativeTestJSON-2022979440 tempest-KeyPairsNegativeTestJSON-2022979440-project] Request method failure captured: Aug 31 16:13:40.000414 n-d-833090-16 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-507591420 HTTP/1.1 Aug 31 16:13:40.000414 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:13:40.000414 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:13:40.000414 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:13:40.000414 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:13:40.000414 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:13:40.000414 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:13:40.000414 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:13:40.000414 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:13:40.000414 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4iynwZyNNjeBkSnOkE6cUtGtaLq8vCu_fHfHzjeaVu12v69m4-qEsLJqBnGyFlp0K-FHeBAzZrvkdCxm3FFwNvW3UMFVVy_1jjF5dbk1idH0M6pgCqniYw7hZVj7Oyo650ceajijEWpzQbBDZIASAdvWyNiaVwLZ_zczbcCdW8zHLc Aug 31 16:13:40.000414 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:13:40.000414 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:13:40.000414 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:13:40.000414 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:13:40.000414 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:13:40.000414 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:13:40.000414 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: d2409b9c5864440fad71a5a234a4e089 Aug 31 16:13:40.000414 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2022979440 Aug 31 16:13:40.000414 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:13:40.000414 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:13:40.000414 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d2409b9c5864440fad71a5a234a4e089"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d2409b9c5864440fad71a5a234a4e089"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d2409b9c5864440fad71a5a234a4e089"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d2409b9c5864440fad71a5a234a4e089", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:13:40.000414 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2022979440 Aug 31 16:13:40.000414 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: d2409b9c5864440fad71a5a234a4e089 Aug 31 16:13:40.000414 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2022979440 Aug 31 16:13:40.000414 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-KeyPairsNegativeTestJSON-2022979440-project Aug 31 16:13:40.000414 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:13:40.000414 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:13:40.000414 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 3a9bdf13a83646419b239110988f7b2f Aug 31 16:13:40.000414 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2022979440-project Aug 31 16:13:40.000414 n-d-833090-16 devstack@n-api.service[128863]: method: Aug 31 16:13:40.000414 n-d-833090-16 devstack@n-api.service[128863]: exception: Keypair tempest-keypair-non-existent-507591420 not found for user 3a9bdf13a83646419b239110988f7b2f Aug 31 16:13:40.000414 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'tempest-keypair-non-existent-507591420'} Aug 31 16:13:40.000414 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:13:40.000414 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:40.000414 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Aug 31 16:13:40.000414 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Aug 31 16:13:40.000414 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 31 16:13:40.000414 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 31 16:13:40.000414 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 16:13:40.000414 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 31 16:13:40.000414 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 16:13:40.000414 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise self.value Aug 31 16:13:40.000414 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 31 16:13:40.000414 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 31 16:13:40.000414 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6859, in delete_key_pair Aug 31 16:13:40.000414 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Aug 31 16:13:40.000414 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6880, in get_key_pair Aug 31 16:13:40.000414 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Aug 31 16:13:40.000414 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 16:13:40.000414 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 16:13:40.000414 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 31 16:13:40.000414 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 31 16:13:40.000414 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 31 16:13:40.000414 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 31 16:13:40.000414 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 31 16:13:40.000414 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 31 16:13:40.000414 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 31 16:13:40.000414 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 31 16:13:40.000414 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-507591420 not found for user 3a9bdf13a83646419b239110988f7b2f Aug 31 16:13:40.000414 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:40.000414 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:40.005607 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:40.005607 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:40.005607 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:40.005607 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:40.005607 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:13:40.005607 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:13:40.005607 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:13:40.005607 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:13:40.005607 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 16:13:40.005607 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:13:40.005607 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:13:40.005607 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:13:40.005607 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Aug 31 16:13:40.005607 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req, id) Aug 31 16:13:40.005607 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Aug 31 16:13:40.005607 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Aug 31 16:13:40.005607 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-507591420 not found for user 3a9bdf13a83646419b239110988f7b2f Aug 31 16:13:40.005607 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:40.005607 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:40.005607 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:40.005607 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:40.005607 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:40.005607 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:40.005607 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:13:40.005607 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:13:40.005607 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-507591420 not found for user 3a9bdf13a83646419b239110988f7b2f Aug 31 16:13:40.005607 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:40.005607 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-92f78a38-9a7a-454f-a943-d8d690358b71 tempest-KeyPairsNegativeTestJSON-2022979440 tempest-KeyPairsNegativeTestJSON-2022979440-project] Returning 404 to user: Keypair tempest-keypair-non-existent-507591420 not found for user 3a9bdf13a83646419b239110988f7b2f {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:13:40.013596 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-92f78a38-9a7a-454f-a943-d8d690358b71 tempest-KeyPairsNegativeTestJSON-2022979440 tempest-KeyPairsNegativeTestJSON-2022979440-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-507591420" status: 404 len: 144 microversion: 2.1 time: 0.032645 Aug 31 16:13:40.013596 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2219/4636] 10.222.0.50 () {58 vars in 1257 bytes} [Wed Aug 31 16:13:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-507591420 => generated 144 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:13:40.194720 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ac121842-ffa7-4829-86d8-e55788080d6b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:40.195622 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ac121842-ffa7-4829-86d8-e55788080d6b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 1c40a98f-366d-4392-9034-7841f68b2050] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:40.236258 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ac121842-ffa7-4829-86d8-e55788080d6b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:40.240180 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ac121842-ffa7-4829-86d8-e55788080d6b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:40.242417 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ac121842-ffa7-4829-86d8-e55788080d6b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:40.243385 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ac121842-ffa7-4829-86d8-e55788080d6b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:40.244512 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ac121842-ffa7-4829-86d8-e55788080d6b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:40.247387 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ac121842-ffa7-4829-86d8-e55788080d6b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:40.728203 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-692df37e-637c-40b9-9519-c4ea92fcb933 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:40.731424 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=100 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:13:40.744553 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-692df37e-637c-40b9-9519-c4ea92fcb933 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a" status: 200 len: 1308 microversion: 2.1 time: 0.926017 Aug 31 16:13:40.745391 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2418/4637] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:39 2022] GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a => generated 1308 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:40.767630 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-515bcce4-473d-414d-9720-b5e2e8d005e4 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:40.768248 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-515bcce4-473d-414d-9720-b5e2e8d005e4 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: f6e41791-366b-4790-8338-2a52f4ebed89] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:40.776050 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-515bcce4-473d-414d-9720-b5e2e8d005e4 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:40.777426 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-515bcce4-473d-414d-9720-b5e2e8d005e4 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:40.778052 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-515bcce4-473d-414d-9720-b5e2e8d005e4 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:40.780285 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-515bcce4-473d-414d-9720-b5e2e8d005e4 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:40.780949 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-515bcce4-473d-414d-9720-b5e2e8d005e4 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:40.782068 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-515bcce4-473d-414d-9720-b5e2e8d005e4 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:41.337745 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-515bcce4-473d-414d-9720-b5e2e8d005e4 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:41.356818 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ac121842-ffa7-4829-86d8-e55788080d6b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:41.363543 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-515bcce4-473d-414d-9720-b5e2e8d005e4 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89" status: 200 len: 1689 microversion: 2.1 time: 0.602739 Aug 31 16:13:41.366866 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2419/4638] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:40 2022] GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89 => generated 1689 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:41.371682 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ac121842-ffa7-4829-86d8-e55788080d6b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050" status: 200 len: 1372 microversion: 2.1 time: 1.183346 Aug 31 16:13:41.390496 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2220/4639] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:40 2022] GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050 => generated 1372 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:13:41.397500 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1653e036-d271-4280-b7f4-6bb7574135e3 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:41.399941 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1653e036-d271-4280-b7f4-6bb7574135e3 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] [instance: 524393de-26e6-483e-90b1-b2d27dcc4044] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:41.412919 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1653e036-d271-4280-b7f4-6bb7574135e3 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:41.413488 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1653e036-d271-4280-b7f4-6bb7574135e3 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:41.413840 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1653e036-d271-4280-b7f4-6bb7574135e3 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:41.416509 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1653e036-d271-4280-b7f4-6bb7574135e3 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:41.420302 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1653e036-d271-4280-b7f4-6bb7574135e3 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:41.420767 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1653e036-d271-4280-b7f4-6bb7574135e3 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:41.501294 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1653e036-d271-4280-b7f4-6bb7574135e3 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:41.504234 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1653e036-d271-4280-b7f4-6bb7574135e3 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:41.506370 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1653e036-d271-4280-b7f4-6bb7574135e3 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:41.507075 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-1653e036-d271-4280-b7f4-6bb7574135e3 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Lazy-loading 'fault' on Instance uuid 524393de-26e6-483e-90b1-b2d27dcc4044 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:13:41.575683 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1653e036-d271-4280-b7f4-6bb7574135e3 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba99802efbce47e4943f8c82d8071a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08088a66bb9f4fa6946be32fa4b9071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:41.614614 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1653e036-d271-4280-b7f4-6bb7574135e3 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba99802efbce47e4943f8c82d8071a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08088a66bb9f4fa6946be32fa4b9071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:41.625429 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1653e036-d271-4280-b7f4-6bb7574135e3 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba99802efbce47e4943f8c82d8071a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08088a66bb9f4fa6946be32fa4b9071a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:41.638733 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1653e036-d271-4280-b7f4-6bb7574135e3 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] 10.222.0.50 "GET /compute/v2.1/servers/524393de-26e6-483e-90b1-b2d27dcc4044" status: 200 len: 1371 microversion: 2.47 time: 0.263725 Aug 31 16:13:41.643031 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2420/4640] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:13:41 2022] GET /compute/v2.1/servers/524393de-26e6-483e-90b1-b2d27dcc4044 => generated 1371 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:13:41.797002 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d585770e-2f6c-401b-965a-b43b72b1fe6b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:41.797674 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d585770e-2f6c-401b-965a-b43b72b1fe6b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ed9a700e-0de1-4ed3-993e-c0b6b293b02a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:41.811177 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d585770e-2f6c-401b-965a-b43b72b1fe6b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:41.814335 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d585770e-2f6c-401b-965a-b43b72b1fe6b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:41.815282 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d585770e-2f6c-401b-965a-b43b72b1fe6b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:41.816836 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d585770e-2f6c-401b-965a-b43b72b1fe6b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:41.818162 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d585770e-2f6c-401b-965a-b43b72b1fe6b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:41.818866 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d585770e-2f6c-401b-965a-b43b72b1fe6b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:41.983301 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=10 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:13:42.121256 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-6b1b64b8-6f19-491c-bf6d-3c6f3a9545df req-a109332b-ee59-4d89-bc41-133da3b21180 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c40a98f-366d-4392-9034-7841f68b2050", "name": "network-vif-plugged", "status": "completed", "tag": "d9b0901e-5dc3-4373-a2f1-0cba26b60d8b"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:42.165615 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-6b1b64b8-6f19-491c-bf6d-3c6f3a9545df req-a109332b-ee59-4d89-bc41-133da3b21180 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:42.166763 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-6b1b64b8-6f19-491c-bf6d-3c6f3a9545df req-a109332b-ee59-4d89-bc41-133da3b21180 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:42.167535 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-6b1b64b8-6f19-491c-bf6d-3c6f3a9545df req-a109332b-ee59-4d89-bc41-133da3b21180 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:42.188830 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d585770e-2f6c-401b-965a-b43b72b1fe6b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:42.201356 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-6b1b64b8-6f19-491c-bf6d-3c6f3a9545df req-a109332b-ee59-4d89-bc41-133da3b21180 service nova] Creating event network-vif-plugged:d9b0901e-5dc3-4373-a2f1-0cba26b60d8b for instance 1c40a98f-366d-4392-9034-7841f68b2050 on n-h1-833090-16 Aug 31 16:13:42.204877 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d585770e-2f6c-401b-965a-b43b72b1fe6b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a" status: 200 len: 1308 microversion: 2.1 time: 0.433739 Aug 31 16:13:42.205827 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2221/4641] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:41 2022] GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a => generated 1308 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:42.223520 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-6b1b64b8-6f19-491c-bf6d-3c6f3a9545df req-a109332b-ee59-4d89-bc41-133da3b21180 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113874 Aug 31 16:13:42.224691 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2421/4642] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:13:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:42.393652 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f8dd55b3-1dfc-4196-90f7-caeb9b4b288f tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:42.393652 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f8dd55b3-1dfc-4196-90f7-caeb9b4b288f tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: f6e41791-366b-4790-8338-2a52f4ebed89] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:42.406324 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-04da0ed2-b28f-4640-b94b-0b985fb962ca tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:42.407705 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-04da0ed2-b28f-4640-b94b-0b985fb962ca tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 1c40a98f-366d-4392-9034-7841f68b2050] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:42.412135 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8dd55b3-1dfc-4196-90f7-caeb9b4b288f tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:42.414727 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8dd55b3-1dfc-4196-90f7-caeb9b4b288f tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:42.417881 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8dd55b3-1dfc-4196-90f7-caeb9b4b288f tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:42.419116 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8dd55b3-1dfc-4196-90f7-caeb9b4b288f tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:42.419851 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8dd55b3-1dfc-4196-90f7-caeb9b4b288f tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:42.422280 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8dd55b3-1dfc-4196-90f7-caeb9b4b288f tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:42.424955 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-04da0ed2-b28f-4640-b94b-0b985fb962ca tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:42.425708 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-04da0ed2-b28f-4640-b94b-0b985fb962ca tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:42.427246 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-04da0ed2-b28f-4640-b94b-0b985fb962ca tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:42.431564 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-04da0ed2-b28f-4640-b94b-0b985fb962ca tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:42.432419 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-04da0ed2-b28f-4640-b94b-0b985fb962ca tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:42.433013 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-04da0ed2-b28f-4640-b94b-0b985fb962ca tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:43.330928 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f8dd55b3-1dfc-4196-90f7-caeb9b4b288f tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:43.348114 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f8dd55b3-1dfc-4196-90f7-caeb9b4b288f tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89" status: 200 len: 1689 microversion: 2.1 time: 0.961508 Aug 31 16:13:43.349098 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2222/4643] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:42 2022] GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89 => generated 1689 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:43.360952 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-559304dc-47e2-461d-83dd-934cbc34c146 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:43.367307 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-559304dc-47e2-461d-83dd-934cbc34c146 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] [instance: 524393de-26e6-483e-90b1-b2d27dcc4044] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:43.391367 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-04da0ed2-b28f-4640-b94b-0b985fb962ca tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:43.392285 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-559304dc-47e2-461d-83dd-934cbc34c146 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:43.396818 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-559304dc-47e2-461d-83dd-934cbc34c146 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:43.398000 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-559304dc-47e2-461d-83dd-934cbc34c146 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:43.399015 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-559304dc-47e2-461d-83dd-934cbc34c146 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:43.400064 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-559304dc-47e2-461d-83dd-934cbc34c146 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:43.405808 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-559304dc-47e2-461d-83dd-934cbc34c146 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:43.408216 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-04da0ed2-b28f-4640-b94b-0b985fb962ca tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050" status: 200 len: 1372 microversion: 2.1 time: 1.007242 Aug 31 16:13:43.409746 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2422/4644] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:42 2022] GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050 => generated 1372 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:43.417755 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b4dd5fd0-c5ad-40e2-bf0f-a170d21237f2 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:43.418865 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b4dd5fd0-c5ad-40e2-bf0f-a170d21237f2 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ed9a700e-0de1-4ed3-993e-c0b6b293b02a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:43.428575 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b4dd5fd0-c5ad-40e2-bf0f-a170d21237f2 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:43.429429 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b4dd5fd0-c5ad-40e2-bf0f-a170d21237f2 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:43.430115 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b4dd5fd0-c5ad-40e2-bf0f-a170d21237f2 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:43.431296 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b4dd5fd0-c5ad-40e2-bf0f-a170d21237f2 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:43.432230 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b4dd5fd0-c5ad-40e2-bf0f-a170d21237f2 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:43.432931 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b4dd5fd0-c5ad-40e2-bf0f-a170d21237f2 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:43.438544 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-559304dc-47e2-461d-83dd-934cbc34c146 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] HTTP exception thrown: Instance 524393de-26e6-483e-90b1-b2d27dcc4044 could not be found. Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-559304dc-47e2-461d-83dd-934cbc34c146 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Request method failure captured: Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/524393de-26e6-483e-90b1-b2d27dcc4044 HTTP/1.1 Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4irz7bpS55IC4soOIlln3KHQK05vv3R7Hh3mVGxEfsJERMin_V8IUlY0-jnlpmMcRNy-Sja4qrnkXoxNtSeotFMup0QP2mkyhdqzZgBvzEAQAK4oQVo0RRoRHoh_hjASuz-FJvQlh3cfzTc_5e-A1o_jk2_KFhNQZ-wa5Jr_1ZNsy0 Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: X-Openstack-Nova-Api-Version: 2.47 Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 08088a66bb9f4fa6946be32fa4b9071a Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersAaction247Test-1980577870 Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/08088a66bb9f4fa6946be32fa4b9071a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/08088a66bb9f4fa6946be32fa4b9071a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/08088a66bb9f4fa6946be32fa4b9071a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_08088a66bb9f4fa6946be32fa4b9071a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServersAaction247Test-1980577870 Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 08088a66bb9f4fa6946be32fa4b9071a Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersAaction247Test-1980577870 Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServersAaction247Test-1980577870-project Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: ba99802efbce47e4943f8c82d8071a73 Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServersAaction247Test-1980577870-project Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 524393de-26e6-483e-90b1-b2d27dcc4044 could not be found. Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '524393de-26e6-483e-90b1-b2d27dcc4044'} Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 524393de-26e6-483e-90b1-b2d27dcc4044 could not be found. Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 524393de-26e6-483e-90b1-b2d27dcc4044 could not be found. Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:43.462194 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:43.469471 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:43.469471 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:43.469471 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:43.469471 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:43.469471 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:13:43.469471 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:13:43.469471 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 524393de-26e6-483e-90b1-b2d27dcc4044 could not be found. Aug 31 16:13:43.469471 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:43.469471 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-559304dc-47e2-461d-83dd-934cbc34c146 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] Returning 404 to user: Instance 524393de-26e6-483e-90b1-b2d27dcc4044 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:13:43.469471 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-559304dc-47e2-461d-83dd-934cbc34c146 tempest-ServersAaction247Test-1980577870 tempest-ServersAaction247Test-1980577870-project] 10.222.0.50 "GET /compute/v2.1/servers/524393de-26e6-483e-90b1-b2d27dcc4044" status: 404 len: 111 microversion: 2.47 time: 0.113756 Aug 31 16:13:43.469471 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2223/4645] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:13:43 2022] GET /compute/v2.1/servers/524393de-26e6-483e-90b1-b2d27dcc4044 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:13:44.287466 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b4dd5fd0-c5ad-40e2-bf0f-a170d21237f2 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:44.302406 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b4dd5fd0-c5ad-40e2-bf0f-a170d21237f2 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a" status: 200 len: 1308 microversion: 2.1 time: 0.890762 Aug 31 16:13:44.303237 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2423/4646] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:43 2022] GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a => generated 1308 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:44.388088 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-464e8781-53e4-4896-86f9-47964fa562f0 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:44.389054 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-464e8781-53e4-4896-86f9-47964fa562f0 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: f6e41791-366b-4790-8338-2a52f4ebed89] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:44.416158 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-464e8781-53e4-4896-86f9-47964fa562f0 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:44.417266 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-464e8781-53e4-4896-86f9-47964fa562f0 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:44.417708 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-464e8781-53e4-4896-86f9-47964fa562f0 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:44.418454 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-464e8781-53e4-4896-86f9-47964fa562f0 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:44.418913 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-464e8781-53e4-4896-86f9-47964fa562f0 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:44.419363 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-464e8781-53e4-4896-86f9-47964fa562f0 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:44.432867 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8a5a5334-bd83-45d3-8fbb-7d8b3166ed92 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:44.433506 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8a5a5334-bd83-45d3-8fbb-7d8b3166ed92 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 1c40a98f-366d-4392-9034-7841f68b2050] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:44.456447 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8a5a5334-bd83-45d3-8fbb-7d8b3166ed92 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:44.464810 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8a5a5334-bd83-45d3-8fbb-7d8b3166ed92 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:44.465422 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8a5a5334-bd83-45d3-8fbb-7d8b3166ed92 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:44.466419 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8a5a5334-bd83-45d3-8fbb-7d8b3166ed92 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:44.466797 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8a5a5334-bd83-45d3-8fbb-7d8b3166ed92 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:44.475420 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8a5a5334-bd83-45d3-8fbb-7d8b3166ed92 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:44.675449 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-464e8781-53e4-4896-86f9-47964fa562f0 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:44.684434 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-464e8781-53e4-4896-86f9-47964fa562f0 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89" status: 200 len: 1504 microversion: 2.1 time: 0.317251 Aug 31 16:13:44.686306 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2224/4647] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:44 2022] GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89 => generated 1504 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:44.695127 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-82ffb1e1-219b-43e9-8123-ac8cd591c76d req-27d6c180-3552-4bb5-b4c4-3ea74d86fc0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed9a700e-0de1-4ed3-993e-c0b6b293b02a", "name": "network-vif-plugged", "status": "completed", "tag": "6f8d8f6e-2b42-4279-a8a4-50ef2c9c74b4"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:44.709511 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-82ffb1e1-219b-43e9-8123-ac8cd591c76d req-27d6c180-3552-4bb5-b4c4-3ea74d86fc0b service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:44.710467 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-82ffb1e1-219b-43e9-8123-ac8cd591c76d req-27d6c180-3552-4bb5-b4c4-3ea74d86fc0b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:44.711147 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-82ffb1e1-219b-43e9-8123-ac8cd591c76d req-27d6c180-3552-4bb5-b4c4-3ea74d86fc0b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:44.730845 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-82ffb1e1-219b-43e9-8123-ac8cd591c76d req-27d6c180-3552-4bb5-b4c4-3ea74d86fc0b service nova] Creating event network-vif-plugged:6f8d8f6e-2b42-4279-a8a4-50ef2c9c74b4 for instance ed9a700e-0de1-4ed3-993e-c0b6b293b02a on n-h2-833090-16 Aug 31 16:13:44.754257 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-82ffb1e1-219b-43e9-8123-ac8cd591c76d req-27d6c180-3552-4bb5-b4c4-3ea74d86fc0b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065716 Aug 31 16:13:44.756220 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2225/4648] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:44.765027 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-f4472716-4fd0-4502-80cc-af4c3be8f2a8 req-16a68406-744a-48da-977c-11e9ebf6eb94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6e41791-366b-4790-8338-2a52f4ebed89", "name": "network-vif-deleted", "tag": "0507378d-ba87-41ae-8199-9dd64dc20873"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:44.776636 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f4472716-4fd0-4502-80cc-af4c3be8f2a8 req-16a68406-744a-48da-977c-11e9ebf6eb94 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:44.777430 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f4472716-4fd0-4502-80cc-af4c3be8f2a8 req-16a68406-744a-48da-977c-11e9ebf6eb94 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:44.777968 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f4472716-4fd0-4502-80cc-af4c3be8f2a8 req-16a68406-744a-48da-977c-11e9ebf6eb94 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:44.790566 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-f4472716-4fd0-4502-80cc-af4c3be8f2a8 req-16a68406-744a-48da-977c-11e9ebf6eb94 service nova] Creating event network-vif-deleted:0507378d-ba87-41ae-8199-9dd64dc20873 for instance f6e41791-366b-4790-8338-2a52f4ebed89 on n-h2-833090-16 Aug 31 16:13:44.798476 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-f4472716-4fd0-4502-80cc-af4c3be8f2a8 req-16a68406-744a-48da-977c-11e9ebf6eb94 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039608 Aug 31 16:13:44.802034 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2226/4649] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:44.871838 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8a5a5334-bd83-45d3-8fbb-7d8b3166ed92 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:44.894924 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8a5a5334-bd83-45d3-8fbb-7d8b3166ed92 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050" status: 200 len: 1565 microversion: 2.1 time: 0.466627 Aug 31 16:13:44.902018 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2424/4650] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:44 2022] GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050 => generated 1565 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:44.918964 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a1212184-68d6-4097-a428-0ebd3b686f72 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:44.919808 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a1212184-68d6-4097-a428-0ebd3b686f72 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 1c40a98f-366d-4392-9034-7841f68b2050] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:44.928560 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1212184-68d6-4097-a428-0ebd3b686f72 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:44.929066 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1212184-68d6-4097-a428-0ebd3b686f72 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:44.929501 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1212184-68d6-4097-a428-0ebd3b686f72 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:44.930681 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1212184-68d6-4097-a428-0ebd3b686f72 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:44.931457 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1212184-68d6-4097-a428-0ebd3b686f72 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:44.944340 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1212184-68d6-4097-a428-0ebd3b686f72 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:45.238791 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a1212184-68d6-4097-a428-0ebd3b686f72 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.324076 Aug 31 16:13:45.240315 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2227/4651] 10.222.0.50 () {58 vars in 1275 bytes} [Wed Aug 31 16:13:44 2022] GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050/os-interface => generated 284 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:45.331101 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7bcd25d1-94b5-49e4-bd70-052fe57e9219 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:45.332915 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7bcd25d1-94b5-49e4-bd70-052fe57e9219 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ed9a700e-0de1-4ed3-993e-c0b6b293b02a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:45.349794 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7bcd25d1-94b5-49e4-bd70-052fe57e9219 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:45.350605 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7bcd25d1-94b5-49e4-bd70-052fe57e9219 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:45.351351 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7bcd25d1-94b5-49e4-bd70-052fe57e9219 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:45.352587 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7bcd25d1-94b5-49e4-bd70-052fe57e9219 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:45.354014 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7bcd25d1-94b5-49e4-bd70-052fe57e9219 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:45.356098 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7bcd25d1-94b5-49e4-bd70-052fe57e9219 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:45.715661 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c9f13f3b-f1a6-4d6c-9be5-b6b81bf833dd tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:45.716713 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c9f13f3b-f1a6-4d6c-9be5-b6b81bf833dd tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: f6e41791-366b-4790-8338-2a52f4ebed89] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:45.730391 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9f13f3b-f1a6-4d6c-9be5-b6b81bf833dd tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:45.734559 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9f13f3b-f1a6-4d6c-9be5-b6b81bf833dd tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:45.735330 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9f13f3b-f1a6-4d6c-9be5-b6b81bf833dd tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:45.736095 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7bcd25d1-94b5-49e4-bd70-052fe57e9219 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:45.736987 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9f13f3b-f1a6-4d6c-9be5-b6b81bf833dd tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:45.736987 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9f13f3b-f1a6-4d6c-9be5-b6b81bf833dd tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:45.737334 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9f13f3b-f1a6-4d6c-9be5-b6b81bf833dd tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:45.745635 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7bcd25d1-94b5-49e4-bd70-052fe57e9219 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a" status: 200 len: 1308 microversion: 2.1 time: 0.421337 Aug 31 16:13:45.747323 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2425/4652] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:45 2022] GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a => generated 1308 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:45.829435 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9f13f3b-f1a6-4d6c-9be5-b6b81bf833dd tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:45.830223 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9f13f3b-f1a6-4d6c-9be5-b6b81bf833dd tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:45.830812 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9f13f3b-f1a6-4d6c-9be5-b6b81bf833dd tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:45.831418 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-c9f13f3b-f1a6-4d6c-9be5-b6b81bf833dd tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lazy-loading 'fault' on Instance uuid f6e41791-366b-4790-8338-2a52f4ebed89 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:13:45.973925 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c9f13f3b-f1a6-4d6c-9be5-b6b81bf833dd tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:45.988965 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c9f13f3b-f1a6-4d6c-9be5-b6b81bf833dd tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89" status: 200 len: 1357 microversion: 2.1 time: 0.278449 Aug 31 16:13:45.992239 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2228/4653] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:45 2022] GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89 => generated 1357 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:46.782247 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7c23ec23-f1ac-401d-8f87-69b1964a384b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:46.786514 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7c23ec23-f1ac-401d-8f87-69b1964a384b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ed9a700e-0de1-4ed3-993e-c0b6b293b02a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:46.824318 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7c23ec23-f1ac-401d-8f87-69b1964a384b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:46.825230 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7c23ec23-f1ac-401d-8f87-69b1964a384b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:46.826884 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7c23ec23-f1ac-401d-8f87-69b1964a384b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:46.828934 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7c23ec23-f1ac-401d-8f87-69b1964a384b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:46.829675 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7c23ec23-f1ac-401d-8f87-69b1964a384b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:46.830543 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7c23ec23-f1ac-401d-8f87-69b1964a384b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:47.016675 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-68d4c2b7-d8cc-4fed-af37-8955c1ee3ab4 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:47.018322 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-68d4c2b7-d8cc-4fed-af37-8955c1ee3ab4 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: f6e41791-366b-4790-8338-2a52f4ebed89] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:47.039609 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68d4c2b7-d8cc-4fed-af37-8955c1ee3ab4 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:47.044616 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68d4c2b7-d8cc-4fed-af37-8955c1ee3ab4 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:47.045686 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68d4c2b7-d8cc-4fed-af37-8955c1ee3ab4 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:47.048543 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68d4c2b7-d8cc-4fed-af37-8955c1ee3ab4 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:47.049352 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68d4c2b7-d8cc-4fed-af37-8955c1ee3ab4 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:47.050340 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68d4c2b7-d8cc-4fed-af37-8955c1ee3ab4 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:47.103656 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-68d4c2b7-d8cc-4fed-af37-8955c1ee3ab4 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] HTTP exception thrown: Instance f6e41791-366b-4790-8338-2a52f4ebed89 could not be found. Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-68d4c2b7-d8cc-4fed-af37-8955c1ee3ab4 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Request method failure captured: Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89 HTTP/1.1 Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4fV98oVosqGT7VWC4t0BtAiBiZATLbXebs7dwZ2GTRmxWIxlWpcykql1rc4XcH6S5iXxbfnhW9zu0xtlzwQXV8xqLhjj_kkcwN0JMTiH3_0LSsRjsreTCqRz_N8Dc-RwStRrYjFigQ-KrUSCoxe4mvwPpJjWkSJo0qe7m_-bm95Maw Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 3397e8a2a042486eb323432c47dfd392 Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-316597183 Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3397e8a2a042486eb323432c47dfd392"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3397e8a2a042486eb323432c47dfd392"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3397e8a2a042486eb323432c47dfd392"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3397e8a2a042486eb323432c47dfd392", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-TestNetworkAdvancedServerOps-316597183 Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 3397e8a2a042486eb323432c47dfd392 Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-316597183 Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-TestNetworkAdvancedServerOps-316597183-project Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 87f8241df6664aa59ba669d733e53871 Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-TestNetworkAdvancedServerOps-316597183-project Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance f6e41791-366b-4790-8338-2a52f4ebed89 could not be found. Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'f6e41791-366b-4790-8338-2a52f4ebed89'} Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6e41791-366b-4790-8338-2a52f4ebed89 could not be found. Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6e41791-366b-4790-8338-2a52f4ebed89 could not be found. Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:47.113416 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:13:47.117907 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:47.117907 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:13:47.117907 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:13:47.117907 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:13:47.117907 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:13:47.117907 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:13:47.117907 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6e41791-366b-4790-8338-2a52f4ebed89 could not be found. Aug 31 16:13:47.117907 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:13:47.117907 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-68d4c2b7-d8cc-4fed-af37-8955c1ee3ab4 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Returning 404 to user: Instance f6e41791-366b-4790-8338-2a52f4ebed89 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:13:47.117907 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-68d4c2b7-d8cc-4fed-af37-8955c1ee3ab4 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89" status: 404 len: 111 microversion: 2.1 time: 0.108867 Aug 31 16:13:47.121456 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2229/4654] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:47 2022] GET /compute/v2.1/servers/f6e41791-366b-4790-8338-2a52f4ebed89 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:13:47.388965 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7c23ec23-f1ac-401d-8f87-69b1964a384b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:47.407109 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7c23ec23-f1ac-401d-8f87-69b1964a384b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a" status: 200 len: 1308 microversion: 2.1 time: 0.637451 Aug 31 16:13:47.407708 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2426/4655] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:46 2022] GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a => generated 1308 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:13:47.926078 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4d8db59e-1fbe-441a-9a75-a65236351e7a tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-2009281179", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": "none"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:48.079151 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-4d8db59e-1fbe-441a-9a75-a65236351e7a tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:13:48.081959 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-4d8db59e-1fbe-441a-9a75-a65236351e7a tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:13:48.083211 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-4d8db59e-1fbe-441a-9a75-a65236351e7a tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:13:48.083952 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-4d8db59e-1fbe-441a-9a75-a65236351e7a tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:13:48.084634 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-4d8db59e-1fbe-441a-9a75-a65236351e7a tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:13:48.110581 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d8db59e-1fbe-441a-9a75-a65236351e7a tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:48.111464 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d8db59e-1fbe-441a-9a75-a65236351e7a tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:48.112357 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d8db59e-1fbe-441a-9a75-a65236351e7a tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:48.113784 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d8db59e-1fbe-441a-9a75-a65236351e7a tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:48.115291 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d8db59e-1fbe-441a-9a75-a65236351e7a tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:48.116509 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d8db59e-1fbe-441a-9a75-a65236351e7a tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:48.218300 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-4d8db59e-1fbe-441a-9a75-a65236351e7a tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Getting quotas for project f10cf9c476744d658fbd33ceb3471eb1. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:13:48.240154 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-4d8db59e-1fbe-441a-9a75-a65236351e7a tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Getting quotas for user b5d9034cc6e2403190940275f8b41c2b and project f10cf9c476744d658fbd33ceb3471eb1. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:13:48.259776 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:DELETE=2,nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:13:48.294224 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4d8db59e-1fbe-441a-9a75-a65236351e7a tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:13:48.298728 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4d8db59e-1fbe-441a-9a75-a65236351e7a tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] [instance: a6faec39-0081-47ec-8896-0a705afd3876] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:13:48.397478 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4d8db59e-1fbe-441a-9a75-a65236351e7a tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.823838 Aug 31 16:13:48.399081 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2230/4656] 10.222.0.50 () {62 vars in 1188 bytes} [Wed Aug 31 16:13:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 827 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 31 16:13:48.413977 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6eb31539-f669-4a8f-802d-56655ecc2564 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:48.417882 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6eb31539-f669-4a8f-802d-56655ecc2564 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] [instance: a6faec39-0081-47ec-8896-0a705afd3876] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:48.446386 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b4b2fbb0-d2f4-4824-8b15-eee8fab0f6a5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:48.447681 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b4b2fbb0-d2f4-4824-8b15-eee8fab0f6a5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ed9a700e-0de1-4ed3-993e-c0b6b293b02a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:48.468426 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4b2fbb0-d2f4-4824-8b15-eee8fab0f6a5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:48.468426 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4b2fbb0-d2f4-4824-8b15-eee8fab0f6a5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:48.468426 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4b2fbb0-d2f4-4824-8b15-eee8fab0f6a5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:48.468426 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4b2fbb0-d2f4-4824-8b15-eee8fab0f6a5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:48.468426 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4b2fbb0-d2f4-4824-8b15-eee8fab0f6a5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:48.468426 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4b2fbb0-d2f4-4824-8b15-eee8fab0f6a5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:48.800080 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6eb31539-f669-4a8f-802d-56655ecc2564 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:48.810427 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6eb31539-f669-4a8f-802d-56655ecc2564 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:48.812408 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6eb31539-f669-4a8f-802d-56655ecc2564 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:48.834437 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6eb31539-f669-4a8f-802d-56655ecc2564 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] 10.222.0.50 "GET /compute/v2.1/servers/a6faec39-0081-47ec-8896-0a705afd3876" status: 200 len: 1278 microversion: 2.47 time: 0.404339 Aug 31 16:13:48.835210 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2427/4657] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:13:48 2022] GET /compute/v2.1/servers/a6faec39-0081-47ec-8896-0a705afd3876 => generated 1278 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:13:48.847857 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-71d6d38c-7070-451d-b218-4c38abb98815 req-a952a807-df8e-4f7c-bbb1-44b83128065c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c40a98f-366d-4392-9034-7841f68b2050", "tag": "d9b0901e-5dc3-4373-a2f1-0cba26b60d8b"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:48.907986 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-71d6d38c-7070-451d-b218-4c38abb98815 req-a952a807-df8e-4f7c-bbb1-44b83128065c service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:48.908477 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-71d6d38c-7070-451d-b218-4c38abb98815 req-a952a807-df8e-4f7c-bbb1-44b83128065c service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:48.908915 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-71d6d38c-7070-451d-b218-4c38abb98815 req-a952a807-df8e-4f7c-bbb1-44b83128065c service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:48.967298 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-71d6d38c-7070-451d-b218-4c38abb98815 req-a952a807-df8e-4f7c-bbb1-44b83128065c service nova] Creating event network-changed:d9b0901e-5dc3-4373-a2f1-0cba26b60d8b for instance 1c40a98f-366d-4392-9034-7841f68b2050 on n-h1-833090-16 Aug 31 16:13:48.997824 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-71d6d38c-7070-451d-b218-4c38abb98815 req-a952a807-df8e-4f7c-bbb1-44b83128065c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155281 Aug 31 16:13:48.998978 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2428/4658] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:13:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:13:49.154318 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-cb4042ac-701c-40c2-a4e2-2b3d7dba5dff tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1485181530", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": "none"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:49.305506 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-cb4042ac-701c-40c2-a4e2-2b3d7dba5dff tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:13:49.307111 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-cb4042ac-701c-40c2-a4e2-2b3d7dba5dff tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:13:49.309214 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-cb4042ac-701c-40c2-a4e2-2b3d7dba5dff tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:13:49.312823 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-cb4042ac-701c-40c2-a4e2-2b3d7dba5dff tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:13:49.314806 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-cb4042ac-701c-40c2-a4e2-2b3d7dba5dff tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:13:49.347241 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb4042ac-701c-40c2-a4e2-2b3d7dba5dff tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:49.347737 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb4042ac-701c-40c2-a4e2-2b3d7dba5dff tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:49.348255 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb4042ac-701c-40c2-a4e2-2b3d7dba5dff tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:49.350292 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb4042ac-701c-40c2-a4e2-2b3d7dba5dff tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:49.351248 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb4042ac-701c-40c2-a4e2-2b3d7dba5dff tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:49.352175 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb4042ac-701c-40c2-a4e2-2b3d7dba5dff tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:49.411073 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-cb4042ac-701c-40c2-a4e2-2b3d7dba5dff tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Getting quotas for project f10cf9c476744d658fbd33ceb3471eb1. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:13:49.430930 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-cb4042ac-701c-40c2-a4e2-2b3d7dba5dff tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Getting quotas for user b5d9034cc6e2403190940275f8b41c2b and project f10cf9c476744d658fbd33ceb3471eb1. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:13:49.465497 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-cb4042ac-701c-40c2-a4e2-2b3d7dba5dff tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:13:49.470887 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-cb4042ac-701c-40c2-a4e2-2b3d7dba5dff tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] [instance: 55b6663a-93c3-4534-b563-bf54f861c111] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:13:49.579309 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-cb4042ac-701c-40c2-a4e2-2b3d7dba5dff tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.431370 Aug 31 16:13:49.585783 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2429/4659] 10.222.0.50 () {62 vars in 1188 bytes} [Wed Aug 31 16:13:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 439 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 31 16:13:49.600515 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-32058a2b-6b82-4cde-8c46-3b7002bde015 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:49.605206 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-32058a2b-6b82-4cde-8c46-3b7002bde015 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] [instance: 55b6663a-93c3-4534-b563-bf54f861c111] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:49.640268 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:13:49.705407 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b4b2fbb0-d2f4-4824-8b15-eee8fab0f6a5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:49.729218 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-32058a2b-6b82-4cde-8c46-3b7002bde015 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] 10.222.0.50 "PUT /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111" status: 200 len: 992 microversion: 2.47 time: 0.133696 Aug 31 16:13:49.731875 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2430/4660] 10.222.0.50 () {62 vars in 1297 bytes} [Wed Aug 31 16:13:49 2022] PUT /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111 => generated 992 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 16:13:49.761194 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b4b2fbb0-d2f4-4824-8b15-eee8fab0f6a5 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a" status: 200 len: 1490 microversion: 2.1 time: 1.291482 Aug 31 16:13:49.761575 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d098f08f-f7f4-4b28-b311-7db8423580d5 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:49.762684 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d098f08f-f7f4-4b28-b311-7db8423580d5 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] [instance: 55b6663a-93c3-4534-b563-bf54f861c111] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:49.787127 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2231/4661] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:48 2022] GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a => generated 1490 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:49.812132 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8da2ac4c-2a3c-4eca-b608-534a8e13886c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-43665992"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:49.816457 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8da2ac4c-2a3c-4eca-b608-534a8e13886c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ed9a700e-0de1-4ed3-993e-c0b6b293b02a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:49.824525 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8da2ac4c-2a3c-4eca-b608-534a8e13886c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:49.825289 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8da2ac4c-2a3c-4eca-b608-534a8e13886c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:49.825927 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8da2ac4c-2a3c-4eca-b608-534a8e13886c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:49.826866 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8da2ac4c-2a3c-4eca-b608-534a8e13886c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:49.827871 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8da2ac4c-2a3c-4eca-b608-534a8e13886c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:49.828561 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8da2ac4c-2a3c-4eca-b608-534a8e13886c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:49.874669 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:13:49.946748 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8da2ac4c-2a3c-4eca-b608-534a8e13886c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "PUT /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a" status: 200 len: 1074 microversion: 2.1 time: 0.144390 Aug 31 16:13:49.959074 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2232/4662] 10.222.0.50 () {60 vars in 1256 bytes} [Wed Aug 31 16:13:49 2022] PUT /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a => generated 1074 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:49.976996 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3b3c17d5-b40f-4c88-aca5-2ca45af9306b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:49.977610 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3b3c17d5-b40f-4c88-aca5-2ca45af9306b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ed9a700e-0de1-4ed3-993e-c0b6b293b02a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:49.988645 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b3c17d5-b40f-4c88-aca5-2ca45af9306b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:49.989147 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b3c17d5-b40f-4c88-aca5-2ca45af9306b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:49.989587 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b3c17d5-b40f-4c88-aca5-2ca45af9306b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:49.990349 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b3c17d5-b40f-4c88-aca5-2ca45af9306b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:49.990812 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b3c17d5-b40f-4c88-aca5-2ca45af9306b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:49.991234 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b3c17d5-b40f-4c88-aca5-2ca45af9306b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:50.098263 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d098f08f-f7f4-4b28-b311-7db8423580d5 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:50.125642 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d098f08f-f7f4-4b28-b311-7db8423580d5 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:50.128816 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d098f08f-f7f4-4b28-b311-7db8423580d5 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:50.152239 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d098f08f-f7f4-4b28-b311-7db8423580d5 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] 10.222.0.50 "GET /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111" status: 200 len: 1278 microversion: 2.47 time: 0.390674 Aug 31 16:13:50.154864 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2431/4663] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:13:49 2022] GET /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111 => generated 1278 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:13:51.178800 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e72548f4-2175-4232-891e-e2b47fcdaade tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:51.180242 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e72548f4-2175-4232-891e-e2b47fcdaade tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] [instance: 55b6663a-93c3-4534-b563-bf54f861c111] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:51.197203 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e72548f4-2175-4232-891e-e2b47fcdaade tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:51.198211 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e72548f4-2175-4232-891e-e2b47fcdaade tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:51.198821 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e72548f4-2175-4232-891e-e2b47fcdaade tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:51.199975 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e72548f4-2175-4232-891e-e2b47fcdaade tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:51.200803 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e72548f4-2175-4232-891e-e2b47fcdaade tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:51.201972 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e72548f4-2175-4232-891e-e2b47fcdaade tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:51.969863 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3b3c17d5-b40f-4c88-aca5-2ca45af9306b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:51.984773 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3b3c17d5-b40f-4c88-aca5-2ca45af9306b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a" status: 200 len: 1500 microversion: 2.1 time: 2.010458 Aug 31 16:13:51.988657 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2233/4664] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:49 2022] GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a => generated 1500 bytes in 2016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:52.044289 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c8e2be3d-f8fa-4d58-b84b-975290ba7e07 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:52.050325 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e72548f4-2175-4232-891e-e2b47fcdaade tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:52.061696 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c8e2be3d-f8fa-4d58-b84b-975290ba7e07 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ed9a700e-0de1-4ed3-993e-c0b6b293b02a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:52.099732 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e72548f4-2175-4232-891e-e2b47fcdaade tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:52.121299 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8e2be3d-f8fa-4d58-b84b-975290ba7e07 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:52.125258 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e72548f4-2175-4232-891e-e2b47fcdaade tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:52.129481 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8e2be3d-f8fa-4d58-b84b-975290ba7e07 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:52.135897 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8e2be3d-f8fa-4d58-b84b-975290ba7e07 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:52.145997 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e72548f4-2175-4232-891e-e2b47fcdaade tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] 10.222.0.50 "GET /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111" status: 200 len: 1274 microversion: 2.47 time: 0.971278 Aug 31 16:13:52.147981 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8e2be3d-f8fa-4d58-b84b-975290ba7e07 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:52.150549 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2432/4665] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:13:51 2022] GET /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111 => generated 1274 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:13:52.151335 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8e2be3d-f8fa-4d58-b84b-975290ba7e07 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:52.154251 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8e2be3d-f8fa-4d58-b84b-975290ba7e07 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:53.183049 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9ced5c1e-0da8-4282-a450-a28f4a06e016 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:53.185144 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9ced5c1e-0da8-4282-a450-a28f4a06e016 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] [instance: 55b6663a-93c3-4534-b563-bf54f861c111] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:53.217490 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ced5c1e-0da8-4282-a450-a28f4a06e016 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:53.218977 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ced5c1e-0da8-4282-a450-a28f4a06e016 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:53.220628 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ced5c1e-0da8-4282-a450-a28f4a06e016 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:53.222471 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ced5c1e-0da8-4282-a450-a28f4a06e016 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:53.223826 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ced5c1e-0da8-4282-a450-a28f4a06e016 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:53.224884 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ced5c1e-0da8-4282-a450-a28f4a06e016 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:53.377641 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c8e2be3d-f8fa-4d58-b84b-975290ba7e07 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:53.436569 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c8e2be3d-f8fa-4d58-b84b-975290ba7e07 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a" status: 200 len: 1500 microversion: 2.1 time: 1.420548 Aug 31 16:13:53.462737 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2234/4666] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:52 2022] GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a => generated 1500 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:53.500427 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b9f41141-a3ef-4793-9265-ba8f8e18b1b0 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:53.514134 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9f41141-a3ef-4793-9265-ba8f8e18b1b0 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:53.521038 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9f41141-a3ef-4793-9265-ba8f8e18b1b0 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:53.521504 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9f41141-a3ef-4793-9265-ba8f8e18b1b0 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:53.626175 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b9f41141-a3ef-4793-9265-ba8f8e18b1b0 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ed9a700e-0de1-4ed3-993e-c0b6b293b02a] Going to try to stop instance {{(pid=128863) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 16:13:53.776170 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b9f41141-a3ef-4793-9265-ba8f8e18b1b0 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "POST /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a/action" status: 202 len: 0 microversion: 2.1 time: 0.282283 Aug 31 16:13:53.777449 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2235/4667] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:13:53 2022] POST /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 16:13:53.793529 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6ac1ec59-2ae1-4b1f-a3ce-a7a01135058c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:53.794640 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6ac1ec59-2ae1-4b1f-a3ce-a7a01135058c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ed9a700e-0de1-4ed3-993e-c0b6b293b02a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:53.813425 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ac1ec59-2ae1-4b1f-a3ce-a7a01135058c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:53.814354 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ac1ec59-2ae1-4b1f-a3ce-a7a01135058c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:53.814998 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ac1ec59-2ae1-4b1f-a3ce-a7a01135058c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:53.815916 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ac1ec59-2ae1-4b1f-a3ce-a7a01135058c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:53.816548 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ac1ec59-2ae1-4b1f-a3ce-a7a01135058c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:53.817806 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ac1ec59-2ae1-4b1f-a3ce-a7a01135058c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:53.932373 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9ced5c1e-0da8-4282-a450-a28f4a06e016 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:53.957915 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9ced5c1e-0da8-4282-a450-a28f4a06e016 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:53.962463 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9ced5c1e-0da8-4282-a450-a28f4a06e016 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:53.965343 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9ced5c1e-0da8-4282-a450-a28f4a06e016 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] 10.222.0.50 "GET /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111" status: 200 len: 1330 microversion: 2.47 time: 0.790631 Aug 31 16:13:53.967246 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2433/4668] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:13:53 2022] GET /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111 => generated 1330 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:13:53.969577 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9ced5c1e-0da8-4282-a450-a28f4a06e016 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:53.971780 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9ced5c1e-0da8-4282-a450-a28f4a06e016 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] 10.222.0.50 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002784 Aug 31 16:13:53.990586 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2434/4669] 10.222.0.50 () {56 vars in 886 bytes} [Wed Aug 31 16:13:53 2022] GET /compute/ => generated 377 bytes in 21 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 31 16:13:54.850601 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6ac1ec59-2ae1-4b1f-a3ce-a7a01135058c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:54.878213 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6ac1ec59-2ae1-4b1f-a3ce-a7a01135058c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a" status: 200 len: 1510 microversion: 2.1 time: 1.094374 Aug 31 16:13:54.879337 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2236/4670] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:53 2022] GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a => generated 1510 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:55.003046 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a9ece54e-81af-4a8a-8b1e-c33f07b14cdc tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:55.006982 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a9ece54e-81af-4a8a-8b1e-c33f07b14cdc tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] [instance: 55b6663a-93c3-4534-b563-bf54f861c111] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:55.023857 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a9ece54e-81af-4a8a-8b1e-c33f07b14cdc tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:55.025283 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a9ece54e-81af-4a8a-8b1e-c33f07b14cdc tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:55.026934 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a9ece54e-81af-4a8a-8b1e-c33f07b14cdc tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:55.028229 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a9ece54e-81af-4a8a-8b1e-c33f07b14cdc tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:55.030853 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a9ece54e-81af-4a8a-8b1e-c33f07b14cdc tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:55.031709 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a9ece54e-81af-4a8a-8b1e-c33f07b14cdc tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:55.199906 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a9ece54e-81af-4a8a-8b1e-c33f07b14cdc tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:55.228504 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a9ece54e-81af-4a8a-8b1e-c33f07b14cdc tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:55.230534 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a9ece54e-81af-4a8a-8b1e-c33f07b14cdc tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:55.232302 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a9ece54e-81af-4a8a-8b1e-c33f07b14cdc tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] 10.222.0.50 "GET /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111" status: 200 len: 1336 microversion: 2.47 time: 0.239788 Aug 31 16:13:55.233103 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2435/4671] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:13:54 2022] GET /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111 => generated 1336 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:13:55.903318 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-00a1b02f-cd1d-4c8f-b4c7-f1ae3b824f34 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:55.903948 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-00a1b02f-cd1d-4c8f-b4c7-f1ae3b824f34 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ed9a700e-0de1-4ed3-993e-c0b6b293b02a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:55.921094 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00a1b02f-cd1d-4c8f-b4c7-f1ae3b824f34 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:55.923252 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00a1b02f-cd1d-4c8f-b4c7-f1ae3b824f34 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:55.926310 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00a1b02f-cd1d-4c8f-b4c7-f1ae3b824f34 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:55.928272 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00a1b02f-cd1d-4c8f-b4c7-f1ae3b824f34 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:55.936002 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00a1b02f-cd1d-4c8f-b4c7-f1ae3b824f34 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:55.937520 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00a1b02f-cd1d-4c8f-b4c7-f1ae3b824f34 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:56.265654 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b97104e1-d90c-402c-a70d-3b0155c12044 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:56.272028 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b97104e1-d90c-402c-a70d-3b0155c12044 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] [instance: 55b6663a-93c3-4534-b563-bf54f861c111] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:56.319269 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b97104e1-d90c-402c-a70d-3b0155c12044 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:56.328523 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b97104e1-d90c-402c-a70d-3b0155c12044 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:56.331470 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b97104e1-d90c-402c-a70d-3b0155c12044 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:56.335403 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b97104e1-d90c-402c-a70d-3b0155c12044 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:56.337807 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b97104e1-d90c-402c-a70d-3b0155c12044 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:56.342277 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b97104e1-d90c-402c-a70d-3b0155c12044 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:57.030801 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-00a1b02f-cd1d-4c8f-b4c7-f1ae3b824f34 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:57.085701 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-00a1b02f-cd1d-4c8f-b4c7-f1ae3b824f34 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a" status: 200 len: 1510 microversion: 2.1 time: 1.188296 Aug 31 16:13:57.103861 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2237/4672] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:55 2022] GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a => generated 1510 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:57.386220 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b97104e1-d90c-402c-a70d-3b0155c12044 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:57.394967 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b97104e1-d90c-402c-a70d-3b0155c12044 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:57.396439 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b97104e1-d90c-402c-a70d-3b0155c12044 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:57.397660 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b97104e1-d90c-402c-a70d-3b0155c12044 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] 10.222.0.50 "GET /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111" status: 200 len: 1357 microversion: 2.47 time: 1.142768 Aug 31 16:13:57.409811 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2436/4673] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:13:56 2022] GET /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111 => generated 1357 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:13:57.436341 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e3eaea1a-473b-4ab2-9cbf-d9bbcdba964d tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:13:57.439582 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e3eaea1a-473b-4ab2-9cbf-d9bbcdba964d tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] [instance: 55b6663a-93c3-4534-b563-bf54f861c111] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:57.446655 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3eaea1a-473b-4ab2-9cbf-d9bbcdba964d tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:57.447696 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3eaea1a-473b-4ab2-9cbf-d9bbcdba964d tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:57.448318 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3eaea1a-473b-4ab2-9cbf-d9bbcdba964d tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:57.449224 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3eaea1a-473b-4ab2-9cbf-d9bbcdba964d tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:57.449842 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3eaea1a-473b-4ab2-9cbf-d9bbcdba964d tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:57.450461 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3eaea1a-473b-4ab2-9cbf-d9bbcdba964d tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:57.605499 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-e3eaea1a-473b-4ab2-9cbf-d9bbcdba964d tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:13:57.605925 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-e3eaea1a-473b-4ab2-9cbf-d9bbcdba964d tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:13:57.608589 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-e3eaea1a-473b-4ab2-9cbf-d9bbcdba964d tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:13:57.609011 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-e3eaea1a-473b-4ab2-9cbf-d9bbcdba964d tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:13:57.609421 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-e3eaea1a-473b-4ab2-9cbf-d9bbcdba964d tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:13:57.721760 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e3eaea1a-473b-4ab2-9cbf-d9bbcdba964d tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] [instance: 55b6663a-93c3-4534-b563-bf54f861c111] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:57.732635 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3eaea1a-473b-4ab2-9cbf-d9bbcdba964d tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:57.733289 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3eaea1a-473b-4ab2-9cbf-d9bbcdba964d tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:57.734924 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3eaea1a-473b-4ab2-9cbf-d9bbcdba964d tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:57.735823 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3eaea1a-473b-4ab2-9cbf-d9bbcdba964d tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:57.736413 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3eaea1a-473b-4ab2-9cbf-d9bbcdba964d tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:57.736934 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3eaea1a-473b-4ab2-9cbf-d9bbcdba964d tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:57.780645 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e3eaea1a-473b-4ab2-9cbf-d9bbcdba964d tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] 10.222.0.50 "POST /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111/action" status: 202 len: 1079 microversion: 2.47 time: 0.348209 Aug 31 16:13:57.781919 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2238/4674] 10.222.0.50 () {62 vars in 1319 bytes} [Wed Aug 31 16:13:57 2022] POST /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111/action => generated 1079 bytes in 350 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 31 16:13:57.818818 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ad2c7c7b-eaa2-418f-835c-f49e520806e1 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:57.825519 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ad2c7c7b-eaa2-418f-835c-f49e520806e1 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] [instance: 55b6663a-93c3-4534-b563-bf54f861c111] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:57.859843 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ad2c7c7b-eaa2-418f-835c-f49e520806e1 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:57.865460 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ad2c7c7b-eaa2-418f-835c-f49e520806e1 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:57.866945 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ad2c7c7b-eaa2-418f-835c-f49e520806e1 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:57.870827 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ad2c7c7b-eaa2-418f-835c-f49e520806e1 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:57.877887 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ad2c7c7b-eaa2-418f-835c-f49e520806e1 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:57.885504 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ad2c7c7b-eaa2-418f-835c-f49e520806e1 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:58.115931 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d7e27912-1a4f-45c6-b388-c10f926cf9fb tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:58.121720 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d7e27912-1a4f-45c6-b388-c10f926cf9fb tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ed9a700e-0de1-4ed3-993e-c0b6b293b02a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:58.144818 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7e27912-1a4f-45c6-b388-c10f926cf9fb tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:58.145751 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7e27912-1a4f-45c6-b388-c10f926cf9fb tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:58.146547 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7e27912-1a4f-45c6-b388-c10f926cf9fb tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:58.155242 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7e27912-1a4f-45c6-b388-c10f926cf9fb tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:58.156080 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7e27912-1a4f-45c6-b388-c10f926cf9fb tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:58.168318 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7e27912-1a4f-45c6-b388-c10f926cf9fb tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:58.278828 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ad2c7c7b-eaa2-418f-835c-f49e520806e1 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:58.334618 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ad2c7c7b-eaa2-418f-835c-f49e520806e1 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:58.336669 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ad2c7c7b-eaa2-418f-835c-f49e520806e1 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:58.342941 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ad2c7c7b-eaa2-418f-835c-f49e520806e1 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] 10.222.0.50 "GET /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111" status: 200 len: 1366 microversion: 2.47 time: 0.531771 Aug 31 16:13:58.343583 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2437/4675] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:13:57 2022] GET /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111 => generated 1366 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:13:58.358408 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:13:58.364303 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=48 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:13:58.950188 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d7e27912-1a4f-45c6-b388-c10f926cf9fb tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:13:58.964151 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d7e27912-1a4f-45c6-b388-c10f926cf9fb tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a" status: 200 len: 1510 microversion: 2.1 time: 0.858476 Aug 31 16:13:58.967031 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2239/4676] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:58 2022] GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a => generated 1510 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:13:59.412523 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f62d1698-23de-46db-afdf-c275053cee24 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:13:59.417051 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f62d1698-23de-46db-afdf-c275053cee24 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] [instance: 55b6663a-93c3-4534-b563-bf54f861c111] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:13:59.425539 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:13:59.449469 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f62d1698-23de-46db-afdf-c275053cee24 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:59.455990 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f62d1698-23de-46db-afdf-c275053cee24 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:59.458385 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f62d1698-23de-46db-afdf-c275053cee24 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:59.461295 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f62d1698-23de-46db-afdf-c275053cee24 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:13:59.462297 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f62d1698-23de-46db-afdf-c275053cee24 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:13:59.463599 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f62d1698-23de-46db-afdf-c275053cee24 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:13:59.985212 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f62d1698-23de-46db-afdf-c275053cee24 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:00.003228 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2cb390b8-60d5-4bfb-ace1-54bc8c5a4a6d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:00.007584 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2cb390b8-60d5-4bfb-ace1-54bc8c5a4a6d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ed9a700e-0de1-4ed3-993e-c0b6b293b02a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:00.033500 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2cb390b8-60d5-4bfb-ace1-54bc8c5a4a6d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:00.043178 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2cb390b8-60d5-4bfb-ace1-54bc8c5a4a6d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:00.044344 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2cb390b8-60d5-4bfb-ace1-54bc8c5a4a6d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:00.045063 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f62d1698-23de-46db-afdf-c275053cee24 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:00.051845 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2cb390b8-60d5-4bfb-ace1-54bc8c5a4a6d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:00.053891 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2cb390b8-60d5-4bfb-ace1-54bc8c5a4a6d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:00.055510 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f62d1698-23de-46db-afdf-c275053cee24 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:00.056623 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2cb390b8-60d5-4bfb-ace1-54bc8c5a4a6d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:00.064958 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f62d1698-23de-46db-afdf-c275053cee24 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] 10.222.0.50 "GET /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111" status: 200 len: 1366 microversion: 2.47 time: 0.680699 Aug 31 16:14:00.105820 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2438/4677] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:13:59 2022] GET /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111 => generated 1366 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:14:01.040383 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2cb390b8-60d5-4bfb-ace1-54bc8c5a4a6d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:01.053611 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2cb390b8-60d5-4bfb-ace1-54bc8c5a4a6d tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a" status: 200 len: 1510 microversion: 2.1 time: 1.059593 Aug 31 16:14:01.054271 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2240/4678] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:13:59 2022] GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a => generated 1510 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:14:01.128354 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=39 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:14:01.135345 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ae3fa95c-f94a-41f6-bb5d-433a2ed4635b tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:01.136265 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ae3fa95c-f94a-41f6-bb5d-433a2ed4635b tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] [instance: 55b6663a-93c3-4534-b563-bf54f861c111] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:01.155791 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ae3fa95c-f94a-41f6-bb5d-433a2ed4635b tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:01.156650 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ae3fa95c-f94a-41f6-bb5d-433a2ed4635b tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:01.157287 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ae3fa95c-f94a-41f6-bb5d-433a2ed4635b tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:01.158233 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ae3fa95c-f94a-41f6-bb5d-433a2ed4635b tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:01.159066 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ae3fa95c-f94a-41f6-bb5d-433a2ed4635b tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:01.161478 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ae3fa95c-f94a-41f6-bb5d-433a2ed4635b tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:01.423002 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ae3fa95c-f94a-41f6-bb5d-433a2ed4635b tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:01.437571 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ae3fa95c-f94a-41f6-bb5d-433a2ed4635b tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:01.441072 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ae3fa95c-f94a-41f6-bb5d-433a2ed4635b tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:01.444947 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ae3fa95c-f94a-41f6-bb5d-433a2ed4635b tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] 10.222.0.50 "GET /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111" status: 200 len: 1366 microversion: 2.47 time: 0.317238 Aug 31 16:14:01.445604 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2439/4679] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:14:01 2022] GET /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111 => generated 1366 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:14:02.095718 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-78e628e3-d2ed-4bdf-8ffa-401fdc7b6a1b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:02.096547 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-78e628e3-d2ed-4bdf-8ffa-401fdc7b6a1b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ed9a700e-0de1-4ed3-993e-c0b6b293b02a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:02.120574 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78e628e3-d2ed-4bdf-8ffa-401fdc7b6a1b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:02.121081 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78e628e3-d2ed-4bdf-8ffa-401fdc7b6a1b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:02.121525 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78e628e3-d2ed-4bdf-8ffa-401fdc7b6a1b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:02.122275 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78e628e3-d2ed-4bdf-8ffa-401fdc7b6a1b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:02.122730 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78e628e3-d2ed-4bdf-8ffa-401fdc7b6a1b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:02.123152 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78e628e3-d2ed-4bdf-8ffa-401fdc7b6a1b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:02.501143 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-bb8aaa9a-c351-4985-8d76-174b6765da54 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:02.506613 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-bb8aaa9a-c351-4985-8d76-174b6765da54 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] [instance: 55b6663a-93c3-4534-b563-bf54f861c111] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:02.538978 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bb8aaa9a-c351-4985-8d76-174b6765da54 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:02.547329 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bb8aaa9a-c351-4985-8d76-174b6765da54 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:02.548259 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bb8aaa9a-c351-4985-8d76-174b6765da54 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:02.549539 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bb8aaa9a-c351-4985-8d76-174b6765da54 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:02.559626 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bb8aaa9a-c351-4985-8d76-174b6765da54 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:02.560603 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bb8aaa9a-c351-4985-8d76-174b6765da54 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:02.959632 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-78e628e3-d2ed-4bdf-8ffa-401fdc7b6a1b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:02.969992 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-78e628e3-d2ed-4bdf-8ffa-401fdc7b6a1b tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a" status: 200 len: 1510 microversion: 2.1 time: 0.877954 Aug 31 16:14:02.973892 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2241/4680] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:02 2022] GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a => generated 1510 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:14:03.077152 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-bb8aaa9a-c351-4985-8d76-174b6765da54 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:03.098678 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-bb8aaa9a-c351-4985-8d76-174b6765da54 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:03.108277 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-bb8aaa9a-c351-4985-8d76-174b6765da54 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:03.127869 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-bb8aaa9a-c351-4985-8d76-174b6765da54 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] 10.222.0.50 "GET /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111" status: 200 len: 1366 microversion: 2.47 time: 0.639569 Aug 31 16:14:03.139041 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2440/4681] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:14:02 2022] GET /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111 => generated 1366 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:14:03.964501 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d84fa0e4-11f9-4c84-96f3-ed95c9b23744 tempest-SecurityGroupRulesTestJSON-1183189146 tempest-SecurityGroupRulesTestJSON-1183189146-project] Action: 'create', calling method: .version_select at 0x7fbb46411e50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1261703718", "description": "tempest-description-517695632"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:04.013335 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c5143ec5-d1e1-47b8-b63c-15992c2e61ba tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:04.013926 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c5143ec5-d1e1-47b8-b63c-15992c2e61ba tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ed9a700e-0de1-4ed3-993e-c0b6b293b02a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:04.027422 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c5143ec5-d1e1-47b8-b63c-15992c2e61ba tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:04.027948 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c5143ec5-d1e1-47b8-b63c-15992c2e61ba tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:04.028451 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c5143ec5-d1e1-47b8-b63c-15992c2e61ba tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:04.029453 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c5143ec5-d1e1-47b8-b63c-15992c2e61ba tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:04.043008 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c5143ec5-d1e1-47b8-b63c-15992c2e61ba tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:04.043960 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c5143ec5-d1e1-47b8-b63c-15992c2e61ba tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:04.047830 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=100 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:14:05.512637 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c5143ec5-d1e1-47b8-b63c-15992c2e61ba tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:05.532231 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c5143ec5-d1e1-47b8-b63c-15992c2e61ba tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a" status: 200 len: 1510 microversion: 2.1 time: 1.521789 Aug 31 16:14:05.533771 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2441/4682] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:04 2022] GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a => generated 1510 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:05.545090 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d35b1258-0aaf-46d8-ab67-8c7b9e655675 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:05.552023 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d35b1258-0aaf-46d8-ab67-8c7b9e655675 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] [instance: 55b6663a-93c3-4534-b563-bf54f861c111] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:05.565621 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d35b1258-0aaf-46d8-ab67-8c7b9e655675 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:05.566123 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d35b1258-0aaf-46d8-ab67-8c7b9e655675 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:05.566765 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d35b1258-0aaf-46d8-ab67-8c7b9e655675 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:05.567815 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d35b1258-0aaf-46d8-ab67-8c7b9e655675 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:05.568337 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d35b1258-0aaf-46d8-ab67-8c7b9e655675 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:05.569109 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d35b1258-0aaf-46d8-ab67-8c7b9e655675 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:05.766333 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d84fa0e4-11f9-4c84-96f3-ed95c9b23744 tempest-SecurityGroupRulesTestJSON-1183189146 tempest-SecurityGroupRulesTestJSON-1183189146-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.899915 Aug 31 16:14:05.769290 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2242/4683] 10.222.0.50 () {60 vars in 1180 bytes} [Wed Aug 31 16:14:03 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1904 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:14:05.781700 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-054194b9-c2e9-43f4-a465-a98219fa574d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '.version_select at 0x7fbb46672280>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:05.814718 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d35b1258-0aaf-46d8-ab67-8c7b9e655675 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:05.829731 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d35b1258-0aaf-46d8-ab67-8c7b9e655675 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:05.839044 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d35b1258-0aaf-46d8-ab67-8c7b9e655675 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:05.843546 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d35b1258-0aaf-46d8-ab67-8c7b9e655675 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] 10.222.0.50 "GET /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111" status: 200 len: 1366 microversion: 2.47 time: 0.308288 Aug 31 16:14:05.845983 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2442/4684] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:14:05 2022] GET /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111 => generated 1366 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:14:05.859069 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-054194b9-c2e9-43f4-a465-a98219fa574d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1055623987" status: 202 len: 0 microversion: 2.1 time: 0.083249 Aug 31 16:14:05.860616 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2243/4685] 10.222.0.50 () {58 vars in 1284 bytes} [Wed Aug 31 16:14:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1055623987 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:14:05.866452 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-201f9724-0313-429f-a48e-c2b34d87af74 tempest-SecurityGroupRulesTestJSON-1183189146 tempest-SecurityGroupRulesTestJSON-1183189146-project] Action: 'create', calling method: .version_select at 0x7fbb46f67af0>, body: {"security_group_rule": {"parent_group_id": "ed3229c4-f292-4f3f-ad68-a633cb3cf3d6", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:05.928639 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b95e88cb-4047-4794-9fd6-be6d7a142230 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Action: 'create', calling method: .version_select at 0x7fbb4aa30040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-108919608", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7FStVbjuAB3h0yhwmu5izohbF+FZVS5N9njToze9fTblZMF91tHb8UybmHtaCjii109BUFarVZI6omGEnKoeg65RZwsgZNrdujw3p+8CYUPtkJZWQrkel6fklar6ZdNQ=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:05.965065 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-b95e88cb-4047-4794-9fd6-be6d7a142230 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Getting quotas for project 3397e8a2a042486eb323432c47dfd392. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:14:05.977091 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-b95e88cb-4047-4794-9fd6-be6d7a142230 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Getting quotas for user 87f8241df6664aa59ba669d733e53871 and project 3397e8a2a042486eb323432c47dfd392. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:14:06.037997 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b95e88cb-4047-4794-9fd6-be6d7a142230 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.117008 Aug 31 16:14:06.039594 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2244/4686] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 31 16:14:05 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:14:06.444864 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-201f9724-0313-429f-a48e-c2b34d87af74 tempest-SecurityGroupRulesTestJSON-1183189146 tempest-SecurityGroupRulesTestJSON-1183189146-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.596167 Aug 31 16:14:06.446172 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2443/4687] 10.222.0.50 () {60 vars in 1195 bytes} [Wed Aug 31 16:14:05 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:14:06.470067 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-945c559f-f9e9-41c5-b38b-57bc91f9225e tempest-SecurityGroupRulesTestJSON-1183189146 tempest-SecurityGroupRulesTestJSON-1183189146-project] Action: 'create', calling method: .version_select at 0x7fbb46411280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-126157782", "description": "tempest-description-1189050477"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:06.575921 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-347d5594-238d-4325-8bc0-8eb3a5bc999f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:06.578648 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-347d5594-238d-4325-8bc0-8eb3a5bc999f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ed9a700e-0de1-4ed3-993e-c0b6b293b02a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:06.600629 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-347d5594-238d-4325-8bc0-8eb3a5bc999f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:06.602549 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-347d5594-238d-4325-8bc0-8eb3a5bc999f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:06.605269 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-347d5594-238d-4325-8bc0-8eb3a5bc999f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:06.607230 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-347d5594-238d-4325-8bc0-8eb3a5bc999f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:06.608284 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-347d5594-238d-4325-8bc0-8eb3a5bc999f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:06.610002 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-347d5594-238d-4325-8bc0-8eb3a5bc999f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:07.000419 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-945c559f-f9e9-41c5-b38b-57bc91f9225e tempest-SecurityGroupRulesTestJSON-1183189146 tempest-SecurityGroupRulesTestJSON-1183189146-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.539110 Aug 31 16:14:07.001677 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2245/4688] 10.222.0.50 () {60 vars in 1180 bytes} [Wed Aug 31 16:14:06 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:14:07.021859 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-afa1221b-edd1-446b-b88e-230387612302 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:07.022802 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-afa1221b-edd1-446b-b88e-230387612302 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] [instance: 55b6663a-93c3-4534-b563-bf54f861c111] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:07.035639 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-afa1221b-edd1-446b-b88e-230387612302 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:07.036705 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-afa1221b-edd1-446b-b88e-230387612302 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:07.038032 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-afa1221b-edd1-446b-b88e-230387612302 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:07.039342 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-afa1221b-edd1-446b-b88e-230387612302 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:07.041306 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-afa1221b-edd1-446b-b88e-230387612302 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:07.042399 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-afa1221b-edd1-446b-b88e-230387612302 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:07.167359 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-347d5594-238d-4325-8bc0-8eb3a5bc999f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:07.213166 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-347d5594-238d-4325-8bc0-8eb3a5bc999f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a" status: 200 len: 1510 microversion: 2.1 time: 0.645273 Aug 31 16:14:07.214383 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2444/4689] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:06 2022] GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a => generated 1510 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:14:07.222817 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8bcd51d6-6abb-4270-b839-4a528860c405 tempest-SecurityGroupRulesTestJSON-1183189146 tempest-SecurityGroupRulesTestJSON-1183189146-project] Action: 'create', calling method: .version_select at 0x7fbb4aa55940>, body: {"security_group_rule": {"parent_group_id": "e9a5f24b-d3b0-4528-b9ab-16e728f7c8fc", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:07.336714 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-afa1221b-edd1-446b-b88e-230387612302 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:07.371428 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-afa1221b-edd1-446b-b88e-230387612302 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:07.373541 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-afa1221b-edd1-446b-b88e-230387612302 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:07.383111 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-afa1221b-edd1-446b-b88e-230387612302 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] 10.222.0.50 "GET /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111" status: 200 len: 1366 microversion: 2.47 time: 0.370552 Aug 31 16:14:07.383736 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2246/4690] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:14:07 2022] GET /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111 => generated 1366 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:14:07.853890 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8bcd51d6-6abb-4270-b839-4a528860c405 tempest-SecurityGroupRulesTestJSON-1183189146 tempest-SecurityGroupRulesTestJSON-1183189146-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.637314 Aug 31 16:14:07.855009 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2445/4691] 10.222.0.50 () {60 vars in 1195 bytes} [Wed Aug 31 16:14:07 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:14:07.873740 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cb25b35e-992b-435b-88b1-1e9b226d3128 tempest-SecurityGroupRulesTestJSON-1183189146 tempest-SecurityGroupRulesTestJSON-1183189146-project] Action: 'create', calling method: .version_select at 0x7fbb45e2b310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-777770754", "description": "tempest-description-817609462"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:08.144176 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cb25b35e-992b-435b-88b1-1e9b226d3128 tempest-SecurityGroupRulesTestJSON-1183189146 tempest-SecurityGroupRulesTestJSON-1183189146-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.275266 Aug 31 16:14:08.145249 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2247/4692] 10.222.0.50 () {60 vars in 1180 bytes} [Wed Aug 31 16:14:07 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:14:08.163437 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-cb886bba-ccb1-4e5f-91d6-8b80da09bf59 tempest-SecurityGroupRulesTestJSON-1183189146 tempest-SecurityGroupRulesTestJSON-1183189146-project] Action: 'create', calling method: .version_select at 0x7fbb45e9d0d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-3937401", "description": "tempest-description-1178245718"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:08.257164 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-929f8639-aa66-4efe-9652-66fd59e3b27f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:08.259894 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-929f8639-aa66-4efe-9652-66fd59e3b27f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ed9a700e-0de1-4ed3-993e-c0b6b293b02a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:08.287358 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-929f8639-aa66-4efe-9652-66fd59e3b27f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:08.288451 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-929f8639-aa66-4efe-9652-66fd59e3b27f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:08.289472 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-929f8639-aa66-4efe-9652-66fd59e3b27f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:08.292707 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-929f8639-aa66-4efe-9652-66fd59e3b27f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:08.293866 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-929f8639-aa66-4efe-9652-66fd59e3b27f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:08.295186 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-929f8639-aa66-4efe-9652-66fd59e3b27f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:08.639728 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-cb886bba-ccb1-4e5f-91d6-8b80da09bf59 tempest-SecurityGroupRulesTestJSON-1183189146 tempest-SecurityGroupRulesTestJSON-1183189146-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.481215 Aug 31 16:14:08.640552 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2446/4693] 10.222.0.50 () {60 vars in 1180 bytes} [Wed Aug 31 16:14:08 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:14:08.660421 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9048a21e-52c9-4915-b80a-ca35d050a14f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:08.662538 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9048a21e-52c9-4915-b80a-ca35d050a14f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] [instance: 55b6663a-93c3-4534-b563-bf54f861c111] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:08.682497 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9048a21e-52c9-4915-b80a-ca35d050a14f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:08.685279 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9048a21e-52c9-4915-b80a-ca35d050a14f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:08.686438 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9048a21e-52c9-4915-b80a-ca35d050a14f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:08.690617 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9048a21e-52c9-4915-b80a-ca35d050a14f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:08.693197 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9048a21e-52c9-4915-b80a-ca35d050a14f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:08.694031 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9048a21e-52c9-4915-b80a-ca35d050a14f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:08.790664 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-929f8639-aa66-4efe-9652-66fd59e3b27f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:08.810556 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-929f8639-aa66-4efe-9652-66fd59e3b27f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a" status: 200 len: 1510 microversion: 2.1 time: 0.562023 Aug 31 16:14:08.812403 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2248/4694] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:08 2022] GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a => generated 1510 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:08.821147 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bd3cdc47-5697-4f8b-afdf-d3810bf9c30b tempest-SecurityGroupRulesTestJSON-1183189146 tempest-SecurityGroupRulesTestJSON-1183189146-project] Action: 'create', calling method: .version_select at 0x7fbb4686a700>, body: {"security_group_rule": {"parent_group_id": "09264cf5-7cb1-4b9f-aa43-4ae3eaf73a26", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "48d6a299-0da1-4e36-85aa-e15ebb326cfd"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:08.948255 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9048a21e-52c9-4915-b80a-ca35d050a14f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:08.963027 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9048a21e-52c9-4915-b80a-ca35d050a14f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:08.967551 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9048a21e-52c9-4915-b80a-ca35d050a14f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:08.971128 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9048a21e-52c9-4915-b80a-ca35d050a14f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] 10.222.0.50 "GET /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111" status: 200 len: 1366 microversion: 2.47 time: 0.319515 Aug 31 16:14:08.972831 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2447/4695] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:14:08 2022] GET /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111 => generated 1366 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:14:09.701675 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bd3cdc47-5697-4f8b-afdf-d3810bf9c30b tempest-SecurityGroupRulesTestJSON-1183189146 tempest-SecurityGroupRulesTestJSON-1183189146-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 328 microversion: 2.1 time: 0.886878 Aug 31 16:14:09.702849 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2249/4696] 10.222.0.50 () {60 vars in 1195 bytes} [Wed Aug 31 16:14:08 2022] POST /compute/v2.1/os-security-group-rules => generated 328 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:14:09.722818 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0eb04535-7d0d-42e4-b3b4-de2f963afcef tempest-SecurityGroupRulesTestJSON-1183189146 tempest-SecurityGroupRulesTestJSON-1183189146-project] Action: 'create', calling method: .version_select at 0x7fbb46408940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-991463753", "description": "tempest-description-1261620691"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:09.737778 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ea0b8605-f825-438e-b761-78fa466ec6f7 tempest-ExtensionsTest-1216528994 tempest-ExtensionsTest-1216528994-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:09.755538 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ea0b8605-f825-438e-b761-78fa466ec6f7 tempest-ExtensionsTest-1216528994 tempest-ExtensionsTest-1216528994-project] 10.222.0.50 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.467475 Aug 31 16:14:09.763489 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2448/4697] 10.222.0.50 () {58 vars in 1170 bytes} [Wed Aug 31 16:14:09 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:14:09.787361 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ff0504b2-2b49-4290-aca1-579c2dbaefbd tempest-ExtensionsTest-1216528994 tempest-ExtensionsTest-1216528994-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:09.797483 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ff0504b2-2b49-4290-aca1-579c2dbaefbd tempest-ExtensionsTest-1216528994 tempest-ExtensionsTest-1216528994-project] 10.222.0.50 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.029422 Aug 31 16:14:09.798158 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2449/4698] 10.222.0.50 () {58 vars in 1134 bytes} [Wed Aug 31 16:14:09 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:14:09.846590 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-51d9110a-3fd7-458d-be77-f2d6fe1149b7 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:09.847486 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-51d9110a-3fd7-458d-be77-f2d6fe1149b7 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ed9a700e-0de1-4ed3-993e-c0b6b293b02a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:09.877188 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51d9110a-3fd7-458d-be77-f2d6fe1149b7 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:09.878018 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51d9110a-3fd7-458d-be77-f2d6fe1149b7 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:09.878801 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51d9110a-3fd7-458d-be77-f2d6fe1149b7 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:09.880016 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51d9110a-3fd7-458d-be77-f2d6fe1149b7 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:09.880805 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51d9110a-3fd7-458d-be77-f2d6fe1149b7 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:09.881538 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51d9110a-3fd7-458d-be77-f2d6fe1149b7 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:10.174649 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0eb04535-7d0d-42e4-b3b4-de2f963afcef tempest-SecurityGroupRulesTestJSON-1183189146 tempest-SecurityGroupRulesTestJSON-1183189146-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.461847 Aug 31 16:14:10.176462 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2250/4699] 10.222.0.50 () {60 vars in 1180 bytes} [Wed Aug 31 16:14:09 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:14:10.204792 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a457f5cf-e693-4aaf-84ca-69301f46e51c tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:10.208176 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a457f5cf-e693-4aaf-84ca-69301f46e51c tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] [instance: 55b6663a-93c3-4534-b563-bf54f861c111] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:10.240477 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a457f5cf-e693-4aaf-84ca-69301f46e51c tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:10.241039 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a457f5cf-e693-4aaf-84ca-69301f46e51c tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:10.242749 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a457f5cf-e693-4aaf-84ca-69301f46e51c tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:10.246217 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a457f5cf-e693-4aaf-84ca-69301f46e51c tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:10.247001 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a457f5cf-e693-4aaf-84ca-69301f46e51c tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:10.249448 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a457f5cf-e693-4aaf-84ca-69301f46e51c tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:10.401604 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a457f5cf-e693-4aaf-84ca-69301f46e51c tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:10.413370 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-51d9110a-3fd7-458d-be77-f2d6fe1149b7 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:10.441305 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-51d9110a-3fd7-458d-be77-f2d6fe1149b7 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a" status: 200 len: 1510 microversion: 2.1 time: 0.598294 Aug 31 16:14:10.445120 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2450/4700] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:09 2022] GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a => generated 1510 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:10.448029 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a457f5cf-e693-4aaf-84ca-69301f46e51c tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:10.462918 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a457f5cf-e693-4aaf-84ca-69301f46e51c tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:10.469288 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a457f5cf-e693-4aaf-84ca-69301f46e51c tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] 10.222.0.50 "GET /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111" status: 200 len: 1366 microversion: 2.47 time: 0.290673 Aug 31 16:14:10.470157 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c6161d16-6efe-4aba-b9d4-71104509ee20 tempest-SecurityGroupRulesTestJSON-1183189146 tempest-SecurityGroupRulesTestJSON-1183189146-project] Action: 'create', calling method: .version_select at 0x7fbb4aa375e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-729769030", "description": "tempest-description-5337693"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:10.472321 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2251/4701] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:14:10 2022] GET /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111 => generated 1366 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:14:10.967326 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c6161d16-6efe-4aba-b9d4-71104509ee20 tempest-SecurityGroupRulesTestJSON-1183189146 tempest-SecurityGroupRulesTestJSON-1183189146-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.519997 Aug 31 16:14:10.969170 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2451/4702] 10.222.0.50 () {60 vars in 1180 bytes} [Wed Aug 31 16:14:10 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:14:10.990880 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-debc0b00-a81b-48a3-9bb9-33f7ba1b8ed6 tempest-SecurityGroupRulesTestJSON-1183189146 tempest-SecurityGroupRulesTestJSON-1183189146-project] Action: 'create', calling method: .version_select at 0x7fbb468e2ee0>, body: {"security_group_rule": {"parent_group_id": "39c6daf5-32fe-4dd8-bbdb-dc37446817ba", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "9dc85439-134f-4b25-8ec6-d80295d68419"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:11.476136 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a7cf0725-27f5-4c4e-85ca-4e8ecca04d92 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:11.479502 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a7cf0725-27f5-4c4e-85ca-4e8ecca04d92 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ed9a700e-0de1-4ed3-993e-c0b6b293b02a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:11.499681 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a7cf0725-27f5-4c4e-85ca-4e8ecca04d92 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:11.501688 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a7cf0725-27f5-4c4e-85ca-4e8ecca04d92 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:11.503101 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a7cf0725-27f5-4c4e-85ca-4e8ecca04d92 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:11.505385 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a7cf0725-27f5-4c4e-85ca-4e8ecca04d92 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:11.506938 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a7cf0725-27f5-4c4e-85ca-4e8ecca04d92 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:11.508158 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a7cf0725-27f5-4c4e-85ca-4e8ecca04d92 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:12.278349 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a7cf0725-27f5-4c4e-85ca-4e8ecca04d92 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:12.301230 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a7cf0725-27f5-4c4e-85ca-4e8ecca04d92 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a" status: 200 len: 1510 microversion: 2.1 time: 0.839266 Aug 31 16:14:12.302197 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2452/4703] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:11 2022] GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a => generated 1510 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:12.324487 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5357008f-0dd4-4871-8e87-f40149a39ccf tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:12.330641 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5357008f-0dd4-4871-8e87-f40149a39ccf tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] [instance: 55b6663a-93c3-4534-b563-bf54f861c111] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:12.359286 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5357008f-0dd4-4871-8e87-f40149a39ccf tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:12.362511 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5357008f-0dd4-4871-8e87-f40149a39ccf tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:12.369012 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5357008f-0dd4-4871-8e87-f40149a39ccf tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:12.371413 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5357008f-0dd4-4871-8e87-f40149a39ccf tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:12.373073 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5357008f-0dd4-4871-8e87-f40149a39ccf tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:12.374356 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5357008f-0dd4-4871-8e87-f40149a39ccf tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:12.881372 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5357008f-0dd4-4871-8e87-f40149a39ccf tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:12.899514 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5357008f-0dd4-4871-8e87-f40149a39ccf tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:12.901928 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5357008f-0dd4-4871-8e87-f40149a39ccf tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:12.908085 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5357008f-0dd4-4871-8e87-f40149a39ccf tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] 10.222.0.50 "GET /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111" status: 200 len: 1366 microversion: 2.47 time: 0.602742 Aug 31 16:14:12.911531 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2453/4704] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:14:12 2022] GET /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111 => generated 1366 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:14:12.977961 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-debc0b00-a81b-48a3-9bb9-33f7ba1b8ed6 tempest-SecurityGroupRulesTestJSON-1183189146 tempest-SecurityGroupRulesTestJSON-1183189146-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 1.994281 Aug 31 16:14:12.979939 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2252/4705] 10.222.0.50 () {60 vars in 1195 bytes} [Wed Aug 31 16:14:10 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 1998 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:14:13.000637 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-704abde7-0b2a-4dc8-8661-93ff0a4c23b9 tempest-SecurityGroupRulesTestJSON-1183189146 tempest-SecurityGroupRulesTestJSON-1183189146-project] Calling method '.version_select at 0x7fbb45e9d9d0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:13.340707 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ebd07d82-9699-4e58-b490-29d175c3bd5c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:13.341823 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ebd07d82-9699-4e58-b490-29d175c3bd5c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ed9a700e-0de1-4ed3-993e-c0b6b293b02a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:13.372583 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebd07d82-9699-4e58-b490-29d175c3bd5c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:13.372965 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebd07d82-9699-4e58-b490-29d175c3bd5c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:13.373408 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebd07d82-9699-4e58-b490-29d175c3bd5c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:13.374153 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebd07d82-9699-4e58-b490-29d175c3bd5c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:13.374614 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebd07d82-9699-4e58-b490-29d175c3bd5c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:13.375052 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebd07d82-9699-4e58-b490-29d175c3bd5c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:13.868633 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ebd07d82-9699-4e58-b490-29d175c3bd5c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:13.877036 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:14:13.891818 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ebd07d82-9699-4e58-b490-29d175c3bd5c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a" status: 200 len: 1510 microversion: 2.1 time: 0.567996 Aug 31 16:14:13.894030 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2253/4706] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:13 2022] GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a => generated 1510 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:13.944062 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-851bb04f-fd66-4ec9-aaa1-0d60321f079f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:13.945154 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-851bb04f-fd66-4ec9-aaa1-0d60321f079f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] [instance: 55b6663a-93c3-4534-b563-bf54f861c111] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:13.963863 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-851bb04f-fd66-4ec9-aaa1-0d60321f079f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:13.964384 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-851bb04f-fd66-4ec9-aaa1-0d60321f079f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:13.966390 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-851bb04f-fd66-4ec9-aaa1-0d60321f079f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:13.979457 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-851bb04f-fd66-4ec9-aaa1-0d60321f079f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:13.980457 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-851bb04f-fd66-4ec9-aaa1-0d60321f079f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:13.982068 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-851bb04f-fd66-4ec9-aaa1-0d60321f079f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:14.160426 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-851bb04f-fd66-4ec9-aaa1-0d60321f079f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:14.176252 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-704abde7-0b2a-4dc8-8661-93ff0a4c23b9 tempest-SecurityGroupRulesTestJSON-1183189146 tempest-SecurityGroupRulesTestJSON-1183189146-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/9dc85439-134f-4b25-8ec6-d80295d68419" status: 202 len: 0 microversion: 2.1 time: 1.184035 Aug 31 16:14:14.180278 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2454/4707] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 31 16:14:12 2022] DELETE /compute/v2.1/os-security-groups/9dc85439-134f-4b25-8ec6-d80295d68419 => generated 0 bytes in 1189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:14:14.190799 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-dcc7b4e2-06fb-4f0d-8b5d-463fa42fe4cc tempest-SecurityGroupRulesTestJSON-1183189146 tempest-SecurityGroupRulesTestJSON-1183189146-project] Calling method '.version_select at 0x7fbb4ac4ec10>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:14.204508 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-851bb04f-fd66-4ec9-aaa1-0d60321f079f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:14.209241 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-851bb04f-fd66-4ec9-aaa1-0d60321f079f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:14.213886 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-851bb04f-fd66-4ec9-aaa1-0d60321f079f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] 10.222.0.50 "GET /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111" status: 200 len: 1366 microversion: 2.47 time: 0.272298 Aug 31 16:14:14.216383 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2254/4708] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:14:13 2022] GET /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111 => generated 1366 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:14:14.558348 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-dcc7b4e2-06fb-4f0d-8b5d-463fa42fe4cc tempest-SecurityGroupRulesTestJSON-1183189146 tempest-SecurityGroupRulesTestJSON-1183189146-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups/39c6daf5-32fe-4dd8-bbdb-dc37446817ba" status: 200 len: 247 microversion: 2.1 time: 0.376432 Aug 31 16:14:14.558901 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2455/4709] 10.222.0.50 () {58 vars in 1269 bytes} [Wed Aug 31 16:14:14 2022] GET /compute/v2.1/os-security-groups/39c6daf5-32fe-4dd8-bbdb-dc37446817ba => generated 247 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:14:14.576794 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a1648cda-3859-4a37-8a62-284636a149b3 tempest-SecurityGroupRulesTestJSON-1183189146 tempest-SecurityGroupRulesTestJSON-1183189146-project] Action: 'create', calling method: .version_select at 0x7fbb45e2b430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-552739736", "description": "tempest-description-125280811"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:14.932846 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1e3946c7-e4ed-40b3-b58a-2685adbceb16 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:14.933460 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1e3946c7-e4ed-40b3-b58a-2685adbceb16 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ed9a700e-0de1-4ed3-993e-c0b6b293b02a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:14.950296 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e3946c7-e4ed-40b3-b58a-2685adbceb16 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:14.951026 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e3946c7-e4ed-40b3-b58a-2685adbceb16 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:14.951636 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e3946c7-e4ed-40b3-b58a-2685adbceb16 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:14.952575 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e3946c7-e4ed-40b3-b58a-2685adbceb16 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:14.953227 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e3946c7-e4ed-40b3-b58a-2685adbceb16 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:14.953830 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e3946c7-e4ed-40b3-b58a-2685adbceb16 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:15.566509 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1e3946c7-e4ed-40b3-b58a-2685adbceb16 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:15.583743 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1e3946c7-e4ed-40b3-b58a-2685adbceb16 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a" status: 200 len: 1510 microversion: 2.1 time: 0.655364 Aug 31 16:14:15.586318 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2456/4710] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:14 2022] GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a => generated 1510 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:14:15.604337 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b601c5b4-762d-4c51-a8c9-91d271558e93 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:15.605962 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b601c5b4-762d-4c51-a8c9-91d271558e93 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] [instance: 55b6663a-93c3-4534-b563-bf54f861c111] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:15.621500 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b601c5b4-762d-4c51-a8c9-91d271558e93 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:15.622796 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b601c5b4-762d-4c51-a8c9-91d271558e93 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:15.623478 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b601c5b4-762d-4c51-a8c9-91d271558e93 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:15.624538 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b601c5b4-762d-4c51-a8c9-91d271558e93 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:15.625244 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b601c5b4-762d-4c51-a8c9-91d271558e93 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:15.626069 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b601c5b4-762d-4c51-a8c9-91d271558e93 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:15.801028 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a1648cda-3859-4a37-8a62-284636a149b3 tempest-SecurityGroupRulesTestJSON-1183189146 tempest-SecurityGroupRulesTestJSON-1183189146-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.230266 Aug 31 16:14:15.802651 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2255/4711] 10.222.0.50 () {60 vars in 1180 bytes} [Wed Aug 31 16:14:14 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:14:15.847840 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-758bbb40-645b-4ee4-84d1-562b6942ee95 tempest-SecurityGroupRulesTestJSON-1183189146 tempest-SecurityGroupRulesTestJSON-1183189146-project] Action: 'create', calling method: .version_select at 0x7fbb46543af0>, body: {"security_group_rule": {"parent_group_id": "85343a6f-7ed3-4ac6-bb3f-9895e94fef97", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:15.882009 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b601c5b4-762d-4c51-a8c9-91d271558e93 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:15.902833 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b601c5b4-762d-4c51-a8c9-91d271558e93 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:15.908439 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b601c5b4-762d-4c51-a8c9-91d271558e93 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:15.910234 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b601c5b4-762d-4c51-a8c9-91d271558e93 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] 10.222.0.50 "GET /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111" status: 200 len: 1366 microversion: 2.47 time: 0.321755 Aug 31 16:14:15.911696 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2457/4712] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:14:15 2022] GET /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111 => generated 1366 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:14:16.001377 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:14:16.622513 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5aa83013-8d7e-4ceb-8b82-0bb2bf2b97d9 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:16.624537 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5aa83013-8d7e-4ceb-8b82-0bb2bf2b97d9 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ed9a700e-0de1-4ed3-993e-c0b6b293b02a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:16.637988 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5aa83013-8d7e-4ceb-8b82-0bb2bf2b97d9 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:16.640117 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5aa83013-8d7e-4ceb-8b82-0bb2bf2b97d9 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:16.641120 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5aa83013-8d7e-4ceb-8b82-0bb2bf2b97d9 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:16.642823 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5aa83013-8d7e-4ceb-8b82-0bb2bf2b97d9 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:16.643893 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5aa83013-8d7e-4ceb-8b82-0bb2bf2b97d9 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:16.644919 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5aa83013-8d7e-4ceb-8b82-0bb2bf2b97d9 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:17.409120 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5aa83013-8d7e-4ceb-8b82-0bb2bf2b97d9 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:17.424920 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5aa83013-8d7e-4ceb-8b82-0bb2bf2b97d9 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a" status: 200 len: 1510 microversion: 2.1 time: 0.811753 Aug 31 16:14:17.425784 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2458/4713] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:16 2022] GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a => generated 1510 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:17.434375 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7e9118d8-83d1-4a17-ad66-8b541e9d1234 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:17.436097 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7e9118d8-83d1-4a17-ad66-8b541e9d1234 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] [instance: 55b6663a-93c3-4534-b563-bf54f861c111] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:17.446735 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7e9118d8-83d1-4a17-ad66-8b541e9d1234 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:17.448457 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7e9118d8-83d1-4a17-ad66-8b541e9d1234 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:17.450134 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7e9118d8-83d1-4a17-ad66-8b541e9d1234 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:17.451953 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7e9118d8-83d1-4a17-ad66-8b541e9d1234 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:17.453037 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7e9118d8-83d1-4a17-ad66-8b541e9d1234 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:17.454248 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7e9118d8-83d1-4a17-ad66-8b541e9d1234 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:17.638324 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-758bbb40-645b-4ee4-84d1-562b6942ee95 tempest-SecurityGroupRulesTestJSON-1183189146 tempest-SecurityGroupRulesTestJSON-1183189146-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.814636 Aug 31 16:14:17.640918 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2256/4714] 10.222.0.50 () {60 vars in 1195 bytes} [Wed Aug 31 16:14:15 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1823 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:14:17.661579 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7e9118d8-83d1-4a17-ad66-8b541e9d1234 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:17.671142 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dff38190-bb12-48bb-a6b0-491f267bc606 tempest-SecurityGroupRulesTestJSON-1183189146 tempest-SecurityGroupRulesTestJSON-1183189146-project] Action: 'create', calling method: .version_select at 0x7fbb4674dc10>, body: {"security_group_rule": {"parent_group_id": "85343a6f-7ed3-4ac6-bb3f-9895e94fef97", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:17.678584 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7e9118d8-83d1-4a17-ad66-8b541e9d1234 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:17.692054 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7e9118d8-83d1-4a17-ad66-8b541e9d1234 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:17.694589 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7e9118d8-83d1-4a17-ad66-8b541e9d1234 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] 10.222.0.50 "GET /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111" status: 200 len: 1366 microversion: 2.47 time: 0.267177 Aug 31 16:14:17.695881 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2459/4715] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:14:17 2022] GET /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111 => generated 1366 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:14:18.452010 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dff38190-bb12-48bb-a6b0-491f267bc606 tempest-SecurityGroupRulesTestJSON-1183189146 tempest-SecurityGroupRulesTestJSON-1183189146-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.797999 Aug 31 16:14:18.454387 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2257/4716] 10.222.0.50 () {60 vars in 1195 bytes} [Wed Aug 31 16:14:17 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:14:18.482503 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-57f78ca1-410c-436b-8ccd-f67f97495aeb tempest-SecurityGroupRulesTestJSON-1183189146 tempest-SecurityGroupRulesTestJSON-1183189146-project] Calling method '.version_select at 0x7fbb464f69d0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:18.483577 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d0755d57-3cb2-48eb-9150-1407fa1ccd17 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:18.484624 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d0755d57-3cb2-48eb-9150-1407fa1ccd17 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ed9a700e-0de1-4ed3-993e-c0b6b293b02a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:18.497804 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d0755d57-3cb2-48eb-9150-1407fa1ccd17 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:18.499979 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d0755d57-3cb2-48eb-9150-1407fa1ccd17 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:18.503902 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d0755d57-3cb2-48eb-9150-1407fa1ccd17 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:18.505767 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d0755d57-3cb2-48eb-9150-1407fa1ccd17 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:18.512573 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d0755d57-3cb2-48eb-9150-1407fa1ccd17 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:18.516223 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d0755d57-3cb2-48eb-9150-1407fa1ccd17 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:18.840227 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-57f78ca1-410c-436b-8ccd-f67f97495aeb tempest-SecurityGroupRulesTestJSON-1183189146 tempest-SecurityGroupRulesTestJSON-1183189146-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups/85343a6f-7ed3-4ac6-bb3f-9895e94fef97" status: 200 len: 663 microversion: 2.1 time: 0.378518 Aug 31 16:14:18.841086 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2258/4717] 10.222.0.50 () {58 vars in 1269 bytes} [Wed Aug 31 16:14:18 2022] GET /compute/v2.1/os-security-groups/85343a6f-7ed3-4ac6-bb3f-9895e94fef97 => generated 663 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:14:18.846753 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5c41e403-a2a1-4092-8342-5f2b505ac37f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:18.850324 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5c41e403-a2a1-4092-8342-5f2b505ac37f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] [instance: 55b6663a-93c3-4534-b563-bf54f861c111] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:18.853309 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:14:18.865363 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c41e403-a2a1-4092-8342-5f2b505ac37f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:18.866209 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c41e403-a2a1-4092-8342-5f2b505ac37f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:18.866860 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c41e403-a2a1-4092-8342-5f2b505ac37f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:18.867782 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c41e403-a2a1-4092-8342-5f2b505ac37f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:18.868395 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c41e403-a2a1-4092-8342-5f2b505ac37f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:18.868862 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c41e403-a2a1-4092-8342-5f2b505ac37f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:19.010133 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5c41e403-a2a1-4092-8342-5f2b505ac37f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:19.044814 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5c41e403-a2a1-4092-8342-5f2b505ac37f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:19.047091 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5c41e403-a2a1-4092-8342-5f2b505ac37f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:19.049574 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5c41e403-a2a1-4092-8342-5f2b505ac37f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] 10.222.0.50 "GET /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111" status: 200 len: 1366 microversion: 2.47 time: 0.206497 Aug 31 16:14:19.064431 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2259/4718] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:14:18 2022] GET /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111 => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:14:19.076227 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d4851b47-2779-4770-9a11-a495e3ab2568 tempest-SecurityGroupRulesTestJSON-1183189146 tempest-SecurityGroupRulesTestJSON-1183189146-project] Calling method '.version_select at 0x7fbb463309d0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:19.098390 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d0755d57-3cb2-48eb-9150-1407fa1ccd17 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:19.108994 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d0755d57-3cb2-48eb-9150-1407fa1ccd17 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a" status: 200 len: 1510 microversion: 2.1 time: 0.656903 Aug 31 16:14:19.114338 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2460/4719] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:18 2022] GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a => generated 1510 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:19.673868 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d4851b47-2779-4770-9a11-a495e3ab2568 tempest-SecurityGroupRulesTestJSON-1183189146 tempest-SecurityGroupRulesTestJSON-1183189146-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-group-rules/a69a8969-980f-464b-bec4-8194a12b4248" status: 202 len: 0 microversion: 2.1 time: 0.610400 Aug 31 16:14:19.678627 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2260/4720] 10.222.0.50 () {58 vars in 1287 bytes} [Wed Aug 31 16:14:19 2022] DELETE /compute/v2.1/os-security-group-rules/a69a8969-980f-464b-bec4-8194a12b4248 => generated 0 bytes in 616 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:14:19.707171 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7ff96286-42e8-479f-83a9-d0694b2348fa tempest-SecurityGroupRulesTestJSON-1183189146 tempest-SecurityGroupRulesTestJSON-1183189146-project] Calling method '.version_select at 0x7fbb45e121f0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:20.083052 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-08ee0bdc-2199-4d76-b40b-ceb4a2dffb86 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:20.086603 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-08ee0bdc-2199-4d76-b40b-ceb4a2dffb86 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] [instance: 55b6663a-93c3-4534-b563-bf54f861c111] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:20.100255 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-08ee0bdc-2199-4d76-b40b-ceb4a2dffb86 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:20.101789 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-08ee0bdc-2199-4d76-b40b-ceb4a2dffb86 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:20.104074 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-08ee0bdc-2199-4d76-b40b-ceb4a2dffb86 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:20.105582 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-08ee0bdc-2199-4d76-b40b-ceb4a2dffb86 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:20.106670 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-08ee0bdc-2199-4d76-b40b-ceb4a2dffb86 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:20.108065 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-08ee0bdc-2199-4d76-b40b-ceb4a2dffb86 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:20.243353 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7ff96286-42e8-479f-83a9-d0694b2348fa tempest-SecurityGroupRulesTestJSON-1183189146 tempest-SecurityGroupRulesTestJSON-1183189146-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/85343a6f-7ed3-4ac6-bb3f-9895e94fef97" status: 202 len: 0 microversion: 2.1 time: 0.562142 Aug 31 16:14:20.250705 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2461/4721] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 31 16:14:19 2022] DELETE /compute/v2.1/os-security-groups/85343a6f-7ed3-4ac6-bb3f-9895e94fef97 => generated 0 bytes in 571 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:14:20.258428 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c517be5f-7b17-4f51-9b9f-7635c13c0804 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:20.259550 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c517be5f-7b17-4f51-9b9f-7635c13c0804 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ed9a700e-0de1-4ed3-993e-c0b6b293b02a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:20.300919 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=49 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:14:20.306821 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c517be5f-7b17-4f51-9b9f-7635c13c0804 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:20.308028 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c517be5f-7b17-4f51-9b9f-7635c13c0804 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:20.309272 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c517be5f-7b17-4f51-9b9f-7635c13c0804 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:20.310547 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c517be5f-7b17-4f51-9b9f-7635c13c0804 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:20.311350 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c517be5f-7b17-4f51-9b9f-7635c13c0804 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:20.312264 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c517be5f-7b17-4f51-9b9f-7635c13c0804 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:20.337805 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-08ee0bdc-2199-4d76-b40b-ceb4a2dffb86 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:20.357578 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-08ee0bdc-2199-4d76-b40b-ceb4a2dffb86 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:20.369524 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-08ee0bdc-2199-4d76-b40b-ceb4a2dffb86 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:20.371777 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-08ee0bdc-2199-4d76-b40b-ceb4a2dffb86 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] 10.222.0.50 "GET /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111" status: 200 len: 1366 microversion: 2.47 time: 0.295999 Aug 31 16:14:20.394582 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2261/4722] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:14:20 2022] GET /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111 => generated 1366 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:14:20.410545 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-86b31d50-f644-49ca-a14a-224aa58b35d4 tempest-SecurityGroupRulesTestJSON-1183189146 tempest-SecurityGroupRulesTestJSON-1183189146-project] Calling method '.version_select at 0x7fbb45c70a60>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:20.510122 n-d-833090-16 devstack@n-api.service[128863]: DEBUG neutronclient.v2_0.client [None req-86b31d50-f644-49ca-a14a-224aa58b35d4 tempest-SecurityGroupRulesTestJSON-1183189146 tempest-SecurityGroupRulesTestJSON-1183189146-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9dc85439-134f-4b25-8ec6-d80295d68419 does not exist", "detail": ""}} {{(pid=128863) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 31 16:14:20.516654 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.security_group_api [None req-86b31d50-f644-49ca-a14a-224aa58b35d4 tempest-SecurityGroupRulesTestJSON-1183189146 tempest-SecurityGroupRulesTestJSON-1183189146-project] Neutron security group 9dc85439-134f-4b25-8ec6-d80295d68419 not found {{(pid=128863) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 31 16:14:20.517900 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-86b31d50-f644-49ca-a14a-224aa58b35d4 tempest-SecurityGroupRulesTestJSON-1183189146 tempest-SecurityGroupRulesTestJSON-1183189146-project] HTTP exception thrown: Security group 9dc85439-134f-4b25-8ec6-d80295d68419 does not exist Aug 31 16:14:20.517900 n-d-833090-16 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-51c93008-6413-4005-87a9-d56dc9b1b808'] Aug 31 16:14:20.525751 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-86b31d50-f644-49ca-a14a-224aa58b35d4 tempest-SecurityGroupRulesTestJSON-1183189146 tempest-SecurityGroupRulesTestJSON-1183189146-project] Request method failure captured: Aug 31 16:14:20.525751 n-d-833090-16 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/os-security-groups/9dc85439-134f-4b25-8ec6-d80295d68419 HTTP/1.1 Aug 31 16:14:20.525751 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:14:20.525751 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:14:20.525751 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:14:20.525751 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:14:20.525751 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:14:20.525751 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:14:20.525751 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:14:20.525751 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:14:20.525751 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4jLCbavY_15o5G_tqw4tnVNggUyOdhSvl_cyftbM4ikPr4B9y0C6M9SKceU4sXDnOzINt8fYvrQFNAEMJktYgMG9kzTAaX-oM3tFUfw40GyMDAPLwXqid6uLXenWdOMRzsjGgCtj2OpXo7uRypZDjk3OhK9KmCPRIQAfTRKI3RUkCc Aug 31 16:14:20.525751 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:14:20.525751 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:14:20.525751 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:14:20.525751 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:14:20.525751 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:14:20.525751 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:14:20.525751 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 217cb51a5b354dc2b3e93a07be61404f Aug 31 16:14:20.525751 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1183189146 Aug 31 16:14:20.525751 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:14:20.525751 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:14:20.525751 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/217cb51a5b354dc2b3e93a07be61404f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/217cb51a5b354dc2b3e93a07be61404f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/217cb51a5b354dc2b3e93a07be61404f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_217cb51a5b354dc2b3e93a07be61404f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:14:20.525751 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1183189146 Aug 31 16:14:20.525751 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 217cb51a5b354dc2b3e93a07be61404f Aug 31 16:14:20.525751 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1183189146 Aug 31 16:14:20.525751 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-SecurityGroupRulesTestJSON-1183189146-project Aug 31 16:14:20.525751 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:14:20.525751 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:14:20.525751 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: dfb44921611d48edb75d5ad32bcc63ba Aug 31 16:14:20.525751 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1183189146-project Aug 31 16:14:20.525751 n-d-833090-16 devstack@n-api.service[128863]: method: Aug 31 16:14:20.525751 n-d-833090-16 devstack@n-api.service[128863]: exception: Security group 9dc85439-134f-4b25-8ec6-d80295d68419 does not exist Aug 31 16:14:20.525751 n-d-833090-16 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-51c93008-6413-4005-87a9-d56dc9b1b808'] Aug 31 16:14:20.525751 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '9dc85439-134f-4b25-8ec6-d80295d68419'} Aug 31 16:14:20.525751 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:14:20.525751 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:20.525751 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 31 16:14:20.525751 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 31 16:14:20.525751 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:14:20.525751 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:14:20.525751 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 31 16:14:20.525751 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 31 16:14:20.525751 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:14:20.525751 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:14:20.525751 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 31 16:14:20.525751 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 31 16:14:20.525751 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:14:20.525751 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:14:20.525751 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 31 16:14:20.525751 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 31 16:14:20.525751 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:14:20.525751 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:14:20.525751 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 31 16:14:20.525751 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 31 16:14:20.525751 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:14:20.525751 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:14:20.525751 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 31 16:14:20.525751 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 31 16:14:20.525751 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 31 16:14:20.525751 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 31 16:14:20.525751 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9dc85439-134f-4b25-8ec6-d80295d68419 does not exist Aug 31 16:14:20.533176 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-51c93008-6413-4005-87a9-d56dc9b1b808'] Aug 31 16:14:20.533176 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:20.533176 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:20.533176 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:20.533176 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:20.533176 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 31 16:14:20.533176 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 31 16:14:20.533176 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 31 16:14:20.533176 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 31 16:14:20.533176 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9dc85439-134f-4b25-8ec6-d80295d68419 does not exist Aug 31 16:14:20.533176 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-51c93008-6413-4005-87a9-d56dc9b1b808'] Aug 31 16:14:20.533176 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:20.533176 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:20.533176 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:20.533176 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:20.533176 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:20.533176 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:20.533176 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:14:20.533176 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:14:20.533176 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:14:20.533176 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:14:20.533176 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:14:20.533176 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:14:20.533176 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 31 16:14:20.533176 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 31 16:14:20.533176 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9dc85439-134f-4b25-8ec6-d80295d68419 does not exist Aug 31 16:14:20.533176 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-51c93008-6413-4005-87a9-d56dc9b1b808'] Aug 31 16:14:20.533176 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:20.533176 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:20.533176 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:20.533176 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:20.533176 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:20.533176 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:20.533176 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:14:20.533176 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:14:20.533176 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9dc85439-134f-4b25-8ec6-d80295d68419 does not exist Aug 31 16:14:20.533176 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-51c93008-6413-4005-87a9-d56dc9b1b808'] Aug 31 16:14:20.533176 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:20.533176 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-86b31d50-f644-49ca-a14a-224aa58b35d4 tempest-SecurityGroupRulesTestJSON-1183189146 tempest-SecurityGroupRulesTestJSON-1183189146-project] Returning 404 to user: Security group 9dc85439-134f-4b25-8ec6-d80295d68419 does not exist Aug 31 16:14:20.533176 n-d-833090-16 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-51c93008-6413-4005-87a9-d56dc9b1b808'] {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:14:20.542555 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-86b31d50-f644-49ca-a14a-224aa58b35d4 tempest-SecurityGroupRulesTestJSON-1183189146 tempest-SecurityGroupRulesTestJSON-1183189146-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/9dc85439-134f-4b25-8ec6-d80295d68419" status: 404 len: 194 microversion: 2.1 time: 0.137283 Aug 31 16:14:20.542555 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2262/4723] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 31 16:14:20 2022] DELETE /compute/v2.1/os-security-groups/9dc85439-134f-4b25-8ec6-d80295d68419 => generated 194 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:14:20.554847 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f3c6a786-4204-4ced-9942-9e59a2d9577e tempest-SecurityGroupRulesTestJSON-1183189146 tempest-SecurityGroupRulesTestJSON-1183189146-project] Calling method '.version_select at 0x7fbb4aa303a0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:20.959611 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c517be5f-7b17-4f51-9b9f-7635c13c0804 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:20.973800 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c517be5f-7b17-4f51-9b9f-7635c13c0804 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a" status: 200 len: 1487 microversion: 2.1 time: 0.721554 Aug 31 16:14:20.984606 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2462/4724] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:20 2022] GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a => generated 1487 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:21.015620 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-79bea4c4-f3c6-4e60-98c6-2b8384ee47b4 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1843150628"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:21.021508 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-79bea4c4-f3c6-4e60-98c6-2b8384ee47b4 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ed9a700e-0de1-4ed3-993e-c0b6b293b02a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:21.065639 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-79bea4c4-f3c6-4e60-98c6-2b8384ee47b4 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:21.066841 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-79bea4c4-f3c6-4e60-98c6-2b8384ee47b4 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:21.067733 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-79bea4c4-f3c6-4e60-98c6-2b8384ee47b4 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:21.069941 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-79bea4c4-f3c6-4e60-98c6-2b8384ee47b4 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:21.072750 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-79bea4c4-f3c6-4e60-98c6-2b8384ee47b4 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:21.073686 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-79bea4c4-f3c6-4e60-98c6-2b8384ee47b4 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:21.200539 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-79bea4c4-f3c6-4e60-98c6-2b8384ee47b4 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "PUT /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a" status: 200 len: 1062 microversion: 2.1 time: 0.206285 Aug 31 16:14:21.202348 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2463/4725] 10.222.0.50 () {60 vars in 1256 bytes} [Wed Aug 31 16:14:20 2022] PUT /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a => generated 1062 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:21.232252 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f67e24c4-76b2-4fce-aec9-bedfbc4d7f89 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:21.232884 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f67e24c4-76b2-4fce-aec9-bedfbc4d7f89 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ed9a700e-0de1-4ed3-993e-c0b6b293b02a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:21.254548 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f67e24c4-76b2-4fce-aec9-bedfbc4d7f89 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:21.255901 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f67e24c4-76b2-4fce-aec9-bedfbc4d7f89 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:21.256543 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f67e24c4-76b2-4fce-aec9-bedfbc4d7f89 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:21.257469 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f67e24c4-76b2-4fce-aec9-bedfbc4d7f89 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:21.258128 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f67e24c4-76b2-4fce-aec9-bedfbc4d7f89 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:21.259035 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f67e24c4-76b2-4fce-aec9-bedfbc4d7f89 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:22.302485 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f67e24c4-76b2-4fce-aec9-bedfbc4d7f89 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:22.320055 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f67e24c4-76b2-4fce-aec9-bedfbc4d7f89 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a" status: 200 len: 1489 microversion: 2.1 time: 1.103254 Aug 31 16:14:22.322723 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2464/4726] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:21 2022] GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a => generated 1489 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:22.332823 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9308a2cf-9d91-4d3b-aa27-b62836103994 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:22.339641 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9308a2cf-9d91-4d3b-aa27-b62836103994 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] [instance: 55b6663a-93c3-4534-b563-bf54f861c111] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:22.353498 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9308a2cf-9d91-4d3b-aa27-b62836103994 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:22.367039 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9308a2cf-9d91-4d3b-aa27-b62836103994 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:22.367805 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9308a2cf-9d91-4d3b-aa27-b62836103994 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:22.368815 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9308a2cf-9d91-4d3b-aa27-b62836103994 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:22.369502 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9308a2cf-9d91-4d3b-aa27-b62836103994 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:22.370164 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9308a2cf-9d91-4d3b-aa27-b62836103994 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:22.450680 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f3c6a786-4204-4ced-9942-9e59a2d9577e tempest-SecurityGroupRulesTestJSON-1183189146 tempest-SecurityGroupRulesTestJSON-1183189146-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/39c6daf5-32fe-4dd8-bbdb-dc37446817ba" status: 202 len: 0 microversion: 2.1 time: 1.907244 Aug 31 16:14:22.458122 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2263/4727] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 31 16:14:20 2022] DELETE /compute/v2.1/os-security-groups/39c6daf5-32fe-4dd8-bbdb-dc37446817ba => generated 0 bytes in 1916 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:14:22.510128 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2e52b0d8-58a6-4d39-969a-2b094abae45a tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f3a07e52-7a2a-49ce-a2f2-77f81069632b"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:22.527378 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2e52b0d8-58a6-4d39-969a-2b094abae45a tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 1c40a98f-366d-4392-9034-7841f68b2050] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:22.547383 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e52b0d8-58a6-4d39-969a-2b094abae45a tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:22.559417 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e52b0d8-58a6-4d39-969a-2b094abae45a tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:22.560723 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e52b0d8-58a6-4d39-969a-2b094abae45a tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:22.562457 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e52b0d8-58a6-4d39-969a-2b094abae45a tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:22.563670 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e52b0d8-58a6-4d39-969a-2b094abae45a tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:22.565783 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e52b0d8-58a6-4d39-969a-2b094abae45a tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:22.708998 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9308a2cf-9d91-4d3b-aa27-b62836103994 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:22.743777 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9308a2cf-9d91-4d3b-aa27-b62836103994 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:22.753131 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9308a2cf-9d91-4d3b-aa27-b62836103994 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:22.754421 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9308a2cf-9d91-4d3b-aa27-b62836103994 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] 10.222.0.50 "GET /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111" status: 200 len: 1366 microversion: 2.47 time: 0.430349 Aug 31 16:14:22.754994 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2465/4728] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:14:22 2022] GET /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111 => generated 1366 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:14:22.778459 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-483b7c47-d671-4a46-803f-edc5a3c861bb tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:22.778459 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-483b7c47-d671-4a46-803f-edc5a3c861bb tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ed9a700e-0de1-4ed3-993e-c0b6b293b02a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:22.786993 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-483b7c47-d671-4a46-803f-edc5a3c861bb tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:22.787496 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-483b7c47-d671-4a46-803f-edc5a3c861bb tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:22.787938 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-483b7c47-d671-4a46-803f-edc5a3c861bb tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:22.788657 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-483b7c47-d671-4a46-803f-edc5a3c861bb tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:22.789115 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-483b7c47-d671-4a46-803f-edc5a3c861bb tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:22.789541 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-483b7c47-d671-4a46-803f-edc5a3c861bb tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:22.815921 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:14:23.319959 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2e52b0d8-58a6-4d39-969a-2b094abae45a tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "POST /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.858967 Aug 31 16:14:23.329351 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2264/4729] 10.222.0.50 () {60 vars in 1323 bytes} [Wed Aug 31 16:14:22 2022] POST /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050/os-volume_attachments => generated 194 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:14:23.363936 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5e5c9469-0773-4e48-98d7-9081fa7ccd03 tempest-SecurityGroupRulesTestJSON-1183189146 tempest-SecurityGroupRulesTestJSON-1183189146-project] Calling method '.version_select at 0x7fbb45e11d30>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:23.410208 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-483b7c47-d671-4a46-803f-edc5a3c861bb tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:23.445453 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-483b7c47-d671-4a46-803f-edc5a3c861bb tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a" status: 200 len: 1489 microversion: 2.1 time: 0.689043 Aug 31 16:14:23.462134 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2466/4730] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:22 2022] GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a => generated 1489 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:23.494775 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b1e5c92b-f165-4cb1-becc-de8ad28768b4 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:23.496412 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b1e5c92b-f165-4cb1-becc-de8ad28768b4 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ed9a700e-0de1-4ed3-993e-c0b6b293b02a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:23.544559 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1e5c92b-f165-4cb1-becc-de8ad28768b4 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:23.545587 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1e5c92b-f165-4cb1-becc-de8ad28768b4 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:23.550892 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1e5c92b-f165-4cb1-becc-de8ad28768b4 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:23.552314 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1e5c92b-f165-4cb1-becc-de8ad28768b4 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:23.553150 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1e5c92b-f165-4cb1-becc-de8ad28768b4 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:23.557395 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1e5c92b-f165-4cb1-becc-de8ad28768b4 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:23.671858 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b1e5c92b-f165-4cb1-becc-de8ad28768b4 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ed9a700e-0de1-4ed3-993e-c0b6b293b02a] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:14:23.892625 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b1e5c92b-f165-4cb1-becc-de8ad28768b4 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a" status: 204 len: 0 microversion: 2.1 time: 0.410772 Aug 31 16:14:23.898237 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2467/4731] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:14:23 2022] DELETE /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 16:14:23.912483 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f1807aac-9756-4e92-838b-b4ee2f8de036 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:23.918978 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f1807aac-9756-4e92-838b-b4ee2f8de036 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] [instance: 55b6663a-93c3-4534-b563-bf54f861c111] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:23.942621 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f1807aac-9756-4e92-838b-b4ee2f8de036 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:23.948165 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f1807aac-9756-4e92-838b-b4ee2f8de036 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:23.948841 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f1807aac-9756-4e92-838b-b4ee2f8de036 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:23.949710 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f1807aac-9756-4e92-838b-b4ee2f8de036 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:23.950371 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f1807aac-9756-4e92-838b-b4ee2f8de036 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:23.955414 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f1807aac-9756-4e92-838b-b4ee2f8de036 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:24.307083 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5e5c9469-0773-4e48-98d7-9081fa7ccd03 tempest-SecurityGroupRulesTestJSON-1183189146 tempest-SecurityGroupRulesTestJSON-1183189146-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/48d6a299-0da1-4e36-85aa-e15ebb326cfd" status: 202 len: 0 microversion: 2.1 time: 0.981221 Aug 31 16:14:24.309025 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2265/4732] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 31 16:14:23 2022] DELETE /compute/v2.1/os-security-groups/48d6a299-0da1-4e36-85aa-e15ebb326cfd => generated 0 bytes in 987 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:14:24.315851 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a297add4-a74b-44dd-889e-bf92f08afb9e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:24.317298 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a297add4-a74b-44dd-889e-bf92f08afb9e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ed9a700e-0de1-4ed3-993e-c0b6b293b02a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:24.359492 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a297add4-a74b-44dd-889e-bf92f08afb9e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:24.363551 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a297add4-a74b-44dd-889e-bf92f08afb9e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:24.367649 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a297add4-a74b-44dd-889e-bf92f08afb9e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:24.370767 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a297add4-a74b-44dd-889e-bf92f08afb9e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:24.374326 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a297add4-a74b-44dd-889e-bf92f08afb9e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:24.376586 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a297add4-a74b-44dd-889e-bf92f08afb9e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:24.401317 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f1807aac-9756-4e92-838b-b4ee2f8de036 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:24.433705 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f1807aac-9756-4e92-838b-b4ee2f8de036 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:24.445941 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f1807aac-9756-4e92-838b-b4ee2f8de036 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:24.449025 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f1807aac-9756-4e92-838b-b4ee2f8de036 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] 10.222.0.50 "GET /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111" status: 200 len: 1366 microversion: 2.47 time: 0.547818 Aug 31 16:14:24.458572 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2468/4733] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:14:23 2022] GET /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111 => generated 1366 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:14:24.490638 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-061c2fb9-604a-4b51-b094-8ab1ad41e427 tempest-SecurityGroupRulesTestJSON-1183189146 tempest-SecurityGroupRulesTestJSON-1183189146-project] Calling method '.version_select at 0x7fbb45de1d30>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:25.512191 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a297add4-a74b-44dd-889e-bf92f08afb9e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:25.548907 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a297add4-a74b-44dd-889e-bf92f08afb9e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a" status: 200 len: 1495 microversion: 2.1 time: 1.233795 Aug 31 16:14:25.575971 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2266/4734] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:24 2022] GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a => generated 1495 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:25.611370 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-75b8c4f4-3605-4e62-93db-951651f0047c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1037602363", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "c271d611-c3e0-40e4-8147-e3af59ade67e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-108919608", "security_groups": [{"name": "tempest-secgroup-smoke-522553892"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:26.213806 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-75b8c4f4-3605-4e62-93db-951651f0047c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] validate_networks() for [('c271d611-c3e0-40e4-8147-e3af59ade67e', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:14:26.542746 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-061c2fb9-604a-4b51-b094-8ab1ad41e427 tempest-SecurityGroupRulesTestJSON-1183189146 tempest-SecurityGroupRulesTestJSON-1183189146-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/09264cf5-7cb1-4b9f-aa43-4ae3eaf73a26" status: 202 len: 0 microversion: 2.1 time: 2.082239 Aug 31 16:14:26.544213 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2469/4735] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 31 16:14:24 2022] DELETE /compute/v2.1/os-security-groups/09264cf5-7cb1-4b9f-aa43-4ae3eaf73a26 => generated 0 bytes in 2084 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:14:26.553436 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-caa6f210-2c39-4d22-ab3b-9f4ad5eb521b tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:26.554084 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-caa6f210-2c39-4d22-ab3b-9f4ad5eb521b tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] [instance: 55b6663a-93c3-4534-b563-bf54f861c111] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:26.589215 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-caa6f210-2c39-4d22-ab3b-9f4ad5eb521b tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:26.594433 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-caa6f210-2c39-4d22-ab3b-9f4ad5eb521b tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:26.595501 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-caa6f210-2c39-4d22-ab3b-9f4ad5eb521b tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:26.598531 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-caa6f210-2c39-4d22-ab3b-9f4ad5eb521b tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:26.599613 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-caa6f210-2c39-4d22-ab3b-9f4ad5eb521b tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:26.618779 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-caa6f210-2c39-4d22-ab3b-9f4ad5eb521b tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:26.957943 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-caa6f210-2c39-4d22-ab3b-9f4ad5eb521b tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:26.983052 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-caa6f210-2c39-4d22-ab3b-9f4ad5eb521b tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:26.991974 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-caa6f210-2c39-4d22-ab3b-9f4ad5eb521b tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:27.000610 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-caa6f210-2c39-4d22-ab3b-9f4ad5eb521b tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] 10.222.0.50 "GET /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111" status: 200 len: 1366 microversion: 2.47 time: 0.454610 Aug 31 16:14:27.014604 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2470/4736] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:14:26 2022] GET /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111 => generated 1366 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:14:27.487366 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b4ffc324-0b02-4707-8e78-347b13ae560e tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1985398819", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "964f2c85-eace-42bc-af0c-2eac7b5c9d1c"}]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:27.675213 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-b4ffc324-0b02-4707-8e78-347b13ae560e tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] validate_networks() for [('964f2c85-eace-42bc-af0c-2eac7b5c9d1c', None, None, None, None, None)] {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:14:27.815833 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-75b8c4f4-3605-4e62-93db-951651f0047c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:14:27.816694 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-75b8c4f4-3605-4e62-93db-951651f0047c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:14:27.816868 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-75b8c4f4-3605-4e62-93db-951651f0047c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:14:27.817180 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-75b8c4f4-3605-4e62-93db-951651f0047c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:14:27.822551 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-75b8c4f4-3605-4e62-93db-951651f0047c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:14:27.856166 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75b8c4f4-3605-4e62-93db-951651f0047c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:27.857228 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75b8c4f4-3605-4e62-93db-951651f0047c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:27.859025 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75b8c4f4-3605-4e62-93db-951651f0047c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:27.863491 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75b8c4f4-3605-4e62-93db-951651f0047c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:27.869495 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75b8c4f4-3605-4e62-93db-951651f0047c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:27.871292 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75b8c4f4-3605-4e62-93db-951651f0047c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:27.920608 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-75b8c4f4-3605-4e62-93db-951651f0047c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Getting quotas for project 3397e8a2a042486eb323432c47dfd392. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:14:27.933762 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-75b8c4f4-3605-4e62-93db-951651f0047c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Getting quotas for user 87f8241df6664aa59ba669d733e53871 and project 3397e8a2a042486eb323432c47dfd392. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:14:27.964085 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-75b8c4f4-3605-4e62-93db-951651f0047c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:14:27.972817 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-75b8c4f4-3605-4e62-93db-951651f0047c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: e1cb02b7-1dd6-4c83-9008-e19525731e03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:14:28.115112 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-75b8c4f4-3605-4e62-93db-951651f0047c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.530101 Aug 31 16:14:28.115782 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2267/4737] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:14:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 2539 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:14:28.146035 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-78229b2d-e858-4b9c-8831-b3eef16b2365 tempest-SecurityGroupRulesTestJSON-1183189146 tempest-SecurityGroupRulesTestJSON-1183189146-project] Calling method '.version_select at 0x7fbb4aa30040>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:29.241415 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-78229b2d-e858-4b9c-8831-b3eef16b2365 tempest-SecurityGroupRulesTestJSON-1183189146 tempest-SecurityGroupRulesTestJSON-1183189146-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/e9a5f24b-d3b0-4528-b9ab-16e728f7c8fc" status: 202 len: 0 microversion: 2.1 time: 1.114561 Aug 31 16:14:29.243433 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2268/4738] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 31 16:14:28 2022] DELETE /compute/v2.1/os-security-groups/e9a5f24b-d3b0-4528-b9ab-16e728f7c8fc => generated 0 bytes in 1127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:14:29.251334 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-75d7ed5e-5330-4d41-8602-3041728da445 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:29.252315 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-75d7ed5e-5330-4d41-8602-3041728da445 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ed9a700e-0de1-4ed3-993e-c0b6b293b02a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:29.276305 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75d7ed5e-5330-4d41-8602-3041728da445 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:29.288705 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75d7ed5e-5330-4d41-8602-3041728da445 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:29.289622 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75d7ed5e-5330-4d41-8602-3041728da445 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:29.292095 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75d7ed5e-5330-4d41-8602-3041728da445 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:29.293766 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75d7ed5e-5330-4d41-8602-3041728da445 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:29.294784 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75d7ed5e-5330-4d41-8602-3041728da445 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:29.443189 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75d7ed5e-5330-4d41-8602-3041728da445 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:29.444161 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75d7ed5e-5330-4d41-8602-3041728da445 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:29.446832 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75d7ed5e-5330-4d41-8602-3041728da445 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:29.448518 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-75d7ed5e-5330-4d41-8602-3041728da445 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lazy-loading 'fault' on Instance uuid ed9a700e-0de1-4ed3-993e-c0b6b293b02a {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:14:29.532552 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-75d7ed5e-5330-4d41-8602-3041728da445 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:29.545482 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-75d7ed5e-5330-4d41-8602-3041728da445 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a" status: 200 len: 1310 microversion: 2.1 time: 0.297494 Aug 31 16:14:29.550814 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2269/4739] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:29 2022] GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a => generated 1310 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:29.560800 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1b42662a-3530-480f-8ff7-3dd49814b8aa tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:29.565409 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1b42662a-3530-480f-8ff7-3dd49814b8aa tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] [instance: 55b6663a-93c3-4534-b563-bf54f861c111] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:29.602231 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b42662a-3530-480f-8ff7-3dd49814b8aa tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:29.617301 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b42662a-3530-480f-8ff7-3dd49814b8aa tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:29.624185 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b42662a-3530-480f-8ff7-3dd49814b8aa tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:29.625725 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b42662a-3530-480f-8ff7-3dd49814b8aa tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:29.626672 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b42662a-3530-480f-8ff7-3dd49814b8aa tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:29.627433 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b42662a-3530-480f-8ff7-3dd49814b8aa tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:30.074771 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-b4ffc324-0b02-4707-8e78-347b13ae560e tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:14:30.075413 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-b4ffc324-0b02-4707-8e78-347b13ae560e tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:14:30.076070 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-b4ffc324-0b02-4707-8e78-347b13ae560e tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:14:30.076598 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-b4ffc324-0b02-4707-8e78-347b13ae560e tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:14:30.077132 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-b4ffc324-0b02-4707-8e78-347b13ae560e tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:14:30.118737 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b4ffc324-0b02-4707-8e78-347b13ae560e tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:30.135535 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b4ffc324-0b02-4707-8e78-347b13ae560e tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:30.136940 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b4ffc324-0b02-4707-8e78-347b13ae560e tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:30.142505 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b4ffc324-0b02-4707-8e78-347b13ae560e tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:30.148336 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b4ffc324-0b02-4707-8e78-347b13ae560e tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:30.149151 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b4ffc324-0b02-4707-8e78-347b13ae560e tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:30.184840 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1b42662a-3530-480f-8ff7-3dd49814b8aa tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:30.225740 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-b4ffc324-0b02-4707-8e78-347b13ae560e tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Getting quotas for project 8d2579dc4a344c2998e30915ea51b2ad. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:14:30.240094 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1b42662a-3530-480f-8ff7-3dd49814b8aa tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:30.244143 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-b4ffc324-0b02-4707-8e78-347b13ae560e tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Getting quotas for user 0b130aecc1794cfc9fe0a9a80d558bbe and project 8d2579dc4a344c2998e30915ea51b2ad. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:14:30.249764 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1b42662a-3530-480f-8ff7-3dd49814b8aa tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:30.252823 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1b42662a-3530-480f-8ff7-3dd49814b8aa tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] 10.222.0.50 "GET /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111" status: 200 len: 1366 microversion: 2.47 time: 0.700426 Aug 31 16:14:30.256938 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2270/4740] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:14:29 2022] GET /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111 => generated 1366 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:14:30.261643 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b4ffc324-0b02-4707-8e78-347b13ae560e tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:14:30.264379 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b4ffc324-0b02-4707-8e78-347b13ae560e tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] [instance: 802a1cc5-9787-47d9-87d5-e3fa912d7712] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:14:30.274467 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-56dd1e23-a4d5-40cb-be44-5932cc4272ba tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:30.275094 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-56dd1e23-a4d5-40cb-be44-5932cc4272ba tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: e1cb02b7-1dd6-4c83-9008-e19525731e03] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:30.290777 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56dd1e23-a4d5-40cb-be44-5932cc4272ba tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:30.292867 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56dd1e23-a4d5-40cb-be44-5932cc4272ba tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:30.293531 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56dd1e23-a4d5-40cb-be44-5932cc4272ba tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:30.295436 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56dd1e23-a4d5-40cb-be44-5932cc4272ba tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:30.296486 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56dd1e23-a4d5-40cb-be44-5932cc4272ba tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:30.297513 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-56dd1e23-a4d5-40cb-be44-5932cc4272ba tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:30.377574 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b4ffc324-0b02-4707-8e78-347b13ae560e tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.358597 Aug 31 16:14:30.382291 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2471/4741] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:14:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 3366 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:14:30.401274 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-ae970ab8-f369-4429-8a52-194d48e07a9a req-45a20194-d8b8-4dcd-ba08-ab46c8f5fcb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed9a700e-0de1-4ed3-993e-c0b6b293b02a", "name": "network-vif-deleted", "tag": "6f8d8f6e-2b42-4279-a8a4-50ef2c9c74b4"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:30.511730 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-ae970ab8-f369-4429-8a52-194d48e07a9a req-45a20194-d8b8-4dcd-ba08-ab46c8f5fcb5 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:30.513028 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-ae970ab8-f369-4429-8a52-194d48e07a9a req-45a20194-d8b8-4dcd-ba08-ab46c8f5fcb5 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:30.518131 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-ae970ab8-f369-4429-8a52-194d48e07a9a req-45a20194-d8b8-4dcd-ba08-ab46c8f5fcb5 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:30.578741 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-ae970ab8-f369-4429-8a52-194d48e07a9a req-45a20194-d8b8-4dcd-ba08-ab46c8f5fcb5 service nova] Creating event network-vif-deleted:6f8d8f6e-2b42-4279-a8a4-50ef2c9c74b4 for instance ed9a700e-0de1-4ed3-993e-c0b6b293b02a on n-h2-833090-16 Aug 31 16:14:30.595993 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-56dd1e23-a4d5-40cb-be44-5932cc4272ba tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:30.596631 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-ae970ab8-f369-4429-8a52-194d48e07a9a req-45a20194-d8b8-4dcd-ba08-ab46c8f5fcb5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.210119 Aug 31 16:14:30.597446 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2472/4742] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:14:30.617526 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-56dd1e23-a4d5-40cb-be44-5932cc4272ba tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03" status: 200 len: 1318 microversion: 2.1 time: 0.359437 Aug 31 16:14:30.619121 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2271/4743] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:30 2022] GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03 => generated 1318 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:30.637682 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-08a60b49-f5c1-4d95-86d8-2ad8b5b5edbf tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:30.640707 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-97626428-aafa-466d-8176-ac43115aabed tempest-SecurityGroupRulesTestJSON-1183189146 tempest-SecurityGroupRulesTestJSON-1183189146-project] Calling method '.version_select at 0x7fbb45e3f9d0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:30.642871 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-08a60b49-f5c1-4d95-86d8-2ad8b5b5edbf tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] [instance: 802a1cc5-9787-47d9-87d5-e3fa912d7712] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:30.827967 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-08a60b49-f5c1-4d95-86d8-2ad8b5b5edbf tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b130aecc1794cfc9fe0a9a80d558bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2579dc4a344c2998e30915ea51b2ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:30.846952 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-08a60b49-f5c1-4d95-86d8-2ad8b5b5edbf tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] 10.222.0.50 "GET /compute/v2.1/servers/802a1cc5-9787-47d9-87d5-e3fa912d7712" status: 200 len: 1228 microversion: 2.1 time: 0.222231 Aug 31 16:14:30.849632 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2272/4744] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:30 2022] GET /compute/v2.1/servers/802a1cc5-9787-47d9-87d5-e3fa912d7712 => generated 1228 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:30.884903 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d04f63aa-341d-41f9-9af7-e42bb322964a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:30.885840 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d04f63aa-341d-41f9-9af7-e42bb322964a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ed9a700e-0de1-4ed3-993e-c0b6b293b02a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:30.899306 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d04f63aa-341d-41f9-9af7-e42bb322964a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:30.899798 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d04f63aa-341d-41f9-9af7-e42bb322964a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:30.900226 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d04f63aa-341d-41f9-9af7-e42bb322964a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:30.900950 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d04f63aa-341d-41f9-9af7-e42bb322964a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:30.901402 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d04f63aa-341d-41f9-9af7-e42bb322964a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:30.901826 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d04f63aa-341d-41f9-9af7-e42bb322964a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:30.959541 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-d04f63aa-341d-41f9-9af7-e42bb322964a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] HTTP exception thrown: Instance ed9a700e-0de1-4ed3-993e-c0b6b293b02a could not be found. Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d04f63aa-341d-41f9-9af7-e42bb322964a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Request method failure captured: Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a HTTP/1.1 Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4fcRMLera6TLJp6OFOd_B19-rdZe1qr5LTGcbsBroFhPQ8_L89JW9hpsNJPnNpQCXW4WKWxdTwWZTYVgRah_OPLrb5JBnrA64ZgN8VfXgRvkXORTfvSkZvZgjCL7371tDtPpfcPNp0NcyRfiYHxIldtsDdYZVFbQTa8WMsjzib7kZ0 Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 84f42648e1a343b9a5ab9b89c91bea0d Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersTestJSON-1527984429 Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_84f42648e1a343b9a5ab9b89c91bea0d", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServersTestJSON-1527984429 Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 84f42648e1a343b9a5ab9b89c91bea0d Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersTestJSON-1527984429 Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServersTestJSON-1527984429-project Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 3ebce87993504550914c2c3702eebb17 Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServersTestJSON-1527984429-project Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance ed9a700e-0de1-4ed3-993e-c0b6b293b02a could not be found. Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'ed9a700e-0de1-4ed3-993e-c0b6b293b02a'} Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed9a700e-0de1-4ed3-993e-c0b6b293b02a could not be found. Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed9a700e-0de1-4ed3-993e-c0b6b293b02a could not be found. Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:30.964299 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:30.969733 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:30.969733 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:30.969733 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:30.969733 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:14:30.969733 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:14:30.969733 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed9a700e-0de1-4ed3-993e-c0b6b293b02a could not be found. Aug 31 16:14:30.969733 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:30.972747 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d04f63aa-341d-41f9-9af7-e42bb322964a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Returning 404 to user: Instance ed9a700e-0de1-4ed3-993e-c0b6b293b02a could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:14:30.973918 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d04f63aa-341d-41f9-9af7-e42bb322964a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a" status: 404 len: 111 microversion: 2.1 time: 0.122366 Aug 31 16:14:30.975954 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2273/4745] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:30 2022] GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:14:30.994675 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8c7e6203-cecd-40e7-8132-a86a50ec9f9e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:30.995464 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8c7e6203-cecd-40e7-8132-a86a50ec9f9e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ed9a700e-0de1-4ed3-993e-c0b6b293b02a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:31.019210 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c7e6203-cecd-40e7-8132-a86a50ec9f9e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:31.024746 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c7e6203-cecd-40e7-8132-a86a50ec9f9e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:31.025452 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c7e6203-cecd-40e7-8132-a86a50ec9f9e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:31.026507 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c7e6203-cecd-40e7-8132-a86a50ec9f9e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:31.027126 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c7e6203-cecd-40e7-8132-a86a50ec9f9e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:31.027706 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c7e6203-cecd-40e7-8132-a86a50ec9f9e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:31.084496 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-8c7e6203-cecd-40e7-8132-a86a50ec9f9e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] HTTP exception thrown: Instance ed9a700e-0de1-4ed3-993e-c0b6b293b02a could not be found. Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8c7e6203-cecd-40e7-8132-a86a50ec9f9e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Request method failure captured: Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a HTTP/1.1 Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4fcRMLera6TLJp6OFOd_B19-rdZe1qr5LTGcbsBroFhPQ8_L89JW9hpsNJPnNpQCXW4WKWxdTwWZTYVgRah_OPLrb5JBnrA64ZgN8VfXgRvkXORTfvSkZvZgjCL7371tDtPpfcPNp0NcyRfiYHxIldtsDdYZVFbQTa8WMsjzib7kZ0 Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 84f42648e1a343b9a5ab9b89c91bea0d Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersTestJSON-1527984429 Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_84f42648e1a343b9a5ab9b89c91bea0d", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServersTestJSON-1527984429 Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 84f42648e1a343b9a5ab9b89c91bea0d Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersTestJSON-1527984429 Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServersTestJSON-1527984429-project Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 3ebce87993504550914c2c3702eebb17 Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServersTestJSON-1527984429-project Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance ed9a700e-0de1-4ed3-993e-c0b6b293b02a could not be found. Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'ed9a700e-0de1-4ed3-993e-c0b6b293b02a'} Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed9a700e-0de1-4ed3-993e-c0b6b293b02a could not be found. Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:14:31.088463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed9a700e-0de1-4ed3-993e-c0b6b293b02a could not be found. Aug 31 16:14:31.093418 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:31.093418 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:31.093418 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:31.093418 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:31.093418 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:31.093418 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:31.093418 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:14:31.093418 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:14:31.093418 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed9a700e-0de1-4ed3-993e-c0b6b293b02a could not be found. Aug 31 16:14:31.093418 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:31.107489 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8c7e6203-cecd-40e7-8132-a86a50ec9f9e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Returning 404 to user: Instance ed9a700e-0de1-4ed3-993e-c0b6b293b02a could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:14:31.109186 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8c7e6203-cecd-40e7-8132-a86a50ec9f9e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a" status: 404 len: 111 microversion: 2.1 time: 0.118800 Aug 31 16:14:31.113831 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2274/4746] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:14:30 2022] DELETE /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:14:31.127969 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8472d3fa-c5d7-4dc3-b9b9-4d496a259ee0 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:31.135825 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8472d3fa-c5d7-4dc3-b9b9-4d496a259ee0 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ed9a700e-0de1-4ed3-993e-c0b6b293b02a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:31.160739 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8472d3fa-c5d7-4dc3-b9b9-4d496a259ee0 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:31.162481 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8472d3fa-c5d7-4dc3-b9b9-4d496a259ee0 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:31.163118 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8472d3fa-c5d7-4dc3-b9b9-4d496a259ee0 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:31.164605 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8472d3fa-c5d7-4dc3-b9b9-4d496a259ee0 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:31.168408 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8472d3fa-c5d7-4dc3-b9b9-4d496a259ee0 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:31.169085 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8472d3fa-c5d7-4dc3-b9b9-4d496a259ee0 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:31.243981 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-8472d3fa-c5d7-4dc3-b9b9-4d496a259ee0 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] HTTP exception thrown: Instance ed9a700e-0de1-4ed3-993e-c0b6b293b02a could not be found. Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8472d3fa-c5d7-4dc3-b9b9-4d496a259ee0 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Request method failure captured: Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a HTTP/1.1 Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4fcRMLera6TLJp6OFOd_B19-rdZe1qr5LTGcbsBroFhPQ8_L89JW9hpsNJPnNpQCXW4WKWxdTwWZTYVgRah_OPLrb5JBnrA64ZgN8VfXgRvkXORTfvSkZvZgjCL7371tDtPpfcPNp0NcyRfiYHxIldtsDdYZVFbQTa8WMsjzib7kZ0 Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 84f42648e1a343b9a5ab9b89c91bea0d Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersTestJSON-1527984429 Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_84f42648e1a343b9a5ab9b89c91bea0d", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServersTestJSON-1527984429 Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 84f42648e1a343b9a5ab9b89c91bea0d Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersTestJSON-1527984429 Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServersTestJSON-1527984429-project Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 3ebce87993504550914c2c3702eebb17 Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServersTestJSON-1527984429-project Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance ed9a700e-0de1-4ed3-993e-c0b6b293b02a could not be found. Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'ed9a700e-0de1-4ed3-993e-c0b6b293b02a'} Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed9a700e-0de1-4ed3-993e-c0b6b293b02a could not be found. Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed9a700e-0de1-4ed3-993e-c0b6b293b02a could not be found. Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:31.245570 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:31.258743 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:31.258743 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:31.258743 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:31.258743 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:14:31.258743 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:14:31.258743 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed9a700e-0de1-4ed3-993e-c0b6b293b02a could not be found. Aug 31 16:14:31.258743 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:31.258743 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8472d3fa-c5d7-4dc3-b9b9-4d496a259ee0 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Returning 404 to user: Instance ed9a700e-0de1-4ed3-993e-c0b6b293b02a could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:14:31.258743 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8472d3fa-c5d7-4dc3-b9b9-4d496a259ee0 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a" status: 404 len: 111 microversion: 2.1 time: 0.130922 Aug 31 16:14:31.258743 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2275/4747] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:31 2022] GET /compute/v2.1/servers/ed9a700e-0de1-4ed3-993e-c0b6b293b02a => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:14:31.424347 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fed3c75c-519c-4feb-9161-756669f0f2d2 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Action: 'create', calling method: .version_select at 0x7fbb464f60d0>, body: {"keypair": {"name": "tempest-keypair-454120424", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPPesYUPK6xIrJfaE2zCCVjbwRkBsQNk8yB/omPXPzEt1mLgatkPHBvfM6Xg1iafVo7E7Gn+11hrh6bGOwEkZ3G3+V8AYZjVaxz40ahMJZ20eCVvitGBphz4+0ak7qdywQ=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:31.479647 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-fed3c75c-519c-4feb-9161-756669f0f2d2 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Getting quotas for project c3cdfdf921af4bc59c5c2fea1287b598. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:14:31.491589 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-fed3c75c-519c-4feb-9161-756669f0f2d2 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Getting quotas for user 6f95e357d68d4ad4a5eedbb08b41c5c1 and project c3cdfdf921af4bc59c5c2fea1287b598. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:14:31.554017 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fed3c75c-519c-4feb-9161-756669f0f2d2 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.297634 Aug 31 16:14:31.564456 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2276/4748] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 31 16:14:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:14:31.599584 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e8b7c450-5130-47a3-84e6-a7a38790aa8a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:31.600357 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e8b7c450-5130-47a3-84e6-a7a38790aa8a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 33170fbc-0d84-4284-9f70-dedb91f0d295] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:31.640558 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8b7c450-5130-47a3-84e6-a7a38790aa8a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:31.642215 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8b7c450-5130-47a3-84e6-a7a38790aa8a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:31.645869 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8b7c450-5130-47a3-84e6-a7a38790aa8a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:31.647584 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8b7c450-5130-47a3-84e6-a7a38790aa8a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:31.648442 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8b7c450-5130-47a3-84e6-a7a38790aa8a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:31.649355 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8b7c450-5130-47a3-84e6-a7a38790aa8a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:31.699956 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-e8b7c450-5130-47a3-84e6-a7a38790aa8a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] HTTP exception thrown: Instance 33170fbc-0d84-4284-9f70-dedb91f0d295 could not be found. Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e8b7c450-5130-47a3-84e6-a7a38790aa8a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Request method failure captured: Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/33170fbc-0d84-4284-9f70-dedb91f0d295 HTTP/1.1 Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4fcRMLera6TLJp6OFOd_B19-rdZe1qr5LTGcbsBroFhPQ8_L89JW9hpsNJPnNpQCXW4WKWxdTwWZTYVgRah_OPLrb5JBnrA64ZgN8VfXgRvkXORTfvSkZvZgjCL7371tDtPpfcPNp0NcyRfiYHxIldtsDdYZVFbQTa8WMsjzib7kZ0 Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 84f42648e1a343b9a5ab9b89c91bea0d Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersTestJSON-1527984429 Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_84f42648e1a343b9a5ab9b89c91bea0d", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServersTestJSON-1527984429 Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 84f42648e1a343b9a5ab9b89c91bea0d Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersTestJSON-1527984429 Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServersTestJSON-1527984429-project Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 3ebce87993504550914c2c3702eebb17 Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServersTestJSON-1527984429-project Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 33170fbc-0d84-4284-9f70-dedb91f0d295 could not be found. Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '33170fbc-0d84-4284-9f70-dedb91f0d295'} Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33170fbc-0d84-4284-9f70-dedb91f0d295 could not be found. Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:14:31.714953 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33170fbc-0d84-4284-9f70-dedb91f0d295 could not be found. Aug 31 16:14:31.723613 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:31.723613 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:31.723613 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:31.723613 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:31.723613 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:31.723613 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:31.723613 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:14:31.723613 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:14:31.723613 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33170fbc-0d84-4284-9f70-dedb91f0d295 could not be found. Aug 31 16:14:31.723613 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:31.730002 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e8b7c450-5130-47a3-84e6-a7a38790aa8a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Returning 404 to user: Instance 33170fbc-0d84-4284-9f70-dedb91f0d295 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:14:31.734354 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e8b7c450-5130-47a3-84e6-a7a38790aa8a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "DELETE /compute/v2.1/servers/33170fbc-0d84-4284-9f70-dedb91f0d295" status: 404 len: 111 microversion: 2.1 time: 0.154487 Aug 31 16:14:31.748300 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-97626428-aafa-466d-8176-ac43115aabed tempest-SecurityGroupRulesTestJSON-1183189146 tempest-SecurityGroupRulesTestJSON-1183189146-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/ed3229c4-f292-4f3f-ad68-a633cb3cf3d6" status: 202 len: 0 microversion: 2.1 time: 1.145479 Aug 31 16:14:31.749093 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2473/4749] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 31 16:14:30 2022] DELETE /compute/v2.1/os-security-groups/ed3229c4-f292-4f3f-ad68-a633cb3cf3d6 => generated 0 bytes in 1147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:14:31.754140 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2277/4750] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:14:31 2022] DELETE /compute/v2.1/servers/33170fbc-0d84-4284-9f70-dedb91f0d295 => generated 111 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:14:31.758434 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-11e9005a-208a-4e0e-abcd-9cfe69d725b0 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:31.759333 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-11e9005a-208a-4e0e-abcd-9cfe69d725b0 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] [instance: 55b6663a-93c3-4534-b563-bf54f861c111] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:31.771392 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-38eac554-219c-42ff-b1a5-8be04c1c0c11 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:31.775782 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-38eac554-219c-42ff-b1a5-8be04c1c0c11 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: e1cb02b7-1dd6-4c83-9008-e19525731e03] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:31.798560 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11e9005a-208a-4e0e-abcd-9cfe69d725b0 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:31.799491 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38eac554-219c-42ff-b1a5-8be04c1c0c11 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:31.800334 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38eac554-219c-42ff-b1a5-8be04c1c0c11 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:31.802025 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38eac554-219c-42ff-b1a5-8be04c1c0c11 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:31.803074 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38eac554-219c-42ff-b1a5-8be04c1c0c11 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:31.804475 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38eac554-219c-42ff-b1a5-8be04c1c0c11 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:31.804853 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11e9005a-208a-4e0e-abcd-9cfe69d725b0 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:31.806439 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38eac554-219c-42ff-b1a5-8be04c1c0c11 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:31.807089 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11e9005a-208a-4e0e-abcd-9cfe69d725b0 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:31.810822 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11e9005a-208a-4e0e-abcd-9cfe69d725b0 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:31.811952 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11e9005a-208a-4e0e-abcd-9cfe69d725b0 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:31.814263 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11e9005a-208a-4e0e-abcd-9cfe69d725b0 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:32.073412 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-38eac554-219c-42ff-b1a5-8be04c1c0c11 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:32.099404 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-38eac554-219c-42ff-b1a5-8be04c1c0c11 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03" status: 200 len: 1324 microversion: 2.1 time: 0.338103 Aug 31 16:14:32.100078 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2278/4751] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:31 2022] GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03 => generated 1324 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:32.127787 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-46a54582-beab-4afb-befa-8708ed48c506 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:32.128557 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-46a54582-beab-4afb-befa-8708ed48c506 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 33170fbc-0d84-4284-9f70-dedb91f0d295] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:32.153312 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-11e9005a-208a-4e0e-abcd-9cfe69d725b0 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:32.167028 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46a54582-beab-4afb-befa-8708ed48c506 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:32.167528 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46a54582-beab-4afb-befa-8708ed48c506 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:32.167970 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46a54582-beab-4afb-befa-8708ed48c506 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:32.168665 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46a54582-beab-4afb-befa-8708ed48c506 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:32.174876 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46a54582-beab-4afb-befa-8708ed48c506 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:32.175448 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46a54582-beab-4afb-befa-8708ed48c506 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:32.176211 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-11e9005a-208a-4e0e-abcd-9cfe69d725b0 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:32.184621 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-11e9005a-208a-4e0e-abcd-9cfe69d725b0 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:32.190999 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-11e9005a-208a-4e0e-abcd-9cfe69d725b0 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] 10.222.0.50 "GET /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111" status: 200 len: 1372 microversion: 2.47 time: 0.437013 Aug 31 16:14:32.192023 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2474/4752] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:14:31 2022] GET /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111 => generated 1372 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:14:32.208080 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fbda6d7b-68cb-4629-8b1a-65b5d9117176 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:32.215292 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fbda6d7b-68cb-4629-8b1a-65b5d9117176 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] [instance: 802a1cc5-9787-47d9-87d5-e3fa912d7712] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:32.242998 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-46a54582-beab-4afb-befa-8708ed48c506 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] HTTP exception thrown: Instance 33170fbc-0d84-4284-9f70-dedb91f0d295 could not be found. Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-46a54582-beab-4afb-befa-8708ed48c506 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Request method failure captured: Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/33170fbc-0d84-4284-9f70-dedb91f0d295 HTTP/1.1 Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4fcRMLera6TLJp6OFOd_B19-rdZe1qr5LTGcbsBroFhPQ8_L89JW9hpsNJPnNpQCXW4WKWxdTwWZTYVgRah_OPLrb5JBnrA64ZgN8VfXgRvkXORTfvSkZvZgjCL7371tDtPpfcPNp0NcyRfiYHxIldtsDdYZVFbQTa8WMsjzib7kZ0 Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 84f42648e1a343b9a5ab9b89c91bea0d Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersTestJSON-1527984429 Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_84f42648e1a343b9a5ab9b89c91bea0d", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServersTestJSON-1527984429 Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 84f42648e1a343b9a5ab9b89c91bea0d Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersTestJSON-1527984429 Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServersTestJSON-1527984429-project Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 3ebce87993504550914c2c3702eebb17 Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServersTestJSON-1527984429-project Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 33170fbc-0d84-4284-9f70-dedb91f0d295 could not be found. Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '33170fbc-0d84-4284-9f70-dedb91f0d295'} Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33170fbc-0d84-4284-9f70-dedb91f0d295 could not be found. Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33170fbc-0d84-4284-9f70-dedb91f0d295 could not be found. Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:32.251371 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:32.259076 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:32.259076 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:32.259076 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:32.259076 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:14:32.259076 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:14:32.259076 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33170fbc-0d84-4284-9f70-dedb91f0d295 could not be found. Aug 31 16:14:32.259076 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:32.262318 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fbda6d7b-68cb-4629-8b1a-65b5d9117176 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:32.266186 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-46a54582-beab-4afb-befa-8708ed48c506 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Returning 404 to user: Instance 33170fbc-0d84-4284-9f70-dedb91f0d295 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:14:32.268907 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fbda6d7b-68cb-4629-8b1a-65b5d9117176 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:32.269645 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fbda6d7b-68cb-4629-8b1a-65b5d9117176 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:32.271110 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-46a54582-beab-4afb-befa-8708ed48c506 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/33170fbc-0d84-4284-9f70-dedb91f0d295" status: 404 len: 111 microversion: 2.1 time: 0.160405 Aug 31 16:14:32.272555 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2279/4753] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:32 2022] GET /compute/v2.1/servers/33170fbc-0d84-4284-9f70-dedb91f0d295 => generated 111 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:14:32.282844 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fbda6d7b-68cb-4629-8b1a-65b5d9117176 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:32.285902 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fbda6d7b-68cb-4629-8b1a-65b5d9117176 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:32.286884 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fbda6d7b-68cb-4629-8b1a-65b5d9117176 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:32.290238 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6391caea-2689-4a2c-9670-33a7503b2142 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:32.290813 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6391caea-2689-4a2c-9670-33a7503b2142 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ddb49409-d019-4682-b5c4-2d9b09cf7f9d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:32.331606 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6391caea-2689-4a2c-9670-33a7503b2142 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:32.335489 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6391caea-2689-4a2c-9670-33a7503b2142 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:32.337651 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6391caea-2689-4a2c-9670-33a7503b2142 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:32.339718 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6391caea-2689-4a2c-9670-33a7503b2142 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:32.343446 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6391caea-2689-4a2c-9670-33a7503b2142 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:32.344060 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6391caea-2689-4a2c-9670-33a7503b2142 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:32.430884 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-6391caea-2689-4a2c-9670-33a7503b2142 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] HTTP exception thrown: Instance ddb49409-d019-4682-b5c4-2d9b09cf7f9d could not be found. Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6391caea-2689-4a2c-9670-33a7503b2142 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Request method failure captured: Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/ddb49409-d019-4682-b5c4-2d9b09cf7f9d HTTP/1.1 Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4fcRMLera6TLJp6OFOd_B19-rdZe1qr5LTGcbsBroFhPQ8_L89JW9hpsNJPnNpQCXW4WKWxdTwWZTYVgRah_OPLrb5JBnrA64ZgN8VfXgRvkXORTfvSkZvZgjCL7371tDtPpfcPNp0NcyRfiYHxIldtsDdYZVFbQTa8WMsjzib7kZ0 Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 84f42648e1a343b9a5ab9b89c91bea0d Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersTestJSON-1527984429 Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_84f42648e1a343b9a5ab9b89c91bea0d", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServersTestJSON-1527984429 Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 84f42648e1a343b9a5ab9b89c91bea0d Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersTestJSON-1527984429 Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServersTestJSON-1527984429-project Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 3ebce87993504550914c2c3702eebb17 Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServersTestJSON-1527984429-project Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance ddb49409-d019-4682-b5c4-2d9b09cf7f9d could not be found. Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'ddb49409-d019-4682-b5c4-2d9b09cf7f9d'} Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddb49409-d019-4682-b5c4-2d9b09cf7f9d could not be found. Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:14:32.433452 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddb49409-d019-4682-b5c4-2d9b09cf7f9d could not be found. Aug 31 16:14:32.443005 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:32.443005 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:32.443005 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:32.443005 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:32.443005 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:32.443005 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:32.443005 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:14:32.443005 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:14:32.443005 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddb49409-d019-4682-b5c4-2d9b09cf7f9d could not be found. Aug 31 16:14:32.443005 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:32.443005 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6391caea-2689-4a2c-9670-33a7503b2142 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Returning 404 to user: Instance ddb49409-d019-4682-b5c4-2d9b09cf7f9d could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:14:32.443005 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6391caea-2689-4a2c-9670-33a7503b2142 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ddb49409-d019-4682-b5c4-2d9b09cf7f9d" status: 404 len: 111 microversion: 2.1 time: 0.161428 Aug 31 16:14:32.446053 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2280/4754] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:14:32 2022] DELETE /compute/v2.1/servers/ddb49409-d019-4682-b5c4-2d9b09cf7f9d => generated 111 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:14:32.468664 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-00efe334-6314-4559-973b-3f4d80cc012f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:32.476241 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-00efe334-6314-4559-973b-3f4d80cc012f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: ddb49409-d019-4682-b5c4-2d9b09cf7f9d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:32.485413 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00efe334-6314-4559-973b-3f4d80cc012f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:32.486353 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00efe334-6314-4559-973b-3f4d80cc012f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:32.487117 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00efe334-6314-4559-973b-3f4d80cc012f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:32.488084 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00efe334-6314-4559-973b-3f4d80cc012f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:32.489188 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00efe334-6314-4559-973b-3f4d80cc012f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:32.489791 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00efe334-6314-4559-973b-3f4d80cc012f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:32.522916 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-00efe334-6314-4559-973b-3f4d80cc012f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] HTTP exception thrown: Instance ddb49409-d019-4682-b5c4-2d9b09cf7f9d could not be found. Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-00efe334-6314-4559-973b-3f4d80cc012f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Request method failure captured: Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/ddb49409-d019-4682-b5c4-2d9b09cf7f9d HTTP/1.1 Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4fcRMLera6TLJp6OFOd_B19-rdZe1qr5LTGcbsBroFhPQ8_L89JW9hpsNJPnNpQCXW4WKWxdTwWZTYVgRah_OPLrb5JBnrA64ZgN8VfXgRvkXORTfvSkZvZgjCL7371tDtPpfcPNp0NcyRfiYHxIldtsDdYZVFbQTa8WMsjzib7kZ0 Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 84f42648e1a343b9a5ab9b89c91bea0d Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersTestJSON-1527984429 Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_84f42648e1a343b9a5ab9b89c91bea0d", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServersTestJSON-1527984429 Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 84f42648e1a343b9a5ab9b89c91bea0d Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersTestJSON-1527984429 Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServersTestJSON-1527984429-project Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 3ebce87993504550914c2c3702eebb17 Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServersTestJSON-1527984429-project Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance ddb49409-d019-4682-b5c4-2d9b09cf7f9d could not be found. Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'ddb49409-d019-4682-b5c4-2d9b09cf7f9d'} Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddb49409-d019-4682-b5c4-2d9b09cf7f9d could not be found. Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddb49409-d019-4682-b5c4-2d9b09cf7f9d could not be found. Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:32.526032 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:32.532803 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:32.532803 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:32.532803 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:32.532803 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:14:32.532803 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:14:32.532803 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddb49409-d019-4682-b5c4-2d9b09cf7f9d could not be found. Aug 31 16:14:32.532803 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:32.533518 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-00efe334-6314-4559-973b-3f4d80cc012f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Returning 404 to user: Instance ddb49409-d019-4682-b5c4-2d9b09cf7f9d could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:14:32.545690 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-00efe334-6314-4559-973b-3f4d80cc012f tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/ddb49409-d019-4682-b5c4-2d9b09cf7f9d" status: 404 len: 111 microversion: 2.1 time: 0.085442 Aug 31 16:14:32.547869 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2281/4755] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:32 2022] GET /compute/v2.1/servers/ddb49409-d019-4682-b5c4-2d9b09cf7f9d => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:14:32.566219 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8f6827cf-f6ae-488a-bfeb-01170352d688 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:32.572844 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8f6827cf-f6ae-488a-bfeb-01170352d688 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: eb6e0169-ac40-4675-b6e9-2a3ea7b13f40] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:32.614287 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f6827cf-f6ae-488a-bfeb-01170352d688 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:32.614954 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f6827cf-f6ae-488a-bfeb-01170352d688 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:32.615403 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f6827cf-f6ae-488a-bfeb-01170352d688 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:32.616199 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f6827cf-f6ae-488a-bfeb-01170352d688 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:32.616594 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f6827cf-f6ae-488a-bfeb-01170352d688 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:32.617015 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f6827cf-f6ae-488a-bfeb-01170352d688 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:32.678656 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-8f6827cf-f6ae-488a-bfeb-01170352d688 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] HTTP exception thrown: Instance eb6e0169-ac40-4675-b6e9-2a3ea7b13f40 could not be found. Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8f6827cf-f6ae-488a-bfeb-01170352d688 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Request method failure captured: Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/eb6e0169-ac40-4675-b6e9-2a3ea7b13f40 HTTP/1.1 Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4fcRMLera6TLJp6OFOd_B19-rdZe1qr5LTGcbsBroFhPQ8_L89JW9hpsNJPnNpQCXW4WKWxdTwWZTYVgRah_OPLrb5JBnrA64ZgN8VfXgRvkXORTfvSkZvZgjCL7371tDtPpfcPNp0NcyRfiYHxIldtsDdYZVFbQTa8WMsjzib7kZ0 Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 84f42648e1a343b9a5ab9b89c91bea0d Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersTestJSON-1527984429 Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_84f42648e1a343b9a5ab9b89c91bea0d", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServersTestJSON-1527984429 Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 84f42648e1a343b9a5ab9b89c91bea0d Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersTestJSON-1527984429 Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServersTestJSON-1527984429-project Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 3ebce87993504550914c2c3702eebb17 Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServersTestJSON-1527984429-project Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance eb6e0169-ac40-4675-b6e9-2a3ea7b13f40 could not be found. Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'eb6e0169-ac40-4675-b6e9-2a3ea7b13f40'} Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb6e0169-ac40-4675-b6e9-2a3ea7b13f40 could not be found. Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:14:32.688450 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb6e0169-ac40-4675-b6e9-2a3ea7b13f40 could not be found. Aug 31 16:14:32.695859 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:32.695859 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:32.695859 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:32.695859 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:32.695859 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:32.695859 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:32.695859 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:14:32.695859 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:14:32.695859 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb6e0169-ac40-4675-b6e9-2a3ea7b13f40 could not be found. Aug 31 16:14:32.695859 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:32.698816 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8f6827cf-f6ae-488a-bfeb-01170352d688 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Returning 404 to user: Instance eb6e0169-ac40-4675-b6e9-2a3ea7b13f40 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:14:32.700732 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8f6827cf-f6ae-488a-bfeb-01170352d688 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "DELETE /compute/v2.1/servers/eb6e0169-ac40-4675-b6e9-2a3ea7b13f40" status: 404 len: 111 microversion: 2.1 time: 0.146937 Aug 31 16:14:32.702075 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2282/4756] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:14:32 2022] DELETE /compute/v2.1/servers/eb6e0169-ac40-4675-b6e9-2a3ea7b13f40 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:14:32.729098 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4cca8cf2-4293-4f48-b70d-7165042ac3d2 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:32.735618 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4cca8cf2-4293-4f48-b70d-7165042ac3d2 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: eb6e0169-ac40-4675-b6e9-2a3ea7b13f40] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:32.769034 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4cca8cf2-4293-4f48-b70d-7165042ac3d2 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:32.770363 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4cca8cf2-4293-4f48-b70d-7165042ac3d2 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:32.770823 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4cca8cf2-4293-4f48-b70d-7165042ac3d2 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:32.772055 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4cca8cf2-4293-4f48-b70d-7165042ac3d2 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:32.772874 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4cca8cf2-4293-4f48-b70d-7165042ac3d2 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:32.773674 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4cca8cf2-4293-4f48-b70d-7165042ac3d2 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:32.862313 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-4cca8cf2-4293-4f48-b70d-7165042ac3d2 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] HTTP exception thrown: Instance eb6e0169-ac40-4675-b6e9-2a3ea7b13f40 could not be found. Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4cca8cf2-4293-4f48-b70d-7165042ac3d2 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Request method failure captured: Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/eb6e0169-ac40-4675-b6e9-2a3ea7b13f40 HTTP/1.1 Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4fcRMLera6TLJp6OFOd_B19-rdZe1qr5LTGcbsBroFhPQ8_L89JW9hpsNJPnNpQCXW4WKWxdTwWZTYVgRah_OPLrb5JBnrA64ZgN8VfXgRvkXORTfvSkZvZgjCL7371tDtPpfcPNp0NcyRfiYHxIldtsDdYZVFbQTa8WMsjzib7kZ0 Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 84f42648e1a343b9a5ab9b89c91bea0d Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersTestJSON-1527984429 Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_84f42648e1a343b9a5ab9b89c91bea0d", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServersTestJSON-1527984429 Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 84f42648e1a343b9a5ab9b89c91bea0d Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersTestJSON-1527984429 Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServersTestJSON-1527984429-project Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 3ebce87993504550914c2c3702eebb17 Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServersTestJSON-1527984429-project Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance eb6e0169-ac40-4675-b6e9-2a3ea7b13f40 could not be found. Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'eb6e0169-ac40-4675-b6e9-2a3ea7b13f40'} Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb6e0169-ac40-4675-b6e9-2a3ea7b13f40 could not be found. Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb6e0169-ac40-4675-b6e9-2a3ea7b13f40 could not be found. Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:32.865013 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:32.872171 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:32.872171 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:32.872171 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:32.872171 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:14:32.872171 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:14:32.872171 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb6e0169-ac40-4675-b6e9-2a3ea7b13f40 could not be found. Aug 31 16:14:32.872171 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:32.882203 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4cca8cf2-4293-4f48-b70d-7165042ac3d2 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Returning 404 to user: Instance eb6e0169-ac40-4675-b6e9-2a3ea7b13f40 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:14:32.884523 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4cca8cf2-4293-4f48-b70d-7165042ac3d2 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/eb6e0169-ac40-4675-b6e9-2a3ea7b13f40" status: 404 len: 111 microversion: 2.1 time: 0.176011 Aug 31 16:14:32.893489 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2283/4757] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:32 2022] GET /compute/v2.1/servers/eb6e0169-ac40-4675-b6e9-2a3ea7b13f40 => generated 111 bytes in 186 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:14:32.926889 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-eb27335a-3683-4316-8bd9-e81c021d479e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:32.928510 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-eb27335a-3683-4316-8bd9-e81c021d479e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: adb50b8a-afc7-4d23-a44c-7d4d75c33ad3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:32.941835 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb27335a-3683-4316-8bd9-e81c021d479e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:32.943460 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb27335a-3683-4316-8bd9-e81c021d479e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:32.944238 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb27335a-3683-4316-8bd9-e81c021d479e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:32.945680 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb27335a-3683-4316-8bd9-e81c021d479e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:32.950559 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb27335a-3683-4316-8bd9-e81c021d479e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:32.954230 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb27335a-3683-4316-8bd9-e81c021d479e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:32.993718 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-eb27335a-3683-4316-8bd9-e81c021d479e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] HTTP exception thrown: Instance adb50b8a-afc7-4d23-a44c-7d4d75c33ad3 could not be found. Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-eb27335a-3683-4316-8bd9-e81c021d479e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Request method failure captured: Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/adb50b8a-afc7-4d23-a44c-7d4d75c33ad3 HTTP/1.1 Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4fcRMLera6TLJp6OFOd_B19-rdZe1qr5LTGcbsBroFhPQ8_L89JW9hpsNJPnNpQCXW4WKWxdTwWZTYVgRah_OPLrb5JBnrA64ZgN8VfXgRvkXORTfvSkZvZgjCL7371tDtPpfcPNp0NcyRfiYHxIldtsDdYZVFbQTa8WMsjzib7kZ0 Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 84f42648e1a343b9a5ab9b89c91bea0d Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersTestJSON-1527984429 Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_84f42648e1a343b9a5ab9b89c91bea0d", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServersTestJSON-1527984429 Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 84f42648e1a343b9a5ab9b89c91bea0d Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersTestJSON-1527984429 Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServersTestJSON-1527984429-project Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 3ebce87993504550914c2c3702eebb17 Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServersTestJSON-1527984429-project Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance adb50b8a-afc7-4d23-a44c-7d4d75c33ad3 could not be found. Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'adb50b8a-afc7-4d23-a44c-7d4d75c33ad3'} Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adb50b8a-afc7-4d23-a44c-7d4d75c33ad3 could not be found. Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:14:32.996342 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adb50b8a-afc7-4d23-a44c-7d4d75c33ad3 could not be found. Aug 31 16:14:33.008527 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:33.008527 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:33.008527 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:33.008527 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:33.008527 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:33.008527 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:33.008527 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:14:33.008527 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:14:33.008527 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adb50b8a-afc7-4d23-a44c-7d4d75c33ad3 could not be found. Aug 31 16:14:33.008527 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:33.023078 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-eb27335a-3683-4316-8bd9-e81c021d479e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Returning 404 to user: Instance adb50b8a-afc7-4d23-a44c-7d4d75c33ad3 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:14:33.024872 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-eb27335a-3683-4316-8bd9-e81c021d479e tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "DELETE /compute/v2.1/servers/adb50b8a-afc7-4d23-a44c-7d4d75c33ad3" status: 404 len: 111 microversion: 2.1 time: 0.127207 Aug 31 16:14:33.029443 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2284/4758] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:14:32 2022] DELETE /compute/v2.1/servers/adb50b8a-afc7-4d23-a44c-7d4d75c33ad3 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:14:33.052793 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-751005ab-7a6d-43f7-8710-a580a490430a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:33.054167 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-751005ab-7a6d-43f7-8710-a580a490430a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: adb50b8a-afc7-4d23-a44c-7d4d75c33ad3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:33.068068 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-751005ab-7a6d-43f7-8710-a580a490430a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:33.069077 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-751005ab-7a6d-43f7-8710-a580a490430a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:33.070006 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-751005ab-7a6d-43f7-8710-a580a490430a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:33.076152 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-751005ab-7a6d-43f7-8710-a580a490430a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:33.076752 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-751005ab-7a6d-43f7-8710-a580a490430a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:33.079845 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-751005ab-7a6d-43f7-8710-a580a490430a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:33.117681 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-751005ab-7a6d-43f7-8710-a580a490430a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] HTTP exception thrown: Instance adb50b8a-afc7-4d23-a44c-7d4d75c33ad3 could not be found. Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-751005ab-7a6d-43f7-8710-a580a490430a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Request method failure captured: Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/adb50b8a-afc7-4d23-a44c-7d4d75c33ad3 HTTP/1.1 Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4fcRMLera6TLJp6OFOd_B19-rdZe1qr5LTGcbsBroFhPQ8_L89JW9hpsNJPnNpQCXW4WKWxdTwWZTYVgRah_OPLrb5JBnrA64ZgN8VfXgRvkXORTfvSkZvZgjCL7371tDtPpfcPNp0NcyRfiYHxIldtsDdYZVFbQTa8WMsjzib7kZ0 Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 84f42648e1a343b9a5ab9b89c91bea0d Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersTestJSON-1527984429 Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_84f42648e1a343b9a5ab9b89c91bea0d", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServersTestJSON-1527984429 Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 84f42648e1a343b9a5ab9b89c91bea0d Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersTestJSON-1527984429 Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServersTestJSON-1527984429-project Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 3ebce87993504550914c2c3702eebb17 Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServersTestJSON-1527984429-project Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance adb50b8a-afc7-4d23-a44c-7d4d75c33ad3 could not be found. Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'adb50b8a-afc7-4d23-a44c-7d4d75c33ad3'} Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adb50b8a-afc7-4d23-a44c-7d4d75c33ad3 could not be found. Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adb50b8a-afc7-4d23-a44c-7d4d75c33ad3 could not be found. Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:33.119694 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:33.125051 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:33.125051 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:33.125051 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:33.125051 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:14:33.125051 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:14:33.125051 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adb50b8a-afc7-4d23-a44c-7d4d75c33ad3 could not be found. Aug 31 16:14:33.125051 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:33.127606 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-751005ab-7a6d-43f7-8710-a580a490430a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Returning 404 to user: Instance adb50b8a-afc7-4d23-a44c-7d4d75c33ad3 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:14:33.131960 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-751005ab-7a6d-43f7-8710-a580a490430a tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/adb50b8a-afc7-4d23-a44c-7d4d75c33ad3" status: 404 len: 111 microversion: 2.1 time: 0.099138 Aug 31 16:14:33.144688 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2285/4759] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:33 2022] GET /compute/v2.1/servers/adb50b8a-afc7-4d23-a44c-7d4d75c33ad3 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:14:33.153721 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5aac24a6-49f1-4968-b996-6b0bb093415c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:33.163725 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5aac24a6-49f1-4968-b996-6b0bb093415c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: e1cb02b7-1dd6-4c83-9008-e19525731e03] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:33.181727 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5aac24a6-49f1-4968-b996-6b0bb093415c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:33.182528 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5aac24a6-49f1-4968-b996-6b0bb093415c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:33.183318 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5aac24a6-49f1-4968-b996-6b0bb093415c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:33.184366 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5aac24a6-49f1-4968-b996-6b0bb093415c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:33.185051 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5aac24a6-49f1-4968-b996-6b0bb093415c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:33.185664 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5aac24a6-49f1-4968-b996-6b0bb093415c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:33.240314 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-fbda6d7b-68cb-4629-8b1a-65b5d9117176 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b130aecc1794cfc9fe0a9a80d558bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2579dc4a344c2998e30915ea51b2ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:33.304238 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fbda6d7b-68cb-4629-8b1a-65b5d9117176 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] 10.222.0.50 "GET /compute/v2.1/servers/802a1cc5-9787-47d9-87d5-e3fa912d7712" status: 200 len: 1224 microversion: 2.1 time: 1.106737 Aug 31 16:14:33.326065 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2475/4760] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:32 2022] GET /compute/v2.1/servers/802a1cc5-9787-47d9-87d5-e3fa912d7712 => generated 1224 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:33.339165 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a2383911-8e6c-4459-b284-9bddddc15b9c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:33.344801 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a2383911-8e6c-4459-b284-9bddddc15b9c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 30d31a1b-0872-4fd2-a9a7-06067b151a68] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:33.358344 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a2383911-8e6c-4459-b284-9bddddc15b9c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:33.359707 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a2383911-8e6c-4459-b284-9bddddc15b9c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:33.360298 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a2383911-8e6c-4459-b284-9bddddc15b9c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:33.361564 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a2383911-8e6c-4459-b284-9bddddc15b9c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:33.362284 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a2383911-8e6c-4459-b284-9bddddc15b9c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:33.362900 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a2383911-8e6c-4459-b284-9bddddc15b9c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:33.416816 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-a2383911-8e6c-4459-b284-9bddddc15b9c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] HTTP exception thrown: Instance 30d31a1b-0872-4fd2-a9a7-06067b151a68 could not be found. Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a2383911-8e6c-4459-b284-9bddddc15b9c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Request method failure captured: Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: request: DELETE /compute/v2.1/servers/30d31a1b-0872-4fd2-a9a7-06067b151a68 HTTP/1.1 Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4fcRMLera6TLJp6OFOd_B19-rdZe1qr5LTGcbsBroFhPQ8_L89JW9hpsNJPnNpQCXW4WKWxdTwWZTYVgRah_OPLrb5JBnrA64ZgN8VfXgRvkXORTfvSkZvZgjCL7371tDtPpfcPNp0NcyRfiYHxIldtsDdYZVFbQTa8WMsjzib7kZ0 Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 84f42648e1a343b9a5ab9b89c91bea0d Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServersTestJSON-1527984429 Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_84f42648e1a343b9a5ab9b89c91bea0d", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServersTestJSON-1527984429 Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 84f42648e1a343b9a5ab9b89c91bea0d Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServersTestJSON-1527984429 Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServersTestJSON-1527984429-project Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 3ebce87993504550914c2c3702eebb17 Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServersTestJSON-1527984429-project Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 30d31a1b-0872-4fd2-a9a7-06067b151a68 could not be found. Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '30d31a1b-0872-4fd2-a9a7-06067b151a68'} Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30d31a1b-0872-4fd2-a9a7-06067b151a68 could not be found. Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:14:33.419464 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30d31a1b-0872-4fd2-a9a7-06067b151a68 could not be found. Aug 31 16:14:33.424458 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:14:33.424458 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:33.424458 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:14:33.424458 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:33.424458 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:33.424458 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:33.424458 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:14:33.424458 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:14:33.424458 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30d31a1b-0872-4fd2-a9a7-06067b151a68 could not be found. Aug 31 16:14:33.424458 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:14:33.427017 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a2383911-8e6c-4459-b284-9bddddc15b9c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Returning 404 to user: Instance 30d31a1b-0872-4fd2-a9a7-06067b151a68 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:14:33.428126 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a2383911-8e6c-4459-b284-9bddddc15b9c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "DELETE /compute/v2.1/servers/30d31a1b-0872-4fd2-a9a7-06067b151a68" status: 404 len: 111 microversion: 2.1 time: 0.100703 Aug 31 16:14:33.433483 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2476/4761] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:14:33 2022] DELETE /compute/v2.1/servers/30d31a1b-0872-4fd2-a9a7-06067b151a68 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:14:33.439699 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2ed469a3-39dd-466e-b98b-582f3d5da35f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:33.440602 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2ed469a3-39dd-466e-b98b-582f3d5da35f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] [instance: 55b6663a-93c3-4534-b563-bf54f861c111] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:33.461766 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2ed469a3-39dd-466e-b98b-582f3d5da35f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:33.462648 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2ed469a3-39dd-466e-b98b-582f3d5da35f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:33.463484 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2ed469a3-39dd-466e-b98b-582f3d5da35f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:33.478012 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2ed469a3-39dd-466e-b98b-582f3d5da35f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:33.478643 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2ed469a3-39dd-466e-b98b-582f3d5da35f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:33.479103 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2ed469a3-39dd-466e-b98b-582f3d5da35f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:34.594720 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5aac24a6-49f1-4968-b996-6b0bb093415c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:34.604378 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5aac24a6-49f1-4968-b996-6b0bb093415c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03" status: 200 len: 1324 microversion: 2.1 time: 1.458240 Aug 31 16:14:34.609506 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2286/4762] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:33 2022] GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03 => generated 1324 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:34.620469 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9e94cbce-4ba4-43de-a52f-f8474be3e55c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:34.623738 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9e94cbce-4ba4-43de-a52f-f8474be3e55c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 30d31a1b-0872-4fd2-a9a7-06067b151a68] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:34.638905 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e94cbce-4ba4-43de-a52f-f8474be3e55c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:34.643029 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e94cbce-4ba4-43de-a52f-f8474be3e55c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:34.643915 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e94cbce-4ba4-43de-a52f-f8474be3e55c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:34.644852 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e94cbce-4ba4-43de-a52f-f8474be3e55c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:34.646840 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e94cbce-4ba4-43de-a52f-f8474be3e55c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:34.647483 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e94cbce-4ba4-43de-a52f-f8474be3e55c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:34.682058 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-9e94cbce-4ba4-43de-a52f-f8474be3e55c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] HTTP exception thrown: Instance 30d31a1b-0872-4fd2-a9a7-06067b151a68 could not be found. Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9e94cbce-4ba4-43de-a52f-f8474be3e55c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Request method failure captured: Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/30d31a1b-0872-4fd2-a9a7-06067b151a68 HTTP/1.1 Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4fcRMLera6TLJp6OFOd_B19-rdZe1qr5LTGcbsBroFhPQ8_L89JW9hpsNJPnNpQCXW4WKWxdTwWZTYVgRah_OPLrb5JBnrA64ZgN8VfXgRvkXORTfvSkZvZgjCL7371tDtPpfcPNp0NcyRfiYHxIldtsDdYZVFbQTa8WMsjzib7kZ0 Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 84f42648e1a343b9a5ab9b89c91bea0d Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersTestJSON-1527984429 Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_84f42648e1a343b9a5ab9b89c91bea0d", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServersTestJSON-1527984429 Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 84f42648e1a343b9a5ab9b89c91bea0d Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersTestJSON-1527984429 Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServersTestJSON-1527984429-project Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 3ebce87993504550914c2c3702eebb17 Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServersTestJSON-1527984429-project Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 30d31a1b-0872-4fd2-a9a7-06067b151a68 could not be found. Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '30d31a1b-0872-4fd2-a9a7-06067b151a68'} Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30d31a1b-0872-4fd2-a9a7-06067b151a68 could not be found. Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30d31a1b-0872-4fd2-a9a7-06067b151a68 could not be found. Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:34.684011 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:34.689800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:34.689800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:34.689800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:34.689800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:14:34.689800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:14:34.689800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30d31a1b-0872-4fd2-a9a7-06067b151a68 could not be found. Aug 31 16:14:34.689800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:34.695303 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9e94cbce-4ba4-43de-a52f-f8474be3e55c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Returning 404 to user: Instance 30d31a1b-0872-4fd2-a9a7-06067b151a68 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:14:34.698335 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9e94cbce-4ba4-43de-a52f-f8474be3e55c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/30d31a1b-0872-4fd2-a9a7-06067b151a68" status: 404 len: 111 microversion: 2.1 time: 0.085577 Aug 31 16:14:34.699188 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2287/4763] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:34 2022] GET /compute/v2.1/servers/30d31a1b-0872-4fd2-a9a7-06067b151a68 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:14:34.706044 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5431a618-1fd2-46ad-afc9-6a67ba633441 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:34.706826 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5431a618-1fd2-46ad-afc9-6a67ba633441 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] [instance: 802a1cc5-9787-47d9-87d5-e3fa912d7712] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:34.719126 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5431a618-1fd2-46ad-afc9-6a67ba633441 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:34.719624 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5431a618-1fd2-46ad-afc9-6a67ba633441 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:34.724152 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5431a618-1fd2-46ad-afc9-6a67ba633441 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:34.725088 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5431a618-1fd2-46ad-afc9-6a67ba633441 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:34.725574 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5431a618-1fd2-46ad-afc9-6a67ba633441 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:34.726167 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5431a618-1fd2-46ad-afc9-6a67ba633441 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:34.781375 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:14:34.831706 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2ed469a3-39dd-466e-b98b-582f3d5da35f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:34.847344 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2ed469a3-39dd-466e-b98b-582f3d5da35f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:34.850989 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2ed469a3-39dd-466e-b98b-582f3d5da35f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:34.866729 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2ed469a3-39dd-466e-b98b-582f3d5da35f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] 10.222.0.50 "GET /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111" status: 200 len: 1357 microversion: 2.47 time: 1.431143 Aug 31 16:14:34.898394 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2477/4764] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:14:33 2022] GET /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111 => generated 1357 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:14:34.905374 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2abe3dcb-703e-48af-9c58-82ea6fac4c98 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:34.906253 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2abe3dcb-703e-48af-9c58-82ea6fac4c98 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 022989f7-8dec-4596-a677-badd5e10336a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:34.920742 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2abe3dcb-703e-48af-9c58-82ea6fac4c98 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:34.921871 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2abe3dcb-703e-48af-9c58-82ea6fac4c98 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:34.923769 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2abe3dcb-703e-48af-9c58-82ea6fac4c98 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:34.924804 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2abe3dcb-703e-48af-9c58-82ea6fac4c98 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:34.925532 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2abe3dcb-703e-48af-9c58-82ea6fac4c98 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:34.926200 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2abe3dcb-703e-48af-9c58-82ea6fac4c98 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:34.948288 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-2abe3dcb-703e-48af-9c58-82ea6fac4c98 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] HTTP exception thrown: Instance 022989f7-8dec-4596-a677-badd5e10336a could not be found. Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2abe3dcb-703e-48af-9c58-82ea6fac4c98 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Request method failure captured: Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: request: DELETE /compute/v2.1/servers/022989f7-8dec-4596-a677-badd5e10336a HTTP/1.1 Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4fcRMLera6TLJp6OFOd_B19-rdZe1qr5LTGcbsBroFhPQ8_L89JW9hpsNJPnNpQCXW4WKWxdTwWZTYVgRah_OPLrb5JBnrA64ZgN8VfXgRvkXORTfvSkZvZgjCL7371tDtPpfcPNp0NcyRfiYHxIldtsDdYZVFbQTa8WMsjzib7kZ0 Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 84f42648e1a343b9a5ab9b89c91bea0d Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServersTestJSON-1527984429 Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_84f42648e1a343b9a5ab9b89c91bea0d", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServersTestJSON-1527984429 Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 84f42648e1a343b9a5ab9b89c91bea0d Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServersTestJSON-1527984429 Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServersTestJSON-1527984429-project Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 3ebce87993504550914c2c3702eebb17 Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServersTestJSON-1527984429-project Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 022989f7-8dec-4596-a677-badd5e10336a could not be found. Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '022989f7-8dec-4596-a677-badd5e10336a'} Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 022989f7-8dec-4596-a677-badd5e10336a could not be found. Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:14:34.950896 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 022989f7-8dec-4596-a677-badd5e10336a could not be found. Aug 31 16:14:34.956091 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:14:34.956091 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:34.956091 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:14:34.956091 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:34.956091 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:34.956091 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:34.956091 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:14:34.956091 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:14:34.956091 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 022989f7-8dec-4596-a677-badd5e10336a could not be found. Aug 31 16:14:34.956091 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:14:34.956091 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2abe3dcb-703e-48af-9c58-82ea6fac4c98 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Returning 404 to user: Instance 022989f7-8dec-4596-a677-badd5e10336a could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:14:34.956091 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2abe3dcb-703e-48af-9c58-82ea6fac4c98 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "DELETE /compute/v2.1/servers/022989f7-8dec-4596-a677-badd5e10336a" status: 404 len: 111 microversion: 2.1 time: 0.055874 Aug 31 16:14:34.971203 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2478/4765] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:14:34 2022] DELETE /compute/v2.1/servers/022989f7-8dec-4596-a677-badd5e10336a => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:14:34.980314 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5431a618-1fd2-46ad-afc9-6a67ba633441 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b130aecc1794cfc9fe0a9a80d558bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2579dc4a344c2998e30915ea51b2ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:35.003769 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-145c0659-6a4b-4d94-8ed0-fef468058054 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:35.004187 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5431a618-1fd2-46ad-afc9-6a67ba633441 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] 10.222.0.50 "GET /compute/v2.1/servers/802a1cc5-9787-47d9-87d5-e3fa912d7712" status: 200 len: 1286 microversion: 2.1 time: 0.302016 Aug 31 16:14:35.006061 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2288/4766] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:34 2022] GET /compute/v2.1/servers/802a1cc5-9787-47d9-87d5-e3fa912d7712 => generated 1286 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:35.017503 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-145c0659-6a4b-4d94-8ed0-fef468058054 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:35.020548 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e800e5e8-e1bf-495c-8f70-5c3a7b1204c3 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:35.022896 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e800e5e8-e1bf-495c-8f70-5c3a7b1204c3 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 022989f7-8dec-4596-a677-badd5e10336a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:35.024202 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-145c0659-6a4b-4d94-8ed0-fef468058054 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Searching by: {'deleted': False, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1'} {{(pid=128864) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:14:35.059106 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-145c0659-6a4b-4d94-8ed0-fef468058054 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:35.060603 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e800e5e8-e1bf-495c-8f70-5c3a7b1204c3 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:35.067204 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-145c0659-6a4b-4d94-8ed0-fef468058054 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:35.071340 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e800e5e8-e1bf-495c-8f70-5c3a7b1204c3 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:35.072939 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-145c0659-6a4b-4d94-8ed0-fef468058054 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:35.080498 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e800e5e8-e1bf-495c-8f70-5c3a7b1204c3 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:35.081820 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-145c0659-6a4b-4d94-8ed0-fef468058054 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:35.082911 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e800e5e8-e1bf-495c-8f70-5c3a7b1204c3 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:35.083989 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-145c0659-6a4b-4d94-8ed0-fef468058054 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:35.094921 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e800e5e8-e1bf-495c-8f70-5c3a7b1204c3 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:35.096501 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e800e5e8-e1bf-495c-8f70-5c3a7b1204c3 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:35.097102 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-145c0659-6a4b-4d94-8ed0-fef468058054 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:35.199118 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-e800e5e8-e1bf-495c-8f70-5c3a7b1204c3 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] HTTP exception thrown: Instance 022989f7-8dec-4596-a677-badd5e10336a could not be found. Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e800e5e8-e1bf-495c-8f70-5c3a7b1204c3 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Request method failure captured: Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/022989f7-8dec-4596-a677-badd5e10336a HTTP/1.1 Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4fcRMLera6TLJp6OFOd_B19-rdZe1qr5LTGcbsBroFhPQ8_L89JW9hpsNJPnNpQCXW4WKWxdTwWZTYVgRah_OPLrb5JBnrA64ZgN8VfXgRvkXORTfvSkZvZgjCL7371tDtPpfcPNp0NcyRfiYHxIldtsDdYZVFbQTa8WMsjzib7kZ0 Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 84f42648e1a343b9a5ab9b89c91bea0d Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersTestJSON-1527984429 Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_84f42648e1a343b9a5ab9b89c91bea0d", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServersTestJSON-1527984429 Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 84f42648e1a343b9a5ab9b89c91bea0d Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersTestJSON-1527984429 Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServersTestJSON-1527984429-project Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 3ebce87993504550914c2c3702eebb17 Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServersTestJSON-1527984429-project Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 022989f7-8dec-4596-a677-badd5e10336a could not be found. Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '022989f7-8dec-4596-a677-badd5e10336a'} Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 022989f7-8dec-4596-a677-badd5e10336a could not be found. Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 022989f7-8dec-4596-a677-badd5e10336a could not be found. Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:35.217277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:35.225278 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:35.225278 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:35.225278 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:35.225278 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:14:35.225278 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:14:35.225278 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 022989f7-8dec-4596-a677-badd5e10336a could not be found. Aug 31 16:14:35.225278 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:35.225278 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e800e5e8-e1bf-495c-8f70-5c3a7b1204c3 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Returning 404 to user: Instance 022989f7-8dec-4596-a677-badd5e10336a could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:14:35.229520 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e800e5e8-e1bf-495c-8f70-5c3a7b1204c3 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/022989f7-8dec-4596-a677-badd5e10336a" status: 404 len: 111 microversion: 2.1 time: 0.216833 Aug 31 16:14:35.232212 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2289/4767] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:35 2022] GET /compute/v2.1/servers/022989f7-8dec-4596-a677-badd5e10336a => generated 111 bytes in 225 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:14:35.248406 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f55f0952-85f2-4dc3-8c23-1461fd0f8c5c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:35.254688 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f55f0952-85f2-4dc3-8c23-1461fd0f8c5c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 2c93da9d-54d5-408f-85d4-768f397294b6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:35.266452 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f55f0952-85f2-4dc3-8c23-1461fd0f8c5c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:35.267313 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f55f0952-85f2-4dc3-8c23-1461fd0f8c5c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:35.269189 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f55f0952-85f2-4dc3-8c23-1461fd0f8c5c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:35.282695 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f55f0952-85f2-4dc3-8c23-1461fd0f8c5c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:35.283470 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f55f0952-85f2-4dc3-8c23-1461fd0f8c5c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:35.283955 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f55f0952-85f2-4dc3-8c23-1461fd0f8c5c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:35.321149 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f55f0952-85f2-4dc3-8c23-1461fd0f8c5c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 2c93da9d-54d5-408f-85d4-768f397294b6] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:14:35.415504 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.multi_cell_list [None req-145c0659-6a4b-4d94-8ed0-fef468058054 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128864) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:14:35.494001 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f55f0952-85f2-4dc3-8c23-1461fd0f8c5c tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "DELETE /compute/v2.1/servers/2c93da9d-54d5-408f-85d4-768f397294b6" status: 204 len: 0 microversion: 2.1 time: 0.253063 Aug 31 16:14:35.496133 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2290/4768] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:14:35 2022] DELETE /compute/v2.1/servers/2c93da9d-54d5-408f-85d4-768f397294b6 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:14:35.511922 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ba3e9e6f-7181-47f3-8e92-bab0a1888621 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1801505343", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ae90d5cd-3421-4e4a-9434-10c5079cf68b"}], "security_groups": [{"name": "tempest-securitygroup--1410926753"}], "key_name": "tempest-keypair-454120424", "user_data": "}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:35.557134 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-145c0659-6a4b-4d94-8ed0-fef468058054 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:35.575568 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-145c0659-6a4b-4d94-8ed0-fef468058054 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:35.578032 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-145c0659-6a4b-4d94-8ed0-fef468058054 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:35.581599 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-145c0659-6a4b-4d94-8ed0-fef468058054 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:35.641378 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-145c0659-6a4b-4d94-8ed0-fef468058054 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:35.643248 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-145c0659-6a4b-4d94-8ed0-fef468058054 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:35.732378 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-145c0659-6a4b-4d94-8ed0-fef468058054 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] 10.222.0.50 "GET /compute/v2.1/servers/detail" status: 200 len: 2707 microversion: 2.47 time: 0.758558 Aug 31 16:14:35.733506 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2479/4769] 10.222.0.50 () {60 vars in 1187 bytes} [Wed Aug 31 16:14:34 2022] GET /compute/v2.1/servers/detail => generated 2707 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:14:35.776666 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5e1d02ea-1d81-467a-9d72-02287e04cc35 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:35.782551 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5e1d02ea-1d81-467a-9d72-02287e04cc35 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 2c93da9d-54d5-408f-85d4-768f397294b6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:35.799765 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e1d02ea-1d81-467a-9d72-02287e04cc35 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:35.800261 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e1d02ea-1d81-467a-9d72-02287e04cc35 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:35.800693 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e1d02ea-1d81-467a-9d72-02287e04cc35 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:35.801439 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e1d02ea-1d81-467a-9d72-02287e04cc35 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:35.802050 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e1d02ea-1d81-467a-9d72-02287e04cc35 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:35.802509 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e1d02ea-1d81-467a-9d72-02287e04cc35 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:36.042043 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-ba3e9e6f-7181-47f3-8e92-bab0a1888621 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] validate_networks() for [('ae90d5cd-3421-4e4a-9434-10c5079cf68b', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:14:36.670397 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5e1d02ea-1d81-467a-9d72-02287e04cc35 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:36.684196 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5e1d02ea-1d81-467a-9d72-02287e04cc35 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/2c93da9d-54d5-408f-85d4-768f397294b6" status: 200 len: 1481 microversion: 2.1 time: 0.933882 Aug 31 16:14:36.686560 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2480/4770] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:35 2022] GET /compute/v2.1/servers/2c93da9d-54d5-408f-85d4-768f397294b6 => generated 1481 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:36.693627 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2896b741-44b8-4641-b4a1-db628f9ae507 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:36.697730 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2896b741-44b8-4641-b4a1-db628f9ae507 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: e1cb02b7-1dd6-4c83-9008-e19525731e03] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:36.715437 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2896b741-44b8-4641-b4a1-db628f9ae507 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:36.717362 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2896b741-44b8-4641-b4a1-db628f9ae507 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:36.720365 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2896b741-44b8-4641-b4a1-db628f9ae507 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:36.722394 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2896b741-44b8-4641-b4a1-db628f9ae507 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:36.723445 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2896b741-44b8-4641-b4a1-db628f9ae507 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:36.725455 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2896b741-44b8-4641-b4a1-db628f9ae507 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:37.487272 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2896b741-44b8-4641-b4a1-db628f9ae507 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:37.499297 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2896b741-44b8-4641-b4a1-db628f9ae507 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03" status: 200 len: 1391 microversion: 2.1 time: 0.811998 Aug 31 16:14:37.511230 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2481/4771] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:36 2022] GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03 => generated 1391 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:37.520719 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-cd2cf2d8-84dc-4848-89e4-2da7086a08f3 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:37.521732 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-cd2cf2d8-84dc-4848-89e4-2da7086a08f3 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] [instance: 55b6663a-93c3-4534-b563-bf54f861c111] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:37.529137 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cd2cf2d8-84dc-4848-89e4-2da7086a08f3 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:37.529878 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cd2cf2d8-84dc-4848-89e4-2da7086a08f3 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:37.530555 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cd2cf2d8-84dc-4848-89e4-2da7086a08f3 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:37.531706 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cd2cf2d8-84dc-4848-89e4-2da7086a08f3 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:37.532482 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cd2cf2d8-84dc-4848-89e4-2da7086a08f3 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:37.533158 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cd2cf2d8-84dc-4848-89e4-2da7086a08f3 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:37.576404 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-cd2cf2d8-84dc-4848-89e4-2da7086a08f3 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] [instance: 55b6663a-93c3-4534-b563-bf54f861c111] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:14:37.752827 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-cd2cf2d8-84dc-4848-89e4-2da7086a08f3 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] 10.222.0.50 "DELETE /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111" status: 204 len: 0 microversion: 2.47 time: 0.239518 Aug 31 16:14:37.758900 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2482/4772] 10.222.0.50 () {60 vars in 1280 bytes} [Wed Aug 31 16:14:37 2022] DELETE /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 16:14:37.783877 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d4b21849-7a0f-41e3-908f-ca0786e23b41 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:37.787269 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d4b21849-7a0f-41e3-908f-ca0786e23b41 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] [instance: 802a1cc5-9787-47d9-87d5-e3fa912d7712] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:37.828022 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d4b21849-7a0f-41e3-908f-ca0786e23b41 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:37.829299 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d4b21849-7a0f-41e3-908f-ca0786e23b41 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:37.830179 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d4b21849-7a0f-41e3-908f-ca0786e23b41 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:37.831318 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d4b21849-7a0f-41e3-908f-ca0786e23b41 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:37.832131 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d4b21849-7a0f-41e3-908f-ca0786e23b41 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:37.833398 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d4b21849-7a0f-41e3-908f-ca0786e23b41 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:37.890774 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:14:37.898067 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:14:38.121941 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ba3e9e6f-7181-47f3-8e92-bab0a1888621 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:14:38.122752 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ba3e9e6f-7181-47f3-8e92-bab0a1888621 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:14:38.123793 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ba3e9e6f-7181-47f3-8e92-bab0a1888621 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:14:38.125589 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ba3e9e6f-7181-47f3-8e92-bab0a1888621 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:14:38.126322 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ba3e9e6f-7181-47f3-8e92-bab0a1888621 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:14:38.129713 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d4b21849-7a0f-41e3-908f-ca0786e23b41 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b130aecc1794cfc9fe0a9a80d558bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2579dc4a344c2998e30915ea51b2ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:38.147655 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d4b21849-7a0f-41e3-908f-ca0786e23b41 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] 10.222.0.50 "GET /compute/v2.1/servers/802a1cc5-9787-47d9-87d5-e3fa912d7712" status: 200 len: 1286 microversion: 2.1 time: 0.386171 Aug 31 16:14:38.148325 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba3e9e6f-7181-47f3-8e92-bab0a1888621 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:38.149412 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2483/4773] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:37 2022] GET /compute/v2.1/servers/802a1cc5-9787-47d9-87d5-e3fa912d7712 => generated 1286 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:38.157256 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d499ef2e-61c3-40f6-80ad-eecbb42e4568 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:38.158512 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d499ef2e-61c3-40f6-80ad-eecbb42e4568 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 2c93da9d-54d5-408f-85d4-768f397294b6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:38.163642 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba3e9e6f-7181-47f3-8e92-bab0a1888621 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:38.173839 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba3e9e6f-7181-47f3-8e92-bab0a1888621 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:38.177682 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba3e9e6f-7181-47f3-8e92-bab0a1888621 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:38.178829 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba3e9e6f-7181-47f3-8e92-bab0a1888621 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:38.179537 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba3e9e6f-7181-47f3-8e92-bab0a1888621 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:38.185366 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d499ef2e-61c3-40f6-80ad-eecbb42e4568 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:38.193639 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d499ef2e-61c3-40f6-80ad-eecbb42e4568 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:38.194652 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d499ef2e-61c3-40f6-80ad-eecbb42e4568 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:38.196147 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d499ef2e-61c3-40f6-80ad-eecbb42e4568 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:38.197416 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d499ef2e-61c3-40f6-80ad-eecbb42e4568 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:38.198308 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d499ef2e-61c3-40f6-80ad-eecbb42e4568 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:38.207035 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-ba3e9e6f-7181-47f3-8e92-bab0a1888621 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Getting quotas for project c3cdfdf921af4bc59c5c2fea1287b598. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:14:38.227933 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-ba3e9e6f-7181-47f3-8e92-bab0a1888621 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Getting quotas for user 6f95e357d68d4ad4a5eedbb08b41c5c1 and project c3cdfdf921af4bc59c5c2fea1287b598. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:14:38.234009 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:14:38.258332 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ba3e9e6f-7181-47f3-8e92-bab0a1888621 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:14:38.260880 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ba3e9e6f-7181-47f3-8e92-bab0a1888621 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:14:38.352754 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ba3e9e6f-7181-47f3-8e92-bab0a1888621 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.854718 Aug 31 16:14:38.353766 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2291/4774] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:14:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 2857 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:14:38.366453 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2b2b9568-b209-4ded-930b-0a69bb3a9f1f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:38.366890 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2b2b9568-b209-4ded-930b-0a69bb3a9f1f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] [instance: 55b6663a-93c3-4534-b563-bf54f861c111] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:38.390215 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2b2b9568-b209-4ded-930b-0a69bb3a9f1f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:38.390984 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2b2b9568-b209-4ded-930b-0a69bb3a9f1f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:38.391610 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2b2b9568-b209-4ded-930b-0a69bb3a9f1f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:38.392553 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2b2b9568-b209-4ded-930b-0a69bb3a9f1f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:38.393167 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2b2b9568-b209-4ded-930b-0a69bb3a9f1f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:38.393763 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2b2b9568-b209-4ded-930b-0a69bb3a9f1f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:39.276494 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d499ef2e-61c3-40f6-80ad-eecbb42e4568 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ebce87993504550914c2c3702eebb17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f42648e1a343b9a5ab9b89c91bea0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:39.289051 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d499ef2e-61c3-40f6-80ad-eecbb42e4568 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/2c93da9d-54d5-408f-85d4-768f397294b6" status: 200 len: 1439 microversion: 2.1 time: 1.137433 Aug 31 16:14:39.290554 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2484/4775] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:38 2022] GET /compute/v2.1/servers/2c93da9d-54d5-408f-85d4-768f397294b6 => generated 1439 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:39.315139 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-36f945ae-385f-4ee0-b2d7-9cd131bb5a32 req-f4d2f5a7-d602-4c12-93fd-0530d00bd508 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c93da9d-54d5-408f-85d4-768f397294b6", "name": "network-vif-deleted", "tag": "7c6332dc-5d4c-478e-93c8-9fa795380cdd"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:39.332438 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-36f945ae-385f-4ee0-b2d7-9cd131bb5a32 req-f4d2f5a7-d602-4c12-93fd-0530d00bd508 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:39.333437 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-36f945ae-385f-4ee0-b2d7-9cd131bb5a32 req-f4d2f5a7-d602-4c12-93fd-0530d00bd508 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:39.334339 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-36f945ae-385f-4ee0-b2d7-9cd131bb5a32 req-f4d2f5a7-d602-4c12-93fd-0530d00bd508 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:39.350716 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-36f945ae-385f-4ee0-b2d7-9cd131bb5a32 req-f4d2f5a7-d602-4c12-93fd-0530d00bd508 service nova] Creating event network-vif-deleted:7c6332dc-5d4c-478e-93c8-9fa795380cdd for instance 2c93da9d-54d5-408f-85d4-768f397294b6 on n-h2-833090-16 Aug 31 16:14:39.357877 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-36f945ae-385f-4ee0-b2d7-9cd131bb5a32 req-f4d2f5a7-d602-4c12-93fd-0530d00bd508 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064948 Aug 31 16:14:39.365361 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2485/4776] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:14:39.374528 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-094672a1-9b39-48d1-9434-f3958f94b4bd tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:39.378482 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-094672a1-9b39-48d1-9434-f3958f94b4bd tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:39.490726 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2b2b9568-b209-4ded-930b-0a69bb3a9f1f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:39.532475 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2b2b9568-b209-4ded-930b-0a69bb3a9f1f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:39.537032 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2b2b9568-b209-4ded-930b-0a69bb3a9f1f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:39.539766 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2b2b9568-b209-4ded-930b-0a69bb3a9f1f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] 10.222.0.50 "GET /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111" status: 200 len: 1363 microversion: 2.47 time: 1.181686 Aug 31 16:14:39.541220 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2292/4777] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:14:38 2022] GET /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111 => generated 1363 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:14:39.550730 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2735233b-5698-430f-9c4d-06163c5239cf tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:39.552673 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2735233b-5698-430f-9c4d-06163c5239cf tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: e1cb02b7-1dd6-4c83-9008-e19525731e03] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:39.565430 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2735233b-5698-430f-9c4d-06163c5239cf tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:39.566954 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2735233b-5698-430f-9c4d-06163c5239cf tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:39.567961 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2735233b-5698-430f-9c4d-06163c5239cf tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:39.569394 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2735233b-5698-430f-9c4d-06163c5239cf tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:39.570541 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2735233b-5698-430f-9c4d-06163c5239cf tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:39.571477 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2735233b-5698-430f-9c4d-06163c5239cf tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:39.817910 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-094672a1-9b39-48d1-9434-f3958f94b4bd tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:39.832573 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-094672a1-9b39-48d1-9434-f3958f94b4bd tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef" status: 200 len: 1241 microversion: 2.1 time: 0.465333 Aug 31 16:14:39.843012 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2486/4778] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:39 2022] GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef => generated 1241 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:39.861659 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-235987fc-eac9-4258-9ec6-ec3095bd80bd tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:39.867891 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-235987fc-eac9-4258-9ec6-ec3095bd80bd tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] [instance: 802a1cc5-9787-47d9-87d5-e3fa912d7712] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:39.879929 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-235987fc-eac9-4258-9ec6-ec3095bd80bd tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:39.880378 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-235987fc-eac9-4258-9ec6-ec3095bd80bd tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:39.880812 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-235987fc-eac9-4258-9ec6-ec3095bd80bd tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:39.881600 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-235987fc-eac9-4258-9ec6-ec3095bd80bd tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:39.882080 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-235987fc-eac9-4258-9ec6-ec3095bd80bd tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:39.882628 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-235987fc-eac9-4258-9ec6-ec3095bd80bd tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:40.260488 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2735233b-5698-430f-9c4d-06163c5239cf tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:40.271500 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2735233b-5698-430f-9c4d-06163c5239cf tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03" status: 200 len: 1391 microversion: 2.1 time: 0.728333 Aug 31 16:14:40.272977 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2293/4779] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:39 2022] GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03 => generated 1391 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:40.315638 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-01d0d6da-7683-42f8-87d3-c4c8f1a1a272 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:40.318456 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-01d0d6da-7683-42f8-87d3-c4c8f1a1a272 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] [instance: 2c93da9d-54d5-408f-85d4-768f397294b6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:40.327436 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01d0d6da-7683-42f8-87d3-c4c8f1a1a272 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:40.328200 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01d0d6da-7683-42f8-87d3-c4c8f1a1a272 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:40.328810 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01d0d6da-7683-42f8-87d3-c4c8f1a1a272 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:40.329675 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01d0d6da-7683-42f8-87d3-c4c8f1a1a272 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:40.330868 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01d0d6da-7683-42f8-87d3-c4c8f1a1a272 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:40.331529 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01d0d6da-7683-42f8-87d3-c4c8f1a1a272 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:40.365875 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-01d0d6da-7683-42f8-87d3-c4c8f1a1a272 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] HTTP exception thrown: Instance 2c93da9d-54d5-408f-85d4-768f397294b6 could not be found. Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-01d0d6da-7683-42f8-87d3-c4c8f1a1a272 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Request method failure captured: Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/2c93da9d-54d5-408f-85d4-768f397294b6 HTTP/1.1 Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4fcRMLera6TLJp6OFOd_B19-rdZe1qr5LTGcbsBroFhPQ8_L89JW9hpsNJPnNpQCXW4WKWxdTwWZTYVgRah_OPLrb5JBnrA64ZgN8VfXgRvkXORTfvSkZvZgjCL7371tDtPpfcPNp0NcyRfiYHxIldtsDdYZVFbQTa8WMsjzib7kZ0 Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 84f42648e1a343b9a5ab9b89c91bea0d Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersTestJSON-1527984429 Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/84f42648e1a343b9a5ab9b89c91bea0d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_84f42648e1a343b9a5ab9b89c91bea0d", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServersTestJSON-1527984429 Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 84f42648e1a343b9a5ab9b89c91bea0d Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersTestJSON-1527984429 Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServersTestJSON-1527984429-project Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 3ebce87993504550914c2c3702eebb17 Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServersTestJSON-1527984429-project Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 2c93da9d-54d5-408f-85d4-768f397294b6 could not be found. Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '2c93da9d-54d5-408f-85d4-768f397294b6'} Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c93da9d-54d5-408f-85d4-768f397294b6 could not be found. Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c93da9d-54d5-408f-85d4-768f397294b6 could not be found. Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:40.367611 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:40.371846 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:40.371846 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:40.371846 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:40.371846 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:14:40.371846 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:14:40.371846 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c93da9d-54d5-408f-85d4-768f397294b6 could not be found. Aug 31 16:14:40.371846 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:40.374472 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-01d0d6da-7683-42f8-87d3-c4c8f1a1a272 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] Returning 404 to user: Instance 2c93da9d-54d5-408f-85d4-768f397294b6 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:14:40.375644 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-01d0d6da-7683-42f8-87d3-c4c8f1a1a272 tempest-ServersTestJSON-1527984429 tempest-ServersTestJSON-1527984429-project] 10.222.0.50 "GET /compute/v2.1/servers/2c93da9d-54d5-408f-85d4-768f397294b6" status: 404 len: 111 microversion: 2.1 time: 0.066382 Aug 31 16:14:40.376760 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2294/4780] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:40 2022] GET /compute/v2.1/servers/2c93da9d-54d5-408f-85d4-768f397294b6 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:14:40.519041 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-235987fc-eac9-4258-9ec6-ec3095bd80bd tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b130aecc1794cfc9fe0a9a80d558bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2579dc4a344c2998e30915ea51b2ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:40.559259 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-235987fc-eac9-4258-9ec6-ec3095bd80bd tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] 10.222.0.50 "GET /compute/v2.1/servers/802a1cc5-9787-47d9-87d5-e3fa912d7712" status: 200 len: 1328 microversion: 2.1 time: 0.707947 Aug 31 16:14:40.561837 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2487/4781] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:39 2022] GET /compute/v2.1/servers/802a1cc5-9787-47d9-87d5-e3fa912d7712 => generated 1328 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:40.578701 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b93e55f2-6b1f-459f-9430-b097910b957f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:40.580094 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b93e55f2-6b1f-459f-9430-b097910b957f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] [instance: 55b6663a-93c3-4534-b563-bf54f861c111] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:40.605410 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b93e55f2-6b1f-459f-9430-b097910b957f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:40.607180 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b93e55f2-6b1f-459f-9430-b097910b957f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:40.607842 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b93e55f2-6b1f-459f-9430-b097910b957f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:40.608784 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b93e55f2-6b1f-459f-9430-b097910b957f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:40.609390 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b93e55f2-6b1f-459f-9430-b097910b957f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:40.610216 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b93e55f2-6b1f-459f-9430-b097910b957f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:40.790561 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b93e55f2-6b1f-459f-9430-b097910b957f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:40.803801 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b93e55f2-6b1f-459f-9430-b097910b957f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:40.806869 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b93e55f2-6b1f-459f-9430-b097910b957f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:40.811881 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b93e55f2-6b1f-459f-9430-b097910b957f tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] 10.222.0.50 "GET /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111" status: 200 len: 1363 microversion: 2.47 time: 0.238866 Aug 31 16:14:40.815339 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2295/4782] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:14:40 2022] GET /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111 => generated 1363 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:14:40.879600 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-120838b0-4f66-40c7-a6c6-045036bf5c07 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:40.881542 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-120838b0-4f66-40c7-a6c6-045036bf5c07 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:40.891282 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-120838b0-4f66-40c7-a6c6-045036bf5c07 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:40.892352 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-120838b0-4f66-40c7-a6c6-045036bf5c07 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:40.893244 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-120838b0-4f66-40c7-a6c6-045036bf5c07 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:40.894636 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-120838b0-4f66-40c7-a6c6-045036bf5c07 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:40.895531 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-120838b0-4f66-40c7-a6c6-045036bf5c07 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:40.896367 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-120838b0-4f66-40c7-a6c6-045036bf5c07 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:41.018569 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-fa01ac2d-02e1-4b90-989d-8251247f8679 req-674098cf-8040-4e43-821a-76261cd762a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1cb02b7-1dd6-4c83-9008-e19525731e03", "tag": "aad14830-ef68-4e56-bff4-91dbcf99efc3"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:41.029824 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-fa01ac2d-02e1-4b90-989d-8251247f8679 req-674098cf-8040-4e43-821a-76261cd762a6 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:41.030708 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-fa01ac2d-02e1-4b90-989d-8251247f8679 req-674098cf-8040-4e43-821a-76261cd762a6 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:41.031344 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-fa01ac2d-02e1-4b90-989d-8251247f8679 req-674098cf-8040-4e43-821a-76261cd762a6 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:41.051502 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-fa01ac2d-02e1-4b90-989d-8251247f8679 req-674098cf-8040-4e43-821a-76261cd762a6 service nova] Creating event network-changed:aad14830-ef68-4e56-bff4-91dbcf99efc3 for instance e1cb02b7-1dd6-4c83-9008-e19525731e03 on n-h2-833090-16 Aug 31 16:14:41.058155 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-fa01ac2d-02e1-4b90-989d-8251247f8679 req-674098cf-8040-4e43-821a-76261cd762a6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043071 Aug 31 16:14:41.059434 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2296/4783] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:14:41.166292 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-120838b0-4f66-40c7-a6c6-045036bf5c07 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:41.182410 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-120838b0-4f66-40c7-a6c6-045036bf5c07 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef" status: 200 len: 1299 microversion: 2.1 time: 0.317835 Aug 31 16:14:41.183917 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2488/4784] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:40 2022] GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef => generated 1299 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:41.310489 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ca07bc90-5cc1-4cc6-b18a-f6801a4e2968 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:41.312075 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ca07bc90-5cc1-4cc6-b18a-f6801a4e2968 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: e1cb02b7-1dd6-4c83-9008-e19525731e03] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:41.324627 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca07bc90-5cc1-4cc6-b18a-f6801a4e2968 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:41.325127 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca07bc90-5cc1-4cc6-b18a-f6801a4e2968 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:41.325572 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca07bc90-5cc1-4cc6-b18a-f6801a4e2968 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:41.326818 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca07bc90-5cc1-4cc6-b18a-f6801a4e2968 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:41.327579 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca07bc90-5cc1-4cc6-b18a-f6801a4e2968 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:41.328187 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca07bc90-5cc1-4cc6-b18a-f6801a4e2968 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:41.586999 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4f308be2-3739-45c3-bd95-7cf081e784b6 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:41.590029 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4f308be2-3739-45c3-bd95-7cf081e784b6 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] [instance: 802a1cc5-9787-47d9-87d5-e3fa912d7712] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:41.631514 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4f308be2-3739-45c3-bd95-7cf081e784b6 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:41.636505 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4f308be2-3739-45c3-bd95-7cf081e784b6 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:41.637407 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4f308be2-3739-45c3-bd95-7cf081e784b6 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:41.638743 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4f308be2-3739-45c3-bd95-7cf081e784b6 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:41.642610 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4f308be2-3739-45c3-bd95-7cf081e784b6 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:41.643631 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4f308be2-3739-45c3-bd95-7cf081e784b6 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:42.341359 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ca07bc90-5cc1-4cc6-b18a-f6801a4e2968 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:42.358838 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ca07bc90-5cc1-4cc6-b18a-f6801a4e2968 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03" status: 200 len: 1391 microversion: 2.1 time: 1.062472 Aug 31 16:14:42.375603 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2297/4785] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:41 2022] GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03 => generated 1391 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:14:42.391502 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-80b68e83-54a6-4d7c-98ee-87bcee61e894 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:42.392391 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-80b68e83-54a6-4d7c-98ee-87bcee61e894 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] [instance: 55b6663a-93c3-4534-b563-bf54f861c111] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:42.400169 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80b68e83-54a6-4d7c-98ee-87bcee61e894 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:42.401146 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80b68e83-54a6-4d7c-98ee-87bcee61e894 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:42.401725 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80b68e83-54a6-4d7c-98ee-87bcee61e894 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:42.402907 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80b68e83-54a6-4d7c-98ee-87bcee61e894 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:42.403584 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80b68e83-54a6-4d7c-98ee-87bcee61e894 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:42.404159 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80b68e83-54a6-4d7c-98ee-87bcee61e894 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:42.462110 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80b68e83-54a6-4d7c-98ee-87bcee61e894 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:42.462873 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80b68e83-54a6-4d7c-98ee-87bcee61e894 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:42.463459 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80b68e83-54a6-4d7c-98ee-87bcee61e894 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:42.464366 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-80b68e83-54a6-4d7c-98ee-87bcee61e894 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lazy-loading 'fault' on Instance uuid 55b6663a-93c3-4534-b563-bf54f861c111 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:14:42.491397 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4f308be2-3739-45c3-bd95-7cf081e784b6 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b130aecc1794cfc9fe0a9a80d558bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2579dc4a344c2998e30915ea51b2ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:42.514558 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4f308be2-3739-45c3-bd95-7cf081e784b6 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] 10.222.0.50 "GET /compute/v2.1/servers/802a1cc5-9787-47d9-87d5-e3fa912d7712" status: 200 len: 1328 microversion: 2.1 time: 0.935147 Aug 31 16:14:42.519913 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2489/4786] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:41 2022] GET /compute/v2.1/servers/802a1cc5-9787-47d9-87d5-e3fa912d7712 => generated 1328 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:42.528777 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-962959e9-1dba-45c4-8364-e19800493afa tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:42.530489 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-962959e9-1dba-45c4-8364-e19800493afa tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:42.545947 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-962959e9-1dba-45c4-8364-e19800493afa tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:42.546826 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-962959e9-1dba-45c4-8364-e19800493afa tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:42.547610 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-962959e9-1dba-45c4-8364-e19800493afa tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:42.548574 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-962959e9-1dba-45c4-8364-e19800493afa tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:42.550014 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-962959e9-1dba-45c4-8364-e19800493afa tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:42.550861 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-962959e9-1dba-45c4-8364-e19800493afa tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:42.687376 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-80b68e83-54a6-4d7c-98ee-87bcee61e894 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:42.701953 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-80b68e83-54a6-4d7c-98ee-87bcee61e894 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:42.705815 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-80b68e83-54a6-4d7c-98ee-87bcee61e894 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:42.716210 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-80b68e83-54a6-4d7c-98ee-87bcee61e894 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] 10.222.0.50 "GET /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111" status: 200 len: 1368 microversion: 2.47 time: 0.334387 Aug 31 16:14:42.719020 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2298/4787] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:14:42 2022] GET /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111 => generated 1368 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:14:42.742948 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-962959e9-1dba-45c4-8364-e19800493afa tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:42.767910 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-962959e9-1dba-45c4-8364-e19800493afa tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef" status: 200 len: 1299 microversion: 2.1 time: 0.246070 Aug 31 16:14:42.778927 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2490/4788] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:42 2022] GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef => generated 1299 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:43.280565 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-a103aee6-72f0-41c5-8257-325f4f6b00db req-2c0b2260-e5f2-4229-ae78-65b1b9403a8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "802a1cc5-9787-47d9-87d5-e3fa912d7712", "tag": "0106e3d6-aeae-4314-8e0c-0a661954a14f"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:43.300193 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a103aee6-72f0-41c5-8257-325f4f6b00db req-2c0b2260-e5f2-4229-ae78-65b1b9403a8a service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:43.301153 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a103aee6-72f0-41c5-8257-325f4f6b00db req-2c0b2260-e5f2-4229-ae78-65b1b9403a8a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:43.302254 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a103aee6-72f0-41c5-8257-325f4f6b00db req-2c0b2260-e5f2-4229-ae78-65b1b9403a8a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:43.331721 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-a103aee6-72f0-41c5-8257-325f4f6b00db req-2c0b2260-e5f2-4229-ae78-65b1b9403a8a service nova] Creating event network-changed:0106e3d6-aeae-4314-8e0c-0a661954a14f for instance 802a1cc5-9787-47d9-87d5-e3fa912d7712 on n-h1-833090-16 Aug 31 16:14:43.342730 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-a103aee6-72f0-41c5-8257-325f4f6b00db req-2c0b2260-e5f2-4229-ae78-65b1b9403a8a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079726 Aug 31 16:14:43.345219 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2299/4789] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:14:43.395640 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-da5c1adb-5c74-4c6b-91f8-e0716e606e2e tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:43.396374 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-da5c1adb-5c74-4c6b-91f8-e0716e606e2e tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: e1cb02b7-1dd6-4c83-9008-e19525731e03] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:43.404754 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-da5c1adb-5c74-4c6b-91f8-e0716e606e2e tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:43.405648 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-da5c1adb-5c74-4c6b-91f8-e0716e606e2e tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:43.406083 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-da5c1adb-5c74-4c6b-91f8-e0716e606e2e tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:43.406816 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-da5c1adb-5c74-4c6b-91f8-e0716e606e2e tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:43.407383 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-da5c1adb-5c74-4c6b-91f8-e0716e606e2e tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:43.407872 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-da5c1adb-5c74-4c6b-91f8-e0716e606e2e tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:43.565812 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-104ceb21-f305-4a83-8994-f7a903a3d4ed tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:43.568234 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-104ceb21-f305-4a83-8994-f7a903a3d4ed tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] [instance: 802a1cc5-9787-47d9-87d5-e3fa912d7712] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:43.584954 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-104ceb21-f305-4a83-8994-f7a903a3d4ed tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:43.586336 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-104ceb21-f305-4a83-8994-f7a903a3d4ed tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:43.587235 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-104ceb21-f305-4a83-8994-f7a903a3d4ed tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:43.588376 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-104ceb21-f305-4a83-8994-f7a903a3d4ed tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:43.589605 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-104ceb21-f305-4a83-8994-f7a903a3d4ed tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:43.590519 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-104ceb21-f305-4a83-8994-f7a903a3d4ed tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:43.780648 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-da5c1adb-5c74-4c6b-91f8-e0716e606e2e tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:43.795933 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-da5c1adb-5c74-4c6b-91f8-e0716e606e2e tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03" status: 200 len: 1391 microversion: 2.1 time: 0.398877 Aug 31 16:14:43.796589 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2491/4790] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:43 2022] GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03 => generated 1391 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:43.801857 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6984db67-6eab-4c24-a866-2fd479f11961 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:43.804331 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6984db67-6eab-4c24-a866-2fd479f11961 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 1c40a98f-366d-4392-9034-7841f68b2050] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:43.826340 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6984db67-6eab-4c24-a866-2fd479f11961 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:43.826824 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6984db67-6eab-4c24-a866-2fd479f11961 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:43.827254 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6984db67-6eab-4c24-a866-2fd479f11961 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:43.827954 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6984db67-6eab-4c24-a866-2fd479f11961 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:43.828403 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6984db67-6eab-4c24-a866-2fd479f11961 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:43.828846 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6984db67-6eab-4c24-a866-2fd479f11961 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:43.923723 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-104ceb21-f305-4a83-8994-f7a903a3d4ed tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b130aecc1794cfc9fe0a9a80d558bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2579dc4a344c2998e30915ea51b2ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:43.924522 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-6984db67-6eab-4c24-a866-2fd479f11961 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lazy-loading 'flavor' on Instance uuid 1c40a98f-366d-4392-9034-7841f68b2050 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:14:43.939034 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-104ceb21-f305-4a83-8994-f7a903a3d4ed tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] 10.222.0.50 "GET /compute/v2.1/servers/802a1cc5-9787-47d9-87d5-e3fa912d7712" status: 200 len: 1328 microversion: 2.1 time: 0.400431 Aug 31 16:14:43.940549 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2300/4791] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:43 2022] GET /compute/v2.1/servers/802a1cc5-9787-47d9-87d5-e3fa912d7712 => generated 1328 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:43.954453 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-971e439c-b2d9-4325-aecc-270a17eefe2e tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:43.959175 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-971e439c-b2d9-4325-aecc-270a17eefe2e tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] [instance: 55b6663a-93c3-4534-b563-bf54f861c111] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:43.986501 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-971e439c-b2d9-4325-aecc-270a17eefe2e tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:43.987564 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-971e439c-b2d9-4325-aecc-270a17eefe2e tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:43.988435 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-971e439c-b2d9-4325-aecc-270a17eefe2e tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:43.989391 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-971e439c-b2d9-4325-aecc-270a17eefe2e tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:43.992682 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-971e439c-b2d9-4325-aecc-270a17eefe2e tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:43.993217 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-971e439c-b2d9-4325-aecc-270a17eefe2e tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:44.025647 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-971e439c-b2d9-4325-aecc-270a17eefe2e tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] HTTP exception thrown: Instance 55b6663a-93c3-4534-b563-bf54f861c111 could not be found. Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-971e439c-b2d9-4325-aecc-270a17eefe2e tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Request method failure captured: Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111 HTTP/1.1 Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4i7eGSdAKLJNpNhG5ClFTQt09ef50opmcgY6s5myxGEogyLY9mM7NG_ekrj8_7Yo2hDAgznu7fpNy9Y3u99suZ1WRbOLftIx7xMUgS-q6WpHjFlOFccWn_UlXbDiZ0f-qAld65DNqUHrYUDPDXTFONeXE0xlOh32dInqHlKENiwp-8 Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: X-Openstack-Nova-Api-Version: 2.47 Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: f10cf9c476744d658fbd33ceb3471eb1 Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerShowV247Test-1318600320 Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f10cf9c476744d658fbd33ceb3471eb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f10cf9c476744d658fbd33ceb3471eb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f10cf9c476744d658fbd33ceb3471eb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f10cf9c476744d658fbd33ceb3471eb1", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServerShowV247Test-1318600320 Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: f10cf9c476744d658fbd33ceb3471eb1 Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerShowV247Test-1318600320 Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServerShowV247Test-1318600320-project Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: b5d9034cc6e2403190940275f8b41c2b Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServerShowV247Test-1318600320-project Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 55b6663a-93c3-4534-b563-bf54f861c111 could not be found. Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '55b6663a-93c3-4534-b563-bf54f861c111'} Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55b6663a-93c3-4534-b563-bf54f861c111 could not be found. Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55b6663a-93c3-4534-b563-bf54f861c111 could not be found. Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:44.032182 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:44.040804 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:44.040804 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:44.040804 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:44.040804 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:14:44.040804 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:14:44.040804 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55b6663a-93c3-4534-b563-bf54f861c111 could not be found. Aug 31 16:14:44.040804 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:44.040804 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-971e439c-b2d9-4325-aecc-270a17eefe2e tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Returning 404 to user: Instance 55b6663a-93c3-4534-b563-bf54f861c111 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:14:44.040804 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-971e439c-b2d9-4325-aecc-270a17eefe2e tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] 10.222.0.50 "GET /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111" status: 404 len: 111 microversion: 2.47 time: 0.093734 Aug 31 16:14:44.040804 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2301/4792] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:14:43 2022] GET /compute/v2.1/servers/55b6663a-93c3-4534-b563-bf54f861c111 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:14:44.044362 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-88662e2c-efce-40c3-8625-0070233de2dd tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:44.045046 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-88662e2c-efce-40c3-8625-0070233de2dd tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:44.051760 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88662e2c-efce-40c3-8625-0070233de2dd tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:44.052357 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88662e2c-efce-40c3-8625-0070233de2dd tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:44.052782 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88662e2c-efce-40c3-8625-0070233de2dd tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:44.053492 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88662e2c-efce-40c3-8625-0070233de2dd tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:44.053970 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88662e2c-efce-40c3-8625-0070233de2dd tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:44.055020 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88662e2c-efce-40c3-8625-0070233de2dd tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:44.217161 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6984db67-6eab-4c24-a866-2fd479f11961 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "POST /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050/action" status: 200 len: 32 microversion: 2.1 time: 0.416402 Aug 31 16:14:44.227581 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2492/4793] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:14:43 2022] POST /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050/action => generated 32 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:14:44.234622 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-98a1994c-29b1-4770-bb3c-f469da7c878b tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:44.235614 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-98a1994c-29b1-4770-bb3c-f469da7c878b tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] [instance: a6faec39-0081-47ec-8896-0a705afd3876] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:44.243052 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-98a1994c-29b1-4770-bb3c-f469da7c878b tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:44.244120 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-98a1994c-29b1-4770-bb3c-f469da7c878b tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:44.244901 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-98a1994c-29b1-4770-bb3c-f469da7c878b tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:44.246790 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-98a1994c-29b1-4770-bb3c-f469da7c878b tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:44.247812 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-98a1994c-29b1-4770-bb3c-f469da7c878b tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:44.248738 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-98a1994c-29b1-4770-bb3c-f469da7c878b tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:44.290056 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-98a1994c-29b1-4770-bb3c-f469da7c878b tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] [instance: a6faec39-0081-47ec-8896-0a705afd3876] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:14:44.417335 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-98a1994c-29b1-4770-bb3c-f469da7c878b tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a6faec39-0081-47ec-8896-0a705afd3876" status: 204 len: 0 microversion: 2.47 time: 0.186552 Aug 31 16:14:44.419211 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2493/4794] 10.222.0.50 () {60 vars in 1280 bytes} [Wed Aug 31 16:14:44 2022] DELETE /compute/v2.1/servers/a6faec39-0081-47ec-8896-0a705afd3876 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 16:14:44.435928 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-28045ea1-c04e-4c09-9a2f-cbfe9a0d8042 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:44.438345 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-28045ea1-c04e-4c09-9a2f-cbfe9a0d8042 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 1c40a98f-366d-4392-9034-7841f68b2050] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:44.449996 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-28045ea1-c04e-4c09-9a2f-cbfe9a0d8042 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:44.450835 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-28045ea1-c04e-4c09-9a2f-cbfe9a0d8042 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:44.451638 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-28045ea1-c04e-4c09-9a2f-cbfe9a0d8042 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:44.452940 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-28045ea1-c04e-4c09-9a2f-cbfe9a0d8042 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:44.453634 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-28045ea1-c04e-4c09-9a2f-cbfe9a0d8042 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:44.454509 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-28045ea1-c04e-4c09-9a2f-cbfe9a0d8042 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:44.464801 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-88662e2c-efce-40c3-8625-0070233de2dd tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:44.497364 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-88662e2c-efce-40c3-8625-0070233de2dd tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef" status: 200 len: 1367 microversion: 2.1 time: 0.456561 Aug 31 16:14:44.502527 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2302/4795] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:44 2022] GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef => generated 1367 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:44.517298 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3023ec7a-afd9-4328-90e9-9a2762e73fc1 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:44.518585 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3023ec7a-afd9-4328-90e9-9a2762e73fc1 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] [instance: a6faec39-0081-47ec-8896-0a705afd3876] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:44.542637 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3023ec7a-afd9-4328-90e9-9a2762e73fc1 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:44.543028 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3023ec7a-afd9-4328-90e9-9a2762e73fc1 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:44.543461 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3023ec7a-afd9-4328-90e9-9a2762e73fc1 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:44.544179 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3023ec7a-afd9-4328-90e9-9a2762e73fc1 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:44.544853 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3023ec7a-afd9-4328-90e9-9a2762e73fc1 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:44.545437 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3023ec7a-afd9-4328-90e9-9a2762e73fc1 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:44.709631 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3023ec7a-afd9-4328-90e9-9a2762e73fc1 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:44.721914 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3023ec7a-afd9-4328-90e9-9a2762e73fc1 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:44.724407 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3023ec7a-afd9-4328-90e9-9a2762e73fc1 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:44.726360 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3023ec7a-afd9-4328-90e9-9a2762e73fc1 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] 10.222.0.50 "GET /compute/v2.1/servers/a6faec39-0081-47ec-8896-0a705afd3876" status: 200 len: 1363 microversion: 2.47 time: 0.221823 Aug 31 16:14:44.727623 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2303/4796] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:14:44 2022] GET /compute/v2.1/servers/a6faec39-0081-47ec-8896-0a705afd3876 => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:14:44.782465 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-28045ea1-c04e-4c09-9a2f-cbfe9a0d8042 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:44.796623 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-28045ea1-c04e-4c09-9a2f-cbfe9a0d8042 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050" status: 200 len: 1736 microversion: 2.1 time: 0.371332 Aug 31 16:14:44.797495 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2494/4797] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:44 2022] GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050 => generated 1736 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:44.827299 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0c5a4eb5-8d9c-4b63-8862-4585dee37866 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:44.827953 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0c5a4eb5-8d9c-4b63-8862-4585dee37866 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: e1cb02b7-1dd6-4c83-9008-e19525731e03] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:44.836267 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c5a4eb5-8d9c-4b63-8862-4585dee37866 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:44.836903 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c5a4eb5-8d9c-4b63-8862-4585dee37866 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:44.837490 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c5a4eb5-8d9c-4b63-8862-4585dee37866 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:44.838519 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c5a4eb5-8d9c-4b63-8862-4585dee37866 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:44.839266 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c5a4eb5-8d9c-4b63-8862-4585dee37866 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:44.839783 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c5a4eb5-8d9c-4b63-8862-4585dee37866 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:44.962898 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7adb40a4-34f8-4c18-b42b-811e22d188dc tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:44.964585 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7adb40a4-34f8-4c18-b42b-811e22d188dc tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] [instance: 802a1cc5-9787-47d9-87d5-e3fa912d7712] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:44.989861 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7adb40a4-34f8-4c18-b42b-811e22d188dc tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:44.990817 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7adb40a4-34f8-4c18-b42b-811e22d188dc tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:44.991664 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7adb40a4-34f8-4c18-b42b-811e22d188dc tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:44.992941 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7adb40a4-34f8-4c18-b42b-811e22d188dc tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:44.993703 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7adb40a4-34f8-4c18-b42b-811e22d188dc tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:44.994672 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7adb40a4-34f8-4c18-b42b-811e22d188dc tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:45.039487 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0c5a4eb5-8d9c-4b63-8862-4585dee37866 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:45.057689 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0c5a4eb5-8d9c-4b63-8862-4585dee37866 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03" status: 200 len: 1391 microversion: 2.1 time: 0.234218 Aug 31 16:14:45.068242 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2304/4798] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:44 2022] GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03 => generated 1391 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:45.204413 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7adb40a4-34f8-4c18-b42b-811e22d188dc tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b130aecc1794cfc9fe0a9a80d558bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2579dc4a344c2998e30915ea51b2ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:45.215512 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7adb40a4-34f8-4c18-b42b-811e22d188dc tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] 10.222.0.50 "GET /compute/v2.1/servers/802a1cc5-9787-47d9-87d5-e3fa912d7712" status: 200 len: 1328 microversion: 2.1 time: 0.257582 Aug 31 16:14:45.216802 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2495/4799] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:44 2022] GET /compute/v2.1/servers/802a1cc5-9787-47d9-87d5-e3fa912d7712 => generated 1328 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:14:45.533664 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b3b1ab19-59df-420e-9aca-97dfd04113c7 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:45.535030 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b3b1ab19-59df-420e-9aca-97dfd04113c7 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:45.558282 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3b1ab19-59df-420e-9aca-97dfd04113c7 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:45.559234 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3b1ab19-59df-420e-9aca-97dfd04113c7 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:45.560010 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3b1ab19-59df-420e-9aca-97dfd04113c7 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:45.561191 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3b1ab19-59df-420e-9aca-97dfd04113c7 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:45.561909 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3b1ab19-59df-420e-9aca-97dfd04113c7 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:45.564266 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3b1ab19-59df-420e-9aca-97dfd04113c7 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:45.755241 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e4e8962e-7d74-46b5-94a0-a1455daa9759 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:45.755860 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e4e8962e-7d74-46b5-94a0-a1455daa9759 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] [instance: a6faec39-0081-47ec-8896-0a705afd3876] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:45.773949 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=4 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:14:45.777812 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:14:45.780389 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4e8962e-7d74-46b5-94a0-a1455daa9759 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:45.780947 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4e8962e-7d74-46b5-94a0-a1455daa9759 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:45.781387 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4e8962e-7d74-46b5-94a0-a1455daa9759 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:45.782126 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4e8962e-7d74-46b5-94a0-a1455daa9759 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:45.787590 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4e8962e-7d74-46b5-94a0-a1455daa9759 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:45.796460 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4e8962e-7d74-46b5-94a0-a1455daa9759 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:46.401944 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e4e8962e-7d74-46b5-94a0-a1455daa9759 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:46.445136 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e4e8962e-7d74-46b5-94a0-a1455daa9759 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:46.447293 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e4e8962e-7d74-46b5-94a0-a1455daa9759 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:46.449908 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e4e8962e-7d74-46b5-94a0-a1455daa9759 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] 10.222.0.50 "GET /compute/v2.1/servers/a6faec39-0081-47ec-8896-0a705afd3876" status: 200 len: 1363 microversion: 2.47 time: 0.698705 Aug 31 16:14:46.451987 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2496/4800] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:14:45 2022] GET /compute/v2.1/servers/a6faec39-0081-47ec-8896-0a705afd3876 => generated 1363 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:14:46.458759 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1a235da6-5e6b-443f-8d86-75079632158e tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:46.459303 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1a235da6-5e6b-443f-8d86-75079632158e tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 1c40a98f-366d-4392-9034-7841f68b2050] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:46.468204 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a235da6-5e6b-443f-8d86-75079632158e tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:46.468479 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a235da6-5e6b-443f-8d86-75079632158e tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:46.468927 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a235da6-5e6b-443f-8d86-75079632158e tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:46.469651 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a235da6-5e6b-443f-8d86-75079632158e tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:46.470124 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a235da6-5e6b-443f-8d86-75079632158e tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:46.471106 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a235da6-5e6b-443f-8d86-75079632158e tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:46.557811 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b3b1ab19-59df-420e-9aca-97dfd04113c7 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:46.594479 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b3b1ab19-59df-420e-9aca-97dfd04113c7 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef" status: 200 len: 1367 microversion: 2.1 time: 1.064266 Aug 31 16:14:46.609228 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2305/4801] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:45 2022] GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef => generated 1367 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:14:46.609228 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-291e4ae4-469f-4374-99a8-fbd60439286d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:46.609228 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-291e4ae4-469f-4374-99a8-fbd60439286d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: e1cb02b7-1dd6-4c83-9008-e19525731e03] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:46.634917 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-291e4ae4-469f-4374-99a8-fbd60439286d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:46.635559 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-291e4ae4-469f-4374-99a8-fbd60439286d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:46.636085 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-291e4ae4-469f-4374-99a8-fbd60439286d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:46.636968 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-291e4ae4-469f-4374-99a8-fbd60439286d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:46.638523 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-291e4ae4-469f-4374-99a8-fbd60439286d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:46.639825 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-291e4ae4-469f-4374-99a8-fbd60439286d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:46.990339 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1a235da6-5e6b-443f-8d86-75079632158e tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:47.013521 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1a235da6-5e6b-443f-8d86-75079632158e tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050" status: 200 len: 1736 microversion: 2.1 time: 0.560183 Aug 31 16:14:47.019166 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2497/4802] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:46 2022] GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050 => generated 1736 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:47.048292 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-66761108-4e95-486a-80a7-a1165bd8b6df tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:47.056727 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-66761108-4e95-486a-80a7-a1165bd8b6df tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] [instance: 802a1cc5-9787-47d9-87d5-e3fa912d7712] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:47.071119 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-66761108-4e95-486a-80a7-a1165bd8b6df tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:47.075105 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-66761108-4e95-486a-80a7-a1165bd8b6df tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:47.076852 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-66761108-4e95-486a-80a7-a1165bd8b6df tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:47.078328 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-291e4ae4-469f-4374-99a8-fbd60439286d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:47.078587 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-66761108-4e95-486a-80a7-a1165bd8b6df tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:47.079572 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-66761108-4e95-486a-80a7-a1165bd8b6df tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:47.080563 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-66761108-4e95-486a-80a7-a1165bd8b6df tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:47.090828 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:14:47.093709 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-291e4ae4-469f-4374-99a8-fbd60439286d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03" status: 200 len: 1391 microversion: 2.1 time: 0.495403 Aug 31 16:14:47.095162 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2306/4803] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:46 2022] GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03 => generated 1391 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:47.477242 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ca978399-2f26-4844-94d8-62dc8d541d27 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:47.478413 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ca978399-2f26-4844-94d8-62dc8d541d27 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] [instance: a6faec39-0081-47ec-8896-0a705afd3876] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:47.504257 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca978399-2f26-4844-94d8-62dc8d541d27 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:47.518907 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca978399-2f26-4844-94d8-62dc8d541d27 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:47.539598 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca978399-2f26-4844-94d8-62dc8d541d27 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:47.559372 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca978399-2f26-4844-94d8-62dc8d541d27 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:47.561386 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca978399-2f26-4844-94d8-62dc8d541d27 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:47.561386 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca978399-2f26-4844-94d8-62dc8d541d27 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:47.587393 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:14:47.654880 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-66761108-4e95-486a-80a7-a1165bd8b6df tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b130aecc1794cfc9fe0a9a80d558bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2579dc4a344c2998e30915ea51b2ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:47.715162 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-66761108-4e95-486a-80a7-a1165bd8b6df tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] 10.222.0.50 "GET /compute/v2.1/servers/802a1cc5-9787-47d9-87d5-e3fa912d7712" status: 200 len: 1328 microversion: 2.1 time: 0.693411 Aug 31 16:14:47.723607 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2498/4804] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:47 2022] GET /compute/v2.1/servers/802a1cc5-9787-47d9-87d5-e3fa912d7712 => generated 1328 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:47.736032 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2a6c08ae-654f-4f9c-a2a5-69f9205df3ff tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:47.738384 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2a6c08ae-654f-4f9c-a2a5-69f9205df3ff tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:47.783950 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2a6c08ae-654f-4f9c-a2a5-69f9205df3ff tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:47.785245 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2a6c08ae-654f-4f9c-a2a5-69f9205df3ff tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:47.796908 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2a6c08ae-654f-4f9c-a2a5-69f9205df3ff tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:47.798348 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2a6c08ae-654f-4f9c-a2a5-69f9205df3ff tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:47.799231 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2a6c08ae-654f-4f9c-a2a5-69f9205df3ff tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:47.800126 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2a6c08ae-654f-4f9c-a2a5-69f9205df3ff tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:47.846942 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ca978399-2f26-4844-94d8-62dc8d541d27 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:47.873720 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ca978399-2f26-4844-94d8-62dc8d541d27 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:47.884457 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ca978399-2f26-4844-94d8-62dc8d541d27 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b5d9034cc6e2403190940275f8b41c2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10cf9c476744d658fbd33ceb3471eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:47.888167 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ca978399-2f26-4844-94d8-62dc8d541d27 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] 10.222.0.50 "GET /compute/v2.1/servers/a6faec39-0081-47ec-8896-0a705afd3876" status: 200 len: 1363 microversion: 2.47 time: 0.415021 Aug 31 16:14:47.915445 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2307/4805] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:14:47 2022] GET /compute/v2.1/servers/a6faec39-0081-47ec-8896-0a705afd3876 => generated 1363 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:14:48.047796 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8802fa32-6d22-48a0-a9e3-e38dac400da5 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:48.048410 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8802fa32-6d22-48a0-a9e3-e38dac400da5 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 1c40a98f-366d-4392-9034-7841f68b2050] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:48.063403 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8802fa32-6d22-48a0-a9e3-e38dac400da5 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:48.064157 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8802fa32-6d22-48a0-a9e3-e38dac400da5 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:48.064759 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8802fa32-6d22-48a0-a9e3-e38dac400da5 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:48.065741 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8802fa32-6d22-48a0-a9e3-e38dac400da5 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:48.068475 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8802fa32-6d22-48a0-a9e3-e38dac400da5 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:48.070524 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8802fa32-6d22-48a0-a9e3-e38dac400da5 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:48.191136 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:14:48.249577 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=18 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:14:48.415684 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2a6c08ae-654f-4f9c-a2a5-69f9205df3ff tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:48.431104 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2a6c08ae-654f-4f9c-a2a5-69f9205df3ff tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef" status: 200 len: 1367 microversion: 2.1 time: 0.705624 Aug 31 16:14:48.431993 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2499/4806] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:47 2022] GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef => generated 1367 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:48.456744 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b08af27b-d8d9-444c-8182-e50f6782525f tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:48.460127 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b08af27b-d8d9-444c-8182-e50f6782525f tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: e1cb02b7-1dd6-4c83-9008-e19525731e03] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:48.478665 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8802fa32-6d22-48a0-a9e3-e38dac400da5 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:48.489333 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b08af27b-d8d9-444c-8182-e50f6782525f tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:48.492521 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b08af27b-d8d9-444c-8182-e50f6782525f tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:48.493230 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b08af27b-d8d9-444c-8182-e50f6782525f tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:48.495403 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b08af27b-d8d9-444c-8182-e50f6782525f tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:48.497296 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b08af27b-d8d9-444c-8182-e50f6782525f tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:48.497964 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b08af27b-d8d9-444c-8182-e50f6782525f tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:48.501565 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8802fa32-6d22-48a0-a9e3-e38dac400da5 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050" status: 200 len: 1736 microversion: 2.1 time: 0.456705 Aug 31 16:14:48.502932 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2308/4807] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:48 2022] GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050 => generated 1736 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:14:48.739817 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b08af27b-d8d9-444c-8182-e50f6782525f tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:48.749797 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b08af27b-d8d9-444c-8182-e50f6782525f tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03" status: 200 len: 1391 microversion: 2.1 time: 0.316464 Aug 31 16:14:48.753188 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-08d387dd-3277-4d48-a631-bb6bdfe448ab tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:48.755326 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-08d387dd-3277-4d48-a631-bb6bdfe448ab tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] [instance: 802a1cc5-9787-47d9-87d5-e3fa912d7712] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:48.764655 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2500/4808] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:48 2022] GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03 => generated 1391 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:48.814166 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-08d387dd-3277-4d48-a631-bb6bdfe448ab tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:48.814979 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-08d387dd-3277-4d48-a631-bb6bdfe448ab tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:48.816984 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-08d387dd-3277-4d48-a631-bb6bdfe448ab tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:48.818981 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-08d387dd-3277-4d48-a631-bb6bdfe448ab tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:48.820339 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-08d387dd-3277-4d48-a631-bb6bdfe448ab tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:48.823622 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-08d387dd-3277-4d48-a631-bb6bdfe448ab tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:48.932587 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-63ce019b-7c73-4c14-8cb5-b1cd5e361107 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:48.941029 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-63ce019b-7c73-4c14-8cb5-b1cd5e361107 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] [instance: a6faec39-0081-47ec-8896-0a705afd3876] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:48.973036 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-63ce019b-7c73-4c14-8cb5-b1cd5e361107 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:48.980293 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-63ce019b-7c73-4c14-8cb5-b1cd5e361107 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:48.981477 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-63ce019b-7c73-4c14-8cb5-b1cd5e361107 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:48.982663 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-63ce019b-7c73-4c14-8cb5-b1cd5e361107 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:48.983508 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-63ce019b-7c73-4c14-8cb5-b1cd5e361107 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:48.984210 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-63ce019b-7c73-4c14-8cb5-b1cd5e361107 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:49.058333 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-63ce019b-7c73-4c14-8cb5-b1cd5e361107 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] HTTP exception thrown: Instance a6faec39-0081-47ec-8896-0a705afd3876 could not be found. Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-63ce019b-7c73-4c14-8cb5-b1cd5e361107 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Request method failure captured: Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/a6faec39-0081-47ec-8896-0a705afd3876 HTTP/1.1 Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4i7eGSdAKLJNpNhG5ClFTQt09ef50opmcgY6s5myxGEogyLY9mM7NG_ekrj8_7Yo2hDAgznu7fpNy9Y3u99suZ1WRbOLftIx7xMUgS-q6WpHjFlOFccWn_UlXbDiZ0f-qAld65DNqUHrYUDPDXTFONeXE0xlOh32dInqHlKENiwp-8 Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: X-Openstack-Nova-Api-Version: 2.47 Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: f10cf9c476744d658fbd33ceb3471eb1 Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServerShowV247Test-1318600320 Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f10cf9c476744d658fbd33ceb3471eb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f10cf9c476744d658fbd33ceb3471eb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f10cf9c476744d658fbd33ceb3471eb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f10cf9c476744d658fbd33ceb3471eb1", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServerShowV247Test-1318600320 Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: f10cf9c476744d658fbd33ceb3471eb1 Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServerShowV247Test-1318600320 Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServerShowV247Test-1318600320-project Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: b5d9034cc6e2403190940275f8b41c2b Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServerShowV247Test-1318600320-project Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance a6faec39-0081-47ec-8896-0a705afd3876 could not be found. Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'a6faec39-0081-47ec-8896-0a705afd3876'} Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6faec39-0081-47ec-8896-0a705afd3876 could not be found. Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6faec39-0081-47ec-8896-0a705afd3876 could not be found. Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:49.060311 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:14:49.065764 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:49.065764 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:49.065764 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:49.065764 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:14:49.065764 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:14:49.065764 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6faec39-0081-47ec-8896-0a705afd3876 could not be found. Aug 31 16:14:49.065764 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:14:49.068357 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-63ce019b-7c73-4c14-8cb5-b1cd5e361107 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] Returning 404 to user: Instance a6faec39-0081-47ec-8896-0a705afd3876 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:14:49.069494 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-63ce019b-7c73-4c14-8cb5-b1cd5e361107 tempest-ServerShowV247Test-1318600320 tempest-ServerShowV247Test-1318600320-project] 10.222.0.50 "GET /compute/v2.1/servers/a6faec39-0081-47ec-8896-0a705afd3876" status: 404 len: 111 microversion: 2.47 time: 0.145722 Aug 31 16:14:49.071150 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2501/4809] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:14:48 2022] GET /compute/v2.1/servers/a6faec39-0081-47ec-8896-0a705afd3876 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:14:49.123029 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-08d387dd-3277-4d48-a631-bb6bdfe448ab tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b130aecc1794cfc9fe0a9a80d558bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2579dc4a344c2998e30915ea51b2ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:49.133545 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-08d387dd-3277-4d48-a631-bb6bdfe448ab tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] 10.222.0.50 "GET /compute/v2.1/servers/802a1cc5-9787-47d9-87d5-e3fa912d7712" status: 200 len: 1328 microversion: 2.1 time: 0.390668 Aug 31 16:14:49.135537 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2309/4810] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:48 2022] GET /compute/v2.1/servers/802a1cc5-9787-47d9-87d5-e3fa912d7712 => generated 1328 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:49.345523 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-ed929d5d-2079-4ea4-9190-48e13acae3e2 req-e0e29539-1ca5-4e3c-9298-2854e2a244a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef", "tag": "59ca6f67-7dec-4e2b-a15d-4746e8c56b32"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:49.356468 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-ed929d5d-2079-4ea4-9190-48e13acae3e2 req-e0e29539-1ca5-4e3c-9298-2854e2a244a7 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:49.367778 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-ed929d5d-2079-4ea4-9190-48e13acae3e2 req-e0e29539-1ca5-4e3c-9298-2854e2a244a7 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:49.369888 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-ed929d5d-2079-4ea4-9190-48e13acae3e2 req-e0e29539-1ca5-4e3c-9298-2854e2a244a7 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:49.404061 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-ed929d5d-2079-4ea4-9190-48e13acae3e2 req-e0e29539-1ca5-4e3c-9298-2854e2a244a7 service nova] Creating event network-changed:59ca6f67-7dec-4e2b-a15d-4746e8c56b32 for instance 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef on n-h2-833090-16 Aug 31 16:14:49.411619 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-ed929d5d-2079-4ea4-9190-48e13acae3e2 req-e0e29539-1ca5-4e3c-9298-2854e2a244a7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069899 Aug 31 16:14:49.414210 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2502/4811] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:14:49.468486 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-06ecff62-3d5b-4647-af37-0a0d8e515151 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:49.469564 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-06ecff62-3d5b-4647-af37-0a0d8e515151 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:49.480742 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06ecff62-3d5b-4647-af37-0a0d8e515151 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:49.481581 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06ecff62-3d5b-4647-af37-0a0d8e515151 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:49.482361 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06ecff62-3d5b-4647-af37-0a0d8e515151 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:49.483528 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06ecff62-3d5b-4647-af37-0a0d8e515151 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:49.484363 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06ecff62-3d5b-4647-af37-0a0d8e515151 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:49.485070 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06ecff62-3d5b-4647-af37-0a0d8e515151 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:49.542551 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-152fab4a-a78d-4d34-8bbf-b14560b22387 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:49.547581 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-152fab4a-a78d-4d34-8bbf-b14560b22387 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 1c40a98f-366d-4392-9034-7841f68b2050] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:49.564911 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-152fab4a-a78d-4d34-8bbf-b14560b22387 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:49.569693 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-152fab4a-a78d-4d34-8bbf-b14560b22387 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:49.570652 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-152fab4a-a78d-4d34-8bbf-b14560b22387 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:49.571920 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-152fab4a-a78d-4d34-8bbf-b14560b22387 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:49.572955 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-152fab4a-a78d-4d34-8bbf-b14560b22387 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:49.575761 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-152fab4a-a78d-4d34-8bbf-b14560b22387 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:49.827098 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=10 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:14:50.203855 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-152fab4a-a78d-4d34-8bbf-b14560b22387 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:50.223269 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-06ecff62-3d5b-4647-af37-0a0d8e515151 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:50.224192 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-152fab4a-a78d-4d34-8bbf-b14560b22387 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050" status: 200 len: 1736 microversion: 2.1 time: 0.689563 Aug 31 16:14:50.224793 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2503/4812] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:49 2022] GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050 => generated 1736 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:14:50.230989 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-41936753-3090-413f-a18d-72b09fc7b3e8 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:50.231965 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-41936753-3090-413f-a18d-72b09fc7b3e8 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: e1cb02b7-1dd6-4c83-9008-e19525731e03] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:50.243364 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-06ecff62-3d5b-4647-af37-0a0d8e515151 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef" status: 200 len: 1367 microversion: 2.1 time: 0.780373 Aug 31 16:14:50.246111 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-41936753-3090-413f-a18d-72b09fc7b3e8 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:50.258200 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2310/4813] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:49 2022] GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef => generated 1367 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:50.260164 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-41936753-3090-413f-a18d-72b09fc7b3e8 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:50.261225 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-41936753-3090-413f-a18d-72b09fc7b3e8 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:50.261993 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-41936753-3090-413f-a18d-72b09fc7b3e8 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:50.262505 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-41936753-3090-413f-a18d-72b09fc7b3e8 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:50.262940 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-41936753-3090-413f-a18d-72b09fc7b3e8 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:50.263377 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-57dcf83c-17ed-4962-9fbb-94e776af7cc0 req-ef464db0-4ae5-4728-ac35-99700543dbea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "802a1cc5-9787-47d9-87d5-e3fa912d7712", "name": "network-vif-plugged", "status": "completed", "tag": "0106e3d6-aeae-4314-8e0c-0a661954a14f"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:50.295083 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-57dcf83c-17ed-4962-9fbb-94e776af7cc0 req-ef464db0-4ae5-4728-ac35-99700543dbea service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:50.295637 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-57dcf83c-17ed-4962-9fbb-94e776af7cc0 req-ef464db0-4ae5-4728-ac35-99700543dbea service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:50.296982 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-57dcf83c-17ed-4962-9fbb-94e776af7cc0 req-ef464db0-4ae5-4728-ac35-99700543dbea service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:50.334198 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-57dcf83c-17ed-4962-9fbb-94e776af7cc0 req-ef464db0-4ae5-4728-ac35-99700543dbea service nova] Creating event network-vif-plugged:0106e3d6-aeae-4314-8e0c-0a661954a14f for instance 802a1cc5-9787-47d9-87d5-e3fa912d7712 on n-h1-833090-16 Aug 31 16:14:50.346256 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-57dcf83c-17ed-4962-9fbb-94e776af7cc0 req-ef464db0-4ae5-4728-ac35-99700543dbea service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095906 Aug 31 16:14:50.348455 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2311/4814] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:14:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:14:50.362150 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2870af4a-dd16-4552-9cd9-e300c9d8525e tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:50.363034 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2870af4a-dd16-4552-9cd9-e300c9d8525e tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] [instance: 802a1cc5-9787-47d9-87d5-e3fa912d7712] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:50.381582 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2870af4a-dd16-4552-9cd9-e300c9d8525e tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:50.383823 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2870af4a-dd16-4552-9cd9-e300c9d8525e tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:50.384418 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2870af4a-dd16-4552-9cd9-e300c9d8525e tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:50.385280 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2870af4a-dd16-4552-9cd9-e300c9d8525e tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:50.389199 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2870af4a-dd16-4552-9cd9-e300c9d8525e tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:50.389992 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2870af4a-dd16-4552-9cd9-e300c9d8525e tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:50.856137 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-41936753-3090-413f-a18d-72b09fc7b3e8 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:50.870317 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-41936753-3090-413f-a18d-72b09fc7b3e8 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03" status: 200 len: 1391 microversion: 2.1 time: 0.641969 Aug 31 16:14:50.870317 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2504/4815] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:50 2022] GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03 => generated 1391 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:50.913319 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2870af4a-dd16-4552-9cd9-e300c9d8525e tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b130aecc1794cfc9fe0a9a80d558bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2579dc4a344c2998e30915ea51b2ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:50.922131 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2870af4a-dd16-4552-9cd9-e300c9d8525e tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] 10.222.0.50 "GET /compute/v2.1/servers/802a1cc5-9787-47d9-87d5-e3fa912d7712" status: 200 len: 1328 microversion: 2.1 time: 0.571658 Aug 31 16:14:50.923113 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2312/4816] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:50 2022] GET /compute/v2.1/servers/802a1cc5-9787-47d9-87d5-e3fa912d7712 => generated 1328 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:51.271125 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-590154fb-1bcc-4193-8dee-3d2e66520f22 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:51.271125 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-590154fb-1bcc-4193-8dee-3d2e66520f22 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 1c40a98f-366d-4392-9034-7841f68b2050] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:51.277685 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d5c4a867-f6e2-43e8-b474-76133d614e22 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:51.278458 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d5c4a867-f6e2-43e8-b474-76133d614e22 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:51.309002 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5c4a867-f6e2-43e8-b474-76133d614e22 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:51.313072 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5c4a867-f6e2-43e8-b474-76133d614e22 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:51.317677 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5c4a867-f6e2-43e8-b474-76133d614e22 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:51.318757 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5c4a867-f6e2-43e8-b474-76133d614e22 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:51.327784 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5c4a867-f6e2-43e8-b474-76133d614e22 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:51.328665 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d5c4a867-f6e2-43e8-b474-76133d614e22 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:51.331134 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-590154fb-1bcc-4193-8dee-3d2e66520f22 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:51.331649 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-590154fb-1bcc-4193-8dee-3d2e66520f22 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:51.332209 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-590154fb-1bcc-4193-8dee-3d2e66520f22 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:51.332937 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-590154fb-1bcc-4193-8dee-3d2e66520f22 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:51.333610 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-590154fb-1bcc-4193-8dee-3d2e66520f22 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:51.333817 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-590154fb-1bcc-4193-8dee-3d2e66520f22 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:51.841132 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d5c4a867-f6e2-43e8-b474-76133d614e22 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:51.881301 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d5c4a867-f6e2-43e8-b474-76133d614e22 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef" status: 200 len: 1367 microversion: 2.1 time: 0.597430 Aug 31 16:14:51.898021 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2313/4817] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:51 2022] GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef => generated 1367 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:51.918960 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-49a3eae6-63b7-40a3-907a-2adbcb3a1606 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:51.921529 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-49a3eae6-63b7-40a3-907a-2adbcb3a1606 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: e1cb02b7-1dd6-4c83-9008-e19525731e03] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:51.926357 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-590154fb-1bcc-4193-8dee-3d2e66520f22 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:51.933420 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49a3eae6-63b7-40a3-907a-2adbcb3a1606 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:51.934637 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49a3eae6-63b7-40a3-907a-2adbcb3a1606 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:51.935753 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49a3eae6-63b7-40a3-907a-2adbcb3a1606 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:51.940003 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49a3eae6-63b7-40a3-907a-2adbcb3a1606 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:51.941319 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49a3eae6-63b7-40a3-907a-2adbcb3a1606 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:51.942506 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49a3eae6-63b7-40a3-907a-2adbcb3a1606 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:51.953796 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-590154fb-1bcc-4193-8dee-3d2e66520f22 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050" status: 200 len: 1736 microversion: 2.1 time: 0.697924 Aug 31 16:14:51.957559 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2505/4818] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:51 2022] GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050 => generated 1736 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:51.970608 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-268c8f94-700b-4aa0-8425-a87006812735 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:51.972294 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-268c8f94-700b-4aa0-8425-a87006812735 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] [instance: 802a1cc5-9787-47d9-87d5-e3fa912d7712] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:51.987951 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-268c8f94-700b-4aa0-8425-a87006812735 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:51.988713 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-268c8f94-700b-4aa0-8425-a87006812735 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:51.990350 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-268c8f94-700b-4aa0-8425-a87006812735 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:51.994796 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-268c8f94-700b-4aa0-8425-a87006812735 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:51.995758 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-268c8f94-700b-4aa0-8425-a87006812735 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:51.997018 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-268c8f94-700b-4aa0-8425-a87006812735 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:52.461359 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-49a3eae6-63b7-40a3-907a-2adbcb3a1606 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:52.479668 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-49a3eae6-63b7-40a3-907a-2adbcb3a1606 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03" status: 200 len: 1391 microversion: 2.1 time: 0.578954 Aug 31 16:14:52.481448 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2314/4819] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:51 2022] GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03 => generated 1391 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:52.507132 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-51bdc963-051b-4afb-8639-3e0c9ed86f24 req-96066525-99f5-45fe-89b4-b3a27a8da20d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1cb02b7-1dd6-4c83-9008-e19525731e03", "name": "network-vif-plugged", "status": "completed", "tag": "aad14830-ef68-4e56-bff4-91dbcf99efc3"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:52.521676 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-51bdc963-051b-4afb-8639-3e0c9ed86f24 req-96066525-99f5-45fe-89b4-b3a27a8da20d service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:52.524230 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-51bdc963-051b-4afb-8639-3e0c9ed86f24 req-96066525-99f5-45fe-89b4-b3a27a8da20d service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:52.524734 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-51bdc963-051b-4afb-8639-3e0c9ed86f24 req-96066525-99f5-45fe-89b4-b3a27a8da20d service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:52.538402 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-268c8f94-700b-4aa0-8425-a87006812735 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b130aecc1794cfc9fe0a9a80d558bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2579dc4a344c2998e30915ea51b2ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:52.544505 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-51bdc963-051b-4afb-8639-3e0c9ed86f24 req-96066525-99f5-45fe-89b4-b3a27a8da20d service nova] Creating event network-vif-plugged:aad14830-ef68-4e56-bff4-91dbcf99efc3 for instance e1cb02b7-1dd6-4c83-9008-e19525731e03 on n-h2-833090-16 Aug 31 16:14:52.556254 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-51bdc963-051b-4afb-8639-3e0c9ed86f24 req-96066525-99f5-45fe-89b4-b3a27a8da20d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071082 Aug 31 16:14:52.557366 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-268c8f94-700b-4aa0-8425-a87006812735 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] 10.222.0.50 "GET /compute/v2.1/servers/802a1cc5-9787-47d9-87d5-e3fa912d7712" status: 200 len: 1527 microversion: 2.1 time: 0.597531 Aug 31 16:14:52.561244 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2506/4820] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:51 2022] GET /compute/v2.1/servers/802a1cc5-9787-47d9-87d5-e3fa912d7712 => generated 1527 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:52.565078 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2315/4821] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:14:52.592516 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ceb8db43-e280-44ab-b35e-9b0626f97d4c tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:52.594061 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ceb8db43-e280-44ab-b35e-9b0626f97d4c tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] [instance: 802a1cc5-9787-47d9-87d5-e3fa912d7712] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:52.605033 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ceb8db43-e280-44ab-b35e-9b0626f97d4c tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:52.605936 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ceb8db43-e280-44ab-b35e-9b0626f97d4c tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:52.606657 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ceb8db43-e280-44ab-b35e-9b0626f97d4c tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:52.607787 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ceb8db43-e280-44ab-b35e-9b0626f97d4c tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:52.608443 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ceb8db43-e280-44ab-b35e-9b0626f97d4c tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:52.609026 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ceb8db43-e280-44ab-b35e-9b0626f97d4c tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:52.707775 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-51bdc963-051b-4afb-8639-3e0c9ed86f24 req-96066525-99f5-45fe-89b4-b3a27a8da20d service nova] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:52.712708 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-51bdc963-051b-4afb-8639-3e0c9ed86f24 req-96066525-99f5-45fe-89b4-b3a27a8da20d service nova] 10.222.0.50 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002339 Aug 31 16:14:52.714648 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2316/4822] 10.222.0.50 () {56 vars in 886 bytes} [Wed Aug 31 16:14:52 2022] GET /compute/ => generated 377 bytes in 8 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 31 16:14:52.853382 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ceb8db43-e280-44ab-b35e-9b0626f97d4c tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b130aecc1794cfc9fe0a9a80d558bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2579dc4a344c2998e30915ea51b2ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:52.865592 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ceb8db43-e280-44ab-b35e-9b0626f97d4c tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] 10.222.0.50 "GET /compute/v2.1/servers/802a1cc5-9787-47d9-87d5-e3fa912d7712" status: 200 len: 1527 microversion: 2.1 time: 0.284163 Aug 31 16:14:52.867404 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2507/4823] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:52 2022] GET /compute/v2.1/servers/802a1cc5-9787-47d9-87d5-e3fa912d7712 => generated 1527 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:52.921822 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b9b93d68-ee00-4a61-a023-f6eb42b9aff3 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:52.922459 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b9b93d68-ee00-4a61-a023-f6eb42b9aff3 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:52.934608 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b9b93d68-ee00-4a61-a023-f6eb42b9aff3 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:52.935523 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b9b93d68-ee00-4a61-a023-f6eb42b9aff3 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:52.935523 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b9b93d68-ee00-4a61-a023-f6eb42b9aff3 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:52.936318 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b9b93d68-ee00-4a61-a023-f6eb42b9aff3 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:52.936835 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b9b93d68-ee00-4a61-a023-f6eb42b9aff3 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:52.937322 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b9b93d68-ee00-4a61-a023-f6eb42b9aff3 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:53.165986 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b9b93d68-ee00-4a61-a023-f6eb42b9aff3 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:53.186947 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b9b93d68-ee00-4a61-a023-f6eb42b9aff3 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef" status: 200 len: 1367 microversion: 2.1 time: 0.269074 Aug 31 16:14:53.187588 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2508/4824] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:52 2022] GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef => generated 1367 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:53.196608 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-704a379d-cc20-45df-afa8-383e1ae8a3a2 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:53.197597 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-704a379d-cc20-45df-afa8-383e1ae8a3a2 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 1c40a98f-366d-4392-9034-7841f68b2050] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:53.215092 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-704a379d-cc20-45df-afa8-383e1ae8a3a2 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:53.215917 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-704a379d-cc20-45df-afa8-383e1ae8a3a2 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:53.216583 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-704a379d-cc20-45df-afa8-383e1ae8a3a2 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:53.217506 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-704a379d-cc20-45df-afa8-383e1ae8a3a2 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:53.218204 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-704a379d-cc20-45df-afa8-383e1ae8a3a2 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:53.218797 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-704a379d-cc20-45df-afa8-383e1ae8a3a2 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:53.407082 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-660173cb-12d8-4be3-8c98-3f0b08f487cb tempest-ServersNegativeTestMultiTenantJSON-1490662422 tempest-ServersNegativeTestMultiTenantJSON-1490662422-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:53.407962 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-660173cb-12d8-4be3-8c98-3f0b08f487cb tempest-ServersNegativeTestMultiTenantJSON-1490662422 tempest-ServersNegativeTestMultiTenantJSON-1490662422-project] [instance: 802a1cc5-9787-47d9-87d5-e3fa912d7712] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:53.419556 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-660173cb-12d8-4be3-8c98-3f0b08f487cb tempest-ServersNegativeTestMultiTenantJSON-1490662422 tempest-ServersNegativeTestMultiTenantJSON-1490662422-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:53.423190 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-660173cb-12d8-4be3-8c98-3f0b08f487cb tempest-ServersNegativeTestMultiTenantJSON-1490662422 tempest-ServersNegativeTestMultiTenantJSON-1490662422-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:53.424815 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-660173cb-12d8-4be3-8c98-3f0b08f487cb tempest-ServersNegativeTestMultiTenantJSON-1490662422 tempest-ServersNegativeTestMultiTenantJSON-1490662422-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:53.427159 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-660173cb-12d8-4be3-8c98-3f0b08f487cb tempest-ServersNegativeTestMultiTenantJSON-1490662422 tempest-ServersNegativeTestMultiTenantJSON-1490662422-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:53.427838 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-660173cb-12d8-4be3-8c98-3f0b08f487cb tempest-ServersNegativeTestMultiTenantJSON-1490662422 tempest-ServersNegativeTestMultiTenantJSON-1490662422-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:53.429884 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-660173cb-12d8-4be3-8c98-3f0b08f487cb tempest-ServersNegativeTestMultiTenantJSON-1490662422 tempest-ServersNegativeTestMultiTenantJSON-1490662422-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:53.463248 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-660173cb-12d8-4be3-8c98-3f0b08f487cb tempest-ServersNegativeTestMultiTenantJSON-1490662422 tempest-ServersNegativeTestMultiTenantJSON-1490662422-project] HTTP exception thrown: Instance 802a1cc5-9787-47d9-87d5-e3fa912d7712 could not be found. Aug 31 16:14:53.468402 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-660173cb-12d8-4be3-8c98-3f0b08f487cb tempest-ServersNegativeTestMultiTenantJSON-1490662422 tempest-ServersNegativeTestMultiTenantJSON-1490662422-project] Request method failure captured: Aug 31 16:14:53.468402 n-d-833090-16 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/802a1cc5-9787-47d9-87d5-e3fa912d7712 HTTP/1.1 Aug 31 16:14:53.468402 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:14:53.468402 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:14:53.468402 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:14:53.468402 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:14:53.468402 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:14:53.468402 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:14:53.468402 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:14:53.468402 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:14:53.468402 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4jhSkkGcGb40r4K-eZlzxm30ZH3lkeGD2S0G4BVaWxl8-mA0OzVgh14BZOo6wfg5PyMxXTiyZj07cscYOzr5f9-DGDCmjGuPWTgYu0aSP3Zy9kKXNjlCCGyXcgsFdeTGjJfXrsAFbd_v62OcyKsQJuIgkRla_c70TO2QIsVQHBZU7g Aug 31 16:14:53.468402 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:14:53.468402 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:14:53.468402 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:14:53.468402 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:14:53.468402 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:14:53.468402 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:14:53.468402 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 057feb00764b47daa18281e523914572 Aug 31 16:14:53.468402 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1490662422 Aug 31 16:14:53.468402 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:14:53.468402 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:14:53.468402 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/057feb00764b47daa18281e523914572"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/057feb00764b47daa18281e523914572"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/057feb00764b47daa18281e523914572"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_057feb00764b47daa18281e523914572", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:14:53.468402 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1490662422 Aug 31 16:14:53.468402 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 057feb00764b47daa18281e523914572 Aug 31 16:14:53.468402 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1490662422 Aug 31 16:14:53.468402 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1490662422-project Aug 31 16:14:53.468402 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:14:53.468402 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:14:53.468402 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 7be628d42de3442db55520a968c58709 Aug 31 16:14:53.468402 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1490662422-project Aug 31 16:14:53.468402 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:14:53.468402 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 802a1cc5-9787-47d9-87d5-e3fa912d7712 could not be found. Aug 31 16:14:53.468402 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '802a1cc5-9787-47d9-87d5-e3fa912d7712'} Aug 31 16:14:53.468402 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:14:53.468402 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:53.468402 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:14:53.468402 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:14:53.468402 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:14:53.468402 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:14:53.468402 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:14:53.468402 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:14:53.468402 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:14:53.468402 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:14:53.468402 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 802a1cc5-9787-47d9-87d5-e3fa912d7712 could not be found. Aug 31 16:14:53.468402 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:53.468402 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:53.468402 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:53.468402 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:53.468402 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:53.468402 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:53.468402 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:14:53.468402 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:14:53.468402 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:14:53.468402 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:14:53.468402 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:14:53.468402 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:14:53.468402 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:14:53.468402 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:14:53.468402 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:14:53.468402 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:14:53.468402 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:14:53.468402 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:14:53.483214 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 802a1cc5-9787-47d9-87d5-e3fa912d7712 could not be found. Aug 31 16:14:53.483214 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:53.483214 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:53.483214 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:53.483214 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:53.483214 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:53.483214 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:53.483214 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:14:53.483214 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:14:53.483214 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 802a1cc5-9787-47d9-87d5-e3fa912d7712 could not be found. Aug 31 16:14:53.483214 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:53.483214 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-660173cb-12d8-4be3-8c98-3f0b08f487cb tempest-ServersNegativeTestMultiTenantJSON-1490662422 tempest-ServersNegativeTestMultiTenantJSON-1490662422-project] Returning 404 to user: Instance 802a1cc5-9787-47d9-87d5-e3fa912d7712 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:14:53.483214 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-660173cb-12d8-4be3-8c98-3f0b08f487cb tempest-ServersNegativeTestMultiTenantJSON-1490662422 tempest-ServersNegativeTestMultiTenantJSON-1490662422-project] 10.222.0.50 "DELETE /compute/v2.1/servers/802a1cc5-9787-47d9-87d5-e3fa912d7712" status: 404 len: 111 microversion: 2.1 time: 0.586926 Aug 31 16:14:53.483214 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2317/4825] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:14:52 2022] DELETE /compute/v2.1/servers/802a1cc5-9787-47d9-87d5-e3fa912d7712 => generated 111 bytes in 588 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:14:53.483214 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7c98eebd-86e4-477e-8cd1-de4e15a651a6 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:53.483214 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7c98eebd-86e4-477e-8cd1-de4e15a651a6 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] [instance: 802a1cc5-9787-47d9-87d5-e3fa912d7712] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:53.496457 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c98eebd-86e4-477e-8cd1-de4e15a651a6 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:53.496457 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c98eebd-86e4-477e-8cd1-de4e15a651a6 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:53.501475 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c98eebd-86e4-477e-8cd1-de4e15a651a6 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:53.503967 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c98eebd-86e4-477e-8cd1-de4e15a651a6 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:53.504449 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c98eebd-86e4-477e-8cd1-de4e15a651a6 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:53.504892 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c98eebd-86e4-477e-8cd1-de4e15a651a6 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:53.822821 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-704a379d-cc20-45df-afa8-383e1ae8a3a2 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:53.846072 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-704a379d-cc20-45df-afa8-383e1ae8a3a2 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050" status: 200 len: 1736 microversion: 2.1 time: 0.656749 Aug 31 16:14:53.847981 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2509/4826] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:53 2022] GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050 => generated 1736 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:53.860801 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a18b8da1-78ce-4af5-9d67-3cf5008a1077 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:53.862681 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a18b8da1-78ce-4af5-9d67-3cf5008a1077 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: e1cb02b7-1dd6-4c83-9008-e19525731e03] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:53.885497 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a18b8da1-78ce-4af5-9d67-3cf5008a1077 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:53.887732 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a18b8da1-78ce-4af5-9d67-3cf5008a1077 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:53.889168 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a18b8da1-78ce-4af5-9d67-3cf5008a1077 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:53.890159 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a18b8da1-78ce-4af5-9d67-3cf5008a1077 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:53.893058 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a18b8da1-78ce-4af5-9d67-3cf5008a1077 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:53.894479 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a18b8da1-78ce-4af5-9d67-3cf5008a1077 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:53.916810 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7c98eebd-86e4-477e-8cd1-de4e15a651a6 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b130aecc1794cfc9fe0a9a80d558bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2579dc4a344c2998e30915ea51b2ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:53.937721 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7c98eebd-86e4-477e-8cd1-de4e15a651a6 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] 10.222.0.50 "GET /compute/v2.1/servers/802a1cc5-9787-47d9-87d5-e3fa912d7712" status: 200 len: 1527 microversion: 2.1 time: 0.458887 Aug 31 16:14:53.938793 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2318/4827] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:53 2022] GET /compute/v2.1/servers/802a1cc5-9787-47d9-87d5-e3fa912d7712 => generated 1527 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:53.974341 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b752510d-d59d-4e55-8a31-e66aa5fe4d81 tempest-ServersNegativeTestMultiTenantJSON-1490662422 tempest-ServersNegativeTestMultiTenantJSON-1490662422-project] Action: 'update', calling method: >, body: {"server": {"name": "802a1cc5-9787-47d9-87d5-e3fa912d7712_new"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:53.977288 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b752510d-d59d-4e55-8a31-e66aa5fe4d81 tempest-ServersNegativeTestMultiTenantJSON-1490662422 tempest-ServersNegativeTestMultiTenantJSON-1490662422-project] [instance: 802a1cc5-9787-47d9-87d5-e3fa912d7712] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:53.985387 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b752510d-d59d-4e55-8a31-e66aa5fe4d81 tempest-ServersNegativeTestMultiTenantJSON-1490662422 tempest-ServersNegativeTestMultiTenantJSON-1490662422-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:53.986233 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b752510d-d59d-4e55-8a31-e66aa5fe4d81 tempest-ServersNegativeTestMultiTenantJSON-1490662422 tempest-ServersNegativeTestMultiTenantJSON-1490662422-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:53.986864 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b752510d-d59d-4e55-8a31-e66aa5fe4d81 tempest-ServersNegativeTestMultiTenantJSON-1490662422 tempest-ServersNegativeTestMultiTenantJSON-1490662422-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:53.987891 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b752510d-d59d-4e55-8a31-e66aa5fe4d81 tempest-ServersNegativeTestMultiTenantJSON-1490662422 tempest-ServersNegativeTestMultiTenantJSON-1490662422-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:53.988625 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b752510d-d59d-4e55-8a31-e66aa5fe4d81 tempest-ServersNegativeTestMultiTenantJSON-1490662422 tempest-ServersNegativeTestMultiTenantJSON-1490662422-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:53.989222 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b752510d-d59d-4e55-8a31-e66aa5fe4d81 tempest-ServersNegativeTestMultiTenantJSON-1490662422 tempest-ServersNegativeTestMultiTenantJSON-1490662422-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:54.013031 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-b752510d-d59d-4e55-8a31-e66aa5fe4d81 tempest-ServersNegativeTestMultiTenantJSON-1490662422 tempest-ServersNegativeTestMultiTenantJSON-1490662422-project] HTTP exception thrown: Instance 802a1cc5-9787-47d9-87d5-e3fa912d7712 could not be found. Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b752510d-d59d-4e55-8a31-e66aa5fe4d81 tempest-ServersNegativeTestMultiTenantJSON-1490662422 tempest-ServersNegativeTestMultiTenantJSON-1490662422-project] Request method failure captured: Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: request: PUT /compute/v2.1/servers/802a1cc5-9787-47d9-87d5-e3fa912d7712 HTTP/1.1 Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 64 Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4jhSkkGcGb40r4K-eZlzxm30ZH3lkeGD2S0G4BVaWxl8-mA0OzVgh14BZOo6wfg5PyMxXTiyZj07cscYOzr5f9-DGDCmjGuPWTgYu0aSP3Zy9kKXNjlCCGyXcgsFdeTGjJfXrsAFbd_v62OcyKsQJuIgkRla_c70TO2QIsVQHBZU7g Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 057feb00764b47daa18281e523914572 Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1490662422 Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/057feb00764b47daa18281e523914572"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/057feb00764b47daa18281e523914572"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/057feb00764b47daa18281e523914572"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_057feb00764b47daa18281e523914572", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1490662422 Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 057feb00764b47daa18281e523914572 Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1490662422 Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1490662422-project Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 7be628d42de3442db55520a968c58709 Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1490662422-project Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: {"server": {"name": "802a1cc5-9787-47d9-87d5-e3fa912d7712_new"}} Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 802a1cc5-9787-47d9-87d5-e3fa912d7712 could not be found. Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '802a1cc5-9787-47d9-87d5-e3fa912d7712', 'body': {'server': {'name': '802a1cc5-9787-47d9-87d5-e3fa912d7712_new'}}} Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 802a1cc5-9787-47d9-87d5-e3fa912d7712 could not be found. Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:14:54.016881 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 31 16:14:54.033891 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 31 16:14:54.033891 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 31 16:14:54.033891 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:14:54.033891 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:14:54.033891 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:14:54.033891 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:14:54.033891 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 802a1cc5-9787-47d9-87d5-e3fa912d7712 could not be found. Aug 31 16:14:54.033891 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:54.033891 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:14:54.033891 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:54.033891 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:14:54.033891 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:14:54.033891 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:14:54.033891 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:14:54.033891 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:14:54.033891 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 802a1cc5-9787-47d9-87d5-e3fa912d7712 could not be found. Aug 31 16:14:54.033891 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:14:54.042287 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b752510d-d59d-4e55-8a31-e66aa5fe4d81 tempest-ServersNegativeTestMultiTenantJSON-1490662422 tempest-ServersNegativeTestMultiTenantJSON-1490662422-project] Returning 404 to user: Instance 802a1cc5-9787-47d9-87d5-e3fa912d7712 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:14:54.042898 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b752510d-d59d-4e55-8a31-e66aa5fe4d81 tempest-ServersNegativeTestMultiTenantJSON-1490662422 tempest-ServersNegativeTestMultiTenantJSON-1490662422-project] 10.222.0.50 "PUT /compute/v2.1/servers/802a1cc5-9787-47d9-87d5-e3fa912d7712" status: 404 len: 111 microversion: 2.1 time: 0.067752 Aug 31 16:14:54.044355 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2319/4828] 10.222.0.50 () {60 vars in 1256 bytes} [Wed Aug 31 16:14:53 2022] PUT /compute/v2.1/servers/802a1cc5-9787-47d9-87d5-e3fa912d7712 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:14:54.058946 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fdcb1945-59d9-4e07-a99f-fa662602cb4f tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:54.059683 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fdcb1945-59d9-4e07-a99f-fa662602cb4f tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] [instance: 802a1cc5-9787-47d9-87d5-e3fa912d7712] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:54.068573 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fdcb1945-59d9-4e07-a99f-fa662602cb4f tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:54.069445 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fdcb1945-59d9-4e07-a99f-fa662602cb4f tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:54.070384 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fdcb1945-59d9-4e07-a99f-fa662602cb4f tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:54.072118 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fdcb1945-59d9-4e07-a99f-fa662602cb4f tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:54.073281 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fdcb1945-59d9-4e07-a99f-fa662602cb4f tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:54.075213 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fdcb1945-59d9-4e07-a99f-fa662602cb4f tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:54.124187 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fdcb1945-59d9-4e07-a99f-fa662602cb4f tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] [instance: 802a1cc5-9787-47d9-87d5-e3fa912d7712] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:14:54.192805 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a18b8da1-78ce-4af5-9d67-3cf5008a1077 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:54.209992 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a18b8da1-78ce-4af5-9d67-3cf5008a1077 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03" status: 200 len: 1391 microversion: 2.1 time: 0.357706 Aug 31 16:14:54.211409 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2510/4829] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:53 2022] GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03 => generated 1391 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:54.233173 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-84ad35f4-ddc5-4451-a47c-fd9ccab7d3b3 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:54.234026 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-84ad35f4-ddc5-4451-a47c-fd9ccab7d3b3 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:54.244179 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-84ad35f4-ddc5-4451-a47c-fd9ccab7d3b3 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:54.245421 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-84ad35f4-ddc5-4451-a47c-fd9ccab7d3b3 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:54.246305 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-84ad35f4-ddc5-4451-a47c-fd9ccab7d3b3 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:54.247546 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-84ad35f4-ddc5-4451-a47c-fd9ccab7d3b3 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:54.248858 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-84ad35f4-ddc5-4451-a47c-fd9ccab7d3b3 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:54.249459 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-84ad35f4-ddc5-4451-a47c-fd9ccab7d3b3 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:54.322899 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fdcb1945-59d9-4e07-a99f-fa662602cb4f tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] 10.222.0.50 "DELETE /compute/v2.1/servers/802a1cc5-9787-47d9-87d5-e3fa912d7712" status: 204 len: 0 microversion: 2.1 time: 0.270993 Aug 31 16:14:54.324041 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2320/4830] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:14:54 2022] DELETE /compute/v2.1/servers/802a1cc5-9787-47d9-87d5-e3fa912d7712 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 16:14:54.344564 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-37b30a14-163d-4a53-a9a1-bb83a422468d tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:54.346979 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-37b30a14-163d-4a53-a9a1-bb83a422468d tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] [instance: 802a1cc5-9787-47d9-87d5-e3fa912d7712] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:54.370482 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37b30a14-163d-4a53-a9a1-bb83a422468d tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:54.371621 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37b30a14-163d-4a53-a9a1-bb83a422468d tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:54.374072 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37b30a14-163d-4a53-a9a1-bb83a422468d tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:54.376218 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37b30a14-163d-4a53-a9a1-bb83a422468d tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:54.377695 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37b30a14-163d-4a53-a9a1-bb83a422468d tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:54.378934 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-37b30a14-163d-4a53-a9a1-bb83a422468d tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:54.517904 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-84ad35f4-ddc5-4451-a47c-fd9ccab7d3b3 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:54.532917 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-84ad35f4-ddc5-4451-a47c-fd9ccab7d3b3 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef" status: 200 len: 1367 microversion: 2.1 time: 0.319718 Aug 31 16:14:54.534360 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2511/4831] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:54 2022] GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef => generated 1367 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:54.775306 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-37b30a14-163d-4a53-a9a1-bb83a422468d tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b130aecc1794cfc9fe0a9a80d558bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2579dc4a344c2998e30915ea51b2ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:54.797699 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-37b30a14-163d-4a53-a9a1-bb83a422468d tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] 10.222.0.50 "GET /compute/v2.1/servers/802a1cc5-9787-47d9-87d5-e3fa912d7712" status: 200 len: 1533 microversion: 2.1 time: 0.467210 Aug 31 16:14:54.801514 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2321/4832] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:54 2022] GET /compute/v2.1/servers/802a1cc5-9787-47d9-87d5-e3fa912d7712 => generated 1533 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:54.873999 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d2d98987-e25d-4580-bfe7-6b809bf92e48 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:54.876073 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d2d98987-e25d-4580-bfe7-6b809bf92e48 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 1c40a98f-366d-4392-9034-7841f68b2050] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:54.890132 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d2d98987-e25d-4580-bfe7-6b809bf92e48 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:54.890719 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d2d98987-e25d-4580-bfe7-6b809bf92e48 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:54.890970 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d2d98987-e25d-4580-bfe7-6b809bf92e48 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:54.891935 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d2d98987-e25d-4580-bfe7-6b809bf92e48 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:54.892628 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d2d98987-e25d-4580-bfe7-6b809bf92e48 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:54.893373 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d2d98987-e25d-4580-bfe7-6b809bf92e48 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:55.243776 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-02b945b4-0dc1-4414-8db2-0a5ce519d716 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:55.249350 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-02b945b4-0dc1-4414-8db2-0a5ce519d716 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: e1cb02b7-1dd6-4c83-9008-e19525731e03] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:55.283377 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02b945b4-0dc1-4414-8db2-0a5ce519d716 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:55.290020 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02b945b4-0dc1-4414-8db2-0a5ce519d716 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:55.291425 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02b945b4-0dc1-4414-8db2-0a5ce519d716 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:55.292979 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02b945b4-0dc1-4414-8db2-0a5ce519d716 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:55.294940 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02b945b4-0dc1-4414-8db2-0a5ce519d716 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:55.295958 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02b945b4-0dc1-4414-8db2-0a5ce519d716 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:55.535633 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d2d98987-e25d-4580-bfe7-6b809bf92e48 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:55.560648 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d2d98987-e25d-4580-bfe7-6b809bf92e48 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050" status: 200 len: 1736 microversion: 2.1 time: 0.685097 Aug 31 16:14:55.561525 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2512/4833] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:54 2022] GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050 => generated 1736 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:55.570997 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ef3964b1-a865-4f2a-8a17-43fb137b0d22 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:55.570997 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ef3964b1-a865-4f2a-8a17-43fb137b0d22 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:55.604234 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ef3964b1-a865-4f2a-8a17-43fb137b0d22 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:55.606897 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ef3964b1-a865-4f2a-8a17-43fb137b0d22 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:55.608662 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ef3964b1-a865-4f2a-8a17-43fb137b0d22 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:55.610654 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ef3964b1-a865-4f2a-8a17-43fb137b0d22 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:55.611947 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ef3964b1-a865-4f2a-8a17-43fb137b0d22 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:55.613101 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ef3964b1-a865-4f2a-8a17-43fb137b0d22 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:55.779390 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-02b945b4-0dc1-4414-8db2-0a5ce519d716 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:55.792330 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-02b945b4-0dc1-4414-8db2-0a5ce519d716 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03" status: 200 len: 1563 microversion: 2.1 time: 0.559024 Aug 31 16:14:55.819296 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2322/4834] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:55 2022] GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03 => generated 1563 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:55.830017 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-35de2b48-79fc-44e4-9557-f350313b2641 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:55.831393 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-35de2b48-79fc-44e4-9557-f350313b2641 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: e1cb02b7-1dd6-4c83-9008-e19525731e03] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:55.841639 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-35de2b48-79fc-44e4-9557-f350313b2641 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:55.842534 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-35de2b48-79fc-44e4-9557-f350313b2641 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:55.843338 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-35de2b48-79fc-44e4-9557-f350313b2641 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:55.844560 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-35de2b48-79fc-44e4-9557-f350313b2641 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:55.845550 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-35de2b48-79fc-44e4-9557-f350313b2641 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:55.846307 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-35de2b48-79fc-44e4-9557-f350313b2641 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:56.014301 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ef3964b1-a865-4f2a-8a17-43fb137b0d22 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:56.043407 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ef3964b1-a865-4f2a-8a17-43fb137b0d22 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef" status: 200 len: 1367 microversion: 2.1 time: 0.469298 Aug 31 16:14:56.044485 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2513/4835] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:55 2022] GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef => generated 1367 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:56.064081 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-43189cbb-22a4-4a50-960e-36ffea78bbc2 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:56.065275 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-43189cbb-22a4-4a50-960e-36ffea78bbc2 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] [instance: 802a1cc5-9787-47d9-87d5-e3fa912d7712] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:56.107121 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-43189cbb-22a4-4a50-960e-36ffea78bbc2 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:56.107954 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-43189cbb-22a4-4a50-960e-36ffea78bbc2 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:56.108708 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-43189cbb-22a4-4a50-960e-36ffea78bbc2 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:56.109946 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-43189cbb-22a4-4a50-960e-36ffea78bbc2 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:56.110777 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-43189cbb-22a4-4a50-960e-36ffea78bbc2 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:56.111501 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-43189cbb-22a4-4a50-960e-36ffea78bbc2 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:56.535301 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-35de2b48-79fc-44e4-9557-f350313b2641 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:56.558067 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-35de2b48-79fc-44e4-9557-f350313b2641 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03" status: 200 len: 1563 microversion: 2.1 time: 0.735365 Aug 31 16:14:56.563565 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2323/4836] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:55 2022] GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03 => generated 1563 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:14:56.595868 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4c1c6a1b-9609-4104-89d0-307249f00ebb tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:56.597294 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4c1c6a1b-9609-4104-89d0-307249f00ebb tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 1c40a98f-366d-4392-9034-7841f68b2050] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:56.653058 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c1c6a1b-9609-4104-89d0-307249f00ebb tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:56.656453 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c1c6a1b-9609-4104-89d0-307249f00ebb tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:56.657953 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c1c6a1b-9609-4104-89d0-307249f00ebb tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:56.660428 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c1c6a1b-9609-4104-89d0-307249f00ebb tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:56.661497 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c1c6a1b-9609-4104-89d0-307249f00ebb tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:56.662602 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c1c6a1b-9609-4104-89d0-307249f00ebb tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:56.736769 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-43189cbb-22a4-4a50-960e-36ffea78bbc2 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b130aecc1794cfc9fe0a9a80d558bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2579dc4a344c2998e30915ea51b2ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:56.766580 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-43189cbb-22a4-4a50-960e-36ffea78bbc2 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] 10.222.0.50 "GET /compute/v2.1/servers/802a1cc5-9787-47d9-87d5-e3fa912d7712" status: 200 len: 1533 microversion: 2.1 time: 0.718216 Aug 31 16:14:56.779542 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2514/4837] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:56 2022] GET /compute/v2.1/servers/802a1cc5-9787-47d9-87d5-e3fa912d7712 => generated 1533 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:56.803658 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-a6e3f82b-2644-40bf-bc49-03fdadb2e8f2 req-0d071f6e-e53c-47ee-b55b-ddf4b1e65b27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef", "name": "network-vif-plugged", "status": "completed", "tag": "59ca6f67-7dec-4e2b-a15d-4746e8c56b32"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:56.836216 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-a6e3f82b-2644-40bf-bc49-03fdadb2e8f2 req-0d071f6e-e53c-47ee-b55b-ddf4b1e65b27 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:56.849513 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-a6e3f82b-2644-40bf-bc49-03fdadb2e8f2 req-0d071f6e-e53c-47ee-b55b-ddf4b1e65b27 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:56.853629 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-a6e3f82b-2644-40bf-bc49-03fdadb2e8f2 req-0d071f6e-e53c-47ee-b55b-ddf4b1e65b27 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:56.885590 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-a6e3f82b-2644-40bf-bc49-03fdadb2e8f2 req-0d071f6e-e53c-47ee-b55b-ddf4b1e65b27 service nova] Creating event network-vif-plugged:59ca6f67-7dec-4e2b-a15d-4746e8c56b32 for instance 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef on n-h2-833090-16 Aug 31 16:14:56.893733 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-a6e3f82b-2644-40bf-bc49-03fdadb2e8f2 req-0d071f6e-e53c-47ee-b55b-ddf4b1e65b27 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112684 Aug 31 16:14:56.895072 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2515/4838] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:14:57.085719 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-41da22eb-199e-4ab8-8502-ffee2bfa4a56 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:57.087466 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-41da22eb-199e-4ab8-8502-ffee2bfa4a56 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:57.101325 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-41da22eb-199e-4ab8-8502-ffee2bfa4a56 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:57.103166 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-41da22eb-199e-4ab8-8502-ffee2bfa4a56 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:57.107424 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-41da22eb-199e-4ab8-8502-ffee2bfa4a56 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:57.109336 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-41da22eb-199e-4ab8-8502-ffee2bfa4a56 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:57.118370 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-41da22eb-199e-4ab8-8502-ffee2bfa4a56 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:57.119122 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-41da22eb-199e-4ab8-8502-ffee2bfa4a56 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:57.768159 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4c1c6a1b-9609-4104-89d0-307249f00ebb tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:57.813844 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4c1c6a1b-9609-4104-89d0-307249f00ebb tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050" status: 200 len: 1736 microversion: 2.1 time: 1.227304 Aug 31 16:14:57.817782 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2324/4839] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:56 2022] GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050 => generated 1736 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:57.848746 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f711a8b2-9558-44c1-8a2e-9f0d1d2e3379 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:57.850964 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f711a8b2-9558-44c1-8a2e-9f0d1d2e3379 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] [instance: 802a1cc5-9787-47d9-87d5-e3fa912d7712] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:57.887449 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f711a8b2-9558-44c1-8a2e-9f0d1d2e3379 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:57.889025 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f711a8b2-9558-44c1-8a2e-9f0d1d2e3379 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:57.892402 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f711a8b2-9558-44c1-8a2e-9f0d1d2e3379 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:57.893617 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f711a8b2-9558-44c1-8a2e-9f0d1d2e3379 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:57.897302 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f711a8b2-9558-44c1-8a2e-9f0d1d2e3379 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:57.899027 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f711a8b2-9558-44c1-8a2e-9f0d1d2e3379 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:57.951364 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-41da22eb-199e-4ab8-8502-ffee2bfa4a56 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:57.964263 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=100 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:14:58.005674 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-41da22eb-199e-4ab8-8502-ffee2bfa4a56 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef" status: 200 len: 1367 microversion: 2.1 time: 0.922455 Aug 31 16:14:58.011077 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2516/4840] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:57 2022] GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef => generated 1367 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:58.017502 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-5ffd663a-9e5d-4d02-b982-99a01b761701 req-43ba1ed0-5ebb-4f1f-aafd-d1524ee69502 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "802a1cc5-9787-47d9-87d5-e3fa912d7712", "name": "network-vif-deleted", "tag": "0106e3d6-aeae-4314-8e0c-0a661954a14f"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:14:58.030548 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-5ffd663a-9e5d-4d02-b982-99a01b761701 req-43ba1ed0-5ebb-4f1f-aafd-d1524ee69502 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:58.031485 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-5ffd663a-9e5d-4d02-b982-99a01b761701 req-43ba1ed0-5ebb-4f1f-aafd-d1524ee69502 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:58.032426 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-5ffd663a-9e5d-4d02-b982-99a01b761701 req-43ba1ed0-5ebb-4f1f-aafd-d1524ee69502 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:58.063272 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-5ffd663a-9e5d-4d02-b982-99a01b761701 req-43ba1ed0-5ebb-4f1f-aafd-d1524ee69502 service nova] Creating event network-vif-deleted:0106e3d6-aeae-4314-8e0c-0a661954a14f for instance 802a1cc5-9787-47d9-87d5-e3fa912d7712 on n-h1-833090-16 Aug 31 16:14:58.079768 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-5ffd663a-9e5d-4d02-b982-99a01b761701 req-43ba1ed0-5ebb-4f1f-aafd-d1524ee69502 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065538 Aug 31 16:14:58.087327 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2517/4841] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:14:58.145208 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f711a8b2-9558-44c1-8a2e-9f0d1d2e3379 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b130aecc1794cfc9fe0a9a80d558bbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d2579dc4a344c2998e30915ea51b2ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:14:58.163501 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:14:58.173040 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f711a8b2-9558-44c1-8a2e-9f0d1d2e3379 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] 10.222.0.50 "GET /compute/v2.1/servers/802a1cc5-9787-47d9-87d5-e3fa912d7712" status: 200 len: 1313 microversion: 2.1 time: 0.348041 Aug 31 16:14:58.190612 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2325/4842] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:57 2022] GET /compute/v2.1/servers/802a1cc5-9787-47d9-87d5-e3fa912d7712 => generated 1313 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:14:58.847506 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4f1e638c-ad46-4ca3-bfe9-d57bcd79a13d tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:58.848211 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4f1e638c-ad46-4ca3-bfe9-d57bcd79a13d tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 1c40a98f-366d-4392-9034-7841f68b2050] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:58.866788 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4f1e638c-ad46-4ca3-bfe9-d57bcd79a13d tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:58.867559 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4f1e638c-ad46-4ca3-bfe9-d57bcd79a13d tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:58.867990 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4f1e638c-ad46-4ca3-bfe9-d57bcd79a13d tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:58.871853 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4f1e638c-ad46-4ca3-bfe9-d57bcd79a13d tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:58.874988 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4f1e638c-ad46-4ca3-bfe9-d57bcd79a13d tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:58.875901 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4f1e638c-ad46-4ca3-bfe9-d57bcd79a13d tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:59.042976 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f202ed6a-f923-4560-acc2-96468b7485f0 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:14:59.043674 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f202ed6a-f923-4560-acc2-96468b7485f0 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:14:59.061064 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f202ed6a-f923-4560-acc2-96468b7485f0 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:59.061650 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f202ed6a-f923-4560-acc2-96468b7485f0 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:59.062085 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f202ed6a-f923-4560-acc2-96468b7485f0 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:14:59.062918 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f202ed6a-f923-4560-acc2-96468b7485f0 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:14:59.063548 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f202ed6a-f923-4560-acc2-96468b7485f0 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:14:59.063975 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f202ed6a-f923-4560-acc2-96468b7485f0 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:00.227368 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4f1e638c-ad46-4ca3-bfe9-d57bcd79a13d tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:00.240447 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4f1e638c-ad46-4ca3-bfe9-d57bcd79a13d tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050" status: 200 len: 1736 microversion: 2.1 time: 1.397837 Aug 31 16:15:00.241809 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2518/4843] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:58 2022] GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050 => generated 1736 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:00.248978 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fc311898-80ab-456f-81b0-e9806de95170 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:00.254755 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fc311898-80ab-456f-81b0-e9806de95170 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] [instance: 802a1cc5-9787-47d9-87d5-e3fa912d7712] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:00.268928 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fc311898-80ab-456f-81b0-e9806de95170 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:00.269724 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fc311898-80ab-456f-81b0-e9806de95170 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:00.270430 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fc311898-80ab-456f-81b0-e9806de95170 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:00.271346 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fc311898-80ab-456f-81b0-e9806de95170 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:00.272530 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fc311898-80ab-456f-81b0-e9806de95170 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:00.272530 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fc311898-80ab-456f-81b0-e9806de95170 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:00.300757 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-fc311898-80ab-456f-81b0-e9806de95170 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] HTTP exception thrown: Instance 802a1cc5-9787-47d9-87d5-e3fa912d7712 could not be found. Aug 31 16:15:00.302514 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fc311898-80ab-456f-81b0-e9806de95170 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Request method failure captured: Aug 31 16:15:00.302514 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/802a1cc5-9787-47d9-87d5-e3fa912d7712 HTTP/1.1 Aug 31 16:15:00.302514 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:15:00.302514 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:15:00.302514 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:15:00.302514 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:15:00.302514 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:15:00.302514 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:15:00.302514 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:15:00.302514 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:15:00.302514 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4jOaQKjR2wtBPJrQez6Gboovzpd-k_um42twck6u-sqF5xVojAR3PUHeN1YwNLXn6AH8TcwexBvAslDfrvmaxC-sNxgYFJt0p2638WBA2W1NFLyUAsYuV7kRHd0xsBdMOBoan4lBWF_4f9_QYzE_plf3iaKIDPN1TLzS6FQsyNt4dk Aug 31 16:15:00.302514 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:15:00.302514 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:15:00.302514 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:15:00.302514 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:15:00.302514 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:15:00.302514 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:15:00.302514 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 8d2579dc4a344c2998e30915ea51b2ad Aug 31 16:15:00.302514 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1684414928 Aug 31 16:15:00.302514 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:15:00.302514 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:15:00.302514 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8d2579dc4a344c2998e30915ea51b2ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8d2579dc4a344c2998e30915ea51b2ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8d2579dc4a344c2998e30915ea51b2ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8d2579dc4a344c2998e30915ea51b2ad", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:15:00.302514 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1684414928 Aug 31 16:15:00.302514 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 8d2579dc4a344c2998e30915ea51b2ad Aug 31 16:15:00.302514 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1684414928 Aug 31 16:15:00.302514 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1684414928-project Aug 31 16:15:00.302514 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:15:00.302514 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:15:00.302514 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 0b130aecc1794cfc9fe0a9a80d558bbe Aug 31 16:15:00.302514 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1684414928-project Aug 31 16:15:00.302514 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:15:00.302514 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 802a1cc5-9787-47d9-87d5-e3fa912d7712 could not be found. Aug 31 16:15:00.302514 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '802a1cc5-9787-47d9-87d5-e3fa912d7712'} Aug 31 16:15:00.302514 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:15:00.302514 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:00.302514 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:15:00.302514 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:15:00.302514 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:15:00.302514 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:15:00.302514 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:15:00.302514 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:15:00.302514 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:15:00.302514 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:15:00.302514 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 802a1cc5-9787-47d9-87d5-e3fa912d7712 could not be found. Aug 31 16:15:00.302514 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:15:00.302514 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:00.302514 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:15:00.302514 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:00.302514 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:00.302514 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:00.302514 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:15:00.302514 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:15:00.302514 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:15:00.302514 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:15:00.302514 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:15:00.302514 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:15:00.302514 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:15:00.302514 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:15:00.302514 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:15:00.302514 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:15:00.302514 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 802a1cc5-9787-47d9-87d5-e3fa912d7712 could not be found. Aug 31 16:15:00.302514 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:15:00.308766 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:00.308766 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:15:00.308766 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:00.308766 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:00.308766 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:00.308766 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:15:00.308766 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:15:00.308766 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 802a1cc5-9787-47d9-87d5-e3fa912d7712 could not be found. Aug 31 16:15:00.308766 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:15:00.308766 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fc311898-80ab-456f-81b0-e9806de95170 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] Returning 404 to user: Instance 802a1cc5-9787-47d9-87d5-e3fa912d7712 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:15:00.308766 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fc311898-80ab-456f-81b0-e9806de95170 tempest-ServersNegativeTestMultiTenantJSON-1684414928 tempest-ServersNegativeTestMultiTenantJSON-1684414928-project] 10.222.0.50 "GET /compute/v2.1/servers/802a1cc5-9787-47d9-87d5-e3fa912d7712" status: 404 len: 111 microversion: 2.1 time: 0.061027 Aug 31 16:15:00.311879 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2519/4844] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:00 2022] GET /compute/v2.1/servers/802a1cc5-9787-47d9-87d5-e3fa912d7712 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:15:00.465366 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f202ed6a-f923-4560-acc2-96468b7485f0 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:00.480920 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f202ed6a-f923-4560-acc2-96468b7485f0 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef" status: 200 len: 1367 microversion: 2.1 time: 1.443647 Aug 31 16:15:00.482621 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2326/4845] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:14:59 2022] GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef => generated 1367 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:01.276819 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ccf110ac-92ae-4bb0-881b-0993f52e3a38 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:01.277425 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ccf110ac-92ae-4bb0-881b-0993f52e3a38 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 1c40a98f-366d-4392-9034-7841f68b2050] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:01.301271 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ccf110ac-92ae-4bb0-881b-0993f52e3a38 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:01.301629 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ccf110ac-92ae-4bb0-881b-0993f52e3a38 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:01.303355 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ccf110ac-92ae-4bb0-881b-0993f52e3a38 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:01.307373 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ccf110ac-92ae-4bb0-881b-0993f52e3a38 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:01.309314 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ccf110ac-92ae-4bb0-881b-0993f52e3a38 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:01.309972 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ccf110ac-92ae-4bb0-881b-0993f52e3a38 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:01.509806 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7ef98434-092b-4463-87fe-7b9e84b20c2a tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:01.511153 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7ef98434-092b-4463-87fe-7b9e84b20c2a tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:01.526306 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ef98434-092b-4463-87fe-7b9e84b20c2a tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:01.527298 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ef98434-092b-4463-87fe-7b9e84b20c2a tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:01.527936 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ef98434-092b-4463-87fe-7b9e84b20c2a tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:01.529121 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ef98434-092b-4463-87fe-7b9e84b20c2a tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:01.532437 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ef98434-092b-4463-87fe-7b9e84b20c2a tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:01.533835 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ef98434-092b-4463-87fe-7b9e84b20c2a tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:02.070659 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7ef98434-092b-4463-87fe-7b9e84b20c2a tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:02.100441 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ccf110ac-92ae-4bb0-881b-0993f52e3a38 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:02.127940 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7ef98434-092b-4463-87fe-7b9e84b20c2a tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef" status: 200 len: 1557 microversion: 2.1 time: 0.619410 Aug 31 16:15:02.132010 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2327/4846] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:01 2022] GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef => generated 1557 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:02.138889 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ccf110ac-92ae-4bb0-881b-0993f52e3a38 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050" status: 200 len: 1736 microversion: 2.1 time: 0.863789 Aug 31 16:15:02.141264 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2520/4847] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:01 2022] GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050 => generated 1736 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:02.194526 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0ab6a95d-0232-4bc3-9cf0-205991e73195 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:02.195636 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0ab6a95d-0232-4bc3-9cf0-205991e73195 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:02.202864 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ab6a95d-0232-4bc3-9cf0-205991e73195 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:02.204107 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ab6a95d-0232-4bc3-9cf0-205991e73195 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:02.204846 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ab6a95d-0232-4bc3-9cf0-205991e73195 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:02.206478 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ab6a95d-0232-4bc3-9cf0-205991e73195 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:02.207173 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ab6a95d-0232-4bc3-9cf0-205991e73195 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:02.207821 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ab6a95d-0232-4bc3-9cf0-205991e73195 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:02.699528 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0ab6a95d-0232-4bc3-9cf0-205991e73195 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.509486 Aug 31 16:15:02.726253 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2328/4848] 10.222.0.50 () {58 vars in 1275 bytes} [Wed Aug 31 16:15:02 2022] GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef/os-interface => generated 284 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:15:03.207686 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7c14e387-259c-4532-831a-16382f984e1b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:03.210941 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7c14e387-259c-4532-831a-16382f984e1b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 1c40a98f-366d-4392-9034-7841f68b2050] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:03.224525 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7c14e387-259c-4532-831a-16382f984e1b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:03.226698 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7c14e387-259c-4532-831a-16382f984e1b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:03.227494 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7c14e387-259c-4532-831a-16382f984e1b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:03.228951 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7c14e387-259c-4532-831a-16382f984e1b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:03.229711 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7c14e387-259c-4532-831a-16382f984e1b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:03.230373 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7c14e387-259c-4532-831a-16382f984e1b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:04.249977 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7c14e387-259c-4532-831a-16382f984e1b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:04.264287 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7c14e387-259c-4532-831a-16382f984e1b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050" status: 200 len: 1736 microversion: 2.1 time: 1.071092 Aug 31 16:15:04.265803 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2521/4849] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:03 2022] GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050 => generated 1736 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:15:05.123100 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-118b4304-c68e-4eed-baad-02bed1f0fc78 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Action: 'create', calling method: .version_select at 0x7fbb464f69d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1086339023", "description": "tempest-description-2083602794"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:05.510182 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c3e0b37a-6c8b-494c-a232-8e00c5d0949e tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:05.511065 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c3e0b37a-6c8b-494c-a232-8e00c5d0949e tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: e1cb02b7-1dd6-4c83-9008-e19525731e03] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:05.532584 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3e0b37a-6c8b-494c-a232-8e00c5d0949e tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:05.533213 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3e0b37a-6c8b-494c-a232-8e00c5d0949e tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:05.533775 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3e0b37a-6c8b-494c-a232-8e00c5d0949e tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:05.534654 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3e0b37a-6c8b-494c-a232-8e00c5d0949e tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:05.535214 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3e0b37a-6c8b-494c-a232-8e00c5d0949e tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:05.535848 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3e0b37a-6c8b-494c-a232-8e00c5d0949e tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:05.680660 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-118b4304-c68e-4eed-baad-02bed1f0fc78 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.850982 Aug 31 16:15:05.681644 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2329/4850] 10.222.0.50 () {60 vars in 1180 bytes} [Wed Aug 31 16:15:04 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:05.686997 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-cfa5cd25-c934-4702-996b-75a501bc5066 req-569a022d-640c-4933-bbf8-2c56c8936dc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1cb02b7-1dd6-4c83-9008-e19525731e03", "tag": "aad14830-ef68-4e56-bff4-91dbcf99efc3"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:05.712712 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-cfa5cd25-c934-4702-996b-75a501bc5066 req-569a022d-640c-4933-bbf8-2c56c8936dc8 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:05.713396 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-cfa5cd25-c934-4702-996b-75a501bc5066 req-569a022d-640c-4933-bbf8-2c56c8936dc8 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:05.713987 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-cfa5cd25-c934-4702-996b-75a501bc5066 req-569a022d-640c-4933-bbf8-2c56c8936dc8 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:05.749469 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-cfa5cd25-c934-4702-996b-75a501bc5066 req-569a022d-640c-4933-bbf8-2c56c8936dc8 service nova] Creating event network-changed:aad14830-ef68-4e56-bff4-91dbcf99efc3 for instance e1cb02b7-1dd6-4c83-9008-e19525731e03 on n-h2-833090-16 Aug 31 16:15:05.757093 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-cfa5cd25-c934-4702-996b-75a501bc5066 req-569a022d-640c-4933-bbf8-2c56c8936dc8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073259 Aug 31 16:15:05.757987 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2330/4851] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:15:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:05.770872 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e16ee85e-3681-4e4d-8477-886ec5f75155 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:05.772241 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e16ee85e-3681-4e4d-8477-886ec5f75155 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 1c40a98f-366d-4392-9034-7841f68b2050] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:05.803667 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e16ee85e-3681-4e4d-8477-886ec5f75155 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:05.804300 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e16ee85e-3681-4e4d-8477-886ec5f75155 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:05.804789 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e16ee85e-3681-4e4d-8477-886ec5f75155 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:05.805659 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e16ee85e-3681-4e4d-8477-886ec5f75155 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:05.806146 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e16ee85e-3681-4e4d-8477-886ec5f75155 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:05.806582 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e16ee85e-3681-4e4d-8477-886ec5f75155 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:06.102425 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c3e0b37a-6c8b-494c-a232-8e00c5d0949e tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:06.144457 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c3e0b37a-6c8b-494c-a232-8e00c5d0949e tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03" status: 200 len: 1563 microversion: 2.1 time: 0.981485 Aug 31 16:15:06.145076 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2522/4852] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:05 2022] GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03 => generated 1563 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:15:06.157240 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a64a1f72-9a51-4f44-b892-a4e54e6d812f tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Action: 'create', calling method: .version_select at 0x7fbb459e61f0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-739257858", "description": "tempest-description-127563827"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:06.329807 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e16ee85e-3681-4e4d-8477-886ec5f75155 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:06.340229 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e16ee85e-3681-4e4d-8477-886ec5f75155 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050" status: 200 len: 1736 microversion: 2.1 time: 0.573828 Aug 31 16:15:06.347832 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2331/4853] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:05 2022] GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050 => generated 1736 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:06.718415 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a64a1f72-9a51-4f44-b892-a4e54e6d812f tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.572213 Aug 31 16:15:06.719388 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2523/4854] 10.222.0.50 () {60 vars in 1180 bytes} [Wed Aug 31 16:15:06 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:06.867400 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-13869a2a-aa1e-454a-b3d9-e4882b118b31 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1528715020", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "e2da32d5-19e8-46c2-8c7c-ebaefe1850c2"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:06.983374 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-13869a2a-aa1e-454a-b3d9-e4882b118b31 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] validate_networks() for [('e2da32d5-19e8-46c2-8c7c-ebaefe1850c2', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:15:07.238292 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-ecaedf83-4687-4f8e-862b-d6b49940ff6c req-d6b91187-37db-4102-99d4-539f51aed785 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef", "tag": "59ca6f67-7dec-4e2b-a15d-4746e8c56b32"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:07.268824 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-ecaedf83-4687-4f8e-862b-d6b49940ff6c req-d6b91187-37db-4102-99d4-539f51aed785 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:07.269527 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-ecaedf83-4687-4f8e-862b-d6b49940ff6c req-d6b91187-37db-4102-99d4-539f51aed785 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:07.270167 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-ecaedf83-4687-4f8e-862b-d6b49940ff6c req-d6b91187-37db-4102-99d4-539f51aed785 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:07.299294 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-ecaedf83-4687-4f8e-862b-d6b49940ff6c req-d6b91187-37db-4102-99d4-539f51aed785 service nova] Creating event network-changed:59ca6f67-7dec-4e2b-a15d-4746e8c56b32 for instance 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef on n-h2-833090-16 Aug 31 16:15:07.308425 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-ecaedf83-4687-4f8e-862b-d6b49940ff6c req-d6b91187-37db-4102-99d4-539f51aed785 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074421 Aug 31 16:15:07.310620 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2524/4855] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:15:07.371569 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-31533d5e-00c0-4a3c-96f7-0edd15580e71 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:07.372751 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-31533d5e-00c0-4a3c-96f7-0edd15580e71 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 1c40a98f-366d-4392-9034-7841f68b2050] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:07.385125 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-31533d5e-00c0-4a3c-96f7-0edd15580e71 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:07.388661 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-31533d5e-00c0-4a3c-96f7-0edd15580e71 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:07.389307 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-31533d5e-00c0-4a3c-96f7-0edd15580e71 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:07.391357 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-31533d5e-00c0-4a3c-96f7-0edd15580e71 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:07.392900 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-31533d5e-00c0-4a3c-96f7-0edd15580e71 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:07.393533 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-31533d5e-00c0-4a3c-96f7-0edd15580e71 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:08.755360 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-31533d5e-00c0-4a3c-96f7-0edd15580e71 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:08.780303 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-31533d5e-00c0-4a3c-96f7-0edd15580e71 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050" status: 200 len: 1736 microversion: 2.1 time: 1.413241 Aug 31 16:15:08.781181 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2525/4856] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:07 2022] GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050 => generated 1736 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:15:08.858264 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-13869a2a-aa1e-454a-b3d9-e4882b118b31 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:15:08.858911 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-13869a2a-aa1e-454a-b3d9-e4882b118b31 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:15:08.860414 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-13869a2a-aa1e-454a-b3d9-e4882b118b31 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:15:08.861090 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-13869a2a-aa1e-454a-b3d9-e4882b118b31 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:15:08.861732 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-13869a2a-aa1e-454a-b3d9-e4882b118b31 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:15:08.872243 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:15:08.905823 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13869a2a-aa1e-454a-b3d9-e4882b118b31 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:08.907258 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13869a2a-aa1e-454a-b3d9-e4882b118b31 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:08.908208 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13869a2a-aa1e-454a-b3d9-e4882b118b31 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:08.909997 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13869a2a-aa1e-454a-b3d9-e4882b118b31 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:08.918220 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13869a2a-aa1e-454a-b3d9-e4882b118b31 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:08.919071 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13869a2a-aa1e-454a-b3d9-e4882b118b31 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:08.948140 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-13869a2a-aa1e-454a-b3d9-e4882b118b31 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Getting quotas for project 7baff3cad5c14325a5576c40fcda0580. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:15:08.954962 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-13869a2a-aa1e-454a-b3d9-e4882b118b31 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Getting quotas for user dabb1c841cde40769174e2f8a97234c0 and project 7baff3cad5c14325a5576c40fcda0580. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:15:08.970534 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-13869a2a-aa1e-454a-b3d9-e4882b118b31 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:15:08.973399 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-13869a2a-aa1e-454a-b3d9-e4882b118b31 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] [instance: 30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:15:09.061660 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-13869a2a-aa1e-454a-b3d9-e4882b118b31 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.199592 Aug 31 16:15:09.074826 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2332/4857] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:15:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 2213 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:15:09.078222 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d12d6788-c60a-47b3-8dda-04849636d136 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:09.079136 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d12d6788-c60a-47b3-8dda-04849636d136 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] [instance: 30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:09.273279 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d12d6788-c60a-47b3-8dda-04849636d136 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dabb1c841cde40769174e2f8a97234c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baff3cad5c14325a5576c40fcda0580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:09.305465 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d12d6788-c60a-47b3-8dda-04849636d136 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "GET /compute/v2.1/servers/30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c" status: 200 len: 1216 microversion: 2.1 time: 0.223314 Aug 31 16:15:09.309140 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2526/4858] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:09 2022] GET /compute/v2.1/servers/30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c => generated 1216 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:09.838131 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a72b2cdc-aedb-4a5a-8c3c-c1708186e6ff tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:09.840171 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a72b2cdc-aedb-4a5a-8c3c-c1708186e6ff tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 1c40a98f-366d-4392-9034-7841f68b2050] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:09.894071 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a72b2cdc-aedb-4a5a-8c3c-c1708186e6ff tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:09.895029 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a72b2cdc-aedb-4a5a-8c3c-c1708186e6ff tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:09.898532 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a72b2cdc-aedb-4a5a-8c3c-c1708186e6ff tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:09.900349 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a72b2cdc-aedb-4a5a-8c3c-c1708186e6ff tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:09.903633 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a72b2cdc-aedb-4a5a-8c3c-c1708186e6ff tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:09.911403 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a72b2cdc-aedb-4a5a-8c3c-c1708186e6ff tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:10.342525 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6789fc74-a9d6-48ae-8de4-338ff3401143 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:10.343823 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6789fc74-a9d6-48ae-8de4-338ff3401143 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] [instance: 30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:10.372200 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6789fc74-a9d6-48ae-8de4-338ff3401143 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:10.376270 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6789fc74-a9d6-48ae-8de4-338ff3401143 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:10.381266 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6789fc74-a9d6-48ae-8de4-338ff3401143 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:10.385832 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6789fc74-a9d6-48ae-8de4-338ff3401143 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:10.388201 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6789fc74-a9d6-48ae-8de4-338ff3401143 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:10.390031 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6789fc74-a9d6-48ae-8de4-338ff3401143 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:10.760964 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6789fc74-a9d6-48ae-8de4-338ff3401143 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dabb1c841cde40769174e2f8a97234c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baff3cad5c14325a5576c40fcda0580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:10.776393 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6789fc74-a9d6-48ae-8de4-338ff3401143 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "GET /compute/v2.1/servers/30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c" status: 200 len: 1220 microversion: 2.1 time: 0.438496 Aug 31 16:15:10.779634 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2527/4859] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:10 2022] GET /compute/v2.1/servers/30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c => generated 1220 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:11.554206 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a72b2cdc-aedb-4a5a-8c3c-c1708186e6ff tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:11.571229 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a72b2cdc-aedb-4a5a-8c3c-c1708186e6ff tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050" status: 200 len: 1736 microversion: 2.1 time: 1.753917 Aug 31 16:15:11.573513 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2333/4860] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:09 2022] GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050 => generated 1736 bytes in 1764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:11.803312 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c2e9554f-8fbc-43a1-891c-6c2cc283472b tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:11.805108 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c2e9554f-8fbc-43a1-891c-6c2cc283472b tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] [instance: 30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:11.829571 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c2e9554f-8fbc-43a1-891c-6c2cc283472b tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:11.831196 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c2e9554f-8fbc-43a1-891c-6c2cc283472b tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:11.832024 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c2e9554f-8fbc-43a1-891c-6c2cc283472b tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:11.832792 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c2e9554f-8fbc-43a1-891c-6c2cc283472b tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:11.833294 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c2e9554f-8fbc-43a1-891c-6c2cc283472b tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:11.834027 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c2e9554f-8fbc-43a1-891c-6c2cc283472b tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:11.997761 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c2e9554f-8fbc-43a1-891c-6c2cc283472b tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dabb1c841cde40769174e2f8a97234c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baff3cad5c14325a5576c40fcda0580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:12.015472 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c2e9554f-8fbc-43a1-891c-6c2cc283472b tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "GET /compute/v2.1/servers/30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c" status: 200 len: 1274 microversion: 2.1 time: 0.218420 Aug 31 16:15:12.017022 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2528/4861] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:11 2022] GET /compute/v2.1/servers/30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c => generated 1274 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:15:12.600947 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f1625e6d-c238-4fc2-92b7-7265219b9dad tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:12.601820 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f1625e6d-c238-4fc2-92b7-7265219b9dad tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 1c40a98f-366d-4392-9034-7841f68b2050] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:12.618467 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f1625e6d-c238-4fc2-92b7-7265219b9dad tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:12.618955 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f1625e6d-c238-4fc2-92b7-7265219b9dad tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:12.619382 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f1625e6d-c238-4fc2-92b7-7265219b9dad tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:12.620104 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f1625e6d-c238-4fc2-92b7-7265219b9dad tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:12.620523 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f1625e6d-c238-4fc2-92b7-7265219b9dad tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:12.620935 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f1625e6d-c238-4fc2-92b7-7265219b9dad tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:12.994729 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f1625e6d-c238-4fc2-92b7-7265219b9dad tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:13.033101 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f1625e6d-c238-4fc2-92b7-7265219b9dad tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050" status: 200 len: 1736 microversion: 2.1 time: 0.436705 Aug 31 16:15:13.034805 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2529/4862] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:12 2022] GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050 => generated 1736 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:13.043501 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-674d5326-d088-4424-af07-20109949c8aa tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:13.047884 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-674d5326-d088-4424-af07-20109949c8aa tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] [instance: 30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:13.061049 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-674d5326-d088-4424-af07-20109949c8aa tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:13.064304 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-674d5326-d088-4424-af07-20109949c8aa tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:13.065184 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-674d5326-d088-4424-af07-20109949c8aa tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:13.066163 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-674d5326-d088-4424-af07-20109949c8aa tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:13.067041 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-674d5326-d088-4424-af07-20109949c8aa tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:13.069479 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-674d5326-d088-4424-af07-20109949c8aa tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:13.160377 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0f7fbf4d-0ddd-43c9-a950-7a77f86f669c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1912694080", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "1c4c22f6-ea49-4e46-87c2-7de60e095fb8"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:13.243188 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-674d5326-d088-4424-af07-20109949c8aa tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dabb1c841cde40769174e2f8a97234c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baff3cad5c14325a5576c40fcda0580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:13.253869 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-674d5326-d088-4424-af07-20109949c8aa tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "GET /compute/v2.1/servers/30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c" status: 200 len: 1274 microversion: 2.1 time: 0.216184 Aug 31 16:15:13.261705 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2530/4863] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:13 2022] GET /compute/v2.1/servers/30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c => generated 1274 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:13.304961 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-0f7fbf4d-0ddd-43c9-a950-7a77f86f669c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] validate_networks() for [('1c4c22f6-ea49-4e46-87c2-7de60e095fb8', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:15:13.817835 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-0f7fbf4d-0ddd-43c9-a950-7a77f86f669c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:15:13.818283 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-0f7fbf4d-0ddd-43c9-a950-7a77f86f669c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:15:13.818745 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-0f7fbf4d-0ddd-43c9-a950-7a77f86f669c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:15:13.819349 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-0f7fbf4d-0ddd-43c9-a950-7a77f86f669c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:15:13.819753 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-0f7fbf4d-0ddd-43c9-a950-7a77f86f669c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:15:13.830582 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f7fbf4d-0ddd-43c9-a950-7a77f86f669c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:13.831542 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f7fbf4d-0ddd-43c9-a950-7a77f86f669c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:13.832212 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f7fbf4d-0ddd-43c9-a950-7a77f86f669c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:13.833456 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f7fbf4d-0ddd-43c9-a950-7a77f86f669c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:13.834325 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f7fbf4d-0ddd-43c9-a950-7a77f86f669c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:13.834782 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f7fbf4d-0ddd-43c9-a950-7a77f86f669c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:13.857962 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-0f7fbf4d-0ddd-43c9-a950-7a77f86f669c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Getting quotas for project 3e843f3122c14cf8889f26423552792f. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:15:13.863721 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-0f7fbf4d-0ddd-43c9-a950-7a77f86f669c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Getting quotas for user 8b67be53aade4f8c92d6765dd91a4b90 and project 3e843f3122c14cf8889f26423552792f. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:15:13.877497 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0f7fbf4d-0ddd-43c9-a950-7a77f86f669c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:15:13.879702 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0f7fbf4d-0ddd-43c9-a950-7a77f86f669c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:15:13.933424 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0f7fbf4d-0ddd-43c9-a950-7a77f86f669c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.486840 Aug 31 16:15:13.941292 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2334/4864] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:15:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1496 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:15:13.948469 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fb3bc6ff-cc5a-47d4-8aca-44bc20024d14 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:13.949083 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fb3bc6ff-cc5a-47d4-8aca-44bc20024d14 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:14.033151 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-fb3bc6ff-cc5a-47d4-8aca-44bc20024d14 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:14.052920 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fb3bc6ff-cc5a-47d4-8aca-44bc20024d14 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1217 microversion: 2.1 time: 0.110604 Aug 31 16:15:14.054230 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2531/4865] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:13 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1217 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:14.073453 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-245e8f43-80f5-47fa-974f-11e735d286f3 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:14.074878 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-245e8f43-80f5-47fa-974f-11e735d286f3 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 1c40a98f-366d-4392-9034-7841f68b2050] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:14.103148 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-245e8f43-80f5-47fa-974f-11e735d286f3 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:14.104992 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-245e8f43-80f5-47fa-974f-11e735d286f3 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:14.108917 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-245e8f43-80f5-47fa-974f-11e735d286f3 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:14.110029 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-245e8f43-80f5-47fa-974f-11e735d286f3 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:14.110758 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-245e8f43-80f5-47fa-974f-11e735d286f3 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:14.112076 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-245e8f43-80f5-47fa-974f-11e735d286f3 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:14.284402 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d618d73a-1c25-4f12-a504-951b12d07d43 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:14.288988 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d618d73a-1c25-4f12-a504-951b12d07d43 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] [instance: 30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:14.320796 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d618d73a-1c25-4f12-a504-951b12d07d43 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:14.321590 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d618d73a-1c25-4f12-a504-951b12d07d43 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:14.322592 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d618d73a-1c25-4f12-a504-951b12d07d43 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:14.325737 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d618d73a-1c25-4f12-a504-951b12d07d43 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:14.327170 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d618d73a-1c25-4f12-a504-951b12d07d43 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:14.327817 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d618d73a-1c25-4f12-a504-951b12d07d43 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:14.868766 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-245e8f43-80f5-47fa-974f-11e735d286f3 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:14.876880 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d618d73a-1c25-4f12-a504-951b12d07d43 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dabb1c841cde40769174e2f8a97234c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baff3cad5c14325a5576c40fcda0580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:14.883947 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-245e8f43-80f5-47fa-974f-11e735d286f3 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050" status: 200 len: 1736 microversion: 2.1 time: 0.813832 Aug 31 16:15:14.886280 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2335/4866] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:14 2022] GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050 => generated 1736 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:14.901200 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d618d73a-1c25-4f12-a504-951b12d07d43 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "GET /compute/v2.1/servers/30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c" status: 200 len: 1316 microversion: 2.1 time: 0.622854 Aug 31 16:15:14.903994 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2532/4867] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:14 2022] GET /compute/v2.1/servers/30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c => generated 1316 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:15:15.086039 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-581e2a43-8af9-4e6d-9fbb-70ba4dc2e70b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:15.089441 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-581e2a43-8af9-4e6d-9fbb-70ba4dc2e70b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:15.103358 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-581e2a43-8af9-4e6d-9fbb-70ba4dc2e70b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:15.104509 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-581e2a43-8af9-4e6d-9fbb-70ba4dc2e70b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:15.107564 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-581e2a43-8af9-4e6d-9fbb-70ba4dc2e70b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:15.108741 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-581e2a43-8af9-4e6d-9fbb-70ba4dc2e70b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:15.110209 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-581e2a43-8af9-4e6d-9fbb-70ba4dc2e70b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:15.111022 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-581e2a43-8af9-4e6d-9fbb-70ba4dc2e70b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:15.276865 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-581e2a43-8af9-4e6d-9fbb-70ba4dc2e70b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:15.299511 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-581e2a43-8af9-4e6d-9fbb-70ba4dc2e70b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1221 microversion: 2.1 time: 0.224049 Aug 31 16:15:15.300166 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2336/4868] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:15 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1221 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:15.911556 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9026b2a4-3f41-4b71-8c69-35d1d10e4c41 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:15.913317 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9026b2a4-3f41-4b71-8c69-35d1d10e4c41 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 1c40a98f-366d-4392-9034-7841f68b2050] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:15.924695 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0e49dfa0-4a54-4e6b-8b9d-765e791255cf tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:15.926140 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0e49dfa0-4a54-4e6b-8b9d-765e791255cf tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] [instance: 30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:15.935815 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=76 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:15:15.942931 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e49dfa0-4a54-4e6b-8b9d-765e791255cf tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:15.943973 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9026b2a4-3f41-4b71-8c69-35d1d10e4c41 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:15.945450 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e49dfa0-4a54-4e6b-8b9d-765e791255cf tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:15.946239 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e49dfa0-4a54-4e6b-8b9d-765e791255cf tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:15.946660 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9026b2a4-3f41-4b71-8c69-35d1d10e4c41 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:15.947326 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9026b2a4-3f41-4b71-8c69-35d1d10e4c41 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:15.950158 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e49dfa0-4a54-4e6b-8b9d-765e791255cf tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:15.950414 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9026b2a4-3f41-4b71-8c69-35d1d10e4c41 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:15.951210 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e49dfa0-4a54-4e6b-8b9d-765e791255cf tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:15.953569 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9026b2a4-3f41-4b71-8c69-35d1d10e4c41 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:15.954357 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e49dfa0-4a54-4e6b-8b9d-765e791255cf tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:15.955173 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9026b2a4-3f41-4b71-8c69-35d1d10e4c41 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:16.531375 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0e49dfa0-4a54-4e6b-8b9d-765e791255cf tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dabb1c841cde40769174e2f8a97234c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baff3cad5c14325a5576c40fcda0580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:16.544895 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0e49dfa0-4a54-4e6b-8b9d-765e791255cf tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "GET /compute/v2.1/servers/30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c" status: 200 len: 1316 microversion: 2.1 time: 0.621939 Aug 31 16:15:16.548973 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2337/4869] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:15 2022] GET /compute/v2.1/servers/30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c => generated 1316 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:16.564140 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-8b00551e-53fa-4aef-9b58-79f4c3cebd20 req-365f6116-12e3-41fa-b228-71e639148718 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c", "tag": "cc1d20a8-7d6e-45fd-8862-92c3e6d7af2e"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:16.577759 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9026b2a4-3f41-4b71-8c69-35d1d10e4c41 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:16.589767 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9026b2a4-3f41-4b71-8c69-35d1d10e4c41 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050" status: 200 len: 1736 microversion: 2.1 time: 0.683514 Aug 31 16:15:16.594337 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2533/4870] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:15 2022] GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050 => generated 1736 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:16.602919 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6eed31cd-94bb-41cf-ab88-26ca06c44195 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:16.607866 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6eed31cd-94bb-41cf-ab88-26ca06c44195 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:16.620660 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8b00551e-53fa-4aef-9b58-79f4c3cebd20 req-365f6116-12e3-41fa-b228-71e639148718 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:16.621536 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8b00551e-53fa-4aef-9b58-79f4c3cebd20 req-365f6116-12e3-41fa-b228-71e639148718 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:16.622364 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8b00551e-53fa-4aef-9b58-79f4c3cebd20 req-365f6116-12e3-41fa-b228-71e639148718 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:16.629386 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6eed31cd-94bb-41cf-ab88-26ca06c44195 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:16.633020 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6eed31cd-94bb-41cf-ab88-26ca06c44195 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:16.633920 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6eed31cd-94bb-41cf-ab88-26ca06c44195 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:16.637995 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6eed31cd-94bb-41cf-ab88-26ca06c44195 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:16.638969 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6eed31cd-94bb-41cf-ab88-26ca06c44195 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:16.640107 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6eed31cd-94bb-41cf-ab88-26ca06c44195 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:16.654152 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-8b00551e-53fa-4aef-9b58-79f4c3cebd20 req-365f6116-12e3-41fa-b228-71e639148718 service nova] Creating event network-changed:cc1d20a8-7d6e-45fd-8862-92c3e6d7af2e for instance 30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c on n-h1-833090-16 Aug 31 16:15:16.674509 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-8b00551e-53fa-4aef-9b58-79f4c3cebd20 req-365f6116-12e3-41fa-b228-71e639148718 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119416 Aug 31 16:15:16.675206 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2338/4871] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:16.764710 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6eed31cd-94bb-41cf-ab88-26ca06c44195 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:16.774478 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6eed31cd-94bb-41cf-ab88-26ca06c44195 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1275 microversion: 2.1 time: 0.178764 Aug 31 16:15:16.779029 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2534/4872] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:16 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1275 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:17.574188 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8335b763-f067-4379-8dc4-d1ce6420ae82 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:17.575074 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8335b763-f067-4379-8dc4-d1ce6420ae82 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] [instance: 30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:17.589104 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8335b763-f067-4379-8dc4-d1ce6420ae82 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:17.603295 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8335b763-f067-4379-8dc4-d1ce6420ae82 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:17.604584 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8335b763-f067-4379-8dc4-d1ce6420ae82 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:17.605605 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8335b763-f067-4379-8dc4-d1ce6420ae82 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:17.606357 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8335b763-f067-4379-8dc4-d1ce6420ae82 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:17.607057 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8335b763-f067-4379-8dc4-d1ce6420ae82 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:17.624084 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-88b21489-0a3c-4dbb-aade-75025319c4c5 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:17.624837 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-88b21489-0a3c-4dbb-aade-75025319c4c5 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 1c40a98f-366d-4392-9034-7841f68b2050] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:17.639016 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-88b21489-0a3c-4dbb-aade-75025319c4c5 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:17.639509 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-88b21489-0a3c-4dbb-aade-75025319c4c5 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:17.640001 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-88b21489-0a3c-4dbb-aade-75025319c4c5 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:17.640706 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-88b21489-0a3c-4dbb-aade-75025319c4c5 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:17.641151 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-88b21489-0a3c-4dbb-aade-75025319c4c5 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:17.641571 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-88b21489-0a3c-4dbb-aade-75025319c4c5 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:17.977937 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8335b763-f067-4379-8dc4-d1ce6420ae82 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dabb1c841cde40769174e2f8a97234c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baff3cad5c14325a5576c40fcda0580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:17.993949 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8335b763-f067-4379-8dc4-d1ce6420ae82 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "GET /compute/v2.1/servers/30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c" status: 200 len: 1316 microversion: 2.1 time: 0.425270 Aug 31 16:15:17.995202 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2339/4873] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:17 2022] GET /compute/v2.1/servers/30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c => generated 1316 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:18.001726 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f6aa4461-747a-4f3d-b33f-fcdf55a29a98 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:18.007726 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f6aa4461-747a-4f3d-b33f-fcdf55a29a98 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:18.026194 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6aa4461-747a-4f3d-b33f-fcdf55a29a98 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:18.029584 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6aa4461-747a-4f3d-b33f-fcdf55a29a98 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:18.030027 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6aa4461-747a-4f3d-b33f-fcdf55a29a98 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:18.030785 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6aa4461-747a-4f3d-b33f-fcdf55a29a98 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:18.031238 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6aa4461-747a-4f3d-b33f-fcdf55a29a98 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:18.031656 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6aa4461-747a-4f3d-b33f-fcdf55a29a98 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:18.198307 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-88b21489-0a3c-4dbb-aade-75025319c4c5 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:18.227853 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-88b21489-0a3c-4dbb-aade-75025319c4c5 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050" status: 200 len: 1716 microversion: 2.1 time: 0.607149 Aug 31 16:15:18.238233 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2535/4874] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:17 2022] GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050 => generated 1716 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:18.351295 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f6aa4461-747a-4f3d-b33f-fcdf55a29a98 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:18.382588 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f6aa4461-747a-4f3d-b33f-fcdf55a29a98 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1317 microversion: 2.1 time: 0.386089 Aug 31 16:15:18.384335 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2340/4875] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:17 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1317 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:18.531956 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a85855bc-30b3-46b2-b341-d71dcd923ae1 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:18.532702 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a85855bc-30b3-46b2-b341-d71dcd923ae1 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 1c40a98f-366d-4392-9034-7841f68b2050] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:18.542701 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a85855bc-30b3-46b2-b341-d71dcd923ae1 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:18.545622 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a85855bc-30b3-46b2-b341-d71dcd923ae1 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:18.546072 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a85855bc-30b3-46b2-b341-d71dcd923ae1 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:18.546841 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a85855bc-30b3-46b2-b341-d71dcd923ae1 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:18.547291 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a85855bc-30b3-46b2-b341-d71dcd923ae1 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:18.547714 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a85855bc-30b3-46b2-b341-d71dcd923ae1 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:18.742201 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-a85855bc-30b3-46b2-b341-d71dcd923ae1 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] HTTP exception thrown: Cannot 'detach_volume' instance 1c40a98f-366d-4392-9034-7841f68b2050 while it is in vm_state rescued Aug 31 16:15:18.751728 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a85855bc-30b3-46b2-b341-d71dcd923ae1 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Request method failure captured: Aug 31 16:15:18.751728 n-d-833090-16 devstack@n-api.service[128864]: request: DELETE /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050/os-volume_attachments/f3a07e52-7a2a-49ce-a2f2-77f81069632b HTTP/1.1 Aug 31 16:15:18.751728 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:15:18.751728 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:15:18.751728 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:15:18.751728 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:15:18.751728 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:15:18.751728 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:15:18.751728 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:15:18.751728 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:15:18.751728 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4gyS9s2L5B9hQNj6-3Bq9VaD0LX3rcaQEx2TULT5jAIwE_syzV3-H131XTbmJBlDQO8oVuY07kOMzEcgw7jqBoRJefg3cpTEEDA9_ABXOKuvCpOJqmPJLOqW4m5eFAB54B22EgPHkAmNh0-egef1rV97h7ELSV4bCzsJF6Z18KMZ5s Aug 31 16:15:18.751728 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:15:18.751728 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:15:18.751728 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:15:18.751728 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:15:18.751728 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:15:18.751728 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:15:18.751728 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: d25e1b1938b2401bab27dafadc9745d5 Aug 31 16:15:18.751728 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-961929748 Aug 31 16:15:18.751728 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:15:18.751728 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:15:18.751728 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d25e1b1938b2401bab27dafadc9745d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d25e1b1938b2401bab27dafadc9745d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d25e1b1938b2401bab27dafadc9745d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d25e1b1938b2401bab27dafadc9745d5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:15:18.751728 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServerRescueNegativeTestJSON-961929748 Aug 31 16:15:18.751728 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: d25e1b1938b2401bab27dafadc9745d5 Aug 31 16:15:18.751728 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-961929748 Aug 31 16:15:18.751728 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServerRescueNegativeTestJSON-961929748-project Aug 31 16:15:18.751728 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:15:18.751728 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:15:18.751728 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: b5f67b54e87c46d28e7d5217bf49ca57 Aug 31 16:15:18.751728 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServerRescueNegativeTestJSON-961929748-project Aug 31 16:15:18.751728 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:15:18.751728 n-d-833090-16 devstack@n-api.service[128864]: exception: Cannot 'detach_volume' instance 1c40a98f-366d-4392-9034-7841f68b2050 while it is in vm_state rescued Aug 31 16:15:18.751728 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'server_id': '1c40a98f-366d-4392-9034-7841f68b2050', 'id': 'f3a07e52-7a2a-49ce-a2f2-77f81069632b'} Aug 31 16:15:18.751728 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:15:18.751728 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:18.751728 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 31 16:15:18.751728 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 31 16:15:18.751728 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 16:15:18.751728 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 16:15:18.751728 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 16:15:18.751728 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 16:15:18.751728 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1c40a98f-366d-4392-9034-7841f68b2050 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 31 16:15:18.751728 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:15:18.751728 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:18.751728 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:15:18.751728 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:18.751728 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:18.751728 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:18.751728 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:15:18.751728 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:15:18.751728 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:15:18.751728 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:15:18.751728 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 31 16:15:18.751728 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 16:15:18.751728 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 16:15:18.751728 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 16:15:18.751728 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 1c40a98f-366d-4392-9034-7841f68b2050 while it is in vm_state rescued Aug 31 16:15:18.751728 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:15:18.751728 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:18.751728 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:15:18.751728 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:18.757550 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:18.757550 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:18.757550 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:15:18.757550 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:15:18.757550 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 1c40a98f-366d-4392-9034-7841f68b2050 while it is in vm_state rescued Aug 31 16:15:18.757550 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:15:18.759137 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a85855bc-30b3-46b2-b341-d71dcd923ae1 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Returning 409 to user: Cannot 'detach_volume' instance 1c40a98f-366d-4392-9034-7841f68b2050 while it is in vm_state rescued {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:15:18.760230 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a85855bc-30b3-46b2-b341-d71dcd923ae1 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "DELETE /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050/os-volume_attachments/f3a07e52-7a2a-49ce-a2f2-77f81069632b" status: 409 len: 152 microversion: 2.1 time: 0.233621 Aug 31 16:15:18.761501 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2536/4876] 10.222.0.50 () {58 vars in 1416 bytes} [Wed Aug 31 16:15:18 2022] DELETE /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050/os-volume_attachments/f3a07e52-7a2a-49ce-a2f2-77f81069632b => generated 152 bytes in 235 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 16:15:18.769827 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c3be8d7e-b1c7-4d5c-90d3-2a61b0355921 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:18.778448 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c3be8d7e-b1c7-4d5c-90d3-2a61b0355921 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 1c40a98f-366d-4392-9034-7841f68b2050] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:18.787299 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3be8d7e-b1c7-4d5c-90d3-2a61b0355921 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:18.787787 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3be8d7e-b1c7-4d5c-90d3-2a61b0355921 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:18.788222 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3be8d7e-b1c7-4d5c-90d3-2a61b0355921 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:18.788921 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3be8d7e-b1c7-4d5c-90d3-2a61b0355921 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:18.789365 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3be8d7e-b1c7-4d5c-90d3-2a61b0355921 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:18.789785 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3be8d7e-b1c7-4d5c-90d3-2a61b0355921 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:18.895225 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c3be8d7e-b1c7-4d5c-90d3-2a61b0355921 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "POST /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050/action" status: 202 len: 0 microversion: 2.1 time: 0.128831 Aug 31 16:15:18.896498 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2341/4877] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:15:18 2022] POST /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:15:18.905057 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2299f32b-90f0-46ee-8a42-ffc9464ce377 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:18.905900 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2299f32b-90f0-46ee-8a42-ffc9464ce377 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 1c40a98f-366d-4392-9034-7841f68b2050] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:18.922279 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2299f32b-90f0-46ee-8a42-ffc9464ce377 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:18.923285 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2299f32b-90f0-46ee-8a42-ffc9464ce377 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:18.923978 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2299f32b-90f0-46ee-8a42-ffc9464ce377 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:18.925259 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2299f32b-90f0-46ee-8a42-ffc9464ce377 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:18.925955 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2299f32b-90f0-46ee-8a42-ffc9464ce377 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:18.926832 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2299f32b-90f0-46ee-8a42-ffc9464ce377 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:19.017279 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-65eaeab5-3716-4098-a6fd-55250ab231ba tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:19.017998 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-65eaeab5-3716-4098-a6fd-55250ab231ba tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] [instance: 30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:19.030400 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65eaeab5-3716-4098-a6fd-55250ab231ba tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:19.034412 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65eaeab5-3716-4098-a6fd-55250ab231ba tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:19.035349 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65eaeab5-3716-4098-a6fd-55250ab231ba tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:19.036704 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65eaeab5-3716-4098-a6fd-55250ab231ba tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:19.037379 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65eaeab5-3716-4098-a6fd-55250ab231ba tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:19.038706 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65eaeab5-3716-4098-a6fd-55250ab231ba tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:19.575857 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2299f32b-90f0-46ee-8a42-ffc9464ce377 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:19.585703 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2299f32b-90f0-46ee-8a42-ffc9464ce377 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050" status: 200 len: 1724 microversion: 2.1 time: 0.684932 Aug 31 16:15:19.591370 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2537/4878] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:18 2022] GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050 => generated 1724 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:19.601502 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8db4951b-7a3b-4fdf-91f8-baeb99bd6142 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:19.605442 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8db4951b-7a3b-4fdf-91f8-baeb99bd6142 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:19.621559 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8db4951b-7a3b-4fdf-91f8-baeb99bd6142 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:19.623070 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8db4951b-7a3b-4fdf-91f8-baeb99bd6142 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:19.624763 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8db4951b-7a3b-4fdf-91f8-baeb99bd6142 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:19.625677 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8db4951b-7a3b-4fdf-91f8-baeb99bd6142 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:19.634339 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8db4951b-7a3b-4fdf-91f8-baeb99bd6142 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:19.635073 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8db4951b-7a3b-4fdf-91f8-baeb99bd6142 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:19.686754 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-65eaeab5-3716-4098-a6fd-55250ab231ba tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dabb1c841cde40769174e2f8a97234c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baff3cad5c14325a5576c40fcda0580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:19.700113 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-65eaeab5-3716-4098-a6fd-55250ab231ba tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "GET /compute/v2.1/servers/30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c" status: 200 len: 1316 microversion: 2.1 time: 0.688698 Aug 31 16:15:19.700666 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=100 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:15:19.714324 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2342/4879] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:19 2022] GET /compute/v2.1/servers/30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c => generated 1316 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:15:19.841036 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-60e26f8f-9ae1-4eca-b1f5-7e03451a8bd2 req-787b0c66-51b0-45cf-ad81-8097b801fc1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b051f4f-6b51-4ca7-9afd-6d75682e7f52", "tag": "5c653659-ac4d-41e4-8b0a-b35ade932e62"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:19.865157 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-60e26f8f-9ae1-4eca-b1f5-7e03451a8bd2 req-787b0c66-51b0-45cf-ad81-8097b801fc1e service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:19.866227 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-60e26f8f-9ae1-4eca-b1f5-7e03451a8bd2 req-787b0c66-51b0-45cf-ad81-8097b801fc1e service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:19.866895 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-60e26f8f-9ae1-4eca-b1f5-7e03451a8bd2 req-787b0c66-51b0-45cf-ad81-8097b801fc1e service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:19.891223 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-60e26f8f-9ae1-4eca-b1f5-7e03451a8bd2 req-787b0c66-51b0-45cf-ad81-8097b801fc1e service nova] Creating event network-changed:5c653659-ac4d-41e4-8b0a-b35ade932e62 for instance 4b051f4f-6b51-4ca7-9afd-6d75682e7f52 on n-h2-833090-16 Aug 31 16:15:19.904835 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-60e26f8f-9ae1-4eca-b1f5-7e03451a8bd2 req-787b0c66-51b0-45cf-ad81-8097b801fc1e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067761 Aug 31 16:15:19.910575 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2343/4880] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:15:20.144682 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8db4951b-7a3b-4fdf-91f8-baeb99bd6142 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:20.171961 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8db4951b-7a3b-4fdf-91f8-baeb99bd6142 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1317 microversion: 2.1 time: 0.579365 Aug 31 16:15:20.172949 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2538/4881] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:19 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1317 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:20.613623 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-16e79dbc-6774-4b9b-82ed-ca308334cebe tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:20.614472 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-16e79dbc-6774-4b9b-82ed-ca308334cebe tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 1c40a98f-366d-4392-9034-7841f68b2050] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:20.624105 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16e79dbc-6774-4b9b-82ed-ca308334cebe tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:20.624899 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16e79dbc-6774-4b9b-82ed-ca308334cebe tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:20.625521 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16e79dbc-6774-4b9b-82ed-ca308334cebe tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:20.626453 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16e79dbc-6774-4b9b-82ed-ca308334cebe tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:20.627076 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16e79dbc-6774-4b9b-82ed-ca308334cebe tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:20.627673 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16e79dbc-6774-4b9b-82ed-ca308334cebe tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:20.738427 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a999d432-f036-43ab-a5e1-2552d0a3ce2a tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:20.740351 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a999d432-f036-43ab-a5e1-2552d0a3ce2a tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] [instance: 30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:20.758848 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a999d432-f036-43ab-a5e1-2552d0a3ce2a tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:20.761865 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a999d432-f036-43ab-a5e1-2552d0a3ce2a tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:20.762676 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a999d432-f036-43ab-a5e1-2552d0a3ce2a tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:20.765265 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a999d432-f036-43ab-a5e1-2552d0a3ce2a tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:20.767470 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a999d432-f036-43ab-a5e1-2552d0a3ce2a tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:20.769855 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a999d432-f036-43ab-a5e1-2552d0a3ce2a tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:20.891985 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-16e79dbc-6774-4b9b-82ed-ca308334cebe tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:20.904235 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-16e79dbc-6774-4b9b-82ed-ca308334cebe tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050" status: 200 len: 1724 microversion: 2.1 time: 0.295583 Aug 31 16:15:20.904848 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2344/4882] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:20 2022] GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050 => generated 1724 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:20.960120 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a999d432-f036-43ab-a5e1-2552d0a3ce2a tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dabb1c841cde40769174e2f8a97234c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baff3cad5c14325a5576c40fcda0580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:20.968186 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a999d432-f036-43ab-a5e1-2552d0a3ce2a tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "GET /compute/v2.1/servers/30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c" status: 200 len: 1316 microversion: 2.1 time: 0.250100 Aug 31 16:15:20.968834 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2539/4883] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:20 2022] GET /compute/v2.1/servers/30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c => generated 1316 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:21.195298 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3764cef9-1000-41af-81e5-1f41e413cee3 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:21.195950 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3764cef9-1000-41af-81e5-1f41e413cee3 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:21.203587 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3764cef9-1000-41af-81e5-1f41e413cee3 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:21.204779 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3764cef9-1000-41af-81e5-1f41e413cee3 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:21.205787 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3764cef9-1000-41af-81e5-1f41e413cee3 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:21.206619 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3764cef9-1000-41af-81e5-1f41e413cee3 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:21.207310 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3764cef9-1000-41af-81e5-1f41e413cee3 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:21.208118 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3764cef9-1000-41af-81e5-1f41e413cee3 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:21.372944 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3764cef9-1000-41af-81e5-1f41e413cee3 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:21.382115 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3764cef9-1000-41af-81e5-1f41e413cee3 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1317 microversion: 2.1 time: 0.191192 Aug 31 16:15:21.383070 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2345/4884] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:21 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1317 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:15:21.928261 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2d562b2c-818e-445b-9e74-40b283929eb5 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:21.929006 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2d562b2c-818e-445b-9e74-40b283929eb5 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 1c40a98f-366d-4392-9034-7841f68b2050] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:21.942351 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2d562b2c-818e-445b-9e74-40b283929eb5 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:21.942848 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2d562b2c-818e-445b-9e74-40b283929eb5 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:21.943949 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2d562b2c-818e-445b-9e74-40b283929eb5 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:21.946216 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2d562b2c-818e-445b-9e74-40b283929eb5 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:21.947120 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2d562b2c-818e-445b-9e74-40b283929eb5 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:21.947789 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2d562b2c-818e-445b-9e74-40b283929eb5 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:21.990864 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1ccc7bda-1f2b-4b44-86ea-1e81a2101f81 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:21.991568 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1ccc7bda-1f2b-4b44-86ea-1e81a2101f81 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] [instance: 30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:22.004294 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ccc7bda-1f2b-4b44-86ea-1e81a2101f81 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:22.005344 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ccc7bda-1f2b-4b44-86ea-1e81a2101f81 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:22.005979 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ccc7bda-1f2b-4b44-86ea-1e81a2101f81 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:22.006767 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ccc7bda-1f2b-4b44-86ea-1e81a2101f81 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:22.007236 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ccc7bda-1f2b-4b44-86ea-1e81a2101f81 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:22.007646 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ccc7bda-1f2b-4b44-86ea-1e81a2101f81 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:22.048283 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:15:22.195852 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2d562b2c-818e-445b-9e74-40b283929eb5 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:22.208233 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2d562b2c-818e-445b-9e74-40b283929eb5 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050" status: 200 len: 1724 microversion: 2.1 time: 0.283530 Aug 31 16:15:22.210856 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2540/4885] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:21 2022] GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050 => generated 1724 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:22.266602 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1ccc7bda-1f2b-4b44-86ea-1e81a2101f81 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dabb1c841cde40769174e2f8a97234c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baff3cad5c14325a5576c40fcda0580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:22.275331 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1ccc7bda-1f2b-4b44-86ea-1e81a2101f81 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "GET /compute/v2.1/servers/30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c" status: 200 len: 1316 microversion: 2.1 time: 0.289358 Aug 31 16:15:22.276552 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2346/4886] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:21 2022] GET /compute/v2.1/servers/30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c => generated 1316 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:22.404496 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3bce165c-a065-4fb1-bc12-0e2625099c73 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:22.405229 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3bce165c-a065-4fb1-bc12-0e2625099c73 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:22.415064 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3bce165c-a065-4fb1-bc12-0e2625099c73 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:22.415562 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3bce165c-a065-4fb1-bc12-0e2625099c73 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:22.415999 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3bce165c-a065-4fb1-bc12-0e2625099c73 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:22.416746 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3bce165c-a065-4fb1-bc12-0e2625099c73 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:22.418449 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3bce165c-a065-4fb1-bc12-0e2625099c73 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:22.418893 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3bce165c-a065-4fb1-bc12-0e2625099c73 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:22.579160 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3bce165c-a065-4fb1-bc12-0e2625099c73 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:22.587584 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3bce165c-a065-4fb1-bc12-0e2625099c73 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1317 microversion: 2.1 time: 0.187634 Aug 31 16:15:22.588160 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2541/4887] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:22 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1317 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:23.234956 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-539b0683-3973-4db0-964c-d5ec89f1a722 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:23.236309 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-539b0683-3973-4db0-964c-d5ec89f1a722 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 1c40a98f-366d-4392-9034-7841f68b2050] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:23.243995 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-539b0683-3973-4db0-964c-d5ec89f1a722 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:23.244661 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-539b0683-3973-4db0-964c-d5ec89f1a722 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:23.245288 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-539b0683-3973-4db0-964c-d5ec89f1a722 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:23.245988 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-539b0683-3973-4db0-964c-d5ec89f1a722 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:23.246466 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-539b0683-3973-4db0-964c-d5ec89f1a722 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:23.246887 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-539b0683-3973-4db0-964c-d5ec89f1a722 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:23.359464 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-27f09380-9590-47e3-a7f0-e1fea6fb2915 tempest-QuotasTestJSON-496210897 tempest-QuotasTestJSON-496210897-project] Calling method '.version_select at 0x7fbb45d3c040>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:23.392834 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-539b0683-3973-4db0-964c-d5ec89f1a722 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:23.402536 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-539b0683-3973-4db0-964c-d5ec89f1a722 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050" status: 200 len: 1730 microversion: 2.1 time: 0.171797 Aug 31 16:15:23.403339 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2542/4888] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:23 2022] GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:23.424903 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0ce6eb5a-33c6-4395-86f0-308876f0cac2 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:23.425547 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0ce6eb5a-33c6-4395-86f0-308876f0cac2 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] [instance: 30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:23.429670 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-27f09380-9590-47e3-a7f0-e1fea6fb2915 tempest-QuotasTestJSON-496210897 tempest-QuotasTestJSON-496210897-project] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/942475c779e5433aababf57f77053ba9/defaults" status: 200 len: 371 microversion: 2.1 time: 0.269176 Aug 31 16:15:23.432168 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0ce6eb5a-33c6-4395-86f0-308876f0cac2 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:23.432658 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0ce6eb5a-33c6-4395-86f0-308876f0cac2 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:23.433095 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0ce6eb5a-33c6-4395-86f0-308876f0cac2 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:23.433794 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0ce6eb5a-33c6-4395-86f0-308876f0cac2 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:23.434278 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0ce6eb5a-33c6-4395-86f0-308876f0cac2 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:23.434890 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0ce6eb5a-33c6-4395-86f0-308876f0cac2 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:23.436966 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2347/4889] 10.222.0.50 () {58 vars in 1269 bytes} [Wed Aug 31 16:15:23 2022] GET /compute/v2.1/os-quota-sets/942475c779e5433aababf57f77053ba9/defaults => generated 371 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:23.442069 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4d6584a9-4bda-4fbc-aa2d-07788c9df8ce tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:23.442798 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4d6584a9-4bda-4fbc-aa2d-07788c9df8ce tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 1c40a98f-366d-4392-9034-7841f68b2050] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:23.449826 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d6584a9-4bda-4fbc-aa2d-07788c9df8ce tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:23.450407 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d6584a9-4bda-4fbc-aa2d-07788c9df8ce tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:23.450918 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d6584a9-4bda-4fbc-aa2d-07788c9df8ce tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:23.451865 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d6584a9-4bda-4fbc-aa2d-07788c9df8ce tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:23.452521 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d6584a9-4bda-4fbc-aa2d-07788c9df8ce tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:23.453179 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d6584a9-4bda-4fbc-aa2d-07788c9df8ce tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:23.570644 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4d6584a9-4bda-4fbc-aa2d-07788c9df8ce tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.132357 Aug 31 16:15:23.572312 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2348/4890] 10.222.0.50 () {58 vars in 1275 bytes} [Wed Aug 31 16:15:23 2022] GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050/os-interface => generated 284 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:23.580777 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5f82339b-ac74-409e-ad28-7671ff779b19 tempest-QuotasTestJSON-496210897 tempest-QuotasTestJSON-496210897-project] Calling method '.version_select at 0x7fbb46671dc0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:23.625060 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0ce6eb5a-33c6-4395-86f0-308876f0cac2 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dabb1c841cde40769174e2f8a97234c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baff3cad5c14325a5576c40fcda0580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:23.634232 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0ce6eb5a-33c6-4395-86f0-308876f0cac2 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "GET /compute/v2.1/servers/30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c" status: 200 len: 1316 microversion: 2.1 time: 0.217782 Aug 31 16:15:23.651654 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2543/4891] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:23 2022] GET /compute/v2.1/servers/30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c => generated 1316 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:23.664180 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d15b5df0-1adf-4832-94b0-5d510302106f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:23.668006 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d15b5df0-1adf-4832-94b0-5d510302106f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:23.682979 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d15b5df0-1adf-4832-94b0-5d510302106f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:23.683467 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d15b5df0-1adf-4832-94b0-5d510302106f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:23.683894 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d15b5df0-1adf-4832-94b0-5d510302106f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:23.690253 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d15b5df0-1adf-4832-94b0-5d510302106f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:23.690959 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d15b5df0-1adf-4832-94b0-5d510302106f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:23.692454 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d15b5df0-1adf-4832-94b0-5d510302106f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:23.846080 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:15:23.870999 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=12 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:15:24.008576 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5f82339b-ac74-409e-ad28-7671ff779b19 tempest-QuotasTestJSON-496210897 tempest-QuotasTestJSON-496210897-project] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/942475c779e5433aababf57f77053ba9" status: 200 len: 371 microversion: 2.1 time: 0.432853 Aug 31 16:15:24.012005 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2349/4892] 10.222.0.50 () {58 vars in 1242 bytes} [Wed Aug 31 16:15:23 2022] GET /compute/v2.1/os-quota-sets/942475c779e5433aababf57f77053ba9 => generated 371 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:24.023815 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d15b5df0-1adf-4832-94b0-5d510302106f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:24.034671 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d15b5df0-1adf-4832-94b0-5d510302106f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1317 microversion: 2.1 time: 0.381585 Aug 31 16:15:24.039402 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2544/4893] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:23 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1317 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:24.049024 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b0093f7a-67fc-4df3-ac99-68f5a1f94d58 tempest-QuotasTestJSON-496210897 tempest-QuotasTestJSON-496210897-project] Calling method '.version_select at 0x7fbb4ab36820>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:24.057097 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=4 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:15:24.147910 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-be7a94a8-20c0-4560-b0c3-d047cefdea15 req-9a5c5bac-6a14-4509-8515-ca0ffe04e72e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c", "name": "network-vif-plugged", "status": "completed", "tag": "cc1d20a8-7d6e-45fd-8862-92c3e6d7af2e"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:24.159848 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-be7a94a8-20c0-4560-b0c3-d047cefdea15 req-9a5c5bac-6a14-4509-8515-ca0ffe04e72e service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:24.160623 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-be7a94a8-20c0-4560-b0c3-d047cefdea15 req-9a5c5bac-6a14-4509-8515-ca0ffe04e72e service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:24.161387 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-be7a94a8-20c0-4560-b0c3-d047cefdea15 req-9a5c5bac-6a14-4509-8515-ca0ffe04e72e service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:24.177329 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-be7a94a8-20c0-4560-b0c3-d047cefdea15 req-9a5c5bac-6a14-4509-8515-ca0ffe04e72e service nova] Creating event network-vif-plugged:cc1d20a8-7d6e-45fd-8862-92c3e6d7af2e for instance 30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c on n-h1-833090-16 Aug 31 16:15:24.177610 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b0093f7a-67fc-4df3-ac99-68f5a1f94d58 tempest-QuotasTestJSON-496210897 tempest-QuotasTestJSON-496210897-project] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/942475c779e5433aababf57f77053ba9/defaults" status: 200 len: 371 microversion: 2.1 time: 0.136510 Aug 31 16:15:24.178635 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2545/4894] 10.222.0.50 () {58 vars in 1269 bytes} [Wed Aug 31 16:15:24 2022] GET /compute/v2.1/os-quota-sets/942475c779e5433aababf57f77053ba9/defaults => generated 371 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:24.190570 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-be7a94a8-20c0-4560-b0c3-d047cefdea15 req-9a5c5bac-6a14-4509-8515-ca0ffe04e72e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176862 Aug 31 16:15:24.192763 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2350/4895] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:24.193775 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-268895f3-9e13-40b9-bd35-03befb64f634 tempest-QuotasTestJSON-496210897 tempest-QuotasTestJSON-496210897-project] Calling method '.version_select at 0x7fbb4aa5c040>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:24.336245 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-268895f3-9e13-40b9-bd35-03befb64f634 tempest-QuotasTestJSON-496210897 tempest-QuotasTestJSON-496210897-project] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/942475c779e5433aababf57f77053ba9" status: 200 len: 371 microversion: 2.1 time: 0.146614 Aug 31 16:15:24.336963 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2546/4896] 10.222.0.50 () {58 vars in 1242 bytes} [Wed Aug 31 16:15:24 2022] GET /compute/v2.1/os-quota-sets/942475c779e5433aababf57f77053ba9 => generated 371 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:15:24.351311 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d6334058-c5b9-44a2-b658-ee6d54329875 tempest-QuotasTestJSON-496210897 tempest-QuotasTestJSON-496210897-project] Calling method '.version_select at 0x7fbb45cdeca0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:24.479106 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d6334058-c5b9-44a2-b658-ee6d54329875 tempest-QuotasTestJSON-496210897 tempest-QuotasTestJSON-496210897-project] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/942475c779e5433aababf57f77053ba9?user_id=9a84ec333e0c44e58310d81e2f853f57" status: 200 len: 371 microversion: 2.1 time: 0.133936 Aug 31 16:15:24.480220 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2351/4897] 10.222.0.50 () {58 vars in 1323 bytes} [Wed Aug 31 16:15:24 2022] GET /compute/v2.1/os-quota-sets/942475c779e5433aababf57f77053ba9?user_id=9a84ec333e0c44e58310d81e2f853f57 => generated 371 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:24.668148 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1a152cd9-0665-4817-9499-0a0fe080e56c tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:24.668896 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1a152cd9-0665-4817-9499-0a0fe080e56c tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] [instance: 30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:24.678487 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a152cd9-0665-4817-9499-0a0fe080e56c tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:24.679294 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a152cd9-0665-4817-9499-0a0fe080e56c tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:24.681297 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a152cd9-0665-4817-9499-0a0fe080e56c tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:24.683287 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a152cd9-0665-4817-9499-0a0fe080e56c tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:24.684360 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a152cd9-0665-4817-9499-0a0fe080e56c tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:24.685292 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a152cd9-0665-4817-9499-0a0fe080e56c tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:24.897937 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1a152cd9-0665-4817-9499-0a0fe080e56c tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dabb1c841cde40769174e2f8a97234c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baff3cad5c14325a5576c40fcda0580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:24.910052 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1a152cd9-0665-4817-9499-0a0fe080e56c tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "GET /compute/v2.1/servers/30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c" status: 200 len: 1316 microversion: 2.1 time: 0.246322 Aug 31 16:15:24.911143 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2547/4898] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:24 2022] GET /compute/v2.1/servers/30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c => generated 1316 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:25.066111 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8d1725b8-a50c-4272-a8cf-3d9fb28c0580 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:25.067408 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8d1725b8-a50c-4272-a8cf-3d9fb28c0580 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:25.075509 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8d1725b8-a50c-4272-a8cf-3d9fb28c0580 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:25.076471 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8d1725b8-a50c-4272-a8cf-3d9fb28c0580 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:25.077237 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8d1725b8-a50c-4272-a8cf-3d9fb28c0580 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:25.078380 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8d1725b8-a50c-4272-a8cf-3d9fb28c0580 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:25.079627 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8d1725b8-a50c-4272-a8cf-3d9fb28c0580 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:25.080650 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8d1725b8-a50c-4272-a8cf-3d9fb28c0580 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:25.275812 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-7f98b50a-2138-4fa5-97b1-406ffabae4f2 req-340d9486-b954-4232-96d3-be538020355e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c40a98f-366d-4392-9034-7841f68b2050", "tag": "d9b0901e-5dc3-4373-a2f1-0cba26b60d8b"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:25.295352 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7f98b50a-2138-4fa5-97b1-406ffabae4f2 req-340d9486-b954-4232-96d3-be538020355e service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:25.296082 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7f98b50a-2138-4fa5-97b1-406ffabae4f2 req-340d9486-b954-4232-96d3-be538020355e service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:25.297736 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7f98b50a-2138-4fa5-97b1-406ffabae4f2 req-340d9486-b954-4232-96d3-be538020355e service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:25.322476 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-7f98b50a-2138-4fa5-97b1-406ffabae4f2 req-340d9486-b954-4232-96d3-be538020355e service nova] Creating event network-changed:d9b0901e-5dc3-4373-a2f1-0cba26b60d8b for instance 1c40a98f-366d-4392-9034-7841f68b2050 on n-h1-833090-16 Aug 31 16:15:25.329633 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-7f98b50a-2138-4fa5-97b1-406ffabae4f2 req-340d9486-b954-4232-96d3-be538020355e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.301208 Aug 31 16:15:25.337630 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2352/4899] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:25.924860 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8d1725b8-a50c-4272-a8cf-3d9fb28c0580 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:25.933305 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2c8f8c71-c8f2-4a58-8cf1-d785b4bea300 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:25.933886 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8d1725b8-a50c-4272-a8cf-3d9fb28c0580 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1317 microversion: 2.1 time: 0.875685 Aug 31 16:15:25.934447 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2548/4900] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:25 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1317 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:25.934589 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2c8f8c71-c8f2-4a58-8cf1-d785b4bea300 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] [instance: 30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:25.943270 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c8f8c71-c8f2-4a58-8cf1-d785b4bea300 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:25.944950 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c8f8c71-c8f2-4a58-8cf1-d785b4bea300 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:25.945611 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c8f8c71-c8f2-4a58-8cf1-d785b4bea300 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:25.947450 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c8f8c71-c8f2-4a58-8cf1-d785b4bea300 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:25.947938 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c8f8c71-c8f2-4a58-8cf1-d785b4bea300 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:25.948494 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c8f8c71-c8f2-4a58-8cf1-d785b4bea300 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:26.300055 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2c8f8c71-c8f2-4a58-8cf1-d785b4bea300 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dabb1c841cde40769174e2f8a97234c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baff3cad5c14325a5576c40fcda0580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:26.318760 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2c8f8c71-c8f2-4a58-8cf1-d785b4bea300 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "GET /compute/v2.1/servers/30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c" status: 200 len: 1504 microversion: 2.1 time: 0.391167 Aug 31 16:15:26.319364 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2353/4901] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:25 2022] GET /compute/v2.1/servers/30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c => generated 1504 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:26.343867 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c5b32e8e-c947-48be-8550-b660a403c9a2 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1086339023"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:26.344260 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c5b32e8e-c947-48be-8550-b660a403c9a2 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] [instance: 30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:26.352214 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c5b32e8e-c947-48be-8550-b660a403c9a2 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:26.352675 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c5b32e8e-c947-48be-8550-b660a403c9a2 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:26.353320 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c5b32e8e-c947-48be-8550-b660a403c9a2 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:26.356747 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c5b32e8e-c947-48be-8550-b660a403c9a2 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:26.357445 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c5b32e8e-c947-48be-8550-b660a403c9a2 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:26.358084 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c5b32e8e-c947-48be-8550-b660a403c9a2 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:26.585678 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-dcc4f5e5-da14-4985-a754-f5f8b0f74e07 req-aa5da881-e835-4f4f-9c8b-a7b6e9ad293f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b051f4f-6b51-4ca7-9afd-6d75682e7f52", "name": "network-vif-plugged", "status": "completed", "tag": "5c653659-ac4d-41e4-8b0a-b35ade932e62"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:26.609474 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-dcc4f5e5-da14-4985-a754-f5f8b0f74e07 req-aa5da881-e835-4f4f-9c8b-a7b6e9ad293f service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:26.609955 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-dcc4f5e5-da14-4985-a754-f5f8b0f74e07 req-aa5da881-e835-4f4f-9c8b-a7b6e9ad293f service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:26.613197 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-dcc4f5e5-da14-4985-a754-f5f8b0f74e07 req-aa5da881-e835-4f4f-9c8b-a7b6e9ad293f service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:26.639570 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-dcc4f5e5-da14-4985-a754-f5f8b0f74e07 req-aa5da881-e835-4f4f-9c8b-a7b6e9ad293f service nova] Creating event network-vif-plugged:5c653659-ac4d-41e4-8b0a-b35ade932e62 for instance 4b051f4f-6b51-4ca7-9afd-6d75682e7f52 on n-h2-833090-16 Aug 31 16:15:26.650877 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-dcc4f5e5-da14-4985-a754-f5f8b0f74e07 req-aa5da881-e835-4f4f-9c8b-a7b6e9ad293f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067601 Aug 31 16:15:26.651822 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2354/4902] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:26.747439 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.network.security_group_api [None req-c5b32e8e-c947-48be-8550-b660a403c9a2 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Adding security group 527d56f8-f8fa-4f82-8fce-5c93e22975cd to port cc1d20a8-7d6e-45fd-8862-92c3e6d7af2e Aug 31 16:15:26.957921 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f76d2f12-35d7-48fc-83dc-bb47948876bb tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:26.958562 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f76d2f12-35d7-48fc-83dc-bb47948876bb tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:26.966392 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f76d2f12-35d7-48fc-83dc-bb47948876bb tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:26.967763 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f76d2f12-35d7-48fc-83dc-bb47948876bb tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:26.968487 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f76d2f12-35d7-48fc-83dc-bb47948876bb tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:26.969412 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f76d2f12-35d7-48fc-83dc-bb47948876bb tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:26.970432 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f76d2f12-35d7-48fc-83dc-bb47948876bb tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:26.971365 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f76d2f12-35d7-48fc-83dc-bb47948876bb tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:27.217792 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f76d2f12-35d7-48fc-83dc-bb47948876bb tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:27.239985 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f76d2f12-35d7-48fc-83dc-bb47948876bb tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1317 microversion: 2.1 time: 0.278236 Aug 31 16:15:27.241571 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2355/4903] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:26 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1317 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:27.357432 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-00656907-dc4c-4e7f-95cc-d0a1a27dffe9 req-c21868bc-198d-499d-b475-49678bb8131c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c40a98f-366d-4392-9034-7841f68b2050", "tag": "d9b0901e-5dc3-4373-a2f1-0cba26b60d8b"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:27.368997 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-00656907-dc4c-4e7f-95cc-d0a1a27dffe9 req-c21868bc-198d-499d-b475-49678bb8131c service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:27.369744 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-00656907-dc4c-4e7f-95cc-d0a1a27dffe9 req-c21868bc-198d-499d-b475-49678bb8131c service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:27.370381 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-00656907-dc4c-4e7f-95cc-d0a1a27dffe9 req-c21868bc-198d-499d-b475-49678bb8131c service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:27.387323 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-00656907-dc4c-4e7f-95cc-d0a1a27dffe9 req-c21868bc-198d-499d-b475-49678bb8131c service nova] Creating event network-changed:d9b0901e-5dc3-4373-a2f1-0cba26b60d8b for instance 1c40a98f-366d-4392-9034-7841f68b2050 on n-h1-833090-16 Aug 31 16:15:27.393561 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-00656907-dc4c-4e7f-95cc-d0a1a27dffe9 req-c21868bc-198d-499d-b475-49678bb8131c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041121 Aug 31 16:15:27.394433 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2356/4904] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:15:27.395622 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-00656907-dc4c-4e7f-95cc-d0a1a27dffe9 req-c21868bc-198d-499d-b475-49678bb8131c service nova] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:27.396846 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-00656907-dc4c-4e7f-95cc-d0a1a27dffe9 req-c21868bc-198d-499d-b475-49678bb8131c service nova] 10.222.0.50 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001507 Aug 31 16:15:27.397117 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2357/4905] 10.222.0.50 () {56 vars in 886 bytes} [Wed Aug 31 16:15:27 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 31 16:15:27.405340 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-00656907-dc4c-4e7f-95cc-d0a1a27dffe9 req-c21868bc-198d-499d-b475-49678bb8131c service nova] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:27.407530 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-00656907-dc4c-4e7f-95cc-d0a1a27dffe9 req-c21868bc-198d-499d-b475-49678bb8131c service nova] 10.222.0.50 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001822 Aug 31 16:15:27.408038 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2358/4906] 10.222.0.50 () {54 vars in 1035 bytes} [Wed Aug 31 16:15:27 2022] GET /compute/v2/ => generated 379 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 221 bytes (2 switches on core 0) Aug 31 16:15:27.417915 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-00656907-dc4c-4e7f-95cc-d0a1a27dffe9 req-c21868bc-198d-499d-b475-49678bb8131c service nova] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:27.419270 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-00656907-dc4c-4e7f-95cc-d0a1a27dffe9 req-c21868bc-198d-499d-b475-49678bb8131c service nova] 10.222.0.50 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002420 Aug 31 16:15:27.420140 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2359/4907] 10.222.0.50 () {54 vars in 1041 bytes} [Wed Aug 31 16:15:27 2022] GET /compute/v2.1/ => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:15:27.429196 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-00656907-dc4c-4e7f-95cc-d0a1a27dffe9 req-c21868bc-198d-499d-b475-49678bb8131c service nova] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:27.430186 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-00656907-dc4c-4e7f-95cc-d0a1a27dffe9 req-c21868bc-198d-499d-b475-49678bb8131c service nova] 10.222.0.50 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001301 Aug 31 16:15:27.430943 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2360/4908] 10.222.0.50 () {56 vars in 886 bytes} [Wed Aug 31 16:15:27 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 31 16:15:27.499984 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c5b32e8e-c947-48be-8550-b660a403c9a2 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "POST /compute/v2.1/servers/30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c/action" status: 202 len: 0 microversion: 2.1 time: 1.160869 Aug 31 16:15:27.500801 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2549/4909] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:15:26 2022] POST /compute/v2.1/servers/30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c/action => generated 0 bytes in 1163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:15:27.516085 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-fe400ec4-9659-400d-9e41-64efb9bb0f1f req-0b4fbd9b-cde3-4e94-8dde-69f31444b344 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c", "tag": "cc1d20a8-7d6e-45fd-8862-92c3e6d7af2e"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:27.518136 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-24b215d7-d841-4f80-915d-135c9d45fb5b tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-739257858"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:27.519556 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-24b215d7-d841-4f80-915d-135c9d45fb5b tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] [instance: 30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:27.541373 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-24b215d7-d841-4f80-915d-135c9d45fb5b tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:27.553041 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-24b215d7-d841-4f80-915d-135c9d45fb5b tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:27.554662 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-24b215d7-d841-4f80-915d-135c9d45fb5b tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:27.557428 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-24b215d7-d841-4f80-915d-135c9d45fb5b tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:27.558394 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-24b215d7-d841-4f80-915d-135c9d45fb5b tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:27.559940 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-fe400ec4-9659-400d-9e41-64efb9bb0f1f req-0b4fbd9b-cde3-4e94-8dde-69f31444b344 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:27.560611 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-24b215d7-d841-4f80-915d-135c9d45fb5b tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:27.561829 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-fe400ec4-9659-400d-9e41-64efb9bb0f1f req-0b4fbd9b-cde3-4e94-8dde-69f31444b344 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:27.565436 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-fe400ec4-9659-400d-9e41-64efb9bb0f1f req-0b4fbd9b-cde3-4e94-8dde-69f31444b344 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:27.598439 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-fe400ec4-9659-400d-9e41-64efb9bb0f1f req-0b4fbd9b-cde3-4e94-8dde-69f31444b344 service nova] Creating event network-changed:cc1d20a8-7d6e-45fd-8862-92c3e6d7af2e for instance 30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c on n-h1-833090-16 Aug 31 16:15:27.607885 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-fe400ec4-9659-400d-9e41-64efb9bb0f1f req-0b4fbd9b-cde3-4e94-8dde-69f31444b344 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100733 Aug 31 16:15:27.625164 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2550/4910] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:27.902855 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.network.security_group_api [None req-24b215d7-d841-4f80-915d-135c9d45fb5b tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Adding security group 6a1caa30-53f8-4cee-acf6-778496f407e7 to port cc1d20a8-7d6e-45fd-8862-92c3e6d7af2e Aug 31 16:15:28.265090 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0c0decbe-2d27-4cb1-bcb7-8e65794b62ad tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:28.265960 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0c0decbe-2d27-4cb1-bcb7-8e65794b62ad tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:28.273305 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0c0decbe-2d27-4cb1-bcb7-8e65794b62ad tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:28.274150 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0c0decbe-2d27-4cb1-bcb7-8e65794b62ad tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:28.274822 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0c0decbe-2d27-4cb1-bcb7-8e65794b62ad tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:28.275776 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0c0decbe-2d27-4cb1-bcb7-8e65794b62ad tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:28.276478 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0c0decbe-2d27-4cb1-bcb7-8e65794b62ad tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:28.277126 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0c0decbe-2d27-4cb1-bcb7-8e65794b62ad tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:28.686777 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0c0decbe-2d27-4cb1-bcb7-8e65794b62ad tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:28.706814 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0c0decbe-2d27-4cb1-bcb7-8e65794b62ad tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1317 microversion: 2.1 time: 0.445895 Aug 31 16:15:28.719940 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2551/4911] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:28 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1317 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:15:28.816028 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-24b215d7-d841-4f80-915d-135c9d45fb5b tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "POST /compute/v2.1/servers/30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c/action" status: 202 len: 0 microversion: 2.1 time: 1.310440 Aug 31 16:15:28.820091 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2361/4912] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:15:27 2022] POST /compute/v2.1/servers/30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c/action => generated 0 bytes in 1312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:15:28.826043 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e7abf922-a94c-4df2-adbc-284c0cb0ebfa tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:28.826807 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e7abf922-a94c-4df2-adbc-284c0cb0ebfa tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] [instance: 30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:28.838986 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7abf922-a94c-4df2-adbc-284c0cb0ebfa tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:28.839751 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7abf922-a94c-4df2-adbc-284c0cb0ebfa tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:28.840374 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7abf922-a94c-4df2-adbc-284c0cb0ebfa tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:28.841188 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7abf922-a94c-4df2-adbc-284c0cb0ebfa tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:28.841545 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7abf922-a94c-4df2-adbc-284c0cb0ebfa tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:28.841966 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7abf922-a94c-4df2-adbc-284c0cb0ebfa tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:29.098183 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e7abf922-a94c-4df2-adbc-284c0cb0ebfa tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "GET /compute/v2.1/servers/30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.276452 Aug 31 16:15:29.099514 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2552/4913] 10.222.0.50 () {58 vars in 1293 bytes} [Wed Aug 31 16:15:28 2022] GET /compute/v2.1/servers/30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c/os-security-groups => generated 1157 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:29.116946 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bfef0e07-1663-4e1e-b6bb-5dbccc89a06f tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Action: 'create', calling method: .version_select at 0x7fbb464a1280>, body: {"security_group": {"name": " tempest-securitygroup -679172583 ", "description": "tempest-description-1753860246"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:29.297129 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bfef0e07-1663-4e1e-b6bb-5dbccc89a06f tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.184660 Aug 31 16:15:29.298520 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2362/4914] 10.222.0.50 () {60 vars in 1180 bytes} [Wed Aug 31 16:15:29 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:29.312659 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-cc2eaeb1-0994-44a4-9220-be041ea42b6f tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '.version_select at 0x7fbb4aa55670>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:29.376393 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-cc2eaeb1-0994-44a4-9220-be041ea42b6f tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups/91e667ca-3807-4879-a671-a4e843be2acc" status: 200 len: 223 microversion: 2.1 time: 0.069111 Aug 31 16:15:29.377215 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2553/4915] 10.222.0.50 () {58 vars in 1269 bytes} [Wed Aug 31 16:15:29 2022] GET /compute/v2.1/os-security-groups/91e667ca-3807-4879-a671-a4e843be2acc => generated 223 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:29.395835 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fa727849-b8a9-4865-bf7c-56b5f64cea3e tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '.version_select at 0x7fbb45d3c3a0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:29.645204 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-0f405fb8-5d22-4b5d-b224-e7090c599f26 req-12c6746f-23db-4a26-b3c3-01f0bbac4350 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c", "tag": "cc1d20a8-7d6e-45fd-8862-92c3e6d7af2e"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:29.657081 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-0f405fb8-5d22-4b5d-b224-e7090c599f26 req-12c6746f-23db-4a26-b3c3-01f0bbac4350 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:29.657715 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-0f405fb8-5d22-4b5d-b224-e7090c599f26 req-12c6746f-23db-4a26-b3c3-01f0bbac4350 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:29.658434 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-0f405fb8-5d22-4b5d-b224-e7090c599f26 req-12c6746f-23db-4a26-b3c3-01f0bbac4350 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:29.664416 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fa727849-b8a9-4865-bf7c-56b5f64cea3e tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/91e667ca-3807-4879-a671-a4e843be2acc" status: 202 len: 0 microversion: 2.1 time: 0.275440 Aug 31 16:15:29.665279 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2363/4916] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 31 16:15:29 2022] DELETE /compute/v2.1/os-security-groups/91e667ca-3807-4879-a671-a4e843be2acc => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:15:29.674137 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-03e96842-0c4a-47ba-b61e-544c30d5553d tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '.version_select at 0x7fbb467adc10>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:29.698709 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-0f405fb8-5d22-4b5d-b224-e7090c599f26 req-12c6746f-23db-4a26-b3c3-01f0bbac4350 service nova] Creating event network-changed:cc1d20a8-7d6e-45fd-8862-92c3e6d7af2e for instance 30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c on n-h1-833090-16 Aug 31 16:15:29.704641 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-0f405fb8-5d22-4b5d-b224-e7090c599f26 req-12c6746f-23db-4a26-b3c3-01f0bbac4350 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063228 Aug 31 16:15:29.705636 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2554/4917] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:29.718384 n-d-833090-16 devstack@n-api.service[128863]: DEBUG neutronclient.v2_0.client [None req-03e96842-0c4a-47ba-b61e-544c30d5553d tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 91e667ca-3807-4879-a671-a4e843be2acc does not exist", "detail": ""}} {{(pid=128863) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 31 16:15:29.719175 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.security_group_api [None req-03e96842-0c4a-47ba-b61e-544c30d5553d tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Neutron security group 91e667ca-3807-4879-a671-a4e843be2acc not found {{(pid=128863) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 31 16:15:29.720536 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-03e96842-0c4a-47ba-b61e-544c30d5553d tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] HTTP exception thrown: Security group 91e667ca-3807-4879-a671-a4e843be2acc does not exist Aug 31 16:15:29.720536 n-d-833090-16 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-0c201a32-f454-4049-9f9b-11e89a58b8fe'] Aug 31 16:15:29.723388 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-03e96842-0c4a-47ba-b61e-544c30d5553d tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Request method failure captured: Aug 31 16:15:29.723388 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/os-security-groups/91e667ca-3807-4879-a671-a4e843be2acc HTTP/1.1 Aug 31 16:15:29.723388 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:15:29.723388 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:15:29.723388 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:15:29.723388 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:15:29.723388 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:15:29.723388 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:15:29.723388 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:15:29.723388 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:15:29.723388 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4kIFJ0zG0xeBGgG3uzrjLL9EnflnKZMdGdJ2D9YGgjKqtNDIyBPydopwRei8ZnPbXcFm3HhN-k5tWZi56omwftJZfOWCKw_Hb9N0DyCWLOGgTx7eghMjbdmJfyquGOCz4DRfEHH-TxPGulLn-DplfVM4FoftEuHQL9TOxgHDYENNcI Aug 31 16:15:29.723388 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:15:29.723388 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:15:29.723388 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:15:29.723388 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:15:29.723388 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:15:29.723388 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:15:29.723388 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 7baff3cad5c14325a5576c40fcda0580 Aug 31 16:15:29.723388 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-SecurityGroupsTestJSON-608242232 Aug 31 16:15:29.723388 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:15:29.723388 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:15:29.723388 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7baff3cad5c14325a5576c40fcda0580"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7baff3cad5c14325a5576c40fcda0580"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7baff3cad5c14325a5576c40fcda0580"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7baff3cad5c14325a5576c40fcda0580", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:15:29.723388 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-SecurityGroupsTestJSON-608242232 Aug 31 16:15:29.723388 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 7baff3cad5c14325a5576c40fcda0580 Aug 31 16:15:29.723388 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-608242232 Aug 31 16:15:29.723388 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-SecurityGroupsTestJSON-608242232-project Aug 31 16:15:29.723388 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:15:29.723388 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:15:29.723388 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: dabb1c841cde40769174e2f8a97234c0 Aug 31 16:15:29.723388 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-SecurityGroupsTestJSON-608242232-project Aug 31 16:15:29.723388 n-d-833090-16 devstack@n-api.service[128863]: method: Aug 31 16:15:29.723388 n-d-833090-16 devstack@n-api.service[128863]: exception: Security group 91e667ca-3807-4879-a671-a4e843be2acc does not exist Aug 31 16:15:29.723388 n-d-833090-16 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-0c201a32-f454-4049-9f9b-11e89a58b8fe'] Aug 31 16:15:29.723388 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '91e667ca-3807-4879-a671-a4e843be2acc'} Aug 31 16:15:29.723388 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:15:29.723388 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:29.723388 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 31 16:15:29.723388 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 31 16:15:29.723388 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:15:29.723388 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:15:29.723388 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 31 16:15:29.723388 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 31 16:15:29.723388 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:15:29.723388 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:15:29.723388 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 31 16:15:29.723388 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 31 16:15:29.723388 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:15:29.723388 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:15:29.723388 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 31 16:15:29.723388 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 31 16:15:29.723388 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:15:29.723388 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:15:29.723388 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 31 16:15:29.723388 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 31 16:15:29.723388 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:15:29.723388 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:15:29.723388 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 31 16:15:29.723388 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 31 16:15:29.723388 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 31 16:15:29.723388 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 31 16:15:29.723388 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 91e667ca-3807-4879-a671-a4e843be2acc does not exist Aug 31 16:15:29.728792 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0c201a32-f454-4049-9f9b-11e89a58b8fe'] Aug 31 16:15:29.728792 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:15:29.728792 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:29.728792 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:15:29.728792 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:29.728792 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 31 16:15:29.728792 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 31 16:15:29.728792 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 31 16:15:29.728792 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 31 16:15:29.728792 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 91e667ca-3807-4879-a671-a4e843be2acc does not exist Aug 31 16:15:29.728792 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0c201a32-f454-4049-9f9b-11e89a58b8fe'] Aug 31 16:15:29.728792 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:15:29.728792 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:29.728792 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:15:29.728792 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:29.728792 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:29.728792 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:29.728792 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:15:29.728792 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:15:29.728792 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:15:29.728792 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:15:29.728792 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:15:29.728792 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:15:29.728792 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 31 16:15:29.728792 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 31 16:15:29.728792 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 91e667ca-3807-4879-a671-a4e843be2acc does not exist Aug 31 16:15:29.728792 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0c201a32-f454-4049-9f9b-11e89a58b8fe'] Aug 31 16:15:29.728792 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:15:29.728792 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:29.728792 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:15:29.728792 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:29.728792 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:29.728792 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:29.728792 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:15:29.728792 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:15:29.728792 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 91e667ca-3807-4879-a671-a4e843be2acc does not exist Aug 31 16:15:29.728792 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0c201a32-f454-4049-9f9b-11e89a58b8fe'] Aug 31 16:15:29.728792 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:15:29.736410 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-03e96842-0c4a-47ba-b61e-544c30d5553d tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Returning 404 to user: Security group 91e667ca-3807-4879-a671-a4e843be2acc does not exist Aug 31 16:15:29.736410 n-d-833090-16 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-0c201a32-f454-4049-9f9b-11e89a58b8fe'] {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:15:29.736410 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-03e96842-0c4a-47ba-b61e-544c30d5553d tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups/91e667ca-3807-4879-a671-a4e843be2acc" status: 404 len: 194 microversion: 2.1 time: 0.060827 Aug 31 16:15:29.736410 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2364/4918] 10.222.0.50 () {58 vars in 1269 bytes} [Wed Aug 31 16:15:29 2022] GET /compute/v2.1/os-security-groups/91e667ca-3807-4879-a671-a4e843be2acc => generated 194 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:15:29.743132 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ff7f85cd-292f-484d-959b-270cc4faa9c2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:29.743843 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ff7f85cd-292f-484d-959b-270cc4faa9c2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:29.745455 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-628fabbb-ee61-437e-bfa2-22fda9666fbb tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Action: 'create', calling method: .version_select at 0x7fbb45d91670>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1786563945", "description": "tempest-description-1487611796"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:29.752119 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ff7f85cd-292f-484d-959b-270cc4faa9c2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:29.753116 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ff7f85cd-292f-484d-959b-270cc4faa9c2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:29.754048 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ff7f85cd-292f-484d-959b-270cc4faa9c2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:29.755609 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ff7f85cd-292f-484d-959b-270cc4faa9c2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:29.756399 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ff7f85cd-292f-484d-959b-270cc4faa9c2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:29.757024 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ff7f85cd-292f-484d-959b-270cc4faa9c2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:30.101901 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ff7f85cd-292f-484d-959b-270cc4faa9c2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:30.112635 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ff7f85cd-292f-484d-959b-270cc4faa9c2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.374106 Aug 31 16:15:30.114580 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2555/4919] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:29 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:30.267314 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-628fabbb-ee61-437e-bfa2-22fda9666fbb tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.528897 Aug 31 16:15:30.269855 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2365/4920] 10.222.0.50 () {60 vars in 1180 bytes} [Wed Aug 31 16:15:29 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:30.281861 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-23ec0c45-c84a-4dfc-a833-f181d94128ba tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Action: 'create', calling method: .version_select at 0x7fbb45db8430>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-721510395", "description": "tempest-description-1988644870"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:30.295621 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-151f1844-f7a2-433c-934a-ab6aa934df69 tempest-VolumesGetTestJSON-746098360 tempest-VolumesGetTestJSON-746098360-project] Action: 'create', calling method: .version_select at 0x7fbb4aa0d160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2036345762", "metadata": {"Type": "work"}}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:30.624801 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-23ec0c45-c84a-4dfc-a833-f181d94128ba tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.345340 Aug 31 16:15:30.626812 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2366/4921] 10.222.0.50 () {60 vars in 1180 bytes} [Wed Aug 31 16:15:30 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:15:30.644025 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ad545fd0-c83a-4df5-8423-b333f025f56f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1896675212", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "1c4c22f6-ea49-4e46-87c2-7de60e095fb8"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:30.725721 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-ad545fd0-c83a-4df5-8423-b333f025f56f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] validate_networks() for [('1c4c22f6-ea49-4e46-87c2-7de60e095fb8', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:15:30.769176 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-151f1844-f7a2-433c-934a-ab6aa934df69 tempest-VolumesGetTestJSON-746098360 tempest-VolumesGetTestJSON-746098360-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.653265 Aug 31 16:15:30.770085 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2556/4922] 10.222.0.50 () {60 vars in 1156 bytes} [Wed Aug 31 16:15:30 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 655 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 31 16:15:30.775439 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a4c916d2-4e5e-4fab-bb4b-7c985bc1fb46 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Action: 'create', calling method: .version_select at 0x7fbb45992280>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1415301204", "description": "tempest-description-611760575"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:31.138019 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a4c916d2-4e5e-4fab-bb4b-7c985bc1fb46 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.366325 Aug 31 16:15:31.139451 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2557/4923] 10.222.0.50 () {60 vars in 1180 bytes} [Wed Aug 31 16:15:30 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:31.170494 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-80640488-7cd0-44db-9f09-a69786b6d8b3 tempest-VolumesGetTestJSON-746098360 tempest-VolumesGetTestJSON-746098360-project] Calling method '.version_select at 0x7fbb45980700>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:31.251008 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-80640488-7cd0-44db-9f09-a69786b6d8b3 tempest-VolumesGetTestJSON-746098360 tempest-VolumesGetTestJSON-746098360-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/7608e573-9e27-44a5-bd4a-187a9ed17e76" status: 200 len: 353 microversion: 2.1 time: 0.109957 Aug 31 16:15:31.257997 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2558/4924] 10.222.0.50 () {58 vars in 1245 bytes} [Wed Aug 31 16:15:31 2022] GET /compute/v2.1/os-volumes/7608e573-9e27-44a5-bd4a-187a9ed17e76 => generated 353 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:31.263401 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6a369371-729c-4834-8272-c13646b7cf99 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '.version_select at 0x7fbb45e9d820>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:31.373699 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ad545fd0-c83a-4df5-8423-b333f025f56f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:15:31.374983 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ad545fd0-c83a-4df5-8423-b333f025f56f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:15:31.376022 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ad545fd0-c83a-4df5-8423-b333f025f56f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:15:31.376673 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ad545fd0-c83a-4df5-8423-b333f025f56f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:15:31.377715 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ad545fd0-c83a-4df5-8423-b333f025f56f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:15:31.396040 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ad545fd0-c83a-4df5-8423-b333f025f56f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:31.397369 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ad545fd0-c83a-4df5-8423-b333f025f56f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:31.397826 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ad545fd0-c83a-4df5-8423-b333f025f56f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:31.398624 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ad545fd0-c83a-4df5-8423-b333f025f56f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:31.399481 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ad545fd0-c83a-4df5-8423-b333f025f56f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:31.399909 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ad545fd0-c83a-4df5-8423-b333f025f56f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:31.436506 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-ad545fd0-c83a-4df5-8423-b333f025f56f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Getting quotas for project 3e843f3122c14cf8889f26423552792f. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:15:31.445252 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-ad545fd0-c83a-4df5-8423-b333f025f56f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Getting quotas for user 8b67be53aade4f8c92d6765dd91a4b90 and project 3e843f3122c14cf8889f26423552792f. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:15:31.461041 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ad545fd0-c83a-4df5-8423-b333f025f56f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:15:31.467131 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ad545fd0-c83a-4df5-8423-b333f025f56f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: bdab1c5f-e128-4ef6-b93d-7ac15002ddbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:15:31.547752 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ad545fd0-c83a-4df5-8423-b333f025f56f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.914651 Aug 31 16:15:31.548834 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2367/4925] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:15:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 917 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:15:31.560906 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6bd4edc3-abda-4e30-83db-98d5dde154de tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:31.561409 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6a369371-729c-4834-8272-c13646b7cf99 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups" status: 200 len: 1833 microversion: 2.1 time: 0.301817 Aug 31 16:15:31.562006 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2559/4926] 10.222.0.50 () {58 vars in 1158 bytes} [Wed Aug 31 16:15:31 2022] GET /compute/v2.1/os-security-groups => generated 1833 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:31.562230 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6bd4edc3-abda-4e30-83db-98d5dde154de tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: bdab1c5f-e128-4ef6-b93d-7ac15002ddbf] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:31.574086 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:15:31.577556 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c2aa7ba6-384b-43e3-ad5e-f963671cc7eb tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '.version_select at 0x7fbb45e9da60>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:31.699717 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6bd4edc3-abda-4e30-83db-98d5dde154de tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:31.738762 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6bd4edc3-abda-4e30-83db-98d5dde154de tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/bdab1c5f-e128-4ef6-b93d-7ac15002ddbf" status: 200 len: 1217 microversion: 2.1 time: 0.180712 Aug 31 16:15:31.742664 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2368/4927] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:31 2022] GET /compute/v2.1/servers/bdab1c5f-e128-4ef6-b93d-7ac15002ddbf => generated 1217 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:15:31.945282 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c2aa7ba6-384b-43e3-ad5e-f963671cc7eb tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/c345c0cd-6eba-42f1-b0a2-386de6373405" status: 202 len: 0 microversion: 2.1 time: 0.372081 Aug 31 16:15:31.946030 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2560/4928] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 31 16:15:31 2022] DELETE /compute/v2.1/os-security-groups/c345c0cd-6eba-42f1-b0a2-386de6373405 => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 16:15:31.960491 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5b4753dd-60ef-442c-aec6-b4d30c6a8d25 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '.version_select at 0x7fbb45d29ca0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:31.991497 n-d-833090-16 devstack@n-api.service[128863]: DEBUG neutronclient.v2_0.client [None req-5b4753dd-60ef-442c-aec6-b4d30c6a8d25 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c345c0cd-6eba-42f1-b0a2-386de6373405 does not exist", "detail": ""}} {{(pid=128863) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 31 16:15:31.992410 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.security_group_api [None req-5b4753dd-60ef-442c-aec6-b4d30c6a8d25 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Neutron security group c345c0cd-6eba-42f1-b0a2-386de6373405 not found {{(pid=128863) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 31 16:15:31.993289 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-5b4753dd-60ef-442c-aec6-b4d30c6a8d25 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] HTTP exception thrown: Security group c345c0cd-6eba-42f1-b0a2-386de6373405 does not exist Aug 31 16:15:31.993289 n-d-833090-16 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-344466f9-94d5-4774-baaf-d3196f0e80fc'] Aug 31 16:15:31.996764 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5b4753dd-60ef-442c-aec6-b4d30c6a8d25 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Request method failure captured: Aug 31 16:15:31.996764 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/os-security-groups/c345c0cd-6eba-42f1-b0a2-386de6373405 HTTP/1.1 Aug 31 16:15:31.996764 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:15:31.996764 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:15:31.996764 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:15:31.996764 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:15:31.996764 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:15:31.996764 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:15:31.996764 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:15:31.996764 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:15:31.996764 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4kIFJ0zG0xeBGgG3uzrjLL9EnflnKZMdGdJ2D9YGgjKqtNDIyBPydopwRei8ZnPbXcFm3HhN-k5tWZi56omwftJZfOWCKw_Hb9N0DyCWLOGgTx7eghMjbdmJfyquGOCz4DRfEHH-TxPGulLn-DplfVM4FoftEuHQL9TOxgHDYENNcI Aug 31 16:15:31.996764 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:15:31.996764 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:15:31.996764 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:15:31.996764 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:15:31.996764 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:15:31.996764 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:15:31.996764 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 7baff3cad5c14325a5576c40fcda0580 Aug 31 16:15:31.996764 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-SecurityGroupsTestJSON-608242232 Aug 31 16:15:31.996764 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:15:31.996764 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:15:31.996764 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7baff3cad5c14325a5576c40fcda0580"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7baff3cad5c14325a5576c40fcda0580"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7baff3cad5c14325a5576c40fcda0580"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7baff3cad5c14325a5576c40fcda0580", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:15:31.996764 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-SecurityGroupsTestJSON-608242232 Aug 31 16:15:31.996764 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 7baff3cad5c14325a5576c40fcda0580 Aug 31 16:15:31.996764 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-608242232 Aug 31 16:15:31.996764 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-SecurityGroupsTestJSON-608242232-project Aug 31 16:15:31.996764 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:15:31.996764 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:15:31.996764 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: dabb1c841cde40769174e2f8a97234c0 Aug 31 16:15:31.996764 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-SecurityGroupsTestJSON-608242232-project Aug 31 16:15:31.996764 n-d-833090-16 devstack@n-api.service[128863]: method: Aug 31 16:15:31.996764 n-d-833090-16 devstack@n-api.service[128863]: exception: Security group c345c0cd-6eba-42f1-b0a2-386de6373405 does not exist Aug 31 16:15:31.996764 n-d-833090-16 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-344466f9-94d5-4774-baaf-d3196f0e80fc'] Aug 31 16:15:31.996764 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'c345c0cd-6eba-42f1-b0a2-386de6373405'} Aug 31 16:15:31.996764 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:15:31.996764 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:31.996764 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 31 16:15:31.996764 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 31 16:15:31.996764 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:15:31.996764 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:15:31.996764 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 31 16:15:31.996764 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 31 16:15:31.996764 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:15:31.996764 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:15:31.996764 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 31 16:15:31.996764 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 31 16:15:31.996764 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:15:31.996764 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:15:31.996764 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 31 16:15:31.996764 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 31 16:15:31.996764 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:15:31.996764 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:15:31.996764 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 31 16:15:31.996764 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 31 16:15:31.996764 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:15:31.996764 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:15:31.996764 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 31 16:15:31.996764 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 31 16:15:31.996764 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 31 16:15:31.996764 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 31 16:15:31.996764 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c345c0cd-6eba-42f1-b0a2-386de6373405 does not exist Aug 31 16:15:32.004905 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-344466f9-94d5-4774-baaf-d3196f0e80fc'] Aug 31 16:15:32.004905 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:15:32.004905 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:32.004905 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:15:32.004905 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:32.004905 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 31 16:15:32.004905 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 31 16:15:32.004905 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 31 16:15:32.004905 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 31 16:15:32.004905 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c345c0cd-6eba-42f1-b0a2-386de6373405 does not exist Aug 31 16:15:32.004905 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-344466f9-94d5-4774-baaf-d3196f0e80fc'] Aug 31 16:15:32.004905 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:15:32.004905 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:32.004905 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:15:32.004905 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:32.004905 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:32.004905 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:32.004905 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:15:32.004905 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:15:32.004905 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:15:32.004905 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:15:32.004905 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:15:32.004905 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:15:32.004905 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 31 16:15:32.004905 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 31 16:15:32.004905 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c345c0cd-6eba-42f1-b0a2-386de6373405 does not exist Aug 31 16:15:32.004905 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-344466f9-94d5-4774-baaf-d3196f0e80fc'] Aug 31 16:15:32.004905 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:15:32.004905 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:32.004905 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:15:32.004905 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:32.004905 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:32.004905 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:32.004905 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:15:32.004905 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:15:32.004905 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c345c0cd-6eba-42f1-b0a2-386de6373405 does not exist Aug 31 16:15:32.004905 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-344466f9-94d5-4774-baaf-d3196f0e80fc'] Aug 31 16:15:32.004905 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:15:32.004905 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5b4753dd-60ef-442c-aec6-b4d30c6a8d25 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Returning 404 to user: Security group c345c0cd-6eba-42f1-b0a2-386de6373405 does not exist Aug 31 16:15:32.004905 n-d-833090-16 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-344466f9-94d5-4774-baaf-d3196f0e80fc'] {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:15:32.004905 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5b4753dd-60ef-442c-aec6-b4d30c6a8d25 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups/c345c0cd-6eba-42f1-b0a2-386de6373405" status: 404 len: 194 microversion: 2.1 time: 0.046701 Aug 31 16:15:32.004905 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2369/4929] 10.222.0.50 () {58 vars in 1269 bytes} [Wed Aug 31 16:15:31 2022] GET /compute/v2.1/os-security-groups/c345c0cd-6eba-42f1-b0a2-386de6373405 => generated 194 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:15:32.014504 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e04b8b24-ff30-402d-bd24-eba1d6fcf10f tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '.version_select at 0x7fbb459803a0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:32.279471 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a338fc51-a640-4afd-857d-22dd4cc44066 tempest-VolumesGetTestJSON-746098360 tempest-VolumesGetTestJSON-746098360-project] Calling method '.version_select at 0x7fbb4aa9caf0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:32.292736 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e04b8b24-ff30-402d-bd24-eba1d6fcf10f tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/d7f0085b-389e-41d3-a37c-a94fbfabfd45" status: 202 len: 0 microversion: 2.1 time: 0.288790 Aug 31 16:15:32.293331 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2561/4930] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 31 16:15:32 2022] DELETE /compute/v2.1/os-security-groups/d7f0085b-389e-41d3-a37c-a94fbfabfd45 => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:15:32.303222 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-acf089f3-efcf-4903-9167-07bff52c6cf9 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '.version_select at 0x7fbb459800d0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:32.340345 n-d-833090-16 devstack@n-api.service[128864]: DEBUG neutronclient.v2_0.client [None req-acf089f3-efcf-4903-9167-07bff52c6cf9 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d7f0085b-389e-41d3-a37c-a94fbfabfd45 does not exist", "detail": ""}} {{(pid=128864) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 31 16:15:32.341311 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.security_group_api [None req-acf089f3-efcf-4903-9167-07bff52c6cf9 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Neutron security group d7f0085b-389e-41d3-a37c-a94fbfabfd45 not found {{(pid=128864) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 31 16:15:32.342131 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-acf089f3-efcf-4903-9167-07bff52c6cf9 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] HTTP exception thrown: Security group d7f0085b-389e-41d3-a37c-a94fbfabfd45 does not exist Aug 31 16:15:32.342131 n-d-833090-16 devstack@n-api.service[128864]: Neutron server returns request_ids: ['req-e4866104-2520-4735-800a-671ecbe37f6b'] Aug 31 16:15:32.345461 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-acf089f3-efcf-4903-9167-07bff52c6cf9 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Request method failure captured: Aug 31 16:15:32.345461 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/os-security-groups/d7f0085b-389e-41d3-a37c-a94fbfabfd45 HTTP/1.1 Aug 31 16:15:32.345461 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:15:32.345461 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:15:32.345461 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:15:32.345461 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:15:32.345461 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:15:32.345461 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:15:32.345461 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:15:32.345461 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:15:32.345461 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4kIFJ0zG0xeBGgG3uzrjLL9EnflnKZMdGdJ2D9YGgjKqtNDIyBPydopwRei8ZnPbXcFm3HhN-k5tWZi56omwftJZfOWCKw_Hb9N0DyCWLOGgTx7eghMjbdmJfyquGOCz4DRfEHH-TxPGulLn-DplfVM4FoftEuHQL9TOxgHDYENNcI Aug 31 16:15:32.345461 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:15:32.345461 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:15:32.345461 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:15:32.345461 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:15:32.345461 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:15:32.345461 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:15:32.345461 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 7baff3cad5c14325a5576c40fcda0580 Aug 31 16:15:32.345461 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-SecurityGroupsTestJSON-608242232 Aug 31 16:15:32.345461 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:15:32.345461 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:15:32.345461 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7baff3cad5c14325a5576c40fcda0580"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7baff3cad5c14325a5576c40fcda0580"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7baff3cad5c14325a5576c40fcda0580"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7baff3cad5c14325a5576c40fcda0580", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:15:32.345461 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-SecurityGroupsTestJSON-608242232 Aug 31 16:15:32.345461 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 7baff3cad5c14325a5576c40fcda0580 Aug 31 16:15:32.345461 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-608242232 Aug 31 16:15:32.345461 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-SecurityGroupsTestJSON-608242232-project Aug 31 16:15:32.345461 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:15:32.345461 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:15:32.345461 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: dabb1c841cde40769174e2f8a97234c0 Aug 31 16:15:32.345461 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-SecurityGroupsTestJSON-608242232-project Aug 31 16:15:32.345461 n-d-833090-16 devstack@n-api.service[128864]: method: Aug 31 16:15:32.345461 n-d-833090-16 devstack@n-api.service[128864]: exception: Security group d7f0085b-389e-41d3-a37c-a94fbfabfd45 does not exist Aug 31 16:15:32.345461 n-d-833090-16 devstack@n-api.service[128864]: Neutron server returns request_ids: ['req-e4866104-2520-4735-800a-671ecbe37f6b'] Aug 31 16:15:32.345461 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'd7f0085b-389e-41d3-a37c-a94fbfabfd45'} Aug 31 16:15:32.345461 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:15:32.345461 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:32.345461 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 31 16:15:32.345461 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 31 16:15:32.345461 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:15:32.345461 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:15:32.345461 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 31 16:15:32.345461 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 31 16:15:32.345461 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:15:32.345461 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:15:32.345461 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 31 16:15:32.345461 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 31 16:15:32.345461 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:15:32.345461 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:15:32.345461 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 31 16:15:32.345461 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 31 16:15:32.345461 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:15:32.345461 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:15:32.345461 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 31 16:15:32.345461 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 31 16:15:32.345461 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:15:32.345461 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:15:32.345461 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 31 16:15:32.345461 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 31 16:15:32.345461 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 31 16:15:32.345461 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 31 16:15:32.345461 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d7f0085b-389e-41d3-a37c-a94fbfabfd45 does not exist Aug 31 16:15:32.355795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e4866104-2520-4735-800a-671ecbe37f6b'] Aug 31 16:15:32.355795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:15:32.355795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:32.355795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:15:32.355795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:32.355795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 31 16:15:32.355795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 31 16:15:32.355795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 31 16:15:32.355795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 31 16:15:32.355795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d7f0085b-389e-41d3-a37c-a94fbfabfd45 does not exist Aug 31 16:15:32.355795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e4866104-2520-4735-800a-671ecbe37f6b'] Aug 31 16:15:32.355795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:15:32.355795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:32.355795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:15:32.355795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:32.355795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:32.355795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:32.355795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:15:32.355795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:15:32.355795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:15:32.355795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:15:32.355795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:15:32.355795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:15:32.355795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 31 16:15:32.355795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 31 16:15:32.355795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d7f0085b-389e-41d3-a37c-a94fbfabfd45 does not exist Aug 31 16:15:32.355795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e4866104-2520-4735-800a-671ecbe37f6b'] Aug 31 16:15:32.355795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:15:32.355795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:32.355795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:15:32.355795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:32.355795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:32.355795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:32.355795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:15:32.355795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:15:32.355795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d7f0085b-389e-41d3-a37c-a94fbfabfd45 does not exist Aug 31 16:15:32.355795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e4866104-2520-4735-800a-671ecbe37f6b'] Aug 31 16:15:32.355795 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:15:32.355795 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-acf089f3-efcf-4903-9167-07bff52c6cf9 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Returning 404 to user: Security group d7f0085b-389e-41d3-a37c-a94fbfabfd45 does not exist Aug 31 16:15:32.355795 n-d-833090-16 devstack@n-api.service[128864]: Neutron server returns request_ids: ['req-e4866104-2520-4735-800a-671ecbe37f6b'] {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:15:32.355795 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-acf089f3-efcf-4903-9167-07bff52c6cf9 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups/d7f0085b-389e-41d3-a37c-a94fbfabfd45" status: 404 len: 194 microversion: 2.1 time: 0.049587 Aug 31 16:15:32.355795 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2562/4931] 10.222.0.50 () {58 vars in 1269 bytes} [Wed Aug 31 16:15:32 2022] GET /compute/v2.1/os-security-groups/d7f0085b-389e-41d3-a37c-a94fbfabfd45 => generated 194 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:15:32.364730 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2bae540d-093e-4452-8146-538ef1fdee0e tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '.version_select at 0x7fbb459920d0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:32.433516 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a338fc51-a640-4afd-857d-22dd4cc44066 tempest-VolumesGetTestJSON-746098360 tempest-VolumesGetTestJSON-746098360-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/7608e573-9e27-44a5-bd4a-187a9ed17e76" status: 200 len: 354 microversion: 2.1 time: 0.168727 Aug 31 16:15:32.447046 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2370/4932] 10.222.0.50 () {58 vars in 1245 bytes} [Wed Aug 31 16:15:32 2022] GET /compute/v2.1/os-volumes/7608e573-9e27-44a5-bd4a-187a9ed17e76 => generated 354 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:32.455739 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bbddc467-a047-4167-b779-64ad323a8782 tempest-VolumesGetTestJSON-746098360 tempest-VolumesGetTestJSON-746098360-project] Calling method '.version_select at 0x7fbb45db8670>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:32.517681 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bbddc467-a047-4167-b779-64ad323a8782 tempest-VolumesGetTestJSON-746098360 tempest-VolumesGetTestJSON-746098360-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/7608e573-9e27-44a5-bd4a-187a9ed17e76" status: 200 len: 354 microversion: 2.1 time: 0.068994 Aug 31 16:15:32.519223 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2371/4933] 10.222.0.50 () {58 vars in 1245 bytes} [Wed Aug 31 16:15:32 2022] GET /compute/v2.1/os-volumes/7608e573-9e27-44a5-bd4a-187a9ed17e76 => generated 354 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:32.543059 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-209f34f5-1610-4c93-af98-b1df9dd04be9 tempest-VolumesGetTestJSON-746098360 tempest-VolumesGetTestJSON-746098360-project] Calling method '.version_select at 0x7fbb464f63a0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:32.651402 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2bae540d-093e-4452-8146-538ef1fdee0e tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/a5400ce6-3b58-4463-a59c-d754fb87d6e3" status: 202 len: 0 microversion: 2.1 time: 0.297557 Aug 31 16:15:32.652020 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2563/4934] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 31 16:15:32 2022] DELETE /compute/v2.1/os-security-groups/a5400ce6-3b58-4463-a59c-d754fb87d6e3 => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:15:32.656983 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-209f34f5-1610-4c93-af98-b1df9dd04be9 tempest-VolumesGetTestJSON-746098360 tempest-VolumesGetTestJSON-746098360-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/7608e573-9e27-44a5-bd4a-187a9ed17e76" status: 202 len: 0 microversion: 2.1 time: 0.122257 Aug 31 16:15:32.657931 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2372/4935] 10.222.0.50 () {58 vars in 1248 bytes} [Wed Aug 31 16:15:32 2022] DELETE /compute/v2.1/os-volumes/7608e573-9e27-44a5-bd4a-187a9ed17e76 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:15:32.662539 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-524de80a-bba1-4426-87a9-568453add7cb tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '.version_select at 0x7fbb45980c10>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:32.677010 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b3cca9c6-3158-4e67-9f60-44b244f2c2f7 tempest-VolumesGetTestJSON-746098360 tempest-VolumesGetTestJSON-746098360-project] Calling method '.version_select at 0x7fbb45cc34c0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:32.710814 n-d-833090-16 devstack@n-api.service[128864]: DEBUG neutronclient.v2_0.client [None req-524de80a-bba1-4426-87a9-568453add7cb tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a5400ce6-3b58-4463-a59c-d754fb87d6e3 does not exist", "detail": ""}} {{(pid=128864) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 31 16:15:32.711503 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.security_group_api [None req-524de80a-bba1-4426-87a9-568453add7cb tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Neutron security group a5400ce6-3b58-4463-a59c-d754fb87d6e3 not found {{(pid=128864) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 31 16:15:32.712342 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-524de80a-bba1-4426-87a9-568453add7cb tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] HTTP exception thrown: Security group a5400ce6-3b58-4463-a59c-d754fb87d6e3 does not exist Aug 31 16:15:32.712342 n-d-833090-16 devstack@n-api.service[128864]: Neutron server returns request_ids: ['req-f3f6c1a6-1e19-4c34-b72e-03213a444e9e'] Aug 31 16:15:32.715260 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-524de80a-bba1-4426-87a9-568453add7cb tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Request method failure captured: Aug 31 16:15:32.715260 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/os-security-groups/a5400ce6-3b58-4463-a59c-d754fb87d6e3 HTTP/1.1 Aug 31 16:15:32.715260 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:15:32.715260 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:15:32.715260 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:15:32.715260 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:15:32.715260 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:15:32.715260 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:15:32.715260 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:15:32.715260 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:15:32.715260 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4kIFJ0zG0xeBGgG3uzrjLL9EnflnKZMdGdJ2D9YGgjKqtNDIyBPydopwRei8ZnPbXcFm3HhN-k5tWZi56omwftJZfOWCKw_Hb9N0DyCWLOGgTx7eghMjbdmJfyquGOCz4DRfEHH-TxPGulLn-DplfVM4FoftEuHQL9TOxgHDYENNcI Aug 31 16:15:32.715260 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:15:32.715260 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:15:32.715260 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:15:32.715260 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:15:32.715260 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:15:32.715260 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:15:32.715260 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 7baff3cad5c14325a5576c40fcda0580 Aug 31 16:15:32.715260 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-SecurityGroupsTestJSON-608242232 Aug 31 16:15:32.715260 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:15:32.715260 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:15:32.715260 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7baff3cad5c14325a5576c40fcda0580"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7baff3cad5c14325a5576c40fcda0580"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7baff3cad5c14325a5576c40fcda0580"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7baff3cad5c14325a5576c40fcda0580", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:15:32.715260 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-SecurityGroupsTestJSON-608242232 Aug 31 16:15:32.715260 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 7baff3cad5c14325a5576c40fcda0580 Aug 31 16:15:32.715260 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-608242232 Aug 31 16:15:32.715260 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-SecurityGroupsTestJSON-608242232-project Aug 31 16:15:32.715260 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:15:32.715260 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:15:32.715260 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: dabb1c841cde40769174e2f8a97234c0 Aug 31 16:15:32.715260 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-SecurityGroupsTestJSON-608242232-project Aug 31 16:15:32.715260 n-d-833090-16 devstack@n-api.service[128864]: method: Aug 31 16:15:32.715260 n-d-833090-16 devstack@n-api.service[128864]: exception: Security group a5400ce6-3b58-4463-a59c-d754fb87d6e3 does not exist Aug 31 16:15:32.715260 n-d-833090-16 devstack@n-api.service[128864]: Neutron server returns request_ids: ['req-f3f6c1a6-1e19-4c34-b72e-03213a444e9e'] Aug 31 16:15:32.715260 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'a5400ce6-3b58-4463-a59c-d754fb87d6e3'} Aug 31 16:15:32.715260 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:15:32.715260 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:32.715260 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 31 16:15:32.715260 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 31 16:15:32.715260 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:15:32.715260 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:15:32.715260 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 31 16:15:32.715260 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 31 16:15:32.715260 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:15:32.715260 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:15:32.715260 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 31 16:15:32.715260 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 31 16:15:32.715260 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:15:32.715260 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:15:32.715260 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 31 16:15:32.715260 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 31 16:15:32.715260 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:15:32.715260 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:15:32.715260 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 31 16:15:32.715260 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 31 16:15:32.715260 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:15:32.715260 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:15:32.715260 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 31 16:15:32.715260 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 31 16:15:32.715260 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 31 16:15:32.715260 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 31 16:15:32.715260 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a5400ce6-3b58-4463-a59c-d754fb87d6e3 does not exist Aug 31 16:15:32.720928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f3f6c1a6-1e19-4c34-b72e-03213a444e9e'] Aug 31 16:15:32.720928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:15:32.720928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:32.720928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:15:32.720928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:32.720928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 31 16:15:32.720928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 31 16:15:32.720928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 31 16:15:32.720928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 31 16:15:32.720928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a5400ce6-3b58-4463-a59c-d754fb87d6e3 does not exist Aug 31 16:15:32.720928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f3f6c1a6-1e19-4c34-b72e-03213a444e9e'] Aug 31 16:15:32.720928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:15:32.720928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:32.720928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:15:32.720928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:32.720928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:32.720928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:32.720928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:15:32.720928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:15:32.720928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:15:32.720928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:15:32.720928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:15:32.720928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:15:32.720928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 31 16:15:32.720928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 31 16:15:32.720928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a5400ce6-3b58-4463-a59c-d754fb87d6e3 does not exist Aug 31 16:15:32.720928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f3f6c1a6-1e19-4c34-b72e-03213a444e9e'] Aug 31 16:15:32.720928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:15:32.720928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:32.720928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:15:32.720928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:32.720928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:32.720928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:32.720928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:15:32.720928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:15:32.720928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a5400ce6-3b58-4463-a59c-d754fb87d6e3 does not exist Aug 31 16:15:32.720928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f3f6c1a6-1e19-4c34-b72e-03213a444e9e'] Aug 31 16:15:32.720928 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:15:32.720928 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-524de80a-bba1-4426-87a9-568453add7cb tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Returning 404 to user: Security group a5400ce6-3b58-4463-a59c-d754fb87d6e3 does not exist Aug 31 16:15:32.720928 n-d-833090-16 devstack@n-api.service[128864]: Neutron server returns request_ids: ['req-f3f6c1a6-1e19-4c34-b72e-03213a444e9e'] {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:15:32.720928 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-524de80a-bba1-4426-87a9-568453add7cb tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups/a5400ce6-3b58-4463-a59c-d754fb87d6e3" status: 404 len: 194 microversion: 2.1 time: 0.062452 Aug 31 16:15:32.724529 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2564/4936] 10.222.0.50 () {58 vars in 1269 bytes} [Wed Aug 31 16:15:32 2022] GET /compute/v2.1/os-security-groups/a5400ce6-3b58-4463-a59c-d754fb87d6e3 => generated 194 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:15:32.730491 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ff7fa0f9-4783-490c-bfd4-9db1c21e85b8 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '.version_select at 0x7fbb45e12b80>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:32.779808 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b3cca9c6-3158-4e67-9f60-44b244f2c2f7 tempest-VolumesGetTestJSON-746098360 tempest-VolumesGetTestJSON-746098360-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/7608e573-9e27-44a5-bd4a-187a9ed17e76" status: 200 len: 353 microversion: 2.1 time: 0.115772 Aug 31 16:15:32.780310 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2373/4937] 10.222.0.50 () {58 vars in 1245 bytes} [Wed Aug 31 16:15:32 2022] GET /compute/v2.1/os-volumes/7608e573-9e27-44a5-bd4a-187a9ed17e76 => generated 353 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:32.785071 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1e756636-8748-4b67-89c5-79200644574a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:32.785887 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1e756636-8748-4b67-89c5-79200644574a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: bdab1c5f-e128-4ef6-b93d-7ac15002ddbf] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:32.812825 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e756636-8748-4b67-89c5-79200644574a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:32.812825 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e756636-8748-4b67-89c5-79200644574a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:32.812825 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e756636-8748-4b67-89c5-79200644574a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:32.812825 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e756636-8748-4b67-89c5-79200644574a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:32.812825 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e756636-8748-4b67-89c5-79200644574a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:32.812825 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e756636-8748-4b67-89c5-79200644574a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:32.930820 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1e756636-8748-4b67-89c5-79200644574a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:32.946750 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1e756636-8748-4b67-89c5-79200644574a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/bdab1c5f-e128-4ef6-b93d-7ac15002ddbf" status: 200 len: 1213 microversion: 2.1 time: 0.165166 Aug 31 16:15:32.947517 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2374/4938] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:32 2022] GET /compute/v2.1/servers/bdab1c5f-e128-4ef6-b93d-7ac15002ddbf => generated 1213 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:33.020180 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ff7fa0f9-4783-490c-bfd4-9db1c21e85b8 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.294326 Aug 31 16:15:33.031538 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2565/4939] 10.222.0.50 () {58 vars in 1158 bytes} [Wed Aug 31 16:15:32 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:33.037195 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e8d2d324-1323-4ba9-952f-713371cae022 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Action: 'create', calling method: .version_select at 0x7fbb4aa9c3a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-666501977", "description": "tempest-description-290633817"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:33.207435 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e8d2d324-1323-4ba9-952f-713371cae022 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.174468 Aug 31 16:15:33.208337 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2375/4940] 10.222.0.50 () {60 vars in 1180 bytes} [Wed Aug 31 16:15:33 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:33.221089 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6c43c9d7-0d3a-4c13-857c-c6fd5261ad5e tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Action: 'create', calling method: .version_select at 0x7fbb46000ca0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1785852647", "description": "tempest-description-1177330104"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:33.397120 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6c43c9d7-0d3a-4c13-857c-c6fd5261ad5e tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.180587 Aug 31 16:15:33.399196 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2566/4941] 10.222.0.50 () {60 vars in 1180 bytes} [Wed Aug 31 16:15:33 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:33.533748 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7bc4b6dc-e9b1-435c-8bdc-435c5e57ab2c tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1694676035", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "e2da32d5-19e8-46c2-8c7c-ebaefe1850c2"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:33.600248 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-7bc4b6dc-e9b1-435c-8bdc-435c5e57ab2c tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] validate_networks() for [('e2da32d5-19e8-46c2-8c7c-ebaefe1850c2', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:15:33.796549 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-bda65c4b-8465-4958-b23c-0c580d5c0b58 tempest-VolumesGetTestJSON-746098360 tempest-VolumesGetTestJSON-746098360-project] Calling method '.version_select at 0x7fbb45980ca0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:33.896008 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-bda65c4b-8465-4958-b23c-0c580d5c0b58 tempest-VolumesGetTestJSON-746098360 tempest-VolumesGetTestJSON-746098360-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/7608e573-9e27-44a5-bd4a-187a9ed17e76" status: 200 len: 353 microversion: 2.1 time: 0.105830 Aug 31 16:15:33.897398 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2567/4942] 10.222.0.50 () {58 vars in 1245 bytes} [Wed Aug 31 16:15:33 2022] GET /compute/v2.1/os-volumes/7608e573-9e27-44a5-bd4a-187a9ed17e76 => generated 353 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:15:33.968298 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a8923a4a-248f-45ff-8901-d2e7ebf1261d tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:33.969408 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a8923a4a-248f-45ff-8901-d2e7ebf1261d tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: bdab1c5f-e128-4ef6-b93d-7ac15002ddbf] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:33.977293 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a8923a4a-248f-45ff-8901-d2e7ebf1261d tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:33.978303 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a8923a4a-248f-45ff-8901-d2e7ebf1261d tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:33.978977 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a8923a4a-248f-45ff-8901-d2e7ebf1261d tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:33.980169 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a8923a4a-248f-45ff-8901-d2e7ebf1261d tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:33.980833 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a8923a4a-248f-45ff-8901-d2e7ebf1261d tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:33.981452 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a8923a4a-248f-45ff-8901-d2e7ebf1261d tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:34.328960 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:15:34.338991 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a8923a4a-248f-45ff-8901-d2e7ebf1261d tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:34.348640 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a8923a4a-248f-45ff-8901-d2e7ebf1261d tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/bdab1c5f-e128-4ef6-b93d-7ac15002ddbf" status: 200 len: 1275 microversion: 2.1 time: 0.383054 Aug 31 16:15:34.355784 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2568/4943] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:33 2022] GET /compute/v2.1/servers/bdab1c5f-e128-4ef6-b93d-7ac15002ddbf => generated 1275 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:34.917438 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-7bc4b6dc-e9b1-435c-8bdc-435c5e57ab2c tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:15:34.917880 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-7bc4b6dc-e9b1-435c-8bdc-435c5e57ab2c tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:15:34.918521 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-08f1f4e6-db4f-4a34-bf18-8c509d885988 tempest-VolumesGetTestJSON-746098360 tempest-VolumesGetTestJSON-746098360-project] Calling method '.version_select at 0x7fbb45980ca0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:34.919382 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-7bc4b6dc-e9b1-435c-8bdc-435c5e57ab2c tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:15:34.919801 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-7bc4b6dc-e9b1-435c-8bdc-435c5e57ab2c tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:15:34.920220 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-7bc4b6dc-e9b1-435c-8bdc-435c5e57ab2c tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:15:34.929864 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7bc4b6dc-e9b1-435c-8bdc-435c5e57ab2c tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:34.930385 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7bc4b6dc-e9b1-435c-8bdc-435c5e57ab2c tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:34.930822 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7bc4b6dc-e9b1-435c-8bdc-435c5e57ab2c tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:34.931545 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7bc4b6dc-e9b1-435c-8bdc-435c5e57ab2c tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:34.932056 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7bc4b6dc-e9b1-435c-8bdc-435c5e57ab2c tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:34.932468 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7bc4b6dc-e9b1-435c-8bdc-435c5e57ab2c tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:34.962904 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-7bc4b6dc-e9b1-435c-8bdc-435c5e57ab2c tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Getting quotas for project 7baff3cad5c14325a5576c40fcda0580. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:15:34.971169 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-7bc4b6dc-e9b1-435c-8bdc-435c5e57ab2c tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Getting quotas for user dabb1c841cde40769174e2f8a97234c0 and project 7baff3cad5c14325a5576c40fcda0580. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:15:34.989623 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-08f1f4e6-db4f-4a34-bf18-8c509d885988 tempest-VolumesGetTestJSON-746098360 tempest-VolumesGetTestJSON-746098360-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/7608e573-9e27-44a5-bd4a-187a9ed17e76" status: 200 len: 353 microversion: 2.1 time: 0.075109 Aug 31 16:15:34.990241 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2569/4944] 10.222.0.50 () {58 vars in 1245 bytes} [Wed Aug 31 16:15:34 2022] GET /compute/v2.1/os-volumes/7608e573-9e27-44a5-bd4a-187a9ed17e76 => generated 353 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:34.990799 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7bc4b6dc-e9b1-435c-8bdc-435c5e57ab2c tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:15:34.993952 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7bc4b6dc-e9b1-435c-8bdc-435c5e57ab2c tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] [instance: 384dc38e-62e2-44c7-a1da-28421a88b79d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:15:35.096272 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7bc4b6dc-e9b1-435c-8bdc-435c5e57ab2c tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.562536 Aug 31 16:15:35.102360 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2376/4945] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:15:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:15:35.116319 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1a51bfb7-3c96-4b44-9f8e-d93bbfc2d397 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:35.117591 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1a51bfb7-3c96-4b44-9f8e-d93bbfc2d397 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] [instance: 384dc38e-62e2-44c7-a1da-28421a88b79d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:35.260096 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1a51bfb7-3c96-4b44-9f8e-d93bbfc2d397 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dabb1c841cde40769174e2f8a97234c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baff3cad5c14325a5576c40fcda0580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:35.277337 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1a51bfb7-3c96-4b44-9f8e-d93bbfc2d397 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "GET /compute/v2.1/servers/384dc38e-62e2-44c7-a1da-28421a88b79d" status: 200 len: 1216 microversion: 2.1 time: 0.168736 Aug 31 16:15:35.278655 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2570/4946] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:35 2022] GET /compute/v2.1/servers/384dc38e-62e2-44c7-a1da-28421a88b79d => generated 1216 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:35.371296 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d40a9ad6-44ec-47dd-84ec-b9f7ef4015fb tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:35.372077 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d40a9ad6-44ec-47dd-84ec-b9f7ef4015fb tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: bdab1c5f-e128-4ef6-b93d-7ac15002ddbf] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:35.390456 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d40a9ad6-44ec-47dd-84ec-b9f7ef4015fb tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:35.400622 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d40a9ad6-44ec-47dd-84ec-b9f7ef4015fb tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:35.401384 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d40a9ad6-44ec-47dd-84ec-b9f7ef4015fb tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:35.402707 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d40a9ad6-44ec-47dd-84ec-b9f7ef4015fb tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:35.403571 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d40a9ad6-44ec-47dd-84ec-b9f7ef4015fb tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:35.404139 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d40a9ad6-44ec-47dd-84ec-b9f7ef4015fb tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:35.890252 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d40a9ad6-44ec-47dd-84ec-b9f7ef4015fb tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:35.914163 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d40a9ad6-44ec-47dd-84ec-b9f7ef4015fb tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/bdab1c5f-e128-4ef6-b93d-7ac15002ddbf" status: 200 len: 1317 microversion: 2.1 time: 0.548304 Aug 31 16:15:35.914787 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2377/4947] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:35 2022] GET /compute/v2.1/servers/bdab1c5f-e128-4ef6-b93d-7ac15002ddbf => generated 1317 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:15:36.007818 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fa313912-12bc-4785-8c10-bb40a2494add tempest-VolumesGetTestJSON-746098360 tempest-VolumesGetTestJSON-746098360-project] Calling method '.version_select at 0x7fbb46000160>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:36.085915 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-fa313912-12bc-4785-8c10-bb40a2494add tempest-VolumesGetTestJSON-746098360 tempest-VolumesGetTestJSON-746098360-project] HTTP exception thrown: Volume 7608e573-9e27-44a5-bd4a-187a9ed17e76 could not be found. Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fa313912-12bc-4785-8c10-bb40a2494add tempest-VolumesGetTestJSON-746098360 tempest-VolumesGetTestJSON-746098360-project] Request method failure captured: Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/os-volumes/7608e573-9e27-44a5-bd4a-187a9ed17e76 HTTP/1.1 Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4kh8gdEPKCK3S5dMxY0k9zUGk6bBGr-BOLz33EWgLzwWdV1X795DlWijVBffLVWcuVeLsD0gzRmmAbD7KaQTQa6wz-karqn2CAvF1_Ys-IP_zIYl-GVnt786ElFBQ2FhkfdT8ho31eYkPBxiFG-G2UnyAvdZGZG498-_0gTuE3N070 Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: fc66d9834b6440829404209b917f2906 Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-VolumesGetTestJSON-746098360 Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fc66d9834b6440829404209b917f2906"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fc66d9834b6440829404209b917f2906"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/fc66d9834b6440829404209b917f2906"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_fc66d9834b6440829404209b917f2906", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-VolumesGetTestJSON-746098360 Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: fc66d9834b6440829404209b917f2906 Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-VolumesGetTestJSON-746098360 Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-VolumesGetTestJSON-746098360-project Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 051bd64de19a486c941f1acda4e9a74b Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-VolumesGetTestJSON-746098360-project Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: method: Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: exception: Volume 7608e573-9e27-44a5-bd4a-187a9ed17e76 could not be found. Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '7608e573-9e27-44a5-bd4a-187a9ed17e76'} Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7608e573-9e27-44a5-bd4a-187a9ed17e76 could not be found. (HTTP 404) (Request-ID: req-119a1de5-002d-4413-9c09-a952d9fe9ace) Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 16:15:36.088327 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 16:15:36.096547 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 16:15:36.096547 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 16:15:36.096547 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 16:15:36.096547 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 16:15:36.096547 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 16:15:36.096547 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 16:15:36.096547 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 16:15:36.096547 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 16:15:36.096547 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 16:15:36.096547 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 16:15:36.096547 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 16:15:36.096547 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 16:15:36.096547 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 16:15:36.096547 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7608e573-9e27-44a5-bd4a-187a9ed17e76 could not be found. Aug 31 16:15:36.096547 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:15:36.096547 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:36.096547 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:15:36.096547 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:36.096547 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:36.096547 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:36.096547 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:15:36.096547 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:15:36.096547 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:15:36.096547 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:15:36.096547 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:15:36.096547 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:15:36.096547 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 16:15:36.096547 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:15:36.096547 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7608e573-9e27-44a5-bd4a-187a9ed17e76 could not be found. Aug 31 16:15:36.096547 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:15:36.096547 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:36.096547 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:15:36.096547 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:36.096547 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:36.096547 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:36.096547 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:15:36.096547 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:15:36.096547 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7608e573-9e27-44a5-bd4a-187a9ed17e76 could not be found. Aug 31 16:15:36.096547 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:15:36.096547 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fa313912-12bc-4785-8c10-bb40a2494add tempest-VolumesGetTestJSON-746098360 tempest-VolumesGetTestJSON-746098360-project] Returning 404 to user: Volume 7608e573-9e27-44a5-bd4a-187a9ed17e76 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:15:36.096547 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fa313912-12bc-4785-8c10-bb40a2494add tempest-VolumesGetTestJSON-746098360 tempest-VolumesGetTestJSON-746098360-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/7608e573-9e27-44a5-bd4a-187a9ed17e76" status: 404 len: 109 microversion: 2.1 time: 0.087731 Aug 31 16:15:36.096547 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2571/4948] 10.222.0.50 () {58 vars in 1245 bytes} [Wed Aug 31 16:15:36 2022] GET /compute/v2.1/os-volumes/7608e573-9e27-44a5-bd4a-187a9ed17e76 => generated 109 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:15:36.306629 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6820631b-1f12-4352-8465-72f21f5a3e09 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:36.308513 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6820631b-1f12-4352-8465-72f21f5a3e09 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] [instance: 384dc38e-62e2-44c7-a1da-28421a88b79d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:36.321480 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6820631b-1f12-4352-8465-72f21f5a3e09 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:36.322524 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6820631b-1f12-4352-8465-72f21f5a3e09 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:36.323250 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6820631b-1f12-4352-8465-72f21f5a3e09 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:36.324778 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6820631b-1f12-4352-8465-72f21f5a3e09 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:36.326683 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6820631b-1f12-4352-8465-72f21f5a3e09 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:36.327522 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6820631b-1f12-4352-8465-72f21f5a3e09 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:36.456131 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6820631b-1f12-4352-8465-72f21f5a3e09 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dabb1c841cde40769174e2f8a97234c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baff3cad5c14325a5576c40fcda0580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:36.476607 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6820631b-1f12-4352-8465-72f21f5a3e09 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "GET /compute/v2.1/servers/384dc38e-62e2-44c7-a1da-28421a88b79d" status: 200 len: 1212 microversion: 2.1 time: 0.178022 Aug 31 16:15:36.479696 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2378/4949] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:36 2022] GET /compute/v2.1/servers/384dc38e-62e2-44c7-a1da-28421a88b79d => generated 1212 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:36.925050 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-fd75e38c-e64c-4644-a50b-e5e7830ffd9d req-8397b677-a69d-412d-a2c1-73c32054274b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdab1c5f-e128-4ef6-b93d-7ac15002ddbf", "tag": "55444892-ede0-4826-8b6c-479e72928ae1"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:36.936332 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1198814c-ff1c-4b7c-a1cc-146d3c3a7286 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:36.937023 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1198814c-ff1c-4b7c-a1cc-146d3c3a7286 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: bdab1c5f-e128-4ef6-b93d-7ac15002ddbf] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:36.944669 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1198814c-ff1c-4b7c-a1cc-146d3c3a7286 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:36.945240 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1198814c-ff1c-4b7c-a1cc-146d3c3a7286 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:36.945595 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1198814c-ff1c-4b7c-a1cc-146d3c3a7286 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:36.946830 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-fd75e38c-e64c-4644-a50b-e5e7830ffd9d req-8397b677-a69d-412d-a2c1-73c32054274b service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:36.947232 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-fd75e38c-e64c-4644-a50b-e5e7830ffd9d req-8397b677-a69d-412d-a2c1-73c32054274b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:36.947853 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-fd75e38c-e64c-4644-a50b-e5e7830ffd9d req-8397b677-a69d-412d-a2c1-73c32054274b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:36.958603 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1198814c-ff1c-4b7c-a1cc-146d3c3a7286 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:36.959119 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1198814c-ff1c-4b7c-a1cc-146d3c3a7286 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:36.959573 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1198814c-ff1c-4b7c-a1cc-146d3c3a7286 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:36.966476 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-fd75e38c-e64c-4644-a50b-e5e7830ffd9d req-8397b677-a69d-412d-a2c1-73c32054274b service nova] Creating event network-changed:55444892-ede0-4826-8b6c-479e72928ae1 for instance bdab1c5f-e128-4ef6-b93d-7ac15002ddbf on n-h2-833090-16 Aug 31 16:15:36.990631 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-fd75e38c-e64c-4644-a50b-e5e7830ffd9d req-8397b677-a69d-412d-a2c1-73c32054274b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073119 Aug 31 16:15:36.991547 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2572/4950] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:37.447580 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1198814c-ff1c-4b7c-a1cc-146d3c3a7286 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:37.462040 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1198814c-ff1c-4b7c-a1cc-146d3c3a7286 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/bdab1c5f-e128-4ef6-b93d-7ac15002ddbf" status: 200 len: 1317 microversion: 2.1 time: 0.529582 Aug 31 16:15:37.463115 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2379/4951] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:36 2022] GET /compute/v2.1/servers/bdab1c5f-e128-4ef6-b93d-7ac15002ddbf => generated 1317 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:15:37.502489 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b0495c62-c069-4ec9-9287-16c4cdc0a3cf tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:37.504986 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b0495c62-c069-4ec9-9287-16c4cdc0a3cf tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] [instance: 384dc38e-62e2-44c7-a1da-28421a88b79d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:37.521812 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b0495c62-c069-4ec9-9287-16c4cdc0a3cf tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:37.532559 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b0495c62-c069-4ec9-9287-16c4cdc0a3cf tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:37.533828 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b0495c62-c069-4ec9-9287-16c4cdc0a3cf tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:37.537142 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b0495c62-c069-4ec9-9287-16c4cdc0a3cf tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:37.537778 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b0495c62-c069-4ec9-9287-16c4cdc0a3cf tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:37.538371 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b0495c62-c069-4ec9-9287-16c4cdc0a3cf tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:37.683410 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b0495c62-c069-4ec9-9287-16c4cdc0a3cf tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dabb1c841cde40769174e2f8a97234c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baff3cad5c14325a5576c40fcda0580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:37.694045 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b0495c62-c069-4ec9-9287-16c4cdc0a3cf tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "GET /compute/v2.1/servers/384dc38e-62e2-44c7-a1da-28421a88b79d" status: 200 len: 1274 microversion: 2.1 time: 0.196371 Aug 31 16:15:37.700060 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2573/4952] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:37 2022] GET /compute/v2.1/servers/384dc38e-62e2-44c7-a1da-28421a88b79d => generated 1274 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:38.493321 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d3268864-a00a-45fc-a8b0-9ce0b6b428b1 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:38.495057 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d3268864-a00a-45fc-a8b0-9ce0b6b428b1 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: bdab1c5f-e128-4ef6-b93d-7ac15002ddbf] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:38.506662 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d3268864-a00a-45fc-a8b0-9ce0b6b428b1 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:38.507492 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d3268864-a00a-45fc-a8b0-9ce0b6b428b1 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:38.508118 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d3268864-a00a-45fc-a8b0-9ce0b6b428b1 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:38.509187 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d3268864-a00a-45fc-a8b0-9ce0b6b428b1 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:38.509856 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d3268864-a00a-45fc-a8b0-9ce0b6b428b1 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:38.510485 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d3268864-a00a-45fc-a8b0-9ce0b6b428b1 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:38.723812 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-060c603a-8afc-4dd4-b5e9-c4ec5313f5a1 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:38.724816 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-060c603a-8afc-4dd4-b5e9-c4ec5313f5a1 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] [instance: 384dc38e-62e2-44c7-a1da-28421a88b79d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:38.748917 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-060c603a-8afc-4dd4-b5e9-c4ec5313f5a1 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:38.753029 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-060c603a-8afc-4dd4-b5e9-c4ec5313f5a1 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:38.754168 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-060c603a-8afc-4dd4-b5e9-c4ec5313f5a1 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:38.755227 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-060c603a-8afc-4dd4-b5e9-c4ec5313f5a1 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:38.759850 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-060c603a-8afc-4dd4-b5e9-c4ec5313f5a1 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:38.763046 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-060c603a-8afc-4dd4-b5e9-c4ec5313f5a1 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:38.935319 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d3268864-a00a-45fc-a8b0-9ce0b6b428b1 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:38.973854 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d3268864-a00a-45fc-a8b0-9ce0b6b428b1 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/bdab1c5f-e128-4ef6-b93d-7ac15002ddbf" status: 200 len: 1317 microversion: 2.1 time: 0.484061 Aug 31 16:15:38.986635 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2380/4953] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:38 2022] GET /compute/v2.1/servers/bdab1c5f-e128-4ef6-b93d-7ac15002ddbf => generated 1317 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:39.201554 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-060c603a-8afc-4dd4-b5e9-c4ec5313f5a1 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dabb1c841cde40769174e2f8a97234c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baff3cad5c14325a5576c40fcda0580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:39.229946 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-060c603a-8afc-4dd4-b5e9-c4ec5313f5a1 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "GET /compute/v2.1/servers/384dc38e-62e2-44c7-a1da-28421a88b79d" status: 200 len: 1316 microversion: 2.1 time: 0.512588 Aug 31 16:15:39.237334 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2574/4954] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:38 2022] GET /compute/v2.1/servers/384dc38e-62e2-44c7-a1da-28421a88b79d => generated 1316 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:39.908780 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-4809c65a-2604-4363-b4c7-73834bf352db req-ddfedbd9-d30f-4092-a6e2-d2a6ebdd81ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "384dc38e-62e2-44c7-a1da-28421a88b79d", "tag": "74b2149c-d46b-45ea-9160-52027217065d"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:39.949792 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4809c65a-2604-4363-b4c7-73834bf352db req-ddfedbd9-d30f-4092-a6e2-d2a6ebdd81ad service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:39.951138 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4809c65a-2604-4363-b4c7-73834bf352db req-ddfedbd9-d30f-4092-a6e2-d2a6ebdd81ad service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:39.953181 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4809c65a-2604-4363-b4c7-73834bf352db req-ddfedbd9-d30f-4092-a6e2-d2a6ebdd81ad service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:39.968286 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-4809c65a-2604-4363-b4c7-73834bf352db req-ddfedbd9-d30f-4092-a6e2-d2a6ebdd81ad service nova] Creating event network-changed:74b2149c-d46b-45ea-9160-52027217065d for instance 384dc38e-62e2-44c7-a1da-28421a88b79d on n-h1-833090-16 Aug 31 16:15:39.974395 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-4809c65a-2604-4363-b4c7-73834bf352db req-ddfedbd9-d30f-4092-a6e2-d2a6ebdd81ad service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068420 Aug 31 16:15:39.975741 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2381/4955] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:15:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:39.999382 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2a859077-6a84-40f1-be1b-7abdba2bdf8c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:40.000879 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2a859077-6a84-40f1-be1b-7abdba2bdf8c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: bdab1c5f-e128-4ef6-b93d-7ac15002ddbf] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:40.008690 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2a859077-6a84-40f1-be1b-7abdba2bdf8c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:40.009703 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2a859077-6a84-40f1-be1b-7abdba2bdf8c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:40.010265 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2a859077-6a84-40f1-be1b-7abdba2bdf8c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:40.011707 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2a859077-6a84-40f1-be1b-7abdba2bdf8c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:40.012376 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2a859077-6a84-40f1-be1b-7abdba2bdf8c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:40.012797 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2a859077-6a84-40f1-be1b-7abdba2bdf8c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:40.266385 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2a859077-6a84-40f1-be1b-7abdba2bdf8c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:40.271046 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=100 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:15:40.273179 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4b866e34-a4f7-4422-93a4-4774bb703488 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:40.273908 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4b866e34-a4f7-4422-93a4-4774bb703488 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] [instance: 384dc38e-62e2-44c7-a1da-28421a88b79d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:40.287543 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b866e34-a4f7-4422-93a4-4774bb703488 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:40.288038 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b866e34-a4f7-4422-93a4-4774bb703488 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:40.289242 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2a859077-6a84-40f1-be1b-7abdba2bdf8c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/bdab1c5f-e128-4ef6-b93d-7ac15002ddbf" status: 200 len: 1317 microversion: 2.1 time: 0.288062 Aug 31 16:15:40.303179 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2575/4956] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:39 2022] GET /compute/v2.1/servers/bdab1c5f-e128-4ef6-b93d-7ac15002ddbf => generated 1317 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:40.303418 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b866e34-a4f7-4422-93a4-4774bb703488 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:40.304613 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b866e34-a4f7-4422-93a4-4774bb703488 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:40.305092 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b866e34-a4f7-4422-93a4-4774bb703488 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:40.306431 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b866e34-a4f7-4422-93a4-4774bb703488 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:40.535502 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4b866e34-a4f7-4422-93a4-4774bb703488 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dabb1c841cde40769174e2f8a97234c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baff3cad5c14325a5576c40fcda0580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:40.549334 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4b866e34-a4f7-4422-93a4-4774bb703488 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "GET /compute/v2.1/servers/384dc38e-62e2-44c7-a1da-28421a88b79d" status: 200 len: 1316 microversion: 2.1 time: 0.288172 Aug 31 16:15:40.549924 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2382/4957] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:40 2022] GET /compute/v2.1/servers/384dc38e-62e2-44c7-a1da-28421a88b79d => generated 1316 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:41.310254 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3f959842-3bc0-47c3-940a-89964827fae7 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:41.310971 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3f959842-3bc0-47c3-940a-89964827fae7 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: bdab1c5f-e128-4ef6-b93d-7ac15002ddbf] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:41.318789 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3f959842-3bc0-47c3-940a-89964827fae7 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:41.319804 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3f959842-3bc0-47c3-940a-89964827fae7 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:41.320059 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3f959842-3bc0-47c3-940a-89964827fae7 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:41.320795 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3f959842-3bc0-47c3-940a-89964827fae7 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:41.321241 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3f959842-3bc0-47c3-940a-89964827fae7 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:41.321652 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3f959842-3bc0-47c3-940a-89964827fae7 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:41.450327 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-021b6efe-5c56-497f-bac1-7c8952118ef9 tempest-VolumesTestJSON-1628480955 tempest-VolumesTestJSON-1628480955-project] Calling method '.version_select at 0x7fbb45d38af0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:41.477866 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3f959842-3bc0-47c3-940a-89964827fae7 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:41.487878 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3f959842-3bc0-47c3-940a-89964827fae7 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/bdab1c5f-e128-4ef6-b93d-7ac15002ddbf" status: 200 len: 1317 microversion: 2.1 time: 0.181790 Aug 31 16:15:41.489159 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2576/4958] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:41 2022] GET /compute/v2.1/servers/bdab1c5f-e128-4ef6-b93d-7ac15002ddbf => generated 1317 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:41.513328 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-021b6efe-5c56-497f-bac1-7c8952118ef9 tempest-VolumesTestJSON-1628480955 tempest-VolumesTestJSON-1628480955-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/39f653d8-eb21-434a-be6e-4b81c664d206" status: 200 len: 351 microversion: 2.1 time: 0.066821 Aug 31 16:15:41.513872 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2383/4959] 10.222.0.50 () {58 vars in 1245 bytes} [Wed Aug 31 16:15:41 2022] GET /compute/v2.1/os-volumes/39f653d8-eb21-434a-be6e-4b81c664d206 => generated 351 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:41.571322 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1932e353-0a42-4f34-bba2-e5febe18071e tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:41.571936 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1932e353-0a42-4f34-bba2-e5febe18071e tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] [instance: 384dc38e-62e2-44c7-a1da-28421a88b79d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:41.578216 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1932e353-0a42-4f34-bba2-e5febe18071e tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:41.578705 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1932e353-0a42-4f34-bba2-e5febe18071e tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:41.579138 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1932e353-0a42-4f34-bba2-e5febe18071e tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:41.580001 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1932e353-0a42-4f34-bba2-e5febe18071e tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:41.580494 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1932e353-0a42-4f34-bba2-e5febe18071e tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:41.580996 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1932e353-0a42-4f34-bba2-e5febe18071e tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:41.726703 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-64a8c9e1-587d-4a8c-a0c6-b3eeea620f8e tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:41.729201 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-64a8c9e1-587d-4a8c-a0c6-b3eeea620f8e tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: e1cb02b7-1dd6-4c83-9008-e19525731e03] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:41.737167 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64a8c9e1-587d-4a8c-a0c6-b3eeea620f8e tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:41.737801 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64a8c9e1-587d-4a8c-a0c6-b3eeea620f8e tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:41.738619 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64a8c9e1-587d-4a8c-a0c6-b3eeea620f8e tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:41.739569 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64a8c9e1-587d-4a8c-a0c6-b3eeea620f8e tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:41.740198 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64a8c9e1-587d-4a8c-a0c6-b3eeea620f8e tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:41.740658 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64a8c9e1-587d-4a8c-a0c6-b3eeea620f8e tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:41.831276 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-64a8c9e1-587d-4a8c-a0c6-b3eeea620f8e tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "POST /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03/action" status: 200 len: 24573 microversion: 2.1 time: 0.110021 Aug 31 16:15:41.832343 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2384/4960] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:15:41 2022] POST /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03/action => generated 24573 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 16:15:42.018446 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1932e353-0a42-4f34-bba2-e5febe18071e tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dabb1c841cde40769174e2f8a97234c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baff3cad5c14325a5576c40fcda0580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:42.027386 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1932e353-0a42-4f34-bba2-e5febe18071e tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "GET /compute/v2.1/servers/384dc38e-62e2-44c7-a1da-28421a88b79d" status: 200 len: 1316 microversion: 2.1 time: 0.460620 Aug 31 16:15:42.027987 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2577/4961] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:41 2022] GET /compute/v2.1/servers/384dc38e-62e2-44c7-a1da-28421a88b79d => generated 1316 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:42.511866 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2d71d99b-5688-4541-a960-fdf796cd46f3 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:42.513176 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2d71d99b-5688-4541-a960-fdf796cd46f3 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: bdab1c5f-e128-4ef6-b93d-7ac15002ddbf] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:42.533257 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d71d99b-5688-4541-a960-fdf796cd46f3 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:42.534707 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d71d99b-5688-4541-a960-fdf796cd46f3 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:42.535542 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d71d99b-5688-4541-a960-fdf796cd46f3 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:42.536967 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d71d99b-5688-4541-a960-fdf796cd46f3 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:42.537668 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d71d99b-5688-4541-a960-fdf796cd46f3 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:42.538822 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d71d99b-5688-4541-a960-fdf796cd46f3 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:42.809004 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2d71d99b-5688-4541-a960-fdf796cd46f3 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:42.827859 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2d71d99b-5688-4541-a960-fdf796cd46f3 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/bdab1c5f-e128-4ef6-b93d-7ac15002ddbf" status: 200 len: 1317 microversion: 2.1 time: 0.320723 Aug 31 16:15:42.834418 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2385/4962] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:42 2022] GET /compute/v2.1/servers/bdab1c5f-e128-4ef6-b93d-7ac15002ddbf => generated 1317 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:15:43.001392 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1985edff-dca9-4eea-907c-bbd8c3dd530c tempest-VolumesTestJSON-1628480955 tempest-VolumesTestJSON-1628480955-project] Calling method '.version_select at 0x7fbb45998820>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:43.051013 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b7b7ffc2-a977-461e-b036-d25175b0d319 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:43.051703 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b7b7ffc2-a977-461e-b036-d25175b0d319 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] [instance: 384dc38e-62e2-44c7-a1da-28421a88b79d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:43.059190 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7b7ffc2-a977-461e-b036-d25175b0d319 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:43.060194 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7b7ffc2-a977-461e-b036-d25175b0d319 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:43.060626 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7b7ffc2-a977-461e-b036-d25175b0d319 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:43.061426 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7b7ffc2-a977-461e-b036-d25175b0d319 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:43.061879 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7b7ffc2-a977-461e-b036-d25175b0d319 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:43.062514 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7b7ffc2-a977-461e-b036-d25175b0d319 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:43.063004 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1985edff-dca9-4eea-907c-bbd8c3dd530c tempest-VolumesTestJSON-1628480955 tempest-VolumesTestJSON-1628480955-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/d342de91-7096-4bcc-915f-387498d4e4f1" status: 200 len: 351 microversion: 2.1 time: 0.067463 Aug 31 16:15:43.064122 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2578/4963] 10.222.0.50 () {58 vars in 1245 bytes} [Wed Aug 31 16:15:42 2022] GET /compute/v2.1/os-volumes/d342de91-7096-4bcc-915f-387498d4e4f1 => generated 351 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:15:43.236376 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b7b7ffc2-a977-461e-b036-d25175b0d319 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dabb1c841cde40769174e2f8a97234c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baff3cad5c14325a5576c40fcda0580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:43.248394 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b7b7ffc2-a977-461e-b036-d25175b0d319 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "GET /compute/v2.1/servers/384dc38e-62e2-44c7-a1da-28421a88b79d" status: 200 len: 1316 microversion: 2.1 time: 0.203237 Aug 31 16:15:43.249945 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2386/4964] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:43 2022] GET /compute/v2.1/servers/384dc38e-62e2-44c7-a1da-28421a88b79d => generated 1316 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:15:43.858986 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1ee4bf53-18f9-4f60-a102-f9befe779b94 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:43.860023 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1ee4bf53-18f9-4f60-a102-f9befe779b94 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: bdab1c5f-e128-4ef6-b93d-7ac15002ddbf] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:43.870046 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1ee4bf53-18f9-4f60-a102-f9befe779b94 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:43.870955 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1ee4bf53-18f9-4f60-a102-f9befe779b94 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:43.872288 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1ee4bf53-18f9-4f60-a102-f9befe779b94 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:43.873266 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1ee4bf53-18f9-4f60-a102-f9befe779b94 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:43.873888 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1ee4bf53-18f9-4f60-a102-f9befe779b94 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:43.874344 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1ee4bf53-18f9-4f60-a102-f9befe779b94 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:44.067770 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1ee4bf53-18f9-4f60-a102-f9befe779b94 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:44.083083 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1ee4bf53-18f9-4f60-a102-f9befe779b94 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/bdab1c5f-e128-4ef6-b93d-7ac15002ddbf" status: 200 len: 1317 microversion: 2.1 time: 0.230382 Aug 31 16:15:44.084253 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2579/4965] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:43 2022] GET /compute/v2.1/servers/bdab1c5f-e128-4ef6-b93d-7ac15002ddbf => generated 1317 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:44.292962 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b26d220a-8a4f-497e-971d-b9446766228d tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:44.293587 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b26d220a-8a4f-497e-971d-b9446766228d tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] [instance: 384dc38e-62e2-44c7-a1da-28421a88b79d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:44.315119 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b26d220a-8a4f-497e-971d-b9446766228d tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:44.320146 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b26d220a-8a4f-497e-971d-b9446766228d tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:44.320146 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b26d220a-8a4f-497e-971d-b9446766228d tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:44.320146 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b26d220a-8a4f-497e-971d-b9446766228d tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:44.320146 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b26d220a-8a4f-497e-971d-b9446766228d tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:44.320146 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b26d220a-8a4f-497e-971d-b9446766228d tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:44.514628 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b26d220a-8a4f-497e-971d-b9446766228d tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dabb1c841cde40769174e2f8a97234c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baff3cad5c14325a5576c40fcda0580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:44.535249 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-934eae80-670a-4a79-baf6-b2e222e239ee tempest-VolumesTestJSON-1628480955 tempest-VolumesTestJSON-1628480955-project] Calling method '.version_select at 0x7fbb45db5c10>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:44.542851 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b26d220a-8a4f-497e-971d-b9446766228d tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "GET /compute/v2.1/servers/384dc38e-62e2-44c7-a1da-28421a88b79d" status: 200 len: 1316 microversion: 2.1 time: 0.273862 Aug 31 16:15:44.544051 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2387/4966] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:44 2022] GET /compute/v2.1/servers/384dc38e-62e2-44c7-a1da-28421a88b79d => generated 1316 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:15:44.610816 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-934eae80-670a-4a79-baf6-b2e222e239ee tempest-VolumesTestJSON-1628480955 tempest-VolumesTestJSON-1628480955-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/e09e4e21-52ce-4401-a0dc-1f62c75a1325" status: 200 len: 349 microversion: 2.1 time: 0.085698 Aug 31 16:15:44.610816 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2580/4967] 10.222.0.50 () {58 vars in 1245 bytes} [Wed Aug 31 16:15:44 2022] GET /compute/v2.1/os-volumes/e09e4e21-52ce-4401-a0dc-1f62c75a1325 => generated 349 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:44.621564 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5b05b23e-1e33-4b45-bcf7-34b27d75521c tempest-VolumesTestJSON-1628480955 tempest-VolumesTestJSON-1628480955-project] Calling method '.version_select at 0x7fbb467ada60>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:44.652583 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-e89680ea-7865-4fbe-9f62-0dcc1e3ca18c req-6d29de80-0ea3-4233-a71c-d269832e30e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdab1c5f-e128-4ef6-b93d-7ac15002ddbf", "name": "network-vif-plugged", "status": "completed", "tag": "55444892-ede0-4826-8b6c-479e72928ae1"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:44.665895 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-e89680ea-7865-4fbe-9f62-0dcc1e3ca18c req-6d29de80-0ea3-4233-a71c-d269832e30e6 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:44.666412 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-e89680ea-7865-4fbe-9f62-0dcc1e3ca18c req-6d29de80-0ea3-4233-a71c-d269832e30e6 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:44.666861 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-e89680ea-7865-4fbe-9f62-0dcc1e3ca18c req-6d29de80-0ea3-4233-a71c-d269832e30e6 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:44.688258 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-e89680ea-7865-4fbe-9f62-0dcc1e3ca18c req-6d29de80-0ea3-4233-a71c-d269832e30e6 service nova] Creating event network-vif-plugged:55444892-ede0-4826-8b6c-479e72928ae1 for instance bdab1c5f-e128-4ef6-b93d-7ac15002ddbf on n-h2-833090-16 Aug 31 16:15:44.696007 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-e89680ea-7865-4fbe-9f62-0dcc1e3ca18c req-6d29de80-0ea3-4233-a71c-d269832e30e6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047413 Aug 31 16:15:44.696939 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2581/4968] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:15:44.724408 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5b05b23e-1e33-4b45-bcf7-34b27d75521c tempest-VolumesTestJSON-1628480955 tempest-VolumesTestJSON-1628480955-project] 10.222.0.50 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.107722 Aug 31 16:15:44.725096 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2388/4969] 10.222.0.50 () {58 vars in 1134 bytes} [Wed Aug 31 16:15:44 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:44.747265 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1dbc5fc6-db9b-405d-ae1f-f280a42aff29 tempest-VolumesTestJSON-1628480955 tempest-VolumesTestJSON-1628480955-project] Calling method '.version_select at 0x7fbb45998f70>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:44.858332 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1dbc5fc6-db9b-405d-ae1f-f280a42aff29 tempest-VolumesTestJSON-1628480955 tempest-VolumesTestJSON-1628480955-project] 10.222.0.50 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.121977 Aug 31 16:15:44.858913 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2582/4970] 10.222.0.50 () {58 vars in 1149 bytes} [Wed Aug 31 16:15:44 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:44.872999 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d548c15d-722c-4436-bc90-d3a37744a3be tempest-VolumesTestJSON-1628480955 tempest-VolumesTestJSON-1628480955-project] Calling method '.version_select at 0x7fbb45d5cca0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:44.951328 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:15:44.961397 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d548c15d-722c-4436-bc90-d3a37744a3be tempest-VolumesTestJSON-1628480955 tempest-VolumesTestJSON-1628480955-project] 10.222.0.50 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.092208 Aug 31 16:15:44.962010 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2389/4971] 10.222.0.50 () {58 vars in 1134 bytes} [Wed Aug 31 16:15:44 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:44.976555 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4a6fab12-fe05-490f-9f58-8b04fe74aee6 tempest-VolumesTestJSON-1628480955 tempest-VolumesTestJSON-1628480955-project] Calling method '.version_select at 0x7fbb459ea700>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:45.061434 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4a6fab12-fe05-490f-9f58-8b04fe74aee6 tempest-VolumesTestJSON-1628480955 tempest-VolumesTestJSON-1628480955-project] 10.222.0.50 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.089852 Aug 31 16:15:45.062054 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2583/4972] 10.222.0.50 () {58 vars in 1167 bytes} [Wed Aug 31 16:15:44 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:45.072348 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=20 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:15:45.076955 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b31363f0-a475-46b6-bc53-8c2108915cb8 tempest-VolumesTestJSON-1628480955 tempest-VolumesTestJSON-1628480955-project] Calling method '.version_select at 0x7fbb45997b80>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:45.111077 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e203813e-9df8-49f0-987f-4c9198645044 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:45.112151 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e203813e-9df8-49f0-987f-4c9198645044 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: bdab1c5f-e128-4ef6-b93d-7ac15002ddbf] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:45.121222 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e203813e-9df8-49f0-987f-4c9198645044 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:45.122486 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e203813e-9df8-49f0-987f-4c9198645044 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:45.123238 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e203813e-9df8-49f0-987f-4c9198645044 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:45.124134 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e203813e-9df8-49f0-987f-4c9198645044 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:45.125318 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e203813e-9df8-49f0-987f-4c9198645044 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:45.126068 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e203813e-9df8-49f0-987f-4c9198645044 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:45.180617 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b31363f0-a475-46b6-bc53-8c2108915cb8 tempest-VolumesTestJSON-1628480955 tempest-VolumesTestJSON-1628480955-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.108878 Aug 31 16:15:45.181188 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2390/4973] 10.222.0.50 () {58 vars in 1170 bytes} [Wed Aug 31 16:15:45 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:45.203527 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-39ee4867-d7f5-4c06-b778-9017fc4db88c tempest-VolumesTestJSON-1628480955 tempest-VolumesTestJSON-1628480955-project] Calling method '.version_select at 0x7fbb45cebc10>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:45.274828 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:15:45.296362 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-39ee4867-d7f5-4c06-b778-9017fc4db88c tempest-VolumesTestJSON-1628480955 tempest-VolumesTestJSON-1628480955-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.096921 Aug 31 16:15:45.297589 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2391/4974] 10.222.0.50 () {58 vars in 1155 bytes} [Wed Aug 31 16:15:45 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:15:45.300732 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e203813e-9df8-49f0-987f-4c9198645044 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:45.310257 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e203813e-9df8-49f0-987f-4c9198645044 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/bdab1c5f-e128-4ef6-b93d-7ac15002ddbf" status: 200 len: 1317 microversion: 2.1 time: 0.204991 Aug 31 16:15:45.310882 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2584/4975] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:45 2022] GET /compute/v2.1/servers/bdab1c5f-e128-4ef6-b93d-7ac15002ddbf => generated 1317 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:15:45.313538 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8e5ce4c8-2d7f-48cf-aedc-a6323b3306ec tempest-VolumesTestJSON-1628480955 tempest-VolumesTestJSON-1628480955-project] Calling method '.version_select at 0x7fbb466710d0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:45.403567 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8e5ce4c8-2d7f-48cf-aedc-a6323b3306ec tempest-VolumesTestJSON-1628480955 tempest-VolumesTestJSON-1628480955-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.096218 Aug 31 16:15:45.404148 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2392/4976] 10.222.0.50 () {58 vars in 1188 bytes} [Wed Aug 31 16:15:45 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:15:45.417305 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-49191683-c339-4ab9-9981-3bf7c7ed5700 tempest-VolumesTestJSON-1628480955 tempest-VolumesTestJSON-1628480955-project] Calling method '.version_select at 0x7fbb45de1ee0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:45.563971 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0806fdec-1311-4fbe-97cf-a029ba7972dc tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:45.565012 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0806fdec-1311-4fbe-97cf-a029ba7972dc tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] [instance: 384dc38e-62e2-44c7-a1da-28421a88b79d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:45.574810 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0806fdec-1311-4fbe-97cf-a029ba7972dc tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:45.575794 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0806fdec-1311-4fbe-97cf-a029ba7972dc tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:45.576421 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0806fdec-1311-4fbe-97cf-a029ba7972dc tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:45.577438 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0806fdec-1311-4fbe-97cf-a029ba7972dc tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:45.578487 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0806fdec-1311-4fbe-97cf-a029ba7972dc tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:45.579145 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0806fdec-1311-4fbe-97cf-a029ba7972dc tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:45.604072 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:15:45.674315 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-49191683-c339-4ab9-9981-3bf7c7ed5700 tempest-VolumesTestJSON-1628480955 tempest-VolumesTestJSON-1628480955-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.260685 Aug 31 16:15:45.674926 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2585/4977] 10.222.0.50 () {58 vars in 1155 bytes} [Wed Aug 31 16:15:45 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:45.748263 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0806fdec-1311-4fbe-97cf-a029ba7972dc tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dabb1c841cde40769174e2f8a97234c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baff3cad5c14325a5576c40fcda0580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:45.759098 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0806fdec-1311-4fbe-97cf-a029ba7972dc tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "GET /compute/v2.1/servers/384dc38e-62e2-44c7-a1da-28421a88b79d" status: 200 len: 1316 microversion: 2.1 time: 0.199054 Aug 31 16:15:45.759785 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2393/4978] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:45 2022] GET /compute/v2.1/servers/384dc38e-62e2-44c7-a1da-28421a88b79d => generated 1316 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:15:46.332846 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-cec82550-0740-44ae-8ce9-bd252999f5f6 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:46.334038 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-cec82550-0740-44ae-8ce9-bd252999f5f6 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: bdab1c5f-e128-4ef6-b93d-7ac15002ddbf] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:46.337177 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=70 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:15:46.344467 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cec82550-0740-44ae-8ce9-bd252999f5f6 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:46.346111 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cec82550-0740-44ae-8ce9-bd252999f5f6 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:46.347054 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cec82550-0740-44ae-8ce9-bd252999f5f6 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:46.348107 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cec82550-0740-44ae-8ce9-bd252999f5f6 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:46.348585 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cec82550-0740-44ae-8ce9-bd252999f5f6 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:46.349367 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cec82550-0740-44ae-8ce9-bd252999f5f6 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:46.504123 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-cec82550-0740-44ae-8ce9-bd252999f5f6 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:46.516802 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-cec82550-0740-44ae-8ce9-bd252999f5f6 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/bdab1c5f-e128-4ef6-b93d-7ac15002ddbf" status: 200 len: 1317 microversion: 2.1 time: 0.186951 Aug 31 16:15:46.517137 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2586/4979] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:46 2022] GET /compute/v2.1/servers/bdab1c5f-e128-4ef6-b93d-7ac15002ddbf => generated 1317 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:46.731379 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-281988ac-7cc8-4adb-b5f3-38a7ca5f376b req-283216e7-332e-4489-bca1-3ca02dcc3397 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "384dc38e-62e2-44c7-a1da-28421a88b79d", "name": "network-vif-plugged", "status": "completed", "tag": "74b2149c-d46b-45ea-9160-52027217065d"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:46.745451 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-281988ac-7cc8-4adb-b5f3-38a7ca5f376b req-283216e7-332e-4489-bca1-3ca02dcc3397 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:46.746355 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-281988ac-7cc8-4adb-b5f3-38a7ca5f376b req-283216e7-332e-4489-bca1-3ca02dcc3397 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:46.747795 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-281988ac-7cc8-4adb-b5f3-38a7ca5f376b req-283216e7-332e-4489-bca1-3ca02dcc3397 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:46.761016 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-281988ac-7cc8-4adb-b5f3-38a7ca5f376b req-283216e7-332e-4489-bca1-3ca02dcc3397 service nova] Creating event network-vif-plugged:74b2149c-d46b-45ea-9160-52027217065d for instance 384dc38e-62e2-44c7-a1da-28421a88b79d on n-h1-833090-16 Aug 31 16:15:46.767323 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-281988ac-7cc8-4adb-b5f3-38a7ca5f376b req-283216e7-332e-4489-bca1-3ca02dcc3397 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042075 Aug 31 16:15:46.774972 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2394/4980] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:46.784899 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8a732924-6187-462a-8d12-851ad422fbb6 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:46.785939 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8a732924-6187-462a-8d12-851ad422fbb6 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] [instance: 384dc38e-62e2-44c7-a1da-28421a88b79d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:46.793465 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8a732924-6187-462a-8d12-851ad422fbb6 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:46.794152 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8a732924-6187-462a-8d12-851ad422fbb6 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:46.794768 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8a732924-6187-462a-8d12-851ad422fbb6 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:46.795928 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8a732924-6187-462a-8d12-851ad422fbb6 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:46.796639 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8a732924-6187-462a-8d12-851ad422fbb6 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:46.797290 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8a732924-6187-462a-8d12-851ad422fbb6 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:47.442348 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8a732924-6187-462a-8d12-851ad422fbb6 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dabb1c841cde40769174e2f8a97234c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baff3cad5c14325a5576c40fcda0580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:47.452190 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8a732924-6187-462a-8d12-851ad422fbb6 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "GET /compute/v2.1/servers/384dc38e-62e2-44c7-a1da-28421a88b79d" status: 200 len: 1316 microversion: 2.1 time: 0.675038 Aug 31 16:15:47.452920 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2587/4981] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:46 2022] GET /compute/v2.1/servers/384dc38e-62e2-44c7-a1da-28421a88b79d => generated 1316 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:47.536672 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e35fb8a3-872e-44c6-825c-c6800728e3c1 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:47.537995 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e35fb8a3-872e-44c6-825c-c6800728e3c1 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: bdab1c5f-e128-4ef6-b93d-7ac15002ddbf] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:47.549746 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e35fb8a3-872e-44c6-825c-c6800728e3c1 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:47.550311 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e35fb8a3-872e-44c6-825c-c6800728e3c1 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:47.550869 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e35fb8a3-872e-44c6-825c-c6800728e3c1 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:47.551538 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e35fb8a3-872e-44c6-825c-c6800728e3c1 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:47.552638 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e35fb8a3-872e-44c6-825c-c6800728e3c1 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:47.553029 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e35fb8a3-872e-44c6-825c-c6800728e3c1 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:47.729064 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e35fb8a3-872e-44c6-825c-c6800728e3c1 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:47.737999 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e35fb8a3-872e-44c6-825c-c6800728e3c1 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/bdab1c5f-e128-4ef6-b93d-7ac15002ddbf" status: 200 len: 1505 microversion: 2.1 time: 0.205822 Aug 31 16:15:47.738804 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2395/4982] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:47 2022] GET /compute/v2.1/servers/bdab1c5f-e128-4ef6-b93d-7ac15002ddbf => generated 1505 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:47.766586 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2b83d4d1-f4f5-462f-906d-204bcac32afb tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:47.767085 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2b83d4d1-f4f5-462f-906d-204bcac32afb tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: bdab1c5f-e128-4ef6-b93d-7ac15002ddbf] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:47.773640 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b83d4d1-f4f5-462f-906d-204bcac32afb tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:47.774144 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b83d4d1-f4f5-462f-906d-204bcac32afb tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:47.774558 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b83d4d1-f4f5-462f-906d-204bcac32afb tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:47.775236 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b83d4d1-f4f5-462f-906d-204bcac32afb tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:47.775688 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b83d4d1-f4f5-462f-906d-204bcac32afb tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:47.776101 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b83d4d1-f4f5-462f-906d-204bcac32afb tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:47.838612 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2b83d4d1-f4f5-462f-906d-204bcac32afb tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: bdab1c5f-e128-4ef6-b93d-7ac15002ddbf] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:15:47.938009 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2b83d4d1-f4f5-462f-906d-204bcac32afb tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "DELETE /compute/v2.1/servers/bdab1c5f-e128-4ef6-b93d-7ac15002ddbf" status: 204 len: 0 microversion: 2.1 time: 0.179931 Aug 31 16:15:47.942751 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2588/4983] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:15:47 2022] DELETE /compute/v2.1/servers/bdab1c5f-e128-4ef6-b93d-7ac15002ddbf => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:15:47.948551 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b2886f11-f673-4bec-ba9e-45223e711578 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:47.949160 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b2886f11-f673-4bec-ba9e-45223e711578 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: bdab1c5f-e128-4ef6-b93d-7ac15002ddbf] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:47.957261 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b2886f11-f673-4bec-ba9e-45223e711578 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:47.957698 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b2886f11-f673-4bec-ba9e-45223e711578 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:47.958155 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b2886f11-f673-4bec-ba9e-45223e711578 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:47.958834 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b2886f11-f673-4bec-ba9e-45223e711578 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:47.959495 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b2886f11-f673-4bec-ba9e-45223e711578 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:47.959905 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b2886f11-f673-4bec-ba9e-45223e711578 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:48.172814 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b2886f11-f673-4bec-ba9e-45223e711578 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:48.181883 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b2886f11-f673-4bec-ba9e-45223e711578 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/bdab1c5f-e128-4ef6-b93d-7ac15002ddbf" status: 200 len: 1511 microversion: 2.1 time: 0.237555 Aug 31 16:15:48.182503 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2396/4984] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:47 2022] GET /compute/v2.1/servers/bdab1c5f-e128-4ef6-b93d-7ac15002ddbf => generated 1511 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:48.484769 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4727108a-4001-4b8f-aec4-c129ef72ac91 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:48.494783 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4727108a-4001-4b8f-aec4-c129ef72ac91 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] [instance: 384dc38e-62e2-44c7-a1da-28421a88b79d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:48.507176 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4727108a-4001-4b8f-aec4-c129ef72ac91 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:48.507814 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4727108a-4001-4b8f-aec4-c129ef72ac91 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:48.508528 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4727108a-4001-4b8f-aec4-c129ef72ac91 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:48.509584 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4727108a-4001-4b8f-aec4-c129ef72ac91 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:48.510621 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4727108a-4001-4b8f-aec4-c129ef72ac91 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:48.511518 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4727108a-4001-4b8f-aec4-c129ef72ac91 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:48.705494 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4727108a-4001-4b8f-aec4-c129ef72ac91 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dabb1c841cde40769174e2f8a97234c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baff3cad5c14325a5576c40fcda0580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:48.715704 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4727108a-4001-4b8f-aec4-c129ef72ac91 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "GET /compute/v2.1/servers/384dc38e-62e2-44c7-a1da-28421a88b79d" status: 200 len: 1316 microversion: 2.1 time: 0.240307 Aug 31 16:15:48.716529 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2589/4985] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:48 2022] GET /compute/v2.1/servers/384dc38e-62e2-44c7-a1da-28421a88b79d => generated 1316 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:49.207281 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b9337dd5-6b2a-417d-a92b-56542990ee03 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:49.208367 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b9337dd5-6b2a-417d-a92b-56542990ee03 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: bdab1c5f-e128-4ef6-b93d-7ac15002ddbf] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:49.217133 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9337dd5-6b2a-417d-a92b-56542990ee03 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:49.217971 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9337dd5-6b2a-417d-a92b-56542990ee03 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:49.218605 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9337dd5-6b2a-417d-a92b-56542990ee03 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:49.219496 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9337dd5-6b2a-417d-a92b-56542990ee03 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:49.220108 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9337dd5-6b2a-417d-a92b-56542990ee03 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:49.220802 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9337dd5-6b2a-417d-a92b-56542990ee03 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:49.432084 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b9337dd5-6b2a-417d-a92b-56542990ee03 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:49.445657 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b9337dd5-6b2a-417d-a92b-56542990ee03 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/bdab1c5f-e128-4ef6-b93d-7ac15002ddbf" status: 200 len: 1511 microversion: 2.1 time: 0.244903 Aug 31 16:15:49.447586 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2397/4986] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:49 2022] GET /compute/v2.1/servers/bdab1c5f-e128-4ef6-b93d-7ac15002ddbf => generated 1511 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:49.738522 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-efba5742-a65b-4249-814c-ebcdd1206db1 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:49.739190 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-efba5742-a65b-4249-814c-ebcdd1206db1 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] [instance: 384dc38e-62e2-44c7-a1da-28421a88b79d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:49.747156 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-efba5742-a65b-4249-814c-ebcdd1206db1 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:49.750810 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-efba5742-a65b-4249-814c-ebcdd1206db1 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:49.751481 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-efba5742-a65b-4249-814c-ebcdd1206db1 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:49.752818 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-efba5742-a65b-4249-814c-ebcdd1206db1 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:49.753408 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-efba5742-a65b-4249-814c-ebcdd1206db1 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:49.753826 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-efba5742-a65b-4249-814c-ebcdd1206db1 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:49.928374 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-efba5742-a65b-4249-814c-ebcdd1206db1 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dabb1c841cde40769174e2f8a97234c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baff3cad5c14325a5576c40fcda0580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:49.939163 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-efba5742-a65b-4249-814c-ebcdd1206db1 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "GET /compute/v2.1/servers/384dc38e-62e2-44c7-a1da-28421a88b79d" status: 200 len: 1504 microversion: 2.1 time: 0.204873 Aug 31 16:15:49.950817 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2590/4987] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:49 2022] GET /compute/v2.1/servers/384dc38e-62e2-44c7-a1da-28421a88b79d => generated 1504 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:49.969266 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8dec1efc-e0d5-4588-bd26-b09416b4d6a7 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-666501977"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:49.970298 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8dec1efc-e0d5-4588-bd26-b09416b4d6a7 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] [instance: 384dc38e-62e2-44c7-a1da-28421a88b79d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:49.978371 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8dec1efc-e0d5-4588-bd26-b09416b4d6a7 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:49.978859 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8dec1efc-e0d5-4588-bd26-b09416b4d6a7 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:49.979509 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8dec1efc-e0d5-4588-bd26-b09416b4d6a7 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:49.980218 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8dec1efc-e0d5-4588-bd26-b09416b4d6a7 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:49.980670 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8dec1efc-e0d5-4588-bd26-b09416b4d6a7 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:49.981086 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8dec1efc-e0d5-4588-bd26-b09416b4d6a7 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:50.250580 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.network.security_group_api [None req-8dec1efc-e0d5-4588-bd26-b09416b4d6a7 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Adding security group a76b48a7-3332-4a36-b269-6e0c52d879e5 to port 74b2149c-d46b-45ea-9160-52027217065d Aug 31 16:15:50.472567 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-55da951b-5a1a-4513-b2a1-e907abe9eab5 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:50.473495 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-55da951b-5a1a-4513-b2a1-e907abe9eab5 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: bdab1c5f-e128-4ef6-b93d-7ac15002ddbf] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:50.480160 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-55da951b-5a1a-4513-b2a1-e907abe9eab5 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:50.480879 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-55da951b-5a1a-4513-b2a1-e907abe9eab5 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:50.481478 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-55da951b-5a1a-4513-b2a1-e907abe9eab5 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:50.482364 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-55da951b-5a1a-4513-b2a1-e907abe9eab5 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:50.483052 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-55da951b-5a1a-4513-b2a1-e907abe9eab5 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:50.483628 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-55da951b-5a1a-4513-b2a1-e907abe9eab5 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:50.823646 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-55da951b-5a1a-4513-b2a1-e907abe9eab5 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:50.836175 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-55da951b-5a1a-4513-b2a1-e907abe9eab5 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/bdab1c5f-e128-4ef6-b93d-7ac15002ddbf" status: 200 len: 1511 microversion: 2.1 time: 0.368006 Aug 31 16:15:50.837182 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2591/4988] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:50 2022] GET /compute/v2.1/servers/bdab1c5f-e128-4ef6-b93d-7ac15002ddbf => generated 1511 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:15:51.011755 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-917cb866-1d2e-4f4b-9f38-29f892dc05bf tempest-PortsAdminExtendedAttrsIpV6TestJSON-1349252228 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1349252228-project-admin] Calling method '.version_select at 0x7fbb45998430>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:51.013748 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-917cb866-1d2e-4f4b-9f38-29f892dc05bf tempest-PortsAdminExtendedAttrsIpV6TestJSON-1349252228 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1349252228-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:51.014267 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-917cb866-1d2e-4f4b-9f38-29f892dc05bf tempest-PortsAdminExtendedAttrsIpV6TestJSON-1349252228 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1349252228-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:51.014705 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-917cb866-1d2e-4f4b-9f38-29f892dc05bf tempest-PortsAdminExtendedAttrsIpV6TestJSON-1349252228 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1349252228-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:51.050362 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-917cb866-1d2e-4f4b-9f38-29f892dc05bf tempest-PortsAdminExtendedAttrsIpV6TestJSON-1349252228 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1349252228-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:51.051111 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-917cb866-1d2e-4f4b-9f38-29f892dc05bf tempest-PortsAdminExtendedAttrsIpV6TestJSON-1349252228 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1349252228-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:51.051679 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-917cb866-1d2e-4f4b-9f38-29f892dc05bf tempest-PortsAdminExtendedAttrsIpV6TestJSON-1349252228 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1349252228-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:51.086200 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-917cb866-1d2e-4f4b-9f38-29f892dc05bf tempest-PortsAdminExtendedAttrsIpV6TestJSON-1349252228 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1349252228-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:51.086710 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-917cb866-1d2e-4f4b-9f38-29f892dc05bf tempest-PortsAdminExtendedAttrsIpV6TestJSON-1349252228 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1349252228-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:51.087131 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-917cb866-1d2e-4f4b-9f38-29f892dc05bf tempest-PortsAdminExtendedAttrsIpV6TestJSON-1349252228 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1349252228-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:51.088209 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8dec1efc-e0d5-4588-bd26-b09416b4d6a7 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "POST /compute/v2.1/servers/384dc38e-62e2-44c7-a1da-28421a88b79d/action" status: 202 len: 0 microversion: 2.1 time: 1.126705 Aug 31 16:15:51.088848 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2398/4989] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:15:49 2022] POST /compute/v2.1/servers/384dc38e-62e2-44c7-a1da-28421a88b79d/action => generated 0 bytes in 1128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:15:51.094608 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-6f17ec82-30c2-436e-919d-0595a3c153e0 req-773e010c-e7ae-46af-9abf-fcc1fd2d5474 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdab1c5f-e128-4ef6-b93d-7ac15002ddbf", "name": "network-vif-deleted", "tag": "55444892-ede0-4826-8b6c-479e72928ae1"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:51.104144 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-917cb866-1d2e-4f4b-9f38-29f892dc05bf tempest-PortsAdminExtendedAttrsIpV6TestJSON-1349252228 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1349252228-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.265442 Aug 31 16:15:51.105074 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2592/4990] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 31 16:15:50 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:51.123913 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e43f416b-c759-4e78-a8c9-7c2db2024941 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '.version_select at 0x7fbb45998700>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:51.153173 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-6f17ec82-30c2-436e-919d-0595a3c153e0 req-773e010c-e7ae-46af-9abf-fcc1fd2d5474 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:51.154065 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-6f17ec82-30c2-436e-919d-0595a3c153e0 req-773e010c-e7ae-46af-9abf-fcc1fd2d5474 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:51.154690 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-6f17ec82-30c2-436e-919d-0595a3c153e0 req-773e010c-e7ae-46af-9abf-fcc1fd2d5474 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:51.198054 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-6f17ec82-30c2-436e-919d-0595a3c153e0 req-773e010c-e7ae-46af-9abf-fcc1fd2d5474 service nova] Creating event network-vif-deleted:55444892-ede0-4826-8b6c-479e72928ae1 for instance bdab1c5f-e128-4ef6-b93d-7ac15002ddbf on n-h2-833090-16 Aug 31 16:15:51.209899 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-6f17ec82-30c2-436e-919d-0595a3c153e0 req-773e010c-e7ae-46af-9abf-fcc1fd2d5474 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119805 Aug 31 16:15:51.217558 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2399/4991] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:51.451725 n-d-833090-16 devstack@n-api.service[128864]: DEBUG neutronclient.v2_0.client [None req-e43f416b-c759-4e78-a8c9-7c2db2024941 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group a76b48a7-3332-4a36-b269-6e0c52d879e5 in use.", "detail": ""}} {{(pid=128864) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 31 16:15:51.452878 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-e43f416b-c759-4e78-a8c9-7c2db2024941 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] HTTP exception thrown: Security Group a76b48a7-3332-4a36-b269-6e0c52d879e5 in use. Aug 31 16:15:51.452878 n-d-833090-16 devstack@n-api.service[128864]: Neutron server returns request_ids: ['req-eba331e1-c407-4bcd-9dfb-d7ba35901442'] Aug 31 16:15:51.455616 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e43f416b-c759-4e78-a8c9-7c2db2024941 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Request method failure captured: Aug 31 16:15:51.455616 n-d-833090-16 devstack@n-api.service[128864]: request: DELETE /compute/v2.1/os-security-groups/a76b48a7-3332-4a36-b269-6e0c52d879e5 HTTP/1.1 Aug 31 16:15:51.455616 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:15:51.455616 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:15:51.455616 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:15:51.455616 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:15:51.455616 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:15:51.455616 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:15:51.455616 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:15:51.455616 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:15:51.455616 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4kIFJ0zG0xeBGgG3uzrjLL9EnflnKZMdGdJ2D9YGgjKqtNDIyBPydopwRei8ZnPbXcFm3HhN-k5tWZi56omwftJZfOWCKw_Hb9N0DyCWLOGgTx7eghMjbdmJfyquGOCz4DRfEHH-TxPGulLn-DplfVM4FoftEuHQL9TOxgHDYENNcI Aug 31 16:15:51.455616 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:15:51.455616 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:15:51.455616 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:15:51.455616 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:15:51.455616 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:15:51.455616 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:15:51.455616 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 7baff3cad5c14325a5576c40fcda0580 Aug 31 16:15:51.455616 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-SecurityGroupsTestJSON-608242232 Aug 31 16:15:51.455616 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:15:51.455616 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:15:51.455616 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7baff3cad5c14325a5576c40fcda0580"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7baff3cad5c14325a5576c40fcda0580"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7baff3cad5c14325a5576c40fcda0580"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7baff3cad5c14325a5576c40fcda0580", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:15:51.455616 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-SecurityGroupsTestJSON-608242232 Aug 31 16:15:51.455616 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 7baff3cad5c14325a5576c40fcda0580 Aug 31 16:15:51.455616 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-608242232 Aug 31 16:15:51.455616 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-SecurityGroupsTestJSON-608242232-project Aug 31 16:15:51.455616 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:15:51.455616 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:15:51.455616 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: dabb1c841cde40769174e2f8a97234c0 Aug 31 16:15:51.455616 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-SecurityGroupsTestJSON-608242232-project Aug 31 16:15:51.455616 n-d-833090-16 devstack@n-api.service[128864]: method: Aug 31 16:15:51.455616 n-d-833090-16 devstack@n-api.service[128864]: exception: Security Group a76b48a7-3332-4a36-b269-6e0c52d879e5 in use. Aug 31 16:15:51.455616 n-d-833090-16 devstack@n-api.service[128864]: Neutron server returns request_ids: ['req-eba331e1-c407-4bcd-9dfb-d7ba35901442'] Aug 31 16:15:51.455616 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'a76b48a7-3332-4a36-b269-6e0c52d879e5'} Aug 31 16:15:51.455616 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:15:51.455616 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:51.455616 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 31 16:15:51.455616 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 31 16:15:51.455616 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:15:51.455616 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:15:51.455616 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 31 16:15:51.455616 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 31 16:15:51.455616 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:15:51.455616 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:15:51.455616 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 31 16:15:51.455616 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 31 16:15:51.455616 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:15:51.455616 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:15:51.455616 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 31 16:15:51.455616 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 31 16:15:51.455616 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:15:51.455616 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:15:51.455616 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 31 16:15:51.455616 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 31 16:15:51.455616 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:15:51.455616 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:15:51.455616 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 31 16:15:51.455616 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 31 16:15:51.455616 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 31 16:15:51.455616 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 31 16:15:51.455616 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group a76b48a7-3332-4a36-b269-6e0c52d879e5 in use. Aug 31 16:15:51.463060 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eba331e1-c407-4bcd-9dfb-d7ba35901442'] Aug 31 16:15:51.463060 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:15:51.463060 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:51.463060 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:15:51.463060 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:51.463060 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 31 16:15:51.463060 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 31 16:15:51.463060 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 31 16:15:51.463060 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 31 16:15:51.463060 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group a76b48a7-3332-4a36-b269-6e0c52d879e5 in use. Aug 31 16:15:51.463060 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eba331e1-c407-4bcd-9dfb-d7ba35901442'] Aug 31 16:15:51.463060 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:15:51.463060 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:51.463060 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:15:51.463060 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:51.463060 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:51.463060 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:51.463060 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:15:51.463060 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:15:51.463060 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:15:51.463060 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:15:51.463060 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:15:51.463060 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:15:51.463060 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 31 16:15:51.463060 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 31 16:15:51.463060 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group a76b48a7-3332-4a36-b269-6e0c52d879e5 in use. Aug 31 16:15:51.463060 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eba331e1-c407-4bcd-9dfb-d7ba35901442'] Aug 31 16:15:51.463060 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:15:51.463060 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:51.463060 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:15:51.463060 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:51.463060 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:51.463060 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:51.463060 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:15:51.463060 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:15:51.463060 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group a76b48a7-3332-4a36-b269-6e0c52d879e5 in use. Aug 31 16:15:51.463060 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eba331e1-c407-4bcd-9dfb-d7ba35901442'] Aug 31 16:15:51.463060 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:15:51.463060 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e43f416b-c759-4e78-a8c9-7c2db2024941 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Returning 400 to user: Security Group a76b48a7-3332-4a36-b269-6e0c52d879e5 in use. Aug 31 16:15:51.463060 n-d-833090-16 devstack@n-api.service[128864]: Neutron server returns request_ids: ['req-eba331e1-c407-4bcd-9dfb-d7ba35901442'] {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:15:51.463060 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e43f416b-c759-4e78-a8c9-7c2db2024941 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/a76b48a7-3332-4a36-b269-6e0c52d879e5" status: 400 len: 185 microversion: 2.1 time: 0.351236 Aug 31 16:15:51.463060 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2593/4992] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 31 16:15:51 2022] DELETE /compute/v2.1/os-security-groups/a76b48a7-3332-4a36-b269-6e0c52d879e5 => generated 185 bytes in 352 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:15:51.481913 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2c9e36a7-8d85-4082-8f54-e0ddcfee8d2a tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:51.504912 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2c9e36a7-8d85-4082-8f54-e0ddcfee8d2a tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] [instance: 384dc38e-62e2-44c7-a1da-28421a88b79d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:51.525731 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c9e36a7-8d85-4082-8f54-e0ddcfee8d2a tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:51.527537 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c9e36a7-8d85-4082-8f54-e0ddcfee8d2a tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:51.528253 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c9e36a7-8d85-4082-8f54-e0ddcfee8d2a tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:51.531095 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c9e36a7-8d85-4082-8f54-e0ddcfee8d2a tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:51.533483 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c9e36a7-8d85-4082-8f54-e0ddcfee8d2a tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:51.534460 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c9e36a7-8d85-4082-8f54-e0ddcfee8d2a tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:51.723629 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2c9e36a7-8d85-4082-8f54-e0ddcfee8d2a tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "POST /compute/v2.1/servers/384dc38e-62e2-44c7-a1da-28421a88b79d/action" status: 202 len: 0 microversion: 2.1 time: 0.252017 Aug 31 16:15:51.725517 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2400/4993] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:15:51 2022] POST /compute/v2.1/servers/384dc38e-62e2-44c7-a1da-28421a88b79d/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:15:51.734434 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3ce93b36-2ed0-4a9d-b4a4-9d91b429c4f5 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:51.735041 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3ce93b36-2ed0-4a9d-b4a4-9d91b429c4f5 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] [instance: 384dc38e-62e2-44c7-a1da-28421a88b79d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:51.752886 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3ce93b36-2ed0-4a9d-b4a4-9d91b429c4f5 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:51.752886 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3ce93b36-2ed0-4a9d-b4a4-9d91b429c4f5 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:51.753298 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3ce93b36-2ed0-4a9d-b4a4-9d91b429c4f5 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:51.753911 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3ce93b36-2ed0-4a9d-b4a4-9d91b429c4f5 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:51.763097 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3ce93b36-2ed0-4a9d-b4a4-9d91b429c4f5 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:51.763473 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3ce93b36-2ed0-4a9d-b4a4-9d91b429c4f5 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:51.879026 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e68d46a3-b8f9-4a8b-ae08-f35514659888 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:51.882549 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e68d46a3-b8f9-4a8b-ae08-f35514659888 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: bdab1c5f-e128-4ef6-b93d-7ac15002ddbf] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:51.911991 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e68d46a3-b8f9-4a8b-ae08-f35514659888 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:51.916626 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e68d46a3-b8f9-4a8b-ae08-f35514659888 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:51.917490 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e68d46a3-b8f9-4a8b-ae08-f35514659888 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:51.934270 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e68d46a3-b8f9-4a8b-ae08-f35514659888 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:51.935023 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e68d46a3-b8f9-4a8b-ae08-f35514659888 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:51.943780 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e68d46a3-b8f9-4a8b-ae08-f35514659888 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:52.085482 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e68d46a3-b8f9-4a8b-ae08-f35514659888 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:52.092898 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e68d46a3-b8f9-4a8b-ae08-f35514659888 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:52.093992 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e68d46a3-b8f9-4a8b-ae08-f35514659888 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:52.097699 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-e68d46a3-b8f9-4a8b-ae08-f35514659888 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lazy-loading 'fault' on Instance uuid bdab1c5f-e128-4ef6-b93d-7ac15002ddbf {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:15:52.334405 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e68d46a3-b8f9-4a8b-ae08-f35514659888 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:52.371114 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e68d46a3-b8f9-4a8b-ae08-f35514659888 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/bdab1c5f-e128-4ef6-b93d-7ac15002ddbf" status: 200 len: 1307 microversion: 2.1 time: 0.506948 Aug 31 16:15:52.388171 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2401/4994] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:51 2022] GET /compute/v2.1/servers/bdab1c5f-e128-4ef6-b93d-7ac15002ddbf => generated 1307 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:52.511542 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3ce93b36-2ed0-4a9d-b4a4-9d91b429c4f5 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dabb1c841cde40769174e2f8a97234c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baff3cad5c14325a5576c40fcda0580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:52.525736 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3ce93b36-2ed0-4a9d-b4a4-9d91b429c4f5 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "GET /compute/v2.1/servers/384dc38e-62e2-44c7-a1da-28421a88b79d" status: 200 len: 1574 microversion: 2.1 time: 0.795109 Aug 31 16:15:52.526376 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2594/4995] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:51 2022] GET /compute/v2.1/servers/384dc38e-62e2-44c7-a1da-28421a88b79d => generated 1574 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:53.243976 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-d89c7f83-0bbc-43a5-8fc2-061a2ac721ce req-f81efee5-f4a0-4a00-880f-5cec990dc07a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "384dc38e-62e2-44c7-a1da-28421a88b79d", "tag": "74b2149c-d46b-45ea-9160-52027217065d"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:53.257274 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d89c7f83-0bbc-43a5-8fc2-061a2ac721ce req-f81efee5-f4a0-4a00-880f-5cec990dc07a service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:53.258034 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d89c7f83-0bbc-43a5-8fc2-061a2ac721ce req-f81efee5-f4a0-4a00-880f-5cec990dc07a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:53.271477 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d89c7f83-0bbc-43a5-8fc2-061a2ac721ce req-f81efee5-f4a0-4a00-880f-5cec990dc07a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:53.297583 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-d89c7f83-0bbc-43a5-8fc2-061a2ac721ce req-f81efee5-f4a0-4a00-880f-5cec990dc07a service nova] Creating event network-changed:74b2149c-d46b-45ea-9160-52027217065d for instance 384dc38e-62e2-44c7-a1da-28421a88b79d on n-h1-833090-16 Aug 31 16:15:53.310016 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-d89c7f83-0bbc-43a5-8fc2-061a2ac721ce req-f81efee5-f4a0-4a00-880f-5cec990dc07a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069566 Aug 31 16:15:53.316308 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2402/4996] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:53.414046 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ce9018fc-eb29-40d1-b042-3e8eeefd139c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:53.414802 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ce9018fc-eb29-40d1-b042-3e8eeefd139c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: bdab1c5f-e128-4ef6-b93d-7ac15002ddbf] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:53.423112 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ce9018fc-eb29-40d1-b042-3e8eeefd139c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:53.423977 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ce9018fc-eb29-40d1-b042-3e8eeefd139c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:53.424606 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ce9018fc-eb29-40d1-b042-3e8eeefd139c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:53.424606 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ce9018fc-eb29-40d1-b042-3e8eeefd139c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:53.424606 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ce9018fc-eb29-40d1-b042-3e8eeefd139c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:53.429107 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ce9018fc-eb29-40d1-b042-3e8eeefd139c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:53.441434 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-ce9018fc-eb29-40d1-b042-3e8eeefd139c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] HTTP exception thrown: Instance bdab1c5f-e128-4ef6-b93d-7ac15002ddbf could not be found. Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ce9018fc-eb29-40d1-b042-3e8eeefd139c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Request method failure captured: Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/bdab1c5f-e128-4ef6-b93d-7ac15002ddbf HTTP/1.1 Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4kQ0XzwgZzM00K2xfqw4sNWznetRNwtM61dwPFzPgxHVwt6ZQqeyy0IDwJXT8yOdP4-2pSJFf0sLdbRTKSty95v4MPjLoaaRhSqpDob3UUxppJFVkB8ZQH-IsYhc50JLxuO54hEVWRh4jtxjaTwZZjw98G6FCIkizac62ua4tSQ6_s Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3e843f3122c14cf8889f26423552792f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3e843f3122c14cf8889f26423552792f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 8b67be53aade4f8c92d6765dd91a4b90 Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance bdab1c5f-e128-4ef6-b93d-7ac15002ddbf could not be found. Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'bdab1c5f-e128-4ef6-b93d-7ac15002ddbf'} Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdab1c5f-e128-4ef6-b93d-7ac15002ddbf could not be found. Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdab1c5f-e128-4ef6-b93d-7ac15002ddbf could not be found. Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:53.443419 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:15:53.449564 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:53.449564 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:53.449564 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:53.449564 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:15:53.449564 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:15:53.449564 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdab1c5f-e128-4ef6-b93d-7ac15002ddbf could not be found. Aug 31 16:15:53.449564 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:15:53.449564 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ce9018fc-eb29-40d1-b042-3e8eeefd139c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Returning 404 to user: Instance bdab1c5f-e128-4ef6-b93d-7ac15002ddbf could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:15:53.449564 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ce9018fc-eb29-40d1-b042-3e8eeefd139c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/bdab1c5f-e128-4ef6-b93d-7ac15002ddbf" status: 404 len: 111 microversion: 2.1 time: 0.035270 Aug 31 16:15:53.450674 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2595/4997] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:53 2022] GET /compute/v2.1/servers/bdab1c5f-e128-4ef6-b93d-7ac15002ddbf => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:15:53.454895 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-02de3079-2e8f-4e56-9301-01edd9f50139 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:53.456072 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-02de3079-2e8f-4e56-9301-01edd9f50139 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:53.467247 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02de3079-2e8f-4e56-9301-01edd9f50139 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:53.471446 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02de3079-2e8f-4e56-9301-01edd9f50139 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:53.473678 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02de3079-2e8f-4e56-9301-01edd9f50139 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:53.476126 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02de3079-2e8f-4e56-9301-01edd9f50139 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:53.476832 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02de3079-2e8f-4e56-9301-01edd9f50139 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:53.477415 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02de3079-2e8f-4e56-9301-01edd9f50139 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:53.552669 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-33c55a5a-0d27-4b89-a4f6-642f12213f2a tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:53.553865 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-33c55a5a-0d27-4b89-a4f6-642f12213f2a tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] [instance: 384dc38e-62e2-44c7-a1da-28421a88b79d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:53.562762 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33c55a5a-0d27-4b89-a4f6-642f12213f2a tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:53.563554 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33c55a5a-0d27-4b89-a4f6-642f12213f2a tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:53.564182 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33c55a5a-0d27-4b89-a4f6-642f12213f2a tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:53.565464 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33c55a5a-0d27-4b89-a4f6-642f12213f2a tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:53.566458 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33c55a5a-0d27-4b89-a4f6-642f12213f2a tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:53.567232 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33c55a5a-0d27-4b89-a4f6-642f12213f2a tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:53.716012 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-02de3079-2e8f-4e56-9301-01edd9f50139 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:53.745100 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-02de3079-2e8f-4e56-9301-01edd9f50139 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.293474 Aug 31 16:15:53.769368 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2403/4998] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:53 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:15:53.886833 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-33c55a5a-0d27-4b89-a4f6-642f12213f2a tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dabb1c841cde40769174e2f8a97234c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baff3cad5c14325a5576c40fcda0580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:53.900273 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-33c55a5a-0d27-4b89-a4f6-642f12213f2a tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "GET /compute/v2.1/servers/384dc38e-62e2-44c7-a1da-28421a88b79d" status: 200 len: 1579 microversion: 2.1 time: 0.351726 Aug 31 16:15:53.900875 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2596/4999] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:53 2022] GET /compute/v2.1/servers/384dc38e-62e2-44c7-a1da-28421a88b79d => generated 1579 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:53.904247 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ceeb7dfd-a013-4cdd-b3ba-494f971ffc59 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "1c4c22f6-ea49-4e46-87c2-7de60e095fb8"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ceeb7dfd-a013-4cdd-b3ba-494f971ffc59 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Request method failure captured: Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 163 Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4kQ0XzwgZzM00K2xfqw4sNWznetRNwtM61dwPFzPgxHVwt6ZQqeyy0IDwJXT8yOdP4-2pSJFf0sLdbRTKSty95v4MPjLoaaRhSqpDob3UUxppJFVkB8ZQH-IsYhc50JLxuO54hEVWRh4jtxjaTwZZjw98G6FCIkizac62ua4tSQ6_s Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3e843f3122c14cf8889f26423552792f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3e843f3122c14cf8889f26423552792f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 8b67be53aade4f8c92d6765dd91a4b90 Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: {"server": {"name": 12345, "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "1c4c22f6-ea49-4e46-87c2-7de60e095fb8"}]}} Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'd715a41c-0e56-494a-a102-cac65831f6bd', 'flavorRef': '452', 'networks': [{'uuid': '1c4c22f6-ea49-4e46-87c2-7de60e095fb8'}]}}} Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 12345 Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:15:53.908276 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:15:53.914357 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:15:53.914357 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 31 16:15:53.914357 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:15:53.914357 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:53.914357 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:15:53.914357 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:53.914357 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:53.914357 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:53.914357 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:15:53.914357 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:15:53.914357 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 31 16:15:53.914357 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:15:53.916783 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ceeb7dfd-a013-4cdd-b3ba-494f971ffc59 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:15:53.917826 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ceeb7dfd-a013-4cdd-b3ba-494f971ffc59 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.019944 Aug 31 16:15:53.918627 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2404/5000] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:15:53 2022] POST /compute/v2.1/servers => generated 127 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 31 16:15:53.926943 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c6a145b0-7cc5-4312-afe0-2c138953001f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:53.927646 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c6a145b0-7cc5-4312-afe0-2c138953001f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:53.942306 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c6a145b0-7cc5-4312-afe0-2c138953001f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:53.943511 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c6a145b0-7cc5-4312-afe0-2c138953001f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:53.945001 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c6a145b0-7cc5-4312-afe0-2c138953001f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:53.946697 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c6a145b0-7cc5-4312-afe0-2c138953001f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:53.947545 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c6a145b0-7cc5-4312-afe0-2c138953001f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:53.948883 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c6a145b0-7cc5-4312-afe0-2c138953001f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:54.185373 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c6a145b0-7cc5-4312-afe0-2c138953001f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:54.201124 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c6a145b0-7cc5-4312-afe0-2c138953001f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.278082 Aug 31 16:15:54.202002 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2597/5001] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:53 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:54.223594 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4cabc841-19c6-44ba-9de2-f775b2523432 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:54.225153 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4cabc841-19c6-44ba-9de2-f775b2523432 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:54.234372 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4cabc841-19c6-44ba-9de2-f775b2523432 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:54.235452 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4cabc841-19c6-44ba-9de2-f775b2523432 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:54.236111 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4cabc841-19c6-44ba-9de2-f775b2523432 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:54.237875 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4cabc841-19c6-44ba-9de2-f775b2523432 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:54.238407 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4cabc841-19c6-44ba-9de2-f775b2523432 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:54.239024 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4cabc841-19c6-44ba-9de2-f775b2523432 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:54.450080 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4cabc841-19c6-44ba-9de2-f775b2523432 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:54.459623 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4cabc841-19c6-44ba-9de2-f775b2523432 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.240415 Aug 31 16:15:54.460769 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2405/5002] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:54 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:54.923305 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a7bee5d6-3b94-4515-a3ec-7e50e4806af4 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:54.924575 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a7bee5d6-3b94-4515-a3ec-7e50e4806af4 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] [instance: 384dc38e-62e2-44c7-a1da-28421a88b79d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:54.935304 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a7bee5d6-3b94-4515-a3ec-7e50e4806af4 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:54.937877 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a7bee5d6-3b94-4515-a3ec-7e50e4806af4 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:54.940069 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a7bee5d6-3b94-4515-a3ec-7e50e4806af4 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:54.941565 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a7bee5d6-3b94-4515-a3ec-7e50e4806af4 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:54.947029 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a7bee5d6-3b94-4515-a3ec-7e50e4806af4 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:54.947786 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a7bee5d6-3b94-4515-a3ec-7e50e4806af4 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:54.986785 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:15:55.159796 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a7bee5d6-3b94-4515-a3ec-7e50e4806af4 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dabb1c841cde40769174e2f8a97234c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baff3cad5c14325a5576c40fcda0580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:55.172245 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a7bee5d6-3b94-4515-a3ec-7e50e4806af4 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "GET /compute/v2.1/servers/384dc38e-62e2-44c7-a1da-28421a88b79d" status: 200 len: 1572 microversion: 2.1 time: 0.252799 Aug 31 16:15:55.182136 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2598/5003] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:54 2022] GET /compute/v2.1/servers/384dc38e-62e2-44c7-a1da-28421a88b79d => generated 1572 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:55.194200 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4516ee81-46d4-4e4f-8495-f99232e285c4 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1785852647"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:55.195244 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4516ee81-46d4-4e4f-8495-f99232e285c4 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] [instance: 384dc38e-62e2-44c7-a1da-28421a88b79d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:55.202129 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4516ee81-46d4-4e4f-8495-f99232e285c4 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:55.202961 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4516ee81-46d4-4e4f-8495-f99232e285c4 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:55.203610 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4516ee81-46d4-4e4f-8495-f99232e285c4 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:55.204529 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4516ee81-46d4-4e4f-8495-f99232e285c4 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:55.205300 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4516ee81-46d4-4e4f-8495-f99232e285c4 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:55.205994 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4516ee81-46d4-4e4f-8495-f99232e285c4 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:55.361382 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.network.security_group_api [None req-4516ee81-46d4-4e4f-8495-f99232e285c4 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Adding security group 712d2c7f-6545-4d70-81d7-8c0d07cb4b70 to port 74b2149c-d46b-45ea-9160-52027217065d Aug 31 16:15:56.016801 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4516ee81-46d4-4e4f-8495-f99232e285c4 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "POST /compute/v2.1/servers/384dc38e-62e2-44c7-a1da-28421a88b79d/action" status: 202 len: 0 microversion: 2.1 time: 0.827659 Aug 31 16:15:56.021499 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2406/5004] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:15:55 2022] POST /compute/v2.1/servers/384dc38e-62e2-44c7-a1da-28421a88b79d/action => generated 0 bytes in 833 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:15:56.029128 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-14db3641-cf48-42a7-ae47-eb137bba389f tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '.version_select at 0x7fbb45980550>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:56.043172 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-4ec77c08-3447-455c-9323-8e5ef36ad6fe req-5bf71e3f-6c97-4650-b3ad-2c1e8d59d3f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "384dc38e-62e2-44c7-a1da-28421a88b79d", "tag": "74b2149c-d46b-45ea-9160-52027217065d"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:56.078526 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4ec77c08-3447-455c-9323-8e5ef36ad6fe req-5bf71e3f-6c97-4650-b3ad-2c1e8d59d3f7 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:56.080883 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4ec77c08-3447-455c-9323-8e5ef36ad6fe req-5bf71e3f-6c97-4650-b3ad-2c1e8d59d3f7 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:56.081348 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4ec77c08-3447-455c-9323-8e5ef36ad6fe req-5bf71e3f-6c97-4650-b3ad-2c1e8d59d3f7 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:56.128096 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-4ec77c08-3447-455c-9323-8e5ef36ad6fe req-5bf71e3f-6c97-4650-b3ad-2c1e8d59d3f7 service nova] Creating event network-changed:74b2149c-d46b-45ea-9160-52027217065d for instance 384dc38e-62e2-44c7-a1da-28421a88b79d on n-h1-833090-16 Aug 31 16:15:56.134258 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-4ec77c08-3447-455c-9323-8e5ef36ad6fe req-5bf71e3f-6c97-4650-b3ad-2c1e8d59d3f7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099014 Aug 31 16:15:56.135527 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2407/5005] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:15:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:56.214117 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-34647bdd-406d-4542-9d77-265cfae77f79 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1624579101", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "02889e0f-3e5a-402e-b29c-c228cddb1854", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "1c4c22f6-ea49-4e46-87c2-7de60e095fb8"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:56.361007 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-34647bdd-406d-4542-9d77-265cfae77f79 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] HTTP exception thrown: Block Device 02889e0f-3e5a-402e-b29c-c228cddb1854 is not bootable. Aug 31 16:15:56.370493 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-34647bdd-406d-4542-9d77-265cfae77f79 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Request method failure captured: Aug 31 16:15:56.370493 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 31 16:15:56.370493 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:15:56.370493 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:15:56.370493 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:15:56.370493 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 358 Aug 31 16:15:56.370493 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:15:56.370493 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:15:56.370493 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:15:56.370493 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:15:56.370493 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4kQ0XzwgZzM00K2xfqw4sNWznetRNwtM61dwPFzPgxHVwt6ZQqeyy0IDwJXT8yOdP4-2pSJFf0sLdbRTKSty95v4MPjLoaaRhSqpDob3UUxppJFVkB8ZQH-IsYhc50JLxuO54hEVWRh4jtxjaTwZZjw98G6FCIkizac62ua4tSQ6_s Aug 31 16:15:56.370493 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:15:56.370493 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:15:56.370493 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:15:56.370493 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:15:56.370493 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:15:56.370493 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:15:56.370493 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:15:56.370493 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:15:56.370493 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:15:56.370493 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:15:56.370493 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3e843f3122c14cf8889f26423552792f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3e843f3122c14cf8889f26423552792f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:15:56.370493 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:15:56.370493 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:15:56.370493 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:15:56.370493 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:15:56.370493 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:15:56.370493 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:15:56.370493 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 8b67be53aade4f8c92d6765dd91a4b90 Aug 31 16:15:56.370493 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:15:56.370493 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 16:15:56.370493 n-d-833090-16 devstack@n-api.service[128863]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1624579101", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "02889e0f-3e5a-402e-b29c-c228cddb1854", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "1c4c22f6-ea49-4e46-87c2-7de60e095fb8"}]}} Aug 31 16:15:56.370493 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:15:56.370493 n-d-833090-16 devstack@n-api.service[128863]: exception: Block Device 02889e0f-3e5a-402e-b29c-c228cddb1854 is not bootable. Aug 31 16:15:56.370493 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1624579101', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '02889e0f-3e5a-402e-b29c-c228cddb1854'}], 'networks': [{'uuid': '1c4c22f6-ea49-4e46-87c2-7de60e095fb8'}]}}} Aug 31 16:15:56.370493 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:15:56.370493 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:56.370493 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 31 16:15:56.370493 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 31 16:15:56.370493 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 31 16:15:56.370493 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 31 16:15:56.370493 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Aug 31 16:15:56.370493 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Aug 31 16:15:56.370493 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Aug 31 16:15:56.370493 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Aug 31 16:15:56.370493 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 02889e0f-3e5a-402e-b29c-c228cddb1854 is not bootable. Aug 31 16:15:56.370493 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:15:56.370493 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:56.370493 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:15:56.370493 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:56.370493 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:56.370493 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:56.370493 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:15:56.370493 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:15:56.370493 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:15:56.370493 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:15:56.370493 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:15:56.370493 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:15:56.370493 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:15:56.377230 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:15:56.377230 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:15:56.377230 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:15:56.377230 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 31 16:15:56.377230 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 31 16:15:56.377230 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 31 16:15:56.377230 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 02889e0f-3e5a-402e-b29c-c228cddb1854 is not bootable. Aug 31 16:15:56.377230 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:15:56.377230 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:56.377230 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:15:56.377230 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:56.377230 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:56.377230 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:56.377230 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:15:56.377230 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:15:56.377230 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 02889e0f-3e5a-402e-b29c-c228cddb1854 is not bootable. Aug 31 16:15:56.377230 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:15:56.377230 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-34647bdd-406d-4542-9d77-265cfae77f79 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Returning 400 to user: Block Device 02889e0f-3e5a-402e-b29c-c228cddb1854 is not bootable. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:15:56.377230 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-34647bdd-406d-4542-9d77-265cfae77f79 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.165827 Aug 31 16:15:56.377230 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2408/5006] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:15:56 2022] POST /compute/v2.1/servers => generated 110 bytes in 169 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:15:56.386884 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-41f65c4b-aa23-47d2-b8b9-c76876493f72 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:56.388804 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-41f65c4b-aa23-47d2-b8b9-c76876493f72 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:56.405749 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-41f65c4b-aa23-47d2-b8b9-c76876493f72 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:56.406314 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-41f65c4b-aa23-47d2-b8b9-c76876493f72 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:56.406760 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-41f65c4b-aa23-47d2-b8b9-c76876493f72 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:56.407515 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-41f65c4b-aa23-47d2-b8b9-c76876493f72 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:56.407934 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-41f65c4b-aa23-47d2-b8b9-c76876493f72 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:56.420236 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-41f65c4b-aa23-47d2-b8b9-c76876493f72 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:56.484395 n-d-833090-16 devstack@n-api.service[128864]: DEBUG neutronclient.v2_0.client [None req-14db3641-cf48-42a7-ae47-eb137bba389f tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 712d2c7f-6545-4d70-81d7-8c0d07cb4b70 in use.", "detail": ""}} {{(pid=128864) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 31 16:15:56.485140 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-14db3641-cf48-42a7-ae47-eb137bba389f tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] HTTP exception thrown: Security Group 712d2c7f-6545-4d70-81d7-8c0d07cb4b70 in use. Aug 31 16:15:56.485140 n-d-833090-16 devstack@n-api.service[128864]: Neutron server returns request_ids: ['req-e9e794a5-e6d8-4e6e-8c66-f409c287769a'] Aug 31 16:15:56.489055 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-14db3641-cf48-42a7-ae47-eb137bba389f tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Request method failure captured: Aug 31 16:15:56.489055 n-d-833090-16 devstack@n-api.service[128864]: request: DELETE /compute/v2.1/os-security-groups/712d2c7f-6545-4d70-81d7-8c0d07cb4b70 HTTP/1.1 Aug 31 16:15:56.489055 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:15:56.489055 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:15:56.489055 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:15:56.489055 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:15:56.489055 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:15:56.489055 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:15:56.489055 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:15:56.489055 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:15:56.489055 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4kIFJ0zG0xeBGgG3uzrjLL9EnflnKZMdGdJ2D9YGgjKqtNDIyBPydopwRei8ZnPbXcFm3HhN-k5tWZi56omwftJZfOWCKw_Hb9N0DyCWLOGgTx7eghMjbdmJfyquGOCz4DRfEHH-TxPGulLn-DplfVM4FoftEuHQL9TOxgHDYENNcI Aug 31 16:15:56.489055 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:15:56.489055 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:15:56.489055 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:15:56.489055 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:15:56.489055 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:15:56.489055 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:15:56.489055 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 7baff3cad5c14325a5576c40fcda0580 Aug 31 16:15:56.489055 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-SecurityGroupsTestJSON-608242232 Aug 31 16:15:56.489055 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:15:56.489055 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:15:56.489055 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7baff3cad5c14325a5576c40fcda0580"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7baff3cad5c14325a5576c40fcda0580"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7baff3cad5c14325a5576c40fcda0580"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7baff3cad5c14325a5576c40fcda0580", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:15:56.489055 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-SecurityGroupsTestJSON-608242232 Aug 31 16:15:56.489055 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 7baff3cad5c14325a5576c40fcda0580 Aug 31 16:15:56.489055 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-608242232 Aug 31 16:15:56.489055 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-SecurityGroupsTestJSON-608242232-project Aug 31 16:15:56.489055 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:15:56.489055 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:15:56.489055 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: dabb1c841cde40769174e2f8a97234c0 Aug 31 16:15:56.489055 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-SecurityGroupsTestJSON-608242232-project Aug 31 16:15:56.489055 n-d-833090-16 devstack@n-api.service[128864]: method: Aug 31 16:15:56.489055 n-d-833090-16 devstack@n-api.service[128864]: exception: Security Group 712d2c7f-6545-4d70-81d7-8c0d07cb4b70 in use. Aug 31 16:15:56.489055 n-d-833090-16 devstack@n-api.service[128864]: Neutron server returns request_ids: ['req-e9e794a5-e6d8-4e6e-8c66-f409c287769a'] Aug 31 16:15:56.489055 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '712d2c7f-6545-4d70-81d7-8c0d07cb4b70'} Aug 31 16:15:56.489055 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:15:56.489055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:56.489055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 31 16:15:56.489055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 31 16:15:56.489055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:15:56.489055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:15:56.489055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 31 16:15:56.489055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 31 16:15:56.489055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:15:56.489055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:15:56.489055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 31 16:15:56.489055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 31 16:15:56.489055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:15:56.489055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:15:56.489055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 31 16:15:56.489055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 31 16:15:56.489055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:15:56.489055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:15:56.489055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 31 16:15:56.489055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 31 16:15:56.489055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:15:56.489055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:15:56.489055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 31 16:15:56.489055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 31 16:15:56.489055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 31 16:15:56.489055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 31 16:15:56.489055 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 712d2c7f-6545-4d70-81d7-8c0d07cb4b70 in use. Aug 31 16:15:56.497867 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e9e794a5-e6d8-4e6e-8c66-f409c287769a'] Aug 31 16:15:56.497867 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:15:56.497867 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:56.497867 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:15:56.497867 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:56.497867 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 31 16:15:56.497867 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 31 16:15:56.497867 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 31 16:15:56.497867 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 31 16:15:56.497867 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 712d2c7f-6545-4d70-81d7-8c0d07cb4b70 in use. Aug 31 16:15:56.497867 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e9e794a5-e6d8-4e6e-8c66-f409c287769a'] Aug 31 16:15:56.497867 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:15:56.497867 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:56.497867 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:15:56.497867 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:56.497867 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:56.497867 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:56.497867 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:15:56.497867 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:15:56.497867 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:15:56.497867 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:15:56.497867 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:15:56.497867 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:15:56.497867 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 31 16:15:56.497867 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 31 16:15:56.497867 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 712d2c7f-6545-4d70-81d7-8c0d07cb4b70 in use. Aug 31 16:15:56.497867 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e9e794a5-e6d8-4e6e-8c66-f409c287769a'] Aug 31 16:15:56.497867 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:15:56.497867 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:15:56.497867 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:15:56.497867 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:15:56.497867 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:15:56.497867 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:15:56.497867 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:15:56.497867 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:15:56.497867 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 712d2c7f-6545-4d70-81d7-8c0d07cb4b70 in use. Aug 31 16:15:56.497867 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e9e794a5-e6d8-4e6e-8c66-f409c287769a'] Aug 31 16:15:56.497867 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:15:56.497867 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-14db3641-cf48-42a7-ae47-eb137bba389f tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Returning 400 to user: Security Group 712d2c7f-6545-4d70-81d7-8c0d07cb4b70 in use. Aug 31 16:15:56.497867 n-d-833090-16 devstack@n-api.service[128864]: Neutron server returns request_ids: ['req-e9e794a5-e6d8-4e6e-8c66-f409c287769a'] {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:15:56.497867 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-14db3641-cf48-42a7-ae47-eb137bba389f tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/712d2c7f-6545-4d70-81d7-8c0d07cb4b70" status: 400 len: 185 microversion: 2.1 time: 0.468535 Aug 31 16:15:56.497867 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2599/5007] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 31 16:15:56 2022] DELETE /compute/v2.1/os-security-groups/712d2c7f-6545-4d70-81d7-8c0d07cb4b70 => generated 185 bytes in 470 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 31 16:15:56.505924 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-601fb7ff-89a8-4b58-bf7c-ae93ceb27b62 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:56.505924 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-601fb7ff-89a8-4b58-bf7c-ae93ceb27b62 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] [instance: 384dc38e-62e2-44c7-a1da-28421a88b79d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:56.525770 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-601fb7ff-89a8-4b58-bf7c-ae93ceb27b62 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:56.526444 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-601fb7ff-89a8-4b58-bf7c-ae93ceb27b62 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:56.526957 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-601fb7ff-89a8-4b58-bf7c-ae93ceb27b62 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:56.527761 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-601fb7ff-89a8-4b58-bf7c-ae93ceb27b62 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:56.528304 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-601fb7ff-89a8-4b58-bf7c-ae93ceb27b62 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:56.528798 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-601fb7ff-89a8-4b58-bf7c-ae93ceb27b62 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:56.573862 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-601fb7ff-89a8-4b58-bf7c-ae93ceb27b62 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] [instance: 384dc38e-62e2-44c7-a1da-28421a88b79d] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:15:56.721390 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-601fb7ff-89a8-4b58-bf7c-ae93ceb27b62 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "DELETE /compute/v2.1/servers/384dc38e-62e2-44c7-a1da-28421a88b79d" status: 204 len: 0 microversion: 2.1 time: 0.224599 Aug 31 16:15:56.726891 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2600/5008] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:15:56 2022] DELETE /compute/v2.1/servers/384dc38e-62e2-44c7-a1da-28421a88b79d => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:15:56.735418 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d74c7af4-db3e-4ee1-8812-64c56e760822 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:56.736621 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d74c7af4-db3e-4ee1-8812-64c56e760822 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] [instance: 384dc38e-62e2-44c7-a1da-28421a88b79d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:56.745189 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d74c7af4-db3e-4ee1-8812-64c56e760822 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:56.746145 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d74c7af4-db3e-4ee1-8812-64c56e760822 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:56.747555 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d74c7af4-db3e-4ee1-8812-64c56e760822 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:56.748569 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d74c7af4-db3e-4ee1-8812-64c56e760822 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:56.749225 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d74c7af4-db3e-4ee1-8812-64c56e760822 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:56.749914 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d74c7af4-db3e-4ee1-8812-64c56e760822 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:56.956154 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-41f65c4b-aa23-47d2-b8b9-c76876493f72 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:56.966875 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-41f65c4b-aa23-47d2-b8b9-c76876493f72 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.589644 Aug 31 16:15:56.968780 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2409/5009] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:56 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:15:56.990075 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-09e885a6-648d-4d92-8673-37e5b1e76256 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:56.990711 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-09e885a6-648d-4d92-8673-37e5b1e76256 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:56.998458 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09e885a6-648d-4d92-8673-37e5b1e76256 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:56.999219 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09e885a6-648d-4d92-8673-37e5b1e76256 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:56.999996 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09e885a6-648d-4d92-8673-37e5b1e76256 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:57.002293 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09e885a6-648d-4d92-8673-37e5b1e76256 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:57.003025 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09e885a6-648d-4d92-8673-37e5b1e76256 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:57.003621 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09e885a6-648d-4d92-8673-37e5b1e76256 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:57.155678 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d74c7af4-db3e-4ee1-8812-64c56e760822 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dabb1c841cde40769174e2f8a97234c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baff3cad5c14325a5576c40fcda0580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:57.165867 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d74c7af4-db3e-4ee1-8812-64c56e760822 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "GET /compute/v2.1/servers/384dc38e-62e2-44c7-a1da-28421a88b79d" status: 200 len: 1647 microversion: 2.1 time: 0.437079 Aug 31 16:15:57.166717 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2601/5010] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:56 2022] GET /compute/v2.1/servers/384dc38e-62e2-44c7-a1da-28421a88b79d => generated 1647 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:57.260549 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-09e885a6-648d-4d92-8673-37e5b1e76256 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:57.279521 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-09e885a6-648d-4d92-8673-37e5b1e76256 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.293610 Aug 31 16:15:57.280145 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2410/5011] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:56 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:15:57.417337 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-648e4e57-0c47-4e28-ad3a-4e1154a430cf tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:57.417996 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-648e4e57-0c47-4e28-ad3a-4e1154a430cf tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 1c40a98f-366d-4392-9034-7841f68b2050] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:57.435859 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-648e4e57-0c47-4e28-ad3a-4e1154a430cf tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:57.436330 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-648e4e57-0c47-4e28-ad3a-4e1154a430cf tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:57.436844 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-648e4e57-0c47-4e28-ad3a-4e1154a430cf tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:57.437621 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-648e4e57-0c47-4e28-ad3a-4e1154a430cf tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:57.438162 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-648e4e57-0c47-4e28-ad3a-4e1154a430cf tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:57.438948 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-648e4e57-0c47-4e28-ad3a-4e1154a430cf tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:57.563376 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-648e4e57-0c47-4e28-ad3a-4e1154a430cf tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lazy-loading 'services' on Instance uuid 1c40a98f-366d-4392-9034-7841f68b2050 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:15:57.711429 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-648e4e57-0c47-4e28-ad3a-4e1154a430cf tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "DELETE /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050/os-volume_attachments/f3a07e52-7a2a-49ce-a2f2-77f81069632b" status: 202 len: 0 microversion: 2.1 time: 0.306673 Aug 31 16:15:57.712700 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2602/5012] 10.222.0.50 () {58 vars in 1416 bytes} [Wed Aug 31 16:15:57 2022] DELETE /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050/os-volume_attachments/f3a07e52-7a2a-49ce-a2f2-77f81069632b => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 16:15:57.724033 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-25602b34-6daf-4372-a12a-3a4d299040e8 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:57.726969 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-25602b34-6daf-4372-a12a-3a4d299040e8 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 1c40a98f-366d-4392-9034-7841f68b2050] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:57.734534 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25602b34-6daf-4372-a12a-3a4d299040e8 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:57.735406 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25602b34-6daf-4372-a12a-3a4d299040e8 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:57.736092 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25602b34-6daf-4372-a12a-3a4d299040e8 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:57.737605 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25602b34-6daf-4372-a12a-3a4d299040e8 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:57.739112 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25602b34-6daf-4372-a12a-3a4d299040e8 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:57.739689 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25602b34-6daf-4372-a12a-3a4d299040e8 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:57.797690 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-25602b34-6daf-4372-a12a-3a4d299040e8 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078263 Aug 31 16:15:57.798652 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2411/5013] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:15:57 2022] GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:58.201481 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a65e8bec-296c-4eb6-a2f3-9092a6d701f9 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:58.208441 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a65e8bec-296c-4eb6-a2f3-9092a6d701f9 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] [instance: 384dc38e-62e2-44c7-a1da-28421a88b79d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:58.227132 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a65e8bec-296c-4eb6-a2f3-9092a6d701f9 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:58.227754 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a65e8bec-296c-4eb6-a2f3-9092a6d701f9 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:58.228312 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a65e8bec-296c-4eb6-a2f3-9092a6d701f9 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:58.229450 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a65e8bec-296c-4eb6-a2f3-9092a6d701f9 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:58.230064 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a65e8bec-296c-4eb6-a2f3-9092a6d701f9 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:58.230682 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a65e8bec-296c-4eb6-a2f3-9092a6d701f9 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:58.817292 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c642928d-943e-44b0-9fcd-6e7fe438a27c tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:58.820484 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c642928d-943e-44b0-9fcd-6e7fe438a27c tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 1c40a98f-366d-4392-9034-7841f68b2050] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:58.850868 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c642928d-943e-44b0-9fcd-6e7fe438a27c tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:58.852627 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c642928d-943e-44b0-9fcd-6e7fe438a27c tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:58.856208 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c642928d-943e-44b0-9fcd-6e7fe438a27c tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:58.857249 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c642928d-943e-44b0-9fcd-6e7fe438a27c tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:58.870844 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c642928d-943e-44b0-9fcd-6e7fe438a27c tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:58.871764 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c642928d-943e-44b0-9fcd-6e7fe438a27c tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:58.928091 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c642928d-943e-44b0-9fcd-6e7fe438a27c tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112343 Aug 31 16:15:58.934301 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2412/5014] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:15:58 2022] GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:59.272902 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a65e8bec-296c-4eb6-a2f3-9092a6d701f9 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dabb1c841cde40769174e2f8a97234c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baff3cad5c14325a5576c40fcda0580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:15:59.284971 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a65e8bec-296c-4eb6-a2f3-9092a6d701f9 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "GET /compute/v2.1/servers/384dc38e-62e2-44c7-a1da-28421a88b79d" status: 200 len: 1647 microversion: 2.1 time: 1.093837 Aug 31 16:15:59.299123 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2603/5015] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:15:58 2022] GET /compute/v2.1/servers/384dc38e-62e2-44c7-a1da-28421a88b79d => generated 1647 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:15:59.371543 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-68d9a244-2a31-4273-abfc-604d2ef389a9 req-fb5c5374-40aa-4696-b75b-3bc1e7fadb50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "384dc38e-62e2-44c7-a1da-28421a88b79d", "name": "network-vif-deleted", "tag": "74b2149c-d46b-45ea-9160-52027217065d"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:15:59.395074 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-68d9a244-2a31-4273-abfc-604d2ef389a9 req-fb5c5374-40aa-4696-b75b-3bc1e7fadb50 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:59.395602 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-68d9a244-2a31-4273-abfc-604d2ef389a9 req-fb5c5374-40aa-4696-b75b-3bc1e7fadb50 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:59.396075 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-68d9a244-2a31-4273-abfc-604d2ef389a9 req-fb5c5374-40aa-4696-b75b-3bc1e7fadb50 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:59.420172 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-68d9a244-2a31-4273-abfc-604d2ef389a9 req-fb5c5374-40aa-4696-b75b-3bc1e7fadb50 service nova] Creating event network-vif-deleted:74b2149c-d46b-45ea-9160-52027217065d for instance 384dc38e-62e2-44c7-a1da-28421a88b79d on n-h1-833090-16 Aug 31 16:15:59.442562 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-68d9a244-2a31-4273-abfc-604d2ef389a9 req-fb5c5374-40aa-4696-b75b-3bc1e7fadb50 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074243 Aug 31 16:15:59.445451 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2413/5016] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:15:59.941913 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ecb804dc-4d13-4c4d-b0b4-f8c38bb78695 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:15:59.944933 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ecb804dc-4d13-4c4d-b0b4-f8c38bb78695 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 1c40a98f-366d-4392-9034-7841f68b2050] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:15:59.953476 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ecb804dc-4d13-4c4d-b0b4-f8c38bb78695 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:59.954670 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ecb804dc-4d13-4c4d-b0b4-f8c38bb78695 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:59.956095 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ecb804dc-4d13-4c4d-b0b4-f8c38bb78695 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:15:59.957074 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ecb804dc-4d13-4c4d-b0b4-f8c38bb78695 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:15:59.957721 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ecb804dc-4d13-4c4d-b0b4-f8c38bb78695 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:15:59.958366 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ecb804dc-4d13-4c4d-b0b4-f8c38bb78695 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:00.030308 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ecb804dc-4d13-4c4d-b0b4-f8c38bb78695 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093066 Aug 31 16:16:00.046306 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2604/5017] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:15:59 2022] GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:16:00.075057 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8873aae7-6524-4132-a045-722ffc599771 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1352312415", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "d715a41c-0e56-494a-a102-cac65831f6bd", "destination_type": "local"}, {"source_type": "volume", "uuid": "91e88957-88e7-4fb5-bda4-8d25c91637e6", "destination_type": "invalid"}], "networks": [{"uuid": "1c4c22f6-ea49-4e46-87c2-7de60e095fb8"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:00.083609 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8873aae7-6524-4132-a045-722ffc599771 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Request method failure captured: Aug 31 16:16:00.083609 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 31 16:16:00.083609 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:16:00.083609 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:16:00.083609 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:16:00.083609 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 495 Aug 31 16:16:00.083609 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:16:00.083609 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:16:00.083609 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:16:00.083609 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:16:00.083609 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4kQ0XzwgZzM00K2xfqw4sNWznetRNwtM61dwPFzPgxHVwt6ZQqeyy0IDwJXT8yOdP4-2pSJFf0sLdbRTKSty95v4MPjLoaaRhSqpDob3UUxppJFVkB8ZQH-IsYhc50JLxuO54hEVWRh4jtxjaTwZZjw98G6FCIkizac62ua4tSQ6_s Aug 31 16:16:00.083609 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:16:00.083609 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:16:00.083609 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:16:00.083609 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:16:00.083609 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:16:00.083609 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:16:00.083609 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:16:00.083609 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:00.083609 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:16:00.083609 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:16:00.083609 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3e843f3122c14cf8889f26423552792f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3e843f3122c14cf8889f26423552792f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:16:00.083609 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:00.083609 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:16:00.083609 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:00.083609 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:16:00.083609 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:16:00.083609 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:16:00.083609 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 8b67be53aade4f8c92d6765dd91a4b90 Aug 31 16:16:00.083609 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:16:00.083609 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 16:16:00.083609 n-d-833090-16 devstack@n-api.service[128863]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1352312415", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "d715a41c-0e56-494a-a102-cac65831f6bd", "destination_type": "local"}, {"source_type": "volume", "uuid": "91e88957-88e7-4fb5-bda4-8d25c91637e6", "destination_type": "invalid"}], "networks": [{"uuid": "1c4c22f6-ea49-4e46-87c2-7de60e095fb8"}]}} Aug 31 16:16:00.083609 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:16:00.083609 n-d-833090-16 devstack@n-api.service[128863]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 31 16:16:00.083609 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1352312415', 'imageRef': 'd715a41c-0e56-494a-a102-cac65831f6bd', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'd715a41c-0e56-494a-a102-cac65831f6bd', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '91e88957-88e7-4fb5-bda4-8d25c91637e6', 'destination_type': 'invalid'}], 'networks': [{'uuid': '1c4c22f6-ea49-4e46-87c2-7de60e095fb8'}]}}} Aug 31 16:16:00.083609 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:16:00.083609 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:00.083609 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:16:00.083609 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:16:00.083609 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:16:00.083609 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:16:00.083609 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Aug 31 16:16:00.083609 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:00.083609 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Aug 31 16:16:00.083609 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Aug 31 16:16:00.083609 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:00.083609 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Aug 31 16:16:00.083609 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'invalid' Aug 31 16:16:00.083609 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:00.083609 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:00.083609 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:00.083609 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:00.083609 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:00.083609 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:00.083609 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:16:00.083609 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:16:00.083609 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:16:00.083609 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:16:00.089065 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:16:00.089065 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:16:00.089065 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 16:16:00.089065 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 16:16:00.089065 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:16:00.089065 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:16:00.089065 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:16:00.089065 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:16:00.089065 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 31 16:16:00.089065 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:00.089065 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:00.089065 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:00.089065 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:00.089065 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:00.089065 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:00.089065 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:16:00.089065 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:16:00.089065 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 31 16:16:00.089065 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:00.103003 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8873aae7-6524-4132-a045-722ffc599771 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:16:00.104350 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8873aae7-6524-4132-a045-722ffc599771 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.036560 Aug 31 16:16:00.105227 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2414/5018] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:16:00 2022] POST /compute/v2.1/servers => generated 155 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:16:00.115193 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-75e8ee15-f6b4-403c-85d5-f03c08e8c2b2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:00.115836 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-75e8ee15-f6b4-403c-85d5-f03c08e8c2b2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:00.126056 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-75e8ee15-f6b4-403c-85d5-f03c08e8c2b2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:00.126601 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-75e8ee15-f6b4-403c-85d5-f03c08e8c2b2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:00.127046 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-75e8ee15-f6b4-403c-85d5-f03c08e8c2b2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:00.128102 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-75e8ee15-f6b4-403c-85d5-f03c08e8c2b2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:00.128377 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-75e8ee15-f6b4-403c-85d5-f03c08e8c2b2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:00.128991 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-75e8ee15-f6b4-403c-85d5-f03c08e8c2b2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:00.321294 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-28d9e490-e1c2-4968-bd00-0eb867f7555d tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:00.323417 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-28d9e490-e1c2-4968-bd00-0eb867f7555d tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] [instance: 384dc38e-62e2-44c7-a1da-28421a88b79d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:00.334892 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28d9e490-e1c2-4968-bd00-0eb867f7555d tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:00.335575 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28d9e490-e1c2-4968-bd00-0eb867f7555d tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:00.336178 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28d9e490-e1c2-4968-bd00-0eb867f7555d tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:00.338184 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28d9e490-e1c2-4968-bd00-0eb867f7555d tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:00.338793 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28d9e490-e1c2-4968-bd00-0eb867f7555d tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:00.339375 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28d9e490-e1c2-4968-bd00-0eb867f7555d tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:00.367440 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-28d9e490-e1c2-4968-bd00-0eb867f7555d tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] HTTP exception thrown: Instance 384dc38e-62e2-44c7-a1da-28421a88b79d could not be found. Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-28d9e490-e1c2-4968-bd00-0eb867f7555d tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Request method failure captured: Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/384dc38e-62e2-44c7-a1da-28421a88b79d HTTP/1.1 Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4kIFJ0zG0xeBGgG3uzrjLL9EnflnKZMdGdJ2D9YGgjKqtNDIyBPydopwRei8ZnPbXcFm3HhN-k5tWZi56omwftJZfOWCKw_Hb9N0DyCWLOGgTx7eghMjbdmJfyquGOCz4DRfEHH-TxPGulLn-DplfVM4FoftEuHQL9TOxgHDYENNcI Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 7baff3cad5c14325a5576c40fcda0580 Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-SecurityGroupsTestJSON-608242232 Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7baff3cad5c14325a5576c40fcda0580"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7baff3cad5c14325a5576c40fcda0580"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7baff3cad5c14325a5576c40fcda0580"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7baff3cad5c14325a5576c40fcda0580", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-SecurityGroupsTestJSON-608242232 Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 7baff3cad5c14325a5576c40fcda0580 Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-608242232 Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-SecurityGroupsTestJSON-608242232-project Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: dabb1c841cde40769174e2f8a97234c0 Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-SecurityGroupsTestJSON-608242232-project Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 384dc38e-62e2-44c7-a1da-28421a88b79d could not be found. Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '384dc38e-62e2-44c7-a1da-28421a88b79d'} Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 384dc38e-62e2-44c7-a1da-28421a88b79d could not be found. Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 384dc38e-62e2-44c7-a1da-28421a88b79d could not be found. Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:00.369312 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:00.375047 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:00.375047 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:00.375047 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:00.375047 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:16:00.375047 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:16:00.375047 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 384dc38e-62e2-44c7-a1da-28421a88b79d could not be found. Aug 31 16:16:00.375047 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:00.376429 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-28d9e490-e1c2-4968-bd00-0eb867f7555d tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Returning 404 to user: Instance 384dc38e-62e2-44c7-a1da-28421a88b79d could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:16:00.377662 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-28d9e490-e1c2-4968-bd00-0eb867f7555d tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "GET /compute/v2.1/servers/384dc38e-62e2-44c7-a1da-28421a88b79d" status: 404 len: 111 microversion: 2.1 time: 0.064390 Aug 31 16:16:00.378588 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2415/5019] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:00 2022] GET /compute/v2.1/servers/384dc38e-62e2-44c7-a1da-28421a88b79d => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:16:00.389766 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-59b31d44-3f2b-4a59-9186-e4348a7ac4ad tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '.version_select at 0x7fbb4aac5e50>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:00.644581 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-75e8ee15-f6b4-403c-85d5-f03c08e8c2b2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:00.663660 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-75e8ee15-f6b4-403c-85d5-f03c08e8c2b2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.552996 Aug 31 16:16:00.668317 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2605/5020] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:00 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:00.700329 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0a9a8b85-0047-4b82-9ddd-387f75e583fe tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:00.702865 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0a9a8b85-0047-4b82-9ddd-387f75e583fe tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:00.714560 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0a9a8b85-0047-4b82-9ddd-387f75e583fe tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:00.720320 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0a9a8b85-0047-4b82-9ddd-387f75e583fe tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:00.723422 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0a9a8b85-0047-4b82-9ddd-387f75e583fe tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:00.725689 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0a9a8b85-0047-4b82-9ddd-387f75e583fe tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:00.726976 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0a9a8b85-0047-4b82-9ddd-387f75e583fe tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:00.729236 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0a9a8b85-0047-4b82-9ddd-387f75e583fe tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:00.919074 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-59b31d44-3f2b-4a59-9186-e4348a7ac4ad tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/a76b48a7-3332-4a36-b269-6e0c52d879e5" status: 202 len: 0 microversion: 2.1 time: 0.535794 Aug 31 16:16:00.920333 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2416/5021] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 31 16:16:00 2022] DELETE /compute/v2.1/os-security-groups/a76b48a7-3332-4a36-b269-6e0c52d879e5 => generated 0 bytes in 538 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 16:16:00.931065 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d99c06f0-3694-4224-a4d8-ff1701102151 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '.version_select at 0x7fbb459a5430>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:01.025742 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0a9a8b85-0047-4b82-9ddd-387f75e583fe tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:01.041312 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0a9a8b85-0047-4b82-9ddd-387f75e583fe tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.347995 Aug 31 16:16:01.042244 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2606/5022] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:00 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:01.047738 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-94a18e5f-8fb3-4bc0-9a66-55e88d09bee3 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:01.060216 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-94a18e5f-8fb3-4bc0-9a66-55e88d09bee3 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 1c40a98f-366d-4392-9034-7841f68b2050] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:01.073099 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-94a18e5f-8fb3-4bc0-9a66-55e88d09bee3 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:01.073597 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-94a18e5f-8fb3-4bc0-9a66-55e88d09bee3 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:01.074039 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-94a18e5f-8fb3-4bc0-9a66-55e88d09bee3 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:01.074783 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-94a18e5f-8fb3-4bc0-9a66-55e88d09bee3 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:01.075239 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-94a18e5f-8fb3-4bc0-9a66-55e88d09bee3 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:01.075664 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-94a18e5f-8fb3-4bc0-9a66-55e88d09bee3 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:01.136531 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-94a18e5f-8fb3-4bc0-9a66-55e88d09bee3 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092959 Aug 31 16:16:01.137137 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2607/5023] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:16:01 2022] GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:16:01.270198 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ccc2d918-8d56-41f8-8857-6b6c9c16378e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-730463818", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "1c4c22f6-ea49-4e46-87c2-7de60e095fb8"}]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:01.278475 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ccc2d918-8d56-41f8-8857-6b6c9c16378e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Request method failure captured: Aug 31 16:16:01.278475 n-d-833090-16 devstack@n-api.service[128864]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 31 16:16:01.278475 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:16:01.278475 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:16:01.278475 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:16:01.278475 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 491 Aug 31 16:16:01.278475 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:16:01.278475 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:16:01.278475 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:16:01.278475 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:16:01.278475 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4kQ0XzwgZzM00K2xfqw4sNWznetRNwtM61dwPFzPgxHVwt6ZQqeyy0IDwJXT8yOdP4-2pSJFf0sLdbRTKSty95v4MPjLoaaRhSqpDob3UUxppJFVkB8ZQH-IsYhc50JLxuO54hEVWRh4jtxjaTwZZjw98G6FCIkizac62ua4tSQ6_s Aug 31 16:16:01.278475 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:16:01.278475 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:16:01.278475 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:16:01.278475 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:16:01.278475 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:16:01.278475 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:16:01.278475 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:16:01.278475 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:01.278475 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:16:01.278475 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:16:01.278475 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3e843f3122c14cf8889f26423552792f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3e843f3122c14cf8889f26423552792f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:16:01.278475 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:01.278475 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:16:01.278475 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:01.278475 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:16:01.278475 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:16:01.278475 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:16:01.278475 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 8b67be53aade4f8c92d6765dd91a4b90 Aug 31 16:16:01.278475 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:16:01.278475 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 16:16:01.278475 n-d-833090-16 devstack@n-api.service[128864]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-730463818", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "1c4c22f6-ea49-4e46-87c2-7de60e095fb8"}]}} Aug 31 16:16:01.278475 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:16:01.278475 n-d-833090-16 devstack@n-api.service[128864]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 31 16:16:01.278475 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-730463818', 'imageRef': 'd715a41c-0e56-494a-a102-cac65831f6bd', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '1c4c22f6-ea49-4e46-87c2-7de60e095fb8'}]}}} Aug 31 16:16:01.278475 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:16:01.278475 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:01.278475 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:16:01.278475 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:16:01.278475 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:16:01.278475 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:16:01.278475 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 31 16:16:01.278475 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:01.278475 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Aug 31 16:16:01.278475 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Aug 31 16:16:01.278475 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:01.278475 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Aug 31 16:16:01.282040 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Aug 31 16:16:01.282040 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:01.282040 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:01.282040 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:01.282040 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:01.282040 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:01.282040 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:01.282040 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:16:01.282040 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:16:01.282040 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:16:01.282040 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:16:01.282040 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:16:01.282040 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:16:01.282040 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 16:16:01.282040 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 16:16:01.282040 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:16:01.282040 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:16:01.282040 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:16:01.282040 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:16:01.282040 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 31 16:16:01.282040 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:01.282040 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:01.282040 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:01.282040 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:01.282040 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:01.282040 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:01.282040 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:16:01.282040 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:16:01.282040 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 31 16:16:01.282040 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:01.286408 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ccc2d918-8d56-41f8-8857-6b6c9c16378e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:16:01.289429 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ccc2d918-8d56-41f8-8857-6b6c9c16378e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.026425 Aug 31 16:16:01.292366 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2608/5024] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:16:01 2022] POST /compute/v2.1/servers => generated 624 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 31 16:16:01.302848 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8b67b0fb-5a16-4a27-af0b-e1592ad57f23 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:01.303531 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8b67b0fb-5a16-4a27-af0b-e1592ad57f23 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:01.309157 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d99c06f0-3694-4224-a4d8-ff1701102151 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/712d2c7f-6545-4d70-81d7-8c0d07cb4b70" status: 202 len: 0 microversion: 2.1 time: 0.382546 Aug 31 16:16:01.309774 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2417/5025] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 31 16:16:00 2022] DELETE /compute/v2.1/os-security-groups/712d2c7f-6545-4d70-81d7-8c0d07cb4b70 => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:16:01.325474 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-71e1572a-ae18-437d-a0b8-4096448ea206 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Action: 'create', calling method: .version_select at 0x7fbb4594b430>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-916619084", "description": "tempest-description-1820687844"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:01.346486 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b67b0fb-5a16-4a27-af0b-e1592ad57f23 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:01.348318 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b67b0fb-5a16-4a27-af0b-e1592ad57f23 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:01.352721 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b67b0fb-5a16-4a27-af0b-e1592ad57f23 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:01.353710 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b67b0fb-5a16-4a27-af0b-e1592ad57f23 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:01.355117 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b67b0fb-5a16-4a27-af0b-e1592ad57f23 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:01.356555 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b67b0fb-5a16-4a27-af0b-e1592ad57f23 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:01.723101 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-71e1572a-ae18-437d-a0b8-4096448ea206 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.403767 Aug 31 16:16:01.724018 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2418/5026] 10.222.0.50 () {60 vars in 1180 bytes} [Wed Aug 31 16:16:01 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:16:01.739082 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3ae00b0a-e582-4eed-be2b-ca11b0c9aa12 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Action: 'update', calling method: .version_select at 0x7fbb4594b8b0>, body: {"security_group": {"name": "tempest-sg-hth-1996274141", "description": "tempest-description-hth-515334311"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:01.851942 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8b67b0fb-5a16-4a27-af0b-e1592ad57f23 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:01.869347 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8b67b0fb-5a16-4a27-af0b-e1592ad57f23 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.572839 Aug 31 16:16:01.870435 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2609/5027] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:01 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:01.895888 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f0ac7220-4413-4001-8552-b6c52c69c613 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:01.896820 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f0ac7220-4413-4001-8552-b6c52c69c613 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:01.906497 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f0ac7220-4413-4001-8552-b6c52c69c613 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:01.907353 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f0ac7220-4413-4001-8552-b6c52c69c613 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:01.908136 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f0ac7220-4413-4001-8552-b6c52c69c613 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:01.910051 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f0ac7220-4413-4001-8552-b6c52c69c613 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:01.910863 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f0ac7220-4413-4001-8552-b6c52c69c613 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:01.911610 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f0ac7220-4413-4001-8552-b6c52c69c613 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:02.066458 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3ae00b0a-e582-4eed-be2b-ca11b0c9aa12 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "PUT /compute/v2.1/os-security-groups/f1a7917a-4bcc-4629-a20f-c6f40747ef82" status: 200 len: 217 microversion: 2.1 time: 0.333242 Aug 31 16:16:02.067066 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2419/5028] 10.222.0.50 () {60 vars in 1290 bytes} [Wed Aug 31 16:16:01 2022] PUT /compute/v2.1/os-security-groups/f1a7917a-4bcc-4629-a20f-c6f40747ef82 => generated 217 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:16:02.084375 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-85c736fe-584b-4cf5-9c3c-cdebea3c4dab tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '.version_select at 0x7fbb4594b3a0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:02.219119 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f0ac7220-4413-4001-8552-b6c52c69c613 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:02.233426 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f0ac7220-4413-4001-8552-b6c52c69c613 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.342151 Aug 31 16:16:02.234065 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2610/5029] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:01 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:16:02.238539 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-85c736fe-584b-4cf5-9c3c-cdebea3c4dab tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups/f1a7917a-4bcc-4629-a20f-c6f40747ef82" status: 200 len: 217 microversion: 2.1 time: 0.160167 Aug 31 16:16:02.239974 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2420/5030] 10.222.0.50 () {58 vars in 1269 bytes} [Wed Aug 31 16:16:02 2022] GET /compute/v2.1/os-security-groups/f1a7917a-4bcc-4629-a20f-c6f40747ef82 => generated 217 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:16:02.263337 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d597c492-4697-4fd0-914b-8056d75418b1 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '.version_select at 0x7fbb459a5160>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:02.265175 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-297376e6-f249-4ff2-9f44-680b07eadda0 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:02.268558 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-297376e6-f249-4ff2-9f44-680b07eadda0 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 1c40a98f-366d-4392-9034-7841f68b2050] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:02.275479 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-297376e6-f249-4ff2-9f44-680b07eadda0 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:02.276283 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-297376e6-f249-4ff2-9f44-680b07eadda0 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:02.276961 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-297376e6-f249-4ff2-9f44-680b07eadda0 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:02.277869 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-297376e6-f249-4ff2-9f44-680b07eadda0 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:02.278572 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-297376e6-f249-4ff2-9f44-680b07eadda0 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:02.279175 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-297376e6-f249-4ff2-9f44-680b07eadda0 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:02.336637 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-297376e6-f249-4ff2-9f44-680b07eadda0 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085072 Aug 31 16:16:02.337558 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2611/5031] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:16:02 2022] GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:16:02.523830 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a00f5ed2-1923-4181-b4e8-966b9b65108e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "1c4c22f6-ea49-4e46-87c2-7de60e095fb8"}]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:02.528172 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a00f5ed2-1923-4181-b4e8-966b9b65108e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Request method failure captured: Aug 31 16:16:02.528172 n-d-833090-16 devstack@n-api.service[128864]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 31 16:16:02.528172 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:16:02.528172 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:16:02.528172 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:16:02.528172 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 416 Aug 31 16:16:02.528172 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:16:02.528172 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:16:02.528172 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:16:02.528172 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:16:02.528172 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4kQ0XzwgZzM00K2xfqw4sNWznetRNwtM61dwPFzPgxHVwt6ZQqeyy0IDwJXT8yOdP4-2pSJFf0sLdbRTKSty95v4MPjLoaaRhSqpDob3UUxppJFVkB8ZQH-IsYhc50JLxuO54hEVWRh4jtxjaTwZZjw98G6FCIkizac62ua4tSQ6_s Aug 31 16:16:02.528172 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:16:02.528172 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:16:02.528172 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:16:02.528172 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:16:02.528172 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:16:02.528172 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:16:02.528172 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:16:02.528172 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:02.528172 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:16:02.528172 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:16:02.528172 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3e843f3122c14cf8889f26423552792f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3e843f3122c14cf8889f26423552792f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:16:02.528172 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:02.528172 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:16:02.528172 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:02.528172 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:16:02.528172 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:16:02.528172 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:16:02.528172 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 8b67be53aade4f8c92d6765dd91a4b90 Aug 31 16:16:02.528172 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:16:02.528172 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 16:16:02.528172 n-d-833090-16 devstack@n-api.service[128864]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "1c4c22f6-ea49-4e46-87c2-7de60e095fb8"}]}} Aug 31 16:16:02.528172 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:16:02.528172 n-d-833090-16 devstack@n-api.service[128864]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 31 16:16:02.528172 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'd715a41c-0e56-494a-a102-cac65831f6bd', 'flavorRef': '452', 'networks': [{'uuid': '1c4c22f6-ea49-4e46-87c2-7de60e095fb8'}]}}} Aug 31 16:16:02.528172 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:16:02.528172 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:02.528172 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:16:02.528172 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:16:02.528172 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:16:02.528172 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:16:02.528172 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 31 16:16:02.528172 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:02.528172 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 31 16:16:02.528172 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 31 16:16:02.528172 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:02.528172 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 31 16:16:02.528172 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 31 16:16:02.528172 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:02.528172 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:02.532642 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:02.532642 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:02.532642 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:02.532642 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:02.532642 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:16:02.532642 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:16:02.532642 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:16:02.532642 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:16:02.532642 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:16:02.532642 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:16:02.532642 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 16:16:02.532642 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 16:16:02.532642 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:16:02.532642 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:16:02.532642 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:16:02.532642 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:16:02.532642 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 31 16:16:02.532642 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:02.532642 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:02.532642 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:02.532642 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:02.532642 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:02.532642 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:02.532642 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:16:02.532642 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:16:02.532642 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 31 16:16:02.532642 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:02.536769 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a00f5ed2-1923-4181-b4e8-966b9b65108e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:16:02.538866 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a00f5ed2-1923-4181-b4e8-966b9b65108e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.020201 Aug 31 16:16:02.543922 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2612/5032] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:16:02 2022] POST /compute/v2.1/servers => generated 619 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:16:02.550829 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-96d4eb04-6f3e-4a20-9c8c-d08d814b3685 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:02.550829 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-96d4eb04-6f3e-4a20-9c8c-d08d814b3685 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:02.557781 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-96d4eb04-6f3e-4a20-9c8c-d08d814b3685 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:02.559139 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-96d4eb04-6f3e-4a20-9c8c-d08d814b3685 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:02.559815 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-96d4eb04-6f3e-4a20-9c8c-d08d814b3685 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:02.560755 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-96d4eb04-6f3e-4a20-9c8c-d08d814b3685 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:02.561431 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-96d4eb04-6f3e-4a20-9c8c-d08d814b3685 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:02.562166 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-96d4eb04-6f3e-4a20-9c8c-d08d814b3685 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:02.636431 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d597c492-4697-4fd0-914b-8056d75418b1 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/f1a7917a-4bcc-4629-a20f-c6f40747ef82" status: 202 len: 0 microversion: 2.1 time: 0.384224 Aug 31 16:16:02.637032 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2421/5033] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 31 16:16:02 2022] DELETE /compute/v2.1/os-security-groups/f1a7917a-4bcc-4629-a20f-c6f40747ef82 => generated 0 bytes in 386 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:16:02.652291 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-04790e9e-740a-4c08-8925-ccf135f97d74 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:02.653194 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-04790e9e-740a-4c08-8925-ccf135f97d74 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] [instance: 384dc38e-62e2-44c7-a1da-28421a88b79d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:02.662739 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:16:02.665466 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04790e9e-740a-4c08-8925-ccf135f97d74 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:02.666201 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04790e9e-740a-4c08-8925-ccf135f97d74 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:02.666823 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04790e9e-740a-4c08-8925-ccf135f97d74 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:02.668132 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04790e9e-740a-4c08-8925-ccf135f97d74 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:02.668950 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04790e9e-740a-4c08-8925-ccf135f97d74 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:02.669791 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04790e9e-740a-4c08-8925-ccf135f97d74 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:02.713285 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-04790e9e-740a-4c08-8925-ccf135f97d74 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] HTTP exception thrown: Instance 384dc38e-62e2-44c7-a1da-28421a88b79d could not be found. Aug 31 16:16:02.716078 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-04790e9e-740a-4c08-8925-ccf135f97d74 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Request method failure captured: Aug 31 16:16:02.716078 n-d-833090-16 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/384dc38e-62e2-44c7-a1da-28421a88b79d HTTP/1.1 Aug 31 16:16:02.716078 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:16:02.716078 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:16:02.716078 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:16:02.716078 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:16:02.716078 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:16:02.716078 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:16:02.716078 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:16:02.716078 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:16:02.716078 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4kIFJ0zG0xeBGgG3uzrjLL9EnflnKZMdGdJ2D9YGgjKqtNDIyBPydopwRei8ZnPbXcFm3HhN-k5tWZi56omwftJZfOWCKw_Hb9N0DyCWLOGgTx7eghMjbdmJfyquGOCz4DRfEHH-TxPGulLn-DplfVM4FoftEuHQL9TOxgHDYENNcI Aug 31 16:16:02.716078 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:16:02.716078 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:16:02.716078 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:16:02.716078 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:16:02.716078 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:16:02.716078 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:16:02.716078 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 7baff3cad5c14325a5576c40fcda0580 Aug 31 16:16:02.716078 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-SecurityGroupsTestJSON-608242232 Aug 31 16:16:02.716078 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:16:02.716078 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:16:02.716078 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7baff3cad5c14325a5576c40fcda0580"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7baff3cad5c14325a5576c40fcda0580"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7baff3cad5c14325a5576c40fcda0580"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7baff3cad5c14325a5576c40fcda0580", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:16:02.716078 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-SecurityGroupsTestJSON-608242232 Aug 31 16:16:02.716078 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 7baff3cad5c14325a5576c40fcda0580 Aug 31 16:16:02.716078 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-608242232 Aug 31 16:16:02.716078 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-SecurityGroupsTestJSON-608242232-project Aug 31 16:16:02.716078 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:16:02.716078 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:16:02.716078 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: dabb1c841cde40769174e2f8a97234c0 Aug 31 16:16:02.716078 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-SecurityGroupsTestJSON-608242232-project Aug 31 16:16:02.716078 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:16:02.716078 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 384dc38e-62e2-44c7-a1da-28421a88b79d could not be found. Aug 31 16:16:02.716078 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '384dc38e-62e2-44c7-a1da-28421a88b79d'} Aug 31 16:16:02.716078 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:16:02.716078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:02.716078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:16:02.716078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:16:02.716078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:16:02.716078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:16:02.716078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:16:02.716078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:16:02.716078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:16:02.716078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:16:02.716078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 384dc38e-62e2-44c7-a1da-28421a88b79d could not be found. Aug 31 16:16:02.716078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:02.716078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:02.716078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:02.716078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:02.716078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:02.716078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:02.716078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:16:02.716078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:16:02.716078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:16:02.716078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:16:02.716078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:16:02.716078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:16:02.716078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:16:02.716078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:16:02.716078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:16:02.716078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:16:02.716078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:16:02.716078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:16:02.720694 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 384dc38e-62e2-44c7-a1da-28421a88b79d could not be found. Aug 31 16:16:02.720694 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:02.720694 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:02.720694 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:02.720694 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:02.720694 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:02.720694 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:02.720694 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:16:02.720694 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:16:02.720694 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 384dc38e-62e2-44c7-a1da-28421a88b79d could not be found. Aug 31 16:16:02.720694 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:02.724143 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-04790e9e-740a-4c08-8925-ccf135f97d74 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Returning 404 to user: Instance 384dc38e-62e2-44c7-a1da-28421a88b79d could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:16:02.725773 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-04790e9e-740a-4c08-8925-ccf135f97d74 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "DELETE /compute/v2.1/servers/384dc38e-62e2-44c7-a1da-28421a88b79d" status: 404 len: 111 microversion: 2.1 time: 0.082309 Aug 31 16:16:02.726994 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2422/5034] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:16:02 2022] DELETE /compute/v2.1/servers/384dc38e-62e2-44c7-a1da-28421a88b79d => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:16:02.743324 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a98b8c1f-1b3d-4f2b-8549-83aa6fbed2f7 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:02.744354 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a98b8c1f-1b3d-4f2b-8549-83aa6fbed2f7 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] [instance: 384dc38e-62e2-44c7-a1da-28421a88b79d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:02.753525 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a98b8c1f-1b3d-4f2b-8549-83aa6fbed2f7 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:02.754476 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a98b8c1f-1b3d-4f2b-8549-83aa6fbed2f7 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:02.755214 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a98b8c1f-1b3d-4f2b-8549-83aa6fbed2f7 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:02.757358 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a98b8c1f-1b3d-4f2b-8549-83aa6fbed2f7 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:02.758217 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a98b8c1f-1b3d-4f2b-8549-83aa6fbed2f7 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:02.759582 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a98b8c1f-1b3d-4f2b-8549-83aa6fbed2f7 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:02.765261 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:16:02.779855 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-a98b8c1f-1b3d-4f2b-8549-83aa6fbed2f7 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] HTTP exception thrown: Instance 384dc38e-62e2-44c7-a1da-28421a88b79d could not be found. Aug 31 16:16:02.785007 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-96d4eb04-6f3e-4a20-9c8c-d08d814b3685 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a98b8c1f-1b3d-4f2b-8549-83aa6fbed2f7 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Request method failure captured: Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/384dc38e-62e2-44c7-a1da-28421a88b79d HTTP/1.1 Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4kIFJ0zG0xeBGgG3uzrjLL9EnflnKZMdGdJ2D9YGgjKqtNDIyBPydopwRei8ZnPbXcFm3HhN-k5tWZi56omwftJZfOWCKw_Hb9N0DyCWLOGgTx7eghMjbdmJfyquGOCz4DRfEHH-TxPGulLn-DplfVM4FoftEuHQL9TOxgHDYENNcI Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 7baff3cad5c14325a5576c40fcda0580 Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-SecurityGroupsTestJSON-608242232 Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7baff3cad5c14325a5576c40fcda0580"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7baff3cad5c14325a5576c40fcda0580"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7baff3cad5c14325a5576c40fcda0580"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7baff3cad5c14325a5576c40fcda0580", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-SecurityGroupsTestJSON-608242232 Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 7baff3cad5c14325a5576c40fcda0580 Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-608242232 Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-SecurityGroupsTestJSON-608242232-project Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: dabb1c841cde40769174e2f8a97234c0 Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-SecurityGroupsTestJSON-608242232-project Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 384dc38e-62e2-44c7-a1da-28421a88b79d could not be found. Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '384dc38e-62e2-44c7-a1da-28421a88b79d'} Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 384dc38e-62e2-44c7-a1da-28421a88b79d could not be found. Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 384dc38e-62e2-44c7-a1da-28421a88b79d could not be found. Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:02.786577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:02.792378 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:02.792378 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:02.792378 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:02.792378 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:16:02.792378 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:16:02.792378 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 384dc38e-62e2-44c7-a1da-28421a88b79d could not be found. Aug 31 16:16:02.792378 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:02.799526 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a98b8c1f-1b3d-4f2b-8549-83aa6fbed2f7 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Returning 404 to user: Instance 384dc38e-62e2-44c7-a1da-28421a88b79d could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:16:02.799729 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-96d4eb04-6f3e-4a20-9c8c-d08d814b3685 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.254289 Aug 31 16:16:02.801317 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a98b8c1f-1b3d-4f2b-8549-83aa6fbed2f7 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "GET /compute/v2.1/servers/384dc38e-62e2-44c7-a1da-28421a88b79d" status: 404 len: 111 microversion: 2.1 time: 0.064333 Aug 31 16:16:02.806776 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2423/5035] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:02 2022] GET /compute/v2.1/servers/384dc38e-62e2-44c7-a1da-28421a88b79d => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:16:02.813792 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-78e0cb93-75f3-4a99-bb48-0fea6ce34692 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '.version_select at 0x7fbb4594baf0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:02.814280 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2613/5036] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:02 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:02.824496 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2dc9d406-ecc5-4731-bf95-44b206c91d9c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:02.825281 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2dc9d406-ecc5-4731-bf95-44b206c91d9c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:02.832228 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2dc9d406-ecc5-4731-bf95-44b206c91d9c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:02.833343 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2dc9d406-ecc5-4731-bf95-44b206c91d9c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:02.834017 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2dc9d406-ecc5-4731-bf95-44b206c91d9c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:02.835090 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2dc9d406-ecc5-4731-bf95-44b206c91d9c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:02.835950 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2dc9d406-ecc5-4731-bf95-44b206c91d9c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:02.836632 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2dc9d406-ecc5-4731-bf95-44b206c91d9c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:02.856108 n-d-833090-16 devstack@n-api.service[128863]: DEBUG neutronclient.v2_0.client [None req-78e0cb93-75f3-4a99-bb48-0fea6ce34692 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 712d2c7f-6545-4d70-81d7-8c0d07cb4b70 does not exist", "detail": ""}} {{(pid=128863) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 31 16:16:02.856710 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.security_group_api [None req-78e0cb93-75f3-4a99-bb48-0fea6ce34692 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Neutron security group 712d2c7f-6545-4d70-81d7-8c0d07cb4b70 not found {{(pid=128863) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 31 16:16:02.857853 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-78e0cb93-75f3-4a99-bb48-0fea6ce34692 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] HTTP exception thrown: Security group 712d2c7f-6545-4d70-81d7-8c0d07cb4b70 does not exist Aug 31 16:16:02.857853 n-d-833090-16 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-26c640bc-c07d-4264-8d86-7da8b96f6f0a'] Aug 31 16:16:02.860414 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-78e0cb93-75f3-4a99-bb48-0fea6ce34692 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Request method failure captured: Aug 31 16:16:02.860414 n-d-833090-16 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/os-security-groups/712d2c7f-6545-4d70-81d7-8c0d07cb4b70 HTTP/1.1 Aug 31 16:16:02.860414 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:16:02.860414 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:16:02.860414 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:16:02.860414 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:16:02.860414 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:16:02.860414 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:16:02.860414 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:16:02.860414 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:16:02.860414 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4kIFJ0zG0xeBGgG3uzrjLL9EnflnKZMdGdJ2D9YGgjKqtNDIyBPydopwRei8ZnPbXcFm3HhN-k5tWZi56omwftJZfOWCKw_Hb9N0DyCWLOGgTx7eghMjbdmJfyquGOCz4DRfEHH-TxPGulLn-DplfVM4FoftEuHQL9TOxgHDYENNcI Aug 31 16:16:02.860414 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:16:02.860414 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:16:02.860414 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:16:02.860414 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:16:02.860414 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:16:02.860414 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:16:02.860414 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 7baff3cad5c14325a5576c40fcda0580 Aug 31 16:16:02.860414 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-SecurityGroupsTestJSON-608242232 Aug 31 16:16:02.860414 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:16:02.860414 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:16:02.860414 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7baff3cad5c14325a5576c40fcda0580"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7baff3cad5c14325a5576c40fcda0580"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7baff3cad5c14325a5576c40fcda0580"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7baff3cad5c14325a5576c40fcda0580", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:16:02.860414 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-SecurityGroupsTestJSON-608242232 Aug 31 16:16:02.860414 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 7baff3cad5c14325a5576c40fcda0580 Aug 31 16:16:02.860414 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-608242232 Aug 31 16:16:02.860414 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-SecurityGroupsTestJSON-608242232-project Aug 31 16:16:02.860414 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:16:02.860414 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:16:02.860414 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: dabb1c841cde40769174e2f8a97234c0 Aug 31 16:16:02.860414 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-SecurityGroupsTestJSON-608242232-project Aug 31 16:16:02.860414 n-d-833090-16 devstack@n-api.service[128863]: method: Aug 31 16:16:02.860414 n-d-833090-16 devstack@n-api.service[128863]: exception: Security group 712d2c7f-6545-4d70-81d7-8c0d07cb4b70 does not exist Aug 31 16:16:02.860414 n-d-833090-16 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-26c640bc-c07d-4264-8d86-7da8b96f6f0a'] Aug 31 16:16:02.860414 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '712d2c7f-6545-4d70-81d7-8c0d07cb4b70'} Aug 31 16:16:02.860414 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:16:02.860414 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:02.860414 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 31 16:16:02.860414 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 31 16:16:02.860414 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:16:02.860414 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:16:02.860414 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 31 16:16:02.860414 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 31 16:16:02.860414 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:16:02.860414 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:16:02.860414 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 31 16:16:02.860414 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 31 16:16:02.860414 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:16:02.860414 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:16:02.860414 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 31 16:16:02.860414 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 31 16:16:02.860414 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:16:02.860414 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:16:02.860414 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 31 16:16:02.860414 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 31 16:16:02.860414 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:16:02.860414 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:16:02.860414 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 31 16:16:02.860414 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 31 16:16:02.860414 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 31 16:16:02.860414 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 31 16:16:02.860414 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 712d2c7f-6545-4d70-81d7-8c0d07cb4b70 does not exist Aug 31 16:16:02.866301 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-26c640bc-c07d-4264-8d86-7da8b96f6f0a'] Aug 31 16:16:02.866301 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:02.866301 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:02.866301 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:02.866301 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:02.866301 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 31 16:16:02.866301 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 31 16:16:02.866301 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 31 16:16:02.866301 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 31 16:16:02.866301 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 712d2c7f-6545-4d70-81d7-8c0d07cb4b70 does not exist Aug 31 16:16:02.866301 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-26c640bc-c07d-4264-8d86-7da8b96f6f0a'] Aug 31 16:16:02.866301 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:02.866301 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:02.866301 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:02.866301 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:02.866301 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:02.866301 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:02.866301 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:16:02.866301 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:16:02.866301 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:16:02.866301 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:16:02.866301 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:16:02.866301 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:16:02.866301 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 31 16:16:02.866301 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 31 16:16:02.866301 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 712d2c7f-6545-4d70-81d7-8c0d07cb4b70 does not exist Aug 31 16:16:02.866301 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-26c640bc-c07d-4264-8d86-7da8b96f6f0a'] Aug 31 16:16:02.866301 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:02.866301 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:02.866301 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:02.866301 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:02.866301 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:02.866301 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:02.866301 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:16:02.866301 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:16:02.866301 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 712d2c7f-6545-4d70-81d7-8c0d07cb4b70 does not exist Aug 31 16:16:02.866301 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-26c640bc-c07d-4264-8d86-7da8b96f6f0a'] Aug 31 16:16:02.866301 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:02.866301 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-78e0cb93-75f3-4a99-bb48-0fea6ce34692 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Returning 404 to user: Security group 712d2c7f-6545-4d70-81d7-8c0d07cb4b70 does not exist Aug 31 16:16:02.866301 n-d-833090-16 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-26c640bc-c07d-4264-8d86-7da8b96f6f0a'] {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:16:02.866301 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-78e0cb93-75f3-4a99-bb48-0fea6ce34692 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/712d2c7f-6545-4d70-81d7-8c0d07cb4b70" status: 404 len: 194 microversion: 2.1 time: 0.055486 Aug 31 16:16:02.866301 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2424/5037] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 31 16:16:02 2022] DELETE /compute/v2.1/os-security-groups/712d2c7f-6545-4d70-81d7-8c0d07cb4b70 => generated 194 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:16:02.880175 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-408d1bea-a5f5-4f7e-a390-4fdbf78ae524 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '.version_select at 0x7fbb45cded30>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:02.927758 n-d-833090-16 devstack@n-api.service[128863]: DEBUG neutronclient.v2_0.client [None req-408d1bea-a5f5-4f7e-a390-4fdbf78ae524 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a76b48a7-3332-4a36-b269-6e0c52d879e5 does not exist", "detail": ""}} {{(pid=128863) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 31 16:16:02.928458 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.security_group_api [None req-408d1bea-a5f5-4f7e-a390-4fdbf78ae524 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Neutron security group a76b48a7-3332-4a36-b269-6e0c52d879e5 not found {{(pid=128863) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 31 16:16:02.930113 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-408d1bea-a5f5-4f7e-a390-4fdbf78ae524 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] HTTP exception thrown: Security group a76b48a7-3332-4a36-b269-6e0c52d879e5 does not exist Aug 31 16:16:02.930113 n-d-833090-16 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-5d4a1f03-a58a-40db-aeee-6d2f59127d29'] Aug 31 16:16:02.932381 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-408d1bea-a5f5-4f7e-a390-4fdbf78ae524 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Request method failure captured: Aug 31 16:16:02.932381 n-d-833090-16 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/os-security-groups/a76b48a7-3332-4a36-b269-6e0c52d879e5 HTTP/1.1 Aug 31 16:16:02.932381 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:16:02.932381 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:16:02.932381 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:16:02.932381 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:16:02.932381 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:16:02.932381 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:16:02.932381 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:16:02.932381 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:16:02.932381 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4kIFJ0zG0xeBGgG3uzrjLL9EnflnKZMdGdJ2D9YGgjKqtNDIyBPydopwRei8ZnPbXcFm3HhN-k5tWZi56omwftJZfOWCKw_Hb9N0DyCWLOGgTx7eghMjbdmJfyquGOCz4DRfEHH-TxPGulLn-DplfVM4FoftEuHQL9TOxgHDYENNcI Aug 31 16:16:02.932381 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:16:02.932381 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:16:02.932381 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:16:02.932381 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:16:02.932381 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:16:02.932381 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:16:02.932381 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 7baff3cad5c14325a5576c40fcda0580 Aug 31 16:16:02.932381 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-SecurityGroupsTestJSON-608242232 Aug 31 16:16:02.932381 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:16:02.932381 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:16:02.932381 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7baff3cad5c14325a5576c40fcda0580"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7baff3cad5c14325a5576c40fcda0580"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7baff3cad5c14325a5576c40fcda0580"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7baff3cad5c14325a5576c40fcda0580", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:16:02.932381 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-SecurityGroupsTestJSON-608242232 Aug 31 16:16:02.932381 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 7baff3cad5c14325a5576c40fcda0580 Aug 31 16:16:02.932381 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-608242232 Aug 31 16:16:02.932381 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-SecurityGroupsTestJSON-608242232-project Aug 31 16:16:02.932381 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:16:02.932381 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:16:02.932381 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: dabb1c841cde40769174e2f8a97234c0 Aug 31 16:16:02.932381 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-SecurityGroupsTestJSON-608242232-project Aug 31 16:16:02.932381 n-d-833090-16 devstack@n-api.service[128863]: method: Aug 31 16:16:02.932381 n-d-833090-16 devstack@n-api.service[128863]: exception: Security group a76b48a7-3332-4a36-b269-6e0c52d879e5 does not exist Aug 31 16:16:02.932381 n-d-833090-16 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-5d4a1f03-a58a-40db-aeee-6d2f59127d29'] Aug 31 16:16:02.932381 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'a76b48a7-3332-4a36-b269-6e0c52d879e5'} Aug 31 16:16:02.932381 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:16:02.932381 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:02.932381 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 31 16:16:02.932381 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 31 16:16:02.932381 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:16:02.932381 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:16:02.932381 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 31 16:16:02.932381 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 31 16:16:02.932381 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:16:02.932381 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:16:02.932381 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 31 16:16:02.932381 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 31 16:16:02.932381 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:16:02.932381 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:16:02.932381 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 31 16:16:02.932381 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 31 16:16:02.932381 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:16:02.932381 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:16:02.932381 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 31 16:16:02.932381 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 31 16:16:02.932381 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:16:02.932381 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:16:02.932381 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 31 16:16:02.932381 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 31 16:16:02.932381 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 31 16:16:02.932381 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 31 16:16:02.932381 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a76b48a7-3332-4a36-b269-6e0c52d879e5 does not exist Aug 31 16:16:02.938277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5d4a1f03-a58a-40db-aeee-6d2f59127d29'] Aug 31 16:16:02.938277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:02.938277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:02.938277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:02.938277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:02.938277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 31 16:16:02.938277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 31 16:16:02.938277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 31 16:16:02.938277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 31 16:16:02.938277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a76b48a7-3332-4a36-b269-6e0c52d879e5 does not exist Aug 31 16:16:02.938277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5d4a1f03-a58a-40db-aeee-6d2f59127d29'] Aug 31 16:16:02.938277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:02.938277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:02.938277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:02.938277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:02.938277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:02.938277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:02.938277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:16:02.938277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:16:02.938277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:16:02.938277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:16:02.938277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:16:02.938277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:16:02.938277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 31 16:16:02.938277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 31 16:16:02.938277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a76b48a7-3332-4a36-b269-6e0c52d879e5 does not exist Aug 31 16:16:02.938277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5d4a1f03-a58a-40db-aeee-6d2f59127d29'] Aug 31 16:16:02.938277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:02.938277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:02.938277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:02.938277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:02.938277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:02.938277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:02.938277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:16:02.938277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:16:02.938277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a76b48a7-3332-4a36-b269-6e0c52d879e5 does not exist Aug 31 16:16:02.938277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5d4a1f03-a58a-40db-aeee-6d2f59127d29'] Aug 31 16:16:02.938277 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:02.938277 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-408d1bea-a5f5-4f7e-a390-4fdbf78ae524 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Returning 404 to user: Security group a76b48a7-3332-4a36-b269-6e0c52d879e5 does not exist Aug 31 16:16:02.938277 n-d-833090-16 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-5d4a1f03-a58a-40db-aeee-6d2f59127d29'] {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:16:02.938277 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-408d1bea-a5f5-4f7e-a390-4fdbf78ae524 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/a76b48a7-3332-4a36-b269-6e0c52d879e5" status: 404 len: 194 microversion: 2.1 time: 0.061780 Aug 31 16:16:02.938277 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2425/5038] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 31 16:16:02 2022] DELETE /compute/v2.1/os-security-groups/a76b48a7-3332-4a36-b269-6e0c52d879e5 => generated 194 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:16:02.948380 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cae2ef89-bc2e-4e9e-a36f-a1c3457b1e2f tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '.version_select at 0x7fbb4594baf0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:03.054402 n-d-833090-16 devstack@n-api.service[128863]: DEBUG neutronclient.v2_0.client [None req-cae2ef89-bc2e-4e9e-a36f-a1c3457b1e2f tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a5400ce6-3b58-4463-a59c-d754fb87d6e3 does not exist", "detail": ""}} {{(pid=128863) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 31 16:16:03.055510 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.security_group_api [None req-cae2ef89-bc2e-4e9e-a36f-a1c3457b1e2f tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Neutron security group a5400ce6-3b58-4463-a59c-d754fb87d6e3 not found {{(pid=128863) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 31 16:16:03.056879 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-cae2ef89-bc2e-4e9e-a36f-a1c3457b1e2f tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] HTTP exception thrown: Security group a5400ce6-3b58-4463-a59c-d754fb87d6e3 does not exist Aug 31 16:16:03.056879 n-d-833090-16 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-a2161ebb-d167-4a4e-a399-2bab566f1715'] Aug 31 16:16:03.059852 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cae2ef89-bc2e-4e9e-a36f-a1c3457b1e2f tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Request method failure captured: Aug 31 16:16:03.059852 n-d-833090-16 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/os-security-groups/a5400ce6-3b58-4463-a59c-d754fb87d6e3 HTTP/1.1 Aug 31 16:16:03.059852 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:16:03.059852 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:16:03.059852 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:16:03.059852 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:16:03.059852 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:16:03.059852 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:16:03.059852 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:16:03.059852 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:16:03.059852 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4kIFJ0zG0xeBGgG3uzrjLL9EnflnKZMdGdJ2D9YGgjKqtNDIyBPydopwRei8ZnPbXcFm3HhN-k5tWZi56omwftJZfOWCKw_Hb9N0DyCWLOGgTx7eghMjbdmJfyquGOCz4DRfEHH-TxPGulLn-DplfVM4FoftEuHQL9TOxgHDYENNcI Aug 31 16:16:03.059852 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:16:03.059852 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:16:03.059852 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:16:03.059852 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:16:03.059852 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:16:03.059852 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:16:03.059852 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 7baff3cad5c14325a5576c40fcda0580 Aug 31 16:16:03.059852 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-SecurityGroupsTestJSON-608242232 Aug 31 16:16:03.059852 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:16:03.059852 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:16:03.059852 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7baff3cad5c14325a5576c40fcda0580"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7baff3cad5c14325a5576c40fcda0580"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7baff3cad5c14325a5576c40fcda0580"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7baff3cad5c14325a5576c40fcda0580", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:16:03.059852 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-SecurityGroupsTestJSON-608242232 Aug 31 16:16:03.059852 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 7baff3cad5c14325a5576c40fcda0580 Aug 31 16:16:03.059852 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-608242232 Aug 31 16:16:03.059852 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-SecurityGroupsTestJSON-608242232-project Aug 31 16:16:03.059852 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:16:03.059852 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:16:03.059852 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: dabb1c841cde40769174e2f8a97234c0 Aug 31 16:16:03.059852 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-SecurityGroupsTestJSON-608242232-project Aug 31 16:16:03.059852 n-d-833090-16 devstack@n-api.service[128863]: method: Aug 31 16:16:03.059852 n-d-833090-16 devstack@n-api.service[128863]: exception: Security group a5400ce6-3b58-4463-a59c-d754fb87d6e3 does not exist Aug 31 16:16:03.059852 n-d-833090-16 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-a2161ebb-d167-4a4e-a399-2bab566f1715'] Aug 31 16:16:03.059852 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'a5400ce6-3b58-4463-a59c-d754fb87d6e3'} Aug 31 16:16:03.059852 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:16:03.059852 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:03.059852 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 31 16:16:03.059852 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 31 16:16:03.059852 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:16:03.059852 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:16:03.059852 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 31 16:16:03.059852 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 31 16:16:03.059852 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:16:03.059852 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:16:03.059852 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 31 16:16:03.059852 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 31 16:16:03.059852 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:16:03.059852 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:16:03.059852 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 31 16:16:03.059852 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 31 16:16:03.059852 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:16:03.059852 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:16:03.059852 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 31 16:16:03.059852 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 31 16:16:03.059852 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:16:03.059852 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:16:03.059852 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 31 16:16:03.059852 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 31 16:16:03.059852 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 31 16:16:03.059852 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 31 16:16:03.059852 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a5400ce6-3b58-4463-a59c-d754fb87d6e3 does not exist Aug 31 16:16:03.064479 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a2161ebb-d167-4a4e-a399-2bab566f1715'] Aug 31 16:16:03.064479 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:03.064479 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:03.064479 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:03.064479 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:03.064479 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 31 16:16:03.064479 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 31 16:16:03.064479 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 31 16:16:03.064479 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 31 16:16:03.064479 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a5400ce6-3b58-4463-a59c-d754fb87d6e3 does not exist Aug 31 16:16:03.064479 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a2161ebb-d167-4a4e-a399-2bab566f1715'] Aug 31 16:16:03.064479 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:03.064479 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:03.064479 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:03.064479 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:03.064479 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:03.064479 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:03.064479 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:16:03.064479 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:16:03.064479 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:16:03.064479 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:16:03.064479 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:16:03.064479 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:16:03.064479 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 31 16:16:03.064479 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 31 16:16:03.064479 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a5400ce6-3b58-4463-a59c-d754fb87d6e3 does not exist Aug 31 16:16:03.064479 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a2161ebb-d167-4a4e-a399-2bab566f1715'] Aug 31 16:16:03.064479 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:03.064479 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:03.064479 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:03.064479 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:03.064479 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:03.064479 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:03.064479 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:16:03.064479 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:16:03.064479 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a5400ce6-3b58-4463-a59c-d754fb87d6e3 does not exist Aug 31 16:16:03.064479 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a2161ebb-d167-4a4e-a399-2bab566f1715'] Aug 31 16:16:03.064479 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:03.068502 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cae2ef89-bc2e-4e9e-a36f-a1c3457b1e2f tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Returning 404 to user: Security group a5400ce6-3b58-4463-a59c-d754fb87d6e3 does not exist Aug 31 16:16:03.068502 n-d-833090-16 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-a2161ebb-d167-4a4e-a399-2bab566f1715'] {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:16:03.070058 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cae2ef89-bc2e-4e9e-a36f-a1c3457b1e2f tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/a5400ce6-3b58-4463-a59c-d754fb87d6e3" status: 404 len: 194 microversion: 2.1 time: 0.125898 Aug 31 16:16:03.071190 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2426/5039] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 31 16:16:02 2022] DELETE /compute/v2.1/os-security-groups/a5400ce6-3b58-4463-a59c-d754fb87d6e3 => generated 194 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:16:03.082944 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2b6959e0-96b2-4bf2-bff0-0a81f7f24a30 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '.version_select at 0x7fbb4594d700>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:03.119794 n-d-833090-16 devstack@n-api.service[128863]: DEBUG neutronclient.v2_0.client [None req-2b6959e0-96b2-4bf2-bff0-0a81f7f24a30 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d7f0085b-389e-41d3-a37c-a94fbfabfd45 does not exist", "detail": ""}} {{(pid=128863) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 31 16:16:03.121519 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.security_group_api [None req-2b6959e0-96b2-4bf2-bff0-0a81f7f24a30 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Neutron security group d7f0085b-389e-41d3-a37c-a94fbfabfd45 not found {{(pid=128863) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 31 16:16:03.123665 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-2b6959e0-96b2-4bf2-bff0-0a81f7f24a30 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] HTTP exception thrown: Security group d7f0085b-389e-41d3-a37c-a94fbfabfd45 does not exist Aug 31 16:16:03.123665 n-d-833090-16 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-6e18a414-aaea-484a-bfe4-34080ed882d4'] Aug 31 16:16:03.127907 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2b6959e0-96b2-4bf2-bff0-0a81f7f24a30 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Request method failure captured: Aug 31 16:16:03.127907 n-d-833090-16 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/os-security-groups/d7f0085b-389e-41d3-a37c-a94fbfabfd45 HTTP/1.1 Aug 31 16:16:03.127907 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:16:03.127907 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:16:03.127907 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:16:03.127907 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:16:03.127907 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:16:03.127907 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:16:03.127907 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:16:03.127907 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:16:03.127907 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4kIFJ0zG0xeBGgG3uzrjLL9EnflnKZMdGdJ2D9YGgjKqtNDIyBPydopwRei8ZnPbXcFm3HhN-k5tWZi56omwftJZfOWCKw_Hb9N0DyCWLOGgTx7eghMjbdmJfyquGOCz4DRfEHH-TxPGulLn-DplfVM4FoftEuHQL9TOxgHDYENNcI Aug 31 16:16:03.127907 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:16:03.127907 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:16:03.127907 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:16:03.127907 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:16:03.127907 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:16:03.127907 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:16:03.127907 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 7baff3cad5c14325a5576c40fcda0580 Aug 31 16:16:03.127907 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-SecurityGroupsTestJSON-608242232 Aug 31 16:16:03.127907 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:16:03.127907 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:16:03.127907 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7baff3cad5c14325a5576c40fcda0580"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7baff3cad5c14325a5576c40fcda0580"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7baff3cad5c14325a5576c40fcda0580"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7baff3cad5c14325a5576c40fcda0580", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:16:03.127907 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-SecurityGroupsTestJSON-608242232 Aug 31 16:16:03.127907 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 7baff3cad5c14325a5576c40fcda0580 Aug 31 16:16:03.127907 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-608242232 Aug 31 16:16:03.127907 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-SecurityGroupsTestJSON-608242232-project Aug 31 16:16:03.127907 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:16:03.127907 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:16:03.127907 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: dabb1c841cde40769174e2f8a97234c0 Aug 31 16:16:03.127907 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-SecurityGroupsTestJSON-608242232-project Aug 31 16:16:03.127907 n-d-833090-16 devstack@n-api.service[128863]: method: Aug 31 16:16:03.127907 n-d-833090-16 devstack@n-api.service[128863]: exception: Security group d7f0085b-389e-41d3-a37c-a94fbfabfd45 does not exist Aug 31 16:16:03.127907 n-d-833090-16 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-6e18a414-aaea-484a-bfe4-34080ed882d4'] Aug 31 16:16:03.127907 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'd7f0085b-389e-41d3-a37c-a94fbfabfd45'} Aug 31 16:16:03.127907 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:16:03.127907 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:03.127907 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 31 16:16:03.127907 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 31 16:16:03.127907 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:16:03.127907 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:16:03.127907 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 31 16:16:03.127907 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 31 16:16:03.127907 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:16:03.127907 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:16:03.127907 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 31 16:16:03.127907 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 31 16:16:03.127907 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:16:03.127907 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:16:03.127907 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 31 16:16:03.127907 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 31 16:16:03.127907 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:16:03.127907 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:16:03.127907 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 31 16:16:03.127907 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 31 16:16:03.127907 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:16:03.127907 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:16:03.127907 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 31 16:16:03.127907 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 31 16:16:03.127907 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 31 16:16:03.127907 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 31 16:16:03.127907 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d7f0085b-389e-41d3-a37c-a94fbfabfd45 does not exist Aug 31 16:16:03.135598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6e18a414-aaea-484a-bfe4-34080ed882d4'] Aug 31 16:16:03.135598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:03.135598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:03.135598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:03.135598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:03.135598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 31 16:16:03.135598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 31 16:16:03.135598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 31 16:16:03.135598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 31 16:16:03.135598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d7f0085b-389e-41d3-a37c-a94fbfabfd45 does not exist Aug 31 16:16:03.135598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6e18a414-aaea-484a-bfe4-34080ed882d4'] Aug 31 16:16:03.135598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:03.135598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:03.135598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:03.135598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:03.135598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:03.135598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:03.135598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:16:03.135598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:16:03.135598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:16:03.135598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:16:03.135598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:16:03.135598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:16:03.135598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 31 16:16:03.135598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 31 16:16:03.135598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d7f0085b-389e-41d3-a37c-a94fbfabfd45 does not exist Aug 31 16:16:03.135598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6e18a414-aaea-484a-bfe4-34080ed882d4'] Aug 31 16:16:03.135598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:03.135598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:03.135598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:03.135598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:03.135598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:03.135598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:03.135598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:16:03.135598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:16:03.135598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d7f0085b-389e-41d3-a37c-a94fbfabfd45 does not exist Aug 31 16:16:03.135598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6e18a414-aaea-484a-bfe4-34080ed882d4'] Aug 31 16:16:03.135598 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:03.144585 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2b6959e0-96b2-4bf2-bff0-0a81f7f24a30 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Returning 404 to user: Security group d7f0085b-389e-41d3-a37c-a94fbfabfd45 does not exist Aug 31 16:16:03.144585 n-d-833090-16 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-6e18a414-aaea-484a-bfe4-34080ed882d4'] {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:16:03.146489 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2b6959e0-96b2-4bf2-bff0-0a81f7f24a30 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/d7f0085b-389e-41d3-a37c-a94fbfabfd45" status: 404 len: 194 microversion: 2.1 time: 0.069401 Aug 31 16:16:03.147432 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2427/5040] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 31 16:16:03 2022] DELETE /compute/v2.1/os-security-groups/d7f0085b-389e-41d3-a37c-a94fbfabfd45 => generated 194 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:16:03.157586 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-31aa281b-0967-4b06-b6b2-2ddbc8461158 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '.version_select at 0x7fbb4594b1f0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:03.162601 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2dc9d406-ecc5-4731-bf95-44b206c91d9c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:03.175396 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2dc9d406-ecc5-4731-bf95-44b206c91d9c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.353100 Aug 31 16:16:03.176751 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2614/5041] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:02 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:03.194984 n-d-833090-16 devstack@n-api.service[128863]: DEBUG neutronclient.v2_0.client [None req-31aa281b-0967-4b06-b6b2-2ddbc8461158 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c345c0cd-6eba-42f1-b0a2-386de6373405 does not exist", "detail": ""}} {{(pid=128863) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 31 16:16:03.195781 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.security_group_api [None req-31aa281b-0967-4b06-b6b2-2ddbc8461158 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Neutron security group c345c0cd-6eba-42f1-b0a2-386de6373405 not found {{(pid=128863) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 31 16:16:03.196452 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-31aa281b-0967-4b06-b6b2-2ddbc8461158 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] HTTP exception thrown: Security group c345c0cd-6eba-42f1-b0a2-386de6373405 does not exist Aug 31 16:16:03.196452 n-d-833090-16 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-6425d57e-ff72-4fce-be0f-599ef3c618a8'] Aug 31 16:16:03.198735 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-31aa281b-0967-4b06-b6b2-2ddbc8461158 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Request method failure captured: Aug 31 16:16:03.198735 n-d-833090-16 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/os-security-groups/c345c0cd-6eba-42f1-b0a2-386de6373405 HTTP/1.1 Aug 31 16:16:03.198735 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:16:03.198735 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:16:03.198735 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:16:03.198735 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:16:03.198735 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:16:03.198735 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:16:03.198735 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:16:03.198735 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:16:03.198735 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4kIFJ0zG0xeBGgG3uzrjLL9EnflnKZMdGdJ2D9YGgjKqtNDIyBPydopwRei8ZnPbXcFm3HhN-k5tWZi56omwftJZfOWCKw_Hb9N0DyCWLOGgTx7eghMjbdmJfyquGOCz4DRfEHH-TxPGulLn-DplfVM4FoftEuHQL9TOxgHDYENNcI Aug 31 16:16:03.198735 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:16:03.198735 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:16:03.198735 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:16:03.198735 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:16:03.198735 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:16:03.198735 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:16:03.198735 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 7baff3cad5c14325a5576c40fcda0580 Aug 31 16:16:03.198735 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-SecurityGroupsTestJSON-608242232 Aug 31 16:16:03.198735 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:16:03.198735 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:16:03.198735 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7baff3cad5c14325a5576c40fcda0580"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7baff3cad5c14325a5576c40fcda0580"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7baff3cad5c14325a5576c40fcda0580"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7baff3cad5c14325a5576c40fcda0580", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:16:03.198735 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-SecurityGroupsTestJSON-608242232 Aug 31 16:16:03.198735 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 7baff3cad5c14325a5576c40fcda0580 Aug 31 16:16:03.198735 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-608242232 Aug 31 16:16:03.198735 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-SecurityGroupsTestJSON-608242232-project Aug 31 16:16:03.198735 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:16:03.198735 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:16:03.198735 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: dabb1c841cde40769174e2f8a97234c0 Aug 31 16:16:03.198735 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-SecurityGroupsTestJSON-608242232-project Aug 31 16:16:03.198735 n-d-833090-16 devstack@n-api.service[128863]: method: Aug 31 16:16:03.198735 n-d-833090-16 devstack@n-api.service[128863]: exception: Security group c345c0cd-6eba-42f1-b0a2-386de6373405 does not exist Aug 31 16:16:03.198735 n-d-833090-16 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-6425d57e-ff72-4fce-be0f-599ef3c618a8'] Aug 31 16:16:03.198735 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'c345c0cd-6eba-42f1-b0a2-386de6373405'} Aug 31 16:16:03.198735 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:16:03.198735 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:03.198735 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 31 16:16:03.198735 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 31 16:16:03.198735 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:16:03.198735 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:16:03.198735 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 31 16:16:03.198735 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 31 16:16:03.198735 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:16:03.198735 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:16:03.198735 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 31 16:16:03.198735 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 31 16:16:03.198735 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:16:03.198735 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:16:03.198735 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 31 16:16:03.198735 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 31 16:16:03.198735 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:16:03.198735 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:16:03.198735 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 31 16:16:03.198735 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 31 16:16:03.198735 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:16:03.198735 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:16:03.198735 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 31 16:16:03.198735 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 31 16:16:03.198735 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 31 16:16:03.198735 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 31 16:16:03.198735 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c345c0cd-6eba-42f1-b0a2-386de6373405 does not exist Aug 31 16:16:03.204078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6425d57e-ff72-4fce-be0f-599ef3c618a8'] Aug 31 16:16:03.204078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:03.204078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:03.204078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:03.204078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:03.204078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 31 16:16:03.204078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 31 16:16:03.204078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 31 16:16:03.204078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 31 16:16:03.204078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c345c0cd-6eba-42f1-b0a2-386de6373405 does not exist Aug 31 16:16:03.204078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6425d57e-ff72-4fce-be0f-599ef3c618a8'] Aug 31 16:16:03.204078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:03.204078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:03.204078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:03.204078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:03.204078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:03.204078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:03.204078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:16:03.204078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:16:03.204078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:16:03.204078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:16:03.204078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:16:03.204078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:16:03.204078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 31 16:16:03.204078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 31 16:16:03.204078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c345c0cd-6eba-42f1-b0a2-386de6373405 does not exist Aug 31 16:16:03.204078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6425d57e-ff72-4fce-be0f-599ef3c618a8'] Aug 31 16:16:03.204078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:03.204078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:03.204078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:03.204078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:03.204078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:03.204078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:03.204078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:16:03.204078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:16:03.204078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c345c0cd-6eba-42f1-b0a2-386de6373405 does not exist Aug 31 16:16:03.204078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6425d57e-ff72-4fce-be0f-599ef3c618a8'] Aug 31 16:16:03.204078 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:03.208993 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-31aa281b-0967-4b06-b6b2-2ddbc8461158 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Returning 404 to user: Security group c345c0cd-6eba-42f1-b0a2-386de6373405 does not exist Aug 31 16:16:03.208993 n-d-833090-16 devstack@n-api.service[128863]: Neutron server returns request_ids: ['req-6425d57e-ff72-4fce-be0f-599ef3c618a8'] {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:16:03.210233 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-31aa281b-0967-4b06-b6b2-2ddbc8461158 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/c345c0cd-6eba-42f1-b0a2-386de6373405" status: 404 len: 194 microversion: 2.1 time: 0.058301 Aug 31 16:16:03.214023 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2428/5042] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 31 16:16:03 2022] DELETE /compute/v2.1/os-security-groups/c345c0cd-6eba-42f1-b0a2-386de6373405 => generated 194 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:16:03.223135 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-da1879f0-e78e-4d7b-ba39-42b277a585c8 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '.version_select at 0x7fbb46000550>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:03.282885 n-d-833090-16 devstack@n-api.service[128864]: DEBUG neutronclient.v2_0.client [None req-da1879f0-e78e-4d7b-ba39-42b277a585c8 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 91e667ca-3807-4879-a671-a4e843be2acc does not exist", "detail": ""}} {{(pid=128864) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 31 16:16:03.283928 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.security_group_api [None req-da1879f0-e78e-4d7b-ba39-42b277a585c8 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Neutron security group 91e667ca-3807-4879-a671-a4e843be2acc not found {{(pid=128864) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 31 16:16:03.285058 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-da1879f0-e78e-4d7b-ba39-42b277a585c8 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] HTTP exception thrown: Security group 91e667ca-3807-4879-a671-a4e843be2acc does not exist Aug 31 16:16:03.285058 n-d-833090-16 devstack@n-api.service[128864]: Neutron server returns request_ids: ['req-a29bff32-53e6-4048-bf4e-a3b67188e0bb'] Aug 31 16:16:03.287856 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-da1879f0-e78e-4d7b-ba39-42b277a585c8 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Request method failure captured: Aug 31 16:16:03.287856 n-d-833090-16 devstack@n-api.service[128864]: request: DELETE /compute/v2.1/os-security-groups/91e667ca-3807-4879-a671-a4e843be2acc HTTP/1.1 Aug 31 16:16:03.287856 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:16:03.287856 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:16:03.287856 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:16:03.287856 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:16:03.287856 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:16:03.287856 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:16:03.287856 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:16:03.287856 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:16:03.287856 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4kIFJ0zG0xeBGgG3uzrjLL9EnflnKZMdGdJ2D9YGgjKqtNDIyBPydopwRei8ZnPbXcFm3HhN-k5tWZi56omwftJZfOWCKw_Hb9N0DyCWLOGgTx7eghMjbdmJfyquGOCz4DRfEHH-TxPGulLn-DplfVM4FoftEuHQL9TOxgHDYENNcI Aug 31 16:16:03.287856 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:16:03.287856 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:16:03.287856 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:16:03.287856 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:16:03.287856 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:16:03.287856 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:16:03.287856 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 7baff3cad5c14325a5576c40fcda0580 Aug 31 16:16:03.287856 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-SecurityGroupsTestJSON-608242232 Aug 31 16:16:03.287856 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:16:03.287856 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:16:03.287856 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7baff3cad5c14325a5576c40fcda0580"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7baff3cad5c14325a5576c40fcda0580"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7baff3cad5c14325a5576c40fcda0580"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7baff3cad5c14325a5576c40fcda0580", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:16:03.287856 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-SecurityGroupsTestJSON-608242232 Aug 31 16:16:03.287856 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 7baff3cad5c14325a5576c40fcda0580 Aug 31 16:16:03.287856 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-608242232 Aug 31 16:16:03.287856 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-SecurityGroupsTestJSON-608242232-project Aug 31 16:16:03.287856 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:16:03.287856 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:16:03.287856 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: dabb1c841cde40769174e2f8a97234c0 Aug 31 16:16:03.287856 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-SecurityGroupsTestJSON-608242232-project Aug 31 16:16:03.287856 n-d-833090-16 devstack@n-api.service[128864]: method: Aug 31 16:16:03.287856 n-d-833090-16 devstack@n-api.service[128864]: exception: Security group 91e667ca-3807-4879-a671-a4e843be2acc does not exist Aug 31 16:16:03.287856 n-d-833090-16 devstack@n-api.service[128864]: Neutron server returns request_ids: ['req-a29bff32-53e6-4048-bf4e-a3b67188e0bb'] Aug 31 16:16:03.287856 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '91e667ca-3807-4879-a671-a4e843be2acc'} Aug 31 16:16:03.287856 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:16:03.287856 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:03.287856 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 31 16:16:03.287856 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 31 16:16:03.287856 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:16:03.287856 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:16:03.287856 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 31 16:16:03.287856 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 31 16:16:03.287856 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:16:03.287856 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:16:03.287856 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 31 16:16:03.287856 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 31 16:16:03.287856 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:16:03.287856 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:16:03.287856 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 31 16:16:03.287856 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 31 16:16:03.287856 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:16:03.287856 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:16:03.287856 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 31 16:16:03.287856 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 31 16:16:03.287856 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:16:03.287856 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:16:03.287856 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 31 16:16:03.287856 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 31 16:16:03.287856 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 31 16:16:03.287856 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 31 16:16:03.287856 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 91e667ca-3807-4879-a671-a4e843be2acc does not exist Aug 31 16:16:03.296797 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a29bff32-53e6-4048-bf4e-a3b67188e0bb'] Aug 31 16:16:03.296797 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:03.296797 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:03.296797 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:03.296797 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:03.296797 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 31 16:16:03.296797 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 31 16:16:03.296797 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 31 16:16:03.296797 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 31 16:16:03.296797 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 91e667ca-3807-4879-a671-a4e843be2acc does not exist Aug 31 16:16:03.296797 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a29bff32-53e6-4048-bf4e-a3b67188e0bb'] Aug 31 16:16:03.296797 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:03.296797 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:03.296797 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:03.296797 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:03.296797 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:03.296797 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:03.296797 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:16:03.296797 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:16:03.296797 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:16:03.296797 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:16:03.296797 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:16:03.296797 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:16:03.296797 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 31 16:16:03.296797 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 31 16:16:03.296797 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 91e667ca-3807-4879-a671-a4e843be2acc does not exist Aug 31 16:16:03.296797 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a29bff32-53e6-4048-bf4e-a3b67188e0bb'] Aug 31 16:16:03.296797 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:03.296797 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:03.296797 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:03.296797 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:03.296797 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:03.296797 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:03.296797 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:16:03.296797 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:16:03.296797 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 91e667ca-3807-4879-a671-a4e843be2acc does not exist Aug 31 16:16:03.296797 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a29bff32-53e6-4048-bf4e-a3b67188e0bb'] Aug 31 16:16:03.296797 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:03.296797 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-da1879f0-e78e-4d7b-ba39-42b277a585c8 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Returning 404 to user: Security group 91e667ca-3807-4879-a671-a4e843be2acc does not exist Aug 31 16:16:03.296797 n-d-833090-16 devstack@n-api.service[128864]: Neutron server returns request_ids: ['req-a29bff32-53e6-4048-bf4e-a3b67188e0bb'] {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:16:03.296797 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-da1879f0-e78e-4d7b-ba39-42b277a585c8 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/91e667ca-3807-4879-a671-a4e843be2acc" status: 404 len: 194 microversion: 2.1 time: 0.073998 Aug 31 16:16:03.296797 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2615/5043] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 31 16:16:03 2022] DELETE /compute/v2.1/os-security-groups/91e667ca-3807-4879-a671-a4e843be2acc => generated 194 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:16:03.315941 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8ff0af4f-aac0-4d79-a039-93d606e343b3 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:03.316755 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8ff0af4f-aac0-4d79-a039-93d606e343b3 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] [instance: 30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:03.335931 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ff0af4f-aac0-4d79-a039-93d606e343b3 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:03.336438 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ff0af4f-aac0-4d79-a039-93d606e343b3 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:03.337066 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ff0af4f-aac0-4d79-a039-93d606e343b3 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:03.337959 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ff0af4f-aac0-4d79-a039-93d606e343b3 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:03.338887 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ff0af4f-aac0-4d79-a039-93d606e343b3 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:03.339369 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ff0af4f-aac0-4d79-a039-93d606e343b3 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:03.355079 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0564f196-e82d-4eda-93a5-50be768ac1a2 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:03.357563 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0564f196-e82d-4eda-93a5-50be768ac1a2 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 1c40a98f-366d-4392-9034-7841f68b2050] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:03.368756 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0564f196-e82d-4eda-93a5-50be768ac1a2 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:03.370018 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0564f196-e82d-4eda-93a5-50be768ac1a2 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:03.370566 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0564f196-e82d-4eda-93a5-50be768ac1a2 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:03.371380 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0564f196-e82d-4eda-93a5-50be768ac1a2 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:03.371924 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0564f196-e82d-4eda-93a5-50be768ac1a2 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:03.372459 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0564f196-e82d-4eda-93a5-50be768ac1a2 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:03.399038 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:16:03.407067 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8ff0af4f-aac0-4d79-a039-93d606e343b3 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] [instance: 30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:16:03.416958 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0564f196-e82d-4eda-93a5-50be768ac1a2 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068952 Aug 31 16:16:03.417829 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2616/5044] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:16:03 2022] GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:16:03.428199 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3644de31-af55-4e55-99c6-c41d3e92c277 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1019019389", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": -1, "networks": [{"uuid": "1c4c22f6-ea49-4e46-87c2-7de60e095fb8"}]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:03.442237 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-3644de31-af55-4e55-99c6-c41d3e92c277 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] HTTP exception thrown: Flavor -1 could not be found. Aug 31 16:16:03.444911 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3644de31-af55-4e55-99c6-c41d3e92c277 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Request method failure captured: Aug 31 16:16:03.444911 n-d-833090-16 devstack@n-api.service[128864]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 31 16:16:03.444911 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:16:03.444911 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:16:03.444911 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:16:03.444911 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 206 Aug 31 16:16:03.444911 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:16:03.444911 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:16:03.444911 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:16:03.444911 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:16:03.444911 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4kQ0XzwgZzM00K2xfqw4sNWznetRNwtM61dwPFzPgxHVwt6ZQqeyy0IDwJXT8yOdP4-2pSJFf0sLdbRTKSty95v4MPjLoaaRhSqpDob3UUxppJFVkB8ZQH-IsYhc50JLxuO54hEVWRh4jtxjaTwZZjw98G6FCIkizac62ua4tSQ6_s Aug 31 16:16:03.444911 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:16:03.444911 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:16:03.444911 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:16:03.444911 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:16:03.444911 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:16:03.444911 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:16:03.444911 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:16:03.444911 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:03.444911 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:16:03.444911 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:16:03.444911 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3e843f3122c14cf8889f26423552792f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3e843f3122c14cf8889f26423552792f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:16:03.444911 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:03.444911 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:16:03.444911 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:03.444911 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:16:03.444911 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:16:03.444911 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:16:03.444911 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 8b67be53aade4f8c92d6765dd91a4b90 Aug 31 16:16:03.444911 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:16:03.444911 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 16:16:03.444911 n-d-833090-16 devstack@n-api.service[128864]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1019019389", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": -1, "networks": [{"uuid": "1c4c22f6-ea49-4e46-87c2-7de60e095fb8"}]}} Aug 31 16:16:03.444911 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:16:03.444911 n-d-833090-16 devstack@n-api.service[128864]: exception: Flavor -1 could not be found. Aug 31 16:16:03.444911 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1019019389', 'imageRef': 'd715a41c-0e56-494a-a102-cac65831f6bd', 'flavorRef': -1, 'networks': [{'uuid': '1c4c22f6-ea49-4e46-87c2-7de60e095fb8'}]}}} Aug 31 16:16:03.444911 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:16:03.444911 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:03.444911 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 31 16:16:03.444911 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 31 16:16:03.444911 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 16:16:03.444911 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 16:16:03.444911 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 16:16:03.444911 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 16:16:03.444911 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 16:16:03.444911 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 16:16:03.444911 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 16:16:03.444911 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:16:03.444911 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 16:16:03.444911 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 16:16:03.444911 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Aug 31 16:16:03.444911 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:03.444911 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:03.444911 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:03.444911 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:03.444911 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:03.444911 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:03.444911 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:16:03.444911 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:16:03.444911 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:16:03.444911 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:16:03.444911 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:16:03.444911 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:16:03.450178 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:16:03.450178 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:16:03.450178 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:16:03.450178 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:16:03.450178 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 31 16:16:03.450178 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 31 16:16:03.450178 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 31 16:16:03.450178 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Aug 31 16:16:03.450178 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:03.450178 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:03.450178 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:03.450178 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:03.450178 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:03.450178 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:03.450178 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:16:03.450178 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:16:03.450178 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Aug 31 16:16:03.450178 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:03.452395 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3644de31-af55-4e55-99c6-c41d3e92c277 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:16:03.455294 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3644de31-af55-4e55-99c6-c41d3e92c277 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.031960 Aug 31 16:16:03.456136 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2617/5045] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:16:03 2022] POST /compute/v2.1/servers => generated 73 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 31 16:16:03.464832 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8f34e224-0947-479f-8652-17601c78104e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:03.465495 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8f34e224-0947-479f-8652-17601c78104e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:03.473690 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8f34e224-0947-479f-8652-17601c78104e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:03.474913 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8f34e224-0947-479f-8652-17601c78104e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:03.475638 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8f34e224-0947-479f-8652-17601c78104e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:03.476596 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8f34e224-0947-479f-8652-17601c78104e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:03.477999 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8f34e224-0947-479f-8652-17601c78104e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:03.478920 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8f34e224-0947-479f-8652-17601c78104e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:03.546010 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8ff0af4f-aac0-4d79-a039-93d606e343b3 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "DELETE /compute/v2.1/servers/30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c" status: 204 len: 0 microversion: 2.1 time: 0.243533 Aug 31 16:16:03.551374 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2429/5046] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:16:03 2022] DELETE /compute/v2.1/servers/30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:16:03.557270 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3040634d-4135-4507-9594-3de5371dfa37 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:03.558331 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3040634d-4135-4507-9594-3de5371dfa37 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] [instance: 30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:03.566559 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3040634d-4135-4507-9594-3de5371dfa37 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:03.567248 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3040634d-4135-4507-9594-3de5371dfa37 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:03.568591 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3040634d-4135-4507-9594-3de5371dfa37 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:03.569496 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3040634d-4135-4507-9594-3de5371dfa37 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:03.571802 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3040634d-4135-4507-9594-3de5371dfa37 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:03.572250 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3040634d-4135-4507-9594-3de5371dfa37 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:03.738381 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8f34e224-0947-479f-8652-17601c78104e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:03.754014 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8f34e224-0947-479f-8652-17601c78104e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.293331 Aug 31 16:16:03.755130 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2618/5047] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:03 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:16:03.783561 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e19f2ea0-92a1-4797-b820-af00d35103b2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:03.784463 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e19f2ea0-92a1-4797-b820-af00d35103b2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:03.792976 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e19f2ea0-92a1-4797-b820-af00d35103b2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:03.794009 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e19f2ea0-92a1-4797-b820-af00d35103b2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:03.794649 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e19f2ea0-92a1-4797-b820-af00d35103b2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:03.795563 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e19f2ea0-92a1-4797-b820-af00d35103b2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:03.796243 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e19f2ea0-92a1-4797-b820-af00d35103b2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:03.796825 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e19f2ea0-92a1-4797-b820-af00d35103b2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:03.979117 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3040634d-4135-4507-9594-3de5371dfa37 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dabb1c841cde40769174e2f8a97234c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baff3cad5c14325a5576c40fcda0580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:03.994959 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3040634d-4135-4507-9594-3de5371dfa37 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "GET /compute/v2.1/servers/30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c" status: 200 len: 1647 microversion: 2.1 time: 0.441810 Aug 31 16:16:04.000780 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2430/5048] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:03 2022] GET /compute/v2.1/servers/30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c => generated 1647 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:04.041496 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e19f2ea0-92a1-4797-b820-af00d35103b2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:04.051951 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e19f2ea0-92a1-4797-b820-af00d35103b2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.272918 Aug 31 16:16:04.052815 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2619/5049] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:03 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:16:04.230589 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1f61d0c5-0c95-4b3f-9a15-80d6de321bf3 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1699767656", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "1c4c22f6-ea49-4e46-87c2-7de60e095fb8"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1f61d0c5-0c95-4b3f-9a15-80d6de321bf3 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Request method failure captured: Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 173 Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4kQ0XzwgZzM00K2xfqw4sNWznetRNwtM61dwPFzPgxHVwt6ZQqeyy0IDwJXT8yOdP4-2pSJFf0sLdbRTKSty95v4MPjLoaaRhSqpDob3UUxppJFVkB8ZQH-IsYhc50JLxuO54hEVWRh4jtxjaTwZZjw98G6FCIkizac62ua4tSQ6_s Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3e843f3122c14cf8889f26423552792f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3e843f3122c14cf8889f26423552792f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 8b67be53aade4f8c92d6765dd91a4b90 Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1699767656", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "1c4c22f6-ea49-4e46-87c2-7de60e095fb8"}]}} Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1699767656', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '1c4c22f6-ea49-4e46-87c2-7de60e095fb8'}]}}} Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi -1 Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:16:04.238969 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:16:04.246060 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:16:04.246060 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:16:04.246060 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 31 16:16:04.246060 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:04.246060 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:04.246060 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:04.246060 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:04.246060 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:04.246060 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:04.246060 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:16:04.246060 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:16:04.246060 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 31 16:16:04.246060 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:04.249215 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1f61d0c5-0c95-4b3f-9a15-80d6de321bf3 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:16:04.252227 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1f61d0c5-0c95-4b3f-9a15-80d6de321bf3 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.029198 Aug 31 16:16:04.253106 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2431/5050] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:16:04 2022] POST /compute/v2.1/servers => generated 145 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:16:04.261376 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-99b33a41-4231-46dd-aa42-60c374ea5d6f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:04.262615 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-99b33a41-4231-46dd-aa42-60c374ea5d6f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:04.275126 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-99b33a41-4231-46dd-aa42-60c374ea5d6f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:04.275714 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-99b33a41-4231-46dd-aa42-60c374ea5d6f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:04.276462 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-99b33a41-4231-46dd-aa42-60c374ea5d6f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:04.277518 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-99b33a41-4231-46dd-aa42-60c374ea5d6f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:04.278366 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-99b33a41-4231-46dd-aa42-60c374ea5d6f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:04.279212 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-99b33a41-4231-46dd-aa42-60c374ea5d6f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:04.432109 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7ca2c6dc-415f-4f92-bf51-5dd84755067b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:04.437129 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7ca2c6dc-415f-4f92-bf51-5dd84755067b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 1c40a98f-366d-4392-9034-7841f68b2050] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:04.454794 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ca2c6dc-415f-4f92-bf51-5dd84755067b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:04.459511 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ca2c6dc-415f-4f92-bf51-5dd84755067b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:04.460095 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ca2c6dc-415f-4f92-bf51-5dd84755067b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:04.462762 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ca2c6dc-415f-4f92-bf51-5dd84755067b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:04.463440 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ca2c6dc-415f-4f92-bf51-5dd84755067b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:04.463879 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ca2c6dc-415f-4f92-bf51-5dd84755067b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:04.508007 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-99b33a41-4231-46dd-aa42-60c374ea5d6f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:04.518745 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-99b33a41-4231-46dd-aa42-60c374ea5d6f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.261367 Aug 31 16:16:04.520642 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2620/5051] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:04 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:04.526581 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7ca2c6dc-415f-4f92-bf51-5dd84755067b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101192 Aug 31 16:16:04.527523 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2432/5052] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:16:04 2022] GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:16:04.545960 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2b251d0b-eda4-43ee-8e96-1f6af187ac80 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:04.559845 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2b251d0b-eda4-43ee-8e96-1f6af187ac80 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:04.575430 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b251d0b-eda4-43ee-8e96-1f6af187ac80 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:04.576219 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b251d0b-eda4-43ee-8e96-1f6af187ac80 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:04.576911 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b251d0b-eda4-43ee-8e96-1f6af187ac80 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:04.577878 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b251d0b-eda4-43ee-8e96-1f6af187ac80 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:04.578767 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b251d0b-eda4-43ee-8e96-1f6af187ac80 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:04.582823 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b251d0b-eda4-43ee-8e96-1f6af187ac80 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:04.779374 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2b251d0b-eda4-43ee-8e96-1f6af187ac80 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:04.787976 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2b251d0b-eda4-43ee-8e96-1f6af187ac80 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.248323 Aug 31 16:16:04.788565 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2621/5053] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:04 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:04.949507 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-762afcf6-c3c7-451f-bb3b-361fd0a02a5e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-717937193", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:04.954339 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-762afcf6-c3c7-451f-bb3b-361fd0a02a5e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 31 16:16:04.956524 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-762afcf6-c3c7-451f-bb3b-361fd0a02a5e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Request method failure captured: Aug 31 16:16:04.956524 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 31 16:16:04.956524 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:16:04.956524 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:16:04.956524 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:16:04.956524 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 215 Aug 31 16:16:04.956524 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:16:04.956524 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:16:04.956524 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:16:04.956524 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:16:04.956524 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4kQ0XzwgZzM00K2xfqw4sNWznetRNwtM61dwPFzPgxHVwt6ZQqeyy0IDwJXT8yOdP4-2pSJFf0sLdbRTKSty95v4MPjLoaaRhSqpDob3UUxppJFVkB8ZQH-IsYhc50JLxuO54hEVWRh4jtxjaTwZZjw98G6FCIkizac62ua4tSQ6_s Aug 31 16:16:04.956524 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:16:04.956524 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:16:04.956524 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:16:04.956524 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:16:04.956524 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:16:04.956524 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:16:04.956524 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:16:04.956524 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:04.956524 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:16:04.956524 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:16:04.956524 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3e843f3122c14cf8889f26423552792f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3e843f3122c14cf8889f26423552792f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:16:04.956524 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:04.956524 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:16:04.956524 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:04.956524 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:16:04.956524 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:16:04.956524 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:16:04.956524 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 8b67be53aade4f8c92d6765dd91a4b90 Aug 31 16:16:04.956524 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:16:04.956524 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 16:16:04.956524 n-d-833090-16 devstack@n-api.service[128863]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-717937193", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Aug 31 16:16:04.956524 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:16:04.956524 n-d-833090-16 devstack@n-api.service[128863]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 31 16:16:04.956524 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-717937193', 'imageRef': 'd715a41c-0e56-494a-a102-cac65831f6bd', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Aug 31 16:16:04.956524 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:16:04.956524 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:04.956524 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:04.956524 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:04.956524 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:16:04.956524 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:16:04.956524 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:16:04.956524 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:16:04.956524 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:16:04.956524 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:16:04.956524 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:16:04.956524 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:16:04.956524 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:16:04.956524 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:16:04.956524 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 31 16:16:04.956524 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Aug 31 16:16:04.956524 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Aug 31 16:16:04.956524 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Aug 31 16:16:04.956524 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Aug 31 16:16:04.956524 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Aug 31 16:16:04.956524 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._validate_network_id( Aug 31 16:16:04.956524 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Aug 31 16:16:04.956524 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 31 16:16:04.956524 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 31 16:16:04.956524 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:04.956524 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:04.956524 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:04.961925 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:04.961925 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:04.961925 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:04.961925 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:16:04.961925 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:16:04.961925 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 31 16:16:04.961925 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:04.961925 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-762afcf6-c3c7-451f-bb3b-361fd0a02a5e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:16:04.961925 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-762afcf6-c3c7-451f-bb3b-361fd0a02a5e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.012961 Aug 31 16:16:04.968401 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-36fd77af-f613-4415-8247-e0c2eef37155 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:04.969151 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-36fd77af-f613-4415-8247-e0c2eef37155 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:04.973954 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2433/5054] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:16:04 2022] POST /compute/v2.1/servers => generated 123 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:16:04.975908 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-36fd77af-f613-4415-8247-e0c2eef37155 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:04.976396 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-36fd77af-f613-4415-8247-e0c2eef37155 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:04.976826 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-36fd77af-f613-4415-8247-e0c2eef37155 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:04.977510 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-36fd77af-f613-4415-8247-e0c2eef37155 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:04.977950 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-36fd77af-f613-4415-8247-e0c2eef37155 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:04.978395 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-36fd77af-f613-4415-8247-e0c2eef37155 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:05.024322 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bcb6da7d-90f2-4211-a596-8ca6d84157c7 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:05.024956 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bcb6da7d-90f2-4211-a596-8ca6d84157c7 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] [instance: 30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:05.032443 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bcb6da7d-90f2-4211-a596-8ca6d84157c7 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:05.033212 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bcb6da7d-90f2-4211-a596-8ca6d84157c7 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:05.033733 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bcb6da7d-90f2-4211-a596-8ca6d84157c7 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:05.034455 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bcb6da7d-90f2-4211-a596-8ca6d84157c7 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:05.034906 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bcb6da7d-90f2-4211-a596-8ca6d84157c7 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:05.035482 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bcb6da7d-90f2-4211-a596-8ca6d84157c7 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:05.351373 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-36fd77af-f613-4415-8247-e0c2eef37155 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:05.361729 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-36fd77af-f613-4415-8247-e0c2eef37155 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.397574 Aug 31 16:16:05.377568 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2622/5055] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:04 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:05.383704 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4ba81f59-0142-4ca2-bde4-b2ef3d78d81a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:05.384662 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4ba81f59-0142-4ca2-bde4-b2ef3d78d81a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:05.392189 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4ba81f59-0142-4ca2-bde4-b2ef3d78d81a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:05.393132 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4ba81f59-0142-4ca2-bde4-b2ef3d78d81a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:05.393774 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4ba81f59-0142-4ca2-bde4-b2ef3d78d81a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:05.394845 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4ba81f59-0142-4ca2-bde4-b2ef3d78d81a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:05.395535 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4ba81f59-0142-4ca2-bde4-b2ef3d78d81a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:05.396186 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4ba81f59-0142-4ca2-bde4-b2ef3d78d81a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:05.405812 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bcb6da7d-90f2-4211-a596-8ca6d84157c7 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dabb1c841cde40769174e2f8a97234c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baff3cad5c14325a5576c40fcda0580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:05.417440 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bcb6da7d-90f2-4211-a596-8ca6d84157c7 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "GET /compute/v2.1/servers/30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c" status: 200 len: 1647 microversion: 2.1 time: 0.398034 Aug 31 16:16:05.419768 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2434/5056] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:05 2022] GET /compute/v2.1/servers/30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c => generated 1647 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:05.551277 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dfa632b0-24d5-4a1b-aa16-8d214ccaed6b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:05.553823 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dfa632b0-24d5-4a1b-aa16-8d214ccaed6b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 1c40a98f-366d-4392-9034-7841f68b2050] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:05.562391 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfa632b0-24d5-4a1b-aa16-8d214ccaed6b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:05.563616 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfa632b0-24d5-4a1b-aa16-8d214ccaed6b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:05.564676 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfa632b0-24d5-4a1b-aa16-8d214ccaed6b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:05.565945 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfa632b0-24d5-4a1b-aa16-8d214ccaed6b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:05.566852 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfa632b0-24d5-4a1b-aa16-8d214ccaed6b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:05.567337 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfa632b0-24d5-4a1b-aa16-8d214ccaed6b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:05.607792 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dfa632b0-24d5-4a1b-aa16-8d214ccaed6b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063099 Aug 31 16:16:05.608942 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2435/5057] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:16:05 2022] GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:16:05.624755 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4ba81f59-0142-4ca2-bde4-b2ef3d78d81a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:05.636214 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4ba81f59-0142-4ca2-bde4-b2ef3d78d81a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.256880 Aug 31 16:16:05.637366 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2623/5058] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:05 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:05.705828 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-91fb7dec-04bd-415c-8ac9-e51bcb387b34 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:05.708790 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-91fb7dec-04bd-415c-8ac9-e51bcb387b34 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:05.715259 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91fb7dec-04bd-415c-8ac9-e51bcb387b34 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:05.716036 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91fb7dec-04bd-415c-8ac9-e51bcb387b34 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:05.717326 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91fb7dec-04bd-415c-8ac9-e51bcb387b34 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:05.719190 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91fb7dec-04bd-415c-8ac9-e51bcb387b34 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:05.720296 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91fb7dec-04bd-415c-8ac9-e51bcb387b34 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:05.720959 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91fb7dec-04bd-415c-8ac9-e51bcb387b34 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:05.795446 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b210b4b4-2938-4f4d-9ac5-66960950e677 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-968092734", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "key_name": "tempest-key-795226121", "networks": [{"uuid": "1c4c22f6-ea49-4e46-87c2-7de60e095fb8"}]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:05.809133 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-91fb7dec-04bd-415c-8ac9-e51bcb387b34 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] HTTP exception thrown: Cannot 'reboot' instance 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f while it is in vm_state rescued Aug 31 16:16:05.819340 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-91fb7dec-04bd-415c-8ac9-e51bcb387b34 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Request method failure captured: Aug 31 16:16:05.819340 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f/action HTTP/1.1 Aug 31 16:16:05.819340 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:16:05.819340 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:16:05.819340 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:16:05.819340 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 28 Aug 31 16:16:05.819340 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:16:05.819340 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:16:05.819340 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:16:05.819340 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:16:05.819340 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4gyS9s2L5B9hQNj6-3Bq9VaD0LX3rcaQEx2TULT5jAIwE_syzV3-H131XTbmJBlDQO8oVuY07kOMzEcgw7jqBoRJefg3cpTEEDA9_ABXOKuvCpOJqmPJLOqW4m5eFAB54B22EgPHkAmNh0-egef1rV97h7ELSV4bCzsJF6Z18KMZ5s Aug 31 16:16:05.819340 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:16:05.819340 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:16:05.819340 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:16:05.819340 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:16:05.819340 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:16:05.819340 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:16:05.819340 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: d25e1b1938b2401bab27dafadc9745d5 Aug 31 16:16:05.819340 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-961929748 Aug 31 16:16:05.819340 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:16:05.819340 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:16:05.819340 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d25e1b1938b2401bab27dafadc9745d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d25e1b1938b2401bab27dafadc9745d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d25e1b1938b2401bab27dafadc9745d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d25e1b1938b2401bab27dafadc9745d5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:16:05.819340 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServerRescueNegativeTestJSON-961929748 Aug 31 16:16:05.819340 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: d25e1b1938b2401bab27dafadc9745d5 Aug 31 16:16:05.819340 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-961929748 Aug 31 16:16:05.819340 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServerRescueNegativeTestJSON-961929748-project Aug 31 16:16:05.819340 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:16:05.819340 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:16:05.819340 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: b5f67b54e87c46d28e7d5217bf49ca57 Aug 31 16:16:05.819340 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServerRescueNegativeTestJSON-961929748-project Aug 31 16:16:05.819340 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 16:16:05.819340 n-d-833090-16 devstack@n-api.service[128863]: {"reboot": {"type": "HARD"}} Aug 31 16:16:05.819340 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:16:05.819340 n-d-833090-16 devstack@n-api.service[128863]: exception: Cannot 'reboot' instance 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f while it is in vm_state rescued Aug 31 16:16:05.819340 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f', 'body': {'reboot': {'type': 'HARD'}}} Aug 31 16:16:05.819340 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:16:05.819340 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:05.819340 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Aug 31 16:16:05.819340 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Aug 31 16:16:05.819340 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 16:16:05.819340 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 16:16:05.819340 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Aug 31 16:16:05.819340 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Aug 31 16:16:05.819340 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 16:16:05.819340 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 16:16:05.819340 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Aug 31 16:16:05.819340 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:05.819340 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:05.819340 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:05.819340 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:05.819340 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:05.819340 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:05.819340 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:16:05.819340 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:16:05.819340 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:16:05.819340 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:16:05.819340 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:16:05.819340 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:16:05.819340 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Aug 31 16:16:05.819340 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 16:16:05.819340 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 16:16:05.819340 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 16:16:05.825030 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f while it is in vm_state rescued Aug 31 16:16:05.825030 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:05.825030 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:05.825030 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:05.825030 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:05.825030 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:05.825030 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:05.825030 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:16:05.825030 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:16:05.825030 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f while it is in vm_state rescued Aug 31 16:16:05.825030 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:05.825030 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-91fb7dec-04bd-415c-8ac9-e51bcb387b34 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Returning 409 to user: Cannot 'reboot' instance 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f while it is in vm_state rescued {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:16:05.827555 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-91fb7dec-04bd-415c-8ac9-e51bcb387b34 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "POST /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f/action" status: 409 len: 145 microversion: 2.1 time: 0.122463 Aug 31 16:16:05.827943 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2436/5059] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:16:05 2022] POST /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f/action => generated 145 bytes in 129 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 16:16:05.843800 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4d49c3b8-c82d-417a-a5d0-c68f15f63064 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:05.852377 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4d49c3b8-c82d-417a-a5d0-c68f15f63064 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:05.861233 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d49c3b8-c82d-417a-a5d0-c68f15f63064 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:05.861892 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d49c3b8-c82d-417a-a5d0-c68f15f63064 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:05.862344 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d49c3b8-c82d-417a-a5d0-c68f15f63064 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:05.863279 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d49c3b8-c82d-417a-a5d0-c68f15f63064 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:05.864027 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d49c3b8-c82d-417a-a5d0-c68f15f63064 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:05.864727 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4d49c3b8-c82d-417a-a5d0-c68f15f63064 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:05.912630 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-b210b4b4-2938-4f4d-9ac5-66960950e677 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] validate_networks() for [('1c4c22f6-ea49-4e46-87c2-7de60e095fb8', None, None, None, None, None)] {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:16:05.942324 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-4d49c3b8-c82d-417a-a5d0-c68f15f63064 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] HTTP exception thrown: Cannot 'rebuild' instance 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f while it is in vm_state rescued Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4d49c3b8-c82d-417a-a5d0-c68f15f63064 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Request method failure captured: Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f/action HTTP/1.1 Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 65 Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4gyS9s2L5B9hQNj6-3Bq9VaD0LX3rcaQEx2TULT5jAIwE_syzV3-H131XTbmJBlDQO8oVuY07kOMzEcgw7jqBoRJefg3cpTEEDA9_ABXOKuvCpOJqmPJLOqW4m5eFAB54B22EgPHkAmNh0-egef1rV97h7ELSV4bCzsJF6Z18KMZ5s Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: d25e1b1938b2401bab27dafadc9745d5 Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-961929748 Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d25e1b1938b2401bab27dafadc9745d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d25e1b1938b2401bab27dafadc9745d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d25e1b1938b2401bab27dafadc9745d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d25e1b1938b2401bab27dafadc9745d5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServerRescueNegativeTestJSON-961929748 Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: d25e1b1938b2401bab27dafadc9745d5 Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-961929748 Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServerRescueNegativeTestJSON-961929748-project Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: b5f67b54e87c46d28e7d5217bf49ca57 Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServerRescueNegativeTestJSON-961929748-project Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: {"rebuild": {"imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd"}} Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: exception: Cannot 'rebuild' instance 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f while it is in vm_state rescued Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f', 'body': {'rebuild': {'imageRef': 'd715a41c-0e56-494a-a102-cac65831f6bd'}}} Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f in vm_state rescued. Cannot rebuild while the instance is in this state. Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:16:05.946695 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:16:05.951942 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:16:05.951942 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 31 16:16:05.951942 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Aug 31 16:16:05.951942 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 16:16:05.951942 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 16:16:05.951942 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 16:16:05.951942 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f while it is in vm_state rescued Aug 31 16:16:05.951942 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:05.951942 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:05.951942 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:05.951942 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:05.951942 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:05.951942 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:05.951942 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:16:05.951942 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:16:05.951942 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f while it is in vm_state rescued Aug 31 16:16:05.951942 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:05.955993 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4d49c3b8-c82d-417a-a5d0-c68f15f63064 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Returning 409 to user: Cannot 'rebuild' instance 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f while it is in vm_state rescued {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:16:05.959414 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4d49c3b8-c82d-417a-a5d0-c68f15f63064 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "POST /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f/action" status: 409 len: 146 microversion: 2.1 time: 0.125218 Aug 31 16:16:05.963087 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2437/5060] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:16:05 2022] POST /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f/action => generated 146 bytes in 131 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 16:16:05.972639 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-2556ccbf-f7b8-4f41-8835-284b44cf6726 req-72b1c2dd-5f9c-4784-81b3-e351e321a448 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c", "name": "network-vif-deleted", "tag": "cc1d20a8-7d6e-45fd-8862-92c3e6d7af2e"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:05.985472 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2556ccbf-f7b8-4f41-8835-284b44cf6726 req-72b1c2dd-5f9c-4784-81b3-e351e321a448 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:05.986656 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2556ccbf-f7b8-4f41-8835-284b44cf6726 req-72b1c2dd-5f9c-4784-81b3-e351e321a448 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:05.987719 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2556ccbf-f7b8-4f41-8835-284b44cf6726 req-72b1c2dd-5f9c-4784-81b3-e351e321a448 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:06.005332 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-2556ccbf-f7b8-4f41-8835-284b44cf6726 req-72b1c2dd-5f9c-4784-81b3-e351e321a448 service nova] Creating event network-vif-deleted:cc1d20a8-7d6e-45fd-8862-92c3e6d7af2e for instance 30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c on n-h1-833090-16 Aug 31 16:16:06.012353 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-2556ccbf-f7b8-4f41-8835-284b44cf6726 req-72b1c2dd-5f9c-4784-81b3-e351e321a448 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047665 Aug 31 16:16:06.013006 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2438/5061] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:16:06.020322 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cc34a09f-ad71-4945-a359-8d55dc6bed07 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:06.021130 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cc34a09f-ad71-4945-a359-8d55dc6bed07 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 1c40a98f-366d-4392-9034-7841f68b2050] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:06.028604 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cc34a09f-ad71-4945-a359-8d55dc6bed07 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:06.029984 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cc34a09f-ad71-4945-a359-8d55dc6bed07 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:06.030617 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cc34a09f-ad71-4945-a359-8d55dc6bed07 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:06.032015 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cc34a09f-ad71-4945-a359-8d55dc6bed07 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:06.032672 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cc34a09f-ad71-4945-a359-8d55dc6bed07 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:06.033374 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cc34a09f-ad71-4945-a359-8d55dc6bed07 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:06.067582 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cc34a09f-ad71-4945-a359-8d55dc6bed07 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 1c40a98f-366d-4392-9034-7841f68b2050] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:16:06.230381 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cc34a09f-ad71-4945-a359-8d55dc6bed07 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "DELETE /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050" status: 204 len: 0 microversion: 2.1 time: 0.213812 Aug 31 16:16:06.238978 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2439/5062] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:16:06 2022] DELETE /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:16:06.250357 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7c3a213c-7895-4be5-894a-433e1b56f5a1 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:06.251445 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7c3a213c-7895-4be5-894a-433e1b56f5a1 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 1c40a98f-366d-4392-9034-7841f68b2050] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:06.260322 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-b210b4b4-2938-4f4d-9ac5-66960950e677 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] HTTP exception thrown: Invalid key_name provided. Aug 31 16:16:06.262594 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b210b4b4-2938-4f4d-9ac5-66960950e677 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Request method failure captured: Aug 31 16:16:06.262594 n-d-833090-16 devstack@n-api.service[128864]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 31 16:16:06.262594 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:16:06.262594 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:16:06.262594 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:16:06.262594 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 245 Aug 31 16:16:06.262594 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:16:06.262594 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:16:06.262594 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:16:06.262594 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:16:06.262594 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4kQ0XzwgZzM00K2xfqw4sNWznetRNwtM61dwPFzPgxHVwt6ZQqeyy0IDwJXT8yOdP4-2pSJFf0sLdbRTKSty95v4MPjLoaaRhSqpDob3UUxppJFVkB8ZQH-IsYhc50JLxuO54hEVWRh4jtxjaTwZZjw98G6FCIkizac62ua4tSQ6_s Aug 31 16:16:06.262594 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:16:06.262594 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:16:06.262594 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:16:06.262594 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:16:06.262594 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:16:06.262594 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:16:06.262594 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:16:06.262594 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:06.262594 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:16:06.262594 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:16:06.262594 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3e843f3122c14cf8889f26423552792f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3e843f3122c14cf8889f26423552792f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:16:06.262594 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:06.262594 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:16:06.262594 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:06.262594 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:16:06.262594 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:16:06.262594 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:16:06.262594 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 8b67be53aade4f8c92d6765dd91a4b90 Aug 31 16:16:06.262594 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:16:06.262594 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 16:16:06.262594 n-d-833090-16 devstack@n-api.service[128864]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-968092734", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "key_name": "tempest-key-795226121", "networks": [{"uuid": "1c4c22f6-ea49-4e46-87c2-7de60e095fb8"}]}} Aug 31 16:16:06.262594 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:16:06.262594 n-d-833090-16 devstack@n-api.service[128864]: exception: Invalid key_name provided. Aug 31 16:16:06.262594 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-968092734', 'imageRef': 'd715a41c-0e56-494a-a102-cac65831f6bd', 'flavorRef': '452', 'key_name': 'tempest-key-795226121', 'networks': [{'uuid': '1c4c22f6-ea49-4e46-87c2-7de60e095fb8'}]}}} Aug 31 16:16:06.262594 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:16:06.262594 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:06.262594 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 31 16:16:06.262594 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 31 16:16:06.262594 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 31 16:16:06.262594 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 31 16:16:06.262594 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Aug 31 16:16:06.262594 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 31 16:16:06.262594 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Aug 31 16:16:06.262594 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Aug 31 16:16:06.262594 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 16:16:06.262594 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 16:16:06.262594 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 31 16:16:06.262594 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 31 16:16:06.262594 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 31 16:16:06.262594 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 31 16:16:06.262594 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 31 16:16:06.262594 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 31 16:16:06.262594 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 31 16:16:06.262594 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 31 16:16:06.262594 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-795226121 not found for user 8b67be53aade4f8c92d6765dd91a4b90 Aug 31 16:16:06.262594 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:06.262594 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:06.262594 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:06.262594 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:06.262594 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:06.268284 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:06.268284 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:16:06.268284 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:16:06.268284 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:16:06.268284 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:16:06.268284 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:16:06.268284 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:16:06.268284 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:16:06.268284 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:16:06.268284 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:16:06.268284 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:16:06.268284 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 31 16:16:06.268284 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Aug 31 16:16:06.268284 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 31 16:16:06.268284 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Aug 31 16:16:06.268284 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:06.268284 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:06.268284 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:06.268284 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:06.268284 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:06.268284 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:06.268284 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:16:06.268284 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:16:06.268284 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Aug 31 16:16:06.268284 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:06.273484 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c3a213c-7895-4be5-894a-433e1b56f5a1 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:06.273484 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c3a213c-7895-4be5-894a-433e1b56f5a1 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:06.273875 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b210b4b4-2938-4f4d-9ac5-66960950e677 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Returning 400 to user: Invalid key_name provided. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:16:06.273988 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c3a213c-7895-4be5-894a-433e1b56f5a1 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:06.274124 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b210b4b4-2938-4f4d-9ac5-66960950e677 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.482412 Aug 31 16:16:06.274231 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c3a213c-7895-4be5-894a-433e1b56f5a1 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:06.274553 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c3a213c-7895-4be5-894a-433e1b56f5a1 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:06.275089 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c3a213c-7895-4be5-894a-433e1b56f5a1 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:06.275969 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2624/5063] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:16:05 2022] POST /compute/v2.1/servers => generated 70 bytes in 486 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Aug 31 16:16:06.285607 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-469065ef-2a80-4de4-bc38-ce670808b8ad tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:06.286942 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-469065ef-2a80-4de4-bc38-ce670808b8ad tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:06.294652 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-469065ef-2a80-4de4-bc38-ce670808b8ad tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:06.295466 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-469065ef-2a80-4de4-bc38-ce670808b8ad tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:06.296067 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-469065ef-2a80-4de4-bc38-ce670808b8ad tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:06.296975 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-469065ef-2a80-4de4-bc38-ce670808b8ad tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:06.297710 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-469065ef-2a80-4de4-bc38-ce670808b8ad tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:06.299547 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-469065ef-2a80-4de4-bc38-ce670808b8ad tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:06.615219 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7c3a213c-7895-4be5-894a-433e1b56f5a1 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:06.620240 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-469065ef-2a80-4de4-bc38-ce670808b8ad tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:06.629904 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-469065ef-2a80-4de4-bc38-ce670808b8ad tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.352150 Aug 31 16:16:06.631093 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2625/5064] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:06 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:16:06.632070 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7c3a213c-7895-4be5-894a-433e1b56f5a1 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050" status: 200 len: 1690 microversion: 2.1 time: 0.391591 Aug 31 16:16:06.634037 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2440/5065] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:06 2022] GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050 => generated 1690 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:06.650080 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3a6613fa-8f7a-42ac-b746-780f1398217b tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:06.650719 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3a6613fa-8f7a-42ac-b746-780f1398217b tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] [instance: 30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:06.653792 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d8e6031d-6b0e-4c17-9f21-542ccd09d3e4 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:06.654438 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d8e6031d-6b0e-4c17-9f21-542ccd09d3e4 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:06.661053 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8e6031d-6b0e-4c17-9f21-542ccd09d3e4 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:06.661539 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8e6031d-6b0e-4c17-9f21-542ccd09d3e4 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:06.661974 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8e6031d-6b0e-4c17-9f21-542ccd09d3e4 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:06.662716 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8e6031d-6b0e-4c17-9f21-542ccd09d3e4 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:06.663160 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8e6031d-6b0e-4c17-9f21-542ccd09d3e4 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:06.663903 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8e6031d-6b0e-4c17-9f21-542ccd09d3e4 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:06.665749 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3a6613fa-8f7a-42ac-b746-780f1398217b tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:06.666895 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3a6613fa-8f7a-42ac-b746-780f1398217b tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:06.667728 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3a6613fa-8f7a-42ac-b746-780f1398217b tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:06.668740 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3a6613fa-8f7a-42ac-b746-780f1398217b tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:06.672455 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3a6613fa-8f7a-42ac-b746-780f1398217b tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:06.672455 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3a6613fa-8f7a-42ac-b746-780f1398217b tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:06.706886 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3a6613fa-8f7a-42ac-b746-780f1398217b tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:06.707718 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3a6613fa-8f7a-42ac-b746-780f1398217b tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:06.708498 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3a6613fa-8f7a-42ac-b746-780f1398217b tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:06.709313 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-3a6613fa-8f7a-42ac-b746-780f1398217b tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lazy-loading 'fault' on Instance uuid 30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:16:06.795567 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3a6613fa-8f7a-42ac-b746-780f1398217b tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dabb1c841cde40769174e2f8a97234c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baff3cad5c14325a5576c40fcda0580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:06.806455 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3a6613fa-8f7a-42ac-b746-780f1398217b tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "GET /compute/v2.1/servers/30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c" status: 200 len: 1306 microversion: 2.1 time: 0.173437 Aug 31 16:16:06.810217 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2626/5066] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:06 2022] GET /compute/v2.1/servers/30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c => generated 1306 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:06.871979 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d8e6031d-6b0e-4c17-9f21-542ccd09d3e4 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:06.882049 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d8e6031d-6b0e-4c17-9f21-542ccd09d3e4 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.232831 Aug 31 16:16:06.882722 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2441/5067] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:06 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:07.036359 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ac0ebabe-298b-45f2-b809-e496075428c5 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-225061124", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "1c4c22f6-ea49-4e46-87c2-7de60e095fb8"}]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:07.170239 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.security_group_api [None req-ac0ebabe-298b-45f2-b809-e496075428c5 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Neutron security group does_not_exist not found {{(pid=128864) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Aug 31 16:16:07.171153 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-ac0ebabe-298b-45f2-b809-e496075428c5 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Aug 31 16:16:07.178184 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ac0ebabe-298b-45f2-b809-e496075428c5 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Request method failure captured: Aug 31 16:16:07.178184 n-d-833090-16 devstack@n-api.service[128864]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 31 16:16:07.178184 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:16:07.178184 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:16:07.178184 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:16:07.178184 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 257 Aug 31 16:16:07.178184 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:16:07.178184 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:16:07.178184 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:16:07.178184 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:16:07.178184 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4kQ0XzwgZzM00K2xfqw4sNWznetRNwtM61dwPFzPgxHVwt6ZQqeyy0IDwJXT8yOdP4-2pSJFf0sLdbRTKSty95v4MPjLoaaRhSqpDob3UUxppJFVkB8ZQH-IsYhc50JLxuO54hEVWRh4jtxjaTwZZjw98G6FCIkizac62ua4tSQ6_s Aug 31 16:16:07.178184 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:16:07.178184 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:16:07.178184 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:16:07.178184 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:16:07.178184 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:16:07.178184 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:16:07.178184 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:16:07.178184 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:07.178184 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:16:07.178184 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:16:07.178184 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3e843f3122c14cf8889f26423552792f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3e843f3122c14cf8889f26423552792f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:16:07.178184 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:07.178184 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:16:07.178184 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:07.178184 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:16:07.178184 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:16:07.178184 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:16:07.178184 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 8b67be53aade4f8c92d6765dd91a4b90 Aug 31 16:16:07.178184 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:16:07.178184 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 16:16:07.178184 n-d-833090-16 devstack@n-api.service[128864]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-225061124", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "1c4c22f6-ea49-4e46-87c2-7de60e095fb8"}]}} Aug 31 16:16:07.178184 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:16:07.178184 n-d-833090-16 devstack@n-api.service[128864]: exception: Unable to find security_group with name or id 'does_not_exist' Aug 31 16:16:07.178184 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-225061124', 'imageRef': 'd715a41c-0e56-494a-a102-cac65831f6bd', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '1c4c22f6-ea49-4e46-87c2-7de60e095fb8'}]}}} Aug 31 16:16:07.178184 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:16:07.178184 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:07.178184 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Aug 31 16:16:07.178184 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Aug 31 16:16:07.178184 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:16:07.178184 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:16:07.178184 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Aug 31 16:16:07.178184 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 31 16:16:07.178184 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Aug 31 16:16:07.178184 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:07.178184 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:07.178184 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:07.178184 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:07.178184 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Aug 31 16:16:07.178184 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Aug 31 16:16:07.178184 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:16:07.178184 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:16:07.178184 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Aug 31 16:16:07.178184 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 31 16:16:07.178184 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Aug 31 16:16:07.178184 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:07.178184 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:07.178184 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:07.178184 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:07.178184 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Aug 31 16:16:07.178184 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Aug 31 16:16:07.183043 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Aug 31 16:16:07.183043 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Aug 31 16:16:07.183043 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Aug 31 16:16:07.183043 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Aug 31 16:16:07.183043 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 31 16:16:07.183043 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 31 16:16:07.183043 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Aug 31 16:16:07.183043 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Aug 31 16:16:07.183043 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Aug 31 16:16:07.183043 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:07.183043 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:07.183043 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:07.183043 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:07.183043 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 31 16:16:07.183043 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 31 16:16:07.183043 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 31 16:16:07.183043 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 31 16:16:07.183043 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Aug 31 16:16:07.183043 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 31 16:16:07.183043 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Aug 31 16:16:07.183043 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Aug 31 16:16:07.183043 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Aug 31 16:16:07.183043 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Aug 31 16:16:07.183043 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Aug 31 16:16:07.183043 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 31 16:16:07.183043 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Aug 31 16:16:07.183043 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:07.183043 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:07.183043 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:07.183043 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:07.183043 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:07.183043 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:07.183043 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:16:07.183043 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:16:07.183043 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:16:07.183043 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:16:07.183043 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:16:07.183043 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:16:07.183043 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:16:07.183043 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:16:07.183043 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:16:07.183043 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:16:07.183043 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 31 16:16:07.183043 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 31 16:16:07.183043 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 31 16:16:07.183043 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Aug 31 16:16:07.183043 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:07.183043 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:07.183043 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:07.183043 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:07.183043 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:07.183043 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:07.183043 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:16:07.183043 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:16:07.183043 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Aug 31 16:16:07.183043 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:07.191828 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ac0ebabe-298b-45f2-b809-e496075428c5 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:16:07.191828 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ac0ebabe-298b-45f2-b809-e496075428c5 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.159423 Aug 31 16:16:07.192403 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2627/5068] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:16:07 2022] POST /compute/v2.1/servers => generated 106 bytes in 162 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:16:07.201387 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4cd260d3-4286-438b-aef0-dc7d22c19148 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:07.203219 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4cd260d3-4286-438b-aef0-dc7d22c19148 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:07.211309 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4cd260d3-4286-438b-aef0-dc7d22c19148 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:07.212051 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4cd260d3-4286-438b-aef0-dc7d22c19148 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:07.213195 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4cd260d3-4286-438b-aef0-dc7d22c19148 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:07.214116 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4cd260d3-4286-438b-aef0-dc7d22c19148 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:07.214731 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4cd260d3-4286-438b-aef0-dc7d22c19148 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:07.215809 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4cd260d3-4286-438b-aef0-dc7d22c19148 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:07.452028 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4cd260d3-4286-438b-aef0-dc7d22c19148 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:07.461515 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4cd260d3-4286-438b-aef0-dc7d22c19148 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.265603 Aug 31 16:16:07.475071 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2442/5069] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:07 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:07.484755 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-92b06a2e-d036-432c-8e80-b6a5048a809c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:07.485358 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-92b06a2e-d036-432c-8e80-b6a5048a809c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:07.493164 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-92b06a2e-d036-432c-8e80-b6a5048a809c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:07.494332 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-92b06a2e-d036-432c-8e80-b6a5048a809c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:07.495696 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-92b06a2e-d036-432c-8e80-b6a5048a809c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:07.496878 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-92b06a2e-d036-432c-8e80-b6a5048a809c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:07.497896 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-92b06a2e-d036-432c-8e80-b6a5048a809c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:07.498537 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-92b06a2e-d036-432c-8e80-b6a5048a809c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:07.655693 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-72b2f35f-212e-4c69-a04a-203bd4355056 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:07.656636 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-72b2f35f-212e-4c69-a04a-203bd4355056 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 1c40a98f-366d-4392-9034-7841f68b2050] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:07.664188 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72b2f35f-212e-4c69-a04a-203bd4355056 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:07.664673 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72b2f35f-212e-4c69-a04a-203bd4355056 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:07.665090 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72b2f35f-212e-4c69-a04a-203bd4355056 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:07.665867 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72b2f35f-212e-4c69-a04a-203bd4355056 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:07.666257 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72b2f35f-212e-4c69-a04a-203bd4355056 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:07.666675 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72b2f35f-212e-4c69-a04a-203bd4355056 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:07.756686 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-92b06a2e-d036-432c-8e80-b6a5048a809c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:07.765297 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-92b06a2e-d036-432c-8e80-b6a5048a809c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.285119 Aug 31 16:16:07.766472 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2628/5070] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:07 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:07.787425 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-120eeefc-7265-49d2-9f85-cfd0fa42e65c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:07.788463 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-120eeefc-7265-49d2-9f85-cfd0fa42e65c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: e82035d7-4037-47b5-8fad-a6095d6a2fe8] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:07.802770 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-120eeefc-7265-49d2-9f85-cfd0fa42e65c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] HTTP exception thrown: Instance e82035d7-4037-47b5-8fad-a6095d6a2fe8 could not be found. Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-120eeefc-7265-49d2-9f85-cfd0fa42e65c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Request method failure captured: Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: request: DELETE /compute/v2.1/servers/e82035d7-4037-47b5-8fad-a6095d6a2fe8 HTTP/1.1 Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4kQ0XzwgZzM00K2xfqw4sNWznetRNwtM61dwPFzPgxHVwt6ZQqeyy0IDwJXT8yOdP4-2pSJFf0sLdbRTKSty95v4MPjLoaaRhSqpDob3UUxppJFVkB8ZQH-IsYhc50JLxuO54hEVWRh4jtxjaTwZZjw98G6FCIkizac62ua4tSQ6_s Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3e843f3122c14cf8889f26423552792f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3e843f3122c14cf8889f26423552792f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 8b67be53aade4f8c92d6765dd91a4b90 Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance e82035d7-4037-47b5-8fad-a6095d6a2fe8 could not be found. Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'e82035d7-4037-47b5-8fad-a6095d6a2fe8'} Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e82035d7-4037-47b5-8fad-a6095d6a2fe8 could not be found. Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e82035d7-4037-47b5-8fad-a6095d6a2fe8 could not be found. Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:07.806031 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:07.814655 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:07.814655 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:07.814655 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:07.814655 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:07.814655 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:16:07.814655 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:16:07.814655 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e82035d7-4037-47b5-8fad-a6095d6a2fe8 could not be found. Aug 31 16:16:07.814655 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:07.817467 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-120eeefc-7265-49d2-9f85-cfd0fa42e65c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Returning 404 to user: Instance e82035d7-4037-47b5-8fad-a6095d6a2fe8 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:16:07.819107 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-120eeefc-7265-49d2-9f85-cfd0fa42e65c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e82035d7-4037-47b5-8fad-a6095d6a2fe8" status: 404 len: 111 microversion: 2.1 time: 0.035693 Aug 31 16:16:07.820681 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2629/5071] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:16:07 2022] DELETE /compute/v2.1/servers/e82035d7-4037-47b5-8fad-a6095d6a2fe8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:16:07.832768 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1cabfe37-f35e-49a0-b520-0ee1bd48476e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:07.834395 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1cabfe37-f35e-49a0-b520-0ee1bd48476e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:07.845687 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1cabfe37-f35e-49a0-b520-0ee1bd48476e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:07.846453 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1cabfe37-f35e-49a0-b520-0ee1bd48476e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:07.847388 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1cabfe37-f35e-49a0-b520-0ee1bd48476e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:07.847784 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-72b2f35f-212e-4c69-a04a-203bd4355056 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:07.848857 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1cabfe37-f35e-49a0-b520-0ee1bd48476e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:07.849902 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1cabfe37-f35e-49a0-b520-0ee1bd48476e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:07.850592 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1cabfe37-f35e-49a0-b520-0ee1bd48476e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:07.862062 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-72b2f35f-212e-4c69-a04a-203bd4355056 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050" status: 200 len: 1690 microversion: 2.1 time: 0.208053 Aug 31 16:16:07.866729 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2443/5072] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:07 2022] GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050 => generated 1690 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:16:07.881406 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ed744177-bd48-49a6-95ac-d09496795149 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:07.882916 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ed744177-bd48-49a6-95ac-d09496795149 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] [instance: 30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:07.900306 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed744177-bd48-49a6-95ac-d09496795149 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:07.901524 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed744177-bd48-49a6-95ac-d09496795149 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:07.902593 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed744177-bd48-49a6-95ac-d09496795149 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:07.904947 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed744177-bd48-49a6-95ac-d09496795149 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:07.905878 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed744177-bd48-49a6-95ac-d09496795149 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:07.906869 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed744177-bd48-49a6-95ac-d09496795149 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:07.965872 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed744177-bd48-49a6-95ac-d09496795149 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:07.966573 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed744177-bd48-49a6-95ac-d09496795149 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:07.969496 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed744177-bd48-49a6-95ac-d09496795149 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:07.970306 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-ed744177-bd48-49a6-95ac-d09496795149 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lazy-loading 'fault' on Instance uuid 30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:16:08.039891 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ed744177-bd48-49a6-95ac-d09496795149 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dabb1c841cde40769174e2f8a97234c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baff3cad5c14325a5576c40fcda0580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:08.063613 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1cabfe37-f35e-49a0-b520-0ee1bd48476e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:08.072309 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1cabfe37-f35e-49a0-b520-0ee1bd48476e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.247410 Aug 31 16:16:08.082658 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2630/5073] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:07 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:16:08.084114 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ed744177-bd48-49a6-95ac-d09496795149 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "GET /compute/v2.1/servers/30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c" status: 200 len: 1306 microversion: 2.1 time: 0.204621 Aug 31 16:16:08.086545 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2444/5074] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:07 2022] GET /compute/v2.1/servers/30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c => generated 1306 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:08.109526 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e494efd4-6de7-41e0-9f76-1b91568d4484 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:08.110498 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e494efd4-6de7-41e0-9f76-1b91568d4484 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:08.121588 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e494efd4-6de7-41e0-9f76-1b91568d4484 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:08.122395 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e494efd4-6de7-41e0-9f76-1b91568d4484 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:08.123061 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e494efd4-6de7-41e0-9f76-1b91568d4484 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:08.124415 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e494efd4-6de7-41e0-9f76-1b91568d4484 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:08.125352 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e494efd4-6de7-41e0-9f76-1b91568d4484 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:08.126010 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e494efd4-6de7-41e0-9f76-1b91568d4484 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:08.307199 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e494efd4-6de7-41e0-9f76-1b91568d4484 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:08.316389 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e494efd4-6de7-41e0-9f76-1b91568d4484 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.215667 Aug 31 16:16:08.317246 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2631/5075] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:08 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:08.339319 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d3065da2-37b4-4215-8f75-e6500a06d1cf tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:08.340047 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d3065da2-37b4-4215-8f75-e6500a06d1cf tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Failed to fetch instance by id 9223372036854775808 {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 31 16:16:08.341304 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-d3065da2-37b4-4215-8f75-e6500a06d1cf tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d3065da2-37b4-4215-8f75-e6500a06d1cf tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Request method failure captured: Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4kQ0XzwgZzM00K2xfqw4sNWznetRNwtM61dwPFzPgxHVwt6ZQqeyy0IDwJXT8yOdP4-2pSJFf0sLdbRTKSty95v4MPjLoaaRhSqpDob3UUxppJFVkB8ZQH-IsYhc50JLxuO54hEVWRh4jtxjaTwZZjw98G6FCIkizac62ua4tSQ6_s Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3e843f3122c14cf8889f26423552792f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3e843f3122c14cf8889f26423552792f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 8b67be53aade4f8c92d6765dd91a4b90 Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 9223372036854775808 could not be found. Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '9223372036854775808'} Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:08.343007 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:08.350840 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:08.350840 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:16:08.350840 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:16:08.350840 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Aug 31 16:16:08.350840 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:08.350840 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d3065da2-37b4-4215-8f75-e6500a06d1cf tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:16:08.350840 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d3065da2-37b4-4215-8f75-e6500a06d1cf tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.010863 Aug 31 16:16:08.350840 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2445/5076] 10.222.0.50 () {58 vars in 1188 bytes} [Wed Aug 31 16:16:08 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 16:16:08.354902 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c12f3676-4a12-471c-a473-0643649d79ca tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:08.355530 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c12f3676-4a12-471c-a473-0643649d79ca tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:08.357454 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:16:08.366161 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c12f3676-4a12-471c-a473-0643649d79ca tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:08.367034 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c12f3676-4a12-471c-a473-0643649d79ca tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:08.367484 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c12f3676-4a12-471c-a473-0643649d79ca tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:08.368241 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c12f3676-4a12-471c-a473-0643649d79ca tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:08.368697 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c12f3676-4a12-471c-a473-0643649d79ca tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:08.369204 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c12f3676-4a12-471c-a473-0643649d79ca tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:08.640062 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c12f3676-4a12-471c-a473-0643649d79ca tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:08.650070 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c12f3676-4a12-471c-a473-0643649d79ca tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.299083 Aug 31 16:16:08.650750 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2632/5077] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:08 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:08.673342 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0e933a45-22e6-41d6-b5ad-228d4473274e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:08.674487 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0e933a45-22e6-41d6-b5ad-228d4473274e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:08.683115 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e933a45-22e6-41d6-b5ad-228d4473274e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:08.683601 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e933a45-22e6-41d6-b5ad-228d4473274e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:08.684030 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e933a45-22e6-41d6-b5ad-228d4473274e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:08.685012 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e933a45-22e6-41d6-b5ad-228d4473274e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:08.685470 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e933a45-22e6-41d6-b5ad-228d4473274e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:08.685892 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0e933a45-22e6-41d6-b5ad-228d4473274e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:08.691102 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:16:08.886783 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1407ea99-7692-4674-9f14-cef10e72b369 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:08.887394 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1407ea99-7692-4674-9f14-cef10e72b369 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 1c40a98f-366d-4392-9034-7841f68b2050] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:08.897335 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1407ea99-7692-4674-9f14-cef10e72b369 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:08.898206 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1407ea99-7692-4674-9f14-cef10e72b369 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:08.898730 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1407ea99-7692-4674-9f14-cef10e72b369 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:08.899821 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1407ea99-7692-4674-9f14-cef10e72b369 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:08.900455 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1407ea99-7692-4674-9f14-cef10e72b369 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:08.901168 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1407ea99-7692-4674-9f14-cef10e72b369 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:08.992357 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0e933a45-22e6-41d6-b5ad-228d4473274e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:09.001235 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0e933a45-22e6-41d6-b5ad-228d4473274e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.332991 Aug 31 16:16:09.002054 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2446/5078] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:08 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:09.022421 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b58276d3-7747-44d5-884e-17e061a04406 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:09.023210 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b58276d3-7747-44d5-884e-17e061a04406 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Failed to fetch instance by id -1 {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 31 16:16:09.023736 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-b58276d3-7747-44d5-884e-17e061a04406 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] HTTP exception thrown: Instance -1 could not be found. Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b58276d3-7747-44d5-884e-17e061a04406 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Request method failure captured: Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4kQ0XzwgZzM00K2xfqw4sNWznetRNwtM61dwPFzPgxHVwt6ZQqeyy0IDwJXT8yOdP4-2pSJFf0sLdbRTKSty95v4MPjLoaaRhSqpDob3UUxppJFVkB8ZQH-IsYhc50JLxuO54hEVWRh4jtxjaTwZZjw98G6FCIkizac62ua4tSQ6_s Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3e843f3122c14cf8889f26423552792f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3e843f3122c14cf8889f26423552792f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 8b67be53aade4f8c92d6765dd91a4b90 Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance -1 could not be found. Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '-1'} Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:09.025231 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:09.031673 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:16:09.031673 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:16:09.031673 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Aug 31 16:16:09.031673 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:09.031673 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b58276d3-7747-44d5-884e-17e061a04406 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Returning 404 to user: Instance -1 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:16:09.031673 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b58276d3-7747-44d5-884e-17e061a04406 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.008311 Aug 31 16:16:09.031673 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2447/5079] 10.222.0.50 () {58 vars in 1137 bytes} [Wed Aug 31 16:16:09 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 10 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 31 16:16:09.035699 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-aac58ee8-5f91-470e-a817-1fd1c0dc21a2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:09.036422 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-aac58ee8-5f91-470e-a817-1fd1c0dc21a2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:09.050950 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aac58ee8-5f91-470e-a817-1fd1c0dc21a2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:09.051437 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aac58ee8-5f91-470e-a817-1fd1c0dc21a2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:09.051863 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aac58ee8-5f91-470e-a817-1fd1c0dc21a2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:09.052551 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aac58ee8-5f91-470e-a817-1fd1c0dc21a2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:09.053005 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aac58ee8-5f91-470e-a817-1fd1c0dc21a2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:09.053404 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aac58ee8-5f91-470e-a817-1fd1c0dc21a2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:09.223300 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1407ea99-7692-4674-9f14-cef10e72b369 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:09.233784 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1407ea99-7692-4674-9f14-cef10e72b369 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050" status: 200 len: 1690 microversion: 2.1 time: 0.351697 Aug 31 16:16:09.252236 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2633/5080] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:08 2022] GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050 => generated 1690 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:16:09.258638 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8e21749e-6ec4-4686-a748-c4228b686c13 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:09.260023 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8e21749e-6ec4-4686-a748-c4228b686c13 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] [instance: 30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:09.268498 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8e21749e-6ec4-4686-a748-c4228b686c13 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:09.269086 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8e21749e-6ec4-4686-a748-c4228b686c13 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:09.269652 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8e21749e-6ec4-4686-a748-c4228b686c13 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:09.270455 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8e21749e-6ec4-4686-a748-c4228b686c13 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:09.270911 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8e21749e-6ec4-4686-a748-c4228b686c13 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:09.271337 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8e21749e-6ec4-4686-a748-c4228b686c13 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:09.309707 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8e21749e-6ec4-4686-a748-c4228b686c13 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:09.311274 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8e21749e-6ec4-4686-a748-c4228b686c13 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:09.312239 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8e21749e-6ec4-4686-a748-c4228b686c13 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:09.313125 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-8e21749e-6ec4-4686-a748-c4228b686c13 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lazy-loading 'fault' on Instance uuid 30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:16:09.400926 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8e21749e-6ec4-4686-a748-c4228b686c13 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dabb1c841cde40769174e2f8a97234c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7baff3cad5c14325a5576c40fcda0580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:09.409772 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8e21749e-6ec4-4686-a748-c4228b686c13 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "GET /compute/v2.1/servers/30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c" status: 200 len: 1306 microversion: 2.1 time: 0.155415 Aug 31 16:16:09.410418 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2634/5081] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:09 2022] GET /compute/v2.1/servers/30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c => generated 1306 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:09.421582 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-aac58ee8-5f91-470e-a817-1fd1c0dc21a2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:09.432361 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-aac58ee8-5f91-470e-a817-1fd1c0dc21a2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.400802 Aug 31 16:16:09.433072 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2448/5082] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:09 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:09.454905 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-93e89612-3888-493f-9877-d9120d8932b0 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:09.455820 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-93e89612-3888-493f-9877-d9120d8932b0 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:09.461935 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-93e89612-3888-493f-9877-d9120d8932b0 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:09.462465 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-93e89612-3888-493f-9877-d9120d8932b0 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:09.462901 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-93e89612-3888-493f-9877-d9120d8932b0 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:09.463594 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-93e89612-3888-493f-9877-d9120d8932b0 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:09.464044 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-93e89612-3888-493f-9877-d9120d8932b0 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:09.464470 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-93e89612-3888-493f-9877-d9120d8932b0 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:09.759948 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-93e89612-3888-493f-9877-d9120d8932b0 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:09.771329 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-93e89612-3888-493f-9877-d9120d8932b0 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.320290 Aug 31 16:16:09.787306 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2635/5083] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:09 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:09.793023 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-31084446-1419-4597-a97a-1b194d0a1713 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:09.793556 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-31084446-1419-4597-a97a-1b194d0a1713 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 531c5ed7-87d2-4b5a-b4ee-afe1298751d8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:09.802497 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-31084446-1419-4597-a97a-1b194d0a1713 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] HTTP exception thrown: Instance 531c5ed7-87d2-4b5a-b4ee-afe1298751d8 could not be found. Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-31084446-1419-4597-a97a-1b194d0a1713 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Request method failure captured: Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers/531c5ed7-87d2-4b5a-b4ee-afe1298751d8/action HTTP/1.1 Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 19 Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4kQ0XzwgZzM00K2xfqw4sNWznetRNwtM61dwPFzPgxHVwt6ZQqeyy0IDwJXT8yOdP4-2pSJFf0sLdbRTKSty95v4MPjLoaaRhSqpDob3UUxppJFVkB8ZQH-IsYhc50JLxuO54hEVWRh4jtxjaTwZZjw98G6FCIkizac62ua4tSQ6_s Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3e843f3122c14cf8889f26423552792f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3e843f3122c14cf8889f26423552792f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 8b67be53aade4f8c92d6765dd91a4b90 Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: {"forceDelete": {}} Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 531c5ed7-87d2-4b5a-b4ee-afe1298751d8 could not be found. Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '531c5ed7-87d2-4b5a-b4ee-afe1298751d8', 'body': {'forceDelete': {}}} Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 531c5ed7-87d2-4b5a-b4ee-afe1298751d8 could not be found. Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 531c5ed7-87d2-4b5a-b4ee-afe1298751d8 could not be found. Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:09.811704 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:09.817574 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:16:09.817574 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:16:09.817574 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 531c5ed7-87d2-4b5a-b4ee-afe1298751d8 could not be found. Aug 31 16:16:09.817574 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:09.819384 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-31084446-1419-4597-a97a-1b194d0a1713 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Returning 404 to user: Instance 531c5ed7-87d2-4b5a-b4ee-afe1298751d8 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:16:09.820282 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-31084446-1419-4597-a97a-1b194d0a1713 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "POST /compute/v2.1/servers/531c5ed7-87d2-4b5a-b4ee-afe1298751d8/action" status: 404 len: 111 microversion: 2.1 time: 0.031412 Aug 31 16:16:09.820846 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2449/5084] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:16:09 2022] POST /compute/v2.1/servers/531c5ed7-87d2-4b5a-b4ee-afe1298751d8/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:16:09.831715 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-40416c9f-1341-420c-8fa2-c1555856f042 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:09.832623 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-40416c9f-1341-420c-8fa2-c1555856f042 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:09.839294 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-40416c9f-1341-420c-8fa2-c1555856f042 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:09.839790 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-40416c9f-1341-420c-8fa2-c1555856f042 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:09.840221 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-40416c9f-1341-420c-8fa2-c1555856f042 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:09.840922 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-40416c9f-1341-420c-8fa2-c1555856f042 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:09.841363 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-40416c9f-1341-420c-8fa2-c1555856f042 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:09.841777 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-40416c9f-1341-420c-8fa2-c1555856f042 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:09.859366 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=100 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:16:10.257926 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3f33387d-a367-4c6f-b2e2-32817ad196f5 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:10.258575 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3f33387d-a367-4c6f-b2e2-32817ad196f5 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 1c40a98f-366d-4392-9034-7841f68b2050] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:10.269545 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f33387d-a367-4c6f-b2e2-32817ad196f5 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:10.270042 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f33387d-a367-4c6f-b2e2-32817ad196f5 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:10.270534 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f33387d-a367-4c6f-b2e2-32817ad196f5 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:10.271365 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f33387d-a367-4c6f-b2e2-32817ad196f5 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:10.271767 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f33387d-a367-4c6f-b2e2-32817ad196f5 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:10.272198 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f33387d-a367-4c6f-b2e2-32817ad196f5 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:10.682637 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-40416c9f-1341-420c-8fa2-c1555856f042 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:10.696950 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-40416c9f-1341-420c-8fa2-c1555856f042 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.871024 Aug 31 16:16:10.697772 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2636/5085] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:09 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:10.706870 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e6983b2d-93e8-47cf-858d-2d82ddf03f7e tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:10.707467 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e6983b2d-93e8-47cf-858d-2d82ddf03f7e tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] [instance: 30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:10.720837 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6983b2d-93e8-47cf-858d-2d82ddf03f7e tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:10.721357 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6983b2d-93e8-47cf-858d-2d82ddf03f7e tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:10.721976 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6983b2d-93e8-47cf-858d-2d82ddf03f7e tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:10.723283 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6983b2d-93e8-47cf-858d-2d82ddf03f7e tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:10.731639 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3f33387d-a367-4c6f-b2e2-32817ad196f5 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:10.739584 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6983b2d-93e8-47cf-858d-2d82ddf03f7e tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:10.740408 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6983b2d-93e8-47cf-858d-2d82ddf03f7e tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:10.748697 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3f33387d-a367-4c6f-b2e2-32817ad196f5 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050" status: 200 len: 1690 microversion: 2.1 time: 0.494466 Aug 31 16:16:10.756114 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2450/5086] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:10 2022] GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050 => generated 1690 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:10.766911 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cf1c621e-4bf9-40bb-8e84-19ffd8665553 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:10.768763 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cf1c621e-4bf9-40bb-8e84-19ffd8665553 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:10.771681 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-e6983b2d-93e8-47cf-858d-2d82ddf03f7e tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] HTTP exception thrown: Instance 30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c could not be found. Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e6983b2d-93e8-47cf-858d-2d82ddf03f7e tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Request method failure captured: Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c HTTP/1.1 Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4kIFJ0zG0xeBGgG3uzrjLL9EnflnKZMdGdJ2D9YGgjKqtNDIyBPydopwRei8ZnPbXcFm3HhN-k5tWZi56omwftJZfOWCKw_Hb9N0DyCWLOGgTx7eghMjbdmJfyquGOCz4DRfEHH-TxPGulLn-DplfVM4FoftEuHQL9TOxgHDYENNcI Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 7baff3cad5c14325a5576c40fcda0580 Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-SecurityGroupsTestJSON-608242232 Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7baff3cad5c14325a5576c40fcda0580"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7baff3cad5c14325a5576c40fcda0580"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7baff3cad5c14325a5576c40fcda0580"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7baff3cad5c14325a5576c40fcda0580", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-SecurityGroupsTestJSON-608242232 Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 7baff3cad5c14325a5576c40fcda0580 Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-608242232 Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-SecurityGroupsTestJSON-608242232-project Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: dabb1c841cde40769174e2f8a97234c0 Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-SecurityGroupsTestJSON-608242232-project Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c could not be found. Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c'} Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c could not be found. Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c could not be found. Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:10.773549 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:10.778379 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:10.778379 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:10.778379 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:10.778379 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:16:10.778379 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:16:10.778379 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c could not be found. Aug 31 16:16:10.778379 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:10.780528 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e6983b2d-93e8-47cf-858d-2d82ddf03f7e tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Returning 404 to user: Instance 30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:16:10.781421 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e6983b2d-93e8-47cf-858d-2d82ddf03f7e tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "GET /compute/v2.1/servers/30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c" status: 404 len: 111 microversion: 2.1 time: 0.082188 Aug 31 16:16:10.782002 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2637/5087] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:10 2022] GET /compute/v2.1/servers/30fdfd4f-5b5e-4dfc-b2d4-4d12e3d4856c => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:16:10.789645 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf1c621e-4bf9-40bb-8e84-19ffd8665553 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:10.790558 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf1c621e-4bf9-40bb-8e84-19ffd8665553 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:10.791468 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf1c621e-4bf9-40bb-8e84-19ffd8665553 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:10.792755 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf1c621e-4bf9-40bb-8e84-19ffd8665553 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:10.793104 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8e9635cc-7c51-446a-a8bc-6e6f849cd929 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '.version_select at 0x7fbb46176ca0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:10.793587 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf1c621e-4bf9-40bb-8e84-19ffd8665553 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:10.794262 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf1c621e-4bf9-40bb-8e84-19ffd8665553 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:11.273896 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cf1c621e-4bf9-40bb-8e84-19ffd8665553 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:11.286260 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cf1c621e-4bf9-40bb-8e84-19ffd8665553 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.528583 Aug 31 16:16:11.287000 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2451/5088] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:10 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:11.308968 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ffd265c3-2dcf-4657-ac96-1ead73d05835 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:11.311718 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ffd265c3-2dcf-4657-ac96-1ead73d05835 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: f39a3e92-a983-4fe9-b441-bb35e9121ae7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:11.320357 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-ffd265c3-2dcf-4657-ac96-1ead73d05835 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] HTTP exception thrown: Instance f39a3e92-a983-4fe9-b441-bb35e9121ae7 could not be found. Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ffd265c3-2dcf-4657-ac96-1ead73d05835 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Request method failure captured: Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers/f39a3e92-a983-4fe9-b441-bb35e9121ae7/action HTTP/1.1 Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 39 Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4kQ0XzwgZzM00K2xfqw4sNWznetRNwtM61dwPFzPgxHVwt6ZQqeyy0IDwJXT8yOdP4-2pSJFf0sLdbRTKSty95v4MPjLoaaRhSqpDob3UUxppJFVkB8ZQH-IsYhc50JLxuO54hEVWRh4jtxjaTwZZjw98G6FCIkizac62ua4tSQ6_s Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3e843f3122c14cf8889f26423552792f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3e843f3122c14cf8889f26423552792f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 8b67be53aade4f8c92d6765dd91a4b90 Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: {"os-getConsoleOutput": {"length": 10}} Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance f39a3e92-a983-4fe9-b441-bb35e9121ae7 could not be found. Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'f39a3e92-a983-4fe9-b441-bb35e9121ae7', 'body': {'os-getConsoleOutput': {'length': 10}}} Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f39a3e92-a983-4fe9-b441-bb35e9121ae7 could not be found. Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f39a3e92-a983-4fe9-b441-bb35e9121ae7 could not be found. Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:11.325968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:11.331158 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:11.331158 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:11.331158 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:16:11.331158 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:16:11.331158 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f39a3e92-a983-4fe9-b441-bb35e9121ae7 could not be found. Aug 31 16:16:11.331158 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:11.332552 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ffd265c3-2dcf-4657-ac96-1ead73d05835 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Returning 404 to user: Instance f39a3e92-a983-4fe9-b441-bb35e9121ae7 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:16:11.333896 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ffd265c3-2dcf-4657-ac96-1ead73d05835 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "POST /compute/v2.1/servers/f39a3e92-a983-4fe9-b441-bb35e9121ae7/action" status: 404 len: 111 microversion: 2.1 time: 0.029397 Aug 31 16:16:11.334625 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2452/5089] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:16:11 2022] POST /compute/v2.1/servers/f39a3e92-a983-4fe9-b441-bb35e9121ae7/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:16:11.345988 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2c41c802-04b2-42d2-aaff-9b3a1f46f020 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:11.346794 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2c41c802-04b2-42d2-aaff-9b3a1f46f020 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:11.356600 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c41c802-04b2-42d2-aaff-9b3a1f46f020 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:11.357334 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c41c802-04b2-42d2-aaff-9b3a1f46f020 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:11.357793 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c41c802-04b2-42d2-aaff-9b3a1f46f020 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:11.358651 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c41c802-04b2-42d2-aaff-9b3a1f46f020 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:11.359136 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c41c802-04b2-42d2-aaff-9b3a1f46f020 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:11.359571 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c41c802-04b2-42d2-aaff-9b3a1f46f020 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:11.687568 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8e9635cc-7c51-446a-a8bc-6e6f849cd929 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/6a1caa30-53f8-4cee-acf6-778496f407e7" status: 202 len: 0 microversion: 2.1 time: 0.899493 Aug 31 16:16:11.688229 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2638/5090] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 31 16:16:10 2022] DELETE /compute/v2.1/os-security-groups/6a1caa30-53f8-4cee-acf6-778496f407e7 => generated 0 bytes in 901 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 16:16:11.697234 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-46264d1f-6e13-4388-b304-f9747392ce02 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] Calling method '.version_select at 0x7fbb459401f0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:11.773714 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2c41c802-04b2-42d2-aaff-9b3a1f46f020 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:11.788626 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2c41c802-04b2-42d2-aaff-9b3a1f46f020 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.447291 Aug 31 16:16:11.788626 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2453/5091] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:11 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:16:11.793277 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f17e7079-7c42-44e3-9472-31ffea05c2ad tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:11.793856 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f17e7079-7c42-44e3-9472-31ffea05c2ad tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 1c40a98f-366d-4392-9034-7841f68b2050] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:11.806021 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f17e7079-7c42-44e3-9472-31ffea05c2ad tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:11.806620 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f17e7079-7c42-44e3-9472-31ffea05c2ad tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:11.807172 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f17e7079-7c42-44e3-9472-31ffea05c2ad tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:11.807778 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f17e7079-7c42-44e3-9472-31ffea05c2ad tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:11.808234 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f17e7079-7c42-44e3-9472-31ffea05c2ad tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:11.808654 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f17e7079-7c42-44e3-9472-31ffea05c2ad tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:11.925301 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f17e7079-7c42-44e3-9472-31ffea05c2ad tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:11.934192 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f17e7079-7c42-44e3-9472-31ffea05c2ad tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050" status: 200 len: 1622 microversion: 2.1 time: 0.144594 Aug 31 16:16:11.934751 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2454/5092] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:11 2022] GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050 => generated 1622 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:11.939966 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fc501dfa-3372-4288-a0dd-3f688e12b761 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:11.940632 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fc501dfa-3372-4288-a0dd-3f688e12b761 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:11.947120 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc501dfa-3372-4288-a0dd-3f688e12b761 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:11.947612 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc501dfa-3372-4288-a0dd-3f688e12b761 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:11.948367 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc501dfa-3372-4288-a0dd-3f688e12b761 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:11.949328 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc501dfa-3372-4288-a0dd-3f688e12b761 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:11.950004 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc501dfa-3372-4288-a0dd-3f688e12b761 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:11.950611 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc501dfa-3372-4288-a0dd-3f688e12b761 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:12.394336 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fc501dfa-3372-4288-a0dd-3f688e12b761 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:12.409138 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fc501dfa-3372-4288-a0dd-3f688e12b761 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.473292 Aug 31 16:16:12.410058 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2455/5093] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:11 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:12.435515 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9205b7d0-92f4-4f04-b4c6-49db21d356da tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:12.437332 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9205b7d0-92f4-4f04-b4c6-49db21d356da tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 24731959-ee58-48af-9152-e4b0d269fdca] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:12.447716 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-9205b7d0-92f4-4f04-b4c6-49db21d356da tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] HTTP exception thrown: Instance 24731959-ee58-48af-9152-e4b0d269fdca could not be found. Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9205b7d0-92f4-4f04-b4c6-49db21d356da tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Request method failure captured: Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/24731959-ee58-48af-9152-e4b0d269fdca HTTP/1.1 Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4kQ0XzwgZzM00K2xfqw4sNWznetRNwtM61dwPFzPgxHVwt6ZQqeyy0IDwJXT8yOdP4-2pSJFf0sLdbRTKSty95v4MPjLoaaRhSqpDob3UUxppJFVkB8ZQH-IsYhc50JLxuO54hEVWRh4jtxjaTwZZjw98G6FCIkizac62ua4tSQ6_s Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3e843f3122c14cf8889f26423552792f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3e843f3122c14cf8889f26423552792f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 8b67be53aade4f8c92d6765dd91a4b90 Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 24731959-ee58-48af-9152-e4b0d269fdca could not be found. Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '24731959-ee58-48af-9152-e4b0d269fdca'} Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24731959-ee58-48af-9152-e4b0d269fdca could not be found. Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24731959-ee58-48af-9152-e4b0d269fdca could not be found. Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:12.451157 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:12.456416 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:12.456416 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:16:12.456416 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:16:12.456416 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24731959-ee58-48af-9152-e4b0d269fdca could not be found. Aug 31 16:16:12.456416 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:12.456416 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9205b7d0-92f4-4f04-b4c6-49db21d356da tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Returning 404 to user: Instance 24731959-ee58-48af-9152-e4b0d269fdca could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:16:12.456416 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9205b7d0-92f4-4f04-b4c6-49db21d356da tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/24731959-ee58-48af-9152-e4b0d269fdca" status: 404 len: 111 microversion: 2.1 time: 0.024415 Aug 31 16:16:12.460808 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2456/5094] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:12 2022] GET /compute/v2.1/servers/24731959-ee58-48af-9152-e4b0d269fdca => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:16:12.468462 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b7dd8922-b900-468d-a3f0-4c3fa26d08d2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:12.469527 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b7dd8922-b900-468d-a3f0-4c3fa26d08d2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:12.490882 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7dd8922-b900-468d-a3f0-4c3fa26d08d2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:12.492579 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7dd8922-b900-468d-a3f0-4c3fa26d08d2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:12.493145 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7dd8922-b900-468d-a3f0-4c3fa26d08d2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:12.495177 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7dd8922-b900-468d-a3f0-4c3fa26d08d2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:12.498399 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7dd8922-b900-468d-a3f0-4c3fa26d08d2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:12.498932 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7dd8922-b900-468d-a3f0-4c3fa26d08d2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:12.506325 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-46264d1f-6e13-4388-b304-f9747392ce02 tempest-SecurityGroupsTestJSON-608242232 tempest-SecurityGroupsTestJSON-608242232-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/527d56f8-f8fa-4f82-8fce-5c93e22975cd" status: 202 len: 0 microversion: 2.1 time: 0.813066 Aug 31 16:16:12.506925 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2639/5095] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 31 16:16:11 2022] DELETE /compute/v2.1/os-security-groups/527d56f8-f8fa-4f82-8fce-5c93e22975cd => generated 0 bytes in 814 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:16:12.513675 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-76030e16-2a7d-4fc9-9541-e59679ff97ab req-38f8e921-2ec7-491e-ab1d-59bdb60e5532 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c40a98f-366d-4392-9034-7841f68b2050", "name": "network-vif-deleted", "tag": "d9b0901e-5dc3-4373-a2f1-0cba26b60d8b"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:12.568847 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-76030e16-2a7d-4fc9-9541-e59679ff97ab req-38f8e921-2ec7-491e-ab1d-59bdb60e5532 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:12.574648 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-76030e16-2a7d-4fc9-9541-e59679ff97ab req-38f8e921-2ec7-491e-ab1d-59bdb60e5532 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:12.577743 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-76030e16-2a7d-4fc9-9541-e59679ff97ab req-38f8e921-2ec7-491e-ab1d-59bdb60e5532 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:12.640273 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-76030e16-2a7d-4fc9-9541-e59679ff97ab req-38f8e921-2ec7-491e-ab1d-59bdb60e5532 service nova] Creating event network-vif-deleted:d9b0901e-5dc3-4373-a2f1-0cba26b60d8b for instance 1c40a98f-366d-4392-9034-7841f68b2050 on n-h1-833090-16 Aug 31 16:16:12.659356 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-76030e16-2a7d-4fc9-9541-e59679ff97ab req-38f8e921-2ec7-491e-ab1d-59bdb60e5532 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148569 Aug 31 16:16:12.659986 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2640/5096] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:16:12.961631 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-26aa6d6e-5333-438b-8f3f-401384506b2c tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:12.962579 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-26aa6d6e-5333-438b-8f3f-401384506b2c tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 1c40a98f-366d-4392-9034-7841f68b2050] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:12.974403 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26aa6d6e-5333-438b-8f3f-401384506b2c tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:12.975559 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26aa6d6e-5333-438b-8f3f-401384506b2c tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:12.976212 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26aa6d6e-5333-438b-8f3f-401384506b2c tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:12.977207 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26aa6d6e-5333-438b-8f3f-401384506b2c tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:12.977846 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26aa6d6e-5333-438b-8f3f-401384506b2c tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:12.978714 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26aa6d6e-5333-438b-8f3f-401384506b2c tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:13.021283 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26aa6d6e-5333-438b-8f3f-401384506b2c tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:13.022035 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26aa6d6e-5333-438b-8f3f-401384506b2c tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:13.022676 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26aa6d6e-5333-438b-8f3f-401384506b2c tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:13.023370 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-26aa6d6e-5333-438b-8f3f-401384506b2c tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lazy-loading 'fault' on Instance uuid 1c40a98f-366d-4392-9034-7841f68b2050 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:16:13.072357 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b7dd8922-b900-468d-a3f0-4c3fa26d08d2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:13.089094 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b7dd8922-b900-468d-a3f0-4c3fa26d08d2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.623415 Aug 31 16:16:13.121258 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2457/5097] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:12 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:13.137465 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9829a810-0ac5-4754-8583-27a288c9eb65 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:13.139273 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9829a810-0ac5-4754-8583-27a288c9eb65 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:13.171569 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9829a810-0ac5-4754-8583-27a288c9eb65 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:13.171987 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9829a810-0ac5-4754-8583-27a288c9eb65 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:13.174248 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9829a810-0ac5-4754-8583-27a288c9eb65 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:13.175240 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9829a810-0ac5-4754-8583-27a288c9eb65 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:13.179898 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9829a810-0ac5-4754-8583-27a288c9eb65 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:13.180751 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9829a810-0ac5-4754-8583-27a288c9eb65 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:13.328115 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-26aa6d6e-5333-438b-8f3f-401384506b2c tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:13.356773 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-26aa6d6e-5333-438b-8f3f-401384506b2c tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050" status: 200 len: 1336 microversion: 2.1 time: 0.400560 Aug 31 16:16:13.381841 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2641/5098] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:12 2022] GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050 => generated 1336 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:14.280191 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9829a810-0ac5-4754-8583-27a288c9eb65 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:14.302871 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9829a810-0ac5-4754-8583-27a288c9eb65 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 1.174508 Aug 31 16:16:14.304159 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2458/5099] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:13 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:14.418627 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-cb002c99-9431-48ca-bab6-c78dc84cb504 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:14.419942 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-cb002c99-9431-48ca-bab6-c78dc84cb504 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 1c40a98f-366d-4392-9034-7841f68b2050] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:14.438576 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb002c99-9431-48ca-bab6-c78dc84cb504 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:14.441626 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb002c99-9431-48ca-bab6-c78dc84cb504 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:14.442313 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb002c99-9431-48ca-bab6-c78dc84cb504 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:14.446481 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb002c99-9431-48ca-bab6-c78dc84cb504 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:14.447676 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb002c99-9431-48ca-bab6-c78dc84cb504 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:14.448838 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb002c99-9431-48ca-bab6-c78dc84cb504 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:14.493512 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-cb002c99-9431-48ca-bab6-c78dc84cb504 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] HTTP exception thrown: Instance 1c40a98f-366d-4392-9034-7841f68b2050 could not be found. Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-cb002c99-9431-48ca-bab6-c78dc84cb504 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Request method failure captured: Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050 HTTP/1.1 Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4gyS9s2L5B9hQNj6-3Bq9VaD0LX3rcaQEx2TULT5jAIwE_syzV3-H131XTbmJBlDQO8oVuY07kOMzEcgw7jqBoRJefg3cpTEEDA9_ABXOKuvCpOJqmPJLOqW4m5eFAB54B22EgPHkAmNh0-egef1rV97h7ELSV4bCzsJF6Z18KMZ5s Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: d25e1b1938b2401bab27dafadc9745d5 Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-961929748 Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d25e1b1938b2401bab27dafadc9745d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d25e1b1938b2401bab27dafadc9745d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d25e1b1938b2401bab27dafadc9745d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d25e1b1938b2401bab27dafadc9745d5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServerRescueNegativeTestJSON-961929748 Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: d25e1b1938b2401bab27dafadc9745d5 Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-961929748 Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServerRescueNegativeTestJSON-961929748-project Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: b5f67b54e87c46d28e7d5217bf49ca57 Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServerRescueNegativeTestJSON-961929748-project Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 1c40a98f-366d-4392-9034-7841f68b2050 could not be found. Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '1c40a98f-366d-4392-9034-7841f68b2050'} Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c40a98f-366d-4392-9034-7841f68b2050 could not be found. Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c40a98f-366d-4392-9034-7841f68b2050 could not be found. Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:14.495265 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:14.500239 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:14.500239 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:14.500239 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:14.500239 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:14.500239 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:16:14.500239 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:16:14.500239 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c40a98f-366d-4392-9034-7841f68b2050 could not be found. Aug 31 16:16:14.500239 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:14.503922 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-cb002c99-9431-48ca-bab6-c78dc84cb504 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Returning 404 to user: Instance 1c40a98f-366d-4392-9034-7841f68b2050 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:16:14.505063 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-cb002c99-9431-48ca-bab6-c78dc84cb504 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050" status: 404 len: 111 microversion: 2.1 time: 0.097955 Aug 31 16:16:14.505653 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2642/5100] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:14 2022] GET /compute/v2.1/servers/1c40a98f-366d-4392-9034-7841f68b2050 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:16:14.516217 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0d12de4e-149e-4bcc-8584-d55fa4995f67 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '.version_select at 0x7fbb4596b040>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:14.580686 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0d12de4e-149e-4bcc-8584-d55fa4995f67 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1689424413" status: 202 len: 0 microversion: 2.1 time: 0.069171 Aug 31 16:16:14.582512 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2459/5101] 10.222.0.50 () {58 vars in 1221 bytes} [Wed Aug 31 16:16:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1689424413 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:16:14.611587 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e9de3acf-470f-4e60-b34c-1c181b5d4c72 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-608139080", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "1c4c22f6-ea49-4e46-87c2-7de60e095fb8"}]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e9de3acf-470f-4e60-b34c-1c181b5d4c72 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Request method failure captured: Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 237 Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4kQ0XzwgZzM00K2xfqw4sNWznetRNwtM61dwPFzPgxHVwt6ZQqeyy0IDwJXT8yOdP4-2pSJFf0sLdbRTKSty95v4MPjLoaaRhSqpDob3UUxppJFVkB8ZQH-IsYhc50JLxuO54hEVWRh4jtxjaTwZZjw98G6FCIkizac62ua4tSQ6_s Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3e843f3122c14cf8889f26423552792f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3e843f3122c14cf8889f26423552792f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 8b67be53aade4f8c92d6765dd91a4b90 Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-608139080", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "1c4c22f6-ea49-4e46-87c2-7de60e095fb8"}]}} Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-608139080', 'imageRef': 'd715a41c-0e56-494a-a102-cac65831f6bd', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '1c4c22f6-ea49-4e46-87c2-7de60e095fb8'}]}}} Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 236, in is_ipv4 Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:14.678120 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:14.683268 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:14.683268 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:14.683268 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:16:14.683268 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:16:14.683268 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:16:14.683268 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:16:14.683268 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:16:14.683268 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:16:14.683268 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 16:16:14.683268 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 16:16:14.683268 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:16:14.683268 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:16:14.683268 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:16:14.683268 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:16:14.683268 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 31 16:16:14.683268 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:14.683268 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:14.683268 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:14.683268 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:14.683268 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:14.683268 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:14.683268 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:16:14.683268 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:16:14.683268 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 31 16:16:14.683268 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:14.683268 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e9de3acf-470f-4e60-b34c-1c181b5d4c72 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:16:14.683268 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e9de3acf-470f-4e60-b34c-1c181b5d4c72 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.075852 Aug 31 16:16:14.683268 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2643/5102] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:16:14 2022] POST /compute/v2.1/servers => generated 139 bytes in 78 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:16:14.699167 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e9d9d54e-52fe-4936-834e-6e6b738095ca tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:14.703027 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e9d9d54e-52fe-4936-834e-6e6b738095ca tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:14.731639 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9d9d54e-52fe-4936-834e-6e6b738095ca tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:14.733586 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9d9d54e-52fe-4936-834e-6e6b738095ca tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:14.735375 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9d9d54e-52fe-4936-834e-6e6b738095ca tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:14.736361 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9d9d54e-52fe-4936-834e-6e6b738095ca tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:14.737372 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9d9d54e-52fe-4936-834e-6e6b738095ca tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:14.738308 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9d9d54e-52fe-4936-834e-6e6b738095ca tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:15.135928 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e9d9d54e-52fe-4936-834e-6e6b738095ca tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:15.168419 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e9d9d54e-52fe-4936-834e-6e6b738095ca tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.479224 Aug 31 16:16:15.172921 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2460/5103] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:14 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:15.198839 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9751f266-4185-4af4-ae6f-6a803b7209cc tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:15.199526 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9751f266-4185-4af4-ae6f-6a803b7209cc tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:15.211570 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9751f266-4185-4af4-ae6f-6a803b7209cc tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:15.212069 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9751f266-4185-4af4-ae6f-6a803b7209cc tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:15.212590 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9751f266-4185-4af4-ae6f-6a803b7209cc tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:15.217525 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9751f266-4185-4af4-ae6f-6a803b7209cc tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:15.218335 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9751f266-4185-4af4-ae6f-6a803b7209cc tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:15.218945 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9751f266-4185-4af4-ae6f-6a803b7209cc tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:15.593739 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9751f266-4185-4af4-ae6f-6a803b7209cc tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:15.620592 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9751f266-4185-4af4-ae6f-6a803b7209cc tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.429558 Aug 31 16:16:15.622037 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2644/5104] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:15 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:15.692611 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1cbaf46e-7a32-4b26-8f10-8d508cf2ea53 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1815402162", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "1c4c22f6-ea49-4e46-87c2-7de60e095fb8"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1cbaf46e-7a32-4b26-8f10-8d508cf2ea53 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Request method failure captured: Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 235 Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4kQ0XzwgZzM00K2xfqw4sNWznetRNwtM61dwPFzPgxHVwt6ZQqeyy0IDwJXT8yOdP4-2pSJFf0sLdbRTKSty95v4MPjLoaaRhSqpDob3UUxppJFVkB8ZQH-IsYhc50JLxuO54hEVWRh4jtxjaTwZZjw98G6FCIkizac62ua4tSQ6_s Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3e843f3122c14cf8889f26423552792f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3e843f3122c14cf8889f26423552792f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 8b67be53aade4f8c92d6765dd91a4b90 Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1815402162", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "1c4c22f6-ea49-4e46-87c2-7de60e095fb8"}]}} Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1815402162', 'imageRef': 'd715a41c-0e56-494a-a102-cac65831f6bd', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '1c4c22f6-ea49-4e46-87c2-7de60e095fb8'}]}}} Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 243, in is_ipv6 Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'notvalid' Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:15.698269 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:15.710798 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:15.710798 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:15.710798 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:16:15.710798 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:16:15.710798 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:16:15.710798 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:16:15.710798 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:16:15.710798 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:16:15.710798 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 16:16:15.710798 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 16:16:15.710798 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:16:15.710798 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:16:15.710798 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:16:15.710798 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:16:15.710798 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 31 16:16:15.710798 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:15.710798 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:15.710798 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:15.710798 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:15.710798 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:15.710798 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:15.710798 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:16:15.710798 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:16:15.710798 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 31 16:16:15.710798 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:15.710798 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1cbaf46e-7a32-4b26-8f10-8d508cf2ea53 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:16:15.710798 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1cbaf46e-7a32-4b26-8f10-8d508cf2ea53 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.014863 Aug 31 16:16:15.710798 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2461/5105] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:16:15 2022] POST /compute/v2.1/servers => generated 133 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:16:15.716896 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-cc83c6ab-71c8-4ecc-9f1a-48b3fda8831d tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:15.717733 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-cc83c6ab-71c8-4ecc-9f1a-48b3fda8831d tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:15.736941 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cc83c6ab-71c8-4ecc-9f1a-48b3fda8831d tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:15.738361 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cc83c6ab-71c8-4ecc-9f1a-48b3fda8831d tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:15.739928 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cc83c6ab-71c8-4ecc-9f1a-48b3fda8831d tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:15.741633 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cc83c6ab-71c8-4ecc-9f1a-48b3fda8831d tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:15.742870 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cc83c6ab-71c8-4ecc-9f1a-48b3fda8831d tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:15.744019 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cc83c6ab-71c8-4ecc-9f1a-48b3fda8831d tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:16.049734 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-cc83c6ab-71c8-4ecc-9f1a-48b3fda8831d tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:16.062194 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-cc83c6ab-71c8-4ecc-9f1a-48b3fda8831d tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.352729 Aug 31 16:16:16.065259 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2645/5106] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:15 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:16:16.093000 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-83acb2e3-ef8d-4ac9-b411-f58f06c6fa28 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:16.093716 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-83acb2e3-ef8d-4ac9-b411-f58f06c6fa28 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:16.104308 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83acb2e3-ef8d-4ac9-b411-f58f06c6fa28 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:16.105108 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83acb2e3-ef8d-4ac9-b411-f58f06c6fa28 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:16.105799 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83acb2e3-ef8d-4ac9-b411-f58f06c6fa28 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:16.106831 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83acb2e3-ef8d-4ac9-b411-f58f06c6fa28 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:16.107462 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83acb2e3-ef8d-4ac9-b411-f58f06c6fa28 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:16.108083 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83acb2e3-ef8d-4ac9-b411-f58f06c6fa28 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:16.314509 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-83acb2e3-ef8d-4ac9-b411-f58f06c6fa28 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:16.324766 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-83acb2e3-ef8d-4ac9-b411-f58f06c6fa28 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.237529 Aug 31 16:16:16.326676 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2462/5107] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:16 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:16.348699 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9501f4ce-132d-4ad9-890e-42fff4d90d95 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:16.349242 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9501f4ce-132d-4ad9-890e-42fff4d90d95 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 8e527144-9752-4567-bac5-457048048421] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:16.356061 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-9501f4ce-132d-4ad9-890e-42fff4d90d95 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] HTTP exception thrown: Instance 8e527144-9752-4567-bac5-457048048421 could not be found. Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9501f4ce-132d-4ad9-890e-42fff4d90d95 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Request method failure captured: Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: request: POST /compute/v2.1/servers/8e527144-9752-4567-bac5-457048048421/action HTTP/1.1 Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 13 Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4kQ0XzwgZzM00K2xfqw4sNWznetRNwtM61dwPFzPgxHVwt6ZQqeyy0IDwJXT8yOdP4-2pSJFf0sLdbRTKSty95v4MPjLoaaRhSqpDob3UUxppJFVkB8ZQH-IsYhc50JLxuO54hEVWRh4jtxjaTwZZjw98G6FCIkizac62ua4tSQ6_s Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3e843f3122c14cf8889f26423552792f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3e843f3122c14cf8889f26423552792f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 8b67be53aade4f8c92d6765dd91a4b90 Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: {"pause": {}} Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 8e527144-9752-4567-bac5-457048048421 could not be found. Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '8e527144-9752-4567-bac5-457048048421', 'body': {'pause': {}}} Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e527144-9752-4567-bac5-457048048421 could not be found. Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e527144-9752-4567-bac5-457048048421 could not be found. Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:16.365314 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:16.372029 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:16:16.372029 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:16:16.372029 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e527144-9752-4567-bac5-457048048421 could not be found. Aug 31 16:16:16.372029 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:16.372029 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9501f4ce-132d-4ad9-890e-42fff4d90d95 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Returning 404 to user: Instance 8e527144-9752-4567-bac5-457048048421 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:16:16.372029 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9501f4ce-132d-4ad9-890e-42fff4d90d95 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "POST /compute/v2.1/servers/8e527144-9752-4567-bac5-457048048421/action" status: 404 len: 111 microversion: 2.1 time: 0.023570 Aug 31 16:16:16.377593 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2646/5108] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:16:16 2022] POST /compute/v2.1/servers/8e527144-9752-4567-bac5-457048048421/action => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:16:16.378295 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8069fcef-c237-43fe-8dc2-f9ffd7e33d5c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:16.379369 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8069fcef-c237-43fe-8dc2-f9ffd7e33d5c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:16.387889 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8069fcef-c237-43fe-8dc2-f9ffd7e33d5c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:16.388919 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8069fcef-c237-43fe-8dc2-f9ffd7e33d5c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:16.390740 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8069fcef-c237-43fe-8dc2-f9ffd7e33d5c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:16.391882 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8069fcef-c237-43fe-8dc2-f9ffd7e33d5c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:16.392598 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8069fcef-c237-43fe-8dc2-f9ffd7e33d5c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:16.393426 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8069fcef-c237-43fe-8dc2-f9ffd7e33d5c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:16.566199 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8069fcef-c237-43fe-8dc2-f9ffd7e33d5c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:16.575047 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8069fcef-c237-43fe-8dc2-f9ffd7e33d5c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.201319 Aug 31 16:16:16.576283 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2463/5109] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:16 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:16.602743 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8ff4275c-30ef-4bb5-916b-1d8582b3c7b5 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:16.602743 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8ff4275c-30ef-4bb5-916b-1d8582b3c7b5 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:16.609149 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8ff4275c-30ef-4bb5-916b-1d8582b3c7b5 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:16.610386 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8ff4275c-30ef-4bb5-916b-1d8582b3c7b5 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:16.611100 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8ff4275c-30ef-4bb5-916b-1d8582b3c7b5 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:16.611973 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8ff4275c-30ef-4bb5-916b-1d8582b3c7b5 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:16.612675 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8ff4275c-30ef-4bb5-916b-1d8582b3c7b5 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:16.613252 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8ff4275c-30ef-4bb5-916b-1d8582b3c7b5 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:16.798266 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8ff4275c-30ef-4bb5-916b-1d8582b3c7b5 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:16.809456 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8ff4275c-30ef-4bb5-916b-1d8582b3c7b5 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.213106 Aug 31 16:16:16.814185 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2647/5110] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:16 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:16.832078 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b97ccfa5-8bd8-4b44-b929-8dabcadcb6cc tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:16.832816 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b97ccfa5-8bd8-4b44-b929-8dabcadcb6cc tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:16.840317 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b97ccfa5-8bd8-4b44-b929-8dabcadcb6cc tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:16.841017 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b97ccfa5-8bd8-4b44-b929-8dabcadcb6cc tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:16.841808 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b97ccfa5-8bd8-4b44-b929-8dabcadcb6cc tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:16.842640 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b97ccfa5-8bd8-4b44-b929-8dabcadcb6cc tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:16.843087 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b97ccfa5-8bd8-4b44-b929-8dabcadcb6cc tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:16.843715 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b97ccfa5-8bd8-4b44-b929-8dabcadcb6cc tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:16.922153 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b97ccfa5-8bd8-4b44-b929-8dabcadcb6cc tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "POST /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52/action" status: 202 len: 0 microversion: 2.1 time: 0.094322 Aug 31 16:16:16.926523 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2464/5111] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:16:16 2022] POST /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:16:16.934318 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7269a9d0-4c62-449b-92f9-d499dd4bd5a5 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:16.934935 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7269a9d0-4c62-449b-92f9-d499dd4bd5a5 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:16.942609 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7269a9d0-4c62-449b-92f9-d499dd4bd5a5 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:16.943101 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7269a9d0-4c62-449b-92f9-d499dd4bd5a5 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:16.944044 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7269a9d0-4c62-449b-92f9-d499dd4bd5a5 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:16.945025 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7269a9d0-4c62-449b-92f9-d499dd4bd5a5 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:16.945765 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7269a9d0-4c62-449b-92f9-d499dd4bd5a5 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:16.946447 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7269a9d0-4c62-449b-92f9-d499dd4bd5a5 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:17.260273 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7269a9d0-4c62-449b-92f9-d499dd4bd5a5 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:17.281401 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7269a9d0-4c62-449b-92f9-d499dd4bd5a5 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1511 microversion: 2.1 time: 0.351321 Aug 31 16:16:17.289208 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2648/5112] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:16 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1511 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:16:18.313565 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b85ab450-a051-4183-8574-5b325758a4cd tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:18.315062 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b85ab450-a051-4183-8574-5b325758a4cd tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:18.332076 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b85ab450-a051-4183-8574-5b325758a4cd tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:18.336213 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b85ab450-a051-4183-8574-5b325758a4cd tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:18.336918 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b85ab450-a051-4183-8574-5b325758a4cd tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:18.338017 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b85ab450-a051-4183-8574-5b325758a4cd tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:18.340385 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b85ab450-a051-4183-8574-5b325758a4cd tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:18.341404 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b85ab450-a051-4183-8574-5b325758a4cd tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:18.929406 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b85ab450-a051-4183-8574-5b325758a4cd tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:18.938585 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b85ab450-a051-4183-8574-5b325758a4cd tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1491 microversion: 2.1 time: 0.628967 Aug 31 16:16:18.954129 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2465/5113] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:18 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1491 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:18.965136 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-df4f69e4-797c-4a95-95d6-c28a6d0a4b52 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:18.965754 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-df4f69e4-797c-4a95-95d6-c28a6d0a4b52 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:18.984239 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-df4f69e4-797c-4a95-95d6-c28a6d0a4b52 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:18.987429 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-df4f69e4-797c-4a95-95d6-c28a6d0a4b52 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:18.990346 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-df4f69e4-797c-4a95-95d6-c28a6d0a4b52 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:18.991210 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-df4f69e4-797c-4a95-95d6-c28a6d0a4b52 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:18.996875 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-df4f69e4-797c-4a95-95d6-c28a6d0a4b52 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:18.997349 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-df4f69e4-797c-4a95-95d6-c28a6d0a4b52 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:19.074281 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-df4f69e4-797c-4a95-95d6-c28a6d0a4b52 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] HTTP exception thrown: Cannot 'pause' instance 4b051f4f-6b51-4ca7-9afd-6d75682e7f52 while it is in vm_state paused Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-df4f69e4-797c-4a95-95d6-c28a6d0a4b52 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Request method failure captured: Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: request: POST /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52/action HTTP/1.1 Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 13 Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4kQ0XzwgZzM00K2xfqw4sNWznetRNwtM61dwPFzPgxHVwt6ZQqeyy0IDwJXT8yOdP4-2pSJFf0sLdbRTKSty95v4MPjLoaaRhSqpDob3UUxppJFVkB8ZQH-IsYhc50JLxuO54hEVWRh4jtxjaTwZZjw98G6FCIkizac62ua4tSQ6_s Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3e843f3122c14cf8889f26423552792f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3e843f3122c14cf8889f26423552792f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 8b67be53aade4f8c92d6765dd91a4b90 Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: {"pause": {}} Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: exception: Cannot 'pause' instance 4b051f4f-6b51-4ca7-9afd-6d75682e7f52 while it is in vm_state paused Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '4b051f4f-6b51-4ca7-9afd-6d75682e7f52', 'body': {'pause': {}}} Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4b051f4f-6b51-4ca7-9afd-6d75682e7f52 in vm_state paused. Cannot pause while the instance is in this state. Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 4b051f4f-6b51-4ca7-9afd-6d75682e7f52 while it is in vm_state paused Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:19.075834 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:19.082214 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:19.082214 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:16:19.082214 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:16:19.082214 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 4b051f4f-6b51-4ca7-9afd-6d75682e7f52 while it is in vm_state paused Aug 31 16:16:19.082214 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:19.082214 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-df4f69e4-797c-4a95-95d6-c28a6d0a4b52 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Returning 409 to user: Cannot 'pause' instance 4b051f4f-6b51-4ca7-9afd-6d75682e7f52 while it is in vm_state paused {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:16:19.082214 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-df4f69e4-797c-4a95-95d6-c28a6d0a4b52 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "POST /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52/action" status: 409 len: 143 microversion: 2.1 time: 0.121125 Aug 31 16:16:19.085242 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2649/5114] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:16:18 2022] POST /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52/action => generated 143 bytes in 125 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 16:16:19.094594 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-694edcb1-d12f-4282-9707-6b26b68203ea tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:19.095388 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-694edcb1-d12f-4282-9707-6b26b68203ea tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:19.106457 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-694edcb1-d12f-4282-9707-6b26b68203ea tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:19.107506 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-694edcb1-d12f-4282-9707-6b26b68203ea tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:19.108242 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-694edcb1-d12f-4282-9707-6b26b68203ea tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:19.135757 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-694edcb1-d12f-4282-9707-6b26b68203ea tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:19.136575 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-694edcb1-d12f-4282-9707-6b26b68203ea tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:19.137827 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-694edcb1-d12f-4282-9707-6b26b68203ea tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:19.224508 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:16:19.239652 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-694edcb1-d12f-4282-9707-6b26b68203ea tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "POST /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52/action" status: 202 len: 0 microversion: 2.1 time: 0.150017 Aug 31 16:16:19.240963 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2466/5115] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:16:19 2022] POST /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:16:19.250956 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-95a5f5ab-2a7a-464a-bdad-d2fcb62dbf3b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:19.252488 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-95a5f5ab-2a7a-464a-bdad-d2fcb62dbf3b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:19.267467 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95a5f5ab-2a7a-464a-bdad-d2fcb62dbf3b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:19.269369 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95a5f5ab-2a7a-464a-bdad-d2fcb62dbf3b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:19.270361 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95a5f5ab-2a7a-464a-bdad-d2fcb62dbf3b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:19.274797 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95a5f5ab-2a7a-464a-bdad-d2fcb62dbf3b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:19.280576 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95a5f5ab-2a7a-464a-bdad-d2fcb62dbf3b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:19.283186 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95a5f5ab-2a7a-464a-bdad-d2fcb62dbf3b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:19.732547 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-95a5f5ab-2a7a-464a-bdad-d2fcb62dbf3b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:19.748464 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-95a5f5ab-2a7a-464a-bdad-d2fcb62dbf3b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1498 microversion: 2.1 time: 0.503312 Aug 31 16:16:19.749470 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2650/5116] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:19 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1498 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:16:20.779270 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-083ad8b9-a0c4-44f4-8915-e52940627848 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:20.787632 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-083ad8b9-a0c4-44f4-8915-e52940627848 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:20.800163 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-083ad8b9-a0c4-44f4-8915-e52940627848 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:20.801193 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-083ad8b9-a0c4-44f4-8915-e52940627848 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:20.801804 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-083ad8b9-a0c4-44f4-8915-e52940627848 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:20.803296 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-083ad8b9-a0c4-44f4-8915-e52940627848 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:20.803909 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-083ad8b9-a0c4-44f4-8915-e52940627848 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:20.804344 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-083ad8b9-a0c4-44f4-8915-e52940627848 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:20.992416 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-083ad8b9-a0c4-44f4-8915-e52940627848 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:21.007434 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-083ad8b9-a0c4-44f4-8915-e52940627848 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.232261 Aug 31 16:16:21.009798 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2467/5117] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:20 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:16:21.035719 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-dc5d7032-f044-4fe8-9604-e556ce6bc6d0 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:21.036344 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-dc5d7032-f044-4fe8-9604-e556ce6bc6d0 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:21.043764 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dc5d7032-f044-4fe8-9604-e556ce6bc6d0 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:21.044512 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dc5d7032-f044-4fe8-9604-e556ce6bc6d0 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:21.045276 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dc5d7032-f044-4fe8-9604-e556ce6bc6d0 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:21.046220 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dc5d7032-f044-4fe8-9604-e556ce6bc6d0 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:21.047091 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dc5d7032-f044-4fe8-9604-e556ce6bc6d0 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:21.047989 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dc5d7032-f044-4fe8-9604-e556ce6bc6d0 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:21.280785 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-dc5d7032-f044-4fe8-9604-e556ce6bc6d0 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:21.292798 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-dc5d7032-f044-4fe8-9604-e556ce6bc6d0 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.261581 Aug 31 16:16:21.310645 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2651/5118] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:21 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:21.315852 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ce97e3e3-6572-4a48-92bc-de2ce13a885f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:21.318156 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ce97e3e3-6572-4a48-92bc-de2ce13a885f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: bdab1c5f-e128-4ef6-b93d-7ac15002ddbf] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:21.330701 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce97e3e3-6572-4a48-92bc-de2ce13a885f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:21.331162 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce97e3e3-6572-4a48-92bc-de2ce13a885f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:21.331636 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce97e3e3-6572-4a48-92bc-de2ce13a885f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:21.332317 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce97e3e3-6572-4a48-92bc-de2ce13a885f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:21.332807 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce97e3e3-6572-4a48-92bc-de2ce13a885f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:21.333227 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce97e3e3-6572-4a48-92bc-de2ce13a885f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:21.365168 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-ce97e3e3-6572-4a48-92bc-de2ce13a885f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] HTTP exception thrown: Instance bdab1c5f-e128-4ef6-b93d-7ac15002ddbf could not be found. Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ce97e3e3-6572-4a48-92bc-de2ce13a885f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Request method failure captured: Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers/bdab1c5f-e128-4ef6-b93d-7ac15002ddbf/action HTTP/1.1 Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 28 Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4kQ0XzwgZzM00K2xfqw4sNWznetRNwtM61dwPFzPgxHVwt6ZQqeyy0IDwJXT8yOdP4-2pSJFf0sLdbRTKSty95v4MPjLoaaRhSqpDob3UUxppJFVkB8ZQH-IsYhc50JLxuO54hEVWRh4jtxjaTwZZjw98G6FCIkizac62ua4tSQ6_s Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3e843f3122c14cf8889f26423552792f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3e843f3122c14cf8889f26423552792f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 8b67be53aade4f8c92d6765dd91a4b90 Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: {"reboot": {"type": "SOFT"}} Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance bdab1c5f-e128-4ef6-b93d-7ac15002ddbf could not be found. Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'bdab1c5f-e128-4ef6-b93d-7ac15002ddbf', 'body': {'reboot': {'type': 'SOFT'}}} Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdab1c5f-e128-4ef6-b93d-7ac15002ddbf could not be found. Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:16:21.367062 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:16:21.372134 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdab1c5f-e128-4ef6-b93d-7ac15002ddbf could not be found. Aug 31 16:16:21.372134 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:21.372134 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:21.372134 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:21.372134 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:21.372134 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:21.372134 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:21.372134 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:16:21.372134 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:16:21.372134 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdab1c5f-e128-4ef6-b93d-7ac15002ddbf could not be found. Aug 31 16:16:21.372134 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:21.372134 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ce97e3e3-6572-4a48-92bc-de2ce13a885f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Returning 404 to user: Instance bdab1c5f-e128-4ef6-b93d-7ac15002ddbf could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:16:21.372134 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ce97e3e3-6572-4a48-92bc-de2ce13a885f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "POST /compute/v2.1/servers/bdab1c5f-e128-4ef6-b93d-7ac15002ddbf/action" status: 404 len: 111 microversion: 2.1 time: 0.057098 Aug 31 16:16:21.372134 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2468/5119] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:16:21 2022] POST /compute/v2.1/servers/bdab1c5f-e128-4ef6-b93d-7ac15002ddbf/action => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:16:21.382424 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a5cf0a0a-9c96-4763-ab07-247e897d2da3 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:21.383207 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a5cf0a0a-9c96-4763-ab07-247e897d2da3 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:21.392206 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5cf0a0a-9c96-4763-ab07-247e897d2da3 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:21.392802 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5cf0a0a-9c96-4763-ab07-247e897d2da3 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:21.393246 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5cf0a0a-9c96-4763-ab07-247e897d2da3 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:21.393945 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5cf0a0a-9c96-4763-ab07-247e897d2da3 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:21.394420 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5cf0a0a-9c96-4763-ab07-247e897d2da3 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:21.395050 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5cf0a0a-9c96-4763-ab07-247e897d2da3 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:21.620815 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a5cf0a0a-9c96-4763-ab07-247e897d2da3 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:21.630193 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a5cf0a0a-9c96-4763-ab07-247e897d2da3 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.255195 Aug 31 16:16:21.632635 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2652/5120] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:21 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:21.653533 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2c54aa0a-2bcd-46c8-985c-0674340634a2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:21.654225 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2c54aa0a-2bcd-46c8-985c-0674340634a2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:21.661029 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c54aa0a-2bcd-46c8-985c-0674340634a2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:21.661783 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c54aa0a-2bcd-46c8-985c-0674340634a2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:21.662443 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c54aa0a-2bcd-46c8-985c-0674340634a2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:21.663347 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c54aa0a-2bcd-46c8-985c-0674340634a2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:21.664010 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c54aa0a-2bcd-46c8-985c-0674340634a2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:21.664621 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c54aa0a-2bcd-46c8-985c-0674340634a2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:21.890196 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2c54aa0a-2bcd-46c8-985c-0674340634a2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:21.901861 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2c54aa0a-2bcd-46c8-985c-0674340634a2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.252164 Aug 31 16:16:21.903622 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2469/5121] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:21 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:21.927111 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-87c91589-2b96-42ac-9f80-8dbdbd35595b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:21.929459 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-87c91589-2b96-42ac-9f80-8dbdbd35595b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: f719d8b6-96d3-400f-94aa-6a41a736242d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:21.946259 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-87c91589-2b96-42ac-9f80-8dbdbd35595b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] HTTP exception thrown: Instance f719d8b6-96d3-400f-94aa-6a41a736242d could not be found. Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-87c91589-2b96-42ac-9f80-8dbdbd35595b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Request method failure captured: Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: request: POST /compute/v2.1/servers/f719d8b6-96d3-400f-94aa-6a41a736242d/action HTTP/1.1 Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 28 Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4kQ0XzwgZzM00K2xfqw4sNWznetRNwtM61dwPFzPgxHVwt6ZQqeyy0IDwJXT8yOdP4-2pSJFf0sLdbRTKSty95v4MPjLoaaRhSqpDob3UUxppJFVkB8ZQH-IsYhc50JLxuO54hEVWRh4jtxjaTwZZjw98G6FCIkizac62ua4tSQ6_s Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3e843f3122c14cf8889f26423552792f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3e843f3122c14cf8889f26423552792f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 8b67be53aade4f8c92d6765dd91a4b90 Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: {"reboot": {"type": "SOFT"}} Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance f719d8b6-96d3-400f-94aa-6a41a736242d could not be found. Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'f719d8b6-96d3-400f-94aa-6a41a736242d', 'body': {'reboot': {'type': 'SOFT'}}} Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f719d8b6-96d3-400f-94aa-6a41a736242d could not be found. Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f719d8b6-96d3-400f-94aa-6a41a736242d could not be found. Aug 31 16:16:21.948025 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:21.953992 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:21.953992 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:21.953992 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:21.953992 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:21.953992 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:21.953992 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:16:21.953992 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:16:21.953992 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f719d8b6-96d3-400f-94aa-6a41a736242d could not be found. Aug 31 16:16:21.953992 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:21.953992 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-87c91589-2b96-42ac-9f80-8dbdbd35595b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Returning 404 to user: Instance f719d8b6-96d3-400f-94aa-6a41a736242d could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:16:21.953992 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-87c91589-2b96-42ac-9f80-8dbdbd35595b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "POST /compute/v2.1/servers/f719d8b6-96d3-400f-94aa-6a41a736242d/action" status: 404 len: 111 microversion: 2.1 time: 0.028297 Aug 31 16:16:21.953992 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2653/5122] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:16:21 2022] POST /compute/v2.1/servers/f719d8b6-96d3-400f-94aa-6a41a736242d/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:16:21.962054 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2b0cb474-7167-40e2-a7ec-cb634df421a4 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:21.962954 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2b0cb474-7167-40e2-a7ec-cb634df421a4 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:21.975183 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2b0cb474-7167-40e2-a7ec-cb634df421a4 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:21.977168 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2b0cb474-7167-40e2-a7ec-cb634df421a4 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:21.981110 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2b0cb474-7167-40e2-a7ec-cb634df421a4 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:21.985091 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2b0cb474-7167-40e2-a7ec-cb634df421a4 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:21.985847 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2b0cb474-7167-40e2-a7ec-cb634df421a4 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:21.988044 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2b0cb474-7167-40e2-a7ec-cb634df421a4 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:22.255242 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2b0cb474-7167-40e2-a7ec-cb634df421a4 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:22.265687 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2b0cb474-7167-40e2-a7ec-cb634df421a4 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.307612 Aug 31 16:16:22.267090 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2470/5123] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:21 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:22.288838 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0bef8623-aa7c-4c15-8d69-394206436a0d tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:22.290403 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0bef8623-aa7c-4c15-8d69-394206436a0d tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:22.299382 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0bef8623-aa7c-4c15-8d69-394206436a0d tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:22.300312 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0bef8623-aa7c-4c15-8d69-394206436a0d tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:22.300990 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0bef8623-aa7c-4c15-8d69-394206436a0d tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:22.301933 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0bef8623-aa7c-4c15-8d69-394206436a0d tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:22.302645 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0bef8623-aa7c-4c15-8d69-394206436a0d tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:22.303294 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0bef8623-aa7c-4c15-8d69-394206436a0d tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:22.647208 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0bef8623-aa7c-4c15-8d69-394206436a0d tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:22.659914 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0bef8623-aa7c-4c15-8d69-394206436a0d tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.374263 Aug 31 16:16:22.679134 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2654/5124] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:22 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:22.687255 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-60e5d800-5449-492f-a388-f81595649ac0 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:22.690670 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-60e5d800-5449-492f-a388-f81595649ac0 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: bdab1c5f-e128-4ef6-b93d-7ac15002ddbf] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:22.698256 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60e5d800-5449-492f-a388-f81595649ac0 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:22.699119 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60e5d800-5449-492f-a388-f81595649ac0 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:22.699850 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60e5d800-5449-492f-a388-f81595649ac0 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:22.700792 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60e5d800-5449-492f-a388-f81595649ac0 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:22.701459 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60e5d800-5449-492f-a388-f81595649ac0 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:22.702122 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60e5d800-5449-492f-a388-f81595649ac0 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:22.719901 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-60e5d800-5449-492f-a388-f81595649ac0 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] HTTP exception thrown: Instance bdab1c5f-e128-4ef6-b93d-7ac15002ddbf could not be found. Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-60e5d800-5449-492f-a388-f81595649ac0 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Request method failure captured: Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers/bdab1c5f-e128-4ef6-b93d-7ac15002ddbf/action HTTP/1.1 Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 65 Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4kQ0XzwgZzM00K2xfqw4sNWznetRNwtM61dwPFzPgxHVwt6ZQqeyy0IDwJXT8yOdP4-2pSJFf0sLdbRTKSty95v4MPjLoaaRhSqpDob3UUxppJFVkB8ZQH-IsYhc50JLxuO54hEVWRh4jtxjaTwZZjw98G6FCIkizac62ua4tSQ6_s Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3e843f3122c14cf8889f26423552792f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3e843f3122c14cf8889f26423552792f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 8b67be53aade4f8c92d6765dd91a4b90 Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: {"rebuild": {"imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd"}} Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance bdab1c5f-e128-4ef6-b93d-7ac15002ddbf could not be found. Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'bdab1c5f-e128-4ef6-b93d-7ac15002ddbf', 'body': {'rebuild': {'imageRef': 'd715a41c-0e56-494a-a102-cac65831f6bd'}}} Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdab1c5f-e128-4ef6-b93d-7ac15002ddbf could not be found. Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 31 16:16:22.721957 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 31 16:16:22.727093 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 31 16:16:22.727093 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:16:22.727093 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:16:22.727093 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:16:22.727093 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:16:22.727093 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdab1c5f-e128-4ef6-b93d-7ac15002ddbf could not be found. Aug 31 16:16:22.727093 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:22.727093 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:22.727093 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:22.727093 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:22.727093 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:22.727093 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:22.727093 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:16:22.727093 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:16:22.727093 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdab1c5f-e128-4ef6-b93d-7ac15002ddbf could not be found. Aug 31 16:16:22.727093 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:22.729802 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-60e5d800-5449-492f-a388-f81595649ac0 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Returning 404 to user: Instance bdab1c5f-e128-4ef6-b93d-7ac15002ddbf could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:16:22.731437 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-60e5d800-5449-492f-a388-f81595649ac0 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "POST /compute/v2.1/servers/bdab1c5f-e128-4ef6-b93d-7ac15002ddbf/action" status: 404 len: 111 microversion: 2.1 time: 0.050679 Aug 31 16:16:22.736564 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2471/5125] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:16:22 2022] POST /compute/v2.1/servers/bdab1c5f-e128-4ef6-b93d-7ac15002ddbf/action => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:16:22.741881 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3f8cf892-f6dc-4b07-bdd0-764db0770da1 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:22.742539 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3f8cf892-f6dc-4b07-bdd0-764db0770da1 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:22.749759 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3f8cf892-f6dc-4b07-bdd0-764db0770da1 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:22.750330 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3f8cf892-f6dc-4b07-bdd0-764db0770da1 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:22.750951 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3f8cf892-f6dc-4b07-bdd0-764db0770da1 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:22.751788 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3f8cf892-f6dc-4b07-bdd0-764db0770da1 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:22.752242 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3f8cf892-f6dc-4b07-bdd0-764db0770da1 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:22.752663 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3f8cf892-f6dc-4b07-bdd0-764db0770da1 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:22.982703 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3f8cf892-f6dc-4b07-bdd0-764db0770da1 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:22.994604 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3f8cf892-f6dc-4b07-bdd0-764db0770da1 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.257036 Aug 31 16:16:22.995200 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2655/5126] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:22 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:23.019793 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b4430f3e-60f2-4750-8a2c-3a61fbacbcd7 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:23.021453 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b4430f3e-60f2-4750-8a2c-3a61fbacbcd7 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:23.030572 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4430f3e-60f2-4750-8a2c-3a61fbacbcd7 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:23.031528 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4430f3e-60f2-4750-8a2c-3a61fbacbcd7 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:23.032250 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4430f3e-60f2-4750-8a2c-3a61fbacbcd7 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:23.033258 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4430f3e-60f2-4750-8a2c-3a61fbacbcd7 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:23.034062 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4430f3e-60f2-4750-8a2c-3a61fbacbcd7 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:23.034870 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4430f3e-60f2-4750-8a2c-3a61fbacbcd7 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:23.324618 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b4430f3e-60f2-4750-8a2c-3a61fbacbcd7 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:23.334596 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b4430f3e-60f2-4750-8a2c-3a61fbacbcd7 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.320511 Aug 31 16:16:23.338056 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2472/5127] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:23 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:23.360681 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e39bf6da-543d-49b7-a66d-4689e0b6aab5 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:23.364267 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e39bf6da-543d-49b7-a66d-4689e0b6aab5 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 3b25ad1a-d49c-423d-8033-6cac854d3ec2] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:23.371592 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-e39bf6da-543d-49b7-a66d-4689e0b6aab5 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] HTTP exception thrown: Instance 3b25ad1a-d49c-423d-8033-6cac854d3ec2 could not be found. Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e39bf6da-543d-49b7-a66d-4689e0b6aab5 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Request method failure captured: Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: request: POST /compute/v2.1/servers/3b25ad1a-d49c-423d-8033-6cac854d3ec2/action HTTP/1.1 Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 65 Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4kQ0XzwgZzM00K2xfqw4sNWznetRNwtM61dwPFzPgxHVwt6ZQqeyy0IDwJXT8yOdP4-2pSJFf0sLdbRTKSty95v4MPjLoaaRhSqpDob3UUxppJFVkB8ZQH-IsYhc50JLxuO54hEVWRh4jtxjaTwZZjw98G6FCIkizac62ua4tSQ6_s Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3e843f3122c14cf8889f26423552792f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3e843f3122c14cf8889f26423552792f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 8b67be53aade4f8c92d6765dd91a4b90 Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: {"rebuild": {"imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd"}} Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 3b25ad1a-d49c-423d-8033-6cac854d3ec2 could not be found. Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '3b25ad1a-d49c-423d-8033-6cac854d3ec2', 'body': {'rebuild': {'imageRef': 'd715a41c-0e56-494a-a102-cac65831f6bd'}}} Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b25ad1a-d49c-423d-8033-6cac854d3ec2 could not be found. Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 31 16:16:23.373549 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:16:23.379706 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:16:23.379706 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:16:23.379706 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:16:23.379706 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b25ad1a-d49c-423d-8033-6cac854d3ec2 could not be found. Aug 31 16:16:23.379706 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:23.379706 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:23.379706 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:23.379706 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:23.379706 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:23.379706 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:23.379706 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:16:23.379706 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:16:23.379706 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b25ad1a-d49c-423d-8033-6cac854d3ec2 could not be found. Aug 31 16:16:23.379706 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:23.383080 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e39bf6da-543d-49b7-a66d-4689e0b6aab5 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Returning 404 to user: Instance 3b25ad1a-d49c-423d-8033-6cac854d3ec2 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:16:23.384300 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e39bf6da-543d-49b7-a66d-4689e0b6aab5 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "POST /compute/v2.1/servers/3b25ad1a-d49c-423d-8033-6cac854d3ec2/action" status: 404 len: 111 microversion: 2.1 time: 0.027843 Aug 31 16:16:23.397406 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-94626707-7d06-420b-8373-2b7af14edb7e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:23.398982 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-94626707-7d06-420b-8373-2b7af14edb7e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:23.401342 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2656/5128] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:16:23 2022] POST /compute/v2.1/servers/3b25ad1a-d49c-423d-8033-6cac854d3ec2/action => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:16:23.407019 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-94626707-7d06-420b-8373-2b7af14edb7e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:23.407866 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-94626707-7d06-420b-8373-2b7af14edb7e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:23.408517 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-94626707-7d06-420b-8373-2b7af14edb7e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:23.409452 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-94626707-7d06-420b-8373-2b7af14edb7e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:23.410160 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-94626707-7d06-420b-8373-2b7af14edb7e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:23.410819 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-94626707-7d06-420b-8373-2b7af14edb7e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:23.705883 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-94626707-7d06-420b-8373-2b7af14edb7e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:23.716418 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-94626707-7d06-420b-8373-2b7af14edb7e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.325813 Aug 31 16:16:23.718359 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2473/5129] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:23 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:23.742826 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-65e20d35-965b-4885-ad37-d85a3d4279f4 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:23.743755 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-65e20d35-965b-4885-ad37-d85a3d4279f4 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:23.754736 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-65e20d35-965b-4885-ad37-d85a3d4279f4 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:23.755412 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-65e20d35-965b-4885-ad37-d85a3d4279f4 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:23.756611 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-65e20d35-965b-4885-ad37-d85a3d4279f4 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:23.757958 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-65e20d35-965b-4885-ad37-d85a3d4279f4 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:23.758537 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-65e20d35-965b-4885-ad37-d85a3d4279f4 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:23.759029 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-65e20d35-965b-4885-ad37-d85a3d4279f4 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:23.993712 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-65e20d35-965b-4885-ad37-d85a3d4279f4 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:24.005074 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-65e20d35-965b-4885-ad37-d85a3d4279f4 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.269100 Aug 31 16:16:24.017523 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2657/5130] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:23 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:24.029000 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6ea13f78-f6b4-4399-8fc3-980ba907cd6a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:24.030228 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6ea13f78-f6b4-4399-8fc3-980ba907cd6a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: fd20f620-46cb-4ba6-9de0-ba8c4cc714d9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:24.036981 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:16:24.038424 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-6ea13f78-f6b4-4399-8fc3-980ba907cd6a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] HTTP exception thrown: Instance fd20f620-46cb-4ba6-9de0-ba8c4cc714d9 could not be found. Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6ea13f78-f6b4-4399-8fc3-980ba907cd6a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Request method failure captured: Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers/fd20f620-46cb-4ba6-9de0-ba8c4cc714d9/action HTTP/1.1 Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 15 Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4kQ0XzwgZzM00K2xfqw4sNWznetRNwtM61dwPFzPgxHVwt6ZQqeyy0IDwJXT8yOdP4-2pSJFf0sLdbRTKSty95v4MPjLoaaRhSqpDob3UUxppJFVkB8ZQH-IsYhc50JLxuO54hEVWRh4jtxjaTwZZjw98G6FCIkizac62ua4tSQ6_s Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3e843f3122c14cf8889f26423552792f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3e843f3122c14cf8889f26423552792f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 8b67be53aade4f8c92d6765dd91a4b90 Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: {"restore": {}} Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance fd20f620-46cb-4ba6-9de0-ba8c4cc714d9 could not be found. Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'fd20f620-46cb-4ba6-9de0-ba8c4cc714d9', 'body': {'restore': {}}} Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd20f620-46cb-4ba6-9de0-ba8c4cc714d9 could not be found. Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd20f620-46cb-4ba6-9de0-ba8c4cc714d9 could not be found. Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:24.041001 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:24.046662 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:16:24.046662 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:16:24.046662 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd20f620-46cb-4ba6-9de0-ba8c4cc714d9 could not be found. Aug 31 16:16:24.046662 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:24.048655 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6ea13f78-f6b4-4399-8fc3-980ba907cd6a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Returning 404 to user: Instance fd20f620-46cb-4ba6-9de0-ba8c4cc714d9 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:16:24.049810 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6ea13f78-f6b4-4399-8fc3-980ba907cd6a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "POST /compute/v2.1/servers/fd20f620-46cb-4ba6-9de0-ba8c4cc714d9/action" status: 404 len: 111 microversion: 2.1 time: 0.025317 Aug 31 16:16:24.050662 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2474/5131] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:16:24 2022] POST /compute/v2.1/servers/fd20f620-46cb-4ba6-9de0-ba8c4cc714d9/action => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:16:24.059924 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-eb241560-77d3-48af-83b9-a085eb7b0f4a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:24.060939 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-eb241560-77d3-48af-83b9-a085eb7b0f4a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:24.069773 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-eb241560-77d3-48af-83b9-a085eb7b0f4a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:24.070366 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-eb241560-77d3-48af-83b9-a085eb7b0f4a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:24.070805 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-eb241560-77d3-48af-83b9-a085eb7b0f4a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:24.071516 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-eb241560-77d3-48af-83b9-a085eb7b0f4a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:24.072043 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-eb241560-77d3-48af-83b9-a085eb7b0f4a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:24.072377 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-eb241560-77d3-48af-83b9-a085eb7b0f4a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:24.352146 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-eb241560-77d3-48af-83b9-a085eb7b0f4a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:24.379051 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-eb241560-77d3-48af-83b9-a085eb7b0f4a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.323615 Aug 31 16:16:24.380832 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2658/5132] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:24 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:24.405893 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bd0cc772-b2ed-48fb-b802-60831fa3ee07 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:24.406802 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bd0cc772-b2ed-48fb-b802-60831fa3ee07 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:24.418731 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bd0cc772-b2ed-48fb-b802-60831fa3ee07 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:24.419231 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bd0cc772-b2ed-48fb-b802-60831fa3ee07 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:24.419666 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bd0cc772-b2ed-48fb-b802-60831fa3ee07 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:24.420437 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bd0cc772-b2ed-48fb-b802-60831fa3ee07 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:24.420900 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bd0cc772-b2ed-48fb-b802-60831fa3ee07 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:24.421812 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bd0cc772-b2ed-48fb-b802-60831fa3ee07 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:24.579816 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e1159410-81a3-499d-bbdb-dc037116b973 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:24.580322 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e1159410-81a3-499d-bbdb-dc037116b973 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:24.601047 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e1159410-81a3-499d-bbdb-dc037116b973 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:24.602718 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e1159410-81a3-499d-bbdb-dc037116b973 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:24.603240 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e1159410-81a3-499d-bbdb-dc037116b973 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:24.606839 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e1159410-81a3-499d-bbdb-dc037116b973 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:24.607338 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e1159410-81a3-499d-bbdb-dc037116b973 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:24.615997 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e1159410-81a3-499d-bbdb-dc037116b973 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:24.671680 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bd0cc772-b2ed-48fb-b802-60831fa3ee07 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:24.680174 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bd0cc772-b2ed-48fb-b802-60831fa3ee07 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.280998 Aug 31 16:16:24.680757 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2475/5133] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:24 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:24.681243 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e1159410-81a3-499d-bbdb-dc037116b973 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:16:24.702783 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-43b41be7-f073-4292-9658-0b0b4054bb24 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:24.704126 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-43b41be7-f073-4292-9658-0b0b4054bb24 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:24.710907 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43b41be7-f073-4292-9658-0b0b4054bb24 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:24.711641 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43b41be7-f073-4292-9658-0b0b4054bb24 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:24.712246 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43b41be7-f073-4292-9658-0b0b4054bb24 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:24.713156 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43b41be7-f073-4292-9658-0b0b4054bb24 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:24.713778 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43b41be7-f073-4292-9658-0b0b4054bb24 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:24.714397 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43b41be7-f073-4292-9658-0b0b4054bb24 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:24.742675 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-43b41be7-f073-4292-9658-0b0b4054bb24 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] HTTP exception thrown: Cannot 'restore' instance 4b051f4f-6b51-4ca7-9afd-6d75682e7f52 while it is in vm_state active Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-43b41be7-f073-4292-9658-0b0b4054bb24 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Request method failure captured: Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52/action HTTP/1.1 Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 15 Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4kQ0XzwgZzM00K2xfqw4sNWznetRNwtM61dwPFzPgxHVwt6ZQqeyy0IDwJXT8yOdP4-2pSJFf0sLdbRTKSty95v4MPjLoaaRhSqpDob3UUxppJFVkB8ZQH-IsYhc50JLxuO54hEVWRh4jtxjaTwZZjw98G6FCIkizac62ua4tSQ6_s Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3e843f3122c14cf8889f26423552792f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3e843f3122c14cf8889f26423552792f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 8b67be53aade4f8c92d6765dd91a4b90 Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: {"restore": {}} Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: exception: Cannot 'restore' instance 4b051f4f-6b51-4ca7-9afd-6d75682e7f52 while it is in vm_state active Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '4b051f4f-6b51-4ca7-9afd-6d75682e7f52', 'body': {'restore': {}}} Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4b051f4f-6b51-4ca7-9afd-6d75682e7f52 in vm_state active. Cannot restore while the instance is in this state. Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 4b051f4f-6b51-4ca7-9afd-6d75682e7f52 while it is in vm_state active Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:24.744477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:24.753580 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:24.753580 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:16:24.753580 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:16:24.753580 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 4b051f4f-6b51-4ca7-9afd-6d75682e7f52 while it is in vm_state active Aug 31 16:16:24.753580 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:24.753580 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-43b41be7-f073-4292-9658-0b0b4054bb24 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Returning 409 to user: Cannot 'restore' instance 4b051f4f-6b51-4ca7-9afd-6d75682e7f52 while it is in vm_state active {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:16:24.753580 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-43b41be7-f073-4292-9658-0b0b4054bb24 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "POST /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52/action" status: 409 len: 145 microversion: 2.1 time: 0.051513 Aug 31 16:16:24.753580 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2476/5134] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:16:24 2022] POST /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52/action => generated 145 bytes in 53 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 16:16:24.760912 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-70808fc3-953f-4c4a-9884-3bcf067bd3af tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:24.761528 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-70808fc3-953f-4c4a-9884-3bcf067bd3af tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:24.765407 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:16:24.779251 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70808fc3-953f-4c4a-9884-3bcf067bd3af tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:24.786248 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70808fc3-953f-4c4a-9884-3bcf067bd3af tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:24.787021 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70808fc3-953f-4c4a-9884-3bcf067bd3af tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:24.788453 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70808fc3-953f-4c4a-9884-3bcf067bd3af tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:24.790527 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70808fc3-953f-4c4a-9884-3bcf067bd3af tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:24.791156 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70808fc3-953f-4c4a-9884-3bcf067bd3af tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:24.834468 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e1159410-81a3-499d-bbdb-dc037116b973 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "DELETE /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f" status: 204 len: 0 microversion: 2.1 time: 0.270178 Aug 31 16:16:24.835084 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2659/5135] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:16:24 2022] DELETE /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:16:24.844624 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a5b7b07f-cdb8-40ed-ab19-bd1618ddc4df tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:24.845671 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a5b7b07f-cdb8-40ed-ab19-bd1618ddc4df tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:24.853738 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5b7b07f-cdb8-40ed-ab19-bd1618ddc4df tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:24.854633 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5b7b07f-cdb8-40ed-ab19-bd1618ddc4df tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:24.855239 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5b7b07f-cdb8-40ed-ab19-bd1618ddc4df tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:24.856208 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5b7b07f-cdb8-40ed-ab19-bd1618ddc4df tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:24.857398 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5b7b07f-cdb8-40ed-ab19-bd1618ddc4df tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:24.858029 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5b7b07f-cdb8-40ed-ab19-bd1618ddc4df tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:25.040897 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-70808fc3-953f-4c4a-9884-3bcf067bd3af tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:25.049400 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-70808fc3-953f-4c4a-9884-3bcf067bd3af tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.292734 Aug 31 16:16:25.049986 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2477/5136] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:24 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:25.073423 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-65598242-5165-4819-a910-6d1573e4db82 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:25.074130 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-65598242-5165-4819-a910-6d1573e4db82 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:25.092467 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65598242-5165-4819-a910-6d1573e4db82 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:25.092989 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65598242-5165-4819-a910-6d1573e4db82 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:25.093430 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65598242-5165-4819-a910-6d1573e4db82 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:25.094404 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65598242-5165-4819-a910-6d1573e4db82 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:25.095082 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65598242-5165-4819-a910-6d1573e4db82 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:25.095683 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65598242-5165-4819-a910-6d1573e4db82 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:25.121669 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a5b7b07f-cdb8-40ed-ab19-bd1618ddc4df tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:25.131027 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a5b7b07f-cdb8-40ed-ab19-bd1618ddc4df tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f" status: 200 len: 1507 microversion: 2.1 time: 0.290998 Aug 31 16:16:25.131777 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2660/5137] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:24 2022] GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f => generated 1507 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:25.267799 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-65598242-5165-4819-a910-6d1573e4db82 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:25.276100 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-65598242-5165-4819-a910-6d1573e4db82 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.206909 Aug 31 16:16:25.276763 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2478/5138] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:25 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:25.297880 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-41aab4fd-5049-4412-b999-7d45aeb39a32 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:25.298749 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-41aab4fd-5049-4412-b999-7d45aeb39a32 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 89839f53-f783-4abf-8756-7179ed24f61e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:25.305391 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-41aab4fd-5049-4412-b999-7d45aeb39a32 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] HTTP exception thrown: Instance 89839f53-f783-4abf-8756-7179ed24f61e could not be found. Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-41aab4fd-5049-4412-b999-7d45aeb39a32 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Request method failure captured: Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: request: POST /compute/v2.1/servers/89839f53-f783-4abf-8756-7179ed24f61e/action HTTP/1.1 Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 14 Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4kQ0XzwgZzM00K2xfqw4sNWznetRNwtM61dwPFzPgxHVwt6ZQqeyy0IDwJXT8yOdP4-2pSJFf0sLdbRTKSty95v4MPjLoaaRhSqpDob3UUxppJFVkB8ZQH-IsYhc50JLxuO54hEVWRh4jtxjaTwZZjw98G6FCIkizac62ua4tSQ6_s Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3e843f3122c14cf8889f26423552792f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3e843f3122c14cf8889f26423552792f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 8b67be53aade4f8c92d6765dd91a4b90 Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: {"resume": {}} Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 89839f53-f783-4abf-8756-7179ed24f61e could not be found. Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '89839f53-f783-4abf-8756-7179ed24f61e', 'body': {'resume': {}}} Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89839f53-f783-4abf-8756-7179ed24f61e could not be found. Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89839f53-f783-4abf-8756-7179ed24f61e could not be found. Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:25.311968 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:25.317970 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:16:25.317970 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:16:25.317970 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89839f53-f783-4abf-8756-7179ed24f61e could not be found. Aug 31 16:16:25.317970 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:16:25.317970 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-41aab4fd-5049-4412-b999-7d45aeb39a32 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Returning 404 to user: Instance 89839f53-f783-4abf-8756-7179ed24f61e could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:16:25.319136 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-41aab4fd-5049-4412-b999-7d45aeb39a32 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "POST /compute/v2.1/servers/89839f53-f783-4abf-8756-7179ed24f61e/action" status: 404 len: 111 microversion: 2.1 time: 0.025697 Aug 31 16:16:25.319819 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2661/5139] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:16:25 2022] POST /compute/v2.1/servers/89839f53-f783-4abf-8756-7179ed24f61e/action => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:16:25.332917 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-05a671fd-bc5b-4992-9ff4-8c0e2a085adc tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:25.333535 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-05a671fd-bc5b-4992-9ff4-8c0e2a085adc tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:25.341168 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05a671fd-bc5b-4992-9ff4-8c0e2a085adc tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:25.341648 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05a671fd-bc5b-4992-9ff4-8c0e2a085adc tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:25.342295 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05a671fd-bc5b-4992-9ff4-8c0e2a085adc tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:25.343409 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05a671fd-bc5b-4992-9ff4-8c0e2a085adc tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:25.344552 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05a671fd-bc5b-4992-9ff4-8c0e2a085adc tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:25.346018 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05a671fd-bc5b-4992-9ff4-8c0e2a085adc tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:25.518552 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-05a671fd-bc5b-4992-9ff4-8c0e2a085adc tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:25.529776 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-05a671fd-bc5b-4992-9ff4-8c0e2a085adc tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.205096 Aug 31 16:16:25.549186 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2479/5140] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:25 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:25.552632 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fa3d6a09-ac86-4552-8670-ca63535588e6 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:25.553236 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fa3d6a09-ac86-4552-8670-ca63535588e6 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:25.560572 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fa3d6a09-ac86-4552-8670-ca63535588e6 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:25.561339 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fa3d6a09-ac86-4552-8670-ca63535588e6 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:25.561937 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fa3d6a09-ac86-4552-8670-ca63535588e6 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:25.562875 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fa3d6a09-ac86-4552-8670-ca63535588e6 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:25.563486 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fa3d6a09-ac86-4552-8670-ca63535588e6 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:25.564200 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fa3d6a09-ac86-4552-8670-ca63535588e6 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:25.744536 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-fa3d6a09-ac86-4552-8670-ca63535588e6 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:25.753438 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fa3d6a09-ac86-4552-8670-ca63535588e6 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.204497 Aug 31 16:16:25.754023 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2662/5141] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:25 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:25.775211 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3673bf40-ee5a-4863-bab9-1bca122271a2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:25.775652 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3673bf40-ee5a-4863-bab9-1bca122271a2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:25.782486 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3673bf40-ee5a-4863-bab9-1bca122271a2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:25.782980 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3673bf40-ee5a-4863-bab9-1bca122271a2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:25.783622 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3673bf40-ee5a-4863-bab9-1bca122271a2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:25.784321 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3673bf40-ee5a-4863-bab9-1bca122271a2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:25.784944 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3673bf40-ee5a-4863-bab9-1bca122271a2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:25.785361 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3673bf40-ee5a-4863-bab9-1bca122271a2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:25.811303 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-3673bf40-ee5a-4863-bab9-1bca122271a2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] HTTP exception thrown: Cannot 'resume' instance 4b051f4f-6b51-4ca7-9afd-6d75682e7f52 while it is in vm_state active Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3673bf40-ee5a-4863-bab9-1bca122271a2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Request method failure captured: Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52/action HTTP/1.1 Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 14 Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4kQ0XzwgZzM00K2xfqw4sNWznetRNwtM61dwPFzPgxHVwt6ZQqeyy0IDwJXT8yOdP4-2pSJFf0sLdbRTKSty95v4MPjLoaaRhSqpDob3UUxppJFVkB8ZQH-IsYhc50JLxuO54hEVWRh4jtxjaTwZZjw98G6FCIkizac62ua4tSQ6_s Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3e843f3122c14cf8889f26423552792f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3e843f3122c14cf8889f26423552792f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 8b67be53aade4f8c92d6765dd91a4b90 Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: {"resume": {}} Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: exception: Cannot 'resume' instance 4b051f4f-6b51-4ca7-9afd-6d75682e7f52 while it is in vm_state active Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '4b051f4f-6b51-4ca7-9afd-6d75682e7f52', 'body': {'resume': {}}} Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4b051f4f-6b51-4ca7-9afd-6d75682e7f52 in vm_state active. Cannot resume while the instance is in this state. Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 4b051f4f-6b51-4ca7-9afd-6d75682e7f52 while it is in vm_state active Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:25.813228 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:25.819035 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:25.819035 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:25.819035 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:25.819035 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:16:25.819035 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:16:25.819035 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 4b051f4f-6b51-4ca7-9afd-6d75682e7f52 while it is in vm_state active Aug 31 16:16:25.819035 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:25.820461 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3673bf40-ee5a-4863-bab9-1bca122271a2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Returning 409 to user: Cannot 'resume' instance 4b051f4f-6b51-4ca7-9afd-6d75682e7f52 while it is in vm_state active {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:16:25.821508 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3673bf40-ee5a-4863-bab9-1bca122271a2 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "POST /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52/action" status: 409 len: 144 microversion: 2.1 time: 0.050372 Aug 31 16:16:25.825575 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2480/5142] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:16:25 2022] POST /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52/action => generated 144 bytes in 55 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 16:16:25.831249 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-95076052-4c7f-4bf0-90e9-63de6592458c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:25.831870 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-95076052-4c7f-4bf0-90e9-63de6592458c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:25.838247 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95076052-4c7f-4bf0-90e9-63de6592458c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:25.838742 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95076052-4c7f-4bf0-90e9-63de6592458c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:25.839183 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95076052-4c7f-4bf0-90e9-63de6592458c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:25.839894 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95076052-4c7f-4bf0-90e9-63de6592458c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:25.840346 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95076052-4c7f-4bf0-90e9-63de6592458c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:25.840769 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95076052-4c7f-4bf0-90e9-63de6592458c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:25.994483 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-95076052-4c7f-4bf0-90e9-63de6592458c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:26.004940 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-95076052-4c7f-4bf0-90e9-63de6592458c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.177678 Aug 31 16:16:26.005528 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2663/5143] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:25 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:26.028931 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8439ffa8-6009-420a-86cb-248689be30f1 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:26.029419 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8439ffa8-6009-420a-86cb-248689be30f1 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:26.036298 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8439ffa8-6009-420a-86cb-248689be30f1 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:26.036782 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8439ffa8-6009-420a-86cb-248689be30f1 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:26.037217 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8439ffa8-6009-420a-86cb-248689be30f1 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:26.037910 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8439ffa8-6009-420a-86cb-248689be30f1 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:26.038386 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8439ffa8-6009-420a-86cb-248689be30f1 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:26.038805 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8439ffa8-6009-420a-86cb-248689be30f1 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:26.154339 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-384bf3ea-f8a0-49f6-b3f2-19987dfdf586 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:26.155292 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-384bf3ea-f8a0-49f6-b3f2-19987dfdf586 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:26.162678 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-384bf3ea-f8a0-49f6-b3f2-19987dfdf586 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:26.163555 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-384bf3ea-f8a0-49f6-b3f2-19987dfdf586 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:26.164104 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-384bf3ea-f8a0-49f6-b3f2-19987dfdf586 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:26.164884 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-384bf3ea-f8a0-49f6-b3f2-19987dfdf586 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:26.165551 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-384bf3ea-f8a0-49f6-b3f2-19987dfdf586 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:26.165960 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-384bf3ea-f8a0-49f6-b3f2-19987dfdf586 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:26.188766 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8439ffa8-6009-420a-86cb-248689be30f1 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:26.199208 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8439ffa8-6009-420a-86cb-248689be30f1 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.173947 Aug 31 16:16:26.201415 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2481/5144] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:26 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:26.341576 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-41e8dc1d-5bb1-43c4-9ed6-ea53c1ea2faf tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "1c4c22f6-ea49-4e46-87c2-7de60e095fb8"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-41e8dc1d-5bb1-43c4-9ed6-ea53c1ea2faf tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Request method failure captured: Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 160 Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4kQ0XzwgZzM00K2xfqw4sNWznetRNwtM61dwPFzPgxHVwt6ZQqeyy0IDwJXT8yOdP4-2pSJFf0sLdbRTKSty95v4MPjLoaaRhSqpDob3UUxppJFVkB8ZQH-IsYhc50JLxuO54hEVWRh4jtxjaTwZZjw98G6FCIkizac62ua4tSQ6_s Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3e843f3122c14cf8889f26423552792f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3e843f3122c14cf8889f26423552792f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 8b67be53aade4f8c92d6765dd91a4b90 Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: {"server": {"name": "", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "1c4c22f6-ea49-4e46-87c2-7de60e095fb8"}]}} Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'body': {'server': {'name': '', 'imageRef': 'd715a41c-0e56-494a-a102-cac65831f6bd', 'flavorRef': '452', 'networks': [{'uuid': '1c4c22f6-ea49-4e46-87c2-7de60e095fb8'}]}}} Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi '' Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:16:26.345948 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:16:26.351358 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:16:26.351358 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 31 16:16:26.351358 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:26.351358 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:26.351358 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:26.351358 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:26.351358 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:26.351358 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:26.351358 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:16:26.351358 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:16:26.351358 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 31 16:16:26.351358 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:26.354725 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-41e8dc1d-5bb1-43c4-9ed6-ea53c1ea2faf tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:16:26.356545 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-41e8dc1d-5bb1-43c4-9ed6-ea53c1ea2faf tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.019895 Aug 31 16:16:26.358353 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2482/5145] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:16:26 2022] POST /compute/v2.1/servers => generated 108 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 31 16:16:26.364229 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-384bf3ea-f8a0-49f6-b3f2-19987dfdf586 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:26.378625 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f5b18af3-6ccf-4d7b-96cf-cb9f5e7fe825 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:26.379154 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-384bf3ea-f8a0-49f6-b3f2-19987dfdf586 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f" status: 200 len: 1507 microversion: 2.1 time: 0.226650 Aug 31 16:16:26.379784 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f5b18af3-6ccf-4d7b-96cf-cb9f5e7fe825 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:26.380714 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2664/5146] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:26 2022] GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f => generated 1507 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:26.387477 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5b18af3-6ccf-4d7b-96cf-cb9f5e7fe825 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:26.387959 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5b18af3-6ccf-4d7b-96cf-cb9f5e7fe825 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:26.388597 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5b18af3-6ccf-4d7b-96cf-cb9f5e7fe825 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:26.389551 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5b18af3-6ccf-4d7b-96cf-cb9f5e7fe825 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:26.390077 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5b18af3-6ccf-4d7b-96cf-cb9f5e7fe825 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:26.390769 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5b18af3-6ccf-4d7b-96cf-cb9f5e7fe825 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:26.908978 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f5b18af3-6ccf-4d7b-96cf-cb9f5e7fe825 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:26.917518 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f5b18af3-6ccf-4d7b-96cf-cb9f5e7fe825 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.548668 Aug 31 16:16:26.918126 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2483/5147] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:26 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:26.939768 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0cbc3ae9-25ff-492f-824e-25ec661be164 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:26.940253 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0cbc3ae9-25ff-492f-824e-25ec661be164 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:26.947399 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0cbc3ae9-25ff-492f-824e-25ec661be164 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:26.948240 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0cbc3ae9-25ff-492f-824e-25ec661be164 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:26.948736 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0cbc3ae9-25ff-492f-824e-25ec661be164 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:26.949502 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0cbc3ae9-25ff-492f-824e-25ec661be164 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:26.950019 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0cbc3ae9-25ff-492f-824e-25ec661be164 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:26.950545 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0cbc3ae9-25ff-492f-824e-25ec661be164 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:27.089530 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0cbc3ae9-25ff-492f-824e-25ec661be164 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:27.101653 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0cbc3ae9-25ff-492f-824e-25ec661be164 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.166763 Aug 31 16:16:27.102655 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2665/5148] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:26 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:27.122642 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8af01b9a-d611-4615-a496-030716af726b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:27.123073 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8af01b9a-d611-4615-a496-030716af726b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 8bd4eb36-0ca8-4117-8320-fa7c17aa9f90] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:27.129964 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-8af01b9a-d611-4615-a496-030716af726b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] HTTP exception thrown: Instance 8bd4eb36-0ca8-4117-8320-fa7c17aa9f90 could not be found. Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8af01b9a-d611-4615-a496-030716af726b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Request method failure captured: Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers/8bd4eb36-0ca8-4117-8320-fa7c17aa9f90/action HTTP/1.1 Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 14 Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4kQ0XzwgZzM00K2xfqw4sNWznetRNwtM61dwPFzPgxHVwt6ZQqeyy0IDwJXT8yOdP4-2pSJFf0sLdbRTKSty95v4MPjLoaaRhSqpDob3UUxppJFVkB8ZQH-IsYhc50JLxuO54hEVWRh4jtxjaTwZZjw98G6FCIkizac62ua4tSQ6_s Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3e843f3122c14cf8889f26423552792f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3e843f3122c14cf8889f26423552792f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 8b67be53aade4f8c92d6765dd91a4b90 Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: {"shelve": {}} Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 8bd4eb36-0ca8-4117-8320-fa7c17aa9f90 could not be found. Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '8bd4eb36-0ca8-4117-8320-fa7c17aa9f90', 'body': {'shelve': {}}} Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bd4eb36-0ca8-4117-8320-fa7c17aa9f90 could not be found. Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bd4eb36-0ca8-4117-8320-fa7c17aa9f90 could not be found. Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:27.146178 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:27.154994 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:16:27.154994 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:16:27.154994 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bd4eb36-0ca8-4117-8320-fa7c17aa9f90 could not be found. Aug 31 16:16:27.154994 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:27.154994 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8af01b9a-d611-4615-a496-030716af726b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Returning 404 to user: Instance 8bd4eb36-0ca8-4117-8320-fa7c17aa9f90 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:16:27.154994 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8af01b9a-d611-4615-a496-030716af726b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "POST /compute/v2.1/servers/8bd4eb36-0ca8-4117-8320-fa7c17aa9f90/action" status: 404 len: 111 microversion: 2.1 time: 0.029124 Aug 31 16:16:27.157598 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2484/5149] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:16:27 2022] POST /compute/v2.1/servers/8bd4eb36-0ca8-4117-8320-fa7c17aa9f90/action => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:16:27.159227 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6e931501-c2d2-45a6-bf68-92c680b214ee tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:27.159840 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6e931501-c2d2-45a6-bf68-92c680b214ee tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:27.166515 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6e931501-c2d2-45a6-bf68-92c680b214ee tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:27.167229 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6e931501-c2d2-45a6-bf68-92c680b214ee tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:27.167812 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6e931501-c2d2-45a6-bf68-92c680b214ee tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:27.168721 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6e931501-c2d2-45a6-bf68-92c680b214ee tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:27.169178 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6e931501-c2d2-45a6-bf68-92c680b214ee tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:27.169593 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6e931501-c2d2-45a6-bf68-92c680b214ee tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:27.387678 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6e931501-c2d2-45a6-bf68-92c680b214ee tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:27.402170 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c75c0143-4a71-4685-ac47-679e5155adb6 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:27.402776 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6e931501-c2d2-45a6-bf68-92c680b214ee tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.248014 Aug 31 16:16:27.405321 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2666/5150] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:27 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:27.421341 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c75c0143-4a71-4685-ac47-679e5155adb6 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:27.425103 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-97107d62-5c1e-453c-bd8b-9eb945946d6a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:27.425719 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-97107d62-5c1e-453c-bd8b-9eb945946d6a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:27.441302 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c75c0143-4a71-4685-ac47-679e5155adb6 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:27.441767 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-97107d62-5c1e-453c-bd8b-9eb945946d6a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:27.442063 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c75c0143-4a71-4685-ac47-679e5155adb6 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:27.442422 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-97107d62-5c1e-453c-bd8b-9eb945946d6a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:27.442552 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c75c0143-4a71-4685-ac47-679e5155adb6 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:27.442859 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-97107d62-5c1e-453c-bd8b-9eb945946d6a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:27.443217 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c75c0143-4a71-4685-ac47-679e5155adb6 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:27.443556 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-97107d62-5c1e-453c-bd8b-9eb945946d6a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:27.443678 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c75c0143-4a71-4685-ac47-679e5155adb6 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:27.444003 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-97107d62-5c1e-453c-bd8b-9eb945946d6a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:27.444179 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c75c0143-4a71-4685-ac47-679e5155adb6 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:27.444939 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-97107d62-5c1e-453c-bd8b-9eb945946d6a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:27.816167 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-97107d62-5c1e-453c-bd8b-9eb945946d6a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:27.830820 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-97107d62-5c1e-453c-bd8b-9eb945946d6a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.406499 Aug 31 16:16:27.846125 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2667/5151] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:27 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:16:27.857936 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c75c0143-4a71-4685-ac47-679e5155adb6 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:27.862663 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ba060563-3635-4a52-9aea-bf87cf70f0cc tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:27.866376 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ba060563-3635-4a52-9aea-bf87cf70f0cc tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:27.882150 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c75c0143-4a71-4685-ac47-679e5155adb6 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f" status: 200 len: 1507 microversion: 2.1 time: 0.484588 Aug 31 16:16:27.886350 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ba060563-3635-4a52-9aea-bf87cf70f0cc tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:27.904431 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ba060563-3635-4a52-9aea-bf87cf70f0cc tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:27.905168 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2485/5152] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:27 2022] GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f => generated 1507 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:27.906379 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ba060563-3635-4a52-9aea-bf87cf70f0cc tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:27.907356 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ba060563-3635-4a52-9aea-bf87cf70f0cc tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:27.908057 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ba060563-3635-4a52-9aea-bf87cf70f0cc tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:27.908709 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ba060563-3635-4a52-9aea-bf87cf70f0cc tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:27.942663 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-ba060563-3635-4a52-9aea-bf87cf70f0cc tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lazy-loading 'flavor' on Instance uuid 4b051f4f-6b51-4ca7-9afd-6d75682e7f52 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:16:28.274505 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ba060563-3635-4a52-9aea-bf87cf70f0cc tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "POST /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52/action" status: 202 len: 0 microversion: 2.1 time: 0.422543 Aug 31 16:16:28.278223 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2668/5153] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:16:27 2022] POST /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52/action => generated 0 bytes in 428 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 16:16:28.287750 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fa3876b0-e41e-4cb7-a2ca-95f79066df32 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:28.288424 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fa3876b0-e41e-4cb7-a2ca-95f79066df32 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:28.314370 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa3876b0-e41e-4cb7-a2ca-95f79066df32 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:28.318388 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa3876b0-e41e-4cb7-a2ca-95f79066df32 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:28.320369 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa3876b0-e41e-4cb7-a2ca-95f79066df32 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:28.321403 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa3876b0-e41e-4cb7-a2ca-95f79066df32 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:28.321878 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa3876b0-e41e-4cb7-a2ca-95f79066df32 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:28.325269 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa3876b0-e41e-4cb7-a2ca-95f79066df32 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:28.659833 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fa3876b0-e41e-4cb7-a2ca-95f79066df32 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:28.671557 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fa3876b0-e41e-4cb7-a2ca-95f79066df32 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1512 microversion: 2.1 time: 0.388055 Aug 31 16:16:28.672650 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2486/5154] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:28 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1512 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:28.719065 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-4aace44c-eee8-454d-af18-cba50e57d922 req-8c0b5126-959d-42f3-88c4-09fcaebbbc53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f", "name": "network-vif-deleted", "tag": "d706c52d-7294-4df5-8605-e5eb47c15dca"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:28.733652 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-4aace44c-eee8-454d-af18-cba50e57d922 req-8c0b5126-959d-42f3-88c4-09fcaebbbc53 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:28.734554 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-4aace44c-eee8-454d-af18-cba50e57d922 req-8c0b5126-959d-42f3-88c4-09fcaebbbc53 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:28.735350 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-4aace44c-eee8-454d-af18-cba50e57d922 req-8c0b5126-959d-42f3-88c4-09fcaebbbc53 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:28.754714 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-4aace44c-eee8-454d-af18-cba50e57d922 req-8c0b5126-959d-42f3-88c4-09fcaebbbc53 service nova] Creating event network-vif-deleted:d706c52d-7294-4df5-8605-e5eb47c15dca for instance 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f on n-h2-833090-16 Aug 31 16:16:28.762745 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-4aace44c-eee8-454d-af18-cba50e57d922 req-8c0b5126-959d-42f3-88c4-09fcaebbbc53 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.396232 Aug 31 16:16:28.768151 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2669/5155] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:16:28.909018 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8ef129a9-debc-4dcb-802a-b58f3e497c46 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:28.909550 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8ef129a9-debc-4dcb-802a-b58f3e497c46 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:28.927477 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ef129a9-debc-4dcb-802a-b58f3e497c46 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:28.928226 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ef129a9-debc-4dcb-802a-b58f3e497c46 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:28.928872 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ef129a9-debc-4dcb-802a-b58f3e497c46 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:28.929785 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ef129a9-debc-4dcb-802a-b58f3e497c46 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:28.930470 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ef129a9-debc-4dcb-802a-b58f3e497c46 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:28.931094 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ef129a9-debc-4dcb-802a-b58f3e497c46 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:29.005713 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ef129a9-debc-4dcb-802a-b58f3e497c46 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:29.006386 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ef129a9-debc-4dcb-802a-b58f3e497c46 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:29.006896 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ef129a9-debc-4dcb-802a-b58f3e497c46 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:29.007430 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-8ef129a9-debc-4dcb-802a-b58f3e497c46 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lazy-loading 'fault' on Instance uuid 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:16:29.066356 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8ef129a9-debc-4dcb-802a-b58f3e497c46 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:29.079673 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8ef129a9-debc-4dcb-802a-b58f3e497c46 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f" status: 200 len: 1312 microversion: 2.1 time: 0.174415 Aug 31 16:16:29.080298 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2487/5156] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:28 2022] GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f => generated 1312 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:29.696723 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9b24bf65-8188-455b-b884-95d0fde611b0 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:29.697508 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9b24bf65-8188-455b-b884-95d0fde611b0 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:29.704417 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9b24bf65-8188-455b-b884-95d0fde611b0 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:29.705062 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9b24bf65-8188-455b-b884-95d0fde611b0 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:29.705608 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9b24bf65-8188-455b-b884-95d0fde611b0 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:29.706455 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9b24bf65-8188-455b-b884-95d0fde611b0 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:29.707132 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9b24bf65-8188-455b-b884-95d0fde611b0 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:29.707628 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9b24bf65-8188-455b-b884-95d0fde611b0 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:29.893269 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9b24bf65-8188-455b-b884-95d0fde611b0 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:29.902692 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9b24bf65-8188-455b-b884-95d0fde611b0 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1512 microversion: 2.1 time: 0.212121 Aug 31 16:16:29.904302 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2670/5157] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:29 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1512 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:30.108062 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1987a545-e201-442b-9c45-590d54c5781b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:30.108682 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1987a545-e201-442b-9c45-590d54c5781b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:30.123487 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1987a545-e201-442b-9c45-590d54c5781b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:30.124317 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1987a545-e201-442b-9c45-590d54c5781b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:30.124781 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1987a545-e201-442b-9c45-590d54c5781b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:30.125498 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1987a545-e201-442b-9c45-590d54c5781b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:30.126036 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1987a545-e201-442b-9c45-590d54c5781b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:30.126475 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1987a545-e201-442b-9c45-590d54c5781b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:30.130979 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:16:30.142829 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-1987a545-e201-442b-9c45-590d54c5781b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] HTTP exception thrown: Instance 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f could not be found. Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1987a545-e201-442b-9c45-590d54c5781b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Request method failure captured: Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f HTTP/1.1 Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4gyS9s2L5B9hQNj6-3Bq9VaD0LX3rcaQEx2TULT5jAIwE_syzV3-H131XTbmJBlDQO8oVuY07kOMzEcgw7jqBoRJefg3cpTEEDA9_ABXOKuvCpOJqmPJLOqW4m5eFAB54B22EgPHkAmNh0-egef1rV97h7ELSV4bCzsJF6Z18KMZ5s Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: d25e1b1938b2401bab27dafadc9745d5 Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-961929748 Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d25e1b1938b2401bab27dafadc9745d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d25e1b1938b2401bab27dafadc9745d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d25e1b1938b2401bab27dafadc9745d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d25e1b1938b2401bab27dafadc9745d5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServerRescueNegativeTestJSON-961929748 Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: d25e1b1938b2401bab27dafadc9745d5 Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-961929748 Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServerRescueNegativeTestJSON-961929748-project Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: b5f67b54e87c46d28e7d5217bf49ca57 Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServerRescueNegativeTestJSON-961929748-project Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f could not be found. Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f'} Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f could not be found. Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f could not be found. Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:30.144666 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:30.152326 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:30.152326 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:30.152326 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:30.152326 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:30.152326 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:16:30.152326 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:16:30.152326 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f could not be found. Aug 31 16:16:30.152326 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:30.152326 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1987a545-e201-442b-9c45-590d54c5781b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Returning 404 to user: Instance 6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:16:30.152326 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1987a545-e201-442b-9c45-590d54c5781b tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f" status: 404 len: 111 microversion: 2.1 time: 0.043718 Aug 31 16:16:30.152326 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2488/5158] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:30 2022] GET /compute/v2.1/servers/6d1d9d8e-ae27-4f04-ae4e-64ec923abe0f => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:16:30.159784 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b921f77a-7c47-47f7-af15-fda6c58b5d34 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:30.160289 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b921f77a-7c47-47f7-af15-fda6c58b5d34 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 14167776-553f-4203-887b-3cb8e4cc0a2a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:30.167244 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b921f77a-7c47-47f7-af15-fda6c58b5d34 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:30.167461 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b921f77a-7c47-47f7-af15-fda6c58b5d34 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:30.167720 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b921f77a-7c47-47f7-af15-fda6c58b5d34 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:30.168685 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b921f77a-7c47-47f7-af15-fda6c58b5d34 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:30.169299 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b921f77a-7c47-47f7-af15-fda6c58b5d34 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:30.169888 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b921f77a-7c47-47f7-af15-fda6c58b5d34 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:30.205741 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b921f77a-7c47-47f7-af15-fda6c58b5d34 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 14167776-553f-4203-887b-3cb8e4cc0a2a] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:16:30.392565 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b921f77a-7c47-47f7-af15-fda6c58b5d34 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "DELETE /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a" status: 204 len: 0 microversion: 2.1 time: 0.230538 Aug 31 16:16:30.399871 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2671/5159] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:16:30 2022] DELETE /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:16:30.418640 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a2b31370-83b2-4e6a-9ab7-e3fb25c7b6a5 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:30.419349 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a2b31370-83b2-4e6a-9ab7-e3fb25c7b6a5 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 14167776-553f-4203-887b-3cb8e4cc0a2a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:30.439167 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a2b31370-83b2-4e6a-9ab7-e3fb25c7b6a5 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:30.444647 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a2b31370-83b2-4e6a-9ab7-e3fb25c7b6a5 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:30.445375 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a2b31370-83b2-4e6a-9ab7-e3fb25c7b6a5 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:30.446510 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a2b31370-83b2-4e6a-9ab7-e3fb25c7b6a5 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:30.447270 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a2b31370-83b2-4e6a-9ab7-e3fb25c7b6a5 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:30.448454 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a2b31370-83b2-4e6a-9ab7-e3fb25c7b6a5 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:30.592742 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b52b5f76-ee22-40dc-a05d-13b2c40850d9 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:30.593741 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b52b5f76-ee22-40dc-a05d-13b2c40850d9 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] [instance: e1cb02b7-1dd6-4c83-9008-e19525731e03] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:30.608393 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b52b5f76-ee22-40dc-a05d-13b2c40850d9 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:30.608883 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b52b5f76-ee22-40dc-a05d-13b2c40850d9 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:30.609410 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b52b5f76-ee22-40dc-a05d-13b2c40850d9 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:30.613978 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b52b5f76-ee22-40dc-a05d-13b2c40850d9 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:30.623048 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b52b5f76-ee22-40dc-a05d-13b2c40850d9 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:30.629414 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b52b5f76-ee22-40dc-a05d-13b2c40850d9 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:30.722163 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a2b31370-83b2-4e6a-9ab7-e3fb25c7b6a5 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:30.735869 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a2b31370-83b2-4e6a-9ab7-e3fb25c7b6a5 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a" status: 200 len: 1521 microversion: 2.1 time: 0.331768 Aug 31 16:16:30.739480 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2672/5160] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:30 2022] GET /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a => generated 1521 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:16:30.926537 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e8c49a2f-bba7-4e06-88e0-c375c0e5550d tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Action: 'create', calling method: .version_select at 0x7fbb45980700>, body: {"keypair": {"name": "tempest-keypair-1366133600", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGQq//wgs3uoMTaogwY9nXltxCcaPojRF9tetDLinmvLmkUse1PEg93wXjg1uKc6tzdN5rRV87iNkx86OblP0hJAtGj9IeNY4fFr0XxM0wrOt2qmSA19gOhELN4sqUNPQ=="}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:30.932309 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b52b5f76-ee22-40dc-a05d-13b2c40850d9 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03" status: 200 len: 1835 microversion: 2.1 time: 0.596878 Aug 31 16:16:30.946120 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2489/5161] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:30 2022] GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03 => generated 1835 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:30.946120 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-164d1ce6-acca-4477-ac38-f23d93c9e6a1 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:30.946971 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-164d1ce6-acca-4477-ac38-f23d93c9e6a1 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:30.975714 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-164d1ce6-acca-4477-ac38-f23d93c9e6a1 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:30.976520 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-164d1ce6-acca-4477-ac38-f23d93c9e6a1 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:30.977411 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-164d1ce6-acca-4477-ac38-f23d93c9e6a1 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:30.978599 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-164d1ce6-acca-4477-ac38-f23d93c9e6a1 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:30.979418 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-164d1ce6-acca-4477-ac38-f23d93c9e6a1 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:30.980082 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-164d1ce6-acca-4477-ac38-f23d93c9e6a1 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:30.981544 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-e8c49a2f-bba7-4e06-88e0-c375c0e5550d tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Getting quotas for project 8c7a87c31955434abae235e438ee3683. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:16:31.001509 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-e8c49a2f-bba7-4e06-88e0-c375c0e5550d tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Getting quotas for user 6318cd386150452f9efb44ce374d6a88 and project 8c7a87c31955434abae235e438ee3683. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:16:31.018321 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:16:31.055931 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e8c49a2f-bba7-4e06-88e0-c375c0e5550d tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.217322 Aug 31 16:16:31.064678 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2673/5162] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 31 16:16:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:16:31.070577 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9793cc0a-9a7f-4f7f-a97c-49ef77910be5 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:31.073805 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9793cc0a-9a7f-4f7f-a97c-49ef77910be5 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: e1cb02b7-1dd6-4c83-9008-e19525731e03] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:31.092497 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9793cc0a-9a7f-4f7f-a97c-49ef77910be5 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:31.093072 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9793cc0a-9a7f-4f7f-a97c-49ef77910be5 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:31.093736 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9793cc0a-9a7f-4f7f-a97c-49ef77910be5 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:31.095253 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9793cc0a-9a7f-4f7f-a97c-49ef77910be5 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:31.095718 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9793cc0a-9a7f-4f7f-a97c-49ef77910be5 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:31.096141 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9793cc0a-9a7f-4f7f-a97c-49ef77910be5 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:31.303933 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-164d1ce6-acca-4477-ac38-f23d93c9e6a1 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:31.316276 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-164d1ce6-acca-4477-ac38-f23d93c9e6a1 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1512 microversion: 2.1 time: 0.380572 Aug 31 16:16:31.319925 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2490/5163] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:30 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1512 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:31.328077 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d7663fb6-69ee-4b99-9d14-e5e9974f5c01 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:31.330600 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d7663fb6-69ee-4b99-9d14-e5e9974f5c01 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:31.339006 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7663fb6-69ee-4b99-9d14-e5e9974f5c01 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:31.340073 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7663fb6-69ee-4b99-9d14-e5e9974f5c01 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:31.340592 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7663fb6-69ee-4b99-9d14-e5e9974f5c01 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:31.341392 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7663fb6-69ee-4b99-9d14-e5e9974f5c01 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:31.341986 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7663fb6-69ee-4b99-9d14-e5e9974f5c01 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:31.342540 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7663fb6-69ee-4b99-9d14-e5e9974f5c01 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:31.352225 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9793cc0a-9a7f-4f7f-a97c-49ef77910be5 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:31.365899 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9793cc0a-9a7f-4f7f-a97c-49ef77910be5 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03" status: 200 len: 1682 microversion: 2.1 time: 0.303674 Aug 31 16:16:31.366274 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2674/5164] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:31 2022] GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03 => generated 1682 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:31.407606 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d7663fb6-69ee-4b99-9d14-e5e9974f5c01 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef/ips" status: 200 len: 149 microversion: 2.1 time: 0.086317 Aug 31 16:16:31.408655 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2491/5165] 10.222.0.50 () {58 vars in 1248 bytes} [Wed Aug 31 16:16:31 2022] GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef/ips => generated 149 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:16:31.508961 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-750003e0-ef40-49a5-ab3b-a8725dc80fc5 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:31.514399 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-750003e0-ef40-49a5-ab3b-a8725dc80fc5 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: e1cb02b7-1dd6-4c83-9008-e19525731e03] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:31.523342 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-750003e0-ef40-49a5-ab3b-a8725dc80fc5 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:31.524223 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-750003e0-ef40-49a5-ab3b-a8725dc80fc5 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:31.525025 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-750003e0-ef40-49a5-ab3b-a8725dc80fc5 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:31.527404 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-750003e0-ef40-49a5-ab3b-a8725dc80fc5 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:31.529035 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-750003e0-ef40-49a5-ab3b-a8725dc80fc5 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:31.529712 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-750003e0-ef40-49a5-ab3b-a8725dc80fc5 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:31.535474 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:16:32.086663 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e133ae57-8cad-46d8-bd12-38d45387659d tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:32.088033 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e133ae57-8cad-46d8-bd12-38d45387659d tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 14167776-553f-4203-887b-3cb8e4cc0a2a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:32.098640 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e133ae57-8cad-46d8-bd12-38d45387659d tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:32.102808 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e133ae57-8cad-46d8-bd12-38d45387659d tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:32.103587 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e133ae57-8cad-46d8-bd12-38d45387659d tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:32.104687 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e133ae57-8cad-46d8-bd12-38d45387659d tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:32.109171 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e133ae57-8cad-46d8-bd12-38d45387659d tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:32.110568 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e133ae57-8cad-46d8-bd12-38d45387659d tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:32.629681 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e133ae57-8cad-46d8-bd12-38d45387659d tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:32.640934 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e133ae57-8cad-46d8-bd12-38d45387659d tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a" status: 200 len: 1521 microversion: 2.1 time: 0.882304 Aug 31 16:16:32.656719 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2492/5166] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:31 2022] GET /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a => generated 1521 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:16:32.664639 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-72e7fffc-d3ec-4d5b-91bc-a0dae94dbe37 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:32.666564 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-72e7fffc-d3ec-4d5b-91bc-a0dae94dbe37 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:32.674044 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72e7fffc-d3ec-4d5b-91bc-a0dae94dbe37 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:32.674885 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72e7fffc-d3ec-4d5b-91bc-a0dae94dbe37 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:32.675753 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72e7fffc-d3ec-4d5b-91bc-a0dae94dbe37 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:32.677141 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72e7fffc-d3ec-4d5b-91bc-a0dae94dbe37 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:32.677800 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72e7fffc-d3ec-4d5b-91bc-a0dae94dbe37 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:32.678909 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72e7fffc-d3ec-4d5b-91bc-a0dae94dbe37 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:33.239220 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-72e7fffc-d3ec-4d5b-91bc-a0dae94dbe37 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:33.248853 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-72e7fffc-d3ec-4d5b-91bc-a0dae94dbe37 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1512 microversion: 2.1 time: 0.590900 Aug 31 16:16:33.256243 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2493/5167] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:32 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1512 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:33.664349 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c9d11b48-e3ce-4633-93d6-f238b29b8b75 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:33.665973 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c9d11b48-e3ce-4633-93d6-f238b29b8b75 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 14167776-553f-4203-887b-3cb8e4cc0a2a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:33.677352 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9d11b48-e3ce-4633-93d6-f238b29b8b75 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:33.678127 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9d11b48-e3ce-4633-93d6-f238b29b8b75 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:33.678575 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9d11b48-e3ce-4633-93d6-f238b29b8b75 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:33.679307 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9d11b48-e3ce-4633-93d6-f238b29b8b75 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:33.679731 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9d11b48-e3ce-4633-93d6-f238b29b8b75 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:33.680151 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9d11b48-e3ce-4633-93d6-f238b29b8b75 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:33.796125 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-750003e0-ef40-49a5-ab3b-a8725dc80fc5 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "POST /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03/action" status: 200 len: 32646 microversion: 2.1 time: 2.291329 Aug 31 16:16:33.799385 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2675/5168] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:16:31 2022] POST /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03/action => generated 32646 bytes in 2299 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:16:33.857740 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c9d11b48-e3ce-4633-93d6-f238b29b8b75 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:33.870086 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c9d11b48-e3ce-4633-93d6-f238b29b8b75 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a" status: 200 len: 1521 microversion: 2.1 time: 0.209651 Aug 31 16:16:33.870699 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2494/5169] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:33 2022] GET /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:16:33.967279 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c31ed4bd-4963-44a0-b5f9-ebbc4ac3b120 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:33.980658 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c31ed4bd-4963-44a0-b5f9-ebbc4ac3b120 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] [instance: e1cb02b7-1dd6-4c83-9008-e19525731e03] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:33.993970 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c31ed4bd-4963-44a0-b5f9-ebbc4ac3b120 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:33.995228 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c31ed4bd-4963-44a0-b5f9-ebbc4ac3b120 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:33.995875 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c31ed4bd-4963-44a0-b5f9-ebbc4ac3b120 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:33.999375 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c31ed4bd-4963-44a0-b5f9-ebbc4ac3b120 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:34.000742 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c31ed4bd-4963-44a0-b5f9-ebbc4ac3b120 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:34.001473 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c31ed4bd-4963-44a0-b5f9-ebbc4ac3b120 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:34.069669 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3b5a7975-f190-4725-ae82-643796ff93aa tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1541533752", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "01008e59-fbd2-4df8-aac3-7d0cd1c7d44d"}], "security_groups": [{"name": "tempest-securitygroup--2050818877"}], "key_name": "tempest-keypair-1366133600", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:34.088778 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c31ed4bd-4963-44a0-b5f9-ebbc4ac3b120 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '61d9d91371ea4bc9b2893beaca99473d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f549385563d444e1a36de6f85caeb877', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:34.089413 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c31ed4bd-4963-44a0-b5f9-ebbc4ac3b120 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] [instance: e1cb02b7-1dd6-4c83-9008-e19525731e03] flavor_id is None. Assuming migration. {{(pid=128864) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 31 16:16:34.090918 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c31ed4bd-4963-44a0-b5f9-ebbc4ac3b120 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] [instance: e1cb02b7-1dd6-4c83-9008-e19525731e03] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128864) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 31 16:16:34.306023 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-3b5a7975-f190-4725-ae82-643796ff93aa tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] validate_networks() for [('01008e59-fbd2-4df8-aac3-7d0cd1c7d44d', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:16:34.463630 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c31ed4bd-4963-44a0-b5f9-ebbc4ac3b120 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03/action" status: 202 len: 0 microversion: 2.1 time: 0.503474 Aug 31 16:16:34.468393 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2676/5170] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:16:33 2022] POST /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03/action => generated 0 bytes in 510 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:16:34.476457 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-aa608b36-4146-4b23-95cc-df30716ad30b tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b48abf44-730e-41a9-a25c-4f0fa59a917c"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:34.480519 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-aa608b36-4146-4b23-95cc-df30716ad30b tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:34.488899 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aa608b36-4146-4b23-95cc-df30716ad30b tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:34.491427 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aa608b36-4146-4b23-95cc-df30716ad30b tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:34.492470 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aa608b36-4146-4b23-95cc-df30716ad30b tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:34.495070 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aa608b36-4146-4b23-95cc-df30716ad30b tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:34.495731 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aa608b36-4146-4b23-95cc-df30716ad30b tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:34.496226 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aa608b36-4146-4b23-95cc-df30716ad30b tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:35.026135 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-aa608b36-4146-4b23-95cc-df30716ad30b tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "POST /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.555821 Aug 31 16:16:35.039582 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2677/5171] 10.222.0.50 () {60 vars in 1323 bytes} [Wed Aug 31 16:16:34 2022] POST /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef/os-volume_attachments => generated 194 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:16:35.067012 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-27665eaa-07e4-49c7-a47e-c7352f74c260 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:35.071181 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-27665eaa-07e4-49c7-a47e-c7352f74c260 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:35.099591 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-27665eaa-07e4-49c7-a47e-c7352f74c260 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:35.100095 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-27665eaa-07e4-49c7-a47e-c7352f74c260 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:35.100532 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-27665eaa-07e4-49c7-a47e-c7352f74c260 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:35.104866 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-27665eaa-07e4-49c7-a47e-c7352f74c260 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:35.105973 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-27665eaa-07e4-49c7-a47e-c7352f74c260 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:35.106522 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-27665eaa-07e4-49c7-a47e-c7352f74c260 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:35.520209 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-27665eaa-07e4-49c7-a47e-c7352f74c260 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:35.532180 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-27665eaa-07e4-49c7-a47e-c7352f74c260 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1512 microversion: 2.1 time: 0.489073 Aug 31 16:16:35.547916 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2678/5172] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:35 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1512 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:35.558039 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8244808d-df3d-400a-b6fb-bfab9a438405 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:35.559604 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8244808d-df3d-400a-b6fb-bfab9a438405 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: e1cb02b7-1dd6-4c83-9008-e19525731e03] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:35.568582 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8244808d-df3d-400a-b6fb-bfab9a438405 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:35.569211 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8244808d-df3d-400a-b6fb-bfab9a438405 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:35.569897 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8244808d-df3d-400a-b6fb-bfab9a438405 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:35.570775 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8244808d-df3d-400a-b6fb-bfab9a438405 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:35.571299 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8244808d-df3d-400a-b6fb-bfab9a438405 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:35.571789 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8244808d-df3d-400a-b6fb-bfab9a438405 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:36.058334 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-3b5a7975-f190-4725-ae82-643796ff93aa tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Getting quotas for project 8c7a87c31955434abae235e438ee3683. Resources: dict_keys(['metadata_items']) {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:16:36.071666 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-3b5a7975-f190-4725-ae82-643796ff93aa tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Getting quotas for user 6318cd386150452f9efb44ce374d6a88 and project 8c7a87c31955434abae235e438ee3683. Resources: dict_keys(['metadata_items']) {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:16:36.093332 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-3b5a7975-f190-4725-ae82-643796ff93aa tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:16:36.094059 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-3b5a7975-f190-4725-ae82-643796ff93aa tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:16:36.094911 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-3b5a7975-f190-4725-ae82-643796ff93aa tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:16:36.095542 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-3b5a7975-f190-4725-ae82-643796ff93aa tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:16:36.096161 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-3b5a7975-f190-4725-ae82-643796ff93aa tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:16:36.105774 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8244808d-df3d-400a-b6fb-bfab9a438405 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:36.106915 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b5a7975-f190-4725-ae82-643796ff93aa tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:36.107688 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b5a7975-f190-4725-ae82-643796ff93aa tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:36.108346 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b5a7975-f190-4725-ae82-643796ff93aa tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:36.109387 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b5a7975-f190-4725-ae82-643796ff93aa tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:36.110070 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b5a7975-f190-4725-ae82-643796ff93aa tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:36.110812 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b5a7975-f190-4725-ae82-643796ff93aa tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:36.132120 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-3b5a7975-f190-4725-ae82-643796ff93aa tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Getting quotas for project 8c7a87c31955434abae235e438ee3683. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:16:36.133471 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8244808d-df3d-400a-b6fb-bfab9a438405 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03" status: 200 len: 1691 microversion: 2.1 time: 0.578196 Aug 31 16:16:36.136768 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2679/5173] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:35 2022] GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03 => generated 1691 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:36.152524 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-3b5a7975-f190-4725-ae82-643796ff93aa tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Getting quotas for user 6318cd386150452f9efb44ce374d6a88 and project 8c7a87c31955434abae235e438ee3683. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:16:36.156870 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-abb331a1-4fb5-4d3c-badc-7e7a8f8e57fb tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:36.157762 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-abb331a1-4fb5-4d3c-badc-7e7a8f8e57fb tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 14167776-553f-4203-887b-3cb8e4cc0a2a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:36.183952 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3b5a7975-f190-4725-ae82-643796ff93aa tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:16:36.186497 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-abb331a1-4fb5-4d3c-badc-7e7a8f8e57fb tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:36.187480 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3b5a7975-f190-4725-ae82-643796ff93aa tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] [instance: d4b3c604-165a-4ffe-935f-0b55a527fad7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:16:36.189934 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-abb331a1-4fb5-4d3c-badc-7e7a8f8e57fb tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:36.191418 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-abb331a1-4fb5-4d3c-badc-7e7a8f8e57fb tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:36.196587 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-abb331a1-4fb5-4d3c-badc-7e7a8f8e57fb tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:36.197404 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-abb331a1-4fb5-4d3c-badc-7e7a8f8e57fb tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:36.198194 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-abb331a1-4fb5-4d3c-badc-7e7a8f8e57fb tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:36.362878 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3b5a7975-f190-4725-ae82-643796ff93aa tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.303519 Aug 31 16:16:36.367686 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2495/5174] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:16:34 2022] POST /compute/v2.1/servers => generated 407 bytes in 2309 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:16:36.387289 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-65317469-4c03-4291-8a7c-da3faf09bb5e req-a2b0a41c-73f0-4348-83ce-2573bb808e41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14167776-553f-4203-887b-3cb8e4cc0a2a", "name": "network-vif-deleted", "tag": "0173af77-c960-4ebc-83db-2830c6fe35dd"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:36.416843 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-abb331a1-4fb5-4d3c-badc-7e7a8f8e57fb tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5f67b54e87c46d28e7d5217bf49ca57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd25e1b1938b2401bab27dafadc9745d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:36.417911 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-65317469-4c03-4291-8a7c-da3faf09bb5e req-a2b0a41c-73f0-4348-83ce-2573bb808e41 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:36.418465 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-65317469-4c03-4291-8a7c-da3faf09bb5e req-a2b0a41c-73f0-4348-83ce-2573bb808e41 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:36.418905 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-65317469-4c03-4291-8a7c-da3faf09bb5e req-a2b0a41c-73f0-4348-83ce-2573bb808e41 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:36.438287 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-abb331a1-4fb5-4d3c-badc-7e7a8f8e57fb tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a" status: 200 len: 1307 microversion: 2.1 time: 0.298915 Aug 31 16:16:36.440784 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2680/5175] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:36 2022] GET /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a => generated 1307 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:36.457939 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e232522c-5f2b-44df-bbb9-1610cc421f40 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:36.460183 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e232522c-5f2b-44df-bbb9-1610cc421f40 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] [instance: d4b3c604-165a-4ffe-935f-0b55a527fad7] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:36.519008 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-65317469-4c03-4291-8a7c-da3faf09bb5e req-a2b0a41c-73f0-4348-83ce-2573bb808e41 service nova] Creating event network-vif-deleted:0173af77-c960-4ebc-83db-2830c6fe35dd for instance 14167776-553f-4203-887b-3cb8e4cc0a2a on n-h2-833090-16 Aug 31 16:16:36.540038 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-65317469-4c03-4291-8a7c-da3faf09bb5e req-a2b0a41c-73f0-4348-83ce-2573bb808e41 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169381 Aug 31 16:16:36.544625 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2496/5176] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:16:36.571224 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7c6d8636-dbac-453d-a1a1-0a12df19562e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:36.572104 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7c6d8636-dbac-453d-a1a1-0a12df19562e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:36.594839 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e232522c-5f2b-44df-bbb9-1610cc421f40 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6318cd386150452f9efb44ce374d6a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7a87c31955434abae235e438ee3683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:36.615350 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e232522c-5f2b-44df-bbb9-1610cc421f40 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] 10.222.0.50 "GET /compute/v2.1/servers/d4b3c604-165a-4ffe-935f-0b55a527fad7" status: 200 len: 1270 microversion: 2.1 time: 0.173391 Aug 31 16:16:36.618880 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2681/5177] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:36 2022] GET /compute/v2.1/servers/d4b3c604-165a-4ffe-935f-0b55a527fad7 => generated 1270 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:36.619277 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c6d8636-dbac-453d-a1a1-0a12df19562e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:36.632833 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c6d8636-dbac-453d-a1a1-0a12df19562e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:36.633502 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c6d8636-dbac-453d-a1a1-0a12df19562e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:36.634455 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c6d8636-dbac-453d-a1a1-0a12df19562e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:36.637397 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c6d8636-dbac-453d-a1a1-0a12df19562e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:36.638833 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c6d8636-dbac-453d-a1a1-0a12df19562e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:37.036089 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7c6d8636-dbac-453d-a1a1-0a12df19562e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:37.048924 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7c6d8636-dbac-453d-a1a1-0a12df19562e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1512 microversion: 2.1 time: 0.497445 Aug 31 16:16:37.077206 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2497/5178] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:36 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1512 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:37.160428 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3ba37503-b0ce-416c-a156-8dd4b4dd855d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:37.161896 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3ba37503-b0ce-416c-a156-8dd4b4dd855d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: e1cb02b7-1dd6-4c83-9008-e19525731e03] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:37.185874 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3ba37503-b0ce-416c-a156-8dd4b4dd855d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:37.187020 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3ba37503-b0ce-416c-a156-8dd4b4dd855d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:37.187456 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3ba37503-b0ce-416c-a156-8dd4b4dd855d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:37.191437 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3ba37503-b0ce-416c-a156-8dd4b4dd855d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:37.191916 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3ba37503-b0ce-416c-a156-8dd4b4dd855d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:37.194249 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3ba37503-b0ce-416c-a156-8dd4b4dd855d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:37.466205 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-85a7a2ea-e5f7-4491-9d44-9f8932fd4326 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:37.466837 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-85a7a2ea-e5f7-4491-9d44-9f8932fd4326 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] [instance: 14167776-553f-4203-887b-3cb8e4cc0a2a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:37.481960 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-85a7a2ea-e5f7-4491-9d44-9f8932fd4326 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:37.483024 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-85a7a2ea-e5f7-4491-9d44-9f8932fd4326 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:37.484305 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-85a7a2ea-e5f7-4491-9d44-9f8932fd4326 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:37.485292 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-85a7a2ea-e5f7-4491-9d44-9f8932fd4326 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:37.485751 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-85a7a2ea-e5f7-4491-9d44-9f8932fd4326 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:37.486213 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-85a7a2ea-e5f7-4491-9d44-9f8932fd4326 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:37.506768 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-85a7a2ea-e5f7-4491-9d44-9f8932fd4326 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] HTTP exception thrown: Instance 14167776-553f-4203-887b-3cb8e4cc0a2a could not be found. Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-85a7a2ea-e5f7-4491-9d44-9f8932fd4326 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Request method failure captured: Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a HTTP/1.1 Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4gyS9s2L5B9hQNj6-3Bq9VaD0LX3rcaQEx2TULT5jAIwE_syzV3-H131XTbmJBlDQO8oVuY07kOMzEcgw7jqBoRJefg3cpTEEDA9_ABXOKuvCpOJqmPJLOqW4m5eFAB54B22EgPHkAmNh0-egef1rV97h7ELSV4bCzsJF6Z18KMZ5s Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: d25e1b1938b2401bab27dafadc9745d5 Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-961929748 Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d25e1b1938b2401bab27dafadc9745d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d25e1b1938b2401bab27dafadc9745d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d25e1b1938b2401bab27dafadc9745d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d25e1b1938b2401bab27dafadc9745d5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServerRescueNegativeTestJSON-961929748 Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: d25e1b1938b2401bab27dafadc9745d5 Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-961929748 Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServerRescueNegativeTestJSON-961929748-project Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: b5f67b54e87c46d28e7d5217bf49ca57 Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServerRescueNegativeTestJSON-961929748-project Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 14167776-553f-4203-887b-3cb8e4cc0a2a could not be found. Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '14167776-553f-4203-887b-3cb8e4cc0a2a'} Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14167776-553f-4203-887b-3cb8e4cc0a2a could not be found. Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14167776-553f-4203-887b-3cb8e4cc0a2a could not be found. Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:37.508433 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:16:37.513820 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:37.513820 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:16:37.513820 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:16:37.513820 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:16:37.513820 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:16:37.513820 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:16:37.513820 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14167776-553f-4203-887b-3cb8e4cc0a2a could not be found. Aug 31 16:16:37.513820 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:16:37.513820 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-85a7a2ea-e5f7-4491-9d44-9f8932fd4326 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] Returning 404 to user: Instance 14167776-553f-4203-887b-3cb8e4cc0a2a could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:16:37.513820 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-85a7a2ea-e5f7-4491-9d44-9f8932fd4326 tempest-ServerRescueNegativeTestJSON-961929748 tempest-ServerRescueNegativeTestJSON-961929748-project] 10.222.0.50 "GET /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a" status: 404 len: 111 microversion: 2.1 time: 0.049701 Aug 31 16:16:37.514909 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2498/5179] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:37 2022] GET /compute/v2.1/servers/14167776-553f-4203-887b-3cb8e4cc0a2a => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:16:37.643395 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5e7e5ba5-0e84-4be3-b65e-f2682cd4d69b tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:37.644068 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5e7e5ba5-0e84-4be3-b65e-f2682cd4d69b tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] [instance: d4b3c604-165a-4ffe-935f-0b55a527fad7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:37.655788 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5e7e5ba5-0e84-4be3-b65e-f2682cd4d69b tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:37.675880 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5e7e5ba5-0e84-4be3-b65e-f2682cd4d69b tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:37.676092 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5e7e5ba5-0e84-4be3-b65e-f2682cd4d69b tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:37.677156 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5e7e5ba5-0e84-4be3-b65e-f2682cd4d69b tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:37.679986 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5e7e5ba5-0e84-4be3-b65e-f2682cd4d69b tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:37.680752 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5e7e5ba5-0e84-4be3-b65e-f2682cd4d69b tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:38.388137 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5e7e5ba5-0e84-4be3-b65e-f2682cd4d69b tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6318cd386150452f9efb44ce374d6a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7a87c31955434abae235e438ee3683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:38.394772 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3ba37503-b0ce-416c-a156-8dd4b4dd855d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:38.411768 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5e7e5ba5-0e84-4be3-b65e-f2682cd4d69b tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] 10.222.0.50 "GET /compute/v2.1/servers/d4b3c604-165a-4ffe-935f-0b55a527fad7" status: 200 len: 1266 microversion: 2.1 time: 0.778897 Aug 31 16:16:38.414416 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2499/5180] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:37 2022] GET /compute/v2.1/servers/d4b3c604-165a-4ffe-935f-0b55a527fad7 => generated 1266 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:38.416298 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3ba37503-b0ce-416c-a156-8dd4b4dd855d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03" status: 200 len: 1691 microversion: 2.1 time: 1.262365 Aug 31 16:16:38.421330 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2682/5181] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:37 2022] GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03 => generated 1691 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:38.432532 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4a5602ad-c7ba-4af3-a440-ef7d2064b9b9 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:38.433833 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4a5602ad-c7ba-4af3-a440-ef7d2064b9b9 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:38.455298 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a5602ad-c7ba-4af3-a440-ef7d2064b9b9 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:38.455797 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a5602ad-c7ba-4af3-a440-ef7d2064b9b9 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:38.456230 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a5602ad-c7ba-4af3-a440-ef7d2064b9b9 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:38.456932 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a5602ad-c7ba-4af3-a440-ef7d2064b9b9 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:38.466067 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a5602ad-c7ba-4af3-a440-ef7d2064b9b9 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:38.472968 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a5602ad-c7ba-4af3-a440-ef7d2064b9b9 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:39.056752 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4a5602ad-c7ba-4af3-a440-ef7d2064b9b9 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:39.066711 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4a5602ad-c7ba-4af3-a440-ef7d2064b9b9 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1512 microversion: 2.1 time: 0.651006 Aug 31 16:16:39.070708 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2500/5182] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:38 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1512 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:39.435411 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9db581b0-bc81-4258-a3a3-e5d00430bc02 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:39.436203 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9db581b0-bc81-4258-a3a3-e5d00430bc02 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] [instance: d4b3c604-165a-4ffe-935f-0b55a527fad7] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:39.440261 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3827f389-4636-4d39-96d5-8d5b3f55a2de tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:39.442061 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3827f389-4636-4d39-96d5-8d5b3f55a2de tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: e1cb02b7-1dd6-4c83-9008-e19525731e03] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:39.453178 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9db581b0-bc81-4258-a3a3-e5d00430bc02 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:39.453767 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9db581b0-bc81-4258-a3a3-e5d00430bc02 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:39.454238 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9db581b0-bc81-4258-a3a3-e5d00430bc02 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:39.454959 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9db581b0-bc81-4258-a3a3-e5d00430bc02 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:39.455455 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9db581b0-bc81-4258-a3a3-e5d00430bc02 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:39.455914 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9db581b0-bc81-4258-a3a3-e5d00430bc02 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:39.457957 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3827f389-4636-4d39-96d5-8d5b3f55a2de tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:39.458660 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3827f389-4636-4d39-96d5-8d5b3f55a2de tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:39.459447 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3827f389-4636-4d39-96d5-8d5b3f55a2de tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:39.460393 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3827f389-4636-4d39-96d5-8d5b3f55a2de tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:39.461015 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3827f389-4636-4d39-96d5-8d5b3f55a2de tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:39.461621 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3827f389-4636-4d39-96d5-8d5b3f55a2de tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:39.743711 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9db581b0-bc81-4258-a3a3-e5d00430bc02 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6318cd386150452f9efb44ce374d6a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7a87c31955434abae235e438ee3683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:39.763585 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9db581b0-bc81-4258-a3a3-e5d00430bc02 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] 10.222.0.50 "GET /compute/v2.1/servers/d4b3c604-165a-4ffe-935f-0b55a527fad7" status: 200 len: 1328 microversion: 2.1 time: 0.332156 Aug 31 16:16:39.765233 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2683/5183] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:39 2022] GET /compute/v2.1/servers/d4b3c604-165a-4ffe-935f-0b55a527fad7 => generated 1328 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:40.019242 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3827f389-4636-4d39-96d5-8d5b3f55a2de tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:40.035547 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3827f389-4636-4d39-96d5-8d5b3f55a2de tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03" status: 200 len: 1691 microversion: 2.1 time: 0.600845 Aug 31 16:16:40.036497 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2501/5184] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:39 2022] GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03 => generated 1691 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:16:40.101986 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5aa88679-fc31-447d-9a79-e049c107d601 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:40.103587 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5aa88679-fc31-447d-9a79-e049c107d601 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:40.114743 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5aa88679-fc31-447d-9a79-e049c107d601 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:40.117943 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5aa88679-fc31-447d-9a79-e049c107d601 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:40.120549 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5aa88679-fc31-447d-9a79-e049c107d601 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:40.126606 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5aa88679-fc31-447d-9a79-e049c107d601 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:40.129009 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5aa88679-fc31-447d-9a79-e049c107d601 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:40.136004 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5aa88679-fc31-447d-9a79-e049c107d601 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:40.631389 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5aa88679-fc31-447d-9a79-e049c107d601 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:40.644742 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5aa88679-fc31-447d-9a79-e049c107d601 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1533 microversion: 2.1 time: 0.555501 Aug 31 16:16:40.647491 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2684/5185] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:40 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1533 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:40.787018 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e835e1d2-ab57-4841-a9bf-5bb534e5ce91 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:40.787619 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e835e1d2-ab57-4841-a9bf-5bb534e5ce91 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] [instance: d4b3c604-165a-4ffe-935f-0b55a527fad7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:40.805063 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e835e1d2-ab57-4841-a9bf-5bb534e5ce91 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:40.805544 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e835e1d2-ab57-4841-a9bf-5bb534e5ce91 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:40.806187 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e835e1d2-ab57-4841-a9bf-5bb534e5ce91 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:40.807657 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e835e1d2-ab57-4841-a9bf-5bb534e5ce91 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:40.808256 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e835e1d2-ab57-4841-a9bf-5bb534e5ce91 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:40.808845 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e835e1d2-ab57-4841-a9bf-5bb534e5ce91 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:40.936124 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e835e1d2-ab57-4841-a9bf-5bb534e5ce91 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6318cd386150452f9efb44ce374d6a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7a87c31955434abae235e438ee3683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:40.953354 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e835e1d2-ab57-4841-a9bf-5bb534e5ce91 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] 10.222.0.50 "GET /compute/v2.1/servers/d4b3c604-165a-4ffe-935f-0b55a527fad7" status: 200 len: 1328 microversion: 2.1 time: 0.169878 Aug 31 16:16:40.954409 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2502/5186] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:40 2022] GET /compute/v2.1/servers/d4b3c604-165a-4ffe-935f-0b55a527fad7 => generated 1328 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:41.059109 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-bccd1bdc-d732-424a-8b9b-244baa7fe37d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:41.060463 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-bccd1bdc-d732-424a-8b9b-244baa7fe37d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: e1cb02b7-1dd6-4c83-9008-e19525731e03] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:41.068056 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bccd1bdc-d732-424a-8b9b-244baa7fe37d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:41.071272 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bccd1bdc-d732-424a-8b9b-244baa7fe37d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:41.071740 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bccd1bdc-d732-424a-8b9b-244baa7fe37d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:41.072490 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bccd1bdc-d732-424a-8b9b-244baa7fe37d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:41.072953 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bccd1bdc-d732-424a-8b9b-244baa7fe37d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:41.073951 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bccd1bdc-d732-424a-8b9b-244baa7fe37d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:41.672913 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-bccd1bdc-d732-424a-8b9b-244baa7fe37d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:41.675352 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d8323912-9b3e-4ff5-bc76-6cc4434b02bc tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:41.676366 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d8323912-9b3e-4ff5-bc76-6cc4434b02bc tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:41.683917 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8323912-9b3e-4ff5-bc76-6cc4434b02bc tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:41.684728 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8323912-9b3e-4ff5-bc76-6cc4434b02bc tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:41.685327 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8323912-9b3e-4ff5-bc76-6cc4434b02bc tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:41.686211 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8323912-9b3e-4ff5-bc76-6cc4434b02bc tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:41.686933 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8323912-9b3e-4ff5-bc76-6cc4434b02bc tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:41.687520 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8323912-9b3e-4ff5-bc76-6cc4434b02bc tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:41.690052 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-bccd1bdc-d732-424a-8b9b-244baa7fe37d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03" status: 200 len: 1696 microversion: 2.1 time: 0.634806 Aug 31 16:16:41.690701 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2685/5187] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:41 2022] GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03 => generated 1696 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:16:41.977423 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-dcd0211c-a867-443b-a5b9-5fb5fb6a944d tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:41.978065 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-dcd0211c-a867-443b-a5b9-5fb5fb6a944d tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] [instance: d4b3c604-165a-4ffe-935f-0b55a527fad7] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:41.987213 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dcd0211c-a867-443b-a5b9-5fb5fb6a944d tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:41.987695 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dcd0211c-a867-443b-a5b9-5fb5fb6a944d tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:41.988316 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dcd0211c-a867-443b-a5b9-5fb5fb6a944d tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:41.989634 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dcd0211c-a867-443b-a5b9-5fb5fb6a944d tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:41.990086 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dcd0211c-a867-443b-a5b9-5fb5fb6a944d tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:41.990856 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dcd0211c-a867-443b-a5b9-5fb5fb6a944d tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:42.569617 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d8323912-9b3e-4ff5-bc76-6cc4434b02bc tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:42.586150 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d8323912-9b3e-4ff5-bc76-6cc4434b02bc tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1533 microversion: 2.1 time: 0.921736 Aug 31 16:16:42.588153 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2503/5188] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:41 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1533 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:42.713419 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-98a17c0d-abb5-4900-84dd-1ceae23ffd4a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:42.714028 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-98a17c0d-abb5-4900-84dd-1ceae23ffd4a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: e1cb02b7-1dd6-4c83-9008-e19525731e03] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:42.723479 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98a17c0d-abb5-4900-84dd-1ceae23ffd4a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:42.723972 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98a17c0d-abb5-4900-84dd-1ceae23ffd4a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:42.724407 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98a17c0d-abb5-4900-84dd-1ceae23ffd4a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:42.725117 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98a17c0d-abb5-4900-84dd-1ceae23ffd4a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:42.725563 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98a17c0d-abb5-4900-84dd-1ceae23ffd4a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:42.725964 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98a17c0d-abb5-4900-84dd-1ceae23ffd4a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:42.868563 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-dcd0211c-a867-443b-a5b9-5fb5fb6a944d tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6318cd386150452f9efb44ce374d6a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7a87c31955434abae235e438ee3683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:42.877993 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-dcd0211c-a867-443b-a5b9-5fb5fb6a944d tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] 10.222.0.50 "GET /compute/v2.1/servers/d4b3c604-165a-4ffe-935f-0b55a527fad7" status: 200 len: 1396 microversion: 2.1 time: 0.906793 Aug 31 16:16:42.879330 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2686/5189] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:41 2022] GET /compute/v2.1/servers/d4b3c604-165a-4ffe-935f-0b55a527fad7 => generated 1396 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:42.884679 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-6d878e7a-b1aa-44ec-a930-c1dcba2c32b3 req-f7f0f518-421b-4b18-a2d7-e0ad52f24e7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b051f4f-6b51-4ca7-9afd-6d75682e7f52", "name": "network-vif-plugged", "status": "completed", "tag": "5c653659-ac4d-41e4-8b0a-b35ade932e62"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:42.903894 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-6d878e7a-b1aa-44ec-a930-c1dcba2c32b3 req-f7f0f518-421b-4b18-a2d7-e0ad52f24e7a service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:42.904521 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-6d878e7a-b1aa-44ec-a930-c1dcba2c32b3 req-f7f0f518-421b-4b18-a2d7-e0ad52f24e7a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:42.905071 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-6d878e7a-b1aa-44ec-a930-c1dcba2c32b3 req-f7f0f518-421b-4b18-a2d7-e0ad52f24e7a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:42.919183 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-6d878e7a-b1aa-44ec-a930-c1dcba2c32b3 req-f7f0f518-421b-4b18-a2d7-e0ad52f24e7a service nova] Creating event network-vif-plugged:5c653659-ac4d-41e4-8b0a-b35ade932e62 for instance 4b051f4f-6b51-4ca7-9afd-6d75682e7f52 on n-h2-833090-16 Aug 31 16:16:42.935167 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-6d878e7a-b1aa-44ec-a930-c1dcba2c32b3 req-f7f0f518-421b-4b18-a2d7-e0ad52f24e7a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053946 Aug 31 16:16:42.936030 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2687/5190] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:16:43.185437 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-98a17c0d-abb5-4900-84dd-1ceae23ffd4a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:43.198430 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-98a17c0d-abb5-4900-84dd-1ceae23ffd4a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03" status: 200 len: 1696 microversion: 2.1 time: 0.488465 Aug 31 16:16:43.199090 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2504/5191] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:42 2022] GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03 => generated 1696 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:16:43.612620 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-366baeb8-8ce0-41c7-b786-b226b63cb943 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:43.613316 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-366baeb8-8ce0-41c7-b786-b226b63cb943 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:43.624921 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-366baeb8-8ce0-41c7-b786-b226b63cb943 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:43.632951 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-366baeb8-8ce0-41c7-b786-b226b63cb943 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:43.633634 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-366baeb8-8ce0-41c7-b786-b226b63cb943 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:43.634585 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-366baeb8-8ce0-41c7-b786-b226b63cb943 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:43.635202 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-366baeb8-8ce0-41c7-b786-b226b63cb943 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:43.635783 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-366baeb8-8ce0-41c7-b786-b226b63cb943 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:43.903032 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9ed3178d-dc2d-4f69-988b-9e5e3ff46f25 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:43.904174 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9ed3178d-dc2d-4f69-988b-9e5e3ff46f25 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] [instance: d4b3c604-165a-4ffe-935f-0b55a527fad7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:43.913018 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9ed3178d-dc2d-4f69-988b-9e5e3ff46f25 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:43.913767 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9ed3178d-dc2d-4f69-988b-9e5e3ff46f25 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:43.914501 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9ed3178d-dc2d-4f69-988b-9e5e3ff46f25 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:43.915585 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9ed3178d-dc2d-4f69-988b-9e5e3ff46f25 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:43.916599 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9ed3178d-dc2d-4f69-988b-9e5e3ff46f25 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:43.917244 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9ed3178d-dc2d-4f69-988b-9e5e3ff46f25 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:44.090508 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-366baeb8-8ce0-41c7-b786-b226b63cb943 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:44.106759 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-366baeb8-8ce0-41c7-b786-b226b63cb943 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1533 microversion: 2.1 time: 0.499332 Aug 31 16:16:44.107374 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2688/5192] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:43 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1533 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:44.125453 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-bc5e9be2-f66c-4006-a923-f8ead1e72872 req-43265e56-8b33-4da6-b799-b206c8f78f8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4b3c604-165a-4ffe-935f-0b55a527fad7", "tag": "a26cfb24-b803-430f-a60a-4b56e2c2b475"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:44.150820 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-bc5e9be2-f66c-4006-a923-f8ead1e72872 req-43265e56-8b33-4da6-b799-b206c8f78f8a service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:44.151751 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-bc5e9be2-f66c-4006-a923-f8ead1e72872 req-43265e56-8b33-4da6-b799-b206c8f78f8a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:44.152443 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-bc5e9be2-f66c-4006-a923-f8ead1e72872 req-43265e56-8b33-4da6-b799-b206c8f78f8a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:44.169191 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-bc5e9be2-f66c-4006-a923-f8ead1e72872 req-43265e56-8b33-4da6-b799-b206c8f78f8a service nova] Creating event network-changed:a26cfb24-b803-430f-a60a-4b56e2c2b475 for instance d4b3c604-165a-4ffe-935f-0b55a527fad7 on n-h1-833090-16 Aug 31 16:16:44.178503 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-bc5e9be2-f66c-4006-a923-f8ead1e72872 req-43265e56-8b33-4da6-b799-b206c8f78f8a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069820 Aug 31 16:16:44.179843 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2689/5193] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:16:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:16:44.223914 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8342434e-b9c6-463f-9c73-e36c3066d90a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:44.225781 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8342434e-b9c6-463f-9c73-e36c3066d90a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: e1cb02b7-1dd6-4c83-9008-e19525731e03] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:44.234472 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8342434e-b9c6-463f-9c73-e36c3066d90a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:44.235054 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8342434e-b9c6-463f-9c73-e36c3066d90a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:44.235510 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8342434e-b9c6-463f-9c73-e36c3066d90a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:44.236212 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8342434e-b9c6-463f-9c73-e36c3066d90a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:44.236656 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8342434e-b9c6-463f-9c73-e36c3066d90a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:44.237070 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8342434e-b9c6-463f-9c73-e36c3066d90a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:44.408816 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9ed3178d-dc2d-4f69-988b-9e5e3ff46f25 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6318cd386150452f9efb44ce374d6a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7a87c31955434abae235e438ee3683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:44.417648 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9ed3178d-dc2d-4f69-988b-9e5e3ff46f25 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] 10.222.0.50 "GET /compute/v2.1/servers/d4b3c604-165a-4ffe-935f-0b55a527fad7" status: 200 len: 1396 microversion: 2.1 time: 0.520869 Aug 31 16:16:44.418976 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2505/5194] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:43 2022] GET /compute/v2.1/servers/d4b3c604-165a-4ffe-935f-0b55a527fad7 => generated 1396 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:44.764637 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8342434e-b9c6-463f-9c73-e36c3066d90a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:44.774586 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8342434e-b9c6-463f-9c73-e36c3066d90a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03" status: 200 len: 1696 microversion: 2.1 time: 0.555731 Aug 31 16:16:44.775330 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2690/5195] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:44 2022] GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03 => generated 1696 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:16:45.130784 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c58729c1-b311-4c1b-9207-255e6c4594ce tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:45.132041 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c58729c1-b311-4c1b-9207-255e6c4594ce tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:45.139661 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c58729c1-b311-4c1b-9207-255e6c4594ce tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:45.140402 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c58729c1-b311-4c1b-9207-255e6c4594ce tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:45.141016 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c58729c1-b311-4c1b-9207-255e6c4594ce tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:45.141870 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c58729c1-b311-4c1b-9207-255e6c4594ce tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:45.142514 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c58729c1-b311-4c1b-9207-255e6c4594ce tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:45.143100 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c58729c1-b311-4c1b-9207-255e6c4594ce tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:45.450002 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6c270661-0d88-4ff3-9f6c-5326faeb5334 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:45.451003 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6c270661-0d88-4ff3-9f6c-5326faeb5334 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] [instance: d4b3c604-165a-4ffe-935f-0b55a527fad7] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:45.452943 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c58729c1-b311-4c1b-9207-255e6c4594ce tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:45.462987 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c58729c1-b311-4c1b-9207-255e6c4594ce tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1533 microversion: 2.1 time: 0.335848 Aug 31 16:16:45.476560 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2506/5196] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:45 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1533 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:45.478223 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6c270661-0d88-4ff3-9f6c-5326faeb5334 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:45.478894 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6c270661-0d88-4ff3-9f6c-5326faeb5334 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:45.479736 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6c270661-0d88-4ff3-9f6c-5326faeb5334 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:45.480784 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6c270661-0d88-4ff3-9f6c-5326faeb5334 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:45.481386 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6c270661-0d88-4ff3-9f6c-5326faeb5334 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:45.481973 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6c270661-0d88-4ff3-9f6c-5326faeb5334 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:45.510757 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:16:45.797648 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8a45e3dd-b1d9-4eff-9175-1f38c4e676df tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:45.798295 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8a45e3dd-b1d9-4eff-9175-1f38c4e676df tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: e1cb02b7-1dd6-4c83-9008-e19525731e03] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:45.804692 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a45e3dd-b1d9-4eff-9175-1f38c4e676df tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:45.805411 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a45e3dd-b1d9-4eff-9175-1f38c4e676df tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:45.809905 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a45e3dd-b1d9-4eff-9175-1f38c4e676df tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:45.810945 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a45e3dd-b1d9-4eff-9175-1f38c4e676df tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:45.812070 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a45e3dd-b1d9-4eff-9175-1f38c4e676df tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:45.813187 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a45e3dd-b1d9-4eff-9175-1f38c4e676df tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:46.122550 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:16:46.171788 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=10 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:16:46.439305 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8a45e3dd-b1d9-4eff-9175-1f38c4e676df tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:46.446167 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:16:46.448632 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8a45e3dd-b1d9-4eff-9175-1f38c4e676df tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03" status: 200 len: 1696 microversion: 2.1 time: 0.655247 Aug 31 16:16:46.452148 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2507/5197] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:45 2022] GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03 => generated 1696 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:16:46.485479 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d408dc33-52df-4da5-a972-a25353b77de9 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:46.486346 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d408dc33-52df-4da5-a972-a25353b77de9 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:46.496355 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d408dc33-52df-4da5-a972-a25353b77de9 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:46.498377 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d408dc33-52df-4da5-a972-a25353b77de9 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:46.499205 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d408dc33-52df-4da5-a972-a25353b77de9 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:46.501378 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d408dc33-52df-4da5-a972-a25353b77de9 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:46.502113 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d408dc33-52df-4da5-a972-a25353b77de9 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:46.504510 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d408dc33-52df-4da5-a972-a25353b77de9 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:46.540029 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6c270661-0d88-4ff3-9f6c-5326faeb5334 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6318cd386150452f9efb44ce374d6a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7a87c31955434abae235e438ee3683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:46.559218 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6c270661-0d88-4ff3-9f6c-5326faeb5334 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] 10.222.0.50 "GET /compute/v2.1/servers/d4b3c604-165a-4ffe-935f-0b55a527fad7" status: 200 len: 1396 microversion: 2.1 time: 1.117864 Aug 31 16:16:46.561003 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2691/5198] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:45 2022] GET /compute/v2.1/servers/d4b3c604-165a-4ffe-935f-0b55a527fad7 => generated 1396 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:46.911750 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d408dc33-52df-4da5-a972-a25353b77de9 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:46.920550 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d408dc33-52df-4da5-a972-a25353b77de9 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1533 microversion: 2.1 time: 0.440011 Aug 31 16:16:46.930941 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2508/5199] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:46 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1533 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:47.473280 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-49378767-6840-4e03-8c96-9f50d322a0cc tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:47.474709 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-49378767-6840-4e03-8c96-9f50d322a0cc tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: e1cb02b7-1dd6-4c83-9008-e19525731e03] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:47.477138 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=6 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:16:47.498106 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-49378767-6840-4e03-8c96-9f50d322a0cc tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:47.500465 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-49378767-6840-4e03-8c96-9f50d322a0cc tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:47.501038 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-49378767-6840-4e03-8c96-9f50d322a0cc tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:47.502778 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-49378767-6840-4e03-8c96-9f50d322a0cc tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:47.503262 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-49378767-6840-4e03-8c96-9f50d322a0cc tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:47.504833 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-49378767-6840-4e03-8c96-9f50d322a0cc tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:47.586059 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c0e96734-fefb-4f00-950f-77ce6d9e0b80 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:47.586751 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c0e96734-fefb-4f00-950f-77ce6d9e0b80 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] [instance: d4b3c604-165a-4ffe-935f-0b55a527fad7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:47.594804 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0e96734-fefb-4f00-950f-77ce6d9e0b80 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:47.595301 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0e96734-fefb-4f00-950f-77ce6d9e0b80 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:47.595803 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0e96734-fefb-4f00-950f-77ce6d9e0b80 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:47.597208 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0e96734-fefb-4f00-950f-77ce6d9e0b80 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:47.597895 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0e96734-fefb-4f00-950f-77ce6d9e0b80 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:47.598431 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0e96734-fefb-4f00-950f-77ce6d9e0b80 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:47.871200 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-49378767-6840-4e03-8c96-9f50d322a0cc tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:47.931167 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-49378767-6840-4e03-8c96-9f50d322a0cc tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03" status: 200 len: 1696 microversion: 2.1 time: 0.458715 Aug 31 16:16:47.932765 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2692/5200] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:47 2022] GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03 => generated 1696 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:47.948725 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-dc636a8b-c201-4a53-a242-9a3454dd6fde tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:47.949328 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-dc636a8b-c201-4a53-a242-9a3454dd6fde tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:47.963295 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dc636a8b-c201-4a53-a242-9a3454dd6fde tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:47.963794 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dc636a8b-c201-4a53-a242-9a3454dd6fde tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:47.968123 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dc636a8b-c201-4a53-a242-9a3454dd6fde tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:47.968936 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dc636a8b-c201-4a53-a242-9a3454dd6fde tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:47.969406 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dc636a8b-c201-4a53-a242-9a3454dd6fde tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:47.969837 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dc636a8b-c201-4a53-a242-9a3454dd6fde tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:48.071154 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c0e96734-fefb-4f00-950f-77ce6d9e0b80 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6318cd386150452f9efb44ce374d6a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7a87c31955434abae235e438ee3683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:48.094889 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c0e96734-fefb-4f00-950f-77ce6d9e0b80 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] 10.222.0.50 "GET /compute/v2.1/servers/d4b3c604-165a-4ffe-935f-0b55a527fad7" status: 200 len: 1396 microversion: 2.1 time: 0.513085 Aug 31 16:16:48.099892 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2509/5201] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:47 2022] GET /compute/v2.1/servers/d4b3c604-165a-4ffe-935f-0b55a527fad7 => generated 1396 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:16:48.305076 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-dc636a8b-c201-4a53-a242-9a3454dd6fde tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:48.318658 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-dc636a8b-c201-4a53-a242-9a3454dd6fde tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1528 microversion: 2.1 time: 0.373613 Aug 31 16:16:48.319803 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2693/5202] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:47 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1528 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:16:48.733135 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dfbee7ee-9dd7-4fc3-bb07-8b618fbd18eb tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Action: 'create', calling method: .version_select at 0x7fbb4596b8b0>, body: {"keypair": {"name": "tempest-keypair-1484873176", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG2ikSQCtRItVDKOrLHARTmoscYlpzamKvTcKK9MbIXrw8/aQlWtcFiBTFPjE4PovZDgFKWmQDg9J9ju2bJ23VoUadnwTpgCH03ohgCNsv89PVmhWddFQAqO9WkVl7GtOA=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:48.761864 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-dfbee7ee-9dd7-4fc3-bb07-8b618fbd18eb tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Getting quotas for project c3cdfdf921af4bc59c5c2fea1287b598. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:16:48.764617 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:16:48.769756 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-dfbee7ee-9dd7-4fc3-bb07-8b618fbd18eb tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Getting quotas for user 6f95e357d68d4ad4a5eedbb08b41c5c1 and project c3cdfdf921af4bc59c5c2fea1287b598. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:16:48.802331 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dfbee7ee-9dd7-4fc3-bb07-8b618fbd18eb tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.073028 Aug 31 16:16:48.803397 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2510/5203] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 31 16:16:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:16:48.956182 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-76189c4e-a749-449f-a684-54d1e98c8c98 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:48.957584 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-76189c4e-a749-449f-a684-54d1e98c8c98 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: e1cb02b7-1dd6-4c83-9008-e19525731e03] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:48.970890 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76189c4e-a749-449f-a684-54d1e98c8c98 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:48.974750 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76189c4e-a749-449f-a684-54d1e98c8c98 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:48.975967 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76189c4e-a749-449f-a684-54d1e98c8c98 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:48.976989 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76189c4e-a749-449f-a684-54d1e98c8c98 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:48.977755 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76189c4e-a749-449f-a684-54d1e98c8c98 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:48.979536 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76189c4e-a749-449f-a684-54d1e98c8c98 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:49.121445 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e7a976ac-5bd8-48e8-a036-6b1dbcf7f252 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:49.122302 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e7a976ac-5bd8-48e8-a036-6b1dbcf7f252 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] [instance: d4b3c604-165a-4ffe-935f-0b55a527fad7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:49.132476 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7a976ac-5bd8-48e8-a036-6b1dbcf7f252 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:49.135667 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7a976ac-5bd8-48e8-a036-6b1dbcf7f252 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:49.136443 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7a976ac-5bd8-48e8-a036-6b1dbcf7f252 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:49.137412 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7a976ac-5bd8-48e8-a036-6b1dbcf7f252 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:49.138750 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7a976ac-5bd8-48e8-a036-6b1dbcf7f252 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:49.141009 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7a976ac-5bd8-48e8-a036-6b1dbcf7f252 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:49.480819 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-76189c4e-a749-449f-a684-54d1e98c8c98 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:49.497182 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-76189c4e-a749-449f-a684-54d1e98c8c98 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03" status: 200 len: 1696 microversion: 2.1 time: 0.546027 Aug 31 16:16:49.520193 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2694/5204] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:48 2022] GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03 => generated 1696 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:49.525936 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ed8c0621-ab5f-456a-9c2a-f0234ff05f50 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:49.535105 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ed8c0621-ab5f-456a-9c2a-f0234ff05f50 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:49.548690 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ed8c0621-ab5f-456a-9c2a-f0234ff05f50 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:49.551102 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ed8c0621-ab5f-456a-9c2a-f0234ff05f50 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:49.551662 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ed8c0621-ab5f-456a-9c2a-f0234ff05f50 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:49.552532 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ed8c0621-ab5f-456a-9c2a-f0234ff05f50 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:49.554786 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ed8c0621-ab5f-456a-9c2a-f0234ff05f50 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:49.558859 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ed8c0621-ab5f-456a-9c2a-f0234ff05f50 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:50.156863 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e7a976ac-5bd8-48e8-a036-6b1dbcf7f252 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6318cd386150452f9efb44ce374d6a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7a87c31955434abae235e438ee3683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:50.171890 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e7a976ac-5bd8-48e8-a036-6b1dbcf7f252 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] 10.222.0.50 "GET /compute/v2.1/servers/d4b3c604-165a-4ffe-935f-0b55a527fad7" status: 200 len: 1396 microversion: 2.1 time: 1.050992 Aug 31 16:16:50.173364 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2511/5205] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:49 2022] GET /compute/v2.1/servers/d4b3c604-165a-4ffe-935f-0b55a527fad7 => generated 1396 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:50.527944 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0bd321cf-4ca8-47b9-b2c3-f228af7302d4 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:50.528956 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0bd321cf-4ca8-47b9-b2c3-f228af7302d4 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: e1cb02b7-1dd6-4c83-9008-e19525731e03] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:50.551865 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0bd321cf-4ca8-47b9-b2c3-f228af7302d4 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:50.552986 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0bd321cf-4ca8-47b9-b2c3-f228af7302d4 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:50.553667 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0bd321cf-4ca8-47b9-b2c3-f228af7302d4 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:50.554687 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0bd321cf-4ca8-47b9-b2c3-f228af7302d4 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:50.555393 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0bd321cf-4ca8-47b9-b2c3-f228af7302d4 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:50.556107 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0bd321cf-4ca8-47b9-b2c3-f228af7302d4 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:51.438823 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ed8c0621-ab5f-456a-9c2a-f0234ff05f50 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:51.455259 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ed8c0621-ab5f-456a-9c2a-f0234ff05f50 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1528 microversion: 2.1 time: 1.932932 Aug 31 16:16:51.474195 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2695/5206] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:49 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1528 bytes in 1952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:51.487825 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-ab29806e-ac5c-491f-b078-6729ac20389c req-78899e05-4ec0-4e82-a35b-83ea131e43e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4b3c604-165a-4ffe-935f-0b55a527fad7", "name": "network-vif-plugged", "status": "completed", "tag": "a26cfb24-b803-430f-a60a-4b56e2c2b475"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:51.506749 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-ab29806e-ac5c-491f-b078-6729ac20389c req-78899e05-4ec0-4e82-a35b-83ea131e43e7 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:51.512967 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-ab29806e-ac5c-491f-b078-6729ac20389c req-78899e05-4ec0-4e82-a35b-83ea131e43e7 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:51.514681 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-ab29806e-ac5c-491f-b078-6729ac20389c req-78899e05-4ec0-4e82-a35b-83ea131e43e7 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:51.547797 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-ab29806e-ac5c-491f-b078-6729ac20389c req-78899e05-4ec0-4e82-a35b-83ea131e43e7 service nova] Creating event network-vif-plugged:a26cfb24-b803-430f-a60a-4b56e2c2b475 for instance d4b3c604-165a-4ffe-935f-0b55a527fad7 on n-h1-833090-16 Aug 31 16:16:51.553346 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0bd321cf-4ca8-47b9-b2c3-f228af7302d4 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:51.557101 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-ab29806e-ac5c-491f-b078-6729ac20389c req-78899e05-4ec0-4e82-a35b-83ea131e43e7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079890 Aug 31 16:16:51.558897 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2696/5207] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:16:51.571126 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2629c663-60d0-444a-8e2e-e27908ea614e tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:51.573470 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2629c663-60d0-444a-8e2e-e27908ea614e tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] [instance: d4b3c604-165a-4ffe-935f-0b55a527fad7] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:51.585369 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2629c663-60d0-444a-8e2e-e27908ea614e tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:51.586280 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2629c663-60d0-444a-8e2e-e27908ea614e tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:51.587551 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2629c663-60d0-444a-8e2e-e27908ea614e tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:51.588817 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2629c663-60d0-444a-8e2e-e27908ea614e tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:51.589756 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2629c663-60d0-444a-8e2e-e27908ea614e tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:51.591370 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2629c663-60d0-444a-8e2e-e27908ea614e tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:51.625139 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0bd321cf-4ca8-47b9-b2c3-f228af7302d4 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03" status: 200 len: 1696 microversion: 2.1 time: 1.095404 Aug 31 16:16:51.631206 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2512/5208] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:50 2022] GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03 => generated 1696 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:52.061155 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2629c663-60d0-444a-8e2e-e27908ea614e tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6318cd386150452f9efb44ce374d6a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7a87c31955434abae235e438ee3683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:52.075064 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2629c663-60d0-444a-8e2e-e27908ea614e tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] 10.222.0.50 "GET /compute/v2.1/servers/d4b3c604-165a-4ffe-935f-0b55a527fad7" status: 200 len: 1396 microversion: 2.1 time: 0.513824 Aug 31 16:16:52.075692 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2697/5209] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:51 2022] GET /compute/v2.1/servers/d4b3c604-165a-4ffe-935f-0b55a527fad7 => generated 1396 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:52.483030 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-06d20bd4-c938-43af-851a-09a11ce22447 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:52.484189 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-06d20bd4-c938-43af-851a-09a11ce22447 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:52.503504 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06d20bd4-c938-43af-851a-09a11ce22447 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:52.507136 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06d20bd4-c938-43af-851a-09a11ce22447 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:52.508696 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06d20bd4-c938-43af-851a-09a11ce22447 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:52.510822 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06d20bd4-c938-43af-851a-09a11ce22447 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:52.511488 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06d20bd4-c938-43af-851a-09a11ce22447 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:52.514782 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06d20bd4-c938-43af-851a-09a11ce22447 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:52.650927 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-52c64c50-b617-469e-8d58-2894b1e9865a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:52.652276 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-52c64c50-b617-469e-8d58-2894b1e9865a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: e1cb02b7-1dd6-4c83-9008-e19525731e03] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:52.666651 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-52c64c50-b617-469e-8d58-2894b1e9865a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:52.667151 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-52c64c50-b617-469e-8d58-2894b1e9865a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:52.667590 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-52c64c50-b617-469e-8d58-2894b1e9865a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:52.668378 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-52c64c50-b617-469e-8d58-2894b1e9865a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:52.668815 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-52c64c50-b617-469e-8d58-2894b1e9865a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:52.669472 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-52c64c50-b617-469e-8d58-2894b1e9865a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:53.056450 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-06d20bd4-c938-43af-851a-09a11ce22447 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:53.084097 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-06d20bd4-c938-43af-851a-09a11ce22447 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1528 microversion: 2.1 time: 0.605028 Aug 31 16:16:53.087460 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2513/5210] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:52 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1528 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:53.100470 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2cecd230-02fe-40e0-86c3-1cac142152fc tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:53.102034 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2cecd230-02fe-40e0-86c3-1cac142152fc tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] [instance: d4b3c604-165a-4ffe-935f-0b55a527fad7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:53.117030 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2cecd230-02fe-40e0-86c3-1cac142152fc tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:53.118286 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2cecd230-02fe-40e0-86c3-1cac142152fc tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:53.118953 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2cecd230-02fe-40e0-86c3-1cac142152fc tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:53.122032 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2cecd230-02fe-40e0-86c3-1cac142152fc tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:53.123693 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2cecd230-02fe-40e0-86c3-1cac142152fc tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:53.126679 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2cecd230-02fe-40e0-86c3-1cac142152fc tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:53.349137 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-52c64c50-b617-469e-8d58-2894b1e9865a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:53.363073 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-52c64c50-b617-469e-8d58-2894b1e9865a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03" status: 200 len: 1696 microversion: 2.1 time: 0.716291 Aug 31 16:16:53.365459 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2698/5211] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:52 2022] GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03 => generated 1696 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:53.753527 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2cecd230-02fe-40e0-86c3-1cac142152fc tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6318cd386150452f9efb44ce374d6a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7a87c31955434abae235e438ee3683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:53.770879 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2cecd230-02fe-40e0-86c3-1cac142152fc tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] 10.222.0.50 "GET /compute/v2.1/servers/d4b3c604-165a-4ffe-935f-0b55a527fad7" status: 200 len: 1396 microversion: 2.1 time: 0.678976 Aug 31 16:16:53.797925 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2514/5212] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:53 2022] GET /compute/v2.1/servers/d4b3c604-165a-4ffe-935f-0b55a527fad7 => generated 1396 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:54.109572 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c441c803-c74c-400c-b684-75d71e9abdaf tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:54.110508 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c441c803-c74c-400c-b684-75d71e9abdaf tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:54.125356 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c441c803-c74c-400c-b684-75d71e9abdaf tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:54.133821 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c441c803-c74c-400c-b684-75d71e9abdaf tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:54.135498 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c441c803-c74c-400c-b684-75d71e9abdaf tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:54.146420 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-540383c4-f79a-48e3-a9ad-0610c0b0b31e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-883489284", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ae90d5cd-3421-4e4a-9434-10c5079cf68b"}], "security_groups": [{"name": "tempest-securitygroup--875285457"}], "key_name": "tempest-keypair-1484873176", "user_data": "}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:54.150008 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c441c803-c74c-400c-b684-75d71e9abdaf tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:54.153012 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c441c803-c74c-400c-b684-75d71e9abdaf tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:54.153889 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c441c803-c74c-400c-b684-75d71e9abdaf tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:54.550757 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-540383c4-f79a-48e3-a9ad-0610c0b0b31e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] validate_networks() for [('ae90d5cd-3421-4e4a-9434-10c5079cf68b', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:16:54.705947 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c441c803-c74c-400c-b684-75d71e9abdaf tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:54.719946 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c441c803-c74c-400c-b684-75d71e9abdaf tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1528 microversion: 2.1 time: 0.614624 Aug 31 16:16:54.721519 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2699/5213] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:54 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1528 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:54.726340 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a1d26db2-370a-4937-873c-c9681b5a7479 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:54.728948 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a1d26db2-370a-4937-873c-c9681b5a7479 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: e1cb02b7-1dd6-4c83-9008-e19525731e03] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:54.741693 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a1d26db2-370a-4937-873c-c9681b5a7479 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:54.744381 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a1d26db2-370a-4937-873c-c9681b5a7479 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:54.755277 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a1d26db2-370a-4937-873c-c9681b5a7479 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:54.755277 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a1d26db2-370a-4937-873c-c9681b5a7479 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:54.755277 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a1d26db2-370a-4937-873c-c9681b5a7479 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:54.755277 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a1d26db2-370a-4937-873c-c9681b5a7479 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:55.605827 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a1d26db2-370a-4937-873c-c9681b5a7479 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:55.625996 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a1d26db2-370a-4937-873c-c9681b5a7479 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03" status: 200 len: 1696 microversion: 2.1 time: 0.902978 Aug 31 16:16:55.627600 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2700/5214] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:54 2022] GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03 => generated 1696 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:55.653089 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-eb536ce4-1e27-4c0c-a5e1-fdd410118b53 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:55.654398 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-eb536ce4-1e27-4c0c-a5e1-fdd410118b53 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] [instance: d4b3c604-165a-4ffe-935f-0b55a527fad7] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:55.669334 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-eb536ce4-1e27-4c0c-a5e1-fdd410118b53 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:55.674975 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-eb536ce4-1e27-4c0c-a5e1-fdd410118b53 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:55.676130 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-eb536ce4-1e27-4c0c-a5e1-fdd410118b53 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:55.678554 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-eb536ce4-1e27-4c0c-a5e1-fdd410118b53 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:55.682564 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-eb536ce4-1e27-4c0c-a5e1-fdd410118b53 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:55.683550 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-eb536ce4-1e27-4c0c-a5e1-fdd410118b53 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:56.785379 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-eb536ce4-1e27-4c0c-a5e1-fdd410118b53 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6318cd386150452f9efb44ce374d6a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7a87c31955434abae235e438ee3683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:56.800371 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-eb536ce4-1e27-4c0c-a5e1-fdd410118b53 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] 10.222.0.50 "GET /compute/v2.1/servers/d4b3c604-165a-4ffe-935f-0b55a527fad7" status: 200 len: 1576 microversion: 2.1 time: 1.170543 Aug 31 16:16:56.801265 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2701/5215] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:55 2022] GET /compute/v2.1/servers/d4b3c604-165a-4ffe-935f-0b55a527fad7 => generated 1576 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:56.808426 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-cf9af476-e5ce-47ba-b09b-cc28593478ef tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:56.809488 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-cf9af476-e5ce-47ba-b09b-cc28593478ef tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:56.817343 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cf9af476-e5ce-47ba-b09b-cc28593478ef tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:56.818142 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cf9af476-e5ce-47ba-b09b-cc28593478ef tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:56.818750 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cf9af476-e5ce-47ba-b09b-cc28593478ef tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:56.819978 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cf9af476-e5ce-47ba-b09b-cc28593478ef tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:56.820619 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cf9af476-e5ce-47ba-b09b-cc28593478ef tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:56.821198 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cf9af476-e5ce-47ba-b09b-cc28593478ef tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:57.224819 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-540383c4-f79a-48e3-a9ad-0610c0b0b31e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:16:57.225502 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-540383c4-f79a-48e3-a9ad-0610c0b0b31e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:16:57.226203 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-540383c4-f79a-48e3-a9ad-0610c0b0b31e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:16:57.228917 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-540383c4-f79a-48e3-a9ad-0610c0b0b31e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:16:57.229717 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-540383c4-f79a-48e3-a9ad-0610c0b0b31e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:16:57.245982 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-540383c4-f79a-48e3-a9ad-0610c0b0b31e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:57.254181 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-540383c4-f79a-48e3-a9ad-0610c0b0b31e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:57.255620 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-540383c4-f79a-48e3-a9ad-0610c0b0b31e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:57.256834 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-540383c4-f79a-48e3-a9ad-0610c0b0b31e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:57.257546 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-540383c4-f79a-48e3-a9ad-0610c0b0b31e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:57.258422 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-540383c4-f79a-48e3-a9ad-0610c0b0b31e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:57.307107 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-cf9af476-e5ce-47ba-b09b-cc28593478ef tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:57.327042 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-cf9af476-e5ce-47ba-b09b-cc28593478ef tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1528 microversion: 2.1 time: 0.513725 Aug 31 16:16:57.328418 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2702/5216] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:56 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1528 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:57.329702 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-540383c4-f79a-48e3-a9ad-0610c0b0b31e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Getting quotas for project c3cdfdf921af4bc59c5c2fea1287b598. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:16:57.335814 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2232d758-c6aa-4bd5-a583-06570ee755dd tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:57.337292 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2232d758-c6aa-4bd5-a583-06570ee755dd tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: e1cb02b7-1dd6-4c83-9008-e19525731e03] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:57.352660 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2232d758-c6aa-4bd5-a583-06570ee755dd tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:57.353824 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2232d758-c6aa-4bd5-a583-06570ee755dd tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:57.356134 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-540383c4-f79a-48e3-a9ad-0610c0b0b31e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Getting quotas for user 6f95e357d68d4ad4a5eedbb08b41c5c1 and project c3cdfdf921af4bc59c5c2fea1287b598. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:16:57.357335 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2232d758-c6aa-4bd5-a583-06570ee755dd tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:57.358635 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2232d758-c6aa-4bd5-a583-06570ee755dd tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:57.359275 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2232d758-c6aa-4bd5-a583-06570ee755dd tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:57.362448 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2232d758-c6aa-4bd5-a583-06570ee755dd tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:57.422819 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-540383c4-f79a-48e3-a9ad-0610c0b0b31e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:16:57.434886 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-540383c4-f79a-48e3-a9ad-0610c0b0b31e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 3e00e521-84f5-4e7b-8cec-7a4d2e220d28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:16:57.572811 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-540383c4-f79a-48e3-a9ad-0610c0b0b31e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.431621 Aug 31 16:16:57.574608 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2515/5217] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:16:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 3434 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 16:16:57.592908 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5bcaa0e9-57ba-4c44-93df-cbf274dbfa67 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:57.593447 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5bcaa0e9-57ba-4c44-93df-cbf274dbfa67 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] [instance: d4b3c604-165a-4ffe-935f-0b55a527fad7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:57.627593 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5bcaa0e9-57ba-4c44-93df-cbf274dbfa67 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:57.628100 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5bcaa0e9-57ba-4c44-93df-cbf274dbfa67 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:57.628536 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5bcaa0e9-57ba-4c44-93df-cbf274dbfa67 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:57.629245 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5bcaa0e9-57ba-4c44-93df-cbf274dbfa67 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:57.629688 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5bcaa0e9-57ba-4c44-93df-cbf274dbfa67 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:57.630130 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5bcaa0e9-57ba-4c44-93df-cbf274dbfa67 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:57.913880 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5bcaa0e9-57ba-4c44-93df-cbf274dbfa67 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] 10.222.0.50 "GET /compute/v2.1/servers/d4b3c604-165a-4ffe-935f-0b55a527fad7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.335455 Aug 31 16:16:57.921335 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2516/5218] 10.222.0.50 () {58 vars in 1275 bytes} [Wed Aug 31 16:16:57 2022] GET /compute/v2.1/servers/d4b3c604-165a-4ffe-935f-0b55a527fad7/os-interface => generated 284 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:16:57.926514 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e9f5c84a-a1dc-46a4-a76c-f26973518176 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:57.927422 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e9f5c84a-a1dc-46a4-a76c-f26973518176 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 3e00e521-84f5-4e7b-8cec-7a4d2e220d28] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:58.962690 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e9f5c84a-a1dc-46a4-a76c-f26973518176 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:58.975022 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e9f5c84a-a1dc-46a4-a76c-f26973518176 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/3e00e521-84f5-4e7b-8cec-7a4d2e220d28" status: 200 len: 1241 microversion: 2.1 time: 1.052097 Aug 31 16:16:58.980597 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2517/5219] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:57 2022] GET /compute/v2.1/servers/3e00e521-84f5-4e7b-8cec-7a4d2e220d28 => generated 1241 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:59.039152 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2232d758-c6aa-4bd5-a583-06570ee755dd tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:59.079910 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2232d758-c6aa-4bd5-a583-06570ee755dd tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03" status: 200 len: 1696 microversion: 2.1 time: 1.749598 Aug 31 16:16:59.091209 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2703/5220] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:57 2022] GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03 => generated 1696 bytes in 1762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:16:59.128513 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-743d016e-77a3-4f67-bc10-bcc1db09119a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:16:59.129988 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-743d016e-77a3-4f67-bc10-bcc1db09119a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:16:59.170046 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-743d016e-77a3-4f67-bc10-bcc1db09119a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:59.172203 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-743d016e-77a3-4f67-bc10-bcc1db09119a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:59.173599 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-743d016e-77a3-4f67-bc10-bcc1db09119a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:59.175156 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-743d016e-77a3-4f67-bc10-bcc1db09119a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:16:59.175899 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-743d016e-77a3-4f67-bc10-bcc1db09119a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:16:59.176709 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-743d016e-77a3-4f67-bc10-bcc1db09119a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:16:59.397685 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-07c7024a-d6bd-4c17-9305-bf8d1f5bf50c tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Action: 'create', calling method: .version_select at 0x7fbb45899dc0>, body: {"keypair": {"name": "tempest-keypair-877623517", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7cGT8eYwPIEe6ncll1IqZOKf5ga7fE2g/or2pDmXI/AiTJS7vTQCPbSAPi2deV7+63v6DJ+OPIhda/rEoK9dxLxr9GUk542oRhhm52pCo3/lY+upJLyZayUwKvThczIg=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:16:59.436627 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-07c7024a-d6bd-4c17-9305-bf8d1f5bf50c tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Getting quotas for project d90aaaaa8d224d939310546fb336b13a. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:16:59.447867 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-07c7024a-d6bd-4c17-9305-bf8d1f5bf50c tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Getting quotas for user ff0a9160ffcc460fb53626cd020fc8b1 and project d90aaaaa8d224d939310546fb336b13a. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:16:59.493299 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-07c7024a-d6bd-4c17-9305-bf8d1f5bf50c tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.510130 Aug 31 16:16:59.494782 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2518/5221] 10.222.0.50 () {62 vars in 1200 bytes} [Wed Aug 31 16:16:58 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 513 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 31 16:16:59.849525 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-743d016e-77a3-4f67-bc10-bcc1db09119a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:16:59.866429 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-743d016e-77a3-4f67-bc10-bcc1db09119a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1528 microversion: 2.1 time: 0.767206 Aug 31 16:16:59.885539 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2704/5222] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:16:59 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1528 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:00.016097 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-38a327d1-5131-4b94-a53d-f67aa3134f43 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:00.017703 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-38a327d1-5131-4b94-a53d-f67aa3134f43 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 3e00e521-84f5-4e7b-8cec-7a4d2e220d28] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:00.032212 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38a327d1-5131-4b94-a53d-f67aa3134f43 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:00.035998 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38a327d1-5131-4b94-a53d-f67aa3134f43 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:00.041422 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38a327d1-5131-4b94-a53d-f67aa3134f43 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:00.042641 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38a327d1-5131-4b94-a53d-f67aa3134f43 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:00.044042 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38a327d1-5131-4b94-a53d-f67aa3134f43 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:00.045116 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38a327d1-5131-4b94-a53d-f67aa3134f43 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:00.137274 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1374dbdb-6aff-47d9-8460-12e2949a0a38 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:00.138648 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1374dbdb-6aff-47d9-8460-12e2949a0a38 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: e1cb02b7-1dd6-4c83-9008-e19525731e03] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:00.152326 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1374dbdb-6aff-47d9-8460-12e2949a0a38 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:00.157015 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1374dbdb-6aff-47d9-8460-12e2949a0a38 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:00.160343 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1374dbdb-6aff-47d9-8460-12e2949a0a38 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:00.162780 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1374dbdb-6aff-47d9-8460-12e2949a0a38 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:00.167886 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1374dbdb-6aff-47d9-8460-12e2949a0a38 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:00.168653 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1374dbdb-6aff-47d9-8460-12e2949a0a38 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:00.535901 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-38a327d1-5131-4b94-a53d-f67aa3134f43 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:00.553016 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-38a327d1-5131-4b94-a53d-f67aa3134f43 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/3e00e521-84f5-4e7b-8cec-7a4d2e220d28" status: 200 len: 1311 microversion: 2.1 time: 0.538814 Aug 31 16:17:00.554782 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2519/5223] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:00 2022] GET /compute/v2.1/servers/3e00e521-84f5-4e7b-8cec-7a4d2e220d28 => generated 1311 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:00.890474 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-080ba45c-90c8-4e20-9af7-4ed1d0f54b57 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:00.891476 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-080ba45c-90c8-4e20-9af7-4ed1d0f54b57 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:00.902085 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-080ba45c-90c8-4e20-9af7-4ed1d0f54b57 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:00.906681 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-080ba45c-90c8-4e20-9af7-4ed1d0f54b57 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:00.907425 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-080ba45c-90c8-4e20-9af7-4ed1d0f54b57 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:00.908333 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-080ba45c-90c8-4e20-9af7-4ed1d0f54b57 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:00.909532 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-080ba45c-90c8-4e20-9af7-4ed1d0f54b57 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:00.910213 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-080ba45c-90c8-4e20-9af7-4ed1d0f54b57 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:01.951749 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1374dbdb-6aff-47d9-8460-12e2949a0a38 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:02.093293 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1374dbdb-6aff-47d9-8460-12e2949a0a38 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03" status: 200 len: 1695 microversion: 2.1 time: 1.960728 Aug 31 16:17:02.109498 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2705/5224] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:00 2022] GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03 => generated 1695 bytes in 1978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:02.117276 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-bc571e59-e25f-4f6e-83b8-a5d4a601c345 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:02.123939 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-bc571e59-e25f-4f6e-83b8-a5d4a601c345 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 3e00e521-84f5-4e7b-8cec-7a4d2e220d28] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:02.159848 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:17:02.161745 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bc571e59-e25f-4f6e-83b8-a5d4a601c345 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:02.162455 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bc571e59-e25f-4f6e-83b8-a5d4a601c345 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:02.163076 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bc571e59-e25f-4f6e-83b8-a5d4a601c345 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:02.169607 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bc571e59-e25f-4f6e-83b8-a5d4a601c345 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:02.173891 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bc571e59-e25f-4f6e-83b8-a5d4a601c345 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:02.180471 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bc571e59-e25f-4f6e-83b8-a5d4a601c345 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:02.461294 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-bc571e59-e25f-4f6e-83b8-a5d4a601c345 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:02.478376 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-bc571e59-e25f-4f6e-83b8-a5d4a601c345 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/3e00e521-84f5-4e7b-8cec-7a4d2e220d28" status: 200 len: 1299 microversion: 2.1 time: 0.367176 Aug 31 16:17:02.485060 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2706/5225] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:02 2022] GET /compute/v2.1/servers/3e00e521-84f5-4e7b-8cec-7a4d2e220d28 => generated 1299 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:02.497890 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-080ba45c-90c8-4e20-9af7-4ed1d0f54b57 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:02.510235 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-080ba45c-90c8-4e20-9af7-4ed1d0f54b57 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1528 microversion: 2.1 time: 1.623870 Aug 31 16:17:02.530144 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2520/5226] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:00 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1528 bytes in 1642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:02.535186 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-be07d5f7-e7b7-4a21-b3b4-822dada5ad0b req-695d01dd-c88f-42c5-86db-db49c5a32d72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1cb02b7-1dd6-4c83-9008-e19525731e03", "name": "network-vif-unplugged", "status": "completed", "tag": "aad14830-ef68-4e56-bff4-91dbcf99efc3"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:17:02.596455 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-be07d5f7-e7b7-4a21-b3b4-822dada5ad0b req-695d01dd-c88f-42c5-86db-db49c5a32d72 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:02.596937 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-be07d5f7-e7b7-4a21-b3b4-822dada5ad0b req-695d01dd-c88f-42c5-86db-db49c5a32d72 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:02.602924 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-be07d5f7-e7b7-4a21-b3b4-822dada5ad0b req-695d01dd-c88f-42c5-86db-db49c5a32d72 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:02.656107 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-be07d5f7-e7b7-4a21-b3b4-822dada5ad0b req-695d01dd-c88f-42c5-86db-db49c5a32d72 service nova] Creating event network-vif-unplugged:aad14830-ef68-4e56-bff4-91dbcf99efc3 for instance e1cb02b7-1dd6-4c83-9008-e19525731e03 on n-h1-833090-16 Aug 31 16:17:02.678188 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [req-be07d5f7-e7b7-4a21-b3b4-822dada5ad0b req-695d01dd-c88f-42c5-86db-db49c5a32d72 service nova] Instance e1cb02b7-1dd6-4c83-9008-e19525731e03 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-833090-16', 'n-h1-833090-16'} {{(pid=128864) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 16:17:02.703920 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-be07d5f7-e7b7-4a21-b3b4-822dada5ad0b req-695d01dd-c88f-42c5-86db-db49c5a32d72 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.215632 Aug 31 16:17:02.705232 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2707/5227] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:17:03.118760 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-85f8c970-ac37-4fcd-ad75-f605a25d7298 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:03.119548 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-85f8c970-ac37-4fcd-ad75-f605a25d7298 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: e1cb02b7-1dd6-4c83-9008-e19525731e03] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:03.136506 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-85f8c970-ac37-4fcd-ad75-f605a25d7298 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:03.144210 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-85f8c970-ac37-4fcd-ad75-f605a25d7298 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:03.145968 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-85f8c970-ac37-4fcd-ad75-f605a25d7298 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:03.150075 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-85f8c970-ac37-4fcd-ad75-f605a25d7298 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:03.150893 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-85f8c970-ac37-4fcd-ad75-f605a25d7298 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:03.154571 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-85f8c970-ac37-4fcd-ad75-f605a25d7298 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:03.503956 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5b7ccce2-1c5f-4e01-a5e7-5afaa0a4bd74 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:03.504664 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5b7ccce2-1c5f-4e01-a5e7-5afaa0a4bd74 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 3e00e521-84f5-4e7b-8cec-7a4d2e220d28] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:03.538672 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5b7ccce2-1c5f-4e01-a5e7-5afaa0a4bd74 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:03.543155 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5b7ccce2-1c5f-4e01-a5e7-5afaa0a4bd74 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:03.543694 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5b7ccce2-1c5f-4e01-a5e7-5afaa0a4bd74 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:03.544791 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5b7ccce2-1c5f-4e01-a5e7-5afaa0a4bd74 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:03.544969 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5b7ccce2-1c5f-4e01-a5e7-5afaa0a4bd74 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:03.551193 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5b7ccce2-1c5f-4e01-a5e7-5afaa0a4bd74 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:03.960776 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5b7ccce2-1c5f-4e01-a5e7-5afaa0a4bd74 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:03.970014 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5b7ccce2-1c5f-4e01-a5e7-5afaa0a4bd74 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/3e00e521-84f5-4e7b-8cec-7a4d2e220d28" status: 200 len: 1299 microversion: 2.1 time: 0.473915 Aug 31 16:17:03.985421 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2708/5228] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:03 2022] GET /compute/v2.1/servers/3e00e521-84f5-4e7b-8cec-7a4d2e220d28 => generated 1299 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:17:03.992226 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a9c1f87e-848b-45bc-b800-f8ff80801469 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:03.993008 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a9c1f87e-848b-45bc-b800-f8ff80801469 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:04.013936 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a9c1f87e-848b-45bc-b800-f8ff80801469 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:04.014879 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a9c1f87e-848b-45bc-b800-f8ff80801469 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:04.015583 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a9c1f87e-848b-45bc-b800-f8ff80801469 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:04.016543 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a9c1f87e-848b-45bc-b800-f8ff80801469 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:04.018109 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a9c1f87e-848b-45bc-b800-f8ff80801469 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:04.018936 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a9c1f87e-848b-45bc-b800-f8ff80801469 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:04.024137 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=100 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:17:04.101870 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-85f8c970-ac37-4fcd-ad75-f605a25d7298 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:04.118508 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-85f8c970-ac37-4fcd-ad75-f605a25d7298 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03" status: 200 len: 1695 microversion: 2.1 time: 1.005114 Aug 31 16:17:04.119110 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2521/5229] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:03 2022] GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03 => generated 1695 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:04.731594 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b124c292-61f9-4c02-bfb4-3b69cbbb0371 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1087586809", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dbf6a81d-1fbd-491e-aa02-c65a1c371d16"}], "security_groups": [{"name": "tempest-securitygroup--611320497"}], "key_name": "tempest-keypair-877623517", "user_data": "}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:17:05.352576 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-b124c292-61f9-4c02-bfb4-3b69cbbb0371 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] validate_networks() for [('dbf6a81d-1fbd-491e-aa02-c65a1c371d16', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:17:05.450492 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a9c1f87e-848b-45bc-b800-f8ff80801469 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:05.461177 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a9c1f87e-848b-45bc-b800-f8ff80801469 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1528 microversion: 2.1 time: 1.485260 Aug 31 16:17:05.464441 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2709/5230] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:03 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1528 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:05.473139 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-19793dd6-6591-4fa6-b082-49bd15a5eb8b tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:05.479754 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-19793dd6-6591-4fa6-b082-49bd15a5eb8b tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 3e00e521-84f5-4e7b-8cec-7a4d2e220d28] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:05.498013 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-19793dd6-6591-4fa6-b082-49bd15a5eb8b tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:05.501572 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-19793dd6-6591-4fa6-b082-49bd15a5eb8b tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:05.504995 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-19793dd6-6591-4fa6-b082-49bd15a5eb8b tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:05.506146 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-19793dd6-6591-4fa6-b082-49bd15a5eb8b tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:05.506787 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-19793dd6-6591-4fa6-b082-49bd15a5eb8b tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:05.509532 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-19793dd6-6591-4fa6-b082-49bd15a5eb8b tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:07.309592 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:17:07.699115 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-19793dd6-6591-4fa6-b082-49bd15a5eb8b tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:07.712831 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-19793dd6-6591-4fa6-b082-49bd15a5eb8b tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/3e00e521-84f5-4e7b-8cec-7a4d2e220d28" status: 200 len: 1366 microversion: 2.1 time: 2.247014 Aug 31 16:17:07.716750 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2710/5231] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:05 2022] GET /compute/v2.1/servers/3e00e521-84f5-4e7b-8cec-7a4d2e220d28 => generated 1366 bytes in 2251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:07.727240 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-dc9cdffb-1be2-44d2-9340-e02e158bc508 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:07.728428 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-dc9cdffb-1be2-44d2-9340-e02e158bc508 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: e1cb02b7-1dd6-4c83-9008-e19525731e03] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:07.737448 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dc9cdffb-1be2-44d2-9340-e02e158bc508 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:07.738565 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dc9cdffb-1be2-44d2-9340-e02e158bc508 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:07.739418 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dc9cdffb-1be2-44d2-9340-e02e158bc508 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:07.741182 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dc9cdffb-1be2-44d2-9340-e02e158bc508 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:07.741909 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dc9cdffb-1be2-44d2-9340-e02e158bc508 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:07.742595 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dc9cdffb-1be2-44d2-9340-e02e158bc508 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:08.267362 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b124c292-61f9-4c02-bfb4-3b69cbbb0371 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:17:08.267831 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b124c292-61f9-4c02-bfb4-3b69cbbb0371 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:17:08.268312 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b124c292-61f9-4c02-bfb4-3b69cbbb0371 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:17:08.268725 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b124c292-61f9-4c02-bfb4-3b69cbbb0371 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:17:08.269129 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b124c292-61f9-4c02-bfb4-3b69cbbb0371 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:17:08.294862 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b124c292-61f9-4c02-bfb4-3b69cbbb0371 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:08.295471 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b124c292-61f9-4c02-bfb4-3b69cbbb0371 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:08.296510 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b124c292-61f9-4c02-bfb4-3b69cbbb0371 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:08.297679 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b124c292-61f9-4c02-bfb4-3b69cbbb0371 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:08.298401 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b124c292-61f9-4c02-bfb4-3b69cbbb0371 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:08.299720 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b124c292-61f9-4c02-bfb4-3b69cbbb0371 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:08.323402 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-dc9cdffb-1be2-44d2-9340-e02e158bc508 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:08.343919 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-dc9cdffb-1be2-44d2-9340-e02e158bc508 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03" status: 200 len: 1695 microversion: 2.1 time: 0.625090 Aug 31 16:17:08.361288 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2711/5232] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:07 2022] GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03 => generated 1695 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:08.363323 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-b124c292-61f9-4c02-bfb4-3b69cbbb0371 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Getting quotas for project d90aaaaa8d224d939310546fb336b13a. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:17:08.378932 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-b124c292-61f9-4c02-bfb4-3b69cbbb0371 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Getting quotas for user ff0a9160ffcc460fb53626cd020fc8b1 and project d90aaaaa8d224d939310546fb336b13a. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:17:08.388491 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-55a04224-f0ff-4249-82b6-8fcf96b38e42 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:08.395724 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-55a04224-f0ff-4249-82b6-8fcf96b38e42 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] [instance: d4b3c604-165a-4ffe-935f-0b55a527fad7] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:08.407483 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-55a04224-f0ff-4249-82b6-8fcf96b38e42 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:08.409709 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-55a04224-f0ff-4249-82b6-8fcf96b38e42 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:08.411003 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-55a04224-f0ff-4249-82b6-8fcf96b38e42 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:08.412144 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-55a04224-f0ff-4249-82b6-8fcf96b38e42 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:08.412836 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-55a04224-f0ff-4249-82b6-8fcf96b38e42 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:08.416005 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-55a04224-f0ff-4249-82b6-8fcf96b38e42 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:08.428721 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b124c292-61f9-4c02-bfb4-3b69cbbb0371 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:17:08.428721 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b124c292-61f9-4c02-bfb4-3b69cbbb0371 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:17:08.536817 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b124c292-61f9-4c02-bfb4-3b69cbbb0371 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.809794 Aug 31 16:17:08.537554 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2522/5233] 10.222.0.50 () {62 vars in 1188 bytes} [Wed Aug 31 16:17:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 3811 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 31 16:17:08.549266 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-33384b60-bcf7-4af1-a091-3040354b3213 req-db08d3dd-a70c-44b1-82df-878fad259695 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4b3c604-165a-4ffe-935f-0b55a527fad7", "tag": "a26cfb24-b803-430f-a60a-4b56e2c2b475"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:17:08.585558 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-33384b60-bcf7-4af1-a091-3040354b3213 req-db08d3dd-a70c-44b1-82df-878fad259695 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:08.586621 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-33384b60-bcf7-4af1-a091-3040354b3213 req-db08d3dd-a70c-44b1-82df-878fad259695 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:08.586785 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-33384b60-bcf7-4af1-a091-3040354b3213 req-db08d3dd-a70c-44b1-82df-878fad259695 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:08.627900 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-33384b60-bcf7-4af1-a091-3040354b3213 req-db08d3dd-a70c-44b1-82df-878fad259695 service nova] Creating event network-changed:a26cfb24-b803-430f-a60a-4b56e2c2b475 for instance d4b3c604-165a-4ffe-935f-0b55a527fad7 on n-h1-833090-16 Aug 31 16:17:08.647073 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-33384b60-bcf7-4af1-a091-3040354b3213 req-db08d3dd-a70c-44b1-82df-878fad259695 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107003 Aug 31 16:17:08.648689 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2523/5234] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:17:08.659037 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-20e3cc4f-07dc-45a1-87aa-a6ce6f0823b0 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:08.659748 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-20e3cc4f-07dc-45a1-87aa-a6ce6f0823b0 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:08.689929 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20e3cc4f-07dc-45a1-87aa-a6ce6f0823b0 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:08.690460 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20e3cc4f-07dc-45a1-87aa-a6ce6f0823b0 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:08.690912 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20e3cc4f-07dc-45a1-87aa-a6ce6f0823b0 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:08.691601 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20e3cc4f-07dc-45a1-87aa-a6ce6f0823b0 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:08.692057 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20e3cc4f-07dc-45a1-87aa-a6ce6f0823b0 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:08.692482 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20e3cc4f-07dc-45a1-87aa-a6ce6f0823b0 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:09.264447 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-55a04224-f0ff-4249-82b6-8fcf96b38e42 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6318cd386150452f9efb44ce374d6a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7a87c31955434abae235e438ee3683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:09.292644 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-55a04224-f0ff-4249-82b6-8fcf96b38e42 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] 10.222.0.50 "GET /compute/v2.1/servers/d4b3c604-165a-4ffe-935f-0b55a527fad7" status: 200 len: 1576 microversion: 2.1 time: 0.923524 Aug 31 16:17:09.298694 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2712/5235] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:08 2022] GET /compute/v2.1/servers/d4b3c604-165a-4ffe-935f-0b55a527fad7 => generated 1576 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:09.320103 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4a30b8ec-8d77-4136-88d8-28720e7be3f7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:09.323548 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4a30b8ec-8d77-4136-88d8-28720e7be3f7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:09.386533 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-20e3cc4f-07dc-45a1-87aa-a6ce6f0823b0 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:09.402261 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-20e3cc4f-07dc-45a1-87aa-a6ce6f0823b0 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1528 microversion: 2.1 time: 0.751816 Aug 31 16:17:09.405229 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2524/5236] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:08 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1528 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:09.432875 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1347fd60-9d87-4b33-9baa-e7d09b7796d9 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:09.434162 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1347fd60-9d87-4b33-9baa-e7d09b7796d9 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 3e00e521-84f5-4e7b-8cec-7a4d2e220d28] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:09.448367 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1347fd60-9d87-4b33-9baa-e7d09b7796d9 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:09.448927 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1347fd60-9d87-4b33-9baa-e7d09b7796d9 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:09.453141 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1347fd60-9d87-4b33-9baa-e7d09b7796d9 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:09.454330 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1347fd60-9d87-4b33-9baa-e7d09b7796d9 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:09.455072 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1347fd60-9d87-4b33-9baa-e7d09b7796d9 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:09.455862 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1347fd60-9d87-4b33-9baa-e7d09b7796d9 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:09.460383 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4a30b8ec-8d77-4136-88d8-28720e7be3f7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:09.480218 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4a30b8ec-8d77-4136-88d8-28720e7be3f7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:09.485489 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4a30b8ec-8d77-4136-88d8-28720e7be3f7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:09.495901 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4a30b8ec-8d77-4136-88d8-28720e7be3f7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1281 microversion: 2.20 time: 0.189679 Aug 31 16:17:09.496668 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2713/5237] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:17:09 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1281 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:17:09.511726 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b956e4e1-83b4-4e40-8954-9380724142ba tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:09.522809 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b956e4e1-83b4-4e40-8954-9380724142ba tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: e1cb02b7-1dd6-4c83-9008-e19525731e03] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:09.563638 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b956e4e1-83b4-4e40-8954-9380724142ba tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:09.564576 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b956e4e1-83b4-4e40-8954-9380724142ba tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:09.566632 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b956e4e1-83b4-4e40-8954-9380724142ba tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:09.569744 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b956e4e1-83b4-4e40-8954-9380724142ba tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:09.572858 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b956e4e1-83b4-4e40-8954-9380724142ba tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:09.573624 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b956e4e1-83b4-4e40-8954-9380724142ba tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:10.067414 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1347fd60-9d87-4b33-9baa-e7d09b7796d9 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:10.076532 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1347fd60-9d87-4b33-9baa-e7d09b7796d9 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/3e00e521-84f5-4e7b-8cec-7a4d2e220d28" status: 200 len: 1366 microversion: 2.1 time: 0.649473 Aug 31 16:17:10.084694 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2525/5238] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:09 2022] GET /compute/v2.1/servers/3e00e521-84f5-4e7b-8cec-7a4d2e220d28 => generated 1366 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:10.100362 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b956e4e1-83b4-4e40-8954-9380724142ba tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:10.112683 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b956e4e1-83b4-4e40-8954-9380724142ba tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03" status: 200 len: 1695 microversion: 2.1 time: 0.614088 Aug 31 16:17:10.113265 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2714/5239] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:09 2022] GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03 => generated 1695 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:10.434020 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3ea1e95f-6351-4684-a41a-9b035a456087 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:10.435050 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3ea1e95f-6351-4684-a41a-9b035a456087 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:10.447505 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ea1e95f-6351-4684-a41a-9b035a456087 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:10.451225 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ea1e95f-6351-4684-a41a-9b035a456087 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:10.451787 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ea1e95f-6351-4684-a41a-9b035a456087 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:10.452663 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ea1e95f-6351-4684-a41a-9b035a456087 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:10.453332 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ea1e95f-6351-4684-a41a-9b035a456087 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:10.454918 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ea1e95f-6351-4684-a41a-9b035a456087 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:10.523418 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fce19cc5-bedd-4a8d-9f36-232894cd9349 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:10.524625 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fce19cc5-bedd-4a8d-9f36-232894cd9349 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:10.533295 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fce19cc5-bedd-4a8d-9f36-232894cd9349 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:10.534083 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fce19cc5-bedd-4a8d-9f36-232894cd9349 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:10.534712 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fce19cc5-bedd-4a8d-9f36-232894cd9349 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:10.535751 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fce19cc5-bedd-4a8d-9f36-232894cd9349 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:10.536374 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fce19cc5-bedd-4a8d-9f36-232894cd9349 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:10.536965 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fce19cc5-bedd-4a8d-9f36-232894cd9349 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:10.675197 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-fce19cc5-bedd-4a8d-9f36-232894cd9349 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:10.690192 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-fce19cc5-bedd-4a8d-9f36-232894cd9349 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:10.693081 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-fce19cc5-bedd-4a8d-9f36-232894cd9349 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:10.694777 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fce19cc5-bedd-4a8d-9f36-232894cd9349 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1333 microversion: 2.20 time: 0.176125 Aug 31 16:17:10.712508 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2715/5240] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:17:10 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1333 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:17:10.739616 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-f1db09c5-7d35-4d63-98ec-58b9197dba8a req-9de92a41-f84b-4402-abaf-bbde9f9964cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1cb02b7-1dd6-4c83-9008-e19525731e03", "tag": "aad14830-ef68-4e56-bff4-91dbcf99efc3"}, {"name": "network-changed", "server_uuid": "3e00e521-84f5-4e7b-8cec-7a4d2e220d28", "tag": "0dc48d8d-77c4-4b8d-9828-06b574dce835"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:17:10.761295 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-f1db09c5-7d35-4d63-98ec-58b9197dba8a req-9de92a41-f84b-4402-abaf-bbde9f9964cb service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:10.762416 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-f1db09c5-7d35-4d63-98ec-58b9197dba8a req-9de92a41-f84b-4402-abaf-bbde9f9964cb service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:10.763152 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-f1db09c5-7d35-4d63-98ec-58b9197dba8a req-9de92a41-f84b-4402-abaf-bbde9f9964cb service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:10.782138 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-f1db09c5-7d35-4d63-98ec-58b9197dba8a req-9de92a41-f84b-4402-abaf-bbde9f9964cb service nova] Creating event network-changed:aad14830-ef68-4e56-bff4-91dbcf99efc3 for instance e1cb02b7-1dd6-4c83-9008-e19525731e03 on n-h1-833090-16 Aug 31 16:17:10.782409 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3ea1e95f-6351-4684-a41a-9b035a456087 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:10.783273 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-f1db09c5-7d35-4d63-98ec-58b9197dba8a req-9de92a41-f84b-4402-abaf-bbde9f9964cb service nova] Creating event network-changed:0dc48d8d-77c4-4b8d-9828-06b574dce835 for instance 3e00e521-84f5-4e7b-8cec-7a4d2e220d28 on n-h2-833090-16 Aug 31 16:17:10.790374 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [req-f1db09c5-7d35-4d63-98ec-58b9197dba8a req-9de92a41-f84b-4402-abaf-bbde9f9964cb service nova] Instance e1cb02b7-1dd6-4c83-9008-e19525731e03 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-833090-16', 'n-h1-833090-16'} {{(pid=128864) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 16:17:10.795522 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3ea1e95f-6351-4684-a41a-9b035a456087 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1528 microversion: 2.1 time: 0.365674 Aug 31 16:17:10.796822 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2526/5241] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:10 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1528 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:10.810899 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-f1db09c5-7d35-4d63-98ec-58b9197dba8a req-9de92a41-f84b-4402-abaf-bbde9f9964cb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.074147 Aug 31 16:17:10.812156 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2716/5242] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:17:11.104958 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8bd10155-3f76-40c9-9bd3-1de4d1e049b1 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:11.105574 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8bd10155-3f76-40c9-9bd3-1de4d1e049b1 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 3e00e521-84f5-4e7b-8cec-7a4d2e220d28] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:11.121781 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8bd10155-3f76-40c9-9bd3-1de4d1e049b1 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:11.129386 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8bd10155-3f76-40c9-9bd3-1de4d1e049b1 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:11.129955 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8bd10155-3f76-40c9-9bd3-1de4d1e049b1 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:11.130772 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8bd10155-3f76-40c9-9bd3-1de4d1e049b1 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:11.131527 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8bd10155-3f76-40c9-9bd3-1de4d1e049b1 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:11.131658 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8bd10155-3f76-40c9-9bd3-1de4d1e049b1 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:11.150147 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-de994693-7c41-49fe-8b11-8816f2c68b49 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:11.150933 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-de994693-7c41-49fe-8b11-8816f2c68b49 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: e1cb02b7-1dd6-4c83-9008-e19525731e03] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:11.163458 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-de994693-7c41-49fe-8b11-8816f2c68b49 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:11.164206 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-de994693-7c41-49fe-8b11-8816f2c68b49 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:11.165027 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-de994693-7c41-49fe-8b11-8816f2c68b49 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:11.166615 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-de994693-7c41-49fe-8b11-8816f2c68b49 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:11.167244 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-de994693-7c41-49fe-8b11-8816f2c68b49 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:11.167832 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-de994693-7c41-49fe-8b11-8816f2c68b49 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:12.030698 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-de994693-7c41-49fe-8b11-8816f2c68b49 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:12.034336 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8bd10155-3f76-40c9-9bd3-1de4d1e049b1 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:12.047485 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8bd10155-3f76-40c9-9bd3-1de4d1e049b1 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/3e00e521-84f5-4e7b-8cec-7a4d2e220d28" status: 200 len: 1366 microversion: 2.1 time: 0.946182 Aug 31 16:17:12.048427 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-de994693-7c41-49fe-8b11-8816f2c68b49 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03" status: 200 len: 1693 microversion: 2.1 time: 0.905435 Aug 31 16:17:12.064932 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2527/5243] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:11 2022] GET /compute/v2.1/servers/3e00e521-84f5-4e7b-8cec-7a4d2e220d28 => generated 1366 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:17:12.064932 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1d184642-a5aa-4c43-8d65-7d3daddf95dc tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:12.064932 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1d184642-a5aa-4c43-8d65-7d3daddf95dc tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:12.074563 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d184642-a5aa-4c43-8d65-7d3daddf95dc tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:12.076207 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d184642-a5aa-4c43-8d65-7d3daddf95dc tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:12.076931 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d184642-a5aa-4c43-8d65-7d3daddf95dc tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:12.081973 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d184642-a5aa-4c43-8d65-7d3daddf95dc tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:12.082844 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d184642-a5aa-4c43-8d65-7d3daddf95dc tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:12.083801 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d184642-a5aa-4c43-8d65-7d3daddf95dc tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:12.098271 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2717/5244] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:11 2022] GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03 => generated 1693 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:17:12.111036 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5b6695fb-b6cd-4e24-9cbf-168cc4b24289 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:12.111702 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5b6695fb-b6cd-4e24-9cbf-168cc4b24289 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:12.119790 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5b6695fb-b6cd-4e24-9cbf-168cc4b24289 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:12.120183 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5b6695fb-b6cd-4e24-9cbf-168cc4b24289 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:12.120615 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5b6695fb-b6cd-4e24-9cbf-168cc4b24289 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:12.121304 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5b6695fb-b6cd-4e24-9cbf-168cc4b24289 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:12.121751 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5b6695fb-b6cd-4e24-9cbf-168cc4b24289 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:12.122321 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5b6695fb-b6cd-4e24-9cbf-168cc4b24289 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:12.244811 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1d184642-a5aa-4c43-8d65-7d3daddf95dc tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:12.259985 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1d184642-a5aa-4c43-8d65-7d3daddf95dc tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:12.261964 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1d184642-a5aa-4c43-8d65-7d3daddf95dc tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:12.264392 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1d184642-a5aa-4c43-8d65-7d3daddf95dc tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1339 microversion: 2.20 time: 0.213256 Aug 31 16:17:12.265187 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2528/5245] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:17:12 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1339 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:17:12.378531 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5b6695fb-b6cd-4e24-9cbf-168cc4b24289 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:12.388899 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5b6695fb-b6cd-4e24-9cbf-168cc4b24289 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1510 microversion: 2.1 time: 0.289269 Aug 31 16:17:12.390080 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2718/5246] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:12 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1510 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:13.072739 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-83637200-0195-44db-a2b1-bb3662566633 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:13.074123 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-83637200-0195-44db-a2b1-bb3662566633 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 3e00e521-84f5-4e7b-8cec-7a4d2e220d28] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:13.081710 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83637200-0195-44db-a2b1-bb3662566633 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:13.082622 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83637200-0195-44db-a2b1-bb3662566633 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:13.083302 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83637200-0195-44db-a2b1-bb3662566633 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:13.084258 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83637200-0195-44db-a2b1-bb3662566633 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:13.085147 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83637200-0195-44db-a2b1-bb3662566633 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:13.085794 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83637200-0195-44db-a2b1-bb3662566633 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:13.102966 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-083f6899-0c61-4694-badc-eb1d4d0d0d68 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:13.103571 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-083f6899-0c61-4694-badc-eb1d4d0d0d68 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: e1cb02b7-1dd6-4c83-9008-e19525731e03] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:13.116687 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-083f6899-0c61-4694-badc-eb1d4d0d0d68 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:13.117594 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-083f6899-0c61-4694-badc-eb1d4d0d0d68 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:13.118586 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-083f6899-0c61-4694-badc-eb1d4d0d0d68 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:13.123453 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-083f6899-0c61-4694-badc-eb1d4d0d0d68 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:13.124160 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-083f6899-0c61-4694-badc-eb1d4d0d0d68 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:13.124850 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-083f6899-0c61-4694-badc-eb1d4d0d0d68 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:13.386977 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-83637200-0195-44db-a2b1-bb3662566633 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:13.390789 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:17:13.396356 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-83637200-0195-44db-a2b1-bb3662566633 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/3e00e521-84f5-4e7b-8cec-7a4d2e220d28" status: 200 len: 1366 microversion: 2.1 time: 0.327816 Aug 31 16:17:13.397225 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2529/5247] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:13 2022] GET /compute/v2.1/servers/3e00e521-84f5-4e7b-8cec-7a4d2e220d28 => generated 1366 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:13.403664 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c625a99f-0161-4300-bef2-f00b9941b8d5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:13.404746 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c625a99f-0161-4300-bef2-f00b9941b8d5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:13.417616 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c625a99f-0161-4300-bef2-f00b9941b8d5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:13.418507 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c625a99f-0161-4300-bef2-f00b9941b8d5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:13.418679 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c625a99f-0161-4300-bef2-f00b9941b8d5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:13.419572 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c625a99f-0161-4300-bef2-f00b9941b8d5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:13.420242 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c625a99f-0161-4300-bef2-f00b9941b8d5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:13.420723 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c625a99f-0161-4300-bef2-f00b9941b8d5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:13.479439 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-083f6899-0c61-4694-badc-eb1d4d0d0d68 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:13.491494 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-083f6899-0c61-4694-badc-eb1d4d0d0d68 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03" status: 200 len: 1690 microversion: 2.1 time: 0.393411 Aug 31 16:17:13.492420 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2719/5248] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:13 2022] GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03 => generated 1690 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:17:13.497620 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-80e3fb66-a22c-4eab-a93e-72c7bb4f6694 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:13.498655 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-80e3fb66-a22c-4eab-a93e-72c7bb4f6694 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:13.507986 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-80e3fb66-a22c-4eab-a93e-72c7bb4f6694 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:13.508771 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-80e3fb66-a22c-4eab-a93e-72c7bb4f6694 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:13.509429 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-80e3fb66-a22c-4eab-a93e-72c7bb4f6694 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:13.510409 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-80e3fb66-a22c-4eab-a93e-72c7bb4f6694 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:13.511341 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-80e3fb66-a22c-4eab-a93e-72c7bb4f6694 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:13.512401 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-80e3fb66-a22c-4eab-a93e-72c7bb4f6694 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:13.824021 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c625a99f-0161-4300-bef2-f00b9941b8d5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:13.834845 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-80e3fb66-a22c-4eab-a93e-72c7bb4f6694 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:13.840526 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c625a99f-0161-4300-bef2-f00b9941b8d5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:13.842819 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c625a99f-0161-4300-bef2-f00b9941b8d5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:13.844128 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-80e3fb66-a22c-4eab-a93e-72c7bb4f6694 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1510 microversion: 2.1 time: 0.350279 Aug 31 16:17:13.845522 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c625a99f-0161-4300-bef2-f00b9941b8d5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1406 microversion: 2.20 time: 0.445960 Aug 31 16:17:13.846897 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2530/5249] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:17:13 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1406 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:17:13.852296 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2720/5250] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:13 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1510 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:13.864535 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c8db8178-ca18-4188-9c6d-d3983ed32748 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:17:13.865867 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c8db8178-ca18-4188-9c6d-d3983ed32748 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: e1cb02b7-1dd6-4c83-9008-e19525731e03] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:13.875887 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8db8178-ca18-4188-9c6d-d3983ed32748 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:13.876384 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8db8178-ca18-4188-9c6d-d3983ed32748 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:13.876814 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8db8178-ca18-4188-9c6d-d3983ed32748 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:13.877526 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8db8178-ca18-4188-9c6d-d3983ed32748 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:13.877979 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8db8178-ca18-4188-9c6d-d3983ed32748 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:13.878432 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8db8178-ca18-4188-9c6d-d3983ed32748 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:14.018390 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c8db8178-ca18-4188-9c6d-d3983ed32748 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "POST /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03/action" status: 202 len: 0 microversion: 2.1 time: 0.168552 Aug 31 16:17:14.019140 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2531/5251] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:17:13 2022] POST /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:17:14.028455 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9af8d383-3b0d-4283-a69b-b335962fd7cd tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:14.029328 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9af8d383-3b0d-4283-a69b-b335962fd7cd tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: e1cb02b7-1dd6-4c83-9008-e19525731e03] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:14.036331 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9af8d383-3b0d-4283-a69b-b335962fd7cd tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:14.037334 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9af8d383-3b0d-4283-a69b-b335962fd7cd tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:14.037916 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9af8d383-3b0d-4283-a69b-b335962fd7cd tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:14.038850 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9af8d383-3b0d-4283-a69b-b335962fd7cd tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:14.039444 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9af8d383-3b0d-4283-a69b-b335962fd7cd tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:14.040010 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9af8d383-3b0d-4283-a69b-b335962fd7cd tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:14.383531 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9af8d383-3b0d-4283-a69b-b335962fd7cd tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:14.398674 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9af8d383-3b0d-4283-a69b-b335962fd7cd tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03" status: 200 len: 1689 microversion: 2.1 time: 0.374764 Aug 31 16:17:14.400629 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2721/5252] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:14 2022] GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03 => generated 1689 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:14.422399 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4efbd47c-8368-4270-940b-d8d5251a53c6 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:14.423425 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4efbd47c-8368-4270-940b-d8d5251a53c6 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 3e00e521-84f5-4e7b-8cec-7a4d2e220d28] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:14.440459 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4efbd47c-8368-4270-940b-d8d5251a53c6 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:14.441214 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4efbd47c-8368-4270-940b-d8d5251a53c6 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:14.441805 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4efbd47c-8368-4270-940b-d8d5251a53c6 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:14.444023 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4efbd47c-8368-4270-940b-d8d5251a53c6 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:14.444647 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4efbd47c-8368-4270-940b-d8d5251a53c6 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:14.445228 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4efbd47c-8368-4270-940b-d8d5251a53c6 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:14.555737 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-0e033523-7d2c-4667-b48d-acb9306338ec req-0d848e27-48c7-4117-9eb3-fa96bb6246a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1cb02b7-1dd6-4c83-9008-e19525731e03", "name": "network-vif-plugged", "status": "completed", "tag": "aad14830-ef68-4e56-bff4-91dbcf99efc3"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:17:14.581737 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-0e033523-7d2c-4667-b48d-acb9306338ec req-0d848e27-48c7-4117-9eb3-fa96bb6246a0 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:14.582575 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-0e033523-7d2c-4667-b48d-acb9306338ec req-0d848e27-48c7-4117-9eb3-fa96bb6246a0 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:14.585131 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-0e033523-7d2c-4667-b48d-acb9306338ec req-0d848e27-48c7-4117-9eb3-fa96bb6246a0 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:14.605379 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-0e033523-7d2c-4667-b48d-acb9306338ec req-0d848e27-48c7-4117-9eb3-fa96bb6246a0 service nova] Creating event network-vif-plugged:aad14830-ef68-4e56-bff4-91dbcf99efc3 for instance e1cb02b7-1dd6-4c83-9008-e19525731e03 on n-h1-833090-16 Aug 31 16:17:14.614070 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [req-0e033523-7d2c-4667-b48d-acb9306338ec req-0d848e27-48c7-4117-9eb3-fa96bb6246a0 service nova] Instance e1cb02b7-1dd6-4c83-9008-e19525731e03 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-833090-16', 'n-h1-833090-16'} {{(pid=128864) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 16:17:14.629287 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-0e033523-7d2c-4667-b48d-acb9306338ec req-0d848e27-48c7-4117-9eb3-fa96bb6246a0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081970 Aug 31 16:17:14.630547 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2722/5253] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:17:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:17:14.826364 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4efbd47c-8368-4270-940b-d8d5251a53c6 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:14.838717 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4efbd47c-8368-4270-940b-d8d5251a53c6 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/3e00e521-84f5-4e7b-8cec-7a4d2e220d28" status: 200 len: 1366 microversion: 2.1 time: 0.421909 Aug 31 16:17:14.841253 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2532/5254] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:14 2022] GET /compute/v2.1/servers/3e00e521-84f5-4e7b-8cec-7a4d2e220d28 => generated 1366 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:14.878868 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7108187e-e276-4e18-8fa7-e859a3b1f946 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:14.879757 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7108187e-e276-4e18-8fa7-e859a3b1f946 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:14.879955 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-64a54e53-4430-4fae-acfb-873b19261927 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:14.880784 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-64a54e53-4430-4fae-acfb-873b19261927 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:14.888733 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7108187e-e276-4e18-8fa7-e859a3b1f946 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:14.889389 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7108187e-e276-4e18-8fa7-e859a3b1f946 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:14.889496 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:17:14.890044 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7108187e-e276-4e18-8fa7-e859a3b1f946 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:14.890979 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7108187e-e276-4e18-8fa7-e859a3b1f946 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:14.893224 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7108187e-e276-4e18-8fa7-e859a3b1f946 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:14.893824 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7108187e-e276-4e18-8fa7-e859a3b1f946 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:14.895336 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64a54e53-4430-4fae-acfb-873b19261927 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:14.897261 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64a54e53-4430-4fae-acfb-873b19261927 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:14.897824 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64a54e53-4430-4fae-acfb-873b19261927 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:14.899985 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64a54e53-4430-4fae-acfb-873b19261927 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:14.900657 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64a54e53-4430-4fae-acfb-873b19261927 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:14.901884 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64a54e53-4430-4fae-acfb-873b19261927 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:15.390992 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-64a54e53-4430-4fae-acfb-873b19261927 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:15.410774 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7108187e-e276-4e18-8fa7-e859a3b1f946 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:15.426841 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-64a54e53-4430-4fae-acfb-873b19261927 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:15.428330 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-64a54e53-4430-4fae-acfb-873b19261927 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:15.436406 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-64a54e53-4430-4fae-acfb-873b19261927 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1406 microversion: 2.20 time: 0.560504 Aug 31 16:17:15.436825 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7108187e-e276-4e18-8fa7-e859a3b1f946 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1510 microversion: 2.1 time: 0.563334 Aug 31 16:17:15.441238 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2723/5255] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:14 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1510 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:15.447156 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-37a2aeba-3251-4d24-b453-72e9e841edfe req-ee407365-b7cc-414a-af93-a9eb4aea9fd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d", "tag": "8e4486a0-b7ef-4efa-8a3b-565a37bae537"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:17:15.452298 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2533/5256] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:17:14 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1406 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:17:15.462177 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-37a2aeba-3251-4d24-b453-72e9e841edfe req-ee407365-b7cc-414a-af93-a9eb4aea9fd2 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:15.465933 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-37a2aeba-3251-4d24-b453-72e9e841edfe req-ee407365-b7cc-414a-af93-a9eb4aea9fd2 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:15.466569 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-37a2aeba-3251-4d24-b453-72e9e841edfe req-ee407365-b7cc-414a-af93-a9eb4aea9fd2 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:15.494320 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d68ecc46-7ca5-41ed-acb5-94cd63f701e0 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:15.495332 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d68ecc46-7ca5-41ed-acb5-94cd63f701e0 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: e1cb02b7-1dd6-4c83-9008-e19525731e03] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:15.511491 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-37a2aeba-3251-4d24-b453-72e9e841edfe req-ee407365-b7cc-414a-af93-a9eb4aea9fd2 service nova] Creating event network-changed:8e4486a0-b7ef-4efa-8a3b-565a37bae537 for instance 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d on n-h1-833090-16 Aug 31 16:17:15.515263 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d68ecc46-7ca5-41ed-acb5-94cd63f701e0 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:15.516518 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d68ecc46-7ca5-41ed-acb5-94cd63f701e0 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:15.517981 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d68ecc46-7ca5-41ed-acb5-94cd63f701e0 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:15.519037 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d68ecc46-7ca5-41ed-acb5-94cd63f701e0 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:15.519638 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d68ecc46-7ca5-41ed-acb5-94cd63f701e0 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:15.519919 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-37a2aeba-3251-4d24-b453-72e9e841edfe req-ee407365-b7cc-414a-af93-a9eb4aea9fd2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076641 Aug 31 16:17:15.520368 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d68ecc46-7ca5-41ed-acb5-94cd63f701e0 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:15.521767 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2724/5257] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:17:15.838881 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d68ecc46-7ca5-41ed-acb5-94cd63f701e0 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:15.850894 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d68ecc46-7ca5-41ed-acb5-94cd63f701e0 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03" status: 200 len: 1689 microversion: 2.1 time: 0.396360 Aug 31 16:17:15.851643 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2534/5258] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:15 2022] GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03 => generated 1689 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:15.863924 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1b4d1a76-0ea3-499d-92a3-fb3d2b4a3a68 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:15.865915 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1b4d1a76-0ea3-499d-92a3-fb3d2b4a3a68 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 3e00e521-84f5-4e7b-8cec-7a4d2e220d28] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:15.875332 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1b4d1a76-0ea3-499d-92a3-fb3d2b4a3a68 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:15.875825 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1b4d1a76-0ea3-499d-92a3-fb3d2b4a3a68 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:15.876553 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1b4d1a76-0ea3-499d-92a3-fb3d2b4a3a68 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:15.877443 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1b4d1a76-0ea3-499d-92a3-fb3d2b4a3a68 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:15.877893 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1b4d1a76-0ea3-499d-92a3-fb3d2b4a3a68 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:15.878549 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1b4d1a76-0ea3-499d-92a3-fb3d2b4a3a68 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:16.049850 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1b4d1a76-0ea3-499d-92a3-fb3d2b4a3a68 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:16.060517 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1b4d1a76-0ea3-499d-92a3-fb3d2b4a3a68 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/3e00e521-84f5-4e7b-8cec-7a4d2e220d28" status: 200 len: 1366 microversion: 2.1 time: 0.199506 Aug 31 16:17:16.060517 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2725/5259] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:15 2022] GET /compute/v2.1/servers/3e00e521-84f5-4e7b-8cec-7a4d2e220d28 => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:16.481412 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7738b267-a36d-4a9f-9ad5-cdb9a904ac7c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:16.482024 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7738b267-a36d-4a9f-9ad5-cdb9a904ac7c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:16.482741 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-44e2a843-506d-430e-bdc7-ba01e9375d8c tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:16.483826 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-44e2a843-506d-430e-bdc7-ba01e9375d8c tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:16.490503 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7738b267-a36d-4a9f-9ad5-cdb9a904ac7c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:16.491125 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7738b267-a36d-4a9f-9ad5-cdb9a904ac7c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:16.491735 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44e2a843-506d-430e-bdc7-ba01e9375d8c tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:16.491848 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7738b267-a36d-4a9f-9ad5-cdb9a904ac7c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:16.492657 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7738b267-a36d-4a9f-9ad5-cdb9a904ac7c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:16.493078 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44e2a843-506d-430e-bdc7-ba01e9375d8c tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:16.493413 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7738b267-a36d-4a9f-9ad5-cdb9a904ac7c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:16.493879 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44e2a843-506d-430e-bdc7-ba01e9375d8c tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:16.494113 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7738b267-a36d-4a9f-9ad5-cdb9a904ac7c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:16.494961 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44e2a843-506d-430e-bdc7-ba01e9375d8c tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:16.495577 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44e2a843-506d-430e-bdc7-ba01e9375d8c tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:16.496178 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44e2a843-506d-430e-bdc7-ba01e9375d8c tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:17.446138 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7738b267-a36d-4a9f-9ad5-cdb9a904ac7c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:17.457437 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7738b267-a36d-4a9f-9ad5-cdb9a904ac7c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1510 microversion: 2.1 time: 0.979348 Aug 31 16:17:17.458592 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2726/5260] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:16 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1510 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:17.479099 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-8b619927-dfb4-45d2-aeda-28d933c31f05 req-fdc20f1a-670a-4d03-900e-068bacf59d8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b051f4f-6b51-4ca7-9afd-6d75682e7f52", "name": "network-vif-unplugged", "status": "completed", "tag": "5c653659-ac4d-41e4-8b0a-b35ade932e62"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:17:17.483653 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-44e2a843-506d-430e-bdc7-ba01e9375d8c tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:17.514450 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-44e2a843-506d-430e-bdc7-ba01e9375d8c tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:17.521943 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-44e2a843-506d-430e-bdc7-ba01e9375d8c tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:17.527077 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-44e2a843-506d-430e-bdc7-ba01e9375d8c tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1406 microversion: 2.20 time: 1.048145 Aug 31 16:17:17.528845 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2535/5261] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:17:16 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1406 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:17:17.532626 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-8b619927-dfb4-45d2-aeda-28d933c31f05 req-fdc20f1a-670a-4d03-900e-068bacf59d8c service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:17.534461 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-8b619927-dfb4-45d2-aeda-28d933c31f05 req-fdc20f1a-670a-4d03-900e-068bacf59d8c service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:17.534914 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-8b619927-dfb4-45d2-aeda-28d933c31f05 req-fdc20f1a-670a-4d03-900e-068bacf59d8c service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:17.552306 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cf771015-8e15-4896-ad78-b5c4e8aad765 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:17.555078 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-8b619927-dfb4-45d2-aeda-28d933c31f05 req-fdc20f1a-670a-4d03-900e-068bacf59d8c service nova] Creating event network-vif-unplugged:5c653659-ac4d-41e4-8b0a-b35ade932e62 for instance 4b051f4f-6b51-4ca7-9afd-6d75682e7f52 on n-h2-833090-16 Aug 31 16:17:17.557150 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cf771015-8e15-4896-ad78-b5c4e8aad765 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: e1cb02b7-1dd6-4c83-9008-e19525731e03] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:17.566402 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-8b619927-dfb4-45d2-aeda-28d933c31f05 req-fdc20f1a-670a-4d03-900e-068bacf59d8c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103834 Aug 31 16:17:17.568295 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2727/5262] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:17:17.580420 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a55256de-40b8-4620-885d-601b8c43e559 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:17.583380 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a55256de-40b8-4620-885d-601b8c43e559 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 3e00e521-84f5-4e7b-8cec-7a4d2e220d28] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:17.589773 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf771015-8e15-4896-ad78-b5c4e8aad765 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:17.590559 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf771015-8e15-4896-ad78-b5c4e8aad765 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:17.591177 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf771015-8e15-4896-ad78-b5c4e8aad765 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:17.591993 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf771015-8e15-4896-ad78-b5c4e8aad765 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:17.601999 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a55256de-40b8-4620-885d-601b8c43e559 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:17.603220 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a55256de-40b8-4620-885d-601b8c43e559 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:17.603660 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf771015-8e15-4896-ad78-b5c4e8aad765 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:17.604402 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf771015-8e15-4896-ad78-b5c4e8aad765 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:17.605305 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a55256de-40b8-4620-885d-601b8c43e559 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:17.607657 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a55256de-40b8-4620-885d-601b8c43e559 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:17.609801 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a55256de-40b8-4620-885d-601b8c43e559 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:17.610944 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a55256de-40b8-4620-885d-601b8c43e559 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:17.940708 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a55256de-40b8-4620-885d-601b8c43e559 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:17.950146 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cf771015-8e15-4896-ad78-b5c4e8aad765 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:17.956799 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=100 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:17:17.972027 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cf771015-8e15-4896-ad78-b5c4e8aad765 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03" status: 200 len: 1689 microversion: 2.1 time: 0.441128 Aug 31 16:17:17.975743 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2536/5263] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:17 2022] GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03 => generated 1689 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:17.981361 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a55256de-40b8-4620-885d-601b8c43e559 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/3e00e521-84f5-4e7b-8cec-7a4d2e220d28" status: 200 len: 1366 microversion: 2.1 time: 0.409936 Aug 31 16:17:17.996409 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2728/5264] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:17 2022] GET /compute/v2.1/servers/3e00e521-84f5-4e7b-8cec-7a4d2e220d28 => generated 1366 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:18.490533 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-efaad389-535c-4a0d-af32-75c702077639 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:18.491830 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-efaad389-535c-4a0d-af32-75c702077639 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:18.503649 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:17:18.505881 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=22 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:17:18.511990 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-efaad389-535c-4a0d-af32-75c702077639 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:18.512965 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-efaad389-535c-4a0d-af32-75c702077639 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:18.514724 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-efaad389-535c-4a0d-af32-75c702077639 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:18.517043 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-efaad389-535c-4a0d-af32-75c702077639 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:18.517577 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-efaad389-535c-4a0d-af32-75c702077639 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:18.518018 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-efaad389-535c-4a0d-af32-75c702077639 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:18.558568 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c974873a-91c1-4308-b104-395a1613cf7d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:18.562196 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c974873a-91c1-4308-b104-395a1613cf7d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:18.581703 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c974873a-91c1-4308-b104-395a1613cf7d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:18.582777 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c974873a-91c1-4308-b104-395a1613cf7d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:18.585536 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c974873a-91c1-4308-b104-395a1613cf7d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:18.586625 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c974873a-91c1-4308-b104-395a1613cf7d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:18.587235 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c974873a-91c1-4308-b104-395a1613cf7d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:18.587831 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c974873a-91c1-4308-b104-395a1613cf7d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:19.274979 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-efaad389-535c-4a0d-af32-75c702077639 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:19.290865 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-efaad389-535c-4a0d-af32-75c702077639 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1513 microversion: 2.1 time: 0.804355 Aug 31 16:17:19.291483 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2537/5265] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:18 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1513 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:19.324422 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-61d49832-0af8-47b7-a025-e9754e3cc86e tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:19.326229 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-61d49832-0af8-47b7-a025-e9754e3cc86e tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: e1cb02b7-1dd6-4c83-9008-e19525731e03] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:19.345632 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61d49832-0af8-47b7-a025-e9754e3cc86e tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:19.348433 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61d49832-0af8-47b7-a025-e9754e3cc86e tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:19.349224 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61d49832-0af8-47b7-a025-e9754e3cc86e tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:19.352139 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61d49832-0af8-47b7-a025-e9754e3cc86e tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:19.354815 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61d49832-0af8-47b7-a025-e9754e3cc86e tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:19.355573 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-61d49832-0af8-47b7-a025-e9754e3cc86e tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:19.473434 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c974873a-91c1-4308-b104-395a1613cf7d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:19.475952 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:17:19.489104 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c974873a-91c1-4308-b104-395a1613cf7d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:19.490983 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c974873a-91c1-4308-b104-395a1613cf7d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:19.492331 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c974873a-91c1-4308-b104-395a1613cf7d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1406 microversion: 2.20 time: 0.939857 Aug 31 16:17:19.493417 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2729/5266] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:17:18 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1406 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:17:19.508757 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-33c420bc-eef6-4dbd-93de-dc3f13c33b80 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:19.513024 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-33c420bc-eef6-4dbd-93de-dc3f13c33b80 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 3e00e521-84f5-4e7b-8cec-7a4d2e220d28] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:19.528569 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33c420bc-eef6-4dbd-93de-dc3f13c33b80 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:19.529310 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33c420bc-eef6-4dbd-93de-dc3f13c33b80 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:19.531174 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33c420bc-eef6-4dbd-93de-dc3f13c33b80 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:19.532091 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33c420bc-eef6-4dbd-93de-dc3f13c33b80 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:19.537525 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33c420bc-eef6-4dbd-93de-dc3f13c33b80 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:19.538434 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33c420bc-eef6-4dbd-93de-dc3f13c33b80 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:20.029452 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-61d49832-0af8-47b7-a025-e9754e3cc86e tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:20.041216 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-61d49832-0af8-47b7-a025-e9754e3cc86e tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03" status: 200 len: 1689 microversion: 2.1 time: 0.730323 Aug 31 16:17:20.046297 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2538/5267] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:19 2022] GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03 => generated 1689 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:20.055163 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-33c420bc-eef6-4dbd-93de-dc3f13c33b80 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:20.060148 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c777dc4e-b7ab-42cf-be25-b111ee7f912f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:20.060869 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c777dc4e-b7ab-42cf-be25-b111ee7f912f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:20.068743 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c777dc4e-b7ab-42cf-be25-b111ee7f912f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:20.069884 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c777dc4e-b7ab-42cf-be25-b111ee7f912f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:20.070487 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-33c420bc-eef6-4dbd-93de-dc3f13c33b80 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/3e00e521-84f5-4e7b-8cec-7a4d2e220d28" status: 200 len: 1366 microversion: 2.1 time: 0.575474 Aug 31 16:17:20.070665 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c777dc4e-b7ab-42cf-be25-b111ee7f912f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:20.071545 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c777dc4e-b7ab-42cf-be25-b111ee7f912f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:20.072212 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c777dc4e-b7ab-42cf-be25-b111ee7f912f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:20.072771 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c777dc4e-b7ab-42cf-be25-b111ee7f912f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:20.078147 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2730/5268] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:19 2022] GET /compute/v2.1/servers/3e00e521-84f5-4e7b-8cec-7a4d2e220d28 => generated 1366 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:20.087941 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-0ca801ef-1831-490c-8141-10ff6e02e7b7 req-6fae8aa6-3f16-42cf-8680-9107bb53eee3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e00e521-84f5-4e7b-8cec-7a4d2e220d28", "name": "network-vif-plugged", "status": "completed", "tag": "0dc48d8d-77c4-4b8d-9828-06b574dce835"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:17:20.101846 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-0ca801ef-1831-490c-8141-10ff6e02e7b7 req-6fae8aa6-3f16-42cf-8680-9107bb53eee3 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:20.103036 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-0ca801ef-1831-490c-8141-10ff6e02e7b7 req-6fae8aa6-3f16-42cf-8680-9107bb53eee3 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:20.103755 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-0ca801ef-1831-490c-8141-10ff6e02e7b7 req-6fae8aa6-3f16-42cf-8680-9107bb53eee3 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:20.126191 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-0ca801ef-1831-490c-8141-10ff6e02e7b7 req-6fae8aa6-3f16-42cf-8680-9107bb53eee3 service nova] Creating event network-vif-plugged:0dc48d8d-77c4-4b8d-9828-06b574dce835 for instance 3e00e521-84f5-4e7b-8cec-7a4d2e220d28 on n-h2-833090-16 Aug 31 16:17:20.134826 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-0ca801ef-1831-490c-8141-10ff6e02e7b7 req-6fae8aa6-3f16-42cf-8680-9107bb53eee3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054929 Aug 31 16:17:20.136213 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2731/5269] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:17:20.518879 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0f13cd47-39d6-416e-a1c0-5e04342f49f3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:20.519871 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0f13cd47-39d6-416e-a1c0-5e04342f49f3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:20.528051 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0f13cd47-39d6-416e-a1c0-5e04342f49f3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:20.528901 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0f13cd47-39d6-416e-a1c0-5e04342f49f3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:20.529876 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0f13cd47-39d6-416e-a1c0-5e04342f49f3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:20.530905 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0f13cd47-39d6-416e-a1c0-5e04342f49f3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:20.531559 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0f13cd47-39d6-416e-a1c0-5e04342f49f3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:20.532182 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0f13cd47-39d6-416e-a1c0-5e04342f49f3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:20.540901 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c777dc4e-b7ab-42cf-be25-b111ee7f912f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:20.551544 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c777dc4e-b7ab-42cf-be25-b111ee7f912f tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1453 microversion: 2.1 time: 0.503340 Aug 31 16:17:20.552376 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2539/5270] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:20 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1453 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:20.611884 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-216c8595-058c-4428-882b-94aae9a32c17 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:17:20.614876 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-216c8595-058c-4428-882b-94aae9a32c17 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:20.632236 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-216c8595-058c-4428-882b-94aae9a32c17 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:20.633001 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-216c8595-058c-4428-882b-94aae9a32c17 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:20.633696 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-216c8595-058c-4428-882b-94aae9a32c17 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:20.634552 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-216c8595-058c-4428-882b-94aae9a32c17 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:20.635138 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-216c8595-058c-4428-882b-94aae9a32c17 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:20.635712 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-216c8595-058c-4428-882b-94aae9a32c17 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:20.669136 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-216c8595-058c-4428-882b-94aae9a32c17 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lazy-loading 'flavor' on Instance uuid 4b051f4f-6b51-4ca7-9afd-6d75682e7f52 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:17:20.683034 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-216c8595-058c-4428-882b-94aae9a32c17 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] HTTP exception thrown: Cannot 'shelve' instance 4b051f4f-6b51-4ca7-9afd-6d75682e7f52 while it is in vm_state shelved_offloaded Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-216c8595-058c-4428-882b-94aae9a32c17 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Request method failure captured: Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52/action HTTP/1.1 Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 14 Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4kQ0XzwgZzM00K2xfqw4sNWznetRNwtM61dwPFzPgxHVwt6ZQqeyy0IDwJXT8yOdP4-2pSJFf0sLdbRTKSty95v4MPjLoaaRhSqpDob3UUxppJFVkB8ZQH-IsYhc50JLxuO54hEVWRh4jtxjaTwZZjw98G6FCIkizac62ua4tSQ6_s Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3e843f3122c14cf8889f26423552792f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3e843f3122c14cf8889f26423552792f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 8b67be53aade4f8c92d6765dd91a4b90 Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: {"shelve": {}} Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: exception: Cannot 'shelve' instance 4b051f4f-6b51-4ca7-9afd-6d75682e7f52 while it is in vm_state shelved_offloaded Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '4b051f4f-6b51-4ca7-9afd-6d75682e7f52', 'body': {'shelve': {}}} Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4b051f4f-6b51-4ca7-9afd-6d75682e7f52 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 16:17:20.685901 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 16:17:20.689502 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 4b051f4f-6b51-4ca7-9afd-6d75682e7f52 while it is in vm_state shelved_offloaded Aug 31 16:17:20.689502 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:17:20.689502 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:17:20.689502 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:17:20.689502 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:17:20.689502 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:17:20.689502 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:17:20.689502 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:17:20.689502 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:17:20.689502 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 4b051f4f-6b51-4ca7-9afd-6d75682e7f52 while it is in vm_state shelved_offloaded Aug 31 16:17:20.689502 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:17:20.696917 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-216c8595-058c-4428-882b-94aae9a32c17 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Returning 409 to user: Cannot 'shelve' instance 4b051f4f-6b51-4ca7-9afd-6d75682e7f52 while it is in vm_state shelved_offloaded {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:17:20.698213 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-216c8595-058c-4428-882b-94aae9a32c17 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "POST /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52/action" status: 409 len: 155 microversion: 2.1 time: 0.090577 Aug 31 16:17:20.706317 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2540/5271] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:17:20 2022] POST /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52/action => generated 155 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 31 16:17:20.718149 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-48eba081-a552-4901-a7e6-c61c1bdc80c3 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:17:20.719171 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-48eba081-a552-4901-a7e6-c61c1bdc80c3 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:20.730896 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-48eba081-a552-4901-a7e6-c61c1bdc80c3 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:20.732204 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-48eba081-a552-4901-a7e6-c61c1bdc80c3 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:20.732696 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-48eba081-a552-4901-a7e6-c61c1bdc80c3 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:20.733648 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-48eba081-a552-4901-a7e6-c61c1bdc80c3 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:20.735111 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-48eba081-a552-4901-a7e6-c61c1bdc80c3 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:20.739291 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-48eba081-a552-4901-a7e6-c61c1bdc80c3 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:20.814655 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-48eba081-a552-4901-a7e6-c61c1bdc80c3 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128863) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 16:17:20.817443 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0f13cd47-39d6-416e-a1c0-5e04342f49f3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:20.835366 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0f13cd47-39d6-416e-a1c0-5e04342f49f3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:20.845490 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0f13cd47-39d6-416e-a1c0-5e04342f49f3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:20.849659 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0f13cd47-39d6-416e-a1c0-5e04342f49f3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1406 microversion: 2.20 time: 0.335085 Aug 31 16:17:20.869318 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2732/5272] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:17:20 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1406 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:17:20.921015 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-48eba081-a552-4901-a7e6-c61c1bdc80c3 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "POST /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52/action" status: 202 len: 0 microversion: 2.1 time: 0.211039 Aug 31 16:17:20.922182 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2541/5273] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:17:20 2022] POST /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:17:20.931991 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ab2ab0de-14b4-4369-b155-9df498a99805 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:20.931991 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ab2ab0de-14b4-4369-b155-9df498a99805 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:20.940379 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ab2ab0de-14b4-4369-b155-9df498a99805 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:20.940983 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ab2ab0de-14b4-4369-b155-9df498a99805 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:20.941742 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ab2ab0de-14b4-4369-b155-9df498a99805 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:20.942582 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ab2ab0de-14b4-4369-b155-9df498a99805 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:20.943092 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ab2ab0de-14b4-4369-b155-9df498a99805 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:20.943636 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ab2ab0de-14b4-4369-b155-9df498a99805 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:21.070332 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-43fa27e6-3ca7-4243-a538-d7946e94d52b tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:21.071161 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-43fa27e6-3ca7-4243-a538-d7946e94d52b tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: e1cb02b7-1dd6-4c83-9008-e19525731e03] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:21.082580 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43fa27e6-3ca7-4243-a538-d7946e94d52b tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:21.086436 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43fa27e6-3ca7-4243-a538-d7946e94d52b tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:21.086935 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43fa27e6-3ca7-4243-a538-d7946e94d52b tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:21.087884 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43fa27e6-3ca7-4243-a538-d7946e94d52b tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:21.088347 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43fa27e6-3ca7-4243-a538-d7946e94d52b tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:21.088777 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43fa27e6-3ca7-4243-a538-d7946e94d52b tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:21.205489 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ab2ab0de-14b4-4369-b155-9df498a99805 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:21.222148 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ab2ab0de-14b4-4369-b155-9df498a99805 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1461 microversion: 2.1 time: 0.290393 Aug 31 16:17:21.224350 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2733/5274] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:20 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1461 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:17:21.240247 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3258b1e9-2e6d-41a0-b8d3-86307db20c09 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:21.242737 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3258b1e9-2e6d-41a0-b8d3-86307db20c09 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 3e00e521-84f5-4e7b-8cec-7a4d2e220d28] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:21.256538 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3258b1e9-2e6d-41a0-b8d3-86307db20c09 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:21.264344 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3258b1e9-2e6d-41a0-b8d3-86307db20c09 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:21.265028 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3258b1e9-2e6d-41a0-b8d3-86307db20c09 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:21.266353 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3258b1e9-2e6d-41a0-b8d3-86307db20c09 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:21.266973 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3258b1e9-2e6d-41a0-b8d3-86307db20c09 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:21.267407 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3258b1e9-2e6d-41a0-b8d3-86307db20c09 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:21.492693 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-43fa27e6-3ca7-4243-a538-d7946e94d52b tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:21.515264 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-43fa27e6-3ca7-4243-a538-d7946e94d52b tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03" status: 200 len: 1689 microversion: 2.1 time: 0.455671 Aug 31 16:17:21.531117 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2542/5275] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:21 2022] GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03 => generated 1689 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:21.534680 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-fe5a9108-5acf-49e5-9698-598c2a899e2d req-bd73d6d7-c8f2-458d-9872-1416360d0c34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1cb02b7-1dd6-4c83-9008-e19525731e03", "name": "network-vif-unplugged", "status": "completed", "tag": "aad14830-ef68-4e56-bff4-91dbcf99efc3"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:17:21.547293 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-fe5a9108-5acf-49e5-9698-598c2a899e2d req-bd73d6d7-c8f2-458d-9872-1416360d0c34 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:21.548264 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-fe5a9108-5acf-49e5-9698-598c2a899e2d req-bd73d6d7-c8f2-458d-9872-1416360d0c34 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:21.548705 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-fe5a9108-5acf-49e5-9698-598c2a899e2d req-bd73d6d7-c8f2-458d-9872-1416360d0c34 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:21.559465 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3258b1e9-2e6d-41a0-b8d3-86307db20c09 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:21.565525 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-fe5a9108-5acf-49e5-9698-598c2a899e2d req-bd73d6d7-c8f2-458d-9872-1416360d0c34 service nova] Creating event network-vif-unplugged:aad14830-ef68-4e56-bff4-91dbcf99efc3 for instance e1cb02b7-1dd6-4c83-9008-e19525731e03 on n-h2-833090-16 Aug 31 16:17:21.568864 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3258b1e9-2e6d-41a0-b8d3-86307db20c09 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/3e00e521-84f5-4e7b-8cec-7a4d2e220d28" status: 200 len: 1366 microversion: 2.1 time: 0.342450 Aug 31 16:17:21.570771 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2734/5276] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:21 2022] GET /compute/v2.1/servers/3e00e521-84f5-4e7b-8cec-7a4d2e220d28 => generated 1366 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:21.573732 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [req-fe5a9108-5acf-49e5-9698-598c2a899e2d req-bd73d6d7-c8f2-458d-9872-1416360d0c34 service nova] Instance e1cb02b7-1dd6-4c83-9008-e19525731e03 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-833090-16', 'n-h1-833090-16'} {{(pid=128863) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 16:17:21.590790 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-fe5a9108-5acf-49e5-9698-598c2a899e2d req-bd73d6d7-c8f2-458d-9872-1416360d0c34 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060662 Aug 31 16:17:21.591630 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2543/5277] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:17:21.874457 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0c48bdfe-596a-4adb-beea-bbf0cfa633f4 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:21.875513 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0c48bdfe-596a-4adb-beea-bbf0cfa633f4 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:21.889407 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0c48bdfe-596a-4adb-beea-bbf0cfa633f4 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:21.894746 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0c48bdfe-596a-4adb-beea-bbf0cfa633f4 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:21.895429 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0c48bdfe-596a-4adb-beea-bbf0cfa633f4 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:21.896601 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0c48bdfe-596a-4adb-beea-bbf0cfa633f4 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:21.897253 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0c48bdfe-596a-4adb-beea-bbf0cfa633f4 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:21.898563 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0c48bdfe-596a-4adb-beea-bbf0cfa633f4 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:22.146384 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0c48bdfe-596a-4adb-beea-bbf0cfa633f4 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:22.157220 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0c48bdfe-596a-4adb-beea-bbf0cfa633f4 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:22.158729 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0c48bdfe-596a-4adb-beea-bbf0cfa633f4 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:22.160829 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0c48bdfe-596a-4adb-beea-bbf0cfa633f4 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1406 microversion: 2.20 time: 0.291236 Aug 31 16:17:22.161991 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2735/5278] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:17:21 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1406 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:17:22.247990 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bbcb0249-66d9-4aeb-afec-747dca1147ef tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:22.248698 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bbcb0249-66d9-4aeb-afec-747dca1147ef tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:22.269754 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bbcb0249-66d9-4aeb-afec-747dca1147ef tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:22.270911 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bbcb0249-66d9-4aeb-afec-747dca1147ef tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:22.271871 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bbcb0249-66d9-4aeb-afec-747dca1147ef tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:22.274236 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bbcb0249-66d9-4aeb-afec-747dca1147ef tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:22.274985 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bbcb0249-66d9-4aeb-afec-747dca1147ef tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:22.275744 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bbcb0249-66d9-4aeb-afec-747dca1147ef tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:22.283907 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:17:22.538428 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2f718e4a-09b8-4272-a11c-63405a3c75d8 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:22.539074 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2f718e4a-09b8-4272-a11c-63405a3c75d8 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: e1cb02b7-1dd6-4c83-9008-e19525731e03] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:22.552532 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2f718e4a-09b8-4272-a11c-63405a3c75d8 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:22.553568 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2f718e4a-09b8-4272-a11c-63405a3c75d8 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:22.556165 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2f718e4a-09b8-4272-a11c-63405a3c75d8 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:22.558650 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2f718e4a-09b8-4272-a11c-63405a3c75d8 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:22.559500 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2f718e4a-09b8-4272-a11c-63405a3c75d8 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:22.561836 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2f718e4a-09b8-4272-a11c-63405a3c75d8 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:22.609524 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bbcb0249-66d9-4aeb-afec-747dca1147ef tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:22.625287 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bbcb0249-66d9-4aeb-afec-747dca1147ef tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1461 microversion: 2.1 time: 0.383208 Aug 31 16:17:22.627494 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2544/5279] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:22 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1461 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:22.639317 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-726c2205-4618-45f8-ab75-1885d5dc5684 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:22.642586 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-726c2205-4618-45f8-ab75-1885d5dc5684 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 3e00e521-84f5-4e7b-8cec-7a4d2e220d28] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:22.665051 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-726c2205-4618-45f8-ab75-1885d5dc5684 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:22.665994 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-726c2205-4618-45f8-ab75-1885d5dc5684 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:22.666720 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-726c2205-4618-45f8-ab75-1885d5dc5684 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:22.667601 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-726c2205-4618-45f8-ab75-1885d5dc5684 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:22.673285 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-726c2205-4618-45f8-ab75-1885d5dc5684 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:22.674009 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-726c2205-4618-45f8-ab75-1885d5dc5684 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:22.939320 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2f718e4a-09b8-4272-a11c-63405a3c75d8 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:22.948572 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2f718e4a-09b8-4272-a11c-63405a3c75d8 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03" status: 200 len: 1689 microversion: 2.1 time: 0.414309 Aug 31 16:17:22.949150 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2736/5280] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:22 2022] GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03 => generated 1689 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:17:22.973433 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-d8eefd9c-c2e5-4828-b329-9cddedf8d167 req-1accaa12-ad23-47de-9faf-26b0ff93ee9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d", "name": "network-vif-plugged", "status": "completed", "tag": "8e4486a0-b7ef-4efa-8a3b-565a37bae537"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:17:22.985022 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-d8eefd9c-c2e5-4828-b329-9cddedf8d167 req-1accaa12-ad23-47de-9faf-26b0ff93ee9c service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:22.985733 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-d8eefd9c-c2e5-4828-b329-9cddedf8d167 req-1accaa12-ad23-47de-9faf-26b0ff93ee9c service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:22.986368 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-d8eefd9c-c2e5-4828-b329-9cddedf8d167 req-1accaa12-ad23-47de-9faf-26b0ff93ee9c service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:22.997618 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-726c2205-4618-45f8-ab75-1885d5dc5684 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:23.005324 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-d8eefd9c-c2e5-4828-b329-9cddedf8d167 req-1accaa12-ad23-47de-9faf-26b0ff93ee9c service nova] Creating event network-vif-plugged:8e4486a0-b7ef-4efa-8a3b-565a37bae537 for instance 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d on n-h1-833090-16 Aug 31 16:17:23.007239 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-726c2205-4618-45f8-ab75-1885d5dc5684 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/3e00e521-84f5-4e7b-8cec-7a4d2e220d28" status: 200 len: 1557 microversion: 2.1 time: 0.378095 Aug 31 16:17:23.022130 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2545/5281] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:22 2022] GET /compute/v2.1/servers/3e00e521-84f5-4e7b-8cec-7a4d2e220d28 => generated 1557 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:23.027189 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-d8eefd9c-c2e5-4828-b329-9cddedf8d167 req-1accaa12-ad23-47de-9faf-26b0ff93ee9c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069764 Aug 31 16:17:23.028490 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2737/5282] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:17:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:17:23.033698 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-67709a3f-26c9-4f58-8d14-5e624c2b5e04 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:23.034420 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-67709a3f-26c9-4f58-8d14-5e624c2b5e04 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 3e00e521-84f5-4e7b-8cec-7a4d2e220d28] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:23.047354 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-67709a3f-26c9-4f58-8d14-5e624c2b5e04 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:23.048057 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-67709a3f-26c9-4f58-8d14-5e624c2b5e04 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:23.048570 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-67709a3f-26c9-4f58-8d14-5e624c2b5e04 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:23.049352 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-67709a3f-26c9-4f58-8d14-5e624c2b5e04 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:23.049881 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-67709a3f-26c9-4f58-8d14-5e624c2b5e04 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:23.051008 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-67709a3f-26c9-4f58-8d14-5e624c2b5e04 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:23.191220 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6436f290-b39f-43cc-aaa8-0ce2afbcd5ae tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:23.192201 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6436f290-b39f-43cc-aaa8-0ce2afbcd5ae tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:23.205644 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6436f290-b39f-43cc-aaa8-0ce2afbcd5ae tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:23.206625 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6436f290-b39f-43cc-aaa8-0ce2afbcd5ae tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:23.207717 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6436f290-b39f-43cc-aaa8-0ce2afbcd5ae tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:23.208839 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6436f290-b39f-43cc-aaa8-0ce2afbcd5ae tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:23.209561 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6436f290-b39f-43cc-aaa8-0ce2afbcd5ae tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:23.210424 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6436f290-b39f-43cc-aaa8-0ce2afbcd5ae tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:23.223045 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-67709a3f-26c9-4f58-8d14-5e624c2b5e04 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/3e00e521-84f5-4e7b-8cec-7a4d2e220d28/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.196429 Aug 31 16:17:23.224040 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2546/5283] 10.222.0.50 () {58 vars in 1275 bytes} [Wed Aug 31 16:17:23 2022] GET /compute/v2.1/servers/3e00e521-84f5-4e7b-8cec-7a4d2e220d28/os-interface => generated 285 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:17:23.617890 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-12505128-ffcd-4091-a732-2d2f882b10e9 req-cde3dd3e-56d7-4a73-b89a-d79da6271632 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1cb02b7-1dd6-4c83-9008-e19525731e03", "tag": "aad14830-ef68-4e56-bff4-91dbcf99efc3"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:17:23.633126 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-12505128-ffcd-4091-a732-2d2f882b10e9 req-cde3dd3e-56d7-4a73-b89a-d79da6271632 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:23.633817 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-12505128-ffcd-4091-a732-2d2f882b10e9 req-cde3dd3e-56d7-4a73-b89a-d79da6271632 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:23.634277 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-12505128-ffcd-4091-a732-2d2f882b10e9 req-cde3dd3e-56d7-4a73-b89a-d79da6271632 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:23.659709 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-12505128-ffcd-4091-a732-2d2f882b10e9 req-cde3dd3e-56d7-4a73-b89a-d79da6271632 service nova] Creating event network-changed:aad14830-ef68-4e56-bff4-91dbcf99efc3 for instance e1cb02b7-1dd6-4c83-9008-e19525731e03 on n-h2-833090-16 Aug 31 16:17:23.676707 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [req-12505128-ffcd-4091-a732-2d2f882b10e9 req-cde3dd3e-56d7-4a73-b89a-d79da6271632 service nova] Instance e1cb02b7-1dd6-4c83-9008-e19525731e03 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-833090-16', 'n-h1-833090-16'} {{(pid=128863) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 16:17:23.701156 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-12505128-ffcd-4091-a732-2d2f882b10e9 req-cde3dd3e-56d7-4a73-b89a-d79da6271632 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089074 Aug 31 16:17:23.702428 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2547/5284] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:17:23.707775 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-67b24a5c-6e6d-4b7f-a52c-5e5e7ffc44e7 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:23.708673 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-67b24a5c-6e6d-4b7f-a52c-5e5e7ffc44e7 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:23.715889 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-67b24a5c-6e6d-4b7f-a52c-5e5e7ffc44e7 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:23.716638 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-67b24a5c-6e6d-4b7f-a52c-5e5e7ffc44e7 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:23.717223 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-67b24a5c-6e6d-4b7f-a52c-5e5e7ffc44e7 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:23.718075 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-67b24a5c-6e6d-4b7f-a52c-5e5e7ffc44e7 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:23.718708 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-67b24a5c-6e6d-4b7f-a52c-5e5e7ffc44e7 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:23.720778 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-67b24a5c-6e6d-4b7f-a52c-5e5e7ffc44e7 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:23.860752 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6436f290-b39f-43cc-aaa8-0ce2afbcd5ae tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:23.873651 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6436f290-b39f-43cc-aaa8-0ce2afbcd5ae tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:23.875148 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6436f290-b39f-43cc-aaa8-0ce2afbcd5ae tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:23.876330 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6436f290-b39f-43cc-aaa8-0ce2afbcd5ae tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1406 microversion: 2.20 time: 0.694804 Aug 31 16:17:23.889121 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2738/5285] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:17:23 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1406 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:17:23.969523 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-92b9be28-00c3-4af4-9fa8-0920bf017856 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:23.970060 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-92b9be28-00c3-4af4-9fa8-0920bf017856 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: e1cb02b7-1dd6-4c83-9008-e19525731e03] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:23.984574 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-92b9be28-00c3-4af4-9fa8-0920bf017856 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:23.985074 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-92b9be28-00c3-4af4-9fa8-0920bf017856 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:23.985514 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-92b9be28-00c3-4af4-9fa8-0920bf017856 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:23.986279 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-92b9be28-00c3-4af4-9fa8-0920bf017856 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:23.986744 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-92b9be28-00c3-4af4-9fa8-0920bf017856 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:23.987174 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-92b9be28-00c3-4af4-9fa8-0920bf017856 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:24.780624 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-67b24a5c-6e6d-4b7f-a52c-5e5e7ffc44e7 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:24.795016 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-67b24a5c-6e6d-4b7f-a52c-5e5e7ffc44e7 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1519 microversion: 2.1 time: 1.090227 Aug 31 16:17:24.795992 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2548/5286] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:23 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1519 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:24.914810 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-21dd7260-2764-4482-9118-61c639c8318b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:24.915582 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-21dd7260-2764-4482-9118-61c639c8318b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:24.932997 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-21dd7260-2764-4482-9118-61c639c8318b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:24.934276 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-21dd7260-2764-4482-9118-61c639c8318b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:24.941965 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-21dd7260-2764-4482-9118-61c639c8318b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:24.943142 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-21dd7260-2764-4482-9118-61c639c8318b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:24.943789 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-21dd7260-2764-4482-9118-61c639c8318b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:24.944325 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-21dd7260-2764-4482-9118-61c639c8318b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:24.989983 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-92b9be28-00c3-4af4-9fa8-0920bf017856 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:25.014341 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-92b9be28-00c3-4af4-9fa8-0920bf017856 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03" status: 200 len: 1689 microversion: 2.1 time: 1.049109 Aug 31 16:17:25.032797 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2739/5287] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:23 2022] GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03 => generated 1689 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:17:25.510665 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-21dd7260-2764-4482-9118-61c639c8318b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:25.521086 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-21dd7260-2764-4482-9118-61c639c8318b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:25.524048 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-21dd7260-2764-4482-9118-61c639c8318b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:25.525722 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-21dd7260-2764-4482-9118-61c639c8318b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1597 microversion: 2.20 time: 0.615472 Aug 31 16:17:25.526587 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2549/5288] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:17:24 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1597 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:17:25.550833 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b2af1e37-63ba-4019-a9ee-feb9d536e23b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:25.551548 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b2af1e37-63ba-4019-a9ee-feb9d536e23b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:25.559409 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b2af1e37-63ba-4019-a9ee-feb9d536e23b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:25.560153 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b2af1e37-63ba-4019-a9ee-feb9d536e23b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:25.560767 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b2af1e37-63ba-4019-a9ee-feb9d536e23b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:25.561644 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b2af1e37-63ba-4019-a9ee-feb9d536e23b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:25.562282 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b2af1e37-63ba-4019-a9ee-feb9d536e23b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:25.562860 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b2af1e37-63ba-4019-a9ee-feb9d536e23b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:25.818919 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b2af1e37-63ba-4019-a9ee-feb9d536e23b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.272289 Aug 31 16:17:25.819844 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2740/5289] 10.222.0.50 () {60 vars in 1316 bytes} [Wed Aug 31 16:17:25 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d/os-interface => generated 284 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:17:25.822064 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-29d363ac-3ffc-40b3-b7c5-76c051818bf7 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:25.822718 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-29d363ac-3ffc-40b3-b7c5-76c051818bf7 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:25.833862 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29d363ac-3ffc-40b3-b7c5-76c051818bf7 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:25.834987 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29d363ac-3ffc-40b3-b7c5-76c051818bf7 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:25.835469 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29d363ac-3ffc-40b3-b7c5-76c051818bf7 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:25.836378 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29d363ac-3ffc-40b3-b7c5-76c051818bf7 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:25.836829 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29d363ac-3ffc-40b3-b7c5-76c051818bf7 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:25.837534 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29d363ac-3ffc-40b3-b7c5-76c051818bf7 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:26.043206 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-18cb8381-e9a8-47c2-88d6-c2648f4640f7 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:26.050265 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-18cb8381-e9a8-47c2-88d6-c2648f4640f7 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: e1cb02b7-1dd6-4c83-9008-e19525731e03] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:26.071278 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-18cb8381-e9a8-47c2-88d6-c2648f4640f7 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:26.072148 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-18cb8381-e9a8-47c2-88d6-c2648f4640f7 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:26.075059 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-18cb8381-e9a8-47c2-88d6-c2648f4640f7 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:26.082158 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-18cb8381-e9a8-47c2-88d6-c2648f4640f7 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:26.083481 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-18cb8381-e9a8-47c2-88d6-c2648f4640f7 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:26.088291 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-18cb8381-e9a8-47c2-88d6-c2648f4640f7 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:26.472613 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-29d363ac-3ffc-40b3-b7c5-76c051818bf7 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:26.492895 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-29d363ac-3ffc-40b3-b7c5-76c051818bf7 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1519 microversion: 2.1 time: 0.674862 Aug 31 16:17:26.502411 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2550/5290] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:25 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1519 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:26.669559 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-fbeaa0f4-42dc-4e3f-b49c-9fba5d5511b9 req-50551abb-4bab-4364-a5af-adf4ff8374f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b051f4f-6b51-4ca7-9afd-6d75682e7f52", "tag": "5c653659-ac4d-41e4-8b0a-b35ade932e62"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:17:26.696494 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-fbeaa0f4-42dc-4e3f-b49c-9fba5d5511b9 req-50551abb-4bab-4364-a5af-adf4ff8374f4 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:26.696972 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-fbeaa0f4-42dc-4e3f-b49c-9fba5d5511b9 req-50551abb-4bab-4364-a5af-adf4ff8374f4 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:26.697615 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-fbeaa0f4-42dc-4e3f-b49c-9fba5d5511b9 req-50551abb-4bab-4364-a5af-adf4ff8374f4 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:26.719636 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-fbeaa0f4-42dc-4e3f-b49c-9fba5d5511b9 req-50551abb-4bab-4364-a5af-adf4ff8374f4 service nova] Creating event network-changed:5c653659-ac4d-41e4-8b0a-b35ade932e62 for instance 4b051f4f-6b51-4ca7-9afd-6d75682e7f52 on n-h1-833090-16 Aug 31 16:17:26.725153 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-fbeaa0f4-42dc-4e3f-b49c-9fba5d5511b9 req-50551abb-4bab-4364-a5af-adf4ff8374f4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059480 Aug 31 16:17:26.726155 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2551/5291] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:17:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:17:26.829990 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-18cb8381-e9a8-47c2-88d6-c2648f4640f7 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:26.866930 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-18cb8381-e9a8-47c2-88d6-c2648f4640f7 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03" status: 200 len: 1689 microversion: 2.1 time: 0.833434 Aug 31 16:17:26.872249 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2741/5292] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:26 2022] GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03 => generated 1689 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:27.529305 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c6367259-5155-4ce5-94e8-7f0d23db5d92 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:27.531022 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c6367259-5155-4ce5-94e8-7f0d23db5d92 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:27.537852 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6367259-5155-4ce5-94e8-7f0d23db5d92 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:27.538689 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6367259-5155-4ce5-94e8-7f0d23db5d92 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:27.539264 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6367259-5155-4ce5-94e8-7f0d23db5d92 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:27.540114 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6367259-5155-4ce5-94e8-7f0d23db5d92 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:27.540842 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6367259-5155-4ce5-94e8-7f0d23db5d92 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:27.541258 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6367259-5155-4ce5-94e8-7f0d23db5d92 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:27.895150 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f0826356-f0e1-4eff-be70-9f3c401c4912 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:27.895852 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f0826356-f0e1-4eff-be70-9f3c401c4912 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: e1cb02b7-1dd6-4c83-9008-e19525731e03] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:27.911881 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f0826356-f0e1-4eff-be70-9f3c401c4912 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:27.912386 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f0826356-f0e1-4eff-be70-9f3c401c4912 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:27.917385 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f0826356-f0e1-4eff-be70-9f3c401c4912 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:27.923739 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f0826356-f0e1-4eff-be70-9f3c401c4912 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:27.924254 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f0826356-f0e1-4eff-be70-9f3c401c4912 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:27.924704 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f0826356-f0e1-4eff-be70-9f3c401c4912 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:28.015467 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c6367259-5155-4ce5-94e8-7f0d23db5d92 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:28.027352 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c6367259-5155-4ce5-94e8-7f0d23db5d92 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1519 microversion: 2.1 time: 0.504655 Aug 31 16:17:28.028046 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2552/5293] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:27 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1519 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:28.372467 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f0826356-f0e1-4eff-be70-9f3c401c4912 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:28.387116 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f0826356-f0e1-4eff-be70-9f3c401c4912 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03" status: 200 len: 1682 microversion: 2.1 time: 0.495012 Aug 31 16:17:28.388417 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2742/5294] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:27 2022] GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03 => generated 1682 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:17:28.845330 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-f8f6ff3a-c936-43bf-b25e-9b4ab7bd9049 req-afa80c4e-15ce-4758-8c47-d92143f21d4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e00e521-84f5-4e7b-8cec-7a4d2e220d28", "tag": "0dc48d8d-77c4-4b8d-9828-06b574dce835"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:17:28.869771 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f8f6ff3a-c936-43bf-b25e-9b4ab7bd9049 req-afa80c4e-15ce-4758-8c47-d92143f21d4f service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:28.870558 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f8f6ff3a-c936-43bf-b25e-9b4ab7bd9049 req-afa80c4e-15ce-4758-8c47-d92143f21d4f service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:28.871343 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f8f6ff3a-c936-43bf-b25e-9b4ab7bd9049 req-afa80c4e-15ce-4758-8c47-d92143f21d4f service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:28.898896 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-f8f6ff3a-c936-43bf-b25e-9b4ab7bd9049 req-afa80c4e-15ce-4758-8c47-d92143f21d4f service nova] Creating event network-changed:0dc48d8d-77c4-4b8d-9828-06b574dce835 for instance 3e00e521-84f5-4e7b-8cec-7a4d2e220d28 on n-h2-833090-16 Aug 31 16:17:28.924023 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-f8f6ff3a-c936-43bf-b25e-9b4ab7bd9049 req-afa80c4e-15ce-4758-8c47-d92143f21d4f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087837 Aug 31 16:17:28.925201 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2553/5295] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:17:29.051603 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0a0a2bfb-1ffa-4e0d-ae30-dcb7b440d8ec tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:29.052424 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0a0a2bfb-1ffa-4e0d-ae30-dcb7b440d8ec tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:29.073743 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0a0a2bfb-1ffa-4e0d-ae30-dcb7b440d8ec tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:29.074289 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0a0a2bfb-1ffa-4e0d-ae30-dcb7b440d8ec tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:29.075544 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0a0a2bfb-1ffa-4e0d-ae30-dcb7b440d8ec tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:29.076360 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0a0a2bfb-1ffa-4e0d-ae30-dcb7b440d8ec tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:29.091524 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0a0a2bfb-1ffa-4e0d-ae30-dcb7b440d8ec tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:29.092230 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0a0a2bfb-1ffa-4e0d-ae30-dcb7b440d8ec tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:29.505414 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0a0a2bfb-1ffa-4e0d-ae30-dcb7b440d8ec tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:29.516938 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0a0a2bfb-1ffa-4e0d-ae30-dcb7b440d8ec tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1519 microversion: 2.1 time: 0.469691 Aug 31 16:17:29.520390 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2743/5296] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:29 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1519 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:30.542727 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-83c10774-3c37-4f77-bd93-2c8c6d7104f8 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:30.544134 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-83c10774-3c37-4f77-bd93-2c8c6d7104f8 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:30.552604 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83c10774-3c37-4f77-bd93-2c8c6d7104f8 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:30.555142 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83c10774-3c37-4f77-bd93-2c8c6d7104f8 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:30.555838 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83c10774-3c37-4f77-bd93-2c8c6d7104f8 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:30.560485 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83c10774-3c37-4f77-bd93-2c8c6d7104f8 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:30.562886 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83c10774-3c37-4f77-bd93-2c8c6d7104f8 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:30.563521 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83c10774-3c37-4f77-bd93-2c8c6d7104f8 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:30.987401 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-a5f21642-86e0-472b-8803-2d3817389c9d req-49b435fa-aee0-4be5-b98d-067cab84d972 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d", "tag": "8e4486a0-b7ef-4efa-8a3b-565a37bae537"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:17:31.023004 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-a5f21642-86e0-472b-8803-2d3817389c9d req-49b435fa-aee0-4be5-b98d-067cab84d972 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:31.031015 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-a5f21642-86e0-472b-8803-2d3817389c9d req-49b435fa-aee0-4be5-b98d-067cab84d972 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:31.031686 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-a5f21642-86e0-472b-8803-2d3817389c9d req-49b435fa-aee0-4be5-b98d-067cab84d972 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:31.073295 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-a5f21642-86e0-472b-8803-2d3817389c9d req-49b435fa-aee0-4be5-b98d-067cab84d972 service nova] Creating event network-changed:8e4486a0-b7ef-4efa-8a3b-565a37bae537 for instance 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d on n-h1-833090-16 Aug 31 16:17:31.087844 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-a5f21642-86e0-472b-8803-2d3817389c9d req-49b435fa-aee0-4be5-b98d-067cab84d972 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109896 Aug 31 16:17:31.088985 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2744/5297] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:17:31.274791 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-83c10774-3c37-4f77-bd93-2c8c6d7104f8 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:31.294816 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-83c10774-3c37-4f77-bd93-2c8c6d7104f8 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1519 microversion: 2.1 time: 0.756218 Aug 31 16:17:31.295514 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2554/5298] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:30 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1519 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:32.326240 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-987eae10-3691-48f6-b4a7-8aceca03d198 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:32.328910 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-987eae10-3691-48f6-b4a7-8aceca03d198 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:32.370035 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=80 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:17:32.376781 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-987eae10-3691-48f6-b4a7-8aceca03d198 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:32.383756 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-987eae10-3691-48f6-b4a7-8aceca03d198 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:32.384995 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-987eae10-3691-48f6-b4a7-8aceca03d198 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:32.386634 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-987eae10-3691-48f6-b4a7-8aceca03d198 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:32.387675 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-987eae10-3691-48f6-b4a7-8aceca03d198 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:32.389006 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-987eae10-3691-48f6-b4a7-8aceca03d198 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:32.486505 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ad048327-dffa-40a0-9c58-e7dc2cdf4bbc tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:32.551091 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ad048327-dffa-40a0-9c58-e7dc2cdf4bbc tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6318cd386150452f9efb44ce374d6a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7a87c31955434abae235e438ee3683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:32.555354 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ad048327-dffa-40a0-9c58-e7dc2cdf4bbc tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Searching by: {'deleted': False, 'project_id': '8c7a87c31955434abae235e438ee3683'} {{(pid=128863) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:17:32.614770 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ad048327-dffa-40a0-9c58-e7dc2cdf4bbc tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:32.615595 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ad048327-dffa-40a0-9c58-e7dc2cdf4bbc tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:32.616214 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ad048327-dffa-40a0-9c58-e7dc2cdf4bbc tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:32.626744 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ad048327-dffa-40a0-9c58-e7dc2cdf4bbc tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:32.628444 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ad048327-dffa-40a0-9c58-e7dc2cdf4bbc tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:32.630501 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ad048327-dffa-40a0-9c58-e7dc2cdf4bbc tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:32.717491 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.multi_cell_list [None req-ad048327-dffa-40a0-9c58-e7dc2cdf4bbc tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128863) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:17:32.804557 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ad048327-dffa-40a0-9c58-e7dc2cdf4bbc tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.330720 Aug 31 16:17:32.807844 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2555/5299] 10.222.0.50 () {58 vars in 1125 bytes} [Wed Aug 31 16:17:32 2022] GET /compute/v2.1/servers => generated 334 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:17:32.819742 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7fb293b4-61b7-4141-b47f-41705574eb66 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:32.838235 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7fb293b4-61b7-4141-b47f-41705574eb66 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6318cd386150452f9efb44ce374d6a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7a87c31955434abae235e438ee3683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:32.839030 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7fb293b4-61b7-4141-b47f-41705574eb66 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Searching by: {'deleted': False, 'project_id': '8c7a87c31955434abae235e438ee3683'} {{(pid=128863) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:17:32.858858 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fb293b4-61b7-4141-b47f-41705574eb66 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:32.860630 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fb293b4-61b7-4141-b47f-41705574eb66 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:32.861726 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fb293b4-61b7-4141-b47f-41705574eb66 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:32.863570 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fb293b4-61b7-4141-b47f-41705574eb66 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:32.864942 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fb293b4-61b7-4141-b47f-41705574eb66 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:32.866966 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fb293b4-61b7-4141-b47f-41705574eb66 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:32.938495 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.multi_cell_list [None req-7fb293b4-61b7-4141-b47f-41705574eb66 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128863) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:17:33.070793 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7fb293b4-61b7-4141-b47f-41705574eb66 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6318cd386150452f9efb44ce374d6a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7a87c31955434abae235e438ee3683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:33.098081 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fb293b4-61b7-4141-b47f-41705574eb66 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:33.098556 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fb293b4-61b7-4141-b47f-41705574eb66 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:33.099009 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fb293b4-61b7-4141-b47f-41705574eb66 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:34.242408 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-987eae10-3691-48f6-b4a7-8aceca03d198 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:34.255696 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-987eae10-3691-48f6-b4a7-8aceca03d198 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1519 microversion: 2.1 time: 1.940673 Aug 31 16:17:34.283926 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2745/5300] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:32 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1519 bytes in 1959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:34.299589 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-761e7525-a53c-4958-a751-c80f11e1a64e req-9ad73f87-8bd6-49e2-9e61-a6f54b3bf634 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1cb02b7-1dd6-4c83-9008-e19525731e03", "name": "network-vif-plugged", "status": "completed", "tag": "aad14830-ef68-4e56-bff4-91dbcf99efc3"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:17:34.341913 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-761e7525-a53c-4958-a751-c80f11e1a64e req-9ad73f87-8bd6-49e2-9e61-a6f54b3bf634 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:34.342542 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-761e7525-a53c-4958-a751-c80f11e1a64e req-9ad73f87-8bd6-49e2-9e61-a6f54b3bf634 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:34.342867 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-761e7525-a53c-4958-a751-c80f11e1a64e req-9ad73f87-8bd6-49e2-9e61-a6f54b3bf634 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:34.358969 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-761e7525-a53c-4958-a751-c80f11e1a64e req-9ad73f87-8bd6-49e2-9e61-a6f54b3bf634 service nova] Creating event network-vif-plugged:aad14830-ef68-4e56-bff4-91dbcf99efc3 for instance e1cb02b7-1dd6-4c83-9008-e19525731e03 on n-h2-833090-16 Aug 31 16:17:34.386418 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-761e7525-a53c-4958-a751-c80f11e1a64e req-9ad73f87-8bd6-49e2-9e61-a6f54b3bf634 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095821 Aug 31 16:17:34.391141 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2746/5301] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:17:34.670350 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7fb293b4-61b7-4141-b47f-41705574eb66 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] 10.222.0.50 "GET /compute/v2.1/servers/detail" status: 200 len: 1698 microversion: 2.1 time: 1.853651 Aug 31 16:17:34.670350 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2556/5302] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 31 16:17:32 2022] GET /compute/v2.1/servers/detail => generated 1698 bytes in 1856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:17:34.702712 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9cb3968e-df1b-4ab5-9b74-99cc33eed591 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:34.732487 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9cb3968e-df1b-4ab5-9b74-99cc33eed591 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.039920 Aug 31 16:17:34.733605 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2747/5303] 10.222.0.50 () {58 vars in 1137 bytes} [Wed Aug 31 16:17:34 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:17:35.080103 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-585a092e-327c-4e00-aa49-b710c2e24abb tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:35.080865 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-585a092e-327c-4e00-aa49-b710c2e24abb tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] [instance: d4b3c604-165a-4ffe-935f-0b55a527fad7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:35.112418 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-585a092e-327c-4e00-aa49-b710c2e24abb tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:35.113245 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-585a092e-327c-4e00-aa49-b710c2e24abb tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:35.113744 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-585a092e-327c-4e00-aa49-b710c2e24abb tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:35.116734 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-585a092e-327c-4e00-aa49-b710c2e24abb tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:35.117300 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-585a092e-327c-4e00-aa49-b710c2e24abb tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:35.117996 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-585a092e-327c-4e00-aa49-b710c2e24abb tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:35.222523 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-585a092e-327c-4e00-aa49-b710c2e24abb tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] [instance: d4b3c604-165a-4ffe-935f-0b55a527fad7] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:17:35.293680 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4ce57591-617f-45db-8ef4-fb1f7d140d6b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:35.295357 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4ce57591-617f-45db-8ef4-fb1f7d140d6b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:35.307214 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4ce57591-617f-45db-8ef4-fb1f7d140d6b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:35.308346 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4ce57591-617f-45db-8ef4-fb1f7d140d6b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:35.309251 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4ce57591-617f-45db-8ef4-fb1f7d140d6b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:35.311246 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4ce57591-617f-45db-8ef4-fb1f7d140d6b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:35.312150 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4ce57591-617f-45db-8ef4-fb1f7d140d6b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:35.312945 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4ce57591-617f-45db-8ef4-fb1f7d140d6b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:35.480355 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-585a092e-327c-4e00-aa49-b710c2e24abb tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d4b3c604-165a-4ffe-935f-0b55a527fad7" status: 204 len: 0 microversion: 2.1 time: 0.414042 Aug 31 16:17:35.484551 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2557/5304] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:17:35 2022] DELETE /compute/v2.1/servers/d4b3c604-165a-4ffe-935f-0b55a527fad7 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:17:35.492229 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-208be5b5-c849-4308-9daa-138bb213eb82 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:35.493136 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-208be5b5-c849-4308-9daa-138bb213eb82 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] [instance: d4b3c604-165a-4ffe-935f-0b55a527fad7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:35.499836 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-208be5b5-c849-4308-9daa-138bb213eb82 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:35.500571 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-208be5b5-c849-4308-9daa-138bb213eb82 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:35.501143 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-208be5b5-c849-4308-9daa-138bb213eb82 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:35.502158 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-208be5b5-c849-4308-9daa-138bb213eb82 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:35.502775 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-208be5b5-c849-4308-9daa-138bb213eb82 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:35.503334 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-208be5b5-c849-4308-9daa-138bb213eb82 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:35.931635 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4ce57591-617f-45db-8ef4-fb1f7d140d6b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:35.940702 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4ce57591-617f-45db-8ef4-fb1f7d140d6b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1519 microversion: 2.1 time: 0.652760 Aug 31 16:17:35.941957 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2748/5305] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:35 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1519 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:35.980276 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-208be5b5-c849-4308-9daa-138bb213eb82 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6318cd386150452f9efb44ce374d6a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7a87c31955434abae235e438ee3683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:35.993201 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-208be5b5-c849-4308-9daa-138bb213eb82 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] 10.222.0.50 "GET /compute/v2.1/servers/d4b3c604-165a-4ffe-935f-0b55a527fad7" status: 200 len: 1701 microversion: 2.1 time: 0.504495 Aug 31 16:17:35.994006 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2558/5306] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:35 2022] GET /compute/v2.1/servers/d4b3c604-165a-4ffe-935f-0b55a527fad7 => generated 1701 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:36.964098 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ba995bb0-bb16-404a-9bc7-a40171638f5b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:36.965585 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ba995bb0-bb16-404a-9bc7-a40171638f5b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:36.977428 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ba995bb0-bb16-404a-9bc7-a40171638f5b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:36.984057 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ba995bb0-bb16-404a-9bc7-a40171638f5b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:36.985719 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ba995bb0-bb16-404a-9bc7-a40171638f5b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:36.987340 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ba995bb0-bb16-404a-9bc7-a40171638f5b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:36.989319 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ba995bb0-bb16-404a-9bc7-a40171638f5b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:36.990697 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ba995bb0-bb16-404a-9bc7-a40171638f5b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:37.017422 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-87b0afd7-ef0c-418a-adb5-0fcb3d64e2c4 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:37.018047 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-87b0afd7-ef0c-418a-adb5-0fcb3d64e2c4 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] [instance: d4b3c604-165a-4ffe-935f-0b55a527fad7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:37.028623 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-87b0afd7-ef0c-418a-adb5-0fcb3d64e2c4 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:37.029121 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-87b0afd7-ef0c-418a-adb5-0fcb3d64e2c4 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:37.029560 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-87b0afd7-ef0c-418a-adb5-0fcb3d64e2c4 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:37.039420 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-87b0afd7-ef0c-418a-adb5-0fcb3d64e2c4 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:37.039944 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-87b0afd7-ef0c-418a-adb5-0fcb3d64e2c4 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:37.040405 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-87b0afd7-ef0c-418a-adb5-0fcb3d64e2c4 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:37.051757 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=100 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:17:37.702564 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-87b0afd7-ef0c-418a-adb5-0fcb3d64e2c4 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6318cd386150452f9efb44ce374d6a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7a87c31955434abae235e438ee3683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:37.712194 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-87b0afd7-ef0c-418a-adb5-0fcb3d64e2c4 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] 10.222.0.50 "GET /compute/v2.1/servers/d4b3c604-165a-4ffe-935f-0b55a527fad7" status: 200 len: 1701 microversion: 2.1 time: 0.699253 Aug 31 16:17:37.728300 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2559/5307] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:37 2022] GET /compute/v2.1/servers/d4b3c604-165a-4ffe-935f-0b55a527fad7 => generated 1701 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:17:37.783428 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ba995bb0-bb16-404a-9bc7-a40171638f5b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:37.793711 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ba995bb0-bb16-404a-9bc7-a40171638f5b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1519 microversion: 2.1 time: 0.834457 Aug 31 16:17:37.794344 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2749/5308] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:36 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1519 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:38.737085 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dab47869-8ec3-48a4-a173-884ace823de4 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:38.737702 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dab47869-8ec3-48a4-a173-884ace823de4 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] [instance: d4b3c604-165a-4ffe-935f-0b55a527fad7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:38.747386 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dab47869-8ec3-48a4-a173-884ace823de4 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:38.747838 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dab47869-8ec3-48a4-a173-884ace823de4 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:38.748298 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dab47869-8ec3-48a4-a173-884ace823de4 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:38.755191 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dab47869-8ec3-48a4-a173-884ace823de4 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:38.756425 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dab47869-8ec3-48a4-a173-884ace823de4 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:38.756975 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dab47869-8ec3-48a4-a173-884ace823de4 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:38.765620 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:17:38.816914 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8c78af1f-b8e9-42da-9188-3f77cce4faff tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:38.818246 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8c78af1f-b8e9-42da-9188-3f77cce4faff tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:38.832207 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8c78af1f-b8e9-42da-9188-3f77cce4faff tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:38.835495 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8c78af1f-b8e9-42da-9188-3f77cce4faff tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:38.836230 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8c78af1f-b8e9-42da-9188-3f77cce4faff tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:38.837200 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8c78af1f-b8e9-42da-9188-3f77cce4faff tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:38.837912 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8c78af1f-b8e9-42da-9188-3f77cce4faff tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:38.839121 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8c78af1f-b8e9-42da-9188-3f77cce4faff tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:39.172726 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8c78af1f-b8e9-42da-9188-3f77cce4faff tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:39.184187 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8c78af1f-b8e9-42da-9188-3f77cce4faff tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1519 microversion: 2.1 time: 0.371707 Aug 31 16:17:39.198253 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2750/5309] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:38 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1519 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:17:39.206314 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dab47869-8ec3-48a4-a173-884ace823de4 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6318cd386150452f9efb44ce374d6a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7a87c31955434abae235e438ee3683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:39.227376 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dab47869-8ec3-48a4-a173-884ace823de4 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] 10.222.0.50 "GET /compute/v2.1/servers/d4b3c604-165a-4ffe-935f-0b55a527fad7" status: 200 len: 1701 microversion: 2.1 time: 0.496442 Aug 31 16:17:39.227970 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2560/5310] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:38 2022] GET /compute/v2.1/servers/d4b3c604-165a-4ffe-935f-0b55a527fad7 => generated 1701 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:40.206020 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5206368d-a9fc-46be-939b-2e065b7fbe08 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:40.209087 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5206368d-a9fc-46be-939b-2e065b7fbe08 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:40.216401 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5206368d-a9fc-46be-939b-2e065b7fbe08 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:40.217176 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5206368d-a9fc-46be-939b-2e065b7fbe08 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:40.217781 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5206368d-a9fc-46be-939b-2e065b7fbe08 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:40.219108 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5206368d-a9fc-46be-939b-2e065b7fbe08 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:40.219729 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5206368d-a9fc-46be-939b-2e065b7fbe08 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:40.220314 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5206368d-a9fc-46be-939b-2e065b7fbe08 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:40.249015 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b84dd178-8529-475b-b517-9cce218c3b5b tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:40.249687 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b84dd178-8529-475b-b517-9cce218c3b5b tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] [instance: d4b3c604-165a-4ffe-935f-0b55a527fad7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:40.263171 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b84dd178-8529-475b-b517-9cce218c3b5b tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:40.263966 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b84dd178-8529-475b-b517-9cce218c3b5b tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:40.267940 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b84dd178-8529-475b-b517-9cce218c3b5b tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:40.269029 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b84dd178-8529-475b-b517-9cce218c3b5b tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:40.269665 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b84dd178-8529-475b-b517-9cce218c3b5b tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:40.270290 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b84dd178-8529-475b-b517-9cce218c3b5b tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:41.141158 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b84dd178-8529-475b-b517-9cce218c3b5b tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6318cd386150452f9efb44ce374d6a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7a87c31955434abae235e438ee3683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:41.147968 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5206368d-a9fc-46be-939b-2e065b7fbe08 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:41.150151 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b84dd178-8529-475b-b517-9cce218c3b5b tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] 10.222.0.50 "GET /compute/v2.1/servers/d4b3c604-165a-4ffe-935f-0b55a527fad7" status: 200 len: 1701 microversion: 2.1 time: 0.905270 Aug 31 16:17:41.156835 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5206368d-a9fc-46be-939b-2e065b7fbe08 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1519 microversion: 2.1 time: 0.954600 Aug 31 16:17:41.162667 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2561/5311] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:40 2022] GET /compute/v2.1/servers/d4b3c604-165a-4ffe-935f-0b55a527fad7 => generated 1701 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:17:41.169174 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-ca9b135d-4c6c-4113-ad99-5e68a680de01 req-bdeacbf7-13dd-4d7f-889f-dff2acc5618e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4b3c604-165a-4ffe-935f-0b55a527fad7", "name": "network-vif-unplugged", "status": "completed", "tag": "a26cfb24-b803-430f-a60a-4b56e2c2b475"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:17:41.175359 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2751/5312] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:40 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1519 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:41.179386 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ca9b135d-4c6c-4113-ad99-5e68a680de01 req-bdeacbf7-13dd-4d7f-889f-dff2acc5618e service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:41.179905 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ca9b135d-4c6c-4113-ad99-5e68a680de01 req-bdeacbf7-13dd-4d7f-889f-dff2acc5618e service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:41.180317 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ca9b135d-4c6c-4113-ad99-5e68a680de01 req-bdeacbf7-13dd-4d7f-889f-dff2acc5618e service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:41.192440 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-ca9b135d-4c6c-4113-ad99-5e68a680de01 req-bdeacbf7-13dd-4d7f-889f-dff2acc5618e service nova] Creating event network-vif-unplugged:a26cfb24-b803-430f-a60a-4b56e2c2b475 for instance d4b3c604-165a-4ffe-935f-0b55a527fad7 on n-h1-833090-16 Aug 31 16:17:41.197567 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-ca9b135d-4c6c-4113-ad99-5e68a680de01 req-bdeacbf7-13dd-4d7f-889f-dff2acc5618e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033403 Aug 31 16:17:41.198210 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2562/5313] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:17:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:17:42.177011 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4be82fbf-b0f5-4550-9c6c-9e86893452fc tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:42.183740 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fbb88955-b806-4c38-9b7d-28052ce6c725 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:42.184772 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4be82fbf-b0f5-4550-9c6c-9e86893452fc tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] [instance: d4b3c604-165a-4ffe-935f-0b55a527fad7] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:42.189097 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fbb88955-b806-4c38-9b7d-28052ce6c725 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:42.195661 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4be82fbf-b0f5-4550-9c6c-9e86893452fc tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:42.199658 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbb88955-b806-4c38-9b7d-28052ce6c725 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:42.200381 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4be82fbf-b0f5-4550-9c6c-9e86893452fc tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:42.200943 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbb88955-b806-4c38-9b7d-28052ce6c725 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:42.201489 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4be82fbf-b0f5-4550-9c6c-9e86893452fc tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:42.202028 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbb88955-b806-4c38-9b7d-28052ce6c725 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:42.202880 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4be82fbf-b0f5-4550-9c6c-9e86893452fc tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:42.203707 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbb88955-b806-4c38-9b7d-28052ce6c725 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:42.204244 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4be82fbf-b0f5-4550-9c6c-9e86893452fc tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:42.204884 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbb88955-b806-4c38-9b7d-28052ce6c725 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:42.205488 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4be82fbf-b0f5-4550-9c6c-9e86893452fc tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:42.205960 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fbb88955-b806-4c38-9b7d-28052ce6c725 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:42.607688 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4be82fbf-b0f5-4550-9c6c-9e86893452fc tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6318cd386150452f9efb44ce374d6a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7a87c31955434abae235e438ee3683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:42.615708 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fbb88955-b806-4c38-9b7d-28052ce6c725 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:42.626569 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fbb88955-b806-4c38-9b7d-28052ce6c725 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1519 microversion: 2.1 time: 0.447702 Aug 31 16:17:42.640881 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4be82fbf-b0f5-4550-9c6c-9e86893452fc tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] 10.222.0.50 "GET /compute/v2.1/servers/d4b3c604-165a-4ffe-935f-0b55a527fad7" status: 200 len: 1701 microversion: 2.1 time: 0.460507 Aug 31 16:17:42.641990 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2563/5314] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:42 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1519 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:42.648813 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2752/5315] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:42 2022] GET /compute/v2.1/servers/d4b3c604-165a-4ffe-935f-0b55a527fad7 => generated 1701 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:43.157371 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-d4d8cd99-9413-4aee-ba6d-586c837f8c23 req-938d1e7a-259d-47a0-b934-c434b5146b14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4b3c604-165a-4ffe-935f-0b55a527fad7", "name": "network-vif-deleted", "tag": "a26cfb24-b803-430f-a60a-4b56e2c2b475"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:17:43.162428 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:17:43.163124 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:17:43.176032 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d4d8cd99-9413-4aee-ba6d-586c837f8c23 req-938d1e7a-259d-47a0-b934-c434b5146b14 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:43.176728 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d4d8cd99-9413-4aee-ba6d-586c837f8c23 req-938d1e7a-259d-47a0-b934-c434b5146b14 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:43.177319 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d4d8cd99-9413-4aee-ba6d-586c837f8c23 req-938d1e7a-259d-47a0-b934-c434b5146b14 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:43.193175 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-d4d8cd99-9413-4aee-ba6d-586c837f8c23 req-938d1e7a-259d-47a0-b934-c434b5146b14 service nova] Creating event network-vif-deleted:a26cfb24-b803-430f-a60a-4b56e2c2b475 for instance d4b3c604-165a-4ffe-935f-0b55a527fad7 on n-h1-833090-16 Aug 31 16:17:43.200132 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-d4d8cd99-9413-4aee-ba6d-586c837f8c23 req-938d1e7a-259d-47a0-b934-c434b5146b14 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046382 Aug 31 16:17:43.201327 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2564/5316] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:17:43.648536 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-70afdc0c-62aa-40b1-8c99-10cf9377cb3e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:43.650698 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-70afdc0c-62aa-40b1-8c99-10cf9377cb3e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:43.656654 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ee283e2a-84e7-4de5-b1fd-1bb8c74d0d86 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:43.657737 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ee283e2a-84e7-4de5-b1fd-1bb8c74d0d86 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] [instance: d4b3c604-165a-4ffe-935f-0b55a527fad7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:43.674722 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-70afdc0c-62aa-40b1-8c99-10cf9377cb3e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:43.675707 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee283e2a-84e7-4de5-b1fd-1bb8c74d0d86 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:43.676410 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee283e2a-84e7-4de5-b1fd-1bb8c74d0d86 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:43.677150 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-70afdc0c-62aa-40b1-8c99-10cf9377cb3e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:43.678477 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee283e2a-84e7-4de5-b1fd-1bb8c74d0d86 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:43.680057 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee283e2a-84e7-4de5-b1fd-1bb8c74d0d86 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:43.680379 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-70afdc0c-62aa-40b1-8c99-10cf9377cb3e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:43.681386 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-70afdc0c-62aa-40b1-8c99-10cf9377cb3e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:43.681981 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee283e2a-84e7-4de5-b1fd-1bb8c74d0d86 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:43.682611 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-70afdc0c-62aa-40b1-8c99-10cf9377cb3e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:43.683281 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee283e2a-84e7-4de5-b1fd-1bb8c74d0d86 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:43.684016 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-70afdc0c-62aa-40b1-8c99-10cf9377cb3e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:43.739114 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee283e2a-84e7-4de5-b1fd-1bb8c74d0d86 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:43.739743 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee283e2a-84e7-4de5-b1fd-1bb8c74d0d86 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:43.740387 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee283e2a-84e7-4de5-b1fd-1bb8c74d0d86 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:43.741007 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-ee283e2a-84e7-4de5-b1fd-1bb8c74d0d86 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lazy-loading 'fault' on Instance uuid d4b3c604-165a-4ffe-935f-0b55a527fad7 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:17:43.842621 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ee283e2a-84e7-4de5-b1fd-1bb8c74d0d86 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6318cd386150452f9efb44ce374d6a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c7a87c31955434abae235e438ee3683', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:43.855903 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ee283e2a-84e7-4de5-b1fd-1bb8c74d0d86 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] 10.222.0.50 "GET /compute/v2.1/servers/d4b3c604-165a-4ffe-935f-0b55a527fad7" status: 200 len: 1360 microversion: 2.1 time: 0.203839 Aug 31 16:17:43.858738 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2565/5317] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:43 2022] GET /compute/v2.1/servers/d4b3c604-165a-4ffe-935f-0b55a527fad7 => generated 1360 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:43.948960 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-70afdc0c-62aa-40b1-8c99-10cf9377cb3e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:43.958378 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-70afdc0c-62aa-40b1-8c99-10cf9377cb3e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1519 microversion: 2.1 time: 0.314077 Aug 31 16:17:43.959222 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2753/5318] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:43 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1519 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:44.681687 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-78d49990-4aa5-4b1d-bff0-2e204b7dc07a req-5540acb3-3ebd-4219-b532-0523a09c3a0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b051f4f-6b51-4ca7-9afd-6d75682e7f52", "name": "network-vif-plugged", "status": "completed", "tag": "5c653659-ac4d-41e4-8b0a-b35ade932e62"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:17:44.700839 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-78d49990-4aa5-4b1d-bff0-2e204b7dc07a req-5540acb3-3ebd-4219-b532-0523a09c3a0f service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:44.701318 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-78d49990-4aa5-4b1d-bff0-2e204b7dc07a req-5540acb3-3ebd-4219-b532-0523a09c3a0f service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:44.704938 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-78d49990-4aa5-4b1d-bff0-2e204b7dc07a req-5540acb3-3ebd-4219-b532-0523a09c3a0f service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:44.740030 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-78d49990-4aa5-4b1d-bff0-2e204b7dc07a req-5540acb3-3ebd-4219-b532-0523a09c3a0f service nova] Creating event network-vif-plugged:5c653659-ac4d-41e4-8b0a-b35ade932e62 for instance 4b051f4f-6b51-4ca7-9afd-6d75682e7f52 on n-h1-833090-16 Aug 31 16:17:44.746300 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-78d49990-4aa5-4b1d-bff0-2e204b7dc07a req-5540acb3-3ebd-4219-b532-0523a09c3a0f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068315 Aug 31 16:17:44.747534 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2566/5319] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:17:44.879618 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-540cfd5f-8917-4579-a455-78a086ff63d8 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:44.880847 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-540cfd5f-8917-4579-a455-78a086ff63d8 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] [instance: d4b3c604-165a-4ffe-935f-0b55a527fad7] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:44.893459 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-540cfd5f-8917-4579-a455-78a086ff63d8 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:44.894396 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-540cfd5f-8917-4579-a455-78a086ff63d8 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:44.895063 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-540cfd5f-8917-4579-a455-78a086ff63d8 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:44.896004 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-540cfd5f-8917-4579-a455-78a086ff63d8 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:44.896658 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-540cfd5f-8917-4579-a455-78a086ff63d8 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:44.897275 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-540cfd5f-8917-4579-a455-78a086ff63d8 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:44.932168 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-540cfd5f-8917-4579-a455-78a086ff63d8 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] HTTP exception thrown: Instance d4b3c604-165a-4ffe-935f-0b55a527fad7 could not be found. Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-540cfd5f-8917-4579-a455-78a086ff63d8 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Request method failure captured: Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/d4b3c604-165a-4ffe-935f-0b55a527fad7 HTTP/1.1 Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4leK1cCig5XMzG-LT-w3s92Z7RCNjhqRfc_d4lOh0JT2PQpIeFglbJgItIHSamMtklq0KX_hlJBCwIYDHE-0YnQwlr966jKZeSl6yXtKK8S2vb1oN-So5Cwcg3kPE_mO69IccH0daZPk36tBqcwSsAxry8hQZopNpVdnNzXFDxMx0Y Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 8c7a87c31955434abae235e438ee3683 Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServersTestJSON-1572161192 Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8c7a87c31955434abae235e438ee3683"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8c7a87c31955434abae235e438ee3683"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8c7a87c31955434abae235e438ee3683"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8c7a87c31955434abae235e438ee3683", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServersTestJSON-1572161192 Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 8c7a87c31955434abae235e438ee3683 Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServersTestJSON-1572161192 Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServersTestJSON-1572161192-project Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 6318cd386150452f9efb44ce374d6a88 Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServersTestJSON-1572161192-project Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance d4b3c604-165a-4ffe-935f-0b55a527fad7 could not be found. Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'd4b3c604-165a-4ffe-935f-0b55a527fad7'} Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4b3c604-165a-4ffe-935f-0b55a527fad7 could not be found. Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4b3c604-165a-4ffe-935f-0b55a527fad7 could not be found. Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:17:44.933995 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:17:44.938010 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:17:44.938010 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:17:44.938010 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:17:44.938010 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:17:44.938010 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:17:44.938010 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4b3c604-165a-4ffe-935f-0b55a527fad7 could not be found. Aug 31 16:17:44.938010 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:17:44.940193 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-540cfd5f-8917-4579-a455-78a086ff63d8 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Returning 404 to user: Instance d4b3c604-165a-4ffe-935f-0b55a527fad7 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:17:44.941163 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-540cfd5f-8917-4579-a455-78a086ff63d8 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] 10.222.0.50 "GET /compute/v2.1/servers/d4b3c604-165a-4ffe-935f-0b55a527fad7" status: 404 len: 111 microversion: 2.1 time: 0.065997 Aug 31 16:17:44.941761 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2754/5320] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:44 2022] GET /compute/v2.1/servers/d4b3c604-165a-4ffe-935f-0b55a527fad7 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:17:44.952143 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-aafbbc2f-1276-4310-b414-c918d0ca6c76 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] Calling method '.version_select at 0x7fbb45997430>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:44.962366 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:17:44.981272 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1ff115fb-fc63-4bba-bd77-d88ff0764577 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:44.981892 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1ff115fb-fc63-4bba-bd77-d88ff0764577 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:44.997663 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1ff115fb-fc63-4bba-bd77-d88ff0764577 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:44.998215 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1ff115fb-fc63-4bba-bd77-d88ff0764577 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:44.998717 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1ff115fb-fc63-4bba-bd77-d88ff0764577 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:44.999445 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1ff115fb-fc63-4bba-bd77-d88ff0764577 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:45.000194 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1ff115fb-fc63-4bba-bd77-d88ff0764577 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:45.000629 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1ff115fb-fc63-4bba-bd77-d88ff0764577 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:45.003729 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-aafbbc2f-1276-4310-b414-c918d0ca6c76 tempest-ServersTestJSON-1572161192 tempest-ServersTestJSON-1572161192-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1366133600" status: 202 len: 0 microversion: 2.1 time: 0.057281 Aug 31 16:17:45.004328 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2567/5321] 10.222.0.50 () {58 vars in 1221 bytes} [Wed Aug 31 16:17:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1366133600 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:17:45.530060 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1ff115fb-fc63-4bba-bd77-d88ff0764577 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:45.540528 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1ff115fb-fc63-4bba-bd77-d88ff0764577 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1519 microversion: 2.1 time: 0.563478 Aug 31 16:17:45.541103 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2755/5322] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:44 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1519 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:46.565933 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3b641535-7f54-4a28-8687-f29a20e68983 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:46.572425 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3b641535-7f54-4a28-8687-f29a20e68983 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:46.590819 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b641535-7f54-4a28-8687-f29a20e68983 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:46.591500 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b641535-7f54-4a28-8687-f29a20e68983 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:46.592073 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b641535-7f54-4a28-8687-f29a20e68983 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:46.593318 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b641535-7f54-4a28-8687-f29a20e68983 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:46.593906 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b641535-7f54-4a28-8687-f29a20e68983 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:46.594489 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3b641535-7f54-4a28-8687-f29a20e68983 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:46.804235 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3b641535-7f54-4a28-8687-f29a20e68983 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:46.814514 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3b641535-7f54-4a28-8687-f29a20e68983 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1519 microversion: 2.1 time: 0.255665 Aug 31 16:17:46.815899 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2568/5323] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:46 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1519 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:47.837214 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-85e2350f-f3a4-48d3-af83-fed548b08be7 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:47.838924 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-85e2350f-f3a4-48d3-af83-fed548b08be7 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:47.848137 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85e2350f-f3a4-48d3-af83-fed548b08be7 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:47.849070 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85e2350f-f3a4-48d3-af83-fed548b08be7 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:47.849784 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85e2350f-f3a4-48d3-af83-fed548b08be7 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:47.850703 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85e2350f-f3a4-48d3-af83-fed548b08be7 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:47.851339 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85e2350f-f3a4-48d3-af83-fed548b08be7 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:47.851910 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85e2350f-f3a4-48d3-af83-fed548b08be7 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:48.179111 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-85e2350f-f3a4-48d3-af83-fed548b08be7 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:48.187686 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-85e2350f-f3a4-48d3-af83-fed548b08be7 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.355344 Aug 31 16:17:48.188261 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2756/5324] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:47 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:48.209858 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b5b0da65-a219-4751-be67-98dac369dd4e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:48.210738 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b5b0da65-a219-4751-be67-98dac369dd4e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:48.219114 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5b0da65-a219-4751-be67-98dac369dd4e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:48.219607 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5b0da65-a219-4751-be67-98dac369dd4e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:48.220041 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5b0da65-a219-4751-be67-98dac369dd4e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:48.220731 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5b0da65-a219-4751-be67-98dac369dd4e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:48.221380 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5b0da65-a219-4751-be67-98dac369dd4e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:48.221802 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5b0da65-a219-4751-be67-98dac369dd4e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:48.541836 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b5b0da65-a219-4751-be67-98dac369dd4e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:48.570935 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b5b0da65-a219-4751-be67-98dac369dd4e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.364900 Aug 31 16:17:48.591240 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2569/5325] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:48 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:48.624866 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f667c78b-a61b-408c-9580-08586203d39a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:48.626377 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f667c78b-a61b-408c-9580-08586203d39a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:48.639592 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f667c78b-a61b-408c-9580-08586203d39a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:48.640999 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f667c78b-a61b-408c-9580-08586203d39a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:48.641975 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f667c78b-a61b-408c-9580-08586203d39a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:48.643532 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f667c78b-a61b-408c-9580-08586203d39a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:48.644960 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f667c78b-a61b-408c-9580-08586203d39a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:48.646032 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f667c78b-a61b-408c-9580-08586203d39a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:48.959951 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f667c78b-a61b-408c-9580-08586203d39a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:48.985086 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f667c78b-a61b-408c-9580-08586203d39a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.369034 Aug 31 16:17:48.987407 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2757/5326] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:48 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:49.028775 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0d81fdac-a516-4f42-97da-a9f2520eb556 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:17:49.050069 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-0d81fdac-a516-4f42-97da-a9f2520eb556 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] HTTP exception thrown: Instance e8fceada-b6ec-4cc8-aaec-cb7f9d209412 has no mapping to a cell. Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0d81fdac-a516-4f42-97da-a9f2520eb556 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Request method failure captured: Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers/e8fceada-b6ec-4cc8-aaec-cb7f9d209412/action HTTP/1.1 Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 15 Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4kQ0XzwgZzM00K2xfqw4sNWznetRNwtM61dwPFzPgxHVwt6ZQqeyy0IDwJXT8yOdP4-2pSJFf0sLdbRTKSty95v4MPjLoaaRhSqpDob3UUxppJFVkB8ZQH-IsYhc50JLxuO54hEVWRh4jtxjaTwZZjw98G6FCIkizac62ua4tSQ6_s Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3e843f3122c14cf8889f26423552792f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3e843f3122c14cf8889f26423552792f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 8b67be53aade4f8c92d6765dd91a4b90 Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: {"os-stop": {}} Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance e8fceada-b6ec-4cc8-aaec-cb7f9d209412 has no mapping to a cell. Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'e8fceada-b6ec-4cc8-aaec-cb7f9d209412', 'body': {'os-stop': {}}} Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance e8fceada-b6ec-4cc8-aaec-cb7f9d209412 has no mapping to a cell. Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:17:49.070855 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8fceada-b6ec-4cc8-aaec-cb7f9d209412 has no mapping to a cell. Aug 31 16:17:49.075652 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:17:49.075652 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:17:49.075652 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:17:49.075652 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:17:49.075652 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:17:49.075652 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:17:49.075652 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:17:49.075652 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:17:49.075652 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8fceada-b6ec-4cc8-aaec-cb7f9d209412 has no mapping to a cell. Aug 31 16:17:49.075652 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:17:49.086441 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0d81fdac-a516-4f42-97da-a9f2520eb556 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Returning 404 to user: Instance e8fceada-b6ec-4cc8-aaec-cb7f9d209412 has no mapping to a cell. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:17:49.088071 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0d81fdac-a516-4f42-97da-a9f2520eb556 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "POST /compute/v2.1/servers/e8fceada-b6ec-4cc8-aaec-cb7f9d209412/action" status: 404 len: 117 microversion: 2.1 time: 0.068878 Aug 31 16:17:49.088966 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2570/5327] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:17:49 2022] POST /compute/v2.1/servers/e8fceada-b6ec-4cc8-aaec-cb7f9d209412/action => generated 117 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:17:49.098610 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-73831758-63a0-4eff-af10-bdf9ddf4732b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:49.099925 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-73831758-63a0-4eff-af10-bdf9ddf4732b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:49.108035 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-73831758-63a0-4eff-af10-bdf9ddf4732b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:49.108605 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-73831758-63a0-4eff-af10-bdf9ddf4732b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:49.109274 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-73831758-63a0-4eff-af10-bdf9ddf4732b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:49.113952 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-73831758-63a0-4eff-af10-bdf9ddf4732b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:49.114688 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-73831758-63a0-4eff-af10-bdf9ddf4732b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:49.115375 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-73831758-63a0-4eff-af10-bdf9ddf4732b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:49.688884 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-73831758-63a0-4eff-af10-bdf9ddf4732b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:49.704008 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-73831758-63a0-4eff-af10-bdf9ddf4732b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.609862 Aug 31 16:17:49.722431 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2758/5328] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:49 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:49.728888 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7755a092-f814-434d-8282-97c479048809 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:49.729880 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7755a092-f814-434d-8282-97c479048809 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:49.737757 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7755a092-f814-434d-8282-97c479048809 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:49.738553 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7755a092-f814-434d-8282-97c479048809 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:49.739143 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7755a092-f814-434d-8282-97c479048809 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:49.739990 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7755a092-f814-434d-8282-97c479048809 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:49.740586 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7755a092-f814-434d-8282-97c479048809 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:49.741153 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7755a092-f814-434d-8282-97c479048809 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:50.071816 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7755a092-f814-434d-8282-97c479048809 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:50.086709 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7755a092-f814-434d-8282-97c479048809 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.361769 Aug 31 16:17:50.124651 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4e818373-f4de-45ba-8ee4-3394c754646c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:17:50.127697 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4e818373-f4de-45ba-8ee4-3394c754646c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: a28aa587-4b0d-4684-9941-6c88bb44a680] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:50.144037 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2571/5329] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:49 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:50.151414 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-4e818373-f4de-45ba-8ee4-3394c754646c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] HTTP exception thrown: Instance a28aa587-4b0d-4684-9941-6c88bb44a680 could not be found. Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4e818373-f4de-45ba-8ee4-3394c754646c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Request method failure captured: Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: request: POST /compute/v2.1/servers/a28aa587-4b0d-4684-9941-6c88bb44a680/action HTTP/1.1 Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 15 Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4kQ0XzwgZzM00K2xfqw4sNWznetRNwtM61dwPFzPgxHVwt6ZQqeyy0IDwJXT8yOdP4-2pSJFf0sLdbRTKSty95v4MPjLoaaRhSqpDob3UUxppJFVkB8ZQH-IsYhc50JLxuO54hEVWRh4jtxjaTwZZjw98G6FCIkizac62ua4tSQ6_s Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3e843f3122c14cf8889f26423552792f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3e843f3122c14cf8889f26423552792f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 8b67be53aade4f8c92d6765dd91a4b90 Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: {"suspend": {}} Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance a28aa587-4b0d-4684-9941-6c88bb44a680 could not be found. Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'a28aa587-4b0d-4684-9941-6c88bb44a680', 'body': {'suspend': {}}} Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a28aa587-4b0d-4684-9941-6c88bb44a680 could not be found. Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a28aa587-4b0d-4684-9941-6c88bb44a680 could not be found. Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:17:50.153430 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:17:50.157369 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:17:50.157369 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:17:50.157369 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a28aa587-4b0d-4684-9941-6c88bb44a680 could not be found. Aug 31 16:17:50.157369 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:17:50.159033 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4e818373-f4de-45ba-8ee4-3394c754646c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Returning 404 to user: Instance a28aa587-4b0d-4684-9941-6c88bb44a680 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:17:50.161512 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4e818373-f4de-45ba-8ee4-3394c754646c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "POST /compute/v2.1/servers/a28aa587-4b0d-4684-9941-6c88bb44a680/action" status: 404 len: 111 microversion: 2.1 time: 0.049562 Aug 31 16:17:50.165710 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2759/5330] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:17:50 2022] POST /compute/v2.1/servers/a28aa587-4b0d-4684-9941-6c88bb44a680/action => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:17:50.184440 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f7adb2a6-ee3c-492d-b80c-092706e221fe tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:50.185069 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f7adb2a6-ee3c-492d-b80c-092706e221fe tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:50.191889 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7adb2a6-ee3c-492d-b80c-092706e221fe tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:50.192385 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7adb2a6-ee3c-492d-b80c-092706e221fe tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:50.192841 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7adb2a6-ee3c-492d-b80c-092706e221fe tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:50.194805 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7adb2a6-ee3c-492d-b80c-092706e221fe tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:50.195281 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7adb2a6-ee3c-492d-b80c-092706e221fe tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:50.195825 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7adb2a6-ee3c-492d-b80c-092706e221fe tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:50.542650 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f7adb2a6-ee3c-492d-b80c-092706e221fe tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:50.556864 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f7adb2a6-ee3c-492d-b80c-092706e221fe tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.388540 Aug 31 16:17:50.567181 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2572/5331] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:50 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:50.580102 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1e33d25c-30de-4580-92a4-ffdab661a863 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:50.580903 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1e33d25c-30de-4580-92a4-ffdab661a863 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:50.588121 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e33d25c-30de-4580-92a4-ffdab661a863 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:50.589004 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e33d25c-30de-4580-92a4-ffdab661a863 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:50.590007 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e33d25c-30de-4580-92a4-ffdab661a863 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:50.590774 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e33d25c-30de-4580-92a4-ffdab661a863 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:50.591229 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e33d25c-30de-4580-92a4-ffdab661a863 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:50.592034 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e33d25c-30de-4580-92a4-ffdab661a863 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:50.879323 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1e33d25c-30de-4580-92a4-ffdab661a863 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:50.887754 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1e33d25c-30de-4580-92a4-ffdab661a863 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.311976 Aug 31 16:17:50.890482 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2760/5332] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:50 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:50.908103 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c1298136-1458-497d-9d67-ff78afd0f429 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:17:50.908627 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c1298136-1458-497d-9d67-ff78afd0f429 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:50.915575 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c1298136-1458-497d-9d67-ff78afd0f429 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:50.916053 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c1298136-1458-497d-9d67-ff78afd0f429 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:50.916553 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c1298136-1458-497d-9d67-ff78afd0f429 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:50.917489 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c1298136-1458-497d-9d67-ff78afd0f429 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:50.918077 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c1298136-1458-497d-9d67-ff78afd0f429 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:50.918666 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c1298136-1458-497d-9d67-ff78afd0f429 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:50.942769 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-c1298136-1458-497d-9d67-ff78afd0f429 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lazy-loading 'flavor' on Instance uuid 4b051f4f-6b51-4ca7-9afd-6d75682e7f52 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:17:51.041954 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c1298136-1458-497d-9d67-ff78afd0f429 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "POST /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52/action" status: 202 len: 0 microversion: 2.1 time: 0.137263 Aug 31 16:17:51.046175 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2573/5333] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:17:50 2022] POST /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:17:51.056480 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9b3b8abd-cbc4-441d-9803-296f770ba418 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:51.058462 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9b3b8abd-cbc4-441d-9803-296f770ba418 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:51.069870 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9b3b8abd-cbc4-441d-9803-296f770ba418 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:51.075162 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9b3b8abd-cbc4-441d-9803-296f770ba418 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:51.075768 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9b3b8abd-cbc4-441d-9803-296f770ba418 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:51.076522 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9b3b8abd-cbc4-441d-9803-296f770ba418 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:51.076991 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9b3b8abd-cbc4-441d-9803-296f770ba418 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:51.077434 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9b3b8abd-cbc4-441d-9803-296f770ba418 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:51.358081 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9b3b8abd-cbc4-441d-9803-296f770ba418 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:51.370966 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9b3b8abd-cbc4-441d-9803-296f770ba418 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1514 microversion: 2.1 time: 0.323761 Aug 31 16:17:51.378576 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2761/5334] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:51 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1514 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:52.396608 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f5f000ef-a18f-484f-94ea-238c82144c93 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:52.398168 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f5f000ef-a18f-484f-94ea-238c82144c93 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:52.409151 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5f000ef-a18f-484f-94ea-238c82144c93 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:52.410248 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5f000ef-a18f-484f-94ea-238c82144c93 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:52.411317 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5f000ef-a18f-484f-94ea-238c82144c93 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:52.412436 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5f000ef-a18f-484f-94ea-238c82144c93 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:52.413528 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5f000ef-a18f-484f-94ea-238c82144c93 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:52.414537 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5f000ef-a18f-484f-94ea-238c82144c93 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:52.869837 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f5f000ef-a18f-484f-94ea-238c82144c93 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:52.881118 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f5f000ef-a18f-484f-94ea-238c82144c93 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1497 microversion: 2.1 time: 0.491906 Aug 31 16:17:52.883079 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2574/5335] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:52 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1497 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:52.907788 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6fd3fd93-ec63-48cb-b2c9-9f5e9d7deb14 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:17:52.909755 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6fd3fd93-ec63-48cb-b2c9-9f5e9d7deb14 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:52.918919 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6fd3fd93-ec63-48cb-b2c9-9f5e9d7deb14 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:52.919939 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6fd3fd93-ec63-48cb-b2c9-9f5e9d7deb14 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:52.920556 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6fd3fd93-ec63-48cb-b2c9-9f5e9d7deb14 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:52.921493 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6fd3fd93-ec63-48cb-b2c9-9f5e9d7deb14 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:52.922163 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6fd3fd93-ec63-48cb-b2c9-9f5e9d7deb14 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:52.923063 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6fd3fd93-ec63-48cb-b2c9-9f5e9d7deb14 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:52.953697 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-6fd3fd93-ec63-48cb-b2c9-9f5e9d7deb14 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lazy-loading 'flavor' on Instance uuid 4b051f4f-6b51-4ca7-9afd-6d75682e7f52 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:17:52.969615 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-6fd3fd93-ec63-48cb-b2c9-9f5e9d7deb14 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] HTTP exception thrown: Cannot 'suspend' instance 4b051f4f-6b51-4ca7-9afd-6d75682e7f52 while it is in vm_state suspended Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6fd3fd93-ec63-48cb-b2c9-9f5e9d7deb14 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Request method failure captured: Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: request: POST /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52/action HTTP/1.1 Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 15 Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4kQ0XzwgZzM00K2xfqw4sNWznetRNwtM61dwPFzPgxHVwt6ZQqeyy0IDwJXT8yOdP4-2pSJFf0sLdbRTKSty95v4MPjLoaaRhSqpDob3UUxppJFVkB8ZQH-IsYhc50JLxuO54hEVWRh4jtxjaTwZZjw98G6FCIkizac62ua4tSQ6_s Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3e843f3122c14cf8889f26423552792f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3e843f3122c14cf8889f26423552792f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 8b67be53aade4f8c92d6765dd91a4b90 Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: {"suspend": {}} Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: exception: Cannot 'suspend' instance 4b051f4f-6b51-4ca7-9afd-6d75682e7f52 while it is in vm_state suspended Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '4b051f4f-6b51-4ca7-9afd-6d75682e7f52', 'body': {'suspend': {}}} Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4b051f4f-6b51-4ca7-9afd-6d75682e7f52 in vm_state suspended. Cannot suspend while the instance is in this state. Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Aug 31 16:17:52.971657 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 16:17:52.974842 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 16:17:52.974842 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 16:17:52.974842 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 4b051f4f-6b51-4ca7-9afd-6d75682e7f52 while it is in vm_state suspended Aug 31 16:17:52.974842 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:17:52.974842 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:17:52.974842 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:17:52.974842 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:17:52.974842 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:17:52.974842 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:17:52.974842 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:17:52.974842 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:17:52.974842 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 4b051f4f-6b51-4ca7-9afd-6d75682e7f52 while it is in vm_state suspended Aug 31 16:17:52.974842 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:17:52.974842 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6fd3fd93-ec63-48cb-b2c9-9f5e9d7deb14 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Returning 409 to user: Cannot 'suspend' instance 4b051f4f-6b51-4ca7-9afd-6d75682e7f52 while it is in vm_state suspended {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:17:52.977499 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6fd3fd93-ec63-48cb-b2c9-9f5e9d7deb14 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "POST /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52/action" status: 409 len: 148 microversion: 2.1 time: 0.074092 Aug 31 16:17:52.977499 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2762/5336] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:17:52 2022] POST /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52/action => generated 148 bytes in 76 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 16:17:52.985503 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1e770bde-3ed3-4cdc-8c6d-a006199c6181 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:17:52.986363 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1e770bde-3ed3-4cdc-8c6d-a006199c6181 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:52.993229 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e770bde-3ed3-4cdc-8c6d-a006199c6181 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:52.994117 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e770bde-3ed3-4cdc-8c6d-a006199c6181 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:52.995007 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e770bde-3ed3-4cdc-8c6d-a006199c6181 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:52.996567 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e770bde-3ed3-4cdc-8c6d-a006199c6181 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:52.997849 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e770bde-3ed3-4cdc-8c6d-a006199c6181 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:52.998555 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e770bde-3ed3-4cdc-8c6d-a006199c6181 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:53.090404 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1e770bde-3ed3-4cdc-8c6d-a006199c6181 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "POST /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52/action" status: 202 len: 0 microversion: 2.1 time: 0.108574 Aug 31 16:17:53.091959 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2575/5337] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:17:52 2022] POST /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:17:53.102170 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a78402d7-0c08-41d6-a8c4-7ba1faf67872 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:53.103052 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a78402d7-0c08-41d6-a8c4-7ba1faf67872 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:53.111027 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a78402d7-0c08-41d6-a8c4-7ba1faf67872 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:53.111751 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a78402d7-0c08-41d6-a8c4-7ba1faf67872 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:53.112546 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a78402d7-0c08-41d6-a8c4-7ba1faf67872 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:53.114801 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a78402d7-0c08-41d6-a8c4-7ba1faf67872 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:53.115454 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a78402d7-0c08-41d6-a8c4-7ba1faf67872 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:53.116189 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a78402d7-0c08-41d6-a8c4-7ba1faf67872 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:53.674714 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a78402d7-0c08-41d6-a8c4-7ba1faf67872 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:53.684316 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a78402d7-0c08-41d6-a8c4-7ba1faf67872 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1503 microversion: 2.1 time: 0.587790 Aug 31 16:17:53.685094 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2763/5338] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:53 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1503 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:54.349802 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-64124780-970c-4fc8-be31-fda1a14cbc79 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-2020395549", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "7f00592a-f52a-476f-b583-8a3e6d7adc0c"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:17:54.423902 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-64124780-970c-4fc8-be31-fda1a14cbc79 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] validate_networks() for [('7f00592a-f52a-476f-b583-8a3e6d7adc0c', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:17:54.710918 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6adcc742-04da-4aff-ae0f-816a1c4b069a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:54.712550 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6adcc742-04da-4aff-ae0f-816a1c4b069a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:54.735519 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6adcc742-04da-4aff-ae0f-816a1c4b069a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:54.736013 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6adcc742-04da-4aff-ae0f-816a1c4b069a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:54.736578 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6adcc742-04da-4aff-ae0f-816a1c4b069a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:54.737512 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6adcc742-04da-4aff-ae0f-816a1c4b069a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:54.737978 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6adcc742-04da-4aff-ae0f-816a1c4b069a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:54.738543 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6adcc742-04da-4aff-ae0f-816a1c4b069a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:55.131644 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6adcc742-04da-4aff-ae0f-816a1c4b069a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:55.155097 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6adcc742-04da-4aff-ae0f-816a1c4b069a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1503 microversion: 2.1 time: 0.450005 Aug 31 16:17:55.158504 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2764/5339] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:54 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1503 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:55.401332 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-64124780-970c-4fc8-be31-fda1a14cbc79 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:17:55.402505 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-64124780-970c-4fc8-be31-fda1a14cbc79 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:17:55.403495 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-64124780-970c-4fc8-be31-fda1a14cbc79 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:17:55.404083 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-64124780-970c-4fc8-be31-fda1a14cbc79 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:17:55.404675 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-64124780-970c-4fc8-be31-fda1a14cbc79 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:17:55.415565 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64124780-970c-4fc8-be31-fda1a14cbc79 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:55.416058 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64124780-970c-4fc8-be31-fda1a14cbc79 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:55.416842 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64124780-970c-4fc8-be31-fda1a14cbc79 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:55.417313 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64124780-970c-4fc8-be31-fda1a14cbc79 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:55.417763 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64124780-970c-4fc8-be31-fda1a14cbc79 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:55.418217 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64124780-970c-4fc8-be31-fda1a14cbc79 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:55.445103 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-64124780-970c-4fc8-be31-fda1a14cbc79 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Getting quotas for project 78689045e6c945108c966ba3cbeb5216. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:17:55.451654 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-64124780-970c-4fc8-be31-fda1a14cbc79 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Getting quotas for user 5a0360d29d1c48d6bcab7d5198a0148b and project 78689045e6c945108c966ba3cbeb5216. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:17:55.466946 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-64124780-970c-4fc8-be31-fda1a14cbc79 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:17:55.470294 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-64124780-970c-4fc8-be31-fda1a14cbc79 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] [instance: a398032b-3def-4df0-bb77-550d29e5be00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:17:55.544902 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-64124780-970c-4fc8-be31-fda1a14cbc79 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.361053 Aug 31 16:17:55.562737 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2576/5340] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:17:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1380 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:17:55.647399 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1a32c9c5-5130-4808-94f9-abc8923eaecc tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1242154042", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "7f00592a-f52a-476f-b583-8a3e6d7adc0c"}]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:17:55.721534 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-1a32c9c5-5130-4808-94f9-abc8923eaecc tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] validate_networks() for [('7f00592a-f52a-476f-b583-8a3e6d7adc0c', None, None, None, None, None)] {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:17:56.188581 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fda8b278-2671-4210-8b3a-74236aee20c1 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:56.189200 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fda8b278-2671-4210-8b3a-74236aee20c1 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:56.196624 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fda8b278-2671-4210-8b3a-74236aee20c1 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:56.197366 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fda8b278-2671-4210-8b3a-74236aee20c1 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:56.197979 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fda8b278-2671-4210-8b3a-74236aee20c1 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:56.198961 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fda8b278-2671-4210-8b3a-74236aee20c1 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:56.199566 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fda8b278-2671-4210-8b3a-74236aee20c1 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:56.200161 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fda8b278-2671-4210-8b3a-74236aee20c1 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:56.553174 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fda8b278-2671-4210-8b3a-74236aee20c1 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:56.563596 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fda8b278-2671-4210-8b3a-74236aee20c1 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.378923 Aug 31 16:17:56.567860 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2577/5341] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:56 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:17:56.598803 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-80f99216-67bc-42e3-b3b9-c04eff663418 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:56.599808 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-80f99216-67bc-42e3-b3b9-c04eff663418 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:56.618016 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80f99216-67bc-42e3-b3b9-c04eff663418 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:56.618878 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80f99216-67bc-42e3-b3b9-c04eff663418 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:56.627865 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80f99216-67bc-42e3-b3b9-c04eff663418 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:56.629648 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80f99216-67bc-42e3-b3b9-c04eff663418 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:56.630414 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80f99216-67bc-42e3-b3b9-c04eff663418 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:56.631054 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80f99216-67bc-42e3-b3b9-c04eff663418 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:56.660127 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:17:57.022774 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-80f99216-67bc-42e3-b3b9-c04eff663418 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:57.038612 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-80f99216-67bc-42e3-b3b9-c04eff663418 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.444489 Aug 31 16:17:57.040229 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2578/5342] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:56 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:17:57.068106 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-85c1d380-90fc-442b-8012-badd25a6cb42 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:17:57.069026 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-85c1d380-90fc-442b-8012-badd25a6cb42 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: b698c5e0-9430-46d4-9c5c-e7c398f06432] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:57.077926 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-85c1d380-90fc-442b-8012-badd25a6cb42 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] HTTP exception thrown: Instance b698c5e0-9430-46d4-9c5c-e7c398f06432 could not be found. Aug 31 16:17:57.088975 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-1a32c9c5-5130-4808-94f9-abc8923eaecc tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:17:57.090017 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-1a32c9c5-5130-4808-94f9-abc8923eaecc tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:17:57.090677 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-1a32c9c5-5130-4808-94f9-abc8923eaecc tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:17:57.091351 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-1a32c9c5-5130-4808-94f9-abc8923eaecc tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:17:57.091937 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-1a32c9c5-5130-4808-94f9-abc8923eaecc tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-85c1d380-90fc-442b-8012-badd25a6cb42 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Request method failure captured: Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers/b698c5e0-9430-46d4-9c5c-e7c398f06432/action HTTP/1.1 Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 15 Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4kQ0XzwgZzM00K2xfqw4sNWznetRNwtM61dwPFzPgxHVwt6ZQqeyy0IDwJXT8yOdP4-2pSJFf0sLdbRTKSty95v4MPjLoaaRhSqpDob3UUxppJFVkB8ZQH-IsYhc50JLxuO54hEVWRh4jtxjaTwZZjw98G6FCIkizac62ua4tSQ6_s Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3e843f3122c14cf8889f26423552792f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3e843f3122c14cf8889f26423552792f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 8b67be53aade4f8c92d6765dd91a4b90 Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: {"unpause": {}} Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance b698c5e0-9430-46d4-9c5c-e7c398f06432 could not be found. Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'b698c5e0-9430-46d4-9c5c-e7c398f06432', 'body': {'unpause': {}}} Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b698c5e0-9430-46d4-9c5c-e7c398f06432 could not be found. Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b698c5e0-9430-46d4-9c5c-e7c398f06432 could not be found. Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:17:57.099992 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:17:57.103390 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:17:57.103390 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:17:57.103390 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b698c5e0-9430-46d4-9c5c-e7c398f06432 could not be found. Aug 31 16:17:57.103390 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:17:57.105591 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-85c1d380-90fc-442b-8012-badd25a6cb42 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Returning 404 to user: Instance b698c5e0-9430-46d4-9c5c-e7c398f06432 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:17:57.106659 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-85c1d380-90fc-442b-8012-badd25a6cb42 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "POST /compute/v2.1/servers/b698c5e0-9430-46d4-9c5c-e7c398f06432/action" status: 404 len: 111 microversion: 2.1 time: 0.045397 Aug 31 16:17:57.109743 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2579/5343] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:17:57 2022] POST /compute/v2.1/servers/b698c5e0-9430-46d4-9c5c-e7c398f06432/action => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:17:57.112475 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a32c9c5-5130-4808-94f9-abc8923eaecc tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:57.117823 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a32c9c5-5130-4808-94f9-abc8923eaecc tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:57.120039 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a32c9c5-5130-4808-94f9-abc8923eaecc tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:57.122668 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a32c9c5-5130-4808-94f9-abc8923eaecc tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:57.123154 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a32c9c5-5130-4808-94f9-abc8923eaecc tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:57.123594 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a32c9c5-5130-4808-94f9-abc8923eaecc tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:57.126808 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f83d4a81-9e10-4038-a2ea-e399b7868751 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:57.127980 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f83d4a81-9e10-4038-a2ea-e399b7868751 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:57.144999 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f83d4a81-9e10-4038-a2ea-e399b7868751 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:57.146459 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f83d4a81-9e10-4038-a2ea-e399b7868751 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:57.146911 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f83d4a81-9e10-4038-a2ea-e399b7868751 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:57.150225 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f83d4a81-9e10-4038-a2ea-e399b7868751 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:57.150765 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f83d4a81-9e10-4038-a2ea-e399b7868751 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:57.151210 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f83d4a81-9e10-4038-a2ea-e399b7868751 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:57.184132 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-1a32c9c5-5130-4808-94f9-abc8923eaecc tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Getting quotas for project 78689045e6c945108c966ba3cbeb5216. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:17:57.195979 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-1a32c9c5-5130-4808-94f9-abc8923eaecc tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Getting quotas for user 5a0360d29d1c48d6bcab7d5198a0148b and project 78689045e6c945108c966ba3cbeb5216. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:17:57.232120 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1a32c9c5-5130-4808-94f9-abc8923eaecc tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:17:57.237449 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1a32c9c5-5130-4808-94f9-abc8923eaecc tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] [instance: e8cc6df1-d4ec-4150-a4be-7f5ed20d64d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:17:57.326996 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1a32c9c5-5130-4808-94f9-abc8923eaecc tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.685792 Aug 31 16:17:57.349885 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2765/5344] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:17:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:17:57.431899 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-cdffc8e0-c049-4e48-99e2-6a0a5d12da29 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-173962465", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "451", "networks": [{"uuid": "7f00592a-f52a-476f-b583-8a3e6d7adc0c"}]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:17:57.545095 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-cdffc8e0-c049-4e48-99e2-6a0a5d12da29 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] validate_networks() for [('7f00592a-f52a-476f-b583-8a3e6d7adc0c', None, None, None, None, None)] {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:17:58.134366 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f83d4a81-9e10-4038-a2ea-e399b7868751 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:58.165092 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f83d4a81-9e10-4038-a2ea-e399b7868751 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 1.050089 Aug 31 16:17:58.185394 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2580/5345] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:57 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:17:58.208791 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1b40e434-17e3-48eb-823f-0a1577acc300 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:58.210065 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1b40e434-17e3-48eb-823f-0a1577acc300 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:58.232750 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b40e434-17e3-48eb-823f-0a1577acc300 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:58.233871 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b40e434-17e3-48eb-823f-0a1577acc300 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:58.235020 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b40e434-17e3-48eb-823f-0a1577acc300 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:58.235959 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b40e434-17e3-48eb-823f-0a1577acc300 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:58.236423 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b40e434-17e3-48eb-823f-0a1577acc300 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:58.236846 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1b40e434-17e3-48eb-823f-0a1577acc300 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:58.825111 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1b40e434-17e3-48eb-823f-0a1577acc300 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:58.841188 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1b40e434-17e3-48eb-823f-0a1577acc300 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.643729 Aug 31 16:17:58.842835 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2581/5346] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:58 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:17:58.867789 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ab10d485-0613-4deb-bc73-26fb89975b38 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:17:58.868683 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ab10d485-0613-4deb-bc73-26fb89975b38 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:58.876189 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab10d485-0613-4deb-bc73-26fb89975b38 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:58.877687 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab10d485-0613-4deb-bc73-26fb89975b38 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:58.878410 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab10d485-0613-4deb-bc73-26fb89975b38 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:58.879345 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab10d485-0613-4deb-bc73-26fb89975b38 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:58.880275 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab10d485-0613-4deb-bc73-26fb89975b38 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:58.881193 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ab10d485-0613-4deb-bc73-26fb89975b38 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:58.920962 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-ab10d485-0613-4deb-bc73-26fb89975b38 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] HTTP exception thrown: Cannot 'unpause' instance 4b051f4f-6b51-4ca7-9afd-6d75682e7f52 while it is in vm_state active Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ab10d485-0613-4deb-bc73-26fb89975b38 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Request method failure captured: Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52/action HTTP/1.1 Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 15 Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4kQ0XzwgZzM00K2xfqw4sNWznetRNwtM61dwPFzPgxHVwt6ZQqeyy0IDwJXT8yOdP4-2pSJFf0sLdbRTKSty95v4MPjLoaaRhSqpDob3UUxppJFVkB8ZQH-IsYhc50JLxuO54hEVWRh4jtxjaTwZZjw98G6FCIkizac62ua4tSQ6_s Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3e843f3122c14cf8889f26423552792f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3e843f3122c14cf8889f26423552792f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 8b67be53aade4f8c92d6765dd91a4b90 Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: {"unpause": {}} Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: exception: Cannot 'unpause' instance 4b051f4f-6b51-4ca7-9afd-6d75682e7f52 while it is in vm_state active Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '4b051f4f-6b51-4ca7-9afd-6d75682e7f52', 'body': {'unpause': {}}} Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4b051f4f-6b51-4ca7-9afd-6d75682e7f52 in vm_state active. Cannot unpause while the instance is in this state. Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 4b051f4f-6b51-4ca7-9afd-6d75682e7f52 while it is in vm_state active Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:17:58.924374 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:17:58.927616 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:17:58.927616 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:17:58.927616 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:17:58.927616 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 4b051f4f-6b51-4ca7-9afd-6d75682e7f52 while it is in vm_state active Aug 31 16:17:58.927616 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:17:58.929637 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ab10d485-0613-4deb-bc73-26fb89975b38 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Returning 409 to user: Cannot 'unpause' instance 4b051f4f-6b51-4ca7-9afd-6d75682e7f52 while it is in vm_state active {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:17:58.930701 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ab10d485-0613-4deb-bc73-26fb89975b38 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "POST /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52/action" status: 409 len: 145 microversion: 2.1 time: 0.071072 Aug 31 16:17:58.933284 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2582/5347] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:17:58 2022] POST /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52/action => generated 145 bytes in 74 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 31 16:17:58.951729 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-cdffc8e0-c049-4e48-99e2-6a0a5d12da29 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:17:58.952585 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-cdffc8e0-c049-4e48-99e2-6a0a5d12da29 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:17:58.953172 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-cdffc8e0-c049-4e48-99e2-6a0a5d12da29 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:17:58.954446 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-cdffc8e0-c049-4e48-99e2-6a0a5d12da29 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:17:58.954984 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-cdffc8e0-c049-4e48-99e2-6a0a5d12da29 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:17:58.955685 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7f1f2249-83f2-4e29-a4fa-9304f7415878 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:58.956574 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7f1f2249-83f2-4e29-a4fa-9304f7415878 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:58.968399 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f1f2249-83f2-4e29-a4fa-9304f7415878 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:58.969979 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f1f2249-83f2-4e29-a4fa-9304f7415878 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:58.970591 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f1f2249-83f2-4e29-a4fa-9304f7415878 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:58.971646 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f1f2249-83f2-4e29-a4fa-9304f7415878 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:58.972306 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f1f2249-83f2-4e29-a4fa-9304f7415878 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:58.973317 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cdffc8e0-c049-4e48-99e2-6a0a5d12da29 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:58.973883 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f1f2249-83f2-4e29-a4fa-9304f7415878 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:58.974264 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cdffc8e0-c049-4e48-99e2-6a0a5d12da29 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:58.974722 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cdffc8e0-c049-4e48-99e2-6a0a5d12da29 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:58.975529 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cdffc8e0-c049-4e48-99e2-6a0a5d12da29 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:58.975989 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cdffc8e0-c049-4e48-99e2-6a0a5d12da29 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:58.976436 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cdffc8e0-c049-4e48-99e2-6a0a5d12da29 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:59.030401 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-cdffc8e0-c049-4e48-99e2-6a0a5d12da29 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Getting quotas for project 78689045e6c945108c966ba3cbeb5216. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:17:59.042328 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-cdffc8e0-c049-4e48-99e2-6a0a5d12da29 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Getting quotas for user 5a0360d29d1c48d6bcab7d5198a0148b and project 78689045e6c945108c966ba3cbeb5216. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:17:59.072684 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-cdffc8e0-c049-4e48-99e2-6a0a5d12da29 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:17:59.083555 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-cdffc8e0-c049-4e48-99e2-6a0a5d12da29 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] [instance: cc25e790-d850-4fda-9954-21d458c3676c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:17:59.188706 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-cdffc8e0-c049-4e48-99e2-6a0a5d12da29 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.763914 Aug 31 16:17:59.189626 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2766/5348] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:17:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:17:59.207676 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f5bb27b9-a69b-4be4-8b1a-1c36ea0109dc tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:59.208572 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f5bb27b9-a69b-4be4-8b1a-1c36ea0109dc tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] [instance: cc25e790-d850-4fda-9954-21d458c3676c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:59.744630 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f5bb27b9-a69b-4be4-8b1a-1c36ea0109dc tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:59.753152 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f5bb27b9-a69b-4be4-8b1a-1c36ea0109dc tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers/cc25e790-d850-4fda-9954-21d458c3676c" status: 200 len: 1220 microversion: 2.1 time: 0.549730 Aug 31 16:17:59.753744 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2767/5349] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:59 2022] GET /compute/v2.1/servers/cc25e790-d850-4fda-9954-21d458c3676c => generated 1220 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:17:59.809542 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7f1f2249-83f2-4e29-a4fa-9304f7415878 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:17:59.827453 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7f1f2249-83f2-4e29-a4fa-9304f7415878 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.891080 Aug 31 16:17:59.845922 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2583/5350] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:58 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:17:59.859473 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e7ef46cb-e98a-40f6-bf21-83155cf6db8b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:17:59.860091 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e7ef46cb-e98a-40f6-bf21-83155cf6db8b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:17:59.873436 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7ef46cb-e98a-40f6-bf21-83155cf6db8b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:59.878018 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7ef46cb-e98a-40f6-bf21-83155cf6db8b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:59.878745 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7ef46cb-e98a-40f6-bf21-83155cf6db8b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:17:59.879828 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7ef46cb-e98a-40f6-bf21-83155cf6db8b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:17:59.880431 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7ef46cb-e98a-40f6-bf21-83155cf6db8b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:17:59.881015 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7ef46cb-e98a-40f6-bf21-83155cf6db8b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:00.357547 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e7ef46cb-e98a-40f6-bf21-83155cf6db8b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:00.396593 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e7ef46cb-e98a-40f6-bf21-83155cf6db8b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.539109 Aug 31 16:18:00.403926 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2768/5351] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:17:59 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:18:00.433521 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b89d3932-af6b-4322-8859-7e3cd0233eff tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:18:00.434397 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b89d3932-af6b-4322-8859-7e3cd0233eff tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: ef2d2f22-2d4f-446c-bebe-f5f921cc1f17] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:00.449586 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-b89d3932-af6b-4322-8859-7e3cd0233eff tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] HTTP exception thrown: Instance ef2d2f22-2d4f-446c-bebe-f5f921cc1f17 could not be found. Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b89d3932-af6b-4322-8859-7e3cd0233eff tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Request method failure captured: Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers/ef2d2f22-2d4f-446c-bebe-f5f921cc1f17/action HTTP/1.1 Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 18 Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4kQ0XzwgZzM00K2xfqw4sNWznetRNwtM61dwPFzPgxHVwt6ZQqeyy0IDwJXT8yOdP4-2pSJFf0sLdbRTKSty95v4MPjLoaaRhSqpDob3UUxppJFVkB8ZQH-IsYhc50JLxuO54hEVWRh4jtxjaTwZZjw98G6FCIkizac62ua4tSQ6_s Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3e843f3122c14cf8889f26423552792f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3e843f3122c14cf8889f26423552792f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 8b67be53aade4f8c92d6765dd91a4b90 Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: {"unshelve": null} Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance ef2d2f22-2d4f-446c-bebe-f5f921cc1f17 could not be found. Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'ef2d2f22-2d4f-446c-bebe-f5f921cc1f17', 'body': {'unshelve': None}} Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef2d2f22-2d4f-446c-bebe-f5f921cc1f17 could not be found. Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef2d2f22-2d4f-446c-bebe-f5f921cc1f17 could not be found. Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:18:00.451217 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:18:00.454580 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:18:00.454580 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:18:00.454580 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:18:00.454580 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:18:00.454580 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:18:00.454580 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:18:00.454580 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef2d2f22-2d4f-446c-bebe-f5f921cc1f17 could not be found. Aug 31 16:18:00.454580 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:18:00.454580 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b89d3932-af6b-4322-8859-7e3cd0233eff tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Returning 404 to user: Instance ef2d2f22-2d4f-446c-bebe-f5f921cc1f17 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:18:00.469034 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b89d3932-af6b-4322-8859-7e3cd0233eff tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "POST /compute/v2.1/servers/ef2d2f22-2d4f-446c-bebe-f5f921cc1f17/action" status: 404 len: 111 microversion: 2.1 time: 0.027371 Aug 31 16:18:00.470570 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2584/5352] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:18:00 2022] POST /compute/v2.1/servers/ef2d2f22-2d4f-446c-bebe-f5f921cc1f17/action => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:18:00.479861 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c01f2d5a-5a98-49ff-ae72-fd9636e4cd07 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:00.480794 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c01f2d5a-5a98-49ff-ae72-fd9636e4cd07 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:00.508423 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c01f2d5a-5a98-49ff-ae72-fd9636e4cd07 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:00.509370 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c01f2d5a-5a98-49ff-ae72-fd9636e4cd07 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:00.510394 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c01f2d5a-5a98-49ff-ae72-fd9636e4cd07 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:00.523832 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c01f2d5a-5a98-49ff-ae72-fd9636e4cd07 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:00.524343 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c01f2d5a-5a98-49ff-ae72-fd9636e4cd07 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:00.524830 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c01f2d5a-5a98-49ff-ae72-fd9636e4cd07 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:00.773898 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-695591a7-0bff-4064-a504-56a00ae6b534 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:00.774554 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-695591a7-0bff-4064-a504-56a00ae6b534 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] [instance: cc25e790-d850-4fda-9954-21d458c3676c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:00.792798 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-695591a7-0bff-4064-a504-56a00ae6b534 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:00.793457 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-695591a7-0bff-4064-a504-56a00ae6b534 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:00.794202 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-695591a7-0bff-4064-a504-56a00ae6b534 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:00.794955 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-695591a7-0bff-4064-a504-56a00ae6b534 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:00.795573 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-695591a7-0bff-4064-a504-56a00ae6b534 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:00.796162 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-695591a7-0bff-4064-a504-56a00ae6b534 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:00.926536 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-695591a7-0bff-4064-a504-56a00ae6b534 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:00.937171 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-695591a7-0bff-4064-a504-56a00ae6b534 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers/cc25e790-d850-4fda-9954-21d458c3676c" status: 200 len: 1272 microversion: 2.1 time: 0.168206 Aug 31 16:18:00.941638 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2585/5353] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:00 2022] GET /compute/v2.1/servers/cc25e790-d850-4fda-9954-21d458c3676c => generated 1272 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:18:00.945118 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c01f2d5a-5a98-49ff-ae72-fd9636e4cd07 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:00.961010 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c01f2d5a-5a98-49ff-ae72-fd9636e4cd07 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.486053 Aug 31 16:18:00.961600 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2769/5354] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:00 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:00.985628 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c77a342c-f143-4324-ab26-9f92af75946b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:00.986560 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c77a342c-f143-4324-ab26-9f92af75946b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:00.993709 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c77a342c-f143-4324-ab26-9f92af75946b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:00.994597 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c77a342c-f143-4324-ab26-9f92af75946b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:00.995185 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c77a342c-f143-4324-ab26-9f92af75946b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:00.996076 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c77a342c-f143-4324-ab26-9f92af75946b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:00.996684 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c77a342c-f143-4324-ab26-9f92af75946b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:00.997259 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c77a342c-f143-4324-ab26-9f92af75946b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:01.192123 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c77a342c-f143-4324-ab26-9f92af75946b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:01.205066 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c77a342c-f143-4324-ab26-9f92af75946b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.223091 Aug 31 16:18:01.206581 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2586/5355] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:00 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:01.227555 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-718a2cbf-3b29-4144-bfaa-3ea592598a81 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:18:01.228165 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-718a2cbf-3b29-4144-bfaa-3ea592598a81 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:01.242183 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-718a2cbf-3b29-4144-bfaa-3ea592598a81 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:01.242685 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-718a2cbf-3b29-4144-bfaa-3ea592598a81 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:01.243123 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-718a2cbf-3b29-4144-bfaa-3ea592598a81 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:01.243842 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-718a2cbf-3b29-4144-bfaa-3ea592598a81 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:01.244454 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-718a2cbf-3b29-4144-bfaa-3ea592598a81 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:01.245153 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-718a2cbf-3b29-4144-bfaa-3ea592598a81 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:01.249467 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=100 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:18:01.311177 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-718a2cbf-3b29-4144-bfaa-3ea592598a81 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] HTTP exception thrown: Cannot 'unshelve' instance 4b051f4f-6b51-4ca7-9afd-6d75682e7f52 while it is in vm_state active Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-718a2cbf-3b29-4144-bfaa-3ea592598a81 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Request method failure captured: Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: request: POST /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52/action HTTP/1.1 Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 18 Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4kQ0XzwgZzM00K2xfqw4sNWznetRNwtM61dwPFzPgxHVwt6ZQqeyy0IDwJXT8yOdP4-2pSJFf0sLdbRTKSty95v4MPjLoaaRhSqpDob3UUxppJFVkB8ZQH-IsYhc50JLxuO54hEVWRh4jtxjaTwZZjw98G6FCIkizac62ua4tSQ6_s Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3e843f3122c14cf8889f26423552792f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3e843f3122c14cf8889f26423552792f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 8b67be53aade4f8c92d6765dd91a4b90 Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: {"unshelve": null} Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: exception: Cannot 'unshelve' instance 4b051f4f-6b51-4ca7-9afd-6d75682e7f52 while it is in vm_state active Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '4b051f4f-6b51-4ca7-9afd-6d75682e7f52', 'body': {'unshelve': None}} Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4b051f4f-6b51-4ca7-9afd-6d75682e7f52 in vm_state active. Cannot unshelve while the instance is in this state. Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 31 16:18:01.313387 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 31 16:18:01.317460 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 4b051f4f-6b51-4ca7-9afd-6d75682e7f52 while it is in vm_state active Aug 31 16:18:01.317460 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:18:01.317460 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:18:01.317460 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:18:01.317460 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:18:01.317460 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:18:01.317460 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:18:01.317460 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:18:01.317460 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:18:01.317460 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 4b051f4f-6b51-4ca7-9afd-6d75682e7f52 while it is in vm_state active Aug 31 16:18:01.317460 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:18:01.319018 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-718a2cbf-3b29-4144-bfaa-3ea592598a81 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Returning 409 to user: Cannot 'unshelve' instance 4b051f4f-6b51-4ca7-9afd-6d75682e7f52 while it is in vm_state active {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:18:01.320056 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-718a2cbf-3b29-4144-bfaa-3ea592598a81 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "POST /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52/action" status: 409 len: 146 microversion: 2.1 time: 0.097115 Aug 31 16:18:01.321124 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2770/5356] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:18:01 2022] POST /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52/action => generated 146 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 16:18:01.330398 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a904f16a-b981-4b5f-8a3a-69b0e7c35ca0 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:01.331278 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a904f16a-b981-4b5f-8a3a-69b0e7c35ca0 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:01.339576 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a904f16a-b981-4b5f-8a3a-69b0e7c35ca0 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:01.340315 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a904f16a-b981-4b5f-8a3a-69b0e7c35ca0 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:01.340884 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a904f16a-b981-4b5f-8a3a-69b0e7c35ca0 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:01.342125 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a904f16a-b981-4b5f-8a3a-69b0e7c35ca0 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:01.342725 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a904f16a-b981-4b5f-8a3a-69b0e7c35ca0 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:01.343740 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a904f16a-b981-4b5f-8a3a-69b0e7c35ca0 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:01.520299 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a904f16a-b981-4b5f-8a3a-69b0e7c35ca0 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:01.530587 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a904f16a-b981-4b5f-8a3a-69b0e7c35ca0 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.205079 Aug 31 16:18:01.531507 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2587/5357] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:01 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:18:01.552293 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f6734b13-5041-4470-89df-36aa6999187c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:01.553460 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f6734b13-5041-4470-89df-36aa6999187c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:01.560329 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f6734b13-5041-4470-89df-36aa6999187c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:01.560813 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f6734b13-5041-4470-89df-36aa6999187c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:01.561245 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f6734b13-5041-4470-89df-36aa6999187c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:01.561946 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f6734b13-5041-4470-89df-36aa6999187c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:01.562430 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f6734b13-5041-4470-89df-36aa6999187c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:01.562852 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f6734b13-5041-4470-89df-36aa6999187c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:01.749319 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f6734b13-5041-4470-89df-36aa6999187c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:01.758124 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f6734b13-5041-4470-89df-36aa6999187c tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.209781 Aug 31 16:18:01.770762 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2771/5358] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:01 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:01.779134 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bf172feb-1753-409a-9f15-45e224165585 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-627558316_updated"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:18:01.781809 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bf172feb-1753-409a-9f15-45e224165585 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 3cd270bc-b081-44d8-974d-f01653fb58cf] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:01.787763 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-bf172feb-1753-409a-9f15-45e224165585 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] HTTP exception thrown: Instance 3cd270bc-b081-44d8-974d-f01653fb58cf could not be found. Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bf172feb-1753-409a-9f15-45e224165585 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Request method failure captured: Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: request: PUT /compute/v2.1/servers/3cd270bc-b081-44d8-974d-f01653fb58cf HTTP/1.1 Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 80 Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4kQ0XzwgZzM00K2xfqw4sNWznetRNwtM61dwPFzPgxHVwt6ZQqeyy0IDwJXT8yOdP4-2pSJFf0sLdbRTKSty95v4MPjLoaaRhSqpDob3UUxppJFVkB8ZQH-IsYhc50JLxuO54hEVWRh4jtxjaTwZZjw98G6FCIkizac62ua4tSQ6_s Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3e843f3122c14cf8889f26423552792f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3e843f3122c14cf8889f26423552792f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 8b67be53aade4f8c92d6765dd91a4b90 Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-627558316_updated"}} Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 3cd270bc-b081-44d8-974d-f01653fb58cf could not be found. Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '3cd270bc-b081-44d8-974d-f01653fb58cf', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-627558316_updated'}}} Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cd270bc-b081-44d8-974d-f01653fb58cf could not be found. Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 31 16:18:01.789604 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:18:01.796664 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:18:01.796664 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:18:01.796664 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:18:01.796664 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cd270bc-b081-44d8-974d-f01653fb58cf could not be found. Aug 31 16:18:01.796664 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:18:01.796664 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:18:01.796664 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:18:01.796664 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:18:01.796664 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:18:01.796664 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:18:01.796664 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:18:01.796664 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:18:01.796664 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cd270bc-b081-44d8-974d-f01653fb58cf could not be found. Aug 31 16:18:01.796664 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:18:01.796664 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bf172feb-1753-409a-9f15-45e224165585 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Returning 404 to user: Instance 3cd270bc-b081-44d8-974d-f01653fb58cf could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:18:01.796664 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bf172feb-1753-409a-9f15-45e224165585 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "PUT /compute/v2.1/servers/3cd270bc-b081-44d8-974d-f01653fb58cf" status: 404 len: 111 microversion: 2.1 time: 0.016005 Aug 31 16:18:01.796664 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2588/5359] 10.222.0.50 () {60 vars in 1256 bytes} [Wed Aug 31 16:18:01 2022] PUT /compute/v2.1/servers/3cd270bc-b081-44d8-974d-f01653fb58cf => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:18:01.803710 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d8951dc9-8463-4b8c-ad09-e1f75bf86dfa tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:01.804513 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d8951dc9-8463-4b8c-ad09-e1f75bf86dfa tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:01.811388 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d8951dc9-8463-4b8c-ad09-e1f75bf86dfa tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:01.811854 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d8951dc9-8463-4b8c-ad09-e1f75bf86dfa tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:01.812491 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d8951dc9-8463-4b8c-ad09-e1f75bf86dfa tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:01.813154 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d8951dc9-8463-4b8c-ad09-e1f75bf86dfa tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:01.813606 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d8951dc9-8463-4b8c-ad09-e1f75bf86dfa tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:01.814586 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d8951dc9-8463-4b8c-ad09-e1f75bf86dfa tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:01.967742 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4daad71c-4aab-4568-b4ab-05a0f3d82665 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:01.969584 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4daad71c-4aab-4568-b4ab-05a0f3d82665 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] [instance: cc25e790-d850-4fda-9954-21d458c3676c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:01.977589 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d8951dc9-8463-4b8c-ad09-e1f75bf86dfa tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:01.991402 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4daad71c-4aab-4568-b4ab-05a0f3d82665 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:01.992288 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4daad71c-4aab-4568-b4ab-05a0f3d82665 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:01.992682 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d8951dc9-8463-4b8c-ad09-e1f75bf86dfa tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.192737 Aug 31 16:18:01.992840 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4daad71c-4aab-4568-b4ab-05a0f3d82665 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:01.993628 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4daad71c-4aab-4568-b4ab-05a0f3d82665 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:01.994285 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2772/5360] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:01 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:01.994399 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4daad71c-4aab-4568-b4ab-05a0f3d82665 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:01.994846 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4daad71c-4aab-4568-b4ab-05a0f3d82665 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:02.017267 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-12774a27-f2d3-49fe-b6ad-20f595a7ec5b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:02.018434 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-12774a27-f2d3-49fe-b6ad-20f595a7ec5b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:02.025263 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-12774a27-f2d3-49fe-b6ad-20f595a7ec5b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:02.026354 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-12774a27-f2d3-49fe-b6ad-20f595a7ec5b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:02.026953 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-12774a27-f2d3-49fe-b6ad-20f595a7ec5b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:02.027669 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-12774a27-f2d3-49fe-b6ad-20f595a7ec5b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:02.028158 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-12774a27-f2d3-49fe-b6ad-20f595a7ec5b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:02.028594 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-12774a27-f2d3-49fe-b6ad-20f595a7ec5b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:02.080790 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4daad71c-4aab-4568-b4ab-05a0f3d82665 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:02.091171 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4daad71c-4aab-4568-b4ab-05a0f3d82665 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers/cc25e790-d850-4fda-9954-21d458c3676c" status: 200 len: 1278 microversion: 2.1 time: 0.130556 Aug 31 16:18:02.098364 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2589/5361] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:01 2022] GET /compute/v2.1/servers/cc25e790-d850-4fda-9954-21d458c3676c => generated 1278 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:02.174833 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-12774a27-f2d3-49fe-b6ad-20f595a7ec5b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:02.183435 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-12774a27-f2d3-49fe-b6ad-20f595a7ec5b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.170342 Aug 31 16:18:02.184021 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2773/5362] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:02 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:02.204512 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b8ade710-4d96-4e0f-8700-fa278831a6de tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:18:02.208489 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b8ade710-4d96-4e0f-8700-fa278831a6de tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Request method failure captured: Aug 31 16:18:02.208489 n-d-833090-16 devstack@n-api.service[128863]: request: PUT /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 HTTP/1.1 Aug 31 16:18:02.208489 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:18:02.208489 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:18:02.208489 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:18:02.208489 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 280 Aug 31 16:18:02.208489 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:18:02.208489 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:18:02.208489 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:18:02.208489 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:18:02.208489 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4kQ0XzwgZzM00K2xfqw4sNWznetRNwtM61dwPFzPgxHVwt6ZQqeyy0IDwJXT8yOdP4-2pSJFf0sLdbRTKSty95v4MPjLoaaRhSqpDob3UUxppJFVkB8ZQH-IsYhc50JLxuO54hEVWRh4jtxjaTwZZjw98G6FCIkizac62ua4tSQ6_s Aug 31 16:18:02.208489 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:18:02.208489 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:18:02.208489 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:18:02.208489 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:18:02.208489 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:18:02.208489 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:18:02.208489 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:18:02.208489 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:18:02.208489 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:18:02.208489 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:18:02.208489 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3e843f3122c14cf8889f26423552792f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3e843f3122c14cf8889f26423552792f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:18:02.208489 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:18:02.208489 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:18:02.208489 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:18:02.208489 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:18:02.208489 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:18:02.208489 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:18:02.208489 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 8b67be53aade4f8c92d6765dd91a4b90 Aug 31 16:18:02.208489 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:18:02.208489 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 16:18:02.208489 n-d-833090-16 devstack@n-api.service[128863]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 31 16:18:02.208489 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:18:02.208489 n-d-833090-16 devstack@n-api.service[128863]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 31 16:18:02.208489 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '4b051f4f-6b51-4ca7-9afd-6d75682e7f52', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 31 16:18:02.208489 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:18:02.208489 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:18:02.208489 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:18:02.208489 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:18:02.208489 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:18:02.208489 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:18:02.208489 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 31 16:18:02.208489 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:18:02.208489 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 31 16:18:02.208489 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 31 16:18:02.208489 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:18:02.208489 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 31 16:18:02.208489 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 31 16:18:02.208489 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:18:02.208489 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:18:02.208489 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:18:02.208489 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:18:02.214750 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:18:02.214750 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:18:02.214750 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:18:02.214750 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:18:02.214750 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:18:02.214750 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:18:02.214750 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:18:02.214750 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:18:02.214750 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 16:18:02.214750 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 16:18:02.214750 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:18:02.214750 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:18:02.214750 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:18:02.214750 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:18:02.214750 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 31 16:18:02.214750 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:18:02.214750 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:18:02.214750 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:18:02.214750 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:18:02.214750 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:18:02.214750 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:18:02.214750 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:18:02.214750 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:18:02.214750 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 31 16:18:02.214750 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:18:02.214750 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b8ade710-4d96-4e0f-8700-fa278831a6de tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:18:02.214750 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b8ade710-4d96-4e0f-8700-fa278831a6de tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "PUT /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 400 len: 619 microversion: 2.1 time: 0.009305 Aug 31 16:18:02.214750 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2590/5363] 10.222.0.50 () {60 vars in 1257 bytes} [Wed Aug 31 16:18:02 2022] PUT /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 619 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:18:02.219379 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c3eaf570-e7a9-48dd-bd18-d670f633828b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:02.219999 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c3eaf570-e7a9-48dd-bd18-d670f633828b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:02.226723 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3eaf570-e7a9-48dd-bd18-d670f633828b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:02.227245 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3eaf570-e7a9-48dd-bd18-d670f633828b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:02.227680 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3eaf570-e7a9-48dd-bd18-d670f633828b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:02.228558 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3eaf570-e7a9-48dd-bd18-d670f633828b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:02.229190 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3eaf570-e7a9-48dd-bd18-d670f633828b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:02.229617 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3eaf570-e7a9-48dd-bd18-d670f633828b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:02.376075 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c3eaf570-e7a9-48dd-bd18-d670f633828b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:02.384276 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c3eaf570-e7a9-48dd-bd18-d670f633828b tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.169176 Aug 31 16:18:02.384930 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2774/5364] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:02 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:02.405980 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3441da44-5eb0-4724-b997-fcedae56bfb5 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:02.406669 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3441da44-5eb0-4724-b997-fcedae56bfb5 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:02.414876 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3441da44-5eb0-4724-b997-fcedae56bfb5 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:02.415811 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3441da44-5eb0-4724-b997-fcedae56bfb5 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:02.416479 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3441da44-5eb0-4724-b997-fcedae56bfb5 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:02.417642 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3441da44-5eb0-4724-b997-fcedae56bfb5 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:02.418326 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3441da44-5eb0-4724-b997-fcedae56bfb5 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:02.418759 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3441da44-5eb0-4724-b997-fcedae56bfb5 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:02.697549 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3441da44-5eb0-4724-b997-fcedae56bfb5 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:02.719993 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3441da44-5eb0-4724-b997-fcedae56bfb5 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.317835 Aug 31 16:18:02.721274 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2591/5365] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:02 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:02.744642 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e6a64636-90c0-4631-85ae-bceb3a479158 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e6a64636-90c0-4631-85ae-bceb3a479158 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Request method failure captured: Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: request: PUT /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 HTTP/1.1 Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 24 Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4kQ0XzwgZzM00K2xfqw4sNWznetRNwtM61dwPFzPgxHVwt6ZQqeyy0IDwJXT8yOdP4-2pSJFf0sLdbRTKSty95v4MPjLoaaRhSqpDob3UUxppJFVkB8ZQH-IsYhc50JLxuO54hEVWRh4jtxjaTwZZjw98G6FCIkizac62ua4tSQ6_s Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3e843f3122c14cf8889f26423552792f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3e843f3122c14cf8889f26423552792f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 8b67be53aade4f8c92d6765dd91a4b90 Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: {"server": {"name": ""}} Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '4b051f4f-6b51-4ca7-9afd-6d75682e7f52', 'body': {'server': {'name': ''}}} Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi '' Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:18:02.750742 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 31 16:18:02.756275 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:18:02.756275 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:18:02.756275 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:18:02.756275 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:18:02.756275 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:18:02.756275 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:18:02.756275 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:18:02.756275 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:18:02.756275 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 31 16:18:02.756275 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:18:02.756275 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e6a64636-90c0-4631-85ae-bceb3a479158 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:18:02.756275 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e6a64636-90c0-4631-85ae-bceb3a479158 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "PUT /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 400 len: 108 microversion: 2.1 time: 0.015105 Aug 31 16:18:02.756275 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2775/5366] 10.222.0.50 () {60 vars in 1256 bytes} [Wed Aug 31 16:18:02 2022] PUT /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 108 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:18:02.764772 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f761e74f-f48a-4a4b-a878-65d8dda195bd tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:02.765412 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f761e74f-f48a-4a4b-a878-65d8dda195bd tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:02.775980 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f761e74f-f48a-4a4b-a878-65d8dda195bd tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:02.776670 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f761e74f-f48a-4a4b-a878-65d8dda195bd tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:02.777216 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f761e74f-f48a-4a4b-a878-65d8dda195bd tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:02.778539 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f761e74f-f48a-4a4b-a878-65d8dda195bd tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:02.779173 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f761e74f-f48a-4a4b-a878-65d8dda195bd tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:02.779623 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f761e74f-f48a-4a4b-a878-65d8dda195bd tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:03.119206 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-26df9fbe-8338-4c81-b165-9b04e4102035 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:03.119997 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-26df9fbe-8338-4c81-b165-9b04e4102035 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] [instance: cc25e790-d850-4fda-9954-21d458c3676c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:03.123496 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=6 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:18:03.134313 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26df9fbe-8338-4c81-b165-9b04e4102035 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:03.135332 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26df9fbe-8338-4c81-b165-9b04e4102035 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:03.136415 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26df9fbe-8338-4c81-b165-9b04e4102035 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:03.137383 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26df9fbe-8338-4c81-b165-9b04e4102035 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:03.138193 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26df9fbe-8338-4c81-b165-9b04e4102035 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:03.138755 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26df9fbe-8338-4c81-b165-9b04e4102035 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:03.152549 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f761e74f-f48a-4a4b-a878-65d8dda195bd tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:03.173287 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f761e74f-f48a-4a4b-a878-65d8dda195bd tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1506 microversion: 2.1 time: 0.413883 Aug 31 16:18:03.175792 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2592/5367] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:02 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1506 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:03.352239 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-26df9fbe-8338-4c81-b165-9b04e4102035 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:03.363646 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-26df9fbe-8338-4c81-b165-9b04e4102035 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers/cc25e790-d850-4fda-9954-21d458c3676c" status: 200 len: 1278 microversion: 2.1 time: 0.253670 Aug 31 16:18:03.380299 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2776/5368] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:03 2022] GET /compute/v2.1/servers/cc25e790-d850-4fda-9954-21d458c3676c => generated 1278 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:03.464153 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-ada27821-da4d-42c1-aad9-4a6243daaf57 req-48c33445-1e72-4148-a719-cf1b1683c82d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a398032b-3def-4df0-bb77-550d29e5be00", "tag": "42a5fd88-1045-4f59-8c7b-feb51537995f"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:18:03.490915 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ada27821-da4d-42c1-aad9-4a6243daaf57 req-48c33445-1e72-4148-a719-cf1b1683c82d service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:03.491646 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ada27821-da4d-42c1-aad9-4a6243daaf57 req-48c33445-1e72-4148-a719-cf1b1683c82d service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:03.492230 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ada27821-da4d-42c1-aad9-4a6243daaf57 req-48c33445-1e72-4148-a719-cf1b1683c82d service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:03.507096 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-ada27821-da4d-42c1-aad9-4a6243daaf57 req-48c33445-1e72-4148-a719-cf1b1683c82d service nova] Creating event network-changed:42a5fd88-1045-4f59-8c7b-feb51537995f for instance a398032b-3def-4df0-bb77-550d29e5be00 on n-h1-833090-16 Aug 31 16:18:03.514637 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-ada27821-da4d-42c1-aad9-4a6243daaf57 req-48c33445-1e72-4148-a719-cf1b1683c82d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055846 Aug 31 16:18:03.515815 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2593/5369] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:18:03.683843 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-43fef40a-fe38-4167-a8d2-d04db5be971c tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:03.684927 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-43fef40a-fe38-4167-a8d2-d04db5be971c tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:03.691741 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-43fef40a-fe38-4167-a8d2-d04db5be971c tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:03.692232 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-43fef40a-fe38-4167-a8d2-d04db5be971c tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:03.692878 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-43fef40a-fe38-4167-a8d2-d04db5be971c tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:03.693556 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-43fef40a-fe38-4167-a8d2-d04db5be971c tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:03.694209 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-43fef40a-fe38-4167-a8d2-d04db5be971c tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:03.695037 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-43fef40a-fe38-4167-a8d2-d04db5be971c tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:03.720689 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-43fef40a-fe38-4167-a8d2-d04db5be971c tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d/ips" status: 200 len: 150 microversion: 2.20 time: 0.040977 Aug 31 16:18:03.728718 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2777/5370] 10.222.0.50 () {60 vars in 1289 bytes} [Wed Aug 31 16:18:03 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:18:04.388078 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e406868c-1ad7-4bb8-99f5-111d8feebabe tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:04.389529 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e406868c-1ad7-4bb8-99f5-111d8feebabe tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] [instance: cc25e790-d850-4fda-9954-21d458c3676c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:04.398769 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e406868c-1ad7-4bb8-99f5-111d8feebabe tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:04.399502 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e406868c-1ad7-4bb8-99f5-111d8feebabe tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:04.400197 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e406868c-1ad7-4bb8-99f5-111d8feebabe tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:04.401048 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e406868c-1ad7-4bb8-99f5-111d8feebabe tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:04.401503 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e406868c-1ad7-4bb8-99f5-111d8feebabe tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:04.401917 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e406868c-1ad7-4bb8-99f5-111d8feebabe tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:04.588547 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e406868c-1ad7-4bb8-99f5-111d8feebabe tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:04.598114 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e406868c-1ad7-4bb8-99f5-111d8feebabe tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers/cc25e790-d850-4fda-9954-21d458c3676c" status: 200 len: 1320 microversion: 2.1 time: 0.214302 Aug 31 16:18:04.602896 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2594/5371] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:04 2022] GET /compute/v2.1/servers/cc25e790-d850-4fda-9954-21d458c3676c => generated 1320 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:05.150157 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-83c7d273-b3c1-451c-a8b9-91a4f46e2a70 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:18:05.154478 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-83c7d273-b3c1-451c-a8b9-91a4f46e2a70 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: e1cb02b7-1dd6-4c83-9008-e19525731e03] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:05.166451 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83c7d273-b3c1-451c-a8b9-91a4f46e2a70 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:05.172206 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83c7d273-b3c1-451c-a8b9-91a4f46e2a70 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:05.172911 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83c7d273-b3c1-451c-a8b9-91a4f46e2a70 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:05.174013 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83c7d273-b3c1-451c-a8b9-91a4f46e2a70 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:05.174607 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83c7d273-b3c1-451c-a8b9-91a4f46e2a70 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:05.175958 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83c7d273-b3c1-451c-a8b9-91a4f46e2a70 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:05.296230 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-83c7d273-b3c1-451c-a8b9-91a4f46e2a70 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "POST /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03/action" status: 200 len: 63133 microversion: 2.1 time: 0.150187 Aug 31 16:18:05.297685 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2778/5372] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:18:05 2022] POST /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03/action => generated 63133 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:18:05.628596 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e811e08d-9806-44a7-8731-df2f3b74d9ec tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:05.630900 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e811e08d-9806-44a7-8731-df2f3b74d9ec tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] [instance: cc25e790-d850-4fda-9954-21d458c3676c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:05.640619 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:18:05.650154 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:18:05.653017 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e811e08d-9806-44a7-8731-df2f3b74d9ec tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:05.653721 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e811e08d-9806-44a7-8731-df2f3b74d9ec tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:05.654355 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e811e08d-9806-44a7-8731-df2f3b74d9ec tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:05.655239 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e811e08d-9806-44a7-8731-df2f3b74d9ec tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:05.655861 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e811e08d-9806-44a7-8731-df2f3b74d9ec tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:05.656562 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e811e08d-9806-44a7-8731-df2f3b74d9ec tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:05.807611 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-09f75e9c-da26-4053-8a0b-e07ce56b73ef req-5c0ba4cb-4b5e-453a-9252-93dffbe300ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8cc6df1-d4ec-4150-a4be-7f5ed20d64d2", "tag": "e07f4077-2b68-40b6-9fbb-6eaf10f85cf7"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:18:05.854552 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-09f75e9c-da26-4053-8a0b-e07ce56b73ef req-5c0ba4cb-4b5e-453a-9252-93dffbe300ba service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:05.855251 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-09f75e9c-da26-4053-8a0b-e07ce56b73ef req-5c0ba4cb-4b5e-453a-9252-93dffbe300ba service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:05.855837 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-09f75e9c-da26-4053-8a0b-e07ce56b73ef req-5c0ba4cb-4b5e-453a-9252-93dffbe300ba service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:05.883204 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-09f75e9c-da26-4053-8a0b-e07ce56b73ef req-5c0ba4cb-4b5e-453a-9252-93dffbe300ba service nova] Creating event network-changed:e07f4077-2b68-40b6-9fbb-6eaf10f85cf7 for instance e8cc6df1-d4ec-4150-a4be-7f5ed20d64d2 on n-h2-833090-16 Aug 31 16:18:05.897838 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-09f75e9c-da26-4053-8a0b-e07ce56b73ef req-5c0ba4cb-4b5e-453a-9252-93dffbe300ba service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098309 Aug 31 16:18:05.905309 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2779/5373] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:18:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:18:06.188601 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e811e08d-9806-44a7-8731-df2f3b74d9ec tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:06.199456 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e811e08d-9806-44a7-8731-df2f3b74d9ec tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers/cc25e790-d850-4fda-9954-21d458c3676c" status: 200 len: 1320 microversion: 2.1 time: 0.575197 Aug 31 16:18:06.213763 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2595/5374] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:05 2022] GET /compute/v2.1/servers/cc25e790-d850-4fda-9954-21d458c3676c => generated 1320 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:06.807983 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-79c16e14-e25e-4f37-9da6-52a0030f4e5e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:18:06.809471 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-79c16e14-e25e-4f37-9da6-52a0030f4e5e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:06.840618 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-79c16e14-e25e-4f37-9da6-52a0030f4e5e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:06.841112 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-79c16e14-e25e-4f37-9da6-52a0030f4e5e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:06.841923 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-79c16e14-e25e-4f37-9da6-52a0030f4e5e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:06.850366 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-79c16e14-e25e-4f37-9da6-52a0030f4e5e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:06.850961 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-79c16e14-e25e-4f37-9da6-52a0030f4e5e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:06.855163 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-79c16e14-e25e-4f37-9da6-52a0030f4e5e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:06.946833 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-79c16e14-e25e-4f37-9da6-52a0030f4e5e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lazy-loading 'flavor' on Instance uuid 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:18:07.220467 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e65e5ead-ef11-423b-a8ae-30e1f97d827d tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:07.221276 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e65e5ead-ef11-423b-a8ae-30e1f97d827d tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] [instance: cc25e790-d850-4fda-9954-21d458c3676c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:07.228170 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e65e5ead-ef11-423b-a8ae-30e1f97d827d tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:07.228986 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e65e5ead-ef11-423b-a8ae-30e1f97d827d tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:07.241716 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e65e5ead-ef11-423b-a8ae-30e1f97d827d tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:07.251552 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e65e5ead-ef11-423b-a8ae-30e1f97d827d tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:07.254880 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e65e5ead-ef11-423b-a8ae-30e1f97d827d tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:07.255537 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e65e5ead-ef11-423b-a8ae-30e1f97d827d tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:07.405333 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-79c16e14-e25e-4f37-9da6-52a0030f4e5e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "POST /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d/action" status: 202 len: 0 microversion: 2.20 time: 0.601530 Aug 31 16:18:07.405970 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2780/5375] 10.222.0.50 () {62 vars in 1319 bytes} [Wed Aug 31 16:18:06 2022] POST /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d/action => generated 0 bytes in 603 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:18:07.453012 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e4833b3e-1225-4d35-87b8-5fbbfd91c1f2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:07.460926 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e4833b3e-1225-4d35-87b8-5fbbfd91c1f2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:07.489141 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4833b3e-1225-4d35-87b8-5fbbfd91c1f2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:07.492186 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4833b3e-1225-4d35-87b8-5fbbfd91c1f2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:07.493478 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4833b3e-1225-4d35-87b8-5fbbfd91c1f2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:07.494368 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4833b3e-1225-4d35-87b8-5fbbfd91c1f2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:07.495480 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4833b3e-1225-4d35-87b8-5fbbfd91c1f2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:07.498761 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4833b3e-1225-4d35-87b8-5fbbfd91c1f2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:07.942356 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e65e5ead-ef11-423b-a8ae-30e1f97d827d tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:07.958904 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e4833b3e-1225-4d35-87b8-5fbbfd91c1f2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:07.991344 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e65e5ead-ef11-423b-a8ae-30e1f97d827d tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers/cc25e790-d850-4fda-9954-21d458c3676c" status: 200 len: 1320 microversion: 2.1 time: 0.774906 Aug 31 16:18:07.995541 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e4833b3e-1225-4d35-87b8-5fbbfd91c1f2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:07.996271 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2596/5376] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:07 2022] GET /compute/v2.1/servers/cc25e790-d850-4fda-9954-21d458c3676c => generated 1320 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:18:07.999923 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e4833b3e-1225-4d35-87b8-5fbbfd91c1f2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:08.008690 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e4833b3e-1225-4d35-87b8-5fbbfd91c1f2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1721 microversion: 2.20 time: 0.589537 Aug 31 16:18:08.009722 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2781/5377] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:18:07 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1721 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:18:08.027683 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-0da8fc16-7e85-49cb-820c-a962980243cf req-96a27df3-a97f-4ec1-b010-9a80a1b3d430 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc25e790-d850-4fda-9954-21d458c3676c", "tag": "e7c462aa-2f77-48ac-ac7e-a528f82350a6"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:18:08.050144 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-0da8fc16-7e85-49cb-820c-a962980243cf req-96a27df3-a97f-4ec1-b010-9a80a1b3d430 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:08.050632 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-0da8fc16-7e85-49cb-820c-a962980243cf req-96a27df3-a97f-4ec1-b010-9a80a1b3d430 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:08.051060 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-0da8fc16-7e85-49cb-820c-a962980243cf req-96a27df3-a97f-4ec1-b010-9a80a1b3d430 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:08.072653 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-0da8fc16-7e85-49cb-820c-a962980243cf req-96a27df3-a97f-4ec1-b010-9a80a1b3d430 service nova] Creating event network-changed:e7c462aa-2f77-48ac-ac7e-a528f82350a6 for instance cc25e790-d850-4fda-9954-21d458c3676c on n-h1-833090-16 Aug 31 16:18:08.089304 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-0da8fc16-7e85-49cb-820c-a962980243cf req-96a27df3-a97f-4ec1-b010-9a80a1b3d430 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090966 Aug 31 16:18:08.098064 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2597/5378] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:18:09.024309 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2936f0f9-0034-428d-9248-43d9aeb7f9aa tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:09.026474 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2936f0f9-0034-428d-9248-43d9aeb7f9aa tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] [instance: cc25e790-d850-4fda-9954-21d458c3676c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:09.035356 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7f6ae14f-bcc0-48bc-8378-6b4d129968b9 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:09.036052 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7f6ae14f-bcc0-48bc-8378-6b4d129968b9 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:09.050277 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f6ae14f-bcc0-48bc-8378-6b4d129968b9 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:09.050771 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f6ae14f-bcc0-48bc-8378-6b4d129968b9 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:09.051207 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f6ae14f-bcc0-48bc-8378-6b4d129968b9 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:09.051913 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f6ae14f-bcc0-48bc-8378-6b4d129968b9 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:09.052362 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f6ae14f-bcc0-48bc-8378-6b4d129968b9 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:09.052784 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f6ae14f-bcc0-48bc-8378-6b4d129968b9 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:09.058862 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=4 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:18:09.063538 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2936f0f9-0034-428d-9248-43d9aeb7f9aa tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:09.071134 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2936f0f9-0034-428d-9248-43d9aeb7f9aa tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:09.071789 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2936f0f9-0034-428d-9248-43d9aeb7f9aa tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:09.073241 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2936f0f9-0034-428d-9248-43d9aeb7f9aa tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:09.077265 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2936f0f9-0034-428d-9248-43d9aeb7f9aa tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:09.077806 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2936f0f9-0034-428d-9248-43d9aeb7f9aa tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:09.539055 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7f6ae14f-bcc0-48bc-8378-6b4d129968b9 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:09.549589 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7f6ae14f-bcc0-48bc-8378-6b4d129968b9 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:09.551322 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7f6ae14f-bcc0-48bc-8378-6b4d129968b9 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:09.554475 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7f6ae14f-bcc0-48bc-8378-6b4d129968b9 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1721 microversion: 2.20 time: 0.523419 Aug 31 16:18:09.571120 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2598/5379] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:18:09 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1721 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:18:09.577473 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-54cddd28-87aa-44b5-9afe-7794df5eb01d req-fa8a7f47-3140-4120-b996-46946e4249ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a398032b-3def-4df0-bb77-550d29e5be00", "name": "network-vif-plugged", "status": "completed", "tag": "42a5fd88-1045-4f59-8c7b-feb51537995f"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:18:09.597368 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-54cddd28-87aa-44b5-9afe-7794df5eb01d req-fa8a7f47-3140-4120-b996-46946e4249ce service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:09.598517 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-54cddd28-87aa-44b5-9afe-7794df5eb01d req-fa8a7f47-3140-4120-b996-46946e4249ce service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:09.599709 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-54cddd28-87aa-44b5-9afe-7794df5eb01d req-fa8a7f47-3140-4120-b996-46946e4249ce service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:09.619866 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-54cddd28-87aa-44b5-9afe-7794df5eb01d req-fa8a7f47-3140-4120-b996-46946e4249ce service nova] Creating event network-vif-plugged:42a5fd88-1045-4f59-8c7b-feb51537995f for instance a398032b-3def-4df0-bb77-550d29e5be00 on n-h1-833090-16 Aug 31 16:18:09.632276 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-54cddd28-87aa-44b5-9afe-7794df5eb01d req-fa8a7f47-3140-4120-b996-46946e4249ce service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058818 Aug 31 16:18:09.633440 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2599/5380] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:18:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:18:09.655110 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2936f0f9-0034-428d-9248-43d9aeb7f9aa tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:09.669716 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2936f0f9-0034-428d-9248-43d9aeb7f9aa tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers/cc25e790-d850-4fda-9954-21d458c3676c" status: 200 len: 1320 microversion: 2.1 time: 0.654090 Aug 31 16:18:09.671872 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2782/5381] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:09 2022] GET /compute/v2.1/servers/cc25e790-d850-4fda-9954-21d458c3676c => generated 1320 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:10.186800 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cdf6670d-a6a4-491a-9462-ab627b29739d tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:10.187937 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cdf6670d-a6a4-491a-9462-ab627b29739d tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: bdab1c5f-e128-4ef6-b93d-7ac15002ddbf] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:10.195840 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cdf6670d-a6a4-491a-9462-ab627b29739d tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:10.196697 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cdf6670d-a6a4-491a-9462-ab627b29739d tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:10.197338 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cdf6670d-a6a4-491a-9462-ab627b29739d tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:10.198424 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cdf6670d-a6a4-491a-9462-ab627b29739d tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:10.199130 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cdf6670d-a6a4-491a-9462-ab627b29739d tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:10.199704 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cdf6670d-a6a4-491a-9462-ab627b29739d tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:10.216041 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-cdf6670d-a6a4-491a-9462-ab627b29739d tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] HTTP exception thrown: Instance bdab1c5f-e128-4ef6-b93d-7ac15002ddbf could not be found. Aug 31 16:18:10.218733 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cdf6670d-a6a4-491a-9462-ab627b29739d tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Request method failure captured: Aug 31 16:18:10.218733 n-d-833090-16 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/bdab1c5f-e128-4ef6-b93d-7ac15002ddbf HTTP/1.1 Aug 31 16:18:10.218733 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:18:10.218733 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:18:10.218733 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:18:10.218733 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:18:10.218733 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:18:10.218733 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:18:10.218733 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:18:10.218733 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:18:10.218733 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4kQ0XzwgZzM00K2xfqw4sNWznetRNwtM61dwPFzPgxHVwt6ZQqeyy0IDwJXT8yOdP4-2pSJFf0sLdbRTKSty95v4MPjLoaaRhSqpDob3UUxppJFVkB8ZQH-IsYhc50JLxuO54hEVWRh4jtxjaTwZZjw98G6FCIkizac62ua4tSQ6_s Aug 31 16:18:10.218733 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:18:10.218733 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:18:10.218733 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:18:10.218733 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:18:10.218733 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:18:10.218733 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:18:10.218733 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:18:10.218733 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:18:10.218733 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:18:10.218733 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:18:10.218733 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3e843f3122c14cf8889f26423552792f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3e843f3122c14cf8889f26423552792f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:18:10.218733 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:18:10.218733 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:18:10.218733 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:18:10.218733 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:18:10.218733 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:18:10.218733 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:18:10.218733 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 8b67be53aade4f8c92d6765dd91a4b90 Aug 31 16:18:10.218733 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:18:10.218733 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:18:10.218733 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance bdab1c5f-e128-4ef6-b93d-7ac15002ddbf could not be found. Aug 31 16:18:10.218733 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'bdab1c5f-e128-4ef6-b93d-7ac15002ddbf'} Aug 31 16:18:10.218733 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:18:10.218733 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:18:10.218733 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:18:10.218733 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:18:10.218733 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:18:10.218733 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:18:10.218733 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:18:10.218733 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:18:10.218733 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:18:10.218733 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:18:10.218733 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdab1c5f-e128-4ef6-b93d-7ac15002ddbf could not be found. Aug 31 16:18:10.218733 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:18:10.218733 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:18:10.218733 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:18:10.218733 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:18:10.218733 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:18:10.218733 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:18:10.218733 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:18:10.218733 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:18:10.218733 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:18:10.218733 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:18:10.218733 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:18:10.218733 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:18:10.218733 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:18:10.218733 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:18:10.218733 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:18:10.218733 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:18:10.218733 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:18:10.218733 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:18:10.222957 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdab1c5f-e128-4ef6-b93d-7ac15002ddbf could not be found. Aug 31 16:18:10.222957 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:18:10.222957 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:18:10.222957 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:18:10.222957 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:18:10.222957 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:18:10.222957 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:18:10.222957 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:18:10.222957 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:18:10.222957 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdab1c5f-e128-4ef6-b93d-7ac15002ddbf could not be found. Aug 31 16:18:10.222957 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:18:10.224579 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cdf6670d-a6a4-491a-9462-ab627b29739d tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Returning 404 to user: Instance bdab1c5f-e128-4ef6-b93d-7ac15002ddbf could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:18:10.225453 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cdf6670d-a6a4-491a-9462-ab627b29739d tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "DELETE /compute/v2.1/servers/bdab1c5f-e128-4ef6-b93d-7ac15002ddbf" status: 404 len: 111 microversion: 2.1 time: 0.045137 Aug 31 16:18:10.226072 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2600/5382] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:18:10 2022] DELETE /compute/v2.1/servers/bdab1c5f-e128-4ef6-b93d-7ac15002ddbf => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:18:10.234338 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0e75d836-cb5b-449e-bbbb-07ad093a3c10 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:10.235002 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0e75d836-cb5b-449e-bbbb-07ad093a3c10 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: bdab1c5f-e128-4ef6-b93d-7ac15002ddbf] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:10.237211 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=14 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:18:10.243861 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0e75d836-cb5b-449e-bbbb-07ad093a3c10 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:10.244511 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0e75d836-cb5b-449e-bbbb-07ad093a3c10 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:10.245281 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0e75d836-cb5b-449e-bbbb-07ad093a3c10 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:10.246248 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0e75d836-cb5b-449e-bbbb-07ad093a3c10 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:10.246704 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0e75d836-cb5b-449e-bbbb-07ad093a3c10 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:10.247124 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0e75d836-cb5b-449e-bbbb-07ad093a3c10 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:10.263841 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-0e75d836-cb5b-449e-bbbb-07ad093a3c10 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] HTTP exception thrown: Instance bdab1c5f-e128-4ef6-b93d-7ac15002ddbf could not be found. Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0e75d836-cb5b-449e-bbbb-07ad093a3c10 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Request method failure captured: Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/bdab1c5f-e128-4ef6-b93d-7ac15002ddbf HTTP/1.1 Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4kQ0XzwgZzM00K2xfqw4sNWznetRNwtM61dwPFzPgxHVwt6ZQqeyy0IDwJXT8yOdP4-2pSJFf0sLdbRTKSty95v4MPjLoaaRhSqpDob3UUxppJFVkB8ZQH-IsYhc50JLxuO54hEVWRh4jtxjaTwZZjw98G6FCIkizac62ua4tSQ6_s Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3e843f3122c14cf8889f26423552792f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3e843f3122c14cf8889f26423552792f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 8b67be53aade4f8c92d6765dd91a4b90 Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance bdab1c5f-e128-4ef6-b93d-7ac15002ddbf could not be found. Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'bdab1c5f-e128-4ef6-b93d-7ac15002ddbf'} Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdab1c5f-e128-4ef6-b93d-7ac15002ddbf could not be found. Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdab1c5f-e128-4ef6-b93d-7ac15002ddbf could not be found. Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:18:10.267001 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:18:10.271137 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:18:10.271137 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:18:10.271137 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:18:10.271137 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:18:10.271137 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:18:10.271137 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdab1c5f-e128-4ef6-b93d-7ac15002ddbf could not be found. Aug 31 16:18:10.271137 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:18:10.272658 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0e75d836-cb5b-449e-bbbb-07ad093a3c10 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Returning 404 to user: Instance bdab1c5f-e128-4ef6-b93d-7ac15002ddbf could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:18:10.273656 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0e75d836-cb5b-449e-bbbb-07ad093a3c10 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/bdab1c5f-e128-4ef6-b93d-7ac15002ddbf" status: 404 len: 111 microversion: 2.1 time: 0.043367 Aug 31 16:18:10.275221 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2783/5383] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:10 2022] GET /compute/v2.1/servers/bdab1c5f-e128-4ef6-b93d-7ac15002ddbf => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:18:10.283611 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4edb0add-1370-458e-97bd-c162df0eb3ce tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:10.284107 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4edb0add-1370-458e-97bd-c162df0eb3ce tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:10.291861 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4edb0add-1370-458e-97bd-c162df0eb3ce tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:10.292909 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4edb0add-1370-458e-97bd-c162df0eb3ce tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:10.293908 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4edb0add-1370-458e-97bd-c162df0eb3ce tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:10.294781 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4edb0add-1370-458e-97bd-c162df0eb3ce tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:10.304916 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4edb0add-1370-458e-97bd-c162df0eb3ce tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:10.305539 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4edb0add-1370-458e-97bd-c162df0eb3ce tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:10.361072 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4edb0add-1370-458e-97bd-c162df0eb3ce tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:18:10.389057 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:18:10.498327 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4edb0add-1370-458e-97bd-c162df0eb3ce tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "DELETE /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 204 len: 0 microversion: 2.1 time: 0.217331 Aug 31 16:18:10.499261 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2601/5384] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:18:10 2022] DELETE /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:18:10.507462 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-907bc4a4-2987-4cb8-827c-f65b9a3c01a3 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:10.507880 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-907bc4a4-2987-4cb8-827c-f65b9a3c01a3 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:10.521661 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-907bc4a4-2987-4cb8-827c-f65b9a3c01a3 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:10.522183 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-907bc4a4-2987-4cb8-827c-f65b9a3c01a3 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:10.522781 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-907bc4a4-2987-4cb8-827c-f65b9a3c01a3 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:10.523630 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-907bc4a4-2987-4cb8-827c-f65b9a3c01a3 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:10.524222 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-907bc4a4-2987-4cb8-827c-f65b9a3c01a3 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:10.524841 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-907bc4a4-2987-4cb8-827c-f65b9a3c01a3 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:10.582903 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-49b479aa-bb2a-4df9-bad5-3f9037974d4e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:10.584483 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-49b479aa-bb2a-4df9-bad5-3f9037974d4e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:10.598690 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49b479aa-bb2a-4df9-bad5-3f9037974d4e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:10.600605 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49b479aa-bb2a-4df9-bad5-3f9037974d4e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:10.601307 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49b479aa-bb2a-4df9-bad5-3f9037974d4e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:10.603304 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49b479aa-bb2a-4df9-bad5-3f9037974d4e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:10.607433 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49b479aa-bb2a-4df9-bad5-3f9037974d4e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:10.608373 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49b479aa-bb2a-4df9-bad5-3f9037974d4e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:10.948844 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-49b479aa-bb2a-4df9-bad5-3f9037974d4e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:10.961030 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-49b479aa-bb2a-4df9-bad5-3f9037974d4e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:10.966557 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-49b479aa-bb2a-4df9-bad5-3f9037974d4e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:10.967887 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-49b479aa-bb2a-4df9-bad5-3f9037974d4e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1721 microversion: 2.20 time: 0.390798 Aug 31 16:18:10.970877 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2602/5385] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:18:10 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1721 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:18:10.982270 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cba7551d-519e-40ae-9917-442fc0ade220 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:10.982900 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cba7551d-519e-40ae-9917-442fc0ade220 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] [instance: cc25e790-d850-4fda-9954-21d458c3676c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:10.987166 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-907bc4a4-2987-4cb8-827c-f65b9a3c01a3 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:11.004425 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-907bc4a4-2987-4cb8-827c-f65b9a3c01a3 tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1512 microversion: 2.1 time: 0.498621 Aug 31 16:18:11.021317 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2784/5386] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:10 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1512 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:11.028480 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cba7551d-519e-40ae-9917-442fc0ade220 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:11.032070 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cba7551d-519e-40ae-9917-442fc0ade220 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:11.033202 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cba7551d-519e-40ae-9917-442fc0ade220 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:11.035686 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cba7551d-519e-40ae-9917-442fc0ade220 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:11.037565 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cba7551d-519e-40ae-9917-442fc0ade220 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:11.038909 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cba7551d-519e-40ae-9917-442fc0ade220 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:11.668946 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cba7551d-519e-40ae-9917-442fc0ade220 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:11.683247 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cba7551d-519e-40ae-9917-442fc0ade220 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers/cc25e790-d850-4fda-9954-21d458c3676c" status: 200 len: 1320 microversion: 2.1 time: 0.711077 Aug 31 16:18:11.689702 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2603/5387] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:10 2022] GET /compute/v2.1/servers/cc25e790-d850-4fda-9954-21d458c3676c => generated 1320 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:11.995543 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-34ee686c-c4fa-4acc-964b-4b444cbf7708 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:11.996115 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-34ee686c-c4fa-4acc-964b-4b444cbf7708 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:12.006675 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-34ee686c-c4fa-4acc-964b-4b444cbf7708 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:12.007182 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-34ee686c-c4fa-4acc-964b-4b444cbf7708 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:12.007625 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-34ee686c-c4fa-4acc-964b-4b444cbf7708 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:12.009951 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-34ee686c-c4fa-4acc-964b-4b444cbf7708 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:12.010751 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-34ee686c-c4fa-4acc-964b-4b444cbf7708 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:12.013367 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-34ee686c-c4fa-4acc-964b-4b444cbf7708 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:12.033886 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1844cea5-bf80-42c4-a597-abd5792e869e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:12.036667 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1844cea5-bf80-42c4-a597-abd5792e869e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:12.051233 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1844cea5-bf80-42c4-a597-abd5792e869e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:12.052607 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1844cea5-bf80-42c4-a597-abd5792e869e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:12.053647 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1844cea5-bf80-42c4-a597-abd5792e869e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:12.054696 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1844cea5-bf80-42c4-a597-abd5792e869e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:12.058031 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1844cea5-bf80-42c4-a597-abd5792e869e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:12.058922 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1844cea5-bf80-42c4-a597-abd5792e869e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:12.417024 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-34ee686c-c4fa-4acc-964b-4b444cbf7708 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:12.431786 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-34ee686c-c4fa-4acc-964b-4b444cbf7708 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:12.433812 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-34ee686c-c4fa-4acc-964b-4b444cbf7708 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:12.437630 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-34ee686c-c4fa-4acc-964b-4b444cbf7708 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1721 microversion: 2.20 time: 0.446880 Aug 31 16:18:12.453298 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2785/5388] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:18:11 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1721 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:18:12.474738 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1844cea5-bf80-42c4-a597-abd5792e869e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:12.488320 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1844cea5-bf80-42c4-a597-abd5792e869e tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1512 microversion: 2.1 time: 0.463731 Aug 31 16:18:12.498201 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2604/5389] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:12 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1512 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:12.714487 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-92b5a874-2271-4be3-ac5d-1c92e3abd1a8 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:12.715458 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-92b5a874-2271-4be3-ac5d-1c92e3abd1a8 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] [instance: cc25e790-d850-4fda-9954-21d458c3676c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:12.723352 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-92b5a874-2271-4be3-ac5d-1c92e3abd1a8 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:12.723932 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-92b5a874-2271-4be3-ac5d-1c92e3abd1a8 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:12.724823 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-92b5a874-2271-4be3-ac5d-1c92e3abd1a8 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:12.725739 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-92b5a874-2271-4be3-ac5d-1c92e3abd1a8 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:12.726419 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-92b5a874-2271-4be3-ac5d-1c92e3abd1a8 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:12.727039 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-92b5a874-2271-4be3-ac5d-1c92e3abd1a8 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:12.959030 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-92b5a874-2271-4be3-ac5d-1c92e3abd1a8 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:12.971701 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-92b5a874-2271-4be3-ac5d-1c92e3abd1a8 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers/cc25e790-d850-4fda-9954-21d458c3676c" status: 200 len: 1320 microversion: 2.1 time: 0.261488 Aug 31 16:18:12.973154 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2786/5390] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:12 2022] GET /compute/v2.1/servers/cc25e790-d850-4fda-9954-21d458c3676c => generated 1320 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:13.465175 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-db8c513e-478f-4cce-8310-bf8c7696d51f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:13.465789 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-db8c513e-478f-4cce-8310-bf8c7696d51f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:13.483501 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db8c513e-478f-4cce-8310-bf8c7696d51f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:13.484209 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db8c513e-478f-4cce-8310-bf8c7696d51f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:13.484820 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db8c513e-478f-4cce-8310-bf8c7696d51f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:13.485802 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db8c513e-478f-4cce-8310-bf8c7696d51f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:13.486455 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db8c513e-478f-4cce-8310-bf8c7696d51f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:13.487123 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db8c513e-478f-4cce-8310-bf8c7696d51f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:13.512760 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8b997f43-516c-4a3c-b8c2-484f04dcee9d tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:13.514033 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8b997f43-516c-4a3c-b8c2-484f04dcee9d tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:13.522015 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b997f43-516c-4a3c-b8c2-484f04dcee9d tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:13.527311 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b997f43-516c-4a3c-b8c2-484f04dcee9d tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:13.527883 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b997f43-516c-4a3c-b8c2-484f04dcee9d tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:13.529361 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b997f43-516c-4a3c-b8c2-484f04dcee9d tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:13.529981 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b997f43-516c-4a3c-b8c2-484f04dcee9d tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:13.530573 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b997f43-516c-4a3c-b8c2-484f04dcee9d tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:13.739760 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8b997f43-516c-4a3c-b8c2-484f04dcee9d tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67be53aade4f8c92d6765dd91a4b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e843f3122c14cf8889f26423552792f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:13.752009 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8b997f43-516c-4a3c-b8c2-484f04dcee9d tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 200 len: 1470 microversion: 2.1 time: 0.243456 Aug 31 16:18:13.781814 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2787/5391] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:13 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 1470 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:13.794702 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-2aa0aac7-eecd-4c64-b012-cc869f96c43e req-f12b4e4e-b708-43b1-91e0-c856060ca303 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b051f4f-6b51-4ca7-9afd-6d75682e7f52", "name": "network-vif-deleted", "tag": "5c653659-ac4d-41e4-8b0a-b35ade932e62"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:18:13.824512 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-2aa0aac7-eecd-4c64-b012-cc869f96c43e req-f12b4e4e-b708-43b1-91e0-c856060ca303 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:13.826738 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-2aa0aac7-eecd-4c64-b012-cc869f96c43e req-f12b4e4e-b708-43b1-91e0-c856060ca303 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:13.827399 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-2aa0aac7-eecd-4c64-b012-cc869f96c43e req-f12b4e4e-b708-43b1-91e0-c856060ca303 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:13.861348 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:18:13.868123 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-2aa0aac7-eecd-4c64-b012-cc869f96c43e req-f12b4e4e-b708-43b1-91e0-c856060ca303 service nova] Creating event network-vif-deleted:5c653659-ac4d-41e4-8b0a-b35ade932e62 for instance 4b051f4f-6b51-4ca7-9afd-6d75682e7f52 on n-h1-833090-16 Aug 31 16:18:13.875065 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-db8c513e-478f-4cce-8310-bf8c7696d51f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:13.884086 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-db8c513e-478f-4cce-8310-bf8c7696d51f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:13.886250 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-db8c513e-478f-4cce-8310-bf8c7696d51f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:13.890186 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-2aa0aac7-eecd-4c64-b012-cc869f96c43e req-f12b4e4e-b708-43b1-91e0-c856060ca303 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106457 Aug 31 16:18:13.891121 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2788/5392] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:18:13.898747 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-db8c513e-478f-4cce-8310-bf8c7696d51f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1721 microversion: 2.20 time: 0.437657 Aug 31 16:18:13.899218 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2605/5393] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:18:13 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1721 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:18:13.900606 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-bfbc1306-6d1f-4e9b-8554-bad21e35ebe6 req-67ad2131-5fc2-464d-aca4-dbbbd319e280 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8cc6df1-d4ec-4150-a4be-7f5ed20d64d2", "name": "network-vif-plugged", "status": "completed", "tag": "e07f4077-2b68-40b6-9fbb-6eaf10f85cf7"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:18:13.911620 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-bfbc1306-6d1f-4e9b-8554-bad21e35ebe6 req-67ad2131-5fc2-464d-aca4-dbbbd319e280 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:13.912125 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-bfbc1306-6d1f-4e9b-8554-bad21e35ebe6 req-67ad2131-5fc2-464d-aca4-dbbbd319e280 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:13.912738 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-bfbc1306-6d1f-4e9b-8554-bad21e35ebe6 req-67ad2131-5fc2-464d-aca4-dbbbd319e280 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:13.928512 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-bfbc1306-6d1f-4e9b-8554-bad21e35ebe6 req-67ad2131-5fc2-464d-aca4-dbbbd319e280 service nova] Creating event network-vif-plugged:e07f4077-2b68-40b6-9fbb-6eaf10f85cf7 for instance e8cc6df1-d4ec-4150-a4be-7f5ed20d64d2 on n-h2-833090-16 Aug 31 16:18:13.934578 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-bfbc1306-6d1f-4e9b-8554-bad21e35ebe6 req-67ad2131-5fc2-464d-aca4-dbbbd319e280 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041945 Aug 31 16:18:13.935114 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2789/5394] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:18:13.999471 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-391d2b61-e1f8-49c9-8afd-fff64c45b2ff tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:14.000081 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-391d2b61-e1f8-49c9-8afd-fff64c45b2ff tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] [instance: cc25e790-d850-4fda-9954-21d458c3676c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:14.018978 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-391d2b61-e1f8-49c9-8afd-fff64c45b2ff tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:14.019473 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-391d2b61-e1f8-49c9-8afd-fff64c45b2ff tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:14.020793 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-391d2b61-e1f8-49c9-8afd-fff64c45b2ff tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:14.020793 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-391d2b61-e1f8-49c9-8afd-fff64c45b2ff tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:14.021504 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-391d2b61-e1f8-49c9-8afd-fff64c45b2ff tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:14.021504 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-391d2b61-e1f8-49c9-8afd-fff64c45b2ff tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:14.182334 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-391d2b61-e1f8-49c9-8afd-fff64c45b2ff tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:14.191370 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-391d2b61-e1f8-49c9-8afd-fff64c45b2ff tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers/cc25e790-d850-4fda-9954-21d458c3676c" status: 200 len: 1320 microversion: 2.1 time: 0.202562 Aug 31 16:18:14.206457 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2606/5395] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:13 2022] GET /compute/v2.1/servers/cc25e790-d850-4fda-9954-21d458c3676c => generated 1320 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:14.777024 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e390c4df-96ef-4b58-9f22-4c43f96ccd8a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:14.778502 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e390c4df-96ef-4b58-9f22-4c43f96ccd8a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] [instance: 4b051f4f-6b51-4ca7-9afd-6d75682e7f52] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:14.785475 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e390c4df-96ef-4b58-9f22-4c43f96ccd8a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:14.786357 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e390c4df-96ef-4b58-9f22-4c43f96ccd8a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:14.787044 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e390c4df-96ef-4b58-9f22-4c43f96ccd8a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:14.787970 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e390c4df-96ef-4b58-9f22-4c43f96ccd8a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:14.788888 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e390c4df-96ef-4b58-9f22-4c43f96ccd8a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:14.789612 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e390c4df-96ef-4b58-9f22-4c43f96ccd8a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:14.806616 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-e390c4df-96ef-4b58-9f22-4c43f96ccd8a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] HTTP exception thrown: Instance 4b051f4f-6b51-4ca7-9afd-6d75682e7f52 could not be found. Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e390c4df-96ef-4b58-9f22-4c43f96ccd8a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Request method failure captured: Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 HTTP/1.1 Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4kQ0XzwgZzM00K2xfqw4sNWznetRNwtM61dwPFzPgxHVwt6ZQqeyy0IDwJXT8yOdP4-2pSJFf0sLdbRTKSty95v4MPjLoaaRhSqpDob3UUxppJFVkB8ZQH-IsYhc50JLxuO54hEVWRh4jtxjaTwZZjw98G6FCIkizac62ua4tSQ6_s Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3e843f3122c14cf8889f26423552792f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3e843f3122c14cf8889f26423552792f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3e843f3122c14cf8889f26423552792f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 3e843f3122c14cf8889f26423552792f Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServersNegativeTestJSON-297501326 Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 8b67be53aade4f8c92d6765dd91a4b90 Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServersNegativeTestJSON-297501326-project Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 4b051f4f-6b51-4ca7-9afd-6d75682e7f52 could not be found. Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '4b051f4f-6b51-4ca7-9afd-6d75682e7f52'} Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b051f4f-6b51-4ca7-9afd-6d75682e7f52 could not be found. Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b051f4f-6b51-4ca7-9afd-6d75682e7f52 could not be found. Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:18:14.808661 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:18:14.812174 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:18:14.812174 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:18:14.812174 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:18:14.812174 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:18:14.812174 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:18:14.812174 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b051f4f-6b51-4ca7-9afd-6d75682e7f52 could not be found. Aug 31 16:18:14.812174 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:18:14.814170 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e390c4df-96ef-4b58-9f22-4c43f96ccd8a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] Returning 404 to user: Instance 4b051f4f-6b51-4ca7-9afd-6d75682e7f52 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:18:14.815382 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e390c4df-96ef-4b58-9f22-4c43f96ccd8a tempest-ServersNegativeTestJSON-297501326 tempest-ServersNegativeTestJSON-297501326-project] 10.222.0.50 "GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52" status: 404 len: 111 microversion: 2.1 time: 0.043675 Aug 31 16:18:14.816047 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2790/5396] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:14 2022] GET /compute/v2.1/servers/4b051f4f-6b51-4ca7-9afd-6d75682e7f52 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:18:14.926687 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-09c65682-e1c8-4e45-a9b3-5efbbc0a0a4e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:14.927302 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-09c65682-e1c8-4e45-a9b3-5efbbc0a0a4e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:14.932358 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:18:14.939302 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09c65682-e1c8-4e45-a9b3-5efbbc0a0a4e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:14.940167 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09c65682-e1c8-4e45-a9b3-5efbbc0a0a4e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:14.940776 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09c65682-e1c8-4e45-a9b3-5efbbc0a0a4e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:14.942533 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09c65682-e1c8-4e45-a9b3-5efbbc0a0a4e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:14.943143 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09c65682-e1c8-4e45-a9b3-5efbbc0a0a4e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:14.943855 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09c65682-e1c8-4e45-a9b3-5efbbc0a0a4e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:15.214399 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3e031aef-660b-45cf-87c5-36faed05bb88 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:15.216259 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3e031aef-660b-45cf-87c5-36faed05bb88 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] [instance: cc25e790-d850-4fda-9954-21d458c3676c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:15.224539 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3e031aef-660b-45cf-87c5-36faed05bb88 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:15.225741 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3e031aef-660b-45cf-87c5-36faed05bb88 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:15.226370 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3e031aef-660b-45cf-87c5-36faed05bb88 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:15.229453 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3e031aef-660b-45cf-87c5-36faed05bb88 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:15.230949 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3e031aef-660b-45cf-87c5-36faed05bb88 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:15.232272 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3e031aef-660b-45cf-87c5-36faed05bb88 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:15.378298 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-09c65682-e1c8-4e45-a9b3-5efbbc0a0a4e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:15.419890 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-09c65682-e1c8-4e45-a9b3-5efbbc0a0a4e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:15.422928 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-09c65682-e1c8-4e45-a9b3-5efbbc0a0a4e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:15.424518 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-09c65682-e1c8-4e45-a9b3-5efbbc0a0a4e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1721 microversion: 2.20 time: 0.505455 Aug 31 16:18:15.427231 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2607/5397] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:18:14 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1721 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:18:15.585720 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3e031aef-660b-45cf-87c5-36faed05bb88 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:15.595950 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3e031aef-660b-45cf-87c5-36faed05bb88 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers/cc25e790-d850-4fda-9954-21d458c3676c" status: 200 len: 1320 microversion: 2.1 time: 0.386855 Aug 31 16:18:15.597383 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2791/5398] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:15 2022] GET /compute/v2.1/servers/cc25e790-d850-4fda-9954-21d458c3676c => generated 1320 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:18:15.950407 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-3f48ae81-9603-4e33-a996-81eb3c6c4128 req-690b9dc7-7e79-437a-9ce2-3d26e90a1907 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc25e790-d850-4fda-9954-21d458c3676c", "name": "network-vif-plugged", "status": "completed", "tag": "e7c462aa-2f77-48ac-ac7e-a528f82350a6"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:18:15.963366 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3f48ae81-9603-4e33-a996-81eb3c6c4128 req-690b9dc7-7e79-437a-9ce2-3d26e90a1907 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:15.963880 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3f48ae81-9603-4e33-a996-81eb3c6c4128 req-690b9dc7-7e79-437a-9ce2-3d26e90a1907 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:15.964318 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3f48ae81-9603-4e33-a996-81eb3c6c4128 req-690b9dc7-7e79-437a-9ce2-3d26e90a1907 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:15.985341 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-3f48ae81-9603-4e33-a996-81eb3c6c4128 req-690b9dc7-7e79-437a-9ce2-3d26e90a1907 service nova] Creating event network-vif-plugged:e7c462aa-2f77-48ac-ac7e-a528f82350a6 for instance cc25e790-d850-4fda-9954-21d458c3676c on n-h1-833090-16 Aug 31 16:18:15.990878 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-3f48ae81-9603-4e33-a996-81eb3c6c4128 req-690b9dc7-7e79-437a-9ce2-3d26e90a1907 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044959 Aug 31 16:18:15.991576 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2608/5399] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:18:16.451107 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9def276d-db3b-4ab3-843d-f378814e17fe tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:16.452492 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9def276d-db3b-4ab3-843d-f378814e17fe tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:16.460332 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9def276d-db3b-4ab3-843d-f378814e17fe tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:16.460826 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9def276d-db3b-4ab3-843d-f378814e17fe tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:16.461961 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9def276d-db3b-4ab3-843d-f378814e17fe tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:16.463367 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9def276d-db3b-4ab3-843d-f378814e17fe tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:16.463834 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9def276d-db3b-4ab3-843d-f378814e17fe tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:16.464268 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9def276d-db3b-4ab3-843d-f378814e17fe tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:16.617484 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cb1957ba-698c-4914-b29d-9f40d603a990 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:16.618324 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cb1957ba-698c-4914-b29d-9f40d603a990 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] [instance: cc25e790-d850-4fda-9954-21d458c3676c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:16.630178 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb1957ba-698c-4914-b29d-9f40d603a990 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:16.630715 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb1957ba-698c-4914-b29d-9f40d603a990 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:16.631637 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb1957ba-698c-4914-b29d-9f40d603a990 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:16.632515 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb1957ba-698c-4914-b29d-9f40d603a990 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:16.633020 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb1957ba-698c-4914-b29d-9f40d603a990 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:16.634043 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb1957ba-698c-4914-b29d-9f40d603a990 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:16.920235 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9def276d-db3b-4ab3-843d-f378814e17fe tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:16.936213 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9def276d-db3b-4ab3-843d-f378814e17fe tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:16.940793 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9def276d-db3b-4ab3-843d-f378814e17fe tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:16.941664 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9def276d-db3b-4ab3-843d-f378814e17fe tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1721 microversion: 2.20 time: 0.496095 Aug 31 16:18:16.944491 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2792/5400] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:18:16 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1721 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:18:17.085129 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cb1957ba-698c-4914-b29d-9f40d603a990 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:17.093632 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cb1957ba-698c-4914-b29d-9f40d603a990 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers/cc25e790-d850-4fda-9954-21d458c3676c" status: 200 len: 1320 microversion: 2.1 time: 0.480518 Aug 31 16:18:17.103163 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2609/5401] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:16 2022] GET /compute/v2.1/servers/cc25e790-d850-4fda-9954-21d458c3676c => generated 1320 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:17.968606 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-66c8118a-dea1-47f3-92dd-9488cd5dc71b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:17.970543 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-66c8118a-dea1-47f3-92dd-9488cd5dc71b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:17.985711 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-66c8118a-dea1-47f3-92dd-9488cd5dc71b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:17.986778 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-66c8118a-dea1-47f3-92dd-9488cd5dc71b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:17.990046 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-66c8118a-dea1-47f3-92dd-9488cd5dc71b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:17.992477 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-66c8118a-dea1-47f3-92dd-9488cd5dc71b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:17.996199 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-66c8118a-dea1-47f3-92dd-9488cd5dc71b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:17.997480 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-66c8118a-dea1-47f3-92dd-9488cd5dc71b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:18.115985 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c710fea1-7aa1-4266-854e-a48a21eacec8 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:18.116609 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c710fea1-7aa1-4266-854e-a48a21eacec8 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] [instance: cc25e790-d850-4fda-9954-21d458c3676c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:18.129889 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c710fea1-7aa1-4266-854e-a48a21eacec8 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:18.130707 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c710fea1-7aa1-4266-854e-a48a21eacec8 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:18.132731 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c710fea1-7aa1-4266-854e-a48a21eacec8 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:18.136507 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c710fea1-7aa1-4266-854e-a48a21eacec8 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:18.137309 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c710fea1-7aa1-4266-854e-a48a21eacec8 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:18.137900 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c710fea1-7aa1-4266-854e-a48a21eacec8 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:18.538616 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-66c8118a-dea1-47f3-92dd-9488cd5dc71b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:18.551149 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-66c8118a-dea1-47f3-92dd-9488cd5dc71b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:18.552998 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-66c8118a-dea1-47f3-92dd-9488cd5dc71b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:18.557884 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-66c8118a-dea1-47f3-92dd-9488cd5dc71b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1721 microversion: 2.20 time: 0.594026 Aug 31 16:18:18.563204 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2793/5402] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:18:17 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1721 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:18:18.641483 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c710fea1-7aa1-4266-854e-a48a21eacec8 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:18.652030 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c710fea1-7aa1-4266-854e-a48a21eacec8 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers/cc25e790-d850-4fda-9954-21d458c3676c" status: 200 len: 1512 microversion: 2.1 time: 0.539781 Aug 31 16:18:18.652650 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2610/5403] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:18 2022] GET /compute/v2.1/servers/cc25e790-d850-4fda-9954-21d458c3676c => generated 1512 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:18.687146 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-06f62582-0c65-4d76-8174-bfb287d425df tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:18.687952 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-06f62582-0c65-4d76-8174-bfb287d425df tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] [instance: a398032b-3def-4df0-bb77-550d29e5be00] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:18.709384 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06f62582-0c65-4d76-8174-bfb287d425df tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:18.719872 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06f62582-0c65-4d76-8174-bfb287d425df tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:18.722069 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06f62582-0c65-4d76-8174-bfb287d425df tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:18.726973 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06f62582-0c65-4d76-8174-bfb287d425df tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:18.727683 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06f62582-0c65-4d76-8174-bfb287d425df tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:18.728237 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06f62582-0c65-4d76-8174-bfb287d425df tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:19.585823 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f9a2ac83-2d6c-46f4-87a1-8099f01da06a tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:19.587487 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f9a2ac83-2d6c-46f4-87a1-8099f01da06a tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:19.604299 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9a2ac83-2d6c-46f4-87a1-8099f01da06a tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:19.604989 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9a2ac83-2d6c-46f4-87a1-8099f01da06a tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:19.605559 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9a2ac83-2d6c-46f4-87a1-8099f01da06a tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:19.606462 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9a2ac83-2d6c-46f4-87a1-8099f01da06a tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:19.607039 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9a2ac83-2d6c-46f4-87a1-8099f01da06a tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:19.607591 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9a2ac83-2d6c-46f4-87a1-8099f01da06a tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:19.717009 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-06f62582-0c65-4d76-8174-bfb287d425df tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:19.728099 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-06f62582-0c65-4d76-8174-bfb287d425df tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers/a398032b-3def-4df0-bb77-550d29e5be00" status: 200 len: 1512 microversion: 2.1 time: 1.055269 Aug 31 16:18:19.729945 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2794/5404] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:18 2022] GET /compute/v2.1/servers/a398032b-3def-4df0-bb77-550d29e5be00 => generated 1512 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:19.753676 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a5fd20ee-64d3-4f7b-aa80-32fa26d4e293 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:19.754673 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a5fd20ee-64d3-4f7b-aa80-32fa26d4e293 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] [instance: e8cc6df1-d4ec-4150-a4be-7f5ed20d64d2] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:19.769185 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5fd20ee-64d3-4f7b-aa80-32fa26d4e293 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:19.769733 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5fd20ee-64d3-4f7b-aa80-32fa26d4e293 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:19.770219 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5fd20ee-64d3-4f7b-aa80-32fa26d4e293 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:19.770945 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5fd20ee-64d3-4f7b-aa80-32fa26d4e293 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:19.771688 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5fd20ee-64d3-4f7b-aa80-32fa26d4e293 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:19.772169 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5fd20ee-64d3-4f7b-aa80-32fa26d4e293 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:19.903889 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f9a2ac83-2d6c-46f4-87a1-8099f01da06a tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:19.919053 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f9a2ac83-2d6c-46f4-87a1-8099f01da06a tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:19.920567 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f9a2ac83-2d6c-46f4-87a1-8099f01da06a tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:19.921809 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f9a2ac83-2d6c-46f4-87a1-8099f01da06a tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1721 microversion: 2.20 time: 0.340235 Aug 31 16:18:19.926416 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2611/5405] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:18:19 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1721 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:18:20.195899 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a5fd20ee-64d3-4f7b-aa80-32fa26d4e293 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:20.206835 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a5fd20ee-64d3-4f7b-aa80-32fa26d4e293 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers/e8cc6df1-d4ec-4150-a4be-7f5ed20d64d2" status: 200 len: 1512 microversion: 2.1 time: 0.457544 Aug 31 16:18:20.209422 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2795/5406] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:19 2022] GET /compute/v2.1/servers/e8cc6df1-d4ec-4150-a4be-7f5ed20d64d2 => generated 1512 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:20.231083 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b4bbe305-2479-4f5a-878e-abf600430238 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:20.237570 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b4bbe305-2479-4f5a-878e-abf600430238 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:20.238477 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b4bbe305-2479-4f5a-878e-abf600430238 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '78689045e6c945108c966ba3cbeb5216'} {{(pid=128863) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:18:20.267547 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4bbe305-2479-4f5a-878e-abf600430238 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:20.271602 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4bbe305-2479-4f5a-878e-abf600430238 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:20.272034 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4bbe305-2479-4f5a-878e-abf600430238 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:20.272808 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4bbe305-2479-4f5a-878e-abf600430238 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:20.273265 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4bbe305-2479-4f5a-878e-abf600430238 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:20.273681 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4bbe305-2479-4f5a-878e-abf600430238 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:20.445814 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.multi_cell_list [None req-b4bbe305-2479-4f5a-878e-abf600430238 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128863) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:18:20.592882 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b4bbe305-2479-4f5a-878e-abf600430238 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:20.623682 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4bbe305-2479-4f5a-878e-abf600430238 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:20.624555 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4bbe305-2479-4f5a-878e-abf600430238 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:20.625199 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4bbe305-2479-4f5a-878e-abf600430238 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:20.941831 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b4bbe305-2479-4f5a-878e-abf600430238 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 0.715237 Aug 31 16:18:20.949090 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2612/5407] 10.222.0.50 () {58 vars in 1167 bytes} [Wed Aug 31 16:18:20 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:20.950405 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-218aae7c-6abf-4a9e-8767-dbcfb289302d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:20.952823 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-218aae7c-6abf-4a9e-8767-dbcfb289302d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:20.959205 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-218aae7c-6abf-4a9e-8767-dbcfb289302d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:20.968854 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-218aae7c-6abf-4a9e-8767-dbcfb289302d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:20.969526 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-218aae7c-6abf-4a9e-8767-dbcfb289302d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:20.970536 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-218aae7c-6abf-4a9e-8767-dbcfb289302d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:20.977753 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-705b9f73-24e3-47c4-8c78-8191f5049b7c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:20.983171 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-705b9f73-24e3-47c4-8c78-8191f5049b7c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:20.983498 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-218aae7c-6abf-4a9e-8767-dbcfb289302d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:20.984265 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-218aae7c-6abf-4a9e-8767-dbcfb289302d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:20.989437 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-705b9f73-24e3-47c4-8c78-8191f5049b7c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-2020395549', 'deleted': False, 'project_id': '78689045e6c945108c966ba3cbeb5216'} {{(pid=128863) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:18:20.997042 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-705b9f73-24e3-47c4-8c78-8191f5049b7c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:21.000536 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-705b9f73-24e3-47c4-8c78-8191f5049b7c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:21.001128 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-705b9f73-24e3-47c4-8c78-8191f5049b7c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:21.002071 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-705b9f73-24e3-47c4-8c78-8191f5049b7c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:21.003477 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-705b9f73-24e3-47c4-8c78-8191f5049b7c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:21.019592 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-705b9f73-24e3-47c4-8c78-8191f5049b7c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:21.298292 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.multi_cell_list [None req-705b9f73-24e3-47c4-8c78-8191f5049b7c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128863) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:18:21.410425 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-705b9f73-24e3-47c4-8c78-8191f5049b7c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:21.417941 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-705b9f73-24e3-47c4-8c78-8191f5049b7c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:21.418829 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-705b9f73-24e3-47c4-8c78-8191f5049b7c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:21.419480 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-705b9f73-24e3-47c4-8c78-8191f5049b7c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:21.452999 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-218aae7c-6abf-4a9e-8767-dbcfb289302d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:21.465177 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-218aae7c-6abf-4a9e-8767-dbcfb289302d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:21.467422 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-218aae7c-6abf-4a9e-8767-dbcfb289302d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:21.469605 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-218aae7c-6abf-4a9e-8767-dbcfb289302d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1721 microversion: 2.20 time: 0.524729 Aug 31 16:18:21.470745 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2796/5408] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:18:20 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1721 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:18:21.628637 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-705b9f73-24e3-47c4-8c78-8191f5049b7c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-2020395549" status: 200 len: 1515 microversion: 2.1 time: 0.654773 Aug 31 16:18:21.639033 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2613/5409] 10.222.0.50 () {58 vars in 1263 bytes} [Wed Aug 31 16:18:20 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-2020395549 => generated 1515 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:21.656396 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ba76993a-bf6d-42f7-aff4-f6129cbb6697 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:21.662076 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ba76993a-bf6d-42f7-aff4-f6129cbb6697 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:21.663275 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ba76993a-bf6d-42f7-aff4-f6129cbb6697 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '78689045e6c945108c966ba3cbeb5216'} {{(pid=128864) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:18:21.670727 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ba76993a-bf6d-42f7-aff4-f6129cbb6697 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:21.671630 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ba76993a-bf6d-42f7-aff4-f6129cbb6697 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:21.672211 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ba76993a-bf6d-42f7-aff4-f6129cbb6697 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:21.673111 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ba76993a-bf6d-42f7-aff4-f6129cbb6697 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:21.673708 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ba76993a-bf6d-42f7-aff4-f6129cbb6697 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:21.674311 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ba76993a-bf6d-42f7-aff4-f6129cbb6697 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:21.802071 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.multi_cell_list [None req-ba76993a-bf6d-42f7-aff4-f6129cbb6697 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128864) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:18:21.909778 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ba76993a-bf6d-42f7-aff4-f6129cbb6697 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:21.919724 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ba76993a-bf6d-42f7-aff4-f6129cbb6697 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:21.920519 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ba76993a-bf6d-42f7-aff4-f6129cbb6697 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:21.921129 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ba76993a-bf6d-42f7-aff4-f6129cbb6697 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:22.244855 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ba76993a-bf6d-42f7-aff4-f6129cbb6697 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4519 microversion: 2.1 time: 0.592624 Aug 31 16:18:22.245524 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2797/5410] 10.222.0.50 () {58 vars in 1173 bytes} [Wed Aug 31 16:18:21 2022] GET /compute/v2.1/servers/detail?status=active => generated 4519 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:22.277105 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-44d47118-4f64-4ad6-b465-1f72070eb9d7 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:22.283027 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-44d47118-4f64-4ad6-b465-1f72070eb9d7 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:22.283600 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.compute.servers [None req-44d47118-4f64-4ad6-b465-1f72070eb9d7 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Removing options 'limit' from query {{(pid=128863) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 31 16:18:22.289432 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-44d47118-4f64-4ad6-b465-1f72070eb9d7 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Searching by: {'deleted': False, 'project_id': '78689045e6c945108c966ba3cbeb5216'} {{(pid=128863) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:18:22.301947 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44d47118-4f64-4ad6-b465-1f72070eb9d7 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:22.302440 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44d47118-4f64-4ad6-b465-1f72070eb9d7 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:22.303864 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44d47118-4f64-4ad6-b465-1f72070eb9d7 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:22.304780 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44d47118-4f64-4ad6-b465-1f72070eb9d7 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:22.306229 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44d47118-4f64-4ad6-b465-1f72070eb9d7 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:22.314296 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44d47118-4f64-4ad6-b465-1f72070eb9d7 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:22.412907 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-44d47118-4f64-4ad6-b465-1f72070eb9d7 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:22.459029 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44d47118-4f64-4ad6-b465-1f72070eb9d7 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:22.473108 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44d47118-4f64-4ad6-b465-1f72070eb9d7 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:22.474330 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44d47118-4f64-4ad6-b465-1f72070eb9d7 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:22.499825 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-211e465d-d484-4589-92e3-ae2bd2882de3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:22.501031 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-211e465d-d484-4589-92e3-ae2bd2882de3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:22.509263 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-211e465d-d484-4589-92e3-ae2bd2882de3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:22.509915 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-211e465d-d484-4589-92e3-ae2bd2882de3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:22.510731 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-211e465d-d484-4589-92e3-ae2bd2882de3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:22.511834 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-211e465d-d484-4589-92e3-ae2bd2882de3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:22.512544 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-211e465d-d484-4589-92e3-ae2bd2882de3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:22.513347 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-211e465d-d484-4589-92e3-ae2bd2882de3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:22.976989 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-211e465d-d484-4589-92e3-ae2bd2882de3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:22.991778 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-211e465d-d484-4589-92e3-ae2bd2882de3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:22.996625 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-211e465d-d484-4589-92e3-ae2bd2882de3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:22.997978 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-211e465d-d484-4589-92e3-ae2bd2882de3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1721 microversion: 2.20 time: 0.502258 Aug 31 16:18:23.014119 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2798/5411] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:18:22 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1721 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:18:23.048526 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-44d47118-4f64-4ad6-b465-1f72070eb9d7 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 0.779082 Aug 31 16:18:23.049130 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2614/5412] 10.222.0.50 () {58 vars in 1161 bytes} [Wed Aug 31 16:18:22 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:23.071730 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-323340f1-aff8-4388-9a86-76cbd4a4839c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:23.077441 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-323340f1-aff8-4388-9a86-76cbd4a4839c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:23.081045 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-323340f1-aff8-4388-9a86-76cbd4a4839c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '78689045e6c945108c966ba3cbeb5216'} {{(pid=128864) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:18:23.096953 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-323340f1-aff8-4388-9a86-76cbd4a4839c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:23.097533 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-323340f1-aff8-4388-9a86-76cbd4a4839c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:23.100225 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-323340f1-aff8-4388-9a86-76cbd4a4839c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:23.101221 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-323340f1-aff8-4388-9a86-76cbd4a4839c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:23.103825 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-323340f1-aff8-4388-9a86-76cbd4a4839c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:23.105132 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-323340f1-aff8-4388-9a86-76cbd4a4839c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:23.369706 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.multi_cell_list [None req-323340f1-aff8-4388-9a86-76cbd4a4839c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128864) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:18:23.477368 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-323340f1-aff8-4388-9a86-76cbd4a4839c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.410054 Aug 31 16:18:23.478940 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2799/5413] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Aug 31 16:18:23 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:23.496144 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c9453b39-8a36-4ca9-b262-b4a9a446112b tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:23.510155 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c9453b39-8a36-4ca9-b262-b4a9a446112b tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:23.510611 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.compute.servers [None req-c9453b39-8a36-4ca9-b262-b4a9a446112b tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Removing options 'limit' from query {{(pid=128863) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 31 16:18:23.511276 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c9453b39-8a36-4ca9-b262-b4a9a446112b tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Searching by: {'deleted': False, 'project_id': '78689045e6c945108c966ba3cbeb5216'} {{(pid=128863) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:18:23.525380 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9453b39-8a36-4ca9-b262-b4a9a446112b tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:23.525859 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9453b39-8a36-4ca9-b262-b4a9a446112b tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:23.531620 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9453b39-8a36-4ca9-b262-b4a9a446112b tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:23.538150 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9453b39-8a36-4ca9-b262-b4a9a446112b tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:23.538656 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9453b39-8a36-4ca9-b262-b4a9a446112b tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:23.539102 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9453b39-8a36-4ca9-b262-b4a9a446112b tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:23.581786 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.multi_cell_list [None req-c9453b39-8a36-4ca9-b262-b4a9a446112b tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128863) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:18:23.634790 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c9453b39-8a36-4ca9-b262-b4a9a446112b tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.143206 Aug 31 16:18:23.636457 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2615/5414] 10.222.0.50 () {58 vars in 1150 bytes} [Wed Aug 31 16:18:23 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:23.648212 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-724ecbaf-cf0b-4076-99bf-19532793acc1 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:23.653514 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-724ecbaf-cf0b-4076-99bf-19532793acc1 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:23.657404 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-724ecbaf-cf0b-4076-99bf-19532793acc1 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Searching by: {'deleted': False, 'project_id': '78689045e6c945108c966ba3cbeb5216'} {{(pid=128864) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:18:23.674002 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-724ecbaf-cf0b-4076-99bf-19532793acc1 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:23.674883 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-724ecbaf-cf0b-4076-99bf-19532793acc1 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:23.677328 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-724ecbaf-cf0b-4076-99bf-19532793acc1 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:23.678225 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-724ecbaf-cf0b-4076-99bf-19532793acc1 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:23.678810 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-724ecbaf-cf0b-4076-99bf-19532793acc1 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:23.679331 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-724ecbaf-cf0b-4076-99bf-19532793acc1 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:23.725528 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.multi_cell_list [None req-724ecbaf-cf0b-4076-99bf-19532793acc1 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128864) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:18:23.804094 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-724ecbaf-cf0b-4076-99bf-19532793acc1 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.160310 Aug 31 16:18:23.808686 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2800/5415] 10.222.0.50 () {58 vars in 1125 bytes} [Wed Aug 31 16:18:23 2022] GET /compute/v2.1/servers => generated 1011 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:23.819958 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-861d6bca-6027-4d7a-b0c0-1ef4ee0893bb tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:23.830425 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-861d6bca-6027-4d7a-b0c0-1ef4ee0893bb tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:23.831172 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-861d6bca-6027-4d7a-b0c0-1ef4ee0893bb tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '78689045e6c945108c966ba3cbeb5216'} {{(pid=128863) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:18:23.853394 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-861d6bca-6027-4d7a-b0c0-1ef4ee0893bb tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:23.853880 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-861d6bca-6027-4d7a-b0c0-1ef4ee0893bb tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:23.854385 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-861d6bca-6027-4d7a-b0c0-1ef4ee0893bb tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:23.855101 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-861d6bca-6027-4d7a-b0c0-1ef4ee0893bb tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:23.855542 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-861d6bca-6027-4d7a-b0c0-1ef4ee0893bb tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:23.856555 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-861d6bca-6027-4d7a-b0c0-1ef4ee0893bb tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:23.943280 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:18:23.969820 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.multi_cell_list [None req-861d6bca-6027-4d7a-b0c0-1ef4ee0893bb tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128863) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:18:24.031532 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5e55279d-f364-42db-8c14-ac556bbbb420 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:24.032157 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5e55279d-f364-42db-8c14-ac556bbbb420 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:24.044445 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e55279d-f364-42db-8c14-ac556bbbb420 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:24.045870 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e55279d-f364-42db-8c14-ac556bbbb420 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:24.047197 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e55279d-f364-42db-8c14-ac556bbbb420 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:24.048792 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e55279d-f364-42db-8c14-ac556bbbb420 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:24.049461 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e55279d-f364-42db-8c14-ac556bbbb420 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:24.051105 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e55279d-f364-42db-8c14-ac556bbbb420 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:24.066728 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-861d6bca-6027-4d7a-b0c0-1ef4ee0893bb tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.250839 Aug 31 16:18:24.074546 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2616/5416] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 31 16:18:23 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:18:24.088360 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-60c8d582-f73c-423c-a507-d335aecbc699 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:24.103499 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-60c8d582-f73c-423c-a507-d335aecbc699 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:24.103996 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.compute.servers [None req-60c8d582-f73c-423c-a507-d335aecbc699 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Removing options 'limit' from query {{(pid=128863) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 31 16:18:24.104729 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-60c8d582-f73c-423c-a507-d335aecbc699 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Searching by: {'deleted': False, 'project_id': '78689045e6c945108c966ba3cbeb5216'} {{(pid=128863) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:18:24.112115 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60c8d582-f73c-423c-a507-d335aecbc699 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:24.112715 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60c8d582-f73c-423c-a507-d335aecbc699 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:24.113197 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60c8d582-f73c-423c-a507-d335aecbc699 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:24.114055 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60c8d582-f73c-423c-a507-d335aecbc699 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:24.114630 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60c8d582-f73c-423c-a507-d335aecbc699 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:24.115130 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60c8d582-f73c-423c-a507-d335aecbc699 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:24.150879 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-60c8d582-f73c-423c-a507-d335aecbc699 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.073351 Aug 31 16:18:24.151479 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2617/5417] 10.222.0.50 () {58 vars in 1140 bytes} [Wed Aug 31 16:18:24 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:18:24.165100 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-98c5be96-96c4-4d08-bdef-f498cbf07f0d tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:24.172218 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-98c5be96-96c4-4d08-bdef-f498cbf07f0d tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:24.173008 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-98c5be96-96c4-4d08-bdef-f498cbf07f0d tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-2020395549', 'deleted': False, 'project_id': '78689045e6c945108c966ba3cbeb5216'} {{(pid=128863) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:18:24.179638 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98c5be96-96c4-4d08-bdef-f498cbf07f0d tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:24.180277 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98c5be96-96c4-4d08-bdef-f498cbf07f0d tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:24.180794 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98c5be96-96c4-4d08-bdef-f498cbf07f0d tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:24.181605 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98c5be96-96c4-4d08-bdef-f498cbf07f0d tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:24.182207 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98c5be96-96c4-4d08-bdef-f498cbf07f0d tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:24.182713 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98c5be96-96c4-4d08-bdef-f498cbf07f0d tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:24.329979 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.multi_cell_list [None req-98c5be96-96c4-4d08-bdef-f498cbf07f0d tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128863) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:18:24.439918 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-98c5be96-96c4-4d08-bdef-f498cbf07f0d tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-2020395549" status: 200 len: 346 microversion: 2.1 time: 0.275554 Aug 31 16:18:24.446782 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2618/5418] 10.222.0.50 () {58 vars in 1242 bytes} [Wed Aug 31 16:18:24 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-2020395549 => generated 346 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:18:24.453235 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c59ce5f1-206d-4646-b4f5-8cc3de6b3bb2 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:18:24.462000 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c59ce5f1-206d-4646-b4f5-8cc3de6b3bb2 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:24.462714 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c59ce5f1-206d-4646-b4f5-8cc3de6b3bb2 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:24.463319 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c59ce5f1-206d-4646-b4f5-8cc3de6b3bb2 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:24.498479 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c59ce5f1-206d-4646-b4f5-8cc3de6b3bb2 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] [instance: a398032b-3def-4df0-bb77-550d29e5be00] Going to try to stop instance {{(pid=128863) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 16:18:24.562402 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c59ce5f1-206d-4646-b4f5-8cc3de6b3bb2 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "POST /compute/v2.1/servers/a398032b-3def-4df0-bb77-550d29e5be00/action" status: 202 len: 0 microversion: 2.1 time: 0.114000 Aug 31 16:18:24.563567 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2619/5419] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:18:24 2022] POST /compute/v2.1/servers/a398032b-3def-4df0-bb77-550d29e5be00/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:18:24.574678 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f7f6396c-7663-4069-83a7-58bb4b326649 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:24.575652 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f7f6396c-7663-4069-83a7-58bb4b326649 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] [instance: a398032b-3def-4df0-bb77-550d29e5be00] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:24.584596 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7f6396c-7663-4069-83a7-58bb4b326649 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:24.585347 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7f6396c-7663-4069-83a7-58bb4b326649 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:24.590671 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5e55279d-f364-42db-8c14-ac556bbbb420 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:24.596181 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7f6396c-7663-4069-83a7-58bb4b326649 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:24.600794 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7f6396c-7663-4069-83a7-58bb4b326649 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:24.603335 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7f6396c-7663-4069-83a7-58bb4b326649 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:24.604246 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7f6396c-7663-4069-83a7-58bb4b326649 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:24.606910 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5e55279d-f364-42db-8c14-ac556bbbb420 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:24.611778 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5e55279d-f364-42db-8c14-ac556bbbb420 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:24.614408 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5e55279d-f364-42db-8c14-ac556bbbb420 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1742 microversion: 2.20 time: 0.587776 Aug 31 16:18:24.648450 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2801/5420] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:18:24 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1742 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:18:25.142371 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f7f6396c-7663-4069-83a7-58bb4b326649 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:25.153076 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f7f6396c-7663-4069-83a7-58bb4b326649 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers/a398032b-3def-4df0-bb77-550d29e5be00" status: 200 len: 1522 microversion: 2.1 time: 0.584482 Aug 31 16:18:25.157284 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2620/5421] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:24 2022] GET /compute/v2.1/servers/a398032b-3def-4df0-bb77-550d29e5be00 => generated 1522 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:25.640747 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9384816c-2785-41ee-84e0-2328c7ac9745 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:25.641559 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9384816c-2785-41ee-84e0-2328c7ac9745 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:25.659452 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9384816c-2785-41ee-84e0-2328c7ac9745 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:25.660771 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9384816c-2785-41ee-84e0-2328c7ac9745 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:25.662268 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9384816c-2785-41ee-84e0-2328c7ac9745 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:25.663241 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9384816c-2785-41ee-84e0-2328c7ac9745 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:25.663714 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9384816c-2785-41ee-84e0-2328c7ac9745 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:25.664150 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9384816c-2785-41ee-84e0-2328c7ac9745 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:25.948795 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9384816c-2785-41ee-84e0-2328c7ac9745 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:25.963575 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9384816c-2785-41ee-84e0-2328c7ac9745 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:25.969787 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9384816c-2785-41ee-84e0-2328c7ac9745 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:25.971347 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9384816c-2785-41ee-84e0-2328c7ac9745 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1737 microversion: 2.20 time: 0.335892 Aug 31 16:18:25.973567 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2802/5422] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:18:25 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1737 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:18:26.177218 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-919992c2-6763-44f7-9dfe-e1c74ff535fb tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:26.178421 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-919992c2-6763-44f7-9dfe-e1c74ff535fb tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] [instance: a398032b-3def-4df0-bb77-550d29e5be00] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:26.190571 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-919992c2-6763-44f7-9dfe-e1c74ff535fb tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:26.192178 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-919992c2-6763-44f7-9dfe-e1c74ff535fb tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:26.194899 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-919992c2-6763-44f7-9dfe-e1c74ff535fb tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:26.196027 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-919992c2-6763-44f7-9dfe-e1c74ff535fb tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:26.196694 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-919992c2-6763-44f7-9dfe-e1c74ff535fb tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:26.197129 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-919992c2-6763-44f7-9dfe-e1c74ff535fb tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:26.997213 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d174f32e-c100-4686-af64-794017a217c2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:26.997825 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d174f32e-c100-4686-af64-794017a217c2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:27.018663 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-919992c2-6763-44f7-9dfe-e1c74ff535fb tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:27.020262 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d174f32e-c100-4686-af64-794017a217c2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:27.026468 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d174f32e-c100-4686-af64-794017a217c2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:27.027079 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d174f32e-c100-4686-af64-794017a217c2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:27.027966 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d174f32e-c100-4686-af64-794017a217c2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:27.028517 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-919992c2-6763-44f7-9dfe-e1c74ff535fb tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers/a398032b-3def-4df0-bb77-550d29e5be00" status: 200 len: 1522 microversion: 2.1 time: 0.855345 Aug 31 16:18:27.028690 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d174f32e-c100-4686-af64-794017a217c2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:27.028991 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d174f32e-c100-4686-af64-794017a217c2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:27.029097 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2621/5423] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:26 2022] GET /compute/v2.1/servers/a398032b-3def-4df0-bb77-550d29e5be00 => generated 1522 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:27.393720 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-0e3a2d39-e6d1-4331-ad48-be38819c34cc req-e7741d98-3aad-4770-906e-c5a2809ea284 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d", "name": "network-vif-plugged", "status": "completed", "tag": "8e4486a0-b7ef-4efa-8a3b-565a37bae537"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:18:27.414616 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-0e3a2d39-e6d1-4331-ad48-be38819c34cc req-e7741d98-3aad-4770-906e-c5a2809ea284 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:27.417261 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-0e3a2d39-e6d1-4331-ad48-be38819c34cc req-e7741d98-3aad-4770-906e-c5a2809ea284 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:27.417887 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-0e3a2d39-e6d1-4331-ad48-be38819c34cc req-e7741d98-3aad-4770-906e-c5a2809ea284 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:27.436991 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d174f32e-c100-4686-af64-794017a217c2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:27.447464 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d174f32e-c100-4686-af64-794017a217c2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:27.453674 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d174f32e-c100-4686-af64-794017a217c2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:27.456483 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d174f32e-c100-4686-af64-794017a217c2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1737 microversion: 2.20 time: 0.462182 Aug 31 16:18:27.456973 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-0e3a2d39-e6d1-4331-ad48-be38819c34cc req-e7741d98-3aad-4770-906e-c5a2809ea284 service nova] Creating event network-vif-plugged:8e4486a0-b7ef-4efa-8a3b-565a37bae537 for instance 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d on n-h1-833090-16 Aug 31 16:18:27.467023 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-0e3a2d39-e6d1-4331-ad48-be38819c34cc req-e7741d98-3aad-4770-906e-c5a2809ea284 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077214 Aug 31 16:18:27.467963 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2622/5424] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:18:27.479157 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2803/5425] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:18:26 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1737 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:18:27.719389 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ca90c70b-3f7b-4fa1-9704-50ea95077df7 tempest-ComputeTenantNetworksTest-844044636 tempest-ComputeTenantNetworksTest-844044636-project] Calling method '.version_select at 0x7fbb45e11af0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:28.003474 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ca90c70b-3f7b-4fa1-9704-50ea95077df7 tempest-ComputeTenantNetworksTest-844044636 tempest-ComputeTenantNetworksTest-844044636-project] 10.222.0.50 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 0.518278 Aug 31 16:18:28.004172 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2623/5426] 10.222.0.50 () {58 vars in 1158 bytes} [Wed Aug 31 16:18:27 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:18:28.021282 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-dcc4ad97-57af-4eaf-89db-80e7086f9c7f tempest-ComputeTenantNetworksTest-844044636 tempest-ComputeTenantNetworksTest-844044636-project] Calling method '.version_select at 0x7fbb4aa5cca0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:28.055024 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d2f42ff3-bdbf-4116-a901-cd8e7a2e80ff tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:28.058287 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d2f42ff3-bdbf-4116-a901-cd8e7a2e80ff tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] [instance: a398032b-3def-4df0-bb77-550d29e5be00] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:28.075135 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2f42ff3-bdbf-4116-a901-cd8e7a2e80ff tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:28.077991 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2f42ff3-bdbf-4116-a901-cd8e7a2e80ff tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:28.078726 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2f42ff3-bdbf-4116-a901-cd8e7a2e80ff tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:28.081311 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2f42ff3-bdbf-4116-a901-cd8e7a2e80ff tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:28.082489 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2f42ff3-bdbf-4116-a901-cd8e7a2e80ff tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:28.083171 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2f42ff3-bdbf-4116-a901-cd8e7a2e80ff tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:28.251507 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-dcc4ad97-57af-4eaf-89db-80e7086f9c7f tempest-ComputeTenantNetworksTest-844044636 tempest-ComputeTenantNetworksTest-844044636-project] 10.222.0.50 "GET /compute/v2.1/os-tenant-networks/293e2c80-b1f4-4831-a2ed-fd45d8bc35ac" status: 200 len: 139 microversion: 2.1 time: 0.239685 Aug 31 16:18:28.252736 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2804/5427] 10.222.0.50 () {58 vars in 1269 bytes} [Wed Aug 31 16:18:28 2022] GET /compute/v2.1/os-tenant-networks/293e2c80-b1f4-4831-a2ed-fd45d8bc35ac => generated 139 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:18:28.257687 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-117bfd42-40e9-462a-85bc-f797299d04d9 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:28.258838 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-117bfd42-40e9-462a-85bc-f797299d04d9 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] [instance: e1cb02b7-1dd6-4c83-9008-e19525731e03] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:28.275516 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-117bfd42-40e9-462a-85bc-f797299d04d9 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:28.276804 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-117bfd42-40e9-462a-85bc-f797299d04d9 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:28.279093 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-117bfd42-40e9-462a-85bc-f797299d04d9 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:28.287425 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-117bfd42-40e9-462a-85bc-f797299d04d9 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:28.288250 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-117bfd42-40e9-462a-85bc-f797299d04d9 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:28.290659 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-117bfd42-40e9-462a-85bc-f797299d04d9 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:28.807104 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d2f42ff3-bdbf-4116-a901-cd8e7a2e80ff tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:28.816522 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d2f42ff3-bdbf-4116-a901-cd8e7a2e80ff tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers/a398032b-3def-4df0-bb77-550d29e5be00" status: 200 len: 1522 microversion: 2.1 time: 0.765023 Aug 31 16:18:28.829036 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2624/5428] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:28 2022] GET /compute/v2.1/servers/a398032b-3def-4df0-bb77-550d29e5be00 => generated 1522 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:18:28.840752 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-739c0c12-30e1-4501-a6c8-fc94a245f7be tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:28.844492 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-739c0c12-30e1-4501-a6c8-fc94a245f7be tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:28.861224 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-739c0c12-30e1-4501-a6c8-fc94a245f7be tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:28.861553 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-739c0c12-30e1-4501-a6c8-fc94a245f7be tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:28.861982 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-739c0c12-30e1-4501-a6c8-fc94a245f7be tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:28.862730 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-739c0c12-30e1-4501-a6c8-fc94a245f7be tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:28.863323 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-739c0c12-30e1-4501-a6c8-fc94a245f7be tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:28.863755 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-739c0c12-30e1-4501-a6c8-fc94a245f7be tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:29.231628 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-117bfd42-40e9-462a-85bc-f797299d04d9 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03" status: 200 len: 1835 microversion: 2.1 time: 0.977629 Aug 31 16:18:29.232779 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2805/5429] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:28 2022] GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03 => generated 1835 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:29.271682 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-739c0c12-30e1-4501-a6c8-fc94a245f7be tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:29.281583 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-739c0c12-30e1-4501-a6c8-fc94a245f7be tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:29.296477 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-739c0c12-30e1-4501-a6c8-fc94a245f7be tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:29.303741 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-739c0c12-30e1-4501-a6c8-fc94a245f7be tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1737 microversion: 2.20 time: 0.472666 Aug 31 16:18:29.305120 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2625/5430] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:18:28 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1737 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:18:29.849608 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-25519ce1-1985-4b90-b37f-cf7dc79290c5 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:29.850254 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-25519ce1-1985-4b90-b37f-cf7dc79290c5 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] [instance: a398032b-3def-4df0-bb77-550d29e5be00] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:29.857060 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-25519ce1-1985-4b90-b37f-cf7dc79290c5 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:29.857553 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-25519ce1-1985-4b90-b37f-cf7dc79290c5 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:29.857987 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-25519ce1-1985-4b90-b37f-cf7dc79290c5 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:29.858756 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-25519ce1-1985-4b90-b37f-cf7dc79290c5 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:29.859205 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-25519ce1-1985-4b90-b37f-cf7dc79290c5 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:29.859700 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-25519ce1-1985-4b90-b37f-cf7dc79290c5 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:29.909798 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=100 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:18:30.297322 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-25519ce1-1985-4b90-b37f-cf7dc79290c5 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:30.309401 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-25519ce1-1985-4b90-b37f-cf7dc79290c5 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers/a398032b-3def-4df0-bb77-550d29e5be00" status: 200 len: 1522 microversion: 2.1 time: 0.463588 Aug 31 16:18:30.327791 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2806/5431] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:29 2022] GET /compute/v2.1/servers/a398032b-3def-4df0-bb77-550d29e5be00 => generated 1522 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:30.340880 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e389be20-319f-4eb5-9b9d-d17ff370ee9e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:30.341609 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e389be20-319f-4eb5-9b9d-d17ff370ee9e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:30.370220 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e389be20-319f-4eb5-9b9d-d17ff370ee9e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:30.370818 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e389be20-319f-4eb5-9b9d-d17ff370ee9e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:30.372745 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e389be20-319f-4eb5-9b9d-d17ff370ee9e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:30.373729 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e389be20-319f-4eb5-9b9d-d17ff370ee9e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:30.374770 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e389be20-319f-4eb5-9b9d-d17ff370ee9e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:30.375699 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e389be20-319f-4eb5-9b9d-d17ff370ee9e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:30.625067 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e389be20-319f-4eb5-9b9d-d17ff370ee9e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:30.637849 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e389be20-319f-4eb5-9b9d-d17ff370ee9e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:30.645112 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e389be20-319f-4eb5-9b9d-d17ff370ee9e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:30.651162 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e389be20-319f-4eb5-9b9d-d17ff370ee9e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1737 microversion: 2.20 time: 0.316476 Aug 31 16:18:30.653288 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2626/5432] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:18:30 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1737 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:18:30.972900 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b833e5b2-ed0c-4e62-9199-7c7935a28166 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:30.973236 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b833e5b2-ed0c-4e62-9199-7c7935a28166 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: e1cb02b7-1dd6-4c83-9008-e19525731e03] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:30.979363 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-ef53aa2a-8652-45c5-9a3b-e0bcf3809592 req-f61c4e52-a906-4006-9785-d44fe9d4aacb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1cb02b7-1dd6-4c83-9008-e19525731e03", "tag": "aad14830-ef68-4e56-bff4-91dbcf99efc3"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:18:30.982648 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b833e5b2-ed0c-4e62-9199-7c7935a28166 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:30.983462 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b833e5b2-ed0c-4e62-9199-7c7935a28166 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:30.984233 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b833e5b2-ed0c-4e62-9199-7c7935a28166 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:30.985655 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b833e5b2-ed0c-4e62-9199-7c7935a28166 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:30.986340 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b833e5b2-ed0c-4e62-9199-7c7935a28166 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:30.986971 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b833e5b2-ed0c-4e62-9199-7c7935a28166 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:31.018543 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ef53aa2a-8652-45c5-9a3b-e0bcf3809592 req-f61c4e52-a906-4006-9785-d44fe9d4aacb service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:31.018963 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ef53aa2a-8652-45c5-9a3b-e0bcf3809592 req-f61c4e52-a906-4006-9785-d44fe9d4aacb service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:31.019391 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ef53aa2a-8652-45c5-9a3b-e0bcf3809592 req-f61c4e52-a906-4006-9785-d44fe9d4aacb service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:31.025728 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b833e5b2-ed0c-4e62-9199-7c7935a28166 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: e1cb02b7-1dd6-4c83-9008-e19525731e03] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:18:31.056446 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-ef53aa2a-8652-45c5-9a3b-e0bcf3809592 req-f61c4e52-a906-4006-9785-d44fe9d4aacb service nova] Creating event network-changed:aad14830-ef68-4e56-bff4-91dbcf99efc3 for instance e1cb02b7-1dd6-4c83-9008-e19525731e03 on n-h2-833090-16 Aug 31 16:18:31.075051 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-ef53aa2a-8652-45c5-9a3b-e0bcf3809592 req-f61c4e52-a906-4006-9785-d44fe9d4aacb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099306 Aug 31 16:18:31.079237 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2627/5433] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:18:31.157275 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b833e5b2-ed0c-4e62-9199-7c7935a28166 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03" status: 204 len: 0 microversion: 2.1 time: 0.189079 Aug 31 16:18:31.160337 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2807/5434] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:18:30 2022] DELETE /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:18:31.169209 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4838475b-16e3-4fa2-8a86-5277dbb3ff47 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:31.170722 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4838475b-16e3-4fa2-8a86-5277dbb3ff47 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: e1cb02b7-1dd6-4c83-9008-e19525731e03] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:31.189260 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4838475b-16e3-4fa2-8a86-5277dbb3ff47 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:31.190168 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4838475b-16e3-4fa2-8a86-5277dbb3ff47 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:31.190629 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4838475b-16e3-4fa2-8a86-5277dbb3ff47 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:31.191474 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4838475b-16e3-4fa2-8a86-5277dbb3ff47 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:31.192079 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4838475b-16e3-4fa2-8a86-5277dbb3ff47 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:31.192574 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4838475b-16e3-4fa2-8a86-5277dbb3ff47 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:31.353756 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9235d41e-9e76-445f-84f7-1b29470f5278 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:31.356398 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9235d41e-9e76-445f-84f7-1b29470f5278 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] [instance: a398032b-3def-4df0-bb77-550d29e5be00] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:31.404610 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9235d41e-9e76-445f-84f7-1b29470f5278 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:31.408838 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9235d41e-9e76-445f-84f7-1b29470f5278 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:31.410317 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9235d41e-9e76-445f-84f7-1b29470f5278 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:31.415515 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9235d41e-9e76-445f-84f7-1b29470f5278 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:31.419236 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9235d41e-9e76-445f-84f7-1b29470f5278 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:31.420445 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9235d41e-9e76-445f-84f7-1b29470f5278 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:31.848822 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4838475b-16e3-4fa2-8a86-5277dbb3ff47 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:31.879270 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4838475b-16e3-4fa2-8a86-5277dbb3ff47 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03" status: 200 len: 1688 microversion: 2.1 time: 0.714967 Aug 31 16:18:31.885975 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2628/5435] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:31 2022] GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03 => generated 1688 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:31.898120 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e4f6eb0d-5b10-40ef-b900-301caadc31e7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:31.899339 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e4f6eb0d-5b10-40ef-b900-301caadc31e7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:31.905917 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4f6eb0d-5b10-40ef-b900-301caadc31e7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:31.907775 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:18:31.908481 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4f6eb0d-5b10-40ef-b900-301caadc31e7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:31.910019 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4f6eb0d-5b10-40ef-b900-301caadc31e7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:31.915988 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4f6eb0d-5b10-40ef-b900-301caadc31e7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:31.916590 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4f6eb0d-5b10-40ef-b900-301caadc31e7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:31.917052 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4f6eb0d-5b10-40ef-b900-301caadc31e7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:32.412378 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:18:32.854182 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9235d41e-9e76-445f-84f7-1b29470f5278 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:32.868908 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9235d41e-9e76-445f-84f7-1b29470f5278 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers/a398032b-3def-4df0-bb77-550d29e5be00" status: 200 len: 1522 microversion: 2.1 time: 1.530812 Aug 31 16:18:32.871145 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2808/5436] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:31 2022] GET /compute/v2.1/servers/a398032b-3def-4df0-bb77-550d29e5be00 => generated 1522 bytes in 1536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:32.915788 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e3a76f0f-f3e5-41ac-8a13-39f6bbd333bc tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:32.916550 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e3a76f0f-f3e5-41ac-8a13-39f6bbd333bc tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: e1cb02b7-1dd6-4c83-9008-e19525731e03] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:32.936567 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e3a76f0f-f3e5-41ac-8a13-39f6bbd333bc tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:32.938261 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e3a76f0f-f3e5-41ac-8a13-39f6bbd333bc tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:32.941201 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e3a76f0f-f3e5-41ac-8a13-39f6bbd333bc tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:32.945047 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e3a76f0f-f3e5-41ac-8a13-39f6bbd333bc tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:32.946968 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e3a76f0f-f3e5-41ac-8a13-39f6bbd333bc tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:32.949222 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e3a76f0f-f3e5-41ac-8a13-39f6bbd333bc tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:32.982033 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e4f6eb0d-5b10-40ef-b900-301caadc31e7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:32.997278 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e4f6eb0d-5b10-40ef-b900-301caadc31e7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:33.004482 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e4f6eb0d-5b10-40ef-b900-301caadc31e7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:33.011782 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e4f6eb0d-5b10-40ef-b900-301caadc31e7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1737 microversion: 2.20 time: 1.124258 Aug 31 16:18:33.017373 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2629/5437] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:18:31 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1737 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:18:33.371849 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e3a76f0f-f3e5-41ac-8a13-39f6bbd333bc tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:33.381336 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e3a76f0f-f3e5-41ac-8a13-39f6bbd333bc tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03" status: 200 len: 1688 microversion: 2.1 time: 0.470691 Aug 31 16:18:33.386118 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2809/5438] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:32 2022] GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03 => generated 1688 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:33.892650 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-462fec3c-f91e-4a8b-88c3-3a09304d28fb tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:33.893719 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-462fec3c-f91e-4a8b-88c3-3a09304d28fb tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] [instance: a398032b-3def-4df0-bb77-550d29e5be00] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:33.916493 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-462fec3c-f91e-4a8b-88c3-3a09304d28fb tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:33.918547 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-462fec3c-f91e-4a8b-88c3-3a09304d28fb tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:33.919277 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-462fec3c-f91e-4a8b-88c3-3a09304d28fb tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:33.920203 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-462fec3c-f91e-4a8b-88c3-3a09304d28fb tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:33.921741 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-462fec3c-f91e-4a8b-88c3-3a09304d28fb tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:33.923762 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-462fec3c-f91e-4a8b-88c3-3a09304d28fb tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:34.043634 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5a184034-fb0e-4b21-b4da-1105c107d8e4 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:34.045038 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5a184034-fb0e-4b21-b4da-1105c107d8e4 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:34.059525 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=6 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:18:34.063565 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:18:34.067838 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5a184034-fb0e-4b21-b4da-1105c107d8e4 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:34.071321 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5a184034-fb0e-4b21-b4da-1105c107d8e4 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:34.077913 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5a184034-fb0e-4b21-b4da-1105c107d8e4 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:34.080274 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5a184034-fb0e-4b21-b4da-1105c107d8e4 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:34.084634 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5a184034-fb0e-4b21-b4da-1105c107d8e4 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:34.085293 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5a184034-fb0e-4b21-b4da-1105c107d8e4 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:34.223212 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=14 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:18:34.719602 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-462fec3c-f91e-4a8b-88c3-3a09304d28fb tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:34.733520 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-462fec3c-f91e-4a8b-88c3-3a09304d28fb tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers/a398032b-3def-4df0-bb77-550d29e5be00" status: 200 len: 1522 microversion: 2.1 time: 0.845844 Aug 31 16:18:34.734786 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2630/5439] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:33 2022] GET /compute/v2.1/servers/a398032b-3def-4df0-bb77-550d29e5be00 => generated 1522 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:34.740661 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e0351b64-5d3f-4042-9996-268bf0b7c0c2 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:34.742516 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e0351b64-5d3f-4042-9996-268bf0b7c0c2 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: e1cb02b7-1dd6-4c83-9008-e19525731e03] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:34.749832 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0351b64-5d3f-4042-9996-268bf0b7c0c2 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:34.750786 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0351b64-5d3f-4042-9996-268bf0b7c0c2 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:34.751442 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0351b64-5d3f-4042-9996-268bf0b7c0c2 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:34.753999 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0351b64-5d3f-4042-9996-268bf0b7c0c2 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:34.754620 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0351b64-5d3f-4042-9996-268bf0b7c0c2 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:34.755599 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0351b64-5d3f-4042-9996-268bf0b7c0c2 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:34.797772 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5a184034-fb0e-4b21-b4da-1105c107d8e4 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:34.807626 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5a184034-fb0e-4b21-b4da-1105c107d8e4 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:34.814635 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5a184034-fb0e-4b21-b4da-1105c107d8e4 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:34.815966 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5a184034-fb0e-4b21-b4da-1105c107d8e4 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1737 microversion: 2.20 time: 0.778775 Aug 31 16:18:34.841150 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2810/5440] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:18:34 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1737 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:18:35.010215 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e0351b64-5d3f-4042-9996-268bf0b7c0c2 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:35.024540 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e0351b64-5d3f-4042-9996-268bf0b7c0c2 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03" status: 200 len: 1569 microversion: 2.1 time: 0.287947 Aug 31 16:18:35.026245 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2631/5441] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:34 2022] GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03 => generated 1569 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:35.059587 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-fb089c01-8a41-4888-8d14-23e58ac27d27 req-74a4f264-31b3-44d2-b85f-cac5aa1ab24d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1cb02b7-1dd6-4c83-9008-e19525731e03", "name": "network-vif-deleted", "tag": "aad14830-ef68-4e56-bff4-91dbcf99efc3"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:18:35.103716 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-fb089c01-8a41-4888-8d14-23e58ac27d27 req-74a4f264-31b3-44d2-b85f-cac5aa1ab24d service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:35.104195 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-fb089c01-8a41-4888-8d14-23e58ac27d27 req-74a4f264-31b3-44d2-b85f-cac5aa1ab24d service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:35.104623 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-fb089c01-8a41-4888-8d14-23e58ac27d27 req-74a4f264-31b3-44d2-b85f-cac5aa1ab24d service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:35.155313 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-fb089c01-8a41-4888-8d14-23e58ac27d27 req-74a4f264-31b3-44d2-b85f-cac5aa1ab24d service nova] Creating event network-vif-deleted:aad14830-ef68-4e56-bff4-91dbcf99efc3 for instance e1cb02b7-1dd6-4c83-9008-e19525731e03 on n-h2-833090-16 Aug 31 16:18:35.167352 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-fb089c01-8a41-4888-8d14-23e58ac27d27 req-74a4f264-31b3-44d2-b85f-cac5aa1ab24d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112886 Aug 31 16:18:35.168055 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2811/5442] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:18:35.756250 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a9dc83aa-bd77-476a-b2df-ba867a6f2d8a tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:35.757020 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a9dc83aa-bd77-476a-b2df-ba867a6f2d8a tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] [instance: a398032b-3def-4df0-bb77-550d29e5be00] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:35.771889 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9dc83aa-bd77-476a-b2df-ba867a6f2d8a tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:35.772550 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9dc83aa-bd77-476a-b2df-ba867a6f2d8a tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:35.774234 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9dc83aa-bd77-476a-b2df-ba867a6f2d8a tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:35.776872 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9dc83aa-bd77-476a-b2df-ba867a6f2d8a tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:35.778025 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9dc83aa-bd77-476a-b2df-ba867a6f2d8a tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:35.779683 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9dc83aa-bd77-476a-b2df-ba867a6f2d8a tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:35.850205 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-48218c0a-6592-43f0-8011-221f2ccfb2e6 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:35.851527 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-48218c0a-6592-43f0-8011-221f2ccfb2e6 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:35.868679 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-48218c0a-6592-43f0-8011-221f2ccfb2e6 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:35.871652 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-48218c0a-6592-43f0-8011-221f2ccfb2e6 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:35.872914 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-48218c0a-6592-43f0-8011-221f2ccfb2e6 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:35.875555 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-48218c0a-6592-43f0-8011-221f2ccfb2e6 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:35.877705 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-48218c0a-6592-43f0-8011-221f2ccfb2e6 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:35.878693 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-48218c0a-6592-43f0-8011-221f2ccfb2e6 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:36.275442 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-48218c0a-6592-43f0-8011-221f2ccfb2e6 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:36.292017 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-48218c0a-6592-43f0-8011-221f2ccfb2e6 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:36.295781 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-48218c0a-6592-43f0-8011-221f2ccfb2e6 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:36.301561 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-48218c0a-6592-43f0-8011-221f2ccfb2e6 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1737 microversion: 2.20 time: 0.454941 Aug 31 16:18:36.303725 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2812/5443] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:18:35 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1737 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:18:36.319233 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a1ad840c-0c29-4059-a930-14984547c0e7 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:36.321649 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a1ad840c-0c29-4059-a930-14984547c0e7 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: e1cb02b7-1dd6-4c83-9008-e19525731e03] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:36.336008 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a1ad840c-0c29-4059-a930-14984547c0e7 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:36.339130 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a1ad840c-0c29-4059-a930-14984547c0e7 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:36.342408 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a1ad840c-0c29-4059-a930-14984547c0e7 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:36.343520 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a1ad840c-0c29-4059-a930-14984547c0e7 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:36.346256 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a1ad840c-0c29-4059-a930-14984547c0e7 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:36.348505 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a1ad840c-0c29-4059-a930-14984547c0e7 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:36.435819 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a9dc83aa-bd77-476a-b2df-ba867a6f2d8a tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:36.445091 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-a1ad840c-0c29-4059-a930-14984547c0e7 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] HTTP exception thrown: Instance e1cb02b7-1dd6-4c83-9008-e19525731e03 could not be found. Aug 31 16:18:36.451080 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a9dc83aa-bd77-476a-b2df-ba867a6f2d8a tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers/a398032b-3def-4df0-bb77-550d29e5be00" status: 200 len: 1522 microversion: 2.1 time: 0.699630 Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a1ad840c-0c29-4059-a930-14984547c0e7 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Request method failure captured: Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03 HTTP/1.1 Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4fV98oVosqGT7VWC4t0BtAiBiZATLbXebs7dwZ2GTRmxWIxlWpcykql1rc4XcH6S5iXxbfnhW9zu0xtlzwQXV8xqLhjj_kkcwN0JMTiH3_0LSsRjsreTCqRz_N8Dc-RwStRrYjFigQ-KrUSCoxe4mvwPpJjWkSJo0qe7m_-bm95Maw Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 3397e8a2a042486eb323432c47dfd392 Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-316597183 Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3397e8a2a042486eb323432c47dfd392"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3397e8a2a042486eb323432c47dfd392"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3397e8a2a042486eb323432c47dfd392"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3397e8a2a042486eb323432c47dfd392", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-TestNetworkAdvancedServerOps-316597183 Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 3397e8a2a042486eb323432c47dfd392 Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-316597183 Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-TestNetworkAdvancedServerOps-316597183-project Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 87f8241df6664aa59ba669d733e53871 Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-TestNetworkAdvancedServerOps-316597183-project Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance e1cb02b7-1dd6-4c83-9008-e19525731e03 could not be found. Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'e1cb02b7-1dd6-4c83-9008-e19525731e03'} Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1cb02b7-1dd6-4c83-9008-e19525731e03 could not be found. Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1cb02b7-1dd6-4c83-9008-e19525731e03 could not be found. Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:18:36.453247 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:18:36.461165 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:18:36.461165 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:18:36.461165 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:18:36.461165 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:18:36.461165 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:18:36.461165 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:18:36.461165 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1cb02b7-1dd6-4c83-9008-e19525731e03 could not be found. Aug 31 16:18:36.461165 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:18:36.467840 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a1ad840c-0c29-4059-a930-14984547c0e7 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Returning 404 to user: Instance e1cb02b7-1dd6-4c83-9008-e19525731e03 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:18:36.471073 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a1ad840c-0c29-4059-a930-14984547c0e7 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03" status: 404 len: 111 microversion: 2.1 time: 0.165026 Aug 31 16:18:36.474385 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2813/5444] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:36 2022] GET /compute/v2.1/servers/e1cb02b7-1dd6-4c83-9008-e19525731e03 => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:18:36.476825 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2632/5445] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:35 2022] GET /compute/v2.1/servers/a398032b-3def-4df0-bb77-550d29e5be00 => generated 1522 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:37.326204 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ec8e8a28-75ec-4aaa-bcdb-bf231dcfb14e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:37.326823 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ec8e8a28-75ec-4aaa-bcdb-bf231dcfb14e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:37.337987 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ec8e8a28-75ec-4aaa-bcdb-bf231dcfb14e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:37.338777 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ec8e8a28-75ec-4aaa-bcdb-bf231dcfb14e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:37.339377 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ec8e8a28-75ec-4aaa-bcdb-bf231dcfb14e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:37.340608 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ec8e8a28-75ec-4aaa-bcdb-bf231dcfb14e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:37.341256 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ec8e8a28-75ec-4aaa-bcdb-bf231dcfb14e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:37.341827 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ec8e8a28-75ec-4aaa-bcdb-bf231dcfb14e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:37.480947 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0abcb6c3-f010-4bdb-979e-08810a0d4a0f tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:37.482191 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0abcb6c3-f010-4bdb-979e-08810a0d4a0f tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] [instance: a398032b-3def-4df0-bb77-550d29e5be00] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:37.490151 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0abcb6c3-f010-4bdb-979e-08810a0d4a0f tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:37.490869 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0abcb6c3-f010-4bdb-979e-08810a0d4a0f tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:37.491456 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0abcb6c3-f010-4bdb-979e-08810a0d4a0f tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:37.492891 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0abcb6c3-f010-4bdb-979e-08810a0d4a0f tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:37.493633 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0abcb6c3-f010-4bdb-979e-08810a0d4a0f tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:37.494466 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0abcb6c3-f010-4bdb-979e-08810a0d4a0f tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:37.896168 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ec8e8a28-75ec-4aaa-bcdb-bf231dcfb14e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:37.929491 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ec8e8a28-75ec-4aaa-bcdb-bf231dcfb14e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:37.934036 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ec8e8a28-75ec-4aaa-bcdb-bf231dcfb14e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:37.935974 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ec8e8a28-75ec-4aaa-bcdb-bf231dcfb14e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1737 microversion: 2.20 time: 0.614710 Aug 31 16:18:37.946214 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2814/5446] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:18:37 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1737 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:18:38.129692 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0abcb6c3-f010-4bdb-979e-08810a0d4a0f tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:38.144653 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0abcb6c3-f010-4bdb-979e-08810a0d4a0f tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers/a398032b-3def-4df0-bb77-550d29e5be00" status: 200 len: 1522 microversion: 2.1 time: 0.668426 Aug 31 16:18:38.148349 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2633/5447] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:37 2022] GET /compute/v2.1/servers/a398032b-3def-4df0-bb77-550d29e5be00 => generated 1522 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:18:38.972405 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c3d2400f-dc16-417f-93fa-415e8d655aca tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:38.973304 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c3d2400f-dc16-417f-93fa-415e8d655aca tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:38.993062 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3d2400f-dc16-417f-93fa-415e8d655aca tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:38.993627 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3d2400f-dc16-417f-93fa-415e8d655aca tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:38.994456 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3d2400f-dc16-417f-93fa-415e8d655aca tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:38.995166 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3d2400f-dc16-417f-93fa-415e8d655aca tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:38.995625 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3d2400f-dc16-417f-93fa-415e8d655aca tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:38.996051 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3d2400f-dc16-417f-93fa-415e8d655aca tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:39.181404 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4edb487e-b8ca-486f-b3c9-a6105fafe56d tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:39.182919 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4edb487e-b8ca-486f-b3c9-a6105fafe56d tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] [instance: a398032b-3def-4df0-bb77-550d29e5be00] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:39.203422 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4edb487e-b8ca-486f-b3c9-a6105fafe56d tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:39.204715 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4edb487e-b8ca-486f-b3c9-a6105fafe56d tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:39.205400 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4edb487e-b8ca-486f-b3c9-a6105fafe56d tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:39.207792 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4edb487e-b8ca-486f-b3c9-a6105fafe56d tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:39.208547 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4edb487e-b8ca-486f-b3c9-a6105fafe56d tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:39.211054 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4edb487e-b8ca-486f-b3c9-a6105fafe56d tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:39.219348 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:18:40.308294 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4edb487e-b8ca-486f-b3c9-a6105fafe56d tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:40.319006 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4edb487e-b8ca-486f-b3c9-a6105fafe56d tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers/a398032b-3def-4df0-bb77-550d29e5be00" status: 200 len: 1522 microversion: 2.1 time: 1.140413 Aug 31 16:18:40.320765 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2634/5448] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:39 2022] GET /compute/v2.1/servers/a398032b-3def-4df0-bb77-550d29e5be00 => generated 1522 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:18:40.633050 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c3d2400f-dc16-417f-93fa-415e8d655aca tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:40.646192 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c3d2400f-dc16-417f-93fa-415e8d655aca tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:40.653443 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c3d2400f-dc16-417f-93fa-415e8d655aca tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:40.660291 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c3d2400f-dc16-417f-93fa-415e8d655aca tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1737 microversion: 2.20 time: 1.698269 Aug 31 16:18:40.661669 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2815/5449] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:18:38 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1737 bytes in 1700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:18:41.344105 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8ed72c50-4b83-4420-b741-7ab90404a450 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:41.344756 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8ed72c50-4b83-4420-b741-7ab90404a450 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] [instance: a398032b-3def-4df0-bb77-550d29e5be00] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:41.358923 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ed72c50-4b83-4420-b741-7ab90404a450 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:41.359408 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ed72c50-4b83-4420-b741-7ab90404a450 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:41.360017 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ed72c50-4b83-4420-b741-7ab90404a450 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:41.366992 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ed72c50-4b83-4420-b741-7ab90404a450 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:41.368497 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ed72c50-4b83-4420-b741-7ab90404a450 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:41.369114 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8ed72c50-4b83-4420-b741-7ab90404a450 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:41.690284 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e8eb9b21-f506-4a53-b244-d601e231ef53 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:41.691183 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e8eb9b21-f506-4a53-b244-d601e231ef53 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:41.713725 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e8eb9b21-f506-4a53-b244-d601e231ef53 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:41.722133 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8ed72c50-4b83-4420-b741-7ab90404a450 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:41.722348 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e8eb9b21-f506-4a53-b244-d601e231ef53 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:41.722718 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e8eb9b21-f506-4a53-b244-d601e231ef53 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:41.732302 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8ed72c50-4b83-4420-b741-7ab90404a450 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers/a398032b-3def-4df0-bb77-550d29e5be00" status: 200 len: 1522 microversion: 2.1 time: 0.393089 Aug 31 16:18:41.732912 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2635/5450] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:41 2022] GET /compute/v2.1/servers/a398032b-3def-4df0-bb77-550d29e5be00 => generated 1522 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:41.733305 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e8eb9b21-f506-4a53-b244-d601e231ef53 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:41.733948 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e8eb9b21-f506-4a53-b244-d601e231ef53 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:41.734634 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e8eb9b21-f506-4a53-b244-d601e231ef53 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:42.083909 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e8eb9b21-f506-4a53-b244-d601e231ef53 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:42.099141 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e8eb9b21-f506-4a53-b244-d601e231ef53 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:42.100597 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e8eb9b21-f506-4a53-b244-d601e231ef53 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:42.101931 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e8eb9b21-f506-4a53-b244-d601e231ef53 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1737 microversion: 2.20 time: 0.416291 Aug 31 16:18:42.124427 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2816/5451] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:18:41 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1737 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:18:42.768585 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a85b3124-3b7b-4418-b218-1f984bf853a7 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:42.772445 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a85b3124-3b7b-4418-b218-1f984bf853a7 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] [instance: a398032b-3def-4df0-bb77-550d29e5be00] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:42.806246 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a85b3124-3b7b-4418-b218-1f984bf853a7 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:42.808924 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a85b3124-3b7b-4418-b218-1f984bf853a7 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:42.810040 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a85b3124-3b7b-4418-b218-1f984bf853a7 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:42.811445 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a85b3124-3b7b-4418-b218-1f984bf853a7 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:42.815807 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a85b3124-3b7b-4418-b218-1f984bf853a7 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:42.816849 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a85b3124-3b7b-4418-b218-1f984bf853a7 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:43.135019 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-73de0622-8e62-495e-a922-572c94ed9e0b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:43.136164 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-73de0622-8e62-495e-a922-572c94ed9e0b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:43.157760 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-73de0622-8e62-495e-a922-572c94ed9e0b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:43.158617 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-73de0622-8e62-495e-a922-572c94ed9e0b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:43.159499 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-73de0622-8e62-495e-a922-572c94ed9e0b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:43.160397 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-73de0622-8e62-495e-a922-572c94ed9e0b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:43.160851 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-73de0622-8e62-495e-a922-572c94ed9e0b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:43.161279 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-73de0622-8e62-495e-a922-572c94ed9e0b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:43.671196 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-73de0622-8e62-495e-a922-572c94ed9e0b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:43.696704 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-73de0622-8e62-495e-a922-572c94ed9e0b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:43.711454 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-73de0622-8e62-495e-a922-572c94ed9e0b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:43.715971 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-73de0622-8e62-495e-a922-572c94ed9e0b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1737 microversion: 2.20 time: 0.586757 Aug 31 16:18:43.719112 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2817/5452] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:18:43 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1737 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:18:43.744818 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d9f0f06b-41bc-4276-9b37-46a5b38735f1 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:43.745624 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d9f0f06b-41bc-4276-9b37-46a5b38735f1 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 3e00e521-84f5-4e7b-8cec-7a4d2e220d28] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:43.781090 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d9f0f06b-41bc-4276-9b37-46a5b38735f1 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:43.785919 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a85b3124-3b7b-4418-b218-1f984bf853a7 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:43.801215 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d9f0f06b-41bc-4276-9b37-46a5b38735f1 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:43.809483 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d9f0f06b-41bc-4276-9b37-46a5b38735f1 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:43.811716 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d9f0f06b-41bc-4276-9b37-46a5b38735f1 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:43.813500 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a85b3124-3b7b-4418-b218-1f984bf853a7 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers/a398032b-3def-4df0-bb77-550d29e5be00" status: 200 len: 1522 microversion: 2.1 time: 1.052731 Aug 31 16:18:43.814950 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d9f0f06b-41bc-4276-9b37-46a5b38735f1 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:43.816011 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d9f0f06b-41bc-4276-9b37-46a5b38735f1 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:43.817197 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2636/5453] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:42 2022] GET /compute/v2.1/servers/a398032b-3def-4df0-bb77-550d29e5be00 => generated 1522 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:43.883005 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d9f0f06b-41bc-4276-9b37-46a5b38735f1 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/3e00e521-84f5-4e7b-8cec-7a4d2e220d28/ips" status: 200 len: 150 microversion: 2.1 time: 0.161865 Aug 31 16:18:43.884205 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2818/5454] 10.222.0.50 () {58 vars in 1248 bytes} [Wed Aug 31 16:18:43 2022] GET /compute/v2.1/servers/3e00e521-84f5-4e7b-8cec-7a4d2e220d28/ips => generated 150 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:18:43.896632 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8e711808-1ae1-4b82-a51c-6603a999a03f tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b48abf44-730e-41a9-a25c-4f0fa59a917c"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:18:43.901629 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8e711808-1ae1-4b82-a51c-6603a999a03f tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 3e00e521-84f5-4e7b-8cec-7a4d2e220d28] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:43.908889 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e711808-1ae1-4b82-a51c-6603a999a03f tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:43.909635 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e711808-1ae1-4b82-a51c-6603a999a03f tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:43.912093 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e711808-1ae1-4b82-a51c-6603a999a03f tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:43.912825 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e711808-1ae1-4b82-a51c-6603a999a03f tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:43.913390 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e711808-1ae1-4b82-a51c-6603a999a03f tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:43.919135 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e711808-1ae1-4b82-a51c-6603a999a03f tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:44.049247 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-8e711808-1ae1-4b82-a51c-6603a999a03f tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] HTTP exception thrown: Invalid volume: volume b48abf44-730e-41a9-a25c-4f0fa59a917c is already attached to instances: 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef Aug 31 16:18:44.056325 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8e711808-1ae1-4b82-a51c-6603a999a03f tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Request method failure captured: Aug 31 16:18:44.056325 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers/3e00e521-84f5-4e7b-8cec-7a4d2e220d28/os-volume_attachments HTTP/1.1 Aug 31 16:18:44.056325 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:18:44.056325 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:18:44.056325 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:18:44.056325 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 74 Aug 31 16:18:44.056325 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:18:44.056325 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:18:44.056325 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:18:44.056325 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:18:44.056325 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4jmnQUplwr8AbbPZFrGxW4cxkzmu6dBR1PW9StPm7lwt758HQoCfwjfTobZNcY1qtMPO8jDX-KXtXLta2nSjy7PGTgxIA8J9_334X72rGtCeQYm6RDS4nOjdET00Y60PMzSq7EOVRAdi656mkiv_ceC-3aVenrz44MCAB3Nc0UBrjk Aug 31 16:18:44.056325 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:18:44.056325 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:18:44.056325 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:18:44.056325 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:18:44.056325 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:18:44.056325 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:18:44.056325 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: c3cdfdf921af4bc59c5c2fea1287b598 Aug 31 16:18:44.056325 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-AttachVolumeNegativeTest-1670272717 Aug 31 16:18:44.056325 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:18:44.056325 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:18:44.056325 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c3cdfdf921af4bc59c5c2fea1287b598"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c3cdfdf921af4bc59c5c2fea1287b598"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c3cdfdf921af4bc59c5c2fea1287b598"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c3cdfdf921af4bc59c5c2fea1287b598", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:18:44.056325 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-AttachVolumeNegativeTest-1670272717 Aug 31 16:18:44.056325 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: c3cdfdf921af4bc59c5c2fea1287b598 Aug 31 16:18:44.056325 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1670272717 Aug 31 16:18:44.056325 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-AttachVolumeNegativeTest-1670272717-project Aug 31 16:18:44.056325 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:18:44.056325 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:18:44.056325 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 6f95e357d68d4ad4a5eedbb08b41c5c1 Aug 31 16:18:44.056325 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-AttachVolumeNegativeTest-1670272717-project Aug 31 16:18:44.056325 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 16:18:44.056325 n-d-833090-16 devstack@n-api.service[128863]: {"volumeAttachment": {"volumeId": "b48abf44-730e-41a9-a25c-4f0fa59a917c"}} Aug 31 16:18:44.056325 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:18:44.056325 n-d-833090-16 devstack@n-api.service[128863]: exception: Invalid volume: volume b48abf44-730e-41a9-a25c-4f0fa59a917c is already attached to instances: 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef Aug 31 16:18:44.056325 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'server_id': '3e00e521-84f5-4e7b-8cec-7a4d2e220d28', 'body': {'volumeAttachment': {'volumeId': 'b48abf44-730e-41a9-a25c-4f0fa59a917c'}}} Aug 31 16:18:44.056325 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:18:44.056325 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:18:44.056325 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 16:18:44.056325 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 16:18:44.056325 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 16:18:44.056325 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 16:18:44.056325 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 16:18:44.056325 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 16:18:44.056325 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 31 16:18:44.056325 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 31 16:18:44.056325 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 31 16:18:44.056325 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 31 16:18:44.056325 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b48abf44-730e-41a9-a25c-4f0fa59a917c is already attached to instances: 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef Aug 31 16:18:44.056325 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:18:44.056325 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:18:44.056325 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:18:44.056325 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:18:44.056325 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:18:44.056325 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:18:44.056325 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:18:44.056325 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:18:44.056325 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:18:44.056325 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:18:44.056325 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:18:44.056325 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:18:44.056325 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:18:44.056325 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:18:44.060604 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:18:44.060604 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:18:44.060604 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 31 16:18:44.060604 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 16:18:44.060604 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b48abf44-730e-41a9-a25c-4f0fa59a917c is already attached to instances: 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef Aug 31 16:18:44.060604 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:18:44.060604 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:18:44.060604 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:18:44.060604 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:18:44.060604 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:18:44.060604 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:18:44.060604 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:18:44.060604 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:18:44.060604 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b48abf44-730e-41a9-a25c-4f0fa59a917c is already attached to instances: 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef Aug 31 16:18:44.060604 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:18:44.063463 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8e711808-1ae1-4b82-a51c-6603a999a03f tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Returning 400 to user: Invalid volume: volume b48abf44-730e-41a9-a25c-4f0fa59a917c is already attached to instances: 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:18:44.064617 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8e711808-1ae1-4b82-a51c-6603a999a03f tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "POST /compute/v2.1/servers/3e00e521-84f5-4e7b-8cec-7a4d2e220d28/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.172071 Aug 31 16:18:44.074348 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2637/5455] 10.222.0.50 () {60 vars in 1323 bytes} [Wed Aug 31 16:18:43 2022] POST /compute/v2.1/servers/3e00e521-84f5-4e7b-8cec-7a4d2e220d28/os-volume_attachments => generated 174 bytes in 182 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:18:44.079344 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ab39e247-ec45-40f7-bdfb-c2f6636bc7de tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:44.079919 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ab39e247-ec45-40f7-bdfb-c2f6636bc7de tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 3e00e521-84f5-4e7b-8cec-7a4d2e220d28] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:44.104710 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ab39e247-ec45-40f7-bdfb-c2f6636bc7de tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:44.106686 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ab39e247-ec45-40f7-bdfb-c2f6636bc7de tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:44.107166 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ab39e247-ec45-40f7-bdfb-c2f6636bc7de tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:44.108760 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ab39e247-ec45-40f7-bdfb-c2f6636bc7de tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:44.109077 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ab39e247-ec45-40f7-bdfb-c2f6636bc7de tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:44.109498 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ab39e247-ec45-40f7-bdfb-c2f6636bc7de tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:44.250165 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ab39e247-ec45-40f7-bdfb-c2f6636bc7de tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 3e00e521-84f5-4e7b-8cec-7a4d2e220d28] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:18:44.425822 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ab39e247-ec45-40f7-bdfb-c2f6636bc7de tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3e00e521-84f5-4e7b-8cec-7a4d2e220d28" status: 204 len: 0 microversion: 2.1 time: 0.350282 Aug 31 16:18:44.426456 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2819/5456] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:18:44 2022] DELETE /compute/v2.1/servers/3e00e521-84f5-4e7b-8cec-7a4d2e220d28 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:18:44.436232 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2dd19b15-9dfa-42c0-968b-994d45a565b8 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:44.436834 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2dd19b15-9dfa-42c0-968b-994d45a565b8 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 3e00e521-84f5-4e7b-8cec-7a4d2e220d28] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:44.446435 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2dd19b15-9dfa-42c0-968b-994d45a565b8 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:44.448009 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2dd19b15-9dfa-42c0-968b-994d45a565b8 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:44.451724 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2dd19b15-9dfa-42c0-968b-994d45a565b8 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:44.452639 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2dd19b15-9dfa-42c0-968b-994d45a565b8 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:44.453130 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2dd19b15-9dfa-42c0-968b-994d45a565b8 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:44.453563 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2dd19b15-9dfa-42c0-968b-994d45a565b8 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:44.741908 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e696ed2b-0b37-4e8f-b423-7ad10e66ee5d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:44.742746 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e696ed2b-0b37-4e8f-b423-7ad10e66ee5d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:44.751790 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e696ed2b-0b37-4e8f-b423-7ad10e66ee5d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:44.759385 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e696ed2b-0b37-4e8f-b423-7ad10e66ee5d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:44.760079 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e696ed2b-0b37-4e8f-b423-7ad10e66ee5d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:44.761707 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e696ed2b-0b37-4e8f-b423-7ad10e66ee5d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:44.762352 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e696ed2b-0b37-4e8f-b423-7ad10e66ee5d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:44.763545 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e696ed2b-0b37-4e8f-b423-7ad10e66ee5d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:45.142538 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2dd19b15-9dfa-42c0-968b-994d45a565b8 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:45.161888 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2dd19b15-9dfa-42c0-968b-994d45a565b8 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/3e00e521-84f5-4e7b-8cec-7a4d2e220d28" status: 200 len: 1681 microversion: 2.1 time: 0.729470 Aug 31 16:18:45.164624 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2638/5457] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:44 2022] GET /compute/v2.1/servers/3e00e521-84f5-4e7b-8cec-7a4d2e220d28 => generated 1681 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:45.178796 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ddd456af-cbeb-4a62-beec-687798b538fb tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:45.182256 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ddd456af-cbeb-4a62-beec-687798b538fb tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] [instance: a398032b-3def-4df0-bb77-550d29e5be00] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:45.185584 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=72 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:18:45.202354 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ddd456af-cbeb-4a62-beec-687798b538fb tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:45.203291 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ddd456af-cbeb-4a62-beec-687798b538fb tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:45.209163 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ddd456af-cbeb-4a62-beec-687798b538fb tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:45.211884 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ddd456af-cbeb-4a62-beec-687798b538fb tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:45.212676 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ddd456af-cbeb-4a62-beec-687798b538fb tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:45.214074 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ddd456af-cbeb-4a62-beec-687798b538fb tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:45.366670 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e696ed2b-0b37-4e8f-b423-7ad10e66ee5d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:45.375836 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e696ed2b-0b37-4e8f-b423-7ad10e66ee5d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:45.391249 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e696ed2b-0b37-4e8f-b423-7ad10e66ee5d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:45.393115 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e696ed2b-0b37-4e8f-b423-7ad10e66ee5d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1737 microversion: 2.20 time: 0.655771 Aug 31 16:18:45.394209 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2820/5458] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:18:44 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1737 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:18:46.004732 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ddd456af-cbeb-4a62-beec-687798b538fb tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:46.018431 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ddd456af-cbeb-4a62-beec-687798b538fb tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers/a398032b-3def-4df0-bb77-550d29e5be00" status: 200 len: 1499 microversion: 2.1 time: 0.852014 Aug 31 16:18:46.019222 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2639/5459] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:45 2022] GET /compute/v2.1/servers/a398032b-3def-4df0-bb77-550d29e5be00 => generated 1499 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:46.045388 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b1ac7350-c6b1-4798-8dcb-425bf148f90c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:46.053919 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b1ac7350-c6b1-4798-8dcb-425bf148f90c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:46.054843 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b1ac7350-c6b1-4798-8dcb-425bf148f90c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '78689045e6c945108c966ba3cbeb5216'} {{(pid=128864) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:18:46.073570 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1ac7350-c6b1-4798-8dcb-425bf148f90c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:46.074046 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1ac7350-c6b1-4798-8dcb-425bf148f90c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:46.074513 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1ac7350-c6b1-4798-8dcb-425bf148f90c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:46.075230 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1ac7350-c6b1-4798-8dcb-425bf148f90c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:46.075683 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1ac7350-c6b1-4798-8dcb-425bf148f90c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:46.076103 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1ac7350-c6b1-4798-8dcb-425bf148f90c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:46.154014 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:18:46.165530 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.multi_cell_list [None req-b1ac7350-c6b1-4798-8dcb-425bf148f90c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128864) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:18:46.186340 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b6b79b5a-91e7-4946-a7dc-ac91bd6c9374 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:46.186950 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b6b79b5a-91e7-4946-a7dc-ac91bd6c9374 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 3e00e521-84f5-4e7b-8cec-7a4d2e220d28] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:46.196063 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6b79b5a-91e7-4946-a7dc-ac91bd6c9374 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:46.198545 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6b79b5a-91e7-4946-a7dc-ac91bd6c9374 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:46.199136 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6b79b5a-91e7-4946-a7dc-ac91bd6c9374 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:46.201193 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6b79b5a-91e7-4946-a7dc-ac91bd6c9374 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:46.202880 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6b79b5a-91e7-4946-a7dc-ac91bd6c9374 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:46.203476 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6b79b5a-91e7-4946-a7dc-ac91bd6c9374 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:46.275332 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b1ac7350-c6b1-4798-8dcb-425bf148f90c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.233680 Aug 31 16:18:46.280439 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2821/5460] 10.222.0.50 () {58 vars in 1154 bytes} [Wed Aug 31 16:18:46 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:18:46.292656 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-712f95a4-c620-4c90-8033-154fc61673d8 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:18:46.309825 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-712f95a4-c620-4c90-8033-154fc61673d8 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:46.310361 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-712f95a4-c620-4c90-8033-154fc61673d8 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:46.310796 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-712f95a4-c620-4c90-8033-154fc61673d8 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:46.391100 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-712f95a4-c620-4c90-8033-154fc61673d8 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] [instance: a398032b-3def-4df0-bb77-550d29e5be00] Going to try to start instance {{(pid=128864) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 31 16:18:46.550261 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-712f95a4-c620-4c90-8033-154fc61673d8 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "POST /compute/v2.1/servers/a398032b-3def-4df0-bb77-550d29e5be00/action" status: 202 len: 0 microversion: 2.1 time: 0.262330 Aug 31 16:18:46.558765 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2822/5461] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:18:46 2022] POST /compute/v2.1/servers/a398032b-3def-4df0-bb77-550d29e5be00/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 16:18:46.594753 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-32a5f1cb-e00c-436f-9b65-8ee036ac9d85 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:46.598267 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-32a5f1cb-e00c-436f-9b65-8ee036ac9d85 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:46.622541 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-32a5f1cb-e00c-436f-9b65-8ee036ac9d85 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:46.635155 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-32a5f1cb-e00c-436f-9b65-8ee036ac9d85 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:46.635904 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-32a5f1cb-e00c-436f-9b65-8ee036ac9d85 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:46.640517 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-32a5f1cb-e00c-436f-9b65-8ee036ac9d85 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:46.642049 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-32a5f1cb-e00c-436f-9b65-8ee036ac9d85 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:46.643751 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-32a5f1cb-e00c-436f-9b65-8ee036ac9d85 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:47.371997 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b6b79b5a-91e7-4946-a7dc-ac91bd6c9374 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:47.380907 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b6b79b5a-91e7-4946-a7dc-ac91bd6c9374 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/3e00e521-84f5-4e7b-8cec-7a4d2e220d28" status: 200 len: 1681 microversion: 2.1 time: 1.198506 Aug 31 16:18:47.399275 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2640/5462] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:46 2022] GET /compute/v2.1/servers/3e00e521-84f5-4e7b-8cec-7a4d2e220d28 => generated 1681 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:18:47.406279 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bba02090-b985-4014-a760-aac0e873be86 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:47.410871 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bba02090-b985-4014-a760-aac0e873be86 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] [instance: a398032b-3def-4df0-bb77-550d29e5be00] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:47.424285 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bba02090-b985-4014-a760-aac0e873be86 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:47.431327 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bba02090-b985-4014-a760-aac0e873be86 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:47.432085 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bba02090-b985-4014-a760-aac0e873be86 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:47.433104 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bba02090-b985-4014-a760-aac0e873be86 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:47.433805 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bba02090-b985-4014-a760-aac0e873be86 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:47.434438 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bba02090-b985-4014-a760-aac0e873be86 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:47.736756 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-32a5f1cb-e00c-436f-9b65-8ee036ac9d85 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:47.750512 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-32a5f1cb-e00c-436f-9b65-8ee036ac9d85 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:47.757139 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-32a5f1cb-e00c-436f-9b65-8ee036ac9d85 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:47.758622 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-32a5f1cb-e00c-436f-9b65-8ee036ac9d85 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1737 microversion: 2.20 time: 1.198407 Aug 31 16:18:47.759334 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2823/5463] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:18:46 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1737 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:18:48.251976 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bba02090-b985-4014-a760-aac0e873be86 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:48.264217 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bba02090-b985-4014-a760-aac0e873be86 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers/a398032b-3def-4df0-bb77-550d29e5be00" status: 200 len: 1508 microversion: 2.1 time: 0.863715 Aug 31 16:18:48.265113 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2641/5464] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:47 2022] GET /compute/v2.1/servers/a398032b-3def-4df0-bb77-550d29e5be00 => generated 1508 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:48.409882 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d17a2e59-849c-47cf-b57b-c326f9e524e0 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:48.410598 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d17a2e59-849c-47cf-b57b-c326f9e524e0 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 3e00e521-84f5-4e7b-8cec-7a4d2e220d28] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:48.427721 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d17a2e59-849c-47cf-b57b-c326f9e524e0 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:48.428313 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d17a2e59-849c-47cf-b57b-c326f9e524e0 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:48.428913 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d17a2e59-849c-47cf-b57b-c326f9e524e0 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:48.430011 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d17a2e59-849c-47cf-b57b-c326f9e524e0 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:48.435276 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d17a2e59-849c-47cf-b57b-c326f9e524e0 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:48.436023 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d17a2e59-849c-47cf-b57b-c326f9e524e0 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:48.465603 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-a12906ca-d1a7-4cbc-a3c9-c4bf4b8bac30 req-fb27410b-f6f4-45b5-bd88-6f17576c2f79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e00e521-84f5-4e7b-8cec-7a4d2e220d28", "name": "network-vif-deleted", "tag": "0dc48d8d-77c4-4b8d-9828-06b574dce835"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:18:48.484738 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a12906ca-d1a7-4cbc-a3c9-c4bf4b8bac30 req-fb27410b-f6f4-45b5-bd88-6f17576c2f79 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:48.489868 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a12906ca-d1a7-4cbc-a3c9-c4bf4b8bac30 req-fb27410b-f6f4-45b5-bd88-6f17576c2f79 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:48.490630 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a12906ca-d1a7-4cbc-a3c9-c4bf4b8bac30 req-fb27410b-f6f4-45b5-bd88-6f17576c2f79 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:48.518056 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-a12906ca-d1a7-4cbc-a3c9-c4bf4b8bac30 req-fb27410b-f6f4-45b5-bd88-6f17576c2f79 service nova] Creating event network-vif-deleted:0dc48d8d-77c4-4b8d-9828-06b574dce835 for instance 3e00e521-84f5-4e7b-8cec-7a4d2e220d28 on n-h2-833090-16 Aug 31 16:18:48.524678 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-a12906ca-d1a7-4cbc-a3c9-c4bf4b8bac30 req-fb27410b-f6f4-45b5-bd88-6f17576c2f79 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064675 Aug 31 16:18:48.525942 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2642/5465] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:18:48.765142 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d17a2e59-849c-47cf-b57b-c326f9e524e0 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:48.788642 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-000b4283-a84c-48bd-84f7-e18b78393bd1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:48.789942 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-000b4283-a84c-48bd-84f7-e18b78393bd1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:48.798513 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d17a2e59-849c-47cf-b57b-c326f9e524e0 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/3e00e521-84f5-4e7b-8cec-7a4d2e220d28" status: 200 len: 1614 microversion: 2.1 time: 0.392522 Aug 31 16:18:48.804304 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2824/5466] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:48 2022] GET /compute/v2.1/servers/3e00e521-84f5-4e7b-8cec-7a4d2e220d28 => generated 1614 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:48.814975 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-000b4283-a84c-48bd-84f7-e18b78393bd1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:48.819368 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-000b4283-a84c-48bd-84f7-e18b78393bd1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:48.823433 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-000b4283-a84c-48bd-84f7-e18b78393bd1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:48.827237 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-000b4283-a84c-48bd-84f7-e18b78393bd1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:48.828051 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-000b4283-a84c-48bd-84f7-e18b78393bd1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:48.830818 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-000b4283-a84c-48bd-84f7-e18b78393bd1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:49.287798 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6507a1b7-0929-4c92-8782-0ed715ddc070 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:49.288744 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6507a1b7-0929-4c92-8782-0ed715ddc070 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] [instance: a398032b-3def-4df0-bb77-550d29e5be00] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:49.298956 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6507a1b7-0929-4c92-8782-0ed715ddc070 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:49.299455 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6507a1b7-0929-4c92-8782-0ed715ddc070 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:49.300018 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6507a1b7-0929-4c92-8782-0ed715ddc070 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:49.300577 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6507a1b7-0929-4c92-8782-0ed715ddc070 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:49.301033 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6507a1b7-0929-4c92-8782-0ed715ddc070 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:49.301466 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6507a1b7-0929-4c92-8782-0ed715ddc070 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:49.552748 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-000b4283-a84c-48bd-84f7-e18b78393bd1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:49.564166 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-000b4283-a84c-48bd-84f7-e18b78393bd1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:49.566005 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-000b4283-a84c-48bd-84f7-e18b78393bd1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:49.567581 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-000b4283-a84c-48bd-84f7-e18b78393bd1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1719 microversion: 2.20 time: 0.784878 Aug 31 16:18:49.568746 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2643/5467] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:18:48 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1719 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:18:49.600172 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6415be10-2d68-4e21-858d-5f7e545f59ff tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '.version_select at 0x7fbb464110d0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:49.639134 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6415be10-2d68-4e21-858d-5f7e545f59ff tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-108919608" status: 202 len: 0 microversion: 2.1 time: 0.067067 Aug 31 16:18:49.641102 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2644/5468] 10.222.0.50 () {58 vars in 1281 bytes} [Wed Aug 31 16:18:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-108919608 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:18:49.692192 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8ca98b78-a170-493e-8f28-ffd9378df3c2 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Action: 'create', calling method: .version_select at 0x7fbb46672550>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1905368861", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1cUS9ivjPR328ih3+1pcz/n5IK8IqH3hysElla5kn0iY528/f4TURMhkcI2E1dSXUsscLDfU1SAjaS2JclJU0bw6KuEFOzOPsQitYSPjQvegspg4pz+/qATHBzQjIYGw=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:18:49.728372 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-8ca98b78-a170-493e-8f28-ffd9378df3c2 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Getting quotas for project 3397e8a2a042486eb323432c47dfd392. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:18:49.735939 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-8ca98b78-a170-493e-8f28-ffd9378df3c2 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Getting quotas for user 87f8241df6664aa59ba669d733e53871 and project 3397e8a2a042486eb323432c47dfd392. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:18:49.778956 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8ca98b78-a170-493e-8f28-ffd9378df3c2 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.096997 Aug 31 16:18:49.780162 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2645/5469] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 31 16:18:49 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:18:49.827968 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-733d4772-1419-4c39-9ddc-458e22a1cf40 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:49.829360 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-733d4772-1419-4c39-9ddc-458e22a1cf40 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 3e00e521-84f5-4e7b-8cec-7a4d2e220d28] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:49.845696 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-733d4772-1419-4c39-9ddc-458e22a1cf40 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:49.846388 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-733d4772-1419-4c39-9ddc-458e22a1cf40 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:49.846896 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-733d4772-1419-4c39-9ddc-458e22a1cf40 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:49.847863 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-733d4772-1419-4c39-9ddc-458e22a1cf40 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:49.848465 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-733d4772-1419-4c39-9ddc-458e22a1cf40 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:49.849651 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-733d4772-1419-4c39-9ddc-458e22a1cf40 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:49.865845 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-733d4772-1419-4c39-9ddc-458e22a1cf40 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] HTTP exception thrown: Instance 3e00e521-84f5-4e7b-8cec-7a4d2e220d28 could not be found. Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-733d4772-1419-4c39-9ddc-458e22a1cf40 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Request method failure captured: Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/3e00e521-84f5-4e7b-8cec-7a4d2e220d28 HTTP/1.1 Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4jmnQUplwr8AbbPZFrGxW4cxkzmu6dBR1PW9StPm7lwt758HQoCfwjfTobZNcY1qtMPO8jDX-KXtXLta2nSjy7PGTgxIA8J9_334X72rGtCeQYm6RDS4nOjdET00Y60PMzSq7EOVRAdi656mkiv_ceC-3aVenrz44MCAB3Nc0UBrjk Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: c3cdfdf921af4bc59c5c2fea1287b598 Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-AttachVolumeNegativeTest-1670272717 Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c3cdfdf921af4bc59c5c2fea1287b598"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c3cdfdf921af4bc59c5c2fea1287b598"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c3cdfdf921af4bc59c5c2fea1287b598"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c3cdfdf921af4bc59c5c2fea1287b598", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-AttachVolumeNegativeTest-1670272717 Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: c3cdfdf921af4bc59c5c2fea1287b598 Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1670272717 Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-AttachVolumeNegativeTest-1670272717-project Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 6f95e357d68d4ad4a5eedbb08b41c5c1 Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-AttachVolumeNegativeTest-1670272717-project Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 3e00e521-84f5-4e7b-8cec-7a4d2e220d28 could not be found. Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '3e00e521-84f5-4e7b-8cec-7a4d2e220d28'} Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e00e521-84f5-4e7b-8cec-7a4d2e220d28 could not be found. Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e00e521-84f5-4e7b-8cec-7a4d2e220d28 could not be found. Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:18:49.873320 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:18:49.878138 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:18:49.878138 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:18:49.878138 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:18:49.878138 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:18:49.878138 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:18:49.878138 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e00e521-84f5-4e7b-8cec-7a4d2e220d28 could not be found. Aug 31 16:18:49.878138 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:18:49.880779 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-733d4772-1419-4c39-9ddc-458e22a1cf40 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Returning 404 to user: Instance 3e00e521-84f5-4e7b-8cec-7a4d2e220d28 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:18:49.882132 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-733d4772-1419-4c39-9ddc-458e22a1cf40 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/3e00e521-84f5-4e7b-8cec-7a4d2e220d28" status: 404 len: 111 microversion: 2.1 time: 0.061294 Aug 31 16:18:49.886959 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2646/5470] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:49 2022] GET /compute/v2.1/servers/3e00e521-84f5-4e7b-8cec-7a4d2e220d28 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:18:49.894262 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ce54c7fb-0c7f-4db3-aee1-959e086e6104 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '.version_select at 0x7fbb459348b0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:49.917638 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ce54c7fb-0c7f-4db3-aee1-959e086e6104 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1484873176" status: 202 len: 0 microversion: 2.1 time: 0.029191 Aug 31 16:18:49.918928 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2647/5471] 10.222.0.50 () {58 vars in 1221 bytes} [Wed Aug 31 16:18:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1484873176 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:18:50.164857 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6507a1b7-0929-4c92-8782-0ed715ddc070 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:50.178339 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6507a1b7-0929-4c92-8782-0ed715ddc070 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers/a398032b-3def-4df0-bb77-550d29e5be00" status: 200 len: 1508 microversion: 2.1 time: 0.894545 Aug 31 16:18:50.179844 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2825/5472] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:49 2022] GET /compute/v2.1/servers/a398032b-3def-4df0-bb77-550d29e5be00 => generated 1508 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:50.598339 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-acd46b8a-7d0f-4e05-a208-dfc8974faed3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:50.599059 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-acd46b8a-7d0f-4e05-a208-dfc8974faed3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:50.609496 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-acd46b8a-7d0f-4e05-a208-dfc8974faed3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:50.613553 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-acd46b8a-7d0f-4e05-a208-dfc8974faed3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:50.614367 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-acd46b8a-7d0f-4e05-a208-dfc8974faed3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:50.615328 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-acd46b8a-7d0f-4e05-a208-dfc8974faed3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:50.615850 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-acd46b8a-7d0f-4e05-a208-dfc8974faed3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:50.616502 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-acd46b8a-7d0f-4e05-a208-dfc8974faed3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:50.818810 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-3a786063-351c-4f65-a5b4-8561048e27fd req-e752d3c4-72d9-4ae6-a541-c2391acd0589 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d", "name": "network-vif-unplugged", "status": "completed", "tag": "8e4486a0-b7ef-4efa-8a3b-565a37bae537"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:18:50.831313 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-3a786063-351c-4f65-a5b4-8561048e27fd req-e752d3c4-72d9-4ae6-a541-c2391acd0589 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:50.831786 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-3a786063-351c-4f65-a5b4-8561048e27fd req-e752d3c4-72d9-4ae6-a541-c2391acd0589 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:50.832213 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-3a786063-351c-4f65-a5b4-8561048e27fd req-e752d3c4-72d9-4ae6-a541-c2391acd0589 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:50.860419 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-3a786063-351c-4f65-a5b4-8561048e27fd req-e752d3c4-72d9-4ae6-a541-c2391acd0589 service nova] Creating event network-vif-unplugged:8e4486a0-b7ef-4efa-8a3b-565a37bae537 for instance 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d on n-h1-833090-16 Aug 31 16:18:50.866154 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-3a786063-351c-4f65-a5b4-8561048e27fd req-e752d3c4-72d9-4ae6-a541-c2391acd0589 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053288 Aug 31 16:18:50.869097 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2826/5473] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:18:51.160167 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-acd46b8a-7d0f-4e05-a208-dfc8974faed3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:51.176561 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-acd46b8a-7d0f-4e05-a208-dfc8974faed3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:51.179247 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-acd46b8a-7d0f-4e05-a208-dfc8974faed3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:51.181842 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-acd46b8a-7d0f-4e05-a208-dfc8974faed3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1719 microversion: 2.20 time: 0.588295 Aug 31 16:18:51.183283 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2648/5474] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:18:50 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1719 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:18:51.203458 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-90d6324a-9524-4281-9e22-e599a94a9126 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:51.204722 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-90d6324a-9524-4281-9e22-e599a94a9126 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] [instance: a398032b-3def-4df0-bb77-550d29e5be00] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:51.222571 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-90d6324a-9524-4281-9e22-e599a94a9126 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:51.223763 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-90d6324a-9524-4281-9e22-e599a94a9126 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:51.224404 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-90d6324a-9524-4281-9e22-e599a94a9126 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:51.230024 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-90d6324a-9524-4281-9e22-e599a94a9126 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:51.230852 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-90d6324a-9524-4281-9e22-e599a94a9126 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:51.231461 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-90d6324a-9524-4281-9e22-e599a94a9126 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:51.464607 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-90d6324a-9524-4281-9e22-e599a94a9126 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:51.466352 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-efe8f4cb-b395-42fa-9876-25a3fb0e7489 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:51.467035 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-efe8f4cb-b395-42fa-9876-25a3fb0e7489 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:51.495872 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-efe8f4cb-b395-42fa-9876-25a3fb0e7489 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:51.497950 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-efe8f4cb-b395-42fa-9876-25a3fb0e7489 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:51.499814 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-efe8f4cb-b395-42fa-9876-25a3fb0e7489 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:51.502746 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-90d6324a-9524-4281-9e22-e599a94a9126 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers/a398032b-3def-4df0-bb77-550d29e5be00" status: 200 len: 1508 microversion: 2.1 time: 0.304572 Aug 31 16:18:51.502919 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-efe8f4cb-b395-42fa-9876-25a3fb0e7489 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:51.505497 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2827/5475] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:51 2022] GET /compute/v2.1/servers/a398032b-3def-4df0-bb77-550d29e5be00 => generated 1508 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:51.510593 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-efe8f4cb-b395-42fa-9876-25a3fb0e7489 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:51.514276 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-efe8f4cb-b395-42fa-9876-25a3fb0e7489 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:51.673539 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-efe8f4cb-b395-42fa-9876-25a3fb0e7489 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lazy-loading 'services' on Instance uuid 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:18:51.883057 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-efe8f4cb-b395-42fa-9876-25a3fb0e7489 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "DELETE /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef/os-volume_attachments/b48abf44-730e-41a9-a25c-4f0fa59a917c" status: 202 len: 0 microversion: 2.1 time: 0.420164 Aug 31 16:18:51.886923 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2649/5476] 10.222.0.50 () {58 vars in 1416 bytes} [Wed Aug 31 16:18:51 2022] DELETE /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef/os-volume_attachments/b48abf44-730e-41a9-a25c-4f0fa59a917c => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 16:18:51.895016 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4a5eec61-41fb-4864-ba76-7e85b21c1904 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:51.924578 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4a5eec61-41fb-4864-ba76-7e85b21c1904 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:51.960742 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4a5eec61-41fb-4864-ba76-7e85b21c1904 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:51.961239 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4a5eec61-41fb-4864-ba76-7e85b21c1904 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:51.961671 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4a5eec61-41fb-4864-ba76-7e85b21c1904 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:51.982400 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4a5eec61-41fb-4864-ba76-7e85b21c1904 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:51.982961 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4a5eec61-41fb-4864-ba76-7e85b21c1904 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:51.983407 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4a5eec61-41fb-4864-ba76-7e85b21c1904 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:52.040478 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4a5eec61-41fb-4864-ba76-7e85b21c1904 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.149406 Aug 31 16:18:52.042631 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2828/5477] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:18:51 2022] GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:18:52.213245 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-730ddb20-9660-4591-a8dd-c0829edb73df tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:52.214618 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-730ddb20-9660-4591-a8dd-c0829edb73df tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:52.225270 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-730ddb20-9660-4591-a8dd-c0829edb73df tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:52.229222 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-730ddb20-9660-4591-a8dd-c0829edb73df tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:52.229860 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-730ddb20-9660-4591-a8dd-c0829edb73df tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:52.230793 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-730ddb20-9660-4591-a8dd-c0829edb73df tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:52.232922 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-730ddb20-9660-4591-a8dd-c0829edb73df tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:52.235820 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-730ddb20-9660-4591-a8dd-c0829edb73df tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:52.530779 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-214d24d4-540d-45a6-a0bb-2c55b191edca tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:52.531892 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-214d24d4-540d-45a6-a0bb-2c55b191edca tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] [instance: a398032b-3def-4df0-bb77-550d29e5be00] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:52.548965 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-214d24d4-540d-45a6-a0bb-2c55b191edca tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:52.549510 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-214d24d4-540d-45a6-a0bb-2c55b191edca tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:52.553416 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-214d24d4-540d-45a6-a0bb-2c55b191edca tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:52.556825 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-214d24d4-540d-45a6-a0bb-2c55b191edca tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:52.574549 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-214d24d4-540d-45a6-a0bb-2c55b191edca tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:52.574549 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-214d24d4-540d-45a6-a0bb-2c55b191edca tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:52.970029 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-730ddb20-9660-4591-a8dd-c0829edb73df tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:52.987051 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-730ddb20-9660-4591-a8dd-c0829edb73df tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:52.992142 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-730ddb20-9660-4591-a8dd-c0829edb73df tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:52.995821 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-730ddb20-9660-4591-a8dd-c0829edb73df tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1662 microversion: 2.20 time: 0.788009 Aug 31 16:18:52.996950 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2650/5478] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:18:52 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1662 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:18:53.027260 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-62d9dae4-d34a-4d28-80e0-d776d5de9bfe tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ca0d3df6-f0c7-439c-a8ed-d42a1f477074"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:18:53.037166 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-62d9dae4-d34a-4d28-80e0-d776d5de9bfe tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:53.055152 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62d9dae4-d34a-4d28-80e0-d776d5de9bfe tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:53.055733 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62d9dae4-d34a-4d28-80e0-d776d5de9bfe tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:53.056178 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62d9dae4-d34a-4d28-80e0-d776d5de9bfe tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:53.059430 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62d9dae4-d34a-4d28-80e0-d776d5de9bfe tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:53.061757 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62d9dae4-d34a-4d28-80e0-d776d5de9bfe tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:53.062501 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62d9dae4-d34a-4d28-80e0-d776d5de9bfe tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:53.166447 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-214d24d4-540d-45a6-a0bb-2c55b191edca tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:53.185893 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-214d24d4-540d-45a6-a0bb-2c55b191edca tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers/a398032b-3def-4df0-bb77-550d29e5be00" status: 200 len: 1512 microversion: 2.1 time: 0.662817 Aug 31 16:18:53.189838 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2829/5479] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:52 2022] GET /compute/v2.1/servers/a398032b-3def-4df0-bb77-550d29e5be00 => generated 1512 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:18:53.197314 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d394ffd2-8853-4ef4-8b38-8ff59d24dff4 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:53.201292 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d394ffd2-8853-4ef4-8b38-8ff59d24dff4 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:53.211455 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d394ffd2-8853-4ef4-8b38-8ff59d24dff4 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:53.212427 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d394ffd2-8853-4ef4-8b38-8ff59d24dff4 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:53.213134 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d394ffd2-8853-4ef4-8b38-8ff59d24dff4 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:53.214950 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d394ffd2-8853-4ef4-8b38-8ff59d24dff4 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:53.215667 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d394ffd2-8853-4ef4-8b38-8ff59d24dff4 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:53.216362 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d394ffd2-8853-4ef4-8b38-8ff59d24dff4 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:53.240509 n-d-833090-16 devstack@n-api.service[128864]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 16:18:53.240727 n-d-833090-16 devstack@n-api.service[128864]: Wed Aug 31 16:18:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef/os-volume_attachments (ip 10.222.0.50) !!! Aug 31 16:18:53.308316 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d394ffd2-8853-4ef4-8b38-8ff59d24dff4 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116689 Aug 31 16:18:53.319074 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2830/5480] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:18:53 2022] GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:18:53.324482 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-95bfa2d3-500c-4d19-973f-a280fdc657c0 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:53.333317 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-95bfa2d3-500c-4d19-973f-a280fdc657c0 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:53.333783 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.compute.servers [None req-95bfa2d3-500c-4d19-973f-a280fdc657c0 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Removing options 'limit' from query {{(pid=128864) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 31 16:18:53.334532 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-95bfa2d3-500c-4d19-973f-a280fdc657c0 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Searching by: {'deleted': False, 'project_id': '78689045e6c945108c966ba3cbeb5216'} {{(pid=128864) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:18:53.336641 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95bfa2d3-500c-4d19-973f-a280fdc657c0 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:53.337759 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95bfa2d3-500c-4d19-973f-a280fdc657c0 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:53.341674 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95bfa2d3-500c-4d19-973f-a280fdc657c0 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:53.343428 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95bfa2d3-500c-4d19-973f-a280fdc657c0 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:53.344479 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95bfa2d3-500c-4d19-973f-a280fdc657c0 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:53.345123 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95bfa2d3-500c-4d19-973f-a280fdc657c0 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:53.346790 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-95bfa2d3-500c-4d19-973f-a280fdc657c0 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.026321 Aug 31 16:18:53.347543 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2831/5481] 10.222.0.50 () {58 vars in 1140 bytes} [Wed Aug 31 16:18:53 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:18:53.362398 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-bce96ca2-50a2-482d-8e56-f3bb8b2ed87d tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:53.363368 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-bce96ca2-50a2-482d-8e56-f3bb8b2ed87d tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] [instance: a398032b-3def-4df0-bb77-550d29e5be00] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:53.372372 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bce96ca2-50a2-482d-8e56-f3bb8b2ed87d tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:53.374029 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bce96ca2-50a2-482d-8e56-f3bb8b2ed87d tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:53.378896 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bce96ca2-50a2-482d-8e56-f3bb8b2ed87d tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:53.380661 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bce96ca2-50a2-482d-8e56-f3bb8b2ed87d tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:53.382564 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bce96ca2-50a2-482d-8e56-f3bb8b2ed87d tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:53.383311 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bce96ca2-50a2-482d-8e56-f3bb8b2ed87d tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:53.706948 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:18:53.715015 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-62d9dae4-d34a-4d28-80e0-d776d5de9bfe tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "POST /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.692269 Aug 31 16:18:53.716860 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2651/5482] 10.222.0.50 () {62 vars in 1364 bytes} [Wed Aug 31 16:18:53 2022] POST /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d/os-volume_attachments => generated 188 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 16:18:53.737648 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-bce96ca2-50a2-482d-8e56-f3bb8b2ed87d tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:53.766139 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-bce96ca2-50a2-482d-8e56-f3bb8b2ed87d tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers/a398032b-3def-4df0-bb77-550d29e5be00" status: 200 len: 1512 microversion: 2.1 time: 0.407234 Aug 31 16:18:53.784542 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2832/5483] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:53 2022] GET /compute/v2.1/servers/a398032b-3def-4df0-bb77-550d29e5be00 => generated 1512 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:53.792583 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-27bf3043-ba33-44ab-8132-8b48a11326d0 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:53.793396 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-27bf3043-ba33-44ab-8132-8b48a11326d0 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] [instance: e8cc6df1-d4ec-4150-a4be-7f5ed20d64d2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:53.821269 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27bf3043-ba33-44ab-8132-8b48a11326d0 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:53.821827 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27bf3043-ba33-44ab-8132-8b48a11326d0 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:53.822299 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27bf3043-ba33-44ab-8132-8b48a11326d0 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:53.823129 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27bf3043-ba33-44ab-8132-8b48a11326d0 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:53.823951 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27bf3043-ba33-44ab-8132-8b48a11326d0 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:53.825591 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27bf3043-ba33-44ab-8132-8b48a11326d0 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:54.011828 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-326f5462-5b85-455e-9ce5-9b1b3e226b16 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:18:54.012449 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-326f5462-5b85-455e-9ce5-9b1b3e226b16 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:54.036965 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-326f5462-5b85-455e-9ce5-9b1b3e226b16 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:54.038918 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-326f5462-5b85-455e-9ce5-9b1b3e226b16 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:54.039528 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-326f5462-5b85-455e-9ce5-9b1b3e226b16 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:54.042317 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-326f5462-5b85-455e-9ce5-9b1b3e226b16 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:54.043552 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-326f5462-5b85-455e-9ce5-9b1b3e226b16 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:54.044996 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-326f5462-5b85-455e-9ce5-9b1b3e226b16 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:54.112141 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-326f5462-5b85-455e-9ce5-9b1b3e226b16 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128864) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 16:18:54.243420 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-326f5462-5b85-455e-9ce5-9b1b3e226b16 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "POST /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d/action" status: 202 len: 0 microversion: 2.20 time: 0.238104 Aug 31 16:18:54.244879 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2833/5484] 10.222.0.50 () {62 vars in 1319 bytes} [Wed Aug 31 16:18:54 2022] POST /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 31 16:18:54.255318 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3ccb1f88-9850-4b30-9d63-c0fa52fc2f6e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:54.256607 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3ccb1f88-9850-4b30-9d63-c0fa52fc2f6e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:54.273609 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3ccb1f88-9850-4b30-9d63-c0fa52fc2f6e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:54.274218 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3ccb1f88-9850-4b30-9d63-c0fa52fc2f6e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:54.277450 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3ccb1f88-9850-4b30-9d63-c0fa52fc2f6e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:54.278475 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3ccb1f88-9850-4b30-9d63-c0fa52fc2f6e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:54.280993 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3ccb1f88-9850-4b30-9d63-c0fa52fc2f6e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:54.283245 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3ccb1f88-9850-4b30-9d63-c0fa52fc2f6e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:54.669891 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-27bf3043-ba33-44ab-8132-8b48a11326d0 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:54.684807 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-27bf3043-ba33-44ab-8132-8b48a11326d0 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers/e8cc6df1-d4ec-4150-a4be-7f5ed20d64d2" status: 200 len: 1512 microversion: 2.1 time: 0.897630 Aug 31 16:18:54.686358 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2652/5485] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:53 2022] GET /compute/v2.1/servers/e8cc6df1-d4ec-4150-a4be-7f5ed20d64d2 => generated 1512 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:54.696492 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-97020efe-05c2-4240-b816-b8da57453e28 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:54.703841 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-97020efe-05c2-4240-b816-b8da57453e28 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:54.730704 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97020efe-05c2-4240-b816-b8da57453e28 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:54.731446 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97020efe-05c2-4240-b816-b8da57453e28 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:54.732071 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97020efe-05c2-4240-b816-b8da57453e28 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:54.732948 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97020efe-05c2-4240-b816-b8da57453e28 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:54.733538 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97020efe-05c2-4240-b816-b8da57453e28 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:54.734127 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97020efe-05c2-4240-b816-b8da57453e28 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:54.782934 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3ccb1f88-9850-4b30-9d63-c0fa52fc2f6e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:54.801637 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-97020efe-05c2-4240-b816-b8da57453e28 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113846 Aug 31 16:18:54.802444 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2653/5486] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:18:54 2022] GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:18:54.804634 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3ccb1f88-9850-4b30-9d63-c0fa52fc2f6e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:54.806189 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3ccb1f88-9850-4b30-9d63-c0fa52fc2f6e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:54.807415 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3ccb1f88-9850-4b30-9d63-c0fa52fc2f6e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1748 microversion: 2.20 time: 0.558118 Aug 31 16:18:54.809549 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2834/5487] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:18:54 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1748 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:18:54.813237 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-98cb8159-d481-4568-90a5-ecd7cd30bc7c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:54.813855 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-98cb8159-d481-4568-90a5-ecd7cd30bc7c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] [instance: cc25e790-d850-4fda-9954-21d458c3676c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:54.830237 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98cb8159-d481-4568-90a5-ecd7cd30bc7c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:54.842003 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98cb8159-d481-4568-90a5-ecd7cd30bc7c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:54.842476 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98cb8159-d481-4568-90a5-ecd7cd30bc7c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:54.843221 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98cb8159-d481-4568-90a5-ecd7cd30bc7c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:54.843672 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98cb8159-d481-4568-90a5-ecd7cd30bc7c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:54.844118 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98cb8159-d481-4568-90a5-ecd7cd30bc7c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:55.086936 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-98cb8159-d481-4568-90a5-ecd7cd30bc7c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:55.101179 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-98cb8159-d481-4568-90a5-ecd7cd30bc7c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers/cc25e790-d850-4fda-9954-21d458c3676c" status: 200 len: 1512 microversion: 2.1 time: 0.295749 Aug 31 16:18:55.102564 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2654/5488] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:54 2022] GET /compute/v2.1/servers/cc25e790-d850-4fda-9954-21d458c3676c => generated 1512 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:55.126415 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-986a6664-41ab-4229-a7e7-0713ce6e7e36 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:55.132267 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-986a6664-41ab-4229-a7e7-0713ce6e7e36 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:55.132932 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-986a6664-41ab-4229-a7e7-0713ce6e7e36 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Searching by: {'ip': '172.20.0.10', 'deleted': False, 'project_id': '78689045e6c945108c966ba3cbeb5216'} {{(pid=128864) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:18:55.382876 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-986a6664-41ab-4229-a7e7-0713ce6e7e36 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:55.383356 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-986a6664-41ab-4229-a7e7-0713ce6e7e36 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:55.383784 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-986a6664-41ab-4229-a7e7-0713ce6e7e36 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:55.384562 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-986a6664-41ab-4229-a7e7-0713ce6e7e36 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:55.385007 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-986a6664-41ab-4229-a7e7-0713ce6e7e36 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:55.385419 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-986a6664-41ab-4229-a7e7-0713ce6e7e36 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:55.683571 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.multi_cell_list [None req-986a6664-41ab-4229-a7e7-0713ce6e7e36 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128864) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:18:55.778862 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-986a6664-41ab-4229-a7e7-0713ce6e7e36 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers?ip=172.20.0.10" status: 200 len: 345 microversion: 2.1 time: 0.656300 Aug 31 16:18:55.779988 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2835/5489] 10.222.0.50 () {58 vars in 1154 bytes} [Wed Aug 31 16:18:55 2022] GET /compute/v2.1/servers?ip=172.20.0.10 => generated 345 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:18:55.793364 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bfd10c08-3d74-4c0c-a48b-523ecd111c56 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:55.794549 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bfd10c08-3d74-4c0c-a48b-523ecd111c56 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] [instance: a398032b-3def-4df0-bb77-550d29e5be00] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:55.816924 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfd10c08-3d74-4c0c-a48b-523ecd111c56 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:55.817863 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfd10c08-3d74-4c0c-a48b-523ecd111c56 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:55.819547 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfd10c08-3d74-4c0c-a48b-523ecd111c56 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:55.821246 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfd10c08-3d74-4c0c-a48b-523ecd111c56 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:55.821572 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c4582c6c-4f54-412b-92eb-53e87f7fc2fa tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:55.825718 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c4582c6c-4f54-412b-92eb-53e87f7fc2fa tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:55.835816 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfd10c08-3d74-4c0c-a48b-523ecd111c56 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:55.836753 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfd10c08-3d74-4c0c-a48b-523ecd111c56 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:55.869379 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c4582c6c-4f54-412b-92eb-53e87f7fc2fa tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:55.869869 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c4582c6c-4f54-412b-92eb-53e87f7fc2fa tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:55.889710 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c4582c6c-4f54-412b-92eb-53e87f7fc2fa tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:55.891386 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c4582c6c-4f54-412b-92eb-53e87f7fc2fa tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:55.891951 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c4582c6c-4f54-412b-92eb-53e87f7fc2fa tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:55.892669 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c4582c6c-4f54-412b-92eb-53e87f7fc2fa tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:55.991465 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c4582c6c-4f54-412b-92eb-53e87f7fc2fa tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.181071 Aug 31 16:18:56.003426 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2836/5490] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:18:55 2022] GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef/os-volume_attachments => generated 197 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:18:56.021945 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9229773b-c302-44a1-824d-f185d825dd18 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:56.023433 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9229773b-c302-44a1-824d-f185d825dd18 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:56.038666 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9229773b-c302-44a1-824d-f185d825dd18 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:56.040439 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9229773b-c302-44a1-824d-f185d825dd18 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:56.051894 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9229773b-c302-44a1-824d-f185d825dd18 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:56.055898 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9229773b-c302-44a1-824d-f185d825dd18 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:56.059735 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9229773b-c302-44a1-824d-f185d825dd18 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:56.060403 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9229773b-c302-44a1-824d-f185d825dd18 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:56.071439 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:18:56.467026 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bfd10c08-3d74-4c0c-a48b-523ecd111c56 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:56.489700 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bfd10c08-3d74-4c0c-a48b-523ecd111c56 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers/a398032b-3def-4df0-bb77-550d29e5be00" status: 200 len: 1512 microversion: 2.1 time: 0.697048 Aug 31 16:18:56.502142 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2655/5491] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:55 2022] GET /compute/v2.1/servers/a398032b-3def-4df0-bb77-550d29e5be00 => generated 1512 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:56.517187 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7fa04e62-4a63-4aa4-88e2-0e23fab49a92 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:56.517949 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7fa04e62-4a63-4aa4-88e2-0e23fab49a92 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] [instance: e8cc6df1-d4ec-4150-a4be-7f5ed20d64d2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:56.538050 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fa04e62-4a63-4aa4-88e2-0e23fab49a92 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:56.541782 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fa04e62-4a63-4aa4-88e2-0e23fab49a92 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:56.544191 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fa04e62-4a63-4aa4-88e2-0e23fab49a92 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:56.550958 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fa04e62-4a63-4aa4-88e2-0e23fab49a92 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:56.551558 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fa04e62-4a63-4aa4-88e2-0e23fab49a92 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:56.552071 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fa04e62-4a63-4aa4-88e2-0e23fab49a92 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:56.781300 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9229773b-c302-44a1-824d-f185d825dd18 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:56.800343 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9229773b-c302-44a1-824d-f185d825dd18 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:56.802502 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9229773b-c302-44a1-824d-f185d825dd18 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:56.807432 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9229773b-c302-44a1-824d-f185d825dd18 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1750 microversion: 2.20 time: 0.802467 Aug 31 16:18:56.808414 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2837/5492] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:18:56 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1750 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:18:57.008730 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-80d08f04-6a00-418d-bdcd-7f90bd3f7afd tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:57.011030 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-80d08f04-6a00-418d-bdcd-7f90bd3f7afd tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:57.017450 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-80d08f04-6a00-418d-bdcd-7f90bd3f7afd tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:57.018000 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-80d08f04-6a00-418d-bdcd-7f90bd3f7afd tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:57.018778 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-80d08f04-6a00-418d-bdcd-7f90bd3f7afd tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:57.019543 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-80d08f04-6a00-418d-bdcd-7f90bd3f7afd tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:57.020055 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-80d08f04-6a00-418d-bdcd-7f90bd3f7afd tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:57.020809 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-80d08f04-6a00-418d-bdcd-7f90bd3f7afd tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:57.108674 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-80d08f04-6a00-418d-bdcd-7f90bd3f7afd tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104872 Aug 31 16:18:57.112339 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2838/5493] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:18:57 2022] GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:18:57.142426 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7fa04e62-4a63-4aa4-88e2-0e23fab49a92 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:57.151754 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7fa04e62-4a63-4aa4-88e2-0e23fab49a92 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers/e8cc6df1-d4ec-4150-a4be-7f5ed20d64d2" status: 200 len: 1512 microversion: 2.1 time: 0.639583 Aug 31 16:18:57.152356 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2656/5494] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:56 2022] GET /compute/v2.1/servers/e8cc6df1-d4ec-4150-a4be-7f5ed20d64d2 => generated 1512 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:57.177826 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-947c990b-1d26-44fb-91d6-00438a690675 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:57.179043 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-947c990b-1d26-44fb-91d6-00438a690675 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] [instance: cc25e790-d850-4fda-9954-21d458c3676c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:57.192202 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-947c990b-1d26-44fb-91d6-00438a690675 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:57.192938 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-947c990b-1d26-44fb-91d6-00438a690675 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:57.193516 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-947c990b-1d26-44fb-91d6-00438a690675 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:57.201644 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-947c990b-1d26-44fb-91d6-00438a690675 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:57.202471 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-947c990b-1d26-44fb-91d6-00438a690675 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:57.203061 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-947c990b-1d26-44fb-91d6-00438a690675 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:57.835277 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-62ab308e-a288-42e4-9eb9-25fcf297972f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:57.837306 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-62ab308e-a288-42e4-9eb9-25fcf297972f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:57.854147 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62ab308e-a288-42e4-9eb9-25fcf297972f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:57.854936 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62ab308e-a288-42e4-9eb9-25fcf297972f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:57.855540 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62ab308e-a288-42e4-9eb9-25fcf297972f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:57.861968 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62ab308e-a288-42e4-9eb9-25fcf297972f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:57.863195 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62ab308e-a288-42e4-9eb9-25fcf297972f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:57.863965 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62ab308e-a288-42e4-9eb9-25fcf297972f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:57.990010 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-947c990b-1d26-44fb-91d6-00438a690675 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:58.004195 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-947c990b-1d26-44fb-91d6-00438a690675 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers/cc25e790-d850-4fda-9954-21d458c3676c" status: 200 len: 1512 microversion: 2.1 time: 0.829935 Aug 31 16:18:58.023189 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2839/5495] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:18:57 2022] GET /compute/v2.1/servers/cc25e790-d850-4fda-9954-21d458c3676c => generated 1512 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:58.033621 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9d998302-7041-418c-9371-c91d03d3bb8f tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:58.041221 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9d998302-7041-418c-9371-c91d03d3bb8f tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:58.042387 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9d998302-7041-418c-9371-c91d03d3bb8f tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Searching by: {'deleted': False, 'project_id': '78689045e6c945108c966ba3cbeb5216'} {{(pid=128864) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:18:58.049143 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9d998302-7041-418c-9371-c91d03d3bb8f tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:58.050503 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9d998302-7041-418c-9371-c91d03d3bb8f tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:58.051396 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9d998302-7041-418c-9371-c91d03d3bb8f tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:58.052564 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9d998302-7041-418c-9371-c91d03d3bb8f tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:58.053790 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9d998302-7041-418c-9371-c91d03d3bb8f tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:58.054562 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9d998302-7041-418c-9371-c91d03d3bb8f tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:58.130917 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.multi_cell_list [None req-9d998302-7041-418c-9371-c91d03d3bb8f tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128864) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:18:58.223521 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9d998302-7041-418c-9371-c91d03d3bb8f tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:58.244371 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9d998302-7041-418c-9371-c91d03d3bb8f tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:58.244889 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9d998302-7041-418c-9371-c91d03d3bb8f tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:58.250510 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9d998302-7041-418c-9371-c91d03d3bb8f tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:58.468824 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-62ab308e-a288-42e4-9eb9-25fcf297972f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:58.500633 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-62ab308e-a288-42e4-9eb9-25fcf297972f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:58.507242 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-62ab308e-a288-42e4-9eb9-25fcf297972f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:58.510951 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-62ab308e-a288-42e4-9eb9-25fcf297972f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1750 microversion: 2.20 time: 0.677515 Aug 31 16:18:58.555388 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2657/5496] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:18:57 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1750 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:18:58.576795 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e18e23e4-73d9-4725-8d1f-af9d36d42dc4 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:58.583421 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e18e23e4-73d9-4725-8d1f-af9d36d42dc4 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:58.584362 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9d998302-7041-418c-9371-c91d03d3bb8f tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers/detail" status: 200 len: 4519 microversion: 2.1 time: 0.556820 Aug 31 16:18:58.598541 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2840/5497] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 31 16:18:58 2022] GET /compute/v2.1/servers/detail => generated 4519 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:58.611805 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-97dd4165-de98-4b8f-904f-7f3b62404261 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:58.624525 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-97dd4165-de98-4b8f-904f-7f3b62404261 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:58.624525 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-97dd4165-de98-4b8f-904f-7f3b62404261 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '78689045e6c945108c966ba3cbeb5216'} {{(pid=128864) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:18:58.625627 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e18e23e4-73d9-4725-8d1f-af9d36d42dc4 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:58.630767 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e18e23e4-73d9-4725-8d1f-af9d36d42dc4 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:58.636377 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e18e23e4-73d9-4725-8d1f-af9d36d42dc4 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:58.637797 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e18e23e4-73d9-4725-8d1f-af9d36d42dc4 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:58.639593 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e18e23e4-73d9-4725-8d1f-af9d36d42dc4 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:58.640265 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e18e23e4-73d9-4725-8d1f-af9d36d42dc4 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:58.735439 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e18e23e4-73d9-4725-8d1f-af9d36d42dc4 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.175388 Aug 31 16:18:58.736363 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2658/5498] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:18:58 2022] GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef/os-volume_attachments => generated 197 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:18:58.889307 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-97dd4165-de98-4b8f-904f-7f3b62404261 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:58.889800 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-97dd4165-de98-4b8f-904f-7f3b62404261 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:58.890285 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-97dd4165-de98-4b8f-904f-7f3b62404261 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:58.891590 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-97dd4165-de98-4b8f-904f-7f3b62404261 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:58.892045 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-97dd4165-de98-4b8f-904f-7f3b62404261 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:58.892483 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-97dd4165-de98-4b8f-904f-7f3b62404261 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:58.981377 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.multi_cell_list [None req-97dd4165-de98-4b8f-904f-7f3b62404261 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128864) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:18:59.061875 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-97dd4165-de98-4b8f-904f-7f3b62404261 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.453889 Aug 31 16:18:59.065305 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2841/5499] 10.222.0.50 () {58 vars in 1150 bytes} [Wed Aug 31 16:18:58 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:18:59.077735 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-90b554a0-6522-4834-9b6c-902dd14108a5 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:59.090256 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-90b554a0-6522-4834-9b6c-902dd14108a5 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:59.093462 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-90b554a0-6522-4834-9b6c-902dd14108a5 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '78689045e6c945108c966ba3cbeb5216'} {{(pid=128863) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:18:59.117915 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-90b554a0-6522-4834-9b6c-902dd14108a5 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:59.118882 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-90b554a0-6522-4834-9b6c-902dd14108a5 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:59.121955 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-90b554a0-6522-4834-9b6c-902dd14108a5 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:59.123234 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-90b554a0-6522-4834-9b6c-902dd14108a5 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:59.123716 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-90b554a0-6522-4834-9b6c-902dd14108a5 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:59.124150 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-90b554a0-6522-4834-9b6c-902dd14108a5 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:59.299761 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.multi_cell_list [None req-90b554a0-6522-4834-9b6c-902dd14108a5 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128863) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:18:59.402333 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-90b554a0-6522-4834-9b6c-902dd14108a5 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.329931 Aug 31 16:18:59.403479 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2659/5500] 10.222.0.50 () {58 vars in 1212 bytes} [Wed Aug 31 16:18:59 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:18:59.416044 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-15c03b74-ee42-4cb5-aee8-6e1efbd8eb69 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:59.434245 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-15c03b74-ee42-4cb5-aee8-6e1efbd8eb69 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:18:59.437230 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-15c03b74-ee42-4cb5-aee8-6e1efbd8eb69 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '78689045e6c945108c966ba3cbeb5216'} {{(pid=128864) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:18:59.452274 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-15c03b74-ee42-4cb5-aee8-6e1efbd8eb69 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:59.452769 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-15c03b74-ee42-4cb5-aee8-6e1efbd8eb69 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:59.455341 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-15c03b74-ee42-4cb5-aee8-6e1efbd8eb69 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:59.457856 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-15c03b74-ee42-4cb5-aee8-6e1efbd8eb69 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:59.459461 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-15c03b74-ee42-4cb5-aee8-6e1efbd8eb69 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:59.459962 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-15c03b74-ee42-4cb5-aee8-6e1efbd8eb69 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:59.548126 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1f99255f-9960-4dd0-8d5e-d0d31c75ee01 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:18:59.548804 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1f99255f-9960-4dd0-8d5e-d0d31c75ee01 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:18:59.566596 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f99255f-9960-4dd0-8d5e-d0d31c75ee01 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:59.571429 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f99255f-9960-4dd0-8d5e-d0d31c75ee01 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:59.572993 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f99255f-9960-4dd0-8d5e-d0d31c75ee01 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:59.575899 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f99255f-9960-4dd0-8d5e-d0d31c75ee01 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:18:59.577825 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f99255f-9960-4dd0-8d5e-d0d31c75ee01 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:18:59.578303 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f99255f-9960-4dd0-8d5e-d0d31c75ee01 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:18:59.761330 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:18:59.818140 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.multi_cell_list [None req-15c03b74-ee42-4cb5-aee8-6e1efbd8eb69 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128864) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:19:00.075845 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-15c03b74-ee42-4cb5-aee8-6e1efbd8eb69 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.664983 Aug 31 16:19:00.083947 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2842/5501] 10.222.0.50 () {58 vars in 1196 bytes} [Wed Aug 31 16:18:59 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:00.104222 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-748a41c5-e1ae-4eb3-8688-93e2fca278c6 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:00.111576 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-748a41c5-e1ae-4eb3-8688-93e2fca278c6 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:00.126910 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-748a41c5-e1ae-4eb3-8688-93e2fca278c6 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:00.128971 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-748a41c5-e1ae-4eb3-8688-93e2fca278c6 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:00.129586 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-748a41c5-e1ae-4eb3-8688-93e2fca278c6 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:00.131691 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-748a41c5-e1ae-4eb3-8688-93e2fca278c6 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:00.132340 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-748a41c5-e1ae-4eb3-8688-93e2fca278c6 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:00.134567 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-748a41c5-e1ae-4eb3-8688-93e2fca278c6 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:00.175997 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-748a41c5-e1ae-4eb3-8688-93e2fca278c6 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089718 Aug 31 16:19:00.177018 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2843/5502] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:19:00 2022] GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:19:00.186568 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-69b21b0c-a7e9-4b2f-b604-b68a020975ae tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:00.193193 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-69b21b0c-a7e9-4b2f-b604-b68a020975ae tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:00.194263 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-69b21b0c-a7e9-4b2f-b604-b68a020975ae tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Searching by: {'name': '2020395549', 'deleted': False, 'project_id': '78689045e6c945108c966ba3cbeb5216'} {{(pid=128864) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:19:00.200462 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69b21b0c-a7e9-4b2f-b604-b68a020975ae tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:00.201724 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69b21b0c-a7e9-4b2f-b604-b68a020975ae tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:00.202352 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69b21b0c-a7e9-4b2f-b604-b68a020975ae tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:00.204081 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69b21b0c-a7e9-4b2f-b604-b68a020975ae tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:00.204917 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69b21b0c-a7e9-4b2f-b604-b68a020975ae tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:00.205501 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69b21b0c-a7e9-4b2f-b604-b68a020975ae tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:00.342314 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1f99255f-9960-4dd0-8d5e-d0d31c75ee01 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:00.354941 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1f99255f-9960-4dd0-8d5e-d0d31c75ee01 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:00.363849 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1f99255f-9960-4dd0-8d5e-d0d31c75ee01 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:00.370762 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1f99255f-9960-4dd0-8d5e-d0d31c75ee01 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1750 microversion: 2.20 time: 0.826679 Aug 31 16:19:00.374690 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2660/5503] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:18:59 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1750 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:19:00.470299 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.multi_cell_list [None req-69b21b0c-a7e9-4b2f-b604-b68a020975ae tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128864) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:19:00.704324 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-69b21b0c-a7e9-4b2f-b604-b68a020975ae tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers?name=2020395549" status: 200 len: 346 microversion: 2.1 time: 0.525047 Aug 31 16:19:00.704942 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2844/5504] 10.222.0.50 () {58 vars in 1156 bytes} [Wed Aug 31 16:19:00 2022] GET /compute/v2.1/servers?name=2020395549 => generated 346 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:19:00.727028 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-829b6e13-0ea0-4c16-a57f-4bf4d0a0114a tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:00.733278 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-829b6e13-0ea0-4c16-a57f-4bf4d0a0114a tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:00.741808 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-829b6e13-0ea0-4c16-a57f-4bf4d0a0114a tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '78689045e6c945108c966ba3cbeb5216'} {{(pid=128863) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:19:00.768896 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-829b6e13-0ea0-4c16-a57f-4bf4d0a0114a tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:00.773788 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-829b6e13-0ea0-4c16-a57f-4bf4d0a0114a tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:00.775304 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-829b6e13-0ea0-4c16-a57f-4bf4d0a0114a tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:00.782362 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-829b6e13-0ea0-4c16-a57f-4bf4d0a0114a tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:00.783134 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-829b6e13-0ea0-4c16-a57f-4bf4d0a0114a tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:00.783685 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-829b6e13-0ea0-4c16-a57f-4bf4d0a0114a tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:01.001687 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.multi_cell_list [None req-829b6e13-0ea0-4c16-a57f-4bf4d0a0114a tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128863) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:19:01.183253 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-829b6e13-0ea0-4c16-a57f-4bf4d0a0114a tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.465999 Aug 31 16:19:01.185880 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2661/5505] 10.222.0.50 () {58 vars in 1154 bytes} [Wed Aug 31 16:19:00 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:01.190406 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-dc2f4a9b-6841-4416-8f9f-32b8f69a832b tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:01.192960 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-dc2f4a9b-6841-4416-8f9f-32b8f69a832b tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:01.200467 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e4cff786-14d5-413c-baaa-6ec54398aaf2 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:01.207989 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dc2f4a9b-6841-4416-8f9f-32b8f69a832b tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:01.215635 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dc2f4a9b-6841-4416-8f9f-32b8f69a832b tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:01.216308 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dc2f4a9b-6841-4416-8f9f-32b8f69a832b tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:01.218584 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dc2f4a9b-6841-4416-8f9f-32b8f69a832b tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:01.219326 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e4cff786-14d5-413c-baaa-6ec54398aaf2 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:01.220422 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e4cff786-14d5-413c-baaa-6ec54398aaf2 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-202039554', 'deleted': False, 'project_id': '78689045e6c945108c966ba3cbeb5216'} {{(pid=128863) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 16:19:01.220556 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dc2f4a9b-6841-4416-8f9f-32b8f69a832b tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:01.220944 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dc2f4a9b-6841-4416-8f9f-32b8f69a832b tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:01.243782 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4cff786-14d5-413c-baaa-6ec54398aaf2 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:01.246408 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4cff786-14d5-413c-baaa-6ec54398aaf2 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:01.247583 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4cff786-14d5-413c-baaa-6ec54398aaf2 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:01.248481 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4cff786-14d5-413c-baaa-6ec54398aaf2 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:01.248998 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4cff786-14d5-413c-baaa-6ec54398aaf2 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:01.257781 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4cff786-14d5-413c-baaa-6ec54398aaf2 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:01.320315 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-dc2f4a9b-6841-4416-8f9f-32b8f69a832b tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.128437 Aug 31 16:19:01.324839 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2845/5506] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:19:01 2022] GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef/os-volume_attachments => generated 25 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:19:01.401034 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-276ee536-6b61-46d8-933c-b05c218ba16a tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:01.402025 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-276ee536-6b61-46d8-933c-b05c218ba16a tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:01.417130 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-276ee536-6b61-46d8-933c-b05c218ba16a tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:01.419587 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-276ee536-6b61-46d8-933c-b05c218ba16a tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:01.424912 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-276ee536-6b61-46d8-933c-b05c218ba16a tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:01.427695 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-276ee536-6b61-46d8-933c-b05c218ba16a tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:01.430804 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-276ee536-6b61-46d8-933c-b05c218ba16a tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:01.432377 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-276ee536-6b61-46d8-933c-b05c218ba16a tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:01.536978 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.multi_cell_list [None req-e4cff786-14d5-413c-baaa-6ec54398aaf2 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128863) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 16:19:01.662495 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e4cff786-14d5-413c-baaa-6ec54398aaf2 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-202039554" status: 200 len: 346 microversion: 2.1 time: 0.469252 Aug 31 16:19:01.670470 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2662/5507] 10.222.0.50 () {58 vars in 1228 bytes} [Wed Aug 31 16:19:01 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-202039554 => generated 346 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:19:01.679673 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f4a45b45-cc1a-4f6d-8452-a027a180d967 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:01.681632 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f4a45b45-cc1a-4f6d-8452-a027a180d967 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:01.688241 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4a45b45-cc1a-4f6d-8452-a027a180d967 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:01.689115 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4a45b45-cc1a-4f6d-8452-a027a180d967 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:01.689725 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4a45b45-cc1a-4f6d-8452-a027a180d967 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:01.690725 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4a45b45-cc1a-4f6d-8452-a027a180d967 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:01.691333 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4a45b45-cc1a-4f6d-8452-a027a180d967 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:01.691902 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4a45b45-cc1a-4f6d-8452-a027a180d967 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:01.742718 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f4a45b45-cc1a-4f6d-8452-a027a180d967 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:19:01.858284 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-276ee536-6b61-46d8-933c-b05c218ba16a tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:01.875301 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-276ee536-6b61-46d8-933c-b05c218ba16a tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:01.877487 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-276ee536-6b61-46d8-933c-b05c218ba16a tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:01.879310 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-276ee536-6b61-46d8-933c-b05c218ba16a tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1750 microversion: 2.20 time: 0.482401 Aug 31 16:19:01.880505 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2846/5508] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:19:01 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1750 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:19:01.886225 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-85346105-301f-4915-b07f-d859d5848d1e tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:01.887232 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-85346105-301f-4915-b07f-d859d5848d1e tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] [instance: cc25e790-d850-4fda-9954-21d458c3676c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:01.895182 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85346105-301f-4915-b07f-d859d5848d1e tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:01.895912 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85346105-301f-4915-b07f-d859d5848d1e tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:01.896518 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85346105-301f-4915-b07f-d859d5848d1e tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:01.897851 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85346105-301f-4915-b07f-d859d5848d1e tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:01.898639 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85346105-301f-4915-b07f-d859d5848d1e tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:01.899247 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85346105-301f-4915-b07f-d859d5848d1e tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:01.958234 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f4a45b45-cc1a-4f6d-8452-a027a180d967 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "DELETE /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef" status: 204 len: 0 microversion: 2.1 time: 0.286147 Aug 31 16:19:01.959642 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2663/5509] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:19:01 2022] DELETE /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:19:01.970818 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5e806c43-f408-4aa0-bef2-7ef9ef0f3b81 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:01.972697 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5e806c43-f408-4aa0-bef2-7ef9ef0f3b81 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:01.973477 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-85346105-301f-4915-b07f-d859d5848d1e tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] [instance: cc25e790-d850-4fda-9954-21d458c3676c] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:19:01.987213 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5e806c43-f408-4aa0-bef2-7ef9ef0f3b81 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:01.992862 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5e806c43-f408-4aa0-bef2-7ef9ef0f3b81 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:01.993355 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5e806c43-f408-4aa0-bef2-7ef9ef0f3b81 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:01.994132 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5e806c43-f408-4aa0-bef2-7ef9ef0f3b81 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:01.994789 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5e806c43-f408-4aa0-bef2-7ef9ef0f3b81 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:01.995362 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5e806c43-f408-4aa0-bef2-7ef9ef0f3b81 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:02.138523 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-85346105-301f-4915-b07f-d859d5848d1e tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "DELETE /compute/v2.1/servers/cc25e790-d850-4fda-9954-21d458c3676c" status: 204 len: 0 microversion: 2.1 time: 0.255025 Aug 31 16:19:02.141447 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2847/5510] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:19:01 2022] DELETE /compute/v2.1/servers/cc25e790-d850-4fda-9954-21d458c3676c => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:19:02.159649 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9ad22b2c-c826-44b4-8ac0-a058fb22015e tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:02.161627 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9ad22b2c-c826-44b4-8ac0-a058fb22015e tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] [instance: cc25e790-d850-4fda-9954-21d458c3676c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:02.174517 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ad22b2c-c826-44b4-8ac0-a058fb22015e tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:02.175198 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ad22b2c-c826-44b4-8ac0-a058fb22015e tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:02.175790 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ad22b2c-c826-44b4-8ac0-a058fb22015e tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:02.177464 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ad22b2c-c826-44b4-8ac0-a058fb22015e tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:02.186641 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ad22b2c-c826-44b4-8ac0-a058fb22015e tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:02.190889 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ad22b2c-c826-44b4-8ac0-a058fb22015e tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:02.356242 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5e806c43-f408-4aa0-bef2-7ef9ef0f3b81 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:02.373429 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5e806c43-f408-4aa0-bef2-7ef9ef0f3b81 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef" status: 200 len: 1681 microversion: 2.1 time: 0.405706 Aug 31 16:19:02.374323 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2664/5511] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:01 2022] GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef => generated 1681 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:19:02.517548 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9ad22b2c-c826-44b4-8ac0-a058fb22015e tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:02.526650 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9ad22b2c-c826-44b4-8ac0-a058fb22015e tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers/cc25e790-d850-4fda-9954-21d458c3676c" status: 200 len: 1518 microversion: 2.1 time: 0.380361 Aug 31 16:19:02.532777 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2848/5512] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:02 2022] GET /compute/v2.1/servers/cc25e790-d850-4fda-9954-21d458c3676c => generated 1518 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:02.904360 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5aa342a4-f681-44d0-ac5d-49e7ffe162c2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:02.904934 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5aa342a4-f681-44d0-ac5d-49e7ffe162c2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:02.920104 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5aa342a4-f681-44d0-ac5d-49e7ffe162c2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:02.920603 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5aa342a4-f681-44d0-ac5d-49e7ffe162c2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:02.920918 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5aa342a4-f681-44d0-ac5d-49e7ffe162c2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:02.921702 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5aa342a4-f681-44d0-ac5d-49e7ffe162c2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:02.922175 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5aa342a4-f681-44d0-ac5d-49e7ffe162c2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:02.922600 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5aa342a4-f681-44d0-ac5d-49e7ffe162c2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:03.190907 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5aa342a4-f681-44d0-ac5d-49e7ffe162c2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:03.200543 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:19:03.204950 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5aa342a4-f681-44d0-ac5d-49e7ffe162c2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:03.207108 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5aa342a4-f681-44d0-ac5d-49e7ffe162c2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:03.209271 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5aa342a4-f681-44d0-ac5d-49e7ffe162c2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1750 microversion: 2.20 time: 0.307916 Aug 31 16:19:03.210785 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2665/5513] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:19:02 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1750 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:19:03.403500 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3341a4d3-4a3a-4878-bf51-c8400141585d tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:03.406471 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3341a4d3-4a3a-4878-bf51-c8400141585d tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:03.454130 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3341a4d3-4a3a-4878-bf51-c8400141585d tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:03.456582 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3341a4d3-4a3a-4878-bf51-c8400141585d tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:03.458084 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3341a4d3-4a3a-4878-bf51-c8400141585d tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:03.460195 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3341a4d3-4a3a-4878-bf51-c8400141585d tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:03.462333 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3341a4d3-4a3a-4878-bf51-c8400141585d tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:03.468177 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3341a4d3-4a3a-4878-bf51-c8400141585d tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:03.554988 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dfdef846-d9a4-468d-97a7-e59185a3c387 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:03.556266 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dfdef846-d9a4-468d-97a7-e59185a3c387 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] [instance: cc25e790-d850-4fda-9954-21d458c3676c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:03.571003 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfdef846-d9a4-468d-97a7-e59185a3c387 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:03.573944 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfdef846-d9a4-468d-97a7-e59185a3c387 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:03.576370 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfdef846-d9a4-468d-97a7-e59185a3c387 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:03.584810 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfdef846-d9a4-468d-97a7-e59185a3c387 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:03.588829 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfdef846-d9a4-468d-97a7-e59185a3c387 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:03.591292 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfdef846-d9a4-468d-97a7-e59185a3c387 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:04.128597 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3341a4d3-4a3a-4878-bf51-c8400141585d tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:04.139267 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3341a4d3-4a3a-4878-bf51-c8400141585d tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef" status: 200 len: 1681 microversion: 2.1 time: 0.747429 Aug 31 16:19:04.148708 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2849/5514] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:03 2022] GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef => generated 1681 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:04.208740 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dfdef846-d9a4-468d-97a7-e59185a3c387 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:04.223314 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dfdef846-d9a4-468d-97a7-e59185a3c387 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers/cc25e790-d850-4fda-9954-21d458c3676c" status: 200 len: 1518 microversion: 2.1 time: 0.674050 Aug 31 16:19:04.224225 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2666/5515] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:03 2022] GET /compute/v2.1/servers/cc25e790-d850-4fda-9954-21d458c3676c => generated 1518 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:04.242429 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4a2f97e0-143b-459d-beff-5550a24fb05f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:04.243289 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4a2f97e0-143b-459d-beff-5550a24fb05f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:04.245509 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=3 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:19:04.258176 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4a2f97e0-143b-459d-beff-5550a24fb05f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:04.258650 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4a2f97e0-143b-459d-beff-5550a24fb05f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:04.259086 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4a2f97e0-143b-459d-beff-5550a24fb05f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:04.259785 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4a2f97e0-143b-459d-beff-5550a24fb05f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:04.278441 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4a2f97e0-143b-459d-beff-5550a24fb05f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:04.279079 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4a2f97e0-143b-459d-beff-5550a24fb05f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:04.378077 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:19:05.026707 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4a2f97e0-143b-459d-beff-5550a24fb05f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:05.043546 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4a2f97e0-143b-459d-beff-5550a24fb05f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:05.045155 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4a2f97e0-143b-459d-beff-5550a24fb05f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:05.046409 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4a2f97e0-143b-459d-beff-5550a24fb05f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1750 microversion: 2.20 time: 0.815469 Aug 31 16:19:05.049996 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2850/5516] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:19:04 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1750 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:19:05.170235 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ebf05386-7cbf-4285-92db-3e2611572370 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:05.170872 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ebf05386-7cbf-4285-92db-3e2611572370 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:05.185894 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebf05386-7cbf-4285-92db-3e2611572370 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:05.186517 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebf05386-7cbf-4285-92db-3e2611572370 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:05.186966 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebf05386-7cbf-4285-92db-3e2611572370 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:05.187995 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebf05386-7cbf-4285-92db-3e2611572370 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:05.188531 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebf05386-7cbf-4285-92db-3e2611572370 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:05.188959 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ebf05386-7cbf-4285-92db-3e2611572370 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:05.243928 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3d2b019e-ab8f-450c-aa41-9cadce570c5c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:05.244552 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3d2b019e-ab8f-450c-aa41-9cadce570c5c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] [instance: cc25e790-d850-4fda-9954-21d458c3676c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:05.254721 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3d2b019e-ab8f-450c-aa41-9cadce570c5c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:05.259196 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3d2b019e-ab8f-450c-aa41-9cadce570c5c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:05.259872 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3d2b019e-ab8f-450c-aa41-9cadce570c5c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:05.265531 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3d2b019e-ab8f-450c-aa41-9cadce570c5c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:05.272915 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3d2b019e-ab8f-450c-aa41-9cadce570c5c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:05.273679 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3d2b019e-ab8f-450c-aa41-9cadce570c5c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:05.507635 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3d2b019e-ab8f-450c-aa41-9cadce570c5c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:05.531043 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3d2b019e-ab8f-450c-aa41-9cadce570c5c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers/cc25e790-d850-4fda-9954-21d458c3676c" status: 200 len: 1476 microversion: 2.1 time: 0.289696 Aug 31 16:19:05.538409 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2851/5517] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:05 2022] GET /compute/v2.1/servers/cc25e790-d850-4fda-9954-21d458c3676c => generated 1476 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:19:05.570493 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-5b93b952-2de4-40d7-838b-76390811754a req-f95fbc13-658d-4364-b1b3-2d124c539f7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc25e790-d850-4fda-9954-21d458c3676c", "name": "network-vif-deleted", "tag": "e7c462aa-2f77-48ac-ac7e-a528f82350a6"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:19:05.594832 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-5b93b952-2de4-40d7-838b-76390811754a req-f95fbc13-658d-4364-b1b3-2d124c539f7c service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:05.598360 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-5b93b952-2de4-40d7-838b-76390811754a req-f95fbc13-658d-4364-b1b3-2d124c539f7c service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:05.600616 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-5b93b952-2de4-40d7-838b-76390811754a req-f95fbc13-658d-4364-b1b3-2d124c539f7c service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:05.636446 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-5b93b952-2de4-40d7-838b-76390811754a req-f95fbc13-658d-4364-b1b3-2d124c539f7c service nova] Creating event network-vif-deleted:e7c462aa-2f77-48ac-ac7e-a528f82350a6 for instance cc25e790-d850-4fda-9954-21d458c3676c on n-h1-833090-16 Aug 31 16:19:05.648913 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-5b93b952-2de4-40d7-838b-76390811754a req-f95fbc13-658d-4364-b1b3-2d124c539f7c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083478 Aug 31 16:19:05.651909 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2852/5518] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:19:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:19:05.768370 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ebf05386-7cbf-4285-92db-3e2611572370 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:05.787508 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ebf05386-7cbf-4285-92db-3e2611572370 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef" status: 200 len: 1681 microversion: 2.1 time: 0.621614 Aug 31 16:19:05.789923 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2667/5519] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:05 2022] GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef => generated 1681 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:06.071841 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3cdc78eb-c529-4bc9-a4de-042185163c19 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:06.073262 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3cdc78eb-c529-4bc9-a4de-042185163c19 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:06.088805 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3cdc78eb-c529-4bc9-a4de-042185163c19 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:06.089486 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3cdc78eb-c529-4bc9-a4de-042185163c19 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:06.090081 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3cdc78eb-c529-4bc9-a4de-042185163c19 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:06.091913 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3cdc78eb-c529-4bc9-a4de-042185163c19 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:06.095524 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3cdc78eb-c529-4bc9-a4de-042185163c19 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:06.096605 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3cdc78eb-c529-4bc9-a4de-042185163c19 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:06.226423 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b47d6fe1-e800-469d-99f5-666ec694b928 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2075360661", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "cb4d4bc0-e99b-4899-be3f-3cf4fce27a9d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1905368861", "security_groups": [{"name": "tempest-secgroup-smoke-1654505256"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:19:06.516610 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-b47d6fe1-e800-469d-99f5-666ec694b928 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] validate_networks() for [('cb4d4bc0-e99b-4899-be3f-3cf4fce27a9d', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:19:07.242789 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3cdc78eb-c529-4bc9-a4de-042185163c19 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:07.255127 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3cdc78eb-c529-4bc9-a4de-042185163c19 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:07.258684 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3cdc78eb-c529-4bc9-a4de-042185163c19 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:07.261424 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3cdc78eb-c529-4bc9-a4de-042185163c19 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1750 microversion: 2.20 time: 1.194480 Aug 31 16:19:07.264312 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2853/5520] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:19:06 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1750 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:19:07.282797 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-725e658e-3b58-4691-842e-c138bf55d9b7 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:07.283423 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-725e658e-3b58-4691-842e-c138bf55d9b7 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] [instance: cc25e790-d850-4fda-9954-21d458c3676c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:07.298144 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-725e658e-3b58-4691-842e-c138bf55d9b7 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:07.301882 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-725e658e-3b58-4691-842e-c138bf55d9b7 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:07.302393 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-725e658e-3b58-4691-842e-c138bf55d9b7 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:07.303324 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-725e658e-3b58-4691-842e-c138bf55d9b7 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:07.304025 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-725e658e-3b58-4691-842e-c138bf55d9b7 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:07.307113 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-725e658e-3b58-4691-842e-c138bf55d9b7 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:07.340073 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-725e658e-3b58-4691-842e-c138bf55d9b7 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] HTTP exception thrown: Instance cc25e790-d850-4fda-9954-21d458c3676c could not be found. Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-725e658e-3b58-4691-842e-c138bf55d9b7 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Request method failure captured: Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/cc25e790-d850-4fda-9954-21d458c3676c HTTP/1.1 Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4mx52cZ3dD8tFAq5Mxl86AsOt_DqyTXwMzWFYujrgUB3RFFiK4V8KUH7x9c3bKCAb1P1bU0S7t-8pMm1uix8BrP4ABOQ_6kR0XWe3q7KPVY5mI8prazXlwK5_iJeetsDduYdvwvmdNYDBty7Bk1m94toWG8A7sVtwlMVbCapAyUUWI Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 78689045e6c945108c966ba3cbeb5216 Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ListServerFiltersTestJSON-847291327 Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/78689045e6c945108c966ba3cbeb5216"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/78689045e6c945108c966ba3cbeb5216"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/78689045e6c945108c966ba3cbeb5216"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_78689045e6c945108c966ba3cbeb5216", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ListServerFiltersTestJSON-847291327 Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 78689045e6c945108c966ba3cbeb5216 Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-847291327 Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ListServerFiltersTestJSON-847291327-project Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 5a0360d29d1c48d6bcab7d5198a0148b Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ListServerFiltersTestJSON-847291327-project Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance cc25e790-d850-4fda-9954-21d458c3676c could not be found. Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'cc25e790-d850-4fda-9954-21d458c3676c'} Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc25e790-d850-4fda-9954-21d458c3676c could not be found. Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc25e790-d850-4fda-9954-21d458c3676c could not be found. Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:19:07.342075 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:19:07.346020 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:19:07.346020 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:19:07.346020 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:19:07.346020 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:19:07.346020 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:19:07.346020 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc25e790-d850-4fda-9954-21d458c3676c could not be found. Aug 31 16:19:07.346020 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:19:07.351461 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-725e658e-3b58-4691-842e-c138bf55d9b7 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Returning 404 to user: Instance cc25e790-d850-4fda-9954-21d458c3676c could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:19:07.354628 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-725e658e-3b58-4691-842e-c138bf55d9b7 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers/cc25e790-d850-4fda-9954-21d458c3676c" status: 404 len: 111 microversion: 2.1 time: 0.087477 Aug 31 16:19:07.357635 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2854/5521] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:07 2022] GET /compute/v2.1/servers/cc25e790-d850-4fda-9954-21d458c3676c => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:19:07.369130 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a7122815-17e0-4eb8-88b6-6ea3b4f2a733 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:07.370024 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a7122815-17e0-4eb8-88b6-6ea3b4f2a733 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:07.390802 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a7122815-17e0-4eb8-88b6-6ea3b4f2a733 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:07.394356 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a7122815-17e0-4eb8-88b6-6ea3b4f2a733 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:07.395002 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a7122815-17e0-4eb8-88b6-6ea3b4f2a733 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:07.396026 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a7122815-17e0-4eb8-88b6-6ea3b4f2a733 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:07.397248 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a7122815-17e0-4eb8-88b6-6ea3b4f2a733 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:07.398404 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a7122815-17e0-4eb8-88b6-6ea3b4f2a733 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:07.710847 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a7122815-17e0-4eb8-88b6-6ea3b4f2a733 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:07.722432 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a7122815-17e0-4eb8-88b6-6ea3b4f2a733 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef" status: 200 len: 1613 microversion: 2.1 time: 0.362844 Aug 31 16:19:07.723197 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2855/5522] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:07 2022] GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef => generated 1613 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:07.728667 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-cce76650-48f5-4010-9306-7e7614f6b1f9 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:07.730332 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-cce76650-48f5-4010-9306-7e7614f6b1f9 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] [instance: e8cc6df1-d4ec-4150-a4be-7f5ed20d64d2] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:07.737351 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cce76650-48f5-4010-9306-7e7614f6b1f9 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:07.738029 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cce76650-48f5-4010-9306-7e7614f6b1f9 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:07.738777 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cce76650-48f5-4010-9306-7e7614f6b1f9 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:07.741115 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cce76650-48f5-4010-9306-7e7614f6b1f9 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:07.741857 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cce76650-48f5-4010-9306-7e7614f6b1f9 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:07.742485 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cce76650-48f5-4010-9306-7e7614f6b1f9 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:07.805187 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-cce76650-48f5-4010-9306-7e7614f6b1f9 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] [instance: e8cc6df1-d4ec-4150-a4be-7f5ed20d64d2] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:19:07.835019 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b47d6fe1-e800-469d-99f5-666ec694b928 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:19:07.835612 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b47d6fe1-e800-469d-99f5-666ec694b928 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:19:07.836181 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b47d6fe1-e800-469d-99f5-666ec694b928 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:19:07.836697 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b47d6fe1-e800-469d-99f5-666ec694b928 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:19:07.837214 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b47d6fe1-e800-469d-99f5-666ec694b928 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:19:07.854849 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b47d6fe1-e800-469d-99f5-666ec694b928 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:07.855709 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b47d6fe1-e800-469d-99f5-666ec694b928 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:07.856369 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b47d6fe1-e800-469d-99f5-666ec694b928 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:07.857343 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b47d6fe1-e800-469d-99f5-666ec694b928 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:07.858734 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b47d6fe1-e800-469d-99f5-666ec694b928 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:07.859409 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b47d6fe1-e800-469d-99f5-666ec694b928 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:07.903297 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-b47d6fe1-e800-469d-99f5-666ec694b928 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Getting quotas for project 3397e8a2a042486eb323432c47dfd392. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:19:07.918595 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-b47d6fe1-e800-469d-99f5-666ec694b928 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Getting quotas for user 87f8241df6664aa59ba669d733e53871 and project 3397e8a2a042486eb323432c47dfd392. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:19:07.940295 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b47d6fe1-e800-469d-99f5-666ec694b928 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:19:07.943549 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b47d6fe1-e800-469d-99f5-666ec694b928 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 5cdd332d-8fd9-4b10-bc9b-a90375e91451] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:19:07.972302 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-cce76650-48f5-4010-9306-7e7614f6b1f9 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e8cc6df1-d4ec-4150-a4be-7f5ed20d64d2" status: 204 len: 0 microversion: 2.1 time: 0.246750 Aug 31 16:19:07.972950 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2856/5523] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:19:07 2022] DELETE /compute/v2.1/servers/e8cc6df1-d4ec-4150-a4be-7f5ed20d64d2 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:19:07.985449 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-b55532f6-b4de-4b79-857f-9e09f5a06670 req-fa9f3262-f3ed-476c-a808-604291eaab2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef", "name": "network-vif-deleted", "tag": "59ca6f67-7dec-4e2b-a15d-4746e8c56b32"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:19:08.021281 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-b55532f6-b4de-4b79-857f-9e09f5a06670 req-fa9f3262-f3ed-476c-a808-604291eaab2c service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:08.028537 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-b55532f6-b4de-4b79-857f-9e09f5a06670 req-fa9f3262-f3ed-476c-a808-604291eaab2c service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:08.029233 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-b55532f6-b4de-4b79-857f-9e09f5a06670 req-fa9f3262-f3ed-476c-a808-604291eaab2c service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:08.030191 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b47d6fe1-e800-469d-99f5-666ec694b928 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.808328 Aug 31 16:19:08.045248 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2668/5524] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:19:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 1815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:19:08.074221 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-09a29cd3-5069-45cf-b351-7d73b6d71a58 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:08.090029 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-09a29cd3-5069-45cf-b351-7d73b6d71a58 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] [instance: e8cc6df1-d4ec-4150-a4be-7f5ed20d64d2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:08.115349 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-b55532f6-b4de-4b79-857f-9e09f5a06670 req-fa9f3262-f3ed-476c-a808-604291eaab2c service nova] Creating event network-vif-deleted:59ca6f67-7dec-4e2b-a15d-4746e8c56b32 for instance 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef on n-h2-833090-16 Aug 31 16:19:08.118774 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09a29cd3-5069-45cf-b351-7d73b6d71a58 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:08.120300 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09a29cd3-5069-45cf-b351-7d73b6d71a58 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:08.121030 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09a29cd3-5069-45cf-b351-7d73b6d71a58 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:08.122942 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09a29cd3-5069-45cf-b351-7d73b6d71a58 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:08.125016 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09a29cd3-5069-45cf-b351-7d73b6d71a58 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:08.134668 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09a29cd3-5069-45cf-b351-7d73b6d71a58 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:08.136626 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-b55532f6-b4de-4b79-857f-9e09f5a06670 req-fa9f3262-f3ed-476c-a808-604291eaab2c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155112 Aug 31 16:19:08.140193 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2857/5525] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:19:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:19:08.161424 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8aee13f1-a6e9-4ccb-ba0a-482ee8c0ce56 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:08.162460 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8aee13f1-a6e9-4ccb-ba0a-482ee8c0ce56 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 5cdd332d-8fd9-4b10-bc9b-a90375e91451] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:08.237685 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:19:08.403235 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8aee13f1-a6e9-4ccb-ba0a-482ee8c0ce56 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:08.412049 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8aee13f1-a6e9-4ccb-ba0a-482ee8c0ce56 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451" status: 200 len: 1267 microversion: 2.1 time: 0.269395 Aug 31 16:19:08.422142 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2858/5526] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:08 2022] GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451 => generated 1267 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:08.429048 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6e09fedb-0dab-45d5-ae2a-e6f7c094f8c9 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:08.429048 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6e09fedb-0dab-45d5-ae2a-e6f7c094f8c9 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:08.467834 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6e09fedb-0dab-45d5-ae2a-e6f7c094f8c9 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:08.468338 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6e09fedb-0dab-45d5-ae2a-e6f7c094f8c9 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:08.468777 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6e09fedb-0dab-45d5-ae2a-e6f7c094f8c9 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:08.469486 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6e09fedb-0dab-45d5-ae2a-e6f7c094f8c9 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:08.469934 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6e09fedb-0dab-45d5-ae2a-e6f7c094f8c9 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:08.480379 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6e09fedb-0dab-45d5-ae2a-e6f7c094f8c9 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:08.580969 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-09a29cd3-5069-45cf-b351-7d73b6d71a58 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:08.593217 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-09a29cd3-5069-45cf-b351-7d73b6d71a58 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers/e8cc6df1-d4ec-4150-a4be-7f5ed20d64d2" status: 200 len: 1518 microversion: 2.1 time: 0.555568 Aug 31 16:19:08.597337 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2669/5527] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:08 2022] GET /compute/v2.1/servers/e8cc6df1-d4ec-4150-a4be-7f5ed20d64d2 => generated 1518 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:08.746996 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9d7e0d94-6bea-4596-92f7-45a570ac9446 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:08.748115 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9d7e0d94-6bea-4596-92f7-45a570ac9446 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:08.762731 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d7e0d94-6bea-4596-92f7-45a570ac9446 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:08.765047 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d7e0d94-6bea-4596-92f7-45a570ac9446 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:08.766831 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d7e0d94-6bea-4596-92f7-45a570ac9446 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:08.769354 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d7e0d94-6bea-4596-92f7-45a570ac9446 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:08.771026 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d7e0d94-6bea-4596-92f7-45a570ac9446 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:08.772761 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d7e0d94-6bea-4596-92f7-45a570ac9446 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:08.855360 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=2,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:19:08.860740 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d7e0d94-6bea-4596-92f7-45a570ac9446 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:08.861751 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d7e0d94-6bea-4596-92f7-45a570ac9446 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:08.862229 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d7e0d94-6bea-4596-92f7-45a570ac9446 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:08.862808 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-9d7e0d94-6bea-4596-92f7-45a570ac9446 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lazy-loading 'fault' on Instance uuid 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:19:08.895759 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6e09fedb-0dab-45d5-ae2a-e6f7c094f8c9 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:08.908838 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6e09fedb-0dab-45d5-ae2a-e6f7c094f8c9 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:08.910361 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6e09fedb-0dab-45d5-ae2a-e6f7c094f8c9 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:08.911890 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6e09fedb-0dab-45d5-ae2a-e6f7c094f8c9 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1750 microversion: 2.20 time: 0.496679 Aug 31 16:19:08.912699 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2859/5528] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:19:08 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1750 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:19:08.973721 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9d7e0d94-6bea-4596-92f7-45a570ac9446 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:08.983147 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9d7e0d94-6bea-4596-92f7-45a570ac9446 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef" status: 200 len: 1331 microversion: 2.1 time: 0.240605 Aug 31 16:19:09.002288 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2670/5529] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:08 2022] GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef => generated 1331 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:09.437189 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-571cb434-faf0-4d1f-b5a9-241bb8a54a70 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:09.437803 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-571cb434-faf0-4d1f-b5a9-241bb8a54a70 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 5cdd332d-8fd9-4b10-bc9b-a90375e91451] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:09.453495 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-571cb434-faf0-4d1f-b5a9-241bb8a54a70 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:09.453987 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-571cb434-faf0-4d1f-b5a9-241bb8a54a70 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:09.464554 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-571cb434-faf0-4d1f-b5a9-241bb8a54a70 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:09.485640 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-571cb434-faf0-4d1f-b5a9-241bb8a54a70 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:09.488010 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-571cb434-faf0-4d1f-b5a9-241bb8a54a70 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:09.489646 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-571cb434-faf0-4d1f-b5a9-241bb8a54a70 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:09.621764 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-01ad4c13-948b-481f-9bd7-c4b87c29d5ba tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:09.622829 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-01ad4c13-948b-481f-9bd7-c4b87c29d5ba tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] [instance: e8cc6df1-d4ec-4150-a4be-7f5ed20d64d2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:09.638746 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01ad4c13-948b-481f-9bd7-c4b87c29d5ba tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:09.639541 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01ad4c13-948b-481f-9bd7-c4b87c29d5ba tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:09.642169 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01ad4c13-948b-481f-9bd7-c4b87c29d5ba tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:09.643571 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01ad4c13-948b-481f-9bd7-c4b87c29d5ba tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:09.651805 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01ad4c13-948b-481f-9bd7-c4b87c29d5ba tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:09.653121 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01ad4c13-948b-481f-9bd7-c4b87c29d5ba tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:09.665394 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-571cb434-faf0-4d1f-b5a9-241bb8a54a70 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:09.682219 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-571cb434-faf0-4d1f-b5a9-241bb8a54a70 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451" status: 200 len: 1319 microversion: 2.1 time: 0.249072 Aug 31 16:19:09.710787 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2860/5530] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:09 2022] GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451 => generated 1319 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:09.940376 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f3e76325-0880-434d-8865-47703ddb2eb3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:09.941004 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f3e76325-0880-434d-8865-47703ddb2eb3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:09.952528 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f3e76325-0880-434d-8865-47703ddb2eb3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:09.957246 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f3e76325-0880-434d-8865-47703ddb2eb3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:09.958355 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f3e76325-0880-434d-8865-47703ddb2eb3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:09.959151 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f3e76325-0880-434d-8865-47703ddb2eb3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:09.959815 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f3e76325-0880-434d-8865-47703ddb2eb3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:09.960292 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f3e76325-0880-434d-8865-47703ddb2eb3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:10.145114 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-01ad4c13-948b-481f-9bd7-c4b87c29d5ba tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:10.165933 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-01ad4c13-948b-481f-9bd7-c4b87c29d5ba tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers/e8cc6df1-d4ec-4150-a4be-7f5ed20d64d2" status: 200 len: 1518 microversion: 2.1 time: 0.550309 Aug 31 16:19:10.166552 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2671/5531] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:09 2022] GET /compute/v2.1/servers/e8cc6df1-d4ec-4150-a4be-7f5ed20d64d2 => generated 1518 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:19:10.185908 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-38f5bb2d-f593-4f41-a8e9-f2c395070287 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:10.186991 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-38f5bb2d-f593-4f41-a8e9-f2c395070287 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:10.205698 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38f5bb2d-f593-4f41-a8e9-f2c395070287 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:10.206313 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38f5bb2d-f593-4f41-a8e9-f2c395070287 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:10.206810 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38f5bb2d-f593-4f41-a8e9-f2c395070287 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:10.207577 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38f5bb2d-f593-4f41-a8e9-f2c395070287 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:10.208299 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38f5bb2d-f593-4f41-a8e9-f2c395070287 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:10.209032 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38f5bb2d-f593-4f41-a8e9-f2c395070287 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:10.235713 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-38f5bb2d-f593-4f41-a8e9-f2c395070287 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] HTTP exception thrown: Instance 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef could not be found. Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-38f5bb2d-f593-4f41-a8e9-f2c395070287 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Request method failure captured: Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef HTTP/1.1 Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4jmnQUplwr8AbbPZFrGxW4cxkzmu6dBR1PW9StPm7lwt758HQoCfwjfTobZNcY1qtMPO8jDX-KXtXLta2nSjy7PGTgxIA8J9_334X72rGtCeQYm6RDS4nOjdET00Y60PMzSq7EOVRAdi656mkiv_ceC-3aVenrz44MCAB3Nc0UBrjk Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: c3cdfdf921af4bc59c5c2fea1287b598 Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-AttachVolumeNegativeTest-1670272717 Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c3cdfdf921af4bc59c5c2fea1287b598"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c3cdfdf921af4bc59c5c2fea1287b598"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c3cdfdf921af4bc59c5c2fea1287b598"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c3cdfdf921af4bc59c5c2fea1287b598", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-AttachVolumeNegativeTest-1670272717 Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: c3cdfdf921af4bc59c5c2fea1287b598 Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1670272717 Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-AttachVolumeNegativeTest-1670272717-project Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 6f95e357d68d4ad4a5eedbb08b41c5c1 Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-AttachVolumeNegativeTest-1670272717-project Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef could not be found. Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef'} Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef could not be found. Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef could not be found. Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:19:10.243521 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:19:10.247101 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:19:10.247101 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:19:10.247101 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:19:10.247101 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:19:10.247101 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:19:10.247101 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef could not be found. Aug 31 16:19:10.247101 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:19:10.247101 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-38f5bb2d-f593-4f41-a8e9-f2c395070287 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Returning 404 to user: Instance 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:19:10.247547 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=12 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:19:10.247622 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-38f5bb2d-f593-4f41-a8e9-f2c395070287 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef" status: 404 len: 111 microversion: 2.1 time: 0.064570 Aug 31 16:19:10.248167 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2672/5532] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:10 2022] GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:19:10.262493 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-10d36e76-d7ac-42c6-935e-7ecf59f2fde4 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '.version_select at 0x7fbb4aa25b80>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:10.301719 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-10d36e76-d7ac-42c6-935e-7ecf59f2fde4 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-454120424" status: 202 len: 0 microversion: 2.1 time: 0.051642 Aug 31 16:19:10.302974 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2673/5533] 10.222.0.50 () {58 vars in 1218 bytes} [Wed Aug 31 16:19:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-454120424 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:19:10.653957 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f3e76325-0880-434d-8865-47703ddb2eb3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:10.665946 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f3e76325-0880-434d-8865-47703ddb2eb3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:10.667826 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f3e76325-0880-434d-8865-47703ddb2eb3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:10.669649 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f3e76325-0880-434d-8865-47703ddb2eb3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1806 microversion: 2.20 time: 0.733523 Aug 31 16:19:10.704131 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2861/5534] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:19:09 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1806 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:19:10.704802 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c91b3713-40d1-436d-80f3-d0db6514ef92 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:10.705420 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c91b3713-40d1-436d-80f3-d0db6514ef92 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 5cdd332d-8fd9-4b10-bc9b-a90375e91451] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:10.725775 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c91b3713-40d1-436d-80f3-d0db6514ef92 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:10.726547 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c91b3713-40d1-436d-80f3-d0db6514ef92 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:10.727175 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c91b3713-40d1-436d-80f3-d0db6514ef92 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:10.728066 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c91b3713-40d1-436d-80f3-d0db6514ef92 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:10.728778 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c91b3713-40d1-436d-80f3-d0db6514ef92 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:10.731154 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c91b3713-40d1-436d-80f3-d0db6514ef92 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:10.903323 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c91b3713-40d1-436d-80f3-d0db6514ef92 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:10.933698 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c91b3713-40d1-436d-80f3-d0db6514ef92 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451" status: 200 len: 1325 microversion: 2.1 time: 0.223504 Aug 31 16:19:10.937249 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2674/5535] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:10 2022] GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451 => generated 1325 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:11.191403 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ad66baea-483b-46af-8058-2b670543fb52 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:11.193905 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ad66baea-483b-46af-8058-2b670543fb52 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] [instance: e8cc6df1-d4ec-4150-a4be-7f5ed20d64d2] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:11.205606 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ad66baea-483b-46af-8058-2b670543fb52 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:11.215605 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ad66baea-483b-46af-8058-2b670543fb52 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:11.216338 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ad66baea-483b-46af-8058-2b670543fb52 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:11.222783 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ad66baea-483b-46af-8058-2b670543fb52 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:11.225039 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ad66baea-483b-46af-8058-2b670543fb52 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:11.229650 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ad66baea-483b-46af-8058-2b670543fb52 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:11.441263 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ad66baea-483b-46af-8058-2b670543fb52 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:11.457735 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ad66baea-483b-46af-8058-2b670543fb52 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers/e8cc6df1-d4ec-4150-a4be-7f5ed20d64d2" status: 200 len: 1476 microversion: 2.1 time: 0.274465 Aug 31 16:19:11.459655 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2862/5536] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:11 2022] GET /compute/v2.1/servers/e8cc6df1-d4ec-4150-a4be-7f5ed20d64d2 => generated 1476 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:11.702473 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d9ce0384-abb1-4441-8e52-5019339f1d4e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:11.704123 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d9ce0384-abb1-4441-8e52-5019339f1d4e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:11.728307 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9ce0384-abb1-4441-8e52-5019339f1d4e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:11.733139 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9ce0384-abb1-4441-8e52-5019339f1d4e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:11.733752 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9ce0384-abb1-4441-8e52-5019339f1d4e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:11.735036 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9ce0384-abb1-4441-8e52-5019339f1d4e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:11.737234 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9ce0384-abb1-4441-8e52-5019339f1d4e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:11.738471 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9ce0384-abb1-4441-8e52-5019339f1d4e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:11.963240 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7563c8d1-eb19-489c-8370-df22678ec6e7 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:11.966199 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7563c8d1-eb19-489c-8370-df22678ec6e7 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 5cdd332d-8fd9-4b10-bc9b-a90375e91451] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:11.977725 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7563c8d1-eb19-489c-8370-df22678ec6e7 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:11.978982 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7563c8d1-eb19-489c-8370-df22678ec6e7 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:11.980245 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7563c8d1-eb19-489c-8370-df22678ec6e7 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:11.982910 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7563c8d1-eb19-489c-8370-df22678ec6e7 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:11.983606 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7563c8d1-eb19-489c-8370-df22678ec6e7 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:11.984263 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7563c8d1-eb19-489c-8370-df22678ec6e7 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:12.262633 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7563c8d1-eb19-489c-8370-df22678ec6e7 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:12.275202 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7563c8d1-eb19-489c-8370-df22678ec6e7 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451" status: 200 len: 1325 microversion: 2.1 time: 0.316671 Aug 31 16:19:12.285392 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2863/5537] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:11 2022] GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451 => generated 1325 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:19:12.304640 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-89125ff2-b0c4-47c8-aa9d-003256339af3 req-d791fc1a-4611-45c8-8cff-6ffc45e419b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8cc6df1-d4ec-4150-a4be-7f5ed20d64d2", "name": "network-vif-deleted", "tag": "e07f4077-2b68-40b6-9fbb-6eaf10f85cf7"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:19:12.324618 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-89125ff2-b0c4-47c8-aa9d-003256339af3 req-d791fc1a-4611-45c8-8cff-6ffc45e419b9 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:12.329495 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-89125ff2-b0c4-47c8-aa9d-003256339af3 req-d791fc1a-4611-45c8-8cff-6ffc45e419b9 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:12.330424 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-89125ff2-b0c4-47c8-aa9d-003256339af3 req-d791fc1a-4611-45c8-8cff-6ffc45e419b9 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:12.373703 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-89125ff2-b0c4-47c8-aa9d-003256339af3 req-d791fc1a-4611-45c8-8cff-6ffc45e419b9 service nova] Creating event network-vif-deleted:e07f4077-2b68-40b6-9fbb-6eaf10f85cf7 for instance e8cc6df1-d4ec-4150-a4be-7f5ed20d64d2 on n-h2-833090-16 Aug 31 16:19:12.388842 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-89125ff2-b0c4-47c8-aa9d-003256339af3 req-d791fc1a-4611-45c8-8cff-6ffc45e419b9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099325 Aug 31 16:19:12.390004 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2864/5538] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:19:12.482041 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6f30ec74-08fd-4252-bbff-d679ef6f54a8 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:12.482866 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6f30ec74-08fd-4252-bbff-d679ef6f54a8 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] [instance: e8cc6df1-d4ec-4150-a4be-7f5ed20d64d2] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:12.495959 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f30ec74-08fd-4252-bbff-d679ef6f54a8 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:12.509486 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f30ec74-08fd-4252-bbff-d679ef6f54a8 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:12.510080 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f30ec74-08fd-4252-bbff-d679ef6f54a8 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:12.515998 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f30ec74-08fd-4252-bbff-d679ef6f54a8 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:12.518660 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f30ec74-08fd-4252-bbff-d679ef6f54a8 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:12.519112 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f30ec74-08fd-4252-bbff-d679ef6f54a8 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:12.658316 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f30ec74-08fd-4252-bbff-d679ef6f54a8 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:12.660268 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f30ec74-08fd-4252-bbff-d679ef6f54a8 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:12.662890 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f30ec74-08fd-4252-bbff-d679ef6f54a8 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:12.663563 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-6f30ec74-08fd-4252-bbff-d679ef6f54a8 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lazy-loading 'fault' on Instance uuid e8cc6df1-d4ec-4150-a4be-7f5ed20d64d2 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:19:12.875480 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d9ce0384-abb1-4441-8e52-5019339f1d4e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:12.916971 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d9ce0384-abb1-4441-8e52-5019339f1d4e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:12.923082 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d9ce0384-abb1-4441-8e52-5019339f1d4e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:12.924385 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d9ce0384-abb1-4441-8e52-5019339f1d4e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1806 microversion: 2.20 time: 1.227458 Aug 31 16:19:12.926764 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2675/5539] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:19:11 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1806 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:19:12.965215 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6f30ec74-08fd-4252-bbff-d679ef6f54a8 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:12.983480 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6f30ec74-08fd-4252-bbff-d679ef6f54a8 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers/e8cc6df1-d4ec-4150-a4be-7f5ed20d64d2" status: 200 len: 1311 microversion: 2.1 time: 0.506948 Aug 31 16:19:12.986137 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2865/5540] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:12 2022] GET /compute/v2.1/servers/e8cc6df1-d4ec-4150-a4be-7f5ed20d64d2 => generated 1311 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:19:13.305595 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-19b910d3-e303-442b-9087-d55965d8c9f4 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:13.306369 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-19b910d3-e303-442b-9087-d55965d8c9f4 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 5cdd332d-8fd9-4b10-bc9b-a90375e91451] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:13.319685 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19b910d3-e303-442b-9087-d55965d8c9f4 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:13.320281 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19b910d3-e303-442b-9087-d55965d8c9f4 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:13.323933 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19b910d3-e303-442b-9087-d55965d8c9f4 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:13.326835 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19b910d3-e303-442b-9087-d55965d8c9f4 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:13.327514 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19b910d3-e303-442b-9087-d55965d8c9f4 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:13.328725 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19b910d3-e303-442b-9087-d55965d8c9f4 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:13.955415 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-666085a2-5497-45f7-a955-1d0ff11e3307 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:13.956327 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-666085a2-5497-45f7-a955-1d0ff11e3307 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:13.969838 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-666085a2-5497-45f7-a955-1d0ff11e3307 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:13.971356 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-666085a2-5497-45f7-a955-1d0ff11e3307 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:13.972228 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-666085a2-5497-45f7-a955-1d0ff11e3307 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:13.973082 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-666085a2-5497-45f7-a955-1d0ff11e3307 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:13.973704 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-666085a2-5497-45f7-a955-1d0ff11e3307 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:13.974396 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-666085a2-5497-45f7-a955-1d0ff11e3307 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:14.137306 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-19b910d3-e303-442b-9087-d55965d8c9f4 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:14.149261 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-19b910d3-e303-442b-9087-d55965d8c9f4 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451" status: 200 len: 1325 microversion: 2.1 time: 0.847794 Aug 31 16:19:14.154243 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2676/5541] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:13 2022] GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451 => generated 1325 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:14.159341 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fcb03089-0fa3-46ab-b2cc-e288512fef19 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:14.164891 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fcb03089-0fa3-46ab-b2cc-e288512fef19 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] [instance: e8cc6df1-d4ec-4150-a4be-7f5ed20d64d2] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:14.178806 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fcb03089-0fa3-46ab-b2cc-e288512fef19 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:14.179674 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fcb03089-0fa3-46ab-b2cc-e288512fef19 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:14.181014 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fcb03089-0fa3-46ab-b2cc-e288512fef19 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:14.185066 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fcb03089-0fa3-46ab-b2cc-e288512fef19 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:14.185818 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fcb03089-0fa3-46ab-b2cc-e288512fef19 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:14.186512 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fcb03089-0fa3-46ab-b2cc-e288512fef19 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:14.216341 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-fcb03089-0fa3-46ab-b2cc-e288512fef19 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] HTTP exception thrown: Instance e8cc6df1-d4ec-4150-a4be-7f5ed20d64d2 could not be found. Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fcb03089-0fa3-46ab-b2cc-e288512fef19 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Request method failure captured: Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/e8cc6df1-d4ec-4150-a4be-7f5ed20d64d2 HTTP/1.1 Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4mx52cZ3dD8tFAq5Mxl86AsOt_DqyTXwMzWFYujrgUB3RFFiK4V8KUH7x9c3bKCAb1P1bU0S7t-8pMm1uix8BrP4ABOQ_6kR0XWe3q7KPVY5mI8prazXlwK5_iJeetsDduYdvwvmdNYDBty7Bk1m94toWG8A7sVtwlMVbCapAyUUWI Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 78689045e6c945108c966ba3cbeb5216 Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ListServerFiltersTestJSON-847291327 Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/78689045e6c945108c966ba3cbeb5216"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/78689045e6c945108c966ba3cbeb5216"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/78689045e6c945108c966ba3cbeb5216"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_78689045e6c945108c966ba3cbeb5216", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ListServerFiltersTestJSON-847291327 Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 78689045e6c945108c966ba3cbeb5216 Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-847291327 Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ListServerFiltersTestJSON-847291327-project Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 5a0360d29d1c48d6bcab7d5198a0148b Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ListServerFiltersTestJSON-847291327-project Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance e8cc6df1-d4ec-4150-a4be-7f5ed20d64d2 could not be found. Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'e8cc6df1-d4ec-4150-a4be-7f5ed20d64d2'} Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8cc6df1-d4ec-4150-a4be-7f5ed20d64d2 could not be found. Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8cc6df1-d4ec-4150-a4be-7f5ed20d64d2 could not be found. Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:19:14.219914 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:19:14.223988 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:19:14.223988 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:19:14.223988 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:19:14.223988 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:19:14.223988 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:19:14.223988 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8cc6df1-d4ec-4150-a4be-7f5ed20d64d2 could not be found. Aug 31 16:19:14.223988 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:19:14.223988 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fcb03089-0fa3-46ab-b2cc-e288512fef19 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Returning 404 to user: Instance e8cc6df1-d4ec-4150-a4be-7f5ed20d64d2 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:19:14.225484 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fcb03089-0fa3-46ab-b2cc-e288512fef19 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers/e8cc6df1-d4ec-4150-a4be-7f5ed20d64d2" status: 404 len: 111 microversion: 2.1 time: 0.066023 Aug 31 16:19:14.226192 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2677/5542] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:14 2022] GET /compute/v2.1/servers/e8cc6df1-d4ec-4150-a4be-7f5ed20d64d2 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:19:14.239140 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2fbf8bcc-7f92-42d5-b5f0-3881805350cd tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:14.239879 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2fbf8bcc-7f92-42d5-b5f0-3881805350cd tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] [instance: a398032b-3def-4df0-bb77-550d29e5be00] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:14.258069 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2fbf8bcc-7f92-42d5-b5f0-3881805350cd tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:14.258903 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2fbf8bcc-7f92-42d5-b5f0-3881805350cd tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:14.258995 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2fbf8bcc-7f92-42d5-b5f0-3881805350cd tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:14.259671 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2fbf8bcc-7f92-42d5-b5f0-3881805350cd tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:14.260116 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2fbf8bcc-7f92-42d5-b5f0-3881805350cd tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:14.260531 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2fbf8bcc-7f92-42d5-b5f0-3881805350cd tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:14.344475 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2fbf8bcc-7f92-42d5-b5f0-3881805350cd tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] [instance: a398032b-3def-4df0-bb77-550d29e5be00] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:19:14.522780 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2fbf8bcc-7f92-42d5-b5f0-3881805350cd tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a398032b-3def-4df0-bb77-550d29e5be00" status: 204 len: 0 microversion: 2.1 time: 0.289271 Aug 31 16:19:14.524999 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2678/5543] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:19:14 2022] DELETE /compute/v2.1/servers/a398032b-3def-4df0-bb77-550d29e5be00 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:19:14.532372 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-a40faa6a-5931-4b15-b4fc-d7a6bda036c0 req-a4d3eda8-9edd-4d40-8d2d-3c5ab7b11e2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d", "tag": "8e4486a0-b7ef-4efa-8a3b-565a37bae537"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:19:14.563233 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a40faa6a-5931-4b15-b4fc-d7a6bda036c0 req-a4d3eda8-9edd-4d40-8d2d-3c5ab7b11e2c service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:14.564108 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a40faa6a-5931-4b15-b4fc-d7a6bda036c0 req-a4d3eda8-9edd-4d40-8d2d-3c5ab7b11e2c service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:14.572486 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a40faa6a-5931-4b15-b4fc-d7a6bda036c0 req-a4d3eda8-9edd-4d40-8d2d-3c5ab7b11e2c service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:14.590372 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-a40faa6a-5931-4b15-b4fc-d7a6bda036c0 req-a4d3eda8-9edd-4d40-8d2d-3c5ab7b11e2c service nova] Creating event network-changed:8e4486a0-b7ef-4efa-8a3b-565a37bae537 for instance 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d on n-h2-833090-16 Aug 31 16:19:14.597785 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-a40faa6a-5931-4b15-b4fc-d7a6bda036c0 req-a4d3eda8-9edd-4d40-8d2d-3c5ab7b11e2c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070667 Aug 31 16:19:14.599377 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2679/5544] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:19:14.606415 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e105a898-e695-43f6-886d-114ebddbb45c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:14.607620 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e105a898-e695-43f6-886d-114ebddbb45c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] [instance: a398032b-3def-4df0-bb77-550d29e5be00] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:14.622938 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e105a898-e695-43f6-886d-114ebddbb45c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:14.626909 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e105a898-e695-43f6-886d-114ebddbb45c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:14.644337 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e105a898-e695-43f6-886d-114ebddbb45c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:14.647332 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e105a898-e695-43f6-886d-114ebddbb45c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:14.649743 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e105a898-e695-43f6-886d-114ebddbb45c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:14.668202 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e105a898-e695-43f6-886d-114ebddbb45c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:14.676672 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-666085a2-5497-45f7-a955-1d0ff11e3307 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:14.694808 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-666085a2-5497-45f7-a955-1d0ff11e3307 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:14.702484 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-666085a2-5497-45f7-a955-1d0ff11e3307 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:14.707103 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-666085a2-5497-45f7-a955-1d0ff11e3307 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1806 microversion: 2.20 time: 0.756189 Aug 31 16:19:14.712872 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2866/5545] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:19:13 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1806 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:19:14.805407 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b2251671-ffcb-4ed0-9f26-2f2f2ff06700 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Action: 'create', calling method: .version_select at 0x7fbb4672b790>, body: {"keypair": {"name": "tempest-keypair-989849790", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMLvluKfTj8YOdeFvAkmDa4+J6mLR0Lsv+e4/3jOm+yiCYZSuTdzIamtnbOXz3laEL0m9EOX2WTCMd5lBpGC1iKTvBRAG8uys7twmNQnFPkO918u5tuFYOk3ZbmL+YKizQ=="}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:19:14.832016 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-b2251671-ffcb-4ed0-9f26-2f2f2ff06700 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Getting quotas for project c3cdfdf921af4bc59c5c2fea1287b598. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:19:14.842024 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-b2251671-ffcb-4ed0-9f26-2f2f2ff06700 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Getting quotas for user 6f95e357d68d4ad4a5eedbb08b41c5c1 and project c3cdfdf921af4bc59c5c2fea1287b598. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:19:14.895495 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b2251671-ffcb-4ed0-9f26-2f2f2ff06700 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.091730 Aug 31 16:19:14.897030 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2867/5546] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 31 16:19:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:19:15.178258 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6e9db3c9-c459-4046-9c56-f05585cdbcde tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:15.181041 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6e9db3c9-c459-4046-9c56-f05585cdbcde tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 5cdd332d-8fd9-4b10-bc9b-a90375e91451] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:15.206043 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6e9db3c9-c459-4046-9c56-f05585cdbcde tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:15.208770 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6e9db3c9-c459-4046-9c56-f05585cdbcde tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:15.211648 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6e9db3c9-c459-4046-9c56-f05585cdbcde tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:15.213634 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6e9db3c9-c459-4046-9c56-f05585cdbcde tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:15.216085 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6e9db3c9-c459-4046-9c56-f05585cdbcde tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:15.217803 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6e9db3c9-c459-4046-9c56-f05585cdbcde tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:15.369723 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e105a898-e695-43f6-886d-114ebddbb45c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:15.386883 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e105a898-e695-43f6-886d-114ebddbb45c tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers/a398032b-3def-4df0-bb77-550d29e5be00" status: 200 len: 1518 microversion: 2.1 time: 0.786115 Aug 31 16:19:15.387471 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2680/5547] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:14 2022] GET /compute/v2.1/servers/a398032b-3def-4df0-bb77-550d29e5be00 => generated 1518 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:15.741157 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-68761d9d-d64d-4458-b1b3-42422a3fa132 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:15.742063 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-68761d9d-d64d-4458-b1b3-42422a3fa132 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:15.767815 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68761d9d-d64d-4458-b1b3-42422a3fa132 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:15.769148 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68761d9d-d64d-4458-b1b3-42422a3fa132 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:15.771394 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68761d9d-d64d-4458-b1b3-42422a3fa132 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:15.772781 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68761d9d-d64d-4458-b1b3-42422a3fa132 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:15.775213 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68761d9d-d64d-4458-b1b3-42422a3fa132 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:15.780699 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68761d9d-d64d-4458-b1b3-42422a3fa132 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:15.984824 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6e9db3c9-c459-4046-9c56-f05585cdbcde tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:16.002730 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6e9db3c9-c459-4046-9c56-f05585cdbcde tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451" status: 200 len: 1393 microversion: 2.1 time: 0.831215 Aug 31 16:19:16.005642 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2868/5548] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:15 2022] GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451 => generated 1393 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:16.296021 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-68761d9d-d64d-4458-b1b3-42422a3fa132 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:16.309208 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-68761d9d-d64d-4458-b1b3-42422a3fa132 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:16.312632 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-68761d9d-d64d-4458-b1b3-42422a3fa132 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:16.315716 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-68761d9d-d64d-4458-b1b3-42422a3fa132 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1806 microversion: 2.20 time: 0.580391 Aug 31 16:19:16.318126 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2681/5549] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:19:15 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1806 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:19:16.414925 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4f26cf9e-a326-466e-81db-798ca9d48a52 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:16.416520 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4f26cf9e-a326-466e-81db-798ca9d48a52 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] [instance: a398032b-3def-4df0-bb77-550d29e5be00] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:16.437398 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4f26cf9e-a326-466e-81db-798ca9d48a52 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:16.438664 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4f26cf9e-a326-466e-81db-798ca9d48a52 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:16.440075 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4f26cf9e-a326-466e-81db-798ca9d48a52 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:16.441736 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4f26cf9e-a326-466e-81db-798ca9d48a52 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:16.443324 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4f26cf9e-a326-466e-81db-798ca9d48a52 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:16.443952 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4f26cf9e-a326-466e-81db-798ca9d48a52 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:16.923219 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4f26cf9e-a326-466e-81db-798ca9d48a52 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:16.931529 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:19:16.939401 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4f26cf9e-a326-466e-81db-798ca9d48a52 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers/a398032b-3def-4df0-bb77-550d29e5be00" status: 200 len: 1518 microversion: 2.1 time: 0.529756 Aug 31 16:19:16.941300 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2869/5550] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:16 2022] GET /compute/v2.1/servers/a398032b-3def-4df0-bb77-550d29e5be00 => generated 1518 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:17.028808 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-69c49a4b-ea13-4805-8bb4-003ae3a2d689 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:17.030027 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-69c49a4b-ea13-4805-8bb4-003ae3a2d689 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 5cdd332d-8fd9-4b10-bc9b-a90375e91451] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:17.045394 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69c49a4b-ea13-4805-8bb4-003ae3a2d689 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:17.046400 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69c49a4b-ea13-4805-8bb4-003ae3a2d689 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:17.046998 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69c49a4b-ea13-4805-8bb4-003ae3a2d689 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:17.048033 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69c49a4b-ea13-4805-8bb4-003ae3a2d689 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:17.048744 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69c49a4b-ea13-4805-8bb4-003ae3a2d689 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:17.049489 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69c49a4b-ea13-4805-8bb4-003ae3a2d689 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:17.341319 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-48ecd0e9-df26-4f89-b4ee-da102e361032 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:17.343683 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-48ecd0e9-df26-4f89-b4ee-da102e361032 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:17.354365 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-48ecd0e9-df26-4f89-b4ee-da102e361032 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:17.354731 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-48ecd0e9-df26-4f89-b4ee-da102e361032 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:17.360726 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-48ecd0e9-df26-4f89-b4ee-da102e361032 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:17.365548 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-48ecd0e9-df26-4f89-b4ee-da102e361032 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:17.368819 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-48ecd0e9-df26-4f89-b4ee-da102e361032 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:17.369288 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-48ecd0e9-df26-4f89-b4ee-da102e361032 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:17.455664 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-69c49a4b-ea13-4805-8bb4-003ae3a2d689 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:17.468789 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-69c49a4b-ea13-4805-8bb4-003ae3a2d689 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451" status: 200 len: 1393 microversion: 2.1 time: 0.442926 Aug 31 16:19:17.470472 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2682/5551] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:17 2022] GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451 => generated 1393 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:17.683328 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-3cfddd92-0daa-43ad-826a-a9c4c7925a28 req-e8a94b22-5e67-415e-9c7e-aca763eb74e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a398032b-3def-4df0-bb77-550d29e5be00", "name": "network-vif-deleted", "tag": "42a5fd88-1045-4f59-8c7b-feb51537995f"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:19:17.718552 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3cfddd92-0daa-43ad-826a-a9c4c7925a28 req-e8a94b22-5e67-415e-9c7e-aca763eb74e3 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:17.719170 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3cfddd92-0daa-43ad-826a-a9c4c7925a28 req-e8a94b22-5e67-415e-9c7e-aca763eb74e3 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:17.719630 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3cfddd92-0daa-43ad-826a-a9c4c7925a28 req-e8a94b22-5e67-415e-9c7e-aca763eb74e3 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:17.753224 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-3cfddd92-0daa-43ad-826a-a9c4c7925a28 req-e8a94b22-5e67-415e-9c7e-aca763eb74e3 service nova] Creating event network-vif-deleted:42a5fd88-1045-4f59-8c7b-feb51537995f for instance a398032b-3def-4df0-bb77-550d29e5be00 on n-h1-833090-16 Aug 31 16:19:17.766389 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-3cfddd92-0daa-43ad-826a-a9c4c7925a28 req-e8a94b22-5e67-415e-9c7e-aca763eb74e3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086843 Aug 31 16:19:17.770732 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2683/5552] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:19:17.966932 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-84fb6403-d790-425a-a434-6e1ad115094d tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:17.967791 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-84fb6403-d790-425a-a434-6e1ad115094d tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] [instance: a398032b-3def-4df0-bb77-550d29e5be00] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:17.976838 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=8 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:19:17.991466 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:19:18.025054 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-84fb6403-d790-425a-a434-6e1ad115094d tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:18.026879 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-84fb6403-d790-425a-a434-6e1ad115094d tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:18.031240 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-84fb6403-d790-425a-a434-6e1ad115094d tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:18.034944 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-84fb6403-d790-425a-a434-6e1ad115094d tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:18.039251 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-84fb6403-d790-425a-a434-6e1ad115094d tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:18.042338 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-84fb6403-d790-425a-a434-6e1ad115094d tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:18.192470 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-84fb6403-d790-425a-a434-6e1ad115094d tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:18.193625 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-84fb6403-d790-425a-a434-6e1ad115094d tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:18.194082 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-84fb6403-d790-425a-a434-6e1ad115094d tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:18.194576 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-84fb6403-d790-425a-a434-6e1ad115094d tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lazy-loading 'fault' on Instance uuid a398032b-3def-4df0-bb77-550d29e5be00 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:19:18.243224 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:19:18.498279 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-84fb6403-d790-425a-a434-6e1ad115094d tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0360d29d1c48d6bcab7d5198a0148b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78689045e6c945108c966ba3cbeb5216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:18.535624 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-84fb6403-d790-425a-a434-6e1ad115094d tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers/a398032b-3def-4df0-bb77-550d29e5be00" status: 200 len: 1311 microversion: 2.1 time: 0.574957 Aug 31 16:19:18.547429 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-48ecd0e9-df26-4f89-b4ee-da102e361032 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:18.571680 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2684/5553] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:17 2022] GET /compute/v2.1/servers/a398032b-3def-4df0-bb77-550d29e5be00 => generated 1311 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:18.576619 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-48ecd0e9-df26-4f89-b4ee-da102e361032 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:18.576952 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9eff6209-e37e-43a3-8335-2a3999befee6 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:18.577775 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9eff6209-e37e-43a3-8335-2a3999befee6 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 5cdd332d-8fd9-4b10-bc9b-a90375e91451] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:18.584298 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-48ecd0e9-df26-4f89-b4ee-da102e361032 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:18.585893 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-48ecd0e9-df26-4f89-b4ee-da102e361032 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1806 microversion: 2.20 time: 1.249385 Aug 31 16:19:18.587106 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2870/5554] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:19:17 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1806 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:19:18.596396 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9eff6209-e37e-43a3-8335-2a3999befee6 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:18.596899 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9eff6209-e37e-43a3-8335-2a3999befee6 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:18.597336 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9eff6209-e37e-43a3-8335-2a3999befee6 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:18.598039 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9eff6209-e37e-43a3-8335-2a3999befee6 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:18.598525 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9eff6209-e37e-43a3-8335-2a3999befee6 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:18.599007 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9eff6209-e37e-43a3-8335-2a3999befee6 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:19.283633 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-5ffcdadc-e420-41c0-86aa-8ca14b9275f5 req-c5c48c2d-4b48-49e1-b0d5-cf2d08446e61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cdd332d-8fd9-4b10-bc9b-a90375e91451", "tag": "13e49ea1-4330-43bd-abbb-39b92d47a423"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:19:19.326598 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-5ffcdadc-e420-41c0-86aa-8ca14b9275f5 req-c5c48c2d-4b48-49e1-b0d5-cf2d08446e61 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:19.327540 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-5ffcdadc-e420-41c0-86aa-8ca14b9275f5 req-c5c48c2d-4b48-49e1-b0d5-cf2d08446e61 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:19.328182 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-5ffcdadc-e420-41c0-86aa-8ca14b9275f5 req-c5c48c2d-4b48-49e1-b0d5-cf2d08446e61 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:19.366986 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-5ffcdadc-e420-41c0-86aa-8ca14b9275f5 req-c5c48c2d-4b48-49e1-b0d5-cf2d08446e61 service nova] Creating event network-changed:13e49ea1-4330-43bd-abbb-39b92d47a423 for instance 5cdd332d-8fd9-4b10-bc9b-a90375e91451 on n-h1-833090-16 Aug 31 16:19:19.392706 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-5ffcdadc-e420-41c0-86aa-8ca14b9275f5 req-c5c48c2d-4b48-49e1-b0d5-cf2d08446e61 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121034 Aug 31 16:19:19.401004 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2871/5555] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:19:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:19:19.581041 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c54a9fe2-9359-4a04-a4ba-5ec96f3569e5 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:19.582499 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c54a9fe2-9359-4a04-a4ba-5ec96f3569e5 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] [instance: a398032b-3def-4df0-bb77-550d29e5be00] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:19.608392 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c54a9fe2-9359-4a04-a4ba-5ec96f3569e5 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:19.610138 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c54a9fe2-9359-4a04-a4ba-5ec96f3569e5 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:19.611333 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c54a9fe2-9359-4a04-a4ba-5ec96f3569e5 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:19.615945 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c54a9fe2-9359-4a04-a4ba-5ec96f3569e5 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:19.616955 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c54a9fe2-9359-4a04-a4ba-5ec96f3569e5 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:19.619027 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c54a9fe2-9359-4a04-a4ba-5ec96f3569e5 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:19.657242 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-c54a9fe2-9359-4a04-a4ba-5ec96f3569e5 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] HTTP exception thrown: Instance a398032b-3def-4df0-bb77-550d29e5be00 could not be found. Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c54a9fe2-9359-4a04-a4ba-5ec96f3569e5 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Request method failure captured: Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/a398032b-3def-4df0-bb77-550d29e5be00 HTTP/1.1 Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4mx52cZ3dD8tFAq5Mxl86AsOt_DqyTXwMzWFYujrgUB3RFFiK4V8KUH7x9c3bKCAb1P1bU0S7t-8pMm1uix8BrP4ABOQ_6kR0XWe3q7KPVY5mI8prazXlwK5_iJeetsDduYdvwvmdNYDBty7Bk1m94toWG8A7sVtwlMVbCapAyUUWI Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 78689045e6c945108c966ba3cbeb5216 Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ListServerFiltersTestJSON-847291327 Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/78689045e6c945108c966ba3cbeb5216"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/78689045e6c945108c966ba3cbeb5216"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/78689045e6c945108c966ba3cbeb5216"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_78689045e6c945108c966ba3cbeb5216", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ListServerFiltersTestJSON-847291327 Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 78689045e6c945108c966ba3cbeb5216 Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-847291327 Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ListServerFiltersTestJSON-847291327-project Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 5a0360d29d1c48d6bcab7d5198a0148b Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ListServerFiltersTestJSON-847291327-project Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance a398032b-3def-4df0-bb77-550d29e5be00 could not be found. Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'a398032b-3def-4df0-bb77-550d29e5be00'} Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a398032b-3def-4df0-bb77-550d29e5be00 could not be found. Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a398032b-3def-4df0-bb77-550d29e5be00 could not be found. Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:19:19.659887 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:19:19.665889 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:19:19.665889 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:19:19.665889 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:19:19.665889 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:19:19.665889 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:19:19.665889 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a398032b-3def-4df0-bb77-550d29e5be00 could not be found. Aug 31 16:19:19.665889 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:19:19.669085 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c54a9fe2-9359-4a04-a4ba-5ec96f3569e5 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] Returning 404 to user: Instance a398032b-3def-4df0-bb77-550d29e5be00 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:19:19.670870 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c54a9fe2-9359-4a04-a4ba-5ec96f3569e5 tempest-ListServerFiltersTestJSON-847291327 tempest-ListServerFiltersTestJSON-847291327-project] 10.222.0.50 "GET /compute/v2.1/servers/a398032b-3def-4df0-bb77-550d29e5be00" status: 404 len: 111 microversion: 2.1 time: 0.094915 Aug 31 16:19:19.680636 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2872/5556] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:19 2022] GET /compute/v2.1/servers/a398032b-3def-4df0-bb77-550d29e5be00 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:19:19.685970 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-746b8cd0-86bb-4483-8849-1bafa53cfd65 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:19.691343 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-746b8cd0-86bb-4483-8849-1bafa53cfd65 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:19.710404 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-746b8cd0-86bb-4483-8849-1bafa53cfd65 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:19.711544 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-746b8cd0-86bb-4483-8849-1bafa53cfd65 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:19.712510 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-746b8cd0-86bb-4483-8849-1bafa53cfd65 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:19.713444 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-746b8cd0-86bb-4483-8849-1bafa53cfd65 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:19.719238 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-746b8cd0-86bb-4483-8849-1bafa53cfd65 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:19.720025 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-746b8cd0-86bb-4483-8849-1bafa53cfd65 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:20.482197 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9eff6209-e37e-43a3-8335-2a3999befee6 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:20.507307 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9eff6209-e37e-43a3-8335-2a3999befee6 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451" status: 200 len: 1393 microversion: 2.1 time: 1.946447 Aug 31 16:19:20.536998 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2685/5557] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:18 2022] GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451 => generated 1393 bytes in 1977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:20.607283 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-746b8cd0-86bb-4483-8849-1bafa53cfd65 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:20.619710 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-746b8cd0-86bb-4483-8849-1bafa53cfd65 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:20.622416 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-746b8cd0-86bb-4483-8849-1bafa53cfd65 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:20.624752 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-746b8cd0-86bb-4483-8849-1bafa53cfd65 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1806 microversion: 2.20 time: 0.942621 Aug 31 16:19:20.625799 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2873/5558] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:19:19 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1806 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:19:21.424192 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2992395a-4e98-4013-912e-6506aa7f2cc7 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2073068373", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ae90d5cd-3421-4e4a-9434-10c5079cf68b"}], "security_groups": [{"name": "tempest-securitygroup--927810550"}], "key_name": "tempest-keypair-989849790", "user_data": "}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:19:21.542426 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-039fa160-a3cf-4c82-85c6-97d8b355148a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:21.543047 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-039fa160-a3cf-4c82-85c6-97d8b355148a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 5cdd332d-8fd9-4b10-bc9b-a90375e91451] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:21.563654 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-039fa160-a3cf-4c82-85c6-97d8b355148a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:21.565959 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-039fa160-a3cf-4c82-85c6-97d8b355148a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:21.570332 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-039fa160-a3cf-4c82-85c6-97d8b355148a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:21.579166 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-039fa160-a3cf-4c82-85c6-97d8b355148a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:21.579652 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-039fa160-a3cf-4c82-85c6-97d8b355148a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:21.580446 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-039fa160-a3cf-4c82-85c6-97d8b355148a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:22.074753 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-2992395a-4e98-4013-912e-6506aa7f2cc7 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] validate_networks() for [('ae90d5cd-3421-4e4a-9434-10c5079cf68b', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:19:22.261706 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-039fa160-a3cf-4c82-85c6-97d8b355148a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:22.277922 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-039fa160-a3cf-4c82-85c6-97d8b355148a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451" status: 200 len: 1393 microversion: 2.1 time: 0.739395 Aug 31 16:19:22.298484 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2874/5559] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:21 2022] GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451 => generated 1393 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:22.304956 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c61612f2-dfe7-45b5-ba4e-a0f3bad0e163 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:22.306319 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c61612f2-dfe7-45b5-ba4e-a0f3bad0e163 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:22.325298 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c61612f2-dfe7-45b5-ba4e-a0f3bad0e163 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:22.328640 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c61612f2-dfe7-45b5-ba4e-a0f3bad0e163 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:22.329351 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c61612f2-dfe7-45b5-ba4e-a0f3bad0e163 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:22.330366 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c61612f2-dfe7-45b5-ba4e-a0f3bad0e163 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:22.333919 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c61612f2-dfe7-45b5-ba4e-a0f3bad0e163 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:22.344782 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c61612f2-dfe7-45b5-ba4e-a0f3bad0e163 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:23.359974 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c61612f2-dfe7-45b5-ba4e-a0f3bad0e163 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:23.383642 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c61612f2-dfe7-45b5-ba4e-a0f3bad0e163 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:23.388177 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c61612f2-dfe7-45b5-ba4e-a0f3bad0e163 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:23.393334 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c61612f2-dfe7-45b5-ba4e-a0f3bad0e163 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1806 microversion: 2.20 time: 1.093342 Aug 31 16:19:23.395242 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2875/5560] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:19:22 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1806 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:19:23.409856 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d200f0ab-7599-4410-8bd3-1eeefe905521 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:23.414960 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d200f0ab-7599-4410-8bd3-1eeefe905521 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 5cdd332d-8fd9-4b10-bc9b-a90375e91451] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:23.456628 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d200f0ab-7599-4410-8bd3-1eeefe905521 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:23.462856 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d200f0ab-7599-4410-8bd3-1eeefe905521 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:23.467775 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d200f0ab-7599-4410-8bd3-1eeefe905521 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:23.468549 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d200f0ab-7599-4410-8bd3-1eeefe905521 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:23.474592 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d200f0ab-7599-4410-8bd3-1eeefe905521 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:23.475198 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d200f0ab-7599-4410-8bd3-1eeefe905521 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:24.174572 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d200f0ab-7599-4410-8bd3-1eeefe905521 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:24.195474 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d200f0ab-7599-4410-8bd3-1eeefe905521 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451" status: 200 len: 1393 microversion: 2.1 time: 0.795640 Aug 31 16:19:24.200799 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2876/5561] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:23 2022] GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451 => generated 1393 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:24.428182 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-79c65e68-99bb-48be-a115-5a6b16ff8214 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:24.428182 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-79c65e68-99bb-48be-a115-5a6b16ff8214 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:24.444276 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-79c65e68-99bb-48be-a115-5a6b16ff8214 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:24.451394 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-79c65e68-99bb-48be-a115-5a6b16ff8214 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:24.454025 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-79c65e68-99bb-48be-a115-5a6b16ff8214 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:24.459086 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-79c65e68-99bb-48be-a115-5a6b16ff8214 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:24.459668 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-79c65e68-99bb-48be-a115-5a6b16ff8214 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:24.461657 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-79c65e68-99bb-48be-a115-5a6b16ff8214 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:24.574029 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-2992395a-4e98-4013-912e-6506aa7f2cc7 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:19:24.575157 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-2992395a-4e98-4013-912e-6506aa7f2cc7 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:19:24.575558 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-2992395a-4e98-4013-912e-6506aa7f2cc7 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:19:24.575981 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-2992395a-4e98-4013-912e-6506aa7f2cc7 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:19:24.576450 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-2992395a-4e98-4013-912e-6506aa7f2cc7 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:19:24.612818 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2992395a-4e98-4013-912e-6506aa7f2cc7 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:24.620411 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2992395a-4e98-4013-912e-6506aa7f2cc7 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:24.623157 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2992395a-4e98-4013-912e-6506aa7f2cc7 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:24.624361 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2992395a-4e98-4013-912e-6506aa7f2cc7 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:24.625774 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2992395a-4e98-4013-912e-6506aa7f2cc7 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:24.626590 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2992395a-4e98-4013-912e-6506aa7f2cc7 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:24.696330 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-2992395a-4e98-4013-912e-6506aa7f2cc7 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Getting quotas for project c3cdfdf921af4bc59c5c2fea1287b598. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:19:24.716692 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-2992395a-4e98-4013-912e-6506aa7f2cc7 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Getting quotas for user 6f95e357d68d4ad4a5eedbb08b41c5c1 and project c3cdfdf921af4bc59c5c2fea1287b598. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:19:24.763012 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2992395a-4e98-4013-912e-6506aa7f2cc7 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:19:24.771625 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2992395a-4e98-4013-912e-6506aa7f2cc7 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 91900503-1200-4e0c-9531-19f602773721] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:19:24.856822 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=6 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:19:24.917153 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2992395a-4e98-4013-912e-6506aa7f2cc7 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.502724 Aug 31 16:19:24.930559 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2686/5562] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:19:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 3517 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:19:24.938030 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-479f4f67-bf60-45b3-9139-1581a441c9e0 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:24.938756 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-479f4f67-bf60-45b3-9139-1581a441c9e0 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 91900503-1200-4e0c-9531-19f602773721] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:24.992495 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-79c65e68-99bb-48be-a115-5a6b16ff8214 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:25.008243 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-79c65e68-99bb-48be-a115-5a6b16ff8214 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:25.011855 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-79c65e68-99bb-48be-a115-5a6b16ff8214 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:25.024118 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-79c65e68-99bb-48be-a115-5a6b16ff8214 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1806 microversion: 2.20 time: 0.607424 Aug 31 16:19:25.025361 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2877/5563] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:19:24 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1806 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:19:25.079001 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-479f4f67-bf60-45b3-9139-1581a441c9e0 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:25.087190 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-479f4f67-bf60-45b3-9139-1581a441c9e0 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721" status: 200 len: 1241 microversion: 2.1 time: 0.154604 Aug 31 16:19:25.090791 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2687/5564] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:24 2022] GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721 => generated 1241 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:25.221331 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c7e0ec85-01ff-4540-8719-a8a912dd87ee tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:25.222074 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c7e0ec85-01ff-4540-8719-a8a912dd87ee tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 5cdd332d-8fd9-4b10-bc9b-a90375e91451] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:25.229765 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c7e0ec85-01ff-4540-8719-a8a912dd87ee tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:25.235601 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c7e0ec85-01ff-4540-8719-a8a912dd87ee tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:25.236802 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c7e0ec85-01ff-4540-8719-a8a912dd87ee tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:25.238431 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c7e0ec85-01ff-4540-8719-a8a912dd87ee tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:25.241914 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c7e0ec85-01ff-4540-8719-a8a912dd87ee tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:25.243192 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c7e0ec85-01ff-4540-8719-a8a912dd87ee tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:25.944662 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c7e0ec85-01ff-4540-8719-a8a912dd87ee tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:25.958926 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c7e0ec85-01ff-4540-8719-a8a912dd87ee tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451" status: 200 len: 1393 microversion: 2.1 time: 0.741856 Aug 31 16:19:25.959496 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2878/5565] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:25 2022] GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451 => generated 1393 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:26.049059 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-86b0f525-1cd8-4fb5-9e18-a81cae873948 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:26.050584 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-86b0f525-1cd8-4fb5-9e18-a81cae873948 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:26.063261 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86b0f525-1cd8-4fb5-9e18-a81cae873948 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:26.070394 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86b0f525-1cd8-4fb5-9e18-a81cae873948 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:26.071187 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86b0f525-1cd8-4fb5-9e18-a81cae873948 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:26.072109 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86b0f525-1cd8-4fb5-9e18-a81cae873948 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:26.079570 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86b0f525-1cd8-4fb5-9e18-a81cae873948 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:26.086556 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86b0f525-1cd8-4fb5-9e18-a81cae873948 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:26.117288 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-603ca512-8ad5-4ecf-9072-6466778152f0 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:26.118254 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-603ca512-8ad5-4ecf-9072-6466778152f0 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 91900503-1200-4e0c-9531-19f602773721] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:26.129632 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-603ca512-8ad5-4ecf-9072-6466778152f0 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:26.135145 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-603ca512-8ad5-4ecf-9072-6466778152f0 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:26.135601 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-603ca512-8ad5-4ecf-9072-6466778152f0 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:26.136406 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-603ca512-8ad5-4ecf-9072-6466778152f0 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:26.136925 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-603ca512-8ad5-4ecf-9072-6466778152f0 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:26.137371 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-603ca512-8ad5-4ecf-9072-6466778152f0 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:26.500065 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-603ca512-8ad5-4ecf-9072-6466778152f0 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:26.508923 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-603ca512-8ad5-4ecf-9072-6466778152f0 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721" status: 200 len: 1245 microversion: 2.1 time: 0.396760 Aug 31 16:19:26.511735 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2879/5566] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:26 2022] GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721 => generated 1245 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:26.893080 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-86b0f525-1cd8-4fb5-9e18-a81cae873948 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:26.913937 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-86b0f525-1cd8-4fb5-9e18-a81cae873948 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:26.918036 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-86b0f525-1cd8-4fb5-9e18-a81cae873948 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:26.919566 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-86b0f525-1cd8-4fb5-9e18-a81cae873948 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1806 microversion: 2.20 time: 0.875805 Aug 31 16:19:26.920461 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2688/5567] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:19:26 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1806 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:19:26.988239 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3c9a6675-8d47-4d63-8251-585150ba98cd tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:26.991097 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3c9a6675-8d47-4d63-8251-585150ba98cd tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 5cdd332d-8fd9-4b10-bc9b-a90375e91451] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:27.007508 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3c9a6675-8d47-4d63-8251-585150ba98cd tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:27.008255 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3c9a6675-8d47-4d63-8251-585150ba98cd tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:27.008896 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3c9a6675-8d47-4d63-8251-585150ba98cd tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:27.009751 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3c9a6675-8d47-4d63-8251-585150ba98cd tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:27.011063 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3c9a6675-8d47-4d63-8251-585150ba98cd tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:27.011574 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3c9a6675-8d47-4d63-8251-585150ba98cd tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:27.237700 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-e9ecd354-1842-41e7-b2c2-b31a98ce3a2d req-44cfd9ff-44ac-485f-9e5d-3f988261fce3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cdd332d-8fd9-4b10-bc9b-a90375e91451", "name": "network-vif-plugged", "status": "completed", "tag": "13e49ea1-4330-43bd-abbb-39b92d47a423"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:19:27.285179 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e9ecd354-1842-41e7-b2c2-b31a98ce3a2d req-44cfd9ff-44ac-485f-9e5d-3f988261fce3 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:27.285179 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e9ecd354-1842-41e7-b2c2-b31a98ce3a2d req-44cfd9ff-44ac-485f-9e5d-3f988261fce3 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:27.285179 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e9ecd354-1842-41e7-b2c2-b31a98ce3a2d req-44cfd9ff-44ac-485f-9e5d-3f988261fce3 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:27.342336 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-e9ecd354-1842-41e7-b2c2-b31a98ce3a2d req-44cfd9ff-44ac-485f-9e5d-3f988261fce3 service nova] Creating event network-vif-plugged:13e49ea1-4330-43bd-abbb-39b92d47a423 for instance 5cdd332d-8fd9-4b10-bc9b-a90375e91451 on n-h1-833090-16 Aug 31 16:19:27.388903 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-e9ecd354-1842-41e7-b2c2-b31a98ce3a2d req-44cfd9ff-44ac-485f-9e5d-3f988261fce3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154120 Aug 31 16:19:27.389601 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2689/5568] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:19:27.441770 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3c9a6675-8d47-4d63-8251-585150ba98cd tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:27.471325 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3c9a6675-8d47-4d63-8251-585150ba98cd tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451" status: 200 len: 1393 microversion: 2.1 time: 0.491796 Aug 31 16:19:27.473470 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2880/5569] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:26 2022] GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451 => generated 1393 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:19:27.541614 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1ca15acc-64ed-48aa-a518-8d31ba6062b1 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:27.550776 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1ca15acc-64ed-48aa-a518-8d31ba6062b1 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 91900503-1200-4e0c-9531-19f602773721] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:27.576463 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ca15acc-64ed-48aa-a518-8d31ba6062b1 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:27.581384 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ca15acc-64ed-48aa-a518-8d31ba6062b1 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:27.584934 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ca15acc-64ed-48aa-a518-8d31ba6062b1 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:27.591687 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ca15acc-64ed-48aa-a518-8d31ba6062b1 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:27.592392 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ca15acc-64ed-48aa-a518-8d31ba6062b1 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:27.592994 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ca15acc-64ed-48aa-a518-8d31ba6062b1 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:27.751087 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1ca15acc-64ed-48aa-a518-8d31ba6062b1 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:27.772534 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1ca15acc-64ed-48aa-a518-8d31ba6062b1 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721" status: 200 len: 1301 microversion: 2.1 time: 0.236187 Aug 31 16:19:27.788035 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2690/5570] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:27 2022] GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721 => generated 1301 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:27.957110 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5829c20d-d1a8-4ba6-ab45-c68e2f42e497 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:27.959764 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5829c20d-d1a8-4ba6-ab45-c68e2f42e497 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:27.980584 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5829c20d-d1a8-4ba6-ab45-c68e2f42e497 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:27.982283 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5829c20d-d1a8-4ba6-ab45-c68e2f42e497 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:27.982944 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5829c20d-d1a8-4ba6-ab45-c68e2f42e497 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:27.983979 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5829c20d-d1a8-4ba6-ab45-c68e2f42e497 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:27.984738 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5829c20d-d1a8-4ba6-ab45-c68e2f42e497 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:27.985316 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5829c20d-d1a8-4ba6-ab45-c68e2f42e497 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:28.345868 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5829c20d-d1a8-4ba6-ab45-c68e2f42e497 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:28.359751 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5829c20d-d1a8-4ba6-ab45-c68e2f42e497 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:28.363008 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5829c20d-d1a8-4ba6-ab45-c68e2f42e497 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:28.364743 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5829c20d-d1a8-4ba6-ab45-c68e2f42e497 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1806 microversion: 2.20 time: 0.423626 Aug 31 16:19:28.365468 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2881/5571] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:19:27 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1806 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:19:28.495102 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7cb1e45d-cf84-45f8-b145-1bfa1c7af6ca tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:28.496450 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7cb1e45d-cf84-45f8-b145-1bfa1c7af6ca tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 5cdd332d-8fd9-4b10-bc9b-a90375e91451] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:28.516574 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cb1e45d-cf84-45f8-b145-1bfa1c7af6ca tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:28.538763 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cb1e45d-cf84-45f8-b145-1bfa1c7af6ca tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:28.540297 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cb1e45d-cf84-45f8-b145-1bfa1c7af6ca tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:28.541471 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cb1e45d-cf84-45f8-b145-1bfa1c7af6ca tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:28.542206 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cb1e45d-cf84-45f8-b145-1bfa1c7af6ca tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:28.542965 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cb1e45d-cf84-45f8-b145-1bfa1c7af6ca tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:28.813676 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e195729d-c5d2-4698-b001-7f319a971f0e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:28.814658 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e195729d-c5d2-4698-b001-7f319a971f0e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 91900503-1200-4e0c-9531-19f602773721] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:28.825223 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e195729d-c5d2-4698-b001-7f319a971f0e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:28.827139 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e195729d-c5d2-4698-b001-7f319a971f0e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:28.827629 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e195729d-c5d2-4698-b001-7f319a971f0e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:28.838591 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e195729d-c5d2-4698-b001-7f319a971f0e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:28.839634 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e195729d-c5d2-4698-b001-7f319a971f0e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:28.840516 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e195729d-c5d2-4698-b001-7f319a971f0e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:28.849362 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7cb1e45d-cf84-45f8-b145-1bfa1c7af6ca tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:28.858498 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7cb1e45d-cf84-45f8-b145-1bfa1c7af6ca tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451" status: 200 len: 1393 microversion: 2.1 time: 0.368742 Aug 31 16:19:28.875346 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2691/5572] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:28 2022] GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451 => generated 1393 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:28.959211 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e195729d-c5d2-4698-b001-7f319a971f0e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:28.968742 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e195729d-c5d2-4698-b001-7f319a971f0e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721" status: 200 len: 1299 microversion: 2.1 time: 0.159326 Aug 31 16:19:28.981878 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2882/5573] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:28 2022] GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721 => generated 1299 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:29.390674 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fa03897f-fe52-4d4b-9684-1adc397e5b1d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:29.391396 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fa03897f-fe52-4d4b-9684-1adc397e5b1d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:29.408051 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa03897f-fe52-4d4b-9684-1adc397e5b1d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:29.409733 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa03897f-fe52-4d4b-9684-1adc397e5b1d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:29.413580 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa03897f-fe52-4d4b-9684-1adc397e5b1d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:29.414588 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa03897f-fe52-4d4b-9684-1adc397e5b1d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:29.415077 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa03897f-fe52-4d4b-9684-1adc397e5b1d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:29.415561 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa03897f-fe52-4d4b-9684-1adc397e5b1d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:29.893116 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-efc519c8-2497-42b1-850d-aa2a79594e0d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:29.893748 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-efc519c8-2497-42b1-850d-aa2a79594e0d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 5cdd332d-8fd9-4b10-bc9b-a90375e91451] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:29.914607 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-efc519c8-2497-42b1-850d-aa2a79594e0d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:29.921326 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-efc519c8-2497-42b1-850d-aa2a79594e0d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:29.926796 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-efc519c8-2497-42b1-850d-aa2a79594e0d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:29.929721 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-efc519c8-2497-42b1-850d-aa2a79594e0d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:29.931269 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-efc519c8-2497-42b1-850d-aa2a79594e0d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:29.931841 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-efc519c8-2497-42b1-850d-aa2a79594e0d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:30.118508 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fa03897f-fe52-4d4b-9684-1adc397e5b1d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:30.134433 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fa03897f-fe52-4d4b-9684-1adc397e5b1d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:30.138026 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fa03897f-fe52-4d4b-9684-1adc397e5b1d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:30.139472 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fa03897f-fe52-4d4b-9684-1adc397e5b1d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1806 microversion: 2.20 time: 0.754069 Aug 31 16:19:30.142350 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2692/5574] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:19:29 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1806 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:19:30.148471 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-98a6b999-e944-4ed1-a3b6-f54d486bd576 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:30.154966 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-98a6b999-e944-4ed1-a3b6-f54d486bd576 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 91900503-1200-4e0c-9531-19f602773721] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:30.200871 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98a6b999-e944-4ed1-a3b6-f54d486bd576 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:30.205807 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98a6b999-e944-4ed1-a3b6-f54d486bd576 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:30.206345 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98a6b999-e944-4ed1-a3b6-f54d486bd576 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:30.207099 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98a6b999-e944-4ed1-a3b6-f54d486bd576 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:30.209327 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98a6b999-e944-4ed1-a3b6-f54d486bd576 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:30.209819 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-98a6b999-e944-4ed1-a3b6-f54d486bd576 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:30.502645 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-efc519c8-2497-42b1-850d-aa2a79594e0d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:30.531672 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-efc519c8-2497-42b1-850d-aa2a79594e0d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451" status: 200 len: 1565 microversion: 2.1 time: 0.642788 Aug 31 16:19:30.535647 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2883/5575] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:29 2022] GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451 => generated 1565 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:19:30.565926 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a4d51567-bfa4-4bac-869b-1e5733442094 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:30.566866 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a4d51567-bfa4-4bac-869b-1e5733442094 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 5cdd332d-8fd9-4b10-bc9b-a90375e91451] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:30.584904 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a4d51567-bfa4-4bac-869b-1e5733442094 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:30.586302 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a4d51567-bfa4-4bac-869b-1e5733442094 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:30.588274 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a4d51567-bfa4-4bac-869b-1e5733442094 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:30.590536 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a4d51567-bfa4-4bac-869b-1e5733442094 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:30.611647 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a4d51567-bfa4-4bac-869b-1e5733442094 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:30.612250 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-98a6b999-e944-4ed1-a3b6-f54d486bd576 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:30.629145 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a4d51567-bfa4-4bac-869b-1e5733442094 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:30.634898 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-98a6b999-e944-4ed1-a3b6-f54d486bd576 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721" status: 200 len: 1366 microversion: 2.1 time: 0.491025 Aug 31 16:19:30.646174 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2693/5576] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:30 2022] GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721 => generated 1366 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:30.962466 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a4d51567-bfa4-4bac-869b-1e5733442094 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:30.974439 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a4d51567-bfa4-4bac-869b-1e5733442094 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451" status: 200 len: 1565 microversion: 2.1 time: 0.412150 Aug 31 16:19:30.975899 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2884/5577] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:30 2022] GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451 => generated 1565 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:19:31.166784 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-97fa289d-40a1-499c-b2f3-ddd3c67c5de4 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:31.167406 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-97fa289d-40a1-499c-b2f3-ddd3c67c5de4 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:31.180414 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97fa289d-40a1-499c-b2f3-ddd3c67c5de4 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:31.180913 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97fa289d-40a1-499c-b2f3-ddd3c67c5de4 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:31.181343 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97fa289d-40a1-499c-b2f3-ddd3c67c5de4 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:31.182046 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97fa289d-40a1-499c-b2f3-ddd3c67c5de4 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:31.197298 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97fa289d-40a1-499c-b2f3-ddd3c67c5de4 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:31.197763 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97fa289d-40a1-499c-b2f3-ddd3c67c5de4 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:31.798378 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-97fa289d-40a1-499c-b2f3-ddd3c67c5de4 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:31.809730 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-97fa289d-40a1-499c-b2f3-ddd3c67c5de4 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:31.812007 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-97fa289d-40a1-499c-b2f3-ddd3c67c5de4 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:31.816052 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-97fa289d-40a1-499c-b2f3-ddd3c67c5de4 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1806 microversion: 2.20 time: 0.654466 Aug 31 16:19:31.816999 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2694/5578] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:19:31 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1806 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:19:31.913299 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e8c9209c-9cb1-4719-b5ae-f7df6996ac88 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:31.915901 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e8c9209c-9cb1-4719-b5ae-f7df6996ac88 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 91900503-1200-4e0c-9531-19f602773721] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:31.931925 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e8c9209c-9cb1-4719-b5ae-f7df6996ac88 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:31.935294 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e8c9209c-9cb1-4719-b5ae-f7df6996ac88 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:31.936035 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e8c9209c-9cb1-4719-b5ae-f7df6996ac88 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:31.937289 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e8c9209c-9cb1-4719-b5ae-f7df6996ac88 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:31.939291 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e8c9209c-9cb1-4719-b5ae-f7df6996ac88 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:31.940142 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e8c9209c-9cb1-4719-b5ae-f7df6996ac88 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:32.198387 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e8c9209c-9cb1-4719-b5ae-f7df6996ac88 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:32.229579 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e8c9209c-9cb1-4719-b5ae-f7df6996ac88 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721" status: 200 len: 1366 microversion: 2.1 time: 0.570103 Aug 31 16:19:32.268021 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2885/5579] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:31 2022] GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721 => generated 1366 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:32.846477 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-eb1c7e99-2351-4165-b12a-581c9d3d939d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:32.847238 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-eb1c7e99-2351-4165-b12a-581c9d3d939d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:32.871389 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb1c7e99-2351-4165-b12a-581c9d3d939d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:32.876521 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb1c7e99-2351-4165-b12a-581c9d3d939d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:32.877505 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb1c7e99-2351-4165-b12a-581c9d3d939d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:32.878957 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb1c7e99-2351-4165-b12a-581c9d3d939d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:32.883195 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb1c7e99-2351-4165-b12a-581c9d3d939d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:32.884191 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb1c7e99-2351-4165-b12a-581c9d3d939d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:33.225350 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-eb1c7e99-2351-4165-b12a-581c9d3d939d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:33.241280 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-eb1c7e99-2351-4165-b12a-581c9d3d939d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:33.245349 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-eb1c7e99-2351-4165-b12a-581c9d3d939d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:33.251192 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-eb1c7e99-2351-4165-b12a-581c9d3d939d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1806 microversion: 2.20 time: 0.413500 Aug 31 16:19:33.252931 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2695/5580] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:19:32 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1806 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:19:33.275824 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-95a0b9fc-7692-4b26-853a-a9ad7492d8e6 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:33.277430 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-95a0b9fc-7692-4b26-853a-a9ad7492d8e6 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 91900503-1200-4e0c-9531-19f602773721] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:33.311476 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95a0b9fc-7692-4b26-853a-a9ad7492d8e6 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:33.316960 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95a0b9fc-7692-4b26-853a-a9ad7492d8e6 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:33.317787 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95a0b9fc-7692-4b26-853a-a9ad7492d8e6 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:33.318637 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95a0b9fc-7692-4b26-853a-a9ad7492d8e6 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:33.319106 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95a0b9fc-7692-4b26-853a-a9ad7492d8e6 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:33.319567 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95a0b9fc-7692-4b26-853a-a9ad7492d8e6 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:33.445554 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-3f3c94c4-b8e4-4831-91f9-b87531dcf2a4 req-bcf76009-de8f-47a1-9e14-9ef4ad4d0f04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91900503-1200-4e0c-9531-19f602773721", "tag": "0ae53451-7a56-4e3c-9834-f4bccd4b4283"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:19:33.478645 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3f3c94c4-b8e4-4831-91f9-b87531dcf2a4 req-bcf76009-de8f-47a1-9e14-9ef4ad4d0f04 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:33.479177 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3f3c94c4-b8e4-4831-91f9-b87531dcf2a4 req-bcf76009-de8f-47a1-9e14-9ef4ad4d0f04 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:33.481553 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3f3c94c4-b8e4-4831-91f9-b87531dcf2a4 req-bcf76009-de8f-47a1-9e14-9ef4ad4d0f04 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:33.512974 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-3f3c94c4-b8e4-4831-91f9-b87531dcf2a4 req-bcf76009-de8f-47a1-9e14-9ef4ad4d0f04 service nova] Creating event network-changed:0ae53451-7a56-4e3c-9834-f4bccd4b4283 for instance 91900503-1200-4e0c-9531-19f602773721 on n-h2-833090-16 Aug 31 16:19:33.529938 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-3f3c94c4-b8e4-4831-91f9-b87531dcf2a4 req-bcf76009-de8f-47a1-9e14-9ef4ad4d0f04 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094544 Aug 31 16:19:33.533058 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2696/5581] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:19:34.003502 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-95a0b9fc-7692-4b26-853a-a9ad7492d8e6 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:34.023604 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-95a0b9fc-7692-4b26-853a-a9ad7492d8e6 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721" status: 200 len: 1366 microversion: 2.1 time: 0.754677 Aug 31 16:19:34.034392 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2886/5582] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:33 2022] GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721 => generated 1366 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:34.279965 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e40fd055-3be5-4135-a9ba-507f8ecef475 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:34.280666 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e40fd055-3be5-4135-a9ba-507f8ecef475 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:34.305203 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e40fd055-3be5-4135-a9ba-507f8ecef475 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:34.305203 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e40fd055-3be5-4135-a9ba-507f8ecef475 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:34.305203 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e40fd055-3be5-4135-a9ba-507f8ecef475 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:34.305978 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e40fd055-3be5-4135-a9ba-507f8ecef475 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:34.306227 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e40fd055-3be5-4135-a9ba-507f8ecef475 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:34.306527 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e40fd055-3be5-4135-a9ba-507f8ecef475 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:34.648636 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:19:34.678414 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e40fd055-3be5-4135-a9ba-507f8ecef475 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:34.690820 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e40fd055-3be5-4135-a9ba-507f8ecef475 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:34.692578 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e40fd055-3be5-4135-a9ba-507f8ecef475 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:34.699648 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e40fd055-3be5-4135-a9ba-507f8ecef475 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1806 microversion: 2.20 time: 0.425050 Aug 31 16:19:34.702708 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2697/5583] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:19:34 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1806 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:19:34.848764 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-70d2110e-dcc4-4819-83a3-abf8f487533c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:34.854309 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-2313f959-4b95-4dca-8f32-707af1f75212 req-989971e8-b4d1-4d74-b557-e022c27bb68a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cdd332d-8fd9-4b10-bc9b-a90375e91451", "tag": "13e49ea1-4330-43bd-abbb-39b92d47a423"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:19:34.854492 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-70d2110e-dcc4-4819-83a3-abf8f487533c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 5cdd332d-8fd9-4b10-bc9b-a90375e91451] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:34.866400 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2313f959-4b95-4dca-8f32-707af1f75212 req-989971e8-b4d1-4d74-b557-e022c27bb68a service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:34.867177 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2313f959-4b95-4dca-8f32-707af1f75212 req-989971e8-b4d1-4d74-b557-e022c27bb68a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:34.868031 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2313f959-4b95-4dca-8f32-707af1f75212 req-989971e8-b4d1-4d74-b557-e022c27bb68a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:34.880035 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:19:34.881671 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-70d2110e-dcc4-4819-83a3-abf8f487533c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:34.882190 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-70d2110e-dcc4-4819-83a3-abf8f487533c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:34.882633 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-70d2110e-dcc4-4819-83a3-abf8f487533c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:34.883353 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-70d2110e-dcc4-4819-83a3-abf8f487533c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:34.883769 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-2313f959-4b95-4dca-8f32-707af1f75212 req-989971e8-b4d1-4d74-b557-e022c27bb68a service nova] Creating event network-changed:13e49ea1-4330-43bd-abbb-39b92d47a423 for instance 5cdd332d-8fd9-4b10-bc9b-a90375e91451 on n-h1-833090-16 Aug 31 16:19:34.883889 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-70d2110e-dcc4-4819-83a3-abf8f487533c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:34.884226 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-70d2110e-dcc4-4819-83a3-abf8f487533c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:34.895585 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-2313f959-4b95-4dca-8f32-707af1f75212 req-989971e8-b4d1-4d74-b557-e022c27bb68a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039510 Aug 31 16:19:34.896796 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2698/5584] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:19:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:19:35.057037 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7934e850-f446-4821-8d2d-0041d837b207 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:35.058121 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7934e850-f446-4821-8d2d-0041d837b207 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 91900503-1200-4e0c-9531-19f602773721] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:35.065040 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7934e850-f446-4821-8d2d-0041d837b207 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:35.065876 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7934e850-f446-4821-8d2d-0041d837b207 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:35.066750 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7934e850-f446-4821-8d2d-0041d837b207 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:35.069258 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7934e850-f446-4821-8d2d-0041d837b207 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:35.069951 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7934e850-f446-4821-8d2d-0041d837b207 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:35.076355 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7934e850-f446-4821-8d2d-0041d837b207 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:35.087348 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=8 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:19:35.116564 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-70d2110e-dcc4-4819-83a3-abf8f487533c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:35.118872 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=100 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:19:35.127946 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-70d2110e-dcc4-4819-83a3-abf8f487533c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451" status: 200 len: 1565 microversion: 2.1 time: 0.283376 Aug 31 16:19:35.146561 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2887/5585] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:34 2022] GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451 => generated 1565 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:35.539211 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7934e850-f446-4821-8d2d-0041d837b207 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:35.568277 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7934e850-f446-4821-8d2d-0041d837b207 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721" status: 200 len: 1366 microversion: 2.1 time: 0.510029 Aug 31 16:19:35.568958 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2699/5586] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:35 2022] GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721 => generated 1366 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:35.725091 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5139869d-3892-4b8b-ac06-3b680a2c5867 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:35.726191 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5139869d-3892-4b8b-ac06-3b680a2c5867 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:35.737393 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5139869d-3892-4b8b-ac06-3b680a2c5867 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:35.738196 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5139869d-3892-4b8b-ac06-3b680a2c5867 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:35.738880 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5139869d-3892-4b8b-ac06-3b680a2c5867 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:35.739807 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5139869d-3892-4b8b-ac06-3b680a2c5867 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:35.740440 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5139869d-3892-4b8b-ac06-3b680a2c5867 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:35.745469 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5139869d-3892-4b8b-ac06-3b680a2c5867 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:36.592982 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-af690710-da6c-4d50-a3f2-c4c935043e84 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:36.594699 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-af690710-da6c-4d50-a3f2-c4c935043e84 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 91900503-1200-4e0c-9531-19f602773721] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:36.610443 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af690710-da6c-4d50-a3f2-c4c935043e84 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:36.611332 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af690710-da6c-4d50-a3f2-c4c935043e84 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:36.611921 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af690710-da6c-4d50-a3f2-c4c935043e84 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:36.614027 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af690710-da6c-4d50-a3f2-c4c935043e84 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:36.616888 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af690710-da6c-4d50-a3f2-c4c935043e84 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:36.617452 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af690710-da6c-4d50-a3f2-c4c935043e84 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:36.745281 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5139869d-3892-4b8b-ac06-3b680a2c5867 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:36.759140 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5139869d-3892-4b8b-ac06-3b680a2c5867 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:36.761007 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5139869d-3892-4b8b-ac06-3b680a2c5867 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:36.763504 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5139869d-3892-4b8b-ac06-3b680a2c5867 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1806 microversion: 2.20 time: 1.043215 Aug 31 16:19:36.779602 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2888/5587] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:19:35 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1806 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:19:36.996935 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-af690710-da6c-4d50-a3f2-c4c935043e84 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:37.006005 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-af690710-da6c-4d50-a3f2-c4c935043e84 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721" status: 200 len: 1366 microversion: 2.1 time: 0.417692 Aug 31 16:19:37.020052 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2700/5588] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:36 2022] GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721 => generated 1366 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:19:37.792093 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-91fcc693-d59a-49ad-8723-9093ad53b47c tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:37.792682 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-91fcc693-d59a-49ad-8723-9093ad53b47c tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:37.809025 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91fcc693-d59a-49ad-8723-9093ad53b47c tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:37.810920 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91fcc693-d59a-49ad-8723-9093ad53b47c tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:37.811406 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91fcc693-d59a-49ad-8723-9093ad53b47c tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:37.814591 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91fcc693-d59a-49ad-8723-9093ad53b47c tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:37.817868 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91fcc693-d59a-49ad-8723-9093ad53b47c tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:37.818446 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91fcc693-d59a-49ad-8723-9093ad53b47c tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:38.027860 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3d041d9c-97d2-4fda-983d-82bcc8a77ddd tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:38.029240 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3d041d9c-97d2-4fda-983d-82bcc8a77ddd tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 91900503-1200-4e0c-9531-19f602773721] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:38.049764 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d041d9c-97d2-4fda-983d-82bcc8a77ddd tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:38.050710 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d041d9c-97d2-4fda-983d-82bcc8a77ddd tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:38.051475 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d041d9c-97d2-4fda-983d-82bcc8a77ddd tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:38.052774 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d041d9c-97d2-4fda-983d-82bcc8a77ddd tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:38.053399 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d041d9c-97d2-4fda-983d-82bcc8a77ddd tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:38.054010 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d041d9c-97d2-4fda-983d-82bcc8a77ddd tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:38.474272 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-91fcc693-d59a-49ad-8723-9093ad53b47c tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:38.487464 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-91fcc693-d59a-49ad-8723-9093ad53b47c tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:38.489505 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-91fcc693-d59a-49ad-8723-9093ad53b47c tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:38.491015 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-91fcc693-d59a-49ad-8723-9093ad53b47c tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1806 microversion: 2.20 time: 0.706210 Aug 31 16:19:38.492117 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2889/5589] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:19:37 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1806 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:19:38.525956 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3d041d9c-97d2-4fda-983d-82bcc8a77ddd tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:38.536044 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3d041d9c-97d2-4fda-983d-82bcc8a77ddd tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721" status: 200 len: 1366 microversion: 2.1 time: 0.512228 Aug 31 16:19:38.551899 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2701/5590] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:38 2022] GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721 => generated 1366 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:19:39.517141 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a0f27a86-71a5-40bb-8a4d-5e0640a9cdb1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:39.518168 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a0f27a86-71a5-40bb-8a4d-5e0640a9cdb1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:39.531434 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a0f27a86-71a5-40bb-8a4d-5e0640a9cdb1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:39.532232 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a0f27a86-71a5-40bb-8a4d-5e0640a9cdb1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:39.536857 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a0f27a86-71a5-40bb-8a4d-5e0640a9cdb1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:39.537953 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a0f27a86-71a5-40bb-8a4d-5e0640a9cdb1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:39.538672 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a0f27a86-71a5-40bb-8a4d-5e0640a9cdb1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:39.539326 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a0f27a86-71a5-40bb-8a4d-5e0640a9cdb1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:39.558247 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0127e385-c3c7-4cba-bd6e-e2f8a9d9b9cc tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:39.560085 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0127e385-c3c7-4cba-bd6e-e2f8a9d9b9cc tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 91900503-1200-4e0c-9531-19f602773721] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:39.571998 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:19:39.577742 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0127e385-c3c7-4cba-bd6e-e2f8a9d9b9cc tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:39.590902 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0127e385-c3c7-4cba-bd6e-e2f8a9d9b9cc tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:39.591718 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0127e385-c3c7-4cba-bd6e-e2f8a9d9b9cc tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:39.592929 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0127e385-c3c7-4cba-bd6e-e2f8a9d9b9cc tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:39.596032 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0127e385-c3c7-4cba-bd6e-e2f8a9d9b9cc tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:39.600886 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0127e385-c3c7-4cba-bd6e-e2f8a9d9b9cc tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:40.729909 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0127e385-c3c7-4cba-bd6e-e2f8a9d9b9cc tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:40.766944 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0127e385-c3c7-4cba-bd6e-e2f8a9d9b9cc tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721" status: 200 len: 1366 microversion: 2.1 time: 1.209696 Aug 31 16:19:40.766944 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2702/5591] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:39 2022] GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721 => generated 1366 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:19:40.854492 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a0f27a86-71a5-40bb-8a4d-5e0640a9cdb1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:40.881861 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a0f27a86-71a5-40bb-8a4d-5e0640a9cdb1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:40.886487 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a0f27a86-71a5-40bb-8a4d-5e0640a9cdb1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:40.888178 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a0f27a86-71a5-40bb-8a4d-5e0640a9cdb1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1806 microversion: 2.20 time: 1.377720 Aug 31 16:19:40.889210 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2890/5592] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:19:39 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1806 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:19:41.790049 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9f9bf8ea-f923-4373-8eda-18c689d32e28 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:41.803274 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9f9bf8ea-f923-4373-8eda-18c689d32e28 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 91900503-1200-4e0c-9531-19f602773721] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:41.816858 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f9bf8ea-f923-4373-8eda-18c689d32e28 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:41.818821 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f9bf8ea-f923-4373-8eda-18c689d32e28 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:41.820290 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f9bf8ea-f923-4373-8eda-18c689d32e28 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:41.822893 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f9bf8ea-f923-4373-8eda-18c689d32e28 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:41.823641 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f9bf8ea-f923-4373-8eda-18c689d32e28 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:41.825622 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f9bf8ea-f923-4373-8eda-18c689d32e28 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:41.913830 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-871fa63a-292c-4a41-b60a-13e0829c021b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:41.914857 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-871fa63a-292c-4a41-b60a-13e0829c021b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:41.943107 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-871fa63a-292c-4a41-b60a-13e0829c021b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:41.943601 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-871fa63a-292c-4a41-b60a-13e0829c021b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:41.944238 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-871fa63a-292c-4a41-b60a-13e0829c021b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:41.945109 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-871fa63a-292c-4a41-b60a-13e0829c021b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:41.945718 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-871fa63a-292c-4a41-b60a-13e0829c021b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:41.946323 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-871fa63a-292c-4a41-b60a-13e0829c021b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:42.549516 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-871fa63a-292c-4a41-b60a-13e0829c021b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:42.575293 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9f9bf8ea-f923-4373-8eda-18c689d32e28 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:42.607891 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-871fa63a-292c-4a41-b60a-13e0829c021b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:42.612160 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-871fa63a-292c-4a41-b60a-13e0829c021b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:42.614216 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-871fa63a-292c-4a41-b60a-13e0829c021b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1806 microversion: 2.20 time: 0.705697 Aug 31 16:19:42.615129 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9f9bf8ea-f923-4373-8eda-18c689d32e28 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721" status: 200 len: 1366 microversion: 2.1 time: 0.831268 Aug 31 16:19:42.615428 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2891/5593] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:19:41 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1806 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:19:42.644377 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2703/5594] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:41 2022] GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721 => generated 1366 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:43.120856 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7b985444-9a8a-4f13-8e43-117c977b0465 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1942997769", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "9ea3ce5e-6274-4667-ba85-536451fcbe56"}]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:19:43.229043 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-7b985444-9a8a-4f13-8e43-117c977b0465 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] validate_networks() for [('9ea3ce5e-6274-4667-ba85-536451fcbe56', None, None, None, None, None)] {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:19:43.638061 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7fa4e2ab-63c8-475f-a7d3-6f02240b93e1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:43.638977 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7fa4e2ab-63c8-475f-a7d3-6f02240b93e1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:43.650576 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fa4e2ab-63c8-475f-a7d3-6f02240b93e1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:43.651122 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fa4e2ab-63c8-475f-a7d3-6f02240b93e1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:43.651858 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fa4e2ab-63c8-475f-a7d3-6f02240b93e1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:43.652583 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fa4e2ab-63c8-475f-a7d3-6f02240b93e1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:43.653026 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fa4e2ab-63c8-475f-a7d3-6f02240b93e1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:43.653443 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7fa4e2ab-63c8-475f-a7d3-6f02240b93e1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:44.074049 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7fa4e2ab-63c8-475f-a7d3-6f02240b93e1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:44.092612 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:19:44.099867 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7fa4e2ab-63c8-475f-a7d3-6f02240b93e1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:44.105408 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7fa4e2ab-63c8-475f-a7d3-6f02240b93e1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:44.107833 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7fa4e2ab-63c8-475f-a7d3-6f02240b93e1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1806 microversion: 2.20 time: 0.473655 Aug 31 16:19:44.110526 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2704/5595] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:19:43 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1806 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:19:44.117058 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-53f43bbc-ee5b-4704-8dd8-5407c106fcaa tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:44.118312 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-53f43bbc-ee5b-4704-8dd8-5407c106fcaa tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 91900503-1200-4e0c-9531-19f602773721] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:44.126083 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-53f43bbc-ee5b-4704-8dd8-5407c106fcaa tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:44.126510 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-53f43bbc-ee5b-4704-8dd8-5407c106fcaa tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:44.127128 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-53f43bbc-ee5b-4704-8dd8-5407c106fcaa tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:44.130007 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-53f43bbc-ee5b-4704-8dd8-5407c106fcaa tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:44.130515 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-53f43bbc-ee5b-4704-8dd8-5407c106fcaa tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:44.130952 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-53f43bbc-ee5b-4704-8dd8-5407c106fcaa tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:44.155147 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-7b985444-9a8a-4f13-8e43-117c977b0465 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:19:44.156328 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-7b985444-9a8a-4f13-8e43-117c977b0465 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:19:44.158358 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-7b985444-9a8a-4f13-8e43-117c977b0465 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:19:44.158960 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-7b985444-9a8a-4f13-8e43-117c977b0465 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:19:44.160775 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-7b985444-9a8a-4f13-8e43-117c977b0465 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:19:44.180467 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7b985444-9a8a-4f13-8e43-117c977b0465 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:44.182624 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7b985444-9a8a-4f13-8e43-117c977b0465 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:44.183328 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7b985444-9a8a-4f13-8e43-117c977b0465 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:44.186226 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7b985444-9a8a-4f13-8e43-117c977b0465 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:44.189393 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7b985444-9a8a-4f13-8e43-117c977b0465 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:44.190004 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7b985444-9a8a-4f13-8e43-117c977b0465 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:44.233548 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-7b985444-9a8a-4f13-8e43-117c977b0465 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Getting quotas for project db8c681153e44dd0a4ba2310d2bb0380. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:19:44.240954 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-7b985444-9a8a-4f13-8e43-117c977b0465 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Getting quotas for user ff838eb6dca6457d8e734f1d8a1f9e37 and project db8c681153e44dd0a4ba2310d2bb0380. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:19:44.261962 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7b985444-9a8a-4f13-8e43-117c977b0465 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:19:44.265136 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7b985444-9a8a-4f13-8e43-117c977b0465 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] [instance: f1ff920f-c104-42df-9947-28a80c5aa7e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:19:44.353872 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7b985444-9a8a-4f13-8e43-117c977b0465 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.737154 Aug 31 16:19:44.359419 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2892/5596] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:19:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:19:44.368844 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7ac826b4-b85a-4710-abc9-b5a2f958a216 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:44.373948 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7ac826b4-b85a-4710-abc9-b5a2f958a216 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] [instance: f1ff920f-c104-42df-9947-28a80c5aa7e9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:44.470262 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7ac826b4-b85a-4710-abc9-b5a2f958a216 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff838eb6dca6457d8e734f1d8a1f9e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8c681153e44dd0a4ba2310d2bb0380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:44.483762 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7ac826b4-b85a-4710-abc9-b5a2f958a216 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] 10.222.0.50 "GET /compute/v2.1/servers/f1ff920f-c104-42df-9947-28a80c5aa7e9" status: 200 len: 1217 microversion: 2.1 time: 0.119382 Aug 31 16:19:44.484806 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2893/5597] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:44 2022] GET /compute/v2.1/servers/f1ff920f-c104-42df-9947-28a80c5aa7e9 => generated 1217 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:44.587810 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-53f43bbc-ee5b-4704-8dd8-5407c106fcaa tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:44.603538 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-53f43bbc-ee5b-4704-8dd8-5407c106fcaa tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721" status: 200 len: 1366 microversion: 2.1 time: 0.491179 Aug 31 16:19:44.636751 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2705/5598] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:44 2022] GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721 => generated 1366 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:45.137107 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e9e33b93-fcd4-4774-aefb-a77c2838553f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:45.137724 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e9e33b93-fcd4-4774-aefb-a77c2838553f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:45.157514 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e9e33b93-fcd4-4774-aefb-a77c2838553f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:45.158078 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e9e33b93-fcd4-4774-aefb-a77c2838553f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:45.158359 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e9e33b93-fcd4-4774-aefb-a77c2838553f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:45.159067 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e9e33b93-fcd4-4774-aefb-a77c2838553f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:45.159523 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e9e33b93-fcd4-4774-aefb-a77c2838553f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:45.160015 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e9e33b93-fcd4-4774-aefb-a77c2838553f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:45.506035 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3bdd4c00-ce7d-4327-a99a-1736c8d16779 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:45.508522 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3bdd4c00-ce7d-4327-a99a-1736c8d16779 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] [instance: f1ff920f-c104-42df-9947-28a80c5aa7e9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:45.518735 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bdd4c00-ce7d-4327-a99a-1736c8d16779 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:45.519291 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bdd4c00-ce7d-4327-a99a-1736c8d16779 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:45.519727 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bdd4c00-ce7d-4327-a99a-1736c8d16779 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:45.520435 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bdd4c00-ce7d-4327-a99a-1736c8d16779 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:45.520892 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bdd4c00-ce7d-4327-a99a-1736c8d16779 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:45.521361 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bdd4c00-ce7d-4327-a99a-1736c8d16779 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:45.776432 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3bdd4c00-ce7d-4327-a99a-1736c8d16779 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff838eb6dca6457d8e734f1d8a1f9e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8c681153e44dd0a4ba2310d2bb0380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:45.796184 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3bdd4c00-ce7d-4327-a99a-1736c8d16779 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] 10.222.0.50 "GET /compute/v2.1/servers/f1ff920f-c104-42df-9947-28a80c5aa7e9" status: 200 len: 1213 microversion: 2.1 time: 0.295145 Aug 31 16:19:45.814443 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2706/5599] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:45 2022] GET /compute/v2.1/servers/f1ff920f-c104-42df-9947-28a80c5aa7e9 => generated 1213 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:19:45.829904 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0ffd4663-db55-4a00-b534-95a860825d03 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:45.831041 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0ffd4663-db55-4a00-b534-95a860825d03 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 91900503-1200-4e0c-9531-19f602773721] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:45.849197 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ffd4663-db55-4a00-b534-95a860825d03 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:45.850278 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ffd4663-db55-4a00-b534-95a860825d03 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:45.851948 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ffd4663-db55-4a00-b534-95a860825d03 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:45.852900 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ffd4663-db55-4a00-b534-95a860825d03 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:45.853692 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ffd4663-db55-4a00-b534-95a860825d03 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:45.854745 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ffd4663-db55-4a00-b534-95a860825d03 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:46.068320 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e9e33b93-fcd4-4774-aefb-a77c2838553f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:46.082582 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e9e33b93-fcd4-4774-aefb-a77c2838553f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:46.084048 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e9e33b93-fcd4-4774-aefb-a77c2838553f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:46.085244 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e9e33b93-fcd4-4774-aefb-a77c2838553f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1806 microversion: 2.20 time: 0.952570 Aug 31 16:19:46.096445 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2894/5600] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:19:45 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1806 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:19:46.388631 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0ffd4663-db55-4a00-b534-95a860825d03 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:46.404976 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0ffd4663-db55-4a00-b534-95a860825d03 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721" status: 200 len: 1366 microversion: 2.1 time: 0.588323 Aug 31 16:19:46.405582 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2707/5601] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:45 2022] GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721 => generated 1366 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:46.820375 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-85b4f137-f9ca-47d0-9ad7-0fd8c1c402c1 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:46.821148 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-85b4f137-f9ca-47d0-9ad7-0fd8c1c402c1 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] [instance: f1ff920f-c104-42df-9947-28a80c5aa7e9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:46.838632 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85b4f137-f9ca-47d0-9ad7-0fd8c1c402c1 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:46.838632 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85b4f137-f9ca-47d0-9ad7-0fd8c1c402c1 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:46.838632 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85b4f137-f9ca-47d0-9ad7-0fd8c1c402c1 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:46.838632 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85b4f137-f9ca-47d0-9ad7-0fd8c1c402c1 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:46.845188 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85b4f137-f9ca-47d0-9ad7-0fd8c1c402c1 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:46.846827 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-85b4f137-f9ca-47d0-9ad7-0fd8c1c402c1 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:47.010224 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-85b4f137-f9ca-47d0-9ad7-0fd8c1c402c1 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff838eb6dca6457d8e734f1d8a1f9e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8c681153e44dd0a4ba2310d2bb0380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:47.020603 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-85b4f137-f9ca-47d0-9ad7-0fd8c1c402c1 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] 10.222.0.50 "GET /compute/v2.1/servers/f1ff920f-c104-42df-9947-28a80c5aa7e9" status: 200 len: 1275 microversion: 2.1 time: 0.204549 Aug 31 16:19:47.025227 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2895/5602] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:46 2022] GET /compute/v2.1/servers/f1ff920f-c104-42df-9947-28a80c5aa7e9 => generated 1275 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:47.125704 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b22b191a-69da-44fb-ae15-b44cd913740f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:47.126993 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b22b191a-69da-44fb-ae15-b44cd913740f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:47.139918 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b22b191a-69da-44fb-ae15-b44cd913740f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:47.141757 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b22b191a-69da-44fb-ae15-b44cd913740f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:47.145067 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b22b191a-69da-44fb-ae15-b44cd913740f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:47.146825 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b22b191a-69da-44fb-ae15-b44cd913740f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:47.147757 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b22b191a-69da-44fb-ae15-b44cd913740f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:47.149511 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b22b191a-69da-44fb-ae15-b44cd913740f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:47.425601 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a839151b-3920-44b6-ba97-c21c5850d953 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:47.427187 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a839151b-3920-44b6-ba97-c21c5850d953 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 91900503-1200-4e0c-9531-19f602773721] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:47.438133 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a839151b-3920-44b6-ba97-c21c5850d953 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:47.438840 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a839151b-3920-44b6-ba97-c21c5850d953 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:47.439622 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a839151b-3920-44b6-ba97-c21c5850d953 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:47.440142 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a839151b-3920-44b6-ba97-c21c5850d953 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:47.440589 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a839151b-3920-44b6-ba97-c21c5850d953 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:47.441346 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a839151b-3920-44b6-ba97-c21c5850d953 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:47.462707 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b22b191a-69da-44fb-ae15-b44cd913740f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:47.497059 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b22b191a-69da-44fb-ae15-b44cd913740f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:47.504058 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b22b191a-69da-44fb-ae15-b44cd913740f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:47.506194 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b22b191a-69da-44fb-ae15-b44cd913740f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1806 microversion: 2.20 time: 0.393262 Aug 31 16:19:47.512252 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2708/5603] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:19:47 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1806 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:19:48.046314 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d50603d3-eb4b-421a-a55a-b0616cd11e74 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:48.047231 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d50603d3-eb4b-421a-a55a-b0616cd11e74 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] [instance: f1ff920f-c104-42df-9947-28a80c5aa7e9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:48.056699 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d50603d3-eb4b-421a-a55a-b0616cd11e74 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:48.059744 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d50603d3-eb4b-421a-a55a-b0616cd11e74 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:48.064336 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d50603d3-eb4b-421a-a55a-b0616cd11e74 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:48.065459 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d50603d3-eb4b-421a-a55a-b0616cd11e74 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:48.067222 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d50603d3-eb4b-421a-a55a-b0616cd11e74 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:48.071046 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d50603d3-eb4b-421a-a55a-b0616cd11e74 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:48.767409 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d50603d3-eb4b-421a-a55a-b0616cd11e74 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff838eb6dca6457d8e734f1d8a1f9e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8c681153e44dd0a4ba2310d2bb0380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:48.779823 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d50603d3-eb4b-421a-a55a-b0616cd11e74 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] 10.222.0.50 "GET /compute/v2.1/servers/f1ff920f-c104-42df-9947-28a80c5aa7e9" status: 200 len: 1317 microversion: 2.1 time: 0.737811 Aug 31 16:19:48.780759 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2709/5604] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:48 2022] GET /compute/v2.1/servers/f1ff920f-c104-42df-9947-28a80c5aa7e9 => generated 1317 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:48.785617 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-614487f9-ac0c-4480-b0ba-196dc05b9f4d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:48.795241 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-614487f9-ac0c-4480-b0ba-196dc05b9f4d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:48.806076 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-614487f9-ac0c-4480-b0ba-196dc05b9f4d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:48.807047 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-614487f9-ac0c-4480-b0ba-196dc05b9f4d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:48.807488 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-614487f9-ac0c-4480-b0ba-196dc05b9f4d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:48.808209 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-614487f9-ac0c-4480-b0ba-196dc05b9f4d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:48.808665 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-614487f9-ac0c-4480-b0ba-196dc05b9f4d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:48.809087 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-614487f9-ac0c-4480-b0ba-196dc05b9f4d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:49.063306 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-614487f9-ac0c-4480-b0ba-196dc05b9f4d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:49.080762 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-614487f9-ac0c-4480-b0ba-196dc05b9f4d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:49.082762 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-614487f9-ac0c-4480-b0ba-196dc05b9f4d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:49.084170 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-614487f9-ac0c-4480-b0ba-196dc05b9f4d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1806 microversion: 2.20 time: 0.302448 Aug 31 16:19:49.084907 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2710/5605] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:19:48 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1806 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:19:49.086407 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a839151b-3920-44b6-ba97-c21c5850d953 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:49.095364 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-d66e6bad-0449-4db6-8384-8ec185734d9a req-e9e83773-f4a2-4953-893e-af5e20edab6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91900503-1200-4e0c-9531-19f602773721", "name": "network-vif-plugged", "status": "completed", "tag": "0ae53451-7a56-4e3c-9834-f4bccd4b4283"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:19:49.098992 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a839151b-3920-44b6-ba97-c21c5850d953 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721" status: 200 len: 1366 microversion: 2.1 time: 1.677672 Aug 31 16:19:49.112322 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2896/5606] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:47 2022] GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721 => generated 1366 bytes in 1682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:49.117073 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d66e6bad-0449-4db6-8384-8ec185734d9a req-e9e83773-f4a2-4953-893e-af5e20edab6e service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:49.117555 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d66e6bad-0449-4db6-8384-8ec185734d9a req-e9e83773-f4a2-4953-893e-af5e20edab6e service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:49.117984 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d66e6bad-0449-4db6-8384-8ec185734d9a req-e9e83773-f4a2-4953-893e-af5e20edab6e service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:49.159849 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-d66e6bad-0449-4db6-8384-8ec185734d9a req-e9e83773-f4a2-4953-893e-af5e20edab6e service nova] Creating event network-vif-plugged:0ae53451-7a56-4e3c-9834-f4bccd4b4283 for instance 91900503-1200-4e0c-9531-19f602773721 on n-h2-833090-16 Aug 31 16:19:49.173815 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-d66e6bad-0449-4db6-8384-8ec185734d9a req-e9e83773-f4a2-4953-893e-af5e20edab6e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085624 Aug 31 16:19:49.175381 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2711/5607] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:19:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:19:49.800279 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9227edf7-a32e-4f9c-bb64-aa8c88a95ad9 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:49.801684 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9227edf7-a32e-4f9c-bb64-aa8c88a95ad9 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] [instance: f1ff920f-c104-42df-9947-28a80c5aa7e9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:49.811331 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9227edf7-a32e-4f9c-bb64-aa8c88a95ad9 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:49.812626 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9227edf7-a32e-4f9c-bb64-aa8c88a95ad9 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:49.821693 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9227edf7-a32e-4f9c-bb64-aa8c88a95ad9 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:49.823030 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9227edf7-a32e-4f9c-bb64-aa8c88a95ad9 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:49.823824 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9227edf7-a32e-4f9c-bb64-aa8c88a95ad9 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:49.824542 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9227edf7-a32e-4f9c-bb64-aa8c88a95ad9 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:50.110000 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d387cb7c-d9b4-472d-b731-78bec5357d6f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:50.110897 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d387cb7c-d9b4-472d-b731-78bec5357d6f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:50.120178 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d387cb7c-d9b4-472d-b731-78bec5357d6f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:50.125195 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d387cb7c-d9b4-472d-b731-78bec5357d6f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:50.125938 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d387cb7c-d9b4-472d-b731-78bec5357d6f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:50.132740 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d387cb7c-d9b4-472d-b731-78bec5357d6f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:50.136756 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d387cb7c-d9b4-472d-b731-78bec5357d6f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:50.137398 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d387cb7c-d9b4-472d-b731-78bec5357d6f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:50.447701 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9227edf7-a32e-4f9c-bb64-aa8c88a95ad9 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff838eb6dca6457d8e734f1d8a1f9e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8c681153e44dd0a4ba2310d2bb0380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:50.460147 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9227edf7-a32e-4f9c-bb64-aa8c88a95ad9 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] 10.222.0.50 "GET /compute/v2.1/servers/f1ff920f-c104-42df-9947-28a80c5aa7e9" status: 200 len: 1317 microversion: 2.1 time: 0.663402 Aug 31 16:19:50.462462 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2897/5608] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:49 2022] GET /compute/v2.1/servers/f1ff920f-c104-42df-9947-28a80c5aa7e9 => generated 1317 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:50.470201 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-99da3eca-2124-4aed-b5e5-2802b1a191f0 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:50.471053 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-99da3eca-2124-4aed-b5e5-2802b1a191f0 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 91900503-1200-4e0c-9531-19f602773721] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:50.479082 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-99da3eca-2124-4aed-b5e5-2802b1a191f0 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:50.479783 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-99da3eca-2124-4aed-b5e5-2802b1a191f0 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:50.480367 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-99da3eca-2124-4aed-b5e5-2802b1a191f0 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:50.481223 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-99da3eca-2124-4aed-b5e5-2802b1a191f0 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:50.481968 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-99da3eca-2124-4aed-b5e5-2802b1a191f0 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:50.482925 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-99da3eca-2124-4aed-b5e5-2802b1a191f0 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:50.804081 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d387cb7c-d9b4-472d-b731-78bec5357d6f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:50.814053 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d387cb7c-d9b4-472d-b731-78bec5357d6f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:50.822145 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d387cb7c-d9b4-472d-b731-78bec5357d6f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:50.828008 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d387cb7c-d9b4-472d-b731-78bec5357d6f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1806 microversion: 2.20 time: 0.722313 Aug 31 16:19:50.845243 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2712/5609] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:19:50 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1806 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:19:50.946349 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-99da3eca-2124-4aed-b5e5-2802b1a191f0 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:50.959643 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-99da3eca-2124-4aed-b5e5-2802b1a191f0 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721" status: 200 len: 1366 microversion: 2.1 time: 0.495821 Aug 31 16:19:50.962682 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2898/5610] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:50 2022] GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721 => generated 1366 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:51.191998 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-b74d1793-3e46-4a09-92ae-aeba0710854b req-ef0dfc92-d75b-4f47-96d7-a2c92dba8800 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d", "name": "network-vif-plugged", "status": "completed", "tag": "8e4486a0-b7ef-4efa-8a3b-565a37bae537"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:19:51.195010 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-5035e7b6-679f-4dc9-b324-33a21ac510cc req-d8a708a7-f75c-4ec1-8eb8-5b5f32930dbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1ff920f-c104-42df-9947-28a80c5aa7e9", "tag": "582754de-4076-42fa-a50b-9ba85e9c5568"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:19:51.213357 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-b74d1793-3e46-4a09-92ae-aeba0710854b req-ef0dfc92-d75b-4f47-96d7-a2c92dba8800 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:51.213951 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-b74d1793-3e46-4a09-92ae-aeba0710854b req-ef0dfc92-d75b-4f47-96d7-a2c92dba8800 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:51.214462 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5035e7b6-679f-4dc9-b324-33a21ac510cc req-d8a708a7-f75c-4ec1-8eb8-5b5f32930dbe service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:51.214674 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-b74d1793-3e46-4a09-92ae-aeba0710854b req-ef0dfc92-d75b-4f47-96d7-a2c92dba8800 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:51.215896 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5035e7b6-679f-4dc9-b324-33a21ac510cc req-d8a708a7-f75c-4ec1-8eb8-5b5f32930dbe service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:51.216637 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5035e7b6-679f-4dc9-b324-33a21ac510cc req-d8a708a7-f75c-4ec1-8eb8-5b5f32930dbe service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:51.235054 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-5035e7b6-679f-4dc9-b324-33a21ac510cc req-d8a708a7-f75c-4ec1-8eb8-5b5f32930dbe service nova] Creating event network-changed:582754de-4076-42fa-a50b-9ba85e9c5568 for instance f1ff920f-c104-42df-9947-28a80c5aa7e9 on n-h2-833090-16 Aug 31 16:19:51.242951 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-5035e7b6-679f-4dc9-b324-33a21ac510cc req-d8a708a7-f75c-4ec1-8eb8-5b5f32930dbe service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054104 Aug 31 16:19:51.245284 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2713/5611] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:19:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:19:51.285938 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-b74d1793-3e46-4a09-92ae-aeba0710854b req-ef0dfc92-d75b-4f47-96d7-a2c92dba8800 service nova] Creating event network-vif-plugged:8e4486a0-b7ef-4efa-8a3b-565a37bae537 for instance 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d on n-h2-833090-16 Aug 31 16:19:51.308153 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-b74d1793-3e46-4a09-92ae-aeba0710854b req-ef0dfc92-d75b-4f47-96d7-a2c92dba8800 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118232 Aug 31 16:19:51.331532 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2899/5612] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:19:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:19:51.483129 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ced62aec-37f2-4ad8-88ec-664080aa490c tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:51.484239 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ced62aec-37f2-4ad8-88ec-664080aa490c tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] [instance: f1ff920f-c104-42df-9947-28a80c5aa7e9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:51.504391 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ced62aec-37f2-4ad8-88ec-664080aa490c tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:51.506438 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ced62aec-37f2-4ad8-88ec-664080aa490c tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:51.507045 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ced62aec-37f2-4ad8-88ec-664080aa490c tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:51.516171 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ced62aec-37f2-4ad8-88ec-664080aa490c tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:51.516947 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ced62aec-37f2-4ad8-88ec-664080aa490c tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:51.517395 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ced62aec-37f2-4ad8-88ec-664080aa490c tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:51.853219 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b42554c2-8ccc-4cab-a50c-2f38edd3e33d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:51.854546 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b42554c2-8ccc-4cab-a50c-2f38edd3e33d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:51.862850 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b42554c2-8ccc-4cab-a50c-2f38edd3e33d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:51.863661 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b42554c2-8ccc-4cab-a50c-2f38edd3e33d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:51.864253 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b42554c2-8ccc-4cab-a50c-2f38edd3e33d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:51.865321 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b42554c2-8ccc-4cab-a50c-2f38edd3e33d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:51.865932 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b42554c2-8ccc-4cab-a50c-2f38edd3e33d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:51.866759 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b42554c2-8ccc-4cab-a50c-2f38edd3e33d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:51.886293 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ced62aec-37f2-4ad8-88ec-664080aa490c tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff838eb6dca6457d8e734f1d8a1f9e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8c681153e44dd0a4ba2310d2bb0380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:51.897122 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ced62aec-37f2-4ad8-88ec-664080aa490c tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] 10.222.0.50 "GET /compute/v2.1/servers/f1ff920f-c104-42df-9947-28a80c5aa7e9" status: 200 len: 1317 microversion: 2.1 time: 0.418570 Aug 31 16:19:51.898040 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2714/5613] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:51 2022] GET /compute/v2.1/servers/f1ff920f-c104-42df-9947-28a80c5aa7e9 => generated 1317 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:51.984675 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-358d6397-f631-4430-9b0b-2ed8b3af2c13 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:51.985238 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-358d6397-f631-4430-9b0b-2ed8b3af2c13 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 91900503-1200-4e0c-9531-19f602773721] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:51.992930 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-358d6397-f631-4430-9b0b-2ed8b3af2c13 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:51.993417 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-358d6397-f631-4430-9b0b-2ed8b3af2c13 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:51.993847 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-358d6397-f631-4430-9b0b-2ed8b3af2c13 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:51.994567 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-358d6397-f631-4430-9b0b-2ed8b3af2c13 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:51.995215 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-358d6397-f631-4430-9b0b-2ed8b3af2c13 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:51.995612 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-358d6397-f631-4430-9b0b-2ed8b3af2c13 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:52.261460 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b42554c2-8ccc-4cab-a50c-2f38edd3e33d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:52.286163 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b42554c2-8ccc-4cab-a50c-2f38edd3e33d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:52.292435 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b42554c2-8ccc-4cab-a50c-2f38edd3e33d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:52.295146 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b42554c2-8ccc-4cab-a50c-2f38edd3e33d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1806 microversion: 2.20 time: 0.446275 Aug 31 16:19:52.313774 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2900/5614] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:19:51 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1806 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:19:52.440845 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-358d6397-f631-4430-9b0b-2ed8b3af2c13 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:52.457282 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-358d6397-f631-4430-9b0b-2ed8b3af2c13 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721" status: 200 len: 1556 microversion: 2.1 time: 0.474611 Aug 31 16:19:52.474951 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2715/5615] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:51 2022] GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721 => generated 1556 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:52.496328 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e92ad947-f6de-4476-ad0c-2e096a57cb92 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:52.496732 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e92ad947-f6de-4476-ad0c-2e096a57cb92 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 91900503-1200-4e0c-9531-19f602773721] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:52.510259 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e92ad947-f6de-4476-ad0c-2e096a57cb92 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:52.510753 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e92ad947-f6de-4476-ad0c-2e096a57cb92 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:52.511341 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e92ad947-f6de-4476-ad0c-2e096a57cb92 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:52.512062 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e92ad947-f6de-4476-ad0c-2e096a57cb92 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:52.512582 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e92ad947-f6de-4476-ad0c-2e096a57cb92 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:52.513009 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e92ad947-f6de-4476-ad0c-2e096a57cb92 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:52.654130 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e92ad947-f6de-4476-ad0c-2e096a57cb92 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.161860 Aug 31 16:19:52.654813 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2901/5616] 10.222.0.50 () {58 vars in 1275 bytes} [Wed Aug 31 16:19:52 2022] GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721/os-interface => generated 284 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:19:52.917931 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4e6e1ee5-b040-4739-b499-e5d18039293c tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:52.918586 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4e6e1ee5-b040-4739-b499-e5d18039293c tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] [instance: f1ff920f-c104-42df-9947-28a80c5aa7e9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:52.932082 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e6e1ee5-b040-4739-b499-e5d18039293c tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:52.935025 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e6e1ee5-b040-4739-b499-e5d18039293c tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:52.937317 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e6e1ee5-b040-4739-b499-e5d18039293c tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:52.938087 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e6e1ee5-b040-4739-b499-e5d18039293c tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:52.940882 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e6e1ee5-b040-4739-b499-e5d18039293c tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:52.941318 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e6e1ee5-b040-4739-b499-e5d18039293c tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:53.323205 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f5fae92d-04e3-4c79-a9e0-8fa0db36b48d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:53.324130 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f5fae92d-04e3-4c79-a9e0-8fa0db36b48d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:53.329626 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4e6e1ee5-b040-4739-b499-e5d18039293c tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff838eb6dca6457d8e734f1d8a1f9e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8c681153e44dd0a4ba2310d2bb0380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:53.335881 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f5fae92d-04e3-4c79-a9e0-8fa0db36b48d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:53.339332 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f5fae92d-04e3-4c79-a9e0-8fa0db36b48d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:53.340594 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f5fae92d-04e3-4c79-a9e0-8fa0db36b48d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:53.346397 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f5fae92d-04e3-4c79-a9e0-8fa0db36b48d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:53.347285 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f5fae92d-04e3-4c79-a9e0-8fa0db36b48d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:53.347892 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f5fae92d-04e3-4c79-a9e0-8fa0db36b48d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:53.352660 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4e6e1ee5-b040-4739-b499-e5d18039293c tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] 10.222.0.50 "GET /compute/v2.1/servers/f1ff920f-c104-42df-9947-28a80c5aa7e9" status: 200 len: 1317 microversion: 2.1 time: 0.438434 Aug 31 16:19:53.372767 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2716/5617] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:52 2022] GET /compute/v2.1/servers/f1ff920f-c104-42df-9947-28a80c5aa7e9 => generated 1317 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:19:54.212498 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:19:54.377153 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8e0280c9-1d8d-4d68-9a4d-b28d2c63fd2f tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:54.377916 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8e0280c9-1d8d-4d68-9a4d-b28d2c63fd2f tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] [instance: f1ff920f-c104-42df-9947-28a80c5aa7e9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:54.394317 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e0280c9-1d8d-4d68-9a4d-b28d2c63fd2f tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:54.394814 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e0280c9-1d8d-4d68-9a4d-b28d2c63fd2f tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:54.398450 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e0280c9-1d8d-4d68-9a4d-b28d2c63fd2f tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:54.401429 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e0280c9-1d8d-4d68-9a4d-b28d2c63fd2f tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:54.401937 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e0280c9-1d8d-4d68-9a4d-b28d2c63fd2f tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:54.402420 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e0280c9-1d8d-4d68-9a4d-b28d2c63fd2f tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:54.479245 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=8 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:19:54.612333 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f5fae92d-04e3-4c79-a9e0-8fa0db36b48d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:54.623416 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f5fae92d-04e3-4c79-a9e0-8fa0db36b48d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:54.625168 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f5fae92d-04e3-4c79-a9e0-8fa0db36b48d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:54.627147 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f5fae92d-04e3-4c79-a9e0-8fa0db36b48d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1806 microversion: 2.20 time: 1.309479 Aug 31 16:19:54.628289 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2902/5618] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:19:53 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1806 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:19:54.749740 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8e0280c9-1d8d-4d68-9a4d-b28d2c63fd2f tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff838eb6dca6457d8e734f1d8a1f9e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8c681153e44dd0a4ba2310d2bb0380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:54.763059 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8e0280c9-1d8d-4d68-9a4d-b28d2c63fd2f tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] 10.222.0.50 "GET /compute/v2.1/servers/f1ff920f-c104-42df-9947-28a80c5aa7e9" status: 200 len: 1317 microversion: 2.1 time: 0.389828 Aug 31 16:19:54.765350 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2717/5619] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:54 2022] GET /compute/v2.1/servers/f1ff920f-c104-42df-9947-28a80c5aa7e9 => generated 1317 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:19:55.290647 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-86b1509c-70cc-4f01-b76d-f70fc415533e req-be54cc9e-01b1-4499-8cd9-5a9e8e68d852 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91900503-1200-4e0c-9531-19f602773721", "tag": "0ae53451-7a56-4e3c-9834-f4bccd4b4283"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:19:55.303250 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-86b1509c-70cc-4f01-b76d-f70fc415533e req-be54cc9e-01b1-4499-8cd9-5a9e8e68d852 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:55.304066 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-86b1509c-70cc-4f01-b76d-f70fc415533e req-be54cc9e-01b1-4499-8cd9-5a9e8e68d852 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:55.304780 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-86b1509c-70cc-4f01-b76d-f70fc415533e req-be54cc9e-01b1-4499-8cd9-5a9e8e68d852 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:55.319737 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-86b1509c-70cc-4f01-b76d-f70fc415533e req-be54cc9e-01b1-4499-8cd9-5a9e8e68d852 service nova] Creating event network-changed:0ae53451-7a56-4e3c-9834-f4bccd4b4283 for instance 91900503-1200-4e0c-9531-19f602773721 on n-h2-833090-16 Aug 31 16:19:55.330181 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-86b1509c-70cc-4f01-b76d-f70fc415533e req-be54cc9e-01b1-4499-8cd9-5a9e8e68d852 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043900 Aug 31 16:19:55.332099 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2903/5620] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:19:55.664607 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f10e6b5e-b693-40fe-99d5-6033534face2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:55.665782 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f10e6b5e-b693-40fe-99d5-6033534face2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:55.697045 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f10e6b5e-b693-40fe-99d5-6033534face2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:55.707428 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f10e6b5e-b693-40fe-99d5-6033534face2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:55.708611 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f10e6b5e-b693-40fe-99d5-6033534face2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:55.711997 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f10e6b5e-b693-40fe-99d5-6033534face2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:55.715013 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f10e6b5e-b693-40fe-99d5-6033534face2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:55.716022 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f10e6b5e-b693-40fe-99d5-6033534face2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:55.785733 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-23760079-b25f-41e6-b9b3-b0d876636d74 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:55.786567 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-23760079-b25f-41e6-b9b3-b0d876636d74 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] [instance: f1ff920f-c104-42df-9947-28a80c5aa7e9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:55.799320 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-23760079-b25f-41e6-b9b3-b0d876636d74 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:55.800436 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-23760079-b25f-41e6-b9b3-b0d876636d74 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:55.805977 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-23760079-b25f-41e6-b9b3-b0d876636d74 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:55.807563 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-23760079-b25f-41e6-b9b3-b0d876636d74 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:55.808714 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-23760079-b25f-41e6-b9b3-b0d876636d74 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:55.809495 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-23760079-b25f-41e6-b9b3-b0d876636d74 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:56.055593 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f10e6b5e-b693-40fe-99d5-6033534face2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:56.069128 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f10e6b5e-b693-40fe-99d5-6033534face2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:56.074464 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f10e6b5e-b693-40fe-99d5-6033534face2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:56.078515 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-23760079-b25f-41e6-b9b3-b0d876636d74 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff838eb6dca6457d8e734f1d8a1f9e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8c681153e44dd0a4ba2310d2bb0380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:56.091849 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f10e6b5e-b693-40fe-99d5-6033534face2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1806 microversion: 2.20 time: 0.433313 Aug 31 16:19:56.111492 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-23760079-b25f-41e6-b9b3-b0d876636d74 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] 10.222.0.50 "GET /compute/v2.1/servers/f1ff920f-c104-42df-9947-28a80c5aa7e9" status: 200 len: 1317 microversion: 2.1 time: 0.330062 Aug 31 16:19:56.112024 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2718/5621] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:19:55 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1806 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:19:56.113964 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2904/5622] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:55 2022] GET /compute/v2.1/servers/f1ff920f-c104-42df-9947-28a80c5aa7e9 => generated 1317 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:19:56.170140 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b0295d9c-6f12-48bd-8f45-f08806a3b170 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:19:56.172869 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b0295d9c-6f12-48bd-8f45-f08806a3b170 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 5cdd332d-8fd9-4b10-bc9b-a90375e91451] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:56.181498 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0295d9c-6f12-48bd-8f45-f08806a3b170 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:56.182370 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0295d9c-6f12-48bd-8f45-f08806a3b170 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:56.183115 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0295d9c-6f12-48bd-8f45-f08806a3b170 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:56.184913 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0295d9c-6f12-48bd-8f45-f08806a3b170 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:56.185690 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0295d9c-6f12-48bd-8f45-f08806a3b170 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:56.187538 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0295d9c-6f12-48bd-8f45-f08806a3b170 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:56.295915 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b0295d9c-6f12-48bd-8f45-f08806a3b170 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "POST /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451/action" status: 200 len: 24565 microversion: 2.1 time: 0.128939 Aug 31 16:19:56.303407 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2719/5623] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:19:56 2022] POST /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451/action => generated 24565 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:19:57.117579 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-241a9e96-f891-4b96-b3d8-7d637427a12e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:57.119178 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-241a9e96-f891-4b96-b3d8-7d637427a12e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:57.137843 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-241a9e96-f891-4b96-b3d8-7d637427a12e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:57.139186 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7d08c539-056a-4682-b2b3-8f48e26513d8 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:57.139941 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-241a9e96-f891-4b96-b3d8-7d637427a12e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:57.140076 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7d08c539-056a-4682-b2b3-8f48e26513d8 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] [instance: f1ff920f-c104-42df-9947-28a80c5aa7e9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:57.141802 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-241a9e96-f891-4b96-b3d8-7d637427a12e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:57.143039 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-241a9e96-f891-4b96-b3d8-7d637427a12e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:57.145149 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-241a9e96-f891-4b96-b3d8-7d637427a12e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:57.145909 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-241a9e96-f891-4b96-b3d8-7d637427a12e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:57.158896 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d08c539-056a-4682-b2b3-8f48e26513d8 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:57.161648 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d08c539-056a-4682-b2b3-8f48e26513d8 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:57.164895 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d08c539-056a-4682-b2b3-8f48e26513d8 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:57.165953 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d08c539-056a-4682-b2b3-8f48e26513d8 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:57.166574 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d08c539-056a-4682-b2b3-8f48e26513d8 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:57.167291 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d08c539-056a-4682-b2b3-8f48e26513d8 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:57.650817 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-241a9e96-f891-4b96-b3d8-7d637427a12e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:57.661008 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-241a9e96-f891-4b96-b3d8-7d637427a12e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:57.673058 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-241a9e96-f891-4b96-b3d8-7d637427a12e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:57.675652 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-241a9e96-f891-4b96-b3d8-7d637427a12e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1793 microversion: 2.20 time: 0.561955 Aug 31 16:19:57.677510 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2905/5624] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:19:57 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1793 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:19:57.806427 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7d08c539-056a-4682-b2b3-8f48e26513d8 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff838eb6dca6457d8e734f1d8a1f9e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8c681153e44dd0a4ba2310d2bb0380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:57.816936 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7d08c539-056a-4682-b2b3-8f48e26513d8 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] 10.222.0.50 "GET /compute/v2.1/servers/f1ff920f-c104-42df-9947-28a80c5aa7e9" status: 200 len: 1317 microversion: 2.1 time: 0.682952 Aug 31 16:19:57.818901 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2720/5625] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:57 2022] GET /compute/v2.1/servers/f1ff920f-c104-42df-9947-28a80c5aa7e9 => generated 1317 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:19:58.839300 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c68aed36-ee8a-4c91-867c-4ac949f8b516 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:19:58.840742 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c68aed36-ee8a-4c91-867c-4ac949f8b516 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] [instance: f1ff920f-c104-42df-9947-28a80c5aa7e9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:19:58.864655 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c68aed36-ee8a-4c91-867c-4ac949f8b516 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:58.865158 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c68aed36-ee8a-4c91-867c-4ac949f8b516 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:58.865600 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c68aed36-ee8a-4c91-867c-4ac949f8b516 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:58.866485 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c68aed36-ee8a-4c91-867c-4ac949f8b516 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:19:58.867007 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c68aed36-ee8a-4c91-867c-4ac949f8b516 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:19:58.867532 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c68aed36-ee8a-4c91-867c-4ac949f8b516 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:19:59.259945 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c68aed36-ee8a-4c91-867c-4ac949f8b516 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff838eb6dca6457d8e734f1d8a1f9e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8c681153e44dd0a4ba2310d2bb0380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:19:59.267635 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c68aed36-ee8a-4c91-867c-4ac949f8b516 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] 10.222.0.50 "GET /compute/v2.1/servers/f1ff920f-c104-42df-9947-28a80c5aa7e9" status: 200 len: 1317 microversion: 2.1 time: 0.432494 Aug 31 16:19:59.269209 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2906/5626] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:19:58 2022] GET /compute/v2.1/servers/f1ff920f-c104-42df-9947-28a80c5aa7e9 => generated 1317 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:00.301777 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bac78753-29e4-464d-be7a-3f7d37602213 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:00.302718 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bac78753-29e4-464d-be7a-3f7d37602213 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] [instance: f1ff920f-c104-42df-9947-28a80c5aa7e9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:00.331411 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bac78753-29e4-464d-be7a-3f7d37602213 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:00.338475 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bac78753-29e4-464d-be7a-3f7d37602213 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:00.339065 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bac78753-29e4-464d-be7a-3f7d37602213 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:00.339942 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bac78753-29e4-464d-be7a-3f7d37602213 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:00.340527 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bac78753-29e4-464d-be7a-3f7d37602213 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:00.341028 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bac78753-29e4-464d-be7a-3f7d37602213 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:00.673857 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bac78753-29e4-464d-be7a-3f7d37602213 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff838eb6dca6457d8e734f1d8a1f9e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8c681153e44dd0a4ba2310d2bb0380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:00.687193 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bac78753-29e4-464d-be7a-3f7d37602213 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] 10.222.0.50 "GET /compute/v2.1/servers/f1ff920f-c104-42df-9947-28a80c5aa7e9" status: 200 len: 1317 microversion: 2.1 time: 0.401232 Aug 31 16:20:00.688139 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2721/5627] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:00 2022] GET /compute/v2.1/servers/f1ff920f-c104-42df-9947-28a80c5aa7e9 => generated 1317 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:01.714632 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5ca25c04-5751-4fdf-b56d-1b0622bce158 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:01.715750 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5ca25c04-5751-4fdf-b56d-1b0622bce158 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] [instance: f1ff920f-c104-42df-9947-28a80c5aa7e9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:01.739595 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5ca25c04-5751-4fdf-b56d-1b0622bce158 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:01.744521 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5ca25c04-5751-4fdf-b56d-1b0622bce158 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:01.745665 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5ca25c04-5751-4fdf-b56d-1b0622bce158 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:01.746783 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5ca25c04-5751-4fdf-b56d-1b0622bce158 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:01.747402 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5ca25c04-5751-4fdf-b56d-1b0622bce158 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:01.747996 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5ca25c04-5751-4fdf-b56d-1b0622bce158 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:02.225736 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5ca25c04-5751-4fdf-b56d-1b0622bce158 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff838eb6dca6457d8e734f1d8a1f9e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8c681153e44dd0a4ba2310d2bb0380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:02.228352 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=100 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:20:02.241403 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5ca25c04-5751-4fdf-b56d-1b0622bce158 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] 10.222.0.50 "GET /compute/v2.1/servers/f1ff920f-c104-42df-9947-28a80c5aa7e9" status: 200 len: 1317 microversion: 2.1 time: 0.535674 Aug 31 16:20:02.255220 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2907/5628] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:01 2022] GET /compute/v2.1/servers/f1ff920f-c104-42df-9947-28a80c5aa7e9 => generated 1317 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:02.553023 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-a2104e1e-1010-4262-9b8e-7d8c120d4cda req-30e86e68-756e-4af1-b9fa-877e9fd3be6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1ff920f-c104-42df-9947-28a80c5aa7e9", "name": "network-vif-plugged", "status": "completed", "tag": "582754de-4076-42fa-a50b-9ba85e9c5568"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:20:02.620750 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a2104e1e-1010-4262-9b8e-7d8c120d4cda req-30e86e68-756e-4af1-b9fa-877e9fd3be6b service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:02.624003 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a2104e1e-1010-4262-9b8e-7d8c120d4cda req-30e86e68-756e-4af1-b9fa-877e9fd3be6b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:02.625535 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a2104e1e-1010-4262-9b8e-7d8c120d4cda req-30e86e68-756e-4af1-b9fa-877e9fd3be6b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:02.653221 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-a2104e1e-1010-4262-9b8e-7d8c120d4cda req-30e86e68-756e-4af1-b9fa-877e9fd3be6b service nova] Creating event network-vif-plugged:582754de-4076-42fa-a50b-9ba85e9c5568 for instance f1ff920f-c104-42df-9947-28a80c5aa7e9 on n-h2-833090-16 Aug 31 16:20:02.672867 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-a2104e1e-1010-4262-9b8e-7d8c120d4cda req-30e86e68-756e-4af1-b9fa-877e9fd3be6b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126640 Aug 31 16:20:02.674924 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2722/5629] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:20:02.714677 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-68b18945-4200-40f5-a98a-5d6b92cf6173 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:02.715452 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-68b18945-4200-40f5-a98a-5d6b92cf6173 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 5cdd332d-8fd9-4b10-bc9b-a90375e91451] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:02.736109 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68b18945-4200-40f5-a98a-5d6b92cf6173 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:02.739190 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68b18945-4200-40f5-a98a-5d6b92cf6173 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:02.742469 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68b18945-4200-40f5-a98a-5d6b92cf6173 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:02.746600 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68b18945-4200-40f5-a98a-5d6b92cf6173 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:02.751954 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68b18945-4200-40f5-a98a-5d6b92cf6173 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:02.752652 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68b18945-4200-40f5-a98a-5d6b92cf6173 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:03.187809 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-68b18945-4200-40f5-a98a-5d6b92cf6173 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:03.211395 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-68b18945-4200-40f5-a98a-5d6b92cf6173 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451" status: 200 len: 1684 microversion: 2.1 time: 0.501667 Aug 31 16:20:03.238219 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2908/5630] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:02 2022] GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451 => generated 1684 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:03.266268 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-549fda14-7bf5-448c-b5a5-568b768bdd5e tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:03.267232 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-549fda14-7bf5-448c-b5a5-568b768bdd5e tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] [instance: f1ff920f-c104-42df-9947-28a80c5aa7e9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:03.281127 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-549fda14-7bf5-448c-b5a5-568b768bdd5e tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:03.281909 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-549fda14-7bf5-448c-b5a5-568b768bdd5e tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:03.283287 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-549fda14-7bf5-448c-b5a5-568b768bdd5e tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:03.285438 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-549fda14-7bf5-448c-b5a5-568b768bdd5e tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:03.286343 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-549fda14-7bf5-448c-b5a5-568b768bdd5e tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:03.286958 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-549fda14-7bf5-448c-b5a5-568b768bdd5e tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:03.472161 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a67c58a2-9667-4616-a1c9-f7f53c8a4df8 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:20:03.475262 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a67c58a2-9667-4616-a1c9-f7f53c8a4df8 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 5cdd332d-8fd9-4b10-bc9b-a90375e91451] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:03.482652 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a67c58a2-9667-4616-a1c9-f7f53c8a4df8 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:03.483449 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a67c58a2-9667-4616-a1c9-f7f53c8a4df8 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:03.484154 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a67c58a2-9667-4616-a1c9-f7f53c8a4df8 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:03.484888 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a67c58a2-9667-4616-a1c9-f7f53c8a4df8 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:03.485512 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a67c58a2-9667-4616-a1c9-f7f53c8a4df8 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:03.486694 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a67c58a2-9667-4616-a1c9-f7f53c8a4df8 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:03.568142 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a67c58a2-9667-4616-a1c9-f7f53c8a4df8 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "POST /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451/action" status: 200 len: 32638 microversion: 2.1 time: 0.102430 Aug 31 16:20:03.578216 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2909/5631] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:20:03 2022] POST /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451/action => generated 32638 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:20:03.736224 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-df1021bb-376b-4408-84f0-4d914a0e407a tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:03.738206 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-df1021bb-376b-4408-84f0-4d914a0e407a tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] [instance: 5cdd332d-8fd9-4b10-bc9b-a90375e91451] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:03.773447 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-df1021bb-376b-4408-84f0-4d914a0e407a tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:03.773962 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-df1021bb-376b-4408-84f0-4d914a0e407a tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:03.774436 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-df1021bb-376b-4408-84f0-4d914a0e407a tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:03.775156 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-df1021bb-376b-4408-84f0-4d914a0e407a tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:03.789612 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-df1021bb-376b-4408-84f0-4d914a0e407a tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:03.792757 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-df1021bb-376b-4408-84f0-4d914a0e407a tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:03.890220 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-549fda14-7bf5-448c-b5a5-568b768bdd5e tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff838eb6dca6457d8e734f1d8a1f9e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8c681153e44dd0a4ba2310d2bb0380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:03.894372 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:20:03.907158 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-549fda14-7bf5-448c-b5a5-568b768bdd5e tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] 10.222.0.50 "GET /compute/v2.1/servers/f1ff920f-c104-42df-9947-28a80c5aa7e9" status: 200 len: 1317 microversion: 2.1 time: 0.646256 Aug 31 16:20:03.911864 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2723/5632] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:03 2022] GET /compute/v2.1/servers/f1ff920f-c104-42df-9947-28a80c5aa7e9 => generated 1317 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:04.153866 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-df1021bb-376b-4408-84f0-4d914a0e407a tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451" status: 200 len: 1837 microversion: 2.1 time: 0.429108 Aug 31 16:20:04.155528 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2910/5633] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:03 2022] GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451 => generated 1837 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:20:04.193861 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-03bed806-dbda-4e36-9c7b-2936830680b5 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:20:04.197687 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-03bed806-dbda-4e36-9c7b-2936830680b5 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] [instance: 5cdd332d-8fd9-4b10-bc9b-a90375e91451] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:04.207915 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03bed806-dbda-4e36-9c7b-2936830680b5 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:04.208821 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03bed806-dbda-4e36-9c7b-2936830680b5 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:04.209461 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03bed806-dbda-4e36-9c7b-2936830680b5 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:04.210784 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03bed806-dbda-4e36-9c7b-2936830680b5 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:04.211412 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03bed806-dbda-4e36-9c7b-2936830680b5 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:04.212024 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03bed806-dbda-4e36-9c7b-2936830680b5 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:04.247796 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-03bed806-dbda-4e36-9c7b-2936830680b5 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Lazy-loading 'flavor' on Instance uuid 5cdd332d-8fd9-4b10-bc9b-a90375e91451 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:20:04.263846 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-03bed806-dbda-4e36-9c7b-2936830680b5 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] [instance: 5cdd332d-8fd9-4b10-bc9b-a90375e91451] Going to try to live migrate instance to another host {{(pid=128863) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 31 16:20:04.939792 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b1c73b81-ac3b-4345-8288-9b494785f631 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:04.941191 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b1c73b81-ac3b-4345-8288-9b494785f631 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] [instance: f1ff920f-c104-42df-9947-28a80c5aa7e9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:04.949440 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:20:04.954794 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1c73b81-ac3b-4345-8288-9b494785f631 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:04.958510 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1c73b81-ac3b-4345-8288-9b494785f631 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:04.960205 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1c73b81-ac3b-4345-8288-9b494785f631 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:04.961078 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1c73b81-ac3b-4345-8288-9b494785f631 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:04.963392 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1c73b81-ac3b-4345-8288-9b494785f631 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:04.966225 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1c73b81-ac3b-4345-8288-9b494785f631 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:05.385505 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b1c73b81-ac3b-4345-8288-9b494785f631 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff838eb6dca6457d8e734f1d8a1f9e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8c681153e44dd0a4ba2310d2bb0380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:05.396092 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b1c73b81-ac3b-4345-8288-9b494785f631 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] 10.222.0.50 "GET /compute/v2.1/servers/f1ff920f-c104-42df-9947-28a80c5aa7e9" status: 200 len: 1505 microversion: 2.1 time: 0.461680 Aug 31 16:20:05.399339 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2911/5634] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:04 2022] GET /compute/v2.1/servers/f1ff920f-c104-42df-9947-28a80c5aa7e9 => generated 1505 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:05.424814 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4ebe8007-5235-4d4b-8650-f1118d86e034 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:05.425824 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4ebe8007-5235-4d4b-8650-f1118d86e034 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] [instance: f1ff920f-c104-42df-9947-28a80c5aa7e9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:05.444893 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4ebe8007-5235-4d4b-8650-f1118d86e034 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:05.448387 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4ebe8007-5235-4d4b-8650-f1118d86e034 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:05.448953 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4ebe8007-5235-4d4b-8650-f1118d86e034 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:05.449794 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4ebe8007-5235-4d4b-8650-f1118d86e034 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:05.450396 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4ebe8007-5235-4d4b-8650-f1118d86e034 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:05.451642 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4ebe8007-5235-4d4b-8650-f1118d86e034 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:05.510427 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4ebe8007-5235-4d4b-8650-f1118d86e034 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] 10.222.0.50 "GET /compute/v2.1/servers/f1ff920f-c104-42df-9947-28a80c5aa7e9/ips" status: 200 len: 108 microversion: 2.1 time: 0.088618 Aug 31 16:20:05.514231 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2912/5635] 10.222.0.50 () {58 vars in 1248 bytes} [Wed Aug 31 16:20:05 2022] GET /compute/v2.1/servers/f1ff920f-c104-42df-9947-28a80c5aa7e9/ips => generated 108 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:20:05.530261 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-bd5f20dc-21ea-4cba-8bbd-168ba3007e55 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:05.531590 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-bd5f20dc-21ea-4cba-8bbd-168ba3007e55 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] [instance: f1ff920f-c104-42df-9947-28a80c5aa7e9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:05.552658 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bd5f20dc-21ea-4cba-8bbd-168ba3007e55 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:05.553823 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bd5f20dc-21ea-4cba-8bbd-168ba3007e55 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:05.554421 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bd5f20dc-21ea-4cba-8bbd-168ba3007e55 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:05.555266 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bd5f20dc-21ea-4cba-8bbd-168ba3007e55 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:05.555962 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bd5f20dc-21ea-4cba-8bbd-168ba3007e55 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:05.557666 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bd5f20dc-21ea-4cba-8bbd-168ba3007e55 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:05.624764 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-bd5f20dc-21ea-4cba-8bbd-168ba3007e55 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] 10.222.0.50 "GET /compute/v2.1/servers/f1ff920f-c104-42df-9947-28a80c5aa7e9/ips" status: 200 len: 108 microversion: 2.1 time: 0.102417 Aug 31 16:20:05.630712 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2913/5636] 10.222.0.50 () {58 vars in 1248 bytes} [Wed Aug 31 16:20:05 2022] GET /compute/v2.1/servers/f1ff920f-c104-42df-9947-28a80c5aa7e9/ips => generated 108 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:20:05.645755 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9280aab9-6e43-413b-8efb-27c79b5f5949 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:05.646125 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9280aab9-6e43-413b-8efb-27c79b5f5949 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] [instance: f1ff920f-c104-42df-9947-28a80c5aa7e9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:05.680922 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9280aab9-6e43-413b-8efb-27c79b5f5949 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:05.681428 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9280aab9-6e43-413b-8efb-27c79b5f5949 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:05.688348 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9280aab9-6e43-413b-8efb-27c79b5f5949 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:05.689371 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9280aab9-6e43-413b-8efb-27c79b5f5949 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:05.690237 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9280aab9-6e43-413b-8efb-27c79b5f5949 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:05.690940 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9280aab9-6e43-413b-8efb-27c79b5f5949 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:05.788516 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9280aab9-6e43-413b-8efb-27c79b5f5949 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] 10.222.0.50 "GET /compute/v2.1/servers/f1ff920f-c104-42df-9947-28a80c5aa7e9/ips/tempest-ServerAddressesTestJSON-906912236-network" status: 200 len: 93 microversion: 2.1 time: 0.154650 Aug 31 16:20:05.792520 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2914/5637] 10.222.0.50 () {58 vars in 1398 bytes} [Wed Aug 31 16:20:05 2022] GET /compute/v2.1/servers/f1ff920f-c104-42df-9947-28a80c5aa7e9/ips/tempest-ServerAddressesTestJSON-906912236-network => generated 93 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:20:05.806005 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ba61002e-4145-4855-8621-4cbd3a189f6c tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:05.811412 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ba61002e-4145-4855-8621-4cbd3a189f6c tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] [instance: f1ff920f-c104-42df-9947-28a80c5aa7e9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:05.827481 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ba61002e-4145-4855-8621-4cbd3a189f6c tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:05.835609 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ba61002e-4145-4855-8621-4cbd3a189f6c tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:05.836458 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ba61002e-4145-4855-8621-4cbd3a189f6c tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:05.837968 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ba61002e-4145-4855-8621-4cbd3a189f6c tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:05.839011 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ba61002e-4145-4855-8621-4cbd3a189f6c tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:05.839745 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ba61002e-4145-4855-8621-4cbd3a189f6c tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:05.872876 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ba61002e-4145-4855-8621-4cbd3a189f6c tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] [instance: f1ff920f-c104-42df-9947-28a80c5aa7e9] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:20:06.066703 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ba61002e-4145-4855-8621-4cbd3a189f6c tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] 10.222.0.50 "DELETE /compute/v2.1/servers/f1ff920f-c104-42df-9947-28a80c5aa7e9" status: 204 len: 0 microversion: 2.1 time: 0.265795 Aug 31 16:20:06.067668 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2915/5638] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:20:05 2022] DELETE /compute/v2.1/servers/f1ff920f-c104-42df-9947-28a80c5aa7e9 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:20:06.079904 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-076fa949-02e7-4e7b-8b35-326a44241b50 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:06.080798 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-076fa949-02e7-4e7b-8b35-326a44241b50 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] [instance: f1ff920f-c104-42df-9947-28a80c5aa7e9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:06.096428 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-076fa949-02e7-4e7b-8b35-326a44241b50 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:06.097188 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-076fa949-02e7-4e7b-8b35-326a44241b50 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:06.099731 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-076fa949-02e7-4e7b-8b35-326a44241b50 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:06.100692 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-076fa949-02e7-4e7b-8b35-326a44241b50 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:06.102589 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-076fa949-02e7-4e7b-8b35-326a44241b50 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:06.104165 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-076fa949-02e7-4e7b-8b35-326a44241b50 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:06.483808 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-076fa949-02e7-4e7b-8b35-326a44241b50 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff838eb6dca6457d8e734f1d8a1f9e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8c681153e44dd0a4ba2310d2bb0380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:06.498843 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-076fa949-02e7-4e7b-8b35-326a44241b50 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] 10.222.0.50 "GET /compute/v2.1/servers/f1ff920f-c104-42df-9947-28a80c5aa7e9" status: 200 len: 1511 microversion: 2.1 time: 0.425220 Aug 31 16:20:06.499465 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2916/5639] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:06 2022] GET /compute/v2.1/servers/f1ff920f-c104-42df-9947-28a80c5aa7e9 => generated 1511 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:07.522584 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-97c28d3f-c850-4c28-9247-27a4bd89f455 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:07.523694 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-97c28d3f-c850-4c28-9247-27a4bd89f455 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] [instance: f1ff920f-c104-42df-9947-28a80c5aa7e9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:07.543871 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-97c28d3f-c850-4c28-9247-27a4bd89f455 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:07.545718 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-97c28d3f-c850-4c28-9247-27a4bd89f455 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:07.547208 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-97c28d3f-c850-4c28-9247-27a4bd89f455 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:07.549256 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-97c28d3f-c850-4c28-9247-27a4bd89f455 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:07.550387 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-97c28d3f-c850-4c28-9247-27a4bd89f455 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:07.551600 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-97c28d3f-c850-4c28-9247-27a4bd89f455 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:07.808947 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-97c28d3f-c850-4c28-9247-27a4bd89f455 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff838eb6dca6457d8e734f1d8a1f9e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8c681153e44dd0a4ba2310d2bb0380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:07.819233 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-97c28d3f-c850-4c28-9247-27a4bd89f455 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] 10.222.0.50 "GET /compute/v2.1/servers/f1ff920f-c104-42df-9947-28a80c5aa7e9" status: 200 len: 1511 microversion: 2.1 time: 0.302194 Aug 31 16:20:07.820162 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2917/5640] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:07 2022] GET /compute/v2.1/servers/f1ff920f-c104-42df-9947-28a80c5aa7e9 => generated 1511 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:20:08.493367 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-03bed806-dbda-4e36-9c7b-2936830680b5 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451/action" status: 202 len: 0 microversion: 2.1 time: 4.306755 Aug 31 16:20:08.494676 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2724/5641] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:20:04 2022] POST /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451/action => generated 0 bytes in 4310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:20:08.795448 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-86e796c1-4dc5-47d1-ba5a-32f56361a419 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:08.797124 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-86e796c1-4dc5-47d1-ba5a-32f56361a419 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 5cdd332d-8fd9-4b10-bc9b-a90375e91451] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:08.805679 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-86e796c1-4dc5-47d1-ba5a-32f56361a419 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:08.806211 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-86e796c1-4dc5-47d1-ba5a-32f56361a419 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:08.806640 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-86e796c1-4dc5-47d1-ba5a-32f56361a419 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:08.807509 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-86e796c1-4dc5-47d1-ba5a-32f56361a419 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:08.807962 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-86e796c1-4dc5-47d1-ba5a-32f56361a419 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:08.808377 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-86e796c1-4dc5-47d1-ba5a-32f56361a419 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:08.842285 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9d6fa382-962c-461b-9385-7215cef06b47 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:08.843920 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9d6fa382-962c-461b-9385-7215cef06b47 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] [instance: f1ff920f-c104-42df-9947-28a80c5aa7e9] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:08.857651 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d6fa382-962c-461b-9385-7215cef06b47 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:08.858465 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d6fa382-962c-461b-9385-7215cef06b47 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:08.859082 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d6fa382-962c-461b-9385-7215cef06b47 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:08.859965 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d6fa382-962c-461b-9385-7215cef06b47 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:08.860568 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d6fa382-962c-461b-9385-7215cef06b47 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:08.861153 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d6fa382-962c-461b-9385-7215cef06b47 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:09.003898 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-86e796c1-4dc5-47d1-ba5a-32f56361a419 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:09.014254 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-86e796c1-4dc5-47d1-ba5a-32f56361a419 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451" status: 200 len: 1694 microversion: 2.1 time: 0.514467 Aug 31 16:20:09.015225 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2918/5642] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:08 2022] GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451 => generated 1694 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:09.068497 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9d6fa382-962c-461b-9385-7215cef06b47 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff838eb6dca6457d8e734f1d8a1f9e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8c681153e44dd0a4ba2310d2bb0380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:09.077652 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9d6fa382-962c-461b-9385-7215cef06b47 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] 10.222.0.50 "GET /compute/v2.1/servers/f1ff920f-c104-42df-9947-28a80c5aa7e9" status: 200 len: 1511 microversion: 2.1 time: 0.239893 Aug 31 16:20:09.078731 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2725/5643] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:08 2022] GET /compute/v2.1/servers/f1ff920f-c104-42df-9947-28a80c5aa7e9 => generated 1511 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:09.505357 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-69756687-d887-4db4-8ca0-a0b6d9d0bb6e req-a2447da3-2bab-4eb2-bee3-35935718b432 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1ff920f-c104-42df-9947-28a80c5aa7e9", "name": "network-vif-deleted", "tag": "582754de-4076-42fa-a50b-9ba85e9c5568"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:20:09.549267 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-69756687-d887-4db4-8ca0-a0b6d9d0bb6e req-a2447da3-2bab-4eb2-bee3-35935718b432 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:09.550069 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-69756687-d887-4db4-8ca0-a0b6d9d0bb6e req-a2447da3-2bab-4eb2-bee3-35935718b432 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:09.550667 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-69756687-d887-4db4-8ca0-a0b6d9d0bb6e req-a2447da3-2bab-4eb2-bee3-35935718b432 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:09.573123 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-69756687-d887-4db4-8ca0-a0b6d9d0bb6e req-a2447da3-2bab-4eb2-bee3-35935718b432 service nova] Creating event network-vif-deleted:582754de-4076-42fa-a50b-9ba85e9c5568 for instance f1ff920f-c104-42df-9947-28a80c5aa7e9 on n-h2-833090-16 Aug 31 16:20:09.578372 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-69756687-d887-4db4-8ca0-a0b6d9d0bb6e req-a2447da3-2bab-4eb2-bee3-35935718b432 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079780 Aug 31 16:20:09.579594 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2919/5644] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:20:10.046649 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e7b0c8ce-34e7-44ba-ac5a-dcbf7fc21a8c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:10.048426 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e7b0c8ce-34e7-44ba-ac5a-dcbf7fc21a8c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 5cdd332d-8fd9-4b10-bc9b-a90375e91451] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:10.055116 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=50 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:20:10.056872 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7b0c8ce-34e7-44ba-ac5a-dcbf7fc21a8c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:10.057573 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7b0c8ce-34e7-44ba-ac5a-dcbf7fc21a8c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:10.058273 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7b0c8ce-34e7-44ba-ac5a-dcbf7fc21a8c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:10.059252 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7b0c8ce-34e7-44ba-ac5a-dcbf7fc21a8c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:10.059946 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7b0c8ce-34e7-44ba-ac5a-dcbf7fc21a8c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:10.060585 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7b0c8ce-34e7-44ba-ac5a-dcbf7fc21a8c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:10.101135 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5cbbc8b3-bc31-488b-bb15-bd19ed6e9211 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:10.102009 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5cbbc8b3-bc31-488b-bb15-bd19ed6e9211 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] [instance: f1ff920f-c104-42df-9947-28a80c5aa7e9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:10.127903 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5cbbc8b3-bc31-488b-bb15-bd19ed6e9211 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:10.130784 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5cbbc8b3-bc31-488b-bb15-bd19ed6e9211 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:10.131360 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5cbbc8b3-bc31-488b-bb15-bd19ed6e9211 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:10.132221 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5cbbc8b3-bc31-488b-bb15-bd19ed6e9211 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:10.134806 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5cbbc8b3-bc31-488b-bb15-bd19ed6e9211 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:10.135530 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5cbbc8b3-bc31-488b-bb15-bd19ed6e9211 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:10.182772 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5cbbc8b3-bc31-488b-bb15-bd19ed6e9211 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:10.183658 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5cbbc8b3-bc31-488b-bb15-bd19ed6e9211 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:10.184335 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5cbbc8b3-bc31-488b-bb15-bd19ed6e9211 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:10.185028 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-5cbbc8b3-bc31-488b-bb15-bd19ed6e9211 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lazy-loading 'fault' on Instance uuid f1ff920f-c104-42df-9947-28a80c5aa7e9 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:20:10.279754 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5cbbc8b3-bc31-488b-bb15-bd19ed6e9211 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff838eb6dca6457d8e734f1d8a1f9e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8c681153e44dd0a4ba2310d2bb0380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:10.291883 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5cbbc8b3-bc31-488b-bb15-bd19ed6e9211 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] 10.222.0.50 "GET /compute/v2.1/servers/f1ff920f-c104-42df-9947-28a80c5aa7e9" status: 200 len: 1307 microversion: 2.1 time: 0.196055 Aug 31 16:20:10.293049 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2920/5645] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:10 2022] GET /compute/v2.1/servers/f1ff920f-c104-42df-9947-28a80c5aa7e9 => generated 1307 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:10.849043 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e7b0c8ce-34e7-44ba-ac5a-dcbf7fc21a8c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:10.867574 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e7b0c8ce-34e7-44ba-ac5a-dcbf7fc21a8c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451" status: 200 len: 1694 microversion: 2.1 time: 0.833152 Aug 31 16:20:10.883471 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2726/5646] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:10 2022] GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451 => generated 1694 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:11.312815 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6f793a7b-783e-4879-b6b7-c301b55da452 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:11.314226 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6f793a7b-783e-4879-b6b7-c301b55da452 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] [instance: f1ff920f-c104-42df-9947-28a80c5aa7e9] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:11.321604 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f793a7b-783e-4879-b6b7-c301b55da452 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:11.322444 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f793a7b-783e-4879-b6b7-c301b55da452 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:11.323107 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f793a7b-783e-4879-b6b7-c301b55da452 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:11.324089 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f793a7b-783e-4879-b6b7-c301b55da452 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:11.324748 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f793a7b-783e-4879-b6b7-c301b55da452 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:11.325390 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f793a7b-783e-4879-b6b7-c301b55da452 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:11.356897 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-6f793a7b-783e-4879-b6b7-c301b55da452 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] HTTP exception thrown: Instance f1ff920f-c104-42df-9947-28a80c5aa7e9 could not be found. Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6f793a7b-783e-4879-b6b7-c301b55da452 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Request method failure captured: Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/f1ff920f-c104-42df-9947-28a80c5aa7e9 HTTP/1.1 Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4oeEyxYSYeLu2wamV6h8QIobZDNKjBJgt5oMiu3awOhqvmu2Q5UlMRYg9b-EBRMSc0knHPqINOIWlDq5gTortuSDURUeo-j-KEregzVbg88FAlQ-_twNedtMcUcobDXDVjbTr1WnW5V43db2CGV6RswA09geu78f7hId4OzV18LJec Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: db8c681153e44dd0a4ba2310d2bb0380 Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServerAddressesTestJSON-1489876315 Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/db8c681153e44dd0a4ba2310d2bb0380"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/db8c681153e44dd0a4ba2310d2bb0380"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/db8c681153e44dd0a4ba2310d2bb0380"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_db8c681153e44dd0a4ba2310d2bb0380", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServerAddressesTestJSON-1489876315 Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: db8c681153e44dd0a4ba2310d2bb0380 Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1489876315 Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServerAddressesTestJSON-1489876315-project Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: ff838eb6dca6457d8e734f1d8a1f9e37 Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServerAddressesTestJSON-1489876315-project Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance f1ff920f-c104-42df-9947-28a80c5aa7e9 could not be found. Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'f1ff920f-c104-42df-9947-28a80c5aa7e9'} Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1ff920f-c104-42df-9947-28a80c5aa7e9 could not be found. Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1ff920f-c104-42df-9947-28a80c5aa7e9 could not be found. Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:20:11.359135 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:20:11.363788 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:20:11.363788 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:20:11.363788 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:20:11.363788 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:20:11.363788 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:20:11.363788 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1ff920f-c104-42df-9947-28a80c5aa7e9 could not be found. Aug 31 16:20:11.363788 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:20:11.365273 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6f793a7b-783e-4879-b6b7-c301b55da452 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] Returning 404 to user: Instance f1ff920f-c104-42df-9947-28a80c5aa7e9 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:20:11.366310 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6f793a7b-783e-4879-b6b7-c301b55da452 tempest-ServerAddressesTestJSON-1489876315 tempest-ServerAddressesTestJSON-1489876315-project] 10.222.0.50 "GET /compute/v2.1/servers/f1ff920f-c104-42df-9947-28a80c5aa7e9" status: 404 len: 111 microversion: 2.1 time: 0.057379 Aug 31 16:20:11.367808 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2921/5647] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:11 2022] GET /compute/v2.1/servers/f1ff920f-c104-42df-9947-28a80c5aa7e9 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:20:11.634455 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-c080eb37-316e-423c-b251-5363f71d5934 req-fd39062b-a5c2-491a-9eea-a62743229411 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cdd332d-8fd9-4b10-bc9b-a90375e91451", "name": "network-vif-unplugged", "status": "completed", "tag": "13e49ea1-4330-43bd-abbb-39b92d47a423"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:20:11.664002 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c080eb37-316e-423c-b251-5363f71d5934 req-fd39062b-a5c2-491a-9eea-a62743229411 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:11.664772 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c080eb37-316e-423c-b251-5363f71d5934 req-fd39062b-a5c2-491a-9eea-a62743229411 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:11.665471 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c080eb37-316e-423c-b251-5363f71d5934 req-fd39062b-a5c2-491a-9eea-a62743229411 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:11.684399 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-c080eb37-316e-423c-b251-5363f71d5934 req-fd39062b-a5c2-491a-9eea-a62743229411 service nova] Creating event network-vif-unplugged:13e49ea1-4330-43bd-abbb-39b92d47a423 for instance 5cdd332d-8fd9-4b10-bc9b-a90375e91451 on n-h1-833090-16 Aug 31 16:20:11.697359 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-c080eb37-316e-423c-b251-5363f71d5934 req-fd39062b-a5c2-491a-9eea-a62743229411 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075572 Aug 31 16:20:11.699731 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2727/5648] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:20:11.889256 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-06c33d0d-01d9-468a-afee-7b9b0f5e4e34 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:11.890373 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-06c33d0d-01d9-468a-afee-7b9b0f5e4e34 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 5cdd332d-8fd9-4b10-bc9b-a90375e91451] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:11.910238 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06c33d0d-01d9-468a-afee-7b9b0f5e4e34 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:11.911107 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06c33d0d-01d9-468a-afee-7b9b0f5e4e34 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:11.911785 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06c33d0d-01d9-468a-afee-7b9b0f5e4e34 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:11.912729 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06c33d0d-01d9-468a-afee-7b9b0f5e4e34 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:11.913387 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06c33d0d-01d9-468a-afee-7b9b0f5e4e34 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:11.914012 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06c33d0d-01d9-468a-afee-7b9b0f5e4e34 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:12.462210 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-06c33d0d-01d9-468a-afee-7b9b0f5e4e34 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:12.477136 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-06c33d0d-01d9-468a-afee-7b9b0f5e4e34 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451" status: 200 len: 1694 microversion: 2.1 time: 0.591995 Aug 31 16:20:12.478019 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2922/5649] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:11 2022] GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451 => generated 1694 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:13.504662 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-64b4f349-e62c-422e-9dec-eafd67a71b12 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:13.506550 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-64b4f349-e62c-422e-9dec-eafd67a71b12 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 5cdd332d-8fd9-4b10-bc9b-a90375e91451] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:13.526418 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64b4f349-e62c-422e-9dec-eafd67a71b12 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:13.527200 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64b4f349-e62c-422e-9dec-eafd67a71b12 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:13.527882 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64b4f349-e62c-422e-9dec-eafd67a71b12 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:13.528887 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64b4f349-e62c-422e-9dec-eafd67a71b12 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:13.529496 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64b4f349-e62c-422e-9dec-eafd67a71b12 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:13.530075 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64b4f349-e62c-422e-9dec-eafd67a71b12 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:13.839946 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-9bfc6055-fc0c-419a-b9b6-ba8de1ca0506 req-15ec13e4-0824-420a-9b9a-54b9c0fba7b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cdd332d-8fd9-4b10-bc9b-a90375e91451", "tag": "13e49ea1-4330-43bd-abbb-39b92d47a423"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:20:13.870692 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-9bfc6055-fc0c-419a-b9b6-ba8de1ca0506 req-15ec13e4-0824-420a-9b9a-54b9c0fba7b0 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:13.871495 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-9bfc6055-fc0c-419a-b9b6-ba8de1ca0506 req-15ec13e4-0824-420a-9b9a-54b9c0fba7b0 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:13.871985 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-9bfc6055-fc0c-419a-b9b6-ba8de1ca0506 req-15ec13e4-0824-420a-9b9a-54b9c0fba7b0 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:13.907688 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-9bfc6055-fc0c-419a-b9b6-ba8de1ca0506 req-15ec13e4-0824-420a-9b9a-54b9c0fba7b0 service nova] Creating event network-changed:13e49ea1-4330-43bd-abbb-39b92d47a423 for instance 5cdd332d-8fd9-4b10-bc9b-a90375e91451 on n-h1-833090-16 Aug 31 16:20:13.924784 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-9bfc6055-fc0c-419a-b9b6-ba8de1ca0506 req-15ec13e4-0824-420a-9b9a-54b9c0fba7b0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089763 Aug 31 16:20:13.925954 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2923/5650] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:20:14.049066 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-64b4f349-e62c-422e-9dec-eafd67a71b12 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:14.057446 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-64b4f349-e62c-422e-9dec-eafd67a71b12 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451" status: 200 len: 1694 microversion: 2.1 time: 0.560830 Aug 31 16:20:14.058085 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2728/5651] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:13 2022] GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451 => generated 1694 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:15.087374 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e7011a90-2388-4c05-97fb-491a6584b06c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:15.089290 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e7011a90-2388-4c05-97fb-491a6584b06c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 5cdd332d-8fd9-4b10-bc9b-a90375e91451] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:15.099124 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7011a90-2388-4c05-97fb-491a6584b06c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:15.099973 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7011a90-2388-4c05-97fb-491a6584b06c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:15.100640 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7011a90-2388-4c05-97fb-491a6584b06c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:15.102747 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7011a90-2388-4c05-97fb-491a6584b06c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:15.103517 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7011a90-2388-4c05-97fb-491a6584b06c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:15.104580 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7011a90-2388-4c05-97fb-491a6584b06c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:15.794796 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e7011a90-2388-4c05-97fb-491a6584b06c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:15.806410 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e7011a90-2388-4c05-97fb-491a6584b06c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451" status: 200 len: 1694 microversion: 2.1 time: 0.729360 Aug 31 16:20:15.807246 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2924/5652] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:15 2022] GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451 => generated 1694 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:16.830793 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4a6dd814-cac1-4faf-a013-bcb2712e988d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:16.832054 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4a6dd814-cac1-4faf-a013-bcb2712e988d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 5cdd332d-8fd9-4b10-bc9b-a90375e91451] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:16.850116 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a6dd814-cac1-4faf-a013-bcb2712e988d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:16.854583 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a6dd814-cac1-4faf-a013-bcb2712e988d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:16.855380 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a6dd814-cac1-4faf-a013-bcb2712e988d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:16.856287 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a6dd814-cac1-4faf-a013-bcb2712e988d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:16.856767 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a6dd814-cac1-4faf-a013-bcb2712e988d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:16.857199 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a6dd814-cac1-4faf-a013-bcb2712e988d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:17.466399 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4a6dd814-cac1-4faf-a013-bcb2712e988d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:17.477831 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4a6dd814-cac1-4faf-a013-bcb2712e988d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451" status: 200 len: 1694 microversion: 2.1 time: 0.651081 Aug 31 16:20:17.479307 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2729/5653] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:16 2022] GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451 => generated 1694 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:18.501266 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-725da30e-6c12-4b9b-b33f-f6b24db65e50 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:18.502224 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-725da30e-6c12-4b9b-b33f-f6b24db65e50 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 5cdd332d-8fd9-4b10-bc9b-a90375e91451] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:18.517155 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-725da30e-6c12-4b9b-b33f-f6b24db65e50 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:18.519053 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-725da30e-6c12-4b9b-b33f-f6b24db65e50 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:18.519696 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-725da30e-6c12-4b9b-b33f-f6b24db65e50 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:18.520449 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-725da30e-6c12-4b9b-b33f-f6b24db65e50 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:18.520906 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-725da30e-6c12-4b9b-b33f-f6b24db65e50 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:18.521327 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-725da30e-6c12-4b9b-b33f-f6b24db65e50 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:19.152029 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-725da30e-6c12-4b9b-b33f-f6b24db65e50 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:19.163261 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:20:19.224786 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-725da30e-6c12-4b9b-b33f-f6b24db65e50 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451" status: 200 len: 1694 microversion: 2.1 time: 0.725101 Aug 31 16:20:19.231167 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2925/5654] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:18 2022] GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451 => generated 1694 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:20.265916 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b438aaca-80a7-43fe-b7f0-4b7b6a48a946 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:20.268074 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b438aaca-80a7-43fe-b7f0-4b7b6a48a946 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 5cdd332d-8fd9-4b10-bc9b-a90375e91451] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:20.280556 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b438aaca-80a7-43fe-b7f0-4b7b6a48a946 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:20.281039 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b438aaca-80a7-43fe-b7f0-4b7b6a48a946 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:20.281461 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b438aaca-80a7-43fe-b7f0-4b7b6a48a946 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:20.282178 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b438aaca-80a7-43fe-b7f0-4b7b6a48a946 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:20.287323 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b438aaca-80a7-43fe-b7f0-4b7b6a48a946 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:20.289114 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b438aaca-80a7-43fe-b7f0-4b7b6a48a946 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:20.754123 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b438aaca-80a7-43fe-b7f0-4b7b6a48a946 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:20.765617 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b438aaca-80a7-43fe-b7f0-4b7b6a48a946 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451" status: 200 len: 1694 microversion: 2.1 time: 0.505275 Aug 31 16:20:20.767349 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2730/5655] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:20 2022] GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451 => generated 1694 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:21.788955 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0b37584c-b2e7-4ff9-a16c-548d48f1e047 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:21.790692 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0b37584c-b2e7-4ff9-a16c-548d48f1e047 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 5cdd332d-8fd9-4b10-bc9b-a90375e91451] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:21.801018 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0b37584c-b2e7-4ff9-a16c-548d48f1e047 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:21.801777 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0b37584c-b2e7-4ff9-a16c-548d48f1e047 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:21.802491 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0b37584c-b2e7-4ff9-a16c-548d48f1e047 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:21.803597 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0b37584c-b2e7-4ff9-a16c-548d48f1e047 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:21.804369 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0b37584c-b2e7-4ff9-a16c-548d48f1e047 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:21.804939 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0b37584c-b2e7-4ff9-a16c-548d48f1e047 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:22.068832 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0b37584c-b2e7-4ff9-a16c-548d48f1e047 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:22.092207 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0b37584c-b2e7-4ff9-a16c-548d48f1e047 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451" status: 200 len: 1694 microversion: 2.1 time: 0.307747 Aug 31 16:20:22.094138 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2926/5656] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:21 2022] GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451 => generated 1694 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:23.116347 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1938492c-9b79-4d97-aefc-982e96d2bb42 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:23.117530 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1938492c-9b79-4d97-aefc-982e96d2bb42 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 5cdd332d-8fd9-4b10-bc9b-a90375e91451] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:23.150743 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1938492c-9b79-4d97-aefc-982e96d2bb42 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:23.151816 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1938492c-9b79-4d97-aefc-982e96d2bb42 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:23.155668 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1938492c-9b79-4d97-aefc-982e96d2bb42 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:23.156428 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1938492c-9b79-4d97-aefc-982e96d2bb42 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:23.156986 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1938492c-9b79-4d97-aefc-982e96d2bb42 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:23.159655 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1938492c-9b79-4d97-aefc-982e96d2bb42 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:23.529289 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1938492c-9b79-4d97-aefc-982e96d2bb42 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:23.544044 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1938492c-9b79-4d97-aefc-982e96d2bb42 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451" status: 200 len: 1694 microversion: 2.1 time: 0.433566 Aug 31 16:20:23.545044 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2731/5657] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:23 2022] GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451 => generated 1694 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:24.571963 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8d74545b-c694-4bb0-8f24-7899e04020ba tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:24.573988 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8d74545b-c694-4bb0-8f24-7899e04020ba tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 5cdd332d-8fd9-4b10-bc9b-a90375e91451] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:24.591678 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8d74545b-c694-4bb0-8f24-7899e04020ba tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:24.592182 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8d74545b-c694-4bb0-8f24-7899e04020ba tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:24.592801 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8d74545b-c694-4bb0-8f24-7899e04020ba tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:24.594574 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8d74545b-c694-4bb0-8f24-7899e04020ba tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:24.595245 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8d74545b-c694-4bb0-8f24-7899e04020ba tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:24.595910 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8d74545b-c694-4bb0-8f24-7899e04020ba tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:25.622667 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8d74545b-c694-4bb0-8f24-7899e04020ba tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:25.638733 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8d74545b-c694-4bb0-8f24-7899e04020ba tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451" status: 200 len: 1694 microversion: 2.1 time: 1.071046 Aug 31 16:20:25.639395 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2927/5658] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:24 2022] GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451 => generated 1694 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:26.666254 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9d3cd4ad-63ee-41bd-978b-5038da2141b0 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:26.667125 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9d3cd4ad-63ee-41bd-978b-5038da2141b0 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 5cdd332d-8fd9-4b10-bc9b-a90375e91451] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:26.677620 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d3cd4ad-63ee-41bd-978b-5038da2141b0 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:26.678610 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d3cd4ad-63ee-41bd-978b-5038da2141b0 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:26.679387 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d3cd4ad-63ee-41bd-978b-5038da2141b0 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:26.680846 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d3cd4ad-63ee-41bd-978b-5038da2141b0 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:26.711244 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d3cd4ad-63ee-41bd-978b-5038da2141b0 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:26.716077 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d3cd4ad-63ee-41bd-978b-5038da2141b0 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:27.384880 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9d3cd4ad-63ee-41bd-978b-5038da2141b0 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:27.396792 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9d3cd4ad-63ee-41bd-978b-5038da2141b0 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451" status: 200 len: 1694 microversion: 2.1 time: 0.736371 Aug 31 16:20:27.397395 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2732/5659] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:26 2022] GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451 => generated 1694 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:28.424439 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-11dc565b-7355-43fa-8a2d-ccef63965c1b tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:28.425573 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-11dc565b-7355-43fa-8a2d-ccef63965c1b tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 5cdd332d-8fd9-4b10-bc9b-a90375e91451] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:28.448675 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11dc565b-7355-43fa-8a2d-ccef63965c1b tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:28.459567 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11dc565b-7355-43fa-8a2d-ccef63965c1b tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:28.460342 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11dc565b-7355-43fa-8a2d-ccef63965c1b tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:28.465342 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11dc565b-7355-43fa-8a2d-ccef63965c1b tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:28.465342 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11dc565b-7355-43fa-8a2d-ccef63965c1b tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:28.465663 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11dc565b-7355-43fa-8a2d-ccef63965c1b tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:28.802682 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-11dc565b-7355-43fa-8a2d-ccef63965c1b tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:28.811883 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-11dc565b-7355-43fa-8a2d-ccef63965c1b tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451" status: 200 len: 1684 microversion: 2.1 time: 0.393161 Aug 31 16:20:28.813817 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2928/5660] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:28 2022] GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451 => generated 1684 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:28.848826 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8414c558-f79d-46f5-a58a-1dbff9167797 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:28.850336 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8414c558-f79d-46f5-a58a-1dbff9167797 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] [instance: 5cdd332d-8fd9-4b10-bc9b-a90375e91451] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:28.858525 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8414c558-f79d-46f5-a58a-1dbff9167797 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:28.859417 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8414c558-f79d-46f5-a58a-1dbff9167797 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:28.860113 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8414c558-f79d-46f5-a58a-1dbff9167797 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:28.862003 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8414c558-f79d-46f5-a58a-1dbff9167797 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:28.862754 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8414c558-f79d-46f5-a58a-1dbff9167797 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:28.863424 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8414c558-f79d-46f5-a58a-1dbff9167797 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:29.257585 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8414c558-f79d-46f5-a58a-1dbff9167797 tempest-TestNetworkAdvancedServerOps-167010875 tempest-TestNetworkAdvancedServerOps-167010875-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451" status: 200 len: 1837 microversion: 2.1 time: 0.413474 Aug 31 16:20:29.258149 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2733/5661] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:28 2022] GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451 => generated 1837 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:29.287706 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4ca7256c-10cf-44aa-8bc6-363ffe5ad291 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:29.288331 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4ca7256c-10cf-44aa-8bc6-363ffe5ad291 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 5cdd332d-8fd9-4b10-bc9b-a90375e91451] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:29.296755 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4ca7256c-10cf-44aa-8bc6-363ffe5ad291 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:29.304254 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4ca7256c-10cf-44aa-8bc6-363ffe5ad291 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:29.304633 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4ca7256c-10cf-44aa-8bc6-363ffe5ad291 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:29.305457 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4ca7256c-10cf-44aa-8bc6-363ffe5ad291 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:29.305824 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4ca7256c-10cf-44aa-8bc6-363ffe5ad291 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:29.306295 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4ca7256c-10cf-44aa-8bc6-363ffe5ad291 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:29.766667 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4ca7256c-10cf-44aa-8bc6-363ffe5ad291 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:29.780906 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4ca7256c-10cf-44aa-8bc6-363ffe5ad291 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451" status: 200 len: 1684 microversion: 2.1 time: 0.498915 Aug 31 16:20:29.781518 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2929/5662] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:29 2022] GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451 => generated 1684 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:30.044651 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8143d3c3-80bb-4e7f-b3de-27ce4c09b5b7 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:20:30.049246 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8143d3c3-80bb-4e7f-b3de-27ce4c09b5b7 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 5cdd332d-8fd9-4b10-bc9b-a90375e91451] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:30.063704 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8143d3c3-80bb-4e7f-b3de-27ce4c09b5b7 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:30.074890 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8143d3c3-80bb-4e7f-b3de-27ce4c09b5b7 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:30.075457 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8143d3c3-80bb-4e7f-b3de-27ce4c09b5b7 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:30.076934 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8143d3c3-80bb-4e7f-b3de-27ce4c09b5b7 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:30.078164 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8143d3c3-80bb-4e7f-b3de-27ce4c09b5b7 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:30.078783 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8143d3c3-80bb-4e7f-b3de-27ce4c09b5b7 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:30.203311 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8143d3c3-80bb-4e7f-b3de-27ce4c09b5b7 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "POST /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451/action" status: 200 len: 38606 microversion: 2.1 time: 0.164556 Aug 31 16:20:30.204119 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2734/5663] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:20:30 2022] POST /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451/action => generated 38606 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:20:33.684966 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f3a5482a-6671-4db3-9c70-f605d35b0e7e tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:33.685596 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f3a5482a-6671-4db3-9c70-f605d35b0e7e tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 5cdd332d-8fd9-4b10-bc9b-a90375e91451] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:33.714075 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f3a5482a-6671-4db3-9c70-f605d35b0e7e tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:33.715428 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f3a5482a-6671-4db3-9c70-f605d35b0e7e tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:33.717167 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f3a5482a-6671-4db3-9c70-f605d35b0e7e tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:33.718499 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f3a5482a-6671-4db3-9c70-f605d35b0e7e tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:33.723143 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f3a5482a-6671-4db3-9c70-f605d35b0e7e tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:33.724416 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f3a5482a-6671-4db3-9c70-f605d35b0e7e tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:33.803443 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f3a5482a-6671-4db3-9c70-f605d35b0e7e tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 5cdd332d-8fd9-4b10-bc9b-a90375e91451] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:20:34.027920 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-3f14014c-01a3-4c4f-87fd-876ab9217f55 req-fc3e4090-475c-49f3-84c1-33ffb56df4e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cdd332d-8fd9-4b10-bc9b-a90375e91451", "tag": "13e49ea1-4330-43bd-abbb-39b92d47a423"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:20:34.049108 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f3a5482a-6671-4db3-9c70-f605d35b0e7e tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451" status: 204 len: 0 microversion: 2.1 time: 0.368546 Aug 31 16:20:34.050194 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2930/5664] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:20:33 2022] DELETE /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:20:34.060083 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3f14014c-01a3-4c4f-87fd-876ab9217f55 req-fc3e4090-475c-49f3-84c1-33ffb56df4e8 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:34.063563 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3f14014c-01a3-4c4f-87fd-876ab9217f55 req-fc3e4090-475c-49f3-84c1-33ffb56df4e8 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:34.065467 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3f14014c-01a3-4c4f-87fd-876ab9217f55 req-fc3e4090-475c-49f3-84c1-33ffb56df4e8 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:34.096551 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:20:34.102270 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-3f14014c-01a3-4c4f-87fd-876ab9217f55 req-fc3e4090-475c-49f3-84c1-33ffb56df4e8 service nova] Creating event network-changed:13e49ea1-4330-43bd-abbb-39b92d47a423 for instance 5cdd332d-8fd9-4b10-bc9b-a90375e91451 on n-h2-833090-16 Aug 31 16:20:34.119823 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-3f14014c-01a3-4c4f-87fd-876ab9217f55 req-fc3e4090-475c-49f3-84c1-33ffb56df4e8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.436776 Aug 31 16:20:34.120849 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2735/5665] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:20:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:20:34.145735 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-411fe65d-e696-4e04-8451-786caf51ea5c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:34.146751 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-411fe65d-e696-4e04-8451-786caf51ea5c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 5cdd332d-8fd9-4b10-bc9b-a90375e91451] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:34.162354 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c216ec10-aeed-4de3-9566-483093cab709 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-151133352", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "44a8db04-7abc-403c-b429-2e8bf0421632"}]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:20:34.165906 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-411fe65d-e696-4e04-8451-786caf51ea5c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:34.166544 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-411fe65d-e696-4e04-8451-786caf51ea5c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:34.167558 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-411fe65d-e696-4e04-8451-786caf51ea5c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:34.168774 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-411fe65d-e696-4e04-8451-786caf51ea5c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:34.169459 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-411fe65d-e696-4e04-8451-786caf51ea5c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:34.170351 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-411fe65d-e696-4e04-8451-786caf51ea5c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:34.288329 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-c216ec10-aeed-4de3-9566-483093cab709 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] validate_networks() for [('44a8db04-7abc-403c-b429-2e8bf0421632', None, None, None, None, None)] {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:20:34.660799 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-411fe65d-e696-4e04-8451-786caf51ea5c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:34.673053 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-411fe65d-e696-4e04-8451-786caf51ea5c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451" status: 200 len: 1690 microversion: 2.1 time: 0.550795 Aug 31 16:20:34.673688 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2736/5666] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:34 2022] GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451 => generated 1690 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:35.180425 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-c216ec10-aeed-4de3-9566-483093cab709 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:20:35.182854 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-c216ec10-aeed-4de3-9566-483093cab709 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:20:35.187981 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-c216ec10-aeed-4de3-9566-483093cab709 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:20:35.187981 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-c216ec10-aeed-4de3-9566-483093cab709 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:20:35.187981 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-c216ec10-aeed-4de3-9566-483093cab709 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:20:35.227070 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:20:35.272133 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c216ec10-aeed-4de3-9566-483093cab709 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:35.272922 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c216ec10-aeed-4de3-9566-483093cab709 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:35.273549 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c216ec10-aeed-4de3-9566-483093cab709 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:35.274527 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c216ec10-aeed-4de3-9566-483093cab709 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:35.275368 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c216ec10-aeed-4de3-9566-483093cab709 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:35.276114 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c216ec10-aeed-4de3-9566-483093cab709 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:35.317687 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-c216ec10-aeed-4de3-9566-483093cab709 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Getting quotas for project d8252667102f472785e65751b4746e7a. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:20:35.325860 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-c216ec10-aeed-4de3-9566-483093cab709 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Getting quotas for user 074a3eaa77164f5e9e51e85c1c7e221b and project d8252667102f472785e65751b4746e7a. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:20:35.357478 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c216ec10-aeed-4de3-9566-483093cab709 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:20:35.364120 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c216ec10-aeed-4de3-9566-483093cab709 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] [instance: a08087d3-94a0-44db-b92b-d3dbaf67d471] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:20:35.561092 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c216ec10-aeed-4de3-9566-483093cab709 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.500317 Aug 31 16:20:35.562228 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2931/5667] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:20:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1511 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:20:35.575722 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-603e185a-729e-4bda-a236-0306f5d0b5f9 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:35.576657 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-603e185a-729e-4bda-a236-0306f5d0b5f9 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] [instance: a08087d3-94a0-44db-b92b-d3dbaf67d471] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:35.705369 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-603e185a-729e-4bda-a236-0306f5d0b5f9 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074a3eaa77164f5e9e51e85c1c7e221b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8252667102f472785e65751b4746e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:35.706020 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-01aedbde-554c-404e-aebb-9987eec1f7d0 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:35.708292 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-01aedbde-554c-404e-aebb-9987eec1f7d0 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 5cdd332d-8fd9-4b10-bc9b-a90375e91451] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:35.716861 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-603e185a-729e-4bda-a236-0306f5d0b5f9 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] 10.222.0.50 "GET /compute/v2.1/servers/a08087d3-94a0-44db-b92b-d3dbaf67d471" status: 200 len: 1224 microversion: 2.1 time: 0.145386 Aug 31 16:20:35.720030 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2737/5668] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:35 2022] GET /compute/v2.1/servers/a08087d3-94a0-44db-b92b-d3dbaf67d471 => generated 1224 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:35.731520 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01aedbde-554c-404e-aebb-9987eec1f7d0 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:35.732610 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01aedbde-554c-404e-aebb-9987eec1f7d0 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:35.736983 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01aedbde-554c-404e-aebb-9987eec1f7d0 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:35.741642 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01aedbde-554c-404e-aebb-9987eec1f7d0 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:35.745102 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01aedbde-554c-404e-aebb-9987eec1f7d0 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:35.745290 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01aedbde-554c-404e-aebb-9987eec1f7d0 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:36.306979 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-01aedbde-554c-404e-aebb-9987eec1f7d0 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:36.336780 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-01aedbde-554c-404e-aebb-9987eec1f7d0 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451" status: 200 len: 1690 microversion: 2.1 time: 0.637590 Aug 31 16:20:36.357082 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2932/5669] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:35 2022] GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451 => generated 1690 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:36.738857 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-772a46c5-2fe5-4e35-85a1-2d1a5b1e7fe8 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:36.739480 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-772a46c5-2fe5-4e35-85a1-2d1a5b1e7fe8 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] [instance: a08087d3-94a0-44db-b92b-d3dbaf67d471] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:36.912928 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-772a46c5-2fe5-4e35-85a1-2d1a5b1e7fe8 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074a3eaa77164f5e9e51e85c1c7e221b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8252667102f472785e65751b4746e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:36.921319 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-772a46c5-2fe5-4e35-85a1-2d1a5b1e7fe8 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] 10.222.0.50 "GET /compute/v2.1/servers/a08087d3-94a0-44db-b92b-d3dbaf67d471" status: 200 len: 1224 microversion: 2.1 time: 0.186520 Aug 31 16:20:36.929570 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2738/5670] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:36 2022] GET /compute/v2.1/servers/a08087d3-94a0-44db-b92b-d3dbaf67d471 => generated 1224 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:37.363397 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2a25c829-6941-454a-8e52-3992c0e653e3 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:37.364080 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2a25c829-6941-454a-8e52-3992c0e653e3 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 5cdd332d-8fd9-4b10-bc9b-a90375e91451] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:37.379598 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2a25c829-6941-454a-8e52-3992c0e653e3 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:37.380103 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2a25c829-6941-454a-8e52-3992c0e653e3 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:37.380546 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2a25c829-6941-454a-8e52-3992c0e653e3 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:37.381264 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2a25c829-6941-454a-8e52-3992c0e653e3 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:37.381720 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2a25c829-6941-454a-8e52-3992c0e653e3 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:37.382185 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2a25c829-6941-454a-8e52-3992c0e653e3 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:37.420993 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-aa30b7d6-ea82-45c4-a941-50848fc66a0f req-f26b4a2c-f22a-42a6-915c-5bde197c932b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cdd332d-8fd9-4b10-bc9b-a90375e91451", "name": "network-vif-deleted", "tag": "13e49ea1-4330-43bd-abbb-39b92d47a423"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:20:37.462457 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-aa30b7d6-ea82-45c4-a941-50848fc66a0f req-f26b4a2c-f22a-42a6-915c-5bde197c932b service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:37.469811 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-aa30b7d6-ea82-45c4-a941-50848fc66a0f req-f26b4a2c-f22a-42a6-915c-5bde197c932b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:37.472034 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-aa30b7d6-ea82-45c4-a941-50848fc66a0f req-f26b4a2c-f22a-42a6-915c-5bde197c932b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:37.528745 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-aa30b7d6-ea82-45c4-a941-50848fc66a0f req-f26b4a2c-f22a-42a6-915c-5bde197c932b service nova] Creating event network-vif-deleted:13e49ea1-4330-43bd-abbb-39b92d47a423 for instance 5cdd332d-8fd9-4b10-bc9b-a90375e91451 on n-h2-833090-16 Aug 31 16:20:37.548382 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-aa30b7d6-ea82-45c4-a941-50848fc66a0f req-f26b4a2c-f22a-42a6-915c-5bde197c932b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130869 Aug 31 16:20:37.549327 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2739/5671] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:20:37.955148 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9206a7eb-c897-447d-b002-645a6170b2a5 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:37.956069 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9206a7eb-c897-447d-b002-645a6170b2a5 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] [instance: a08087d3-94a0-44db-b92b-d3dbaf67d471] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:37.987183 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9206a7eb-c897-447d-b002-645a6170b2a5 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:37.990484 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9206a7eb-c897-447d-b002-645a6170b2a5 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:37.991289 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9206a7eb-c897-447d-b002-645a6170b2a5 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:37.993564 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9206a7eb-c897-447d-b002-645a6170b2a5 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:37.999747 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9206a7eb-c897-447d-b002-645a6170b2a5 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:38.003352 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9206a7eb-c897-447d-b002-645a6170b2a5 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:38.339252 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9206a7eb-c897-447d-b002-645a6170b2a5 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074a3eaa77164f5e9e51e85c1c7e221b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8252667102f472785e65751b4746e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:38.347148 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2a25c829-6941-454a-8e52-3992c0e653e3 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:38.354279 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9206a7eb-c897-447d-b002-645a6170b2a5 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] 10.222.0.50 "GET /compute/v2.1/servers/a08087d3-94a0-44db-b92b-d3dbaf67d471" status: 200 len: 1284 microversion: 2.1 time: 0.414410 Aug 31 16:20:38.358874 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2740/5672] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:37 2022] GET /compute/v2.1/servers/a08087d3-94a0-44db-b92b-d3dbaf67d471 => generated 1284 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:20:38.362190 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2a25c829-6941-454a-8e52-3992c0e653e3 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451" status: 200 len: 1503 microversion: 2.1 time: 1.003083 Aug 31 16:20:38.363087 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2933/5673] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:37 2022] GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451 => generated 1503 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:39.393402 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c73e63f6-2d58-411c-8673-f4c640b7a7ca tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:39.395139 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c73e63f6-2d58-411c-8673-f4c640b7a7ca tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 5cdd332d-8fd9-4b10-bc9b-a90375e91451] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:39.407117 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5d0d41c1-cede-4b0d-908e-7e8798f3ef29 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:39.407754 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5d0d41c1-cede-4b0d-908e-7e8798f3ef29 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] [instance: a08087d3-94a0-44db-b92b-d3dbaf67d471] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:39.416889 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5d0d41c1-cede-4b0d-908e-7e8798f3ef29 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:39.417371 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5d0d41c1-cede-4b0d-908e-7e8798f3ef29 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:39.417805 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5d0d41c1-cede-4b0d-908e-7e8798f3ef29 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:39.418534 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c73e63f6-2d58-411c-8673-f4c640b7a7ca tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:39.419338 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c73e63f6-2d58-411c-8673-f4c640b7a7ca tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:39.429469 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5d0d41c1-cede-4b0d-908e-7e8798f3ef29 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:39.429671 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5d0d41c1-cede-4b0d-908e-7e8798f3ef29 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:39.430751 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5d0d41c1-cede-4b0d-908e-7e8798f3ef29 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:39.453934 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c73e63f6-2d58-411c-8673-f4c640b7a7ca tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:39.455657 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c73e63f6-2d58-411c-8673-f4c640b7a7ca tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:39.456721 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c73e63f6-2d58-411c-8673-f4c640b7a7ca tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:39.460292 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c73e63f6-2d58-411c-8673-f4c640b7a7ca tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:39.542614 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-c73e63f6-2d58-411c-8673-f4c640b7a7ca tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] HTTP exception thrown: Instance 5cdd332d-8fd9-4b10-bc9b-a90375e91451 could not be found. Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c73e63f6-2d58-411c-8673-f4c640b7a7ca tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Request method failure captured: Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451 HTTP/1.1 Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4fV98oVosqGT7VWC4t0BtAiBiZATLbXebs7dwZ2GTRmxWIxlWpcykql1rc4XcH6S5iXxbfnhW9zu0xtlzwQXV8xqLhjj_kkcwN0JMTiH3_0LSsRjsreTCqRz_N8Dc-RwStRrYjFigQ-KrUSCoxe4mvwPpJjWkSJo0qe7m_-bm95Maw Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 3397e8a2a042486eb323432c47dfd392 Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-316597183 Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3397e8a2a042486eb323432c47dfd392"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3397e8a2a042486eb323432c47dfd392"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3397e8a2a042486eb323432c47dfd392"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3397e8a2a042486eb323432c47dfd392", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-TestNetworkAdvancedServerOps-316597183 Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 3397e8a2a042486eb323432c47dfd392 Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-316597183 Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-TestNetworkAdvancedServerOps-316597183-project Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 87f8241df6664aa59ba669d733e53871 Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-TestNetworkAdvancedServerOps-316597183-project Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 5cdd332d-8fd9-4b10-bc9b-a90375e91451 could not be found. Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '5cdd332d-8fd9-4b10-bc9b-a90375e91451'} Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cdd332d-8fd9-4b10-bc9b-a90375e91451 could not be found. Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cdd332d-8fd9-4b10-bc9b-a90375e91451 could not be found. Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:20:39.545062 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:20:39.549470 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:20:39.549470 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:20:39.549470 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:20:39.549470 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:20:39.549470 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:20:39.549470 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:20:39.549470 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cdd332d-8fd9-4b10-bc9b-a90375e91451 could not be found. Aug 31 16:20:39.549470 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:20:39.552858 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c73e63f6-2d58-411c-8673-f4c640b7a7ca tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Returning 404 to user: Instance 5cdd332d-8fd9-4b10-bc9b-a90375e91451 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:20:39.553748 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c73e63f6-2d58-411c-8673-f4c640b7a7ca tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451" status: 404 len: 111 microversion: 2.1 time: 0.164761 Aug 31 16:20:39.554375 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2741/5674] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:39 2022] GET /compute/v2.1/servers/5cdd332d-8fd9-4b10-bc9b-a90375e91451 => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:20:39.749402 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5d0d41c1-cede-4b0d-908e-7e8798f3ef29 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074a3eaa77164f5e9e51e85c1c7e221b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8252667102f472785e65751b4746e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:39.769120 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5d0d41c1-cede-4b0d-908e-7e8798f3ef29 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] 10.222.0.50 "GET /compute/v2.1/servers/a08087d3-94a0-44db-b92b-d3dbaf67d471" status: 200 len: 1282 microversion: 2.1 time: 0.366077 Aug 31 16:20:39.769890 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2934/5675] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:39 2022] GET /compute/v2.1/servers/a08087d3-94a0-44db-b92b-d3dbaf67d471 => generated 1282 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:20:40.793985 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a5004304-ba18-4d49-b402-7ebe73b48b5b tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:40.795418 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a5004304-ba18-4d49-b402-7ebe73b48b5b tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] [instance: a08087d3-94a0-44db-b92b-d3dbaf67d471] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:40.813082 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=36 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:20:40.817067 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5004304-ba18-4d49-b402-7ebe73b48b5b tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:40.821798 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5004304-ba18-4d49-b402-7ebe73b48b5b tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:40.821798 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5004304-ba18-4d49-b402-7ebe73b48b5b tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:40.822575 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5004304-ba18-4d49-b402-7ebe73b48b5b tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:40.823439 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5004304-ba18-4d49-b402-7ebe73b48b5b tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:40.825237 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5004304-ba18-4d49-b402-7ebe73b48b5b tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:41.594736 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a5004304-ba18-4d49-b402-7ebe73b48b5b tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074a3eaa77164f5e9e51e85c1c7e221b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8252667102f472785e65751b4746e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:41.639424 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a5004304-ba18-4d49-b402-7ebe73b48b5b tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] 10.222.0.50 "GET /compute/v2.1/servers/a08087d3-94a0-44db-b92b-d3dbaf67d471" status: 200 len: 1324 microversion: 2.1 time: 0.849939 Aug 31 16:20:41.650216 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2742/5676] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:40 2022] GET /compute/v2.1/servers/a08087d3-94a0-44db-b92b-d3dbaf67d471 => generated 1324 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:42.675624 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1552f231-f152-4921-aa05-d8b5c933cc1d tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:42.677224 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1552f231-f152-4921-aa05-d8b5c933cc1d tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] [instance: a08087d3-94a0-44db-b92b-d3dbaf67d471] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:42.695797 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1552f231-f152-4921-aa05-d8b5c933cc1d tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:42.696847 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1552f231-f152-4921-aa05-d8b5c933cc1d tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:42.697398 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1552f231-f152-4921-aa05-d8b5c933cc1d tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:42.700274 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1552f231-f152-4921-aa05-d8b5c933cc1d tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:42.708528 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1552f231-f152-4921-aa05-d8b5c933cc1d tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:42.709474 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1552f231-f152-4921-aa05-d8b5c933cc1d tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:43.100396 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1552f231-f152-4921-aa05-d8b5c933cc1d tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074a3eaa77164f5e9e51e85c1c7e221b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8252667102f472785e65751b4746e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:43.110675 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1552f231-f152-4921-aa05-d8b5c933cc1d tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] 10.222.0.50 "GET /compute/v2.1/servers/a08087d3-94a0-44db-b92b-d3dbaf67d471" status: 200 len: 1324 microversion: 2.1 time: 0.440747 Aug 31 16:20:43.113213 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2935/5677] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:42 2022] GET /compute/v2.1/servers/a08087d3-94a0-44db-b92b-d3dbaf67d471 => generated 1324 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:43.782624 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-94de19af-417d-44be-8bd9-cc16ef673a80 req-f1ee1651-0b61-440d-8f8b-af6f72ca3976 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a08087d3-94a0-44db-b92b-d3dbaf67d471", "tag": "7e6c742a-e7ff-44d7-8758-006e9062d76f"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:20:43.798744 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-94de19af-417d-44be-8bd9-cc16ef673a80 req-f1ee1651-0b61-440d-8f8b-af6f72ca3976 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:43.799149 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-94de19af-417d-44be-8bd9-cc16ef673a80 req-f1ee1651-0b61-440d-8f8b-af6f72ca3976 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:43.799669 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-94de19af-417d-44be-8bd9-cc16ef673a80 req-f1ee1651-0b61-440d-8f8b-af6f72ca3976 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:43.837633 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-94de19af-417d-44be-8bd9-cc16ef673a80 req-f1ee1651-0b61-440d-8f8b-af6f72ca3976 service nova] Creating event network-changed:7e6c742a-e7ff-44d7-8758-006e9062d76f for instance a08087d3-94a0-44db-b92b-d3dbaf67d471 on n-h1-833090-16 Aug 31 16:20:43.849105 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-94de19af-417d-44be-8bd9-cc16ef673a80 req-f1ee1651-0b61-440d-8f8b-af6f72ca3976 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070482 Aug 31 16:20:43.850027 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2743/5678] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:20:44.137739 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e595b903-3a04-4546-a092-c86907ecba81 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:44.141930 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e595b903-3a04-4546-a092-c86907ecba81 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] [instance: a08087d3-94a0-44db-b92b-d3dbaf67d471] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:44.164845 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e595b903-3a04-4546-a092-c86907ecba81 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:44.169651 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e595b903-3a04-4546-a092-c86907ecba81 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:44.173375 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e595b903-3a04-4546-a092-c86907ecba81 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:44.178812 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e595b903-3a04-4546-a092-c86907ecba81 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:44.179968 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e595b903-3a04-4546-a092-c86907ecba81 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:44.180994 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e595b903-3a04-4546-a092-c86907ecba81 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:44.674370 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e595b903-3a04-4546-a092-c86907ecba81 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074a3eaa77164f5e9e51e85c1c7e221b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8252667102f472785e65751b4746e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:44.684145 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e595b903-3a04-4546-a092-c86907ecba81 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] 10.222.0.50 "GET /compute/v2.1/servers/a08087d3-94a0-44db-b92b-d3dbaf67d471" status: 200 len: 1324 microversion: 2.1 time: 0.553717 Aug 31 16:20:44.688069 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2936/5679] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:44 2022] GET /compute/v2.1/servers/a08087d3-94a0-44db-b92b-d3dbaf67d471 => generated 1324 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:45.724924 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-94d7dc44-0cf7-493f-aaa1-f6073d9acdcf tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:45.725838 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-94d7dc44-0cf7-493f-aaa1-f6073d9acdcf tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] [instance: a08087d3-94a0-44db-b92b-d3dbaf67d471] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:45.747396 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-94d7dc44-0cf7-493f-aaa1-f6073d9acdcf tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:45.748145 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-94d7dc44-0cf7-493f-aaa1-f6073d9acdcf tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:45.748873 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-94d7dc44-0cf7-493f-aaa1-f6073d9acdcf tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:45.749579 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-94d7dc44-0cf7-493f-aaa1-f6073d9acdcf tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:45.750399 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-94d7dc44-0cf7-493f-aaa1-f6073d9acdcf tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:45.751021 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-94d7dc44-0cf7-493f-aaa1-f6073d9acdcf tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:46.657842 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-94d7dc44-0cf7-493f-aaa1-f6073d9acdcf tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074a3eaa77164f5e9e51e85c1c7e221b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8252667102f472785e65751b4746e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:46.680073 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-94d7dc44-0cf7-493f-aaa1-f6073d9acdcf tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] 10.222.0.50 "GET /compute/v2.1/servers/a08087d3-94a0-44db-b92b-d3dbaf67d471" status: 200 len: 1324 microversion: 2.1 time: 0.959151 Aug 31 16:20:46.698303 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2744/5680] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:45 2022] GET /compute/v2.1/servers/a08087d3-94a0-44db-b92b-d3dbaf67d471 => generated 1324 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:47.707269 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a63d2ffe-ed0f-444d-9b50-75307b60f933 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:47.708966 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a63d2ffe-ed0f-444d-9b50-75307b60f933 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] [instance: a08087d3-94a0-44db-b92b-d3dbaf67d471] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:47.714047 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:20:47.715057 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=6 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:20:47.719443 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a63d2ffe-ed0f-444d-9b50-75307b60f933 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:47.720169 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a63d2ffe-ed0f-444d-9b50-75307b60f933 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:47.720770 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a63d2ffe-ed0f-444d-9b50-75307b60f933 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:47.721650 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a63d2ffe-ed0f-444d-9b50-75307b60f933 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:47.722364 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a63d2ffe-ed0f-444d-9b50-75307b60f933 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:47.723078 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a63d2ffe-ed0f-444d-9b50-75307b60f933 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:48.040510 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a63d2ffe-ed0f-444d-9b50-75307b60f933 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074a3eaa77164f5e9e51e85c1c7e221b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8252667102f472785e65751b4746e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:48.054417 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a63d2ffe-ed0f-444d-9b50-75307b60f933 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] 10.222.0.50 "GET /compute/v2.1/servers/a08087d3-94a0-44db-b92b-d3dbaf67d471" status: 200 len: 1324 microversion: 2.1 time: 0.350800 Aug 31 16:20:48.056924 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2937/5681] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:47 2022] GET /compute/v2.1/servers/a08087d3-94a0-44db-b92b-d3dbaf67d471 => generated 1324 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:49.087873 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5b1ba406-fe22-4c07-99b3-7e3b9dd0409e tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:49.088640 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5b1ba406-fe22-4c07-99b3-7e3b9dd0409e tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] [instance: a08087d3-94a0-44db-b92b-d3dbaf67d471] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:49.102685 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:20:49.111137 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b1ba406-fe22-4c07-99b3-7e3b9dd0409e tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:49.112236 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b1ba406-fe22-4c07-99b3-7e3b9dd0409e tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:49.114256 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b1ba406-fe22-4c07-99b3-7e3b9dd0409e tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:49.115175 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b1ba406-fe22-4c07-99b3-7e3b9dd0409e tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:49.116258 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b1ba406-fe22-4c07-99b3-7e3b9dd0409e tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:49.118331 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b1ba406-fe22-4c07-99b3-7e3b9dd0409e tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:50.615321 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5b1ba406-fe22-4c07-99b3-7e3b9dd0409e tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074a3eaa77164f5e9e51e85c1c7e221b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8252667102f472785e65751b4746e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:50.642083 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5b1ba406-fe22-4c07-99b3-7e3b9dd0409e tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] 10.222.0.50 "GET /compute/v2.1/servers/a08087d3-94a0-44db-b92b-d3dbaf67d471" status: 200 len: 1324 microversion: 2.1 time: 1.567600 Aug 31 16:20:50.643649 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2745/5682] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:49 2022] GET /compute/v2.1/servers/a08087d3-94a0-44db-b92b-d3dbaf67d471 => generated 1324 bytes in 1571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:51.665573 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-167b4188-5c60-487e-b54f-18841644dd4e tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:51.666469 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-167b4188-5c60-487e-b54f-18841644dd4e tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] [instance: a08087d3-94a0-44db-b92b-d3dbaf67d471] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:51.681360 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-167b4188-5c60-487e-b54f-18841644dd4e tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:51.682701 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-167b4188-5c60-487e-b54f-18841644dd4e tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:51.685011 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-167b4188-5c60-487e-b54f-18841644dd4e tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:51.686150 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-167b4188-5c60-487e-b54f-18841644dd4e tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:51.690258 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-167b4188-5c60-487e-b54f-18841644dd4e tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:51.690820 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-167b4188-5c60-487e-b54f-18841644dd4e tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:52.504227 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-167b4188-5c60-487e-b54f-18841644dd4e tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074a3eaa77164f5e9e51e85c1c7e221b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8252667102f472785e65751b4746e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:52.519161 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:20:52.534080 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-167b4188-5c60-487e-b54f-18841644dd4e tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] 10.222.0.50 "GET /compute/v2.1/servers/a08087d3-94a0-44db-b92b-d3dbaf67d471" status: 200 len: 1324 microversion: 2.1 time: 0.871882 Aug 31 16:20:52.538023 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2938/5683] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:51 2022] GET /compute/v2.1/servers/a08087d3-94a0-44db-b92b-d3dbaf67d471 => generated 1324 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:52.591356 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-645837d2-a532-4e79-9836-d90231068ef2 req-8792cc4a-771e-41c2-aed2-be9f64173d80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a08087d3-94a0-44db-b92b-d3dbaf67d471", "name": "network-vif-plugged", "status": "completed", "tag": "7e6c742a-e7ff-44d7-8758-006e9062d76f"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:20:52.604556 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-645837d2-a532-4e79-9836-d90231068ef2 req-8792cc4a-771e-41c2-aed2-be9f64173d80 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:52.612654 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-645837d2-a532-4e79-9836-d90231068ef2 req-8792cc4a-771e-41c2-aed2-be9f64173d80 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:52.613345 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-645837d2-a532-4e79-9836-d90231068ef2 req-8792cc4a-771e-41c2-aed2-be9f64173d80 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:52.642343 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-645837d2-a532-4e79-9836-d90231068ef2 req-8792cc4a-771e-41c2-aed2-be9f64173d80 service nova] Creating event network-vif-plugged:7e6c742a-e7ff-44d7-8758-006e9062d76f for instance a08087d3-94a0-44db-b92b-d3dbaf67d471 on n-h1-833090-16 Aug 31 16:20:52.659386 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-645837d2-a532-4e79-9836-d90231068ef2 req-8792cc4a-771e-41c2-aed2-be9f64173d80 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.491437 Aug 31 16:20:52.660075 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2746/5684] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:20:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:20:52.789504 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-06b6a0ed-e92c-4b27-8c6c-0dca98e7447d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '.version_select at 0x7fbb468641f0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:52.834693 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-06b6a0ed-e92c-4b27-8c6c-0dca98e7447d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1905368861" status: 202 len: 0 microversion: 2.1 time: 0.049331 Aug 31 16:20:52.836527 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2939/5685] 10.222.0.50 () {58 vars in 1284 bytes} [Wed Aug 31 16:20:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1905368861 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:20:52.876032 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4c47a92e-3037-4ff8-84fb-c3c3c75bfd82 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Action: 'create', calling method: .version_select at 0x7fbb4ac31820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1044602333", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACWYqqB+ib9rAoLoQxDq9yp3JXVEmECLHBf3oMGjvrM4WGczBfI5TfwzdCVj6BlXrjYZF5Nphy0wyfe/lEsfLQrNZXwucsobiL8DivVIJa/TeM7f6ZRVUtKcHq0CVcC6g=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:20:52.911552 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-4c47a92e-3037-4ff8-84fb-c3c3c75bfd82 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Getting quotas for project 3397e8a2a042486eb323432c47dfd392. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:20:52.930356 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-4c47a92e-3037-4ff8-84fb-c3c3c75bfd82 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Getting quotas for user 87f8241df6664aa59ba669d733e53871 and project 3397e8a2a042486eb323432c47dfd392. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:20:52.992370 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4c47a92e-3037-4ff8-84fb-c3c3c75bfd82 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.120516 Aug 31 16:20:52.993257 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2747/5686] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 31 16:20:52 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:20:53.563597 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7595aa09-8bfc-49f1-9bd8-14fee3ab16bb tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:53.564220 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7595aa09-8bfc-49f1-9bd8-14fee3ab16bb tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] [instance: a08087d3-94a0-44db-b92b-d3dbaf67d471] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:53.576757 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7595aa09-8bfc-49f1-9bd8-14fee3ab16bb tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:53.578950 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7595aa09-8bfc-49f1-9bd8-14fee3ab16bb tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:53.581578 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7595aa09-8bfc-49f1-9bd8-14fee3ab16bb tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:53.585793 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7595aa09-8bfc-49f1-9bd8-14fee3ab16bb tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:53.594785 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7595aa09-8bfc-49f1-9bd8-14fee3ab16bb tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:53.595479 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7595aa09-8bfc-49f1-9bd8-14fee3ab16bb tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:53.884552 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7595aa09-8bfc-49f1-9bd8-14fee3ab16bb tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074a3eaa77164f5e9e51e85c1c7e221b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8252667102f472785e65751b4746e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:53.901462 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7595aa09-8bfc-49f1-9bd8-14fee3ab16bb tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] 10.222.0.50 "GET /compute/v2.1/servers/a08087d3-94a0-44db-b92b-d3dbaf67d471" status: 200 len: 1324 microversion: 2.1 time: 0.344280 Aug 31 16:20:53.904997 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2940/5687] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:53 2022] GET /compute/v2.1/servers/a08087d3-94a0-44db-b92b-d3dbaf67d471 => generated 1324 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:54.938379 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7d4a8085-16f2-4f17-b29e-9801ec621d4f tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:54.940546 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7d4a8085-16f2-4f17-b29e-9801ec621d4f tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] [instance: a08087d3-94a0-44db-b92b-d3dbaf67d471] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:54.984148 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d4a8085-16f2-4f17-b29e-9801ec621d4f tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:54.997543 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d4a8085-16f2-4f17-b29e-9801ec621d4f tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:54.998942 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d4a8085-16f2-4f17-b29e-9801ec621d4f tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:55.006990 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d4a8085-16f2-4f17-b29e-9801ec621d4f tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:55.008066 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d4a8085-16f2-4f17-b29e-9801ec621d4f tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:55.008838 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d4a8085-16f2-4f17-b29e-9801ec621d4f tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:55.382911 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7d4a8085-16f2-4f17-b29e-9801ec621d4f tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074a3eaa77164f5e9e51e85c1c7e221b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8252667102f472785e65751b4746e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:55.398706 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7d4a8085-16f2-4f17-b29e-9801ec621d4f tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] 10.222.0.50 "GET /compute/v2.1/servers/a08087d3-94a0-44db-b92b-d3dbaf67d471" status: 200 len: 1522 microversion: 2.1 time: 0.474029 Aug 31 16:20:55.400029 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2748/5688] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:54 2022] GET /compute/v2.1/servers/a08087d3-94a0-44db-b92b-d3dbaf67d471 => generated 1522 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:55.440630 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-df73225b-c924-494a-b9af-7ec1db0e626b tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:55.442545 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-df73225b-c924-494a-b9af-7ec1db0e626b tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] [instance: a08087d3-94a0-44db-b92b-d3dbaf67d471] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:55.450765 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-df73225b-c924-494a-b9af-7ec1db0e626b tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:55.451664 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-df73225b-c924-494a-b9af-7ec1db0e626b tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:55.452762 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-df73225b-c924-494a-b9af-7ec1db0e626b tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:55.454882 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-df73225b-c924-494a-b9af-7ec1db0e626b tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:55.455665 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-df73225b-c924-494a-b9af-7ec1db0e626b tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:55.456261 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-df73225b-c924-494a-b9af-7ec1db0e626b tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:55.506153 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-df73225b-c924-494a-b9af-7ec1db0e626b tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] HTTP exception thrown: Instance is not a member of specified network Aug 31 16:20:55.515138 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-df73225b-c924-494a-b9af-7ec1db0e626b tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Request method failure captured: Aug 31 16:20:55.515138 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/a08087d3-94a0-44db-b92b-d3dbaf67d471/ips/invalid HTTP/1.1 Aug 31 16:20:55.515138 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:20:55.515138 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:20:55.515138 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:20:55.515138 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:20:55.515138 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:20:55.515138 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:20:55.515138 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:20:55.515138 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:20:55.515138 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4pRo3okixaRFrFRqJSFh-fQ6qGT0xqpn3okjA9xEpyhKFAg8K13kKBJtf-W4OyNXH_7gGW1fNlGuHyuLJFmEdhNwOWKKZhGE2-MJUyAyxfOK0-KgpeMn3CszGzxCFbVNq2wsaJ28JT_fNZxg8869PM3LKZBcKc09-vtMuDPURTpq9I Aug 31 16:20:55.515138 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:20:55.515138 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:20:55.515138 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:20:55.515138 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:20:55.515138 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:20:55.515138 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:20:55.515138 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: d8252667102f472785e65751b4746e7a Aug 31 16:20:55.515138 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-2014126518 Aug 31 16:20:55.515138 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:20:55.515138 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:20:55.515138 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d8252667102f472785e65751b4746e7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d8252667102f472785e65751b4746e7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d8252667102f472785e65751b4746e7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d8252667102f472785e65751b4746e7a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:20:55.515138 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-2014126518 Aug 31 16:20:55.515138 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: d8252667102f472785e65751b4746e7a Aug 31 16:20:55.515138 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-2014126518 Aug 31 16:20:55.515138 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServerAddressesNegativeTestJSON-2014126518-project Aug 31 16:20:55.515138 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:20:55.515138 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:20:55.515138 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 074a3eaa77164f5e9e51e85c1c7e221b Aug 31 16:20:55.515138 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-2014126518-project Aug 31 16:20:55.515138 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:20:55.515138 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance is not a member of specified network Aug 31 16:20:55.515138 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'server_id': 'a08087d3-94a0-44db-b92b-d3dbaf67d471', 'id': 'invalid'} Aug 31 16:20:55.515138 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:20:55.515138 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:20:55.515138 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:20:55.515138 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:20:55.515138 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:20:55.515138 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:20:55.515138 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:20:55.515138 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:20:55.515138 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Aug 31 16:20:55.515138 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 31 16:20:55.515138 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Aug 31 16:20:55.515138 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:20:55.515138 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:20:55.515138 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:20:55.515138 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:20:55.515138 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:20:55.515138 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:20:55.515138 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:20:55.515138 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:20:55.515138 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Aug 31 16:20:55.515138 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:20:55.519153 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-df73225b-c924-494a-b9af-7ec1db0e626b tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Returning 404 to user: Instance is not a member of specified network {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:20:55.519153 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-df73225b-c924-494a-b9af-7ec1db0e626b tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] 10.222.0.50 "GET /compute/v2.1/servers/a08087d3-94a0-44db-b92b-d3dbaf67d471/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.085908 Aug 31 16:20:55.527368 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2941/5689] 10.222.0.50 () {58 vars in 1272 bytes} [Wed Aug 31 16:20:55 2022] GET /compute/v2.1/servers/a08087d3-94a0-44db-b92b-d3dbaf67d471/ips/invalid => generated 91 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 16:20:55.531619 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-76883acf-befc-46a2-bf62-81c9a29bcdba tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:55.532675 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-76883acf-befc-46a2-bf62-81c9a29bcdba tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Failed to fetch instance by id 999 {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 31 16:20:55.533449 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-76883acf-befc-46a2-bf62-81c9a29bcdba tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] HTTP exception thrown: Instance 999 could not be found. Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-76883acf-befc-46a2-bf62-81c9a29bcdba tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Request method failure captured: Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4pRo3okixaRFrFRqJSFh-fQ6qGT0xqpn3okjA9xEpyhKFAg8K13kKBJtf-W4OyNXH_7gGW1fNlGuHyuLJFmEdhNwOWKKZhGE2-MJUyAyxfOK0-KgpeMn3CszGzxCFbVNq2wsaJ28JT_fNZxg8869PM3LKZBcKc09-vtMuDPURTpq9I Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: d8252667102f472785e65751b4746e7a Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-2014126518 Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d8252667102f472785e65751b4746e7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d8252667102f472785e65751b4746e7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d8252667102f472785e65751b4746e7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d8252667102f472785e65751b4746e7a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-2014126518 Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: d8252667102f472785e65751b4746e7a Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-2014126518 Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServerAddressesNegativeTestJSON-2014126518-project Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 074a3eaa77164f5e9e51e85c1c7e221b Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-2014126518-project Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 999 could not be found. Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'server_id': '999'} Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 31 16:20:55.537027 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:20:55.546077 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-76883acf-befc-46a2-bf62-81c9a29bcdba tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Returning 404 to user: Instance 999 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:20:55.547898 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-76883acf-befc-46a2-bf62-81c9a29bcdba tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] 10.222.0.50 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.022870 Aug 31 16:20:55.549491 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2749/5690] 10.222.0.50 () {58 vars in 1149 bytes} [Wed Aug 31 16:20:55 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 31 16:20:55.560210 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-60f21ffa-a346-4b5f-9a36-fb3c501dcc6a tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:55.560720 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-60f21ffa-a346-4b5f-9a36-fb3c501dcc6a tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] [instance: a08087d3-94a0-44db-b92b-d3dbaf67d471] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:55.575483 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-60f21ffa-a346-4b5f-9a36-fb3c501dcc6a tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:55.577191 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-60f21ffa-a346-4b5f-9a36-fb3c501dcc6a tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:55.579003 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-60f21ffa-a346-4b5f-9a36-fb3c501dcc6a tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:55.580812 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-60f21ffa-a346-4b5f-9a36-fb3c501dcc6a tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:55.581756 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-60f21ffa-a346-4b5f-9a36-fb3c501dcc6a tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:55.584420 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-60f21ffa-a346-4b5f-9a36-fb3c501dcc6a tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:55.672623 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-60f21ffa-a346-4b5f-9a36-fb3c501dcc6a tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] [instance: a08087d3-94a0-44db-b92b-d3dbaf67d471] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:20:55.929195 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-60f21ffa-a346-4b5f-9a36-fb3c501dcc6a tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a08087d3-94a0-44db-b92b-d3dbaf67d471" status: 204 len: 0 microversion: 2.1 time: 0.374350 Aug 31 16:20:55.932788 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2942/5691] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:20:55 2022] DELETE /compute/v2.1/servers/a08087d3-94a0-44db-b92b-d3dbaf67d471 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:20:55.941949 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b8bbc72b-c5bf-467f-9a12-10a3520e9804 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:55.942802 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b8bbc72b-c5bf-467f-9a12-10a3520e9804 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] [instance: a08087d3-94a0-44db-b92b-d3dbaf67d471] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:55.967711 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8bbc72b-c5bf-467f-9a12-10a3520e9804 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:55.974024 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8bbc72b-c5bf-467f-9a12-10a3520e9804 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:55.974648 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8bbc72b-c5bf-467f-9a12-10a3520e9804 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:55.975494 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8bbc72b-c5bf-467f-9a12-10a3520e9804 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:55.976053 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8bbc72b-c5bf-467f-9a12-10a3520e9804 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:55.978253 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8bbc72b-c5bf-467f-9a12-10a3520e9804 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:56.375661 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b8bbc72b-c5bf-467f-9a12-10a3520e9804 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074a3eaa77164f5e9e51e85c1c7e221b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8252667102f472785e65751b4746e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:56.404858 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b8bbc72b-c5bf-467f-9a12-10a3520e9804 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] 10.222.0.50 "GET /compute/v2.1/servers/a08087d3-94a0-44db-b92b-d3dbaf67d471" status: 200 len: 1528 microversion: 2.1 time: 0.467891 Aug 31 16:20:56.408269 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2750/5692] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:55 2022] GET /compute/v2.1/servers/a08087d3-94a0-44db-b92b-d3dbaf67d471 => generated 1528 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:57.440830 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-010ef20a-1e4e-4c3d-ba8e-67c9bf8fbcc8 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:57.442697 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-010ef20a-1e4e-4c3d-ba8e-67c9bf8fbcc8 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] [instance: a08087d3-94a0-44db-b92b-d3dbaf67d471] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:57.463589 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-010ef20a-1e4e-4c3d-ba8e-67c9bf8fbcc8 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:57.469843 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-010ef20a-1e4e-4c3d-ba8e-67c9bf8fbcc8 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:57.470630 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-010ef20a-1e4e-4c3d-ba8e-67c9bf8fbcc8 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:57.471726 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-010ef20a-1e4e-4c3d-ba8e-67c9bf8fbcc8 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:57.495050 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-010ef20a-1e4e-4c3d-ba8e-67c9bf8fbcc8 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:57.497095 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-010ef20a-1e4e-4c3d-ba8e-67c9bf8fbcc8 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:58.175819 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-010ef20a-1e4e-4c3d-ba8e-67c9bf8fbcc8 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074a3eaa77164f5e9e51e85c1c7e221b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8252667102f472785e65751b4746e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:58.192574 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-010ef20a-1e4e-4c3d-ba8e-67c9bf8fbcc8 tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] 10.222.0.50 "GET /compute/v2.1/servers/a08087d3-94a0-44db-b92b-d3dbaf67d471" status: 200 len: 1528 microversion: 2.1 time: 0.752041 Aug 31 16:20:58.193252 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2943/5693] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:57 2022] GET /compute/v2.1/servers/a08087d3-94a0-44db-b92b-d3dbaf67d471 => generated 1528 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:59.220146 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f9364ad3-336b-46d7-85b3-0f1257abac5b tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:20:59.221543 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f9364ad3-336b-46d7-85b3-0f1257abac5b tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] [instance: a08087d3-94a0-44db-b92b-d3dbaf67d471] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:20:59.250357 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9364ad3-336b-46d7-85b3-0f1257abac5b tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:59.252619 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9364ad3-336b-46d7-85b3-0f1257abac5b tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:59.255884 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9364ad3-336b-46d7-85b3-0f1257abac5b tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:59.257265 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9364ad3-336b-46d7-85b3-0f1257abac5b tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:59.259226 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9364ad3-336b-46d7-85b3-0f1257abac5b tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:59.261422 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9364ad3-336b-46d7-85b3-0f1257abac5b tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:59.482433 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f9364ad3-336b-46d7-85b3-0f1257abac5b tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '074a3eaa77164f5e9e51e85c1c7e221b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8252667102f472785e65751b4746e7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:20:59.498945 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f9364ad3-336b-46d7-85b3-0f1257abac5b tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] 10.222.0.50 "GET /compute/v2.1/servers/a08087d3-94a0-44db-b92b-d3dbaf67d471" status: 200 len: 1486 microversion: 2.1 time: 0.284214 Aug 31 16:20:59.499575 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2751/5694] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:20:59 2022] GET /compute/v2.1/servers/a08087d3-94a0-44db-b92b-d3dbaf67d471 => generated 1486 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:20:59.693845 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-2d5fd7c8-e914-46ac-95b1-60b810e78a15 req-6e7b4435-9185-4447-9b4c-944643a482e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a08087d3-94a0-44db-b92b-d3dbaf67d471", "name": "network-vif-deleted", "tag": "7e6c742a-e7ff-44d7-8758-006e9062d76f"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:20:59.722115 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-2d5fd7c8-e914-46ac-95b1-60b810e78a15 req-6e7b4435-9185-4447-9b4c-944643a482e7 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:20:59.725280 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-2d5fd7c8-e914-46ac-95b1-60b810e78a15 req-6e7b4435-9185-4447-9b4c-944643a482e7 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:20:59.727743 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-2d5fd7c8-e914-46ac-95b1-60b810e78a15 req-6e7b4435-9185-4447-9b4c-944643a482e7 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:20:59.759106 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-2d5fd7c8-e914-46ac-95b1-60b810e78a15 req-6e7b4435-9185-4447-9b4c-944643a482e7 service nova] Creating event network-vif-deleted:7e6c742a-e7ff-44d7-8758-006e9062d76f for instance a08087d3-94a0-44db-b92b-d3dbaf67d471 on n-h1-833090-16 Aug 31 16:20:59.777268 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-2d5fd7c8-e914-46ac-95b1-60b810e78a15 req-6e7b4435-9185-4447-9b4c-944643a482e7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089947 Aug 31 16:20:59.778387 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2944/5695] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:21:00.521120 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e5709c18-125e-466f-8d0b-1329c3a8925e tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:00.521667 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e5709c18-125e-466f-8d0b-1329c3a8925e tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] [instance: a08087d3-94a0-44db-b92b-d3dbaf67d471] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:00.547345 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e5709c18-125e-466f-8d0b-1329c3a8925e tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:00.550578 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e5709c18-125e-466f-8d0b-1329c3a8925e tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:00.553106 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e5709c18-125e-466f-8d0b-1329c3a8925e tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:00.554243 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e5709c18-125e-466f-8d0b-1329c3a8925e tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:00.558007 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e5709c18-125e-466f-8d0b-1329c3a8925e tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:00.560373 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e5709c18-125e-466f-8d0b-1329c3a8925e tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:00.614384 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-e5709c18-125e-466f-8d0b-1329c3a8925e tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] HTTP exception thrown: Instance a08087d3-94a0-44db-b92b-d3dbaf67d471 could not be found. Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e5709c18-125e-466f-8d0b-1329c3a8925e tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Request method failure captured: Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/a08087d3-94a0-44db-b92b-d3dbaf67d471 HTTP/1.1 Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4pRo3okixaRFrFRqJSFh-fQ6qGT0xqpn3okjA9xEpyhKFAg8K13kKBJtf-W4OyNXH_7gGW1fNlGuHyuLJFmEdhNwOWKKZhGE2-MJUyAyxfOK0-KgpeMn3CszGzxCFbVNq2wsaJ28JT_fNZxg8869PM3LKZBcKc09-vtMuDPURTpq9I Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: d8252667102f472785e65751b4746e7a Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-2014126518 Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d8252667102f472785e65751b4746e7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d8252667102f472785e65751b4746e7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d8252667102f472785e65751b4746e7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d8252667102f472785e65751b4746e7a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-2014126518 Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: d8252667102f472785e65751b4746e7a Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-2014126518 Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServerAddressesNegativeTestJSON-2014126518-project Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 074a3eaa77164f5e9e51e85c1c7e221b Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-2014126518-project Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance a08087d3-94a0-44db-b92b-d3dbaf67d471 could not be found. Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'a08087d3-94a0-44db-b92b-d3dbaf67d471'} Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a08087d3-94a0-44db-b92b-d3dbaf67d471 could not be found. Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a08087d3-94a0-44db-b92b-d3dbaf67d471 could not be found. Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:21:00.617181 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:21:00.621290 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:21:00.621290 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:21:00.621290 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:21:00.621290 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:21:00.621290 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:21:00.621290 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:21:00.621290 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a08087d3-94a0-44db-b92b-d3dbaf67d471 could not be found. Aug 31 16:21:00.621290 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:21:00.631367 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e5709c18-125e-466f-8d0b-1329c3a8925e tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] Returning 404 to user: Instance a08087d3-94a0-44db-b92b-d3dbaf67d471 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:21:00.632475 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e5709c18-125e-466f-8d0b-1329c3a8925e tempest-ServerAddressesNegativeTestJSON-2014126518 tempest-ServerAddressesNegativeTestJSON-2014126518-project] 10.222.0.50 "GET /compute/v2.1/servers/a08087d3-94a0-44db-b92b-d3dbaf67d471" status: 404 len: 111 microversion: 2.1 time: 0.116579 Aug 31 16:21:00.633738 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2752/5696] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:00 2022] GET /compute/v2.1/servers/a08087d3-94a0-44db-b92b-d3dbaf67d471 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:21:11.019803 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-02518887-bf40-4ca1-bfaf-c7d137c0012d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1290329074", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "5e7a3901-9082-48ad-8f1c-dc8d91dde009"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1044602333", "security_groups": [{"name": "tempest-secgroup-smoke-241969708"}]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:21:11.045383 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:21:11.046326 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:21:11.566169 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-02518887-bf40-4ca1-bfaf-c7d137c0012d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] validate_networks() for [('5e7a3901-9082-48ad-8f1c-dc8d91dde009', None, None, None, None, None)] {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:21:13.237873 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-02518887-bf40-4ca1-bfaf-c7d137c0012d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:21:13.239658 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-02518887-bf40-4ca1-bfaf-c7d137c0012d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:21:13.241312 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-02518887-bf40-4ca1-bfaf-c7d137c0012d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:21:13.242321 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-02518887-bf40-4ca1-bfaf-c7d137c0012d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:21:13.242936 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-02518887-bf40-4ca1-bfaf-c7d137c0012d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:21:13.256533 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-02518887-bf40-4ca1-bfaf-c7d137c0012d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:13.257420 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-02518887-bf40-4ca1-bfaf-c7d137c0012d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:13.258110 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-02518887-bf40-4ca1-bfaf-c7d137c0012d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:13.259531 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-02518887-bf40-4ca1-bfaf-c7d137c0012d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:13.260205 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-02518887-bf40-4ca1-bfaf-c7d137c0012d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:13.278660 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-02518887-bf40-4ca1-bfaf-c7d137c0012d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:13.329501 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-02518887-bf40-4ca1-bfaf-c7d137c0012d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Getting quotas for project 3397e8a2a042486eb323432c47dfd392. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:21:13.336330 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-02518887-bf40-4ca1-bfaf-c7d137c0012d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Getting quotas for user 87f8241df6664aa59ba669d733e53871 and project 3397e8a2a042486eb323432c47dfd392. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:21:13.356233 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-02518887-bf40-4ca1-bfaf-c7d137c0012d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:21:13.359757 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-02518887-bf40-4ca1-bfaf-c7d137c0012d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 1d359c68-27fb-4b21-ba0c-0d189780d82e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:21:13.422438 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-02518887-bf40-4ca1-bfaf-c7d137c0012d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.406968 Aug 31 16:21:13.424583 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2945/5697] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:21:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 2410 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:21:13.437368 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4a87c22a-68a5-45ee-96e4-5a06885ef42c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:13.438264 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4a87c22a-68a5-45ee-96e4-5a06885ef42c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 1d359c68-27fb-4b21-ba0c-0d189780d82e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:13.449144 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:21:13.450427 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:21:13.451389 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=59 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:21:13.669492 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4a87c22a-68a5-45ee-96e4-5a06885ef42c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:13.689077 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4a87c22a-68a5-45ee-96e4-5a06885ef42c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e" status: 200 len: 1267 microversion: 2.1 time: 0.256330 Aug 31 16:21:13.690871 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2753/5698] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:13 2022] GET /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e => generated 1267 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:14.328933 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e7d25990-f85a-4b2c-946b-0b6422a55f11 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:14.329843 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e7d25990-f85a-4b2c-946b-0b6422a55f11 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:14.348716 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7d25990-f85a-4b2c-946b-0b6422a55f11 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:14.352556 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7d25990-f85a-4b2c-946b-0b6422a55f11 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:14.353749 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7d25990-f85a-4b2c-946b-0b6422a55f11 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:14.357574 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7d25990-f85a-4b2c-946b-0b6422a55f11 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:14.362585 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7d25990-f85a-4b2c-946b-0b6422a55f11 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:14.367024 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7d25990-f85a-4b2c-946b-0b6422a55f11 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:14.491299 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e7d25990-f85a-4b2c-946b-0b6422a55f11 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d/os-volume_attachments/ca0d3df6-f0c7-439c-a8ed-d42a1f477074" status: 200 len: 194 microversion: 2.20 time: 0.167127 Aug 31 16:21:14.500743 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2946/5699] 10.222.0.50 () {60 vars in 1454 bytes} [Wed Aug 31 16:21:14 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d/os-volume_attachments/ca0d3df6-f0c7-439c-a8ed-d42a1f477074 => generated 194 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:21:14.629879 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5d8c1c9e-b9e9-4d8b-8173-b19a6ffcc926 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:14.630409 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5d8c1c9e-b9e9-4d8b-8173-b19a6ffcc926 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:14.649453 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d8c1c9e-b9e9-4d8b-8173-b19a6ffcc926 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:14.649961 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d8c1c9e-b9e9-4d8b-8173-b19a6ffcc926 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:14.655937 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d8c1c9e-b9e9-4d8b-8173-b19a6ffcc926 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:14.656761 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d8c1c9e-b9e9-4d8b-8173-b19a6ffcc926 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:14.657233 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d8c1c9e-b9e9-4d8b-8173-b19a6ffcc926 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:14.657668 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d8c1c9e-b9e9-4d8b-8173-b19a6ffcc926 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:14.719950 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-873e3410-4e19-4a2c-aeda-4106dd77a7ec tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:14.724088 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-873e3410-4e19-4a2c-aeda-4106dd77a7ec tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 1d359c68-27fb-4b21-ba0c-0d189780d82e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:14.744980 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-873e3410-4e19-4a2c-aeda-4106dd77a7ec tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:14.747111 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-873e3410-4e19-4a2c-aeda-4106dd77a7ec tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:14.749656 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-873e3410-4e19-4a2c-aeda-4106dd77a7ec tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:14.753061 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-873e3410-4e19-4a2c-aeda-4106dd77a7ec tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:14.754447 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-873e3410-4e19-4a2c-aeda-4106dd77a7ec tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:14.758975 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-873e3410-4e19-4a2c-aeda-4106dd77a7ec tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:14.834764 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-5d8c1c9e-b9e9-4d8b-8173-b19a6ffcc926 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lazy-loading 'services' on Instance uuid 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:21:14.961069 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5d8c1c9e-b9e9-4d8b-8173-b19a6ffcc926 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "DELETE /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d/os-volume_attachments/ca0d3df6-f0c7-439c-a8ed-d42a1f477074" status: 202 len: 0 microversion: 2.20 time: 0.335660 Aug 31 16:21:14.962164 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2754/5700] 10.222.0.50 () {60 vars in 1457 bytes} [Wed Aug 31 16:21:14 2022] DELETE /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d/os-volume_attachments/ca0d3df6-f0c7-439c-a8ed-d42a1f477074 => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:21:14.972167 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-486202e4-21dd-4f8e-a53f-9d8f878e4ee0 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:14.991082 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-486202e4-21dd-4f8e-a53f-9d8f878e4ee0 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:15.004493 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-873e3410-4e19-4a2c-aeda-4106dd77a7ec tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:15.010276 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-486202e4-21dd-4f8e-a53f-9d8f878e4ee0 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:15.011086 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-486202e4-21dd-4f8e-a53f-9d8f878e4ee0 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:15.011737 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-486202e4-21dd-4f8e-a53f-9d8f878e4ee0 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:15.013802 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-486202e4-21dd-4f8e-a53f-9d8f878e4ee0 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:15.015178 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-486202e4-21dd-4f8e-a53f-9d8f878e4ee0 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:15.015845 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-486202e4-21dd-4f8e-a53f-9d8f878e4ee0 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:15.040537 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-873e3410-4e19-4a2c-aeda-4106dd77a7ec tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e" status: 200 len: 1263 microversion: 2.1 time: 0.331937 Aug 31 16:21:15.069649 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2947/5701] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:14 2022] GET /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e => generated 1263 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:15.069930 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-486202e4-21dd-4f8e-a53f-9d8f878e4ee0 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.102447 Aug 31 16:21:15.070883 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2755/5702] 10.222.0.50 () {60 vars in 1343 bytes} [Wed Aug 31 16:21:14 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:21:16.066315 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-842ead04-acd7-4bd8-912c-b3d1767cbc22 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:16.068105 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-842ead04-acd7-4bd8-912c-b3d1767cbc22 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 1d359c68-27fb-4b21-ba0c-0d189780d82e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:16.083249 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-842ead04-acd7-4bd8-912c-b3d1767cbc22 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:16.083466 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a76b945b-17dd-44ba-a82e-432fdf51ef0a tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:16.084482 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-842ead04-acd7-4bd8-912c-b3d1767cbc22 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:16.085700 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a76b945b-17dd-44ba-a82e-432fdf51ef0a tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:16.086780 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-842ead04-acd7-4bd8-912c-b3d1767cbc22 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:16.091338 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-842ead04-acd7-4bd8-912c-b3d1767cbc22 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:16.091861 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-842ead04-acd7-4bd8-912c-b3d1767cbc22 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:16.092988 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-842ead04-acd7-4bd8-912c-b3d1767cbc22 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:16.102236 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a76b945b-17dd-44ba-a82e-432fdf51ef0a tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:16.102917 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a76b945b-17dd-44ba-a82e-432fdf51ef0a tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:16.111141 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a76b945b-17dd-44ba-a82e-432fdf51ef0a tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:16.112192 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a76b945b-17dd-44ba-a82e-432fdf51ef0a tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:16.112859 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a76b945b-17dd-44ba-a82e-432fdf51ef0a tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:16.113497 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a76b945b-17dd-44ba-a82e-432fdf51ef0a tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:16.193247 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a76b945b-17dd-44ba-a82e-432fdf51ef0a tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.114421 Aug 31 16:21:16.197084 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2756/5703] 10.222.0.50 () {60 vars in 1343 bytes} [Wed Aug 31 16:21:16 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:21:16.300162 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-842ead04-acd7-4bd8-912c-b3d1767cbc22 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:16.316325 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-842ead04-acd7-4bd8-912c-b3d1767cbc22 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e" status: 200 len: 1325 microversion: 2.1 time: 0.253650 Aug 31 16:21:16.318195 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2948/5704] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:16 2022] GET /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e => generated 1325 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:17.208706 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f829ad52-590a-422a-954d-88f89aa7a455 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:17.210897 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f829ad52-590a-422a-954d-88f89aa7a455 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:17.235203 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f829ad52-590a-422a-954d-88f89aa7a455 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:17.235715 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f829ad52-590a-422a-954d-88f89aa7a455 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:17.245032 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f829ad52-590a-422a-954d-88f89aa7a455 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:17.246498 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f829ad52-590a-422a-954d-88f89aa7a455 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:17.253790 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f829ad52-590a-422a-954d-88f89aa7a455 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:17.254492 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f829ad52-590a-422a-954d-88f89aa7a455 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:17.349643 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e0348dbe-08e8-4ec9-867c-67360a2b544f tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:17.352832 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e0348dbe-08e8-4ec9-867c-67360a2b544f tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 1d359c68-27fb-4b21-ba0c-0d189780d82e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:17.381692 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e0348dbe-08e8-4ec9-867c-67360a2b544f tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:17.382454 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f829ad52-590a-422a-954d-88f89aa7a455 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.178613 Aug 31 16:21:17.382814 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e0348dbe-08e8-4ec9-867c-67360a2b544f tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:17.385322 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e0348dbe-08e8-4ec9-867c-67360a2b544f tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:17.387345 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2757/5705] 10.222.0.50 () {60 vars in 1343 bytes} [Wed Aug 31 16:21:17 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d/os-volume_attachments => generated 197 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:21:17.391497 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e0348dbe-08e8-4ec9-867c-67360a2b544f tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:17.391497 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e0348dbe-08e8-4ec9-867c-67360a2b544f tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:17.391497 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e0348dbe-08e8-4ec9-867c-67360a2b544f tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:17.739880 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e0348dbe-08e8-4ec9-867c-67360a2b544f tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:17.755107 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e0348dbe-08e8-4ec9-867c-67360a2b544f tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e" status: 200 len: 1325 microversion: 2.1 time: 0.417899 Aug 31 16:21:17.760023 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2949/5706] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:17 2022] GET /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e => generated 1325 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:18.401476 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f55f6e3c-5707-4a33-a7b5-9a4f68c3bffd tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:18.408618 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f55f6e3c-5707-4a33-a7b5-9a4f68c3bffd tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:18.427354 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f55f6e3c-5707-4a33-a7b5-9a4f68c3bffd tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:18.428023 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f55f6e3c-5707-4a33-a7b5-9a4f68c3bffd tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:18.429747 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f55f6e3c-5707-4a33-a7b5-9a4f68c3bffd tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:18.430618 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f55f6e3c-5707-4a33-a7b5-9a4f68c3bffd tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:18.433078 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f55f6e3c-5707-4a33-a7b5-9a4f68c3bffd tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:18.446392 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f55f6e3c-5707-4a33-a7b5-9a4f68c3bffd tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:18.524086 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f55f6e3c-5707-4a33-a7b5-9a4f68c3bffd tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.128186 Aug 31 16:21:18.525075 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2758/5707] 10.222.0.50 () {60 vars in 1343 bytes} [Wed Aug 31 16:21:18 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:21:18.782520 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5bbce359-0483-4237-9988-785589a815a5 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:18.783413 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5bbce359-0483-4237-9988-785589a815a5 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 1d359c68-27fb-4b21-ba0c-0d189780d82e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:18.800035 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5bbce359-0483-4237-9988-785589a815a5 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:18.800494 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5bbce359-0483-4237-9988-785589a815a5 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:18.800940 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5bbce359-0483-4237-9988-785589a815a5 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:18.809361 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5bbce359-0483-4237-9988-785589a815a5 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:18.809955 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5bbce359-0483-4237-9988-785589a815a5 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:18.811786 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5bbce359-0483-4237-9988-785589a815a5 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:19.542013 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8c01f510-42de-4119-b99a-506d817da822 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:19.563356 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8c01f510-42de-4119-b99a-506d817da822 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:19.583044 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c01f510-42de-4119-b99a-506d817da822 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:19.583919 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c01f510-42de-4119-b99a-506d817da822 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:19.584649 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c01f510-42de-4119-b99a-506d817da822 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:19.588639 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c01f510-42de-4119-b99a-506d817da822 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:19.589335 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c01f510-42de-4119-b99a-506d817da822 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:19.590280 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c01f510-42de-4119-b99a-506d817da822 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:19.622015 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5bbce359-0483-4237-9988-785589a815a5 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:19.631408 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5bbce359-0483-4237-9988-785589a815a5 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e" status: 200 len: 1392 microversion: 2.1 time: 0.854460 Aug 31 16:21:19.631998 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2950/5708] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:18 2022] GET /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e => generated 1392 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:19.680837 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8c01f510-42de-4119-b99a-506d817da822 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.147839 Aug 31 16:21:19.695750 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2759/5709] 10.222.0.50 () {60 vars in 1343 bytes} [Wed Aug 31 16:21:19 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:21:20.653753 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-255a1ccb-1142-4e63-814e-94c8bda672a3 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:20.654584 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-255a1ccb-1142-4e63-814e-94c8bda672a3 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 1d359c68-27fb-4b21-ba0c-0d189780d82e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:20.675124 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-255a1ccb-1142-4e63-814e-94c8bda672a3 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:20.678397 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-255a1ccb-1142-4e63-814e-94c8bda672a3 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:20.678866 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-255a1ccb-1142-4e63-814e-94c8bda672a3 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:20.684078 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-255a1ccb-1142-4e63-814e-94c8bda672a3 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:20.684581 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-255a1ccb-1142-4e63-814e-94c8bda672a3 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:20.685026 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-255a1ccb-1142-4e63-814e-94c8bda672a3 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:20.694117 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6d8ead39-4a49-4a41-b9ed-4d994042e371 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:20.696446 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6d8ead39-4a49-4a41-b9ed-4d994042e371 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:20.720756 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d8ead39-4a49-4a41-b9ed-4d994042e371 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:20.726869 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d8ead39-4a49-4a41-b9ed-4d994042e371 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:20.729260 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d8ead39-4a49-4a41-b9ed-4d994042e371 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:20.730063 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d8ead39-4a49-4a41-b9ed-4d994042e371 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:20.730554 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d8ead39-4a49-4a41-b9ed-4d994042e371 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:20.730981 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d8ead39-4a49-4a41-b9ed-4d994042e371 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:20.846154 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6d8ead39-4a49-4a41-b9ed-4d994042e371 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.156747 Aug 31 16:21:20.852498 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2760/5710] 10.222.0.50 () {60 vars in 1343 bytes} [Wed Aug 31 16:21:20 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d/os-volume_attachments => generated 197 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:21:21.152774 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-255a1ccb-1142-4e63-814e-94c8bda672a3 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:21.162184 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-255a1ccb-1142-4e63-814e-94c8bda672a3 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e" status: 200 len: 1392 microversion: 2.1 time: 0.513263 Aug 31 16:21:21.172742 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2951/5711] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:20 2022] GET /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e => generated 1392 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:21.867912 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-49577187-39f7-4d5f-baec-37d3bb0e130c tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:21.872281 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-49577187-39f7-4d5f-baec-37d3bb0e130c tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:21.893194 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49577187-39f7-4d5f-baec-37d3bb0e130c tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:21.894987 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49577187-39f7-4d5f-baec-37d3bb0e130c tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:21.895685 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49577187-39f7-4d5f-baec-37d3bb0e130c tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:21.900226 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49577187-39f7-4d5f-baec-37d3bb0e130c tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:21.902219 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49577187-39f7-4d5f-baec-37d3bb0e130c tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:21.903137 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-49577187-39f7-4d5f-baec-37d3bb0e130c tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:21.940642 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-9a61f02e-5d4a-4e57-a2bd-3c6233c73a0e req-218f33aa-f931-48b9-baae-3db6b684cc0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d359c68-27fb-4b21-ba0c-0d189780d82e", "tag": "d1610121-0e92-4a46-ab8b-173db528ac07"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:21:22.009501 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-9a61f02e-5d4a-4e57-a2bd-3c6233c73a0e req-218f33aa-f931-48b9-baae-3db6b684cc0f service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:22.009982 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-9a61f02e-5d4a-4e57-a2bd-3c6233c73a0e req-218f33aa-f931-48b9-baae-3db6b684cc0f service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:22.010437 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-9a61f02e-5d4a-4e57-a2bd-3c6233c73a0e req-218f33aa-f931-48b9-baae-3db6b684cc0f service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:22.035375 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-9a61f02e-5d4a-4e57-a2bd-3c6233c73a0e req-218f33aa-f931-48b9-baae-3db6b684cc0f service nova] Creating event network-changed:d1610121-0e92-4a46-ab8b-173db528ac07 for instance 1d359c68-27fb-4b21-ba0c-0d189780d82e on n-h1-833090-16 Aug 31 16:21:22.050152 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-9a61f02e-5d4a-4e57-a2bd-3c6233c73a0e req-218f33aa-f931-48b9-baae-3db6b684cc0f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114955 Aug 31 16:21:22.053005 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2952/5712] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:21:22.088017 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-49577187-39f7-4d5f-baec-37d3bb0e130c tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.225253 Aug 31 16:21:22.092932 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2761/5713] 10.222.0.50 () {60 vars in 1343 bytes} [Wed Aug 31 16:21:21 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d/os-volume_attachments => generated 197 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:21:22.193360 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-880bdd75-f3b5-4173-9dc9-cf4f1f7ccc73 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:22.194063 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-880bdd75-f3b5-4173-9dc9-cf4f1f7ccc73 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 1d359c68-27fb-4b21-ba0c-0d189780d82e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:22.218361 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-880bdd75-f3b5-4173-9dc9-cf4f1f7ccc73 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:22.218830 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-880bdd75-f3b5-4173-9dc9-cf4f1f7ccc73 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:22.219284 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-880bdd75-f3b5-4173-9dc9-cf4f1f7ccc73 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:22.219965 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-880bdd75-f3b5-4173-9dc9-cf4f1f7ccc73 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:22.225357 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-880bdd75-f3b5-4173-9dc9-cf4f1f7ccc73 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:22.226180 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-880bdd75-f3b5-4173-9dc9-cf4f1f7ccc73 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:22.668220 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-880bdd75-f3b5-4173-9dc9-cf4f1f7ccc73 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:22.679902 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-880bdd75-f3b5-4173-9dc9-cf4f1f7ccc73 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e" status: 200 len: 1392 microversion: 2.1 time: 0.491542 Aug 31 16:21:22.683773 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2953/5714] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:22 2022] GET /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e => generated 1392 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:23.104503 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-120261c9-74ac-4233-9040-383a59c68001 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:23.106775 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-120261c9-74ac-4233-9040-383a59c68001 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:23.128447 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-120261c9-74ac-4233-9040-383a59c68001 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:23.129416 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-120261c9-74ac-4233-9040-383a59c68001 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:23.130008 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-120261c9-74ac-4233-9040-383a59c68001 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:23.131875 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-120261c9-74ac-4233-9040-383a59c68001 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:23.134763 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-120261c9-74ac-4233-9040-383a59c68001 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:23.135446 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-120261c9-74ac-4233-9040-383a59c68001 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:23.245435 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-120261c9-74ac-4233-9040-383a59c68001 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.134612 Aug 31 16:21:23.245435 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2762/5715] 10.222.0.50 () {60 vars in 1343 bytes} [Wed Aug 31 16:21:23 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 16:21:23.719326 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9f03b27d-6c25-4741-acb9-6eafcd4229bb tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:23.720047 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9f03b27d-6c25-4741-acb9-6eafcd4229bb tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 1d359c68-27fb-4b21-ba0c-0d189780d82e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:23.738153 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:21:23.738892 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=6 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:21:23.750402 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9f03b27d-6c25-4741-acb9-6eafcd4229bb tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:23.751005 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9f03b27d-6c25-4741-acb9-6eafcd4229bb tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:23.751458 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9f03b27d-6c25-4741-acb9-6eafcd4229bb tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:23.752233 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9f03b27d-6c25-4741-acb9-6eafcd4229bb tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:23.752661 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9f03b27d-6c25-4741-acb9-6eafcd4229bb tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:23.753083 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9f03b27d-6c25-4741-acb9-6eafcd4229bb tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:24.248692 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-09b45aff-8ec5-4b9e-a67f-013f40fa7b45 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:24.251282 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-09b45aff-8ec5-4b9e-a67f-013f40fa7b45 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:24.264185 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:21:24.273304 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09b45aff-8ec5-4b9e-a67f-013f40fa7b45 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:24.274543 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09b45aff-8ec5-4b9e-a67f-013f40fa7b45 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:24.275190 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09b45aff-8ec5-4b9e-a67f-013f40fa7b45 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:24.276100 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09b45aff-8ec5-4b9e-a67f-013f40fa7b45 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:24.276707 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09b45aff-8ec5-4b9e-a67f-013f40fa7b45 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:24.277295 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09b45aff-8ec5-4b9e-a67f-013f40fa7b45 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:24.356949 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-09b45aff-8ec5-4b9e-a67f-013f40fa7b45 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.113078 Aug 31 16:21:24.360931 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2763/5716] 10.222.0.50 () {60 vars in 1343 bytes} [Wed Aug 31 16:21:24 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:21:24.875041 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-627c9666-7b62-4545-bcf8-8f84b3afac9c tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Action: 'create', calling method: .version_select at 0x7fbb4ab6caf0>, body: {"keypair": {"name": "tempest-keypair-1349661177", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ5R4REmrNQwSaeGwko7QrmacOSC55LQSt3vEV87uvllFO9XpxfzXjnJ6jk3oo5eQtyJ0XczgfEPECK4mYzvjtnuRTgur43FlUJ2zWbFObckm8rRPX3NuAnMIFdRwr3BYQ=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:21:24.914954 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-627c9666-7b62-4545-bcf8-8f84b3afac9c tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Getting quotas for project b196bd92b2774a6898c39dc6e99b5674. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:21:24.921021 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-627c9666-7b62-4545-bcf8-8f84b3afac9c tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Getting quotas for user b07308778f1f4b4aa44713715cb2dc5d and project b196bd92b2774a6898c39dc6e99b5674. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:21:24.956441 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-627c9666-7b62-4545-bcf8-8f84b3afac9c tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.364176 Aug 31 16:21:24.964339 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2764/5717] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 31 16:21:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:21:25.201569 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9f03b27d-6c25-4741-acb9-6eafcd4229bb tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:25.214579 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9f03b27d-6c25-4741-acb9-6eafcd4229bb tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e" status: 200 len: 1392 microversion: 2.1 time: 1.515367 Aug 31 16:21:25.216027 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2954/5718] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:23 2022] GET /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e => generated 1392 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:25.373658 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-798b6015-f5ea-40c2-8b34-7507a368bbef tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:25.376178 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-798b6015-f5ea-40c2-8b34-7507a368bbef tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:25.390567 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-798b6015-f5ea-40c2-8b34-7507a368bbef tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:25.391688 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-798b6015-f5ea-40c2-8b34-7507a368bbef tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:25.393833 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-798b6015-f5ea-40c2-8b34-7507a368bbef tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:25.396953 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-798b6015-f5ea-40c2-8b34-7507a368bbef tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:25.397611 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-798b6015-f5ea-40c2-8b34-7507a368bbef tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:25.402083 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-798b6015-f5ea-40c2-8b34-7507a368bbef tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:25.481892 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-798b6015-f5ea-40c2-8b34-7507a368bbef tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.112710 Aug 31 16:21:25.481892 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2765/5719] 10.222.0.50 () {60 vars in 1343 bytes} [Wed Aug 31 16:21:25 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d/os-volume_attachments => generated 25 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:25.700982 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fec67d0d-1cdb-4da0-b8c8-1b112d7624bd tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:25.702367 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fec67d0d-1cdb-4da0-b8c8-1b112d7624bd tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:25.713718 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fec67d0d-1cdb-4da0-b8c8-1b112d7624bd tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:25.714647 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fec67d0d-1cdb-4da0-b8c8-1b112d7624bd tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:25.715175 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fec67d0d-1cdb-4da0-b8c8-1b112d7624bd tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:25.718521 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fec67d0d-1cdb-4da0-b8c8-1b112d7624bd tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:25.719336 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fec67d0d-1cdb-4da0-b8c8-1b112d7624bd tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:25.723155 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fec67d0d-1cdb-4da0-b8c8-1b112d7624bd tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:25.773074 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fec67d0d-1cdb-4da0-b8c8-1b112d7624bd tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:21:26.009741 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ee3ea0d1-e5f6-44b2-a475-0d4d7708650b tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:26.011249 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ee3ea0d1-e5f6-44b2-a475-0d4d7708650b tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 91900503-1200-4e0c-9531-19f602773721] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:26.027345 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee3ea0d1-e5f6-44b2-a475-0d4d7708650b tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:26.027873 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee3ea0d1-e5f6-44b2-a475-0d4d7708650b tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:26.028321 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee3ea0d1-e5f6-44b2-a475-0d4d7708650b tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:26.047483 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee3ea0d1-e5f6-44b2-a475-0d4d7708650b tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:26.048155 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee3ea0d1-e5f6-44b2-a475-0d4d7708650b tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:26.054153 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee3ea0d1-e5f6-44b2-a475-0d4d7708650b tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:26.062995 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fec67d0d-1cdb-4da0-b8c8-1b112d7624bd tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "DELETE /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 204 len: 0 microversion: 2.20 time: 0.357157 Aug 31 16:21:26.066584 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2955/5720] 10.222.0.50 () {60 vars in 1280 bytes} [Wed Aug 31 16:21:25 2022] DELETE /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 16:21:26.100768 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-484de8c5-0af3-444d-a907-49769b71019f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:26.101670 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-484de8c5-0af3-444d-a907-49769b71019f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:26.126843 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-484de8c5-0af3-444d-a907-49769b71019f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:26.137754 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-484de8c5-0af3-444d-a907-49769b71019f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:26.138443 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-484de8c5-0af3-444d-a907-49769b71019f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:26.139231 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-484de8c5-0af3-444d-a907-49769b71019f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:26.139700 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-484de8c5-0af3-444d-a907-49769b71019f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:26.140126 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-484de8c5-0af3-444d-a907-49769b71019f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:26.157953 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ee3ea0d1-e5f6-44b2-a475-0d4d7708650b tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721/ips" status: 200 len: 149 microversion: 2.1 time: 0.145816 Aug 31 16:21:26.158723 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2766/5721] 10.222.0.50 () {58 vars in 1248 bytes} [Wed Aug 31 16:21:26 2022] GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721/ips => generated 149 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:21:26.239379 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2ae8d01d-2941-406e-bda1-22e8d7cb719c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:26.239987 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2ae8d01d-2941-406e-bda1-22e8d7cb719c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 1d359c68-27fb-4b21-ba0c-0d189780d82e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:26.250264 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ae8d01d-2941-406e-bda1-22e8d7cb719c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:26.252728 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ae8d01d-2941-406e-bda1-22e8d7cb719c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:26.254238 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ae8d01d-2941-406e-bda1-22e8d7cb719c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:26.255774 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ae8d01d-2941-406e-bda1-22e8d7cb719c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:26.257848 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ae8d01d-2941-406e-bda1-22e8d7cb719c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:26.260967 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ae8d01d-2941-406e-bda1-22e8d7cb719c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:26.736737 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-484de8c5-0af3-444d-a907-49769b71019f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:26.752867 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-484de8c5-0af3-444d-a907-49769b71019f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:26.755789 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-484de8c5-0af3-444d-a907-49769b71019f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:26.760700 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-484de8c5-0af3-444d-a907-49769b71019f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1721 microversion: 2.20 time: 0.688220 Aug 31 16:21:26.781114 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2956/5722] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:21:26 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1721 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:21:26.830224 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2ae8d01d-2941-406e-bda1-22e8d7cb719c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:26.839527 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2ae8d01d-2941-406e-bda1-22e8d7cb719c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e" status: 200 len: 1392 microversion: 2.1 time: 0.604724 Aug 31 16:21:26.842528 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2767/5723] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:26 2022] GET /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e => generated 1392 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:27.787556 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a8e63510-3772-4193-a36b-a01b7f190da2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:27.788170 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a8e63510-3772-4193-a36b-a01b7f190da2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:27.800885 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a8e63510-3772-4193-a36b-a01b7f190da2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:27.809060 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a8e63510-3772-4193-a36b-a01b7f190da2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:27.814630 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a8e63510-3772-4193-a36b-a01b7f190da2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:27.818411 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a8e63510-3772-4193-a36b-a01b7f190da2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:27.819660 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a8e63510-3772-4193-a36b-a01b7f190da2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:27.840826 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a8e63510-3772-4193-a36b-a01b7f190da2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:27.869105 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-46b7e72b-b2da-45db-81a6-906828a31fce tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:27.870477 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-46b7e72b-b2da-45db-81a6-906828a31fce tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 1d359c68-27fb-4b21-ba0c-0d189780d82e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:27.886421 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46b7e72b-b2da-45db-81a6-906828a31fce tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:27.887660 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46b7e72b-b2da-45db-81a6-906828a31fce tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:27.889128 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46b7e72b-b2da-45db-81a6-906828a31fce tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:27.891584 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46b7e72b-b2da-45db-81a6-906828a31fce tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:27.909590 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46b7e72b-b2da-45db-81a6-906828a31fce tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:27.910325 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46b7e72b-b2da-45db-81a6-906828a31fce tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:28.674271 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-46b7e72b-b2da-45db-81a6-906828a31fce tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:28.688946 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-46b7e72b-b2da-45db-81a6-906828a31fce tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e" status: 200 len: 1392 microversion: 2.1 time: 0.824328 Aug 31 16:21:28.690202 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2768/5724] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:27 2022] GET /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e => generated 1392 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:28.702118 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-9455eb0b-92a2-4671-9034-92458c122966 req-2f85f3ca-8c79-4f99-ad8d-9d1f7ccd6783 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d359c68-27fb-4b21-ba0c-0d189780d82e", "name": "network-vif-plugged", "status": "completed", "tag": "d1610121-0e92-4a46-ab8b-173db528ac07"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:21:28.739787 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9455eb0b-92a2-4671-9034-92458c122966 req-2f85f3ca-8c79-4f99-ad8d-9d1f7ccd6783 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:28.740363 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9455eb0b-92a2-4671-9034-92458c122966 req-2f85f3ca-8c79-4f99-ad8d-9d1f7ccd6783 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:28.740908 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9455eb0b-92a2-4671-9034-92458c122966 req-2f85f3ca-8c79-4f99-ad8d-9d1f7ccd6783 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:28.759881 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-9455eb0b-92a2-4671-9034-92458c122966 req-2f85f3ca-8c79-4f99-ad8d-9d1f7ccd6783 service nova] Creating event network-vif-plugged:d1610121-0e92-4a46-ab8b-173db528ac07 for instance 1d359c68-27fb-4b21-ba0c-0d189780d82e on n-h1-833090-16 Aug 31 16:21:28.765973 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-9455eb0b-92a2-4671-9034-92458c122966 req-2f85f3ca-8c79-4f99-ad8d-9d1f7ccd6783 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074227 Aug 31 16:21:28.766988 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2769/5725] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:21:28.815135 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a8e63510-3772-4193-a36b-a01b7f190da2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:28.832155 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a8e63510-3772-4193-a36b-a01b7f190da2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:28.834575 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a8e63510-3772-4193-a36b-a01b7f190da2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:28.836574 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a8e63510-3772-4193-a36b-a01b7f190da2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1721 microversion: 2.20 time: 1.053244 Aug 31 16:21:28.853317 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2957/5726] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:21:27 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1721 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:21:28.998819 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-aebf5352-1ef6-4971-aa9c-834c93032e1e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "62340300-e545-43e8-8ed0-c47c0c2a6983"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:21:29.003480 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-aebf5352-1ef6-4971-aa9c-834c93032e1e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 91900503-1200-4e0c-9531-19f602773721] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:29.013396 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aebf5352-1ef6-4971-aa9c-834c93032e1e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:29.014207 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aebf5352-1ef6-4971-aa9c-834c93032e1e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:29.014843 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aebf5352-1ef6-4971-aa9c-834c93032e1e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:29.015809 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aebf5352-1ef6-4971-aa9c-834c93032e1e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:29.016479 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aebf5352-1ef6-4971-aa9c-834c93032e1e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:29.017342 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aebf5352-1ef6-4971-aa9c-834c93032e1e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:29.446073 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:21:29.480329 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-aebf5352-1ef6-4971-aa9c-834c93032e1e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "POST /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.488903 Aug 31 16:21:29.481166 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2770/5727] 10.222.0.50 () {60 vars in 1323 bytes} [Wed Aug 31 16:21:28 2022] POST /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721/os-volume_attachments => generated 194 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:21:29.715243 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-bd6f3db7-5073-49d4-a6e6-6e7435074d50 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:29.716053 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-bd6f3db7-5073-49d4-a6e6-6e7435074d50 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 1d359c68-27fb-4b21-ba0c-0d189780d82e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:29.730735 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bd6f3db7-5073-49d4-a6e6-6e7435074d50 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:29.731236 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bd6f3db7-5073-49d4-a6e6-6e7435074d50 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:29.731662 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bd6f3db7-5073-49d4-a6e6-6e7435074d50 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:29.732406 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bd6f3db7-5073-49d4-a6e6-6e7435074d50 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:29.732847 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bd6f3db7-5073-49d4-a6e6-6e7435074d50 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:29.733266 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bd6f3db7-5073-49d4-a6e6-6e7435074d50 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:29.861963 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4bd5c2d6-a26e-4afa-b502-a48a642ff7ca tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:29.862584 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4bd5c2d6-a26e-4afa-b502-a48a642ff7ca tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:29.874889 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4bd5c2d6-a26e-4afa-b502-a48a642ff7ca tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:29.876705 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4bd5c2d6-a26e-4afa-b502-a48a642ff7ca tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:29.882135 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4bd5c2d6-a26e-4afa-b502-a48a642ff7ca tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:29.883296 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4bd5c2d6-a26e-4afa-b502-a48a642ff7ca tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:29.885775 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4bd5c2d6-a26e-4afa-b502-a48a642ff7ca tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:29.888449 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4bd5c2d6-a26e-4afa-b502-a48a642ff7ca tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:30.404866 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4bd5c2d6-a26e-4afa-b502-a48a642ff7ca tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:30.417710 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4bd5c2d6-a26e-4afa-b502-a48a642ff7ca tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:30.419783 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4bd5c2d6-a26e-4afa-b502-a48a642ff7ca tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:30.425827 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4bd5c2d6-a26e-4afa-b502-a48a642ff7ca tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1721 microversion: 2.20 time: 0.566868 Aug 31 16:21:30.426910 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2771/5728] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:21:29 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1721 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:21:30.651703 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-bd6f3db7-5073-49d4-a6e6-6e7435074d50 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:30.669948 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-bd6f3db7-5073-49d4-a6e6-6e7435074d50 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e" status: 200 len: 1392 microversion: 2.1 time: 0.953388 Aug 31 16:21:30.677005 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2958/5729] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:29 2022] GET /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e => generated 1392 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:30.888766 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-713adb8d-2bd8-4801-8b34-c656f556bb66 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-805816434", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "27decff3-e28e-43ba-9fd1-b25d1c847b72"}], "security_groups": [{"name": "tempest-securitygroup--221859707"}], "key_name": "tempest-keypair-1349661177", "user_data": "}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:21:31.087046 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-713adb8d-2bd8-4801-8b34-c656f556bb66 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] validate_networks() for [('27decff3-e28e-43ba-9fd1-b25d1c847b72', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:21:31.336087 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-37a9a71c-12dd-4f8b-b17e-9ededdc9a410 req-e3c2acdd-0f49-4990-8c86-a0de4efd5765 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d", "name": "network-vif-deleted", "tag": "8e4486a0-b7ef-4efa-8a3b-565a37bae537"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:21:31.362878 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-37a9a71c-12dd-4f8b-b17e-9ededdc9a410 req-e3c2acdd-0f49-4990-8c86-a0de4efd5765 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:31.363577 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-37a9a71c-12dd-4f8b-b17e-9ededdc9a410 req-e3c2acdd-0f49-4990-8c86-a0de4efd5765 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:31.364170 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-37a9a71c-12dd-4f8b-b17e-9ededdc9a410 req-e3c2acdd-0f49-4990-8c86-a0de4efd5765 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:31.402042 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-37a9a71c-12dd-4f8b-b17e-9ededdc9a410 req-e3c2acdd-0f49-4990-8c86-a0de4efd5765 service nova] Creating event network-vif-deleted:8e4486a0-b7ef-4efa-8a3b-565a37bae537 for instance 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d on n-h2-833090-16 Aug 31 16:21:31.414465 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-37a9a71c-12dd-4f8b-b17e-9ededdc9a410 req-e3c2acdd-0f49-4990-8c86-a0de4efd5765 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083585 Aug 31 16:21:31.415117 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2959/5730] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:21:31.456771 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9e5b7b07-9b4a-4e49-8777-aca5bbb160c6 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:31.457963 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9e5b7b07-9b4a-4e49-8777-aca5bbb160c6 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:31.470690 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9e5b7b07-9b4a-4e49-8777-aca5bbb160c6 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:31.473421 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9e5b7b07-9b4a-4e49-8777-aca5bbb160c6 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:31.474027 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9e5b7b07-9b4a-4e49-8777-aca5bbb160c6 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:31.478156 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9e5b7b07-9b4a-4e49-8777-aca5bbb160c6 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:31.478857 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9e5b7b07-9b4a-4e49-8777-aca5bbb160c6 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:31.479486 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9e5b7b07-9b4a-4e49-8777-aca5bbb160c6 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:31.576300 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9e5b7b07-9b4a-4e49-8777-aca5bbb160c6 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:31.576858 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9e5b7b07-9b4a-4e49-8777-aca5bbb160c6 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:31.577311 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9e5b7b07-9b4a-4e49-8777-aca5bbb160c6 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:31.577781 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-9e5b7b07-9b4a-4e49-8777-aca5bbb160c6 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lazy-loading 'fault' on Instance uuid 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:21:31.881859 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9e5b7b07-9b4a-4e49-8777-aca5bbb160c6 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:31.919167 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9e5b7b07-9b4a-4e49-8777-aca5bbb160c6 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:31.924775 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9e5b7b07-9b4a-4e49-8777-aca5bbb160c6 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:31.927839 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9e5b7b07-9b4a-4e49-8777-aca5bbb160c6 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 200 len: 1371 microversion: 2.20 time: 0.477580 Aug 31 16:21:31.931891 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2960/5731] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:21:31 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 1371 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:21:31.939605 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fa9241a6-9982-4224-96ec-5ceb4b5fa8aa tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:31.941577 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fa9241a6-9982-4224-96ec-5ceb4b5fa8aa tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 1d359c68-27fb-4b21-ba0c-0d189780d82e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:31.954982 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fa9241a6-9982-4224-96ec-5ceb4b5fa8aa tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:31.956199 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fa9241a6-9982-4224-96ec-5ceb4b5fa8aa tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:31.956943 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fa9241a6-9982-4224-96ec-5ceb4b5fa8aa tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:31.957956 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fa9241a6-9982-4224-96ec-5ceb4b5fa8aa tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:31.961210 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fa9241a6-9982-4224-96ec-5ceb4b5fa8aa tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:31.961851 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fa9241a6-9982-4224-96ec-5ceb4b5fa8aa tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:31.988979 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:21:33.099070 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-fa9241a6-9982-4224-96ec-5ceb4b5fa8aa tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:33.111167 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fa9241a6-9982-4224-96ec-5ceb4b5fa8aa tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e" status: 200 len: 1563 microversion: 2.1 time: 1.177991 Aug 31 16:21:33.114005 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2961/5732] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:31 2022] GET /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e => generated 1563 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:33.119422 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ad5816c4-5791-4b69-be95-09b369422e66 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:33.120033 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ad5816c4-5791-4b69-be95-09b369422e66 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:33.143804 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ad5816c4-5791-4b69-be95-09b369422e66 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:33.144298 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ad5816c4-5791-4b69-be95-09b369422e66 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:33.144745 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ad5816c4-5791-4b69-be95-09b369422e66 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:33.145447 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ad5816c4-5791-4b69-be95-09b369422e66 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:33.145898 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ad5816c4-5791-4b69-be95-09b369422e66 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:33.146394 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ad5816c4-5791-4b69-be95-09b369422e66 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:33.186169 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-ad5816c4-5791-4b69-be95-09b369422e66 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] HTTP exception thrown: Instance 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d could not be found. Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ad5816c4-5791-4b69-be95-09b369422e66 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Request method failure captured: Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d HTTP/1.1 Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4l5U3NKSy3r-XAQdc-6l3YfT_P69zlXi5uwQe-ClIZH8iLT5hwnzXEsrelRX0UCZ_hHcx4I6Wg7kOAh1wQKWVZAXa3XRNpcczjYLIhwfWkYDi26t_SUfryN53-sghrgG-GpwLykvSwQ4FQlCc_7RM5cy0jh4SaXqtu-fmi3qnsSh1g Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: d90aaaaa8d224d939310546fb336b13a Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-44638769 Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d90aaaaa8d224d939310546fb336b13a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d90aaaaa8d224d939310546fb336b13a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d90aaaaa8d224d939310546fb336b13a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d90aaaaa8d224d939310546fb336b13a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-AttachVolumeShelveTestJSON-44638769 Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: d90aaaaa8d224d939310546fb336b13a Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-44638769 Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-AttachVolumeShelveTestJSON-44638769-project Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: ff0a9160ffcc460fb53626cd020fc8b1 Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-AttachVolumeShelveTestJSON-44638769-project Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d could not be found. Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d'} Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d could not be found. Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d could not be found. Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:21:33.187924 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:21:33.192993 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:21:33.192993 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:21:33.192993 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:21:33.192993 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:21:33.192993 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:21:33.192993 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:21:33.192993 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d could not be found. Aug 31 16:21:33.192993 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:21:33.192993 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ad5816c4-5791-4b69-be95-09b369422e66 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Returning 404 to user: Instance 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:21:33.192993 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ad5816c4-5791-4b69-be95-09b369422e66 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 404 len: 111 microversion: 2.20 time: 0.074347 Aug 31 16:21:33.195061 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2962/5733] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:21:33 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:21:33.201366 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-459974a6-2971-430d-b65a-31093dc1ff21 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:33.201993 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-459974a6-2971-430d-b65a-31093dc1ff21 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 1d359c68-27fb-4b21-ba0c-0d189780d82e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:33.219519 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-459974a6-2971-430d-b65a-31093dc1ff21 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:33.220222 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-459974a6-2971-430d-b65a-31093dc1ff21 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:33.220842 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-459974a6-2971-430d-b65a-31093dc1ff21 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:33.222117 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-459974a6-2971-430d-b65a-31093dc1ff21 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:33.222817 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-459974a6-2971-430d-b65a-31093dc1ff21 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:33.224090 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-459974a6-2971-430d-b65a-31093dc1ff21 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:33.492000 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-713adb8d-2bd8-4801-8b34-c656f556bb66 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:21:33.493642 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-713adb8d-2bd8-4801-8b34-c656f556bb66 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:21:33.494770 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-713adb8d-2bd8-4801-8b34-c656f556bb66 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:21:33.495360 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-713adb8d-2bd8-4801-8b34-c656f556bb66 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:21:33.496406 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-713adb8d-2bd8-4801-8b34-c656f556bb66 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:21:33.527870 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-713adb8d-2bd8-4801-8b34-c656f556bb66 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:33.528365 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-713adb8d-2bd8-4801-8b34-c656f556bb66 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:33.528933 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-713adb8d-2bd8-4801-8b34-c656f556bb66 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:33.530079 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-713adb8d-2bd8-4801-8b34-c656f556bb66 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:33.530591 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-713adb8d-2bd8-4801-8b34-c656f556bb66 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:33.541428 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-713adb8d-2bd8-4801-8b34-c656f556bb66 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:33.577511 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-713adb8d-2bd8-4801-8b34-c656f556bb66 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Getting quotas for project b196bd92b2774a6898c39dc6e99b5674. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:21:33.589681 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-713adb8d-2bd8-4801-8b34-c656f556bb66 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Getting quotas for user b07308778f1f4b4aa44713715cb2dc5d and project b196bd92b2774a6898c39dc6e99b5674. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:21:33.609592 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-713adb8d-2bd8-4801-8b34-c656f556bb66 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:21:33.613962 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-713adb8d-2bd8-4801-8b34-c656f556bb66 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:21:33.759852 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-713adb8d-2bd8-4801-8b34-c656f556bb66 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.875654 Aug 31 16:21:33.760532 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2772/5734] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:21:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 2877 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:21:33.779912 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-89e76946-a308-4dad-bff1-a9433cd5d5d8 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '.version_select at 0x7fbb4ab6ca60>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:33.817437 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-89e76946-a308-4dad-bff1-a9433cd5d5d8 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-877623517" status: 204 len: 0 microversion: 2.20 time: 0.054009 Aug 31 16:21:33.818324 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2773/5735] 10.222.0.50 () {60 vars in 1259 bytes} [Wed Aug 31 16:21:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-877623517 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 16:21:33.825164 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-39f338b5-cea3-4cf8-aa34-15738f4514ff tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:33.826123 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-39f338b5-cea3-4cf8-aa34-15738f4514ff tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:33.898559 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-459974a6-2971-430d-b65a-31093dc1ff21 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:33.923849 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-459974a6-2971-430d-b65a-31093dc1ff21 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e" status: 200 len: 1563 microversion: 2.1 time: 0.724754 Aug 31 16:21:33.930406 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2963/5736] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:33 2022] GET /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e => generated 1563 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:33.937760 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-39f338b5-cea3-4cf8-aa34-15738f4514ff tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:33.945342 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-39f338b5-cea3-4cf8-aa34-15738f4514ff tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b" status: 200 len: 1237 microversion: 2.1 time: 0.125257 Aug 31 16:21:33.979685 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2774/5737] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:33 2022] GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b => generated 1237 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:34.977712 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-51fc1103-352f-4c38-ba20-af6a14ee202e tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:34.979338 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-51fc1103-352f-4c38-ba20-af6a14ee202e tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:34.992785 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51fc1103-352f-4c38-ba20-af6a14ee202e tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:34.992946 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51fc1103-352f-4c38-ba20-af6a14ee202e tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:34.993376 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51fc1103-352f-4c38-ba20-af6a14ee202e tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:34.994132 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51fc1103-352f-4c38-ba20-af6a14ee202e tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:34.994666 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51fc1103-352f-4c38-ba20-af6a14ee202e tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:34.994984 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51fc1103-352f-4c38-ba20-af6a14ee202e tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:35.183369 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-51fc1103-352f-4c38-ba20-af6a14ee202e tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:35.201081 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-51fc1103-352f-4c38-ba20-af6a14ee202e tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b" status: 200 len: 1233 microversion: 2.1 time: 0.223855 Aug 31 16:21:35.201971 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2964/5738] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:34 2022] GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b => generated 1233 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:35.295410 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9fd7f2e2-2b8a-4d01-a995-261e784334e4 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Action: 'create', calling method: .version_select at 0x7fbb45bc2700>, body: {"keypair": {"name": "tempest-keypair-203274708", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAHuLpI5F9BlVCv6v6e7cM/gIuY+ETn/crOIiYEVVADeVh1r/sFQcZp2KVxSxvoEY+xgceudtmmiTyA/yA6JoA/wk5XxqjnCXZb+jPj8ccKF/DuAfeBucG7PhmyWW53+/w=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:21:35.332281 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-9fd7f2e2-2b8a-4d01-a995-261e784334e4 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Getting quotas for project d90aaaaa8d224d939310546fb336b13a. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:21:35.342306 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-9fd7f2e2-2b8a-4d01-a995-261e784334e4 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Getting quotas for user ff0a9160ffcc460fb53626cd020fc8b1 and project d90aaaaa8d224d939310546fb336b13a. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:21:35.383437 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9fd7f2e2-2b8a-4d01-a995-261e784334e4 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.093741 Aug 31 16:21:35.393652 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2775/5739] 10.222.0.50 () {62 vars in 1200 bytes} [Wed Aug 31 16:21:35 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 107 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 31 16:21:36.224885 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-31e4c539-36e2-4d49-8412-caaf20342ce2 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:36.226129 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-31e4c539-36e2-4d49-8412-caaf20342ce2 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:36.235357 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-31e4c539-36e2-4d49-8412-caaf20342ce2 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:36.236174 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-31e4c539-36e2-4d49-8412-caaf20342ce2 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:36.236749 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-31e4c539-36e2-4d49-8412-caaf20342ce2 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:36.237617 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-31e4c539-36e2-4d49-8412-caaf20342ce2 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:36.239349 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-31e4c539-36e2-4d49-8412-caaf20342ce2 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:36.239927 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-31e4c539-36e2-4d49-8412-caaf20342ce2 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:36.388386 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-31e4c539-36e2-4d49-8412-caaf20342ce2 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:36.400051 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-31e4c539-36e2-4d49-8412-caaf20342ce2 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b" status: 200 len: 1295 microversion: 2.1 time: 0.180913 Aug 31 16:21:36.401125 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2965/5740] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:36 2022] GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b => generated 1295 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:37.421058 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-eda3a32a-297c-464d-9292-adad2485261c tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:37.421694 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-eda3a32a-297c-464d-9292-adad2485261c tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:37.437316 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eda3a32a-297c-464d-9292-adad2485261c tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:37.438042 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eda3a32a-297c-464d-9292-adad2485261c tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:37.438684 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eda3a32a-297c-464d-9292-adad2485261c tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:37.439429 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eda3a32a-297c-464d-9292-adad2485261c tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:37.439861 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eda3a32a-297c-464d-9292-adad2485261c tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:37.440278 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eda3a32a-297c-464d-9292-adad2485261c tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:37.945726 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-eda3a32a-297c-464d-9292-adad2485261c tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:37.955062 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-eda3a32a-297c-464d-9292-adad2485261c tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b" status: 200 len: 1362 microversion: 2.1 time: 0.537647 Aug 31 16:21:37.971413 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2776/5741] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:37 2022] GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b => generated 1362 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:38.995138 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3302c051-dc74-4205-834f-d2d64f0e49c5 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:38.996114 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3302c051-dc74-4205-834f-d2d64f0e49c5 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:39.008040 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3302c051-dc74-4205-834f-d2d64f0e49c5 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:39.008615 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3302c051-dc74-4205-834f-d2d64f0e49c5 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:39.009156 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3302c051-dc74-4205-834f-d2d64f0e49c5 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:39.010072 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3302c051-dc74-4205-834f-d2d64f0e49c5 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:39.011278 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3302c051-dc74-4205-834f-d2d64f0e49c5 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:39.011961 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3302c051-dc74-4205-834f-d2d64f0e49c5 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:39.249184 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-b4506bd0-054e-4604-b0f0-be24e9f6707a req-6025760a-00be-49fe-b090-502f7184d1d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27172556-b12c-4974-815d-5f893a07506b", "tag": "fb8f078c-683b-4fe5-9e14-600f0922bd16"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:21:39.260662 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b4506bd0-054e-4604-b0f0-be24e9f6707a req-6025760a-00be-49fe-b090-502f7184d1d7 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:39.261533 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b4506bd0-054e-4604-b0f0-be24e9f6707a req-6025760a-00be-49fe-b090-502f7184d1d7 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:39.262218 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b4506bd0-054e-4604-b0f0-be24e9f6707a req-6025760a-00be-49fe-b090-502f7184d1d7 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:39.275524 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-b4506bd0-054e-4604-b0f0-be24e9f6707a req-6025760a-00be-49fe-b090-502f7184d1d7 service nova] Creating event network-changed:fb8f078c-683b-4fe5-9e14-600f0922bd16 for instance 27172556-b12c-4974-815d-5f893a07506b on n-h2-833090-16 Aug 31 16:21:39.288660 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-b4506bd0-054e-4604-b0f0-be24e9f6707a req-6025760a-00be-49fe-b090-502f7184d1d7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042745 Aug 31 16:21:39.289622 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2777/5742] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:21:39.411196 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3302c051-dc74-4205-834f-d2d64f0e49c5 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:39.419733 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3302c051-dc74-4205-834f-d2d64f0e49c5 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b" status: 200 len: 1362 microversion: 2.1 time: 0.433695 Aug 31 16:21:39.434135 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2966/5743] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:38 2022] GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b => generated 1362 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:40.148702 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ca0616aa-a7e8-4beb-ab09-cf8588eba26d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1281680143", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dbf6a81d-1fbd-491e-aa02-c65a1c371d16"}], "security_groups": [{"name": "tempest-securitygroup--243331988"}], "key_name": "tempest-keypair-203274708", "user_data": "}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:21:40.201506 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d6d18bec-c6d1-4d29-8c54-07a914141084 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:40.203147 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d6d18bec-c6d1-4d29-8c54-07a914141084 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 1d359c68-27fb-4b21-ba0c-0d189780d82e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:40.214767 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d6d18bec-c6d1-4d29-8c54-07a914141084 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:40.218697 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d6d18bec-c6d1-4d29-8c54-07a914141084 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:40.219411 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d6d18bec-c6d1-4d29-8c54-07a914141084 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:40.222621 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d6d18bec-c6d1-4d29-8c54-07a914141084 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:40.223317 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d6d18bec-c6d1-4d29-8c54-07a914141084 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:40.223911 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d6d18bec-c6d1-4d29-8c54-07a914141084 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:40.407026 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-ca0616aa-a7e8-4beb-ab09-cf8588eba26d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] validate_networks() for [('dbf6a81d-1fbd-491e-aa02-c65a1c371d16', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:21:40.648510 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d6d18bec-c6d1-4d29-8c54-07a914141084 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:40.665695 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d6d18bec-c6d1-4d29-8c54-07a914141084 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e" status: 200 len: 1563 microversion: 2.1 time: 0.468368 Aug 31 16:21:40.667181 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2967/5744] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:40 2022] GET /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e => generated 1563 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:40.832652 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-3bd8aa37-fcb5-48ab-8a1b-7c16d5fcd8a3 req-72227a04-2a1f-40d8-9b90-a69170873816 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d359c68-27fb-4b21-ba0c-0d189780d82e", "tag": "d1610121-0e92-4a46-ab8b-173db528ac07"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:21:40.858135 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-3bd8aa37-fcb5-48ab-8a1b-7c16d5fcd8a3 req-72227a04-2a1f-40d8-9b90-a69170873816 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:40.860800 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-3bd8aa37-fcb5-48ab-8a1b-7c16d5fcd8a3 req-72227a04-2a1f-40d8-9b90-a69170873816 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:40.861526 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-3bd8aa37-fcb5-48ab-8a1b-7c16d5fcd8a3 req-72227a04-2a1f-40d8-9b90-a69170873816 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:40.885163 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-3bd8aa37-fcb5-48ab-8a1b-7c16d5fcd8a3 req-72227a04-2a1f-40d8-9b90-a69170873816 service nova] Creating event network-changed:d1610121-0e92-4a46-ab8b-173db528ac07 for instance 1d359c68-27fb-4b21-ba0c-0d189780d82e on n-h1-833090-16 Aug 31 16:21:40.900387 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-3bd8aa37-fcb5-48ab-8a1b-7c16d5fcd8a3 req-72227a04-2a1f-40d8-9b90-a69170873816 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.231772 Aug 31 16:21:40.901245 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2968/5745] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:21:40.907041 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-15674095-d4f0-4ee4-acb0-a3519195aeda tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:40.917442 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-15674095-d4f0-4ee4-acb0-a3519195aeda tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:40.939162 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-15674095-d4f0-4ee4-acb0-a3519195aeda tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:40.940037 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-15674095-d4f0-4ee4-acb0-a3519195aeda tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:40.940716 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-15674095-d4f0-4ee4-acb0-a3519195aeda tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:40.941949 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-15674095-d4f0-4ee4-acb0-a3519195aeda tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:40.942646 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-15674095-d4f0-4ee4-acb0-a3519195aeda tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:40.943289 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-15674095-d4f0-4ee4-acb0-a3519195aeda tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:42.244145 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-15674095-d4f0-4ee4-acb0-a3519195aeda tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:42.255668 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-15674095-d4f0-4ee4-acb0-a3519195aeda tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b" status: 200 len: 1362 microversion: 2.1 time: 1.352725 Aug 31 16:21:42.256354 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2969/5746] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:40 2022] GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b => generated 1362 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:42.274385 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ca0616aa-a7e8-4beb-ab09-cf8588eba26d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:21:42.274836 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ca0616aa-a7e8-4beb-ab09-cf8588eba26d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:21:42.275259 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ca0616aa-a7e8-4beb-ab09-cf8588eba26d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:21:42.275666 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ca0616aa-a7e8-4beb-ab09-cf8588eba26d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:21:42.276074 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ca0616aa-a7e8-4beb-ab09-cf8588eba26d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:21:42.289646 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca0616aa-a7e8-4beb-ab09-cf8588eba26d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:42.291467 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca0616aa-a7e8-4beb-ab09-cf8588eba26d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:42.292566 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca0616aa-a7e8-4beb-ab09-cf8588eba26d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:42.294570 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca0616aa-a7e8-4beb-ab09-cf8588eba26d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:42.295198 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca0616aa-a7e8-4beb-ab09-cf8588eba26d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:42.295823 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ca0616aa-a7e8-4beb-ab09-cf8588eba26d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:42.315091 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:21:42.324004 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-ca0616aa-a7e8-4beb-ab09-cf8588eba26d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Getting quotas for project d90aaaaa8d224d939310546fb336b13a. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:21:42.343973 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-ca0616aa-a7e8-4beb-ab09-cf8588eba26d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Getting quotas for user ff0a9160ffcc460fb53626cd020fc8b1 and project d90aaaaa8d224d939310546fb336b13a. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:21:42.365777 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ca0616aa-a7e8-4beb-ab09-cf8588eba26d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:21:42.368662 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ca0616aa-a7e8-4beb-ab09-cf8588eba26d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:21:42.459454 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ca0616aa-a7e8-4beb-ab09-cf8588eba26d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.317070 Aug 31 16:21:42.468890 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2778/5747] 10.222.0.50 () {62 vars in 1188 bytes} [Wed Aug 31 16:21:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 2328 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 31 16:21:42.473270 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-552bdaa0-ce9a-469d-bb80-803933482990 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:42.474023 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-552bdaa0-ce9a-469d-bb80-803933482990 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:42.476224 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:21:42.727000 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-552bdaa0-ce9a-469d-bb80-803933482990 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:42.754045 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-552bdaa0-ce9a-469d-bb80-803933482990 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:42.756180 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-552bdaa0-ce9a-469d-bb80-803933482990 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:42.761509 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-552bdaa0-ce9a-469d-bb80-803933482990 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1281 microversion: 2.20 time: 0.292147 Aug 31 16:21:42.763423 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2970/5748] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:21:42 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1281 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:21:43.293774 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2e5c3df2-427c-41bf-b9fc-89fbcdd611c4 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:43.296517 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2e5c3df2-427c-41bf-b9fc-89fbcdd611c4 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:43.315986 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e5c3df2-427c-41bf-b9fc-89fbcdd611c4 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:43.316484 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e5c3df2-427c-41bf-b9fc-89fbcdd611c4 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:43.316909 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e5c3df2-427c-41bf-b9fc-89fbcdd611c4 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:43.320618 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e5c3df2-427c-41bf-b9fc-89fbcdd611c4 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:43.321660 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e5c3df2-427c-41bf-b9fc-89fbcdd611c4 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:43.322338 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e5c3df2-427c-41bf-b9fc-89fbcdd611c4 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:43.645860 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2e5c3df2-427c-41bf-b9fc-89fbcdd611c4 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:43.656464 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2e5c3df2-427c-41bf-b9fc-89fbcdd611c4 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b" status: 200 len: 1362 microversion: 2.1 time: 0.382968 Aug 31 16:21:43.672019 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2779/5749] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:43 2022] GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b => generated 1362 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:43.785005 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-217f24ae-a8b7-4f1d-a9c7-dc6bac0493f7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:43.786620 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-217f24ae-a8b7-4f1d-a9c7-dc6bac0493f7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:43.798879 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-217f24ae-a8b7-4f1d-a9c7-dc6bac0493f7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:43.806511 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-217f24ae-a8b7-4f1d-a9c7-dc6bac0493f7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:43.807297 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-217f24ae-a8b7-4f1d-a9c7-dc6bac0493f7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:43.808378 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-217f24ae-a8b7-4f1d-a9c7-dc6bac0493f7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:43.808993 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-217f24ae-a8b7-4f1d-a9c7-dc6bac0493f7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:43.809777 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-217f24ae-a8b7-4f1d-a9c7-dc6bac0493f7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:43.956863 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-217f24ae-a8b7-4f1d-a9c7-dc6bac0493f7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:43.968557 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-217f24ae-a8b7-4f1d-a9c7-dc6bac0493f7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:43.971272 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-217f24ae-a8b7-4f1d-a9c7-dc6bac0493f7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:43.973155 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-217f24ae-a8b7-4f1d-a9c7-dc6bac0493f7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1333 microversion: 2.20 time: 0.192161 Aug 31 16:21:43.989127 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2971/5750] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:21:43 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1333 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:21:44.681352 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7888cb88-19c8-4be4-ac56-8286dda0a676 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:44.682785 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7888cb88-19c8-4be4-ac56-8286dda0a676 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:44.697000 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7888cb88-19c8-4be4-ac56-8286dda0a676 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:44.698464 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7888cb88-19c8-4be4-ac56-8286dda0a676 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:44.700452 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7888cb88-19c8-4be4-ac56-8286dda0a676 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:44.706053 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7888cb88-19c8-4be4-ac56-8286dda0a676 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:44.706793 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7888cb88-19c8-4be4-ac56-8286dda0a676 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:44.707345 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7888cb88-19c8-4be4-ac56-8286dda0a676 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:44.979929 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7888cb88-19c8-4be4-ac56-8286dda0a676 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:44.988095 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7888cb88-19c8-4be4-ac56-8286dda0a676 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b" status: 200 len: 1362 microversion: 2.1 time: 0.312928 Aug 31 16:21:44.989094 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2780/5751] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:44 2022] GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b => generated 1362 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:45.007399 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e7e6f198-41d9-42bc-9d26-d2b7f229b77f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:45.008080 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e7e6f198-41d9-42bc-9d26-d2b7f229b77f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:45.018139 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7e6f198-41d9-42bc-9d26-d2b7f229b77f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:45.022322 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7e6f198-41d9-42bc-9d26-d2b7f229b77f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:45.022767 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7e6f198-41d9-42bc-9d26-d2b7f229b77f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:45.023531 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7e6f198-41d9-42bc-9d26-d2b7f229b77f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:45.023990 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7e6f198-41d9-42bc-9d26-d2b7f229b77f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:45.024417 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7e6f198-41d9-42bc-9d26-d2b7f229b77f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:45.125085 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e7e6f198-41d9-42bc-9d26-d2b7f229b77f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:45.139108 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e7e6f198-41d9-42bc-9d26-d2b7f229b77f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:45.141161 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e7e6f198-41d9-42bc-9d26-d2b7f229b77f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:45.142568 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e7e6f198-41d9-42bc-9d26-d2b7f229b77f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1339 microversion: 2.20 time: 0.139224 Aug 31 16:21:45.143909 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2972/5752] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:21:45 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1339 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:21:46.010070 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e4e0fa0e-946b-4598-ab68-28127301ad97 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:46.010673 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e4e0fa0e-946b-4598-ab68-28127301ad97 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:46.030581 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4e0fa0e-946b-4598-ab68-28127301ad97 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:46.031071 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4e0fa0e-946b-4598-ab68-28127301ad97 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:46.031504 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4e0fa0e-946b-4598-ab68-28127301ad97 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:46.032205 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4e0fa0e-946b-4598-ab68-28127301ad97 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:46.032645 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4e0fa0e-946b-4598-ab68-28127301ad97 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:46.033065 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e4e0fa0e-946b-4598-ab68-28127301ad97 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:46.166298 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0401d71f-5300-4b48-a472-8069337a8c1f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:46.167424 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0401d71f-5300-4b48-a472-8069337a8c1f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:46.180565 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0401d71f-5300-4b48-a472-8069337a8c1f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:46.181066 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0401d71f-5300-4b48-a472-8069337a8c1f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:46.181508 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0401d71f-5300-4b48-a472-8069337a8c1f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:46.184726 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0401d71f-5300-4b48-a472-8069337a8c1f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:46.185312 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0401d71f-5300-4b48-a472-8069337a8c1f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:46.185755 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0401d71f-5300-4b48-a472-8069337a8c1f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:46.233526 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e4e0fa0e-946b-4598-ab68-28127301ad97 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:46.245643 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e4e0fa0e-946b-4598-ab68-28127301ad97 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b" status: 200 len: 1362 microversion: 2.1 time: 0.240200 Aug 31 16:21:46.247101 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2781/5753] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:46 2022] GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b => generated 1362 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:46.425702 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0401d71f-5300-4b48-a472-8069337a8c1f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:46.458941 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0401d71f-5300-4b48-a472-8069337a8c1f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:46.467595 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0401d71f-5300-4b48-a472-8069337a8c1f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:46.475930 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0401d71f-5300-4b48-a472-8069337a8c1f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1406 microversion: 2.20 time: 0.308956 Aug 31 16:21:46.476857 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2973/5754] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:21:46 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1406 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:21:46.761773 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-e3926fab-9702-4855-aa4b-1a274e0623fb req-d1a2f0f3-7ad6-4ee2-a517-46a07c329859 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27172556-b12c-4974-815d-5f893a07506b", "name": "network-vif-plugged", "status": "completed", "tag": "fb8f078c-683b-4fe5-9e14-600f0922bd16"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:21:46.779758 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e3926fab-9702-4855-aa4b-1a274e0623fb req-d1a2f0f3-7ad6-4ee2-a517-46a07c329859 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:46.780237 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e3926fab-9702-4855-aa4b-1a274e0623fb req-d1a2f0f3-7ad6-4ee2-a517-46a07c329859 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:46.780662 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e3926fab-9702-4855-aa4b-1a274e0623fb req-d1a2f0f3-7ad6-4ee2-a517-46a07c329859 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:46.827501 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-e3926fab-9702-4855-aa4b-1a274e0623fb req-d1a2f0f3-7ad6-4ee2-a517-46a07c329859 service nova] Creating event network-vif-plugged:fb8f078c-683b-4fe5-9e14-600f0922bd16 for instance 27172556-b12c-4974-815d-5f893a07506b on n-h2-833090-16 Aug 31 16:21:46.853746 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-e3926fab-9702-4855-aa4b-1a274e0623fb req-d1a2f0f3-7ad6-4ee2-a517-46a07c329859 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084764 Aug 31 16:21:46.858465 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2782/5755] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:21:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:21:47.088078 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-341fb0fc-e69a-404f-a0c2-3283af1750a0 req-5b4feec1-e480-4572-82b2-5c61587b3512 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42064ec8-1aec-498c-8ed7-7c1683963dae", "tag": "8298d82a-a2b4-4bc9-b94c-40f87ac42aa3"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:21:47.119790 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-341fb0fc-e69a-404f-a0c2-3283af1750a0 req-5b4feec1-e480-4572-82b2-5c61587b3512 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:47.126074 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-341fb0fc-e69a-404f-a0c2-3283af1750a0 req-5b4feec1-e480-4572-82b2-5c61587b3512 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:47.126769 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-341fb0fc-e69a-404f-a0c2-3283af1750a0 req-5b4feec1-e480-4572-82b2-5c61587b3512 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:47.159757 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-341fb0fc-e69a-404f-a0c2-3283af1750a0 req-5b4feec1-e480-4572-82b2-5c61587b3512 service nova] Creating event network-changed:8298d82a-a2b4-4bc9-b94c-40f87ac42aa3 for instance 42064ec8-1aec-498c-8ed7-7c1683963dae on n-h1-833090-16 Aug 31 16:21:47.165884 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-341fb0fc-e69a-404f-a0c2-3283af1750a0 req-5b4feec1-e480-4572-82b2-5c61587b3512 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082090 Aug 31 16:21:47.166783 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2974/5756] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:21:47.272113 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-26730284-e283-40a9-96ed-be1bc32ffe7c tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:47.272836 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-26730284-e283-40a9-96ed-be1bc32ffe7c tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:47.284669 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26730284-e283-40a9-96ed-be1bc32ffe7c tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:47.285160 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26730284-e283-40a9-96ed-be1bc32ffe7c tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:47.286904 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26730284-e283-40a9-96ed-be1bc32ffe7c tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:47.288847 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26730284-e283-40a9-96ed-be1bc32ffe7c tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:47.289668 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26730284-e283-40a9-96ed-be1bc32ffe7c tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:47.290120 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-26730284-e283-40a9-96ed-be1bc32ffe7c tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:47.504740 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-409fd338-9a27-4cb7-867b-333876a5a5c9 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:47.505735 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-409fd338-9a27-4cb7-867b-333876a5a5c9 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:47.516922 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-409fd338-9a27-4cb7-867b-333876a5a5c9 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:47.517617 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-409fd338-9a27-4cb7-867b-333876a5a5c9 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:47.518159 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-409fd338-9a27-4cb7-867b-333876a5a5c9 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:47.519337 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-409fd338-9a27-4cb7-867b-333876a5a5c9 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:47.520014 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-409fd338-9a27-4cb7-867b-333876a5a5c9 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:47.520635 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-409fd338-9a27-4cb7-867b-333876a5a5c9 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:47.549099 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-26730284-e283-40a9-96ed-be1bc32ffe7c tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:47.563774 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-26730284-e283-40a9-96ed-be1bc32ffe7c tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b" status: 200 len: 1362 microversion: 2.1 time: 0.294756 Aug 31 16:21:47.564431 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2783/5757] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:47 2022] GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b => generated 1362 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:47.741629 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-409fd338-9a27-4cb7-867b-333876a5a5c9 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:47.753399 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-409fd338-9a27-4cb7-867b-333876a5a5c9 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:47.755349 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-409fd338-9a27-4cb7-867b-333876a5a5c9 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:47.756751 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-409fd338-9a27-4cb7-867b-333876a5a5c9 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1406 microversion: 2.20 time: 0.256688 Aug 31 16:21:47.770834 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2975/5758] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:21:47 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1406 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:21:48.587537 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b83577aa-ae35-4969-8a08-d1ec872446aa tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:48.588684 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b83577aa-ae35-4969-8a08-d1ec872446aa tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:48.596630 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b83577aa-ae35-4969-8a08-d1ec872446aa tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:48.597331 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b83577aa-ae35-4969-8a08-d1ec872446aa tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:48.597974 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b83577aa-ae35-4969-8a08-d1ec872446aa tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:48.598912 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b83577aa-ae35-4969-8a08-d1ec872446aa tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:48.599539 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b83577aa-ae35-4969-8a08-d1ec872446aa tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:48.600131 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b83577aa-ae35-4969-8a08-d1ec872446aa tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:48.765204 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b83577aa-ae35-4969-8a08-d1ec872446aa tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:48.780338 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f9b00c72-39e2-4fdf-a0ae-3d6ebd0afaa0 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:48.781609 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f9b00c72-39e2-4fdf-a0ae-3d6ebd0afaa0 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:48.788396 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f9b00c72-39e2-4fdf-a0ae-3d6ebd0afaa0 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:48.788872 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f9b00c72-39e2-4fdf-a0ae-3d6ebd0afaa0 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:48.791152 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b83577aa-ae35-4969-8a08-d1ec872446aa tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b" status: 200 len: 1362 microversion: 2.1 time: 0.208147 Aug 31 16:21:48.791765 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2784/5759] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:48 2022] GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b => generated 1362 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:21:48.792309 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f9b00c72-39e2-4fdf-a0ae-3d6ebd0afaa0 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:48.793301 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f9b00c72-39e2-4fdf-a0ae-3d6ebd0afaa0 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:48.793993 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f9b00c72-39e2-4fdf-a0ae-3d6ebd0afaa0 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:48.794674 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f9b00c72-39e2-4fdf-a0ae-3d6ebd0afaa0 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:48.956448 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f9b00c72-39e2-4fdf-a0ae-3d6ebd0afaa0 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:48.992104 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f9b00c72-39e2-4fdf-a0ae-3d6ebd0afaa0 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:48.993981 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f9b00c72-39e2-4fdf-a0ae-3d6ebd0afaa0 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:49.002458 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f9b00c72-39e2-4fdf-a0ae-3d6ebd0afaa0 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1406 microversion: 2.20 time: 0.221656 Aug 31 16:21:49.002458 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2976/5760] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:21:48 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1406 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:21:49.730324 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c0efc501-f628-4c4b-93c7-fa88538fc958 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "62340300-e545-43e8-8ed0-c47c0c2a6983"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:21:49.733915 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c0efc501-f628-4c4b-93c7-fa88538fc958 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 91900503-1200-4e0c-9531-19f602773721] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:49.748437 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0efc501-f628-4c4b-93c7-fa88538fc958 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:49.748804 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0efc501-f628-4c4b-93c7-fa88538fc958 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:49.751455 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0efc501-f628-4c4b-93c7-fa88538fc958 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:49.754952 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0efc501-f628-4c4b-93c7-fa88538fc958 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:49.755428 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0efc501-f628-4c4b-93c7-fa88538fc958 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:49.756059 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0efc501-f628-4c4b-93c7-fa88538fc958 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:49.814790 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-328c5ca8-7d5a-495a-b183-657b97c80846 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:49.816056 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-328c5ca8-7d5a-495a-b183-657b97c80846 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:49.828337 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-328c5ca8-7d5a-495a-b183-657b97c80846 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:49.828828 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-328c5ca8-7d5a-495a-b183-657b97c80846 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:49.829580 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-328c5ca8-7d5a-495a-b183-657b97c80846 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:49.832232 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-328c5ca8-7d5a-495a-b183-657b97c80846 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:49.834508 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-328c5ca8-7d5a-495a-b183-657b97c80846 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:49.835283 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-328c5ca8-7d5a-495a-b183-657b97c80846 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:49.917360 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-c0efc501-f628-4c4b-93c7-fa88538fc958 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] HTTP exception thrown: Invalid volume: volume 62340300-e545-43e8-8ed0-c47c0c2a6983 is already attached to instances: 91900503-1200-4e0c-9531-19f602773721 Aug 31 16:21:49.919885 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c0efc501-f628-4c4b-93c7-fa88538fc958 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Request method failure captured: Aug 31 16:21:49.919885 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721/os-volume_attachments HTTP/1.1 Aug 31 16:21:49.919885 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:21:49.919885 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:21:49.919885 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:21:49.919885 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 74 Aug 31 16:21:49.919885 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:21:49.919885 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:21:49.919885 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:21:49.919885 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:21:49.919885 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4jmnQUplwr8AbbPZFrGxW4cxkzmu6dBR1PW9StPm7lwt758HQoCfwjfTobZNcY1qtMPO8jDX-KXtXLta2nSjy7PGTgxIA8J9_334X72rGtCeQYm6RDS4nOjdET00Y60PMzSq7EOVRAdi656mkiv_ceC-3aVenrz44MCAB3Nc0UBrjk Aug 31 16:21:49.919885 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:21:49.919885 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:21:49.919885 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:21:49.919885 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:21:49.919885 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:21:49.919885 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:21:49.919885 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: c3cdfdf921af4bc59c5c2fea1287b598 Aug 31 16:21:49.919885 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-AttachVolumeNegativeTest-1670272717 Aug 31 16:21:49.919885 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:21:49.919885 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:21:49.919885 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c3cdfdf921af4bc59c5c2fea1287b598"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c3cdfdf921af4bc59c5c2fea1287b598"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c3cdfdf921af4bc59c5c2fea1287b598"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c3cdfdf921af4bc59c5c2fea1287b598", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:21:49.919885 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-AttachVolumeNegativeTest-1670272717 Aug 31 16:21:49.919885 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: c3cdfdf921af4bc59c5c2fea1287b598 Aug 31 16:21:49.919885 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1670272717 Aug 31 16:21:49.919885 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-AttachVolumeNegativeTest-1670272717-project Aug 31 16:21:49.919885 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:21:49.919885 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:21:49.919885 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 6f95e357d68d4ad4a5eedbb08b41c5c1 Aug 31 16:21:49.919885 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-AttachVolumeNegativeTest-1670272717-project Aug 31 16:21:49.919885 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 16:21:49.919885 n-d-833090-16 devstack@n-api.service[128863]: {"volumeAttachment": {"volumeId": "62340300-e545-43e8-8ed0-c47c0c2a6983"}} Aug 31 16:21:49.919885 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:21:49.919885 n-d-833090-16 devstack@n-api.service[128863]: exception: Invalid volume: volume 62340300-e545-43e8-8ed0-c47c0c2a6983 is already attached to instances: 91900503-1200-4e0c-9531-19f602773721 Aug 31 16:21:49.919885 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'server_id': '91900503-1200-4e0c-9531-19f602773721', 'body': {'volumeAttachment': {'volumeId': '62340300-e545-43e8-8ed0-c47c0c2a6983'}}} Aug 31 16:21:49.919885 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:21:49.919885 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:21:49.919885 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 31 16:21:49.919885 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 31 16:21:49.919885 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 16:21:49.919885 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 16:21:49.919885 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 16:21:49.919885 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 16:21:49.919885 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 31 16:21:49.919885 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 31 16:21:49.919885 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 31 16:21:49.919885 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 31 16:21:49.919885 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 62340300-e545-43e8-8ed0-c47c0c2a6983 is already attached to instances: 91900503-1200-4e0c-9531-19f602773721 Aug 31 16:21:49.919885 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:21:49.919885 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:21:49.919885 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:21:49.919885 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:21:49.919885 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:21:49.919885 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:21:49.919885 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:21:49.919885 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:21:49.919885 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:21:49.919885 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:21:49.919885 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:21:49.919885 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:21:49.919885 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:21:49.919885 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:21:49.924504 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:21:49.924504 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:21:49.924504 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 31 16:21:49.924504 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 16:21:49.924504 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 62340300-e545-43e8-8ed0-c47c0c2a6983 is already attached to instances: 91900503-1200-4e0c-9531-19f602773721 Aug 31 16:21:49.924504 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:21:49.924504 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:21:49.924504 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:21:49.924504 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:21:49.924504 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:21:49.924504 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:21:49.924504 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:21:49.924504 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:21:49.924504 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 62340300-e545-43e8-8ed0-c47c0c2a6983 is already attached to instances: 91900503-1200-4e0c-9531-19f602773721 Aug 31 16:21:49.924504 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:21:49.927546 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c0efc501-f628-4c4b-93c7-fa88538fc958 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Returning 400 to user: Invalid volume: volume 62340300-e545-43e8-8ed0-c47c0c2a6983 is already attached to instances: 91900503-1200-4e0c-9531-19f602773721 {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:21:49.928480 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c0efc501-f628-4c4b-93c7-fa88538fc958 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "POST /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.202309 Aug 31 16:21:49.933174 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2785/5761] 10.222.0.50 () {60 vars in 1323 bytes} [Wed Aug 31 16:21:49 2022] POST /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721/os-volume_attachments => generated 174 bytes in 204 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 31 16:21:50.030012 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-475e029f-2894-4caa-92e5-eaaffc3de174 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:50.031009 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-475e029f-2894-4caa-92e5-eaaffc3de174 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:50.044538 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-475e029f-2894-4caa-92e5-eaaffc3de174 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:50.045035 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-475e029f-2894-4caa-92e5-eaaffc3de174 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:50.045461 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-475e029f-2894-4caa-92e5-eaaffc3de174 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:50.046260 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-475e029f-2894-4caa-92e5-eaaffc3de174 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:50.046702 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-475e029f-2894-4caa-92e5-eaaffc3de174 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:50.047113 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-475e029f-2894-4caa-92e5-eaaffc3de174 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:50.094972 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-328c5ca8-7d5a-495a-b183-657b97c80846 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:50.107176 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-328c5ca8-7d5a-495a-b183-657b97c80846 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b" status: 200 len: 1549 microversion: 2.1 time: 0.296493 Aug 31 16:21:50.108319 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2977/5762] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:21:49 2022] GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b => generated 1549 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:21:50.116496 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5701e1df-28a8-4a99-a074-5ff700c2fcb0 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:50.121741 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5701e1df-28a8-4a99-a074-5ff700c2fcb0 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 91900503-1200-4e0c-9531-19f602773721] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:50.140835 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5701e1df-28a8-4a99-a074-5ff700c2fcb0 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:50.141573 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5701e1df-28a8-4a99-a074-5ff700c2fcb0 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:50.141876 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5701e1df-28a8-4a99-a074-5ff700c2fcb0 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:50.142624 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5701e1df-28a8-4a99-a074-5ff700c2fcb0 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:50.143070 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5701e1df-28a8-4a99-a074-5ff700c2fcb0 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:50.144392 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5701e1df-28a8-4a99-a074-5ff700c2fcb0 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:50.302120 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-5701e1df-28a8-4a99-a074-5ff700c2fcb0 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lazy-loading 'services' on Instance uuid 91900503-1200-4e0c-9531-19f602773721 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:21:50.343048 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-475e029f-2894-4caa-92e5-eaaffc3de174 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:50.352824 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-475e029f-2894-4caa-92e5-eaaffc3de174 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:50.362441 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-475e029f-2894-4caa-92e5-eaaffc3de174 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:50.363735 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-475e029f-2894-4caa-92e5-eaaffc3de174 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1406 microversion: 2.20 time: 0.343168 Aug 31 16:21:50.364327 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2786/5763] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:21:50 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1406 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:21:50.369203 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9883c06f-2ef2-47a2-97eb-b261de7558b5 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:50.373248 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9883c06f-2ef2-47a2-97eb-b261de7558b5 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:50.386684 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9883c06f-2ef2-47a2-97eb-b261de7558b5 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:50.387576 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9883c06f-2ef2-47a2-97eb-b261de7558b5 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:50.388162 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9883c06f-2ef2-47a2-97eb-b261de7558b5 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:50.399069 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9883c06f-2ef2-47a2-97eb-b261de7558b5 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:50.399731 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9883c06f-2ef2-47a2-97eb-b261de7558b5 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:50.400166 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9883c06f-2ef2-47a2-97eb-b261de7558b5 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:50.447870 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5701e1df-28a8-4a99-a074-5ff700c2fcb0 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "DELETE /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721/os-volume_attachments/62340300-e545-43e8-8ed0-c47c0c2a6983" status: 202 len: 0 microversion: 2.1 time: 0.337456 Aug 31 16:21:50.452669 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2978/5764] 10.222.0.50 () {58 vars in 1416 bytes} [Wed Aug 31 16:21:50 2022] DELETE /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721/os-volume_attachments/62340300-e545-43e8-8ed0-c47c0c2a6983 => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:21:50.472613 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3a69003c-8787-4c7f-8595-e3fb6acf5624 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:50.478882 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3a69003c-8787-4c7f-8595-e3fb6acf5624 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 91900503-1200-4e0c-9531-19f602773721] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:50.501630 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3a69003c-8787-4c7f-8595-e3fb6acf5624 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:50.508573 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3a69003c-8787-4c7f-8595-e3fb6acf5624 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:50.509408 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3a69003c-8787-4c7f-8595-e3fb6acf5624 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:50.510405 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3a69003c-8787-4c7f-8595-e3fb6acf5624 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:50.511103 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3a69003c-8787-4c7f-8595-e3fb6acf5624 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:50.511899 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3a69003c-8787-4c7f-8595-e3fb6acf5624 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:50.603461 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3a69003c-8787-4c7f-8595-e3fb6acf5624 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.146310 Aug 31 16:21:50.604075 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2979/5765] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:21:50 2022] GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:21:50.638926 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9883c06f-2ef2-47a2-97eb-b261de7558b5 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.272959 Aug 31 16:21:50.639833 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2787/5766] 10.222.0.50 () {58 vars in 1275 bytes} [Wed Aug 31 16:21:50 2022] GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b/os-interface => generated 285 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:21:51.396832 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d1af475b-d2c3-4235-ae89-129285dc2097 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:51.398160 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d1af475b-d2c3-4235-ae89-129285dc2097 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:51.410288 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d1af475b-d2c3-4235-ae89-129285dc2097 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:51.415178 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d1af475b-d2c3-4235-ae89-129285dc2097 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:51.415839 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d1af475b-d2c3-4235-ae89-129285dc2097 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:51.416864 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d1af475b-d2c3-4235-ae89-129285dc2097 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:51.417521 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d1af475b-d2c3-4235-ae89-129285dc2097 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:51.418192 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d1af475b-d2c3-4235-ae89-129285dc2097 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:51.470122 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:21:51.632669 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-748a10d6-a065-4613-a6fc-28019de2dbcd tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:51.636002 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-748a10d6-a065-4613-a6fc-28019de2dbcd tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 91900503-1200-4e0c-9531-19f602773721] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:51.654600 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-748a10d6-a065-4613-a6fc-28019de2dbcd tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:51.655118 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-748a10d6-a065-4613-a6fc-28019de2dbcd tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:51.655564 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-748a10d6-a065-4613-a6fc-28019de2dbcd tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:51.658077 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-748a10d6-a065-4613-a6fc-28019de2dbcd tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:51.659723 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-748a10d6-a065-4613-a6fc-28019de2dbcd tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:51.660347 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-748a10d6-a065-4613-a6fc-28019de2dbcd tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:51.758569 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-748a10d6-a065-4613-a6fc-28019de2dbcd tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.141260 Aug 31 16:21:51.759356 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2788/5767] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:21:51 2022] GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:21:52.035963 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d1af475b-d2c3-4235-ae89-129285dc2097 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:52.049131 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d1af475b-d2c3-4235-ae89-129285dc2097 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:52.053009 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d1af475b-d2c3-4235-ae89-129285dc2097 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:52.055761 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d1af475b-d2c3-4235-ae89-129285dc2097 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1406 microversion: 2.20 time: 0.668867 Aug 31 16:21:52.059438 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2980/5768] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:21:51 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1406 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:21:52.772671 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ed2bf298-1e53-41b6-a19b-13fda13f9e77 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:52.774876 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ed2bf298-1e53-41b6-a19b-13fda13f9e77 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 91900503-1200-4e0c-9531-19f602773721] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:52.789211 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-7319a6c2-a5c4-4554-85ec-d9a9f82b4125 req-7918b79f-f529-49ae-9bdd-0fdf278fe2d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27172556-b12c-4974-815d-5f893a07506b", "tag": "fb8f078c-683b-4fe5-9e14-600f0922bd16"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:21:52.803993 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:21:52.804750 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=22 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:21:52.806792 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:21:52.819892 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed2bf298-1e53-41b6-a19b-13fda13f9e77 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:52.820470 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed2bf298-1e53-41b6-a19b-13fda13f9e77 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:52.820916 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed2bf298-1e53-41b6-a19b-13fda13f9e77 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:52.832274 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed2bf298-1e53-41b6-a19b-13fda13f9e77 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:52.832760 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed2bf298-1e53-41b6-a19b-13fda13f9e77 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:52.833193 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed2bf298-1e53-41b6-a19b-13fda13f9e77 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:52.838000 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7319a6c2-a5c4-4554-85ec-d9a9f82b4125 req-7918b79f-f529-49ae-9bdd-0fdf278fe2d4 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:52.838666 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7319a6c2-a5c4-4554-85ec-d9a9f82b4125 req-7918b79f-f529-49ae-9bdd-0fdf278fe2d4 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:52.839117 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7319a6c2-a5c4-4554-85ec-d9a9f82b4125 req-7918b79f-f529-49ae-9bdd-0fdf278fe2d4 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:52.876997 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-7319a6c2-a5c4-4554-85ec-d9a9f82b4125 req-7918b79f-f529-49ae-9bdd-0fdf278fe2d4 service nova] Creating event network-changed:fb8f078c-683b-4fe5-9e14-600f0922bd16 for instance 27172556-b12c-4974-815d-5f893a07506b on n-h2-833090-16 Aug 31 16:21:52.907191 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-7319a6c2-a5c4-4554-85ec-d9a9f82b4125 req-7918b79f-f529-49ae-9bdd-0fdf278fe2d4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113878 Aug 31 16:21:52.908295 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2981/5769] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:21:52.936175 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ed2bf298-1e53-41b6-a19b-13fda13f9e77 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.167958 Aug 31 16:21:52.946128 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2789/5770] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:21:52 2022] GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721/os-volume_attachments => generated 197 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:21:53.087255 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c9aa8563-ce64-4cce-bdb3-8fdbb8168162 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:53.088202 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c9aa8563-ce64-4cce-bdb3-8fdbb8168162 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:53.100171 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c9aa8563-ce64-4cce-bdb3-8fdbb8168162 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:53.100923 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c9aa8563-ce64-4cce-bdb3-8fdbb8168162 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:53.102602 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c9aa8563-ce64-4cce-bdb3-8fdbb8168162 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:53.107039 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c9aa8563-ce64-4cce-bdb3-8fdbb8168162 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:53.107719 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c9aa8563-ce64-4cce-bdb3-8fdbb8168162 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:53.108308 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c9aa8563-ce64-4cce-bdb3-8fdbb8168162 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:53.953865 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4bbb9cc8-6c2a-483d-a031-27656a01ccad tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:53.957343 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4bbb9cc8-6c2a-483d-a031-27656a01ccad tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 91900503-1200-4e0c-9531-19f602773721] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:53.977287 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4bbb9cc8-6c2a-483d-a031-27656a01ccad tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:53.992964 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4bbb9cc8-6c2a-483d-a031-27656a01ccad tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:53.996609 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4bbb9cc8-6c2a-483d-a031-27656a01ccad tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:53.998441 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4bbb9cc8-6c2a-483d-a031-27656a01ccad tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:53.999734 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4bbb9cc8-6c2a-483d-a031-27656a01ccad tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:54.000414 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4bbb9cc8-6c2a-483d-a031-27656a01ccad tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:54.092152 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4bbb9cc8-6c2a-483d-a031-27656a01ccad tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.142955 Aug 31 16:21:54.100671 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2790/5771] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:21:53 2022] GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:21:54.309188 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c9aa8563-ce64-4cce-bdb3-8fdbb8168162 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:54.323095 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c9aa8563-ce64-4cce-bdb3-8fdbb8168162 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:54.332227 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c9aa8563-ce64-4cce-bdb3-8fdbb8168162 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:54.333668 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c9aa8563-ce64-4cce-bdb3-8fdbb8168162 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1406 microversion: 2.20 time: 1.250847 Aug 31 16:21:54.351429 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2982/5772] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:21:53 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1406 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:21:55.108581 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d7f72d24-1778-4317-a6b6-427aace6272e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:55.111131 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d7f72d24-1778-4317-a6b6-427aace6272e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 91900503-1200-4e0c-9531-19f602773721] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:55.129348 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7f72d24-1778-4317-a6b6-427aace6272e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:55.130338 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7f72d24-1778-4317-a6b6-427aace6272e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:55.131042 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7f72d24-1778-4317-a6b6-427aace6272e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:55.131981 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7f72d24-1778-4317-a6b6-427aace6272e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:55.132638 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7f72d24-1778-4317-a6b6-427aace6272e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:55.136553 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7f72d24-1778-4317-a6b6-427aace6272e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:55.219470 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d7f72d24-1778-4317-a6b6-427aace6272e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111009 Aug 31 16:21:55.224492 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2791/5773] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:21:55 2022] GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:21:55.297603 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-7d5da6fe-14d9-4623-a8e8-f041237d0749 req-bddee05b-c26e-4d86-b2bb-b3f95806a725 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42064ec8-1aec-498c-8ed7-7c1683963dae", "name": "network-vif-plugged", "status": "completed", "tag": "8298d82a-a2b4-4bc9-b94c-40f87ac42aa3"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:21:55.321849 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7d5da6fe-14d9-4623-a8e8-f041237d0749 req-bddee05b-c26e-4d86-b2bb-b3f95806a725 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:55.322532 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7d5da6fe-14d9-4623-a8e8-f041237d0749 req-bddee05b-c26e-4d86-b2bb-b3f95806a725 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:55.323009 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7d5da6fe-14d9-4623-a8e8-f041237d0749 req-bddee05b-c26e-4d86-b2bb-b3f95806a725 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:55.359183 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0921a88c-77bb-4bd6-b72e-9ade1495496e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:55.360590 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0921a88c-77bb-4bd6-b72e-9ade1495496e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:55.366848 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-7d5da6fe-14d9-4623-a8e8-f041237d0749 req-bddee05b-c26e-4d86-b2bb-b3f95806a725 service nova] Creating event network-vif-plugged:8298d82a-a2b4-4bc9-b94c-40f87ac42aa3 for instance 42064ec8-1aec-498c-8ed7-7c1683963dae on n-h1-833090-16 Aug 31 16:21:55.389790 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0921a88c-77bb-4bd6-b72e-9ade1495496e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:55.392997 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-7d5da6fe-14d9-4623-a8e8-f041237d0749 req-bddee05b-c26e-4d86-b2bb-b3f95806a725 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104069 Aug 31 16:21:55.401344 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0921a88c-77bb-4bd6-b72e-9ade1495496e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:55.406394 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0921a88c-77bb-4bd6-b72e-9ade1495496e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:55.407309 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2983/5774] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:21:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:21:55.408615 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0921a88c-77bb-4bd6-b72e-9ade1495496e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:55.409406 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0921a88c-77bb-4bd6-b72e-9ade1495496e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:55.410888 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0921a88c-77bb-4bd6-b72e-9ade1495496e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:56.073615 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0921a88c-77bb-4bd6-b72e-9ade1495496e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:56.094979 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0921a88c-77bb-4bd6-b72e-9ade1495496e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:56.098913 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0921a88c-77bb-4bd6-b72e-9ade1495496e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:56.102764 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0921a88c-77bb-4bd6-b72e-9ade1495496e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1406 microversion: 2.20 time: 0.748605 Aug 31 16:21:56.107310 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2792/5775] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:21:55 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1406 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:21:56.233766 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1e455564-a387-44f4-a564-3cf1e2282011 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:56.236753 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1e455564-a387-44f4-a564-3cf1e2282011 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 91900503-1200-4e0c-9531-19f602773721] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:56.272729 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e455564-a387-44f4-a564-3cf1e2282011 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:56.285112 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e455564-a387-44f4-a564-3cf1e2282011 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:56.289334 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e455564-a387-44f4-a564-3cf1e2282011 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:56.300357 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e455564-a387-44f4-a564-3cf1e2282011 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:56.301117 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e455564-a387-44f4-a564-3cf1e2282011 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:56.301783 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e455564-a387-44f4-a564-3cf1e2282011 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:56.394517 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1e455564-a387-44f4-a564-3cf1e2282011 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.166012 Aug 31 16:21:56.400003 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2984/5776] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:21:56 2022] GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721/os-volume_attachments => generated 197 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:21:57.133078 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-da5ddd8c-1fb7-44bd-b632-25a783e8092d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:57.133802 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-da5ddd8c-1fb7-44bd-b632-25a783e8092d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:57.161655 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da5ddd8c-1fb7-44bd-b632-25a783e8092d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:57.164098 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da5ddd8c-1fb7-44bd-b632-25a783e8092d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:57.166485 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da5ddd8c-1fb7-44bd-b632-25a783e8092d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:57.171216 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da5ddd8c-1fb7-44bd-b632-25a783e8092d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:57.172037 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da5ddd8c-1fb7-44bd-b632-25a783e8092d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:57.177991 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da5ddd8c-1fb7-44bd-b632-25a783e8092d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:57.192474 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:21:57.408555 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b84ea303-3a1e-494a-ab85-f7ae9286704b tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:57.435934 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b84ea303-3a1e-494a-ab85-f7ae9286704b tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 91900503-1200-4e0c-9531-19f602773721] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:57.487513 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b84ea303-3a1e-494a-ab85-f7ae9286704b tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:57.489199 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b84ea303-3a1e-494a-ab85-f7ae9286704b tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:57.496649 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b84ea303-3a1e-494a-ab85-f7ae9286704b tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:57.499839 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b84ea303-3a1e-494a-ab85-f7ae9286704b tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:57.500640 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b84ea303-3a1e-494a-ab85-f7ae9286704b tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:57.511436 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b84ea303-3a1e-494a-ab85-f7ae9286704b tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:57.650363 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b84ea303-3a1e-494a-ab85-f7ae9286704b tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.245920 Aug 31 16:21:57.674567 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2985/5777] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:21:57 2022] GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721/os-volume_attachments => generated 197 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:21:57.679977 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-11f6c221-e21d-4716-8a1f-75be79018dfa tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:21:57.695403 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-11f6c221-e21d-4716-8a1f-75be79018dfa tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 1d359c68-27fb-4b21-ba0c-0d189780d82e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:57.726741 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11f6c221-e21d-4716-8a1f-75be79018dfa tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:57.728019 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11f6c221-e21d-4716-8a1f-75be79018dfa tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:57.730759 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11f6c221-e21d-4716-8a1f-75be79018dfa tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:57.731821 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11f6c221-e21d-4716-8a1f-75be79018dfa tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:57.732450 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11f6c221-e21d-4716-8a1f-75be79018dfa tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:57.733039 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11f6c221-e21d-4716-8a1f-75be79018dfa tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:57.873629 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-da5ddd8c-1fb7-44bd-b632-25a783e8092d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:57.897268 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-11f6c221-e21d-4716-8a1f-75be79018dfa tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "POST /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e/action" status: 200 len: 24562 microversion: 2.1 time: 0.220986 Aug 31 16:21:57.897940 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2986/5778] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:21:57 2022] POST /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e/action => generated 24562 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:21:57.920224 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-da5ddd8c-1fb7-44bd-b632-25a783e8092d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:57.940044 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-da5ddd8c-1fb7-44bd-b632-25a783e8092d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:57.946889 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-da5ddd8c-1fb7-44bd-b632-25a783e8092d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1406 microversion: 2.20 time: 0.820259 Aug 31 16:21:57.963734 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2793/5779] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:21:57 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1406 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:21:58.679884 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e6b963fa-f675-4edf-af4e-91d66caddcfc tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:58.683494 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e6b963fa-f675-4edf-af4e-91d66caddcfc tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 91900503-1200-4e0c-9531-19f602773721] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:58.707763 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6b963fa-f675-4edf-af4e-91d66caddcfc tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:58.713175 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6b963fa-f675-4edf-af4e-91d66caddcfc tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:58.713840 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6b963fa-f675-4edf-af4e-91d66caddcfc tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:58.714911 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6b963fa-f675-4edf-af4e-91d66caddcfc tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:58.715382 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6b963fa-f675-4edf-af4e-91d66caddcfc tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:58.716056 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6b963fa-f675-4edf-af4e-91d66caddcfc tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:58.785382 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e6b963fa-f675-4edf-af4e-91d66caddcfc tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115262 Aug 31 16:21:58.790530 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2987/5780] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:21:58 2022] GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:21:58.979039 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-273a8bf5-5428-4608-a95a-b89cae5f4e77 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:58.980715 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-273a8bf5-5428-4608-a95a-b89cae5f4e77 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:59.002440 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-273a8bf5-5428-4608-a95a-b89cae5f4e77 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:59.004933 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-273a8bf5-5428-4608-a95a-b89cae5f4e77 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:59.006349 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-273a8bf5-5428-4608-a95a-b89cae5f4e77 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:59.015658 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-273a8bf5-5428-4608-a95a-b89cae5f4e77 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:59.017075 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-273a8bf5-5428-4608-a95a-b89cae5f4e77 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:59.018861 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-273a8bf5-5428-4608-a95a-b89cae5f4e77 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:59.642771 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-273a8bf5-5428-4608-a95a-b89cae5f4e77 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:59.657763 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-273a8bf5-5428-4608-a95a-b89cae5f4e77 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:59.659630 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-273a8bf5-5428-4608-a95a-b89cae5f4e77 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:21:59.663630 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-273a8bf5-5428-4608-a95a-b89cae5f4e77 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1598 microversion: 2.20 time: 0.691498 Aug 31 16:21:59.674479 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2794/5781] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:21:58 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1598 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:21:59.797744 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-11ce21b1-626b-45b3-b628-678322470c56 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:21:59.800344 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-11ce21b1-626b-45b3-b628-678322470c56 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 91900503-1200-4e0c-9531-19f602773721] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:21:59.819246 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11ce21b1-626b-45b3-b628-678322470c56 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:59.819246 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11ce21b1-626b-45b3-b628-678322470c56 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:59.819246 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11ce21b1-626b-45b3-b628-678322470c56 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:59.819246 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11ce21b1-626b-45b3-b628-678322470c56 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:21:59.819246 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11ce21b1-626b-45b3-b628-678322470c56 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:21:59.819246 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11ce21b1-626b-45b3-b628-678322470c56 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:21:59.893494 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-11ce21b1-626b-45b3-b628-678322470c56 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100348 Aug 31 16:21:59.902663 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2795/5782] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:21:59 2022] GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:22:00.049485 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-805e513c-dd6e-4f5e-ba70-7e4765c1ff27 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:00.050897 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-805e513c-dd6e-4f5e-ba70-7e4765c1ff27 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:00.060057 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-805e513c-dd6e-4f5e-ba70-7e4765c1ff27 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:00.060806 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-805e513c-dd6e-4f5e-ba70-7e4765c1ff27 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:00.062059 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-805e513c-dd6e-4f5e-ba70-7e4765c1ff27 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:00.063268 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-805e513c-dd6e-4f5e-ba70-7e4765c1ff27 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:00.063873 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-805e513c-dd6e-4f5e-ba70-7e4765c1ff27 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:00.064448 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-805e513c-dd6e-4f5e-ba70-7e4765c1ff27 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:00.334488 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-805e513c-dd6e-4f5e-ba70-7e4765c1ff27 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.650911 Aug 31 16:22:00.335107 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2988/5783] 10.222.0.50 () {60 vars in 1316 bytes} [Wed Aug 31 16:21:59 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae/os-interface => generated 285 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:22:00.915512 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d7a9298e-63b1-4595-a701-2616169f1d91 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:00.919912 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d7a9298e-63b1-4595-a701-2616169f1d91 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 91900503-1200-4e0c-9531-19f602773721] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:00.937548 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7a9298e-63b1-4595-a701-2616169f1d91 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:00.938043 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7a9298e-63b1-4595-a701-2616169f1d91 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:00.938506 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7a9298e-63b1-4595-a701-2616169f1d91 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:00.939187 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7a9298e-63b1-4595-a701-2616169f1d91 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:00.946650 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7a9298e-63b1-4595-a701-2616169f1d91 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:00.947319 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7a9298e-63b1-4595-a701-2616169f1d91 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:01.033549 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d7a9298e-63b1-4595-a701-2616169f1d91 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.120452 Aug 31 16:22:01.039651 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2796/5784] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:22:00 2022] GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721/os-volume_attachments => generated 25 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:22:01.141259 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e1fcfab0-9283-4543-9cb2-8a6bce723a7d tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:01.142352 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e1fcfab0-9283-4543-9cb2-8a6bce723a7d tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 91900503-1200-4e0c-9531-19f602773721] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:01.152822 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e1fcfab0-9283-4543-9cb2-8a6bce723a7d tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:01.153869 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e1fcfab0-9283-4543-9cb2-8a6bce723a7d tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:01.154482 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e1fcfab0-9283-4543-9cb2-8a6bce723a7d tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:01.155394 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e1fcfab0-9283-4543-9cb2-8a6bce723a7d tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:01.155992 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e1fcfab0-9283-4543-9cb2-8a6bce723a7d tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:01.156561 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e1fcfab0-9283-4543-9cb2-8a6bce723a7d tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:01.186403 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e1fcfab0-9283-4543-9cb2-8a6bce723a7d tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 91900503-1200-4e0c-9531-19f602773721] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:22:01.331433 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e1fcfab0-9283-4543-9cb2-8a6bce723a7d tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "DELETE /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721" status: 204 len: 0 microversion: 2.1 time: 0.198545 Aug 31 16:22:01.333856 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2989/5785] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:22:01 2022] DELETE /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:22:01.344257 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-50a05620-a0a7-4b04-990e-e44765833add tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:01.345218 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-50a05620-a0a7-4b04-990e-e44765833add tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 91900503-1200-4e0c-9531-19f602773721] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:01.355626 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50a05620-a0a7-4b04-990e-e44765833add tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:01.356757 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50a05620-a0a7-4b04-990e-e44765833add tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:01.357200 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50a05620-a0a7-4b04-990e-e44765833add tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:01.357930 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50a05620-a0a7-4b04-990e-e44765833add tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:01.358409 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50a05620-a0a7-4b04-990e-e44765833add tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:01.358859 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50a05620-a0a7-4b04-990e-e44765833add tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:02.141208 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-50a05620-a0a7-4b04-990e-e44765833add tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:02.156061 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-50a05620-a0a7-4b04-990e-e44765833add tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721" status: 200 len: 1680 microversion: 2.1 time: 0.816184 Aug 31 16:22:02.171769 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2797/5786] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:01 2022] GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721 => generated 1680 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:02.990894 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-1100b67d-219f-43e3-969d-b2b219222340 req-72deb003-a8dc-49ba-9ee9-e715c2097a83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42064ec8-1aec-498c-8ed7-7c1683963dae", "tag": "8298d82a-a2b4-4bc9-b94c-40f87ac42aa3"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:22:03.031176 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-1100b67d-219f-43e3-969d-b2b219222340 req-72deb003-a8dc-49ba-9ee9-e715c2097a83 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:03.031667 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-1100b67d-219f-43e3-969d-b2b219222340 req-72deb003-a8dc-49ba-9ee9-e715c2097a83 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:03.032066 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-1100b67d-219f-43e3-969d-b2b219222340 req-72deb003-a8dc-49ba-9ee9-e715c2097a83 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:03.058701 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-1100b67d-219f-43e3-969d-b2b219222340 req-72deb003-a8dc-49ba-9ee9-e715c2097a83 service nova] Creating event network-changed:8298d82a-a2b4-4bc9-b94c-40f87ac42aa3 for instance 42064ec8-1aec-498c-8ed7-7c1683963dae on n-h1-833090-16 Aug 31 16:22:03.070541 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-1100b67d-219f-43e3-969d-b2b219222340 req-72deb003-a8dc-49ba-9ee9-e715c2097a83 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083584 Aug 31 16:22:03.071680 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2990/5787] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:22:03.193850 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b196fa7d-44cc-4143-b8f0-853520c02d29 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:03.195014 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b196fa7d-44cc-4143-b8f0-853520c02d29 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 91900503-1200-4e0c-9531-19f602773721] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:03.208954 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b196fa7d-44cc-4143-b8f0-853520c02d29 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:03.209871 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b196fa7d-44cc-4143-b8f0-853520c02d29 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:03.210388 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b196fa7d-44cc-4143-b8f0-853520c02d29 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:03.211138 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b196fa7d-44cc-4143-b8f0-853520c02d29 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:03.211588 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b196fa7d-44cc-4143-b8f0-853520c02d29 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:03.212001 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b196fa7d-44cc-4143-b8f0-853520c02d29 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:03.685996 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b196fa7d-44cc-4143-b8f0-853520c02d29 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:03.698553 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b196fa7d-44cc-4143-b8f0-853520c02d29 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721" status: 200 len: 1680 microversion: 2.1 time: 0.524940 Aug 31 16:22:03.713919 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2798/5788] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:03 2022] GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721 => generated 1680 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:04.133554 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-267fd945-de09-40ac-b656-6fd26b00597a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:22:04.136528 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-267fd945-de09-40ac-b656-6fd26b00597a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 1d359c68-27fb-4b21-ba0c-0d189780d82e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:04.157974 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-267fd945-de09-40ac-b656-6fd26b00597a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:04.158514 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-267fd945-de09-40ac-b656-6fd26b00597a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:04.158918 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-267fd945-de09-40ac-b656-6fd26b00597a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:04.159614 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-267fd945-de09-40ac-b656-6fd26b00597a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:04.160062 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-267fd945-de09-40ac-b656-6fd26b00597a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:04.160483 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-267fd945-de09-40ac-b656-6fd26b00597a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:04.369333 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-267fd945-de09-40ac-b656-6fd26b00597a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:22:04.377947 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-267fd945-de09-40ac-b656-6fd26b00597a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:22:04.382756 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-267fd945-de09-40ac-b656-6fd26b00597a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:22:04.383192 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-267fd945-de09-40ac-b656-6fd26b00597a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:22:04.383610 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-267fd945-de09-40ac-b656-6fd26b00597a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:22:04.528393 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-267fd945-de09-40ac-b656-6fd26b00597a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 1d359c68-27fb-4b21-ba0c-0d189780d82e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:04.547109 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-267fd945-de09-40ac-b656-6fd26b00597a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:04.547612 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-267fd945-de09-40ac-b656-6fd26b00597a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:04.548044 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-267fd945-de09-40ac-b656-6fd26b00597a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:04.548752 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-267fd945-de09-40ac-b656-6fd26b00597a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:04.549200 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-267fd945-de09-40ac-b656-6fd26b00597a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:04.555136 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-267fd945-de09-40ac-b656-6fd26b00597a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:04.628825 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-267fd945-de09-40ac-b656-6fd26b00597a tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "POST /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e/action" status: 202 len: 1136 microversion: 2.1 time: 0.494443 Aug 31 16:22:04.631946 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2991/5789] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:22:04 2022] POST /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e/action => generated 1136 bytes in 505 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 31 16:22:04.654311 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9e901af9-a41c-426a-9be9-03eab6da45d3 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:04.655667 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9e901af9-a41c-426a-9be9-03eab6da45d3 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 1d359c68-27fb-4b21-ba0c-0d189780d82e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:04.665413 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e901af9-a41c-426a-9be9-03eab6da45d3 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:04.666333 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e901af9-a41c-426a-9be9-03eab6da45d3 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:04.667064 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e901af9-a41c-426a-9be9-03eab6da45d3 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:04.668402 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e901af9-a41c-426a-9be9-03eab6da45d3 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:04.669255 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e901af9-a41c-426a-9be9-03eab6da45d3 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:04.669978 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e901af9-a41c-426a-9be9-03eab6da45d3 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:04.728815 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8cdbe902-4311-4f6d-ba4b-687ff2ed2936 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:04.730222 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8cdbe902-4311-4f6d-ba4b-687ff2ed2936 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 91900503-1200-4e0c-9531-19f602773721] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:04.748141 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8cdbe902-4311-4f6d-ba4b-687ff2ed2936 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:04.748950 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8cdbe902-4311-4f6d-ba4b-687ff2ed2936 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:04.749655 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8cdbe902-4311-4f6d-ba4b-687ff2ed2936 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:04.751291 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8cdbe902-4311-4f6d-ba4b-687ff2ed2936 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:04.752522 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8cdbe902-4311-4f6d-ba4b-687ff2ed2936 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:04.753324 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8cdbe902-4311-4f6d-ba4b-687ff2ed2936 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:05.674564 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9e901af9-a41c-426a-9be9-03eab6da45d3 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:05.684635 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9e901af9-a41c-426a-9be9-03eab6da45d3 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e" status: 200 len: 1690 microversion: 2.1 time: 1.034819 Aug 31 16:22:05.698551 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2799/5790] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:04 2022] GET /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e => generated 1690 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:05.754847 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8cdbe902-4311-4f6d-ba4b-687ff2ed2936 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:05.765364 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8cdbe902-4311-4f6d-ba4b-687ff2ed2936 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721" status: 200 len: 1680 microversion: 2.1 time: 1.047693 Aug 31 16:22:05.781360 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2992/5791] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:04 2022] GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721 => generated 1680 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:06.076348 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-8d9c2c30-4a4a-4b25-91e9-1adc01d9464b req-fe103df9-fe62-424d-8fae-63d52889320d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91900503-1200-4e0c-9531-19f602773721", "name": "network-vif-deleted", "tag": "0ae53451-7a56-4e3c-9834-f4bccd4b4283"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:22:06.104021 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8d9c2c30-4a4a-4b25-91e9-1adc01d9464b req-fe103df9-fe62-424d-8fae-63d52889320d service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:06.105029 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8d9c2c30-4a4a-4b25-91e9-1adc01d9464b req-fe103df9-fe62-424d-8fae-63d52889320d service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:06.105931 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8d9c2c30-4a4a-4b25-91e9-1adc01d9464b req-fe103df9-fe62-424d-8fae-63d52889320d service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:06.132412 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-8d9c2c30-4a4a-4b25-91e9-1adc01d9464b req-fe103df9-fe62-424d-8fae-63d52889320d service nova] Creating event network-vif-deleted:0ae53451-7a56-4e3c-9834-f4bccd4b4283 for instance 91900503-1200-4e0c-9531-19f602773721 on n-h2-833090-16 Aug 31 16:22:06.143654 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-8d9c2c30-4a4a-4b25-91e9-1adc01d9464b req-fe103df9-fe62-424d-8fae-63d52889320d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069976 Aug 31 16:22:06.148204 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2800/5792] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:22:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:22:06.732686 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ce46d2e7-9c66-40db-b36e-85be8d88ca74 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:06.733972 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ce46d2e7-9c66-40db-b36e-85be8d88ca74 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 1d359c68-27fb-4b21-ba0c-0d189780d82e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:06.762518 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ce46d2e7-9c66-40db-b36e-85be8d88ca74 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:06.763283 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ce46d2e7-9c66-40db-b36e-85be8d88ca74 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:06.763530 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ce46d2e7-9c66-40db-b36e-85be8d88ca74 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:06.764647 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ce46d2e7-9c66-40db-b36e-85be8d88ca74 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:06.765365 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ce46d2e7-9c66-40db-b36e-85be8d88ca74 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:06.765908 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ce46d2e7-9c66-40db-b36e-85be8d88ca74 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:06.789305 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1a6dd73e-03a6-4205-8bd7-61736f7810a8 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:06.790078 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1a6dd73e-03a6-4205-8bd7-61736f7810a8 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 91900503-1200-4e0c-9531-19f602773721] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:06.804784 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a6dd73e-03a6-4205-8bd7-61736f7810a8 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:06.810360 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a6dd73e-03a6-4205-8bd7-61736f7810a8 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:06.811104 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a6dd73e-03a6-4205-8bd7-61736f7810a8 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:06.812035 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a6dd73e-03a6-4205-8bd7-61736f7810a8 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:06.812497 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a6dd73e-03a6-4205-8bd7-61736f7810a8 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:06.812953 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a6dd73e-03a6-4205-8bd7-61736f7810a8 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:06.876213 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a6dd73e-03a6-4205-8bd7-61736f7810a8 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:06.876929 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a6dd73e-03a6-4205-8bd7-61736f7810a8 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:06.877534 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a6dd73e-03a6-4205-8bd7-61736f7810a8 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:06.878163 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-1a6dd73e-03a6-4205-8bd7-61736f7810a8 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lazy-loading 'fault' on Instance uuid 91900503-1200-4e0c-9531-19f602773721 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:22:07.001762 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1a6dd73e-03a6-4205-8bd7-61736f7810a8 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:07.010767 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1a6dd73e-03a6-4205-8bd7-61736f7810a8 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721" status: 200 len: 1331 microversion: 2.1 time: 0.226258 Aug 31 16:22:07.022923 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2801/5793] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:06 2022] GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721 => generated 1331 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:07.307171 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ce46d2e7-9c66-40db-b36e-85be8d88ca74 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:07.325124 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ce46d2e7-9c66-40db-b36e-85be8d88ca74 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e" status: 200 len: 1690 microversion: 2.1 time: 0.594763 Aug 31 16:22:07.325946 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2993/5794] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:06 2022] GET /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e => generated 1690 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:08.033443 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6960f1e4-4e79-41ae-9aae-eb094d9430fb tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:08.034064 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6960f1e4-4e79-41ae-9aae-eb094d9430fb tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 91900503-1200-4e0c-9531-19f602773721] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:08.041230 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6960f1e4-4e79-41ae-9aae-eb094d9430fb tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:08.042015 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6960f1e4-4e79-41ae-9aae-eb094d9430fb tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:08.042683 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6960f1e4-4e79-41ae-9aae-eb094d9430fb tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:08.043545 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6960f1e4-4e79-41ae-9aae-eb094d9430fb tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:08.044189 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6960f1e4-4e79-41ae-9aae-eb094d9430fb tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:08.044767 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6960f1e4-4e79-41ae-9aae-eb094d9430fb tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:08.077168 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-6960f1e4-4e79-41ae-9aae-eb094d9430fb tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] HTTP exception thrown: Instance 91900503-1200-4e0c-9531-19f602773721 could not be found. Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6960f1e4-4e79-41ae-9aae-eb094d9430fb tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Request method failure captured: Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721 HTTP/1.1 Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4jmnQUplwr8AbbPZFrGxW4cxkzmu6dBR1PW9StPm7lwt758HQoCfwjfTobZNcY1qtMPO8jDX-KXtXLta2nSjy7PGTgxIA8J9_334X72rGtCeQYm6RDS4nOjdET00Y60PMzSq7EOVRAdi656mkiv_ceC-3aVenrz44MCAB3Nc0UBrjk Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: c3cdfdf921af4bc59c5c2fea1287b598 Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-AttachVolumeNegativeTest-1670272717 Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c3cdfdf921af4bc59c5c2fea1287b598"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c3cdfdf921af4bc59c5c2fea1287b598"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c3cdfdf921af4bc59c5c2fea1287b598"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c3cdfdf921af4bc59c5c2fea1287b598", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-AttachVolumeNegativeTest-1670272717 Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: c3cdfdf921af4bc59c5c2fea1287b598 Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1670272717 Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-AttachVolumeNegativeTest-1670272717-project Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 6f95e357d68d4ad4a5eedbb08b41c5c1 Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-AttachVolumeNegativeTest-1670272717-project Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 91900503-1200-4e0c-9531-19f602773721 could not be found. Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '91900503-1200-4e0c-9531-19f602773721'} Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91900503-1200-4e0c-9531-19f602773721 could not be found. Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91900503-1200-4e0c-9531-19f602773721 could not be found. Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:22:08.083133 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:22:08.088259 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:22:08.088259 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:22:08.088259 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:22:08.088259 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:22:08.088259 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:22:08.088259 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91900503-1200-4e0c-9531-19f602773721 could not be found. Aug 31 16:22:08.088259 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:22:08.090761 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6960f1e4-4e79-41ae-9aae-eb094d9430fb tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Returning 404 to user: Instance 91900503-1200-4e0c-9531-19f602773721 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:22:08.092757 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6960f1e4-4e79-41ae-9aae-eb094d9430fb tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721" status: 404 len: 111 microversion: 2.1 time: 0.063725 Aug 31 16:22:08.097166 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2802/5795] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:08 2022] GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:22:08.101842 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1865640e-25a4-4a6c-9e62-5dedec9abf99 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '.version_select at 0x7fbb45567160>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:08.151719 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1865640e-25a4-4a6c-9e62-5dedec9abf99 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-989849790" status: 202 len: 0 microversion: 2.1 time: 0.053571 Aug 31 16:22:08.152885 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2994/5796] 10.222.0.50 () {58 vars in 1218 bytes} [Wed Aug 31 16:22:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-989849790 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 16:22:08.348516 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-42a5afe1-a782-48a7-84d8-00cdbb26192c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:08.349137 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-42a5afe1-a782-48a7-84d8-00cdbb26192c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 1d359c68-27fb-4b21-ba0c-0d189780d82e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:08.362491 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-42a5afe1-a782-48a7-84d8-00cdbb26192c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:08.365682 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-42a5afe1-a782-48a7-84d8-00cdbb26192c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:08.367091 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-42a5afe1-a782-48a7-84d8-00cdbb26192c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:08.372852 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-42a5afe1-a782-48a7-84d8-00cdbb26192c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:08.373552 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-42a5afe1-a782-48a7-84d8-00cdbb26192c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:08.374532 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-42a5afe1-a782-48a7-84d8-00cdbb26192c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:09.150924 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-42a5afe1-a782-48a7-84d8-00cdbb26192c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:09.172586 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-42a5afe1-a782-48a7-84d8-00cdbb26192c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e" status: 200 len: 1690 microversion: 2.1 time: 0.827874 Aug 31 16:22:09.174847 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2803/5797] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:08 2022] GET /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e => generated 1690 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:09.719593 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7b1e74b7-1ac7-4909-bf12-f4f65f05b9a8 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Action: 'create', calling method: .version_select at 0x7fbb458d35e0>, body: {"keypair": {"name": "tempest-keypair-84167743", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5BJngZFeJ4Gwm7HH98dCHtXwWIM8fmBltctYNYI+tfWPuXVWwOsH8WZWKNDFde0A29i2/zZEc6nyEdwCoVSz573UsmbqR1N9bPIOxxR//fkygtovm8XpPB7GAi6ylJQQ=="}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:22:09.738718 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-7b1e74b7-1ac7-4909-bf12-f4f65f05b9a8 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Getting quotas for project c3cdfdf921af4bc59c5c2fea1287b598. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:22:09.744831 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-7b1e74b7-1ac7-4909-bf12-f4f65f05b9a8 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Getting quotas for user 6f95e357d68d4ad4a5eedbb08b41c5c1 and project c3cdfdf921af4bc59c5c2fea1287b598. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:22:09.781313 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7b1e74b7-1ac7-4909-bf12-f4f65f05b9a8 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.065921 Aug 31 16:22:09.782435 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2995/5798] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 31 16:22:09 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:22:10.193378 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-80f81ab7-8508-433d-aeb4-771403c6231b tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:10.194011 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-80f81ab7-8508-433d-aeb4-771403c6231b tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 1d359c68-27fb-4b21-ba0c-0d189780d82e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:10.209116 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80f81ab7-8508-433d-aeb4-771403c6231b tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:10.218916 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80f81ab7-8508-433d-aeb4-771403c6231b tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:10.219300 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80f81ab7-8508-433d-aeb4-771403c6231b tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:10.220049 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80f81ab7-8508-433d-aeb4-771403c6231b tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:10.220504 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80f81ab7-8508-433d-aeb4-771403c6231b tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:10.220929 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80f81ab7-8508-433d-aeb4-771403c6231b tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:10.529414 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-80f81ab7-8508-433d-aeb4-771403c6231b tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:10.539062 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-80f81ab7-8508-433d-aeb4-771403c6231b tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e" status: 200 len: 1690 microversion: 2.1 time: 0.349713 Aug 31 16:22:10.540940 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2804/5799] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:10 2022] GET /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e => generated 1690 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:11.563571 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7915d58e-0a62-40c1-94f8-9b7bdac4172f tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:11.564258 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7915d58e-0a62-40c1-94f8-9b7bdac4172f tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 1d359c68-27fb-4b21-ba0c-0d189780d82e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:11.571400 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7915d58e-0a62-40c1-94f8-9b7bdac4172f tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:11.571966 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7915d58e-0a62-40c1-94f8-9b7bdac4172f tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:11.572394 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7915d58e-0a62-40c1-94f8-9b7bdac4172f tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:11.573259 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7915d58e-0a62-40c1-94f8-9b7bdac4172f tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:11.573932 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7915d58e-0a62-40c1-94f8-9b7bdac4172f tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:11.574326 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7915d58e-0a62-40c1-94f8-9b7bdac4172f tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:11.832110 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7915d58e-0a62-40c1-94f8-9b7bdac4172f tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:11.848445 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7915d58e-0a62-40c1-94f8-9b7bdac4172f tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e" status: 200 len: 1690 microversion: 2.1 time: 0.290630 Aug 31 16:22:11.850388 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2996/5800] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:11 2022] GET /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e => generated 1690 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:11.949066 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b9c6f428-fa40-4196-a5a2-93e2b6bdf0a8 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1712557129", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ae90d5cd-3421-4e4a-9434-10c5079cf68b"}], "security_groups": [{"name": "tempest-securitygroup--933400169"}], "key_name": "tempest-keypair-84167743", "user_data": "}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:22:12.064056 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-b9c6f428-fa40-4196-a5a2-93e2b6bdf0a8 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] validate_networks() for [('ae90d5cd-3421-4e4a-9434-10c5079cf68b', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:22:12.655109 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b9c6f428-fa40-4196-a5a2-93e2b6bdf0a8 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:22:12.655573 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b9c6f428-fa40-4196-a5a2-93e2b6bdf0a8 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:22:12.656149 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b9c6f428-fa40-4196-a5a2-93e2b6bdf0a8 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:22:12.656561 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b9c6f428-fa40-4196-a5a2-93e2b6bdf0a8 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:22:12.657550 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b9c6f428-fa40-4196-a5a2-93e2b6bdf0a8 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:22:12.660952 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:22:12.708442 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9c6f428-fa40-4196-a5a2-93e2b6bdf0a8 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:12.709578 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9c6f428-fa40-4196-a5a2-93e2b6bdf0a8 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:12.711040 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9c6f428-fa40-4196-a5a2-93e2b6bdf0a8 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:12.712677 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9c6f428-fa40-4196-a5a2-93e2b6bdf0a8 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:12.713573 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9c6f428-fa40-4196-a5a2-93e2b6bdf0a8 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:12.714908 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9c6f428-fa40-4196-a5a2-93e2b6bdf0a8 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:12.746630 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-b9c6f428-fa40-4196-a5a2-93e2b6bdf0a8 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Getting quotas for project c3cdfdf921af4bc59c5c2fea1287b598. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:22:12.758172 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-b9c6f428-fa40-4196-a5a2-93e2b6bdf0a8 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Getting quotas for user 6f95e357d68d4ad4a5eedbb08b41c5c1 and project c3cdfdf921af4bc59c5c2fea1287b598. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:22:12.781360 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b9c6f428-fa40-4196-a5a2-93e2b6bdf0a8 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:22:12.784313 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b9c6f428-fa40-4196-a5a2-93e2b6bdf0a8 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 95902b01-9a33-45e2-b454-cdab91014582] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:22:12.849845 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b9c6f428-fa40-4196-a5a2-93e2b6bdf0a8 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.905786 Aug 31 16:22:12.851167 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2805/5801] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:22:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 908 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:22:12.862155 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f6a7ab9d-a500-4af9-b410-954a48d6799e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:12.863644 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f6a7ab9d-a500-4af9-b410-954a48d6799e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 95902b01-9a33-45e2-b454-cdab91014582] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:12.866582 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:22:12.877627 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9485552d-f5cb-44b5-ae31-23266c17b8c8 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:12.878516 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9485552d-f5cb-44b5-ae31-23266c17b8c8 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 1d359c68-27fb-4b21-ba0c-0d189780d82e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:12.922452 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9485552d-f5cb-44b5-ae31-23266c17b8c8 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:12.923213 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9485552d-f5cb-44b5-ae31-23266c17b8c8 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:12.923793 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9485552d-f5cb-44b5-ae31-23266c17b8c8 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:12.924805 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9485552d-f5cb-44b5-ae31-23266c17b8c8 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:12.925946 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9485552d-f5cb-44b5-ae31-23266c17b8c8 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:12.926591 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9485552d-f5cb-44b5-ae31-23266c17b8c8 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:12.966247 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f6a7ab9d-a500-4af9-b410-954a48d6799e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:12.974748 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f6a7ab9d-a500-4af9-b410-954a48d6799e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582" status: 200 len: 1240 microversion: 2.1 time: 0.116584 Aug 31 16:22:12.976240 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2997/5802] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:12 2022] GET /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582 => generated 1240 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:13.181683 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9485552d-f5cb-44b5-ae31-23266c17b8c8 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:13.197386 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9485552d-f5cb-44b5-ae31-23266c17b8c8 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e" status: 200 len: 1690 microversion: 2.1 time: 0.327142 Aug 31 16:22:13.211095 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2806/5803] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:12 2022] GET /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e => generated 1690 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:13.997535 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f621c71e-8d5e-437b-9fc4-b8c20f536d20 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:13.998132 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f621c71e-8d5e-437b-9fc4-b8c20f536d20 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 95902b01-9a33-45e2-b454-cdab91014582] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:14.012018 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f621c71e-8d5e-437b-9fc4-b8c20f536d20 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:14.013112 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f621c71e-8d5e-437b-9fc4-b8c20f536d20 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:14.013878 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f621c71e-8d5e-437b-9fc4-b8c20f536d20 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:14.016129 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f621c71e-8d5e-437b-9fc4-b8c20f536d20 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:14.016978 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f621c71e-8d5e-437b-9fc4-b8c20f536d20 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:14.017580 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f621c71e-8d5e-437b-9fc4-b8c20f536d20 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:14.175516 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f621c71e-8d5e-437b-9fc4-b8c20f536d20 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:14.194980 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f621c71e-8d5e-437b-9fc4-b8c20f536d20 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582" status: 200 len: 1292 microversion: 2.1 time: 0.199224 Aug 31 16:22:14.209744 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2998/5804] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:13 2022] GET /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582 => generated 1292 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:14.221318 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f0551f4a-197e-43c1-b4dd-0c88a0671c0d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:14.222016 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f0551f4a-197e-43c1-b4dd-0c88a0671c0d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 1d359c68-27fb-4b21-ba0c-0d189780d82e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:14.235094 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f0551f4a-197e-43c1-b4dd-0c88a0671c0d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:14.235584 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f0551f4a-197e-43c1-b4dd-0c88a0671c0d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:14.236259 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f0551f4a-197e-43c1-b4dd-0c88a0671c0d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:14.250299 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f0551f4a-197e-43c1-b4dd-0c88a0671c0d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:14.251912 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f0551f4a-197e-43c1-b4dd-0c88a0671c0d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:14.252581 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f0551f4a-197e-43c1-b4dd-0c88a0671c0d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:14.450446 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f0551f4a-197e-43c1-b4dd-0c88a0671c0d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:14.475387 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f0551f4a-197e-43c1-b4dd-0c88a0671c0d tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e" status: 200 len: 1690 microversion: 2.1 time: 0.259180 Aug 31 16:22:14.476454 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2807/5805] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:14 2022] GET /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e => generated 1690 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:15.218320 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1b3fbe13-f712-4aeb-9398-a2d1f2e391bf tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:15.219860 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1b3fbe13-f712-4aeb-9398-a2d1f2e391bf tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 95902b01-9a33-45e2-b454-cdab91014582] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:15.227734 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1b3fbe13-f712-4aeb-9398-a2d1f2e391bf tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:15.228759 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1b3fbe13-f712-4aeb-9398-a2d1f2e391bf tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:15.229552 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1b3fbe13-f712-4aeb-9398-a2d1f2e391bf tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:15.230878 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1b3fbe13-f712-4aeb-9398-a2d1f2e391bf tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:15.231608 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1b3fbe13-f712-4aeb-9398-a2d1f2e391bf tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:15.232652 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1b3fbe13-f712-4aeb-9398-a2d1f2e391bf tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:15.238891 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:22:15.357294 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1b3fbe13-f712-4aeb-9398-a2d1f2e391bf tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:15.381115 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1b3fbe13-f712-4aeb-9398-a2d1f2e391bf tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582" status: 200 len: 1298 microversion: 2.1 time: 0.167794 Aug 31 16:22:15.395592 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 2999/5806] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:15 2022] GET /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582 => generated 1298 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:15.513403 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4e5b6d40-08db-4523-9d59-50d4c5322889 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:15.515694 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4e5b6d40-08db-4523-9d59-50d4c5322889 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 1d359c68-27fb-4b21-ba0c-0d189780d82e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:15.534118 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e5b6d40-08db-4523-9d59-50d4c5322889 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:15.535069 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e5b6d40-08db-4523-9d59-50d4c5322889 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:15.535522 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e5b6d40-08db-4523-9d59-50d4c5322889 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:15.536406 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e5b6d40-08db-4523-9d59-50d4c5322889 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:15.536865 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e5b6d40-08db-4523-9d59-50d4c5322889 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:15.537291 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e5b6d40-08db-4523-9d59-50d4c5322889 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:15.895207 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4e5b6d40-08db-4523-9d59-50d4c5322889 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:15.915952 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4e5b6d40-08db-4523-9d59-50d4c5322889 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e" status: 200 len: 1690 microversion: 2.1 time: 0.406855 Aug 31 16:22:15.918783 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2808/5807] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:15 2022] GET /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e => generated 1690 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:16.404485 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c6bf9b50-d95c-4452-a58d-4057d9cb9b55 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:16.405950 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c6bf9b50-d95c-4452-a58d-4057d9cb9b55 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 95902b01-9a33-45e2-b454-cdab91014582] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:16.423820 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c6bf9b50-d95c-4452-a58d-4057d9cb9b55 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:16.424836 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c6bf9b50-d95c-4452-a58d-4057d9cb9b55 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:16.425460 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c6bf9b50-d95c-4452-a58d-4057d9cb9b55 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:16.428069 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c6bf9b50-d95c-4452-a58d-4057d9cb9b55 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:16.429956 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c6bf9b50-d95c-4452-a58d-4057d9cb9b55 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:16.432360 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c6bf9b50-d95c-4452-a58d-4057d9cb9b55 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:16.750339 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c6bf9b50-d95c-4452-a58d-4057d9cb9b55 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:16.760441 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c6bf9b50-d95c-4452-a58d-4057d9cb9b55 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582" status: 200 len: 1365 microversion: 2.1 time: 0.361640 Aug 31 16:22:16.770125 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3000/5808] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:16 2022] GET /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582 => generated 1365 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:16.872694 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-3b9473e1-2488-48db-848e-6ed61171cbb0 req-92de769b-4468-42cc-93e6-204909298d04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95902b01-9a33-45e2-b454-cdab91014582", "tag": "dd5066b9-0a42-442a-8389-fda7bbc347b3"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:22:16.894523 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3b9473e1-2488-48db-848e-6ed61171cbb0 req-92de769b-4468-42cc-93e6-204909298d04 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:16.895014 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3b9473e1-2488-48db-848e-6ed61171cbb0 req-92de769b-4468-42cc-93e6-204909298d04 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:16.895453 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3b9473e1-2488-48db-848e-6ed61171cbb0 req-92de769b-4468-42cc-93e6-204909298d04 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:16.920634 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-3b9473e1-2488-48db-848e-6ed61171cbb0 req-92de769b-4468-42cc-93e6-204909298d04 service nova] Creating event network-changed:dd5066b9-0a42-442a-8389-fda7bbc347b3 for instance 95902b01-9a33-45e2-b454-cdab91014582 on n-h2-833090-16 Aug 31 16:22:16.931944 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-3b9473e1-2488-48db-848e-6ed61171cbb0 req-92de769b-4468-42cc-93e6-204909298d04 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063264 Aug 31 16:22:16.940449 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8b997df2-d173-4008-be71-355b4521cfe4 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:16.940449 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8b997df2-d173-4008-be71-355b4521cfe4 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 1d359c68-27fb-4b21-ba0c-0d189780d82e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:16.945300 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2809/5809] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:22:16.947540 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b997df2-d173-4008-be71-355b4521cfe4 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:16.949479 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b997df2-d173-4008-be71-355b4521cfe4 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:16.952046 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b997df2-d173-4008-be71-355b4521cfe4 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:16.953078 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b997df2-d173-4008-be71-355b4521cfe4 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:16.953547 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b997df2-d173-4008-be71-355b4521cfe4 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:16.954000 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b997df2-d173-4008-be71-355b4521cfe4 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:17.164216 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8b997df2-d173-4008-be71-355b4521cfe4 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:17.184684 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8b997df2-d173-4008-be71-355b4521cfe4 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e" status: 200 len: 1690 microversion: 2.1 time: 0.248462 Aug 31 16:22:17.205157 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3001/5810] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:16 2022] GET /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e => generated 1690 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:22:17.783097 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4f3565e5-b25a-40ce-916d-d9343ca8e852 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:17.784067 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4f3565e5-b25a-40ce-916d-d9343ca8e852 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 95902b01-9a33-45e2-b454-cdab91014582] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:17.798696 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f3565e5-b25a-40ce-916d-d9343ca8e852 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:17.799378 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f3565e5-b25a-40ce-916d-d9343ca8e852 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:17.800141 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f3565e5-b25a-40ce-916d-d9343ca8e852 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:17.801165 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f3565e5-b25a-40ce-916d-d9343ca8e852 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:17.801769 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f3565e5-b25a-40ce-916d-d9343ca8e852 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:17.802518 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f3565e5-b25a-40ce-916d-d9343ca8e852 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:18.096523 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4f3565e5-b25a-40ce-916d-d9343ca8e852 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:18.106463 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4f3565e5-b25a-40ce-916d-d9343ca8e852 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582" status: 200 len: 1365 microversion: 2.1 time: 0.327600 Aug 31 16:22:18.119561 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2810/5811] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:17 2022] GET /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582 => generated 1365 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:18.212436 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-93598f0d-660e-45ef-b2ba-f31f727475bb tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:18.213229 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-93598f0d-660e-45ef-b2ba-f31f727475bb tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 1d359c68-27fb-4b21-ba0c-0d189780d82e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:18.236470 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-93598f0d-660e-45ef-b2ba-f31f727475bb tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:18.238480 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-93598f0d-660e-45ef-b2ba-f31f727475bb tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:18.240546 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-93598f0d-660e-45ef-b2ba-f31f727475bb tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:18.242390 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-93598f0d-660e-45ef-b2ba-f31f727475bb tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:18.243561 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-93598f0d-660e-45ef-b2ba-f31f727475bb tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:18.244257 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-93598f0d-660e-45ef-b2ba-f31f727475bb tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:18.486446 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-93598f0d-660e-45ef-b2ba-f31f727475bb tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:18.497157 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-93598f0d-660e-45ef-b2ba-f31f727475bb tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e" status: 200 len: 1696 microversion: 2.1 time: 0.288710 Aug 31 16:22:18.510173 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3002/5812] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:18 2022] GET /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e => generated 1696 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:19.134620 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-351cccaf-d7c1-46c3-bb20-4c909428ebf2 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:19.139101 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-351cccaf-d7c1-46c3-bb20-4c909428ebf2 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 95902b01-9a33-45e2-b454-cdab91014582] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:19.151076 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-351cccaf-d7c1-46c3-bb20-4c909428ebf2 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:19.152423 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-351cccaf-d7c1-46c3-bb20-4c909428ebf2 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:19.152877 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-351cccaf-d7c1-46c3-bb20-4c909428ebf2 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:19.153601 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-351cccaf-d7c1-46c3-bb20-4c909428ebf2 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:19.154117 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-351cccaf-d7c1-46c3-bb20-4c909428ebf2 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:19.154680 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-351cccaf-d7c1-46c3-bb20-4c909428ebf2 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:19.371991 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-351cccaf-d7c1-46c3-bb20-4c909428ebf2 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:19.392167 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-351cccaf-d7c1-46c3-bb20-4c909428ebf2 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582" status: 200 len: 1365 microversion: 2.1 time: 0.267076 Aug 31 16:22:19.394145 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2811/5813] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:19 2022] GET /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582 => generated 1365 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:19.521342 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-71f58582-beb9-4dc9-bd2a-770823c83a94 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:19.521975 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-71f58582-beb9-4dc9-bd2a-770823c83a94 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 1d359c68-27fb-4b21-ba0c-0d189780d82e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:19.537809 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-71f58582-beb9-4dc9-bd2a-770823c83a94 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:19.538342 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-71f58582-beb9-4dc9-bd2a-770823c83a94 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:19.538801 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-71f58582-beb9-4dc9-bd2a-770823c83a94 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:19.543038 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-71f58582-beb9-4dc9-bd2a-770823c83a94 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:19.543566 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-71f58582-beb9-4dc9-bd2a-770823c83a94 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:19.544018 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-71f58582-beb9-4dc9-bd2a-770823c83a94 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:19.751813 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-71f58582-beb9-4dc9-bd2a-770823c83a94 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:19.760706 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-71f58582-beb9-4dc9-bd2a-770823c83a94 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e" status: 200 len: 1681 microversion: 2.1 time: 0.244025 Aug 31 16:22:19.763002 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3003/5814] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:19 2022] GET /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e => generated 1681 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:20.415658 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-80198d97-d069-4376-8cb8-d574f5831a5c tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:20.417970 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-80198d97-d069-4376-8cb8-d574f5831a5c tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 95902b01-9a33-45e2-b454-cdab91014582] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:20.426343 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80198d97-d069-4376-8cb8-d574f5831a5c tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:20.427676 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80198d97-d069-4376-8cb8-d574f5831a5c tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:20.428664 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80198d97-d069-4376-8cb8-d574f5831a5c tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:20.429661 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80198d97-d069-4376-8cb8-d574f5831a5c tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:20.430389 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80198d97-d069-4376-8cb8-d574f5831a5c tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:20.431038 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-80198d97-d069-4376-8cb8-d574f5831a5c tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:20.437238 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:22:20.711489 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-80198d97-d069-4376-8cb8-d574f5831a5c tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:20.727413 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-80198d97-d069-4376-8cb8-d574f5831a5c tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582" status: 200 len: 1365 microversion: 2.1 time: 0.315899 Aug 31 16:22:20.741259 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2812/5815] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:20 2022] GET /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582 => generated 1365 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:21.761133 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-509bf201-f245-4770-a102-ee3371fbfc52 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:21.763416 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-509bf201-f245-4770-a102-ee3371fbfc52 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 95902b01-9a33-45e2-b454-cdab91014582] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:21.781412 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-509bf201-f245-4770-a102-ee3371fbfc52 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:21.782042 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-509bf201-f245-4770-a102-ee3371fbfc52 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:21.782596 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-509bf201-f245-4770-a102-ee3371fbfc52 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:21.783855 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-509bf201-f245-4770-a102-ee3371fbfc52 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:21.786358 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-509bf201-f245-4770-a102-ee3371fbfc52 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:21.787042 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-509bf201-f245-4770-a102-ee3371fbfc52 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:22.384455 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-509bf201-f245-4770-a102-ee3371fbfc52 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:22.394232 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-509bf201-f245-4770-a102-ee3371fbfc52 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582" status: 200 len: 1365 microversion: 2.1 time: 0.638018 Aug 31 16:22:22.394840 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3004/5816] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:21 2022] GET /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582 => generated 1365 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:23.076798 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-ffa64e17-d2a3-4dee-ac5c-c2b44ecabcc0 req-0530599b-6a4f-492f-816c-c6675f3b6845 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d359c68-27fb-4b21-ba0c-0d189780d82e", "name": "network-vif-plugged", "status": "completed", "tag": "d1610121-0e92-4a46-ab8b-173db528ac07"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:22:23.097173 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:22:23.098273 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:22:23.137968 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ffa64e17-d2a3-4dee-ac5c-c2b44ecabcc0 req-0530599b-6a4f-492f-816c-c6675f3b6845 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:23.138696 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ffa64e17-d2a3-4dee-ac5c-c2b44ecabcc0 req-0530599b-6a4f-492f-816c-c6675f3b6845 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:23.140853 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ffa64e17-d2a3-4dee-ac5c-c2b44ecabcc0 req-0530599b-6a4f-492f-816c-c6675f3b6845 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:23.172556 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-ffa64e17-d2a3-4dee-ac5c-c2b44ecabcc0 req-0530599b-6a4f-492f-816c-c6675f3b6845 service nova] Creating event network-vif-plugged:d1610121-0e92-4a46-ab8b-173db528ac07 for instance 1d359c68-27fb-4b21-ba0c-0d189780d82e on n-h1-833090-16 Aug 31 16:22:23.185240 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-ffa64e17-d2a3-4dee-ac5c-c2b44ecabcc0 req-0530599b-6a4f-492f-816c-c6675f3b6845 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120606 Aug 31 16:22:23.186797 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2813/5817] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:22:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:22:23.419244 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-95f0d642-e3ce-4b5f-aae1-50270780985e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:23.420035 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-95f0d642-e3ce-4b5f-aae1-50270780985e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 95902b01-9a33-45e2-b454-cdab91014582] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:23.433443 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=6 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:22:23.437200 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95f0d642-e3ce-4b5f-aae1-50270780985e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:23.438728 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95f0d642-e3ce-4b5f-aae1-50270780985e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:23.439659 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95f0d642-e3ce-4b5f-aae1-50270780985e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:23.441496 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95f0d642-e3ce-4b5f-aae1-50270780985e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:23.441978 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95f0d642-e3ce-4b5f-aae1-50270780985e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:23.442432 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95f0d642-e3ce-4b5f-aae1-50270780985e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:23.790917 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-95f0d642-e3ce-4b5f-aae1-50270780985e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:23.826826 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-95f0d642-e3ce-4b5f-aae1-50270780985e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582" status: 200 len: 1365 microversion: 2.1 time: 0.413094 Aug 31 16:22:23.828026 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3005/5818] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:23 2022] GET /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582 => generated 1365 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:24.858219 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-79f4e114-51b4-49ac-b66f-0e6de5ee71fd tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:24.859630 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-79f4e114-51b4-49ac-b66f-0e6de5ee71fd tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 95902b01-9a33-45e2-b454-cdab91014582] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:24.888384 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79f4e114-51b4-49ac-b66f-0e6de5ee71fd tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:24.889177 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79f4e114-51b4-49ac-b66f-0e6de5ee71fd tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:24.891572 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79f4e114-51b4-49ac-b66f-0e6de5ee71fd tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:24.894883 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79f4e114-51b4-49ac-b66f-0e6de5ee71fd tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:24.895979 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79f4e114-51b4-49ac-b66f-0e6de5ee71fd tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:24.896448 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79f4e114-51b4-49ac-b66f-0e6de5ee71fd tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:25.787149 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-79f4e114-51b4-49ac-b66f-0e6de5ee71fd tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:25.808813 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-79f4e114-51b4-49ac-b66f-0e6de5ee71fd tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582" status: 200 len: 1365 microversion: 2.1 time: 0.953850 Aug 31 16:22:25.810578 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2814/5819] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:24 2022] GET /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582 => generated 1365 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:26.830266 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-682c1db3-90fd-4c3b-8707-174b66ad5022 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:26.831118 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-682c1db3-90fd-4c3b-8707-174b66ad5022 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 95902b01-9a33-45e2-b454-cdab91014582] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:26.850748 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-682c1db3-90fd-4c3b-8707-174b66ad5022 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:26.851346 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-682c1db3-90fd-4c3b-8707-174b66ad5022 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:26.852071 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-682c1db3-90fd-4c3b-8707-174b66ad5022 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:26.857634 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-682c1db3-90fd-4c3b-8707-174b66ad5022 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:26.858433 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-682c1db3-90fd-4c3b-8707-174b66ad5022 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:26.859270 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-682c1db3-90fd-4c3b-8707-174b66ad5022 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:27.192917 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-682c1db3-90fd-4c3b-8707-174b66ad5022 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:27.208110 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-682c1db3-90fd-4c3b-8707-174b66ad5022 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582" status: 200 len: 1365 microversion: 2.1 time: 0.382836 Aug 31 16:22:27.210627 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3006/5820] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:26 2022] GET /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582 => generated 1365 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:27.483751 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-b815c0ca-e19e-451b-8393-8b9533f11a51 req-cfebd8aa-ccd6-411f-be18-21bd83f3b75e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95902b01-9a33-45e2-b454-cdab91014582", "name": "network-vif-plugged", "status": "completed", "tag": "dd5066b9-0a42-442a-8389-fda7bbc347b3"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:22:27.515870 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b815c0ca-e19e-451b-8393-8b9533f11a51 req-cfebd8aa-ccd6-411f-be18-21bd83f3b75e service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:27.516585 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b815c0ca-e19e-451b-8393-8b9533f11a51 req-cfebd8aa-ccd6-411f-be18-21bd83f3b75e service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:27.517260 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b815c0ca-e19e-451b-8393-8b9533f11a51 req-cfebd8aa-ccd6-411f-be18-21bd83f3b75e service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:27.563281 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-b815c0ca-e19e-451b-8393-8b9533f11a51 req-cfebd8aa-ccd6-411f-be18-21bd83f3b75e service nova] Creating event network-vif-plugged:dd5066b9-0a42-442a-8389-fda7bbc347b3 for instance 95902b01-9a33-45e2-b454-cdab91014582 on n-h2-833090-16 Aug 31 16:22:27.576144 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-b815c0ca-e19e-451b-8393-8b9533f11a51 req-cfebd8aa-ccd6-411f-be18-21bd83f3b75e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104556 Aug 31 16:22:27.583448 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2815/5821] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 31 16:22:28.230559 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-01322e5d-b791-4c76-aa91-be710db07e06 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:28.231418 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-01322e5d-b791-4c76-aa91-be710db07e06 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 95902b01-9a33-45e2-b454-cdab91014582] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:28.243539 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01322e5d-b791-4c76-aa91-be710db07e06 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:28.244027 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01322e5d-b791-4c76-aa91-be710db07e06 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:28.246702 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01322e5d-b791-4c76-aa91-be710db07e06 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:28.248017 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01322e5d-b791-4c76-aa91-be710db07e06 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:28.252028 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01322e5d-b791-4c76-aa91-be710db07e06 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:28.253112 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01322e5d-b791-4c76-aa91-be710db07e06 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:28.517802 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-01322e5d-b791-4c76-aa91-be710db07e06 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:28.529436 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-01322e5d-b791-4c76-aa91-be710db07e06 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582" status: 200 len: 1365 microversion: 2.1 time: 0.303170 Aug 31 16:22:28.532904 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3007/5822] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:28 2022] GET /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582 => generated 1365 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:29.552676 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dc2c54c5-a0f0-4111-b2a2-d59c9c77391a tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:29.553463 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dc2c54c5-a0f0-4111-b2a2-d59c9c77391a tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 95902b01-9a33-45e2-b454-cdab91014582] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:29.569419 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc2c54c5-a0f0-4111-b2a2-d59c9c77391a tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:29.572812 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc2c54c5-a0f0-4111-b2a2-d59c9c77391a tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:29.574962 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc2c54c5-a0f0-4111-b2a2-d59c9c77391a tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:29.575976 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc2c54c5-a0f0-4111-b2a2-d59c9c77391a tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:29.577968 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc2c54c5-a0f0-4111-b2a2-d59c9c77391a tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:29.578485 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc2c54c5-a0f0-4111-b2a2-d59c9c77391a tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:29.764202 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dc2c54c5-a0f0-4111-b2a2-d59c9c77391a tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:29.773826 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dc2c54c5-a0f0-4111-b2a2-d59c9c77391a tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582" status: 200 len: 1365 microversion: 2.1 time: 0.226882 Aug 31 16:22:29.786663 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2816/5823] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:29 2022] GET /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582 => generated 1365 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:30.794687 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c7d01b8b-03ee-42e6-af7e-462ab6ed4ee9 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:30.795211 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c7d01b8b-03ee-42e6-af7e-462ab6ed4ee9 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 95902b01-9a33-45e2-b454-cdab91014582] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:30.804189 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c7d01b8b-03ee-42e6-af7e-462ab6ed4ee9 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:30.804653 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c7d01b8b-03ee-42e6-af7e-462ab6ed4ee9 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:30.805295 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c7d01b8b-03ee-42e6-af7e-462ab6ed4ee9 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:30.805990 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c7d01b8b-03ee-42e6-af7e-462ab6ed4ee9 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:30.806598 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c7d01b8b-03ee-42e6-af7e-462ab6ed4ee9 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:30.807229 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c7d01b8b-03ee-42e6-af7e-462ab6ed4ee9 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:30.965094 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c7d01b8b-03ee-42e6-af7e-462ab6ed4ee9 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:30.976042 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c7d01b8b-03ee-42e6-af7e-462ab6ed4ee9 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582" status: 200 len: 1555 microversion: 2.1 time: 0.185465 Aug 31 16:22:30.977249 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3008/5824] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:30 2022] GET /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582 => generated 1555 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:30.996775 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-937b916d-396d-4712-be72-e08a89c61ba3 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:30.997319 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-937b916d-396d-4712-be72-e08a89c61ba3 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 95902b01-9a33-45e2-b454-cdab91014582] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:31.003977 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-937b916d-396d-4712-be72-e08a89c61ba3 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:31.004460 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-937b916d-396d-4712-be72-e08a89c61ba3 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:31.004895 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-937b916d-396d-4712-be72-e08a89c61ba3 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:31.005588 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-937b916d-396d-4712-be72-e08a89c61ba3 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:31.006030 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-937b916d-396d-4712-be72-e08a89c61ba3 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:31.006475 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-937b916d-396d-4712-be72-e08a89c61ba3 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:31.089599 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-937b916d-396d-4712-be72-e08a89c61ba3 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096903 Aug 31 16:22:31.090588 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2817/5825] 10.222.0.50 () {58 vars in 1275 bytes} [Wed Aug 31 16:22:30 2022] GET /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:22:32.376629 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-410f5468-2a4a-4ee2-a1d9-8855fdae8f02 req-c466f635-06c5-45b2-b552-116e12b478a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95902b01-9a33-45e2-b454-cdab91014582", "tag": "dd5066b9-0a42-442a-8389-fda7bbc347b3"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:22:32.395202 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-410f5468-2a4a-4ee2-a1d9-8855fdae8f02 req-c466f635-06c5-45b2-b552-116e12b478a5 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:32.395670 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-410f5468-2a4a-4ee2-a1d9-8855fdae8f02 req-c466f635-06c5-45b2-b552-116e12b478a5 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:32.396349 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-410f5468-2a4a-4ee2-a1d9-8855fdae8f02 req-c466f635-06c5-45b2-b552-116e12b478a5 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:32.409991 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-410f5468-2a4a-4ee2-a1d9-8855fdae8f02 req-c466f635-06c5-45b2-b552-116e12b478a5 service nova] Creating event network-changed:dd5066b9-0a42-442a-8389-fda7bbc347b3 for instance 95902b01-9a33-45e2-b454-cdab91014582 on n-h2-833090-16 Aug 31 16:22:32.417911 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-410f5468-2a4a-4ee2-a1d9-8855fdae8f02 req-c466f635-06c5-45b2-b552-116e12b478a5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045662 Aug 31 16:22:32.419202 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3009/5826] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:22:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:22:36.720813 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-902ee39b-95d8-4565-a858-c1b7333fffb1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:36.721437 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-902ee39b-95d8-4565-a858-c1b7333fffb1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:36.728086 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-902ee39b-95d8-4565-a858-c1b7333fffb1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:36.728790 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-902ee39b-95d8-4565-a858-c1b7333fffb1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:36.729335 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-902ee39b-95d8-4565-a858-c1b7333fffb1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:36.730120 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-902ee39b-95d8-4565-a858-c1b7333fffb1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:36.730769 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-902ee39b-95d8-4565-a858-c1b7333fffb1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:36.731285 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-902ee39b-95d8-4565-a858-c1b7333fffb1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:36.766268 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-902ee39b-95d8-4565-a858-c1b7333fffb1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae/ips" status: 200 len: 150 microversion: 2.20 time: 0.050606 Aug 31 16:22:36.770271 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2818/5827] 10.222.0.50 () {60 vars in 1289 bytes} [Wed Aug 31 16:22:36 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae/ips => generated 150 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:22:39.889764 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b86cdfa2-32e9-47b7-9846-21fef80bbc13 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:22:39.890640 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b86cdfa2-32e9-47b7-9846-21fef80bbc13 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:39.897415 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b86cdfa2-32e9-47b7-9846-21fef80bbc13 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:39.897906 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b86cdfa2-32e9-47b7-9846-21fef80bbc13 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:39.898731 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b86cdfa2-32e9-47b7-9846-21fef80bbc13 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:39.899679 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b86cdfa2-32e9-47b7-9846-21fef80bbc13 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:39.900474 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b86cdfa2-32e9-47b7-9846-21fef80bbc13 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:39.901220 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b86cdfa2-32e9-47b7-9846-21fef80bbc13 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:39.935375 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-b86cdfa2-32e9-47b7-9846-21fef80bbc13 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lazy-loading 'flavor' on Instance uuid 42064ec8-1aec-498c-8ed7-7c1683963dae {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:22:40.191820 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b86cdfa2-32e9-47b7-9846-21fef80bbc13 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "POST /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae/action" status: 202 len: 0 microversion: 2.20 time: 0.308726 Aug 31 16:22:40.192698 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3010/5828] 10.222.0.50 () {62 vars in 1319 bytes} [Wed Aug 31 16:22:39 2022] POST /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:22:40.202846 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a23b77ee-e75a-40b8-8c2b-c1670d2f9d8a tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:40.203539 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a23b77ee-e75a-40b8-8c2b-c1670d2f9d8a tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:40.218395 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a23b77ee-e75a-40b8-8c2b-c1670d2f9d8a tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:40.219033 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a23b77ee-e75a-40b8-8c2b-c1670d2f9d8a tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:40.219651 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a23b77ee-e75a-40b8-8c2b-c1670d2f9d8a tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:40.220517 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a23b77ee-e75a-40b8-8c2b-c1670d2f9d8a tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:40.220963 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a23b77ee-e75a-40b8-8c2b-c1670d2f9d8a tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:40.221543 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a23b77ee-e75a-40b8-8c2b-c1670d2f9d8a tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:40.385439 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a23b77ee-e75a-40b8-8c2b-c1670d2f9d8a tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:40.395870 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a23b77ee-e75a-40b8-8c2b-c1670d2f9d8a tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:40.397672 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a23b77ee-e75a-40b8-8c2b-c1670d2f9d8a tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:40.399066 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a23b77ee-e75a-40b8-8c2b-c1670d2f9d8a tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1721 microversion: 2.20 time: 0.201672 Aug 31 16:22:40.400212 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2819/5829] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:22:40 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1721 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:22:41.425431 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ea5f5c46-422e-4a10-a93f-f39a51c90e47 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:41.426888 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ea5f5c46-422e-4a10-a93f-f39a51c90e47 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:41.435511 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ea5f5c46-422e-4a10-a93f-f39a51c90e47 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:41.436230 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ea5f5c46-422e-4a10-a93f-f39a51c90e47 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:41.436664 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ea5f5c46-422e-4a10-a93f-f39a51c90e47 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:41.437363 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ea5f5c46-422e-4a10-a93f-f39a51c90e47 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:41.437817 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ea5f5c46-422e-4a10-a93f-f39a51c90e47 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:41.438318 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ea5f5c46-422e-4a10-a93f-f39a51c90e47 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:41.666394 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ea5f5c46-422e-4a10-a93f-f39a51c90e47 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:41.679107 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ea5f5c46-422e-4a10-a93f-f39a51c90e47 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:41.681864 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ea5f5c46-422e-4a10-a93f-f39a51c90e47 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:41.683870 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ea5f5c46-422e-4a10-a93f-f39a51c90e47 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1721 microversion: 2.20 time: 0.264069 Aug 31 16:22:41.694628 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3011/5830] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:22:41 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1721 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:22:42.716542 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7373c074-ae63-441f-9117-a4b2c8202def tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:42.717496 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7373c074-ae63-441f-9117-a4b2c8202def tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:42.723603 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:22:42.730192 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7373c074-ae63-441f-9117-a4b2c8202def tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:42.730946 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7373c074-ae63-441f-9117-a4b2c8202def tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:42.731619 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7373c074-ae63-441f-9117-a4b2c8202def tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:42.732665 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7373c074-ae63-441f-9117-a4b2c8202def tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:42.733120 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7373c074-ae63-441f-9117-a4b2c8202def tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:42.733546 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7373c074-ae63-441f-9117-a4b2c8202def tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:42.932232 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7373c074-ae63-441f-9117-a4b2c8202def tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:42.966712 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7373c074-ae63-441f-9117-a4b2c8202def tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:42.971068 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7373c074-ae63-441f-9117-a4b2c8202def tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:42.980121 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7373c074-ae63-441f-9117-a4b2c8202def tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1721 microversion: 2.20 time: 0.269008 Aug 31 16:22:42.986474 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2820/5831] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:22:42 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1721 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:22:44.004101 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d3c01109-8053-4fe2-a0ca-e97a001e3bc6 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:44.005350 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d3c01109-8053-4fe2-a0ca-e97a001e3bc6 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:44.013234 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=32 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:22:44.016045 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d3c01109-8053-4fe2-a0ca-e97a001e3bc6 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:44.017003 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d3c01109-8053-4fe2-a0ca-e97a001e3bc6 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:44.017659 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d3c01109-8053-4fe2-a0ca-e97a001e3bc6 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:44.018765 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d3c01109-8053-4fe2-a0ca-e97a001e3bc6 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:44.019437 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d3c01109-8053-4fe2-a0ca-e97a001e3bc6 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:44.020194 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d3c01109-8053-4fe2-a0ca-e97a001e3bc6 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:44.199951 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d3c01109-8053-4fe2-a0ca-e97a001e3bc6 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:44.208934 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d3c01109-8053-4fe2-a0ca-e97a001e3bc6 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:44.214054 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d3c01109-8053-4fe2-a0ca-e97a001e3bc6 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:44.215302 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d3c01109-8053-4fe2-a0ca-e97a001e3bc6 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1721 microversion: 2.20 time: 0.215391 Aug 31 16:22:44.215866 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3012/5832] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:22:43 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1721 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:22:45.239458 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fad70b96-2c5d-44cf-8d99-8853a380e207 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:45.240138 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fad70b96-2c5d-44cf-8d99-8853a380e207 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:45.251526 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fad70b96-2c5d-44cf-8d99-8853a380e207 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:45.252093 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fad70b96-2c5d-44cf-8d99-8853a380e207 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:45.252527 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fad70b96-2c5d-44cf-8d99-8853a380e207 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:45.253819 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fad70b96-2c5d-44cf-8d99-8853a380e207 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:45.253819 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fad70b96-2c5d-44cf-8d99-8853a380e207 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:45.254139 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fad70b96-2c5d-44cf-8d99-8853a380e207 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:45.441634 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fad70b96-2c5d-44cf-8d99-8853a380e207 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:45.453362 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fad70b96-2c5d-44cf-8d99-8853a380e207 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:45.456931 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fad70b96-2c5d-44cf-8d99-8853a380e207 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:45.459098 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fad70b96-2c5d-44cf-8d99-8853a380e207 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1721 microversion: 2.20 time: 0.224186 Aug 31 16:22:45.459885 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2821/5833] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:22:45 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1721 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:22:46.015690 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-cb276bf7-971b-4f60-9374-a1e8fba86cae tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:22:46.019243 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-cb276bf7-971b-4f60-9374-a1e8fba86cae tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 1d359c68-27fb-4b21-ba0c-0d189780d82e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:46.028158 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb276bf7-971b-4f60-9374-a1e8fba86cae tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:46.028898 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb276bf7-971b-4f60-9374-a1e8fba86cae tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:46.029511 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb276bf7-971b-4f60-9374-a1e8fba86cae tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:46.030620 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb276bf7-971b-4f60-9374-a1e8fba86cae tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:46.031300 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb276bf7-971b-4f60-9374-a1e8fba86cae tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:46.031727 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb276bf7-971b-4f60-9374-a1e8fba86cae tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:46.035495 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:22:46.120251 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-cb276bf7-971b-4f60-9374-a1e8fba86cae tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "POST /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e/action" status: 200 len: 24572 microversion: 2.1 time: 0.111492 Aug 31 16:22:46.120957 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3013/5834] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:22:46 2022] POST /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e/action => generated 24572 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:22:46.484307 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7e28dc45-8138-405c-9a8b-29ef2d83249e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:46.485045 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7e28dc45-8138-405c-9a8b-29ef2d83249e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:46.493316 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e28dc45-8138-405c-9a8b-29ef2d83249e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:46.494266 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e28dc45-8138-405c-9a8b-29ef2d83249e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:46.494694 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e28dc45-8138-405c-9a8b-29ef2d83249e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:46.495620 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e28dc45-8138-405c-9a8b-29ef2d83249e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:46.496038 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e28dc45-8138-405c-9a8b-29ef2d83249e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:46.497056 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e28dc45-8138-405c-9a8b-29ef2d83249e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:46.674226 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7e28dc45-8138-405c-9a8b-29ef2d83249e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:46.683712 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7e28dc45-8138-405c-9a8b-29ef2d83249e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:46.685348 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7e28dc45-8138-405c-9a8b-29ef2d83249e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:46.686681 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7e28dc45-8138-405c-9a8b-29ef2d83249e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1721 microversion: 2.20 time: 0.206510 Aug 31 16:22:46.687254 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2822/5835] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:22:46 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1721 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:22:47.716998 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-91eb8580-1efc-47ef-82e2-7b23760c6863 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:47.717868 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-91eb8580-1efc-47ef-82e2-7b23760c6863 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:47.728055 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91eb8580-1efc-47ef-82e2-7b23760c6863 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:47.728730 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91eb8580-1efc-47ef-82e2-7b23760c6863 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:47.729126 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91eb8580-1efc-47ef-82e2-7b23760c6863 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:47.729866 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91eb8580-1efc-47ef-82e2-7b23760c6863 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:47.730324 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91eb8580-1efc-47ef-82e2-7b23760c6863 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:47.731115 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91eb8580-1efc-47ef-82e2-7b23760c6863 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:47.928644 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-91eb8580-1efc-47ef-82e2-7b23760c6863 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:47.944436 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-91eb8580-1efc-47ef-82e2-7b23760c6863 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:47.946689 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-91eb8580-1efc-47ef-82e2-7b23760c6863 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:47.949750 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-91eb8580-1efc-47ef-82e2-7b23760c6863 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1721 microversion: 2.20 time: 0.242241 Aug 31 16:22:47.965108 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3014/5836] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:22:47 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1721 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:22:48.976325 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3173964f-a427-4daf-8f29-1429f0b4826e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:48.978159 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3173964f-a427-4daf-8f29-1429f0b4826e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:48.987288 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3173964f-a427-4daf-8f29-1429f0b4826e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:48.988249 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3173964f-a427-4daf-8f29-1429f0b4826e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:48.988711 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3173964f-a427-4daf-8f29-1429f0b4826e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:48.989559 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3173964f-a427-4daf-8f29-1429f0b4826e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:48.990701 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3173964f-a427-4daf-8f29-1429f0b4826e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:48.991429 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3173964f-a427-4daf-8f29-1429f0b4826e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:49.161723 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3173964f-a427-4daf-8f29-1429f0b4826e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:49.171566 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3173964f-a427-4daf-8f29-1429f0b4826e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:49.173639 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3173964f-a427-4daf-8f29-1429f0b4826e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:49.175297 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3173964f-a427-4daf-8f29-1429f0b4826e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1721 microversion: 2.20 time: 0.204616 Aug 31 16:22:49.176749 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2823/5837] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:22:48 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1721 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:22:50.210882 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6652d665-4a6e-47fa-b652-a260ad6ee111 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:50.211755 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6652d665-4a6e-47fa-b652-a260ad6ee111 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:50.220882 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6652d665-4a6e-47fa-b652-a260ad6ee111 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:50.221611 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6652d665-4a6e-47fa-b652-a260ad6ee111 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:50.222238 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6652d665-4a6e-47fa-b652-a260ad6ee111 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:50.223130 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6652d665-4a6e-47fa-b652-a260ad6ee111 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:50.224024 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6652d665-4a6e-47fa-b652-a260ad6ee111 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:50.224593 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6652d665-4a6e-47fa-b652-a260ad6ee111 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:50.852488 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6652d665-4a6e-47fa-b652-a260ad6ee111 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:50.874918 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6652d665-4a6e-47fa-b652-a260ad6ee111 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:50.877983 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6652d665-4a6e-47fa-b652-a260ad6ee111 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:50.880447 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6652d665-4a6e-47fa-b652-a260ad6ee111 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1721 microversion: 2.20 time: 0.673476 Aug 31 16:22:50.881023 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3015/5838] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:22:50 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1721 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:22:51.905044 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4ffcdc5e-ebad-4984-877f-a97693608eb5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:51.905716 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4ffcdc5e-ebad-4984-877f-a97693608eb5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:51.917158 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ffcdc5e-ebad-4984-877f-a97693608eb5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:51.918637 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ffcdc5e-ebad-4984-877f-a97693608eb5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:51.919346 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ffcdc5e-ebad-4984-877f-a97693608eb5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:51.920435 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ffcdc5e-ebad-4984-877f-a97693608eb5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:51.921174 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ffcdc5e-ebad-4984-877f-a97693608eb5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:51.921831 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ffcdc5e-ebad-4984-877f-a97693608eb5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:51.928074 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=59 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:22:52.102438 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4ffcdc5e-ebad-4984-877f-a97693608eb5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:52.110844 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4ffcdc5e-ebad-4984-877f-a97693608eb5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:52.112272 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4ffcdc5e-ebad-4984-877f-a97693608eb5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:52.114519 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4ffcdc5e-ebad-4984-877f-a97693608eb5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1721 microversion: 2.20 time: 0.215144 Aug 31 16:22:52.118878 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2824/5839] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:22:51 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1721 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:22:53.143289 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4dffb5d2-df32-49be-a438-3afa14cb7ddc tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:53.144145 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4dffb5d2-df32-49be-a438-3afa14cb7ddc tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:53.153386 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4dffb5d2-df32-49be-a438-3afa14cb7ddc tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:53.154312 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4dffb5d2-df32-49be-a438-3afa14cb7ddc tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:53.154921 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4dffb5d2-df32-49be-a438-3afa14cb7ddc tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:53.155937 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4dffb5d2-df32-49be-a438-3afa14cb7ddc tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:53.157673 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4dffb5d2-df32-49be-a438-3afa14cb7ddc tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:53.158398 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4dffb5d2-df32-49be-a438-3afa14cb7ddc tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:53.398914 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4dffb5d2-df32-49be-a438-3afa14cb7ddc tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:53.418170 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4dffb5d2-df32-49be-a438-3afa14cb7ddc tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:53.420030 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4dffb5d2-df32-49be-a438-3afa14cb7ddc tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:53.422143 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4dffb5d2-df32-49be-a438-3afa14cb7ddc tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1721 microversion: 2.20 time: 0.283508 Aug 31 16:22:53.423293 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3016/5840] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:22:53 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1721 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:22:54.448954 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-91e5234b-9d4a-4770-8410-751a303892ed tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:54.448954 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-91e5234b-9d4a-4770-8410-751a303892ed tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:54.465588 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91e5234b-9d4a-4770-8410-751a303892ed tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:54.467822 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91e5234b-9d4a-4770-8410-751a303892ed tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:54.468469 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91e5234b-9d4a-4770-8410-751a303892ed tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:54.469520 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91e5234b-9d4a-4770-8410-751a303892ed tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:54.470418 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91e5234b-9d4a-4770-8410-751a303892ed tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:54.470926 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91e5234b-9d4a-4770-8410-751a303892ed tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:54.651632 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-91e5234b-9d4a-4770-8410-751a303892ed tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:54.663870 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-91e5234b-9d4a-4770-8410-751a303892ed tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:54.666518 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-91e5234b-9d4a-4770-8410-751a303892ed tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:54.668948 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-91e5234b-9d4a-4770-8410-751a303892ed tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1721 microversion: 2.20 time: 0.225420 Aug 31 16:22:54.669788 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2825/5841] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:22:54 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1721 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:22:55.697052 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5c57033c-96aa-4fd3-bc7b-f08599f348b7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:55.697883 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5c57033c-96aa-4fd3-bc7b-f08599f348b7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:55.711204 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5c57033c-96aa-4fd3-bc7b-f08599f348b7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:55.711714 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5c57033c-96aa-4fd3-bc7b-f08599f348b7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:55.712202 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5c57033c-96aa-4fd3-bc7b-f08599f348b7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:55.713346 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5c57033c-96aa-4fd3-bc7b-f08599f348b7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:55.715260 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5c57033c-96aa-4fd3-bc7b-f08599f348b7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:55.715955 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5c57033c-96aa-4fd3-bc7b-f08599f348b7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:55.980779 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5c57033c-96aa-4fd3-bc7b-f08599f348b7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:55.996179 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5c57033c-96aa-4fd3-bc7b-f08599f348b7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:55.999329 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5c57033c-96aa-4fd3-bc7b-f08599f348b7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:56.003979 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5c57033c-96aa-4fd3-bc7b-f08599f348b7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1742 microversion: 2.20 time: 0.310035 Aug 31 16:22:56.022495 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3017/5842] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:22:55 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1742 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:22:57.028856 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-58cc8457-2984-43c0-a7c6-17c7d3f9f30f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:57.029497 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-58cc8457-2984-43c0-a7c6-17c7d3f9f30f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:57.037379 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58cc8457-2984-43c0-a7c6-17c7d3f9f30f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:57.038119 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58cc8457-2984-43c0-a7c6-17c7d3f9f30f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:57.038733 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58cc8457-2984-43c0-a7c6-17c7d3f9f30f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:57.039579 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58cc8457-2984-43c0-a7c6-17c7d3f9f30f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:57.040242 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58cc8457-2984-43c0-a7c6-17c7d3f9f30f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:57.040926 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58cc8457-2984-43c0-a7c6-17c7d3f9f30f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:57.239119 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-58cc8457-2984-43c0-a7c6-17c7d3f9f30f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:57.248817 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-58cc8457-2984-43c0-a7c6-17c7d3f9f30f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:57.250812 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-58cc8457-2984-43c0-a7c6-17c7d3f9f30f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:57.252265 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-58cc8457-2984-43c0-a7c6-17c7d3f9f30f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1742 microversion: 2.20 time: 0.227888 Aug 31 16:22:57.253054 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2826/5843] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:22:57 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1742 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:22:57.919896 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-1a28fd58-03a9-4c17-bcc1-ce4f7641edaf req-54a2643b-8047-43b8-aa61-adff9d4e8b91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42064ec8-1aec-498c-8ed7-7c1683963dae", "name": "network-vif-plugged", "status": "completed", "tag": "8298d82a-a2b4-4bc9-b94c-40f87ac42aa3"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:22:57.942168 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-1a28fd58-03a9-4c17-bcc1-ce4f7641edaf req-54a2643b-8047-43b8-aa61-adff9d4e8b91 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:57.945829 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-1a28fd58-03a9-4c17-bcc1-ce4f7641edaf req-54a2643b-8047-43b8-aa61-adff9d4e8b91 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:57.948291 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-1a28fd58-03a9-4c17-bcc1-ce4f7641edaf req-54a2643b-8047-43b8-aa61-adff9d4e8b91 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:57.970608 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-1a28fd58-03a9-4c17-bcc1-ce4f7641edaf req-54a2643b-8047-43b8-aa61-adff9d4e8b91 service nova] Creating event network-vif-plugged:8298d82a-a2b4-4bc9-b94c-40f87ac42aa3 for instance 42064ec8-1aec-498c-8ed7-7c1683963dae on n-h1-833090-16 Aug 31 16:22:57.977265 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-1a28fd58-03a9-4c17-bcc1-ce4f7641edaf req-54a2643b-8047-43b8-aa61-adff9d4e8b91 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063501 Aug 31 16:22:57.978656 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3018/5844] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:22:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:22:58.276985 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f367316c-61f2-4456-aae8-c3fbcdcff7db tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:58.279227 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f367316c-61f2-4456-aae8-c3fbcdcff7db tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:58.291633 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f367316c-61f2-4456-aae8-c3fbcdcff7db tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:58.295532 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f367316c-61f2-4456-aae8-c3fbcdcff7db tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:58.296045 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f367316c-61f2-4456-aae8-c3fbcdcff7db tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:58.296902 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f367316c-61f2-4456-aae8-c3fbcdcff7db tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:58.297394 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f367316c-61f2-4456-aae8-c3fbcdcff7db tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:58.297821 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f367316c-61f2-4456-aae8-c3fbcdcff7db tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:58.519478 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0c505b89-02f1-48bb-ade0-369ccdbe39b5 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:58.520287 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0c505b89-02f1-48bb-ade0-369ccdbe39b5 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 1d359c68-27fb-4b21-ba0c-0d189780d82e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:58.533483 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0c505b89-02f1-48bb-ade0-369ccdbe39b5 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:58.534898 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0c505b89-02f1-48bb-ade0-369ccdbe39b5 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:58.535739 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0c505b89-02f1-48bb-ade0-369ccdbe39b5 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:58.538887 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0c505b89-02f1-48bb-ade0-369ccdbe39b5 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:58.539681 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0c505b89-02f1-48bb-ade0-369ccdbe39b5 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:58.540748 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0c505b89-02f1-48bb-ade0-369ccdbe39b5 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:58.592718 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0c505b89-02f1-48bb-ade0-369ccdbe39b5 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 1d359c68-27fb-4b21-ba0c-0d189780d82e] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:22:58.719126 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f367316c-61f2-4456-aae8-c3fbcdcff7db tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:58.730407 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f367316c-61f2-4456-aae8-c3fbcdcff7db tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:58.744048 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f367316c-61f2-4456-aae8-c3fbcdcff7db tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:58.744272 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0c505b89-02f1-48bb-ade0-369ccdbe39b5 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "DELETE /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e" status: 204 len: 0 microversion: 2.1 time: 0.229769 Aug 31 16:22:58.745217 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f367316c-61f2-4456-aae8-c3fbcdcff7db tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1742 microversion: 2.20 time: 0.473828 Aug 31 16:22:58.745835 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3019/5845] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:22:58 2022] DELETE /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:22:58.753079 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2827/5846] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:22:58 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1742 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:22:58.756201 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-153bdd10-dccd-45ce-b73a-e0f70a3cc124 req-38ce5458-8b6c-47a4-97ad-021e2b4f5d38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d359c68-27fb-4b21-ba0c-0d189780d82e", "tag": "d1610121-0e92-4a46-ab8b-173db528ac07"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:22:58.774929 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c4fde9f8-fdd9-4430-adc9-d26de4016c2b tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:58.775616 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c4fde9f8-fdd9-4430-adc9-d26de4016c2b tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 1d359c68-27fb-4b21-ba0c-0d189780d82e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:58.777354 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-153bdd10-dccd-45ce-b73a-e0f70a3cc124 req-38ce5458-8b6c-47a4-97ad-021e2b4f5d38 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:58.778115 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-153bdd10-dccd-45ce-b73a-e0f70a3cc124 req-38ce5458-8b6c-47a4-97ad-021e2b4f5d38 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:58.788710 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-153bdd10-dccd-45ce-b73a-e0f70a3cc124 req-38ce5458-8b6c-47a4-97ad-021e2b4f5d38 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:58.791995 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4fde9f8-fdd9-4430-adc9-d26de4016c2b tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:58.792598 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4fde9f8-fdd9-4430-adc9-d26de4016c2b tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:58.793273 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4fde9f8-fdd9-4430-adc9-d26de4016c2b tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:58.802879 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4fde9f8-fdd9-4430-adc9-d26de4016c2b tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:58.803379 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4fde9f8-fdd9-4430-adc9-d26de4016c2b tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:58.804931 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4fde9f8-fdd9-4430-adc9-d26de4016c2b tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:58.817490 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-153bdd10-dccd-45ce-b73a-e0f70a3cc124 req-38ce5458-8b6c-47a4-97ad-021e2b4f5d38 service nova] Creating event network-changed:d1610121-0e92-4a46-ab8b-173db528ac07 for instance 1d359c68-27fb-4b21-ba0c-0d189780d82e on n-h1-833090-16 Aug 31 16:22:58.841679 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-153bdd10-dccd-45ce-b73a-e0f70a3cc124 req-38ce5458-8b6c-47a4-97ad-021e2b4f5d38 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093346 Aug 31 16:22:58.847781 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3020/5847] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:22:59.050334 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c4fde9f8-fdd9-4430-adc9-d26de4016c2b tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:22:59.061323 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c4fde9f8-fdd9-4430-adc9-d26de4016c2b tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e" status: 200 len: 1687 microversion: 2.1 time: 0.306804 Aug 31 16:22:59.061925 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2828/5848] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:22:58 2022] GET /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e => generated 1687 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:22:59.774385 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-89536662-7918-4c14-8a8b-60101e3b7253 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:22:59.776069 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-89536662-7918-4c14-8a8b-60101e3b7253 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:22:59.793337 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-89536662-7918-4c14-8a8b-60101e3b7253 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:59.794250 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-89536662-7918-4c14-8a8b-60101e3b7253 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:59.795261 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-89536662-7918-4c14-8a8b-60101e3b7253 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:22:59.796240 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-89536662-7918-4c14-8a8b-60101e3b7253 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:22:59.798077 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-89536662-7918-4c14-8a8b-60101e3b7253 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:22:59.798786 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-89536662-7918-4c14-8a8b-60101e3b7253 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:00.024645 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-89536662-7918-4c14-8a8b-60101e3b7253 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:00.035323 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-89536662-7918-4c14-8a8b-60101e3b7253 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:00.037533 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-89536662-7918-4c14-8a8b-60101e3b7253 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:00.038874 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-89536662-7918-4c14-8a8b-60101e3b7253 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1737 microversion: 2.20 time: 0.271803 Aug 31 16:23:00.039850 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3021/5849] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:22:59 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1737 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:23:00.087529 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8b83e27b-6382-4031-ae1a-e68cdaf1c46c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:00.088144 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8b83e27b-6382-4031-ae1a-e68cdaf1c46c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 1d359c68-27fb-4b21-ba0c-0d189780d82e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:00.106043 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b83e27b-6382-4031-ae1a-e68cdaf1c46c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:00.106636 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b83e27b-6382-4031-ae1a-e68cdaf1c46c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:00.107181 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b83e27b-6382-4031-ae1a-e68cdaf1c46c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:00.107908 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b83e27b-6382-4031-ae1a-e68cdaf1c46c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:00.108543 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b83e27b-6382-4031-ae1a-e68cdaf1c46c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:00.109019 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b83e27b-6382-4031-ae1a-e68cdaf1c46c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:00.466175 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8b83e27b-6382-4031-ae1a-e68cdaf1c46c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:00.486542 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8b83e27b-6382-4031-ae1a-e68cdaf1c46c tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e" status: 200 len: 1687 microversion: 2.1 time: 0.403232 Aug 31 16:23:00.490644 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2829/5850] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:00 2022] GET /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e => generated 1687 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:23:01.068913 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ad1e340f-4dd8-4bab-a89d-c8112141ebc3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:01.069496 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ad1e340f-4dd8-4bab-a89d-c8112141ebc3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:01.099799 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ad1e340f-4dd8-4bab-a89d-c8112141ebc3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:01.100296 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ad1e340f-4dd8-4bab-a89d-c8112141ebc3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:01.100729 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ad1e340f-4dd8-4bab-a89d-c8112141ebc3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:01.101441 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ad1e340f-4dd8-4bab-a89d-c8112141ebc3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:01.101892 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ad1e340f-4dd8-4bab-a89d-c8112141ebc3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:01.102593 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ad1e340f-4dd8-4bab-a89d-c8112141ebc3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:01.513808 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-33e2fb2e-113f-4ace-ad02-185152ff6612 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:01.514545 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-33e2fb2e-113f-4ace-ad02-185152ff6612 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 1d359c68-27fb-4b21-ba0c-0d189780d82e] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:01.529058 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33e2fb2e-113f-4ace-ad02-185152ff6612 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:01.530017 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33e2fb2e-113f-4ace-ad02-185152ff6612 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:01.530713 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33e2fb2e-113f-4ace-ad02-185152ff6612 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:01.538808 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33e2fb2e-113f-4ace-ad02-185152ff6612 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:01.539378 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33e2fb2e-113f-4ace-ad02-185152ff6612 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:01.539972 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33e2fb2e-113f-4ace-ad02-185152ff6612 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:01.732013 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-33e2fb2e-113f-4ace-ad02-185152ff6612 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87f8241df6664aa59ba669d733e53871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3397e8a2a042486eb323432c47dfd392', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:01.744664 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-33e2fb2e-113f-4ace-ad02-185152ff6612 tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e" status: 200 len: 1502 microversion: 2.1 time: 0.232427 Aug 31 16:23:01.745952 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2830/5851] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:01 2022] GET /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e => generated 1502 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:23:01.753570 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-c5597359-5d8a-4ac8-9c63-bf7d7a9fc2c4 req-c10300e9-9d90-4d82-a2fb-f58334393a23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d359c68-27fb-4b21-ba0c-0d189780d82e", "name": "network-vif-deleted", "tag": "d1610121-0e92-4a46-ab8b-173db528ac07"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:23:01.766431 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ad1e340f-4dd8-4bab-a89d-c8112141ebc3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:01.787493 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ad1e340f-4dd8-4bab-a89d-c8112141ebc3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:01.794449 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c5597359-5d8a-4ac8-9c63-bf7d7a9fc2c4 req-c10300e9-9d90-4d82-a2fb-f58334393a23 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:01.794866 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ad1e340f-4dd8-4bab-a89d-c8112141ebc3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:01.796992 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ad1e340f-4dd8-4bab-a89d-c8112141ebc3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1737 microversion: 2.20 time: 0.731941 Aug 31 16:23:01.797689 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c5597359-5d8a-4ac8-9c63-bf7d7a9fc2c4 req-c10300e9-9d90-4d82-a2fb-f58334393a23 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:01.798374 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c5597359-5d8a-4ac8-9c63-bf7d7a9fc2c4 req-c10300e9-9d90-4d82-a2fb-f58334393a23 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:01.799021 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3022/5852] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:01 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1737 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:23:01.816015 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-c5597359-5d8a-4ac8-9c63-bf7d7a9fc2c4 req-c10300e9-9d90-4d82-a2fb-f58334393a23 service nova] Creating event network-vif-deleted:d1610121-0e92-4a46-ab8b-173db528ac07 for instance 1d359c68-27fb-4b21-ba0c-0d189780d82e on n-h1-833090-16 Aug 31 16:23:01.821690 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-c5597359-5d8a-4ac8-9c63-bf7d7a9fc2c4 req-c10300e9-9d90-4d82-a2fb-f58334393a23 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071543 Aug 31 16:23:01.822798 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2831/5853] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:23:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:23:02.775546 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-22da064e-26c9-4f6a-ae89-9cbac4c0d1fb tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:02.776927 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-22da064e-26c9-4f6a-ae89-9cbac4c0d1fb tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] [instance: 1d359c68-27fb-4b21-ba0c-0d189780d82e] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:02.796190 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-22da064e-26c9-4f6a-ae89-9cbac4c0d1fb tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:02.797862 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-22da064e-26c9-4f6a-ae89-9cbac4c0d1fb tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:02.798359 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-22da064e-26c9-4f6a-ae89-9cbac4c0d1fb tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:02.802386 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-22da064e-26c9-4f6a-ae89-9cbac4c0d1fb tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:02.806532 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-22da064e-26c9-4f6a-ae89-9cbac4c0d1fb tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:02.807223 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-22da064e-26c9-4f6a-ae89-9cbac4c0d1fb tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:02.825402 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-25e735e2-d380-445f-b771-02aeebd38d71 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:02.827501 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-25e735e2-d380-445f-b771-02aeebd38d71 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:02.856113 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25e735e2-d380-445f-b771-02aeebd38d71 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:02.856849 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25e735e2-d380-445f-b771-02aeebd38d71 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:02.861224 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25e735e2-d380-445f-b771-02aeebd38d71 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:02.862360 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25e735e2-d380-445f-b771-02aeebd38d71 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:02.862971 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25e735e2-d380-445f-b771-02aeebd38d71 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:02.864256 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25e735e2-d380-445f-b771-02aeebd38d71 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:02.866001 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-22da064e-26c9-4f6a-ae89-9cbac4c0d1fb tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] HTTP exception thrown: Instance 1d359c68-27fb-4b21-ba0c-0d189780d82e could not be found. Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-22da064e-26c9-4f6a-ae89-9cbac4c0d1fb tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Request method failure captured: Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e HTTP/1.1 Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4fV98oVosqGT7VWC4t0BtAiBiZATLbXebs7dwZ2GTRmxWIxlWpcykql1rc4XcH6S5iXxbfnhW9zu0xtlzwQXV8xqLhjj_kkcwN0JMTiH3_0LSsRjsreTCqRz_N8Dc-RwStRrYjFigQ-KrUSCoxe4mvwPpJjWkSJo0qe7m_-bm95Maw Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 3397e8a2a042486eb323432c47dfd392 Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-316597183 Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3397e8a2a042486eb323432c47dfd392"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3397e8a2a042486eb323432c47dfd392"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3397e8a2a042486eb323432c47dfd392"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3397e8a2a042486eb323432c47dfd392", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-TestNetworkAdvancedServerOps-316597183 Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 3397e8a2a042486eb323432c47dfd392 Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-316597183 Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-TestNetworkAdvancedServerOps-316597183-project Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 87f8241df6664aa59ba669d733e53871 Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-TestNetworkAdvancedServerOps-316597183-project Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 1d359c68-27fb-4b21-ba0c-0d189780d82e could not be found. Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '1d359c68-27fb-4b21-ba0c-0d189780d82e'} Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d359c68-27fb-4b21-ba0c-0d189780d82e could not be found. Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d359c68-27fb-4b21-ba0c-0d189780d82e could not be found. Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:23:02.888056 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:23:02.892963 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:23:02.892963 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:23:02.892963 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:23:02.892963 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:23:02.892963 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:23:02.892963 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:23:02.892963 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d359c68-27fb-4b21-ba0c-0d189780d82e could not be found. Aug 31 16:23:02.892963 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:23:02.896532 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-22da064e-26c9-4f6a-ae89-9cbac4c0d1fb tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Returning 404 to user: Instance 1d359c68-27fb-4b21-ba0c-0d189780d82e could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:23:02.896532 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-22da064e-26c9-4f6a-ae89-9cbac4c0d1fb tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "GET /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e" status: 404 len: 111 microversion: 2.1 time: 0.129586 Aug 31 16:23:02.903681 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3023/5854] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:02 2022] GET /compute/v2.1/servers/1d359c68-27fb-4b21-ba0c-0d189780d82e => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:23:03.181608 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-25e735e2-d380-445f-b771-02aeebd38d71 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:03.193799 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-25e735e2-d380-445f-b771-02aeebd38d71 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:03.195649 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-25e735e2-d380-445f-b771-02aeebd38d71 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:03.197770 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-25e735e2-d380-445f-b771-02aeebd38d71 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1737 microversion: 2.20 time: 0.376710 Aug 31 16:23:03.211767 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2832/5855] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:02 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1737 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:23:04.224417 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b1bab03c-4bad-4a6e-91e4-45709615925c tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:04.225674 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b1bab03c-4bad-4a6e-91e4-45709615925c tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:04.257072 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1bab03c-4bad-4a6e-91e4-45709615925c tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:04.259470 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1bab03c-4bad-4a6e-91e4-45709615925c tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:04.260165 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1bab03c-4bad-4a6e-91e4-45709615925c tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:04.263181 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1bab03c-4bad-4a6e-91e4-45709615925c tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:04.263859 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1bab03c-4bad-4a6e-91e4-45709615925c tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:04.265114 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b1bab03c-4bad-4a6e-91e4-45709615925c tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:04.563747 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b1bab03c-4bad-4a6e-91e4-45709615925c tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:04.573717 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b1bab03c-4bad-4a6e-91e4-45709615925c tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:04.584140 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b1bab03c-4bad-4a6e-91e4-45709615925c tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:04.586916 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b1bab03c-4bad-4a6e-91e4-45709615925c tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1737 microversion: 2.20 time: 0.366701 Aug 31 16:23:04.588941 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3024/5856] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:04 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1737 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:23:05.635860 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-69ba0e96-243c-4904-8288-6f36fb8fb611 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:05.637674 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-69ba0e96-243c-4904-8288-6f36fb8fb611 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:05.644922 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69ba0e96-243c-4904-8288-6f36fb8fb611 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:05.645413 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69ba0e96-243c-4904-8288-6f36fb8fb611 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:05.645844 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69ba0e96-243c-4904-8288-6f36fb8fb611 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:05.646576 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69ba0e96-243c-4904-8288-6f36fb8fb611 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:05.647029 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69ba0e96-243c-4904-8288-6f36fb8fb611 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:05.647456 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69ba0e96-243c-4904-8288-6f36fb8fb611 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:06.531602 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-69ba0e96-243c-4904-8288-6f36fb8fb611 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:06.547265 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-69ba0e96-243c-4904-8288-6f36fb8fb611 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:06.550044 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-69ba0e96-243c-4904-8288-6f36fb8fb611 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:06.553199 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-69ba0e96-243c-4904-8288-6f36fb8fb611 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1737 microversion: 2.20 time: 0.935439 Aug 31 16:23:06.566499 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2833/5857] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:05 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1737 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:23:07.586549 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6e8b9aa0-a0ae-46d2-ad4c-6a3444610835 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:07.588445 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6e8b9aa0-a0ae-46d2-ad4c-6a3444610835 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:07.605853 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6e8b9aa0-a0ae-46d2-ad4c-6a3444610835 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:07.606831 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6e8b9aa0-a0ae-46d2-ad4c-6a3444610835 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:07.607493 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6e8b9aa0-a0ae-46d2-ad4c-6a3444610835 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:07.611699 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6e8b9aa0-a0ae-46d2-ad4c-6a3444610835 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:07.612800 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6e8b9aa0-a0ae-46d2-ad4c-6a3444610835 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:07.626790 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6e8b9aa0-a0ae-46d2-ad4c-6a3444610835 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:07.986198 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6e8b9aa0-a0ae-46d2-ad4c-6a3444610835 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:08.005902 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6e8b9aa0-a0ae-46d2-ad4c-6a3444610835 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:08.014085 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6e8b9aa0-a0ae-46d2-ad4c-6a3444610835 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:08.016610 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6e8b9aa0-a0ae-46d2-ad4c-6a3444610835 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1737 microversion: 2.20 time: 0.435696 Aug 31 16:23:08.046677 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3025/5858] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:07 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1737 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:23:09.045553 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4a16e682-5346-4915-97ea-5dc4152c96c2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:09.047641 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4a16e682-5346-4915-97ea-5dc4152c96c2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:09.063388 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a16e682-5346-4915-97ea-5dc4152c96c2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:09.063896 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a16e682-5346-4915-97ea-5dc4152c96c2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:09.064425 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a16e682-5346-4915-97ea-5dc4152c96c2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:09.065125 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a16e682-5346-4915-97ea-5dc4152c96c2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:09.065505 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a16e682-5346-4915-97ea-5dc4152c96c2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:09.065982 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a16e682-5346-4915-97ea-5dc4152c96c2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:09.507422 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4a16e682-5346-4915-97ea-5dc4152c96c2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:09.539575 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4a16e682-5346-4915-97ea-5dc4152c96c2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:09.546920 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4a16e682-5346-4915-97ea-5dc4152c96c2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:09.555565 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4a16e682-5346-4915-97ea-5dc4152c96c2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1737 microversion: 2.20 time: 0.514099 Aug 31 16:23:09.583351 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2834/5859] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:09 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1737 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:23:10.125150 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a23fb43f-e85d-48d2-8cb8-a45a92af1a5f tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] Calling method '.version_select at 0x7fbb45f7aee0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:10.176780 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a23fb43f-e85d-48d2-8cb8-a45a92af1a5f tempest-TestNetworkAdvancedServerOps-316597183 tempest-TestNetworkAdvancedServerOps-316597183-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1044602333" status: 202 len: 0 microversion: 2.1 time: 0.057263 Aug 31 16:23:10.181202 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3026/5860] 10.222.0.50 () {58 vars in 1284 bytes} [Wed Aug 31 16:23:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1044602333 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:23:10.597282 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1f3902cd-a64b-4b8d-8c52-beaf2302c0f7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:10.597893 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1f3902cd-a64b-4b8d-8c52-beaf2302c0f7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:10.622020 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f3902cd-a64b-4b8d-8c52-beaf2302c0f7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:10.623081 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f3902cd-a64b-4b8d-8c52-beaf2302c0f7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:10.623921 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f3902cd-a64b-4b8d-8c52-beaf2302c0f7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:10.624910 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f3902cd-a64b-4b8d-8c52-beaf2302c0f7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:10.625685 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f3902cd-a64b-4b8d-8c52-beaf2302c0f7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:10.627945 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1f3902cd-a64b-4b8d-8c52-beaf2302c0f7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:10.869870 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1f3902cd-a64b-4b8d-8c52-beaf2302c0f7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:10.883395 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1f3902cd-a64b-4b8d-8c52-beaf2302c0f7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:10.886041 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1f3902cd-a64b-4b8d-8c52-beaf2302c0f7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:10.887735 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1f3902cd-a64b-4b8d-8c52-beaf2302c0f7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1737 microversion: 2.20 time: 0.295943 Aug 31 16:23:10.888864 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2835/5861] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:10 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1737 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:23:11.918202 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-01215fa9-ba59-4d4e-a780-90aa1ed017aa tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:11.919469 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-01215fa9-ba59-4d4e-a780-90aa1ed017aa tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:11.943909 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01215fa9-ba59-4d4e-a780-90aa1ed017aa tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:11.946384 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01215fa9-ba59-4d4e-a780-90aa1ed017aa tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:11.948643 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01215fa9-ba59-4d4e-a780-90aa1ed017aa tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:11.949298 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01215fa9-ba59-4d4e-a780-90aa1ed017aa tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:11.956772 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01215fa9-ba59-4d4e-a780-90aa1ed017aa tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:11.956772 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01215fa9-ba59-4d4e-a780-90aa1ed017aa tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:12.249909 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-01215fa9-ba59-4d4e-a780-90aa1ed017aa tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:12.285595 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-01215fa9-ba59-4d4e-a780-90aa1ed017aa tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:12.288030 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-01215fa9-ba59-4d4e-a780-90aa1ed017aa tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:12.290837 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-01215fa9-ba59-4d4e-a780-90aa1ed017aa tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1737 microversion: 2.20 time: 0.378428 Aug 31 16:23:12.303802 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3027/5862] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:11 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1737 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:23:13.317973 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-29941262-d764-414d-b1af-a0f31674f1c6 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:13.318635 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-29941262-d764-414d-b1af-a0f31674f1c6 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:13.321800 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=32 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:23:13.345887 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29941262-d764-414d-b1af-a0f31674f1c6 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:13.361248 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29941262-d764-414d-b1af-a0f31674f1c6 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:13.362616 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29941262-d764-414d-b1af-a0f31674f1c6 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:13.365747 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29941262-d764-414d-b1af-a0f31674f1c6 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:13.366402 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29941262-d764-414d-b1af-a0f31674f1c6 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:13.366936 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29941262-d764-414d-b1af-a0f31674f1c6 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:13.731387 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-29941262-d764-414d-b1af-a0f31674f1c6 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:13.744170 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-29941262-d764-414d-b1af-a0f31674f1c6 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:13.746920 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-29941262-d764-414d-b1af-a0f31674f1c6 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:13.748141 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-29941262-d764-414d-b1af-a0f31674f1c6 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1737 microversion: 2.20 time: 0.435642 Aug 31 16:23:13.748713 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2836/5863] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:13 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1737 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:23:14.784303 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-cc192d61-1df3-450d-927b-d38f2f6792e3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:14.787467 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-cc192d61-1df3-450d-927b-d38f2f6792e3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:14.803307 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:23:14.818502 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cc192d61-1df3-450d-927b-d38f2f6792e3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:14.826380 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cc192d61-1df3-450d-927b-d38f2f6792e3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:14.827361 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cc192d61-1df3-450d-927b-d38f2f6792e3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:14.828493 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cc192d61-1df3-450d-927b-d38f2f6792e3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:14.832954 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cc192d61-1df3-450d-927b-d38f2f6792e3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:14.834020 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cc192d61-1df3-450d-927b-d38f2f6792e3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:15.232606 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-cc192d61-1df3-450d-927b-d38f2f6792e3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:15.246990 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-cc192d61-1df3-450d-927b-d38f2f6792e3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:15.257061 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-cc192d61-1df3-450d-927b-d38f2f6792e3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:15.257170 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-cc192d61-1df3-450d-927b-d38f2f6792e3 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1737 microversion: 2.20 time: 0.481511 Aug 31 16:23:15.270888 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3028/5864] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:14 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1737 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:23:16.297867 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-387e72ca-5813-4d03-85ae-22a76abdf11e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:16.298516 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-387e72ca-5813-4d03-85ae-22a76abdf11e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:16.316067 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-387e72ca-5813-4d03-85ae-22a76abdf11e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:16.317007 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-387e72ca-5813-4d03-85ae-22a76abdf11e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:16.317608 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-387e72ca-5813-4d03-85ae-22a76abdf11e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:16.318873 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-387e72ca-5813-4d03-85ae-22a76abdf11e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:16.321547 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-387e72ca-5813-4d03-85ae-22a76abdf11e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:16.324539 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-387e72ca-5813-4d03-85ae-22a76abdf11e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:16.925667 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-387e72ca-5813-4d03-85ae-22a76abdf11e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:16.957915 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-387e72ca-5813-4d03-85ae-22a76abdf11e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:16.964966 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-387e72ca-5813-4d03-85ae-22a76abdf11e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:16.966246 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-387e72ca-5813-4d03-85ae-22a76abdf11e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1737 microversion: 2.20 time: 0.674388 Aug 31 16:23:16.974957 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2837/5865] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:16 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1737 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:23:18.004802 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e646e8a5-270e-471e-a5a0-3c7fc3ccd2df tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:18.005784 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e646e8a5-270e-471e-a5a0-3c7fc3ccd2df tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:18.062509 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e646e8a5-270e-471e-a5a0-3c7fc3ccd2df tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:18.067636 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e646e8a5-270e-471e-a5a0-3c7fc3ccd2df tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:18.069426 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e646e8a5-270e-471e-a5a0-3c7fc3ccd2df tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:18.073432 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e646e8a5-270e-471e-a5a0-3c7fc3ccd2df tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:18.084654 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e646e8a5-270e-471e-a5a0-3c7fc3ccd2df tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:18.090984 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e646e8a5-270e-471e-a5a0-3c7fc3ccd2df tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:18.192972 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:23:18.635817 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bcb173b0-9a1d-4a12-a352-602d08f307e6 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:18.637214 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bcb173b0-9a1d-4a12-a352-602d08f307e6 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:18.646775 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bcb173b0-9a1d-4a12-a352-602d08f307e6 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:18.648609 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bcb173b0-9a1d-4a12-a352-602d08f307e6 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:18.649824 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bcb173b0-9a1d-4a12-a352-602d08f307e6 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:18.651009 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bcb173b0-9a1d-4a12-a352-602d08f307e6 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:18.651711 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bcb173b0-9a1d-4a12-a352-602d08f307e6 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:18.652415 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bcb173b0-9a1d-4a12-a352-602d08f307e6 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:19.324213 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bcb173b0-9a1d-4a12-a352-602d08f307e6 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b/ips" status: 200 len: 147 microversion: 2.1 time: 0.707772 Aug 31 16:23:19.335681 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2838/5866] 10.222.0.50 () {58 vars in 1248 bytes} [Wed Aug 31 16:23:18 2022] GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b/ips => generated 147 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:23:19.419399 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e646e8a5-270e-471e-a5a0-3c7fc3ccd2df tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:19.463576 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e646e8a5-270e-471e-a5a0-3c7fc3ccd2df tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:19.466173 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e646e8a5-270e-471e-a5a0-3c7fc3ccd2df tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:19.467746 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e646e8a5-270e-471e-a5a0-3c7fc3ccd2df tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1737 microversion: 2.20 time: 1.469715 Aug 31 16:23:19.468639 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3029/5867] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:17 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1737 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:23:20.493532 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2ca82443-b10d-476a-87e6-fb2ca986c1af tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:20.499533 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2ca82443-b10d-476a-87e6-fb2ca986c1af tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:20.511420 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ca82443-b10d-476a-87e6-fb2ca986c1af tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:20.514856 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ca82443-b10d-476a-87e6-fb2ca986c1af tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:20.515704 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ca82443-b10d-476a-87e6-fb2ca986c1af tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:20.516618 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ca82443-b10d-476a-87e6-fb2ca986c1af tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:20.517245 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ca82443-b10d-476a-87e6-fb2ca986c1af tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:20.522305 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ca82443-b10d-476a-87e6-fb2ca986c1af tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:21.141015 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2ca82443-b10d-476a-87e6-fb2ca986c1af tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:21.160282 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2ca82443-b10d-476a-87e6-fb2ca986c1af tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:21.161728 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2ca82443-b10d-476a-87e6-fb2ca986c1af tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:21.165920 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2ca82443-b10d-476a-87e6-fb2ca986c1af tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1737 microversion: 2.20 time: 0.676538 Aug 31 16:23:21.170821 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2839/5868] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:20 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1737 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:23:22.200648 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-11a286e4-a0d8-4d89-8a8f-9b2eb2774709 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:22.201858 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-11a286e4-a0d8-4d89-8a8f-9b2eb2774709 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:22.216447 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11a286e4-a0d8-4d89-8a8f-9b2eb2774709 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:22.217198 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11a286e4-a0d8-4d89-8a8f-9b2eb2774709 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:22.217822 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11a286e4-a0d8-4d89-8a8f-9b2eb2774709 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:22.219005 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11a286e4-a0d8-4d89-8a8f-9b2eb2774709 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:22.219612 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11a286e4-a0d8-4d89-8a8f-9b2eb2774709 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:22.220916 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11a286e4-a0d8-4d89-8a8f-9b2eb2774709 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:22.709289 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-11a286e4-a0d8-4d89-8a8f-9b2eb2774709 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:22.725863 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-11a286e4-a0d8-4d89-8a8f-9b2eb2774709 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:22.739740 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-11a286e4-a0d8-4d89-8a8f-9b2eb2774709 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:22.742170 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-11a286e4-a0d8-4d89-8a8f-9b2eb2774709 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1737 microversion: 2.20 time: 0.546578 Aug 31 16:23:22.743286 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3030/5869] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:22 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1737 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:23:23.121316 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1e38ac1a-7999-4d46-b8af-b2709c6cfd3f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e508458d-4d71-4f6a-830b-19c7cde75e06"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:23:23.131041 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1e38ac1a-7999-4d46-b8af-b2709c6cfd3f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:23.149424 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e38ac1a-7999-4d46-b8af-b2709c6cfd3f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:23.149924 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e38ac1a-7999-4d46-b8af-b2709c6cfd3f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:23.152354 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e38ac1a-7999-4d46-b8af-b2709c6cfd3f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:23.153117 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e38ac1a-7999-4d46-b8af-b2709c6cfd3f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:23.153580 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e38ac1a-7999-4d46-b8af-b2709c6cfd3f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:23.157930 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e38ac1a-7999-4d46-b8af-b2709c6cfd3f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:23.166564 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=90 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:23:23.627265 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1e38ac1a-7999-4d46-b8af-b2709c6cfd3f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "POST /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.510673 Aug 31 16:23:23.638739 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2840/5870] 10.222.0.50 () {60 vars in 1323 bytes} [Wed Aug 31 16:23:23 2022] POST /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b/os-volume_attachments => generated 194 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:23:23.774866 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1c9c0109-c34c-4994-8d84-7327095168d5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:23.775561 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1c9c0109-c34c-4994-8d84-7327095168d5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:23.794976 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1c9c0109-c34c-4994-8d84-7327095168d5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:23.795474 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1c9c0109-c34c-4994-8d84-7327095168d5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:23.795910 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1c9c0109-c34c-4994-8d84-7327095168d5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:23.796623 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1c9c0109-c34c-4994-8d84-7327095168d5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:23.797074 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1c9c0109-c34c-4994-8d84-7327095168d5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:23.797499 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1c9c0109-c34c-4994-8d84-7327095168d5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:24.274549 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1c9c0109-c34c-4994-8d84-7327095168d5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:24.289796 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1c9c0109-c34c-4994-8d84-7327095168d5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:24.291290 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1c9c0109-c34c-4994-8d84-7327095168d5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:24.294773 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1c9c0109-c34c-4994-8d84-7327095168d5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1719 microversion: 2.20 time: 0.524141 Aug 31 16:23:24.295533 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3031/5871] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:23 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1719 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:23:25.342449 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cbc24df5-b3c9-439d-a36a-0da32f3f0854 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:25.344113 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cbc24df5-b3c9-439d-a36a-0da32f3f0854 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:25.377523 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbc24df5-b3c9-439d-a36a-0da32f3f0854 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:25.378294 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbc24df5-b3c9-439d-a36a-0da32f3f0854 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:25.379750 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbc24df5-b3c9-439d-a36a-0da32f3f0854 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:25.381409 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbc24df5-b3c9-439d-a36a-0da32f3f0854 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:25.382056 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbc24df5-b3c9-439d-a36a-0da32f3f0854 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:25.383619 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbc24df5-b3c9-439d-a36a-0da32f3f0854 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:26.209977 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cbc24df5-b3c9-439d-a36a-0da32f3f0854 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:26.233664 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cbc24df5-b3c9-439d-a36a-0da32f3f0854 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:26.235194 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cbc24df5-b3c9-439d-a36a-0da32f3f0854 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:26.249228 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cbc24df5-b3c9-439d-a36a-0da32f3f0854 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1719 microversion: 2.20 time: 0.929511 Aug 31 16:23:26.259208 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2841/5872] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:25 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1719 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:23:27.277558 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-bce058a0-66e7-41a5-befa-6ad374f0a308 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:27.278436 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-bce058a0-66e7-41a5-befa-6ad374f0a308 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:27.287554 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bce058a0-66e7-41a5-befa-6ad374f0a308 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:27.288300 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bce058a0-66e7-41a5-befa-6ad374f0a308 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:27.289312 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bce058a0-66e7-41a5-befa-6ad374f0a308 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:27.290259 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bce058a0-66e7-41a5-befa-6ad374f0a308 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:27.290912 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bce058a0-66e7-41a5-befa-6ad374f0a308 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:27.291698 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bce058a0-66e7-41a5-befa-6ad374f0a308 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:28.022985 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-bce058a0-66e7-41a5-befa-6ad374f0a308 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:28.061737 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-bce058a0-66e7-41a5-befa-6ad374f0a308 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:28.063536 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-bce058a0-66e7-41a5-befa-6ad374f0a308 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:28.080095 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-bce058a0-66e7-41a5-befa-6ad374f0a308 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1719 microversion: 2.20 time: 0.807882 Aug 31 16:23:28.080716 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3032/5873] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:27 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1719 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:23:28.644881 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-2c72787c-5da2-4dde-95ec-2aaadcc108a2 req-1be34e60-cf3b-4b86-a3ea-6762b1d1e731 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42064ec8-1aec-498c-8ed7-7c1683963dae", "name": "network-vif-unplugged", "status": "completed", "tag": "8298d82a-a2b4-4bc9-b94c-40f87ac42aa3"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:23:28.687830 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2c72787c-5da2-4dde-95ec-2aaadcc108a2 req-1be34e60-cf3b-4b86-a3ea-6762b1d1e731 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:28.688388 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2c72787c-5da2-4dde-95ec-2aaadcc108a2 req-1be34e60-cf3b-4b86-a3ea-6762b1d1e731 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:28.694680 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2c72787c-5da2-4dde-95ec-2aaadcc108a2 req-1be34e60-cf3b-4b86-a3ea-6762b1d1e731 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:28.754518 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-2c72787c-5da2-4dde-95ec-2aaadcc108a2 req-1be34e60-cf3b-4b86-a3ea-6762b1d1e731 service nova] Creating event network-vif-unplugged:8298d82a-a2b4-4bc9-b94c-40f87ac42aa3 for instance 42064ec8-1aec-498c-8ed7-7c1683963dae on n-h1-833090-16 Aug 31 16:23:28.763748 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-2c72787c-5da2-4dde-95ec-2aaadcc108a2 req-1be34e60-cf3b-4b86-a3ea-6762b1d1e731 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.122793 Aug 31 16:23:28.764806 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2842/5874] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:23:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:23:29.108186 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c39eff61-8107-4261-93e0-a535754fdda0 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:29.110002 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c39eff61-8107-4261-93e0-a535754fdda0 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:29.124070 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c39eff61-8107-4261-93e0-a535754fdda0 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:29.126598 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c39eff61-8107-4261-93e0-a535754fdda0 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:29.127326 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c39eff61-8107-4261-93e0-a535754fdda0 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:29.131292 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c39eff61-8107-4261-93e0-a535754fdda0 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:29.132451 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c39eff61-8107-4261-93e0-a535754fdda0 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:29.134990 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c39eff61-8107-4261-93e0-a535754fdda0 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:29.369368 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c39eff61-8107-4261-93e0-a535754fdda0 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:29.380082 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c39eff61-8107-4261-93e0-a535754fdda0 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:29.382296 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c39eff61-8107-4261-93e0-a535754fdda0 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:29.384000 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c39eff61-8107-4261-93e0-a535754fdda0 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1719 microversion: 2.20 time: 0.280933 Aug 31 16:23:29.385249 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3033/5875] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:29 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1719 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:23:30.422865 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1e4ff52e-fce0-48e4-896f-afff635d25ca tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:30.426869 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1e4ff52e-fce0-48e4-896f-afff635d25ca tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:30.447673 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e4ff52e-fce0-48e4-896f-afff635d25ca tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:30.450596 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e4ff52e-fce0-48e4-896f-afff635d25ca tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:30.451559 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e4ff52e-fce0-48e4-896f-afff635d25ca tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:30.457290 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e4ff52e-fce0-48e4-896f-afff635d25ca tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:30.458550 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e4ff52e-fce0-48e4-896f-afff635d25ca tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:30.460318 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e4ff52e-fce0-48e4-896f-afff635d25ca tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:30.766781 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1e4ff52e-fce0-48e4-896f-afff635d25ca tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:30.790789 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1e4ff52e-fce0-48e4-896f-afff635d25ca tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:30.797366 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1e4ff52e-fce0-48e4-896f-afff635d25ca tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:30.814078 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1e4ff52e-fce0-48e4-896f-afff635d25ca tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1662 microversion: 2.20 time: 0.406540 Aug 31 16:23:30.815206 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2843/5876] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:30 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1662 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:23:30.848908 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-69b1adc2-cbad-4cb6-b91d-036cb476492b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dff076cd-104b-4f50-8b02-ac49f84b15e1"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:23:30.852421 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-69b1adc2-cbad-4cb6-b91d-036cb476492b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:30.868663 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69b1adc2-cbad-4cb6-b91d-036cb476492b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:30.870626 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69b1adc2-cbad-4cb6-b91d-036cb476492b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:30.872278 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69b1adc2-cbad-4cb6-b91d-036cb476492b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:30.875405 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69b1adc2-cbad-4cb6-b91d-036cb476492b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:30.877862 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69b1adc2-cbad-4cb6-b91d-036cb476492b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:30.878552 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69b1adc2-cbad-4cb6-b91d-036cb476492b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:31.702669 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-69b1adc2-cbad-4cb6-b91d-036cb476492b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "POST /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.860697 Aug 31 16:23:31.711444 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3034/5877] 10.222.0.50 () {62 vars in 1364 bytes} [Wed Aug 31 16:23:30 2022] POST /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae/os-volume_attachments => generated 188 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:23:31.901845 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5a4efe1f-ba09-4880-b43e-e7dba68f1abe tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:31.903175 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5a4efe1f-ba09-4880-b43e-e7dba68f1abe tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:31.912120 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a4efe1f-ba09-4880-b43e-e7dba68f1abe tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:31.913004 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a4efe1f-ba09-4880-b43e-e7dba68f1abe tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:31.913835 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a4efe1f-ba09-4880-b43e-e7dba68f1abe tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:31.915607 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a4efe1f-ba09-4880-b43e-e7dba68f1abe tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:31.916255 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a4efe1f-ba09-4880-b43e-e7dba68f1abe tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:31.916849 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a4efe1f-ba09-4880-b43e-e7dba68f1abe tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:32.659576 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5a4efe1f-ba09-4880-b43e-e7dba68f1abe tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "DELETE /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae/os-volume_attachments/dff076cd-104b-4f50-8b02-ac49f84b15e1" status: 202 len: 0 microversion: 2.20 time: 0.762541 Aug 31 16:23:32.660687 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2844/5878] 10.222.0.50 () {60 vars in 1457 bytes} [Wed Aug 31 16:23:31 2022] DELETE /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae/os-volume_attachments/dff076cd-104b-4f50-8b02-ac49f84b15e1 => generated 0 bytes in 765 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:23:32.807190 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7424de4e-cc1f-49a8-bab6-c1ed197e65f4 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:23:32.808698 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7424de4e-cc1f-49a8-bab6-c1ed197e65f4 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:32.842771 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7424de4e-cc1f-49a8-bab6-c1ed197e65f4 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:32.843757 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7424de4e-cc1f-49a8-bab6-c1ed197e65f4 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:32.851664 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7424de4e-cc1f-49a8-bab6-c1ed197e65f4 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:32.853779 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7424de4e-cc1f-49a8-bab6-c1ed197e65f4 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:32.854606 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7424de4e-cc1f-49a8-bab6-c1ed197e65f4 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:32.855337 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7424de4e-cc1f-49a8-bab6-c1ed197e65f4 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:32.903639 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7424de4e-cc1f-49a8-bab6-c1ed197e65f4 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128864) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 16:23:33.027486 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7424de4e-cc1f-49a8-bab6-c1ed197e65f4 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "POST /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae/action" status: 202 len: 0 microversion: 2.20 time: 0.224214 Aug 31 16:23:33.032355 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3035/5879] 10.222.0.50 () {62 vars in 1319 bytes} [Wed Aug 31 16:23:32 2022] POST /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:23:33.040377 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0b585bb9-52e1-4c44-a09a-00c37ff084ce tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:33.041010 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0b585bb9-52e1-4c44-a09a-00c37ff084ce tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:33.059146 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0b585bb9-52e1-4c44-a09a-00c37ff084ce tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:33.059733 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0b585bb9-52e1-4c44-a09a-00c37ff084ce tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:33.067898 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0b585bb9-52e1-4c44-a09a-00c37ff084ce tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:33.071470 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0b585bb9-52e1-4c44-a09a-00c37ff084ce tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:33.073597 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0b585bb9-52e1-4c44-a09a-00c37ff084ce tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:33.075802 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0b585bb9-52e1-4c44-a09a-00c37ff084ce tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:33.637000 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0b585bb9-52e1-4c44-a09a-00c37ff084ce tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:33.670464 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0b585bb9-52e1-4c44-a09a-00c37ff084ce tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:33.680790 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0b585bb9-52e1-4c44-a09a-00c37ff084ce tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:33.695652 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0b585bb9-52e1-4c44-a09a-00c37ff084ce tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1670 microversion: 2.20 time: 0.654835 Aug 31 16:23:33.706141 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2845/5880] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:33 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1670 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:23:34.728375 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-db69eb8c-1b9b-4edb-8962-2c4ca0596ea5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:34.728996 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-db69eb8c-1b9b-4edb-8962-2c4ca0596ea5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:34.744231 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db69eb8c-1b9b-4edb-8962-2c4ca0596ea5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:34.744701 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db69eb8c-1b9b-4edb-8962-2c4ca0596ea5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:34.745134 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db69eb8c-1b9b-4edb-8962-2c4ca0596ea5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:34.745874 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db69eb8c-1b9b-4edb-8962-2c4ca0596ea5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:34.746364 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db69eb8c-1b9b-4edb-8962-2c4ca0596ea5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:34.746788 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db69eb8c-1b9b-4edb-8962-2c4ca0596ea5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:34.948231 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-db69eb8c-1b9b-4edb-8962-2c4ca0596ea5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:34.968024 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-db69eb8c-1b9b-4edb-8962-2c4ca0596ea5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:34.971047 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-db69eb8c-1b9b-4edb-8962-2c4ca0596ea5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:34.973030 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-db69eb8c-1b9b-4edb-8962-2c4ca0596ea5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1670 microversion: 2.20 time: 0.252063 Aug 31 16:23:34.974371 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3036/5881] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:34 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1670 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:23:36.000909 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fa27f5e9-119f-4523-b96c-66d1e47ee0d1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:36.002373 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fa27f5e9-119f-4523-b96c-66d1e47ee0d1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:36.023752 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa27f5e9-119f-4523-b96c-66d1e47ee0d1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:36.037800 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa27f5e9-119f-4523-b96c-66d1e47ee0d1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:36.038640 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa27f5e9-119f-4523-b96c-66d1e47ee0d1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:36.042936 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa27f5e9-119f-4523-b96c-66d1e47ee0d1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:36.043806 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa27f5e9-119f-4523-b96c-66d1e47ee0d1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:36.044639 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa27f5e9-119f-4523-b96c-66d1e47ee0d1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:37.186598 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fa27f5e9-119f-4523-b96c-66d1e47ee0d1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:37.205811 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fa27f5e9-119f-4523-b96c-66d1e47ee0d1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:37.207593 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fa27f5e9-119f-4523-b96c-66d1e47ee0d1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:37.216316 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fa27f5e9-119f-4523-b96c-66d1e47ee0d1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1728 microversion: 2.20 time: 1.222106 Aug 31 16:23:37.216925 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2846/5882] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:35 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1728 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:23:38.250028 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3624cd9d-8632-49d8-89b2-07f1f90d50ca tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:38.250648 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3624cd9d-8632-49d8-89b2-07f1f90d50ca tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:38.263637 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3624cd9d-8632-49d8-89b2-07f1f90d50ca tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:38.264545 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3624cd9d-8632-49d8-89b2-07f1f90d50ca tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:38.265138 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3624cd9d-8632-49d8-89b2-07f1f90d50ca tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:38.266008 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3624cd9d-8632-49d8-89b2-07f1f90d50ca tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:38.270951 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3624cd9d-8632-49d8-89b2-07f1f90d50ca tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:38.271399 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3624cd9d-8632-49d8-89b2-07f1f90d50ca tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:38.681154 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3624cd9d-8632-49d8-89b2-07f1f90d50ca tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:38.724684 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3624cd9d-8632-49d8-89b2-07f1f90d50ca tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:38.749968 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3624cd9d-8632-49d8-89b2-07f1f90d50ca tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:38.754816 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3624cd9d-8632-49d8-89b2-07f1f90d50ca tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1728 microversion: 2.20 time: 0.507671 Aug 31 16:23:38.760704 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3037/5883] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:38 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1728 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:23:39.787348 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f6b026c8-1098-4a17-bd5b-c368fea409b5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:39.788079 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f6b026c8-1098-4a17-bd5b-c368fea409b5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:39.808294 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6b026c8-1098-4a17-bd5b-c368fea409b5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:39.808800 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6b026c8-1098-4a17-bd5b-c368fea409b5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:39.809246 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6b026c8-1098-4a17-bd5b-c368fea409b5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:39.823110 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6b026c8-1098-4a17-bd5b-c368fea409b5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:39.827817 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6b026c8-1098-4a17-bd5b-c368fea409b5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:39.828307 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6b026c8-1098-4a17-bd5b-c368fea409b5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:40.949649 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f6b026c8-1098-4a17-bd5b-c368fea409b5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:40.976693 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f6b026c8-1098-4a17-bd5b-c368fea409b5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:40.992454 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f6b026c8-1098-4a17-bd5b-c368fea409b5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:41.009786 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f6b026c8-1098-4a17-bd5b-c368fea409b5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1728 microversion: 2.20 time: 1.213498 Aug 31 16:23:41.023942 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2847/5884] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:39 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1728 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:23:42.043776 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0c34ffb5-b0f1-412f-9e92-fc37f258b12f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:42.044398 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0c34ffb5-b0f1-412f-9e92-fc37f258b12f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:42.066419 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0c34ffb5-b0f1-412f-9e92-fc37f258b12f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:42.066861 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0c34ffb5-b0f1-412f-9e92-fc37f258b12f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:42.067298 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0c34ffb5-b0f1-412f-9e92-fc37f258b12f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:42.068020 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0c34ffb5-b0f1-412f-9e92-fc37f258b12f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:42.068467 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0c34ffb5-b0f1-412f-9e92-fc37f258b12f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:42.068890 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0c34ffb5-b0f1-412f-9e92-fc37f258b12f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:42.671319 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0c34ffb5-b0f1-412f-9e92-fc37f258b12f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:42.713393 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0c34ffb5-b0f1-412f-9e92-fc37f258b12f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:42.723777 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0c34ffb5-b0f1-412f-9e92-fc37f258b12f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:42.735720 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0c34ffb5-b0f1-412f-9e92-fc37f258b12f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1728 microversion: 2.20 time: 0.692774 Aug 31 16:23:42.741509 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3038/5885] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:42 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1728 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:23:43.763892 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1d2b3dab-8d8f-4986-9fbd-76edb3883a4d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:43.765333 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1d2b3dab-8d8f-4986-9fbd-76edb3883a4d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:43.777257 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=24 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:23:43.779550 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d2b3dab-8d8f-4986-9fbd-76edb3883a4d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:43.785322 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d2b3dab-8d8f-4986-9fbd-76edb3883a4d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:43.786373 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d2b3dab-8d8f-4986-9fbd-76edb3883a4d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:43.787366 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d2b3dab-8d8f-4986-9fbd-76edb3883a4d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:43.788409 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d2b3dab-8d8f-4986-9fbd-76edb3883a4d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:43.791005 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d2b3dab-8d8f-4986-9fbd-76edb3883a4d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:44.233680 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1d2b3dab-8d8f-4986-9fbd-76edb3883a4d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:44.268002 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1d2b3dab-8d8f-4986-9fbd-76edb3883a4d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:44.286425 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1d2b3dab-8d8f-4986-9fbd-76edb3883a4d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:44.299030 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1d2b3dab-8d8f-4986-9fbd-76edb3883a4d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1728 microversion: 2.20 time: 0.535736 Aug 31 16:23:44.301184 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2848/5886] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:43 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1728 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:23:45.325196 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3cae7044-e634-4191-831f-aec64976dfe1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:45.325809 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3cae7044-e634-4191-831f-aec64976dfe1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:45.384906 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:23:45.397416 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3cae7044-e634-4191-831f-aec64976dfe1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:45.401007 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3cae7044-e634-4191-831f-aec64976dfe1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:45.406918 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3cae7044-e634-4191-831f-aec64976dfe1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:45.410219 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3cae7044-e634-4191-831f-aec64976dfe1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:45.413672 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3cae7044-e634-4191-831f-aec64976dfe1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:45.415092 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3cae7044-e634-4191-831f-aec64976dfe1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:46.033361 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3cae7044-e634-4191-831f-aec64976dfe1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:46.091590 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3cae7044-e634-4191-831f-aec64976dfe1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:46.096345 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3cae7044-e634-4191-831f-aec64976dfe1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:46.097732 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3cae7044-e634-4191-831f-aec64976dfe1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1728 microversion: 2.20 time: 0.776896 Aug 31 16:23:46.110484 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3039/5887] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:45 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1728 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:23:47.137896 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1a3fadf1-094a-4e2f-8852-647e4973f792 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:47.138601 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1a3fadf1-094a-4e2f-8852-647e4973f792 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:47.147351 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a3fadf1-094a-4e2f-8852-647e4973f792 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:47.148210 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a3fadf1-094a-4e2f-8852-647e4973f792 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:47.154880 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a3fadf1-094a-4e2f-8852-647e4973f792 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:47.155894 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a3fadf1-094a-4e2f-8852-647e4973f792 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:47.156515 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a3fadf1-094a-4e2f-8852-647e4973f792 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:47.157277 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a3fadf1-094a-4e2f-8852-647e4973f792 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:47.567593 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1a3fadf1-094a-4e2f-8852-647e4973f792 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:47.584872 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1a3fadf1-094a-4e2f-8852-647e4973f792 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:47.589440 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1a3fadf1-094a-4e2f-8852-647e4973f792 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:47.592077 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1a3fadf1-094a-4e2f-8852-647e4973f792 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1728 microversion: 2.20 time: 0.458251 Aug 31 16:23:47.599117 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2849/5888] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:47 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1728 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:23:48.043501 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d470fbe7-a4e3-4b07-928e-a148cbebd50a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-490777481", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "f127c417-aeff-4197-bab5-9b708326dd93", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "875599c9-5517-4369-96b1-87dce382c42c"}]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:23:48.256998 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-d470fbe7-a4e3-4b07-928e-a148cbebd50a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] validate_networks() for [('875599c9-5517-4369-96b1-87dce382c42c', None, None, None, None, None)] {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:23:48.300015 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f2942ea9-6dfb-4bbf-9992-430272ca0cdf tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:23:48.331354 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f2942ea9-6dfb-4bbf-9992-430272ca0cdf tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:48.331910 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f2942ea9-6dfb-4bbf-9992-430272ca0cdf tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:48.332421 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f2942ea9-6dfb-4bbf-9992-430272ca0cdf tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:48.410684 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f2942ea9-6dfb-4bbf-9992-430272ca0cdf tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] Going to try to stop instance {{(pid=128863) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 16:23:48.493051 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f2942ea9-6dfb-4bbf-9992-430272ca0cdf tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "POST /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b/action" status: 202 len: 0 microversion: 2.1 time: 0.199362 Aug 31 16:23:48.494429 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2850/5889] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:23:48 2022] POST /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 16:23:48.513437 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-173aabe9-87c8-4b77-b6fb-000ba9fdeb1f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:48.515759 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-173aabe9-87c8-4b77-b6fb-000ba9fdeb1f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:48.572506 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-173aabe9-87c8-4b77-b6fb-000ba9fdeb1f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:48.573985 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-173aabe9-87c8-4b77-b6fb-000ba9fdeb1f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:48.583405 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-173aabe9-87c8-4b77-b6fb-000ba9fdeb1f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:48.585267 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-173aabe9-87c8-4b77-b6fb-000ba9fdeb1f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:48.587500 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-173aabe9-87c8-4b77-b6fb-000ba9fdeb1f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:48.588326 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-173aabe9-87c8-4b77-b6fb-000ba9fdeb1f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:49.151518 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-173aabe9-87c8-4b77-b6fb-000ba9fdeb1f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:49.162323 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-173aabe9-87c8-4b77-b6fb-000ba9fdeb1f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b" status: 200 len: 1724 microversion: 2.1 time: 0.663874 Aug 31 16:23:49.168451 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2851/5890] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:48 2022] GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b => generated 1724 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:23:49.174542 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-48547a98-a455-47e6-af9c-5ce803df1c31 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:49.182954 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-48547a98-a455-47e6-af9c-5ce803df1c31 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:49.193919 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-48547a98-a455-47e6-af9c-5ce803df1c31 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:49.199283 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-48547a98-a455-47e6-af9c-5ce803df1c31 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:49.200776 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-48547a98-a455-47e6-af9c-5ce803df1c31 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:49.203056 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-48547a98-a455-47e6-af9c-5ce803df1c31 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:49.209834 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-48547a98-a455-47e6-af9c-5ce803df1c31 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:49.213674 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-48547a98-a455-47e6-af9c-5ce803df1c31 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:49.271496 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=7,nova_cell1:INSERT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:23:49.799588 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-48547a98-a455-47e6-af9c-5ce803df1c31 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:49.812271 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-48547a98-a455-47e6-af9c-5ce803df1c31 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:49.815841 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-48547a98-a455-47e6-af9c-5ce803df1c31 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:49.817081 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-48547a98-a455-47e6-af9c-5ce803df1c31 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1728 microversion: 2.20 time: 0.647321 Aug 31 16:23:49.817657 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2852/5891] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:49 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1728 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:23:49.894003 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-d470fbe7-a4e3-4b07-928e-a148cbebd50a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:23:49.895214 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-d470fbe7-a4e3-4b07-928e-a148cbebd50a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:23:49.895982 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-d470fbe7-a4e3-4b07-928e-a148cbebd50a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:23:49.896990 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-d470fbe7-a4e3-4b07-928e-a148cbebd50a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:23:49.899379 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-d470fbe7-a4e3-4b07-928e-a148cbebd50a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:23:49.915508 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d470fbe7-a4e3-4b07-928e-a148cbebd50a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:49.916364 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d470fbe7-a4e3-4b07-928e-a148cbebd50a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:49.917048 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d470fbe7-a4e3-4b07-928e-a148cbebd50a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:49.918079 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d470fbe7-a4e3-4b07-928e-a148cbebd50a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:49.919210 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d470fbe7-a4e3-4b07-928e-a148cbebd50a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:49.919949 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d470fbe7-a4e3-4b07-928e-a148cbebd50a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:49.932303 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=79,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:23:49.962862 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-d470fbe7-a4e3-4b07-928e-a148cbebd50a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Getting quotas for project 32245d85aee64f69865d98656133a539. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:23:49.973069 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-d470fbe7-a4e3-4b07-928e-a148cbebd50a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Getting quotas for user fb76a89a8b8042edb7b6aaccb4f41ead and project 32245d85aee64f69865d98656133a539. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:23:50.111412 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d470fbe7-a4e3-4b07-928e-a148cbebd50a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:23:50.111412 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d470fbe7-a4e3-4b07-928e-a148cbebd50a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 88b41d16-3908-4de0-94fe-6c3d46786286] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f127c417-aeff-4197-bab5-9b708326dd93',volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:23:50.190234 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-832e626c-ffac-4222-942a-5e33b1bc09cb tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:50.191162 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-832e626c-ffac-4222-942a-5e33b1bc09cb tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:50.201407 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-832e626c-ffac-4222-942a-5e33b1bc09cb tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:50.202273 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-832e626c-ffac-4222-942a-5e33b1bc09cb tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:50.204907 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-832e626c-ffac-4222-942a-5e33b1bc09cb tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:50.205822 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-832e626c-ffac-4222-942a-5e33b1bc09cb tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:50.206490 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-832e626c-ffac-4222-942a-5e33b1bc09cb tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:50.209068 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-832e626c-ffac-4222-942a-5e33b1bc09cb tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:50.350419 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d470fbe7-a4e3-4b07-928e-a148cbebd50a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.320600 Aug 31 16:23:50.356733 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3040/5892] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:23:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 2323 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:23:50.362985 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a9502705-7813-48e3-8e95-c68413d7c096 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:50.363687 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a9502705-7813-48e3-8e95-c68413d7c096 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 88b41d16-3908-4de0-94fe-6c3d46786286] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:50.489636 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a9502705-7813-48e3-8e95-c68413d7c096 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:50.501849 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a9502705-7813-48e3-8e95-c68413d7c096 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286" status: 200 len: 1056 microversion: 2.1 time: 0.142971 Aug 31 16:23:50.518826 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3041/5893] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:50 2022] GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286 => generated 1056 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:23:50.532421 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-832e626c-ffac-4222-942a-5e33b1bc09cb tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:50.542728 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-832e626c-ffac-4222-942a-5e33b1bc09cb tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b" status: 200 len: 1724 microversion: 2.1 time: 0.355700 Aug 31 16:23:50.556185 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2853/5894] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:50 2022] GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b => generated 1724 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:23:50.848873 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d3baf9c8-c7f1-430c-9162-8981e2f0896a tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:50.849884 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d3baf9c8-c7f1-430c-9162-8981e2f0896a tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:50.857536 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d3baf9c8-c7f1-430c-9162-8981e2f0896a tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:50.858534 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d3baf9c8-c7f1-430c-9162-8981e2f0896a tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:50.859280 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d3baf9c8-c7f1-430c-9162-8981e2f0896a tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:50.860244 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d3baf9c8-c7f1-430c-9162-8981e2f0896a tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:50.861222 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d3baf9c8-c7f1-430c-9162-8981e2f0896a tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:50.861841 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d3baf9c8-c7f1-430c-9162-8981e2f0896a tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:51.255358 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d3baf9c8-c7f1-430c-9162-8981e2f0896a tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:51.269738 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d3baf9c8-c7f1-430c-9162-8981e2f0896a tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:51.276565 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d3baf9c8-c7f1-430c-9162-8981e2f0896a tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:51.279169 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d3baf9c8-c7f1-430c-9162-8981e2f0896a tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1728 microversion: 2.20 time: 0.441578 Aug 31 16:23:51.302291 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3042/5895] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:50 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1728 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:23:51.528106 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ce3c8935-22fb-440f-bf49-908164a142f8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:51.529983 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ce3c8935-22fb-440f-bf49-908164a142f8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 88b41d16-3908-4de0-94fe-6c3d46786286] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:51.538354 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce3c8935-22fb-440f-bf49-908164a142f8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:51.539382 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce3c8935-22fb-440f-bf49-908164a142f8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:51.539903 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce3c8935-22fb-440f-bf49-908164a142f8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:51.540684 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce3c8935-22fb-440f-bf49-908164a142f8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:51.541387 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce3c8935-22fb-440f-bf49-908164a142f8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:51.541903 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce3c8935-22fb-440f-bf49-908164a142f8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:51.566824 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-51ca5edf-a539-4615-94c2-48890e9b8277 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:51.567443 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-51ca5edf-a539-4615-94c2-48890e9b8277 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:51.580068 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51ca5edf-a539-4615-94c2-48890e9b8277 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:51.587710 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51ca5edf-a539-4615-94c2-48890e9b8277 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:51.587915 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51ca5edf-a539-4615-94c2-48890e9b8277 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:51.602833 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51ca5edf-a539-4615-94c2-48890e9b8277 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:51.618222 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51ca5edf-a539-4615-94c2-48890e9b8277 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:51.628870 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51ca5edf-a539-4615-94c2-48890e9b8277 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:51.659163 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ce3c8935-22fb-440f-bf49-908164a142f8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:51.673751 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ce3c8935-22fb-440f-bf49-908164a142f8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286" status: 200 len: 1106 microversion: 2.1 time: 0.150910 Aug 31 16:23:51.682486 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2854/5896] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:51 2022] GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286 => generated 1106 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:23:52.119421 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-51ca5edf-a539-4615-94c2-48890e9b8277 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:52.162122 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-51ca5edf-a539-4615-94c2-48890e9b8277 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b" status: 200 len: 1724 microversion: 2.1 time: 0.591563 Aug 31 16:23:52.182981 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3043/5897] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:51 2022] GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b => generated 1724 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:23:52.305626 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e7e13774-c73c-4690-a27f-ff23858f4463 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:52.306778 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e7e13774-c73c-4690-a27f-ff23858f4463 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:52.318426 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7e13774-c73c-4690-a27f-ff23858f4463 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:52.318947 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7e13774-c73c-4690-a27f-ff23858f4463 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:52.322961 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7e13774-c73c-4690-a27f-ff23858f4463 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:52.324296 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7e13774-c73c-4690-a27f-ff23858f4463 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:52.324977 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7e13774-c73c-4690-a27f-ff23858f4463 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:52.325583 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e7e13774-c73c-4690-a27f-ff23858f4463 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:52.620962 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e7e13774-c73c-4690-a27f-ff23858f4463 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:52.635620 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e7e13774-c73c-4690-a27f-ff23858f4463 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:52.643878 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e7e13774-c73c-4690-a27f-ff23858f4463 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:52.646283 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e7e13774-c73c-4690-a27f-ff23858f4463 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1728 microversion: 2.20 time: 0.343732 Aug 31 16:23:52.661303 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2855/5898] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:52 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1728 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:23:52.722361 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-11cefe3b-fc03-404a-b447-b8c176cf72c1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:52.723060 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-11cefe3b-fc03-404a-b447-b8c176cf72c1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 88b41d16-3908-4de0-94fe-6c3d46786286] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:52.741712 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11cefe3b-fc03-404a-b447-b8c176cf72c1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:52.742242 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11cefe3b-fc03-404a-b447-b8c176cf72c1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:52.742688 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11cefe3b-fc03-404a-b447-b8c176cf72c1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:52.743414 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11cefe3b-fc03-404a-b447-b8c176cf72c1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:52.750742 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11cefe3b-fc03-404a-b447-b8c176cf72c1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:52.751228 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11cefe3b-fc03-404a-b447-b8c176cf72c1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:52.968795 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-11cefe3b-fc03-404a-b447-b8c176cf72c1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:52.980303 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-11cefe3b-fc03-404a-b447-b8c176cf72c1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286" status: 200 len: 1154 microversion: 2.1 time: 0.266318 Aug 31 16:23:52.990963 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3044/5899] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:52 2022] GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286 => generated 1154 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:23:53.175047 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6745c34d-c253-48f3-ae80-2b9c710c8813 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:53.176221 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6745c34d-c253-48f3-ae80-2b9c710c8813 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:53.199046 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6745c34d-c253-48f3-ae80-2b9c710c8813 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:53.200074 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6745c34d-c253-48f3-ae80-2b9c710c8813 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:53.201063 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6745c34d-c253-48f3-ae80-2b9c710c8813 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:53.202391 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6745c34d-c253-48f3-ae80-2b9c710c8813 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:53.203118 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6745c34d-c253-48f3-ae80-2b9c710c8813 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:53.205669 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6745c34d-c253-48f3-ae80-2b9c710c8813 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:53.671540 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-04016298-5bdc-45e8-b111-ee1450043fde tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:53.672698 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-04016298-5bdc-45e8-b111-ee1450043fde tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:53.686152 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-04016298-5bdc-45e8-b111-ee1450043fde tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:53.693721 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-04016298-5bdc-45e8-b111-ee1450043fde tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:53.694573 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-04016298-5bdc-45e8-b111-ee1450043fde tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:53.695529 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-04016298-5bdc-45e8-b111-ee1450043fde tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:53.696241 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-04016298-5bdc-45e8-b111-ee1450043fde tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:53.696898 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-04016298-5bdc-45e8-b111-ee1450043fde tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:54.152496 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6745c34d-c253-48f3-ae80-2b9c710c8813 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:54.170767 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6745c34d-c253-48f3-ae80-2b9c710c8813 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b" status: 200 len: 1724 microversion: 2.1 time: 1.000507 Aug 31 16:23:54.174501 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2856/5900] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:53 2022] GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b => generated 1724 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:23:54.188563 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3bdfe212-cc1e-4714-86a4-4f61940861f4 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:54.189818 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3bdfe212-cc1e-4714-86a4-4f61940861f4 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 88b41d16-3908-4de0-94fe-6c3d46786286] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:54.207757 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bdfe212-cc1e-4714-86a4-4f61940861f4 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:54.208723 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bdfe212-cc1e-4714-86a4-4f61940861f4 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:54.209391 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bdfe212-cc1e-4714-86a4-4f61940861f4 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:54.214257 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bdfe212-cc1e-4714-86a4-4f61940861f4 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:54.215282 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bdfe212-cc1e-4714-86a4-4f61940861f4 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:54.216077 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bdfe212-cc1e-4714-86a4-4f61940861f4 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:54.290321 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-04016298-5bdc-45e8-b111-ee1450043fde tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:54.304077 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-04016298-5bdc-45e8-b111-ee1450043fde tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:54.309106 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-04016298-5bdc-45e8-b111-ee1450043fde tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:54.314360 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-04016298-5bdc-45e8-b111-ee1450043fde tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1728 microversion: 2.20 time: 0.647940 Aug 31 16:23:54.316069 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3045/5901] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:53 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1728 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:23:55.195167 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3bdfe212-cc1e-4714-86a4-4f61940861f4 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:55.198621 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4f481cbb-0265-4bc5-9f7d-8278ebb9f914 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:55.199482 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4f481cbb-0265-4bc5-9f7d-8278ebb9f914 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:55.205809 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3bdfe212-cc1e-4714-86a4-4f61940861f4 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286" status: 200 len: 1172 microversion: 2.1 time: 1.029963 Aug 31 16:23:55.212608 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2857/5902] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:54 2022] GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286 => generated 1172 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:23:55.215474 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4f481cbb-0265-4bc5-9f7d-8278ebb9f914 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:55.216666 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4f481cbb-0265-4bc5-9f7d-8278ebb9f914 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:55.217385 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4f481cbb-0265-4bc5-9f7d-8278ebb9f914 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:55.218912 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4f481cbb-0265-4bc5-9f7d-8278ebb9f914 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:55.219591 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4f481cbb-0265-4bc5-9f7d-8278ebb9f914 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:55.220288 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4f481cbb-0265-4bc5-9f7d-8278ebb9f914 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:55.344598 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6e2dda33-1eea-46c7-adb1-18009d60e7d0 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:55.345768 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6e2dda33-1eea-46c7-adb1-18009d60e7d0 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:55.356658 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6e2dda33-1eea-46c7-adb1-18009d60e7d0 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:55.357361 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6e2dda33-1eea-46c7-adb1-18009d60e7d0 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:55.360841 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6e2dda33-1eea-46c7-adb1-18009d60e7d0 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:55.361885 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6e2dda33-1eea-46c7-adb1-18009d60e7d0 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:55.362552 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6e2dda33-1eea-46c7-adb1-18009d60e7d0 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:55.365627 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6e2dda33-1eea-46c7-adb1-18009d60e7d0 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:55.702565 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4f481cbb-0265-4bc5-9f7d-8278ebb9f914 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:55.716626 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4f481cbb-0265-4bc5-9f7d-8278ebb9f914 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b" status: 200 len: 1724 microversion: 2.1 time: 0.523879 Aug 31 16:23:55.718477 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3046/5903] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:55 2022] GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b => generated 1724 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:23:55.749896 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6e2dda33-1eea-46c7-adb1-18009d60e7d0 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:55.763416 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6e2dda33-1eea-46c7-adb1-18009d60e7d0 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:55.764879 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6e2dda33-1eea-46c7-adb1-18009d60e7d0 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:55.771834 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6e2dda33-1eea-46c7-adb1-18009d60e7d0 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1728 microversion: 2.20 time: 0.430851 Aug 31 16:23:55.774449 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2858/5904] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:55 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1728 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:23:56.234725 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-cd07bbe3-3ffe-4f84-8e5d-ee73afa2ace8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:56.241025 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-cd07bbe3-3ffe-4f84-8e5d-ee73afa2ace8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 88b41d16-3908-4de0-94fe-6c3d46786286] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:56.259326 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cd07bbe3-3ffe-4f84-8e5d-ee73afa2ace8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:56.261472 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cd07bbe3-3ffe-4f84-8e5d-ee73afa2ace8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:56.263069 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cd07bbe3-3ffe-4f84-8e5d-ee73afa2ace8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:56.266205 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cd07bbe3-3ffe-4f84-8e5d-ee73afa2ace8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:56.267230 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cd07bbe3-3ffe-4f84-8e5d-ee73afa2ace8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:56.268965 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cd07bbe3-3ffe-4f84-8e5d-ee73afa2ace8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:56.680652 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-cd07bbe3-3ffe-4f84-8e5d-ee73afa2ace8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:56.691662 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-cd07bbe3-3ffe-4f84-8e5d-ee73afa2ace8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286" status: 200 len: 1214 microversion: 2.1 time: 0.465764 Aug 31 16:23:56.694874 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3047/5905] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:56 2022] GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286 => generated 1214 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:23:56.739063 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-38e577e2-c3fc-4564-bc25-8f5c462994d7 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:56.739664 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-38e577e2-c3fc-4564-bc25-8f5c462994d7 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:56.749483 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38e577e2-c3fc-4564-bc25-8f5c462994d7 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:56.749973 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38e577e2-c3fc-4564-bc25-8f5c462994d7 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:56.757303 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38e577e2-c3fc-4564-bc25-8f5c462994d7 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:56.758039 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38e577e2-c3fc-4564-bc25-8f5c462994d7 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:56.758565 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38e577e2-c3fc-4564-bc25-8f5c462994d7 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:56.759003 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38e577e2-c3fc-4564-bc25-8f5c462994d7 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:56.798868 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ab650dbb-c2b1-445a-b2d2-975c6f5184f1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:56.799490 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ab650dbb-c2b1-445a-b2d2-975c6f5184f1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:56.813177 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ab650dbb-c2b1-445a-b2d2-975c6f5184f1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:56.817218 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ab650dbb-c2b1-445a-b2d2-975c6f5184f1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:56.822638 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ab650dbb-c2b1-445a-b2d2-975c6f5184f1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:56.843546 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ab650dbb-c2b1-445a-b2d2-975c6f5184f1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:56.844297 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ab650dbb-c2b1-445a-b2d2-975c6f5184f1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:56.845015 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ab650dbb-c2b1-445a-b2d2-975c6f5184f1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:57.242939 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-38e577e2-c3fc-4564-bc25-8f5c462994d7 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:57.255007 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-38e577e2-c3fc-4564-bc25-8f5c462994d7 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b" status: 200 len: 1724 microversion: 2.1 time: 0.519738 Aug 31 16:23:57.259292 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2859/5906] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:56 2022] GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b => generated 1724 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:23:57.725581 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4c3ecb07-a09e-4743-a884-d71d83a273d4 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:57.726533 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4c3ecb07-a09e-4743-a884-d71d83a273d4 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 88b41d16-3908-4de0-94fe-6c3d46786286] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:57.733645 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c3ecb07-a09e-4743-a884-d71d83a273d4 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:57.747200 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c3ecb07-a09e-4743-a884-d71d83a273d4 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:57.747902 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c3ecb07-a09e-4743-a884-d71d83a273d4 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:57.748416 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c3ecb07-a09e-4743-a884-d71d83a273d4 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:57.748883 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c3ecb07-a09e-4743-a884-d71d83a273d4 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:57.749303 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4c3ecb07-a09e-4743-a884-d71d83a273d4 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:57.915586 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ab650dbb-c2b1-445a-b2d2-975c6f5184f1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:57.929605 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ab650dbb-c2b1-445a-b2d2-975c6f5184f1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:57.945939 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ab650dbb-c2b1-445a-b2d2-975c6f5184f1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:57.947234 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ab650dbb-c2b1-445a-b2d2-975c6f5184f1 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1728 microversion: 2.20 time: 1.152293 Aug 31 16:23:57.954762 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3048/5907] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:56 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1728 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:23:58.142619 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4c3ecb07-a09e-4743-a884-d71d83a273d4 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:58.184975 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4c3ecb07-a09e-4743-a884-d71d83a273d4 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286" status: 200 len: 1214 microversion: 2.1 time: 0.450851 Aug 31 16:23:58.184975 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2860/5908] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:57 2022] GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286 => generated 1214 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:23:58.237508 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-9ad24840-7ab3-411f-8867-f05f47b73dc4 req-403befdc-e23b-4617-873b-21248a4cbcfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88b41d16-3908-4de0-94fe-6c3d46786286", "tag": "9d5dc457-9a17-4234-903f-e557dffd350f"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:23:58.266178 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-9ad24840-7ab3-411f-8867-f05f47b73dc4 req-403befdc-e23b-4617-873b-21248a4cbcfc service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:58.266713 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-9ad24840-7ab3-411f-8867-f05f47b73dc4 req-403befdc-e23b-4617-873b-21248a4cbcfc service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:58.273836 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-9ad24840-7ab3-411f-8867-f05f47b73dc4 req-403befdc-e23b-4617-873b-21248a4cbcfc service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:58.280857 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c9e2c3d6-f777-43c6-abdf-e638f32b1d28 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:58.281481 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c9e2c3d6-f777-43c6-abdf-e638f32b1d28 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:58.294550 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9e2c3d6-f777-43c6-abdf-e638f32b1d28 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:58.295064 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9e2c3d6-f777-43c6-abdf-e638f32b1d28 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:58.295517 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9e2c3d6-f777-43c6-abdf-e638f32b1d28 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:58.296251 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9e2c3d6-f777-43c6-abdf-e638f32b1d28 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:58.308155 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9e2c3d6-f777-43c6-abdf-e638f32b1d28 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:58.308887 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9e2c3d6-f777-43c6-abdf-e638f32b1d28 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:58.326488 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-9ad24840-7ab3-411f-8867-f05f47b73dc4 req-403befdc-e23b-4617-873b-21248a4cbcfc service nova] Creating event network-changed:9d5dc457-9a17-4234-903f-e557dffd350f for instance 88b41d16-3908-4de0-94fe-6c3d46786286 on n-h1-833090-16 Aug 31 16:23:58.347075 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-9ad24840-7ab3-411f-8867-f05f47b73dc4 req-403befdc-e23b-4617-873b-21248a4cbcfc service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128019 Aug 31 16:23:58.348027 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3049/5909] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:23:58.770350 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c9e2c3d6-f777-43c6-abdf-e638f32b1d28 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:58.780513 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c9e2c3d6-f777-43c6-abdf-e638f32b1d28 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b" status: 200 len: 1724 microversion: 2.1 time: 0.503939 Aug 31 16:23:58.781191 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2861/5910] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:58 2022] GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b => generated 1724 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:23:58.973082 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4ce81565-ea0c-4241-ad6a-38f44efd7c9f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:58.975399 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4ce81565-ea0c-4241-ad6a-38f44efd7c9f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:58.987340 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4ce81565-ea0c-4241-ad6a-38f44efd7c9f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:58.993640 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4ce81565-ea0c-4241-ad6a-38f44efd7c9f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:58.994224 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4ce81565-ea0c-4241-ad6a-38f44efd7c9f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:58.995084 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4ce81565-ea0c-4241-ad6a-38f44efd7c9f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:58.996263 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4ce81565-ea0c-4241-ad6a-38f44efd7c9f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:58.996787 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4ce81565-ea0c-4241-ad6a-38f44efd7c9f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:59.079997 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0209d59a-af86-40a4-a1cd-3d6c0bec7f63 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:59.080722 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0209d59a-af86-40a4-a1cd-3d6c0bec7f63 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 95902b01-9a33-45e2-b454-cdab91014582] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:59.091078 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0209d59a-af86-40a4-a1cd-3d6c0bec7f63 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:59.093929 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0209d59a-af86-40a4-a1cd-3d6c0bec7f63 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:59.094852 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0209d59a-af86-40a4-a1cd-3d6c0bec7f63 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:59.095797 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0209d59a-af86-40a4-a1cd-3d6c0bec7f63 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:59.098687 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0209d59a-af86-40a4-a1cd-3d6c0bec7f63 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:59.099316 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0209d59a-af86-40a4-a1cd-3d6c0bec7f63 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:59.162694 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0209d59a-af86-40a4-a1cd-3d6c0bec7f63 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582/ips" status: 200 len: 150 microversion: 2.1 time: 0.082815 Aug 31 16:23:59.177194 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2862/5911] 10.222.0.50 () {58 vars in 1248 bytes} [Wed Aug 31 16:23:59 2022] GET /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582/ips => generated 150 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:23:59.201489 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-acb20086-6543-43cf-b9b7-8040db866ab7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:59.202119 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-acb20086-6543-43cf-b9b7-8040db866ab7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 88b41d16-3908-4de0-94fe-6c3d46786286] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:59.223790 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-acb20086-6543-43cf-b9b7-8040db866ab7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:59.224072 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-acb20086-6543-43cf-b9b7-8040db866ab7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:59.227135 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-acb20086-6543-43cf-b9b7-8040db866ab7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:59.239157 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-acb20086-6543-43cf-b9b7-8040db866ab7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:59.240321 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-acb20086-6543-43cf-b9b7-8040db866ab7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:59.244222 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-acb20086-6543-43cf-b9b7-8040db866ab7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:59.566424 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4ce81565-ea0c-4241-ad6a-38f44efd7c9f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:59.588495 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4ce81565-ea0c-4241-ad6a-38f44efd7c9f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:59.597372 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4ce81565-ea0c-4241-ad6a-38f44efd7c9f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:59.603820 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4ce81565-ea0c-4241-ad6a-38f44efd7c9f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1728 microversion: 2.20 time: 0.634814 Aug 31 16:23:59.623422 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3050/5912] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:23:58 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1728 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:23:59.802229 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-acb20086-6543-43cf-b9b7-8040db866ab7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:23:59.804094 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a8ec5138-b251-43ec-ae95-209139f0c60f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:23:59.804712 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a8ec5138-b251-43ec-ae95-209139f0c60f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:23:59.822193 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a8ec5138-b251-43ec-ae95-209139f0c60f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:59.840011 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a8ec5138-b251-43ec-ae95-209139f0c60f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:59.841831 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a8ec5138-b251-43ec-ae95-209139f0c60f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:59.842811 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a8ec5138-b251-43ec-ae95-209139f0c60f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:23:59.847514 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a8ec5138-b251-43ec-ae95-209139f0c60f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:23:59.848185 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a8ec5138-b251-43ec-ae95-209139f0c60f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:23:59.878194 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-acb20086-6543-43cf-b9b7-8040db866ab7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286" status: 200 len: 1214 microversion: 2.1 time: 0.675630 Aug 31 16:23:59.879199 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2863/5913] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:59 2022] GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286 => generated 1214 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:23:59.933950 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:24:00.387094 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a8ec5138-b251-43ec-ae95-209139f0c60f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:00.400213 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a8ec5138-b251-43ec-ae95-209139f0c60f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b" status: 200 len: 1724 microversion: 2.1 time: 0.600915 Aug 31 16:24:00.418125 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3051/5914] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:23:59 2022] GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b => generated 1724 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:00.637756 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-99916ae7-a7b8-48e6-b5c2-3b03b7be3ad2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:00.638410 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-99916ae7-a7b8-48e6-b5c2-3b03b7be3ad2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:00.645838 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99916ae7-a7b8-48e6-b5c2-3b03b7be3ad2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:00.646445 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99916ae7-a7b8-48e6-b5c2-3b03b7be3ad2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:00.647031 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99916ae7-a7b8-48e6-b5c2-3b03b7be3ad2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:00.693160 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99916ae7-a7b8-48e6-b5c2-3b03b7be3ad2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:00.693745 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99916ae7-a7b8-48e6-b5c2-3b03b7be3ad2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:00.699980 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99916ae7-a7b8-48e6-b5c2-3b03b7be3ad2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:00.901584 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d0819761-2f1b-4749-ac75-886848c49479 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:00.903202 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d0819761-2f1b-4749-ac75-886848c49479 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 88b41d16-3908-4de0-94fe-6c3d46786286] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:00.921899 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=8 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:24:00.925677 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d0819761-2f1b-4749-ac75-886848c49479 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:00.926492 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d0819761-2f1b-4749-ac75-886848c49479 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:00.927885 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d0819761-2f1b-4749-ac75-886848c49479 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:00.931098 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d0819761-2f1b-4749-ac75-886848c49479 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:00.934251 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d0819761-2f1b-4749-ac75-886848c49479 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:00.934901 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d0819761-2f1b-4749-ac75-886848c49479 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:01.435551 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-99916ae7-a7b8-48e6-b5c2-3b03b7be3ad2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:01.513343 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d0819761-2f1b-4749-ac75-886848c49479 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:01.529951 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-99916ae7-a7b8-48e6-b5c2-3b03b7be3ad2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:01.531913 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-99916ae7-a7b8-48e6-b5c2-3b03b7be3ad2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:01.540391 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-99916ae7-a7b8-48e6-b5c2-3b03b7be3ad2 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1728 microversion: 2.20 time: 0.908513 Aug 31 16:24:01.543754 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2864/5915] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:24:00 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1728 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:24:01.556073 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-17db2757-7323-4269-930e-fc9b6757fc18 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:01.559432 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-17db2757-7323-4269-930e-fc9b6757fc18 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:01.575627 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d0819761-2f1b-4749-ac75-886848c49479 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286" status: 200 len: 1214 microversion: 2.1 time: 0.666903 Aug 31 16:24:01.581338 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3052/5916] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:00 2022] GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286 => generated 1214 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:01.599709 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-17db2757-7323-4269-930e-fc9b6757fc18 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:01.606648 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-17db2757-7323-4269-930e-fc9b6757fc18 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:01.629838 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-17db2757-7323-4269-930e-fc9b6757fc18 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:01.636110 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-17db2757-7323-4269-930e-fc9b6757fc18 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:01.640751 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-17db2757-7323-4269-930e-fc9b6757fc18 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:01.641295 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-17db2757-7323-4269-930e-fc9b6757fc18 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:01.937645 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-17db2757-7323-4269-930e-fc9b6757fc18 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:01.975384 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-17db2757-7323-4269-930e-fc9b6757fc18 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b" status: 200 len: 1724 microversion: 2.1 time: 0.429189 Aug 31 16:24:01.981336 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2865/5917] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:01 2022] GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b => generated 1724 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:02.266900 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a17a4f40-d34e-4cc3-bbb5-e6057a7d51ec tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a569a105-5619-4017-9b3c-3d2c3061b892"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:24:02.269809 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a17a4f40-d34e-4cc3-bbb5-e6057a7d51ec tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 95902b01-9a33-45e2-b454-cdab91014582] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:02.276795 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a17a4f40-d34e-4cc3-bbb5-e6057a7d51ec tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:02.277529 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a17a4f40-d34e-4cc3-bbb5-e6057a7d51ec tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:02.278150 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a17a4f40-d34e-4cc3-bbb5-e6057a7d51ec tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:02.279052 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a17a4f40-d34e-4cc3-bbb5-e6057a7d51ec tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:02.279690 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a17a4f40-d34e-4cc3-bbb5-e6057a7d51ec tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:02.280277 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a17a4f40-d34e-4cc3-bbb5-e6057a7d51ec tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:02.441990 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-3cb32c93-47da-40af-a107-d1a85842ce3f req-168842b1-992b-405e-a5cc-ce4757bc9704 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42064ec8-1aec-498c-8ed7-7c1683963dae", "name": "network-vif-plugged", "status": "completed", "tag": "8298d82a-a2b4-4bc9-b94c-40f87ac42aa3"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:24:02.472691 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3cb32c93-47da-40af-a107-d1a85842ce3f req-168842b1-992b-405e-a5cc-ce4757bc9704 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:02.473376 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3cb32c93-47da-40af-a107-d1a85842ce3f req-168842b1-992b-405e-a5cc-ce4757bc9704 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:02.473980 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3cb32c93-47da-40af-a107-d1a85842ce3f req-168842b1-992b-405e-a5cc-ce4757bc9704 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:02.524090 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-3cb32c93-47da-40af-a107-d1a85842ce3f req-168842b1-992b-405e-a5cc-ce4757bc9704 service nova] Creating event network-vif-plugged:8298d82a-a2b4-4bc9-b94c-40f87ac42aa3 for instance 42064ec8-1aec-498c-8ed7-7c1683963dae on n-h1-833090-16 Aug 31 16:24:02.554175 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-3cb32c93-47da-40af-a107-d1a85842ce3f req-168842b1-992b-405e-a5cc-ce4757bc9704 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126251 Aug 31 16:24:02.554877 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2866/5918] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:24:02.593757 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9bef4ba4-ca32-47d1-99b1-2abc70e2ac1b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:02.595814 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9bef4ba4-ca32-47d1-99b1-2abc70e2ac1b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:02.633716 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9bef4ba4-ca32-47d1-99b1-2abc70e2ac1b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:02.634788 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9bef4ba4-ca32-47d1-99b1-2abc70e2ac1b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:02.638662 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9bef4ba4-ca32-47d1-99b1-2abc70e2ac1b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:02.640255 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9bef4ba4-ca32-47d1-99b1-2abc70e2ac1b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:02.642996 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9bef4ba4-ca32-47d1-99b1-2abc70e2ac1b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:02.644918 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9bef4ba4-ca32-47d1-99b1-2abc70e2ac1b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:02.920331 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a17a4f40-d34e-4cc3-bbb5-e6057a7d51ec tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "POST /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.658265 Aug 31 16:24:02.927402 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3053/5919] 10.222.0.50 () {60 vars in 1323 bytes} [Wed Aug 31 16:24:02 2022] POST /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582/os-volume_attachments => generated 194 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:24:02.933744 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c776cb3b-970a-4c3a-a5bf-6c85bddcd03e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:02.934881 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c776cb3b-970a-4c3a-a5bf-6c85bddcd03e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 88b41d16-3908-4de0-94fe-6c3d46786286] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:02.945619 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c776cb3b-970a-4c3a-a5bf-6c85bddcd03e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:02.948298 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c776cb3b-970a-4c3a-a5bf-6c85bddcd03e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:02.948943 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c776cb3b-970a-4c3a-a5bf-6c85bddcd03e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:02.949894 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c776cb3b-970a-4c3a-a5bf-6c85bddcd03e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:02.950716 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c776cb3b-970a-4c3a-a5bf-6c85bddcd03e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:02.951342 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c776cb3b-970a-4c3a-a5bf-6c85bddcd03e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:03.300175 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9bef4ba4-ca32-47d1-99b1-2abc70e2ac1b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:03.322994 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9bef4ba4-ca32-47d1-99b1-2abc70e2ac1b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:03.341020 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9bef4ba4-ca32-47d1-99b1-2abc70e2ac1b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:03.344547 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9bef4ba4-ca32-47d1-99b1-2abc70e2ac1b tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1728 microversion: 2.20 time: 0.766628 Aug 31 16:24:03.346404 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2867/5920] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:24:02 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1728 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:24:03.372629 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9a1e7582-d000-4869-aa1e-9c7e980a3dfa tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:03.375630 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9a1e7582-d000-4869-aa1e-9c7e980a3dfa tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:03.399370 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a1e7582-d000-4869-aa1e-9c7e980a3dfa tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:03.401490 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a1e7582-d000-4869-aa1e-9c7e980a3dfa tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:03.410879 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a1e7582-d000-4869-aa1e-9c7e980a3dfa tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:03.412733 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a1e7582-d000-4869-aa1e-9c7e980a3dfa tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:03.413925 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a1e7582-d000-4869-aa1e-9c7e980a3dfa tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:03.417801 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a1e7582-d000-4869-aa1e-9c7e980a3dfa tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:03.439120 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c776cb3b-970a-4c3a-a5bf-6c85bddcd03e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:03.493233 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c776cb3b-970a-4c3a-a5bf-6c85bddcd03e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286" status: 200 len: 1214 microversion: 2.1 time: 0.563865 Aug 31 16:24:03.504254 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3054/5921] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:02 2022] GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286 => generated 1214 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:03.848025 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9a1e7582-d000-4869-aa1e-9c7e980a3dfa tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:03.864784 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9a1e7582-d000-4869-aa1e-9c7e980a3dfa tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b" status: 200 len: 1724 microversion: 2.1 time: 0.496929 Aug 31 16:24:03.865676 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2868/5922] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:03 2022] GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b => generated 1724 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:04.377091 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ae11eaf3-8e25-4e98-993e-161cf1b87535 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:04.378159 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ae11eaf3-8e25-4e98-993e-161cf1b87535 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:04.391387 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ae11eaf3-8e25-4e98-993e-161cf1b87535 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:04.392319 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ae11eaf3-8e25-4e98-993e-161cf1b87535 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:04.392997 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ae11eaf3-8e25-4e98-993e-161cf1b87535 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:04.394043 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ae11eaf3-8e25-4e98-993e-161cf1b87535 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:04.395080 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ae11eaf3-8e25-4e98-993e-161cf1b87535 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:04.395758 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ae11eaf3-8e25-4e98-993e-161cf1b87535 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:04.548804 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-185f4c58-30cb-4537-8b8f-375ffe7c8cb2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:04.550590 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-185f4c58-30cb-4537-8b8f-375ffe7c8cb2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 88b41d16-3908-4de0-94fe-6c3d46786286] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:04.574176 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-185f4c58-30cb-4537-8b8f-375ffe7c8cb2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:04.574955 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-185f4c58-30cb-4537-8b8f-375ffe7c8cb2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:04.575581 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-185f4c58-30cb-4537-8b8f-375ffe7c8cb2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:04.576466 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-185f4c58-30cb-4537-8b8f-375ffe7c8cb2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:04.577082 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-185f4c58-30cb-4537-8b8f-375ffe7c8cb2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:04.577707 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-185f4c58-30cb-4537-8b8f-375ffe7c8cb2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:04.718466 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ae11eaf3-8e25-4e98-993e-161cf1b87535 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:04.735110 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ae11eaf3-8e25-4e98-993e-161cf1b87535 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:04.743363 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ae11eaf3-8e25-4e98-993e-161cf1b87535 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:04.746448 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ae11eaf3-8e25-4e98-993e-161cf1b87535 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1728 microversion: 2.20 time: 0.374990 Aug 31 16:24:04.784966 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3055/5923] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:24:04 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1728 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:24:04.821413 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-185f4c58-30cb-4537-8b8f-375ffe7c8cb2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:04.829682 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-185f4c58-30cb-4537-8b8f-375ffe7c8cb2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286" status: 200 len: 1214 microversion: 2.1 time: 0.301202 Aug 31 16:24:04.851865 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2869/5924] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:04 2022] GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286 => generated 1214 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:04.890522 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9d78c6a1-4e4c-4f0d-8ca1-a4337bbdfb61 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:04.891379 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9d78c6a1-4e4c-4f0d-8ca1-a4337bbdfb61 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:04.901361 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9d78c6a1-4e4c-4f0d-8ca1-a4337bbdfb61 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:04.902725 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9d78c6a1-4e4c-4f0d-8ca1-a4337bbdfb61 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:04.903440 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9d78c6a1-4e4c-4f0d-8ca1-a4337bbdfb61 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:04.904830 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9d78c6a1-4e4c-4f0d-8ca1-a4337bbdfb61 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:04.905424 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9d78c6a1-4e4c-4f0d-8ca1-a4337bbdfb61 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:04.906124 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9d78c6a1-4e4c-4f0d-8ca1-a4337bbdfb61 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:05.156759 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9d78c6a1-4e4c-4f0d-8ca1-a4337bbdfb61 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:05.166880 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9d78c6a1-4e4c-4f0d-8ca1-a4337bbdfb61 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b" status: 200 len: 1724 microversion: 2.1 time: 0.281700 Aug 31 16:24:05.173122 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3056/5925] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:04 2022] GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b => generated 1724 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:05.794599 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-29ec5fe5-1d22-4ead-a140-afe844bfec3d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:05.799947 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-29ec5fe5-1d22-4ead-a140-afe844bfec3d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:05.808847 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29ec5fe5-1d22-4ead-a140-afe844bfec3d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:05.809609 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29ec5fe5-1d22-4ead-a140-afe844bfec3d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:05.810969 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29ec5fe5-1d22-4ead-a140-afe844bfec3d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:05.811847 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29ec5fe5-1d22-4ead-a140-afe844bfec3d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:05.812460 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29ec5fe5-1d22-4ead-a140-afe844bfec3d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:05.813034 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29ec5fe5-1d22-4ead-a140-afe844bfec3d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:05.818742 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:24:05.861549 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-39e53a4a-be00-4682-b3a5-76a771cafac4 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:05.866013 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-39e53a4a-be00-4682-b3a5-76a771cafac4 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 88b41d16-3908-4de0-94fe-6c3d46786286] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:05.892187 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-39e53a4a-be00-4682-b3a5-76a771cafac4 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:05.895164 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-39e53a4a-be00-4682-b3a5-76a771cafac4 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:05.897101 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-39e53a4a-be00-4682-b3a5-76a771cafac4 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:05.898683 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-39e53a4a-be00-4682-b3a5-76a771cafac4 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:05.899781 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-39e53a4a-be00-4682-b3a5-76a771cafac4 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:05.902121 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-39e53a4a-be00-4682-b3a5-76a771cafac4 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:06.007607 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-29ec5fe5-1d22-4ead-a140-afe844bfec3d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:06.021417 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-29ec5fe5-1d22-4ead-a140-afe844bfec3d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:06.023805 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-29ec5fe5-1d22-4ead-a140-afe844bfec3d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:06.025435 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-29ec5fe5-1d22-4ead-a140-afe844bfec3d tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1715 microversion: 2.20 time: 0.235162 Aug 31 16:24:06.027171 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2870/5926] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:24:05 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1715 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:24:06.159634 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-39e53a4a-be00-4682-b3a5-76a771cafac4 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:06.162947 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:24:06.178020 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-39e53a4a-be00-4682-b3a5-76a771cafac4 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286" status: 200 len: 1214 microversion: 2.1 time: 0.330093 Aug 31 16:24:06.189364 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3057/5927] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:05 2022] GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286 => generated 1214 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:06.201012 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-32fdd503-b073-4033-903f-8d46b0d75ed1 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:06.202085 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-32fdd503-b073-4033-903f-8d46b0d75ed1 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:06.209000 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-32fdd503-b073-4033-903f-8d46b0d75ed1 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:06.210335 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-32fdd503-b073-4033-903f-8d46b0d75ed1 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:06.211100 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-32fdd503-b073-4033-903f-8d46b0d75ed1 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:06.212134 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-32fdd503-b073-4033-903f-8d46b0d75ed1 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:06.212979 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-32fdd503-b073-4033-903f-8d46b0d75ed1 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:06.213964 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-32fdd503-b073-4033-903f-8d46b0d75ed1 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:06.418213 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-32fdd503-b073-4033-903f-8d46b0d75ed1 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:06.430529 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-32fdd503-b073-4033-903f-8d46b0d75ed1 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b" status: 200 len: 1724 microversion: 2.1 time: 0.233474 Aug 31 16:24:06.441111 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2871/5928] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:06 2022] GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b => generated 1724 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:07.202292 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-56a37d3f-bbbe-44c0-bc1b-a96b2a7d42d3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:07.203528 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-56a37d3f-bbbe-44c0-bc1b-a96b2a7d42d3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 88b41d16-3908-4de0-94fe-6c3d46786286] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:07.216949 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-56a37d3f-bbbe-44c0-bc1b-a96b2a7d42d3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:07.217714 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-56a37d3f-bbbe-44c0-bc1b-a96b2a7d42d3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:07.226340 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-56a37d3f-bbbe-44c0-bc1b-a96b2a7d42d3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:07.227316 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-56a37d3f-bbbe-44c0-bc1b-a96b2a7d42d3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:07.227973 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-56a37d3f-bbbe-44c0-bc1b-a96b2a7d42d3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:07.228557 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-56a37d3f-bbbe-44c0-bc1b-a96b2a7d42d3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:07.453486 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6c273f1a-4180-4cd3-bac8-7fb561a27253 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:07.454046 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6c273f1a-4180-4cd3-bac8-7fb561a27253 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:07.469336 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c273f1a-4180-4cd3-bac8-7fb561a27253 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:07.470400 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c273f1a-4180-4cd3-bac8-7fb561a27253 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:07.471125 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c273f1a-4180-4cd3-bac8-7fb561a27253 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:07.476827 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c273f1a-4180-4cd3-bac8-7fb561a27253 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:07.478118 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c273f1a-4180-4cd3-bac8-7fb561a27253 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:07.479491 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c273f1a-4180-4cd3-bac8-7fb561a27253 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:07.510220 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-56a37d3f-bbbe-44c0-bc1b-a96b2a7d42d3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:07.519483 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-56a37d3f-bbbe-44c0-bc1b-a96b2a7d42d3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286" status: 200 len: 1202 microversion: 2.1 time: 0.322365 Aug 31 16:24:07.528913 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3058/5929] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:07 2022] GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286 => generated 1202 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:07.714388 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6c273f1a-4180-4cd3-bac8-7fb561a27253 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:07.742578 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6c273f1a-4180-4cd3-bac8-7fb561a27253 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b" status: 200 len: 1724 microversion: 2.1 time: 0.293005 Aug 31 16:24:07.757822 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2872/5930] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:07 2022] GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b => generated 1724 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:24:08.570206 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-94a63e15-76d8-430c-8801-c0c1095cbb2b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:08.571015 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-94a63e15-76d8-430c-8801-c0c1095cbb2b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 88b41d16-3908-4de0-94fe-6c3d46786286] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:08.623851 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-94a63e15-76d8-430c-8801-c0c1095cbb2b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:08.624620 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-94a63e15-76d8-430c-8801-c0c1095cbb2b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:08.626185 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-94a63e15-76d8-430c-8801-c0c1095cbb2b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:08.627212 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-94a63e15-76d8-430c-8801-c0c1095cbb2b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:08.627859 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-94a63e15-76d8-430c-8801-c0c1095cbb2b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:08.629504 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-94a63e15-76d8-430c-8801-c0c1095cbb2b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:08.766463 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e3ecae02-8eff-40c6-89e1-9c59905a508d tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:08.767655 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e3ecae02-8eff-40c6-89e1-9c59905a508d tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:08.781410 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3ecae02-8eff-40c6-89e1-9c59905a508d tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:08.782332 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3ecae02-8eff-40c6-89e1-9c59905a508d tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:08.786812 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3ecae02-8eff-40c6-89e1-9c59905a508d tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:08.788055 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3ecae02-8eff-40c6-89e1-9c59905a508d tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:08.788558 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3ecae02-8eff-40c6-89e1-9c59905a508d tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:08.789083 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3ecae02-8eff-40c6-89e1-9c59905a508d tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:09.015310 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-94a63e15-76d8-430c-8801-c0c1095cbb2b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:09.046582 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-94a63e15-76d8-430c-8801-c0c1095cbb2b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286" status: 200 len: 1202 microversion: 2.1 time: 0.488693 Aug 31 16:24:09.051001 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3059/5931] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:08 2022] GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286 => generated 1202 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:09.093833 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e3ecae02-8eff-40c6-89e1-9c59905a508d tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:09.120137 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e3ecae02-8eff-40c6-89e1-9c59905a508d tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b" status: 200 len: 1724 microversion: 2.1 time: 0.358624 Aug 31 16:24:09.123729 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2873/5932] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:08 2022] GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b => generated 1724 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:10.081406 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7af52804-0b51-47c4-89f5-9b250923405c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:10.082269 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7af52804-0b51-47c4-89f5-9b250923405c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 88b41d16-3908-4de0-94fe-6c3d46786286] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:10.100539 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7af52804-0b51-47c4-89f5-9b250923405c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:10.101024 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7af52804-0b51-47c4-89f5-9b250923405c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:10.101470 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7af52804-0b51-47c4-89f5-9b250923405c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:10.102197 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7af52804-0b51-47c4-89f5-9b250923405c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:10.103083 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7af52804-0b51-47c4-89f5-9b250923405c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:10.103662 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7af52804-0b51-47c4-89f5-9b250923405c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:10.148170 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a7c77925-3b25-416d-9257-d51c0ee25759 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:10.149505 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a7c77925-3b25-416d-9257-d51c0ee25759 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:10.188206 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a7c77925-3b25-416d-9257-d51c0ee25759 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:10.198049 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a7c77925-3b25-416d-9257-d51c0ee25759 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:10.198900 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a7c77925-3b25-416d-9257-d51c0ee25759 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:10.200084 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a7c77925-3b25-416d-9257-d51c0ee25759 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:10.200774 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a7c77925-3b25-416d-9257-d51c0ee25759 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:10.203932 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a7c77925-3b25-416d-9257-d51c0ee25759 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:10.484969 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7af52804-0b51-47c4-89f5-9b250923405c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:10.497466 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7af52804-0b51-47c4-89f5-9b250923405c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286" status: 200 len: 1202 microversion: 2.1 time: 0.428314 Aug 31 16:24:10.510490 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3060/5933] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:10 2022] GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286 => generated 1202 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:10.519085 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a7c77925-3b25-416d-9257-d51c0ee25759 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:10.538146 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a7c77925-3b25-416d-9257-d51c0ee25759 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b" status: 200 len: 1724 microversion: 2.1 time: 0.394992 Aug 31 16:24:10.541313 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2874/5934] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:10 2022] GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b => generated 1724 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:24:11.520530 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4d06ba92-b1f6-4793-97cb-097b8df7ec06 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:11.521486 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4d06ba92-b1f6-4793-97cb-097b8df7ec06 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 88b41d16-3908-4de0-94fe-6c3d46786286] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:11.529124 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4d06ba92-b1f6-4793-97cb-097b8df7ec06 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:11.529505 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4d06ba92-b1f6-4793-97cb-097b8df7ec06 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:11.529930 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4d06ba92-b1f6-4793-97cb-097b8df7ec06 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:11.531048 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4d06ba92-b1f6-4793-97cb-097b8df7ec06 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:11.531501 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4d06ba92-b1f6-4793-97cb-097b8df7ec06 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:11.531925 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4d06ba92-b1f6-4793-97cb-097b8df7ec06 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:11.565292 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fae0c4c0-0bb6-456a-912f-46267f87b14b tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:11.566485 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fae0c4c0-0bb6-456a-912f-46267f87b14b tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:11.580385 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fae0c4c0-0bb6-456a-912f-46267f87b14b tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:11.581180 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fae0c4c0-0bb6-456a-912f-46267f87b14b tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:11.581696 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fae0c4c0-0bb6-456a-912f-46267f87b14b tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:11.582396 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fae0c4c0-0bb6-456a-912f-46267f87b14b tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:11.582890 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fae0c4c0-0bb6-456a-912f-46267f87b14b tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:11.583513 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fae0c4c0-0bb6-456a-912f-46267f87b14b tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:11.822735 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4d06ba92-b1f6-4793-97cb-097b8df7ec06 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:11.833054 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4d06ba92-b1f6-4793-97cb-097b8df7ec06 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286" status: 200 len: 1202 microversion: 2.1 time: 0.317146 Aug 31 16:24:11.833867 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3061/5935] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:11 2022] GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286 => generated 1202 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:11.863791 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fae0c4c0-0bb6-456a-912f-46267f87b14b tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:11.879185 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fae0c4c0-0bb6-456a-912f-46267f87b14b tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b" status: 200 len: 1724 microversion: 2.1 time: 0.318010 Aug 31 16:24:11.880505 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2875/5936] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:11 2022] GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b => generated 1724 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:12.859866 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3618ca56-d37c-4e9b-8bdd-a9dbbf0b1286 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:12.861187 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3618ca56-d37c-4e9b-8bdd-a9dbbf0b1286 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 88b41d16-3908-4de0-94fe-6c3d46786286] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:12.894556 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3618ca56-d37c-4e9b-8bdd-a9dbbf0b1286 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:12.895046 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3618ca56-d37c-4e9b-8bdd-a9dbbf0b1286 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:12.895479 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3618ca56-d37c-4e9b-8bdd-a9dbbf0b1286 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:12.896354 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3618ca56-d37c-4e9b-8bdd-a9dbbf0b1286 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:12.896807 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3618ca56-d37c-4e9b-8bdd-a9dbbf0b1286 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:12.897462 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3618ca56-d37c-4e9b-8bdd-a9dbbf0b1286 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:12.914874 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5cd8acdd-4cc7-48b1-b0d0-0e3266599eb3 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:12.916298 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5cd8acdd-4cc7-48b1-b0d0-0e3266599eb3 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:12.933539 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5cd8acdd-4cc7-48b1-b0d0-0e3266599eb3 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:12.934504 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5cd8acdd-4cc7-48b1-b0d0-0e3266599eb3 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:12.935339 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5cd8acdd-4cc7-48b1-b0d0-0e3266599eb3 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:12.936453 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5cd8acdd-4cc7-48b1-b0d0-0e3266599eb3 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:12.937226 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5cd8acdd-4cc7-48b1-b0d0-0e3266599eb3 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:12.937893 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5cd8acdd-4cc7-48b1-b0d0-0e3266599eb3 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:13.239903 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3618ca56-d37c-4e9b-8bdd-a9dbbf0b1286 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:13.244581 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5cd8acdd-4cc7-48b1-b0d0-0e3266599eb3 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:13.249227 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3618ca56-d37c-4e9b-8bdd-a9dbbf0b1286 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286" status: 200 len: 1202 microversion: 2.1 time: 0.394264 Aug 31 16:24:13.256219 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5cd8acdd-4cc7-48b1-b0d0-0e3266599eb3 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b" status: 200 len: 1724 microversion: 2.1 time: 0.355911 Aug 31 16:24:13.257472 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2876/5937] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:12 2022] GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b => generated 1724 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:24:13.263502 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3062/5938] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:12 2022] GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286 => generated 1202 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:14.281782 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0de840ba-3874-40f4-b318-e10afffe96cc tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:14.283274 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0de840ba-3874-40f4-b318-e10afffe96cc tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:14.286894 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3ea6db8d-0943-4006-a8f0-8cebbcde2f75 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:14.288020 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3ea6db8d-0943-4006-a8f0-8cebbcde2f75 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 88b41d16-3908-4de0-94fe-6c3d46786286] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:14.294598 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0de840ba-3874-40f4-b318-e10afffe96cc tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:14.295432 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0de840ba-3874-40f4-b318-e10afffe96cc tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:14.296164 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0de840ba-3874-40f4-b318-e10afffe96cc tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:14.297208 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0de840ba-3874-40f4-b318-e10afffe96cc tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:14.297884 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0de840ba-3874-40f4-b318-e10afffe96cc tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:14.298376 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=58 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:24:14.298742 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0de840ba-3874-40f4-b318-e10afffe96cc tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:14.302275 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ea6db8d-0943-4006-a8f0-8cebbcde2f75 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:14.303596 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ea6db8d-0943-4006-a8f0-8cebbcde2f75 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:14.304539 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ea6db8d-0943-4006-a8f0-8cebbcde2f75 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:14.319941 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ea6db8d-0943-4006-a8f0-8cebbcde2f75 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:14.321674 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ea6db8d-0943-4006-a8f0-8cebbcde2f75 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:14.322562 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3ea6db8d-0943-4006-a8f0-8cebbcde2f75 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:14.990394 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3ea6db8d-0943-4006-a8f0-8cebbcde2f75 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:14.999854 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0de840ba-3874-40f4-b318-e10afffe96cc tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:15.011650 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3ea6db8d-0943-4006-a8f0-8cebbcde2f75 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286" status: 200 len: 1202 microversion: 2.1 time: 0.744681 Aug 31 16:24:15.013696 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2877/5939] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:14 2022] GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286 => generated 1202 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:15.030906 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0de840ba-3874-40f4-b318-e10afffe96cc tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b" status: 200 len: 1701 microversion: 2.1 time: 0.735973 Aug 31 16:24:15.032064 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3063/5940] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:14 2022] GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b => generated 1701 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:15.067212 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6d22e957-607c-4f51-956b-aca247849e63 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:24:15.099641 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d22e957-607c-4f51-956b-aca247849e63 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:15.100343 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d22e957-607c-4f51-956b-aca247849e63 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:15.100806 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d22e957-607c-4f51-956b-aca247849e63 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:15.162776 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6d22e957-607c-4f51-956b-aca247849e63 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] Going to try to start instance {{(pid=128863) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 31 16:24:15.244719 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6d22e957-607c-4f51-956b-aca247849e63 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "POST /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b/action" status: 202 len: 0 microversion: 2.1 time: 0.188764 Aug 31 16:24:15.248716 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2878/5941] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:24:15 2022] POST /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:24:15.256785 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b93cdc89-d0fc-49e1-9c3a-40cccc2693a9 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:15.257609 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b93cdc89-d0fc-49e1-9c3a-40cccc2693a9 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:15.271442 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b93cdc89-d0fc-49e1-9c3a-40cccc2693a9 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:15.273600 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b93cdc89-d0fc-49e1-9c3a-40cccc2693a9 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:15.276768 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b93cdc89-d0fc-49e1-9c3a-40cccc2693a9 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:15.278001 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b93cdc89-d0fc-49e1-9c3a-40cccc2693a9 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:15.280964 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b93cdc89-d0fc-49e1-9c3a-40cccc2693a9 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:15.281769 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b93cdc89-d0fc-49e1-9c3a-40cccc2693a9 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:15.592158 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b93cdc89-d0fc-49e1-9c3a-40cccc2693a9 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:15.605188 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b93cdc89-d0fc-49e1-9c3a-40cccc2693a9 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b" status: 200 len: 1710 microversion: 2.1 time: 0.354613 Aug 31 16:24:15.606957 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3064/5942] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:15 2022] GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b => generated 1710 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:16.040612 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ba14c3a9-e90e-4992-85f8-55ccef86d110 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:16.041337 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ba14c3a9-e90e-4992-85f8-55ccef86d110 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 88b41d16-3908-4de0-94fe-6c3d46786286] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:16.062569 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba14c3a9-e90e-4992-85f8-55ccef86d110 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:16.065286 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba14c3a9-e90e-4992-85f8-55ccef86d110 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:16.066522 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba14c3a9-e90e-4992-85f8-55ccef86d110 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:16.070941 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba14c3a9-e90e-4992-85f8-55ccef86d110 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:16.072804 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba14c3a9-e90e-4992-85f8-55ccef86d110 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:16.073471 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba14c3a9-e90e-4992-85f8-55ccef86d110 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:16.438724 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ba14c3a9-e90e-4992-85f8-55ccef86d110 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:16.449931 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ba14c3a9-e90e-4992-85f8-55ccef86d110 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286" status: 200 len: 1202 microversion: 2.1 time: 0.416663 Aug 31 16:24:16.450575 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2879/5943] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:16 2022] GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286 => generated 1202 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:16.640991 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-700162b6-2bae-48d1-b4e7-7099bb56988e tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:16.641795 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-700162b6-2bae-48d1-b4e7-7099bb56988e tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:16.645241 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:24:16.653475 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-700162b6-2bae-48d1-b4e7-7099bb56988e tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:16.654546 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-700162b6-2bae-48d1-b4e7-7099bb56988e tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:16.655777 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-700162b6-2bae-48d1-b4e7-7099bb56988e tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:16.656714 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-700162b6-2bae-48d1-b4e7-7099bb56988e tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:16.657559 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-700162b6-2bae-48d1-b4e7-7099bb56988e tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:16.658862 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-700162b6-2bae-48d1-b4e7-7099bb56988e tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:16.844666 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-700162b6-2bae-48d1-b4e7-7099bb56988e tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:16.856107 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-700162b6-2bae-48d1-b4e7-7099bb56988e tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b" status: 200 len: 1710 microversion: 2.1 time: 0.224914 Aug 31 16:24:16.856975 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3065/5944] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:16 2022] GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b => generated 1710 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:17.472045 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cef14915-49ce-4745-9cd2-5a033213118a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:17.472652 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cef14915-49ce-4745-9cd2-5a033213118a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 88b41d16-3908-4de0-94fe-6c3d46786286] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:17.481674 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cef14915-49ce-4745-9cd2-5a033213118a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:17.486239 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cef14915-49ce-4745-9cd2-5a033213118a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:17.486700 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cef14915-49ce-4745-9cd2-5a033213118a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:17.487455 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cef14915-49ce-4745-9cd2-5a033213118a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:17.487920 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cef14915-49ce-4745-9cd2-5a033213118a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:17.488347 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cef14915-49ce-4745-9cd2-5a033213118a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:17.557252 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-349c9885-f114-4b96-b734-e0ebb35ee8f2 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:17.558185 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-349c9885-f114-4b96-b734-e0ebb35ee8f2 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 95902b01-9a33-45e2-b454-cdab91014582] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:17.568439 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-349c9885-f114-4b96-b734-e0ebb35ee8f2 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:17.569351 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-349c9885-f114-4b96-b734-e0ebb35ee8f2 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:17.570056 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-349c9885-f114-4b96-b734-e0ebb35ee8f2 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:17.570981 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-349c9885-f114-4b96-b734-e0ebb35ee8f2 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:17.571824 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-349c9885-f114-4b96-b734-e0ebb35ee8f2 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:17.572610 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-349c9885-f114-4b96-b734-e0ebb35ee8f2 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:17.741856 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cef14915-49ce-4745-9cd2-5a033213118a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:17.744429 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-349c9885-f114-4b96-b734-e0ebb35ee8f2 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lazy-loading 'services' on Instance uuid 95902b01-9a33-45e2-b454-cdab91014582 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:24:17.751600 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cef14915-49ce-4745-9cd2-5a033213118a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286" status: 200 len: 1202 microversion: 2.1 time: 0.283351 Aug 31 16:24:17.752752 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2880/5945] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:17 2022] GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286 => generated 1202 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:17.861235 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-349c9885-f114-4b96-b734-e0ebb35ee8f2 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "DELETE /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582/os-volume_attachments/a569a105-5619-4017-9b3c-3d2c3061b892" status: 202 len: 0 microversion: 2.1 time: 0.309834 Aug 31 16:24:17.862529 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3066/5946] 10.222.0.50 () {58 vars in 1416 bytes} [Wed Aug 31 16:24:17 2022] DELETE /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582/os-volume_attachments/a569a105-5619-4017-9b3c-3d2c3061b892 => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 16:24:17.872372 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5fc04773-4ed6-48e6-8765-e0aeb56d7db5 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:17.879328 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5fc04773-4ed6-48e6-8765-e0aeb56d7db5 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 95902b01-9a33-45e2-b454-cdab91014582] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:17.888893 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-025bbcfd-3b56-446f-b04d-691e2037d378 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:17.890574 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-025bbcfd-3b56-446f-b04d-691e2037d378 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:17.894650 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5fc04773-4ed6-48e6-8765-e0aeb56d7db5 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:17.895469 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5fc04773-4ed6-48e6-8765-e0aeb56d7db5 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:17.897794 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5fc04773-4ed6-48e6-8765-e0aeb56d7db5 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:17.900075 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-025bbcfd-3b56-446f-b04d-691e2037d378 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:17.900782 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-025bbcfd-3b56-446f-b04d-691e2037d378 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:17.901593 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-025bbcfd-3b56-446f-b04d-691e2037d378 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:17.902777 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-025bbcfd-3b56-446f-b04d-691e2037d378 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:17.903397 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-025bbcfd-3b56-446f-b04d-691e2037d378 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:17.904117 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-025bbcfd-3b56-446f-b04d-691e2037d378 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:17.911130 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5fc04773-4ed6-48e6-8765-e0aeb56d7db5 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:17.916200 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5fc04773-4ed6-48e6-8765-e0aeb56d7db5 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:17.917048 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5fc04773-4ed6-48e6-8765-e0aeb56d7db5 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:18.008140 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5fc04773-4ed6-48e6-8765-e0aeb56d7db5 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.141124 Aug 31 16:24:18.009993 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2881/5947] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:24:17 2022] GET /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:24:18.256181 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-025bbcfd-3b56-446f-b04d-691e2037d378 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:18.265964 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-025bbcfd-3b56-446f-b04d-691e2037d378 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b" status: 200 len: 1714 microversion: 2.1 time: 0.386674 Aug 31 16:24:18.267610 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3067/5948] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:17 2022] GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b => generated 1714 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:18.432747 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-0ac62197-f5d0-4436-9616-5cf44edfe8b1 req-7fcd8426-8177-40ff-8e50-c6f7d84f18d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88b41d16-3908-4de0-94fe-6c3d46786286", "name": "network-vif-plugged", "status": "completed", "tag": "9d5dc457-9a17-4234-903f-e557dffd350f"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:24:18.454562 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-0ac62197-f5d0-4436-9616-5cf44edfe8b1 req-7fcd8426-8177-40ff-8e50-c6f7d84f18d2 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:18.455106 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-0ac62197-f5d0-4436-9616-5cf44edfe8b1 req-7fcd8426-8177-40ff-8e50-c6f7d84f18d2 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:18.455569 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-0ac62197-f5d0-4436-9616-5cf44edfe8b1 req-7fcd8426-8177-40ff-8e50-c6f7d84f18d2 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:18.480393 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-0ac62197-f5d0-4436-9616-5cf44edfe8b1 req-7fcd8426-8177-40ff-8e50-c6f7d84f18d2 service nova] Creating event network-vif-plugged:9d5dc457-9a17-4234-903f-e557dffd350f for instance 88b41d16-3908-4de0-94fe-6c3d46786286 on n-h1-833090-16 Aug 31 16:24:18.496196 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-0ac62197-f5d0-4436-9616-5cf44edfe8b1 req-7fcd8426-8177-40ff-8e50-c6f7d84f18d2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068735 Aug 31 16:24:18.500824 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2882/5949] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:24:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:24:18.790675 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-dae8b55c-9f4e-4b59-b7c6-a99a8cc85dbf tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:18.791296 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-dae8b55c-9f4e-4b59-b7c6-a99a8cc85dbf tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 88b41d16-3908-4de0-94fe-6c3d46786286] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:18.815043 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dae8b55c-9f4e-4b59-b7c6-a99a8cc85dbf tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:18.815692 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dae8b55c-9f4e-4b59-b7c6-a99a8cc85dbf tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:18.816361 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dae8b55c-9f4e-4b59-b7c6-a99a8cc85dbf tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:18.817123 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dae8b55c-9f4e-4b59-b7c6-a99a8cc85dbf tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:18.817670 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dae8b55c-9f4e-4b59-b7c6-a99a8cc85dbf tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:18.820882 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dae8b55c-9f4e-4b59-b7c6-a99a8cc85dbf tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:19.023206 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-114ff178-6d4f-47b5-802f-5aab4e65b579 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:19.027021 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-114ff178-6d4f-47b5-802f-5aab4e65b579 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 95902b01-9a33-45e2-b454-cdab91014582] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:19.057931 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-114ff178-6d4f-47b5-802f-5aab4e65b579 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:19.063874 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-114ff178-6d4f-47b5-802f-5aab4e65b579 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:19.064761 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-114ff178-6d4f-47b5-802f-5aab4e65b579 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:19.068485 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-114ff178-6d4f-47b5-802f-5aab4e65b579 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:19.069155 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-114ff178-6d4f-47b5-802f-5aab4e65b579 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:19.070742 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-114ff178-6d4f-47b5-802f-5aab4e65b579 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:19.080509 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-dae8b55c-9f4e-4b59-b7c6-a99a8cc85dbf tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:19.095621 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-dae8b55c-9f4e-4b59-b7c6-a99a8cc85dbf tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286" status: 200 len: 1202 microversion: 2.1 time: 0.311665 Aug 31 16:24:19.099341 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3068/5950] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:18 2022] GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286 => generated 1202 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:19.138138 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-114ff178-6d4f-47b5-802f-5aab4e65b579 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120687 Aug 31 16:24:19.139168 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2883/5951] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:24:19 2022] GET /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:24:20.129071 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e7fe0393-53c4-40c7-bcbe-ba039939cafa tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:20.131206 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e7fe0393-53c4-40c7-bcbe-ba039939cafa tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 88b41d16-3908-4de0-94fe-6c3d46786286] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:20.152835 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dd4b87aa-2cbd-4375-95c9-86445703529c tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:20.156140 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dd4b87aa-2cbd-4375-95c9-86445703529c tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 95902b01-9a33-45e2-b454-cdab91014582] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:20.157422 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7fe0393-53c4-40c7-bcbe-ba039939cafa tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:20.158054 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7fe0393-53c4-40c7-bcbe-ba039939cafa tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:20.158653 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7fe0393-53c4-40c7-bcbe-ba039939cafa tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:20.159910 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7fe0393-53c4-40c7-bcbe-ba039939cafa tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:20.160581 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7fe0393-53c4-40c7-bcbe-ba039939cafa tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:20.161210 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e7fe0393-53c4-40c7-bcbe-ba039939cafa tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:20.172616 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd4b87aa-2cbd-4375-95c9-86445703529c tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:20.173194 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd4b87aa-2cbd-4375-95c9-86445703529c tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:20.174413 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd4b87aa-2cbd-4375-95c9-86445703529c tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:20.175138 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd4b87aa-2cbd-4375-95c9-86445703529c tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:20.175599 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd4b87aa-2cbd-4375-95c9-86445703529c tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:20.176025 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd4b87aa-2cbd-4375-95c9-86445703529c tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:20.239938 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dd4b87aa-2cbd-4375-95c9-86445703529c tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091504 Aug 31 16:24:20.241903 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2884/5952] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:24:20 2022] GET /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:24:20.375048 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e7fe0393-53c4-40c7-bcbe-ba039939cafa tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:20.397434 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e7fe0393-53c4-40c7-bcbe-ba039939cafa tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286" status: 200 len: 1389 microversion: 2.1 time: 0.279113 Aug 31 16:24:20.401563 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3069/5953] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:20 2022] GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286 => generated 1389 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:20.421948 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-50d5c525-91a0-462c-8617-d9a096a0aad3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:20.422933 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-50d5c525-91a0-462c-8617-d9a096a0aad3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 88b41d16-3908-4de0-94fe-6c3d46786286] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:20.432440 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50d5c525-91a0-462c-8617-d9a096a0aad3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:20.433548 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50d5c525-91a0-462c-8617-d9a096a0aad3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:20.434602 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50d5c525-91a0-462c-8617-d9a096a0aad3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:20.435967 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50d5c525-91a0-462c-8617-d9a096a0aad3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:20.436909 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50d5c525-91a0-462c-8617-d9a096a0aad3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:20.437778 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50d5c525-91a0-462c-8617-d9a096a0aad3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:20.626395 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-50d5c525-91a0-462c-8617-d9a096a0aad3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:20.638445 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-50d5c525-91a0-462c-8617-d9a096a0aad3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286" status: 200 len: 1389 microversion: 2.1 time: 0.220320 Aug 31 16:24:20.639322 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2885/5954] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:20 2022] GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286 => generated 1389 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:20.659545 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-541e8931-d87b-4c72-81e1-f4ebb2ac1dd4 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:20.660512 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-541e8931-d87b-4c72-81e1-f4ebb2ac1dd4 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 88b41d16-3908-4de0-94fe-6c3d46786286] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:20.678609 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-541e8931-d87b-4c72-81e1-f4ebb2ac1dd4 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:20.679367 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-541e8931-d87b-4c72-81e1-f4ebb2ac1dd4 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:20.679801 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-541e8931-d87b-4c72-81e1-f4ebb2ac1dd4 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:20.680681 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-541e8931-d87b-4c72-81e1-f4ebb2ac1dd4 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:20.681143 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-541e8931-d87b-4c72-81e1-f4ebb2ac1dd4 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:20.681565 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-541e8931-d87b-4c72-81e1-f4ebb2ac1dd4 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:20.862158 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-541e8931-d87b-4c72-81e1-f4ebb2ac1dd4 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:20.872903 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-541e8931-d87b-4c72-81e1-f4ebb2ac1dd4 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286" status: 200 len: 1389 microversion: 2.1 time: 0.217457 Aug 31 16:24:20.886388 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3070/5955] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:20 2022] GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286 => generated 1389 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:20.895368 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-df05189f-9e71-41f0-80ce-d35d33d53035 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:20.896461 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-df05189f-9e71-41f0-80ce-d35d33d53035 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 88b41d16-3908-4de0-94fe-6c3d46786286] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:20.904798 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df05189f-9e71-41f0-80ce-d35d33d53035 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:20.905755 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df05189f-9e71-41f0-80ce-d35d33d53035 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:20.906544 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df05189f-9e71-41f0-80ce-d35d33d53035 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:20.907837 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df05189f-9e71-41f0-80ce-d35d33d53035 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:20.909844 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df05189f-9e71-41f0-80ce-d35d33d53035 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:20.909844 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df05189f-9e71-41f0-80ce-d35d33d53035 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:20.933531 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:24:20.945727 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-df05189f-9e71-41f0-80ce-d35d33d53035 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 88b41d16-3908-4de0-94fe-6c3d46786286] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:24:21.060439 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-df05189f-9e71-41f0-80ce-d35d33d53035 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "DELETE /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286" status: 204 len: 0 microversion: 2.1 time: 0.170105 Aug 31 16:24:21.061545 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2886/5956] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:24:20 2022] DELETE /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 16:24:21.073596 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c677878d-acf9-466d-849f-c1adb7b84f15 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:21.076087 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c677878d-acf9-466d-849f-c1adb7b84f15 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 88b41d16-3908-4de0-94fe-6c3d46786286] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:21.086791 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c677878d-acf9-466d-849f-c1adb7b84f15 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:21.087458 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c677878d-acf9-466d-849f-c1adb7b84f15 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:21.088089 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c677878d-acf9-466d-849f-c1adb7b84f15 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:21.089242 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c677878d-acf9-466d-849f-c1adb7b84f15 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:21.090153 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c677878d-acf9-466d-849f-c1adb7b84f15 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:21.090882 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c677878d-acf9-466d-849f-c1adb7b84f15 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:21.257254 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-55bdcb4e-3e66-40ac-a7f7-6d075b7d7ba9 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:21.261117 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-55bdcb4e-3e66-40ac-a7f7-6d075b7d7ba9 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 95902b01-9a33-45e2-b454-cdab91014582] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:21.272360 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55bdcb4e-3e66-40ac-a7f7-6d075b7d7ba9 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:21.273132 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55bdcb4e-3e66-40ac-a7f7-6d075b7d7ba9 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:21.274414 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55bdcb4e-3e66-40ac-a7f7-6d075b7d7ba9 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:21.275346 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55bdcb4e-3e66-40ac-a7f7-6d075b7d7ba9 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:21.275961 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55bdcb4e-3e66-40ac-a7f7-6d075b7d7ba9 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:21.276544 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55bdcb4e-3e66-40ac-a7f7-6d075b7d7ba9 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:21.320374 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c677878d-acf9-466d-849f-c1adb7b84f15 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:21.331727 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c677878d-acf9-466d-849f-c1adb7b84f15 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286" status: 200 len: 1395 microversion: 2.1 time: 0.265594 Aug 31 16:24:21.346954 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3071/5957] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:21 2022] GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286 => generated 1395 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:21.382605 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-55bdcb4e-3e66-40ac-a7f7-6d075b7d7ba9 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129626 Aug 31 16:24:21.388738 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2887/5958] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:24:21 2022] GET /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:24:22.357450 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5851269e-f833-46bf-a112-ac1ef4413a6d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:22.359516 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5851269e-f833-46bf-a112-ac1ef4413a6d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 88b41d16-3908-4de0-94fe-6c3d46786286] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:22.374310 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5851269e-f833-46bf-a112-ac1ef4413a6d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:22.375449 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5851269e-f833-46bf-a112-ac1ef4413a6d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:22.376534 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5851269e-f833-46bf-a112-ac1ef4413a6d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:22.378137 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5851269e-f833-46bf-a112-ac1ef4413a6d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:22.379285 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5851269e-f833-46bf-a112-ac1ef4413a6d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:22.381410 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5851269e-f833-46bf-a112-ac1ef4413a6d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:22.395118 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-639f68f7-615e-4b42-8d26-e71c3aa8a7f6 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:22.397867 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-639f68f7-615e-4b42-8d26-e71c3aa8a7f6 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 95902b01-9a33-45e2-b454-cdab91014582] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:22.413880 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-639f68f7-615e-4b42-8d26-e71c3aa8a7f6 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:22.414552 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-639f68f7-615e-4b42-8d26-e71c3aa8a7f6 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:22.415091 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-639f68f7-615e-4b42-8d26-e71c3aa8a7f6 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:22.415910 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-639f68f7-615e-4b42-8d26-e71c3aa8a7f6 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:22.416460 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-639f68f7-615e-4b42-8d26-e71c3aa8a7f6 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:22.418623 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-639f68f7-615e-4b42-8d26-e71c3aa8a7f6 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:22.487274 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-639f68f7-615e-4b42-8d26-e71c3aa8a7f6 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096417 Aug 31 16:24:22.492397 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2888/5959] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:24:22 2022] GET /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:24:22.592760 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5851269e-f833-46bf-a112-ac1ef4413a6d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:22.627136 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5851269e-f833-46bf-a112-ac1ef4413a6d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286" status: 200 len: 1395 microversion: 2.1 time: 0.275874 Aug 31 16:24:22.627929 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3072/5960] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:22 2022] GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286 => generated 1395 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:23.510569 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-27756a99-1745-40e8-85a9-cd978fb158ae tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:23.515645 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-27756a99-1745-40e8-85a9-cd978fb158ae tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 95902b01-9a33-45e2-b454-cdab91014582] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:23.538830 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27756a99-1745-40e8-85a9-cd978fb158ae tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:23.539705 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27756a99-1745-40e8-85a9-cd978fb158ae tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:23.543048 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27756a99-1745-40e8-85a9-cd978fb158ae tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:23.544788 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27756a99-1745-40e8-85a9-cd978fb158ae tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:23.548410 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27756a99-1745-40e8-85a9-cd978fb158ae tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:23.548865 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27756a99-1745-40e8-85a9-cd978fb158ae tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:23.651732 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9cd9837b-3a5d-4900-924c-c8ca5f934fb6 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:23.653332 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9cd9837b-3a5d-4900-924c-c8ca5f934fb6 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 88b41d16-3908-4de0-94fe-6c3d46786286] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:23.662675 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-27756a99-1745-40e8-85a9-cd978fb158ae tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.160922 Aug 31 16:24:23.667314 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2889/5961] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:24:23 2022] GET /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582/os-volume_attachments => generated 197 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:24:23.672283 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9cd9837b-3a5d-4900-924c-c8ca5f934fb6 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:23.673126 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9cd9837b-3a5d-4900-924c-c8ca5f934fb6 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:23.676612 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9cd9837b-3a5d-4900-924c-c8ca5f934fb6 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:23.677259 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9cd9837b-3a5d-4900-924c-c8ca5f934fb6 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:23.677949 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9cd9837b-3a5d-4900-924c-c8ca5f934fb6 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:23.682447 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9cd9837b-3a5d-4900-924c-c8ca5f934fb6 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:23.715344 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-02a9d7de-6234-4f26-92f9-64adcc73c1ee req-79e016b5-cd30-4d3f-999d-be682c796ae5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88b41d16-3908-4de0-94fe-6c3d46786286", "name": "network-vif-deleted", "tag": "9d5dc457-9a17-4234-903f-e557dffd350f"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:24:23.746314 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-02a9d7de-6234-4f26-92f9-64adcc73c1ee req-79e016b5-cd30-4d3f-999d-be682c796ae5 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:23.747179 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-02a9d7de-6234-4f26-92f9-64adcc73c1ee req-79e016b5-cd30-4d3f-999d-be682c796ae5 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:23.751113 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-02a9d7de-6234-4f26-92f9-64adcc73c1ee req-79e016b5-cd30-4d3f-999d-be682c796ae5 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:23.785009 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-02a9d7de-6234-4f26-92f9-64adcc73c1ee req-79e016b5-cd30-4d3f-999d-be682c796ae5 service nova] Creating event network-vif-deleted:9d5dc457-9a17-4234-903f-e557dffd350f for instance 88b41d16-3908-4de0-94fe-6c3d46786286 on n-h1-833090-16 Aug 31 16:24:23.794844 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-02a9d7de-6234-4f26-92f9-64adcc73c1ee req-79e016b5-cd30-4d3f-999d-be682c796ae5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084651 Aug 31 16:24:23.795851 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2890/5962] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:24:23.870291 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9cd9837b-3a5d-4900-924c-c8ca5f934fb6 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:23.872852 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:24:23.887679 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9cd9837b-3a5d-4900-924c-c8ca5f934fb6 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286" status: 200 len: 1353 microversion: 2.1 time: 0.241468 Aug 31 16:24:23.891011 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3073/5963] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:23 2022] GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286 => generated 1353 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:24:24.677849 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f2fdb355-bf4f-4793-8799-f81d4af91f58 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:24.681915 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f2fdb355-bf4f-4793-8799-f81d4af91f58 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 95902b01-9a33-45e2-b454-cdab91014582] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:24.703229 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f2fdb355-bf4f-4793-8799-f81d4af91f58 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:24.703926 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f2fdb355-bf4f-4793-8799-f81d4af91f58 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:24.704544 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f2fdb355-bf4f-4793-8799-f81d4af91f58 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:24.710634 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f2fdb355-bf4f-4793-8799-f81d4af91f58 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:24.711635 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f2fdb355-bf4f-4793-8799-f81d4af91f58 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:24.712671 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f2fdb355-bf4f-4793-8799-f81d4af91f58 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:24.786165 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f2fdb355-bf4f-4793-8799-f81d4af91f58 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.114717 Aug 31 16:24:24.790138 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2891/5964] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:24:24 2022] GET /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582/os-volume_attachments => generated 25 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:24:24.877468 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0cdc6ead-017b-4cc4-8326-5c6401b1a588 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:24.878822 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0cdc6ead-017b-4cc4-8326-5c6401b1a588 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 95902b01-9a33-45e2-b454-cdab91014582] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:24.887866 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0cdc6ead-017b-4cc4-8326-5c6401b1a588 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:24.888631 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0cdc6ead-017b-4cc4-8326-5c6401b1a588 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:24.889253 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0cdc6ead-017b-4cc4-8326-5c6401b1a588 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:24.895060 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0cdc6ead-017b-4cc4-8326-5c6401b1a588 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:24.896069 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0cdc6ead-017b-4cc4-8326-5c6401b1a588 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:24.896698 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0cdc6ead-017b-4cc4-8326-5c6401b1a588 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:24.916055 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b0c086cf-0232-4613-ab4b-5916507f7d2e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:24.917186 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b0c086cf-0232-4613-ab4b-5916507f7d2e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 88b41d16-3908-4de0-94fe-6c3d46786286] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:24.929707 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0c086cf-0232-4613-ab4b-5916507f7d2e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:24.930235 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0c086cf-0232-4613-ab4b-5916507f7d2e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:24.930900 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0c086cf-0232-4613-ab4b-5916507f7d2e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:24.931767 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0c086cf-0232-4613-ab4b-5916507f7d2e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:24.932243 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0c086cf-0232-4613-ab4b-5916507f7d2e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:24.938737 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0c086cf-0232-4613-ab4b-5916507f7d2e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:24.956272 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0cdc6ead-017b-4cc4-8326-5c6401b1a588 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 95902b01-9a33-45e2-b454-cdab91014582] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:24:25.063839 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0cdc6ead-017b-4cc4-8326-5c6401b1a588 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "DELETE /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582" status: 204 len: 0 microversion: 2.1 time: 0.190025 Aug 31 16:24:25.068542 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3074/5965] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:24:24 2022] DELETE /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:24:25.075681 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4ea488dd-961f-4c7f-bb14-220aebe1a0d5 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:25.076888 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4ea488dd-961f-4c7f-bb14-220aebe1a0d5 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 95902b01-9a33-45e2-b454-cdab91014582] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:25.087253 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4ea488dd-961f-4c7f-bb14-220aebe1a0d5 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:25.088752 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4ea488dd-961f-4c7f-bb14-220aebe1a0d5 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:25.089379 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4ea488dd-961f-4c7f-bb14-220aebe1a0d5 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:25.090029 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b0c086cf-0232-4613-ab4b-5916507f7d2e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:25.090582 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4ea488dd-961f-4c7f-bb14-220aebe1a0d5 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:25.091379 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4ea488dd-961f-4c7f-bb14-220aebe1a0d5 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:25.091983 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4ea488dd-961f-4c7f-bb14-220aebe1a0d5 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:25.102368 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b0c086cf-0232-4613-ab4b-5916507f7d2e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286" status: 200 len: 1187 microversion: 2.1 time: 0.192667 Aug 31 16:24:25.103068 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2892/5966] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:24 2022] GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286 => generated 1187 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:25.277855 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4ea488dd-961f-4c7f-bb14-220aebe1a0d5 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:25.292609 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4ea488dd-961f-4c7f-bb14-220aebe1a0d5 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582" status: 200 len: 1680 microversion: 2.1 time: 0.222483 Aug 31 16:24:25.293197 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3075/5967] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:25 2022] GET /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582 => generated 1680 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:26.125487 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bf7ec2e6-6348-4de0-bc39-cbe419384678 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:26.127081 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bf7ec2e6-6348-4de0-bc39-cbe419384678 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 88b41d16-3908-4de0-94fe-6c3d46786286] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:26.135666 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf7ec2e6-6348-4de0-bc39-cbe419384678 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:26.136419 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf7ec2e6-6348-4de0-bc39-cbe419384678 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:26.136946 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf7ec2e6-6348-4de0-bc39-cbe419384678 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:26.138295 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf7ec2e6-6348-4de0-bc39-cbe419384678 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:26.139136 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf7ec2e6-6348-4de0-bc39-cbe419384678 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:26.139884 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf7ec2e6-6348-4de0-bc39-cbe419384678 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:26.233355 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bf7ec2e6-6348-4de0-bc39-cbe419384678 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:26.242308 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bf7ec2e6-6348-4de0-bc39-cbe419384678 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286" status: 200 len: 1187 microversion: 2.1 time: 0.121764 Aug 31 16:24:26.250566 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2893/5968] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:26 2022] GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286 => generated 1187 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:26.315044 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-797c2a26-04aa-4b86-913b-950516a60d10 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:26.316517 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-797c2a26-04aa-4b86-913b-950516a60d10 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 95902b01-9a33-45e2-b454-cdab91014582] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:26.325245 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-797c2a26-04aa-4b86-913b-950516a60d10 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:26.325997 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-797c2a26-04aa-4b86-913b-950516a60d10 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:26.326744 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-797c2a26-04aa-4b86-913b-950516a60d10 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:26.327606 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-797c2a26-04aa-4b86-913b-950516a60d10 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:26.328222 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-797c2a26-04aa-4b86-913b-950516a60d10 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:26.328805 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-797c2a26-04aa-4b86-913b-950516a60d10 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:26.527934 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-797c2a26-04aa-4b86-913b-950516a60d10 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:26.532886 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-797c2a26-04aa-4b86-913b-950516a60d10 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582" status: 200 len: 1680 microversion: 2.1 time: 0.221893 Aug 31 16:24:26.534285 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3076/5969] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:26 2022] GET /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582 => generated 1680 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:27.263949 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a73bd51f-bf5f-4540-b17f-01e1be492eec tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:27.265225 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a73bd51f-bf5f-4540-b17f-01e1be492eec tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 88b41d16-3908-4de0-94fe-6c3d46786286] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:27.286869 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a73bd51f-bf5f-4540-b17f-01e1be492eec tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:27.287634 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a73bd51f-bf5f-4540-b17f-01e1be492eec tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:27.288285 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a73bd51f-bf5f-4540-b17f-01e1be492eec tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:27.290132 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a73bd51f-bf5f-4540-b17f-01e1be492eec tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:27.290833 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a73bd51f-bf5f-4540-b17f-01e1be492eec tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:27.292253 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a73bd51f-bf5f-4540-b17f-01e1be492eec tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:27.401816 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a73bd51f-bf5f-4540-b17f-01e1be492eec tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:27.433999 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a73bd51f-bf5f-4540-b17f-01e1be492eec tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286" status: 200 len: 1187 microversion: 2.1 time: 0.174054 Aug 31 16:24:27.435348 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2894/5970] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:27 2022] GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286 => generated 1187 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:27.558780 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9052855e-8a6d-488c-bcbc-4bb3e8684a6e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:27.560747 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9052855e-8a6d-488c-bcbc-4bb3e8684a6e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 95902b01-9a33-45e2-b454-cdab91014582] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:27.584022 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9052855e-8a6d-488c-bcbc-4bb3e8684a6e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:27.584505 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9052855e-8a6d-488c-bcbc-4bb3e8684a6e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:27.588533 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9052855e-8a6d-488c-bcbc-4bb3e8684a6e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:27.589552 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9052855e-8a6d-488c-bcbc-4bb3e8684a6e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:27.590339 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9052855e-8a6d-488c-bcbc-4bb3e8684a6e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:27.591530 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9052855e-8a6d-488c-bcbc-4bb3e8684a6e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:27.889360 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9052855e-8a6d-488c-bcbc-4bb3e8684a6e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:27.910301 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9052855e-8a6d-488c-bcbc-4bb3e8684a6e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582" status: 200 len: 1680 microversion: 2.1 time: 0.353950 Aug 31 16:24:27.918343 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3077/5971] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:27 2022] GET /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582 => generated 1680 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:28.456541 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-59aa1e51-6596-41a7-a67e-531f995d30a3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:28.457183 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-59aa1e51-6596-41a7-a67e-531f995d30a3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 88b41d16-3908-4de0-94fe-6c3d46786286] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:28.480670 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-59aa1e51-6596-41a7-a67e-531f995d30a3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:28.481218 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-59aa1e51-6596-41a7-a67e-531f995d30a3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:28.481645 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-59aa1e51-6596-41a7-a67e-531f995d30a3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:28.485715 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-59aa1e51-6596-41a7-a67e-531f995d30a3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:28.486887 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-59aa1e51-6596-41a7-a67e-531f995d30a3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:28.487384 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-59aa1e51-6596-41a7-a67e-531f995d30a3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:28.733954 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-59aa1e51-6596-41a7-a67e-531f995d30a3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:28.758237 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-59aa1e51-6596-41a7-a67e-531f995d30a3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286" status: 200 len: 1187 microversion: 2.1 time: 0.305696 Aug 31 16:24:28.770879 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2895/5972] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:28 2022] GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286 => generated 1187 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:28.941485 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-befeda73-b569-42a0-ba53-c8762eed4684 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:28.942652 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-befeda73-b569-42a0-ba53-c8762eed4684 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 95902b01-9a33-45e2-b454-cdab91014582] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:28.985160 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-befeda73-b569-42a0-ba53-c8762eed4684 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:28.989677 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-befeda73-b569-42a0-ba53-c8762eed4684 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:28.995223 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-befeda73-b569-42a0-ba53-c8762eed4684 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:28.997123 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-befeda73-b569-42a0-ba53-c8762eed4684 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:28.998245 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-befeda73-b569-42a0-ba53-c8762eed4684 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:28.999489 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-befeda73-b569-42a0-ba53-c8762eed4684 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:29.246030 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-befeda73-b569-42a0-ba53-c8762eed4684 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f95e357d68d4ad4a5eedbb08b41c5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cdfdf921af4bc59c5c2fea1287b598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:29.253132 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-b54993c7-b89d-4090-a647-cea9fecd8d8d req-5c48c093-2524-4666-9dff-fd597e1e5e0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95902b01-9a33-45e2-b454-cdab91014582", "name": "network-vif-deleted", "tag": "dd5066b9-0a42-442a-8389-fda7bbc347b3"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:24:29.290536 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-befeda73-b569-42a0-ba53-c8762eed4684 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582" status: 200 len: 1613 microversion: 2.1 time: 0.353943 Aug 31 16:24:29.291598 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3078/5973] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:28 2022] GET /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582 => generated 1613 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:29.294526 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b54993c7-b89d-4090-a647-cea9fecd8d8d req-5c48c093-2524-4666-9dff-fd597e1e5e0a service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:29.295539 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b54993c7-b89d-4090-a647-cea9fecd8d8d req-5c48c093-2524-4666-9dff-fd597e1e5e0a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:29.296443 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b54993c7-b89d-4090-a647-cea9fecd8d8d req-5c48c093-2524-4666-9dff-fd597e1e5e0a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:29.315074 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-b54993c7-b89d-4090-a647-cea9fecd8d8d req-5c48c093-2524-4666-9dff-fd597e1e5e0a service nova] Creating event network-vif-deleted:dd5066b9-0a42-442a-8389-fda7bbc347b3 for instance 95902b01-9a33-45e2-b454-cdab91014582 on n-h2-833090-16 Aug 31 16:24:29.341871 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-b54993c7-b89d-4090-a647-cea9fecd8d8d req-5c48c093-2524-4666-9dff-fd597e1e5e0a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092039 Aug 31 16:24:29.344277 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2896/5974] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:24:29.791344 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-76c58095-402e-4c02-9fd9-efa41a5df2da tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:29.792214 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-76c58095-402e-4c02-9fd9-efa41a5df2da tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 88b41d16-3908-4de0-94fe-6c3d46786286] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:29.810481 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76c58095-402e-4c02-9fd9-efa41a5df2da tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:29.811349 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76c58095-402e-4c02-9fd9-efa41a5df2da tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:29.814404 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76c58095-402e-4c02-9fd9-efa41a5df2da tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:29.815854 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76c58095-402e-4c02-9fd9-efa41a5df2da tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:29.816484 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76c58095-402e-4c02-9fd9-efa41a5df2da tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:29.817121 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76c58095-402e-4c02-9fd9-efa41a5df2da tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:29.923700 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-76c58095-402e-4c02-9fd9-efa41a5df2da tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:29.941041 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-76c58095-402e-4c02-9fd9-efa41a5df2da tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286" status: 200 len: 1187 microversion: 2.1 time: 0.153729 Aug 31 16:24:29.942605 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3079/5975] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:29 2022] GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286 => generated 1187 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:30.326340 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-93e206c3-ac6c-43ad-971c-199e4b5d1d9c tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:30.328278 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-93e206c3-ac6c-43ad-971c-199e4b5d1d9c tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 95902b01-9a33-45e2-b454-cdab91014582] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:30.339102 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-93e206c3-ac6c-43ad-971c-199e4b5d1d9c tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:30.340086 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-93e206c3-ac6c-43ad-971c-199e4b5d1d9c tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:30.340772 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-93e206c3-ac6c-43ad-971c-199e4b5d1d9c tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:30.343868 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-93e206c3-ac6c-43ad-971c-199e4b5d1d9c tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:30.344781 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-93e206c3-ac6c-43ad-971c-199e4b5d1d9c tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:30.354036 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-93e206c3-ac6c-43ad-971c-199e4b5d1d9c tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:30.382766 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-93e206c3-ac6c-43ad-971c-199e4b5d1d9c tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] HTTP exception thrown: Instance 95902b01-9a33-45e2-b454-cdab91014582 could not be found. Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-93e206c3-ac6c-43ad-971c-199e4b5d1d9c tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Request method failure captured: Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582 HTTP/1.1 Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4jmnQUplwr8AbbPZFrGxW4cxkzmu6dBR1PW9StPm7lwt758HQoCfwjfTobZNcY1qtMPO8jDX-KXtXLta2nSjy7PGTgxIA8J9_334X72rGtCeQYm6RDS4nOjdET00Y60PMzSq7EOVRAdi656mkiv_ceC-3aVenrz44MCAB3Nc0UBrjk Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: c3cdfdf921af4bc59c5c2fea1287b598 Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-AttachVolumeNegativeTest-1670272717 Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c3cdfdf921af4bc59c5c2fea1287b598"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c3cdfdf921af4bc59c5c2fea1287b598"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c3cdfdf921af4bc59c5c2fea1287b598"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c3cdfdf921af4bc59c5c2fea1287b598", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-AttachVolumeNegativeTest-1670272717 Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: c3cdfdf921af4bc59c5c2fea1287b598 Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1670272717 Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-AttachVolumeNegativeTest-1670272717-project Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 6f95e357d68d4ad4a5eedbb08b41c5c1 Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-AttachVolumeNegativeTest-1670272717-project Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 95902b01-9a33-45e2-b454-cdab91014582 could not be found. Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '95902b01-9a33-45e2-b454-cdab91014582'} Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95902b01-9a33-45e2-b454-cdab91014582 could not be found. Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95902b01-9a33-45e2-b454-cdab91014582 could not be found. Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:24:30.405029 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:24:30.413833 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:30.413833 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:24:30.413833 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:24:30.413833 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:24:30.413833 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:24:30.413833 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95902b01-9a33-45e2-b454-cdab91014582 could not be found. Aug 31 16:24:30.413833 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:24:30.413833 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-93e206c3-ac6c-43ad-971c-199e4b5d1d9c tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Returning 404 to user: Instance 95902b01-9a33-45e2-b454-cdab91014582 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:24:30.413833 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-93e206c3-ac6c-43ad-971c-199e4b5d1d9c tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582" status: 404 len: 111 microversion: 2.1 time: 0.098862 Aug 31 16:24:30.417640 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2897/5976] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:30 2022] GET /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:24:30.426068 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b7aba654-58e3-4b3c-8eff-cdfc10a4740a tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '.version_select at 0x7fbb467b9dc0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:30.466633 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b7aba654-58e3-4b3c-8eff-cdfc10a4740a tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-84167743" status: 202 len: 0 microversion: 2.1 time: 0.049342 Aug 31 16:24:30.479920 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3080/5977] 10.222.0.50 () {58 vars in 1215 bytes} [Wed Aug 31 16:24:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-84167743 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:24:30.983888 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3f340a9f-dc6b-489b-9d28-9a2b8efffe4b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:30.986721 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3f340a9f-dc6b-489b-9d28-9a2b8efffe4b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 88b41d16-3908-4de0-94fe-6c3d46786286] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:31.008708 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f340a9f-dc6b-489b-9d28-9a2b8efffe4b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:31.013929 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f340a9f-dc6b-489b-9d28-9a2b8efffe4b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:31.025633 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f340a9f-dc6b-489b-9d28-9a2b8efffe4b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:31.026771 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f340a9f-dc6b-489b-9d28-9a2b8efffe4b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:31.027382 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f340a9f-dc6b-489b-9d28-9a2b8efffe4b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:31.028540 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f340a9f-dc6b-489b-9d28-9a2b8efffe4b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:31.183809 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3f340a9f-dc6b-489b-9d28-9a2b8efffe4b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:31.195183 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3f340a9f-dc6b-489b-9d28-9a2b8efffe4b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286" status: 200 len: 1187 microversion: 2.1 time: 0.233423 Aug 31 16:24:31.211519 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2898/5978] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:30 2022] GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286 => generated 1187 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:32.221269 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-db0d822e-555a-4eae-b6c2-3c6e83af1279 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:32.222525 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-db0d822e-555a-4eae-b6c2-3c6e83af1279 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 88b41d16-3908-4de0-94fe-6c3d46786286] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:32.241710 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db0d822e-555a-4eae-b6c2-3c6e83af1279 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:32.242734 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db0d822e-555a-4eae-b6c2-3c6e83af1279 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:32.244751 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db0d822e-555a-4eae-b6c2-3c6e83af1279 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:32.248036 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db0d822e-555a-4eae-b6c2-3c6e83af1279 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:32.248815 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db0d822e-555a-4eae-b6c2-3c6e83af1279 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:32.250020 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db0d822e-555a-4eae-b6c2-3c6e83af1279 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:32.388443 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-db0d822e-555a-4eae-b6c2-3c6e83af1279 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:32.400025 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-db0d822e-555a-4eae-b6c2-3c6e83af1279 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286" status: 200 len: 1187 microversion: 2.1 time: 0.186850 Aug 31 16:24:32.402466 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3081/5979] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:32 2022] GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286 => generated 1187 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:33.430415 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-54630289-1c59-4e2c-be4f-62f7ec9fde80 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:33.431959 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-54630289-1c59-4e2c-be4f-62f7ec9fde80 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 88b41d16-3908-4de0-94fe-6c3d46786286] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:33.445866 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-54630289-1c59-4e2c-be4f-62f7ec9fde80 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:33.461113 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-54630289-1c59-4e2c-be4f-62f7ec9fde80 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:33.464641 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-54630289-1c59-4e2c-be4f-62f7ec9fde80 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:33.465416 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-54630289-1c59-4e2c-be4f-62f7ec9fde80 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:33.466067 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-54630289-1c59-4e2c-be4f-62f7ec9fde80 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:33.468996 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-54630289-1c59-4e2c-be4f-62f7ec9fde80 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:33.539827 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-54630289-1c59-4e2c-be4f-62f7ec9fde80 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:33.550558 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-54630289-1c59-4e2c-be4f-62f7ec9fde80 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286" status: 200 len: 1187 microversion: 2.1 time: 0.125759 Aug 31 16:24:33.552503 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2899/5980] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:33 2022] GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286 => generated 1187 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:34.576691 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b6bd401e-631b-403f-a067-5578808ee56d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:34.577399 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b6bd401e-631b-403f-a067-5578808ee56d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 88b41d16-3908-4de0-94fe-6c3d46786286] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:34.589595 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b6bd401e-631b-403f-a067-5578808ee56d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:34.590188 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b6bd401e-631b-403f-a067-5578808ee56d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:34.598048 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b6bd401e-631b-403f-a067-5578808ee56d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:34.598048 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b6bd401e-631b-403f-a067-5578808ee56d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:34.598048 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b6bd401e-631b-403f-a067-5578808ee56d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:34.598048 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b6bd401e-631b-403f-a067-5578808ee56d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:34.630959 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b6bd401e-631b-403f-a067-5578808ee56d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:34.631412 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b6bd401e-631b-403f-a067-5578808ee56d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:34.631853 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b6bd401e-631b-403f-a067-5578808ee56d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:34.632317 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-b6bd401e-631b-403f-a067-5578808ee56d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lazy-loading 'fault' on Instance uuid 88b41d16-3908-4de0-94fe-6c3d46786286 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:24:34.687411 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b6bd401e-631b-403f-a067-5578808ee56d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:34.704737 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b6bd401e-631b-403f-a067-5578808ee56d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286" status: 200 len: 1192 microversion: 2.1 time: 0.124602 Aug 31 16:24:34.706365 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3082/5981] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:34 2022] GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286 => generated 1192 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:35.720776 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c7ba8d05-d22b-49c3-8439-d81c3e7f4db7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:35.721552 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c7ba8d05-d22b-49c3-8439-d81c3e7f4db7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 88b41d16-3908-4de0-94fe-6c3d46786286] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:35.729366 n-d-833090-16 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 16:24:35.729599 n-d-833090-16 devstack@n-api.service[128863]: Wed Aug 31 16:24:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286 (ip 10.222.0.50) !!! Aug 31 16:24:35.733031 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7ba8d05-d22b-49c3-8439-d81c3e7f4db7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:35.733479 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7ba8d05-d22b-49c3-8439-d81c3e7f4db7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:35.734003 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7ba8d05-d22b-49c3-8439-d81c3e7f4db7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:35.735519 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7ba8d05-d22b-49c3-8439-d81c3e7f4db7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:35.735519 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7ba8d05-d22b-49c3-8439-d81c3e7f4db7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:35.735762 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7ba8d05-d22b-49c3-8439-d81c3e7f4db7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:35.763432 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-c7ba8d05-d22b-49c3-8439-d81c3e7f4db7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] HTTP exception thrown: Instance 88b41d16-3908-4de0-94fe-6c3d46786286 could not be found. Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c7ba8d05-d22b-49c3-8439-d81c3e7f4db7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Request method failure captured: Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286 HTTP/1.1 Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4sA8QatsiRw58KL4D-GJAaR1X9zBGwbu0cNuaHi16Tl8K5LhZ4dthUjdeeybVrZ6FkLiuj0CnwnGa_AqwqzkMsKdZfTNQhjMqXfHtEAV5ID9oXbOsK0vGNgY-jRlE7qor7NeFM7QGwhr8KE3TJ70ugNQcxhI7ZJIKzx49vTu_Rhy18 Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 32245d85aee64f69865d98656133a539 Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-TestVolumeBootPattern-1732723367 Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/32245d85aee64f69865d98656133a539"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/32245d85aee64f69865d98656133a539"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/32245d85aee64f69865d98656133a539"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_32245d85aee64f69865d98656133a539", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-TestVolumeBootPattern-1732723367 Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 32245d85aee64f69865d98656133a539 Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TestVolumeBootPattern-1732723367 Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-TestVolumeBootPattern-1732723367-project Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: fb76a89a8b8042edb7b6aaccb4f41ead Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-TestVolumeBootPattern-1732723367-project Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 88b41d16-3908-4de0-94fe-6c3d46786286 could not be found. Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '88b41d16-3908-4de0-94fe-6c3d46786286'} Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88b41d16-3908-4de0-94fe-6c3d46786286 could not be found. Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88b41d16-3908-4de0-94fe-6c3d46786286 could not be found. Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:24:35.765216 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:24:35.771599 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:35.771599 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:24:35.771599 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:24:35.771599 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:24:35.771599 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:24:35.771599 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88b41d16-3908-4de0-94fe-6c3d46786286 could not be found. Aug 31 16:24:35.771599 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:24:35.771599 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c7ba8d05-d22b-49c3-8439-d81c3e7f4db7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Returning 404 to user: Instance 88b41d16-3908-4de0-94fe-6c3d46786286 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:24:35.771599 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c7ba8d05-d22b-49c3-8439-d81c3e7f4db7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286" status: 404 len: 111 microversion: 2.1 time: 0.051291 Aug 31 16:24:35.772344 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2900/5982] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:35 2022] GET /compute/v2.1/servers/88b41d16-3908-4de0-94fe-6c3d46786286 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:24:37.636925 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8eb39f92-bc06-4156-8d0d-b014d76b7e57 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:37.637441 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8eb39f92-bc06-4156-8d0d-b014d76b7e57 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 95902b01-9a33-45e2-b454-cdab91014582] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:37.647284 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8eb39f92-bc06-4156-8d0d-b014d76b7e57 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:37.648134 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8eb39f92-bc06-4156-8d0d-b014d76b7e57 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:37.648692 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8eb39f92-bc06-4156-8d0d-b014d76b7e57 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:37.656086 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8eb39f92-bc06-4156-8d0d-b014d76b7e57 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:37.656576 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8eb39f92-bc06-4156-8d0d-b014d76b7e57 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:37.657020 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8eb39f92-bc06-4156-8d0d-b014d76b7e57 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:37.681686 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-8eb39f92-bc06-4156-8d0d-b014d76b7e57 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] HTTP exception thrown: Instance 95902b01-9a33-45e2-b454-cdab91014582 could not be found. Aug 31 16:24:37.683473 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8eb39f92-bc06-4156-8d0d-b014d76b7e57 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Request method failure captured: Aug 31 16:24:37.683473 n-d-833090-16 devstack@n-api.service[128864]: request: DELETE /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582 HTTP/1.1 Aug 31 16:24:37.683473 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:24:37.683473 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:24:37.683473 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:24:37.683473 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:24:37.683473 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:24:37.683473 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:24:37.683473 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:24:37.683473 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:24:37.683473 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4jmnQUplwr8AbbPZFrGxW4cxkzmu6dBR1PW9StPm7lwt758HQoCfwjfTobZNcY1qtMPO8jDX-KXtXLta2nSjy7PGTgxIA8J9_334X72rGtCeQYm6RDS4nOjdET00Y60PMzSq7EOVRAdi656mkiv_ceC-3aVenrz44MCAB3Nc0UBrjk Aug 31 16:24:37.683473 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:24:37.683473 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:24:37.683473 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:24:37.683473 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:24:37.683473 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:24:37.683473 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:24:37.683473 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: c3cdfdf921af4bc59c5c2fea1287b598 Aug 31 16:24:37.683473 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-AttachVolumeNegativeTest-1670272717 Aug 31 16:24:37.683473 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:24:37.683473 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:24:37.683473 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c3cdfdf921af4bc59c5c2fea1287b598"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c3cdfdf921af4bc59c5c2fea1287b598"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c3cdfdf921af4bc59c5c2fea1287b598"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c3cdfdf921af4bc59c5c2fea1287b598", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:24:37.683473 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-AttachVolumeNegativeTest-1670272717 Aug 31 16:24:37.683473 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: c3cdfdf921af4bc59c5c2fea1287b598 Aug 31 16:24:37.683473 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1670272717 Aug 31 16:24:37.683473 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-AttachVolumeNegativeTest-1670272717-project Aug 31 16:24:37.683473 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:24:37.683473 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:24:37.683473 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 6f95e357d68d4ad4a5eedbb08b41c5c1 Aug 31 16:24:37.683473 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-AttachVolumeNegativeTest-1670272717-project Aug 31 16:24:37.683473 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:24:37.683473 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 95902b01-9a33-45e2-b454-cdab91014582 could not be found. Aug 31 16:24:37.683473 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '95902b01-9a33-45e2-b454-cdab91014582'} Aug 31 16:24:37.683473 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:24:37.683473 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:37.683473 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:24:37.683473 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:24:37.683473 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:24:37.683473 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:24:37.683473 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:24:37.683473 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:24:37.683473 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:24:37.683473 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:24:37.683473 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95902b01-9a33-45e2-b454-cdab91014582 could not be found. Aug 31 16:24:37.683473 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:24:37.683473 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:24:37.683473 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:24:37.683473 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:37.683473 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:24:37.683473 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:24:37.683473 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:24:37.683473 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:24:37.683473 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:24:37.683473 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:24:37.683473 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:24:37.683473 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:24:37.683473 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:24:37.683473 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:24:37.683473 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:24:37.683473 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:24:37.683473 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:24:37.683473 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:24:37.689047 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95902b01-9a33-45e2-b454-cdab91014582 could not be found. Aug 31 16:24:37.689047 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:24:37.689047 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:24:37.689047 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:24:37.689047 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:37.689047 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:24:37.689047 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:24:37.689047 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:24:37.689047 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:24:37.689047 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95902b01-9a33-45e2-b454-cdab91014582 could not be found. Aug 31 16:24:37.689047 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:24:37.689047 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8eb39f92-bc06-4156-8d0d-b014d76b7e57 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Returning 404 to user: Instance 95902b01-9a33-45e2-b454-cdab91014582 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:24:37.689047 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8eb39f92-bc06-4156-8d0d-b014d76b7e57 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "DELETE /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582" status: 404 len: 111 microversion: 2.1 time: 0.063569 Aug 31 16:24:37.689047 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3083/5983] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:24:37 2022] DELETE /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:24:37.694976 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-de3edb84-5677-4d77-a9f0-c38b1eb51931 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:37.695676 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-de3edb84-5677-4d77-a9f0-c38b1eb51931 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 95902b01-9a33-45e2-b454-cdab91014582] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:37.706813 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-de3edb84-5677-4d77-a9f0-c38b1eb51931 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:37.707528 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-de3edb84-5677-4d77-a9f0-c38b1eb51931 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:37.708254 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-de3edb84-5677-4d77-a9f0-c38b1eb51931 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:37.709968 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-de3edb84-5677-4d77-a9f0-c38b1eb51931 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:37.720338 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-de3edb84-5677-4d77-a9f0-c38b1eb51931 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:37.724984 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-de3edb84-5677-4d77-a9f0-c38b1eb51931 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:37.746775 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-de3edb84-5677-4d77-a9f0-c38b1eb51931 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] HTTP exception thrown: Instance 95902b01-9a33-45e2-b454-cdab91014582 could not be found. Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-de3edb84-5677-4d77-a9f0-c38b1eb51931 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Request method failure captured: Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582 HTTP/1.1 Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4jmnQUplwr8AbbPZFrGxW4cxkzmu6dBR1PW9StPm7lwt758HQoCfwjfTobZNcY1qtMPO8jDX-KXtXLta2nSjy7PGTgxIA8J9_334X72rGtCeQYm6RDS4nOjdET00Y60PMzSq7EOVRAdi656mkiv_ceC-3aVenrz44MCAB3Nc0UBrjk Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: c3cdfdf921af4bc59c5c2fea1287b598 Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-AttachVolumeNegativeTest-1670272717 Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c3cdfdf921af4bc59c5c2fea1287b598"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c3cdfdf921af4bc59c5c2fea1287b598"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c3cdfdf921af4bc59c5c2fea1287b598"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c3cdfdf921af4bc59c5c2fea1287b598", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-AttachVolumeNegativeTest-1670272717 Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: c3cdfdf921af4bc59c5c2fea1287b598 Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1670272717 Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-AttachVolumeNegativeTest-1670272717-project Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 6f95e357d68d4ad4a5eedbb08b41c5c1 Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-AttachVolumeNegativeTest-1670272717-project Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 95902b01-9a33-45e2-b454-cdab91014582 could not be found. Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '95902b01-9a33-45e2-b454-cdab91014582'} Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95902b01-9a33-45e2-b454-cdab91014582 could not be found. Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95902b01-9a33-45e2-b454-cdab91014582 could not be found. Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:24:37.749045 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:24:37.755958 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:37.755958 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:24:37.755958 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:24:37.755958 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:24:37.755958 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:24:37.755958 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95902b01-9a33-45e2-b454-cdab91014582 could not be found. Aug 31 16:24:37.755958 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:24:37.757875 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-de3edb84-5677-4d77-a9f0-c38b1eb51931 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Returning 404 to user: Instance 95902b01-9a33-45e2-b454-cdab91014582 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:24:37.759010 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-de3edb84-5677-4d77-a9f0-c38b1eb51931 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582" status: 404 len: 111 microversion: 2.1 time: 0.068614 Aug 31 16:24:37.763050 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2901/5984] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:37 2022] GET /compute/v2.1/servers/95902b01-9a33-45e2-b454-cdab91014582 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:24:37.784601 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0cb1707f-a38e-4470-bd6b-1d632f540544 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:37.789158 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0cb1707f-a38e-4470-bd6b-1d632f540544 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:37.798485 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0cb1707f-a38e-4470-bd6b-1d632f540544 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:37.799588 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0cb1707f-a38e-4470-bd6b-1d632f540544 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:37.800130 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0cb1707f-a38e-4470-bd6b-1d632f540544 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:37.801160 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0cb1707f-a38e-4470-bd6b-1d632f540544 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:37.801896 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0cb1707f-a38e-4470-bd6b-1d632f540544 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:37.802450 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0cb1707f-a38e-4470-bd6b-1d632f540544 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:37.849014 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0cb1707f-a38e-4470-bd6b-1d632f540544 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.068929 Aug 31 16:24:37.850376 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3084/5985] 10.222.0.50 () {60 vars in 1343 bytes} [Wed Aug 31 16:24:37 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:37.978199 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b61945cd-9094-4512-b02e-d7089cec055f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:37.979415 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b61945cd-9094-4512-b02e-d7089cec055f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:37.990981 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b61945cd-9094-4512-b02e-d7089cec055f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:37.992428 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b61945cd-9094-4512-b02e-d7089cec055f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:37.994015 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b61945cd-9094-4512-b02e-d7089cec055f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:37.996153 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b61945cd-9094-4512-b02e-d7089cec055f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:37.998059 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b61945cd-9094-4512-b02e-d7089cec055f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:37.998758 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b61945cd-9094-4512-b02e-d7089cec055f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:38.066336 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b61945cd-9094-4512-b02e-d7089cec055f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:24:38.235896 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b61945cd-9094-4512-b02e-d7089cec055f tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "DELETE /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 204 len: 0 microversion: 2.20 time: 0.264159 Aug 31 16:24:38.236763 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2902/5986] 10.222.0.50 () {60 vars in 1280 bytes} [Wed Aug 31 16:24:37 2022] DELETE /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 16:24:38.245979 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5667f397-28cc-4812-8717-a4b0161b68e8 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:38.246792 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5667f397-28cc-4812-8717-a4b0161b68e8 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:38.263849 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5667f397-28cc-4812-8717-a4b0161b68e8 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:38.268378 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5667f397-28cc-4812-8717-a4b0161b68e8 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:38.269494 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5667f397-28cc-4812-8717-a4b0161b68e8 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:38.271461 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5667f397-28cc-4812-8717-a4b0161b68e8 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:38.272728 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5667f397-28cc-4812-8717-a4b0161b68e8 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:38.275124 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5667f397-28cc-4812-8717-a4b0161b68e8 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:38.517295 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5667f397-28cc-4812-8717-a4b0161b68e8 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:38.536412 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5667f397-28cc-4812-8717-a4b0161b68e8 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:38.538435 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5667f397-28cc-4812-8717-a4b0161b68e8 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:38.540042 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5667f397-28cc-4812-8717-a4b0161b68e8 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1721 microversion: 2.20 time: 0.299142 Aug 31 16:24:38.554313 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3085/5987] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:24:38 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1721 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:24:39.565817 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-88d0ec7f-a819-4759-be30-931aa3dbc6e7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:39.568071 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-88d0ec7f-a819-4759-be30-931aa3dbc6e7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:39.588166 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88d0ec7f-a819-4759-be30-931aa3dbc6e7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:39.589025 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88d0ec7f-a819-4759-be30-931aa3dbc6e7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:39.589574 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88d0ec7f-a819-4759-be30-931aa3dbc6e7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:39.593714 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88d0ec7f-a819-4759-be30-931aa3dbc6e7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:39.594382 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88d0ec7f-a819-4759-be30-931aa3dbc6e7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:39.595079 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88d0ec7f-a819-4759-be30-931aa3dbc6e7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:39.679377 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:24:39.950127 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-88d0ec7f-a819-4759-be30-931aa3dbc6e7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:39.963512 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-88d0ec7f-a819-4759-be30-931aa3dbc6e7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:39.965767 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-88d0ec7f-a819-4759-be30-931aa3dbc6e7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:39.968400 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-88d0ec7f-a819-4759-be30-931aa3dbc6e7 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1721 microversion: 2.20 time: 0.408121 Aug 31 16:24:39.969643 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2903/5988] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:24:39 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1721 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 16:24:40.997191 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-11a7f9a7-e38d-4ed5-a266-74fac04a3e07 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:41.001597 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-11a7f9a7-e38d-4ed5-a266-74fac04a3e07 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:41.024210 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11a7f9a7-e38d-4ed5-a266-74fac04a3e07 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:41.027066 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11a7f9a7-e38d-4ed5-a266-74fac04a3e07 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:41.027716 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11a7f9a7-e38d-4ed5-a266-74fac04a3e07 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:41.028913 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11a7f9a7-e38d-4ed5-a266-74fac04a3e07 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:41.034320 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11a7f9a7-e38d-4ed5-a266-74fac04a3e07 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:41.034769 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11a7f9a7-e38d-4ed5-a266-74fac04a3e07 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:41.159376 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-11a7f9a7-e38d-4ed5-a266-74fac04a3e07 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:41.169230 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-11a7f9a7-e38d-4ed5-a266-74fac04a3e07 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:41.183899 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-11a7f9a7-e38d-4ed5-a266-74fac04a3e07 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:41.188794 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-11a7f9a7-e38d-4ed5-a266-74fac04a3e07 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1654 microversion: 2.20 time: 0.194344 Aug 31 16:24:41.202552 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3086/5989] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:24:40 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1654 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:24:41.868332 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-c6d4457c-049a-4229-b81d-0f42ffd03ac8 req-31015154-9dd7-4f05-92eb-9f57184af059 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42064ec8-1aec-498c-8ed7-7c1683963dae", "name": "network-vif-deleted", "tag": "8298d82a-a2b4-4bc9-b94c-40f87ac42aa3"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:24:41.909508 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c6d4457c-049a-4229-b81d-0f42ffd03ac8 req-31015154-9dd7-4f05-92eb-9f57184af059 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:41.916257 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c6d4457c-049a-4229-b81d-0f42ffd03ac8 req-31015154-9dd7-4f05-92eb-9f57184af059 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:41.916838 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c6d4457c-049a-4229-b81d-0f42ffd03ac8 req-31015154-9dd7-4f05-92eb-9f57184af059 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:41.983094 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-c6d4457c-049a-4229-b81d-0f42ffd03ac8 req-31015154-9dd7-4f05-92eb-9f57184af059 service nova] Creating event network-vif-deleted:8298d82a-a2b4-4bc9-b94c-40f87ac42aa3 for instance 42064ec8-1aec-498c-8ed7-7c1683963dae on n-h1-833090-16 Aug 31 16:24:42.022265 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-c6d4457c-049a-4229-b81d-0f42ffd03ac8 req-31015154-9dd7-4f05-92eb-9f57184af059 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161028 Aug 31 16:24:42.034230 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2904/5990] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:24:42.217607 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-51f12cfe-0fdb-4a67-ab93-a6db75b500a5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:42.219007 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-51f12cfe-0fdb-4a67-ab93-a6db75b500a5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:42.234984 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51f12cfe-0fdb-4a67-ab93-a6db75b500a5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:42.244208 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51f12cfe-0fdb-4a67-ab93-a6db75b500a5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:42.244671 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51f12cfe-0fdb-4a67-ab93-a6db75b500a5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:42.245433 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51f12cfe-0fdb-4a67-ab93-a6db75b500a5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:42.251372 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51f12cfe-0fdb-4a67-ab93-a6db75b500a5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:42.252011 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51f12cfe-0fdb-4a67-ab93-a6db75b500a5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:42.364788 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51f12cfe-0fdb-4a67-ab93-a6db75b500a5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:42.366235 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51f12cfe-0fdb-4a67-ab93-a6db75b500a5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:42.367464 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51f12cfe-0fdb-4a67-ab93-a6db75b500a5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:42.369365 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-51f12cfe-0fdb-4a67-ab93-a6db75b500a5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lazy-loading 'fault' on Instance uuid 42064ec8-1aec-498c-8ed7-7c1683963dae {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:24:42.467867 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-51f12cfe-0fdb-4a67-ab93-a6db75b500a5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:42.499074 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-51f12cfe-0fdb-4a67-ab93-a6db75b500a5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:42.504730 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-51f12cfe-0fdb-4a67-ab93-a6db75b500a5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff0a9160ffcc460fb53626cd020fc8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd90aaaaa8d224d939310546fb336b13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:42.506254 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-51f12cfe-0fdb-4a67-ab93-a6db75b500a5 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 200 len: 1371 microversion: 2.20 time: 0.293180 Aug 31 16:24:42.532425 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3087/5991] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:24:42 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 1371 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 16:24:43.539300 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-136e8b98-4c01-48c4-a85d-f0bf7da988ad tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:43.541306 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-136e8b98-4c01-48c4-a85d-f0bf7da988ad tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:43.556226 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-136e8b98-4c01-48c4-a85d-f0bf7da988ad tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:43.559020 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-136e8b98-4c01-48c4-a85d-f0bf7da988ad tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:43.561137 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-136e8b98-4c01-48c4-a85d-f0bf7da988ad tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:43.562410 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-136e8b98-4c01-48c4-a85d-f0bf7da988ad tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:43.570626 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-136e8b98-4c01-48c4-a85d-f0bf7da988ad tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:43.571424 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-136e8b98-4c01-48c4-a85d-f0bf7da988ad tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:43.602699 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-136e8b98-4c01-48c4-a85d-f0bf7da988ad tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] HTTP exception thrown: Instance 42064ec8-1aec-498c-8ed7-7c1683963dae could not be found. Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-136e8b98-4c01-48c4-a85d-f0bf7da988ad tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Request method failure captured: Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae HTTP/1.1 Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4l5U3NKSy3r-XAQdc-6l3YfT_P69zlXi5uwQe-ClIZH8iLT5hwnzXEsrelRX0UCZ_hHcx4I6Wg7kOAh1wQKWVZAXa3XRNpcczjYLIhwfWkYDi26t_SUfryN53-sghrgG-GpwLykvSwQ4FQlCc_7RM5cy0jh4SaXqtu-fmi3qnsSh1g Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: d90aaaaa8d224d939310546fb336b13a Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-44638769 Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d90aaaaa8d224d939310546fb336b13a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d90aaaaa8d224d939310546fb336b13a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d90aaaaa8d224d939310546fb336b13a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d90aaaaa8d224d939310546fb336b13a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-AttachVolumeShelveTestJSON-44638769 Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: d90aaaaa8d224d939310546fb336b13a Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-44638769 Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-AttachVolumeShelveTestJSON-44638769-project Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: ff0a9160ffcc460fb53626cd020fc8b1 Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-AttachVolumeShelveTestJSON-44638769-project Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 42064ec8-1aec-498c-8ed7-7c1683963dae could not be found. Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '42064ec8-1aec-498c-8ed7-7c1683963dae'} Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42064ec8-1aec-498c-8ed7-7c1683963dae could not be found. Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42064ec8-1aec-498c-8ed7-7c1683963dae could not be found. Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:24:43.613405 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:24:43.618719 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:24:43.618719 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:43.618719 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:24:43.618719 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:24:43.618719 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:24:43.618719 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:24:43.618719 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42064ec8-1aec-498c-8ed7-7c1683963dae could not be found. Aug 31 16:24:43.618719 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:24:43.624847 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-136e8b98-4c01-48c4-a85d-f0bf7da988ad tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Returning 404 to user: Instance 42064ec8-1aec-498c-8ed7-7c1683963dae could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:24:43.625741 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-136e8b98-4c01-48c4-a85d-f0bf7da988ad tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 404 len: 111 microversion: 2.20 time: 0.092347 Aug 31 16:24:43.626385 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2905/5992] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:24:43 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:24:43.635868 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5db5d059-0e05-4d2d-9aea-be46c2280516 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '.version_select at 0x7fbb4672bd30>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:43.681373 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5db5d059-0e05-4d2d-9aea-be46c2280516 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-203274708" status: 204 len: 0 microversion: 2.20 time: 0.049769 Aug 31 16:24:43.683023 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3088/5993] 10.222.0.50 () {60 vars in 1259 bytes} [Wed Aug 31 16:24:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-203274708 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 31 16:24:46.703337 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-81ec143b-1932-4b5f-a036-372fe0c00c39 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1221841385", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "5bb427cb-90c2-4a5d-8dcf-73ad867f2872", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "875599c9-5517-4369-96b1-87dce382c42c"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:24:46.731566 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:24:46.916951 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-81ec143b-1932-4b5f-a036-372fe0c00c39 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] validate_networks() for [('875599c9-5517-4369-96b1-87dce382c42c', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:24:47.748773 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-81ec143b-1932-4b5f-a036-372fe0c00c39 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:24:47.749418 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-81ec143b-1932-4b5f-a036-372fe0c00c39 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:24:47.749865 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-81ec143b-1932-4b5f-a036-372fe0c00c39 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:24:47.750438 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-81ec143b-1932-4b5f-a036-372fe0c00c39 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:24:47.751001 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-81ec143b-1932-4b5f-a036-372fe0c00c39 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:24:47.771216 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-81ec143b-1932-4b5f-a036-372fe0c00c39 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:47.771841 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-81ec143b-1932-4b5f-a036-372fe0c00c39 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:47.772599 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-81ec143b-1932-4b5f-a036-372fe0c00c39 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:47.773471 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-81ec143b-1932-4b5f-a036-372fe0c00c39 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:47.776322 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-81ec143b-1932-4b5f-a036-372fe0c00c39 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:47.790972 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-81ec143b-1932-4b5f-a036-372fe0c00c39 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:47.857366 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-81ec143b-1932-4b5f-a036-372fe0c00c39 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Getting quotas for project 32245d85aee64f69865d98656133a539. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:24:47.872421 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-81ec143b-1932-4b5f-a036-372fe0c00c39 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Getting quotas for user fb76a89a8b8042edb7b6aaccb4f41ead and project 32245d85aee64f69865d98656133a539. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:24:48.050081 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-81ec143b-1932-4b5f-a036-372fe0c00c39 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:24:48.054941 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-81ec143b-1932-4b5f-a036-372fe0c00c39 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 37fb9349-5468-4dd6-bab3-47f29cb99b32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5bb427cb-90c2-4a5d-8dcf-73ad867f2872',volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:24:48.305969 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-81ec143b-1932-4b5f-a036-372fe0c00c39 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.602998 Aug 31 16:24:48.306897 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2906/5994] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:24:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:24:48.319557 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fa4cac8c-9070-4f6e-87fe-d86960cea106 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:48.319557 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fa4cac8c-9070-4f6e-87fe-d86960cea106 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 37fb9349-5468-4dd6-bab3-47f29cb99b32] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:48.341035 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:24:48.442789 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-fa4cac8c-9070-4f6e-87fe-d86960cea106 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:48.451637 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fa4cac8c-9070-4f6e-87fe-d86960cea106 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32" status: 200 len: 1057 microversion: 2.1 time: 0.137651 Aug 31 16:24:48.474440 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3089/5995] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:48 2022] GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32 => generated 1057 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:49.474781 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cf7c6c21-4180-456c-b499-2ba6d70bfa20 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:49.476152 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cf7c6c21-4180-456c-b499-2ba6d70bfa20 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 37fb9349-5468-4dd6-bab3-47f29cb99b32] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:49.497664 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf7c6c21-4180-456c-b499-2ba6d70bfa20 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:49.499377 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf7c6c21-4180-456c-b499-2ba6d70bfa20 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:49.501724 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf7c6c21-4180-456c-b499-2ba6d70bfa20 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:49.506052 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf7c6c21-4180-456c-b499-2ba6d70bfa20 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:49.506982 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf7c6c21-4180-456c-b499-2ba6d70bfa20 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:49.509119 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf7c6c21-4180-456c-b499-2ba6d70bfa20 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:49.751949 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cf7c6c21-4180-456c-b499-2ba6d70bfa20 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:49.764762 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cf7c6c21-4180-456c-b499-2ba6d70bfa20 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32" status: 200 len: 1155 microversion: 2.1 time: 0.295592 Aug 31 16:24:49.765699 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2907/5996] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:49 2022] GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32 => generated 1155 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:50.170264 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-339028d1-0bf6-4975-a913-bb0267a1d988 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:50.171026 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-339028d1-0bf6-4975-a913-bb0267a1d988 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:50.189007 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-339028d1-0bf6-4975-a913-bb0267a1d988 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:50.189529 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-339028d1-0bf6-4975-a913-bb0267a1d988 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:50.189990 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-339028d1-0bf6-4975-a913-bb0267a1d988 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:50.190780 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-339028d1-0bf6-4975-a913-bb0267a1d988 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:50.191249 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-339028d1-0bf6-4975-a913-bb0267a1d988 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:50.191695 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-339028d1-0bf6-4975-a913-bb0267a1d988 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:50.235853 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-339028d1-0bf6-4975-a913-bb0267a1d988 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] HTTP exception thrown: Instance 42064ec8-1aec-498c-8ed7-7c1683963dae could not be found. Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-339028d1-0bf6-4975-a913-bb0267a1d988 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Request method failure captured: Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: request: DELETE /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae HTTP/1.1 Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4l5U3NKSy3r-XAQdc-6l3YfT_P69zlXi5uwQe-ClIZH8iLT5hwnzXEsrelRX0UCZ_hHcx4I6Wg7kOAh1wQKWVZAXa3XRNpcczjYLIhwfWkYDi26t_SUfryN53-sghrgG-GpwLykvSwQ4FQlCc_7RM5cy0jh4SaXqtu-fmi3qnsSh1g Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: d90aaaaa8d224d939310546fb336b13a Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-44638769 Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d90aaaaa8d224d939310546fb336b13a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d90aaaaa8d224d939310546fb336b13a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d90aaaaa8d224d939310546fb336b13a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d90aaaaa8d224d939310546fb336b13a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-AttachVolumeShelveTestJSON-44638769 Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: d90aaaaa8d224d939310546fb336b13a Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-44638769 Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-AttachVolumeShelveTestJSON-44638769-project Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: ff0a9160ffcc460fb53626cd020fc8b1 Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-AttachVolumeShelveTestJSON-44638769-project Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 42064ec8-1aec-498c-8ed7-7c1683963dae could not be found. Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '42064ec8-1aec-498c-8ed7-7c1683963dae'} Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42064ec8-1aec-498c-8ed7-7c1683963dae could not be found. Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:24:50.244900 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:24:50.250131 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42064ec8-1aec-498c-8ed7-7c1683963dae could not be found. Aug 31 16:24:50.250131 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:24:50.250131 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:24:50.250131 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:24:50.250131 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:50.250131 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:24:50.250131 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:24:50.250131 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:24:50.250131 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:24:50.250131 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42064ec8-1aec-498c-8ed7-7c1683963dae could not be found. Aug 31 16:24:50.250131 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:24:50.251971 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-339028d1-0bf6-4975-a913-bb0267a1d988 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Returning 404 to user: Instance 42064ec8-1aec-498c-8ed7-7c1683963dae could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:24:50.253024 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-339028d1-0bf6-4975-a913-bb0267a1d988 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "DELETE /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 404 len: 111 microversion: 2.20 time: 0.088268 Aug 31 16:24:50.254271 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3090/5997] 10.222.0.50 () {60 vars in 1280 bytes} [Wed Aug 31 16:24:50 2022] DELETE /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:24:50.263720 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fee5cacd-6ba5-419a-9d53-5e27b60783fb tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:50.264740 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fee5cacd-6ba5-419a-9d53-5e27b60783fb tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 42064ec8-1aec-498c-8ed7-7c1683963dae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:50.275983 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fee5cacd-6ba5-419a-9d53-5e27b60783fb tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:50.278193 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fee5cacd-6ba5-419a-9d53-5e27b60783fb tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:50.285050 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fee5cacd-6ba5-419a-9d53-5e27b60783fb tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:50.286579 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fee5cacd-6ba5-419a-9d53-5e27b60783fb tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:50.287953 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fee5cacd-6ba5-419a-9d53-5e27b60783fb tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:50.288715 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fee5cacd-6ba5-419a-9d53-5e27b60783fb tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:50.338017 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-fee5cacd-6ba5-419a-9d53-5e27b60783fb tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] HTTP exception thrown: Instance 42064ec8-1aec-498c-8ed7-7c1683963dae could not be found. Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fee5cacd-6ba5-419a-9d53-5e27b60783fb tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Request method failure captured: Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae HTTP/1.1 Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4l5U3NKSy3r-XAQdc-6l3YfT_P69zlXi5uwQe-ClIZH8iLT5hwnzXEsrelRX0UCZ_hHcx4I6Wg7kOAh1wQKWVZAXa3XRNpcczjYLIhwfWkYDi26t_SUfryN53-sghrgG-GpwLykvSwQ4FQlCc_7RM5cy0jh4SaXqtu-fmi3qnsSh1g Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: d90aaaaa8d224d939310546fb336b13a Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-44638769 Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d90aaaaa8d224d939310546fb336b13a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d90aaaaa8d224d939310546fb336b13a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d90aaaaa8d224d939310546fb336b13a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d90aaaaa8d224d939310546fb336b13a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-AttachVolumeShelveTestJSON-44638769 Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: d90aaaaa8d224d939310546fb336b13a Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-44638769 Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-AttachVolumeShelveTestJSON-44638769-project Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: ff0a9160ffcc460fb53626cd020fc8b1 Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-AttachVolumeShelveTestJSON-44638769-project Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 42064ec8-1aec-498c-8ed7-7c1683963dae could not be found. Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '42064ec8-1aec-498c-8ed7-7c1683963dae'} Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42064ec8-1aec-498c-8ed7-7c1683963dae could not be found. Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42064ec8-1aec-498c-8ed7-7c1683963dae could not be found. Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:24:50.339823 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:24:50.346847 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:24:50.346847 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:50.346847 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:24:50.346847 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:24:50.346847 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:24:50.346847 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:24:50.346847 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42064ec8-1aec-498c-8ed7-7c1683963dae could not be found. Aug 31 16:24:50.346847 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:24:50.346847 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fee5cacd-6ba5-419a-9d53-5e27b60783fb tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Returning 404 to user: Instance 42064ec8-1aec-498c-8ed7-7c1683963dae could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:24:50.346847 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fee5cacd-6ba5-419a-9d53-5e27b60783fb tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae" status: 404 len: 111 microversion: 2.20 time: 0.082592 Aug 31 16:24:50.346847 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2908/5998] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:24:50 2022] GET /compute/v2.1/servers/42064ec8-1aec-498c-8ed7-7c1683963dae => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:24:50.789985 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7f037603-e4e8-4602-9412-4cbf07599119 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:50.790683 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7f037603-e4e8-4602-9412-4cbf07599119 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 37fb9349-5468-4dd6-bab3-47f29cb99b32] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:50.805184 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f037603-e4e8-4602-9412-4cbf07599119 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:50.810195 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f037603-e4e8-4602-9412-4cbf07599119 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:50.810764 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f037603-e4e8-4602-9412-4cbf07599119 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:50.828108 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f037603-e4e8-4602-9412-4cbf07599119 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:50.828842 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f037603-e4e8-4602-9412-4cbf07599119 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:50.831527 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f037603-e4e8-4602-9412-4cbf07599119 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:51.109211 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7f037603-e4e8-4602-9412-4cbf07599119 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:51.118799 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7f037603-e4e8-4602-9412-4cbf07599119 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32" status: 200 len: 1173 microversion: 2.1 time: 0.333089 Aug 31 16:24:51.129524 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3091/5999] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:50 2022] GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32 => generated 1173 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:51.745522 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c429a044-e4ee-4e11-8903-ffb266d89b62 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:51.749462 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c429a044-e4ee-4e11-8903-ffb266d89b62 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 91900503-1200-4e0c-9531-19f602773721] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:51.773357 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c429a044-e4ee-4e11-8903-ffb266d89b62 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:51.780076 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c429a044-e4ee-4e11-8903-ffb266d89b62 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:51.785600 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c429a044-e4ee-4e11-8903-ffb266d89b62 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:51.788054 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c429a044-e4ee-4e11-8903-ffb266d89b62 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:51.792276 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c429a044-e4ee-4e11-8903-ffb266d89b62 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:51.794864 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c429a044-e4ee-4e11-8903-ffb266d89b62 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:51.855225 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-c429a044-e4ee-4e11-8903-ffb266d89b62 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] HTTP exception thrown: Instance 91900503-1200-4e0c-9531-19f602773721 could not be found. Aug 31 16:24:51.856974 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c429a044-e4ee-4e11-8903-ffb266d89b62 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Request method failure captured: Aug 31 16:24:51.856974 n-d-833090-16 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721 HTTP/1.1 Aug 31 16:24:51.856974 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:24:51.856974 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:24:51.856974 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:24:51.856974 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:24:51.856974 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:24:51.856974 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:24:51.856974 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:24:51.856974 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:24:51.856974 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4jmnQUplwr8AbbPZFrGxW4cxkzmu6dBR1PW9StPm7lwt758HQoCfwjfTobZNcY1qtMPO8jDX-KXtXLta2nSjy7PGTgxIA8J9_334X72rGtCeQYm6RDS4nOjdET00Y60PMzSq7EOVRAdi656mkiv_ceC-3aVenrz44MCAB3Nc0UBrjk Aug 31 16:24:51.856974 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:24:51.856974 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:24:51.856974 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:24:51.856974 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:24:51.856974 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:24:51.856974 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:24:51.856974 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: c3cdfdf921af4bc59c5c2fea1287b598 Aug 31 16:24:51.856974 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-AttachVolumeNegativeTest-1670272717 Aug 31 16:24:51.856974 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:24:51.856974 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:24:51.856974 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c3cdfdf921af4bc59c5c2fea1287b598"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c3cdfdf921af4bc59c5c2fea1287b598"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c3cdfdf921af4bc59c5c2fea1287b598"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c3cdfdf921af4bc59c5c2fea1287b598", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:24:51.856974 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-AttachVolumeNegativeTest-1670272717 Aug 31 16:24:51.856974 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: c3cdfdf921af4bc59c5c2fea1287b598 Aug 31 16:24:51.856974 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1670272717 Aug 31 16:24:51.856974 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-AttachVolumeNegativeTest-1670272717-project Aug 31 16:24:51.856974 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:24:51.856974 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:24:51.856974 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 6f95e357d68d4ad4a5eedbb08b41c5c1 Aug 31 16:24:51.856974 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-AttachVolumeNegativeTest-1670272717-project Aug 31 16:24:51.856974 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:24:51.856974 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 91900503-1200-4e0c-9531-19f602773721 could not be found. Aug 31 16:24:51.856974 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '91900503-1200-4e0c-9531-19f602773721'} Aug 31 16:24:51.856974 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:24:51.856974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:51.856974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:24:51.856974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:24:51.856974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:24:51.856974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:24:51.856974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:24:51.856974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:24:51.856974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:24:51.856974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:24:51.856974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91900503-1200-4e0c-9531-19f602773721 could not be found. Aug 31 16:24:51.856974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:24:51.856974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:24:51.856974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:24:51.856974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:51.856974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:24:51.856974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:24:51.856974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:24:51.856974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:24:51.856974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:24:51.856974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:24:51.856974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:24:51.856974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:24:51.856974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:24:51.856974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:24:51.856974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:24:51.856974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:24:51.856974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:24:51.856974 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:24:51.866071 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91900503-1200-4e0c-9531-19f602773721 could not be found. Aug 31 16:24:51.866071 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:24:51.866071 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:24:51.866071 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:24:51.866071 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:51.866071 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:24:51.866071 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:24:51.866071 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:24:51.866071 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:24:51.866071 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91900503-1200-4e0c-9531-19f602773721 could not be found. Aug 31 16:24:51.866071 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:24:51.866071 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c429a044-e4ee-4e11-8903-ffb266d89b62 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Returning 404 to user: Instance 91900503-1200-4e0c-9531-19f602773721 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:24:51.869291 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c429a044-e4ee-4e11-8903-ffb266d89b62 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "DELETE /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721" status: 404 len: 111 microversion: 2.1 time: 0.121714 Aug 31 16:24:51.884279 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-dfd0dc7d-6cff-4a1a-ae8d-a24f5b9d227e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:51.889482 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-dfd0dc7d-6cff-4a1a-ae8d-a24f5b9d227e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 91900503-1200-4e0c-9531-19f602773721] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:51.891168 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2909/6000] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:24:51 2022] DELETE /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721 => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:24:51.918276 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dfd0dc7d-6cff-4a1a-ae8d-a24f5b9d227e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:51.926693 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dfd0dc7d-6cff-4a1a-ae8d-a24f5b9d227e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:51.927521 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dfd0dc7d-6cff-4a1a-ae8d-a24f5b9d227e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:51.935386 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dfd0dc7d-6cff-4a1a-ae8d-a24f5b9d227e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:51.939224 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dfd0dc7d-6cff-4a1a-ae8d-a24f5b9d227e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:51.939710 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dfd0dc7d-6cff-4a1a-ae8d-a24f5b9d227e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:51.992569 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-dfd0dc7d-6cff-4a1a-ae8d-a24f5b9d227e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] HTTP exception thrown: Instance 91900503-1200-4e0c-9531-19f602773721 could not be found. Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-dfd0dc7d-6cff-4a1a-ae8d-a24f5b9d227e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Request method failure captured: Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721 HTTP/1.1 Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4jmnQUplwr8AbbPZFrGxW4cxkzmu6dBR1PW9StPm7lwt758HQoCfwjfTobZNcY1qtMPO8jDX-KXtXLta2nSjy7PGTgxIA8J9_334X72rGtCeQYm6RDS4nOjdET00Y60PMzSq7EOVRAdi656mkiv_ceC-3aVenrz44MCAB3Nc0UBrjk Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: c3cdfdf921af4bc59c5c2fea1287b598 Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-AttachVolumeNegativeTest-1670272717 Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c3cdfdf921af4bc59c5c2fea1287b598"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c3cdfdf921af4bc59c5c2fea1287b598"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c3cdfdf921af4bc59c5c2fea1287b598"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c3cdfdf921af4bc59c5c2fea1287b598", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-AttachVolumeNegativeTest-1670272717 Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: c3cdfdf921af4bc59c5c2fea1287b598 Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1670272717 Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-AttachVolumeNegativeTest-1670272717-project Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 6f95e357d68d4ad4a5eedbb08b41c5c1 Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-AttachVolumeNegativeTest-1670272717-project Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 91900503-1200-4e0c-9531-19f602773721 could not be found. Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '91900503-1200-4e0c-9531-19f602773721'} Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91900503-1200-4e0c-9531-19f602773721 could not be found. Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91900503-1200-4e0c-9531-19f602773721 could not be found. Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:24:52.001667 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:24:52.006476 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:52.006476 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:24:52.006476 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:24:52.006476 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:24:52.006476 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:24:52.006476 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91900503-1200-4e0c-9531-19f602773721 could not be found. Aug 31 16:24:52.006476 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:24:52.006476 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-dfd0dc7d-6cff-4a1a-ae8d-a24f5b9d227e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Returning 404 to user: Instance 91900503-1200-4e0c-9531-19f602773721 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:24:52.006476 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-dfd0dc7d-6cff-4a1a-ae8d-a24f5b9d227e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721" status: 404 len: 111 microversion: 2.1 time: 0.126808 Aug 31 16:24:52.012751 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-28fc37d7-a560-49fd-9546-e7f5e6a61a99 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:52.013257 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-28fc37d7-a560-49fd-9546-e7f5e6a61a99 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 3e00e521-84f5-4e7b-8cec-7a4d2e220d28] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:52.029151 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3092/6001] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:51 2022] GET /compute/v2.1/servers/91900503-1200-4e0c-9531-19f602773721 => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:24:52.030977 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28fc37d7-a560-49fd-9546-e7f5e6a61a99 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:52.032354 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28fc37d7-a560-49fd-9546-e7f5e6a61a99 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:52.033613 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28fc37d7-a560-49fd-9546-e7f5e6a61a99 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:52.035264 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28fc37d7-a560-49fd-9546-e7f5e6a61a99 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:52.036338 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28fc37d7-a560-49fd-9546-e7f5e6a61a99 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:52.037342 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28fc37d7-a560-49fd-9546-e7f5e6a61a99 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:52.084213 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-28fc37d7-a560-49fd-9546-e7f5e6a61a99 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] HTTP exception thrown: Instance 3e00e521-84f5-4e7b-8cec-7a4d2e220d28 could not be found. Aug 31 16:24:52.091446 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-28fc37d7-a560-49fd-9546-e7f5e6a61a99 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Request method failure captured: Aug 31 16:24:52.091446 n-d-833090-16 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/3e00e521-84f5-4e7b-8cec-7a4d2e220d28 HTTP/1.1 Aug 31 16:24:52.091446 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:24:52.091446 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:24:52.091446 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:24:52.091446 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:24:52.091446 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:24:52.091446 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:24:52.091446 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:24:52.091446 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:24:52.091446 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4jmnQUplwr8AbbPZFrGxW4cxkzmu6dBR1PW9StPm7lwt758HQoCfwjfTobZNcY1qtMPO8jDX-KXtXLta2nSjy7PGTgxIA8J9_334X72rGtCeQYm6RDS4nOjdET00Y60PMzSq7EOVRAdi656mkiv_ceC-3aVenrz44MCAB3Nc0UBrjk Aug 31 16:24:52.091446 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:24:52.091446 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:24:52.091446 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:24:52.091446 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:24:52.091446 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:24:52.091446 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:24:52.091446 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: c3cdfdf921af4bc59c5c2fea1287b598 Aug 31 16:24:52.091446 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-AttachVolumeNegativeTest-1670272717 Aug 31 16:24:52.091446 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:24:52.091446 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:24:52.091446 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c3cdfdf921af4bc59c5c2fea1287b598"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c3cdfdf921af4bc59c5c2fea1287b598"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c3cdfdf921af4bc59c5c2fea1287b598"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c3cdfdf921af4bc59c5c2fea1287b598", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:24:52.091446 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-AttachVolumeNegativeTest-1670272717 Aug 31 16:24:52.091446 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: c3cdfdf921af4bc59c5c2fea1287b598 Aug 31 16:24:52.091446 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1670272717 Aug 31 16:24:52.091446 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-AttachVolumeNegativeTest-1670272717-project Aug 31 16:24:52.091446 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:24:52.091446 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:24:52.091446 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 6f95e357d68d4ad4a5eedbb08b41c5c1 Aug 31 16:24:52.091446 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-AttachVolumeNegativeTest-1670272717-project Aug 31 16:24:52.091446 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:24:52.091446 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 3e00e521-84f5-4e7b-8cec-7a4d2e220d28 could not be found. Aug 31 16:24:52.091446 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '3e00e521-84f5-4e7b-8cec-7a4d2e220d28'} Aug 31 16:24:52.091446 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:24:52.091446 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:52.091446 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:24:52.091446 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:24:52.091446 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:24:52.091446 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:24:52.091446 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:24:52.091446 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:24:52.091446 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:24:52.091446 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:24:52.091446 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e00e521-84f5-4e7b-8cec-7a4d2e220d28 could not be found. Aug 31 16:24:52.091446 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:24:52.091446 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:24:52.091446 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:24:52.091446 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:52.091446 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:24:52.091446 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:24:52.091446 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:24:52.091446 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:24:52.091446 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:24:52.091446 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:24:52.091446 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:24:52.091446 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:24:52.091446 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:24:52.091446 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:24:52.091446 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:24:52.091446 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:24:52.091446 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:24:52.091446 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:24:52.096669 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e00e521-84f5-4e7b-8cec-7a4d2e220d28 could not be found. Aug 31 16:24:52.096669 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:24:52.096669 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:24:52.096669 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:24:52.096669 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:52.096669 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:24:52.096669 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:24:52.096669 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:24:52.096669 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:24:52.096669 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e00e521-84f5-4e7b-8cec-7a4d2e220d28 could not be found. Aug 31 16:24:52.096669 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:24:52.099765 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-28fc37d7-a560-49fd-9546-e7f5e6a61a99 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Returning 404 to user: Instance 3e00e521-84f5-4e7b-8cec-7a4d2e220d28 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:24:52.103268 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-28fc37d7-a560-49fd-9546-e7f5e6a61a99 tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3e00e521-84f5-4e7b-8cec-7a4d2e220d28" status: 404 len: 111 microversion: 2.1 time: 0.092950 Aug 31 16:24:52.104376 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2910/6002] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:24:52 2022] DELETE /compute/v2.1/servers/3e00e521-84f5-4e7b-8cec-7a4d2e220d28 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:24:52.114507 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8ecc4d80-72c5-4c39-ab89-ba61c9d4090e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:52.115405 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8ecc4d80-72c5-4c39-ab89-ba61c9d4090e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 3e00e521-84f5-4e7b-8cec-7a4d2e220d28] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:52.127298 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8ecc4d80-72c5-4c39-ab89-ba61c9d4090e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:52.128086 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8ecc4d80-72c5-4c39-ab89-ba61c9d4090e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:52.131398 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8ecc4d80-72c5-4c39-ab89-ba61c9d4090e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:52.132341 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8ecc4d80-72c5-4c39-ab89-ba61c9d4090e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:52.132971 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8ecc4d80-72c5-4c39-ab89-ba61c9d4090e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:52.137136 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8ecc4d80-72c5-4c39-ab89-ba61c9d4090e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:52.152431 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-639f5a00-97c4-457e-a64b-369f5c17da0c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:52.153438 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-639f5a00-97c4-457e-a64b-369f5c17da0c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 37fb9349-5468-4dd6-bab3-47f29cb99b32] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:52.165159 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-639f5a00-97c4-457e-a64b-369f5c17da0c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:52.177225 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-639f5a00-97c4-457e-a64b-369f5c17da0c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:52.177689 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-639f5a00-97c4-457e-a64b-369f5c17da0c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:52.179301 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-639f5a00-97c4-457e-a64b-369f5c17da0c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:52.179777 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-639f5a00-97c4-457e-a64b-369f5c17da0c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:52.180204 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-639f5a00-97c4-457e-a64b-369f5c17da0c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:52.185111 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:24:52.190421 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-8ecc4d80-72c5-4c39-ab89-ba61c9d4090e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] HTTP exception thrown: Instance 3e00e521-84f5-4e7b-8cec-7a4d2e220d28 could not be found. Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8ecc4d80-72c5-4c39-ab89-ba61c9d4090e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Request method failure captured: Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/3e00e521-84f5-4e7b-8cec-7a4d2e220d28 HTTP/1.1 Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4jmnQUplwr8AbbPZFrGxW4cxkzmu6dBR1PW9StPm7lwt758HQoCfwjfTobZNcY1qtMPO8jDX-KXtXLta2nSjy7PGTgxIA8J9_334X72rGtCeQYm6RDS4nOjdET00Y60PMzSq7EOVRAdi656mkiv_ceC-3aVenrz44MCAB3Nc0UBrjk Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: c3cdfdf921af4bc59c5c2fea1287b598 Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-AttachVolumeNegativeTest-1670272717 Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c3cdfdf921af4bc59c5c2fea1287b598"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c3cdfdf921af4bc59c5c2fea1287b598"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c3cdfdf921af4bc59c5c2fea1287b598"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c3cdfdf921af4bc59c5c2fea1287b598", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-AttachVolumeNegativeTest-1670272717 Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: c3cdfdf921af4bc59c5c2fea1287b598 Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1670272717 Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-AttachVolumeNegativeTest-1670272717-project Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 6f95e357d68d4ad4a5eedbb08b41c5c1 Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-AttachVolumeNegativeTest-1670272717-project Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 3e00e521-84f5-4e7b-8cec-7a4d2e220d28 could not be found. Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '3e00e521-84f5-4e7b-8cec-7a4d2e220d28'} Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e00e521-84f5-4e7b-8cec-7a4d2e220d28 could not be found. Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e00e521-84f5-4e7b-8cec-7a4d2e220d28 could not be found. Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:24:52.193840 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:24:52.202155 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:52.202155 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:24:52.202155 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:24:52.202155 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:24:52.202155 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:24:52.202155 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e00e521-84f5-4e7b-8cec-7a4d2e220d28 could not be found. Aug 31 16:24:52.202155 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:24:52.210229 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8ecc4d80-72c5-4c39-ab89-ba61c9d4090e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Returning 404 to user: Instance 3e00e521-84f5-4e7b-8cec-7a4d2e220d28 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:24:52.211644 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8ecc4d80-72c5-4c39-ab89-ba61c9d4090e tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/3e00e521-84f5-4e7b-8cec-7a4d2e220d28" status: 404 len: 111 microversion: 2.1 time: 0.101761 Aug 31 16:24:52.212515 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3093/6003] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:52 2022] GET /compute/v2.1/servers/3e00e521-84f5-4e7b-8cec-7a4d2e220d28 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:24:52.624027 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-639f5a00-97c4-457e-a64b-369f5c17da0c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:52.636187 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-639f5a00-97c4-457e-a64b-369f5c17da0c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32" status: 200 len: 1215 microversion: 2.1 time: 0.485630 Aug 31 16:24:52.639480 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2911/6004] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:52 2022] GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32 => generated 1215 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:53.671203 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5931da57-5373-4cfb-ba75-f56362ed89cb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:53.672514 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5931da57-5373-4cfb-ba75-f56362ed89cb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 37fb9349-5468-4dd6-bab3-47f29cb99b32] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:53.701835 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5931da57-5373-4cfb-ba75-f56362ed89cb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:53.705122 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5931da57-5373-4cfb-ba75-f56362ed89cb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:53.706675 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5931da57-5373-4cfb-ba75-f56362ed89cb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:53.707441 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5931da57-5373-4cfb-ba75-f56362ed89cb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:53.709059 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5931da57-5373-4cfb-ba75-f56362ed89cb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:53.710175 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5931da57-5373-4cfb-ba75-f56362ed89cb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:53.969490 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-e8a40175-188e-4afc-96c5-e8911ea1b504 req-4ddc0774-2904-4ef7-a159-382ba29cf754 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37fb9349-5468-4dd6-bab3-47f29cb99b32", "tag": "7608c4e5-e798-4d4a-b97a-4d336d5a3792"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:24:54.009317 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e8a40175-188e-4afc-96c5-e8911ea1b504 req-4ddc0774-2904-4ef7-a159-382ba29cf754 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:54.009817 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e8a40175-188e-4afc-96c5-e8911ea1b504 req-4ddc0774-2904-4ef7-a159-382ba29cf754 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:54.010488 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e8a40175-188e-4afc-96c5-e8911ea1b504 req-4ddc0774-2904-4ef7-a159-382ba29cf754 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:54.056132 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-e8a40175-188e-4afc-96c5-e8911ea1b504 req-4ddc0774-2904-4ef7-a159-382ba29cf754 service nova] Creating event network-changed:7608c4e5-e798-4d4a-b97a-4d336d5a3792 for instance 37fb9349-5468-4dd6-bab3-47f29cb99b32 on n-h1-833090-16 Aug 31 16:24:54.069526 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-e8a40175-188e-4afc-96c5-e8911ea1b504 req-4ddc0774-2904-4ef7-a159-382ba29cf754 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103748 Aug 31 16:24:54.074622 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2912/6005] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:24:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:24:54.121032 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5931da57-5373-4cfb-ba75-f56362ed89cb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:54.130676 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5931da57-5373-4cfb-ba75-f56362ed89cb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32" status: 200 len: 1215 microversion: 2.1 time: 0.463695 Aug 31 16:24:54.144766 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3094/6006] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:53 2022] GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32 => generated 1215 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:55.154546 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8321a72a-faf0-47ac-a23f-09b46be77c66 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:55.156676 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8321a72a-faf0-47ac-a23f-09b46be77c66 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 37fb9349-5468-4dd6-bab3-47f29cb99b32] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:55.169665 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8321a72a-faf0-47ac-a23f-09b46be77c66 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:55.170653 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8321a72a-faf0-47ac-a23f-09b46be77c66 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:55.182213 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8321a72a-faf0-47ac-a23f-09b46be77c66 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:55.191049 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8321a72a-faf0-47ac-a23f-09b46be77c66 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:55.191783 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8321a72a-faf0-47ac-a23f-09b46be77c66 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:55.192391 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8321a72a-faf0-47ac-a23f-09b46be77c66 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:55.979592 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8321a72a-faf0-47ac-a23f-09b46be77c66 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:56.015631 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8321a72a-faf0-47ac-a23f-09b46be77c66 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32" status: 200 len: 1215 microversion: 2.1 time: 0.860453 Aug 31 16:24:56.018733 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2913/6007] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:55 2022] GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32 => generated 1215 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:57.038110 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-62f181b2-8d57-49de-aa33-02d1e00bdb5f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:57.038780 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-62f181b2-8d57-49de-aa33-02d1e00bdb5f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 37fb9349-5468-4dd6-bab3-47f29cb99b32] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:57.051993 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-62f181b2-8d57-49de-aa33-02d1e00bdb5f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:57.052502 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-62f181b2-8d57-49de-aa33-02d1e00bdb5f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:57.052939 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-62f181b2-8d57-49de-aa33-02d1e00bdb5f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:57.056700 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-62f181b2-8d57-49de-aa33-02d1e00bdb5f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:57.057995 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-62f181b2-8d57-49de-aa33-02d1e00bdb5f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:57.058658 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-62f181b2-8d57-49de-aa33-02d1e00bdb5f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:57.328714 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-62f181b2-8d57-49de-aa33-02d1e00bdb5f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:57.343388 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-62f181b2-8d57-49de-aa33-02d1e00bdb5f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32" status: 200 len: 1215 microversion: 2.1 time: 0.310028 Aug 31 16:24:57.344218 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3095/6008] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:57 2022] GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32 => generated 1215 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:57.666909 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-262fbba6-576f-4556-b7b2-3ffcc60f932e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:57.667495 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-262fbba6-576f-4556-b7b2-3ffcc60f932e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:57.681556 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-262fbba6-576f-4556-b7b2-3ffcc60f932e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:57.682056 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-262fbba6-576f-4556-b7b2-3ffcc60f932e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:57.684413 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-262fbba6-576f-4556-b7b2-3ffcc60f932e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:57.685148 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-262fbba6-576f-4556-b7b2-3ffcc60f932e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:57.685614 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-262fbba6-576f-4556-b7b2-3ffcc60f932e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:57.686556 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-262fbba6-576f-4556-b7b2-3ffcc60f932e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:57.716264 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-262fbba6-576f-4556-b7b2-3ffcc60f932e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] HTTP exception thrown: Instance 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d could not be found. Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-262fbba6-576f-4556-b7b2-3ffcc60f932e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Request method failure captured: Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d HTTP/1.1 Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4l5U3NKSy3r-XAQdc-6l3YfT_P69zlXi5uwQe-ClIZH8iLT5hwnzXEsrelRX0UCZ_hHcx4I6Wg7kOAh1wQKWVZAXa3XRNpcczjYLIhwfWkYDi26t_SUfryN53-sghrgG-GpwLykvSwQ4FQlCc_7RM5cy0jh4SaXqtu-fmi3qnsSh1g Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: d90aaaaa8d224d939310546fb336b13a Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-44638769 Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d90aaaaa8d224d939310546fb336b13a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d90aaaaa8d224d939310546fb336b13a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d90aaaaa8d224d939310546fb336b13a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d90aaaaa8d224d939310546fb336b13a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-AttachVolumeShelveTestJSON-44638769 Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: d90aaaaa8d224d939310546fb336b13a Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-44638769 Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-AttachVolumeShelveTestJSON-44638769-project Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: ff0a9160ffcc460fb53626cd020fc8b1 Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-AttachVolumeShelveTestJSON-44638769-project Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d could not be found. Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d'} Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d could not be found. Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:24:57.717915 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:24:57.724179 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d could not be found. Aug 31 16:24:57.724179 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:24:57.724179 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:24:57.724179 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:24:57.724179 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:57.724179 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:24:57.724179 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:24:57.724179 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:24:57.724179 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:24:57.724179 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d could not be found. Aug 31 16:24:57.724179 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:24:57.724179 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-262fbba6-576f-4556-b7b2-3ffcc60f932e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Returning 404 to user: Instance 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:24:57.724179 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-262fbba6-576f-4556-b7b2-3ffcc60f932e tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "DELETE /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 404 len: 111 microversion: 2.20 time: 0.056675 Aug 31 16:24:57.724179 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2914/6009] 10.222.0.50 () {60 vars in 1280 bytes} [Wed Aug 31 16:24:57 2022] DELETE /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:24:57.728509 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-32e222f5-1cab-41ff-b04f-253dd9e91f23 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:57.729127 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-32e222f5-1cab-41ff-b04f-253dd9e91f23 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] [instance: 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:57.735907 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-32e222f5-1cab-41ff-b04f-253dd9e91f23 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:57.736406 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-32e222f5-1cab-41ff-b04f-253dd9e91f23 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:57.736834 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-32e222f5-1cab-41ff-b04f-253dd9e91f23 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:57.737793 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-32e222f5-1cab-41ff-b04f-253dd9e91f23 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:57.749314 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-32e222f5-1cab-41ff-b04f-253dd9e91f23 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:57.749790 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-32e222f5-1cab-41ff-b04f-253dd9e91f23 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:57.795766 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-32e222f5-1cab-41ff-b04f-253dd9e91f23 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] HTTP exception thrown: Instance 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d could not be found. Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-32e222f5-1cab-41ff-b04f-253dd9e91f23 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Request method failure captured: Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d HTTP/1.1 Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4l5U3NKSy3r-XAQdc-6l3YfT_P69zlXi5uwQe-ClIZH8iLT5hwnzXEsrelRX0UCZ_hHcx4I6Wg7kOAh1wQKWVZAXa3XRNpcczjYLIhwfWkYDi26t_SUfryN53-sghrgG-GpwLykvSwQ4FQlCc_7RM5cy0jh4SaXqtu-fmi3qnsSh1g Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: X-Openstack-Nova-Api-Version: 2.20 Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: d90aaaaa8d224d939310546fb336b13a Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-44638769 Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d90aaaaa8d224d939310546fb336b13a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d90aaaaa8d224d939310546fb336b13a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d90aaaaa8d224d939310546fb336b13a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d90aaaaa8d224d939310546fb336b13a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-AttachVolumeShelveTestJSON-44638769 Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: d90aaaaa8d224d939310546fb336b13a Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-44638769 Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-AttachVolumeShelveTestJSON-44638769-project Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: ff0a9160ffcc460fb53626cd020fc8b1 Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-AttachVolumeShelveTestJSON-44638769-project Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d could not be found. Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d'} Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d could not be found. Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d could not be found. Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:24:57.797687 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:24:57.805924 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:24:57.805924 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:24:57.805924 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:24:57.805924 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:24:57.805924 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:24:57.805924 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:24:57.805924 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d could not be found. Aug 31 16:24:57.805924 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:24:57.808768 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-32e222f5-1cab-41ff-b04f-253dd9e91f23 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] Returning 404 to user: Instance 79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:24:57.813869 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-32e222f5-1cab-41ff-b04f-253dd9e91f23 tempest-AttachVolumeShelveTestJSON-44638769 tempest-AttachVolumeShelveTestJSON-44638769-project] 10.222.0.50 "GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d" status: 404 len: 111 microversion: 2.20 time: 0.085853 Aug 31 16:24:57.815898 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3096/6010] 10.222.0.50 () {60 vars in 1277 bytes} [Wed Aug 31 16:24:57 2022] GET /compute/v2.1/servers/79a6fcb1-3aa4-4d1b-9ace-05d2b6bc349d => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:24:58.365955 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c11f607a-2a19-41c2-abba-a5e6df41a5aa tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:58.366607 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c11f607a-2a19-41c2-abba-a5e6df41a5aa tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 37fb9349-5468-4dd6-bab3-47f29cb99b32] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:24:58.381921 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:24:58.382743 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:24:58.384375 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c11f607a-2a19-41c2-abba-a5e6df41a5aa tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:58.384968 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c11f607a-2a19-41c2-abba-a5e6df41a5aa tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:58.385323 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c11f607a-2a19-41c2-abba-a5e6df41a5aa tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:58.385993 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c11f607a-2a19-41c2-abba-a5e6df41a5aa tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:24:58.386470 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c11f607a-2a19-41c2-abba-a5e6df41a5aa tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:24:58.386896 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c11f607a-2a19-41c2-abba-a5e6df41a5aa tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:24:58.932988 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c11f607a-2a19-41c2-abba-a5e6df41a5aa tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:24:58.944535 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c11f607a-2a19-41c2-abba-a5e6df41a5aa tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32" status: 200 len: 1215 microversion: 2.1 time: 0.582602 Aug 31 16:24:58.945614 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2915/6011] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:58 2022] GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32 => generated 1215 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:24:59.985048 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-989caa3d-8586-4697-bce3-f010e5dc963b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:24:59.991539 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-989caa3d-8586-4697-bce3-f010e5dc963b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 37fb9349-5468-4dd6-bab3-47f29cb99b32] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:00.009181 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:25:00.017642 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-989caa3d-8586-4697-bce3-f010e5dc963b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:00.020886 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-989caa3d-8586-4697-bce3-f010e5dc963b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:00.023159 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-989caa3d-8586-4697-bce3-f010e5dc963b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:00.025636 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-989caa3d-8586-4697-bce3-f010e5dc963b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:00.027296 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-989caa3d-8586-4697-bce3-f010e5dc963b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:00.029240 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-989caa3d-8586-4697-bce3-f010e5dc963b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:01.388671 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-989caa3d-8586-4697-bce3-f010e5dc963b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:01.422392 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-989caa3d-8586-4697-bce3-f010e5dc963b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32" status: 200 len: 1215 microversion: 2.1 time: 1.452334 Aug 31 16:25:01.423178 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3097/6012] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:24:59 2022] GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32 => generated 1215 bytes in 1455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:02.034030 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0a56cc0e-758c-45a5-8dd9-d51ecf6c881c tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:02.035296 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0a56cc0e-758c-45a5-8dd9-d51ecf6c881c tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:02.063185 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a56cc0e-758c-45a5-8dd9-d51ecf6c881c tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:02.063988 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a56cc0e-758c-45a5-8dd9-d51ecf6c881c tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:02.065540 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a56cc0e-758c-45a5-8dd9-d51ecf6c881c tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:02.067159 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a56cc0e-758c-45a5-8dd9-d51ecf6c881c tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:02.067846 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a56cc0e-758c-45a5-8dd9-d51ecf6c881c tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:02.072182 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a56cc0e-758c-45a5-8dd9-d51ecf6c881c tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:02.121312 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-0a56cc0e-758c-45a5-8dd9-d51ecf6c881c tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] HTTP exception thrown: Instance 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef could not be found. Aug 31 16:25:02.123832 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0a56cc0e-758c-45a5-8dd9-d51ecf6c881c tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Request method failure captured: Aug 31 16:25:02.123832 n-d-833090-16 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef HTTP/1.1 Aug 31 16:25:02.123832 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:25:02.123832 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:25:02.123832 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:25:02.123832 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:25:02.123832 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:25:02.123832 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:25:02.123832 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:25:02.123832 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:25:02.123832 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4jmnQUplwr8AbbPZFrGxW4cxkzmu6dBR1PW9StPm7lwt758HQoCfwjfTobZNcY1qtMPO8jDX-KXtXLta2nSjy7PGTgxIA8J9_334X72rGtCeQYm6RDS4nOjdET00Y60PMzSq7EOVRAdi656mkiv_ceC-3aVenrz44MCAB3Nc0UBrjk Aug 31 16:25:02.123832 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:25:02.123832 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:25:02.123832 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:25:02.123832 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:25:02.123832 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:25:02.123832 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:25:02.123832 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: c3cdfdf921af4bc59c5c2fea1287b598 Aug 31 16:25:02.123832 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-AttachVolumeNegativeTest-1670272717 Aug 31 16:25:02.123832 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:25:02.123832 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:25:02.123832 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c3cdfdf921af4bc59c5c2fea1287b598"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c3cdfdf921af4bc59c5c2fea1287b598"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c3cdfdf921af4bc59c5c2fea1287b598"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c3cdfdf921af4bc59c5c2fea1287b598", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:25:02.123832 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-AttachVolumeNegativeTest-1670272717 Aug 31 16:25:02.123832 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: c3cdfdf921af4bc59c5c2fea1287b598 Aug 31 16:25:02.123832 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1670272717 Aug 31 16:25:02.123832 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-AttachVolumeNegativeTest-1670272717-project Aug 31 16:25:02.123832 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:25:02.123832 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:25:02.123832 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 6f95e357d68d4ad4a5eedbb08b41c5c1 Aug 31 16:25:02.123832 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-AttachVolumeNegativeTest-1670272717-project Aug 31 16:25:02.123832 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:25:02.123832 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef could not be found. Aug 31 16:25:02.123832 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef'} Aug 31 16:25:02.123832 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:25:02.123832 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:25:02.123832 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:25:02.123832 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:25:02.123832 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:25:02.123832 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:25:02.123832 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:25:02.123832 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:25:02.123832 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:25:02.123832 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:25:02.123832 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef could not be found. Aug 31 16:25:02.123832 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:25:02.123832 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:25:02.123832 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:25:02.123832 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:25:02.123832 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:25:02.123832 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:25:02.123832 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:25:02.123832 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:25:02.123832 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:25:02.123832 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:25:02.123832 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:25:02.123832 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:25:02.123832 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:25:02.123832 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:25:02.123832 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:25:02.123832 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:25:02.123832 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:25:02.123832 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:25:02.130119 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef could not be found. Aug 31 16:25:02.130119 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:25:02.130119 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:25:02.130119 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:25:02.130119 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:25:02.130119 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:25:02.130119 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:25:02.130119 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:25:02.130119 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:25:02.130119 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef could not be found. Aug 31 16:25:02.130119 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:25:02.130119 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0a56cc0e-758c-45a5-8dd9-d51ecf6c881c tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Returning 404 to user: Instance 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:25:02.130119 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0a56cc0e-758c-45a5-8dd9-d51ecf6c881c tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "DELETE /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef" status: 404 len: 111 microversion: 2.1 time: 0.096998 Aug 31 16:25:02.136533 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2916/6013] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:25:02 2022] DELETE /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:25:02.149263 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-16f01251-47d9-4fb0-a2e9-91004f15189b tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:02.149959 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-16f01251-47d9-4fb0-a2e9-91004f15189b tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] [instance: 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:02.169144 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-16f01251-47d9-4fb0-a2e9-91004f15189b tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:02.169926 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-16f01251-47d9-4fb0-a2e9-91004f15189b tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:02.173303 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-16f01251-47d9-4fb0-a2e9-91004f15189b tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:02.174288 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-16f01251-47d9-4fb0-a2e9-91004f15189b tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:02.175025 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-16f01251-47d9-4fb0-a2e9-91004f15189b tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:02.183559 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-16f01251-47d9-4fb0-a2e9-91004f15189b tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:02.225383 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-16f01251-47d9-4fb0-a2e9-91004f15189b tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] HTTP exception thrown: Instance 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef could not be found. Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-16f01251-47d9-4fb0-a2e9-91004f15189b tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Request method failure captured: Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef HTTP/1.1 Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4jmnQUplwr8AbbPZFrGxW4cxkzmu6dBR1PW9StPm7lwt758HQoCfwjfTobZNcY1qtMPO8jDX-KXtXLta2nSjy7PGTgxIA8J9_334X72rGtCeQYm6RDS4nOjdET00Y60PMzSq7EOVRAdi656mkiv_ceC-3aVenrz44MCAB3Nc0UBrjk Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: c3cdfdf921af4bc59c5c2fea1287b598 Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-AttachVolumeNegativeTest-1670272717 Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c3cdfdf921af4bc59c5c2fea1287b598"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c3cdfdf921af4bc59c5c2fea1287b598"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c3cdfdf921af4bc59c5c2fea1287b598"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c3cdfdf921af4bc59c5c2fea1287b598", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-AttachVolumeNegativeTest-1670272717 Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: c3cdfdf921af4bc59c5c2fea1287b598 Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1670272717 Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-AttachVolumeNegativeTest-1670272717-project Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 6f95e357d68d4ad4a5eedbb08b41c5c1 Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-AttachVolumeNegativeTest-1670272717-project Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef could not be found. Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef'} Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef could not be found. Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef could not be found. Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:25:02.227298 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:25:02.232599 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:25:02.232599 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:25:02.232599 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:25:02.232599 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:25:02.232599 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:25:02.232599 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef could not be found. Aug 31 16:25:02.232599 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:25:02.239210 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-16f01251-47d9-4fb0-a2e9-91004f15189b tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] Returning 404 to user: Instance 1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:25:02.240558 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-16f01251-47d9-4fb0-a2e9-91004f15189b tempest-AttachVolumeNegativeTest-1670272717 tempest-AttachVolumeNegativeTest-1670272717-project] 10.222.0.50 "GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef" status: 404 len: 111 microversion: 2.1 time: 0.096043 Aug 31 16:25:02.241954 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3098/6014] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:02 2022] GET /compute/v2.1/servers/1ef00d34-2cbb-4e66-8b17-fa5e7c0fe4ef => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:25:02.449447 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9f538cf7-a80a-4e35-bc21-4567cf85ca0f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:02.450496 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9f538cf7-a80a-4e35-bc21-4567cf85ca0f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 37fb9349-5468-4dd6-bab3-47f29cb99b32] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:02.463305 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f538cf7-a80a-4e35-bc21-4567cf85ca0f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:02.468130 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f538cf7-a80a-4e35-bc21-4567cf85ca0f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:02.470953 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f538cf7-a80a-4e35-bc21-4567cf85ca0f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:02.475618 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f538cf7-a80a-4e35-bc21-4567cf85ca0f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:02.477983 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f538cf7-a80a-4e35-bc21-4567cf85ca0f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:02.482960 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f538cf7-a80a-4e35-bc21-4567cf85ca0f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:03.508099 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9f538cf7-a80a-4e35-bc21-4567cf85ca0f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:03.524023 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9f538cf7-a80a-4e35-bc21-4567cf85ca0f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32" status: 200 len: 1215 microversion: 2.1 time: 1.080544 Aug 31 16:25:03.527377 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2917/6015] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:02 2022] GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32 => generated 1215 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:04.545601 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3d5ca5ed-f7f6-4224-9c22-950427e8d916 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:04.547334 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3d5ca5ed-f7f6-4224-9c22-950427e8d916 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 37fb9349-5468-4dd6-bab3-47f29cb99b32] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:04.571486 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d5ca5ed-f7f6-4224-9c22-950427e8d916 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:04.572263 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d5ca5ed-f7f6-4224-9c22-950427e8d916 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:04.573263 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d5ca5ed-f7f6-4224-9c22-950427e8d916 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:04.574371 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d5ca5ed-f7f6-4224-9c22-950427e8d916 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:04.575195 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d5ca5ed-f7f6-4224-9c22-950427e8d916 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:04.577218 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d5ca5ed-f7f6-4224-9c22-950427e8d916 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:04.685129 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a08e35b1-87ff-4146-aa16-3f994a036f0d tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-300252067", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "60017536-1aa1-4908-a4dd-badc3fa07ee3"}]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:25:04.802432 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-a08e35b1-87ff-4146-aa16-3f994a036f0d tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] validate_networks() for [('60017536-1aa1-4908-a4dd-badc3fa07ee3', None, None, None, None, None)] {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:25:05.281430 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3d5ca5ed-f7f6-4224-9c22-950427e8d916 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:05.295770 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3d5ca5ed-f7f6-4224-9c22-950427e8d916 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32" status: 200 len: 1215 microversion: 2.1 time: 0.754719 Aug 31 16:25:05.300708 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2918/6016] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:04 2022] GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32 => generated 1215 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:25:05.606661 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-a08e35b1-87ff-4146-aa16-3f994a036f0d tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:25:05.607442 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-a08e35b1-87ff-4146-aa16-3f994a036f0d tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:25:05.608073 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-a08e35b1-87ff-4146-aa16-3f994a036f0d tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:25:05.608645 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-a08e35b1-87ff-4146-aa16-3f994a036f0d tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:25:05.609239 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-a08e35b1-87ff-4146-aa16-3f994a036f0d tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:25:05.625260 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a08e35b1-87ff-4146-aa16-3f994a036f0d tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:05.634298 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a08e35b1-87ff-4146-aa16-3f994a036f0d tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:05.642361 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a08e35b1-87ff-4146-aa16-3f994a036f0d tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:05.643717 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a08e35b1-87ff-4146-aa16-3f994a036f0d tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:05.651106 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a08e35b1-87ff-4146-aa16-3f994a036f0d tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:05.652023 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a08e35b1-87ff-4146-aa16-3f994a036f0d tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:05.732699 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-a08e35b1-87ff-4146-aa16-3f994a036f0d tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Getting quotas for project a25250299d5a45a3b6a18e22793f6232. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:25:05.756702 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-a08e35b1-87ff-4146-aa16-3f994a036f0d tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Getting quotas for user 8d7e1b7368604169b3658a7415a3684e and project a25250299d5a45a3b6a18e22793f6232. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:25:05.795832 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a08e35b1-87ff-4146-aa16-3f994a036f0d tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:25:05.798991 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a08e35b1-87ff-4146-aa16-3f994a036f0d tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] [instance: 1a332207-809f-4c2a-81d3-4bdab483fee0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:25:05.961124 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a08e35b1-87ff-4146-aa16-3f994a036f0d tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.739650 Aug 31 16:25:05.973880 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3099/6017] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:25:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:25:05.985398 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-67f663eb-0c52-4371-8e76-d3ab3bdc3173 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:05.986650 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-67f663eb-0c52-4371-8e76-d3ab3bdc3173 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] [instance: 1a332207-809f-4c2a-81d3-4bdab483fee0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:06.175568 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-67f663eb-0c52-4371-8e76-d3ab3bdc3173 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7e1b7368604169b3658a7415a3684e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25250299d5a45a3b6a18e22793f6232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:06.188641 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-67f663eb-0c52-4371-8e76-d3ab3bdc3173 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] 10.222.0.50 "GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0" status: 200 len: 1214 microversion: 2.1 time: 0.205744 Aug 31 16:25:06.211553 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2919/6018] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:05 2022] GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0 => generated 1214 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:06.322374 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2c715555-8242-4e12-a2d6-03c30ca99465 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:06.323013 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2c715555-8242-4e12-a2d6-03c30ca99465 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 37fb9349-5468-4dd6-bab3-47f29cb99b32] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:06.347636 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2c715555-8242-4e12-a2d6-03c30ca99465 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:06.354849 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2c715555-8242-4e12-a2d6-03c30ca99465 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:06.355535 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2c715555-8242-4e12-a2d6-03c30ca99465 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:06.356207 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2c715555-8242-4e12-a2d6-03c30ca99465 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:06.356684 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2c715555-8242-4e12-a2d6-03c30ca99465 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:06.357140 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2c715555-8242-4e12-a2d6-03c30ca99465 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:07.113296 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2c715555-8242-4e12-a2d6-03c30ca99465 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:07.143468 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2c715555-8242-4e12-a2d6-03c30ca99465 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32" status: 200 len: 1215 microversion: 2.1 time: 0.826125 Aug 31 16:25:07.165574 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3100/6019] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:06 2022] GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32 => generated 1215 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:25:07.215984 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-03648846-6866-48b3-93c6-78f1b72eb5c4 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:07.217078 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-03648846-6866-48b3-93c6-78f1b72eb5c4 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] [instance: 1a332207-809f-4c2a-81d3-4bdab483fee0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:07.479253 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-03648846-6866-48b3-93c6-78f1b72eb5c4 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7e1b7368604169b3658a7415a3684e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25250299d5a45a3b6a18e22793f6232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:07.498480 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-03648846-6866-48b3-93c6-78f1b72eb5c4 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] 10.222.0.50 "GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0" status: 200 len: 1214 microversion: 2.1 time: 0.285838 Aug 31 16:25:07.499692 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2920/6020] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:07 2022] GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0 => generated 1214 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:08.185827 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-807ed2aa-2ae7-4f4e-9d29-61e5f93d437d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:08.186749 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-807ed2aa-2ae7-4f4e-9d29-61e5f93d437d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 37fb9349-5468-4dd6-bab3-47f29cb99b32] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:08.209168 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-807ed2aa-2ae7-4f4e-9d29-61e5f93d437d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:08.209684 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-807ed2aa-2ae7-4f4e-9d29-61e5f93d437d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:08.210147 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-807ed2aa-2ae7-4f4e-9d29-61e5f93d437d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:08.211082 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-807ed2aa-2ae7-4f4e-9d29-61e5f93d437d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:08.211545 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-807ed2aa-2ae7-4f4e-9d29-61e5f93d437d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:08.211972 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-807ed2aa-2ae7-4f4e-9d29-61e5f93d437d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:08.519431 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8f5eb969-8c86-44fd-ad9e-90a9c92843c2 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:08.520087 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8f5eb969-8c86-44fd-ad9e-90a9c92843c2 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] [instance: 1a332207-809f-4c2a-81d3-4bdab483fee0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:08.531742 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f5eb969-8c86-44fd-ad9e-90a9c92843c2 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:08.532237 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f5eb969-8c86-44fd-ad9e-90a9c92843c2 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:08.532675 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f5eb969-8c86-44fd-ad9e-90a9c92843c2 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:08.533396 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f5eb969-8c86-44fd-ad9e-90a9c92843c2 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:08.533926 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f5eb969-8c86-44fd-ad9e-90a9c92843c2 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:08.542581 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f5eb969-8c86-44fd-ad9e-90a9c92843c2 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:08.923242 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8f5eb969-8c86-44fd-ad9e-90a9c92843c2 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7e1b7368604169b3658a7415a3684e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25250299d5a45a3b6a18e22793f6232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:08.936779 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8f5eb969-8c86-44fd-ad9e-90a9c92843c2 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] 10.222.0.50 "GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0" status: 200 len: 1274 microversion: 2.1 time: 0.421374 Aug 31 16:25:08.938022 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2921/6021] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:08 2022] GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0 => generated 1274 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:09.151988 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-807ed2aa-2ae7-4f4e-9d29-61e5f93d437d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:09.163909 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-807ed2aa-2ae7-4f4e-9d29-61e5f93d437d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32" status: 200 len: 1215 microversion: 2.1 time: 0.982421 Aug 31 16:25:09.179663 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3101/6022] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:08 2022] GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32 => generated 1215 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:09.960222 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c398f13a-4a85-4cf0-b7c9-9d69c0430096 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:09.960857 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c398f13a-4a85-4cf0-b7c9-9d69c0430096 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] [instance: 1a332207-809f-4c2a-81d3-4bdab483fee0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:09.978313 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c398f13a-4a85-4cf0-b7c9-9d69c0430096 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:09.979418 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c398f13a-4a85-4cf0-b7c9-9d69c0430096 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:09.980754 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c398f13a-4a85-4cf0-b7c9-9d69c0430096 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:09.981890 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c398f13a-4a85-4cf0-b7c9-9d69c0430096 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:09.982639 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c398f13a-4a85-4cf0-b7c9-9d69c0430096 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:09.983386 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c398f13a-4a85-4cf0-b7c9-9d69c0430096 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:10.015045 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=65 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:25:10.191374 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ade4ccdf-2a95-400e-a99e-8822ebb92e4f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:10.191985 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ade4ccdf-2a95-400e-a99e-8822ebb92e4f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 37fb9349-5468-4dd6-bab3-47f29cb99b32] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:10.203586 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ade4ccdf-2a95-400e-a99e-8822ebb92e4f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:10.217307 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ade4ccdf-2a95-400e-a99e-8822ebb92e4f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:10.218918 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ade4ccdf-2a95-400e-a99e-8822ebb92e4f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:10.220114 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ade4ccdf-2a95-400e-a99e-8822ebb92e4f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:10.223336 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ade4ccdf-2a95-400e-a99e-8822ebb92e4f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:10.224003 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ade4ccdf-2a95-400e-a99e-8822ebb92e4f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:10.289652 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c398f13a-4a85-4cf0-b7c9-9d69c0430096 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7e1b7368604169b3658a7415a3684e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25250299d5a45a3b6a18e22793f6232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:10.299481 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c398f13a-4a85-4cf0-b7c9-9d69c0430096 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] 10.222.0.50 "GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0" status: 200 len: 1314 microversion: 2.1 time: 0.343678 Aug 31 16:25:10.303364 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2922/6023] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:09 2022] GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0 => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:10.495832 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ade4ccdf-2a95-400e-a99e-8822ebb92e4f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:10.508193 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ade4ccdf-2a95-400e-a99e-8822ebb92e4f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32" status: 200 len: 1203 microversion: 2.1 time: 0.320447 Aug 31 16:25:10.509839 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3102/6024] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:10 2022] GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32 => generated 1203 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:25:11.324385 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-331a6198-568e-4802-b121-79d3687dbc79 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:11.325027 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-331a6198-568e-4802-b121-79d3687dbc79 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] [instance: 1a332207-809f-4c2a-81d3-4bdab483fee0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:11.350838 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-331a6198-568e-4802-b121-79d3687dbc79 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:11.358766 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-331a6198-568e-4802-b121-79d3687dbc79 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:11.359355 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-331a6198-568e-4802-b121-79d3687dbc79 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:11.361138 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-331a6198-568e-4802-b121-79d3687dbc79 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:11.364602 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-331a6198-568e-4802-b121-79d3687dbc79 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:11.365251 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-331a6198-568e-4802-b121-79d3687dbc79 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:11.534440 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2d7a0e8b-80f1-4688-a27d-dc042b989622 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:11.535202 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2d7a0e8b-80f1-4688-a27d-dc042b989622 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 37fb9349-5468-4dd6-bab3-47f29cb99b32] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:11.547937 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2d7a0e8b-80f1-4688-a27d-dc042b989622 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:11.550585 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2d7a0e8b-80f1-4688-a27d-dc042b989622 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:11.554323 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2d7a0e8b-80f1-4688-a27d-dc042b989622 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:11.555451 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2d7a0e8b-80f1-4688-a27d-dc042b989622 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:11.556120 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2d7a0e8b-80f1-4688-a27d-dc042b989622 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:11.556743 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2d7a0e8b-80f1-4688-a27d-dc042b989622 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:11.824829 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-331a6198-568e-4802-b121-79d3687dbc79 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7e1b7368604169b3658a7415a3684e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25250299d5a45a3b6a18e22793f6232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:11.839038 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-331a6198-568e-4802-b121-79d3687dbc79 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] 10.222.0.50 "GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0" status: 200 len: 1314 microversion: 2.1 time: 0.519755 Aug 31 16:25:11.840071 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2923/6025] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:11 2022] GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0 => generated 1314 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:11.988374 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2d7a0e8b-80f1-4688-a27d-dc042b989622 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:12.011257 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2d7a0e8b-80f1-4688-a27d-dc042b989622 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32" status: 200 len: 1203 microversion: 2.1 time: 0.480089 Aug 31 16:25:12.013094 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3103/6026] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:11 2022] GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32 => generated 1203 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:12.683753 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-ed5deceb-18e8-46c6-8114-9d57cf22c698 req-a1cd2d0d-1d5e-4cfe-9b4c-6a6b7c4feea3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a332207-809f-4c2a-81d3-4bdab483fee0", "tag": "17f7c0ff-4a0a-42f4-9539-5b8d3239e2b5"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:25:12.705950 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ed5deceb-18e8-46c6-8114-9d57cf22c698 req-a1cd2d0d-1d5e-4cfe-9b4c-6a6b7c4feea3 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:12.706490 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ed5deceb-18e8-46c6-8114-9d57cf22c698 req-a1cd2d0d-1d5e-4cfe-9b4c-6a6b7c4feea3 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:12.706916 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ed5deceb-18e8-46c6-8114-9d57cf22c698 req-a1cd2d0d-1d5e-4cfe-9b4c-6a6b7c4feea3 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:12.728703 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-ed5deceb-18e8-46c6-8114-9d57cf22c698 req-a1cd2d0d-1d5e-4cfe-9b4c-6a6b7c4feea3 service nova] Creating event network-changed:17f7c0ff-4a0a-42f4-9539-5b8d3239e2b5 for instance 1a332207-809f-4c2a-81d3-4bdab483fee0 on n-h2-833090-16 Aug 31 16:25:12.734503 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-ed5deceb-18e8-46c6-8114-9d57cf22c698 req-a1cd2d0d-1d5e-4cfe-9b4c-6a6b7c4feea3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059302 Aug 31 16:25:12.735756 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2924/6027] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:25:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:25:12.870663 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-61e7dfef-6107-491f-8cec-80f15f4bbc2f tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:12.872760 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-61e7dfef-6107-491f-8cec-80f15f4bbc2f tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] [instance: 1a332207-809f-4c2a-81d3-4bdab483fee0] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:12.888441 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-61e7dfef-6107-491f-8cec-80f15f4bbc2f tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:12.889689 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-61e7dfef-6107-491f-8cec-80f15f4bbc2f tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:12.902139 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-61e7dfef-6107-491f-8cec-80f15f4bbc2f tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:12.904814 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-61e7dfef-6107-491f-8cec-80f15f4bbc2f tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:12.906617 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-61e7dfef-6107-491f-8cec-80f15f4bbc2f tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:12.907608 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-61e7dfef-6107-491f-8cec-80f15f4bbc2f tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:13.048058 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4cb12096-4029-4e87-8df7-eccbc448f7fb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:13.060169 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4cb12096-4029-4e87-8df7-eccbc448f7fb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 37fb9349-5468-4dd6-bab3-47f29cb99b32] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:13.072390 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4cb12096-4029-4e87-8df7-eccbc448f7fb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:13.072916 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4cb12096-4029-4e87-8df7-eccbc448f7fb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:13.073412 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4cb12096-4029-4e87-8df7-eccbc448f7fb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:13.074050 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4cb12096-4029-4e87-8df7-eccbc448f7fb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:13.074521 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4cb12096-4029-4e87-8df7-eccbc448f7fb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:13.074936 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4cb12096-4029-4e87-8df7-eccbc448f7fb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:13.320191 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-61e7dfef-6107-491f-8cec-80f15f4bbc2f tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7e1b7368604169b3658a7415a3684e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25250299d5a45a3b6a18e22793f6232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:13.341269 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-61e7dfef-6107-491f-8cec-80f15f4bbc2f tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] 10.222.0.50 "GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0" status: 200 len: 1314 microversion: 2.1 time: 0.481618 Aug 31 16:25:13.358127 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3104/6028] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:12 2022] GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0 => generated 1314 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:25:13.396942 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4cb12096-4029-4e87-8df7-eccbc448f7fb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:13.405599 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4cb12096-4029-4e87-8df7-eccbc448f7fb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32" status: 200 len: 1203 microversion: 2.1 time: 0.365362 Aug 31 16:25:13.406221 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2925/6029] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:13 2022] GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32 => generated 1203 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:13.750413 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-771d4897-c9c9-4028-b79d-8b27abf248f4 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:13.750947 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-771d4897-c9c9-4028-b79d-8b27abf248f4 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:13.760360 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-771d4897-c9c9-4028-b79d-8b27abf248f4 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:13.764359 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-771d4897-c9c9-4028-b79d-8b27abf248f4 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:13.766230 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-771d4897-c9c9-4028-b79d-8b27abf248f4 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:13.769287 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-771d4897-c9c9-4028-b79d-8b27abf248f4 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:13.769911 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-771d4897-c9c9-4028-b79d-8b27abf248f4 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:13.771377 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-771d4897-c9c9-4028-b79d-8b27abf248f4 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:13.938171 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-771d4897-c9c9-4028-b79d-8b27abf248f4 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lazy-loading 'services' on Instance uuid 27172556-b12c-4974-815d-5f893a07506b {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:25:14.087773 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-771d4897-c9c9-4028-b79d-8b27abf248f4 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "DELETE /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b/os-volume_attachments/e508458d-4d71-4f6a-830b-19c7cde75e06" status: 202 len: 0 microversion: 2.1 time: 0.341896 Aug 31 16:25:14.092010 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3105/6030] 10.222.0.50 () {58 vars in 1416 bytes} [Wed Aug 31 16:25:13 2022] DELETE /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b/os-volume_attachments/e508458d-4d71-4f6a-830b-19c7cde75e06 => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:25:14.370262 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f8f72042-4e7b-41fa-9e0c-329003d2cd5d tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:14.370999 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f8f72042-4e7b-41fa-9e0c-329003d2cd5d tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] [instance: 1a332207-809f-4c2a-81d3-4bdab483fee0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:14.382782 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8f72042-4e7b-41fa-9e0c-329003d2cd5d tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:14.384276 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8f72042-4e7b-41fa-9e0c-329003d2cd5d tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:14.385720 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8f72042-4e7b-41fa-9e0c-329003d2cd5d tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:14.388341 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8f72042-4e7b-41fa-9e0c-329003d2cd5d tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:14.390889 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8f72042-4e7b-41fa-9e0c-329003d2cd5d tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:14.391399 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8f72042-4e7b-41fa-9e0c-329003d2cd5d tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:14.430138 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4bbb76be-3b50-45b3-8243-ee6fd8d6dee5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:14.431189 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4bbb76be-3b50-45b3-8243-ee6fd8d6dee5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 37fb9349-5468-4dd6-bab3-47f29cb99b32] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:14.452715 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4bbb76be-3b50-45b3-8243-ee6fd8d6dee5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:14.454307 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4bbb76be-3b50-45b3-8243-ee6fd8d6dee5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:14.455542 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4bbb76be-3b50-45b3-8243-ee6fd8d6dee5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:14.457158 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4bbb76be-3b50-45b3-8243-ee6fd8d6dee5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:14.458318 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4bbb76be-3b50-45b3-8243-ee6fd8d6dee5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:14.462486 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4bbb76be-3b50-45b3-8243-ee6fd8d6dee5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:14.929496 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4bbb76be-3b50-45b3-8243-ee6fd8d6dee5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:14.947694 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4bbb76be-3b50-45b3-8243-ee6fd8d6dee5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32" status: 200 len: 1203 microversion: 2.1 time: 0.522297 Aug 31 16:25:14.962621 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3106/6031] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:14 2022] GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32 => generated 1203 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:14.985298 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f8f72042-4e7b-41fa-9e0c-329003d2cd5d tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7e1b7368604169b3658a7415a3684e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25250299d5a45a3b6a18e22793f6232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:15.012375 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f8f72042-4e7b-41fa-9e0c-329003d2cd5d tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] 10.222.0.50 "GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0" status: 200 len: 1314 microversion: 2.1 time: 0.642893 Aug 31 16:25:15.026121 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2926/6032] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:14 2022] GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0 => generated 1314 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:15.971604 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c2fe38b5-a575-4b98-b88a-ffbaf2febd0f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:15.972268 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c2fe38b5-a575-4b98-b88a-ffbaf2febd0f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 37fb9349-5468-4dd6-bab3-47f29cb99b32] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:15.976819 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:25:15.977961 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=6 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:25:16.003635 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c2fe38b5-a575-4b98-b88a-ffbaf2febd0f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:16.004138 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c2fe38b5-a575-4b98-b88a-ffbaf2febd0f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:16.004571 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c2fe38b5-a575-4b98-b88a-ffbaf2febd0f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:16.011798 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c2fe38b5-a575-4b98-b88a-ffbaf2febd0f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:16.012514 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c2fe38b5-a575-4b98-b88a-ffbaf2febd0f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:16.012959 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c2fe38b5-a575-4b98-b88a-ffbaf2febd0f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:16.042037 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c069272c-fd03-4bb3-8207-d17a4afa7eec tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:16.042946 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c069272c-fd03-4bb3-8207-d17a4afa7eec tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] [instance: 1a332207-809f-4c2a-81d3-4bdab483fee0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:16.062906 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c069272c-fd03-4bb3-8207-d17a4afa7eec tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:16.063596 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c069272c-fd03-4bb3-8207-d17a4afa7eec tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:16.064172 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c069272c-fd03-4bb3-8207-d17a4afa7eec tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:16.065067 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c069272c-fd03-4bb3-8207-d17a4afa7eec tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:16.065739 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c069272c-fd03-4bb3-8207-d17a4afa7eec tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:16.066622 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c069272c-fd03-4bb3-8207-d17a4afa7eec tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:16.447785 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c2fe38b5-a575-4b98-b88a-ffbaf2febd0f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:16.461027 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c2fe38b5-a575-4b98-b88a-ffbaf2febd0f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32" status: 200 len: 1203 microversion: 2.1 time: 0.495132 Aug 31 16:25:16.463276 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3107/6033] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:15 2022] GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32 => generated 1203 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:16.483081 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c069272c-fd03-4bb3-8207-d17a4afa7eec tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7e1b7368604169b3658a7415a3684e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25250299d5a45a3b6a18e22793f6232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:16.498287 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c069272c-fd03-4bb3-8207-d17a4afa7eec tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] 10.222.0.50 "GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0" status: 200 len: 1314 microversion: 2.1 time: 0.463919 Aug 31 16:25:16.500069 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2927/6034] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:16 2022] GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0 => generated 1314 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:25:17.490210 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5c9422a2-a787-437d-af5a-900da77dc4ad tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:17.490975 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5c9422a2-a787-437d-af5a-900da77dc4ad tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 37fb9349-5468-4dd6-bab3-47f29cb99b32] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:17.511542 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5c9422a2-a787-437d-af5a-900da77dc4ad tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:17.512056 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5c9422a2-a787-437d-af5a-900da77dc4ad tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:17.513250 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5c9422a2-a787-437d-af5a-900da77dc4ad tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:17.514001 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5c9422a2-a787-437d-af5a-900da77dc4ad tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:17.514494 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5c9422a2-a787-437d-af5a-900da77dc4ad tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:17.514985 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5c9422a2-a787-437d-af5a-900da77dc4ad tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:17.529401 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-469ae4a4-38b2-4154-bb6a-eeb9a1256518 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:17.530226 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-469ae4a4-38b2-4154-bb6a-eeb9a1256518 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] [instance: 1a332207-809f-4c2a-81d3-4bdab483fee0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:17.534752 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:25:17.542588 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:25:17.562120 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-469ae4a4-38b2-4154-bb6a-eeb9a1256518 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:17.563005 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-469ae4a4-38b2-4154-bb6a-eeb9a1256518 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:17.565257 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-469ae4a4-38b2-4154-bb6a-eeb9a1256518 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:17.568777 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-469ae4a4-38b2-4154-bb6a-eeb9a1256518 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:17.571143 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-469ae4a4-38b2-4154-bb6a-eeb9a1256518 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:17.571979 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-469ae4a4-38b2-4154-bb6a-eeb9a1256518 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:18.064823 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5c9422a2-a787-437d-af5a-900da77dc4ad tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:18.091814 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5c9422a2-a787-437d-af5a-900da77dc4ad tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32" status: 200 len: 1203 microversion: 2.1 time: 0.607117 Aug 31 16:25:18.092916 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3108/6035] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:17 2022] GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32 => generated 1203 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:18.131140 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-469ae4a4-38b2-4154-bb6a-eeb9a1256518 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7e1b7368604169b3658a7415a3684e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25250299d5a45a3b6a18e22793f6232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:18.157459 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-469ae4a4-38b2-4154-bb6a-eeb9a1256518 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] 10.222.0.50 "GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0" status: 200 len: 1314 microversion: 2.1 time: 0.633254 Aug 31 16:25:18.166681 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2928/6036] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:17 2022] GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0 => generated 1314 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:25:19.135153 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-21daacb1-23c3-49b4-b078-67a3961960b3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:19.136000 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-21daacb1-23c3-49b4-b078-67a3961960b3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 37fb9349-5468-4dd6-bab3-47f29cb99b32] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:19.140237 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:25:19.158733 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-21daacb1-23c3-49b4-b078-67a3961960b3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:19.162900 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-21daacb1-23c3-49b4-b078-67a3961960b3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:19.163597 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-21daacb1-23c3-49b4-b078-67a3961960b3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:19.171164 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-21daacb1-23c3-49b4-b078-67a3961960b3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:19.177403 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-21daacb1-23c3-49b4-b078-67a3961960b3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:19.178259 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-21daacb1-23c3-49b4-b078-67a3961960b3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:19.206728 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-836ecee8-0f9d-4adf-8c78-6ce2b4e37038 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:19.206728 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-836ecee8-0f9d-4adf-8c78-6ce2b4e37038 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] [instance: 1a332207-809f-4c2a-81d3-4bdab483fee0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:19.217836 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-836ecee8-0f9d-4adf-8c78-6ce2b4e37038 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:19.218550 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-836ecee8-0f9d-4adf-8c78-6ce2b4e37038 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:19.219132 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-836ecee8-0f9d-4adf-8c78-6ce2b4e37038 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:19.222233 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-836ecee8-0f9d-4adf-8c78-6ce2b4e37038 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:19.230036 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-836ecee8-0f9d-4adf-8c78-6ce2b4e37038 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:19.231898 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-836ecee8-0f9d-4adf-8c78-6ce2b4e37038 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:20.092476 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-21daacb1-23c3-49b4-b078-67a3961960b3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:20.120523 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-21daacb1-23c3-49b4-b078-67a3961960b3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32" status: 200 len: 1203 microversion: 2.1 time: 0.987154 Aug 31 16:25:20.126704 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3109/6037] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:19 2022] GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32 => generated 1203 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:20.221497 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-836ecee8-0f9d-4adf-8c78-6ce2b4e37038 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7e1b7368604169b3658a7415a3684e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25250299d5a45a3b6a18e22793f6232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:20.233184 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-836ecee8-0f9d-4adf-8c78-6ce2b4e37038 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] 10.222.0.50 "GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0" status: 200 len: 1314 microversion: 2.1 time: 1.040117 Aug 31 16:25:20.233798 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2929/6038] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:19 2022] GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0 => generated 1314 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:25:21.148561 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-95c37521-6f91-49ae-acfd-7485facd73c1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:21.150040 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-95c37521-6f91-49ae-acfd-7485facd73c1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 37fb9349-5468-4dd6-bab3-47f29cb99b32] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:21.159362 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95c37521-6f91-49ae-acfd-7485facd73c1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:21.161685 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95c37521-6f91-49ae-acfd-7485facd73c1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:21.162164 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95c37521-6f91-49ae-acfd-7485facd73c1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:21.167397 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95c37521-6f91-49ae-acfd-7485facd73c1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:21.167925 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95c37521-6f91-49ae-acfd-7485facd73c1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:21.168342 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95c37521-6f91-49ae-acfd-7485facd73c1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:21.258404 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-faad1f5f-bf91-4e26-a812-11c8003846b4 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:21.260018 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-faad1f5f-bf91-4e26-a812-11c8003846b4 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] [instance: 1a332207-809f-4c2a-81d3-4bdab483fee0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:21.281884 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-faad1f5f-bf91-4e26-a812-11c8003846b4 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:21.283261 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-faad1f5f-bf91-4e26-a812-11c8003846b4 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:21.284078 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-faad1f5f-bf91-4e26-a812-11c8003846b4 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:21.285199 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-faad1f5f-bf91-4e26-a812-11c8003846b4 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:21.285881 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-faad1f5f-bf91-4e26-a812-11c8003846b4 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:21.286538 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-faad1f5f-bf91-4e26-a812-11c8003846b4 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:21.938407 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-95c37521-6f91-49ae-acfd-7485facd73c1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:21.968628 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-95c37521-6f91-49ae-acfd-7485facd73c1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32" status: 200 len: 1203 microversion: 2.1 time: 0.824741 Aug 31 16:25:21.973124 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3110/6039] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:21 2022] GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32 => generated 1203 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:21.978187 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-3277667b-4872-4866-996b-af3afb587e94 req-17192c00-7573-431a-a180-590efb3615af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a332207-809f-4c2a-81d3-4bdab483fee0", "name": "network-vif-plugged", "status": "completed", "tag": "17f7c0ff-4a0a-42f4-9539-5b8d3239e2b5"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:25:22.014076 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-3277667b-4872-4866-996b-af3afb587e94 req-17192c00-7573-431a-a180-590efb3615af service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:22.015107 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-3277667b-4872-4866-996b-af3afb587e94 req-17192c00-7573-431a-a180-590efb3615af service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:22.015760 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-3277667b-4872-4866-996b-af3afb587e94 req-17192c00-7573-431a-a180-590efb3615af service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:22.024668 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-faad1f5f-bf91-4e26-a812-11c8003846b4 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7e1b7368604169b3658a7415a3684e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25250299d5a45a3b6a18e22793f6232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:22.036627 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-faad1f5f-bf91-4e26-a812-11c8003846b4 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] 10.222.0.50 "GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0" status: 200 len: 1314 microversion: 2.1 time: 0.782437 Aug 31 16:25:22.042001 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2930/6040] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:21 2022] GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0 => generated 1314 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:22.054262 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-3277667b-4872-4866-996b-af3afb587e94 req-17192c00-7573-431a-a180-590efb3615af service nova] Creating event network-vif-plugged:17f7c0ff-4a0a-42f4-9539-5b8d3239e2b5 for instance 1a332207-809f-4c2a-81d3-4bdab483fee0 on n-h2-833090-16 Aug 31 16:25:22.072064 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-3277667b-4872-4866-996b-af3afb587e94 req-17192c00-7573-431a-a180-590efb3615af service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096801 Aug 31 16:25:22.077314 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3111/6041] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:25:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:25:22.994872 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bb139f65-96dc-4d93-bc3f-35e5825d6c37 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:22.995977 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bb139f65-96dc-4d93-bc3f-35e5825d6c37 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 37fb9349-5468-4dd6-bab3-47f29cb99b32] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:23.022450 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bb139f65-96dc-4d93-bc3f-35e5825d6c37 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:23.029098 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bb139f65-96dc-4d93-bc3f-35e5825d6c37 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:23.030739 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bb139f65-96dc-4d93-bc3f-35e5825d6c37 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:23.031806 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bb139f65-96dc-4d93-bc3f-35e5825d6c37 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:23.034057 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bb139f65-96dc-4d93-bc3f-35e5825d6c37 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:23.034766 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bb139f65-96dc-4d93-bc3f-35e5825d6c37 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:23.071521 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c8d4f74e-b4a3-4af4-9429-225cead4b61f tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:23.075379 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c8d4f74e-b4a3-4af4-9429-225cead4b61f tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] [instance: 1a332207-809f-4c2a-81d3-4bdab483fee0] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:23.133350 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8d4f74e-b4a3-4af4-9429-225cead4b61f tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:23.135671 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8d4f74e-b4a3-4af4-9429-225cead4b61f tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:23.136138 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8d4f74e-b4a3-4af4-9429-225cead4b61f tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:23.136912 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8d4f74e-b4a3-4af4-9429-225cead4b61f tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:23.137428 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8d4f74e-b4a3-4af4-9429-225cead4b61f tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:23.137868 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8d4f74e-b4a3-4af4-9429-225cead4b61f tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:23.214073 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:25:23.798071 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c8d4f74e-b4a3-4af4-9429-225cead4b61f tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7e1b7368604169b3658a7415a3684e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25250299d5a45a3b6a18e22793f6232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:23.805082 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bb139f65-96dc-4d93-bc3f-35e5825d6c37 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:23.810834 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c8d4f74e-b4a3-4af4-9429-225cead4b61f tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] 10.222.0.50 "GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0" status: 200 len: 1314 microversion: 2.1 time: 0.748662 Aug 31 16:25:23.811977 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3112/6042] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:23 2022] GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0 => generated 1314 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:23.820224 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bb139f65-96dc-4d93-bc3f-35e5825d6c37 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32" status: 200 len: 1203 microversion: 2.1 time: 0.829627 Aug 31 16:25:23.821437 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2931/6043] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:22 2022] GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32 => generated 1203 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:24.167277 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-7e307213-43c4-4b6f-8608-7f3a8c613aeb req-4c376d6d-397b-43c5-b4f2-49d366a1627b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37fb9349-5468-4dd6-bab3-47f29cb99b32", "name": "network-vif-plugged", "status": "completed", "tag": "7608c4e5-e798-4d4a-b97a-4d336d5a3792"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:25:24.229247 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7e307213-43c4-4b6f-8608-7f3a8c613aeb req-4c376d6d-397b-43c5-b4f2-49d366a1627b service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:24.229751 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7e307213-43c4-4b6f-8608-7f3a8c613aeb req-4c376d6d-397b-43c5-b4f2-49d366a1627b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:24.234934 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7e307213-43c4-4b6f-8608-7f3a8c613aeb req-4c376d6d-397b-43c5-b4f2-49d366a1627b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:24.312618 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-7e307213-43c4-4b6f-8608-7f3a8c613aeb req-4c376d6d-397b-43c5-b4f2-49d366a1627b service nova] Creating event network-vif-plugged:7608c4e5-e798-4d4a-b97a-4d336d5a3792 for instance 37fb9349-5468-4dd6-bab3-47f29cb99b32 on n-h1-833090-16 Aug 31 16:25:24.352758 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-7e307213-43c4-4b6f-8608-7f3a8c613aeb req-4c376d6d-397b-43c5-b4f2-49d366a1627b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.190459 Aug 31 16:25:24.355782 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3113/6044] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:25:24.837129 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6bcdc4bb-a962-4173-89c0-16da37aaec89 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:24.838187 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6bcdc4bb-a962-4173-89c0-16da37aaec89 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] [instance: 1a332207-809f-4c2a-81d3-4bdab483fee0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:24.842453 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a906c3d0-cb76-4bc3-9121-9e8b42e3c38b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:24.843715 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a906c3d0-cb76-4bc3-9121-9e8b42e3c38b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 37fb9349-5468-4dd6-bab3-47f29cb99b32] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:24.850895 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6bcdc4bb-a962-4173-89c0-16da37aaec89 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:24.851383 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6bcdc4bb-a962-4173-89c0-16da37aaec89 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:24.851811 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6bcdc4bb-a962-4173-89c0-16da37aaec89 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:24.852510 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6bcdc4bb-a962-4173-89c0-16da37aaec89 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:24.852980 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6bcdc4bb-a962-4173-89c0-16da37aaec89 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:24.853370 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6bcdc4bb-a962-4173-89c0-16da37aaec89 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:24.856381 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a906c3d0-cb76-4bc3-9121-9e8b42e3c38b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:24.859458 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a906c3d0-cb76-4bc3-9121-9e8b42e3c38b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:24.861034 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a906c3d0-cb76-4bc3-9121-9e8b42e3c38b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:24.863447 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a906c3d0-cb76-4bc3-9121-9e8b42e3c38b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:24.865386 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a906c3d0-cb76-4bc3-9121-9e8b42e3c38b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:24.867087 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a906c3d0-cb76-4bc3-9121-9e8b42e3c38b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:26.084097 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6bcdc4bb-a962-4173-89c0-16da37aaec89 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7e1b7368604169b3658a7415a3684e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25250299d5a45a3b6a18e22793f6232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:26.098492 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6bcdc4bb-a962-4173-89c0-16da37aaec89 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] 10.222.0.50 "GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0" status: 200 len: 1501 microversion: 2.1 time: 1.265380 Aug 31 16:25:26.107936 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2932/6045] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:24 2022] GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0 => generated 1501 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:26.126684 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-259f690e-dbb6-4662-869f-1c195f32c730 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:26.135323 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-259f690e-dbb6-4662-869f-1c195f32c730 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] [instance: 1a332207-809f-4c2a-81d3-4bdab483fee0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:26.158755 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-259f690e-dbb6-4662-869f-1c195f32c730 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:26.161329 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-259f690e-dbb6-4662-869f-1c195f32c730 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:26.163768 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-259f690e-dbb6-4662-869f-1c195f32c730 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:26.167683 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-259f690e-dbb6-4662-869f-1c195f32c730 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:26.171529 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-259f690e-dbb6-4662-869f-1c195f32c730 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:26.172048 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-259f690e-dbb6-4662-869f-1c195f32c730 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:26.215456 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a906c3d0-cb76-4bc3-9121-9e8b42e3c38b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:26.238470 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a906c3d0-cb76-4bc3-9121-9e8b42e3c38b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32" status: 200 len: 1203 microversion: 2.1 time: 1.396983 Aug 31 16:25:26.239157 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3114/6046] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:24 2022] GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32 => generated 1203 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:25:26.436082 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-259f690e-dbb6-4662-869f-1c195f32c730 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7e1b7368604169b3658a7415a3684e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25250299d5a45a3b6a18e22793f6232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:26.454473 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-259f690e-dbb6-4662-869f-1c195f32c730 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] 10.222.0.50 "GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0" status: 200 len: 1501 microversion: 2.1 time: 0.338074 Aug 31 16:25:26.454473 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2933/6047] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:26 2022] GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0 => generated 1501 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:26.484114 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fb7dd5d5-7856-4c5d-ae63-3bd56876c44c tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:25:26.484574 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fb7dd5d5-7856-4c5d-ae63-3bd56876c44c tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] [instance: 1a332207-809f-4c2a-81d3-4bdab483fee0] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:26.500182 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb7dd5d5-7856-4c5d-ae63-3bd56876c44c tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:26.500895 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb7dd5d5-7856-4c5d-ae63-3bd56876c44c tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:26.501349 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb7dd5d5-7856-4c5d-ae63-3bd56876c44c tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:26.504700 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb7dd5d5-7856-4c5d-ae63-3bd56876c44c tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:26.505637 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb7dd5d5-7856-4c5d-ae63-3bd56876c44c tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:26.506406 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb7dd5d5-7856-4c5d-ae63-3bd56876c44c tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:26.564652 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-fb7dd5d5-7856-4c5d-ae63-3bd56876c44c tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lazy-loading 'flavor' on Instance uuid 1a332207-809f-4c2a-81d3-4bdab483fee0 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:25:26.726756 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fb7dd5d5-7856-4c5d-ae63-3bd56876c44c tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] 10.222.0.50 "POST /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0/action" status: 202 len: 0 microversion: 2.1 time: 0.247780 Aug 31 16:25:26.731365 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3115/6048] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:25:26 2022] POST /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:25:26.739828 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7ba65f80-737f-4014-8fd3-41c02e6ab33a tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:26.740845 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7ba65f80-737f-4014-8fd3-41c02e6ab33a tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] [instance: 1a332207-809f-4c2a-81d3-4bdab483fee0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:26.757069 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ba65f80-737f-4014-8fd3-41c02e6ab33a tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:26.757885 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ba65f80-737f-4014-8fd3-41c02e6ab33a tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:26.759497 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ba65f80-737f-4014-8fd3-41c02e6ab33a tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:26.760463 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ba65f80-737f-4014-8fd3-41c02e6ab33a tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:26.761097 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ba65f80-737f-4014-8fd3-41c02e6ab33a tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:26.761719 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ba65f80-737f-4014-8fd3-41c02e6ab33a tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:27.117472 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7ba65f80-737f-4014-8fd3-41c02e6ab33a tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7e1b7368604169b3658a7415a3684e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25250299d5a45a3b6a18e22793f6232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:27.134059 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7ba65f80-737f-4014-8fd3-41c02e6ab33a tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] 10.222.0.50 "GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0" status: 200 len: 1509 microversion: 2.1 time: 0.400895 Aug 31 16:25:27.135433 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2934/6049] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:26 2022] GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0 => generated 1509 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:27.263037 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-200edffa-6fde-4c27-95ff-a30deb9de7ef tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:27.263909 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-200edffa-6fde-4c27-95ff-a30deb9de7ef tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 37fb9349-5468-4dd6-bab3-47f29cb99b32] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:27.273382 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-200edffa-6fde-4c27-95ff-a30deb9de7ef tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:27.274344 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-200edffa-6fde-4c27-95ff-a30deb9de7ef tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:27.275094 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-200edffa-6fde-4c27-95ff-a30deb9de7ef tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:27.276103 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-200edffa-6fde-4c27-95ff-a30deb9de7ef tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:27.276793 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-200edffa-6fde-4c27-95ff-a30deb9de7ef tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:27.277389 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-200edffa-6fde-4c27-95ff-a30deb9de7ef tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:27.427589 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-effe644e-96b1-449c-90f8-ebc4f8714a9b tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:25:27.437794 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-effe644e-96b1-449c-90f8-ebc4f8714a9b tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:27.440534 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-effe644e-96b1-449c-90f8-ebc4f8714a9b tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:27.441059 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-effe644e-96b1-449c-90f8-ebc4f8714a9b tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:27.478419 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-effe644e-96b1-449c-90f8-ebc4f8714a9b tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] Going to try to stop instance {{(pid=128863) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 16:25:27.639657 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-effe644e-96b1-449c-90f8-ebc4f8714a9b tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "POST /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b/action" status: 202 len: 0 microversion: 2.1 time: 0.213800 Aug 31 16:25:27.647294 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2935/6050] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:25:27 2022] POST /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:25:27.671189 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7561aec6-cd8a-4f49-b99a-da33eb136788 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:27.672139 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7561aec6-cd8a-4f49-b99a-da33eb136788 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:27.696581 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7561aec6-cd8a-4f49-b99a-da33eb136788 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:27.697201 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7561aec6-cd8a-4f49-b99a-da33eb136788 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:27.697655 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7561aec6-cd8a-4f49-b99a-da33eb136788 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:27.711887 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7561aec6-cd8a-4f49-b99a-da33eb136788 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:27.712420 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7561aec6-cd8a-4f49-b99a-da33eb136788 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:27.712885 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7561aec6-cd8a-4f49-b99a-da33eb136788 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:27.760332 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-200edffa-6fde-4c27-95ff-a30deb9de7ef tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:27.781644 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-200edffa-6fde-4c27-95ff-a30deb9de7ef tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32" status: 200 len: 1390 microversion: 2.1 time: 0.518380 Aug 31 16:25:27.784547 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3116/6051] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:27 2022] GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32 => generated 1390 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:27.808983 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e8c8fc81-2393-4bdb-ba99-509f01c601b6 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:27.809930 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e8c8fc81-2393-4bdb-ba99-509f01c601b6 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 37fb9349-5468-4dd6-bab3-47f29cb99b32] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:27.823301 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e8c8fc81-2393-4bdb-ba99-509f01c601b6 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:27.824105 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e8c8fc81-2393-4bdb-ba99-509f01c601b6 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:27.824871 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e8c8fc81-2393-4bdb-ba99-509f01c601b6 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:27.826179 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e8c8fc81-2393-4bdb-ba99-509f01c601b6 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:27.833292 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e8c8fc81-2393-4bdb-ba99-509f01c601b6 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:27.834067 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e8c8fc81-2393-4bdb-ba99-509f01c601b6 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:28.314554 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e8c8fc81-2393-4bdb-ba99-509f01c601b6 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:28.338821 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e8c8fc81-2393-4bdb-ba99-509f01c601b6 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32" status: 200 len: 1390 microversion: 2.1 time: 0.534506 Aug 31 16:25:28.342702 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3117/6052] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:27 2022] GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32 => generated 1390 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:25:28.352848 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4776a6fd-8668-4139-9791-1379cae72cb8 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:28.353540 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4776a6fd-8668-4139-9791-1379cae72cb8 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] [instance: 1a332207-809f-4c2a-81d3-4bdab483fee0] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:28.383057 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4776a6fd-8668-4139-9791-1379cae72cb8 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:28.385401 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4776a6fd-8668-4139-9791-1379cae72cb8 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:28.386622 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4776a6fd-8668-4139-9791-1379cae72cb8 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:28.390481 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4776a6fd-8668-4139-9791-1379cae72cb8 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:28.392228 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4776a6fd-8668-4139-9791-1379cae72cb8 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:28.393112 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4776a6fd-8668-4139-9791-1379cae72cb8 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:28.394489 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7561aec6-cd8a-4f49-b99a-da33eb136788 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:28.408582 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7561aec6-cd8a-4f49-b99a-da33eb136788 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b" status: 200 len: 1678 microversion: 2.1 time: 0.755765 Aug 31 16:25:28.412559 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2936/6053] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:27 2022] GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b => generated 1678 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:28.447166 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5a79daef-46e9-4303-8110-0b2a02564f26 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:28.448039 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5a79daef-46e9-4303-8110-0b2a02564f26 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 37fb9349-5468-4dd6-bab3-47f29cb99b32] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:28.463899 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a79daef-46e9-4303-8110-0b2a02564f26 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:28.464847 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a79daef-46e9-4303-8110-0b2a02564f26 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:28.466793 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a79daef-46e9-4303-8110-0b2a02564f26 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:28.468107 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a79daef-46e9-4303-8110-0b2a02564f26 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:28.469947 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a79daef-46e9-4303-8110-0b2a02564f26 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:28.471904 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a79daef-46e9-4303-8110-0b2a02564f26 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:28.826114 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5a79daef-46e9-4303-8110-0b2a02564f26 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:28.841872 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5a79daef-46e9-4303-8110-0b2a02564f26 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32" status: 200 len: 1390 microversion: 2.1 time: 0.419789 Aug 31 16:25:28.842731 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2937/6054] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:28 2022] GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32 => generated 1390 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:28.867344 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-64601852-15dc-4fb4-a615-a5e459a5aadb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:28.867851 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-64601852-15dc-4fb4-a615-a5e459a5aadb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 37fb9349-5468-4dd6-bab3-47f29cb99b32] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:28.884169 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64601852-15dc-4fb4-a615-a5e459a5aadb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:28.884678 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64601852-15dc-4fb4-a615-a5e459a5aadb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:28.885126 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64601852-15dc-4fb4-a615-a5e459a5aadb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:28.891660 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64601852-15dc-4fb4-a615-a5e459a5aadb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:28.897886 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64601852-15dc-4fb4-a615-a5e459a5aadb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:28.898559 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64601852-15dc-4fb4-a615-a5e459a5aadb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:28.936358 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4776a6fd-8668-4139-9791-1379cae72cb8 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7e1b7368604169b3658a7415a3684e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25250299d5a45a3b6a18e22793f6232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:28.991797 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4776a6fd-8668-4139-9791-1379cae72cb8 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] 10.222.0.50 "GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0" status: 200 len: 1492 microversion: 2.1 time: 0.647702 Aug 31 16:25:29.000597 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3118/6055] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:28 2022] GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0 => generated 1492 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:29.023898 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d3bc9fde-17fe-45b0-b57d-61acc28ef28b tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:25:29.026425 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d3bc9fde-17fe-45b0-b57d-61acc28ef28b tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] [instance: 1a332207-809f-4c2a-81d3-4bdab483fee0] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:29.037823 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:25:29.044051 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d3bc9fde-17fe-45b0-b57d-61acc28ef28b tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:29.046364 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d3bc9fde-17fe-45b0-b57d-61acc28ef28b tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:29.050551 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d3bc9fde-17fe-45b0-b57d-61acc28ef28b tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:29.051600 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d3bc9fde-17fe-45b0-b57d-61acc28ef28b tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:29.052307 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d3bc9fde-17fe-45b0-b57d-61acc28ef28b tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:29.053777 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d3bc9fde-17fe-45b0-b57d-61acc28ef28b tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:29.074544 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-64601852-15dc-4fb4-a615-a5e459a5aadb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 37fb9349-5468-4dd6-bab3-47f29cb99b32] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:25:29.274538 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d3bc9fde-17fe-45b0-b57d-61acc28ef28b tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] 10.222.0.50 "POST /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0/action" status: 202 len: 0 microversion: 2.1 time: 0.262194 Aug 31 16:25:29.314784 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3119/6056] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:25:29 2022] POST /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:25:29.349244 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-64601852-15dc-4fb4-a615-a5e459a5aadb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "DELETE /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32" status: 204 len: 0 microversion: 2.1 time: 0.481628 Aug 31 16:25:29.356580 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2938/6057] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:25:28 2022] DELETE /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:25:29.368525 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9bcd4d65-3a3d-4e27-8823-cd633976f2ba tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:29.369390 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9bcd4d65-3a3d-4e27-8823-cd633976f2ba tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] [instance: 1a332207-809f-4c2a-81d3-4bdab483fee0] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:29.385445 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7449a7f8-84ef-47cd-8f1a-2da1e3e24c8a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:29.388670 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7449a7f8-84ef-47cd-8f1a-2da1e3e24c8a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 37fb9349-5468-4dd6-bab3-47f29cb99b32] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:29.398512 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9bcd4d65-3a3d-4e27-8823-cd633976f2ba tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:29.402805 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9bcd4d65-3a3d-4e27-8823-cd633976f2ba tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:29.405786 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9bcd4d65-3a3d-4e27-8823-cd633976f2ba tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:29.406903 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9bcd4d65-3a3d-4e27-8823-cd633976f2ba tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:29.411040 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9bcd4d65-3a3d-4e27-8823-cd633976f2ba tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:29.415899 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9bcd4d65-3a3d-4e27-8823-cd633976f2ba tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:29.443585 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7449a7f8-84ef-47cd-8f1a-2da1e3e24c8a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:29.450672 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7449a7f8-84ef-47cd-8f1a-2da1e3e24c8a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:29.452665 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7449a7f8-84ef-47cd-8f1a-2da1e3e24c8a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:29.453834 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7449a7f8-84ef-47cd-8f1a-2da1e3e24c8a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:29.461404 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7449a7f8-84ef-47cd-8f1a-2da1e3e24c8a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:29.462308 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7449a7f8-84ef-47cd-8f1a-2da1e3e24c8a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:30.050648 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9bcd4d65-3a3d-4e27-8823-cd633976f2ba tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7e1b7368604169b3658a7415a3684e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25250299d5a45a3b6a18e22793f6232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:30.066804 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9bcd4d65-3a3d-4e27-8823-cd633976f2ba tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] 10.222.0.50 "GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0" status: 200 len: 1498 microversion: 2.1 time: 0.743596 Aug 31 16:25:30.082553 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3120/6058] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:29 2022] GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0 => generated 1498 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:30.099356 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d4f7a544-f105-4a1d-907d-83498eb51119 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:30.100407 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d4f7a544-f105-4a1d-907d-83498eb51119 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:30.116611 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d4f7a544-f105-4a1d-907d-83498eb51119 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:30.127098 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d4f7a544-f105-4a1d-907d-83498eb51119 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:30.127562 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d4f7a544-f105-4a1d-907d-83498eb51119 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:30.128588 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d4f7a544-f105-4a1d-907d-83498eb51119 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:30.129050 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d4f7a544-f105-4a1d-907d-83498eb51119 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:30.129469 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d4f7a544-f105-4a1d-907d-83498eb51119 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:30.165022 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7449a7f8-84ef-47cd-8f1a-2da1e3e24c8a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:30.180664 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7449a7f8-84ef-47cd-8f1a-2da1e3e24c8a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32" status: 200 len: 1396 microversion: 2.1 time: 0.818686 Aug 31 16:25:30.185438 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2939/6059] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:29 2022] GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32 => generated 1396 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:30.465609 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d4f7a544-f105-4a1d-907d-83498eb51119 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:30.480743 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d4f7a544-f105-4a1d-907d-83498eb51119 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b" status: 200 len: 1678 microversion: 2.1 time: 0.396528 Aug 31 16:25:30.481694 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3121/6060] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:30 2022] GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b => generated 1678 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:31.092990 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-87e077b5-92ca-4b50-b89d-bfb1d3e2f83d tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:31.093610 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-87e077b5-92ca-4b50-b89d-bfb1d3e2f83d tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] [instance: 1a332207-809f-4c2a-81d3-4bdab483fee0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:31.113607 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-87e077b5-92ca-4b50-b89d-bfb1d3e2f83d tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:31.114133 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-87e077b5-92ca-4b50-b89d-bfb1d3e2f83d tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:31.116526 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-87e077b5-92ca-4b50-b89d-bfb1d3e2f83d tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:31.120150 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-87e077b5-92ca-4b50-b89d-bfb1d3e2f83d tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:31.120684 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-87e077b5-92ca-4b50-b89d-bfb1d3e2f83d tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:31.121332 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-87e077b5-92ca-4b50-b89d-bfb1d3e2f83d tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:31.206039 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d40425b4-f1c7-4715-8b39-333591e67439 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:31.209305 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d40425b4-f1c7-4715-8b39-333591e67439 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 37fb9349-5468-4dd6-bab3-47f29cb99b32] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:31.224982 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d40425b4-f1c7-4715-8b39-333591e67439 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:31.236823 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d40425b4-f1c7-4715-8b39-333591e67439 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:31.237299 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d40425b4-f1c7-4715-8b39-333591e67439 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:31.238033 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d40425b4-f1c7-4715-8b39-333591e67439 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:31.297314 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d40425b4-f1c7-4715-8b39-333591e67439 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.059s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:31.297771 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d40425b4-f1c7-4715-8b39-333591e67439 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:31.524636 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-87e077b5-92ca-4b50-b89d-bfb1d3e2f83d tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7e1b7368604169b3658a7415a3684e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25250299d5a45a3b6a18e22793f6232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:31.536583 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-87e077b5-92ca-4b50-b89d-bfb1d3e2f83d tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] 10.222.0.50 "GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0" status: 200 len: 1498 microversion: 2.1 time: 0.447116 Aug 31 16:25:31.552465 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2940/6061] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:31 2022] GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0 => generated 1498 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:25:31.558571 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f5f65e01-1d3d-483f-bada-e08e76d8a5cb tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:31.559294 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f5f65e01-1d3d-483f-bada-e08e76d8a5cb tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:31.569320 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5f65e01-1d3d-483f-bada-e08e76d8a5cb tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:31.572751 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5f65e01-1d3d-483f-bada-e08e76d8a5cb tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:31.573601 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5f65e01-1d3d-483f-bada-e08e76d8a5cb tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:31.574500 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5f65e01-1d3d-483f-bada-e08e76d8a5cb tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:31.575517 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5f65e01-1d3d-483f-bada-e08e76d8a5cb tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:31.576253 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5f65e01-1d3d-483f-bada-e08e76d8a5cb tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:31.669548 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d40425b4-f1c7-4715-8b39-333591e67439 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:31.684614 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d40425b4-f1c7-4715-8b39-333591e67439 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32" status: 200 len: 1396 microversion: 2.1 time: 0.484519 Aug 31 16:25:31.690890 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3122/6062] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:31 2022] GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32 => generated 1396 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:31.923658 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f5f65e01-1d3d-483f-bada-e08e76d8a5cb tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:31.935523 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f5f65e01-1d3d-483f-bada-e08e76d8a5cb tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b" status: 200 len: 1678 microversion: 2.1 time: 0.381435 Aug 31 16:25:31.936511 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2941/6063] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:31 2022] GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b => generated 1678 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:32.560100 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0b3cb519-b535-4414-bcb6-c3b20d99c6dc tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:32.561035 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0b3cb519-b535-4414-bcb6-c3b20d99c6dc tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] [instance: 1a332207-809f-4c2a-81d3-4bdab483fee0] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:32.581170 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0b3cb519-b535-4414-bcb6-c3b20d99c6dc tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:32.582415 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0b3cb519-b535-4414-bcb6-c3b20d99c6dc tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:32.583461 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0b3cb519-b535-4414-bcb6-c3b20d99c6dc tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:32.584443 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0b3cb519-b535-4414-bcb6-c3b20d99c6dc tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:32.587801 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0b3cb519-b535-4414-bcb6-c3b20d99c6dc tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:32.588972 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0b3cb519-b535-4414-bcb6-c3b20d99c6dc tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:32.716164 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f4ed330f-4e1b-45c5-b246-da45b880be14 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:32.716837 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f4ed330f-4e1b-45c5-b246-da45b880be14 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 37fb9349-5468-4dd6-bab3-47f29cb99b32] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:32.748869 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4ed330f-4e1b-45c5-b246-da45b880be14 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:32.756430 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4ed330f-4e1b-45c5-b246-da45b880be14 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:32.761291 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4ed330f-4e1b-45c5-b246-da45b880be14 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:32.763809 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4ed330f-4e1b-45c5-b246-da45b880be14 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:32.768549 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4ed330f-4e1b-45c5-b246-da45b880be14 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:32.770452 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4ed330f-4e1b-45c5-b246-da45b880be14 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:33.118287 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0b3cb519-b535-4414-bcb6-c3b20d99c6dc tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7e1b7368604169b3658a7415a3684e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25250299d5a45a3b6a18e22793f6232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:33.127737 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0b3cb519-b535-4414-bcb6-c3b20d99c6dc tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] 10.222.0.50 "GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0" status: 200 len: 1498 microversion: 2.1 time: 0.572806 Aug 31 16:25:33.130549 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3123/6064] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:32 2022] GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0 => generated 1498 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:33.170755 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d0595809-c763-484b-8460-e249d26fd2aa tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:33.175493 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d0595809-c763-484b-8460-e249d26fd2aa tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:33.195660 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d0595809-c763-484b-8460-e249d26fd2aa tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:33.198748 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d0595809-c763-484b-8460-e249d26fd2aa tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:33.199558 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d0595809-c763-484b-8460-e249d26fd2aa tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:33.200570 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d0595809-c763-484b-8460-e249d26fd2aa tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:33.204037 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d0595809-c763-484b-8460-e249d26fd2aa tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:33.205220 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d0595809-c763-484b-8460-e249d26fd2aa tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:33.270199 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f4ed330f-4e1b-45c5-b246-da45b880be14 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:33.279809 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f4ed330f-4e1b-45c5-b246-da45b880be14 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32" status: 200 len: 1396 microversion: 2.1 time: 0.568253 Aug 31 16:25:33.291234 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2942/6065] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:32 2022] GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32 => generated 1396 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:33.482338 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d0595809-c763-484b-8460-e249d26fd2aa tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:33.491726 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d0595809-c763-484b-8460-e249d26fd2aa tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b" status: 200 len: 1678 microversion: 2.1 time: 0.359615 Aug 31 16:25:33.494534 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3124/6066] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:33 2022] GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b => generated 1678 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:34.148905 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9049266e-f07b-4697-8747-09319a6d6106 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:34.150505 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9049266e-f07b-4697-8747-09319a6d6106 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] [instance: 1a332207-809f-4c2a-81d3-4bdab483fee0] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:34.164165 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9049266e-f07b-4697-8747-09319a6d6106 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:34.166922 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9049266e-f07b-4697-8747-09319a6d6106 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:34.169027 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9049266e-f07b-4697-8747-09319a6d6106 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:34.170199 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9049266e-f07b-4697-8747-09319a6d6106 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:34.170911 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9049266e-f07b-4697-8747-09319a6d6106 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:34.171847 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9049266e-f07b-4697-8747-09319a6d6106 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:34.351504 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-5f1ceea8-337f-4691-9866-222452bc4bfa req-4cc5d181-b20a-4e3b-b33f-ef1372b4fd1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37fb9349-5468-4dd6-bab3-47f29cb99b32", "name": "network-vif-deleted", "tag": "7608c4e5-e798-4d4a-b97a-4d336d5a3792"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:25:34.384280 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5f1ceea8-337f-4691-9866-222452bc4bfa req-4cc5d181-b20a-4e3b-b33f-ef1372b4fd1d service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:34.390331 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5f1ceea8-337f-4691-9866-222452bc4bfa req-4cc5d181-b20a-4e3b-b33f-ef1372b4fd1d service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:34.391229 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5f1ceea8-337f-4691-9866-222452bc4bfa req-4cc5d181-b20a-4e3b-b33f-ef1372b4fd1d service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:34.450592 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-5f1ceea8-337f-4691-9866-222452bc4bfa req-4cc5d181-b20a-4e3b-b33f-ef1372b4fd1d service nova] Creating event network-vif-deleted:7608c4e5-e798-4d4a-b97a-4d336d5a3792 for instance 37fb9349-5468-4dd6-bab3-47f29cb99b32 on n-h1-833090-16 Aug 31 16:25:34.463627 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9049266e-f07b-4697-8747-09319a6d6106 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7e1b7368604169b3658a7415a3684e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25250299d5a45a3b6a18e22793f6232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:34.467484 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-5f1ceea8-337f-4691-9866-222452bc4bfa req-4cc5d181-b20a-4e3b-b33f-ef1372b4fd1d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.574007 Aug 31 16:25:34.473156 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2943/6067] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:25:34.476160 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9049266e-f07b-4697-8747-09319a6d6106 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] 10.222.0.50 "GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0" status: 200 len: 1498 microversion: 2.1 time: 0.330723 Aug 31 16:25:34.477234 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3125/6068] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:34 2022] GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0 => generated 1498 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:34.495994 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-07a27d5d-c40a-463b-9c60-02781fee77d4 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:34.499200 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-07a27d5d-c40a-463b-9c60-02781fee77d4 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 37fb9349-5468-4dd6-bab3-47f29cb99b32] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:34.518007 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-dfa53953-a6bb-48a7-9dd6-3c22b0de34c2 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:34.518732 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-dfa53953-a6bb-48a7-9dd6-3c22b0de34c2 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:34.529495 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dfa53953-a6bb-48a7-9dd6-3c22b0de34c2 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:34.530808 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-07a27d5d-c40a-463b-9c60-02781fee77d4 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:34.531303 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-07a27d5d-c40a-463b-9c60-02781fee77d4 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:34.531733 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-07a27d5d-c40a-463b-9c60-02781fee77d4 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:34.533467 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dfa53953-a6bb-48a7-9dd6-3c22b0de34c2 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:34.536527 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-07a27d5d-c40a-463b-9c60-02781fee77d4 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:34.537940 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dfa53953-a6bb-48a7-9dd6-3c22b0de34c2 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:34.538818 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dfa53953-a6bb-48a7-9dd6-3c22b0de34c2 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:34.539357 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dfa53953-a6bb-48a7-9dd6-3c22b0de34c2 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:34.539732 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dfa53953-a6bb-48a7-9dd6-3c22b0de34c2 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:34.541531 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-07a27d5d-c40a-463b-9c60-02781fee77d4 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:34.542022 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-07a27d5d-c40a-463b-9c60-02781fee77d4 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:34.882670 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-07a27d5d-c40a-463b-9c60-02781fee77d4 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:34.894357 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-07a27d5d-c40a-463b-9c60-02781fee77d4 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32" status: 200 len: 1188 microversion: 2.1 time: 0.418281 Aug 31 16:25:34.915337 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2944/6069] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:34 2022] GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32 => generated 1188 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:34.954806 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-dfa53953-a6bb-48a7-9dd6-3c22b0de34c2 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:34.970666 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-dfa53953-a6bb-48a7-9dd6-3c22b0de34c2 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b" status: 200 len: 1678 microversion: 2.1 time: 0.456028 Aug 31 16:25:34.971507 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3126/6070] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:34 2022] GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b => generated 1678 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:25:35.503871 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4035de79-6313-41c4-953d-6a2f02640d6b tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:35.505530 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4035de79-6313-41c4-953d-6a2f02640d6b tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] [instance: 1a332207-809f-4c2a-81d3-4bdab483fee0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:35.515599 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4035de79-6313-41c4-953d-6a2f02640d6b tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:35.516429 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4035de79-6313-41c4-953d-6a2f02640d6b tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:35.517557 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4035de79-6313-41c4-953d-6a2f02640d6b tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:35.519519 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4035de79-6313-41c4-953d-6a2f02640d6b tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:35.520164 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4035de79-6313-41c4-953d-6a2f02640d6b tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:35.524015 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4035de79-6313-41c4-953d-6a2f02640d6b tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:35.920988 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9c2ea7ab-df7b-44e7-91b4-46ff55226671 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:35.921602 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9c2ea7ab-df7b-44e7-91b4-46ff55226671 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 37fb9349-5468-4dd6-bab3-47f29cb99b32] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:35.941597 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4035de79-6313-41c4-953d-6a2f02640d6b tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7e1b7368604169b3658a7415a3684e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25250299d5a45a3b6a18e22793f6232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:35.950486 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9c2ea7ab-df7b-44e7-91b4-46ff55226671 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:35.951030 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9c2ea7ab-df7b-44e7-91b4-46ff55226671 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:35.956257 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4035de79-6313-41c4-953d-6a2f02640d6b tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] 10.222.0.50 "GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0" status: 200 len: 1501 microversion: 2.1 time: 0.458302 Aug 31 16:25:35.958561 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9c2ea7ab-df7b-44e7-91b4-46ff55226671 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:35.959595 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9c2ea7ab-df7b-44e7-91b4-46ff55226671 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:35.960084 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9c2ea7ab-df7b-44e7-91b4-46ff55226671 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:35.960253 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2945/6071] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:35 2022] GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0 => generated 1501 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:35.966608 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9c2ea7ab-df7b-44e7-91b4-46ff55226671 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:35.984383 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:25:35.984973 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-eb8c1d2a-4d03-4549-8507-08b40173932b tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:25:35.985880 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-eb8c1d2a-4d03-4549-8507-08b40173932b tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] [instance: 1a332207-809f-4c2a-81d3-4bdab483fee0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:35.997532 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb8c1d2a-4d03-4549-8507-08b40173932b tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:36.001864 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb8c1d2a-4d03-4549-8507-08b40173932b tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:36.002718 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb8c1d2a-4d03-4549-8507-08b40173932b tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:36.003908 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb8c1d2a-4d03-4549-8507-08b40173932b tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:36.007330 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb8c1d2a-4d03-4549-8507-08b40173932b tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:36.007995 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb8c1d2a-4d03-4549-8507-08b40173932b tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:36.088178 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-eb8c1d2a-4d03-4549-8507-08b40173932b tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lazy-loading 'flavor' on Instance uuid 1a332207-809f-4c2a-81d3-4bdab483fee0 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:25:36.259899 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9c2ea7ab-df7b-44e7-91b4-46ff55226671 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:36.279590 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9c2ea7ab-df7b-44e7-91b4-46ff55226671 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32" status: 200 len: 1188 microversion: 2.1 time: 0.363091 Aug 31 16:25:36.286563 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-eb8c1d2a-4d03-4549-8507-08b40173932b tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] 10.222.0.50 "POST /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0/action" status: 202 len: 0 microversion: 2.1 time: 0.302350 Aug 31 16:25:36.289095 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2946/6072] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:25:35 2022] POST /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:25:36.300761 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3127/6073] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:35 2022] GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32 => generated 1188 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:36.315469 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b3033e4d-926c-4ca5-afa6-a127394cdc8f tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:36.320244 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b3033e4d-926c-4ca5-afa6-a127394cdc8f tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] [instance: 1a332207-809f-4c2a-81d3-4bdab483fee0] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:36.330145 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a9c69870-aaf4-4167-9015-4bfd93e0a8cc tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:36.330862 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a9c69870-aaf4-4167-9015-4bfd93e0a8cc tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:36.343725 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b3033e4d-926c-4ca5-afa6-a127394cdc8f tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:36.344368 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b3033e4d-926c-4ca5-afa6-a127394cdc8f tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:36.345036 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b3033e4d-926c-4ca5-afa6-a127394cdc8f tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:36.345857 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b3033e4d-926c-4ca5-afa6-a127394cdc8f tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:36.346439 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b3033e4d-926c-4ca5-afa6-a127394cdc8f tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:36.346868 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b3033e4d-926c-4ca5-afa6-a127394cdc8f tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:36.359615 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9c69870-aaf4-4167-9015-4bfd93e0a8cc tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:36.363829 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9c69870-aaf4-4167-9015-4bfd93e0a8cc tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:36.364618 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9c69870-aaf4-4167-9015-4bfd93e0a8cc tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:36.370372 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9c69870-aaf4-4167-9015-4bfd93e0a8cc tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:36.371238 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9c69870-aaf4-4167-9015-4bfd93e0a8cc tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:36.377805 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9c69870-aaf4-4167-9015-4bfd93e0a8cc tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:36.892467 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b3033e4d-926c-4ca5-afa6-a127394cdc8f tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7e1b7368604169b3658a7415a3684e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25250299d5a45a3b6a18e22793f6232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:36.902162 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b3033e4d-926c-4ca5-afa6-a127394cdc8f tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] 10.222.0.50 "GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0" status: 200 len: 1509 microversion: 2.1 time: 0.599887 Aug 31 16:25:36.909107 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3128/6074] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:36 2022] GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0 => generated 1509 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:36.929820 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a9c69870-aaf4-4167-9015-4bfd93e0a8cc tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:36.944283 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a9c69870-aaf4-4167-9015-4bfd93e0a8cc tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b" status: 200 len: 1678 microversion: 2.1 time: 0.650734 Aug 31 16:25:36.945877 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2947/6075] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:36 2022] GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b => generated 1678 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:37.307118 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3f778ed3-c431-4484-9daa-3195a75628a9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:37.307844 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3f778ed3-c431-4484-9daa-3195a75628a9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 37fb9349-5468-4dd6-bab3-47f29cb99b32] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:37.333909 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3f778ed3-c431-4484-9daa-3195a75628a9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:37.335565 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3f778ed3-c431-4484-9daa-3195a75628a9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:37.336615 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3f778ed3-c431-4484-9daa-3195a75628a9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:37.340459 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3f778ed3-c431-4484-9daa-3195a75628a9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:37.343569 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3f778ed3-c431-4484-9daa-3195a75628a9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:37.345278 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3f778ed3-c431-4484-9daa-3195a75628a9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:37.519391 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3f778ed3-c431-4484-9daa-3195a75628a9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:37.534164 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3f778ed3-c431-4484-9daa-3195a75628a9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32" status: 200 len: 1188 microversion: 2.1 time: 0.231920 Aug 31 16:25:37.535410 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3129/6076] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:37 2022] GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32 => generated 1188 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:37.931869 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2ac0c55b-10c4-4785-8df0-4e89d8bde9ea tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:37.932463 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2ac0c55b-10c4-4785-8df0-4e89d8bde9ea tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] [instance: 1a332207-809f-4c2a-81d3-4bdab483fee0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:37.952296 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ac0c55b-10c4-4785-8df0-4e89d8bde9ea tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:37.952795 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ac0c55b-10c4-4785-8df0-4e89d8bde9ea tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:37.953229 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ac0c55b-10c4-4785-8df0-4e89d8bde9ea tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:37.953943 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ac0c55b-10c4-4785-8df0-4e89d8bde9ea tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:37.954509 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ac0c55b-10c4-4785-8df0-4e89d8bde9ea tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:37.954871 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ac0c55b-10c4-4785-8df0-4e89d8bde9ea tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:37.965533 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-081681e1-99f3-4e5a-8af3-938bc0d01828 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:37.966595 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-081681e1-99f3-4e5a-8af3-938bc0d01828 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:37.980136 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-081681e1-99f3-4e5a-8af3-938bc0d01828 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:37.982303 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-081681e1-99f3-4e5a-8af3-938bc0d01828 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:37.983049 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-081681e1-99f3-4e5a-8af3-938bc0d01828 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:37.989522 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-081681e1-99f3-4e5a-8af3-938bc0d01828 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:37.991377 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-081681e1-99f3-4e5a-8af3-938bc0d01828 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:37.992424 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-081681e1-99f3-4e5a-8af3-938bc0d01828 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:38.536107 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-081681e1-99f3-4e5a-8af3-938bc0d01828 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:38.555633 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-081681e1-99f3-4e5a-8af3-938bc0d01828 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b" status: 200 len: 1678 microversion: 2.1 time: 0.594477 Aug 31 16:25:38.556726 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3130/6077] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:37 2022] GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b => generated 1678 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:38.567314 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-48051b36-ac6a-416f-84b1-562c2c3428c0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:38.572465 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-48051b36-ac6a-416f-84b1-562c2c3428c0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 37fb9349-5468-4dd6-bab3-47f29cb99b32] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:38.590525 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-48051b36-ac6a-416f-84b1-562c2c3428c0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:38.592720 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-48051b36-ac6a-416f-84b1-562c2c3428c0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:38.599223 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-48051b36-ac6a-416f-84b1-562c2c3428c0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:38.600281 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-48051b36-ac6a-416f-84b1-562c2c3428c0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:38.600932 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-48051b36-ac6a-416f-84b1-562c2c3428c0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:38.601572 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-48051b36-ac6a-416f-84b1-562c2c3428c0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:38.616253 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2ac0c55b-10c4-4785-8df0-4e89d8bde9ea tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7e1b7368604169b3658a7415a3684e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25250299d5a45a3b6a18e22793f6232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:38.650664 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2ac0c55b-10c4-4785-8df0-4e89d8bde9ea tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] 10.222.0.50 "GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0" status: 200 len: 1492 microversion: 2.1 time: 0.722446 Aug 31 16:25:38.652709 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2948/6078] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:37 2022] GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0 => generated 1492 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:38.679126 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0f9f2c76-954d-4de1-9b5b-7d83095f445a tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:25:38.680443 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0f9f2c76-954d-4de1-9b5b-7d83095f445a tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] [instance: 1a332207-809f-4c2a-81d3-4bdab483fee0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:38.705118 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-48051b36-ac6a-416f-84b1-562c2c3428c0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:38.705828 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f9f2c76-954d-4de1-9b5b-7d83095f445a tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:38.706396 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f9f2c76-954d-4de1-9b5b-7d83095f445a tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:38.706791 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f9f2c76-954d-4de1-9b5b-7d83095f445a tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:38.707509 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f9f2c76-954d-4de1-9b5b-7d83095f445a tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:38.707955 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f9f2c76-954d-4de1-9b5b-7d83095f445a tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:38.710773 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f9f2c76-954d-4de1-9b5b-7d83095f445a tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:38.734893 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-48051b36-ac6a-416f-84b1-562c2c3428c0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32" status: 200 len: 1188 microversion: 2.1 time: 0.176365 Aug 31 16:25:38.747448 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3131/6079] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:38 2022] GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32 => generated 1188 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:38.843246 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0f9f2c76-954d-4de1-9b5b-7d83095f445a tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] 10.222.0.50 "POST /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0/action" status: 202 len: 0 microversion: 2.1 time: 0.171043 Aug 31 16:25:38.847376 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2949/6080] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:25:38 2022] POST /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 16:25:38.853006 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-31e2d96e-5719-49d5-a7a0-e512da6f5583 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:38.853764 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-31e2d96e-5719-49d5-a7a0-e512da6f5583 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] [instance: 1a332207-809f-4c2a-81d3-4bdab483fee0] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:38.865605 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-31e2d96e-5719-49d5-a7a0-e512da6f5583 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:38.866979 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-31e2d96e-5719-49d5-a7a0-e512da6f5583 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:38.868412 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-31e2d96e-5719-49d5-a7a0-e512da6f5583 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:38.870177 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-31e2d96e-5719-49d5-a7a0-e512da6f5583 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:38.871541 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-31e2d96e-5719-49d5-a7a0-e512da6f5583 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:38.873393 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-31e2d96e-5719-49d5-a7a0-e512da6f5583 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:39.194913 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-31e2d96e-5719-49d5-a7a0-e512da6f5583 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7e1b7368604169b3658a7415a3684e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25250299d5a45a3b6a18e22793f6232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:39.205754 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-31e2d96e-5719-49d5-a7a0-e512da6f5583 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] 10.222.0.50 "GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0" status: 200 len: 1498 microversion: 2.1 time: 0.356953 Aug 31 16:25:39.210262 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3132/6081] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:38 2022] GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0 => generated 1498 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:39.579391 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-72ac03b7-5d32-48b0-8c71-c39e9c5ab9f5 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:39.581115 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-72ac03b7-5d32-48b0-8c71-c39e9c5ab9f5 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:39.601750 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72ac03b7-5d32-48b0-8c71-c39e9c5ab9f5 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:39.602338 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72ac03b7-5d32-48b0-8c71-c39e9c5ab9f5 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:39.611006 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72ac03b7-5d32-48b0-8c71-c39e9c5ab9f5 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:39.612194 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72ac03b7-5d32-48b0-8c71-c39e9c5ab9f5 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:39.612897 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72ac03b7-5d32-48b0-8c71-c39e9c5ab9f5 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:39.613576 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72ac03b7-5d32-48b0-8c71-c39e9c5ab9f5 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:39.761302 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e844c966-f569-4c59-999e-afad0ec3c3c0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:39.762016 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e844c966-f569-4c59-999e-afad0ec3c3c0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 37fb9349-5468-4dd6-bab3-47f29cb99b32] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:39.774360 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e844c966-f569-4c59-999e-afad0ec3c3c0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:39.783421 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e844c966-f569-4c59-999e-afad0ec3c3c0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:39.784027 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e844c966-f569-4c59-999e-afad0ec3c3c0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:39.784971 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e844c966-f569-4c59-999e-afad0ec3c3c0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:39.785634 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e844c966-f569-4c59-999e-afad0ec3c3c0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:39.787442 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e844c966-f569-4c59-999e-afad0ec3c3c0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:40.203992 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e844c966-f569-4c59-999e-afad0ec3c3c0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:40.229587 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e844c966-f569-4c59-999e-afad0ec3c3c0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32" status: 200 len: 1188 microversion: 2.1 time: 0.472520 Aug 31 16:25:40.241308 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3133/6082] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:39 2022] GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32 => generated 1188 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:25:40.252733 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b821b202-d84f-4be8-8fb4-52f8f2357ba6 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:40.255207 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b821b202-d84f-4be8-8fb4-52f8f2357ba6 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] [instance: 1a332207-809f-4c2a-81d3-4bdab483fee0] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:40.268868 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b821b202-d84f-4be8-8fb4-52f8f2357ba6 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:40.275389 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b821b202-d84f-4be8-8fb4-52f8f2357ba6 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:40.276100 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b821b202-d84f-4be8-8fb4-52f8f2357ba6 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:40.277082 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b821b202-d84f-4be8-8fb4-52f8f2357ba6 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:40.277767 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b821b202-d84f-4be8-8fb4-52f8f2357ba6 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:40.278467 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b821b202-d84f-4be8-8fb4-52f8f2357ba6 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:40.278874 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-72ac03b7-5d32-48b0-8c71-c39e9c5ab9f5 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:40.305271 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-72ac03b7-5d32-48b0-8c71-c39e9c5ab9f5 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b" status: 200 len: 1655 microversion: 2.1 time: 0.723103 Aug 31 16:25:40.311621 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2950/6083] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:39 2022] GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b => generated 1655 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:40.353475 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6d87025f-0475-4058-9cf6-75c99b275cc6 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:25:40.382818 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d87025f-0475-4058-9cf6-75c99b275cc6 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:40.387016 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d87025f-0475-4058-9cf6-75c99b275cc6 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:40.389520 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d87025f-0475-4058-9cf6-75c99b275cc6 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:40.452165 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:25:40.523803 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6d87025f-0475-4058-9cf6-75c99b275cc6 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] Going to try to start instance {{(pid=128863) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 31 16:25:40.591173 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b821b202-d84f-4be8-8fb4-52f8f2357ba6 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7e1b7368604169b3658a7415a3684e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25250299d5a45a3b6a18e22793f6232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:40.614541 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b821b202-d84f-4be8-8fb4-52f8f2357ba6 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] 10.222.0.50 "GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0" status: 200 len: 1498 microversion: 2.1 time: 0.370342 Aug 31 16:25:40.615539 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3134/6084] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:40 2022] GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0 => generated 1498 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:40.686604 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6d87025f-0475-4058-9cf6-75c99b275cc6 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "POST /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b/action" status: 202 len: 0 microversion: 2.1 time: 0.338600 Aug 31 16:25:40.688551 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2951/6085] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:25:40 2022] POST /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b/action => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 16:25:40.701484 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-68a5064e-db15-4e56-82a2-4b3412b19654 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:40.705962 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-68a5064e-db15-4e56-82a2-4b3412b19654 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:40.735964 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68a5064e-db15-4e56-82a2-4b3412b19654 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:40.737649 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68a5064e-db15-4e56-82a2-4b3412b19654 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:40.740988 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68a5064e-db15-4e56-82a2-4b3412b19654 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:40.745711 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68a5064e-db15-4e56-82a2-4b3412b19654 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:40.749953 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68a5064e-db15-4e56-82a2-4b3412b19654 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:40.752693 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68a5064e-db15-4e56-82a2-4b3412b19654 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:41.184273 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-68a5064e-db15-4e56-82a2-4b3412b19654 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:41.197964 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-68a5064e-db15-4e56-82a2-4b3412b19654 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b" status: 200 len: 1664 microversion: 2.1 time: 0.504668 Aug 31 16:25:41.198957 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3135/6086] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:40 2022] GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b => generated 1664 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:41.309925 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b0b8e0d9-7d16-48ed-a5b7-72b2f93c58dd tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:41.310971 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b0b8e0d9-7d16-48ed-a5b7-72b2f93c58dd tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 37fb9349-5468-4dd6-bab3-47f29cb99b32] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:41.319921 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0b8e0d9-7d16-48ed-a5b7-72b2f93c58dd tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:41.321198 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0b8e0d9-7d16-48ed-a5b7-72b2f93c58dd tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:41.321802 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0b8e0d9-7d16-48ed-a5b7-72b2f93c58dd tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:41.325195 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0b8e0d9-7d16-48ed-a5b7-72b2f93c58dd tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:41.330948 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0b8e0d9-7d16-48ed-a5b7-72b2f93c58dd tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:41.331703 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b0b8e0d9-7d16-48ed-a5b7-72b2f93c58dd tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:41.493255 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b0b8e0d9-7d16-48ed-a5b7-72b2f93c58dd tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:41.508258 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b0b8e0d9-7d16-48ed-a5b7-72b2f93c58dd tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32" status: 200 len: 1188 microversion: 2.1 time: 0.229995 Aug 31 16:25:41.522176 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2952/6087] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:41 2022] GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32 => generated 1188 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:41.641689 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-01ee4b40-ae61-4995-b319-b350ab1d732e tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:41.644459 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-01ee4b40-ae61-4995-b319-b350ab1d732e tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] [instance: 1a332207-809f-4c2a-81d3-4bdab483fee0] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:41.668074 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01ee4b40-ae61-4995-b319-b350ab1d732e tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:41.669368 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01ee4b40-ae61-4995-b319-b350ab1d732e tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:41.682241 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01ee4b40-ae61-4995-b319-b350ab1d732e tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:41.692730 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01ee4b40-ae61-4995-b319-b350ab1d732e tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:41.698926 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01ee4b40-ae61-4995-b319-b350ab1d732e tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:41.699434 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01ee4b40-ae61-4995-b319-b350ab1d732e tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:42.175337 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-01ee4b40-ae61-4995-b319-b350ab1d732e tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7e1b7368604169b3658a7415a3684e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25250299d5a45a3b6a18e22793f6232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:42.190925 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-01ee4b40-ae61-4995-b319-b350ab1d732e tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] 10.222.0.50 "GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0" status: 200 len: 1498 microversion: 2.1 time: 0.555073 Aug 31 16:25:42.191770 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3136/6088] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:41 2022] GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0 => generated 1498 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:42.247391 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ce0850e6-f414-4143-8162-cd37fe4ed8c7 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:42.248325 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ce0850e6-f414-4143-8162-cd37fe4ed8c7 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:42.280484 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce0850e6-f414-4143-8162-cd37fe4ed8c7 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:42.281424 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce0850e6-f414-4143-8162-cd37fe4ed8c7 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:42.282229 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce0850e6-f414-4143-8162-cd37fe4ed8c7 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:42.291628 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce0850e6-f414-4143-8162-cd37fe4ed8c7 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:42.297421 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce0850e6-f414-4143-8162-cd37fe4ed8c7 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:42.298057 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ce0850e6-f414-4143-8162-cd37fe4ed8c7 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:42.675326 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ce0850e6-f414-4143-8162-cd37fe4ed8c7 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:42.687114 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ce0850e6-f414-4143-8162-cd37fe4ed8c7 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b" status: 200 len: 1664 microversion: 2.1 time: 0.470402 Aug 31 16:25:42.691301 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2953/6089] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:42 2022] GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b => generated 1664 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:42.710643 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a59ee67f-fdcf-430f-b216-59d58c79a50e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:42.717505 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a59ee67f-fdcf-430f-b216-59d58c79a50e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 37fb9349-5468-4dd6-bab3-47f29cb99b32] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:42.734965 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a59ee67f-fdcf-430f-b216-59d58c79a50e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:42.738569 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a59ee67f-fdcf-430f-b216-59d58c79a50e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:42.740015 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a59ee67f-fdcf-430f-b216-59d58c79a50e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:42.745784 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a59ee67f-fdcf-430f-b216-59d58c79a50e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:42.746841 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a59ee67f-fdcf-430f-b216-59d58c79a50e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:42.747497 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a59ee67f-fdcf-430f-b216-59d58c79a50e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:42.927529 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1bb912fe-2448-4b0f-a5e9-69fe33ab9cea tempest-TestAggregatesBasicOps-862310563 tempest-TestAggregatesBasicOps-862310563-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-128205536", "availability_zone": "foo_zone"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:25:42.929572 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a59ee67f-fdcf-430f-b216-59d58c79a50e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:42.931522 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.aggregate [None req-1bb912fe-2448-4b0f-a5e9-69fe33ab9cea tempest-TestAggregatesBasicOps-862310563 tempest-TestAggregatesBasicOps-862310563-project-admin] Generated uuid cd67542c-d1cc-4ffe-8761-95e2f5def52b for aggregate {{(pid=128864) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 31 16:25:42.943720 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a59ee67f-fdcf-430f-b216-59d58c79a50e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32" status: 200 len: 1188 microversion: 2.1 time: 0.246286 Aug 31 16:25:42.944753 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2954/6090] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:42 2022] GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32 => generated 1188 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:43.015250 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1bb912fe-2448-4b0f-a5e9-69fe33ab9cea tempest-TestAggregatesBasicOps-862310563 tempest-TestAggregatesBasicOps-862310563-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.591236 Aug 31 16:25:43.018131 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3137/6091] 10.222.0.50 () {60 vars in 1164 bytes} [Wed Aug 31 16:25:42 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:25:43.031617 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a2cee777-786a-4d83-ab20-c68ed7734fac tempest-TestAggregatesBasicOps-862310563 tempest-TestAggregatesBasicOps-862310563-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:25:43.089604 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a2cee777-786a-4d83-ab20-c68ed7734fac tempest-TestAggregatesBasicOps-862310563 tempest-TestAggregatesBasicOps-862310563-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.061920 Aug 31 16:25:43.091529 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2955/6092] 10.222.0.50 () {60 vars in 1194 bytes} [Wed Aug 31 16:25:43 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:25:43.110387 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5af530d9-eaa0-4beb-980e-60d6bb1d0a75 tempest-TestAggregatesBasicOps-862310563 tempest-TestAggregatesBasicOps-862310563-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:43.116005 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5af530d9-eaa0-4beb-980e-60d6bb1d0a75 tempest-TestAggregatesBasicOps-862310563 tempest-TestAggregatesBasicOps-862310563-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:43.117132 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5af530d9-eaa0-4beb-980e-60d6bb1d0a75 tempest-TestAggregatesBasicOps-862310563 tempest-TestAggregatesBasicOps-862310563-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:43.117745 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5af530d9-eaa0-4beb-980e-60d6bb1d0a75 tempest-TestAggregatesBasicOps-862310563 tempest-TestAggregatesBasicOps-862310563-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:43.118756 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5af530d9-eaa0-4beb-980e-60d6bb1d0a75 tempest-TestAggregatesBasicOps-862310563 tempest-TestAggregatesBasicOps-862310563-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:43.119398 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5af530d9-eaa0-4beb-980e-60d6bb1d0a75 tempest-TestAggregatesBasicOps-862310563 tempest-TestAggregatesBasicOps-862310563-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:43.119988 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5af530d9-eaa0-4beb-980e-60d6bb1d0a75 tempest-TestAggregatesBasicOps-862310563 tempest-TestAggregatesBasicOps-862310563-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:43.163601 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5af530d9-eaa0-4beb-980e-60d6bb1d0a75 tempest-TestAggregatesBasicOps-862310563 tempest-TestAggregatesBasicOps-862310563-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.060658 Aug 31 16:25:43.165659 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3138/6093] 10.222.0.50 () {58 vars in 1176 bytes} [Wed Aug 31 16:25:43 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:25:43.176594 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8cb84f39-5f4e-4699-a648-31f4f08a8e87 tempest-TestAggregatesBasicOps-862310563 tempest-TestAggregatesBasicOps-862310563-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:43.195099 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8cb84f39-5f4e-4699-a648-31f4f08a8e87 tempest-TestAggregatesBasicOps-862310563 tempest-TestAggregatesBasicOps-862310563-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.023180 Aug 31 16:25:43.195690 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2956/6094] 10.222.0.50 () {58 vars in 1143 bytes} [Wed Aug 31 16:25:43 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:25:43.211522 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-31789d3c-3d87-459d-a961-29dddca83b19 tempest-TestAggregatesBasicOps-862310563 tempest-TestAggregatesBasicOps-862310563-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-833090-16"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:25:43.235222 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d40528c3-b468-4253-a96a-e3f31309cd3d tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:43.236354 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d40528c3-b468-4253-a96a-e3f31309cd3d tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] [instance: 1a332207-809f-4c2a-81d3-4bdab483fee0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:43.241390 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-31789d3c-3d87-459d-a961-29dddca83b19 tempest-TestAggregatesBasicOps-862310563 tempest-TestAggregatesBasicOps-862310563-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:43.244580 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-31789d3c-3d87-459d-a961-29dddca83b19 tempest-TestAggregatesBasicOps-862310563 tempest-TestAggregatesBasicOps-862310563-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:43.245077 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-31789d3c-3d87-459d-a961-29dddca83b19 tempest-TestAggregatesBasicOps-862310563 tempest-TestAggregatesBasicOps-862310563-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:43.254869 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d40528c3-b468-4253-a96a-e3f31309cd3d tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:43.255905 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d40528c3-b468-4253-a96a-e3f31309cd3d tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:43.257134 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d40528c3-b468-4253-a96a-e3f31309cd3d tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:43.260505 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d40528c3-b468-4253-a96a-e3f31309cd3d tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:43.261414 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d40528c3-b468-4253-a96a-e3f31309cd3d tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:43.262052 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d40528c3-b468-4253-a96a-e3f31309cd3d tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:43.624617 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d40528c3-b468-4253-a96a-e3f31309cd3d tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7e1b7368604169b3658a7415a3684e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25250299d5a45a3b6a18e22793f6232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:43.640227 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d40528c3-b468-4253-a96a-e3f31309cd3d tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] 10.222.0.50 "GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0" status: 200 len: 1501 microversion: 2.1 time: 0.409268 Aug 31 16:25:43.643518 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2957/6095] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:43 2022] GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0 => generated 1501 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:43.671542 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3c7f6755-d12a-446a-ad07-53ce1e9d9cbd tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:43.672428 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3c7f6755-d12a-446a-ad07-53ce1e9d9cbd tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] [instance: 1a332207-809f-4c2a-81d3-4bdab483fee0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:43.692153 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c7f6755-d12a-446a-ad07-53ce1e9d9cbd tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:43.692876 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c7f6755-d12a-446a-ad07-53ce1e9d9cbd tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:43.693867 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c7f6755-d12a-446a-ad07-53ce1e9d9cbd tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:43.700232 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c7f6755-d12a-446a-ad07-53ce1e9d9cbd tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:43.701417 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c7f6755-d12a-446a-ad07-53ce1e9d9cbd tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:43.717686 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c7f6755-d12a-446a-ad07-53ce1e9d9cbd tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:43.816033 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3c7f6755-d12a-446a-ad07-53ce1e9d9cbd tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] [instance: 1a332207-809f-4c2a-81d3-4bdab483fee0] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:25:44.058331 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3c7f6755-d12a-446a-ad07-53ce1e9d9cbd tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] 10.222.0.50 "DELETE /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0" status: 204 len: 0 microversion: 2.1 time: 0.389651 Aug 31 16:25:44.059323 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-31789d3c-3d87-459d-a961-29dddca83b19 tempest-TestAggregatesBasicOps-862310563 tempest-TestAggregatesBasicOps-862310563-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.852404 Aug 31 16:25:44.061305 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2958/6096] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:25:43 2022] DELETE /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 16:25:44.062168 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3139/6097] 10.222.0.50 () {60 vars in 1194 bytes} [Wed Aug 31 16:25:43 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:25:44.076921 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-13525a95-a95e-40a1-a711-190f22db6289 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:44.077772 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-13525a95-a95e-40a1-a711-190f22db6289 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 37fb9349-5468-4dd6-bab3-47f29cb99b32] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:44.089031 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-380bf53a-9067-4acd-adbe-f05d5c61f736 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:44.093521 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-380bf53a-9067-4acd-adbe-f05d5c61f736 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:44.094589 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-13525a95-a95e-40a1-a711-190f22db6289 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:44.097291 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-13525a95-a95e-40a1-a711-190f22db6289 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:44.098969 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-13525a95-a95e-40a1-a711-190f22db6289 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:44.101752 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-13525a95-a95e-40a1-a711-190f22db6289 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:44.103368 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-13525a95-a95e-40a1-a711-190f22db6289 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:44.104534 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-13525a95-a95e-40a1-a711-190f22db6289 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:44.128110 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-380bf53a-9067-4acd-adbe-f05d5c61f736 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:44.129375 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-380bf53a-9067-4acd-adbe-f05d5c61f736 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:44.130127 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-380bf53a-9067-4acd-adbe-f05d5c61f736 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:44.131303 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-380bf53a-9067-4acd-adbe-f05d5c61f736 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:44.132883 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-380bf53a-9067-4acd-adbe-f05d5c61f736 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:44.133851 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-380bf53a-9067-4acd-adbe-f05d5c61f736 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:44.184024 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-13525a95-a95e-40a1-a711-190f22db6289 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:44.187087 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-13525a95-a95e-40a1-a711-190f22db6289 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:44.188326 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-13525a95-a95e-40a1-a711-190f22db6289 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:44.191331 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-13525a95-a95e-40a1-a711-190f22db6289 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lazy-loading 'fault' on Instance uuid 37fb9349-5468-4dd6-bab3-47f29cb99b32 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:25:44.258803 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-13525a95-a95e-40a1-a711-190f22db6289 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:44.278741 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-13525a95-a95e-40a1-a711-190f22db6289 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32" status: 200 len: 1197 microversion: 2.1 time: 0.210825 Aug 31 16:25:44.281149 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3140/6098] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:44 2022] GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32 => generated 1197 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:44.290598 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b7dfd15f-f910-4c51-a407-fd1e8fb595ba tempest-TestAggregatesBasicOps-862310563 tempest-TestAggregatesBasicOps-862310563-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:44.313991 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b7dfd15f-f910-4c51-a407-fd1e8fb595ba tempest-TestAggregatesBasicOps-862310563 tempest-TestAggregatesBasicOps-862310563-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.025203 Aug 31 16:25:44.314514 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3141/6099] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Aug 31 16:25:44 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:25:44.321912 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6c8395bd-620c-4f77-ba85-3d9cbd8f1444 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:44.322666 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6c8395bd-620c-4f77-ba85-3d9cbd8f1444 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] [instance: 1a332207-809f-4c2a-81d3-4bdab483fee0] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:44.341378 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6c8395bd-620c-4f77-ba85-3d9cbd8f1444 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:44.344882 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6c8395bd-620c-4f77-ba85-3d9cbd8f1444 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:44.347380 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6c8395bd-620c-4f77-ba85-3d9cbd8f1444 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:44.349176 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6c8395bd-620c-4f77-ba85-3d9cbd8f1444 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:44.350698 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6c8395bd-620c-4f77-ba85-3d9cbd8f1444 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:44.351132 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6c8395bd-620c-4f77-ba85-3d9cbd8f1444 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:44.805978 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-380bf53a-9067-4acd-adbe-f05d5c61f736 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:44.830464 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-380bf53a-9067-4acd-adbe-f05d5c61f736 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b" status: 200 len: 1668 microversion: 2.1 time: 0.764310 Aug 31 16:25:44.836735 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2959/6100] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:44 2022] GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b => generated 1668 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:44.860822 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6c8395bd-620c-4f77-ba85-3d9cbd8f1444 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7e1b7368604169b3658a7415a3684e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25250299d5a45a3b6a18e22793f6232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:44.862677 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-37d711bb-0af6-4cbe-8915-1d903d98e831 tempest-TestAggregatesBasicOps-862310563 tempest-TestAggregatesBasicOps-862310563-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-4181593", "availability_zone": "foo_zone"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:25:44.886571 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6c8395bd-620c-4f77-ba85-3d9cbd8f1444 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] 10.222.0.50 "GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0" status: 200 len: 1507 microversion: 2.1 time: 0.570548 Aug 31 16:25:44.892166 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3142/6101] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:44 2022] GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0 => generated 1507 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:45.117365 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-37d711bb-0af6-4cbe-8915-1d903d98e831 tempest-TestAggregatesBasicOps-862310563 tempest-TestAggregatesBasicOps-862310563-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 340 microversion: 2.1 time: 0.277766 Aug 31 16:25:45.118714 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2960/6102] 10.222.0.50 () {60 vars in 1173 bytes} [Wed Aug 31 16:25:44 2022] PUT /compute/v2.1/os-aggregates/19 => generated 340 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:25:45.139080 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a088fbad-27ab-46f7-bad0-0345a95c51f9 tempest-TestAggregatesBasicOps-862310563 tempest-TestAggregatesBasicOps-862310563-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:25:45.215617 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a088fbad-27ab-46f7-bad0-0345a95c51f9 tempest-TestAggregatesBasicOps-862310563 tempest-TestAggregatesBasicOps-862310563-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 354 microversion: 2.1 time: 0.087560 Aug 31 16:25:45.217864 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3143/6103] 10.222.0.50 () {60 vars in 1194 bytes} [Wed Aug 31 16:25:45 2022] POST /compute/v2.1/os-aggregates/19/action => generated 354 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:25:45.229837 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-014efd0c-0f24-476d-8f50-a3c445799908 tempest-TestAggregatesBasicOps-862310563 tempest-TestAggregatesBasicOps-862310563-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:45.241211 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-014efd0c-0f24-476d-8f50-a3c445799908 tempest-TestAggregatesBasicOps-862310563 tempest-TestAggregatesBasicOps-862310563-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 354 microversion: 2.1 time: 0.015436 Aug 31 16:25:45.242525 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2961/6104] 10.222.0.50 () {58 vars in 1152 bytes} [Wed Aug 31 16:25:45 2022] GET /compute/v2.1/os-aggregates/19 => generated 354 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:25:45.257770 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7d730120-6560-48d2-a5e3-1a7de002346b tempest-TestAggregatesBasicOps-862310563 tempest-TestAggregatesBasicOps-862310563-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-833090-16"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:25:45.285099 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7d730120-6560-48d2-a5e3-1a7de002346b tempest-TestAggregatesBasicOps-862310563 tempest-TestAggregatesBasicOps-862310563-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:45.287438 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7d730120-6560-48d2-a5e3-1a7de002346b tempest-TestAggregatesBasicOps-862310563 tempest-TestAggregatesBasicOps-862310563-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:45.289009 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7d730120-6560-48d2-a5e3-1a7de002346b tempest-TestAggregatesBasicOps-862310563 tempest-TestAggregatesBasicOps-862310563-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:45.306122 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2d91d82a-b8ca-4bb7-8869-789b1519394f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:45.307551 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2d91d82a-b8ca-4bb7-8869-789b1519394f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 37fb9349-5468-4dd6-bab3-47f29cb99b32] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:45.328691 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d91d82a-b8ca-4bb7-8869-789b1519394f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:45.330186 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d91d82a-b8ca-4bb7-8869-789b1519394f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:45.332373 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d91d82a-b8ca-4bb7-8869-789b1519394f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:45.336385 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d91d82a-b8ca-4bb7-8869-789b1519394f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:45.337565 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d91d82a-b8ca-4bb7-8869-789b1519394f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:45.338640 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d91d82a-b8ca-4bb7-8869-789b1519394f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:45.357369 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-2d91d82a-b8ca-4bb7-8869-789b1519394f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] HTTP exception thrown: Instance 37fb9349-5468-4dd6-bab3-47f29cb99b32 could not be found. Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2d91d82a-b8ca-4bb7-8869-789b1519394f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Request method failure captured: Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32 HTTP/1.1 Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4sA8QatsiRw58KL4D-GJAaR1X9zBGwbu0cNuaHi16Tl8K5LhZ4dthUjdeeybVrZ6FkLiuj0CnwnGa_AqwqzkMsKdZfTNQhjMqXfHtEAV5ID9oXbOsK0vGNgY-jRlE7qor7NeFM7QGwhr8KE3TJ70ugNQcxhI7ZJIKzx49vTu_Rhy18 Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 32245d85aee64f69865d98656133a539 Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-TestVolumeBootPattern-1732723367 Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/32245d85aee64f69865d98656133a539"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/32245d85aee64f69865d98656133a539"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/32245d85aee64f69865d98656133a539"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_32245d85aee64f69865d98656133a539", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-TestVolumeBootPattern-1732723367 Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 32245d85aee64f69865d98656133a539 Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TestVolumeBootPattern-1732723367 Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-TestVolumeBootPattern-1732723367-project Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: fb76a89a8b8042edb7b6aaccb4f41ead Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-TestVolumeBootPattern-1732723367-project Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 37fb9349-5468-4dd6-bab3-47f29cb99b32 could not be found. Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '37fb9349-5468-4dd6-bab3-47f29cb99b32'} Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37fb9349-5468-4dd6-bab3-47f29cb99b32 could not be found. Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37fb9349-5468-4dd6-bab3-47f29cb99b32 could not be found. Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:25:45.359463 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:25:45.365827 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:25:45.365827 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:25:45.365827 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:25:45.365827 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:25:45.365827 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:25:45.365827 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37fb9349-5468-4dd6-bab3-47f29cb99b32 could not be found. Aug 31 16:25:45.365827 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:25:45.367583 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2d91d82a-b8ca-4bb7-8869-789b1519394f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Returning 404 to user: Instance 37fb9349-5468-4dd6-bab3-47f29cb99b32 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:25:45.369003 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2d91d82a-b8ca-4bb7-8869-789b1519394f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32" status: 404 len: 111 microversion: 2.1 time: 0.069301 Aug 31 16:25:45.370511 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2962/6105] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:45 2022] GET /compute/v2.1/servers/37fb9349-5468-4dd6-bab3-47f29cb99b32 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:25:45.475997 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:25:45.527134 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7d730120-6560-48d2-a5e3-1a7de002346b tempest-TestAggregatesBasicOps-862310563 tempest-TestAggregatesBasicOps-862310563-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 338 microversion: 2.1 time: 0.276380 Aug 31 16:25:45.527749 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3144/6106] 10.222.0.50 () {60 vars in 1194 bytes} [Wed Aug 31 16:25:45 2022] POST /compute/v2.1/os-aggregates/19/action => generated 338 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:25:45.544220 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bba7935e-7eb8-4347-a9fd-1e5255f8caff tempest-TestAggregatesBasicOps-862310563 tempest-TestAggregatesBasicOps-862310563-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:45.606772 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bba7935e-7eb8-4347-a9fd-1e5255f8caff tempest-TestAggregatesBasicOps-862310563 tempest-TestAggregatesBasicOps-862310563-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.066925 Aug 31 16:25:45.607447 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2963/6107] 10.222.0.50 () {58 vars in 1155 bytes} [Wed Aug 31 16:25:45 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 31 16:25:45.917901 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3e54138d-d406-4bb5-983a-3ae171dd4412 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:45.918838 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3e54138d-d406-4bb5-983a-3ae171dd4412 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] [instance: 1a332207-809f-4c2a-81d3-4bdab483fee0] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:45.937760 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3e54138d-d406-4bb5-983a-3ae171dd4412 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:45.938351 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3e54138d-d406-4bb5-983a-3ae171dd4412 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:45.942400 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3e54138d-d406-4bb5-983a-3ae171dd4412 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:45.943535 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3e54138d-d406-4bb5-983a-3ae171dd4412 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:45.944015 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3e54138d-d406-4bb5-983a-3ae171dd4412 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:45.944454 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3e54138d-d406-4bb5-983a-3ae171dd4412 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:46.275396 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3e54138d-d406-4bb5-983a-3ae171dd4412 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7e1b7368604169b3658a7415a3684e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25250299d5a45a3b6a18e22793f6232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:46.294867 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3e54138d-d406-4bb5-983a-3ae171dd4412 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] 10.222.0.50 "GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0" status: 200 len: 1507 microversion: 2.1 time: 0.381356 Aug 31 16:25:46.299006 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3145/6108] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:45 2022] GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0 => generated 1507 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:47.327247 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3641e374-cdb0-4cae-be43-f677d699c216 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:47.328036 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3641e374-cdb0-4cae-be43-f677d699c216 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] [instance: 1a332207-809f-4c2a-81d3-4bdab483fee0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:47.350393 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3641e374-cdb0-4cae-be43-f677d699c216 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:47.355408 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3641e374-cdb0-4cae-be43-f677d699c216 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:47.358907 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3641e374-cdb0-4cae-be43-f677d699c216 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:47.362339 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3641e374-cdb0-4cae-be43-f677d699c216 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:47.365555 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3641e374-cdb0-4cae-be43-f677d699c216 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:47.366117 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3641e374-cdb0-4cae-be43-f677d699c216 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:47.735861 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3641e374-cdb0-4cae-be43-f677d699c216 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7e1b7368604169b3658a7415a3684e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25250299d5a45a3b6a18e22793f6232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:47.787350 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3641e374-cdb0-4cae-be43-f677d699c216 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] 10.222.0.50 "GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0" status: 200 len: 1507 microversion: 2.1 time: 0.466289 Aug 31 16:25:47.791757 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2964/6109] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:47 2022] GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0 => generated 1507 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:48.193569 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-550a1cca-5162-4103-bc42-1fdf7e794fd1 req-0fc81a86-fdc1-45d7-9327-f28f87e23f53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a332207-809f-4c2a-81d3-4bdab483fee0", "name": "network-vif-deleted", "tag": "17f7c0ff-4a0a-42f4-9539-5b8d3239e2b5"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:25:48.232839 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-550a1cca-5162-4103-bc42-1fdf7e794fd1 req-0fc81a86-fdc1-45d7-9327-f28f87e23f53 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:48.234977 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-550a1cca-5162-4103-bc42-1fdf7e794fd1 req-0fc81a86-fdc1-45d7-9327-f28f87e23f53 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:48.235913 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-550a1cca-5162-4103-bc42-1fdf7e794fd1 req-0fc81a86-fdc1-45d7-9327-f28f87e23f53 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:48.259490 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-550a1cca-5162-4103-bc42-1fdf7e794fd1 req-0fc81a86-fdc1-45d7-9327-f28f87e23f53 service nova] Creating event network-vif-deleted:17f7c0ff-4a0a-42f4-9539-5b8d3239e2b5 for instance 1a332207-809f-4c2a-81d3-4bdab483fee0 on n-h2-833090-16 Aug 31 16:25:48.268132 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-550a1cca-5162-4103-bc42-1fdf7e794fd1 req-0fc81a86-fdc1-45d7-9327-f28f87e23f53 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080374 Aug 31 16:25:48.269779 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3146/6110] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:25:48.818196 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-65ba4d93-cb87-495e-a77b-a883770e25df tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:48.818826 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-65ba4d93-cb87-495e-a77b-a883770e25df tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] [instance: 1a332207-809f-4c2a-81d3-4bdab483fee0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:48.823718 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=1,nova_api:DELETE=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:25:48.853623 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65ba4d93-cb87-495e-a77b-a883770e25df tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:48.854193 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65ba4d93-cb87-495e-a77b-a883770e25df tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:48.859591 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65ba4d93-cb87-495e-a77b-a883770e25df tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:48.860532 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65ba4d93-cb87-495e-a77b-a883770e25df tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:48.861035 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65ba4d93-cb87-495e-a77b-a883770e25df tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:48.868696 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65ba4d93-cb87-495e-a77b-a883770e25df tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:48.970027 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65ba4d93-cb87-495e-a77b-a883770e25df tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:48.970644 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65ba4d93-cb87-495e-a77b-a883770e25df tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:48.971096 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65ba4d93-cb87-495e-a77b-a883770e25df tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:48.971704 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-65ba4d93-cb87-495e-a77b-a883770e25df tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lazy-loading 'fault' on Instance uuid 1a332207-809f-4c2a-81d3-4bdab483fee0 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:25:49.156586 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-65ba4d93-cb87-495e-a77b-a883770e25df tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d7e1b7368604169b3658a7415a3684e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a25250299d5a45a3b6a18e22793f6232', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:25:49.175859 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-65ba4d93-cb87-495e-a77b-a883770e25df tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] 10.222.0.50 "GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0" status: 200 len: 1304 microversion: 2.1 time: 0.363306 Aug 31 16:25:49.180923 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2965/6111] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:48 2022] GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0 => generated 1304 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:25:50.217693 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0978f8ae-00c3-41d2-90e1-2abd9fe52785 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:25:50.221803 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0978f8ae-00c3-41d2-90e1-2abd9fe52785 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] [instance: 1a332207-809f-4c2a-81d3-4bdab483fee0] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:25:50.250127 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0978f8ae-00c3-41d2-90e1-2abd9fe52785 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:50.250688 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0978f8ae-00c3-41d2-90e1-2abd9fe52785 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:50.253492 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0978f8ae-00c3-41d2-90e1-2abd9fe52785 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:50.255842 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0978f8ae-00c3-41d2-90e1-2abd9fe52785 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:25:50.257972 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0978f8ae-00c3-41d2-90e1-2abd9fe52785 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:25:50.258633 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0978f8ae-00c3-41d2-90e1-2abd9fe52785 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:25:50.302041 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-0978f8ae-00c3-41d2-90e1-2abd9fe52785 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] HTTP exception thrown: Instance 1a332207-809f-4c2a-81d3-4bdab483fee0 could not be found. Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0978f8ae-00c3-41d2-90e1-2abd9fe52785 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Request method failure captured: Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0 HTTP/1.1 Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4tcScnpiUYDRapby8YHKu3WH9tuBysB-g0TUB62e-pjwq2QOHj9hfG0Y1yKT3SlliqosoRTC1gRgVM1HMFEJ9WfIaaYcdgW9LcbnCbQUE1jCBxNd6dstqKrJcWxl_zvLz8owlNRkgUZUwBf8MZFVuY0GiIImWtyKSc6VgQyzjqSTwg Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: a25250299d5a45a3b6a18e22793f6232 Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-TestServerAdvancedOps-1484737729 Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a25250299d5a45a3b6a18e22793f6232"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a25250299d5a45a3b6a18e22793f6232"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a25250299d5a45a3b6a18e22793f6232"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a25250299d5a45a3b6a18e22793f6232", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-TestServerAdvancedOps-1484737729 Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: a25250299d5a45a3b6a18e22793f6232 Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-TestServerAdvancedOps-1484737729 Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-TestServerAdvancedOps-1484737729-project Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 8d7e1b7368604169b3658a7415a3684e Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-TestServerAdvancedOps-1484737729-project Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 1a332207-809f-4c2a-81d3-4bdab483fee0 could not be found. Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '1a332207-809f-4c2a-81d3-4bdab483fee0'} Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a332207-809f-4c2a-81d3-4bdab483fee0 could not be found. Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a332207-809f-4c2a-81d3-4bdab483fee0 could not be found. Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:25:50.304194 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:25:50.309188 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:25:50.309188 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:25:50.309188 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:25:50.309188 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:25:50.309188 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:25:50.309188 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a332207-809f-4c2a-81d3-4bdab483fee0 could not be found. Aug 31 16:25:50.309188 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:25:50.311430 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0978f8ae-00c3-41d2-90e1-2abd9fe52785 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] Returning 404 to user: Instance 1a332207-809f-4c2a-81d3-4bdab483fee0 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:25:50.312605 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0978f8ae-00c3-41d2-90e1-2abd9fe52785 tempest-TestServerAdvancedOps-1484737729 tempest-TestServerAdvancedOps-1484737729-project] 10.222.0.50 "GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0" status: 404 len: 111 microversion: 2.1 time: 0.118665 Aug 31 16:25:50.313749 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3147/6112] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:25:50 2022] GET /compute/v2.1/servers/1a332207-809f-4c2a-81d3-4bdab483fee0 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:26:37.322689 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:26:37.323464 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:26:37.891324 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b8e393d8-c1d2-4b09-837b-44bab6bda655 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Action: 'create', calling method: .version_select at 0x7fbb46543f70>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1423424004", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPa0Mxbwao+myx6H1PvRH26+iKLYke9GofqdzUXPzlY+ZGggpn2/jDFzlbaHSOJTXQRa120ywLN7tWqM9zAHm3GCKYOryAw7TAIfeWDrcBDMn/a8SxJHsiLiV1O/cB5e9A=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:26:37.947667 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-b8e393d8-c1d2-4b09-837b-44bab6bda655 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Getting quotas for project cad72fb986ae4235bc6daa067d8d30c7. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:26:37.974421 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-b8e393d8-c1d2-4b09-837b-44bab6bda655 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Getting quotas for user 491c3afd0b634b859f8388454184b8b1 and project cad72fb986ae4235bc6daa067d8d30c7. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:26:38.073449 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b8e393d8-c1d2-4b09-837b-44bab6bda655 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.754323 Aug 31 16:26:38.077352 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2966/6113] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 31 16:26:37 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:26:41.259460 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-26dc747a-a9bb-48e6-8b04-b029c866cb60 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:41.262687 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-26dc747a-a9bb-48e6-8b04-b029c866cb60 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:41.268797 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:26:41.270883 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=8 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:26:41.271834 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=93 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:26:41.288735 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26dc747a-a9bb-48e6-8b04-b029c866cb60 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:41.307069 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26dc747a-a9bb-48e6-8b04-b029c866cb60 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:41.309325 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26dc747a-a9bb-48e6-8b04-b029c866cb60 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:41.310196 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26dc747a-a9bb-48e6-8b04-b029c866cb60 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:41.314277 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26dc747a-a9bb-48e6-8b04-b029c866cb60 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:41.314903 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26dc747a-a9bb-48e6-8b04-b029c866cb60 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:41.362344 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-26dc747a-a9bb-48e6-8b04-b029c866cb60 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.107292 Aug 31 16:26:41.363632 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3148/6114] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:26:41 2022] GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b/os-volume_attachments => generated 25 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:26:41.465909 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4ed316a7-2819-42ec-912d-1d95a3387e42 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:41.467671 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4ed316a7-2819-42ec-912d-1d95a3387e42 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:41.483921 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ed316a7-2819-42ec-912d-1d95a3387e42 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:41.489985 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ed316a7-2819-42ec-912d-1d95a3387e42 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:41.490994 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ed316a7-2819-42ec-912d-1d95a3387e42 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:41.492760 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ed316a7-2819-42ec-912d-1d95a3387e42 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:41.493490 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ed316a7-2819-42ec-912d-1d95a3387e42 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:41.495695 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ed316a7-2819-42ec-912d-1d95a3387e42 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:41.548603 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4ed316a7-2819-42ec-912d-1d95a3387e42 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:26:41.772438 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4ed316a7-2819-42ec-912d-1d95a3387e42 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "DELETE /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b" status: 204 len: 0 microversion: 2.1 time: 0.312672 Aug 31 16:26:41.776015 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2967/6115] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:26:41 2022] DELETE /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:26:41.786122 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6fd89d38-9cde-44e5-9aba-b5720b3a647d tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:41.786895 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6fd89d38-9cde-44e5-9aba-b5720b3a647d tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:41.811426 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6fd89d38-9cde-44e5-9aba-b5720b3a647d tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:41.816920 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6fd89d38-9cde-44e5-9aba-b5720b3a647d tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:41.819546 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6fd89d38-9cde-44e5-9aba-b5720b3a647d tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:41.825480 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6fd89d38-9cde-44e5-9aba-b5720b3a647d tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:41.827960 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6fd89d38-9cde-44e5-9aba-b5720b3a647d tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:41.833076 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6fd89d38-9cde-44e5-9aba-b5720b3a647d tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:42.004667 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cab81510-f3bc-4caf-bb22-8475383c2343 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1256305971", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1423424004", "security_groups": [{"name": "tempest-secgroup-smoke-1472611307"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "9261b835-b152-47bb-9c70-e2aaf006549a"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:26:42.168026 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6fd89d38-9cde-44e5-9aba-b5720b3a647d tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:42.178723 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6fd89d38-9cde-44e5-9aba-b5720b3a647d tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b" status: 200 len: 1674 microversion: 2.1 time: 0.397496 Aug 31 16:26:42.179602 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3149/6116] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:41 2022] GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b => generated 1674 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:42.185761 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4adb11ac-3d96-47d6-91d8-6b23be0c666e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1598701059", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "33e4423c-c8b2-4043-8aef-3cdf2ca5b07e", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "875599c9-5517-4369-96b1-87dce382c42c"}]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:26:42.332550 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-cab81510-f3bc-4caf-bb22-8475383c2343 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] validate_networks() for [('9261b835-b152-47bb-9c70-e2aaf006549a', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:26:42.348876 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-4adb11ac-3d96-47d6-91d8-6b23be0c666e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] validate_networks() for [('875599c9-5517-4369-96b1-87dce382c42c', None, None, None, None, None)] {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:26:43.773124 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-cab81510-f3bc-4caf-bb22-8475383c2343 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Getting quotas for project cad72fb986ae4235bc6daa067d8d30c7. Resources: dict_keys(['metadata_items']) {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:26:43.791965 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-cab81510-f3bc-4caf-bb22-8475383c2343 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Getting quotas for user 491c3afd0b634b859f8388454184b8b1 and project cad72fb986ae4235bc6daa067d8d30c7. Resources: dict_keys(['metadata_items']) {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:26:43.826578 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-cab81510-f3bc-4caf-bb22-8475383c2343 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:26:43.827320 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-cab81510-f3bc-4caf-bb22-8475383c2343 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:26:43.827968 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-cab81510-f3bc-4caf-bb22-8475383c2343 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:26:43.828695 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-cab81510-f3bc-4caf-bb22-8475383c2343 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:26:43.829304 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-cab81510-f3bc-4caf-bb22-8475383c2343 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:26:43.840112 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cab81510-f3bc-4caf-bb22-8475383c2343 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:43.840828 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cab81510-f3bc-4caf-bb22-8475383c2343 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:43.841436 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cab81510-f3bc-4caf-bb22-8475383c2343 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:43.842737 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cab81510-f3bc-4caf-bb22-8475383c2343 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:43.843479 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cab81510-f3bc-4caf-bb22-8475383c2343 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:43.844053 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cab81510-f3bc-4caf-bb22-8475383c2343 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:43.867047 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-cab81510-f3bc-4caf-bb22-8475383c2343 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Getting quotas for project cad72fb986ae4235bc6daa067d8d30c7. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:26:43.873721 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-cab81510-f3bc-4caf-bb22-8475383c2343 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Getting quotas for user 491c3afd0b634b859f8388454184b8b1 and project cad72fb986ae4235bc6daa067d8d30c7. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:26:43.890434 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cab81510-f3bc-4caf-bb22-8475383c2343 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:26:43.896471 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cab81510-f3bc-4caf-bb22-8475383c2343 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] [instance: 1652ca69-4e62-413f-aeda-ef5c8bbdcbe6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:26:43.956919 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-4adb11ac-3d96-47d6-91d8-6b23be0c666e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:26:43.957638 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-4adb11ac-3d96-47d6-91d8-6b23be0c666e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:26:43.958155 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-4adb11ac-3d96-47d6-91d8-6b23be0c666e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:26:43.958627 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-4adb11ac-3d96-47d6-91d8-6b23be0c666e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:26:43.959047 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-4adb11ac-3d96-47d6-91d8-6b23be0c666e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:26:43.980739 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4adb11ac-3d96-47d6-91d8-6b23be0c666e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:43.981238 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4adb11ac-3d96-47d6-91d8-6b23be0c666e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:43.982637 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4adb11ac-3d96-47d6-91d8-6b23be0c666e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:43.984447 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4adb11ac-3d96-47d6-91d8-6b23be0c666e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:43.985289 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4adb11ac-3d96-47d6-91d8-6b23be0c666e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:43.994923 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4adb11ac-3d96-47d6-91d8-6b23be0c666e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:44.000668 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cab81510-f3bc-4caf-bb22-8475383c2343 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.001650 Aug 31 16:26:44.008575 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2968/6117] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:26:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 2010 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:26:44.032728 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1a276865-ea30-4dcb-bef9-7b22036400f3 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:44.034865 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1a276865-ea30-4dcb-bef9-7b22036400f3 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:44.052641 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a276865-ea30-4dcb-bef9-7b22036400f3 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:44.053200 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-4adb11ac-3d96-47d6-91d8-6b23be0c666e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Getting quotas for project 32245d85aee64f69865d98656133a539. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:26:44.054857 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a276865-ea30-4dcb-bef9-7b22036400f3 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:44.055651 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a276865-ea30-4dcb-bef9-7b22036400f3 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:44.056853 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a276865-ea30-4dcb-bef9-7b22036400f3 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:44.057613 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a276865-ea30-4dcb-bef9-7b22036400f3 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:44.058880 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1a276865-ea30-4dcb-bef9-7b22036400f3 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:44.074582 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-4adb11ac-3d96-47d6-91d8-6b23be0c666e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Getting quotas for user fb76a89a8b8042edb7b6aaccb4f41ead and project 32245d85aee64f69865d98656133a539. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:26:44.119902 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4adb11ac-3d96-47d6-91d8-6b23be0c666e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:26:44.122806 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4adb11ac-3d96-47d6-91d8-6b23be0c666e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 0afebe39-d25a-437e-86b5-30fefa20bc11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='33e4423c-c8b2-4043-8aef-3cdf2ca5b07e',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:26:44.325075 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4adb11ac-3d96-47d6-91d8-6b23be0c666e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.141665 Aug 31 16:26:44.334357 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3150/6118] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:26:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2148 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:26:44.343262 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-54fd418f-a07a-4775-ac3d-cf3ab6bcff41 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:44.343884 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-54fd418f-a07a-4775-ac3d-cf3ab6bcff41 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] [instance: 1652ca69-4e62-413f-aeda-ef5c8bbdcbe6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:44.355306 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1a276865-ea30-4dcb-bef9-7b22036400f3 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:44.367180 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1a276865-ea30-4dcb-bef9-7b22036400f3 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b" status: 200 len: 1674 microversion: 2.1 time: 0.357254 Aug 31 16:26:44.383396 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2969/6119] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:44 2022] GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b => generated 1674 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:44.390663 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-788194b6-8928-4534-9833-16551efe9177 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:44.391439 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-788194b6-8928-4534-9833-16551efe9177 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 0afebe39-d25a-437e-86b5-30fefa20bc11] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:44.459165 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-788194b6-8928-4534-9833-16551efe9177 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:44.470288 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-788194b6-8928-4534-9833-16551efe9177 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11" status: 200 len: 1057 microversion: 2.1 time: 0.085471 Aug 31 16:26:44.482684 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2970/6120] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:44 2022] GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11 => generated 1057 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:44.520732 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-54fd418f-a07a-4775-ac3d-cf3ab6bcff41 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491c3afd0b634b859f8388454184b8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad72fb986ae4235bc6daa067d8d30c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:44.533878 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-54fd418f-a07a-4775-ac3d-cf3ab6bcff41 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] 10.222.0.50 "GET /compute/v2.1/servers/1652ca69-4e62-413f-aeda-ef5c8bbdcbe6" status: 200 len: 1303 microversion: 2.1 time: 0.203928 Aug 31 16:26:44.542807 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3151/6121] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:44 2022] GET /compute/v2.1/servers/1652ca69-4e62-413f-aeda-ef5c8bbdcbe6 => generated 1303 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:45.398242 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fc66b186-b1ff-43f4-a8b2-966c32f25afd tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:45.401251 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fc66b186-b1ff-43f4-a8b2-966c32f25afd tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:45.443885 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc66b186-b1ff-43f4-a8b2-966c32f25afd tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:45.446721 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc66b186-b1ff-43f4-a8b2-966c32f25afd tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:45.446721 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc66b186-b1ff-43f4-a8b2-966c32f25afd tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:45.453249 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc66b186-b1ff-43f4-a8b2-966c32f25afd tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:45.456993 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc66b186-b1ff-43f4-a8b2-966c32f25afd tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:45.457493 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc66b186-b1ff-43f4-a8b2-966c32f25afd tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:45.500059 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5db7d524-bd63-4c38-a623-aad2d9c87f50 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:45.502338 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5db7d524-bd63-4c38-a623-aad2d9c87f50 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 0afebe39-d25a-437e-86b5-30fefa20bc11] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:45.810582 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5db7d524-bd63-4c38-a623-aad2d9c87f50 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:45.829336 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5db7d524-bd63-4c38-a623-aad2d9c87f50 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11" status: 200 len: 1057 microversion: 2.1 time: 0.335691 Aug 31 16:26:45.831179 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3152/6122] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:45 2022] GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11 => generated 1057 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:45.837444 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fc66b186-b1ff-43f4-a8b2-966c32f25afd tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:45.856283 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fc66b186-b1ff-43f4-a8b2-966c32f25afd tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b" status: 200 len: 1607 microversion: 2.1 time: 0.463955 Aug 31 16:26:45.878639 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2971/6123] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:45 2022] GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b => generated 1607 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:45.900306 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5c40b54a-5ee6-4818-ac83-d78ad702c236 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:45.902262 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5c40b54a-5ee6-4818-ac83-d78ad702c236 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] [instance: 1652ca69-4e62-413f-aeda-ef5c8bbdcbe6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:45.936258 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5c40b54a-5ee6-4818-ac83-d78ad702c236 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:45.936914 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5c40b54a-5ee6-4818-ac83-d78ad702c236 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:45.937460 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5c40b54a-5ee6-4818-ac83-d78ad702c236 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:45.938249 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5c40b54a-5ee6-4818-ac83-d78ad702c236 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:45.938721 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5c40b54a-5ee6-4818-ac83-d78ad702c236 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:45.939148 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5c40b54a-5ee6-4818-ac83-d78ad702c236 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:46.061571 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-b427bd84-9f1e-4144-9e5b-f808d1fcb6fc req-f6aad734-2d37-4a94-8411-c10e4a843117 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27172556-b12c-4974-815d-5f893a07506b", "name": "network-vif-deleted", "tag": "fb8f078c-683b-4fe5-9e14-600f0922bd16"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:26:46.086300 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b427bd84-9f1e-4144-9e5b-f808d1fcb6fc req-f6aad734-2d37-4a94-8411-c10e4a843117 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:46.086781 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b427bd84-9f1e-4144-9e5b-f808d1fcb6fc req-f6aad734-2d37-4a94-8411-c10e4a843117 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:46.087214 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-b427bd84-9f1e-4144-9e5b-f808d1fcb6fc req-f6aad734-2d37-4a94-8411-c10e4a843117 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:46.126759 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-b427bd84-9f1e-4144-9e5b-f808d1fcb6fc req-f6aad734-2d37-4a94-8411-c10e4a843117 service nova] Creating event network-vif-deleted:fb8f078c-683b-4fe5-9e14-600f0922bd16 for instance 27172556-b12c-4974-815d-5f893a07506b on n-h2-833090-16 Aug 31 16:26:46.156131 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-b427bd84-9f1e-4144-9e5b-f808d1fcb6fc req-f6aad734-2d37-4a94-8411-c10e4a843117 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099446 Aug 31 16:26:46.160664 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2972/6124] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:26:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:26:46.169865 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5c40b54a-5ee6-4818-ac83-d78ad702c236 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491c3afd0b634b859f8388454184b8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad72fb986ae4235bc6daa067d8d30c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:46.191252 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5c40b54a-5ee6-4818-ac83-d78ad702c236 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] 10.222.0.50 "GET /compute/v2.1/servers/1652ca69-4e62-413f-aeda-ef5c8bbdcbe6" status: 200 len: 1307 microversion: 2.1 time: 0.349037 Aug 31 16:26:46.191867 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3153/6125] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:45 2022] GET /compute/v2.1/servers/1652ca69-4e62-413f-aeda-ef5c8bbdcbe6 => generated 1307 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:46.851256 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-df4ba06c-5c15-443d-87f9-d0abe2ca3322 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:46.851985 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-df4ba06c-5c15-443d-87f9-d0abe2ca3322 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 0afebe39-d25a-437e-86b5-30fefa20bc11] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:46.860772 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df4ba06c-5c15-443d-87f9-d0abe2ca3322 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:46.861268 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df4ba06c-5c15-443d-87f9-d0abe2ca3322 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:46.861698 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df4ba06c-5c15-443d-87f9-d0abe2ca3322 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:46.864501 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df4ba06c-5c15-443d-87f9-d0abe2ca3322 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:46.868635 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df4ba06c-5c15-443d-87f9-d0abe2ca3322 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:46.870878 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df4ba06c-5c15-443d-87f9-d0abe2ca3322 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:46.890204 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ae4eefa9-6b8e-4b64-bb7e-bd02971f531c tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:46.890867 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ae4eefa9-6b8e-4b64-bb7e-bd02971f531c tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:46.933833 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ae4eefa9-6b8e-4b64-bb7e-bd02971f531c tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:46.934670 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ae4eefa9-6b8e-4b64-bb7e-bd02971f531c tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:46.938042 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ae4eefa9-6b8e-4b64-bb7e-bd02971f531c tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:46.939310 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ae4eefa9-6b8e-4b64-bb7e-bd02971f531c tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:46.941338 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ae4eefa9-6b8e-4b64-bb7e-bd02971f531c tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:46.943907 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ae4eefa9-6b8e-4b64-bb7e-bd02971f531c tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:47.019905 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-df4ba06c-5c15-443d-87f9-d0abe2ca3322 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:47.037448 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-df4ba06c-5c15-443d-87f9-d0abe2ca3322 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11" status: 200 len: 1109 microversion: 2.1 time: 0.191288 Aug 31 16:26:47.060458 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ae4eefa9-6b8e-4b64-bb7e-bd02971f531c tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:47.061840 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ae4eefa9-6b8e-4b64-bb7e-bd02971f531c tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:47.064001 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2973/6126] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:46 2022] GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11 => generated 1109 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:47.066859 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ae4eefa9-6b8e-4b64-bb7e-bd02971f531c tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:47.071230 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-ae4eefa9-6b8e-4b64-bb7e-bd02971f531c tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lazy-loading 'fault' on Instance uuid 27172556-b12c-4974-815d-5f893a07506b {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:26:47.182758 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ae4eefa9-6b8e-4b64-bb7e-bd02971f531c tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:47.214113 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c3255786-043f-4a8d-9515-6916a65d59ec tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:47.215191 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c3255786-043f-4a8d-9515-6916a65d59ec tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] [instance: 1652ca69-4e62-413f-aeda-ef5c8bbdcbe6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:47.224993 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ae4eefa9-6b8e-4b64-bb7e-bd02971f531c tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b" status: 200 len: 1327 microversion: 2.1 time: 0.343911 Aug 31 16:26:47.248929 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3154/6127] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:46 2022] GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b => generated 1327 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:47.250049 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3255786-043f-4a8d-9515-6916a65d59ec tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:47.250682 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3255786-043f-4a8d-9515-6916a65d59ec tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:47.251578 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3255786-043f-4a8d-9515-6916a65d59ec tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:47.252372 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3255786-043f-4a8d-9515-6916a65d59ec tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:47.252944 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3255786-043f-4a8d-9515-6916a65d59ec tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:47.253384 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3255786-043f-4a8d-9515-6916a65d59ec tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:47.399995 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c3255786-043f-4a8d-9515-6916a65d59ec tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491c3afd0b634b859f8388454184b8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad72fb986ae4235bc6daa067d8d30c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:47.416485 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c3255786-043f-4a8d-9515-6916a65d59ec tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] 10.222.0.50 "GET /compute/v2.1/servers/1652ca69-4e62-413f-aeda-ef5c8bbdcbe6" status: 200 len: 1355 microversion: 2.1 time: 0.207040 Aug 31 16:26:47.419763 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2974/6128] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:47 2022] GET /compute/v2.1/servers/1652ca69-4e62-413f-aeda-ef5c8bbdcbe6 => generated 1355 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:26:48.068411 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-cee426f3-e296-4f14-860b-076eaa9c059c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:48.070418 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-cee426f3-e296-4f14-860b-076eaa9c059c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 0afebe39-d25a-437e-86b5-30fefa20bc11] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:48.099364 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cee426f3-e296-4f14-860b-076eaa9c059c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:48.099767 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cee426f3-e296-4f14-860b-076eaa9c059c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:48.103644 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cee426f3-e296-4f14-860b-076eaa9c059c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:48.106881 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cee426f3-e296-4f14-860b-076eaa9c059c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:48.107489 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cee426f3-e296-4f14-860b-076eaa9c059c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:48.108094 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cee426f3-e296-4f14-860b-076eaa9c059c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:48.254453 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5c100f35-3d6c-4ede-9a74-878bb8339c3f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:48.255151 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5c100f35-3d6c-4ede-9a74-878bb8339c3f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:48.293335 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-cee426f3-e296-4f14-860b-076eaa9c059c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:48.298993 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c100f35-3d6c-4ede-9a74-878bb8339c3f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:48.302343 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c100f35-3d6c-4ede-9a74-878bb8339c3f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:48.303898 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c100f35-3d6c-4ede-9a74-878bb8339c3f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:48.307655 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c100f35-3d6c-4ede-9a74-878bb8339c3f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:48.310806 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c100f35-3d6c-4ede-9a74-878bb8339c3f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:48.316351 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c100f35-3d6c-4ede-9a74-878bb8339c3f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:48.318223 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-cee426f3-e296-4f14-860b-076eaa9c059c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11" status: 200 len: 1127 microversion: 2.1 time: 0.253360 Aug 31 16:26:48.323844 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3155/6129] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:48 2022] GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11 => generated 1127 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:48.400740 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-5c100f35-3d6c-4ede-9a74-878bb8339c3f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] HTTP exception thrown: Instance 27172556-b12c-4974-815d-5f893a07506b could not be found. Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5c100f35-3d6c-4ede-9a74-878bb8339c3f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Request method failure captured: Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b HTTP/1.1 Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4qEc5AtkidsuCFEVOsKE6JRJgG3zRgW7cQ7X7_Pj1ygml5S6QFx5uHtU-PVO_a5NxyYSe4F1etDqaE98sTNFeT2lNZUd-Sgew_pe6BiKEO67OFPQRXju3FU5vu0HQszGxTnGI8adAujjwF-XHh3TjmeHO7aSbZPY8fsJH1JfRxZ_5g Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: b196bd92b2774a6898c39dc6e99b5674 Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-AttachVolumeTestJSON-166245674 Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b196bd92b2774a6898c39dc6e99b5674"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b196bd92b2774a6898c39dc6e99b5674"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b196bd92b2774a6898c39dc6e99b5674"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b196bd92b2774a6898c39dc6e99b5674", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-AttachVolumeTestJSON-166245674 Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: b196bd92b2774a6898c39dc6e99b5674 Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-AttachVolumeTestJSON-166245674 Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-AttachVolumeTestJSON-166245674-project Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: b07308778f1f4b4aa44713715cb2dc5d Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-AttachVolumeTestJSON-166245674-project Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 27172556-b12c-4974-815d-5f893a07506b could not be found. Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '27172556-b12c-4974-815d-5f893a07506b'} Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27172556-b12c-4974-815d-5f893a07506b could not be found. Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27172556-b12c-4974-815d-5f893a07506b could not be found. Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:26:48.405481 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:26:48.408925 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:26:48.408925 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:26:48.408925 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:26:48.408925 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:26:48.408925 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:26:48.408925 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27172556-b12c-4974-815d-5f893a07506b could not be found. Aug 31 16:26:48.408925 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:26:48.408925 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5c100f35-3d6c-4ede-9a74-878bb8339c3f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Returning 404 to user: Instance 27172556-b12c-4974-815d-5f893a07506b could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:26:48.408925 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5c100f35-3d6c-4ede-9a74-878bb8339c3f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b" status: 404 len: 111 microversion: 2.1 time: 0.160312 Aug 31 16:26:48.414798 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2975/6130] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:48 2022] GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b => generated 111 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:26:48.421979 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-512e5cfe-d7e1-4630-aebd-1b5f4d049c9e tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '.version_select at 0x7fbb46bf2af0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:48.445198 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dcc94e97-a790-4065-b18a-0c038e35ace1 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:48.446205 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dcc94e97-a790-4065-b18a-0c038e35ace1 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] [instance: 1652ca69-4e62-413f-aeda-ef5c8bbdcbe6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:48.455982 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcc94e97-a790-4065-b18a-0c038e35ace1 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:48.462823 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcc94e97-a790-4065-b18a-0c038e35ace1 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:48.462823 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcc94e97-a790-4065-b18a-0c038e35ace1 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:48.464137 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcc94e97-a790-4065-b18a-0c038e35ace1 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:48.465624 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcc94e97-a790-4065-b18a-0c038e35ace1 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:48.468721 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-512e5cfe-d7e1-4630-aebd-1b5f4d049c9e tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1349661177" status: 202 len: 0 microversion: 2.1 time: 0.049821 Aug 31 16:26:48.468721 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3156/6131] 10.222.0.50 () {58 vars in 1221 bytes} [Wed Aug 31 16:26:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1349661177 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 16:26:48.470802 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcc94e97-a790-4065-b18a-0c038e35ace1 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:48.770347 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dcc94e97-a790-4065-b18a-0c038e35ace1 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491c3afd0b634b859f8388454184b8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad72fb986ae4235bc6daa067d8d30c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:48.780360 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dcc94e97-a790-4065-b18a-0c038e35ace1 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] 10.222.0.50 "GET /compute/v2.1/servers/1652ca69-4e62-413f-aeda-ef5c8bbdcbe6" status: 200 len: 1361 microversion: 2.1 time: 0.340804 Aug 31 16:26:48.799732 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2976/6132] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:48 2022] GET /compute/v2.1/servers/1652ca69-4e62-413f-aeda-ef5c8bbdcbe6 => generated 1361 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:26:49.343767 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-02e4223f-1313-451e-a91e-c6ef1e00d33c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:49.344879 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-02e4223f-1313-451e-a91e-c6ef1e00d33c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 0afebe39-d25a-437e-86b5-30fefa20bc11] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:49.372191 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-02e4223f-1313-451e-a91e-c6ef1e00d33c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:49.372743 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-02e4223f-1313-451e-a91e-c6ef1e00d33c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:49.384952 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-02e4223f-1313-451e-a91e-c6ef1e00d33c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:49.387541 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-02e4223f-1313-451e-a91e-c6ef1e00d33c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:49.389547 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-02e4223f-1313-451e-a91e-c6ef1e00d33c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:49.393596 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-02e4223f-1313-451e-a91e-c6ef1e00d33c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:49.806378 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-eec64a2c-38ca-490e-b99f-ad684e62d065 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:49.809463 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-eec64a2c-38ca-490e-b99f-ad684e62d065 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] [instance: 1652ca69-4e62-413f-aeda-ef5c8bbdcbe6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:49.823117 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eec64a2c-38ca-490e-b99f-ad684e62d065 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:49.825167 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eec64a2c-38ca-490e-b99f-ad684e62d065 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:49.825816 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eec64a2c-38ca-490e-b99f-ad684e62d065 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:49.828531 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eec64a2c-38ca-490e-b99f-ad684e62d065 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:49.829321 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eec64a2c-38ca-490e-b99f-ad684e62d065 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:49.830593 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eec64a2c-38ca-490e-b99f-ad684e62d065 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:49.870836 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-02e4223f-1313-451e-a91e-c6ef1e00d33c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:49.880137 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-02e4223f-1313-451e-a91e-c6ef1e00d33c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11" status: 200 len: 1169 microversion: 2.1 time: 0.541904 Aug 31 16:26:49.884896 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3157/6133] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:49 2022] GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11 => generated 1169 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:50.385933 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-eec64a2c-38ca-490e-b99f-ad684e62d065 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491c3afd0b634b859f8388454184b8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad72fb986ae4235bc6daa067d8d30c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:50.399109 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-eec64a2c-38ca-490e-b99f-ad684e62d065 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] 10.222.0.50 "GET /compute/v2.1/servers/1652ca69-4e62-413f-aeda-ef5c8bbdcbe6" status: 200 len: 1429 microversion: 2.1 time: 0.597675 Aug 31 16:26:50.400078 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2977/6134] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:49 2022] GET /compute/v2.1/servers/1652ca69-4e62-413f-aeda-ef5c8bbdcbe6 => generated 1429 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:50.906011 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-831745c2-befe-401c-8f76-d524a43c63a9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:50.906671 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-831745c2-befe-401c-8f76-d524a43c63a9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 0afebe39-d25a-437e-86b5-30fefa20bc11] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:50.924114 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-831745c2-befe-401c-8f76-d524a43c63a9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:50.930936 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-831745c2-befe-401c-8f76-d524a43c63a9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:50.931712 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-831745c2-befe-401c-8f76-d524a43c63a9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:50.933376 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-831745c2-befe-401c-8f76-d524a43c63a9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:50.934852 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-831745c2-befe-401c-8f76-d524a43c63a9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:50.935244 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-831745c2-befe-401c-8f76-d524a43c63a9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:51.419351 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-40dd3907-6dce-4e08-a28a-8950b64401ef tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Action: 'create', calling method: .version_select at 0x7fbb45e00dc0>, body: {"keypair": {"name": "tempest-keypair-786212832", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGlP3xocJHwbsV2o5ZtIe0KUjsvzdNbfs+Fym8U82y9CqwWwDjk6Y/hZ3xmhwpzF/LLEmMSd5ZYh4+acjyn8zisG/JloQl7dYhcYAQu1W3UQ+gbDvtcxbOKfh3htJLuS0g=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:26:51.465684 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-40dd3907-6dce-4e08-a28a-8950b64401ef tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Getting quotas for project b196bd92b2774a6898c39dc6e99b5674. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:26:51.484104 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-40dd3907-6dce-4e08-a28a-8950b64401ef tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Getting quotas for user b07308778f1f4b4aa44713715cb2dc5d and project b196bd92b2774a6898c39dc6e99b5674. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:26:51.534843 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-831745c2-befe-401c-8f76-d524a43c63a9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:51.550321 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-40dd3907-6dce-4e08-a28a-8950b64401ef tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.135657 Aug 31 16:26:51.550943 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2978/6135] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 31 16:26:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:26:51.552674 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-831745c2-befe-401c-8f76-d524a43c63a9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11" status: 200 len: 1169 microversion: 2.1 time: 0.650063 Aug 31 16:26:51.562891 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2c40297c-93fc-44a0-8788-775b4a9d2134 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:51.570020 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3158/6136] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:50 2022] GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11 => generated 1169 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:51.573658 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2c40297c-93fc-44a0-8788-775b4a9d2134 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] [instance: 1652ca69-4e62-413f-aeda-ef5c8bbdcbe6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:51.594265 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c40297c-93fc-44a0-8788-775b4a9d2134 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:51.599361 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c40297c-93fc-44a0-8788-775b4a9d2134 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:51.604205 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c40297c-93fc-44a0-8788-775b4a9d2134 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:51.613795 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c40297c-93fc-44a0-8788-775b4a9d2134 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:51.614359 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c40297c-93fc-44a0-8788-775b4a9d2134 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:51.615094 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c40297c-93fc-44a0-8788-775b4a9d2134 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:52.014518 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2c40297c-93fc-44a0-8788-775b4a9d2134 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491c3afd0b634b859f8388454184b8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad72fb986ae4235bc6daa067d8d30c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:52.031196 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2c40297c-93fc-44a0-8788-775b4a9d2134 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] 10.222.0.50 "GET /compute/v2.1/servers/1652ca69-4e62-413f-aeda-ef5c8bbdcbe6" status: 200 len: 1429 microversion: 2.1 time: 0.479169 Aug 31 16:26:52.033971 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2979/6137] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:51 2022] GET /compute/v2.1/servers/1652ca69-4e62-413f-aeda-ef5c8bbdcbe6 => generated 1429 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:52.053997 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-8cd5e4f3-d726-4759-abe1-7300041637c7 req-da6ee7cd-e8e4-49e4-82ab-135a7a983763 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0afebe39-d25a-437e-86b5-30fefa20bc11", "tag": "fb55849b-19e9-4279-a7e9-1fcb19e0054a"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:26:52.081529 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-8cd5e4f3-d726-4759-abe1-7300041637c7 req-da6ee7cd-e8e4-49e4-82ab-135a7a983763 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:52.084344 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-8cd5e4f3-d726-4759-abe1-7300041637c7 req-da6ee7cd-e8e4-49e4-82ab-135a7a983763 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:52.085463 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-8cd5e4f3-d726-4759-abe1-7300041637c7 req-da6ee7cd-e8e4-49e4-82ab-135a7a983763 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:52.102986 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-8cd5e4f3-d726-4759-abe1-7300041637c7 req-da6ee7cd-e8e4-49e4-82ab-135a7a983763 service nova] Creating event network-changed:fb55849b-19e9-4279-a7e9-1fcb19e0054a for instance 0afebe39-d25a-437e-86b5-30fefa20bc11 on n-h1-833090-16 Aug 31 16:26:52.116606 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-8cd5e4f3-d726-4759-abe1-7300041637c7 req-da6ee7cd-e8e4-49e4-82ab-135a7a983763 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066009 Aug 31 16:26:52.121662 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3159/6138] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:26:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:26:52.586532 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8634765a-1cae-4df9-bca5-5fa1ee8ec3c7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:52.590205 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8634765a-1cae-4df9-bca5-5fa1ee8ec3c7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 0afebe39-d25a-437e-86b5-30fefa20bc11] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:52.609560 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8634765a-1cae-4df9-bca5-5fa1ee8ec3c7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:52.610478 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8634765a-1cae-4df9-bca5-5fa1ee8ec3c7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:52.612642 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8634765a-1cae-4df9-bca5-5fa1ee8ec3c7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:52.614424 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8634765a-1cae-4df9-bca5-5fa1ee8ec3c7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:52.618903 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8634765a-1cae-4df9-bca5-5fa1ee8ec3c7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:52.620933 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8634765a-1cae-4df9-bca5-5fa1ee8ec3c7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:53.117427 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-51f19a52-7ee7-4b36-93db-367dbb92b2e8 req-eb9c4d20-69a6-455a-a9c6-7a133193c98d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1652ca69-4e62-413f-aeda-ef5c8bbdcbe6", "tag": "8faf78da-76f3-45a7-adc4-310cb3235122"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:26:53.141917 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-51f19a52-7ee7-4b36-93db-367dbb92b2e8 req-eb9c4d20-69a6-455a-a9c6-7a133193c98d service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:53.141917 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-51f19a52-7ee7-4b36-93db-367dbb92b2e8 req-eb9c4d20-69a6-455a-a9c6-7a133193c98d service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:53.141917 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-51f19a52-7ee7-4b36-93db-367dbb92b2e8 req-eb9c4d20-69a6-455a-a9c6-7a133193c98d service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:53.172625 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-51f19a52-7ee7-4b36-93db-367dbb92b2e8 req-eb9c4d20-69a6-455a-a9c6-7a133193c98d service nova] Creating event network-changed:8faf78da-76f3-45a7-adc4-310cb3235122 for instance 1652ca69-4e62-413f-aeda-ef5c8bbdcbe6 on n-h1-833090-16 Aug 31 16:26:53.179428 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-51f19a52-7ee7-4b36-93db-367dbb92b2e8 req-eb9c4d20-69a6-455a-a9c6-7a133193c98d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.601142 Aug 31 16:26:53.180617 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3160/6139] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:26:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:26:53.191017 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4754c407-9311-47fd-98ad-96a7d224714f tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:53.194126 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4754c407-9311-47fd-98ad-96a7d224714f tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] [instance: 1652ca69-4e62-413f-aeda-ef5c8bbdcbe6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:53.211893 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4754c407-9311-47fd-98ad-96a7d224714f tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:53.213437 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4754c407-9311-47fd-98ad-96a7d224714f tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:53.215533 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4754c407-9311-47fd-98ad-96a7d224714f tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:53.221876 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4754c407-9311-47fd-98ad-96a7d224714f tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:53.222621 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4754c407-9311-47fd-98ad-96a7d224714f tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:53.223517 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4754c407-9311-47fd-98ad-96a7d224714f tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:53.273176 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8634765a-1cae-4df9-bca5-5fa1ee8ec3c7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:53.285415 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8634765a-1cae-4df9-bca5-5fa1ee8ec3c7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11" status: 200 len: 1169 microversion: 2.1 time: 0.710335 Aug 31 16:26:53.286170 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2980/6140] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:52 2022] GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11 => generated 1169 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:53.693715 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4754c407-9311-47fd-98ad-96a7d224714f tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491c3afd0b634b859f8388454184b8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad72fb986ae4235bc6daa067d8d30c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:53.710732 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4754c407-9311-47fd-98ad-96a7d224714f tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] 10.222.0.50 "GET /compute/v2.1/servers/1652ca69-4e62-413f-aeda-ef5c8bbdcbe6" status: 200 len: 1429 microversion: 2.1 time: 0.527490 Aug 31 16:26:53.712335 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3161/6141] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:53 2022] GET /compute/v2.1/servers/1652ca69-4e62-413f-aeda-ef5c8bbdcbe6 => generated 1429 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:54.329481 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-47e459b3-3d88-45ff-a5ce-3a1350aa8ac6 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:54.330902 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-47e459b3-3d88-45ff-a5ce-3a1350aa8ac6 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 0afebe39-d25a-437e-86b5-30fefa20bc11] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:54.341000 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:26:54.347385 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47e459b3-3d88-45ff-a5ce-3a1350aa8ac6 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:54.348296 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47e459b3-3d88-45ff-a5ce-3a1350aa8ac6 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:54.351111 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47e459b3-3d88-45ff-a5ce-3a1350aa8ac6 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:54.352131 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47e459b3-3d88-45ff-a5ce-3a1350aa8ac6 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:54.353173 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47e459b3-3d88-45ff-a5ce-3a1350aa8ac6 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:54.354004 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47e459b3-3d88-45ff-a5ce-3a1350aa8ac6 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:54.653398 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-47e459b3-3d88-45ff-a5ce-3a1350aa8ac6 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:54.663556 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-47e459b3-3d88-45ff-a5ce-3a1350aa8ac6 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11" status: 200 len: 1169 microversion: 2.1 time: 0.339674 Aug 31 16:26:54.666210 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2981/6142] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:54 2022] GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11 => generated 1169 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:54.736961 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6eace64e-ee2f-4039-8b6b-5f368c102854 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:54.737775 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6eace64e-ee2f-4039-8b6b-5f368c102854 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] [instance: 1652ca69-4e62-413f-aeda-ef5c8bbdcbe6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:54.741014 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:26:54.759987 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6eace64e-ee2f-4039-8b6b-5f368c102854 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:54.760679 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6eace64e-ee2f-4039-8b6b-5f368c102854 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:54.761310 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6eace64e-ee2f-4039-8b6b-5f368c102854 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:54.762155 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6eace64e-ee2f-4039-8b6b-5f368c102854 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:54.762717 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6eace64e-ee2f-4039-8b6b-5f368c102854 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:54.763661 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6eace64e-ee2f-4039-8b6b-5f368c102854 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:55.199545 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6eace64e-ee2f-4039-8b6b-5f368c102854 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491c3afd0b634b859f8388454184b8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad72fb986ae4235bc6daa067d8d30c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:55.209208 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6eace64e-ee2f-4039-8b6b-5f368c102854 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] 10.222.0.50 "GET /compute/v2.1/servers/1652ca69-4e62-413f-aeda-ef5c8bbdcbe6" status: 200 len: 1429 microversion: 2.1 time: 0.476391 Aug 31 16:26:55.223566 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3162/6143] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:54 2022] GET /compute/v2.1/servers/1652ca69-4e62-413f-aeda-ef5c8bbdcbe6 => generated 1429 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:55.693591 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-709a24f9-08e1-4296-8dd1-b28ea4d5be5f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:55.695269 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-709a24f9-08e1-4296-8dd1-b28ea4d5be5f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 0afebe39-d25a-437e-86b5-30fefa20bc11] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:55.734474 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-709a24f9-08e1-4296-8dd1-b28ea4d5be5f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:55.737030 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-709a24f9-08e1-4296-8dd1-b28ea4d5be5f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:55.748856 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-709a24f9-08e1-4296-8dd1-b28ea4d5be5f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:55.775377 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-709a24f9-08e1-4296-8dd1-b28ea4d5be5f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:55.788127 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-709a24f9-08e1-4296-8dd1-b28ea4d5be5f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:55.788858 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-709a24f9-08e1-4296-8dd1-b28ea4d5be5f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:55.816973 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a09825bd-208c-4017-844d-01b2c3fd5fe4 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2135712111", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "27decff3-e28e-43ba-9fd1-b25d1c847b72"}], "security_groups": [{"name": "tempest-securitygroup--442042124"}], "key_name": "tempest-keypair-786212832", "user_data": "}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:26:55.914635 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=10 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:26:56.380435 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-a09825bd-208c-4017-844d-01b2c3fd5fe4 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] validate_networks() for [('27decff3-e28e-43ba-9fd1-b25d1c847b72', None, None, None, None, None)] {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:26:56.584402 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-709a24f9-08e1-4296-8dd1-b28ea4d5be5f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:56.596901 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-709a24f9-08e1-4296-8dd1-b28ea4d5be5f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11" status: 200 len: 1169 microversion: 2.1 time: 0.907939 Aug 31 16:26:56.598057 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2982/6144] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:55 2022] GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11 => generated 1169 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:56.613973 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bddf447b-692f-4657-87d7-c068c8833ee1 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:56.614813 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bddf447b-692f-4657-87d7-c068c8833ee1 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] [instance: 1652ca69-4e62-413f-aeda-ef5c8bbdcbe6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:56.632299 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bddf447b-692f-4657-87d7-c068c8833ee1 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:56.632732 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bddf447b-692f-4657-87d7-c068c8833ee1 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:56.633418 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bddf447b-692f-4657-87d7-c068c8833ee1 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:56.638646 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bddf447b-692f-4657-87d7-c068c8833ee1 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:56.639381 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bddf447b-692f-4657-87d7-c068c8833ee1 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:56.639951 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bddf447b-692f-4657-87d7-c068c8833ee1 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:56.976390 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bddf447b-692f-4657-87d7-c068c8833ee1 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491c3afd0b634b859f8388454184b8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad72fb986ae4235bc6daa067d8d30c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:56.985940 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bddf447b-692f-4657-87d7-c068c8833ee1 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] 10.222.0.50 "GET /compute/v2.1/servers/1652ca69-4e62-413f-aeda-ef5c8bbdcbe6" status: 200 len: 1429 microversion: 2.1 time: 0.383981 Aug 31 16:26:56.989219 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2983/6145] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:56 2022] GET /compute/v2.1/servers/1652ca69-4e62-413f-aeda-ef5c8bbdcbe6 => generated 1429 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:57.307801 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-a09825bd-208c-4017-844d-01b2c3fd5fe4 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:26:57.308268 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-a09825bd-208c-4017-844d-01b2c3fd5fe4 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:26:57.308643 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-a09825bd-208c-4017-844d-01b2c3fd5fe4 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:26:57.309036 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-a09825bd-208c-4017-844d-01b2c3fd5fe4 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:26:57.310434 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-a09825bd-208c-4017-844d-01b2c3fd5fe4 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:26:57.327667 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a09825bd-208c-4017-844d-01b2c3fd5fe4 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:57.329175 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a09825bd-208c-4017-844d-01b2c3fd5fe4 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:57.330019 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a09825bd-208c-4017-844d-01b2c3fd5fe4 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:57.333405 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a09825bd-208c-4017-844d-01b2c3fd5fe4 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:57.334030 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a09825bd-208c-4017-844d-01b2c3fd5fe4 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:57.335235 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a09825bd-208c-4017-844d-01b2c3fd5fe4 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:57.376301 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-a09825bd-208c-4017-844d-01b2c3fd5fe4 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Getting quotas for project b196bd92b2774a6898c39dc6e99b5674. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:26:57.384497 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-a09825bd-208c-4017-844d-01b2c3fd5fe4 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Getting quotas for user b07308778f1f4b4aa44713715cb2dc5d and project b196bd92b2774a6898c39dc6e99b5674. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:26:57.404613 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a09825bd-208c-4017-844d-01b2c3fd5fe4 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:26:57.408864 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a09825bd-208c-4017-844d-01b2c3fd5fe4 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 6e296817-752b-4ef9-812b-882268796473] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:26:57.500687 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a09825bd-208c-4017-844d-01b2c3fd5fe4 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.693394 Aug 31 16:26:57.503764 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3163/6146] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:26:55 2022] POST /compute/v2.1/servers => generated 401 bytes in 1699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 16:26:57.523248 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-365edf5f-2f50-4466-a5a0-44b9b234ed8e tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:57.524174 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-365edf5f-2f50-4466-a5a0-44b9b234ed8e tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 6e296817-752b-4ef9-812b-882268796473] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:57.624842 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7c8d5f75-dfe8-47f4-9360-133b7a4740d1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:57.625460 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7c8d5f75-dfe8-47f4-9360-133b7a4740d1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 0afebe39-d25a-437e-86b5-30fefa20bc11] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:57.639037 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-365edf5f-2f50-4466-a5a0-44b9b234ed8e tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:57.642121 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7c8d5f75-dfe8-47f4-9360-133b7a4740d1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:57.643518 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7c8d5f75-dfe8-47f4-9360-133b7a4740d1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:57.649665 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-365edf5f-2f50-4466-a5a0-44b9b234ed8e tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473" status: 200 len: 1237 microversion: 2.1 time: 0.139199 Aug 31 16:26:57.649831 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7c8d5f75-dfe8-47f4-9360-133b7a4740d1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:57.651574 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2984/6147] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:57 2022] GET /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473 => generated 1237 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:57.652274 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7c8d5f75-dfe8-47f4-9360-133b7a4740d1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:57.653216 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7c8d5f75-dfe8-47f4-9360-133b7a4740d1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:57.653318 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7c8d5f75-dfe8-47f4-9360-133b7a4740d1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:58.012886 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-100dbb9b-446b-4a6d-a9e5-eb9929e63454 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:58.014850 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-100dbb9b-446b-4a6d-a9e5-eb9929e63454 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] [instance: 1652ca69-4e62-413f-aeda-ef5c8bbdcbe6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:58.032415 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-100dbb9b-446b-4a6d-a9e5-eb9929e63454 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:58.033222 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-100dbb9b-446b-4a6d-a9e5-eb9929e63454 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:58.034823 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-100dbb9b-446b-4a6d-a9e5-eb9929e63454 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:58.035503 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-100dbb9b-446b-4a6d-a9e5-eb9929e63454 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:58.035992 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-100dbb9b-446b-4a6d-a9e5-eb9929e63454 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:58.038864 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-100dbb9b-446b-4a6d-a9e5-eb9929e63454 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:58.276579 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7c8d5f75-dfe8-47f4-9360-133b7a4740d1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:58.288676 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7c8d5f75-dfe8-47f4-9360-133b7a4740d1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11" status: 200 len: 1169 microversion: 2.1 time: 0.664724 Aug 31 16:26:58.289822 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3164/6148] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:57 2022] GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11 => generated 1169 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:58.363994 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-100dbb9b-446b-4a6d-a9e5-eb9929e63454 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491c3afd0b634b859f8388454184b8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad72fb986ae4235bc6daa067d8d30c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:58.380048 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-100dbb9b-446b-4a6d-a9e5-eb9929e63454 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] 10.222.0.50 "GET /compute/v2.1/servers/1652ca69-4e62-413f-aeda-ef5c8bbdcbe6" status: 200 len: 1429 microversion: 2.1 time: 0.371453 Aug 31 16:26:58.396854 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2985/6149] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:58 2022] GET /compute/v2.1/servers/1652ca69-4e62-413f-aeda-ef5c8bbdcbe6 => generated 1429 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:58.677242 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5402a6eb-9d2f-4610-8004-fdf0e0f6b836 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:58.678186 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5402a6eb-9d2f-4610-8004-fdf0e0f6b836 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 6e296817-752b-4ef9-812b-882268796473] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:58.716339 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5402a6eb-9d2f-4610-8004-fdf0e0f6b836 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:58.717737 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5402a6eb-9d2f-4610-8004-fdf0e0f6b836 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:58.723007 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5402a6eb-9d2f-4610-8004-fdf0e0f6b836 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:58.724443 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5402a6eb-9d2f-4610-8004-fdf0e0f6b836 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:58.730839 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5402a6eb-9d2f-4610-8004-fdf0e0f6b836 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:58.736458 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5402a6eb-9d2f-4610-8004-fdf0e0f6b836 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:58.911902 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5402a6eb-9d2f-4610-8004-fdf0e0f6b836 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:58.931176 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5402a6eb-9d2f-4610-8004-fdf0e0f6b836 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473" status: 200 len: 1241 microversion: 2.1 time: 0.257232 Aug 31 16:26:58.933457 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3165/6150] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:58 2022] GET /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473 => generated 1241 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:59.338539 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-960b94ab-7557-4a1a-b071-4b17bbcaeca0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:59.339823 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-960b94ab-7557-4a1a-b071-4b17bbcaeca0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 0afebe39-d25a-437e-86b5-30fefa20bc11] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:59.350906 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-960b94ab-7557-4a1a-b071-4b17bbcaeca0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:59.351406 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-960b94ab-7557-4a1a-b071-4b17bbcaeca0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:59.351984 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-960b94ab-7557-4a1a-b071-4b17bbcaeca0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:59.352649 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-960b94ab-7557-4a1a-b071-4b17bbcaeca0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:59.353106 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-960b94ab-7557-4a1a-b071-4b17bbcaeca0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:59.353603 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-960b94ab-7557-4a1a-b071-4b17bbcaeca0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:59.575215 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-960b94ab-7557-4a1a-b071-4b17bbcaeca0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:59.589967 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-960b94ab-7557-4a1a-b071-4b17bbcaeca0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11" status: 200 len: 1169 microversion: 2.1 time: 0.255321 Aug 31 16:26:59.595421 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3166/6151] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:59 2022] GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11 => generated 1169 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:26:59.606447 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5f3b098f-62f1-434d-93ae-6d9faf0402fe tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:26:59.615014 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5f3b098f-62f1-434d-93ae-6d9faf0402fe tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] [instance: 1652ca69-4e62-413f-aeda-ef5c8bbdcbe6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:26:59.631016 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5f3b098f-62f1-434d-93ae-6d9faf0402fe tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:59.644335 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5f3b098f-62f1-434d-93ae-6d9faf0402fe tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:59.645004 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5f3b098f-62f1-434d-93ae-6d9faf0402fe tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:59.646125 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5f3b098f-62f1-434d-93ae-6d9faf0402fe tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:26:59.646736 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5f3b098f-62f1-434d-93ae-6d9faf0402fe tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:26:59.647330 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5f3b098f-62f1-434d-93ae-6d9faf0402fe tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:26:59.943510 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5f3b098f-62f1-434d-93ae-6d9faf0402fe tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491c3afd0b634b859f8388454184b8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad72fb986ae4235bc6daa067d8d30c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:26:59.995781 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5f3b098f-62f1-434d-93ae-6d9faf0402fe tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] 10.222.0.50 "GET /compute/v2.1/servers/1652ca69-4e62-413f-aeda-ef5c8bbdcbe6" status: 200 len: 1429 microversion: 2.1 time: 0.399099 Aug 31 16:26:59.998272 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3167/6152] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:59 2022] GET /compute/v2.1/servers/1652ca69-4e62-413f-aeda-ef5c8bbdcbe6 => generated 1429 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:00.012799 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-efa4858c-1d32-4f15-afb9-d67861bb1c70 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:00.013703 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-efa4858c-1d32-4f15-afb9-d67861bb1c70 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 6e296817-752b-4ef9-812b-882268796473] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:00.018516 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-e5a82741-35f3-4840-b915-4aea68815a77 req-5b1a3373-1f48-4e49-ae98-ead9ffd6512b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1652ca69-4e62-413f-aeda-ef5c8bbdcbe6", "name": "network-vif-plugged", "status": "completed", "tag": "8faf78da-76f3-45a7-adc4-310cb3235122"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:27:00.029198 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-efa4858c-1d32-4f15-afb9-d67861bb1c70 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:00.031205 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-efa4858c-1d32-4f15-afb9-d67861bb1c70 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:00.032494 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-efa4858c-1d32-4f15-afb9-d67861bb1c70 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:00.035266 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-efa4858c-1d32-4f15-afb9-d67861bb1c70 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:00.036976 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-efa4858c-1d32-4f15-afb9-d67861bb1c70 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:00.037796 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-efa4858c-1d32-4f15-afb9-d67861bb1c70 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:00.047696 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e5a82741-35f3-4840-b915-4aea68815a77 req-5b1a3373-1f48-4e49-ae98-ead9ffd6512b service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:00.054690 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e5a82741-35f3-4840-b915-4aea68815a77 req-5b1a3373-1f48-4e49-ae98-ead9ffd6512b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:00.056629 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e5a82741-35f3-4840-b915-4aea68815a77 req-5b1a3373-1f48-4e49-ae98-ead9ffd6512b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:00.114677 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-e5a82741-35f3-4840-b915-4aea68815a77 req-5b1a3373-1f48-4e49-ae98-ead9ffd6512b service nova] Creating event network-vif-plugged:8faf78da-76f3-45a7-adc4-310cb3235122 for instance 1652ca69-4e62-413f-aeda-ef5c8bbdcbe6 on n-h1-833090-16 Aug 31 16:27:00.134133 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-e5a82741-35f3-4840-b915-4aea68815a77 req-5b1a3373-1f48-4e49-ae98-ead9ffd6512b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.024694 Aug 31 16:27:00.143959 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2986/6153] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:26:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:27:00.214331 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-efa4858c-1d32-4f15-afb9-d67861bb1c70 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:00.228193 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-efa4858c-1d32-4f15-afb9-d67861bb1c70 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473" status: 200 len: 1307 microversion: 2.1 time: 0.228538 Aug 31 16:27:00.228975 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3168/6154] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:26:59 2022] GET /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473 => generated 1307 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:00.625848 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1cd1a546-0422-48dd-b4ab-ce0d42dbffcf tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:00.627125 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1cd1a546-0422-48dd-b4ab-ce0d42dbffcf tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 0afebe39-d25a-437e-86b5-30fefa20bc11] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:00.643556 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1cd1a546-0422-48dd-b4ab-ce0d42dbffcf tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:00.644224 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1cd1a546-0422-48dd-b4ab-ce0d42dbffcf tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:00.647639 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1cd1a546-0422-48dd-b4ab-ce0d42dbffcf tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:00.649747 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1cd1a546-0422-48dd-b4ab-ce0d42dbffcf tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:00.651695 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1cd1a546-0422-48dd-b4ab-ce0d42dbffcf tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:00.652519 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1cd1a546-0422-48dd-b4ab-ce0d42dbffcf tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:00.717619 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:27:01.017793 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1cd1a546-0422-48dd-b4ab-ce0d42dbffcf tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:01.022220 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e8b62f3a-7820-4601-abae-d08b25b17aac tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:01.023195 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e8b62f3a-7820-4601-abae-d08b25b17aac tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] [instance: 1652ca69-4e62-413f-aeda-ef5c8bbdcbe6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:01.033842 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1cd1a546-0422-48dd-b4ab-ce0d42dbffcf tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11" status: 200 len: 1169 microversion: 2.1 time: 0.414747 Aug 31 16:27:01.037448 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e8b62f3a-7820-4601-abae-d08b25b17aac tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:01.038312 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e8b62f3a-7820-4601-abae-d08b25b17aac tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:01.039173 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e8b62f3a-7820-4601-abae-d08b25b17aac tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:01.040619 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e8b62f3a-7820-4601-abae-d08b25b17aac tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:01.041660 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e8b62f3a-7820-4601-abae-d08b25b17aac tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:01.042908 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e8b62f3a-7820-4601-abae-d08b25b17aac tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:01.052920 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2987/6155] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:00 2022] GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11 => generated 1169 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:01.252597 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0aa11673-e229-41ae-89bc-5730ada5dcf7 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:01.253666 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0aa11673-e229-41ae-89bc-5730ada5dcf7 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 6e296817-752b-4ef9-812b-882268796473] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:01.263931 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:27:01.273415 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0aa11673-e229-41ae-89bc-5730ada5dcf7 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:01.274245 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0aa11673-e229-41ae-89bc-5730ada5dcf7 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:01.274689 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e8b62f3a-7820-4601-abae-d08b25b17aac tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491c3afd0b634b859f8388454184b8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad72fb986ae4235bc6daa067d8d30c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:01.279283 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0aa11673-e229-41ae-89bc-5730ada5dcf7 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:01.280990 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=100 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:27:01.283745 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0aa11673-e229-41ae-89bc-5730ada5dcf7 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:01.285036 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0aa11673-e229-41ae-89bc-5730ada5dcf7 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:01.286145 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0aa11673-e229-41ae-89bc-5730ada5dcf7 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:01.293392 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e8b62f3a-7820-4601-abae-d08b25b17aac tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] 10.222.0.50 "GET /compute/v2.1/servers/1652ca69-4e62-413f-aeda-ef5c8bbdcbe6" status: 200 len: 1429 microversion: 2.1 time: 0.276625 Aug 31 16:27:01.295387 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3169/6156] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:01 2022] GET /compute/v2.1/servers/1652ca69-4e62-413f-aeda-ef5c8bbdcbe6 => generated 1429 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:27:01.463014 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0aa11673-e229-41ae-89bc-5730ada5dcf7 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:01.481001 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0aa11673-e229-41ae-89bc-5730ada5dcf7 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473" status: 200 len: 1295 microversion: 2.1 time: 0.228928 Aug 31 16:27:01.484803 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2988/6157] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:01 2022] GET /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473 => generated 1295 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:02.061630 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7a7eacb4-6e89-463a-8fa1-7c3a392535ae tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:02.063098 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7a7eacb4-6e89-463a-8fa1-7c3a392535ae tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 0afebe39-d25a-437e-86b5-30fefa20bc11] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:02.076006 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7a7eacb4-6e89-463a-8fa1-7c3a392535ae tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:02.079098 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7a7eacb4-6e89-463a-8fa1-7c3a392535ae tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:02.086843 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7a7eacb4-6e89-463a-8fa1-7c3a392535ae tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:02.087824 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7a7eacb4-6e89-463a-8fa1-7c3a392535ae tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:02.088431 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7a7eacb4-6e89-463a-8fa1-7c3a392535ae tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:02.089126 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7a7eacb4-6e89-463a-8fa1-7c3a392535ae tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:02.343137 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c68ba656-d18f-4509-9c66-2d4685904c42 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:02.346597 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c68ba656-d18f-4509-9c66-2d4685904c42 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] [instance: 1652ca69-4e62-413f-aeda-ef5c8bbdcbe6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:02.355473 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7a7eacb4-6e89-463a-8fa1-7c3a392535ae tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:02.376694 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7a7eacb4-6e89-463a-8fa1-7c3a392535ae tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11" status: 200 len: 1169 microversion: 2.1 time: 0.319256 Aug 31 16:27:02.380580 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3170/6158] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:02 2022] GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11 => generated 1169 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:02.408689 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c68ba656-d18f-4509-9c66-2d4685904c42 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:02.410608 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c68ba656-d18f-4509-9c66-2d4685904c42 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:02.411403 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c68ba656-d18f-4509-9c66-2d4685904c42 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:02.413332 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c68ba656-d18f-4509-9c66-2d4685904c42 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:02.416160 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c68ba656-d18f-4509-9c66-2d4685904c42 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:02.418727 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c68ba656-d18f-4509-9c66-2d4685904c42 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:02.511224 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b5f4ff8c-fc51-49d3-85c8-b5f4c4773d52 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:02.512378 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b5f4ff8c-fc51-49d3-85c8-b5f4c4773d52 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 6e296817-752b-4ef9-812b-882268796473] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:02.526948 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b5f4ff8c-fc51-49d3-85c8-b5f4c4773d52 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:02.527448 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b5f4ff8c-fc51-49d3-85c8-b5f4c4773d52 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:02.527883 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b5f4ff8c-fc51-49d3-85c8-b5f4c4773d52 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:02.536767 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b5f4ff8c-fc51-49d3-85c8-b5f4c4773d52 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:02.537378 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b5f4ff8c-fc51-49d3-85c8-b5f4c4773d52 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:02.537825 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b5f4ff8c-fc51-49d3-85c8-b5f4c4773d52 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:02.875993 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c68ba656-d18f-4509-9c66-2d4685904c42 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491c3afd0b634b859f8388454184b8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad72fb986ae4235bc6daa067d8d30c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:02.885389 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c68ba656-d18f-4509-9c66-2d4685904c42 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] 10.222.0.50 "GET /compute/v2.1/servers/1652ca69-4e62-413f-aeda-ef5c8bbdcbe6" status: 200 len: 1610 microversion: 2.1 time: 0.552746 Aug 31 16:27:02.886973 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2989/6159] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:02 2022] GET /compute/v2.1/servers/1652ca69-4e62-413f-aeda-ef5c8bbdcbe6 => generated 1610 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:27:02.913235 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-59d639d5-a5ff-4951-9228-d794f4a93a72 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:02.913965 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-59d639d5-a5ff-4951-9228-d794f4a93a72 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] [instance: 1652ca69-4e62-413f-aeda-ef5c8bbdcbe6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:02.926140 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-59d639d5-a5ff-4951-9228-d794f4a93a72 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:02.928409 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-59d639d5-a5ff-4951-9228-d794f4a93a72 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:02.929002 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-59d639d5-a5ff-4951-9228-d794f4a93a72 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:02.929863 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-59d639d5-a5ff-4951-9228-d794f4a93a72 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:02.931637 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-59d639d5-a5ff-4951-9228-d794f4a93a72 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:02.940379 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-59d639d5-a5ff-4951-9228-d794f4a93a72 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:03.097381 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b5f4ff8c-fc51-49d3-85c8-b5f4c4773d52 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:03.112162 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b5f4ff8c-fc51-49d3-85c8-b5f4c4773d52 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473" status: 200 len: 1362 microversion: 2.1 time: 0.606627 Aug 31 16:27:03.128945 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3171/6160] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:02 2022] GET /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473 => generated 1362 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:03.265580 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-59d639d5-a5ff-4951-9228-d794f4a93a72 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491c3afd0b634b859f8388454184b8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad72fb986ae4235bc6daa067d8d30c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:03.289612 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-59d639d5-a5ff-4951-9228-d794f4a93a72 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] 10.222.0.50 "GET /compute/v2.1/servers/1652ca69-4e62-413f-aeda-ef5c8bbdcbe6" status: 200 len: 1610 microversion: 2.1 time: 0.379936 Aug 31 16:27:03.308152 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2990/6161] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:02 2022] GET /compute/v2.1/servers/1652ca69-4e62-413f-aeda-ef5c8bbdcbe6 => generated 1610 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:27:03.354706 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6e79a673-8b6e-4d8e-8f86-a77317db7af3 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:03.355341 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6e79a673-8b6e-4d8e-8f86-a77317db7af3 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] [instance: 1652ca69-4e62-413f-aeda-ef5c8bbdcbe6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:03.363092 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6e79a673-8b6e-4d8e-8f86-a77317db7af3 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:03.364018 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6e79a673-8b6e-4d8e-8f86-a77317db7af3 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:03.364612 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6e79a673-8b6e-4d8e-8f86-a77317db7af3 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:03.365417 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6e79a673-8b6e-4d8e-8f86-a77317db7af3 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:03.366014 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6e79a673-8b6e-4d8e-8f86-a77317db7af3 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:03.366607 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6e79a673-8b6e-4d8e-8f86-a77317db7af3 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:03.402768 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c29657d3-4abd-4252-8db8-825c35f77776 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:03.404320 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c29657d3-4abd-4252-8db8-825c35f77776 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 0afebe39-d25a-437e-86b5-30fefa20bc11] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:03.417026 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c29657d3-4abd-4252-8db8-825c35f77776 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:03.419846 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c29657d3-4abd-4252-8db8-825c35f77776 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:03.420881 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c29657d3-4abd-4252-8db8-825c35f77776 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:03.424125 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c29657d3-4abd-4252-8db8-825c35f77776 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:03.426047 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c29657d3-4abd-4252-8db8-825c35f77776 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:03.429578 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c29657d3-4abd-4252-8db8-825c35f77776 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:03.956978 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c29657d3-4abd-4252-8db8-825c35f77776 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:03.983746 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6e79a673-8b6e-4d8e-8f86-a77317db7af3 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491c3afd0b634b859f8388454184b8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad72fb986ae4235bc6daa067d8d30c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:03.988210 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c29657d3-4abd-4252-8db8-825c35f77776 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11" status: 200 len: 1169 microversion: 2.1 time: 0.588478 Aug 31 16:27:03.998566 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2991/6162] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:03 2022] GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11 => generated 1169 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:04.008593 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6e79a673-8b6e-4d8e-8f86-a77317db7af3 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] 10.222.0.50 "GET /compute/v2.1/servers/1652ca69-4e62-413f-aeda-ef5c8bbdcbe6" status: 200 len: 1610 microversion: 2.1 time: 0.672693 Aug 31 16:27:04.022716 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3172/6163] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:03 2022] GET /compute/v2.1/servers/1652ca69-4e62-413f-aeda-ef5c8bbdcbe6 => generated 1610 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:04.142903 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cdc3633a-be2d-4d90-9f09-11106124da5c tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:04.143787 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cdc3633a-be2d-4d90-9f09-11106124da5c tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 6e296817-752b-4ef9-812b-882268796473] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:04.163779 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cdc3633a-be2d-4d90-9f09-11106124da5c tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:04.164654 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cdc3633a-be2d-4d90-9f09-11106124da5c tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:04.165278 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cdc3633a-be2d-4d90-9f09-11106124da5c tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:04.166160 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cdc3633a-be2d-4d90-9f09-11106124da5c tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:04.166867 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cdc3633a-be2d-4d90-9f09-11106124da5c tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:04.167525 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cdc3633a-be2d-4d90-9f09-11106124da5c tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:04.224190 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-ff1e6a56-aecb-4d3f-97fb-7540fce9d829 req-f9a24f0b-0689-4b4b-afdb-c862918a1ab5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e296817-752b-4ef9-812b-882268796473", "tag": "5901bbb7-215f-4339-8d62-cf9aa9918acf"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:27:04.285768 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-ff1e6a56-aecb-4d3f-97fb-7540fce9d829 req-f9a24f0b-0689-4b4b-afdb-c862918a1ab5 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:04.288230 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-ff1e6a56-aecb-4d3f-97fb-7540fce9d829 req-f9a24f0b-0689-4b4b-afdb-c862918a1ab5 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:04.291327 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-ff1e6a56-aecb-4d3f-97fb-7540fce9d829 req-f9a24f0b-0689-4b4b-afdb-c862918a1ab5 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:04.333094 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-ff1e6a56-aecb-4d3f-97fb-7540fce9d829 req-f9a24f0b-0689-4b4b-afdb-c862918a1ab5 service nova] Creating event network-changed:5901bbb7-215f-4339-8d62-cf9aa9918acf for instance 6e296817-752b-4ef9-812b-882268796473 on n-h2-833090-16 Aug 31 16:27:04.346253 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-ff1e6a56-aecb-4d3f-97fb-7540fce9d829 req-f9a24f0b-0689-4b4b-afdb-c862918a1ab5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126641 Aug 31 16:27:04.350421 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3173/6164] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:27:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:27:04.563753 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cdc3633a-be2d-4d90-9f09-11106124da5c tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:04.576376 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cdc3633a-be2d-4d90-9f09-11106124da5c tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473" status: 200 len: 1362 microversion: 2.1 time: 0.443334 Aug 31 16:27:04.577861 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2992/6165] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:04 2022] GET /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473 => generated 1362 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:05.013975 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4e530065-cc30-4f4c-8d0f-cfaa589c2b17 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:05.015159 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4e530065-cc30-4f4c-8d0f-cfaa589c2b17 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 0afebe39-d25a-437e-86b5-30fefa20bc11] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:05.032874 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4e530065-cc30-4f4c-8d0f-cfaa589c2b17 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:05.033671 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4e530065-cc30-4f4c-8d0f-cfaa589c2b17 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:05.034305 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4e530065-cc30-4f4c-8d0f-cfaa589c2b17 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:05.035390 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4e530065-cc30-4f4c-8d0f-cfaa589c2b17 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:05.036054 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4e530065-cc30-4f4c-8d0f-cfaa589c2b17 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:05.043255 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4e530065-cc30-4f4c-8d0f-cfaa589c2b17 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:05.330653 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4e530065-cc30-4f4c-8d0f-cfaa589c2b17 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:05.342840 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4e530065-cc30-4f4c-8d0f-cfaa589c2b17 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11" status: 200 len: 1169 microversion: 2.1 time: 0.333452 Aug 31 16:27:05.343835 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3174/6166] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:05 2022] GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11 => generated 1169 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:05.602456 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e51d5acc-942f-42a9-9353-fa9fddff5cf0 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:05.604006 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e51d5acc-942f-42a9-9353-fa9fddff5cf0 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 6e296817-752b-4ef9-812b-882268796473] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:05.621465 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e51d5acc-942f-42a9-9353-fa9fddff5cf0 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:05.622293 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e51d5acc-942f-42a9-9353-fa9fddff5cf0 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:05.622833 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e51d5acc-942f-42a9-9353-fa9fddff5cf0 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:05.625135 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e51d5acc-942f-42a9-9353-fa9fddff5cf0 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:05.625743 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e51d5acc-942f-42a9-9353-fa9fddff5cf0 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:05.626318 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e51d5acc-942f-42a9-9353-fa9fddff5cf0 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:05.892832 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e51d5acc-942f-42a9-9353-fa9fddff5cf0 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:05.911081 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e51d5acc-942f-42a9-9353-fa9fddff5cf0 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473" status: 200 len: 1362 microversion: 2.1 time: 0.312563 Aug 31 16:27:05.911783 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2993/6167] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:05 2022] GET /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473 => generated 1362 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:06.384520 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0ce065b4-a2ed-48e5-b6fc-277c60e56041 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:06.385145 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0ce065b4-a2ed-48e5-b6fc-277c60e56041 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 0afebe39-d25a-437e-86b5-30fefa20bc11] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:06.393006 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0ce065b4-a2ed-48e5-b6fc-277c60e56041 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:06.393819 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0ce065b4-a2ed-48e5-b6fc-277c60e56041 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:06.394522 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0ce065b4-a2ed-48e5-b6fc-277c60e56041 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:06.395495 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0ce065b4-a2ed-48e5-b6fc-277c60e56041 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:06.396295 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0ce065b4-a2ed-48e5-b6fc-277c60e56041 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:06.396831 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0ce065b4-a2ed-48e5-b6fc-277c60e56041 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:06.685579 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0ce065b4-a2ed-48e5-b6fc-277c60e56041 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:06.724440 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0ce065b4-a2ed-48e5-b6fc-277c60e56041 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11" status: 200 len: 1169 microversion: 2.1 time: 0.345572 Aug 31 16:27:06.726169 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3175/6168] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:06 2022] GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11 => generated 1169 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:06.934999 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-616191d8-ae5b-4426-ad01-a6ecc345049d tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:06.937240 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-616191d8-ae5b-4426-ad01-a6ecc345049d tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 6e296817-752b-4ef9-812b-882268796473] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:06.960636 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-616191d8-ae5b-4426-ad01-a6ecc345049d tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:06.962040 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-616191d8-ae5b-4426-ad01-a6ecc345049d tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:06.962967 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-616191d8-ae5b-4426-ad01-a6ecc345049d tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:06.964396 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-616191d8-ae5b-4426-ad01-a6ecc345049d tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:06.970852 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-616191d8-ae5b-4426-ad01-a6ecc345049d tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:06.971522 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-616191d8-ae5b-4426-ad01-a6ecc345049d tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:07.442484 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-616191d8-ae5b-4426-ad01-a6ecc345049d tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:07.452361 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-616191d8-ae5b-4426-ad01-a6ecc345049d tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473" status: 200 len: 1362 microversion: 2.1 time: 0.523609 Aug 31 16:27:07.455455 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2994/6169] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:06 2022] GET /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473 => generated 1362 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:07.746688 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-dc99c511-984a-45ca-be6b-4b20fca31646 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:07.748014 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-dc99c511-984a-45ca-be6b-4b20fca31646 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 0afebe39-d25a-437e-86b5-30fefa20bc11] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:07.750400 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:27:07.769755 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=6 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:27:07.799409 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dc99c511-984a-45ca-be6b-4b20fca31646 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:07.799924 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dc99c511-984a-45ca-be6b-4b20fca31646 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:07.800417 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dc99c511-984a-45ca-be6b-4b20fca31646 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:07.801084 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dc99c511-984a-45ca-be6b-4b20fca31646 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:07.801545 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dc99c511-984a-45ca-be6b-4b20fca31646 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:07.809307 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dc99c511-984a-45ca-be6b-4b20fca31646 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:08.401928 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-dc99c511-984a-45ca-be6b-4b20fca31646 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:08.416185 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-dc99c511-984a-45ca-be6b-4b20fca31646 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11" status: 200 len: 1169 microversion: 2.1 time: 0.674381 Aug 31 16:27:08.436859 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3176/6170] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:07 2022] GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11 => generated 1169 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:08.478841 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ccd9dc81-eaf6-4c48-9f5f-6837388b3cd2 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:08.480199 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ccd9dc81-eaf6-4c48-9f5f-6837388b3cd2 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 6e296817-752b-4ef9-812b-882268796473] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:08.490887 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=22 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:27:08.493718 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ccd9dc81-eaf6-4c48-9f5f-6837388b3cd2 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:08.495756 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ccd9dc81-eaf6-4c48-9f5f-6837388b3cd2 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:08.506155 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ccd9dc81-eaf6-4c48-9f5f-6837388b3cd2 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:08.511196 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ccd9dc81-eaf6-4c48-9f5f-6837388b3cd2 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:08.511870 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ccd9dc81-eaf6-4c48-9f5f-6837388b3cd2 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:08.512698 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ccd9dc81-eaf6-4c48-9f5f-6837388b3cd2 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:08.574273 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-8524cc6f-b76d-4128-b4fb-15472c687640 req-1c6d9ff1-b734-423e-82c4-4cdc6b9ba663 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1652ca69-4e62-413f-aeda-ef5c8bbdcbe6", "tag": "8faf78da-76f3-45a7-adc4-310cb3235122"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:27:08.600523 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-8524cc6f-b76d-4128-b4fb-15472c687640 req-1c6d9ff1-b734-423e-82c4-4cdc6b9ba663 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:08.603918 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-8524cc6f-b76d-4128-b4fb-15472c687640 req-1c6d9ff1-b734-423e-82c4-4cdc6b9ba663 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:08.604904 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-8524cc6f-b76d-4128-b4fb-15472c687640 req-1c6d9ff1-b734-423e-82c4-4cdc6b9ba663 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:08.652896 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-8524cc6f-b76d-4128-b4fb-15472c687640 req-1c6d9ff1-b734-423e-82c4-4cdc6b9ba663 service nova] Creating event network-changed:8faf78da-76f3-45a7-adc4-310cb3235122 for instance 1652ca69-4e62-413f-aeda-ef5c8bbdcbe6 on n-h1-833090-16 Aug 31 16:27:08.677536 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-8524cc6f-b76d-4128-b4fb-15472c687640 req-1c6d9ff1-b734-423e-82c4-4cdc6b9ba663 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107434 Aug 31 16:27:08.679919 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3177/6171] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:27:09.354230 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ccd9dc81-eaf6-4c48-9f5f-6837388b3cd2 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:09.366771 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ccd9dc81-eaf6-4c48-9f5f-6837388b3cd2 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473" status: 200 len: 1362 microversion: 2.1 time: 0.890758 Aug 31 16:27:09.382752 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2995/6172] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:08 2022] GET /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473 => generated 1362 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:09.437783 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-eb0184ae-fc51-4bee-acd2-56970aba18f9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:09.438445 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-eb0184ae-fc51-4bee-acd2-56970aba18f9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 0afebe39-d25a-437e-86b5-30fefa20bc11] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:09.460428 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:27:09.462196 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-eb0184ae-fc51-4bee-acd2-56970aba18f9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:09.462693 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-eb0184ae-fc51-4bee-acd2-56970aba18f9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:09.463110 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-eb0184ae-fc51-4bee-acd2-56970aba18f9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:09.465428 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-eb0184ae-fc51-4bee-acd2-56970aba18f9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:09.480201 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-eb0184ae-fc51-4bee-acd2-56970aba18f9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:09.488316 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-eb0184ae-fc51-4bee-acd2-56970aba18f9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:10.389132 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dd50674f-97bd-4f15-95c9-60495c7711de tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:10.390002 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dd50674f-97bd-4f15-95c9-60495c7711de tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 6e296817-752b-4ef9-812b-882268796473] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:10.399782 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd50674f-97bd-4f15-95c9-60495c7711de tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:10.401364 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd50674f-97bd-4f15-95c9-60495c7711de tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:10.402027 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd50674f-97bd-4f15-95c9-60495c7711de tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:10.404503 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd50674f-97bd-4f15-95c9-60495c7711de tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:10.405226 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd50674f-97bd-4f15-95c9-60495c7711de tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:10.407524 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd50674f-97bd-4f15-95c9-60495c7711de tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:10.498633 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-eb0184ae-fc51-4bee-acd2-56970aba18f9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:10.512292 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-eb0184ae-fc51-4bee-acd2-56970aba18f9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11" status: 200 len: 1169 microversion: 2.1 time: 1.078146 Aug 31 16:27:10.527834 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3178/6173] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:09 2022] GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11 => generated 1169 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:11.021182 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dd50674f-97bd-4f15-95c9-60495c7711de tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:11.035403 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dd50674f-97bd-4f15-95c9-60495c7711de tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473" status: 200 len: 1362 microversion: 2.1 time: 0.650374 Aug 31 16:27:11.057842 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2996/6174] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:10 2022] GET /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473 => generated 1362 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:27:11.540580 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e00c584d-6d67-4469-8836-81a5b9c1cd84 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:11.541213 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e00c584d-6d67-4469-8836-81a5b9c1cd84 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 0afebe39-d25a-437e-86b5-30fefa20bc11] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:11.558350 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e00c584d-6d67-4469-8836-81a5b9c1cd84 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:11.558861 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e00c584d-6d67-4469-8836-81a5b9c1cd84 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:11.559806 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e00c584d-6d67-4469-8836-81a5b9c1cd84 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:11.561740 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e00c584d-6d67-4469-8836-81a5b9c1cd84 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:11.562533 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e00c584d-6d67-4469-8836-81a5b9c1cd84 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:11.563120 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e00c584d-6d67-4469-8836-81a5b9c1cd84 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:11.908636 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e00c584d-6d67-4469-8836-81a5b9c1cd84 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:11.926990 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e00c584d-6d67-4469-8836-81a5b9c1cd84 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11" status: 200 len: 1169 microversion: 2.1 time: 0.389471 Aug 31 16:27:11.929865 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3179/6175] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:11 2022] GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11 => generated 1169 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:12.043129 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-7c831730-c7e6-4102-9493-7b16bccfa907 req-9d133e86-8309-4df8-8819-435464cc45ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e296817-752b-4ef9-812b-882268796473", "name": "network-vif-plugged", "status": "completed", "tag": "5901bbb7-215f-4339-8d62-cf9aa9918acf"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:27:12.060970 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4fb470ee-45b5-45ec-8ba8-39f74e73d324 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:12.061795 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4fb470ee-45b5-45ec-8ba8-39f74e73d324 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 6e296817-752b-4ef9-812b-882268796473] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:12.067845 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7c831730-c7e6-4102-9493-7b16bccfa907 req-9d133e86-8309-4df8-8819-435464cc45ed service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:12.068342 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7c831730-c7e6-4102-9493-7b16bccfa907 req-9d133e86-8309-4df8-8819-435464cc45ed service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:12.072348 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7c831730-c7e6-4102-9493-7b16bccfa907 req-9d133e86-8309-4df8-8819-435464cc45ed service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:12.073953 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4fb470ee-45b5-45ec-8ba8-39f74e73d324 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:12.074965 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4fb470ee-45b5-45ec-8ba8-39f74e73d324 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:12.076891 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4fb470ee-45b5-45ec-8ba8-39f74e73d324 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:12.079109 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4fb470ee-45b5-45ec-8ba8-39f74e73d324 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:12.079817 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4fb470ee-45b5-45ec-8ba8-39f74e73d324 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:12.081019 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4fb470ee-45b5-45ec-8ba8-39f74e73d324 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:12.109134 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-7c831730-c7e6-4102-9493-7b16bccfa907 req-9d133e86-8309-4df8-8819-435464cc45ed service nova] Creating event network-vif-plugged:5901bbb7-215f-4339-8d62-cf9aa9918acf for instance 6e296817-752b-4ef9-812b-882268796473 on n-h2-833090-16 Aug 31 16:27:12.121047 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-7c831730-c7e6-4102-9493-7b16bccfa907 req-9d133e86-8309-4df8-8819-435464cc45ed service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082341 Aug 31 16:27:12.126467 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2997/6176] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:27:12.343665 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4fb470ee-45b5-45ec-8ba8-39f74e73d324 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:12.353950 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4fb470ee-45b5-45ec-8ba8-39f74e73d324 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473" status: 200 len: 1362 microversion: 2.1 time: 0.297920 Aug 31 16:27:12.355379 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3180/6177] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:12 2022] GET /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473 => generated 1362 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:12.955790 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-02c3df5a-28cc-4168-bbca-90872dd89152 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:12.957466 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-02c3df5a-28cc-4168-bbca-90872dd89152 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 0afebe39-d25a-437e-86b5-30fefa20bc11] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:12.986680 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02c3df5a-28cc-4168-bbca-90872dd89152 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:12.990953 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02c3df5a-28cc-4168-bbca-90872dd89152 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:12.998402 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02c3df5a-28cc-4168-bbca-90872dd89152 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:13.001220 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02c3df5a-28cc-4168-bbca-90872dd89152 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:13.004062 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02c3df5a-28cc-4168-bbca-90872dd89152 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:13.007074 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02c3df5a-28cc-4168-bbca-90872dd89152 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:13.262921 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-02c3df5a-28cc-4168-bbca-90872dd89152 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:13.275077 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-02c3df5a-28cc-4168-bbca-90872dd89152 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11" status: 200 len: 1169 microversion: 2.1 time: 0.325029 Aug 31 16:27:13.276192 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2998/6178] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:12 2022] GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11 => generated 1169 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:13.382154 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a074ee3b-ae0d-41d3-bc57-1696ce83804d tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:13.383760 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a074ee3b-ae0d-41d3-bc57-1696ce83804d tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 6e296817-752b-4ef9-812b-882268796473] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:13.397308 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a074ee3b-ae0d-41d3-bc57-1696ce83804d tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:13.398928 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a074ee3b-ae0d-41d3-bc57-1696ce83804d tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:13.399659 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a074ee3b-ae0d-41d3-bc57-1696ce83804d tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:13.400829 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a074ee3b-ae0d-41d3-bc57-1696ce83804d tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:13.401944 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a074ee3b-ae0d-41d3-bc57-1696ce83804d tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:13.402500 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a074ee3b-ae0d-41d3-bc57-1696ce83804d tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:13.662315 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a074ee3b-ae0d-41d3-bc57-1696ce83804d tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:13.675503 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a074ee3b-ae0d-41d3-bc57-1696ce83804d tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473" status: 200 len: 1362 microversion: 2.1 time: 0.302256 Aug 31 16:27:13.676589 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3181/6179] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:13 2022] GET /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473 => generated 1362 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:14.310879 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6866abf5-f778-4d9a-8826-b2b710f41b23 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:14.312897 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6866abf5-f778-4d9a-8826-b2b710f41b23 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 0afebe39-d25a-437e-86b5-30fefa20bc11] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:14.322387 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6866abf5-f778-4d9a-8826-b2b710f41b23 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:14.323146 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6866abf5-f778-4d9a-8826-b2b710f41b23 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:14.323637 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6866abf5-f778-4d9a-8826-b2b710f41b23 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:14.324563 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6866abf5-f778-4d9a-8826-b2b710f41b23 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:14.325423 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6866abf5-f778-4d9a-8826-b2b710f41b23 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:14.326225 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6866abf5-f778-4d9a-8826-b2b710f41b23 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:14.516284 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6866abf5-f778-4d9a-8826-b2b710f41b23 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:14.526790 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6866abf5-f778-4d9a-8826-b2b710f41b23 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11" status: 200 len: 1169 microversion: 2.1 time: 0.221105 Aug 31 16:27:14.538969 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 2999/6180] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:14 2022] GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11 => generated 1169 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:14.700803 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d647ab31-9a43-44cd-bef3-17a34512f494 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:14.702124 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d647ab31-9a43-44cd-bef3-17a34512f494 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 6e296817-752b-4ef9-812b-882268796473] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:14.709611 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d647ab31-9a43-44cd-bef3-17a34512f494 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:14.710356 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d647ab31-9a43-44cd-bef3-17a34512f494 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:14.710935 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d647ab31-9a43-44cd-bef3-17a34512f494 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:14.712052 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d647ab31-9a43-44cd-bef3-17a34512f494 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:14.712496 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d647ab31-9a43-44cd-bef3-17a34512f494 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:14.713065 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d647ab31-9a43-44cd-bef3-17a34512f494 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:14.882161 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d647ab31-9a43-44cd-bef3-17a34512f494 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:14.892376 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d647ab31-9a43-44cd-bef3-17a34512f494 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473" status: 200 len: 1548 microversion: 2.1 time: 0.196261 Aug 31 16:27:14.893367 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3182/6181] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:14 2022] GET /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473 => generated 1548 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:14.914586 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a29210e3-ccae-4af3-a6b7-007f80a6d612 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:14.915641 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a29210e3-ccae-4af3-a6b7-007f80a6d612 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 6e296817-752b-4ef9-812b-882268796473] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:14.924094 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a29210e3-ccae-4af3-a6b7-007f80a6d612 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:14.925186 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a29210e3-ccae-4af3-a6b7-007f80a6d612 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:14.925938 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a29210e3-ccae-4af3-a6b7-007f80a6d612 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:14.927020 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a29210e3-ccae-4af3-a6b7-007f80a6d612 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:14.927528 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a29210e3-ccae-4af3-a6b7-007f80a6d612 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:14.928107 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a29210e3-ccae-4af3-a6b7-007f80a6d612 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:15.018817 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a29210e3-ccae-4af3-a6b7-007f80a6d612 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.109403 Aug 31 16:27:15.019431 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3000/6182] 10.222.0.50 () {58 vars in 1275 bytes} [Wed Aug 31 16:27:14 2022] GET /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:27:15.549821 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-913ed980-debe-465c-af7f-3638cc4cbeb7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:15.550477 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-913ed980-debe-465c-af7f-3638cc4cbeb7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 0afebe39-d25a-437e-86b5-30fefa20bc11] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:15.558807 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-913ed980-debe-465c-af7f-3638cc4cbeb7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:15.559454 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-913ed980-debe-465c-af7f-3638cc4cbeb7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:15.561986 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-913ed980-debe-465c-af7f-3638cc4cbeb7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:15.563337 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-913ed980-debe-465c-af7f-3638cc4cbeb7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:15.563835 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-913ed980-debe-465c-af7f-3638cc4cbeb7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:15.567875 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-913ed980-debe-465c-af7f-3638cc4cbeb7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:15.782886 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-913ed980-debe-465c-af7f-3638cc4cbeb7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:15.793842 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-913ed980-debe-465c-af7f-3638cc4cbeb7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11" status: 200 len: 1169 microversion: 2.1 time: 0.248263 Aug 31 16:27:15.806979 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3183/6183] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:15 2022] GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11 => generated 1169 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:16.360816 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-8d09f828-f2fb-461a-939b-8a5fa6a404df req-f2245a8f-9824-457d-bf7d-fa9e4aef2920 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e296817-752b-4ef9-812b-882268796473", "tag": "5901bbb7-215f-4339-8d62-cf9aa9918acf"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:27:16.384443 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8d09f828-f2fb-461a-939b-8a5fa6a404df req-f2245a8f-9824-457d-bf7d-fa9e4aef2920 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:16.384919 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8d09f828-f2fb-461a-939b-8a5fa6a404df req-f2245a8f-9824-457d-bf7d-fa9e4aef2920 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:16.385360 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8d09f828-f2fb-461a-939b-8a5fa6a404df req-f2245a8f-9824-457d-bf7d-fa9e4aef2920 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:16.415295 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-8d09f828-f2fb-461a-939b-8a5fa6a404df req-f2245a8f-9824-457d-bf7d-fa9e4aef2920 service nova] Creating event network-changed:5901bbb7-215f-4339-8d62-cf9aa9918acf for instance 6e296817-752b-4ef9-812b-882268796473 on n-h2-833090-16 Aug 31 16:27:16.425977 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-8d09f828-f2fb-461a-939b-8a5fa6a404df req-f2245a8f-9824-457d-bf7d-fa9e4aef2920 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069951 Aug 31 16:27:16.429403 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3001/6184] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:27:16.817710 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-160802b0-89eb-423c-bb4e-6bde9061e4ad tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:16.818285 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-160802b0-89eb-423c-bb4e-6bde9061e4ad tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 0afebe39-d25a-437e-86b5-30fefa20bc11] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:16.842196 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-160802b0-89eb-423c-bb4e-6bde9061e4ad tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:16.843105 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-160802b0-89eb-423c-bb4e-6bde9061e4ad tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:16.846907 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-160802b0-89eb-423c-bb4e-6bde9061e4ad tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:16.848077 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-160802b0-89eb-423c-bb4e-6bde9061e4ad tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:16.849361 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-160802b0-89eb-423c-bb4e-6bde9061e4ad tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:16.851106 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-160802b0-89eb-423c-bb4e-6bde9061e4ad tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:17.135586 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-160802b0-89eb-423c-bb4e-6bde9061e4ad tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:17.150134 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-160802b0-89eb-423c-bb4e-6bde9061e4ad tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11" status: 200 len: 1203 microversion: 2.1 time: 0.338896 Aug 31 16:27:17.150795 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3184/6185] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:16 2022] GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11 => generated 1203 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:18.177028 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0bab8b0d-31cc-478f-88eb-a09fb8265d34 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:18.177620 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0bab8b0d-31cc-478f-88eb-a09fb8265d34 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 0afebe39-d25a-437e-86b5-30fefa20bc11] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:18.192174 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0bab8b0d-31cc-478f-88eb-a09fb8265d34 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:18.199266 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0bab8b0d-31cc-478f-88eb-a09fb8265d34 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:18.200001 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0bab8b0d-31cc-478f-88eb-a09fb8265d34 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:18.200757 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0bab8b0d-31cc-478f-88eb-a09fb8265d34 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:18.201232 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0bab8b0d-31cc-478f-88eb-a09fb8265d34 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:18.201644 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0bab8b0d-31cc-478f-88eb-a09fb8265d34 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:18.464610 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0bab8b0d-31cc-478f-88eb-a09fb8265d34 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:18.480117 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0bab8b0d-31cc-478f-88eb-a09fb8265d34 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11" status: 200 len: 1203 microversion: 2.1 time: 0.306904 Aug 31 16:27:18.481748 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3002/6186] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:18 2022] GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11 => generated 1203 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:19.515724 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-664680c9-be30-4b54-8c19-007785adfee0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:19.518205 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-664680c9-be30-4b54-8c19-007785adfee0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 0afebe39-d25a-437e-86b5-30fefa20bc11] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:19.538069 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-664680c9-be30-4b54-8c19-007785adfee0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:19.539124 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-664680c9-be30-4b54-8c19-007785adfee0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:19.539429 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-664680c9-be30-4b54-8c19-007785adfee0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:19.540361 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-664680c9-be30-4b54-8c19-007785adfee0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:19.540921 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-664680c9-be30-4b54-8c19-007785adfee0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:19.541449 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-664680c9-be30-4b54-8c19-007785adfee0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:19.763120 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-664680c9-be30-4b54-8c19-007785adfee0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:19.774476 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-664680c9-be30-4b54-8c19-007785adfee0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11" status: 200 len: 1203 microversion: 2.1 time: 0.265533 Aug 31 16:27:19.775184 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3185/6187] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:19 2022] GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11 => generated 1203 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:20.808692 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4587bd49-08be-4a5e-b34e-4dd7f3a9bcd9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:20.811769 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4587bd49-08be-4a5e-b34e-4dd7f3a9bcd9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 0afebe39-d25a-437e-86b5-30fefa20bc11] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:20.883290 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4587bd49-08be-4a5e-b34e-4dd7f3a9bcd9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:20.883848 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4587bd49-08be-4a5e-b34e-4dd7f3a9bcd9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:20.886521 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4587bd49-08be-4a5e-b34e-4dd7f3a9bcd9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:20.889189 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4587bd49-08be-4a5e-b34e-4dd7f3a9bcd9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:20.893376 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4587bd49-08be-4a5e-b34e-4dd7f3a9bcd9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:20.896696 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4587bd49-08be-4a5e-b34e-4dd7f3a9bcd9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:21.368671 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4587bd49-08be-4a5e-b34e-4dd7f3a9bcd9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:21.383133 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4587bd49-08be-4a5e-b34e-4dd7f3a9bcd9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11" status: 200 len: 1203 microversion: 2.1 time: 0.591759 Aug 31 16:27:21.384044 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3003/6188] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:20 2022] GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11 => generated 1203 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:22.405068 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a1a5d6ab-75b5-4e6f-946b-e9565c3b8581 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:22.406559 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a1a5d6ab-75b5-4e6f-946b-e9565c3b8581 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 0afebe39-d25a-437e-86b5-30fefa20bc11] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:22.417825 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a1a5d6ab-75b5-4e6f-946b-e9565c3b8581 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:22.418759 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a1a5d6ab-75b5-4e6f-946b-e9565c3b8581 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:22.419428 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a1a5d6ab-75b5-4e6f-946b-e9565c3b8581 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:22.420349 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a1a5d6ab-75b5-4e6f-946b-e9565c3b8581 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:22.421108 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a1a5d6ab-75b5-4e6f-946b-e9565c3b8581 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:22.421738 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a1a5d6ab-75b5-4e6f-946b-e9565c3b8581 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:22.716814 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a1a5d6ab-75b5-4e6f-946b-e9565c3b8581 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:22.730072 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a1a5d6ab-75b5-4e6f-946b-e9565c3b8581 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11" status: 200 len: 1203 microversion: 2.1 time: 0.329650 Aug 31 16:27:22.756948 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3186/6189] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:22 2022] GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11 => generated 1203 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:23.754399 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-46d05581-aca6-47f6-94af-50c3c87983cb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:23.755164 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-46d05581-aca6-47f6-94af-50c3c87983cb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 0afebe39-d25a-437e-86b5-30fefa20bc11] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:23.765007 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46d05581-aca6-47f6-94af-50c3c87983cb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:23.765650 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46d05581-aca6-47f6-94af-50c3c87983cb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:23.766277 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46d05581-aca6-47f6-94af-50c3c87983cb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:23.767222 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46d05581-aca6-47f6-94af-50c3c87983cb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:23.767897 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46d05581-aca6-47f6-94af-50c3c87983cb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:23.768412 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46d05581-aca6-47f6-94af-50c3c87983cb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:23.940231 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-46d05581-aca6-47f6-94af-50c3c87983cb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:23.948881 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-46d05581-aca6-47f6-94af-50c3c87983cb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11" status: 200 len: 1203 microversion: 2.1 time: 0.200749 Aug 31 16:27:23.950310 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3004/6190] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:23 2022] GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11 => generated 1203 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:24.974635 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3357492e-d565-46b1-950c-1d4bf9e26eec tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:24.976068 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3357492e-d565-46b1-950c-1d4bf9e26eec tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 0afebe39-d25a-437e-86b5-30fefa20bc11] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:24.995001 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3357492e-d565-46b1-950c-1d4bf9e26eec tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:24.996165 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3357492e-d565-46b1-950c-1d4bf9e26eec tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:24.996898 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3357492e-d565-46b1-950c-1d4bf9e26eec tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:25.013115 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3357492e-d565-46b1-950c-1d4bf9e26eec tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:25.019037 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3357492e-d565-46b1-950c-1d4bf9e26eec tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:25.020796 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3357492e-d565-46b1-950c-1d4bf9e26eec tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:25.335320 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3357492e-d565-46b1-950c-1d4bf9e26eec tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:25.339914 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=100 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:27:25.347197 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3357492e-d565-46b1-950c-1d4bf9e26eec tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11" status: 200 len: 1203 microversion: 2.1 time: 0.376684 Aug 31 16:27:25.348391 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3187/6191] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:24 2022] GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11 => generated 1203 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:27:26.375489 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-262db875-de54-47aa-b239-8f61ff03e99c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:26.376376 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-262db875-de54-47aa-b239-8f61ff03e99c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 0afebe39-d25a-437e-86b5-30fefa20bc11] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:26.384249 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-262db875-de54-47aa-b239-8f61ff03e99c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:26.384748 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-262db875-de54-47aa-b239-8f61ff03e99c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:26.385218 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-262db875-de54-47aa-b239-8f61ff03e99c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:26.386333 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-262db875-de54-47aa-b239-8f61ff03e99c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:26.386992 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-262db875-de54-47aa-b239-8f61ff03e99c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:26.387826 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-262db875-de54-47aa-b239-8f61ff03e99c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:27.021632 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-262db875-de54-47aa-b239-8f61ff03e99c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:27.026210 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:27:27.039147 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-262db875-de54-47aa-b239-8f61ff03e99c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11" status: 200 len: 1203 microversion: 2.1 time: 0.666607 Aug 31 16:27:27.039938 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3005/6192] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:26 2022] GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11 => generated 1203 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:27:27.247606 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-806ddcaf-c3f4-4a2e-9b7f-19a26fa804c3 req-35ea9af2-6745-4d37-84e8-97db4b9ae4a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0afebe39-d25a-437e-86b5-30fefa20bc11", "name": "network-vif-plugged", "status": "completed", "tag": "fb55849b-19e9-4279-a7e9-1fcb19e0054a"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:27:27.271074 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-806ddcaf-c3f4-4a2e-9b7f-19a26fa804c3 req-35ea9af2-6745-4d37-84e8-97db4b9ae4a5 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:27.271871 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-806ddcaf-c3f4-4a2e-9b7f-19a26fa804c3 req-35ea9af2-6745-4d37-84e8-97db4b9ae4a5 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:27.273075 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-806ddcaf-c3f4-4a2e-9b7f-19a26fa804c3 req-35ea9af2-6745-4d37-84e8-97db4b9ae4a5 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:27.314184 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-806ddcaf-c3f4-4a2e-9b7f-19a26fa804c3 req-35ea9af2-6745-4d37-84e8-97db4b9ae4a5 service nova] Creating event network-vif-plugged:fb55849b-19e9-4279-a7e9-1fcb19e0054a for instance 0afebe39-d25a-437e-86b5-30fefa20bc11 on n-h1-833090-16 Aug 31 16:27:27.336673 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-806ddcaf-c3f4-4a2e-9b7f-19a26fa804c3 req-35ea9af2-6745-4d37-84e8-97db4b9ae4a5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143378 Aug 31 16:27:27.338192 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3188/6193] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:27:28.062063 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-adb4e09e-5410-4ce8-be4f-213ae6338ad1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:28.064231 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-adb4e09e-5410-4ce8-be4f-213ae6338ad1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 0afebe39-d25a-437e-86b5-30fefa20bc11] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:28.072192 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-adb4e09e-5410-4ce8-be4f-213ae6338ad1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:28.072919 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-adb4e09e-5410-4ce8-be4f-213ae6338ad1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:28.073626 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-adb4e09e-5410-4ce8-be4f-213ae6338ad1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:28.074831 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-adb4e09e-5410-4ce8-be4f-213ae6338ad1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:28.075377 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-adb4e09e-5410-4ce8-be4f-213ae6338ad1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:28.075799 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-adb4e09e-5410-4ce8-be4f-213ae6338ad1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:28.243921 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-adb4e09e-5410-4ce8-be4f-213ae6338ad1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:28.252367 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-adb4e09e-5410-4ce8-be4f-213ae6338ad1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11" status: 200 len: 1203 microversion: 2.1 time: 0.195919 Aug 31 16:27:28.252959 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3006/6194] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:28 2022] GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11 => generated 1203 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:29.280419 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c6b24226-6a1b-4901-830a-eee81d886a4b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:29.281163 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c6b24226-6a1b-4901-830a-eee81d886a4b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 0afebe39-d25a-437e-86b5-30fefa20bc11] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:29.291183 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c6b24226-6a1b-4901-830a-eee81d886a4b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:29.291672 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c6b24226-6a1b-4901-830a-eee81d886a4b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:29.292230 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c6b24226-6a1b-4901-830a-eee81d886a4b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:29.293540 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c6b24226-6a1b-4901-830a-eee81d886a4b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:29.294173 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c6b24226-6a1b-4901-830a-eee81d886a4b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:29.294757 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c6b24226-6a1b-4901-830a-eee81d886a4b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:29.551611 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c6b24226-6a1b-4901-830a-eee81d886a4b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:29.567547 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c6b24226-6a1b-4901-830a-eee81d886a4b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11" status: 200 len: 1391 microversion: 2.1 time: 0.293734 Aug 31 16:27:29.599487 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3189/6195] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:29 2022] GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11 => generated 1391 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:29.602619 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-396c4a15-b3d1-4b4b-914a-df5ed35b8c96 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:29.603267 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-396c4a15-b3d1-4b4b-914a-df5ed35b8c96 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 0afebe39-d25a-437e-86b5-30fefa20bc11] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:29.621185 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-396c4a15-b3d1-4b4b-914a-df5ed35b8c96 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:29.622817 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-396c4a15-b3d1-4b4b-914a-df5ed35b8c96 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:29.623436 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-396c4a15-b3d1-4b4b-914a-df5ed35b8c96 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:29.624401 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-396c4a15-b3d1-4b4b-914a-df5ed35b8c96 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:29.625009 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-396c4a15-b3d1-4b4b-914a-df5ed35b8c96 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:29.625772 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-396c4a15-b3d1-4b4b-914a-df5ed35b8c96 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:29.891107 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-396c4a15-b3d1-4b4b-914a-df5ed35b8c96 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:29.904580 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-396c4a15-b3d1-4b4b-914a-df5ed35b8c96 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11" status: 200 len: 1391 microversion: 2.1 time: 0.306021 Aug 31 16:27:29.905478 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3007/6196] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:29 2022] GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11 => generated 1391 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:27:29.927796 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4e22476f-194b-4932-b1d6-8e85fabd0e65 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:29.928532 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4e22476f-194b-4932-b1d6-8e85fabd0e65 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 0afebe39-d25a-437e-86b5-30fefa20bc11] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:29.939917 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4e22476f-194b-4932-b1d6-8e85fabd0e65 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:29.941490 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4e22476f-194b-4932-b1d6-8e85fabd0e65 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:29.944898 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4e22476f-194b-4932-b1d6-8e85fabd0e65 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:29.947198 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4e22476f-194b-4932-b1d6-8e85fabd0e65 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:29.947902 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4e22476f-194b-4932-b1d6-8e85fabd0e65 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:29.948553 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4e22476f-194b-4932-b1d6-8e85fabd0e65 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:30.233899 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4e22476f-194b-4932-b1d6-8e85fabd0e65 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:30.245962 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4e22476f-194b-4932-b1d6-8e85fabd0e65 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11" status: 200 len: 1391 microversion: 2.1 time: 0.322101 Aug 31 16:27:30.247218 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3190/6197] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:29 2022] GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11 => generated 1391 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:30.333685 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-596abe04-6aa6-4bc3-8b33-40ad7d18bd14 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:30.335186 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-596abe04-6aa6-4bc3-8b33-40ad7d18bd14 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 0afebe39-d25a-437e-86b5-30fefa20bc11] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:30.345959 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-596abe04-6aa6-4bc3-8b33-40ad7d18bd14 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:30.346702 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-596abe04-6aa6-4bc3-8b33-40ad7d18bd14 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:30.347137 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-596abe04-6aa6-4bc3-8b33-40ad7d18bd14 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:30.348098 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-596abe04-6aa6-4bc3-8b33-40ad7d18bd14 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:30.348554 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-596abe04-6aa6-4bc3-8b33-40ad7d18bd14 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:30.349427 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-596abe04-6aa6-4bc3-8b33-40ad7d18bd14 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:30.377236 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-596abe04-6aa6-4bc3-8b33-40ad7d18bd14 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 0afebe39-d25a-437e-86b5-30fefa20bc11] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:27:30.482041 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-596abe04-6aa6-4bc3-8b33-40ad7d18bd14 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11" status: 204 len: 0 microversion: 2.1 time: 0.151903 Aug 31 16:27:30.482977 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3008/6198] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:27:30 2022] DELETE /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:27:30.492404 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-40d2acb7-90bb-4a50-a4dd-bb29049e931d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:30.493179 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-40d2acb7-90bb-4a50-a4dd-bb29049e931d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 0afebe39-d25a-437e-86b5-30fefa20bc11] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:30.503681 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-40d2acb7-90bb-4a50-a4dd-bb29049e931d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:30.504264 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-40d2acb7-90bb-4a50-a4dd-bb29049e931d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:30.504769 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-40d2acb7-90bb-4a50-a4dd-bb29049e931d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:30.505542 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-40d2acb7-90bb-4a50-a4dd-bb29049e931d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:30.506074 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-40d2acb7-90bb-4a50-a4dd-bb29049e931d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:30.507260 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-40d2acb7-90bb-4a50-a4dd-bb29049e931d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:30.673493 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-40d2acb7-90bb-4a50-a4dd-bb29049e931d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:30.684319 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-40d2acb7-90bb-4a50-a4dd-bb29049e931d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11" status: 200 len: 1397 microversion: 2.1 time: 0.197092 Aug 31 16:27:30.684998 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3191/6199] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:30 2022] GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11 => generated 1397 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:31.708749 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bd16996e-cc5c-41e5-bed1-3ea57d8e2d00 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:31.709639 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bd16996e-cc5c-41e5-bed1-3ea57d8e2d00 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 0afebe39-d25a-437e-86b5-30fefa20bc11] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:31.723038 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:27:31.730043 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bd16996e-cc5c-41e5-bed1-3ea57d8e2d00 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:31.731188 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bd16996e-cc5c-41e5-bed1-3ea57d8e2d00 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:31.733363 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bd16996e-cc5c-41e5-bed1-3ea57d8e2d00 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:31.735802 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bd16996e-cc5c-41e5-bed1-3ea57d8e2d00 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:31.737825 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bd16996e-cc5c-41e5-bed1-3ea57d8e2d00 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:31.738426 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bd16996e-cc5c-41e5-bed1-3ea57d8e2d00 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:32.037570 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bd16996e-cc5c-41e5-bed1-3ea57d8e2d00 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:32.054666 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bd16996e-cc5c-41e5-bed1-3ea57d8e2d00 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11" status: 200 len: 1397 microversion: 2.1 time: 0.352722 Aug 31 16:27:32.056160 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3009/6200] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:31 2022] GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11 => generated 1397 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:32.921407 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-bc1a1eb7-c0fe-4f2a-ad90-ae5f413a647f req-6ba6dba5-9216-447e-9e8b-eabed3db689b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0afebe39-d25a-437e-86b5-30fefa20bc11", "name": "network-vif-deleted", "tag": "fb55849b-19e9-4279-a7e9-1fcb19e0054a"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:27:32.940906 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-bc1a1eb7-c0fe-4f2a-ad90-ae5f413a647f req-6ba6dba5-9216-447e-9e8b-eabed3db689b service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:32.941404 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-bc1a1eb7-c0fe-4f2a-ad90-ae5f413a647f req-6ba6dba5-9216-447e-9e8b-eabed3db689b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:32.941841 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-bc1a1eb7-c0fe-4f2a-ad90-ae5f413a647f req-6ba6dba5-9216-447e-9e8b-eabed3db689b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:32.987108 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-bc1a1eb7-c0fe-4f2a-ad90-ae5f413a647f req-6ba6dba5-9216-447e-9e8b-eabed3db689b service nova] Creating event network-vif-deleted:fb55849b-19e9-4279-a7e9-1fcb19e0054a for instance 0afebe39-d25a-437e-86b5-30fefa20bc11 on n-h1-833090-16 Aug 31 16:27:33.002515 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-bc1a1eb7-c0fe-4f2a-ad90-ae5f413a647f req-6ba6dba5-9216-447e-9e8b-eabed3db689b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085695 Aug 31 16:27:33.003446 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3192/6201] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:27:33.079664 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c29a9cd3-7a1a-4fd0-a250-c96eda00ce8f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:33.080951 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c29a9cd3-7a1a-4fd0-a250-c96eda00ce8f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 0afebe39-d25a-437e-86b5-30fefa20bc11] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:33.100895 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c29a9cd3-7a1a-4fd0-a250-c96eda00ce8f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:33.101776 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c29a9cd3-7a1a-4fd0-a250-c96eda00ce8f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:33.102388 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c29a9cd3-7a1a-4fd0-a250-c96eda00ce8f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:33.103273 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c29a9cd3-7a1a-4fd0-a250-c96eda00ce8f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:33.103925 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c29a9cd3-7a1a-4fd0-a250-c96eda00ce8f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:33.104495 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c29a9cd3-7a1a-4fd0-a250-c96eda00ce8f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:33.233896 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c29a9cd3-7a1a-4fd0-a250-c96eda00ce8f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:33.244693 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c29a9cd3-7a1a-4fd0-a250-c96eda00ce8f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11" status: 200 len: 1188 microversion: 2.1 time: 0.171578 Aug 31 16:27:33.249726 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3010/6202] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:33 2022] GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11 => generated 1188 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:34.267939 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7f1bb311-aeed-411a-95f8-082ac5d58da7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:34.268688 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7f1bb311-aeed-411a-95f8-082ac5d58da7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 0afebe39-d25a-437e-86b5-30fefa20bc11] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:34.283795 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f1bb311-aeed-411a-95f8-082ac5d58da7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:34.287443 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f1bb311-aeed-411a-95f8-082ac5d58da7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:34.288320 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f1bb311-aeed-411a-95f8-082ac5d58da7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:34.299226 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f1bb311-aeed-411a-95f8-082ac5d58da7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:34.300060 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f1bb311-aeed-411a-95f8-082ac5d58da7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:34.300711 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f1bb311-aeed-411a-95f8-082ac5d58da7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:34.425061 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7f1bb311-aeed-411a-95f8-082ac5d58da7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:34.433954 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7f1bb311-aeed-411a-95f8-082ac5d58da7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11" status: 200 len: 1188 microversion: 2.1 time: 0.172318 Aug 31 16:27:34.434586 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3193/6203] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:34 2022] GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11 => generated 1188 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:35.473846 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3c5ff4b4-5986-480a-aca7-8787242029cd tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:35.475322 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3c5ff4b4-5986-480a-aca7-8787242029cd tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 0afebe39-d25a-437e-86b5-30fefa20bc11] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:35.490772 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c5ff4b4-5986-480a-aca7-8787242029cd tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:35.491326 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c5ff4b4-5986-480a-aca7-8787242029cd tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:35.498604 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c5ff4b4-5986-480a-aca7-8787242029cd tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:35.499395 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c5ff4b4-5986-480a-aca7-8787242029cd tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:35.499882 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c5ff4b4-5986-480a-aca7-8787242029cd tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:35.500317 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c5ff4b4-5986-480a-aca7-8787242029cd tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:35.657630 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3c5ff4b4-5986-480a-aca7-8787242029cd tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:35.668069 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3c5ff4b4-5986-480a-aca7-8787242029cd tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11" status: 200 len: 1188 microversion: 2.1 time: 0.197030 Aug 31 16:27:35.668945 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3011/6204] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:35 2022] GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11 => generated 1188 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:36.691580 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c3cb57f9-8edd-4462-aef3-94c5415bb608 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:36.692596 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c3cb57f9-8edd-4462-aef3-94c5415bb608 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 0afebe39-d25a-437e-86b5-30fefa20bc11] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:36.708001 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3cb57f9-8edd-4462-aef3-94c5415bb608 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:36.708592 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3cb57f9-8edd-4462-aef3-94c5415bb608 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:36.712448 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3cb57f9-8edd-4462-aef3-94c5415bb608 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:36.713306 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3cb57f9-8edd-4462-aef3-94c5415bb608 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:36.714034 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3cb57f9-8edd-4462-aef3-94c5415bb608 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:36.714837 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3cb57f9-8edd-4462-aef3-94c5415bb608 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:36.944555 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c3cb57f9-8edd-4462-aef3-94c5415bb608 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:36.956792 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c3cb57f9-8edd-4462-aef3-94c5415bb608 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11" status: 200 len: 1188 microversion: 2.1 time: 0.270154 Aug 31 16:27:36.962140 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3194/6205] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:36 2022] GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11 => generated 1188 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:37.980348 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e063776e-f2fa-4aa4-a72e-71f7b67934d7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:37.981217 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e063776e-f2fa-4aa4-a72e-71f7b67934d7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 0afebe39-d25a-437e-86b5-30fefa20bc11] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:37.996751 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e063776e-f2fa-4aa4-a72e-71f7b67934d7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:38.002845 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e063776e-f2fa-4aa4-a72e-71f7b67934d7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:38.004303 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e063776e-f2fa-4aa4-a72e-71f7b67934d7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:38.007448 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e063776e-f2fa-4aa4-a72e-71f7b67934d7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:38.007912 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e063776e-f2fa-4aa4-a72e-71f7b67934d7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:38.008445 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e063776e-f2fa-4aa4-a72e-71f7b67934d7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:38.145938 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e063776e-f2fa-4aa4-a72e-71f7b67934d7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:38.155875 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e063776e-f2fa-4aa4-a72e-71f7b67934d7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11" status: 200 len: 1188 microversion: 2.1 time: 0.179564 Aug 31 16:27:38.156462 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3012/6206] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:37 2022] GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11 => generated 1188 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:39.177092 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ed07c152-d565-4456-9728-af65c96bd84a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:39.177707 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ed07c152-d565-4456-9728-af65c96bd84a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 0afebe39-d25a-437e-86b5-30fefa20bc11] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:39.200584 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ed07c152-d565-4456-9728-af65c96bd84a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:39.206753 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ed07c152-d565-4456-9728-af65c96bd84a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:39.207424 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ed07c152-d565-4456-9728-af65c96bd84a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:39.214460 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ed07c152-d565-4456-9728-af65c96bd84a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:39.217491 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ed07c152-d565-4456-9728-af65c96bd84a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:39.218326 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ed07c152-d565-4456-9728-af65c96bd84a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:39.363298 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ed07c152-d565-4456-9728-af65c96bd84a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:39.370885 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ed07c152-d565-4456-9728-af65c96bd84a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:39.371336 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ed07c152-d565-4456-9728-af65c96bd84a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:39.371798 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-ed07c152-d565-4456-9728-af65c96bd84a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lazy-loading 'fault' on Instance uuid 0afebe39-d25a-437e-86b5-30fefa20bc11 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:27:39.540428 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ed07c152-d565-4456-9728-af65c96bd84a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:27:39.553769 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ed07c152-d565-4456-9728-af65c96bd84a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11" status: 200 len: 1147 microversion: 2.1 time: 0.380710 Aug 31 16:27:39.555479 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3195/6207] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:39 2022] GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11 => generated 1147 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:27:40.577281 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-191ac223-b394-4dca-bdfa-7480ced8b2ba tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:40.577889 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-191ac223-b394-4dca-bdfa-7480ced8b2ba tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 0afebe39-d25a-437e-86b5-30fefa20bc11] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:40.591066 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-191ac223-b394-4dca-bdfa-7480ced8b2ba tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:40.591713 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-191ac223-b394-4dca-bdfa-7480ced8b2ba tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:40.592168 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-191ac223-b394-4dca-bdfa-7480ced8b2ba tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:40.592887 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-191ac223-b394-4dca-bdfa-7480ced8b2ba tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:40.593338 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-191ac223-b394-4dca-bdfa-7480ced8b2ba tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:40.593764 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-191ac223-b394-4dca-bdfa-7480ced8b2ba tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:40.631939 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-191ac223-b394-4dca-bdfa-7480ced8b2ba tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] HTTP exception thrown: Instance 0afebe39-d25a-437e-86b5-30fefa20bc11 could not be found. Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-191ac223-b394-4dca-bdfa-7480ced8b2ba tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Request method failure captured: Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11 HTTP/1.1 Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4sA8QatsiRw58KL4D-GJAaR1X9zBGwbu0cNuaHi16Tl8K5LhZ4dthUjdeeybVrZ6FkLiuj0CnwnGa_AqwqzkMsKdZfTNQhjMqXfHtEAV5ID9oXbOsK0vGNgY-jRlE7qor7NeFM7QGwhr8KE3TJ70ugNQcxhI7ZJIKzx49vTu_Rhy18 Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 32245d85aee64f69865d98656133a539 Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-TestVolumeBootPattern-1732723367 Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/32245d85aee64f69865d98656133a539"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/32245d85aee64f69865d98656133a539"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/32245d85aee64f69865d98656133a539"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_32245d85aee64f69865d98656133a539", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-TestVolumeBootPattern-1732723367 Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 32245d85aee64f69865d98656133a539 Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TestVolumeBootPattern-1732723367 Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-TestVolumeBootPattern-1732723367-project Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: fb76a89a8b8042edb7b6aaccb4f41ead Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-TestVolumeBootPattern-1732723367-project Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 0afebe39-d25a-437e-86b5-30fefa20bc11 could not be found. Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '0afebe39-d25a-437e-86b5-30fefa20bc11'} Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0afebe39-d25a-437e-86b5-30fefa20bc11 could not be found. Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0afebe39-d25a-437e-86b5-30fefa20bc11 could not be found. Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:27:40.633707 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:27:40.640193 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:27:40.640193 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:27:40.640193 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:27:40.640193 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:27:40.640193 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:27:40.640193 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0afebe39-d25a-437e-86b5-30fefa20bc11 could not be found. Aug 31 16:27:40.640193 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:27:40.640193 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-191ac223-b394-4dca-bdfa-7480ced8b2ba tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Returning 404 to user: Instance 0afebe39-d25a-437e-86b5-30fefa20bc11 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:27:40.640193 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-191ac223-b394-4dca-bdfa-7480ced8b2ba tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11" status: 404 len: 111 microversion: 2.1 time: 0.062755 Aug 31 16:27:40.640193 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3013/6208] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:40 2022] GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:27:42.896520 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-701c33a7-3c0a-4d2e-adaa-a8909240fa74 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:42.897008 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-701c33a7-3c0a-4d2e-adaa-a8909240fa74 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 0afebe39-d25a-437e-86b5-30fefa20bc11] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:42.899850 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=37 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:27:42.914275 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-701c33a7-3c0a-4d2e-adaa-a8909240fa74 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:42.915652 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-701c33a7-3c0a-4d2e-adaa-a8909240fa74 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:42.917495 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-701c33a7-3c0a-4d2e-adaa-a8909240fa74 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:42.918543 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-701c33a7-3c0a-4d2e-adaa-a8909240fa74 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:42.919164 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-701c33a7-3c0a-4d2e-adaa-a8909240fa74 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:42.919948 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-701c33a7-3c0a-4d2e-adaa-a8909240fa74 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:42.936409 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-701c33a7-3c0a-4d2e-adaa-a8909240fa74 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] HTTP exception thrown: Instance 0afebe39-d25a-437e-86b5-30fefa20bc11 could not be found. Aug 31 16:27:42.939051 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-701c33a7-3c0a-4d2e-adaa-a8909240fa74 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Request method failure captured: Aug 31 16:27:42.939051 n-d-833090-16 devstack@n-api.service[128864]: request: DELETE /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11 HTTP/1.1 Aug 31 16:27:42.939051 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:27:42.939051 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:27:42.939051 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:27:42.939051 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:27:42.939051 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:27:42.939051 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:27:42.939051 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:27:42.939051 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:27:42.939051 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4sA8QatsiRw58KL4D-GJAaR1X9zBGwbu0cNuaHi16Tl8K5LhZ4dthUjdeeybVrZ6FkLiuj0CnwnGa_AqwqzkMsKdZfTNQhjMqXfHtEAV5ID9oXbOsK0vGNgY-jRlE7qor7NeFM7QGwhr8KE3TJ70ugNQcxhI7ZJIKzx49vTu_Rhy18 Aug 31 16:27:42.939051 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:27:42.939051 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:27:42.939051 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:27:42.939051 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:27:42.939051 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:27:42.939051 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:27:42.939051 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 32245d85aee64f69865d98656133a539 Aug 31 16:27:42.939051 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-TestVolumeBootPattern-1732723367 Aug 31 16:27:42.939051 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:27:42.939051 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:27:42.939051 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/32245d85aee64f69865d98656133a539"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/32245d85aee64f69865d98656133a539"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/32245d85aee64f69865d98656133a539"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_32245d85aee64f69865d98656133a539", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:27:42.939051 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-TestVolumeBootPattern-1732723367 Aug 31 16:27:42.939051 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 32245d85aee64f69865d98656133a539 Aug 31 16:27:42.939051 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-TestVolumeBootPattern-1732723367 Aug 31 16:27:42.939051 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-TestVolumeBootPattern-1732723367-project Aug 31 16:27:42.939051 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:27:42.939051 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:27:42.939051 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: fb76a89a8b8042edb7b6aaccb4f41ead Aug 31 16:27:42.939051 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-TestVolumeBootPattern-1732723367-project Aug 31 16:27:42.939051 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:27:42.939051 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 0afebe39-d25a-437e-86b5-30fefa20bc11 could not be found. Aug 31 16:27:42.939051 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '0afebe39-d25a-437e-86b5-30fefa20bc11'} Aug 31 16:27:42.939051 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:27:42.939051 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:27:42.939051 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:27:42.939051 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:27:42.939051 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:27:42.939051 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:27:42.939051 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:27:42.939051 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:27:42.939051 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:27:42.939051 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:27:42.939051 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0afebe39-d25a-437e-86b5-30fefa20bc11 could not be found. Aug 31 16:27:42.939051 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:27:42.939051 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:27:42.939051 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:27:42.939051 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:27:42.939051 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:27:42.939051 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:27:42.939051 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:27:42.939051 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:27:42.939051 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:27:42.939051 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:27:42.939051 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:27:42.939051 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:27:42.939051 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:27:42.939051 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:27:42.939051 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:27:42.939051 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:27:42.939051 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:27:42.939051 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:27:42.944277 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0afebe39-d25a-437e-86b5-30fefa20bc11 could not be found. Aug 31 16:27:42.944277 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:27:42.944277 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:27:42.944277 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:27:42.944277 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:27:42.944277 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:27:42.944277 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:27:42.944277 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:27:42.944277 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:27:42.944277 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0afebe39-d25a-437e-86b5-30fefa20bc11 could not be found. Aug 31 16:27:42.944277 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:27:42.946250 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-701c33a7-3c0a-4d2e-adaa-a8909240fa74 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Returning 404 to user: Instance 0afebe39-d25a-437e-86b5-30fefa20bc11 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:27:42.947348 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-701c33a7-3c0a-4d2e-adaa-a8909240fa74 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11" status: 404 len: 111 microversion: 2.1 time: 0.055382 Aug 31 16:27:42.948554 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3196/6209] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:27:42 2022] DELETE /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:27:42.961442 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f0060739-b810-4706-9fb5-5144921f67e5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:42.965724 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f0060739-b810-4706-9fb5-5144921f67e5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 0afebe39-d25a-437e-86b5-30fefa20bc11] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:42.977111 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f0060739-b810-4706-9fb5-5144921f67e5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:42.977899 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f0060739-b810-4706-9fb5-5144921f67e5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:42.978529 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f0060739-b810-4706-9fb5-5144921f67e5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:42.979479 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f0060739-b810-4706-9fb5-5144921f67e5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:42.980548 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f0060739-b810-4706-9fb5-5144921f67e5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:42.981322 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f0060739-b810-4706-9fb5-5144921f67e5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:43.002034 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-f0060739-b810-4706-9fb5-5144921f67e5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] HTTP exception thrown: Instance 0afebe39-d25a-437e-86b5-30fefa20bc11 could not be found. Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f0060739-b810-4706-9fb5-5144921f67e5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Request method failure captured: Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11 HTTP/1.1 Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4sA8QatsiRw58KL4D-GJAaR1X9zBGwbu0cNuaHi16Tl8K5LhZ4dthUjdeeybVrZ6FkLiuj0CnwnGa_AqwqzkMsKdZfTNQhjMqXfHtEAV5ID9oXbOsK0vGNgY-jRlE7qor7NeFM7QGwhr8KE3TJ70ugNQcxhI7ZJIKzx49vTu_Rhy18 Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 32245d85aee64f69865d98656133a539 Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-TestVolumeBootPattern-1732723367 Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/32245d85aee64f69865d98656133a539"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/32245d85aee64f69865d98656133a539"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/32245d85aee64f69865d98656133a539"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_32245d85aee64f69865d98656133a539", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-TestVolumeBootPattern-1732723367 Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 32245d85aee64f69865d98656133a539 Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TestVolumeBootPattern-1732723367 Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-TestVolumeBootPattern-1732723367-project Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: fb76a89a8b8042edb7b6aaccb4f41ead Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-TestVolumeBootPattern-1732723367-project Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 0afebe39-d25a-437e-86b5-30fefa20bc11 could not be found. Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '0afebe39-d25a-437e-86b5-30fefa20bc11'} Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0afebe39-d25a-437e-86b5-30fefa20bc11 could not be found. Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0afebe39-d25a-437e-86b5-30fefa20bc11 could not be found. Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:27:43.006985 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:27:43.010473 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:27:43.010473 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:27:43.010473 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:27:43.010473 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:27:43.010473 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:27:43.010473 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0afebe39-d25a-437e-86b5-30fefa20bc11 could not be found. Aug 31 16:27:43.010473 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:27:43.013001 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f0060739-b810-4706-9fb5-5144921f67e5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Returning 404 to user: Instance 0afebe39-d25a-437e-86b5-30fefa20bc11 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:27:43.014936 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f0060739-b810-4706-9fb5-5144921f67e5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11" status: 404 len: 111 microversion: 2.1 time: 0.061815 Aug 31 16:27:43.016957 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3014/6210] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:27:42 2022] GET /compute/v2.1/servers/0afebe39-d25a-437e-86b5-30fefa20bc11 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:27:43.771369 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fa09c6e9-f88e-4bf6-aee6-48a76741480b tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:27:43.772673 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fa09c6e9-f88e-4bf6-aee6-48a76741480b tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] [instance: 1652ca69-4e62-413f-aeda-ef5c8bbdcbe6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:27:43.780979 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fa09c6e9-f88e-4bf6-aee6-48a76741480b tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:43.781774 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fa09c6e9-f88e-4bf6-aee6-48a76741480b tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:43.782655 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fa09c6e9-f88e-4bf6-aee6-48a76741480b tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:43.783943 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fa09c6e9-f88e-4bf6-aee6-48a76741480b tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:27:43.784606 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fa09c6e9-f88e-4bf6-aee6-48a76741480b tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:27:43.785267 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fa09c6e9-f88e-4bf6-aee6-48a76741480b tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:27:43.815636 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fa09c6e9-f88e-4bf6-aee6-48a76741480b tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] 10.222.0.50 "GET /compute/v2.1/servers/1652ca69-4e62-413f-aeda-ef5c8bbdcbe6/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.051137 Aug 31 16:27:43.816832 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3197/6211] 10.222.0.50 () {58 vars in 1293 bytes} [Wed Aug 31 16:27:43 2022] GET /compute/v2.1/servers/1652ca69-4e62-413f-aeda-ef5c8bbdcbe6/os-server-password => generated 116 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:28:14.586202 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=11 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:28:14.586202 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:28:14.591617 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-251823a9-8da6-418b-af00-6dea3eb7c547 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-2011497862", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "cfa95213-4bf7-4024-b654-1af571770d7a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "875599c9-5517-4369-96b1-87dce382c42c"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:28:14.801221 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-251823a9-8da6-418b-af00-6dea3eb7c547 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] validate_networks() for [('875599c9-5517-4369-96b1-87dce382c42c', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:28:15.872622 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-251823a9-8da6-418b-af00-6dea3eb7c547 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:28:15.873181 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-251823a9-8da6-418b-af00-6dea3eb7c547 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:28:15.873709 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-251823a9-8da6-418b-af00-6dea3eb7c547 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:28:15.874390 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-251823a9-8da6-418b-af00-6dea3eb7c547 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:28:15.874931 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-251823a9-8da6-418b-af00-6dea3eb7c547 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:28:15.888808 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-251823a9-8da6-418b-af00-6dea3eb7c547 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:15.893234 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-251823a9-8da6-418b-af00-6dea3eb7c547 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:15.893799 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-251823a9-8da6-418b-af00-6dea3eb7c547 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:15.894859 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-251823a9-8da6-418b-af00-6dea3eb7c547 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:15.897035 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-251823a9-8da6-418b-af00-6dea3eb7c547 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:15.897589 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-251823a9-8da6-418b-af00-6dea3eb7c547 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:15.946450 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-251823a9-8da6-418b-af00-6dea3eb7c547 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Getting quotas for project 32245d85aee64f69865d98656133a539. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:28:15.956755 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-251823a9-8da6-418b-af00-6dea3eb7c547 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Getting quotas for user fb76a89a8b8042edb7b6aaccb4f41ead and project 32245d85aee64f69865d98656133a539. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:28:16.172039 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-251823a9-8da6-418b-af00-6dea3eb7c547 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:28:16.174522 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-251823a9-8da6-418b-af00-6dea3eb7c547 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 52207df3-de0e-4f94-aba2-2d0173ef3ba3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cfa95213-4bf7-4024-b654-1af571770d7a',volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:28:16.528129 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-251823a9-8da6-418b-af00-6dea3eb7c547 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.944195 Aug 31 16:28:16.532388 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3015/6212] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:28:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1949 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:28:16.542326 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1cd762b8-3ae7-486d-980d-7d9bd05e7a7b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:16.542940 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1cd762b8-3ae7-486d-980d-7d9bd05e7a7b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 52207df3-de0e-4f94-aba2-2d0173ef3ba3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:16.545515 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=3 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:28:16.546366 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=48 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:28:16.663725 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1cd762b8-3ae7-486d-980d-7d9bd05e7a7b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:16.701373 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1cd762b8-3ae7-486d-980d-7d9bd05e7a7b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3" status: 200 len: 1071 microversion: 2.1 time: 0.158468 Aug 31 16:28:16.702350 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3198/6213] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:16 2022] GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3 => generated 1071 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:17.723887 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dcde5a62-4ad3-48b6-912a-c9e4c817c7bf tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:17.724504 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dcde5a62-4ad3-48b6-912a-c9e4c817c7bf tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 52207df3-de0e-4f94-aba2-2d0173ef3ba3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:17.743864 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcde5a62-4ad3-48b6-912a-c9e4c817c7bf tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:17.744555 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcde5a62-4ad3-48b6-912a-c9e4c817c7bf tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:17.745175 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcde5a62-4ad3-48b6-912a-c9e4c817c7bf tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:17.745903 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcde5a62-4ad3-48b6-912a-c9e4c817c7bf tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:17.746452 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcde5a62-4ad3-48b6-912a-c9e4c817c7bf tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:17.746918 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcde5a62-4ad3-48b6-912a-c9e4c817c7bf tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:17.918394 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dcde5a62-4ad3-48b6-912a-c9e4c817c7bf tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:17.937931 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dcde5a62-4ad3-48b6-912a-c9e4c817c7bf tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3" status: 200 len: 1169 microversion: 2.1 time: 0.219235 Aug 31 16:28:17.939612 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3016/6214] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:17 2022] GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3 => generated 1169 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:18.959980 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5f852406-6ec3-4d48-81e4-1d02e60bf494 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:18.960601 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5f852406-6ec3-4d48-81e4-1d02e60bf494 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 52207df3-de0e-4f94-aba2-2d0173ef3ba3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:18.973498 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5f852406-6ec3-4d48-81e4-1d02e60bf494 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:18.974261 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5f852406-6ec3-4d48-81e4-1d02e60bf494 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:18.978552 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5f852406-6ec3-4d48-81e4-1d02e60bf494 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:18.979860 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5f852406-6ec3-4d48-81e4-1d02e60bf494 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:18.980487 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5f852406-6ec3-4d48-81e4-1d02e60bf494 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:18.981075 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5f852406-6ec3-4d48-81e4-1d02e60bf494 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:19.465354 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5f852406-6ec3-4d48-81e4-1d02e60bf494 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:19.483008 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5f852406-6ec3-4d48-81e4-1d02e60bf494 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3" status: 200 len: 1187 microversion: 2.1 time: 0.526640 Aug 31 16:28:19.483599 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3199/6215] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:18 2022] GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3 => generated 1187 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:20.504630 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d2d27ce0-be17-4387-938d-d6948f0801cb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:20.505257 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d2d27ce0-be17-4387-938d-d6948f0801cb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 52207df3-de0e-4f94-aba2-2d0173ef3ba3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:20.516463 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2d27ce0-be17-4387-938d-d6948f0801cb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:20.516995 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2d27ce0-be17-4387-938d-d6948f0801cb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:20.517396 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2d27ce0-be17-4387-938d-d6948f0801cb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:20.518120 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2d27ce0-be17-4387-938d-d6948f0801cb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:20.518562 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2d27ce0-be17-4387-938d-d6948f0801cb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:20.518980 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2d27ce0-be17-4387-938d-d6948f0801cb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:20.872491 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d2d27ce0-be17-4387-938d-d6948f0801cb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:20.883070 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d2d27ce0-be17-4387-938d-d6948f0801cb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3" status: 200 len: 1229 microversion: 2.1 time: 0.382642 Aug 31 16:28:20.883689 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3017/6216] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:20 2022] GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3 => generated 1229 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:21.515860 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-cfff0e0e-2cdd-41c7-9878-4448eaee83b1 req-0c152d3c-d284-4428-a907-09df59158f54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52207df3-de0e-4f94-aba2-2d0173ef3ba3", "tag": "67a45c7a-fd48-45b3-a526-c4bbb69f89b9"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:28:21.549836 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-cfff0e0e-2cdd-41c7-9878-4448eaee83b1 req-0c152d3c-d284-4428-a907-09df59158f54 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:21.550264 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-cfff0e0e-2cdd-41c7-9878-4448eaee83b1 req-0c152d3c-d284-4428-a907-09df59158f54 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:21.550696 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-cfff0e0e-2cdd-41c7-9878-4448eaee83b1 req-0c152d3c-d284-4428-a907-09df59158f54 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:21.579629 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-cfff0e0e-2cdd-41c7-9878-4448eaee83b1 req-0c152d3c-d284-4428-a907-09df59158f54 service nova] Creating event network-changed:67a45c7a-fd48-45b3-a526-c4bbb69f89b9 for instance 52207df3-de0e-4f94-aba2-2d0173ef3ba3 on n-h2-833090-16 Aug 31 16:28:21.593658 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-cfff0e0e-2cdd-41c7-9878-4448eaee83b1 req-0c152d3c-d284-4428-a907-09df59158f54 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082824 Aug 31 16:28:21.594309 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3200/6217] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:28:21.907525 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8e94a2e3-ed0f-4045-ae33-e54e99ac5f48 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:21.908238 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8e94a2e3-ed0f-4045-ae33-e54e99ac5f48 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 52207df3-de0e-4f94-aba2-2d0173ef3ba3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:21.927207 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e94a2e3-ed0f-4045-ae33-e54e99ac5f48 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:21.927707 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e94a2e3-ed0f-4045-ae33-e54e99ac5f48 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:21.928143 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e94a2e3-ed0f-4045-ae33-e54e99ac5f48 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:21.928858 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e94a2e3-ed0f-4045-ae33-e54e99ac5f48 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:21.929309 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e94a2e3-ed0f-4045-ae33-e54e99ac5f48 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:21.929733 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e94a2e3-ed0f-4045-ae33-e54e99ac5f48 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:22.153153 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8e94a2e3-ed0f-4045-ae33-e54e99ac5f48 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:22.164899 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8e94a2e3-ed0f-4045-ae33-e54e99ac5f48 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3" status: 200 len: 1229 microversion: 2.1 time: 0.260067 Aug 31 16:28:22.166641 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3018/6218] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:21 2022] GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3 => generated 1229 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:23.189281 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-54825b88-32f0-42c3-bf38-1bd5a08247e0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:23.190990 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-54825b88-32f0-42c3-bf38-1bd5a08247e0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 52207df3-de0e-4f94-aba2-2d0173ef3ba3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:23.219737 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-54825b88-32f0-42c3-bf38-1bd5a08247e0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:23.223070 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-54825b88-32f0-42c3-bf38-1bd5a08247e0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:23.225406 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-54825b88-32f0-42c3-bf38-1bd5a08247e0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:23.229405 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-54825b88-32f0-42c3-bf38-1bd5a08247e0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:23.231872 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-54825b88-32f0-42c3-bf38-1bd5a08247e0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:23.233259 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-54825b88-32f0-42c3-bf38-1bd5a08247e0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:23.497444 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-54825b88-32f0-42c3-bf38-1bd5a08247e0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:23.510375 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-54825b88-32f0-42c3-bf38-1bd5a08247e0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3" status: 200 len: 1229 microversion: 2.1 time: 0.327474 Aug 31 16:28:23.512167 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3201/6219] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:23 2022] GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3 => generated 1229 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:24.534363 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b53f5049-471c-44dd-863a-8f23558322a7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:24.535952 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b53f5049-471c-44dd-863a-8f23558322a7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 52207df3-de0e-4f94-aba2-2d0173ef3ba3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:24.548275 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b53f5049-471c-44dd-863a-8f23558322a7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:24.549959 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b53f5049-471c-44dd-863a-8f23558322a7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:24.550675 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b53f5049-471c-44dd-863a-8f23558322a7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:24.551608 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b53f5049-471c-44dd-863a-8f23558322a7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:24.552262 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b53f5049-471c-44dd-863a-8f23558322a7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:24.552920 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b53f5049-471c-44dd-863a-8f23558322a7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:24.971996 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b53f5049-471c-44dd-863a-8f23558322a7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:24.983987 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b53f5049-471c-44dd-863a-8f23558322a7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3" status: 200 len: 1229 microversion: 2.1 time: 0.455601 Aug 31 16:28:24.989267 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3019/6220] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:24 2022] GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3 => generated 1229 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:26.013650 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7ce6b112-bb5d-46ed-af7a-3c066882321e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:26.014932 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7ce6b112-bb5d-46ed-af7a-3c066882321e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 52207df3-de0e-4f94-aba2-2d0173ef3ba3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:26.027089 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ce6b112-bb5d-46ed-af7a-3c066882321e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:26.029597 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ce6b112-bb5d-46ed-af7a-3c066882321e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:26.030492 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ce6b112-bb5d-46ed-af7a-3c066882321e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:26.033686 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ce6b112-bb5d-46ed-af7a-3c066882321e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:26.034363 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ce6b112-bb5d-46ed-af7a-3c066882321e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:26.035510 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ce6b112-bb5d-46ed-af7a-3c066882321e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:26.412638 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7ce6b112-bb5d-46ed-af7a-3c066882321e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:26.423930 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7ce6b112-bb5d-46ed-af7a-3c066882321e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3" status: 200 len: 1229 microversion: 2.1 time: 0.416686 Aug 31 16:28:26.443156 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3202/6221] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:26 2022] GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3 => generated 1229 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:27.442803 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:28:27.444315 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:28:27.451082 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b392e00f-8163-46a1-9c91-a0438c78dd5f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:27.452511 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b392e00f-8163-46a1-9c91-a0438c78dd5f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 52207df3-de0e-4f94-aba2-2d0173ef3ba3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:27.468399 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b392e00f-8163-46a1-9c91-a0438c78dd5f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:27.469127 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b392e00f-8163-46a1-9c91-a0438c78dd5f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:27.469748 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b392e00f-8163-46a1-9c91-a0438c78dd5f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:27.475772 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b392e00f-8163-46a1-9c91-a0438c78dd5f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:27.476415 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b392e00f-8163-46a1-9c91-a0438c78dd5f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:27.477269 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b392e00f-8163-46a1-9c91-a0438c78dd5f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:28.295807 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b392e00f-8163-46a1-9c91-a0438c78dd5f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:28.313732 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b392e00f-8163-46a1-9c91-a0438c78dd5f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3" status: 200 len: 1229 microversion: 2.1 time: 0.866581 Aug 31 16:28:28.320506 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3020/6222] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:27 2022] GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3 => generated 1229 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:29.342078 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c8a72327-0f40-45ea-982c-920d6f01aff0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:29.343712 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c8a72327-0f40-45ea-982c-920d6f01aff0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 52207df3-de0e-4f94-aba2-2d0173ef3ba3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:29.387864 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:28:29.446922 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8a72327-0f40-45ea-982c-920d6f01aff0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:29.449306 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8a72327-0f40-45ea-982c-920d6f01aff0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:29.449927 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8a72327-0f40-45ea-982c-920d6f01aff0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:29.459875 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8a72327-0f40-45ea-982c-920d6f01aff0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:29.467084 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8a72327-0f40-45ea-982c-920d6f01aff0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:29.468530 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8a72327-0f40-45ea-982c-920d6f01aff0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:30.282770 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c8a72327-0f40-45ea-982c-920d6f01aff0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:30.294198 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c8a72327-0f40-45ea-982c-920d6f01aff0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3" status: 200 len: 1217 microversion: 2.1 time: 0.953585 Aug 31 16:28:30.295358 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3203/6223] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:29 2022] GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3 => generated 1217 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:30.986001 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-42dc3592-1839-4365-832a-279fb5af100f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:30.986569 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-42dc3592-1839-4365-832a-279fb5af100f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 6e296817-752b-4ef9-812b-882268796473] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:30.997496 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-42dc3592-1839-4365-832a-279fb5af100f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:31.000057 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-42dc3592-1839-4365-832a-279fb5af100f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:31.002066 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-42dc3592-1839-4365-832a-279fb5af100f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:31.004429 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-42dc3592-1839-4365-832a-279fb5af100f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:31.006646 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-42dc3592-1839-4365-832a-279fb5af100f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:31.007285 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-42dc3592-1839-4365-832a-279fb5af100f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:31.047312 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-42dc3592-1839-4365-832a-279fb5af100f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473/ips" status: 200 len: 146 microversion: 2.1 time: 0.066461 Aug 31 16:28:31.057172 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3021/6224] 10.222.0.50 () {58 vars in 1248 bytes} [Wed Aug 31 16:28:30 2022] GET /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473/ips => generated 146 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:28:31.317388 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-94e97e2c-9135-4356-87b1-937160f67d34 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:31.319045 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-94e97e2c-9135-4356-87b1-937160f67d34 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 52207df3-de0e-4f94-aba2-2d0173ef3ba3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:31.334392 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-94e97e2c-9135-4356-87b1-937160f67d34 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:31.335190 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-94e97e2c-9135-4356-87b1-937160f67d34 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:31.338068 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-94e97e2c-9135-4356-87b1-937160f67d34 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:31.340683 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-94e97e2c-9135-4356-87b1-937160f67d34 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:31.341331 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-94e97e2c-9135-4356-87b1-937160f67d34 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:31.342724 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-94e97e2c-9135-4356-87b1-937160f67d34 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:31.789150 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-94e97e2c-9135-4356-87b1-937160f67d34 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:31.797802 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-94e97e2c-9135-4356-87b1-937160f67d34 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3" status: 200 len: 1217 microversion: 2.1 time: 0.484991 Aug 31 16:28:31.803587 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3204/6225] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:31 2022] GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3 => generated 1217 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:32.819884 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-775be835-3bb9-4462-9fff-6e7d222a9820 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:32.820646 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-775be835-3bb9-4462-9fff-6e7d222a9820 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 52207df3-de0e-4f94-aba2-2d0173ef3ba3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:32.834825 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-775be835-3bb9-4462-9fff-6e7d222a9820 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:32.840813 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-775be835-3bb9-4462-9fff-6e7d222a9820 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:32.841527 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-775be835-3bb9-4462-9fff-6e7d222a9820 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:32.847665 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-775be835-3bb9-4462-9fff-6e7d222a9820 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:32.848589 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-775be835-3bb9-4462-9fff-6e7d222a9820 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:32.855148 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-775be835-3bb9-4462-9fff-6e7d222a9820 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:33.147388 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-775be835-3bb9-4462-9fff-6e7d222a9820 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:33.156858 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-775be835-3bb9-4462-9fff-6e7d222a9820 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3" status: 200 len: 1217 microversion: 2.1 time: 0.340796 Aug 31 16:28:33.157597 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3022/6226] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:32 2022] GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3 => generated 1217 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:28:33.787227 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7ab0649a-7286-454a-84f2-fd3490797484 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "660f743e-92c7-4cdc-af17-31e53b2cae90"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:28:33.789940 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7ab0649a-7286-454a-84f2-fd3490797484 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 6e296817-752b-4ef9-812b-882268796473] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:33.798172 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ab0649a-7286-454a-84f2-fd3490797484 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:33.798934 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ab0649a-7286-454a-84f2-fd3490797484 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:33.800246 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ab0649a-7286-454a-84f2-fd3490797484 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:33.817969 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ab0649a-7286-454a-84f2-fd3490797484 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:33.819106 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ab0649a-7286-454a-84f2-fd3490797484 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:33.823018 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ab0649a-7286-454a-84f2-fd3490797484 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:34.179359 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2f42005e-d9b9-48c8-ada8-1381fca78d2a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:34.180807 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2f42005e-d9b9-48c8-ada8-1381fca78d2a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 52207df3-de0e-4f94-aba2-2d0173ef3ba3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:34.192669 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2f42005e-d9b9-48c8-ada8-1381fca78d2a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:34.195203 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2f42005e-d9b9-48c8-ada8-1381fca78d2a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:34.195785 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2f42005e-d9b9-48c8-ada8-1381fca78d2a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:34.198808 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2f42005e-d9b9-48c8-ada8-1381fca78d2a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:34.199510 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2f42005e-d9b9-48c8-ada8-1381fca78d2a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:34.200118 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2f42005e-d9b9-48c8-ada8-1381fca78d2a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:34.232055 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7ab0649a-7286-454a-84f2-fd3490797484 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "POST /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.446490 Aug 31 16:28:34.240008 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3205/6227] 10.222.0.50 () {60 vars in 1323 bytes} [Wed Aug 31 16:28:33 2022] POST /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473/os-volume_attachments => generated 194 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:28:34.953884 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2f42005e-d9b9-48c8-ada8-1381fca78d2a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:34.966218 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2f42005e-d9b9-48c8-ada8-1381fca78d2a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3" status: 200 len: 1217 microversion: 2.1 time: 0.791037 Aug 31 16:28:34.967436 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3023/6228] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:34 2022] GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3 => generated 1217 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:28:35.988868 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-65160284-2890-482d-b73c-c80b6cb254c1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:35.989577 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-65160284-2890-482d-b73c-c80b6cb254c1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 52207df3-de0e-4f94-aba2-2d0173ef3ba3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:36.010218 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-65160284-2890-482d-b73c-c80b6cb254c1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:36.010733 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-65160284-2890-482d-b73c-c80b6cb254c1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:36.011136 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-65160284-2890-482d-b73c-c80b6cb254c1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:36.011849 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-65160284-2890-482d-b73c-c80b6cb254c1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:36.012302 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-65160284-2890-482d-b73c-c80b6cb254c1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:36.012725 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-65160284-2890-482d-b73c-c80b6cb254c1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:36.363607 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-65160284-2890-482d-b73c-c80b6cb254c1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:36.373916 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-65160284-2890-482d-b73c-c80b6cb254c1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3" status: 200 len: 1217 microversion: 2.1 time: 0.389939 Aug 31 16:28:36.387164 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3206/6229] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:35 2022] GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3 => generated 1217 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:37.397653 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cf2702d9-cb8f-42fa-b837-c9ee251e1c2a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:37.398948 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cf2702d9-cb8f-42fa-b837-c9ee251e1c2a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 52207df3-de0e-4f94-aba2-2d0173ef3ba3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:37.414168 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf2702d9-cb8f-42fa-b837-c9ee251e1c2a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:37.422701 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf2702d9-cb8f-42fa-b837-c9ee251e1c2a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:37.423208 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf2702d9-cb8f-42fa-b837-c9ee251e1c2a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:37.423971 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf2702d9-cb8f-42fa-b837-c9ee251e1c2a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:37.424435 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf2702d9-cb8f-42fa-b837-c9ee251e1c2a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:37.425070 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf2702d9-cb8f-42fa-b837-c9ee251e1c2a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:37.637946 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cf2702d9-cb8f-42fa-b837-c9ee251e1c2a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:37.649180 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cf2702d9-cb8f-42fa-b837-c9ee251e1c2a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3" status: 200 len: 1217 microversion: 2.1 time: 0.255891 Aug 31 16:28:37.655214 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3024/6230] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:37 2022] GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3 => generated 1217 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:38.674553 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8cb140d8-0716-4ff4-a0b0-7c680ba3d045 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:38.675424 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8cb140d8-0716-4ff4-a0b0-7c680ba3d045 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 52207df3-de0e-4f94-aba2-2d0173ef3ba3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:38.685398 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8cb140d8-0716-4ff4-a0b0-7c680ba3d045 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:38.687443 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8cb140d8-0716-4ff4-a0b0-7c680ba3d045 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:38.687957 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8cb140d8-0716-4ff4-a0b0-7c680ba3d045 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:38.689462 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8cb140d8-0716-4ff4-a0b0-7c680ba3d045 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:38.690166 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8cb140d8-0716-4ff4-a0b0-7c680ba3d045 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:38.690823 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8cb140d8-0716-4ff4-a0b0-7c680ba3d045 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:38.947983 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8cb140d8-0716-4ff4-a0b0-7c680ba3d045 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:38.960512 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8cb140d8-0716-4ff4-a0b0-7c680ba3d045 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3" status: 200 len: 1217 microversion: 2.1 time: 0.293267 Aug 31 16:28:38.962684 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3207/6231] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:38 2022] GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3 => generated 1217 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:39.987248 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c64d3e77-e04b-4537-b2c2-5045f9c63c22 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:39.987878 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c64d3e77-e04b-4537-b2c2-5045f9c63c22 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 52207df3-de0e-4f94-aba2-2d0173ef3ba3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:40.000844 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c64d3e77-e04b-4537-b2c2-5045f9c63c22 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:40.001313 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c64d3e77-e04b-4537-b2c2-5045f9c63c22 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:40.001766 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c64d3e77-e04b-4537-b2c2-5045f9c63c22 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:40.002502 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c64d3e77-e04b-4537-b2c2-5045f9c63c22 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:40.003091 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c64d3e77-e04b-4537-b2c2-5045f9c63c22 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:40.003592 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c64d3e77-e04b-4537-b2c2-5045f9c63c22 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:40.492953 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c64d3e77-e04b-4537-b2c2-5045f9c63c22 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:40.509961 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-a2f74477-2614-4c85-a0b0-829e88600a79 req-8b6287a2-bf3d-49d4-b93b-74f033bf60bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52207df3-de0e-4f94-aba2-2d0173ef3ba3", "name": "network-vif-plugged", "status": "completed", "tag": "67a45c7a-fd48-45b3-a526-c4bbb69f89b9"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:28:40.525530 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c64d3e77-e04b-4537-b2c2-5045f9c63c22 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3" status: 200 len: 1217 microversion: 2.1 time: 0.542938 Aug 31 16:28:40.527396 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3025/6232] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:39 2022] GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3 => generated 1217 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:40.537499 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-a2f74477-2614-4c85-a0b0-829e88600a79 req-8b6287a2-bf3d-49d4-b93b-74f033bf60bf service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:40.538334 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-a2f74477-2614-4c85-a0b0-829e88600a79 req-8b6287a2-bf3d-49d4-b93b-74f033bf60bf service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:40.538976 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-a2f74477-2614-4c85-a0b0-829e88600a79 req-8b6287a2-bf3d-49d4-b93b-74f033bf60bf service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:40.579555 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-a2f74477-2614-4c85-a0b0-829e88600a79 req-8b6287a2-bf3d-49d4-b93b-74f033bf60bf service nova] Creating event network-vif-plugged:67a45c7a-fd48-45b3-a526-c4bbb69f89b9 for instance 52207df3-de0e-4f94-aba2-2d0173ef3ba3 on n-h2-833090-16 Aug 31 16:28:40.611767 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-a2f74477-2614-4c85-a0b0-829e88600a79 req-8b6287a2-bf3d-49d4-b93b-74f033bf60bf service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106637 Aug 31 16:28:40.615082 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3208/6233] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:28:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:28:41.547893 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f6adfec8-226b-4aab-b72e-25582eb1d23f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:41.548495 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f6adfec8-226b-4aab-b72e-25582eb1d23f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 52207df3-de0e-4f94-aba2-2d0173ef3ba3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:41.557418 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6adfec8-226b-4aab-b72e-25582eb1d23f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:41.559116 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6adfec8-226b-4aab-b72e-25582eb1d23f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:41.559711 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6adfec8-226b-4aab-b72e-25582eb1d23f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:41.561435 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6adfec8-226b-4aab-b72e-25582eb1d23f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:41.562028 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6adfec8-226b-4aab-b72e-25582eb1d23f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:41.562964 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f6adfec8-226b-4aab-b72e-25582eb1d23f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:41.751011 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f6adfec8-226b-4aab-b72e-25582eb1d23f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:41.770278 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f6adfec8-226b-4aab-b72e-25582eb1d23f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3" status: 200 len: 1217 microversion: 2.1 time: 0.226284 Aug 31 16:28:41.771231 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3026/6234] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:41 2022] GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3 => generated 1217 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:43.271490 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a8a8ae4c-c898-40fa-8b61-3c249e08842e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:43.273738 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a8a8ae4c-c898-40fa-8b61-3c249e08842e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 52207df3-de0e-4f94-aba2-2d0173ef3ba3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:43.303884 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a8a8ae4c-c898-40fa-8b61-3c249e08842e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:43.304729 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a8a8ae4c-c898-40fa-8b61-3c249e08842e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:43.305551 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a8a8ae4c-c898-40fa-8b61-3c249e08842e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:43.306508 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a8a8ae4c-c898-40fa-8b61-3c249e08842e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:43.307224 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a8a8ae4c-c898-40fa-8b61-3c249e08842e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:43.308974 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a8a8ae4c-c898-40fa-8b61-3c249e08842e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:43.553919 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a8a8ae4c-c898-40fa-8b61-3c249e08842e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:43.564029 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a8a8ae4c-c898-40fa-8b61-3c249e08842e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3" status: 200 len: 1404 microversion: 2.1 time: 0.768111 Aug 31 16:28:43.567966 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3209/6235] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:42 2022] GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3 => generated 1404 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:43.592112 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-eb8a180f-faf1-4f7a-8b94-f385ceb06142 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:43.592745 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-eb8a180f-faf1-4f7a-8b94-f385ceb06142 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 52207df3-de0e-4f94-aba2-2d0173ef3ba3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:43.612642 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb8a180f-faf1-4f7a-8b94-f385ceb06142 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:43.613139 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb8a180f-faf1-4f7a-8b94-f385ceb06142 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:43.614251 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb8a180f-faf1-4f7a-8b94-f385ceb06142 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:43.614914 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb8a180f-faf1-4f7a-8b94-f385ceb06142 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:43.615367 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb8a180f-faf1-4f7a-8b94-f385ceb06142 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:43.615799 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb8a180f-faf1-4f7a-8b94-f385ceb06142 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:44.188332 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-eb8a180f-faf1-4f7a-8b94-f385ceb06142 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:44.208158 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-eb8a180f-faf1-4f7a-8b94-f385ceb06142 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3" status: 200 len: 1404 microversion: 2.1 time: 0.618466 Aug 31 16:28:44.211644 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3027/6236] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:43 2022] GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3 => generated 1404 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:44.232314 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-16c1b035-49ae-4aaf-8424-090f67914b2a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1430927599"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:28:44.237673 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-16c1b035-49ae-4aaf-8424-090f67914b2a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 52207df3-de0e-4f94-aba2-2d0173ef3ba3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:44.252289 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-16c1b035-49ae-4aaf-8424-090f67914b2a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:44.253085 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-16c1b035-49ae-4aaf-8424-090f67914b2a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:44.253625 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-16c1b035-49ae-4aaf-8424-090f67914b2a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:44.254494 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-16c1b035-49ae-4aaf-8424-090f67914b2a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:44.255217 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-16c1b035-49ae-4aaf-8424-090f67914b2a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:44.256057 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-16c1b035-49ae-4aaf-8424-090f67914b2a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:44.461065 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.compute.api [None req-16c1b035-49ae-4aaf-8424-090f67914b2a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 52207df3-de0e-4f94-aba2-2d0173ef3ba3] Attempting to quiesce instance before volume snapshot. Aug 31 16:28:44.529574 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.compute.api [None req-16c1b035-49ae-4aaf-8424-090f67914b2a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 52207df3-de0e-4f94-aba2-2d0173ef3ba3] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Aug 31 16:28:44.655307 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-16c1b035-49ae-4aaf-8424-090f67914b2a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 52207df3-de0e-4f94-aba2-2d0173ef3ba3] Creating snapshot from volume cfa95213-4bf7-4024-b654-1af571770d7a. {{(pid=128864) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Aug 31 16:28:46.201665 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-16c1b035-49ae-4aaf-8424-090f67914b2a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "POST /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3/action" status: 202 len: 0 microversion: 2.1 time: 1.965522 Aug 31 16:28:46.204554 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3210/6237] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:28:44 2022] POST /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3/action => generated 0 bytes in 1978 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 31 16:28:47.896204 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8914c784-fd85-4504-814f-2c501a2abe2d tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1516063705", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "486334e9-b4f3-4a5c-9a8d-a7eb95d6fdab"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:28:47.913921 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:28:47.966142 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-8914c784-fd85-4504-814f-2c501a2abe2d tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] validate_networks() for [('486334e9-b4f3-4a5c-9a8d-a7eb95d6fdab', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:28:48.559837 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6d284f33-e2b7-4c4a-980e-8610c34f76a0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-715592923", "imageRef": "7692acd7-7d58-4424-827d-5ddd708e786a", "flavorRef": "452", "networks": [{"uuid": "875599c9-5517-4369-96b1-87dce382c42c"}]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:28:48.576919 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=29 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:28:48.644421 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-6d284f33-e2b7-4c4a-980e-8610c34f76a0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] validate_networks() for [('875599c9-5517-4369-96b1-87dce382c42c', None, None, None, None, None)] {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:28:48.702651 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-8914c784-fd85-4504-814f-2c501a2abe2d tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:28:48.710002 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-8914c784-fd85-4504-814f-2c501a2abe2d tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:28:48.710597 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-8914c784-fd85-4504-814f-2c501a2abe2d tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:28:48.711025 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-8914c784-fd85-4504-814f-2c501a2abe2d tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:28:48.712089 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-8914c784-fd85-4504-814f-2c501a2abe2d tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:28:48.728659 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8914c784-fd85-4504-814f-2c501a2abe2d tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:48.732001 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8914c784-fd85-4504-814f-2c501a2abe2d tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:48.732632 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8914c784-fd85-4504-814f-2c501a2abe2d tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:48.737083 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8914c784-fd85-4504-814f-2c501a2abe2d tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:48.738258 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8914c784-fd85-4504-814f-2c501a2abe2d tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:48.738897 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8914c784-fd85-4504-814f-2c501a2abe2d tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:48.756868 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=73 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:28:48.773185 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-8914c784-fd85-4504-814f-2c501a2abe2d tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Getting quotas for project aad41f7866b841cf8e28f9e6229ae6c3. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:28:48.781879 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-8914c784-fd85-4504-814f-2c501a2abe2d tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Getting quotas for user 144faa1806d54274812544c5d10cdb0e and project aad41f7866b841cf8e28f9e6229ae6c3. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:28:48.804341 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8914c784-fd85-4504-814f-2c501a2abe2d tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:28:48.808163 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8914c784-fd85-4504-814f-2c501a2abe2d tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] [instance: b4625b72-1083-418b-a152-c0c8b7d1ebfb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:28:48.895093 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8914c784-fd85-4504-814f-2c501a2abe2d tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.001536 Aug 31 16:28:48.897294 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3028/6238] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:28:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1006 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:28:48.910725 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1aba4f7c-b54b-4396-946b-b6029c017420 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:48.911543 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1aba4f7c-b54b-4396-946b-b6029c017420 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] [instance: b4625b72-1083-418b-a152-c0c8b7d1ebfb] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:49.068868 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1aba4f7c-b54b-4396-946b-b6029c017420 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144faa1806d54274812544c5d10cdb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad41f7866b841cf8e28f9e6229ae6c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:49.085167 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1aba4f7c-b54b-4396-946b-b6029c017420 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] 10.222.0.50 "GET /compute/v2.1/servers/b4625b72-1083-418b-a152-c0c8b7d1ebfb" status: 200 len: 1214 microversion: 2.1 time: 0.174138 Aug 31 16:28:49.085859 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3029/6239] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:48 2022] GET /compute/v2.1/servers/b4625b72-1083-418b-a152-c0c8b7d1ebfb => generated 1214 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:49.460711 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-6d284f33-e2b7-4c4a-980e-8610c34f76a0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:28:49.461484 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-6d284f33-e2b7-4c4a-980e-8610c34f76a0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:28:49.462319 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-6d284f33-e2b7-4c4a-980e-8610c34f76a0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:28:49.463121 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-6d284f33-e2b7-4c4a-980e-8610c34f76a0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:28:49.463863 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-6d284f33-e2b7-4c4a-980e-8610c34f76a0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:28:49.474239 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d284f33-e2b7-4c4a-980e-8610c34f76a0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:49.474918 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d284f33-e2b7-4c4a-980e-8610c34f76a0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:49.475451 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d284f33-e2b7-4c4a-980e-8610c34f76a0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:49.476229 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d284f33-e2b7-4c4a-980e-8610c34f76a0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:49.477206 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d284f33-e2b7-4c4a-980e-8610c34f76a0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:49.477736 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d284f33-e2b7-4c4a-980e-8610c34f76a0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:49.484913 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:28:49.500336 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-6d284f33-e2b7-4c4a-980e-8610c34f76a0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Getting quotas for project 32245d85aee64f69865d98656133a539. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:28:49.506945 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-6d284f33-e2b7-4c4a-980e-8610c34f76a0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Getting quotas for user fb76a89a8b8042edb7b6aaccb4f41ead and project 32245d85aee64f69865d98656133a539. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:28:49.521446 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6d284f33-e2b7-4c4a-980e-8610c34f76a0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:28:49.524896 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6d284f33-e2b7-4c4a-980e-8610c34f76a0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='10a7710f-c761-4fe4-85bd-9a7a8ae185ef',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:28:49.662337 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6d284f33-e2b7-4c4a-980e-8610c34f76a0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.108978 Aug 31 16:28:49.666168 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3211/6240] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:28:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1112 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:28:49.687233 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-99365a35-e4d6-4831-ab21-341ce1365b4d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:49.688086 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-99365a35-e4d6-4831-ab21-341ce1365b4d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:49.803680 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-99365a35-e4d6-4831-ab21-341ce1365b4d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:49.815930 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-99365a35-e4d6-4831-ab21-341ce1365b4d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd" status: 200 len: 1229 microversion: 2.1 time: 0.141981 Aug 31 16:28:49.826063 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3030/6241] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:49 2022] GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd => generated 1229 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:50.068784 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1c912ff5-7384-4aaf-8a53-6669ba2e3983 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:50.073755 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1c912ff5-7384-4aaf-8a53-6669ba2e3983 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 6e296817-752b-4ef9-812b-882268796473] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:50.088832 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1c912ff5-7384-4aaf-8a53-6669ba2e3983 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:50.089750 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1c912ff5-7384-4aaf-8a53-6669ba2e3983 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:50.090686 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1c912ff5-7384-4aaf-8a53-6669ba2e3983 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:50.092111 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1c912ff5-7384-4aaf-8a53-6669ba2e3983 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:50.092864 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1c912ff5-7384-4aaf-8a53-6669ba2e3983 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:50.093370 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1c912ff5-7384-4aaf-8a53-6669ba2e3983 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:50.107224 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-580dd1b6-1792-4288-9883-6a7f6d32287b tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:50.108353 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-580dd1b6-1792-4288-9883-6a7f6d32287b tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] [instance: b4625b72-1083-418b-a152-c0c8b7d1ebfb] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:50.116114 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-580dd1b6-1792-4288-9883-6a7f6d32287b tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:50.116823 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-580dd1b6-1792-4288-9883-6a7f6d32287b tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:50.117601 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-580dd1b6-1792-4288-9883-6a7f6d32287b tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:50.118734 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-580dd1b6-1792-4288-9883-6a7f6d32287b tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:50.119626 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-580dd1b6-1792-4288-9883-6a7f6d32287b tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:50.120328 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-580dd1b6-1792-4288-9883-6a7f6d32287b tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:50.229566 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1c912ff5-7384-4aaf-8a53-6669ba2e3983 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.166515 Aug 31 16:28:50.241828 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3212/6242] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:28:50 2022] GET /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473/os-volume_attachments => generated 197 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:28:50.257783 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-669e9ca1-8d0a-40ab-93cf-77ce453a914d tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:50.268300 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-669e9ca1-8d0a-40ab-93cf-77ce453a914d tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 6e296817-752b-4ef9-812b-882268796473] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:50.283909 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-669e9ca1-8d0a-40ab-93cf-77ce453a914d tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:50.284202 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-580dd1b6-1792-4288-9883-6a7f6d32287b tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144faa1806d54274812544c5d10cdb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad41f7866b841cf8e28f9e6229ae6c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:50.288094 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-669e9ca1-8d0a-40ab-93cf-77ce453a914d tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:50.290918 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-669e9ca1-8d0a-40ab-93cf-77ce453a914d tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:50.292050 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-669e9ca1-8d0a-40ab-93cf-77ce453a914d tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:50.292678 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-669e9ca1-8d0a-40ab-93cf-77ce453a914d tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:50.293283 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-669e9ca1-8d0a-40ab-93cf-77ce453a914d tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:50.297406 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-580dd1b6-1792-4288-9883-6a7f6d32287b tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] 10.222.0.50 "GET /compute/v2.1/servers/b4625b72-1083-418b-a152-c0c8b7d1ebfb" status: 200 len: 1266 microversion: 2.1 time: 0.194876 Aug 31 16:28:50.298474 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3031/6243] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:50 2022] GET /compute/v2.1/servers/b4625b72-1083-418b-a152-c0c8b7d1ebfb => generated 1266 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:50.365760 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-669e9ca1-8d0a-40ab-93cf-77ce453a914d tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473/os-volume_attachments/660f743e-92c7-4cdc-af17-31e53b2cae90" status: 200 len: 194 microversion: 2.1 time: 0.113167 Aug 31 16:28:50.366679 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3213/6244] 10.222.0.50 () {58 vars in 1413 bytes} [Wed Aug 31 16:28:50 2022] GET /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473/os-volume_attachments/660f743e-92c7-4cdc-af17-31e53b2cae90 => generated 194 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:28:50.860209 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b2fed9c1-7fbc-4366-b848-7769b17b8bea tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:50.860836 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b2fed9c1-7fbc-4366-b848-7769b17b8bea tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:50.879359 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b2fed9c1-7fbc-4366-b848-7769b17b8bea tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:50.881545 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b2fed9c1-7fbc-4366-b848-7769b17b8bea tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:50.883178 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b2fed9c1-7fbc-4366-b848-7769b17b8bea tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:50.888195 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b2fed9c1-7fbc-4366-b848-7769b17b8bea tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:50.889179 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b2fed9c1-7fbc-4366-b848-7769b17b8bea tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:50.889817 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b2fed9c1-7fbc-4366-b848-7769b17b8bea tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:51.128497 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b2fed9c1-7fbc-4366-b848-7769b17b8bea tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:51.145980 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b2fed9c1-7fbc-4366-b848-7769b17b8bea tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd" status: 200 len: 1225 microversion: 2.1 time: 0.292656 Aug 31 16:28:51.147505 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3032/6245] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:50 2022] GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd => generated 1225 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:51.321056 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1853c6d0-d7cf-4cdf-a5c8-5fcc9085d2a8 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:51.322831 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1853c6d0-d7cf-4cdf-a5c8-5fcc9085d2a8 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] [instance: b4625b72-1083-418b-a152-c0c8b7d1ebfb] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:51.332777 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1853c6d0-d7cf-4cdf-a5c8-5fcc9085d2a8 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:51.334252 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1853c6d0-d7cf-4cdf-a5c8-5fcc9085d2a8 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:51.336549 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1853c6d0-d7cf-4cdf-a5c8-5fcc9085d2a8 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:51.338445 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1853c6d0-d7cf-4cdf-a5c8-5fcc9085d2a8 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:51.339542 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1853c6d0-d7cf-4cdf-a5c8-5fcc9085d2a8 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:51.341664 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1853c6d0-d7cf-4cdf-a5c8-5fcc9085d2a8 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:51.482053 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1853c6d0-d7cf-4cdf-a5c8-5fcc9085d2a8 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144faa1806d54274812544c5d10cdb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad41f7866b841cf8e28f9e6229ae6c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:51.498565 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1853c6d0-d7cf-4cdf-a5c8-5fcc9085d2a8 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] 10.222.0.50 "GET /compute/v2.1/servers/b4625b72-1083-418b-a152-c0c8b7d1ebfb" status: 200 len: 1272 microversion: 2.1 time: 0.180765 Aug 31 16:28:51.501674 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3214/6246] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:51 2022] GET /compute/v2.1/servers/b4625b72-1083-418b-a152-c0c8b7d1ebfb => generated 1272 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:52.172064 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d759b233-facd-4403-9f03-51d4d7f6d5a9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:52.174951 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d759b233-facd-4403-9f03-51d4d7f6d5a9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:52.199818 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d759b233-facd-4403-9f03-51d4d7f6d5a9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:52.200353 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d759b233-facd-4403-9f03-51d4d7f6d5a9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:52.200789 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d759b233-facd-4403-9f03-51d4d7f6d5a9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:52.201502 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d759b233-facd-4403-9f03-51d4d7f6d5a9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:52.201954 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d759b233-facd-4403-9f03-51d4d7f6d5a9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:52.206062 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d759b233-facd-4403-9f03-51d4d7f6d5a9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:52.408502 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d759b233-facd-4403-9f03-51d4d7f6d5a9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:52.421296 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d759b233-facd-4403-9f03-51d4d7f6d5a9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd" status: 200 len: 1299 microversion: 2.1 time: 0.254317 Aug 31 16:28:52.423154 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3033/6247] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:52 2022] GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd => generated 1299 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:52.523088 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-26ef02df-1919-4f68-938c-3d1cfeb28984 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:52.526851 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-26ef02df-1919-4f68-938c-3d1cfeb28984 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] [instance: b4625b72-1083-418b-a152-c0c8b7d1ebfb] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:52.543516 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26ef02df-1919-4f68-938c-3d1cfeb28984 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:52.544375 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26ef02df-1919-4f68-938c-3d1cfeb28984 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:52.545155 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26ef02df-1919-4f68-938c-3d1cfeb28984 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:52.546164 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26ef02df-1919-4f68-938c-3d1cfeb28984 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:52.546853 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26ef02df-1919-4f68-938c-3d1cfeb28984 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:52.547728 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26ef02df-1919-4f68-938c-3d1cfeb28984 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:52.923329 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-26ef02df-1919-4f68-938c-3d1cfeb28984 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144faa1806d54274812544c5d10cdb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad41f7866b841cf8e28f9e6229ae6c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:52.956759 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-26ef02df-1919-4f68-938c-3d1cfeb28984 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] 10.222.0.50 "GET /compute/v2.1/servers/b4625b72-1083-418b-a152-c0c8b7d1ebfb" status: 200 len: 1314 microversion: 2.1 time: 0.438363 Aug 31 16:28:52.976481 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3215/6248] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:52 2022] GET /compute/v2.1/servers/b4625b72-1083-418b-a152-c0c8b7d1ebfb => generated 1314 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:53.224762 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f68e88e0-ff9b-41d6-8b7f-63a53bca1255 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "359daa73-f497-4cfe-89c9-52af7ac38a7a"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:28:53.228867 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f68e88e0-ff9b-41d6-8b7f-63a53bca1255 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 6e296817-752b-4ef9-812b-882268796473] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:53.247204 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f68e88e0-ff9b-41d6-8b7f-63a53bca1255 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:53.248728 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f68e88e0-ff9b-41d6-8b7f-63a53bca1255 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:53.250279 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f68e88e0-ff9b-41d6-8b7f-63a53bca1255 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:53.251934 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f68e88e0-ff9b-41d6-8b7f-63a53bca1255 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:53.254662 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f68e88e0-ff9b-41d6-8b7f-63a53bca1255 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:53.255370 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f68e88e0-ff9b-41d6-8b7f-63a53bca1255 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:53.448784 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1fd1e6db-eec6-4933-8fa3-e1e11846a619 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:53.449914 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1fd1e6db-eec6-4933-8fa3-e1e11846a619 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:53.462762 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1fd1e6db-eec6-4933-8fa3-e1e11846a619 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:53.466718 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1fd1e6db-eec6-4933-8fa3-e1e11846a619 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:53.468354 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1fd1e6db-eec6-4933-8fa3-e1e11846a619 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:53.470828 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1fd1e6db-eec6-4933-8fa3-e1e11846a619 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:53.472667 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1fd1e6db-eec6-4933-8fa3-e1e11846a619 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:53.473396 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1fd1e6db-eec6-4933-8fa3-e1e11846a619 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:53.839245 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f68e88e0-ff9b-41d6-8b7f-63a53bca1255 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "POST /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.619051 Aug 31 16:28:53.858036 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3034/6249] 10.222.0.50 () {60 vars in 1323 bytes} [Wed Aug 31 16:28:53 2022] POST /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473/os-volume_attachments => generated 194 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:28:53.878958 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-7ee3c14f-7719-4e54-81b7-a4168c10de4f req-10919804-a59a-41ac-979a-4637ea7a06b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4625b72-1083-418b-a152-c0c8b7d1ebfb", "tag": "b18ed3de-f29a-424d-b7ff-820939fdc5d2"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:28:53.896917 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1fd1e6db-eec6-4933-8fa3-e1e11846a619 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:53.913844 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7ee3c14f-7719-4e54-81b7-a4168c10de4f req-10919804-a59a-41ac-979a-4637ea7a06b5 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:53.917903 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7ee3c14f-7719-4e54-81b7-a4168c10de4f req-10919804-a59a-41ac-979a-4637ea7a06b5 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:53.918559 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1fd1e6db-eec6-4933-8fa3-e1e11846a619 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd" status: 200 len: 1299 microversion: 2.1 time: 0.469640 Aug 31 16:28:53.918988 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7ee3c14f-7719-4e54-81b7-a4168c10de4f req-10919804-a59a-41ac-979a-4637ea7a06b5 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:53.926545 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3216/6250] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:53 2022] GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd => generated 1299 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:53.983766 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-58caff2e-85f4-496b-83c5-1ca922b373b8 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:53.984389 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-58caff2e-85f4-496b-83c5-1ca922b373b8 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] [instance: b4625b72-1083-418b-a152-c0c8b7d1ebfb] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:53.988152 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-7ee3c14f-7719-4e54-81b7-a4168c10de4f req-10919804-a59a-41ac-979a-4637ea7a06b5 service nova] Creating event network-changed:b18ed3de-f29a-424d-b7ff-820939fdc5d2 for instance b4625b72-1083-418b-a152-c0c8b7d1ebfb on n-h1-833090-16 Aug 31 16:28:53.992147 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-58caff2e-85f4-496b-83c5-1ca922b373b8 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:54.002194 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-7ee3c14f-7719-4e54-81b7-a4168c10de4f req-10919804-a59a-41ac-979a-4637ea7a06b5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128643 Aug 31 16:28:54.006911 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-58caff2e-85f4-496b-83c5-1ca922b373b8 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:54.007505 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3035/6251] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:28:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:28:54.007662 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-58caff2e-85f4-496b-83c5-1ca922b373b8 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:54.009299 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-58caff2e-85f4-496b-83c5-1ca922b373b8 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:54.009482 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-58caff2e-85f4-496b-83c5-1ca922b373b8 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:54.011838 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-58caff2e-85f4-496b-83c5-1ca922b373b8 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:54.715480 n-d-833090-16 devstack@n-api.service[128864]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 16:28:54.715805 n-d-833090-16 devstack@n-api.service[128864]: Wed Aug 31 16:28:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b4625b72-1083-418b-a152-c0c8b7d1ebfb (ip 10.222.0.50) !!! Aug 31 16:28:54.737687 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-58caff2e-85f4-496b-83c5-1ca922b373b8 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144faa1806d54274812544c5d10cdb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad41f7866b841cf8e28f9e6229ae6c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:54.761367 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-58caff2e-85f4-496b-83c5-1ca922b373b8 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] 10.222.0.50 "GET /compute/v2.1/servers/b4625b72-1083-418b-a152-c0c8b7d1ebfb" status: 200 len: 1314 microversion: 2.1 time: 0.781366 Aug 31 16:28:54.768741 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3217/6252] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:53 2022] GET /compute/v2.1/servers/b4625b72-1083-418b-a152-c0c8b7d1ebfb => generated 1314 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:54.952396 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f4381029-a338-4b2e-ad24-575a63a63218 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:54.953164 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f4381029-a338-4b2e-ad24-575a63a63218 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:54.967462 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4381029-a338-4b2e-ad24-575a63a63218 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:54.967938 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4381029-a338-4b2e-ad24-575a63a63218 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:54.968495 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4381029-a338-4b2e-ad24-575a63a63218 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:54.969284 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4381029-a338-4b2e-ad24-575a63a63218 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:54.969748 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4381029-a338-4b2e-ad24-575a63a63218 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:54.983249 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f4381029-a338-4b2e-ad24-575a63a63218 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:55.559201 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f4381029-a338-4b2e-ad24-575a63a63218 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:55.568756 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f4381029-a338-4b2e-ad24-575a63a63218 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd" status: 200 len: 1341 microversion: 2.1 time: 0.620592 Aug 31 16:28:55.570285 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3036/6253] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:54 2022] GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd => generated 1341 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:55.788325 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3c4de02d-42d0-436e-b220-a307f752f747 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:55.789664 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3c4de02d-42d0-436e-b220-a307f752f747 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] [instance: b4625b72-1083-418b-a152-c0c8b7d1ebfb] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:55.799922 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3c4de02d-42d0-436e-b220-a307f752f747 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:55.800673 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3c4de02d-42d0-436e-b220-a307f752f747 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:55.801301 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3c4de02d-42d0-436e-b220-a307f752f747 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:55.802201 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3c4de02d-42d0-436e-b220-a307f752f747 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:55.802816 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3c4de02d-42d0-436e-b220-a307f752f747 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:55.803402 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3c4de02d-42d0-436e-b220-a307f752f747 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:55.958828 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3c4de02d-42d0-436e-b220-a307f752f747 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144faa1806d54274812544c5d10cdb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad41f7866b841cf8e28f9e6229ae6c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:55.969096 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3c4de02d-42d0-436e-b220-a307f752f747 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] 10.222.0.50 "GET /compute/v2.1/servers/b4625b72-1083-418b-a152-c0c8b7d1ebfb" status: 200 len: 1314 microversion: 2.1 time: 0.185255 Aug 31 16:28:55.983680 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3218/6254] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:55 2022] GET /compute/v2.1/servers/b4625b72-1083-418b-a152-c0c8b7d1ebfb => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:56.591568 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f57b6af8-bdb4-46e5-991f-ab58555bc549 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:56.592343 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f57b6af8-bdb4-46e5-991f-ab58555bc549 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:56.632788 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f57b6af8-bdb4-46e5-991f-ab58555bc549 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:56.637859 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f57b6af8-bdb4-46e5-991f-ab58555bc549 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:56.638492 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f57b6af8-bdb4-46e5-991f-ab58555bc549 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:56.639416 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f57b6af8-bdb4-46e5-991f-ab58555bc549 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:56.648028 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f57b6af8-bdb4-46e5-991f-ab58555bc549 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:56.648742 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f57b6af8-bdb4-46e5-991f-ab58555bc549 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:56.714689 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-66c1786e-a7cc-44bd-895a-aa6766525343 req-9dd1493b-c853-471d-8412-83ca0592d622 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd", "tag": "c4579063-be24-495a-941a-cbb3a5a05119"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:28:56.744628 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-66c1786e-a7cc-44bd-895a-aa6766525343 req-9dd1493b-c853-471d-8412-83ca0592d622 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:56.745841 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-66c1786e-a7cc-44bd-895a-aa6766525343 req-9dd1493b-c853-471d-8412-83ca0592d622 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:56.746456 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-66c1786e-a7cc-44bd-895a-aa6766525343 req-9dd1493b-c853-471d-8412-83ca0592d622 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:56.768587 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-66c1786e-a7cc-44bd-895a-aa6766525343 req-9dd1493b-c853-471d-8412-83ca0592d622 service nova] Creating event network-changed:c4579063-be24-495a-941a-cbb3a5a05119 for instance a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd on n-h2-833090-16 Aug 31 16:28:56.776172 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-66c1786e-a7cc-44bd-895a-aa6766525343 req-9dd1493b-c853-471d-8412-83ca0592d622 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066031 Aug 31 16:28:56.777283 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3219/6255] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:28:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:28:56.999266 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-670da145-47c4-46b0-8697-58cf6dd820fa tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:57.001155 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-670da145-47c4-46b0-8697-58cf6dd820fa tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] [instance: b4625b72-1083-418b-a152-c0c8b7d1ebfb] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:57.016466 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-670da145-47c4-46b0-8697-58cf6dd820fa tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:57.021886 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-670da145-47c4-46b0-8697-58cf6dd820fa tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:57.022759 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-670da145-47c4-46b0-8697-58cf6dd820fa tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:57.024026 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-670da145-47c4-46b0-8697-58cf6dd820fa tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:57.024748 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-670da145-47c4-46b0-8697-58cf6dd820fa tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:57.026060 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-670da145-47c4-46b0-8697-58cf6dd820fa tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:57.361007 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f57b6af8-bdb4-46e5-991f-ab58555bc549 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:57.374080 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f57b6af8-bdb4-46e5-991f-ab58555bc549 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd" status: 200 len: 1341 microversion: 2.1 time: 0.785582 Aug 31 16:28:57.386260 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3037/6256] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:56 2022] GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd => generated 1341 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:57.494906 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-670da145-47c4-46b0-8697-58cf6dd820fa tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144faa1806d54274812544c5d10cdb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad41f7866b841cf8e28f9e6229ae6c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:57.505025 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-670da145-47c4-46b0-8697-58cf6dd820fa tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] 10.222.0.50 "GET /compute/v2.1/servers/b4625b72-1083-418b-a152-c0c8b7d1ebfb" status: 200 len: 1314 microversion: 2.1 time: 0.512160 Aug 31 16:28:57.519552 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3220/6257] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:56 2022] GET /compute/v2.1/servers/b4625b72-1083-418b-a152-c0c8b7d1ebfb => generated 1314 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:28:58.406875 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-24e03ef1-dda9-489d-9ed9-79b4d50085bf tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:58.412100 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-24e03ef1-dda9-489d-9ed9-79b4d50085bf tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:58.436088 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-24e03ef1-dda9-489d-9ed9-79b4d50085bf tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:58.436926 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-24e03ef1-dda9-489d-9ed9-79b4d50085bf tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:58.443117 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-24e03ef1-dda9-489d-9ed9-79b4d50085bf tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:58.444098 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-24e03ef1-dda9-489d-9ed9-79b4d50085bf tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:58.449414 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-24e03ef1-dda9-489d-9ed9-79b4d50085bf tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:58.450452 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-24e03ef1-dda9-489d-9ed9-79b4d50085bf tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:58.532963 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9190a84a-2cb1-473b-a103-5efc5d61a358 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:28:58.534659 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9190a84a-2cb1-473b-a103-5efc5d61a358 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] [instance: b4625b72-1083-418b-a152-c0c8b7d1ebfb] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:28:58.551645 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9190a84a-2cb1-473b-a103-5efc5d61a358 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:58.552607 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9190a84a-2cb1-473b-a103-5efc5d61a358 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:58.553004 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9190a84a-2cb1-473b-a103-5efc5d61a358 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:58.553766 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9190a84a-2cb1-473b-a103-5efc5d61a358 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:28:58.554262 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9190a84a-2cb1-473b-a103-5efc5d61a358 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:28:58.554903 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9190a84a-2cb1-473b-a103-5efc5d61a358 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:28:58.758517 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:28:59.023228 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-24e03ef1-dda9-489d-9ed9-79b4d50085bf tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:59.043792 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-24e03ef1-dda9-489d-9ed9-79b4d50085bf tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd" status: 200 len: 1341 microversion: 2.1 time: 0.644718 Aug 31 16:28:59.045304 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3038/6258] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:58 2022] GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd => generated 1341 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:28:59.062523 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9190a84a-2cb1-473b-a103-5efc5d61a358 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144faa1806d54274812544c5d10cdb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad41f7866b841cf8e28f9e6229ae6c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:28:59.073900 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9190a84a-2cb1-473b-a103-5efc5d61a358 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] 10.222.0.50 "GET /compute/v2.1/servers/b4625b72-1083-418b-a152-c0c8b7d1ebfb" status: 200 len: 1314 microversion: 2.1 time: 0.546327 Aug 31 16:28:59.082607 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3221/6259] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:28:58 2022] GET /compute/v2.1/servers/b4625b72-1083-418b-a152-c0c8b7d1ebfb => generated 1314 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:00.066372 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6a70ec75-b0ea-496a-8845-046cfe0541bb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:00.068609 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6a70ec75-b0ea-496a-8845-046cfe0541bb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:00.072566 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=10 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:29:00.084622 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a70ec75-b0ea-496a-8845-046cfe0541bb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:00.085405 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a70ec75-b0ea-496a-8845-046cfe0541bb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:00.086626 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a70ec75-b0ea-496a-8845-046cfe0541bb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:00.087540 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a70ec75-b0ea-496a-8845-046cfe0541bb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:00.088153 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a70ec75-b0ea-496a-8845-046cfe0541bb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:00.088873 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a70ec75-b0ea-496a-8845-046cfe0541bb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:00.098820 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ec8332f4-0c9d-4f3b-bc16-26e7fa6ad26b tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:00.100415 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ec8332f4-0c9d-4f3b-bc16-26e7fa6ad26b tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] [instance: b4625b72-1083-418b-a152-c0c8b7d1ebfb] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:00.111687 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:29:00.113262 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=6 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:29:00.117562 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ec8332f4-0c9d-4f3b-bc16-26e7fa6ad26b tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:00.118652 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ec8332f4-0c9d-4f3b-bc16-26e7fa6ad26b tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:00.119313 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ec8332f4-0c9d-4f3b-bc16-26e7fa6ad26b tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:00.120414 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ec8332f4-0c9d-4f3b-bc16-26e7fa6ad26b tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:00.121146 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ec8332f4-0c9d-4f3b-bc16-26e7fa6ad26b tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:00.122200 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ec8332f4-0c9d-4f3b-bc16-26e7fa6ad26b tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:00.616949 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6a70ec75-b0ea-496a-8845-046cfe0541bb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:00.642048 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6a70ec75-b0ea-496a-8845-046cfe0541bb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd" status: 200 len: 1341 microversion: 2.1 time: 0.580445 Aug 31 16:29:00.662760 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3039/6260] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:00 2022] GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd => generated 1341 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:00.679012 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ec8332f4-0c9d-4f3b-bc16-26e7fa6ad26b tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144faa1806d54274812544c5d10cdb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad41f7866b841cf8e28f9e6229ae6c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:00.696768 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ec8332f4-0c9d-4f3b-bc16-26e7fa6ad26b tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] 10.222.0.50 "GET /compute/v2.1/servers/b4625b72-1083-418b-a152-c0c8b7d1ebfb" status: 200 len: 1314 microversion: 2.1 time: 0.602521 Aug 31 16:29:00.699790 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3222/6261] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:00 2022] GET /compute/v2.1/servers/b4625b72-1083-418b-a152-c0c8b7d1ebfb => generated 1314 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:01.653996 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-cb63c0a7-62e5-4a6f-b43d-efa305d85cf4 req-59caef23-f3fd-4b37-a709-5cdf67fe3c9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4625b72-1083-418b-a152-c0c8b7d1ebfb", "name": "network-vif-plugged", "status": "completed", "tag": "b18ed3de-f29a-424d-b7ff-820939fdc5d2"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:29:01.678684 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e3bc110f-0bc4-497b-8d75-08d671477e2f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:01.680322 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e3bc110f-0bc4-497b-8d75-08d671477e2f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:01.693469 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-cb63c0a7-62e5-4a6f-b43d-efa305d85cf4 req-59caef23-f3fd-4b37-a709-5cdf67fe3c9e service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:01.696201 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-cb63c0a7-62e5-4a6f-b43d-efa305d85cf4 req-59caef23-f3fd-4b37-a709-5cdf67fe3c9e service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:01.699226 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-cb63c0a7-62e5-4a6f-b43d-efa305d85cf4 req-59caef23-f3fd-4b37-a709-5cdf67fe3c9e service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:01.703401 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e3bc110f-0bc4-497b-8d75-08d671477e2f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:01.706447 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e3bc110f-0bc4-497b-8d75-08d671477e2f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:01.707379 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e3bc110f-0bc4-497b-8d75-08d671477e2f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:01.709646 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e3bc110f-0bc4-497b-8d75-08d671477e2f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:01.711343 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e3bc110f-0bc4-497b-8d75-08d671477e2f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:01.713635 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e3bc110f-0bc4-497b-8d75-08d671477e2f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:01.758605 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-cb63c0a7-62e5-4a6f-b43d-efa305d85cf4 req-59caef23-f3fd-4b37-a709-5cdf67fe3c9e service nova] Creating event network-vif-plugged:b18ed3de-f29a-424d-b7ff-820939fdc5d2 for instance b4625b72-1083-418b-a152-c0c8b7d1ebfb on n-h1-833090-16 Aug 31 16:29:01.786775 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-cb63c0a7-62e5-4a6f-b43d-efa305d85cf4 req-59caef23-f3fd-4b37-a709-5cdf67fe3c9e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136518 Aug 31 16:29:01.791458 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3040/6262] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:29:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:29:01.807328 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1120ea4e-a22c-4a9c-ad66-c73880202300 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:01.814949 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1120ea4e-a22c-4a9c-ad66-c73880202300 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] [instance: b4625b72-1083-418b-a152-c0c8b7d1ebfb] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:01.858470 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1120ea4e-a22c-4a9c-ad66-c73880202300 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:01.860177 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1120ea4e-a22c-4a9c-ad66-c73880202300 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:01.865677 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1120ea4e-a22c-4a9c-ad66-c73880202300 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:01.867413 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1120ea4e-a22c-4a9c-ad66-c73880202300 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:01.873406 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1120ea4e-a22c-4a9c-ad66-c73880202300 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:01.877944 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1120ea4e-a22c-4a9c-ad66-c73880202300 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:02.302050 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e3bc110f-0bc4-497b-8d75-08d671477e2f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:02.316176 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e3bc110f-0bc4-497b-8d75-08d671477e2f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd" status: 200 len: 1341 microversion: 2.1 time: 0.649600 Aug 31 16:29:02.328459 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3223/6263] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:01 2022] GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd => generated 1341 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:02.356844 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1120ea4e-a22c-4a9c-ad66-c73880202300 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144faa1806d54274812544c5d10cdb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad41f7866b841cf8e28f9e6229ae6c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:02.367277 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1120ea4e-a22c-4a9c-ad66-c73880202300 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] 10.222.0.50 "GET /compute/v2.1/servers/b4625b72-1083-418b-a152-c0c8b7d1ebfb" status: 200 len: 1314 microversion: 2.1 time: 0.573880 Aug 31 16:29:02.379205 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3041/6264] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:01 2022] GET /compute/v2.1/servers/b4625b72-1083-418b-a152-c0c8b7d1ebfb => generated 1314 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:03.354752 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-744631b4-3ec5-4433-b844-a5323b35b5a2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:03.356023 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-744631b4-3ec5-4433-b844-a5323b35b5a2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:03.363490 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-744631b4-3ec5-4433-b844-a5323b35b5a2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:03.366352 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-744631b4-3ec5-4433-b844-a5323b35b5a2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:03.367056 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-744631b4-3ec5-4433-b844-a5323b35b5a2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:03.367967 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-744631b4-3ec5-4433-b844-a5323b35b5a2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:03.368896 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-744631b4-3ec5-4433-b844-a5323b35b5a2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:03.369401 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-744631b4-3ec5-4433-b844-a5323b35b5a2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:03.390857 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bf1056b8-ff87-45e8-a152-70b5e86a3a6b tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:03.392394 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bf1056b8-ff87-45e8-a152-70b5e86a3a6b tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] [instance: b4625b72-1083-418b-a152-c0c8b7d1ebfb] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:03.410447 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf1056b8-ff87-45e8-a152-70b5e86a3a6b tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:03.411588 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf1056b8-ff87-45e8-a152-70b5e86a3a6b tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:03.412679 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf1056b8-ff87-45e8-a152-70b5e86a3a6b tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:03.414223 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf1056b8-ff87-45e8-a152-70b5e86a3a6b tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:03.414928 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf1056b8-ff87-45e8-a152-70b5e86a3a6b tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:03.415590 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf1056b8-ff87-45e8-a152-70b5e86a3a6b tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:03.723547 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bf1056b8-ff87-45e8-a152-70b5e86a3a6b tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144faa1806d54274812544c5d10cdb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad41f7866b841cf8e28f9e6229ae6c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:03.732269 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-744631b4-3ec5-4433-b844-a5323b35b5a2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:03.738463 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bf1056b8-ff87-45e8-a152-70b5e86a3a6b tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] 10.222.0.50 "GET /compute/v2.1/servers/b4625b72-1083-418b-a152-c0c8b7d1ebfb" status: 200 len: 1498 microversion: 2.1 time: 0.350250 Aug 31 16:29:03.742633 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3042/6265] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:03 2022] GET /compute/v2.1/servers/b4625b72-1083-418b-a152-c0c8b7d1ebfb => generated 1498 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:29:03.762672 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-744631b4-3ec5-4433-b844-a5323b35b5a2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd" status: 200 len: 1341 microversion: 2.1 time: 0.411748 Aug 31 16:29:03.770038 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3224/6266] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:03 2022] GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd => generated 1341 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:04.589438 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-11bcd5aa-6361-4028-bf08-97706f844a88 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:04.590586 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-11bcd5aa-6361-4028-bf08-97706f844a88 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] [instance: b4625b72-1083-418b-a152-c0c8b7d1ebfb] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:04.623610 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11bcd5aa-6361-4028-bf08-97706f844a88 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:04.628745 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11bcd5aa-6361-4028-bf08-97706f844a88 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:04.629819 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11bcd5aa-6361-4028-bf08-97706f844a88 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:04.630867 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11bcd5aa-6361-4028-bf08-97706f844a88 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:04.634873 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11bcd5aa-6361-4028-bf08-97706f844a88 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:04.635810 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-11bcd5aa-6361-4028-bf08-97706f844a88 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:04.691177 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-11bcd5aa-6361-4028-bf08-97706f844a88 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] [instance: b4625b72-1083-418b-a152-c0c8b7d1ebfb] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:29:04.795236 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-83998aca-777c-4de5-93b9-563c2ec5aebc tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:04.795770 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-83998aca-777c-4de5-93b9-563c2ec5aebc tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:04.832912 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83998aca-777c-4de5-93b9-563c2ec5aebc tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:04.833460 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83998aca-777c-4de5-93b9-563c2ec5aebc tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:04.839010 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83998aca-777c-4de5-93b9-563c2ec5aebc tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:04.840033 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83998aca-777c-4de5-93b9-563c2ec5aebc tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:04.840953 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83998aca-777c-4de5-93b9-563c2ec5aebc tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:04.842036 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83998aca-777c-4de5-93b9-563c2ec5aebc tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:04.860263 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-11bcd5aa-6361-4028-bf08-97706f844a88 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b4625b72-1083-418b-a152-c0c8b7d1ebfb" status: 204 len: 0 microversion: 2.1 time: 0.274649 Aug 31 16:29:04.861256 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3043/6267] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:29:04 2022] DELETE /compute/v2.1/servers/b4625b72-1083-418b-a152-c0c8b7d1ebfb => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:29:04.873837 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-54d257d4-3058-42bc-abd0-8f71a83ac3f1 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:04.875100 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-54d257d4-3058-42bc-abd0-8f71a83ac3f1 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] [instance: b4625b72-1083-418b-a152-c0c8b7d1ebfb] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:04.882967 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-54d257d4-3058-42bc-abd0-8f71a83ac3f1 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:04.884503 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-54d257d4-3058-42bc-abd0-8f71a83ac3f1 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:04.885501 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-54d257d4-3058-42bc-abd0-8f71a83ac3f1 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:04.886516 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-54d257d4-3058-42bc-abd0-8f71a83ac3f1 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:04.887228 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-54d257d4-3058-42bc-abd0-8f71a83ac3f1 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:04.888152 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-54d257d4-3058-42bc-abd0-8f71a83ac3f1 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:05.319600 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-83998aca-777c-4de5-93b9-563c2ec5aebc tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:05.320732 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-54d257d4-3058-42bc-abd0-8f71a83ac3f1 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144faa1806d54274812544c5d10cdb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad41f7866b841cf8e28f9e6229ae6c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:05.328280 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-83998aca-777c-4de5-93b9-563c2ec5aebc tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd" status: 200 len: 1341 microversion: 2.1 time: 0.536683 Aug 31 16:29:05.344475 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3225/6268] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:04 2022] GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd => generated 1341 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:29:05.347424 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-54d257d4-3058-42bc-abd0-8f71a83ac3f1 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] 10.222.0.50 "GET /compute/v2.1/servers/b4625b72-1083-418b-a152-c0c8b7d1ebfb" status: 200 len: 1504 microversion: 2.1 time: 0.479014 Aug 31 16:29:05.353064 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3044/6269] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:04 2022] GET /compute/v2.1/servers/b4625b72-1083-418b-a152-c0c8b7d1ebfb => generated 1504 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:29:06.356373 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-78f02530-3e61-4e3c-8870-6c50f84ce561 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:06.357831 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-78f02530-3e61-4e3c-8870-6c50f84ce561 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:06.369318 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-78f02530-3e61-4e3c-8870-6c50f84ce561 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:06.370463 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-78f02530-3e61-4e3c-8870-6c50f84ce561 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:06.371163 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-78f02530-3e61-4e3c-8870-6c50f84ce561 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:06.372355 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-78f02530-3e61-4e3c-8870-6c50f84ce561 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:06.373293 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-78f02530-3e61-4e3c-8870-6c50f84ce561 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:06.373827 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-78f02530-3e61-4e3c-8870-6c50f84ce561 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:06.375924 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cb357a3b-8606-49e5-8763-4a9e4880582a tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:06.376706 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cb357a3b-8606-49e5-8763-4a9e4880582a tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] [instance: b4625b72-1083-418b-a152-c0c8b7d1ebfb] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:06.400156 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb357a3b-8606-49e5-8763-4a9e4880582a tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:06.400909 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb357a3b-8606-49e5-8763-4a9e4880582a tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:06.403712 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb357a3b-8606-49e5-8763-4a9e4880582a tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:06.407331 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb357a3b-8606-49e5-8763-4a9e4880582a tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:06.407891 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb357a3b-8606-49e5-8763-4a9e4880582a tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:06.408336 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb357a3b-8606-49e5-8763-4a9e4880582a tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:06.739042 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-78f02530-3e61-4e3c-8870-6c50f84ce561 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:06.749039 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-78f02530-3e61-4e3c-8870-6c50f84ce561 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd" status: 200 len: 1341 microversion: 2.1 time: 0.402613 Aug 31 16:29:06.753915 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3226/6270] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:06 2022] GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd => generated 1341 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:06.792853 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cb357a3b-8606-49e5-8763-4a9e4880582a tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144faa1806d54274812544c5d10cdb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad41f7866b841cf8e28f9e6229ae6c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:06.799927 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:29:06.804205 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cb357a3b-8606-49e5-8763-4a9e4880582a tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] 10.222.0.50 "GET /compute/v2.1/servers/b4625b72-1083-418b-a152-c0c8b7d1ebfb" status: 200 len: 1504 microversion: 2.1 time: 0.434094 Aug 31 16:29:06.805262 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3045/6271] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:06 2022] GET /compute/v2.1/servers/b4625b72-1083-418b-a152-c0c8b7d1ebfb => generated 1504 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:29:07.049100 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-46d4ea4a-b620-4170-82f4-43009c89eeb4 req-4d6f4724-4b4c-4240-8216-b45c1747a26c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4625b72-1083-418b-a152-c0c8b7d1ebfb", "name": "network-vif-deleted", "tag": "b18ed3de-f29a-424d-b7ff-820939fdc5d2"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:29:07.063388 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-46d4ea4a-b620-4170-82f4-43009c89eeb4 req-4d6f4724-4b4c-4240-8216-b45c1747a26c service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:07.063885 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-46d4ea4a-b620-4170-82f4-43009c89eeb4 req-4d6f4724-4b4c-4240-8216-b45c1747a26c service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:07.065281 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-46d4ea4a-b620-4170-82f4-43009c89eeb4 req-4d6f4724-4b4c-4240-8216-b45c1747a26c service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:07.091872 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-46d4ea4a-b620-4170-82f4-43009c89eeb4 req-4d6f4724-4b4c-4240-8216-b45c1747a26c service nova] Creating event network-vif-deleted:b18ed3de-f29a-424d-b7ff-820939fdc5d2 for instance b4625b72-1083-418b-a152-c0c8b7d1ebfb on n-h1-833090-16 Aug 31 16:29:07.098249 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-46d4ea4a-b620-4170-82f4-43009c89eeb4 req-4d6f4724-4b4c-4240-8216-b45c1747a26c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053069 Aug 31 16:29:07.102500 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3227/6272] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:29:07.777122 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6a58247b-f0ff-4dcb-ab9d-02ace768ca7c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:07.777925 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6a58247b-f0ff-4dcb-ab9d-02ace768ca7c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:07.788505 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a58247b-f0ff-4dcb-ab9d-02ace768ca7c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:07.789297 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a58247b-f0ff-4dcb-ab9d-02ace768ca7c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:07.789982 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a58247b-f0ff-4dcb-ab9d-02ace768ca7c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:07.790750 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a58247b-f0ff-4dcb-ab9d-02ace768ca7c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:07.791180 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a58247b-f0ff-4dcb-ab9d-02ace768ca7c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:07.791772 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a58247b-f0ff-4dcb-ab9d-02ace768ca7c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:07.846996 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-615f2ff6-a145-4245-9448-f1c4d29688d1 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:07.848701 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-615f2ff6-a145-4245-9448-f1c4d29688d1 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] [instance: b4625b72-1083-418b-a152-c0c8b7d1ebfb] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:07.866874 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-615f2ff6-a145-4245-9448-f1c4d29688d1 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:07.869227 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-615f2ff6-a145-4245-9448-f1c4d29688d1 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:07.869866 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-615f2ff6-a145-4245-9448-f1c4d29688d1 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:07.871927 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-615f2ff6-a145-4245-9448-f1c4d29688d1 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:07.872334 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-615f2ff6-a145-4245-9448-f1c4d29688d1 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:07.874768 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-615f2ff6-a145-4245-9448-f1c4d29688d1 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:07.898511 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-615f2ff6-a145-4245-9448-f1c4d29688d1 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] HTTP exception thrown: Instance b4625b72-1083-418b-a152-c0c8b7d1ebfb could not be found. Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-615f2ff6-a145-4245-9448-f1c4d29688d1 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Request method failure captured: Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/b4625b72-1083-418b-a152-c0c8b7d1ebfb HTTP/1.1 Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4w82X7UZTN9c57fJdclv4xDmMjF8qiCzqw4_m8gmJby-s4swncLwYBSKcUKjGhoRmJLtfMoiE24VOK8ZkjK8PEzmTKaGTWeJcNrcznnJbQIQK0mNIOPE3iprZst8qIsDFWlXvjGf2qaUT9N8x-OpJtw8bMy-VhEYyCi-ZgSzhc3n5Q Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: aad41f7866b841cf8e28f9e6229ae6c3 Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-VolumesActionsTest-1219421304 Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/aad41f7866b841cf8e28f9e6229ae6c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/aad41f7866b841cf8e28f9e6229ae6c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/aad41f7866b841cf8e28f9e6229ae6c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_aad41f7866b841cf8e28f9e6229ae6c3", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-VolumesActionsTest-1219421304 Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: aad41f7866b841cf8e28f9e6229ae6c3 Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-VolumesActionsTest-1219421304 Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-VolumesActionsTest-1219421304-project Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 144faa1806d54274812544c5d10cdb0e Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-VolumesActionsTest-1219421304-project Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance b4625b72-1083-418b-a152-c0c8b7d1ebfb could not be found. Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'b4625b72-1083-418b-a152-c0c8b7d1ebfb'} Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4625b72-1083-418b-a152-c0c8b7d1ebfb could not be found. Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4625b72-1083-418b-a152-c0c8b7d1ebfb could not be found. Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:29:07.900802 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:29:07.917990 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:29:07.917990 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:29:07.917990 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:29:07.917990 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:29:07.917990 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:29:07.917990 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4625b72-1083-418b-a152-c0c8b7d1ebfb could not be found. Aug 31 16:29:07.917990 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:29:07.917990 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-615f2ff6-a145-4245-9448-f1c4d29688d1 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Returning 404 to user: Instance b4625b72-1083-418b-a152-c0c8b7d1ebfb could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:29:07.917990 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-615f2ff6-a145-4245-9448-f1c4d29688d1 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] 10.222.0.50 "GET /compute/v2.1/servers/b4625b72-1083-418b-a152-c0c8b7d1ebfb" status: 404 len: 111 microversion: 2.1 time: 0.068855 Aug 31 16:29:07.917990 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3228/6273] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:07 2022] GET /compute/v2.1/servers/b4625b72-1083-418b-a152-c0c8b7d1ebfb => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:29:07.985058 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6a58247b-f0ff-4dcb-ab9d-02ace768ca7c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:08.003631 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6a58247b-f0ff-4dcb-ab9d-02ace768ca7c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd" status: 200 len: 1341 microversion: 2.1 time: 0.234313 Aug 31 16:29:08.004534 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3046/6274] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:07 2022] GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd => generated 1341 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:08.038902 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7fd8ea6c-03f5-49d0-bde3-c704af0ee88b tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1866549193", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "486334e9-b4f3-4a5c-9a8d-a7eb95d6fdab"}]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:29:08.112115 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-7fd8ea6c-03f5-49d0-bde3-c704af0ee88b tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] validate_networks() for [('486334e9-b4f3-4a5c-9a8d-a7eb95d6fdab', None, None, None, None, None)] {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:29:08.844057 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-7fd8ea6c-03f5-49d0-bde3-c704af0ee88b tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:29:08.844780 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-7fd8ea6c-03f5-49d0-bde3-c704af0ee88b tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:29:08.845419 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-7fd8ea6c-03f5-49d0-bde3-c704af0ee88b tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:29:08.845993 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-7fd8ea6c-03f5-49d0-bde3-c704af0ee88b tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:29:08.846603 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-7fd8ea6c-03f5-49d0-bde3-c704af0ee88b tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:29:08.881049 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7fd8ea6c-03f5-49d0-bde3-c704af0ee88b tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:08.881980 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7fd8ea6c-03f5-49d0-bde3-c704af0ee88b tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:08.881980 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7fd8ea6c-03f5-49d0-bde3-c704af0ee88b tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:08.883213 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7fd8ea6c-03f5-49d0-bde3-c704af0ee88b tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:08.883811 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7fd8ea6c-03f5-49d0-bde3-c704af0ee88b tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:08.884349 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7fd8ea6c-03f5-49d0-bde3-c704af0ee88b tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:08.923447 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-7fd8ea6c-03f5-49d0-bde3-c704af0ee88b tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Getting quotas for project aad41f7866b841cf8e28f9e6229ae6c3. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:29:08.935996 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-7fd8ea6c-03f5-49d0-bde3-c704af0ee88b tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Getting quotas for user 144faa1806d54274812544c5d10cdb0e and project aad41f7866b841cf8e28f9e6229ae6c3. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:29:08.965320 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7fd8ea6c-03f5-49d0-bde3-c704af0ee88b tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:29:08.971684 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7fd8ea6c-03f5-49d0-bde3-c704af0ee88b tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] [instance: 765b5be3-ebb2-42b1-8c42-84ae59be3505] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:29:09.033768 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-443f9a10-0212-4377-99bd-bf6f4e1f898a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:09.035099 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-443f9a10-0212-4377-99bd-bf6f4e1f898a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:09.052249 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-443f9a10-0212-4377-99bd-bf6f4e1f898a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:09.054974 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-443f9a10-0212-4377-99bd-bf6f4e1f898a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:09.055784 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-443f9a10-0212-4377-99bd-bf6f4e1f898a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:09.062159 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-443f9a10-0212-4377-99bd-bf6f4e1f898a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:09.062832 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-443f9a10-0212-4377-99bd-bf6f4e1f898a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:09.063436 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-443f9a10-0212-4377-99bd-bf6f4e1f898a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:09.076307 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7fd8ea6c-03f5-49d0-bde3-c704af0ee88b tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.042306 Aug 31 16:29:09.094155 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3229/6275] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:29:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1061 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 16:29:09.109319 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-66479651-a633-4707-9980-5596807c2558 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:09.126376 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-66479651-a633-4707-9980-5596807c2558 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] [instance: 765b5be3-ebb2-42b1-8c42-84ae59be3505] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:09.344056 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-66479651-a633-4707-9980-5596807c2558 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144faa1806d54274812544c5d10cdb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad41f7866b841cf8e28f9e6229ae6c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:09.358586 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-66479651-a633-4707-9980-5596807c2558 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] 10.222.0.50 "GET /compute/v2.1/servers/765b5be3-ebb2-42b1-8c42-84ae59be3505" status: 200 len: 1214 microversion: 2.1 time: 0.252308 Aug 31 16:29:09.370783 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3230/6276] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:09 2022] GET /compute/v2.1/servers/765b5be3-ebb2-42b1-8c42-84ae59be3505 => generated 1214 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:29:09.443606 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-443f9a10-0212-4377-99bd-bf6f4e1f898a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:09.455739 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-443f9a10-0212-4377-99bd-bf6f4e1f898a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd" status: 200 len: 1341 microversion: 2.1 time: 0.433070 Aug 31 16:29:09.458632 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3047/6277] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:09 2022] GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd => generated 1341 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:29:10.385701 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a7b3189e-e473-4278-9539-d695b09ffbec tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:10.386601 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a7b3189e-e473-4278-9539-d695b09ffbec tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] [instance: 765b5be3-ebb2-42b1-8c42-84ae59be3505] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:10.407580 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a7b3189e-e473-4278-9539-d695b09ffbec tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:10.408353 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a7b3189e-e473-4278-9539-d695b09ffbec tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:10.409079 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a7b3189e-e473-4278-9539-d695b09ffbec tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:10.411428 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a7b3189e-e473-4278-9539-d695b09ffbec tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:10.412601 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a7b3189e-e473-4278-9539-d695b09ffbec tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:10.413544 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a7b3189e-e473-4278-9539-d695b09ffbec tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:10.482405 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f02a76ae-0ce3-448a-813a-2fbb2767f5a2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:10.492863 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f02a76ae-0ce3-448a-813a-2fbb2767f5a2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:10.517302 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f02a76ae-0ce3-448a-813a-2fbb2767f5a2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:10.517993 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f02a76ae-0ce3-448a-813a-2fbb2767f5a2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:10.518626 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f02a76ae-0ce3-448a-813a-2fbb2767f5a2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:10.519533 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f02a76ae-0ce3-448a-813a-2fbb2767f5a2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:10.520157 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f02a76ae-0ce3-448a-813a-2fbb2767f5a2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:10.520733 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f02a76ae-0ce3-448a-813a-2fbb2767f5a2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:10.722940 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a7b3189e-e473-4278-9539-d695b09ffbec tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144faa1806d54274812544c5d10cdb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad41f7866b841cf8e28f9e6229ae6c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:10.734228 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a7b3189e-e473-4278-9539-d695b09ffbec tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] 10.222.0.50 "GET /compute/v2.1/servers/765b5be3-ebb2-42b1-8c42-84ae59be3505" status: 200 len: 1266 microversion: 2.1 time: 0.354432 Aug 31 16:29:10.750891 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3231/6278] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:10 2022] GET /compute/v2.1/servers/765b5be3-ebb2-42b1-8c42-84ae59be3505 => generated 1266 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:10.911560 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f02a76ae-0ce3-448a-813a-2fbb2767f5a2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:10.931447 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f02a76ae-0ce3-448a-813a-2fbb2767f5a2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd" status: 200 len: 1341 microversion: 2.1 time: 0.446235 Aug 31 16:29:10.947488 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3048/6279] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:10 2022] GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd => generated 1341 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:11.111052 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-07d5eee1-740a-42ed-a2d2-51dd0c66ec35 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:11.115731 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-07d5eee1-740a-42ed-a2d2-51dd0c66ec35 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 6e296817-752b-4ef9-812b-882268796473] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:11.134546 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-07d5eee1-740a-42ed-a2d2-51dd0c66ec35 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:11.135316 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-07d5eee1-740a-42ed-a2d2-51dd0c66ec35 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:11.136984 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-07d5eee1-740a-42ed-a2d2-51dd0c66ec35 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:11.141120 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-07d5eee1-740a-42ed-a2d2-51dd0c66ec35 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:11.141858 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-07d5eee1-740a-42ed-a2d2-51dd0c66ec35 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:11.142516 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-07d5eee1-740a-42ed-a2d2-51dd0c66ec35 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:11.150653 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=100 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:29:11.220907 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-07d5eee1-740a-42ed-a2d2-51dd0c66ec35 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.117259 Aug 31 16:29:11.228113 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3232/6280] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:29:11 2022] GET /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473/os-volume_attachments => generated 371 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:29:11.365929 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8985ddf3-0613-4d8e-891c-80076fc42351 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:11.368037 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8985ddf3-0613-4d8e-891c-80076fc42351 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 6e296817-752b-4ef9-812b-882268796473] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:11.381212 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8985ddf3-0613-4d8e-891c-80076fc42351 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:11.389481 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8985ddf3-0613-4d8e-891c-80076fc42351 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:11.392272 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8985ddf3-0613-4d8e-891c-80076fc42351 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:11.398968 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8985ddf3-0613-4d8e-891c-80076fc42351 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:11.399868 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8985ddf3-0613-4d8e-891c-80076fc42351 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:11.404800 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8985ddf3-0613-4d8e-891c-80076fc42351 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:11.549242 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8985ddf3-0613-4d8e-891c-80076fc42351 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473/os-volume_attachments/660f743e-92c7-4cdc-af17-31e53b2cae90" status: 200 len: 194 microversion: 2.1 time: 0.190002 Aug 31 16:29:11.562716 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3ed18bc3-4a2f-45bd-a984-282ec6e01522 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:11.563284 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3ed18bc3-4a2f-45bd-a984-282ec6e01522 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 6e296817-752b-4ef9-812b-882268796473] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:11.566446 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3049/6281] 10.222.0.50 () {58 vars in 1413 bytes} [Wed Aug 31 16:29:11 2022] GET /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473/os-volume_attachments/660f743e-92c7-4cdc-af17-31e53b2cae90 => generated 194 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:29:11.575479 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3ed18bc3-4a2f-45bd-a984-282ec6e01522 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:11.577044 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3ed18bc3-4a2f-45bd-a984-282ec6e01522 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:11.577669 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3ed18bc3-4a2f-45bd-a984-282ec6e01522 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:11.578803 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3ed18bc3-4a2f-45bd-a984-282ec6e01522 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:11.580081 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3ed18bc3-4a2f-45bd-a984-282ec6e01522 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:11.583598 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3ed18bc3-4a2f-45bd-a984-282ec6e01522 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:11.743883 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-3ed18bc3-4a2f-45bd-a984-282ec6e01522 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lazy-loading 'services' on Instance uuid 6e296817-752b-4ef9-812b-882268796473 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:29:11.761912 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-45323ae2-aff2-4e16-8448-70c028c790f9 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:11.763006 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-45323ae2-aff2-4e16-8448-70c028c790f9 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] [instance: 765b5be3-ebb2-42b1-8c42-84ae59be3505] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:11.794022 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45323ae2-aff2-4e16-8448-70c028c790f9 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:11.795919 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45323ae2-aff2-4e16-8448-70c028c790f9 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:11.798579 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45323ae2-aff2-4e16-8448-70c028c790f9 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:11.802410 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45323ae2-aff2-4e16-8448-70c028c790f9 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:11.803694 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45323ae2-aff2-4e16-8448-70c028c790f9 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:11.807715 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45323ae2-aff2-4e16-8448-70c028c790f9 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:11.994684 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3ed18bc3-4a2f-45bd-a984-282ec6e01522 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "DELETE /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473/os-volume_attachments/660f743e-92c7-4cdc-af17-31e53b2cae90" status: 202 len: 0 microversion: 2.1 time: 0.437772 Aug 31 16:29:11.996140 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3233/6282] 10.222.0.50 () {58 vars in 1416 bytes} [Wed Aug 31 16:29:11 2022] DELETE /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473/os-volume_attachments/660f743e-92c7-4cdc-af17-31e53b2cae90 => generated 0 bytes in 440 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:29:12.015069 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-be092461-9ee1-4d12-91cd-5bc2f262bff7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:12.033545 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-be092461-9ee1-4d12-91cd-5bc2f262bff7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:12.057890 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-be092461-9ee1-4d12-91cd-5bc2f262bff7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:12.063157 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-be092461-9ee1-4d12-91cd-5bc2f262bff7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:12.063725 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-be092461-9ee1-4d12-91cd-5bc2f262bff7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:12.064536 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-be092461-9ee1-4d12-91cd-5bc2f262bff7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:12.065176 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-be092461-9ee1-4d12-91cd-5bc2f262bff7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:12.065705 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-be092461-9ee1-4d12-91cd-5bc2f262bff7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:12.103493 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-45323ae2-aff2-4e16-8448-70c028c790f9 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144faa1806d54274812544c5d10cdb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad41f7866b841cf8e28f9e6229ae6c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:12.146512 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-45323ae2-aff2-4e16-8448-70c028c790f9 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] 10.222.0.50 "GET /compute/v2.1/servers/765b5be3-ebb2-42b1-8c42-84ae59be3505" status: 200 len: 1272 microversion: 2.1 time: 0.387929 Aug 31 16:29:12.147171 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3050/6283] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:11 2022] GET /compute/v2.1/servers/765b5be3-ebb2-42b1-8c42-84ae59be3505 => generated 1272 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:12.764923 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-be092461-9ee1-4d12-91cd-5bc2f262bff7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:12.785630 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-be092461-9ee1-4d12-91cd-5bc2f262bff7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd" status: 200 len: 1341 microversion: 2.1 time: 0.787925 Aug 31 16:29:12.786586 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3234/6284] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:11 2022] GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd => generated 1341 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:13.171062 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f3ffc0ba-55f7-4026-87fe-36c8d306ca5b tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:13.172361 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f3ffc0ba-55f7-4026-87fe-36c8d306ca5b tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] [instance: 765b5be3-ebb2-42b1-8c42-84ae59be3505] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:13.186484 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f3ffc0ba-55f7-4026-87fe-36c8d306ca5b tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:13.187077 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f3ffc0ba-55f7-4026-87fe-36c8d306ca5b tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:13.187583 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f3ffc0ba-55f7-4026-87fe-36c8d306ca5b tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:13.188336 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f3ffc0ba-55f7-4026-87fe-36c8d306ca5b tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:13.199464 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f3ffc0ba-55f7-4026-87fe-36c8d306ca5b tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:13.200007 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f3ffc0ba-55f7-4026-87fe-36c8d306ca5b tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:13.672290 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f3ffc0ba-55f7-4026-87fe-36c8d306ca5b tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144faa1806d54274812544c5d10cdb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad41f7866b841cf8e28f9e6229ae6c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:13.692632 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f3ffc0ba-55f7-4026-87fe-36c8d306ca5b tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] 10.222.0.50 "GET /compute/v2.1/servers/765b5be3-ebb2-42b1-8c42-84ae59be3505" status: 200 len: 1314 microversion: 2.1 time: 0.527199 Aug 31 16:29:13.693630 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3051/6285] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:13 2022] GET /compute/v2.1/servers/765b5be3-ebb2-42b1-8c42-84ae59be3505 => generated 1314 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:13.812446 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-70afc122-5680-4a90-9770-0b349ae1c054 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:13.826294 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-70afc122-5680-4a90-9770-0b349ae1c054 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:13.838813 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-70afc122-5680-4a90-9770-0b349ae1c054 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:13.840303 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-70afc122-5680-4a90-9770-0b349ae1c054 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:13.841042 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-70afc122-5680-4a90-9770-0b349ae1c054 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:13.842238 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-70afc122-5680-4a90-9770-0b349ae1c054 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:13.842979 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-70afc122-5680-4a90-9770-0b349ae1c054 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:13.843615 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-70afc122-5680-4a90-9770-0b349ae1c054 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:14.562412 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-70afc122-5680-4a90-9770-0b349ae1c054 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:14.571824 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-70afc122-5680-4a90-9770-0b349ae1c054 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd" status: 200 len: 1341 microversion: 2.1 time: 0.764561 Aug 31 16:29:14.578847 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3235/6286] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:13 2022] GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd => generated 1341 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:14.715708 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d3a5519e-0cdf-4bc4-b411-5f1e422dba1c tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:14.716328 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d3a5519e-0cdf-4bc4-b411-5f1e422dba1c tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] [instance: 765b5be3-ebb2-42b1-8c42-84ae59be3505] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:14.736369 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d3a5519e-0cdf-4bc4-b411-5f1e422dba1c tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:14.736861 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d3a5519e-0cdf-4bc4-b411-5f1e422dba1c tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:14.739555 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d3a5519e-0cdf-4bc4-b411-5f1e422dba1c tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:14.746719 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d3a5519e-0cdf-4bc4-b411-5f1e422dba1c tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:14.747875 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d3a5519e-0cdf-4bc4-b411-5f1e422dba1c tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:14.748896 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d3a5519e-0cdf-4bc4-b411-5f1e422dba1c tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:14.858985 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-4c639d4c-8b62-4617-9968-830959acfe0e req-21785711-5372-4ebd-a2c9-db9ef2ff342c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "765b5be3-ebb2-42b1-8c42-84ae59be3505", "tag": "4b35ea41-1a70-4073-b45f-7384866c803f"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:29:14.888354 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-4c639d4c-8b62-4617-9968-830959acfe0e req-21785711-5372-4ebd-a2c9-db9ef2ff342c service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:14.889081 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-4c639d4c-8b62-4617-9968-830959acfe0e req-21785711-5372-4ebd-a2c9-db9ef2ff342c service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:14.889540 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-4c639d4c-8b62-4617-9968-830959acfe0e req-21785711-5372-4ebd-a2c9-db9ef2ff342c service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:14.918330 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-4c639d4c-8b62-4617-9968-830959acfe0e req-21785711-5372-4ebd-a2c9-db9ef2ff342c service nova] Creating event network-changed:4b35ea41-1a70-4073-b45f-7384866c803f for instance 765b5be3-ebb2-42b1-8c42-84ae59be3505 on n-h1-833090-16 Aug 31 16:29:14.924865 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-4c639d4c-8b62-4617-9968-830959acfe0e req-21785711-5372-4ebd-a2c9-db9ef2ff342c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070632 Aug 31 16:29:14.925487 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3236/6287] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:29:15.159526 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d3a5519e-0cdf-4bc4-b411-5f1e422dba1c tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144faa1806d54274812544c5d10cdb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad41f7866b841cf8e28f9e6229ae6c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:15.177354 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d3a5519e-0cdf-4bc4-b411-5f1e422dba1c tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] 10.222.0.50 "GET /compute/v2.1/servers/765b5be3-ebb2-42b1-8c42-84ae59be3505" status: 200 len: 1314 microversion: 2.1 time: 0.464184 Aug 31 16:29:15.178750 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3052/6288] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:14 2022] GET /compute/v2.1/servers/765b5be3-ebb2-42b1-8c42-84ae59be3505 => generated 1314 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:15.607612 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1015b0b5-afe0-4f01-9ef8-c415d0781ae5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:15.608724 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1015b0b5-afe0-4f01-9ef8-c415d0781ae5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:15.618784 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1015b0b5-afe0-4f01-9ef8-c415d0781ae5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:15.620069 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1015b0b5-afe0-4f01-9ef8-c415d0781ae5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:15.620926 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1015b0b5-afe0-4f01-9ef8-c415d0781ae5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:15.622133 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1015b0b5-afe0-4f01-9ef8-c415d0781ae5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:15.623404 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1015b0b5-afe0-4f01-9ef8-c415d0781ae5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:15.624238 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1015b0b5-afe0-4f01-9ef8-c415d0781ae5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:15.932989 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1015b0b5-afe0-4f01-9ef8-c415d0781ae5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:15.960248 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1015b0b5-afe0-4f01-9ef8-c415d0781ae5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd" status: 200 len: 1341 microversion: 2.1 time: 0.357434 Aug 31 16:29:15.972335 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3237/6289] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:15 2022] GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd => generated 1341 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:16.201500 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ffb63d71-befe-4bdc-97f2-02efa3abd3f0 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:16.203111 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ffb63d71-befe-4bdc-97f2-02efa3abd3f0 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] [instance: 765b5be3-ebb2-42b1-8c42-84ae59be3505] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:16.211783 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ffb63d71-befe-4bdc-97f2-02efa3abd3f0 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:16.212523 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ffb63d71-befe-4bdc-97f2-02efa3abd3f0 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:16.213154 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ffb63d71-befe-4bdc-97f2-02efa3abd3f0 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:16.213884 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ffb63d71-befe-4bdc-97f2-02efa3abd3f0 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:16.214392 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ffb63d71-befe-4bdc-97f2-02efa3abd3f0 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:16.214940 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ffb63d71-befe-4bdc-97f2-02efa3abd3f0 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:16.436216 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ffb63d71-befe-4bdc-97f2-02efa3abd3f0 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144faa1806d54274812544c5d10cdb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad41f7866b841cf8e28f9e6229ae6c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:16.448821 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ffb63d71-befe-4bdc-97f2-02efa3abd3f0 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] 10.222.0.50 "GET /compute/v2.1/servers/765b5be3-ebb2-42b1-8c42-84ae59be3505" status: 200 len: 1314 microversion: 2.1 time: 0.248900 Aug 31 16:29:16.452893 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3053/6290] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:16 2022] GET /compute/v2.1/servers/765b5be3-ebb2-42b1-8c42-84ae59be3505 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:16.989953 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4fad58ba-ec63-4fbd-a779-3532af9a4042 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:16.990922 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4fad58ba-ec63-4fbd-a779-3532af9a4042 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:17.019448 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4fad58ba-ec63-4fbd-a779-3532af9a4042 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:17.021850 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4fad58ba-ec63-4fbd-a779-3532af9a4042 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:17.024183 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4fad58ba-ec63-4fbd-a779-3532af9a4042 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:17.025209 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4fad58ba-ec63-4fbd-a779-3532af9a4042 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:17.025874 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4fad58ba-ec63-4fbd-a779-3532af9a4042 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:17.027991 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4fad58ba-ec63-4fbd-a779-3532af9a4042 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:17.419262 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4fad58ba-ec63-4fbd-a779-3532af9a4042 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:17.434798 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4fad58ba-ec63-4fbd-a779-3532af9a4042 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd" status: 200 len: 1341 microversion: 2.1 time: 0.451265 Aug 31 16:29:17.436453 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3238/6291] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:16 2022] GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd => generated 1341 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:17.470337 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a0bfd5a7-6275-4063-a861-20aeb4cf87d3 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:17.470968 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a0bfd5a7-6275-4063-a861-20aeb4cf87d3 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] [instance: 765b5be3-ebb2-42b1-8c42-84ae59be3505] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:17.478361 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a0bfd5a7-6275-4063-a861-20aeb4cf87d3 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:17.479066 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a0bfd5a7-6275-4063-a861-20aeb4cf87d3 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:17.479680 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a0bfd5a7-6275-4063-a861-20aeb4cf87d3 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:17.480604 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a0bfd5a7-6275-4063-a861-20aeb4cf87d3 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:17.489834 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a0bfd5a7-6275-4063-a861-20aeb4cf87d3 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:17.490699 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a0bfd5a7-6275-4063-a861-20aeb4cf87d3 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:17.827770 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a0bfd5a7-6275-4063-a861-20aeb4cf87d3 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144faa1806d54274812544c5d10cdb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad41f7866b841cf8e28f9e6229ae6c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:17.836298 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a0bfd5a7-6275-4063-a861-20aeb4cf87d3 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] 10.222.0.50 "GET /compute/v2.1/servers/765b5be3-ebb2-42b1-8c42-84ae59be3505" status: 200 len: 1314 microversion: 2.1 time: 0.369746 Aug 31 16:29:17.836945 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3054/6292] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:17 2022] GET /compute/v2.1/servers/765b5be3-ebb2-42b1-8c42-84ae59be3505 => generated 1314 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:18.461952 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8dd3c23a-d878-4099-961a-6c460a637fdb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:18.463396 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8dd3c23a-d878-4099-961a-6c460a637fdb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:18.478439 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8dd3c23a-d878-4099-961a-6c460a637fdb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:18.480632 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8dd3c23a-d878-4099-961a-6c460a637fdb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:18.481491 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8dd3c23a-d878-4099-961a-6c460a637fdb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:18.484125 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8dd3c23a-d878-4099-961a-6c460a637fdb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:18.484772 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8dd3c23a-d878-4099-961a-6c460a637fdb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:18.487749 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8dd3c23a-d878-4099-961a-6c460a637fdb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:18.801251 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8dd3c23a-d878-4099-961a-6c460a637fdb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:18.824781 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8dd3c23a-d878-4099-961a-6c460a637fdb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd" status: 200 len: 1341 microversion: 2.1 time: 0.367588 Aug 31 16:29:18.825761 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3239/6293] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:18 2022] GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd => generated 1341 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:18.868649 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5d4733f9-7ffe-4fd6-9f01-adf7a0559c2e tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:18.869270 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5d4733f9-7ffe-4fd6-9f01-adf7a0559c2e tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] [instance: 765b5be3-ebb2-42b1-8c42-84ae59be3505] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:18.875455 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:29:18.885915 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d4733f9-7ffe-4fd6-9f01-adf7a0559c2e tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:18.886493 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d4733f9-7ffe-4fd6-9f01-adf7a0559c2e tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:18.886928 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d4733f9-7ffe-4fd6-9f01-adf7a0559c2e tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:18.887676 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d4733f9-7ffe-4fd6-9f01-adf7a0559c2e tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:18.888131 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d4733f9-7ffe-4fd6-9f01-adf7a0559c2e tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:18.898899 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d4733f9-7ffe-4fd6-9f01-adf7a0559c2e tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:19.186822 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5d4733f9-7ffe-4fd6-9f01-adf7a0559c2e tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144faa1806d54274812544c5d10cdb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad41f7866b841cf8e28f9e6229ae6c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:19.200723 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5d4733f9-7ffe-4fd6-9f01-adf7a0559c2e tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] 10.222.0.50 "GET /compute/v2.1/servers/765b5be3-ebb2-42b1-8c42-84ae59be3505" status: 200 len: 1314 microversion: 2.1 time: 0.336744 Aug 31 16:29:19.202223 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3055/6294] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:18 2022] GET /compute/v2.1/servers/765b5be3-ebb2-42b1-8c42-84ae59be3505 => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:19.854473 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f684efab-2f70-49d6-b46d-2c7903edbdde tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:19.856306 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f684efab-2f70-49d6-b46d-2c7903edbdde tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:19.860523 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:29:19.863253 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=8 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:29:19.868970 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:29:19.894831 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f684efab-2f70-49d6-b46d-2c7903edbdde tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:19.895731 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f684efab-2f70-49d6-b46d-2c7903edbdde tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:19.909523 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f684efab-2f70-49d6-b46d-2c7903edbdde tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:19.910727 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f684efab-2f70-49d6-b46d-2c7903edbdde tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:19.911378 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f684efab-2f70-49d6-b46d-2c7903edbdde tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:19.911997 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f684efab-2f70-49d6-b46d-2c7903edbdde tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:20.195671 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f684efab-2f70-49d6-b46d-2c7903edbdde tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:20.206519 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f684efab-2f70-49d6-b46d-2c7903edbdde tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd" status: 200 len: 1341 microversion: 2.1 time: 0.359616 Aug 31 16:29:20.208887 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3240/6295] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:19 2022] GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd => generated 1341 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:20.240788 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-45f4d4f5-a554-40e4-84d6-da066e421a58 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:20.241778 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-45f4d4f5-a554-40e4-84d6-da066e421a58 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] [instance: 765b5be3-ebb2-42b1-8c42-84ae59be3505] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:20.255889 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45f4d4f5-a554-40e4-84d6-da066e421a58 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:20.259710 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45f4d4f5-a554-40e4-84d6-da066e421a58 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:20.262244 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45f4d4f5-a554-40e4-84d6-da066e421a58 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:20.266184 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45f4d4f5-a554-40e4-84d6-da066e421a58 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:20.266184 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45f4d4f5-a554-40e4-84d6-da066e421a58 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:20.266645 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-45f4d4f5-a554-40e4-84d6-da066e421a58 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:20.539393 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-45f4d4f5-a554-40e4-84d6-da066e421a58 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144faa1806d54274812544c5d10cdb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad41f7866b841cf8e28f9e6229ae6c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:20.566016 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-45f4d4f5-a554-40e4-84d6-da066e421a58 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] 10.222.0.50 "GET /compute/v2.1/servers/765b5be3-ebb2-42b1-8c42-84ae59be3505" status: 200 len: 1314 microversion: 2.1 time: 0.330532 Aug 31 16:29:20.578734 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3056/6296] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:20 2022] GET /compute/v2.1/servers/765b5be3-ebb2-42b1-8c42-84ae59be3505 => generated 1314 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:21.231151 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-45d6a610-ada3-4864-9263-cc53e59f6e4f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:21.232914 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-45d6a610-ada3-4864-9263-cc53e59f6e4f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:21.250566 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-45d6a610-ada3-4864-9263-cc53e59f6e4f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:21.251675 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-45d6a610-ada3-4864-9263-cc53e59f6e4f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:21.252737 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-45d6a610-ada3-4864-9263-cc53e59f6e4f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:21.254008 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-45d6a610-ada3-4864-9263-cc53e59f6e4f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:21.254996 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-45d6a610-ada3-4864-9263-cc53e59f6e4f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:21.255600 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-45d6a610-ada3-4864-9263-cc53e59f6e4f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:21.590653 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0fe67627-0caf-48fd-9cbe-ff98f6bc442f tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:21.591350 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0fe67627-0caf-48fd-9cbe-ff98f6bc442f tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] [instance: 765b5be3-ebb2-42b1-8c42-84ae59be3505] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:21.598125 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-45d6a610-ada3-4864-9263-cc53e59f6e4f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:21.608054 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0fe67627-0caf-48fd-9cbe-ff98f6bc442f tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:21.610223 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0fe67627-0caf-48fd-9cbe-ff98f6bc442f tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:21.611926 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-45d6a610-ada3-4864-9263-cc53e59f6e4f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd" status: 200 len: 1341 microversion: 2.1 time: 0.384592 Aug 31 16:29:21.612643 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0fe67627-0caf-48fd-9cbe-ff98f6bc442f tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:21.619437 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0fe67627-0caf-48fd-9cbe-ff98f6bc442f tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:21.619941 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0fe67627-0caf-48fd-9cbe-ff98f6bc442f tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:21.620392 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0fe67627-0caf-48fd-9cbe-ff98f6bc442f tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:21.624028 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3241/6297] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:21 2022] GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd => generated 1341 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:21.941172 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-34c2b17e-8933-4855-a4f0-fa102b4d2abe tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:21.943554 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-34c2b17e-8933-4855-a4f0-fa102b4d2abe tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 6e296817-752b-4ef9-812b-882268796473] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:21.952654 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-34c2b17e-8933-4855-a4f0-fa102b4d2abe tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:21.954491 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-34c2b17e-8933-4855-a4f0-fa102b4d2abe tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:21.958829 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-34c2b17e-8933-4855-a4f0-fa102b4d2abe tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:21.960406 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-34c2b17e-8933-4855-a4f0-fa102b4d2abe tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:21.961385 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-34c2b17e-8933-4855-a4f0-fa102b4d2abe tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:21.962172 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-34c2b17e-8933-4855-a4f0-fa102b4d2abe tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:21.963340 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0fe67627-0caf-48fd-9cbe-ff98f6bc442f tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144faa1806d54274812544c5d10cdb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad41f7866b841cf8e28f9e6229ae6c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:21.976606 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0fe67627-0caf-48fd-9cbe-ff98f6bc442f tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] 10.222.0.50 "GET /compute/v2.1/servers/765b5be3-ebb2-42b1-8c42-84ae59be3505" status: 200 len: 1314 microversion: 2.1 time: 0.386601 Aug 31 16:29:21.977310 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3057/6298] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:21 2022] GET /compute/v2.1/servers/765b5be3-ebb2-42b1-8c42-84ae59be3505 => generated 1314 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:29:22.015855 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-4b868cde-e07d-4051-a2a8-6eedea47455b req-efd35b6f-172a-4217-881c-d16599229735 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "765b5be3-ebb2-42b1-8c42-84ae59be3505", "name": "network-vif-plugged", "status": "completed", "tag": "4b35ea41-1a70-4073-b45f-7384866c803f"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:29:22.023781 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-34c2b17e-8933-4855-a4f0-fa102b4d2abe tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473/os-volume_attachments/359daa73-f497-4cfe-89c9-52af7ac38a7a" status: 200 len: 194 microversion: 2.1 time: 0.090840 Aug 31 16:29:22.032859 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3242/6299] 10.222.0.50 () {58 vars in 1413 bytes} [Wed Aug 31 16:29:21 2022] GET /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473/os-volume_attachments/359daa73-f497-4cfe-89c9-52af7ac38a7a => generated 194 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:29:22.040964 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1d7c0e4e-ffbb-421a-9c45-12c3237df8f4 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:22.041807 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1d7c0e4e-ffbb-421a-9c45-12c3237df8f4 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 6e296817-752b-4ef9-812b-882268796473] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:22.045393 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4b868cde-e07d-4051-a2a8-6eedea47455b req-efd35b6f-172a-4217-881c-d16599229735 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:22.046062 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4b868cde-e07d-4051-a2a8-6eedea47455b req-efd35b6f-172a-4217-881c-d16599229735 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:22.047524 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4b868cde-e07d-4051-a2a8-6eedea47455b req-efd35b6f-172a-4217-881c-d16599229735 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:22.051345 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1d7c0e4e-ffbb-421a-9c45-12c3237df8f4 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:22.052029 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1d7c0e4e-ffbb-421a-9c45-12c3237df8f4 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:22.053274 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1d7c0e4e-ffbb-421a-9c45-12c3237df8f4 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:22.054886 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1d7c0e4e-ffbb-421a-9c45-12c3237df8f4 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:22.055782 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1d7c0e4e-ffbb-421a-9c45-12c3237df8f4 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:22.056574 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1d7c0e4e-ffbb-421a-9c45-12c3237df8f4 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:22.065477 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-4b868cde-e07d-4051-a2a8-6eedea47455b req-efd35b6f-172a-4217-881c-d16599229735 service nova] Creating event network-vif-plugged:4b35ea41-1a70-4073-b45f-7384866c803f for instance 765b5be3-ebb2-42b1-8c42-84ae59be3505 on n-h1-833090-16 Aug 31 16:29:22.071776 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-4b868cde-e07d-4051-a2a8-6eedea47455b req-efd35b6f-172a-4217-881c-d16599229735 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070740 Aug 31 16:29:22.072796 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3058/6300] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:29:22.202455 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-1d7c0e4e-ffbb-421a-9c45-12c3237df8f4 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lazy-loading 'services' on Instance uuid 6e296817-752b-4ef9-812b-882268796473 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:29:22.342455 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1d7c0e4e-ffbb-421a-9c45-12c3237df8f4 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "DELETE /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473/os-volume_attachments/359daa73-f497-4cfe-89c9-52af7ac38a7a" status: 202 len: 0 microversion: 2.1 time: 0.307641 Aug 31 16:29:22.343378 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3243/6301] 10.222.0.50 () {58 vars in 1416 bytes} [Wed Aug 31 16:29:22 2022] DELETE /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473/os-volume_attachments/359daa73-f497-4cfe-89c9-52af7ac38a7a => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:29:22.643727 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2f26caca-4ebf-429e-9ac3-bedd80178711 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:22.644449 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2f26caca-4ebf-429e-9ac3-bedd80178711 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:22.657195 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2f26caca-4ebf-429e-9ac3-bedd80178711 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:22.657687 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2f26caca-4ebf-429e-9ac3-bedd80178711 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:22.658139 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2f26caca-4ebf-429e-9ac3-bedd80178711 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:22.659046 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2f26caca-4ebf-429e-9ac3-bedd80178711 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:22.659693 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2f26caca-4ebf-429e-9ac3-bedd80178711 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:22.660112 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2f26caca-4ebf-429e-9ac3-bedd80178711 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:22.920600 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2f26caca-4ebf-429e-9ac3-bedd80178711 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:22.939661 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2f26caca-4ebf-429e-9ac3-bedd80178711 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd" status: 200 len: 1341 microversion: 2.1 time: 0.308120 Aug 31 16:29:22.940270 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3059/6302] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:22 2022] GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd => generated 1341 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:23.006058 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8efcaa38-95da-4563-8556-63a70ff6bd4f tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:23.007078 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8efcaa38-95da-4563-8556-63a70ff6bd4f tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] [instance: 765b5be3-ebb2-42b1-8c42-84ae59be3505] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:23.015615 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8efcaa38-95da-4563-8556-63a70ff6bd4f tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:23.016126 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8efcaa38-95da-4563-8556-63a70ff6bd4f tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:23.016586 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8efcaa38-95da-4563-8556-63a70ff6bd4f tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:23.017305 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8efcaa38-95da-4563-8556-63a70ff6bd4f tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:23.017773 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8efcaa38-95da-4563-8556-63a70ff6bd4f tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:23.018269 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8efcaa38-95da-4563-8556-63a70ff6bd4f tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:23.323138 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8efcaa38-95da-4563-8556-63a70ff6bd4f tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144faa1806d54274812544c5d10cdb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad41f7866b841cf8e28f9e6229ae6c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:23.341645 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8efcaa38-95da-4563-8556-63a70ff6bd4f tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] 10.222.0.50 "GET /compute/v2.1/servers/765b5be3-ebb2-42b1-8c42-84ae59be3505" status: 200 len: 1314 microversion: 2.1 time: 0.341290 Aug 31 16:29:23.343451 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3244/6303] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:22 2022] GET /compute/v2.1/servers/765b5be3-ebb2-42b1-8c42-84ae59be3505 => generated 1314 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:23.962903 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2c88e293-2be2-4507-850c-606d12496c13 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:23.964812 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2c88e293-2be2-4507-850c-606d12496c13 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:23.973572 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c88e293-2be2-4507-850c-606d12496c13 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:23.974553 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c88e293-2be2-4507-850c-606d12496c13 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:23.975279 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c88e293-2be2-4507-850c-606d12496c13 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:23.976813 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c88e293-2be2-4507-850c-606d12496c13 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:23.977577 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c88e293-2be2-4507-850c-606d12496c13 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:23.979319 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c88e293-2be2-4507-850c-606d12496c13 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:24.307973 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2c88e293-2be2-4507-850c-606d12496c13 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:24.325050 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2c88e293-2be2-4507-850c-606d12496c13 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd" status: 200 len: 1341 microversion: 2.1 time: 0.367401 Aug 31 16:29:24.327683 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3060/6304] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:23 2022] GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd => generated 1341 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:24.366133 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-058a37bc-6c9f-4e7c-b900-65496724c979 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:24.366727 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-058a37bc-6c9f-4e7c-b900-65496724c979 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] [instance: 765b5be3-ebb2-42b1-8c42-84ae59be3505] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:24.385557 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-058a37bc-6c9f-4e7c-b900-65496724c979 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:24.391037 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-058a37bc-6c9f-4e7c-b900-65496724c979 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:24.391694 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-058a37bc-6c9f-4e7c-b900-65496724c979 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:24.392904 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-058a37bc-6c9f-4e7c-b900-65496724c979 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:24.394059 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-058a37bc-6c9f-4e7c-b900-65496724c979 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:24.395179 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-058a37bc-6c9f-4e7c-b900-65496724c979 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:24.729788 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-058a37bc-6c9f-4e7c-b900-65496724c979 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144faa1806d54274812544c5d10cdb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad41f7866b841cf8e28f9e6229ae6c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:24.752410 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-058a37bc-6c9f-4e7c-b900-65496724c979 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] 10.222.0.50 "GET /compute/v2.1/servers/765b5be3-ebb2-42b1-8c42-84ae59be3505" status: 200 len: 1499 microversion: 2.1 time: 0.388026 Aug 31 16:29:24.793759 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3245/6305] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:24 2022] GET /compute/v2.1/servers/765b5be3-ebb2-42b1-8c42-84ae59be3505 => generated 1499 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:25.354723 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7222c138-7817-4ca5-8d4f-71047126073a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:25.356069 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7222c138-7817-4ca5-8d4f-71047126073a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:25.376127 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7222c138-7817-4ca5-8d4f-71047126073a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:25.376631 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7222c138-7817-4ca5-8d4f-71047126073a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:25.383241 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7222c138-7817-4ca5-8d4f-71047126073a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:25.392496 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7222c138-7817-4ca5-8d4f-71047126073a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:25.393386 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7222c138-7817-4ca5-8d4f-71047126073a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:25.393876 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7222c138-7817-4ca5-8d4f-71047126073a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:25.865939 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7222c138-7817-4ca5-8d4f-71047126073a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:25.885463 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7222c138-7817-4ca5-8d4f-71047126073a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd" status: 200 len: 1387 microversion: 2.1 time: 0.535648 Aug 31 16:29:25.886479 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3061/6306] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:25 2022] GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd => generated 1387 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:26.562768 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-352ba5c9-729e-4f47-a57b-04255b799edf tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:26.563833 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-352ba5c9-729e-4f47-a57b-04255b799edf tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] [instance: 765b5be3-ebb2-42b1-8c42-84ae59be3505] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:26.576617 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-352ba5c9-729e-4f47-a57b-04255b799edf tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:26.577446 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-352ba5c9-729e-4f47-a57b-04255b799edf tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:26.578178 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-352ba5c9-729e-4f47-a57b-04255b799edf tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:26.579237 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-352ba5c9-729e-4f47-a57b-04255b799edf tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:26.579859 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-352ba5c9-729e-4f47-a57b-04255b799edf tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:26.581522 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-352ba5c9-729e-4f47-a57b-04255b799edf tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:26.637333 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-352ba5c9-729e-4f47-a57b-04255b799edf tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] [instance: 765b5be3-ebb2-42b1-8c42-84ae59be3505] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:29:26.734573 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:29:26.830934 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-352ba5c9-729e-4f47-a57b-04255b799edf tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] 10.222.0.50 "DELETE /compute/v2.1/servers/765b5be3-ebb2-42b1-8c42-84ae59be3505" status: 204 len: 0 microversion: 2.1 time: 0.268922 Aug 31 16:29:26.832023 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3246/6307] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:29:26 2022] DELETE /compute/v2.1/servers/765b5be3-ebb2-42b1-8c42-84ae59be3505 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:29:26.841640 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-099ecc59-aca3-4bd6-9830-4021059e43dc tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:26.842740 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-099ecc59-aca3-4bd6-9830-4021059e43dc tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] [instance: 765b5be3-ebb2-42b1-8c42-84ae59be3505] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:26.853905 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-099ecc59-aca3-4bd6-9830-4021059e43dc tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:26.856619 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-099ecc59-aca3-4bd6-9830-4021059e43dc tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:26.860308 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-099ecc59-aca3-4bd6-9830-4021059e43dc tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:26.864888 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-099ecc59-aca3-4bd6-9830-4021059e43dc tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:26.867556 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-099ecc59-aca3-4bd6-9830-4021059e43dc tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:26.868436 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-099ecc59-aca3-4bd6-9830-4021059e43dc tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:26.913449 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0c6b4f74-3c69-42b1-8651-1c782f38ebe1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:26.914611 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0c6b4f74-3c69-42b1-8651-1c782f38ebe1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:26.935510 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0c6b4f74-3c69-42b1-8651-1c782f38ebe1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:26.936370 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0c6b4f74-3c69-42b1-8651-1c782f38ebe1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:26.936994 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0c6b4f74-3c69-42b1-8651-1c782f38ebe1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:26.937927 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0c6b4f74-3c69-42b1-8651-1c782f38ebe1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:26.938784 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0c6b4f74-3c69-42b1-8651-1c782f38ebe1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:26.939466 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0c6b4f74-3c69-42b1-8651-1c782f38ebe1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:27.166083 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-099ecc59-aca3-4bd6-9830-4021059e43dc tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144faa1806d54274812544c5d10cdb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad41f7866b841cf8e28f9e6229ae6c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:27.180215 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-099ecc59-aca3-4bd6-9830-4021059e43dc tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] 10.222.0.50 "GET /compute/v2.1/servers/765b5be3-ebb2-42b1-8c42-84ae59be3505" status: 200 len: 1505 microversion: 2.1 time: 0.342801 Aug 31 16:29:27.181425 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3062/6308] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:26 2022] GET /compute/v2.1/servers/765b5be3-ebb2-42b1-8c42-84ae59be3505 => generated 1505 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:27.231752 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0c6b4f74-3c69-42b1-8651-1c782f38ebe1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:27.246002 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0c6b4f74-3c69-42b1-8651-1c782f38ebe1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd" status: 200 len: 1375 microversion: 2.1 time: 0.338013 Aug 31 16:29:27.248869 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3247/6309] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:26 2022] GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd => generated 1375 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:28.202983 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-905719dc-d91c-43c7-9e87-226ab5e823c1 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:28.203593 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-905719dc-d91c-43c7-9e87-226ab5e823c1 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] [instance: 765b5be3-ebb2-42b1-8c42-84ae59be3505] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:28.218017 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-905719dc-d91c-43c7-9e87-226ab5e823c1 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:28.218557 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-905719dc-d91c-43c7-9e87-226ab5e823c1 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:28.219013 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-905719dc-d91c-43c7-9e87-226ab5e823c1 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:28.219747 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-905719dc-d91c-43c7-9e87-226ab5e823c1 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:28.220206 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-905719dc-d91c-43c7-9e87-226ab5e823c1 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:28.220630 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-905719dc-d91c-43c7-9e87-226ab5e823c1 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:28.226752 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:29:28.292091 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0868ab79-6737-4be8-b99b-9f44904e8ba9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:28.293144 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0868ab79-6737-4be8-b99b-9f44904e8ba9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:28.309474 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0868ab79-6737-4be8-b99b-9f44904e8ba9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:28.309992 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0868ab79-6737-4be8-b99b-9f44904e8ba9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:28.313524 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0868ab79-6737-4be8-b99b-9f44904e8ba9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:28.314391 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0868ab79-6737-4be8-b99b-9f44904e8ba9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:28.314904 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0868ab79-6737-4be8-b99b-9f44904e8ba9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:28.318466 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0868ab79-6737-4be8-b99b-9f44904e8ba9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:28.828279 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-905719dc-d91c-43c7-9e87-226ab5e823c1 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144faa1806d54274812544c5d10cdb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad41f7866b841cf8e28f9e6229ae6c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:28.837956 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-905719dc-d91c-43c7-9e87-226ab5e823c1 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] 10.222.0.50 "GET /compute/v2.1/servers/765b5be3-ebb2-42b1-8c42-84ae59be3505" status: 200 len: 1505 microversion: 2.1 time: 0.638790 Aug 31 16:29:28.838605 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3063/6310] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:28 2022] GET /compute/v2.1/servers/765b5be3-ebb2-42b1-8c42-84ae59be3505 => generated 1505 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:28.892581 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0868ab79-6737-4be8-b99b-9f44904e8ba9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:28.905512 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0868ab79-6737-4be8-b99b-9f44904e8ba9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd" status: 200 len: 1375 microversion: 2.1 time: 0.620489 Aug 31 16:29:28.911266 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3248/6311] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:28 2022] GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd => generated 1375 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:29.438450 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-952488ea-a766-4ab1-8262-3c77181283e6 req-9528e73a-9967-4d03-bb71-d011d25f0f7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "765b5be3-ebb2-42b1-8c42-84ae59be3505", "name": "network-vif-deleted", "tag": "4b35ea41-1a70-4073-b45f-7384866c803f"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:29:29.486904 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-952488ea-a766-4ab1-8262-3c77181283e6 req-9528e73a-9967-4d03-bb71-d011d25f0f7f service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:29.488056 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-952488ea-a766-4ab1-8262-3c77181283e6 req-9528e73a-9967-4d03-bb71-d011d25f0f7f service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:29.489860 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-952488ea-a766-4ab1-8262-3c77181283e6 req-9528e73a-9967-4d03-bb71-d011d25f0f7f service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:29.531101 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-952488ea-a766-4ab1-8262-3c77181283e6 req-9528e73a-9967-4d03-bb71-d011d25f0f7f service nova] Creating event network-vif-deleted:4b35ea41-1a70-4073-b45f-7384866c803f for instance 765b5be3-ebb2-42b1-8c42-84ae59be3505 on n-h1-833090-16 Aug 31 16:29:29.547940 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-952488ea-a766-4ab1-8262-3c77181283e6 req-9528e73a-9967-4d03-bb71-d011d25f0f7f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113921 Aug 31 16:29:29.548583 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3064/6312] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:29:29.868598 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7a6fef4b-a817-44dd-be2b-bef73741a928 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:29.870841 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7a6fef4b-a817-44dd-be2b-bef73741a928 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] [instance: 765b5be3-ebb2-42b1-8c42-84ae59be3505] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:29.893945 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7a6fef4b-a817-44dd-be2b-bef73741a928 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:29.899752 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7a6fef4b-a817-44dd-be2b-bef73741a928 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:29.900236 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7a6fef4b-a817-44dd-be2b-bef73741a928 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:29.901015 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7a6fef4b-a817-44dd-be2b-bef73741a928 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:29.901507 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7a6fef4b-a817-44dd-be2b-bef73741a928 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:29.912803 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7a6fef4b-a817-44dd-be2b-bef73741a928 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:29.929985 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e482d729-ab7f-45d3-a320-4955d4bffba5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:29.930751 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e482d729-ab7f-45d3-a320-4955d4bffba5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:29.949899 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e482d729-ab7f-45d3-a320-4955d4bffba5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:29.950751 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e482d729-ab7f-45d3-a320-4955d4bffba5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:29.951533 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e482d729-ab7f-45d3-a320-4955d4bffba5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:29.952435 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e482d729-ab7f-45d3-a320-4955d4bffba5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:29.953046 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e482d729-ab7f-45d3-a320-4955d4bffba5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:29.956882 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e482d729-ab7f-45d3-a320-4955d4bffba5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:30.040352 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7a6fef4b-a817-44dd-be2b-bef73741a928 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:30.041765 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7a6fef4b-a817-44dd-be2b-bef73741a928 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:30.042408 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7a6fef4b-a817-44dd-be2b-bef73741a928 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:30.043995 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-7a6fef4b-a817-44dd-be2b-bef73741a928 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lazy-loading 'fault' on Instance uuid 765b5be3-ebb2-42b1-8c42-84ae59be3505 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:29:30.452641 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e482d729-ab7f-45d3-a320-4955d4bffba5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:30.458422 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7a6fef4b-a817-44dd-be2b-bef73741a928 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '144faa1806d54274812544c5d10cdb0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad41f7866b841cf8e28f9e6229ae6c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:30.475452 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e482d729-ab7f-45d3-a320-4955d4bffba5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd" status: 200 len: 1375 microversion: 2.1 time: 0.549846 Aug 31 16:29:30.484255 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7a6fef4b-a817-44dd-be2b-bef73741a928 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] 10.222.0.50 "GET /compute/v2.1/servers/765b5be3-ebb2-42b1-8c42-84ae59be3505" status: 200 len: 1304 microversion: 2.1 time: 0.621647 Aug 31 16:29:30.485190 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3065/6313] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:29 2022] GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd => generated 1375 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:30.485428 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3249/6314] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:29 2022] GET /compute/v2.1/servers/765b5be3-ebb2-42b1-8c42-84ae59be3505 => generated 1304 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:31.505711 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-88ea313f-3a9e-4657-a038-51a9f513c868 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:31.513808 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1821a41a-e7ab-4d06-985e-53152c01e5d6 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:31.514426 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-88ea313f-3a9e-4657-a038-51a9f513c868 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:31.523139 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1821a41a-e7ab-4d06-985e-53152c01e5d6 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] [instance: 765b5be3-ebb2-42b1-8c42-84ae59be3505] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:31.549620 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1821a41a-e7ab-4d06-985e-53152c01e5d6 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:31.552976 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-88ea313f-3a9e-4657-a038-51a9f513c868 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:31.553851 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1821a41a-e7ab-4d06-985e-53152c01e5d6 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:31.554514 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1821a41a-e7ab-4d06-985e-53152c01e5d6 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:31.555217 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-88ea313f-3a9e-4657-a038-51a9f513c868 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:31.556162 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1821a41a-e7ab-4d06-985e-53152c01e5d6 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:31.556819 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-88ea313f-3a9e-4657-a038-51a9f513c868 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:31.557759 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-88ea313f-3a9e-4657-a038-51a9f513c868 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:31.558851 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1821a41a-e7ab-4d06-985e-53152c01e5d6 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:31.560736 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-88ea313f-3a9e-4657-a038-51a9f513c868 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:31.561439 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1821a41a-e7ab-4d06-985e-53152c01e5d6 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:31.570162 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-88ea313f-3a9e-4657-a038-51a9f513c868 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:31.632228 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-1821a41a-e7ab-4d06-985e-53152c01e5d6 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] HTTP exception thrown: Instance 765b5be3-ebb2-42b1-8c42-84ae59be3505 could not be found. Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1821a41a-e7ab-4d06-985e-53152c01e5d6 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Request method failure captured: Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/765b5be3-ebb2-42b1-8c42-84ae59be3505 HTTP/1.1 Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4w82X7UZTN9c57fJdclv4xDmMjF8qiCzqw4_m8gmJby-s4swncLwYBSKcUKjGhoRmJLtfMoiE24VOK8ZkjK8PEzmTKaGTWeJcNrcznnJbQIQK0mNIOPE3iprZst8qIsDFWlXvjGf2qaUT9N8x-OpJtw8bMy-VhEYyCi-ZgSzhc3n5Q Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: aad41f7866b841cf8e28f9e6229ae6c3 Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-VolumesActionsTest-1219421304 Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/aad41f7866b841cf8e28f9e6229ae6c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/aad41f7866b841cf8e28f9e6229ae6c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/aad41f7866b841cf8e28f9e6229ae6c3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_aad41f7866b841cf8e28f9e6229ae6c3", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-VolumesActionsTest-1219421304 Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: aad41f7866b841cf8e28f9e6229ae6c3 Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-VolumesActionsTest-1219421304 Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-VolumesActionsTest-1219421304-project Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 144faa1806d54274812544c5d10cdb0e Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-VolumesActionsTest-1219421304-project Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 765b5be3-ebb2-42b1-8c42-84ae59be3505 could not be found. Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '765b5be3-ebb2-42b1-8c42-84ae59be3505'} Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 765b5be3-ebb2-42b1-8c42-84ae59be3505 could not be found. Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 765b5be3-ebb2-42b1-8c42-84ae59be3505 could not be found. Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:29:31.637594 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:29:31.647200 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:29:31.647200 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:29:31.647200 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:29:31.647200 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:29:31.647200 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:29:31.647200 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 765b5be3-ebb2-42b1-8c42-84ae59be3505 could not be found. Aug 31 16:29:31.647200 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:29:31.648610 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1821a41a-e7ab-4d06-985e-53152c01e5d6 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] Returning 404 to user: Instance 765b5be3-ebb2-42b1-8c42-84ae59be3505 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:29:31.648858 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1821a41a-e7ab-4d06-985e-53152c01e5d6 tempest-VolumesActionsTest-1219421304 tempest-VolumesActionsTest-1219421304-project] 10.222.0.50 "GET /compute/v2.1/servers/765b5be3-ebb2-42b1-8c42-84ae59be3505" status: 404 len: 111 microversion: 2.1 time: 0.141253 Aug 31 16:29:31.650545 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3066/6315] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:31 2022] GET /compute/v2.1/servers/765b5be3-ebb2-42b1-8c42-84ae59be3505 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:29:31.899645 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-88ea313f-3a9e-4657-a038-51a9f513c868 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:31.936197 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-88ea313f-3a9e-4657-a038-51a9f513c868 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd" status: 200 len: 1375 microversion: 2.1 time: 0.433047 Aug 31 16:29:31.937310 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3250/6316] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:31 2022] GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd => generated 1375 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:32.959373 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-476f61e7-2183-4785-b74e-3bd20f13ab54 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:32.960609 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-476f61e7-2183-4785-b74e-3bd20f13ab54 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:32.973723 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-476f61e7-2183-4785-b74e-3bd20f13ab54 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:32.989347 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-476f61e7-2183-4785-b74e-3bd20f13ab54 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:32.992405 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-476f61e7-2183-4785-b74e-3bd20f13ab54 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:32.996175 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-476f61e7-2183-4785-b74e-3bd20f13ab54 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:33.000732 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-476f61e7-2183-4785-b74e-3bd20f13ab54 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:33.001505 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-476f61e7-2183-4785-b74e-3bd20f13ab54 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:33.420267 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-476f61e7-2183-4785-b74e-3bd20f13ab54 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:33.436050 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-476f61e7-2183-4785-b74e-3bd20f13ab54 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd" status: 200 len: 1375 microversion: 2.1 time: 0.481236 Aug 31 16:29:33.441429 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3067/6317] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:32 2022] GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd => generated 1375 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:33.471804 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0d2d5e1a-1cbe-469f-b5b7-a84abded5830 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:33.475629 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0d2d5e1a-1cbe-469f-b5b7-a84abded5830 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 6e296817-752b-4ef9-812b-882268796473] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:33.484802 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0d2d5e1a-1cbe-469f-b5b7-a84abded5830 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:33.485589 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0d2d5e1a-1cbe-469f-b5b7-a84abded5830 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:33.487114 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0d2d5e1a-1cbe-469f-b5b7-a84abded5830 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:33.488134 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0d2d5e1a-1cbe-469f-b5b7-a84abded5830 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:33.488873 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0d2d5e1a-1cbe-469f-b5b7-a84abded5830 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:33.489613 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0d2d5e1a-1cbe-469f-b5b7-a84abded5830 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:33.547634 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0d2d5e1a-1cbe-469f-b5b7-a84abded5830 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.080013 Aug 31 16:29:33.556495 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3251/6318] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:29:33 2022] GET /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473/os-volume_attachments => generated 25 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:29:33.730032 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fe923537-ac29-4f9e-aafe-a3ff44aba502 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:33.733116 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fe923537-ac29-4f9e-aafe-a3ff44aba502 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 6e296817-752b-4ef9-812b-882268796473] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:33.748643 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe923537-ac29-4f9e-aafe-a3ff44aba502 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:33.749304 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe923537-ac29-4f9e-aafe-a3ff44aba502 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:33.749836 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe923537-ac29-4f9e-aafe-a3ff44aba502 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:33.750670 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe923537-ac29-4f9e-aafe-a3ff44aba502 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:33.751218 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe923537-ac29-4f9e-aafe-a3ff44aba502 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:33.752401 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe923537-ac29-4f9e-aafe-a3ff44aba502 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:33.814623 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fe923537-ac29-4f9e-aafe-a3ff44aba502 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.089064 Aug 31 16:29:33.820464 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3068/6319] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:29:33 2022] GET /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473/os-volume_attachments => generated 25 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 16:29:33.948079 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-31c9f0c9-a934-4fc1-8b76-9aee17e51017 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:33.948668 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-31c9f0c9-a934-4fc1-8b76-9aee17e51017 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 6e296817-752b-4ef9-812b-882268796473] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:33.959514 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-31c9f0c9-a934-4fc1-8b76-9aee17e51017 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:33.967911 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-31c9f0c9-a934-4fc1-8b76-9aee17e51017 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:33.968933 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-31c9f0c9-a934-4fc1-8b76-9aee17e51017 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:33.973228 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-31c9f0c9-a934-4fc1-8b76-9aee17e51017 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:33.974021 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-31c9f0c9-a934-4fc1-8b76-9aee17e51017 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:33.974768 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-31c9f0c9-a934-4fc1-8b76-9aee17e51017 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:34.044002 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-31c9f0c9-a934-4fc1-8b76-9aee17e51017 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 6e296817-752b-4ef9-812b-882268796473] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:29:34.201992 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-31c9f0c9-a934-4fc1-8b76-9aee17e51017 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "DELETE /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473" status: 204 len: 0 microversion: 2.1 time: 0.258425 Aug 31 16:29:34.211889 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3252/6320] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:29:33 2022] DELETE /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:29:34.225232 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4a985839-44d1-4232-b05f-7200f478e3cd tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:34.226722 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4a985839-44d1-4232-b05f-7200f478e3cd tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 6e296817-752b-4ef9-812b-882268796473] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:34.248855 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a985839-44d1-4232-b05f-7200f478e3cd tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:34.250743 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a985839-44d1-4232-b05f-7200f478e3cd tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:34.253401 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a985839-44d1-4232-b05f-7200f478e3cd tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:34.260432 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a985839-44d1-4232-b05f-7200f478e3cd tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:34.262997 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a985839-44d1-4232-b05f-7200f478e3cd tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:34.263726 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a985839-44d1-4232-b05f-7200f478e3cd tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:34.473739 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-25896e05-3271-4e51-82f3-a6ddd44c2095 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:34.475256 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-25896e05-3271-4e51-82f3-a6ddd44c2095 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:34.489502 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-25896e05-3271-4e51-82f3-a6ddd44c2095 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:34.495233 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-25896e05-3271-4e51-82f3-a6ddd44c2095 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:34.495893 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-25896e05-3271-4e51-82f3-a6ddd44c2095 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:34.496773 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-25896e05-3271-4e51-82f3-a6ddd44c2095 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:34.497495 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-25896e05-3271-4e51-82f3-a6ddd44c2095 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:34.499634 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-25896e05-3271-4e51-82f3-a6ddd44c2095 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:34.838377 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4a985839-44d1-4232-b05f-7200f478e3cd tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:34.852068 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4a985839-44d1-4232-b05f-7200f478e3cd tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473" status: 200 len: 1673 microversion: 2.1 time: 0.632856 Aug 31 16:29:34.852774 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3069/6321] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:34 2022] GET /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473 => generated 1673 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:34.988646 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-25896e05-3271-4e51-82f3-a6ddd44c2095 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:35.002616 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-25896e05-3271-4e51-82f3-a6ddd44c2095 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd" status: 200 len: 1375 microversion: 2.1 time: 0.533020 Aug 31 16:29:35.004458 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3253/6322] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:34 2022] GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd => generated 1375 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:35.873890 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f7113c79-5d55-4a05-8450-8f4ff8a75b66 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:35.877897 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f7113c79-5d55-4a05-8450-8f4ff8a75b66 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 6e296817-752b-4ef9-812b-882268796473] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:35.895464 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7113c79-5d55-4a05-8450-8f4ff8a75b66 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:35.896248 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7113c79-5d55-4a05-8450-8f4ff8a75b66 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:35.897340 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7113c79-5d55-4a05-8450-8f4ff8a75b66 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:35.898698 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7113c79-5d55-4a05-8450-8f4ff8a75b66 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:35.899382 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7113c79-5d55-4a05-8450-8f4ff8a75b66 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:35.900010 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f7113c79-5d55-4a05-8450-8f4ff8a75b66 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:36.029920 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3e92d952-248d-4945-90e3-9b8058bcebf7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:36.032572 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3e92d952-248d-4945-90e3-9b8058bcebf7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:36.080194 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3e92d952-248d-4945-90e3-9b8058bcebf7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:36.080979 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3e92d952-248d-4945-90e3-9b8058bcebf7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:36.081620 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3e92d952-248d-4945-90e3-9b8058bcebf7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:36.082647 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3e92d952-248d-4945-90e3-9b8058bcebf7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:36.083586 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3e92d952-248d-4945-90e3-9b8058bcebf7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:36.084336 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3e92d952-248d-4945-90e3-9b8058bcebf7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:36.449670 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f7113c79-5d55-4a05-8450-8f4ff8a75b66 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:36.467401 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3e92d952-248d-4945-90e3-9b8058bcebf7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:36.479203 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f7113c79-5d55-4a05-8450-8f4ff8a75b66 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473" status: 200 len: 1673 microversion: 2.1 time: 0.609789 Aug 31 16:29:36.481394 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3e92d952-248d-4945-90e3-9b8058bcebf7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd" status: 200 len: 1375 microversion: 2.1 time: 0.456502 Aug 31 16:29:36.482047 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3254/6324] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:36 2022] GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd => generated 1375 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:36.482283 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3070/6324] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:35 2022] GET /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473 => generated 1673 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:37.513767 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-828afbfb-2c5c-4cd9-bc47-5d1c48d15944 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:37.514432 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-828afbfb-2c5c-4cd9-bc47-5d1c48d15944 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 6e296817-752b-4ef9-812b-882268796473] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:37.523540 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e17ebbc6-c29d-4e91-8eff-1c7a85f15666 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:37.524167 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e17ebbc6-c29d-4e91-8eff-1c7a85f15666 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:37.531820 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e17ebbc6-c29d-4e91-8eff-1c7a85f15666 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:37.532791 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-828afbfb-2c5c-4cd9-bc47-5d1c48d15944 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:37.533275 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e17ebbc6-c29d-4e91-8eff-1c7a85f15666 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:37.534043 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-828afbfb-2c5c-4cd9-bc47-5d1c48d15944 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:37.534717 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e17ebbc6-c29d-4e91-8eff-1c7a85f15666 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:37.535639 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e17ebbc6-c29d-4e91-8eff-1c7a85f15666 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:37.536299 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-828afbfb-2c5c-4cd9-bc47-5d1c48d15944 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:37.538603 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-828afbfb-2c5c-4cd9-bc47-5d1c48d15944 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:37.539421 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-828afbfb-2c5c-4cd9-bc47-5d1c48d15944 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:37.539687 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e17ebbc6-c29d-4e91-8eff-1c7a85f15666 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:37.540709 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e17ebbc6-c29d-4e91-8eff-1c7a85f15666 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:37.542859 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-828afbfb-2c5c-4cd9-bc47-5d1c48d15944 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:37.963742 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-828afbfb-2c5c-4cd9-bc47-5d1c48d15944 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:37.968497 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e17ebbc6-c29d-4e91-8eff-1c7a85f15666 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:37.986378 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e17ebbc6-c29d-4e91-8eff-1c7a85f15666 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd" status: 200 len: 1375 microversion: 2.1 time: 0.479834 Aug 31 16:29:37.991102 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-828afbfb-2c5c-4cd9-bc47-5d1c48d15944 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473" status: 200 len: 1673 microversion: 2.1 time: 0.487667 Aug 31 16:29:37.993106 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3071/6325] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:37 2022] GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd => generated 1375 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:37.993961 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3255/6326] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:37 2022] GET /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473 => generated 1673 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:39.022172 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-db651d96-6271-46b8-a345-ff5308e9c08f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:39.023212 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-db651d96-6271-46b8-a345-ff5308e9c08f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 6e296817-752b-4ef9-812b-882268796473] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:39.026247 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fb8772da-0132-445d-ae8d-c93b4ea601af tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:39.027199 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fb8772da-0132-445d-ae8d-c93b4ea601af tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:39.063694 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb8772da-0132-445d-ae8d-c93b4ea601af tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:39.064188 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb8772da-0132-445d-ae8d-c93b4ea601af tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:39.066038 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db651d96-6271-46b8-a345-ff5308e9c08f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:39.069827 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb8772da-0132-445d-ae8d-c93b4ea601af tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:39.070234 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db651d96-6271-46b8-a345-ff5308e9c08f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:39.071577 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb8772da-0132-445d-ae8d-c93b4ea601af tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:39.071948 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db651d96-6271-46b8-a345-ff5308e9c08f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:39.074373 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db651d96-6271-46b8-a345-ff5308e9c08f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:39.074870 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db651d96-6271-46b8-a345-ff5308e9c08f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:39.076108 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb8772da-0132-445d-ae8d-c93b4ea601af tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:39.078738 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb8772da-0132-445d-ae8d-c93b4ea601af tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:39.080816 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db651d96-6271-46b8-a345-ff5308e9c08f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:39.343493 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-db651d96-6271-46b8-a345-ff5308e9c08f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:39.353573 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-db651d96-6271-46b8-a345-ff5308e9c08f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473" status: 200 len: 1606 microversion: 2.1 time: 0.341401 Aug 31 16:29:39.359258 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3256/6327] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:39 2022] GET /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473 => generated 1606 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:39.492648 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fb8772da-0132-445d-ae8d-c93b4ea601af tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:39.501660 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fb8772da-0132-445d-ae8d-c93b4ea601af tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd" status: 200 len: 1375 microversion: 2.1 time: 0.492732 Aug 31 16:29:39.503615 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3072/6328] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:39 2022] GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd => generated 1375 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:39.761655 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-853c8e32-df7c-4662-aed8-02eda2a5e2a2 req-23998eae-a287-4626-9347-9a589ccc2f0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e296817-752b-4ef9-812b-882268796473", "name": "network-vif-deleted", "tag": "5901bbb7-215f-4339-8d62-cf9aa9918acf"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:29:39.792751 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-853c8e32-df7c-4662-aed8-02eda2a5e2a2 req-23998eae-a287-4626-9347-9a589ccc2f0b service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:39.795400 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-853c8e32-df7c-4662-aed8-02eda2a5e2a2 req-23998eae-a287-4626-9347-9a589ccc2f0b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:39.798702 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-853c8e32-df7c-4662-aed8-02eda2a5e2a2 req-23998eae-a287-4626-9347-9a589ccc2f0b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:39.832546 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-853c8e32-df7c-4662-aed8-02eda2a5e2a2 req-23998eae-a287-4626-9347-9a589ccc2f0b service nova] Creating event network-vif-deleted:5901bbb7-215f-4339-8d62-cf9aa9918acf for instance 6e296817-752b-4ef9-812b-882268796473 on n-h2-833090-16 Aug 31 16:29:39.859993 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-853c8e32-df7c-4662-aed8-02eda2a5e2a2 req-23998eae-a287-4626-9347-9a589ccc2f0b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098918 Aug 31 16:29:39.865064 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3257/6329] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:29:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:29:40.380160 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-069fc90f-d2d8-4e08-b51e-96a48977cfa0 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:40.382153 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-069fc90f-d2d8-4e08-b51e-96a48977cfa0 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 6e296817-752b-4ef9-812b-882268796473] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:40.401654 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-069fc90f-d2d8-4e08-b51e-96a48977cfa0 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:40.418938 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-069fc90f-d2d8-4e08-b51e-96a48977cfa0 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:40.423176 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-069fc90f-d2d8-4e08-b51e-96a48977cfa0 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:40.427333 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-069fc90f-d2d8-4e08-b51e-96a48977cfa0 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:40.434423 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-069fc90f-d2d8-4e08-b51e-96a48977cfa0 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:40.435050 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-069fc90f-d2d8-4e08-b51e-96a48977cfa0 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:40.509514 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-069fc90f-d2d8-4e08-b51e-96a48977cfa0 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:40.510297 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-069fc90f-d2d8-4e08-b51e-96a48977cfa0 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:40.511009 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-069fc90f-d2d8-4e08-b51e-96a48977cfa0 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:40.511647 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-069fc90f-d2d8-4e08-b51e-96a48977cfa0 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lazy-loading 'fault' on Instance uuid 6e296817-752b-4ef9-812b-882268796473 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:29:40.525970 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-cdee1e20-744c-4654-b135-6286fc74a227 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:40.528038 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-cdee1e20-744c-4654-b135-6286fc74a227 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:40.556419 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cdee1e20-744c-4654-b135-6286fc74a227 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:40.563014 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cdee1e20-744c-4654-b135-6286fc74a227 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:40.563829 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cdee1e20-744c-4654-b135-6286fc74a227 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:40.564788 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cdee1e20-744c-4654-b135-6286fc74a227 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:40.565530 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cdee1e20-744c-4654-b135-6286fc74a227 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:40.569201 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cdee1e20-744c-4654-b135-6286fc74a227 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:40.656245 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-069fc90f-d2d8-4e08-b51e-96a48977cfa0 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b07308778f1f4b4aa44713715cb2dc5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b196bd92b2774a6898c39dc6e99b5674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:40.703704 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-069fc90f-d2d8-4e08-b51e-96a48977cfa0 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473" status: 200 len: 1327 microversion: 2.1 time: 0.327164 Aug 31 16:29:40.707016 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3073/6330] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:40 2022] GET /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473 => generated 1327 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:29:41.219927 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-cdee1e20-744c-4654-b135-6286fc74a227 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:41.239392 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-cdee1e20-744c-4654-b135-6286fc74a227 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd" status: 200 len: 1375 microversion: 2.1 time: 0.718443 Aug 31 16:29:41.247683 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3258/6331] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:40 2022] GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd => generated 1375 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:41.726556 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7de9e33a-a53d-4f56-82b1-93d63eca5943 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:41.727228 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7de9e33a-a53d-4f56-82b1-93d63eca5943 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 6e296817-752b-4ef9-812b-882268796473] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:41.734461 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-cd7c5015-37a5-4b6b-815c-0f8981e58f1f req-0a9891e5-e235-4275-991b-833c948cfb91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd", "name": "network-vif-plugged", "status": "completed", "tag": "c4579063-be24-495a-941a-cbb3a5a05119"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:29:41.784220 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7de9e33a-a53d-4f56-82b1-93d63eca5943 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:41.787073 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-cd7c5015-37a5-4b6b-815c-0f8981e58f1f req-0a9891e5-e235-4275-991b-833c948cfb91 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:41.788407 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7de9e33a-a53d-4f56-82b1-93d63eca5943 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:41.789265 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7de9e33a-a53d-4f56-82b1-93d63eca5943 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:41.791187 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7de9e33a-a53d-4f56-82b1-93d63eca5943 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:41.794159 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7de9e33a-a53d-4f56-82b1-93d63eca5943 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:41.794409 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-cd7c5015-37a5-4b6b-815c-0f8981e58f1f req-0a9891e5-e235-4275-991b-833c948cfb91 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:41.795319 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-cd7c5015-37a5-4b6b-815c-0f8981e58f1f req-0a9891e5-e235-4275-991b-833c948cfb91 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:41.796035 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7de9e33a-a53d-4f56-82b1-93d63eca5943 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:41.846556 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-cd7c5015-37a5-4b6b-815c-0f8981e58f1f req-0a9891e5-e235-4275-991b-833c948cfb91 service nova] Creating event network-vif-plugged:c4579063-be24-495a-941a-cbb3a5a05119 for instance a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd on n-h2-833090-16 Aug 31 16:29:41.856877 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-7de9e33a-a53d-4f56-82b1-93d63eca5943 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] HTTP exception thrown: Instance 6e296817-752b-4ef9-812b-882268796473 could not be found. Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7de9e33a-a53d-4f56-82b1-93d63eca5943 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Request method failure captured: Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473 HTTP/1.1 Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4qEc5AtkidsuCFEVOsKE6JRJgG3zRgW7cQ7X7_Pj1ygml5S6QFx5uHtU-PVO_a5NxyYSe4F1etDqaE98sTNFeT2lNZUd-Sgew_pe6BiKEO67OFPQRXju3FU5vu0HQszGxTnGI8adAujjwF-XHh3TjmeHO7aSbZPY8fsJH1JfRxZ_5g Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: b196bd92b2774a6898c39dc6e99b5674 Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-AttachVolumeTestJSON-166245674 Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b196bd92b2774a6898c39dc6e99b5674"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b196bd92b2774a6898c39dc6e99b5674"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b196bd92b2774a6898c39dc6e99b5674"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b196bd92b2774a6898c39dc6e99b5674", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-AttachVolumeTestJSON-166245674 Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: b196bd92b2774a6898c39dc6e99b5674 Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-AttachVolumeTestJSON-166245674 Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-AttachVolumeTestJSON-166245674-project Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: b07308778f1f4b4aa44713715cb2dc5d Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-AttachVolumeTestJSON-166245674-project Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 6e296817-752b-4ef9-812b-882268796473 could not be found. Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '6e296817-752b-4ef9-812b-882268796473'} Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e296817-752b-4ef9-812b-882268796473 could not be found. Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e296817-752b-4ef9-812b-882268796473 could not be found. Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:29:41.861683 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:29:41.866429 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:29:41.866429 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:29:41.866429 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:29:41.866429 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:29:41.866429 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:29:41.866429 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e296817-752b-4ef9-812b-882268796473 could not be found. Aug 31 16:29:41.866429 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:29:41.867102 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-cd7c5015-37a5-4b6b-815c-0f8981e58f1f req-0a9891e5-e235-4275-991b-833c948cfb91 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147954 Aug 31 16:29:41.867362 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3074/6332] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:29:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:29:41.870082 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7de9e33a-a53d-4f56-82b1-93d63eca5943 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Returning 404 to user: Instance 6e296817-752b-4ef9-812b-882268796473 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:29:41.871342 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7de9e33a-a53d-4f56-82b1-93d63eca5943 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473" status: 404 len: 111 microversion: 2.1 time: 0.150319 Aug 31 16:29:41.872658 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3259/6333] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:41 2022] GET /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:29:41.892289 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e066db69-05ed-484e-97e0-ff7facddef5f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '.version_select at 0x7fbb45e2bd30>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:41.907629 n-d-833090-16 devstack@n-api.service[128863]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e066db69-05ed-484e-97e0-ff7facddef5f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [20597d35-4b4e-4ea0-93ee-0a08dc793a48] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 16:29:42.047040 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-cabbb2e7-3e55-4c28-861d-9704adc88341 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Action: 'create', calling method: .version_select at 0x7fbb458aff70>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-2004041068", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNlgil+5LU2JRxo7L3jw5z+xlq4j4lxSNWL0Lrgm4CHjys0a7ffzbdYiZgjycwWjEqF/a69qJbLM2HWHtaoUFc2ouMHKREmQCuM/KczUc5Wr0slrVCI37jXt7jlbao+GZg=="}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:29:42.080615 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-cabbb2e7-3e55-4c28-861d-9704adc88341 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Getting quotas for project 50e75ee3acbd4ad1aa0a8cb826f02bc2. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:29:42.098812 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-cabbb2e7-3e55-4c28-861d-9704adc88341 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Getting quotas for user 6bf7edf821004c3fbca0a0b46de95799 and project 50e75ee3acbd4ad1aa0a8cb826f02bc2. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:29:42.248282 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-cabbb2e7-3e55-4c28-861d-9704adc88341 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.203285 Aug 31 16:29:42.252037 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3260/6334] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 31 16:29:42 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:29:42.275291 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6bc51a27-3e84-4587-97f9-9988586f14a2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:42.282649 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6bc51a27-3e84-4587-97f9-9988586f14a2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:42.300365 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6bc51a27-3e84-4587-97f9-9988586f14a2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:42.305918 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6bc51a27-3e84-4587-97f9-9988586f14a2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:42.309691 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6bc51a27-3e84-4587-97f9-9988586f14a2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:42.311658 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6bc51a27-3e84-4587-97f9-9988586f14a2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:42.317076 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6bc51a27-3e84-4587-97f9-9988586f14a2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:42.317940 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6bc51a27-3e84-4587-97f9-9988586f14a2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:42.733404 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6bc51a27-3e84-4587-97f9-9988586f14a2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:42.766057 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6bc51a27-3e84-4587-97f9-9988586f14a2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd" status: 200 len: 1375 microversion: 2.1 time: 0.503457 Aug 31 16:29:42.771009 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3261/6335] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:42 2022] GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd => generated 1375 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:29:42.938194 n-d-833090-16 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [None req-e066db69-05ed-484e-97e0-ff7facddef5f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [20597d35-4b4e-4ea0-93ee-0a08dc793a48] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 36786. Aug 31 16:29:42.970281 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e066db69-05ed-484e-97e0-ff7facddef5f tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-786212832" status: 202 len: 0 microversion: 2.1 time: 1.090899 Aug 31 16:29:42.976883 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3075/6336] 10.222.0.50 () {58 vars in 1218 bytes} [Wed Aug 31 16:29:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-786212832 => generated 0 bytes in 1098 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:29:43.793607 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-272399ae-5783-4f2e-ad84-4920c581b592 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:43.798424 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-272399ae-5783-4f2e-ad84-4920c581b592 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:43.821829 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-272399ae-5783-4f2e-ad84-4920c581b592 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:43.824056 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-272399ae-5783-4f2e-ad84-4920c581b592 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:43.824749 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-272399ae-5783-4f2e-ad84-4920c581b592 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:43.829024 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-272399ae-5783-4f2e-ad84-4920c581b592 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:43.829928 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-272399ae-5783-4f2e-ad84-4920c581b592 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:43.830795 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-272399ae-5783-4f2e-ad84-4920c581b592 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:44.321560 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-272399ae-5783-4f2e-ad84-4920c581b592 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:44.344822 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-272399ae-5783-4f2e-ad84-4920c581b592 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd" status: 200 len: 1562 microversion: 2.1 time: 0.551446 Aug 31 16:29:44.351015 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3262/6337] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:43 2022] GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd => generated 1562 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:44.372806 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e0118aa1-559a-47da-af42-213206d9bd94 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:44.373938 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e0118aa1-559a-47da-af42-213206d9bd94 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:44.395524 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0118aa1-559a-47da-af42-213206d9bd94 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:44.398161 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0118aa1-559a-47da-af42-213206d9bd94 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:44.398864 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0118aa1-559a-47da-af42-213206d9bd94 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:44.403969 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0118aa1-559a-47da-af42-213206d9bd94 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:44.404746 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0118aa1-559a-47da-af42-213206d9bd94 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:44.408468 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e0118aa1-559a-47da-af42-213206d9bd94 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:44.977498 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e0118aa1-559a-47da-af42-213206d9bd94 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:44.987241 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e0118aa1-559a-47da-af42-213206d9bd94 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd" status: 200 len: 1562 microversion: 2.1 time: 0.618284 Aug 31 16:29:44.994131 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3076/6338] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:44 2022] GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd => generated 1562 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:45.138389 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4c6e2a68-5bf2-4f49-9c54-99d2f9874136 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:45.139039 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4c6e2a68-5bf2-4f49-9c54-99d2f9874136 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:45.161240 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4c6e2a68-5bf2-4f49-9c54-99d2f9874136 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:45.162012 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4c6e2a68-5bf2-4f49-9c54-99d2f9874136 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:45.162608 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4c6e2a68-5bf2-4f49-9c54-99d2f9874136 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:45.163522 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4c6e2a68-5bf2-4f49-9c54-99d2f9874136 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:45.164439 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4c6e2a68-5bf2-4f49-9c54-99d2f9874136 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:45.165309 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4c6e2a68-5bf2-4f49-9c54-99d2f9874136 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:45.231395 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:29:45.274911 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4c6e2a68-5bf2-4f49-9c54-99d2f9874136 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:29:45.430404 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4c6e2a68-5bf2-4f49-9c54-99d2f9874136 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd" status: 204 len: 0 microversion: 2.1 time: 0.294157 Aug 31 16:29:45.435349 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3263/6339] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:29:45 2022] DELETE /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:29:45.442803 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6c9d93fe-5716-44b1-a4fa-4479804d10c3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:45.444147 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6c9d93fe-5716-44b1-a4fa-4479804d10c3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:45.452294 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c9d93fe-5716-44b1-a4fa-4479804d10c3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:45.469562 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c9d93fe-5716-44b1-a4fa-4479804d10c3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:45.469562 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c9d93fe-5716-44b1-a4fa-4479804d10c3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:45.469562 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c9d93fe-5716-44b1-a4fa-4479804d10c3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:45.469562 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c9d93fe-5716-44b1-a4fa-4479804d10c3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:45.469562 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6c9d93fe-5716-44b1-a4fa-4479804d10c3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:45.909429 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6c9d93fe-5716-44b1-a4fa-4479804d10c3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:45.923549 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6c9d93fe-5716-44b1-a4fa-4479804d10c3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd" status: 200 len: 1568 microversion: 2.1 time: 0.485721 Aug 31 16:29:45.925674 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3077/6340] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:45 2022] GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd => generated 1568 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:46.964423 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b8ff1b0e-ee28-4032-b749-aae1c925ed47 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1460376154", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "04bb38f6-337a-4dc2-a8eb-b044dcb77a58", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-2004041068", "security_groups": [{"name": "tempest-secgroup-smoke-1308839140"}], "networks": [{"uuid": "42164c75-9246-4aff-927b-9f271ee34cb0"}]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:29:46.965727 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e61f1a2e-7ca7-479e-a0b8-45ffbbe3d27c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:46.966971 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e61f1a2e-7ca7-479e-a0b8-45ffbbe3d27c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:47.002967 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e61f1a2e-7ca7-479e-a0b8-45ffbbe3d27c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:47.003911 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e61f1a2e-7ca7-479e-a0b8-45ffbbe3d27c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:47.004594 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e61f1a2e-7ca7-479e-a0b8-45ffbbe3d27c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:47.005952 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e61f1a2e-7ca7-479e-a0b8-45ffbbe3d27c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:47.007256 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e61f1a2e-7ca7-479e-a0b8-45ffbbe3d27c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:47.009242 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e61f1a2e-7ca7-479e-a0b8-45ffbbe3d27c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:47.669416 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-b8ff1b0e-ee28-4032-b749-aae1c925ed47 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] validate_networks() for [('42164c75-9246-4aff-927b-9f271ee34cb0', None, None, None, None, None)] {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:29:48.461929 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e61f1a2e-7ca7-479e-a0b8-45ffbbe3d27c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:48.470910 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e61f1a2e-7ca7-479e-a0b8-45ffbbe3d27c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd" status: 200 len: 1568 microversion: 2.1 time: 1.522421 Aug 31 16:29:48.498220 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3078/6341] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:46 2022] GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd => generated 1568 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:48.523972 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-fdc36a9f-3076-49c4-b80b-e7e2529ff43a req-b31b019b-7a35-4716-a757-37a1bf21f4b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd", "name": "network-vif-deleted", "tag": "c4579063-be24-495a-941a-cbb3a5a05119"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:29:48.552407 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-fdc36a9f-3076-49c4-b80b-e7e2529ff43a req-b31b019b-7a35-4716-a757-37a1bf21f4b0 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:48.560265 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-fdc36a9f-3076-49c4-b80b-e7e2529ff43a req-b31b019b-7a35-4716-a757-37a1bf21f4b0 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:48.562158 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-fdc36a9f-3076-49c4-b80b-e7e2529ff43a req-b31b019b-7a35-4716-a757-37a1bf21f4b0 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:48.648051 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-fdc36a9f-3076-49c4-b80b-e7e2529ff43a req-b31b019b-7a35-4716-a757-37a1bf21f4b0 service nova] Creating event network-vif-deleted:c4579063-be24-495a-941a-cbb3a5a05119 for instance a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd on n-h2-833090-16 Aug 31 16:29:48.675356 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-fdc36a9f-3076-49c4-b80b-e7e2529ff43a req-b31b019b-7a35-4716-a757-37a1bf21f4b0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174851 Aug 31 16:29:48.683594 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3079/6342] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:29:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:29:49.522579 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fb7a09bd-a9ee-4831-8ea0-b67959af0b30 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:49.539697 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fb7a09bd-a9ee-4831-8ea0-b67959af0b30 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:49.549337 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:29:49.554229 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb7a09bd-a9ee-4831-8ea0-b67959af0b30 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:49.555354 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb7a09bd-a9ee-4831-8ea0-b67959af0b30 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:49.556002 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb7a09bd-a9ee-4831-8ea0-b67959af0b30 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:49.558649 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb7a09bd-a9ee-4831-8ea0-b67959af0b30 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:49.560435 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb7a09bd-a9ee-4831-8ea0-b67959af0b30 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:49.561086 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb7a09bd-a9ee-4831-8ea0-b67959af0b30 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:49.606736 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-b8ff1b0e-ee28-4032-b749-aae1c925ed47 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:29:49.607294 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-b8ff1b0e-ee28-4032-b749-aae1c925ed47 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:29:49.608331 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-b8ff1b0e-ee28-4032-b749-aae1c925ed47 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:29:49.608850 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-b8ff1b0e-ee28-4032-b749-aae1c925ed47 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:29:49.609554 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-b8ff1b0e-ee28-4032-b749-aae1c925ed47 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:29:49.631228 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b8ff1b0e-ee28-4032-b749-aae1c925ed47 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:49.636911 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b8ff1b0e-ee28-4032-b749-aae1c925ed47 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:49.639006 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b8ff1b0e-ee28-4032-b749-aae1c925ed47 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:49.646998 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b8ff1b0e-ee28-4032-b749-aae1c925ed47 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:49.647660 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b8ff1b0e-ee28-4032-b749-aae1c925ed47 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:49.648923 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b8ff1b0e-ee28-4032-b749-aae1c925ed47 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:49.733978 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-b8ff1b0e-ee28-4032-b749-aae1c925ed47 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Getting quotas for project 50e75ee3acbd4ad1aa0a8cb826f02bc2. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:29:49.754029 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-b8ff1b0e-ee28-4032-b749-aae1c925ed47 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Getting quotas for user 6bf7edf821004c3fbca0a0b46de95799 and project 50e75ee3acbd4ad1aa0a8cb826f02bc2. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:29:49.790201 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fb7a09bd-a9ee-4831-8ea0-b67959af0b30 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:49.831130 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fb7a09bd-a9ee-4831-8ea0-b67959af0b30 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd" status: 200 len: 1360 microversion: 2.1 time: 0.314363 Aug 31 16:29:49.847837 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3080/6343] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:49 2022] GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd => generated 1360 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:49.887534 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b8ff1b0e-ee28-4032-b749-aae1c925ed47 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:29:49.890489 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b8ff1b0e-ee28-4032-b749-aae1c925ed47 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] [instance: e77fc40b-336f-4886-8a87-9376431bec27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='04bb38f6-337a-4dc2-a8eb-b044dcb77a58',volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:29:50.158643 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:29:50.195937 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b8ff1b0e-ee28-4032-b749-aae1c925ed47 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.251863 Aug 31 16:29:50.203002 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3264/6344] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:29:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 3260 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:29:50.227413 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-871b40d2-cfcb-40ac-849d-8bdcf5ff9a43 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:50.236081 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-871b40d2-cfcb-40ac-849d-8bdcf5ff9a43 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] [instance: e77fc40b-336f-4886-8a87-9376431bec27] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:50.493771 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-871b40d2-cfcb-40ac-849d-8bdcf5ff9a43 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7edf821004c3fbca0a0b46de95799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e75ee3acbd4ad1aa0a8cb826f02bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:50.502366 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-871b40d2-cfcb-40ac-849d-8bdcf5ff9a43 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] 10.222.0.50 "GET /compute/v2.1/servers/e77fc40b-336f-4886-8a87-9376431bec27" status: 200 len: 1099 microversion: 2.1 time: 0.288614 Aug 31 16:29:50.502982 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3081/6345] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:50 2022] GET /compute/v2.1/servers/e77fc40b-336f-4886-8a87-9376431bec27 => generated 1099 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:50.856791 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-af1b8ba1-a819-4eb8-9a3d-bd315b792bd0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:50.857579 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-af1b8ba1-a819-4eb8-9a3d-bd315b792bd0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:50.892258 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-af1b8ba1-a819-4eb8-9a3d-bd315b792bd0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:50.893344 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-af1b8ba1-a819-4eb8-9a3d-bd315b792bd0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:50.894252 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-af1b8ba1-a819-4eb8-9a3d-bd315b792bd0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:50.895251 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-af1b8ba1-a819-4eb8-9a3d-bd315b792bd0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:50.895973 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-af1b8ba1-a819-4eb8-9a3d-bd315b792bd0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:50.896599 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-af1b8ba1-a819-4eb8-9a3d-bd315b792bd0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:51.139623 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-af1b8ba1-a819-4eb8-9a3d-bd315b792bd0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:51.156756 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-af1b8ba1-a819-4eb8-9a3d-bd315b792bd0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd" status: 200 len: 1360 microversion: 2.1 time: 0.302000 Aug 31 16:29:51.157505 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3265/6346] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:50 2022] GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd => generated 1360 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:51.525845 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-88ec9c06-b920-4095-a2bc-4f7a797902ec tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:51.527146 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-88ec9c06-b920-4095-a2bc-4f7a797902ec tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] [instance: e77fc40b-336f-4886-8a87-9376431bec27] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:51.545956 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88ec9c06-b920-4095-a2bc-4f7a797902ec tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:51.546724 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88ec9c06-b920-4095-a2bc-4f7a797902ec tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:51.547331 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88ec9c06-b920-4095-a2bc-4f7a797902ec tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:51.548204 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88ec9c06-b920-4095-a2bc-4f7a797902ec tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:51.550338 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88ec9c06-b920-4095-a2bc-4f7a797902ec tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:51.550947 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88ec9c06-b920-4095-a2bc-4f7a797902ec tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:51.696003 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-88ec9c06-b920-4095-a2bc-4f7a797902ec tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7edf821004c3fbca0a0b46de95799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e75ee3acbd4ad1aa0a8cb826f02bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:51.711227 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-88ec9c06-b920-4095-a2bc-4f7a797902ec tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] 10.222.0.50 "GET /compute/v2.1/servers/e77fc40b-336f-4886-8a87-9376431bec27" status: 200 len: 1141 microversion: 2.1 time: 0.186454 Aug 31 16:29:51.712538 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3082/6347] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:51 2022] GET /compute/v2.1/servers/e77fc40b-336f-4886-8a87-9376431bec27 => generated 1141 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:52.189777 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c7f25092-ba4e-46bd-8ced-7893703712ae tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:52.203234 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c7f25092-ba4e-46bd-8ced-7893703712ae tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:52.229927 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c7f25092-ba4e-46bd-8ced-7893703712ae tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:52.233696 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c7f25092-ba4e-46bd-8ced-7893703712ae tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:52.234337 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c7f25092-ba4e-46bd-8ced-7893703712ae tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:52.235119 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c7f25092-ba4e-46bd-8ced-7893703712ae tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:52.235610 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c7f25092-ba4e-46bd-8ced-7893703712ae tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:52.236081 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c7f25092-ba4e-46bd-8ced-7893703712ae tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:52.362800 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c7f25092-ba4e-46bd-8ced-7893703712ae tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:52.413088 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c7f25092-ba4e-46bd-8ced-7893703712ae tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd" status: 200 len: 1360 microversion: 2.1 time: 0.230604 Aug 31 16:29:52.424454 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3266/6348] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:52 2022] GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd => generated 1360 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:52.736689 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-016a354b-d515-49bd-86f9-2b789f941050 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:52.738057 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-016a354b-d515-49bd-86f9-2b789f941050 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] [instance: e77fc40b-336f-4886-8a87-9376431bec27] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:52.750801 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-016a354b-d515-49bd-86f9-2b789f941050 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:52.755672 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-016a354b-d515-49bd-86f9-2b789f941050 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:52.758552 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-016a354b-d515-49bd-86f9-2b789f941050 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:52.759962 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-016a354b-d515-49bd-86f9-2b789f941050 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:52.762250 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-016a354b-d515-49bd-86f9-2b789f941050 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:52.763856 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-016a354b-d515-49bd-86f9-2b789f941050 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:53.162961 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-016a354b-d515-49bd-86f9-2b789f941050 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7edf821004c3fbca0a0b46de95799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e75ee3acbd4ad1aa0a8cb826f02bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:53.174694 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-016a354b-d515-49bd-86f9-2b789f941050 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] 10.222.0.50 "GET /compute/v2.1/servers/e77fc40b-336f-4886-8a87-9376431bec27" status: 200 len: 1215 microversion: 2.1 time: 0.440252 Aug 31 16:29:53.177638 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3083/6349] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:52 2022] GET /compute/v2.1/servers/e77fc40b-336f-4886-8a87-9376431bec27 => generated 1215 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:29:53.452070 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2d16cb58-cb29-4044-b4e6-5b0c0e2d8fd9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:53.452688 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2d16cb58-cb29-4044-b4e6-5b0c0e2d8fd9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:53.480861 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2d16cb58-cb29-4044-b4e6-5b0c0e2d8fd9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:53.481370 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2d16cb58-cb29-4044-b4e6-5b0c0e2d8fd9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:53.481814 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2d16cb58-cb29-4044-b4e6-5b0c0e2d8fd9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:53.482568 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2d16cb58-cb29-4044-b4e6-5b0c0e2d8fd9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:53.483031 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2d16cb58-cb29-4044-b4e6-5b0c0e2d8fd9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:53.483460 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2d16cb58-cb29-4044-b4e6-5b0c0e2d8fd9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:54.024648 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2d16cb58-cb29-4044-b4e6-5b0c0e2d8fd9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:54.048454 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2d16cb58-cb29-4044-b4e6-5b0c0e2d8fd9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd" status: 200 len: 1360 microversion: 2.1 time: 0.591869 Aug 31 16:29:54.079501 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3267/6350] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:53 2022] GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd => generated 1360 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:54.203565 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-00dcfa0e-267e-4d04-b174-a04aeceb3594 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:54.204245 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-00dcfa0e-267e-4d04-b174-a04aeceb3594 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] [instance: e77fc40b-336f-4886-8a87-9376431bec27] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:54.231442 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00dcfa0e-267e-4d04-b174-a04aeceb3594 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:54.251029 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00dcfa0e-267e-4d04-b174-a04aeceb3594 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:54.261882 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00dcfa0e-267e-4d04-b174-a04aeceb3594 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:54.263705 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00dcfa0e-267e-4d04-b174-a04aeceb3594 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:54.263705 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00dcfa0e-267e-4d04-b174-a04aeceb3594 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:54.263922 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-00dcfa0e-267e-4d04-b174-a04aeceb3594 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:54.351006 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:29:54.762011 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-00dcfa0e-267e-4d04-b174-a04aeceb3594 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7edf821004c3fbca0a0b46de95799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e75ee3acbd4ad1aa0a8cb826f02bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:54.789989 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-00dcfa0e-267e-4d04-b174-a04aeceb3594 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] 10.222.0.50 "GET /compute/v2.1/servers/e77fc40b-336f-4886-8a87-9376431bec27" status: 200 len: 1215 microversion: 2.1 time: 0.590526 Aug 31 16:29:54.795718 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3084/6351] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:54 2022] GET /compute/v2.1/servers/e77fc40b-336f-4886-8a87-9376431bec27 => generated 1215 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:55.083057 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b0e27a02-5798-49ce-856c-540b11ce8241 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:55.083761 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b0e27a02-5798-49ce-856c-540b11ce8241 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:55.095393 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b0e27a02-5798-49ce-856c-540b11ce8241 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:55.095906 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b0e27a02-5798-49ce-856c-540b11ce8241 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:55.096358 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b0e27a02-5798-49ce-856c-540b11ce8241 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:55.097084 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b0e27a02-5798-49ce-856c-540b11ce8241 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:55.097557 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b0e27a02-5798-49ce-856c-540b11ce8241 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:55.098005 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b0e27a02-5798-49ce-856c-540b11ce8241 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:55.249724 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b0e27a02-5798-49ce-856c-540b11ce8241 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:55.261971 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b0e27a02-5798-49ce-856c-540b11ce8241 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd" status: 200 len: 1360 microversion: 2.1 time: 0.182792 Aug 31 16:29:55.263190 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3268/6352] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:55 2022] GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd => generated 1360 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:55.814655 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-321ed9e3-590f-4db3-83b9-54605424ac5d tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:55.816115 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-321ed9e3-590f-4db3-83b9-54605424ac5d tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] [instance: e77fc40b-336f-4886-8a87-9376431bec27] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:55.830950 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-321ed9e3-590f-4db3-83b9-54605424ac5d tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:55.834779 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-321ed9e3-590f-4db3-83b9-54605424ac5d tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:55.835516 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-321ed9e3-590f-4db3-83b9-54605424ac5d tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:55.836505 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-321ed9e3-590f-4db3-83b9-54605424ac5d tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:55.837130 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-321ed9e3-590f-4db3-83b9-54605424ac5d tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:55.837722 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-321ed9e3-590f-4db3-83b9-54605424ac5d tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:56.206312 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-321ed9e3-590f-4db3-83b9-54605424ac5d tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7edf821004c3fbca0a0b46de95799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e75ee3acbd4ad1aa0a8cb826f02bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:56.224879 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-321ed9e3-590f-4db3-83b9-54605424ac5d tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] 10.222.0.50 "GET /compute/v2.1/servers/e77fc40b-336f-4886-8a87-9376431bec27" status: 200 len: 1283 microversion: 2.1 time: 0.413039 Aug 31 16:29:56.226433 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3085/6353] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:55 2022] GET /compute/v2.1/servers/e77fc40b-336f-4886-8a87-9376431bec27 => generated 1283 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:56.284770 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-95841fc9-1bf2-444f-962a-aaacc4c2d790 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:56.285398 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-95841fc9-1bf2-444f-962a-aaacc4c2d790 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:56.299164 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95841fc9-1bf2-444f-962a-aaacc4c2d790 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:56.299605 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95841fc9-1bf2-444f-962a-aaacc4c2d790 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:56.300061 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95841fc9-1bf2-444f-962a-aaacc4c2d790 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:56.300783 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95841fc9-1bf2-444f-962a-aaacc4c2d790 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:56.301249 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95841fc9-1bf2-444f-962a-aaacc4c2d790 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:56.301683 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95841fc9-1bf2-444f-962a-aaacc4c2d790 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:56.423351 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-95841fc9-1bf2-444f-962a-aaacc4c2d790 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:56.436779 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-95841fc9-1bf2-444f-962a-aaacc4c2d790 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd" status: 200 len: 1360 microversion: 2.1 time: 0.156407 Aug 31 16:29:56.440050 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3269/6354] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:56 2022] GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd => generated 1360 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:57.259310 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c0ba3fbd-388b-4bfe-87cb-726d74b48f51 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:57.260116 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c0ba3fbd-388b-4bfe-87cb-726d74b48f51 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] [instance: e77fc40b-336f-4886-8a87-9376431bec27] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:57.278449 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0ba3fbd-388b-4bfe-87cb-726d74b48f51 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:57.279268 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0ba3fbd-388b-4bfe-87cb-726d74b48f51 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:57.279735 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0ba3fbd-388b-4bfe-87cb-726d74b48f51 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:57.280478 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0ba3fbd-388b-4bfe-87cb-726d74b48f51 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:57.280939 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0ba3fbd-388b-4bfe-87cb-726d74b48f51 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:57.281364 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0ba3fbd-388b-4bfe-87cb-726d74b48f51 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:57.413448 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-8b50a8b9-e523-439a-b38a-b19b7c6f3b09 req-664205bb-ae22-4581-acf3-ad569d5643d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e77fc40b-336f-4886-8a87-9376431bec27", "tag": "bb31973a-7cba-4adc-9ea9-a852d7c78acf"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:29:57.448683 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-8b50a8b9-e523-439a-b38a-b19b7c6f3b09 req-664205bb-ae22-4581-acf3-ad569d5643d7 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:57.451448 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-8b50a8b9-e523-439a-b38a-b19b7c6f3b09 req-664205bb-ae22-4581-acf3-ad569d5643d7 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:57.454224 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-8b50a8b9-e523-439a-b38a-b19b7c6f3b09 req-664205bb-ae22-4581-acf3-ad569d5643d7 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:57.504400 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-8b50a8b9-e523-439a-b38a-b19b7c6f3b09 req-664205bb-ae22-4581-acf3-ad569d5643d7 service nova] Creating event network-changed:bb31973a-7cba-4adc-9ea9-a852d7c78acf for instance e77fc40b-336f-4886-8a87-9376431bec27 on n-h1-833090-16 Aug 31 16:29:57.525328 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-8b50a8b9-e523-439a-b38a-b19b7c6f3b09 req-664205bb-ae22-4581-acf3-ad569d5643d7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115400 Aug 31 16:29:57.527265 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3270/6355] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:29:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:29:57.540597 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7587066f-c271-4080-b507-75241540d942 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:57.542042 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7587066f-c271-4080-b507-75241540d942 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:57.552387 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7587066f-c271-4080-b507-75241540d942 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:57.574343 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7587066f-c271-4080-b507-75241540d942 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:57.576236 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7587066f-c271-4080-b507-75241540d942 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:57.577580 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7587066f-c271-4080-b507-75241540d942 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:57.580018 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7587066f-c271-4080-b507-75241540d942 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:57.582196 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7587066f-c271-4080-b507-75241540d942 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:57.665779 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7587066f-c271-4080-b507-75241540d942 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:57.666309 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7587066f-c271-4080-b507-75241540d942 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:57.666754 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7587066f-c271-4080-b507-75241540d942 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:57.667218 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-7587066f-c271-4080-b507-75241540d942 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lazy-loading 'fault' on Instance uuid a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:29:58.017416 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7587066f-c271-4080-b507-75241540d942 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:58.026438 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7587066f-c271-4080-b507-75241540d942 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd" status: 200 len: 1365 microversion: 2.1 time: 0.495600 Aug 31 16:29:58.030858 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3271/6356] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:57 2022] GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd => generated 1365 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:58.310521 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c0ba3fbd-388b-4bfe-87cb-726d74b48f51 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7edf821004c3fbca0a0b46de95799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e75ee3acbd4ad1aa0a8cb826f02bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:58.318738 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c0ba3fbd-388b-4bfe-87cb-726d74b48f51 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] 10.222.0.50 "GET /compute/v2.1/servers/e77fc40b-336f-4886-8a87-9376431bec27" status: 200 len: 1283 microversion: 2.1 time: 1.075505 Aug 31 16:29:58.335905 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3086/6357] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:57 2022] GET /compute/v2.1/servers/e77fc40b-336f-4886-8a87-9376431bec27 => generated 1283 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:29:59.054839 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-25ade0da-78d2-4a21-9382-3740f42ddb5f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:59.055681 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-25ade0da-78d2-4a21-9382-3740f42ddb5f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:59.070314 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-25ade0da-78d2-4a21-9382-3740f42ddb5f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:59.073822 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-25ade0da-78d2-4a21-9382-3740f42ddb5f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:59.075231 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-25ade0da-78d2-4a21-9382-3740f42ddb5f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:59.082200 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-25ade0da-78d2-4a21-9382-3740f42ddb5f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:59.083313 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-25ade0da-78d2-4a21-9382-3740f42ddb5f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:59.084527 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-25ade0da-78d2-4a21-9382-3740f42ddb5f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:59.127299 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-25ade0da-78d2-4a21-9382-3740f42ddb5f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] HTTP exception thrown: Instance a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd could not be found. Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-25ade0da-78d2-4a21-9382-3740f42ddb5f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Request method failure captured: Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd HTTP/1.1 Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4sA8QatsiRw58KL4D-GJAaR1X9zBGwbu0cNuaHi16Tl8K5LhZ4dthUjdeeybVrZ6FkLiuj0CnwnGa_AqwqzkMsKdZfTNQhjMqXfHtEAV5ID9oXbOsK0vGNgY-jRlE7qor7NeFM7QGwhr8KE3TJ70ugNQcxhI7ZJIKzx49vTu_Rhy18 Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 32245d85aee64f69865d98656133a539 Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-TestVolumeBootPattern-1732723367 Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/32245d85aee64f69865d98656133a539"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/32245d85aee64f69865d98656133a539"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/32245d85aee64f69865d98656133a539"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_32245d85aee64f69865d98656133a539", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-TestVolumeBootPattern-1732723367 Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 32245d85aee64f69865d98656133a539 Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-TestVolumeBootPattern-1732723367 Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-TestVolumeBootPattern-1732723367-project Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: fb76a89a8b8042edb7b6aaccb4f41ead Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-TestVolumeBootPattern-1732723367-project Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd could not be found. Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd'} Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd could not be found. Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd could not be found. Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:29:59.135627 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:29:59.141282 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:29:59.141282 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:29:59.141282 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:29:59.141282 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:29:59.141282 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:29:59.141282 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd could not be found. Aug 31 16:29:59.141282 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:29:59.144858 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-25ade0da-78d2-4a21-9382-3740f42ddb5f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Returning 404 to user: Instance a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:29:59.146794 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-25ade0da-78d2-4a21-9382-3740f42ddb5f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd" status: 404 len: 111 microversion: 2.1 time: 0.098102 Aug 31 16:29:59.164703 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3272/6358] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:59 2022] GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:29:59.345173 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1dc1fcad-58aa-4c11-8342-479a66ae41b7 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:29:59.346571 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1dc1fcad-58aa-4c11-8342-479a66ae41b7 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] [instance: e77fc40b-336f-4886-8a87-9376431bec27] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:29:59.369806 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1dc1fcad-58aa-4c11-8342-479a66ae41b7 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:59.370962 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1dc1fcad-58aa-4c11-8342-479a66ae41b7 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:59.374126 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1dc1fcad-58aa-4c11-8342-479a66ae41b7 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:59.375557 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1dc1fcad-58aa-4c11-8342-479a66ae41b7 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:29:59.377112 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1dc1fcad-58aa-4c11-8342-479a66ae41b7 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:29:59.378641 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1dc1fcad-58aa-4c11-8342-479a66ae41b7 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:29:59.904772 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1dc1fcad-58aa-4c11-8342-479a66ae41b7 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7edf821004c3fbca0a0b46de95799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e75ee3acbd4ad1aa0a8cb826f02bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:29:59.917022 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1dc1fcad-58aa-4c11-8342-479a66ae41b7 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] 10.222.0.50 "GET /compute/v2.1/servers/e77fc40b-336f-4886-8a87-9376431bec27" status: 200 len: 1283 microversion: 2.1 time: 0.577577 Aug 31 16:29:59.922761 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3087/6359] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:29:59 2022] GET /compute/v2.1/servers/e77fc40b-336f-4886-8a87-9376431bec27 => generated 1283 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:30:00.949208 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-68550af0-abf0-420e-b4f6-d3d6482fbf12 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:00.950957 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-68550af0-abf0-420e-b4f6-d3d6482fbf12 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] [instance: e77fc40b-336f-4886-8a87-9376431bec27] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:00.954429 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:30:00.955145 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=10 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:30:00.977816 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68550af0-abf0-420e-b4f6-d3d6482fbf12 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:00.978376 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68550af0-abf0-420e-b4f6-d3d6482fbf12 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:00.978840 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68550af0-abf0-420e-b4f6-d3d6482fbf12 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:00.986061 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68550af0-abf0-420e-b4f6-d3d6482fbf12 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:00.986592 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68550af0-abf0-420e-b4f6-d3d6482fbf12 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:00.994528 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68550af0-abf0-420e-b4f6-d3d6482fbf12 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:01.300665 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-68550af0-abf0-420e-b4f6-d3d6482fbf12 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7edf821004c3fbca0a0b46de95799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e75ee3acbd4ad1aa0a8cb826f02bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:01.313859 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-68550af0-abf0-420e-b4f6-d3d6482fbf12 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] 10.222.0.50 "GET /compute/v2.1/servers/e77fc40b-336f-4886-8a87-9376431bec27" status: 200 len: 1283 microversion: 2.1 time: 0.373380 Aug 31 16:30:01.338274 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3273/6360] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:00 2022] GET /compute/v2.1/servers/e77fc40b-336f-4886-8a87-9376431bec27 => generated 1283 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:30:02.359657 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b5270410-85dd-45dd-9c07-775eedce622e tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:02.362689 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b5270410-85dd-45dd-9c07-775eedce622e tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] [instance: e77fc40b-336f-4886-8a87-9376431bec27] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:02.371481 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:30:02.376542 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5270410-85dd-45dd-9c07-775eedce622e tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:02.377815 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5270410-85dd-45dd-9c07-775eedce622e tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:02.378777 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5270410-85dd-45dd-9c07-775eedce622e tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:02.379811 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5270410-85dd-45dd-9c07-775eedce622e tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:02.383228 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5270410-85dd-45dd-9c07-775eedce622e tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:02.384077 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5270410-85dd-45dd-9c07-775eedce622e tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:02.802872 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b5270410-85dd-45dd-9c07-775eedce622e tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7edf821004c3fbca0a0b46de95799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e75ee3acbd4ad1aa0a8cb826f02bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:02.823184 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b5270410-85dd-45dd-9c07-775eedce622e tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] 10.222.0.50 "GET /compute/v2.1/servers/e77fc40b-336f-4886-8a87-9376431bec27" status: 200 len: 1283 microversion: 2.1 time: 0.470681 Aug 31 16:30:02.830853 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3088/6361] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:02 2022] GET /compute/v2.1/servers/e77fc40b-336f-4886-8a87-9376431bec27 => generated 1283 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:30:03.852651 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-64163ed3-49d5-458f-ac2f-aa0be3d7ffa2 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:03.854116 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-64163ed3-49d5-458f-ac2f-aa0be3d7ffa2 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] [instance: e77fc40b-336f-4886-8a87-9376431bec27] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:03.879620 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-64163ed3-49d5-458f-ac2f-aa0be3d7ffa2 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:03.880369 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-64163ed3-49d5-458f-ac2f-aa0be3d7ffa2 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:03.893893 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-64163ed3-49d5-458f-ac2f-aa0be3d7ffa2 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:03.895421 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-64163ed3-49d5-458f-ac2f-aa0be3d7ffa2 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:03.900572 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-64163ed3-49d5-458f-ac2f-aa0be3d7ffa2 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:03.909244 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-64163ed3-49d5-458f-ac2f-aa0be3d7ffa2 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:05.068064 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-64163ed3-49d5-458f-ac2f-aa0be3d7ffa2 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7edf821004c3fbca0a0b46de95799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e75ee3acbd4ad1aa0a8cb826f02bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:05.078367 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-64163ed3-49d5-458f-ac2f-aa0be3d7ffa2 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] 10.222.0.50 "GET /compute/v2.1/servers/e77fc40b-336f-4886-8a87-9376431bec27" status: 200 len: 1283 microversion: 2.1 time: 1.231152 Aug 31 16:30:05.079572 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3274/6362] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:03 2022] GET /compute/v2.1/servers/e77fc40b-336f-4886-8a87-9376431bec27 => generated 1283 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:30:06.116764 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f3508007-3b65-4848-8464-ac761bbfd164 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:06.117390 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f3508007-3b65-4848-8464-ac761bbfd164 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] [instance: e77fc40b-336f-4886-8a87-9376431bec27] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:06.140297 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f3508007-3b65-4848-8464-ac761bbfd164 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:06.141507 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f3508007-3b65-4848-8464-ac761bbfd164 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:06.143085 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f3508007-3b65-4848-8464-ac761bbfd164 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:06.144089 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f3508007-3b65-4848-8464-ac761bbfd164 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:06.149995 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f3508007-3b65-4848-8464-ac761bbfd164 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:06.150734 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f3508007-3b65-4848-8464-ac761bbfd164 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:06.637075 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f3508007-3b65-4848-8464-ac761bbfd164 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7edf821004c3fbca0a0b46de95799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e75ee3acbd4ad1aa0a8cb826f02bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:06.650221 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f3508007-3b65-4848-8464-ac761bbfd164 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] 10.222.0.50 "GET /compute/v2.1/servers/e77fc40b-336f-4886-8a87-9376431bec27" status: 200 len: 1283 microversion: 2.1 time: 0.541718 Aug 31 16:30:06.658041 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3089/6363] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:06 2022] GET /compute/v2.1/servers/e77fc40b-336f-4886-8a87-9376431bec27 => generated 1283 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:30:07.292405 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8f7dc1e1-d75e-4e7a-b97d-999d92196daa tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:07.293513 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8f7dc1e1-d75e-4e7a-b97d-999d92196daa tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 6e296817-752b-4ef9-812b-882268796473] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:07.312635 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8f7dc1e1-d75e-4e7a-b97d-999d92196daa tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:07.318445 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8f7dc1e1-d75e-4e7a-b97d-999d92196daa tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:07.319429 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8f7dc1e1-d75e-4e7a-b97d-999d92196daa tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:07.324029 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8f7dc1e1-d75e-4e7a-b97d-999d92196daa tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:07.328288 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8f7dc1e1-d75e-4e7a-b97d-999d92196daa tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:07.332508 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8f7dc1e1-d75e-4e7a-b97d-999d92196daa tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:07.394338 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-8f7dc1e1-d75e-4e7a-b97d-999d92196daa tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] HTTP exception thrown: Instance 6e296817-752b-4ef9-812b-882268796473 could not be found. Aug 31 16:30:07.397762 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8f7dc1e1-d75e-4e7a-b97d-999d92196daa tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Request method failure captured: Aug 31 16:30:07.397762 n-d-833090-16 devstack@n-api.service[128864]: request: DELETE /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473 HTTP/1.1 Aug 31 16:30:07.397762 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:30:07.397762 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:30:07.397762 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:30:07.397762 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:30:07.397762 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:30:07.397762 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:30:07.397762 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:30:07.397762 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:30:07.397762 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4qEc5AtkidsuCFEVOsKE6JRJgG3zRgW7cQ7X7_Pj1ygml5S6QFx5uHtU-PVO_a5NxyYSe4F1etDqaE98sTNFeT2lNZUd-Sgew_pe6BiKEO67OFPQRXju3FU5vu0HQszGxTnGI8adAujjwF-XHh3TjmeHO7aSbZPY8fsJH1JfRxZ_5g Aug 31 16:30:07.397762 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:30:07.397762 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:30:07.397762 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:30:07.397762 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:30:07.397762 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:30:07.397762 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:30:07.397762 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: b196bd92b2774a6898c39dc6e99b5674 Aug 31 16:30:07.397762 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-AttachVolumeTestJSON-166245674 Aug 31 16:30:07.397762 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:30:07.397762 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:30:07.397762 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b196bd92b2774a6898c39dc6e99b5674"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b196bd92b2774a6898c39dc6e99b5674"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b196bd92b2774a6898c39dc6e99b5674"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b196bd92b2774a6898c39dc6e99b5674", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:30:07.397762 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-AttachVolumeTestJSON-166245674 Aug 31 16:30:07.397762 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: b196bd92b2774a6898c39dc6e99b5674 Aug 31 16:30:07.397762 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-AttachVolumeTestJSON-166245674 Aug 31 16:30:07.397762 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-AttachVolumeTestJSON-166245674-project Aug 31 16:30:07.397762 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:30:07.397762 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:30:07.397762 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: b07308778f1f4b4aa44713715cb2dc5d Aug 31 16:30:07.397762 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-AttachVolumeTestJSON-166245674-project Aug 31 16:30:07.397762 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:30:07.397762 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 6e296817-752b-4ef9-812b-882268796473 could not be found. Aug 31 16:30:07.397762 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '6e296817-752b-4ef9-812b-882268796473'} Aug 31 16:30:07.397762 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:30:07.397762 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:30:07.397762 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:30:07.397762 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:30:07.397762 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:30:07.397762 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:30:07.397762 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:30:07.397762 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:30:07.397762 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:30:07.397762 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:30:07.397762 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e296817-752b-4ef9-812b-882268796473 could not be found. Aug 31 16:30:07.397762 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:30:07.397762 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:30:07.397762 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:30:07.397762 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:30:07.397762 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:30:07.397762 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:30:07.397762 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:30:07.397762 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:30:07.397762 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:30:07.397762 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:30:07.397762 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:30:07.397762 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:30:07.397762 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:30:07.397762 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:30:07.397762 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:30:07.397762 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:30:07.397762 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:30:07.397762 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:30:07.402309 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e296817-752b-4ef9-812b-882268796473 could not be found. Aug 31 16:30:07.402309 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:30:07.402309 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:30:07.402309 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:30:07.402309 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:30:07.402309 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:30:07.402309 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:30:07.402309 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:30:07.402309 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:30:07.402309 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e296817-752b-4ef9-812b-882268796473 could not be found. Aug 31 16:30:07.402309 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:30:07.408876 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8f7dc1e1-d75e-4e7a-b97d-999d92196daa tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Returning 404 to user: Instance 6e296817-752b-4ef9-812b-882268796473 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:30:07.417224 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8f7dc1e1-d75e-4e7a-b97d-999d92196daa tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "DELETE /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473" status: 404 len: 111 microversion: 2.1 time: 0.122913 Aug 31 16:30:07.423554 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3275/6364] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:30:07 2022] DELETE /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:30:07.433316 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a04f48f8-262f-4f90-b99d-77bc0afa5ab4 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:07.434839 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a04f48f8-262f-4f90-b99d-77bc0afa5ab4 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 6e296817-752b-4ef9-812b-882268796473] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:07.453702 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a04f48f8-262f-4f90-b99d-77bc0afa5ab4 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:07.460383 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a04f48f8-262f-4f90-b99d-77bc0afa5ab4 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:07.461199 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a04f48f8-262f-4f90-b99d-77bc0afa5ab4 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:07.466507 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a04f48f8-262f-4f90-b99d-77bc0afa5ab4 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:07.467853 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a04f48f8-262f-4f90-b99d-77bc0afa5ab4 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:07.470949 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a04f48f8-262f-4f90-b99d-77bc0afa5ab4 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:07.533771 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-a04f48f8-262f-4f90-b99d-77bc0afa5ab4 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] HTTP exception thrown: Instance 6e296817-752b-4ef9-812b-882268796473 could not be found. Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a04f48f8-262f-4f90-b99d-77bc0afa5ab4 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Request method failure captured: Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473 HTTP/1.1 Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4qEc5AtkidsuCFEVOsKE6JRJgG3zRgW7cQ7X7_Pj1ygml5S6QFx5uHtU-PVO_a5NxyYSe4F1etDqaE98sTNFeT2lNZUd-Sgew_pe6BiKEO67OFPQRXju3FU5vu0HQszGxTnGI8adAujjwF-XHh3TjmeHO7aSbZPY8fsJH1JfRxZ_5g Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: b196bd92b2774a6898c39dc6e99b5674 Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-AttachVolumeTestJSON-166245674 Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b196bd92b2774a6898c39dc6e99b5674"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b196bd92b2774a6898c39dc6e99b5674"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b196bd92b2774a6898c39dc6e99b5674"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b196bd92b2774a6898c39dc6e99b5674", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-AttachVolumeTestJSON-166245674 Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: b196bd92b2774a6898c39dc6e99b5674 Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-AttachVolumeTestJSON-166245674 Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-AttachVolumeTestJSON-166245674-project Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: b07308778f1f4b4aa44713715cb2dc5d Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-AttachVolumeTestJSON-166245674-project Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 6e296817-752b-4ef9-812b-882268796473 could not be found. Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '6e296817-752b-4ef9-812b-882268796473'} Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e296817-752b-4ef9-812b-882268796473 could not be found. Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e296817-752b-4ef9-812b-882268796473 could not be found. Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:30:07.537318 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:30:07.541247 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:30:07.541247 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:30:07.541247 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:30:07.541247 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:30:07.541247 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:30:07.541247 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e296817-752b-4ef9-812b-882268796473 could not be found. Aug 31 16:30:07.541247 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:30:07.541247 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a04f48f8-262f-4f90-b99d-77bc0afa5ab4 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Returning 404 to user: Instance 6e296817-752b-4ef9-812b-882268796473 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:30:07.541247 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a04f48f8-262f-4f90-b99d-77bc0afa5ab4 tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473" status: 404 len: 111 microversion: 2.1 time: 0.111762 Aug 31 16:30:07.546752 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3090/6365] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:07 2022] GET /compute/v2.1/servers/6e296817-752b-4ef9-812b-882268796473 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:30:07.672673 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b8f30c4f-a391-4198-ac67-a8c933d054f0 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:07.673335 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b8f30c4f-a391-4198-ac67-a8c933d054f0 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] [instance: e77fc40b-336f-4886-8a87-9376431bec27] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:07.684923 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b8f30c4f-a391-4198-ac67-a8c933d054f0 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:07.694582 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b8f30c4f-a391-4198-ac67-a8c933d054f0 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:07.696489 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b8f30c4f-a391-4198-ac67-a8c933d054f0 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:07.697278 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b8f30c4f-a391-4198-ac67-a8c933d054f0 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:07.697774 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b8f30c4f-a391-4198-ac67-a8c933d054f0 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:07.706862 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b8f30c4f-a391-4198-ac67-a8c933d054f0 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:08.050345 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b8f30c4f-a391-4198-ac67-a8c933d054f0 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7edf821004c3fbca0a0b46de95799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e75ee3acbd4ad1aa0a8cb826f02bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:08.060945 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b8f30c4f-a391-4198-ac67-a8c933d054f0 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] 10.222.0.50 "GET /compute/v2.1/servers/e77fc40b-336f-4886-8a87-9376431bec27" status: 200 len: 1283 microversion: 2.1 time: 0.392667 Aug 31 16:30:08.080034 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3276/6366] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:07 2022] GET /compute/v2.1/servers/e77fc40b-336f-4886-8a87-9376431bec27 => generated 1283 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:30:09.086684 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ef49760b-abf0-49bf-8587-3350d566f713 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:09.087292 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ef49760b-abf0-49bf-8587-3350d566f713 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] [instance: e77fc40b-336f-4886-8a87-9376431bec27] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:09.103012 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef49760b-abf0-49bf-8587-3350d566f713 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:09.103785 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef49760b-abf0-49bf-8587-3350d566f713 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:09.106740 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef49760b-abf0-49bf-8587-3350d566f713 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:09.107654 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef49760b-abf0-49bf-8587-3350d566f713 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:09.108268 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef49760b-abf0-49bf-8587-3350d566f713 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:09.108838 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef49760b-abf0-49bf-8587-3350d566f713 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:09.505965 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ef49760b-abf0-49bf-8587-3350d566f713 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7edf821004c3fbca0a0b46de95799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e75ee3acbd4ad1aa0a8cb826f02bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:09.529178 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ef49760b-abf0-49bf-8587-3350d566f713 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] 10.222.0.50 "GET /compute/v2.1/servers/e77fc40b-336f-4886-8a87-9376431bec27" status: 200 len: 1271 microversion: 2.1 time: 0.443388 Aug 31 16:30:09.530173 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3091/6367] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:09 2022] GET /compute/v2.1/servers/e77fc40b-336f-4886-8a87-9376431bec27 => generated 1271 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:30:10.555372 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-33df87d3-31ee-4d84-beb1-8e25149f0282 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:10.555915 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-33df87d3-31ee-4d84-beb1-8e25149f0282 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] [instance: e77fc40b-336f-4886-8a87-9376431bec27] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:10.573213 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33df87d3-31ee-4d84-beb1-8e25149f0282 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:10.573725 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33df87d3-31ee-4d84-beb1-8e25149f0282 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:10.574198 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33df87d3-31ee-4d84-beb1-8e25149f0282 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:10.574926 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33df87d3-31ee-4d84-beb1-8e25149f0282 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:10.586979 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33df87d3-31ee-4d84-beb1-8e25149f0282 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:10.587614 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33df87d3-31ee-4d84-beb1-8e25149f0282 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:11.251895 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-33df87d3-31ee-4d84-beb1-8e25149f0282 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7edf821004c3fbca0a0b46de95799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e75ee3acbd4ad1aa0a8cb826f02bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:11.274968 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-33df87d3-31ee-4d84-beb1-8e25149f0282 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] 10.222.0.50 "GET /compute/v2.1/servers/e77fc40b-336f-4886-8a87-9376431bec27" status: 200 len: 1271 microversion: 2.1 time: 0.722879 Aug 31 16:30:11.278868 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3277/6368] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:10 2022] GET /compute/v2.1/servers/e77fc40b-336f-4886-8a87-9376431bec27 => generated 1271 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:30:11.706972 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8d0d1295-6c69-4fbd-a696-d72af7937166 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:11.707627 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8d0d1295-6c69-4fbd-a696-d72af7937166 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 52207df3-de0e-4f94-aba2-2d0173ef3ba3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:11.719234 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d0d1295-6c69-4fbd-a696-d72af7937166 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:11.719712 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d0d1295-6c69-4fbd-a696-d72af7937166 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:11.720345 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d0d1295-6c69-4fbd-a696-d72af7937166 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:11.721286 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d0d1295-6c69-4fbd-a696-d72af7937166 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:11.721882 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d0d1295-6c69-4fbd-a696-d72af7937166 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:11.722491 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d0d1295-6c69-4fbd-a696-d72af7937166 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:11.790342 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8d0d1295-6c69-4fbd-a696-d72af7937166 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 52207df3-de0e-4f94-aba2-2d0173ef3ba3] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:30:12.133197 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8d0d1295-6c69-4fbd-a696-d72af7937166 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "DELETE /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3" status: 204 len: 0 microversion: 2.1 time: 0.428696 Aug 31 16:30:12.149241 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3092/6369] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:30:11 2022] DELETE /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:30:12.166963 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-eddc2880-6fb8-4ccf-872d-78c6133238fe tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:12.170057 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-eddc2880-6fb8-4ccf-872d-78c6133238fe tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 52207df3-de0e-4f94-aba2-2d0173ef3ba3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:12.195214 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-eddc2880-6fb8-4ccf-872d-78c6133238fe tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:12.195684 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-eddc2880-6fb8-4ccf-872d-78c6133238fe tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:12.196148 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-eddc2880-6fb8-4ccf-872d-78c6133238fe tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:12.197533 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-eddc2880-6fb8-4ccf-872d-78c6133238fe tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:12.198018 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-eddc2880-6fb8-4ccf-872d-78c6133238fe tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:12.199012 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-eddc2880-6fb8-4ccf-872d-78c6133238fe tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:12.295911 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6638e210-1c72-418e-b750-5371bcb516f8 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:12.296621 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6638e210-1c72-418e-b750-5371bcb516f8 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] [instance: e77fc40b-336f-4886-8a87-9376431bec27] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:12.308899 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6638e210-1c72-418e-b750-5371bcb516f8 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:12.309769 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6638e210-1c72-418e-b750-5371bcb516f8 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:12.310607 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6638e210-1c72-418e-b750-5371bcb516f8 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:12.311327 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6638e210-1c72-418e-b750-5371bcb516f8 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:12.311788 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6638e210-1c72-418e-b750-5371bcb516f8 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:12.312216 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6638e210-1c72-418e-b750-5371bcb516f8 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:12.561481 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6638e210-1c72-418e-b750-5371bcb516f8 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7edf821004c3fbca0a0b46de95799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e75ee3acbd4ad1aa0a8cb826f02bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:12.573543 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6638e210-1c72-418e-b750-5371bcb516f8 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] 10.222.0.50 "GET /compute/v2.1/servers/e77fc40b-336f-4886-8a87-9376431bec27" status: 200 len: 1271 microversion: 2.1 time: 0.281773 Aug 31 16:30:12.574728 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3093/6370] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:12 2022] GET /compute/v2.1/servers/e77fc40b-336f-4886-8a87-9376431bec27 => generated 1271 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:30:12.586592 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-eddc2880-6fb8-4ccf-872d-78c6133238fe tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:12.600378 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-eddc2880-6fb8-4ccf-872d-78c6133238fe tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3" status: 200 len: 1410 microversion: 2.1 time: 0.439202 Aug 31 16:30:12.601091 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3278/6371] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:12 2022] GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3 => generated 1410 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:30:13.597775 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1c92ac50-de4c-42d7-8044-777e0b08253e tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:13.598764 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1c92ac50-de4c-42d7-8044-777e0b08253e tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] [instance: e77fc40b-336f-4886-8a87-9376431bec27] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:13.620564 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c92ac50-de4c-42d7-8044-777e0b08253e tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:13.621597 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c92ac50-de4c-42d7-8044-777e0b08253e tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:13.622183 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ef85f2a3-6260-4e83-a623-ce1d3daecbfb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:13.623183 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c92ac50-de4c-42d7-8044-777e0b08253e tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:13.623809 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ef85f2a3-6260-4e83-a623-ce1d3daecbfb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 52207df3-de0e-4f94-aba2-2d0173ef3ba3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:13.626224 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c92ac50-de4c-42d7-8044-777e0b08253e tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:13.626834 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c92ac50-de4c-42d7-8044-777e0b08253e tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:13.628073 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1c92ac50-de4c-42d7-8044-777e0b08253e tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:13.639672 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ef85f2a3-6260-4e83-a623-ce1d3daecbfb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:13.641702 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ef85f2a3-6260-4e83-a623-ce1d3daecbfb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:13.643275 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ef85f2a3-6260-4e83-a623-ce1d3daecbfb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:13.645439 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ef85f2a3-6260-4e83-a623-ce1d3daecbfb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:13.649782 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ef85f2a3-6260-4e83-a623-ce1d3daecbfb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:13.650999 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ef85f2a3-6260-4e83-a623-ce1d3daecbfb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:14.021523 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1c92ac50-de4c-42d7-8044-777e0b08253e tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7edf821004c3fbca0a0b46de95799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e75ee3acbd4ad1aa0a8cb826f02bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:14.037976 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1c92ac50-de4c-42d7-8044-777e0b08253e tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] 10.222.0.50 "GET /compute/v2.1/servers/e77fc40b-336f-4886-8a87-9376431bec27" status: 200 len: 1271 microversion: 2.1 time: 0.444910 Aug 31 16:30:14.038887 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3094/6372] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:13 2022] GET /compute/v2.1/servers/e77fc40b-336f-4886-8a87-9376431bec27 => generated 1271 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:30:14.057011 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ef85f2a3-6260-4e83-a623-ce1d3daecbfb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:14.069451 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ef85f2a3-6260-4e83-a623-ce1d3daecbfb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3" status: 200 len: 1410 microversion: 2.1 time: 0.451991 Aug 31 16:30:14.071065 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3279/6373] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:13 2022] GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3 => generated 1410 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:30:14.407583 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4f25126e-52bf-40f0-892a-57bb1dde293b tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:14.408628 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4f25126e-52bf-40f0-892a-57bb1dde293b tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:14.419850 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f25126e-52bf-40f0-892a-57bb1dde293b tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:14.421066 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f25126e-52bf-40f0-892a-57bb1dde293b tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:14.421743 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f25126e-52bf-40f0-892a-57bb1dde293b tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:14.422882 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f25126e-52bf-40f0-892a-57bb1dde293b tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:14.425243 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f25126e-52bf-40f0-892a-57bb1dde293b tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:14.425981 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f25126e-52bf-40f0-892a-57bb1dde293b tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:14.448195 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-4f25126e-52bf-40f0-892a-57bb1dde293b tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] HTTP exception thrown: Instance 27172556-b12c-4974-815d-5f893a07506b could not be found. Aug 31 16:30:14.450883 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4f25126e-52bf-40f0-892a-57bb1dde293b tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Request method failure captured: Aug 31 16:30:14.450883 n-d-833090-16 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b HTTP/1.1 Aug 31 16:30:14.450883 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:30:14.450883 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:30:14.450883 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:30:14.450883 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:30:14.450883 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:30:14.450883 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:30:14.450883 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:30:14.450883 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:30:14.450883 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4qEc5AtkidsuCFEVOsKE6JRJgG3zRgW7cQ7X7_Pj1ygml5S6QFx5uHtU-PVO_a5NxyYSe4F1etDqaE98sTNFeT2lNZUd-Sgew_pe6BiKEO67OFPQRXju3FU5vu0HQszGxTnGI8adAujjwF-XHh3TjmeHO7aSbZPY8fsJH1JfRxZ_5g Aug 31 16:30:14.450883 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:30:14.450883 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:30:14.450883 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:30:14.450883 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:30:14.450883 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:30:14.450883 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:30:14.450883 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: b196bd92b2774a6898c39dc6e99b5674 Aug 31 16:30:14.450883 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-AttachVolumeTestJSON-166245674 Aug 31 16:30:14.450883 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:30:14.450883 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:30:14.450883 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b196bd92b2774a6898c39dc6e99b5674"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b196bd92b2774a6898c39dc6e99b5674"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b196bd92b2774a6898c39dc6e99b5674"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b196bd92b2774a6898c39dc6e99b5674", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:30:14.450883 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-AttachVolumeTestJSON-166245674 Aug 31 16:30:14.450883 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: b196bd92b2774a6898c39dc6e99b5674 Aug 31 16:30:14.450883 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-AttachVolumeTestJSON-166245674 Aug 31 16:30:14.450883 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-AttachVolumeTestJSON-166245674-project Aug 31 16:30:14.450883 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:30:14.450883 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:30:14.450883 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: b07308778f1f4b4aa44713715cb2dc5d Aug 31 16:30:14.450883 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-AttachVolumeTestJSON-166245674-project Aug 31 16:30:14.450883 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:30:14.450883 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 27172556-b12c-4974-815d-5f893a07506b could not be found. Aug 31 16:30:14.450883 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '27172556-b12c-4974-815d-5f893a07506b'} Aug 31 16:30:14.450883 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:30:14.450883 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:30:14.450883 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:30:14.450883 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:30:14.450883 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:30:14.450883 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:30:14.450883 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:30:14.450883 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:30:14.450883 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:30:14.450883 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:30:14.450883 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27172556-b12c-4974-815d-5f893a07506b could not be found. Aug 31 16:30:14.450883 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:30:14.450883 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:30:14.450883 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:30:14.450883 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:30:14.450883 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:30:14.450883 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:30:14.450883 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:30:14.450883 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:30:14.450883 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:30:14.450883 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:30:14.450883 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:30:14.450883 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:30:14.450883 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:30:14.450883 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:30:14.450883 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:30:14.450883 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:30:14.450883 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:30:14.450883 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:30:14.454819 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27172556-b12c-4974-815d-5f893a07506b could not be found. Aug 31 16:30:14.454819 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:30:14.454819 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:30:14.454819 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:30:14.454819 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:30:14.454819 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:30:14.454819 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:30:14.454819 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:30:14.454819 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:30:14.454819 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27172556-b12c-4974-815d-5f893a07506b could not be found. Aug 31 16:30:14.454819 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:30:14.461417 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4f25126e-52bf-40f0-892a-57bb1dde293b tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Returning 404 to user: Instance 27172556-b12c-4974-815d-5f893a07506b could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:30:14.462696 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4f25126e-52bf-40f0-892a-57bb1dde293b tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "DELETE /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b" status: 404 len: 111 microversion: 2.1 time: 0.061228 Aug 31 16:30:14.466717 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3095/6374] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:30:14 2022] DELETE /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:30:14.471584 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e9250b5d-d8d1-4b7b-bad7-3a28854382de tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:14.472216 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e9250b5d-d8d1-4b7b-bad7-3a28854382de tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] [instance: 27172556-b12c-4974-815d-5f893a07506b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:14.484569 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e9250b5d-d8d1-4b7b-bad7-3a28854382de tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:14.485081 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e9250b5d-d8d1-4b7b-bad7-3a28854382de tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:14.485757 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e9250b5d-d8d1-4b7b-bad7-3a28854382de tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:14.486697 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e9250b5d-d8d1-4b7b-bad7-3a28854382de tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:14.487375 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e9250b5d-d8d1-4b7b-bad7-3a28854382de tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:14.489161 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e9250b5d-d8d1-4b7b-bad7-3a28854382de tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:14.524209 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-e9250b5d-d8d1-4b7b-bad7-3a28854382de tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] HTTP exception thrown: Instance 27172556-b12c-4974-815d-5f893a07506b could not be found. Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e9250b5d-d8d1-4b7b-bad7-3a28854382de tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Request method failure captured: Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b HTTP/1.1 Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4qEc5AtkidsuCFEVOsKE6JRJgG3zRgW7cQ7X7_Pj1ygml5S6QFx5uHtU-PVO_a5NxyYSe4F1etDqaE98sTNFeT2lNZUd-Sgew_pe6BiKEO67OFPQRXju3FU5vu0HQszGxTnGI8adAujjwF-XHh3TjmeHO7aSbZPY8fsJH1JfRxZ_5g Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: b196bd92b2774a6898c39dc6e99b5674 Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-AttachVolumeTestJSON-166245674 Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b196bd92b2774a6898c39dc6e99b5674"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b196bd92b2774a6898c39dc6e99b5674"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b196bd92b2774a6898c39dc6e99b5674"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b196bd92b2774a6898c39dc6e99b5674", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-AttachVolumeTestJSON-166245674 Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: b196bd92b2774a6898c39dc6e99b5674 Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-AttachVolumeTestJSON-166245674 Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-AttachVolumeTestJSON-166245674-project Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: b07308778f1f4b4aa44713715cb2dc5d Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-AttachVolumeTestJSON-166245674-project Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 27172556-b12c-4974-815d-5f893a07506b could not be found. Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '27172556-b12c-4974-815d-5f893a07506b'} Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27172556-b12c-4974-815d-5f893a07506b could not be found. Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27172556-b12c-4974-815d-5f893a07506b could not be found. Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:30:14.525791 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:30:14.529774 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:30:14.529774 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:30:14.529774 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:30:14.529774 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:30:14.529774 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:30:14.529774 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27172556-b12c-4974-815d-5f893a07506b could not be found. Aug 31 16:30:14.529774 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:30:14.529774 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e9250b5d-d8d1-4b7b-bad7-3a28854382de tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] Returning 404 to user: Instance 27172556-b12c-4974-815d-5f893a07506b could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:30:14.529774 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e9250b5d-d8d1-4b7b-bad7-3a28854382de tempest-AttachVolumeTestJSON-166245674 tempest-AttachVolumeTestJSON-166245674-project] 10.222.0.50 "GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b" status: 404 len: 111 microversion: 2.1 time: 0.059573 Aug 31 16:30:14.534984 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3280/6375] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:14 2022] GET /compute/v2.1/servers/27172556-b12c-4974-815d-5f893a07506b => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:30:14.978382 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-bc6ce1aa-c9b9-4ece-8e96-7b9f7f80d6a9 req-1442a04b-10a1-4280-9cc4-27e6e03eba22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52207df3-de0e-4f94-aba2-2d0173ef3ba3", "name": "network-vif-deleted", "tag": "67a45c7a-fd48-45b3-a526-c4bbb69f89b9"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:30:14.988776 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-bc6ce1aa-c9b9-4ece-8e96-7b9f7f80d6a9 req-1442a04b-10a1-4280-9cc4-27e6e03eba22 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:14.989249 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-bc6ce1aa-c9b9-4ece-8e96-7b9f7f80d6a9 req-1442a04b-10a1-4280-9cc4-27e6e03eba22 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:14.989673 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-bc6ce1aa-c9b9-4ece-8e96-7b9f7f80d6a9 req-1442a04b-10a1-4280-9cc4-27e6e03eba22 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:15.003065 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-bc6ce1aa-c9b9-4ece-8e96-7b9f7f80d6a9 req-1442a04b-10a1-4280-9cc4-27e6e03eba22 service nova] Creating event network-vif-deleted:67a45c7a-fd48-45b3-a526-c4bbb69f89b9 for instance 52207df3-de0e-4f94-aba2-2d0173ef3ba3 on n-h2-833090-16 Aug 31 16:30:15.008971 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-bc6ce1aa-c9b9-4ece-8e96-7b9f7f80d6a9 req-1442a04b-10a1-4280-9cc4-27e6e03eba22 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034781 Aug 31 16:30:15.013124 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3096/6376] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:30:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:30:15.060863 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ef5b5e11-13b0-4888-8c19-15644a9186b8 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:15.062279 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ef5b5e11-13b0-4888-8c19-15644a9186b8 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] [instance: e77fc40b-336f-4886-8a87-9376431bec27] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:15.079613 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ef5b5e11-13b0-4888-8c19-15644a9186b8 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:15.080129 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ef5b5e11-13b0-4888-8c19-15644a9186b8 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:15.080579 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ef5b5e11-13b0-4888-8c19-15644a9186b8 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:15.082193 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ef5b5e11-13b0-4888-8c19-15644a9186b8 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:15.084840 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ef5b5e11-13b0-4888-8c19-15644a9186b8 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:15.085723 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ef5b5e11-13b0-4888-8c19-15644a9186b8 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:15.097159 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cfafb503-a668-4d8b-b24b-0fbf0d8afd68 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:15.099799 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cfafb503-a668-4d8b-b24b-0fbf0d8afd68 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 52207df3-de0e-4f94-aba2-2d0173ef3ba3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:15.116726 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:30:15.120393 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cfafb503-a668-4d8b-b24b-0fbf0d8afd68 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:15.121987 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cfafb503-a668-4d8b-b24b-0fbf0d8afd68 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:15.123266 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cfafb503-a668-4d8b-b24b-0fbf0d8afd68 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:15.124710 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cfafb503-a668-4d8b-b24b-0fbf0d8afd68 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:15.134067 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cfafb503-a668-4d8b-b24b-0fbf0d8afd68 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:15.134578 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cfafb503-a668-4d8b-b24b-0fbf0d8afd68 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:15.437509 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cfafb503-a668-4d8b-b24b-0fbf0d8afd68 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:15.448710 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cfafb503-a668-4d8b-b24b-0fbf0d8afd68 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3" status: 200 len: 1202 microversion: 2.1 time: 0.358042 Aug 31 16:30:15.449245 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3097/6377] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:15 2022] GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3 => generated 1202 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:30:15.660257 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ef5b5e11-13b0-4888-8c19-15644a9186b8 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7edf821004c3fbca0a0b46de95799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e75ee3acbd4ad1aa0a8cb826f02bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:15.684287 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ef5b5e11-13b0-4888-8c19-15644a9186b8 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] 10.222.0.50 "GET /compute/v2.1/servers/e77fc40b-336f-4886-8a87-9376431bec27" status: 200 len: 1271 microversion: 2.1 time: 0.628785 Aug 31 16:30:15.689243 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3281/6378] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:15 2022] GET /compute/v2.1/servers/e77fc40b-336f-4886-8a87-9376431bec27 => generated 1271 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:30:16.471810 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a904f3b9-e66e-4d56-a5d1-841fed7d0187 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:16.472596 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a904f3b9-e66e-4d56-a5d1-841fed7d0187 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 52207df3-de0e-4f94-aba2-2d0173ef3ba3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:16.480299 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a904f3b9-e66e-4d56-a5d1-841fed7d0187 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:16.480921 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a904f3b9-e66e-4d56-a5d1-841fed7d0187 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:16.481560 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a904f3b9-e66e-4d56-a5d1-841fed7d0187 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:16.482615 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a904f3b9-e66e-4d56-a5d1-841fed7d0187 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:16.483287 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a904f3b9-e66e-4d56-a5d1-841fed7d0187 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:16.483921 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a904f3b9-e66e-4d56-a5d1-841fed7d0187 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:16.573804 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a904f3b9-e66e-4d56-a5d1-841fed7d0187 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:16.591614 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a904f3b9-e66e-4d56-a5d1-841fed7d0187 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3" status: 200 len: 1202 microversion: 2.1 time: 0.126283 Aug 31 16:30:16.602603 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3098/6379] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:16 2022] GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3 => generated 1202 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:30:16.710120 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-93b06251-a1c2-4a3c-b3a5-523e3194daf7 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:16.713354 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-93b06251-a1c2-4a3c-b3a5-523e3194daf7 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] [instance: e77fc40b-336f-4886-8a87-9376431bec27] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:16.726177 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-93b06251-a1c2-4a3c-b3a5-523e3194daf7 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:16.730131 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-93b06251-a1c2-4a3c-b3a5-523e3194daf7 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:16.732009 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-93b06251-a1c2-4a3c-b3a5-523e3194daf7 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:16.732841 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-93b06251-a1c2-4a3c-b3a5-523e3194daf7 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:16.734165 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-93b06251-a1c2-4a3c-b3a5-523e3194daf7 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:16.734896 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-93b06251-a1c2-4a3c-b3a5-523e3194daf7 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:16.988762 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-93b06251-a1c2-4a3c-b3a5-523e3194daf7 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7edf821004c3fbca0a0b46de95799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e75ee3acbd4ad1aa0a8cb826f02bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:16.998128 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-93b06251-a1c2-4a3c-b3a5-523e3194daf7 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] 10.222.0.50 "GET /compute/v2.1/servers/e77fc40b-336f-4886-8a87-9376431bec27" status: 200 len: 1271 microversion: 2.1 time: 0.291787 Aug 31 16:30:16.999103 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3282/6380] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:16 2022] GET /compute/v2.1/servers/e77fc40b-336f-4886-8a87-9376431bec27 => generated 1271 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:30:17.628902 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7e2c7f2c-9ddb-43e9-b00f-afd77bfb6822 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:17.643858 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7e2c7f2c-9ddb-43e9-b00f-afd77bfb6822 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 52207df3-de0e-4f94-aba2-2d0173ef3ba3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:17.671587 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e2c7f2c-9ddb-43e9-b00f-afd77bfb6822 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:17.674619 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e2c7f2c-9ddb-43e9-b00f-afd77bfb6822 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:17.675968 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e2c7f2c-9ddb-43e9-b00f-afd77bfb6822 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:17.677941 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e2c7f2c-9ddb-43e9-b00f-afd77bfb6822 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:17.691151 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e2c7f2c-9ddb-43e9-b00f-afd77bfb6822 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:17.691698 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e2c7f2c-9ddb-43e9-b00f-afd77bfb6822 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:17.785830 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7e2c7f2c-9ddb-43e9-b00f-afd77bfb6822 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:17.794786 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7e2c7f2c-9ddb-43e9-b00f-afd77bfb6822 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3" status: 200 len: 1202 microversion: 2.1 time: 0.181194 Aug 31 16:30:17.806880 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3099/6381] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:17 2022] GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3 => generated 1202 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:30:18.021923 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-107b81bc-de95-4778-a5c7-9bcf1aab4eed tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:18.023304 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-107b81bc-de95-4778-a5c7-9bcf1aab4eed tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] [instance: e77fc40b-336f-4886-8a87-9376431bec27] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:18.039194 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-107b81bc-de95-4778-a5c7-9bcf1aab4eed tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:18.040515 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-107b81bc-de95-4778-a5c7-9bcf1aab4eed tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:18.042786 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-107b81bc-de95-4778-a5c7-9bcf1aab4eed tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:18.045167 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-107b81bc-de95-4778-a5c7-9bcf1aab4eed tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:18.045829 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-107b81bc-de95-4778-a5c7-9bcf1aab4eed tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:18.047305 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-107b81bc-de95-4778-a5c7-9bcf1aab4eed tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:18.136882 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-53c3c763-b413-4f6a-9e26-8d46ca646dca req-db606e84-5888-4d31-8fdf-65c195ffc501 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e77fc40b-336f-4886-8a87-9376431bec27", "name": "network-vif-plugged", "status": "completed", "tag": "bb31973a-7cba-4adc-9ea9-a852d7c78acf"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:30:18.167820 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-53c3c763-b413-4f6a-9e26-8d46ca646dca req-db606e84-5888-4d31-8fdf-65c195ffc501 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:18.170378 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-53c3c763-b413-4f6a-9e26-8d46ca646dca req-db606e84-5888-4d31-8fdf-65c195ffc501 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:18.171394 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-53c3c763-b413-4f6a-9e26-8d46ca646dca req-db606e84-5888-4d31-8fdf-65c195ffc501 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:18.215730 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-53c3c763-b413-4f6a-9e26-8d46ca646dca req-db606e84-5888-4d31-8fdf-65c195ffc501 service nova] Creating event network-vif-plugged:bb31973a-7cba-4adc-9ea9-a852d7c78acf for instance e77fc40b-336f-4886-8a87-9376431bec27 on n-h1-833090-16 Aug 31 16:30:18.227155 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-53c3c763-b413-4f6a-9e26-8d46ca646dca req-db606e84-5888-4d31-8fdf-65c195ffc501 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094859 Aug 31 16:30:18.230655 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3100/6382] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:30:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:30:18.560671 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-107b81bc-de95-4778-a5c7-9bcf1aab4eed tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7edf821004c3fbca0a0b46de95799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e75ee3acbd4ad1aa0a8cb826f02bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:18.572898 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-107b81bc-de95-4778-a5c7-9bcf1aab4eed tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] 10.222.0.50 "GET /compute/v2.1/servers/e77fc40b-336f-4886-8a87-9376431bec27" status: 200 len: 1271 microversion: 2.1 time: 0.554408 Aug 31 16:30:18.578190 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3283/6383] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:18 2022] GET /compute/v2.1/servers/e77fc40b-336f-4886-8a87-9376431bec27 => generated 1271 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:30:18.817687 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a86b4de3-9532-4893-9ae6-bcdc10e7060b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:18.819066 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a86b4de3-9532-4893-9ae6-bcdc10e7060b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 52207df3-de0e-4f94-aba2-2d0173ef3ba3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:18.831318 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a86b4de3-9532-4893-9ae6-bcdc10e7060b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:18.831813 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a86b4de3-9532-4893-9ae6-bcdc10e7060b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:18.832287 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a86b4de3-9532-4893-9ae6-bcdc10e7060b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:18.833012 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a86b4de3-9532-4893-9ae6-bcdc10e7060b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:18.833464 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a86b4de3-9532-4893-9ae6-bcdc10e7060b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:18.833889 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a86b4de3-9532-4893-9ae6-bcdc10e7060b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:18.941099 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a86b4de3-9532-4893-9ae6-bcdc10e7060b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:18.954282 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:30:18.961661 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a86b4de3-9532-4893-9ae6-bcdc10e7060b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3" status: 200 len: 1202 microversion: 2.1 time: 0.149176 Aug 31 16:30:18.973176 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3101/6384] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:18 2022] GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3 => generated 1202 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:30:19.596194 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8a4b3f2a-ae73-49d3-9ac6-e09f8c2ca770 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:19.596901 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8a4b3f2a-ae73-49d3-9ac6-e09f8c2ca770 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] [instance: e77fc40b-336f-4886-8a87-9376431bec27] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:19.613262 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8a4b3f2a-ae73-49d3-9ac6-e09f8c2ca770 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:19.613862 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8a4b3f2a-ae73-49d3-9ac6-e09f8c2ca770 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:19.614917 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8a4b3f2a-ae73-49d3-9ac6-e09f8c2ca770 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:19.615653 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8a4b3f2a-ae73-49d3-9ac6-e09f8c2ca770 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:19.622548 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8a4b3f2a-ae73-49d3-9ac6-e09f8c2ca770 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:19.623336 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8a4b3f2a-ae73-49d3-9ac6-e09f8c2ca770 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:19.986406 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-54d219c9-1751-400e-82e9-b03bcb7e9507 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:19.987782 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-54d219c9-1751-400e-82e9-b03bcb7e9507 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 52207df3-de0e-4f94-aba2-2d0173ef3ba3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:20.002940 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:30:20.013791 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-54d219c9-1751-400e-82e9-b03bcb7e9507 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:20.014484 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-54d219c9-1751-400e-82e9-b03bcb7e9507 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:20.015234 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-54d219c9-1751-400e-82e9-b03bcb7e9507 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:20.016130 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-54d219c9-1751-400e-82e9-b03bcb7e9507 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:20.016705 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-54d219c9-1751-400e-82e9-b03bcb7e9507 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:20.017267 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-54d219c9-1751-400e-82e9-b03bcb7e9507 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:20.025595 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8a4b3f2a-ae73-49d3-9ac6-e09f8c2ca770 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7edf821004c3fbca0a0b46de95799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e75ee3acbd4ad1aa0a8cb826f02bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:20.050816 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8a4b3f2a-ae73-49d3-9ac6-e09f8c2ca770 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] 10.222.0.50 "GET /compute/v2.1/servers/e77fc40b-336f-4886-8a87-9376431bec27" status: 200 len: 1459 microversion: 2.1 time: 0.459378 Aug 31 16:30:20.061752 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3284/6385] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:19 2022] GET /compute/v2.1/servers/e77fc40b-336f-4886-8a87-9376431bec27 => generated 1459 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:30:20.084213 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5a2ff026-75df-4daa-a341-d949778f49bb tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:20.088999 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5a2ff026-75df-4daa-a341-d949778f49bb tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] [instance: e77fc40b-336f-4886-8a87-9376431bec27] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:20.109954 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5a2ff026-75df-4daa-a341-d949778f49bb tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:20.110717 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5a2ff026-75df-4daa-a341-d949778f49bb tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:20.111455 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5a2ff026-75df-4daa-a341-d949778f49bb tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:20.112578 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5a2ff026-75df-4daa-a341-d949778f49bb tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:20.113433 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5a2ff026-75df-4daa-a341-d949778f49bb tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:20.114450 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5a2ff026-75df-4daa-a341-d949778f49bb tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:20.256229 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-54d219c9-1751-400e-82e9-b03bcb7e9507 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:20.273116 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-54d219c9-1751-400e-82e9-b03bcb7e9507 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3" status: 200 len: 1202 microversion: 2.1 time: 0.291591 Aug 31 16:30:20.277786 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3102/6386] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:19 2022] GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3 => generated 1202 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:30:20.582689 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5a2ff026-75df-4daa-a341-d949778f49bb tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7edf821004c3fbca0a0b46de95799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e75ee3acbd4ad1aa0a8cb826f02bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:20.592726 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5a2ff026-75df-4daa-a341-d949778f49bb tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] 10.222.0.50 "GET /compute/v2.1/servers/e77fc40b-336f-4886-8a87-9376431bec27" status: 200 len: 1459 microversion: 2.1 time: 0.515195 Aug 31 16:30:20.594711 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3285/6387] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:20 2022] GET /compute/v2.1/servers/e77fc40b-336f-4886-8a87-9376431bec27 => generated 1459 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:30:21.298062 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-69dbf70c-f0cd-4d1f-a088-78b4f739dc23 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:21.298720 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-69dbf70c-f0cd-4d1f-a088-78b4f739dc23 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 52207df3-de0e-4f94-aba2-2d0173ef3ba3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:21.311394 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69dbf70c-f0cd-4d1f-a088-78b4f739dc23 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:21.311887 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69dbf70c-f0cd-4d1f-a088-78b4f739dc23 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:21.312325 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69dbf70c-f0cd-4d1f-a088-78b4f739dc23 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:21.313057 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69dbf70c-f0cd-4d1f-a088-78b4f739dc23 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:21.313509 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69dbf70c-f0cd-4d1f-a088-78b4f739dc23 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:21.313928 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-69dbf70c-f0cd-4d1f-a088-78b4f739dc23 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:21.445954 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-69dbf70c-f0cd-4d1f-a088-78b4f739dc23 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:21.454632 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-69dbf70c-f0cd-4d1f-a088-78b4f739dc23 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3" status: 200 len: 1202 microversion: 2.1 time: 0.160544 Aug 31 16:30:21.457645 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3103/6388] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:21 2022] GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3 => generated 1202 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:30:22.478777 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d13ae19d-6310-444c-b697-f1e1f4b88464 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:22.479406 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d13ae19d-6310-444c-b697-f1e1f4b88464 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 52207df3-de0e-4f94-aba2-2d0173ef3ba3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:22.483687 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=45 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:30:22.511226 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d13ae19d-6310-444c-b697-f1e1f4b88464 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:22.512053 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d13ae19d-6310-444c-b697-f1e1f4b88464 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:22.512477 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d13ae19d-6310-444c-b697-f1e1f4b88464 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:22.513244 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d13ae19d-6310-444c-b697-f1e1f4b88464 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:22.513805 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d13ae19d-6310-444c-b697-f1e1f4b88464 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:22.518738 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d13ae19d-6310-444c-b697-f1e1f4b88464 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:22.605590 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d13ae19d-6310-444c-b697-f1e1f4b88464 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:22.606424 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d13ae19d-6310-444c-b697-f1e1f4b88464 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:22.607092 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d13ae19d-6310-444c-b697-f1e1f4b88464 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:22.610716 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-d13ae19d-6310-444c-b697-f1e1f4b88464 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lazy-loading 'fault' on Instance uuid 52207df3-de0e-4f94-aba2-2d0173ef3ba3 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:30:22.768641 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d13ae19d-6310-444c-b697-f1e1f4b88464 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:22.780570 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d13ae19d-6310-444c-b697-f1e1f4b88464 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3" status: 200 len: 1207 microversion: 2.1 time: 0.305820 Aug 31 16:30:22.794626 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3286/6389] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:22 2022] GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3 => generated 1207 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:30:23.808428 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7d265781-5f86-4812-9595-452a8f83fe08 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:23.809840 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7d265781-5f86-4812-9595-452a8f83fe08 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 52207df3-de0e-4f94-aba2-2d0173ef3ba3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:23.821824 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7d265781-5f86-4812-9595-452a8f83fe08 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:23.825589 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7d265781-5f86-4812-9595-452a8f83fe08 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:23.828439 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7d265781-5f86-4812-9595-452a8f83fe08 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:23.830280 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7d265781-5f86-4812-9595-452a8f83fe08 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:23.831033 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7d265781-5f86-4812-9595-452a8f83fe08 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:23.836600 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7d265781-5f86-4812-9595-452a8f83fe08 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:23.865390 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-7d265781-5f86-4812-9595-452a8f83fe08 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] HTTP exception thrown: Instance 52207df3-de0e-4f94-aba2-2d0173ef3ba3 could not be found. Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7d265781-5f86-4812-9595-452a8f83fe08 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Request method failure captured: Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3 HTTP/1.1 Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4sA8QatsiRw58KL4D-GJAaR1X9zBGwbu0cNuaHi16Tl8K5LhZ4dthUjdeeybVrZ6FkLiuj0CnwnGa_AqwqzkMsKdZfTNQhjMqXfHtEAV5ID9oXbOsK0vGNgY-jRlE7qor7NeFM7QGwhr8KE3TJ70ugNQcxhI7ZJIKzx49vTu_Rhy18 Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 32245d85aee64f69865d98656133a539 Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-TestVolumeBootPattern-1732723367 Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/32245d85aee64f69865d98656133a539"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/32245d85aee64f69865d98656133a539"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/32245d85aee64f69865d98656133a539"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_32245d85aee64f69865d98656133a539", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-TestVolumeBootPattern-1732723367 Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 32245d85aee64f69865d98656133a539 Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-TestVolumeBootPattern-1732723367 Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-TestVolumeBootPattern-1732723367-project Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: fb76a89a8b8042edb7b6aaccb4f41ead Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-TestVolumeBootPattern-1732723367-project Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 52207df3-de0e-4f94-aba2-2d0173ef3ba3 could not be found. Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '52207df3-de0e-4f94-aba2-2d0173ef3ba3'} Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52207df3-de0e-4f94-aba2-2d0173ef3ba3 could not be found. Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52207df3-de0e-4f94-aba2-2d0173ef3ba3 could not be found. Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:30:23.868677 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:30:23.872701 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:30:23.872701 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:30:23.872701 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:30:23.872701 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:30:23.872701 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:30:23.872701 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52207df3-de0e-4f94-aba2-2d0173ef3ba3 could not be found. Aug 31 16:30:23.872701 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:30:23.881694 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7d265781-5f86-4812-9595-452a8f83fe08 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Returning 404 to user: Instance 52207df3-de0e-4f94-aba2-2d0173ef3ba3 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:30:23.882969 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7d265781-5f86-4812-9595-452a8f83fe08 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3" status: 404 len: 111 microversion: 2.1 time: 0.079949 Aug 31 16:30:23.885939 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3287/6390] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:23 2022] GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:30:23.949504 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-25e892db-ca9d-4be2-9b23-a405faff8396 tempest-VolumesSnapshotsTestJSON-1725915488 tempest-VolumesSnapshotsTestJSON-1725915488-project] Action: 'create', calling method: .version_select at 0x7fbb45bed4c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-517879232"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:30:24.393492 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-7afca147-dc21-4f19-907e-7d71369b4388 req-9ead703f-fe20-4fce-ad71-0e9e3868b79a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e77fc40b-336f-4886-8a87-9376431bec27", "tag": "bb31973a-7cba-4adc-9ea9-a852d7c78acf"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:30:24.417084 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7afca147-dc21-4f19-907e-7d71369b4388 req-9ead703f-fe20-4fce-ad71-0e9e3868b79a service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:24.418595 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7afca147-dc21-4f19-907e-7d71369b4388 req-9ead703f-fe20-4fce-ad71-0e9e3868b79a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:24.420824 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7afca147-dc21-4f19-907e-7d71369b4388 req-9ead703f-fe20-4fce-ad71-0e9e3868b79a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:24.463514 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-7afca147-dc21-4f19-907e-7d71369b4388 req-9ead703f-fe20-4fce-ad71-0e9e3868b79a service nova] Creating event network-changed:bb31973a-7cba-4adc-9ea9-a852d7c78acf for instance e77fc40b-336f-4886-8a87-9376431bec27 on n-h1-833090-16 Aug 31 16:30:24.483739 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-7afca147-dc21-4f19-907e-7d71369b4388 req-9ead703f-fe20-4fce-ad71-0e9e3868b79a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092592 Aug 31 16:30:24.484615 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3288/6391] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:30:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:30:24.604439 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-25e892db-ca9d-4be2-9b23-a405faff8396 tempest-VolumesSnapshotsTestJSON-1725915488 tempest-VolumesSnapshotsTestJSON-1725915488-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.149099 Aug 31 16:30:24.605748 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3104/6392] 10.222.0.50 () {60 vars in 1155 bytes} [Wed Aug 31 16:30:23 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 1152 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 31 16:30:24.622652 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9d680ef0-0c91-462f-9d09-7ec899902296 tempest-VolumesSnapshotsTestJSON-1725915488 tempest-VolumesSnapshotsTestJSON-1725915488-project] Calling method '.version_select at 0x7fbb46e01160>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:24.709743 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9d680ef0-0c91-462f-9d09-7ec899902296 tempest-VolumesSnapshotsTestJSON-1725915488 tempest-VolumesSnapshotsTestJSON-1725915488-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/5087a4cb-58cd-4efe-9695-1fa6fd44f185" status: 200 len: 344 microversion: 2.1 time: 0.094672 Aug 31 16:30:24.710746 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3289/6393] 10.222.0.50 () {58 vars in 1245 bytes} [Wed Aug 31 16:30:24 2022] GET /compute/v2.1/os-volumes/5087a4cb-58cd-4efe-9695-1fa6fd44f185 => generated 344 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:30:25.728669 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b4bd2141-55e0-4f80-a226-fbc024718bdb tempest-VolumesSnapshotsTestJSON-1725915488 tempest-VolumesSnapshotsTestJSON-1725915488-project] Calling method '.version_select at 0x7fbb45bed820>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:25.866469 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b4bd2141-55e0-4f80-a226-fbc024718bdb tempest-VolumesSnapshotsTestJSON-1725915488 tempest-VolumesSnapshotsTestJSON-1725915488-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/5087a4cb-58cd-4efe-9695-1fa6fd44f185" status: 200 len: 344 microversion: 2.1 time: 0.144804 Aug 31 16:30:25.872361 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3105/6394] 10.222.0.50 () {58 vars in 1245 bytes} [Wed Aug 31 16:30:25 2022] GET /compute/v2.1/os-volumes/5087a4cb-58cd-4efe-9695-1fa6fd44f185 => generated 344 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:30:26.518456 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-974f3585-e08b-4ec5-8a9b-497e3ccecead req-ca13a800-a669-4312-b530-848dc168297d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e77fc40b-336f-4886-8a87-9376431bec27", "tag": "bb31973a-7cba-4adc-9ea9-a852d7c78acf"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:30:26.546783 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-974f3585-e08b-4ec5-8a9b-497e3ccecead req-ca13a800-a669-4312-b530-848dc168297d service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:26.547452 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-974f3585-e08b-4ec5-8a9b-497e3ccecead req-ca13a800-a669-4312-b530-848dc168297d service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:26.547914 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-974f3585-e08b-4ec5-8a9b-497e3ccecead req-ca13a800-a669-4312-b530-848dc168297d service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:26.594744 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-974f3585-e08b-4ec5-8a9b-497e3ccecead req-ca13a800-a669-4312-b530-848dc168297d service nova] Creating event network-changed:bb31973a-7cba-4adc-9ea9-a852d7c78acf for instance e77fc40b-336f-4886-8a87-9376431bec27 on n-h1-833090-16 Aug 31 16:30:26.604995 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-974f3585-e08b-4ec5-8a9b-497e3ccecead req-ca13a800-a669-4312-b530-848dc168297d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091239 Aug 31 16:30:26.606642 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3290/6395] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:30:26.881171 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2d8fe5a0-a475-41d1-9877-5303e8a89423 tempest-VolumesSnapshotsTestJSON-1725915488 tempest-VolumesSnapshotsTestJSON-1725915488-project] Calling method '.version_select at 0x7fbb45b34820>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:27.002713 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2d8fe5a0-a475-41d1-9877-5303e8a89423 tempest-VolumesSnapshotsTestJSON-1725915488 tempest-VolumesSnapshotsTestJSON-1725915488-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/5087a4cb-58cd-4efe-9695-1fa6fd44f185" status: 200 len: 345 microversion: 2.1 time: 0.126610 Aug 31 16:30:27.003647 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3106/6396] 10.222.0.50 () {58 vars in 1245 bytes} [Wed Aug 31 16:30:26 2022] GET /compute/v2.1/os-volumes/5087a4cb-58cd-4efe-9695-1fa6fd44f185 => generated 345 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:30:27.017205 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2fd1598a-3031-4906-bfc4-f1115fa63402 tempest-VolumesSnapshotsTestJSON-1725915488 tempest-VolumesSnapshotsTestJSON-1725915488-project] Action: 'create', calling method: .version_select at 0x7fbb45556ee0>, body: {"snapshot": {"volume_id": "5087a4cb-58cd-4efe-9695-1fa6fd44f185", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1848457344"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:30:27.263708 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b7b8abc9-5f07-40f7-a5b6-5a19395e0d93 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:27.264269 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b7b8abc9-5f07-40f7-a5b6-5a19395e0d93 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:27.278922 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7b8abc9-5f07-40f7-a5b6-5a19395e0d93 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:27.279919 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7b8abc9-5f07-40f7-a5b6-5a19395e0d93 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:27.280828 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7b8abc9-5f07-40f7-a5b6-5a19395e0d93 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:27.281769 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7b8abc9-5f07-40f7-a5b6-5a19395e0d93 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:27.282424 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7b8abc9-5f07-40f7-a5b6-5a19395e0d93 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:27.282862 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7b8abc9-5f07-40f7-a5b6-5a19395e0d93 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:27.344116 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-b7b8abc9-5f07-40f7-a5b6-5a19395e0d93 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] HTTP exception thrown: Instance a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd could not be found. Aug 31 16:30:27.346454 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b7b8abc9-5f07-40f7-a5b6-5a19395e0d93 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Request method failure captured: Aug 31 16:30:27.346454 n-d-833090-16 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd HTTP/1.1 Aug 31 16:30:27.346454 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:30:27.346454 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:30:27.346454 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:30:27.346454 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:30:27.346454 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:30:27.346454 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:30:27.346454 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:30:27.346454 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:30:27.346454 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4sA8QatsiRw58KL4D-GJAaR1X9zBGwbu0cNuaHi16Tl8K5LhZ4dthUjdeeybVrZ6FkLiuj0CnwnGa_AqwqzkMsKdZfTNQhjMqXfHtEAV5ID9oXbOsK0vGNgY-jRlE7qor7NeFM7QGwhr8KE3TJ70ugNQcxhI7ZJIKzx49vTu_Rhy18 Aug 31 16:30:27.346454 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:30:27.346454 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:30:27.346454 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:30:27.346454 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:30:27.346454 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:30:27.346454 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:30:27.346454 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 32245d85aee64f69865d98656133a539 Aug 31 16:30:27.346454 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-TestVolumeBootPattern-1732723367 Aug 31 16:30:27.346454 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:30:27.346454 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:30:27.346454 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/32245d85aee64f69865d98656133a539"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/32245d85aee64f69865d98656133a539"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/32245d85aee64f69865d98656133a539"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_32245d85aee64f69865d98656133a539", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:30:27.346454 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-TestVolumeBootPattern-1732723367 Aug 31 16:30:27.346454 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 32245d85aee64f69865d98656133a539 Aug 31 16:30:27.346454 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TestVolumeBootPattern-1732723367 Aug 31 16:30:27.346454 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-TestVolumeBootPattern-1732723367-project Aug 31 16:30:27.346454 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:30:27.346454 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:30:27.346454 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: fb76a89a8b8042edb7b6aaccb4f41ead Aug 31 16:30:27.346454 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-TestVolumeBootPattern-1732723367-project Aug 31 16:30:27.346454 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:30:27.346454 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd could not be found. Aug 31 16:30:27.346454 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd'} Aug 31 16:30:27.346454 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:30:27.346454 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:30:27.346454 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:30:27.346454 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:30:27.346454 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:30:27.346454 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:30:27.346454 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:30:27.346454 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:30:27.346454 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:30:27.346454 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:30:27.346454 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd could not be found. Aug 31 16:30:27.346454 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:30:27.346454 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:30:27.346454 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:30:27.346454 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:30:27.346454 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:30:27.346454 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:30:27.346454 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:30:27.346454 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:30:27.346454 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:30:27.346454 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:30:27.346454 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:30:27.346454 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:30:27.346454 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:30:27.346454 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:30:27.346454 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:30:27.346454 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:30:27.346454 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:30:27.346454 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:30:27.351627 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd could not be found. Aug 31 16:30:27.351627 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:30:27.351627 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:30:27.351627 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:30:27.351627 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:30:27.351627 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:30:27.351627 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:30:27.351627 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:30:27.351627 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:30:27.351627 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd could not be found. Aug 31 16:30:27.351627 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:30:27.356666 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b7b8abc9-5f07-40f7-a5b6-5a19395e0d93 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Returning 404 to user: Instance a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:30:27.357673 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b7b8abc9-5f07-40f7-a5b6-5a19395e0d93 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd" status: 404 len: 111 microversion: 2.1 time: 0.098944 Aug 31 16:30:27.361161 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3107/6397] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:30:27 2022] DELETE /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:30:27.371674 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-40cb4932-adce-4b0d-9170-a5e94929be56 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:27.375001 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-40cb4932-adce-4b0d-9170-a5e94929be56 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:27.393707 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-40cb4932-adce-4b0d-9170-a5e94929be56 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:27.397835 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-40cb4932-adce-4b0d-9170-a5e94929be56 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:27.401202 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-40cb4932-adce-4b0d-9170-a5e94929be56 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:27.402058 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-40cb4932-adce-4b0d-9170-a5e94929be56 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:27.403245 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-40cb4932-adce-4b0d-9170-a5e94929be56 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:27.404064 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-40cb4932-adce-4b0d-9170-a5e94929be56 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:27.434848 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2fd1598a-3031-4906-bfc4-f1115fa63402 tempest-VolumesSnapshotsTestJSON-1725915488 tempest-VolumesSnapshotsTestJSON-1725915488-project] 10.222.0.50 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.422140 Aug 31 16:30:27.435457 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3291/6398] 10.222.0.50 () {60 vars in 1162 bytes} [Wed Aug 31 16:30:27 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:30:27.441955 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-40cb4932-adce-4b0d-9170-a5e94929be56 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] HTTP exception thrown: Instance a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd could not be found. Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-40cb4932-adce-4b0d-9170-a5e94929be56 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Request method failure captured: Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd HTTP/1.1 Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4sA8QatsiRw58KL4D-GJAaR1X9zBGwbu0cNuaHi16Tl8K5LhZ4dthUjdeeybVrZ6FkLiuj0CnwnGa_AqwqzkMsKdZfTNQhjMqXfHtEAV5ID9oXbOsK0vGNgY-jRlE7qor7NeFM7QGwhr8KE3TJ70ugNQcxhI7ZJIKzx49vTu_Rhy18 Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 32245d85aee64f69865d98656133a539 Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-TestVolumeBootPattern-1732723367 Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/32245d85aee64f69865d98656133a539"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/32245d85aee64f69865d98656133a539"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/32245d85aee64f69865d98656133a539"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_32245d85aee64f69865d98656133a539", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-TestVolumeBootPattern-1732723367 Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 32245d85aee64f69865d98656133a539 Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TestVolumeBootPattern-1732723367 Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-TestVolumeBootPattern-1732723367-project Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: fb76a89a8b8042edb7b6aaccb4f41ead Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-TestVolumeBootPattern-1732723367-project Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd could not be found. Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd'} Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd could not be found. Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd could not be found. Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:30:27.446744 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:30:27.453754 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:30:27.453754 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:30:27.453754 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:30:27.453754 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:30:27.453754 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:30:27.453754 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd could not be found. Aug 31 16:30:27.453754 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:30:27.453754 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-40cb4932-adce-4b0d-9170-a5e94929be56 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Returning 404 to user: Instance a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:30:27.453754 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-40cb4932-adce-4b0d-9170-a5e94929be56 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd" status: 404 len: 111 microversion: 2.1 time: 0.085701 Aug 31 16:30:27.455068 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-edb61f8d-03eb-4a44-b424-dd537e924607 tempest-VolumesSnapshotsTestJSON-1725915488 tempest-VolumesSnapshotsTestJSON-1725915488-project] Calling method '.version_select at 0x7fbb461dc820>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:27.459016 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3108/6399] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:27 2022] GET /compute/v2.1/servers/a86cc8e4-eaa5-47b5-83ad-3b72fc465ddd => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:30:27.576938 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-edb61f8d-03eb-4a44-b424-dd537e924607 tempest-VolumesSnapshotsTestJSON-1725915488 tempest-VolumesSnapshotsTestJSON-1725915488-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/03f493ac-e8be-4f12-ab42-37200e500cad" status: 200 len: 287 microversion: 2.1 time: 0.134375 Aug 31 16:30:27.578620 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3292/6400] 10.222.0.50 () {58 vars in 1251 bytes} [Wed Aug 31 16:30:27 2022] GET /compute/v2.1/os-snapshots/03f493ac-e8be-4f12-ab42-37200e500cad => generated 287 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:30:27.590602 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d4c3010b-1bbe-4d56-b551-7e3488baf3a3 tempest-VolumesSnapshotsTestJSON-1725915488 tempest-VolumesSnapshotsTestJSON-1725915488-project] Calling method '.version_select at 0x7fbb467adc10>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:27.733740 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d4c3010b-1bbe-4d56-b551-7e3488baf3a3 tempest-VolumesSnapshotsTestJSON-1725915488 tempest-VolumesSnapshotsTestJSON-1725915488-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.148386 Aug 31 16:30:27.735133 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3109/6401] 10.222.0.50 () {58 vars in 1140 bytes} [Wed Aug 31 16:30:27 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:30:27.748592 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0d6d0f96-af86-4802-8fc6-5ae73115b41e tempest-VolumesSnapshotsTestJSON-1725915488 tempest-VolumesSnapshotsTestJSON-1725915488-project] Calling method '.version_select at 0x7fbb45f80b80>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:27.813639 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0d6d0f96-af86-4802-8fc6-5ae73115b41e tempest-VolumesSnapshotsTestJSON-1725915488 tempest-VolumesSnapshotsTestJSON-1725915488-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/03f493ac-e8be-4f12-ab42-37200e500cad" status: 200 len: 287 microversion: 2.1 time: 0.070362 Aug 31 16:30:27.814589 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3293/6402] 10.222.0.50 () {58 vars in 1251 bytes} [Wed Aug 31 16:30:27 2022] GET /compute/v2.1/os-snapshots/03f493ac-e8be-4f12-ab42-37200e500cad => generated 287 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:30:28.487941 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5c8fe11c-54ef-4170-a3f8-cfcddbbed590 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:28.489221 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5c8fe11c-54ef-4170-a3f8-cfcddbbed590 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 52207df3-de0e-4f94-aba2-2d0173ef3ba3] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:28.497174 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c8fe11c-54ef-4170-a3f8-cfcddbbed590 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:28.497926 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c8fe11c-54ef-4170-a3f8-cfcddbbed590 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:28.498748 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c8fe11c-54ef-4170-a3f8-cfcddbbed590 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:28.499803 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c8fe11c-54ef-4170-a3f8-cfcddbbed590 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:28.500443 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c8fe11c-54ef-4170-a3f8-cfcddbbed590 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:28.501448 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c8fe11c-54ef-4170-a3f8-cfcddbbed590 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:28.523830 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-5c8fe11c-54ef-4170-a3f8-cfcddbbed590 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] HTTP exception thrown: Instance 52207df3-de0e-4f94-aba2-2d0173ef3ba3 could not be found. Aug 31 16:30:28.526022 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5c8fe11c-54ef-4170-a3f8-cfcddbbed590 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Request method failure captured: Aug 31 16:30:28.526022 n-d-833090-16 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3 HTTP/1.1 Aug 31 16:30:28.526022 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:30:28.526022 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:30:28.526022 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:30:28.526022 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:30:28.526022 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:30:28.526022 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:30:28.526022 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:30:28.526022 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:30:28.526022 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4sA8QatsiRw58KL4D-GJAaR1X9zBGwbu0cNuaHi16Tl8K5LhZ4dthUjdeeybVrZ6FkLiuj0CnwnGa_AqwqzkMsKdZfTNQhjMqXfHtEAV5ID9oXbOsK0vGNgY-jRlE7qor7NeFM7QGwhr8KE3TJ70ugNQcxhI7ZJIKzx49vTu_Rhy18 Aug 31 16:30:28.526022 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:30:28.526022 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:30:28.526022 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:30:28.526022 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:30:28.526022 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:30:28.526022 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:30:28.526022 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 32245d85aee64f69865d98656133a539 Aug 31 16:30:28.526022 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-TestVolumeBootPattern-1732723367 Aug 31 16:30:28.526022 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:30:28.526022 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:30:28.526022 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/32245d85aee64f69865d98656133a539"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/32245d85aee64f69865d98656133a539"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/32245d85aee64f69865d98656133a539"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_32245d85aee64f69865d98656133a539", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:30:28.526022 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-TestVolumeBootPattern-1732723367 Aug 31 16:30:28.526022 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 32245d85aee64f69865d98656133a539 Aug 31 16:30:28.526022 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TestVolumeBootPattern-1732723367 Aug 31 16:30:28.526022 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-TestVolumeBootPattern-1732723367-project Aug 31 16:30:28.526022 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:30:28.526022 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:30:28.526022 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: fb76a89a8b8042edb7b6aaccb4f41ead Aug 31 16:30:28.526022 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-TestVolumeBootPattern-1732723367-project Aug 31 16:30:28.526022 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:30:28.526022 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 52207df3-de0e-4f94-aba2-2d0173ef3ba3 could not be found. Aug 31 16:30:28.526022 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '52207df3-de0e-4f94-aba2-2d0173ef3ba3'} Aug 31 16:30:28.526022 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:30:28.526022 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:30:28.526022 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:30:28.526022 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:30:28.526022 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:30:28.526022 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:30:28.526022 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:30:28.526022 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:30:28.526022 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:30:28.526022 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:30:28.526022 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52207df3-de0e-4f94-aba2-2d0173ef3ba3 could not be found. Aug 31 16:30:28.526022 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:30:28.526022 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:30:28.526022 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:30:28.526022 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:30:28.526022 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:30:28.526022 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:30:28.526022 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:30:28.526022 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:30:28.526022 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:30:28.526022 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:30:28.526022 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:30:28.526022 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:30:28.526022 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:30:28.526022 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:30:28.526022 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:30:28.526022 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:30:28.526022 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:30:28.526022 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:30:28.530664 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52207df3-de0e-4f94-aba2-2d0173ef3ba3 could not be found. Aug 31 16:30:28.530664 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:30:28.530664 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:30:28.530664 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:30:28.530664 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:30:28.530664 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:30:28.530664 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:30:28.530664 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:30:28.530664 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:30:28.530664 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52207df3-de0e-4f94-aba2-2d0173ef3ba3 could not be found. Aug 31 16:30:28.530664 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:30:28.533023 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5c8fe11c-54ef-4170-a3f8-cfcddbbed590 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Returning 404 to user: Instance 52207df3-de0e-4f94-aba2-2d0173ef3ba3 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:30:28.534309 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5c8fe11c-54ef-4170-a3f8-cfcddbbed590 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "DELETE /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3" status: 404 len: 111 microversion: 2.1 time: 0.052259 Aug 31 16:30:28.544457 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3110/6403] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:30:28 2022] DELETE /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:30:28.545505 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9982b76f-7f47-4277-9084-0cb8f55fe63b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:28.547998 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9982b76f-7f47-4277-9084-0cb8f55fe63b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 52207df3-de0e-4f94-aba2-2d0173ef3ba3] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:28.560971 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9982b76f-7f47-4277-9084-0cb8f55fe63b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:28.561672 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9982b76f-7f47-4277-9084-0cb8f55fe63b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:28.562486 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9982b76f-7f47-4277-9084-0cb8f55fe63b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:28.563723 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9982b76f-7f47-4277-9084-0cb8f55fe63b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:28.564556 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9982b76f-7f47-4277-9084-0cb8f55fe63b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:28.565296 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9982b76f-7f47-4277-9084-0cb8f55fe63b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:28.582595 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-9982b76f-7f47-4277-9084-0cb8f55fe63b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] HTTP exception thrown: Instance 52207df3-de0e-4f94-aba2-2d0173ef3ba3 could not be found. Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9982b76f-7f47-4277-9084-0cb8f55fe63b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Request method failure captured: Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3 HTTP/1.1 Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4sA8QatsiRw58KL4D-GJAaR1X9zBGwbu0cNuaHi16Tl8K5LhZ4dthUjdeeybVrZ6FkLiuj0CnwnGa_AqwqzkMsKdZfTNQhjMqXfHtEAV5ID9oXbOsK0vGNgY-jRlE7qor7NeFM7QGwhr8KE3TJ70ugNQcxhI7ZJIKzx49vTu_Rhy18 Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 32245d85aee64f69865d98656133a539 Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-TestVolumeBootPattern-1732723367 Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/32245d85aee64f69865d98656133a539"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/32245d85aee64f69865d98656133a539"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/32245d85aee64f69865d98656133a539"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_32245d85aee64f69865d98656133a539", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-TestVolumeBootPattern-1732723367 Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 32245d85aee64f69865d98656133a539 Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-TestVolumeBootPattern-1732723367 Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-TestVolumeBootPattern-1732723367-project Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: fb76a89a8b8042edb7b6aaccb4f41ead Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-TestVolumeBootPattern-1732723367-project Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 52207df3-de0e-4f94-aba2-2d0173ef3ba3 could not be found. Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '52207df3-de0e-4f94-aba2-2d0173ef3ba3'} Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52207df3-de0e-4f94-aba2-2d0173ef3ba3 could not be found. Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52207df3-de0e-4f94-aba2-2d0173ef3ba3 could not be found. Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:30:28.585217 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:30:28.589685 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:30:28.589685 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:30:28.589685 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:30:28.589685 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:30:28.589685 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:30:28.589685 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52207df3-de0e-4f94-aba2-2d0173ef3ba3 could not be found. Aug 31 16:30:28.589685 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:30:28.590834 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9982b76f-7f47-4277-9084-0cb8f55fe63b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Returning 404 to user: Instance 52207df3-de0e-4f94-aba2-2d0173ef3ba3 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:30:28.591869 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9982b76f-7f47-4277-9084-0cb8f55fe63b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3" status: 404 len: 111 microversion: 2.1 time: 0.051756 Aug 31 16:30:28.592987 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3294/6404] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:28 2022] GET /compute/v2.1/servers/52207df3-de0e-4f94-aba2-2d0173ef3ba3 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:30:28.631239 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-d6343fbe-0624-446e-b6d0-605497141f0b req-c73cfd14-1cb7-446c-bfc0-59de56e268c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e77fc40b-336f-4886-8a87-9376431bec27", "tag": "bb31973a-7cba-4adc-9ea9-a852d7c78acf"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:30:28.652663 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d6343fbe-0624-446e-b6d0-605497141f0b req-c73cfd14-1cb7-446c-bfc0-59de56e268c9 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:28.653403 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d6343fbe-0624-446e-b6d0-605497141f0b req-c73cfd14-1cb7-446c-bfc0-59de56e268c9 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:28.654072 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d6343fbe-0624-446e-b6d0-605497141f0b req-c73cfd14-1cb7-446c-bfc0-59de56e268c9 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:28.667701 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-d6343fbe-0624-446e-b6d0-605497141f0b req-c73cfd14-1cb7-446c-bfc0-59de56e268c9 service nova] Creating event network-changed:bb31973a-7cba-4adc-9ea9-a852d7c78acf for instance e77fc40b-336f-4886-8a87-9376431bec27 on n-h1-833090-16 Aug 31 16:30:28.673998 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-d6343fbe-0624-446e-b6d0-605497141f0b req-c73cfd14-1cb7-446c-bfc0-59de56e268c9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056305 Aug 31 16:30:28.675154 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3111/6405] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:30:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:30:28.710723 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5d07ecea-e81a-4cdb-b17f-cfcdab424ca3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Action: 'create', calling method: .version_select at 0x7fbb45f80040>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1295463571", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOKd/12PpT3rqmWRF5n/W6mWa4vuydlQhZ5RjWKdwi1g7nm9MXOre9NUsSmAEuV1PabFD9cUMG595llYTl0c+JzUUZzORoJaWR5bkUymBUEOtmIwuDpta1gS4uCcesDQw=="}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:30:28.772632 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-5d07ecea-e81a-4cdb-b17f-cfcdab424ca3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Getting quotas for project 32245d85aee64f69865d98656133a539. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:30:28.790248 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-5d07ecea-e81a-4cdb-b17f-cfcdab424ca3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Getting quotas for user fb76a89a8b8042edb7b6aaccb4f41ead and project 32245d85aee64f69865d98656133a539. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:30:28.827165 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-60adbaec-c09e-4965-976a-6242713b4c25 tempest-VolumesSnapshotsTestJSON-1725915488 tempest-VolumesSnapshotsTestJSON-1725915488-project] Calling method '.version_select at 0x7fbb467adc10>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:28.850187 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5d07ecea-e81a-4cdb-b17f-cfcdab424ca3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.145734 Aug 31 16:30:28.850886 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3295/6406] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 31 16:30:28 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:30:28.907373 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-60adbaec-c09e-4965-976a-6242713b4c25 tempest-VolumesSnapshotsTestJSON-1725915488 tempest-VolumesSnapshotsTestJSON-1725915488-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/03f493ac-e8be-4f12-ab42-37200e500cad" status: 200 len: 287 microversion: 2.1 time: 0.084669 Aug 31 16:30:28.907926 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3112/6407] 10.222.0.50 () {58 vars in 1251 bytes} [Wed Aug 31 16:30:28 2022] GET /compute/v2.1/os-snapshots/03f493ac-e8be-4f12-ab42-37200e500cad => generated 287 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:30:29.922319 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-720d1469-88af-4bab-8333-ee3f8c32401d tempest-VolumesSnapshotsTestJSON-1725915488 tempest-VolumesSnapshotsTestJSON-1725915488-project] Calling method '.version_select at 0x7fbb4ab47790>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:29.972584 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-720d1469-88af-4bab-8333-ee3f8c32401d tempest-VolumesSnapshotsTestJSON-1725915488 tempest-VolumesSnapshotsTestJSON-1725915488-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/03f493ac-e8be-4f12-ab42-37200e500cad" status: 200 len: 288 microversion: 2.1 time: 0.055929 Aug 31 16:30:29.974642 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3296/6408] 10.222.0.50 () {58 vars in 1251 bytes} [Wed Aug 31 16:30:29 2022] GET /compute/v2.1/os-snapshots/03f493ac-e8be-4f12-ab42-37200e500cad => generated 288 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:30:29.986644 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-43af4d38-ac0f-49ac-b292-12e0cc9958d5 tempest-VolumesSnapshotsTestJSON-1725915488 tempest-VolumesSnapshotsTestJSON-1725915488-project] Calling method '.version_select at 0x7fbb45b9a0d0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:30.119829 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-43af4d38-ac0f-49ac-b292-12e0cc9958d5 tempest-VolumesSnapshotsTestJSON-1725915488 tempest-VolumesSnapshotsTestJSON-1725915488-project] 10.222.0.50 "DELETE /compute/v2.1/os-snapshots/03f493ac-e8be-4f12-ab42-37200e500cad" status: 202 len: 0 microversion: 2.1 time: 0.138106 Aug 31 16:30:30.120487 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3113/6409] 10.222.0.50 () {58 vars in 1254 bytes} [Wed Aug 31 16:30:29 2022] DELETE /compute/v2.1/os-snapshots/03f493ac-e8be-4f12-ab42-37200e500cad => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:30:30.130862 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1df07d1b-479c-4743-bf8e-c1907cd23b34 tempest-VolumesSnapshotsTestJSON-1725915488 tempest-VolumesSnapshotsTestJSON-1725915488-project] Calling method '.version_select at 0x7fbb4ac20700>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:30.189923 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1df07d1b-479c-4743-bf8e-c1907cd23b34 tempest-VolumesSnapshotsTestJSON-1725915488 tempest-VolumesSnapshotsTestJSON-1725915488-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/03f493ac-e8be-4f12-ab42-37200e500cad" status: 200 len: 287 microversion: 2.1 time: 0.064499 Aug 31 16:30:30.190919 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3297/6410] 10.222.0.50 () {58 vars in 1251 bytes} [Wed Aug 31 16:30:30 2022] GET /compute/v2.1/os-snapshots/03f493ac-e8be-4f12-ab42-37200e500cad => generated 287 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:30:31.205245 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0e50c615-bf1d-4f80-98a2-d80e1d29b1a2 tempest-VolumesSnapshotsTestJSON-1725915488 tempest-VolumesSnapshotsTestJSON-1725915488-project] Calling method '.version_select at 0x7fbb4aa30b80>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:31.263647 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0e50c615-bf1d-4f80-98a2-d80e1d29b1a2 tempest-VolumesSnapshotsTestJSON-1725915488 tempest-VolumesSnapshotsTestJSON-1725915488-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/03f493ac-e8be-4f12-ab42-37200e500cad" status: 200 len: 287 microversion: 2.1 time: 0.064178 Aug 31 16:30:31.265372 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3114/6411] 10.222.0.50 () {58 vars in 1251 bytes} [Wed Aug 31 16:30:31 2022] GET /compute/v2.1/os-snapshots/03f493ac-e8be-4f12-ab42-37200e500cad => generated 287 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:30:32.278564 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e0276d87-2bb2-4a18-840e-c39c6a20e8f5 tempest-VolumesSnapshotsTestJSON-1725915488 tempest-VolumesSnapshotsTestJSON-1725915488-project] Calling method '.version_select at 0x7fbb46018f70>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:32.313408 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-e0276d87-2bb2-4a18-840e-c39c6a20e8f5 tempest-VolumesSnapshotsTestJSON-1725915488 tempest-VolumesSnapshotsTestJSON-1725915488-project] HTTP exception thrown: Snapshot 03f493ac-e8be-4f12-ab42-37200e500cad could not be found. Aug 31 16:30:32.350527 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e0276d87-2bb2-4a18-840e-c39c6a20e8f5 tempest-VolumesSnapshotsTestJSON-1725915488 tempest-VolumesSnapshotsTestJSON-1725915488-project] Request method failure captured: Aug 31 16:30:32.350527 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/os-snapshots/03f493ac-e8be-4f12-ab42-37200e500cad HTTP/1.1 Aug 31 16:30:32.350527 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:30:32.350527 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:30:32.350527 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:30:32.350527 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:30:32.350527 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:30:32.350527 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:30:32.350527 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:30:32.350527 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:30:32.350527 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4yfuQ9dT7H1ntXnb2xSCebJlvrgeZnMy0aCQ_S7jPnqSmovKgqA2EIk5ilo509yCW3T5711oquzRmzQgUU5Zd9ZQrvbhh8ZA3F2GVGTyKyMHMmtPRXdzJmyEceEDXy3zP4A0q1WsTuePp_KRrM4zLu-R0c4KynhTsjLvJ5NbYY0Z4M Aug 31 16:30:32.350527 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:30:32.350527 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:30:32.350527 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:30:32.350527 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:30:32.350527 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:30:32.350527 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:30:32.350527 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 96e900c8483f4bb9a774c58b1f0f8431 Aug 31 16:30:32.350527 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1725915488 Aug 31 16:30:32.350527 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:30:32.350527 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:30:32.350527 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/96e900c8483f4bb9a774c58b1f0f8431"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/96e900c8483f4bb9a774c58b1f0f8431"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/96e900c8483f4bb9a774c58b1f0f8431"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_96e900c8483f4bb9a774c58b1f0f8431", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:30:32.350527 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1725915488 Aug 31 16:30:32.350527 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 96e900c8483f4bb9a774c58b1f0f8431 Aug 31 16:30:32.350527 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1725915488 Aug 31 16:30:32.350527 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-VolumesSnapshotsTestJSON-1725915488-project Aug 31 16:30:32.350527 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:30:32.350527 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:30:32.350527 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 6874e7d51b6047b7b92eca86a4e87cf0 Aug 31 16:30:32.350527 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1725915488-project Aug 31 16:30:32.350527 n-d-833090-16 devstack@n-api.service[128864]: method: Aug 31 16:30:32.350527 n-d-833090-16 devstack@n-api.service[128864]: exception: Snapshot 03f493ac-e8be-4f12-ab42-37200e500cad could not be found. Aug 31 16:30:32.350527 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '03f493ac-e8be-4f12-ab42-37200e500cad'} Aug 31 16:30:32.350527 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:30:32.350527 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:30:32.350527 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 31 16:30:32.350527 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 31 16:30:32.350527 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 31 16:30:32.350527 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 31 16:30:32.350527 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 31 16:30:32.350527 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 31 16:30:32.350527 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 16:30:32.350527 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 16:30:32.350527 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 16:30:32.350527 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 16:30:32.350527 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 16:30:32.350527 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 16:30:32.350527 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 16:30:32.350527 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 16:30:32.350527 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 03f493ac-e8be-4f12-ab42-37200e500cad could not be found. (HTTP 404) (Request-ID: req-7f69c3c1-4460-4aa7-a36e-d82c5d83445e) Aug 31 16:30:32.350527 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:30:32.350527 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:30:32.350527 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:30:32.350527 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:30:32.350527 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 31 16:30:32.350527 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 31 16:30:32.350527 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 16:30:32.350527 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 16:30:32.350527 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 31 16:30:32.350527 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 31 16:30:32.350527 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 16:30:32.350527 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 16:30:32.354308 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 31 16:30:32.354308 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 31 16:30:32.354308 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 31 16:30:32.354308 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 31 16:30:32.354308 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 31 16:30:32.354308 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 31 16:30:32.354308 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 16:30:32.354308 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 16:30:32.354308 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 16:30:32.354308 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 16:30:32.354308 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 16:30:32.354308 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 16:30:32.354308 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 16:30:32.354308 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 16:30:32.354308 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 03f493ac-e8be-4f12-ab42-37200e500cad could not be found. Aug 31 16:30:32.354308 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:30:32.354308 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:30:32.354308 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:30:32.354308 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:30:32.354308 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:30:32.354308 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:30:32.354308 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:30:32.354308 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:30:32.354308 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:30:32.354308 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:30:32.354308 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:30:32.354308 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:30:32.354308 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 31 16:30:32.354308 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:30:32.354308 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 03f493ac-e8be-4f12-ab42-37200e500cad could not be found. Aug 31 16:30:32.354308 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:30:32.354308 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:30:32.354308 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:30:32.354308 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:30:32.354308 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:30:32.354308 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:30:32.354308 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:30:32.354308 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:30:32.354308 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 03f493ac-e8be-4f12-ab42-37200e500cad could not be found. Aug 31 16:30:32.354308 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:30:32.354308 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e0276d87-2bb2-4a18-840e-c39c6a20e8f5 tempest-VolumesSnapshotsTestJSON-1725915488 tempest-VolumesSnapshotsTestJSON-1725915488-project] Returning 404 to user: Snapshot 03f493ac-e8be-4f12-ab42-37200e500cad could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:30:32.354308 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e0276d87-2bb2-4a18-840e-c39c6a20e8f5 tempest-VolumesSnapshotsTestJSON-1725915488 tempest-VolumesSnapshotsTestJSON-1725915488-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/03f493ac-e8be-4f12-ab42-37200e500cad" status: 404 len: 111 microversion: 2.1 time: 0.079052 Aug 31 16:30:32.362489 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d8e5f692-2ef5-40e4-9a1f-ea3f2f6f8863 tempest-VolumesSnapshotsTestJSON-1725915488 tempest-VolumesSnapshotsTestJSON-1725915488-project] Calling method '.version_select at 0x7fbb4ab4e790>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:32.368799 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3298/6412] 10.222.0.50 () {58 vars in 1251 bytes} [Wed Aug 31 16:30:32 2022] GET /compute/v2.1/os-snapshots/03f493ac-e8be-4f12-ab42-37200e500cad => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:30:32.447164 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d8e5f692-2ef5-40e4-9a1f-ea3f2f6f8863 tempest-VolumesSnapshotsTestJSON-1725915488 tempest-VolumesSnapshotsTestJSON-1725915488-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/5087a4cb-58cd-4efe-9695-1fa6fd44f185" status: 202 len: 0 microversion: 2.1 time: 0.089677 Aug 31 16:30:32.447742 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3115/6413] 10.222.0.50 () {58 vars in 1248 bytes} [Wed Aug 31 16:30:32 2022] DELETE /compute/v2.1/os-volumes/5087a4cb-58cd-4efe-9695-1fa6fd44f185 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:30:32.458053 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-655874cc-1436-4b73-bbe1-ed969d0fdf06 tempest-VolumesSnapshotsTestJSON-1725915488 tempest-VolumesSnapshotsTestJSON-1725915488-project] Calling method '.version_select at 0x7fbb45556310>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:32.517872 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-655874cc-1436-4b73-bbe1-ed969d0fdf06 tempest-VolumesSnapshotsTestJSON-1725915488 tempest-VolumesSnapshotsTestJSON-1725915488-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/5087a4cb-58cd-4efe-9695-1fa6fd44f185" status: 200 len: 344 microversion: 2.1 time: 0.065422 Aug 31 16:30:32.519075 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3299/6414] 10.222.0.50 () {58 vars in 1245 bytes} [Wed Aug 31 16:30:32 2022] GET /compute/v2.1/os-volumes/5087a4cb-58cd-4efe-9695-1fa6fd44f185 => generated 344 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:30:33.532753 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1cb53786-b67c-4282-9338-3234a3a9b3e0 tempest-VolumesSnapshotsTestJSON-1725915488 tempest-VolumesSnapshotsTestJSON-1725915488-project] Calling method '.version_select at 0x7fbb45b9a0d0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:33.629687 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1cb53786-b67c-4282-9338-3234a3a9b3e0 tempest-VolumesSnapshotsTestJSON-1725915488 tempest-VolumesSnapshotsTestJSON-1725915488-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/5087a4cb-58cd-4efe-9695-1fa6fd44f185" status: 200 len: 344 microversion: 2.1 time: 0.101600 Aug 31 16:30:33.631616 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3116/6415] 10.222.0.50 () {58 vars in 1245 bytes} [Wed Aug 31 16:30:33 2022] GET /compute/v2.1/os-volumes/5087a4cb-58cd-4efe-9695-1fa6fd44f185 => generated 344 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:30:34.646965 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-da5c65d5-efa2-48d1-b3cd-d42dc9036f89 tempest-VolumesSnapshotsTestJSON-1725915488 tempest-VolumesSnapshotsTestJSON-1725915488-project] Calling method '.version_select at 0x7fbb45e02dc0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:34.685146 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-da5c65d5-efa2-48d1-b3cd-d42dc9036f89 tempest-VolumesSnapshotsTestJSON-1725915488 tempest-VolumesSnapshotsTestJSON-1725915488-project] HTTP exception thrown: Volume 5087a4cb-58cd-4efe-9695-1fa6fd44f185 could not be found. Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-da5c65d5-efa2-48d1-b3cd-d42dc9036f89 tempest-VolumesSnapshotsTestJSON-1725915488 tempest-VolumesSnapshotsTestJSON-1725915488-project] Request method failure captured: Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/os-volumes/5087a4cb-58cd-4efe-9695-1fa6fd44f185 HTTP/1.1 Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4yfuQ9dT7H1ntXnb2xSCebJlvrgeZnMy0aCQ_S7jPnqSmovKgqA2EIk5ilo509yCW3T5711oquzRmzQgUU5Zd9ZQrvbhh8ZA3F2GVGTyKyMHMmtPRXdzJmyEceEDXy3zP4A0q1WsTuePp_KRrM4zLu-R0c4KynhTsjLvJ5NbYY0Z4M Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 96e900c8483f4bb9a774c58b1f0f8431 Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1725915488 Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/96e900c8483f4bb9a774c58b1f0f8431"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/96e900c8483f4bb9a774c58b1f0f8431"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/96e900c8483f4bb9a774c58b1f0f8431"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_96e900c8483f4bb9a774c58b1f0f8431", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1725915488 Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 96e900c8483f4bb9a774c58b1f0f8431 Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1725915488 Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-VolumesSnapshotsTestJSON-1725915488-project Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 6874e7d51b6047b7b92eca86a4e87cf0 Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1725915488-project Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: method: Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: exception: Volume 5087a4cb-58cd-4efe-9695-1fa6fd44f185 could not be found. Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '5087a4cb-58cd-4efe-9695-1fa6fd44f185'} Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5087a4cb-58cd-4efe-9695-1fa6fd44f185 could not be found. (HTTP 404) (Request-ID: req-6fa8c160-dc4f-4fc2-bbcd-913f8c3c60ea) Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 16:30:34.687432 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 16:30:34.692624 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 16:30:34.692624 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 16:30:34.692624 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 16:30:34.692624 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 16:30:34.692624 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 16:30:34.692624 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 16:30:34.692624 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 16:30:34.692624 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 16:30:34.692624 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 16:30:34.692624 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 16:30:34.692624 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 16:30:34.692624 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 16:30:34.692624 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 16:30:34.692624 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5087a4cb-58cd-4efe-9695-1fa6fd44f185 could not be found. Aug 31 16:30:34.692624 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:30:34.692624 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:30:34.692624 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:30:34.692624 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:30:34.692624 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:30:34.692624 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:30:34.692624 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:30:34.692624 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:30:34.692624 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:30:34.692624 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:30:34.692624 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:30:34.692624 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:30:34.692624 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 16:30:34.692624 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:30:34.692624 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5087a4cb-58cd-4efe-9695-1fa6fd44f185 could not be found. Aug 31 16:30:34.692624 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:30:34.692624 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:30:34.692624 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:30:34.692624 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:30:34.692624 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:30:34.692624 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:30:34.692624 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:30:34.692624 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:30:34.692624 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5087a4cb-58cd-4efe-9695-1fa6fd44f185 could not be found. Aug 31 16:30:34.692624 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:30:34.692624 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-da5c65d5-efa2-48d1-b3cd-d42dc9036f89 tempest-VolumesSnapshotsTestJSON-1725915488 tempest-VolumesSnapshotsTestJSON-1725915488-project] Returning 404 to user: Volume 5087a4cb-58cd-4efe-9695-1fa6fd44f185 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:30:34.692624 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-da5c65d5-efa2-48d1-b3cd-d42dc9036f89 tempest-VolumesSnapshotsTestJSON-1725915488 tempest-VolumesSnapshotsTestJSON-1725915488-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/5087a4cb-58cd-4efe-9695-1fa6fd44f185" status: 404 len: 109 microversion: 2.1 time: 0.047176 Aug 31 16:30:34.700354 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5d5bb65b-d028-4f9e-8bcf-f6ce3282538b tempest-VolumesSnapshotsTestJSON-1725915488 tempest-VolumesSnapshotsTestJSON-1725915488-project] Calling method '.version_select at 0x7fbb45b9aca0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:34.702186 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3300/6416] 10.222.0.50 () {58 vars in 1245 bytes} [Wed Aug 31 16:30:34 2022] GET /compute/v2.1/os-volumes/5087a4cb-58cd-4efe-9695-1fa6fd44f185 => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:30:34.739998 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-5d5bb65b-d028-4f9e-8bcf-f6ce3282538b tempest-VolumesSnapshotsTestJSON-1725915488 tempest-VolumesSnapshotsTestJSON-1725915488-project] HTTP exception thrown: Volume 5087a4cb-58cd-4efe-9695-1fa6fd44f185 could not be found. Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5d5bb65b-d028-4f9e-8bcf-f6ce3282538b tempest-VolumesSnapshotsTestJSON-1725915488 tempest-VolumesSnapshotsTestJSON-1725915488-project] Request method failure captured: Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/os-volumes/5087a4cb-58cd-4efe-9695-1fa6fd44f185 HTTP/1.1 Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4yfuQ9dT7H1ntXnb2xSCebJlvrgeZnMy0aCQ_S7jPnqSmovKgqA2EIk5ilo509yCW3T5711oquzRmzQgUU5Zd9ZQrvbhh8ZA3F2GVGTyKyMHMmtPRXdzJmyEceEDXy3zP4A0q1WsTuePp_KRrM4zLu-R0c4KynhTsjLvJ5NbYY0Z4M Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 96e900c8483f4bb9a774c58b1f0f8431 Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1725915488 Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/96e900c8483f4bb9a774c58b1f0f8431"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/96e900c8483f4bb9a774c58b1f0f8431"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/96e900c8483f4bb9a774c58b1f0f8431"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_96e900c8483f4bb9a774c58b1f0f8431", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1725915488 Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 96e900c8483f4bb9a774c58b1f0f8431 Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1725915488 Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-VolumesSnapshotsTestJSON-1725915488-project Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 6874e7d51b6047b7b92eca86a4e87cf0 Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1725915488-project Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: method: Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: exception: Volume 5087a4cb-58cd-4efe-9695-1fa6fd44f185 could not be found. Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '5087a4cb-58cd-4efe-9695-1fa6fd44f185'} Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5087a4cb-58cd-4efe-9695-1fa6fd44f185 could not be found. (HTTP 404) (Request-ID: req-f2c84c64-ca30-4bb2-be7d-55664ff4853f) Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 16:30:34.742410 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 16:30:34.747477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 16:30:34.747477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 31 16:30:34.747477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 31 16:30:34.747477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 31 16:30:34.747477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 31 16:30:34.747477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 31 16:30:34.747477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 31 16:30:34.747477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 31 16:30:34.747477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 31 16:30:34.747477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 16:30:34.747477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 16:30:34.747477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 16:30:34.747477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 16:30:34.747477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5087a4cb-58cd-4efe-9695-1fa6fd44f185 could not be found. Aug 31 16:30:34.747477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:30:34.747477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:30:34.747477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:30:34.747477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:30:34.747477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:30:34.747477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:30:34.747477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:30:34.747477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:30:34.747477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:30:34.747477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:30:34.747477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:30:34.747477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:30:34.747477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 31 16:30:34.747477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:30:34.747477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5087a4cb-58cd-4efe-9695-1fa6fd44f185 could not be found. Aug 31 16:30:34.747477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:30:34.747477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:30:34.747477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:30:34.747477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:30:34.747477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:30:34.747477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:30:34.747477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:30:34.747477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:30:34.747477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5087a4cb-58cd-4efe-9695-1fa6fd44f185 could not be found. Aug 31 16:30:34.747477 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:30:34.751592 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5d5bb65b-d028-4f9e-8bcf-f6ce3282538b tempest-VolumesSnapshotsTestJSON-1725915488 tempest-VolumesSnapshotsTestJSON-1725915488-project] Returning 404 to user: Volume 5087a4cb-58cd-4efe-9695-1fa6fd44f185 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:30:34.752576 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5d5bb65b-d028-4f9e-8bcf-f6ce3282538b tempest-VolumesSnapshotsTestJSON-1725915488 tempest-VolumesSnapshotsTestJSON-1725915488-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/5087a4cb-58cd-4efe-9695-1fa6fd44f185" status: 404 len: 109 microversion: 2.1 time: 0.055935 Aug 31 16:30:34.753241 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3117/6417] 10.222.0.50 () {58 vars in 1248 bytes} [Wed Aug 31 16:30:34 2022] DELETE /compute/v2.1/os-volumes/5087a4cb-58cd-4efe-9695-1fa6fd44f185 => generated 109 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:30:34.761795 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fdb78a4b-ccb4-4dab-9b4f-a6a58ef767d5 tempest-VolumesSnapshotsTestJSON-1725915488 tempest-VolumesSnapshotsTestJSON-1725915488-project] Calling method '.version_select at 0x7fbb458af310>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:34.796757 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-fdb78a4b-ccb4-4dab-9b4f-a6a58ef767d5 tempest-VolumesSnapshotsTestJSON-1725915488 tempest-VolumesSnapshotsTestJSON-1725915488-project] HTTP exception thrown: Volume 5087a4cb-58cd-4efe-9695-1fa6fd44f185 could not be found. Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fdb78a4b-ccb4-4dab-9b4f-a6a58ef767d5 tempest-VolumesSnapshotsTestJSON-1725915488 tempest-VolumesSnapshotsTestJSON-1725915488-project] Request method failure captured: Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/os-volumes/5087a4cb-58cd-4efe-9695-1fa6fd44f185 HTTP/1.1 Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4yfuQ9dT7H1ntXnb2xSCebJlvrgeZnMy0aCQ_S7jPnqSmovKgqA2EIk5ilo509yCW3T5711oquzRmzQgUU5Zd9ZQrvbhh8ZA3F2GVGTyKyMHMmtPRXdzJmyEceEDXy3zP4A0q1WsTuePp_KRrM4zLu-R0c4KynhTsjLvJ5NbYY0Z4M Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 96e900c8483f4bb9a774c58b1f0f8431 Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1725915488 Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/96e900c8483f4bb9a774c58b1f0f8431"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/96e900c8483f4bb9a774c58b1f0f8431"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/96e900c8483f4bb9a774c58b1f0f8431"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_96e900c8483f4bb9a774c58b1f0f8431", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1725915488 Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 96e900c8483f4bb9a774c58b1f0f8431 Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1725915488 Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-VolumesSnapshotsTestJSON-1725915488-project Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 6874e7d51b6047b7b92eca86a4e87cf0 Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1725915488-project Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: method: Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: exception: Volume 5087a4cb-58cd-4efe-9695-1fa6fd44f185 could not be found. Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '5087a4cb-58cd-4efe-9695-1fa6fd44f185'} Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5087a4cb-58cd-4efe-9695-1fa6fd44f185 could not be found. (HTTP 404) (Request-ID: req-a584a659-805f-461b-acfa-9545ded5cda0) Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 31 16:30:34.799156 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 31 16:30:34.803520 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 31 16:30:34.803520 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 31 16:30:34.803520 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 31 16:30:34.803520 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 31 16:30:34.803520 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 31 16:30:34.803520 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 31 16:30:34.803520 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 31 16:30:34.803520 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 31 16:30:34.803520 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 31 16:30:34.803520 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 31 16:30:34.803520 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 31 16:30:34.803520 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 31 16:30:34.803520 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 31 16:30:34.803520 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5087a4cb-58cd-4efe-9695-1fa6fd44f185 could not be found. Aug 31 16:30:34.803520 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:30:34.803520 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:30:34.803520 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:30:34.803520 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:30:34.803520 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:30:34.803520 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:30:34.803520 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:30:34.803520 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:30:34.803520 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 31 16:30:34.803520 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 31 16:30:34.803520 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:30:34.803520 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:30:34.803520 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 31 16:30:34.803520 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:30:34.803520 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5087a4cb-58cd-4efe-9695-1fa6fd44f185 could not be found. Aug 31 16:30:34.803520 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:30:34.803520 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:30:34.803520 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:30:34.803520 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:30:34.803520 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:30:34.803520 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:30:34.803520 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:30:34.803520 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:30:34.803520 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5087a4cb-58cd-4efe-9695-1fa6fd44f185 could not be found. Aug 31 16:30:34.803520 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:30:34.807550 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fdb78a4b-ccb4-4dab-9b4f-a6a58ef767d5 tempest-VolumesSnapshotsTestJSON-1725915488 tempest-VolumesSnapshotsTestJSON-1725915488-project] Returning 404 to user: Volume 5087a4cb-58cd-4efe-9695-1fa6fd44f185 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:30:34.808586 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fdb78a4b-ccb4-4dab-9b4f-a6a58ef767d5 tempest-VolumesSnapshotsTestJSON-1725915488 tempest-VolumesSnapshotsTestJSON-1725915488-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/5087a4cb-58cd-4efe-9695-1fa6fd44f185" status: 404 len: 109 microversion: 2.1 time: 0.050888 Aug 31 16:30:34.815058 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3301/6418] 10.222.0.50 () {58 vars in 1245 bytes} [Wed Aug 31 16:30:34 2022] GET /compute/v2.1/os-volumes/5087a4cb-58cd-4efe-9695-1fa6fd44f185 => generated 109 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:30:52.692190 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=11 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:30:52.693429 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=21 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:30:52.927512 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fb0655fb-a8a5-4a72-82fb-239279134ab8 tempest-PortsAdminExtendedAttrsTestJSON-2115394932 tempest-PortsAdminExtendedAttrsTestJSON-2115394932-project-admin] Calling method '.version_select at 0x7fbb4aa304c0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:52.929287 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb0655fb-a8a5-4a72-82fb-239279134ab8 tempest-PortsAdminExtendedAttrsTestJSON-2115394932 tempest-PortsAdminExtendedAttrsTestJSON-2115394932-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:52.929765 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb0655fb-a8a5-4a72-82fb-239279134ab8 tempest-PortsAdminExtendedAttrsTestJSON-2115394932 tempest-PortsAdminExtendedAttrsTestJSON-2115394932-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:52.930534 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb0655fb-a8a5-4a72-82fb-239279134ab8 tempest-PortsAdminExtendedAttrsTestJSON-2115394932 tempest-PortsAdminExtendedAttrsTestJSON-2115394932-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:52.944837 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb0655fb-a8a5-4a72-82fb-239279134ab8 tempest-PortsAdminExtendedAttrsTestJSON-2115394932 tempest-PortsAdminExtendedAttrsTestJSON-2115394932-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:52.945321 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb0655fb-a8a5-4a72-82fb-239279134ab8 tempest-PortsAdminExtendedAttrsTestJSON-2115394932 tempest-PortsAdminExtendedAttrsTestJSON-2115394932-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:52.945761 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb0655fb-a8a5-4a72-82fb-239279134ab8 tempest-PortsAdminExtendedAttrsTestJSON-2115394932 tempest-PortsAdminExtendedAttrsTestJSON-2115394932-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:52.956191 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb0655fb-a8a5-4a72-82fb-239279134ab8 tempest-PortsAdminExtendedAttrsTestJSON-2115394932 tempest-PortsAdminExtendedAttrsTestJSON-2115394932-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:52.956792 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb0655fb-a8a5-4a72-82fb-239279134ab8 tempest-PortsAdminExtendedAttrsTestJSON-2115394932 tempest-PortsAdminExtendedAttrsTestJSON-2115394932-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:52.957247 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fb0655fb-a8a5-4a72-82fb-239279134ab8 tempest-PortsAdminExtendedAttrsTestJSON-2115394932 tempest-PortsAdminExtendedAttrsTestJSON-2115394932-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:52.964574 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fb0655fb-a8a5-4a72-82fb-239279134ab8 tempest-PortsAdminExtendedAttrsTestJSON-2115394932 tempest-PortsAdminExtendedAttrsTestJSON-2115394932-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.275371 Aug 31 16:30:52.971003 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3118/6419] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 31 16:30:52 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:30:53.625650 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-016b2a1b-75a7-4e31-a07f-b99837970fc9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-970737348", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1295463571", "security_groups": [{"name": "tempest-secgroup-smoke-1246170769"}], "block_device_mapping_v2": [{"uuid": "d097127b-89c0-4001-aee4-21b69ac9faad", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "875599c9-5517-4369-96b1-87dce382c42c"}]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:30:53.639343 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=43 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:30:53.640794 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=4 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:30:53.641566 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:30:53.765390 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-016b2a1b-75a7-4e31-a07f-b99837970fc9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] validate_networks() for [('875599c9-5517-4369-96b1-87dce382c42c', None, None, None, None, None)] {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:30:54.216940 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-016b2a1b-75a7-4e31-a07f-b99837970fc9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:30:54.217623 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-016b2a1b-75a7-4e31-a07f-b99837970fc9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:30:54.218554 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-016b2a1b-75a7-4e31-a07f-b99837970fc9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:30:54.219190 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-016b2a1b-75a7-4e31-a07f-b99837970fc9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:30:54.219884 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-016b2a1b-75a7-4e31-a07f-b99837970fc9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:30:54.231430 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-016b2a1b-75a7-4e31-a07f-b99837970fc9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:54.231926 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-016b2a1b-75a7-4e31-a07f-b99837970fc9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:54.232368 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-016b2a1b-75a7-4e31-a07f-b99837970fc9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:54.233097 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-016b2a1b-75a7-4e31-a07f-b99837970fc9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:54.233555 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-016b2a1b-75a7-4e31-a07f-b99837970fc9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:54.233984 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-016b2a1b-75a7-4e31-a07f-b99837970fc9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:54.254893 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-016b2a1b-75a7-4e31-a07f-b99837970fc9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Getting quotas for project 32245d85aee64f69865d98656133a539. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:30:54.261343 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-016b2a1b-75a7-4e31-a07f-b99837970fc9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Getting quotas for user fb76a89a8b8042edb7b6aaccb4f41ead and project 32245d85aee64f69865d98656133a539. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:30:54.332297 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-016b2a1b-75a7-4e31-a07f-b99837970fc9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:30:54.335104 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-016b2a1b-75a7-4e31-a07f-b99837970fc9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 158a6dc8-d946-4479-b3a5-ee3e97d283e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d097127b-89c0-4001-aee4-21b69ac9faad',volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:30:54.498403 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-016b2a1b-75a7-4e31-a07f-b99837970fc9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.875412 Aug 31 16:30:54.499415 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3302/6420] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:30:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 879 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:30:54.512359 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3b69b64f-ab9b-4192-b9cc-e4dcbdcc2226 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:54.513101 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3b69b64f-ab9b-4192-b9cc-e4dcbdcc2226 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 158a6dc8-d946-4479-b3a5-ee3e97d283e8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:54.596600 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3b69b64f-ab9b-4192-b9cc-e4dcbdcc2226 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:54.605957 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3b69b64f-ab9b-4192-b9cc-e4dcbdcc2226 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8" status: 200 len: 1094 microversion: 2.1 time: 0.098406 Aug 31 16:30:54.607250 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3119/6421] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:54 2022] GET /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8 => generated 1094 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:30:54.723880 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a10d2971-9c1e-4c71-ac73-ae6c68e0db45 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1643032643", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:30:54.787842 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-a10d2971-9c1e-4c71-ac73-ae6c68e0db45 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] validate_networks() for None {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:30:55.187493 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-a10d2971-9c1e-4c71-ac73-ae6c68e0db45 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:30:55.187997 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-a10d2971-9c1e-4c71-ac73-ae6c68e0db45 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:30:55.188585 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-a10d2971-9c1e-4c71-ac73-ae6c68e0db45 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:30:55.189468 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-a10d2971-9c1e-4c71-ac73-ae6c68e0db45 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:30:55.190360 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-a10d2971-9c1e-4c71-ac73-ae6c68e0db45 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:30:55.220626 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a10d2971-9c1e-4c71-ac73-ae6c68e0db45 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:55.221298 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a10d2971-9c1e-4c71-ac73-ae6c68e0db45 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:55.222075 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a10d2971-9c1e-4c71-ac73-ae6c68e0db45 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:55.223449 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a10d2971-9c1e-4c71-ac73-ae6c68e0db45 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:55.224172 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a10d2971-9c1e-4c71-ac73-ae6c68e0db45 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:55.224645 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a10d2971-9c1e-4c71-ac73-ae6c68e0db45 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:55.245275 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-a10d2971-9c1e-4c71-ac73-ae6c68e0db45 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Getting quotas for project f0351946f48f45899d9430bdc9cc33ef. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:30:55.253776 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-a10d2971-9c1e-4c71-ac73-ae6c68e0db45 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Getting quotas for user 910cdbb96c3246b78c7230eb6061b9c3 and project f0351946f48f45899d9430bdc9cc33ef. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:30:55.265680 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a10d2971-9c1e-4c71-ac73-ae6c68e0db45 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:30:55.268131 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a10d2971-9c1e-4c71-ac73-ae6c68e0db45 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] [instance: f55aba6a-0964-49f1-8817-235ae006af2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:30:55.319938 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a10d2971-9c1e-4c71-ac73-ae6c68e0db45 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.602439 Aug 31 16:30:55.320938 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3303/6422] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:30:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:30:55.331473 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7727f624-cdf2-424f-8eaa-7a30ca55fcdf tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:55.332565 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7727f624-cdf2-424f-8eaa-7a30ca55fcdf tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] [instance: f55aba6a-0964-49f1-8817-235ae006af2c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:55.405598 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7727f624-cdf2-424f-8eaa-7a30ca55fcdf tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '910cdbb96c3246b78c7230eb6061b9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0351946f48f45899d9430bdc9cc33ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:55.418310 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7727f624-cdf2-424f-8eaa-7a30ca55fcdf tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] 10.222.0.50 "GET /compute/v2.1/servers/f55aba6a-0964-49f1-8817-235ae006af2c" status: 200 len: 1214 microversion: 2.1 time: 0.090698 Aug 31 16:30:55.419126 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3120/6423] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:55 2022] GET /compute/v2.1/servers/f55aba6a-0964-49f1-8817-235ae006af2c => generated 1214 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:30:55.628256 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-281744f4-f103-4bb2-8a73-9cc1066f989a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:55.629303 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-281744f4-f103-4bb2-8a73-9cc1066f989a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 158a6dc8-d946-4479-b3a5-ee3e97d283e8] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:55.640163 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-281744f4-f103-4bb2-8a73-9cc1066f989a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:55.640953 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-281744f4-f103-4bb2-8a73-9cc1066f989a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:55.641565 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-281744f4-f103-4bb2-8a73-9cc1066f989a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:55.642502 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-281744f4-f103-4bb2-8a73-9cc1066f989a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:55.643449 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-281744f4-f103-4bb2-8a73-9cc1066f989a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:55.644318 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-281744f4-f103-4bb2-8a73-9cc1066f989a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:55.718019 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-281744f4-f103-4bb2-8a73-9cc1066f989a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:55.731139 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-281744f4-f103-4bb2-8a73-9cc1066f989a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8" status: 200 len: 1192 microversion: 2.1 time: 0.107255 Aug 31 16:30:55.732378 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3304/6424] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:55 2022] GET /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8 => generated 1192 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:30:56.439498 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5d4e361a-a900-41a9-b989-b5379d73d649 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:56.440743 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5d4e361a-a900-41a9-b989-b5379d73d649 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] [instance: f55aba6a-0964-49f1-8817-235ae006af2c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:56.451349 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d4e361a-a900-41a9-b989-b5379d73d649 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:56.452076 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d4e361a-a900-41a9-b989-b5379d73d649 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:56.452663 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d4e361a-a900-41a9-b989-b5379d73d649 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:56.453553 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d4e361a-a900-41a9-b989-b5379d73d649 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:56.454178 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d4e361a-a900-41a9-b989-b5379d73d649 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:56.454748 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d4e361a-a900-41a9-b989-b5379d73d649 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:56.553538 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5d4e361a-a900-41a9-b989-b5379d73d649 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '910cdbb96c3246b78c7230eb6061b9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0351946f48f45899d9430bdc9cc33ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:56.568818 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5d4e361a-a900-41a9-b989-b5379d73d649 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] 10.222.0.50 "GET /compute/v2.1/servers/f55aba6a-0964-49f1-8817-235ae006af2c" status: 200 len: 1266 microversion: 2.1 time: 0.133077 Aug 31 16:30:56.570224 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3121/6425] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:56 2022] GET /compute/v2.1/servers/f55aba6a-0964-49f1-8817-235ae006af2c => generated 1266 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:30:56.754173 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6a1b5464-8dec-4853-b02d-52677830d257 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:56.755173 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6a1b5464-8dec-4853-b02d-52677830d257 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 158a6dc8-d946-4479-b3a5-ee3e97d283e8] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:56.764780 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6a1b5464-8dec-4853-b02d-52677830d257 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:56.765544 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6a1b5464-8dec-4853-b02d-52677830d257 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:56.766161 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6a1b5464-8dec-4853-b02d-52677830d257 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:56.767274 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6a1b5464-8dec-4853-b02d-52677830d257 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:56.768030 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6a1b5464-8dec-4853-b02d-52677830d257 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:56.769644 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6a1b5464-8dec-4853-b02d-52677830d257 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:56.853599 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6a1b5464-8dec-4853-b02d-52677830d257 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:56.864405 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6a1b5464-8dec-4853-b02d-52677830d257 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8" status: 200 len: 1210 microversion: 2.1 time: 0.114865 Aug 31 16:30:56.874920 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3305/6426] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:56 2022] GET /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8 => generated 1210 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:30:57.591997 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3efc556c-7e28-470a-92b7-e1d4e1033416 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:57.592625 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3efc556c-7e28-470a-92b7-e1d4e1033416 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] [instance: f55aba6a-0964-49f1-8817-235ae006af2c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:57.616005 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3efc556c-7e28-470a-92b7-e1d4e1033416 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:57.616714 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3efc556c-7e28-470a-92b7-e1d4e1033416 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:57.617332 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3efc556c-7e28-470a-92b7-e1d4e1033416 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:57.618278 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3efc556c-7e28-470a-92b7-e1d4e1033416 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:57.618906 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3efc556c-7e28-470a-92b7-e1d4e1033416 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:57.619336 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3efc556c-7e28-470a-92b7-e1d4e1033416 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:57.741543 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3efc556c-7e28-470a-92b7-e1d4e1033416 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '910cdbb96c3246b78c7230eb6061b9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0351946f48f45899d9430bdc9cc33ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:57.753061 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3efc556c-7e28-470a-92b7-e1d4e1033416 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] 10.222.0.50 "GET /compute/v2.1/servers/f55aba6a-0964-49f1-8817-235ae006af2c" status: 200 len: 1272 microversion: 2.1 time: 0.165301 Aug 31 16:30:57.754578 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3122/6427] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:57 2022] GET /compute/v2.1/servers/f55aba6a-0964-49f1-8817-235ae006af2c => generated 1272 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:30:57.889779 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f5df0cae-cd77-40f9-a97d-9252dd5d27e5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:57.890607 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f5df0cae-cd77-40f9-a97d-9252dd5d27e5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 158a6dc8-d946-4479-b3a5-ee3e97d283e8] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:57.908260 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f5df0cae-cd77-40f9-a97d-9252dd5d27e5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:57.909260 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f5df0cae-cd77-40f9-a97d-9252dd5d27e5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:57.910755 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f5df0cae-cd77-40f9-a97d-9252dd5d27e5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:57.911686 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f5df0cae-cd77-40f9-a97d-9252dd5d27e5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:57.912423 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f5df0cae-cd77-40f9-a97d-9252dd5d27e5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:57.912948 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f5df0cae-cd77-40f9-a97d-9252dd5d27e5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:58.232825 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f5df0cae-cd77-40f9-a97d-9252dd5d27e5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:58.247272 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f5df0cae-cd77-40f9-a97d-9252dd5d27e5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8" status: 200 len: 1278 microversion: 2.1 time: 0.361336 Aug 31 16:30:58.248486 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3306/6428] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:57 2022] GET /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8 => generated 1278 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:30:58.783243 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7d106df2-2765-4b03-9bba-97fbd9c9ddfb tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:58.785558 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7d106df2-2765-4b03-9bba-97fbd9c9ddfb tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] [instance: f55aba6a-0964-49f1-8817-235ae006af2c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:58.798048 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d106df2-2765-4b03-9bba-97fbd9c9ddfb tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:58.799560 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d106df2-2765-4b03-9bba-97fbd9c9ddfb tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:58.800339 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d106df2-2765-4b03-9bba-97fbd9c9ddfb tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:58.801619 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d106df2-2765-4b03-9bba-97fbd9c9ddfb tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:58.802616 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d106df2-2765-4b03-9bba-97fbd9c9ddfb tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:58.803359 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d106df2-2765-4b03-9bba-97fbd9c9ddfb tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:59.235613 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7d106df2-2765-4b03-9bba-97fbd9c9ddfb tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '910cdbb96c3246b78c7230eb6061b9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0351946f48f45899d9430bdc9cc33ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:59.247032 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-7ea3e076-676c-41f5-b618-4b0b85c6f44a req-02473b1b-9caa-43a8-93cc-513104d453ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "158a6dc8-d946-4479-b3a5-ee3e97d283e8", "tag": "d2f54ad1-7a5a-48df-bf38-500fbd01980e"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:30:59.254462 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7d106df2-2765-4b03-9bba-97fbd9c9ddfb tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] 10.222.0.50 "GET /compute/v2.1/servers/f55aba6a-0964-49f1-8817-235ae006af2c" status: 200 len: 1314 microversion: 2.1 time: 0.482488 Aug 31 16:30:59.256168 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3123/6429] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:58 2022] GET /compute/v2.1/servers/f55aba6a-0964-49f1-8817-235ae006af2c => generated 1314 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:30:59.275772 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7ea3e076-676c-41f5-b618-4b0b85c6f44a req-02473b1b-9caa-43a8-93cc-513104d453ec service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:59.277197 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7ea3e076-676c-41f5-b618-4b0b85c6f44a req-02473b1b-9caa-43a8-93cc-513104d453ec service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:59.278010 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7ea3e076-676c-41f5-b618-4b0b85c6f44a req-02473b1b-9caa-43a8-93cc-513104d453ec service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:59.278411 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-df864b88-ec62-4767-ade9-1b1a56302bc2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:30:59.279399 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-df864b88-ec62-4767-ade9-1b1a56302bc2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 158a6dc8-d946-4479-b3a5-ee3e97d283e8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:30:59.289167 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df864b88-ec62-4767-ade9-1b1a56302bc2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:59.289947 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df864b88-ec62-4767-ade9-1b1a56302bc2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:59.294639 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df864b88-ec62-4767-ade9-1b1a56302bc2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:59.295804 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df864b88-ec62-4767-ade9-1b1a56302bc2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:30:59.296442 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df864b88-ec62-4767-ade9-1b1a56302bc2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:30:59.297027 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df864b88-ec62-4767-ade9-1b1a56302bc2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:30:59.297768 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-7ea3e076-676c-41f5-b618-4b0b85c6f44a req-02473b1b-9caa-43a8-93cc-513104d453ec service nova] Creating event network-changed:d2f54ad1-7a5a-48df-bf38-500fbd01980e for instance 158a6dc8-d946-4479-b3a5-ee3e97d283e8 on n-h2-833090-16 Aug 31 16:30:59.305069 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-7ea3e076-676c-41f5-b618-4b0b85c6f44a req-02473b1b-9caa-43a8-93cc-513104d453ec service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.266239 Aug 31 16:30:59.306748 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3307/6430] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:30:59.523279 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-df864b88-ec62-4767-ade9-1b1a56302bc2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:30:59.544324 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-df864b88-ec62-4767-ade9-1b1a56302bc2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8" status: 200 len: 1278 microversion: 2.1 time: 0.277683 Aug 31 16:30:59.548376 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3124/6431] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:30:59 2022] GET /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8 => generated 1278 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:31:00.282033 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a3866ede-3ee2-4d66-bc95-8c378fc28d0c tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:00.282445 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a3866ede-3ee2-4d66-bc95-8c378fc28d0c tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] [instance: f55aba6a-0964-49f1-8817-235ae006af2c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:00.294680 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a3866ede-3ee2-4d66-bc95-8c378fc28d0c tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:00.295446 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a3866ede-3ee2-4d66-bc95-8c378fc28d0c tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:00.296242 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a3866ede-3ee2-4d66-bc95-8c378fc28d0c tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:00.297673 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a3866ede-3ee2-4d66-bc95-8c378fc28d0c tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:00.298355 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a3866ede-3ee2-4d66-bc95-8c378fc28d0c tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:00.298970 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a3866ede-3ee2-4d66-bc95-8c378fc28d0c tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:00.586857 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-01a3016e-dd03-4829-b7e9-d3333d991681 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:00.587543 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-01a3016e-dd03-4829-b7e9-d3333d991681 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 158a6dc8-d946-4479-b3a5-ee3e97d283e8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:00.600510 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01a3016e-dd03-4829-b7e9-d3333d991681 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:00.601015 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01a3016e-dd03-4829-b7e9-d3333d991681 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:00.601454 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01a3016e-dd03-4829-b7e9-d3333d991681 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:00.601893 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a3866ede-3ee2-4d66-bc95-8c378fc28d0c tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '910cdbb96c3246b78c7230eb6061b9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0351946f48f45899d9430bdc9cc33ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:00.602193 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01a3016e-dd03-4829-b7e9-d3333d991681 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:00.602650 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01a3016e-dd03-4829-b7e9-d3333d991681 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:00.603072 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-01a3016e-dd03-4829-b7e9-d3333d991681 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:00.619578 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a3866ede-3ee2-4d66-bc95-8c378fc28d0c tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] 10.222.0.50 "GET /compute/v2.1/servers/f55aba6a-0964-49f1-8817-235ae006af2c" status: 200 len: 1314 microversion: 2.1 time: 0.342917 Aug 31 16:31:00.620550 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3308/6432] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:00 2022] GET /compute/v2.1/servers/f55aba6a-0964-49f1-8817-235ae006af2c => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:31:00.625541 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8443a4c1-671f-4028-86c2-81031b885b7f tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:00.626549 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8443a4c1-671f-4028-86c2-81031b885b7f tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] [instance: e77fc40b-336f-4886-8a87-9376431bec27] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:00.634058 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8443a4c1-671f-4028-86c2-81031b885b7f tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:00.634963 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8443a4c1-671f-4028-86c2-81031b885b7f tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:00.635621 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8443a4c1-671f-4028-86c2-81031b885b7f tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:00.636699 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8443a4c1-671f-4028-86c2-81031b885b7f tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:00.637383 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8443a4c1-671f-4028-86c2-81031b885b7f tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:00.638017 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8443a4c1-671f-4028-86c2-81031b885b7f tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:00.675632 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8443a4c1-671f-4028-86c2-81031b885b7f tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] [instance: e77fc40b-336f-4886-8a87-9376431bec27] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:31:00.859693 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8443a4c1-671f-4028-86c2-81031b885b7f tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e77fc40b-336f-4886-8a87-9376431bec27" status: 204 len: 0 microversion: 2.1 time: 0.235045 Aug 31 16:31:00.864417 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3309/6433] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:31:00 2022] DELETE /compute/v2.1/servers/e77fc40b-336f-4886-8a87-9376431bec27 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:31:00.874751 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-7e6c99c7-63da-49ee-912e-f58deac6a880 req-6d785c8c-1a47-415a-b75c-8843178f3c45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e77fc40b-336f-4886-8a87-9376431bec27", "tag": "bb31973a-7cba-4adc-9ea9-a852d7c78acf"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:31:00.889780 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-01a3016e-dd03-4829-b7e9-d3333d991681 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:00.898597 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7e6c99c7-63da-49ee-912e-f58deac6a880 req-6d785c8c-1a47-415a-b75c-8843178f3c45 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:00.898848 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7e6c99c7-63da-49ee-912e-f58deac6a880 req-6d785c8c-1a47-415a-b75c-8843178f3c45 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:00.899213 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7e6c99c7-63da-49ee-912e-f58deac6a880 req-6d785c8c-1a47-415a-b75c-8843178f3c45 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:00.907385 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-01a3016e-dd03-4829-b7e9-d3333d991681 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8" status: 200 len: 1278 microversion: 2.1 time: 0.339715 Aug 31 16:31:00.908345 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3125/6434] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:00 2022] GET /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8 => generated 1278 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:31:00.922780 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-144877e4-6136-4564-a801-2b2bdc4210bb tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:00.923471 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-144877e4-6136-4564-a801-2b2bdc4210bb tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] [instance: e77fc40b-336f-4886-8a87-9376431bec27] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:00.929212 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-7e6c99c7-63da-49ee-912e-f58deac6a880 req-6d785c8c-1a47-415a-b75c-8843178f3c45 service nova] Creating event network-changed:bb31973a-7cba-4adc-9ea9-a852d7c78acf for instance e77fc40b-336f-4886-8a87-9376431bec27 on n-h1-833090-16 Aug 31 16:31:00.939558 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-144877e4-6136-4564-a801-2b2bdc4210bb tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:00.940438 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-144877e4-6136-4564-a801-2b2bdc4210bb tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:00.942364 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-144877e4-6136-4564-a801-2b2bdc4210bb tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:00.943575 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-144877e4-6136-4564-a801-2b2bdc4210bb tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:00.944073 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-7e6c99c7-63da-49ee-912e-f58deac6a880 req-6d785c8c-1a47-415a-b75c-8843178f3c45 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081801 Aug 31 16:31:00.944856 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3310/6435] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:31:00.947729 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-144877e4-6136-4564-a801-2b2bdc4210bb tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:00.948424 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-144877e4-6136-4564-a801-2b2bdc4210bb tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:01.174654 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-144877e4-6136-4564-a801-2b2bdc4210bb tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7edf821004c3fbca0a0b46de95799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e75ee3acbd4ad1aa0a8cb826f02bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:01.185619 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-144877e4-6136-4564-a801-2b2bdc4210bb tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] 10.222.0.50 "GET /compute/v2.1/servers/e77fc40b-336f-4886-8a87-9376431bec27" status: 200 len: 1583 microversion: 2.1 time: 0.272691 Aug 31 16:31:01.187389 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3126/6436] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:00 2022] GET /compute/v2.1/servers/e77fc40b-336f-4886-8a87-9376431bec27 => generated 1583 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:31:01.410790 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-d26bce5e-9a2d-46dd-a18c-47f564f85126 req-9de74a57-a34d-4b08-b511-30dba65a4994 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f55aba6a-0964-49f1-8817-235ae006af2c", "tag": "cd70e070-d687-4a57-bee9-ef70196a3390"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:31:01.429501 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-d26bce5e-9a2d-46dd-a18c-47f564f85126 req-9de74a57-a34d-4b08-b511-30dba65a4994 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:01.430709 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-d26bce5e-9a2d-46dd-a18c-47f564f85126 req-9de74a57-a34d-4b08-b511-30dba65a4994 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:01.431263 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-d26bce5e-9a2d-46dd-a18c-47f564f85126 req-9de74a57-a34d-4b08-b511-30dba65a4994 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:01.450324 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-d26bce5e-9a2d-46dd-a18c-47f564f85126 req-9de74a57-a34d-4b08-b511-30dba65a4994 service nova] Creating event network-changed:cd70e070-d687-4a57-bee9-ef70196a3390 for instance f55aba6a-0964-49f1-8817-235ae006af2c on n-h2-833090-16 Aug 31 16:31:01.466627 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-d26bce5e-9a2d-46dd-a18c-47f564f85126 req-9de74a57-a34d-4b08-b511-30dba65a4994 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063125 Aug 31 16:31:01.469724 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3311/6437] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:31:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:31:01.652691 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-83db2f41-8d9f-4caa-bc5e-13554f3cf507 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:01.653315 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-83db2f41-8d9f-4caa-bc5e-13554f3cf507 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] [instance: f55aba6a-0964-49f1-8817-235ae006af2c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:01.667864 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83db2f41-8d9f-4caa-bc5e-13554f3cf507 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:01.668526 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83db2f41-8d9f-4caa-bc5e-13554f3cf507 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:01.669114 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83db2f41-8d9f-4caa-bc5e-13554f3cf507 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:01.669995 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83db2f41-8d9f-4caa-bc5e-13554f3cf507 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:01.670916 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83db2f41-8d9f-4caa-bc5e-13554f3cf507 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:01.671483 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83db2f41-8d9f-4caa-bc5e-13554f3cf507 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:01.875348 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-83db2f41-8d9f-4caa-bc5e-13554f3cf507 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '910cdbb96c3246b78c7230eb6061b9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0351946f48f45899d9430bdc9cc33ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:01.885528 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-83db2f41-8d9f-4caa-bc5e-13554f3cf507 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] 10.222.0.50 "GET /compute/v2.1/servers/f55aba6a-0964-49f1-8817-235ae006af2c" status: 200 len: 1314 microversion: 2.1 time: 0.247217 Aug 31 16:31:01.888635 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3127/6438] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:01 2022] GET /compute/v2.1/servers/f55aba6a-0964-49f1-8817-235ae006af2c => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:31:01.931906 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1bf853d8-f79d-44a4-b224-1df93308c28b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:01.933946 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1bf853d8-f79d-44a4-b224-1df93308c28b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 158a6dc8-d946-4479-b3a5-ee3e97d283e8] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:01.950566 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1bf853d8-f79d-44a4-b224-1df93308c28b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:01.951290 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1bf853d8-f79d-44a4-b224-1df93308c28b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:01.952045 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1bf853d8-f79d-44a4-b224-1df93308c28b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:01.953516 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1bf853d8-f79d-44a4-b224-1df93308c28b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:01.954497 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1bf853d8-f79d-44a4-b224-1df93308c28b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:01.955218 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1bf853d8-f79d-44a4-b224-1df93308c28b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:02.210036 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bc518915-cf70-43ae-84d0-2d93848d4085 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:02.211097 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bc518915-cf70-43ae-84d0-2d93848d4085 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] [instance: e77fc40b-336f-4886-8a87-9376431bec27] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:02.218856 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc518915-cf70-43ae-84d0-2d93848d4085 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:02.220165 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc518915-cf70-43ae-84d0-2d93848d4085 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:02.220833 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc518915-cf70-43ae-84d0-2d93848d4085 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:02.222164 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc518915-cf70-43ae-84d0-2d93848d4085 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:02.222884 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc518915-cf70-43ae-84d0-2d93848d4085 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:02.223868 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc518915-cf70-43ae-84d0-2d93848d4085 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:02.757244 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1bf853d8-f79d-44a4-b224-1df93308c28b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:02.765712 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1bf853d8-f79d-44a4-b224-1df93308c28b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8" status: 200 len: 1278 microversion: 2.1 time: 0.841554 Aug 31 16:31:02.766322 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3312/6439] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:01 2022] GET /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8 => generated 1278 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:31:02.887921 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bc518915-cf70-43ae-84d0-2d93848d4085 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7edf821004c3fbca0a0b46de95799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e75ee3acbd4ad1aa0a8cb826f02bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:02.898809 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bc518915-cf70-43ae-84d0-2d93848d4085 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] 10.222.0.50 "GET /compute/v2.1/servers/e77fc40b-336f-4886-8a87-9376431bec27" status: 200 len: 1583 microversion: 2.1 time: 0.693629 Aug 31 16:31:02.899431 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3128/6440] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:02 2022] GET /compute/v2.1/servers/e77fc40b-336f-4886-8a87-9376431bec27 => generated 1583 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:31:02.911519 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ec5d826f-003a-4611-b86d-692add1395fa tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:02.912947 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ec5d826f-003a-4611-b86d-692add1395fa tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] [instance: f55aba6a-0964-49f1-8817-235ae006af2c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:02.921038 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ec5d826f-003a-4611-b86d-692add1395fa tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:02.921704 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ec5d826f-003a-4611-b86d-692add1395fa tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:02.922613 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ec5d826f-003a-4611-b86d-692add1395fa tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:02.923342 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ec5d826f-003a-4611-b86d-692add1395fa tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:02.923795 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ec5d826f-003a-4611-b86d-692add1395fa tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:02.924303 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ec5d826f-003a-4611-b86d-692add1395fa tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:03.156798 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ec5d826f-003a-4611-b86d-692add1395fa tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '910cdbb96c3246b78c7230eb6061b9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0351946f48f45899d9430bdc9cc33ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:03.169627 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ec5d826f-003a-4611-b86d-692add1395fa tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] 10.222.0.50 "GET /compute/v2.1/servers/f55aba6a-0964-49f1-8817-235ae006af2c" status: 200 len: 1314 microversion: 2.1 time: 0.263747 Aug 31 16:31:03.170719 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3313/6441] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:02 2022] GET /compute/v2.1/servers/f55aba6a-0964-49f1-8817-235ae006af2c => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:31:03.407795 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-da771c47-0b0f-4186-b360-51118dcadee4 req-5cc95e25-ca37-430f-8325-ceff1afd55c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e77fc40b-336f-4886-8a87-9376431bec27", "name": "network-vif-deleted", "tag": "bb31973a-7cba-4adc-9ea9-a852d7c78acf"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:31:03.420552 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-da771c47-0b0f-4186-b360-51118dcadee4 req-5cc95e25-ca37-430f-8325-ceff1afd55c4 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:03.421028 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-da771c47-0b0f-4186-b360-51118dcadee4 req-5cc95e25-ca37-430f-8325-ceff1afd55c4 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:03.421453 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-da771c47-0b0f-4186-b360-51118dcadee4 req-5cc95e25-ca37-430f-8325-ceff1afd55c4 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:03.435116 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-da771c47-0b0f-4186-b360-51118dcadee4 req-5cc95e25-ca37-430f-8325-ceff1afd55c4 service nova] Creating event network-vif-deleted:bb31973a-7cba-4adc-9ea9-a852d7c78acf for instance e77fc40b-336f-4886-8a87-9376431bec27 on n-h1-833090-16 Aug 31 16:31:03.442756 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-da771c47-0b0f-4186-b360-51118dcadee4 req-5cc95e25-ca37-430f-8325-ceff1afd55c4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038872 Aug 31 16:31:03.443914 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3129/6442] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:31:03.787279 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-be024d62-1e97-4bf6-a559-52b6d16cc315 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:03.787886 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-be024d62-1e97-4bf6-a559-52b6d16cc315 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 158a6dc8-d946-4479-b3a5-ee3e97d283e8] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:03.795075 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-be024d62-1e97-4bf6-a559-52b6d16cc315 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:03.795576 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-be024d62-1e97-4bf6-a559-52b6d16cc315 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:03.796024 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-be024d62-1e97-4bf6-a559-52b6d16cc315 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:03.796775 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-be024d62-1e97-4bf6-a559-52b6d16cc315 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:03.797242 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-be024d62-1e97-4bf6-a559-52b6d16cc315 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:03.797681 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-be024d62-1e97-4bf6-a559-52b6d16cc315 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:03.921931 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bd3bec7a-84b7-4a24-bbf3-fd8478963739 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:03.923788 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bd3bec7a-84b7-4a24-bbf3-fd8478963739 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] [instance: e77fc40b-336f-4886-8a87-9376431bec27] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:03.932720 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bd3bec7a-84b7-4a24-bbf3-fd8478963739 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:03.933628 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bd3bec7a-84b7-4a24-bbf3-fd8478963739 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:03.934148 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bd3bec7a-84b7-4a24-bbf3-fd8478963739 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:03.935142 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bd3bec7a-84b7-4a24-bbf3-fd8478963739 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:03.935815 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bd3bec7a-84b7-4a24-bbf3-fd8478963739 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:03.936381 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bd3bec7a-84b7-4a24-bbf3-fd8478963739 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:03.988500 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-be024d62-1e97-4bf6-a559-52b6d16cc315 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:03.999855 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-be024d62-1e97-4bf6-a559-52b6d16cc315 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8" status: 200 len: 1278 microversion: 2.1 time: 0.216741 Aug 31 16:31:04.001625 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3314/6443] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:03 2022] GET /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8 => generated 1278 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:31:04.039480 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bd3bec7a-84b7-4a24-bbf3-fd8478963739 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7edf821004c3fbca0a0b46de95799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e75ee3acbd4ad1aa0a8cb826f02bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:04.047763 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bd3bec7a-84b7-4a24-bbf3-fd8478963739 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] 10.222.0.50 "GET /compute/v2.1/servers/e77fc40b-336f-4886-8a87-9376431bec27" status: 200 len: 1230 microversion: 2.1 time: 0.130544 Aug 31 16:31:04.048511 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3130/6444] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:03 2022] GET /compute/v2.1/servers/e77fc40b-336f-4886-8a87-9376431bec27 => generated 1230 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:31:04.193770 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-125c28bd-49bd-4ae1-8979-6f0b6ce05f09 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:04.194452 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-125c28bd-49bd-4ae1-8979-6f0b6ce05f09 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] [instance: f55aba6a-0964-49f1-8817-235ae006af2c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:04.202033 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-125c28bd-49bd-4ae1-8979-6f0b6ce05f09 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:04.202642 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-125c28bd-49bd-4ae1-8979-6f0b6ce05f09 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:04.203161 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-125c28bd-49bd-4ae1-8979-6f0b6ce05f09 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:04.204092 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-125c28bd-49bd-4ae1-8979-6f0b6ce05f09 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:04.204632 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-125c28bd-49bd-4ae1-8979-6f0b6ce05f09 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:04.205320 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-125c28bd-49bd-4ae1-8979-6f0b6ce05f09 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:04.371757 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-125c28bd-49bd-4ae1-8979-6f0b6ce05f09 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '910cdbb96c3246b78c7230eb6061b9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0351946f48f45899d9430bdc9cc33ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:04.383657 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-125c28bd-49bd-4ae1-8979-6f0b6ce05f09 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] 10.222.0.50 "GET /compute/v2.1/servers/f55aba6a-0964-49f1-8817-235ae006af2c" status: 200 len: 1314 microversion: 2.1 time: 0.194359 Aug 31 16:31:04.395077 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3315/6445] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:04 2022] GET /compute/v2.1/servers/f55aba6a-0964-49f1-8817-235ae006af2c => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:31:05.023723 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bd2719cc-1c6b-4188-9586-3214efdd4310 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:05.025539 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bd2719cc-1c6b-4188-9586-3214efdd4310 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 158a6dc8-d946-4479-b3a5-ee3e97d283e8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:05.038795 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bd2719cc-1c6b-4188-9586-3214efdd4310 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:05.039919 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bd2719cc-1c6b-4188-9586-3214efdd4310 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:05.040578 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bd2719cc-1c6b-4188-9586-3214efdd4310 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:05.063024 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bd2719cc-1c6b-4188-9586-3214efdd4310 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:05.063873 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bd2719cc-1c6b-4188-9586-3214efdd4310 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:05.064452 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bd2719cc-1c6b-4188-9586-3214efdd4310 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:05.071407 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-dfb085f4-99ac-4244-aeb4-367ea8cf36e8 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:05.073502 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-dfb085f4-99ac-4244-aeb4-367ea8cf36e8 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] [instance: e77fc40b-336f-4886-8a87-9376431bec27] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:05.085852 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dfb085f4-99ac-4244-aeb4-367ea8cf36e8 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:05.086622 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dfb085f4-99ac-4244-aeb4-367ea8cf36e8 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:05.087282 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dfb085f4-99ac-4244-aeb4-367ea8cf36e8 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:05.088650 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dfb085f4-99ac-4244-aeb4-367ea8cf36e8 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:05.089315 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dfb085f4-99ac-4244-aeb4-367ea8cf36e8 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:05.089949 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dfb085f4-99ac-4244-aeb4-367ea8cf36e8 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:05.210912 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-dfb085f4-99ac-4244-aeb4-367ea8cf36e8 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7edf821004c3fbca0a0b46de95799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e75ee3acbd4ad1aa0a8cb826f02bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:05.223683 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-dfb085f4-99ac-4244-aeb4-367ea8cf36e8 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] 10.222.0.50 "GET /compute/v2.1/servers/e77fc40b-336f-4886-8a87-9376431bec27" status: 200 len: 1230 microversion: 2.1 time: 0.157973 Aug 31 16:31:05.234380 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3316/6446] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:05 2022] GET /compute/v2.1/servers/e77fc40b-336f-4886-8a87-9376431bec27 => generated 1230 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:31:05.291209 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bd2719cc-1c6b-4188-9586-3214efdd4310 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:05.299719 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bd2719cc-1c6b-4188-9586-3214efdd4310 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8" status: 200 len: 1266 microversion: 2.1 time: 0.281475 Aug 31 16:31:05.301233 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3131/6447] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:05 2022] GET /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8 => generated 1266 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:31:05.408281 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-df867ce7-1746-4f1c-8c69-c014a0896148 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:05.409392 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-df867ce7-1746-4f1c-8c69-c014a0896148 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] [instance: f55aba6a-0964-49f1-8817-235ae006af2c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:05.411956 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=4 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:31:05.412856 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=12 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:31:05.426606 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-df867ce7-1746-4f1c-8c69-c014a0896148 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:05.427504 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-df867ce7-1746-4f1c-8c69-c014a0896148 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:05.428151 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-df867ce7-1746-4f1c-8c69-c014a0896148 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:05.429088 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-df867ce7-1746-4f1c-8c69-c014a0896148 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:05.430019 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-df867ce7-1746-4f1c-8c69-c014a0896148 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:05.430634 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-df867ce7-1746-4f1c-8c69-c014a0896148 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:05.616224 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-df867ce7-1746-4f1c-8c69-c014a0896148 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '910cdbb96c3246b78c7230eb6061b9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0351946f48f45899d9430bdc9cc33ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:05.630412 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-df867ce7-1746-4f1c-8c69-c014a0896148 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] 10.222.0.50 "GET /compute/v2.1/servers/f55aba6a-0964-49f1-8817-235ae006af2c" status: 200 len: 1314 microversion: 2.1 time: 0.226640 Aug 31 16:31:05.632185 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3317/6448] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:05 2022] GET /compute/v2.1/servers/f55aba6a-0964-49f1-8817-235ae006af2c => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:31:06.251516 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c6e384ab-2d38-4a02-9d03-3e2d11e32639 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:06.252204 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c6e384ab-2d38-4a02-9d03-3e2d11e32639 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] [instance: e77fc40b-336f-4886-8a87-9376431bec27] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:06.259240 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:31:06.278932 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6e384ab-2d38-4a02-9d03-3e2d11e32639 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:06.280869 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6e384ab-2d38-4a02-9d03-3e2d11e32639 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:06.281590 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6e384ab-2d38-4a02-9d03-3e2d11e32639 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:06.284894 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6e384ab-2d38-4a02-9d03-3e2d11e32639 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:06.286543 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6e384ab-2d38-4a02-9d03-3e2d11e32639 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:06.288997 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c6e384ab-2d38-4a02-9d03-3e2d11e32639 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:06.324418 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f1af3f3d-69c8-46b1-96f7-873f3916f62a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:06.325845 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f1af3f3d-69c8-46b1-96f7-873f3916f62a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 158a6dc8-d946-4479-b3a5-ee3e97d283e8] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:06.339176 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f1af3f3d-69c8-46b1-96f7-873f3916f62a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:06.342814 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f1af3f3d-69c8-46b1-96f7-873f3916f62a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:06.343637 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f1af3f3d-69c8-46b1-96f7-873f3916f62a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:06.349399 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f1af3f3d-69c8-46b1-96f7-873f3916f62a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:06.350394 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f1af3f3d-69c8-46b1-96f7-873f3916f62a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:06.351296 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f1af3f3d-69c8-46b1-96f7-873f3916f62a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:06.499865 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c6e384ab-2d38-4a02-9d03-3e2d11e32639 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7edf821004c3fbca0a0b46de95799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e75ee3acbd4ad1aa0a8cb826f02bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:06.512137 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c6e384ab-2d38-4a02-9d03-3e2d11e32639 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] 10.222.0.50 "GET /compute/v2.1/servers/e77fc40b-336f-4886-8a87-9376431bec27" status: 200 len: 1230 microversion: 2.1 time: 0.266858 Aug 31 16:31:06.513582 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3132/6449] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:06 2022] GET /compute/v2.1/servers/e77fc40b-336f-4886-8a87-9376431bec27 => generated 1230 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:31:06.653913 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2f6706d8-c283-4449-9215-bf6c94e53bb2 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:06.656560 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2f6706d8-c283-4449-9215-bf6c94e53bb2 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] [instance: f55aba6a-0964-49f1-8817-235ae006af2c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:06.666714 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2f6706d8-c283-4449-9215-bf6c94e53bb2 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:06.668790 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2f6706d8-c283-4449-9215-bf6c94e53bb2 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:06.669995 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2f6706d8-c283-4449-9215-bf6c94e53bb2 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:06.671740 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2f6706d8-c283-4449-9215-bf6c94e53bb2 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:06.672198 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2f6706d8-c283-4449-9215-bf6c94e53bb2 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:06.673815 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2f6706d8-c283-4449-9215-bf6c94e53bb2 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:06.726394 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f1af3f3d-69c8-46b1-96f7-873f3916f62a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:06.737145 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f1af3f3d-69c8-46b1-96f7-873f3916f62a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8" status: 200 len: 1266 microversion: 2.1 time: 0.417232 Aug 31 16:31:06.738806 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3318/6450] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:06 2022] GET /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8 => generated 1266 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:31:06.976740 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2f6706d8-c283-4449-9215-bf6c94e53bb2 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '910cdbb96c3246b78c7230eb6061b9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0351946f48f45899d9430bdc9cc33ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:06.986067 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2f6706d8-c283-4449-9215-bf6c94e53bb2 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] 10.222.0.50 "GET /compute/v2.1/servers/f55aba6a-0964-49f1-8817-235ae006af2c" status: 200 len: 1314 microversion: 2.1 time: 0.337517 Aug 31 16:31:06.998149 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3133/6451] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:06 2022] GET /compute/v2.1/servers/f55aba6a-0964-49f1-8817-235ae006af2c => generated 1314 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:31:07.554275 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-41b1795c-5ca6-4a95-a08c-e92528de81d8 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:07.556613 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-41b1795c-5ca6-4a95-a08c-e92528de81d8 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] [instance: e77fc40b-336f-4886-8a87-9376431bec27] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:07.568544 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-41b1795c-5ca6-4a95-a08c-e92528de81d8 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:07.570180 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-41b1795c-5ca6-4a95-a08c-e92528de81d8 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:07.570803 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-41b1795c-5ca6-4a95-a08c-e92528de81d8 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:07.572200 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-41b1795c-5ca6-4a95-a08c-e92528de81d8 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:07.572866 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-41b1795c-5ca6-4a95-a08c-e92528de81d8 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:07.574207 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-41b1795c-5ca6-4a95-a08c-e92528de81d8 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:07.718294 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-41b1795c-5ca6-4a95-a08c-e92528de81d8 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7edf821004c3fbca0a0b46de95799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e75ee3acbd4ad1aa0a8cb826f02bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:07.731768 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-41b1795c-5ca6-4a95-a08c-e92528de81d8 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] 10.222.0.50 "GET /compute/v2.1/servers/e77fc40b-336f-4886-8a87-9376431bec27" status: 200 len: 1230 microversion: 2.1 time: 0.197362 Aug 31 16:31:07.732729 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3319/6452] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:07 2022] GET /compute/v2.1/servers/e77fc40b-336f-4886-8a87-9376431bec27 => generated 1230 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:31:07.761017 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9deb0993-cf37-4c4d-af9c-229db26e5801 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:07.762282 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9deb0993-cf37-4c4d-af9c-229db26e5801 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 158a6dc8-d946-4479-b3a5-ee3e97d283e8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:07.770063 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9deb0993-cf37-4c4d-af9c-229db26e5801 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:07.770881 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9deb0993-cf37-4c4d-af9c-229db26e5801 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:07.771721 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9deb0993-cf37-4c4d-af9c-229db26e5801 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:07.772203 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9deb0993-cf37-4c4d-af9c-229db26e5801 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:07.772658 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9deb0993-cf37-4c4d-af9c-229db26e5801 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:07.773078 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9deb0993-cf37-4c4d-af9c-229db26e5801 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:08.016735 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d4fbdeef-8ce0-48ee-989a-27322725628e tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:08.019762 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d4fbdeef-8ce0-48ee-989a-27322725628e tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] [instance: f55aba6a-0964-49f1-8817-235ae006af2c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:08.031813 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9deb0993-cf37-4c4d-af9c-229db26e5801 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:08.036410 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d4fbdeef-8ce0-48ee-989a-27322725628e tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:08.036952 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d4fbdeef-8ce0-48ee-989a-27322725628e tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:08.037510 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d4fbdeef-8ce0-48ee-989a-27322725628e tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:08.038521 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d4fbdeef-8ce0-48ee-989a-27322725628e tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:08.040444 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d4fbdeef-8ce0-48ee-989a-27322725628e tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:08.040922 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d4fbdeef-8ce0-48ee-989a-27322725628e tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:08.044434 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9deb0993-cf37-4c4d-af9c-229db26e5801 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8" status: 200 len: 1266 microversion: 2.1 time: 0.287837 Aug 31 16:31:08.045332 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3134/6453] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:07 2022] GET /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8 => generated 1266 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:31:08.048514 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:31:08.275600 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d4fbdeef-8ce0-48ee-989a-27322725628e tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '910cdbb96c3246b78c7230eb6061b9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0351946f48f45899d9430bdc9cc33ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:08.291915 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d4fbdeef-8ce0-48ee-989a-27322725628e tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] 10.222.0.50 "GET /compute/v2.1/servers/f55aba6a-0964-49f1-8817-235ae006af2c" status: 200 len: 1314 microversion: 2.1 time: 0.287492 Aug 31 16:31:08.292690 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3320/6454] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:08 2022] GET /compute/v2.1/servers/f55aba6a-0964-49f1-8817-235ae006af2c => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:31:08.755646 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-50ee6c8b-d830-46c4-b7de-9849e9392803 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:08.756677 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-50ee6c8b-d830-46c4-b7de-9849e9392803 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] [instance: e77fc40b-336f-4886-8a87-9376431bec27] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:08.767161 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50ee6c8b-d830-46c4-b7de-9849e9392803 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:08.768651 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50ee6c8b-d830-46c4-b7de-9849e9392803 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:08.768862 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50ee6c8b-d830-46c4-b7de-9849e9392803 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:08.769858 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50ee6c8b-d830-46c4-b7de-9849e9392803 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:08.770645 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50ee6c8b-d830-46c4-b7de-9849e9392803 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:08.771454 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50ee6c8b-d830-46c4-b7de-9849e9392803 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:08.812452 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50ee6c8b-d830-46c4-b7de-9849e9392803 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:08.812936 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50ee6c8b-d830-46c4-b7de-9849e9392803 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:08.813567 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50ee6c8b-d830-46c4-b7de-9849e9392803 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:08.814033 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-50ee6c8b-d830-46c4-b7de-9849e9392803 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lazy-loading 'fault' on Instance uuid e77fc40b-336f-4886-8a87-9376431bec27 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:31:08.890034 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-50ee6c8b-d830-46c4-b7de-9849e9392803 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf7edf821004c3fbca0a0b46de95799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50e75ee3acbd4ad1aa0a8cb826f02bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:08.900134 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-50ee6c8b-d830-46c4-b7de-9849e9392803 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] 10.222.0.50 "GET /compute/v2.1/servers/e77fc40b-336f-4886-8a87-9376431bec27" status: 200 len: 1235 microversion: 2.1 time: 0.150519 Aug 31 16:31:08.900740 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3135/6455] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:08 2022] GET /compute/v2.1/servers/e77fc40b-336f-4886-8a87-9376431bec27 => generated 1235 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:31:09.077510 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6110fa96-4278-4a9e-9efa-601c8c0dd1c5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:09.079955 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6110fa96-4278-4a9e-9efa-601c8c0dd1c5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 158a6dc8-d946-4479-b3a5-ee3e97d283e8] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:09.109382 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6110fa96-4278-4a9e-9efa-601c8c0dd1c5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:09.113374 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6110fa96-4278-4a9e-9efa-601c8c0dd1c5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:09.113374 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6110fa96-4278-4a9e-9efa-601c8c0dd1c5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:09.113374 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6110fa96-4278-4a9e-9efa-601c8c0dd1c5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:09.114713 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6110fa96-4278-4a9e-9efa-601c8c0dd1c5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:09.115348 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6110fa96-4278-4a9e-9efa-601c8c0dd1c5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:09.316516 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-851d1ff1-3356-4d44-80ea-497f01ff8589 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:09.317849 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-851d1ff1-3356-4d44-80ea-497f01ff8589 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] [instance: f55aba6a-0964-49f1-8817-235ae006af2c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:09.325727 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-851d1ff1-3356-4d44-80ea-497f01ff8589 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:09.326282 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-851d1ff1-3356-4d44-80ea-497f01ff8589 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:09.326722 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-851d1ff1-3356-4d44-80ea-497f01ff8589 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:09.327865 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-851d1ff1-3356-4d44-80ea-497f01ff8589 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:09.328846 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-851d1ff1-3356-4d44-80ea-497f01ff8589 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:09.329637 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-851d1ff1-3356-4d44-80ea-497f01ff8589 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:09.368073 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6110fa96-4278-4a9e-9efa-601c8c0dd1c5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:09.376301 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6110fa96-4278-4a9e-9efa-601c8c0dd1c5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8" status: 200 len: 1266 microversion: 2.1 time: 0.310670 Aug 31 16:31:09.377279 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3321/6456] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:09 2022] GET /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8 => generated 1266 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:31:09.559319 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-851d1ff1-3356-4d44-80ea-497f01ff8589 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '910cdbb96c3246b78c7230eb6061b9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0351946f48f45899d9430bdc9cc33ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:09.569124 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:31:09.591797 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-851d1ff1-3356-4d44-80ea-497f01ff8589 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] 10.222.0.50 "GET /compute/v2.1/servers/f55aba6a-0964-49f1-8817-235ae006af2c" status: 200 len: 1314 microversion: 2.1 time: 0.277387 Aug 31 16:31:09.592672 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3136/6457] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:09 2022] GET /compute/v2.1/servers/f55aba6a-0964-49f1-8817-235ae006af2c => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:31:09.921657 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fd2a1ce8-68d3-4632-b9c9-de6894dd6f47 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:09.922682 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fd2a1ce8-68d3-4632-b9c9-de6894dd6f47 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] [instance: e77fc40b-336f-4886-8a87-9376431bec27] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:09.932227 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fd2a1ce8-68d3-4632-b9c9-de6894dd6f47 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:09.933094 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fd2a1ce8-68d3-4632-b9c9-de6894dd6f47 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:09.933552 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fd2a1ce8-68d3-4632-b9c9-de6894dd6f47 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:09.934314 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fd2a1ce8-68d3-4632-b9c9-de6894dd6f47 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:09.935211 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fd2a1ce8-68d3-4632-b9c9-de6894dd6f47 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:09.935999 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fd2a1ce8-68d3-4632-b9c9-de6894dd6f47 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:09.956546 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-fd2a1ce8-68d3-4632-b9c9-de6894dd6f47 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] HTTP exception thrown: Instance e77fc40b-336f-4886-8a87-9376431bec27 could not be found. Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fd2a1ce8-68d3-4632-b9c9-de6894dd6f47 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Request method failure captured: Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/e77fc40b-336f-4886-8a87-9376431bec27 HTTP/1.1 Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4uiIc3uF3H9KeKwojtsNLZoTXs2IKNPsmZgqnEuu_K-BQ4T3N04Zti26boForeCR7S3sfIX3slufK4vbGZlTYpXhPBy-iQtMT8_RI-4F2t_cpbHJj70f8NwSK2yyBCnu1CToCouBMlWfGWwCh1bLbFgpdBDbgcDZRd0hUjbwLBSioE Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 50e75ee3acbd4ad1aa0a8cb826f02bc2 Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-TestVolumeBackupRestore-1170049606 Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/50e75ee3acbd4ad1aa0a8cb826f02bc2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/50e75ee3acbd4ad1aa0a8cb826f02bc2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/50e75ee3acbd4ad1aa0a8cb826f02bc2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_50e75ee3acbd4ad1aa0a8cb826f02bc2", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-TestVolumeBackupRestore-1170049606 Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 50e75ee3acbd4ad1aa0a8cb826f02bc2 Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1170049606 Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-TestVolumeBackupRestore-1170049606-project Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 6bf7edf821004c3fbca0a0b46de95799 Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-TestVolumeBackupRestore-1170049606-project Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance e77fc40b-336f-4886-8a87-9376431bec27 could not be found. Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'e77fc40b-336f-4886-8a87-9376431bec27'} Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e77fc40b-336f-4886-8a87-9376431bec27 could not be found. Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e77fc40b-336f-4886-8a87-9376431bec27 could not be found. Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:31:09.959136 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:31:09.963998 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:31:09.963998 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:31:09.963998 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:31:09.963998 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:31:09.963998 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:31:09.963998 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e77fc40b-336f-4886-8a87-9376431bec27 could not be found. Aug 31 16:31:09.963998 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:31:09.966287 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fd2a1ce8-68d3-4632-b9c9-de6894dd6f47 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Returning 404 to user: Instance e77fc40b-336f-4886-8a87-9376431bec27 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:31:09.967184 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fd2a1ce8-68d3-4632-b9c9-de6894dd6f47 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] 10.222.0.50 "GET /compute/v2.1/servers/e77fc40b-336f-4886-8a87-9376431bec27" status: 404 len: 111 microversion: 2.1 time: 0.050124 Aug 31 16:31:09.967764 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3322/6458] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:09 2022] GET /compute/v2.1/servers/e77fc40b-336f-4886-8a87-9376431bec27 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:31:10.293074 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-956f62c2-2d0b-40f1-8e25-5dd5e7135f28 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] Calling method '.version_select at 0x7fbb46330280>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:10.327471 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-956f62c2-2d0b-40f1-8e25-5dd5e7135f28 tempest-TestVolumeBackupRestore-1170049606 tempest-TestVolumeBackupRestore-1170049606-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-2004041068" status: 202 len: 0 microversion: 2.1 time: 0.041021 Aug 31 16:31:10.328461 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3137/6459] 10.222.0.50 () {58 vars in 1269 bytes} [Wed Aug 31 16:31:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-2004041068 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:31:10.397289 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f33d2dfb-75b0-49ba-8f45-4147a76c8753 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:10.398118 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f33d2dfb-75b0-49ba-8f45-4147a76c8753 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 158a6dc8-d946-4479-b3a5-ee3e97d283e8] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:10.407075 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f33d2dfb-75b0-49ba-8f45-4147a76c8753 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:10.407583 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f33d2dfb-75b0-49ba-8f45-4147a76c8753 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:10.408032 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f33d2dfb-75b0-49ba-8f45-4147a76c8753 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:10.408899 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f33d2dfb-75b0-49ba-8f45-4147a76c8753 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:10.409593 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f33d2dfb-75b0-49ba-8f45-4147a76c8753 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:10.413557 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f33d2dfb-75b0-49ba-8f45-4147a76c8753 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:10.619079 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6025eb60-bfae-4cbd-8af3-c05e2eb08e99 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:10.619942 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6025eb60-bfae-4cbd-8af3-c05e2eb08e99 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] [instance: f55aba6a-0964-49f1-8817-235ae006af2c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:10.651207 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6025eb60-bfae-4cbd-8af3-c05e2eb08e99 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:10.651777 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6025eb60-bfae-4cbd-8af3-c05e2eb08e99 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:10.652515 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6025eb60-bfae-4cbd-8af3-c05e2eb08e99 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:10.653357 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6025eb60-bfae-4cbd-8af3-c05e2eb08e99 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:10.653835 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6025eb60-bfae-4cbd-8af3-c05e2eb08e99 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:10.654295 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6025eb60-bfae-4cbd-8af3-c05e2eb08e99 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:10.694768 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f33d2dfb-75b0-49ba-8f45-4147a76c8753 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:10.707923 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f33d2dfb-75b0-49ba-8f45-4147a76c8753 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8" status: 200 len: 1266 microversion: 2.1 time: 0.313968 Aug 31 16:31:10.710637 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3323/6460] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:10 2022] GET /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8 => generated 1266 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:31:10.963452 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6025eb60-bfae-4cbd-8af3-c05e2eb08e99 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '910cdbb96c3246b78c7230eb6061b9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0351946f48f45899d9430bdc9cc33ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:10.978274 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6025eb60-bfae-4cbd-8af3-c05e2eb08e99 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] 10.222.0.50 "GET /compute/v2.1/servers/f55aba6a-0964-49f1-8817-235ae006af2c" status: 200 len: 1314 microversion: 2.1 time: 0.366361 Aug 31 16:31:10.979537 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3138/6461] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:10 2022] GET /compute/v2.1/servers/f55aba6a-0964-49f1-8817-235ae006af2c => generated 1314 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:31:11.622765 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-93196b0e-247d-467e-8a70-162de3bbd354 req-06259806-4849-4380-b952-94fa32527d13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f55aba6a-0964-49f1-8817-235ae006af2c", "name": "network-vif-plugged", "status": "completed", "tag": "cd70e070-d687-4a57-bee9-ef70196a3390"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:31:11.639509 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-93196b0e-247d-467e-8a70-162de3bbd354 req-06259806-4849-4380-b952-94fa32527d13 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:11.640318 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-93196b0e-247d-467e-8a70-162de3bbd354 req-06259806-4849-4380-b952-94fa32527d13 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:11.641366 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-93196b0e-247d-467e-8a70-162de3bbd354 req-06259806-4849-4380-b952-94fa32527d13 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:11.659544 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-93196b0e-247d-467e-8a70-162de3bbd354 req-06259806-4849-4380-b952-94fa32527d13 service nova] Creating event network-vif-plugged:cd70e070-d687-4a57-bee9-ef70196a3390 for instance f55aba6a-0964-49f1-8817-235ae006af2c on n-h2-833090-16 Aug 31 16:31:11.665815 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-93196b0e-247d-467e-8a70-162de3bbd354 req-06259806-4849-4380-b952-94fa32527d13 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046794 Aug 31 16:31:11.666729 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3324/6462] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:31:11.737597 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8333ac23-e54e-4611-b2a6-3a6e1922da78 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:11.738321 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8333ac23-e54e-4611-b2a6-3a6e1922da78 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 158a6dc8-d946-4479-b3a5-ee3e97d283e8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:11.760607 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8333ac23-e54e-4611-b2a6-3a6e1922da78 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:11.761271 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8333ac23-e54e-4611-b2a6-3a6e1922da78 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:11.762039 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8333ac23-e54e-4611-b2a6-3a6e1922da78 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:11.763178 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8333ac23-e54e-4611-b2a6-3a6e1922da78 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:11.763802 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8333ac23-e54e-4611-b2a6-3a6e1922da78 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:11.764570 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8333ac23-e54e-4611-b2a6-3a6e1922da78 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:12.002145 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-53339f2b-9934-44ca-9dde-5eb09a67b7e6 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:12.005093 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-53339f2b-9934-44ca-9dde-5eb09a67b7e6 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] [instance: f55aba6a-0964-49f1-8817-235ae006af2c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:12.030017 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-53339f2b-9934-44ca-9dde-5eb09a67b7e6 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:12.030923 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-53339f2b-9934-44ca-9dde-5eb09a67b7e6 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:12.031714 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-53339f2b-9934-44ca-9dde-5eb09a67b7e6 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:12.034390 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-53339f2b-9934-44ca-9dde-5eb09a67b7e6 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:12.035340 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-53339f2b-9934-44ca-9dde-5eb09a67b7e6 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:12.037734 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-53339f2b-9934-44ca-9dde-5eb09a67b7e6 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:12.472113 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8333ac23-e54e-4611-b2a6-3a6e1922da78 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:12.486158 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8333ac23-e54e-4611-b2a6-3a6e1922da78 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8" status: 200 len: 1266 microversion: 2.1 time: 0.752685 Aug 31 16:31:12.487602 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3139/6463] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:11 2022] GET /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8 => generated 1266 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:31:12.692464 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-53339f2b-9934-44ca-9dde-5eb09a67b7e6 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '910cdbb96c3246b78c7230eb6061b9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0351946f48f45899d9430bdc9cc33ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:12.707301 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-53339f2b-9934-44ca-9dde-5eb09a67b7e6 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] 10.222.0.50 "GET /compute/v2.1/servers/f55aba6a-0964-49f1-8817-235ae006af2c" status: 200 len: 1314 microversion: 2.1 time: 0.712041 Aug 31 16:31:12.733712 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3325/6464] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:11 2022] GET /compute/v2.1/servers/f55aba6a-0964-49f1-8817-235ae006af2c => generated 1314 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:31:13.516875 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-94a515f9-849a-448f-a735-0b178d93fd18 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:13.517588 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-94a515f9-849a-448f-a735-0b178d93fd18 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 158a6dc8-d946-4479-b3a5-ee3e97d283e8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:13.540485 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-94a515f9-849a-448f-a735-0b178d93fd18 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:13.540969 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-94a515f9-849a-448f-a735-0b178d93fd18 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:13.541409 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-94a515f9-849a-448f-a735-0b178d93fd18 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:13.542147 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-94a515f9-849a-448f-a735-0b178d93fd18 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:13.542626 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-94a515f9-849a-448f-a735-0b178d93fd18 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:13.543025 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-94a515f9-849a-448f-a735-0b178d93fd18 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:13.743912 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7aa98e62-6d6b-433c-aab2-ce1a05064ca3 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:13.744557 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7aa98e62-6d6b-433c-aab2-ce1a05064ca3 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] [instance: f55aba6a-0964-49f1-8817-235ae006af2c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:13.756865 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7aa98e62-6d6b-433c-aab2-ce1a05064ca3 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:13.757284 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7aa98e62-6d6b-433c-aab2-ce1a05064ca3 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:13.764785 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7aa98e62-6d6b-433c-aab2-ce1a05064ca3 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:13.765669 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7aa98e62-6d6b-433c-aab2-ce1a05064ca3 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:13.766181 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7aa98e62-6d6b-433c-aab2-ce1a05064ca3 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:13.766626 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7aa98e62-6d6b-433c-aab2-ce1a05064ca3 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:14.508803 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-94a515f9-849a-448f-a735-0b178d93fd18 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:14.527472 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-94a515f9-849a-448f-a735-0b178d93fd18 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8" status: 200 len: 1266 microversion: 2.1 time: 1.017141 Aug 31 16:31:14.528141 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3140/6465] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:13 2022] GET /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8 => generated 1266 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:31:14.562670 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7aa98e62-6d6b-433c-aab2-ce1a05064ca3 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '910cdbb96c3246b78c7230eb6061b9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0351946f48f45899d9430bdc9cc33ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:14.605576 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7aa98e62-6d6b-433c-aab2-ce1a05064ca3 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] 10.222.0.50 "GET /compute/v2.1/servers/f55aba6a-0964-49f1-8817-235ae006af2c" status: 200 len: 1314 microversion: 2.1 time: 0.868528 Aug 31 16:31:14.617443 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3326/6466] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:13 2022] GET /compute/v2.1/servers/f55aba6a-0964-49f1-8817-235ae006af2c => generated 1314 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:31:15.399389 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-4cd97e5b-9dc2-4285-a94c-b6bd8d48de73 req-51a30a1e-ac14-4525-ad3d-2c1336c5a1e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "158a6dc8-d946-4479-b3a5-ee3e97d283e8", "name": "network-vif-plugged", "status": "completed", "tag": "d2f54ad1-7a5a-48df-bf38-500fbd01980e"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:31:15.417242 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4cd97e5b-9dc2-4285-a94c-b6bd8d48de73 req-51a30a1e-ac14-4525-ad3d-2c1336c5a1e9 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:15.418929 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4cd97e5b-9dc2-4285-a94c-b6bd8d48de73 req-51a30a1e-ac14-4525-ad3d-2c1336c5a1e9 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:15.420117 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4cd97e5b-9dc2-4285-a94c-b6bd8d48de73 req-51a30a1e-ac14-4525-ad3d-2c1336c5a1e9 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:15.438656 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-4cd97e5b-9dc2-4285-a94c-b6bd8d48de73 req-51a30a1e-ac14-4525-ad3d-2c1336c5a1e9 service nova] Creating event network-vif-plugged:d2f54ad1-7a5a-48df-bf38-500fbd01980e for instance 158a6dc8-d946-4479-b3a5-ee3e97d283e8 on n-h2-833090-16 Aug 31 16:31:15.444930 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-4cd97e5b-9dc2-4285-a94c-b6bd8d48de73 req-51a30a1e-ac14-4525-ad3d-2c1336c5a1e9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049696 Aug 31 16:31:15.446257 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3141/6467] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:31:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:31:15.560945 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e4235a74-0fa5-41e5-bd3f-9006fc803dd8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:15.567465 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e4235a74-0fa5-41e5-bd3f-9006fc803dd8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 158a6dc8-d946-4479-b3a5-ee3e97d283e8] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:15.576448 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4235a74-0fa5-41e5-bd3f-9006fc803dd8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:15.577382 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4235a74-0fa5-41e5-bd3f-9006fc803dd8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:15.578168 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4235a74-0fa5-41e5-bd3f-9006fc803dd8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:15.579333 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4235a74-0fa5-41e5-bd3f-9006fc803dd8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:15.581450 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4235a74-0fa5-41e5-bd3f-9006fc803dd8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:15.582253 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4235a74-0fa5-41e5-bd3f-9006fc803dd8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:15.637730 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6e62e3d1-776c-4c25-80ef-9d9e3d3070d1 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:15.639377 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6e62e3d1-776c-4c25-80ef-9d9e3d3070d1 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] [instance: f55aba6a-0964-49f1-8817-235ae006af2c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:15.654787 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6e62e3d1-776c-4c25-80ef-9d9e3d3070d1 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:15.659204 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6e62e3d1-776c-4c25-80ef-9d9e3d3070d1 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:15.659981 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6e62e3d1-776c-4c25-80ef-9d9e3d3070d1 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:15.661002 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6e62e3d1-776c-4c25-80ef-9d9e3d3070d1 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:15.661877 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6e62e3d1-776c-4c25-80ef-9d9e3d3070d1 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:15.662740 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6e62e3d1-776c-4c25-80ef-9d9e3d3070d1 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:15.965791 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e4235a74-0fa5-41e5-bd3f-9006fc803dd8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:15.983297 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e4235a74-0fa5-41e5-bd3f-9006fc803dd8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8" status: 200 len: 1266 microversion: 2.1 time: 0.433366 Aug 31 16:31:16.003363 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6e62e3d1-776c-4c25-80ef-9d9e3d3070d1 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '910cdbb96c3246b78c7230eb6061b9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0351946f48f45899d9430bdc9cc33ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:16.011720 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3327/6468] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:15 2022] GET /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8 => generated 1266 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:31:16.020360 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6e62e3d1-776c-4c25-80ef-9d9e3d3070d1 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] 10.222.0.50 "GET /compute/v2.1/servers/f55aba6a-0964-49f1-8817-235ae006af2c" status: 200 len: 1462 microversion: 2.1 time: 0.392041 Aug 31 16:31:16.022869 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3142/6469] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:15 2022] GET /compute/v2.1/servers/f55aba6a-0964-49f1-8817-235ae006af2c => generated 1462 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:31:16.051920 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-49425909-ea66-4223-8e25-3da575bdb34a tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4097a5c0-ede1-4e04-a69d-6dcae879b740", "device": "/dev/sdb"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:31:16.062369 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-49425909-ea66-4223-8e25-3da575bdb34a tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] [instance: f55aba6a-0964-49f1-8817-235ae006af2c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:16.077555 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-49425909-ea66-4223-8e25-3da575bdb34a tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:16.080292 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-49425909-ea66-4223-8e25-3da575bdb34a tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:16.080982 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-49425909-ea66-4223-8e25-3da575bdb34a tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:16.082021 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-49425909-ea66-4223-8e25-3da575bdb34a tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:16.082678 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-49425909-ea66-4223-8e25-3da575bdb34a tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:16.083324 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-49425909-ea66-4223-8e25-3da575bdb34a tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:16.910455 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-49425909-ea66-4223-8e25-3da575bdb34a tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] 10.222.0.50 "POST /compute/v2.1/servers/f55aba6a-0964-49f1-8817-235ae006af2c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.865575 Aug 31 16:31:16.912212 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3328/6470] 10.222.0.50 () {60 vars in 1323 bytes} [Wed Aug 31 16:31:16 2022] POST /compute/v2.1/servers/f55aba6a-0964-49f1-8817-235ae006af2c/os-volume_attachments => generated 194 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:31:17.015270 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-995c8060-eff4-4505-9e8e-4a412dfdafe8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:17.017540 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-995c8060-eff4-4505-9e8e-4a412dfdafe8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 158a6dc8-d946-4479-b3a5-ee3e97d283e8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:17.028257 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-995c8060-eff4-4505-9e8e-4a412dfdafe8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:17.029213 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-995c8060-eff4-4505-9e8e-4a412dfdafe8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:17.029882 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-995c8060-eff4-4505-9e8e-4a412dfdafe8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:17.031380 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-995c8060-eff4-4505-9e8e-4a412dfdafe8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:17.033020 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-995c8060-eff4-4505-9e8e-4a412dfdafe8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:17.033880 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-995c8060-eff4-4505-9e8e-4a412dfdafe8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:17.474568 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-995c8060-eff4-4505-9e8e-4a412dfdafe8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:17.488425 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-995c8060-eff4-4505-9e8e-4a412dfdafe8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8" status: 200 len: 1266 microversion: 2.1 time: 0.481290 Aug 31 16:31:17.489036 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3143/6471] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:17 2022] GET /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8 => generated 1266 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:31:18.514691 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5053230c-66a1-4379-9ece-867b059848df tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:18.516721 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5053230c-66a1-4379-9ece-867b059848df tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 158a6dc8-d946-4479-b3a5-ee3e97d283e8] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:18.536069 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5053230c-66a1-4379-9ece-867b059848df tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:18.536873 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5053230c-66a1-4379-9ece-867b059848df tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:18.537483 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5053230c-66a1-4379-9ece-867b059848df tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:18.538653 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5053230c-66a1-4379-9ece-867b059848df tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:18.541010 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5053230c-66a1-4379-9ece-867b059848df tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:18.541010 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5053230c-66a1-4379-9ece-867b059848df tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:18.867277 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5053230c-66a1-4379-9ece-867b059848df tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:18.899368 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5053230c-66a1-4379-9ece-867b059848df tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8" status: 200 len: 1454 microversion: 2.1 time: 0.389658 Aug 31 16:31:18.919177 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3329/6472] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:18 2022] GET /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8 => generated 1454 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:31:18.925507 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c9f6d23c-3516-4e4b-8377-e1c6b28b75f2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:18.927021 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c9f6d23c-3516-4e4b-8377-e1c6b28b75f2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 158a6dc8-d946-4479-b3a5-ee3e97d283e8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:18.937199 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9f6d23c-3516-4e4b-8377-e1c6b28b75f2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:18.938249 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9f6d23c-3516-4e4b-8377-e1c6b28b75f2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:18.939038 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9f6d23c-3516-4e4b-8377-e1c6b28b75f2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:18.940469 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9f6d23c-3516-4e4b-8377-e1c6b28b75f2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:18.941297 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9f6d23c-3516-4e4b-8377-e1c6b28b75f2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:18.942194 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9f6d23c-3516-4e4b-8377-e1c6b28b75f2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:19.277870 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c9f6d23c-3516-4e4b-8377-e1c6b28b75f2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:19.290603 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c9f6d23c-3516-4e4b-8377-e1c6b28b75f2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8" status: 200 len: 1454 microversion: 2.1 time: 0.368707 Aug 31 16:31:19.291462 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3144/6473] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:18 2022] GET /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8 => generated 1454 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:31:22.835260 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-6ea0435f-8c54-4de4-9e42-15459bae1286 req-deda1390-def5-4eeb-806d-b7de8bd879c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "158a6dc8-d946-4479-b3a5-ee3e97d283e8", "tag": "d2f54ad1-7a5a-48df-bf38-500fbd01980e"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:31:22.847112 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-6ea0435f-8c54-4de4-9e42-15459bae1286 req-deda1390-def5-4eeb-806d-b7de8bd879c3 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:22.847877 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-6ea0435f-8c54-4de4-9e42-15459bae1286 req-deda1390-def5-4eeb-806d-b7de8bd879c3 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:22.848498 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-6ea0435f-8c54-4de4-9e42-15459bae1286 req-deda1390-def5-4eeb-806d-b7de8bd879c3 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:22.861553 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-6ea0435f-8c54-4de4-9e42-15459bae1286 req-deda1390-def5-4eeb-806d-b7de8bd879c3 service nova] Creating event network-changed:d2f54ad1-7a5a-48df-bf38-500fbd01980e for instance 158a6dc8-d946-4479-b3a5-ee3e97d283e8 on n-h2-833090-16 Aug 31 16:31:22.867351 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-6ea0435f-8c54-4de4-9e42-15459bae1286 req-deda1390-def5-4eeb-806d-b7de8bd879c3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035892 Aug 31 16:31:22.868317 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3330/6474] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:31:47.436387 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=63,nova_api:DELETE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:31:47.437980 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=38 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:31:47.709863 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-70a2ce90-c7ad-490f-93e5-a728d828e881 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:47.712405 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-70a2ce90-c7ad-490f-93e5-a728d828e881 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] [instance: 1652ca69-4e62-413f-aeda-ef5c8bbdcbe6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:47.732311 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70a2ce90-c7ad-490f-93e5-a728d828e881 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:47.735120 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70a2ce90-c7ad-490f-93e5-a728d828e881 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:47.735718 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70a2ce90-c7ad-490f-93e5-a728d828e881 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:47.736881 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70a2ce90-c7ad-490f-93e5-a728d828e881 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:47.737318 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70a2ce90-c7ad-490f-93e5-a728d828e881 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:47.739925 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70a2ce90-c7ad-490f-93e5-a728d828e881 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:47.796724 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-70a2ce90-c7ad-490f-93e5-a728d828e881 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] [instance: 1652ca69-4e62-413f-aeda-ef5c8bbdcbe6] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:31:47.925329 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-70a2ce90-c7ad-490f-93e5-a728d828e881 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] 10.222.0.50 "DELETE /compute/v2.1/servers/1652ca69-4e62-413f-aeda-ef5c8bbdcbe6" status: 204 len: 0 microversion: 2.1 time: 0.494822 Aug 31 16:31:47.925977 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3145/6475] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:31:47 2022] DELETE /compute/v2.1/servers/1652ca69-4e62-413f-aeda-ef5c8bbdcbe6 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:31:47.935786 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6d6e9472-5e67-4c60-87ba-5fd613916293 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:47.936495 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6d6e9472-5e67-4c60-87ba-5fd613916293 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] [instance: 1652ca69-4e62-413f-aeda-ef5c8bbdcbe6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:47.939366 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:31:47.951683 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:31:47.959433 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d6e9472-5e67-4c60-87ba-5fd613916293 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:47.959960 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d6e9472-5e67-4c60-87ba-5fd613916293 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:47.960383 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d6e9472-5e67-4c60-87ba-5fd613916293 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:47.961178 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d6e9472-5e67-4c60-87ba-5fd613916293 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:47.961620 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d6e9472-5e67-4c60-87ba-5fd613916293 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:47.962059 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d6e9472-5e67-4c60-87ba-5fd613916293 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:48.168671 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6d6e9472-5e67-4c60-87ba-5fd613916293 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491c3afd0b634b859f8388454184b8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad72fb986ae4235bc6daa067d8d30c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:48.181248 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6d6e9472-5e67-4c60-87ba-5fd613916293 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] 10.222.0.50 "GET /compute/v2.1/servers/1652ca69-4e62-413f-aeda-ef5c8bbdcbe6" status: 200 len: 1735 microversion: 2.1 time: 0.249968 Aug 31 16:31:48.182533 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3331/6476] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:47 2022] GET /compute/v2.1/servers/1652ca69-4e62-413f-aeda-ef5c8bbdcbe6 => generated 1735 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:31:49.204844 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9c3896d6-b866-4f0a-892f-e8167bd90f94 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:49.205529 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9c3896d6-b866-4f0a-892f-e8167bd90f94 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] [instance: 1652ca69-4e62-413f-aeda-ef5c8bbdcbe6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:49.213414 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c3896d6-b866-4f0a-892f-e8167bd90f94 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:49.213978 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c3896d6-b866-4f0a-892f-e8167bd90f94 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:49.214516 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c3896d6-b866-4f0a-892f-e8167bd90f94 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:49.215229 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c3896d6-b866-4f0a-892f-e8167bd90f94 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:49.215663 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c3896d6-b866-4f0a-892f-e8167bd90f94 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:49.216264 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9c3896d6-b866-4f0a-892f-e8167bd90f94 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:49.467123 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9c3896d6-b866-4f0a-892f-e8167bd90f94 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491c3afd0b634b859f8388454184b8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad72fb986ae4235bc6daa067d8d30c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:49.480489 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9c3896d6-b866-4f0a-892f-e8167bd90f94 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] 10.222.0.50 "GET /compute/v2.1/servers/1652ca69-4e62-413f-aeda-ef5c8bbdcbe6" status: 200 len: 1735 microversion: 2.1 time: 0.277262 Aug 31 16:31:49.482155 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3146/6477] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:49 2022] GET /compute/v2.1/servers/1652ca69-4e62-413f-aeda-ef5c8bbdcbe6 => generated 1735 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:31:50.353992 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-a3b4544b-1f53-41fd-ba4f-0a86f5069649 req-3cbb19a2-c27b-4c1b-b407-bf3529c38168 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1652ca69-4e62-413f-aeda-ef5c8bbdcbe6", "name": "network-vif-deleted", "tag": "8faf78da-76f3-45a7-adc4-310cb3235122"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:31:50.370369 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-a3b4544b-1f53-41fd-ba4f-0a86f5069649 req-3cbb19a2-c27b-4c1b-b407-bf3529c38168 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:50.373712 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-a3b4544b-1f53-41fd-ba4f-0a86f5069649 req-3cbb19a2-c27b-4c1b-b407-bf3529c38168 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:50.374337 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-a3b4544b-1f53-41fd-ba4f-0a86f5069649 req-3cbb19a2-c27b-4c1b-b407-bf3529c38168 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:50.390606 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-a3b4544b-1f53-41fd-ba4f-0a86f5069649 req-3cbb19a2-c27b-4c1b-b407-bf3529c38168 service nova] Creating event network-vif-deleted:8faf78da-76f3-45a7-adc4-310cb3235122 for instance 1652ca69-4e62-413f-aeda-ef5c8bbdcbe6 on n-h1-833090-16 Aug 31 16:31:50.396362 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-a3b4544b-1f53-41fd-ba4f-0a86f5069649 req-3cbb19a2-c27b-4c1b-b407-bf3529c38168 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046438 Aug 31 16:31:50.397871 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3332/6478] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:31:50.511095 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dcbcf050-09af-40f8-b32c-43eabce7f228 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:50.512819 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dcbcf050-09af-40f8-b32c-43eabce7f228 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] [instance: 1652ca69-4e62-413f-aeda-ef5c8bbdcbe6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:50.524272 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcbcf050-09af-40f8-b32c-43eabce7f228 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:50.525065 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcbcf050-09af-40f8-b32c-43eabce7f228 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:50.525664 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcbcf050-09af-40f8-b32c-43eabce7f228 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:50.526758 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcbcf050-09af-40f8-b32c-43eabce7f228 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:50.527392 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcbcf050-09af-40f8-b32c-43eabce7f228 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:50.528474 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcbcf050-09af-40f8-b32c-43eabce7f228 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:50.572506 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcbcf050-09af-40f8-b32c-43eabce7f228 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:50.573299 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcbcf050-09af-40f8-b32c-43eabce7f228 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:50.573959 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcbcf050-09af-40f8-b32c-43eabce7f228 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:50.574653 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-dcbcf050-09af-40f8-b32c-43eabce7f228 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lazy-loading 'fault' on Instance uuid 1652ca69-4e62-413f-aeda-ef5c8bbdcbe6 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:31:50.643995 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dcbcf050-09af-40f8-b32c-43eabce7f228 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491c3afd0b634b859f8388454184b8b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cad72fb986ae4235bc6daa067d8d30c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:31:50.655467 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dcbcf050-09af-40f8-b32c-43eabce7f228 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] 10.222.0.50 "GET /compute/v2.1/servers/1652ca69-4e62-413f-aeda-ef5c8bbdcbe6" status: 200 len: 1389 microversion: 2.1 time: 0.151779 Aug 31 16:31:50.656829 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3147/6479] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:50 2022] GET /compute/v2.1/servers/1652ca69-4e62-413f-aeda-ef5c8bbdcbe6 => generated 1389 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:31:51.691361 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-598c29d5-ec2c-40d3-9ad2-89b87417923a tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:51.692095 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-598c29d5-ec2c-40d3-9ad2-89b87417923a tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] [instance: 1652ca69-4e62-413f-aeda-ef5c8bbdcbe6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:51.701149 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-598c29d5-ec2c-40d3-9ad2-89b87417923a tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:51.701666 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-598c29d5-ec2c-40d3-9ad2-89b87417923a tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:51.702121 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-598c29d5-ec2c-40d3-9ad2-89b87417923a tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:51.703020 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-598c29d5-ec2c-40d3-9ad2-89b87417923a tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:51.704170 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-598c29d5-ec2c-40d3-9ad2-89b87417923a tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:51.708622 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-598c29d5-ec2c-40d3-9ad2-89b87417923a tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:51.724721 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-598c29d5-ec2c-40d3-9ad2-89b87417923a tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] HTTP exception thrown: Instance 1652ca69-4e62-413f-aeda-ef5c8bbdcbe6 could not be found. Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-598c29d5-ec2c-40d3-9ad2-89b87417923a tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Request method failure captured: Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/1652ca69-4e62-413f-aeda-ef5c8bbdcbe6 HTTP/1.1 Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4uubg2cGnIy6Dm98wL2o5DjZMlCT1s7o6o3sIB1dY48id7CdpZEw4PgIGfA3yvXyPn6AAGYBq5ZBRvA6mnoq8CGdgVJRwAqSEghs2MexHadoNStuLz7jC6kq0Jnvi7YL_J7euJqb0m-2jI-a4TwGxEogzh5mWA_C7BmDu3X_Xyj6IM Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: cad72fb986ae4235bc6daa067d8d30c7 Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-TestServerBasicOps-1043235854 Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cad72fb986ae4235bc6daa067d8d30c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cad72fb986ae4235bc6daa067d8d30c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cad72fb986ae4235bc6daa067d8d30c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cad72fb986ae4235bc6daa067d8d30c7", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-TestServerBasicOps-1043235854 Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: cad72fb986ae4235bc6daa067d8d30c7 Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-TestServerBasicOps-1043235854 Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-TestServerBasicOps-1043235854-project Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 491c3afd0b634b859f8388454184b8b1 Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-TestServerBasicOps-1043235854-project Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 1652ca69-4e62-413f-aeda-ef5c8bbdcbe6 could not be found. Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '1652ca69-4e62-413f-aeda-ef5c8bbdcbe6'} Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1652ca69-4e62-413f-aeda-ef5c8bbdcbe6 could not be found. Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1652ca69-4e62-413f-aeda-ef5c8bbdcbe6 could not be found. Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:31:51.727000 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:31:51.731709 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:31:51.731709 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:31:51.731709 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:31:51.731709 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:31:51.731709 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:31:51.731709 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1652ca69-4e62-413f-aeda-ef5c8bbdcbe6 could not be found. Aug 31 16:31:51.731709 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:31:51.731709 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-598c29d5-ec2c-40d3-9ad2-89b87417923a tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Returning 404 to user: Instance 1652ca69-4e62-413f-aeda-ef5c8bbdcbe6 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:31:51.731709 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-598c29d5-ec2c-40d3-9ad2-89b87417923a tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] 10.222.0.50 "GET /compute/v2.1/servers/1652ca69-4e62-413f-aeda-ef5c8bbdcbe6" status: 404 len: 111 microversion: 2.1 time: 0.054302 Aug 31 16:31:51.731709 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3333/6480] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:51 2022] GET /compute/v2.1/servers/1652ca69-4e62-413f-aeda-ef5c8bbdcbe6 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:31:52.433844 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dfb9fe41-c476-4644-b34a-6c13916fb832 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:52.434456 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dfb9fe41-c476-4644-b34a-6c13916fb832 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] [instance: 1652ca69-4e62-413f-aeda-ef5c8bbdcbe6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:52.442828 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfb9fe41-c476-4644-b34a-6c13916fb832 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:52.443567 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfb9fe41-c476-4644-b34a-6c13916fb832 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:52.444244 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfb9fe41-c476-4644-b34a-6c13916fb832 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:52.444951 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfb9fe41-c476-4644-b34a-6c13916fb832 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:52.445560 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfb9fe41-c476-4644-b34a-6c13916fb832 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:52.446155 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfb9fe41-c476-4644-b34a-6c13916fb832 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:52.462398 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-dfb9fe41-c476-4644-b34a-6c13916fb832 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] HTTP exception thrown: Instance 1652ca69-4e62-413f-aeda-ef5c8bbdcbe6 could not be found. Aug 31 16:31:52.464493 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dfb9fe41-c476-4644-b34a-6c13916fb832 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Request method failure captured: Aug 31 16:31:52.464493 n-d-833090-16 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/1652ca69-4e62-413f-aeda-ef5c8bbdcbe6 HTTP/1.1 Aug 31 16:31:52.464493 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:31:52.464493 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:31:52.464493 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:31:52.464493 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:31:52.464493 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:31:52.464493 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:31:52.464493 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:31:52.464493 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:31:52.464493 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4uubg2cGnIy6Dm98wL2o5DjZMlCT1s7o6o3sIB1dY48id7CdpZEw4PgIGfA3yvXyPn6AAGYBq5ZBRvA6mnoq8CGdgVJRwAqSEghs2MexHadoNStuLz7jC6kq0Jnvi7YL_J7euJqb0m-2jI-a4TwGxEogzh5mWA_C7BmDu3X_Xyj6IM Aug 31 16:31:52.464493 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:31:52.464493 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:31:52.464493 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:31:52.464493 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:31:52.464493 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:31:52.464493 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:31:52.464493 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: cad72fb986ae4235bc6daa067d8d30c7 Aug 31 16:31:52.464493 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-TestServerBasicOps-1043235854 Aug 31 16:31:52.464493 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:31:52.464493 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:31:52.464493 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cad72fb986ae4235bc6daa067d8d30c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cad72fb986ae4235bc6daa067d8d30c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cad72fb986ae4235bc6daa067d8d30c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cad72fb986ae4235bc6daa067d8d30c7", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:31:52.464493 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-TestServerBasicOps-1043235854 Aug 31 16:31:52.464493 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: cad72fb986ae4235bc6daa067d8d30c7 Aug 31 16:31:52.464493 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TestServerBasicOps-1043235854 Aug 31 16:31:52.464493 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-TestServerBasicOps-1043235854-project Aug 31 16:31:52.464493 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:31:52.464493 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:31:52.464493 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 491c3afd0b634b859f8388454184b8b1 Aug 31 16:31:52.464493 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-TestServerBasicOps-1043235854-project Aug 31 16:31:52.464493 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:31:52.464493 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 1652ca69-4e62-413f-aeda-ef5c8bbdcbe6 could not be found. Aug 31 16:31:52.464493 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '1652ca69-4e62-413f-aeda-ef5c8bbdcbe6'} Aug 31 16:31:52.464493 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:31:52.464493 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:31:52.464493 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:31:52.464493 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:31:52.464493 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:31:52.464493 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:31:52.464493 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:31:52.464493 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:31:52.464493 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:31:52.464493 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:31:52.464493 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1652ca69-4e62-413f-aeda-ef5c8bbdcbe6 could not be found. Aug 31 16:31:52.464493 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:31:52.464493 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:31:52.464493 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:31:52.464493 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:31:52.464493 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:31:52.464493 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:31:52.464493 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:31:52.464493 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:31:52.464493 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:31:52.464493 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:31:52.464493 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:31:52.464493 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:31:52.464493 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:31:52.464493 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:31:52.464493 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:31:52.464493 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:31:52.464493 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:31:52.464493 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:31:52.468444 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1652ca69-4e62-413f-aeda-ef5c8bbdcbe6 could not be found. Aug 31 16:31:52.468444 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:31:52.468444 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:31:52.468444 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:31:52.468444 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:31:52.468444 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:31:52.468444 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:31:52.468444 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:31:52.468444 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:31:52.468444 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1652ca69-4e62-413f-aeda-ef5c8bbdcbe6 could not be found. Aug 31 16:31:52.468444 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:31:52.470188 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dfb9fe41-c476-4644-b34a-6c13916fb832 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Returning 404 to user: Instance 1652ca69-4e62-413f-aeda-ef5c8bbdcbe6 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:31:52.471350 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dfb9fe41-c476-4644-b34a-6c13916fb832 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] 10.222.0.50 "DELETE /compute/v2.1/servers/1652ca69-4e62-413f-aeda-ef5c8bbdcbe6" status: 404 len: 111 microversion: 2.1 time: 0.041507 Aug 31 16:31:52.472479 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3148/6481] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:31:52 2022] DELETE /compute/v2.1/servers/1652ca69-4e62-413f-aeda-ef5c8bbdcbe6 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:31:52.480537 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4c30765a-9ea3-40b4-b378-1e426a748898 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:52.481687 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4c30765a-9ea3-40b4-b378-1e426a748898 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] [instance: 1652ca69-4e62-413f-aeda-ef5c8bbdcbe6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:31:52.487657 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4c30765a-9ea3-40b4-b378-1e426a748898 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:52.488370 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4c30765a-9ea3-40b4-b378-1e426a748898 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:52.489060 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4c30765a-9ea3-40b4-b378-1e426a748898 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:52.489888 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4c30765a-9ea3-40b4-b378-1e426a748898 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:31:52.490557 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4c30765a-9ea3-40b4-b378-1e426a748898 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:31:52.491548 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4c30765a-9ea3-40b4-b378-1e426a748898 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:31:52.508565 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-4c30765a-9ea3-40b4-b378-1e426a748898 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] HTTP exception thrown: Instance 1652ca69-4e62-413f-aeda-ef5c8bbdcbe6 could not be found. Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4c30765a-9ea3-40b4-b378-1e426a748898 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Request method failure captured: Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/1652ca69-4e62-413f-aeda-ef5c8bbdcbe6 HTTP/1.1 Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4uubg2cGnIy6Dm98wL2o5DjZMlCT1s7o6o3sIB1dY48id7CdpZEw4PgIGfA3yvXyPn6AAGYBq5ZBRvA6mnoq8CGdgVJRwAqSEghs2MexHadoNStuLz7jC6kq0Jnvi7YL_J7euJqb0m-2jI-a4TwGxEogzh5mWA_C7BmDu3X_Xyj6IM Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: cad72fb986ae4235bc6daa067d8d30c7 Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-TestServerBasicOps-1043235854 Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cad72fb986ae4235bc6daa067d8d30c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cad72fb986ae4235bc6daa067d8d30c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cad72fb986ae4235bc6daa067d8d30c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cad72fb986ae4235bc6daa067d8d30c7", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-TestServerBasicOps-1043235854 Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: cad72fb986ae4235bc6daa067d8d30c7 Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-TestServerBasicOps-1043235854 Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-TestServerBasicOps-1043235854-project Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 491c3afd0b634b859f8388454184b8b1 Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-TestServerBasicOps-1043235854-project Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 1652ca69-4e62-413f-aeda-ef5c8bbdcbe6 could not be found. Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '1652ca69-4e62-413f-aeda-ef5c8bbdcbe6'} Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1652ca69-4e62-413f-aeda-ef5c8bbdcbe6 could not be found. Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1652ca69-4e62-413f-aeda-ef5c8bbdcbe6 could not be found. Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:31:52.510568 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:31:52.514525 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:31:52.514525 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:31:52.514525 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:31:52.514525 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:31:52.514525 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:31:52.514525 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1652ca69-4e62-413f-aeda-ef5c8bbdcbe6 could not be found. Aug 31 16:31:52.514525 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:31:52.515619 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4c30765a-9ea3-40b4-b378-1e426a748898 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Returning 404 to user: Instance 1652ca69-4e62-413f-aeda-ef5c8bbdcbe6 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:31:52.516682 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4c30765a-9ea3-40b4-b378-1e426a748898 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] 10.222.0.50 "GET /compute/v2.1/servers/1652ca69-4e62-413f-aeda-ef5c8bbdcbe6" status: 404 len: 111 microversion: 2.1 time: 0.040422 Aug 31 16:31:52.521003 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3334/6482] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:31:52 2022] GET /compute/v2.1/servers/1652ca69-4e62-413f-aeda-ef5c8bbdcbe6 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:31:52.750275 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4ff6dcc2-9234-4ab7-bdea-44764ed017f7 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] Calling method '.version_select at 0x7fbb45934280>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:31:52.803984 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4ff6dcc2-9234-4ab7-bdea-44764ed017f7 tempest-TestServerBasicOps-1043235854 tempest-TestServerBasicOps-1043235854-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1423424004" status: 202 len: 0 microversion: 2.1 time: 0.058287 Aug 31 16:31:52.807835 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3149/6483] 10.222.0.50 () {58 vars in 1254 bytes} [Wed Aug 31 16:31:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1423424004 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:32:17.815900 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=8 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:32:17.817266 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=12 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:32:18.000759 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-34ad629b-9147-4b2b-8501-0433c6c6f18e tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:18.003185 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-34ad629b-9147-4b2b-8501-0433c6c6f18e tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:18.003663 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-34ad629b-9147-4b2b-8501-0433c6c6f18e tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:18.004154 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-34ad629b-9147-4b2b-8501-0433c6c6f18e tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:18.004919 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-34ad629b-9147-4b2b-8501-0433c6c6f18e tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:18.006373 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-34ad629b-9147-4b2b-8501-0433c6c6f18e tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:18.007627 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-34ad629b-9147-4b2b-8501-0433c6c6f18e tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:18.044073 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-34ad629b-9147-4b2b-8501-0433c6c6f18e tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] 10.222.0.50 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.233911 Aug 31 16:32:18.045697 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3335/6484] 10.222.0.50 () {58 vars in 1185 bytes} [Wed Aug 31 16:32:17 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:32:18.286785 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:32:18.287629 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:32:18.307274 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9a215b55-0f87-48c1-8a75-7cf2056f66fd tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-523987982", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "availability_zone": "nova:n-h2-833090-16", "networks": [{"uuid": "63fd74a5-3a86-4fe0-b226-6ba16757b16c"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:32:18.492884 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-9a215b55-0f87-48c1-8a75-7cf2056f66fd tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] validate_networks() for [('63fd74a5-3a86-4fe0-b226-6ba16757b16c', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:32:19.387999 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-9a215b55-0f87-48c1-8a75-7cf2056f66fd tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:32:19.389611 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-9a215b55-0f87-48c1-8a75-7cf2056f66fd tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:32:19.390378 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-9a215b55-0f87-48c1-8a75-7cf2056f66fd tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:32:19.391037 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-9a215b55-0f87-48c1-8a75-7cf2056f66fd tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:32:19.391729 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-9a215b55-0f87-48c1-8a75-7cf2056f66fd tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:32:19.401854 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a215b55-0f87-48c1-8a75-7cf2056f66fd tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:19.402653 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a215b55-0f87-48c1-8a75-7cf2056f66fd tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:19.403265 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a215b55-0f87-48c1-8a75-7cf2056f66fd tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:19.404158 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a215b55-0f87-48c1-8a75-7cf2056f66fd tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:19.405827 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a215b55-0f87-48c1-8a75-7cf2056f66fd tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:19.409581 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a215b55-0f87-48c1-8a75-7cf2056f66fd tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:19.456148 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-9a215b55-0f87-48c1-8a75-7cf2056f66fd tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Getting quotas for project a8876649937e493fbebe7fea6c638eb1. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:32:19.465437 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-9a215b55-0f87-48c1-8a75-7cf2056f66fd tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Getting quotas for user 7fb420dae04d472ba8b14374eec21b1b and project a8876649937e493fbebe7fea6c638eb1. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:32:19.515538 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9a215b55-0f87-48c1-8a75-7cf2056f66fd tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:32:19.518299 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9a215b55-0f87-48c1-8a75-7cf2056f66fd tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] [instance: 5784fa07-1e97-4e71-a3ae-eba6ffb1d958] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:32:19.625460 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9a215b55-0f87-48c1-8a75-7cf2056f66fd tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.345261 Aug 31 16:32:19.632273 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3150/6485] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:32:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1353 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:32:19.636855 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-07dd995b-1fa2-4905-bd92-04d83982affb tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:19.638134 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-07dd995b-1fa2-4905-bd92-04d83982affb tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] [instance: 5784fa07-1e97-4e71-a3ae-eba6ffb1d958] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:19.745583 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-07dd995b-1fa2-4905-bd92-04d83982affb tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/5784fa07-1e97-4e71-a3ae-eba6ffb1d958" status: 200 len: 1328 microversion: 2.1 time: 0.112378 Aug 31 16:32:19.752180 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3336/6486] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:32:19 2022] GET /compute/v2.1/servers/5784fa07-1e97-4e71-a3ae-eba6ffb1d958 => generated 1328 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:32:20.776889 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2d56155a-5519-4cd5-ac44-f6bf2939cb67 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:20.777469 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2d56155a-5519-4cd5-ac44-f6bf2939cb67 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] [instance: 5784fa07-1e97-4e71-a3ae-eba6ffb1d958] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:20.791504 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d56155a-5519-4cd5-ac44-f6bf2939cb67 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:20.792016 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d56155a-5519-4cd5-ac44-f6bf2939cb67 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:20.792466 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d56155a-5519-4cd5-ac44-f6bf2939cb67 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:20.793195 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d56155a-5519-4cd5-ac44-f6bf2939cb67 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:20.793653 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d56155a-5519-4cd5-ac44-f6bf2939cb67 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:20.794079 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d56155a-5519-4cd5-ac44-f6bf2939cb67 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:20.924325 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2d56155a-5519-4cd5-ac44-f6bf2939cb67 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/5784fa07-1e97-4e71-a3ae-eba6ffb1d958" status: 200 len: 1337 microversion: 2.1 time: 0.153526 Aug 31 16:32:20.928024 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3151/6487] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:32:20 2022] GET /compute/v2.1/servers/5784fa07-1e97-4e71-a3ae-eba6ffb1d958 => generated 1337 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:32:21.952251 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-06aa5c84-44ce-4aaa-8e80-9bfc03069904 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:21.954504 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-06aa5c84-44ce-4aaa-8e80-9bfc03069904 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] [instance: 5784fa07-1e97-4e71-a3ae-eba6ffb1d958] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:21.965658 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06aa5c84-44ce-4aaa-8e80-9bfc03069904 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:21.966851 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06aa5c84-44ce-4aaa-8e80-9bfc03069904 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:21.967933 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06aa5c84-44ce-4aaa-8e80-9bfc03069904 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:21.969794 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06aa5c84-44ce-4aaa-8e80-9bfc03069904 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:21.970587 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06aa5c84-44ce-4aaa-8e80-9bfc03069904 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:21.971683 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06aa5c84-44ce-4aaa-8e80-9bfc03069904 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:22.117629 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-06aa5c84-44ce-4aaa-8e80-9bfc03069904 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/5784fa07-1e97-4e71-a3ae-eba6ffb1d958" status: 200 len: 1423 microversion: 2.1 time: 0.172442 Aug 31 16:32:22.119932 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3337/6488] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:32:21 2022] GET /compute/v2.1/servers/5784fa07-1e97-4e71-a3ae-eba6ffb1d958 => generated 1423 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:32:23.143060 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dc447edd-1c59-49f4-a711-4287d39c9ab8 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:23.143926 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dc447edd-1c59-49f4-a711-4287d39c9ab8 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] [instance: 5784fa07-1e97-4e71-a3ae-eba6ffb1d958] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:23.167042 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc447edd-1c59-49f4-a711-4287d39c9ab8 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:23.167810 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc447edd-1c59-49f4-a711-4287d39c9ab8 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:23.168484 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc447edd-1c59-49f4-a711-4287d39c9ab8 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:23.170989 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc447edd-1c59-49f4-a711-4287d39c9ab8 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:23.171694 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc447edd-1c59-49f4-a711-4287d39c9ab8 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:23.172580 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc447edd-1c59-49f4-a711-4287d39c9ab8 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:23.413473 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dc447edd-1c59-49f4-a711-4287d39c9ab8 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/5784fa07-1e97-4e71-a3ae-eba6ffb1d958" status: 200 len: 1465 microversion: 2.1 time: 0.276481 Aug 31 16:32:23.430617 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3152/6489] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:32:23 2022] GET /compute/v2.1/servers/5784fa07-1e97-4e71-a3ae-eba6ffb1d958 => generated 1465 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:32:23.708014 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-5285d9bd-ff02-4af8-896a-f92cfff190f2 req-cb462891-7937-495c-b5fc-374639658e29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5784fa07-1e97-4e71-a3ae-eba6ffb1d958", "tag": "78a9e749-85f1-40bf-a3c0-dba671c26bcb"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:32:23.721026 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-5285d9bd-ff02-4af8-896a-f92cfff190f2 req-cb462891-7937-495c-b5fc-374639658e29 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:23.721792 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-5285d9bd-ff02-4af8-896a-f92cfff190f2 req-cb462891-7937-495c-b5fc-374639658e29 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:23.722447 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-5285d9bd-ff02-4af8-896a-f92cfff190f2 req-cb462891-7937-495c-b5fc-374639658e29 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:23.739646 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-5285d9bd-ff02-4af8-896a-f92cfff190f2 req-cb462891-7937-495c-b5fc-374639658e29 service nova] Creating event network-changed:78a9e749-85f1-40bf-a3c0-dba671c26bcb for instance 5784fa07-1e97-4e71-a3ae-eba6ffb1d958 on n-h2-833090-16 Aug 31 16:32:23.749365 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-5285d9bd-ff02-4af8-896a-f92cfff190f2 req-cb462891-7937-495c-b5fc-374639658e29 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045031 Aug 31 16:32:23.750274 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3338/6490] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:32:24.439639 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-77ce6b27-55b3-4968-8358-49d98b73d1a7 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:24.440255 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-77ce6b27-55b3-4968-8358-49d98b73d1a7 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] [instance: 5784fa07-1e97-4e71-a3ae-eba6ffb1d958] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:24.454508 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-77ce6b27-55b3-4968-8358-49d98b73d1a7 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:24.455247 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-77ce6b27-55b3-4968-8358-49d98b73d1a7 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:24.455848 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-77ce6b27-55b3-4968-8358-49d98b73d1a7 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:24.456907 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-77ce6b27-55b3-4968-8358-49d98b73d1a7 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:24.457508 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-77ce6b27-55b3-4968-8358-49d98b73d1a7 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:24.458362 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-77ce6b27-55b3-4968-8358-49d98b73d1a7 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:24.694082 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-77ce6b27-55b3-4968-8358-49d98b73d1a7 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/5784fa07-1e97-4e71-a3ae-eba6ffb1d958" status: 200 len: 1465 microversion: 2.1 time: 0.259784 Aug 31 16:32:24.694859 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3153/6491] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:32:24 2022] GET /compute/v2.1/servers/5784fa07-1e97-4e71-a3ae-eba6ffb1d958 => generated 1465 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:32:25.718862 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-dafb546e-6fbd-41cc-9cae-af6b7f1ba9bf tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:25.720525 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-dafb546e-6fbd-41cc-9cae-af6b7f1ba9bf tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] [instance: 5784fa07-1e97-4e71-a3ae-eba6ffb1d958] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:25.732604 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dafb546e-6fbd-41cc-9cae-af6b7f1ba9bf tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:25.734753 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dafb546e-6fbd-41cc-9cae-af6b7f1ba9bf tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:25.735231 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dafb546e-6fbd-41cc-9cae-af6b7f1ba9bf tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:25.736034 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dafb546e-6fbd-41cc-9cae-af6b7f1ba9bf tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:25.736541 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dafb546e-6fbd-41cc-9cae-af6b7f1ba9bf tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:25.737574 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dafb546e-6fbd-41cc-9cae-af6b7f1ba9bf tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:25.940202 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-dafb546e-6fbd-41cc-9cae-af6b7f1ba9bf tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/5784fa07-1e97-4e71-a3ae-eba6ffb1d958" status: 200 len: 1465 microversion: 2.1 time: 0.228379 Aug 31 16:32:25.940792 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3339/6492] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:32:25 2022] GET /compute/v2.1/servers/5784fa07-1e97-4e71-a3ae-eba6ffb1d958 => generated 1465 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:32:26.960744 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-99f7a086-56ec-420c-ac4d-5fbc47fe8a0a tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:26.962118 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-99f7a086-56ec-420c-ac4d-5fbc47fe8a0a tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] [instance: 5784fa07-1e97-4e71-a3ae-eba6ffb1d958] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:26.991640 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99f7a086-56ec-420c-ac4d-5fbc47fe8a0a tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:26.992408 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99f7a086-56ec-420c-ac4d-5fbc47fe8a0a tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:26.993031 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99f7a086-56ec-420c-ac4d-5fbc47fe8a0a tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:26.993900 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99f7a086-56ec-420c-ac4d-5fbc47fe8a0a tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:26.994971 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99f7a086-56ec-420c-ac4d-5fbc47fe8a0a tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:26.995554 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99f7a086-56ec-420c-ac4d-5fbc47fe8a0a tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:27.185106 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-99f7a086-56ec-420c-ac4d-5fbc47fe8a0a tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/5784fa07-1e97-4e71-a3ae-eba6ffb1d958" status: 200 len: 1465 microversion: 2.1 time: 0.227658 Aug 31 16:32:27.210821 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3154/6493] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:32:26 2022] GET /compute/v2.1/servers/5784fa07-1e97-4e71-a3ae-eba6ffb1d958 => generated 1465 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:32:27.417461 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-bea85268-0cce-407b-b60b-28a5bf768230 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-360576569", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "5413e62b-14ef-48bc-8c11-e9143627997e"}]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:32:27.486216 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-bea85268-0cce-407b-b60b-28a5bf768230 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] validate_networks() for [('5413e62b-14ef-48bc-8c11-e9143627997e', None, None, None, None, None)] {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:32:27.931911 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-bea85268-0cce-407b-b60b-28a5bf768230 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:32:27.932405 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-bea85268-0cce-407b-b60b-28a5bf768230 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:32:27.933032 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-bea85268-0cce-407b-b60b-28a5bf768230 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:32:27.933370 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-bea85268-0cce-407b-b60b-28a5bf768230 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:32:27.933820 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-bea85268-0cce-407b-b60b-28a5bf768230 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:32:27.943425 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bea85268-0cce-407b-b60b-28a5bf768230 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:27.943948 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bea85268-0cce-407b-b60b-28a5bf768230 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:27.944424 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bea85268-0cce-407b-b60b-28a5bf768230 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:27.945156 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bea85268-0cce-407b-b60b-28a5bf768230 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:27.945618 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bea85268-0cce-407b-b60b-28a5bf768230 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:27.946082 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bea85268-0cce-407b-b60b-28a5bf768230 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:27.963996 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-bea85268-0cce-407b-b60b-28a5bf768230 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Getting quotas for project 9fc30a2f3a6d455aaaff075b1b86b23f. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:32:27.970066 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-bea85268-0cce-407b-b60b-28a5bf768230 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Getting quotas for user 7977e3015b2f45099a76317fc6477b6b and project 9fc30a2f3a6d455aaaff075b1b86b23f. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:32:27.984239 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-bea85268-0cce-407b-b60b-28a5bf768230 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:32:27.986645 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-bea85268-0cce-407b-b60b-28a5bf768230 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] [instance: 87f68e78-c953-4be7-a824-ebffbd70e147] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:32:28.034642 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-bea85268-0cce-407b-b60b-28a5bf768230 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.797266 Aug 31 16:32:28.038186 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3340/6494] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:32:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:32:28.048067 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5938b801-3767-4248-80dc-9ac09f7b61e4 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:28.049426 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5938b801-3767-4248-80dc-9ac09f7b61e4 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] [instance: 87f68e78-c953-4be7-a824-ebffbd70e147] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:28.109387 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5938b801-3767-4248-80dc-9ac09f7b61e4 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7977e3015b2f45099a76317fc6477b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc30a2f3a6d455aaaff075b1b86b23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:32:28.118939 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5938b801-3767-4248-80dc-9ac09f7b61e4 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] 10.222.0.50 "GET /compute/v2.1/servers/87f68e78-c953-4be7-a824-ebffbd70e147" status: 200 len: 1213 microversion: 2.1 time: 0.075318 Aug 31 16:32:28.119544 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3155/6495] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:32:28 2022] GET /compute/v2.1/servers/87f68e78-c953-4be7-a824-ebffbd70e147 => generated 1213 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:32:28.211018 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-db3f1545-10fd-4173-98e3-37df5275ac28 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:28.211821 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-db3f1545-10fd-4173-98e3-37df5275ac28 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] [instance: 5784fa07-1e97-4e71-a3ae-eba6ffb1d958] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:28.221721 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db3f1545-10fd-4173-98e3-37df5275ac28 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:28.222852 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db3f1545-10fd-4173-98e3-37df5275ac28 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:28.223314 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db3f1545-10fd-4173-98e3-37df5275ac28 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:28.224045 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db3f1545-10fd-4173-98e3-37df5275ac28 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:28.224515 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db3f1545-10fd-4173-98e3-37df5275ac28 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:28.224958 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db3f1545-10fd-4173-98e3-37df5275ac28 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:28.395543 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-db3f1545-10fd-4173-98e3-37df5275ac28 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/5784fa07-1e97-4e71-a3ae-eba6ffb1d958" status: 200 len: 1465 microversion: 2.1 time: 0.188741 Aug 31 16:32:28.397158 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3341/6496] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:32:28 2022] GET /compute/v2.1/servers/5784fa07-1e97-4e71-a3ae-eba6ffb1d958 => generated 1465 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:32:29.145012 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-25fa99b0-b745-4200-afa9-9b73c60efc60 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:29.146300 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-25fa99b0-b745-4200-afa9-9b73c60efc60 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] [instance: 87f68e78-c953-4be7-a824-ebffbd70e147] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:29.155782 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25fa99b0-b745-4200-afa9-9b73c60efc60 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:29.157089 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25fa99b0-b745-4200-afa9-9b73c60efc60 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:29.157695 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25fa99b0-b745-4200-afa9-9b73c60efc60 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:29.158930 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25fa99b0-b745-4200-afa9-9b73c60efc60 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:29.159595 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25fa99b0-b745-4200-afa9-9b73c60efc60 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:29.160070 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-25fa99b0-b745-4200-afa9-9b73c60efc60 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:29.241296 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-25fa99b0-b745-4200-afa9-9b73c60efc60 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7977e3015b2f45099a76317fc6477b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc30a2f3a6d455aaaff075b1b86b23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:32:29.250888 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-25fa99b0-b745-4200-afa9-9b73c60efc60 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] 10.222.0.50 "GET /compute/v2.1/servers/87f68e78-c953-4be7-a824-ebffbd70e147" status: 200 len: 1273 microversion: 2.1 time: 0.110557 Aug 31 16:32:29.252254 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3156/6497] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:32:29 2022] GET /compute/v2.1/servers/87f68e78-c953-4be7-a824-ebffbd70e147 => generated 1273 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:32:29.421565 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ba01b091-848a-40fd-a641-115b8d4c95ef tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:29.422418 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ba01b091-848a-40fd-a641-115b8d4c95ef tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] [instance: 5784fa07-1e97-4e71-a3ae-eba6ffb1d958] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:29.430331 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ba01b091-848a-40fd-a641-115b8d4c95ef tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:29.431561 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ba01b091-848a-40fd-a641-115b8d4c95ef tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:29.432121 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ba01b091-848a-40fd-a641-115b8d4c95ef tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:29.433306 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ba01b091-848a-40fd-a641-115b8d4c95ef tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:29.433875 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ba01b091-848a-40fd-a641-115b8d4c95ef tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:29.434448 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ba01b091-848a-40fd-a641-115b8d4c95ef tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:29.657510 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ba01b091-848a-40fd-a641-115b8d4c95ef tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/5784fa07-1e97-4e71-a3ae-eba6ffb1d958" status: 200 len: 1465 microversion: 2.1 time: 0.241240 Aug 31 16:32:29.674070 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3342/6498] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:32:29 2022] GET /compute/v2.1/servers/5784fa07-1e97-4e71-a3ae-eba6ffb1d958 => generated 1465 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:32:29.736689 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:32:29.843850 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-7b934567-a0f4-49e3-858b-e603c618d1df req-03103bd0-efad-4a34-a6e3-a201c512ca3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5784fa07-1e97-4e71-a3ae-eba6ffb1d958", "name": "network-vif-plugged", "status": "completed", "tag": "78a9e749-85f1-40bf-a3c0-dba671c26bcb"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:32:29.853824 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7b934567-a0f4-49e3-858b-e603c618d1df req-03103bd0-efad-4a34-a6e3-a201c512ca3b service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:29.854617 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7b934567-a0f4-49e3-858b-e603c618d1df req-03103bd0-efad-4a34-a6e3-a201c512ca3b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:29.855172 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7b934567-a0f4-49e3-858b-e603c618d1df req-03103bd0-efad-4a34-a6e3-a201c512ca3b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:29.866945 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-7b934567-a0f4-49e3-858b-e603c618d1df req-03103bd0-efad-4a34-a6e3-a201c512ca3b service nova] Creating event network-vif-plugged:78a9e749-85f1-40bf-a3c0-dba671c26bcb for instance 5784fa07-1e97-4e71-a3ae-eba6ffb1d958 on n-h2-833090-16 Aug 31 16:32:29.874317 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-7b934567-a0f4-49e3-858b-e603c618d1df req-03103bd0-efad-4a34-a6e3-a201c512ca3b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146124 Aug 31 16:32:29.875137 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3157/6499] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:32:30.275339 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-568faee9-5442-477f-8f24-17ff7caa399b tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:30.276142 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-568faee9-5442-477f-8f24-17ff7caa399b tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] [instance: 87f68e78-c953-4be7-a824-ebffbd70e147] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:30.283510 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-568faee9-5442-477f-8f24-17ff7caa399b tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:30.284148 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-568faee9-5442-477f-8f24-17ff7caa399b tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:30.284823 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-568faee9-5442-477f-8f24-17ff7caa399b tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:30.285628 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-568faee9-5442-477f-8f24-17ff7caa399b tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:30.286266 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-568faee9-5442-477f-8f24-17ff7caa399b tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:30.286882 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-568faee9-5442-477f-8f24-17ff7caa399b tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:30.503123 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-568faee9-5442-477f-8f24-17ff7caa399b tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7977e3015b2f45099a76317fc6477b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc30a2f3a6d455aaaff075b1b86b23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:32:30.512113 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-568faee9-5442-477f-8f24-17ff7caa399b tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] 10.222.0.50 "GET /compute/v2.1/servers/87f68e78-c953-4be7-a824-ebffbd70e147" status: 200 len: 1313 microversion: 2.1 time: 0.241213 Aug 31 16:32:30.512830 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3343/6500] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:32:30 2022] GET /compute/v2.1/servers/87f68e78-c953-4be7-a824-ebffbd70e147 => generated 1313 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:32:30.683668 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e889ad15-6586-460e-ab8d-7302cc32794c tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:30.684421 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e889ad15-6586-460e-ab8d-7302cc32794c tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] [instance: 5784fa07-1e97-4e71-a3ae-eba6ffb1d958] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:30.692521 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e889ad15-6586-460e-ab8d-7302cc32794c tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:30.692957 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e889ad15-6586-460e-ab8d-7302cc32794c tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:30.693523 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e889ad15-6586-460e-ab8d-7302cc32794c tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:30.694626 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e889ad15-6586-460e-ab8d-7302cc32794c tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:30.701674 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e889ad15-6586-460e-ab8d-7302cc32794c tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:30.703368 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e889ad15-6586-460e-ab8d-7302cc32794c tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:30.803151 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-aa970761-0400-4406-adb7-7e80306ffd76 req-7fc45bfe-2e8e-476d-a8bc-0fba68c849b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87f68e78-c953-4be7-a824-ebffbd70e147", "tag": "6653c38c-8140-4558-9aaa-f0415c538bd6"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:32:30.813297 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-aa970761-0400-4406-adb7-7e80306ffd76 req-7fc45bfe-2e8e-476d-a8bc-0fba68c849b7 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:30.814046 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-aa970761-0400-4406-adb7-7e80306ffd76 req-7fc45bfe-2e8e-476d-a8bc-0fba68c849b7 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:30.814514 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-aa970761-0400-4406-adb7-7e80306ffd76 req-7fc45bfe-2e8e-476d-a8bc-0fba68c849b7 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:30.826935 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-aa970761-0400-4406-adb7-7e80306ffd76 req-7fc45bfe-2e8e-476d-a8bc-0fba68c849b7 service nova] Creating event network-changed:6653c38c-8140-4558-9aaa-f0415c538bd6 for instance 87f68e78-c953-4be7-a824-ebffbd70e147 on n-h1-833090-16 Aug 31 16:32:30.832359 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-aa970761-0400-4406-adb7-7e80306ffd76 req-7fc45bfe-2e8e-476d-a8bc-0fba68c849b7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135960 Aug 31 16:32:30.832985 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3344/6501] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:32:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:32:30.985430 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e889ad15-6586-460e-ab8d-7302cc32794c tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/5784fa07-1e97-4e71-a3ae-eba6ffb1d958" status: 200 len: 1465 microversion: 2.1 time: 0.308208 Aug 31 16:32:30.986180 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3158/6502] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:32:30 2022] GET /compute/v2.1/servers/5784fa07-1e97-4e71-a3ae-eba6ffb1d958 => generated 1465 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:32:31.535151 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b85f050c-91b7-4bed-a633-fe424999bda2 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:31.535900 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b85f050c-91b7-4bed-a633-fe424999bda2 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] [instance: 87f68e78-c953-4be7-a824-ebffbd70e147] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:31.543033 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b85f050c-91b7-4bed-a633-fe424999bda2 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:31.543864 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b85f050c-91b7-4bed-a633-fe424999bda2 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:31.544301 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b85f050c-91b7-4bed-a633-fe424999bda2 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:31.545020 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b85f050c-91b7-4bed-a633-fe424999bda2 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:31.545523 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b85f050c-91b7-4bed-a633-fe424999bda2 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:31.546147 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b85f050c-91b7-4bed-a633-fe424999bda2 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:31.703442 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b85f050c-91b7-4bed-a633-fe424999bda2 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7977e3015b2f45099a76317fc6477b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc30a2f3a6d455aaaff075b1b86b23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:32:31.711673 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b85f050c-91b7-4bed-a633-fe424999bda2 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] 10.222.0.50 "GET /compute/v2.1/servers/87f68e78-c953-4be7-a824-ebffbd70e147" status: 200 len: 1313 microversion: 2.1 time: 0.182345 Aug 31 16:32:31.712270 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3345/6503] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:32:31 2022] GET /compute/v2.1/servers/87f68e78-c953-4be7-a824-ebffbd70e147 => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:32:32.007542 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-194bc3c6-12e8-42d5-9084-f3c0d3acfd12 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:32.008265 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-194bc3c6-12e8-42d5-9084-f3c0d3acfd12 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] [instance: 5784fa07-1e97-4e71-a3ae-eba6ffb1d958] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:32.016490 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-194bc3c6-12e8-42d5-9084-f3c0d3acfd12 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:32.016901 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-194bc3c6-12e8-42d5-9084-f3c0d3acfd12 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:32.017428 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-194bc3c6-12e8-42d5-9084-f3c0d3acfd12 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:32.020254 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-194bc3c6-12e8-42d5-9084-f3c0d3acfd12 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:32.020254 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-194bc3c6-12e8-42d5-9084-f3c0d3acfd12 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:32.020254 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-194bc3c6-12e8-42d5-9084-f3c0d3acfd12 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:32.235161 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-194bc3c6-12e8-42d5-9084-f3c0d3acfd12 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/5784fa07-1e97-4e71-a3ae-eba6ffb1d958" status: 200 len: 1650 microversion: 2.1 time: 0.231412 Aug 31 16:32:32.236509 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3159/6504] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:32:32 2022] GET /compute/v2.1/servers/5784fa07-1e97-4e71-a3ae-eba6ffb1d958 => generated 1650 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:32:32.256946 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9f582209-a16e-4904-9c80-46791c90b554 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:32.257592 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9f582209-a16e-4904-9c80-46791c90b554 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] [instance: 5784fa07-1e97-4e71-a3ae-eba6ffb1d958] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:32.264536 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9f582209-a16e-4904-9c80-46791c90b554 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:32.265295 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9f582209-a16e-4904-9c80-46791c90b554 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:32.265902 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9f582209-a16e-4904-9c80-46791c90b554 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:32.267047 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9f582209-a16e-4904-9c80-46791c90b554 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:32.267707 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9f582209-a16e-4904-9c80-46791c90b554 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:32.268298 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9f582209-a16e-4904-9c80-46791c90b554 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:32.733004 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-65cb75a9-9d88-4e05-b739-2f62dbc13477 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:32.734452 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-65cb75a9-9d88-4e05-b739-2f62dbc13477 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] [instance: 87f68e78-c953-4be7-a824-ebffbd70e147] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:32.743902 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65cb75a9-9d88-4e05-b739-2f62dbc13477 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:32.744789 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65cb75a9-9d88-4e05-b739-2f62dbc13477 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:32.745496 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65cb75a9-9d88-4e05-b739-2f62dbc13477 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:32.746493 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65cb75a9-9d88-4e05-b739-2f62dbc13477 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:32.747175 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65cb75a9-9d88-4e05-b739-2f62dbc13477 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:32.747841 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-65cb75a9-9d88-4e05-b739-2f62dbc13477 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:32.956661 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9f582209-a16e-4904-9c80-46791c90b554 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/5784fa07-1e97-4e71-a3ae-eba6ffb1d958" status: 200 len: 1650 microversion: 2.1 time: 0.703997 Aug 31 16:32:32.957611 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3346/6505] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:32:32 2022] GET /compute/v2.1/servers/5784fa07-1e97-4e71-a3ae-eba6ffb1d958 => generated 1650 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:32:32.994473 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-23956390-3031-419a-82b5-0b64e8627ecc tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:32.995113 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-23956390-3031-419a-82b5-0b64e8627ecc tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] [instance: 5784fa07-1e97-4e71-a3ae-eba6ffb1d958] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:33.004354 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-23956390-3031-419a-82b5-0b64e8627ecc tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:33.004853 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-23956390-3031-419a-82b5-0b64e8627ecc tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:33.005364 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-23956390-3031-419a-82b5-0b64e8627ecc tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:33.007218 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-23956390-3031-419a-82b5-0b64e8627ecc tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:33.007851 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-23956390-3031-419a-82b5-0b64e8627ecc tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:33.008439 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-23956390-3031-419a-82b5-0b64e8627ecc tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:33.180802 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-65cb75a9-9d88-4e05-b739-2f62dbc13477 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7977e3015b2f45099a76317fc6477b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc30a2f3a6d455aaaff075b1b86b23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:32:33.194700 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-65cb75a9-9d88-4e05-b739-2f62dbc13477 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] 10.222.0.50 "GET /compute/v2.1/servers/87f68e78-c953-4be7-a824-ebffbd70e147" status: 200 len: 1313 microversion: 2.1 time: 0.465598 Aug 31 16:32:33.195447 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3160/6506] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:32:32 2022] GET /compute/v2.1/servers/87f68e78-c953-4be7-a824-ebffbd70e147 => generated 1313 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:32:33.272596 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-23956390-3031-419a-82b5-0b64e8627ecc tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/5784fa07-1e97-4e71-a3ae-eba6ffb1d958" status: 200 len: 1650 microversion: 2.1 time: 0.284009 Aug 31 16:32:33.273552 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3347/6507] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:32:32 2022] GET /compute/v2.1/servers/5784fa07-1e97-4e71-a3ae-eba6ffb1d958 => generated 1650 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:32:33.400161 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dbb35923-72a3-42a8-af95-03798058c2d2 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-259678604", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "availability_zone": "nova:n-h1-833090-16", "networks": [{"uuid": "63fd74a5-3a86-4fe0-b226-6ba16757b16c"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:32:33.481136 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-dbb35923-72a3-42a8-af95-03798058c2d2 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] validate_networks() for [('63fd74a5-3a86-4fe0-b226-6ba16757b16c', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:32:33.929248 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-dbb35923-72a3-42a8-af95-03798058c2d2 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:32:33.929761 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-dbb35923-72a3-42a8-af95-03798058c2d2 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:32:33.930275 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-dbb35923-72a3-42a8-af95-03798058c2d2 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:32:33.930681 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-dbb35923-72a3-42a8-af95-03798058c2d2 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:32:33.931093 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-dbb35923-72a3-42a8-af95-03798058c2d2 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:32:33.941260 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dbb35923-72a3-42a8-af95-03798058c2d2 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:33.941690 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dbb35923-72a3-42a8-af95-03798058c2d2 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:33.942346 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dbb35923-72a3-42a8-af95-03798058c2d2 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:33.943112 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dbb35923-72a3-42a8-af95-03798058c2d2 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:33.943500 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dbb35923-72a3-42a8-af95-03798058c2d2 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:33.943973 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dbb35923-72a3-42a8-af95-03798058c2d2 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:33.967217 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-dbb35923-72a3-42a8-af95-03798058c2d2 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Getting quotas for project a8876649937e493fbebe7fea6c638eb1. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:32:33.973478 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-dbb35923-72a3-42a8-af95-03798058c2d2 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Getting quotas for user 7fb420dae04d472ba8b14374eec21b1b and project a8876649937e493fbebe7fea6c638eb1. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:32:33.986497 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dbb35923-72a3-42a8-af95-03798058c2d2 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:32:33.988928 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dbb35923-72a3-42a8-af95-03798058c2d2 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] [instance: 73ac7526-f14e-497a-ab8a-9b36fc3fd094] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:32:34.041383 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dbb35923-72a3-42a8-af95-03798058c2d2 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.645265 Aug 31 16:32:34.042452 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3161/6508] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:32:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:32:34.054415 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3b4ec1af-6dc0-43a6-90b9-a2f840f17e93 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:34.055838 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3b4ec1af-6dc0-43a6-90b9-a2f840f17e93 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] [instance: 73ac7526-f14e-497a-ab8a-9b36fc3fd094] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:34.135541 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3b4ec1af-6dc0-43a6-90b9-a2f840f17e93 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/73ac7526-f14e-497a-ab8a-9b36fc3fd094" status: 200 len: 1328 microversion: 2.1 time: 0.084640 Aug 31 16:32:34.136289 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3348/6509] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:32:34 2022] GET /compute/v2.1/servers/73ac7526-f14e-497a-ab8a-9b36fc3fd094 => generated 1328 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:32:34.218814 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9553e545-f81a-4f9c-be76-88663835bae8 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:34.220573 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9553e545-f81a-4f9c-be76-88663835bae8 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] [instance: 87f68e78-c953-4be7-a824-ebffbd70e147] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:34.228314 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9553e545-f81a-4f9c-be76-88663835bae8 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:34.229308 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9553e545-f81a-4f9c-be76-88663835bae8 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:34.229919 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9553e545-f81a-4f9c-be76-88663835bae8 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:34.231344 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9553e545-f81a-4f9c-be76-88663835bae8 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:34.231953 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9553e545-f81a-4f9c-be76-88663835bae8 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:34.232993 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9553e545-f81a-4f9c-be76-88663835bae8 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:34.524424 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9553e545-f81a-4f9c-be76-88663835bae8 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7977e3015b2f45099a76317fc6477b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc30a2f3a6d455aaaff075b1b86b23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:32:34.541692 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9553e545-f81a-4f9c-be76-88663835bae8 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] 10.222.0.50 "GET /compute/v2.1/servers/87f68e78-c953-4be7-a824-ebffbd70e147" status: 200 len: 1313 microversion: 2.1 time: 0.327774 Aug 31 16:32:34.556120 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3162/6510] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:32:34 2022] GET /compute/v2.1/servers/87f68e78-c953-4be7-a824-ebffbd70e147 => generated 1313 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:32:35.157187 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a67a8c29-8e8a-418f-9a19-7fc04f0dd6f9 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:35.157815 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a67a8c29-8e8a-418f-9a19-7fc04f0dd6f9 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] [instance: 73ac7526-f14e-497a-ab8a-9b36fc3fd094] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:35.165634 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a67a8c29-8e8a-418f-9a19-7fc04f0dd6f9 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:35.166358 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a67a8c29-8e8a-418f-9a19-7fc04f0dd6f9 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:35.167104 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a67a8c29-8e8a-418f-9a19-7fc04f0dd6f9 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:35.167818 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a67a8c29-8e8a-418f-9a19-7fc04f0dd6f9 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:35.168270 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a67a8c29-8e8a-418f-9a19-7fc04f0dd6f9 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:35.168698 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a67a8c29-8e8a-418f-9a19-7fc04f0dd6f9 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:35.245676 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a67a8c29-8e8a-418f-9a19-7fc04f0dd6f9 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/73ac7526-f14e-497a-ab8a-9b36fc3fd094" status: 200 len: 1417 microversion: 2.1 time: 0.093522 Aug 31 16:32:35.246382 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3349/6511] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:32:35 2022] GET /compute/v2.1/servers/73ac7526-f14e-497a-ab8a-9b36fc3fd094 => generated 1417 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:32:35.570561 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-14a5312c-51bb-4ca1-a099-09e940f00c75 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:35.571482 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-14a5312c-51bb-4ca1-a099-09e940f00c75 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] [instance: 87f68e78-c953-4be7-a824-ebffbd70e147] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:35.589884 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14a5312c-51bb-4ca1-a099-09e940f00c75 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:35.590626 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14a5312c-51bb-4ca1-a099-09e940f00c75 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:35.591399 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14a5312c-51bb-4ca1-a099-09e940f00c75 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:35.592643 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14a5312c-51bb-4ca1-a099-09e940f00c75 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:35.595185 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14a5312c-51bb-4ca1-a099-09e940f00c75 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:35.595811 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-14a5312c-51bb-4ca1-a099-09e940f00c75 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:35.857020 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-14a5312c-51bb-4ca1-a099-09e940f00c75 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7977e3015b2f45099a76317fc6477b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc30a2f3a6d455aaaff075b1b86b23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:32:35.873788 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-14a5312c-51bb-4ca1-a099-09e940f00c75 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] 10.222.0.50 "GET /compute/v2.1/servers/87f68e78-c953-4be7-a824-ebffbd70e147" status: 200 len: 1313 microversion: 2.1 time: 0.307447 Aug 31 16:32:35.877037 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3163/6512] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:32:35 2022] GET /compute/v2.1/servers/87f68e78-c953-4be7-a824-ebffbd70e147 => generated 1313 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:32:36.267841 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1a9aa932-8ddb-4504-a176-1b9b5d313c9d tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:36.268408 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1a9aa932-8ddb-4504-a176-1b9b5d313c9d tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] [instance: 73ac7526-f14e-497a-ab8a-9b36fc3fd094] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:36.281721 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a9aa932-8ddb-4504-a176-1b9b5d313c9d tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:36.282152 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a9aa932-8ddb-4504-a176-1b9b5d313c9d tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:36.282680 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a9aa932-8ddb-4504-a176-1b9b5d313c9d tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:36.283286 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a9aa932-8ddb-4504-a176-1b9b5d313c9d tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:36.283744 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a9aa932-8ddb-4504-a176-1b9b5d313c9d tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:36.284194 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a9aa932-8ddb-4504-a176-1b9b5d313c9d tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:36.602452 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1a9aa932-8ddb-4504-a176-1b9b5d313c9d tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/73ac7526-f14e-497a-ab8a-9b36fc3fd094" status: 200 len: 1465 microversion: 2.1 time: 0.338804 Aug 31 16:32:36.614283 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3350/6513] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:32:36 2022] GET /compute/v2.1/servers/73ac7526-f14e-497a-ab8a-9b36fc3fd094 => generated 1465 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:32:36.640461 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-8af2caf0-3c33-4970-8e38-6fb05f470457 req-70efd7d5-54f3-45e4-ae29-e3d9233caab0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87f68e78-c953-4be7-a824-ebffbd70e147", "name": "network-vif-plugged", "status": "completed", "tag": "6653c38c-8140-4558-9aaa-f0415c538bd6"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:32:36.652863 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8af2caf0-3c33-4970-8e38-6fb05f470457 req-70efd7d5-54f3-45e4-ae29-e3d9233caab0 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:36.653685 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8af2caf0-3c33-4970-8e38-6fb05f470457 req-70efd7d5-54f3-45e4-ae29-e3d9233caab0 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:36.654310 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8af2caf0-3c33-4970-8e38-6fb05f470457 req-70efd7d5-54f3-45e4-ae29-e3d9233caab0 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:36.669871 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-8af2caf0-3c33-4970-8e38-6fb05f470457 req-70efd7d5-54f3-45e4-ae29-e3d9233caab0 service nova] Creating event network-vif-plugged:6653c38c-8140-4558-9aaa-f0415c538bd6 for instance 87f68e78-c953-4be7-a824-ebffbd70e147 on n-h1-833090-16 Aug 31 16:32:36.681033 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-8af2caf0-3c33-4970-8e38-6fb05f470457 req-70efd7d5-54f3-45e4-ae29-e3d9233caab0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043881 Aug 31 16:32:36.681654 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3164/6514] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:32:36.899104 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9975c889-679d-48bf-9ec5-45765fc1a634 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:36.899714 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9975c889-679d-48bf-9ec5-45765fc1a634 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] [instance: 87f68e78-c953-4be7-a824-ebffbd70e147] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:36.905995 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9975c889-679d-48bf-9ec5-45765fc1a634 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:36.906457 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9975c889-679d-48bf-9ec5-45765fc1a634 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:36.906920 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9975c889-679d-48bf-9ec5-45765fc1a634 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:36.907622 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9975c889-679d-48bf-9ec5-45765fc1a634 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:36.908079 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9975c889-679d-48bf-9ec5-45765fc1a634 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:36.908509 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9975c889-679d-48bf-9ec5-45765fc1a634 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:37.115940 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9975c889-679d-48bf-9ec5-45765fc1a634 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7977e3015b2f45099a76317fc6477b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc30a2f3a6d455aaaff075b1b86b23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:32:37.124892 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9975c889-679d-48bf-9ec5-45765fc1a634 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] 10.222.0.50 "GET /compute/v2.1/servers/87f68e78-c953-4be7-a824-ebffbd70e147" status: 200 len: 1313 microversion: 2.1 time: 0.230179 Aug 31 16:32:37.125483 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3351/6515] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:32:36 2022] GET /compute/v2.1/servers/87f68e78-c953-4be7-a824-ebffbd70e147 => generated 1313 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:32:37.149150 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-275770c5-6b18-4c72-9050-75edfd6c5496 req-5cb56820-0859-4b76-8435-a4f33c2ae589 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73ac7526-f14e-497a-ab8a-9b36fc3fd094", "tag": "271d2e9d-9a24-4ea2-bf3a-effbc0c2439b"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:32:37.185927 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-275770c5-6b18-4c72-9050-75edfd6c5496 req-5cb56820-0859-4b76-8435-a4f33c2ae589 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:37.190731 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-275770c5-6b18-4c72-9050-75edfd6c5496 req-5cb56820-0859-4b76-8435-a4f33c2ae589 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:37.191427 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-275770c5-6b18-4c72-9050-75edfd6c5496 req-5cb56820-0859-4b76-8435-a4f33c2ae589 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:37.197930 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3d95eadb-daa1-4399-8eb7-85e74672769c tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:37.198663 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3d95eadb-daa1-4399-8eb7-85e74672769c tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] [instance: f55aba6a-0964-49f1-8817-235ae006af2c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:37.206529 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-275770c5-6b18-4c72-9050-75edfd6c5496 req-5cb56820-0859-4b76-8435-a4f33c2ae589 service nova] Creating event network-changed:271d2e9d-9a24-4ea2-bf3a-effbc0c2439b for instance 73ac7526-f14e-497a-ab8a-9b36fc3fd094 on n-h1-833090-16 Aug 31 16:32:37.207011 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3d95eadb-daa1-4399-8eb7-85e74672769c tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:37.207958 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3d95eadb-daa1-4399-8eb7-85e74672769c tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:37.208568 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3d95eadb-daa1-4399-8eb7-85e74672769c tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:37.209296 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3d95eadb-daa1-4399-8eb7-85e74672769c tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:37.209765 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3d95eadb-daa1-4399-8eb7-85e74672769c tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:37.210226 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3d95eadb-daa1-4399-8eb7-85e74672769c tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:37.213606 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-275770c5-6b18-4c72-9050-75edfd6c5496 req-5cb56820-0859-4b76-8435-a4f33c2ae589 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070949 Aug 31 16:32:37.214630 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3165/6516] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:32:37.296029 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-3d95eadb-daa1-4399-8eb7-85e74672769c tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lazy-loading 'services' on Instance uuid f55aba6a-0964-49f1-8817-235ae006af2c {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:32:37.383961 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3d95eadb-daa1-4399-8eb7-85e74672769c tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] 10.222.0.50 "DELETE /compute/v2.1/servers/f55aba6a-0964-49f1-8817-235ae006af2c/os-volume_attachments/4097a5c0-ede1-4e04-a69d-6dcae879b740" status: 202 len: 0 microversion: 2.1 time: 0.192385 Aug 31 16:32:37.384582 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3352/6517] 10.222.0.50 () {58 vars in 1416 bytes} [Wed Aug 31 16:32:37 2022] DELETE /compute/v2.1/servers/f55aba6a-0964-49f1-8817-235ae006af2c/os-volume_attachments/4097a5c0-ede1-4e04-a69d-6dcae879b740 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:32:37.631026 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-512a6686-4780-42be-867d-b10c663a3ca0 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:37.631894 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-512a6686-4780-42be-867d-b10c663a3ca0 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] [instance: 73ac7526-f14e-497a-ab8a-9b36fc3fd094] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:37.640831 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-512a6686-4780-42be-867d-b10c663a3ca0 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:37.641627 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-512a6686-4780-42be-867d-b10c663a3ca0 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:37.641818 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-512a6686-4780-42be-867d-b10c663a3ca0 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:37.642602 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-512a6686-4780-42be-867d-b10c663a3ca0 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:37.642956 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-512a6686-4780-42be-867d-b10c663a3ca0 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:37.643372 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-512a6686-4780-42be-867d-b10c663a3ca0 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:37.823850 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-512a6686-4780-42be-867d-b10c663a3ca0 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/73ac7526-f14e-497a-ab8a-9b36fc3fd094" status: 200 len: 1465 microversion: 2.1 time: 0.196710 Aug 31 16:32:37.824516 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3166/6518] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:32:37 2022] GET /compute/v2.1/servers/73ac7526-f14e-497a-ab8a-9b36fc3fd094 => generated 1465 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:32:38.143238 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=4 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:32:38.148047 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d6780e2c-4f3c-4516-b132-2d806cca5c68 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:38.148786 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d6780e2c-4f3c-4516-b132-2d806cca5c68 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] [instance: 87f68e78-c953-4be7-a824-ebffbd70e147] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:38.156992 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d6780e2c-4f3c-4516-b132-2d806cca5c68 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:38.157506 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d6780e2c-4f3c-4516-b132-2d806cca5c68 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:38.157961 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d6780e2c-4f3c-4516-b132-2d806cca5c68 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:38.158742 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d6780e2c-4f3c-4516-b132-2d806cca5c68 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:38.159194 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d6780e2c-4f3c-4516-b132-2d806cca5c68 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:38.159662 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d6780e2c-4f3c-4516-b132-2d806cca5c68 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:38.312629 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d6780e2c-4f3c-4516-b132-2d806cca5c68 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7977e3015b2f45099a76317fc6477b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc30a2f3a6d455aaaff075b1b86b23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:32:38.321620 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d6780e2c-4f3c-4516-b132-2d806cca5c68 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] 10.222.0.50 "GET /compute/v2.1/servers/87f68e78-c953-4be7-a824-ebffbd70e147" status: 200 len: 1495 microversion: 2.1 time: 0.179447 Aug 31 16:32:38.322285 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3353/6519] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:32:38 2022] GET /compute/v2.1/servers/87f68e78-c953-4be7-a824-ebffbd70e147 => generated 1495 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:32:38.848529 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-66caf436-7486-42af-bfb7-160a84682599 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:38.849262 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-66caf436-7486-42af-bfb7-160a84682599 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] [instance: 73ac7526-f14e-497a-ab8a-9b36fc3fd094] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:38.856922 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66caf436-7486-42af-bfb7-160a84682599 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:38.857691 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66caf436-7486-42af-bfb7-160a84682599 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:38.858580 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66caf436-7486-42af-bfb7-160a84682599 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:38.859567 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66caf436-7486-42af-bfb7-160a84682599 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:38.860299 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66caf436-7486-42af-bfb7-160a84682599 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:38.860794 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-66caf436-7486-42af-bfb7-160a84682599 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:39.140591 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-66caf436-7486-42af-bfb7-160a84682599 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/73ac7526-f14e-497a-ab8a-9b36fc3fd094" status: 200 len: 1465 microversion: 2.1 time: 0.296236 Aug 31 16:32:39.142197 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3167/6520] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:32:38 2022] GET /compute/v2.1/servers/73ac7526-f14e-497a-ab8a-9b36fc3fd094 => generated 1465 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:32:40.163209 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f99809e7-ca27-43bb-9c6e-467fb49afdfd tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:40.163977 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f99809e7-ca27-43bb-9c6e-467fb49afdfd tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] [instance: 73ac7526-f14e-497a-ab8a-9b36fc3fd094] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:40.174539 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f99809e7-ca27-43bb-9c6e-467fb49afdfd tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:40.174915 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f99809e7-ca27-43bb-9c6e-467fb49afdfd tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:40.175426 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f99809e7-ca27-43bb-9c6e-467fb49afdfd tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:40.176520 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f99809e7-ca27-43bb-9c6e-467fb49afdfd tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:40.176520 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f99809e7-ca27-43bb-9c6e-467fb49afdfd tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:40.178408 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f99809e7-ca27-43bb-9c6e-467fb49afdfd tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:40.327947 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f99809e7-ca27-43bb-9c6e-467fb49afdfd tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/73ac7526-f14e-497a-ab8a-9b36fc3fd094" status: 200 len: 1465 microversion: 2.1 time: 0.169887 Aug 31 16:32:40.328727 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3354/6521] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:32:40 2022] GET /compute/v2.1/servers/73ac7526-f14e-497a-ab8a-9b36fc3fd094 => generated 1465 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:32:40.906791 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c7eda175-d6c6-4a50-abbb-436341b40c4a tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:40.908633 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c7eda175-d6c6-4a50-abbb-436341b40c4a tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] [instance: 87f68e78-c953-4be7-a824-ebffbd70e147] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:40.918972 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7eda175-d6c6-4a50-abbb-436341b40c4a tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:40.919605 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7eda175-d6c6-4a50-abbb-436341b40c4a tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:40.920578 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7eda175-d6c6-4a50-abbb-436341b40c4a tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:40.921646 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7eda175-d6c6-4a50-abbb-436341b40c4a tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:40.922187 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7eda175-d6c6-4a50-abbb-436341b40c4a tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:40.922710 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c7eda175-d6c6-4a50-abbb-436341b40c4a tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:40.955869 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c7eda175-d6c6-4a50-abbb-436341b40c4a tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] [instance: 87f68e78-c953-4be7-a824-ebffbd70e147] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:32:41.061517 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c7eda175-d6c6-4a50-abbb-436341b40c4a tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] 10.222.0.50 "DELETE /compute/v2.1/servers/87f68e78-c953-4be7-a824-ebffbd70e147" status: 204 len: 0 microversion: 2.1 time: 0.159027 Aug 31 16:32:41.062541 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3168/6522] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:32:40 2022] DELETE /compute/v2.1/servers/87f68e78-c953-4be7-a824-ebffbd70e147 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:32:41.072406 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fe8c2b06-9039-4d0e-b07f-cbbd3f83b84e tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:41.073508 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fe8c2b06-9039-4d0e-b07f-cbbd3f83b84e tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] [instance: 87f68e78-c953-4be7-a824-ebffbd70e147] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:41.080294 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fe8c2b06-9039-4d0e-b07f-cbbd3f83b84e tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:41.081139 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fe8c2b06-9039-4d0e-b07f-cbbd3f83b84e tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:41.081819 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fe8c2b06-9039-4d0e-b07f-cbbd3f83b84e tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:41.082779 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fe8c2b06-9039-4d0e-b07f-cbbd3f83b84e tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:41.083648 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fe8c2b06-9039-4d0e-b07f-cbbd3f83b84e tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:41.084180 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fe8c2b06-9039-4d0e-b07f-cbbd3f83b84e tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:41.104045 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:32:41.229766 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-fe8c2b06-9039-4d0e-b07f-cbbd3f83b84e tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7977e3015b2f45099a76317fc6477b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc30a2f3a6d455aaaff075b1b86b23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:32:41.238380 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fe8c2b06-9039-4d0e-b07f-cbbd3f83b84e tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] 10.222.0.50 "GET /compute/v2.1/servers/87f68e78-c953-4be7-a824-ebffbd70e147" status: 200 len: 1501 microversion: 2.1 time: 0.171139 Aug 31 16:32:41.238943 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3355/6523] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:32:41 2022] GET /compute/v2.1/servers/87f68e78-c953-4be7-a824-ebffbd70e147 => generated 1501 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:32:41.349430 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-38d2789c-d5fb-4e75-bec2-e59c95bebbdd tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:41.350300 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-38d2789c-d5fb-4e75-bec2-e59c95bebbdd tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] [instance: 73ac7526-f14e-497a-ab8a-9b36fc3fd094] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:41.357371 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38d2789c-d5fb-4e75-bec2-e59c95bebbdd tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:41.358327 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38d2789c-d5fb-4e75-bec2-e59c95bebbdd tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:41.358327 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38d2789c-d5fb-4e75-bec2-e59c95bebbdd tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:41.359224 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38d2789c-d5fb-4e75-bec2-e59c95bebbdd tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:41.359753 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38d2789c-d5fb-4e75-bec2-e59c95bebbdd tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:41.360253 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38d2789c-d5fb-4e75-bec2-e59c95bebbdd tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:41.366685 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:32:41.495759 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-38d2789c-d5fb-4e75-bec2-e59c95bebbdd tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/73ac7526-f14e-497a-ab8a-9b36fc3fd094" status: 200 len: 1465 microversion: 2.1 time: 0.150305 Aug 31 16:32:41.496437 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3169/6524] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:32:41 2022] GET /compute/v2.1/servers/73ac7526-f14e-497a-ab8a-9b36fc3fd094 => generated 1465 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:32:42.260881 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-24eda06e-a575-4e29-9132-23b50e407a70 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:42.261473 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-24eda06e-a575-4e29-9132-23b50e407a70 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] [instance: 87f68e78-c953-4be7-a824-ebffbd70e147] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:42.268936 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-24eda06e-a575-4e29-9132-23b50e407a70 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:42.269429 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-24eda06e-a575-4e29-9132-23b50e407a70 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:42.269876 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-24eda06e-a575-4e29-9132-23b50e407a70 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:42.270620 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-24eda06e-a575-4e29-9132-23b50e407a70 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:42.271085 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-24eda06e-a575-4e29-9132-23b50e407a70 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:42.271608 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-24eda06e-a575-4e29-9132-23b50e407a70 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:42.516144 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7a25c487-2c66-42c8-ae92-38382e965eac tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:42.516754 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7a25c487-2c66-42c8-ae92-38382e965eac tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] [instance: 73ac7526-f14e-497a-ab8a-9b36fc3fd094] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:42.523835 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a25c487-2c66-42c8-ae92-38382e965eac tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:42.524584 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a25c487-2c66-42c8-ae92-38382e965eac tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:42.525204 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a25c487-2c66-42c8-ae92-38382e965eac tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:42.526061 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a25c487-2c66-42c8-ae92-38382e965eac tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:42.526714 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a25c487-2c66-42c8-ae92-38382e965eac tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:42.527281 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a25c487-2c66-42c8-ae92-38382e965eac tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:42.564449 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-24eda06e-a575-4e29-9132-23b50e407a70 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7977e3015b2f45099a76317fc6477b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc30a2f3a6d455aaaff075b1b86b23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:32:42.577046 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-24eda06e-a575-4e29-9132-23b50e407a70 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] 10.222.0.50 "GET /compute/v2.1/servers/87f68e78-c953-4be7-a824-ebffbd70e147" status: 200 len: 1501 microversion: 2.1 time: 0.318507 Aug 31 16:32:42.594336 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3356/6525] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:32:42 2022] GET /compute/v2.1/servers/87f68e78-c953-4be7-a824-ebffbd70e147 => generated 1501 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:32:42.600050 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-e9f9ca39-0341-476f-99d8-accbb18d6f34 req-521cb3bb-6d2c-4ddb-85cc-409991aafa3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73ac7526-f14e-497a-ab8a-9b36fc3fd094", "name": "network-vif-plugged", "status": "completed", "tag": "271d2e9d-9a24-4ea2-bf3a-effbc0c2439b"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:32:42.617469 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-e9f9ca39-0341-476f-99d8-accbb18d6f34 req-521cb3bb-6d2c-4ddb-85cc-409991aafa3c service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:42.618296 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-e9f9ca39-0341-476f-99d8-accbb18d6f34 req-521cb3bb-6d2c-4ddb-85cc-409991aafa3c service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:42.618895 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-e9f9ca39-0341-476f-99d8-accbb18d6f34 req-521cb3bb-6d2c-4ddb-85cc-409991aafa3c service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:42.632581 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-e9f9ca39-0341-476f-99d8-accbb18d6f34 req-521cb3bb-6d2c-4ddb-85cc-409991aafa3c service nova] Creating event network-vif-plugged:271d2e9d-9a24-4ea2-bf3a-effbc0c2439b for instance 73ac7526-f14e-497a-ab8a-9b36fc3fd094 on n-h1-833090-16 Aug 31 16:32:42.654843 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-e9f9ca39-0341-476f-99d8-accbb18d6f34 req-521cb3bb-6d2c-4ddb-85cc-409991aafa3c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058752 Aug 31 16:32:42.655982 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3357/6526] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:32:42.778500 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7a25c487-2c66-42c8-ae92-38382e965eac tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/73ac7526-f14e-497a-ab8a-9b36fc3fd094" status: 200 len: 1465 microversion: 2.1 time: 0.266280 Aug 31 16:32:42.779178 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3170/6527] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:32:42 2022] GET /compute/v2.1/servers/73ac7526-f14e-497a-ab8a-9b36fc3fd094 => generated 1465 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:32:42.990355 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3c616a2f-bb9d-4fe5-b3a9-cf2b901530a0 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:42.990972 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3c616a2f-bb9d-4fe5-b3a9-cf2b901530a0 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] [instance: f55aba6a-0964-49f1-8817-235ae006af2c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:42.991111 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-6a55bfaf-24ce-4ca6-8ed1-e51b3ad6d313 req-14298093-06f7-4ff1-bb98-a382f81f1f0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87f68e78-c953-4be7-a824-ebffbd70e147", "name": "network-vif-deleted", "tag": "6653c38c-8140-4558-9aaa-f0415c538bd6"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:32:42.998127 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3c616a2f-bb9d-4fe5-b3a9-cf2b901530a0 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:42.998975 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3c616a2f-bb9d-4fe5-b3a9-cf2b901530a0 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:42.999591 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3c616a2f-bb9d-4fe5-b3a9-cf2b901530a0 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:43.000308 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3c616a2f-bb9d-4fe5-b3a9-cf2b901530a0 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:43.000778 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3c616a2f-bb9d-4fe5-b3a9-cf2b901530a0 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:43.001188 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3c616a2f-bb9d-4fe5-b3a9-cf2b901530a0 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:43.001314 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-6a55bfaf-24ce-4ca6-8ed1-e51b3ad6d313 req-14298093-06f7-4ff1-bb98-a382f81f1f0d service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:43.001731 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-6a55bfaf-24ce-4ca6-8ed1-e51b3ad6d313 req-14298093-06f7-4ff1-bb98-a382f81f1f0d service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:43.002200 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-6a55bfaf-24ce-4ca6-8ed1-e51b3ad6d313 req-14298093-06f7-4ff1-bb98-a382f81f1f0d service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:43.013952 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-6a55bfaf-24ce-4ca6-8ed1-e51b3ad6d313 req-14298093-06f7-4ff1-bb98-a382f81f1f0d service nova] Creating event network-vif-deleted:6653c38c-8140-4558-9aaa-f0415c538bd6 for instance 87f68e78-c953-4be7-a824-ebffbd70e147 on n-h1-833090-16 Aug 31 16:32:43.019916 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-6a55bfaf-24ce-4ca6-8ed1-e51b3ad6d313 req-14298093-06f7-4ff1-bb98-a382f81f1f0d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032444 Aug 31 16:32:43.020501 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3171/6528] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:32:43.033912 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3c616a2f-bb9d-4fe5-b3a9-cf2b901530a0 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] [instance: f55aba6a-0964-49f1-8817-235ae006af2c] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:32:43.117001 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3c616a2f-bb9d-4fe5-b3a9-cf2b901530a0 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] 10.222.0.50 "DELETE /compute/v2.1/servers/f55aba6a-0964-49f1-8817-235ae006af2c" status: 204 len: 0 microversion: 2.1 time: 0.130713 Aug 31 16:32:43.117630 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3358/6529] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:32:42 2022] DELETE /compute/v2.1/servers/f55aba6a-0964-49f1-8817-235ae006af2c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:32:43.128055 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6d32c7c7-ad3a-4811-834a-b989575610fc tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:43.129390 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6d32c7c7-ad3a-4811-834a-b989575610fc tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] [instance: f55aba6a-0964-49f1-8817-235ae006af2c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:43.136178 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d32c7c7-ad3a-4811-834a-b989575610fc tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:43.136660 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d32c7c7-ad3a-4811-834a-b989575610fc tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:43.137090 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d32c7c7-ad3a-4811-834a-b989575610fc tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:43.137779 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d32c7c7-ad3a-4811-834a-b989575610fc tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:43.138256 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d32c7c7-ad3a-4811-834a-b989575610fc tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:43.138773 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d32c7c7-ad3a-4811-834a-b989575610fc tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:43.276604 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6d32c7c7-ad3a-4811-834a-b989575610fc tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '910cdbb96c3246b78c7230eb6061b9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0351946f48f45899d9430bdc9cc33ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:32:43.285016 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6d32c7c7-ad3a-4811-834a-b989575610fc tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] 10.222.0.50 "GET /compute/v2.1/servers/f55aba6a-0964-49f1-8817-235ae006af2c" status: 200 len: 1468 microversion: 2.1 time: 0.161486 Aug 31 16:32:43.285602 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3172/6530] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:32:43 2022] GET /compute/v2.1/servers/f55aba6a-0964-49f1-8817-235ae006af2c => generated 1468 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:32:43.603103 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-512415f1-05e9-44b5-94f5-27a7d676d99f tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:43.604284 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-512415f1-05e9-44b5-94f5-27a7d676d99f tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] [instance: 87f68e78-c953-4be7-a824-ebffbd70e147] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:43.611622 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-512415f1-05e9-44b5-94f5-27a7d676d99f tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:43.612121 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-512415f1-05e9-44b5-94f5-27a7d676d99f tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:43.612607 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-512415f1-05e9-44b5-94f5-27a7d676d99f tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:43.613338 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-512415f1-05e9-44b5-94f5-27a7d676d99f tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:43.613833 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-512415f1-05e9-44b5-94f5-27a7d676d99f tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:43.614290 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-512415f1-05e9-44b5-94f5-27a7d676d99f tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:43.648697 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-512415f1-05e9-44b5-94f5-27a7d676d99f tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:43.649317 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-512415f1-05e9-44b5-94f5-27a7d676d99f tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:43.649661 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-512415f1-05e9-44b5-94f5-27a7d676d99f tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:43.650133 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-512415f1-05e9-44b5-94f5-27a7d676d99f tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Lazy-loading 'fault' on Instance uuid 87f68e78-c953-4be7-a824-ebffbd70e147 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:32:43.696657 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-512415f1-05e9-44b5-94f5-27a7d676d99f tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7977e3015b2f45099a76317fc6477b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fc30a2f3a6d455aaaff075b1b86b23f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:32:43.705790 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-512415f1-05e9-44b5-94f5-27a7d676d99f tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] 10.222.0.50 "GET /compute/v2.1/servers/87f68e78-c953-4be7-a824-ebffbd70e147" status: 200 len: 1303 microversion: 2.1 time: 0.107215 Aug 31 16:32:43.706836 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3359/6531] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:32:43 2022] GET /compute/v2.1/servers/87f68e78-c953-4be7-a824-ebffbd70e147 => generated 1303 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:32:43.801911 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2e25977b-1dea-4f10-a567-a38d80a27969 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:43.803226 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2e25977b-1dea-4f10-a567-a38d80a27969 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] [instance: 73ac7526-f14e-497a-ab8a-9b36fc3fd094] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:43.809838 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e25977b-1dea-4f10-a567-a38d80a27969 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:43.810548 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e25977b-1dea-4f10-a567-a38d80a27969 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:43.811899 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e25977b-1dea-4f10-a567-a38d80a27969 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:43.812819 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e25977b-1dea-4f10-a567-a38d80a27969 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:43.813331 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e25977b-1dea-4f10-a567-a38d80a27969 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:43.813756 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e25977b-1dea-4f10-a567-a38d80a27969 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:43.952795 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:32:43.979358 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2e25977b-1dea-4f10-a567-a38d80a27969 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/73ac7526-f14e-497a-ab8a-9b36fc3fd094" status: 200 len: 1465 microversion: 2.1 time: 0.182657 Aug 31 16:32:43.980011 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3173/6532] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:32:43 2022] GET /compute/v2.1/servers/73ac7526-f14e-497a-ab8a-9b36fc3fd094 => generated 1465 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:32:44.307524 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d74529d4-475d-489b-a0e6-b9e7b9534a22 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:44.308188 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d74529d4-475d-489b-a0e6-b9e7b9534a22 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] [instance: f55aba6a-0964-49f1-8817-235ae006af2c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:44.311232 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=10 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:32:44.317374 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d74529d4-475d-489b-a0e6-b9e7b9534a22 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:44.317883 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d74529d4-475d-489b-a0e6-b9e7b9534a22 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:44.318365 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d74529d4-475d-489b-a0e6-b9e7b9534a22 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:44.319076 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d74529d4-475d-489b-a0e6-b9e7b9534a22 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:44.319542 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d74529d4-475d-489b-a0e6-b9e7b9534a22 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:44.319976 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d74529d4-475d-489b-a0e6-b9e7b9534a22 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:44.457179 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d74529d4-475d-489b-a0e6-b9e7b9534a22 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '910cdbb96c3246b78c7230eb6061b9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0351946f48f45899d9430bdc9cc33ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:32:44.465526 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d74529d4-475d-489b-a0e6-b9e7b9534a22 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] 10.222.0.50 "GET /compute/v2.1/servers/f55aba6a-0964-49f1-8817-235ae006af2c" status: 200 len: 1468 microversion: 2.1 time: 0.162871 Aug 31 16:32:44.466117 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3360/6533] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:32:44 2022] GET /compute/v2.1/servers/f55aba6a-0964-49f1-8817-235ae006af2c => generated 1468 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:32:44.729768 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-39a27897-e5ee-449f-9bb6-2e79930cde90 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:44.730514 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-39a27897-e5ee-449f-9bb6-2e79930cde90 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] [instance: 87f68e78-c953-4be7-a824-ebffbd70e147] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:44.733096 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=14 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:32:44.738955 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39a27897-e5ee-449f-9bb6-2e79930cde90 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:44.739439 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39a27897-e5ee-449f-9bb6-2e79930cde90 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:44.739871 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39a27897-e5ee-449f-9bb6-2e79930cde90 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:44.740565 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39a27897-e5ee-449f-9bb6-2e79930cde90 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:44.741016 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39a27897-e5ee-449f-9bb6-2e79930cde90 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:44.741435 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39a27897-e5ee-449f-9bb6-2e79930cde90 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:44.755547 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-39a27897-e5ee-449f-9bb6-2e79930cde90 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] HTTP exception thrown: Instance 87f68e78-c953-4be7-a824-ebffbd70e147 could not be found. Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-39a27897-e5ee-449f-9bb6-2e79930cde90 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Request method failure captured: Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/87f68e78-c953-4be7-a824-ebffbd70e147 HTTP/1.1 Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD40ZC990uGoG7xNOvz5A9G9DQxDIXVw5urr5efqoyTmBQi99y9GvvXn-VDJeHLRzMqgQUpTdSbL2m35TmNoU5f0QDmHIOKspHvGiusx9Bhs5bH9_rhOSkWqMqtARWARMnI-7GMOW-RK9ohlTSOo9bxgj3QG-e7mIzWq2kfTQa2PA2cc Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 9fc30a2f3a6d455aaaff075b1b86b23f Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-VolumesActionsTest-1590061312 Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9fc30a2f3a6d455aaaff075b1b86b23f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9fc30a2f3a6d455aaaff075b1b86b23f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9fc30a2f3a6d455aaaff075b1b86b23f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9fc30a2f3a6d455aaaff075b1b86b23f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-VolumesActionsTest-1590061312 Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 9fc30a2f3a6d455aaaff075b1b86b23f Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-VolumesActionsTest-1590061312 Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-VolumesActionsTest-1590061312-project Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 7977e3015b2f45099a76317fc6477b6b Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-VolumesActionsTest-1590061312-project Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 87f68e78-c953-4be7-a824-ebffbd70e147 could not be found. Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '87f68e78-c953-4be7-a824-ebffbd70e147'} Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87f68e78-c953-4be7-a824-ebffbd70e147 could not be found. Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87f68e78-c953-4be7-a824-ebffbd70e147 could not be found. Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:32:44.757212 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:32:44.762466 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:32:44.762466 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:32:44.762466 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:32:44.762466 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:32:44.762466 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:32:44.762466 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87f68e78-c953-4be7-a824-ebffbd70e147 could not be found. Aug 31 16:32:44.762466 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:32:44.762466 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-39a27897-e5ee-449f-9bb6-2e79930cde90 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] Returning 404 to user: Instance 87f68e78-c953-4be7-a824-ebffbd70e147 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:32:44.762466 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-39a27897-e5ee-449f-9bb6-2e79930cde90 tempest-VolumesActionsTest-1590061312 tempest-VolumesActionsTest-1590061312-project] 10.222.0.50 "GET /compute/v2.1/servers/87f68e78-c953-4be7-a824-ebffbd70e147" status: 404 len: 111 microversion: 2.1 time: 0.034427 Aug 31 16:32:44.762466 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3174/6534] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:32:44 2022] GET /compute/v2.1/servers/87f68e78-c953-4be7-a824-ebffbd70e147 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:32:45.004708 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6c253ce1-34a4-4d74-adab-864eee658eb4 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:45.005317 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6c253ce1-34a4-4d74-adab-864eee658eb4 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] [instance: 73ac7526-f14e-497a-ab8a-9b36fc3fd094] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:45.024020 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6c253ce1-34a4-4d74-adab-864eee658eb4 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:45.025230 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6c253ce1-34a4-4d74-adab-864eee658eb4 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:45.025683 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6c253ce1-34a4-4d74-adab-864eee658eb4 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:45.026448 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6c253ce1-34a4-4d74-adab-864eee658eb4 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:45.027071 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6c253ce1-34a4-4d74-adab-864eee658eb4 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:45.027513 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6c253ce1-34a4-4d74-adab-864eee658eb4 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:45.185923 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6c253ce1-34a4-4d74-adab-864eee658eb4 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/73ac7526-f14e-497a-ab8a-9b36fc3fd094" status: 200 len: 1650 microversion: 2.1 time: 0.184992 Aug 31 16:32:45.201248 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3361/6535] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:32:44 2022] GET /compute/v2.1/servers/73ac7526-f14e-497a-ab8a-9b36fc3fd094 => generated 1650 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:32:45.207787 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1d13f1b9-2ee0-4aa5-a1c4-1481f7645b22 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:45.208507 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1d13f1b9-2ee0-4aa5-a1c4-1481f7645b22 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] [instance: 73ac7526-f14e-497a-ab8a-9b36fc3fd094] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:45.215695 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d13f1b9-2ee0-4aa5-a1c4-1481f7645b22 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:45.216283 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d13f1b9-2ee0-4aa5-a1c4-1481f7645b22 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:45.216715 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d13f1b9-2ee0-4aa5-a1c4-1481f7645b22 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:45.217606 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d13f1b9-2ee0-4aa5-a1c4-1481f7645b22 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:45.218225 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d13f1b9-2ee0-4aa5-a1c4-1481f7645b22 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:45.218969 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d13f1b9-2ee0-4aa5-a1c4-1481f7645b22 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:45.376952 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1d13f1b9-2ee0-4aa5-a1c4-1481f7645b22 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/73ac7526-f14e-497a-ab8a-9b36fc3fd094" status: 200 len: 1650 microversion: 2.1 time: 0.174084 Aug 31 16:32:45.377907 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3175/6536] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:32:45 2022] GET /compute/v2.1/servers/73ac7526-f14e-497a-ab8a-9b36fc3fd094 => generated 1650 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:32:45.397288 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fc1986e5-b4fd-49a1-a500-7c112cc93294 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:45.424505 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fc1986e5-b4fd-49a1-a500-7c112cc93294 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] [instance: 73ac7526-f14e-497a-ab8a-9b36fc3fd094] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:45.433067 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fc1986e5-b4fd-49a1-a500-7c112cc93294 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:45.438864 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fc1986e5-b4fd-49a1-a500-7c112cc93294 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:45.439352 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fc1986e5-b4fd-49a1-a500-7c112cc93294 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:45.442049 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fc1986e5-b4fd-49a1-a500-7c112cc93294 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:45.446481 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fc1986e5-b4fd-49a1-a500-7c112cc93294 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:45.447001 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fc1986e5-b4fd-49a1-a500-7c112cc93294 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:45.469254 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-e70b94b3-c956-4a67-9540-a8bc97941e20 req-b8eff2b9-502b-490c-95c8-3f8edbf19e71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f55aba6a-0964-49f1-8817-235ae006af2c", "name": "network-vif-deleted", "tag": "cd70e070-d687-4a57-bee9-ef70196a3390"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:32:45.488115 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e70b94b3-c956-4a67-9540-a8bc97941e20 req-b8eff2b9-502b-490c-95c8-3f8edbf19e71 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:45.491670 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e70b94b3-c956-4a67-9540-a8bc97941e20 req-b8eff2b9-502b-490c-95c8-3f8edbf19e71 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:45.493985 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e70b94b3-c956-4a67-9540-a8bc97941e20 req-b8eff2b9-502b-490c-95c8-3f8edbf19e71 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:45.509456 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-e70b94b3-c956-4a67-9540-a8bc97941e20 req-b8eff2b9-502b-490c-95c8-3f8edbf19e71 service nova] Creating event network-vif-deleted:cd70e070-d687-4a57-bee9-ef70196a3390 for instance f55aba6a-0964-49f1-8817-235ae006af2c on n-h2-833090-16 Aug 31 16:32:45.515156 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-e70b94b3-c956-4a67-9540-a8bc97941e20 req-b8eff2b9-502b-490c-95c8-3f8edbf19e71 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051470 Aug 31 16:32:45.522859 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3176/6537] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:32:45.534571 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b580dafa-2e1f-4ae1-8c64-2a32a492e58f tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:45.535415 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b580dafa-2e1f-4ae1-8c64-2a32a492e58f tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] [instance: f55aba6a-0964-49f1-8817-235ae006af2c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:45.542014 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b580dafa-2e1f-4ae1-8c64-2a32a492e58f tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:45.542662 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b580dafa-2e1f-4ae1-8c64-2a32a492e58f tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:45.543195 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b580dafa-2e1f-4ae1-8c64-2a32a492e58f tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:45.544018 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b580dafa-2e1f-4ae1-8c64-2a32a492e58f tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:45.544569 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b580dafa-2e1f-4ae1-8c64-2a32a492e58f tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:45.545093 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b580dafa-2e1f-4ae1-8c64-2a32a492e58f tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:45.637497 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b580dafa-2e1f-4ae1-8c64-2a32a492e58f tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '910cdbb96c3246b78c7230eb6061b9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0351946f48f45899d9430bdc9cc33ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:32:45.647296 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b580dafa-2e1f-4ae1-8c64-2a32a492e58f tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] 10.222.0.50 "GET /compute/v2.1/servers/f55aba6a-0964-49f1-8817-235ae006af2c" status: 200 len: 1299 microversion: 2.1 time: 0.119699 Aug 31 16:32:45.647880 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3177/6538] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:32:45 2022] GET /compute/v2.1/servers/f55aba6a-0964-49f1-8817-235ae006af2c => generated 1299 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:32:45.666445 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fc1986e5-b4fd-49a1-a500-7c112cc93294 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/73ac7526-f14e-497a-ab8a-9b36fc3fd094" status: 200 len: 1650 microversion: 2.1 time: 0.273007 Aug 31 16:32:45.667082 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3362/6539] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:32:45 2022] GET /compute/v2.1/servers/73ac7526-f14e-497a-ab8a-9b36fc3fd094 => generated 1650 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:32:45.687219 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cd09a7fe-07ca-4c69-90e7-ca994a6dfa31 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:45.687963 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cd09a7fe-07ca-4c69-90e7-ca994a6dfa31 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] [instance: 73ac7526-f14e-497a-ab8a-9b36fc3fd094] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:45.694565 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd09a7fe-07ca-4c69-90e7-ca994a6dfa31 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:45.695052 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd09a7fe-07ca-4c69-90e7-ca994a6dfa31 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:45.695486 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd09a7fe-07ca-4c69-90e7-ca994a6dfa31 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:45.696359 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd09a7fe-07ca-4c69-90e7-ca994a6dfa31 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:45.696815 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd09a7fe-07ca-4c69-90e7-ca994a6dfa31 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:45.697240 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd09a7fe-07ca-4c69-90e7-ca994a6dfa31 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:45.724535 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cd09a7fe-07ca-4c69-90e7-ca994a6dfa31 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] [instance: 73ac7526-f14e-497a-ab8a-9b36fc3fd094] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:32:45.795211 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:32:45.811916 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cd09a7fe-07ca-4c69-90e7-ca994a6dfa31 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] 10.222.0.50 "DELETE /compute/v2.1/servers/73ac7526-f14e-497a-ab8a-9b36fc3fd094" status: 204 len: 0 microversion: 2.1 time: 0.128350 Aug 31 16:32:45.813035 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3178/6540] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:32:45 2022] DELETE /compute/v2.1/servers/73ac7526-f14e-497a-ab8a-9b36fc3fd094 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 16:32:45.821071 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1e5a8e9a-2b18-4198-be95-01683543bd7d tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:45.821689 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1e5a8e9a-2b18-4198-be95-01683543bd7d tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] [instance: 73ac7526-f14e-497a-ab8a-9b36fc3fd094] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:45.835277 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e5a8e9a-2b18-4198-be95-01683543bd7d tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:45.836044 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e5a8e9a-2b18-4198-be95-01683543bd7d tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:45.836657 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e5a8e9a-2b18-4198-be95-01683543bd7d tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:45.837618 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e5a8e9a-2b18-4198-be95-01683543bd7d tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:45.838326 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e5a8e9a-2b18-4198-be95-01683543bd7d tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:45.838945 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e5a8e9a-2b18-4198-be95-01683543bd7d tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:46.001782 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1e5a8e9a-2b18-4198-be95-01683543bd7d tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/73ac7526-f14e-497a-ab8a-9b36fc3fd094" status: 200 len: 1656 microversion: 2.1 time: 0.184546 Aug 31 16:32:46.002800 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3363/6541] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:32:45 2022] GET /compute/v2.1/servers/73ac7526-f14e-497a-ab8a-9b36fc3fd094 => generated 1656 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:32:46.670690 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dfce6b73-2510-4adc-99c5-d8e73c681487 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:46.671567 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dfce6b73-2510-4adc-99c5-d8e73c681487 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] [instance: f55aba6a-0964-49f1-8817-235ae006af2c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:46.679645 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfce6b73-2510-4adc-99c5-d8e73c681487 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:46.680133 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfce6b73-2510-4adc-99c5-d8e73c681487 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:46.680570 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfce6b73-2510-4adc-99c5-d8e73c681487 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:46.681276 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfce6b73-2510-4adc-99c5-d8e73c681487 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:46.681729 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfce6b73-2510-4adc-99c5-d8e73c681487 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:46.682173 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dfce6b73-2510-4adc-99c5-d8e73c681487 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:46.698084 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-dfce6b73-2510-4adc-99c5-d8e73c681487 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] HTTP exception thrown: Instance f55aba6a-0964-49f1-8817-235ae006af2c could not be found. Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dfce6b73-2510-4adc-99c5-d8e73c681487 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Request method failure captured: Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/f55aba6a-0964-49f1-8817-235ae006af2c HTTP/1.1 Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4y8Se1RmAnm30yVqVKbsNB782SZ0A08eiascQevep2tYbRDi2omeq1iYmnzq5laCMs9l7WhAmY06hLFLl9ZtcVYW4VzP7odtcY4YvbWo84hjA6x2FCi2HI9yx1EJpxN-9z1qPjgdixerT5Mfe7TrEY-DBf_dJjhh3BUNiGiz3NFWbQ Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: f0351946f48f45899d9430bdc9cc33ef Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-VolumesBackupsTest-1294166804 Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f0351946f48f45899d9430bdc9cc33ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f0351946f48f45899d9430bdc9cc33ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f0351946f48f45899d9430bdc9cc33ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f0351946f48f45899d9430bdc9cc33ef", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-VolumesBackupsTest-1294166804 Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: f0351946f48f45899d9430bdc9cc33ef Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-VolumesBackupsTest-1294166804 Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-VolumesBackupsTest-1294166804-project Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 910cdbb96c3246b78c7230eb6061b9c3 Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-VolumesBackupsTest-1294166804-project Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance f55aba6a-0964-49f1-8817-235ae006af2c could not be found. Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'f55aba6a-0964-49f1-8817-235ae006af2c'} Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f55aba6a-0964-49f1-8817-235ae006af2c could not be found. Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f55aba6a-0964-49f1-8817-235ae006af2c could not be found. Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:32:46.699800 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:32:46.709699 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:32:46.709699 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:32:46.709699 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:32:46.709699 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:32:46.709699 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:32:46.709699 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f55aba6a-0964-49f1-8817-235ae006af2c could not be found. Aug 31 16:32:46.709699 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:32:46.709699 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dfce6b73-2510-4adc-99c5-d8e73c681487 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] Returning 404 to user: Instance f55aba6a-0964-49f1-8817-235ae006af2c could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:32:46.709699 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dfce6b73-2510-4adc-99c5-d8e73c681487 tempest-VolumesBackupsTest-1294166804 tempest-VolumesBackupsTest-1294166804-project] 10.222.0.50 "GET /compute/v2.1/servers/f55aba6a-0964-49f1-8817-235ae006af2c" status: 404 len: 111 microversion: 2.1 time: 0.034999 Aug 31 16:32:46.709699 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3179/6542] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:32:46 2022] GET /compute/v2.1/servers/f55aba6a-0964-49f1-8817-235ae006af2c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:32:47.023763 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-cb0b7070-2cef-4bd7-aa01-3af50d4db36b tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:47.024399 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-cb0b7070-2cef-4bd7-aa01-3af50d4db36b tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] [instance: 73ac7526-f14e-497a-ab8a-9b36fc3fd094] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:47.032695 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb0b7070-2cef-4bd7-aa01-3af50d4db36b tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:47.033211 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb0b7070-2cef-4bd7-aa01-3af50d4db36b tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:47.033647 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb0b7070-2cef-4bd7-aa01-3af50d4db36b tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:47.034618 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb0b7070-2cef-4bd7-aa01-3af50d4db36b tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:47.035283 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb0b7070-2cef-4bd7-aa01-3af50d4db36b tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:47.035950 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb0b7070-2cef-4bd7-aa01-3af50d4db36b tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:47.240030 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-cb0b7070-2cef-4bd7-aa01-3af50d4db36b tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/73ac7526-f14e-497a-ab8a-9b36fc3fd094" status: 200 len: 1656 microversion: 2.1 time: 0.219977 Aug 31 16:32:47.242240 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3364/6543] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:32:47 2022] GET /compute/v2.1/servers/73ac7526-f14e-497a-ab8a-9b36fc3fd094 => generated 1656 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:32:47.697824 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-4a1ac109-55ee-4b75-9857-32871d8153e6 req-7c36de44-5b7f-4335-b467-854879966882 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73ac7526-f14e-497a-ab8a-9b36fc3fd094", "name": "network-vif-deleted", "tag": "271d2e9d-9a24-4ea2-bf3a-effbc0c2439b"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:32:47.720257 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4a1ac109-55ee-4b75-9857-32871d8153e6 req-7c36de44-5b7f-4335-b467-854879966882 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:47.720920 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4a1ac109-55ee-4b75-9857-32871d8153e6 req-7c36de44-5b7f-4335-b467-854879966882 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:47.721212 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4a1ac109-55ee-4b75-9857-32871d8153e6 req-7c36de44-5b7f-4335-b467-854879966882 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:47.745431 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-4a1ac109-55ee-4b75-9857-32871d8153e6 req-7c36de44-5b7f-4335-b467-854879966882 service nova] Creating event network-vif-deleted:271d2e9d-9a24-4ea2-bf3a-effbc0c2439b for instance 73ac7526-f14e-497a-ab8a-9b36fc3fd094 on n-h1-833090-16 Aug 31 16:32:47.750321 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-4a1ac109-55ee-4b75-9857-32871d8153e6 req-7c36de44-5b7f-4335-b467-854879966882 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056182 Aug 31 16:32:47.751289 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3180/6544] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:32:48.268675 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d0bbefae-c281-4db6-b048-e39e1ba875fc tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:48.269413 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d0bbefae-c281-4db6-b048-e39e1ba875fc tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] [instance: 73ac7526-f14e-497a-ab8a-9b36fc3fd094] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:48.272818 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:32:48.280106 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d0bbefae-c281-4db6-b048-e39e1ba875fc tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:48.281127 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d0bbefae-c281-4db6-b048-e39e1ba875fc tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:48.281762 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d0bbefae-c281-4db6-b048-e39e1ba875fc tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:48.282962 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d0bbefae-c281-4db6-b048-e39e1ba875fc tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:48.283623 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d0bbefae-c281-4db6-b048-e39e1ba875fc tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:48.284369 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d0bbefae-c281-4db6-b048-e39e1ba875fc tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:48.305547 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-d0bbefae-c281-4db6-b048-e39e1ba875fc tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] HTTP exception thrown: Instance 73ac7526-f14e-497a-ab8a-9b36fc3fd094 could not be found. Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d0bbefae-c281-4db6-b048-e39e1ba875fc tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Request method failure captured: Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/73ac7526-f14e-497a-ab8a-9b36fc3fd094 HTTP/1.1 Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD40RuL9ISyW6GkmQdlLhL1UyZtend_6SBl-VJvF5pPflIcYf8mExR0dFLERnCZFdlheExE7ZKmFssECErNSB-cD-NW6N_l71soQUgzsvlYjxpEly1YovdVRZn-CpeaxFzvg2UavKLMZytV_PoBaVwLVLZ9ZRxm5oKNLLx5i0njxMXTc Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: a8876649937e493fbebe7fea6c638eb1 Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-TestServerMultinode-148552067 Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,admin,member Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,admin,member Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a8876649937e493fbebe7fea6c638eb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a8876649937e493fbebe7fea6c638eb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a8876649937e493fbebe7fea6c638eb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a8876649937e493fbebe7fea6c638eb1", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-TestServerMultinode-148552067 Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: a8876649937e493fbebe7fea6c638eb1 Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-TestServerMultinode-148552067 Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-TestServerMultinode-148552067-project-admin Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 7fb420dae04d472ba8b14374eec21b1b Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-TestServerMultinode-148552067-project-admin Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 73ac7526-f14e-497a-ab8a-9b36fc3fd094 could not be found. Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '73ac7526-f14e-497a-ab8a-9b36fc3fd094'} Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73ac7526-f14e-497a-ab8a-9b36fc3fd094 could not be found. Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73ac7526-f14e-497a-ab8a-9b36fc3fd094 could not be found. Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:32:48.307881 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:32:48.312771 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:32:48.312771 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:32:48.312771 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:32:48.312771 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:32:48.312771 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:32:48.312771 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73ac7526-f14e-497a-ab8a-9b36fc3fd094 could not be found. Aug 31 16:32:48.312771 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:32:48.314247 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d0bbefae-c281-4db6-b048-e39e1ba875fc tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Returning 404 to user: Instance 73ac7526-f14e-497a-ab8a-9b36fc3fd094 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:32:48.315333 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d0bbefae-c281-4db6-b048-e39e1ba875fc tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/73ac7526-f14e-497a-ab8a-9b36fc3fd094" status: 404 len: 111 microversion: 2.1 time: 0.050992 Aug 31 16:32:48.315922 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3365/6545] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:32:48 2022] GET /compute/v2.1/servers/73ac7526-f14e-497a-ab8a-9b36fc3fd094 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:32:48.325488 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-389e9b1f-02a2-4afa-a463-0e4350910d24 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:48.326549 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-389e9b1f-02a2-4afa-a463-0e4350910d24 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] [instance: 5784fa07-1e97-4e71-a3ae-eba6ffb1d958] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:48.335088 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-389e9b1f-02a2-4afa-a463-0e4350910d24 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:48.335665 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-389e9b1f-02a2-4afa-a463-0e4350910d24 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:48.336443 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-389e9b1f-02a2-4afa-a463-0e4350910d24 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:48.337162 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-389e9b1f-02a2-4afa-a463-0e4350910d24 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:48.337619 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-389e9b1f-02a2-4afa-a463-0e4350910d24 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:48.338286 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-389e9b1f-02a2-4afa-a463-0e4350910d24 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:48.377561 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-389e9b1f-02a2-4afa-a463-0e4350910d24 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] [instance: 5784fa07-1e97-4e71-a3ae-eba6ffb1d958] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:32:48.473644 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-389e9b1f-02a2-4afa-a463-0e4350910d24 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] 10.222.0.50 "DELETE /compute/v2.1/servers/5784fa07-1e97-4e71-a3ae-eba6ffb1d958" status: 204 len: 0 microversion: 2.1 time: 0.152065 Aug 31 16:32:48.475043 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3181/6546] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:32:48 2022] DELETE /compute/v2.1/servers/5784fa07-1e97-4e71-a3ae-eba6ffb1d958 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:32:48.483898 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-25609b33-7b8e-478f-95e0-4393badea81e tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:48.484623 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-25609b33-7b8e-478f-95e0-4393badea81e tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] [instance: 5784fa07-1e97-4e71-a3ae-eba6ffb1d958] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:48.491131 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-25609b33-7b8e-478f-95e0-4393badea81e tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:48.501403 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-25609b33-7b8e-478f-95e0-4393badea81e tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:48.501984 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-25609b33-7b8e-478f-95e0-4393badea81e tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:48.504082 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-25609b33-7b8e-478f-95e0-4393badea81e tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:48.504570 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-25609b33-7b8e-478f-95e0-4393badea81e tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:48.505006 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-25609b33-7b8e-478f-95e0-4393badea81e tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:48.671254 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-25609b33-7b8e-478f-95e0-4393badea81e tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/5784fa07-1e97-4e71-a3ae-eba6ffb1d958" status: 200 len: 1656 microversion: 2.1 time: 0.191457 Aug 31 16:32:48.672622 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3366/6547] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:32:48 2022] GET /compute/v2.1/servers/5784fa07-1e97-4e71-a3ae-eba6ffb1d958 => generated 1656 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:32:49.696169 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-63e199c4-e70e-444f-a892-84cd32f9fb80 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:49.697240 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-63e199c4-e70e-444f-a892-84cd32f9fb80 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] [instance: 5784fa07-1e97-4e71-a3ae-eba6ffb1d958] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:49.705460 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-63e199c4-e70e-444f-a892-84cd32f9fb80 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:49.707083 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-63e199c4-e70e-444f-a892-84cd32f9fb80 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:49.707537 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-63e199c4-e70e-444f-a892-84cd32f9fb80 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:49.708322 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-63e199c4-e70e-444f-a892-84cd32f9fb80 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:49.709127 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-63e199c4-e70e-444f-a892-84cd32f9fb80 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:49.709712 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-63e199c4-e70e-444f-a892-84cd32f9fb80 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:49.903005 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-63e199c4-e70e-444f-a892-84cd32f9fb80 tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/5784fa07-1e97-4e71-a3ae-eba6ffb1d958" status: 200 len: 1656 microversion: 2.1 time: 0.212583 Aug 31 16:32:49.904346 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3182/6548] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:32:49 2022] GET /compute/v2.1/servers/5784fa07-1e97-4e71-a3ae-eba6ffb1d958 => generated 1656 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:32:50.888131 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-4488482a-c633-42f3-b7ab-f2286d4eaaa6 req-d0c9083f-f055-44df-8116-7c73cf156083 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5784fa07-1e97-4e71-a3ae-eba6ffb1d958", "name": "network-vif-deleted", "tag": "78a9e749-85f1-40bf-a3c0-dba671c26bcb"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:32:50.904321 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-4488482a-c633-42f3-b7ab-f2286d4eaaa6 req-d0c9083f-f055-44df-8116-7c73cf156083 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:50.904994 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-4488482a-c633-42f3-b7ab-f2286d4eaaa6 req-d0c9083f-f055-44df-8116-7c73cf156083 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:50.906281 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-4488482a-c633-42f3-b7ab-f2286d4eaaa6 req-d0c9083f-f055-44df-8116-7c73cf156083 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:50.922528 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-4488482a-c633-42f3-b7ab-f2286d4eaaa6 req-d0c9083f-f055-44df-8116-7c73cf156083 service nova] Creating event network-vif-deleted:78a9e749-85f1-40bf-a3c0-dba671c26bcb for instance 5784fa07-1e97-4e71-a3ae-eba6ffb1d958 on n-h2-833090-16 Aug 31 16:32:50.926789 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-32173ee2-da89-4a3b-80f5-26e134de662b tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:50.930206 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-4488482a-c633-42f3-b7ab-f2286d4eaaa6 req-d0c9083f-f055-44df-8116-7c73cf156083 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048318 Aug 31 16:32:50.935546 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-32173ee2-da89-4a3b-80f5-26e134de662b tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] [instance: 5784fa07-1e97-4e71-a3ae-eba6ffb1d958] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:50.938474 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3367/6549] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:32:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:32:50.956432 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-32173ee2-da89-4a3b-80f5-26e134de662b tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:50.959024 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-32173ee2-da89-4a3b-80f5-26e134de662b tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:50.960073 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-32173ee2-da89-4a3b-80f5-26e134de662b tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:50.964972 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-32173ee2-da89-4a3b-80f5-26e134de662b tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:50.967800 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-32173ee2-da89-4a3b-80f5-26e134de662b tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:50.968856 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-32173ee2-da89-4a3b-80f5-26e134de662b tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:51.114633 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-32173ee2-da89-4a3b-80f5-26e134de662b tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/5784fa07-1e97-4e71-a3ae-eba6ffb1d958" status: 200 len: 1450 microversion: 2.1 time: 0.193525 Aug 31 16:32:51.119418 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3183/6550] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:32:50 2022] GET /compute/v2.1/servers/5784fa07-1e97-4e71-a3ae-eba6ffb1d958 => generated 1450 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:32:52.142730 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-854a8db1-00be-4c83-863e-590feeba89da tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:32:52.144280 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-854a8db1-00be-4c83-863e-590feeba89da tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] [instance: 5784fa07-1e97-4e71-a3ae-eba6ffb1d958] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:32:52.153193 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-854a8db1-00be-4c83-863e-590feeba89da tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:52.154105 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-854a8db1-00be-4c83-863e-590feeba89da tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:52.154721 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-854a8db1-00be-4c83-863e-590feeba89da tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:52.155622 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-854a8db1-00be-4c83-863e-590feeba89da tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:32:52.156280 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-854a8db1-00be-4c83-863e-590feeba89da tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:32:52.156800 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-854a8db1-00be-4c83-863e-590feeba89da tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:32:52.175561 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-854a8db1-00be-4c83-863e-590feeba89da tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] HTTP exception thrown: Instance 5784fa07-1e97-4e71-a3ae-eba6ffb1d958 could not be found. Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-854a8db1-00be-4c83-863e-590feeba89da tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Request method failure captured: Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/5784fa07-1e97-4e71-a3ae-eba6ffb1d958 HTTP/1.1 Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD40RuL9ISyW6GkmQdlLhL1UyZtend_6SBl-VJvF5pPflIcYf8mExR0dFLERnCZFdlheExE7ZKmFssECErNSB-cD-NW6N_l71soQUgzsvlYjxpEly1YovdVRZn-CpeaxFzvg2UavKLMZytV_PoBaVwLVLZ9ZRxm5oKNLLx5i0njxMXTc Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: a8876649937e493fbebe7fea6c638eb1 Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-TestServerMultinode-148552067 Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,admin,member Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,admin,member Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a8876649937e493fbebe7fea6c638eb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a8876649937e493fbebe7fea6c638eb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a8876649937e493fbebe7fea6c638eb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a8876649937e493fbebe7fea6c638eb1", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-TestServerMultinode-148552067 Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: a8876649937e493fbebe7fea6c638eb1 Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-TestServerMultinode-148552067 Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-TestServerMultinode-148552067-project-admin Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 7fb420dae04d472ba8b14374eec21b1b Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-TestServerMultinode-148552067-project-admin Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 5784fa07-1e97-4e71-a3ae-eba6ffb1d958 could not be found. Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '5784fa07-1e97-4e71-a3ae-eba6ffb1d958'} Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5784fa07-1e97-4e71-a3ae-eba6ffb1d958 could not be found. Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5784fa07-1e97-4e71-a3ae-eba6ffb1d958 could not be found. Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:32:52.177530 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:32:52.182411 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:32:52.182411 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:32:52.182411 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:32:52.182411 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:32:52.182411 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:32:52.182411 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5784fa07-1e97-4e71-a3ae-eba6ffb1d958 could not be found. Aug 31 16:32:52.182411 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:32:52.183839 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-854a8db1-00be-4c83-863e-590feeba89da tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] Returning 404 to user: Instance 5784fa07-1e97-4e71-a3ae-eba6ffb1d958 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:32:52.184714 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-854a8db1-00be-4c83-863e-590feeba89da tempest-TestServerMultinode-148552067 tempest-TestServerMultinode-148552067-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/5784fa07-1e97-4e71-a3ae-eba6ffb1d958" status: 404 len: 111 microversion: 2.1 time: 0.046901 Aug 31 16:32:52.185712 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3368/6551] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:32:52 2022] GET /compute/v2.1/servers/5784fa07-1e97-4e71-a3ae-eba6ffb1d958 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:33:18.526620 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-03dd2ea2-dcf7-4345-9e26-3b8feaa45765 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:18.527248 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-03dd2ea2-dcf7-4345-9e26-3b8feaa45765 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 158a6dc8-d946-4479-b3a5-ee3e97d283e8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:33:18.530526 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:33:18.531275 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:33:18.540096 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03dd2ea2-dcf7-4345-9e26-3b8feaa45765 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:18.544166 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03dd2ea2-dcf7-4345-9e26-3b8feaa45765 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:18.547580 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03dd2ea2-dcf7-4345-9e26-3b8feaa45765 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:18.548355 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03dd2ea2-dcf7-4345-9e26-3b8feaa45765 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:18.548839 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03dd2ea2-dcf7-4345-9e26-3b8feaa45765 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:18.549585 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03dd2ea2-dcf7-4345-9e26-3b8feaa45765 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:18.584340 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-03dd2ea2-dcf7-4345-9e26-3b8feaa45765 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 158a6dc8-d946-4479-b3a5-ee3e97d283e8] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:33:18.711125 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-03dd2ea2-dcf7-4345-9e26-3b8feaa45765 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "DELETE /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8" status: 204 len: 0 microversion: 2.1 time: 0.188800 Aug 31 16:33:18.712108 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3184/6552] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:33:18 2022] DELETE /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:33:18.721532 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3749a8ba-4f52-4a58-a399-748249567c92 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:18.723035 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3749a8ba-4f52-4a58-a399-748249567c92 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 158a6dc8-d946-4479-b3a5-ee3e97d283e8] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:33:18.728349 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=7 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:33:18.729966 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:33:18.735970 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3749a8ba-4f52-4a58-a399-748249567c92 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:18.737012 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3749a8ba-4f52-4a58-a399-748249567c92 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:18.737685 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3749a8ba-4f52-4a58-a399-748249567c92 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:18.744825 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3749a8ba-4f52-4a58-a399-748249567c92 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:18.745834 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3749a8ba-4f52-4a58-a399-748249567c92 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:18.746701 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3749a8ba-4f52-4a58-a399-748249567c92 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:18.979011 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3749a8ba-4f52-4a58-a399-748249567c92 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:33:18.995342 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3749a8ba-4f52-4a58-a399-748249567c92 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8" status: 200 len: 1579 microversion: 2.1 time: 0.277429 Aug 31 16:33:18.997827 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3369/6553] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:33:18 2022] GET /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8 => generated 1579 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:33:20.021008 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8f5ae676-6c90-411a-9441-0db01c91263d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:20.021690 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8f5ae676-6c90-411a-9441-0db01c91263d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 158a6dc8-d946-4479-b3a5-ee3e97d283e8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:33:20.037557 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f5ae676-6c90-411a-9441-0db01c91263d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:20.038502 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f5ae676-6c90-411a-9441-0db01c91263d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:20.039672 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f5ae676-6c90-411a-9441-0db01c91263d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:20.041208 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f5ae676-6c90-411a-9441-0db01c91263d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:20.041700 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f5ae676-6c90-411a-9441-0db01c91263d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:20.042139 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8f5ae676-6c90-411a-9441-0db01c91263d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:20.194292 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8f5ae676-6c90-411a-9441-0db01c91263d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:33:20.203529 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8f5ae676-6c90-411a-9441-0db01c91263d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8" status: 200 len: 1579 microversion: 2.1 time: 0.187021 Aug 31 16:33:20.204137 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3185/6554] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:33:20 2022] GET /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8 => generated 1579 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:33:21.225798 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9ac3d596-d032-491a-b026-a616628e27fd tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:21.226580 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9ac3d596-d032-491a-b026-a616628e27fd tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 158a6dc8-d946-4479-b3a5-ee3e97d283e8] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:33:21.234689 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ac3d596-d032-491a-b026-a616628e27fd tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:21.235289 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ac3d596-d032-491a-b026-a616628e27fd tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:21.235983 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ac3d596-d032-491a-b026-a616628e27fd tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:21.236805 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ac3d596-d032-491a-b026-a616628e27fd tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:21.237336 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ac3d596-d032-491a-b026-a616628e27fd tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:21.237974 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9ac3d596-d032-491a-b026-a616628e27fd tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:21.318379 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9ac3d596-d032-491a-b026-a616628e27fd tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:33:21.330640 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9ac3d596-d032-491a-b026-a616628e27fd tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8" status: 200 len: 1511 microversion: 2.1 time: 0.108657 Aug 31 16:33:21.331644 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3370/6555] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:33:21 2022] GET /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8 => generated 1511 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:33:21.535702 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-d45de973-dce9-4d4b-8994-b3b16aeacbbd req-36a59a26-57fa-4c6d-9348-2d78e8f986b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "158a6dc8-d946-4479-b3a5-ee3e97d283e8", "name": "network-vif-deleted", "tag": "d2f54ad1-7a5a-48df-bf38-500fbd01980e"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:33:21.577231 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d45de973-dce9-4d4b-8994-b3b16aeacbbd req-36a59a26-57fa-4c6d-9348-2d78e8f986b1 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:21.577729 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d45de973-dce9-4d4b-8994-b3b16aeacbbd req-36a59a26-57fa-4c6d-9348-2d78e8f986b1 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:21.578195 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d45de973-dce9-4d4b-8994-b3b16aeacbbd req-36a59a26-57fa-4c6d-9348-2d78e8f986b1 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:21.616742 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-d45de973-dce9-4d4b-8994-b3b16aeacbbd req-36a59a26-57fa-4c6d-9348-2d78e8f986b1 service nova] Creating event network-vif-deleted:d2f54ad1-7a5a-48df-bf38-500fbd01980e for instance 158a6dc8-d946-4479-b3a5-ee3e97d283e8 on n-h2-833090-16 Aug 31 16:33:21.626546 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-d45de973-dce9-4d4b-8994-b3b16aeacbbd req-36a59a26-57fa-4c6d-9348-2d78e8f986b1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097834 Aug 31 16:33:21.629908 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3186/6556] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:33:22.353282 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6723dba6-cafb-404c-92d6-4adce3424cff tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:22.354056 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6723dba6-cafb-404c-92d6-4adce3424cff tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 158a6dc8-d946-4479-b3a5-ee3e97d283e8] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:33:22.369241 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6723dba6-cafb-404c-92d6-4adce3424cff tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:22.369851 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6723dba6-cafb-404c-92d6-4adce3424cff tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:22.374122 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6723dba6-cafb-404c-92d6-4adce3424cff tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:22.375051 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6723dba6-cafb-404c-92d6-4adce3424cff tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:22.375613 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6723dba6-cafb-404c-92d6-4adce3424cff tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:22.376126 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6723dba6-cafb-404c-92d6-4adce3424cff tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:22.463191 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6723dba6-cafb-404c-92d6-4adce3424cff tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:33:22.474451 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6723dba6-cafb-404c-92d6-4adce3424cff tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8" status: 200 len: 1225 microversion: 2.1 time: 0.125359 Aug 31 16:33:22.476138 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3371/6557] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:33:22 2022] GET /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8 => generated 1225 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:33:23.497129 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cc32ccbb-016f-4e60-aa68-64355ed22b21 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:23.497949 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cc32ccbb-016f-4e60-aa68-64355ed22b21 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 158a6dc8-d946-4479-b3a5-ee3e97d283e8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:33:23.508790 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cc32ccbb-016f-4e60-aa68-64355ed22b21 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:23.510515 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cc32ccbb-016f-4e60-aa68-64355ed22b21 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:23.512906 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cc32ccbb-016f-4e60-aa68-64355ed22b21 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:23.515083 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cc32ccbb-016f-4e60-aa68-64355ed22b21 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:23.515570 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cc32ccbb-016f-4e60-aa68-64355ed22b21 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:23.515996 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cc32ccbb-016f-4e60-aa68-64355ed22b21 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:23.612424 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cc32ccbb-016f-4e60-aa68-64355ed22b21 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:33:23.622220 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cc32ccbb-016f-4e60-aa68-64355ed22b21 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8" status: 200 len: 1225 microversion: 2.1 time: 0.130075 Aug 31 16:33:23.635867 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3187/6558] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:33:23 2022] GET /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8 => generated 1225 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:33:24.644341 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-34a5e37c-bf0b-4042-9f93-391d40f2025c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:24.645055 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-34a5e37c-bf0b-4042-9f93-391d40f2025c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 158a6dc8-d946-4479-b3a5-ee3e97d283e8] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:33:24.652653 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-34a5e37c-bf0b-4042-9f93-391d40f2025c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:24.653420 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-34a5e37c-bf0b-4042-9f93-391d40f2025c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:24.653991 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-34a5e37c-bf0b-4042-9f93-391d40f2025c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:24.655010 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-34a5e37c-bf0b-4042-9f93-391d40f2025c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:24.655643 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-34a5e37c-bf0b-4042-9f93-391d40f2025c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:24.656256 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-34a5e37c-bf0b-4042-9f93-391d40f2025c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:24.737724 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-34a5e37c-bf0b-4042-9f93-391d40f2025c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:33:24.746976 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-34a5e37c-bf0b-4042-9f93-391d40f2025c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8" status: 200 len: 1225 microversion: 2.1 time: 0.106894 Aug 31 16:33:24.747904 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3372/6559] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:33:24 2022] GET /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8 => generated 1225 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:33:25.778297 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b996af88-911f-41d2-88da-3977a1a66d5b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:25.780152 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b996af88-911f-41d2-88da-3977a1a66d5b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 158a6dc8-d946-4479-b3a5-ee3e97d283e8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:33:25.788585 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b996af88-911f-41d2-88da-3977a1a66d5b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:25.789361 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b996af88-911f-41d2-88da-3977a1a66d5b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:25.789950 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b996af88-911f-41d2-88da-3977a1a66d5b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:25.790858 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b996af88-911f-41d2-88da-3977a1a66d5b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:25.792112 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b996af88-911f-41d2-88da-3977a1a66d5b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:25.793335 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b996af88-911f-41d2-88da-3977a1a66d5b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:25.876921 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b996af88-911f-41d2-88da-3977a1a66d5b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:33:25.886424 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b996af88-911f-41d2-88da-3977a1a66d5b tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8" status: 200 len: 1225 microversion: 2.1 time: 0.114787 Aug 31 16:33:25.894381 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3188/6560] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:33:25 2022] GET /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8 => generated 1225 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:33:26.911918 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-adcd8406-64ee-49f4-a5dd-9c5e5dbbcc05 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:26.912631 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-adcd8406-64ee-49f4-a5dd-9c5e5dbbcc05 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 158a6dc8-d946-4479-b3a5-ee3e97d283e8] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:33:26.919711 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-adcd8406-64ee-49f4-a5dd-9c5e5dbbcc05 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:26.920310 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-adcd8406-64ee-49f4-a5dd-9c5e5dbbcc05 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:26.920830 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-adcd8406-64ee-49f4-a5dd-9c5e5dbbcc05 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:26.921800 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-adcd8406-64ee-49f4-a5dd-9c5e5dbbcc05 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:26.922322 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-adcd8406-64ee-49f4-a5dd-9c5e5dbbcc05 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:26.922824 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-adcd8406-64ee-49f4-a5dd-9c5e5dbbcc05 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:26.977722 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-adcd8406-64ee-49f4-a5dd-9c5e5dbbcc05 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:26.978891 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-adcd8406-64ee-49f4-a5dd-9c5e5dbbcc05 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:26.979400 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-adcd8406-64ee-49f4-a5dd-9c5e5dbbcc05 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:26.980084 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-adcd8406-64ee-49f4-a5dd-9c5e5dbbcc05 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lazy-loading 'fault' on Instance uuid 158a6dc8-d946-4479-b3a5-ee3e97d283e8 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:33:27.053628 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-adcd8406-64ee-49f4-a5dd-9c5e5dbbcc05 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:33:27.067348 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-adcd8406-64ee-49f4-a5dd-9c5e5dbbcc05 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8" status: 200 len: 1230 microversion: 2.1 time: 0.160257 Aug 31 16:33:27.067950 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3373/6561] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:33:26 2022] GET /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8 => generated 1230 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:33:28.089413 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-29adde4f-8ce9-4597-b1ba-05128d37af81 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:28.090010 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-29adde4f-8ce9-4597-b1ba-05128d37af81 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 158a6dc8-d946-4479-b3a5-ee3e97d283e8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:33:28.099418 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29adde4f-8ce9-4597-b1ba-05128d37af81 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:28.099947 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29adde4f-8ce9-4597-b1ba-05128d37af81 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:28.100381 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29adde4f-8ce9-4597-b1ba-05128d37af81 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:28.101306 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29adde4f-8ce9-4597-b1ba-05128d37af81 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:28.101757 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29adde4f-8ce9-4597-b1ba-05128d37af81 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:28.102496 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-29adde4f-8ce9-4597-b1ba-05128d37af81 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:28.126550 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-29adde4f-8ce9-4597-b1ba-05128d37af81 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] HTTP exception thrown: Instance 158a6dc8-d946-4479-b3a5-ee3e97d283e8 could not be found. Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-29adde4f-8ce9-4597-b1ba-05128d37af81 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Request method failure captured: Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8 HTTP/1.1 Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4sA8QatsiRw58KL4D-GJAaR1X9zBGwbu0cNuaHi16Tl8K5LhZ4dthUjdeeybVrZ6FkLiuj0CnwnGa_AqwqzkMsKdZfTNQhjMqXfHtEAV5ID9oXbOsK0vGNgY-jRlE7qor7NeFM7QGwhr8KE3TJ70ugNQcxhI7ZJIKzx49vTu_Rhy18 Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 32245d85aee64f69865d98656133a539 Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-TestVolumeBootPattern-1732723367 Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/32245d85aee64f69865d98656133a539"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/32245d85aee64f69865d98656133a539"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/32245d85aee64f69865d98656133a539"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_32245d85aee64f69865d98656133a539", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-TestVolumeBootPattern-1732723367 Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 32245d85aee64f69865d98656133a539 Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TestVolumeBootPattern-1732723367 Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-TestVolumeBootPattern-1732723367-project Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: fb76a89a8b8042edb7b6aaccb4f41ead Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-TestVolumeBootPattern-1732723367-project Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 158a6dc8-d946-4479-b3a5-ee3e97d283e8 could not be found. Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '158a6dc8-d946-4479-b3a5-ee3e97d283e8'} Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 158a6dc8-d946-4479-b3a5-ee3e97d283e8 could not be found. Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 158a6dc8-d946-4479-b3a5-ee3e97d283e8 could not be found. Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:33:28.130710 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:33:28.139164 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:33:28.139164 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:33:28.139164 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:33:28.139164 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:33:28.139164 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:33:28.139164 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 158a6dc8-d946-4479-b3a5-ee3e97d283e8 could not be found. Aug 31 16:33:28.139164 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:33:28.139164 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-29adde4f-8ce9-4597-b1ba-05128d37af81 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Returning 404 to user: Instance 158a6dc8-d946-4479-b3a5-ee3e97d283e8 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:33:28.139164 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-29adde4f-8ce9-4597-b1ba-05128d37af81 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8" status: 404 len: 111 microversion: 2.1 time: 0.048345 Aug 31 16:33:28.139164 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3189/6562] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:33:28 2022] GET /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:33:28.333364 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f69eaefe-c6d8-43c8-a4e5-6f18187b9cde tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1249518929", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1295463571", "security_groups": [{"name": "tempest-secgroup-smoke-1246170769"}], "block_device_mapping_v2": [{"uuid": "d097127b-89c0-4001-aee4-21b69ac9faad", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "875599c9-5517-4369-96b1-87dce382c42c"}]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:33:28.472873 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-f69eaefe-c6d8-43c8-a4e5-6f18187b9cde tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] validate_networks() for [('875599c9-5517-4369-96b1-87dce382c42c', None, None, None, None, None)] {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:33:29.015877 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-f69eaefe-c6d8-43c8-a4e5-6f18187b9cde tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:33:29.016258 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-f69eaefe-c6d8-43c8-a4e5-6f18187b9cde tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:33:29.016744 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-f69eaefe-c6d8-43c8-a4e5-6f18187b9cde tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:33:29.017185 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-f69eaefe-c6d8-43c8-a4e5-6f18187b9cde tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:33:29.017750 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-f69eaefe-c6d8-43c8-a4e5-6f18187b9cde tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:33:29.039423 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f69eaefe-c6d8-43c8-a4e5-6f18187b9cde tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:29.040223 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f69eaefe-c6d8-43c8-a4e5-6f18187b9cde tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:29.040820 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f69eaefe-c6d8-43c8-a4e5-6f18187b9cde tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:29.041729 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f69eaefe-c6d8-43c8-a4e5-6f18187b9cde tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:29.042423 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f69eaefe-c6d8-43c8-a4e5-6f18187b9cde tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:29.043078 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f69eaefe-c6d8-43c8-a4e5-6f18187b9cde tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:29.068294 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-f69eaefe-c6d8-43c8-a4e5-6f18187b9cde tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Getting quotas for project 32245d85aee64f69865d98656133a539. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:33:29.074631 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-f69eaefe-c6d8-43c8-a4e5-6f18187b9cde tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Getting quotas for user fb76a89a8b8042edb7b6aaccb4f41ead and project 32245d85aee64f69865d98656133a539. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:33:29.154437 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f69eaefe-c6d8-43c8-a4e5-6f18187b9cde tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:33:29.157133 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f69eaefe-c6d8-43c8-a4e5-6f18187b9cde tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 18912bca-5369-4179-8c68-24a627d48403] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d097127b-89c0-4001-aee4-21b69ac9faad',volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:33:29.343360 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f69eaefe-c6d8-43c8-a4e5-6f18187b9cde tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.014380 Aug 31 16:33:29.354975 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3374/6563] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:33:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 1027 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:33:29.367087 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2f214611-b0dc-4765-94ba-283fbbb34a8d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:29.368014 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2f214611-b0dc-4765-94ba-283fbbb34a8d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 18912bca-5369-4179-8c68-24a627d48403] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:33:29.473377 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2f214611-b0dc-4765-94ba-283fbbb34a8d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:33:29.484348 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2f214611-b0dc-4765-94ba-283fbbb34a8d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/18912bca-5369-4179-8c68-24a627d48403" status: 200 len: 1095 microversion: 2.1 time: 0.118615 Aug 31 16:33:29.486195 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3190/6564] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:33:29 2022] GET /compute/v2.1/servers/18912bca-5369-4179-8c68-24a627d48403 => generated 1095 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:33:30.507666 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-06e8bfe1-16cf-4a5e-907e-a8473ba0fc1a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:30.509036 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-06e8bfe1-16cf-4a5e-907e-a8473ba0fc1a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 18912bca-5369-4179-8c68-24a627d48403] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:33:30.517227 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06e8bfe1-16cf-4a5e-907e-a8473ba0fc1a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:30.517799 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06e8bfe1-16cf-4a5e-907e-a8473ba0fc1a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:30.518281 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06e8bfe1-16cf-4a5e-907e-a8473ba0fc1a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:30.518994 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06e8bfe1-16cf-4a5e-907e-a8473ba0fc1a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:30.519461 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06e8bfe1-16cf-4a5e-907e-a8473ba0fc1a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:30.519891 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-06e8bfe1-16cf-4a5e-907e-a8473ba0fc1a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:30.642679 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-06e8bfe1-16cf-4a5e-907e-a8473ba0fc1a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:33:30.660118 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-06e8bfe1-16cf-4a5e-907e-a8473ba0fc1a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/18912bca-5369-4179-8c68-24a627d48403" status: 200 len: 1201 microversion: 2.1 time: 0.157562 Aug 31 16:33:30.661082 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3375/6565] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:33:30 2022] GET /compute/v2.1/servers/18912bca-5369-4179-8c68-24a627d48403 => generated 1201 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:33:31.686846 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5ab7af73-0efb-4bf7-8950-3f1bd6935ab7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:31.687487 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5ab7af73-0efb-4bf7-8950-3f1bd6935ab7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 18912bca-5369-4179-8c68-24a627d48403] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:33:31.701630 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ab7af73-0efb-4bf7-8950-3f1bd6935ab7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:31.705365 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ab7af73-0efb-4bf7-8950-3f1bd6935ab7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:31.706038 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ab7af73-0efb-4bf7-8950-3f1bd6935ab7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:31.706967 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ab7af73-0efb-4bf7-8950-3f1bd6935ab7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:31.714725 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ab7af73-0efb-4bf7-8950-3f1bd6935ab7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:31.722140 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ab7af73-0efb-4bf7-8950-3f1bd6935ab7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:32.074539 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5ab7af73-0efb-4bf7-8950-3f1bd6935ab7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:33:32.085851 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5ab7af73-0efb-4bf7-8950-3f1bd6935ab7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/18912bca-5369-4179-8c68-24a627d48403" status: 200 len: 1279 microversion: 2.1 time: 0.404521 Aug 31 16:33:32.099458 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3191/6566] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:33:31 2022] GET /compute/v2.1/servers/18912bca-5369-4179-8c68-24a627d48403 => generated 1279 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:33:32.537058 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-aae6fa60-8492-45ec-b3f6-f4d17e9e67d1 req-6b9ae84e-fca0-4990-8a5c-c73e64c843c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18912bca-5369-4179-8c68-24a627d48403", "tag": "743d612c-7e97-4487-b267-5853d0764aa1"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:33:32.591261 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-aae6fa60-8492-45ec-b3f6-f4d17e9e67d1 req-6b9ae84e-fca0-4990-8a5c-c73e64c843c7 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:32.592045 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-aae6fa60-8492-45ec-b3f6-f4d17e9e67d1 req-6b9ae84e-fca0-4990-8a5c-c73e64c843c7 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:32.592697 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-aae6fa60-8492-45ec-b3f6-f4d17e9e67d1 req-6b9ae84e-fca0-4990-8a5c-c73e64c843c7 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:32.605980 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-aae6fa60-8492-45ec-b3f6-f4d17e9e67d1 req-6b9ae84e-fca0-4990-8a5c-c73e64c843c7 service nova] Creating event network-changed:743d612c-7e97-4487-b267-5853d0764aa1 for instance 18912bca-5369-4179-8c68-24a627d48403 on n-h1-833090-16 Aug 31 16:33:32.612302 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-aae6fa60-8492-45ec-b3f6-f4d17e9e67d1 req-6b9ae84e-fca0-4990-8a5c-c73e64c843c7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081216 Aug 31 16:33:32.613208 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3376/6567] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:33:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:33:33.109124 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-47657d01-1ef0-4799-a340-a8627b7f9e5f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:33.110331 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-47657d01-1ef0-4799-a340-a8627b7f9e5f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 18912bca-5369-4179-8c68-24a627d48403] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:33:33.117864 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47657d01-1ef0-4799-a340-a8627b7f9e5f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:33.118625 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47657d01-1ef0-4799-a340-a8627b7f9e5f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:33.119197 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47657d01-1ef0-4799-a340-a8627b7f9e5f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:33.120451 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47657d01-1ef0-4799-a340-a8627b7f9e5f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:33.121041 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47657d01-1ef0-4799-a340-a8627b7f9e5f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:33.121607 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47657d01-1ef0-4799-a340-a8627b7f9e5f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:33.807010 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-47657d01-1ef0-4799-a340-a8627b7f9e5f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:33:33.823152 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-47657d01-1ef0-4799-a340-a8627b7f9e5f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/18912bca-5369-4179-8c68-24a627d48403" status: 200 len: 1279 microversion: 2.1 time: 0.717791 Aug 31 16:33:33.837270 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3192/6568] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:33:33 2022] GET /compute/v2.1/servers/18912bca-5369-4179-8c68-24a627d48403 => generated 1279 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:33:34.845734 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b3c739ea-50a9-4c36-8835-41ca2adc0216 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:34.847092 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b3c739ea-50a9-4c36-8835-41ca2adc0216 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 18912bca-5369-4179-8c68-24a627d48403] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:33:34.859854 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b3c739ea-50a9-4c36-8835-41ca2adc0216 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:34.861537 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b3c739ea-50a9-4c36-8835-41ca2adc0216 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:34.862642 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b3c739ea-50a9-4c36-8835-41ca2adc0216 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:34.865173 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b3c739ea-50a9-4c36-8835-41ca2adc0216 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:34.865996 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b3c739ea-50a9-4c36-8835-41ca2adc0216 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:34.867194 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b3c739ea-50a9-4c36-8835-41ca2adc0216 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:35.146249 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b3c739ea-50a9-4c36-8835-41ca2adc0216 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:33:35.160386 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b3c739ea-50a9-4c36-8835-41ca2adc0216 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/18912bca-5369-4179-8c68-24a627d48403" status: 200 len: 1279 microversion: 2.1 time: 0.319187 Aug 31 16:33:35.186804 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3377/6569] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:33:34 2022] GET /compute/v2.1/servers/18912bca-5369-4179-8c68-24a627d48403 => generated 1279 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:33:36.183968 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f30461f0-1f43-4617-bef4-9a245764892f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:36.184678 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f30461f0-1f43-4617-bef4-9a245764892f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 18912bca-5369-4179-8c68-24a627d48403] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:33:36.191861 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f30461f0-1f43-4617-bef4-9a245764892f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:36.192678 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f30461f0-1f43-4617-bef4-9a245764892f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:36.193292 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f30461f0-1f43-4617-bef4-9a245764892f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:36.194193 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f30461f0-1f43-4617-bef4-9a245764892f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:36.194805 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f30461f0-1f43-4617-bef4-9a245764892f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:36.195988 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f30461f0-1f43-4617-bef4-9a245764892f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:36.359125 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f30461f0-1f43-4617-bef4-9a245764892f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:33:36.369652 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f30461f0-1f43-4617-bef4-9a245764892f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/18912bca-5369-4179-8c68-24a627d48403" status: 200 len: 1279 microversion: 2.1 time: 0.189362 Aug 31 16:33:36.370353 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3193/6570] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:33:36 2022] GET /compute/v2.1/servers/18912bca-5369-4179-8c68-24a627d48403 => generated 1279 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:33:37.392709 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d0280f38-58d0-4840-86f6-c00256f5a0c7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:37.393623 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d0280f38-58d0-4840-86f6-c00256f5a0c7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 18912bca-5369-4179-8c68-24a627d48403] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:33:37.403413 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d0280f38-58d0-4840-86f6-c00256f5a0c7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:37.404140 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d0280f38-58d0-4840-86f6-c00256f5a0c7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:37.404571 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d0280f38-58d0-4840-86f6-c00256f5a0c7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:37.405493 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d0280f38-58d0-4840-86f6-c00256f5a0c7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:37.406206 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d0280f38-58d0-4840-86f6-c00256f5a0c7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:37.407125 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d0280f38-58d0-4840-86f6-c00256f5a0c7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:37.576816 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d0280f38-58d0-4840-86f6-c00256f5a0c7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:33:37.586754 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d0280f38-58d0-4840-86f6-c00256f5a0c7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/18912bca-5369-4179-8c68-24a627d48403" status: 200 len: 1267 microversion: 2.1 time: 0.199223 Aug 31 16:33:37.588601 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3378/6571] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:33:37 2022] GET /compute/v2.1/servers/18912bca-5369-4179-8c68-24a627d48403 => generated 1267 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:33:38.614011 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b9ed13ed-976c-4ff9-a318-794faa3e9cd3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:38.615034 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b9ed13ed-976c-4ff9-a318-794faa3e9cd3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 18912bca-5369-4179-8c68-24a627d48403] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:33:38.623904 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9ed13ed-976c-4ff9-a318-794faa3e9cd3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:38.624969 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9ed13ed-976c-4ff9-a318-794faa3e9cd3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:38.625628 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9ed13ed-976c-4ff9-a318-794faa3e9cd3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:38.626627 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9ed13ed-976c-4ff9-a318-794faa3e9cd3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:38.627296 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9ed13ed-976c-4ff9-a318-794faa3e9cd3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:38.628254 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b9ed13ed-976c-4ff9-a318-794faa3e9cd3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:38.813492 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b9ed13ed-976c-4ff9-a318-794faa3e9cd3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:33:38.830608 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b9ed13ed-976c-4ff9-a318-794faa3e9cd3 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/18912bca-5369-4179-8c68-24a627d48403" status: 200 len: 1267 microversion: 2.1 time: 0.223377 Aug 31 16:33:38.832673 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3194/6572] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:33:38 2022] GET /compute/v2.1/servers/18912bca-5369-4179-8c68-24a627d48403 => generated 1267 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:33:39.857914 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-51aa7f9d-88df-4c3c-97dc-41c5cf37a3ff tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:39.858620 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-51aa7f9d-88df-4c3c-97dc-41c5cf37a3ff tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 18912bca-5369-4179-8c68-24a627d48403] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:33:39.862838 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:33:39.867825 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=6 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:33:39.884280 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51aa7f9d-88df-4c3c-97dc-41c5cf37a3ff tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:39.884957 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51aa7f9d-88df-4c3c-97dc-41c5cf37a3ff tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:39.885551 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51aa7f9d-88df-4c3c-97dc-41c5cf37a3ff tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:39.886858 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51aa7f9d-88df-4c3c-97dc-41c5cf37a3ff tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:39.887717 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51aa7f9d-88df-4c3c-97dc-41c5cf37a3ff tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:39.888646 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51aa7f9d-88df-4c3c-97dc-41c5cf37a3ff tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:40.069791 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-51aa7f9d-88df-4c3c-97dc-41c5cf37a3ff tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:33:40.079883 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-51aa7f9d-88df-4c3c-97dc-41c5cf37a3ff tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/18912bca-5369-4179-8c68-24a627d48403" status: 200 len: 1267 microversion: 2.1 time: 0.226974 Aug 31 16:33:40.080476 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3379/6573] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:33:39 2022] GET /compute/v2.1/servers/18912bca-5369-4179-8c68-24a627d48403 => generated 1267 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:33:41.101210 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-43fa69d0-e32a-4b6e-bfd5-d488401cfc48 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:41.102289 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-43fa69d0-e32a-4b6e-bfd5-d488401cfc48 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 18912bca-5369-4179-8c68-24a627d48403] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:33:41.104670 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:33:41.112143 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43fa69d0-e32a-4b6e-bfd5-d488401cfc48 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:41.112820 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43fa69d0-e32a-4b6e-bfd5-d488401cfc48 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:41.113421 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43fa69d0-e32a-4b6e-bfd5-d488401cfc48 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:41.113972 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43fa69d0-e32a-4b6e-bfd5-d488401cfc48 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:41.114465 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43fa69d0-e32a-4b6e-bfd5-d488401cfc48 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:41.114933 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43fa69d0-e32a-4b6e-bfd5-d488401cfc48 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:41.282571 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-43fa69d0-e32a-4b6e-bfd5-d488401cfc48 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:33:41.294966 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-43fa69d0-e32a-4b6e-bfd5-d488401cfc48 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/18912bca-5369-4179-8c68-24a627d48403" status: 200 len: 1267 microversion: 2.1 time: 0.197535 Aug 31 16:33:41.301381 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3195/6574] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:33:41 2022] GET /compute/v2.1/servers/18912bca-5369-4179-8c68-24a627d48403 => generated 1267 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:33:42.316459 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6111912f-c2fe-4284-9366-750878764297 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:42.317357 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6111912f-c2fe-4284-9366-750878764297 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 18912bca-5369-4179-8c68-24a627d48403] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:33:42.325431 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6111912f-c2fe-4284-9366-750878764297 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:42.325906 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6111912f-c2fe-4284-9366-750878764297 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:42.326526 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6111912f-c2fe-4284-9366-750878764297 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:42.327258 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6111912f-c2fe-4284-9366-750878764297 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:42.327739 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6111912f-c2fe-4284-9366-750878764297 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:42.328173 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6111912f-c2fe-4284-9366-750878764297 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:42.467733 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6111912f-c2fe-4284-9366-750878764297 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:33:42.475945 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6111912f-c2fe-4284-9366-750878764297 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/18912bca-5369-4179-8c68-24a627d48403" status: 200 len: 1267 microversion: 2.1 time: 0.163715 Aug 31 16:33:42.476771 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3380/6575] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:33:42 2022] GET /compute/v2.1/servers/18912bca-5369-4179-8c68-24a627d48403 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:33:43.745871 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a43097d6-299d-48d7-b874-b439b8694aeb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:43.746534 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a43097d6-299d-48d7-b874-b439b8694aeb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 18912bca-5369-4179-8c68-24a627d48403] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:33:43.752995 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a43097d6-299d-48d7-b874-b439b8694aeb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:43.753412 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a43097d6-299d-48d7-b874-b439b8694aeb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:43.753841 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a43097d6-299d-48d7-b874-b439b8694aeb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:43.754571 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a43097d6-299d-48d7-b874-b439b8694aeb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:43.755020 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a43097d6-299d-48d7-b874-b439b8694aeb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:43.755436 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a43097d6-299d-48d7-b874-b439b8694aeb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:43.928911 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a43097d6-299d-48d7-b874-b439b8694aeb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:33:43.938480 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a43097d6-299d-48d7-b874-b439b8694aeb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/18912bca-5369-4179-8c68-24a627d48403" status: 200 len: 1267 microversion: 2.1 time: 0.445237 Aug 31 16:33:43.939268 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3196/6576] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:33:43 2022] GET /compute/v2.1/servers/18912bca-5369-4179-8c68-24a627d48403 => generated 1267 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:33:44.964290 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-91f82ad9-d190-4e6d-89f1-ec905fce2570 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:44.966512 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-91f82ad9-d190-4e6d-89f1-ec905fce2570 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 18912bca-5369-4179-8c68-24a627d48403] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:33:44.974504 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91f82ad9-d190-4e6d-89f1-ec905fce2570 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:44.975038 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91f82ad9-d190-4e6d-89f1-ec905fce2570 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:44.975514 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91f82ad9-d190-4e6d-89f1-ec905fce2570 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:44.976436 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91f82ad9-d190-4e6d-89f1-ec905fce2570 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:44.977057 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91f82ad9-d190-4e6d-89f1-ec905fce2570 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:44.977523 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91f82ad9-d190-4e6d-89f1-ec905fce2570 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:45.139570 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-91f82ad9-d190-4e6d-89f1-ec905fce2570 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:33:45.149775 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-91f82ad9-d190-4e6d-89f1-ec905fce2570 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/18912bca-5369-4179-8c68-24a627d48403" status: 200 len: 1267 microversion: 2.1 time: 0.188266 Aug 31 16:33:45.159322 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3381/6577] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:33:44 2022] GET /compute/v2.1/servers/18912bca-5369-4179-8c68-24a627d48403 => generated 1267 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:33:46.171739 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f777e689-9cf3-42ee-a131-a3033f9b9af5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:46.173408 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f777e689-9cf3-42ee-a131-a3033f9b9af5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 18912bca-5369-4179-8c68-24a627d48403] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:33:46.181005 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f777e689-9cf3-42ee-a131-a3033f9b9af5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:46.181789 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f777e689-9cf3-42ee-a131-a3033f9b9af5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:46.182500 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f777e689-9cf3-42ee-a131-a3033f9b9af5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:46.183450 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f777e689-9cf3-42ee-a131-a3033f9b9af5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:46.184129 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f777e689-9cf3-42ee-a131-a3033f9b9af5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:46.184849 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f777e689-9cf3-42ee-a131-a3033f9b9af5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:46.346052 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f777e689-9cf3-42ee-a131-a3033f9b9af5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:33:46.355839 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f777e689-9cf3-42ee-a131-a3033f9b9af5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/18912bca-5369-4179-8c68-24a627d48403" status: 200 len: 1267 microversion: 2.1 time: 0.187896 Aug 31 16:33:46.366809 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3197/6578] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:33:46 2022] GET /compute/v2.1/servers/18912bca-5369-4179-8c68-24a627d48403 => generated 1267 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:33:46.828224 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-371dff9a-6268-4272-85d4-bf9f2138ff3b req-01da95e5-979b-4894-a912-500f9e7c2c3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18912bca-5369-4179-8c68-24a627d48403", "name": "network-vif-plugged", "status": "completed", "tag": "743d612c-7e97-4487-b267-5853d0764aa1"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:33:46.848659 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-371dff9a-6268-4272-85d4-bf9f2138ff3b req-01da95e5-979b-4894-a912-500f9e7c2c3c service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:46.848659 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-371dff9a-6268-4272-85d4-bf9f2138ff3b req-01da95e5-979b-4894-a912-500f9e7c2c3c service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:46.853280 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-371dff9a-6268-4272-85d4-bf9f2138ff3b req-01da95e5-979b-4894-a912-500f9e7c2c3c service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:46.890255 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-371dff9a-6268-4272-85d4-bf9f2138ff3b req-01da95e5-979b-4894-a912-500f9e7c2c3c service nova] Creating event network-vif-plugged:743d612c-7e97-4487-b267-5853d0764aa1 for instance 18912bca-5369-4179-8c68-24a627d48403 on n-h1-833090-16 Aug 31 16:33:46.901133 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-371dff9a-6268-4272-85d4-bf9f2138ff3b req-01da95e5-979b-4894-a912-500f9e7c2c3c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078617 Aug 31 16:33:46.904874 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3382/6579] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:33:47.381053 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-33d86b16-0c58-4699-9cee-a7a8492f7f32 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:47.383870 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-33d86b16-0c58-4699-9cee-a7a8492f7f32 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 18912bca-5369-4179-8c68-24a627d48403] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:33:47.392987 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33d86b16-0c58-4699-9cee-a7a8492f7f32 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:47.393909 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33d86b16-0c58-4699-9cee-a7a8492f7f32 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:47.394573 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33d86b16-0c58-4699-9cee-a7a8492f7f32 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:47.395745 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33d86b16-0c58-4699-9cee-a7a8492f7f32 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:47.396316 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33d86b16-0c58-4699-9cee-a7a8492f7f32 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:47.396949 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33d86b16-0c58-4699-9cee-a7a8492f7f32 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:47.566154 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-33d86b16-0c58-4699-9cee-a7a8492f7f32 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:33:47.577002 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-33d86b16-0c58-4699-9cee-a7a8492f7f32 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/18912bca-5369-4179-8c68-24a627d48403" status: 200 len: 1267 microversion: 2.1 time: 0.202895 Aug 31 16:33:47.578368 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3198/6580] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:33:47 2022] GET /compute/v2.1/servers/18912bca-5369-4179-8c68-24a627d48403 => generated 1267 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:33:48.602502 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7b166d93-ef17-49dc-9e08-41c5bcd3dbec tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:48.615784 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7b166d93-ef17-49dc-9e08-41c5bcd3dbec tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 18912bca-5369-4179-8c68-24a627d48403] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:33:48.638544 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7b166d93-ef17-49dc-9e08-41c5bcd3dbec tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:48.639516 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7b166d93-ef17-49dc-9e08-41c5bcd3dbec tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:48.640977 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7b166d93-ef17-49dc-9e08-41c5bcd3dbec tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:48.642312 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7b166d93-ef17-49dc-9e08-41c5bcd3dbec tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:48.643082 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7b166d93-ef17-49dc-9e08-41c5bcd3dbec tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:48.643931 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7b166d93-ef17-49dc-9e08-41c5bcd3dbec tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:48.911293 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7b166d93-ef17-49dc-9e08-41c5bcd3dbec tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:33:48.915495 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=79 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:33:48.933076 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7b166d93-ef17-49dc-9e08-41c5bcd3dbec tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/18912bca-5369-4179-8c68-24a627d48403" status: 200 len: 1455 microversion: 2.1 time: 0.337014 Aug 31 16:33:48.935166 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3383/6581] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:33:48 2022] GET /compute/v2.1/servers/18912bca-5369-4179-8c68-24a627d48403 => generated 1455 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:33:48.957603 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-22cbb24f-709e-448d-a0c5-7d0f7ab6cbe2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:33:48.959412 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-22cbb24f-709e-448d-a0c5-7d0f7ab6cbe2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 18912bca-5369-4179-8c68-24a627d48403] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:33:48.963225 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:33:48.972134 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-22cbb24f-709e-448d-a0c5-7d0f7ab6cbe2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:48.973055 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-22cbb24f-709e-448d-a0c5-7d0f7ab6cbe2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:48.974015 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-22cbb24f-709e-448d-a0c5-7d0f7ab6cbe2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:48.974976 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-22cbb24f-709e-448d-a0c5-7d0f7ab6cbe2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:48.975531 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-22cbb24f-709e-448d-a0c5-7d0f7ab6cbe2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:48.975973 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-22cbb24f-709e-448d-a0c5-7d0f7ab6cbe2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:48.980305 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:33:49.270295 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-22cbb24f-709e-448d-a0c5-7d0f7ab6cbe2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:33:49.281432 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-22cbb24f-709e-448d-a0c5-7d0f7ab6cbe2 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/18912bca-5369-4179-8c68-24a627d48403" status: 200 len: 1455 microversion: 2.1 time: 0.328811 Aug 31 16:33:49.282683 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3199/6582] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:33:48 2022] GET /compute/v2.1/servers/18912bca-5369-4179-8c68-24a627d48403 => generated 1455 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:33:51.409402 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-16725a47-1b46-4c2c-8777-397d23e1745e req-e40c6db2-1ade-44af-9d3c-1d178191e7be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18912bca-5369-4179-8c68-24a627d48403", "tag": "743d612c-7e97-4487-b267-5853d0764aa1"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:33:51.418579 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:33:51.426431 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-16725a47-1b46-4c2c-8777-397d23e1745e req-e40c6db2-1ade-44af-9d3c-1d178191e7be service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:33:51.427086 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-16725a47-1b46-4c2c-8777-397d23e1745e req-e40c6db2-1ade-44af-9d3c-1d178191e7be service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:33:51.427684 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-16725a47-1b46-4c2c-8777-397d23e1745e req-e40c6db2-1ade-44af-9d3c-1d178191e7be service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:33:51.445360 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-16725a47-1b46-4c2c-8777-397d23e1745e req-e40c6db2-1ade-44af-9d3c-1d178191e7be service nova] Creating event network-changed:743d612c-7e97-4487-b267-5853d0764aa1 for instance 18912bca-5369-4179-8c68-24a627d48403 on n-h1-833090-16 Aug 31 16:33:51.451355 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-16725a47-1b46-4c2c-8777-397d23e1745e req-e40c6db2-1ade-44af-9d3c-1d178191e7be service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050185 Aug 31 16:33:51.456505 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3384/6583] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:34:38.973027 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ee3aede8-7bf8-4b59-b645-5d134dd212df tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1471904254", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "89e6a1f1-20ef-4f9a-a88a-ca9634461641"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:34:38.982299 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:34:38.982952 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=5 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:34:39.152587 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-ee3aede8-7bf8-4b59-b645-5d134dd212df tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] validate_networks() for [('89e6a1f1-20ef-4f9a-a88a-ca9634461641', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:34:39.519955 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ee3aede8-7bf8-4b59-b645-5d134dd212df tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:34:39.520381 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ee3aede8-7bf8-4b59-b645-5d134dd212df tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:34:39.520863 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ee3aede8-7bf8-4b59-b645-5d134dd212df tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:34:39.521325 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ee3aede8-7bf8-4b59-b645-5d134dd212df tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:34:39.521733 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-ee3aede8-7bf8-4b59-b645-5d134dd212df tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:34:39.531482 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee3aede8-7bf8-4b59-b645-5d134dd212df tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:34:39.531965 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee3aede8-7bf8-4b59-b645-5d134dd212df tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:34:39.532407 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee3aede8-7bf8-4b59-b645-5d134dd212df tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:34:39.533126 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee3aede8-7bf8-4b59-b645-5d134dd212df tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:34:39.533576 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee3aede8-7bf8-4b59-b645-5d134dd212df tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:34:39.533983 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee3aede8-7bf8-4b59-b645-5d134dd212df tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:34:39.552908 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-ee3aede8-7bf8-4b59-b645-5d134dd212df tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Getting quotas for project 6cf3503a6a724914af2ac13a4579a4fe. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:34:39.558657 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-ee3aede8-7bf8-4b59-b645-5d134dd212df tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Getting quotas for user 8192fd503d654d36919dd083abf585b0 and project 6cf3503a6a724914af2ac13a4579a4fe. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:34:39.572427 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ee3aede8-7bf8-4b59-b645-5d134dd212df tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:34:39.575108 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ee3aede8-7bf8-4b59-b645-5d134dd212df tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] [instance: e7093cc6-edd9-4c19-8911-aafa831f29e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:34:39.622988 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ee3aede8-7bf8-4b59-b645-5d134dd212df tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.653841 Aug 31 16:34:39.623612 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3200/6584] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:34:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:34:39.636069 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-38b92b51-5ce4-4b17-bbeb-a5b5ddf2a42d tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:34:39.636997 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-38b92b51-5ce4-4b17-bbeb-a5b5ddf2a42d tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] [instance: e7093cc6-edd9-4c19-8911-aafa831f29e6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:34:39.639791 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=3 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:34:39.767130 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-38b92b51-5ce4-4b17-bbeb-a5b5ddf2a42d tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8192fd503d654d36919dd083abf585b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf3503a6a724914af2ac13a4579a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:34:39.776086 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-38b92b51-5ce4-4b17-bbeb-a5b5ddf2a42d tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] 10.222.0.50 "GET /compute/v2.1/servers/e7093cc6-edd9-4c19-8911-aafa831f29e6" status: 200 len: 1219 microversion: 2.1 time: 0.144965 Aug 31 16:34:39.776979 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3385/6585] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:34:39 2022] GET /compute/v2.1/servers/e7093cc6-edd9-4c19-8911-aafa831f29e6 => generated 1219 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:34:40.799458 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-04c99e35-aad5-4b93-a232-b312e007773c tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:34:40.800061 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-04c99e35-aad5-4b93-a232-b312e007773c tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] [instance: e7093cc6-edd9-4c19-8911-aafa831f29e6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:34:40.809636 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04c99e35-aad5-4b93-a232-b312e007773c tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:34:40.811294 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04c99e35-aad5-4b93-a232-b312e007773c tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:34:40.811958 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04c99e35-aad5-4b93-a232-b312e007773c tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:34:40.813229 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04c99e35-aad5-4b93-a232-b312e007773c tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:34:40.813684 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04c99e35-aad5-4b93-a232-b312e007773c tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:34:40.814126 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04c99e35-aad5-4b93-a232-b312e007773c tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:34:40.897551 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-04c99e35-aad5-4b93-a232-b312e007773c tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8192fd503d654d36919dd083abf585b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf3503a6a724914af2ac13a4579a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:34:40.910029 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-04c99e35-aad5-4b93-a232-b312e007773c tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] 10.222.0.50 "GET /compute/v2.1/servers/e7093cc6-edd9-4c19-8911-aafa831f29e6" status: 200 len: 1279 microversion: 2.1 time: 0.116703 Aug 31 16:34:40.913206 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3201/6586] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:34:40 2022] GET /compute/v2.1/servers/e7093cc6-edd9-4c19-8911-aafa831f29e6 => generated 1279 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:34:41.935539 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b5a9b184-46a8-4d2e-ba01-81fdf4afafbf tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:34:41.936223 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b5a9b184-46a8-4d2e-ba01-81fdf4afafbf tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] [instance: e7093cc6-edd9-4c19-8911-aafa831f29e6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:34:41.944995 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b5a9b184-46a8-4d2e-ba01-81fdf4afafbf tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:34:41.945512 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b5a9b184-46a8-4d2e-ba01-81fdf4afafbf tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:34:41.945971 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b5a9b184-46a8-4d2e-ba01-81fdf4afafbf tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:34:41.946957 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b5a9b184-46a8-4d2e-ba01-81fdf4afafbf tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:34:41.947230 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b5a9b184-46a8-4d2e-ba01-81fdf4afafbf tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:34:41.947845 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b5a9b184-46a8-4d2e-ba01-81fdf4afafbf tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:34:42.130423 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b5a9b184-46a8-4d2e-ba01-81fdf4afafbf tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8192fd503d654d36919dd083abf585b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf3503a6a724914af2ac13a4579a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:34:42.139515 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b5a9b184-46a8-4d2e-ba01-81fdf4afafbf tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] 10.222.0.50 "GET /compute/v2.1/servers/e7093cc6-edd9-4c19-8911-aafa831f29e6" status: 200 len: 1319 microversion: 2.1 time: 0.208227 Aug 31 16:34:42.140416 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3386/6587] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:34:41 2022] GET /compute/v2.1/servers/e7093cc6-edd9-4c19-8911-aafa831f29e6 => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:34:42.278677 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-8a407d13-a0b8-478e-86dc-98030bbe2118 req-797e4b9d-c627-42fd-a234-4f5469b00344 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7093cc6-edd9-4c19-8911-aafa831f29e6", "tag": "047c5e6e-618a-45b3-bb99-ab1087e8dad8"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:34:42.298048 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8a407d13-a0b8-478e-86dc-98030bbe2118 req-797e4b9d-c627-42fd-a234-4f5469b00344 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:34:42.299147 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8a407d13-a0b8-478e-86dc-98030bbe2118 req-797e4b9d-c627-42fd-a234-4f5469b00344 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:34:42.299585 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8a407d13-a0b8-478e-86dc-98030bbe2118 req-797e4b9d-c627-42fd-a234-4f5469b00344 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:34:42.313967 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-8a407d13-a0b8-478e-86dc-98030bbe2118 req-797e4b9d-c627-42fd-a234-4f5469b00344 service nova] Creating event network-changed:047c5e6e-618a-45b3-bb99-ab1087e8dad8 for instance e7093cc6-edd9-4c19-8911-aafa831f29e6 on n-h2-833090-16 Aug 31 16:34:42.320126 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-8a407d13-a0b8-478e-86dc-98030bbe2118 req-797e4b9d-c627-42fd-a234-4f5469b00344 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044478 Aug 31 16:34:42.321066 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3202/6588] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:34:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:34:43.160667 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f39fcc4e-eab0-40ad-a7ea-f44cdc6fb3a8 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:34:43.161260 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f39fcc4e-eab0-40ad-a7ea-f44cdc6fb3a8 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] [instance: e7093cc6-edd9-4c19-8911-aafa831f29e6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:34:43.168946 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f39fcc4e-eab0-40ad-a7ea-f44cdc6fb3a8 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:34:43.169444 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f39fcc4e-eab0-40ad-a7ea-f44cdc6fb3a8 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:34:43.169892 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f39fcc4e-eab0-40ad-a7ea-f44cdc6fb3a8 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:34:43.170640 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f39fcc4e-eab0-40ad-a7ea-f44cdc6fb3a8 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:34:43.171419 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f39fcc4e-eab0-40ad-a7ea-f44cdc6fb3a8 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:34:43.171854 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f39fcc4e-eab0-40ad-a7ea-f44cdc6fb3a8 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:34:43.334123 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f39fcc4e-eab0-40ad-a7ea-f44cdc6fb3a8 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8192fd503d654d36919dd083abf585b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf3503a6a724914af2ac13a4579a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:34:43.345618 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f39fcc4e-eab0-40ad-a7ea-f44cdc6fb3a8 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] 10.222.0.50 "GET /compute/v2.1/servers/e7093cc6-edd9-4c19-8911-aafa831f29e6" status: 200 len: 1319 microversion: 2.1 time: 0.188906 Aug 31 16:34:43.346347 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3387/6589] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:34:43 2022] GET /compute/v2.1/servers/e7093cc6-edd9-4c19-8911-aafa831f29e6 => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:34:44.368576 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-53829e43-0a55-44fd-9fa1-92af7a27fbed tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:34:44.369576 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-53829e43-0a55-44fd-9fa1-92af7a27fbed tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] [instance: e7093cc6-edd9-4c19-8911-aafa831f29e6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:34:44.376495 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-53829e43-0a55-44fd-9fa1-92af7a27fbed tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:34:44.377009 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-53829e43-0a55-44fd-9fa1-92af7a27fbed tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:34:44.377449 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-53829e43-0a55-44fd-9fa1-92af7a27fbed tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:34:44.378297 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-53829e43-0a55-44fd-9fa1-92af7a27fbed tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:34:44.378609 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-53829e43-0a55-44fd-9fa1-92af7a27fbed tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:34:44.379227 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-53829e43-0a55-44fd-9fa1-92af7a27fbed tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:34:44.537109 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-53829e43-0a55-44fd-9fa1-92af7a27fbed tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8192fd503d654d36919dd083abf585b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf3503a6a724914af2ac13a4579a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:34:44.545728 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-53829e43-0a55-44fd-9fa1-92af7a27fbed tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] 10.222.0.50 "GET /compute/v2.1/servers/e7093cc6-edd9-4c19-8911-aafa831f29e6" status: 200 len: 1319 microversion: 2.1 time: 0.182508 Aug 31 16:34:44.546642 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3203/6590] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:34:44 2022] GET /compute/v2.1/servers/e7093cc6-edd9-4c19-8911-aafa831f29e6 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:34:45.568643 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-33a710db-69eb-4d5c-b6d3-69c5e31be02a tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:34:45.569270 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-33a710db-69eb-4d5c-b6d3-69c5e31be02a tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] [instance: e7093cc6-edd9-4c19-8911-aafa831f29e6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:34:45.578712 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33a710db-69eb-4d5c-b6d3-69c5e31be02a tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:34:45.579247 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33a710db-69eb-4d5c-b6d3-69c5e31be02a tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:34:45.579720 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33a710db-69eb-4d5c-b6d3-69c5e31be02a tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:34:45.580794 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33a710db-69eb-4d5c-b6d3-69c5e31be02a tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:34:45.581529 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33a710db-69eb-4d5c-b6d3-69c5e31be02a tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:34:45.582293 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33a710db-69eb-4d5c-b6d3-69c5e31be02a tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:34:45.756859 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-33a710db-69eb-4d5c-b6d3-69c5e31be02a tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8192fd503d654d36919dd083abf585b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf3503a6a724914af2ac13a4579a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:34:45.767607 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-33a710db-69eb-4d5c-b6d3-69c5e31be02a tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] 10.222.0.50 "GET /compute/v2.1/servers/e7093cc6-edd9-4c19-8911-aafa831f29e6" status: 200 len: 1319 microversion: 2.1 time: 0.203568 Aug 31 16:34:45.768306 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3388/6591] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:34:45 2022] GET /compute/v2.1/servers/e7093cc6-edd9-4c19-8911-aafa831f29e6 => generated 1319 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:34:46.794056 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4514a0f2-2202-4c93-8f34-38444155dc4b tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:34:46.794795 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4514a0f2-2202-4c93-8f34-38444155dc4b tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] [instance: e7093cc6-edd9-4c19-8911-aafa831f29e6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:34:46.802569 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4514a0f2-2202-4c93-8f34-38444155dc4b tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:34:46.803146 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4514a0f2-2202-4c93-8f34-38444155dc4b tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:34:46.803633 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4514a0f2-2202-4c93-8f34-38444155dc4b tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:34:46.804416 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4514a0f2-2202-4c93-8f34-38444155dc4b tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:34:46.804958 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4514a0f2-2202-4c93-8f34-38444155dc4b tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:34:46.805439 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4514a0f2-2202-4c93-8f34-38444155dc4b tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:34:46.953378 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4514a0f2-2202-4c93-8f34-38444155dc4b tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8192fd503d654d36919dd083abf585b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf3503a6a724914af2ac13a4579a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:34:46.962451 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4514a0f2-2202-4c93-8f34-38444155dc4b tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] 10.222.0.50 "GET /compute/v2.1/servers/e7093cc6-edd9-4c19-8911-aafa831f29e6" status: 200 len: 1319 microversion: 2.1 time: 0.173350 Aug 31 16:34:46.963122 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3204/6592] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:34:46 2022] GET /compute/v2.1/servers/e7093cc6-edd9-4c19-8911-aafa831f29e6 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:34:47.990068 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-97c9ad70-0a1f-4a8b-aa8b-e45acf21c6b7 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:34:47.991886 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-97c9ad70-0a1f-4a8b-aa8b-e45acf21c6b7 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] [instance: e7093cc6-edd9-4c19-8911-aafa831f29e6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:34:48.001189 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-97c9ad70-0a1f-4a8b-aa8b-e45acf21c6b7 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:34:48.001708 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-97c9ad70-0a1f-4a8b-aa8b-e45acf21c6b7 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:34:48.002184 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-97c9ad70-0a1f-4a8b-aa8b-e45acf21c6b7 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:34:48.002914 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-97c9ad70-0a1f-4a8b-aa8b-e45acf21c6b7 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:34:48.003382 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-97c9ad70-0a1f-4a8b-aa8b-e45acf21c6b7 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:34:48.003819 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-97c9ad70-0a1f-4a8b-aa8b-e45acf21c6b7 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:34:48.151877 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-97c9ad70-0a1f-4a8b-aa8b-e45acf21c6b7 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8192fd503d654d36919dd083abf585b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf3503a6a724914af2ac13a4579a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:34:48.161201 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-97c9ad70-0a1f-4a8b-aa8b-e45acf21c6b7 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] 10.222.0.50 "GET /compute/v2.1/servers/e7093cc6-edd9-4c19-8911-aafa831f29e6" status: 200 len: 1319 microversion: 2.1 time: 0.178944 Aug 31 16:34:48.162450 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3389/6593] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:34:47 2022] GET /compute/v2.1/servers/e7093cc6-edd9-4c19-8911-aafa831f29e6 => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:34:48.231313 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-555a5d34-6b0a-411c-8874-b50d6ef3893d req-71f5cc22-b6b2-48e5-beb4-47267fe95173 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7093cc6-edd9-4c19-8911-aafa831f29e6", "name": "network-vif-plugged", "status": "completed", "tag": "047c5e6e-618a-45b3-bb99-ab1087e8dad8"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:34:48.243349 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-555a5d34-6b0a-411c-8874-b50d6ef3893d req-71f5cc22-b6b2-48e5-beb4-47267fe95173 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:34:48.243910 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-555a5d34-6b0a-411c-8874-b50d6ef3893d req-71f5cc22-b6b2-48e5-beb4-47267fe95173 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:34:48.245887 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-555a5d34-6b0a-411c-8874-b50d6ef3893d req-71f5cc22-b6b2-48e5-beb4-47267fe95173 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:34:48.259640 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-555a5d34-6b0a-411c-8874-b50d6ef3893d req-71f5cc22-b6b2-48e5-beb4-47267fe95173 service nova] Creating event network-vif-plugged:047c5e6e-618a-45b3-bb99-ab1087e8dad8 for instance e7093cc6-edd9-4c19-8911-aafa831f29e6 on n-h2-833090-16 Aug 31 16:34:48.265390 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-555a5d34-6b0a-411c-8874-b50d6ef3893d req-71f5cc22-b6b2-48e5-beb4-47267fe95173 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038840 Aug 31 16:34:48.266930 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3205/6594] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:34:49.185638 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2766327b-d4f6-45e1-bb30-c196d5f65f3c tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:34:49.186605 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2766327b-d4f6-45e1-bb30-c196d5f65f3c tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] [instance: e7093cc6-edd9-4c19-8911-aafa831f29e6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:34:49.194069 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2766327b-d4f6-45e1-bb30-c196d5f65f3c tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:34:49.194434 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2766327b-d4f6-45e1-bb30-c196d5f65f3c tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:34:49.194885 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2766327b-d4f6-45e1-bb30-c196d5f65f3c tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:34:49.195558 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2766327b-d4f6-45e1-bb30-c196d5f65f3c tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:34:49.196203 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2766327b-d4f6-45e1-bb30-c196d5f65f3c tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:34:49.196637 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2766327b-d4f6-45e1-bb30-c196d5f65f3c tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:34:49.702629 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2766327b-d4f6-45e1-bb30-c196d5f65f3c tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8192fd503d654d36919dd083abf585b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf3503a6a724914af2ac13a4579a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:34:49.711929 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2766327b-d4f6-45e1-bb30-c196d5f65f3c tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] 10.222.0.50 "GET /compute/v2.1/servers/e7093cc6-edd9-4c19-8911-aafa831f29e6" status: 200 len: 1319 microversion: 2.1 time: 0.530351 Aug 31 16:34:49.712529 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3390/6595] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:34:49 2022] GET /compute/v2.1/servers/e7093cc6-edd9-4c19-8911-aafa831f29e6 => generated 1319 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:34:50.734772 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:34:50.734772 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:34:50.739258 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c2389c73-05c4-4045-9f35-f4855a73c9d1 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:34:50.739982 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c2389c73-05c4-4045-9f35-f4855a73c9d1 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] [instance: e7093cc6-edd9-4c19-8911-aafa831f29e6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:34:50.748306 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2389c73-05c4-4045-9f35-f4855a73c9d1 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:34:50.748801 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2389c73-05c4-4045-9f35-f4855a73c9d1 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:34:50.749354 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2389c73-05c4-4045-9f35-f4855a73c9d1 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:34:50.750140 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2389c73-05c4-4045-9f35-f4855a73c9d1 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:34:50.750600 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2389c73-05c4-4045-9f35-f4855a73c9d1 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:34:50.751086 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2389c73-05c4-4045-9f35-f4855a73c9d1 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:34:50.902906 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c2389c73-05c4-4045-9f35-f4855a73c9d1 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8192fd503d654d36919dd083abf585b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf3503a6a724914af2ac13a4579a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:34:50.911384 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c2389c73-05c4-4045-9f35-f4855a73c9d1 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] 10.222.0.50 "GET /compute/v2.1/servers/e7093cc6-edd9-4c19-8911-aafa831f29e6" status: 200 len: 1507 microversion: 2.1 time: 0.179847 Aug 31 16:34:50.912249 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3206/6596] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:34:50 2022] GET /compute/v2.1/servers/e7093cc6-edd9-4c19-8911-aafa831f29e6 => generated 1507 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:35:08.472432 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7b3c7467-6fac-4d30-bd00-d97ce2b0decf tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "678ed4fa-b201-4336-8872-bf0707ee5bf7", "device": "/dev/sdb"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:35:08.475549 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7b3c7467-6fac-4d30-bd00-d97ce2b0decf tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] [instance: e7093cc6-edd9-4c19-8911-aafa831f29e6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:35:08.477878 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:35:08.479206 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=15 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:35:08.480035 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=30 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:35:08.488173 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7b3c7467-6fac-4d30-bd00-d97ce2b0decf tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:08.490005 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7b3c7467-6fac-4d30-bd00-d97ce2b0decf tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:08.490598 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7b3c7467-6fac-4d30-bd00-d97ce2b0decf tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:08.491210 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7b3c7467-6fac-4d30-bd00-d97ce2b0decf tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:08.491672 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7b3c7467-6fac-4d30-bd00-d97ce2b0decf tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:08.492290 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7b3c7467-6fac-4d30-bd00-d97ce2b0decf tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:08.803845 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7b3c7467-6fac-4d30-bd00-d97ce2b0decf tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] 10.222.0.50 "POST /compute/v2.1/servers/e7093cc6-edd9-4c19-8911-aafa831f29e6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.336425 Aug 31 16:35:08.804501 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3391/6597] 10.222.0.50 () {60 vars in 1323 bytes} [Wed Aug 31 16:35:08 2022] POST /compute/v2.1/servers/e7093cc6-edd9-4c19-8911-aafa831f29e6/os-volume_attachments => generated 194 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:35:36.172991 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d4e2d1d7-6c8f-42c8-a81e-7ef7388e0bdf tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:35:36.173492 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d4e2d1d7-6c8f-42c8-a81e-7ef7388e0bdf tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] [instance: e7093cc6-edd9-4c19-8911-aafa831f29e6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:35:36.180889 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:35:36.181944 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=30 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:35:36.183399 n-d-833090-16 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 16:35:36.183733 n-d-833090-16 devstack@n-api.service[128863]: Wed Aug 31 16:35:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e7093cc6-edd9-4c19-8911-aafa831f29e6/os-volume_attachments/678ed4fa-b201-4336-8872-bf0707ee5bf7 (ip 10.222.0.50) !!! Aug 31 16:35:36.197598 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4e2d1d7-6c8f-42c8-a81e-7ef7388e0bdf tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:36.198141 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4e2d1d7-6c8f-42c8-a81e-7ef7388e0bdf tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:36.198556 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4e2d1d7-6c8f-42c8-a81e-7ef7388e0bdf tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:36.199267 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4e2d1d7-6c8f-42c8-a81e-7ef7388e0bdf tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:36.199717 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4e2d1d7-6c8f-42c8-a81e-7ef7388e0bdf tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:36.200168 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d4e2d1d7-6c8f-42c8-a81e-7ef7388e0bdf tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:36.300234 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-d4e2d1d7-6c8f-42c8-a81e-7ef7388e0bdf tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lazy-loading 'services' on Instance uuid e7093cc6-edd9-4c19-8911-aafa831f29e6 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:35:36.399188 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d4e2d1d7-6c8f-42c8-a81e-7ef7388e0bdf tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e7093cc6-edd9-4c19-8911-aafa831f29e6/os-volume_attachments/678ed4fa-b201-4336-8872-bf0707ee5bf7" status: 202 len: 0 microversion: 2.1 time: 0.230738 Aug 31 16:35:36.400418 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3207/6598] 10.222.0.50 () {58 vars in 1416 bytes} [Wed Aug 31 16:35:36 2022] DELETE /compute/v2.1/servers/e7093cc6-edd9-4c19-8911-aafa831f29e6/os-volume_attachments/678ed4fa-b201-4336-8872-bf0707ee5bf7 => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:35:43.050710 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-70ab75bb-c87d-4f74-80c1-4ffa938f4e79 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:35:43.052193 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-70ab75bb-c87d-4f74-80c1-4ffa938f4e79 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] [instance: e7093cc6-edd9-4c19-8911-aafa831f29e6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:35:43.059093 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:35:43.060332 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:35:43.063362 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-70ab75bb-c87d-4f74-80c1-4ffa938f4e79 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:43.064326 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-70ab75bb-c87d-4f74-80c1-4ffa938f4e79 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:43.065174 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-70ab75bb-c87d-4f74-80c1-4ffa938f4e79 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:43.066042 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-70ab75bb-c87d-4f74-80c1-4ffa938f4e79 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:43.067222 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-70ab75bb-c87d-4f74-80c1-4ffa938f4e79 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:43.067882 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-70ab75bb-c87d-4f74-80c1-4ffa938f4e79 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:43.099155 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-70ab75bb-c87d-4f74-80c1-4ffa938f4e79 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] [instance: e7093cc6-edd9-4c19-8911-aafa831f29e6] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:35:43.196194 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-70ab75bb-c87d-4f74-80c1-4ffa938f4e79 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e7093cc6-edd9-4c19-8911-aafa831f29e6" status: 204 len: 0 microversion: 2.1 time: 0.149745 Aug 31 16:35:43.197237 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3392/6599] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:35:43 2022] DELETE /compute/v2.1/servers/e7093cc6-edd9-4c19-8911-aafa831f29e6 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:35:43.206466 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-87e7935e-a568-4864-9da1-6e6ae7c896dd tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:35:43.207501 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-87e7935e-a568-4864-9da1-6e6ae7c896dd tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] [instance: e7093cc6-edd9-4c19-8911-aafa831f29e6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:35:43.216663 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-87e7935e-a568-4864-9da1-6e6ae7c896dd tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:43.216663 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-87e7935e-a568-4864-9da1-6e6ae7c896dd tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:43.217151 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-87e7935e-a568-4864-9da1-6e6ae7c896dd tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:43.218618 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-87e7935e-a568-4864-9da1-6e6ae7c896dd tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:43.218618 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-87e7935e-a568-4864-9da1-6e6ae7c896dd tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:43.218618 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-87e7935e-a568-4864-9da1-6e6ae7c896dd tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:43.382919 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-87e7935e-a568-4864-9da1-6e6ae7c896dd tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8192fd503d654d36919dd083abf585b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf3503a6a724914af2ac13a4579a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:35:43.395144 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-87e7935e-a568-4864-9da1-6e6ae7c896dd tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] 10.222.0.50 "GET /compute/v2.1/servers/e7093cc6-edd9-4c19-8911-aafa831f29e6" status: 200 len: 1513 microversion: 2.1 time: 0.193162 Aug 31 16:35:43.396387 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3208/6600] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:35:43 2022] GET /compute/v2.1/servers/e7093cc6-edd9-4c19-8911-aafa831f29e6 => generated 1513 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:35:43.761803 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ecd8247a-f1e2-4a24-8d6a-c4388b968289 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-703662042", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1295463571", "security_groups": [{"name": "tempest-secgroup-smoke-1246170769"}], "block_device_mapping_v2": [{"uuid": "3f3d5147-2a64-4c64-8438-23aabbc31f97", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "875599c9-5517-4369-96b1-87dce382c42c"}]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:35:43.888076 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-ecd8247a-f1e2-4a24-8d6a-c4388b968289 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] validate_networks() for [('875599c9-5517-4369-96b1-87dce382c42c', None, None, None, None, None)] {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:35:44.347105 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-ecd8247a-f1e2-4a24-8d6a-c4388b968289 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:35:44.347649 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-ecd8247a-f1e2-4a24-8d6a-c4388b968289 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:35:44.348130 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-ecd8247a-f1e2-4a24-8d6a-c4388b968289 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:35:44.348652 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-ecd8247a-f1e2-4a24-8d6a-c4388b968289 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:35:44.349128 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-ecd8247a-f1e2-4a24-8d6a-c4388b968289 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:35:44.358491 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ecd8247a-f1e2-4a24-8d6a-c4388b968289 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:44.358976 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ecd8247a-f1e2-4a24-8d6a-c4388b968289 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:44.359431 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ecd8247a-f1e2-4a24-8d6a-c4388b968289 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:44.360152 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ecd8247a-f1e2-4a24-8d6a-c4388b968289 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:44.360606 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ecd8247a-f1e2-4a24-8d6a-c4388b968289 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:44.361032 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ecd8247a-f1e2-4a24-8d6a-c4388b968289 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:44.379309 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-ecd8247a-f1e2-4a24-8d6a-c4388b968289 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Getting quotas for project 32245d85aee64f69865d98656133a539. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:35:44.384920 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-ecd8247a-f1e2-4a24-8d6a-c4388b968289 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Getting quotas for user fb76a89a8b8042edb7b6aaccb4f41ead and project 32245d85aee64f69865d98656133a539. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:35:44.418915 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4a5ed7d7-8d3f-4c97-8800-fb3b34b7cd2b tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:35:44.421050 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4a5ed7d7-8d3f-4c97-8800-fb3b34b7cd2b tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] [instance: e7093cc6-edd9-4c19-8911-aafa831f29e6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:35:44.429653 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a5ed7d7-8d3f-4c97-8800-fb3b34b7cd2b tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:44.430533 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a5ed7d7-8d3f-4c97-8800-fb3b34b7cd2b tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:44.431225 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a5ed7d7-8d3f-4c97-8800-fb3b34b7cd2b tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:44.431937 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a5ed7d7-8d3f-4c97-8800-fb3b34b7cd2b tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:44.432370 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a5ed7d7-8d3f-4c97-8800-fb3b34b7cd2b tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:44.432798 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a5ed7d7-8d3f-4c97-8800-fb3b34b7cd2b tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:44.450347 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ecd8247a-f1e2-4a24-8d6a-c4388b968289 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:35:44.452612 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ecd8247a-f1e2-4a24-8d6a-c4388b968289 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 26d39330-ca3c-4bb2-b93b-d503629aec4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3f3d5147-2a64-4c64-8438-23aabbc31f97',volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:35:44.603799 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4a5ed7d7-8d3f-4c97-8800-fb3b34b7cd2b tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8192fd503d654d36919dd083abf585b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf3503a6a724914af2ac13a4579a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:35:44.625485 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4a5ed7d7-8d3f-4c97-8800-fb3b34b7cd2b tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] 10.222.0.50 "GET /compute/v2.1/servers/e7093cc6-edd9-4c19-8911-aafa831f29e6" status: 200 len: 1513 microversion: 2.1 time: 0.212359 Aug 31 16:35:44.630731 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3209/6601] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:35:44 2022] GET /compute/v2.1/servers/e7093cc6-edd9-4c19-8911-aafa831f29e6 => generated 1513 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:35:44.661528 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ecd8247a-f1e2-4a24-8d6a-c4388b968289 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.904131 Aug 31 16:35:44.662673 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3393/6602] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:35:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 906 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:35:44.675411 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c0db4702-b6e5-4915-a7fc-cda47f6152dc tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:35:44.676309 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c0db4702-b6e5-4915-a7fc-cda47f6152dc tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 26d39330-ca3c-4bb2-b93b-d503629aec4a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:35:44.741831 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c0db4702-b6e5-4915-a7fc-cda47f6152dc tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:35:44.750892 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c0db4702-b6e5-4915-a7fc-cda47f6152dc tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/26d39330-ca3c-4bb2-b93b-d503629aec4a" status: 200 len: 1094 microversion: 2.1 time: 0.079446 Aug 31 16:35:44.751637 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3210/6603] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:35:44 2022] GET /compute/v2.1/servers/26d39330-ca3c-4bb2-b93b-d503629aec4a => generated 1094 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:35:45.653348 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fc21760d-6725-47f9-83fd-f60f1f142549 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:35:45.654109 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fc21760d-6725-47f9-83fd-f60f1f142549 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] [instance: e7093cc6-edd9-4c19-8911-aafa831f29e6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:35:45.673750 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fc21760d-6725-47f9-83fd-f60f1f142549 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:45.674292 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fc21760d-6725-47f9-83fd-f60f1f142549 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:45.674741 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fc21760d-6725-47f9-83fd-f60f1f142549 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:45.675459 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fc21760d-6725-47f9-83fd-f60f1f142549 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:45.675916 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fc21760d-6725-47f9-83fd-f60f1f142549 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:45.676352 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fc21760d-6725-47f9-83fd-f60f1f142549 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:45.751627 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-fc21760d-6725-47f9-83fd-f60f1f142549 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8192fd503d654d36919dd083abf585b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf3503a6a724914af2ac13a4579a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:35:45.760943 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fc21760d-6725-47f9-83fd-f60f1f142549 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] 10.222.0.50 "GET /compute/v2.1/servers/e7093cc6-edd9-4c19-8911-aafa831f29e6" status: 200 len: 1471 microversion: 2.1 time: 0.111661 Aug 31 16:35:45.761812 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3394/6604] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:35:45 2022] GET /compute/v2.1/servers/e7093cc6-edd9-4c19-8911-aafa831f29e6 => generated 1471 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:35:45.774359 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6ff3aaf0-c6bc-477b-b2e0-3e53a91ed0bf tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:35:45.774359 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6ff3aaf0-c6bc-477b-b2e0-3e53a91ed0bf tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 26d39330-ca3c-4bb2-b93b-d503629aec4a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:35:45.784670 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ff3aaf0-c6bc-477b-b2e0-3e53a91ed0bf tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:45.785471 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ff3aaf0-c6bc-477b-b2e0-3e53a91ed0bf tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:45.785913 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ff3aaf0-c6bc-477b-b2e0-3e53a91ed0bf tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:45.786660 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ff3aaf0-c6bc-477b-b2e0-3e53a91ed0bf tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:45.787113 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ff3aaf0-c6bc-477b-b2e0-3e53a91ed0bf tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:45.787690 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ff3aaf0-c6bc-477b-b2e0-3e53a91ed0bf tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:45.805773 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-c734153c-c10e-4c97-9815-6e1ff31852d4 req-6f753bb2-593c-4caa-a366-2b7d2f0851f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7093cc6-edd9-4c19-8911-aafa831f29e6", "name": "network-vif-deleted", "tag": "047c5e6e-618a-45b3-bb99-ab1087e8dad8"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:35:45.828147 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-c734153c-c10e-4c97-9815-6e1ff31852d4 req-6f753bb2-593c-4caa-a366-2b7d2f0851f2 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:45.828664 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-c734153c-c10e-4c97-9815-6e1ff31852d4 req-6f753bb2-593c-4caa-a366-2b7d2f0851f2 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:45.829121 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-c734153c-c10e-4c97-9815-6e1ff31852d4 req-6f753bb2-593c-4caa-a366-2b7d2f0851f2 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:45.853127 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-c734153c-c10e-4c97-9815-6e1ff31852d4 req-6f753bb2-593c-4caa-a366-2b7d2f0851f2 service nova] Creating event network-vif-deleted:047c5e6e-618a-45b3-bb99-ab1087e8dad8 for instance e7093cc6-edd9-4c19-8911-aafa831f29e6 on n-h2-833090-16 Aug 31 16:35:45.864278 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-c734153c-c10e-4c97-9815-6e1ff31852d4 req-6f753bb2-593c-4caa-a366-2b7d2f0851f2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061503 Aug 31 16:35:45.879942 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3395/6605] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:35:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:35:45.904260 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6ff3aaf0-c6bc-477b-b2e0-3e53a91ed0bf tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:35:45.913341 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6ff3aaf0-c6bc-477b-b2e0-3e53a91ed0bf tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/26d39330-ca3c-4bb2-b93b-d503629aec4a" status: 200 len: 1192 microversion: 2.1 time: 0.145061 Aug 31 16:35:45.913945 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3211/6606] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:35:45 2022] GET /compute/v2.1/servers/26d39330-ca3c-4bb2-b93b-d503629aec4a => generated 1192 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:35:46.783970 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ab3d5bf3-47af-4f78-a2c2-23167f80bc16 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:35:46.784658 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ab3d5bf3-47af-4f78-a2c2-23167f80bc16 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] [instance: e7093cc6-edd9-4c19-8911-aafa831f29e6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:35:46.796484 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ab3d5bf3-47af-4f78-a2c2-23167f80bc16 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:46.797587 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ab3d5bf3-47af-4f78-a2c2-23167f80bc16 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:46.798386 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ab3d5bf3-47af-4f78-a2c2-23167f80bc16 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:46.799737 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ab3d5bf3-47af-4f78-a2c2-23167f80bc16 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:46.800569 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ab3d5bf3-47af-4f78-a2c2-23167f80bc16 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:46.801709 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ab3d5bf3-47af-4f78-a2c2-23167f80bc16 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:46.823890 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-ab3d5bf3-47af-4f78-a2c2-23167f80bc16 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] HTTP exception thrown: Instance e7093cc6-edd9-4c19-8911-aafa831f29e6 could not be found. Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ab3d5bf3-47af-4f78-a2c2-23167f80bc16 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Request method failure captured: Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/e7093cc6-edd9-4c19-8911-aafa831f29e6 HTTP/1.1 Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD41iEyT6l1fOpxkmvyixnNWBlUBU_HV68fmJ1WXqakCOchJbLYMWkGBPkc2rJ2_0Ume-aRbb7znfwWoR51ENBVkty18dMSVW8D04PZhxJpXM79ihag0i9_NGDUkmgI0jjJmtE7aYXpq5bveqhB3SvWS_gZHen1hiGdpaHXb0ka-bmLY Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 6cf3503a6a724914af2ac13a4579a4fe Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1528458441 Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6cf3503a6a724914af2ac13a4579a4fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6cf3503a6a724914af2ac13a4579a4fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6cf3503a6a724914af2ac13a4579a4fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6cf3503a6a724914af2ac13a4579a4fe", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-VolumesSnapshotTestJSON-1528458441 Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 6cf3503a6a724914af2ac13a4579a4fe Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1528458441 Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-VolumesSnapshotTestJSON-1528458441-project Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 8192fd503d654d36919dd083abf585b0 Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-VolumesSnapshotTestJSON-1528458441-project Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance e7093cc6-edd9-4c19-8911-aafa831f29e6 could not be found. Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'e7093cc6-edd9-4c19-8911-aafa831f29e6'} Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7093cc6-edd9-4c19-8911-aafa831f29e6 could not be found. Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7093cc6-edd9-4c19-8911-aafa831f29e6 could not be found. Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:35:46.826179 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:35:46.833171 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:35:46.833171 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:35:46.833171 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:35:46.833171 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:35:46.833171 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:35:46.833171 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7093cc6-edd9-4c19-8911-aafa831f29e6 could not be found. Aug 31 16:35:46.833171 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:35:46.835310 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ab3d5bf3-47af-4f78-a2c2-23167f80bc16 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Returning 404 to user: Instance e7093cc6-edd9-4c19-8911-aafa831f29e6 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:35:46.836723 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ab3d5bf3-47af-4f78-a2c2-23167f80bc16 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] 10.222.0.50 "GET /compute/v2.1/servers/e7093cc6-edd9-4c19-8911-aafa831f29e6" status: 404 len: 111 microversion: 2.1 time: 0.057971 Aug 31 16:35:46.838158 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3396/6607] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:35:46 2022] GET /compute/v2.1/servers/e7093cc6-edd9-4c19-8911-aafa831f29e6 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:35:46.937818 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a997063d-9a72-46cc-a722-dc9dda1de6f4 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:35:46.938509 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a997063d-9a72-46cc-a722-dc9dda1de6f4 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 26d39330-ca3c-4bb2-b93b-d503629aec4a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:35:46.948600 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a997063d-9a72-46cc-a722-dc9dda1de6f4 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:46.949137 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a997063d-9a72-46cc-a722-dc9dda1de6f4 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:46.949581 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a997063d-9a72-46cc-a722-dc9dda1de6f4 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:46.950319 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a997063d-9a72-46cc-a722-dc9dda1de6f4 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:46.950766 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a997063d-9a72-46cc-a722-dc9dda1de6f4 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:46.951183 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a997063d-9a72-46cc-a722-dc9dda1de6f4 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:47.273741 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a997063d-9a72-46cc-a722-dc9dda1de6f4 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:35:47.284933 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a997063d-9a72-46cc-a722-dc9dda1de6f4 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/26d39330-ca3c-4bb2-b93b-d503629aec4a" status: 200 len: 1278 microversion: 2.1 time: 0.350941 Aug 31 16:35:47.285684 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3212/6608] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:35:46 2022] GET /compute/v2.1/servers/26d39330-ca3c-4bb2-b93b-d503629aec4a => generated 1278 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:35:48.156026 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-0b437c15-69a9-45b5-bdfe-59b515ac1def req-8cf5222b-0ffa-4377-9d18-ae9f957d62b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26d39330-ca3c-4bb2-b93b-d503629aec4a", "tag": "8d60fe73-b416-4974-8737-17121beced88"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:35:48.173413 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-0b437c15-69a9-45b5-bdfe-59b515ac1def req-8cf5222b-0ffa-4377-9d18-ae9f957d62b3 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:48.174370 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-0b437c15-69a9-45b5-bdfe-59b515ac1def req-8cf5222b-0ffa-4377-9d18-ae9f957d62b3 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:48.175071 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-0b437c15-69a9-45b5-bdfe-59b515ac1def req-8cf5222b-0ffa-4377-9d18-ae9f957d62b3 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:48.191044 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-0b437c15-69a9-45b5-bdfe-59b515ac1def req-8cf5222b-0ffa-4377-9d18-ae9f957d62b3 service nova] Creating event network-changed:8d60fe73-b416-4974-8737-17121beced88 for instance 26d39330-ca3c-4bb2-b93b-d503629aec4a on n-h2-833090-16 Aug 31 16:35:48.200900 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-0b437c15-69a9-45b5-bdfe-59b515ac1def req-8cf5222b-0ffa-4377-9d18-ae9f957d62b3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049521 Aug 31 16:35:48.203380 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3397/6609] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:35:48.309906 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ed290e65-945c-46ed-a269-a37f9fd635fe tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:35:48.311300 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ed290e65-945c-46ed-a269-a37f9fd635fe tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 26d39330-ca3c-4bb2-b93b-d503629aec4a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:35:48.326539 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed290e65-945c-46ed-a269-a37f9fd635fe tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:48.327869 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed290e65-945c-46ed-a269-a37f9fd635fe tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:48.329640 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed290e65-945c-46ed-a269-a37f9fd635fe tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:48.330662 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed290e65-945c-46ed-a269-a37f9fd635fe tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:48.332659 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed290e65-945c-46ed-a269-a37f9fd635fe tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:48.333131 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed290e65-945c-46ed-a269-a37f9fd635fe tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:48.584108 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ed290e65-945c-46ed-a269-a37f9fd635fe tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:35:48.595693 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ed290e65-945c-46ed-a269-a37f9fd635fe tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/26d39330-ca3c-4bb2-b93b-d503629aec4a" status: 200 len: 1278 microversion: 2.1 time: 0.290186 Aug 31 16:35:48.597249 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3213/6610] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:35:48 2022] GET /compute/v2.1/servers/26d39330-ca3c-4bb2-b93b-d503629aec4a => generated 1278 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:35:49.651914 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ece44790-0e23-434b-8cac-04161d33a0a8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:35:49.653671 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ece44790-0e23-434b-8cac-04161d33a0a8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 26d39330-ca3c-4bb2-b93b-d503629aec4a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:35:49.690873 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ece44790-0e23-434b-8cac-04161d33a0a8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:49.691329 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ece44790-0e23-434b-8cac-04161d33a0a8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:49.691790 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ece44790-0e23-434b-8cac-04161d33a0a8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:49.692534 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ece44790-0e23-434b-8cac-04161d33a0a8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:49.699442 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ece44790-0e23-434b-8cac-04161d33a0a8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:49.700730 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ece44790-0e23-434b-8cac-04161d33a0a8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:49.906974 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ece44790-0e23-434b-8cac-04161d33a0a8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:35:49.918888 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ece44790-0e23-434b-8cac-04161d33a0a8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/26d39330-ca3c-4bb2-b93b-d503629aec4a" status: 200 len: 1278 microversion: 2.1 time: 0.299892 Aug 31 16:35:49.919735 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3398/6611] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:35:49 2022] GET /compute/v2.1/servers/26d39330-ca3c-4bb2-b93b-d503629aec4a => generated 1278 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:35:50.943896 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ac7ec2fc-38a7-456b-90bd-dd7da77267f8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:35:50.945214 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ac7ec2fc-38a7-456b-90bd-dd7da77267f8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 26d39330-ca3c-4bb2-b93b-d503629aec4a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:35:50.955365 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ac7ec2fc-38a7-456b-90bd-dd7da77267f8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:50.956396 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ac7ec2fc-38a7-456b-90bd-dd7da77267f8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:50.957115 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ac7ec2fc-38a7-456b-90bd-dd7da77267f8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:50.958169 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ac7ec2fc-38a7-456b-90bd-dd7da77267f8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:50.959072 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ac7ec2fc-38a7-456b-90bd-dd7da77267f8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:50.960136 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ac7ec2fc-38a7-456b-90bd-dd7da77267f8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:51.151165 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ac7ec2fc-38a7-456b-90bd-dd7da77267f8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:35:51.162614 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ac7ec2fc-38a7-456b-90bd-dd7da77267f8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/26d39330-ca3c-4bb2-b93b-d503629aec4a" status: 200 len: 1278 microversion: 2.1 time: 0.225013 Aug 31 16:35:51.180025 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3214/6612] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:35:50 2022] GET /compute/v2.1/servers/26d39330-ca3c-4bb2-b93b-d503629aec4a => generated 1278 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:35:52.191079 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-33c51d27-ae4b-4833-b1f5-945bc82c8ad1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:35:52.192497 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-33c51d27-ae4b-4833-b1f5-945bc82c8ad1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 26d39330-ca3c-4bb2-b93b-d503629aec4a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:35:52.200885 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33c51d27-ae4b-4833-b1f5-945bc82c8ad1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:52.201423 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33c51d27-ae4b-4833-b1f5-945bc82c8ad1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:52.201826 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33c51d27-ae4b-4833-b1f5-945bc82c8ad1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:52.202722 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33c51d27-ae4b-4833-b1f5-945bc82c8ad1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:52.203183 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33c51d27-ae4b-4833-b1f5-945bc82c8ad1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:52.203661 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33c51d27-ae4b-4833-b1f5-945bc82c8ad1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:52.345866 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-33c51d27-ae4b-4833-b1f5-945bc82c8ad1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:35:52.354916 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-33c51d27-ae4b-4833-b1f5-945bc82c8ad1 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/26d39330-ca3c-4bb2-b93b-d503629aec4a" status: 200 len: 1278 microversion: 2.1 time: 0.167824 Aug 31 16:35:52.355485 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3399/6613] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:35:52 2022] GET /compute/v2.1/servers/26d39330-ca3c-4bb2-b93b-d503629aec4a => generated 1278 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:35:53.376127 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8e6d6ab1-cb66-4a3e-9960-628744946b6f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:35:53.377512 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8e6d6ab1-cb66-4a3e-9960-628744946b6f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 26d39330-ca3c-4bb2-b93b-d503629aec4a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:35:53.384890 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e6d6ab1-cb66-4a3e-9960-628744946b6f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:53.385378 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e6d6ab1-cb66-4a3e-9960-628744946b6f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:53.385812 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e6d6ab1-cb66-4a3e-9960-628744946b6f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:53.386544 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e6d6ab1-cb66-4a3e-9960-628744946b6f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:53.386996 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e6d6ab1-cb66-4a3e-9960-628744946b6f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:53.387552 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8e6d6ab1-cb66-4a3e-9960-628744946b6f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:53.544880 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8e6d6ab1-cb66-4a3e-9960-628744946b6f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:35:53.553165 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8e6d6ab1-cb66-4a3e-9960-628744946b6f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/26d39330-ca3c-4bb2-b93b-d503629aec4a" status: 200 len: 1266 microversion: 2.1 time: 0.181038 Aug 31 16:35:53.553998 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3215/6614] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:35:53 2022] GET /compute/v2.1/servers/26d39330-ca3c-4bb2-b93b-d503629aec4a => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:35:54.575065 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e4d2a7fa-f26d-4a44-815b-7ea496811b52 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:35:54.575720 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e4d2a7fa-f26d-4a44-815b-7ea496811b52 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 26d39330-ca3c-4bb2-b93b-d503629aec4a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:35:54.578668 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:35:54.579353 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=6 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:35:54.586040 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4d2a7fa-f26d-4a44-815b-7ea496811b52 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:54.586621 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4d2a7fa-f26d-4a44-815b-7ea496811b52 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:54.587159 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4d2a7fa-f26d-4a44-815b-7ea496811b52 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:54.587862 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4d2a7fa-f26d-4a44-815b-7ea496811b52 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:54.588322 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4d2a7fa-f26d-4a44-815b-7ea496811b52 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:54.588829 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4d2a7fa-f26d-4a44-815b-7ea496811b52 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:54.730436 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e4d2a7fa-f26d-4a44-815b-7ea496811b52 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:35:54.738808 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e4d2a7fa-f26d-4a44-815b-7ea496811b52 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/26d39330-ca3c-4bb2-b93b-d503629aec4a" status: 200 len: 1266 microversion: 2.1 time: 0.167717 Aug 31 16:35:54.739390 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3400/6615] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:35:54 2022] GET /compute/v2.1/servers/26d39330-ca3c-4bb2-b93b-d503629aec4a => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:35:54.972768 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f05d48f9-8af2-4368-976a-e9c3fd28e192 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-65044168", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "89e6a1f1-20ef-4f9a-a88a-ca9634461641"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:35:54.982619 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:35:55.033334 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-f05d48f9-8af2-4368-976a-e9c3fd28e192 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] validate_networks() for [('89e6a1f1-20ef-4f9a-a88a-ca9634461641', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:35:55.414859 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-f05d48f9-8af2-4368-976a-e9c3fd28e192 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:35:55.415384 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-f05d48f9-8af2-4368-976a-e9c3fd28e192 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:35:55.415826 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-f05d48f9-8af2-4368-976a-e9c3fd28e192 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:35:55.416228 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-f05d48f9-8af2-4368-976a-e9c3fd28e192 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:35:55.416667 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-f05d48f9-8af2-4368-976a-e9c3fd28e192 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:35:55.426950 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f05d48f9-8af2-4368-976a-e9c3fd28e192 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:55.427429 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f05d48f9-8af2-4368-976a-e9c3fd28e192 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:55.427860 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f05d48f9-8af2-4368-976a-e9c3fd28e192 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:55.428578 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f05d48f9-8af2-4368-976a-e9c3fd28e192 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:55.429221 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f05d48f9-8af2-4368-976a-e9c3fd28e192 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:55.429971 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f05d48f9-8af2-4368-976a-e9c3fd28e192 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:55.447583 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-f05d48f9-8af2-4368-976a-e9c3fd28e192 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Getting quotas for project 6cf3503a6a724914af2ac13a4579a4fe. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:35:55.453051 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-f05d48f9-8af2-4368-976a-e9c3fd28e192 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Getting quotas for user 8192fd503d654d36919dd083abf585b0 and project 6cf3503a6a724914af2ac13a4579a4fe. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:35:55.466910 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f05d48f9-8af2-4368-976a-e9c3fd28e192 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:35:55.469418 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f05d48f9-8af2-4368-976a-e9c3fd28e192 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] [instance: 5b93b9eb-1e59-4f27-9ce0-d1425fe59bda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:35:55.521111 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f05d48f9-8af2-4368-976a-e9c3fd28e192 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.552225 Aug 31 16:35:55.522225 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3216/6616] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:35:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 554 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:35:55.534516 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4e083ea3-b6a7-431f-85c7-36ffe556252c tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:35:55.535471 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4e083ea3-b6a7-431f-85c7-36ffe556252c tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] [instance: 5b93b9eb-1e59-4f27-9ce0-d1425fe59bda] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:35:55.629552 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4e083ea3-b6a7-431f-85c7-36ffe556252c tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8192fd503d654d36919dd083abf585b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf3503a6a724914af2ac13a4579a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:35:55.638184 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4e083ea3-b6a7-431f-85c7-36ffe556252c tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] 10.222.0.50 "GET /compute/v2.1/servers/5b93b9eb-1e59-4f27-9ce0-d1425fe59bda" status: 200 len: 1217 microversion: 2.1 time: 0.107974 Aug 31 16:35:55.638974 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3401/6617] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:35:55 2022] GET /compute/v2.1/servers/5b93b9eb-1e59-4f27-9ce0-d1425fe59bda => generated 1217 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:35:55.760209 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7f3d85d2-7261-4570-b678-6499d2eda74f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:35:55.760793 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7f3d85d2-7261-4570-b678-6499d2eda74f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 26d39330-ca3c-4bb2-b93b-d503629aec4a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:35:55.767388 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f3d85d2-7261-4570-b678-6499d2eda74f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:55.767858 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f3d85d2-7261-4570-b678-6499d2eda74f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:55.768282 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f3d85d2-7261-4570-b678-6499d2eda74f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:55.768970 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f3d85d2-7261-4570-b678-6499d2eda74f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:55.769408 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f3d85d2-7261-4570-b678-6499d2eda74f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:55.769820 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f3d85d2-7261-4570-b678-6499d2eda74f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:55.949816 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7f3d85d2-7261-4570-b678-6499d2eda74f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:35:55.959357 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7f3d85d2-7261-4570-b678-6499d2eda74f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/26d39330-ca3c-4bb2-b93b-d503629aec4a" status: 200 len: 1266 microversion: 2.1 time: 0.203341 Aug 31 16:35:55.959990 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3217/6618] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:35:55 2022] GET /compute/v2.1/servers/26d39330-ca3c-4bb2-b93b-d503629aec4a => generated 1266 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:35:56.662968 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-58fdb108-e7ae-4f5d-b715-d6ac2df94f91 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:35:56.663686 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-58fdb108-e7ae-4f5d-b715-d6ac2df94f91 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] [instance: 5b93b9eb-1e59-4f27-9ce0-d1425fe59bda] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:35:56.673585 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-58fdb108-e7ae-4f5d-b715-d6ac2df94f91 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:56.674523 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-58fdb108-e7ae-4f5d-b715-d6ac2df94f91 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:56.675179 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-58fdb108-e7ae-4f5d-b715-d6ac2df94f91 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:56.676286 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-58fdb108-e7ae-4f5d-b715-d6ac2df94f91 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:56.676971 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-58fdb108-e7ae-4f5d-b715-d6ac2df94f91 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:56.677467 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-58fdb108-e7ae-4f5d-b715-d6ac2df94f91 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:56.799654 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-58fdb108-e7ae-4f5d-b715-d6ac2df94f91 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8192fd503d654d36919dd083abf585b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf3503a6a724914af2ac13a4579a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:35:56.812931 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-58fdb108-e7ae-4f5d-b715-d6ac2df94f91 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] 10.222.0.50 "GET /compute/v2.1/servers/5b93b9eb-1e59-4f27-9ce0-d1425fe59bda" status: 200 len: 1277 microversion: 2.1 time: 0.155544 Aug 31 16:35:56.814034 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3402/6619] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:35:56 2022] GET /compute/v2.1/servers/5b93b9eb-1e59-4f27-9ce0-d1425fe59bda => generated 1277 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:35:56.981074 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-915b3291-7284-485a-ac4a-e1bf7c196560 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:35:56.981992 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-915b3291-7284-485a-ac4a-e1bf7c196560 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 26d39330-ca3c-4bb2-b93b-d503629aec4a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:35:56.989020 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-915b3291-7284-485a-ac4a-e1bf7c196560 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:56.989591 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-915b3291-7284-485a-ac4a-e1bf7c196560 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:56.990026 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-915b3291-7284-485a-ac4a-e1bf7c196560 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:56.990755 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-915b3291-7284-485a-ac4a-e1bf7c196560 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:56.991231 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-915b3291-7284-485a-ac4a-e1bf7c196560 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:56.991656 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-915b3291-7284-485a-ac4a-e1bf7c196560 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:57.197993 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-915b3291-7284-485a-ac4a-e1bf7c196560 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:35:57.206340 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-915b3291-7284-485a-ac4a-e1bf7c196560 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/26d39330-ca3c-4bb2-b93b-d503629aec4a" status: 200 len: 1266 microversion: 2.1 time: 0.229729 Aug 31 16:35:57.206854 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3218/6620] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:35:56 2022] GET /compute/v2.1/servers/26d39330-ca3c-4bb2-b93b-d503629aec4a => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:35:57.835735 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0e8d979b-7b2f-49d1-a916-f183cc1b72cd tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:35:57.838416 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0e8d979b-7b2f-49d1-a916-f183cc1b72cd tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] [instance: 5b93b9eb-1e59-4f27-9ce0-d1425fe59bda] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:35:57.852603 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0e8d979b-7b2f-49d1-a916-f183cc1b72cd tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:57.853668 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0e8d979b-7b2f-49d1-a916-f183cc1b72cd tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:57.854597 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0e8d979b-7b2f-49d1-a916-f183cc1b72cd tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:57.855973 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0e8d979b-7b2f-49d1-a916-f183cc1b72cd tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:57.856965 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0e8d979b-7b2f-49d1-a916-f183cc1b72cd tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:57.857848 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0e8d979b-7b2f-49d1-a916-f183cc1b72cd tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:58.084386 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0e8d979b-7b2f-49d1-a916-f183cc1b72cd tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8192fd503d654d36919dd083abf585b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf3503a6a724914af2ac13a4579a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:35:58.096155 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0e8d979b-7b2f-49d1-a916-f183cc1b72cd tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] 10.222.0.50 "GET /compute/v2.1/servers/5b93b9eb-1e59-4f27-9ce0-d1425fe59bda" status: 200 len: 1317 microversion: 2.1 time: 0.264534 Aug 31 16:35:58.097144 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3403/6621] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:35:57 2022] GET /compute/v2.1/servers/5b93b9eb-1e59-4f27-9ce0-d1425fe59bda => generated 1317 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:35:58.228112 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-77f1dc5b-0a35-4e1b-bbc2-6aa9dbf3892c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:35:58.228716 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-77f1dc5b-0a35-4e1b-bbc2-6aa9dbf3892c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 26d39330-ca3c-4bb2-b93b-d503629aec4a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:35:58.235888 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-77f1dc5b-0a35-4e1b-bbc2-6aa9dbf3892c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:58.236633 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-77f1dc5b-0a35-4e1b-bbc2-6aa9dbf3892c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:58.237377 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-77f1dc5b-0a35-4e1b-bbc2-6aa9dbf3892c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:58.239421 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-77f1dc5b-0a35-4e1b-bbc2-6aa9dbf3892c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:58.239883 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-77f1dc5b-0a35-4e1b-bbc2-6aa9dbf3892c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:58.240311 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-77f1dc5b-0a35-4e1b-bbc2-6aa9dbf3892c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:58.387706 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-a7a29eb0-33a3-4f0e-a8d0-c6223295094d req-3afc7328-a60f-4801-9f90-b4399d1a52f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b93b9eb-1e59-4f27-9ce0-d1425fe59bda", "tag": "64893d48-e45c-44ad-95da-1d4408069ff6"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:35:58.408538 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-a7a29eb0-33a3-4f0e-a8d0-c6223295094d req-3afc7328-a60f-4801-9f90-b4399d1a52f9 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:58.409407 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-a7a29eb0-33a3-4f0e-a8d0-c6223295094d req-3afc7328-a60f-4801-9f90-b4399d1a52f9 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:58.410514 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-a7a29eb0-33a3-4f0e-a8d0-c6223295094d req-3afc7328-a60f-4801-9f90-b4399d1a52f9 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:58.429860 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-a7a29eb0-33a3-4f0e-a8d0-c6223295094d req-3afc7328-a60f-4801-9f90-b4399d1a52f9 service nova] Creating event network-changed:64893d48-e45c-44ad-95da-1d4408069ff6 for instance 5b93b9eb-1e59-4f27-9ce0-d1425fe59bda on n-h1-833090-16 Aug 31 16:35:58.440267 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-a7a29eb0-33a3-4f0e-a8d0-c6223295094d req-3afc7328-a60f-4801-9f90-b4399d1a52f9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056591 Aug 31 16:35:58.442595 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3404/6622] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:35:58.531320 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-77f1dc5b-0a35-4e1b-bbc2-6aa9dbf3892c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:35:58.548410 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-77f1dc5b-0a35-4e1b-bbc2-6aa9dbf3892c tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/26d39330-ca3c-4bb2-b93b-d503629aec4a" status: 200 len: 1266 microversion: 2.1 time: 0.324620 Aug 31 16:35:58.549016 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3219/6623] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:35:58 2022] GET /compute/v2.1/servers/26d39330-ca3c-4bb2-b93b-d503629aec4a => generated 1266 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:35:59.118604 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a274b217-30ff-414d-ac18-b5946e83a5cd tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:35:59.119324 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a274b217-30ff-414d-ac18-b5946e83a5cd tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] [instance: 5b93b9eb-1e59-4f27-9ce0-d1425fe59bda] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:35:59.127055 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a274b217-30ff-414d-ac18-b5946e83a5cd tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:59.127552 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a274b217-30ff-414d-ac18-b5946e83a5cd tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:59.128000 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a274b217-30ff-414d-ac18-b5946e83a5cd tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:59.128706 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a274b217-30ff-414d-ac18-b5946e83a5cd tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:59.129170 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a274b217-30ff-414d-ac18-b5946e83a5cd tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:59.129614 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a274b217-30ff-414d-ac18-b5946e83a5cd tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:59.271505 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a274b217-30ff-414d-ac18-b5946e83a5cd tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8192fd503d654d36919dd083abf585b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf3503a6a724914af2ac13a4579a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:35:59.279946 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a274b217-30ff-414d-ac18-b5946e83a5cd tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] 10.222.0.50 "GET /compute/v2.1/servers/5b93b9eb-1e59-4f27-9ce0-d1425fe59bda" status: 200 len: 1317 microversion: 2.1 time: 0.165794 Aug 31 16:35:59.280498 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3405/6624] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:35:59 2022] GET /compute/v2.1/servers/5b93b9eb-1e59-4f27-9ce0-d1425fe59bda => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:35:59.569282 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a2ee11f3-87bd-44c9-bfcf-c9af7b62f0f8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:35:59.570175 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a2ee11f3-87bd-44c9-bfcf-c9af7b62f0f8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 26d39330-ca3c-4bb2-b93b-d503629aec4a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:35:59.578114 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a2ee11f3-87bd-44c9-bfcf-c9af7b62f0f8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:59.578609 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a2ee11f3-87bd-44c9-bfcf-c9af7b62f0f8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:59.579042 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a2ee11f3-87bd-44c9-bfcf-c9af7b62f0f8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:59.579714 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a2ee11f3-87bd-44c9-bfcf-c9af7b62f0f8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:35:59.580192 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a2ee11f3-87bd-44c9-bfcf-c9af7b62f0f8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:35:59.580615 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a2ee11f3-87bd-44c9-bfcf-c9af7b62f0f8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:35:59.729892 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a2ee11f3-87bd-44c9-bfcf-c9af7b62f0f8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:35:59.739238 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a2ee11f3-87bd-44c9-bfcf-c9af7b62f0f8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/26d39330-ca3c-4bb2-b93b-d503629aec4a" status: 200 len: 1266 microversion: 2.1 time: 0.173908 Aug 31 16:35:59.739895 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3220/6625] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:35:59 2022] GET /compute/v2.1/servers/26d39330-ca3c-4bb2-b93b-d503629aec4a => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:36:00.301360 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e089fa96-236c-48f3-8b53-ce13f5b86c38 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:36:00.302057 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e089fa96-236c-48f3-8b53-ce13f5b86c38 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] [instance: 5b93b9eb-1e59-4f27-9ce0-d1425fe59bda] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:36:00.309678 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e089fa96-236c-48f3-8b53-ce13f5b86c38 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:00.310214 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e089fa96-236c-48f3-8b53-ce13f5b86c38 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:00.310671 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e089fa96-236c-48f3-8b53-ce13f5b86c38 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:00.311383 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e089fa96-236c-48f3-8b53-ce13f5b86c38 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:00.311856 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e089fa96-236c-48f3-8b53-ce13f5b86c38 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:00.312290 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e089fa96-236c-48f3-8b53-ce13f5b86c38 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:00.451981 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e089fa96-236c-48f3-8b53-ce13f5b86c38 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8192fd503d654d36919dd083abf585b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf3503a6a724914af2ac13a4579a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:36:00.460599 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e089fa96-236c-48f3-8b53-ce13f5b86c38 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] 10.222.0.50 "GET /compute/v2.1/servers/5b93b9eb-1e59-4f27-9ce0-d1425fe59bda" status: 200 len: 1317 microversion: 2.1 time: 0.163224 Aug 31 16:36:00.461185 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3406/6626] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:36:00 2022] GET /compute/v2.1/servers/5b93b9eb-1e59-4f27-9ce0-d1425fe59bda => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:36:00.761177 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-15a1d46b-73e3-48f7-b1b6-f8a23d923101 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:36:00.761759 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-15a1d46b-73e3-48f7-b1b6-f8a23d923101 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 26d39330-ca3c-4bb2-b93b-d503629aec4a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:36:00.769468 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-15a1d46b-73e3-48f7-b1b6-f8a23d923101 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:00.770033 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-15a1d46b-73e3-48f7-b1b6-f8a23d923101 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:00.770566 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-15a1d46b-73e3-48f7-b1b6-f8a23d923101 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:00.771331 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-15a1d46b-73e3-48f7-b1b6-f8a23d923101 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:00.771851 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-15a1d46b-73e3-48f7-b1b6-f8a23d923101 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:00.772378 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-15a1d46b-73e3-48f7-b1b6-f8a23d923101 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:00.913704 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-15a1d46b-73e3-48f7-b1b6-f8a23d923101 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:36:00.922044 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-15a1d46b-73e3-48f7-b1b6-f8a23d923101 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/26d39330-ca3c-4bb2-b93b-d503629aec4a" status: 200 len: 1266 microversion: 2.1 time: 0.165050 Aug 31 16:36:00.922662 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3221/6627] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:36:00 2022] GET /compute/v2.1/servers/26d39330-ca3c-4bb2-b93b-d503629aec4a => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:36:01.481663 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-74fc805d-b32d-4326-a543-2c9acc66e1f8 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:36:01.482337 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-74fc805d-b32d-4326-a543-2c9acc66e1f8 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] [instance: 5b93b9eb-1e59-4f27-9ce0-d1425fe59bda] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:36:01.490900 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-74fc805d-b32d-4326-a543-2c9acc66e1f8 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:01.491326 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-74fc805d-b32d-4326-a543-2c9acc66e1f8 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:01.491851 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-74fc805d-b32d-4326-a543-2c9acc66e1f8 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:01.492613 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-74fc805d-b32d-4326-a543-2c9acc66e1f8 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:01.493143 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-74fc805d-b32d-4326-a543-2c9acc66e1f8 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:01.493583 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-74fc805d-b32d-4326-a543-2c9acc66e1f8 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:01.654550 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-74fc805d-b32d-4326-a543-2c9acc66e1f8 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8192fd503d654d36919dd083abf585b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf3503a6a724914af2ac13a4579a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:36:01.665798 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-74fc805d-b32d-4326-a543-2c9acc66e1f8 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] 10.222.0.50 "GET /compute/v2.1/servers/5b93b9eb-1e59-4f27-9ce0-d1425fe59bda" status: 200 len: 1317 microversion: 2.1 time: 0.188297 Aug 31 16:36:01.666787 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3407/6628] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:36:01 2022] GET /compute/v2.1/servers/5b93b9eb-1e59-4f27-9ce0-d1425fe59bda => generated 1317 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:36:01.946713 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-597d11f2-0995-47ee-838c-38e8fe691e57 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:36:01.947970 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-597d11f2-0995-47ee-838c-38e8fe691e57 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 26d39330-ca3c-4bb2-b93b-d503629aec4a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:36:01.956247 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-597d11f2-0995-47ee-838c-38e8fe691e57 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:01.957177 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-597d11f2-0995-47ee-838c-38e8fe691e57 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:01.957177 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-597d11f2-0995-47ee-838c-38e8fe691e57 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:01.958860 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-597d11f2-0995-47ee-838c-38e8fe691e57 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:01.958860 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-597d11f2-0995-47ee-838c-38e8fe691e57 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:01.958860 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-597d11f2-0995-47ee-838c-38e8fe691e57 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:02.117345 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-597d11f2-0995-47ee-838c-38e8fe691e57 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:36:02.129700 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-597d11f2-0995-47ee-838c-38e8fe691e57 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/26d39330-ca3c-4bb2-b93b-d503629aec4a" status: 200 len: 1266 microversion: 2.1 time: 0.189503 Aug 31 16:36:02.130545 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3222/6629] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:36:01 2022] GET /compute/v2.1/servers/26d39330-ca3c-4bb2-b93b-d503629aec4a => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:36:02.690583 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9cd3346c-6412-45e5-8bca-223332c57627 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:36:02.691778 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9cd3346c-6412-45e5-8bca-223332c57627 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] [instance: 5b93b9eb-1e59-4f27-9ce0-d1425fe59bda] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:36:02.703767 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9cd3346c-6412-45e5-8bca-223332c57627 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:02.704433 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9cd3346c-6412-45e5-8bca-223332c57627 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:02.704924 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9cd3346c-6412-45e5-8bca-223332c57627 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:02.705666 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9cd3346c-6412-45e5-8bca-223332c57627 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:02.706130 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9cd3346c-6412-45e5-8bca-223332c57627 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:02.706602 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9cd3346c-6412-45e5-8bca-223332c57627 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:02.849283 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9cd3346c-6412-45e5-8bca-223332c57627 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8192fd503d654d36919dd083abf585b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf3503a6a724914af2ac13a4579a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:36:02.858825 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9cd3346c-6412-45e5-8bca-223332c57627 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] 10.222.0.50 "GET /compute/v2.1/servers/5b93b9eb-1e59-4f27-9ce0-d1425fe59bda" status: 200 len: 1317 microversion: 2.1 time: 0.174042 Aug 31 16:36:02.859780 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3408/6630] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:36:02 2022] GET /compute/v2.1/servers/5b93b9eb-1e59-4f27-9ce0-d1425fe59bda => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:36:03.153184 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1ef1b624-4b30-4461-97ca-3b5e901d0afc tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:36:03.153843 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1ef1b624-4b30-4461-97ca-3b5e901d0afc tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 26d39330-ca3c-4bb2-b93b-d503629aec4a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:36:03.161865 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ef1b624-4b30-4461-97ca-3b5e901d0afc tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:03.162386 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ef1b624-4b30-4461-97ca-3b5e901d0afc tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:03.162822 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ef1b624-4b30-4461-97ca-3b5e901d0afc tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:03.163823 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ef1b624-4b30-4461-97ca-3b5e901d0afc tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:03.164009 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ef1b624-4b30-4461-97ca-3b5e901d0afc tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:03.164362 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ef1b624-4b30-4461-97ca-3b5e901d0afc tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:03.365273 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1ef1b624-4b30-4461-97ca-3b5e901d0afc tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:36:03.374895 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1ef1b624-4b30-4461-97ca-3b5e901d0afc tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/26d39330-ca3c-4bb2-b93b-d503629aec4a" status: 200 len: 1266 microversion: 2.1 time: 0.225688 Aug 31 16:36:03.375583 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3223/6631] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:36:03 2022] GET /compute/v2.1/servers/26d39330-ca3c-4bb2-b93b-d503629aec4a => generated 1266 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:36:03.408122 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-48365cfb-3bbf-4530-8e6b-ef39c57c7caa req-295ac174-1283-40ef-8d48-6c3f17088559 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b93b9eb-1e59-4f27-9ce0-d1425fe59bda", "name": "network-vif-plugged", "status": "completed", "tag": "64893d48-e45c-44ad-95da-1d4408069ff6"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:36:03.418980 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-48365cfb-3bbf-4530-8e6b-ef39c57c7caa req-295ac174-1283-40ef-8d48-6c3f17088559 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:03.419552 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-48365cfb-3bbf-4530-8e6b-ef39c57c7caa req-295ac174-1283-40ef-8d48-6c3f17088559 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:03.420071 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-48365cfb-3bbf-4530-8e6b-ef39c57c7caa req-295ac174-1283-40ef-8d48-6c3f17088559 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:03.433858 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-48365cfb-3bbf-4530-8e6b-ef39c57c7caa req-295ac174-1283-40ef-8d48-6c3f17088559 service nova] Creating event network-vif-plugged:64893d48-e45c-44ad-95da-1d4408069ff6 for instance 5b93b9eb-1e59-4f27-9ce0-d1425fe59bda on n-h1-833090-16 Aug 31 16:36:03.439355 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-48365cfb-3bbf-4530-8e6b-ef39c57c7caa req-295ac174-1283-40ef-8d48-6c3f17088559 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035267 Aug 31 16:36:03.440332 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3409/6632] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:36:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:36:03.879919 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-19472f7f-d804-4ed9-af27-7f1dd39642bc tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:36:03.880537 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-19472f7f-d804-4ed9-af27-7f1dd39642bc tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] [instance: 5b93b9eb-1e59-4f27-9ce0-d1425fe59bda] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:36:03.891785 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19472f7f-d804-4ed9-af27-7f1dd39642bc tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:03.892324 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19472f7f-d804-4ed9-af27-7f1dd39642bc tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:03.892859 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19472f7f-d804-4ed9-af27-7f1dd39642bc tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:03.893882 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19472f7f-d804-4ed9-af27-7f1dd39642bc tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:03.894389 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19472f7f-d804-4ed9-af27-7f1dd39642bc tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:03.894841 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19472f7f-d804-4ed9-af27-7f1dd39642bc tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:03.920347 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:36:04.052737 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-19472f7f-d804-4ed9-af27-7f1dd39642bc tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8192fd503d654d36919dd083abf585b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf3503a6a724914af2ac13a4579a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:36:04.065618 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-19472f7f-d804-4ed9-af27-7f1dd39642bc tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] 10.222.0.50 "GET /compute/v2.1/servers/5b93b9eb-1e59-4f27-9ce0-d1425fe59bda" status: 200 len: 1317 microversion: 2.1 time: 0.189389 Aug 31 16:36:04.066360 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3224/6633] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:36:03 2022] GET /compute/v2.1/servers/5b93b9eb-1e59-4f27-9ce0-d1425fe59bda => generated 1317 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:36:04.399459 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-517efdc6-822e-4f9d-88d4-a92d93db6ef9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:36:04.400421 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-517efdc6-822e-4f9d-88d4-a92d93db6ef9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 26d39330-ca3c-4bb2-b93b-d503629aec4a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:36:04.407709 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-517efdc6-822e-4f9d-88d4-a92d93db6ef9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:04.408221 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-517efdc6-822e-4f9d-88d4-a92d93db6ef9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:04.408673 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-517efdc6-822e-4f9d-88d4-a92d93db6ef9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:04.409462 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-517efdc6-822e-4f9d-88d4-a92d93db6ef9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:04.410078 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-517efdc6-822e-4f9d-88d4-a92d93db6ef9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:04.410541 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-517efdc6-822e-4f9d-88d4-a92d93db6ef9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:04.561952 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-517efdc6-822e-4f9d-88d4-a92d93db6ef9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:36:04.571701 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-517efdc6-822e-4f9d-88d4-a92d93db6ef9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/26d39330-ca3c-4bb2-b93b-d503629aec4a" status: 200 len: 1266 microversion: 2.1 time: 0.178486 Aug 31 16:36:04.572746 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3410/6634] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:36:04 2022] GET /compute/v2.1/servers/26d39330-ca3c-4bb2-b93b-d503629aec4a => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:36:05.087794 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-573c7974-fcf4-40c5-a963-9c39493a379c tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:36:05.088373 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-573c7974-fcf4-40c5-a963-9c39493a379c tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] [instance: 5b93b9eb-1e59-4f27-9ce0-d1425fe59bda] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:36:05.097477 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-573c7974-fcf4-40c5-a963-9c39493a379c tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:05.097943 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-573c7974-fcf4-40c5-a963-9c39493a379c tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:05.098420 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-573c7974-fcf4-40c5-a963-9c39493a379c tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:05.099120 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-573c7974-fcf4-40c5-a963-9c39493a379c tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:05.099571 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-573c7974-fcf4-40c5-a963-9c39493a379c tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:05.100012 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-573c7974-fcf4-40c5-a963-9c39493a379c tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:05.240517 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-573c7974-fcf4-40c5-a963-9c39493a379c tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8192fd503d654d36919dd083abf585b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf3503a6a724914af2ac13a4579a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:36:05.249520 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-573c7974-fcf4-40c5-a963-9c39493a379c tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] 10.222.0.50 "GET /compute/v2.1/servers/5b93b9eb-1e59-4f27-9ce0-d1425fe59bda" status: 200 len: 1505 microversion: 2.1 time: 0.166096 Aug 31 16:36:05.250149 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3225/6635] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:36:05 2022] GET /compute/v2.1/servers/5b93b9eb-1e59-4f27-9ce0-d1425fe59bda => generated 1505 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:36:05.271603 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d15c5888-1a23-494a-b772-f2e2a4275d8c tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "60bf06aa-7fa4-4f58-a092-3353d3841daf", "device": "/dev/sdb"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:36:05.274352 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d15c5888-1a23-494a-b772-f2e2a4275d8c tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] [instance: 5b93b9eb-1e59-4f27-9ce0-d1425fe59bda] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:36:05.281570 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d15c5888-1a23-494a-b772-f2e2a4275d8c tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:05.282190 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d15c5888-1a23-494a-b772-f2e2a4275d8c tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:05.282618 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d15c5888-1a23-494a-b772-f2e2a4275d8c tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:05.283433 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d15c5888-1a23-494a-b772-f2e2a4275d8c tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:05.284025 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d15c5888-1a23-494a-b772-f2e2a4275d8c tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:05.284541 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d15c5888-1a23-494a-b772-f2e2a4275d8c tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:05.506249 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:36:05.510013 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-d86c069d-1524-4645-8b01-0b4432705d38 req-73f9f9c3-e82a-4310-86fd-32d22eceb15a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26d39330-ca3c-4bb2-b93b-d503629aec4a", "name": "network-vif-plugged", "status": "completed", "tag": "8d60fe73-b416-4974-8737-17121beced88"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:36:05.510013 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:36:05.510013 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:36:05.510013 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d86c069d-1524-4645-8b01-0b4432705d38 req-73f9f9c3-e82a-4310-86fd-32d22eceb15a service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:05.510013 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d86c069d-1524-4645-8b01-0b4432705d38 req-73f9f9c3-e82a-4310-86fd-32d22eceb15a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:05.510013 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d86c069d-1524-4645-8b01-0b4432705d38 req-73f9f9c3-e82a-4310-86fd-32d22eceb15a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:05.510013 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-d86c069d-1524-4645-8b01-0b4432705d38 req-73f9f9c3-e82a-4310-86fd-32d22eceb15a service nova] Creating event network-vif-plugged:8d60fe73-b416-4974-8737-17121beced88 for instance 26d39330-ca3c-4bb2-b93b-d503629aec4a on n-h2-833090-16 Aug 31 16:36:05.510013 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-d86c069d-1524-4645-8b01-0b4432705d38 req-73f9f9c3-e82a-4310-86fd-32d22eceb15a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040727 Aug 31 16:36:05.510013 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3226/6636] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:36:05.595659 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-181b4275-9523-4614-b139-f592c9bafaf7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:36:05.596383 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-181b4275-9523-4614-b139-f592c9bafaf7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 26d39330-ca3c-4bb2-b93b-d503629aec4a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:36:05.607615 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-181b4275-9523-4614-b139-f592c9bafaf7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:05.607615 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-181b4275-9523-4614-b139-f592c9bafaf7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:05.607615 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-181b4275-9523-4614-b139-f592c9bafaf7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:05.607615 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-181b4275-9523-4614-b139-f592c9bafaf7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:05.607615 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-181b4275-9523-4614-b139-f592c9bafaf7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:05.607615 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-181b4275-9523-4614-b139-f592c9bafaf7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:05.609745 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d15c5888-1a23-494a-b772-f2e2a4275d8c tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] 10.222.0.50 "POST /compute/v2.1/servers/5b93b9eb-1e59-4f27-9ce0-d1425fe59bda/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.342203 Aug 31 16:36:05.610590 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3411/6637] 10.222.0.50 () {60 vars in 1323 bytes} [Wed Aug 31 16:36:05 2022] POST /compute/v2.1/servers/5b93b9eb-1e59-4f27-9ce0-d1425fe59bda/os-volume_attachments => generated 194 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:36:05.807934 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-181b4275-9523-4614-b139-f592c9bafaf7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:36:05.817716 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-181b4275-9523-4614-b139-f592c9bafaf7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/26d39330-ca3c-4bb2-b93b-d503629aec4a" status: 200 len: 1266 microversion: 2.1 time: 0.227373 Aug 31 16:36:05.818361 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3227/6638] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:36:05 2022] GET /compute/v2.1/servers/26d39330-ca3c-4bb2-b93b-d503629aec4a => generated 1266 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:36:06.836386 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:36:06.842330 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-aa58627a-a051-4d7f-ba81-ae8f9ff6b58d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:36:06.843145 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-aa58627a-a051-4d7f-ba81-ae8f9ff6b58d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 26d39330-ca3c-4bb2-b93b-d503629aec4a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:36:06.853670 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aa58627a-a051-4d7f-ba81-ae8f9ff6b58d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:06.854898 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aa58627a-a051-4d7f-ba81-ae8f9ff6b58d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:06.855369 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aa58627a-a051-4d7f-ba81-ae8f9ff6b58d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:06.856333 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aa58627a-a051-4d7f-ba81-ae8f9ff6b58d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:06.856795 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aa58627a-a051-4d7f-ba81-ae8f9ff6b58d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:06.857229 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aa58627a-a051-4d7f-ba81-ae8f9ff6b58d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:07.029956 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-aa58627a-a051-4d7f-ba81-ae8f9ff6b58d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:36:07.038190 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-aa58627a-a051-4d7f-ba81-ae8f9ff6b58d tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/26d39330-ca3c-4bb2-b93b-d503629aec4a" status: 200 len: 1266 microversion: 2.1 time: 0.202914 Aug 31 16:36:07.038904 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3412/6639] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:36:06 2022] GET /compute/v2.1/servers/26d39330-ca3c-4bb2-b93b-d503629aec4a => generated 1266 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:36:08.060877 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a9fe6e73-94a7-4cbb-ac60-e2c47890b9d7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:36:08.061821 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a9fe6e73-94a7-4cbb-ac60-e2c47890b9d7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 26d39330-ca3c-4bb2-b93b-d503629aec4a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:36:08.066045 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:36:08.071398 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9fe6e73-94a7-4cbb-ac60-e2c47890b9d7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:08.071398 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9fe6e73-94a7-4cbb-ac60-e2c47890b9d7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:08.071706 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9fe6e73-94a7-4cbb-ac60-e2c47890b9d7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:08.072470 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9fe6e73-94a7-4cbb-ac60-e2c47890b9d7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:08.072929 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9fe6e73-94a7-4cbb-ac60-e2c47890b9d7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:08.073510 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9fe6e73-94a7-4cbb-ac60-e2c47890b9d7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:08.256142 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a9fe6e73-94a7-4cbb-ac60-e2c47890b9d7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:36:08.269246 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a9fe6e73-94a7-4cbb-ac60-e2c47890b9d7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/26d39330-ca3c-4bb2-b93b-d503629aec4a" status: 200 len: 1453 microversion: 2.1 time: 0.211847 Aug 31 16:36:08.270372 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3228/6640] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:36:08 2022] GET /compute/v2.1/servers/26d39330-ca3c-4bb2-b93b-d503629aec4a => generated 1453 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:36:08.292499 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3964d4e8-4540-4cd9-8939-4a98bbae1284 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:36:08.294785 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3964d4e8-4540-4cd9-8939-4a98bbae1284 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 26d39330-ca3c-4bb2-b93b-d503629aec4a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:36:08.305892 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3964d4e8-4540-4cd9-8939-4a98bbae1284 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:08.306433 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3964d4e8-4540-4cd9-8939-4a98bbae1284 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:08.306871 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3964d4e8-4540-4cd9-8939-4a98bbae1284 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:08.307665 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3964d4e8-4540-4cd9-8939-4a98bbae1284 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:08.308136 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3964d4e8-4540-4cd9-8939-4a98bbae1284 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:08.308565 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3964d4e8-4540-4cd9-8939-4a98bbae1284 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:08.485472 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3964d4e8-4540-4cd9-8939-4a98bbae1284 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:36:08.497295 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3964d4e8-4540-4cd9-8939-4a98bbae1284 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/26d39330-ca3c-4bb2-b93b-d503629aec4a" status: 200 len: 1453 microversion: 2.1 time: 0.209354 Aug 31 16:36:08.498018 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3413/6641] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:36:08 2022] GET /compute/v2.1/servers/26d39330-ca3c-4bb2-b93b-d503629aec4a => generated 1453 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:36:10.888047 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-fec53c70-14d5-4779-b0fe-2d034f5b1fa2 req-30bc2ff1-ae2c-48ee-8a12-7e212327db64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26d39330-ca3c-4bb2-b93b-d503629aec4a", "tag": "8d60fe73-b416-4974-8737-17121beced88"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:36:10.911127 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-fec53c70-14d5-4779-b0fe-2d034f5b1fa2 req-30bc2ff1-ae2c-48ee-8a12-7e212327db64 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:10.912042 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-fec53c70-14d5-4779-b0fe-2d034f5b1fa2 req-30bc2ff1-ae2c-48ee-8a12-7e212327db64 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:10.912291 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-fec53c70-14d5-4779-b0fe-2d034f5b1fa2 req-30bc2ff1-ae2c-48ee-8a12-7e212327db64 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:10.937061 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-fec53c70-14d5-4779-b0fe-2d034f5b1fa2 req-30bc2ff1-ae2c-48ee-8a12-7e212327db64 service nova] Creating event network-changed:8d60fe73-b416-4974-8737-17121beced88 for instance 26d39330-ca3c-4bb2-b93b-d503629aec4a on n-h2-833090-16 Aug 31 16:36:10.944063 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-fec53c70-14d5-4779-b0fe-2d034f5b1fa2 req-30bc2ff1-ae2c-48ee-8a12-7e212327db64 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059360 Aug 31 16:36:10.946776 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3229/6642] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:36:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:36:28.567926 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-07a5eab8-0d28-42da-8c99-eb2d5def87f6 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:36:28.568567 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-07a5eab8-0d28-42da-8c99-eb2d5def87f6 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] [instance: 5b93b9eb-1e59-4f27-9ce0-d1425fe59bda] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:36:28.571784 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:36:28.572620 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:36:28.573687 n-d-833090-16 devstack@n-api.service[128864]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 16:36:28.573960 n-d-833090-16 devstack@n-api.service[128864]: Wed Aug 31 16:36:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5b93b9eb-1e59-4f27-9ce0-d1425fe59bda/os-volume_attachments/60bf06aa-7fa4-4f58-a092-3353d3841daf (ip 10.222.0.50) !!! Aug 31 16:36:28.581454 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-07a5eab8-0d28-42da-8c99-eb2d5def87f6 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:28.581959 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-07a5eab8-0d28-42da-8c99-eb2d5def87f6 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:28.582736 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-07a5eab8-0d28-42da-8c99-eb2d5def87f6 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:28.583472 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-07a5eab8-0d28-42da-8c99-eb2d5def87f6 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:28.587576 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-07a5eab8-0d28-42da-8c99-eb2d5def87f6 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:28.588061 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-07a5eab8-0d28-42da-8c99-eb2d5def87f6 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:28.686600 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-07a5eab8-0d28-42da-8c99-eb2d5def87f6 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lazy-loading 'services' on Instance uuid 5b93b9eb-1e59-4f27-9ce0-d1425fe59bda {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:36:28.763983 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-07a5eab8-0d28-42da-8c99-eb2d5def87f6 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5b93b9eb-1e59-4f27-9ce0-d1425fe59bda/os-volume_attachments/60bf06aa-7fa4-4f58-a092-3353d3841daf" status: 202 len: 0 microversion: 2.1 time: 0.199765 Aug 31 16:36:28.764612 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3414/6643] 10.222.0.50 () {58 vars in 1416 bytes} [Wed Aug 31 16:36:28 2022] DELETE /compute/v2.1/servers/5b93b9eb-1e59-4f27-9ce0-d1425fe59bda/os-volume_attachments/60bf06aa-7fa4-4f58-a092-3353d3841daf => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:36:34.151110 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:36:34.152005 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=24 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:36:34.156801 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fc009821-f49d-4c0b-9950-21cc5912076d tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:36:34.157755 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fc009821-f49d-4c0b-9950-21cc5912076d tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] [instance: 5b93b9eb-1e59-4f27-9ce0-d1425fe59bda] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:36:34.165058 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc009821-f49d-4c0b-9950-21cc5912076d tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:34.165555 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc009821-f49d-4c0b-9950-21cc5912076d tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:34.165981 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc009821-f49d-4c0b-9950-21cc5912076d tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:34.166995 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc009821-f49d-4c0b-9950-21cc5912076d tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:34.167529 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc009821-f49d-4c0b-9950-21cc5912076d tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:34.167940 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc009821-f49d-4c0b-9950-21cc5912076d tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:34.195857 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fc009821-f49d-4c0b-9950-21cc5912076d tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] [instance: 5b93b9eb-1e59-4f27-9ce0-d1425fe59bda] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:36:34.293722 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fc009821-f49d-4c0b-9950-21cc5912076d tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5b93b9eb-1e59-4f27-9ce0-d1425fe59bda" status: 204 len: 0 microversion: 2.1 time: 0.144799 Aug 31 16:36:34.294556 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3230/6644] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:36:34 2022] DELETE /compute/v2.1/servers/5b93b9eb-1e59-4f27-9ce0-d1425fe59bda => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:36:34.305318 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-42b3f5e8-3ca1-4db1-bb96-048da8b21697 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:36:34.306795 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-42b3f5e8-3ca1-4db1-bb96-048da8b21697 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] [instance: 5b93b9eb-1e59-4f27-9ce0-d1425fe59bda] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:36:34.313844 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-42b3f5e8-3ca1-4db1-bb96-048da8b21697 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:34.314473 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-42b3f5e8-3ca1-4db1-bb96-048da8b21697 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:34.314988 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-42b3f5e8-3ca1-4db1-bb96-048da8b21697 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:34.315770 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-42b3f5e8-3ca1-4db1-bb96-048da8b21697 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:34.316301 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-42b3f5e8-3ca1-4db1-bb96-048da8b21697 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:34.316807 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-42b3f5e8-3ca1-4db1-bb96-048da8b21697 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:34.459412 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-42b3f5e8-3ca1-4db1-bb96-048da8b21697 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8192fd503d654d36919dd083abf585b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf3503a6a724914af2ac13a4579a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:36:34.468645 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-42b3f5e8-3ca1-4db1-bb96-048da8b21697 tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] 10.222.0.50 "GET /compute/v2.1/servers/5b93b9eb-1e59-4f27-9ce0-d1425fe59bda" status: 200 len: 1511 microversion: 2.1 time: 0.169101 Aug 31 16:36:34.469242 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3415/6645] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:36:34 2022] GET /compute/v2.1/servers/5b93b9eb-1e59-4f27-9ce0-d1425fe59bda => generated 1511 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:36:35.489700 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bea99a74-83c6-449e-ae2d-6928e61be16c tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:36:35.490430 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bea99a74-83c6-449e-ae2d-6928e61be16c tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] [instance: 5b93b9eb-1e59-4f27-9ce0-d1425fe59bda] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:36:35.498658 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bea99a74-83c6-449e-ae2d-6928e61be16c tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:35.499045 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bea99a74-83c6-449e-ae2d-6928e61be16c tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:35.499476 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bea99a74-83c6-449e-ae2d-6928e61be16c tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:35.500166 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bea99a74-83c6-449e-ae2d-6928e61be16c tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:35.500611 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bea99a74-83c6-449e-ae2d-6928e61be16c tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:35.501178 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bea99a74-83c6-449e-ae2d-6928e61be16c tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:35.643752 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bea99a74-83c6-449e-ae2d-6928e61be16c tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8192fd503d654d36919dd083abf585b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf3503a6a724914af2ac13a4579a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:36:35.653451 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bea99a74-83c6-449e-ae2d-6928e61be16c tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] 10.222.0.50 "GET /compute/v2.1/servers/5b93b9eb-1e59-4f27-9ce0-d1425fe59bda" status: 200 len: 1511 microversion: 2.1 time: 0.168077 Aug 31 16:36:35.654357 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3231/6646] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:36:35 2022] GET /compute/v2.1/servers/5b93b9eb-1e59-4f27-9ce0-d1425fe59bda => generated 1511 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:36:36.488945 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-a77aeb48-821f-4e23-9fba-174c3ccb6b16 req-04835f53-961f-49a3-8f13-773d797e18bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b93b9eb-1e59-4f27-9ce0-d1425fe59bda", "name": "network-vif-deleted", "tag": "64893d48-e45c-44ad-95da-1d4408069ff6"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:36:36.501279 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-a77aeb48-821f-4e23-9fba-174c3ccb6b16 req-04835f53-961f-49a3-8f13-773d797e18bd service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:36.502046 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-a77aeb48-821f-4e23-9fba-174c3ccb6b16 req-04835f53-961f-49a3-8f13-773d797e18bd service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:36.502730 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-a77aeb48-821f-4e23-9fba-174c3ccb6b16 req-04835f53-961f-49a3-8f13-773d797e18bd service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:36.519441 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-a77aeb48-821f-4e23-9fba-174c3ccb6b16 req-04835f53-961f-49a3-8f13-773d797e18bd service nova] Creating event network-vif-deleted:64893d48-e45c-44ad-95da-1d4408069ff6 for instance 5b93b9eb-1e59-4f27-9ce0-d1425fe59bda on n-h1-833090-16 Aug 31 16:36:36.526472 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-a77aeb48-821f-4e23-9fba-174c3ccb6b16 req-04835f53-961f-49a3-8f13-773d797e18bd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041731 Aug 31 16:36:36.527463 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3416/6647] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:36:36.675739 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ba3c6446-8493-4d1f-b55b-71bc56c6ec7b tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:36:36.676694 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ba3c6446-8493-4d1f-b55b-71bc56c6ec7b tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] [instance: 5b93b9eb-1e59-4f27-9ce0-d1425fe59bda] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:36:36.685663 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba3c6446-8493-4d1f-b55b-71bc56c6ec7b tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:36.686391 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba3c6446-8493-4d1f-b55b-71bc56c6ec7b tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:36.687278 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba3c6446-8493-4d1f-b55b-71bc56c6ec7b tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:36.688015 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba3c6446-8493-4d1f-b55b-71bc56c6ec7b tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:36.689276 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba3c6446-8493-4d1f-b55b-71bc56c6ec7b tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:36.689719 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba3c6446-8493-4d1f-b55b-71bc56c6ec7b tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:36.754767 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba3c6446-8493-4d1f-b55b-71bc56c6ec7b tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:36.755505 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba3c6446-8493-4d1f-b55b-71bc56c6ec7b tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:36.756278 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba3c6446-8493-4d1f-b55b-71bc56c6ec7b tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:36.757111 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-ba3c6446-8493-4d1f-b55b-71bc56c6ec7b tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lazy-loading 'fault' on Instance uuid 5b93b9eb-1e59-4f27-9ce0-d1425fe59bda {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:36:36.812512 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ba3c6446-8493-4d1f-b55b-71bc56c6ec7b tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8192fd503d654d36919dd083abf585b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cf3503a6a724914af2ac13a4579a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:36:36.822484 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ba3c6446-8493-4d1f-b55b-71bc56c6ec7b tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] 10.222.0.50 "GET /compute/v2.1/servers/5b93b9eb-1e59-4f27-9ce0-d1425fe59bda" status: 200 len: 1307 microversion: 2.1 time: 0.150299 Aug 31 16:36:36.823187 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3232/6648] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:36:36 2022] GET /compute/v2.1/servers/5b93b9eb-1e59-4f27-9ce0-d1425fe59bda => generated 1307 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:36:37.846230 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d61e611f-b95c-4cf8-b3db-5fc70325855e tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:36:37.846969 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d61e611f-b95c-4cf8-b3db-5fc70325855e tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] [instance: 5b93b9eb-1e59-4f27-9ce0-d1425fe59bda] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:36:37.855093 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d61e611f-b95c-4cf8-b3db-5fc70325855e tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:37.855590 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d61e611f-b95c-4cf8-b3db-5fc70325855e tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:37.856070 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d61e611f-b95c-4cf8-b3db-5fc70325855e tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:37.856782 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d61e611f-b95c-4cf8-b3db-5fc70325855e tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:36:37.857261 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d61e611f-b95c-4cf8-b3db-5fc70325855e tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:36:37.857706 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d61e611f-b95c-4cf8-b3db-5fc70325855e tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:36:37.873087 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-d61e611f-b95c-4cf8-b3db-5fc70325855e tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] HTTP exception thrown: Instance 5b93b9eb-1e59-4f27-9ce0-d1425fe59bda could not be found. Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d61e611f-b95c-4cf8-b3db-5fc70325855e tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Request method failure captured: Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/5b93b9eb-1e59-4f27-9ce0-d1425fe59bda HTTP/1.1 Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD41iEyT6l1fOpxkmvyixnNWBlUBU_HV68fmJ1WXqakCOchJbLYMWkGBPkc2rJ2_0Ume-aRbb7znfwWoR51ENBVkty18dMSVW8D04PZhxJpXM79ihag0i9_NGDUkmgI0jjJmtE7aYXpq5bveqhB3SvWS_gZHen1hiGdpaHXb0ka-bmLY Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 6cf3503a6a724914af2ac13a4579a4fe Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1528458441 Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6cf3503a6a724914af2ac13a4579a4fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6cf3503a6a724914af2ac13a4579a4fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6cf3503a6a724914af2ac13a4579a4fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6cf3503a6a724914af2ac13a4579a4fe", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-VolumesSnapshotTestJSON-1528458441 Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 6cf3503a6a724914af2ac13a4579a4fe Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1528458441 Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-VolumesSnapshotTestJSON-1528458441-project Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 8192fd503d654d36919dd083abf585b0 Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-VolumesSnapshotTestJSON-1528458441-project Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 5b93b9eb-1e59-4f27-9ce0-d1425fe59bda could not be found. Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '5b93b9eb-1e59-4f27-9ce0-d1425fe59bda'} Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b93b9eb-1e59-4f27-9ce0-d1425fe59bda could not be found. Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b93b9eb-1e59-4f27-9ce0-d1425fe59bda could not be found. Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:36:37.874850 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:36:37.880714 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:36:37.880714 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:36:37.880714 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:36:37.880714 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:36:37.880714 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:36:37.880714 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b93b9eb-1e59-4f27-9ce0-d1425fe59bda could not be found. Aug 31 16:36:37.880714 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:36:37.880714 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d61e611f-b95c-4cf8-b3db-5fc70325855e tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] Returning 404 to user: Instance 5b93b9eb-1e59-4f27-9ce0-d1425fe59bda could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:36:37.880714 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d61e611f-b95c-4cf8-b3db-5fc70325855e tempest-VolumesSnapshotTestJSON-1528458441 tempest-VolumesSnapshotTestJSON-1528458441-project] 10.222.0.50 "GET /compute/v2.1/servers/5b93b9eb-1e59-4f27-9ce0-d1425fe59bda" status: 404 len: 111 microversion: 2.1 time: 0.035535 Aug 31 16:36:37.880714 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3417/6649] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:36:37 2022] GET /compute/v2.1/servers/5b93b9eb-1e59-4f27-9ce0-d1425fe59bda => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:37:34.059020 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=8 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:37:34.060072 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:37:34.061407 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-06fea464-541d-4928-99fc-1a247aef397f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:37:34.062865 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-06fea464-541d-4928-99fc-1a247aef397f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 26d39330-ca3c-4bb2-b93b-d503629aec4a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:37:34.065366 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:37:34.068543 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:37:34.076311 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06fea464-541d-4928-99fc-1a247aef397f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:37:34.077080 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06fea464-541d-4928-99fc-1a247aef397f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:37:34.077687 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06fea464-541d-4928-99fc-1a247aef397f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:37:34.078609 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06fea464-541d-4928-99fc-1a247aef397f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:37:34.079224 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06fea464-541d-4928-99fc-1a247aef397f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:37:34.079812 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06fea464-541d-4928-99fc-1a247aef397f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:37:34.114518 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-06fea464-541d-4928-99fc-1a247aef397f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 26d39330-ca3c-4bb2-b93b-d503629aec4a] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:37:34.209083 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-06fea464-541d-4928-99fc-1a247aef397f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "DELETE /compute/v2.1/servers/26d39330-ca3c-4bb2-b93b-d503629aec4a" status: 204 len: 0 microversion: 2.1 time: 0.159799 Aug 31 16:37:34.210305 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3233/6650] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:37:34 2022] DELETE /compute/v2.1/servers/26d39330-ca3c-4bb2-b93b-d503629aec4a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:37:34.220142 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-06aadd50-5729-41da-85d0-051c2298a841 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:37:34.221372 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-06aadd50-5729-41da-85d0-051c2298a841 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 26d39330-ca3c-4bb2-b93b-d503629aec4a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:37:34.229698 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06aadd50-5729-41da-85d0-051c2298a841 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:37:34.230719 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06aadd50-5729-41da-85d0-051c2298a841 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:37:34.231497 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06aadd50-5729-41da-85d0-051c2298a841 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:37:34.232468 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06aadd50-5729-41da-85d0-051c2298a841 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:37:34.233113 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06aadd50-5729-41da-85d0-051c2298a841 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:37:34.233840 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06aadd50-5729-41da-85d0-051c2298a841 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:37:34.258283 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-a9543f91-04e6-49a3-bc67-bbb2e5bf2c1a req-3a8ef7ea-e924-467a-a474-03e7948b3e63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26d39330-ca3c-4bb2-b93b-d503629aec4a", "tag": "8d60fe73-b416-4974-8737-17121beced88"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:37:34.268954 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-a9543f91-04e6-49a3-bc67-bbb2e5bf2c1a req-3a8ef7ea-e924-467a-a474-03e7948b3e63 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:37:34.269754 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-a9543f91-04e6-49a3-bc67-bbb2e5bf2c1a req-3a8ef7ea-e924-467a-a474-03e7948b3e63 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:37:34.270398 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-a9543f91-04e6-49a3-bc67-bbb2e5bf2c1a req-3a8ef7ea-e924-467a-a474-03e7948b3e63 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:37:34.288465 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-a9543f91-04e6-49a3-bc67-bbb2e5bf2c1a req-3a8ef7ea-e924-467a-a474-03e7948b3e63 service nova] Creating event network-changed:8d60fe73-b416-4974-8737-17121beced88 for instance 26d39330-ca3c-4bb2-b93b-d503629aec4a on n-h2-833090-16 Aug 31 16:37:34.295130 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-a9543f91-04e6-49a3-bc67-bbb2e5bf2c1a req-3a8ef7ea-e924-467a-a474-03e7948b3e63 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.241383 Aug 31 16:37:34.296332 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3418/6651] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:37:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:37:34.403190 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-06aadd50-5729-41da-85d0-051c2298a841 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:37:34.412341 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-06aadd50-5729-41da-85d0-051c2298a841 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/26d39330-ca3c-4bb2-b93b-d503629aec4a" status: 200 len: 1578 microversion: 2.1 time: 0.197610 Aug 31 16:37:34.412938 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3234/6652] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:37:34 2022] GET /compute/v2.1/servers/26d39330-ca3c-4bb2-b93b-d503629aec4a => generated 1578 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:37:35.438045 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c3e1e313-e2b1-4177-a7d3-d67f3856d78e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:37:35.438801 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c3e1e313-e2b1-4177-a7d3-d67f3856d78e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 26d39330-ca3c-4bb2-b93b-d503629aec4a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:37:35.446709 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3e1e313-e2b1-4177-a7d3-d67f3856d78e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:37:35.447507 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3e1e313-e2b1-4177-a7d3-d67f3856d78e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:37:35.447956 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3e1e313-e2b1-4177-a7d3-d67f3856d78e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:37:35.448842 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3e1e313-e2b1-4177-a7d3-d67f3856d78e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:37:35.449689 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3e1e313-e2b1-4177-a7d3-d67f3856d78e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:37:35.450373 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3e1e313-e2b1-4177-a7d3-d67f3856d78e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:37:35.619217 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c3e1e313-e2b1-4177-a7d3-d67f3856d78e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:37:35.628503 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c3e1e313-e2b1-4177-a7d3-d67f3856d78e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/26d39330-ca3c-4bb2-b93b-d503629aec4a" status: 200 len: 1578 microversion: 2.1 time: 0.195084 Aug 31 16:37:35.629117 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3419/6653] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:37:35 2022] GET /compute/v2.1/servers/26d39330-ca3c-4bb2-b93b-d503629aec4a => generated 1578 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:37:36.654745 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-936ba85a-b840-4b98-88c3-94e720b82fcb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:37:36.655334 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-936ba85a-b840-4b98-88c3-94e720b82fcb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 26d39330-ca3c-4bb2-b93b-d503629aec4a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:37:36.663741 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-936ba85a-b840-4b98-88c3-94e720b82fcb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:37:36.664333 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-936ba85a-b840-4b98-88c3-94e720b82fcb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:37:36.665486 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-936ba85a-b840-4b98-88c3-94e720b82fcb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:37:36.666914 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-936ba85a-b840-4b98-88c3-94e720b82fcb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:37:36.666914 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-936ba85a-b840-4b98-88c3-94e720b82fcb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:37:36.667215 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-936ba85a-b840-4b98-88c3-94e720b82fcb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:37:36.866215 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-936ba85a-b840-4b98-88c3-94e720b82fcb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:37:36.878902 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-936ba85a-b840-4b98-88c3-94e720b82fcb tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/26d39330-ca3c-4bb2-b93b-d503629aec4a" status: 200 len: 1578 microversion: 2.1 time: 0.229481 Aug 31 16:37:36.880387 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3235/6654] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:37:36 2022] GET /compute/v2.1/servers/26d39330-ca3c-4bb2-b93b-d503629aec4a => generated 1578 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:37:37.169844 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-9ea9289d-a952-4d68-b9dd-69f118986214 req-efcf2458-d833-4221-87a2-75c892ba3006 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26d39330-ca3c-4bb2-b93b-d503629aec4a", "name": "network-vif-deleted", "tag": "8d60fe73-b416-4974-8737-17121beced88"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:37:37.192110 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-9ea9289d-a952-4d68-b9dd-69f118986214 req-efcf2458-d833-4221-87a2-75c892ba3006 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:37:37.192934 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-9ea9289d-a952-4d68-b9dd-69f118986214 req-efcf2458-d833-4221-87a2-75c892ba3006 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:37:37.193349 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-9ea9289d-a952-4d68-b9dd-69f118986214 req-efcf2458-d833-4221-87a2-75c892ba3006 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:37:37.212583 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-9ea9289d-a952-4d68-b9dd-69f118986214 req-efcf2458-d833-4221-87a2-75c892ba3006 service nova] Creating event network-vif-deleted:8d60fe73-b416-4974-8737-17121beced88 for instance 26d39330-ca3c-4bb2-b93b-d503629aec4a on n-h2-833090-16 Aug 31 16:37:37.229770 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-9ea9289d-a952-4d68-b9dd-69f118986214 req-efcf2458-d833-4221-87a2-75c892ba3006 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063390 Aug 31 16:37:37.233906 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3420/6655] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:37:37.907183 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-31ca6a48-2853-4b6b-9665-b922c8661c5e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:37:37.907851 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-31ca6a48-2853-4b6b-9665-b922c8661c5e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 26d39330-ca3c-4bb2-b93b-d503629aec4a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:37:37.915872 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31ca6a48-2853-4b6b-9665-b922c8661c5e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:37:37.916363 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31ca6a48-2853-4b6b-9665-b922c8661c5e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:37:37.916798 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31ca6a48-2853-4b6b-9665-b922c8661c5e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:37:37.917498 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31ca6a48-2853-4b6b-9665-b922c8661c5e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:37:37.918396 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31ca6a48-2853-4b6b-9665-b922c8661c5e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:37:37.918898 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31ca6a48-2853-4b6b-9665-b922c8661c5e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:37:37.985056 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-31ca6a48-2853-4b6b-9665-b922c8661c5e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:37:37.994069 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-31ca6a48-2853-4b6b-9665-b922c8661c5e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/26d39330-ca3c-4bb2-b93b-d503629aec4a" status: 200 len: 1225 microversion: 2.1 time: 0.091500 Aug 31 16:37:37.995005 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3236/6656] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:37:37 2022] GET /compute/v2.1/servers/26d39330-ca3c-4bb2-b93b-d503629aec4a => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:37:39.021309 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c3b7e9c5-d985-4672-a7ee-c3ee05aae0ac tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:37:39.022250 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c3b7e9c5-d985-4672-a7ee-c3ee05aae0ac tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 26d39330-ca3c-4bb2-b93b-d503629aec4a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:37:39.029666 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3b7e9c5-d985-4672-a7ee-c3ee05aae0ac tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:37:39.030611 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3b7e9c5-d985-4672-a7ee-c3ee05aae0ac tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:37:39.031002 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3b7e9c5-d985-4672-a7ee-c3ee05aae0ac tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:37:39.031985 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3b7e9c5-d985-4672-a7ee-c3ee05aae0ac tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:37:39.032570 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3b7e9c5-d985-4672-a7ee-c3ee05aae0ac tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:37:39.033635 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3b7e9c5-d985-4672-a7ee-c3ee05aae0ac tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:37:39.108811 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c3b7e9c5-d985-4672-a7ee-c3ee05aae0ac tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:37:39.118122 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c3b7e9c5-d985-4672-a7ee-c3ee05aae0ac tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/26d39330-ca3c-4bb2-b93b-d503629aec4a" status: 200 len: 1225 microversion: 2.1 time: 0.101928 Aug 31 16:37:39.119119 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3421/6657] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:37:39 2022] GET /compute/v2.1/servers/26d39330-ca3c-4bb2-b93b-d503629aec4a => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:37:40.140295 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f1aea4b8-3ff1-40ba-a292-6e3813e30a1f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:37:40.141608 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f1aea4b8-3ff1-40ba-a292-6e3813e30a1f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 26d39330-ca3c-4bb2-b93b-d503629aec4a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:37:40.148964 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f1aea4b8-3ff1-40ba-a292-6e3813e30a1f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:37:40.149455 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f1aea4b8-3ff1-40ba-a292-6e3813e30a1f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:37:40.149904 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f1aea4b8-3ff1-40ba-a292-6e3813e30a1f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:37:40.150637 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f1aea4b8-3ff1-40ba-a292-6e3813e30a1f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:37:40.151085 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f1aea4b8-3ff1-40ba-a292-6e3813e30a1f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:37:40.151510 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f1aea4b8-3ff1-40ba-a292-6e3813e30a1f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:37:40.218643 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f1aea4b8-3ff1-40ba-a292-6e3813e30a1f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:37:40.227200 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f1aea4b8-3ff1-40ba-a292-6e3813e30a1f tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/26d39330-ca3c-4bb2-b93b-d503629aec4a" status: 200 len: 1225 microversion: 2.1 time: 0.091209 Aug 31 16:37:40.227795 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3237/6658] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:37:40 2022] GET /compute/v2.1/servers/26d39330-ca3c-4bb2-b93b-d503629aec4a => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:37:41.249679 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-866dd7a5-61b6-4807-94e6-5b5f9b2d20e5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:37:41.250975 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-866dd7a5-61b6-4807-94e6-5b5f9b2d20e5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 26d39330-ca3c-4bb2-b93b-d503629aec4a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:37:41.259297 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-866dd7a5-61b6-4807-94e6-5b5f9b2d20e5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:37:41.260089 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-866dd7a5-61b6-4807-94e6-5b5f9b2d20e5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:37:41.260741 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-866dd7a5-61b6-4807-94e6-5b5f9b2d20e5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:37:41.261572 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-866dd7a5-61b6-4807-94e6-5b5f9b2d20e5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:37:41.262055 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-866dd7a5-61b6-4807-94e6-5b5f9b2d20e5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:37:41.262525 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-866dd7a5-61b6-4807-94e6-5b5f9b2d20e5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:37:41.333393 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-866dd7a5-61b6-4807-94e6-5b5f9b2d20e5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:37:41.342009 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-866dd7a5-61b6-4807-94e6-5b5f9b2d20e5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/26d39330-ca3c-4bb2-b93b-d503629aec4a" status: 200 len: 1225 microversion: 2.1 time: 0.097066 Aug 31 16:37:41.342740 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3422/6659] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:37:41 2022] GET /compute/v2.1/servers/26d39330-ca3c-4bb2-b93b-d503629aec4a => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:37:42.363824 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d6bdaca8-2c5b-4322-be21-19ea99cc2de9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:37:42.364430 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d6bdaca8-2c5b-4322-be21-19ea99cc2de9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 26d39330-ca3c-4bb2-b93b-d503629aec4a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:37:42.373690 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6bdaca8-2c5b-4322-be21-19ea99cc2de9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:37:42.374240 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6bdaca8-2c5b-4322-be21-19ea99cc2de9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:37:42.374668 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6bdaca8-2c5b-4322-be21-19ea99cc2de9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:37:42.375372 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6bdaca8-2c5b-4322-be21-19ea99cc2de9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:37:42.375817 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6bdaca8-2c5b-4322-be21-19ea99cc2de9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:37:42.376462 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6bdaca8-2c5b-4322-be21-19ea99cc2de9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:37:42.391533 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-d6bdaca8-2c5b-4322-be21-19ea99cc2de9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] HTTP exception thrown: Instance 26d39330-ca3c-4bb2-b93b-d503629aec4a could not be found. Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d6bdaca8-2c5b-4322-be21-19ea99cc2de9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Request method failure captured: Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/26d39330-ca3c-4bb2-b93b-d503629aec4a HTTP/1.1 Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4sA8QatsiRw58KL4D-GJAaR1X9zBGwbu0cNuaHi16Tl8K5LhZ4dthUjdeeybVrZ6FkLiuj0CnwnGa_AqwqzkMsKdZfTNQhjMqXfHtEAV5ID9oXbOsK0vGNgY-jRlE7qor7NeFM7QGwhr8KE3TJ70ugNQcxhI7ZJIKzx49vTu_Rhy18 Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 32245d85aee64f69865d98656133a539 Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-TestVolumeBootPattern-1732723367 Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/32245d85aee64f69865d98656133a539"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/32245d85aee64f69865d98656133a539"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/32245d85aee64f69865d98656133a539"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_32245d85aee64f69865d98656133a539", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-TestVolumeBootPattern-1732723367 Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 32245d85aee64f69865d98656133a539 Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TestVolumeBootPattern-1732723367 Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-TestVolumeBootPattern-1732723367-project Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: fb76a89a8b8042edb7b6aaccb4f41ead Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-TestVolumeBootPattern-1732723367-project Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 26d39330-ca3c-4bb2-b93b-d503629aec4a could not be found. Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '26d39330-ca3c-4bb2-b93b-d503629aec4a'} Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26d39330-ca3c-4bb2-b93b-d503629aec4a could not be found. Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26d39330-ca3c-4bb2-b93b-d503629aec4a could not be found. Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:37:42.393223 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:37:42.399678 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:37:42.399678 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:37:42.399678 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:37:42.399678 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:37:42.399678 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:37:42.399678 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26d39330-ca3c-4bb2-b93b-d503629aec4a could not be found. Aug 31 16:37:42.399678 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:37:42.399678 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d6bdaca8-2c5b-4322-be21-19ea99cc2de9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Returning 404 to user: Instance 26d39330-ca3c-4bb2-b93b-d503629aec4a could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:37:42.399678 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d6bdaca8-2c5b-4322-be21-19ea99cc2de9 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/26d39330-ca3c-4bb2-b93b-d503629aec4a" status: 404 len: 111 microversion: 2.1 time: 0.035050 Aug 31 16:37:42.399678 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3238/6660] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:37:42 2022] GET /compute/v2.1/servers/26d39330-ca3c-4bb2-b93b-d503629aec4a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:37:48.912455 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-30d6646f-4853-4f02-8d53-c21e44b7eae0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:37:48.913032 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-30d6646f-4853-4f02-8d53-c21e44b7eae0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 18912bca-5369-4179-8c68-24a627d48403] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:37:48.927122 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-30d6646f-4853-4f02-8d53-c21e44b7eae0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:37:48.927627 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-30d6646f-4853-4f02-8d53-c21e44b7eae0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:37:48.928083 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-30d6646f-4853-4f02-8d53-c21e44b7eae0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:37:48.928811 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-30d6646f-4853-4f02-8d53-c21e44b7eae0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:37:48.929283 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-30d6646f-4853-4f02-8d53-c21e44b7eae0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:37:48.929723 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-30d6646f-4853-4f02-8d53-c21e44b7eae0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:37:48.964470 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-30d6646f-4853-4f02-8d53-c21e44b7eae0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 18912bca-5369-4179-8c68-24a627d48403] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:37:49.091775 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-30d6646f-4853-4f02-8d53-c21e44b7eae0 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "DELETE /compute/v2.1/servers/18912bca-5369-4179-8c68-24a627d48403" status: 204 len: 0 microversion: 2.1 time: 0.181731 Aug 31 16:37:49.092424 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3423/6661] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:37:48 2022] DELETE /compute/v2.1/servers/18912bca-5369-4179-8c68-24a627d48403 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:37:49.111077 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e9c4080c-6c93-42ec-a53c-07122ae1f32e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:37:49.113626 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e9c4080c-6c93-42ec-a53c-07122ae1f32e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 18912bca-5369-4179-8c68-24a627d48403] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:37:49.123415 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e9c4080c-6c93-42ec-a53c-07122ae1f32e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:37:49.124221 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e9c4080c-6c93-42ec-a53c-07122ae1f32e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:37:49.124840 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e9c4080c-6c93-42ec-a53c-07122ae1f32e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:37:49.125737 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e9c4080c-6c93-42ec-a53c-07122ae1f32e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:37:49.126435 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e9c4080c-6c93-42ec-a53c-07122ae1f32e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:37:49.127352 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e9c4080c-6c93-42ec-a53c-07122ae1f32e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:37:49.218532 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-1055db50-6758-41af-9b6a-5b91f89e6730 req-fa4989a0-bee6-46a6-a47a-1fad04b3d8b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18912bca-5369-4179-8c68-24a627d48403", "tag": "743d612c-7e97-4487-b267-5853d0764aa1"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:37:49.236753 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-1055db50-6758-41af-9b6a-5b91f89e6730 req-fa4989a0-bee6-46a6-a47a-1fad04b3d8b3 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:37:49.237299 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-1055db50-6758-41af-9b6a-5b91f89e6730 req-fa4989a0-bee6-46a6-a47a-1fad04b3d8b3 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:37:49.237789 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-1055db50-6758-41af-9b6a-5b91f89e6730 req-fa4989a0-bee6-46a6-a47a-1fad04b3d8b3 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:37:49.285564 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-1055db50-6758-41af-9b6a-5b91f89e6730 req-fa4989a0-bee6-46a6-a47a-1fad04b3d8b3 service nova] Creating event network-changed:743d612c-7e97-4487-b267-5853d0764aa1 for instance 18912bca-5369-4179-8c68-24a627d48403 on n-h1-833090-16 Aug 31 16:37:49.302030 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-1055db50-6758-41af-9b6a-5b91f89e6730 req-fa4989a0-bee6-46a6-a47a-1fad04b3d8b3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.369763 Aug 31 16:37:49.303035 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3239/6662] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:37:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:37:49.407376 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e9c4080c-6c93-42ec-a53c-07122ae1f32e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:37:49.419110 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e9c4080c-6c93-42ec-a53c-07122ae1f32e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/18912bca-5369-4179-8c68-24a627d48403" status: 200 len: 1580 microversion: 2.1 time: 0.321907 Aug 31 16:37:49.422964 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3424/6663] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:37:49 2022] GET /compute/v2.1/servers/18912bca-5369-4179-8c68-24a627d48403 => generated 1580 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:37:50.451305 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8183b3f1-d488-4490-a396-cb34a11905e5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:37:50.452198 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8183b3f1-d488-4490-a396-cb34a11905e5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 18912bca-5369-4179-8c68-24a627d48403] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:37:50.461906 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8183b3f1-d488-4490-a396-cb34a11905e5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:37:50.462526 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8183b3f1-d488-4490-a396-cb34a11905e5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:37:50.462972 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8183b3f1-d488-4490-a396-cb34a11905e5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:37:50.463668 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8183b3f1-d488-4490-a396-cb34a11905e5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:37:50.464765 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8183b3f1-d488-4490-a396-cb34a11905e5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:37:50.465373 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8183b3f1-d488-4490-a396-cb34a11905e5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:37:50.717885 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8183b3f1-d488-4490-a396-cb34a11905e5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:37:50.738816 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8183b3f1-d488-4490-a396-cb34a11905e5 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/18912bca-5369-4179-8c68-24a627d48403" status: 200 len: 1580 microversion: 2.1 time: 0.296268 Aug 31 16:37:50.750637 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3240/6664] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:37:50 2022] GET /compute/v2.1/servers/18912bca-5369-4179-8c68-24a627d48403 => generated 1580 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:37:51.399426 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-3ea4e628-39c7-46c9-9080-0a8e7c88a5b9 req-9585681f-ddce-4c8e-a0b9-a2a14eb3fd29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18912bca-5369-4179-8c68-24a627d48403", "name": "network-vif-deleted", "tag": "743d612c-7e97-4487-b267-5853d0764aa1"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:37:51.434649 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-3ea4e628-39c7-46c9-9080-0a8e7c88a5b9 req-9585681f-ddce-4c8e-a0b9-a2a14eb3fd29 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:37:51.435805 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-3ea4e628-39c7-46c9-9080-0a8e7c88a5b9 req-9585681f-ddce-4c8e-a0b9-a2a14eb3fd29 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:37:51.436673 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-3ea4e628-39c7-46c9-9080-0a8e7c88a5b9 req-9585681f-ddce-4c8e-a0b9-a2a14eb3fd29 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:37:51.471879 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-3ea4e628-39c7-46c9-9080-0a8e7c88a5b9 req-9585681f-ddce-4c8e-a0b9-a2a14eb3fd29 service nova] Creating event network-vif-deleted:743d612c-7e97-4487-b267-5853d0764aa1 for instance 18912bca-5369-4179-8c68-24a627d48403 on n-h1-833090-16 Aug 31 16:37:51.478584 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-3ea4e628-39c7-46c9-9080-0a8e7c88a5b9 req-9585681f-ddce-4c8e-a0b9-a2a14eb3fd29 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091229 Aug 31 16:37:51.479248 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3425/6665] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:37:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:37:51.778873 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c0563462-98c0-408f-84c2-46ff03fb6fa8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:37:51.779482 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c0563462-98c0-408f-84c2-46ff03fb6fa8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 18912bca-5369-4179-8c68-24a627d48403] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:37:51.793399 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0563462-98c0-408f-84c2-46ff03fb6fa8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:37:51.793897 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0563462-98c0-408f-84c2-46ff03fb6fa8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:37:51.794357 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0563462-98c0-408f-84c2-46ff03fb6fa8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:37:51.795113 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0563462-98c0-408f-84c2-46ff03fb6fa8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:37:51.795563 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0563462-98c0-408f-84c2-46ff03fb6fa8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:37:51.795989 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0563462-98c0-408f-84c2-46ff03fb6fa8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:37:52.003340 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c0563462-98c0-408f-84c2-46ff03fb6fa8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:37:52.014519 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c0563462-98c0-408f-84c2-46ff03fb6fa8 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/18912bca-5369-4179-8c68-24a627d48403" status: 200 len: 1393 microversion: 2.1 time: 0.246035 Aug 31 16:37:52.022435 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3241/6666] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:37:51 2022] GET /compute/v2.1/servers/18912bca-5369-4179-8c68-24a627d48403 => generated 1393 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:37:52.791115 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7408959e-dac3-4c59-8e3c-b628fea6fe53 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Action: 'create', calling method: .version_select at 0x7fbb4553b4c0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1277255544", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNpIPzffCe1H4xp7ZKxndvZt1/0kUzjehDG7Vo+QIdjI3/VvrsmPXenNtP2L/2Asvrthrufv6n6hKFZeYbj6Fic6c3VcZtp7p+vQWUdn5k0MX1w9Ki4DVftkzyB0H7nG+g=="}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:37:52.816387 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-7408959e-dac3-4c59-8e3c-b628fea6fe53 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Getting quotas for project ca0257e250d645aea1c2f5d9737fcff5. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:37:52.823316 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-7408959e-dac3-4c59-8e3c-b628fea6fe53 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Getting quotas for user c0a80d6de66345a0a9773ec0a4ad3855 and project ca0257e250d645aea1c2f5d9737fcff5. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:37:52.862927 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7408959e-dac3-4c59-8e3c-b628fea6fe53 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.077446 Aug 31 16:37:52.864493 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3426/6667] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 31 16:37:52 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:37:53.036617 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-02fbbe5a-92e0-401d-8396-1e273439ab29 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:37:53.037526 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-02fbbe5a-92e0-401d-8396-1e273439ab29 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 18912bca-5369-4179-8c68-24a627d48403] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:37:53.049960 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02fbbe5a-92e0-401d-8396-1e273439ab29 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:37:53.050470 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02fbbe5a-92e0-401d-8396-1e273439ab29 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:37:53.055504 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02fbbe5a-92e0-401d-8396-1e273439ab29 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:37:53.056470 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02fbbe5a-92e0-401d-8396-1e273439ab29 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:37:53.057096 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02fbbe5a-92e0-401d-8396-1e273439ab29 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:37:53.058595 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02fbbe5a-92e0-401d-8396-1e273439ab29 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:37:53.167665 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-02fbbe5a-92e0-401d-8396-1e273439ab29 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:37:53.179863 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-02fbbe5a-92e0-401d-8396-1e273439ab29 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/18912bca-5369-4179-8c68-24a627d48403" status: 200 len: 1393 microversion: 2.1 time: 0.147034 Aug 31 16:37:53.181196 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3242/6668] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:37:53 2022] GET /compute/v2.1/servers/18912bca-5369-4179-8c68-24a627d48403 => generated 1393 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:37:54.204223 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-abfec631-eb1e-43f7-9347-a68960e105c7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:37:54.205075 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-abfec631-eb1e-43f7-9347-a68960e105c7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 18912bca-5369-4179-8c68-24a627d48403] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:37:54.213085 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-abfec631-eb1e-43f7-9347-a68960e105c7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:37:54.214177 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-abfec631-eb1e-43f7-9347-a68960e105c7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:37:54.215065 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-abfec631-eb1e-43f7-9347-a68960e105c7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:37:54.216191 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-abfec631-eb1e-43f7-9347-a68960e105c7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:37:54.216923 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-abfec631-eb1e-43f7-9347-a68960e105c7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:37:54.218241 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-abfec631-eb1e-43f7-9347-a68960e105c7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:37:54.223049 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b5ba3444-42ea-41cb-b734-6b2e1e355eb5 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-455375667", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "ee4e84c7-6f2f-4e43-8bb3-22bd721c8800"}], "key_name": "tempest-TestNetworkBasicOps-1277255544", "security_groups": [{"name": "tempest-secgroup-smoke-1916021124"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:37:54.297310 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-abfec631-eb1e-43f7-9347-a68960e105c7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:37:54.308776 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-abfec631-eb1e-43f7-9347-a68960e105c7 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/18912bca-5369-4179-8c68-24a627d48403" status: 200 len: 1393 microversion: 2.1 time: 0.109660 Aug 31 16:37:54.316297 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3427/6669] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:37:54 2022] GET /compute/v2.1/servers/18912bca-5369-4179-8c68-24a627d48403 => generated 1393 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:37:54.363807 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-b5ba3444-42ea-41cb-b734-6b2e1e355eb5 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] validate_networks() for [('ee4e84c7-6f2f-4e43-8bb3-22bd721c8800', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:37:54.925085 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b5ba3444-42ea-41cb-b734-6b2e1e355eb5 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:37:54.930656 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b5ba3444-42ea-41cb-b734-6b2e1e355eb5 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:37:54.931160 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b5ba3444-42ea-41cb-b734-6b2e1e355eb5 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:37:54.931574 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b5ba3444-42ea-41cb-b734-6b2e1e355eb5 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:37:54.932015 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b5ba3444-42ea-41cb-b734-6b2e1e355eb5 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:37:54.941384 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5ba3444-42ea-41cb-b734-6b2e1e355eb5 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:37:54.941862 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5ba3444-42ea-41cb-b734-6b2e1e355eb5 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:37:54.942328 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5ba3444-42ea-41cb-b734-6b2e1e355eb5 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:37:54.943051 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5ba3444-42ea-41cb-b734-6b2e1e355eb5 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:37:54.943498 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5ba3444-42ea-41cb-b734-6b2e1e355eb5 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:37:54.943919 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5ba3444-42ea-41cb-b734-6b2e1e355eb5 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:37:54.961825 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-b5ba3444-42ea-41cb-b734-6b2e1e355eb5 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Getting quotas for project ca0257e250d645aea1c2f5d9737fcff5. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:37:54.966903 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-b5ba3444-42ea-41cb-b734-6b2e1e355eb5 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Getting quotas for user c0a80d6de66345a0a9773ec0a4ad3855 and project ca0257e250d645aea1c2f5d9737fcff5. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:37:54.980736 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b5ba3444-42ea-41cb-b734-6b2e1e355eb5 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:37:54.983300 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b5ba3444-42ea-41cb-b734-6b2e1e355eb5 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] [instance: f01381d6-d55d-4f85-bfd5-70fd8db72a02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:37:55.032739 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b5ba3444-42ea-41cb-b734-6b2e1e355eb5 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.813549 Aug 31 16:37:55.033584 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3243/6670] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:37:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:37:55.045481 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-65d0e3e4-03f1-49d4-b344-b2ee318baf9e tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:37:55.046272 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-65d0e3e4-03f1-49d4-b344-b2ee318baf9e tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] [instance: f01381d6-d55d-4f85-bfd5-70fd8db72a02] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:37:55.116590 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-65d0e3e4-03f1-49d4-b344-b2ee318baf9e tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a80d6de66345a0a9773ec0a4ad3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0257e250d645aea1c2f5d9737fcff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:37:55.124256 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-65d0e3e4-03f1-49d4-b344-b2ee318baf9e tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] 10.222.0.50 "GET /compute/v2.1/servers/f01381d6-d55d-4f85-bfd5-70fd8db72a02" status: 200 len: 1248 microversion: 2.1 time: 0.083395 Aug 31 16:37:55.124840 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3428/6671] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:37:55 2022] GET /compute/v2.1/servers/f01381d6-d55d-4f85-bfd5-70fd8db72a02 => generated 1248 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:37:55.336722 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b70c7945-8805-462e-9c16-761b20ac4fbe tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:37:55.337235 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b70c7945-8805-462e-9c16-761b20ac4fbe tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 18912bca-5369-4179-8c68-24a627d48403] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:37:55.345510 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b70c7945-8805-462e-9c16-761b20ac4fbe tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:37:55.345995 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b70c7945-8805-462e-9c16-761b20ac4fbe tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:37:55.346583 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b70c7945-8805-462e-9c16-761b20ac4fbe tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:37:55.347281 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b70c7945-8805-462e-9c16-761b20ac4fbe tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:37:55.347776 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b70c7945-8805-462e-9c16-761b20ac4fbe tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:37:55.348276 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b70c7945-8805-462e-9c16-761b20ac4fbe tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:37:55.420029 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b70c7945-8805-462e-9c16-761b20ac4fbe tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:37:55.429244 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b70c7945-8805-462e-9c16-761b20ac4fbe tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/18912bca-5369-4179-8c68-24a627d48403" status: 200 len: 1393 microversion: 2.1 time: 0.098774 Aug 31 16:37:55.430143 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3244/6672] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:37:55 2022] GET /compute/v2.1/servers/18912bca-5369-4179-8c68-24a627d48403 => generated 1393 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:37:56.145094 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a34ba4e1-b4dc-417e-a75e-53c55f067d17 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:37:56.145678 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a34ba4e1-b4dc-417e-a75e-53c55f067d17 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] [instance: f01381d6-d55d-4f85-bfd5-70fd8db72a02] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:37:56.154341 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a34ba4e1-b4dc-417e-a75e-53c55f067d17 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:37:56.155071 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a34ba4e1-b4dc-417e-a75e-53c55f067d17 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:37:56.155285 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a34ba4e1-b4dc-417e-a75e-53c55f067d17 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:37:56.155991 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a34ba4e1-b4dc-417e-a75e-53c55f067d17 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:37:56.156448 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a34ba4e1-b4dc-417e-a75e-53c55f067d17 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:37:56.156889 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a34ba4e1-b4dc-417e-a75e-53c55f067d17 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:37:56.235894 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a34ba4e1-b4dc-417e-a75e-53c55f067d17 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a80d6de66345a0a9773ec0a4ad3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0257e250d645aea1c2f5d9737fcff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:37:56.244985 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a34ba4e1-b4dc-417e-a75e-53c55f067d17 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] 10.222.0.50 "GET /compute/v2.1/servers/f01381d6-d55d-4f85-bfd5-70fd8db72a02" status: 200 len: 1300 microversion: 2.1 time: 0.103632 Aug 31 16:37:56.248876 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3429/6673] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:37:56 2022] GET /compute/v2.1/servers/f01381d6-d55d-4f85-bfd5-70fd8db72a02 => generated 1300 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:37:56.456107 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-afc4343c-b7a9-46c5-9c81-a7a2f994bc76 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:37:56.457048 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-afc4343c-b7a9-46c5-9c81-a7a2f994bc76 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 18912bca-5369-4179-8c68-24a627d48403] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:37:56.468258 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-afc4343c-b7a9-46c5-9c81-a7a2f994bc76 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:37:56.468895 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-afc4343c-b7a9-46c5-9c81-a7a2f994bc76 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:37:56.469472 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-afc4343c-b7a9-46c5-9c81-a7a2f994bc76 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:37:56.470766 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-afc4343c-b7a9-46c5-9c81-a7a2f994bc76 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:37:56.471444 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-afc4343c-b7a9-46c5-9c81-a7a2f994bc76 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:37:56.472137 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-afc4343c-b7a9-46c5-9c81-a7a2f994bc76 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:37:56.510575 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-afc4343c-b7a9-46c5-9c81-a7a2f994bc76 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:37:56.510951 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-afc4343c-b7a9-46c5-9c81-a7a2f994bc76 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:37:56.511753 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-afc4343c-b7a9-46c5-9c81-a7a2f994bc76 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:37:56.512244 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-afc4343c-b7a9-46c5-9c81-a7a2f994bc76 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lazy-loading 'fault' on Instance uuid 18912bca-5369-4179-8c68-24a627d48403 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:37:56.572110 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-afc4343c-b7a9-46c5-9c81-a7a2f994bc76 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb76a89a8b8042edb7b6aaccb4f41ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32245d85aee64f69865d98656133a539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:37:56.585996 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-afc4343c-b7a9-46c5-9c81-a7a2f994bc76 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/18912bca-5369-4179-8c68-24a627d48403" status: 200 len: 1398 microversion: 2.1 time: 0.138886 Aug 31 16:37:56.586720 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3245/6674] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:37:56 2022] GET /compute/v2.1/servers/18912bca-5369-4179-8c68-24a627d48403 => generated 1398 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:37:57.275759 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d81105f8-3d9d-45e1-809b-23830ead6574 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:37:57.277433 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d81105f8-3d9d-45e1-809b-23830ead6574 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] [instance: f01381d6-d55d-4f85-bfd5-70fd8db72a02] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:37:57.286048 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d81105f8-3d9d-45e1-809b-23830ead6574 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:37:57.286637 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d81105f8-3d9d-45e1-809b-23830ead6574 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:37:57.287126 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d81105f8-3d9d-45e1-809b-23830ead6574 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:37:57.287946 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d81105f8-3d9d-45e1-809b-23830ead6574 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:37:57.288417 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d81105f8-3d9d-45e1-809b-23830ead6574 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:37:57.289453 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d81105f8-3d9d-45e1-809b-23830ead6574 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:37:57.474240 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d81105f8-3d9d-45e1-809b-23830ead6574 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a80d6de66345a0a9773ec0a4ad3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0257e250d645aea1c2f5d9737fcff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:37:57.488757 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d81105f8-3d9d-45e1-809b-23830ead6574 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] 10.222.0.50 "GET /compute/v2.1/servers/f01381d6-d55d-4f85-bfd5-70fd8db72a02" status: 200 len: 1374 microversion: 2.1 time: 0.219605 Aug 31 16:37:57.489694 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3430/6675] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:37:57 2022] GET /compute/v2.1/servers/f01381d6-d55d-4f85-bfd5-70fd8db72a02 => generated 1374 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:37:57.610075 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8474bfec-7c32-414a-82f3-0b14efccdd74 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:37:57.611734 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8474bfec-7c32-414a-82f3-0b14efccdd74 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 18912bca-5369-4179-8c68-24a627d48403] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:37:57.619375 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8474bfec-7c32-414a-82f3-0b14efccdd74 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:37:57.619848 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8474bfec-7c32-414a-82f3-0b14efccdd74 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:37:57.620546 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8474bfec-7c32-414a-82f3-0b14efccdd74 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:37:57.621764 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8474bfec-7c32-414a-82f3-0b14efccdd74 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:37:57.622297 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8474bfec-7c32-414a-82f3-0b14efccdd74 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:37:57.622947 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8474bfec-7c32-414a-82f3-0b14efccdd74 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:37:57.640194 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-8474bfec-7c32-414a-82f3-0b14efccdd74 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] HTTP exception thrown: Instance 18912bca-5369-4179-8c68-24a627d48403 could not be found. Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8474bfec-7c32-414a-82f3-0b14efccdd74 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Request method failure captured: Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/18912bca-5369-4179-8c68-24a627d48403 HTTP/1.1 Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4sA8QatsiRw58KL4D-GJAaR1X9zBGwbu0cNuaHi16Tl8K5LhZ4dthUjdeeybVrZ6FkLiuj0CnwnGa_AqwqzkMsKdZfTNQhjMqXfHtEAV5ID9oXbOsK0vGNgY-jRlE7qor7NeFM7QGwhr8KE3TJ70ugNQcxhI7ZJIKzx49vTu_Rhy18 Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 32245d85aee64f69865d98656133a539 Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-TestVolumeBootPattern-1732723367 Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/32245d85aee64f69865d98656133a539"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/32245d85aee64f69865d98656133a539"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/32245d85aee64f69865d98656133a539"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_32245d85aee64f69865d98656133a539", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-TestVolumeBootPattern-1732723367 Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 32245d85aee64f69865d98656133a539 Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TestVolumeBootPattern-1732723367 Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-TestVolumeBootPattern-1732723367-project Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: fb76a89a8b8042edb7b6aaccb4f41ead Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-TestVolumeBootPattern-1732723367-project Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 18912bca-5369-4179-8c68-24a627d48403 could not be found. Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '18912bca-5369-4179-8c68-24a627d48403'} Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18912bca-5369-4179-8c68-24a627d48403 could not be found. Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18912bca-5369-4179-8c68-24a627d48403 could not be found. Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:37:57.642268 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:37:57.649190 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:37:57.649190 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:37:57.649190 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:37:57.649190 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:37:57.649190 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:37:57.649190 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18912bca-5369-4179-8c68-24a627d48403 could not be found. Aug 31 16:37:57.649190 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:37:57.649190 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8474bfec-7c32-414a-82f3-0b14efccdd74 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Returning 404 to user: Instance 18912bca-5369-4179-8c68-24a627d48403 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:37:57.649190 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8474bfec-7c32-414a-82f3-0b14efccdd74 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/18912bca-5369-4179-8c68-24a627d48403" status: 404 len: 111 microversion: 2.1 time: 0.038879 Aug 31 16:37:57.649190 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3246/6676] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:37:57 2022] GET /compute/v2.1/servers/18912bca-5369-4179-8c68-24a627d48403 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:37:58.299232 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-3c1ce98c-4255-42e8-815f-8b01352f3f1a req-02643111-ff52-4f4d-966c-bf48d8165f50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f01381d6-d55d-4f85-bfd5-70fd8db72a02", "tag": "bec4ca9b-e612-495d-8637-2da25043600a"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:37:58.316704 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-3c1ce98c-4255-42e8-815f-8b01352f3f1a req-02643111-ff52-4f4d-966c-bf48d8165f50 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:37:58.317249 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-3c1ce98c-4255-42e8-815f-8b01352f3f1a req-02643111-ff52-4f4d-966c-bf48d8165f50 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:37:58.318132 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-3c1ce98c-4255-42e8-815f-8b01352f3f1a req-02643111-ff52-4f4d-966c-bf48d8165f50 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:37:58.345973 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-3c1ce98c-4255-42e8-815f-8b01352f3f1a req-02643111-ff52-4f4d-966c-bf48d8165f50 service nova] Creating event network-changed:bec4ca9b-e612-495d-8637-2da25043600a for instance f01381d6-d55d-4f85-bfd5-70fd8db72a02 on n-h2-833090-16 Aug 31 16:37:58.356008 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-3c1ce98c-4255-42e8-815f-8b01352f3f1a req-02643111-ff52-4f4d-966c-bf48d8165f50 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060164 Aug 31 16:37:58.357129 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3431/6677] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:37:58.451661 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f29ffec0-cbc8-465e-9aab-17df6bc3941e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:37:58.452534 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f29ffec0-cbc8-465e-9aab-17df6bc3941e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 158a6dc8-d946-4479-b3a5-ee3e97d283e8] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:37:58.458806 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f29ffec0-cbc8-465e-9aab-17df6bc3941e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:37:58.459294 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f29ffec0-cbc8-465e-9aab-17df6bc3941e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:37:58.459724 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f29ffec0-cbc8-465e-9aab-17df6bc3941e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:37:58.460427 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f29ffec0-cbc8-465e-9aab-17df6bc3941e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:37:58.460950 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f29ffec0-cbc8-465e-9aab-17df6bc3941e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:37:58.461810 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f29ffec0-cbc8-465e-9aab-17df6bc3941e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:37:58.480962 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-f29ffec0-cbc8-465e-9aab-17df6bc3941e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] HTTP exception thrown: Instance 158a6dc8-d946-4479-b3a5-ee3e97d283e8 could not be found. Aug 31 16:37:58.483088 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f29ffec0-cbc8-465e-9aab-17df6bc3941e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Request method failure captured: Aug 31 16:37:58.483088 n-d-833090-16 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8 HTTP/1.1 Aug 31 16:37:58.483088 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:37:58.483088 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:37:58.483088 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:37:58.483088 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:37:58.483088 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:37:58.483088 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:37:58.483088 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:37:58.483088 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:37:58.483088 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4sA8QatsiRw58KL4D-GJAaR1X9zBGwbu0cNuaHi16Tl8K5LhZ4dthUjdeeybVrZ6FkLiuj0CnwnGa_AqwqzkMsKdZfTNQhjMqXfHtEAV5ID9oXbOsK0vGNgY-jRlE7qor7NeFM7QGwhr8KE3TJ70ugNQcxhI7ZJIKzx49vTu_Rhy18 Aug 31 16:37:58.483088 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:37:58.483088 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:37:58.483088 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:37:58.483088 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:37:58.483088 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:37:58.483088 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:37:58.483088 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 32245d85aee64f69865d98656133a539 Aug 31 16:37:58.483088 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-TestVolumeBootPattern-1732723367 Aug 31 16:37:58.483088 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:37:58.483088 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:37:58.483088 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/32245d85aee64f69865d98656133a539"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/32245d85aee64f69865d98656133a539"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/32245d85aee64f69865d98656133a539"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_32245d85aee64f69865d98656133a539", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:37:58.483088 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-TestVolumeBootPattern-1732723367 Aug 31 16:37:58.483088 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 32245d85aee64f69865d98656133a539 Aug 31 16:37:58.483088 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TestVolumeBootPattern-1732723367 Aug 31 16:37:58.483088 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-TestVolumeBootPattern-1732723367-project Aug 31 16:37:58.483088 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:37:58.483088 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:37:58.483088 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: fb76a89a8b8042edb7b6aaccb4f41ead Aug 31 16:37:58.483088 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-TestVolumeBootPattern-1732723367-project Aug 31 16:37:58.483088 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:37:58.483088 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 158a6dc8-d946-4479-b3a5-ee3e97d283e8 could not be found. Aug 31 16:37:58.483088 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '158a6dc8-d946-4479-b3a5-ee3e97d283e8'} Aug 31 16:37:58.483088 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:37:58.483088 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:37:58.483088 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:37:58.483088 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:37:58.483088 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:37:58.483088 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:37:58.483088 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:37:58.483088 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:37:58.483088 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:37:58.483088 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:37:58.483088 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 158a6dc8-d946-4479-b3a5-ee3e97d283e8 could not be found. Aug 31 16:37:58.483088 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:37:58.483088 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:37:58.483088 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:37:58.483088 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:37:58.483088 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:37:58.483088 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:37:58.483088 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:37:58.483088 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:37:58.483088 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:37:58.483088 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:37:58.483088 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:37:58.483088 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:37:58.483088 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:37:58.483088 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:37:58.483088 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:37:58.483088 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:37:58.483088 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:37:58.483088 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:37:58.492209 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 158a6dc8-d946-4479-b3a5-ee3e97d283e8 could not be found. Aug 31 16:37:58.492209 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:37:58.492209 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:37:58.492209 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:37:58.492209 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:37:58.492209 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:37:58.492209 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:37:58.492209 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:37:58.492209 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:37:58.492209 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 158a6dc8-d946-4479-b3a5-ee3e97d283e8 could not be found. Aug 31 16:37:58.492209 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:37:58.492209 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f29ffec0-cbc8-465e-9aab-17df6bc3941e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Returning 404 to user: Instance 158a6dc8-d946-4479-b3a5-ee3e97d283e8 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:37:58.492209 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f29ffec0-cbc8-465e-9aab-17df6bc3941e tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "DELETE /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8" status: 404 len: 111 microversion: 2.1 time: 0.039229 Aug 31 16:37:58.492209 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3247/6678] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:37:58 2022] DELETE /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:37:58.497023 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-38eede26-9a14-439d-a22b-deb88134808a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:37:58.497254 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-38eede26-9a14-439d-a22b-deb88134808a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] [instance: 158a6dc8-d946-4479-b3a5-ee3e97d283e8] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:37:58.504135 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-38eede26-9a14-439d-a22b-deb88134808a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:37:58.504706 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-38eede26-9a14-439d-a22b-deb88134808a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:37:58.505504 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-38eede26-9a14-439d-a22b-deb88134808a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:37:58.506280 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-38eede26-9a14-439d-a22b-deb88134808a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:37:58.506758 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-38eede26-9a14-439d-a22b-deb88134808a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:37:58.507198 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-38eede26-9a14-439d-a22b-deb88134808a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:37:58.510080 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4bb41136-2fed-4fc1-ac59-675e5ba720a4 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:37:58.510970 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4bb41136-2fed-4fc1-ac59-675e5ba720a4 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] [instance: f01381d6-d55d-4f85-bfd5-70fd8db72a02] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:37:58.517505 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4bb41136-2fed-4fc1-ac59-675e5ba720a4 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:37:58.518157 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4bb41136-2fed-4fc1-ac59-675e5ba720a4 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:37:58.518590 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4bb41136-2fed-4fc1-ac59-675e5ba720a4 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:37:58.519555 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4bb41136-2fed-4fc1-ac59-675e5ba720a4 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:37:58.520001 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4bb41136-2fed-4fc1-ac59-675e5ba720a4 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:37:58.520590 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4bb41136-2fed-4fc1-ac59-675e5ba720a4 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:37:58.522586 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-38eede26-9a14-439d-a22b-deb88134808a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] HTTP exception thrown: Instance 158a6dc8-d946-4479-b3a5-ee3e97d283e8 could not be found. Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-38eede26-9a14-439d-a22b-deb88134808a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Request method failure captured: Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8 HTTP/1.1 Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4sA8QatsiRw58KL4D-GJAaR1X9zBGwbu0cNuaHi16Tl8K5LhZ4dthUjdeeybVrZ6FkLiuj0CnwnGa_AqwqzkMsKdZfTNQhjMqXfHtEAV5ID9oXbOsK0vGNgY-jRlE7qor7NeFM7QGwhr8KE3TJ70ugNQcxhI7ZJIKzx49vTu_Rhy18 Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 32245d85aee64f69865d98656133a539 Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-TestVolumeBootPattern-1732723367 Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/32245d85aee64f69865d98656133a539"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/32245d85aee64f69865d98656133a539"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/32245d85aee64f69865d98656133a539"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_32245d85aee64f69865d98656133a539", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-TestVolumeBootPattern-1732723367 Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 32245d85aee64f69865d98656133a539 Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-TestVolumeBootPattern-1732723367 Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-TestVolumeBootPattern-1732723367-project Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: fb76a89a8b8042edb7b6aaccb4f41ead Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-TestVolumeBootPattern-1732723367-project Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 158a6dc8-d946-4479-b3a5-ee3e97d283e8 could not be found. Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '158a6dc8-d946-4479-b3a5-ee3e97d283e8'} Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 158a6dc8-d946-4479-b3a5-ee3e97d283e8 could not be found. Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 158a6dc8-d946-4479-b3a5-ee3e97d283e8 could not be found. Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:37:58.524281 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:37:58.533268 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:37:58.533268 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:37:58.533268 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:37:58.533268 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:37:58.533268 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:37:58.533268 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 158a6dc8-d946-4479-b3a5-ee3e97d283e8 could not be found. Aug 31 16:37:58.533268 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:37:58.533268 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-38eede26-9a14-439d-a22b-deb88134808a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Returning 404 to user: Instance 158a6dc8-d946-4479-b3a5-ee3e97d283e8 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:37:58.533268 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-38eede26-9a14-439d-a22b-deb88134808a tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "GET /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8" status: 404 len: 111 microversion: 2.1 time: 0.035378 Aug 31 16:37:58.533268 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3432/6679] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:37:58 2022] GET /compute/v2.1/servers/158a6dc8-d946-4479-b3a5-ee3e97d283e8 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:37:58.689257 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4bb41136-2fed-4fc1-ac59-675e5ba720a4 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a80d6de66345a0a9773ec0a4ad3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0257e250d645aea1c2f5d9737fcff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:37:58.698963 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4bb41136-2fed-4fc1-ac59-675e5ba720a4 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] 10.222.0.50 "GET /compute/v2.1/servers/f01381d6-d55d-4f85-bfd5-70fd8db72a02" status: 200 len: 1374 microversion: 2.1 time: 0.192127 Aug 31 16:37:58.710922 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3248/6680] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:37:58 2022] GET /compute/v2.1/servers/f01381d6-d55d-4f85-bfd5-70fd8db72a02 => generated 1374 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:37:59.720790 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-66546523-c2f6-434e-b62d-7646695d64ed tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:37:59.721459 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-66546523-c2f6-434e-b62d-7646695d64ed tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] [instance: f01381d6-d55d-4f85-bfd5-70fd8db72a02] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:37:59.729467 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-66546523-c2f6-434e-b62d-7646695d64ed tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:37:59.729974 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-66546523-c2f6-434e-b62d-7646695d64ed tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:37:59.730532 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-66546523-c2f6-434e-b62d-7646695d64ed tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:37:59.731240 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-66546523-c2f6-434e-b62d-7646695d64ed tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:37:59.731706 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-66546523-c2f6-434e-b62d-7646695d64ed tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:37:59.732137 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-66546523-c2f6-434e-b62d-7646695d64ed tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:37:59.881330 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-66546523-c2f6-434e-b62d-7646695d64ed tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a80d6de66345a0a9773ec0a4ad3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0257e250d645aea1c2f5d9737fcff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:37:59.891792 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-66546523-c2f6-434e-b62d-7646695d64ed tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] 10.222.0.50 "GET /compute/v2.1/servers/f01381d6-d55d-4f85-bfd5-70fd8db72a02" status: 200 len: 1374 microversion: 2.1 time: 0.174964 Aug 31 16:37:59.892376 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3433/6681] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:37:59 2022] GET /compute/v2.1/servers/f01381d6-d55d-4f85-bfd5-70fd8db72a02 => generated 1374 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:38:00.913884 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e8e4db47-69c8-4ae2-8e86-a8f0a83c9838 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:38:00.914683 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e8e4db47-69c8-4ae2-8e86-a8f0a83c9838 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] [instance: f01381d6-d55d-4f85-bfd5-70fd8db72a02] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:38:00.923266 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8e4db47-69c8-4ae2-8e86-a8f0a83c9838 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:38:00.923885 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8e4db47-69c8-4ae2-8e86-a8f0a83c9838 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:38:00.924463 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8e4db47-69c8-4ae2-8e86-a8f0a83c9838 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:38:00.925270 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8e4db47-69c8-4ae2-8e86-a8f0a83c9838 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:38:00.925837 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8e4db47-69c8-4ae2-8e86-a8f0a83c9838 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:38:00.926390 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8e4db47-69c8-4ae2-8e86-a8f0a83c9838 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:38:01.074447 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e8e4db47-69c8-4ae2-8e86-a8f0a83c9838 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a80d6de66345a0a9773ec0a4ad3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0257e250d645aea1c2f5d9737fcff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:38:01.091229 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e8e4db47-69c8-4ae2-8e86-a8f0a83c9838 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] 10.222.0.50 "GET /compute/v2.1/servers/f01381d6-d55d-4f85-bfd5-70fd8db72a02" status: 200 len: 1374 microversion: 2.1 time: 0.181394 Aug 31 16:38:01.099410 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3249/6682] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:38:00 2022] GET /compute/v2.1/servers/f01381d6-d55d-4f85-bfd5-70fd8db72a02 => generated 1374 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:38:01.982583 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e1445bf7-2a47-4980-bafe-6ff492dbe666 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] Calling method '.version_select at 0x7fbb45564700>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:38:02.009318 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e1445bf7-2a47-4980-bafe-6ff492dbe666 tempest-TestVolumeBootPattern-1732723367 tempest-TestVolumeBootPattern-1732723367-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1295463571" status: 202 len: 0 microversion: 2.1 time: 0.032672 Aug 31 16:38:02.010309 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3434/6683] 10.222.0.50 () {58 vars in 1263 bytes} [Wed Aug 31 16:38:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1295463571 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:38:02.113273 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bfd0b3e1-5763-4701-a957-05fb4b2aba76 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:38:02.113923 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bfd0b3e1-5763-4701-a957-05fb4b2aba76 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] [instance: f01381d6-d55d-4f85-bfd5-70fd8db72a02] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:38:02.123758 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfd0b3e1-5763-4701-a957-05fb4b2aba76 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:38:02.124252 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfd0b3e1-5763-4701-a957-05fb4b2aba76 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:38:02.124683 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfd0b3e1-5763-4701-a957-05fb4b2aba76 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:38:02.125450 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfd0b3e1-5763-4701-a957-05fb4b2aba76 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:38:02.125925 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfd0b3e1-5763-4701-a957-05fb4b2aba76 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:38:02.126311 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bfd0b3e1-5763-4701-a957-05fb4b2aba76 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:38:02.416950 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bfd0b3e1-5763-4701-a957-05fb4b2aba76 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a80d6de66345a0a9773ec0a4ad3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0257e250d645aea1c2f5d9737fcff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:38:02.420950 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:38:02.427720 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bfd0b3e1-5763-4701-a957-05fb4b2aba76 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] 10.222.0.50 "GET /compute/v2.1/servers/f01381d6-d55d-4f85-bfd5-70fd8db72a02" status: 200 len: 1374 microversion: 2.1 time: 0.319420 Aug 31 16:38:02.428346 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3250/6684] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:38:02 2022] GET /compute/v2.1/servers/f01381d6-d55d-4f85-bfd5-70fd8db72a02 => generated 1374 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:38:03.081907 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-53951d80-654c-4566-8922-bdcb5a80c097 req-f7a7c37d-0b5e-44aa-93bf-509d4e3ad5f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f01381d6-d55d-4f85-bfd5-70fd8db72a02", "name": "network-vif-plugged", "status": "completed", "tag": "bec4ca9b-e612-495d-8637-2da25043600a"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:38:03.095908 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-53951d80-654c-4566-8922-bdcb5a80c097 req-f7a7c37d-0b5e-44aa-93bf-509d4e3ad5f0 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:38:03.096403 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-53951d80-654c-4566-8922-bdcb5a80c097 req-f7a7c37d-0b5e-44aa-93bf-509d4e3ad5f0 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:38:03.096850 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-53951d80-654c-4566-8922-bdcb5a80c097 req-f7a7c37d-0b5e-44aa-93bf-509d4e3ad5f0 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:38:03.108291 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-53951d80-654c-4566-8922-bdcb5a80c097 req-f7a7c37d-0b5e-44aa-93bf-509d4e3ad5f0 service nova] Creating event network-vif-plugged:bec4ca9b-e612-495d-8637-2da25043600a for instance f01381d6-d55d-4f85-bfd5-70fd8db72a02 on n-h2-833090-16 Aug 31 16:38:03.113591 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-53951d80-654c-4566-8922-bdcb5a80c097 req-f7a7c37d-0b5e-44aa-93bf-509d4e3ad5f0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115880 Aug 31 16:38:03.114695 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3435/6685] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:38:03.457288 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-58509eaf-a18f-4f89-b3ff-db03f95b61ac tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:38:03.458013 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-58509eaf-a18f-4f89-b3ff-db03f95b61ac tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] [instance: f01381d6-d55d-4f85-bfd5-70fd8db72a02] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:38:03.466742 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58509eaf-a18f-4f89-b3ff-db03f95b61ac tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:38:03.467434 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58509eaf-a18f-4f89-b3ff-db03f95b61ac tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:38:03.467758 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58509eaf-a18f-4f89-b3ff-db03f95b61ac tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:38:03.468903 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58509eaf-a18f-4f89-b3ff-db03f95b61ac tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:38:03.469438 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58509eaf-a18f-4f89-b3ff-db03f95b61ac tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:38:03.469933 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58509eaf-a18f-4f89-b3ff-db03f95b61ac tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:38:03.696948 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-58509eaf-a18f-4f89-b3ff-db03f95b61ac tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a80d6de66345a0a9773ec0a4ad3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0257e250d645aea1c2f5d9737fcff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:38:03.705897 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-58509eaf-a18f-4f89-b3ff-db03f95b61ac tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] 10.222.0.50 "GET /compute/v2.1/servers/f01381d6-d55d-4f85-bfd5-70fd8db72a02" status: 200 len: 1374 microversion: 2.1 time: 0.254755 Aug 31 16:38:03.718196 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3251/6686] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:38:03 2022] GET /compute/v2.1/servers/f01381d6-d55d-4f85-bfd5-70fd8db72a02 => generated 1374 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:38:04.729147 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1f123e88-ed08-4f27-8202-8f8ce46eaf51 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:38:04.730945 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1f123e88-ed08-4f27-8202-8f8ce46eaf51 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] [instance: f01381d6-d55d-4f85-bfd5-70fd8db72a02] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:38:04.733964 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:38:04.740456 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1f123e88-ed08-4f27-8202-8f8ce46eaf51 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:38:04.740958 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1f123e88-ed08-4f27-8202-8f8ce46eaf51 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:38:04.741438 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1f123e88-ed08-4f27-8202-8f8ce46eaf51 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:38:04.742178 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1f123e88-ed08-4f27-8202-8f8ce46eaf51 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:38:04.742641 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1f123e88-ed08-4f27-8202-8f8ce46eaf51 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:38:04.743069 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1f123e88-ed08-4f27-8202-8f8ce46eaf51 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:38:04.748267 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:38:05.037551 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1f123e88-ed08-4f27-8202-8f8ce46eaf51 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a80d6de66345a0a9773ec0a4ad3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0257e250d645aea1c2f5d9737fcff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:38:05.049315 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1f123e88-ed08-4f27-8202-8f8ce46eaf51 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] 10.222.0.50 "GET /compute/v2.1/servers/f01381d6-d55d-4f85-bfd5-70fd8db72a02" status: 200 len: 1547 microversion: 2.1 time: 0.324540 Aug 31 16:38:05.064775 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3436/6687] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:38:04 2022] GET /compute/v2.1/servers/f01381d6-d55d-4f85-bfd5-70fd8db72a02 => generated 1547 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:38:05.070836 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e9053ad4-7431-4d68-9573-41f1b8041fc6 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:38:05.071450 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e9053ad4-7431-4d68-9573-41f1b8041fc6 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] [instance: f01381d6-d55d-4f85-bfd5-70fd8db72a02] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:38:05.074934 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:38:05.076992 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:38:05.077705 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:38:05.084614 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9053ad4-7431-4d68-9573-41f1b8041fc6 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:38:05.085103 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9053ad4-7431-4d68-9573-41f1b8041fc6 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:38:05.085724 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9053ad4-7431-4d68-9573-41f1b8041fc6 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:38:05.086468 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9053ad4-7431-4d68-9573-41f1b8041fc6 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:38:05.086917 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9053ad4-7431-4d68-9573-41f1b8041fc6 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:38:05.087331 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9053ad4-7431-4d68-9573-41f1b8041fc6 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:38:05.246295 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e9053ad4-7431-4d68-9573-41f1b8041fc6 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a80d6de66345a0a9773ec0a4ad3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0257e250d645aea1c2f5d9737fcff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:38:05.255537 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e9053ad4-7431-4d68-9573-41f1b8041fc6 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] 10.222.0.50 "GET /compute/v2.1/servers/f01381d6-d55d-4f85-bfd5-70fd8db72a02" status: 200 len: 1547 microversion: 2.1 time: 0.188895 Aug 31 16:38:05.256148 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3252/6688] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:38:05 2022] GET /compute/v2.1/servers/f01381d6-d55d-4f85-bfd5-70fd8db72a02 => generated 1547 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:38:08.101525 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-8afc1244-dc1b-4126-ba18-5c81e27294ee req-872a0081-cfea-4df3-8d3e-6855f95e7041 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f01381d6-d55d-4f85-bfd5-70fd8db72a02", "tag": "bec4ca9b-e612-495d-8637-2da25043600a"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:38:08.112235 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=6 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:38:08.132027 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-8afc1244-dc1b-4126-ba18-5c81e27294ee req-872a0081-cfea-4df3-8d3e-6855f95e7041 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:38:08.132820 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-8afc1244-dc1b-4126-ba18-5c81e27294ee req-872a0081-cfea-4df3-8d3e-6855f95e7041 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:38:08.134066 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-8afc1244-dc1b-4126-ba18-5c81e27294ee req-872a0081-cfea-4df3-8d3e-6855f95e7041 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:38:08.159454 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-8afc1244-dc1b-4126-ba18-5c81e27294ee req-872a0081-cfea-4df3-8d3e-6855f95e7041 service nova] Creating event network-changed:bec4ca9b-e612-495d-8637-2da25043600a for instance f01381d6-d55d-4f85-bfd5-70fd8db72a02 on n-h2-833090-16 Aug 31 16:38:08.174125 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-8afc1244-dc1b-4126-ba18-5c81e27294ee req-872a0081-cfea-4df3-8d3e-6855f95e7041 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076436 Aug 31 16:38:08.175915 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3437/6689] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:38:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:38:44.562294 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-09e1be49-f4d6-4e5e-8163-066dfdfa62ed tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:38:44.564732 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-09e1be49-f4d6-4e5e-8163-066dfdfa62ed tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] [instance: f01381d6-d55d-4f85-bfd5-70fd8db72a02] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:38:44.567332 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:38:44.567989 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=12 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:38:44.575482 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09e1be49-f4d6-4e5e-8163-066dfdfa62ed tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:38:44.575947 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09e1be49-f4d6-4e5e-8163-066dfdfa62ed tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:38:44.576441 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09e1be49-f4d6-4e5e-8163-066dfdfa62ed tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:38:44.577153 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09e1be49-f4d6-4e5e-8163-066dfdfa62ed tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:38:44.577639 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09e1be49-f4d6-4e5e-8163-066dfdfa62ed tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:38:44.578037 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09e1be49-f4d6-4e5e-8163-066dfdfa62ed tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:38:44.648894 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-09e1be49-f4d6-4e5e-8163-066dfdfa62ed tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] 10.222.0.50 "POST /compute/v2.1/servers/f01381d6-d55d-4f85-bfd5-70fd8db72a02/action" status: 200 len: 24573 microversion: 2.1 time: 0.090834 Aug 31 16:38:44.649577 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3253/6690] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:38:44 2022] POST /compute/v2.1/servers/f01381d6-d55d-4f85-bfd5-70fd8db72a02/action => generated 24573 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:39:28.580812 n-d-833090-16 devstack@n-api.service[128864]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 16:39:28.581365 n-d-833090-16 devstack@n-api.service[128864]: Wed Aug 31 16:39:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.50) !!! Aug 31 16:39:28.584320 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=3 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:39:28.585252 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=7 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:39:28.592706 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b00a436a-a0ba-4206-b89b-3ad6aa76f6ff tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Action: 'create', calling method: .version_select at 0x7fbb4565d280>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1237667588", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIN5AsILZ4KxYojw1t9lLQFnBhtt2ExH2QztfKG0QdyiQIrU/jrbUbk68NfsBoGEEVeFA53wV8ezHainfVXfpri+e6VHicSQ5NKrG/iCxKINrUt+A5Oo7xwzxd5ww+diJg=="}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:39:28.622639 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-b00a436a-a0ba-4206-b89b-3ad6aa76f6ff tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Getting quotas for project ca0257e250d645aea1c2f5d9737fcff5. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:39:28.630494 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-b00a436a-a0ba-4206-b89b-3ad6aa76f6ff tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Getting quotas for user c0a80d6de66345a0a9773ec0a4ad3855 and project ca0257e250d645aea1c2f5d9737fcff5. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:39:28.663796 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b00a436a-a0ba-4206-b89b-3ad6aa76f6ff tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.084291 Aug 31 16:39:28.664428 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3438/6691] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 31 16:39:28 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:39:29.841321 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1fcfe89e-323f-457a-b483-0c4c5bb30919 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1567499410", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "8a2f9c79-6d90-4f2b-8bcc-ef1ab35d01e2"}], "key_name": "tempest-TestNetworkBasicOps-1237667588", "security_groups": [{"name": "tempest-secgroup-smoke-1717297568"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:39:29.850520 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:39:29.851178 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:39:29.852059 n-d-833090-16 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 16:39:29.852194 n-d-833090-16 devstack@n-api.service[128863]: Wed Aug 31 16:39:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.50) !!! Aug 31 16:39:29.963571 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-1fcfe89e-323f-457a-b483-0c4c5bb30919 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] validate_networks() for [('8a2f9c79-6d90-4f2b-8bcc-ef1ab35d01e2', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:39:30.381041 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-1fcfe89e-323f-457a-b483-0c4c5bb30919 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:39:30.381571 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-1fcfe89e-323f-457a-b483-0c4c5bb30919 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:39:30.382176 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-1fcfe89e-323f-457a-b483-0c4c5bb30919 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:39:30.382681 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-1fcfe89e-323f-457a-b483-0c4c5bb30919 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:39:30.383202 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-1fcfe89e-323f-457a-b483-0c4c5bb30919 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:39:30.394644 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1fcfe89e-323f-457a-b483-0c4c5bb30919 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:30.395206 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1fcfe89e-323f-457a-b483-0c4c5bb30919 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:30.395717 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1fcfe89e-323f-457a-b483-0c4c5bb30919 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:30.396548 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1fcfe89e-323f-457a-b483-0c4c5bb30919 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:30.397028 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1fcfe89e-323f-457a-b483-0c4c5bb30919 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:30.397637 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1fcfe89e-323f-457a-b483-0c4c5bb30919 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:30.421165 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-1fcfe89e-323f-457a-b483-0c4c5bb30919 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Getting quotas for project ca0257e250d645aea1c2f5d9737fcff5. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:39:30.427017 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-1fcfe89e-323f-457a-b483-0c4c5bb30919 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Getting quotas for user c0a80d6de66345a0a9773ec0a4ad3855 and project ca0257e250d645aea1c2f5d9737fcff5. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:39:30.444914 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1fcfe89e-323f-457a-b483-0c4c5bb30919 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:39:30.447732 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1fcfe89e-323f-457a-b483-0c4c5bb30919 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] [instance: fbf437b3-252f-43f1-8901-5020d8fd5e55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:39:30.501792 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1fcfe89e-323f-457a-b483-0c4c5bb30919 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.665598 Aug 31 16:39:30.502487 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3254/6692] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:39:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:39:30.514951 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3b50055b-10ae-46cc-b2bf-5cfc0db7bbfa tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:39:30.515719 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3b50055b-10ae-46cc-b2bf-5cfc0db7bbfa tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] [instance: fbf437b3-252f-43f1-8901-5020d8fd5e55] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:39:30.581702 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3b50055b-10ae-46cc-b2bf-5cfc0db7bbfa tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a80d6de66345a0a9773ec0a4ad3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0257e250d645aea1c2f5d9737fcff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:39:30.589176 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3b50055b-10ae-46cc-b2bf-5cfc0db7bbfa tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] 10.222.0.50 "GET /compute/v2.1/servers/fbf437b3-252f-43f1-8901-5020d8fd5e55" status: 200 len: 1249 microversion: 2.1 time: 0.079408 Aug 31 16:39:30.590254 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3439/6693] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:39:30 2022] GET /compute/v2.1/servers/fbf437b3-252f-43f1-8901-5020d8fd5e55 => generated 1249 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:39:31.613725 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ea240a0a-c56c-4d60-b991-78dfc49d56f1 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:39:31.614286 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ea240a0a-c56c-4d60-b991-78dfc49d56f1 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] [instance: fbf437b3-252f-43f1-8901-5020d8fd5e55] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:39:31.622448 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea240a0a-c56c-4d60-b991-78dfc49d56f1 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:31.623028 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea240a0a-c56c-4d60-b991-78dfc49d56f1 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:31.623391 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea240a0a-c56c-4d60-b991-78dfc49d56f1 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:31.624093 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea240a0a-c56c-4d60-b991-78dfc49d56f1 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:31.624793 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea240a0a-c56c-4d60-b991-78dfc49d56f1 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:31.625217 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ea240a0a-c56c-4d60-b991-78dfc49d56f1 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:31.697826 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ea240a0a-c56c-4d60-b991-78dfc49d56f1 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a80d6de66345a0a9773ec0a4ad3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0257e250d645aea1c2f5d9737fcff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:39:31.706429 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ea240a0a-c56c-4d60-b991-78dfc49d56f1 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] 10.222.0.50 "GET /compute/v2.1/servers/fbf437b3-252f-43f1-8901-5020d8fd5e55" status: 200 len: 1301 microversion: 2.1 time: 0.099364 Aug 31 16:39:31.707051 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3255/6694] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:39:31 2022] GET /compute/v2.1/servers/fbf437b3-252f-43f1-8901-5020d8fd5e55 => generated 1301 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:39:32.729943 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-45f8d7ee-bf24-4660-97d9-5f5669102894 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:39:32.730649 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-45f8d7ee-bf24-4660-97d9-5f5669102894 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] [instance: fbf437b3-252f-43f1-8901-5020d8fd5e55] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:39:32.739883 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-45f8d7ee-bf24-4660-97d9-5f5669102894 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:32.740384 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-45f8d7ee-bf24-4660-97d9-5f5669102894 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:32.740987 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-45f8d7ee-bf24-4660-97d9-5f5669102894 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:32.741868 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-45f8d7ee-bf24-4660-97d9-5f5669102894 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:32.742517 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-45f8d7ee-bf24-4660-97d9-5f5669102894 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:32.742951 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-45f8d7ee-bf24-4660-97d9-5f5669102894 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:32.910635 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-45f8d7ee-bf24-4660-97d9-5f5669102894 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a80d6de66345a0a9773ec0a4ad3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0257e250d645aea1c2f5d9737fcff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:39:32.919957 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-45f8d7ee-bf24-4660-97d9-5f5669102894 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] 10.222.0.50 "GET /compute/v2.1/servers/fbf437b3-252f-43f1-8901-5020d8fd5e55" status: 200 len: 1375 microversion: 2.1 time: 0.195647 Aug 31 16:39:32.920490 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3440/6695] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:39:32 2022] GET /compute/v2.1/servers/fbf437b3-252f-43f1-8901-5020d8fd5e55 => generated 1375 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:39:33.115213 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-d8f3a328-55cd-48da-af09-f0a1166c3e62 req-615f467d-f0af-468f-b12f-1199ea3bed00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbf437b3-252f-43f1-8901-5020d8fd5e55", "tag": "2c3d41bc-41cc-45a8-ae49-e404c8541ffd"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:39:33.127791 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d8f3a328-55cd-48da-af09-f0a1166c3e62 req-615f467d-f0af-468f-b12f-1199ea3bed00 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:33.128568 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d8f3a328-55cd-48da-af09-f0a1166c3e62 req-615f467d-f0af-468f-b12f-1199ea3bed00 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:33.128965 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d8f3a328-55cd-48da-af09-f0a1166c3e62 req-615f467d-f0af-468f-b12f-1199ea3bed00 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:33.142575 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-d8f3a328-55cd-48da-af09-f0a1166c3e62 req-615f467d-f0af-468f-b12f-1199ea3bed00 service nova] Creating event network-changed:2c3d41bc-41cc-45a8-ae49-e404c8541ffd for instance fbf437b3-252f-43f1-8901-5020d8fd5e55 on n-h1-833090-16 Aug 31 16:39:33.155425 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-d8f3a328-55cd-48da-af09-f0a1166c3e62 req-615f467d-f0af-468f-b12f-1199ea3bed00 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044000 Aug 31 16:39:33.158147 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3256/6696] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:39:33.942340 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f68ff993-08db-4b16-8105-2f7971e6bd0b tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:39:33.942970 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f68ff993-08db-4b16-8105-2f7971e6bd0b tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] [instance: fbf437b3-252f-43f1-8901-5020d8fd5e55] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:39:33.950747 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f68ff993-08db-4b16-8105-2f7971e6bd0b tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:33.951234 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f68ff993-08db-4b16-8105-2f7971e6bd0b tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:33.951679 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f68ff993-08db-4b16-8105-2f7971e6bd0b tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:33.952400 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f68ff993-08db-4b16-8105-2f7971e6bd0b tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:33.952864 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f68ff993-08db-4b16-8105-2f7971e6bd0b tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:33.953297 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f68ff993-08db-4b16-8105-2f7971e6bd0b tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:34.102047 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f68ff993-08db-4b16-8105-2f7971e6bd0b tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a80d6de66345a0a9773ec0a4ad3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0257e250d645aea1c2f5d9737fcff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:39:34.110584 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f68ff993-08db-4b16-8105-2f7971e6bd0b tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] 10.222.0.50 "GET /compute/v2.1/servers/fbf437b3-252f-43f1-8901-5020d8fd5e55" status: 200 len: 1375 microversion: 2.1 time: 0.172258 Aug 31 16:39:34.111136 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3441/6697] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:39:33 2022] GET /compute/v2.1/servers/fbf437b3-252f-43f1-8901-5020d8fd5e55 => generated 1375 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:39:35.137227 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3824c529-ef2c-4395-93df-8dba46ecd21a tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:39:35.137961 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3824c529-ef2c-4395-93df-8dba46ecd21a tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] [instance: fbf437b3-252f-43f1-8901-5020d8fd5e55] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:39:35.147225 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3824c529-ef2c-4395-93df-8dba46ecd21a tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:35.147920 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3824c529-ef2c-4395-93df-8dba46ecd21a tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:35.148539 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3824c529-ef2c-4395-93df-8dba46ecd21a tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:35.149377 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3824c529-ef2c-4395-93df-8dba46ecd21a tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:35.150152 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3824c529-ef2c-4395-93df-8dba46ecd21a tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:35.150790 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3824c529-ef2c-4395-93df-8dba46ecd21a tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:35.301421 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3824c529-ef2c-4395-93df-8dba46ecd21a tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a80d6de66345a0a9773ec0a4ad3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0257e250d645aea1c2f5d9737fcff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:39:35.309924 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3824c529-ef2c-4395-93df-8dba46ecd21a tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] 10.222.0.50 "GET /compute/v2.1/servers/fbf437b3-252f-43f1-8901-5020d8fd5e55" status: 200 len: 1375 microversion: 2.1 time: 0.180670 Aug 31 16:39:35.310546 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3257/6698] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:39:35 2022] GET /compute/v2.1/servers/fbf437b3-252f-43f1-8901-5020d8fd5e55 => generated 1375 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:39:36.331092 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8b874f09-3f36-46ab-a125-fbe8faf425ba tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:39:36.331719 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8b874f09-3f36-46ab-a125-fbe8faf425ba tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] [instance: fbf437b3-252f-43f1-8901-5020d8fd5e55] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:39:36.338769 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b874f09-3f36-46ab-a125-fbe8faf425ba tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:36.339265 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b874f09-3f36-46ab-a125-fbe8faf425ba tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:36.339711 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b874f09-3f36-46ab-a125-fbe8faf425ba tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:36.340985 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b874f09-3f36-46ab-a125-fbe8faf425ba tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:36.340985 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b874f09-3f36-46ab-a125-fbe8faf425ba tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:36.341306 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b874f09-3f36-46ab-a125-fbe8faf425ba tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:36.508251 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8b874f09-3f36-46ab-a125-fbe8faf425ba tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a80d6de66345a0a9773ec0a4ad3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0257e250d645aea1c2f5d9737fcff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:39:36.516763 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8b874f09-3f36-46ab-a125-fbe8faf425ba tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] 10.222.0.50 "GET /compute/v2.1/servers/fbf437b3-252f-43f1-8901-5020d8fd5e55" status: 200 len: 1375 microversion: 2.1 time: 0.189576 Aug 31 16:39:36.517364 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3442/6699] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:39:36 2022] GET /compute/v2.1/servers/fbf437b3-252f-43f1-8901-5020d8fd5e55 => generated 1375 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:39:37.539987 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-53dab509-5d5f-482a-8a75-787aac3def2b tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:39:37.540598 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-53dab509-5d5f-482a-8a75-787aac3def2b tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] [instance: fbf437b3-252f-43f1-8901-5020d8fd5e55] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:39:37.548323 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-53dab509-5d5f-482a-8a75-787aac3def2b tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:37.549328 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-53dab509-5d5f-482a-8a75-787aac3def2b tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:37.549328 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-53dab509-5d5f-482a-8a75-787aac3def2b tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:37.550566 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-53dab509-5d5f-482a-8a75-787aac3def2b tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:37.550566 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-53dab509-5d5f-482a-8a75-787aac3def2b tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:37.550892 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-53dab509-5d5f-482a-8a75-787aac3def2b tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:37.699660 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-53dab509-5d5f-482a-8a75-787aac3def2b tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a80d6de66345a0a9773ec0a4ad3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0257e250d645aea1c2f5d9737fcff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:39:37.710905 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-53dab509-5d5f-482a-8a75-787aac3def2b tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] 10.222.0.50 "GET /compute/v2.1/servers/fbf437b3-252f-43f1-8901-5020d8fd5e55" status: 200 len: 1375 microversion: 2.1 time: 0.175469 Aug 31 16:39:37.711519 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3258/6700] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:39:37 2022] GET /compute/v2.1/servers/fbf437b3-252f-43f1-8901-5020d8fd5e55 => generated 1375 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:39:38.422199 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-74b7e4f2-9d14-4a91-b23c-9a3ab105508d req-2c0da729-c55f-453d-b867-83a3c7fea042 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbf437b3-252f-43f1-8901-5020d8fd5e55", "name": "network-vif-plugged", "status": "completed", "tag": "2c3d41bc-41cc-45a8-ae49-e404c8541ffd"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:39:38.433868 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-74b7e4f2-9d14-4a91-b23c-9a3ab105508d req-2c0da729-c55f-453d-b867-83a3c7fea042 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:38.434491 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-74b7e4f2-9d14-4a91-b23c-9a3ab105508d req-2c0da729-c55f-453d-b867-83a3c7fea042 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:38.435001 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-74b7e4f2-9d14-4a91-b23c-9a3ab105508d req-2c0da729-c55f-453d-b867-83a3c7fea042 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:38.449663 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-74b7e4f2-9d14-4a91-b23c-9a3ab105508d req-2c0da729-c55f-453d-b867-83a3c7fea042 service nova] Creating event network-vif-plugged:2c3d41bc-41cc-45a8-ae49-e404c8541ffd for instance fbf437b3-252f-43f1-8901-5020d8fd5e55 on n-h1-833090-16 Aug 31 16:39:38.455303 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-74b7e4f2-9d14-4a91-b23c-9a3ab105508d req-2c0da729-c55f-453d-b867-83a3c7fea042 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037959 Aug 31 16:39:38.456171 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3443/6701] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:39:38.734044 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-15f09704-a769-406d-96f4-f58f6c6ea482 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:39:38.734941 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-15f09704-a769-406d-96f4-f58f6c6ea482 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] [instance: fbf437b3-252f-43f1-8901-5020d8fd5e55] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:39:38.746704 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-15f09704-a769-406d-96f4-f58f6c6ea482 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:38.747208 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-15f09704-a769-406d-96f4-f58f6c6ea482 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:38.747644 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-15f09704-a769-406d-96f4-f58f6c6ea482 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:38.748352 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-15f09704-a769-406d-96f4-f58f6c6ea482 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:38.748806 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-15f09704-a769-406d-96f4-f58f6c6ea482 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:38.749224 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-15f09704-a769-406d-96f4-f58f6c6ea482 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:39.127123 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-15f09704-a769-406d-96f4-f58f6c6ea482 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a80d6de66345a0a9773ec0a4ad3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0257e250d645aea1c2f5d9737fcff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:39:39.135665 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-15f09704-a769-406d-96f4-f58f6c6ea482 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] 10.222.0.50 "GET /compute/v2.1/servers/fbf437b3-252f-43f1-8901-5020d8fd5e55" status: 200 len: 1375 microversion: 2.1 time: 0.405792 Aug 31 16:39:39.136266 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3259/6702] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:39:38 2022] GET /compute/v2.1/servers/fbf437b3-252f-43f1-8901-5020d8fd5e55 => generated 1375 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:39:40.158580 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6153c442-0d10-4e46-a0df-1f2703c12c32 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:39:40.159192 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6153c442-0d10-4e46-a0df-1f2703c12c32 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] [instance: fbf437b3-252f-43f1-8901-5020d8fd5e55] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:39:40.167524 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6153c442-0d10-4e46-a0df-1f2703c12c32 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:40.168013 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6153c442-0d10-4e46-a0df-1f2703c12c32 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:40.168466 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6153c442-0d10-4e46-a0df-1f2703c12c32 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:40.169193 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6153c442-0d10-4e46-a0df-1f2703c12c32 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:40.169664 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6153c442-0d10-4e46-a0df-1f2703c12c32 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:40.170133 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6153c442-0d10-4e46-a0df-1f2703c12c32 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:40.372248 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6153c442-0d10-4e46-a0df-1f2703c12c32 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a80d6de66345a0a9773ec0a4ad3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0257e250d645aea1c2f5d9737fcff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:39:40.380422 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6153c442-0d10-4e46-a0df-1f2703c12c32 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] 10.222.0.50 "GET /compute/v2.1/servers/fbf437b3-252f-43f1-8901-5020d8fd5e55" status: 200 len: 1547 microversion: 2.1 time: 0.226467 Aug 31 16:39:40.381017 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3444/6703] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:39:40 2022] GET /compute/v2.1/servers/fbf437b3-252f-43f1-8901-5020d8fd5e55 => generated 1547 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:39:40.400735 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d7fe1ddc-d5e1-4edb-be0c-abcda26fc8f9 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:39:40.401339 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d7fe1ddc-d5e1-4edb-be0c-abcda26fc8f9 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] [instance: fbf437b3-252f-43f1-8901-5020d8fd5e55] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:39:40.408220 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:39:40.409678 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7fe1ddc-d5e1-4edb-be0c-abcda26fc8f9 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:40.410491 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7fe1ddc-d5e1-4edb-be0c-abcda26fc8f9 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:40.411094 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7fe1ddc-d5e1-4edb-be0c-abcda26fc8f9 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:40.411684 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7fe1ddc-d5e1-4edb-be0c-abcda26fc8f9 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:39:40.412120 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7fe1ddc-d5e1-4edb-be0c-abcda26fc8f9 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:39:40.412532 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7fe1ddc-d5e1-4edb-be0c-abcda26fc8f9 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:39:40.435991 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:39:40.559481 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d7fe1ddc-d5e1-4edb-be0c-abcda26fc8f9 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a80d6de66345a0a9773ec0a4ad3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0257e250d645aea1c2f5d9737fcff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:39:40.571534 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d7fe1ddc-d5e1-4edb-be0c-abcda26fc8f9 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] 10.222.0.50 "GET /compute/v2.1/servers/fbf437b3-252f-43f1-8901-5020d8fd5e55" status: 200 len: 1547 microversion: 2.1 time: 0.174541 Aug 31 16:39:40.572398 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3260/6704] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:39:40 2022] GET /compute/v2.1/servers/fbf437b3-252f-43f1-8901-5020d8fd5e55 => generated 1547 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:40:06.452958 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c0508b53-6ff5-4b7d-9650-31315a6f0302 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:40:06.453438 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c0508b53-6ff5-4b7d-9650-31315a6f0302 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] [instance: fbf437b3-252f-43f1-8901-5020d8fd5e55] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:40:06.455545 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=6 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:40:06.456367 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:40:06.456995 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=26 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:40:06.462978 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c0508b53-6ff5-4b7d-9650-31315a6f0302 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:06.463476 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c0508b53-6ff5-4b7d-9650-31315a6f0302 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:06.463917 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c0508b53-6ff5-4b7d-9650-31315a6f0302 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:06.464625 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c0508b53-6ff5-4b7d-9650-31315a6f0302 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:06.465079 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c0508b53-6ff5-4b7d-9650-31315a6f0302 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:06.465505 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c0508b53-6ff5-4b7d-9650-31315a6f0302 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:06.493332 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c0508b53-6ff5-4b7d-9650-31315a6f0302 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] [instance: fbf437b3-252f-43f1-8901-5020d8fd5e55] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:40:06.581092 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c0508b53-6ff5-4b7d-9650-31315a6f0302 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] 10.222.0.50 "DELETE /compute/v2.1/servers/fbf437b3-252f-43f1-8901-5020d8fd5e55" status: 204 len: 0 microversion: 2.1 time: 0.131863 Aug 31 16:40:06.585011 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3445/6705] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:40:06 2022] DELETE /compute/v2.1/servers/fbf437b3-252f-43f1-8901-5020d8fd5e55 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:40:06.590240 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0c00beed-a74b-4840-b2fa-303ace88cac8 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:40:06.590840 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0c00beed-a74b-4840-b2fa-303ace88cac8 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] [instance: fbf437b3-252f-43f1-8901-5020d8fd5e55] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:40:06.594531 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:40:06.595367 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=34 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:40:06.599183 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c00beed-a74b-4840-b2fa-303ace88cac8 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:06.599663 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c00beed-a74b-4840-b2fa-303ace88cac8 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:06.600334 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c00beed-a74b-4840-b2fa-303ace88cac8 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:06.601030 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c00beed-a74b-4840-b2fa-303ace88cac8 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:06.601475 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c00beed-a74b-4840-b2fa-303ace88cac8 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:06.601886 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c00beed-a74b-4840-b2fa-303ace88cac8 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:06.744382 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0c00beed-a74b-4840-b2fa-303ace88cac8 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a80d6de66345a0a9773ec0a4ad3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0257e250d645aea1c2f5d9737fcff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:40:06.752477 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0c00beed-a74b-4840-b2fa-303ace88cac8 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] 10.222.0.50 "GET /compute/v2.1/servers/fbf437b3-252f-43f1-8901-5020d8fd5e55" status: 200 len: 1553 microversion: 2.1 time: 0.166134 Aug 31 16:40:06.753137 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3261/6706] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:40:06 2022] GET /compute/v2.1/servers/fbf437b3-252f-43f1-8901-5020d8fd5e55 => generated 1553 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:40:07.776554 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7c6637ba-6f7d-4126-bd11-021bda4deb30 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:40:07.777482 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7c6637ba-6f7d-4126-bd11-021bda4deb30 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] [instance: fbf437b3-252f-43f1-8901-5020d8fd5e55] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:40:07.786889 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7c6637ba-6f7d-4126-bd11-021bda4deb30 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:07.787393 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7c6637ba-6f7d-4126-bd11-021bda4deb30 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:07.787846 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7c6637ba-6f7d-4126-bd11-021bda4deb30 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:07.788532 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7c6637ba-6f7d-4126-bd11-021bda4deb30 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:07.789009 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7c6637ba-6f7d-4126-bd11-021bda4deb30 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:07.789447 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7c6637ba-6f7d-4126-bd11-021bda4deb30 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:07.930293 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7c6637ba-6f7d-4126-bd11-021bda4deb30 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a80d6de66345a0a9773ec0a4ad3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0257e250d645aea1c2f5d9737fcff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:40:07.940504 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7c6637ba-6f7d-4126-bd11-021bda4deb30 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] 10.222.0.50 "GET /compute/v2.1/servers/fbf437b3-252f-43f1-8901-5020d8fd5e55" status: 200 len: 1553 microversion: 2.1 time: 0.169261 Aug 31 16:40:07.941072 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3446/6707] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:40:07 2022] GET /compute/v2.1/servers/fbf437b3-252f-43f1-8901-5020d8fd5e55 => generated 1553 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:40:08.437748 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-9595261d-0db7-44ea-b71d-f822ffc88b98 req-b075f9f6-e923-4f5d-a5af-ebd044898cb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbf437b3-252f-43f1-8901-5020d8fd5e55", "name": "network-vif-deleted", "tag": "2c3d41bc-41cc-45a8-ae49-e404c8541ffd"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:40:08.450373 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9595261d-0db7-44ea-b71d-f822ffc88b98 req-b075f9f6-e923-4f5d-a5af-ebd044898cb5 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:08.450854 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9595261d-0db7-44ea-b71d-f822ffc88b98 req-b075f9f6-e923-4f5d-a5af-ebd044898cb5 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:08.451278 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9595261d-0db7-44ea-b71d-f822ffc88b98 req-b075f9f6-e923-4f5d-a5af-ebd044898cb5 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:08.467347 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-9595261d-0db7-44ea-b71d-f822ffc88b98 req-b075f9f6-e923-4f5d-a5af-ebd044898cb5 service nova] Creating event network-vif-deleted:2c3d41bc-41cc-45a8-ae49-e404c8541ffd for instance fbf437b3-252f-43f1-8901-5020d8fd5e55 on n-h1-833090-16 Aug 31 16:40:08.472653 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-9595261d-0db7-44ea-b71d-f822ffc88b98 req-b075f9f6-e923-4f5d-a5af-ebd044898cb5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038791 Aug 31 16:40:08.473494 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3262/6708] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:40:08.961949 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0ab5e0e3-d7e1-4532-942c-3a2a8132a7ce tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:40:08.962535 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0ab5e0e3-d7e1-4532-942c-3a2a8132a7ce tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] [instance: fbf437b3-252f-43f1-8901-5020d8fd5e55] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:40:08.970016 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0ab5e0e3-d7e1-4532-942c-3a2a8132a7ce tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:08.970568 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0ab5e0e3-d7e1-4532-942c-3a2a8132a7ce tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:08.971014 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0ab5e0e3-d7e1-4532-942c-3a2a8132a7ce tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:08.971715 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0ab5e0e3-d7e1-4532-942c-3a2a8132a7ce tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:08.972183 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0ab5e0e3-d7e1-4532-942c-3a2a8132a7ce tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:08.972578 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0ab5e0e3-d7e1-4532-942c-3a2a8132a7ce tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:08.987603 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-0ab5e0e3-d7e1-4532-942c-3a2a8132a7ce tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] HTTP exception thrown: Instance fbf437b3-252f-43f1-8901-5020d8fd5e55 could not be found. Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0ab5e0e3-d7e1-4532-942c-3a2a8132a7ce tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Request method failure captured: Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/fbf437b3-252f-43f1-8901-5020d8fd5e55 HTTP/1.1 Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD45XHXWi_Azg0wkocaeo6ONTypF_d2_u5PE7aJq8kxkLLbmnIiLYOmcg98F391ZTmrsBGYDKoFkxtCK6K8SLqWzfYmNXWzdFHaVAOgvpVkKSm8FVl9cKAyaXp-tTat5o-4vmJH7Tzf4HUZeIMGMDM5wJmsDIDl88UfPEYjRIk58uJQQ Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: ca0257e250d645aea1c2f5d9737fcff5 Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-TestNetworkBasicOps-1342269563 Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ca0257e250d645aea1c2f5d9737fcff5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ca0257e250d645aea1c2f5d9737fcff5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ca0257e250d645aea1c2f5d9737fcff5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ca0257e250d645aea1c2f5d9737fcff5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-TestNetworkBasicOps-1342269563 Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: ca0257e250d645aea1c2f5d9737fcff5 Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-TestNetworkBasicOps-1342269563 Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-TestNetworkBasicOps-1342269563-project Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: c0a80d6de66345a0a9773ec0a4ad3855 Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-TestNetworkBasicOps-1342269563-project Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance fbf437b3-252f-43f1-8901-5020d8fd5e55 could not be found. Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'fbf437b3-252f-43f1-8901-5020d8fd5e55'} Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbf437b3-252f-43f1-8901-5020d8fd5e55 could not be found. Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbf437b3-252f-43f1-8901-5020d8fd5e55 could not be found. Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:40:08.989288 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:40:08.993444 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:40:08.993444 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:40:08.993444 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:40:08.993444 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:40:08.993444 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:40:08.993444 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbf437b3-252f-43f1-8901-5020d8fd5e55 could not be found. Aug 31 16:40:08.993444 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:40:08.993444 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0ab5e0e3-d7e1-4532-942c-3a2a8132a7ce tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Returning 404 to user: Instance fbf437b3-252f-43f1-8901-5020d8fd5e55 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:40:08.993444 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0ab5e0e3-d7e1-4532-942c-3a2a8132a7ce tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] 10.222.0.50 "GET /compute/v2.1/servers/fbf437b3-252f-43f1-8901-5020d8fd5e55" status: 404 len: 111 microversion: 2.1 time: 0.033086 Aug 31 16:40:08.993444 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3447/6709] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:40:08 2022] GET /compute/v2.1/servers/fbf437b3-252f-43f1-8901-5020d8fd5e55 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:40:09.165956 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-11ad2deb-6f99-47f2-9574-b1842d523680 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Calling method '.version_select at 0x7fbb4544f5e0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:40:09.192989 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-11ad2deb-6f99-47f2-9574-b1842d523680 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1237667588" status: 202 len: 0 microversion: 2.1 time: 0.031697 Aug 31 16:40:09.193915 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3263/6710] 10.222.0.50 () {58 vars in 1257 bytes} [Wed Aug 31 16:40:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1237667588 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:40:11.588977 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-86f04fcc-b268-494e-a4f9-1218033983c5 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:40:11.589621 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-86f04fcc-b268-494e-a4f9-1218033983c5 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] [instance: f01381d6-d55d-4f85-bfd5-70fd8db72a02] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:40:11.591561 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-d40b38fe-4ea1-489f-80e7-55c07c6560df req-e0f90232-358b-4b20-aebd-f92a4e16eb7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f01381d6-d55d-4f85-bfd5-70fd8db72a02", "tag": "bec4ca9b-e612-495d-8637-2da25043600a"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:40:11.597594 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-86f04fcc-b268-494e-a4f9-1218033983c5 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:11.598117 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-86f04fcc-b268-494e-a4f9-1218033983c5 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:11.598574 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-86f04fcc-b268-494e-a4f9-1218033983c5 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:11.599293 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-86f04fcc-b268-494e-a4f9-1218033983c5 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:11.599910 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-86f04fcc-b268-494e-a4f9-1218033983c5 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:11.600494 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-86f04fcc-b268-494e-a4f9-1218033983c5 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:11.603208 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d40b38fe-4ea1-489f-80e7-55c07c6560df req-e0f90232-358b-4b20-aebd-f92a4e16eb7a service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:11.603755 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d40b38fe-4ea1-489f-80e7-55c07c6560df req-e0f90232-358b-4b20-aebd-f92a4e16eb7a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:11.604246 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d40b38fe-4ea1-489f-80e7-55c07c6560df req-e0f90232-358b-4b20-aebd-f92a4e16eb7a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:11.617074 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-d40b38fe-4ea1-489f-80e7-55c07c6560df req-e0f90232-358b-4b20-aebd-f92a4e16eb7a service nova] Creating event network-changed:bec4ca9b-e612-495d-8637-2da25043600a for instance f01381d6-d55d-4f85-bfd5-70fd8db72a02 on n-h2-833090-16 Aug 31 16:40:11.623502 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-d40b38fe-4ea1-489f-80e7-55c07c6560df req-e0f90232-358b-4b20-aebd-f92a4e16eb7a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035874 Aug 31 16:40:11.624673 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3264/6711] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:40:11.644071 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-86f04fcc-b268-494e-a4f9-1218033983c5 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] [instance: f01381d6-d55d-4f85-bfd5-70fd8db72a02] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:40:11.751165 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-86f04fcc-b268-494e-a4f9-1218033983c5 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] 10.222.0.50 "DELETE /compute/v2.1/servers/f01381d6-d55d-4f85-bfd5-70fd8db72a02" status: 204 len: 0 microversion: 2.1 time: 0.165992 Aug 31 16:40:11.752152 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3448/6712] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:40:11 2022] DELETE /compute/v2.1/servers/f01381d6-d55d-4f85-bfd5-70fd8db72a02 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:40:11.761096 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9ba78154-d3b8-403a-82d3-c4fe85dae59e tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:40:11.762218 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9ba78154-d3b8-403a-82d3-c4fe85dae59e tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] [instance: f01381d6-d55d-4f85-bfd5-70fd8db72a02] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:40:11.769276 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9ba78154-d3b8-403a-82d3-c4fe85dae59e tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:11.769768 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9ba78154-d3b8-403a-82d3-c4fe85dae59e tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:11.770246 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9ba78154-d3b8-403a-82d3-c4fe85dae59e tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:11.770950 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9ba78154-d3b8-403a-82d3-c4fe85dae59e tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:11.771641 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9ba78154-d3b8-403a-82d3-c4fe85dae59e tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:11.772142 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9ba78154-d3b8-403a-82d3-c4fe85dae59e tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:11.915299 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9ba78154-d3b8-403a-82d3-c4fe85dae59e tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a80d6de66345a0a9773ec0a4ad3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0257e250d645aea1c2f5d9737fcff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:40:11.923392 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9ba78154-d3b8-403a-82d3-c4fe85dae59e tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] 10.222.0.50 "GET /compute/v2.1/servers/f01381d6-d55d-4f85-bfd5-70fd8db72a02" status: 200 len: 1671 microversion: 2.1 time: 0.166603 Aug 31 16:40:11.924060 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3265/6713] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:40:11 2022] GET /compute/v2.1/servers/f01381d6-d55d-4f85-bfd5-70fd8db72a02 => generated 1671 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:40:12.945846 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6f40180a-4189-4c47-ae25-802a1b68b12f tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:40:12.946587 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6f40180a-4189-4c47-ae25-802a1b68b12f tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] [instance: f01381d6-d55d-4f85-bfd5-70fd8db72a02] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:40:12.954304 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f40180a-4189-4c47-ae25-802a1b68b12f tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:12.954634 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f40180a-4189-4c47-ae25-802a1b68b12f tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:12.955277 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f40180a-4189-4c47-ae25-802a1b68b12f tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:12.955991 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f40180a-4189-4c47-ae25-802a1b68b12f tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:12.956457 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f40180a-4189-4c47-ae25-802a1b68b12f tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:12.956890 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f40180a-4189-4c47-ae25-802a1b68b12f tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:13.099447 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6f40180a-4189-4c47-ae25-802a1b68b12f tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a80d6de66345a0a9773ec0a4ad3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0257e250d645aea1c2f5d9737fcff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:40:13.112521 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6f40180a-4189-4c47-ae25-802a1b68b12f tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] 10.222.0.50 "GET /compute/v2.1/servers/f01381d6-d55d-4f85-bfd5-70fd8db72a02" status: 200 len: 1671 microversion: 2.1 time: 0.171099 Aug 31 16:40:13.113125 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3449/6714] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:40:12 2022] GET /compute/v2.1/servers/f01381d6-d55d-4f85-bfd5-70fd8db72a02 => generated 1671 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:40:13.908446 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-1ba5f5af-a37a-4c2a-9228-8955ea591307 req-bd4404c9-4349-4c3a-b693-7ffe5061a3ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f01381d6-d55d-4f85-bfd5-70fd8db72a02", "name": "network-vif-deleted", "tag": "bec4ca9b-e612-495d-8637-2da25043600a"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:40:13.921264 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-1ba5f5af-a37a-4c2a-9228-8955ea591307 req-bd4404c9-4349-4c3a-b693-7ffe5061a3ec service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:13.921742 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-1ba5f5af-a37a-4c2a-9228-8955ea591307 req-bd4404c9-4349-4c3a-b693-7ffe5061a3ec service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:13.922181 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-1ba5f5af-a37a-4c2a-9228-8955ea591307 req-bd4404c9-4349-4c3a-b693-7ffe5061a3ec service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:13.935602 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-1ba5f5af-a37a-4c2a-9228-8955ea591307 req-bd4404c9-4349-4c3a-b693-7ffe5061a3ec service nova] Creating event network-vif-deleted:bec4ca9b-e612-495d-8637-2da25043600a for instance f01381d6-d55d-4f85-bfd5-70fd8db72a02 on n-h2-833090-16 Aug 31 16:40:13.942405 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-1ba5f5af-a37a-4c2a-9228-8955ea591307 req-bd4404c9-4349-4c3a-b693-7ffe5061a3ec service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037868 Aug 31 16:40:13.943023 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3266/6715] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:40:14.135027 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-cb8a7ed1-94ab-4725-bcb9-6a8b8bfbac99 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:40:14.135754 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-cb8a7ed1-94ab-4725-bcb9-6a8b8bfbac99 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] [instance: f01381d6-d55d-4f85-bfd5-70fd8db72a02] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:40:14.143868 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb8a7ed1-94ab-4725-bcb9-6a8b8bfbac99 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:14.144360 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb8a7ed1-94ab-4725-bcb9-6a8b8bfbac99 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:14.144807 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb8a7ed1-94ab-4725-bcb9-6a8b8bfbac99 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:14.145548 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb8a7ed1-94ab-4725-bcb9-6a8b8bfbac99 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:14.146009 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb8a7ed1-94ab-4725-bcb9-6a8b8bfbac99 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:14.146481 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb8a7ed1-94ab-4725-bcb9-6a8b8bfbac99 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:14.183865 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb8a7ed1-94ab-4725-bcb9-6a8b8bfbac99 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:14.184374 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb8a7ed1-94ab-4725-bcb9-6a8b8bfbac99 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:14.184830 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb8a7ed1-94ab-4725-bcb9-6a8b8bfbac99 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:14.185300 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-cb8a7ed1-94ab-4725-bcb9-6a8b8bfbac99 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lazy-loading 'fault' on Instance uuid f01381d6-d55d-4f85-bfd5-70fd8db72a02 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:40:14.228542 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-cb8a7ed1-94ab-4725-bcb9-6a8b8bfbac99 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a80d6de66345a0a9773ec0a4ad3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0257e250d645aea1c2f5d9737fcff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:40:14.237639 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-cb8a7ed1-94ab-4725-bcb9-6a8b8bfbac99 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] 10.222.0.50 "GET /compute/v2.1/servers/f01381d6-d55d-4f85-bfd5-70fd8db72a02" status: 200 len: 1338 microversion: 2.1 time: 0.106499 Aug 31 16:40:14.238399 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3450/6716] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:40:14 2022] GET /compute/v2.1/servers/f01381d6-d55d-4f85-bfd5-70fd8db72a02 => generated 1338 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:40:15.263771 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2996a698-d8bc-4b54-a680-7115555ddcf4 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:40:15.264527 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2996a698-d8bc-4b54-a680-7115555ddcf4 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] [instance: f01381d6-d55d-4f85-bfd5-70fd8db72a02] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:40:15.275495 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2996a698-d8bc-4b54-a680-7115555ddcf4 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:15.275982 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2996a698-d8bc-4b54-a680-7115555ddcf4 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:15.276422 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2996a698-d8bc-4b54-a680-7115555ddcf4 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:15.277210 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2996a698-d8bc-4b54-a680-7115555ddcf4 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:15.277865 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2996a698-d8bc-4b54-a680-7115555ddcf4 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:15.278489 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2996a698-d8bc-4b54-a680-7115555ddcf4 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:15.296061 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-2996a698-d8bc-4b54-a680-7115555ddcf4 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] HTTP exception thrown: Instance f01381d6-d55d-4f85-bfd5-70fd8db72a02 could not be found. Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2996a698-d8bc-4b54-a680-7115555ddcf4 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Request method failure captured: Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/f01381d6-d55d-4f85-bfd5-70fd8db72a02 HTTP/1.1 Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD45XHXWi_Azg0wkocaeo6ONTypF_d2_u5PE7aJq8kxkLLbmnIiLYOmcg98F391ZTmrsBGYDKoFkxtCK6K8SLqWzfYmNXWzdFHaVAOgvpVkKSm8FVl9cKAyaXp-tTat5o-4vmJH7Tzf4HUZeIMGMDM5wJmsDIDl88UfPEYjRIk58uJQQ Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: ca0257e250d645aea1c2f5d9737fcff5 Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-TestNetworkBasicOps-1342269563 Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ca0257e250d645aea1c2f5d9737fcff5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ca0257e250d645aea1c2f5d9737fcff5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ca0257e250d645aea1c2f5d9737fcff5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ca0257e250d645aea1c2f5d9737fcff5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-TestNetworkBasicOps-1342269563 Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: ca0257e250d645aea1c2f5d9737fcff5 Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TestNetworkBasicOps-1342269563 Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-TestNetworkBasicOps-1342269563-project Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: c0a80d6de66345a0a9773ec0a4ad3855 Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-TestNetworkBasicOps-1342269563-project Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance f01381d6-d55d-4f85-bfd5-70fd8db72a02 could not be found. Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'f01381d6-d55d-4f85-bfd5-70fd8db72a02'} Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f01381d6-d55d-4f85-bfd5-70fd8db72a02 could not be found. Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f01381d6-d55d-4f85-bfd5-70fd8db72a02 could not be found. Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:40:15.297810 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:40:15.301502 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:40:15.301502 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:40:15.301502 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:40:15.301502 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:40:15.301502 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:40:15.301502 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f01381d6-d55d-4f85-bfd5-70fd8db72a02 could not be found. Aug 31 16:40:15.301502 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:40:15.301502 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2996a698-d8bc-4b54-a680-7115555ddcf4 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Returning 404 to user: Instance f01381d6-d55d-4f85-bfd5-70fd8db72a02 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:40:15.301502 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2996a698-d8bc-4b54-a680-7115555ddcf4 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] 10.222.0.50 "GET /compute/v2.1/servers/f01381d6-d55d-4f85-bfd5-70fd8db72a02" status: 404 len: 111 microversion: 2.1 time: 0.043097 Aug 31 16:40:15.301502 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3267/6717] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:40:15 2022] GET /compute/v2.1/servers/f01381d6-d55d-4f85-bfd5-70fd8db72a02 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:40:15.502228 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3563ce68-8598-4c35-b58b-44f41da040ef tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Calling method '.version_select at 0x7fbb4565d280>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:40:15.536640 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3563ce68-8598-4c35-b58b-44f41da040ef tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1277255544" status: 202 len: 0 microversion: 2.1 time: 0.040672 Aug 31 16:40:15.537679 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3451/6718] 10.222.0.50 () {58 vars in 1257 bytes} [Wed Aug 31 16:40:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1277255544 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:40:23.893701 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b68da4a4-f6b3-41a9-affe-a3d3991678d8 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Action: 'create', calling method: .version_select at 0x7fbb45d3cf70>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1472817644", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhiONvR+ZdvcEBYH823P+GXTwH2hHhOypDcqxQ+4xmvHaH8Lyb3wJs1JBdyDVYj37wvAZKxhAQWDok9I8uFLUwXPGCkso+ag8KcbKo4qT8S75HbJGX3ipc23M+amyQUug=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:40:23.913784 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-b68da4a4-f6b3-41a9-affe-a3d3991678d8 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Getting quotas for project ca0257e250d645aea1c2f5d9737fcff5. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:40:23.920133 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-b68da4a4-f6b3-41a9-affe-a3d3991678d8 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Getting quotas for user c0a80d6de66345a0a9773ec0a4ad3855 and project ca0257e250d645aea1c2f5d9737fcff5. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:40:23.960227 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b68da4a4-f6b3-41a9-affe-a3d3991678d8 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.070890 Aug 31 16:40:23.960853 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3268/6719] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 31 16:40:23 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:40:25.019164 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:40:25.023448 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-11e80dc9-5304-4d51-b91f-0c9631fe90de tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-2062269260", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "76d84bf2-f2d4-419a-a824-d72ea5c9b8f2"}], "key_name": "tempest-TestNetworkBasicOps-1472817644", "security_groups": [{"name": "tempest-secgroup-smoke-1333764231"}]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:40:25.140926 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-11e80dc9-5304-4d51-b91f-0c9631fe90de tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] validate_networks() for [('76d84bf2-f2d4-419a-a824-d72ea5c9b8f2', None, None, None, None, None)] {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:40:25.537229 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-11e80dc9-5304-4d51-b91f-0c9631fe90de tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:40:25.537664 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-11e80dc9-5304-4d51-b91f-0c9631fe90de tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:40:25.538170 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-11e80dc9-5304-4d51-b91f-0c9631fe90de tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:40:25.538619 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-11e80dc9-5304-4d51-b91f-0c9631fe90de tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:40:25.539030 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-11e80dc9-5304-4d51-b91f-0c9631fe90de tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:40:25.549489 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11e80dc9-5304-4d51-b91f-0c9631fe90de tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:25.550578 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11e80dc9-5304-4d51-b91f-0c9631fe90de tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:25.551682 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11e80dc9-5304-4d51-b91f-0c9631fe90de tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:25.552424 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11e80dc9-5304-4d51-b91f-0c9631fe90de tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:25.552883 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11e80dc9-5304-4d51-b91f-0c9631fe90de tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:25.553311 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11e80dc9-5304-4d51-b91f-0c9631fe90de tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:25.572174 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-11e80dc9-5304-4d51-b91f-0c9631fe90de tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Getting quotas for project ca0257e250d645aea1c2f5d9737fcff5. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:40:25.577893 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-11e80dc9-5304-4d51-b91f-0c9631fe90de tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Getting quotas for user c0a80d6de66345a0a9773ec0a4ad3855 and project ca0257e250d645aea1c2f5d9737fcff5. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:40:25.590922 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-11e80dc9-5304-4d51-b91f-0c9631fe90de tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:40:25.593160 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-11e80dc9-5304-4d51-b91f-0c9631fe90de tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] [instance: a7df0255-adab-4369-b94a-9ea536d18937] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:40:25.647085 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-11e80dc9-5304-4d51-b91f-0c9631fe90de tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.629778 Aug 31 16:40:25.647739 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3452/6720] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:40:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:40:25.659274 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e5504956-b602-4b12-90ef-968efe9ff9c2 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:40:25.659881 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e5504956-b602-4b12-90ef-968efe9ff9c2 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] [instance: a7df0255-adab-4369-b94a-9ea536d18937] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:40:25.665294 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=20 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:40:25.731779 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e5504956-b602-4b12-90ef-968efe9ff9c2 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a80d6de66345a0a9773ec0a4ad3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0257e250d645aea1c2f5d9737fcff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:40:25.748035 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e5504956-b602-4b12-90ef-968efe9ff9c2 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] 10.222.0.50 "GET /compute/v2.1/servers/a7df0255-adab-4369-b94a-9ea536d18937" status: 200 len: 1249 microversion: 2.1 time: 0.092926 Aug 31 16:40:25.748875 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3269/6721] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:40:25 2022] GET /compute/v2.1/servers/a7df0255-adab-4369-b94a-9ea536d18937 => generated 1249 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:40:26.772882 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3f8e9231-b180-4b7d-a253-685d2ab08a0a tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:40:26.773767 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3f8e9231-b180-4b7d-a253-685d2ab08a0a tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] [instance: a7df0255-adab-4369-b94a-9ea536d18937] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:40:26.840467 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3f8e9231-b180-4b7d-a253-685d2ab08a0a tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a80d6de66345a0a9773ec0a4ad3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0257e250d645aea1c2f5d9737fcff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:40:26.848184 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3f8e9231-b180-4b7d-a253-685d2ab08a0a tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] 10.222.0.50 "GET /compute/v2.1/servers/a7df0255-adab-4369-b94a-9ea536d18937" status: 200 len: 1249 microversion: 2.1 time: 0.080988 Aug 31 16:40:26.848884 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3453/6722] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:40:26 2022] GET /compute/v2.1/servers/a7df0255-adab-4369-b94a-9ea536d18937 => generated 1249 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:40:27.869568 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4c77e2ca-6911-4d50-a79c-fce50b6e87d8 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:40:27.870290 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4c77e2ca-6911-4d50-a79c-fce50b6e87d8 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] [instance: a7df0255-adab-4369-b94a-9ea536d18937] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:40:27.928948 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4c77e2ca-6911-4d50-a79c-fce50b6e87d8 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a80d6de66345a0a9773ec0a4ad3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0257e250d645aea1c2f5d9737fcff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:40:27.936014 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4c77e2ca-6911-4d50-a79c-fce50b6e87d8 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] 10.222.0.50 "GET /compute/v2.1/servers/a7df0255-adab-4369-b94a-9ea536d18937" status: 200 len: 1249 microversion: 2.1 time: 0.070608 Aug 31 16:40:27.936594 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3270/6723] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:40:27 2022] GET /compute/v2.1/servers/a7df0255-adab-4369-b94a-9ea536d18937 => generated 1249 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:40:28.963161 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c2b7c401-2d07-45c2-99bb-28788cbb23e4 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:40:28.965069 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c2b7c401-2d07-45c2-99bb-28788cbb23e4 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] [instance: a7df0255-adab-4369-b94a-9ea536d18937] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:40:29.026953 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c2b7c401-2d07-45c2-99bb-28788cbb23e4 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a80d6de66345a0a9773ec0a4ad3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0257e250d645aea1c2f5d9737fcff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:40:29.035373 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c2b7c401-2d07-45c2-99bb-28788cbb23e4 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] 10.222.0.50 "GET /compute/v2.1/servers/a7df0255-adab-4369-b94a-9ea536d18937" status: 200 len: 1249 microversion: 2.1 time: 0.078942 Aug 31 16:40:29.036147 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3454/6724] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:40:28 2022] GET /compute/v2.1/servers/a7df0255-adab-4369-b94a-9ea536d18937 => generated 1249 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:40:30.056817 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ee8df2c5-13c1-4902-8566-2a989b5a16ff tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:40:30.057443 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ee8df2c5-13c1-4902-8566-2a989b5a16ff tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] [instance: a7df0255-adab-4369-b94a-9ea536d18937] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:40:30.065663 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee8df2c5-13c1-4902-8566-2a989b5a16ff tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:30.066178 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee8df2c5-13c1-4902-8566-2a989b5a16ff tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:30.066615 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee8df2c5-13c1-4902-8566-2a989b5a16ff tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:30.067348 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee8df2c5-13c1-4902-8566-2a989b5a16ff tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:30.067799 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee8df2c5-13c1-4902-8566-2a989b5a16ff tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:30.068223 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ee8df2c5-13c1-4902-8566-2a989b5a16ff tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:30.144623 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ee8df2c5-13c1-4902-8566-2a989b5a16ff tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a80d6de66345a0a9773ec0a4ad3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0257e250d645aea1c2f5d9737fcff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:40:30.154990 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ee8df2c5-13c1-4902-8566-2a989b5a16ff tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] 10.222.0.50 "GET /compute/v2.1/servers/a7df0255-adab-4369-b94a-9ea536d18937" status: 200 len: 1253 microversion: 2.1 time: 0.102332 Aug 31 16:40:30.155582 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3271/6725] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:40:30 2022] GET /compute/v2.1/servers/a7df0255-adab-4369-b94a-9ea536d18937 => generated 1253 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:40:31.176499 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-88ad732c-3cb0-4eb5-a8da-26ab834069d1 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:40:31.177075 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-88ad732c-3cb0-4eb5-a8da-26ab834069d1 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] [instance: a7df0255-adab-4369-b94a-9ea536d18937] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:40:31.185348 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-88ad732c-3cb0-4eb5-a8da-26ab834069d1 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:31.185840 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-88ad732c-3cb0-4eb5-a8da-26ab834069d1 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:31.186316 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-88ad732c-3cb0-4eb5-a8da-26ab834069d1 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:31.187025 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-88ad732c-3cb0-4eb5-a8da-26ab834069d1 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:31.187500 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-88ad732c-3cb0-4eb5-a8da-26ab834069d1 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:31.187919 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-88ad732c-3cb0-4eb5-a8da-26ab834069d1 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:31.252291 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-88ad732c-3cb0-4eb5-a8da-26ab834069d1 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a80d6de66345a0a9773ec0a4ad3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0257e250d645aea1c2f5d9737fcff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:40:31.261063 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-88ad732c-3cb0-4eb5-a8da-26ab834069d1 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] 10.222.0.50 "GET /compute/v2.1/servers/a7df0255-adab-4369-b94a-9ea536d18937" status: 200 len: 1307 microversion: 2.1 time: 0.088742 Aug 31 16:40:31.261719 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3455/6726] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:40:31 2022] GET /compute/v2.1/servers/a7df0255-adab-4369-b94a-9ea536d18937 => generated 1307 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:40:32.283734 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9b34d8f1-f649-4d85-b95d-3fd08e62d0e8 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:40:32.284612 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9b34d8f1-f649-4d85-b95d-3fd08e62d0e8 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] [instance: a7df0255-adab-4369-b94a-9ea536d18937] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:40:32.292176 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b34d8f1-f649-4d85-b95d-3fd08e62d0e8 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:32.292662 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b34d8f1-f649-4d85-b95d-3fd08e62d0e8 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:32.293097 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b34d8f1-f649-4d85-b95d-3fd08e62d0e8 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:32.293849 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b34d8f1-f649-4d85-b95d-3fd08e62d0e8 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:32.294268 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b34d8f1-f649-4d85-b95d-3fd08e62d0e8 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:32.294690 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9b34d8f1-f649-4d85-b95d-3fd08e62d0e8 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:32.314172 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-56c9e7c8-1e8f-4920-933b-5e7055b28321 req-3ab84736-5c79-4894-8150-1433340b9451 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7df0255-adab-4369-b94a-9ea536d18937", "tag": "e3a4b163-9f25-4d9f-9309-2cc6b00d4436"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:40:32.329614 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-56c9e7c8-1e8f-4920-933b-5e7055b28321 req-3ab84736-5c79-4894-8150-1433340b9451 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:32.330385 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-56c9e7c8-1e8f-4920-933b-5e7055b28321 req-3ab84736-5c79-4894-8150-1433340b9451 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:32.331043 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-56c9e7c8-1e8f-4920-933b-5e7055b28321 req-3ab84736-5c79-4894-8150-1433340b9451 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:32.344168 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-56c9e7c8-1e8f-4920-933b-5e7055b28321 req-3ab84736-5c79-4894-8150-1433340b9451 service nova] Creating event network-changed:e3a4b163-9f25-4d9f-9309-2cc6b00d4436 for instance a7df0255-adab-4369-b94a-9ea536d18937 on n-h2-833090-16 Aug 31 16:40:32.351015 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-56c9e7c8-1e8f-4920-933b-5e7055b28321 req-3ab84736-5c79-4894-8150-1433340b9451 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045795 Aug 31 16:40:32.351632 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3456/6727] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:40:32.458429 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9b34d8f1-f649-4d85-b95d-3fd08e62d0e8 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a80d6de66345a0a9773ec0a4ad3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0257e250d645aea1c2f5d9737fcff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:40:32.466692 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9b34d8f1-f649-4d85-b95d-3fd08e62d0e8 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] 10.222.0.50 "GET /compute/v2.1/servers/a7df0255-adab-4369-b94a-9ea536d18937" status: 200 len: 1375 microversion: 2.1 time: 0.187263 Aug 31 16:40:32.467280 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3272/6728] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:40:32 2022] GET /compute/v2.1/servers/a7df0255-adab-4369-b94a-9ea536d18937 => generated 1375 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:40:33.490491 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a5d001f3-a8e6-4e89-be95-ee2ce6f46c48 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:40:33.491229 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a5d001f3-a8e6-4e89-be95-ee2ce6f46c48 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] [instance: a7df0255-adab-4369-b94a-9ea536d18937] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:40:33.498451 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5d001f3-a8e6-4e89-be95-ee2ce6f46c48 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:33.498960 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5d001f3-a8e6-4e89-be95-ee2ce6f46c48 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:33.499415 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5d001f3-a8e6-4e89-be95-ee2ce6f46c48 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:33.500121 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5d001f3-a8e6-4e89-be95-ee2ce6f46c48 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:33.500869 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5d001f3-a8e6-4e89-be95-ee2ce6f46c48 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:33.501308 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5d001f3-a8e6-4e89-be95-ee2ce6f46c48 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:33.656397 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a5d001f3-a8e6-4e89-be95-ee2ce6f46c48 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a80d6de66345a0a9773ec0a4ad3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0257e250d645aea1c2f5d9737fcff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:40:33.665666 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a5d001f3-a8e6-4e89-be95-ee2ce6f46c48 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] 10.222.0.50 "GET /compute/v2.1/servers/a7df0255-adab-4369-b94a-9ea536d18937" status: 200 len: 1375 microversion: 2.1 time: 0.180560 Aug 31 16:40:33.666298 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3457/6729] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:40:33 2022] GET /compute/v2.1/servers/a7df0255-adab-4369-b94a-9ea536d18937 => generated 1375 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:40:34.690389 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f234a1a0-704f-4d6f-89ca-dfb1f77c0865 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:40:34.690943 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f234a1a0-704f-4d6f-89ca-dfb1f77c0865 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] [instance: a7df0255-adab-4369-b94a-9ea536d18937] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:40:34.699300 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f234a1a0-704f-4d6f-89ca-dfb1f77c0865 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:34.699793 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f234a1a0-704f-4d6f-89ca-dfb1f77c0865 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:34.700226 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f234a1a0-704f-4d6f-89ca-dfb1f77c0865 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:34.700927 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f234a1a0-704f-4d6f-89ca-dfb1f77c0865 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:34.701383 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f234a1a0-704f-4d6f-89ca-dfb1f77c0865 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:34.702277 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f234a1a0-704f-4d6f-89ca-dfb1f77c0865 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:34.850155 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f234a1a0-704f-4d6f-89ca-dfb1f77c0865 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a80d6de66345a0a9773ec0a4ad3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0257e250d645aea1c2f5d9737fcff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:40:34.862937 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f234a1a0-704f-4d6f-89ca-dfb1f77c0865 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] 10.222.0.50 "GET /compute/v2.1/servers/a7df0255-adab-4369-b94a-9ea536d18937" status: 200 len: 1375 microversion: 2.1 time: 0.178422 Aug 31 16:40:34.863677 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3273/6730] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:40:34 2022] GET /compute/v2.1/servers/a7df0255-adab-4369-b94a-9ea536d18937 => generated 1375 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:40:35.889609 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a510f104-406c-4e2b-bc5c-5fce9983304a tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:40:35.890501 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a510f104-406c-4e2b-bc5c-5fce9983304a tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] [instance: a7df0255-adab-4369-b94a-9ea536d18937] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:40:35.894049 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:40:35.900201 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a510f104-406c-4e2b-bc5c-5fce9983304a tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:35.900752 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a510f104-406c-4e2b-bc5c-5fce9983304a tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:35.901223 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a510f104-406c-4e2b-bc5c-5fce9983304a tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:35.901929 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a510f104-406c-4e2b-bc5c-5fce9983304a tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:35.902415 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a510f104-406c-4e2b-bc5c-5fce9983304a tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:35.902845 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a510f104-406c-4e2b-bc5c-5fce9983304a tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:36.045391 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a510f104-406c-4e2b-bc5c-5fce9983304a tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a80d6de66345a0a9773ec0a4ad3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0257e250d645aea1c2f5d9737fcff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:40:36.054336 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a510f104-406c-4e2b-bc5c-5fce9983304a tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] 10.222.0.50 "GET /compute/v2.1/servers/a7df0255-adab-4369-b94a-9ea536d18937" status: 200 len: 1375 microversion: 2.1 time: 0.169069 Aug 31 16:40:36.054923 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3458/6731] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:40:35 2022] GET /compute/v2.1/servers/a7df0255-adab-4369-b94a-9ea536d18937 => generated 1375 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:40:37.076174 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7ee5868c-a8a1-4e94-9854-54029e940f38 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:40:37.076752 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7ee5868c-a8a1-4e94-9854-54029e940f38 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] [instance: a7df0255-adab-4369-b94a-9ea536d18937] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:40:37.079563 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:40:37.085531 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ee5868c-a8a1-4e94-9854-54029e940f38 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:37.086009 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ee5868c-a8a1-4e94-9854-54029e940f38 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:37.086473 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ee5868c-a8a1-4e94-9854-54029e940f38 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:37.087168 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ee5868c-a8a1-4e94-9854-54029e940f38 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:37.087612 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ee5868c-a8a1-4e94-9854-54029e940f38 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:37.088024 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ee5868c-a8a1-4e94-9854-54029e940f38 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:37.232540 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7ee5868c-a8a1-4e94-9854-54029e940f38 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a80d6de66345a0a9773ec0a4ad3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0257e250d645aea1c2f5d9737fcff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:40:37.240993 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7ee5868c-a8a1-4e94-9854-54029e940f38 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] 10.222.0.50 "GET /compute/v2.1/servers/a7df0255-adab-4369-b94a-9ea536d18937" status: 200 len: 1375 microversion: 2.1 time: 0.168835 Aug 31 16:40:37.241594 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3274/6732] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:40:37 2022] GET /compute/v2.1/servers/a7df0255-adab-4369-b94a-9ea536d18937 => generated 1375 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:40:38.263162 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c5d82552-5065-4b1b-9b60-987c28e19e42 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:40:38.263808 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c5d82552-5065-4b1b-9b60-987c28e19e42 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] [instance: a7df0255-adab-4369-b94a-9ea536d18937] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:40:38.266678 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:40:38.273017 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c5d82552-5065-4b1b-9b60-987c28e19e42 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:38.273523 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c5d82552-5065-4b1b-9b60-987c28e19e42 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:38.273981 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c5d82552-5065-4b1b-9b60-987c28e19e42 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:38.274726 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c5d82552-5065-4b1b-9b60-987c28e19e42 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:38.275193 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c5d82552-5065-4b1b-9b60-987c28e19e42 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:38.275632 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c5d82552-5065-4b1b-9b60-987c28e19e42 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:38.420542 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c5d82552-5065-4b1b-9b60-987c28e19e42 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a80d6de66345a0a9773ec0a4ad3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0257e250d645aea1c2f5d9737fcff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:40:38.428865 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c5d82552-5065-4b1b-9b60-987c28e19e42 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] 10.222.0.50 "GET /compute/v2.1/servers/a7df0255-adab-4369-b94a-9ea536d18937" status: 200 len: 1375 microversion: 2.1 time: 0.169780 Aug 31 16:40:38.429488 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3459/6733] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:40:38 2022] GET /compute/v2.1/servers/a7df0255-adab-4369-b94a-9ea536d18937 => generated 1375 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:40:39.453168 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-46870580-b7b2-4059-abaa-fd31cb68c00b tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:40:39.454037 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-46870580-b7b2-4059-abaa-fd31cb68c00b tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] [instance: a7df0255-adab-4369-b94a-9ea536d18937] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:40:39.457069 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=8 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:40:39.467413 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46870580-b7b2-4059-abaa-fd31cb68c00b tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:39.468179 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46870580-b7b2-4059-abaa-fd31cb68c00b tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:39.468847 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46870580-b7b2-4059-abaa-fd31cb68c00b tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:39.469914 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46870580-b7b2-4059-abaa-fd31cb68c00b tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:39.470561 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46870580-b7b2-4059-abaa-fd31cb68c00b tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:39.471166 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46870580-b7b2-4059-abaa-fd31cb68c00b tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:39.612813 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-46870580-b7b2-4059-abaa-fd31cb68c00b tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a80d6de66345a0a9773ec0a4ad3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0257e250d645aea1c2f5d9737fcff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:40:39.622372 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-46870580-b7b2-4059-abaa-fd31cb68c00b tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] 10.222.0.50 "GET /compute/v2.1/servers/a7df0255-adab-4369-b94a-9ea536d18937" status: 200 len: 1375 microversion: 2.1 time: 0.174963 Aug 31 16:40:39.623214 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3275/6734] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:40:39 2022] GET /compute/v2.1/servers/a7df0255-adab-4369-b94a-9ea536d18937 => generated 1375 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:40:39.819054 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-45609a12-f2ff-45bc-b341-c6abdfce7c5a req-d99490a2-248d-4dc4-8f3d-ee06058dcb22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7df0255-adab-4369-b94a-9ea536d18937", "name": "network-vif-plugged", "status": "completed", "tag": "e3a4b163-9f25-4d9f-9309-2cc6b00d4436"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:40:39.824621 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=10 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:40:39.831390 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-45609a12-f2ff-45bc-b341-c6abdfce7c5a req-d99490a2-248d-4dc4-8f3d-ee06058dcb22 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:39.832208 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-45609a12-f2ff-45bc-b341-c6abdfce7c5a req-d99490a2-248d-4dc4-8f3d-ee06058dcb22 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:39.832718 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-45609a12-f2ff-45bc-b341-c6abdfce7c5a req-d99490a2-248d-4dc4-8f3d-ee06058dcb22 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:39.845118 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-45609a12-f2ff-45bc-b341-c6abdfce7c5a req-d99490a2-248d-4dc4-8f3d-ee06058dcb22 service nova] Creating event network-vif-plugged:e3a4b163-9f25-4d9f-9309-2cc6b00d4436 for instance a7df0255-adab-4369-b94a-9ea536d18937 on n-h2-833090-16 Aug 31 16:40:39.850543 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-45609a12-f2ff-45bc-b341-c6abdfce7c5a req-d99490a2-248d-4dc4-8f3d-ee06058dcb22 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035605 Aug 31 16:40:39.851170 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3460/6735] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:40:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:40:40.645918 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-acb9c3ac-497d-4588-8e84-d194f281f1a4 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:40:40.646554 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-acb9c3ac-497d-4588-8e84-d194f281f1a4 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] [instance: a7df0255-adab-4369-b94a-9ea536d18937] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:40:40.654192 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-acb9c3ac-497d-4588-8e84-d194f281f1a4 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:40.654676 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-acb9c3ac-497d-4588-8e84-d194f281f1a4 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:40.655110 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-acb9c3ac-497d-4588-8e84-d194f281f1a4 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:40.655794 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-acb9c3ac-497d-4588-8e84-d194f281f1a4 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:40.656244 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-acb9c3ac-497d-4588-8e84-d194f281f1a4 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:40.656664 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-acb9c3ac-497d-4588-8e84-d194f281f1a4 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:40.802605 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-acb9c3ac-497d-4588-8e84-d194f281f1a4 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a80d6de66345a0a9773ec0a4ad3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0257e250d645aea1c2f5d9737fcff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:40:40.810738 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-acb9c3ac-497d-4588-8e84-d194f281f1a4 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] 10.222.0.50 "GET /compute/v2.1/servers/a7df0255-adab-4369-b94a-9ea536d18937" status: 200 len: 1375 microversion: 2.1 time: 0.170674 Aug 31 16:40:40.811322 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3276/6736] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:40:40 2022] GET /compute/v2.1/servers/a7df0255-adab-4369-b94a-9ea536d18937 => generated 1375 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:40:41.839985 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-974c404c-7fd7-4a55-a467-310de6a75c0e tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:40:41.840972 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-974c404c-7fd7-4a55-a467-310de6a75c0e tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] [instance: a7df0255-adab-4369-b94a-9ea536d18937] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:40:41.850652 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-974c404c-7fd7-4a55-a467-310de6a75c0e tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:41.851155 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-974c404c-7fd7-4a55-a467-310de6a75c0e tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:41.851615 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-974c404c-7fd7-4a55-a467-310de6a75c0e tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:41.852323 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-974c404c-7fd7-4a55-a467-310de6a75c0e tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:41.852808 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-974c404c-7fd7-4a55-a467-310de6a75c0e tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:41.853245 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-974c404c-7fd7-4a55-a467-310de6a75c0e tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:42.008227 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-974c404c-7fd7-4a55-a467-310de6a75c0e tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a80d6de66345a0a9773ec0a4ad3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0257e250d645aea1c2f5d9737fcff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:40:42.019354 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-974c404c-7fd7-4a55-a467-310de6a75c0e tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] 10.222.0.50 "GET /compute/v2.1/servers/a7df0255-adab-4369-b94a-9ea536d18937" status: 200 len: 1546 microversion: 2.1 time: 0.189010 Aug 31 16:40:42.019931 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3461/6737] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:40:41 2022] GET /compute/v2.1/servers/a7df0255-adab-4369-b94a-9ea536d18937 => generated 1546 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:40:42.044852 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cbf3cc06-6977-4f79-bd9f-fa1edd49939f tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:40:42.045436 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cbf3cc06-6977-4f79-bd9f-fa1edd49939f tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] [instance: a7df0255-adab-4369-b94a-9ea536d18937] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:40:42.052934 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbf3cc06-6977-4f79-bd9f-fa1edd49939f tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:42.053425 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbf3cc06-6977-4f79-bd9f-fa1edd49939f tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:42.053848 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbf3cc06-6977-4f79-bd9f-fa1edd49939f tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:42.054586 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbf3cc06-6977-4f79-bd9f-fa1edd49939f tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:42.055041 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbf3cc06-6977-4f79-bd9f-fa1edd49939f tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:42.055472 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbf3cc06-6977-4f79-bd9f-fa1edd49939f tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:42.197565 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cbf3cc06-6977-4f79-bd9f-fa1edd49939f tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a80d6de66345a0a9773ec0a4ad3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0257e250d645aea1c2f5d9737fcff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:40:42.208800 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cbf3cc06-6977-4f79-bd9f-fa1edd49939f tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] 10.222.0.50 "GET /compute/v2.1/servers/a7df0255-adab-4369-b94a-9ea536d18937" status: 200 len: 1546 microversion: 2.1 time: 0.167870 Aug 31 16:40:42.209386 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3277/6738] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:40:42 2022] GET /compute/v2.1/servers/a7df0255-adab-4369-b94a-9ea536d18937 => generated 1546 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:40:43.995841 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-d5d1b228-80a3-4179-935c-868133ffc745 req-b78b6ae2-7a2e-4060-a6e6-8553522b3815 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7df0255-adab-4369-b94a-9ea536d18937", "tag": "e3a4b163-9f25-4d9f-9309-2cc6b00d4436"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:40:44.006890 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-d5d1b228-80a3-4179-935c-868133ffc745 req-b78b6ae2-7a2e-4060-a6e6-8553522b3815 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:40:44.007370 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-d5d1b228-80a3-4179-935c-868133ffc745 req-b78b6ae2-7a2e-4060-a6e6-8553522b3815 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:40:44.007805 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-d5d1b228-80a3-4179-935c-868133ffc745 req-b78b6ae2-7a2e-4060-a6e6-8553522b3815 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:40:44.020808 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-d5d1b228-80a3-4179-935c-868133ffc745 req-b78b6ae2-7a2e-4060-a6e6-8553522b3815 service nova] Creating event network-changed:e3a4b163-9f25-4d9f-9309-2cc6b00d4436 for instance a7df0255-adab-4369-b94a-9ea536d18937 on n-h2-833090-16 Aug 31 16:40:44.026947 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-d5d1b228-80a3-4179-935c-868133ffc745 req-b78b6ae2-7a2e-4060-a6e6-8553522b3815 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034309 Aug 31 16:40:44.028138 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3462/6739] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:40:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:41:22.379246 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-44b73ca9-ed75-41b4-bc90-0ebb290da10a tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:41:22.381833 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-44b73ca9-ed75-41b4-bc90-0ebb290da10a tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] [instance: a7df0255-adab-4369-b94a-9ea536d18937] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:41:22.385015 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=7 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:41:22.385687 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=42 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:41:22.397036 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44b73ca9-ed75-41b4-bc90-0ebb290da10a tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:22.397535 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44b73ca9-ed75-41b4-bc90-0ebb290da10a tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:22.397970 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44b73ca9-ed75-41b4-bc90-0ebb290da10a tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:22.398721 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44b73ca9-ed75-41b4-bc90-0ebb290da10a tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:41:22.400380 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44b73ca9-ed75-41b4-bc90-0ebb290da10a tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:41:22.400805 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44b73ca9-ed75-41b4-bc90-0ebb290da10a tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:41:22.472142 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-44b73ca9-ed75-41b4-bc90-0ebb290da10a tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] 10.222.0.50 "POST /compute/v2.1/servers/a7df0255-adab-4369-b94a-9ea536d18937/action" status: 200 len: 24566 microversion: 2.1 time: 0.098344 Aug 31 16:41:22.472806 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3278/6740] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:41:22 2022] POST /compute/v2.1/servers/a7df0255-adab-4369-b94a-9ea536d18937/action => generated 24566 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:42:01.343146 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=7 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:42:01.344020 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=38 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:42:01.349818 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-beb33b44-495b-4318-aa00-68ec7485b1fe tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:42:01.352525 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-beb33b44-495b-4318-aa00-68ec7485b1fe tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] [instance: a7df0255-adab-4369-b94a-9ea536d18937] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:01.360933 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-beb33b44-495b-4318-aa00-68ec7485b1fe tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:01.361442 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-beb33b44-495b-4318-aa00-68ec7485b1fe tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:01.361895 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-beb33b44-495b-4318-aa00-68ec7485b1fe tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:01.362721 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-beb33b44-495b-4318-aa00-68ec7485b1fe tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:01.363189 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-beb33b44-495b-4318-aa00-68ec7485b1fe tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:01.363634 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-beb33b44-495b-4318-aa00-68ec7485b1fe tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:01.437185 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-beb33b44-495b-4318-aa00-68ec7485b1fe tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] 10.222.0.50 "POST /compute/v2.1/servers/a7df0255-adab-4369-b94a-9ea536d18937/action" status: 200 len: 32636 microversion: 2.1 time: 0.096578 Aug 31 16:42:01.438072 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3463/6741] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:42:01 2022] POST /compute/v2.1/servers/a7df0255-adab-4369-b94a-9ea536d18937/action => generated 32636 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 16:42:02.505284 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-266fcf2e-bf19-4231-8986-af56429d1aeb tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:02.505860 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-266fcf2e-bf19-4231-8986-af56429d1aeb tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] [instance: a7df0255-adab-4369-b94a-9ea536d18937] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:02.508761 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:42:02.508901 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-7474ac9d-62c0-4be8-94fa-b94c2316fca4 req-cfc72949-d45c-4449-9150-f7733133e992 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7df0255-adab-4369-b94a-9ea536d18937", "tag": "e3a4b163-9f25-4d9f-9309-2cc6b00d4436"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:42:02.509816 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:42:02.516098 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-266fcf2e-bf19-4231-8986-af56429d1aeb tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:02.516582 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-266fcf2e-bf19-4231-8986-af56429d1aeb tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:02.517273 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-266fcf2e-bf19-4231-8986-af56429d1aeb tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:02.518928 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-266fcf2e-bf19-4231-8986-af56429d1aeb tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:02.519466 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-266fcf2e-bf19-4231-8986-af56429d1aeb tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:02.519976 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-266fcf2e-bf19-4231-8986-af56429d1aeb tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:02.521473 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7474ac9d-62c0-4be8-94fa-b94c2316fca4 req-cfc72949-d45c-4449-9150-f7733133e992 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:02.522071 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7474ac9d-62c0-4be8-94fa-b94c2316fca4 req-cfc72949-d45c-4449-9150-f7733133e992 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:02.522573 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7474ac9d-62c0-4be8-94fa-b94c2316fca4 req-cfc72949-d45c-4449-9150-f7733133e992 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:02.536080 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-7474ac9d-62c0-4be8-94fa-b94c2316fca4 req-cfc72949-d45c-4449-9150-f7733133e992 service nova] Creating event network-changed:e3a4b163-9f25-4d9f-9309-2cc6b00d4436 for instance a7df0255-adab-4369-b94a-9ea536d18937 on n-h2-833090-16 Aug 31 16:42:02.542548 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-7474ac9d-62c0-4be8-94fa-b94c2316fca4 req-cfc72949-d45c-4449-9150-f7733133e992 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038805 Aug 31 16:42:02.543531 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3464/6742] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:42:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:42:02.549333 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-266fcf2e-bf19-4231-8986-af56429d1aeb tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] [instance: a7df0255-adab-4369-b94a-9ea536d18937] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:42:02.657791 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-266fcf2e-bf19-4231-8986-af56429d1aeb tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a7df0255-adab-4369-b94a-9ea536d18937" status: 204 len: 0 microversion: 2.1 time: 0.156773 Aug 31 16:42:02.658611 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3279/6743] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:42:02 2022] DELETE /compute/v2.1/servers/a7df0255-adab-4369-b94a-9ea536d18937 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:42:02.668212 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1066112e-36e5-463f-924b-c56dc42ac529 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:02.669035 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1066112e-36e5-463f-924b-c56dc42ac529 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] [instance: a7df0255-adab-4369-b94a-9ea536d18937] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:02.676150 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1066112e-36e5-463f-924b-c56dc42ac529 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:02.676861 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1066112e-36e5-463f-924b-c56dc42ac529 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:02.677310 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1066112e-36e5-463f-924b-c56dc42ac529 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:02.678221 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1066112e-36e5-463f-924b-c56dc42ac529 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:02.678689 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1066112e-36e5-463f-924b-c56dc42ac529 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:02.679240 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1066112e-36e5-463f-924b-c56dc42ac529 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:02.816666 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1066112e-36e5-463f-924b-c56dc42ac529 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a80d6de66345a0a9773ec0a4ad3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0257e250d645aea1c2f5d9737fcff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:42:02.824778 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1066112e-36e5-463f-924b-c56dc42ac529 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] 10.222.0.50 "GET /compute/v2.1/servers/a7df0255-adab-4369-b94a-9ea536d18937" status: 200 len: 1671 microversion: 2.1 time: 0.161505 Aug 31 16:42:02.825360 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3465/6744] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:42:02 2022] GET /compute/v2.1/servers/a7df0255-adab-4369-b94a-9ea536d18937 => generated 1671 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:42:03.847675 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-381245f1-c9d7-4093-8e1b-766fa0d2f126 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:03.848392 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-381245f1-c9d7-4093-8e1b-766fa0d2f126 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] [instance: a7df0255-adab-4369-b94a-9ea536d18937] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:03.859664 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-381245f1-c9d7-4093-8e1b-766fa0d2f126 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:03.860160 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-381245f1-c9d7-4093-8e1b-766fa0d2f126 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:03.860626 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-381245f1-c9d7-4093-8e1b-766fa0d2f126 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:03.861328 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-381245f1-c9d7-4093-8e1b-766fa0d2f126 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:03.861778 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-381245f1-c9d7-4093-8e1b-766fa0d2f126 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:03.862233 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-381245f1-c9d7-4093-8e1b-766fa0d2f126 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:04.032080 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-381245f1-c9d7-4093-8e1b-766fa0d2f126 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a80d6de66345a0a9773ec0a4ad3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0257e250d645aea1c2f5d9737fcff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:42:04.042534 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-381245f1-c9d7-4093-8e1b-766fa0d2f126 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] 10.222.0.50 "GET /compute/v2.1/servers/a7df0255-adab-4369-b94a-9ea536d18937" status: 200 len: 1671 microversion: 2.1 time: 0.199268 Aug 31 16:42:04.043289 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3280/6745] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:42:03 2022] GET /compute/v2.1/servers/a7df0255-adab-4369-b94a-9ea536d18937 => generated 1671 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:42:05.034757 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-b1e6c4c3-d83d-4a4a-988f-079ee5e78316 req-906a4140-cd5f-4e3c-8191-d3bb6485ed02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7df0255-adab-4369-b94a-9ea536d18937", "name": "network-vif-deleted", "tag": "e3a4b163-9f25-4d9f-9309-2cc6b00d4436"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:42:05.045798 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-b1e6c4c3-d83d-4a4a-988f-079ee5e78316 req-906a4140-cd5f-4e3c-8191-d3bb6485ed02 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:05.046330 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-b1e6c4c3-d83d-4a4a-988f-079ee5e78316 req-906a4140-cd5f-4e3c-8191-d3bb6485ed02 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:05.046757 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-b1e6c4c3-d83d-4a4a-988f-079ee5e78316 req-906a4140-cd5f-4e3c-8191-d3bb6485ed02 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:05.058540 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-b1e6c4c3-d83d-4a4a-988f-079ee5e78316 req-906a4140-cd5f-4e3c-8191-d3bb6485ed02 service nova] Creating event network-vif-deleted:e3a4b163-9f25-4d9f-9309-2cc6b00d4436 for instance a7df0255-adab-4369-b94a-9ea536d18937 on n-h2-833090-16 Aug 31 16:42:05.063886 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-b1e6c4c3-d83d-4a4a-988f-079ee5e78316 req-906a4140-cd5f-4e3c-8191-d3bb6485ed02 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032736 Aug 31 16:42:05.064716 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3466/6746] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:42:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:42:05.066035 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1aeca306-5836-4f6c-83a2-630b8e046f02 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:05.067866 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1aeca306-5836-4f6c-83a2-630b8e046f02 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] [instance: a7df0255-adab-4369-b94a-9ea536d18937] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:05.075136 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1aeca306-5836-4f6c-83a2-630b8e046f02 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:05.075615 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1aeca306-5836-4f6c-83a2-630b8e046f02 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:05.076083 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1aeca306-5836-4f6c-83a2-630b8e046f02 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:05.076789 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1aeca306-5836-4f6c-83a2-630b8e046f02 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:05.077254 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1aeca306-5836-4f6c-83a2-630b8e046f02 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:05.077706 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1aeca306-5836-4f6c-83a2-630b8e046f02 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:05.143627 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1aeca306-5836-4f6c-83a2-630b8e046f02 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a80d6de66345a0a9773ec0a4ad3855', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0257e250d645aea1c2f5d9737fcff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:42:05.151766 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1aeca306-5836-4f6c-83a2-630b8e046f02 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] 10.222.0.50 "GET /compute/v2.1/servers/a7df0255-adab-4369-b94a-9ea536d18937" status: 200 len: 1334 microversion: 2.1 time: 0.090912 Aug 31 16:42:05.152344 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3281/6747] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:42:05 2022] GET /compute/v2.1/servers/a7df0255-adab-4369-b94a-9ea536d18937 => generated 1334 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:42:06.179746 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-37ddda1b-756e-405d-a662-a84699d5f215 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:06.180917 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-37ddda1b-756e-405d-a662-a84699d5f215 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] [instance: a7df0255-adab-4369-b94a-9ea536d18937] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:06.192301 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-37ddda1b-756e-405d-a662-a84699d5f215 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:06.193176 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-37ddda1b-756e-405d-a662-a84699d5f215 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:06.193882 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-37ddda1b-756e-405d-a662-a84699d5f215 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:06.195093 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-37ddda1b-756e-405d-a662-a84699d5f215 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:06.195872 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-37ddda1b-756e-405d-a662-a84699d5f215 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:06.196913 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-37ddda1b-756e-405d-a662-a84699d5f215 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:06.212166 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-37ddda1b-756e-405d-a662-a84699d5f215 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] HTTP exception thrown: Instance a7df0255-adab-4369-b94a-9ea536d18937 could not be found. Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-37ddda1b-756e-405d-a662-a84699d5f215 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Request method failure captured: Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/a7df0255-adab-4369-b94a-9ea536d18937 HTTP/1.1 Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD45XHXWi_Azg0wkocaeo6ONTypF_d2_u5PE7aJq8kxkLLbmnIiLYOmcg98F391ZTmrsBGYDKoFkxtCK6K8SLqWzfYmNXWzdFHaVAOgvpVkKSm8FVl9cKAyaXp-tTat5o-4vmJH7Tzf4HUZeIMGMDM5wJmsDIDl88UfPEYjRIk58uJQQ Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: ca0257e250d645aea1c2f5d9737fcff5 Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-TestNetworkBasicOps-1342269563 Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ca0257e250d645aea1c2f5d9737fcff5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ca0257e250d645aea1c2f5d9737fcff5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ca0257e250d645aea1c2f5d9737fcff5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ca0257e250d645aea1c2f5d9737fcff5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-TestNetworkBasicOps-1342269563 Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: ca0257e250d645aea1c2f5d9737fcff5 Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-TestNetworkBasicOps-1342269563 Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-TestNetworkBasicOps-1342269563-project Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: c0a80d6de66345a0a9773ec0a4ad3855 Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-TestNetworkBasicOps-1342269563-project Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance a7df0255-adab-4369-b94a-9ea536d18937 could not be found. Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'a7df0255-adab-4369-b94a-9ea536d18937'} Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7df0255-adab-4369-b94a-9ea536d18937 could not be found. Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7df0255-adab-4369-b94a-9ea536d18937 could not be found. Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:42:06.213873 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:42:06.217588 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:42:06.217588 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:42:06.217588 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:42:06.217588 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:42:06.217588 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:42:06.217588 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7df0255-adab-4369-b94a-9ea536d18937 could not be found. Aug 31 16:42:06.217588 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:42:06.217588 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-37ddda1b-756e-405d-a662-a84699d5f215 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Returning 404 to user: Instance a7df0255-adab-4369-b94a-9ea536d18937 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:42:06.217588 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-37ddda1b-756e-405d-a662-a84699d5f215 tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] 10.222.0.50 "GET /compute/v2.1/servers/a7df0255-adab-4369-b94a-9ea536d18937" status: 404 len: 111 microversion: 2.1 time: 0.044363 Aug 31 16:42:06.217588 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3467/6748] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:42:06 2022] GET /compute/v2.1/servers/a7df0255-adab-4369-b94a-9ea536d18937 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:42:06.409676 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-38679fa7-b8da-41a0-b3af-fb2b0d13390d tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] Calling method '.version_select at 0x7fbb45d29b80>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:06.417700 n-d-833090-16 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 16:42:06.417835 n-d-833090-16 devstack@n-api.service[128863]: Wed Aug 31 16:42:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1472817644 (ip 10.222.0.50) !!! Aug 31 16:42:06.443423 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-38679fa7-b8da-41a0-b3af-fb2b0d13390d tempest-TestNetworkBasicOps-1342269563 tempest-TestNetworkBasicOps-1342269563-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1472817644" status: 202 len: 0 microversion: 2.1 time: 0.038367 Aug 31 16:42:06.443999 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3282/6749] 10.222.0.50 () {58 vars in 1257 bytes} [Wed Aug 31 16:42:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1472817644 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:42:13.192123 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c38fd837-ad54-4f9b-b358-8d91ffc26fc5 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Action: 'create', calling method: .version_select at 0x7fbb45481a60>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-416114491", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAU41DBsw2FiuiP2aKVPR34TEV68UbagjC/jNzElf2dmOEzjZ0hRFWJk7Dpn6/E9Axd71GppM6OtIaji0/u2qrVBkAtibfq5ib/9/eXyQJ2VhJcjfzp4b2fh0b06gJC7mw=="}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:42:13.213481 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-c38fd837-ad54-4f9b-b358-8d91ffc26fc5 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Getting quotas for project 7df4ca1d3ee4424eaa45d937e8910a7f. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:42:13.219102 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-c38fd837-ad54-4f9b-b358-8d91ffc26fc5 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Getting quotas for user 045881249c104b53a8e15c98a71463b2 and project 7df4ca1d3ee4424eaa45d937e8910a7f. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:42:13.247608 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c38fd837-ad54-4f9b-b358-8d91ffc26fc5 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.253966 Aug 31 16:42:13.248229 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3468/6750] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 31 16:42:12 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:42:19.163744 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:42:19.164509 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:42:19.169957 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-44c0d1cf-8131-45f1-be56-ef1177727b61 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-158119172-access_point-1472439041", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "1f933596-6da0-4871-81a4-fa37ee6042a8"}], "key_name": "tempest-TestSecurityGroupsBasicOps-416114491", "security_groups": [{"name": "tempest-secgroup_access--1309846420"}, {"name": "tempest-secgroup_general--1003924158"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:42:19.419184 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-44c0d1cf-8131-45f1-be56-ef1177727b61 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] validate_networks() for [('1f933596-6da0-4871-81a4-fa37ee6042a8', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:42:19.903705 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-44c0d1cf-8131-45f1-be56-ef1177727b61 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:42:19.904412 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-44c0d1cf-8131-45f1-be56-ef1177727b61 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:42:19.904880 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-44c0d1cf-8131-45f1-be56-ef1177727b61 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:42:19.905467 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-44c0d1cf-8131-45f1-be56-ef1177727b61 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:42:19.905878 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-44c0d1cf-8131-45f1-be56-ef1177727b61 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:42:19.915246 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44c0d1cf-8131-45f1-be56-ef1177727b61 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:19.915660 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44c0d1cf-8131-45f1-be56-ef1177727b61 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:19.916097 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44c0d1cf-8131-45f1-be56-ef1177727b61 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:19.916824 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44c0d1cf-8131-45f1-be56-ef1177727b61 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:19.917274 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44c0d1cf-8131-45f1-be56-ef1177727b61 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:19.917696 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-44c0d1cf-8131-45f1-be56-ef1177727b61 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:19.935931 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-44c0d1cf-8131-45f1-be56-ef1177727b61 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Getting quotas for project 7df4ca1d3ee4424eaa45d937e8910a7f. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:42:19.941485 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-44c0d1cf-8131-45f1-be56-ef1177727b61 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Getting quotas for user 045881249c104b53a8e15c98a71463b2 and project 7df4ca1d3ee4424eaa45d937e8910a7f. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:42:19.955291 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-44c0d1cf-8131-45f1-be56-ef1177727b61 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:42:19.957383 n-d-833090-16 devstack@n-api.service[128863]: WARNING nova.utils [None req-44c0d1cf-8131-45f1-be56-ef1177727b61 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-158119172-access_point-1472439041 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-158119172-acc Aug 31 16:42:19.958143 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-44c0d1cf-8131-45f1-be56-ef1177727b61 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] [instance: a50141e6-3b07-46db-9de4-d86fc4a8980d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:42:20.012431 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-44c0d1cf-8131-45f1-be56-ef1177727b61 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 458 microversion: 2.1 time: 0.850259 Aug 31 16:42:20.013285 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3283/6751] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:42:19 2022] POST /compute/v2.1/servers => generated 458 bytes in 852 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:42:20.022159 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=16 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:42:20.028223 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-201b1c61-d385-4483-b343-558c967cdc95 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:20.029746 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-201b1c61-d385-4483-b343-558c967cdc95 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] [instance: a50141e6-3b07-46db-9de4-d86fc4a8980d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:20.091082 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-201b1c61-d385-4483-b343-558c967cdc95 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045881249c104b53a8e15c98a71463b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df4ca1d3ee4424eaa45d937e8910a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:42:20.099066 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-201b1c61-d385-4483-b343-558c967cdc95 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] 10.222.0.50 "GET /compute/v2.1/servers/a50141e6-3b07-46db-9de4-d86fc4a8980d" status: 200 len: 1293 microversion: 2.1 time: 0.078612 Aug 31 16:42:20.099879 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3469/6752] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:42:20 2022] GET /compute/v2.1/servers/a50141e6-3b07-46db-9de4-d86fc4a8980d => generated 1293 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:42:21.122075 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-60b1e606-f6e5-48fd-8bc0-9bac4dc9d6e4 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:21.123317 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-60b1e606-f6e5-48fd-8bc0-9bac4dc9d6e4 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] [instance: a50141e6-3b07-46db-9de4-d86fc4a8980d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:21.137290 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60b1e606-f6e5-48fd-8bc0-9bac4dc9d6e4 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:21.138463 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60b1e606-f6e5-48fd-8bc0-9bac4dc9d6e4 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:21.139799 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60b1e606-f6e5-48fd-8bc0-9bac4dc9d6e4 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:21.140852 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60b1e606-f6e5-48fd-8bc0-9bac4dc9d6e4 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:21.142077 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60b1e606-f6e5-48fd-8bc0-9bac4dc9d6e4 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:21.142671 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60b1e606-f6e5-48fd-8bc0-9bac4dc9d6e4 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:21.229508 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-60b1e606-f6e5-48fd-8bc0-9bac4dc9d6e4 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045881249c104b53a8e15c98a71463b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df4ca1d3ee4424eaa45d937e8910a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:42:21.252079 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-60b1e606-f6e5-48fd-8bc0-9bac4dc9d6e4 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] 10.222.0.50 "GET /compute/v2.1/servers/a50141e6-3b07-46db-9de4-d86fc4a8980d" status: 200 len: 1345 microversion: 2.1 time: 0.135041 Aug 31 16:42:21.256002 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3284/6753] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:42:21 2022] GET /compute/v2.1/servers/a50141e6-3b07-46db-9de4-d86fc4a8980d => generated 1345 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:42:22.276704 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f353cb76-7b4e-48bc-b1b0-942693a261fc tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:22.277303 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f353cb76-7b4e-48bc-b1b0-942693a261fc tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] [instance: a50141e6-3b07-46db-9de4-d86fc4a8980d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:22.286017 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f353cb76-7b4e-48bc-b1b0-942693a261fc tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:22.286473 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f353cb76-7b4e-48bc-b1b0-942693a261fc tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:22.286924 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f353cb76-7b4e-48bc-b1b0-942693a261fc tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:22.287653 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f353cb76-7b4e-48bc-b1b0-942693a261fc tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:22.288364 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f353cb76-7b4e-48bc-b1b0-942693a261fc tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:22.288780 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f353cb76-7b4e-48bc-b1b0-942693a261fc tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:22.730648 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-c08f62b1-fd48-499f-b69b-f729f7bb5a13 req-c8e0d14a-2b7d-4196-a5ed-081596185dc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a50141e6-3b07-46db-9de4-d86fc4a8980d", "tag": "c0254e23-209f-4a91-a3cd-fa5d7f9145dc"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:42:22.750162 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c08f62b1-fd48-499f-b69b-f729f7bb5a13 req-c8e0d14a-2b7d-4196-a5ed-081596185dc7 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:22.750893 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c08f62b1-fd48-499f-b69b-f729f7bb5a13 req-c8e0d14a-2b7d-4196-a5ed-081596185dc7 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:22.751516 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-c08f62b1-fd48-499f-b69b-f729f7bb5a13 req-c8e0d14a-2b7d-4196-a5ed-081596185dc7 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:22.770335 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f353cb76-7b4e-48bc-b1b0-942693a261fc tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045881249c104b53a8e15c98a71463b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df4ca1d3ee4424eaa45d937e8910a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:42:22.784399 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f353cb76-7b4e-48bc-b1b0-942693a261fc tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] 10.222.0.50 "GET /compute/v2.1/servers/a50141e6-3b07-46db-9de4-d86fc4a8980d" status: 200 len: 1471 microversion: 2.1 time: 0.507718 Aug 31 16:42:22.787545 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-c08f62b1-fd48-499f-b69b-f729f7bb5a13 req-c8e0d14a-2b7d-4196-a5ed-081596185dc7 service nova] Creating event network-changed:c0254e23-209f-4a91-a3cd-fa5d7f9145dc for instance a50141e6-3b07-46db-9de4-d86fc4a8980d on n-h2-833090-16 Aug 31 16:42:22.796158 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-c08f62b1-fd48-499f-b69b-f729f7bb5a13 req-c8e0d14a-2b7d-4196-a5ed-081596185dc7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080673 Aug 31 16:42:22.797648 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3285/6754] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:42:22.801997 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3470/6755] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:42:22 2022] GET /compute/v2.1/servers/a50141e6-3b07-46db-9de4-d86fc4a8980d => generated 1471 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:42:23.813822 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8d402bdb-d686-4daa-b3e0-ca9c75549b53 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:23.815010 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8d402bdb-d686-4daa-b3e0-ca9c75549b53 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] [instance: a50141e6-3b07-46db-9de4-d86fc4a8980d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:23.826309 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d402bdb-d686-4daa-b3e0-ca9c75549b53 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:23.826814 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d402bdb-d686-4daa-b3e0-ca9c75549b53 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:23.827358 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d402bdb-d686-4daa-b3e0-ca9c75549b53 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:23.828078 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d402bdb-d686-4daa-b3e0-ca9c75549b53 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:23.828521 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d402bdb-d686-4daa-b3e0-ca9c75549b53 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:23.828934 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d402bdb-d686-4daa-b3e0-ca9c75549b53 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:23.979347 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8d402bdb-d686-4daa-b3e0-ca9c75549b53 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045881249c104b53a8e15c98a71463b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df4ca1d3ee4424eaa45d937e8910a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:42:23.991144 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8d402bdb-d686-4daa-b3e0-ca9c75549b53 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] 10.222.0.50 "GET /compute/v2.1/servers/a50141e6-3b07-46db-9de4-d86fc4a8980d" status: 200 len: 1471 microversion: 2.1 time: 0.184518 Aug 31 16:42:23.992016 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3286/6756] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:42:23 2022] GET /compute/v2.1/servers/a50141e6-3b07-46db-9de4-d86fc4a8980d => generated 1471 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:42:25.013898 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-087890e5-a18f-4c13-92d7-4bf45e7b7a7e tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:25.014579 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-087890e5-a18f-4c13-92d7-4bf45e7b7a7e tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] [instance: a50141e6-3b07-46db-9de4-d86fc4a8980d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:25.021301 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-087890e5-a18f-4c13-92d7-4bf45e7b7a7e tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:25.021807 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-087890e5-a18f-4c13-92d7-4bf45e7b7a7e tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:25.022299 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-087890e5-a18f-4c13-92d7-4bf45e7b7a7e tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:25.023024 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-087890e5-a18f-4c13-92d7-4bf45e7b7a7e tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:25.023501 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-087890e5-a18f-4c13-92d7-4bf45e7b7a7e tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:25.026724 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-087890e5-a18f-4c13-92d7-4bf45e7b7a7e tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:25.197656 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-087890e5-a18f-4c13-92d7-4bf45e7b7a7e tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045881249c104b53a8e15c98a71463b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df4ca1d3ee4424eaa45d937e8910a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:42:25.207692 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-087890e5-a18f-4c13-92d7-4bf45e7b7a7e tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] 10.222.0.50 "GET /compute/v2.1/servers/a50141e6-3b07-46db-9de4-d86fc4a8980d" status: 200 len: 1471 microversion: 2.1 time: 0.199383 Aug 31 16:42:25.208288 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3471/6757] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:42:25 2022] GET /compute/v2.1/servers/a50141e6-3b07-46db-9de4-d86fc4a8980d => generated 1471 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:42:26.231133 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-50f6d844-9a97-4bfd-aafb-ef97ed83cf48 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:26.232809 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-50f6d844-9a97-4bfd-aafb-ef97ed83cf48 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] [instance: a50141e6-3b07-46db-9de4-d86fc4a8980d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:26.243257 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50f6d844-9a97-4bfd-aafb-ef97ed83cf48 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:26.243769 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50f6d844-9a97-4bfd-aafb-ef97ed83cf48 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:26.244204 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50f6d844-9a97-4bfd-aafb-ef97ed83cf48 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:26.244909 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50f6d844-9a97-4bfd-aafb-ef97ed83cf48 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:26.245360 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50f6d844-9a97-4bfd-aafb-ef97ed83cf48 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:26.245779 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50f6d844-9a97-4bfd-aafb-ef97ed83cf48 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:26.395927 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-50f6d844-9a97-4bfd-aafb-ef97ed83cf48 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045881249c104b53a8e15c98a71463b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df4ca1d3ee4424eaa45d937e8910a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:42:26.405643 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-50f6d844-9a97-4bfd-aafb-ef97ed83cf48 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] 10.222.0.50 "GET /compute/v2.1/servers/a50141e6-3b07-46db-9de4-d86fc4a8980d" status: 200 len: 1471 microversion: 2.1 time: 0.180219 Aug 31 16:42:26.406414 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3287/6758] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:42:26 2022] GET /compute/v2.1/servers/a50141e6-3b07-46db-9de4-d86fc4a8980d => generated 1471 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:42:27.427456 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9edb4a1a-6345-4436-9491-3669158e50e6 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:27.428065 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9edb4a1a-6345-4436-9491-3669158e50e6 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] [instance: a50141e6-3b07-46db-9de4-d86fc4a8980d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:27.436024 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9edb4a1a-6345-4436-9491-3669158e50e6 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:27.436519 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9edb4a1a-6345-4436-9491-3669158e50e6 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:27.436962 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9edb4a1a-6345-4436-9491-3669158e50e6 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:27.437673 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9edb4a1a-6345-4436-9491-3669158e50e6 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:27.438146 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9edb4a1a-6345-4436-9491-3669158e50e6 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:27.438569 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9edb4a1a-6345-4436-9491-3669158e50e6 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:27.600338 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9edb4a1a-6345-4436-9491-3669158e50e6 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045881249c104b53a8e15c98a71463b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df4ca1d3ee4424eaa45d937e8910a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:42:27.608637 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9edb4a1a-6345-4436-9491-3669158e50e6 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] 10.222.0.50 "GET /compute/v2.1/servers/a50141e6-3b07-46db-9de4-d86fc4a8980d" status: 200 len: 1471 microversion: 2.1 time: 0.185160 Aug 31 16:42:27.609229 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3472/6759] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:42:27 2022] GET /compute/v2.1/servers/a50141e6-3b07-46db-9de4-d86fc4a8980d => generated 1471 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:42:28.632901 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a783c8ee-0c9e-43ab-b600-e7713c447a87 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:28.633733 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a783c8ee-0c9e-43ab-b600-e7713c447a87 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] [instance: a50141e6-3b07-46db-9de4-d86fc4a8980d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:28.641321 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a783c8ee-0c9e-43ab-b600-e7713c447a87 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:28.641807 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a783c8ee-0c9e-43ab-b600-e7713c447a87 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:28.642936 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a783c8ee-0c9e-43ab-b600-e7713c447a87 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:28.643676 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a783c8ee-0c9e-43ab-b600-e7713c447a87 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:28.644136 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a783c8ee-0c9e-43ab-b600-e7713c447a87 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:28.644561 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a783c8ee-0c9e-43ab-b600-e7713c447a87 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:28.797415 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a783c8ee-0c9e-43ab-b600-e7713c447a87 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045881249c104b53a8e15c98a71463b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df4ca1d3ee4424eaa45d937e8910a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:42:28.805512 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a783c8ee-0c9e-43ab-b600-e7713c447a87 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] 10.222.0.50 "GET /compute/v2.1/servers/a50141e6-3b07-46db-9de4-d86fc4a8980d" status: 200 len: 1471 microversion: 2.1 time: 0.177730 Aug 31 16:42:28.806786 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3288/6760] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:42:28 2022] GET /compute/v2.1/servers/a50141e6-3b07-46db-9de4-d86fc4a8980d => generated 1471 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:42:29.827584 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-71b28b9a-94be-4593-a0df-614bd5873d0c tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:29.828848 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-71b28b9a-94be-4593-a0df-614bd5873d0c tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] [instance: a50141e6-3b07-46db-9de4-d86fc4a8980d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:29.836491 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-71b28b9a-94be-4593-a0df-614bd5873d0c tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:29.837166 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-71b28b9a-94be-4593-a0df-614bd5873d0c tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:29.837673 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-71b28b9a-94be-4593-a0df-614bd5873d0c tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:29.838587 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-71b28b9a-94be-4593-a0df-614bd5873d0c tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:29.839147 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-71b28b9a-94be-4593-a0df-614bd5873d0c tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:29.839648 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-71b28b9a-94be-4593-a0df-614bd5873d0c tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:29.996230 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-71b28b9a-94be-4593-a0df-614bd5873d0c tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045881249c104b53a8e15c98a71463b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df4ca1d3ee4424eaa45d937e8910a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:42:30.004423 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-71b28b9a-94be-4593-a0df-614bd5873d0c tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] 10.222.0.50 "GET /compute/v2.1/servers/a50141e6-3b07-46db-9de4-d86fc4a8980d" status: 200 len: 1471 microversion: 2.1 time: 0.180818 Aug 31 16:42:30.005008 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3473/6761] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:42:29 2022] GET /compute/v2.1/servers/a50141e6-3b07-46db-9de4-d86fc4a8980d => generated 1471 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:42:30.367107 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-111e30ee-5775-4ec8-957d-f23fac0d5352 req-5eb1fc2b-c260-4ee1-b36f-31ebfc4ebdea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a50141e6-3b07-46db-9de4-d86fc4a8980d", "name": "network-vif-plugged", "status": "completed", "tag": "c0254e23-209f-4a91-a3cd-fa5d7f9145dc"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:42:30.373870 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:42:30.374665 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:42:30.382523 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-111e30ee-5775-4ec8-957d-f23fac0d5352 req-5eb1fc2b-c260-4ee1-b36f-31ebfc4ebdea service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:30.383000 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-111e30ee-5775-4ec8-957d-f23fac0d5352 req-5eb1fc2b-c260-4ee1-b36f-31ebfc4ebdea service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:30.383429 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-111e30ee-5775-4ec8-957d-f23fac0d5352 req-5eb1fc2b-c260-4ee1-b36f-31ebfc4ebdea service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:30.395124 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-111e30ee-5775-4ec8-957d-f23fac0d5352 req-5eb1fc2b-c260-4ee1-b36f-31ebfc4ebdea service nova] Creating event network-vif-plugged:c0254e23-209f-4a91-a3cd-fa5d7f9145dc for instance a50141e6-3b07-46db-9de4-d86fc4a8980d on n-h2-833090-16 Aug 31 16:42:30.401802 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-111e30ee-5775-4ec8-957d-f23fac0d5352 req-5eb1fc2b-c260-4ee1-b36f-31ebfc4ebdea service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038368 Aug 31 16:42:30.402471 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3289/6762] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:42:31.025490 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-cbfae2b6-8f66-4b39-a43c-a3aa42cfb2b6 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:31.026049 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-cbfae2b6-8f66-4b39-a43c-a3aa42cfb2b6 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] [instance: a50141e6-3b07-46db-9de4-d86fc4a8980d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:31.028051 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=6 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:42:31.034617 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cbfae2b6-8f66-4b39-a43c-a3aa42cfb2b6 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:31.035115 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cbfae2b6-8f66-4b39-a43c-a3aa42cfb2b6 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:31.035557 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cbfae2b6-8f66-4b39-a43c-a3aa42cfb2b6 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:31.036263 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cbfae2b6-8f66-4b39-a43c-a3aa42cfb2b6 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:31.036721 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cbfae2b6-8f66-4b39-a43c-a3aa42cfb2b6 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:31.037174 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cbfae2b6-8f66-4b39-a43c-a3aa42cfb2b6 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:31.189198 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-cbfae2b6-8f66-4b39-a43c-a3aa42cfb2b6 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045881249c104b53a8e15c98a71463b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df4ca1d3ee4424eaa45d937e8910a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:42:31.197895 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-cbfae2b6-8f66-4b39-a43c-a3aa42cfb2b6 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] 10.222.0.50 "GET /compute/v2.1/servers/a50141e6-3b07-46db-9de4-d86fc4a8980d" status: 200 len: 1471 microversion: 2.1 time: 0.176673 Aug 31 16:42:31.198549 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3474/6763] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:42:31 2022] GET /compute/v2.1/servers/a50141e6-3b07-46db-9de4-d86fc4a8980d => generated 1471 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:42:32.219629 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6f5a3df1-7d85-4389-ac16-99b6a507e575 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:32.220318 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6f5a3df1-7d85-4389-ac16-99b6a507e575 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] [instance: a50141e6-3b07-46db-9de4-d86fc4a8980d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:32.228292 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6f5a3df1-7d85-4389-ac16-99b6a507e575 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:32.228741 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6f5a3df1-7d85-4389-ac16-99b6a507e575 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:32.229175 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6f5a3df1-7d85-4389-ac16-99b6a507e575 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:32.229852 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6f5a3df1-7d85-4389-ac16-99b6a507e575 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:32.230340 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6f5a3df1-7d85-4389-ac16-99b6a507e575 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:32.230760 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6f5a3df1-7d85-4389-ac16-99b6a507e575 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:32.378448 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6f5a3df1-7d85-4389-ac16-99b6a507e575 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045881249c104b53a8e15c98a71463b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df4ca1d3ee4424eaa45d937e8910a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:42:32.386916 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6f5a3df1-7d85-4389-ac16-99b6a507e575 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] 10.222.0.50 "GET /compute/v2.1/servers/a50141e6-3b07-46db-9de4-d86fc4a8980d" status: 200 len: 1644 microversion: 2.1 time: 0.171655 Aug 31 16:42:32.387491 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3290/6764] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:42:32 2022] GET /compute/v2.1/servers/a50141e6-3b07-46db-9de4-d86fc4a8980d => generated 1644 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:42:32.407729 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0c3b9629-747a-4083-9ab0-7f764a1be642 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:32.408340 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0c3b9629-747a-4083-9ab0-7f764a1be642 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] [instance: a50141e6-3b07-46db-9de4-d86fc4a8980d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:32.411244 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:42:32.417021 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0c3b9629-747a-4083-9ab0-7f764a1be642 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:32.417510 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0c3b9629-747a-4083-9ab0-7f764a1be642 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:32.417950 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0c3b9629-747a-4083-9ab0-7f764a1be642 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:32.418676 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0c3b9629-747a-4083-9ab0-7f764a1be642 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:32.419157 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0c3b9629-747a-4083-9ab0-7f764a1be642 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:32.419585 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0c3b9629-747a-4083-9ab0-7f764a1be642 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:32.575749 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0c3b9629-747a-4083-9ab0-7f764a1be642 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045881249c104b53a8e15c98a71463b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df4ca1d3ee4424eaa45d937e8910a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:42:32.584112 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0c3b9629-747a-4083-9ab0-7f764a1be642 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] 10.222.0.50 "GET /compute/v2.1/servers/a50141e6-3b07-46db-9de4-d86fc4a8980d" status: 200 len: 1644 microversion: 2.1 time: 0.180609 Aug 31 16:42:32.584703 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3475/6765] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:42:32 2022] GET /compute/v2.1/servers/a50141e6-3b07-46db-9de4-d86fc4a8980d => generated 1644 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:42:32.603969 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5b282db1-1c47-4190-bd50-a5d75cb8b0cb tempest-TestSecurityGroupsBasicOps-1250529568 tempest-TestSecurityGroupsBasicOps-1250529568-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:42:32.604579 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5b282db1-1c47-4190-bd50-a5d75cb8b0cb tempest-TestSecurityGroupsBasicOps-1250529568 tempest-TestSecurityGroupsBasicOps-1250529568-project-admin] [instance: a50141e6-3b07-46db-9de4-d86fc4a8980d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:42:32.610915 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b282db1-1c47-4190-bd50-a5d75cb8b0cb tempest-TestSecurityGroupsBasicOps-1250529568 tempest-TestSecurityGroupsBasicOps-1250529568-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:32.611418 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b282db1-1c47-4190-bd50-a5d75cb8b0cb tempest-TestSecurityGroupsBasicOps-1250529568 tempest-TestSecurityGroupsBasicOps-1250529568-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:32.611844 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b282db1-1c47-4190-bd50-a5d75cb8b0cb tempest-TestSecurityGroupsBasicOps-1250529568 tempest-TestSecurityGroupsBasicOps-1250529568-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:32.612535 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b282db1-1c47-4190-bd50-a5d75cb8b0cb tempest-TestSecurityGroupsBasicOps-1250529568 tempest-TestSecurityGroupsBasicOps-1250529568-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:32.612991 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b282db1-1c47-4190-bd50-a5d75cb8b0cb tempest-TestSecurityGroupsBasicOps-1250529568 tempest-TestSecurityGroupsBasicOps-1250529568-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:32.613407 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b282db1-1c47-4190-bd50-a5d75cb8b0cb tempest-TestSecurityGroupsBasicOps-1250529568 tempest-TestSecurityGroupsBasicOps-1250529568-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:32.852699 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5b282db1-1c47-4190-bd50-a5d75cb8b0cb tempest-TestSecurityGroupsBasicOps-1250529568 tempest-TestSecurityGroupsBasicOps-1250529568-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/a50141e6-3b07-46db-9de4-d86fc4a8980d" status: 200 len: 1797 microversion: 2.1 time: 0.252433 Aug 31 16:42:32.853292 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3291/6766] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:42:32 2022] GET /compute/v2.1/servers/a50141e6-3b07-46db-9de4-d86fc4a8980d => generated 1797 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:42:34.569749 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-7661ec85-14db-49de-84dc-75165a169a2b req-2d55ea5f-06f7-47d3-9884-9523c1866e73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a50141e6-3b07-46db-9de4-d86fc4a8980d", "tag": "c0254e23-209f-4a91-a3cd-fa5d7f9145dc"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:42:34.581023 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7661ec85-14db-49de-84dc-75165a169a2b req-2d55ea5f-06f7-47d3-9884-9523c1866e73 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:42:34.581861 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7661ec85-14db-49de-84dc-75165a169a2b req-2d55ea5f-06f7-47d3-9884-9523c1866e73 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:42:34.582570 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7661ec85-14db-49de-84dc-75165a169a2b req-2d55ea5f-06f7-47d3-9884-9523c1866e73 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:42:34.596341 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-7661ec85-14db-49de-84dc-75165a169a2b req-2d55ea5f-06f7-47d3-9884-9523c1866e73 service nova] Creating event network-changed:c0254e23-209f-4a91-a3cd-fa5d7f9145dc for instance a50141e6-3b07-46db-9de4-d86fc4a8980d on n-h2-833090-16 Aug 31 16:42:34.603637 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-7661ec85-14db-49de-84dc-75165a169a2b req-2d55ea5f-06f7-47d3-9884-9523c1866e73 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114506 Aug 31 16:42:34.606430 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3476/6767] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:42:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:43:56.724759 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-193a13a0-64db-437a-a64e-b7e64091904a tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-612286284", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "9c7a7972-146f-4cf8-b7f6-8899c658abed"}], "key_name": "tempest-TestSecurityGroupsBasicOps-416114491", "security_groups": []}, "os:scheduler_hints": {"different_host": ["a50141e6-3b07-46db-9de4-d86fc4a8980d"]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:43:56.736949 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:43:56.737624 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=42 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:43:56.799759 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-193a13a0-64db-437a-a64e-b7e64091904a tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] validate_networks() for [('9c7a7972-146f-4cf8-b7f6-8899c658abed', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:43:57.341941 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-193a13a0-64db-437a-a64e-b7e64091904a tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:43:57.342405 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-193a13a0-64db-437a-a64e-b7e64091904a tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:43:57.342868 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-193a13a0-64db-437a-a64e-b7e64091904a tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:43:57.343370 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-193a13a0-64db-437a-a64e-b7e64091904a tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:43:57.343780 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-193a13a0-64db-437a-a64e-b7e64091904a tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:43:57.362584 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-193a13a0-64db-437a-a64e-b7e64091904a tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:57.362803 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-193a13a0-64db-437a-a64e-b7e64091904a tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:57.363244 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-193a13a0-64db-437a-a64e-b7e64091904a tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:57.364173 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-193a13a0-64db-437a-a64e-b7e64091904a tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:57.364899 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-193a13a0-64db-437a-a64e-b7e64091904a tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:57.365359 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-193a13a0-64db-437a-a64e-b7e64091904a tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:57.387966 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-193a13a0-64db-437a-a64e-b7e64091904a tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Getting quotas for project 7df4ca1d3ee4424eaa45d937e8910a7f. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:43:57.394240 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-193a13a0-64db-437a-a64e-b7e64091904a tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Getting quotas for user 045881249c104b53a8e15c98a71463b2 and project 7df4ca1d3ee4424eaa45d937e8910a7f. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:43:57.408323 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-193a13a0-64db-437a-a64e-b7e64091904a tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:43:57.410742 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-193a13a0-64db-437a-a64e-b7e64091904a tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] [instance: e75ea964-754c-4a82-8132-433202ce9b2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:43:57.460640 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-193a13a0-64db-437a-a64e-b7e64091904a tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 0.742598 Aug 31 16:43:57.461666 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3292/6768] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:43:56 2022] POST /compute/v2.1/servers => generated 361 bytes in 744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:43:57.471525 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=3 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:43:57.472796 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=38 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:43:57.475048 n-d-833090-16 devstack@n-api.service[128864]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 16:43:57.475492 n-d-833090-16 devstack@n-api.service[128864]: Wed Aug 31 16:43:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e75ea964-754c-4a82-8132-433202ce9b2d (ip 10.222.0.50) !!! Aug 31 16:43:57.482548 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7e993396-7d15-4a78-860c-7ea3c77d333c tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:57.483477 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7e993396-7d15-4a78-860c-7ea3c77d333c tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] [instance: e75ea964-754c-4a82-8132-433202ce9b2d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:57.547608 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7e993396-7d15-4a78-860c-7ea3c77d333c tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045881249c104b53a8e15c98a71463b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df4ca1d3ee4424eaa45d937e8910a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:57.556285 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7e993396-7d15-4a78-860c-7ea3c77d333c tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] 10.222.0.50 "GET /compute/v2.1/servers/e75ea964-754c-4a82-8132-433202ce9b2d" status: 200 len: 1240 microversion: 2.1 time: 0.086266 Aug 31 16:43:57.557127 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3477/6769] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:57 2022] GET /compute/v2.1/servers/e75ea964-754c-4a82-8132-433202ce9b2d => generated 1240 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:58.583670 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-54f0720f-7c61-4353-b644-bfd8295a3add tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:58.584549 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-54f0720f-7c61-4353-b644-bfd8295a3add tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] [instance: e75ea964-754c-4a82-8132-433202ce9b2d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:58.594387 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-54f0720f-7c61-4353-b644-bfd8295a3add tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:58.594874 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-54f0720f-7c61-4353-b644-bfd8295a3add tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:58.596219 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-54f0720f-7c61-4353-b644-bfd8295a3add tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:58.597494 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-54f0720f-7c61-4353-b644-bfd8295a3add tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:58.598129 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-54f0720f-7c61-4353-b644-bfd8295a3add tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:58.598760 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-54f0720f-7c61-4353-b644-bfd8295a3add tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:58.677187 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-54f0720f-7c61-4353-b644-bfd8295a3add tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045881249c104b53a8e15c98a71463b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df4ca1d3ee4424eaa45d937e8910a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:58.687579 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-54f0720f-7c61-4353-b644-bfd8295a3add tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] 10.222.0.50 "GET /compute/v2.1/servers/e75ea964-754c-4a82-8132-433202ce9b2d" status: 200 len: 1300 microversion: 2.1 time: 0.112382 Aug 31 16:43:58.688651 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3293/6770] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:58 2022] GET /compute/v2.1/servers/e75ea964-754c-4a82-8132-433202ce9b2d => generated 1300 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:43:59.711143 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5abcad7b-f43f-4039-b2a9-a35fc508752b tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:43:59.711794 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5abcad7b-f43f-4039-b2a9-a35fc508752b tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] [instance: e75ea964-754c-4a82-8132-433202ce9b2d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:43:59.720650 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5abcad7b-f43f-4039-b2a9-a35fc508752b tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:59.721155 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5abcad7b-f43f-4039-b2a9-a35fc508752b tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:59.721597 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5abcad7b-f43f-4039-b2a9-a35fc508752b tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:59.722335 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5abcad7b-f43f-4039-b2a9-a35fc508752b tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:43:59.722800 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5abcad7b-f43f-4039-b2a9-a35fc508752b tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:43:59.723250 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5abcad7b-f43f-4039-b2a9-a35fc508752b tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:43:59.807845 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5abcad7b-f43f-4039-b2a9-a35fc508752b tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045881249c104b53a8e15c98a71463b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df4ca1d3ee4424eaa45d937e8910a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:43:59.816204 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5abcad7b-f43f-4039-b2a9-a35fc508752b tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] 10.222.0.50 "GET /compute/v2.1/servers/e75ea964-754c-4a82-8132-433202ce9b2d" status: 200 len: 1298 microversion: 2.1 time: 0.110591 Aug 31 16:43:59.816877 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3478/6771] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:43:59 2022] GET /compute/v2.1/servers/e75ea964-754c-4a82-8132-433202ce9b2d => generated 1298 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:00.087174 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-8d248b19-af6a-496b-9aa2-eab985525640 req-31c84290-11d9-453f-9ef7-50bbf97a7023 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e75ea964-754c-4a82-8132-433202ce9b2d", "tag": "58aa2805-a9fb-4445-b2a1-4e847d71aecb"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:44:00.097291 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8d248b19-af6a-496b-9aa2-eab985525640 req-31c84290-11d9-453f-9ef7-50bbf97a7023 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:00.097801 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8d248b19-af6a-496b-9aa2-eab985525640 req-31c84290-11d9-453f-9ef7-50bbf97a7023 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:00.098348 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8d248b19-af6a-496b-9aa2-eab985525640 req-31c84290-11d9-453f-9ef7-50bbf97a7023 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:00.110855 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-8d248b19-af6a-496b-9aa2-eab985525640 req-31c84290-11d9-453f-9ef7-50bbf97a7023 service nova] Creating event network-changed:58aa2805-a9fb-4445-b2a1-4e847d71aecb for instance e75ea964-754c-4a82-8132-433202ce9b2d on n-h1-833090-16 Aug 31 16:44:00.116145 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-8d248b19-af6a-496b-9aa2-eab985525640 req-31c84290-11d9-453f-9ef7-50bbf97a7023 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033925 Aug 31 16:44:00.117271 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3294/6772] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:44:00.837953 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d8d6a0d0-02fc-445e-868f-3dca80e5b745 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:00.838667 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d8d6a0d0-02fc-445e-868f-3dca80e5b745 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] [instance: e75ea964-754c-4a82-8132-433202ce9b2d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:00.846384 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d8d6a0d0-02fc-445e-868f-3dca80e5b745 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:00.846886 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d8d6a0d0-02fc-445e-868f-3dca80e5b745 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:00.847335 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d8d6a0d0-02fc-445e-868f-3dca80e5b745 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:00.848055 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d8d6a0d0-02fc-445e-868f-3dca80e5b745 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:00.848527 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d8d6a0d0-02fc-445e-868f-3dca80e5b745 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:00.848962 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d8d6a0d0-02fc-445e-868f-3dca80e5b745 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:00.937398 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d8d6a0d0-02fc-445e-868f-3dca80e5b745 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045881249c104b53a8e15c98a71463b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df4ca1d3ee4424eaa45d937e8910a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:00.946406 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d8d6a0d0-02fc-445e-868f-3dca80e5b745 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] 10.222.0.50 "GET /compute/v2.1/servers/e75ea964-754c-4a82-8132-433202ce9b2d" status: 200 len: 1298 microversion: 2.1 time: 0.112996 Aug 31 16:44:00.947046 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3479/6773] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:00 2022] GET /compute/v2.1/servers/e75ea964-754c-4a82-8132-433202ce9b2d => generated 1298 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:01.972094 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ae1bde4c-e713-4a5b-939f-b088544b1488 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:01.973141 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ae1bde4c-e713-4a5b-939f-b088544b1488 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] [instance: e75ea964-754c-4a82-8132-433202ce9b2d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:01.982681 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae1bde4c-e713-4a5b-939f-b088544b1488 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:01.983358 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae1bde4c-e713-4a5b-939f-b088544b1488 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:01.984003 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae1bde4c-e713-4a5b-939f-b088544b1488 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:01.987269 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae1bde4c-e713-4a5b-939f-b088544b1488 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:01.987269 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae1bde4c-e713-4a5b-939f-b088544b1488 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:01.987269 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae1bde4c-e713-4a5b-939f-b088544b1488 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:02.090075 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ae1bde4c-e713-4a5b-939f-b088544b1488 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045881249c104b53a8e15c98a71463b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df4ca1d3ee4424eaa45d937e8910a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:02.102825 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ae1bde4c-e713-4a5b-939f-b088544b1488 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] 10.222.0.50 "GET /compute/v2.1/servers/e75ea964-754c-4a82-8132-433202ce9b2d" status: 200 len: 1298 microversion: 2.1 time: 0.137771 Aug 31 16:44:02.103802 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3295/6774] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:01 2022] GET /compute/v2.1/servers/e75ea964-754c-4a82-8132-433202ce9b2d => generated 1298 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:03.132289 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7317f839-01fe-484b-bf7a-343eb2ecc0f2 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:03.132903 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7317f839-01fe-484b-bf7a-343eb2ecc0f2 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] [instance: e75ea964-754c-4a82-8132-433202ce9b2d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:03.142554 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7317f839-01fe-484b-bf7a-343eb2ecc0f2 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:03.143050 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7317f839-01fe-484b-bf7a-343eb2ecc0f2 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:03.143488 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7317f839-01fe-484b-bf7a-343eb2ecc0f2 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:03.144180 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7317f839-01fe-484b-bf7a-343eb2ecc0f2 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:03.144639 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7317f839-01fe-484b-bf7a-343eb2ecc0f2 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:03.145065 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7317f839-01fe-484b-bf7a-343eb2ecc0f2 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:03.237948 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7317f839-01fe-484b-bf7a-343eb2ecc0f2 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045881249c104b53a8e15c98a71463b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df4ca1d3ee4424eaa45d937e8910a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:03.249818 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7317f839-01fe-484b-bf7a-343eb2ecc0f2 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] 10.222.0.50 "GET /compute/v2.1/servers/e75ea964-754c-4a82-8132-433202ce9b2d" status: 200 len: 1298 microversion: 2.1 time: 0.123766 Aug 31 16:44:03.250663 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3480/6775] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:03 2022] GET /compute/v2.1/servers/e75ea964-754c-4a82-8132-433202ce9b2d => generated 1298 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:04.274075 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f21eceea-7334-4089-a326-d6faeb9cdbbc tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:04.274720 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f21eceea-7334-4089-a326-d6faeb9cdbbc tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] [instance: e75ea964-754c-4a82-8132-433202ce9b2d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:04.282361 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f21eceea-7334-4089-a326-d6faeb9cdbbc tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:04.282826 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f21eceea-7334-4089-a326-d6faeb9cdbbc tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:04.283263 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f21eceea-7334-4089-a326-d6faeb9cdbbc tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:04.283965 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f21eceea-7334-4089-a326-d6faeb9cdbbc tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:04.284418 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f21eceea-7334-4089-a326-d6faeb9cdbbc tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:04.284878 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f21eceea-7334-4089-a326-d6faeb9cdbbc tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:04.375272 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f21eceea-7334-4089-a326-d6faeb9cdbbc tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045881249c104b53a8e15c98a71463b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df4ca1d3ee4424eaa45d937e8910a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:04.383727 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f21eceea-7334-4089-a326-d6faeb9cdbbc tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] 10.222.0.50 "GET /compute/v2.1/servers/e75ea964-754c-4a82-8132-433202ce9b2d" status: 200 len: 1298 microversion: 2.1 time: 0.114176 Aug 31 16:44:04.384300 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3296/6776] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:04 2022] GET /compute/v2.1/servers/e75ea964-754c-4a82-8132-433202ce9b2d => generated 1298 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:05.409346 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-59effb3a-20ba-4f4a-b8f3-de9261e33b69 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:05.409920 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-59effb3a-20ba-4f4a-b8f3-de9261e33b69 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] [instance: e75ea964-754c-4a82-8132-433202ce9b2d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:05.417309 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-59effb3a-20ba-4f4a-b8f3-de9261e33b69 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:05.417814 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-59effb3a-20ba-4f4a-b8f3-de9261e33b69 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:05.418336 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-59effb3a-20ba-4f4a-b8f3-de9261e33b69 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:05.419049 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-59effb3a-20ba-4f4a-b8f3-de9261e33b69 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:05.419544 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-59effb3a-20ba-4f4a-b8f3-de9261e33b69 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:05.420146 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-59effb3a-20ba-4f4a-b8f3-de9261e33b69 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:05.503884 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-59effb3a-20ba-4f4a-b8f3-de9261e33b69 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045881249c104b53a8e15c98a71463b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df4ca1d3ee4424eaa45d937e8910a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:05.511754 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-59effb3a-20ba-4f4a-b8f3-de9261e33b69 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] 10.222.0.50 "GET /compute/v2.1/servers/e75ea964-754c-4a82-8132-433202ce9b2d" status: 200 len: 1298 microversion: 2.1 time: 0.110672 Aug 31 16:44:05.512737 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3481/6777] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:05 2022] GET /compute/v2.1/servers/e75ea964-754c-4a82-8132-433202ce9b2d => generated 1298 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:05.623998 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-4192d60a-0b85-461a-b768-111e1a56d982 req-50d82726-23bf-497f-a75f-e4035520b0d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e75ea964-754c-4a82-8132-433202ce9b2d", "name": "network-vif-plugged", "status": "completed", "tag": "58aa2805-a9fb-4445-b2a1-4e847d71aecb"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:44:05.634157 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4192d60a-0b85-461a-b768-111e1a56d982 req-50d82726-23bf-497f-a75f-e4035520b0d6 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:05.634777 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4192d60a-0b85-461a-b768-111e1a56d982 req-50d82726-23bf-497f-a75f-e4035520b0d6 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:05.635217 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4192d60a-0b85-461a-b768-111e1a56d982 req-50d82726-23bf-497f-a75f-e4035520b0d6 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:05.646487 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-4192d60a-0b85-461a-b768-111e1a56d982 req-50d82726-23bf-497f-a75f-e4035520b0d6 service nova] Creating event network-vif-plugged:58aa2805-a9fb-4445-b2a1-4e847d71aecb for instance e75ea964-754c-4a82-8132-433202ce9b2d on n-h1-833090-16 Aug 31 16:44:05.652683 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-4192d60a-0b85-461a-b768-111e1a56d982 req-50d82726-23bf-497f-a75f-e4035520b0d6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103673 Aug 31 16:44:05.653313 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3297/6778] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:44:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:44:06.533220 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ebdc32ca-159b-4a3e-a0e5-8550a9744fd3 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:06.533767 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ebdc32ca-159b-4a3e-a0e5-8550a9744fd3 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] [instance: e75ea964-754c-4a82-8132-433202ce9b2d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:06.542186 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ebdc32ca-159b-4a3e-a0e5-8550a9744fd3 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:06.542696 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ebdc32ca-159b-4a3e-a0e5-8550a9744fd3 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:06.543139 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ebdc32ca-159b-4a3e-a0e5-8550a9744fd3 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:06.543845 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ebdc32ca-159b-4a3e-a0e5-8550a9744fd3 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:06.544301 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ebdc32ca-159b-4a3e-a0e5-8550a9744fd3 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:06.544732 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ebdc32ca-159b-4a3e-a0e5-8550a9744fd3 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:06.632751 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ebdc32ca-159b-4a3e-a0e5-8550a9744fd3 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045881249c104b53a8e15c98a71463b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df4ca1d3ee4424eaa45d937e8910a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:06.641296 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ebdc32ca-159b-4a3e-a0e5-8550a9744fd3 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] 10.222.0.50 "GET /compute/v2.1/servers/e75ea964-754c-4a82-8132-433202ce9b2d" status: 200 len: 1298 microversion: 2.1 time: 0.112123 Aug 31 16:44:06.641876 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3482/6779] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:06 2022] GET /compute/v2.1/servers/e75ea964-754c-4a82-8132-433202ce9b2d => generated 1298 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:07.661717 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:44:07.662535 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:44:07.666867 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ba554927-2710-4962-bf26-922cb1891bd5 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:07.667565 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ba554927-2710-4962-bf26-922cb1891bd5 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] [instance: e75ea964-754c-4a82-8132-433202ce9b2d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:07.674854 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba554927-2710-4962-bf26-922cb1891bd5 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:07.675335 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba554927-2710-4962-bf26-922cb1891bd5 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:07.675762 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba554927-2710-4962-bf26-922cb1891bd5 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:07.676451 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba554927-2710-4962-bf26-922cb1891bd5 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:07.676894 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba554927-2710-4962-bf26-922cb1891bd5 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:07.677314 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba554927-2710-4962-bf26-922cb1891bd5 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:07.779226 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ba554927-2710-4962-bf26-922cb1891bd5 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045881249c104b53a8e15c98a71463b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df4ca1d3ee4424eaa45d937e8910a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:07.787497 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ba554927-2710-4962-bf26-922cb1891bd5 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] 10.222.0.50 "GET /compute/v2.1/servers/e75ea964-754c-4a82-8132-433202ce9b2d" status: 200 len: 1471 microversion: 2.1 time: 0.127774 Aug 31 16:44:07.788074 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3298/6780] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:07 2022] GET /compute/v2.1/servers/e75ea964-754c-4a82-8132-433202ce9b2d => generated 1471 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:07.808710 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b8e5e8c2-ab7f-44ab-8a4f-30d164ed5523 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:07.809424 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b8e5e8c2-ab7f-44ab-8a4f-30d164ed5523 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] [instance: e75ea964-754c-4a82-8132-433202ce9b2d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:07.812241 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:44:07.817800 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b8e5e8c2-ab7f-44ab-8a4f-30d164ed5523 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:07.818329 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b8e5e8c2-ab7f-44ab-8a4f-30d164ed5523 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:07.818775 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b8e5e8c2-ab7f-44ab-8a4f-30d164ed5523 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:07.819516 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b8e5e8c2-ab7f-44ab-8a4f-30d164ed5523 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:07.819988 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b8e5e8c2-ab7f-44ab-8a4f-30d164ed5523 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:07.820422 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b8e5e8c2-ab7f-44ab-8a4f-30d164ed5523 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:07.908390 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b8e5e8c2-ab7f-44ab-8a4f-30d164ed5523 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045881249c104b53a8e15c98a71463b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df4ca1d3ee4424eaa45d937e8910a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:07.916758 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b8e5e8c2-ab7f-44ab-8a4f-30d164ed5523 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] 10.222.0.50 "GET /compute/v2.1/servers/e75ea964-754c-4a82-8132-433202ce9b2d" status: 200 len: 1471 microversion: 2.1 time: 0.112240 Aug 31 16:44:07.917733 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3483/6781] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:07 2022] GET /compute/v2.1/servers/e75ea964-754c-4a82-8132-433202ce9b2d => generated 1471 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:07.937434 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3aaa49fe-1eef-48fd-8335-1c33784d2771 tempest-TestSecurityGroupsBasicOps-1250529568 tempest-TestSecurityGroupsBasicOps-1250529568-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:07.938129 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3aaa49fe-1eef-48fd-8335-1c33784d2771 tempest-TestSecurityGroupsBasicOps-1250529568 tempest-TestSecurityGroupsBasicOps-1250529568-project-admin] [instance: e75ea964-754c-4a82-8132-433202ce9b2d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:07.944450 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3aaa49fe-1eef-48fd-8335-1c33784d2771 tempest-TestSecurityGroupsBasicOps-1250529568 tempest-TestSecurityGroupsBasicOps-1250529568-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:07.944930 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3aaa49fe-1eef-48fd-8335-1c33784d2771 tempest-TestSecurityGroupsBasicOps-1250529568 tempest-TestSecurityGroupsBasicOps-1250529568-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:07.945354 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3aaa49fe-1eef-48fd-8335-1c33784d2771 tempest-TestSecurityGroupsBasicOps-1250529568 tempest-TestSecurityGroupsBasicOps-1250529568-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:07.946044 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3aaa49fe-1eef-48fd-8335-1c33784d2771 tempest-TestSecurityGroupsBasicOps-1250529568 tempest-TestSecurityGroupsBasicOps-1250529568-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:07.946507 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3aaa49fe-1eef-48fd-8335-1c33784d2771 tempest-TestSecurityGroupsBasicOps-1250529568 tempest-TestSecurityGroupsBasicOps-1250529568-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:07.946924 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3aaa49fe-1eef-48fd-8335-1c33784d2771 tempest-TestSecurityGroupsBasicOps-1250529568 tempest-TestSecurityGroupsBasicOps-1250529568-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:08.029145 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3aaa49fe-1eef-48fd-8335-1c33784d2771 tempest-TestSecurityGroupsBasicOps-1250529568 tempest-TestSecurityGroupsBasicOps-1250529568-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e75ea964-754c-4a82-8132-433202ce9b2d" status: 200 len: 1624 microversion: 2.1 time: 0.095378 Aug 31 16:44:08.029761 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3299/6782] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:07 2022] GET /compute/v2.1/servers/e75ea964-754c-4a82-8132-433202ce9b2d => generated 1624 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:08.049993 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-65948aeb-dcf7-434e-a4eb-2b78c58b5be4 tempest-TestSecurityGroupsBasicOps-1250529568 tempest-TestSecurityGroupsBasicOps-1250529568-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:08.050693 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-65948aeb-dcf7-434e-a4eb-2b78c58b5be4 tempest-TestSecurityGroupsBasicOps-1250529568 tempest-TestSecurityGroupsBasicOps-1250529568-project-admin] [instance: a50141e6-3b07-46db-9de4-d86fc4a8980d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:08.056946 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-65948aeb-dcf7-434e-a4eb-2b78c58b5be4 tempest-TestSecurityGroupsBasicOps-1250529568 tempest-TestSecurityGroupsBasicOps-1250529568-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:08.057563 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-65948aeb-dcf7-434e-a4eb-2b78c58b5be4 tempest-TestSecurityGroupsBasicOps-1250529568 tempest-TestSecurityGroupsBasicOps-1250529568-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:08.058005 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-65948aeb-dcf7-434e-a4eb-2b78c58b5be4 tempest-TestSecurityGroupsBasicOps-1250529568 tempest-TestSecurityGroupsBasicOps-1250529568-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:08.058762 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-65948aeb-dcf7-434e-a4eb-2b78c58b5be4 tempest-TestSecurityGroupsBasicOps-1250529568 tempest-TestSecurityGroupsBasicOps-1250529568-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:08.059193 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-65948aeb-dcf7-434e-a4eb-2b78c58b5be4 tempest-TestSecurityGroupsBasicOps-1250529568 tempest-TestSecurityGroupsBasicOps-1250529568-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:08.059659 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-65948aeb-dcf7-434e-a4eb-2b78c58b5be4 tempest-TestSecurityGroupsBasicOps-1250529568 tempest-TestSecurityGroupsBasicOps-1250529568-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:08.209512 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-65948aeb-dcf7-434e-a4eb-2b78c58b5be4 tempest-TestSecurityGroupsBasicOps-1250529568 tempest-TestSecurityGroupsBasicOps-1250529568-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/a50141e6-3b07-46db-9de4-d86fc4a8980d" status: 200 len: 1915 microversion: 2.1 time: 0.163164 Aug 31 16:44:08.210083 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3484/6783] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:08 2022] GET /compute/v2.1/servers/a50141e6-3b07-46db-9de4-d86fc4a8980d => generated 1915 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:08.281264 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-af1527fb-753d-477a-8659-fd43746ba3d9 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:08.281765 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-af1527fb-753d-477a-8659-fd43746ba3d9 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] [instance: e75ea964-754c-4a82-8132-433202ce9b2d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:08.288438 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af1527fb-753d-477a-8659-fd43746ba3d9 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:08.288957 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af1527fb-753d-477a-8659-fd43746ba3d9 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:08.289392 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af1527fb-753d-477a-8659-fd43746ba3d9 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:08.290131 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af1527fb-753d-477a-8659-fd43746ba3d9 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:08.290596 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af1527fb-753d-477a-8659-fd43746ba3d9 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:08.291016 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af1527fb-753d-477a-8659-fd43746ba3d9 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:08.316953 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-af1527fb-753d-477a-8659-fd43746ba3d9 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] [instance: e75ea964-754c-4a82-8132-433202ce9b2d] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:44:08.404957 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-af1527fb-753d-477a-8659-fd43746ba3d9 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e75ea964-754c-4a82-8132-433202ce9b2d" status: 204 len: 0 microversion: 2.1 time: 0.127443 Aug 31 16:44:08.405900 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3300/6784] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:44:08 2022] DELETE /compute/v2.1/servers/e75ea964-754c-4a82-8132-433202ce9b2d => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:44:08.414339 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ac26c1ba-c1ef-4a6f-8370-3b200617a257 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:08.414979 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ac26c1ba-c1ef-4a6f-8370-3b200617a257 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] [instance: e75ea964-754c-4a82-8132-433202ce9b2d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:08.421573 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ac26c1ba-c1ef-4a6f-8370-3b200617a257 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:08.422213 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ac26c1ba-c1ef-4a6f-8370-3b200617a257 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:08.422690 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ac26c1ba-c1ef-4a6f-8370-3b200617a257 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:08.423403 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ac26c1ba-c1ef-4a6f-8370-3b200617a257 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:08.423831 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ac26c1ba-c1ef-4a6f-8370-3b200617a257 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:08.424264 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ac26c1ba-c1ef-4a6f-8370-3b200617a257 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:08.511619 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ac26c1ba-c1ef-4a6f-8370-3b200617a257 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045881249c104b53a8e15c98a71463b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df4ca1d3ee4424eaa45d937e8910a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:08.521496 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ac26c1ba-c1ef-4a6f-8370-3b200617a257 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] 10.222.0.50 "GET /compute/v2.1/servers/e75ea964-754c-4a82-8132-433202ce9b2d" status: 200 len: 1477 microversion: 2.1 time: 0.111039 Aug 31 16:44:08.522125 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3485/6785] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:08 2022] GET /compute/v2.1/servers/e75ea964-754c-4a82-8132-433202ce9b2d => generated 1477 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:09.544370 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-957b3abe-dbc9-407e-beb3-b3611b4befdd tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:09.545074 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-957b3abe-dbc9-407e-beb3-b3611b4befdd tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] [instance: e75ea964-754c-4a82-8132-433202ce9b2d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:09.552875 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-957b3abe-dbc9-407e-beb3-b3611b4befdd tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:09.553344 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-957b3abe-dbc9-407e-beb3-b3611b4befdd tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:09.553783 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-957b3abe-dbc9-407e-beb3-b3611b4befdd tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:09.554758 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-957b3abe-dbc9-407e-beb3-b3611b4befdd tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:09.555431 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-957b3abe-dbc9-407e-beb3-b3611b4befdd tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:09.555893 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-957b3abe-dbc9-407e-beb3-b3611b4befdd tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:09.651094 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-957b3abe-dbc9-407e-beb3-b3611b4befdd tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045881249c104b53a8e15c98a71463b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df4ca1d3ee4424eaa45d937e8910a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:09.660375 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-957b3abe-dbc9-407e-beb3-b3611b4befdd tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] 10.222.0.50 "GET /compute/v2.1/servers/e75ea964-754c-4a82-8132-433202ce9b2d" status: 200 len: 1477 microversion: 2.1 time: 0.120733 Aug 31 16:44:09.660950 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3301/6786] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:09 2022] GET /compute/v2.1/servers/e75ea964-754c-4a82-8132-433202ce9b2d => generated 1477 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:10.163523 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-76d6b2f6-fedf-460c-b87b-bf0472ee16b8 req-ea060ed5-1eb5-46b4-8776-cbe800424718 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e75ea964-754c-4a82-8132-433202ce9b2d", "name": "network-vif-deleted", "tag": "58aa2805-a9fb-4445-b2a1-4e847d71aecb"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:44:10.174981 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-76d6b2f6-fedf-460c-b87b-bf0472ee16b8 req-ea060ed5-1eb5-46b4-8776-cbe800424718 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:10.175388 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-76d6b2f6-fedf-460c-b87b-bf0472ee16b8 req-ea060ed5-1eb5-46b4-8776-cbe800424718 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:10.175821 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-76d6b2f6-fedf-460c-b87b-bf0472ee16b8 req-ea060ed5-1eb5-46b4-8776-cbe800424718 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:10.194079 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-76d6b2f6-fedf-460c-b87b-bf0472ee16b8 req-ea060ed5-1eb5-46b4-8776-cbe800424718 service nova] Creating event network-vif-deleted:58aa2805-a9fb-4445-b2a1-4e847d71aecb for instance e75ea964-754c-4a82-8132-433202ce9b2d on n-h1-833090-16 Aug 31 16:44:10.199408 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-76d6b2f6-fedf-460c-b87b-bf0472ee16b8 req-ea060ed5-1eb5-46b4-8776-cbe800424718 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039632 Aug 31 16:44:10.199979 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3486/6787] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:44:10.681554 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1501e242-9777-43ba-9e1d-71bbcd1c118e tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:10.682245 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1501e242-9777-43ba-9e1d-71bbcd1c118e tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] [instance: e75ea964-754c-4a82-8132-433202ce9b2d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:10.689762 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1501e242-9777-43ba-9e1d-71bbcd1c118e tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:10.690308 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1501e242-9777-43ba-9e1d-71bbcd1c118e tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:10.690741 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1501e242-9777-43ba-9e1d-71bbcd1c118e tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:10.691979 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1501e242-9777-43ba-9e1d-71bbcd1c118e tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:10.691979 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1501e242-9777-43ba-9e1d-71bbcd1c118e tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:10.692414 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1501e242-9777-43ba-9e1d-71bbcd1c118e tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:10.708780 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-1501e242-9777-43ba-9e1d-71bbcd1c118e tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] HTTP exception thrown: Instance e75ea964-754c-4a82-8132-433202ce9b2d could not be found. Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1501e242-9777-43ba-9e1d-71bbcd1c118e tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Request method failure captured: Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/e75ea964-754c-4a82-8132-433202ce9b2d HTTP/1.1 Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD49jWBhsHhXnIEJT5dbw6QYEnwta2E52Cu4VQRfgxYOP0-errnfFJ1nNN3knstao3NwmM1wqB1Jsy7eLSJTeMiRgwO1oLRotDmMZK3HceChvYc4pnZGZFUL4tED47RO4A_uzRVI-09yIV8K60r7OrZLmy-lQoEsH--7j9FnxN6h7WWA Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 7df4ca1d3ee4424eaa45d937e8910a7f Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-158119172 Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7df4ca1d3ee4424eaa45d937e8910a7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7df4ca1d3ee4424eaa45d937e8910a7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7df4ca1d3ee4424eaa45d937e8910a7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7df4ca1d3ee4424eaa45d937e8910a7f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-TestSecurityGroupsBasicOps-158119172 Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 7df4ca1d3ee4424eaa45d937e8910a7f Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-158119172 Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-TestSecurityGroupsBasicOps-158119172-project Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 045881249c104b53a8e15c98a71463b2 Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-TestSecurityGroupsBasicOps-158119172-project Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance e75ea964-754c-4a82-8132-433202ce9b2d could not be found. Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'e75ea964-754c-4a82-8132-433202ce9b2d'} Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e75ea964-754c-4a82-8132-433202ce9b2d could not be found. Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e75ea964-754c-4a82-8132-433202ce9b2d could not be found. Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:44:10.710458 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:44:10.714580 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:44:10.714580 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:44:10.714580 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:44:10.714580 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:44:10.714580 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:44:10.714580 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e75ea964-754c-4a82-8132-433202ce9b2d could not be found. Aug 31 16:44:10.714580 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:44:10.714580 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1501e242-9777-43ba-9e1d-71bbcd1c118e tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Returning 404 to user: Instance e75ea964-754c-4a82-8132-433202ce9b2d could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:44:10.714580 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1501e242-9777-43ba-9e1d-71bbcd1c118e tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] 10.222.0.50 "GET /compute/v2.1/servers/e75ea964-754c-4a82-8132-433202ce9b2d" status: 404 len: 111 microversion: 2.1 time: 0.034312 Aug 31 16:44:10.714580 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3302/6788] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:10 2022] GET /compute/v2.1/servers/e75ea964-754c-4a82-8132-433202ce9b2d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:44:15.026235 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-21edba42-d891-463c-9526-d8f34610982e tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:15.026959 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-21edba42-d891-463c-9526-d8f34610982e tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] [instance: a50141e6-3b07-46db-9de4-d86fc4a8980d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:15.033819 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-21edba42-d891-463c-9526-d8f34610982e tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:15.034659 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-21edba42-d891-463c-9526-d8f34610982e tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:15.035206 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-21edba42-d891-463c-9526-d8f34610982e tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:15.036001 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-21edba42-d891-463c-9526-d8f34610982e tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:15.036737 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-21edba42-d891-463c-9526-d8f34610982e tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:15.037262 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-21edba42-d891-463c-9526-d8f34610982e tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:15.069709 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-21edba42-d891-463c-9526-d8f34610982e tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] [instance: a50141e6-3b07-46db-9de4-d86fc4a8980d] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:44:15.100231 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-e324b4b9-4479-419c-885f-43d5daa620e5 req-38901e23-b34a-49ae-aa23-e016b221644a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a50141e6-3b07-46db-9de4-d86fc4a8980d", "tag": "c0254e23-209f-4a91-a3cd-fa5d7f9145dc"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:44:15.110567 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e324b4b9-4479-419c-885f-43d5daa620e5 req-38901e23-b34a-49ae-aa23-e016b221644a service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:15.111022 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e324b4b9-4479-419c-885f-43d5daa620e5 req-38901e23-b34a-49ae-aa23-e016b221644a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:15.111648 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e324b4b9-4479-419c-885f-43d5daa620e5 req-38901e23-b34a-49ae-aa23-e016b221644a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:15.128277 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-e324b4b9-4479-419c-885f-43d5daa620e5 req-38901e23-b34a-49ae-aa23-e016b221644a service nova] Creating event network-changed:c0254e23-209f-4a91-a3cd-fa5d7f9145dc for instance a50141e6-3b07-46db-9de4-d86fc4a8980d on n-h2-833090-16 Aug 31 16:44:15.133880 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-e324b4b9-4479-419c-885f-43d5daa620e5 req-38901e23-b34a-49ae-aa23-e016b221644a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111405 Aug 31 16:44:15.138276 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3303/6789] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:44:15.171108 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-21edba42-d891-463c-9526-d8f34610982e tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a50141e6-3b07-46db-9de4-d86fc4a8980d" status: 204 len: 0 microversion: 2.1 time: 0.150599 Aug 31 16:44:15.171814 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3487/6790] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:44:15 2022] DELETE /compute/v2.1/servers/a50141e6-3b07-46db-9de4-d86fc4a8980d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:44:15.188502 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5a0b7182-3f6e-4cee-a242-02539835fe4e tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:15.189218 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5a0b7182-3f6e-4cee-a242-02539835fe4e tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] [instance: a50141e6-3b07-46db-9de4-d86fc4a8980d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:15.195847 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a0b7182-3f6e-4cee-a242-02539835fe4e tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:15.196335 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a0b7182-3f6e-4cee-a242-02539835fe4e tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:15.196775 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a0b7182-3f6e-4cee-a242-02539835fe4e tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:15.197476 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a0b7182-3f6e-4cee-a242-02539835fe4e tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:15.198347 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a0b7182-3f6e-4cee-a242-02539835fe4e tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:15.199093 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5a0b7182-3f6e-4cee-a242-02539835fe4e tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:15.370897 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5a0b7182-3f6e-4cee-a242-02539835fe4e tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045881249c104b53a8e15c98a71463b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df4ca1d3ee4424eaa45d937e8910a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:15.379716 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5a0b7182-3f6e-4cee-a242-02539835fe4e tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] 10.222.0.50 "GET /compute/v2.1/servers/a50141e6-3b07-46db-9de4-d86fc4a8980d" status: 200 len: 1768 microversion: 2.1 time: 0.196474 Aug 31 16:44:15.380498 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3304/6791] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:15 2022] GET /compute/v2.1/servers/a50141e6-3b07-46db-9de4-d86fc4a8980d => generated 1768 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:16.402407 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-535ea6cf-0536-466e-8309-8158d788d4f2 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:16.403581 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-535ea6cf-0536-466e-8309-8158d788d4f2 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] [instance: a50141e6-3b07-46db-9de4-d86fc4a8980d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:16.410951 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-535ea6cf-0536-466e-8309-8158d788d4f2 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:16.411450 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-535ea6cf-0536-466e-8309-8158d788d4f2 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:16.411900 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-535ea6cf-0536-466e-8309-8158d788d4f2 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:16.412611 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-535ea6cf-0536-466e-8309-8158d788d4f2 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:16.413070 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-535ea6cf-0536-466e-8309-8158d788d4f2 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:16.413506 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-535ea6cf-0536-466e-8309-8158d788d4f2 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:16.570246 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-535ea6cf-0536-466e-8309-8158d788d4f2 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045881249c104b53a8e15c98a71463b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df4ca1d3ee4424eaa45d937e8910a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:16.578747 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-535ea6cf-0536-466e-8309-8158d788d4f2 tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] 10.222.0.50 "GET /compute/v2.1/servers/a50141e6-3b07-46db-9de4-d86fc4a8980d" status: 200 len: 1768 microversion: 2.1 time: 0.181158 Aug 31 16:44:16.581423 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3488/6792] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:16 2022] GET /compute/v2.1/servers/a50141e6-3b07-46db-9de4-d86fc4a8980d => generated 1768 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:17.419772 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-29e254c6-27d9-4be4-b2d7-77d2d9d25ebe req-3d14e033-4dcf-4080-85ce-3ec7cde33f7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a50141e6-3b07-46db-9de4-d86fc4a8980d", "name": "network-vif-deleted", "tag": "c0254e23-209f-4a91-a3cd-fa5d7f9145dc"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:44:17.430793 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-29e254c6-27d9-4be4-b2d7-77d2d9d25ebe req-3d14e033-4dcf-4080-85ce-3ec7cde33f7b service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:17.431266 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-29e254c6-27d9-4be4-b2d7-77d2d9d25ebe req-3d14e033-4dcf-4080-85ce-3ec7cde33f7b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:17.431691 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-29e254c6-27d9-4be4-b2d7-77d2d9d25ebe req-3d14e033-4dcf-4080-85ce-3ec7cde33f7b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:17.443875 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-29e254c6-27d9-4be4-b2d7-77d2d9d25ebe req-3d14e033-4dcf-4080-85ce-3ec7cde33f7b service nova] Creating event network-vif-deleted:c0254e23-209f-4a91-a3cd-fa5d7f9145dc for instance a50141e6-3b07-46db-9de4-d86fc4a8980d on n-h2-833090-16 Aug 31 16:44:17.449324 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-29e254c6-27d9-4be4-b2d7-77d2d9d25ebe req-3d14e033-4dcf-4080-85ce-3ec7cde33f7b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033470 Aug 31 16:44:17.449946 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3305/6793] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:44:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:44:17.604661 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-496d3bcd-93a2-4e1b-9f99-567339d51cef tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:17.606204 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-496d3bcd-93a2-4e1b-9f99-567339d51cef tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] [instance: a50141e6-3b07-46db-9de4-d86fc4a8980d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:17.614498 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-496d3bcd-93a2-4e1b-9f99-567339d51cef tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:17.615081 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-496d3bcd-93a2-4e1b-9f99-567339d51cef tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:17.615521 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-496d3bcd-93a2-4e1b-9f99-567339d51cef tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:17.616233 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-496d3bcd-93a2-4e1b-9f99-567339d51cef tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:17.616698 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-496d3bcd-93a2-4e1b-9f99-567339d51cef tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:17.617134 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-496d3bcd-93a2-4e1b-9f99-567339d51cef tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:17.653431 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-496d3bcd-93a2-4e1b-9f99-567339d51cef tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:17.653942 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-496d3bcd-93a2-4e1b-9f99-567339d51cef tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:17.654422 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-496d3bcd-93a2-4e1b-9f99-567339d51cef tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:17.654892 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-496d3bcd-93a2-4e1b-9f99-567339d51cef tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lazy-loading 'fault' on Instance uuid a50141e6-3b07-46db-9de4-d86fc4a8980d {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:44:17.697737 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-496d3bcd-93a2-4e1b-9f99-567339d51cef tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '045881249c104b53a8e15c98a71463b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df4ca1d3ee4424eaa45d937e8910a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:17.706375 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-496d3bcd-93a2-4e1b-9f99-567339d51cef tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] 10.222.0.50 "GET /compute/v2.1/servers/a50141e6-3b07-46db-9de4-d86fc4a8980d" status: 200 len: 1383 microversion: 2.1 time: 0.107475 Aug 31 16:44:17.706967 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3489/6794] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:17 2022] GET /compute/v2.1/servers/a50141e6-3b07-46db-9de4-d86fc4a8980d => generated 1383 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:18.729871 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9ddd9ffb-a496-4048-9d35-3444dd1d16fc tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:18.730569 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9ddd9ffb-a496-4048-9d35-3444dd1d16fc tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] [instance: a50141e6-3b07-46db-9de4-d86fc4a8980d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:18.737708 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9ddd9ffb-a496-4048-9d35-3444dd1d16fc tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:18.738242 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9ddd9ffb-a496-4048-9d35-3444dd1d16fc tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:18.738662 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9ddd9ffb-a496-4048-9d35-3444dd1d16fc tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:18.739356 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9ddd9ffb-a496-4048-9d35-3444dd1d16fc tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:18.739806 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9ddd9ffb-a496-4048-9d35-3444dd1d16fc tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:18.740228 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9ddd9ffb-a496-4048-9d35-3444dd1d16fc tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:18.756322 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-9ddd9ffb-a496-4048-9d35-3444dd1d16fc tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] HTTP exception thrown: Instance a50141e6-3b07-46db-9de4-d86fc4a8980d could not be found. Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9ddd9ffb-a496-4048-9d35-3444dd1d16fc tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Request method failure captured: Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/a50141e6-3b07-46db-9de4-d86fc4a8980d HTTP/1.1 Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD49jWBhsHhXnIEJT5dbw6QYEnwta2E52Cu4VQRfgxYOP0-errnfFJ1nNN3knstao3NwmM1wqB1Jsy7eLSJTeMiRgwO1oLRotDmMZK3HceChvYc4pnZGZFUL4tED47RO4A_uzRVI-09yIV8K60r7OrZLmy-lQoEsH--7j9FnxN6h7WWA Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 7df4ca1d3ee4424eaa45d937e8910a7f Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-158119172 Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7df4ca1d3ee4424eaa45d937e8910a7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7df4ca1d3ee4424eaa45d937e8910a7f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7df4ca1d3ee4424eaa45d937e8910a7f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7df4ca1d3ee4424eaa45d937e8910a7f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-TestSecurityGroupsBasicOps-158119172 Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 7df4ca1d3ee4424eaa45d937e8910a7f Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-158119172 Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-TestSecurityGroupsBasicOps-158119172-project Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 045881249c104b53a8e15c98a71463b2 Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-TestSecurityGroupsBasicOps-158119172-project Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance a50141e6-3b07-46db-9de4-d86fc4a8980d could not be found. Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'a50141e6-3b07-46db-9de4-d86fc4a8980d'} Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a50141e6-3b07-46db-9de4-d86fc4a8980d could not be found. Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a50141e6-3b07-46db-9de4-d86fc4a8980d could not be found. Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:44:18.758116 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:44:18.765226 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:44:18.765226 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:44:18.765226 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:44:18.765226 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:44:18.765226 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:44:18.765226 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a50141e6-3b07-46db-9de4-d86fc4a8980d could not be found. Aug 31 16:44:18.765226 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:44:18.765226 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9ddd9ffb-a496-4048-9d35-3444dd1d16fc tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Returning 404 to user: Instance a50141e6-3b07-46db-9de4-d86fc4a8980d could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:44:18.765226 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9ddd9ffb-a496-4048-9d35-3444dd1d16fc tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] 10.222.0.50 "GET /compute/v2.1/servers/a50141e6-3b07-46db-9de4-d86fc4a8980d" status: 404 len: 111 microversion: 2.1 time: 0.035219 Aug 31 16:44:18.765226 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3306/6795] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:18 2022] GET /compute/v2.1/servers/a50141e6-3b07-46db-9de4-d86fc4a8980d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:44:22.421664 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b5e96dee-10c0-4812-b973-528943224c6d tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] Calling method '.version_select at 0x7fbb45481c10>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:22.444592 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b5e96dee-10c0-4812-b973-528943224c6d tempest-TestSecurityGroupsBasicOps-158119172 tempest-TestSecurityGroupsBasicOps-158119172-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-416114491" status: 202 len: 0 microversion: 2.1 time: 0.028370 Aug 31 16:44:22.445193 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3490/6796] 10.222.0.50 () {58 vars in 1275 bytes} [Wed Aug 31 16:44:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-416114491 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:44:35.551433 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:44:35.552279 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:44:35.680396 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e2f1d456-44e7-4678-b87e-010c8354aad0 tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1896511497", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:44:35.737071 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-e2f1d456-44e7-4678-b87e-010c8354aad0 tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] validate_networks() for None {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:44:36.033064 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-e2f1d456-44e7-4678-b87e-010c8354aad0 tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:44:36.033491 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-e2f1d456-44e7-4678-b87e-010c8354aad0 tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:44:36.033966 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-e2f1d456-44e7-4678-b87e-010c8354aad0 tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:44:36.034410 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-e2f1d456-44e7-4678-b87e-010c8354aad0 tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:44:36.034795 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-e2f1d456-44e7-4678-b87e-010c8354aad0 tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:44:36.044031 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2f1d456-44e7-4678-b87e-010c8354aad0 tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:36.044601 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2f1d456-44e7-4678-b87e-010c8354aad0 tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:36.045326 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2f1d456-44e7-4678-b87e-010c8354aad0 tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:36.046064 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2f1d456-44e7-4678-b87e-010c8354aad0 tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:36.046550 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2f1d456-44e7-4678-b87e-010c8354aad0 tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:36.046978 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2f1d456-44e7-4678-b87e-010c8354aad0 tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:36.065150 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-e2f1d456-44e7-4678-b87e-010c8354aad0 tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Getting quotas for project 35705f22587c4f749b09fc43b51c3639. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:44:36.070614 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-e2f1d456-44e7-4678-b87e-010c8354aad0 tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Getting quotas for user 13b6942adb4f437f9daf316e71561ed0 and project 35705f22587c4f749b09fc43b51c3639. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:44:36.085848 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e2f1d456-44e7-4678-b87e-010c8354aad0 tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:44:36.088228 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e2f1d456-44e7-4678-b87e-010c8354aad0 tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] [instance: 82aa6598-c9eb-436a-acec-3d14a40120c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:44:36.139816 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e2f1d456-44e7-4678-b87e-010c8354aad0 tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.596936 Aug 31 16:44:36.140492 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3307/6797] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:44:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:44:36.153407 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c0f0de60-4d89-4fbb-9652-23b4ef83051a tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:36.154299 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c0f0de60-4d89-4fbb-9652-23b4ef83051a tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] [instance: 82aa6598-c9eb-436a-acec-3d14a40120c6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:36.159424 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:44:36.160326 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:44:36.227543 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c0f0de60-4d89-4fbb-9652-23b4ef83051a tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b6942adb4f437f9daf316e71561ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35705f22587c4f749b09fc43b51c3639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:36.235502 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c0f0de60-4d89-4fbb-9652-23b4ef83051a tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] 10.222.0.50 "GET /compute/v2.1/servers/82aa6598-c9eb-436a-acec-3d14a40120c6" status: 200 len: 1222 microversion: 2.1 time: 0.086618 Aug 31 16:44:36.236100 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3491/6798] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:36 2022] GET /compute/v2.1/servers/82aa6598-c9eb-436a-acec-3d14a40120c6 => generated 1222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:37.262798 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7f9d2b51-cf4a-4d21-b65f-d4bf6b9f315f tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:37.263874 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7f9d2b51-cf4a-4d21-b65f-d4bf6b9f315f tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] [instance: 82aa6598-c9eb-436a-acec-3d14a40120c6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:37.273789 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f9d2b51-cf4a-4d21-b65f-d4bf6b9f315f tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:37.274619 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f9d2b51-cf4a-4d21-b65f-d4bf6b9f315f tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:37.275049 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f9d2b51-cf4a-4d21-b65f-d4bf6b9f315f tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:37.275722 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f9d2b51-cf4a-4d21-b65f-d4bf6b9f315f tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:37.276171 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f9d2b51-cf4a-4d21-b65f-d4bf6b9f315f tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:37.276581 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f9d2b51-cf4a-4d21-b65f-d4bf6b9f315f tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:37.346221 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7f9d2b51-cf4a-4d21-b65f-d4bf6b9f315f tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b6942adb4f437f9daf316e71561ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35705f22587c4f749b09fc43b51c3639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:37.354480 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7f9d2b51-cf4a-4d21-b65f-d4bf6b9f315f tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] 10.222.0.50 "GET /compute/v2.1/servers/82aa6598-c9eb-436a-acec-3d14a40120c6" status: 200 len: 1274 microversion: 2.1 time: 0.099661 Aug 31 16:44:37.355094 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3308/6799] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:37 2022] GET /compute/v2.1/servers/82aa6598-c9eb-436a-acec-3d14a40120c6 => generated 1274 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:38.378674 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-741b84a5-5470-4ab0-b3ff-e4f488583155 tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:38.379479 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-741b84a5-5470-4ab0-b3ff-e4f488583155 tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] [instance: 82aa6598-c9eb-436a-acec-3d14a40120c6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:38.389135 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-741b84a5-5470-4ab0-b3ff-e4f488583155 tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:38.389913 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-741b84a5-5470-4ab0-b3ff-e4f488583155 tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:38.390396 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-741b84a5-5470-4ab0-b3ff-e4f488583155 tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:38.391493 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-741b84a5-5470-4ab0-b3ff-e4f488583155 tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:38.392156 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-741b84a5-5470-4ab0-b3ff-e4f488583155 tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:38.392578 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-741b84a5-5470-4ab0-b3ff-e4f488583155 tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:38.547175 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-741b84a5-5470-4ab0-b3ff-e4f488583155 tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b6942adb4f437f9daf316e71561ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35705f22587c4f749b09fc43b51c3639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:38.555295 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-741b84a5-5470-4ab0-b3ff-e4f488583155 tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] 10.222.0.50 "GET /compute/v2.1/servers/82aa6598-c9eb-436a-acec-3d14a40120c6" status: 200 len: 1322 microversion: 2.1 time: 0.182298 Aug 31 16:44:38.556108 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3492/6800] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:38 2022] GET /compute/v2.1/servers/82aa6598-c9eb-436a-acec-3d14a40120c6 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:39.012011 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-d4886e2c-8084-412d-9430-a9d9cba689ec req-0c3b1e8b-2c78-43f9-b281-ea3653fe1d39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82aa6598-c9eb-436a-acec-3d14a40120c6", "tag": "c3da9e35-f7b8-4734-b1bc-896e7437e5b5"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:44:39.025664 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d4886e2c-8084-412d-9430-a9d9cba689ec req-0c3b1e8b-2c78-43f9-b281-ea3653fe1d39 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:39.026304 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d4886e2c-8084-412d-9430-a9d9cba689ec req-0c3b1e8b-2c78-43f9-b281-ea3653fe1d39 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:39.026731 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d4886e2c-8084-412d-9430-a9d9cba689ec req-0c3b1e8b-2c78-43f9-b281-ea3653fe1d39 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:39.038895 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-d4886e2c-8084-412d-9430-a9d9cba689ec req-0c3b1e8b-2c78-43f9-b281-ea3653fe1d39 service nova] Creating event network-changed:c3da9e35-f7b8-4734-b1bc-896e7437e5b5 for instance 82aa6598-c9eb-436a-acec-3d14a40120c6 on n-h2-833090-16 Aug 31 16:44:39.043730 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-d4886e2c-8084-412d-9430-a9d9cba689ec req-0c3b1e8b-2c78-43f9-b281-ea3653fe1d39 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035511 Aug 31 16:44:39.044584 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3309/6801] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:44:39.576935 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-dc5ba108-bc77-4d27-98af-51fa0c787e4a tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:39.577604 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-dc5ba108-bc77-4d27-98af-51fa0c787e4a tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] [instance: 82aa6598-c9eb-436a-acec-3d14a40120c6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:39.584901 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dc5ba108-bc77-4d27-98af-51fa0c787e4a tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:39.585390 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dc5ba108-bc77-4d27-98af-51fa0c787e4a tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:39.585832 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dc5ba108-bc77-4d27-98af-51fa0c787e4a tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:39.586584 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dc5ba108-bc77-4d27-98af-51fa0c787e4a tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:39.587032 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dc5ba108-bc77-4d27-98af-51fa0c787e4a tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:39.587462 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dc5ba108-bc77-4d27-98af-51fa0c787e4a tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:39.726763 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-dc5ba108-bc77-4d27-98af-51fa0c787e4a tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b6942adb4f437f9daf316e71561ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35705f22587c4f749b09fc43b51c3639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:39.736581 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-dc5ba108-bc77-4d27-98af-51fa0c787e4a tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] 10.222.0.50 "GET /compute/v2.1/servers/82aa6598-c9eb-436a-acec-3d14a40120c6" status: 200 len: 1322 microversion: 2.1 time: 0.163743 Aug 31 16:44:39.737136 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3493/6802] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:39 2022] GET /compute/v2.1/servers/82aa6598-c9eb-436a-acec-3d14a40120c6 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:40.759308 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-83551205-c784-43ad-8157-52a620dd950c tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:40.760065 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-83551205-c784-43ad-8157-52a620dd950c tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] [instance: 82aa6598-c9eb-436a-acec-3d14a40120c6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:40.767087 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83551205-c784-43ad-8157-52a620dd950c tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:40.767564 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83551205-c784-43ad-8157-52a620dd950c tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:40.768003 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83551205-c784-43ad-8157-52a620dd950c tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:40.768697 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83551205-c784-43ad-8157-52a620dd950c tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:40.769150 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83551205-c784-43ad-8157-52a620dd950c tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:40.769572 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83551205-c784-43ad-8157-52a620dd950c tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:41.036353 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-83551205-c784-43ad-8157-52a620dd950c tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b6942adb4f437f9daf316e71561ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35705f22587c4f749b09fc43b51c3639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:41.044578 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-83551205-c784-43ad-8157-52a620dd950c tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] 10.222.0.50 "GET /compute/v2.1/servers/82aa6598-c9eb-436a-acec-3d14a40120c6" status: 200 len: 1322 microversion: 2.1 time: 0.290460 Aug 31 16:44:41.045153 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3310/6803] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:40 2022] GET /compute/v2.1/servers/82aa6598-c9eb-436a-acec-3d14a40120c6 => generated 1322 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:42.075826 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-09514823-66da-4405-a05d-1fceebd206cf tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:42.076484 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-09514823-66da-4405-a05d-1fceebd206cf tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] [instance: 82aa6598-c9eb-436a-acec-3d14a40120c6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:42.084038 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-09514823-66da-4405-a05d-1fceebd206cf tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:42.084518 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-09514823-66da-4405-a05d-1fceebd206cf tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:42.084992 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-09514823-66da-4405-a05d-1fceebd206cf tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:42.085747 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-09514823-66da-4405-a05d-1fceebd206cf tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:42.086244 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-09514823-66da-4405-a05d-1fceebd206cf tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:42.086674 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-09514823-66da-4405-a05d-1fceebd206cf tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:42.317904 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-09514823-66da-4405-a05d-1fceebd206cf tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b6942adb4f437f9daf316e71561ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35705f22587c4f749b09fc43b51c3639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:42.327057 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-09514823-66da-4405-a05d-1fceebd206cf tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] 10.222.0.50 "GET /compute/v2.1/servers/82aa6598-c9eb-436a-acec-3d14a40120c6" status: 200 len: 1322 microversion: 2.1 time: 0.257361 Aug 31 16:44:42.327635 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3494/6804] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:42 2022] GET /compute/v2.1/servers/82aa6598-c9eb-436a-acec-3d14a40120c6 => generated 1322 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:43.348974 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d0138c0e-3666-4bcd-969b-6017e705905c tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:43.349535 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d0138c0e-3666-4bcd-969b-6017e705905c tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] [instance: 82aa6598-c9eb-436a-acec-3d14a40120c6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:43.357210 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0138c0e-3666-4bcd-969b-6017e705905c tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:43.357968 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0138c0e-3666-4bcd-969b-6017e705905c tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:43.358813 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0138c0e-3666-4bcd-969b-6017e705905c tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:43.359643 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0138c0e-3666-4bcd-969b-6017e705905c tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:43.360134 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0138c0e-3666-4bcd-969b-6017e705905c tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:43.360652 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0138c0e-3666-4bcd-969b-6017e705905c tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:43.505150 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d0138c0e-3666-4bcd-969b-6017e705905c tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b6942adb4f437f9daf316e71561ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35705f22587c4f749b09fc43b51c3639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:43.515290 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d0138c0e-3666-4bcd-969b-6017e705905c tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] 10.222.0.50 "GET /compute/v2.1/servers/82aa6598-c9eb-436a-acec-3d14a40120c6" status: 200 len: 1322 microversion: 2.1 time: 0.170529 Aug 31 16:44:43.515290 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3311/6805] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:43 2022] GET /compute/v2.1/servers/82aa6598-c9eb-436a-acec-3d14a40120c6 => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:44.536560 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8e0471b0-04ed-4bf2-89ff-8bd57f93132e tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:44.537205 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8e0471b0-04ed-4bf2-89ff-8bd57f93132e tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] [instance: 82aa6598-c9eb-436a-acec-3d14a40120c6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:44.545255 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8e0471b0-04ed-4bf2-89ff-8bd57f93132e tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:44.545762 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8e0471b0-04ed-4bf2-89ff-8bd57f93132e tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:44.546253 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8e0471b0-04ed-4bf2-89ff-8bd57f93132e tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:44.546972 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8e0471b0-04ed-4bf2-89ff-8bd57f93132e tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:44.547485 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8e0471b0-04ed-4bf2-89ff-8bd57f93132e tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:44.547910 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8e0471b0-04ed-4bf2-89ff-8bd57f93132e tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:44.699473 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8e0471b0-04ed-4bf2-89ff-8bd57f93132e tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b6942adb4f437f9daf316e71561ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35705f22587c4f749b09fc43b51c3639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:44.712498 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8e0471b0-04ed-4bf2-89ff-8bd57f93132e tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] 10.222.0.50 "GET /compute/v2.1/servers/82aa6598-c9eb-436a-acec-3d14a40120c6" status: 200 len: 1322 microversion: 2.1 time: 0.179658 Aug 31 16:44:44.713152 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3495/6806] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:44 2022] GET /compute/v2.1/servers/82aa6598-c9eb-436a-acec-3d14a40120c6 => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:45.008845 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-10b057ac-8691-4752-a1f4-171faf3bd701 req-bf3845e6-f95f-4073-9331-478648030212 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82aa6598-c9eb-436a-acec-3d14a40120c6", "name": "network-vif-plugged", "status": "completed", "tag": "c3da9e35-f7b8-4734-b1bc-896e7437e5b5"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:44:45.020782 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-10b057ac-8691-4752-a1f4-171faf3bd701 req-bf3845e6-f95f-4073-9331-478648030212 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:45.021335 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-10b057ac-8691-4752-a1f4-171faf3bd701 req-bf3845e6-f95f-4073-9331-478648030212 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:45.021775 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-10b057ac-8691-4752-a1f4-171faf3bd701 req-bf3845e6-f95f-4073-9331-478648030212 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:45.034817 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-10b057ac-8691-4752-a1f4-171faf3bd701 req-bf3845e6-f95f-4073-9331-478648030212 service nova] Creating event network-vif-plugged:c3da9e35-f7b8-4734-b1bc-896e7437e5b5 for instance 82aa6598-c9eb-436a-acec-3d14a40120c6 on n-h2-833090-16 Aug 31 16:44:45.039946 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-10b057ac-8691-4752-a1f4-171faf3bd701 req-bf3845e6-f95f-4073-9331-478648030212 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034885 Aug 31 16:44:45.040660 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3312/6807] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:44:45.736748 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-eface8cf-a8cb-46e5-a902-cdba4b3a7002 tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:45.737326 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-eface8cf-a8cb-46e5-a902-cdba4b3a7002 tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] [instance: 82aa6598-c9eb-436a-acec-3d14a40120c6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:45.744862 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-eface8cf-a8cb-46e5-a902-cdba4b3a7002 tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:45.745375 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-eface8cf-a8cb-46e5-a902-cdba4b3a7002 tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:45.745823 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-eface8cf-a8cb-46e5-a902-cdba4b3a7002 tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:45.746638 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-eface8cf-a8cb-46e5-a902-cdba4b3a7002 tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:45.747104 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-eface8cf-a8cb-46e5-a902-cdba4b3a7002 tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:45.747541 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-eface8cf-a8cb-46e5-a902-cdba4b3a7002 tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:45.896610 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-eface8cf-a8cb-46e5-a902-cdba4b3a7002 tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b6942adb4f437f9daf316e71561ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35705f22587c4f749b09fc43b51c3639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:45.908671 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-eface8cf-a8cb-46e5-a902-cdba4b3a7002 tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] 10.222.0.50 "GET /compute/v2.1/servers/82aa6598-c9eb-436a-acec-3d14a40120c6" status: 200 len: 1322 microversion: 2.1 time: 0.177127 Aug 31 16:44:45.909296 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3496/6808] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:45 2022] GET /compute/v2.1/servers/82aa6598-c9eb-436a-acec-3d14a40120c6 => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:46.931458 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:44:46.932290 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:44:46.938626 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0adf3c06-cc89-4246-8282-9a25ab766b85 tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:46.939643 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0adf3c06-cc89-4246-8282-9a25ab766b85 tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] [instance: 82aa6598-c9eb-436a-acec-3d14a40120c6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:46.950763 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0adf3c06-cc89-4246-8282-9a25ab766b85 tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:46.951571 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0adf3c06-cc89-4246-8282-9a25ab766b85 tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:46.952072 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0adf3c06-cc89-4246-8282-9a25ab766b85 tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:46.952875 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0adf3c06-cc89-4246-8282-9a25ab766b85 tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:46.953530 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0adf3c06-cc89-4246-8282-9a25ab766b85 tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:46.954012 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0adf3c06-cc89-4246-8282-9a25ab766b85 tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:47.089252 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0adf3c06-cc89-4246-8282-9a25ab766b85 tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b6942adb4f437f9daf316e71561ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35705f22587c4f749b09fc43b51c3639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:47.097960 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0adf3c06-cc89-4246-8282-9a25ab766b85 tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] 10.222.0.50 "GET /compute/v2.1/servers/82aa6598-c9eb-436a-acec-3d14a40120c6" status: 200 len: 1472 microversion: 2.1 time: 0.169511 Aug 31 16:44:47.098577 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3313/6809] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:46 2022] GET /compute/v2.1/servers/82aa6598-c9eb-436a-acec-3d14a40120c6 => generated 1472 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:47.127529 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:44:47.186602 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-61e42dd4-35dc-45b9-81c3-9babdc824807 tempest-ServersAdminNegativeTestJSON-1147173629 tempest-ServersAdminNegativeTestJSON-1147173629-project-admin] Calling method '.version_select at 0x7fbb455f7ca0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:47.273033 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-61e42dd4-35dc-45b9-81c3-9babdc824807 tempest-ServersAdminNegativeTestJSON-1147173629 tempest-ServersAdminNegativeTestJSON-1147173629-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/8afea9824b9544139555c50c3439f1b4" status: 200 len: 371 microversion: 2.1 time: 0.150820 Aug 31 16:44:47.274687 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3497/6810] 10.222.0.50 () {58 vars in 1242 bytes} [Wed Aug 31 16:44:47 2022] GET /compute/v2.1/os-quota-sets/8afea9824b9544139555c50c3439f1b4 => generated 371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:44:47.293529 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dd653f9a-9bfc-4ca4-8130-849893438e47 tempest-ServersAdminNegativeTestJSON-1147173629 tempest-ServersAdminNegativeTestJSON-1147173629-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1129189110", "id": 209549404, "os-flavor-access:is_public": "True"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:44:47.315899 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dd653f9a-9bfc-4ca4-8130-849893438e47 tempest-ServersAdminNegativeTestJSON-1147173629 tempest-ServersAdminNegativeTestJSON-1147173629-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.028641 Aug 31 16:44:47.316624 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3314/6811] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:44:47 2022] POST /compute/v2.1/flavors => generated 435 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:44:47.328943 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-64e9a0e3-bf3d-4080-9c1c-eabba59d21ce tempest-ServersAdminNegativeTestJSON-1147173629 tempest-ServersAdminNegativeTestJSON-1147173629-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "209549404"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:44:47.331602 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-64e9a0e3-bf3d-4080-9c1c-eabba59d21ce tempest-ServersAdminNegativeTestJSON-1147173629 tempest-ServersAdminNegativeTestJSON-1147173629-project-admin] [instance: 82aa6598-c9eb-436a-acec-3d14a40120c6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:47.338474 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-64e9a0e3-bf3d-4080-9c1c-eabba59d21ce tempest-ServersAdminNegativeTestJSON-1147173629 tempest-ServersAdminNegativeTestJSON-1147173629-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:47.339004 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-64e9a0e3-bf3d-4080-9c1c-eabba59d21ce tempest-ServersAdminNegativeTestJSON-1147173629 tempest-ServersAdminNegativeTestJSON-1147173629-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:47.339444 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-64e9a0e3-bf3d-4080-9c1c-eabba59d21ce tempest-ServersAdminNegativeTestJSON-1147173629 tempest-ServersAdminNegativeTestJSON-1147173629-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:47.340171 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-64e9a0e3-bf3d-4080-9c1c-eabba59d21ce tempest-ServersAdminNegativeTestJSON-1147173629 tempest-ServersAdminNegativeTestJSON-1147173629-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:47.340633 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-64e9a0e3-bf3d-4080-9c1c-eabba59d21ce tempest-ServersAdminNegativeTestJSON-1147173629 tempest-ServersAdminNegativeTestJSON-1147173629-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:47.341068 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-64e9a0e3-bf3d-4080-9c1c-eabba59d21ce tempest-ServersAdminNegativeTestJSON-1147173629 tempest-ServersAdminNegativeTestJSON-1147173629-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:47.490737 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-64e9a0e3-bf3d-4080-9c1c-eabba59d21ce tempest-ServersAdminNegativeTestJSON-1147173629 tempest-ServersAdminNegativeTestJSON-1147173629-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '50447b747b644cb0a1c58c9ec9bc1cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afea9824b9544139555c50c3439f1b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:47.500569 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-64e9a0e3-bf3d-4080-9c1c-eabba59d21ce tempest-ServersAdminNegativeTestJSON-1147173629 tempest-ServersAdminNegativeTestJSON-1147173629-project-admin] [instance: 82aa6598-c9eb-436a-acec-3d14a40120c6] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1129189110 {{(pid=128864) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 31 16:44:47.507667 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-64e9a0e3-bf3d-4080-9c1c-eabba59d21ce tempest-ServersAdminNegativeTestJSON-1147173629 tempest-ServersAdminNegativeTestJSON-1147173629-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:47.508152 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-64e9a0e3-bf3d-4080-9c1c-eabba59d21ce tempest-ServersAdminNegativeTestJSON-1147173629 tempest-ServersAdminNegativeTestJSON-1147173629-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:47.508591 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-64e9a0e3-bf3d-4080-9c1c-eabba59d21ce tempest-ServersAdminNegativeTestJSON-1147173629 tempest-ServersAdminNegativeTestJSON-1147173629-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:47.509318 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-64e9a0e3-bf3d-4080-9c1c-eabba59d21ce tempest-ServersAdminNegativeTestJSON-1147173629 tempest-ServersAdminNegativeTestJSON-1147173629-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:47.509775 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-64e9a0e3-bf3d-4080-9c1c-eabba59d21ce tempest-ServersAdminNegativeTestJSON-1147173629 tempest-ServersAdminNegativeTestJSON-1147173629-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:47.510233 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-64e9a0e3-bf3d-4080-9c1c-eabba59d21ce tempest-ServersAdminNegativeTestJSON-1147173629 tempest-ServersAdminNegativeTestJSON-1147173629-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:47.534909 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-64e9a0e3-bf3d-4080-9c1c-eabba59d21ce tempest-ServersAdminNegativeTestJSON-1147173629 tempest-ServersAdminNegativeTestJSON-1147173629-project-admin] Getting quotas for project 35705f22587c4f749b09fc43b51c3639. Resources: {'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:44:47.540731 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-64e9a0e3-bf3d-4080-9c1c-eabba59d21ce tempest-ServersAdminNegativeTestJSON-1147173629 tempest-ServersAdminNegativeTestJSON-1147173629-project-admin] Getting quotas for user 13b6942adb4f437f9daf316e71561ed0 and project 35705f22587c4f749b09fc43b51c3639. Resources: {'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:44:47.557301 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.compute.api [None req-64e9a0e3-bf3d-4080-9c1c-eabba59d21ce tempest-ServersAdminNegativeTestJSON-1147173629 tempest-ServersAdminNegativeTestJSON-1147173629-project-admin] ram quota exceeded for 8afea9824b9544139555c50c3439f1b4, tried to resize instance. Aug 31 16:44:47.557872 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-64e9a0e3-bf3d-4080-9c1c-eabba59d21ce tempest-ServersAdminNegativeTestJSON-1147173629 tempest-ServersAdminNegativeTestJSON-1147173629-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-64e9a0e3-bf3d-4080-9c1c-eabba59d21ce tempest-ServersAdminNegativeTestJSON-1147173629 tempest-ServersAdminNegativeTestJSON-1147173629-project-admin] Request method failure captured: Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: request: POST /compute/v2.1/servers/82aa6598-c9eb-436a-acec-3d14a40120c6/action HTTP/1.1 Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 38 Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD4_zThMzJR7q6KoN-7HONs1ffGsadXLm1iQrpyCNmURAsfdihRzcYT991z-aMbS_wCDfZG0ys_1GP7wxQmMd4pg5foWpK7fxKyjYl7koik6v-DVX1pQx1YNpQemgDobOPl_KigLR_ueXGzhELWkweZzRXff7GgoflfjyPNutWLqNT6o Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 8afea9824b9544139555c50c3439f1b4 Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1147173629 Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,admin,member Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,admin,member Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8afea9824b9544139555c50c3439f1b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8afea9824b9544139555c50c3439f1b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8afea9824b9544139555c50c3439f1b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8afea9824b9544139555c50c3439f1b4", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1147173629 Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 8afea9824b9544139555c50c3439f1b4 Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1147173629 Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServersAdminNegativeTestJSON-1147173629-project-admin Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 50447b747b644cb0a1c58c9ec9bc1cc5 Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1147173629-project-admin Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: {"resize": {"flavorRef": "209549404"}} Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '82aa6598-c9eb-436a-acec-3d14a40120c6', 'body': {'resize': {'flavorRef': '209549404'}}} Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3876, in _check_quota_for_upsize Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 16:44:47.567908 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 31 16:44:47.572091 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 31 16:44:47.572091 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 31 16:44:47.572091 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 31 16:44:47.572091 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 16:44:47.572091 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 16:44:47.572091 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 16:44:47.572091 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 16:44:47.572091 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 31 16:44:47.572091 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 16:44:47.572091 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4242, in resize Aug 31 16:44:47.572091 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 31 16:44:47.572091 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3894, in _check_quota_for_upsize Aug 31 16:44:47.572091 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 31 16:44:47.572091 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 31 16:44:47.572091 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:44:47.572091 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:44:47.572091 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:44:47.572091 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:44:47.572091 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:44:47.572091 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:44:47.572091 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:44:47.572091 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:44:47.572091 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:44:47.572091 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:44:47.572091 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:44:47.572091 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:44:47.572091 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 31 16:44:47.572091 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 31 16:44:47.572091 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 31 16:44:47.572091 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 31 16:44:47.572091 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 31 16:44:47.572091 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:44:47.572091 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:44:47.572091 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:44:47.572091 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:44:47.572091 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:44:47.572091 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:44:47.572091 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:44:47.572091 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:44:47.572091 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 31 16:44:47.572091 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:44:47.572091 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-64e9a0e3-bf3d-4080-9c1c-eabba59d21ce tempest-ServersAdminNegativeTestJSON-1147173629 tempest-ServersAdminNegativeTestJSON-1147173629-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:44:47.572091 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-64e9a0e3-bf3d-4080-9c1c-eabba59d21ce tempest-ServersAdminNegativeTestJSON-1147173629 tempest-ServersAdminNegativeTestJSON-1147173629-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/82aa6598-c9eb-436a-acec-3d14a40120c6/action" status: 403 len: 118 microversion: 2.1 time: 0.244557 Aug 31 16:44:47.572091 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3498/6812] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:44:47 2022] POST /compute/v2.1/servers/82aa6598-c9eb-436a-acec-3d14a40120c6/action => generated 118 bytes in 246 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:44:47.579578 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1a7b55bb-5732-4df6-8f7d-516ebc2ba112 tempest-ServersAdminNegativeTestJSON-1147173629 tempest-ServersAdminNegativeTestJSON-1147173629-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:47.602417 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1a7b55bb-5732-4df6-8f7d-516ebc2ba112 tempest-ServersAdminNegativeTestJSON-1147173629 tempest-ServersAdminNegativeTestJSON-1147173629-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/209549404" status: 202 len: 0 microversion: 2.1 time: 0.026986 Aug 31 16:44:47.603226 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3315/6813] 10.222.0.50 () {58 vars in 1158 bytes} [Wed Aug 31 16:44:47 2022] DELETE /compute/v2.1/flavors/209549404 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:44:47.612721 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fee98bb5-9195-440f-b718-bd7828357f34 tempest-ServersAdminNegativeTestJSON-1147173629 tempest-ServersAdminNegativeTestJSON-1147173629-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:47.634713 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fee98bb5-9195-440f-b718-bd7828357f34 tempest-ServersAdminNegativeTestJSON-1147173629 tempest-ServersAdminNegativeTestJSON-1147173629-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026637 Aug 31 16:44:47.635318 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3499/6814] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 31 16:44:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:47.656591 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d103e57c-9c7d-4405-9aee-e95d0a70a7b4 tempest-ServersAdminNegativeTestJSON-1147173629 tempest-ServersAdminNegativeTestJSON-1147173629-project-admin] Calling method '.version_select at 0x7fbb45347e50>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:47.740357 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d103e57c-9c7d-4405-9aee-e95d0a70a7b4 tempest-ServersAdminNegativeTestJSON-1147173629 tempest-ServersAdminNegativeTestJSON-1147173629-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/8afea9824b9544139555c50c3439f1b4" status: 200 len: 371 microversion: 2.1 time: 0.087566 Aug 31 16:44:47.740951 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3316/6815] 10.222.0.50 () {58 vars in 1242 bytes} [Wed Aug 31 16:44:47 2022] GET /compute/v2.1/os-quota-sets/8afea9824b9544139555c50c3439f1b4 => generated 371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:44:47.753152 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-262fa15f-49e4-4fd1-ba5e-674cad1c2d9e tempest-ServersAdminNegativeTestJSON-1147173629 tempest-ServersAdminNegativeTestJSON-1147173629-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-154827273", "id": 910288174, "os-flavor-access:is_public": "True"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:44:47.777170 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-262fa15f-49e4-4fd1-ba5e-674cad1c2d9e tempest-ServersAdminNegativeTestJSON-1147173629 tempest-ServersAdminNegativeTestJSON-1147173629-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 433 microversion: 2.1 time: 0.028084 Aug 31 16:44:47.778023 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3500/6816] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:44:47 2022] POST /compute/v2.1/flavors => generated 433 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:44:47.793237 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d8df89a3-380e-4381-8bf6-6c84605e5204 tempest-ServersAdminNegativeTestJSON-1147173629 tempest-ServersAdminNegativeTestJSON-1147173629-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "910288174"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:44:47.795714 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d8df89a3-380e-4381-8bf6-6c84605e5204 tempest-ServersAdminNegativeTestJSON-1147173629 tempest-ServersAdminNegativeTestJSON-1147173629-project-admin] [instance: 82aa6598-c9eb-436a-acec-3d14a40120c6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:47.802566 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8df89a3-380e-4381-8bf6-6c84605e5204 tempest-ServersAdminNegativeTestJSON-1147173629 tempest-ServersAdminNegativeTestJSON-1147173629-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:47.803051 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8df89a3-380e-4381-8bf6-6c84605e5204 tempest-ServersAdminNegativeTestJSON-1147173629 tempest-ServersAdminNegativeTestJSON-1147173629-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:47.803488 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8df89a3-380e-4381-8bf6-6c84605e5204 tempest-ServersAdminNegativeTestJSON-1147173629 tempest-ServersAdminNegativeTestJSON-1147173629-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:47.804203 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8df89a3-380e-4381-8bf6-6c84605e5204 tempest-ServersAdminNegativeTestJSON-1147173629 tempest-ServersAdminNegativeTestJSON-1147173629-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:47.804652 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8df89a3-380e-4381-8bf6-6c84605e5204 tempest-ServersAdminNegativeTestJSON-1147173629 tempest-ServersAdminNegativeTestJSON-1147173629-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:47.805078 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8df89a3-380e-4381-8bf6-6c84605e5204 tempest-ServersAdminNegativeTestJSON-1147173629 tempest-ServersAdminNegativeTestJSON-1147173629-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:47.891578 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d8df89a3-380e-4381-8bf6-6c84605e5204 tempest-ServersAdminNegativeTestJSON-1147173629 tempest-ServersAdminNegativeTestJSON-1147173629-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '50447b747b644cb0a1c58c9ec9bc1cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afea9824b9544139555c50c3439f1b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:47.899082 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d8df89a3-380e-4381-8bf6-6c84605e5204 tempest-ServersAdminNegativeTestJSON-1147173629 tempest-ServersAdminNegativeTestJSON-1147173629-project-admin] [instance: 82aa6598-c9eb-436a-acec-3d14a40120c6] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-154827273 {{(pid=128863) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 31 16:44:47.906828 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8df89a3-380e-4381-8bf6-6c84605e5204 tempest-ServersAdminNegativeTestJSON-1147173629 tempest-ServersAdminNegativeTestJSON-1147173629-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:47.907406 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8df89a3-380e-4381-8bf6-6c84605e5204 tempest-ServersAdminNegativeTestJSON-1147173629 tempest-ServersAdminNegativeTestJSON-1147173629-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:47.907846 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8df89a3-380e-4381-8bf6-6c84605e5204 tempest-ServersAdminNegativeTestJSON-1147173629 tempest-ServersAdminNegativeTestJSON-1147173629-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:47.908574 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8df89a3-380e-4381-8bf6-6c84605e5204 tempest-ServersAdminNegativeTestJSON-1147173629 tempest-ServersAdminNegativeTestJSON-1147173629-project-admin] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:47.909023 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8df89a3-380e-4381-8bf6-6c84605e5204 tempest-ServersAdminNegativeTestJSON-1147173629 tempest-ServersAdminNegativeTestJSON-1147173629-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:47.909447 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d8df89a3-380e-4381-8bf6-6c84605e5204 tempest-ServersAdminNegativeTestJSON-1147173629 tempest-ServersAdminNegativeTestJSON-1147173629-project-admin] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:47.936338 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-d8df89a3-380e-4381-8bf6-6c84605e5204 tempest-ServersAdminNegativeTestJSON-1147173629 tempest-ServersAdminNegativeTestJSON-1147173629-project-admin] Getting quotas for project 35705f22587c4f749b09fc43b51c3639. Resources: {'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:44:47.941782 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-d8df89a3-380e-4381-8bf6-6c84605e5204 tempest-ServersAdminNegativeTestJSON-1147173629 tempest-ServersAdminNegativeTestJSON-1147173629-project-admin] Getting quotas for user 13b6942adb4f437f9daf316e71561ed0 and project 35705f22587c4f749b09fc43b51c3639. Resources: {'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:44:47.957910 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.compute.api [None req-d8df89a3-380e-4381-8bf6-6c84605e5204 tempest-ServersAdminNegativeTestJSON-1147173629 tempest-ServersAdminNegativeTestJSON-1147173629-project-admin] cores quota exceeded for 8afea9824b9544139555c50c3439f1b4, tried to resize instance. Aug 31 16:44:47.958482 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-d8df89a3-380e-4381-8bf6-6c84605e5204 tempest-ServersAdminNegativeTestJSON-1147173629 tempest-ServersAdminNegativeTestJSON-1147173629-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d8df89a3-380e-4381-8bf6-6c84605e5204 tempest-ServersAdminNegativeTestJSON-1147173629 tempest-ServersAdminNegativeTestJSON-1147173629-project-admin] Request method failure captured: Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers/82aa6598-c9eb-436a-acec-3d14a40120c6/action HTTP/1.1 Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 38 Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4_zThMzJR7q6KoN-7HONs1ffGsadXLm1iQrpyCNmURAsfdihRzcYT991z-aMbS_wCDfZG0ys_1GP7wxQmMd4pg5foWpK7fxKyjYl7koik6v-DVX1pQx1YNpQemgDobOPl_KigLR_ueXGzhELWkweZzRXff7GgoflfjyPNutWLqNT6o Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 8afea9824b9544139555c50c3439f1b4 Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1147173629 Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,admin,member Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,admin,member Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8afea9824b9544139555c50c3439f1b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8afea9824b9544139555c50c3439f1b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8afea9824b9544139555c50c3439f1b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8afea9824b9544139555c50c3439f1b4", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1147173629 Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 8afea9824b9544139555c50c3439f1b4 Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1147173629 Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServersAdminNegativeTestJSON-1147173629-project-admin Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 50447b747b644cb0a1c58c9ec9bc1cc5 Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1147173629-project-admin Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: {"resize": {"flavorRef": "910288174"}} Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '82aa6598-c9eb-436a-acec-3d14a40120c6', 'body': {'resize': {'flavorRef': '910288174'}}} Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3876, in _check_quota_for_upsize Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 16:44:47.960588 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 31 16:44:47.964577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 31 16:44:47.964577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 31 16:44:47.964577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 31 16:44:47.964577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 16:44:47.964577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 16:44:47.964577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 16:44:47.964577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 16:44:47.964577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 31 16:44:47.964577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 16:44:47.964577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4242, in resize Aug 31 16:44:47.964577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 31 16:44:47.964577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3894, in _check_quota_for_upsize Aug 31 16:44:47.964577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 31 16:44:47.964577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 31 16:44:47.964577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:44:47.964577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:44:47.964577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:44:47.964577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:44:47.964577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:44:47.964577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:44:47.964577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:44:47.964577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:44:47.964577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:44:47.964577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:44:47.964577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:44:47.964577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:44:47.964577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 31 16:44:47.964577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 31 16:44:47.964577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 31 16:44:47.964577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 31 16:44:47.964577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 31 16:44:47.964577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:44:47.964577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:44:47.964577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:44:47.964577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:44:47.964577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:44:47.964577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:44:47.964577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:44:47.964577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:44:47.964577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 31 16:44:47.964577 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:44:47.964577 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d8df89a3-380e-4381-8bf6-6c84605e5204 tempest-ServersAdminNegativeTestJSON-1147173629 tempest-ServersAdminNegativeTestJSON-1147173629-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:44:47.964577 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d8df89a3-380e-4381-8bf6-6c84605e5204 tempest-ServersAdminNegativeTestJSON-1147173629 tempest-ServersAdminNegativeTestJSON-1147173629-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/82aa6598-c9eb-436a-acec-3d14a40120c6/action" status: 403 len: 113 microversion: 2.1 time: 0.172865 Aug 31 16:44:47.964577 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3317/6817] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:44:47 2022] POST /compute/v2.1/servers/82aa6598-c9eb-436a-acec-3d14a40120c6/action => generated 113 bytes in 174 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:44:47.974936 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-048acaef-b631-46df-a80f-b36f0bb8a61e tempest-ServersAdminNegativeTestJSON-1147173629 tempest-ServersAdminNegativeTestJSON-1147173629-project-admin] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:47.997849 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-048acaef-b631-46df-a80f-b36f0bb8a61e tempest-ServersAdminNegativeTestJSON-1147173629 tempest-ServersAdminNegativeTestJSON-1147173629-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/910288174" status: 202 len: 0 microversion: 2.1 time: 0.029404 Aug 31 16:44:47.998522 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3501/6818] 10.222.0.50 () {58 vars in 1158 bytes} [Wed Aug 31 16:44:47 2022] DELETE /compute/v2.1/flavors/910288174 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:44:48.007188 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ec3ea435-951a-4ca5-8d6c-bb4b8b2e3f3a tempest-ServersAdminNegativeTestJSON-1147173629 tempest-ServersAdminNegativeTestJSON-1147173629-project-admin] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:48.028107 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ec3ea435-951a-4ca5-8d6c-bb4b8b2e3f3a tempest-ServersAdminNegativeTestJSON-1147173629 tempest-ServersAdminNegativeTestJSON-1147173629-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024603 Aug 31 16:44:48.028671 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3318/6819] 10.222.0.50 () {58 vars in 1146 bytes} [Wed Aug 31 16:44:48 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:48.048791 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7e857d8d-b0cc-48df-8e4a-b608c1e7ad4f tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:48.049331 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7e857d8d-b0cc-48df-8e4a-b608c1e7ad4f tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] [instance: 82aa6598-c9eb-436a-acec-3d14a40120c6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:48.056172 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7e857d8d-b0cc-48df-8e4a-b608c1e7ad4f tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:48.056682 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7e857d8d-b0cc-48df-8e4a-b608c1e7ad4f tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:48.057125 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7e857d8d-b0cc-48df-8e4a-b608c1e7ad4f tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:48.057828 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7e857d8d-b0cc-48df-8e4a-b608c1e7ad4f tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:48.058378 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7e857d8d-b0cc-48df-8e4a-b608c1e7ad4f tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:48.058784 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7e857d8d-b0cc-48df-8e4a-b608c1e7ad4f tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:48.085743 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7e857d8d-b0cc-48df-8e4a-b608c1e7ad4f tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] [instance: 82aa6598-c9eb-436a-acec-3d14a40120c6] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:44:48.183609 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7e857d8d-b0cc-48df-8e4a-b608c1e7ad4f tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] 10.222.0.50 "DELETE /compute/v2.1/servers/82aa6598-c9eb-436a-acec-3d14a40120c6" status: 204 len: 0 microversion: 2.1 time: 0.138673 Aug 31 16:44:48.184538 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3502/6820] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:44:48 2022] DELETE /compute/v2.1/servers/82aa6598-c9eb-436a-acec-3d14a40120c6 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 16:44:48.194714 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d79af17f-fa38-424e-9efe-a820bacae632 tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:48.195332 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d79af17f-fa38-424e-9efe-a820bacae632 tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] [instance: 82aa6598-c9eb-436a-acec-3d14a40120c6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:48.201782 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d79af17f-fa38-424e-9efe-a820bacae632 tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:48.202352 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d79af17f-fa38-424e-9efe-a820bacae632 tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:48.202827 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d79af17f-fa38-424e-9efe-a820bacae632 tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:48.203677 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d79af17f-fa38-424e-9efe-a820bacae632 tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:48.204403 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d79af17f-fa38-424e-9efe-a820bacae632 tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:48.204838 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d79af17f-fa38-424e-9efe-a820bacae632 tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:48.352197 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d79af17f-fa38-424e-9efe-a820bacae632 tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b6942adb4f437f9daf316e71561ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35705f22587c4f749b09fc43b51c3639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:48.364762 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d79af17f-fa38-424e-9efe-a820bacae632 tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] 10.222.0.50 "GET /compute/v2.1/servers/82aa6598-c9eb-436a-acec-3d14a40120c6" status: 200 len: 1478 microversion: 2.1 time: 0.174360 Aug 31 16:44:48.365554 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3319/6821] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:48 2022] GET /compute/v2.1/servers/82aa6598-c9eb-436a-acec-3d14a40120c6 => generated 1478 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:49.390356 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-09190946-1368-4a06-a45c-8717179199eb tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:49.391426 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-09190946-1368-4a06-a45c-8717179199eb tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] [instance: 82aa6598-c9eb-436a-acec-3d14a40120c6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:49.400097 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-09190946-1368-4a06-a45c-8717179199eb tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:49.400609 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-09190946-1368-4a06-a45c-8717179199eb tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:49.401069 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-09190946-1368-4a06-a45c-8717179199eb tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:49.401793 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-09190946-1368-4a06-a45c-8717179199eb tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:49.402306 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-09190946-1368-4a06-a45c-8717179199eb tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:49.402756 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-09190946-1368-4a06-a45c-8717179199eb tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:49.559799 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-09190946-1368-4a06-a45c-8717179199eb tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b6942adb4f437f9daf316e71561ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35705f22587c4f749b09fc43b51c3639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:49.569802 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-09190946-1368-4a06-a45c-8717179199eb tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] 10.222.0.50 "GET /compute/v2.1/servers/82aa6598-c9eb-436a-acec-3d14a40120c6" status: 200 len: 1478 microversion: 2.1 time: 0.184250 Aug 31 16:44:49.570440 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3503/6822] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:49 2022] GET /compute/v2.1/servers/82aa6598-c9eb-436a-acec-3d14a40120c6 => generated 1478 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:50.218146 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-1ef67e23-ef1a-454d-af76-d4fb0352948f req-44e45eeb-a6a7-4fb7-845c-66bde4c4cabd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82aa6598-c9eb-436a-acec-3d14a40120c6", "name": "network-vif-deleted", "tag": "c3da9e35-f7b8-4734-b1bc-896e7437e5b5"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:44:50.230138 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-1ef67e23-ef1a-454d-af76-d4fb0352948f req-44e45eeb-a6a7-4fb7-845c-66bde4c4cabd service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:50.230637 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-1ef67e23-ef1a-454d-af76-d4fb0352948f req-44e45eeb-a6a7-4fb7-845c-66bde4c4cabd service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:50.231067 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-1ef67e23-ef1a-454d-af76-d4fb0352948f req-44e45eeb-a6a7-4fb7-845c-66bde4c4cabd service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:50.243462 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-1ef67e23-ef1a-454d-af76-d4fb0352948f req-44e45eeb-a6a7-4fb7-845c-66bde4c4cabd service nova] Creating event network-vif-deleted:c3da9e35-f7b8-4734-b1bc-896e7437e5b5 for instance 82aa6598-c9eb-436a-acec-3d14a40120c6 on n-h2-833090-16 Aug 31 16:44:50.249537 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-1ef67e23-ef1a-454d-af76-d4fb0352948f req-44e45eeb-a6a7-4fb7-845c-66bde4c4cabd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035130 Aug 31 16:44:50.250251 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3320/6823] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:44:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:44:50.592335 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8d0e65a7-9c05-4881-87e0-554e8684411a tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:50.592969 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8d0e65a7-9c05-4881-87e0-554e8684411a tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] [instance: 82aa6598-c9eb-436a-acec-3d14a40120c6] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:50.600128 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8d0e65a7-9c05-4881-87e0-554e8684411a tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:50.600615 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8d0e65a7-9c05-4881-87e0-554e8684411a tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:50.601059 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8d0e65a7-9c05-4881-87e0-554e8684411a tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:50.601755 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8d0e65a7-9c05-4881-87e0-554e8684411a tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:50.602245 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8d0e65a7-9c05-4881-87e0-554e8684411a tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:50.602676 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8d0e65a7-9c05-4881-87e0-554e8684411a tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:50.635926 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8d0e65a7-9c05-4881-87e0-554e8684411a tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:50.636419 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8d0e65a7-9c05-4881-87e0-554e8684411a tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:50.636870 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8d0e65a7-9c05-4881-87e0-554e8684411a tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:50.637319 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-8d0e65a7-9c05-4881-87e0-554e8684411a tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lazy-loading 'fault' on Instance uuid 82aa6598-c9eb-436a-acec-3d14a40120c6 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:44:50.687815 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8d0e65a7-9c05-4881-87e0-554e8684411a tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b6942adb4f437f9daf316e71561ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35705f22587c4f749b09fc43b51c3639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:50.701498 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8d0e65a7-9c05-4881-87e0-554e8684411a tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] 10.222.0.50 "GET /compute/v2.1/servers/82aa6598-c9eb-436a-acec-3d14a40120c6" status: 200 len: 1312 microversion: 2.1 time: 0.113654 Aug 31 16:44:50.702504 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3504/6824] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:50 2022] GET /compute/v2.1/servers/82aa6598-c9eb-436a-acec-3d14a40120c6 => generated 1312 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:44:51.726516 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-28105b1b-c1a6-490c-95fc-762df9eb785b tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:51.727085 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-28105b1b-c1a6-490c-95fc-762df9eb785b tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] [instance: 82aa6598-c9eb-436a-acec-3d14a40120c6] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:51.733948 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28105b1b-c1a6-490c-95fc-762df9eb785b tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:51.734462 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28105b1b-c1a6-490c-95fc-762df9eb785b tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:51.734906 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28105b1b-c1a6-490c-95fc-762df9eb785b tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:51.735596 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28105b1b-c1a6-490c-95fc-762df9eb785b tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:51.736055 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28105b1b-c1a6-490c-95fc-762df9eb785b tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:51.736479 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28105b1b-c1a6-490c-95fc-762df9eb785b tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:51.754504 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-28105b1b-c1a6-490c-95fc-762df9eb785b tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] HTTP exception thrown: Instance 82aa6598-c9eb-436a-acec-3d14a40120c6 could not be found. Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-28105b1b-c1a6-490c-95fc-762df9eb785b tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Request method failure captured: Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/82aa6598-c9eb-436a-acec-3d14a40120c6 HTTP/1.1 Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD4_yEyE45rJEi9qsbbH4kwv3hi17mXY3uHtYV_psHbvovCGkWOtZs3a_JY-pWDJnzP2YVIYYxx1viJBGhg16wMiuIlkbIbt4A8hdxxcFqvLYqxGXlHNVch7VhJpRm6p_ATcroiH1Io-zKXzulX8s5V2p3C-3UEDGDWHLZfFZbw_Xelw Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 35705f22587c4f749b09fc43b51c3639 Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1557983902 Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/35705f22587c4f749b09fc43b51c3639"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/35705f22587c4f749b09fc43b51c3639"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/35705f22587c4f749b09fc43b51c3639"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_35705f22587c4f749b09fc43b51c3639", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1557983902 Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 35705f22587c4f749b09fc43b51c3639 Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1557983902 Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServersAdminNegativeTestJSON-1557983902-project Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 13b6942adb4f437f9daf316e71561ed0 Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1557983902-project Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 82aa6598-c9eb-436a-acec-3d14a40120c6 could not be found. Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '82aa6598-c9eb-436a-acec-3d14a40120c6'} Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82aa6598-c9eb-436a-acec-3d14a40120c6 could not be found. Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82aa6598-c9eb-436a-acec-3d14a40120c6 could not be found. Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:44:51.756190 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:44:51.760531 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:44:51.760531 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:44:51.760531 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:44:51.760531 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:44:51.760531 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:44:51.760531 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:44:51.760531 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82aa6598-c9eb-436a-acec-3d14a40120c6 could not be found. Aug 31 16:44:51.760531 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:44:51.760531 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-28105b1b-c1a6-490c-95fc-762df9eb785b tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] Returning 404 to user: Instance 82aa6598-c9eb-436a-acec-3d14a40120c6 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:44:51.760531 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-28105b1b-c1a6-490c-95fc-762df9eb785b tempest-ServersAdminNegativeTestJSON-1557983902 tempest-ServersAdminNegativeTestJSON-1557983902-project] 10.222.0.50 "GET /compute/v2.1/servers/82aa6598-c9eb-436a-acec-3d14a40120c6" status: 404 len: 111 microversion: 2.1 time: 0.037441 Aug 31 16:44:51.760531 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3321/6825] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:51 2022] GET /compute/v2.1/servers/82aa6598-c9eb-436a-acec-3d14a40120c6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:44:58.581668 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:44:58.583155 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=3 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:44:58.730660 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1d9c4175-8e90-483a-8fb5-23bde123feb8 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1746205117", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "d5b4929f-8af2-42bd-852b-6401c0478e43"}]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:44:58.795354 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-1d9c4175-8e90-483a-8fb5-23bde123feb8 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] validate_networks() for [('d5b4929f-8af2-42bd-852b-6401c0478e43', None, None, None, None, None)] {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:44:59.264706 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-1d9c4175-8e90-483a-8fb5-23bde123feb8 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:44:59.265204 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-1d9c4175-8e90-483a-8fb5-23bde123feb8 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:44:59.265754 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-1d9c4175-8e90-483a-8fb5-23bde123feb8 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:44:59.266201 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-1d9c4175-8e90-483a-8fb5-23bde123feb8 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:44:59.266621 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-1d9c4175-8e90-483a-8fb5-23bde123feb8 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:44:59.276429 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1d9c4175-8e90-483a-8fb5-23bde123feb8 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:59.276941 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1d9c4175-8e90-483a-8fb5-23bde123feb8 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:59.277384 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1d9c4175-8e90-483a-8fb5-23bde123feb8 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:59.278140 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1d9c4175-8e90-483a-8fb5-23bde123feb8 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:44:59.278605 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1d9c4175-8e90-483a-8fb5-23bde123feb8 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:44:59.279030 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1d9c4175-8e90-483a-8fb5-23bde123feb8 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:44:59.302768 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-1d9c4175-8e90-483a-8fb5-23bde123feb8 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Getting quotas for project 0e5dc56a00b5438a9e8f357e996b3acc. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:44:59.308126 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-1d9c4175-8e90-483a-8fb5-23bde123feb8 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Getting quotas for user a69f7326a3fa453a8502b78fe45e4652 and project 0e5dc56a00b5438a9e8f357e996b3acc. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:44:59.321702 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1d9c4175-8e90-483a-8fb5-23bde123feb8 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:44:59.324381 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1d9c4175-8e90-483a-8fb5-23bde123feb8 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] [instance: 0bee9253-36ea-474b-a4ca-31890040a769] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:44:59.372845 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1d9c4175-8e90-483a-8fb5-23bde123feb8 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.796731 Aug 31 16:44:59.373500 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3505/6826] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:44:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:44:59.387163 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-868f8e3d-927b-4287-969c-eaa06121b93d tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:44:59.387766 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-868f8e3d-927b-4287-969c-eaa06121b93d tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] [instance: 0bee9253-36ea-474b-a4ca-31890040a769] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:44:59.392649 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:44:59.393740 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:44:59.477303 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-868f8e3d-927b-4287-969c-eaa06121b93d tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69f7326a3fa453a8502b78fe45e4652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5dc56a00b5438a9e8f357e996b3acc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:44:59.487902 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-868f8e3d-927b-4287-969c-eaa06121b93d tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] 10.222.0.50 "GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769" status: 200 len: 1215 microversion: 2.1 time: 0.104442 Aug 31 16:44:59.489065 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3322/6827] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:44:59 2022] GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769 => generated 1215 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:00.511516 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f9e799a1-44cb-4594-8101-d17f59a719f1 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:00.512124 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f9e799a1-44cb-4594-8101-d17f59a719f1 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] [instance: 0bee9253-36ea-474b-a4ca-31890040a769] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:00.518859 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f9e799a1-44cb-4594-8101-d17f59a719f1 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:00.519504 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f9e799a1-44cb-4594-8101-d17f59a719f1 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:00.520835 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f9e799a1-44cb-4594-8101-d17f59a719f1 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:00.520835 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f9e799a1-44cb-4594-8101-d17f59a719f1 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:00.521251 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f9e799a1-44cb-4594-8101-d17f59a719f1 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:00.521687 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f9e799a1-44cb-4594-8101-d17f59a719f1 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:00.629313 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f9e799a1-44cb-4594-8101-d17f59a719f1 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69f7326a3fa453a8502b78fe45e4652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5dc56a00b5438a9e8f357e996b3acc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:00.640634 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f9e799a1-44cb-4594-8101-d17f59a719f1 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] 10.222.0.50 "GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769" status: 200 len: 1275 microversion: 2.1 time: 0.134631 Aug 31 16:45:00.642875 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3506/6828] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:00 2022] GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769 => generated 1275 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:01.664381 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-91d95dd8-5b0a-4ccd-97b0-dc0df5f7a4e6 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:01.665596 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-91d95dd8-5b0a-4ccd-97b0-dc0df5f7a4e6 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] [instance: 0bee9253-36ea-474b-a4ca-31890040a769] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:01.674257 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91d95dd8-5b0a-4ccd-97b0-dc0df5f7a4e6 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:01.675095 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91d95dd8-5b0a-4ccd-97b0-dc0df5f7a4e6 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:01.675936 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91d95dd8-5b0a-4ccd-97b0-dc0df5f7a4e6 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:01.676800 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91d95dd8-5b0a-4ccd-97b0-dc0df5f7a4e6 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:01.677250 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91d95dd8-5b0a-4ccd-97b0-dc0df5f7a4e6 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:01.677672 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91d95dd8-5b0a-4ccd-97b0-dc0df5f7a4e6 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:01.833488 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-91d95dd8-5b0a-4ccd-97b0-dc0df5f7a4e6 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69f7326a3fa453a8502b78fe45e4652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5dc56a00b5438a9e8f357e996b3acc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:01.844181 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-91d95dd8-5b0a-4ccd-97b0-dc0df5f7a4e6 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] 10.222.0.50 "GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769" status: 200 len: 1315 microversion: 2.1 time: 0.183949 Aug 31 16:45:01.845526 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3323/6829] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:01 2022] GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:45:02.107312 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-b1290774-cd56-4a6a-b8f0-add6ac25d0c7 req-09a02798-2139-434d-81c0-666c55c94412 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bee9253-36ea-474b-a4ca-31890040a769", "tag": "065e13d4-81de-4662-8e49-bd9a406c061b"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:45:02.122825 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-b1290774-cd56-4a6a-b8f0-add6ac25d0c7 req-09a02798-2139-434d-81c0-666c55c94412 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:02.123475 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-b1290774-cd56-4a6a-b8f0-add6ac25d0c7 req-09a02798-2139-434d-81c0-666c55c94412 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:02.124192 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-b1290774-cd56-4a6a-b8f0-add6ac25d0c7 req-09a02798-2139-434d-81c0-666c55c94412 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:02.136441 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-b1290774-cd56-4a6a-b8f0-add6ac25d0c7 req-09a02798-2139-434d-81c0-666c55c94412 service nova] Creating event network-changed:065e13d4-81de-4662-8e49-bd9a406c061b for instance 0bee9253-36ea-474b-a4ca-31890040a769 on n-h2-833090-16 Aug 31 16:45:02.142828 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-b1290774-cd56-4a6a-b8f0-add6ac25d0c7 req-09a02798-2139-434d-81c0-666c55c94412 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047485 Aug 31 16:45:02.144798 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3507/6830] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:45:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:45:02.866171 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6b48ad88-7d8c-4960-a29c-b7bbdd2e38a3 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:02.866790 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6b48ad88-7d8c-4960-a29c-b7bbdd2e38a3 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] [instance: 0bee9253-36ea-474b-a4ca-31890040a769] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:02.874379 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b48ad88-7d8c-4960-a29c-b7bbdd2e38a3 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:02.874888 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b48ad88-7d8c-4960-a29c-b7bbdd2e38a3 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:02.875317 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b48ad88-7d8c-4960-a29c-b7bbdd2e38a3 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:02.876002 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b48ad88-7d8c-4960-a29c-b7bbdd2e38a3 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:02.876472 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b48ad88-7d8c-4960-a29c-b7bbdd2e38a3 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:02.876886 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6b48ad88-7d8c-4960-a29c-b7bbdd2e38a3 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:03.014912 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6b48ad88-7d8c-4960-a29c-b7bbdd2e38a3 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69f7326a3fa453a8502b78fe45e4652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5dc56a00b5438a9e8f357e996b3acc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:03.023044 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6b48ad88-7d8c-4960-a29c-b7bbdd2e38a3 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] 10.222.0.50 "GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769" status: 200 len: 1315 microversion: 2.1 time: 0.161017 Aug 31 16:45:03.024018 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3324/6831] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:02 2022] GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:04.049364 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e25a25f7-c4ea-4ddb-8d7f-8a213f6eeef5 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:04.050852 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e25a25f7-c4ea-4ddb-8d7f-8a213f6eeef5 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] [instance: 0bee9253-36ea-474b-a4ca-31890040a769] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:04.059762 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e25a25f7-c4ea-4ddb-8d7f-8a213f6eeef5 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:04.060481 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e25a25f7-c4ea-4ddb-8d7f-8a213f6eeef5 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:04.061160 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e25a25f7-c4ea-4ddb-8d7f-8a213f6eeef5 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:04.062179 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e25a25f7-c4ea-4ddb-8d7f-8a213f6eeef5 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:04.062699 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e25a25f7-c4ea-4ddb-8d7f-8a213f6eeef5 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:04.063243 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e25a25f7-c4ea-4ddb-8d7f-8a213f6eeef5 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:04.207062 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e25a25f7-c4ea-4ddb-8d7f-8a213f6eeef5 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69f7326a3fa453a8502b78fe45e4652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5dc56a00b5438a9e8f357e996b3acc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:04.215165 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e25a25f7-c4ea-4ddb-8d7f-8a213f6eeef5 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] 10.222.0.50 "GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769" status: 200 len: 1315 microversion: 2.1 time: 0.173574 Aug 31 16:45:04.215751 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3508/6832] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:04 2022] GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:05.237415 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f05821c5-e4cd-4be2-92bd-e2e36ec1c617 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:05.238362 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f05821c5-e4cd-4be2-92bd-e2e36ec1c617 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] [instance: 0bee9253-36ea-474b-a4ca-31890040a769] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:05.245936 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f05821c5-e4cd-4be2-92bd-e2e36ec1c617 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:05.246457 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f05821c5-e4cd-4be2-92bd-e2e36ec1c617 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:05.246909 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f05821c5-e4cd-4be2-92bd-e2e36ec1c617 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:05.247610 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f05821c5-e4cd-4be2-92bd-e2e36ec1c617 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:05.248063 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f05821c5-e4cd-4be2-92bd-e2e36ec1c617 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:05.248473 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f05821c5-e4cd-4be2-92bd-e2e36ec1c617 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:05.384541 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f05821c5-e4cd-4be2-92bd-e2e36ec1c617 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69f7326a3fa453a8502b78fe45e4652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5dc56a00b5438a9e8f357e996b3acc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:05.392856 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f05821c5-e4cd-4be2-92bd-e2e36ec1c617 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] 10.222.0.50 "GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769" status: 200 len: 1315 microversion: 2.1 time: 0.159511 Aug 31 16:45:05.393721 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3325/6833] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:05 2022] GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:06.415053 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-32115379-4742-48b5-b15a-19cc5a6da8d8 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:06.415630 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-32115379-4742-48b5-b15a-19cc5a6da8d8 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] [instance: 0bee9253-36ea-474b-a4ca-31890040a769] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:06.418224 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:45:06.424191 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-32115379-4742-48b5-b15a-19cc5a6da8d8 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:06.424795 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-32115379-4742-48b5-b15a-19cc5a6da8d8 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:06.425251 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-32115379-4742-48b5-b15a-19cc5a6da8d8 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:06.425964 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-32115379-4742-48b5-b15a-19cc5a6da8d8 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:06.426457 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-32115379-4742-48b5-b15a-19cc5a6da8d8 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:06.426892 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-32115379-4742-48b5-b15a-19cc5a6da8d8 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:06.430606 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:45:06.562733 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-32115379-4742-48b5-b15a-19cc5a6da8d8 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69f7326a3fa453a8502b78fe45e4652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5dc56a00b5438a9e8f357e996b3acc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:06.571864 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-32115379-4742-48b5-b15a-19cc5a6da8d8 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] 10.222.0.50 "GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769" status: 200 len: 1315 microversion: 2.1 time: 0.160985 Aug 31 16:45:06.572422 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3509/6834] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:06 2022] GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:07.592908 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-199d497a-30b0-4a35-a457-efd2010ad040 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:07.593510 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-199d497a-30b0-4a35-a457-efd2010ad040 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] [instance: 0bee9253-36ea-474b-a4ca-31890040a769] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:07.597077 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:45:07.603209 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-199d497a-30b0-4a35-a457-efd2010ad040 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:07.603638 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-199d497a-30b0-4a35-a457-efd2010ad040 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:07.604277 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-199d497a-30b0-4a35-a457-efd2010ad040 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:07.605165 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-199d497a-30b0-4a35-a457-efd2010ad040 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:07.605623 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-199d497a-30b0-4a35-a457-efd2010ad040 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:07.606043 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-199d497a-30b0-4a35-a457-efd2010ad040 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:07.609527 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=72 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:45:07.749355 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-199d497a-30b0-4a35-a457-efd2010ad040 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69f7326a3fa453a8502b78fe45e4652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5dc56a00b5438a9e8f357e996b3acc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:07.759003 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-199d497a-30b0-4a35-a457-efd2010ad040 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] 10.222.0.50 "GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769" status: 200 len: 1315 microversion: 2.1 time: 0.169983 Aug 31 16:45:07.759582 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3326/6835] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:07 2022] GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:08.783914 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a8e316fb-43ee-4abd-9138-5c1344bdc053 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:08.784644 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a8e316fb-43ee-4abd-9138-5c1344bdc053 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] [instance: 0bee9253-36ea-474b-a4ca-31890040a769] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:08.795462 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a8e316fb-43ee-4abd-9138-5c1344bdc053 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:08.796251 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a8e316fb-43ee-4abd-9138-5c1344bdc053 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:08.797120 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a8e316fb-43ee-4abd-9138-5c1344bdc053 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:08.799390 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a8e316fb-43ee-4abd-9138-5c1344bdc053 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:08.800620 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a8e316fb-43ee-4abd-9138-5c1344bdc053 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:08.801316 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a8e316fb-43ee-4abd-9138-5c1344bdc053 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:08.939508 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a8e316fb-43ee-4abd-9138-5c1344bdc053 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69f7326a3fa453a8502b78fe45e4652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5dc56a00b5438a9e8f357e996b3acc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:08.947730 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a8e316fb-43ee-4abd-9138-5c1344bdc053 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] 10.222.0.50 "GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769" status: 200 len: 1315 microversion: 2.1 time: 0.171288 Aug 31 16:45:08.948338 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3510/6836] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:08 2022] GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:09.099349 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-a941b1a9-c3cf-4a0f-b7d3-3694a7813d12 req-550697f1-26be-41e5-b936-1d3fbb3a39d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bee9253-36ea-474b-a4ca-31890040a769", "name": "network-vif-plugged", "status": "completed", "tag": "065e13d4-81de-4662-8e49-bd9a406c061b"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:45:09.114147 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a941b1a9-c3cf-4a0f-b7d3-3694a7813d12 req-550697f1-26be-41e5-b936-1d3fbb3a39d5 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:09.114995 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a941b1a9-c3cf-4a0f-b7d3-3694a7813d12 req-550697f1-26be-41e5-b936-1d3fbb3a39d5 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:09.115502 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a941b1a9-c3cf-4a0f-b7d3-3694a7813d12 req-550697f1-26be-41e5-b936-1d3fbb3a39d5 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:09.133897 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-a941b1a9-c3cf-4a0f-b7d3-3694a7813d12 req-550697f1-26be-41e5-b936-1d3fbb3a39d5 service nova] Creating event network-vif-plugged:065e13d4-81de-4662-8e49-bd9a406c061b for instance 0bee9253-36ea-474b-a4ca-31890040a769 on n-h2-833090-16 Aug 31 16:45:09.139284 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-a941b1a9-c3cf-4a0f-b7d3-3694a7813d12 req-550697f1-26be-41e5-b936-1d3fbb3a39d5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043900 Aug 31 16:45:09.139890 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3327/6837] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:45:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:45:09.969887 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2c24d4ec-6145-4aa1-b178-29b0428939e2 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:09.970643 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2c24d4ec-6145-4aa1-b178-29b0428939e2 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] [instance: 0bee9253-36ea-474b-a4ca-31890040a769] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:09.972761 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:45:09.973458 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=6 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:45:09.980475 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2c24d4ec-6145-4aa1-b178-29b0428939e2 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:09.980989 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2c24d4ec-6145-4aa1-b178-29b0428939e2 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:09.981440 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2c24d4ec-6145-4aa1-b178-29b0428939e2 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:09.982163 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2c24d4ec-6145-4aa1-b178-29b0428939e2 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:09.982628 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2c24d4ec-6145-4aa1-b178-29b0428939e2 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:09.983061 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2c24d4ec-6145-4aa1-b178-29b0428939e2 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:10.126359 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2c24d4ec-6145-4aa1-b178-29b0428939e2 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69f7326a3fa453a8502b78fe45e4652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5dc56a00b5438a9e8f357e996b3acc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:10.135604 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2c24d4ec-6145-4aa1-b178-29b0428939e2 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] 10.222.0.50 "GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769" status: 200 len: 1315 microversion: 2.1 time: 0.169945 Aug 31 16:45:10.136382 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3511/6838] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:09 2022] GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:11.157565 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:45:11.162984 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-199505dc-e8a4-4037-9e00-7be81d809a8d tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:11.163696 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-199505dc-e8a4-4037-9e00-7be81d809a8d tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] [instance: 0bee9253-36ea-474b-a4ca-31890040a769] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:11.170516 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-199505dc-e8a4-4037-9e00-7be81d809a8d tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:11.170996 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-199505dc-e8a4-4037-9e00-7be81d809a8d tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:11.171440 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-199505dc-e8a4-4037-9e00-7be81d809a8d tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:11.172143 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-199505dc-e8a4-4037-9e00-7be81d809a8d tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:11.172585 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-199505dc-e8a4-4037-9e00-7be81d809a8d tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:11.173012 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-199505dc-e8a4-4037-9e00-7be81d809a8d tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:11.323785 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-199505dc-e8a4-4037-9e00-7be81d809a8d tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69f7326a3fa453a8502b78fe45e4652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5dc56a00b5438a9e8f357e996b3acc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:11.332353 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-199505dc-e8a4-4037-9e00-7be81d809a8d tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] 10.222.0.50 "GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769" status: 200 len: 1500 microversion: 2.1 time: 0.175766 Aug 31 16:45:11.332953 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3328/6839] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:11 2022] GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769 => generated 1500 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:11.353110 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9c7ea9cb-b328-47f1-ab99-8f2a534e78c8 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:45:11.355424 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9c7ea9cb-b328-47f1-ab99-8f2a534e78c8 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] [instance: 0bee9253-36ea-474b-a4ca-31890040a769] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:11.362552 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9c7ea9cb-b328-47f1-ab99-8f2a534e78c8 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:11.363091 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9c7ea9cb-b328-47f1-ab99-8f2a534e78c8 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:11.363539 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9c7ea9cb-b328-47f1-ab99-8f2a534e78c8 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:11.364245 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9c7ea9cb-b328-47f1-ab99-8f2a534e78c8 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:11.364704 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9c7ea9cb-b328-47f1-ab99-8f2a534e78c8 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:11.365143 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9c7ea9cb-b328-47f1-ab99-8f2a534e78c8 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:11.403030 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9c7ea9cb-b328-47f1-ab99-8f2a534e78c8 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a69f7326a3fa453a8502b78fe45e4652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5dc56a00b5438a9e8f357e996b3acc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:11.411952 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9c7ea9cb-b328-47f1-ab99-8f2a534e78c8 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] [instance: 0bee9253-36ea-474b-a4ca-31890040a769] Old instance type m1.heat2, new instance type m1.heat {{(pid=128864) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 31 16:45:11.419903 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-9c7ea9cb-b328-47f1-ab99-8f2a534e78c8 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:45:11.420336 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-9c7ea9cb-b328-47f1-ab99-8f2a534e78c8 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:45:11.420847 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-9c7ea9cb-b328-47f1-ab99-8f2a534e78c8 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:45:11.421244 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-9c7ea9cb-b328-47f1-ab99-8f2a534e78c8 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:45:11.421661 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-9c7ea9cb-b328-47f1-ab99-8f2a534e78c8 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:45:11.488001 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9c7ea9cb-b328-47f1-ab99-8f2a534e78c8 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] 10.222.0.50 "POST /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769/action" status: 202 len: 0 microversion: 2.1 time: 0.138938 Aug 31 16:45:11.489014 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3512/6840] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:45:11 2022] POST /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:45:11.503244 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ae524156-0a83-482a-8703-1b8dae181467 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:11.503887 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ae524156-0a83-482a-8703-1b8dae181467 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] [instance: 0bee9253-36ea-474b-a4ca-31890040a769] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:11.510496 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae524156-0a83-482a-8703-1b8dae181467 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:11.510988 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae524156-0a83-482a-8703-1b8dae181467 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:11.511420 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae524156-0a83-482a-8703-1b8dae181467 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:11.512142 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae524156-0a83-482a-8703-1b8dae181467 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:11.512585 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae524156-0a83-482a-8703-1b8dae181467 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:11.513088 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ae524156-0a83-482a-8703-1b8dae181467 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:11.665396 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ae524156-0a83-482a-8703-1b8dae181467 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69f7326a3fa453a8502b78fe45e4652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5dc56a00b5438a9e8f357e996b3acc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:11.674856 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ae524156-0a83-482a-8703-1b8dae181467 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] 10.222.0.50 "GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769" status: 200 len: 1509 microversion: 2.1 time: 0.178201 Aug 31 16:45:11.674856 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3329/6841] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:11 2022] GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769 => generated 1509 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:12.696094 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2c17a35c-67e7-4d9f-bcf9-cb5b5f6afb52 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:12.696707 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2c17a35c-67e7-4d9f-bcf9-cb5b5f6afb52 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] [instance: 0bee9253-36ea-474b-a4ca-31890040a769] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:12.703201 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2c17a35c-67e7-4d9f-bcf9-cb5b5f6afb52 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:12.703739 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2c17a35c-67e7-4d9f-bcf9-cb5b5f6afb52 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:12.704160 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2c17a35c-67e7-4d9f-bcf9-cb5b5f6afb52 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:12.704872 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2c17a35c-67e7-4d9f-bcf9-cb5b5f6afb52 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:12.705338 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2c17a35c-67e7-4d9f-bcf9-cb5b5f6afb52 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:12.706163 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2c17a35c-67e7-4d9f-bcf9-cb5b5f6afb52 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:12.859802 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2c17a35c-67e7-4d9f-bcf9-cb5b5f6afb52 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69f7326a3fa453a8502b78fe45e4652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5dc56a00b5438a9e8f357e996b3acc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:12.868886 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2c17a35c-67e7-4d9f-bcf9-cb5b5f6afb52 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] 10.222.0.50 "GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769" status: 200 len: 1509 microversion: 2.1 time: 0.177419 Aug 31 16:45:12.869815 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3513/6842] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:12 2022] GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769 => generated 1509 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:13.894502 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-eb34257a-c1a5-4d97-afe3-ac9e45aadc88 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:13.895089 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-eb34257a-c1a5-4d97-afe3-ac9e45aadc88 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] [instance: 0bee9253-36ea-474b-a4ca-31890040a769] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:13.902443 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb34257a-c1a5-4d97-afe3-ac9e45aadc88 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:13.902943 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb34257a-c1a5-4d97-afe3-ac9e45aadc88 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:13.903350 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb34257a-c1a5-4d97-afe3-ac9e45aadc88 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:13.904048 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb34257a-c1a5-4d97-afe3-ac9e45aadc88 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:13.904703 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb34257a-c1a5-4d97-afe3-ac9e45aadc88 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:13.905470 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb34257a-c1a5-4d97-afe3-ac9e45aadc88 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:14.059066 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-eb34257a-c1a5-4d97-afe3-ac9e45aadc88 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69f7326a3fa453a8502b78fe45e4652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5dc56a00b5438a9e8f357e996b3acc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:14.070403 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-eb34257a-c1a5-4d97-afe3-ac9e45aadc88 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] 10.222.0.50 "GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769" status: 200 len: 1514 microversion: 2.1 time: 0.181054 Aug 31 16:45:14.071307 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3330/6843] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:13 2022] GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769 => generated 1514 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:15.095524 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c3ea8d4b-1627-4b18-9954-bb1da2a78394 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:15.096258 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c3ea8d4b-1627-4b18-9954-bb1da2a78394 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] [instance: 0bee9253-36ea-474b-a4ca-31890040a769] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:15.104232 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3ea8d4b-1627-4b18-9954-bb1da2a78394 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:15.104732 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3ea8d4b-1627-4b18-9954-bb1da2a78394 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:15.105263 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3ea8d4b-1627-4b18-9954-bb1da2a78394 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:15.106041 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3ea8d4b-1627-4b18-9954-bb1da2a78394 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:15.106573 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3ea8d4b-1627-4b18-9954-bb1da2a78394 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:15.107015 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3ea8d4b-1627-4b18-9954-bb1da2a78394 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:15.248829 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c3ea8d4b-1627-4b18-9954-bb1da2a78394 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69f7326a3fa453a8502b78fe45e4652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5dc56a00b5438a9e8f357e996b3acc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:15.259652 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c3ea8d4b-1627-4b18-9954-bb1da2a78394 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] 10.222.0.50 "GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769" status: 200 len: 1514 microversion: 2.1 time: 0.169418 Aug 31 16:45:15.260257 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3514/6844] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:15 2022] GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769 => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:16.282536 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7370987a-c716-4662-8a23-65f1e870ddb6 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:16.283151 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7370987a-c716-4662-8a23-65f1e870ddb6 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] [instance: 0bee9253-36ea-474b-a4ca-31890040a769] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:16.290740 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7370987a-c716-4662-8a23-65f1e870ddb6 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:16.291231 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7370987a-c716-4662-8a23-65f1e870ddb6 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:16.291653 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7370987a-c716-4662-8a23-65f1e870ddb6 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:16.292374 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7370987a-c716-4662-8a23-65f1e870ddb6 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:16.292854 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7370987a-c716-4662-8a23-65f1e870ddb6 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:16.293303 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7370987a-c716-4662-8a23-65f1e870ddb6 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:16.446605 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7370987a-c716-4662-8a23-65f1e870ddb6 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69f7326a3fa453a8502b78fe45e4652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5dc56a00b5438a9e8f357e996b3acc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:16.457707 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7370987a-c716-4662-8a23-65f1e870ddb6 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] 10.222.0.50 "GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769" status: 200 len: 1514 microversion: 2.1 time: 0.179241 Aug 31 16:45:16.458363 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3331/6845] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:16 2022] GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769 => generated 1514 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:17.479633 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-cb137524-2bbb-4687-96c1-0d5db2679c1d tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:17.480289 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-cb137524-2bbb-4687-96c1-0d5db2679c1d tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] [instance: 0bee9253-36ea-474b-a4ca-31890040a769] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:17.488937 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb137524-2bbb-4687-96c1-0d5db2679c1d tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:17.489649 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb137524-2bbb-4687-96c1-0d5db2679c1d tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:17.490218 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb137524-2bbb-4687-96c1-0d5db2679c1d tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:17.491029 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb137524-2bbb-4687-96c1-0d5db2679c1d tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:17.491496 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb137524-2bbb-4687-96c1-0d5db2679c1d tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:17.491989 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb137524-2bbb-4687-96c1-0d5db2679c1d tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:17.634907 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-cb137524-2bbb-4687-96c1-0d5db2679c1d tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69f7326a3fa453a8502b78fe45e4652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5dc56a00b5438a9e8f357e996b3acc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:17.643621 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-cb137524-2bbb-4687-96c1-0d5db2679c1d tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] 10.222.0.50 "GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769" status: 200 len: 1514 microversion: 2.1 time: 0.168092 Aug 31 16:45:17.644247 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3515/6846] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:17 2022] GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769 => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:18.671102 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-43f75bf7-e22a-4cc3-80a4-608a3ec912e8 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:18.671774 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-43f75bf7-e22a-4cc3-80a4-608a3ec912e8 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] [instance: 0bee9253-36ea-474b-a4ca-31890040a769] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:18.680825 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43f75bf7-e22a-4cc3-80a4-608a3ec912e8 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:18.681340 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43f75bf7-e22a-4cc3-80a4-608a3ec912e8 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:18.681785 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43f75bf7-e22a-4cc3-80a4-608a3ec912e8 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:18.682515 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43f75bf7-e22a-4cc3-80a4-608a3ec912e8 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:18.682970 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43f75bf7-e22a-4cc3-80a4-608a3ec912e8 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:18.683394 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-43f75bf7-e22a-4cc3-80a4-608a3ec912e8 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:18.826445 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-43f75bf7-e22a-4cc3-80a4-608a3ec912e8 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69f7326a3fa453a8502b78fe45e4652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5dc56a00b5438a9e8f357e996b3acc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:18.835317 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-43f75bf7-e22a-4cc3-80a4-608a3ec912e8 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] 10.222.0.50 "GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769" status: 200 len: 1514 microversion: 2.1 time: 0.168249 Aug 31 16:45:18.835919 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3332/6847] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:18 2022] GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769 => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:19.860183 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6df13cbc-b5ec-46d6-8a56-dcc0da199bc3 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:19.861136 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6df13cbc-b5ec-46d6-8a56-dcc0da199bc3 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] [instance: 0bee9253-36ea-474b-a4ca-31890040a769] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:19.869147 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6df13cbc-b5ec-46d6-8a56-dcc0da199bc3 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:19.869639 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6df13cbc-b5ec-46d6-8a56-dcc0da199bc3 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:19.870079 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6df13cbc-b5ec-46d6-8a56-dcc0da199bc3 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:19.870814 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6df13cbc-b5ec-46d6-8a56-dcc0da199bc3 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:19.871272 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6df13cbc-b5ec-46d6-8a56-dcc0da199bc3 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:19.871700 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6df13cbc-b5ec-46d6-8a56-dcc0da199bc3 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:20.018024 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6df13cbc-b5ec-46d6-8a56-dcc0da199bc3 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69f7326a3fa453a8502b78fe45e4652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5dc56a00b5438a9e8f357e996b3acc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:20.027376 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6df13cbc-b5ec-46d6-8a56-dcc0da199bc3 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] 10.222.0.50 "GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769" status: 200 len: 1514 microversion: 2.1 time: 0.173732 Aug 31 16:45:20.027968 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3516/6848] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:19 2022] GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769 => generated 1514 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:21.055592 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7d9ca952-b576-428b-b2ba-c1fbcce1a9b0 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:21.056235 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7d9ca952-b576-428b-b2ba-c1fbcce1a9b0 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] [instance: 0bee9253-36ea-474b-a4ca-31890040a769] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:21.063364 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d9ca952-b576-428b-b2ba-c1fbcce1a9b0 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:21.063854 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d9ca952-b576-428b-b2ba-c1fbcce1a9b0 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:21.064291 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d9ca952-b576-428b-b2ba-c1fbcce1a9b0 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:21.065360 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d9ca952-b576-428b-b2ba-c1fbcce1a9b0 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:21.065817 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d9ca952-b576-428b-b2ba-c1fbcce1a9b0 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:21.066281 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7d9ca952-b576-428b-b2ba-c1fbcce1a9b0 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:21.220757 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7d9ca952-b576-428b-b2ba-c1fbcce1a9b0 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69f7326a3fa453a8502b78fe45e4652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5dc56a00b5438a9e8f357e996b3acc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:21.229805 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7d9ca952-b576-428b-b2ba-c1fbcce1a9b0 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] 10.222.0.50 "GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769" status: 200 len: 1514 microversion: 2.1 time: 0.178399 Aug 31 16:45:21.230410 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3333/6849] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:21 2022] GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769 => generated 1514 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:45:22.251810 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5c7a7b06-b1d4-4349-b754-f61d3ff6db3d tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:22.252751 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5c7a7b06-b1d4-4349-b754-f61d3ff6db3d tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] [instance: 0bee9253-36ea-474b-a4ca-31890040a769] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:22.260126 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5c7a7b06-b1d4-4349-b754-f61d3ff6db3d tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:22.260628 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5c7a7b06-b1d4-4349-b754-f61d3ff6db3d tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:22.261081 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5c7a7b06-b1d4-4349-b754-f61d3ff6db3d tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:22.262153 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5c7a7b06-b1d4-4349-b754-f61d3ff6db3d tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:22.262829 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5c7a7b06-b1d4-4349-b754-f61d3ff6db3d tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:22.263519 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5c7a7b06-b1d4-4349-b754-f61d3ff6db3d tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:22.428227 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5c7a7b06-b1d4-4349-b754-f61d3ff6db3d tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69f7326a3fa453a8502b78fe45e4652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5dc56a00b5438a9e8f357e996b3acc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:22.436431 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5c7a7b06-b1d4-4349-b754-f61d3ff6db3d tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] 10.222.0.50 "GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769" status: 200 len: 1514 microversion: 2.1 time: 0.188745 Aug 31 16:45:22.437013 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3517/6850] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:22 2022] GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769 => generated 1514 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:23.463931 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-31ea4ce3-efeb-413b-bd50-c8c9bf3b77f0 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:23.464783 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-31ea4ce3-efeb-413b-bd50-c8c9bf3b77f0 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] [instance: 0bee9253-36ea-474b-a4ca-31890040a769] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:23.472725 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31ea4ce3-efeb-413b-bd50-c8c9bf3b77f0 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:23.473225 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31ea4ce3-efeb-413b-bd50-c8c9bf3b77f0 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:23.473649 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31ea4ce3-efeb-413b-bd50-c8c9bf3b77f0 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:23.474389 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31ea4ce3-efeb-413b-bd50-c8c9bf3b77f0 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:23.474851 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31ea4ce3-efeb-413b-bd50-c8c9bf3b77f0 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:23.475275 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31ea4ce3-efeb-413b-bd50-c8c9bf3b77f0 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:23.623628 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-31ea4ce3-efeb-413b-bd50-c8c9bf3b77f0 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69f7326a3fa453a8502b78fe45e4652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5dc56a00b5438a9e8f357e996b3acc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:23.632615 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-31ea4ce3-efeb-413b-bd50-c8c9bf3b77f0 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] 10.222.0.50 "GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769" status: 200 len: 1514 microversion: 2.1 time: 0.172531 Aug 31 16:45:23.633239 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3334/6851] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:23 2022] GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769 => generated 1514 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:24.657301 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-bf206103-bc70-4d14-b68b-f7d387535f75 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:24.657926 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-bf206103-bc70-4d14-b68b-f7d387535f75 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] [instance: 0bee9253-36ea-474b-a4ca-31890040a769] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:24.666167 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bf206103-bc70-4d14-b68b-f7d387535f75 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:24.666683 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bf206103-bc70-4d14-b68b-f7d387535f75 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:24.667130 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bf206103-bc70-4d14-b68b-f7d387535f75 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:24.667852 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bf206103-bc70-4d14-b68b-f7d387535f75 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:24.668442 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bf206103-bc70-4d14-b68b-f7d387535f75 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:24.668875 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bf206103-bc70-4d14-b68b-f7d387535f75 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:24.823161 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-bf206103-bc70-4d14-b68b-f7d387535f75 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69f7326a3fa453a8502b78fe45e4652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5dc56a00b5438a9e8f357e996b3acc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:24.832180 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-bf206103-bc70-4d14-b68b-f7d387535f75 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] 10.222.0.50 "GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769" status: 200 len: 1514 microversion: 2.1 time: 0.179347 Aug 31 16:45:24.832756 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3518/6852] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:24 2022] GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769 => generated 1514 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:45:25.859305 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-89965a7b-9171-4c41-b96e-37a4038eca10 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:25.860397 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-89965a7b-9171-4c41-b96e-37a4038eca10 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] [instance: 0bee9253-36ea-474b-a4ca-31890040a769] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:25.868249 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-89965a7b-9171-4c41-b96e-37a4038eca10 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:25.868731 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-89965a7b-9171-4c41-b96e-37a4038eca10 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:25.869157 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-89965a7b-9171-4c41-b96e-37a4038eca10 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:25.869839 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-89965a7b-9171-4c41-b96e-37a4038eca10 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:25.870329 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-89965a7b-9171-4c41-b96e-37a4038eca10 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:25.870745 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-89965a7b-9171-4c41-b96e-37a4038eca10 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:26.011623 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-89965a7b-9171-4c41-b96e-37a4038eca10 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69f7326a3fa453a8502b78fe45e4652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5dc56a00b5438a9e8f357e996b3acc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:26.020332 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-89965a7b-9171-4c41-b96e-37a4038eca10 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] 10.222.0.50 "GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769" status: 200 len: 1514 microversion: 2.1 time: 0.166576 Aug 31 16:45:26.020925 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3335/6853] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:25 2022] GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769 => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:27.044029 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d1ad2bac-0465-4f98-883b-7073f297a9a1 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:27.044625 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d1ad2bac-0465-4f98-883b-7073f297a9a1 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] [instance: 0bee9253-36ea-474b-a4ca-31890040a769] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:27.054787 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d1ad2bac-0465-4f98-883b-7073f297a9a1 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:27.055486 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d1ad2bac-0465-4f98-883b-7073f297a9a1 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:27.056000 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d1ad2bac-0465-4f98-883b-7073f297a9a1 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:27.056761 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d1ad2bac-0465-4f98-883b-7073f297a9a1 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:27.057444 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d1ad2bac-0465-4f98-883b-7073f297a9a1 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:27.057919 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d1ad2bac-0465-4f98-883b-7073f297a9a1 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:27.200147 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d1ad2bac-0465-4f98-883b-7073f297a9a1 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69f7326a3fa453a8502b78fe45e4652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5dc56a00b5438a9e8f357e996b3acc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:27.208731 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d1ad2bac-0465-4f98-883b-7073f297a9a1 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] 10.222.0.50 "GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769" status: 200 len: 1514 microversion: 2.1 time: 0.170321 Aug 31 16:45:27.209353 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3519/6854] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:27 2022] GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769 => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:28.229971 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c3a4ae11-3073-4696-b09b-0d55abf088a0 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:28.230614 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c3a4ae11-3073-4696-b09b-0d55abf088a0 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] [instance: 0bee9253-36ea-474b-a4ca-31890040a769] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:28.237883 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3a4ae11-3073-4696-b09b-0d55abf088a0 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:28.238401 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3a4ae11-3073-4696-b09b-0d55abf088a0 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:28.238839 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3a4ae11-3073-4696-b09b-0d55abf088a0 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:28.239531 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3a4ae11-3073-4696-b09b-0d55abf088a0 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:28.239984 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3a4ae11-3073-4696-b09b-0d55abf088a0 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:28.240402 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3a4ae11-3073-4696-b09b-0d55abf088a0 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:28.717459 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c3a4ae11-3073-4696-b09b-0d55abf088a0 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69f7326a3fa453a8502b78fe45e4652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5dc56a00b5438a9e8f357e996b3acc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:28.726833 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c3a4ae11-3073-4696-b09b-0d55abf088a0 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] 10.222.0.50 "GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769" status: 200 len: 1514 microversion: 2.1 time: 0.500788 Aug 31 16:45:28.727413 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3336/6855] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:28 2022] GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769 => generated 1514 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:29.754374 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-36f0898b-4146-413b-84d5-15464d492d01 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:29.754998 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-36f0898b-4146-413b-84d5-15464d492d01 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] [instance: 0bee9253-36ea-474b-a4ca-31890040a769] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:29.762618 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-36f0898b-4146-413b-84d5-15464d492d01 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:29.763116 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-36f0898b-4146-413b-84d5-15464d492d01 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:29.763552 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-36f0898b-4146-413b-84d5-15464d492d01 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:29.764255 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-36f0898b-4146-413b-84d5-15464d492d01 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:29.764717 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-36f0898b-4146-413b-84d5-15464d492d01 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:29.765145 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-36f0898b-4146-413b-84d5-15464d492d01 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:29.898122 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-36f0898b-4146-413b-84d5-15464d492d01 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69f7326a3fa453a8502b78fe45e4652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5dc56a00b5438a9e8f357e996b3acc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:29.906832 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-36f0898b-4146-413b-84d5-15464d492d01 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] 10.222.0.50 "GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769" status: 200 len: 1514 microversion: 2.1 time: 0.156550 Aug 31 16:45:29.907708 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3520/6856] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:29 2022] GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:30.931656 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b5a3880c-474c-4bcd-9eb5-264d14174422 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:30.932181 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b5a3880c-474c-4bcd-9eb5-264d14174422 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] [instance: 0bee9253-36ea-474b-a4ca-31890040a769] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:30.939960 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5a3880c-474c-4bcd-9eb5-264d14174422 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:30.940786 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5a3880c-474c-4bcd-9eb5-264d14174422 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:30.941272 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5a3880c-474c-4bcd-9eb5-264d14174422 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:30.941960 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5a3880c-474c-4bcd-9eb5-264d14174422 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:30.942497 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5a3880c-474c-4bcd-9eb5-264d14174422 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:30.942980 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5a3880c-474c-4bcd-9eb5-264d14174422 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:31.091150 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b5a3880c-474c-4bcd-9eb5-264d14174422 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69f7326a3fa453a8502b78fe45e4652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5dc56a00b5438a9e8f357e996b3acc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:31.099619 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b5a3880c-474c-4bcd-9eb5-264d14174422 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] 10.222.0.50 "GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769" status: 200 len: 1514 microversion: 2.1 time: 0.172143 Aug 31 16:45:31.100243 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3337/6857] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:30 2022] GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769 => generated 1514 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:32.121640 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3b007d45-be20-4948-8510-fc28f367eb32 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:32.122224 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3b007d45-be20-4948-8510-fc28f367eb32 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] [instance: 0bee9253-36ea-474b-a4ca-31890040a769] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:32.130131 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3b007d45-be20-4948-8510-fc28f367eb32 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:32.130739 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3b007d45-be20-4948-8510-fc28f367eb32 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:32.131266 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3b007d45-be20-4948-8510-fc28f367eb32 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:32.132016 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3b007d45-be20-4948-8510-fc28f367eb32 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:32.132494 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3b007d45-be20-4948-8510-fc28f367eb32 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:32.132935 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3b007d45-be20-4948-8510-fc28f367eb32 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:32.275082 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3b007d45-be20-4948-8510-fc28f367eb32 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69f7326a3fa453a8502b78fe45e4652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5dc56a00b5438a9e8f357e996b3acc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:32.283239 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3b007d45-be20-4948-8510-fc28f367eb32 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] 10.222.0.50 "GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769" status: 200 len: 1514 microversion: 2.1 time: 0.165845 Aug 31 16:45:32.283914 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3521/6858] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:32 2022] GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:33.305133 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d6efdf47-e87f-4f6a-8bea-c13147b36a6c tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:33.305708 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d6efdf47-e87f-4f6a-8bea-c13147b36a6c tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] [instance: 0bee9253-36ea-474b-a4ca-31890040a769] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:33.313179 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6efdf47-e87f-4f6a-8bea-c13147b36a6c tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:33.313665 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6efdf47-e87f-4f6a-8bea-c13147b36a6c tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:33.314124 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6efdf47-e87f-4f6a-8bea-c13147b36a6c tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:33.314903 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6efdf47-e87f-4f6a-8bea-c13147b36a6c tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:33.315339 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6efdf47-e87f-4f6a-8bea-c13147b36a6c tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:33.315792 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6efdf47-e87f-4f6a-8bea-c13147b36a6c tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:33.452043 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d6efdf47-e87f-4f6a-8bea-c13147b36a6c tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69f7326a3fa453a8502b78fe45e4652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5dc56a00b5438a9e8f357e996b3acc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:33.460495 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d6efdf47-e87f-4f6a-8bea-c13147b36a6c tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] 10.222.0.50 "GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769" status: 200 len: 1514 microversion: 2.1 time: 0.159326 Aug 31 16:45:33.461059 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3338/6859] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:33 2022] GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:34.482242 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-de866e59-763c-4ccd-8357-907fddbfaf22 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:34.482972 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-de866e59-763c-4ccd-8357-907fddbfaf22 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] [instance: 0bee9253-36ea-474b-a4ca-31890040a769] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:34.492716 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-de866e59-763c-4ccd-8357-907fddbfaf22 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:34.493320 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-de866e59-763c-4ccd-8357-907fddbfaf22 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:34.493840 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-de866e59-763c-4ccd-8357-907fddbfaf22 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:34.495016 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-de866e59-763c-4ccd-8357-907fddbfaf22 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:34.495511 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-de866e59-763c-4ccd-8357-907fddbfaf22 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:34.496030 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-de866e59-763c-4ccd-8357-907fddbfaf22 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:34.660627 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-de866e59-763c-4ccd-8357-907fddbfaf22 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69f7326a3fa453a8502b78fe45e4652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5dc56a00b5438a9e8f357e996b3acc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:34.671711 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-de866e59-763c-4ccd-8357-907fddbfaf22 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] 10.222.0.50 "GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769" status: 200 len: 1514 microversion: 2.1 time: 0.194187 Aug 31 16:45:34.672331 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3522/6860] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:34 2022] GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769 => generated 1514 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:35.699247 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-871bccec-27a3-472d-8ed2-6c2ed5717918 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:35.700211 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-871bccec-27a3-472d-8ed2-6c2ed5717918 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] [instance: 0bee9253-36ea-474b-a4ca-31890040a769] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:35.709740 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-871bccec-27a3-472d-8ed2-6c2ed5717918 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:35.710273 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-871bccec-27a3-472d-8ed2-6c2ed5717918 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:35.710711 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-871bccec-27a3-472d-8ed2-6c2ed5717918 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:35.711418 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-871bccec-27a3-472d-8ed2-6c2ed5717918 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:35.711879 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-871bccec-27a3-472d-8ed2-6c2ed5717918 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:35.712304 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-871bccec-27a3-472d-8ed2-6c2ed5717918 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:35.854606 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-871bccec-27a3-472d-8ed2-6c2ed5717918 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69f7326a3fa453a8502b78fe45e4652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5dc56a00b5438a9e8f357e996b3acc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:35.863838 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-871bccec-27a3-472d-8ed2-6c2ed5717918 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] 10.222.0.50 "GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769" status: 200 len: 1514 microversion: 2.1 time: 0.170294 Aug 31 16:45:35.864431 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3339/6861] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:35 2022] GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769 => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:36.885946 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c6662c18-6b92-4825-b83e-6d644cc19631 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:36.886699 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c6662c18-6b92-4825-b83e-6d644cc19631 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] [instance: 0bee9253-36ea-474b-a4ca-31890040a769] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:36.889852 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=32 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:45:36.897410 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c6662c18-6b92-4825-b83e-6d644cc19631 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:36.898107 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c6662c18-6b92-4825-b83e-6d644cc19631 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:36.898667 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c6662c18-6b92-4825-b83e-6d644cc19631 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:36.899529 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c6662c18-6b92-4825-b83e-6d644cc19631 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:36.900051 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c6662c18-6b92-4825-b83e-6d644cc19631 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:36.900724 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c6662c18-6b92-4825-b83e-6d644cc19631 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:36.904959 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:45:37.075363 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c6662c18-6b92-4825-b83e-6d644cc19631 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69f7326a3fa453a8502b78fe45e4652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5dc56a00b5438a9e8f357e996b3acc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:37.084451 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c6662c18-6b92-4825-b83e-6d644cc19631 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] 10.222.0.50 "GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769" status: 200 len: 1514 microversion: 2.1 time: 0.203184 Aug 31 16:45:37.085053 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3523/6862] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:36 2022] GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769 => generated 1514 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:38.107462 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b6a5e6fa-d557-4e85-a6f8-cdec30bdf2ae tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:38.108224 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b6a5e6fa-d557-4e85-a6f8-cdec30bdf2ae tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] [instance: 0bee9253-36ea-474b-a4ca-31890040a769] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:38.112951 n-d-833090-16 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 16:45:38.113110 n-d-833090-16 devstack@n-api.service[128863]: Wed Aug 31 16:45:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769 (ip 10.222.0.50) !!! Aug 31 16:45:38.114429 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=28 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:45:38.122007 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6a5e6fa-d557-4e85-a6f8-cdec30bdf2ae tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:38.122523 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6a5e6fa-d557-4e85-a6f8-cdec30bdf2ae tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:38.123020 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6a5e6fa-d557-4e85-a6f8-cdec30bdf2ae tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:38.123747 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6a5e6fa-d557-4e85-a6f8-cdec30bdf2ae tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:38.124216 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6a5e6fa-d557-4e85-a6f8-cdec30bdf2ae tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:38.124658 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6a5e6fa-d557-4e85-a6f8-cdec30bdf2ae tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:38.129068 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=80 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:45:38.280738 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b6a5e6fa-d557-4e85-a6f8-cdec30bdf2ae tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69f7326a3fa453a8502b78fe45e4652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5dc56a00b5438a9e8f357e996b3acc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:38.292874 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b6a5e6fa-d557-4e85-a6f8-cdec30bdf2ae tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] 10.222.0.50 "GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769" status: 200 len: 1514 microversion: 2.1 time: 0.191207 Aug 31 16:45:38.293480 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3340/6863] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:38 2022] GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769 => generated 1514 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:39.318918 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-031733bc-291a-48c1-9438-1c66c81b08c3 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:39.319538 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-031733bc-291a-48c1-9438-1c66c81b08c3 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] [instance: 0bee9253-36ea-474b-a4ca-31890040a769] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:39.328386 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-031733bc-291a-48c1-9438-1c66c81b08c3 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:39.329063 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-031733bc-291a-48c1-9438-1c66c81b08c3 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:39.329518 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-031733bc-291a-48c1-9438-1c66c81b08c3 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:39.330284 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-031733bc-291a-48c1-9438-1c66c81b08c3 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:39.330751 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-031733bc-291a-48c1-9438-1c66c81b08c3 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:39.331377 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-031733bc-291a-48c1-9438-1c66c81b08c3 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:39.491772 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-031733bc-291a-48c1-9438-1c66c81b08c3 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69f7326a3fa453a8502b78fe45e4652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5dc56a00b5438a9e8f357e996b3acc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:39.500736 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-031733bc-291a-48c1-9438-1c66c81b08c3 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] 10.222.0.50 "GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769" status: 200 len: 1514 microversion: 2.1 time: 0.187209 Aug 31 16:45:39.501241 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3524/6864] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:39 2022] GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769 => generated 1514 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:40.526849 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0c4418a9-80a9-46a2-a8e7-63e5720656c9 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:40.527507 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0c4418a9-80a9-46a2-a8e7-63e5720656c9 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] [instance: 0bee9253-36ea-474b-a4ca-31890040a769] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:40.535192 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c4418a9-80a9-46a2-a8e7-63e5720656c9 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:40.535704 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c4418a9-80a9-46a2-a8e7-63e5720656c9 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:40.536135 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c4418a9-80a9-46a2-a8e7-63e5720656c9 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:40.536840 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c4418a9-80a9-46a2-a8e7-63e5720656c9 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:40.537293 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c4418a9-80a9-46a2-a8e7-63e5720656c9 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:40.537760 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c4418a9-80a9-46a2-a8e7-63e5720656c9 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:40.696250 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0c4418a9-80a9-46a2-a8e7-63e5720656c9 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69f7326a3fa453a8502b78fe45e4652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5dc56a00b5438a9e8f357e996b3acc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:40.705598 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0c4418a9-80a9-46a2-a8e7-63e5720656c9 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] 10.222.0.50 "GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769" status: 200 len: 1514 microversion: 2.1 time: 0.182654 Aug 31 16:45:40.706196 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3341/6865] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:40 2022] GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769 => generated 1514 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:41.540436 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-f7b55b08-7751-4502-bfcf-2b3ac09b0f03 req-3497c079-32ee-4a16-b86e-c2790bde1ccb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bee9253-36ea-474b-a4ca-31890040a769", "name": "network-vif-unplugged", "status": "completed", "tag": "065e13d4-81de-4662-8e49-bd9a406c061b"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:45:41.556229 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-f7b55b08-7751-4502-bfcf-2b3ac09b0f03 req-3497c079-32ee-4a16-b86e-c2790bde1ccb service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:41.556751 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-f7b55b08-7751-4502-bfcf-2b3ac09b0f03 req-3497c079-32ee-4a16-b86e-c2790bde1ccb service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:41.557179 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-f7b55b08-7751-4502-bfcf-2b3ac09b0f03 req-3497c079-32ee-4a16-b86e-c2790bde1ccb service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:41.570623 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-f7b55b08-7751-4502-bfcf-2b3ac09b0f03 req-3497c079-32ee-4a16-b86e-c2790bde1ccb service nova] Creating event network-vif-unplugged:065e13d4-81de-4662-8e49-bd9a406c061b for instance 0bee9253-36ea-474b-a4ca-31890040a769 on n-h1-833090-16 Aug 31 16:45:41.579148 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [req-f7b55b08-7751-4502-bfcf-2b3ac09b0f03 req-3497c079-32ee-4a16-b86e-c2790bde1ccb service nova] Instance 0bee9253-36ea-474b-a4ca-31890040a769 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-833090-16', 'n-h1-833090-16'} {{(pid=128864) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 16:45:41.590720 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-f7b55b08-7751-4502-bfcf-2b3ac09b0f03 req-3497c079-32ee-4a16-b86e-c2790bde1ccb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054735 Aug 31 16:45:41.591522 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3525/6866] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:45:41.730133 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-402cf55b-01e6-4b79-bdcc-a7b295961f7e tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:41.730808 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-402cf55b-01e6-4b79-bdcc-a7b295961f7e tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] [instance: 0bee9253-36ea-474b-a4ca-31890040a769] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:41.739608 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-402cf55b-01e6-4b79-bdcc-a7b295961f7e tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:41.740183 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-402cf55b-01e6-4b79-bdcc-a7b295961f7e tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:41.740703 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-402cf55b-01e6-4b79-bdcc-a7b295961f7e tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:41.741405 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-402cf55b-01e6-4b79-bdcc-a7b295961f7e tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:41.741856 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-402cf55b-01e6-4b79-bdcc-a7b295961f7e tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:41.742302 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-402cf55b-01e6-4b79-bdcc-a7b295961f7e tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:41.886503 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-402cf55b-01e6-4b79-bdcc-a7b295961f7e tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69f7326a3fa453a8502b78fe45e4652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5dc56a00b5438a9e8f357e996b3acc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:41.895002 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-402cf55b-01e6-4b79-bdcc-a7b295961f7e tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] 10.222.0.50 "GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769" status: 200 len: 1513 microversion: 2.1 time: 0.168929 Aug 31 16:45:41.895576 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3342/6867] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:41 2022] GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769 => generated 1513 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:42.920656 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9b8c923f-b08d-4ffc-99d9-736a0ce13c1f tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:42.921413 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9b8c923f-b08d-4ffc-99d9-736a0ce13c1f tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] [instance: 0bee9253-36ea-474b-a4ca-31890040a769] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:42.930010 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9b8c923f-b08d-4ffc-99d9-736a0ce13c1f tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:42.930669 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9b8c923f-b08d-4ffc-99d9-736a0ce13c1f tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:42.931192 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9b8c923f-b08d-4ffc-99d9-736a0ce13c1f tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:42.932083 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9b8c923f-b08d-4ffc-99d9-736a0ce13c1f tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:42.932665 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9b8c923f-b08d-4ffc-99d9-736a0ce13c1f tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:42.933208 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9b8c923f-b08d-4ffc-99d9-736a0ce13c1f tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:43.083176 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9b8c923f-b08d-4ffc-99d9-736a0ce13c1f tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69f7326a3fa453a8502b78fe45e4652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5dc56a00b5438a9e8f357e996b3acc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:43.091461 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9b8c923f-b08d-4ffc-99d9-736a0ce13c1f tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] 10.222.0.50 "GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769" status: 200 len: 1511 microversion: 2.1 time: 0.177502 Aug 31 16:45:43.092012 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3526/6868] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:42 2022] GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769 => generated 1511 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:43.613359 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-12675207-7f82-4252-b48a-941b058e57e8 req-1ea7431d-c48f-404e-98a7-d9f9ac9d9554 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bee9253-36ea-474b-a4ca-31890040a769", "tag": "065e13d4-81de-4662-8e49-bd9a406c061b"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:45:43.623742 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-12675207-7f82-4252-b48a-941b058e57e8 req-1ea7431d-c48f-404e-98a7-d9f9ac9d9554 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:43.624184 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-12675207-7f82-4252-b48a-941b058e57e8 req-1ea7431d-c48f-404e-98a7-d9f9ac9d9554 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:43.624786 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-12675207-7f82-4252-b48a-941b058e57e8 req-1ea7431d-c48f-404e-98a7-d9f9ac9d9554 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:43.638748 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-12675207-7f82-4252-b48a-941b058e57e8 req-1ea7431d-c48f-404e-98a7-d9f9ac9d9554 service nova] Creating event network-changed:065e13d4-81de-4662-8e49-bd9a406c061b for instance 0bee9253-36ea-474b-a4ca-31890040a769 on n-h1-833090-16 Aug 31 16:45:43.647021 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [req-12675207-7f82-4252-b48a-941b058e57e8 req-1ea7431d-c48f-404e-98a7-d9f9ac9d9554 service nova] Instance 0bee9253-36ea-474b-a4ca-31890040a769 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-833090-16', 'n-h1-833090-16'} {{(pid=128863) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 16:45:43.658970 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-12675207-7f82-4252-b48a-941b058e57e8 req-1ea7431d-c48f-404e-98a7-d9f9ac9d9554 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050459 Aug 31 16:45:43.659677 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3343/6869] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:45:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:45:44.113376 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a395aa61-dae0-4108-ac56-55470efa7351 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:44.113977 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a395aa61-dae0-4108-ac56-55470efa7351 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] [instance: 0bee9253-36ea-474b-a4ca-31890040a769] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:44.121402 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a395aa61-dae0-4108-ac56-55470efa7351 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:44.121891 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a395aa61-dae0-4108-ac56-55470efa7351 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:44.122390 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a395aa61-dae0-4108-ac56-55470efa7351 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:44.123069 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a395aa61-dae0-4108-ac56-55470efa7351 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:44.123491 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a395aa61-dae0-4108-ac56-55470efa7351 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:44.123951 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a395aa61-dae0-4108-ac56-55470efa7351 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:44.258019 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a395aa61-dae0-4108-ac56-55470efa7351 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69f7326a3fa453a8502b78fe45e4652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5dc56a00b5438a9e8f357e996b3acc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:44.266278 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a395aa61-dae0-4108-ac56-55470efa7351 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] 10.222.0.50 "GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769" status: 200 len: 1508 microversion: 2.1 time: 0.157184 Aug 31 16:45:44.266841 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3527/6870] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:44 2022] GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:44.288651 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c536c810-0ac5-41f6-876b-e10cc58518e3 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:44.289368 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c536c810-0ac5-41f6-876b-e10cc58518e3 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] [instance: 0bee9253-36ea-474b-a4ca-31890040a769] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:44.295968 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c536c810-0ac5-41f6-876b-e10cc58518e3 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:44.296461 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c536c810-0ac5-41f6-876b-e10cc58518e3 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:44.296872 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c536c810-0ac5-41f6-876b-e10cc58518e3 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:44.297568 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c536c810-0ac5-41f6-876b-e10cc58518e3 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:44.298022 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c536c810-0ac5-41f6-876b-e10cc58518e3 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:44.298479 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c536c810-0ac5-41f6-876b-e10cc58518e3 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:44.326874 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c536c810-0ac5-41f6-876b-e10cc58518e3 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] [instance: 0bee9253-36ea-474b-a4ca-31890040a769] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:45:44.385013 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.compute.api [None req-c536c810-0ac5-41f6-876b-e10cc58518e3 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] [instance: 0bee9253-36ea-474b-a4ca-31890040a769] Found an unconfirmed migration during delete, id: 16, status: finished Aug 31 16:45:46.581856 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c536c810-0ac5-41f6-876b-e10cc58518e3 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769" status: 204 len: 0 microversion: 2.1 time: 2.297155 Aug 31 16:45:46.582827 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3344/6871] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:45:44 2022] DELETE /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769 => generated 0 bytes in 2300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:45:46.593191 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3412e6e6-bffd-45bd-8e3d-190714e9f9bd tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:46.594505 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3412e6e6-bffd-45bd-8e3d-190714e9f9bd tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] [instance: 0bee9253-36ea-474b-a4ca-31890040a769] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:46.604486 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3412e6e6-bffd-45bd-8e3d-190714e9f9bd tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:46.605329 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3412e6e6-bffd-45bd-8e3d-190714e9f9bd tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:46.605782 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3412e6e6-bffd-45bd-8e3d-190714e9f9bd tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:46.606554 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3412e6e6-bffd-45bd-8e3d-190714e9f9bd tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:46.607029 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3412e6e6-bffd-45bd-8e3d-190714e9f9bd tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:46.607468 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3412e6e6-bffd-45bd-8e3d-190714e9f9bd tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:46.749927 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3412e6e6-bffd-45bd-8e3d-190714e9f9bd tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69f7326a3fa453a8502b78fe45e4652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5dc56a00b5438a9e8f357e996b3acc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:46.759299 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3412e6e6-bffd-45bd-8e3d-190714e9f9bd tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] 10.222.0.50 "GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769" status: 200 len: 1500 microversion: 2.1 time: 0.170205 Aug 31 16:45:46.759879 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3528/6872] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:46 2022] GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769 => generated 1500 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:47.782152 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9e0d8ca8-f573-4122-88e7-b80f4f958ca3 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:47.782919 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9e0d8ca8-f573-4122-88e7-b80f4f958ca3 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] [instance: 0bee9253-36ea-474b-a4ca-31890040a769] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:47.791420 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e0d8ca8-f573-4122-88e7-b80f4f958ca3 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:47.791899 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e0d8ca8-f573-4122-88e7-b80f4f958ca3 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:47.792333 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e0d8ca8-f573-4122-88e7-b80f4f958ca3 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:47.793072 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e0d8ca8-f573-4122-88e7-b80f4f958ca3 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:47.793485 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e0d8ca8-f573-4122-88e7-b80f4f958ca3 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:47.793883 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9e0d8ca8-f573-4122-88e7-b80f4f958ca3 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:47.941492 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9e0d8ca8-f573-4122-88e7-b80f4f958ca3 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a69f7326a3fa453a8502b78fe45e4652', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5dc56a00b5438a9e8f357e996b3acc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:47.950309 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9e0d8ca8-f573-4122-88e7-b80f4f958ca3 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] 10.222.0.50 "GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769" status: 200 len: 1500 microversion: 2.1 time: 0.172489 Aug 31 16:45:47.951399 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3345/6873] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:47 2022] GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769 => generated 1500 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:45:48.016035 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-3afbd724-c50d-4d5d-b3d0-a0a98228af7e req-d94142c8-ec28-4ae1-983e-ee73766a5b51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bee9253-36ea-474b-a4ca-31890040a769", "name": "network-vif-plugged", "status": "completed", "tag": "065e13d4-81de-4662-8e49-bd9a406c061b"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:45:48.026970 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-3afbd724-c50d-4d5d-b3d0-a0a98228af7e req-d94142c8-ec28-4ae1-983e-ee73766a5b51 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:48.027460 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-3afbd724-c50d-4d5d-b3d0-a0a98228af7e req-d94142c8-ec28-4ae1-983e-ee73766a5b51 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:48.027876 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-3afbd724-c50d-4d5d-b3d0-a0a98228af7e req-d94142c8-ec28-4ae1-983e-ee73766a5b51 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:48.040785 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-3afbd724-c50d-4d5d-b3d0-a0a98228af7e req-d94142c8-ec28-4ae1-983e-ee73766a5b51 service nova] Creating event network-vif-plugged:065e13d4-81de-4662-8e49-bd9a406c061b for instance 0bee9253-36ea-474b-a4ca-31890040a769 on n-h1-833090-16 Aug 31 16:45:48.045975 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-3afbd724-c50d-4d5d-b3d0-a0a98228af7e req-d94142c8-ec28-4ae1-983e-ee73766a5b51 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034676 Aug 31 16:45:48.046782 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3529/6874] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:45:48.384963 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-ff31db0e-f8ef-4787-8e29-c822abfe205e req-ba015bb6-43b7-4fd7-9267-1f7988e744d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bee9253-36ea-474b-a4ca-31890040a769", "name": "network-vif-deleted", "tag": "065e13d4-81de-4662-8e49-bd9a406c061b"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:45:48.398957 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ff31db0e-f8ef-4787-8e29-c822abfe205e req-ba015bb6-43b7-4fd7-9267-1f7988e744d5 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:48.399657 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ff31db0e-f8ef-4787-8e29-c822abfe205e req-ba015bb6-43b7-4fd7-9267-1f7988e744d5 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:48.400269 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ff31db0e-f8ef-4787-8e29-c822abfe205e req-ba015bb6-43b7-4fd7-9267-1f7988e744d5 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:48.417183 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-ff31db0e-f8ef-4787-8e29-c822abfe205e req-ba015bb6-43b7-4fd7-9267-1f7988e744d5 service nova] Creating event network-vif-deleted:065e13d4-81de-4662-8e49-bd9a406c061b for instance 0bee9253-36ea-474b-a4ca-31890040a769 on n-h1-833090-16 Aug 31 16:45:48.427340 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-ff31db0e-f8ef-4787-8e29-c822abfe205e req-ba015bb6-43b7-4fd7-9267-1f7988e744d5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046609 Aug 31 16:45:48.428315 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3346/6875] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:45:48.975429 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a1d80097-3334-47e0-8037-0b6c431734d1 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:48.976161 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a1d80097-3334-47e0-8037-0b6c431734d1 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] [instance: 0bee9253-36ea-474b-a4ca-31890040a769] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:48.983273 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a1d80097-3334-47e0-8037-0b6c431734d1 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:48.983807 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a1d80097-3334-47e0-8037-0b6c431734d1 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:48.984257 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a1d80097-3334-47e0-8037-0b6c431734d1 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:48.984969 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a1d80097-3334-47e0-8037-0b6c431734d1 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:48.985467 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a1d80097-3334-47e0-8037-0b6c431734d1 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:48.985907 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a1d80097-3334-47e0-8037-0b6c431734d1 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:49.000605 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-a1d80097-3334-47e0-8037-0b6c431734d1 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] HTTP exception thrown: Instance 0bee9253-36ea-474b-a4ca-31890040a769 could not be found. Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a1d80097-3334-47e0-8037-0b6c431734d1 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Request method failure captured: Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769 HTTP/1.1 Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD5AKpJS4SV4V0N-AGwfZMartbsQZ-ZMzqBGUu4GQUBdZEF3pdW-BnilRlyj3d4ZwfI-pRK_OGPUSqXdnsSEf-Gss7mGyBDWPzMEnBpCCuF5pOZOYx8PDNd3u9GFQITMfo0VAiVW0XcfxyHJC-KltOHvwt5Ts2-yFSctT0haLFVjbgEY Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 0e5dc56a00b5438a9e8f357e996b3acc Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-DeleteServersTestJSON-1967794002 Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0e5dc56a00b5438a9e8f357e996b3acc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0e5dc56a00b5438a9e8f357e996b3acc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0e5dc56a00b5438a9e8f357e996b3acc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0e5dc56a00b5438a9e8f357e996b3acc", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-DeleteServersTestJSON-1967794002 Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 0e5dc56a00b5438a9e8f357e996b3acc Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-DeleteServersTestJSON-1967794002 Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-DeleteServersTestJSON-1967794002-project Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: a69f7326a3fa453a8502b78fe45e4652 Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-DeleteServersTestJSON-1967794002-project Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 0bee9253-36ea-474b-a4ca-31890040a769 could not be found. Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '0bee9253-36ea-474b-a4ca-31890040a769'} Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bee9253-36ea-474b-a4ca-31890040a769 could not be found. Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bee9253-36ea-474b-a4ca-31890040a769 could not be found. Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:45:49.002368 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:45:49.006437 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:45:49.006437 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:45:49.006437 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:45:49.006437 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:45:49.006437 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:45:49.006437 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bee9253-36ea-474b-a4ca-31890040a769 could not be found. Aug 31 16:45:49.006437 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:45:49.006437 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a1d80097-3334-47e0-8037-0b6c431734d1 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Returning 404 to user: Instance 0bee9253-36ea-474b-a4ca-31890040a769 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:45:49.006437 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a1d80097-3334-47e0-8037-0b6c431734d1 tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] 10.222.0.50 "GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769" status: 404 len: 111 microversion: 2.1 time: 0.033476 Aug 31 16:45:49.006437 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3530/6876] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:48 2022] GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:45:49.026375 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-02fde0b5-e1a9-4950-bdf2-5bd2f63e50bf tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:49.027706 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-02fde0b5-e1a9-4950-bdf2-5bd2f63e50bf tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] [instance: 0bee9253-36ea-474b-a4ca-31890040a769] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:49.036678 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02fde0b5-e1a9-4950-bdf2-5bd2f63e50bf tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:49.037161 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02fde0b5-e1a9-4950-bdf2-5bd2f63e50bf tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:49.037591 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02fde0b5-e1a9-4950-bdf2-5bd2f63e50bf tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:49.038305 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02fde0b5-e1a9-4950-bdf2-5bd2f63e50bf tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:49.038751 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02fde0b5-e1a9-4950-bdf2-5bd2f63e50bf tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:49.039182 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02fde0b5-e1a9-4950-bdf2-5bd2f63e50bf tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:49.053355 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-02fde0b5-e1a9-4950-bdf2-5bd2f63e50bf tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] HTTP exception thrown: Instance 0bee9253-36ea-474b-a4ca-31890040a769 could not be found. Aug 31 16:45:49.054989 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-02fde0b5-e1a9-4950-bdf2-5bd2f63e50bf tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Request method failure captured: Aug 31 16:45:49.054989 n-d-833090-16 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769 HTTP/1.1 Aug 31 16:45:49.054989 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:45:49.054989 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:45:49.054989 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:45:49.054989 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:45:49.054989 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:45:49.054989 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:45:49.054989 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:45:49.054989 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:45:49.054989 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD5AKpJS4SV4V0N-AGwfZMartbsQZ-ZMzqBGUu4GQUBdZEF3pdW-BnilRlyj3d4ZwfI-pRK_OGPUSqXdnsSEf-Gss7mGyBDWPzMEnBpCCuF5pOZOYx8PDNd3u9GFQITMfo0VAiVW0XcfxyHJC-KltOHvwt5Ts2-yFSctT0haLFVjbgEY Aug 31 16:45:49.054989 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:45:49.054989 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:45:49.054989 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:45:49.054989 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:45:49.054989 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:45:49.054989 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:45:49.054989 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 0e5dc56a00b5438a9e8f357e996b3acc Aug 31 16:45:49.054989 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-DeleteServersTestJSON-1967794002 Aug 31 16:45:49.054989 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:45:49.054989 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:45:49.054989 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0e5dc56a00b5438a9e8f357e996b3acc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0e5dc56a00b5438a9e8f357e996b3acc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0e5dc56a00b5438a9e8f357e996b3acc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0e5dc56a00b5438a9e8f357e996b3acc", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:45:49.054989 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-DeleteServersTestJSON-1967794002 Aug 31 16:45:49.054989 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 0e5dc56a00b5438a9e8f357e996b3acc Aug 31 16:45:49.054989 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-DeleteServersTestJSON-1967794002 Aug 31 16:45:49.054989 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-DeleteServersTestJSON-1967794002-project Aug 31 16:45:49.054989 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:45:49.054989 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:45:49.054989 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: a69f7326a3fa453a8502b78fe45e4652 Aug 31 16:45:49.054989 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-DeleteServersTestJSON-1967794002-project Aug 31 16:45:49.054989 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:45:49.054989 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 0bee9253-36ea-474b-a4ca-31890040a769 could not be found. Aug 31 16:45:49.054989 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '0bee9253-36ea-474b-a4ca-31890040a769'} Aug 31 16:45:49.054989 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:45:49.054989 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:45:49.054989 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:45:49.054989 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:45:49.054989 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:45:49.054989 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:45:49.054989 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:45:49.054989 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:45:49.054989 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:45:49.054989 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:45:49.054989 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bee9253-36ea-474b-a4ca-31890040a769 could not be found. Aug 31 16:45:49.054989 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:45:49.054989 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:45:49.054989 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:45:49.054989 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:45:49.054989 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:45:49.054989 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:45:49.054989 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:45:49.054989 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:45:49.054989 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:45:49.054989 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:45:49.054989 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:45:49.054989 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:45:49.054989 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:45:49.054989 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:45:49.054989 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:45:49.054989 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:45:49.054989 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:45:49.054989 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:45:49.059070 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bee9253-36ea-474b-a4ca-31890040a769 could not be found. Aug 31 16:45:49.059070 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:45:49.059070 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:45:49.059070 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:45:49.059070 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:45:49.059070 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:45:49.059070 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:45:49.059070 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:45:49.059070 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:45:49.059070 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bee9253-36ea-474b-a4ca-31890040a769 could not be found. Aug 31 16:45:49.059070 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:45:49.059070 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-02fde0b5-e1a9-4950-bdf2-5bd2f63e50bf tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Returning 404 to user: Instance 0bee9253-36ea-474b-a4ca-31890040a769 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:45:49.059070 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-02fde0b5-e1a9-4950-bdf2-5bd2f63e50bf tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769" status: 404 len: 111 microversion: 2.1 time: 0.036975 Aug 31 16:45:49.059070 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3347/6877] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:45:49 2022] DELETE /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:45:49.065799 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-54d99fed-e62c-4fb0-befe-87e43276052a tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:49.066482 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-54d99fed-e62c-4fb0-befe-87e43276052a tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] [instance: 0bee9253-36ea-474b-a4ca-31890040a769] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:49.073515 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-54d99fed-e62c-4fb0-befe-87e43276052a tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:49.074008 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-54d99fed-e62c-4fb0-befe-87e43276052a tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:49.074478 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-54d99fed-e62c-4fb0-befe-87e43276052a tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:49.075171 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-54d99fed-e62c-4fb0-befe-87e43276052a tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:49.075661 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-54d99fed-e62c-4fb0-befe-87e43276052a tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:49.076094 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-54d99fed-e62c-4fb0-befe-87e43276052a tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:49.093809 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-54d99fed-e62c-4fb0-befe-87e43276052a tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] HTTP exception thrown: Instance 0bee9253-36ea-474b-a4ca-31890040a769 could not be found. Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-54d99fed-e62c-4fb0-befe-87e43276052a tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Request method failure captured: Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769 HTTP/1.1 Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD5AKpJS4SV4V0N-AGwfZMartbsQZ-ZMzqBGUu4GQUBdZEF3pdW-BnilRlyj3d4ZwfI-pRK_OGPUSqXdnsSEf-Gss7mGyBDWPzMEnBpCCuF5pOZOYx8PDNd3u9GFQITMfo0VAiVW0XcfxyHJC-KltOHvwt5Ts2-yFSctT0haLFVjbgEY Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 0e5dc56a00b5438a9e8f357e996b3acc Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-DeleteServersTestJSON-1967794002 Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0e5dc56a00b5438a9e8f357e996b3acc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0e5dc56a00b5438a9e8f357e996b3acc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0e5dc56a00b5438a9e8f357e996b3acc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0e5dc56a00b5438a9e8f357e996b3acc", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-DeleteServersTestJSON-1967794002 Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 0e5dc56a00b5438a9e8f357e996b3acc Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-DeleteServersTestJSON-1967794002 Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-DeleteServersTestJSON-1967794002-project Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: a69f7326a3fa453a8502b78fe45e4652 Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-DeleteServersTestJSON-1967794002-project Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 0bee9253-36ea-474b-a4ca-31890040a769 could not be found. Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '0bee9253-36ea-474b-a4ca-31890040a769'} Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bee9253-36ea-474b-a4ca-31890040a769 could not be found. Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bee9253-36ea-474b-a4ca-31890040a769 could not be found. Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:45:49.095403 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:45:49.099816 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:45:49.099816 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:45:49.099816 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:45:49.099816 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:45:49.099816 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:45:49.099816 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bee9253-36ea-474b-a4ca-31890040a769 could not be found. Aug 31 16:45:49.099816 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:45:49.099816 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-54d99fed-e62c-4fb0-befe-87e43276052a tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] Returning 404 to user: Instance 0bee9253-36ea-474b-a4ca-31890040a769 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:45:49.099816 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-54d99fed-e62c-4fb0-befe-87e43276052a tempest-DeleteServersTestJSON-1967794002 tempest-DeleteServersTestJSON-1967794002-project] 10.222.0.50 "GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769" status: 404 len: 111 microversion: 2.1 time: 0.035174 Aug 31 16:45:49.099816 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3531/6878] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:49 2022] GET /compute/v2.1/servers/0bee9253-36ea-474b-a4ca-31890040a769 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:45:58.464641 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c9bf3d19-e86a-4d28-902e-532ec8c5332e tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-125933358", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "f8703b94-40b6-44a6-b14b-c7ac4ae91e4a"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:45:58.523399 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-c9bf3d19-e86a-4d28-902e-532ec8c5332e tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] validate_networks() for [('f8703b94-40b6-44a6-b14b-c7ac4ae91e4a', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:45:58.937311 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-c9bf3d19-e86a-4d28-902e-532ec8c5332e tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:45:58.937730 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-c9bf3d19-e86a-4d28-902e-532ec8c5332e tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:45:58.938226 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-c9bf3d19-e86a-4d28-902e-532ec8c5332e tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:45:58.938633 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-c9bf3d19-e86a-4d28-902e-532ec8c5332e tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:45:58.939053 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-c9bf3d19-e86a-4d28-902e-532ec8c5332e tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:45:58.948669 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9bf3d19-e86a-4d28-902e-532ec8c5332e tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:58.949137 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9bf3d19-e86a-4d28-902e-532ec8c5332e tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:58.949566 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9bf3d19-e86a-4d28-902e-532ec8c5332e tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:58.950309 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9bf3d19-e86a-4d28-902e-532ec8c5332e tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:45:58.950759 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9bf3d19-e86a-4d28-902e-532ec8c5332e tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:45:58.951177 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c9bf3d19-e86a-4d28-902e-532ec8c5332e tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:45:58.969396 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-c9bf3d19-e86a-4d28-902e-532ec8c5332e tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Getting quotas for project cf84b19774134ccaaf8f80c6c6bacf9c. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:45:58.975115 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-c9bf3d19-e86a-4d28-902e-532ec8c5332e tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Getting quotas for user 5181164c428d4e38afc8d8195f730ed4 and project cf84b19774134ccaaf8f80c6c6bacf9c. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:45:58.989871 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c9bf3d19-e86a-4d28-902e-532ec8c5332e tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:45:58.992252 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c9bf3d19-e86a-4d28-902e-532ec8c5332e tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:45:59.041424 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c9bf3d19-e86a-4d28-902e-532ec8c5332e tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.712120 Aug 31 16:45:59.047849 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3348/6879] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:45:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:45:59.053471 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-189ca5c1-9e54-4558-b1f8-ec019ba894b0 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:45:59.054084 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-189ca5c1-9e54-4558-b1f8-ec019ba894b0 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:45:59.090418 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=39 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:45:59.113747 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-189ca5c1-9e54-4558-b1f8-ec019ba894b0 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:45:59.121054 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-189ca5c1-9e54-4558-b1f8-ec019ba894b0 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90" status: 200 len: 1217 microversion: 2.1 time: 0.071752 Aug 31 16:45:59.122343 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3532/6880] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:45:59 2022] GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90 => generated 1217 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:00.143327 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-edbc9d62-d3f0-40a1-aa92-8d1c2872cf0d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:00.143918 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-edbc9d62-d3f0-40a1-aa92-8d1c2872cf0d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:00.152328 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-edbc9d62-d3f0-40a1-aa92-8d1c2872cf0d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:00.152815 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-edbc9d62-d3f0-40a1-aa92-8d1c2872cf0d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:00.153247 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-edbc9d62-d3f0-40a1-aa92-8d1c2872cf0d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:00.153952 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-edbc9d62-d3f0-40a1-aa92-8d1c2872cf0d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:00.154439 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-edbc9d62-d3f0-40a1-aa92-8d1c2872cf0d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:00.154862 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-edbc9d62-d3f0-40a1-aa92-8d1c2872cf0d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:00.237775 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-edbc9d62-d3f0-40a1-aa92-8d1c2872cf0d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:00.247696 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-edbc9d62-d3f0-40a1-aa92-8d1c2872cf0d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90" status: 200 len: 1269 microversion: 2.1 time: 0.108269 Aug 31 16:46:00.261215 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3349/6881] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:00 2022] GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90 => generated 1269 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:01.269598 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ab464523-3c59-4694-855d-b153973c1dc5 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:01.270537 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ab464523-3c59-4694-855d-b153973c1dc5 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:01.278436 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ab464523-3c59-4694-855d-b153973c1dc5 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:01.279384 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ab464523-3c59-4694-855d-b153973c1dc5 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:01.280667 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ab464523-3c59-4694-855d-b153973c1dc5 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:01.282284 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ab464523-3c59-4694-855d-b153973c1dc5 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:01.283590 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ab464523-3c59-4694-855d-b153973c1dc5 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:01.284242 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ab464523-3c59-4694-855d-b153973c1dc5 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:01.465455 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ab464523-3c59-4694-855d-b153973c1dc5 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:01.475330 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ab464523-3c59-4694-855d-b153973c1dc5 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90" status: 200 len: 1317 microversion: 2.1 time: 0.209710 Aug 31 16:46:01.490333 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3533/6882] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:01 2022] GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90 => generated 1317 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:01.711055 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-d5c998d3-836c-463c-bd89-4a975eda8631 req-ccb6bd79-3117-4094-a628-abd9e99a5104 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82b2210a-de3a-48bd-866d-cf681ad8cd90", "tag": "771e6f5e-f80b-4582-b76c-9d722e34dfda"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:46:01.723967 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d5c998d3-836c-463c-bd89-4a975eda8631 req-ccb6bd79-3117-4094-a628-abd9e99a5104 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:01.724844 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d5c998d3-836c-463c-bd89-4a975eda8631 req-ccb6bd79-3117-4094-a628-abd9e99a5104 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:01.725498 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d5c998d3-836c-463c-bd89-4a975eda8631 req-ccb6bd79-3117-4094-a628-abd9e99a5104 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:01.737870 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-d5c998d3-836c-463c-bd89-4a975eda8631 req-ccb6bd79-3117-4094-a628-abd9e99a5104 service nova] Creating event network-changed:771e6f5e-f80b-4582-b76c-9d722e34dfda for instance 82b2210a-de3a-48bd-866d-cf681ad8cd90 on n-h2-833090-16 Aug 31 16:46:01.743126 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-d5c998d3-836c-463c-bd89-4a975eda8631 req-ccb6bd79-3117-4094-a628-abd9e99a5104 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035805 Aug 31 16:46:01.743962 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3350/6883] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:46:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:46:02.499776 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-569a86d0-f064-47c0-af9e-4160f5702039 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:02.500628 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-569a86d0-f064-47c0-af9e-4160f5702039 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:02.510695 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-569a86d0-f064-47c0-af9e-4160f5702039 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:02.511446 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-569a86d0-f064-47c0-af9e-4160f5702039 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:02.512087 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-569a86d0-f064-47c0-af9e-4160f5702039 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:02.513213 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-569a86d0-f064-47c0-af9e-4160f5702039 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:02.513930 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-569a86d0-f064-47c0-af9e-4160f5702039 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:02.514569 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-569a86d0-f064-47c0-af9e-4160f5702039 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:02.662946 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-569a86d0-f064-47c0-af9e-4160f5702039 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:02.675089 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-569a86d0-f064-47c0-af9e-4160f5702039 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90" status: 200 len: 1317 microversion: 2.1 time: 0.180982 Aug 31 16:46:02.675679 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3534/6884] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:02 2022] GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90 => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:03.698517 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3263c710-b4c4-4e89-9d4f-ab41c94bf79a tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:03.699058 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3263c710-b4c4-4e89-9d4f-ab41c94bf79a tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:03.706045 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3263c710-b4c4-4e89-9d4f-ab41c94bf79a tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:03.706599 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3263c710-b4c4-4e89-9d4f-ab41c94bf79a tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:03.707028 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3263c710-b4c4-4e89-9d4f-ab41c94bf79a tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:03.707752 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3263c710-b4c4-4e89-9d4f-ab41c94bf79a tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:03.708203 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3263c710-b4c4-4e89-9d4f-ab41c94bf79a tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:03.708622 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3263c710-b4c4-4e89-9d4f-ab41c94bf79a tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:03.853003 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3263c710-b4c4-4e89-9d4f-ab41c94bf79a tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:03.865864 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3263c710-b4c4-4e89-9d4f-ab41c94bf79a tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90" status: 200 len: 1317 microversion: 2.1 time: 0.172617 Aug 31 16:46:03.866799 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3351/6885] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:03 2022] GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90 => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:04.891411 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-94356d7d-5050-490b-905b-6b8c463c90aa tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:04.892053 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-94356d7d-5050-490b-905b-6b8c463c90aa tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:04.899970 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-94356d7d-5050-490b-905b-6b8c463c90aa tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:04.900504 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-94356d7d-5050-490b-905b-6b8c463c90aa tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:04.900927 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-94356d7d-5050-490b-905b-6b8c463c90aa tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:04.901644 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-94356d7d-5050-490b-905b-6b8c463c90aa tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:04.902121 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-94356d7d-5050-490b-905b-6b8c463c90aa tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:04.902567 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-94356d7d-5050-490b-905b-6b8c463c90aa tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:05.068955 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-94356d7d-5050-490b-905b-6b8c463c90aa tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:05.077142 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-94356d7d-5050-490b-905b-6b8c463c90aa tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90" status: 200 len: 1317 microversion: 2.1 time: 0.189808 Aug 31 16:46:05.077707 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3535/6886] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:04 2022] GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90 => generated 1317 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:06.107202 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-46ad8375-7660-4026-b2d4-8299d77cffc0 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:06.108089 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-46ad8375-7660-4026-b2d4-8299d77cffc0 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:06.118038 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46ad8375-7660-4026-b2d4-8299d77cffc0 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:06.118767 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46ad8375-7660-4026-b2d4-8299d77cffc0 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:06.119387 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46ad8375-7660-4026-b2d4-8299d77cffc0 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:06.120358 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46ad8375-7660-4026-b2d4-8299d77cffc0 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:06.120987 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46ad8375-7660-4026-b2d4-8299d77cffc0 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:06.121580 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46ad8375-7660-4026-b2d4-8299d77cffc0 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:06.257743 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-46ad8375-7660-4026-b2d4-8299d77cffc0 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:06.265947 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-46ad8375-7660-4026-b2d4-8299d77cffc0 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90" status: 200 len: 1317 microversion: 2.1 time: 0.163986 Aug 31 16:46:06.266591 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3352/6887] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:06 2022] GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:07.288194 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7aeb685d-8417-4184-9a92-00ec1e5501ba tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:07.289004 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7aeb685d-8417-4184-9a92-00ec1e5501ba tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:07.291488 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=28 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:46:07.298328 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7aeb685d-8417-4184-9a92-00ec1e5501ba tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:07.298933 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7aeb685d-8417-4184-9a92-00ec1e5501ba tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:07.299710 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7aeb685d-8417-4184-9a92-00ec1e5501ba tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:07.300524 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7aeb685d-8417-4184-9a92-00ec1e5501ba tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:07.301004 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7aeb685d-8417-4184-9a92-00ec1e5501ba tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:07.301446 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7aeb685d-8417-4184-9a92-00ec1e5501ba tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:07.301560 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-6ee31b7f-cc15-4a77-9ab0-d8de93ba6cfa req-e42339c7-2776-471b-818d-5f9c67df3c83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82b2210a-de3a-48bd-866d-cf681ad8cd90", "name": "network-vif-plugged", "status": "completed", "tag": "771e6f5e-f80b-4582-b76c-9d722e34dfda"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:46:07.312447 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-6ee31b7f-cc15-4a77-9ab0-d8de93ba6cfa req-e42339c7-2776-471b-818d-5f9c67df3c83 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:07.313305 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-6ee31b7f-cc15-4a77-9ab0-d8de93ba6cfa req-e42339c7-2776-471b-818d-5f9c67df3c83 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:07.313914 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-6ee31b7f-cc15-4a77-9ab0-d8de93ba6cfa req-e42339c7-2776-471b-818d-5f9c67df3c83 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:07.331362 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-6ee31b7f-cc15-4a77-9ab0-d8de93ba6cfa req-e42339c7-2776-471b-818d-5f9c67df3c83 service nova] Creating event network-vif-plugged:771e6f5e-f80b-4582-b76c-9d722e34dfda for instance 82b2210a-de3a-48bd-866d-cf681ad8cd90 on n-h2-833090-16 Aug 31 16:46:07.337154 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-6ee31b7f-cc15-4a77-9ab0-d8de93ba6cfa req-e42339c7-2776-471b-818d-5f9c67df3c83 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039582 Aug 31 16:46:07.337758 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3353/6888] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:46:07.459649 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7aeb685d-8417-4184-9a92-00ec1e5501ba tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:07.468528 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7aeb685d-8417-4184-9a92-00ec1e5501ba tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90" status: 200 len: 1317 microversion: 2.1 time: 0.184619 Aug 31 16:46:07.469716 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3536/6889] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:07 2022] GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90 => generated 1317 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:08.491241 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9f652781-1e2e-4ab0-95e1-ef138d223771 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:08.491961 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9f652781-1e2e-4ab0-95e1-ef138d223771 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:08.493920 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:46:08.499933 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f652781-1e2e-4ab0-95e1-ef138d223771 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:08.500417 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f652781-1e2e-4ab0-95e1-ef138d223771 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:08.500849 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f652781-1e2e-4ab0-95e1-ef138d223771 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:08.501688 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f652781-1e2e-4ab0-95e1-ef138d223771 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:08.502031 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f652781-1e2e-4ab0-95e1-ef138d223771 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:08.502469 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f652781-1e2e-4ab0-95e1-ef138d223771 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:08.508214 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:46:08.651764 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9f652781-1e2e-4ab0-95e1-ef138d223771 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:08.663433 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9f652781-1e2e-4ab0-95e1-ef138d223771 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90" status: 200 len: 1317 microversion: 2.1 time: 0.177166 Aug 31 16:46:08.664231 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3354/6890] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:08 2022] GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90 => generated 1317 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:09.690585 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-319b2ef0-6de0-49ef-9b44-670c01ffb62b tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:09.691199 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-319b2ef0-6de0-49ef-9b44-670c01ffb62b tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:09.694035 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:46:09.702042 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-319b2ef0-6de0-49ef-9b44-670c01ffb62b tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:09.702642 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-319b2ef0-6de0-49ef-9b44-670c01ffb62b tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:09.703288 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-319b2ef0-6de0-49ef-9b44-670c01ffb62b tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:09.704378 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-319b2ef0-6de0-49ef-9b44-670c01ffb62b tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:09.705064 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-319b2ef0-6de0-49ef-9b44-670c01ffb62b tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:09.705508 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-319b2ef0-6de0-49ef-9b44-670c01ffb62b tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:09.845509 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-319b2ef0-6de0-49ef-9b44-670c01ffb62b tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:09.856214 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-319b2ef0-6de0-49ef-9b44-670c01ffb62b tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90" status: 200 len: 1507 microversion: 2.1 time: 0.171334 Aug 31 16:46:09.856818 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3537/6891] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:09 2022] GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90 => generated 1507 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:09.876670 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dbfee4b8-86da-4eef-9faf-f5a3b33d16c6 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:09.877279 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dbfee4b8-86da-4eef-9faf-f5a3b33d16c6 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:09.879143 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:46:09.879833 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:46:09.886635 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dbfee4b8-86da-4eef-9faf-f5a3b33d16c6 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:09.887111 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dbfee4b8-86da-4eef-9faf-f5a3b33d16c6 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:09.887532 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dbfee4b8-86da-4eef-9faf-f5a3b33d16c6 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:09.888208 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dbfee4b8-86da-4eef-9faf-f5a3b33d16c6 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:09.888736 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dbfee4b8-86da-4eef-9faf-f5a3b33d16c6 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:09.889148 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dbfee4b8-86da-4eef-9faf-f5a3b33d16c6 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:10.025749 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dbfee4b8-86da-4eef-9faf-f5a3b33d16c6 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:10.035193 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dbfee4b8-86da-4eef-9faf-f5a3b33d16c6 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90" status: 200 len: 1507 microversion: 2.1 time: 0.162024 Aug 31 16:46:10.036165 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3355/6892] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:09 2022] GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90 => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:10.055615 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a1b6f16f-f05b-4b50-80d6-ca3706c54348 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:46:10.058113 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a1b6f16f-f05b-4b50-80d6-ca3706c54348 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:10.064745 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a1b6f16f-f05b-4b50-80d6-ca3706c54348 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:10.065417 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a1b6f16f-f05b-4b50-80d6-ca3706c54348 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:10.065923 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a1b6f16f-f05b-4b50-80d6-ca3706c54348 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:10.066766 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a1b6f16f-f05b-4b50-80d6-ca3706c54348 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:10.067312 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a1b6f16f-f05b-4b50-80d6-ca3706c54348 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:10.067991 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a1b6f16f-f05b-4b50-80d6-ca3706c54348 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:10.140925 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a1b6f16f-f05b-4b50-80d6-ca3706c54348 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "PUT /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90" status: 200 len: 1079 microversion: 2.1 time: 0.089201 Aug 31 16:46:10.143626 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3538/6893] 10.222.0.50 () {60 vars in 1256 bytes} [Wed Aug 31 16:46:10 2022] PUT /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90 => generated 1079 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:10.166135 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-21b4a3bf-9deb-408d-86f3-d3969630ca71 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:10.167030 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-21b4a3bf-9deb-408d-86f3-d3969630ca71 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:10.175573 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-21b4a3bf-9deb-408d-86f3-d3969630ca71 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:10.176055 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-21b4a3bf-9deb-408d-86f3-d3969630ca71 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:10.176487 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-21b4a3bf-9deb-408d-86f3-d3969630ca71 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:10.177171 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-21b4a3bf-9deb-408d-86f3-d3969630ca71 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:10.177616 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-21b4a3bf-9deb-408d-86f3-d3969630ca71 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:10.178034 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-21b4a3bf-9deb-408d-86f3-d3969630ca71 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:10.310610 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-21b4a3bf-9deb-408d-86f3-d3969630ca71 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:10.319065 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-21b4a3bf-9deb-408d-86f3-d3969630ca71 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90" status: 200 len: 1505 microversion: 2.1 time: 0.158426 Aug 31 16:46:10.319662 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3356/6894] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:10 2022] GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90 => generated 1505 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:10.341631 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6ca5d10c-4e96-4936-9095-c8791973838b tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:10.342388 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6ca5d10c-4e96-4936-9095-c8791973838b tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:10.350965 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6ca5d10c-4e96-4936-9095-c8791973838b tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:10.351645 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6ca5d10c-4e96-4936-9095-c8791973838b tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:10.352385 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6ca5d10c-4e96-4936-9095-c8791973838b tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:10.353304 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6ca5d10c-4e96-4936-9095-c8791973838b tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:10.353905 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6ca5d10c-4e96-4936-9095-c8791973838b tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:10.354566 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6ca5d10c-4e96-4936-9095-c8791973838b tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:10.489295 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6ca5d10c-4e96-4936-9095-c8791973838b tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:10.499389 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6ca5d10c-4e96-4936-9095-c8791973838b tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90" status: 200 len: 1505 microversion: 2.1 time: 0.163612 Aug 31 16:46:10.500201 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3539/6895] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:10 2022] GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90 => generated 1505 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:10.520520 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4eb87245-f3f1-4fea-92df-6ec19f28ef13 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:46:10.523095 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4eb87245-f3f1-4fea-92df-6ec19f28ef13 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:10.529471 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4eb87245-f3f1-4fea-92df-6ec19f28ef13 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:10.529939 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4eb87245-f3f1-4fea-92df-6ec19f28ef13 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:10.530392 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4eb87245-f3f1-4fea-92df-6ec19f28ef13 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:10.531062 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4eb87245-f3f1-4fea-92df-6ec19f28ef13 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:10.531501 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4eb87245-f3f1-4fea-92df-6ec19f28ef13 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:10.531919 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4eb87245-f3f1-4fea-92df-6ec19f28ef13 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:10.560521 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4eb87245-f3f1-4fea-92df-6ec19f28ef13 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:10.566487 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4eb87245-f3f1-4fea-92df-6ec19f28ef13 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] Old instance type m1.heat2, new instance type m1.heat {{(pid=128863) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 31 16:46:10.573171 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-4eb87245-f3f1-4fea-92df-6ec19f28ef13 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:46:10.573581 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-4eb87245-f3f1-4fea-92df-6ec19f28ef13 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:46:10.574036 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-4eb87245-f3f1-4fea-92df-6ec19f28ef13 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:46:10.574463 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-4eb87245-f3f1-4fea-92df-6ec19f28ef13 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:46:10.574858 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-4eb87245-f3f1-4fea-92df-6ec19f28ef13 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:46:10.642050 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4eb87245-f3f1-4fea-92df-6ec19f28ef13 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "POST /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90/action" status: 202 len: 0 microversion: 2.1 time: 0.125515 Aug 31 16:46:10.642748 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3357/6896] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:46:10 2022] POST /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 16:46:10.651506 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-bdde010e-a4e6-4ee0-ac99-1abd448d431a tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:10.652163 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-bdde010e-a4e6-4ee0-ac99-1abd448d431a tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:10.658583 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bdde010e-a4e6-4ee0-ac99-1abd448d431a tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:10.659077 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bdde010e-a4e6-4ee0-ac99-1abd448d431a tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:10.659518 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bdde010e-a4e6-4ee0-ac99-1abd448d431a tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:10.660219 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bdde010e-a4e6-4ee0-ac99-1abd448d431a tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:10.660671 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bdde010e-a4e6-4ee0-ac99-1abd448d431a tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:10.661098 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bdde010e-a4e6-4ee0-ac99-1abd448d431a tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:10.801971 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-bdde010e-a4e6-4ee0-ac99-1abd448d431a tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:10.814656 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-bdde010e-a4e6-4ee0-ac99-1abd448d431a tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90" status: 200 len: 1516 microversion: 2.1 time: 0.166623 Aug 31 16:46:10.819755 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3540/6897] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:10 2022] GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90 => generated 1516 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:11.837576 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8b9e47ac-1d3f-4168-9c46-7e401674f546 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:11.838188 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8b9e47ac-1d3f-4168-9c46-7e401674f546 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:11.844801 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b9e47ac-1d3f-4168-9c46-7e401674f546 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:11.845430 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b9e47ac-1d3f-4168-9c46-7e401674f546 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:11.845929 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b9e47ac-1d3f-4168-9c46-7e401674f546 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:11.846717 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b9e47ac-1d3f-4168-9c46-7e401674f546 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:11.847516 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b9e47ac-1d3f-4168-9c46-7e401674f546 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:11.847659 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b9e47ac-1d3f-4168-9c46-7e401674f546 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:11.990194 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8b9e47ac-1d3f-4168-9c46-7e401674f546 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:11.999372 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8b9e47ac-1d3f-4168-9c46-7e401674f546 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90" status: 200 len: 1516 microversion: 2.1 time: 0.166560 Aug 31 16:46:11.999951 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3358/6898] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:11 2022] GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90 => generated 1516 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:13.022663 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-779f2287-cc3f-4e61-bfd8-12e45a11f2f7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:13.023390 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-779f2287-cc3f-4e61-bfd8-12e45a11f2f7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:13.032080 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-779f2287-cc3f-4e61-bfd8-12e45a11f2f7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:13.033170 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-779f2287-cc3f-4e61-bfd8-12e45a11f2f7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:13.033729 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-779f2287-cc3f-4e61-bfd8-12e45a11f2f7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:13.034480 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-779f2287-cc3f-4e61-bfd8-12e45a11f2f7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:13.034955 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-779f2287-cc3f-4e61-bfd8-12e45a11f2f7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:13.035396 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-779f2287-cc3f-4e61-bfd8-12e45a11f2f7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:13.179520 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-779f2287-cc3f-4e61-bfd8-12e45a11f2f7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:13.191734 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-779f2287-cc3f-4e61-bfd8-12e45a11f2f7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90" status: 200 len: 1521 microversion: 2.1 time: 0.173899 Aug 31 16:46:13.192494 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3541/6899] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:13 2022] GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:14.218893 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-60dcdaed-cc3a-49f4-91d0-09490234fb21 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:14.219567 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-60dcdaed-cc3a-49f4-91d0-09490234fb21 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:14.226974 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60dcdaed-cc3a-49f4-91d0-09490234fb21 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:14.227551 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60dcdaed-cc3a-49f4-91d0-09490234fb21 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:14.227872 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60dcdaed-cc3a-49f4-91d0-09490234fb21 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:14.228561 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60dcdaed-cc3a-49f4-91d0-09490234fb21 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:14.229001 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60dcdaed-cc3a-49f4-91d0-09490234fb21 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:14.229400 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60dcdaed-cc3a-49f4-91d0-09490234fb21 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:14.377151 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-60dcdaed-cc3a-49f4-91d0-09490234fb21 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:14.385385 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-60dcdaed-cc3a-49f4-91d0-09490234fb21 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90" status: 200 len: 1521 microversion: 2.1 time: 0.171121 Aug 31 16:46:14.385975 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3359/6900] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:14 2022] GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:15.408941 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7fd48d0a-a692-4e65-9acc-49b9e9dd8f47 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:15.409688 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7fd48d0a-a692-4e65-9acc-49b9e9dd8f47 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:15.418324 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7fd48d0a-a692-4e65-9acc-49b9e9dd8f47 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:15.418910 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7fd48d0a-a692-4e65-9acc-49b9e9dd8f47 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:15.419387 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7fd48d0a-a692-4e65-9acc-49b9e9dd8f47 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:15.420229 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7fd48d0a-a692-4e65-9acc-49b9e9dd8f47 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:15.420767 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7fd48d0a-a692-4e65-9acc-49b9e9dd8f47 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:15.421285 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7fd48d0a-a692-4e65-9acc-49b9e9dd8f47 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:15.560893 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7fd48d0a-a692-4e65-9acc-49b9e9dd8f47 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:15.569546 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7fd48d0a-a692-4e65-9acc-49b9e9dd8f47 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90" status: 200 len: 1521 microversion: 2.1 time: 0.165497 Aug 31 16:46:15.570139 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3542/6901] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:15 2022] GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:16.595048 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-78f865ee-88ca-455a-9cdf-bce086cd89e9 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:16.596098 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-78f865ee-88ca-455a-9cdf-bce086cd89e9 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:16.603461 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78f865ee-88ca-455a-9cdf-bce086cd89e9 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:16.603952 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78f865ee-88ca-455a-9cdf-bce086cd89e9 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:16.604384 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78f865ee-88ca-455a-9cdf-bce086cd89e9 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:16.605085 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78f865ee-88ca-455a-9cdf-bce086cd89e9 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:16.605534 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78f865ee-88ca-455a-9cdf-bce086cd89e9 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:16.605957 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78f865ee-88ca-455a-9cdf-bce086cd89e9 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:16.762344 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-78f865ee-88ca-455a-9cdf-bce086cd89e9 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:16.770178 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-78f865ee-88ca-455a-9cdf-bce086cd89e9 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90" status: 200 len: 1521 microversion: 2.1 time: 0.181237 Aug 31 16:46:16.771107 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3360/6902] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:16 2022] GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:17.800355 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-52b293e8-5247-4ec5-b809-402de56708c1 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:17.801151 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-52b293e8-5247-4ec5-b809-402de56708c1 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:17.809016 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-52b293e8-5247-4ec5-b809-402de56708c1 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:17.809522 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-52b293e8-5247-4ec5-b809-402de56708c1 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:17.809966 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-52b293e8-5247-4ec5-b809-402de56708c1 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:17.810713 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-52b293e8-5247-4ec5-b809-402de56708c1 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:17.811181 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-52b293e8-5247-4ec5-b809-402de56708c1 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:17.811616 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-52b293e8-5247-4ec5-b809-402de56708c1 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:17.947103 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-52b293e8-5247-4ec5-b809-402de56708c1 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:17.955354 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-52b293e8-5247-4ec5-b809-402de56708c1 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90" status: 200 len: 1521 microversion: 2.1 time: 0.161507 Aug 31 16:46:17.955934 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3543/6903] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:17 2022] GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:18.981103 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cc9f20d6-6122-4565-9874-c4ade7fd81ba tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:18.981749 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cc9f20d6-6122-4565-9874-c4ade7fd81ba tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:18.989586 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cc9f20d6-6122-4565-9874-c4ade7fd81ba tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:18.990071 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cc9f20d6-6122-4565-9874-c4ade7fd81ba tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:18.990499 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cc9f20d6-6122-4565-9874-c4ade7fd81ba tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:18.991199 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cc9f20d6-6122-4565-9874-c4ade7fd81ba tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:18.991657 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cc9f20d6-6122-4565-9874-c4ade7fd81ba tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:18.992084 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cc9f20d6-6122-4565-9874-c4ade7fd81ba tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:19.415253 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cc9f20d6-6122-4565-9874-c4ade7fd81ba tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:19.423289 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cc9f20d6-6122-4565-9874-c4ade7fd81ba tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90" status: 200 len: 1521 microversion: 2.1 time: 0.446180 Aug 31 16:46:19.423849 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3361/6904] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:18 2022] GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90 => generated 1521 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:20.445619 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-506eb42f-80cc-4383-916c-edca6cbe9cfc tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:20.446216 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-506eb42f-80cc-4383-916c-edca6cbe9cfc tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:20.453788 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-506eb42f-80cc-4383-916c-edca6cbe9cfc tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:20.454322 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-506eb42f-80cc-4383-916c-edca6cbe9cfc tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:20.454777 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-506eb42f-80cc-4383-916c-edca6cbe9cfc tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:20.455489 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-506eb42f-80cc-4383-916c-edca6cbe9cfc tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:20.455952 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-506eb42f-80cc-4383-916c-edca6cbe9cfc tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:20.456698 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-506eb42f-80cc-4383-916c-edca6cbe9cfc tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:20.626824 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-506eb42f-80cc-4383-916c-edca6cbe9cfc tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:20.635470 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-506eb42f-80cc-4383-916c-edca6cbe9cfc tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90" status: 200 len: 1521 microversion: 2.1 time: 0.194010 Aug 31 16:46:20.636054 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3544/6905] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:20 2022] GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:21.659700 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a4f6a964-852b-4cc2-a442-c604dfc99eaf tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:21.660409 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a4f6a964-852b-4cc2-a442-c604dfc99eaf tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:21.667569 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4f6a964-852b-4cc2-a442-c604dfc99eaf tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:21.668063 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4f6a964-852b-4cc2-a442-c604dfc99eaf tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:21.668533 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4f6a964-852b-4cc2-a442-c604dfc99eaf tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:21.669210 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4f6a964-852b-4cc2-a442-c604dfc99eaf tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:21.669688 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4f6a964-852b-4cc2-a442-c604dfc99eaf tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:21.670082 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a4f6a964-852b-4cc2-a442-c604dfc99eaf tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:21.812833 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a4f6a964-852b-4cc2-a442-c604dfc99eaf tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:21.821407 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a4f6a964-852b-4cc2-a442-c604dfc99eaf tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90" status: 200 len: 1521 microversion: 2.1 time: 0.167364 Aug 31 16:46:21.821986 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3362/6906] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:21 2022] GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:22.846181 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5a73d6f2-932b-4d83-9288-999c5d69b062 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:22.847718 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5a73d6f2-932b-4d83-9288-999c5d69b062 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:22.856363 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5a73d6f2-932b-4d83-9288-999c5d69b062 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:22.857202 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5a73d6f2-932b-4d83-9288-999c5d69b062 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:22.857925 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5a73d6f2-932b-4d83-9288-999c5d69b062 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:22.859060 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5a73d6f2-932b-4d83-9288-999c5d69b062 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:22.859803 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5a73d6f2-932b-4d83-9288-999c5d69b062 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:22.860485 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5a73d6f2-932b-4d83-9288-999c5d69b062 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:23.027774 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5a73d6f2-932b-4d83-9288-999c5d69b062 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:23.037384 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5a73d6f2-932b-4d83-9288-999c5d69b062 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90" status: 200 len: 1521 microversion: 2.1 time: 0.197772 Aug 31 16:46:23.038037 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3545/6907] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:22 2022] GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:46:24.061386 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-aa31899d-e30a-435f-a1e4-430cf02f9b2f tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:24.061950 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-aa31899d-e30a-435f-a1e4-430cf02f9b2f tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:24.069444 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa31899d-e30a-435f-a1e4-430cf02f9b2f tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:24.069934 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa31899d-e30a-435f-a1e4-430cf02f9b2f tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:24.070408 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa31899d-e30a-435f-a1e4-430cf02f9b2f tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:24.071105 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa31899d-e30a-435f-a1e4-430cf02f9b2f tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:24.071571 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa31899d-e30a-435f-a1e4-430cf02f9b2f tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:24.071997 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa31899d-e30a-435f-a1e4-430cf02f9b2f tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:24.216060 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-aa31899d-e30a-435f-a1e4-430cf02f9b2f tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:24.225999 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-aa31899d-e30a-435f-a1e4-430cf02f9b2f tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90" status: 200 len: 1521 microversion: 2.1 time: 0.168681 Aug 31 16:46:24.226615 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3363/6908] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:24 2022] GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:25.250383 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a2af732c-61df-40c4-a806-13041bfb6944 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:25.251095 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a2af732c-61df-40c4-a806-13041bfb6944 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:25.262142 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a2af732c-61df-40c4-a806-13041bfb6944 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:25.263042 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a2af732c-61df-40c4-a806-13041bfb6944 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:25.263524 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a2af732c-61df-40c4-a806-13041bfb6944 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:25.264525 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a2af732c-61df-40c4-a806-13041bfb6944 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:25.265254 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a2af732c-61df-40c4-a806-13041bfb6944 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:25.265893 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a2af732c-61df-40c4-a806-13041bfb6944 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:25.408616 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a2af732c-61df-40c4-a806-13041bfb6944 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:25.419309 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a2af732c-61df-40c4-a806-13041bfb6944 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90" status: 200 len: 1521 microversion: 2.1 time: 0.174883 Aug 31 16:46:25.420066 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3546/6909] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:25 2022] GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:26.441493 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-27e022e7-6427-426b-88a3-9d8cdc94ebca tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:26.442413 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-27e022e7-6427-426b-88a3-9d8cdc94ebca tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:26.450232 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27e022e7-6427-426b-88a3-9d8cdc94ebca tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:26.450736 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27e022e7-6427-426b-88a3-9d8cdc94ebca tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:26.451166 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27e022e7-6427-426b-88a3-9d8cdc94ebca tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:26.451858 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27e022e7-6427-426b-88a3-9d8cdc94ebca tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:26.452303 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27e022e7-6427-426b-88a3-9d8cdc94ebca tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:26.452716 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27e022e7-6427-426b-88a3-9d8cdc94ebca tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:26.596563 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-27e022e7-6427-426b-88a3-9d8cdc94ebca tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:26.607267 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-27e022e7-6427-426b-88a3-9d8cdc94ebca tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90" status: 200 len: 1521 microversion: 2.1 time: 0.169790 Aug 31 16:46:26.607818 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3364/6910] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:26 2022] GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:27.631000 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f5b92b81-0946-4902-ab22-0a97956227f4 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:27.631686 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f5b92b81-0946-4902-ab22-0a97956227f4 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:27.639430 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f5b92b81-0946-4902-ab22-0a97956227f4 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:27.639918 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f5b92b81-0946-4902-ab22-0a97956227f4 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:27.640366 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f5b92b81-0946-4902-ab22-0a97956227f4 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:27.641074 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f5b92b81-0946-4902-ab22-0a97956227f4 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:27.641535 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f5b92b81-0946-4902-ab22-0a97956227f4 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:27.641989 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f5b92b81-0946-4902-ab22-0a97956227f4 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:27.788001 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f5b92b81-0946-4902-ab22-0a97956227f4 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:27.796544 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f5b92b81-0946-4902-ab22-0a97956227f4 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90" status: 200 len: 1521 microversion: 2.1 time: 0.171126 Aug 31 16:46:27.797129 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3547/6911] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:27 2022] GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:28.818913 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-28ce1b29-c194-4bdd-b2e6-39fad317fd21 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:28.819535 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-28ce1b29-c194-4bdd-b2e6-39fad317fd21 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:28.826854 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28ce1b29-c194-4bdd-b2e6-39fad317fd21 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:28.827351 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28ce1b29-c194-4bdd-b2e6-39fad317fd21 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:28.827820 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28ce1b29-c194-4bdd-b2e6-39fad317fd21 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:28.828522 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28ce1b29-c194-4bdd-b2e6-39fad317fd21 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:28.828982 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28ce1b29-c194-4bdd-b2e6-39fad317fd21 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:28.829407 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28ce1b29-c194-4bdd-b2e6-39fad317fd21 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:28.967065 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-28ce1b29-c194-4bdd-b2e6-39fad317fd21 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:28.979768 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-28ce1b29-c194-4bdd-b2e6-39fad317fd21 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90" status: 200 len: 1521 microversion: 2.1 time: 0.164884 Aug 31 16:46:28.980534 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3365/6912] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:28 2022] GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:30.007920 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2a541187-829e-4065-8415-0fd45861a45f tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:30.008478 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2a541187-829e-4065-8415-0fd45861a45f tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:30.015778 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2a541187-829e-4065-8415-0fd45861a45f tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:30.016276 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2a541187-829e-4065-8415-0fd45861a45f tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:30.016715 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2a541187-829e-4065-8415-0fd45861a45f tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:30.017429 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2a541187-829e-4065-8415-0fd45861a45f tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:30.017884 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2a541187-829e-4065-8415-0fd45861a45f tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:30.018373 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2a541187-829e-4065-8415-0fd45861a45f tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:30.021387 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:46:30.180321 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2a541187-829e-4065-8415-0fd45861a45f tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:30.188506 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2a541187-829e-4065-8415-0fd45861a45f tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90" status: 200 len: 1521 microversion: 2.1 time: 0.187009 Aug 31 16:46:30.189404 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3548/6913] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:29 2022] GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:31.212395 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c02b4838-ed26-4ccb-bb86-79c8b467296a tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:31.213076 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c02b4838-ed26-4ccb-bb86-79c8b467296a tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:31.220930 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c02b4838-ed26-4ccb-bb86-79c8b467296a tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:31.221427 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c02b4838-ed26-4ccb-bb86-79c8b467296a tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:31.221870 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c02b4838-ed26-4ccb-bb86-79c8b467296a tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:31.222609 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c02b4838-ed26-4ccb-bb86-79c8b467296a tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:31.223065 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c02b4838-ed26-4ccb-bb86-79c8b467296a tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:31.223491 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c02b4838-ed26-4ccb-bb86-79c8b467296a tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:31.370545 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c02b4838-ed26-4ccb-bb86-79c8b467296a tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:31.382613 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c02b4838-ed26-4ccb-bb86-79c8b467296a tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90" status: 200 len: 1521 microversion: 2.1 time: 0.174902 Aug 31 16:46:31.383190 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3366/6914] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:31 2022] GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:32.412214 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-76da4eda-dd4a-442d-8e76-cdf08a2d6239 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:32.412980 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-76da4eda-dd4a-442d-8e76-cdf08a2d6239 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:32.420931 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76da4eda-dd4a-442d-8e76-cdf08a2d6239 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:32.421419 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76da4eda-dd4a-442d-8e76-cdf08a2d6239 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:32.421864 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76da4eda-dd4a-442d-8e76-cdf08a2d6239 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:32.422609 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76da4eda-dd4a-442d-8e76-cdf08a2d6239 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:32.423063 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76da4eda-dd4a-442d-8e76-cdf08a2d6239 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:32.423533 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76da4eda-dd4a-442d-8e76-cdf08a2d6239 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:32.565706 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-76da4eda-dd4a-442d-8e76-cdf08a2d6239 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:32.574975 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-76da4eda-dd4a-442d-8e76-cdf08a2d6239 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90" status: 200 len: 1521 microversion: 2.1 time: 0.166768 Aug 31 16:46:32.575560 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3549/6915] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:32 2022] GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:33.600711 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ff845343-47be-4e32-928f-b450172ff90e tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:33.601784 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ff845343-47be-4e32-928f-b450172ff90e tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:33.610902 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ff845343-47be-4e32-928f-b450172ff90e tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:33.611395 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ff845343-47be-4e32-928f-b450172ff90e tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:33.611834 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ff845343-47be-4e32-928f-b450172ff90e tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:33.612544 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ff845343-47be-4e32-928f-b450172ff90e tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:33.612999 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ff845343-47be-4e32-928f-b450172ff90e tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:33.613428 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ff845343-47be-4e32-928f-b450172ff90e tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:33.753921 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ff845343-47be-4e32-928f-b450172ff90e tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:33.763315 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ff845343-47be-4e32-928f-b450172ff90e tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90" status: 200 len: 1521 microversion: 2.1 time: 0.170000 Aug 31 16:46:33.763897 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3367/6916] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:33 2022] GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:34.785187 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f808a8f4-2f3f-4941-acb2-b80bc3b08ada tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:34.785800 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f808a8f4-2f3f-4941-acb2-b80bc3b08ada tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:34.793328 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f808a8f4-2f3f-4941-acb2-b80bc3b08ada tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:34.793820 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f808a8f4-2f3f-4941-acb2-b80bc3b08ada tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:34.794305 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f808a8f4-2f3f-4941-acb2-b80bc3b08ada tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:34.795019 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f808a8f4-2f3f-4941-acb2-b80bc3b08ada tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:34.795478 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f808a8f4-2f3f-4941-acb2-b80bc3b08ada tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:34.795912 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f808a8f4-2f3f-4941-acb2-b80bc3b08ada tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:34.932711 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f808a8f4-2f3f-4941-acb2-b80bc3b08ada tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:34.941071 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f808a8f4-2f3f-4941-acb2-b80bc3b08ada tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90" status: 200 len: 1521 microversion: 2.1 time: 0.159915 Aug 31 16:46:34.941683 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3550/6917] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:34 2022] GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:35.963491 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-af98d936-b665-477b-8870-fca25d8bae37 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:35.964131 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-af98d936-b665-477b-8870-fca25d8bae37 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:35.971683 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af98d936-b665-477b-8870-fca25d8bae37 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:35.972173 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af98d936-b665-477b-8870-fca25d8bae37 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:35.972602 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af98d936-b665-477b-8870-fca25d8bae37 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:35.973311 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af98d936-b665-477b-8870-fca25d8bae37 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:35.973758 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af98d936-b665-477b-8870-fca25d8bae37 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:35.974205 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af98d936-b665-477b-8870-fca25d8bae37 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:36.110152 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-af98d936-b665-477b-8870-fca25d8bae37 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:36.118560 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-af98d936-b665-477b-8870-fca25d8bae37 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90" status: 200 len: 1521 microversion: 2.1 time: 0.159299 Aug 31 16:46:36.119133 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3368/6918] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:35 2022] GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:37.139886 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-135f6f85-3922-43b5-a6e8-b70b53672dd7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:37.140501 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-135f6f85-3922-43b5-a6e8-b70b53672dd7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:37.148401 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-135f6f85-3922-43b5-a6e8-b70b53672dd7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:37.148896 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-135f6f85-3922-43b5-a6e8-b70b53672dd7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:37.149342 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-135f6f85-3922-43b5-a6e8-b70b53672dd7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:37.150086 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-135f6f85-3922-43b5-a6e8-b70b53672dd7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:37.150589 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-135f6f85-3922-43b5-a6e8-b70b53672dd7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:37.151027 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-135f6f85-3922-43b5-a6e8-b70b53672dd7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:37.291898 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-135f6f85-3922-43b5-a6e8-b70b53672dd7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:37.300159 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-135f6f85-3922-43b5-a6e8-b70b53672dd7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90" status: 200 len: 1521 microversion: 2.1 time: 0.164346 Aug 31 16:46:37.300748 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3551/6919] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:37 2022] GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:38.321987 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b6ab71f0-2b24-4236-8edd-b6e4d5f226b1 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:38.322649 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b6ab71f0-2b24-4236-8edd-b6e4d5f226b1 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:38.330137 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6ab71f0-2b24-4236-8edd-b6e4d5f226b1 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:38.330670 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6ab71f0-2b24-4236-8edd-b6e4d5f226b1 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:38.331102 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6ab71f0-2b24-4236-8edd-b6e4d5f226b1 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:38.331805 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6ab71f0-2b24-4236-8edd-b6e4d5f226b1 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:38.332260 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6ab71f0-2b24-4236-8edd-b6e4d5f226b1 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:38.332687 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b6ab71f0-2b24-4236-8edd-b6e4d5f226b1 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:38.353601 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:46:38.489236 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b6ab71f0-2b24-4236-8edd-b6e4d5f226b1 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:38.497647 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b6ab71f0-2b24-4236-8edd-b6e4d5f226b1 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90" status: 200 len: 1521 microversion: 2.1 time: 0.179990 Aug 31 16:46:38.498227 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3369/6920] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:38 2022] GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:39.521763 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c2cc51c8-91e8-4365-8cb3-4740b2f6ac45 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:39.522719 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c2cc51c8-91e8-4365-8cb3-4740b2f6ac45 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:39.525471 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=32 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:46:39.531025 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c2cc51c8-91e8-4365-8cb3-4740b2f6ac45 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:39.531519 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c2cc51c8-91e8-4365-8cb3-4740b2f6ac45 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:39.531961 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c2cc51c8-91e8-4365-8cb3-4740b2f6ac45 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:39.532665 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c2cc51c8-91e8-4365-8cb3-4740b2f6ac45 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:39.533129 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c2cc51c8-91e8-4365-8cb3-4740b2f6ac45 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:39.533568 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c2cc51c8-91e8-4365-8cb3-4740b2f6ac45 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:39.942550 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c2cc51c8-91e8-4365-8cb3-4740b2f6ac45 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:39.951266 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c2cc51c8-91e8-4365-8cb3-4740b2f6ac45 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90" status: 200 len: 1521 microversion: 2.1 time: 0.435868 Aug 31 16:46:39.951895 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3552/6921] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:39 2022] GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90 => generated 1521 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:40.973777 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0addce1f-ecfa-47be-a440-57f1b30d9d8d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:40.974454 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0addce1f-ecfa-47be-a440-57f1b30d9d8d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:40.977348 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=36 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:46:40.983321 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0addce1f-ecfa-47be-a440-57f1b30d9d8d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:40.983809 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0addce1f-ecfa-47be-a440-57f1b30d9d8d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:40.984248 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0addce1f-ecfa-47be-a440-57f1b30d9d8d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:40.984981 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0addce1f-ecfa-47be-a440-57f1b30d9d8d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:40.985428 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0addce1f-ecfa-47be-a440-57f1b30d9d8d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:40.985858 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0addce1f-ecfa-47be-a440-57f1b30d9d8d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:41.119703 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0addce1f-ecfa-47be-a440-57f1b30d9d8d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:41.128763 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0addce1f-ecfa-47be-a440-57f1b30d9d8d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90" status: 200 len: 1521 microversion: 2.1 time: 0.159006 Aug 31 16:46:41.129381 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3370/6922] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:40 2022] GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:42.155067 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0ed46a2f-21ba-451e-bfc3-6969a74106ea tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:42.156120 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0ed46a2f-21ba-451e-bfc3-6969a74106ea tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:42.166314 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0ed46a2f-21ba-451e-bfc3-6969a74106ea tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:42.166844 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0ed46a2f-21ba-451e-bfc3-6969a74106ea tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:42.167289 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0ed46a2f-21ba-451e-bfc3-6969a74106ea tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:42.167998 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0ed46a2f-21ba-451e-bfc3-6969a74106ea tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:42.168476 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0ed46a2f-21ba-451e-bfc3-6969a74106ea tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:42.168895 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0ed46a2f-21ba-451e-bfc3-6969a74106ea tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:42.306845 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0ed46a2f-21ba-451e-bfc3-6969a74106ea tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:42.314781 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0ed46a2f-21ba-451e-bfc3-6969a74106ea tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90" status: 200 len: 1521 microversion: 2.1 time: 0.166340 Aug 31 16:46:42.315329 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3553/6923] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:42 2022] GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:43.336887 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2794ba27-b509-4016-a465-4aca25c27bdf tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:43.337487 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2794ba27-b509-4016-a465-4aca25c27bdf tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:43.344328 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2794ba27-b509-4016-a465-4aca25c27bdf tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:43.344820 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2794ba27-b509-4016-a465-4aca25c27bdf tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:43.345255 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2794ba27-b509-4016-a465-4aca25c27bdf tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:43.345949 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2794ba27-b509-4016-a465-4aca25c27bdf tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:43.346439 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2794ba27-b509-4016-a465-4aca25c27bdf tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:43.346870 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2794ba27-b509-4016-a465-4aca25c27bdf tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:43.487544 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2794ba27-b509-4016-a465-4aca25c27bdf tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:43.498941 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2794ba27-b509-4016-a465-4aca25c27bdf tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90" status: 200 len: 1521 microversion: 2.1 time: 0.166249 Aug 31 16:46:43.499679 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3371/6924] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:43 2022] GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:44.523395 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d86863ac-894c-4e2f-810c-7050764f7ad9 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:44.524149 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d86863ac-894c-4e2f-810c-7050764f7ad9 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:44.531410 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d86863ac-894c-4e2f-810c-7050764f7ad9 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:44.531898 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d86863ac-894c-4e2f-810c-7050764f7ad9 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:44.532439 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d86863ac-894c-4e2f-810c-7050764f7ad9 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:44.533161 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d86863ac-894c-4e2f-810c-7050764f7ad9 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:44.533600 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d86863ac-894c-4e2f-810c-7050764f7ad9 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:44.534028 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d86863ac-894c-4e2f-810c-7050764f7ad9 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:44.672684 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d86863ac-894c-4e2f-810c-7050764f7ad9 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:44.681994 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d86863ac-894c-4e2f-810c-7050764f7ad9 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90" status: 200 len: 1521 microversion: 2.1 time: 0.163378 Aug 31 16:46:44.682654 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3554/6925] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:44 2022] GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:45.703633 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-412867bd-34f9-4777-895c-719290b19626 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:45.704257 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-412867bd-34f9-4777-895c-719290b19626 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:45.712241 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-412867bd-34f9-4777-895c-719290b19626 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:45.712706 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-412867bd-34f9-4777-895c-719290b19626 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:45.713143 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-412867bd-34f9-4777-895c-719290b19626 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:45.713867 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-412867bd-34f9-4777-895c-719290b19626 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:45.714434 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-412867bd-34f9-4777-895c-719290b19626 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:45.714775 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-412867bd-34f9-4777-895c-719290b19626 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:46.183541 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-412867bd-34f9-4777-895c-719290b19626 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:46.193362 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-412867bd-34f9-4777-895c-719290b19626 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90" status: 200 len: 1521 microversion: 2.1 time: 0.493682 Aug 31 16:46:46.193967 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3372/6926] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:45 2022] GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90 => generated 1521 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:47.220921 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1bfd8a1b-a8b0-4f66-9696-15cf5e1b6b0d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:47.221603 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1bfd8a1b-a8b0-4f66-9696-15cf5e1b6b0d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:47.230334 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1bfd8a1b-a8b0-4f66-9696-15cf5e1b6b0d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:47.230842 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1bfd8a1b-a8b0-4f66-9696-15cf5e1b6b0d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:47.231279 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1bfd8a1b-a8b0-4f66-9696-15cf5e1b6b0d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:47.231993 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1bfd8a1b-a8b0-4f66-9696-15cf5e1b6b0d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:47.232464 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1bfd8a1b-a8b0-4f66-9696-15cf5e1b6b0d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:47.232901 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1bfd8a1b-a8b0-4f66-9696-15cf5e1b6b0d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:47.371740 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1bfd8a1b-a8b0-4f66-9696-15cf5e1b6b0d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:47.379909 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1bfd8a1b-a8b0-4f66-9696-15cf5e1b6b0d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90" status: 200 len: 1521 microversion: 2.1 time: 0.164757 Aug 31 16:46:47.380493 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3555/6927] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:47 2022] GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:48.401859 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7f7124f4-1e54-4f20-b771-dd4fdbbc09b7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:48.402538 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7f7124f4-1e54-4f20-b771-dd4fdbbc09b7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:48.410520 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f7124f4-1e54-4f20-b771-dd4fdbbc09b7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:48.411056 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f7124f4-1e54-4f20-b771-dd4fdbbc09b7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:48.411491 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f7124f4-1e54-4f20-b771-dd4fdbbc09b7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:48.412194 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f7124f4-1e54-4f20-b771-dd4fdbbc09b7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:48.412629 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f7124f4-1e54-4f20-b771-dd4fdbbc09b7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:48.413550 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7f7124f4-1e54-4f20-b771-dd4fdbbc09b7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:48.572497 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7f7124f4-1e54-4f20-b771-dd4fdbbc09b7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:48.580866 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7f7124f4-1e54-4f20-b771-dd4fdbbc09b7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90" status: 200 len: 1521 microversion: 2.1 time: 0.183206 Aug 31 16:46:48.581454 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3373/6928] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:48 2022] GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:49.603577 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-562cc5d6-c4ec-4aa0-84a1-2626d845ca02 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:49.604243 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-562cc5d6-c4ec-4aa0-84a1-2626d845ca02 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:49.611932 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-562cc5d6-c4ec-4aa0-84a1-2626d845ca02 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:49.612541 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-562cc5d6-c4ec-4aa0-84a1-2626d845ca02 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:49.613068 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-562cc5d6-c4ec-4aa0-84a1-2626d845ca02 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:49.613936 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-562cc5d6-c4ec-4aa0-84a1-2626d845ca02 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:49.614451 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-562cc5d6-c4ec-4aa0-84a1-2626d845ca02 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:49.614886 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-562cc5d6-c4ec-4aa0-84a1-2626d845ca02 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:49.755757 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-562cc5d6-c4ec-4aa0-84a1-2626d845ca02 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:49.764165 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-562cc5d6-c4ec-4aa0-84a1-2626d845ca02 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90" status: 200 len: 1520 microversion: 2.1 time: 0.164969 Aug 31 16:46:49.764786 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3556/6929] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:49 2022] GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:50.268801 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-7151aa85-3361-46fc-967f-6828202658cd req-38e5fb24-68db-4d3d-86fc-c4c309bad3b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82b2210a-de3a-48bd-866d-cf681ad8cd90", "name": "network-vif-unplugged", "status": "completed", "tag": "771e6f5e-f80b-4582-b76c-9d722e34dfda"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:46:50.283957 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7151aa85-3361-46fc-967f-6828202658cd req-38e5fb24-68db-4d3d-86fc-c4c309bad3b4 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:50.284666 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7151aa85-3361-46fc-967f-6828202658cd req-38e5fb24-68db-4d3d-86fc-c4c309bad3b4 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:50.285112 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7151aa85-3361-46fc-967f-6828202658cd req-38e5fb24-68db-4d3d-86fc-c4c309bad3b4 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:50.298072 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-7151aa85-3361-46fc-967f-6828202658cd req-38e5fb24-68db-4d3d-86fc-c4c309bad3b4 service nova] Creating event network-vif-unplugged:771e6f5e-f80b-4582-b76c-9d722e34dfda for instance 82b2210a-de3a-48bd-866d-cf681ad8cd90 on n-h1-833090-16 Aug 31 16:46:50.304006 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [req-7151aa85-3361-46fc-967f-6828202658cd req-38e5fb24-68db-4d3d-86fc-c4c309bad3b4 service nova] Instance 82b2210a-de3a-48bd-866d-cf681ad8cd90 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-833090-16', 'n-h1-833090-16'} {{(pid=128863) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 16:46:50.316153 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-7151aa85-3361-46fc-967f-6828202658cd req-38e5fb24-68db-4d3d-86fc-c4c309bad3b4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053062 Aug 31 16:46:50.317010 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3374/6930] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:46:50.786757 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-455ed2ce-973d-4127-9847-389b31b1d5fb tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:50.787372 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-455ed2ce-973d-4127-9847-389b31b1d5fb tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:50.795303 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-455ed2ce-973d-4127-9847-389b31b1d5fb tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:50.795811 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-455ed2ce-973d-4127-9847-389b31b1d5fb tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:50.796255 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-455ed2ce-973d-4127-9847-389b31b1d5fb tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:50.796976 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-455ed2ce-973d-4127-9847-389b31b1d5fb tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:50.797436 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-455ed2ce-973d-4127-9847-389b31b1d5fb tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:50.797850 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-455ed2ce-973d-4127-9847-389b31b1d5fb tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:51.004114 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-455ed2ce-973d-4127-9847-389b31b1d5fb tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:51.013178 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-455ed2ce-973d-4127-9847-389b31b1d5fb tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90" status: 200 len: 1520 microversion: 2.1 time: 0.230446 Aug 31 16:46:51.013699 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3557/6931] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:50 2022] GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90 => generated 1520 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:52.038498 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f942ba24-64e1-4551-bcca-6632b0bdd159 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:52.039207 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f942ba24-64e1-4551-bcca-6632b0bdd159 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:52.046486 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f942ba24-64e1-4551-bcca-6632b0bdd159 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:52.047066 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f942ba24-64e1-4551-bcca-6632b0bdd159 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:52.047560 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f942ba24-64e1-4551-bcca-6632b0bdd159 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:52.048317 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f942ba24-64e1-4551-bcca-6632b0bdd159 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:52.048763 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f942ba24-64e1-4551-bcca-6632b0bdd159 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:52.049178 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f942ba24-64e1-4551-bcca-6632b0bdd159 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:52.237148 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f942ba24-64e1-4551-bcca-6632b0bdd159 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:52.245836 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f942ba24-64e1-4551-bcca-6632b0bdd159 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90" status: 200 len: 1518 microversion: 2.1 time: 0.213935 Aug 31 16:46:52.246487 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3375/6932] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:52 2022] GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90 => generated 1518 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:52.336820 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-03941cdd-d5db-490e-b812-4a07f4727375 req-0ec0cf0f-8f67-4659-8b40-ab9c58db996d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82b2210a-de3a-48bd-866d-cf681ad8cd90", "tag": "771e6f5e-f80b-4582-b76c-9d722e34dfda"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:46:52.351997 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-03941cdd-d5db-490e-b812-4a07f4727375 req-0ec0cf0f-8f67-4659-8b40-ab9c58db996d service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:52.352475 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-03941cdd-d5db-490e-b812-4a07f4727375 req-0ec0cf0f-8f67-4659-8b40-ab9c58db996d service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:52.352911 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-03941cdd-d5db-490e-b812-4a07f4727375 req-0ec0cf0f-8f67-4659-8b40-ab9c58db996d service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:52.365016 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-03941cdd-d5db-490e-b812-4a07f4727375 req-0ec0cf0f-8f67-4659-8b40-ab9c58db996d service nova] Creating event network-changed:771e6f5e-f80b-4582-b76c-9d722e34dfda for instance 82b2210a-de3a-48bd-866d-cf681ad8cd90 on n-h1-833090-16 Aug 31 16:46:52.371522 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [req-03941cdd-d5db-490e-b812-4a07f4727375 req-0ec0cf0f-8f67-4659-8b40-ab9c58db996d service nova] Instance 82b2210a-de3a-48bd-866d-cf681ad8cd90 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-833090-16', 'n-h1-833090-16'} {{(pid=128864) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 16:46:52.383121 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-03941cdd-d5db-490e-b812-4a07f4727375 req-0ec0cf0f-8f67-4659-8b40-ab9c58db996d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050069 Aug 31 16:46:52.383770 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3558/6933] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:46:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:46:53.268107 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-93cdc4ef-1a42-4914-97e7-3b33fb2b8afd tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:53.268781 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-93cdc4ef-1a42-4914-97e7-3b33fb2b8afd tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:53.276688 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-93cdc4ef-1a42-4914-97e7-3b33fb2b8afd tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:53.277255 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-93cdc4ef-1a42-4914-97e7-3b33fb2b8afd tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:53.277757 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-93cdc4ef-1a42-4914-97e7-3b33fb2b8afd tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:53.278595 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-93cdc4ef-1a42-4914-97e7-3b33fb2b8afd tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:53.279088 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-93cdc4ef-1a42-4914-97e7-3b33fb2b8afd tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:53.279574 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-93cdc4ef-1a42-4914-97e7-3b33fb2b8afd tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:53.535398 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-93cdc4ef-1a42-4914-97e7-3b33fb2b8afd tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:53.546294 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-93cdc4ef-1a42-4914-97e7-3b33fb2b8afd tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90" status: 200 len: 1515 microversion: 2.1 time: 0.281979 Aug 31 16:46:53.546925 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3376/6934] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:53 2022] GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90 => generated 1515 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:53.570894 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d8bef1c7-6064-41dc-9017-14cf902497f0 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:46:53.571561 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d8bef1c7-6064-41dc-9017-14cf902497f0 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:53.578883 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d8bef1c7-6064-41dc-9017-14cf902497f0 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:53.579410 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d8bef1c7-6064-41dc-9017-14cf902497f0 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:53.579879 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d8bef1c7-6064-41dc-9017-14cf902497f0 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:53.580976 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d8bef1c7-6064-41dc-9017-14cf902497f0 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:53.581105 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d8bef1c7-6064-41dc-9017-14cf902497f0 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:53.581531 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d8bef1c7-6064-41dc-9017-14cf902497f0 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:53.649605 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d8bef1c7-6064-41dc-9017-14cf902497f0 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "POST /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90/action" status: 204 len: 0 microversion: 2.1 time: 0.084384 Aug 31 16:46:53.650433 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3559/6935] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:46:53 2022] POST /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90/action => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:46:53.670314 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a98aa191-95ca-4d70-9062-267345e5f1fb tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:53.671222 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a98aa191-95ca-4d70-9062-267345e5f1fb tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:53.680743 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a98aa191-95ca-4d70-9062-267345e5f1fb tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:53.681474 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a98aa191-95ca-4d70-9062-267345e5f1fb tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:53.682041 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a98aa191-95ca-4d70-9062-267345e5f1fb tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:53.683039 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a98aa191-95ca-4d70-9062-267345e5f1fb tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:53.683566 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a98aa191-95ca-4d70-9062-267345e5f1fb tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:53.684001 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a98aa191-95ca-4d70-9062-267345e5f1fb tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:53.833868 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a98aa191-95ca-4d70-9062-267345e5f1fb tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:53.845182 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a98aa191-95ca-4d70-9062-267345e5f1fb tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90" status: 200 len: 1515 microversion: 2.1 time: 0.182965 Aug 31 16:46:53.845864 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3377/6936] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:53 2022] GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90 => generated 1515 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:54.873568 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-91d95285-467d-474f-9779-1ac0ace1ae9d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:54.874336 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-91d95285-467d-474f-9779-1ac0ace1ae9d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:54.881312 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91d95285-467d-474f-9779-1ac0ace1ae9d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:54.881968 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91d95285-467d-474f-9779-1ac0ace1ae9d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:54.882492 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91d95285-467d-474f-9779-1ac0ace1ae9d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:54.883253 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91d95285-467d-474f-9779-1ac0ace1ae9d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:54.883761 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91d95285-467d-474f-9779-1ac0ace1ae9d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:54.884204 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91d95285-467d-474f-9779-1ac0ace1ae9d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:55.037440 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-91d95285-467d-474f-9779-1ac0ace1ae9d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:55.049852 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-91d95285-467d-474f-9779-1ac0ace1ae9d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90" status: 200 len: 1515 microversion: 2.1 time: 0.181434 Aug 31 16:46:55.050840 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3560/6937] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:54 2022] GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90 => generated 1515 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:56.076909 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7a0056bb-f1a1-4ecb-8da3-d1240ef42c31 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:56.077609 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7a0056bb-f1a1-4ecb-8da3-d1240ef42c31 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:56.085190 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a0056bb-f1a1-4ecb-8da3-d1240ef42c31 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:56.085682 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a0056bb-f1a1-4ecb-8da3-d1240ef42c31 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:56.086156 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a0056bb-f1a1-4ecb-8da3-d1240ef42c31 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:56.087557 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a0056bb-f1a1-4ecb-8da3-d1240ef42c31 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:56.088034 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a0056bb-f1a1-4ecb-8da3-d1240ef42c31 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:56.088474 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7a0056bb-f1a1-4ecb-8da3-d1240ef42c31 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:56.248190 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7a0056bb-f1a1-4ecb-8da3-d1240ef42c31 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:56.256903 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7a0056bb-f1a1-4ecb-8da3-d1240ef42c31 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90" status: 200 len: 1507 microversion: 2.1 time: 0.183969 Aug 31 16:46:56.257474 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3378/6938] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:56 2022] GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90 => generated 1507 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:56.280475 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-86e9ef84-d29e-4c75-a181-271492b4ec9c tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:56.281086 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-86e9ef84-d29e-4c75-a181-271492b4ec9c tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:56.290456 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-86e9ef84-d29e-4c75-a181-271492b4ec9c tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:56.290980 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-86e9ef84-d29e-4c75-a181-271492b4ec9c tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:56.291440 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-86e9ef84-d29e-4c75-a181-271492b4ec9c tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:56.292160 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-86e9ef84-d29e-4c75-a181-271492b4ec9c tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:56.292626 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-86e9ef84-d29e-4c75-a181-271492b4ec9c tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:56.293066 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-86e9ef84-d29e-4c75-a181-271492b4ec9c tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:56.399939 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-dc758afe-d7fb-4212-a575-bda79a84e88a req-0b9d66da-b587-430b-8b74-a3d5c53c5d86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82b2210a-de3a-48bd-866d-cf681ad8cd90", "name": "network-vif-plugged", "status": "completed", "tag": "771e6f5e-f80b-4582-b76c-9d722e34dfda"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:46:56.414269 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-dc758afe-d7fb-4212-a575-bda79a84e88a req-0b9d66da-b587-430b-8b74-a3d5c53c5d86 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:56.415733 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-dc758afe-d7fb-4212-a575-bda79a84e88a req-0b9d66da-b587-430b-8b74-a3d5c53c5d86 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:56.416824 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-dc758afe-d7fb-4212-a575-bda79a84e88a req-0b9d66da-b587-430b-8b74-a3d5c53c5d86 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:56.438188 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-dc758afe-d7fb-4212-a575-bda79a84e88a req-0b9d66da-b587-430b-8b74-a3d5c53c5d86 service nova] Creating event network-vif-plugged:771e6f5e-f80b-4582-b76c-9d722e34dfda for instance 82b2210a-de3a-48bd-866d-cf681ad8cd90 on n-h1-833090-16 Aug 31 16:46:56.444215 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-dc758afe-d7fb-4212-a575-bda79a84e88a req-0b9d66da-b587-430b-8b74-a3d5c53c5d86 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048269 Aug 31 16:46:56.445390 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3379/6939] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:46:56.535245 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-86e9ef84-d29e-4c75-a181-271492b4ec9c tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:56.543980 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-86e9ef84-d29e-4c75-a181-271492b4ec9c tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90" status: 200 len: 1507 microversion: 2.1 time: 0.269292 Aug 31 16:46:56.544598 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3561/6940] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:56 2022] GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90 => generated 1507 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:56.569180 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f5f92f3c-603f-4859-8e5d-c314d10b7914 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Action: 'create', calling method: .version_select at 0x7fbb453cac10>, body: {"keypair": {"name": "tempest-keypair-1824275745", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKbPoeGY19ySlRecpg1us3Cc81fFEhOMHEXfRAg/+NYiX02cEzHOnxII8oIMknYFko1p20P0GWG3sUXAu8qjoPCL0hc7aWWYCYSn7iLWnxZv2mTzZqKy9Z96+h2hVFYpRw=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:46:56.585686 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-f5f92f3c-603f-4859-8e5d-c314d10b7914 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Getting quotas for project cf84b19774134ccaaf8f80c6c6bacf9c. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:46:56.591884 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-f5f92f3c-603f-4859-8e5d-c314d10b7914 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Getting quotas for user 5181164c428d4e38afc8d8195f730ed4 and project cf84b19774134ccaaf8f80c6c6bacf9c. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:46:56.624920 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f5f92f3c-603f-4859-8e5d-c314d10b7914 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.060042 Aug 31 16:46:56.626025 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3380/6941] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 31 16:46:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:46:58.014804 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e3fc87f8-2e8b-41e8-9a32-9faf9d1f3f8c tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:58.015454 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e3fc87f8-2e8b-41e8-9a32-9faf9d1f3f8c tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:58.023426 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e3fc87f8-2e8b-41e8-9a32-9faf9d1f3f8c tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:58.024037 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e3fc87f8-2e8b-41e8-9a32-9faf9d1f3f8c tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:58.024739 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e3fc87f8-2e8b-41e8-9a32-9faf9d1f3f8c tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:58.025448 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e3fc87f8-2e8b-41e8-9a32-9faf9d1f3f8c tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:58.025920 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e3fc87f8-2e8b-41e8-9a32-9faf9d1f3f8c tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:58.026390 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e3fc87f8-2e8b-41e8-9a32-9faf9d1f3f8c tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:58.173401 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e3fc87f8-2e8b-41e8-9a32-9faf9d1f3f8c tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:58.183457 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e3fc87f8-2e8b-41e8-9a32-9faf9d1f3f8c tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90" status: 200 len: 1507 microversion: 2.1 time: 0.172681 Aug 31 16:46:58.184136 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3562/6942] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:58 2022] GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90 => generated 1507 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:46:58.206717 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-da22fb10-b192-4952-9cf9-d648f341411b tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:58.207349 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-da22fb10-b192-4952-9cf9-d648f341411b tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:58.215553 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da22fb10-b192-4952-9cf9-d648f341411b tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:58.216037 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da22fb10-b192-4952-9cf9-d648f341411b tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:58.216466 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da22fb10-b192-4952-9cf9-d648f341411b tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:58.217201 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da22fb10-b192-4952-9cf9-d648f341411b tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:58.217649 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da22fb10-b192-4952-9cf9-d648f341411b tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:58.218117 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-da22fb10-b192-4952-9cf9-d648f341411b tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:58.244470 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-da22fb10-b192-4952-9cf9-d648f341411b tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:46:58.342374 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-da22fb10-b192-4952-9cf9-d648f341411b tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "DELETE /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90" status: 204 len: 0 microversion: 2.1 time: 0.140209 Aug 31 16:46:58.342976 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3381/6943] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:46:58 2022] DELETE /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:46:58.410950 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-206e72b6-7300-4f94-b8bd-e27b5dc67436 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-203632427", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "f8703b94-40b6-44a6-b14b-c7ac4ae91e4a"}]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:46:58.472015 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-206e72b6-7300-4f94-b8bd-e27b5dc67436 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] validate_networks() for [('f8703b94-40b6-44a6-b14b-c7ac4ae91e4a', None, None, None, None, None)] {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:46:58.879832 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-206e72b6-7300-4f94-b8bd-e27b5dc67436 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:46:58.880303 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-206e72b6-7300-4f94-b8bd-e27b5dc67436 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:46:58.880784 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-206e72b6-7300-4f94-b8bd-e27b5dc67436 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:46:58.881204 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-206e72b6-7300-4f94-b8bd-e27b5dc67436 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:46:58.881645 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-206e72b6-7300-4f94-b8bd-e27b5dc67436 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:46:58.891259 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-206e72b6-7300-4f94-b8bd-e27b5dc67436 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:58.891760 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-206e72b6-7300-4f94-b8bd-e27b5dc67436 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:58.892207 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-206e72b6-7300-4f94-b8bd-e27b5dc67436 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:58.892936 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-206e72b6-7300-4f94-b8bd-e27b5dc67436 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:46:58.893404 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-206e72b6-7300-4f94-b8bd-e27b5dc67436 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:46:58.893841 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-206e72b6-7300-4f94-b8bd-e27b5dc67436 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:46:58.920857 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-206e72b6-7300-4f94-b8bd-e27b5dc67436 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Getting quotas for project cf84b19774134ccaaf8f80c6c6bacf9c. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:46:58.926626 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-206e72b6-7300-4f94-b8bd-e27b5dc67436 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Getting quotas for user 5181164c428d4e38afc8d8195f730ed4 and project cf84b19774134ccaaf8f80c6c6bacf9c. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:46:58.941069 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-206e72b6-7300-4f94-b8bd-e27b5dc67436 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:46:58.943505 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-206e72b6-7300-4f94-b8bd-e27b5dc67436 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:46:59.001364 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-206e72b6-7300-4f94-b8bd-e27b5dc67436 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.594852 Aug 31 16:46:59.002040 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3563/6944] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:46:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:46:59.014298 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8c5542cb-9c85-41c7-b6c2-81e493eae9f0 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:46:59.015009 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8c5542cb-9c85-41c7-b6c2-81e493eae9f0 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:46:59.077632 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8c5542cb-9c85-41c7-b6c2-81e493eae9f0 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:46:59.086542 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8c5542cb-9c85-41c7-b6c2-81e493eae9f0 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1" status: 200 len: 1217 microversion: 2.1 time: 0.075615 Aug 31 16:46:59.087422 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3382/6945] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:46:59 2022] GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 => generated 1217 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:00.110890 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c2fdc011-671f-42ab-9205-0199f4f06ce2 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:00.111452 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c2fdc011-671f-42ab-9205-0199f4f06ce2 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:00.120355 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c2fdc011-671f-42ab-9205-0199f4f06ce2 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:00.121286 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c2fdc011-671f-42ab-9205-0199f4f06ce2 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:00.121744 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c2fdc011-671f-42ab-9205-0199f4f06ce2 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:00.122571 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c2fdc011-671f-42ab-9205-0199f4f06ce2 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:00.123052 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c2fdc011-671f-42ab-9205-0199f4f06ce2 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:00.123482 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c2fdc011-671f-42ab-9205-0199f4f06ce2 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:00.129458 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:47:00.231575 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c2fdc011-671f-42ab-9205-0199f4f06ce2 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:00.246167 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c2fdc011-671f-42ab-9205-0199f4f06ce2 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1" status: 200 len: 1277 microversion: 2.1 time: 0.141102 Aug 31 16:47:00.247326 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3564/6946] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:00 2022] GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 => generated 1277 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:00.290960 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-adb3fdfe-5803-4d9c-9337-28b74aacbbdd req-2cc10d30-ef3c-470f-b649-dfa05bff050c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82b2210a-de3a-48bd-866d-cf681ad8cd90", "name": "network-vif-deleted", "tag": "771e6f5e-f80b-4582-b76c-9d722e34dfda"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:47:00.306466 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-adb3fdfe-5803-4d9c-9337-28b74aacbbdd req-2cc10d30-ef3c-470f-b649-dfa05bff050c service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:00.307188 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-adb3fdfe-5803-4d9c-9337-28b74aacbbdd req-2cc10d30-ef3c-470f-b649-dfa05bff050c service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:00.307748 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-adb3fdfe-5803-4d9c-9337-28b74aacbbdd req-2cc10d30-ef3c-470f-b649-dfa05bff050c service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:00.320215 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-adb3fdfe-5803-4d9c-9337-28b74aacbbdd req-2cc10d30-ef3c-470f-b649-dfa05bff050c service nova] Creating event network-vif-deleted:771e6f5e-f80b-4582-b76c-9d722e34dfda for instance 82b2210a-de3a-48bd-866d-cf681ad8cd90 on n-h1-833090-16 Aug 31 16:47:00.326282 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-adb3fdfe-5803-4d9c-9337-28b74aacbbdd req-2cc10d30-ef3c-470f-b649-dfa05bff050c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039232 Aug 31 16:47:00.327143 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3383/6947] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:47:01.269574 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ce2b38d6-281f-4abe-ae1b-e07900b0956d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:01.270238 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ce2b38d6-281f-4abe-ae1b-e07900b0956d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:01.278180 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ce2b38d6-281f-4abe-ae1b-e07900b0956d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:01.278593 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ce2b38d6-281f-4abe-ae1b-e07900b0956d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:01.279064 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ce2b38d6-281f-4abe-ae1b-e07900b0956d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:01.279815 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ce2b38d6-281f-4abe-ae1b-e07900b0956d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:01.280277 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ce2b38d6-281f-4abe-ae1b-e07900b0956d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:01.280710 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ce2b38d6-281f-4abe-ae1b-e07900b0956d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:01.420543 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ce2b38d6-281f-4abe-ae1b-e07900b0956d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:01.431070 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ce2b38d6-281f-4abe-ae1b-e07900b0956d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1" status: 200 len: 1317 microversion: 2.1 time: 0.166389 Aug 31 16:47:01.431961 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3565/6948] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:01 2022] GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:02.361021 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-251c069f-d3eb-4352-b963-71356cadcefb req-8d9e3b6a-1799-42f4-b48a-0a9b3af99f7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1", "tag": "2658cd67-f3f2-4818-a378-cbb1e47fb9fa"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:47:02.373144 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-251c069f-d3eb-4352-b963-71356cadcefb req-8d9e3b6a-1799-42f4-b48a-0a9b3af99f7e service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:02.373664 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-251c069f-d3eb-4352-b963-71356cadcefb req-8d9e3b6a-1799-42f4-b48a-0a9b3af99f7e service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:02.375017 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-251c069f-d3eb-4352-b963-71356cadcefb req-8d9e3b6a-1799-42f4-b48a-0a9b3af99f7e service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:02.389684 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-251c069f-d3eb-4352-b963-71356cadcefb req-8d9e3b6a-1799-42f4-b48a-0a9b3af99f7e service nova] Creating event network-changed:2658cd67-f3f2-4818-a378-cbb1e47fb9fa for instance 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 on n-h2-833090-16 Aug 31 16:47:02.395381 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-251c069f-d3eb-4352-b963-71356cadcefb req-8d9e3b6a-1799-42f4-b48a-0a9b3af99f7e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042956 Aug 31 16:47:02.396055 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3384/6949] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:47:02.456469 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-091d2f90-94ea-43a9-a428-fa5cd38634b4 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:02.457161 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-091d2f90-94ea-43a9-a428-fa5cd38634b4 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:02.466704 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-091d2f90-94ea-43a9-a428-fa5cd38634b4 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:02.467368 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-091d2f90-94ea-43a9-a428-fa5cd38634b4 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:02.468080 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-091d2f90-94ea-43a9-a428-fa5cd38634b4 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:02.469142 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-091d2f90-94ea-43a9-a428-fa5cd38634b4 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:02.469817 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-091d2f90-94ea-43a9-a428-fa5cd38634b4 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:02.470554 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-091d2f90-94ea-43a9-a428-fa5cd38634b4 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:02.648998 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-091d2f90-94ea-43a9-a428-fa5cd38634b4 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:02.660875 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-091d2f90-94ea-43a9-a428-fa5cd38634b4 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1" status: 200 len: 1317 microversion: 2.1 time: 0.210888 Aug 31 16:47:02.661721 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3566/6950] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:02 2022] GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 => generated 1317 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:03.687533 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-02e4c648-a2c6-4f36-97e1-cce506c4154f tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:03.688364 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-02e4c648-a2c6-4f36-97e1-cce506c4154f tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:03.695178 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02e4c648-a2c6-4f36-97e1-cce506c4154f tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:03.695659 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02e4c648-a2c6-4f36-97e1-cce506c4154f tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:03.696540 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02e4c648-a2c6-4f36-97e1-cce506c4154f tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:03.697249 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02e4c648-a2c6-4f36-97e1-cce506c4154f tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:03.697702 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02e4c648-a2c6-4f36-97e1-cce506c4154f tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:03.698463 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02e4c648-a2c6-4f36-97e1-cce506c4154f tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:03.839929 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-02e4c648-a2c6-4f36-97e1-cce506c4154f tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:03.849619 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-02e4c648-a2c6-4f36-97e1-cce506c4154f tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1" status: 200 len: 1317 microversion: 2.1 time: 0.167451 Aug 31 16:47:03.850300 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3385/6951] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:03 2022] GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:04.875446 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4aded81f-e565-4053-929f-26e29d3194d0 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:04.876146 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4aded81f-e565-4053-929f-26e29d3194d0 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:04.885064 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4aded81f-e565-4053-929f-26e29d3194d0 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:04.885637 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4aded81f-e565-4053-929f-26e29d3194d0 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:04.886124 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4aded81f-e565-4053-929f-26e29d3194d0 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:04.886989 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4aded81f-e565-4053-929f-26e29d3194d0 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:04.887344 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4aded81f-e565-4053-929f-26e29d3194d0 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:04.887781 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4aded81f-e565-4053-929f-26e29d3194d0 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:05.029629 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4aded81f-e565-4053-929f-26e29d3194d0 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:05.037785 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4aded81f-e565-4053-929f-26e29d3194d0 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1" status: 200 len: 1317 microversion: 2.1 time: 0.168177 Aug 31 16:47:05.038449 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3567/6952] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:04 2022] GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:06.060057 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-545d7296-031c-491b-b596-a8ecf5c4c6c0 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:06.060657 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-545d7296-031c-491b-b596-a8ecf5c4c6c0 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:06.068043 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-545d7296-031c-491b-b596-a8ecf5c4c6c0 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:06.068534 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-545d7296-031c-491b-b596-a8ecf5c4c6c0 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:06.068992 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-545d7296-031c-491b-b596-a8ecf5c4c6c0 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:06.069829 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-545d7296-031c-491b-b596-a8ecf5c4c6c0 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:06.070423 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-545d7296-031c-491b-b596-a8ecf5c4c6c0 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:06.070892 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-545d7296-031c-491b-b596-a8ecf5c4c6c0 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:06.213103 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-545d7296-031c-491b-b596-a8ecf5c4c6c0 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:06.221160 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-545d7296-031c-491b-b596-a8ecf5c4c6c0 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1" status: 200 len: 1317 microversion: 2.1 time: 0.165647 Aug 31 16:47:06.221734 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3386/6953] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:06 2022] GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:07.242818 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-16759eee-aa90-45c7-affd-c9d978cda689 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:07.244176 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-16759eee-aa90-45c7-affd-c9d978cda689 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:07.250921 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-16759eee-aa90-45c7-affd-c9d978cda689 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:07.251431 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-16759eee-aa90-45c7-affd-c9d978cda689 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:07.251883 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-16759eee-aa90-45c7-affd-c9d978cda689 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:07.252975 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-16759eee-aa90-45c7-affd-c9d978cda689 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:07.253738 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-16759eee-aa90-45c7-affd-c9d978cda689 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:07.254317 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-16759eee-aa90-45c7-affd-c9d978cda689 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:07.399849 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-16759eee-aa90-45c7-affd-c9d978cda689 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:07.408537 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-16759eee-aa90-45c7-affd-c9d978cda689 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1" status: 200 len: 1317 microversion: 2.1 time: 0.170311 Aug 31 16:47:07.409124 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3568/6954] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:07 2022] GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:07.655785 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-dedc8c66-a9d1-498b-8756-50a84c069fd6 req-712c5ed2-f4fd-45f8-90ec-5b424ed673ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1", "name": "network-vif-plugged", "status": "completed", "tag": "2658cd67-f3f2-4818-a378-cbb1e47fb9fa"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:47:07.667920 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-dedc8c66-a9d1-498b-8756-50a84c069fd6 req-712c5ed2-f4fd-45f8-90ec-5b424ed673ed service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:07.668393 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-dedc8c66-a9d1-498b-8756-50a84c069fd6 req-712c5ed2-f4fd-45f8-90ec-5b424ed673ed service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:07.668822 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-dedc8c66-a9d1-498b-8756-50a84c069fd6 req-712c5ed2-f4fd-45f8-90ec-5b424ed673ed service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:07.681946 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-dedc8c66-a9d1-498b-8756-50a84c069fd6 req-712c5ed2-f4fd-45f8-90ec-5b424ed673ed service nova] Creating event network-vif-plugged:2658cd67-f3f2-4818-a378-cbb1e47fb9fa for instance 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 on n-h2-833090-16 Aug 31 16:47:07.688502 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-dedc8c66-a9d1-498b-8756-50a84c069fd6 req-712c5ed2-f4fd-45f8-90ec-5b424ed673ed service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036460 Aug 31 16:47:07.689341 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3387/6955] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:47:08.429307 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-52f31502-4c41-404b-81f8-674ce9baea84 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:08.429913 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-52f31502-4c41-404b-81f8-674ce9baea84 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:08.439416 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-52f31502-4c41-404b-81f8-674ce9baea84 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:08.440701 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-52f31502-4c41-404b-81f8-674ce9baea84 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:08.441809 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-52f31502-4c41-404b-81f8-674ce9baea84 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:08.443505 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-52f31502-4c41-404b-81f8-674ce9baea84 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:08.444687 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-52f31502-4c41-404b-81f8-674ce9baea84 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:08.445870 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-52f31502-4c41-404b-81f8-674ce9baea84 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:08.601243 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-52f31502-4c41-404b-81f8-674ce9baea84 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:08.611553 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-52f31502-4c41-404b-81f8-674ce9baea84 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1" status: 200 len: 1317 microversion: 2.1 time: 0.184672 Aug 31 16:47:08.611553 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3569/6956] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:08 2022] GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 => generated 1317 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:09.634473 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:47:09.642787 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bc94ece6-e067-4581-9d8f-ebdef85aee39 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:09.644643 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bc94ece6-e067-4581-9d8f-ebdef85aee39 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:09.655897 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc94ece6-e067-4581-9d8f-ebdef85aee39 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:09.656308 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc94ece6-e067-4581-9d8f-ebdef85aee39 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:09.656744 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc94ece6-e067-4581-9d8f-ebdef85aee39 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:09.657451 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc94ece6-e067-4581-9d8f-ebdef85aee39 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:09.657910 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc94ece6-e067-4581-9d8f-ebdef85aee39 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:09.658361 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc94ece6-e067-4581-9d8f-ebdef85aee39 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:09.661029 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:47:09.803357 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bc94ece6-e067-4581-9d8f-ebdef85aee39 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:09.813115 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bc94ece6-e067-4581-9d8f-ebdef85aee39 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1" status: 200 len: 1506 microversion: 2.1 time: 0.181000 Aug 31 16:47:09.814024 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3388/6957] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:09 2022] GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 => generated 1506 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:09.839199 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5222c495-94dd-4686-88fb-2600a2901ee8 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:09.839818 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5222c495-94dd-4686-88fb-2600a2901ee8 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:09.841779 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:47:09.842506 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=6 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:47:09.844121 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:47:09.851455 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5222c495-94dd-4686-88fb-2600a2901ee8 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:09.852177 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5222c495-94dd-4686-88fb-2600a2901ee8 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:09.852566 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5222c495-94dd-4686-88fb-2600a2901ee8 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:09.853572 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5222c495-94dd-4686-88fb-2600a2901ee8 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:09.854419 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5222c495-94dd-4686-88fb-2600a2901ee8 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:09.855160 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5222c495-94dd-4686-88fb-2600a2901ee8 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:10.009420 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5222c495-94dd-4686-88fb-2600a2901ee8 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:10.017563 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5222c495-94dd-4686-88fb-2600a2901ee8 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1" status: 200 len: 1506 microversion: 2.1 time: 0.182756 Aug 31 16:47:10.018198 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3570/6958] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:09 2022] GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 => generated 1506 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:47:10.044115 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-40c70389-175d-4c67-84a7-baa3b45347ab tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:47:10.046541 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-40c70389-175d-4c67-84a7-baa3b45347ab tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:10.052846 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-40c70389-175d-4c67-84a7-baa3b45347ab tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:10.053366 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-40c70389-175d-4c67-84a7-baa3b45347ab tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:10.053803 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-40c70389-175d-4c67-84a7-baa3b45347ab tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:10.054544 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-40c70389-175d-4c67-84a7-baa3b45347ab tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:10.055013 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-40c70389-175d-4c67-84a7-baa3b45347ab tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:10.055683 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-40c70389-175d-4c67-84a7-baa3b45347ab tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:10.085329 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-40c70389-175d-4c67-84a7-baa3b45347ab tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:10.092152 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-40c70389-175d-4c67-84a7-baa3b45347ab tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1] Old instance type m1.heat2, new instance type m1.heat {{(pid=128863) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 31 16:47:10.098924 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-40c70389-175d-4c67-84a7-baa3b45347ab tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:47:10.099341 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-40c70389-175d-4c67-84a7-baa3b45347ab tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:47:10.099809 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-40c70389-175d-4c67-84a7-baa3b45347ab tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:47:10.100212 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-40c70389-175d-4c67-84a7-baa3b45347ab tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:47:10.100617 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-40c70389-175d-4c67-84a7-baa3b45347ab tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:47:10.167054 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-40c70389-175d-4c67-84a7-baa3b45347ab tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "POST /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1/action" status: 202 len: 0 microversion: 2.1 time: 0.128092 Aug 31 16:47:10.167681 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3389/6959] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:47:10 2022] POST /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:47:10.176306 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0243616f-487b-44f6-828c-a666e76ce4d7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:10.176932 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0243616f-487b-44f6-828c-a666e76ce4d7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:10.183371 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0243616f-487b-44f6-828c-a666e76ce4d7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:10.183879 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0243616f-487b-44f6-828c-a666e76ce4d7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:10.184387 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0243616f-487b-44f6-828c-a666e76ce4d7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:10.185110 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0243616f-487b-44f6-828c-a666e76ce4d7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:10.185595 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0243616f-487b-44f6-828c-a666e76ce4d7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:10.186019 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0243616f-487b-44f6-828c-a666e76ce4d7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:10.334442 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0243616f-487b-44f6-828c-a666e76ce4d7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:10.346465 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0243616f-487b-44f6-828c-a666e76ce4d7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1" status: 200 len: 1513 microversion: 2.1 time: 0.174044 Aug 31 16:47:10.346995 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3571/6960] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:10 2022] GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 => generated 1513 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:11.374647 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-83a3c38f-c596-4912-97fd-853a548cd0a3 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:11.375521 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-83a3c38f-c596-4912-97fd-853a548cd0a3 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:11.378401 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:47:11.385968 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83a3c38f-c596-4912-97fd-853a548cd0a3 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:11.386532 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83a3c38f-c596-4912-97fd-853a548cd0a3 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:11.386959 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83a3c38f-c596-4912-97fd-853a548cd0a3 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:11.387670 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83a3c38f-c596-4912-97fd-853a548cd0a3 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:11.388116 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83a3c38f-c596-4912-97fd-853a548cd0a3 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:11.388537 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83a3c38f-c596-4912-97fd-853a548cd0a3 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:11.541188 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-83a3c38f-c596-4912-97fd-853a548cd0a3 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:11.550962 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-83a3c38f-c596-4912-97fd-853a548cd0a3 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1" status: 200 len: 1513 microversion: 2.1 time: 0.185878 Aug 31 16:47:11.552065 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3390/6961] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:11 2022] GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 => generated 1513 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:12.573547 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-02714170-8891-4ca7-bd75-4a45f5357ded tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:12.574417 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-02714170-8891-4ca7-bd75-4a45f5357ded tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:12.581808 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-02714170-8891-4ca7-bd75-4a45f5357ded tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:12.582365 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-02714170-8891-4ca7-bd75-4a45f5357ded tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:12.582821 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-02714170-8891-4ca7-bd75-4a45f5357ded tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:12.583564 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-02714170-8891-4ca7-bd75-4a45f5357ded tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:12.584047 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-02714170-8891-4ca7-bd75-4a45f5357ded tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:12.584487 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-02714170-8891-4ca7-bd75-4a45f5357ded tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:12.737480 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-02714170-8891-4ca7-bd75-4a45f5357ded tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:12.747655 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-02714170-8891-4ca7-bd75-4a45f5357ded tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1" status: 200 len: 1518 microversion: 2.1 time: 0.178379 Aug 31 16:47:12.748251 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3572/6962] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:12 2022] GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 => generated 1518 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:13.771216 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ec56d8c0-1dd9-4c8a-888d-2ac74785d14d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:13.771915 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ec56d8c0-1dd9-4c8a-888d-2ac74785d14d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:13.780356 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ec56d8c0-1dd9-4c8a-888d-2ac74785d14d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:13.780915 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ec56d8c0-1dd9-4c8a-888d-2ac74785d14d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:13.781407 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ec56d8c0-1dd9-4c8a-888d-2ac74785d14d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:13.782225 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ec56d8c0-1dd9-4c8a-888d-2ac74785d14d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:13.782734 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ec56d8c0-1dd9-4c8a-888d-2ac74785d14d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:13.783214 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ec56d8c0-1dd9-4c8a-888d-2ac74785d14d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:13.921573 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ec56d8c0-1dd9-4c8a-888d-2ac74785d14d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:13.930355 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ec56d8c0-1dd9-4c8a-888d-2ac74785d14d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1" status: 200 len: 1518 microversion: 2.1 time: 0.164105 Aug 31 16:47:13.931105 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3391/6963] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:13 2022] GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 => generated 1518 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:14.962362 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7b67e9e9-9b74-4864-905c-d09697114a59 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:14.963036 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7b67e9e9-9b74-4864-905c-d09697114a59 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:14.970777 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7b67e9e9-9b74-4864-905c-d09697114a59 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:14.971281 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7b67e9e9-9b74-4864-905c-d09697114a59 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:14.971736 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7b67e9e9-9b74-4864-905c-d09697114a59 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:14.972449 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7b67e9e9-9b74-4864-905c-d09697114a59 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:14.972908 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7b67e9e9-9b74-4864-905c-d09697114a59 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:14.973351 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7b67e9e9-9b74-4864-905c-d09697114a59 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:15.116560 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7b67e9e9-9b74-4864-905c-d09697114a59 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:15.125582 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7b67e9e9-9b74-4864-905c-d09697114a59 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1" status: 200 len: 1518 microversion: 2.1 time: 0.170227 Aug 31 16:47:15.126193 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3573/6964] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:14 2022] GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 => generated 1518 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:16.148259 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a76cea17-bc6e-4c63-8677-c3542ed3738d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:16.149118 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a76cea17-bc6e-4c63-8677-c3542ed3738d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:16.157012 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a76cea17-bc6e-4c63-8677-c3542ed3738d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:16.157547 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a76cea17-bc6e-4c63-8677-c3542ed3738d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:16.158033 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a76cea17-bc6e-4c63-8677-c3542ed3738d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:16.158989 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a76cea17-bc6e-4c63-8677-c3542ed3738d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:16.159437 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a76cea17-bc6e-4c63-8677-c3542ed3738d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:16.159882 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a76cea17-bc6e-4c63-8677-c3542ed3738d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:16.299411 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a76cea17-bc6e-4c63-8677-c3542ed3738d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:16.309609 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a76cea17-bc6e-4c63-8677-c3542ed3738d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1" status: 200 len: 1518 microversion: 2.1 time: 0.166553 Aug 31 16:47:16.310227 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3392/6965] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:16 2022] GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 => generated 1518 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:17.332755 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c54a7dee-3e70-4972-8661-9575dd8ec64d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:17.333680 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c54a7dee-3e70-4972-8661-9575dd8ec64d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:17.341266 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c54a7dee-3e70-4972-8661-9575dd8ec64d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:17.341763 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c54a7dee-3e70-4972-8661-9575dd8ec64d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:17.342242 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c54a7dee-3e70-4972-8661-9575dd8ec64d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:17.342952 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c54a7dee-3e70-4972-8661-9575dd8ec64d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:17.343417 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c54a7dee-3e70-4972-8661-9575dd8ec64d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:17.343848 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c54a7dee-3e70-4972-8661-9575dd8ec64d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:17.490056 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c54a7dee-3e70-4972-8661-9575dd8ec64d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:17.498574 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c54a7dee-3e70-4972-8661-9575dd8ec64d tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1" status: 200 len: 1518 microversion: 2.1 time: 0.170584 Aug 31 16:47:17.499175 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3574/6966] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:17 2022] GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 => generated 1518 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:18.520889 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e57d6b7b-c933-489b-a39f-d68ad7e35103 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:18.521550 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e57d6b7b-c933-489b-a39f-d68ad7e35103 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:18.530063 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e57d6b7b-c933-489b-a39f-d68ad7e35103 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:18.530580 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e57d6b7b-c933-489b-a39f-d68ad7e35103 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:18.531034 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e57d6b7b-c933-489b-a39f-d68ad7e35103 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:18.531714 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e57d6b7b-c933-489b-a39f-d68ad7e35103 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:18.532164 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e57d6b7b-c933-489b-a39f-d68ad7e35103 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:18.532582 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e57d6b7b-c933-489b-a39f-d68ad7e35103 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:18.684653 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e57d6b7b-c933-489b-a39f-d68ad7e35103 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:18.693199 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e57d6b7b-c933-489b-a39f-d68ad7e35103 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1" status: 200 len: 1518 microversion: 2.1 time: 0.176835 Aug 31 16:47:18.693891 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3393/6967] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:18 2022] GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 => generated 1518 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:19.715314 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7d59c099-a96b-49b2-9926-1d6b42d0f4c5 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:19.715996 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7d59c099-a96b-49b2-9926-1d6b42d0f4c5 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:19.718947 n-d-833090-16 devstack@n-api.service[128864]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 16:47:19.719105 n-d-833090-16 devstack@n-api.service[128864]: Wed Aug 31 16:47:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 (ip 10.222.0.50) !!! Aug 31 16:47:19.725523 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7d59c099-a96b-49b2-9926-1d6b42d0f4c5 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:19.726022 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7d59c099-a96b-49b2-9926-1d6b42d0f4c5 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:19.726513 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7d59c099-a96b-49b2-9926-1d6b42d0f4c5 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:19.727222 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7d59c099-a96b-49b2-9926-1d6b42d0f4c5 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:19.727685 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7d59c099-a96b-49b2-9926-1d6b42d0f4c5 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:19.728121 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7d59c099-a96b-49b2-9926-1d6b42d0f4c5 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:19.897653 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7d59c099-a96b-49b2-9926-1d6b42d0f4c5 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:19.909868 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7d59c099-a96b-49b2-9926-1d6b42d0f4c5 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1" status: 200 len: 1518 microversion: 2.1 time: 0.198329 Aug 31 16:47:19.910699 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3575/6968] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:19 2022] GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 => generated 1518 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:20.934881 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bcc18d42-d90c-4819-8c94-32c538b04c53 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:20.935446 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bcc18d42-d90c-4819-8c94-32c538b04c53 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:20.942739 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bcc18d42-d90c-4819-8c94-32c538b04c53 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:20.943242 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bcc18d42-d90c-4819-8c94-32c538b04c53 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:20.943682 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bcc18d42-d90c-4819-8c94-32c538b04c53 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:20.944394 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bcc18d42-d90c-4819-8c94-32c538b04c53 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:20.944839 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bcc18d42-d90c-4819-8c94-32c538b04c53 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:20.945262 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bcc18d42-d90c-4819-8c94-32c538b04c53 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:21.097245 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bcc18d42-d90c-4819-8c94-32c538b04c53 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:21.110348 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bcc18d42-d90c-4819-8c94-32c538b04c53 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1" status: 200 len: 1518 microversion: 2.1 time: 0.179473 Aug 31 16:47:21.111854 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3394/6969] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:20 2022] GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 => generated 1518 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:22.141216 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4b9e4ad4-f6f8-44ec-8c46-1f881d2294b0 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:22.141833 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4b9e4ad4-f6f8-44ec-8c46-1f881d2294b0 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:22.149439 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4b9e4ad4-f6f8-44ec-8c46-1f881d2294b0 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:22.149932 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4b9e4ad4-f6f8-44ec-8c46-1f881d2294b0 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:22.150421 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4b9e4ad4-f6f8-44ec-8c46-1f881d2294b0 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:22.151136 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4b9e4ad4-f6f8-44ec-8c46-1f881d2294b0 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:22.151630 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4b9e4ad4-f6f8-44ec-8c46-1f881d2294b0 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:22.152323 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4b9e4ad4-f6f8-44ec-8c46-1f881d2294b0 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:22.289314 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4b9e4ad4-f6f8-44ec-8c46-1f881d2294b0 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:22.297676 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4b9e4ad4-f6f8-44ec-8c46-1f881d2294b0 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1" status: 200 len: 1518 microversion: 2.1 time: 0.161133 Aug 31 16:47:22.298307 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3576/6970] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:22 2022] GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 => generated 1518 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:23.326254 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6113e20a-defc-4a2e-8d5d-0d901035bb7a tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:23.326959 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6113e20a-defc-4a2e-8d5d-0d901035bb7a tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:23.335014 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6113e20a-defc-4a2e-8d5d-0d901035bb7a tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:23.335506 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6113e20a-defc-4a2e-8d5d-0d901035bb7a tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:23.335941 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6113e20a-defc-4a2e-8d5d-0d901035bb7a tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:23.336640 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6113e20a-defc-4a2e-8d5d-0d901035bb7a tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:23.337097 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6113e20a-defc-4a2e-8d5d-0d901035bb7a tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:23.337530 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6113e20a-defc-4a2e-8d5d-0d901035bb7a tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:23.518857 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6113e20a-defc-4a2e-8d5d-0d901035bb7a tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:23.532544 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6113e20a-defc-4a2e-8d5d-0d901035bb7a tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1" status: 200 len: 1518 microversion: 2.1 time: 0.212137 Aug 31 16:47:23.533317 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3395/6971] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:23 2022] GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 => generated 1518 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:24.561328 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7212211f-b81e-4e5b-bf27-f09d710eb1c6 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:24.562026 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7212211f-b81e-4e5b-bf27-f09d710eb1c6 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:24.570702 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7212211f-b81e-4e5b-bf27-f09d710eb1c6 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:24.571369 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7212211f-b81e-4e5b-bf27-f09d710eb1c6 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:24.572004 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7212211f-b81e-4e5b-bf27-f09d710eb1c6 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:24.572737 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7212211f-b81e-4e5b-bf27-f09d710eb1c6 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:24.573327 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7212211f-b81e-4e5b-bf27-f09d710eb1c6 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:24.574016 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7212211f-b81e-4e5b-bf27-f09d710eb1c6 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:24.719485 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7212211f-b81e-4e5b-bf27-f09d710eb1c6 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:24.728266 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7212211f-b81e-4e5b-bf27-f09d710eb1c6 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1" status: 200 len: 1518 microversion: 2.1 time: 0.172893 Aug 31 16:47:24.728856 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3577/6972] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:24 2022] GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 => generated 1518 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:25.753912 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-add79cde-87c1-4bea-8c0a-f14a6c518228 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:25.755137 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-add79cde-87c1-4bea-8c0a-f14a6c518228 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:25.764865 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-add79cde-87c1-4bea-8c0a-f14a6c518228 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:25.765359 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-add79cde-87c1-4bea-8c0a-f14a6c518228 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:25.765796 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-add79cde-87c1-4bea-8c0a-f14a6c518228 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:25.766503 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-add79cde-87c1-4bea-8c0a-f14a6c518228 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:25.766967 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-add79cde-87c1-4bea-8c0a-f14a6c518228 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:25.767383 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-add79cde-87c1-4bea-8c0a-f14a6c518228 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:25.922388 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-add79cde-87c1-4bea-8c0a-f14a6c518228 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:25.935021 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-add79cde-87c1-4bea-8c0a-f14a6c518228 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1" status: 200 len: 1518 microversion: 2.1 time: 0.187770 Aug 31 16:47:25.935619 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3396/6973] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:25 2022] GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 => generated 1518 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:26.955971 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-746017f4-cb99-4960-9fda-d8495123bf19 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:26.956588 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-746017f4-cb99-4960-9fda-d8495123bf19 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:26.964211 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-746017f4-cb99-4960-9fda-d8495123bf19 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:26.964890 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-746017f4-cb99-4960-9fda-d8495123bf19 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:26.965414 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-746017f4-cb99-4960-9fda-d8495123bf19 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:26.966155 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-746017f4-cb99-4960-9fda-d8495123bf19 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:26.966641 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-746017f4-cb99-4960-9fda-d8495123bf19 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:26.967070 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-746017f4-cb99-4960-9fda-d8495123bf19 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:27.107283 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-746017f4-cb99-4960-9fda-d8495123bf19 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:27.115375 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-746017f4-cb99-4960-9fda-d8495123bf19 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1" status: 200 len: 1518 microversion: 2.1 time: 0.163452 Aug 31 16:47:27.115956 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3578/6974] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:26 2022] GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 => generated 1518 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:28.137183 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-626490bc-3736-4e1f-8592-7e2796084ee5 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:28.137805 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-626490bc-3736-4e1f-8592-7e2796084ee5 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:28.146215 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-626490bc-3736-4e1f-8592-7e2796084ee5 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:28.146717 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-626490bc-3736-4e1f-8592-7e2796084ee5 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:28.147158 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-626490bc-3736-4e1f-8592-7e2796084ee5 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:28.147923 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-626490bc-3736-4e1f-8592-7e2796084ee5 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:28.148629 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-626490bc-3736-4e1f-8592-7e2796084ee5 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:28.149286 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-626490bc-3736-4e1f-8592-7e2796084ee5 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:28.301930 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-626490bc-3736-4e1f-8592-7e2796084ee5 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:28.312315 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-626490bc-3736-4e1f-8592-7e2796084ee5 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1" status: 200 len: 1518 microversion: 2.1 time: 0.179362 Aug 31 16:47:28.313400 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3397/6975] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:28 2022] GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 => generated 1518 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:29.338705 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e87eda59-55c2-4678-aa1b-a1a1f143068a tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:29.340020 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e87eda59-55c2-4678-aa1b-a1a1f143068a tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:29.352699 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e87eda59-55c2-4678-aa1b-a1a1f143068a tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:29.353536 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e87eda59-55c2-4678-aa1b-a1a1f143068a tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:29.354361 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e87eda59-55c2-4678-aa1b-a1a1f143068a tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:29.356083 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e87eda59-55c2-4678-aa1b-a1a1f143068a tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:29.356566 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e87eda59-55c2-4678-aa1b-a1a1f143068a tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:29.357011 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e87eda59-55c2-4678-aa1b-a1a1f143068a tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:29.500348 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e87eda59-55c2-4678-aa1b-a1a1f143068a tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:29.512395 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e87eda59-55c2-4678-aa1b-a1a1f143068a tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1" status: 200 len: 1518 microversion: 2.1 time: 0.180551 Aug 31 16:47:29.513491 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3579/6976] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:29 2022] GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 => generated 1518 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:30.539094 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-82a55f4b-f951-47cf-849a-673ad59aafdf tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:30.540315 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-82a55f4b-f951-47cf-849a-673ad59aafdf tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:30.552787 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-82a55f4b-f951-47cf-849a-673ad59aafdf tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:30.553604 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-82a55f4b-f951-47cf-849a-673ad59aafdf tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:30.554438 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-82a55f4b-f951-47cf-849a-673ad59aafdf tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:30.555635 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-82a55f4b-f951-47cf-849a-673ad59aafdf tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:30.556414 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-82a55f4b-f951-47cf-849a-673ad59aafdf tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:30.557144 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-82a55f4b-f951-47cf-849a-673ad59aafdf tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:30.694957 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-82a55f4b-f951-47cf-849a-673ad59aafdf tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:30.702886 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-82a55f4b-f951-47cf-849a-673ad59aafdf tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1" status: 200 len: 1518 microversion: 2.1 time: 0.170751 Aug 31 16:47:30.703466 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3398/6977] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:30 2022] GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 => generated 1518 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:31.726656 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c92bc6e9-0cf3-4a62-b5d2-9d545400a8b7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:31.727541 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c92bc6e9-0cf3-4a62-b5d2-9d545400a8b7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:31.736240 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c92bc6e9-0cf3-4a62-b5d2-9d545400a8b7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:31.736745 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c92bc6e9-0cf3-4a62-b5d2-9d545400a8b7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:31.737196 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c92bc6e9-0cf3-4a62-b5d2-9d545400a8b7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:31.737910 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c92bc6e9-0cf3-4a62-b5d2-9d545400a8b7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:31.738417 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c92bc6e9-0cf3-4a62-b5d2-9d545400a8b7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:31.738854 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c92bc6e9-0cf3-4a62-b5d2-9d545400a8b7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:31.741703 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=96 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:47:31.889985 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c92bc6e9-0cf3-4a62-b5d2-9d545400a8b7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:31.898721 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c92bc6e9-0cf3-4a62-b5d2-9d545400a8b7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1" status: 200 len: 1518 microversion: 2.1 time: 0.178526 Aug 31 16:47:31.899349 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3580/6978] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:31 2022] GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 => generated 1518 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:32.924088 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e2298ade-fd5d-408c-8ae4-ce69fb54c528 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:32.924732 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e2298ade-fd5d-408c-8ae4-ce69fb54c528 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:32.932681 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2298ade-fd5d-408c-8ae4-ce69fb54c528 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:32.933183 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2298ade-fd5d-408c-8ae4-ce69fb54c528 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:32.933624 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2298ade-fd5d-408c-8ae4-ce69fb54c528 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:32.934384 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2298ade-fd5d-408c-8ae4-ce69fb54c528 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:32.934854 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2298ade-fd5d-408c-8ae4-ce69fb54c528 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:32.935300 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2298ade-fd5d-408c-8ae4-ce69fb54c528 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:33.074936 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e2298ade-fd5d-408c-8ae4-ce69fb54c528 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:33.084058 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e2298ade-fd5d-408c-8ae4-ce69fb54c528 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1" status: 200 len: 1518 microversion: 2.1 time: 0.164465 Aug 31 16:47:33.084911 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3399/6979] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:32 2022] GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 => generated 1518 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:34.109655 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2849a838-106b-44c7-a550-4d455bc137a2 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:34.110253 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2849a838-106b-44c7-a550-4d455bc137a2 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:34.120822 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2849a838-106b-44c7-a550-4d455bc137a2 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:34.121343 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2849a838-106b-44c7-a550-4d455bc137a2 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:34.121799 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2849a838-106b-44c7-a550-4d455bc137a2 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:34.122580 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2849a838-106b-44c7-a550-4d455bc137a2 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:34.123041 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2849a838-106b-44c7-a550-4d455bc137a2 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:34.123479 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2849a838-106b-44c7-a550-4d455bc137a2 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:34.280732 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2849a838-106b-44c7-a550-4d455bc137a2 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:34.289650 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2849a838-106b-44c7-a550-4d455bc137a2 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1" status: 200 len: 1518 microversion: 2.1 time: 0.184166 Aug 31 16:47:34.290286 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3581/6980] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:34 2022] GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 => generated 1518 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:35.318846 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7e0bce71-e9d5-4efb-b661-369e0cd9aa65 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:35.319544 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7e0bce71-e9d5-4efb-b661-369e0cd9aa65 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:35.330596 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e0bce71-e9d5-4efb-b661-369e0cd9aa65 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:35.331417 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e0bce71-e9d5-4efb-b661-369e0cd9aa65 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:35.332146 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e0bce71-e9d5-4efb-b661-369e0cd9aa65 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:35.333265 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e0bce71-e9d5-4efb-b661-369e0cd9aa65 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:35.334333 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e0bce71-e9d5-4efb-b661-369e0cd9aa65 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:35.334333 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7e0bce71-e9d5-4efb-b661-369e0cd9aa65 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:35.491813 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7e0bce71-e9d5-4efb-b661-369e0cd9aa65 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:35.503811 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7e0bce71-e9d5-4efb-b661-369e0cd9aa65 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1" status: 200 len: 1518 microversion: 2.1 time: 0.189888 Aug 31 16:47:35.504433 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3400/6981] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:35 2022] GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 => generated 1518 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:36.528423 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a21eb04f-280b-4ee9-9c47-f731bee5d5a3 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:36.529086 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a21eb04f-280b-4ee9-9c47-f731bee5d5a3 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:36.537887 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a21eb04f-280b-4ee9-9c47-f731bee5d5a3 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:36.538657 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a21eb04f-280b-4ee9-9c47-f731bee5d5a3 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:36.539112 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a21eb04f-280b-4ee9-9c47-f731bee5d5a3 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:36.539844 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a21eb04f-280b-4ee9-9c47-f731bee5d5a3 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:36.540306 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a21eb04f-280b-4ee9-9c47-f731bee5d5a3 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:36.540749 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a21eb04f-280b-4ee9-9c47-f731bee5d5a3 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:36.687720 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a21eb04f-280b-4ee9-9c47-f731bee5d5a3 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:36.696150 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a21eb04f-280b-4ee9-9c47-f731bee5d5a3 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1" status: 200 len: 1518 microversion: 2.1 time: 0.174394 Aug 31 16:47:36.696771 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3582/6982] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:36 2022] GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 => generated 1518 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:37.719999 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-09bb631b-5c02-499f-a759-33fae1ce8633 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:37.720982 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-09bb631b-5c02-499f-a759-33fae1ce8633 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:37.730831 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09bb631b-5c02-499f-a759-33fae1ce8633 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:37.731326 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09bb631b-5c02-499f-a759-33fae1ce8633 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:37.731763 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09bb631b-5c02-499f-a759-33fae1ce8633 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:37.732464 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09bb631b-5c02-499f-a759-33fae1ce8633 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:37.732920 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09bb631b-5c02-499f-a759-33fae1ce8633 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:37.733345 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-09bb631b-5c02-499f-a759-33fae1ce8633 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:37.884495 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-09bb631b-5c02-499f-a759-33fae1ce8633 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:37.893753 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-09bb631b-5c02-499f-a759-33fae1ce8633 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1" status: 200 len: 1518 microversion: 2.1 time: 0.178947 Aug 31 16:47:37.894406 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3401/6983] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:37 2022] GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 => generated 1518 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:38.919046 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9a754a6f-4231-4ad9-8004-c2232b437bbd tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:38.920575 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9a754a6f-4231-4ad9-8004-c2232b437bbd tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:38.934617 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9a754a6f-4231-4ad9-8004-c2232b437bbd tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:38.935539 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9a754a6f-4231-4ad9-8004-c2232b437bbd tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:38.936556 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9a754a6f-4231-4ad9-8004-c2232b437bbd tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:38.937790 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9a754a6f-4231-4ad9-8004-c2232b437bbd tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:38.938655 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9a754a6f-4231-4ad9-8004-c2232b437bbd tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:38.939447 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9a754a6f-4231-4ad9-8004-c2232b437bbd tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:39.115380 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9a754a6f-4231-4ad9-8004-c2232b437bbd tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:39.124483 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9a754a6f-4231-4ad9-8004-c2232b437bbd tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1" status: 200 len: 1518 microversion: 2.1 time: 0.212318 Aug 31 16:47:39.125344 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3583/6984] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:38 2022] GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 => generated 1518 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:47:39.941594 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-bb783650-e0cd-44c8-bafd-affaca2ea5f8 req-2f74675f-df85-4685-9d5d-79df274d5d6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1", "name": "network-vif-unplugged", "status": "completed", "tag": "2658cd67-f3f2-4818-a378-cbb1e47fb9fa"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:47:39.951982 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-bb783650-e0cd-44c8-bafd-affaca2ea5f8 req-2f74675f-df85-4685-9d5d-79df274d5d6c service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:39.952626 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-bb783650-e0cd-44c8-bafd-affaca2ea5f8 req-2f74675f-df85-4685-9d5d-79df274d5d6c service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:39.953135 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-bb783650-e0cd-44c8-bafd-affaca2ea5f8 req-2f74675f-df85-4685-9d5d-79df274d5d6c service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:39.957193 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:47:39.965954 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-bb783650-e0cd-44c8-bafd-affaca2ea5f8 req-2f74675f-df85-4685-9d5d-79df274d5d6c service nova] Creating event network-vif-unplugged:2658cd67-f3f2-4818-a378-cbb1e47fb9fa for instance 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 on n-h1-833090-16 Aug 31 16:47:39.972751 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [req-bb783650-e0cd-44c8-bafd-affaca2ea5f8 req-2f74675f-df85-4685-9d5d-79df274d5d6c service nova] Instance 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-833090-16', 'n-h1-833090-16'} {{(pid=128863) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 16:47:39.985111 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-bb783650-e0cd-44c8-bafd-affaca2ea5f8 req-2f74675f-df85-4685-9d5d-79df274d5d6c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105988 Aug 31 16:47:39.985740 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3402/6985] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:47:40.148218 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a209513f-f130-4912-93a5-e102647d7466 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:40.148782 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a209513f-f130-4912-93a5-e102647d7466 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:40.152035 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=28 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:47:40.159402 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a209513f-f130-4912-93a5-e102647d7466 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:40.160018 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a209513f-f130-4912-93a5-e102647d7466 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:40.160556 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a209513f-f130-4912-93a5-e102647d7466 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:40.161376 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a209513f-f130-4912-93a5-e102647d7466 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:40.162274 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a209513f-f130-4912-93a5-e102647d7466 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:40.162925 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a209513f-f130-4912-93a5-e102647d7466 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:40.314368 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a209513f-f130-4912-93a5-e102647d7466 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:40.322879 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a209513f-f130-4912-93a5-e102647d7466 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1" status: 200 len: 1517 microversion: 2.1 time: 0.178857 Aug 31 16:47:40.324110 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3584/6986] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:40 2022] GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 => generated 1517 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:41.348465 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f55f01c8-be70-4941-b0e6-1c3e67a263eb tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:41.349053 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f55f01c8-be70-4941-b0e6-1c3e67a263eb tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:41.356411 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f55f01c8-be70-4941-b0e6-1c3e67a263eb tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:41.356897 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f55f01c8-be70-4941-b0e6-1c3e67a263eb tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:41.357542 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f55f01c8-be70-4941-b0e6-1c3e67a263eb tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:41.358317 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f55f01c8-be70-4941-b0e6-1c3e67a263eb tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:41.358771 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f55f01c8-be70-4941-b0e6-1c3e67a263eb tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:41.359199 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f55f01c8-be70-4941-b0e6-1c3e67a263eb tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:41.503009 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f55f01c8-be70-4941-b0e6-1c3e67a263eb tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:41.513991 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f55f01c8-be70-4941-b0e6-1c3e67a263eb tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1" status: 200 len: 1515 microversion: 2.1 time: 0.171039 Aug 31 16:47:41.514789 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3403/6987] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:41 2022] GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:42.010315 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-e639a1be-d11d-41aa-b204-86e93f38dce2 req-759a8c10-cf57-447e-a2e8-50d4689faf8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1", "tag": "2658cd67-f3f2-4818-a378-cbb1e47fb9fa"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:47:42.024315 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-e639a1be-d11d-41aa-b204-86e93f38dce2 req-759a8c10-cf57-447e-a2e8-50d4689faf8c service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:42.025268 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-e639a1be-d11d-41aa-b204-86e93f38dce2 req-759a8c10-cf57-447e-a2e8-50d4689faf8c service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:42.026181 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-e639a1be-d11d-41aa-b204-86e93f38dce2 req-759a8c10-cf57-447e-a2e8-50d4689faf8c service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:42.041610 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-e639a1be-d11d-41aa-b204-86e93f38dce2 req-759a8c10-cf57-447e-a2e8-50d4689faf8c service nova] Creating event network-changed:2658cd67-f3f2-4818-a378-cbb1e47fb9fa for instance 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 on n-h1-833090-16 Aug 31 16:47:42.048741 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [req-e639a1be-d11d-41aa-b204-86e93f38dce2 req-759a8c10-cf57-447e-a2e8-50d4689faf8c service nova] Instance 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-833090-16', 'n-h1-833090-16'} {{(pid=128864) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 16:47:42.063678 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-e639a1be-d11d-41aa-b204-86e93f38dce2 req-759a8c10-cf57-447e-a2e8-50d4689faf8c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060185 Aug 31 16:47:42.064284 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3585/6988] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:47:42.536343 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-99c4110e-a1ec-4f3d-8ab0-5f2d02c5c8db tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:42.536986 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-99c4110e-a1ec-4f3d-8ab0-5f2d02c5c8db tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:42.540852 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=28 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:47:42.549913 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99c4110e-a1ec-4f3d-8ab0-5f2d02c5c8db tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:42.550517 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99c4110e-a1ec-4f3d-8ab0-5f2d02c5c8db tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:42.550890 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99c4110e-a1ec-4f3d-8ab0-5f2d02c5c8db tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:42.551611 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99c4110e-a1ec-4f3d-8ab0-5f2d02c5c8db tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:42.552096 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99c4110e-a1ec-4f3d-8ab0-5f2d02c5c8db tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:42.552512 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99c4110e-a1ec-4f3d-8ab0-5f2d02c5c8db tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:42.693565 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-99c4110e-a1ec-4f3d-8ab0-5f2d02c5c8db tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:42.703515 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-99c4110e-a1ec-4f3d-8ab0-5f2d02c5c8db tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1" status: 200 len: 1512 microversion: 2.1 time: 0.171188 Aug 31 16:47:42.704158 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3404/6989] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:42 2022] GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 => generated 1512 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:42.725683 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e8e1d988-2121-4c00-8bf2-92a36bb82c37 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:47:42.726420 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e8e1d988-2121-4c00-8bf2-92a36bb82c37 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:42.733105 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e8e1d988-2121-4c00-8bf2-92a36bb82c37 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:42.733608 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e8e1d988-2121-4c00-8bf2-92a36bb82c37 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:42.734055 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e8e1d988-2121-4c00-8bf2-92a36bb82c37 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:42.734795 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e8e1d988-2121-4c00-8bf2-92a36bb82c37 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:42.735256 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e8e1d988-2121-4c00-8bf2-92a36bb82c37 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:42.735722 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e8e1d988-2121-4c00-8bf2-92a36bb82c37 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:42.799222 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e8e1d988-2121-4c00-8bf2-92a36bb82c37 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "POST /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1/action" status: 204 len: 0 microversion: 2.1 time: 0.077357 Aug 31 16:47:42.799894 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3586/6990] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:47:42 2022] POST /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1/action => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:47:42.810615 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f296d8cc-eb72-474c-8e47-6414081f8c35 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:42.811281 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f296d8cc-eb72-474c-8e47-6414081f8c35 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:42.818411 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f296d8cc-eb72-474c-8e47-6414081f8c35 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:42.819048 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f296d8cc-eb72-474c-8e47-6414081f8c35 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:42.819726 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f296d8cc-eb72-474c-8e47-6414081f8c35 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:42.820568 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f296d8cc-eb72-474c-8e47-6414081f8c35 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:42.821305 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f296d8cc-eb72-474c-8e47-6414081f8c35 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:42.821956 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f296d8cc-eb72-474c-8e47-6414081f8c35 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:42.967261 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f296d8cc-eb72-474c-8e47-6414081f8c35 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:42.975367 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f296d8cc-eb72-474c-8e47-6414081f8c35 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1" status: 200 len: 1512 microversion: 2.1 time: 0.171169 Aug 31 16:47:42.976109 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3405/6991] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:42 2022] GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 => generated 1512 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:44.004610 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-154a0c10-11cf-4185-8595-971cc4018d70 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:44.005671 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-154a0c10-11cf-4185-8595-971cc4018d70 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:44.015538 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-154a0c10-11cf-4185-8595-971cc4018d70 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:44.016049 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-154a0c10-11cf-4185-8595-971cc4018d70 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:44.016510 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-154a0c10-11cf-4185-8595-971cc4018d70 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:44.017228 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-154a0c10-11cf-4185-8595-971cc4018d70 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:44.018063 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-154a0c10-11cf-4185-8595-971cc4018d70 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:44.018542 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-154a0c10-11cf-4185-8595-971cc4018d70 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:44.162294 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-154a0c10-11cf-4185-8595-971cc4018d70 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:44.170762 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-154a0c10-11cf-4185-8595-971cc4018d70 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1" status: 200 len: 1512 microversion: 2.1 time: 0.175362 Aug 31 16:47:44.171652 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3587/6992] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:43 2022] GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 => generated 1512 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:45.192572 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-91e4fc4b-832e-4e9a-ae15-cbe2378259c7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:45.194065 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-91e4fc4b-832e-4e9a-ae15-cbe2378259c7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:45.201369 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91e4fc4b-832e-4e9a-ae15-cbe2378259c7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:45.201896 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91e4fc4b-832e-4e9a-ae15-cbe2378259c7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:45.202798 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91e4fc4b-832e-4e9a-ae15-cbe2378259c7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:45.204150 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91e4fc4b-832e-4e9a-ae15-cbe2378259c7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:45.204612 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91e4fc4b-832e-4e9a-ae15-cbe2378259c7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:45.205034 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-91e4fc4b-832e-4e9a-ae15-cbe2378259c7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:45.352762 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-91e4fc4b-832e-4e9a-ae15-cbe2378259c7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:45.361744 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-91e4fc4b-832e-4e9a-ae15-cbe2378259c7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1" status: 200 len: 1504 microversion: 2.1 time: 0.173306 Aug 31 16:47:45.362373 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3406/6993] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:45 2022] GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 => generated 1504 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:47:45.383032 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-bce4c1a5-08d5-4d39-8d34-cf64a4f9177c tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:45.383796 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-bce4c1a5-08d5-4d39-8d34-cf64a4f9177c tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:45.392033 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bce4c1a5-08d5-4d39-8d34-cf64a4f9177c tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:45.392877 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bce4c1a5-08d5-4d39-8d34-cf64a4f9177c tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:45.393342 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bce4c1a5-08d5-4d39-8d34-cf64a4f9177c tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:45.394065 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bce4c1a5-08d5-4d39-8d34-cf64a4f9177c tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:45.394690 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bce4c1a5-08d5-4d39-8d34-cf64a4f9177c tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:45.395136 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bce4c1a5-08d5-4d39-8d34-cf64a4f9177c tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:45.532389 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-bce4c1a5-08d5-4d39-8d34-cf64a4f9177c tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:45.540397 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-bce4c1a5-08d5-4d39-8d34-cf64a4f9177c tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1" status: 200 len: 1504 microversion: 2.1 time: 0.161606 Aug 31 16:47:45.540985 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3588/6994] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:45 2022] GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:45.561098 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cb6f9aac-4b95-46e2-8bb2-e31aeda75d1e tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:45.561667 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cb6f9aac-4b95-46e2-8bb2-e31aeda75d1e tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:45.569041 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb6f9aac-4b95-46e2-8bb2-e31aeda75d1e tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:45.569555 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb6f9aac-4b95-46e2-8bb2-e31aeda75d1e tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:45.569981 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb6f9aac-4b95-46e2-8bb2-e31aeda75d1e tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:45.570736 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb6f9aac-4b95-46e2-8bb2-e31aeda75d1e tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:45.571216 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb6f9aac-4b95-46e2-8bb2-e31aeda75d1e tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:45.571605 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb6f9aac-4b95-46e2-8bb2-e31aeda75d1e tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:45.715398 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cb6f9aac-4b95-46e2-8bb2-e31aeda75d1e tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:45.723800 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cb6f9aac-4b95-46e2-8bb2-e31aeda75d1e tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1" status: 200 len: 1504 microversion: 2.1 time: 0.166943 Aug 31 16:47:45.724387 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3407/6995] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:45 2022] GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:45.744867 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-08fe7271-9c2f-450c-b1a4-4dda94e521c7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:45.745427 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-08fe7271-9c2f-450c-b1a4-4dda94e521c7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:45.752642 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-08fe7271-9c2f-450c-b1a4-4dda94e521c7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:45.753167 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-08fe7271-9c2f-450c-b1a4-4dda94e521c7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:45.753620 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-08fe7271-9c2f-450c-b1a4-4dda94e521c7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:45.754367 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-08fe7271-9c2f-450c-b1a4-4dda94e521c7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:45.754816 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-08fe7271-9c2f-450c-b1a4-4dda94e521c7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:45.755283 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-08fe7271-9c2f-450c-b1a4-4dda94e521c7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:45.785149 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-08fe7271-9c2f-450c-b1a4-4dda94e521c7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:47:45.886159 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-08fe7271-9c2f-450c-b1a4-4dda94e521c7 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1" status: 204 len: 0 microversion: 2.1 time: 0.144895 Aug 31 16:47:45.886769 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3589/6996] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:47:45 2022] DELETE /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 16:47:45.907897 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9ea82cd6-2271-4eb8-bba2-78468d0fdd0f tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:45.908379 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9ea82cd6-2271-4eb8-bba2-78468d0fdd0f tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:45.915145 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9ea82cd6-2271-4eb8-bba2-78468d0fdd0f tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:45.915630 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9ea82cd6-2271-4eb8-bba2-78468d0fdd0f tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:45.916063 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9ea82cd6-2271-4eb8-bba2-78468d0fdd0f tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:45.916742 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9ea82cd6-2271-4eb8-bba2-78468d0fdd0f tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:45.917186 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9ea82cd6-2271-4eb8-bba2-78468d0fdd0f tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:45.917604 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9ea82cd6-2271-4eb8-bba2-78468d0fdd0f tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:45.947010 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9ea82cd6-2271-4eb8-bba2-78468d0fdd0f tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:47:45.995020 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.compute.api [None req-9ea82cd6-2271-4eb8-bba2-78468d0fdd0f tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1] Instance is already in deleting state, ignoring this request Aug 31 16:47:45.995857 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9ea82cd6-2271-4eb8-bba2-78468d0fdd0f tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1" status: 204 len: 0 microversion: 2.1 time: 0.092862 Aug 31 16:47:45.996469 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3408/6997] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:47:45 2022] DELETE /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:47:46.008668 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-67856e9f-d723-42b1-8966-9a8af8b36080 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:46.009574 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-67856e9f-d723-42b1-8966-9a8af8b36080 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:46.016252 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-67856e9f-d723-42b1-8966-9a8af8b36080 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:46.016758 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-67856e9f-d723-42b1-8966-9a8af8b36080 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:46.017214 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-67856e9f-d723-42b1-8966-9a8af8b36080 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:46.018612 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-67856e9f-d723-42b1-8966-9a8af8b36080 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:46.018833 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-67856e9f-d723-42b1-8966-9a8af8b36080 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:46.019265 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-67856e9f-d723-42b1-8966-9a8af8b36080 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:46.178842 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-67856e9f-d723-42b1-8966-9a8af8b36080 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:46.191171 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-67856e9f-d723-42b1-8966-9a8af8b36080 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1" status: 200 len: 1510 microversion: 2.1 time: 0.186492 Aug 31 16:47:46.192038 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3590/6998] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:46 2022] GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 => generated 1510 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:46.718520 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-ab74f50c-420c-48aa-a861-1668b347d652 req-809e4d3b-c7d7-42e8-a2ef-c977c9cc0473 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1", "name": "network-vif-plugged", "status": "completed", "tag": "2658cd67-f3f2-4818-a378-cbb1e47fb9fa"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:47:46.728505 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ab74f50c-420c-48aa-a861-1668b347d652 req-809e4d3b-c7d7-42e8-a2ef-c977c9cc0473 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:46.729014 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ab74f50c-420c-48aa-a861-1668b347d652 req-809e4d3b-c7d7-42e8-a2ef-c977c9cc0473 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:46.729447 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ab74f50c-420c-48aa-a861-1668b347d652 req-809e4d3b-c7d7-42e8-a2ef-c977c9cc0473 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:46.741428 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-ab74f50c-420c-48aa-a861-1668b347d652 req-809e4d3b-c7d7-42e8-a2ef-c977c9cc0473 service nova] Creating event network-vif-plugged:2658cd67-f3f2-4818-a378-cbb1e47fb9fa for instance 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 on n-h1-833090-16 Aug 31 16:47:46.746665 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-ab74f50c-420c-48aa-a861-1668b347d652 req-809e4d3b-c7d7-42e8-a2ef-c977c9cc0473 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089800 Aug 31 16:47:46.747269 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3409/6999] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:47:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:47:47.215538 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9b5ad03b-935e-40c9-81b0-af3ae9066c55 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:47.216212 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9b5ad03b-935e-40c9-81b0-af3ae9066c55 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:47.223854 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9b5ad03b-935e-40c9-81b0-af3ae9066c55 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:47.224359 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9b5ad03b-935e-40c9-81b0-af3ae9066c55 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:47.224808 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9b5ad03b-935e-40c9-81b0-af3ae9066c55 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:47.225525 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9b5ad03b-935e-40c9-81b0-af3ae9066c55 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:47.225967 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9b5ad03b-935e-40c9-81b0-af3ae9066c55 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:47.226458 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9b5ad03b-935e-40c9-81b0-af3ae9066c55 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:47.370906 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9b5ad03b-935e-40c9-81b0-af3ae9066c55 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5181164c428d4e38afc8d8195f730ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf84b19774134ccaaf8f80c6c6bacf9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:47:47.380580 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9b5ad03b-935e-40c9-81b0-af3ae9066c55 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1" status: 200 len: 1510 microversion: 2.1 time: 0.169120 Aug 31 16:47:47.381468 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3591/7000] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:47 2022] GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 => generated 1510 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:47:47.723006 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-43f2bd89-38a6-4f2c-8eac-560d9e59ae59 req-63a39416-b44b-4548-9318-68359fbe59e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1", "name": "network-vif-deleted", "tag": "2658cd67-f3f2-4818-a378-cbb1e47fb9fa"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:47:47.734277 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-43f2bd89-38a6-4f2c-8eac-560d9e59ae59 req-63a39416-b44b-4548-9318-68359fbe59e4 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:47.734770 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-43f2bd89-38a6-4f2c-8eac-560d9e59ae59 req-63a39416-b44b-4548-9318-68359fbe59e4 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:47.735236 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-43f2bd89-38a6-4f2c-8eac-560d9e59ae59 req-63a39416-b44b-4548-9318-68359fbe59e4 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:47.747824 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-43f2bd89-38a6-4f2c-8eac-560d9e59ae59 req-63a39416-b44b-4548-9318-68359fbe59e4 service nova] Creating event network-vif-deleted:2658cd67-f3f2-4818-a378-cbb1e47fb9fa for instance 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 on n-h1-833090-16 Aug 31 16:47:47.753577 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-43f2bd89-38a6-4f2c-8eac-560d9e59ae59 req-63a39416-b44b-4548-9318-68359fbe59e4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035593 Aug 31 16:47:47.757261 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3410/7001] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:47:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:47:48.405283 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b0bd9acc-4719-49ee-b29d-f2e7fa31415e tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:48.406123 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b0bd9acc-4719-49ee-b29d-f2e7fa31415e tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:48.416887 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b0bd9acc-4719-49ee-b29d-f2e7fa31415e tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:48.417550 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b0bd9acc-4719-49ee-b29d-f2e7fa31415e tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:48.418202 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b0bd9acc-4719-49ee-b29d-f2e7fa31415e tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:48.419152 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b0bd9acc-4719-49ee-b29d-f2e7fa31415e tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:48.419798 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b0bd9acc-4719-49ee-b29d-f2e7fa31415e tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:48.420579 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b0bd9acc-4719-49ee-b29d-f2e7fa31415e tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:48.435540 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-b0bd9acc-4719-49ee-b29d-f2e7fa31415e tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] HTTP exception thrown: Instance 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 could not be found. Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b0bd9acc-4719-49ee-b29d-f2e7fa31415e tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Request method failure captured: Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 HTTP/1.1 Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD5BGqayH0Rp6qBLHpVlIXRYRZJ-ENIB7H5bEjb_V0fCHNREh65VlLJZm7eF-iqZNJGziK_KnXDCA1HxwE4Ex3Rnyf0MYfEb703hhTJnccPZIFDoj5Kw43offu5YZ9AQPa2wjcV-2mhVJtOcv1gMRXaQj31NburRKqAOuBc377PAUdAQ Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: cf84b19774134ccaaf8f80c6c6bacf9c Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1481709990 Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cf84b19774134ccaaf8f80c6c6bacf9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cf84b19774134ccaaf8f80c6c6bacf9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cf84b19774134ccaaf8f80c6c6bacf9c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cf84b19774134ccaaf8f80c6c6bacf9c", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServerDiskConfigTestJSON-1481709990 Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: cf84b19774134ccaaf8f80c6c6bacf9c Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1481709990 Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServerDiskConfigTestJSON-1481709990-project Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 5181164c428d4e38afc8d8195f730ed4 Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServerDiskConfigTestJSON-1481709990-project Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 could not be found. Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1'} Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 could not be found. Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 could not be found. Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:47:48.437744 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:47:48.441882 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:47:48.441882 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:47:48.441882 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:47:48.441882 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:47:48.441882 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:47:48.441882 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 could not be found. Aug 31 16:47:48.441882 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:47:48.441882 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b0bd9acc-4719-49ee-b29d-f2e7fa31415e tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Returning 404 to user: Instance 0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:47:48.441882 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b0bd9acc-4719-49ee-b29d-f2e7fa31415e tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1" status: 404 len: 111 microversion: 2.1 time: 0.039494 Aug 31 16:47:48.441882 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3592/7002] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:48 2022] GET /compute/v2.1/servers/0bc114c0-eccc-4d69-8a3d-2a44a1afd1e1 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:47:48.449037 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fcfe6624-1be6-4ddf-bf93-ef12f023804e tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '.version_select at 0x7fbb4541aee0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:48.471937 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fcfe6624-1be6-4ddf-bf93-ef12f023804e tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1824275745" status: 202 len: 0 microversion: 2.1 time: 0.027207 Aug 31 16:47:48.472533 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3411/7003] 10.222.0.50 () {58 vars in 1221 bytes} [Wed Aug 31 16:47:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1824275745 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:47:49.120926 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1a6da90e-fb8b-46fb-a6bd-f1910d860063 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:49.121666 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1a6da90e-fb8b-46fb-a6bd-f1910d860063 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:49.131385 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a6da90e-fb8b-46fb-a6bd-f1910d860063 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:49.132075 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a6da90e-fb8b-46fb-a6bd-f1910d860063 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:49.132723 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a6da90e-fb8b-46fb-a6bd-f1910d860063 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:49.133705 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a6da90e-fb8b-46fb-a6bd-f1910d860063 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:49.134414 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a6da90e-fb8b-46fb-a6bd-f1910d860063 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:49.135052 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1a6da90e-fb8b-46fb-a6bd-f1910d860063 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:49.150801 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-1a6da90e-fb8b-46fb-a6bd-f1910d860063 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] HTTP exception thrown: Instance 82b2210a-de3a-48bd-866d-cf681ad8cd90 could not be found. Aug 31 16:47:49.152387 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1a6da90e-fb8b-46fb-a6bd-f1910d860063 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Request method failure captured: Aug 31 16:47:49.152387 n-d-833090-16 devstack@n-api.service[128864]: request: DELETE /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90 HTTP/1.1 Aug 31 16:47:49.152387 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:47:49.152387 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:47:49.152387 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:47:49.152387 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:47:49.152387 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:47:49.152387 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:47:49.152387 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:47:49.152387 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:47:49.152387 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD5BGqayH0Rp6qBLHpVlIXRYRZJ-ENIB7H5bEjb_V0fCHNREh65VlLJZm7eF-iqZNJGziK_KnXDCA1HxwE4Ex3Rnyf0MYfEb703hhTJnccPZIFDoj5Kw43offu5YZ9AQPa2wjcV-2mhVJtOcv1gMRXaQj31NburRKqAOuBc377PAUdAQ Aug 31 16:47:49.152387 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:47:49.152387 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:47:49.152387 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:47:49.152387 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:47:49.152387 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:47:49.152387 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:47:49.152387 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: cf84b19774134ccaaf8f80c6c6bacf9c Aug 31 16:47:49.152387 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1481709990 Aug 31 16:47:49.152387 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:47:49.152387 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:47:49.152387 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cf84b19774134ccaaf8f80c6c6bacf9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cf84b19774134ccaaf8f80c6c6bacf9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cf84b19774134ccaaf8f80c6c6bacf9c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cf84b19774134ccaaf8f80c6c6bacf9c", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:47:49.152387 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServerDiskConfigTestJSON-1481709990 Aug 31 16:47:49.152387 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: cf84b19774134ccaaf8f80c6c6bacf9c Aug 31 16:47:49.152387 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1481709990 Aug 31 16:47:49.152387 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServerDiskConfigTestJSON-1481709990-project Aug 31 16:47:49.152387 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:47:49.152387 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:47:49.152387 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 5181164c428d4e38afc8d8195f730ed4 Aug 31 16:47:49.152387 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServerDiskConfigTestJSON-1481709990-project Aug 31 16:47:49.152387 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:47:49.152387 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 82b2210a-de3a-48bd-866d-cf681ad8cd90 could not be found. Aug 31 16:47:49.152387 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '82b2210a-de3a-48bd-866d-cf681ad8cd90'} Aug 31 16:47:49.152387 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:47:49.152387 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:47:49.152387 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:47:49.152387 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:47:49.152387 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:47:49.152387 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:47:49.152387 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:47:49.152387 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:47:49.152387 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:47:49.152387 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:47:49.152387 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82b2210a-de3a-48bd-866d-cf681ad8cd90 could not be found. Aug 31 16:47:49.152387 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:47:49.152387 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:47:49.152387 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:47:49.152387 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:47:49.152387 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:47:49.152387 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:47:49.152387 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:47:49.152387 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:47:49.152387 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:47:49.152387 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:47:49.152387 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:47:49.152387 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:47:49.152387 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:47:49.152387 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:47:49.152387 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:47:49.152387 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:47:49.152387 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:47:49.152387 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:47:49.156896 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82b2210a-de3a-48bd-866d-cf681ad8cd90 could not be found. Aug 31 16:47:49.156896 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:47:49.156896 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:47:49.156896 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:47:49.156896 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:47:49.156896 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:47:49.156896 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:47:49.156896 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:47:49.156896 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:47:49.156896 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82b2210a-de3a-48bd-866d-cf681ad8cd90 could not be found. Aug 31 16:47:49.156896 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:47:49.156896 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1a6da90e-fb8b-46fb-a6bd-f1910d860063 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Returning 404 to user: Instance 82b2210a-de3a-48bd-866d-cf681ad8cd90 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:47:49.156896 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1a6da90e-fb8b-46fb-a6bd-f1910d860063 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "DELETE /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90" status: 404 len: 111 microversion: 2.1 time: 0.039364 Aug 31 16:47:49.156896 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3593/7004] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:47:49 2022] DELETE /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:47:49.163411 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c4f3b340-ffbd-42fc-a07a-b12169742d02 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:47:49.164181 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c4f3b340-ffbd-42fc-a07a-b12169742d02 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] [instance: 82b2210a-de3a-48bd-866d-cf681ad8cd90] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:47:49.171381 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4f3b340-ffbd-42fc-a07a-b12169742d02 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:49.171900 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4f3b340-ffbd-42fc-a07a-b12169742d02 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:49.172336 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4f3b340-ffbd-42fc-a07a-b12169742d02 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:49.173027 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4f3b340-ffbd-42fc-a07a-b12169742d02 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:47:49.173482 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4f3b340-ffbd-42fc-a07a-b12169742d02 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:47:49.173905 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4f3b340-ffbd-42fc-a07a-b12169742d02 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:47:49.187796 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-c4f3b340-ffbd-42fc-a07a-b12169742d02 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] HTTP exception thrown: Instance 82b2210a-de3a-48bd-866d-cf681ad8cd90 could not be found. Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c4f3b340-ffbd-42fc-a07a-b12169742d02 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Request method failure captured: Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90 HTTP/1.1 Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD5BGqayH0Rp6qBLHpVlIXRYRZJ-ENIB7H5bEjb_V0fCHNREh65VlLJZm7eF-iqZNJGziK_KnXDCA1HxwE4Ex3Rnyf0MYfEb703hhTJnccPZIFDoj5Kw43offu5YZ9AQPa2wjcV-2mhVJtOcv1gMRXaQj31NburRKqAOuBc377PAUdAQ Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: cf84b19774134ccaaf8f80c6c6bacf9c Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1481709990 Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cf84b19774134ccaaf8f80c6c6bacf9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cf84b19774134ccaaf8f80c6c6bacf9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cf84b19774134ccaaf8f80c6c6bacf9c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cf84b19774134ccaaf8f80c6c6bacf9c", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServerDiskConfigTestJSON-1481709990 Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: cf84b19774134ccaaf8f80c6c6bacf9c Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1481709990 Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServerDiskConfigTestJSON-1481709990-project Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 5181164c428d4e38afc8d8195f730ed4 Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServerDiskConfigTestJSON-1481709990-project Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 82b2210a-de3a-48bd-866d-cf681ad8cd90 could not be found. Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '82b2210a-de3a-48bd-866d-cf681ad8cd90'} Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82b2210a-de3a-48bd-866d-cf681ad8cd90 could not be found. Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82b2210a-de3a-48bd-866d-cf681ad8cd90 could not be found. Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:47:49.189550 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:47:49.193760 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:47:49.193760 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:47:49.193760 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:47:49.193760 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:47:49.193760 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:47:49.193760 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82b2210a-de3a-48bd-866d-cf681ad8cd90 could not be found. Aug 31 16:47:49.193760 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:47:49.193760 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c4f3b340-ffbd-42fc-a07a-b12169742d02 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] Returning 404 to user: Instance 82b2210a-de3a-48bd-866d-cf681ad8cd90 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:47:49.193760 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c4f3b340-ffbd-42fc-a07a-b12169742d02 tempest-ServerDiskConfigTestJSON-1481709990 tempest-ServerDiskConfigTestJSON-1481709990-project] 10.222.0.50 "GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90" status: 404 len: 111 microversion: 2.1 time: 0.032445 Aug 31 16:47:49.193760 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3412/7005] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:47:49 2022] GET /compute/v2.1/servers/82b2210a-de3a-48bd-866d-cf681ad8cd90 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:47:58.168119 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3d8ba5b1-039d-488d-8aec-b5cbd999f056 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Action: 'create', calling method: .version_select at 0x7fbb4aa0d820>, body: {"keypair": {"name": "tempest-keypair-249207011", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIga6mwDxcdSMGauQwW3uys3SPosufaKOBxvICX6fBUYyZSWQeXPFXcrerej5cgl9Yf3OB8eU7zkjYvp28Ho9941xpgRHsEE/HYFPN70RnZvZU72H/41mHHF976RLJcakA=="}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:47:58.184971 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-3d8ba5b1-039d-488d-8aec-b5cbd999f056 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Getting quotas for project fce77c4128d3448885217ac4d4744765. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:47:58.192826 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-3d8ba5b1-039d-488d-8aec-b5cbd999f056 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Getting quotas for user 689ff4da0acb4aafa5f44d42e68ab41d and project fce77c4128d3448885217ac4d4744765. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:47:58.242593 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3d8ba5b1-039d-488d-8aec-b5cbd999f056 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.200163 Aug 31 16:47:58.243234 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3594/7006] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 31 16:47:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:47:59.665202 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b3ee7605-f89a-4600-a2f9-16331d84860d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1387526302", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b8a9ec6f-b6c3-4e24-8c90-3b9785a6ff39"}], "security_groups": [{"name": "tempest-securitygroup--137403414"}], "key_name": "tempest-keypair-249207011", "user_data": "}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:47:59.674802 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:47:59.675473 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:47:59.781126 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-b3ee7605-f89a-4600-a2f9-16331d84860d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] validate_networks() for [('b8a9ec6f-b6c3-4e24-8c90-3b9785a6ff39', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:48:00.312003 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b3ee7605-f89a-4600-a2f9-16331d84860d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:48:00.312505 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b3ee7605-f89a-4600-a2f9-16331d84860d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:48:00.312978 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b3ee7605-f89a-4600-a2f9-16331d84860d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:48:00.313384 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b3ee7605-f89a-4600-a2f9-16331d84860d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:48:00.313791 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b3ee7605-f89a-4600-a2f9-16331d84860d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:48:00.323296 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3ee7605-f89a-4600-a2f9-16331d84860d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:48:00.323789 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3ee7605-f89a-4600-a2f9-16331d84860d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:48:00.324221 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3ee7605-f89a-4600-a2f9-16331d84860d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:48:00.324933 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3ee7605-f89a-4600-a2f9-16331d84860d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:48:00.325380 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3ee7605-f89a-4600-a2f9-16331d84860d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:48:00.325794 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3ee7605-f89a-4600-a2f9-16331d84860d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:48:00.343395 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-b3ee7605-f89a-4600-a2f9-16331d84860d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Getting quotas for project fce77c4128d3448885217ac4d4744765. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:48:00.348757 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-b3ee7605-f89a-4600-a2f9-16331d84860d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Getting quotas for user 689ff4da0acb4aafa5f44d42e68ab41d and project fce77c4128d3448885217ac4d4744765. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:48:00.361763 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b3ee7605-f89a-4600-a2f9-16331d84860d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:48:00.364042 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b3ee7605-f89a-4600-a2f9-16331d84860d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: b7113bf3-7742-450a-a22e-d88cd6d548d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:48:00.412051 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b3ee7605-f89a-4600-a2f9-16331d84860d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.751348 Aug 31 16:48:00.412883 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3413/7007] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:47:59 2022] POST /compute/v2.1/servers => generated 408 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:48:00.421717 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:48:00.430465 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-37e85741-c75f-4e9c-b7fc-0679241c5d86 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:48:00.431098 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-37e85741-c75f-4e9c-b7fc-0679241c5d86 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: b7113bf3-7742-450a-a22e-d88cd6d548d7] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:48:00.497983 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-37e85741-c75f-4e9c-b7fc-0679241c5d86 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:48:00.506260 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-37e85741-c75f-4e9c-b7fc-0679241c5d86 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7" status: 200 len: 1238 microversion: 2.1 time: 0.086375 Aug 31 16:48:00.507036 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3595/7008] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:48:00 2022] GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7 => generated 1238 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:48:01.528458 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e2905b35-52fa-4061-87cd-e7550456e16e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:48:01.529836 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e2905b35-52fa-4061-87cd-e7550456e16e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: b7113bf3-7742-450a-a22e-d88cd6d548d7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:48:01.541596 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2905b35-52fa-4061-87cd-e7550456e16e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:48:01.543356 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2905b35-52fa-4061-87cd-e7550456e16e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:48:01.544014 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2905b35-52fa-4061-87cd-e7550456e16e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:48:01.544888 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2905b35-52fa-4061-87cd-e7550456e16e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:48:01.545491 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2905b35-52fa-4061-87cd-e7550456e16e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:48:01.546340 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e2905b35-52fa-4061-87cd-e7550456e16e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:48:01.628624 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e2905b35-52fa-4061-87cd-e7550456e16e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:48:01.639589 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e2905b35-52fa-4061-87cd-e7550456e16e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7" status: 200 len: 1298 microversion: 2.1 time: 0.116132 Aug 31 16:48:01.653221 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3414/7009] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:48:01 2022] GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7 => generated 1298 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:48:02.661966 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1c211d60-0201-4c95-9591-167214022491 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:48:02.662719 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1c211d60-0201-4c95-9591-167214022491 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: b7113bf3-7742-450a-a22e-d88cd6d548d7] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:48:02.670929 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1c211d60-0201-4c95-9591-167214022491 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:48:02.671570 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1c211d60-0201-4c95-9591-167214022491 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:48:02.672142 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1c211d60-0201-4c95-9591-167214022491 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:48:02.672881 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1c211d60-0201-4c95-9591-167214022491 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:48:02.673406 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1c211d60-0201-4c95-9591-167214022491 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:48:02.673834 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1c211d60-0201-4c95-9591-167214022491 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:48:02.813598 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1c211d60-0201-4c95-9591-167214022491 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:48:02.822014 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1c211d60-0201-4c95-9591-167214022491 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7" status: 200 len: 1363 microversion: 2.1 time: 0.164110 Aug 31 16:48:02.822603 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3596/7010] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:48:02 2022] GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:48:03.111585 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-7fde1ef2-f64d-4416-9119-c5019f141db7 req-531f645d-6120-475a-a758-bf83465a8e4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7113bf3-7742-450a-a22e-d88cd6d548d7", "tag": "318b5abd-c67d-424a-a4f0-7b3478365106"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:48:03.126132 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7fde1ef2-f64d-4416-9119-c5019f141db7 req-531f645d-6120-475a-a758-bf83465a8e4a service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:48:03.127241 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7fde1ef2-f64d-4416-9119-c5019f141db7 req-531f645d-6120-475a-a758-bf83465a8e4a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:48:03.127241 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7fde1ef2-f64d-4416-9119-c5019f141db7 req-531f645d-6120-475a-a758-bf83465a8e4a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:48:03.140192 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-7fde1ef2-f64d-4416-9119-c5019f141db7 req-531f645d-6120-475a-a758-bf83465a8e4a service nova] Creating event network-changed:318b5abd-c67d-424a-a4f0-7b3478365106 for instance b7113bf3-7742-450a-a22e-d88cd6d548d7 on n-h2-833090-16 Aug 31 16:48:03.145975 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-7fde1ef2-f64d-4416-9119-c5019f141db7 req-531f645d-6120-475a-a758-bf83465a8e4a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038805 Aug 31 16:48:03.146998 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3415/7011] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:48:03.845908 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b74c5533-bedf-411b-821a-c8c7024342e7 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:48:03.846581 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b74c5533-bedf-411b-821a-c8c7024342e7 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: b7113bf3-7742-450a-a22e-d88cd6d548d7] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:48:03.853986 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b74c5533-bedf-411b-821a-c8c7024342e7 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:48:03.854545 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b74c5533-bedf-411b-821a-c8c7024342e7 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:48:03.854980 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b74c5533-bedf-411b-821a-c8c7024342e7 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:48:03.855721 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b74c5533-bedf-411b-821a-c8c7024342e7 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:48:03.856342 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b74c5533-bedf-411b-821a-c8c7024342e7 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:48:03.856841 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b74c5533-bedf-411b-821a-c8c7024342e7 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:48:03.996949 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b74c5533-bedf-411b-821a-c8c7024342e7 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:48:04.006186 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b74c5533-bedf-411b-821a-c8c7024342e7 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7" status: 200 len: 1363 microversion: 2.1 time: 0.165541 Aug 31 16:48:04.006801 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3597/7012] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:48:03 2022] GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:48:05.029252 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d0a518cd-b0c9-4e0c-aed1-861d789b695f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:48:05.030312 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d0a518cd-b0c9-4e0c-aed1-861d789b695f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: b7113bf3-7742-450a-a22e-d88cd6d548d7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:48:05.037561 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0a518cd-b0c9-4e0c-aed1-861d789b695f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:48:05.038071 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0a518cd-b0c9-4e0c-aed1-861d789b695f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:48:05.038546 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0a518cd-b0c9-4e0c-aed1-861d789b695f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:48:05.039258 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0a518cd-b0c9-4e0c-aed1-861d789b695f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:48:05.039723 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0a518cd-b0c9-4e0c-aed1-861d789b695f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:48:05.040188 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d0a518cd-b0c9-4e0c-aed1-861d789b695f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:48:05.186572 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d0a518cd-b0c9-4e0c-aed1-861d789b695f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:48:05.195231 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d0a518cd-b0c9-4e0c-aed1-861d789b695f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7" status: 200 len: 1363 microversion: 2.1 time: 0.171270 Aug 31 16:48:05.195840 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3416/7013] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:48:05 2022] GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:48:06.216631 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3d634b75-0da1-4ebe-9000-3fac7157fafb tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:48:06.217456 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3d634b75-0da1-4ebe-9000-3fac7157fafb tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: b7113bf3-7742-450a-a22e-d88cd6d548d7] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:48:06.225646 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3d634b75-0da1-4ebe-9000-3fac7157fafb tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:48:06.226232 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3d634b75-0da1-4ebe-9000-3fac7157fafb tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:48:06.226794 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3d634b75-0da1-4ebe-9000-3fac7157fafb tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:48:06.227551 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3d634b75-0da1-4ebe-9000-3fac7157fafb tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:48:06.228023 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3d634b75-0da1-4ebe-9000-3fac7157fafb tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:48:06.228492 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3d634b75-0da1-4ebe-9000-3fac7157fafb tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:48:06.373927 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3d634b75-0da1-4ebe-9000-3fac7157fafb tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:48:06.383992 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3d634b75-0da1-4ebe-9000-3fac7157fafb tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7" status: 200 len: 1363 microversion: 2.1 time: 0.171456 Aug 31 16:48:06.392492 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3598/7014] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:48:06 2022] GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:48:07.406083 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2f1fb8b6-32d5-4c27-aef0-2452d78308ac tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:48:07.406727 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2f1fb8b6-32d5-4c27-aef0-2452d78308ac tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: b7113bf3-7742-450a-a22e-d88cd6d548d7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:48:07.414980 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2f1fb8b6-32d5-4c27-aef0-2452d78308ac tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:48:07.415465 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2f1fb8b6-32d5-4c27-aef0-2452d78308ac tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:48:07.415897 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2f1fb8b6-32d5-4c27-aef0-2452d78308ac tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:48:07.416626 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2f1fb8b6-32d5-4c27-aef0-2452d78308ac tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:48:07.417074 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2f1fb8b6-32d5-4c27-aef0-2452d78308ac tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:48:07.417506 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2f1fb8b6-32d5-4c27-aef0-2452d78308ac tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:48:07.568298 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2f1fb8b6-32d5-4c27-aef0-2452d78308ac tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:48:07.577026 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2f1fb8b6-32d5-4c27-aef0-2452d78308ac tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7" status: 200 len: 1363 microversion: 2.1 time: 0.174823 Aug 31 16:48:07.577598 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3417/7015] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:48:07 2022] GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:48:08.598917 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c91ea04e-3341-40e5-9f6b-cdba5257f583 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:48:08.599440 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c91ea04e-3341-40e5-9f6b-cdba5257f583 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: b7113bf3-7742-450a-a22e-d88cd6d548d7] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:48:08.607087 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c91ea04e-3341-40e5-9f6b-cdba5257f583 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:48:08.607596 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c91ea04e-3341-40e5-9f6b-cdba5257f583 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:48:08.608099 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c91ea04e-3341-40e5-9f6b-cdba5257f583 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:48:08.608828 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c91ea04e-3341-40e5-9f6b-cdba5257f583 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:48:08.609322 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c91ea04e-3341-40e5-9f6b-cdba5257f583 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:48:08.609748 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c91ea04e-3341-40e5-9f6b-cdba5257f583 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:48:08.750326 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c91ea04e-3341-40e5-9f6b-cdba5257f583 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:48:08.758461 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c91ea04e-3341-40e5-9f6b-cdba5257f583 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7" status: 200 len: 1363 microversion: 2.1 time: 0.164059 Aug 31 16:48:08.759394 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3599/7016] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:48:08 2022] GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:48:09.779673 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-df8bccab-197c-4429-b19d-126cd7e4909d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:48:09.780616 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-df8bccab-197c-4429-b19d-126cd7e4909d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: b7113bf3-7742-450a-a22e-d88cd6d548d7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:48:09.788124 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df8bccab-197c-4429-b19d-126cd7e4909d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:48:09.788624 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df8bccab-197c-4429-b19d-126cd7e4909d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:48:09.789063 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df8bccab-197c-4429-b19d-126cd7e4909d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:48:09.789767 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df8bccab-197c-4429-b19d-126cd7e4909d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:48:09.790261 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df8bccab-197c-4429-b19d-126cd7e4909d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:48:09.790689 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df8bccab-197c-4429-b19d-126cd7e4909d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:48:09.900186 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-488dac84-198d-4177-a981-4789d065f905 req-a77fe910-04a9-4829-b279-d6f2ca8b2ce3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7113bf3-7742-450a-a22e-d88cd6d548d7", "name": "network-vif-plugged", "status": "completed", "tag": "318b5abd-c67d-424a-a4f0-7b3478365106"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:48:09.918627 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-488dac84-198d-4177-a981-4789d065f905 req-a77fe910-04a9-4829-b279-d6f2ca8b2ce3 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:48:09.919487 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-488dac84-198d-4177-a981-4789d065f905 req-a77fe910-04a9-4829-b279-d6f2ca8b2ce3 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:48:09.920167 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-488dac84-198d-4177-a981-4789d065f905 req-a77fe910-04a9-4829-b279-d6f2ca8b2ce3 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:48:09.932712 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-df8bccab-197c-4429-b19d-126cd7e4909d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:48:09.936134 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-488dac84-198d-4177-a981-4789d065f905 req-a77fe910-04a9-4829-b279-d6f2ca8b2ce3 service nova] Creating event network-vif-plugged:318b5abd-c67d-424a-a4f0-7b3478365106 for instance b7113bf3-7742-450a-a22e-d88cd6d548d7 on n-h2-833090-16 Aug 31 16:48:09.942927 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-df8bccab-197c-4429-b19d-126cd7e4909d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7" status: 200 len: 1363 microversion: 2.1 time: 0.167165 Aug 31 16:48:09.946186 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3418/7017] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:48:09 2022] GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:48:09.946328 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-488dac84-198d-4177-a981-4789d065f905 req-a77fe910-04a9-4829-b279-d6f2ca8b2ce3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048972 Aug 31 16:48:09.946328 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3600/7018] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:48:10.967029 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d59ad1af-0644-4c48-9a64-54654a40b5af tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:48:10.967661 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d59ad1af-0644-4c48-9a64-54654a40b5af tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: b7113bf3-7742-450a-a22e-d88cd6d548d7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:48:10.970225 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:48:10.970953 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:48:10.980506 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d59ad1af-0644-4c48-9a64-54654a40b5af tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:48:10.980996 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d59ad1af-0644-4c48-9a64-54654a40b5af tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:48:10.981428 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d59ad1af-0644-4c48-9a64-54654a40b5af tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:48:10.982156 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d59ad1af-0644-4c48-9a64-54654a40b5af tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:48:10.982607 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d59ad1af-0644-4c48-9a64-54654a40b5af tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:48:10.983025 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d59ad1af-0644-4c48-9a64-54654a40b5af tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:48:11.128176 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d59ad1af-0644-4c48-9a64-54654a40b5af tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:48:11.136230 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d59ad1af-0644-4c48-9a64-54654a40b5af tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7" status: 200 len: 1363 microversion: 2.1 time: 0.174241 Aug 31 16:48:11.137193 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3419/7019] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:48:10 2022] GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:48:12.156594 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=6 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:48:12.161777 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-81e04e4b-e06f-4eb3-bdda-357304a0b09c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:48:12.162532 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-81e04e4b-e06f-4eb3-bdda-357304a0b09c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: b7113bf3-7742-450a-a22e-d88cd6d548d7] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:48:12.164500 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:48:12.170941 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-81e04e4b-e06f-4eb3-bdda-357304a0b09c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:48:12.171448 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-81e04e4b-e06f-4eb3-bdda-357304a0b09c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:48:12.171894 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-81e04e4b-e06f-4eb3-bdda-357304a0b09c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:48:12.172603 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-81e04e4b-e06f-4eb3-bdda-357304a0b09c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:48:12.173073 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-81e04e4b-e06f-4eb3-bdda-357304a0b09c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:48:12.173504 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-81e04e4b-e06f-4eb3-bdda-357304a0b09c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:48:12.325536 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-81e04e4b-e06f-4eb3-bdda-357304a0b09c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:48:12.334978 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-81e04e4b-e06f-4eb3-bdda-357304a0b09c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7" status: 200 len: 1550 microversion: 2.1 time: 0.179842 Aug 31 16:48:12.335536 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3601/7020] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:48:12 2022] GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7 => generated 1550 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:48:12.355921 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f532a77a-972a-47bc-92cf-e31b5cd5ee41 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:48:12.356460 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f532a77a-972a-47bc-92cf-e31b5cd5ee41 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: b7113bf3-7742-450a-a22e-d88cd6d548d7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:48:12.364364 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f532a77a-972a-47bc-92cf-e31b5cd5ee41 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:48:12.364921 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f532a77a-972a-47bc-92cf-e31b5cd5ee41 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:48:12.365622 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f532a77a-972a-47bc-92cf-e31b5cd5ee41 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:48:12.366642 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f532a77a-972a-47bc-92cf-e31b5cd5ee41 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:48:12.367056 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f532a77a-972a-47bc-92cf-e31b5cd5ee41 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:48:12.367630 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f532a77a-972a-47bc-92cf-e31b5cd5ee41 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:48:12.457467 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f532a77a-972a-47bc-92cf-e31b5cd5ee41 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105361 Aug 31 16:48:12.458358 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3420/7021] 10.222.0.50 () {58 vars in 1275 bytes} [Wed Aug 31 16:48:12 2022] GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:48:13.905614 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-2a14d812-f518-4e53-ab53-dec3ade038bb req-68aaeb30-8e9b-47d8-a47e-94fed3e9a025 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7113bf3-7742-450a-a22e-d88cd6d548d7", "tag": "318b5abd-c67d-424a-a4f0-7b3478365106"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:48:13.915771 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-2a14d812-f518-4e53-ab53-dec3ade038bb req-68aaeb30-8e9b-47d8-a47e-94fed3e9a025 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:48:13.916228 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-2a14d812-f518-4e53-ab53-dec3ade038bb req-68aaeb30-8e9b-47d8-a47e-94fed3e9a025 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:48:13.916692 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-2a14d812-f518-4e53-ab53-dec3ade038bb req-68aaeb30-8e9b-47d8-a47e-94fed3e9a025 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:48:13.929351 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-2a14d812-f518-4e53-ab53-dec3ade038bb req-68aaeb30-8e9b-47d8-a47e-94fed3e9a025 service nova] Creating event network-changed:318b5abd-c67d-424a-a4f0-7b3478365106 for instance b7113bf3-7742-450a-a22e-d88cd6d548d7 on n-h2-833090-16 Aug 31 16:48:13.934955 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-2a14d812-f518-4e53-ab53-dec3ade038bb req-68aaeb30-8e9b-47d8-a47e-94fed3e9a025 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095732 Aug 31 16:48:13.935809 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3602/7022] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:48:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:49:29.149323 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:49:29.150271 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=38 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:49:29.155705 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-461d02da-356e-4753-9171-35c256ef9561 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:29.156339 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-461d02da-356e-4753-9171-35c256ef9561 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: b7113bf3-7742-450a-a22e-d88cd6d548d7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:29.164867 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-461d02da-356e-4753-9171-35c256ef9561 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:29.165391 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-461d02da-356e-4753-9171-35c256ef9561 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:29.165832 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-461d02da-356e-4753-9171-35c256ef9561 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:29.166644 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-461d02da-356e-4753-9171-35c256ef9561 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:29.167011 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-461d02da-356e-4753-9171-35c256ef9561 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:29.167441 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-461d02da-356e-4753-9171-35c256ef9561 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:29.318252 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-461d02da-356e-4753-9171-35c256ef9561 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:29.326581 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-461d02da-356e-4753-9171-35c256ef9561 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7" status: 200 len: 1669 microversion: 2.1 time: 0.180229 Aug 31 16:49:29.327157 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3421/7023] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:29 2022] GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7 => generated 1669 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:29.346395 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=3 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:49:29.347180 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=34 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:49:29.349175 n-d-833090-16 devstack@n-api.service[128864]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Aug 31 16:49:29.357519 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e20827e4-6d08-40d2-920a-f433d238d578 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:29.358305 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e20827e4-6d08-40d2-920a-f433d238d578 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: b7113bf3-7742-450a-a22e-d88cd6d548d7] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:29.368310 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e20827e4-6d08-40d2-920a-f433d238d578 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:29.368808 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e20827e4-6d08-40d2-920a-f433d238d578 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:29.369259 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e20827e4-6d08-40d2-920a-f433d238d578 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:29.369970 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e20827e4-6d08-40d2-920a-f433d238d578 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:29.370472 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e20827e4-6d08-40d2-920a-f433d238d578 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:29.370910 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e20827e4-6d08-40d2-920a-f433d238d578 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:29.512261 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e20827e4-6d08-40d2-920a-f433d238d578 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:29.520827 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e20827e4-6d08-40d2-920a-f433d238d578 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7" status: 200 len: 1669 microversion: 2.1 time: 0.177562 Aug 31 16:49:29.521401 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3603/7024] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:29 2022] GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7 => generated 1669 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:29.544474 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3bc654db-ad53-4251-a029-629e05de6a2f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:29.545191 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3bc654db-ad53-4251-a029-629e05de6a2f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: b7113bf3-7742-450a-a22e-d88cd6d548d7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:29.555735 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bc654db-ad53-4251-a029-629e05de6a2f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:29.556244 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bc654db-ad53-4251-a029-629e05de6a2f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:29.556872 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bc654db-ad53-4251-a029-629e05de6a2f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:29.557574 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bc654db-ad53-4251-a029-629e05de6a2f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:29.558027 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bc654db-ad53-4251-a029-629e05de6a2f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:29.558490 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3bc654db-ad53-4251-a029-629e05de6a2f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:29.703667 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3bc654db-ad53-4251-a029-629e05de6a2f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:29.712207 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3bc654db-ad53-4251-a029-629e05de6a2f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7" status: 200 len: 1669 microversion: 2.1 time: 0.174079 Aug 31 16:49:29.712808 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3422/7025] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:29 2022] GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7 => generated 1669 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:29.733583 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-586c7376-a3f5-4ba9-a922-a81cea8b7676 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:49:29.736059 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-586c7376-a3f5-4ba9-a922-a81cea8b7676 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: b7113bf3-7742-450a-a22e-d88cd6d548d7] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:29.743096 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-586c7376-a3f5-4ba9-a922-a81cea8b7676 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:29.743622 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-586c7376-a3f5-4ba9-a922-a81cea8b7676 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:29.744056 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-586c7376-a3f5-4ba9-a922-a81cea8b7676 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:29.744779 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-586c7376-a3f5-4ba9-a922-a81cea8b7676 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:29.745241 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-586c7376-a3f5-4ba9-a922-a81cea8b7676 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:29.746059 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-586c7376-a3f5-4ba9-a922-a81cea8b7676 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:29.776653 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-586c7376-a3f5-4ba9-a922-a81cea8b7676 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:29.783540 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-586c7376-a3f5-4ba9-a922-a81cea8b7676 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: b7113bf3-7742-450a-a22e-d88cd6d548d7] Old instance type m1.heat2, new instance type m1.heat {{(pid=128864) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 31 16:49:29.790716 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-586c7376-a3f5-4ba9-a922-a81cea8b7676 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:49:29.791144 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-586c7376-a3f5-4ba9-a922-a81cea8b7676 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:49:29.791797 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-586c7376-a3f5-4ba9-a922-a81cea8b7676 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:49:29.792044 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-586c7376-a3f5-4ba9-a922-a81cea8b7676 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:49:29.792473 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-586c7376-a3f5-4ba9-a922-a81cea8b7676 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:49:29.859817 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-586c7376-a3f5-4ba9-a922-a81cea8b7676 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "POST /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7/action" status: 202 len: 0 microversion: 2.1 time: 0.130546 Aug 31 16:49:29.860433 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3604/7026] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:49:29 2022] POST /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:49:29.869176 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f9241520-0aae-4d6e-9f13-6455825b89bf tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:29.869759 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f9241520-0aae-4d6e-9f13-6455825b89bf tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: b7113bf3-7742-450a-a22e-d88cd6d548d7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:29.876323 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9241520-0aae-4d6e-9f13-6455825b89bf tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:29.877455 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9241520-0aae-4d6e-9f13-6455825b89bf tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:29.877455 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9241520-0aae-4d6e-9f13-6455825b89bf tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:29.878212 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9241520-0aae-4d6e-9f13-6455825b89bf tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:29.878665 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9241520-0aae-4d6e-9f13-6455825b89bf tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:29.879084 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f9241520-0aae-4d6e-9f13-6455825b89bf tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:30.017720 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f9241520-0aae-4d6e-9f13-6455825b89bf tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:30.027047 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f9241520-0aae-4d6e-9f13-6455825b89bf tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7" status: 200 len: 1678 microversion: 2.1 time: 0.161751 Aug 31 16:49:30.027643 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3423/7027] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:29 2022] GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:31.050715 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-764eac12-3a25-455d-af5b-6e5c6294ca1c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:31.051327 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-764eac12-3a25-455d-af5b-6e5c6294ca1c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: b7113bf3-7742-450a-a22e-d88cd6d548d7] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:31.057952 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-764eac12-3a25-455d-af5b-6e5c6294ca1c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:31.058573 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-764eac12-3a25-455d-af5b-6e5c6294ca1c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:31.059026 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-764eac12-3a25-455d-af5b-6e5c6294ca1c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:31.059740 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-764eac12-3a25-455d-af5b-6e5c6294ca1c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:31.060225 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-764eac12-3a25-455d-af5b-6e5c6294ca1c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:31.060664 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-764eac12-3a25-455d-af5b-6e5c6294ca1c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:31.206393 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-764eac12-3a25-455d-af5b-6e5c6294ca1c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:31.214930 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-764eac12-3a25-455d-af5b-6e5c6294ca1c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7" status: 200 len: 1678 microversion: 2.1 time: 0.169544 Aug 31 16:49:31.215511 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3605/7028] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:31 2022] GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7 => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:32.236182 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-48a7a74f-5b9e-4e14-8dd1-89850eb041fc tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:32.237006 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-48a7a74f-5b9e-4e14-8dd1-89850eb041fc tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: b7113bf3-7742-450a-a22e-d88cd6d548d7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:32.244937 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-48a7a74f-5b9e-4e14-8dd1-89850eb041fc tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:32.245424 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-48a7a74f-5b9e-4e14-8dd1-89850eb041fc tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:32.245924 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-48a7a74f-5b9e-4e14-8dd1-89850eb041fc tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:32.246777 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-48a7a74f-5b9e-4e14-8dd1-89850eb041fc tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:32.247375 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-48a7a74f-5b9e-4e14-8dd1-89850eb041fc tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:32.247804 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-48a7a74f-5b9e-4e14-8dd1-89850eb041fc tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:32.386922 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-48a7a74f-5b9e-4e14-8dd1-89850eb041fc tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:32.395590 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-48a7a74f-5b9e-4e14-8dd1-89850eb041fc tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7" status: 200 len: 1683 microversion: 2.1 time: 0.163287 Aug 31 16:49:32.396177 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3424/7029] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:32 2022] GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7 => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:33.417640 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-53b9897b-010f-4d0f-8334-7f363a3f88ac tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:33.418243 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-53b9897b-010f-4d0f-8334-7f363a3f88ac tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: b7113bf3-7742-450a-a22e-d88cd6d548d7] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:33.425922 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-53b9897b-010f-4d0f-8334-7f363a3f88ac tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:33.426445 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-53b9897b-010f-4d0f-8334-7f363a3f88ac tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:33.427125 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-53b9897b-010f-4d0f-8334-7f363a3f88ac tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:33.427834 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-53b9897b-010f-4d0f-8334-7f363a3f88ac tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:33.428294 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-53b9897b-010f-4d0f-8334-7f363a3f88ac tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:33.428749 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-53b9897b-010f-4d0f-8334-7f363a3f88ac tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:33.573582 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-53b9897b-010f-4d0f-8334-7f363a3f88ac tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:33.582276 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-53b9897b-010f-4d0f-8334-7f363a3f88ac tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7" status: 200 len: 1683 microversion: 2.1 time: 0.168637 Aug 31 16:49:33.582859 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3606/7030] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:33 2022] GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7 => generated 1683 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:34.603847 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-55834bc4-81c1-4a00-af12-3fcee83dfb2f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:34.604454 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-55834bc4-81c1-4a00-af12-3fcee83dfb2f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: b7113bf3-7742-450a-a22e-d88cd6d548d7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:34.612096 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55834bc4-81c1-4a00-af12-3fcee83dfb2f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:34.612879 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55834bc4-81c1-4a00-af12-3fcee83dfb2f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:34.613370 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55834bc4-81c1-4a00-af12-3fcee83dfb2f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:34.614082 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55834bc4-81c1-4a00-af12-3fcee83dfb2f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:34.614743 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55834bc4-81c1-4a00-af12-3fcee83dfb2f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:34.615175 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-55834bc4-81c1-4a00-af12-3fcee83dfb2f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:34.756436 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-55834bc4-81c1-4a00-af12-3fcee83dfb2f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:34.764232 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-55834bc4-81c1-4a00-af12-3fcee83dfb2f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7" status: 200 len: 1683 microversion: 2.1 time: 0.164527 Aug 31 16:49:34.764801 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3425/7031] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:34 2022] GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7 => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:35.786375 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-18557047-5695-44fe-bf3d-28ebbbcaffbc tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:35.786972 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-18557047-5695-44fe-bf3d-28ebbbcaffbc tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: b7113bf3-7742-450a-a22e-d88cd6d548d7] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:35.795245 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-18557047-5695-44fe-bf3d-28ebbbcaffbc tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:35.795783 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-18557047-5695-44fe-bf3d-28ebbbcaffbc tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:35.796238 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-18557047-5695-44fe-bf3d-28ebbbcaffbc tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:35.796948 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-18557047-5695-44fe-bf3d-28ebbbcaffbc tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:35.797537 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-18557047-5695-44fe-bf3d-28ebbbcaffbc tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:35.797976 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-18557047-5695-44fe-bf3d-28ebbbcaffbc tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:35.944812 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-18557047-5695-44fe-bf3d-28ebbbcaffbc tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:35.956166 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-18557047-5695-44fe-bf3d-28ebbbcaffbc tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7" status: 200 len: 1683 microversion: 2.1 time: 0.174607 Aug 31 16:49:35.957224 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3607/7032] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:35 2022] GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7 => generated 1683 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:36.983707 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-75b966a7-cf78-4eaf-8c1c-955af1126d2b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:36.984304 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-75b966a7-cf78-4eaf-8c1c-955af1126d2b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: b7113bf3-7742-450a-a22e-d88cd6d548d7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:36.991778 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75b966a7-cf78-4eaf-8c1c-955af1126d2b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:36.992262 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75b966a7-cf78-4eaf-8c1c-955af1126d2b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:36.992753 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75b966a7-cf78-4eaf-8c1c-955af1126d2b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:36.993639 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75b966a7-cf78-4eaf-8c1c-955af1126d2b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:36.994200 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75b966a7-cf78-4eaf-8c1c-955af1126d2b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:36.994628 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-75b966a7-cf78-4eaf-8c1c-955af1126d2b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:37.143579 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-75b966a7-cf78-4eaf-8c1c-955af1126d2b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:37.152886 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-75b966a7-cf78-4eaf-8c1c-955af1126d2b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7" status: 200 len: 1683 microversion: 2.1 time: 0.173172 Aug 31 16:49:37.153471 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3426/7033] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:36 2022] GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7 => generated 1683 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:38.174935 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-05693381-7b80-409f-967e-7f5ea63ce56f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:38.175693 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-05693381-7b80-409f-967e-7f5ea63ce56f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: b7113bf3-7742-450a-a22e-d88cd6d548d7] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:38.183552 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-05693381-7b80-409f-967e-7f5ea63ce56f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:38.184056 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-05693381-7b80-409f-967e-7f5ea63ce56f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:38.184509 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-05693381-7b80-409f-967e-7f5ea63ce56f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:38.185220 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-05693381-7b80-409f-967e-7f5ea63ce56f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:38.185687 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-05693381-7b80-409f-967e-7f5ea63ce56f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:38.186136 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-05693381-7b80-409f-967e-7f5ea63ce56f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:38.348589 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-05693381-7b80-409f-967e-7f5ea63ce56f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:38.358897 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-05693381-7b80-409f-967e-7f5ea63ce56f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7" status: 200 len: 1683 microversion: 2.1 time: 0.188123 Aug 31 16:49:38.359520 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3608/7034] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:38 2022] GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7 => generated 1683 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:39.385253 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ccfdac24-1799-452d-855a-a4e0ed837424 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:39.385851 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ccfdac24-1799-452d-855a-a4e0ed837424 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: b7113bf3-7742-450a-a22e-d88cd6d548d7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:39.393447 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ccfdac24-1799-452d-855a-a4e0ed837424 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:39.393936 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ccfdac24-1799-452d-855a-a4e0ed837424 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:39.395066 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ccfdac24-1799-452d-855a-a4e0ed837424 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:39.395808 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ccfdac24-1799-452d-855a-a4e0ed837424 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:39.396293 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ccfdac24-1799-452d-855a-a4e0ed837424 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:39.396763 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ccfdac24-1799-452d-855a-a4e0ed837424 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:39.547760 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ccfdac24-1799-452d-855a-a4e0ed837424 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:39.557330 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ccfdac24-1799-452d-855a-a4e0ed837424 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7" status: 200 len: 1683 microversion: 2.1 time: 0.176129 Aug 31 16:49:39.557893 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3427/7035] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:39 2022] GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7 => generated 1683 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:40.578992 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a88472fc-1027-47dd-ab7e-4a82526385ae tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:40.579610 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a88472fc-1027-47dd-ab7e-4a82526385ae tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: b7113bf3-7742-450a-a22e-d88cd6d548d7] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:40.588146 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a88472fc-1027-47dd-ab7e-4a82526385ae tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:40.588617 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a88472fc-1027-47dd-ab7e-4a82526385ae tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:40.589057 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a88472fc-1027-47dd-ab7e-4a82526385ae tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:40.589784 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a88472fc-1027-47dd-ab7e-4a82526385ae tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:40.590285 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a88472fc-1027-47dd-ab7e-4a82526385ae tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:40.590716 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a88472fc-1027-47dd-ab7e-4a82526385ae tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:40.732178 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a88472fc-1027-47dd-ab7e-4a82526385ae tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:40.740593 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a88472fc-1027-47dd-ab7e-4a82526385ae tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7" status: 200 len: 1683 microversion: 2.1 time: 0.165659 Aug 31 16:49:40.741125 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3609/7036] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:40 2022] GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7 => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:41.766151 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5521d445-70c1-4a19-8a50-8c74f12ab7db tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:41.767182 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5521d445-70c1-4a19-8a50-8c74f12ab7db tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: b7113bf3-7742-450a-a22e-d88cd6d548d7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:41.776064 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5521d445-70c1-4a19-8a50-8c74f12ab7db tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:41.776551 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5521d445-70c1-4a19-8a50-8c74f12ab7db tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:41.776978 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5521d445-70c1-4a19-8a50-8c74f12ab7db tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:41.777682 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5521d445-70c1-4a19-8a50-8c74f12ab7db tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:41.778142 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5521d445-70c1-4a19-8a50-8c74f12ab7db tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:41.778574 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5521d445-70c1-4a19-8a50-8c74f12ab7db tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:41.932094 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5521d445-70c1-4a19-8a50-8c74f12ab7db tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:41.940944 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5521d445-70c1-4a19-8a50-8c74f12ab7db tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7" status: 200 len: 1683 microversion: 2.1 time: 0.181990 Aug 31 16:49:41.941534 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3428/7037] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:41 2022] GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7 => generated 1683 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:42.970359 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7f2e04d8-1365-4e65-aa0b-35632c8dd9c9 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:42.971020 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7f2e04d8-1365-4e65-aa0b-35632c8dd9c9 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: b7113bf3-7742-450a-a22e-d88cd6d548d7] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:42.981190 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f2e04d8-1365-4e65-aa0b-35632c8dd9c9 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:42.981799 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f2e04d8-1365-4e65-aa0b-35632c8dd9c9 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:42.982327 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f2e04d8-1365-4e65-aa0b-35632c8dd9c9 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:42.983136 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f2e04d8-1365-4e65-aa0b-35632c8dd9c9 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:42.983627 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f2e04d8-1365-4e65-aa0b-35632c8dd9c9 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:42.984185 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f2e04d8-1365-4e65-aa0b-35632c8dd9c9 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:43.134939 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7f2e04d8-1365-4e65-aa0b-35632c8dd9c9 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:43.144067 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7f2e04d8-1365-4e65-aa0b-35632c8dd9c9 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7" status: 200 len: 1683 microversion: 2.1 time: 0.178108 Aug 31 16:49:43.144732 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3610/7038] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:42 2022] GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7 => generated 1683 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:44.167966 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-639d1643-a7ef-4aba-a201-ad25e79fc720 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:44.168641 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-639d1643-a7ef-4aba-a201-ad25e79fc720 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: b7113bf3-7742-450a-a22e-d88cd6d548d7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:44.176444 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-639d1643-a7ef-4aba-a201-ad25e79fc720 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:44.177037 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-639d1643-a7ef-4aba-a201-ad25e79fc720 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:44.177465 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-639d1643-a7ef-4aba-a201-ad25e79fc720 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:44.178211 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-639d1643-a7ef-4aba-a201-ad25e79fc720 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:44.178663 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-639d1643-a7ef-4aba-a201-ad25e79fc720 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:44.179391 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-639d1643-a7ef-4aba-a201-ad25e79fc720 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:44.315665 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-c2a49a32-36ce-4bb5-b920-049142d969a2 req-5e2befbf-9b69-4c7a-b386-8baa4376e247 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7113bf3-7742-450a-a22e-d88cd6d548d7", "name": "network-vif-unplugged", "status": "completed", "tag": "318b5abd-c67d-424a-a4f0-7b3478365106"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:49:44.326850 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-c2a49a32-36ce-4bb5-b920-049142d969a2 req-5e2befbf-9b69-4c7a-b386-8baa4376e247 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:44.327356 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-c2a49a32-36ce-4bb5-b920-049142d969a2 req-5e2befbf-9b69-4c7a-b386-8baa4376e247 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:44.327826 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-c2a49a32-36ce-4bb5-b920-049142d969a2 req-5e2befbf-9b69-4c7a-b386-8baa4376e247 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:44.330900 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-639d1643-a7ef-4aba-a201-ad25e79fc720 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:44.341790 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-639d1643-a7ef-4aba-a201-ad25e79fc720 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7" status: 200 len: 1682 microversion: 2.1 time: 0.177877 Aug 31 16:49:44.345246 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-c2a49a32-36ce-4bb5-b920-049142d969a2 req-5e2befbf-9b69-4c7a-b386-8baa4376e247 service nova] Creating event network-vif-unplugged:318b5abd-c67d-424a-a4f0-7b3478365106 for instance b7113bf3-7742-450a-a22e-d88cd6d548d7 on n-h1-833090-16 Aug 31 16:49:44.351514 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [req-c2a49a32-36ce-4bb5-b920-049142d969a2 req-5e2befbf-9b69-4c7a-b386-8baa4376e247 service nova] Instance b7113bf3-7742-450a-a22e-d88cd6d548d7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-833090-16', 'n-h1-833090-16'} {{(pid=128864) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 16:49:44.355238 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3429/7039] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:44 2022] GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7 => generated 1682 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:49:44.363693 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-c2a49a32-36ce-4bb5-b920-049142d969a2 req-5e2befbf-9b69-4c7a-b386-8baa4376e247 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052211 Aug 31 16:49:44.364330 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3611/7040] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:49:45.365861 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-056484f5-88e7-4990-8da6-f77ab1d4ce7d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:45.366509 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-056484f5-88e7-4990-8da6-f77ab1d4ce7d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: b7113bf3-7742-450a-a22e-d88cd6d548d7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:45.373745 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-056484f5-88e7-4990-8da6-f77ab1d4ce7d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:45.374290 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-056484f5-88e7-4990-8da6-f77ab1d4ce7d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:45.374820 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-056484f5-88e7-4990-8da6-f77ab1d4ce7d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:45.375777 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-056484f5-88e7-4990-8da6-f77ab1d4ce7d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:45.376277 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-056484f5-88e7-4990-8da6-f77ab1d4ce7d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:45.376767 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-056484f5-88e7-4990-8da6-f77ab1d4ce7d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:45.531260 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-056484f5-88e7-4990-8da6-f77ab1d4ce7d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:45.540235 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-056484f5-88e7-4990-8da6-f77ab1d4ce7d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7" status: 200 len: 1682 microversion: 2.1 time: 0.178861 Aug 31 16:49:45.540842 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3430/7041] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:45 2022] GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7 => generated 1682 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:46.394633 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-3c68bb9f-03da-49f6-b5f4-408c388f99a5 req-d6db57eb-ffb6-4a9a-a73a-9c70f7493d2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7113bf3-7742-450a-a22e-d88cd6d548d7", "tag": "318b5abd-c67d-424a-a4f0-7b3478365106"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:49:46.409575 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-3c68bb9f-03da-49f6-b5f4-408c388f99a5 req-d6db57eb-ffb6-4a9a-a73a-9c70f7493d2a service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:46.410278 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-3c68bb9f-03da-49f6-b5f4-408c388f99a5 req-d6db57eb-ffb6-4a9a-a73a-9c70f7493d2a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:46.410927 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-3c68bb9f-03da-49f6-b5f4-408c388f99a5 req-d6db57eb-ffb6-4a9a-a73a-9c70f7493d2a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:46.424336 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-3c68bb9f-03da-49f6-b5f4-408c388f99a5 req-d6db57eb-ffb6-4a9a-a73a-9c70f7493d2a service nova] Creating event network-changed:318b5abd-c67d-424a-a4f0-7b3478365106 for instance b7113bf3-7742-450a-a22e-d88cd6d548d7 on n-h1-833090-16 Aug 31 16:49:46.430699 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [req-3c68bb9f-03da-49f6-b5f4-408c388f99a5 req-d6db57eb-ffb6-4a9a-a73a-9c70f7493d2a service nova] Instance b7113bf3-7742-450a-a22e-d88cd6d548d7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-833090-16', 'n-h1-833090-16'} {{(pid=128864) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 16:49:46.442639 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-3c68bb9f-03da-49f6-b5f4-408c388f99a5 req-d6db57eb-ffb6-4a9a-a73a-9c70f7493d2a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055489 Aug 31 16:49:46.443242 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3612/7042] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:49:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:49:46.561668 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6790f53a-f639-4250-953b-844a8042148d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:46.562552 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6790f53a-f639-4250-953b-844a8042148d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: b7113bf3-7742-450a-a22e-d88cd6d548d7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:46.570706 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6790f53a-f639-4250-953b-844a8042148d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:46.571232 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6790f53a-f639-4250-953b-844a8042148d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:46.571706 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6790f53a-f639-4250-953b-844a8042148d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:46.572469 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6790f53a-f639-4250-953b-844a8042148d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:46.572932 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6790f53a-f639-4250-953b-844a8042148d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:46.573359 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6790f53a-f639-4250-953b-844a8042148d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:46.734439 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6790f53a-f639-4250-953b-844a8042148d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:46.745552 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6790f53a-f639-4250-953b-844a8042148d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7" status: 200 len: 1680 microversion: 2.1 time: 0.187874 Aug 31 16:49:46.758123 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3431/7043] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:46 2022] GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7 => generated 1680 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:47.770452 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-df94943e-384d-45fd-bfbb-5931febb570b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:47.771177 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-df94943e-384d-45fd-bfbb-5931febb570b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: b7113bf3-7742-450a-a22e-d88cd6d548d7] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:47.778435 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-df94943e-384d-45fd-bfbb-5931febb570b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:47.779809 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-df94943e-384d-45fd-bfbb-5931febb570b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:47.780927 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-df94943e-384d-45fd-bfbb-5931febb570b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:47.781361 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-df94943e-384d-45fd-bfbb-5931febb570b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:47.781835 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-df94943e-384d-45fd-bfbb-5931febb570b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:47.782320 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-df94943e-384d-45fd-bfbb-5931febb570b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:47.930025 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-df94943e-384d-45fd-bfbb-5931febb570b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:47.938990 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-df94943e-384d-45fd-bfbb-5931febb570b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7" status: 200 len: 1677 microversion: 2.1 time: 0.173729 Aug 31 16:49:47.939635 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3613/7044] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:47 2022] GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7 => generated 1677 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:47.962939 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4a09c51d-def6-4d84-b178-88e549db19bd tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:49:47.963633 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4a09c51d-def6-4d84-b178-88e549db19bd tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: b7113bf3-7742-450a-a22e-d88cd6d548d7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:47.971185 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a09c51d-def6-4d84-b178-88e549db19bd tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:47.971671 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a09c51d-def6-4d84-b178-88e549db19bd tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:47.972100 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a09c51d-def6-4d84-b178-88e549db19bd tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:47.973488 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a09c51d-def6-4d84-b178-88e549db19bd tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:47.973488 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a09c51d-def6-4d84-b178-88e549db19bd tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:47.974682 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a09c51d-def6-4d84-b178-88e549db19bd tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:48.043261 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4a09c51d-def6-4d84-b178-88e549db19bd tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "POST /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7/action" status: 204 len: 0 microversion: 2.1 time: 0.085368 Aug 31 16:49:48.044062 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3432/7045] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:49:47 2022] POST /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7/action => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:49:48.053921 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-03f3ff77-ef0b-45e7-9ba0-d3d7d1fdacd5 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:48.054754 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-03f3ff77-ef0b-45e7-9ba0-d3d7d1fdacd5 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: b7113bf3-7742-450a-a22e-d88cd6d548d7] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:48.061652 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-03f3ff77-ef0b-45e7-9ba0-d3d7d1fdacd5 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:48.062230 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-03f3ff77-ef0b-45e7-9ba0-d3d7d1fdacd5 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:48.062684 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-03f3ff77-ef0b-45e7-9ba0-d3d7d1fdacd5 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:48.063581 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-03f3ff77-ef0b-45e7-9ba0-d3d7d1fdacd5 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:48.064208 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-03f3ff77-ef0b-45e7-9ba0-d3d7d1fdacd5 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:48.064848 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-03f3ff77-ef0b-45e7-9ba0-d3d7d1fdacd5 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:48.217537 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-03f3ff77-ef0b-45e7-9ba0-d3d7d1fdacd5 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:48.227077 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-03f3ff77-ef0b-45e7-9ba0-d3d7d1fdacd5 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7" status: 200 len: 1677 microversion: 2.1 time: 0.177928 Aug 31 16:49:48.235501 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3614/7046] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:48 2022] GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7 => generated 1677 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:49.252933 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-33ae50f4-3a10-4953-8040-3af98e75c9be tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:49.254002 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-33ae50f4-3a10-4953-8040-3af98e75c9be tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: b7113bf3-7742-450a-a22e-d88cd6d548d7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:49.264317 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33ae50f4-3a10-4953-8040-3af98e75c9be tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:49.264944 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33ae50f4-3a10-4953-8040-3af98e75c9be tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:49.265591 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33ae50f4-3a10-4953-8040-3af98e75c9be tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:49.267136 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33ae50f4-3a10-4953-8040-3af98e75c9be tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:49.267802 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33ae50f4-3a10-4953-8040-3af98e75c9be tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:49.268746 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33ae50f4-3a10-4953-8040-3af98e75c9be tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:49.434346 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-33ae50f4-3a10-4953-8040-3af98e75c9be tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:49.444840 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-33ae50f4-3a10-4953-8040-3af98e75c9be tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7" status: 200 len: 1677 microversion: 2.1 time: 0.199703 Aug 31 16:49:49.446132 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3433/7047] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:49 2022] GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7 => generated 1677 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:50.469004 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-11e34083-b2cc-4e37-ab2c-39f133fc8c7c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:50.469732 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-11e34083-b2cc-4e37-ab2c-39f133fc8c7c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: b7113bf3-7742-450a-a22e-d88cd6d548d7] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:50.479703 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11e34083-b2cc-4e37-ab2c-39f133fc8c7c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:50.480349 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11e34083-b2cc-4e37-ab2c-39f133fc8c7c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:50.480876 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11e34083-b2cc-4e37-ab2c-39f133fc8c7c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:50.481816 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11e34083-b2cc-4e37-ab2c-39f133fc8c7c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:50.482462 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11e34083-b2cc-4e37-ab2c-39f133fc8c7c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:50.482861 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-11e34083-b2cc-4e37-ab2c-39f133fc8c7c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:50.628396 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-11e34083-b2cc-4e37-ab2c-39f133fc8c7c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:50.636896 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-11e34083-b2cc-4e37-ab2c-39f133fc8c7c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7" status: 200 len: 1669 microversion: 2.1 time: 0.173940 Aug 31 16:49:50.637479 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3615/7048] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:50 2022] GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7 => generated 1669 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:50.658151 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b198329a-54bf-4257-96f2-5de3c13ea165 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:50.658765 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b198329a-54bf-4257-96f2-5de3c13ea165 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: b7113bf3-7742-450a-a22e-d88cd6d548d7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:50.666004 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b198329a-54bf-4257-96f2-5de3c13ea165 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:50.666530 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b198329a-54bf-4257-96f2-5de3c13ea165 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:50.666967 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b198329a-54bf-4257-96f2-5de3c13ea165 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:50.667696 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b198329a-54bf-4257-96f2-5de3c13ea165 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:50.668152 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b198329a-54bf-4257-96f2-5de3c13ea165 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:50.668573 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b198329a-54bf-4257-96f2-5de3c13ea165 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:50.804254 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b198329a-54bf-4257-96f2-5de3c13ea165 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:50.812753 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b198329a-54bf-4257-96f2-5de3c13ea165 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7" status: 200 len: 1669 microversion: 2.1 time: 0.159005 Aug 31 16:49:50.813342 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3434/7049] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:50 2022] GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7 => generated 1669 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:50.833574 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ffb325a0-df16-445d-8c0a-094d765b89b6 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:50.834288 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ffb325a0-df16-445d-8c0a-094d765b89b6 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: b7113bf3-7742-450a-a22e-d88cd6d548d7] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:50.840754 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ffb325a0-df16-445d-8c0a-094d765b89b6 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:50.841237 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ffb325a0-df16-445d-8c0a-094d765b89b6 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:50.841692 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ffb325a0-df16-445d-8c0a-094d765b89b6 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:50.842479 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ffb325a0-df16-445d-8c0a-094d765b89b6 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:50.842950 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ffb325a0-df16-445d-8c0a-094d765b89b6 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:50.843391 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ffb325a0-df16-445d-8c0a-094d765b89b6 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:50.992693 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ffb325a0-df16-445d-8c0a-094d765b89b6 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:51.001107 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ffb325a0-df16-445d-8c0a-094d765b89b6 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7" status: 200 len: 1669 microversion: 2.1 time: 0.171396 Aug 31 16:49:51.001628 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3616/7050] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:50 2022] GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7 => generated 1669 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:51.023454 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b7cd939b-b42a-44d7-aa22-3421799b5512 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:51.023992 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b7cd939b-b42a-44d7-aa22-3421799b5512 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: b7113bf3-7742-450a-a22e-d88cd6d548d7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:51.030662 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7cd939b-b42a-44d7-aa22-3421799b5512 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:51.031186 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7cd939b-b42a-44d7-aa22-3421799b5512 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:51.031630 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7cd939b-b42a-44d7-aa22-3421799b5512 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:51.032337 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7cd939b-b42a-44d7-aa22-3421799b5512 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:51.032791 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7cd939b-b42a-44d7-aa22-3421799b5512 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:51.033220 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b7cd939b-b42a-44d7-aa22-3421799b5512 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:51.064132 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b7cd939b-b42a-44d7-aa22-3421799b5512 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: b7113bf3-7742-450a-a22e-d88cd6d548d7] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:49:51.091116 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:49:51.164240 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b7cd939b-b42a-44d7-aa22-3421799b5512 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7" status: 204 len: 0 microversion: 2.1 time: 0.145038 Aug 31 16:49:51.164981 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3435/7051] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:49:51 2022] DELETE /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:49:51.174438 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-81b483db-1c1d-4f9b-b0b0-0ac56ae75886 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:51.175302 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-81b483db-1c1d-4f9b-b0b0-0ac56ae75886 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: b7113bf3-7742-450a-a22e-d88cd6d548d7] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:51.181680 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-81b483db-1c1d-4f9b-b0b0-0ac56ae75886 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:51.182233 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-81b483db-1c1d-4f9b-b0b0-0ac56ae75886 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:51.182688 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-81b483db-1c1d-4f9b-b0b0-0ac56ae75886 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:51.183399 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-81b483db-1c1d-4f9b-b0b0-0ac56ae75886 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:51.183901 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-81b483db-1c1d-4f9b-b0b0-0ac56ae75886 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:51.184339 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-81b483db-1c1d-4f9b-b0b0-0ac56ae75886 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:51.205790 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-59549108-c4db-4597-a27e-79a226eb0601 req-1772d8af-557c-409d-bc26-ab4d3f1b1947 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7113bf3-7742-450a-a22e-d88cd6d548d7", "name": "network-vif-plugged", "status": "completed", "tag": "318b5abd-c67d-424a-a4f0-7b3478365106"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:49:51.219051 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-59549108-c4db-4597-a27e-79a226eb0601 req-1772d8af-557c-409d-bc26-ab4d3f1b1947 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:51.219540 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-59549108-c4db-4597-a27e-79a226eb0601 req-1772d8af-557c-409d-bc26-ab4d3f1b1947 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:51.219972 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-59549108-c4db-4597-a27e-79a226eb0601 req-1772d8af-557c-409d-bc26-ab4d3f1b1947 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:51.232952 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-59549108-c4db-4597-a27e-79a226eb0601 req-1772d8af-557c-409d-bc26-ab4d3f1b1947 service nova] Creating event network-vif-plugged:318b5abd-c67d-424a-a4f0-7b3478365106 for instance b7113bf3-7742-450a-a22e-d88cd6d548d7 on n-h1-833090-16 Aug 31 16:49:51.238524 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-59549108-c4db-4597-a27e-79a226eb0601 req-1772d8af-557c-409d-bc26-ab4d3f1b1947 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039631 Aug 31 16:49:51.239146 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3436/7052] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:49:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:49:51.330080 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-81b483db-1c1d-4f9b-b0b0-0ac56ae75886 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:51.339715 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-81b483db-1c1d-4f9b-b0b0-0ac56ae75886 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7" status: 200 len: 1675 microversion: 2.1 time: 0.169573 Aug 31 16:49:51.340325 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3617/7053] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:51 2022] GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7 => generated 1675 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:49:52.363156 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6e125d6b-fe8d-4a32-99a1-03263c97acc0 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:52.363856 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6e125d6b-fe8d-4a32-99a1-03263c97acc0 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: b7113bf3-7742-450a-a22e-d88cd6d548d7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:52.370988 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6e125d6b-fe8d-4a32-99a1-03263c97acc0 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:52.371392 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6e125d6b-fe8d-4a32-99a1-03263c97acc0 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:52.371828 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6e125d6b-fe8d-4a32-99a1-03263c97acc0 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:52.372580 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6e125d6b-fe8d-4a32-99a1-03263c97acc0 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:52.373021 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6e125d6b-fe8d-4a32-99a1-03263c97acc0 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:52.373434 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6e125d6b-fe8d-4a32-99a1-03263c97acc0 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:52.520305 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6e125d6b-fe8d-4a32-99a1-03263c97acc0 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:52.530924 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6e125d6b-fe8d-4a32-99a1-03263c97acc0 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7" status: 200 len: 1675 microversion: 2.1 time: 0.172894 Aug 31 16:49:52.531781 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3437/7054] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:52 2022] GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7 => generated 1675 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:53.557456 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ba074be8-f793-4f38-8d0e-34638140aec8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:53.558129 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ba074be8-f793-4f38-8d0e-34638140aec8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: b7113bf3-7742-450a-a22e-d88cd6d548d7] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:53.571674 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-67719a7f-5a6f-4634-b15f-beba768ffcb4 req-16e9770b-a58a-42d7-a4e1-8fc967ec9413 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7113bf3-7742-450a-a22e-d88cd6d548d7", "name": "network-vif-deleted", "tag": "318b5abd-c67d-424a-a4f0-7b3478365106"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:49:53.589980 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ba074be8-f793-4f38-8d0e-34638140aec8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:53.590520 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ba074be8-f793-4f38-8d0e-34638140aec8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:53.593281 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-67719a7f-5a6f-4634-b15f-beba768ffcb4 req-16e9770b-a58a-42d7-a4e1-8fc967ec9413 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:53.594169 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-67719a7f-5a6f-4634-b15f-beba768ffcb4 req-16e9770b-a58a-42d7-a4e1-8fc967ec9413 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:53.594870 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-67719a7f-5a6f-4634-b15f-beba768ffcb4 req-16e9770b-a58a-42d7-a4e1-8fc967ec9413 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:53.602485 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ba074be8-f793-4f38-8d0e-34638140aec8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:53.603507 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ba074be8-f793-4f38-8d0e-34638140aec8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:53.604305 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ba074be8-f793-4f38-8d0e-34638140aec8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:53.604485 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ba074be8-f793-4f38-8d0e-34638140aec8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:53.624090 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-67719a7f-5a6f-4634-b15f-beba768ffcb4 req-16e9770b-a58a-42d7-a4e1-8fc967ec9413 service nova] Creating event network-vif-deleted:318b5abd-c67d-424a-a4f0-7b3478365106 for instance b7113bf3-7742-450a-a22e-d88cd6d548d7 on n-h1-833090-16 Aug 31 16:49:53.639475 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-67719a7f-5a6f-4634-b15f-beba768ffcb4 req-16e9770b-a58a-42d7-a4e1-8fc967ec9413 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069978 Aug 31 16:49:53.643984 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3438/7055] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:49:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:49:53.721175 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ba074be8-f793-4f38-8d0e-34638140aec8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:53.725095 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:49:53.732280 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ba074be8-f793-4f38-8d0e-34638140aec8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7" status: 200 len: 1323 microversion: 2.1 time: 0.178902 Aug 31 16:49:53.747027 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3618/7056] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:53 2022] GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7 => generated 1323 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:54.756573 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-17d36530-e6b4-4d42-a009-3ae8f363518c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:54.757280 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-17d36530-e6b4-4d42-a009-3ae8f363518c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: b7113bf3-7742-450a-a22e-d88cd6d548d7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:54.764142 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-17d36530-e6b4-4d42-a009-3ae8f363518c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:54.764734 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-17d36530-e6b4-4d42-a009-3ae8f363518c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:54.765249 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-17d36530-e6b4-4d42-a009-3ae8f363518c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:54.765952 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-17d36530-e6b4-4d42-a009-3ae8f363518c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:54.766440 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-17d36530-e6b4-4d42-a009-3ae8f363518c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:54.766860 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-17d36530-e6b4-4d42-a009-3ae8f363518c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:54.782455 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-17d36530-e6b4-4d42-a009-3ae8f363518c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] HTTP exception thrown: Instance b7113bf3-7742-450a-a22e-d88cd6d548d7 could not be found. Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-17d36530-e6b4-4d42-a009-3ae8f363518c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Request method failure captured: Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7 HTTP/1.1 Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD5C9uAz-t5mh-r3mUMMlr2wQd9RJYBAKDGT0KvPrLTihjtZPy6-09_bJTMDpSB88huaVHBLxwU79aGS9Ig9M6XEadSxV6dHNvqYvU2MaYuMgncb9fl7PDdbiMU9wj6m6OmrQoGoaSgGYVEfgnnlWHC-gb6kVlFh35PHiKS5x0RNERSU Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: fce77c4128d3448885217ac4d4744765 Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerActionsTestJSON-1850065935 Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fce77c4128d3448885217ac4d4744765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fce77c4128d3448885217ac4d4744765"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/fce77c4128d3448885217ac4d4744765"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_fce77c4128d3448885217ac4d4744765", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServerActionsTestJSON-1850065935 Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: fce77c4128d3448885217ac4d4744765 Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerActionsTestJSON-1850065935 Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServerActionsTestJSON-1850065935-project Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 689ff4da0acb4aafa5f44d42e68ab41d Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServerActionsTestJSON-1850065935-project Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance b7113bf3-7742-450a-a22e-d88cd6d548d7 could not be found. Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'b7113bf3-7742-450a-a22e-d88cd6d548d7'} Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7113bf3-7742-450a-a22e-d88cd6d548d7 could not be found. Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7113bf3-7742-450a-a22e-d88cd6d548d7 could not be found. Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:49:54.784152 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:49:54.788929 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:49:54.788929 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:49:54.788929 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:49:54.788929 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:49:54.788929 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:49:54.788929 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7113bf3-7742-450a-a22e-d88cd6d548d7 could not be found. Aug 31 16:49:54.788929 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:49:54.788929 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-17d36530-e6b4-4d42-a009-3ae8f363518c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Returning 404 to user: Instance b7113bf3-7742-450a-a22e-d88cd6d548d7 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:49:54.788929 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-17d36530-e6b4-4d42-a009-3ae8f363518c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7" status: 404 len: 111 microversion: 2.1 time: 0.034996 Aug 31 16:49:54.788929 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3439/7057] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:54 2022] GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:49:54.798268 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e4f341c3-2e7e-4718-8811-ab119209de6c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:54.798889 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e4f341c3-2e7e-4718-8811-ab119209de6c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: b7113bf3-7742-450a-a22e-d88cd6d548d7] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:54.807127 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4f341c3-2e7e-4718-8811-ab119209de6c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:54.807615 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4f341c3-2e7e-4718-8811-ab119209de6c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:54.808055 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4f341c3-2e7e-4718-8811-ab119209de6c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:54.808757 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4f341c3-2e7e-4718-8811-ab119209de6c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:54.809213 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4f341c3-2e7e-4718-8811-ab119209de6c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:54.809639 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4f341c3-2e7e-4718-8811-ab119209de6c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:54.826074 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-e4f341c3-2e7e-4718-8811-ab119209de6c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] HTTP exception thrown: Instance b7113bf3-7742-450a-a22e-d88cd6d548d7 could not be found. Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e4f341c3-2e7e-4718-8811-ab119209de6c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Request method failure captured: Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7 HTTP/1.1 Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD5C9uAz-t5mh-r3mUMMlr2wQd9RJYBAKDGT0KvPrLTihjtZPy6-09_bJTMDpSB88huaVHBLxwU79aGS9Ig9M6XEadSxV6dHNvqYvU2MaYuMgncb9fl7PDdbiMU9wj6m6OmrQoGoaSgGYVEfgnnlWHC-gb6kVlFh35PHiKS5x0RNERSU Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: fce77c4128d3448885217ac4d4744765 Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServerActionsTestJSON-1850065935 Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fce77c4128d3448885217ac4d4744765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fce77c4128d3448885217ac4d4744765"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/fce77c4128d3448885217ac4d4744765"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_fce77c4128d3448885217ac4d4744765", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServerActionsTestJSON-1850065935 Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: fce77c4128d3448885217ac4d4744765 Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServerActionsTestJSON-1850065935 Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServerActionsTestJSON-1850065935-project Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 689ff4da0acb4aafa5f44d42e68ab41d Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServerActionsTestJSON-1850065935-project Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance b7113bf3-7742-450a-a22e-d88cd6d548d7 could not be found. Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'b7113bf3-7742-450a-a22e-d88cd6d548d7'} Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7113bf3-7742-450a-a22e-d88cd6d548d7 could not be found. Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7113bf3-7742-450a-a22e-d88cd6d548d7 could not be found. Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:49:54.827790 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:49:54.831739 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:49:54.831739 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:49:54.831739 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:49:54.831739 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:49:54.831739 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:49:54.831739 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7113bf3-7742-450a-a22e-d88cd6d548d7 could not be found. Aug 31 16:49:54.831739 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:49:54.831739 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e4f341c3-2e7e-4718-8811-ab119209de6c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Returning 404 to user: Instance b7113bf3-7742-450a-a22e-d88cd6d548d7 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:49:54.831739 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e4f341c3-2e7e-4718-8811-ab119209de6c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7" status: 404 len: 111 microversion: 2.1 time: 0.035300 Aug 31 16:49:54.831739 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3619/7058] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:54 2022] GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 16:49:54.879670 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-03ed73c3-ed93-48f5-8fa6-3ce9ad7c3d7d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1969718008", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "b8a9ec6f-b6c3-4e24-8c90-3b9785a6ff39"}], "security_groups": [{"name": "tempest-securitygroup--137403414"}], "key_name": "tempest-keypair-249207011", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:49:54.993497 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-03ed73c3-ed93-48f5-8fa6-3ce9ad7c3d7d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] validate_networks() for [('b8a9ec6f-b6c3-4e24-8c90-3b9785a6ff39', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:49:55.408970 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-03ed73c3-ed93-48f5-8fa6-3ce9ad7c3d7d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:49:55.410771 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-03ed73c3-ed93-48f5-8fa6-3ce9ad7c3d7d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:49:55.411344 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-03ed73c3-ed93-48f5-8fa6-3ce9ad7c3d7d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:49:55.411930 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-03ed73c3-ed93-48f5-8fa6-3ce9ad7c3d7d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:49:55.412352 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-03ed73c3-ed93-48f5-8fa6-3ce9ad7c3d7d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:49:55.426480 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03ed73c3-ed93-48f5-8fa6-3ce9ad7c3d7d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:55.427126 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03ed73c3-ed93-48f5-8fa6-3ce9ad7c3d7d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:55.427562 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03ed73c3-ed93-48f5-8fa6-3ce9ad7c3d7d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:55.428315 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03ed73c3-ed93-48f5-8fa6-3ce9ad7c3d7d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:55.428803 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03ed73c3-ed93-48f5-8fa6-3ce9ad7c3d7d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:55.429227 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03ed73c3-ed93-48f5-8fa6-3ce9ad7c3d7d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:55.452585 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-03ed73c3-ed93-48f5-8fa6-3ce9ad7c3d7d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Getting quotas for project fce77c4128d3448885217ac4d4744765. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:49:55.458490 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-03ed73c3-ed93-48f5-8fa6-3ce9ad7c3d7d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Getting quotas for user 689ff4da0acb4aafa5f44d42e68ab41d and project fce77c4128d3448885217ac4d4744765. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:49:55.473867 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-03ed73c3-ed93-48f5-8fa6-3ce9ad7c3d7d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:49:55.477384 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-03ed73c3-ed93-48f5-8fa6-3ce9ad7c3d7d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:49:55.527611 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-03ed73c3-ed93-48f5-8fa6-3ce9ad7c3d7d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.651885 Aug 31 16:49:55.528881 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3440/7059] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:49:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:49:55.540799 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d98a01af-03f6-48f9-8642-c965ffbc9a9d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:55.541439 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d98a01af-03f6-48f9-8642-c965ffbc9a9d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:55.608054 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d98a01af-03f6-48f9-8642-c965ffbc9a9d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:55.619597 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d98a01af-03f6-48f9-8642-c965ffbc9a9d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b" status: 200 len: 1238 microversion: 2.1 time: 0.083530 Aug 31 16:49:55.620688 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3620/7060] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:55 2022] GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b => generated 1238 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:56.642549 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fe851bf2-f790-454d-9a93-6d55d9e75cc3 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:56.643218 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fe851bf2-f790-454d-9a93-6d55d9e75cc3 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:56.652529 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe851bf2-f790-454d-9a93-6d55d9e75cc3 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:56.653031 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe851bf2-f790-454d-9a93-6d55d9e75cc3 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:56.653456 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe851bf2-f790-454d-9a93-6d55d9e75cc3 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:56.654256 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe851bf2-f790-454d-9a93-6d55d9e75cc3 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:56.654706 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe851bf2-f790-454d-9a93-6d55d9e75cc3 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:56.655119 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe851bf2-f790-454d-9a93-6d55d9e75cc3 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:56.729030 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fe851bf2-f790-454d-9a93-6d55d9e75cc3 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:56.738519 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fe851bf2-f790-454d-9a93-6d55d9e75cc3 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b" status: 200 len: 1290 microversion: 2.1 time: 0.100622 Aug 31 16:49:56.739274 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3441/7061] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:56 2022] GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b => generated 1290 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:57.761171 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-96d04cb2-2348-4c74-94f0-562e115efaca tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:57.761837 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-96d04cb2-2348-4c74-94f0-562e115efaca tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:57.771413 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-96d04cb2-2348-4c74-94f0-562e115efaca tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:57.771927 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-96d04cb2-2348-4c74-94f0-562e115efaca tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:57.772409 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-96d04cb2-2348-4c74-94f0-562e115efaca tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:57.773201 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-96d04cb2-2348-4c74-94f0-562e115efaca tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:57.773993 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-96d04cb2-2348-4c74-94f0-562e115efaca tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:57.775125 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-96d04cb2-2348-4c74-94f0-562e115efaca tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:57.917833 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-96d04cb2-2348-4c74-94f0-562e115efaca tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:57.926226 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-96d04cb2-2348-4c74-94f0-562e115efaca tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b" status: 200 len: 1363 microversion: 2.1 time: 0.169427 Aug 31 16:49:57.926792 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3621/7062] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:57 2022] GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:49:58.539304 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-e690bea0-43f5-496d-a567-42051b461c1f req-9838ba0b-8f35-412a-ac48-95784980642a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "015c2ed2-16ef-4fe4-9867-ff4d28b7a60b", "tag": "294f91ac-7cf5-4f19-acae-3212571f92d2"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:49:58.558957 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e690bea0-43f5-496d-a567-42051b461c1f req-9838ba0b-8f35-412a-ac48-95784980642a service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:58.559441 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e690bea0-43f5-496d-a567-42051b461c1f req-9838ba0b-8f35-412a-ac48-95784980642a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:58.559875 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-e690bea0-43f5-496d-a567-42051b461c1f req-9838ba0b-8f35-412a-ac48-95784980642a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:58.571761 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-e690bea0-43f5-496d-a567-42051b461c1f req-9838ba0b-8f35-412a-ac48-95784980642a service nova] Creating event network-changed:294f91ac-7cf5-4f19-acae-3212571f92d2 for instance 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b on n-h2-833090-16 Aug 31 16:49:58.577045 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-e690bea0-43f5-496d-a567-42051b461c1f req-9838ba0b-8f35-412a-ac48-95784980642a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041728 Aug 31 16:49:58.578011 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3442/7063] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:49:58.950379 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3a705778-9d3d-4ba7-85b1-3ea146933a99 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:49:58.950982 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3a705778-9d3d-4ba7-85b1-3ea146933a99 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:49:58.959471 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3a705778-9d3d-4ba7-85b1-3ea146933a99 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:58.959965 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3a705778-9d3d-4ba7-85b1-3ea146933a99 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:58.960469 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3a705778-9d3d-4ba7-85b1-3ea146933a99 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:58.961212 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3a705778-9d3d-4ba7-85b1-3ea146933a99 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:49:58.962007 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3a705778-9d3d-4ba7-85b1-3ea146933a99 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:49:58.962520 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3a705778-9d3d-4ba7-85b1-3ea146933a99 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:49:59.128608 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3a705778-9d3d-4ba7-85b1-3ea146933a99 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:49:59.138248 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3a705778-9d3d-4ba7-85b1-3ea146933a99 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b" status: 200 len: 1363 microversion: 2.1 time: 0.193141 Aug 31 16:49:59.138868 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3622/7064] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:49:58 2022] GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b => generated 1363 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:50:00.163819 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dcdde500-0a25-4ae7-ae15-c0a81a08fd07 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:50:00.164880 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dcdde500-0a25-4ae7-ae15-c0a81a08fd07 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:50:00.167514 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:50:00.173950 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcdde500-0a25-4ae7-ae15-c0a81a08fd07 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:50:00.174480 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcdde500-0a25-4ae7-ae15-c0a81a08fd07 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:50:00.174915 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcdde500-0a25-4ae7-ae15-c0a81a08fd07 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:50:00.175605 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcdde500-0a25-4ae7-ae15-c0a81a08fd07 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:50:00.176053 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcdde500-0a25-4ae7-ae15-c0a81a08fd07 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:50:00.176470 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dcdde500-0a25-4ae7-ae15-c0a81a08fd07 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:50:00.328914 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dcdde500-0a25-4ae7-ae15-c0a81a08fd07 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:50:00.337290 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dcdde500-0a25-4ae7-ae15-c0a81a08fd07 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b" status: 200 len: 1363 microversion: 2.1 time: 0.180049 Aug 31 16:50:00.338228 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3443/7065] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:50:00 2022] GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:50:01.359584 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-cc4bb255-afd6-4c69-a8b3-203ffecf0462 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:50:01.360195 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-cc4bb255-afd6-4c69-a8b3-203ffecf0462 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:50:01.363171 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=47 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:50:01.369723 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cc4bb255-afd6-4c69-a8b3-203ffecf0462 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:50:01.370412 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cc4bb255-afd6-4c69-a8b3-203ffecf0462 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:50:01.370864 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cc4bb255-afd6-4c69-a8b3-203ffecf0462 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:50:01.371577 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cc4bb255-afd6-4c69-a8b3-203ffecf0462 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:50:01.372048 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cc4bb255-afd6-4c69-a8b3-203ffecf0462 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:50:01.372486 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cc4bb255-afd6-4c69-a8b3-203ffecf0462 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:50:01.519364 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-cc4bb255-afd6-4c69-a8b3-203ffecf0462 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:50:01.528156 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-cc4bb255-afd6-4c69-a8b3-203ffecf0462 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b" status: 200 len: 1363 microversion: 2.1 time: 0.172706 Aug 31 16:50:01.528774 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3623/7066] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:50:01 2022] GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:50:02.551569 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9396ab0d-32b4-4356-9941-cb5bf0f20d34 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:50:02.552922 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9396ab0d-32b4-4356-9941-cb5bf0f20d34 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:50:02.564951 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9396ab0d-32b4-4356-9941-cb5bf0f20d34 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:50:02.565456 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9396ab0d-32b4-4356-9941-cb5bf0f20d34 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:50:02.565903 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9396ab0d-32b4-4356-9941-cb5bf0f20d34 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:50:02.566709 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9396ab0d-32b4-4356-9941-cb5bf0f20d34 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:50:02.567163 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9396ab0d-32b4-4356-9941-cb5bf0f20d34 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:50:02.567591 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9396ab0d-32b4-4356-9941-cb5bf0f20d34 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:50:02.716894 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9396ab0d-32b4-4356-9941-cb5bf0f20d34 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:50:02.725633 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9396ab0d-32b4-4356-9941-cb5bf0f20d34 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b" status: 200 len: 1363 microversion: 2.1 time: 0.180383 Aug 31 16:50:02.726355 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3444/7067] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:50:02 2022] GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:50:03.748534 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f156d661-5d41-4878-aceb-9a9180d48088 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:50:03.749176 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f156d661-5d41-4878-aceb-9a9180d48088 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:50:03.759051 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f156d661-5d41-4878-aceb-9a9180d48088 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:50:03.759579 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f156d661-5d41-4878-aceb-9a9180d48088 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:50:03.760559 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f156d661-5d41-4878-aceb-9a9180d48088 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:50:03.761293 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f156d661-5d41-4878-aceb-9a9180d48088 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:50:03.761828 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f156d661-5d41-4878-aceb-9a9180d48088 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:50:03.762319 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f156d661-5d41-4878-aceb-9a9180d48088 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:50:03.904965 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f156d661-5d41-4878-aceb-9a9180d48088 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:50:03.913100 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f156d661-5d41-4878-aceb-9a9180d48088 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b" status: 200 len: 1363 microversion: 2.1 time: 0.169358 Aug 31 16:50:03.913724 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3624/7068] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:50:03 2022] GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:50:04.516235 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-87f34eae-19c1-4aa9-993a-0df8c9e502cd req-e11c5f48-0aa8-4809-b873-220afb64d3ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "015c2ed2-16ef-4fe4-9867-ff4d28b7a60b", "name": "network-vif-plugged", "status": "completed", "tag": "294f91ac-7cf5-4f19-acae-3212571f92d2"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:50:04.528180 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-87f34eae-19c1-4aa9-993a-0df8c9e502cd req-e11c5f48-0aa8-4809-b873-220afb64d3ca service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:50:04.528915 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-87f34eae-19c1-4aa9-993a-0df8c9e502cd req-e11c5f48-0aa8-4809-b873-220afb64d3ca service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:50:04.529360 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-87f34eae-19c1-4aa9-993a-0df8c9e502cd req-e11c5f48-0aa8-4809-b873-220afb64d3ca service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:50:04.542176 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-87f34eae-19c1-4aa9-993a-0df8c9e502cd req-e11c5f48-0aa8-4809-b873-220afb64d3ca service nova] Creating event network-vif-plugged:294f91ac-7cf5-4f19-acae-3212571f92d2 for instance 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b on n-h2-833090-16 Aug 31 16:50:04.548388 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-87f34eae-19c1-4aa9-993a-0df8c9e502cd req-e11c5f48-0aa8-4809-b873-220afb64d3ca service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035784 Aug 31 16:50:04.549330 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3445/7069] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:50:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:50:04.937922 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-468cb55b-f689-4378-8096-d95c19c8d8ca tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:50:04.938672 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-468cb55b-f689-4378-8096-d95c19c8d8ca tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:50:04.949425 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-468cb55b-f689-4378-8096-d95c19c8d8ca tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:50:04.949948 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-468cb55b-f689-4378-8096-d95c19c8d8ca tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:50:04.950458 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-468cb55b-f689-4378-8096-d95c19c8d8ca tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:50:04.951212 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-468cb55b-f689-4378-8096-d95c19c8d8ca tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:50:04.951729 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-468cb55b-f689-4378-8096-d95c19c8d8ca tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:50:04.952176 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-468cb55b-f689-4378-8096-d95c19c8d8ca tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:50:05.106324 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-468cb55b-f689-4378-8096-d95c19c8d8ca tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:50:05.116805 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-468cb55b-f689-4378-8096-d95c19c8d8ca tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b" status: 200 len: 1363 microversion: 2.1 time: 0.184929 Aug 31 16:50:05.117406 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3625/7070] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:50:04 2022] GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b => generated 1363 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:50:06.143011 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:50:06.144380 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:50:06.152284 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6ec47b4e-208c-466f-9578-9e3be1a5454d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:50:06.153290 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6ec47b4e-208c-466f-9578-9e3be1a5454d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:50:06.160190 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ec47b4e-208c-466f-9578-9e3be1a5454d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:50:06.160644 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ec47b4e-208c-466f-9578-9e3be1a5454d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:50:06.161046 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ec47b4e-208c-466f-9578-9e3be1a5454d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:50:06.161730 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ec47b4e-208c-466f-9578-9e3be1a5454d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:50:06.162272 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ec47b4e-208c-466f-9578-9e3be1a5454d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:50:06.162690 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6ec47b4e-208c-466f-9578-9e3be1a5454d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:50:06.300684 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6ec47b4e-208c-466f-9578-9e3be1a5454d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:50:06.308675 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6ec47b4e-208c-466f-9578-9e3be1a5454d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b" status: 200 len: 1363 microversion: 2.1 time: 0.166747 Aug 31 16:50:06.309253 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3446/7071] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:50:06 2022] GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:50:07.334855 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-308884dd-674b-4825-8295-1312ed6979cb tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:50:07.335959 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-308884dd-674b-4825-8295-1312ed6979cb tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:50:07.339699 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:50:07.344465 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-308884dd-674b-4825-8295-1312ed6979cb tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:50:07.344973 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-308884dd-674b-4825-8295-1312ed6979cb tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:50:07.345427 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-308884dd-674b-4825-8295-1312ed6979cb tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:50:07.346165 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-308884dd-674b-4825-8295-1312ed6979cb tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:50:07.346804 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-308884dd-674b-4825-8295-1312ed6979cb tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:50:07.347325 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-308884dd-674b-4825-8295-1312ed6979cb tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:50:07.504013 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-308884dd-674b-4825-8295-1312ed6979cb tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:50:07.512484 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-308884dd-674b-4825-8295-1312ed6979cb tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b" status: 200 len: 1550 microversion: 2.1 time: 0.184590 Aug 31 16:50:07.513069 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3626/7072] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:50:07 2022] GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b => generated 1550 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:50:07.533851 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b10a2dba-4ca7-4b8a-b4f9-87ac3fe3924e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:50:07.534454 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b10a2dba-4ca7-4b8a-b4f9-87ac3fe3924e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:50:07.542258 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b10a2dba-4ca7-4b8a-b4f9-87ac3fe3924e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:50:07.542750 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b10a2dba-4ca7-4b8a-b4f9-87ac3fe3924e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:50:07.543181 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b10a2dba-4ca7-4b8a-b4f9-87ac3fe3924e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:50:07.543881 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b10a2dba-4ca7-4b8a-b4f9-87ac3fe3924e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:50:07.544325 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b10a2dba-4ca7-4b8a-b4f9-87ac3fe3924e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:50:07.544743 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b10a2dba-4ca7-4b8a-b4f9-87ac3fe3924e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:50:07.637747 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b10a2dba-4ca7-4b8a-b4f9-87ac3fe3924e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107884 Aug 31 16:50:07.638422 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3447/7073] 10.222.0.50 () {58 vars in 1275 bytes} [Wed Aug 31 16:50:07 2022] GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:50:08.633365 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-8760a87a-cac0-4447-81fc-97637b2bee43 req-50edceec-3b7a-4c99-aa3d-d044ec12413e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "015c2ed2-16ef-4fe4-9867-ff4d28b7a60b", "tag": "294f91ac-7cf5-4f19-acae-3212571f92d2"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:50:08.644050 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-8760a87a-cac0-4447-81fc-97637b2bee43 req-50edceec-3b7a-4c99-aa3d-d044ec12413e service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:50:08.644620 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-8760a87a-cac0-4447-81fc-97637b2bee43 req-50edceec-3b7a-4c99-aa3d-d044ec12413e service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:50:08.645117 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-8760a87a-cac0-4447-81fc-97637b2bee43 req-50edceec-3b7a-4c99-aa3d-d044ec12413e service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:50:08.657621 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-8760a87a-cac0-4447-81fc-97637b2bee43 req-50edceec-3b7a-4c99-aa3d-d044ec12413e service nova] Creating event network-changed:294f91ac-7cf5-4f19-acae-3212571f92d2 for instance 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b on n-h2-833090-16 Aug 31 16:50:08.663397 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-8760a87a-cac0-4447-81fc-97637b2bee43 req-50edceec-3b7a-4c99-aa3d-d044ec12413e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033570 Aug 31 16:50:08.664238 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3627/7074] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:51:12.455845 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=9 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:51:12.456952 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:51:12.458875 n-d-833090-16 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 16:51:12.459076 n-d-833090-16 devstack@n-api.service[128863]: Wed Aug 31 16:51:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b/action (ip 10.222.0.50) !!! Aug 31 16:51:12.466594 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bf58d937-dd4b-419c-9866-52acef81f69e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:51:12.475630 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf58d937-dd4b-419c-9866-52acef81f69e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:12.476121 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf58d937-dd4b-419c-9866-52acef81f69e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:12.476561 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bf58d937-dd4b-419c-9866-52acef81f69e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:12.504595 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bf58d937-dd4b-419c-9866-52acef81f69e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b] Going to try to stop instance {{(pid=128863) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 16:51:12.559432 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bf58d937-dd4b-419c-9866-52acef81f69e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "POST /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b/action" status: 202 len: 0 microversion: 2.1 time: 0.106256 Aug 31 16:51:12.560392 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3448/7075] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:51:12 2022] POST /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 16:51:12.568816 n-d-833090-16 devstack@n-api.service[128864]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4f3e0afc-1d0e-4db3-9143-6185c0e157a7] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 16:51:12.571739 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=9 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:51:12.572808 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=40 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:51:12.575181 n-d-833090-16 devstack@n-api.service[128864]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 16:51:12.575708 n-d-833090-16 devstack@n-api.service[128864]: Wed Aug 31 16:51:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b (ip 10.222.0.50) !!! Aug 31 16:51:12.586267 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8b804b54-8ed3-4ba0-afaa-674f51b10124 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:12.587278 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8b804b54-8ed3-4ba0-afaa-674f51b10124 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:12.597468 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b804b54-8ed3-4ba0-afaa-674f51b10124 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:12.598021 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b804b54-8ed3-4ba0-afaa-674f51b10124 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:12.598605 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b804b54-8ed3-4ba0-afaa-674f51b10124 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:12.599410 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b804b54-8ed3-4ba0-afaa-674f51b10124 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:12.599962 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b804b54-8ed3-4ba0-afaa-674f51b10124 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:12.600474 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b804b54-8ed3-4ba0-afaa-674f51b10124 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:12.754487 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8b804b54-8ed3-4ba0-afaa-674f51b10124 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:12.763044 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8b804b54-8ed3-4ba0-afaa-674f51b10124 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b" status: 200 len: 1679 microversion: 2.1 time: 0.197095 Aug 31 16:51:12.763647 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3628/7076] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:12 2022] GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b => generated 1679 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:51:13.785629 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0003ceb9-8148-4586-aac3-c3716afed2f9 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:13.786391 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0003ceb9-8148-4586-aac3-c3716afed2f9 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:13.793610 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0003ceb9-8148-4586-aac3-c3716afed2f9 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:13.794121 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0003ceb9-8148-4586-aac3-c3716afed2f9 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:13.794570 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0003ceb9-8148-4586-aac3-c3716afed2f9 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:13.795273 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0003ceb9-8148-4586-aac3-c3716afed2f9 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:13.795725 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0003ceb9-8148-4586-aac3-c3716afed2f9 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:13.796149 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0003ceb9-8148-4586-aac3-c3716afed2f9 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:13.932635 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0003ceb9-8148-4586-aac3-c3716afed2f9 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:13.942839 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0003ceb9-8148-4586-aac3-c3716afed2f9 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b" status: 200 len: 1679 microversion: 2.1 time: 0.162805 Aug 31 16:51:13.943441 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3449/7077] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:13 2022] GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:51:14.967503 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8ebce364-acd0-402c-b60f-4c9e3558f8f8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:14.968524 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8ebce364-acd0-402c-b60f-4c9e3558f8f8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:14.984379 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8ebce364-acd0-402c-b60f-4c9e3558f8f8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:14.985243 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8ebce364-acd0-402c-b60f-4c9e3558f8f8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:14.985875 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8ebce364-acd0-402c-b60f-4c9e3558f8f8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:14.987132 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8ebce364-acd0-402c-b60f-4c9e3558f8f8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:14.987939 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8ebce364-acd0-402c-b60f-4c9e3558f8f8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:14.988407 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8ebce364-acd0-402c-b60f-4c9e3558f8f8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:15.000074 n-d-833090-16 devstack@n-api.service[128864]: INFO oslo.messaging._drivers.impl_rabbit [-] [4f3e0afc-1d0e-4db3-9143-6185c0e157a7] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 48990. Aug 31 16:51:15.163257 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8ebce364-acd0-402c-b60f-4c9e3558f8f8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:15.173053 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8ebce364-acd0-402c-b60f-4c9e3558f8f8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b" status: 200 len: 1679 microversion: 2.1 time: 0.211080 Aug 31 16:51:15.173719 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3629/7078] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:14 2022] GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b => generated 1679 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:51:16.194994 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-62e5a442-78fb-430e-b6d7-1f1cdf2dc756 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:16.195614 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-62e5a442-78fb-430e-b6d7-1f1cdf2dc756 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:16.203143 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62e5a442-78fb-430e-b6d7-1f1cdf2dc756 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:16.203620 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62e5a442-78fb-430e-b6d7-1f1cdf2dc756 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:16.204048 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62e5a442-78fb-430e-b6d7-1f1cdf2dc756 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:16.204739 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62e5a442-78fb-430e-b6d7-1f1cdf2dc756 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:16.205187 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62e5a442-78fb-430e-b6d7-1f1cdf2dc756 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:16.205604 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62e5a442-78fb-430e-b6d7-1f1cdf2dc756 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:16.347160 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-62e5a442-78fb-430e-b6d7-1f1cdf2dc756 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:16.355567 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-62e5a442-78fb-430e-b6d7-1f1cdf2dc756 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b" status: 200 len: 1679 microversion: 2.1 time: 0.164929 Aug 31 16:51:16.356198 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3450/7079] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:16 2022] GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:51:17.377264 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3864668d-0a85-42d3-93e5-5efd9448a38a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:17.377932 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3864668d-0a85-42d3-93e5-5efd9448a38a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:17.385293 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3864668d-0a85-42d3-93e5-5efd9448a38a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:17.385793 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3864668d-0a85-42d3-93e5-5efd9448a38a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:17.386357 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3864668d-0a85-42d3-93e5-5efd9448a38a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:17.387699 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3864668d-0a85-42d3-93e5-5efd9448a38a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:17.388173 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3864668d-0a85-42d3-93e5-5efd9448a38a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:17.388615 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3864668d-0a85-42d3-93e5-5efd9448a38a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:17.527460 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3864668d-0a85-42d3-93e5-5efd9448a38a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:17.536172 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3864668d-0a85-42d3-93e5-5efd9448a38a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b" status: 200 len: 1679 microversion: 2.1 time: 0.162920 Aug 31 16:51:17.536726 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3630/7080] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:17 2022] GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:51:18.559039 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5f1ed709-9475-404c-a022-dbd019d1156f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:18.559751 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5f1ed709-9475-404c-a022-dbd019d1156f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:18.566954 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f1ed709-9475-404c-a022-dbd019d1156f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:18.567443 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f1ed709-9475-404c-a022-dbd019d1156f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:18.567872 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f1ed709-9475-404c-a022-dbd019d1156f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:18.568561 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f1ed709-9475-404c-a022-dbd019d1156f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:18.569193 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f1ed709-9475-404c-a022-dbd019d1156f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:18.569615 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f1ed709-9475-404c-a022-dbd019d1156f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:18.732996 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5f1ed709-9475-404c-a022-dbd019d1156f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:18.744322 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5f1ed709-9475-404c-a022-dbd019d1156f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b" status: 200 len: 1679 microversion: 2.1 time: 0.189274 Aug 31 16:51:18.745129 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3451/7081] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:18 2022] GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b => generated 1679 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:51:19.772918 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3cf5f415-d3ea-402a-a5fb-d74bb56c58a2 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:19.773666 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3cf5f415-d3ea-402a-a5fb-d74bb56c58a2 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:19.781178 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3cf5f415-d3ea-402a-a5fb-d74bb56c58a2 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:19.781681 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3cf5f415-d3ea-402a-a5fb-d74bb56c58a2 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:19.782130 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3cf5f415-d3ea-402a-a5fb-d74bb56c58a2 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:19.782862 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3cf5f415-d3ea-402a-a5fb-d74bb56c58a2 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:19.783319 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3cf5f415-d3ea-402a-a5fb-d74bb56c58a2 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:19.783753 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3cf5f415-d3ea-402a-a5fb-d74bb56c58a2 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:19.924807 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3cf5f415-d3ea-402a-a5fb-d74bb56c58a2 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:19.933020 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3cf5f415-d3ea-402a-a5fb-d74bb56c58a2 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b" status: 200 len: 1679 microversion: 2.1 time: 0.164441 Aug 31 16:51:19.934102 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3631/7082] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:19 2022] GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:51:20.956798 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1e7c1f36-5b85-4f2f-9372-eb047a508cb9 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:20.957516 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1e7c1f36-5b85-4f2f-9372-eb047a508cb9 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:20.965576 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e7c1f36-5b85-4f2f-9372-eb047a508cb9 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:20.966061 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e7c1f36-5b85-4f2f-9372-eb047a508cb9 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:20.966521 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e7c1f36-5b85-4f2f-9372-eb047a508cb9 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:20.967229 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e7c1f36-5b85-4f2f-9372-eb047a508cb9 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:20.967680 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e7c1f36-5b85-4f2f-9372-eb047a508cb9 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:20.968105 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e7c1f36-5b85-4f2f-9372-eb047a508cb9 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:21.111096 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1e7c1f36-5b85-4f2f-9372-eb047a508cb9 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:21.118940 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1e7c1f36-5b85-4f2f-9372-eb047a508cb9 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b" status: 200 len: 1679 microversion: 2.1 time: 0.166293 Aug 31 16:51:21.119544 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3452/7083] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:20 2022] GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:51:22.142709 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4a10fe4a-badf-4f4c-b8de-e92225478d36 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:22.144777 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4a10fe4a-badf-4f4c-b8de-e92225478d36 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:22.155838 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4a10fe4a-badf-4f4c-b8de-e92225478d36 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:22.155960 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4a10fe4a-badf-4f4c-b8de-e92225478d36 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:22.156322 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4a10fe4a-badf-4f4c-b8de-e92225478d36 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:22.157049 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4a10fe4a-badf-4f4c-b8de-e92225478d36 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:22.157518 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4a10fe4a-badf-4f4c-b8de-e92225478d36 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:22.157956 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4a10fe4a-badf-4f4c-b8de-e92225478d36 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:22.310672 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4a10fe4a-badf-4f4c-b8de-e92225478d36 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:22.318808 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4a10fe4a-badf-4f4c-b8de-e92225478d36 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b" status: 200 len: 1679 microversion: 2.1 time: 0.182126 Aug 31 16:51:22.319398 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3632/7084] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:22 2022] GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b => generated 1679 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:51:23.343128 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-97224bc9-29f5-4a98-8c98-35c4a01e62be tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:23.343676 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-97224bc9-29f5-4a98-8c98-35c4a01e62be tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:23.351392 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97224bc9-29f5-4a98-8c98-35c4a01e62be tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:23.351881 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97224bc9-29f5-4a98-8c98-35c4a01e62be tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:23.352320 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97224bc9-29f5-4a98-8c98-35c4a01e62be tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:23.353017 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97224bc9-29f5-4a98-8c98-35c4a01e62be tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:23.353470 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97224bc9-29f5-4a98-8c98-35c4a01e62be tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:23.353895 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-97224bc9-29f5-4a98-8c98-35c4a01e62be tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:23.493615 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-97224bc9-29f5-4a98-8c98-35c4a01e62be tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:23.502038 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-97224bc9-29f5-4a98-8c98-35c4a01e62be tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b" status: 200 len: 1656 microversion: 2.1 time: 0.163441 Aug 31 16:51:23.502643 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3453/7085] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:23 2022] GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b => generated 1656 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:51:23.525644 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-30ec0db3-f7ab-419f-8298-4f203eb21baf tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:51:23.528018 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-30ec0db3-f7ab-419f-8298-4f203eb21baf tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:23.535344 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-30ec0db3-f7ab-419f-8298-4f203eb21baf tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:23.536140 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-30ec0db3-f7ab-419f-8298-4f203eb21baf tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:23.536578 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-30ec0db3-f7ab-419f-8298-4f203eb21baf tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:23.537277 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-30ec0db3-f7ab-419f-8298-4f203eb21baf tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:23.537736 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-30ec0db3-f7ab-419f-8298-4f203eb21baf tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:23.538274 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-30ec0db3-f7ab-419f-8298-4f203eb21baf tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:23.570912 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-30ec0db3-f7ab-419f-8298-4f203eb21baf tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:23.577254 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-30ec0db3-f7ab-419f-8298-4f203eb21baf tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b] Old instance type m1.heat2, new instance type m1.heat {{(pid=128864) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 31 16:51:23.584191 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-30ec0db3-f7ab-419f-8298-4f203eb21baf tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:51:23.584612 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-30ec0db3-f7ab-419f-8298-4f203eb21baf tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:51:23.585088 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-30ec0db3-f7ab-419f-8298-4f203eb21baf tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:51:23.585496 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-30ec0db3-f7ab-419f-8298-4f203eb21baf tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:51:23.585908 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-30ec0db3-f7ab-419f-8298-4f203eb21baf tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:51:23.654736 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-30ec0db3-f7ab-419f-8298-4f203eb21baf tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "POST /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b/action" status: 202 len: 0 microversion: 2.1 time: 0.133031 Aug 31 16:51:23.655373 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3633/7086] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:51:23 2022] POST /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:51:23.664214 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-547db7a8-2702-4eb0-85be-eef473001d54 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:23.664789 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-547db7a8-2702-4eb0-85be-eef473001d54 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:23.671139 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-547db7a8-2702-4eb0-85be-eef473001d54 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:23.671799 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-547db7a8-2702-4eb0-85be-eef473001d54 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:23.672079 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-547db7a8-2702-4eb0-85be-eef473001d54 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:23.672791 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-547db7a8-2702-4eb0-85be-eef473001d54 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:23.673256 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-547db7a8-2702-4eb0-85be-eef473001d54 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:23.673680 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-547db7a8-2702-4eb0-85be-eef473001d54 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:23.819663 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-547db7a8-2702-4eb0-85be-eef473001d54 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:23.828918 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-547db7a8-2702-4eb0-85be-eef473001d54 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b" status: 200 len: 1679 microversion: 2.1 time: 0.168990 Aug 31 16:51:23.829712 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3454/7087] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:23 2022] GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:51:24.852011 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-15cb4118-e0ec-426e-a721-afaba5a6a9e7 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:24.853410 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-15cb4118-e0ec-426e-a721-afaba5a6a9e7 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:24.860438 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-15cb4118-e0ec-426e-a721-afaba5a6a9e7 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:24.860956 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-15cb4118-e0ec-426e-a721-afaba5a6a9e7 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:24.861404 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-15cb4118-e0ec-426e-a721-afaba5a6a9e7 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:24.862143 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-15cb4118-e0ec-426e-a721-afaba5a6a9e7 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:24.862617 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-15cb4118-e0ec-426e-a721-afaba5a6a9e7 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:24.863051 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-15cb4118-e0ec-426e-a721-afaba5a6a9e7 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:25.027733 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-15cb4118-e0ec-426e-a721-afaba5a6a9e7 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:25.036946 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-15cb4118-e0ec-426e-a721-afaba5a6a9e7 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b" status: 200 len: 1679 microversion: 2.1 time: 0.189883 Aug 31 16:51:25.037532 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3634/7088] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:24 2022] GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b => generated 1679 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:51:26.062712 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d08dc7c9-f3b3-40f5-8755-e51387c04e58 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:26.063591 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d08dc7c9-f3b3-40f5-8755-e51387c04e58 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:26.070895 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d08dc7c9-f3b3-40f5-8755-e51387c04e58 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:26.071382 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d08dc7c9-f3b3-40f5-8755-e51387c04e58 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:26.071812 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d08dc7c9-f3b3-40f5-8755-e51387c04e58 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:26.072505 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d08dc7c9-f3b3-40f5-8755-e51387c04e58 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:26.072949 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d08dc7c9-f3b3-40f5-8755-e51387c04e58 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:26.073364 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d08dc7c9-f3b3-40f5-8755-e51387c04e58 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:26.216822 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d08dc7c9-f3b3-40f5-8755-e51387c04e58 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:26.225966 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d08dc7c9-f3b3-40f5-8755-e51387c04e58 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b" status: 200 len: 1684 microversion: 2.1 time: 0.169071 Aug 31 16:51:26.226628 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3455/7089] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:26 2022] GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b => generated 1684 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:51:27.257234 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-24b22792-d150-46fc-beb3-bba683fcf2ad tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:27.259183 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-24b22792-d150-46fc-beb3-bba683fcf2ad tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:27.266924 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-24b22792-d150-46fc-beb3-bba683fcf2ad tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:27.267421 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-24b22792-d150-46fc-beb3-bba683fcf2ad tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:27.267864 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-24b22792-d150-46fc-beb3-bba683fcf2ad tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:27.268568 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-24b22792-d150-46fc-beb3-bba683fcf2ad tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:27.269023 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-24b22792-d150-46fc-beb3-bba683fcf2ad tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:27.269455 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-24b22792-d150-46fc-beb3-bba683fcf2ad tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:27.419585 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-24b22792-d150-46fc-beb3-bba683fcf2ad tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:27.428626 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-24b22792-d150-46fc-beb3-bba683fcf2ad tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b" status: 200 len: 1684 microversion: 2.1 time: 0.181759 Aug 31 16:51:27.429239 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3635/7090] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:27 2022] GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b => generated 1684 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:51:28.453876 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6a312020-6c37-4f1e-b59a-4b8dfa21ca8e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:28.454551 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6a312020-6c37-4f1e-b59a-4b8dfa21ca8e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:28.465701 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a312020-6c37-4f1e-b59a-4b8dfa21ca8e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:28.466314 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a312020-6c37-4f1e-b59a-4b8dfa21ca8e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:28.466816 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a312020-6c37-4f1e-b59a-4b8dfa21ca8e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:28.467558 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a312020-6c37-4f1e-b59a-4b8dfa21ca8e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:28.468102 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a312020-6c37-4f1e-b59a-4b8dfa21ca8e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:28.468472 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6a312020-6c37-4f1e-b59a-4b8dfa21ca8e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:28.628070 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-d486561f-149c-403e-b0fd-3b91482c1821 req-fc0d1752-cd75-4ce0-9832-75d9c88b059c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "015c2ed2-16ef-4fe4-9867-ff4d28b7a60b", "name": "network-vif-unplugged", "status": "completed", "tag": "294f91ac-7cf5-4f19-acae-3212571f92d2"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:51:28.641318 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-d486561f-149c-403e-b0fd-3b91482c1821 req-fc0d1752-cd75-4ce0-9832-75d9c88b059c service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:28.641816 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-d486561f-149c-403e-b0fd-3b91482c1821 req-fc0d1752-cd75-4ce0-9832-75d9c88b059c service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:28.642308 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-d486561f-149c-403e-b0fd-3b91482c1821 req-fc0d1752-cd75-4ce0-9832-75d9c88b059c service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:28.656600 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-d486561f-149c-403e-b0fd-3b91482c1821 req-fc0d1752-cd75-4ce0-9832-75d9c88b059c service nova] Creating event network-vif-unplugged:294f91ac-7cf5-4f19-acae-3212571f92d2 for instance 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b on n-h1-833090-16 Aug 31 16:51:28.663104 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [req-d486561f-149c-403e-b0fd-3b91482c1821 req-fc0d1752-cd75-4ce0-9832-75d9c88b059c service nova] Instance 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-833090-16', 'n-h1-833090-16'} {{(pid=128864) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 16:51:28.676649 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6a312020-6c37-4f1e-b59a-4b8dfa21ca8e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:28.676861 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-d486561f-149c-403e-b0fd-3b91482c1821 req-fc0d1752-cd75-4ce0-9832-75d9c88b059c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057430 Aug 31 16:51:28.677916 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3636/7091] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:51:28.685632 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6a312020-6c37-4f1e-b59a-4b8dfa21ca8e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b" status: 200 len: 1683 microversion: 2.1 time: 0.235999 Aug 31 16:51:28.686405 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3456/7092] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:28 2022] GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b => generated 1683 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:51:29.718345 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-67047bb7-0943-4f07-9ff4-76c9bfb93ac8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:29.719059 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-67047bb7-0943-4f07-9ff4-76c9bfb93ac8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:29.725352 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-67047bb7-0943-4f07-9ff4-76c9bfb93ac8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:29.725841 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-67047bb7-0943-4f07-9ff4-76c9bfb93ac8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:29.726339 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-67047bb7-0943-4f07-9ff4-76c9bfb93ac8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:29.727103 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-67047bb7-0943-4f07-9ff4-76c9bfb93ac8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:29.727536 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-67047bb7-0943-4f07-9ff4-76c9bfb93ac8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:29.727964 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-67047bb7-0943-4f07-9ff4-76c9bfb93ac8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:29.873318 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-67047bb7-0943-4f07-9ff4-76c9bfb93ac8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:29.883992 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-67047bb7-0943-4f07-9ff4-76c9bfb93ac8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b" status: 200 len: 1683 microversion: 2.1 time: 0.171579 Aug 31 16:51:29.884598 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3637/7093] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:29 2022] GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b => generated 1683 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:51:30.708637 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-49e1ed6f-17cd-4a7d-8a22-301d19bbad81 req-9d0b41b6-4f20-4722-ab93-56dc17a8ff73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "015c2ed2-16ef-4fe4-9867-ff4d28b7a60b", "tag": "294f91ac-7cf5-4f19-acae-3212571f92d2"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:51:30.721124 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-49e1ed6f-17cd-4a7d-8a22-301d19bbad81 req-9d0b41b6-4f20-4722-ab93-56dc17a8ff73 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:30.721600 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-49e1ed6f-17cd-4a7d-8a22-301d19bbad81 req-9d0b41b6-4f20-4722-ab93-56dc17a8ff73 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:30.722083 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-49e1ed6f-17cd-4a7d-8a22-301d19bbad81 req-9d0b41b6-4f20-4722-ab93-56dc17a8ff73 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:30.738205 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-49e1ed6f-17cd-4a7d-8a22-301d19bbad81 req-9d0b41b6-4f20-4722-ab93-56dc17a8ff73 service nova] Creating event network-changed:294f91ac-7cf5-4f19-acae-3212571f92d2 for instance 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b on n-h1-833090-16 Aug 31 16:51:30.744461 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [req-49e1ed6f-17cd-4a7d-8a22-301d19bbad81 req-9d0b41b6-4f20-4722-ab93-56dc17a8ff73 service nova] Instance 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-833090-16', 'n-h1-833090-16'} {{(pid=128863) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 16:51:30.756355 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-49e1ed6f-17cd-4a7d-8a22-301d19bbad81 req-9d0b41b6-4f20-4722-ab93-56dc17a8ff73 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051700 Aug 31 16:51:30.757224 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3457/7094] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:51:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:51:30.905845 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-df853144-c407-493f-9601-342c86eec075 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:30.906593 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-df853144-c407-493f-9601-342c86eec075 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:30.915234 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-df853144-c407-493f-9601-342c86eec075 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:30.915774 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-df853144-c407-493f-9601-342c86eec075 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:30.916242 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-df853144-c407-493f-9601-342c86eec075 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:30.917058 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-df853144-c407-493f-9601-342c86eec075 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:30.917639 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-df853144-c407-493f-9601-342c86eec075 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:30.918411 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-df853144-c407-493f-9601-342c86eec075 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:31.079481 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-df853144-c407-493f-9601-342c86eec075 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:31.091282 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-df853144-c407-493f-9601-342c86eec075 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b" status: 200 len: 1681 microversion: 2.1 time: 0.188958 Aug 31 16:51:31.092545 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3638/7095] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:30 2022] GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b => generated 1681 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:51:32.116514 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8a344db1-7184-4fdd-ba42-f349f090370c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:32.117295 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8a344db1-7184-4fdd-ba42-f349f090370c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:32.124441 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a344db1-7184-4fdd-ba42-f349f090370c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:32.124941 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a344db1-7184-4fdd-ba42-f349f090370c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:32.125401 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a344db1-7184-4fdd-ba42-f349f090370c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:32.126144 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a344db1-7184-4fdd-ba42-f349f090370c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:32.126637 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a344db1-7184-4fdd-ba42-f349f090370c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:32.127062 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a344db1-7184-4fdd-ba42-f349f090370c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:32.301880 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8a344db1-7184-4fdd-ba42-f349f090370c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:32.310699 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8a344db1-7184-4fdd-ba42-f349f090370c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b" status: 200 len: 1677 microversion: 2.1 time: 0.200054 Aug 31 16:51:32.311390 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3458/7096] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:32 2022] GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b => generated 1677 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:51:32.333806 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-53609e0f-eabe-4747-b12b-b7d10e89628d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:51:32.334389 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-53609e0f-eabe-4747-b12b-b7d10e89628d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:32.343620 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-53609e0f-eabe-4747-b12b-b7d10e89628d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:32.344119 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-53609e0f-eabe-4747-b12b-b7d10e89628d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:32.344727 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-53609e0f-eabe-4747-b12b-b7d10e89628d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:32.345571 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-53609e0f-eabe-4747-b12b-b7d10e89628d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:32.346057 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-53609e0f-eabe-4747-b12b-b7d10e89628d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:32.346571 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-53609e0f-eabe-4747-b12b-b7d10e89628d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:32.431223 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-53609e0f-eabe-4747-b12b-b7d10e89628d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "POST /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b/action" status: 204 len: 0 microversion: 2.1 time: 0.101444 Aug 31 16:51:32.431983 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3639/7097] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:51:32 2022] POST /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b/action => generated 0 bytes in 103 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:51:32.443533 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2c7c72cd-da3c-46ac-bdd8-c8fb0aad08e3 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:32.444190 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2c7c72cd-da3c-46ac-bdd8-c8fb0aad08e3 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:32.452919 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c7c72cd-da3c-46ac-bdd8-c8fb0aad08e3 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:32.453509 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c7c72cd-da3c-46ac-bdd8-c8fb0aad08e3 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:32.454122 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c7c72cd-da3c-46ac-bdd8-c8fb0aad08e3 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:32.454978 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c7c72cd-da3c-46ac-bdd8-c8fb0aad08e3 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:32.455435 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c7c72cd-da3c-46ac-bdd8-c8fb0aad08e3 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:32.455903 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2c7c72cd-da3c-46ac-bdd8-c8fb0aad08e3 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:32.611440 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2c7c72cd-da3c-46ac-bdd8-c8fb0aad08e3 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:32.619912 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2c7c72cd-da3c-46ac-bdd8-c8fb0aad08e3 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b" status: 200 len: 1677 microversion: 2.1 time: 0.182167 Aug 31 16:51:32.620834 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3459/7098] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:32 2022] GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b => generated 1677 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:51:33.652398 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6b76c63a-1097-47dd-91ed-49f95a87df16 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:33.653248 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6b76c63a-1097-47dd-91ed-49f95a87df16 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:33.660885 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6b76c63a-1097-47dd-91ed-49f95a87df16 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:33.661436 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6b76c63a-1097-47dd-91ed-49f95a87df16 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:33.662309 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6b76c63a-1097-47dd-91ed-49f95a87df16 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:33.663201 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6b76c63a-1097-47dd-91ed-49f95a87df16 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:33.663789 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6b76c63a-1097-47dd-91ed-49f95a87df16 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:33.664248 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6b76c63a-1097-47dd-91ed-49f95a87df16 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:33.797794 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-957b5dbd-ffd7-4026-b738-235e9f086bff req-093563aa-954a-4c40-8129-220b459ebdec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "015c2ed2-16ef-4fe4-9867-ff4d28b7a60b", "name": "network-vif-plugged", "status": "completed", "tag": "294f91ac-7cf5-4f19-acae-3212571f92d2"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:51:33.824284 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-957b5dbd-ffd7-4026-b738-235e9f086bff req-093563aa-954a-4c40-8129-220b459ebdec service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:33.825106 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-957b5dbd-ffd7-4026-b738-235e9f086bff req-093563aa-954a-4c40-8129-220b459ebdec service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:33.825992 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-957b5dbd-ffd7-4026-b738-235e9f086bff req-093563aa-954a-4c40-8129-220b459ebdec service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:33.847290 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-957b5dbd-ffd7-4026-b738-235e9f086bff req-093563aa-954a-4c40-8129-220b459ebdec service nova] Creating event network-vif-plugged:294f91ac-7cf5-4f19-acae-3212571f92d2 for instance 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b on n-h1-833090-16 Aug 31 16:51:33.853987 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-957b5dbd-ffd7-4026-b738-235e9f086bff req-093563aa-954a-4c40-8129-220b459ebdec service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062258 Aug 31 16:51:33.855551 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3460/7099] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:51:34.154681 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6b76c63a-1097-47dd-91ed-49f95a87df16 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:34.163515 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6b76c63a-1097-47dd-91ed-49f95a87df16 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b" status: 200 len: 1677 microversion: 2.1 time: 0.518557 Aug 31 16:51:34.164095 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3640/7100] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:33 2022] GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b => generated 1677 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:51:35.191250 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1cc87d5e-02da-48c8-bc3a-4700bfec1c2a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:35.192047 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1cc87d5e-02da-48c8-bc3a-4700bfec1c2a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:35.200110 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1cc87d5e-02da-48c8-bc3a-4700bfec1c2a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:35.200731 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1cc87d5e-02da-48c8-bc3a-4700bfec1c2a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:35.201372 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1cc87d5e-02da-48c8-bc3a-4700bfec1c2a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:35.202226 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1cc87d5e-02da-48c8-bc3a-4700bfec1c2a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:35.202761 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1cc87d5e-02da-48c8-bc3a-4700bfec1c2a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:35.203194 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1cc87d5e-02da-48c8-bc3a-4700bfec1c2a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:35.346756 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1cc87d5e-02da-48c8-bc3a-4700bfec1c2a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:35.354929 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1cc87d5e-02da-48c8-bc3a-4700bfec1c2a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b" status: 200 len: 1656 microversion: 2.1 time: 0.167862 Aug 31 16:51:35.355516 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3461/7101] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:35 2022] GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b => generated 1656 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:51:35.375545 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-bec9053a-be82-483c-a925-bdc85eea1cd5 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:35.376140 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-bec9053a-be82-483c-a925-bdc85eea1cd5 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:35.383567 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bec9053a-be82-483c-a925-bdc85eea1cd5 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:35.384047 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bec9053a-be82-483c-a925-bdc85eea1cd5 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:35.384508 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bec9053a-be82-483c-a925-bdc85eea1cd5 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:35.385234 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bec9053a-be82-483c-a925-bdc85eea1cd5 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:35.386698 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bec9053a-be82-483c-a925-bdc85eea1cd5 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:35.387252 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bec9053a-be82-483c-a925-bdc85eea1cd5 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:35.535418 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-bec9053a-be82-483c-a925-bdc85eea1cd5 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:35.544585 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-bec9053a-be82-483c-a925-bdc85eea1cd5 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b" status: 200 len: 1656 microversion: 2.1 time: 0.172912 Aug 31 16:51:35.545396 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3641/7102] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:35 2022] GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b => generated 1656 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:51:35.565127 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-60ded4a8-3740-4bda-8511-d4ad4c89b2aa tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:51:35.571537 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60ded4a8-3740-4bda-8511-d4ad4c89b2aa tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:35.572029 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60ded4a8-3740-4bda-8511-d4ad4c89b2aa tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:35.572502 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60ded4a8-3740-4bda-8511-d4ad4c89b2aa tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:35.596853 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-60ded4a8-3740-4bda-8511-d4ad4c89b2aa tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b] Going to try to start instance {{(pid=128863) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 31 16:51:35.643063 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-60ded4a8-3740-4bda-8511-d4ad4c89b2aa tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "POST /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b/action" status: 202 len: 0 microversion: 2.1 time: 0.081838 Aug 31 16:51:35.643677 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3462/7103] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:51:35 2022] POST /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:51:35.652720 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fe7d3770-5ea9-4e42-a829-b785cda2382f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:35.653359 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fe7d3770-5ea9-4e42-a829-b785cda2382f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:35.660276 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fe7d3770-5ea9-4e42-a829-b785cda2382f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:35.660809 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fe7d3770-5ea9-4e42-a829-b785cda2382f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:35.661242 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fe7d3770-5ea9-4e42-a829-b785cda2382f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:35.662314 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fe7d3770-5ea9-4e42-a829-b785cda2382f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:35.663099 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fe7d3770-5ea9-4e42-a829-b785cda2382f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:35.663804 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fe7d3770-5ea9-4e42-a829-b785cda2382f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:35.683454 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:51:35.833553 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-fe7d3770-5ea9-4e42-a829-b785cda2382f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:35.844735 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fe7d3770-5ea9-4e42-a829-b785cda2382f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b" status: 200 len: 1665 microversion: 2.1 time: 0.196215 Aug 31 16:51:35.845446 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3642/7104] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:35 2022] GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b => generated 1665 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:51:36.871435 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c4202478-eed3-40f5-984b-cad7983ba41e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:36.872144 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c4202478-eed3-40f5-984b-cad7983ba41e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:36.878997 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4202478-eed3-40f5-984b-cad7983ba41e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:36.879485 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4202478-eed3-40f5-984b-cad7983ba41e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:36.879908 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4202478-eed3-40f5-984b-cad7983ba41e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:36.880606 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4202478-eed3-40f5-984b-cad7983ba41e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:36.881056 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4202478-eed3-40f5-984b-cad7983ba41e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:36.881485 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4202478-eed3-40f5-984b-cad7983ba41e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:36.905309 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:51:37.049671 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c4202478-eed3-40f5-984b-cad7983ba41e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:37.059473 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c4202478-eed3-40f5-984b-cad7983ba41e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b" status: 200 len: 1669 microversion: 2.1 time: 0.195076 Aug 31 16:51:37.060094 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3463/7105] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:36 2022] GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b => generated 1669 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:51:37.085591 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1856e0a4-627b-4dbf-a234-9d46b2d1b768 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:37.086185 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1856e0a4-627b-4dbf-a234-9d46b2d1b768 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:37.094974 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1856e0a4-627b-4dbf-a234-9d46b2d1b768 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:37.095570 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1856e0a4-627b-4dbf-a234-9d46b2d1b768 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:37.096127 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1856e0a4-627b-4dbf-a234-9d46b2d1b768 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:37.096843 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1856e0a4-627b-4dbf-a234-9d46b2d1b768 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:37.097349 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1856e0a4-627b-4dbf-a234-9d46b2d1b768 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:37.097835 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1856e0a4-627b-4dbf-a234-9d46b2d1b768 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:37.130169 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1856e0a4-627b-4dbf-a234-9d46b2d1b768 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:51:37.220729 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1856e0a4-627b-4dbf-a234-9d46b2d1b768 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "DELETE /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b" status: 204 len: 0 microversion: 2.1 time: 0.138965 Aug 31 16:51:37.221642 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3643/7106] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:51:37 2022] DELETE /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:51:37.237628 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6f3b4006-74a2-4c16-b84b-c864aa1ad5a0 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:37.238334 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6f3b4006-74a2-4c16-b84b-c864aa1ad5a0 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:37.245516 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6f3b4006-74a2-4c16-b84b-c864aa1ad5a0 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:37.246020 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6f3b4006-74a2-4c16-b84b-c864aa1ad5a0 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:37.246461 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6f3b4006-74a2-4c16-b84b-c864aa1ad5a0 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:37.247174 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6f3b4006-74a2-4c16-b84b-c864aa1ad5a0 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:37.248929 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6f3b4006-74a2-4c16-b84b-c864aa1ad5a0 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:37.249374 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6f3b4006-74a2-4c16-b84b-c864aa1ad5a0 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:37.400097 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6f3b4006-74a2-4c16-b84b-c864aa1ad5a0 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:37.410505 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6f3b4006-74a2-4c16-b84b-c864aa1ad5a0 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b" status: 200 len: 1675 microversion: 2.1 time: 0.183163 Aug 31 16:51:37.411083 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3464/7107] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:37 2022] GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b => generated 1675 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:51:38.434663 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c1f9e9cf-466f-4af8-b047-8343257b99ee tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:38.435477 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c1f9e9cf-466f-4af8-b047-8343257b99ee tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:38.443091 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c1f9e9cf-466f-4af8-b047-8343257b99ee tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:38.443591 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c1f9e9cf-466f-4af8-b047-8343257b99ee tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:38.444039 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c1f9e9cf-466f-4af8-b047-8343257b99ee tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:38.444806 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c1f9e9cf-466f-4af8-b047-8343257b99ee tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:38.445362 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c1f9e9cf-466f-4af8-b047-8343257b99ee tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:38.445755 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c1f9e9cf-466f-4af8-b047-8343257b99ee tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:38.612713 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c1f9e9cf-466f-4af8-b047-8343257b99ee tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:38.622789 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c1f9e9cf-466f-4af8-b047-8343257b99ee tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b" status: 200 len: 1675 microversion: 2.1 time: 0.192633 Aug 31 16:51:38.623856 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3644/7108] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:38 2022] GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b => generated 1675 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:51:39.645888 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bbaa91e8-c97d-46e3-bd3c-acf915145304 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:39.646649 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bbaa91e8-c97d-46e3-bd3c-acf915145304 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:39.655062 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bbaa91e8-c97d-46e3-bd3c-acf915145304 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:39.655788 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bbaa91e8-c97d-46e3-bd3c-acf915145304 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:39.656287 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bbaa91e8-c97d-46e3-bd3c-acf915145304 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:39.657074 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bbaa91e8-c97d-46e3-bd3c-acf915145304 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:39.657590 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bbaa91e8-c97d-46e3-bd3c-acf915145304 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:39.658119 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bbaa91e8-c97d-46e3-bd3c-acf915145304 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:39.727840 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-bbaa91e8-c97d-46e3-bd3c-acf915145304 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:39.736470 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bbaa91e8-c97d-46e3-bd3c-acf915145304 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b" status: 200 len: 1608 microversion: 2.1 time: 0.094803 Aug 31 16:51:39.737484 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3465/7109] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:39 2022] GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b => generated 1608 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:51:39.785590 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-3465c111-2533-4e52-96aa-905e2b67bf75 req-c4f1a09a-bd78-43d0-b335-80c636757d46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "015c2ed2-16ef-4fe4-9867-ff4d28b7a60b", "name": "network-vif-deleted", "tag": "294f91ac-7cf5-4f19-acae-3212571f92d2"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:51:39.812124 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-3465c111-2533-4e52-96aa-905e2b67bf75 req-c4f1a09a-bd78-43d0-b335-80c636757d46 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:39.812726 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-3465c111-2533-4e52-96aa-905e2b67bf75 req-c4f1a09a-bd78-43d0-b335-80c636757d46 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:39.813592 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-3465c111-2533-4e52-96aa-905e2b67bf75 req-c4f1a09a-bd78-43d0-b335-80c636757d46 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:39.828340 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-3465c111-2533-4e52-96aa-905e2b67bf75 req-c4f1a09a-bd78-43d0-b335-80c636757d46 service nova] Creating event network-vif-deleted:294f91ac-7cf5-4f19-acae-3212571f92d2 for instance 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b on n-h1-833090-16 Aug 31 16:51:39.833411 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-3465c111-2533-4e52-96aa-905e2b67bf75 req-c4f1a09a-bd78-43d0-b335-80c636757d46 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052225 Aug 31 16:51:39.834415 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3645/7110] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:51:40.759805 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9a1a4099-1b64-4479-ba24-6181a901bff8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:40.760406 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9a1a4099-1b64-4479-ba24-6181a901bff8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:40.768634 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a1a4099-1b64-4479-ba24-6181a901bff8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:40.769138 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a1a4099-1b64-4479-ba24-6181a901bff8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:40.769561 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a1a4099-1b64-4479-ba24-6181a901bff8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:40.770305 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a1a4099-1b64-4479-ba24-6181a901bff8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:40.770790 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a1a4099-1b64-4479-ba24-6181a901bff8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:40.771219 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a1a4099-1b64-4479-ba24-6181a901bff8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:40.786438 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-9a1a4099-1b64-4479-ba24-6181a901bff8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] HTTP exception thrown: Instance 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b could not be found. Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9a1a4099-1b64-4479-ba24-6181a901bff8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Request method failure captured: Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b HTTP/1.1 Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD5C9uAz-t5mh-r3mUMMlr2wQd9RJYBAKDGT0KvPrLTihjtZPy6-09_bJTMDpSB88huaVHBLxwU79aGS9Ig9M6XEadSxV6dHNvqYvU2MaYuMgncb9fl7PDdbiMU9wj6m6OmrQoGoaSgGYVEfgnnlWHC-gb6kVlFh35PHiKS5x0RNERSU Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: fce77c4128d3448885217ac4d4744765 Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerActionsTestJSON-1850065935 Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fce77c4128d3448885217ac4d4744765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fce77c4128d3448885217ac4d4744765"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/fce77c4128d3448885217ac4d4744765"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_fce77c4128d3448885217ac4d4744765", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServerActionsTestJSON-1850065935 Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: fce77c4128d3448885217ac4d4744765 Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerActionsTestJSON-1850065935 Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServerActionsTestJSON-1850065935-project Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 689ff4da0acb4aafa5f44d42e68ab41d Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServerActionsTestJSON-1850065935-project Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b could not be found. Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '015c2ed2-16ef-4fe4-9867-ff4d28b7a60b'} Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b could not be found. Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b could not be found. Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:51:40.788656 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:51:40.793602 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:51:40.793602 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:51:40.793602 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:51:40.793602 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:51:40.793602 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:51:40.793602 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b could not be found. Aug 31 16:51:40.793602 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:51:40.793602 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9a1a4099-1b64-4479-ba24-6181a901bff8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Returning 404 to user: Instance 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:51:40.793602 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9a1a4099-1b64-4479-ba24-6181a901bff8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b" status: 404 len: 111 microversion: 2.1 time: 0.034342 Aug 31 16:51:40.793602 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3466/7111] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:40 2022] GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:51:40.812862 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-76f6e0de-272b-4839-b2ba-f98a69e0f08e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:40.813687 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-76f6e0de-272b-4839-b2ba-f98a69e0f08e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:40.820838 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76f6e0de-272b-4839-b2ba-f98a69e0f08e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:40.821362 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76f6e0de-272b-4839-b2ba-f98a69e0f08e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:40.821794 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76f6e0de-272b-4839-b2ba-f98a69e0f08e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:40.822918 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76f6e0de-272b-4839-b2ba-f98a69e0f08e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:40.823180 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76f6e0de-272b-4839-b2ba-f98a69e0f08e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:40.823541 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76f6e0de-272b-4839-b2ba-f98a69e0f08e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:40.844846 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-76f6e0de-272b-4839-b2ba-f98a69e0f08e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] HTTP exception thrown: Instance 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b could not be found. Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-76f6e0de-272b-4839-b2ba-f98a69e0f08e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Request method failure captured: Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b HTTP/1.1 Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD5C9uAz-t5mh-r3mUMMlr2wQd9RJYBAKDGT0KvPrLTihjtZPy6-09_bJTMDpSB88huaVHBLxwU79aGS9Ig9M6XEadSxV6dHNvqYvU2MaYuMgncb9fl7PDdbiMU9wj6m6OmrQoGoaSgGYVEfgnnlWHC-gb6kVlFh35PHiKS5x0RNERSU Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: fce77c4128d3448885217ac4d4744765 Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServerActionsTestJSON-1850065935 Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fce77c4128d3448885217ac4d4744765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fce77c4128d3448885217ac4d4744765"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/fce77c4128d3448885217ac4d4744765"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_fce77c4128d3448885217ac4d4744765", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServerActionsTestJSON-1850065935 Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: fce77c4128d3448885217ac4d4744765 Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServerActionsTestJSON-1850065935 Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServerActionsTestJSON-1850065935-project Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 689ff4da0acb4aafa5f44d42e68ab41d Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServerActionsTestJSON-1850065935-project Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b could not be found. Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '015c2ed2-16ef-4fe4-9867-ff4d28b7a60b'} Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b could not be found. Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b could not be found. Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:51:40.846758 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:51:40.852011 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:51:40.852011 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:51:40.852011 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:51:40.852011 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:51:40.852011 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:51:40.852011 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b could not be found. Aug 31 16:51:40.852011 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:51:40.852011 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-76f6e0de-272b-4839-b2ba-f98a69e0f08e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Returning 404 to user: Instance 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:51:40.852011 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-76f6e0de-272b-4839-b2ba-f98a69e0f08e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b" status: 404 len: 111 microversion: 2.1 time: 0.040914 Aug 31 16:51:40.852011 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3646/7112] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:40 2022] GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:51:40.901661 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4248c1bc-ea53-4531-9295-2acc2b5a145d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-663780899", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "b8a9ec6f-b6c3-4e24-8c90-3b9785a6ff39"}], "security_groups": [{"name": "tempest-securitygroup--137403414"}], "key_name": "tempest-keypair-249207011", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:51:41.014568 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-4248c1bc-ea53-4531-9295-2acc2b5a145d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] validate_networks() for [('b8a9ec6f-b6c3-4e24-8c90-3b9785a6ff39', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:51:41.423857 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-4248c1bc-ea53-4531-9295-2acc2b5a145d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:51:41.424283 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-4248c1bc-ea53-4531-9295-2acc2b5a145d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:51:41.424756 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-4248c1bc-ea53-4531-9295-2acc2b5a145d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:51:41.425186 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-4248c1bc-ea53-4531-9295-2acc2b5a145d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:51:41.425607 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-4248c1bc-ea53-4531-9295-2acc2b5a145d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:51:41.439583 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4248c1bc-ea53-4531-9295-2acc2b5a145d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:41.440863 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4248c1bc-ea53-4531-9295-2acc2b5a145d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:41.440863 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4248c1bc-ea53-4531-9295-2acc2b5a145d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:41.441412 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4248c1bc-ea53-4531-9295-2acc2b5a145d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:41.441895 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4248c1bc-ea53-4531-9295-2acc2b5a145d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:41.442331 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4248c1bc-ea53-4531-9295-2acc2b5a145d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:41.462241 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-4248c1bc-ea53-4531-9295-2acc2b5a145d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Getting quotas for project fce77c4128d3448885217ac4d4744765. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:51:41.468745 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-4248c1bc-ea53-4531-9295-2acc2b5a145d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Getting quotas for user 689ff4da0acb4aafa5f44d42e68ab41d and project fce77c4128d3448885217ac4d4744765. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:51:41.482004 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4248c1bc-ea53-4531-9295-2acc2b5a145d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:51:41.484640 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4248c1bc-ea53-4531-9295-2acc2b5a145d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: c39c1157-f207-4ef9-a7c5-6bc88b4986dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:51:41.539846 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4248c1bc-ea53-4531-9295-2acc2b5a145d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.642151 Aug 31 16:51:41.540510 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3467/7113] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:51:40 2022] POST /compute/v2.1/servers => generated 405 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:51:41.552565 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-dca04f9e-5011-4484-9464-2f8e6cd364f2 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:41.553278 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-dca04f9e-5011-4484-9464-2f8e6cd364f2 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: c39c1157-f207-4ef9-a7c5-6bc88b4986dd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:41.620858 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-dca04f9e-5011-4484-9464-2f8e6cd364f2 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:41.631228 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-dca04f9e-5011-4484-9464-2f8e6cd364f2 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd" status: 200 len: 1237 microversion: 2.1 time: 0.082952 Aug 31 16:51:41.631887 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3647/7114] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:41 2022] GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd => generated 1237 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:51:42.657401 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-336d185c-47fe-4a28-9ce2-efa417dfac84 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:42.658113 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-336d185c-47fe-4a28-9ce2-efa417dfac84 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: c39c1157-f207-4ef9-a7c5-6bc88b4986dd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:42.661601 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:51:42.668730 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-336d185c-47fe-4a28-9ce2-efa417dfac84 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:42.669214 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-336d185c-47fe-4a28-9ce2-efa417dfac84 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:42.669642 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-336d185c-47fe-4a28-9ce2-efa417dfac84 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:42.670444 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-336d185c-47fe-4a28-9ce2-efa417dfac84 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:42.671013 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-336d185c-47fe-4a28-9ce2-efa417dfac84 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:42.671429 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-336d185c-47fe-4a28-9ce2-efa417dfac84 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:42.741680 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-336d185c-47fe-4a28-9ce2-efa417dfac84 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:42.752137 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-336d185c-47fe-4a28-9ce2-efa417dfac84 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd" status: 200 len: 1297 microversion: 2.1 time: 0.100200 Aug 31 16:51:42.752936 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3468/7115] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:42 2022] GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd => generated 1297 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:51:43.773349 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-50198af0-8ba4-4d1b-a73d-6a1540642f2d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:43.774115 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-50198af0-8ba4-4d1b-a73d-6a1540642f2d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: c39c1157-f207-4ef9-a7c5-6bc88b4986dd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:43.778190 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:51:43.784818 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-50198af0-8ba4-4d1b-a73d-6a1540642f2d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:43.785796 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-50198af0-8ba4-4d1b-a73d-6a1540642f2d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:43.787098 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-50198af0-8ba4-4d1b-a73d-6a1540642f2d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:43.788157 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-50198af0-8ba4-4d1b-a73d-6a1540642f2d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:43.788645 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-50198af0-8ba4-4d1b-a73d-6a1540642f2d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:43.789109 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-50198af0-8ba4-4d1b-a73d-6a1540642f2d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:43.935753 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-50198af0-8ba4-4d1b-a73d-6a1540642f2d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:43.944562 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-50198af0-8ba4-4d1b-a73d-6a1540642f2d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd" status: 200 len: 1362 microversion: 2.1 time: 0.175281 Aug 31 16:51:43.945290 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3648/7116] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:43 2022] GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:51:44.242081 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-6a2cc210-c45e-4f25-b4af-4a0b606d7a55 req-0c6d3af3-d657-4e3c-bba4-6835eb3ee3e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c39c1157-f207-4ef9-a7c5-6bc88b4986dd", "tag": "d31a26b7-ffb6-4f1c-81b0-8baf22104732"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:51:44.258697 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-6a2cc210-c45e-4f25-b4af-4a0b606d7a55 req-0c6d3af3-d657-4e3c-bba4-6835eb3ee3e4 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:44.259183 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-6a2cc210-c45e-4f25-b4af-4a0b606d7a55 req-0c6d3af3-d657-4e3c-bba4-6835eb3ee3e4 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:44.259594 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-6a2cc210-c45e-4f25-b4af-4a0b606d7a55 req-0c6d3af3-d657-4e3c-bba4-6835eb3ee3e4 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:44.275185 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-6a2cc210-c45e-4f25-b4af-4a0b606d7a55 req-0c6d3af3-d657-4e3c-bba4-6835eb3ee3e4 service nova] Creating event network-changed:d31a26b7-ffb6-4f1c-81b0-8baf22104732 for instance c39c1157-f207-4ef9-a7c5-6bc88b4986dd on n-h2-833090-16 Aug 31 16:51:44.281187 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-6a2cc210-c45e-4f25-b4af-4a0b606d7a55 req-0c6d3af3-d657-4e3c-bba4-6835eb3ee3e4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044395 Aug 31 16:51:44.282321 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3469/7117] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:51:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:51:44.966895 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7913dbd9-c593-4858-b88b-4b1513866ffa tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:44.967968 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7913dbd9-c593-4858-b88b-4b1513866ffa tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: c39c1157-f207-4ef9-a7c5-6bc88b4986dd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:44.976351 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7913dbd9-c593-4858-b88b-4b1513866ffa tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:44.976863 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7913dbd9-c593-4858-b88b-4b1513866ffa tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:44.977348 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7913dbd9-c593-4858-b88b-4b1513866ffa tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:44.978074 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7913dbd9-c593-4858-b88b-4b1513866ffa tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:44.978682 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7913dbd9-c593-4858-b88b-4b1513866ffa tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:44.979153 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7913dbd9-c593-4858-b88b-4b1513866ffa tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:45.130421 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7913dbd9-c593-4858-b88b-4b1513866ffa tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:45.139100 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7913dbd9-c593-4858-b88b-4b1513866ffa tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd" status: 200 len: 1362 microversion: 2.1 time: 0.175973 Aug 31 16:51:45.140513 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3649/7118] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:44 2022] GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:51:46.163292 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0cb10f51-6554-48c1-95af-8c80b7fe9294 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:46.164029 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0cb10f51-6554-48c1-95af-8c80b7fe9294 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: c39c1157-f207-4ef9-a7c5-6bc88b4986dd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:46.171818 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0cb10f51-6554-48c1-95af-8c80b7fe9294 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:46.172308 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0cb10f51-6554-48c1-95af-8c80b7fe9294 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:46.172750 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0cb10f51-6554-48c1-95af-8c80b7fe9294 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:46.173457 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0cb10f51-6554-48c1-95af-8c80b7fe9294 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:46.173911 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0cb10f51-6554-48c1-95af-8c80b7fe9294 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:46.174363 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0cb10f51-6554-48c1-95af-8c80b7fe9294 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:46.337900 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0cb10f51-6554-48c1-95af-8c80b7fe9294 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:46.349550 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0cb10f51-6554-48c1-95af-8c80b7fe9294 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd" status: 200 len: 1362 microversion: 2.1 time: 0.191947 Aug 31 16:51:46.350158 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3470/7119] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:46 2022] GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:51:47.371693 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-24d8ae72-e9f0-4009-9bf7-2d84476db73f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:47.372658 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-24d8ae72-e9f0-4009-9bf7-2d84476db73f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: c39c1157-f207-4ef9-a7c5-6bc88b4986dd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:47.383854 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-24d8ae72-e9f0-4009-9bf7-2d84476db73f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:47.384680 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-24d8ae72-e9f0-4009-9bf7-2d84476db73f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:47.385426 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-24d8ae72-e9f0-4009-9bf7-2d84476db73f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:47.386637 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-24d8ae72-e9f0-4009-9bf7-2d84476db73f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:47.387409 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-24d8ae72-e9f0-4009-9bf7-2d84476db73f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:47.388137 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-24d8ae72-e9f0-4009-9bf7-2d84476db73f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:47.539023 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-24d8ae72-e9f0-4009-9bf7-2d84476db73f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:47.548647 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-24d8ae72-e9f0-4009-9bf7-2d84476db73f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd" status: 200 len: 1362 microversion: 2.1 time: 0.181247 Aug 31 16:51:47.549295 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3650/7120] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:47 2022] GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:51:48.570906 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e9356637-fc0a-4e28-9aba-c17d3ae69215 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:48.571800 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e9356637-fc0a-4e28-9aba-c17d3ae69215 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: c39c1157-f207-4ef9-a7c5-6bc88b4986dd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:48.582288 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9356637-fc0a-4e28-9aba-c17d3ae69215 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:48.583144 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9356637-fc0a-4e28-9aba-c17d3ae69215 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:48.583930 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9356637-fc0a-4e28-9aba-c17d3ae69215 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:48.585077 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9356637-fc0a-4e28-9aba-c17d3ae69215 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:48.585766 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9356637-fc0a-4e28-9aba-c17d3ae69215 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:48.586509 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9356637-fc0a-4e28-9aba-c17d3ae69215 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:48.739066 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e9356637-fc0a-4e28-9aba-c17d3ae69215 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:48.747506 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e9356637-fc0a-4e28-9aba-c17d3ae69215 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd" status: 200 len: 1362 microversion: 2.1 time: 0.181069 Aug 31 16:51:48.748088 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3471/7121] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:48 2022] GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:51:49.051763 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-a61e4acb-0f2e-455a-8aaa-f5edf1b80129 req-b08e9761-7f23-4910-a85b-b3eece9285bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c39c1157-f207-4ef9-a7c5-6bc88b4986dd", "name": "network-vif-plugged", "status": "completed", "tag": "d31a26b7-ffb6-4f1c-81b0-8baf22104732"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:51:49.066213 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-a61e4acb-0f2e-455a-8aaa-f5edf1b80129 req-b08e9761-7f23-4910-a85b-b3eece9285bc service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:49.066719 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-a61e4acb-0f2e-455a-8aaa-f5edf1b80129 req-b08e9761-7f23-4910-a85b-b3eece9285bc service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:49.067171 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-a61e4acb-0f2e-455a-8aaa-f5edf1b80129 req-b08e9761-7f23-4910-a85b-b3eece9285bc service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:49.079440 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-a61e4acb-0f2e-455a-8aaa-f5edf1b80129 req-b08e9761-7f23-4910-a85b-b3eece9285bc service nova] Creating event network-vif-plugged:d31a26b7-ffb6-4f1c-81b0-8baf22104732 for instance c39c1157-f207-4ef9-a7c5-6bc88b4986dd on n-h2-833090-16 Aug 31 16:51:49.085060 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-a61e4acb-0f2e-455a-8aaa-f5edf1b80129 req-b08e9761-7f23-4910-a85b-b3eece9285bc service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037356 Aug 31 16:51:49.085761 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3651/7122] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:51:49.770386 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-17e7dcd1-1d8a-4037-8e9c-081a25e9b0d6 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:49.771010 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-17e7dcd1-1d8a-4037-8e9c-081a25e9b0d6 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: c39c1157-f207-4ef9-a7c5-6bc88b4986dd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:49.778115 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-17e7dcd1-1d8a-4037-8e9c-081a25e9b0d6 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:49.778611 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-17e7dcd1-1d8a-4037-8e9c-081a25e9b0d6 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:49.779164 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-17e7dcd1-1d8a-4037-8e9c-081a25e9b0d6 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:49.779997 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-17e7dcd1-1d8a-4037-8e9c-081a25e9b0d6 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:49.780546 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-17e7dcd1-1d8a-4037-8e9c-081a25e9b0d6 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:49.780984 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-17e7dcd1-1d8a-4037-8e9c-081a25e9b0d6 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:49.932238 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-17e7dcd1-1d8a-4037-8e9c-081a25e9b0d6 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:49.945412 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-17e7dcd1-1d8a-4037-8e9c-081a25e9b0d6 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd" status: 200 len: 1362 microversion: 2.1 time: 0.178865 Aug 31 16:51:49.946225 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3472/7123] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:49 2022] GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:51:50.980399 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-95951534-8da5-4c9e-958f-4d32ddebcf32 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:50.981414 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-95951534-8da5-4c9e-958f-4d32ddebcf32 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: c39c1157-f207-4ef9-a7c5-6bc88b4986dd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:50.991442 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95951534-8da5-4c9e-958f-4d32ddebcf32 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:50.991608 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95951534-8da5-4c9e-958f-4d32ddebcf32 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:50.992122 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95951534-8da5-4c9e-958f-4d32ddebcf32 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:50.993137 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95951534-8da5-4c9e-958f-4d32ddebcf32 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:50.993760 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95951534-8da5-4c9e-958f-4d32ddebcf32 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:50.994270 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-95951534-8da5-4c9e-958f-4d32ddebcf32 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:51.144958 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-95951534-8da5-4c9e-958f-4d32ddebcf32 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:51:51.154508 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-95951534-8da5-4c9e-958f-4d32ddebcf32 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd" status: 200 len: 1550 microversion: 2.1 time: 0.182394 Aug 31 16:51:51.155391 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3652/7124] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:51:50 2022] GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd => generated 1550 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:51:51.180324 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-576f4cfc-5cf2-4095-a731-1618e279f1b4 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:51:51.180876 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-576f4cfc-5cf2-4095-a731-1618e279f1b4 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: c39c1157-f207-4ef9-a7c5-6bc88b4986dd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:51:51.188035 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-576f4cfc-5cf2-4095-a731-1618e279f1b4 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:51.188514 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-576f4cfc-5cf2-4095-a731-1618e279f1b4 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:51.189143 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-576f4cfc-5cf2-4095-a731-1618e279f1b4 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:51.189843 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-576f4cfc-5cf2-4095-a731-1618e279f1b4 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:51.190328 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-576f4cfc-5cf2-4095-a731-1618e279f1b4 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:51.190748 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-576f4cfc-5cf2-4095-a731-1618e279f1b4 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:51.274636 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-576f4cfc-5cf2-4095-a731-1618e279f1b4 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097904 Aug 31 16:51:51.275569 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3473/7125] 10.222.0.50 () {58 vars in 1275 bytes} [Wed Aug 31 16:51:51 2022] GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:51:52.288284 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-918b1c10-7d9a-4f9d-8c97-53b0de411792 req-de0429b9-3b7e-4046-bc4a-d07ec55d2443 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c39c1157-f207-4ef9-a7c5-6bc88b4986dd", "tag": "d31a26b7-ffb6-4f1c-81b0-8baf22104732"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:51:52.293790 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:51:52.301674 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-918b1c10-7d9a-4f9d-8c97-53b0de411792 req-de0429b9-3b7e-4046-bc4a-d07ec55d2443 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:51:52.302197 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-918b1c10-7d9a-4f9d-8c97-53b0de411792 req-de0429b9-3b7e-4046-bc4a-d07ec55d2443 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:51:52.302638 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-918b1c10-7d9a-4f9d-8c97-53b0de411792 req-de0429b9-3b7e-4046-bc4a-d07ec55d2443 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:51:52.318174 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-918b1c10-7d9a-4f9d-8c97-53b0de411792 req-de0429b9-3b7e-4046-bc4a-d07ec55d2443 service nova] Creating event network-changed:d31a26b7-ffb6-4f1c-81b0-8baf22104732 for instance c39c1157-f207-4ef9-a7c5-6bc88b4986dd on n-h2-833090-16 Aug 31 16:51:52.323370 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-918b1c10-7d9a-4f9d-8c97-53b0de411792 req-de0429b9-3b7e-4046-bc4a-d07ec55d2443 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038985 Aug 31 16:51:52.324005 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3653/7126] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:53:04.337216 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:53:04.338473 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:53:04.342700 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=11 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:53:04.344124 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=48 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:53:04.420567 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8a2678fd-0379-46e9-b050-df6f0bf3579b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:53:04.422945 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8a2678fd-0379-46e9-b050-df6f0bf3579b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: c39c1157-f207-4ef9-a7c5-6bc88b4986dd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:04.429406 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a2678fd-0379-46e9-b050-df6f0bf3579b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:04.429887 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a2678fd-0379-46e9-b050-df6f0bf3579b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:04.430340 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a2678fd-0379-46e9-b050-df6f0bf3579b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:04.431026 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a2678fd-0379-46e9-b050-df6f0bf3579b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:04.431469 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a2678fd-0379-46e9-b050-df6f0bf3579b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:04.431890 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a2678fd-0379-46e9-b050-df6f0bf3579b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:04.471381 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8a2678fd-0379-46e9-b050-df6f0bf3579b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:04.477959 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8a2678fd-0379-46e9-b050-df6f0bf3579b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: c39c1157-f207-4ef9-a7c5-6bc88b4986dd] Old instance type m1.heat2, new instance type m1.heat {{(pid=128863) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 31 16:53:04.484929 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-8a2678fd-0379-46e9-b050-df6f0bf3579b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:53:04.485342 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-8a2678fd-0379-46e9-b050-df6f0bf3579b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:53:04.485809 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-8a2678fd-0379-46e9-b050-df6f0bf3579b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:53:04.486251 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-8a2678fd-0379-46e9-b050-df6f0bf3579b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:53:04.486659 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-8a2678fd-0379-46e9-b050-df6f0bf3579b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:53:04.559592 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8a2678fd-0379-46e9-b050-df6f0bf3579b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "POST /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd/action" status: 202 len: 0 microversion: 2.1 time: 0.224619 Aug 31 16:53:04.560710 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3474/7127] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:53:04 2022] POST /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:53:04.571233 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=11 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:53:04.572082 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:53:04.580115 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8bab9e12-5914-4ca4-9675-0fe68e72278b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:04.580881 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8bab9e12-5914-4ca4-9675-0fe68e72278b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: c39c1157-f207-4ef9-a7c5-6bc88b4986dd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:04.591748 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8bab9e12-5914-4ca4-9675-0fe68e72278b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:04.592300 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8bab9e12-5914-4ca4-9675-0fe68e72278b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:04.592754 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8bab9e12-5914-4ca4-9675-0fe68e72278b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:04.593679 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8bab9e12-5914-4ca4-9675-0fe68e72278b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:04.594152 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8bab9e12-5914-4ca4-9675-0fe68e72278b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:04.594760 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8bab9e12-5914-4ca4-9675-0fe68e72278b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:04.800310 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8bab9e12-5914-4ca4-9675-0fe68e72278b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:04.808575 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8bab9e12-5914-4ca4-9675-0fe68e72278b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd" status: 200 len: 1678 microversion: 2.1 time: 0.241171 Aug 31 16:53:04.809238 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3654/7128] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:04 2022] GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd => generated 1678 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:53:05.832387 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f408d9b3-ed0f-48aa-8eef-55473551ba5b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:05.832992 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f408d9b3-ed0f-48aa-8eef-55473551ba5b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: c39c1157-f207-4ef9-a7c5-6bc88b4986dd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:05.839646 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f408d9b3-ed0f-48aa-8eef-55473551ba5b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:05.840132 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f408d9b3-ed0f-48aa-8eef-55473551ba5b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:05.840567 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f408d9b3-ed0f-48aa-8eef-55473551ba5b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:05.841264 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f408d9b3-ed0f-48aa-8eef-55473551ba5b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:05.841707 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f408d9b3-ed0f-48aa-8eef-55473551ba5b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:05.842146 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f408d9b3-ed0f-48aa-8eef-55473551ba5b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:06.033552 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f408d9b3-ed0f-48aa-8eef-55473551ba5b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:06.042053 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f408d9b3-ed0f-48aa-8eef-55473551ba5b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd" status: 200 len: 1678 microversion: 2.1 time: 0.214945 Aug 31 16:53:06.042664 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3475/7129] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:05 2022] GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd => generated 1678 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:53:07.065039 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a8d912b9-11e6-43b5-891a-1d700458a675 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:07.065619 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a8d912b9-11e6-43b5-891a-1d700458a675 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: c39c1157-f207-4ef9-a7c5-6bc88b4986dd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:07.073477 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a8d912b9-11e6-43b5-891a-1d700458a675 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:07.073992 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a8d912b9-11e6-43b5-891a-1d700458a675 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:07.074478 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a8d912b9-11e6-43b5-891a-1d700458a675 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:07.075208 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a8d912b9-11e6-43b5-891a-1d700458a675 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:07.075683 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a8d912b9-11e6-43b5-891a-1d700458a675 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:07.076121 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a8d912b9-11e6-43b5-891a-1d700458a675 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:07.237584 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a8d912b9-11e6-43b5-891a-1d700458a675 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:07.246427 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a8d912b9-11e6-43b5-891a-1d700458a675 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd" status: 200 len: 1683 microversion: 2.1 time: 0.186224 Aug 31 16:53:07.247133 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3655/7130] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:07 2022] GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd => generated 1683 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:53:08.272683 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a1054988-2359-4569-a1be-2c4476ef511a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:08.273661 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a1054988-2359-4569-a1be-2c4476ef511a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: c39c1157-f207-4ef9-a7c5-6bc88b4986dd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:08.283565 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1054988-2359-4569-a1be-2c4476ef511a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:08.284083 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1054988-2359-4569-a1be-2c4476ef511a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:08.284521 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1054988-2359-4569-a1be-2c4476ef511a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:08.285217 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1054988-2359-4569-a1be-2c4476ef511a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:08.285673 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1054988-2359-4569-a1be-2c4476ef511a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:08.286118 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1054988-2359-4569-a1be-2c4476ef511a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:08.441197 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a1054988-2359-4569-a1be-2c4476ef511a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:08.449992 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a1054988-2359-4569-a1be-2c4476ef511a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd" status: 200 len: 1683 microversion: 2.1 time: 0.183115 Aug 31 16:53:08.450623 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3476/7131] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:08 2022] GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd => generated 1683 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:53:09.471811 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f6a486e8-1ba7-4892-8749-29c28eff5252 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:09.472419 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f6a486e8-1ba7-4892-8749-29c28eff5252 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: c39c1157-f207-4ef9-a7c5-6bc88b4986dd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:09.479821 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f6a486e8-1ba7-4892-8749-29c28eff5252 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:09.480351 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f6a486e8-1ba7-4892-8749-29c28eff5252 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:09.480805 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f6a486e8-1ba7-4892-8749-29c28eff5252 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:09.481515 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f6a486e8-1ba7-4892-8749-29c28eff5252 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:09.481985 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f6a486e8-1ba7-4892-8749-29c28eff5252 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:09.482464 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f6a486e8-1ba7-4892-8749-29c28eff5252 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:09.639435 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f6a486e8-1ba7-4892-8749-29c28eff5252 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:09.647798 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f6a486e8-1ba7-4892-8749-29c28eff5252 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd" status: 200 len: 1683 microversion: 2.1 time: 0.180515 Aug 31 16:53:09.648370 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3656/7132] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:09 2022] GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd => generated 1683 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:53:10.669197 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-05cfb948-ae41-4467-997d-d68529fe1acf tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:10.669840 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-05cfb948-ae41-4467-997d-d68529fe1acf tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: c39c1157-f207-4ef9-a7c5-6bc88b4986dd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:10.677973 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05cfb948-ae41-4467-997d-d68529fe1acf tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:10.678496 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05cfb948-ae41-4467-997d-d68529fe1acf tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:10.678937 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05cfb948-ae41-4467-997d-d68529fe1acf tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:10.679637 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05cfb948-ae41-4467-997d-d68529fe1acf tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:10.680091 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05cfb948-ae41-4467-997d-d68529fe1acf tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:10.680519 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05cfb948-ae41-4467-997d-d68529fe1acf tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:10.835743 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-05cfb948-ae41-4467-997d-d68529fe1acf tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:10.848371 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-05cfb948-ae41-4467-997d-d68529fe1acf tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd" status: 200 len: 1683 microversion: 2.1 time: 0.182841 Aug 31 16:53:10.849233 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3477/7133] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:10 2022] GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd => generated 1683 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:53:11.876084 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1fa13baf-0aea-448c-b08c-8869e5046ea9 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:11.876741 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1fa13baf-0aea-448c-b08c-8869e5046ea9 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: c39c1157-f207-4ef9-a7c5-6bc88b4986dd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:11.884184 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1fa13baf-0aea-448c-b08c-8869e5046ea9 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:11.884686 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1fa13baf-0aea-448c-b08c-8869e5046ea9 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:11.885164 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1fa13baf-0aea-448c-b08c-8869e5046ea9 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:11.885847 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1fa13baf-0aea-448c-b08c-8869e5046ea9 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:11.886370 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1fa13baf-0aea-448c-b08c-8869e5046ea9 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:11.886814 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1fa13baf-0aea-448c-b08c-8869e5046ea9 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:12.045004 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1fa13baf-0aea-448c-b08c-8869e5046ea9 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:12.058287 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1fa13baf-0aea-448c-b08c-8869e5046ea9 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd" status: 200 len: 1683 microversion: 2.1 time: 0.186888 Aug 31 16:53:12.059170 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3657/7134] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:11 2022] GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd => generated 1683 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:53:13.082314 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f3e59dce-9117-47a8-a012-36e93a9d7947 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:13.082931 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f3e59dce-9117-47a8-a012-36e93a9d7947 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: c39c1157-f207-4ef9-a7c5-6bc88b4986dd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:13.089878 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f3e59dce-9117-47a8-a012-36e93a9d7947 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:13.090396 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f3e59dce-9117-47a8-a012-36e93a9d7947 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:13.090830 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f3e59dce-9117-47a8-a012-36e93a9d7947 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:13.091520 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f3e59dce-9117-47a8-a012-36e93a9d7947 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:13.091970 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f3e59dce-9117-47a8-a012-36e93a9d7947 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:13.092399 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f3e59dce-9117-47a8-a012-36e93a9d7947 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:13.243496 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f3e59dce-9117-47a8-a012-36e93a9d7947 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:13.252007 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f3e59dce-9117-47a8-a012-36e93a9d7947 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd" status: 200 len: 1683 microversion: 2.1 time: 0.173992 Aug 31 16:53:13.252594 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3478/7135] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:13 2022] GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd => generated 1683 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:53:14.276258 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c8950cff-e281-49c6-b579-d12ccda05899 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:14.276977 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c8950cff-e281-49c6-b579-d12ccda05899 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: c39c1157-f207-4ef9-a7c5-6bc88b4986dd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:14.285711 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8950cff-e281-49c6-b579-d12ccda05899 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:14.286255 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8950cff-e281-49c6-b579-d12ccda05899 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:14.286709 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8950cff-e281-49c6-b579-d12ccda05899 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:14.287434 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8950cff-e281-49c6-b579-d12ccda05899 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:14.287898 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8950cff-e281-49c6-b579-d12ccda05899 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:14.288340 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8950cff-e281-49c6-b579-d12ccda05899 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:14.428109 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c8950cff-e281-49c6-b579-d12ccda05899 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:14.436476 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c8950cff-e281-49c6-b579-d12ccda05899 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd" status: 200 len: 1683 microversion: 2.1 time: 0.166781 Aug 31 16:53:14.437542 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3658/7136] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:14 2022] GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:53:15.459260 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-67b5eac1-e9a7-4966-9d43-625b631e6874 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:15.459872 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-67b5eac1-e9a7-4966-9d43-625b631e6874 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: c39c1157-f207-4ef9-a7c5-6bc88b4986dd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:15.467323 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-67b5eac1-e9a7-4966-9d43-625b631e6874 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:15.467801 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-67b5eac1-e9a7-4966-9d43-625b631e6874 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:15.468250 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-67b5eac1-e9a7-4966-9d43-625b631e6874 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:15.468944 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-67b5eac1-e9a7-4966-9d43-625b631e6874 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:15.469388 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-67b5eac1-e9a7-4966-9d43-625b631e6874 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:15.469808 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-67b5eac1-e9a7-4966-9d43-625b631e6874 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:15.625378 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-67b5eac1-e9a7-4966-9d43-625b631e6874 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:15.634846 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-67b5eac1-e9a7-4966-9d43-625b631e6874 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd" status: 200 len: 1683 microversion: 2.1 time: 0.179702 Aug 31 16:53:15.635436 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3479/7137] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:15 2022] GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd => generated 1683 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:53:16.656512 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-38554ac4-0409-45e2-86f6-2df4f5d65950 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:16.657130 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-38554ac4-0409-45e2-86f6-2df4f5d65950 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: c39c1157-f207-4ef9-a7c5-6bc88b4986dd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:16.664641 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-38554ac4-0409-45e2-86f6-2df4f5d65950 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:16.665142 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-38554ac4-0409-45e2-86f6-2df4f5d65950 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:16.665588 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-38554ac4-0409-45e2-86f6-2df4f5d65950 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:16.666324 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-38554ac4-0409-45e2-86f6-2df4f5d65950 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:16.666784 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-38554ac4-0409-45e2-86f6-2df4f5d65950 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:16.667214 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-38554ac4-0409-45e2-86f6-2df4f5d65950 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:16.805584 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-38554ac4-0409-45e2-86f6-2df4f5d65950 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:16.813634 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-38554ac4-0409-45e2-86f6-2df4f5d65950 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd" status: 200 len: 1683 microversion: 2.1 time: 0.161239 Aug 31 16:53:16.814345 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3659/7138] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:16 2022] GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:53:17.839631 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-30ab05e7-8e91-4827-999a-79839f18e561 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:17.840570 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-30ab05e7-8e91-4827-999a-79839f18e561 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: c39c1157-f207-4ef9-a7c5-6bc88b4986dd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:17.850325 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-30ab05e7-8e91-4827-999a-79839f18e561 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:17.850812 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-30ab05e7-8e91-4827-999a-79839f18e561 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:17.851256 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-30ab05e7-8e91-4827-999a-79839f18e561 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:17.851953 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-30ab05e7-8e91-4827-999a-79839f18e561 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:17.852406 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-30ab05e7-8e91-4827-999a-79839f18e561 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:17.852822 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-30ab05e7-8e91-4827-999a-79839f18e561 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:17.991718 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-30ab05e7-8e91-4827-999a-79839f18e561 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:17.999839 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-30ab05e7-8e91-4827-999a-79839f18e561 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd" status: 200 len: 1683 microversion: 2.1 time: 0.165966 Aug 31 16:53:18.000429 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3480/7139] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:17 2022] GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:53:19.022934 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6d64489b-5e38-436d-b11a-65c406edd27b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:19.023699 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6d64489b-5e38-436d-b11a-65c406edd27b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: c39c1157-f207-4ef9-a7c5-6bc88b4986dd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:19.031133 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d64489b-5e38-436d-b11a-65c406edd27b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:19.031951 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d64489b-5e38-436d-b11a-65c406edd27b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:19.032552 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d64489b-5e38-436d-b11a-65c406edd27b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:19.033430 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d64489b-5e38-436d-b11a-65c406edd27b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:19.033551 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-1ca90771-2859-48ee-ad3d-0461f509edfd req-c33448ff-63cc-4360-8944-f7788bae3d76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c39c1157-f207-4ef9-a7c5-6bc88b4986dd", "name": "network-vif-unplugged", "status": "completed", "tag": "d31a26b7-ffb6-4f1c-81b0-8baf22104732"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:53:19.034576 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d64489b-5e38-436d-b11a-65c406edd27b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:19.035164 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d64489b-5e38-436d-b11a-65c406edd27b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:19.044463 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-1ca90771-2859-48ee-ad3d-0461f509edfd req-c33448ff-63cc-4360-8944-f7788bae3d76 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:19.044993 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-1ca90771-2859-48ee-ad3d-0461f509edfd req-c33448ff-63cc-4360-8944-f7788bae3d76 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:19.045998 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-1ca90771-2859-48ee-ad3d-0461f509edfd req-c33448ff-63cc-4360-8944-f7788bae3d76 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:19.063091 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-1ca90771-2859-48ee-ad3d-0461f509edfd req-c33448ff-63cc-4360-8944-f7788bae3d76 service nova] Creating event network-vif-unplugged:d31a26b7-ffb6-4f1c-81b0-8baf22104732 for instance c39c1157-f207-4ef9-a7c5-6bc88b4986dd on n-h1-833090-16 Aug 31 16:53:19.069329 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [req-1ca90771-2859-48ee-ad3d-0461f509edfd req-c33448ff-63cc-4360-8944-f7788bae3d76 service nova] Instance c39c1157-f207-4ef9-a7c5-6bc88b4986dd is migrating within the same cell, copying events to all relevant hosts: {'n-h2-833090-16', 'n-h1-833090-16'} {{(pid=128864) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 16:53:19.081983 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-1ca90771-2859-48ee-ad3d-0461f509edfd req-c33448ff-63cc-4360-8944-f7788bae3d76 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113145 Aug 31 16:53:19.082730 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3660/7140] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:53:19.182941 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6d64489b-5e38-436d-b11a-65c406edd27b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:19.194154 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6d64489b-5e38-436d-b11a-65c406edd27b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd" status: 200 len: 1682 microversion: 2.1 time: 0.176401 Aug 31 16:53:19.194759 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3481/7141] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:19 2022] GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd => generated 1682 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:53:20.217675 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ab97ad9b-16a9-4c07-835a-bd4c4e0214e0 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:20.218421 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ab97ad9b-16a9-4c07-835a-bd4c4e0214e0 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: c39c1157-f207-4ef9-a7c5-6bc88b4986dd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:20.226261 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ab97ad9b-16a9-4c07-835a-bd4c4e0214e0 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:20.226771 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ab97ad9b-16a9-4c07-835a-bd4c4e0214e0 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:20.227222 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ab97ad9b-16a9-4c07-835a-bd4c4e0214e0 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:20.227943 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ab97ad9b-16a9-4c07-835a-bd4c4e0214e0 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:20.228415 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ab97ad9b-16a9-4c07-835a-bd4c4e0214e0 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:20.228885 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ab97ad9b-16a9-4c07-835a-bd4c4e0214e0 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:20.370482 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ab97ad9b-16a9-4c07-835a-bd4c4e0214e0 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:20.381883 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ab97ad9b-16a9-4c07-835a-bd4c4e0214e0 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd" status: 200 len: 1682 microversion: 2.1 time: 0.168601 Aug 31 16:53:20.382500 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3661/7142] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:20 2022] GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:53:21.103470 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-f369c441-0590-456a-a854-e5b8fc5938d7 req-4d576720-858a-4775-ada2-f03d5e7d8d2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c39c1157-f207-4ef9-a7c5-6bc88b4986dd", "tag": "d31a26b7-ffb6-4f1c-81b0-8baf22104732"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:53:21.114216 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f369c441-0590-456a-a854-e5b8fc5938d7 req-4d576720-858a-4775-ada2-f03d5e7d8d2e service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:21.114697 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f369c441-0590-456a-a854-e5b8fc5938d7 req-4d576720-858a-4775-ada2-f03d5e7d8d2e service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:21.115136 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f369c441-0590-456a-a854-e5b8fc5938d7 req-4d576720-858a-4775-ada2-f03d5e7d8d2e service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:21.127380 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-f369c441-0590-456a-a854-e5b8fc5938d7 req-4d576720-858a-4775-ada2-f03d5e7d8d2e service nova] Creating event network-changed:d31a26b7-ffb6-4f1c-81b0-8baf22104732 for instance c39c1157-f207-4ef9-a7c5-6bc88b4986dd on n-h1-833090-16 Aug 31 16:53:21.133791 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [req-f369c441-0590-456a-a854-e5b8fc5938d7 req-4d576720-858a-4775-ada2-f03d5e7d8d2e service nova] Instance c39c1157-f207-4ef9-a7c5-6bc88b4986dd is migrating within the same cell, copying events to all relevant hosts: {'n-h2-833090-16', 'n-h1-833090-16'} {{(pid=128863) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 16:53:21.147526 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-f369c441-0590-456a-a854-e5b8fc5938d7 req-4d576720-858a-4775-ada2-f03d5e7d8d2e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047786 Aug 31 16:53:21.148127 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3482/7143] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:53:21.404336 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-36bda9f9-3988-44fd-9280-ac7f01db50b5 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:21.404997 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-36bda9f9-3988-44fd-9280-ac7f01db50b5 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: c39c1157-f207-4ef9-a7c5-6bc88b4986dd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:21.413291 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-36bda9f9-3988-44fd-9280-ac7f01db50b5 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:21.413801 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-36bda9f9-3988-44fd-9280-ac7f01db50b5 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:21.414285 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-36bda9f9-3988-44fd-9280-ac7f01db50b5 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:21.415008 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-36bda9f9-3988-44fd-9280-ac7f01db50b5 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:21.415460 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-36bda9f9-3988-44fd-9280-ac7f01db50b5 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:21.416143 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-36bda9f9-3988-44fd-9280-ac7f01db50b5 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:21.563816 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-36bda9f9-3988-44fd-9280-ac7f01db50b5 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:21.572713 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-36bda9f9-3988-44fd-9280-ac7f01db50b5 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd" status: 200 len: 1680 microversion: 2.1 time: 0.172740 Aug 31 16:53:21.573329 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3662/7144] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:21 2022] GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:53:22.602831 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5f35ac36-9175-45ff-a015-61c61f3f0fce tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:22.603534 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5f35ac36-9175-45ff-a015-61c61f3f0fce tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: c39c1157-f207-4ef9-a7c5-6bc88b4986dd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:22.610057 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f35ac36-9175-45ff-a015-61c61f3f0fce tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:22.610691 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f35ac36-9175-45ff-a015-61c61f3f0fce tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:22.611096 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f35ac36-9175-45ff-a015-61c61f3f0fce tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:22.611760 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f35ac36-9175-45ff-a015-61c61f3f0fce tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:22.612215 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f35ac36-9175-45ff-a015-61c61f3f0fce tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:22.612737 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f35ac36-9175-45ff-a015-61c61f3f0fce tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:22.765447 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5f35ac36-9175-45ff-a015-61c61f3f0fce tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:22.774923 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5f35ac36-9175-45ff-a015-61c61f3f0fce tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd" status: 200 len: 1677 microversion: 2.1 time: 0.177499 Aug 31 16:53:22.775525 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3483/7145] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:22 2022] GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd => generated 1677 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:53:22.804774 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c1c1fb10-1d4c-40cf-b98e-7b5a9fd58570 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:53:22.805351 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c1c1fb10-1d4c-40cf-b98e-7b5a9fd58570 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: c39c1157-f207-4ef9-a7c5-6bc88b4986dd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:22.812904 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c1c1fb10-1d4c-40cf-b98e-7b5a9fd58570 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:22.813415 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c1c1fb10-1d4c-40cf-b98e-7b5a9fd58570 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:22.813869 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c1c1fb10-1d4c-40cf-b98e-7b5a9fd58570 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:22.814614 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c1c1fb10-1d4c-40cf-b98e-7b5a9fd58570 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:22.815078 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c1c1fb10-1d4c-40cf-b98e-7b5a9fd58570 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:22.815514 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c1c1fb10-1d4c-40cf-b98e-7b5a9fd58570 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:22.854068 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c1c1fb10-1d4c-40cf-b98e-7b5a9fd58570 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:22.854651 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c1c1fb10-1d4c-40cf-b98e-7b5a9fd58570 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:22.855102 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c1c1fb10-1d4c-40cf-b98e-7b5a9fd58570 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:22.855840 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c1c1fb10-1d4c-40cf-b98e-7b5a9fd58570 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:22.856308 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c1c1fb10-1d4c-40cf-b98e-7b5a9fd58570 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:22.856739 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c1c1fb10-1d4c-40cf-b98e-7b5a9fd58570 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:22.881623 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-c1c1fb10-1d4c-40cf-b98e-7b5a9fd58570 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Getting quotas for project fce77c4128d3448885217ac4d4744765. Resources: {'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:53:22.887559 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-c1c1fb10-1d4c-40cf-b98e-7b5a9fd58570 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Getting quotas for user 689ff4da0acb4aafa5f44d42e68ab41d and project fce77c4128d3448885217ac4d4744765. Resources: {'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:53:23.001745 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c1c1fb10-1d4c-40cf-b98e-7b5a9fd58570 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "POST /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd/action" status: 202 len: 0 microversion: 2.1 time: 0.201444 Aug 31 16:53:23.002514 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3663/7146] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:53:22 2022] POST /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:53:23.011006 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e1048242-0a37-4a8d-a4a2-9df14b9c3b2f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:23.011741 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e1048242-0a37-4a8d-a4a2-9df14b9c3b2f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: c39c1157-f207-4ef9-a7c5-6bc88b4986dd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:23.018386 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e1048242-0a37-4a8d-a4a2-9df14b9c3b2f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:23.019986 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e1048242-0a37-4a8d-a4a2-9df14b9c3b2f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:23.020447 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e1048242-0a37-4a8d-a4a2-9df14b9c3b2f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:23.021483 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e1048242-0a37-4a8d-a4a2-9df14b9c3b2f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:23.021989 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e1048242-0a37-4a8d-a4a2-9df14b9c3b2f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:23.022570 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e1048242-0a37-4a8d-a4a2-9df14b9c3b2f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:23.169282 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e1048242-0a37-4a8d-a4a2-9df14b9c3b2f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:23.178649 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e1048242-0a37-4a8d-a4a2-9df14b9c3b2f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd" status: 200 len: 1676 microversion: 2.1 time: 0.171615 Aug 31 16:53:23.179242 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3484/7147] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:23 2022] GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd => generated 1676 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:53:24.200807 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-feac53f8-ed6d-4ada-a2a3-72629a00f4df tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:24.201743 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-feac53f8-ed6d-4ada-a2a3-72629a00f4df tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: c39c1157-f207-4ef9-a7c5-6bc88b4986dd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:24.210577 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-feac53f8-ed6d-4ada-a2a3-72629a00f4df tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:24.211080 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-feac53f8-ed6d-4ada-a2a3-72629a00f4df tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:24.211523 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-feac53f8-ed6d-4ada-a2a3-72629a00f4df tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:24.212326 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-feac53f8-ed6d-4ada-a2a3-72629a00f4df tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:24.212792 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-feac53f8-ed6d-4ada-a2a3-72629a00f4df tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:24.213224 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-feac53f8-ed6d-4ada-a2a3-72629a00f4df tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:24.287962 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-22d82ea2-6512-4e72-ab91-3aeb9896e538 req-c75de8b0-f91c-4b4f-99e8-71075d1eee69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c39c1157-f207-4ef9-a7c5-6bc88b4986dd", "name": "network-vif-plugged", "status": "completed", "tag": "d31a26b7-ffb6-4f1c-81b0-8baf22104732"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:53:24.299134 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-22d82ea2-6512-4e72-ab91-3aeb9896e538 req-c75de8b0-f91c-4b4f-99e8-71075d1eee69 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:24.299615 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-22d82ea2-6512-4e72-ab91-3aeb9896e538 req-c75de8b0-f91c-4b4f-99e8-71075d1eee69 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:24.300044 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-22d82ea2-6512-4e72-ab91-3aeb9896e538 req-c75de8b0-f91c-4b4f-99e8-71075d1eee69 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:24.312633 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-22d82ea2-6512-4e72-ab91-3aeb9896e538 req-c75de8b0-f91c-4b4f-99e8-71075d1eee69 service nova] Creating event network-vif-plugged:d31a26b7-ffb6-4f1c-81b0-8baf22104732 for instance c39c1157-f207-4ef9-a7c5-6bc88b4986dd on n-h1-833090-16 Aug 31 16:53:24.318378 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [req-22d82ea2-6512-4e72-ab91-3aeb9896e538 req-c75de8b0-f91c-4b4f-99e8-71075d1eee69 service nova] Instance c39c1157-f207-4ef9-a7c5-6bc88b4986dd is migrating within the same cell, copying events to all relevant hosts: {'n-h2-833090-16', 'n-h1-833090-16'} {{(pid=128863) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 16:53:24.329384 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-22d82ea2-6512-4e72-ab91-3aeb9896e538 req-c75de8b0-f91c-4b4f-99e8-71075d1eee69 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115516 Aug 31 16:53:24.330021 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3485/7148] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:53:24.369676 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-feac53f8-ed6d-4ada-a2a3-72629a00f4df tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:24.377927 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-feac53f8-ed6d-4ada-a2a3-72629a00f4df tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd" status: 200 len: 1676 microversion: 2.1 time: 0.181677 Aug 31 16:53:24.378588 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3664/7149] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:24 2022] GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd => generated 1676 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:53:25.400946 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-19b32d4f-0d00-4fb9-823a-9083c736c233 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:25.401650 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-19b32d4f-0d00-4fb9-823a-9083c736c233 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: c39c1157-f207-4ef9-a7c5-6bc88b4986dd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:25.408552 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19b32d4f-0d00-4fb9-823a-9083c736c233 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:25.409048 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19b32d4f-0d00-4fb9-823a-9083c736c233 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:25.409490 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19b32d4f-0d00-4fb9-823a-9083c736c233 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:25.410340 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19b32d4f-0d00-4fb9-823a-9083c736c233 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:25.410846 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19b32d4f-0d00-4fb9-823a-9083c736c233 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:25.411281 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-19b32d4f-0d00-4fb9-823a-9083c736c233 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:25.557869 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-19b32d4f-0d00-4fb9-823a-9083c736c233 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:25.568616 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-19b32d4f-0d00-4fb9-823a-9083c736c233 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd" status: 200 len: 1676 microversion: 2.1 time: 0.172636 Aug 31 16:53:25.569448 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3486/7150] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:25 2022] GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd => generated 1676 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:53:26.162803 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-ccf78c99-351f-4d0c-a9ad-93aaa10a1b57 req-e5ccab2a-24ed-4c35-a5bf-9ad29e0df573 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c39c1157-f207-4ef9-a7c5-6bc88b4986dd", "name": "network-vif-unplugged", "status": "completed", "tag": "d31a26b7-ffb6-4f1c-81b0-8baf22104732"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:53:26.174642 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-ccf78c99-351f-4d0c-a9ad-93aaa10a1b57 req-e5ccab2a-24ed-4c35-a5bf-9ad29e0df573 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:26.175096 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-ccf78c99-351f-4d0c-a9ad-93aaa10a1b57 req-e5ccab2a-24ed-4c35-a5bf-9ad29e0df573 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:26.175590 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-ccf78c99-351f-4d0c-a9ad-93aaa10a1b57 req-e5ccab2a-24ed-4c35-a5bf-9ad29e0df573 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:26.189256 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-ccf78c99-351f-4d0c-a9ad-93aaa10a1b57 req-e5ccab2a-24ed-4c35-a5bf-9ad29e0df573 service nova] Creating event network-vif-unplugged:d31a26b7-ffb6-4f1c-81b0-8baf22104732 for instance c39c1157-f207-4ef9-a7c5-6bc88b4986dd on n-h2-833090-16 Aug 31 16:53:26.195197 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [req-ccf78c99-351f-4d0c-a9ad-93aaa10a1b57 req-e5ccab2a-24ed-4c35-a5bf-9ad29e0df573 service nova] Instance c39c1157-f207-4ef9-a7c5-6bc88b4986dd is migrating within the same cell, copying events to all relevant hosts: {'n-h2-833090-16', 'n-h1-833090-16'} {{(pid=128864) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 16:53:26.206471 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-ccf78c99-351f-4d0c-a9ad-93aaa10a1b57 req-e5ccab2a-24ed-4c35-a5bf-9ad29e0df573 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048168 Aug 31 16:53:26.207072 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3665/7151] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:53:26.591797 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8404ca32-28d6-481d-a99b-ea00d3f65b91 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:26.592408 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8404ca32-28d6-481d-a99b-ea00d3f65b91 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: c39c1157-f207-4ef9-a7c5-6bc88b4986dd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:26.599770 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8404ca32-28d6-481d-a99b-ea00d3f65b91 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:26.600261 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8404ca32-28d6-481d-a99b-ea00d3f65b91 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:26.600696 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8404ca32-28d6-481d-a99b-ea00d3f65b91 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:26.601636 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8404ca32-28d6-481d-a99b-ea00d3f65b91 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:26.602083 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8404ca32-28d6-481d-a99b-ea00d3f65b91 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:26.602542 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8404ca32-28d6-481d-a99b-ea00d3f65b91 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:26.756362 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8404ca32-28d6-481d-a99b-ea00d3f65b91 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:26.766385 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8404ca32-28d6-481d-a99b-ea00d3f65b91 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd" status: 200 len: 1676 microversion: 2.1 time: 0.178491 Aug 31 16:53:26.766985 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3487/7152] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:26 2022] GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd => generated 1676 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:53:27.790521 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d2d758aa-4d34-48e3-a55d-e01f801d6c7b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:27.791236 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d2d758aa-4d34-48e3-a55d-e01f801d6c7b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: c39c1157-f207-4ef9-a7c5-6bc88b4986dd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:27.798552 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d2d758aa-4d34-48e3-a55d-e01f801d6c7b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:27.799034 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d2d758aa-4d34-48e3-a55d-e01f801d6c7b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:27.799476 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d2d758aa-4d34-48e3-a55d-e01f801d6c7b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:27.800149 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d2d758aa-4d34-48e3-a55d-e01f801d6c7b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:27.800639 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d2d758aa-4d34-48e3-a55d-e01f801d6c7b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:27.801066 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d2d758aa-4d34-48e3-a55d-e01f801d6c7b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:27.959853 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d2d758aa-4d34-48e3-a55d-e01f801d6c7b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:27.968825 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d2d758aa-4d34-48e3-a55d-e01f801d6c7b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd" status: 200 len: 1676 microversion: 2.1 time: 0.184216 Aug 31 16:53:27.969410 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3666/7153] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:27 2022] GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd => generated 1676 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:53:28.224918 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-10a3cf49-b66e-43b3-b722-393f4e2159d6 req-730a263d-e36d-4986-85d2-02a58700b7bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c39c1157-f207-4ef9-a7c5-6bc88b4986dd", "tag": "d31a26b7-ffb6-4f1c-81b0-8baf22104732"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:53:28.236064 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-10a3cf49-b66e-43b3-b722-393f4e2159d6 req-730a263d-e36d-4986-85d2-02a58700b7bc service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:28.236537 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-10a3cf49-b66e-43b3-b722-393f4e2159d6 req-730a263d-e36d-4986-85d2-02a58700b7bc service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:28.236965 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-10a3cf49-b66e-43b3-b722-393f4e2159d6 req-730a263d-e36d-4986-85d2-02a58700b7bc service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:28.249040 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-10a3cf49-b66e-43b3-b722-393f4e2159d6 req-730a263d-e36d-4986-85d2-02a58700b7bc service nova] Creating event network-changed:d31a26b7-ffb6-4f1c-81b0-8baf22104732 for instance c39c1157-f207-4ef9-a7c5-6bc88b4986dd on n-h2-833090-16 Aug 31 16:53:28.254920 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [req-10a3cf49-b66e-43b3-b722-393f4e2159d6 req-730a263d-e36d-4986-85d2-02a58700b7bc service nova] Instance c39c1157-f207-4ef9-a7c5-6bc88b4986dd is migrating within the same cell, copying events to all relevant hosts: {'n-h2-833090-16', 'n-h1-833090-16'} {{(pid=128863) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 16:53:28.266113 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-10a3cf49-b66e-43b3-b722-393f4e2159d6 req-730a263d-e36d-4986-85d2-02a58700b7bc service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045546 Aug 31 16:53:28.266743 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3488/7154] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:53:28.990316 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c768fd9d-e671-4afa-b4cd-a1cef979e212 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:28.990952 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c768fd9d-e671-4afa-b4cd-a1cef979e212 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: c39c1157-f207-4ef9-a7c5-6bc88b4986dd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:28.998899 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c768fd9d-e671-4afa-b4cd-a1cef979e212 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:28.999403 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c768fd9d-e671-4afa-b4cd-a1cef979e212 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:28.999858 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c768fd9d-e671-4afa-b4cd-a1cef979e212 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:29.000577 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c768fd9d-e671-4afa-b4cd-a1cef979e212 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:29.001039 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c768fd9d-e671-4afa-b4cd-a1cef979e212 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:29.001484 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c768fd9d-e671-4afa-b4cd-a1cef979e212 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:29.153354 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c768fd9d-e671-4afa-b4cd-a1cef979e212 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:29.165049 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c768fd9d-e671-4afa-b4cd-a1cef979e212 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd" status: 200 len: 1676 microversion: 2.1 time: 0.178817 Aug 31 16:53:29.165627 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3667/7155] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:28 2022] GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd => generated 1676 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:53:30.189867 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e629caed-fc39-4467-8f30-3a52660a0c91 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:30.190902 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e629caed-fc39-4467-8f30-3a52660a0c91 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: c39c1157-f207-4ef9-a7c5-6bc88b4986dd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:30.197681 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e629caed-fc39-4467-8f30-3a52660a0c91 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:30.198229 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e629caed-fc39-4467-8f30-3a52660a0c91 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:30.198697 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e629caed-fc39-4467-8f30-3a52660a0c91 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:30.199392 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e629caed-fc39-4467-8f30-3a52660a0c91 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:30.199830 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e629caed-fc39-4467-8f30-3a52660a0c91 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:30.200254 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e629caed-fc39-4467-8f30-3a52660a0c91 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:30.345361 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e629caed-fc39-4467-8f30-3a52660a0c91 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:30.353887 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e629caed-fc39-4467-8f30-3a52660a0c91 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd" status: 200 len: 1669 microversion: 2.1 time: 0.170425 Aug 31 16:53:30.354589 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3489/7156] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:30 2022] GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd => generated 1669 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:53:30.374941 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-987fec3d-b4af-4a1e-afa7-1ba8a30c96ba tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:30.375561 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-987fec3d-b4af-4a1e-afa7-1ba8a30c96ba tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: c39c1157-f207-4ef9-a7c5-6bc88b4986dd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:30.382989 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-987fec3d-b4af-4a1e-afa7-1ba8a30c96ba tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:30.383483 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-987fec3d-b4af-4a1e-afa7-1ba8a30c96ba tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:30.384079 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-987fec3d-b4af-4a1e-afa7-1ba8a30c96ba tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:30.384827 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-987fec3d-b4af-4a1e-afa7-1ba8a30c96ba tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:30.385289 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-987fec3d-b4af-4a1e-afa7-1ba8a30c96ba tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:30.385718 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-987fec3d-b4af-4a1e-afa7-1ba8a30c96ba tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:30.390371 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:53:30.536706 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-987fec3d-b4af-4a1e-afa7-1ba8a30c96ba tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:30.544764 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-987fec3d-b4af-4a1e-afa7-1ba8a30c96ba tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd" status: 200 len: 1669 microversion: 2.1 time: 0.173786 Aug 31 16:53:30.545345 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3668/7157] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:30 2022] GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd => generated 1669 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:53:30.565347 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-467709ee-1ec4-452b-bb51-70fd3be44eca tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:30.565960 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-467709ee-1ec4-452b-bb51-70fd3be44eca tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: c39c1157-f207-4ef9-a7c5-6bc88b4986dd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:30.572826 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-467709ee-1ec4-452b-bb51-70fd3be44eca tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:30.573332 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-467709ee-1ec4-452b-bb51-70fd3be44eca tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:30.573764 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-467709ee-1ec4-452b-bb51-70fd3be44eca tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:30.574518 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-467709ee-1ec4-452b-bb51-70fd3be44eca tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:30.574969 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-467709ee-1ec4-452b-bb51-70fd3be44eca tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:30.575386 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-467709ee-1ec4-452b-bb51-70fd3be44eca tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:30.579741 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:53:30.719609 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-467709ee-1ec4-452b-bb51-70fd3be44eca tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:30.728626 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-467709ee-1ec4-452b-bb51-70fd3be44eca tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd" status: 200 len: 1669 microversion: 2.1 time: 0.167125 Aug 31 16:53:30.729221 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3490/7158] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:30 2022] GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd => generated 1669 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:53:30.755966 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2aa052d7-004d-4a91-a84a-d91c0308a5aa tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:30.756395 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2aa052d7-004d-4a91-a84a-d91c0308a5aa tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: c39c1157-f207-4ef9-a7c5-6bc88b4986dd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:30.763044 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2aa052d7-004d-4a91-a84a-d91c0308a5aa tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:30.763499 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2aa052d7-004d-4a91-a84a-d91c0308a5aa tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:30.763971 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2aa052d7-004d-4a91-a84a-d91c0308a5aa tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:30.764673 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2aa052d7-004d-4a91-a84a-d91c0308a5aa tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:30.765133 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2aa052d7-004d-4a91-a84a-d91c0308a5aa tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:30.765560 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2aa052d7-004d-4a91-a84a-d91c0308a5aa tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:30.793001 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2aa052d7-004d-4a91-a84a-d91c0308a5aa tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: c39c1157-f207-4ef9-a7c5-6bc88b4986dd] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:53:30.876691 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2aa052d7-004d-4a91-a84a-d91c0308a5aa tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "DELETE /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd" status: 204 len: 0 microversion: 2.1 time: 0.124430 Aug 31 16:53:30.877389 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3669/7159] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:53:30 2022] DELETE /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:53:30.886568 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-10c9b60b-3ada-49dc-8419-0160666c6c90 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:30.887167 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-10c9b60b-3ada-49dc-8419-0160666c6c90 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: c39c1157-f207-4ef9-a7c5-6bc88b4986dd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:30.893969 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10c9b60b-3ada-49dc-8419-0160666c6c90 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:30.894489 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10c9b60b-3ada-49dc-8419-0160666c6c90 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:30.894927 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10c9b60b-3ada-49dc-8419-0160666c6c90 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:30.895620 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10c9b60b-3ada-49dc-8419-0160666c6c90 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:30.896074 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10c9b60b-3ada-49dc-8419-0160666c6c90 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:30.896500 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10c9b60b-3ada-49dc-8419-0160666c6c90 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:31.033204 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-10c9b60b-3ada-49dc-8419-0160666c6c90 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:31.047361 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-10c9b60b-3ada-49dc-8419-0160666c6c90 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd" status: 200 len: 1675 microversion: 2.1 time: 0.164635 Aug 31 16:53:31.048285 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3491/7160] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:30 2022] GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd => generated 1675 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:53:32.072644 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2040baef-16d7-4937-802f-ee3f9db5f2ca tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:32.073243 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2040baef-16d7-4937-802f-ee3f9db5f2ca tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: c39c1157-f207-4ef9-a7c5-6bc88b4986dd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:32.080826 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2040baef-16d7-4937-802f-ee3f9db5f2ca tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:32.081327 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2040baef-16d7-4937-802f-ee3f9db5f2ca tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:32.081775 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2040baef-16d7-4937-802f-ee3f9db5f2ca tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:32.082614 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2040baef-16d7-4937-802f-ee3f9db5f2ca tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:32.083080 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2040baef-16d7-4937-802f-ee3f9db5f2ca tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:32.083513 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2040baef-16d7-4937-802f-ee3f9db5f2ca tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:32.232374 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2040baef-16d7-4937-802f-ee3f9db5f2ca tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:32.241169 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2040baef-16d7-4937-802f-ee3f9db5f2ca tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd" status: 200 len: 1675 microversion: 2.1 time: 0.173219 Aug 31 16:53:32.241762 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3670/7161] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:32 2022] GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd => generated 1675 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:53:33.271261 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-68a63e29-dcb5-47c1-8e81-e440d167dd8e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:33.271831 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-68a63e29-dcb5-47c1-8e81-e440d167dd8e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: c39c1157-f207-4ef9-a7c5-6bc88b4986dd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:33.281145 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68a63e29-dcb5-47c1-8e81-e440d167dd8e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:33.281662 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68a63e29-dcb5-47c1-8e81-e440d167dd8e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:33.282121 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68a63e29-dcb5-47c1-8e81-e440d167dd8e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:33.283062 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68a63e29-dcb5-47c1-8e81-e440d167dd8e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:33.283518 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68a63e29-dcb5-47c1-8e81-e440d167dd8e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:33.283943 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-68a63e29-dcb5-47c1-8e81-e440d167dd8e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:33.286723 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-ffcfd0a3-0b6a-4855-9dd8-6c31c8ecd8e8 req-1a0fb7f1-3822-42b1-99ed-09d26bde5627 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c39c1157-f207-4ef9-a7c5-6bc88b4986dd", "name": "network-vif-deleted", "tag": "d31a26b7-ffb6-4f1c-81b0-8baf22104732"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:53:33.293674 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=3 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:53:33.299579 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-ffcfd0a3-0b6a-4855-9dd8-6c31c8ecd8e8 req-1a0fb7f1-3822-42b1-99ed-09d26bde5627 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:33.300123 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-ffcfd0a3-0b6a-4855-9dd8-6c31c8ecd8e8 req-1a0fb7f1-3822-42b1-99ed-09d26bde5627 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:33.300507 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-ffcfd0a3-0b6a-4855-9dd8-6c31c8ecd8e8 req-1a0fb7f1-3822-42b1-99ed-09d26bde5627 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:33.313584 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-ffcfd0a3-0b6a-4855-9dd8-6c31c8ecd8e8 req-1a0fb7f1-3822-42b1-99ed-09d26bde5627 service nova] Creating event network-vif-deleted:d31a26b7-ffb6-4f1c-81b0-8baf22104732 for instance c39c1157-f207-4ef9-a7c5-6bc88b4986dd on n-h2-833090-16 Aug 31 16:53:33.318882 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-ffcfd0a3-0b6a-4855-9dd8-6c31c8ecd8e8 req-1a0fb7f1-3822-42b1-99ed-09d26bde5627 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037535 Aug 31 16:53:33.319750 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3671/7162] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:53:33.362529 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-68a63e29-dcb5-47c1-8e81-e440d167dd8e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:33.372831 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-68a63e29-dcb5-47c1-8e81-e440d167dd8e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd" status: 200 len: 1608 microversion: 2.1 time: 0.105775 Aug 31 16:53:33.373430 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3492/7163] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:33 2022] GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd => generated 1608 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:53:34.395822 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-eaa5c6b8-6b5f-46c5-b630-7bfb4d7bb0e5 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:34.396562 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-eaa5c6b8-6b5f-46c5-b630-7bfb4d7bb0e5 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: c39c1157-f207-4ef9-a7c5-6bc88b4986dd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:34.403714 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-eaa5c6b8-6b5f-46c5-b630-7bfb4d7bb0e5 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:34.404238 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-eaa5c6b8-6b5f-46c5-b630-7bfb4d7bb0e5 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:34.404683 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-eaa5c6b8-6b5f-46c5-b630-7bfb4d7bb0e5 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:34.405391 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-eaa5c6b8-6b5f-46c5-b630-7bfb4d7bb0e5 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:34.405886 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-eaa5c6b8-6b5f-46c5-b630-7bfb4d7bb0e5 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:34.406355 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-eaa5c6b8-6b5f-46c5-b630-7bfb4d7bb0e5 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:34.420742 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-eaa5c6b8-6b5f-46c5-b630-7bfb4d7bb0e5 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] HTTP exception thrown: Instance c39c1157-f207-4ef9-a7c5-6bc88b4986dd could not be found. Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-eaa5c6b8-6b5f-46c5-b630-7bfb4d7bb0e5 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Request method failure captured: Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd HTTP/1.1 Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD5C9uAz-t5mh-r3mUMMlr2wQd9RJYBAKDGT0KvPrLTihjtZPy6-09_bJTMDpSB88huaVHBLxwU79aGS9Ig9M6XEadSxV6dHNvqYvU2MaYuMgncb9fl7PDdbiMU9wj6m6OmrQoGoaSgGYVEfgnnlWHC-gb6kVlFh35PHiKS5x0RNERSU Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: fce77c4128d3448885217ac4d4744765 Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServerActionsTestJSON-1850065935 Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fce77c4128d3448885217ac4d4744765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fce77c4128d3448885217ac4d4744765"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/fce77c4128d3448885217ac4d4744765"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_fce77c4128d3448885217ac4d4744765", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServerActionsTestJSON-1850065935 Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: fce77c4128d3448885217ac4d4744765 Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServerActionsTestJSON-1850065935 Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServerActionsTestJSON-1850065935-project Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 689ff4da0acb4aafa5f44d42e68ab41d Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServerActionsTestJSON-1850065935-project Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance c39c1157-f207-4ef9-a7c5-6bc88b4986dd could not be found. Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'c39c1157-f207-4ef9-a7c5-6bc88b4986dd'} Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c39c1157-f207-4ef9-a7c5-6bc88b4986dd could not be found. Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c39c1157-f207-4ef9-a7c5-6bc88b4986dd could not be found. Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:53:34.422713 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:53:34.427078 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:53:34.427078 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:53:34.427078 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:53:34.427078 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:53:34.427078 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:53:34.427078 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c39c1157-f207-4ef9-a7c5-6bc88b4986dd could not be found. Aug 31 16:53:34.427078 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:53:34.427078 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-eaa5c6b8-6b5f-46c5-b630-7bfb4d7bb0e5 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Returning 404 to user: Instance c39c1157-f207-4ef9-a7c5-6bc88b4986dd could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:53:34.427078 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-eaa5c6b8-6b5f-46c5-b630-7bfb4d7bb0e5 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd" status: 404 len: 111 microversion: 2.1 time: 0.033833 Aug 31 16:53:34.427078 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3672/7164] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:34 2022] GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:53:34.440291 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-36cdac51-7b71-46f2-bafa-c7381bb9f211 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:34.440918 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-36cdac51-7b71-46f2-bafa-c7381bb9f211 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: c39c1157-f207-4ef9-a7c5-6bc88b4986dd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:34.443758 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=43 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:53:34.449359 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-36cdac51-7b71-46f2-bafa-c7381bb9f211 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:34.449868 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-36cdac51-7b71-46f2-bafa-c7381bb9f211 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:34.450361 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-36cdac51-7b71-46f2-bafa-c7381bb9f211 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:34.451121 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-36cdac51-7b71-46f2-bafa-c7381bb9f211 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:34.451542 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-36cdac51-7b71-46f2-bafa-c7381bb9f211 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:34.451970 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-36cdac51-7b71-46f2-bafa-c7381bb9f211 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:34.467098 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-36cdac51-7b71-46f2-bafa-c7381bb9f211 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] HTTP exception thrown: Instance c39c1157-f207-4ef9-a7c5-6bc88b4986dd could not be found. Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-36cdac51-7b71-46f2-bafa-c7381bb9f211 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Request method failure captured: Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd HTTP/1.1 Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD5C9uAz-t5mh-r3mUMMlr2wQd9RJYBAKDGT0KvPrLTihjtZPy6-09_bJTMDpSB88huaVHBLxwU79aGS9Ig9M6XEadSxV6dHNvqYvU2MaYuMgncb9fl7PDdbiMU9wj6m6OmrQoGoaSgGYVEfgnnlWHC-gb6kVlFh35PHiKS5x0RNERSU Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: fce77c4128d3448885217ac4d4744765 Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerActionsTestJSON-1850065935 Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fce77c4128d3448885217ac4d4744765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fce77c4128d3448885217ac4d4744765"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/fce77c4128d3448885217ac4d4744765"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_fce77c4128d3448885217ac4d4744765", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServerActionsTestJSON-1850065935 Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: fce77c4128d3448885217ac4d4744765 Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerActionsTestJSON-1850065935 Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServerActionsTestJSON-1850065935-project Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 689ff4da0acb4aafa5f44d42e68ab41d Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServerActionsTestJSON-1850065935-project Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance c39c1157-f207-4ef9-a7c5-6bc88b4986dd could not be found. Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'c39c1157-f207-4ef9-a7c5-6bc88b4986dd'} Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c39c1157-f207-4ef9-a7c5-6bc88b4986dd could not be found. Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c39c1157-f207-4ef9-a7c5-6bc88b4986dd could not be found. Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:53:34.468898 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:53:34.473095 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:53:34.473095 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:53:34.473095 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:53:34.473095 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:53:34.473095 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:53:34.473095 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c39c1157-f207-4ef9-a7c5-6bc88b4986dd could not be found. Aug 31 16:53:34.473095 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:53:34.473095 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-36cdac51-7b71-46f2-bafa-c7381bb9f211 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Returning 404 to user: Instance c39c1157-f207-4ef9-a7c5-6bc88b4986dd could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:53:34.473095 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-36cdac51-7b71-46f2-bafa-c7381bb9f211 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd" status: 404 len: 111 microversion: 2.1 time: 0.034188 Aug 31 16:53:34.473095 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3493/7165] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:34 2022] GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:53:34.525866 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d2ff0e32-8393-4794-8de2-6919dbd8e3fd tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1043154459", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "b8a9ec6f-b6c3-4e24-8c90-3b9785a6ff39"}], "security_groups": [{"name": "tempest-securitygroup--137403414"}], "key_name": "tempest-keypair-249207011", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:53:34.651317 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-d2ff0e32-8393-4794-8de2-6919dbd8e3fd tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] validate_networks() for [('b8a9ec6f-b6c3-4e24-8c90-3b9785a6ff39', None, None, None, None, None)] {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:53:34.850701 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:53:35.142690 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-d2ff0e32-8393-4794-8de2-6919dbd8e3fd tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:53:35.143120 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-d2ff0e32-8393-4794-8de2-6919dbd8e3fd tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:53:35.143606 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-d2ff0e32-8393-4794-8de2-6919dbd8e3fd tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:53:35.144012 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-d2ff0e32-8393-4794-8de2-6919dbd8e3fd tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:53:35.144430 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-d2ff0e32-8393-4794-8de2-6919dbd8e3fd tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:53:35.154467 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d2ff0e32-8393-4794-8de2-6919dbd8e3fd tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:35.154959 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d2ff0e32-8393-4794-8de2-6919dbd8e3fd tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:35.155398 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d2ff0e32-8393-4794-8de2-6919dbd8e3fd tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:35.156123 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d2ff0e32-8393-4794-8de2-6919dbd8e3fd tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:35.156594 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d2ff0e32-8393-4794-8de2-6919dbd8e3fd tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:35.157017 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d2ff0e32-8393-4794-8de2-6919dbd8e3fd tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:35.175189 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-d2ff0e32-8393-4794-8de2-6919dbd8e3fd tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Getting quotas for project fce77c4128d3448885217ac4d4744765. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:53:35.181004 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-d2ff0e32-8393-4794-8de2-6919dbd8e3fd tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Getting quotas for user 689ff4da0acb4aafa5f44d42e68ab41d and project fce77c4128d3448885217ac4d4744765. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:53:35.194286 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d2ff0e32-8393-4794-8de2-6919dbd8e3fd tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:53:35.196666 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d2ff0e32-8393-4794-8de2-6919dbd8e3fd tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:53:35.248604 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d2ff0e32-8393-4794-8de2-6919dbd8e3fd tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.729417 Aug 31 16:53:35.249376 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3673/7166] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:53:34 2022] POST /compute/v2.1/servers => generated 405 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:53:35.260656 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a0ab4c25-c3e5-4a3e-8bcc-7b7b86133fc7 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:35.261277 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a0ab4c25-c3e5-4a3e-8bcc-7b7b86133fc7 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:35.315223 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a0ab4c25-c3e5-4a3e-8bcc-7b7b86133fc7 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:35.322567 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a0ab4c25-c3e5-4a3e-8bcc-7b7b86133fc7 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1238 microversion: 2.1 time: 0.065936 Aug 31 16:53:35.323152 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3494/7167] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:35 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1238 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:53:36.347117 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b4de8789-3723-4032-adf1-d0193fe54e76 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:36.347699 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b4de8789-3723-4032-adf1-d0193fe54e76 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:36.359285 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b4de8789-3723-4032-adf1-d0193fe54e76 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:36.360126 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b4de8789-3723-4032-adf1-d0193fe54e76 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:36.360766 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b4de8789-3723-4032-adf1-d0193fe54e76 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:36.361777 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b4de8789-3723-4032-adf1-d0193fe54e76 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:36.362530 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b4de8789-3723-4032-adf1-d0193fe54e76 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:36.363056 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b4de8789-3723-4032-adf1-d0193fe54e76 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:36.432750 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b4de8789-3723-4032-adf1-d0193fe54e76 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:36.441323 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b4de8789-3723-4032-adf1-d0193fe54e76 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1290 microversion: 2.1 time: 0.100763 Aug 31 16:53:36.442138 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3674/7168] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:36 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1290 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:53:37.464482 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-50a8a606-cdcd-4c8c-85f9-eed87b795205 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:37.465140 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-50a8a606-cdcd-4c8c-85f9-eed87b795205 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:37.473447 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50a8a606-cdcd-4c8c-85f9-eed87b795205 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:37.473860 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50a8a606-cdcd-4c8c-85f9-eed87b795205 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:37.474531 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50a8a606-cdcd-4c8c-85f9-eed87b795205 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:37.475223 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50a8a606-cdcd-4c8c-85f9-eed87b795205 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:37.475688 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50a8a606-cdcd-4c8c-85f9-eed87b795205 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:37.476105 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50a8a606-cdcd-4c8c-85f9-eed87b795205 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:37.621599 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-50a8a606-cdcd-4c8c-85f9-eed87b795205 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:37.631083 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-50a8a606-cdcd-4c8c-85f9-eed87b795205 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1363 microversion: 2.1 time: 0.170774 Aug 31 16:53:37.631684 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3495/7169] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:37 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:53:37.919510 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-34055adb-5174-4cc1-9279-7234aff42262 req-fe4b52b7-aa85-4d10-b5ec-99cab2fd874c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d7ff3bf-dc43-421d-93af-9b10866f869c", "tag": "0b969e4e-9a6d-426d-a9fe-bdbee00916af"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:53:37.933444 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-34055adb-5174-4cc1-9279-7234aff42262 req-fe4b52b7-aa85-4d10-b5ec-99cab2fd874c service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:37.934064 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-34055adb-5174-4cc1-9279-7234aff42262 req-fe4b52b7-aa85-4d10-b5ec-99cab2fd874c service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:37.934444 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-34055adb-5174-4cc1-9279-7234aff42262 req-fe4b52b7-aa85-4d10-b5ec-99cab2fd874c service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:37.946165 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-34055adb-5174-4cc1-9279-7234aff42262 req-fe4b52b7-aa85-4d10-b5ec-99cab2fd874c service nova] Creating event network-changed:0b969e4e-9a6d-426d-a9fe-bdbee00916af for instance 6d7ff3bf-dc43-421d-93af-9b10866f869c on n-h2-833090-16 Aug 31 16:53:37.951478 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-34055adb-5174-4cc1-9279-7234aff42262 req-fe4b52b7-aa85-4d10-b5ec-99cab2fd874c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036040 Aug 31 16:53:37.952323 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3675/7170] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:53:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:53:38.652661 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-af6942d7-524a-4429-9954-d9948625e4d0 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:38.653251 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-af6942d7-524a-4429-9954-d9948625e4d0 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:38.660652 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af6942d7-524a-4429-9954-d9948625e4d0 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:38.661135 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af6942d7-524a-4429-9954-d9948625e4d0 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:38.661602 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af6942d7-524a-4429-9954-d9948625e4d0 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:38.662341 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af6942d7-524a-4429-9954-d9948625e4d0 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:38.662794 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af6942d7-524a-4429-9954-d9948625e4d0 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:38.663221 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-af6942d7-524a-4429-9954-d9948625e4d0 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:38.808270 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-af6942d7-524a-4429-9954-d9948625e4d0 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:38.819614 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-af6942d7-524a-4429-9954-d9948625e4d0 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1363 microversion: 2.1 time: 0.170798 Aug 31 16:53:38.820194 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3496/7171] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:38 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:53:39.845616 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a543e639-cede-458d-ab5b-c99e24302347 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:39.846423 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a543e639-cede-458d-ab5b-c99e24302347 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:39.854133 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a543e639-cede-458d-ab5b-c99e24302347 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:39.854753 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a543e639-cede-458d-ab5b-c99e24302347 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:39.855275 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a543e639-cede-458d-ab5b-c99e24302347 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:39.856063 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a543e639-cede-458d-ab5b-c99e24302347 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:39.856588 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a543e639-cede-458d-ab5b-c99e24302347 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:39.857271 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a543e639-cede-458d-ab5b-c99e24302347 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:40.003777 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a543e639-cede-458d-ab5b-c99e24302347 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:40.012321 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a543e639-cede-458d-ab5b-c99e24302347 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1363 microversion: 2.1 time: 0.172717 Aug 31 16:53:40.012893 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3676/7172] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:39 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:53:41.037154 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ed24768d-8d59-4002-a2ba-75989ff83f3a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:41.038044 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ed24768d-8d59-4002-a2ba-75989ff83f3a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:41.047704 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed24768d-8d59-4002-a2ba-75989ff83f3a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:41.048194 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed24768d-8d59-4002-a2ba-75989ff83f3a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:41.048631 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed24768d-8d59-4002-a2ba-75989ff83f3a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:41.049335 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed24768d-8d59-4002-a2ba-75989ff83f3a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:41.049793 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed24768d-8d59-4002-a2ba-75989ff83f3a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:41.050256 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed24768d-8d59-4002-a2ba-75989ff83f3a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:41.201517 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ed24768d-8d59-4002-a2ba-75989ff83f3a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:41.209310 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ed24768d-8d59-4002-a2ba-75989ff83f3a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1363 microversion: 2.1 time: 0.178998 Aug 31 16:53:41.209886 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3497/7173] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:41 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:53:42.233767 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-58af0219-e31d-4a0b-80f2-bca6f7e52d81 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:42.234582 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-58af0219-e31d-4a0b-80f2-bca6f7e52d81 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:42.244565 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-58af0219-e31d-4a0b-80f2-bca6f7e52d81 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:42.245231 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-58af0219-e31d-4a0b-80f2-bca6f7e52d81 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:42.245994 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-58af0219-e31d-4a0b-80f2-bca6f7e52d81 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:42.246815 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-58af0219-e31d-4a0b-80f2-bca6f7e52d81 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:42.247273 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-58af0219-e31d-4a0b-80f2-bca6f7e52d81 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:42.247701 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-58af0219-e31d-4a0b-80f2-bca6f7e52d81 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:42.405461 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-58af0219-e31d-4a0b-80f2-bca6f7e52d81 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:42.417915 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-58af0219-e31d-4a0b-80f2-bca6f7e52d81 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1363 microversion: 2.1 time: 0.189391 Aug 31 16:53:42.418542 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3677/7174] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:42 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1363 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:53:43.445409 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0dc33b26-bfd1-41eb-9efe-caf88aad55c8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:43.446407 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0dc33b26-bfd1-41eb-9efe-caf88aad55c8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:43.454856 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0dc33b26-bfd1-41eb-9efe-caf88aad55c8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:43.455348 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0dc33b26-bfd1-41eb-9efe-caf88aad55c8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:43.455780 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0dc33b26-bfd1-41eb-9efe-caf88aad55c8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:43.456470 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0dc33b26-bfd1-41eb-9efe-caf88aad55c8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:43.456916 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0dc33b26-bfd1-41eb-9efe-caf88aad55c8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:43.457350 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0dc33b26-bfd1-41eb-9efe-caf88aad55c8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:43.594991 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0dc33b26-bfd1-41eb-9efe-caf88aad55c8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:43.605046 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0dc33b26-bfd1-41eb-9efe-caf88aad55c8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1363 microversion: 2.1 time: 0.167139 Aug 31 16:53:43.610121 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3498/7175] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:43 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:53:44.627143 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-822fcdef-885f-4072-a394-1eff31317ad4 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:44.627594 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-822fcdef-885f-4072-a394-1eff31317ad4 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:44.635172 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-822fcdef-885f-4072-a394-1eff31317ad4 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:44.635666 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-822fcdef-885f-4072-a394-1eff31317ad4 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:44.636119 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-822fcdef-885f-4072-a394-1eff31317ad4 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:44.636966 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-822fcdef-885f-4072-a394-1eff31317ad4 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:44.637433 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-822fcdef-885f-4072-a394-1eff31317ad4 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:44.637869 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-822fcdef-885f-4072-a394-1eff31317ad4 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:44.790934 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-822fcdef-885f-4072-a394-1eff31317ad4 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:44.800949 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-822fcdef-885f-4072-a394-1eff31317ad4 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1363 microversion: 2.1 time: 0.177966 Aug 31 16:53:44.801512 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3678/7176] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:44 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:53:45.742418 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-7a309a86-46d5-4843-9179-6e9f9d0c377d req-b9b12aed-67e7-472f-a1d3-d1ac72daae5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d7ff3bf-dc43-421d-93af-9b10866f869c", "name": "network-vif-plugged", "status": "completed", "tag": "0b969e4e-9a6d-426d-a9fe-bdbee00916af"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:53:45.748959 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:53:45.754946 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7a309a86-46d5-4843-9179-6e9f9d0c377d req-b9b12aed-67e7-472f-a1d3-d1ac72daae5b service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:45.755458 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7a309a86-46d5-4843-9179-6e9f9d0c377d req-b9b12aed-67e7-472f-a1d3-d1ac72daae5b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:45.756008 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7a309a86-46d5-4843-9179-6e9f9d0c377d req-b9b12aed-67e7-472f-a1d3-d1ac72daae5b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:45.768811 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-7a309a86-46d5-4843-9179-6e9f9d0c377d req-b9b12aed-67e7-472f-a1d3-d1ac72daae5b service nova] Creating event network-vif-plugged:0b969e4e-9a6d-426d-a9fe-bdbee00916af for instance 6d7ff3bf-dc43-421d-93af-9b10866f869c on n-h2-833090-16 Aug 31 16:53:45.773918 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-7a309a86-46d5-4843-9179-6e9f9d0c377d req-b9b12aed-67e7-472f-a1d3-d1ac72daae5b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035347 Aug 31 16:53:45.774530 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3499/7177] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:53:45.822551 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9e5a405c-b6a1-4149-9079-665b85b032ae tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:45.823274 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9e5a405c-b6a1-4149-9079-665b85b032ae tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:45.825751 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:53:45.826697 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=6 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:53:45.833300 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9e5a405c-b6a1-4149-9079-665b85b032ae tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:45.833804 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9e5a405c-b6a1-4149-9079-665b85b032ae tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:45.834292 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9e5a405c-b6a1-4149-9079-665b85b032ae tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:45.835052 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9e5a405c-b6a1-4149-9079-665b85b032ae tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:45.835516 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9e5a405c-b6a1-4149-9079-665b85b032ae tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:45.835958 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9e5a405c-b6a1-4149-9079-665b85b032ae tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:45.977807 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9e5a405c-b6a1-4149-9079-665b85b032ae tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:45.985847 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9e5a405c-b6a1-4149-9079-665b85b032ae tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1363 microversion: 2.1 time: 0.167506 Aug 31 16:53:45.986474 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3679/7178] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:45 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:53:47.009306 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-697916ee-cae7-40ac-bf98-2314509419db tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:47.009960 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-697916ee-cae7-40ac-bf98-2314509419db tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:47.016985 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-697916ee-cae7-40ac-bf98-2314509419db tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:47.017706 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-697916ee-cae7-40ac-bf98-2314509419db tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:47.018122 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-697916ee-cae7-40ac-bf98-2314509419db tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:47.018798 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-697916ee-cae7-40ac-bf98-2314509419db tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:47.019442 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-697916ee-cae7-40ac-bf98-2314509419db tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:47.019848 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-697916ee-cae7-40ac-bf98-2314509419db tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:47.160329 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-697916ee-cae7-40ac-bf98-2314509419db tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:47.172133 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-697916ee-cae7-40ac-bf98-2314509419db tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1363 microversion: 2.1 time: 0.168112 Aug 31 16:53:47.173302 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3500/7179] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:47 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:53:48.200417 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-dcf5c1e7-ec9e-4db4-a23a-8714e55fcb6b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:48.201588 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-dcf5c1e7-ec9e-4db4-a23a-8714e55fcb6b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:48.213382 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dcf5c1e7-ec9e-4db4-a23a-8714e55fcb6b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:48.214214 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dcf5c1e7-ec9e-4db4-a23a-8714e55fcb6b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:48.215155 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dcf5c1e7-ec9e-4db4-a23a-8714e55fcb6b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:48.216052 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dcf5c1e7-ec9e-4db4-a23a-8714e55fcb6b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:48.216547 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dcf5c1e7-ec9e-4db4-a23a-8714e55fcb6b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:48.216986 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dcf5c1e7-ec9e-4db4-a23a-8714e55fcb6b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:48.369050 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-dcf5c1e7-ec9e-4db4-a23a-8714e55fcb6b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:53:48.377485 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-dcf5c1e7-ec9e-4db4-a23a-8714e55fcb6b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1551 microversion: 2.1 time: 0.184168 Aug 31 16:53:48.378117 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3680/7180] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:53:48 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1551 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:53:48.401368 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5ed5e875-dfb0-4c10-b5e5-9a7e3d42b10a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:53:48.402007 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5ed5e875-dfb0-4c10-b5e5-9a7e3d42b10a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:53:48.409558 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ed5e875-dfb0-4c10-b5e5-9a7e3d42b10a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:48.410159 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ed5e875-dfb0-4c10-b5e5-9a7e3d42b10a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:48.410621 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ed5e875-dfb0-4c10-b5e5-9a7e3d42b10a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:48.411402 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ed5e875-dfb0-4c10-b5e5-9a7e3d42b10a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:48.411927 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ed5e875-dfb0-4c10-b5e5-9a7e3d42b10a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:48.412384 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ed5e875-dfb0-4c10-b5e5-9a7e3d42b10a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:48.497309 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5ed5e875-dfb0-4c10-b5e5-9a7e3d42b10a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100063 Aug 31 16:53:48.497936 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3501/7181] 10.222.0.50 () {58 vars in 1275 bytes} [Wed Aug 31 16:53:48 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:53:49.905688 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-3e61fe5e-6d07-4c83-8aa6-ec0629c48a0a req-2ecdd929-f8eb-4163-b402-473a0f174d14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d7ff3bf-dc43-421d-93af-9b10866f869c", "tag": "0b969e4e-9a6d-426d-a9fe-bdbee00916af"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:53:49.917393 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-3e61fe5e-6d07-4c83-8aa6-ec0629c48a0a req-2ecdd929-f8eb-4163-b402-473a0f174d14 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:53:49.918234 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-3e61fe5e-6d07-4c83-8aa6-ec0629c48a0a req-2ecdd929-f8eb-4163-b402-473a0f174d14 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:53:49.918889 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-3e61fe5e-6d07-4c83-8aa6-ec0629c48a0a req-2ecdd929-f8eb-4163-b402-473a0f174d14 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:53:49.932412 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-3e61fe5e-6d07-4c83-8aa6-ec0629c48a0a req-2ecdd929-f8eb-4163-b402-473a0f174d14 service nova] Creating event network-changed:0b969e4e-9a6d-426d-a9fe-bdbee00916af for instance 6d7ff3bf-dc43-421d-93af-9b10866f869c on n-h2-833090-16 Aug 31 16:53:49.937769 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-3e61fe5e-6d07-4c83-8aa6-ec0629c48a0a req-2ecdd929-f8eb-4163-b402-473a0f174d14 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036987 Aug 31 16:53:49.938480 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3681/7182] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:54:54.789276 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=19 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:54:54.790380 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=54 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:54:54.791876 n-d-833090-16 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 16:54:54.792052 n-d-833090-16 devstack@n-api.service[128863]: Wed Aug 31 16:54:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c (ip 10.222.0.50) !!! Aug 31 16:54:54.803713 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0af90ea4-6ae1-4311-8838-c3415855f816 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:54:54.804418 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0af90ea4-6ae1-4311-8838-c3415855f816 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:54:54.811488 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0af90ea4-6ae1-4311-8838-c3415855f816 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:54:54.811979 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0af90ea4-6ae1-4311-8838-c3415855f816 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:54:54.812545 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0af90ea4-6ae1-4311-8838-c3415855f816 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:54:54.813241 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0af90ea4-6ae1-4311-8838-c3415855f816 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:54:54.813693 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0af90ea4-6ae1-4311-8838-c3415855f816 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:54:54.814148 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0af90ea4-6ae1-4311-8838-c3415855f816 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:54:54.962070 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0af90ea4-6ae1-4311-8838-c3415855f816 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:54:54.971431 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0af90ea4-6ae1-4311-8838-c3415855f816 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1670 microversion: 2.1 time: 0.186193 Aug 31 16:54:54.972049 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3502/7183] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:54:54 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1670 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:54:54.991275 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:54:54.992029 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:54:54.993491 n-d-833090-16 devstack@n-api.service[128864]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 16:54:54.993612 n-d-833090-16 devstack@n-api.service[128864]: Wed Aug 31 16:54:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c/os-volume_attachments (ip 10.222.0.50) !!! Aug 31 16:54:54.999402 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-abd54af5-4ce8-400c-9ce7-fa7ce9b8d557 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f2e39055-db36-4407-abc2-1847ace66111"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:54:55.001873 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-abd54af5-4ce8-400c-9ce7-fa7ce9b8d557 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:54:55.010457 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-abd54af5-4ce8-400c-9ce7-fa7ce9b8d557 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:54:55.010990 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-abd54af5-4ce8-400c-9ce7-fa7ce9b8d557 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:54:55.011497 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-abd54af5-4ce8-400c-9ce7-fa7ce9b8d557 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:54:55.012215 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-abd54af5-4ce8-400c-9ce7-fa7ce9b8d557 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:54:55.012666 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-abd54af5-4ce8-400c-9ce7-fa7ce9b8d557 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:54:55.013099 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-abd54af5-4ce8-400c-9ce7-fa7ce9b8d557 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:54:55.324319 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-abd54af5-4ce8-400c-9ce7-fa7ce9b8d557 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "POST /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.335846 Aug 31 16:54:55.325125 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3682/7184] 10.222.0.50 () {60 vars in 1323 bytes} [Wed Aug 31 16:54:54 2022] POST /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c/os-volume_attachments => generated 194 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:55:07.170989 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-530bde5b-e0ff-48c4-85ca-3a15a65a9707 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:55:07.172964 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-530bde5b-e0ff-48c4-85ca-3a15a65a9707 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:55:07.175855 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:55:07.176571 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:55:07.182884 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-530bde5b-e0ff-48c4-85ca-3a15a65a9707 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:07.183369 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-530bde5b-e0ff-48c4-85ca-3a15a65a9707 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:07.183806 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-530bde5b-e0ff-48c4-85ca-3a15a65a9707 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:07.184496 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-530bde5b-e0ff-48c4-85ca-3a15a65a9707 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:07.184938 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-530bde5b-e0ff-48c4-85ca-3a15a65a9707 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:07.185360 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-530bde5b-e0ff-48c4-85ca-3a15a65a9707 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:07.273919 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-530bde5b-e0ff-48c4-85ca-3a15a65a9707 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:55:07.281222 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-530bde5b-e0ff-48c4-85ca-3a15a65a9707 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Old instance type m1.heat2, new instance type m1.heat {{(pid=128863) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 31 16:55:07.289208 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-530bde5b-e0ff-48c4-85ca-3a15a65a9707 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:55:07.289626 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-530bde5b-e0ff-48c4-85ca-3a15a65a9707 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:55:07.290113 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-530bde5b-e0ff-48c4-85ca-3a15a65a9707 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:55:07.290529 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-530bde5b-e0ff-48c4-85ca-3a15a65a9707 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:55:07.290931 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-530bde5b-e0ff-48c4-85ca-3a15a65a9707 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:55:07.362384 n-d-833090-16 devstack@n-api.service[128863]: ERROR oslo.messaging._drivers.impl_rabbit [None req-530bde5b-e0ff-48c4-85ca-3a15a65a9707 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [8d880d77-6271-4a4a-9b50-270c963a7de5] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 16:55:08.371925 n-d-833090-16 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [None req-530bde5b-e0ff-48c4-85ca-3a15a65a9707 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [8d880d77-6271-4a4a-9b50-270c963a7de5] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 49426. Aug 31 16:55:08.376718 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-530bde5b-e0ff-48c4-85ca-3a15a65a9707 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "POST /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c/action" status: 202 len: 0 microversion: 2.1 time: 1.210331 Aug 31 16:55:08.377581 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3503/7185] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:55:07 2022] POST /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c/action => generated 0 bytes in 1212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:55:08.387629 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9da7d6c3-a455-4fcf-b200-ef9c4ebe5967 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:55:08.388505 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9da7d6c3-a455-4fcf-b200-ef9c4ebe5967 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:55:08.392205 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:55:08.393174 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:55:08.403345 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9da7d6c3-a455-4fcf-b200-ef9c4ebe5967 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:08.404368 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9da7d6c3-a455-4fcf-b200-ef9c4ebe5967 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:08.405205 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9da7d6c3-a455-4fcf-b200-ef9c4ebe5967 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:08.406719 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9da7d6c3-a455-4fcf-b200-ef9c4ebe5967 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:08.407579 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9da7d6c3-a455-4fcf-b200-ef9c4ebe5967 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:08.408324 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9da7d6c3-a455-4fcf-b200-ef9c4ebe5967 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:08.566723 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9da7d6c3-a455-4fcf-b200-ef9c4ebe5967 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:55:08.575775 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9da7d6c3-a455-4fcf-b200-ef9c4ebe5967 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1725 microversion: 2.1 time: 0.192918 Aug 31 16:55:08.576532 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3683/7186] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:55:08 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1725 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:55:09.598404 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8b0471f4-ae6e-4619-9912-f8165ab44929 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:55:09.599033 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8b0471f4-ae6e-4619-9912-f8165ab44929 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:55:09.606374 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b0471f4-ae6e-4619-9912-f8165ab44929 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:09.606859 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b0471f4-ae6e-4619-9912-f8165ab44929 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:09.607292 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b0471f4-ae6e-4619-9912-f8165ab44929 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:09.607994 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b0471f4-ae6e-4619-9912-f8165ab44929 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:09.608440 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b0471f4-ae6e-4619-9912-f8165ab44929 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:09.608853 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8b0471f4-ae6e-4619-9912-f8165ab44929 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:09.750581 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8b0471f4-ae6e-4619-9912-f8165ab44929 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:55:09.760269 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8b0471f4-ae6e-4619-9912-f8165ab44929 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1725 microversion: 2.1 time: 0.167061 Aug 31 16:55:09.774138 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3504/7187] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:55:09 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:55:10.787245 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b84e427a-608d-49b8-b875-53732200f7c1 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:55:10.788819 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b84e427a-608d-49b8-b875-53732200f7c1 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:55:10.803920 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b84e427a-608d-49b8-b875-53732200f7c1 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:10.805228 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b84e427a-608d-49b8-b875-53732200f7c1 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:10.805228 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b84e427a-608d-49b8-b875-53732200f7c1 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:10.806359 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b84e427a-608d-49b8-b875-53732200f7c1 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:10.806359 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b84e427a-608d-49b8-b875-53732200f7c1 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:10.806844 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b84e427a-608d-49b8-b875-53732200f7c1 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:10.965064 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b84e427a-608d-49b8-b875-53732200f7c1 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:55:10.974984 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b84e427a-608d-49b8-b875-53732200f7c1 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1730 microversion: 2.1 time: 0.196908 Aug 31 16:55:10.975578 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3684/7188] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:55:10 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1730 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:55:11.997901 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-318f229c-b915-42f7-8d68-d4a5738bb314 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:55:11.998534 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-318f229c-b915-42f7-8d68-d4a5738bb314 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:55:12.006618 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-318f229c-b915-42f7-8d68-d4a5738bb314 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:12.007109 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-318f229c-b915-42f7-8d68-d4a5738bb314 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:12.007546 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-318f229c-b915-42f7-8d68-d4a5738bb314 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:12.008253 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-318f229c-b915-42f7-8d68-d4a5738bb314 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:12.008714 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-318f229c-b915-42f7-8d68-d4a5738bb314 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:12.009137 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-318f229c-b915-42f7-8d68-d4a5738bb314 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:12.152442 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-318f229c-b915-42f7-8d68-d4a5738bb314 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:55:12.165686 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-318f229c-b915-42f7-8d68-d4a5738bb314 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1730 microversion: 2.1 time: 0.171744 Aug 31 16:55:12.166329 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3505/7189] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:55:11 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:55:13.191853 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-374d815c-fbfa-4578-a3d2-2b1059589003 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:55:13.192469 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-374d815c-fbfa-4578-a3d2-2b1059589003 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:55:13.200060 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-374d815c-fbfa-4578-a3d2-2b1059589003 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:13.200553 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-374d815c-fbfa-4578-a3d2-2b1059589003 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:13.200993 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-374d815c-fbfa-4578-a3d2-2b1059589003 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:13.201724 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-374d815c-fbfa-4578-a3d2-2b1059589003 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:13.202223 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-374d815c-fbfa-4578-a3d2-2b1059589003 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:13.202654 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-374d815c-fbfa-4578-a3d2-2b1059589003 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:13.343284 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-374d815c-fbfa-4578-a3d2-2b1059589003 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:55:13.354361 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-374d815c-fbfa-4578-a3d2-2b1059589003 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1730 microversion: 2.1 time: 0.166502 Aug 31 16:55:13.354943 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3685/7190] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:55:13 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:55:14.379386 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4bac4f12-7c71-4a16-a40a-f3dbb8c90b1f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:55:14.380014 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4bac4f12-7c71-4a16-a40a-f3dbb8c90b1f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:55:14.391414 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4bac4f12-7c71-4a16-a40a-f3dbb8c90b1f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:14.391929 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4bac4f12-7c71-4a16-a40a-f3dbb8c90b1f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:14.392364 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4bac4f12-7c71-4a16-a40a-f3dbb8c90b1f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:14.393064 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4bac4f12-7c71-4a16-a40a-f3dbb8c90b1f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:14.393493 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4bac4f12-7c71-4a16-a40a-f3dbb8c90b1f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:14.394116 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4bac4f12-7c71-4a16-a40a-f3dbb8c90b1f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:14.547693 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4bac4f12-7c71-4a16-a40a-f3dbb8c90b1f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:55:14.561486 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4bac4f12-7c71-4a16-a40a-f3dbb8c90b1f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1730 microversion: 2.1 time: 0.189011 Aug 31 16:55:14.562225 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3506/7191] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:55:14 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1730 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:55:15.586592 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-524455ba-3351-423e-b3a6-cbd9641a877f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:55:15.587255 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-524455ba-3351-423e-b3a6-cbd9641a877f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:55:15.594770 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-524455ba-3351-423e-b3a6-cbd9641a877f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:15.595273 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-524455ba-3351-423e-b3a6-cbd9641a877f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:15.595721 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-524455ba-3351-423e-b3a6-cbd9641a877f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:15.596436 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-524455ba-3351-423e-b3a6-cbd9641a877f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:15.596906 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-524455ba-3351-423e-b3a6-cbd9641a877f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:15.597344 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-524455ba-3351-423e-b3a6-cbd9641a877f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:16.078610 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-524455ba-3351-423e-b3a6-cbd9641a877f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:55:16.087957 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-524455ba-3351-423e-b3a6-cbd9641a877f tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1730 microversion: 2.1 time: 0.506045 Aug 31 16:55:16.088557 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3686/7192] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:55:15 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1730 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:55:17.110844 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9f1554a8-eadf-4961-8353-adbd8fa2651a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:55:17.111620 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9f1554a8-eadf-4961-8353-adbd8fa2651a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:55:17.118861 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f1554a8-eadf-4961-8353-adbd8fa2651a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:17.119348 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f1554a8-eadf-4961-8353-adbd8fa2651a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:17.119785 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f1554a8-eadf-4961-8353-adbd8fa2651a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:17.120484 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f1554a8-eadf-4961-8353-adbd8fa2651a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:17.120938 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f1554a8-eadf-4961-8353-adbd8fa2651a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:17.121363 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9f1554a8-eadf-4961-8353-adbd8fa2651a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:17.257846 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9f1554a8-eadf-4961-8353-adbd8fa2651a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:55:17.267587 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9f1554a8-eadf-4961-8353-adbd8fa2651a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1730 microversion: 2.1 time: 0.161117 Aug 31 16:55:17.268097 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3507/7193] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:55:17 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:55:18.290400 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fc3d44aa-78ad-46b0-90b1-cf5ee981c5ae tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:55:18.291012 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fc3d44aa-78ad-46b0-90b1-cf5ee981c5ae tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:55:18.298760 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fc3d44aa-78ad-46b0-90b1-cf5ee981c5ae tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:18.299265 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fc3d44aa-78ad-46b0-90b1-cf5ee981c5ae tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:18.299735 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fc3d44aa-78ad-46b0-90b1-cf5ee981c5ae tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:18.300454 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fc3d44aa-78ad-46b0-90b1-cf5ee981c5ae tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:18.300921 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fc3d44aa-78ad-46b0-90b1-cf5ee981c5ae tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:18.301360 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fc3d44aa-78ad-46b0-90b1-cf5ee981c5ae tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:18.461658 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-fc3d44aa-78ad-46b0-90b1-cf5ee981c5ae tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:55:18.472246 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fc3d44aa-78ad-46b0-90b1-cf5ee981c5ae tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1730 microversion: 2.1 time: 0.186718 Aug 31 16:55:18.472930 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3687/7194] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:55:18 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1730 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:55:19.496136 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1d920af0-9f30-4132-96be-dcee302031b0 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:55:19.496783 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1d920af0-9f30-4132-96be-dcee302031b0 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:55:19.505030 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d920af0-9f30-4132-96be-dcee302031b0 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:19.505574 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d920af0-9f30-4132-96be-dcee302031b0 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:19.506061 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d920af0-9f30-4132-96be-dcee302031b0 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:19.506871 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d920af0-9f30-4132-96be-dcee302031b0 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:19.507383 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d920af0-9f30-4132-96be-dcee302031b0 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:19.507858 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1d920af0-9f30-4132-96be-dcee302031b0 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:19.657577 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1d920af0-9f30-4132-96be-dcee302031b0 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:55:19.671330 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1d920af0-9f30-4132-96be-dcee302031b0 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1730 microversion: 2.1 time: 0.179826 Aug 31 16:55:19.672152 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3508/7195] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:55:19 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:55:20.695927 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-13cc4ca9-c021-46e6-80a7-0e8cc495bd64 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:55:20.696513 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-13cc4ca9-c021-46e6-80a7-0e8cc495bd64 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:55:20.704639 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-13cc4ca9-c021-46e6-80a7-0e8cc495bd64 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:20.705280 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-13cc4ca9-c021-46e6-80a7-0e8cc495bd64 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:20.705774 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-13cc4ca9-c021-46e6-80a7-0e8cc495bd64 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:20.706845 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-13cc4ca9-c021-46e6-80a7-0e8cc495bd64 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:20.707312 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-13cc4ca9-c021-46e6-80a7-0e8cc495bd64 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:20.707769 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-13cc4ca9-c021-46e6-80a7-0e8cc495bd64 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:20.858561 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-13cc4ca9-c021-46e6-80a7-0e8cc495bd64 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:55:20.868814 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-13cc4ca9-c021-46e6-80a7-0e8cc495bd64 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1730 microversion: 2.1 time: 0.176828 Aug 31 16:55:20.869972 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3688/7196] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:55:20 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1730 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:55:21.895151 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-afcd6573-4c5c-4cf6-b787-60f5a9700e80 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:55:21.896055 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-afcd6573-4c5c-4cf6-b787-60f5a9700e80 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:55:21.905358 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-afcd6573-4c5c-4cf6-b787-60f5a9700e80 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:21.905843 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-afcd6573-4c5c-4cf6-b787-60f5a9700e80 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:21.906319 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-afcd6573-4c5c-4cf6-b787-60f5a9700e80 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:21.907013 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-afcd6573-4c5c-4cf6-b787-60f5a9700e80 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:21.907472 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-afcd6573-4c5c-4cf6-b787-60f5a9700e80 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:21.907901 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-afcd6573-4c5c-4cf6-b787-60f5a9700e80 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:22.048029 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-afcd6573-4c5c-4cf6-b787-60f5a9700e80 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:55:22.062566 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-afcd6573-4c5c-4cf6-b787-60f5a9700e80 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1730 microversion: 2.1 time: 0.173947 Aug 31 16:55:22.063383 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3509/7197] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:55:21 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:55:23.084742 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5540270c-2be2-4e68-9905-2bc5bc86acb8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:55:23.085291 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5540270c-2be2-4e68-9905-2bc5bc86acb8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:55:23.093738 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5540270c-2be2-4e68-9905-2bc5bc86acb8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:23.094274 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5540270c-2be2-4e68-9905-2bc5bc86acb8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:23.094728 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5540270c-2be2-4e68-9905-2bc5bc86acb8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:23.095451 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5540270c-2be2-4e68-9905-2bc5bc86acb8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:23.095924 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5540270c-2be2-4e68-9905-2bc5bc86acb8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:23.096367 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5540270c-2be2-4e68-9905-2bc5bc86acb8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:23.234734 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5540270c-2be2-4e68-9905-2bc5bc86acb8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:55:23.243580 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5540270c-2be2-4e68-9905-2bc5bc86acb8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1730 microversion: 2.1 time: 0.162897 Aug 31 16:55:23.244175 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3689/7198] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:55:23 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:55:24.266188 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-72f522bc-a0d0-4364-9fed-663ea70e044c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:55:24.266761 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-72f522bc-a0d0-4364-9fed-663ea70e044c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:55:24.273782 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72f522bc-a0d0-4364-9fed-663ea70e044c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:24.274309 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72f522bc-a0d0-4364-9fed-663ea70e044c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:24.274738 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72f522bc-a0d0-4364-9fed-663ea70e044c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:24.275428 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72f522bc-a0d0-4364-9fed-663ea70e044c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:24.275913 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72f522bc-a0d0-4364-9fed-663ea70e044c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:24.276320 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-72f522bc-a0d0-4364-9fed-663ea70e044c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:24.423869 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-72f522bc-a0d0-4364-9fed-663ea70e044c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:55:24.433282 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-72f522bc-a0d0-4364-9fed-663ea70e044c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1730 microversion: 2.1 time: 0.170852 Aug 31 16:55:24.433876 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3510/7199] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:55:24 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:55:25.015994 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-e6510803-77fb-42eb-838f-1d9e20a5533b req-82c491cc-3faf-41fb-a102-5076a3d9fc07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d7ff3bf-dc43-421d-93af-9b10866f869c", "name": "network-vif-unplugged", "status": "completed", "tag": "0b969e4e-9a6d-426d-a9fe-bdbee00916af"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:55:25.026863 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-e6510803-77fb-42eb-838f-1d9e20a5533b req-82c491cc-3faf-41fb-a102-5076a3d9fc07 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:25.027433 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-e6510803-77fb-42eb-838f-1d9e20a5533b req-82c491cc-3faf-41fb-a102-5076a3d9fc07 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:25.027935 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-e6510803-77fb-42eb-838f-1d9e20a5533b req-82c491cc-3faf-41fb-a102-5076a3d9fc07 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:25.040569 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-e6510803-77fb-42eb-838f-1d9e20a5533b req-82c491cc-3faf-41fb-a102-5076a3d9fc07 service nova] Creating event network-vif-unplugged:0b969e4e-9a6d-426d-a9fe-bdbee00916af for instance 6d7ff3bf-dc43-421d-93af-9b10866f869c on n-h1-833090-16 Aug 31 16:55:25.046391 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [req-e6510803-77fb-42eb-838f-1d9e20a5533b req-82c491cc-3faf-41fb-a102-5076a3d9fc07 service nova] Instance 6d7ff3bf-dc43-421d-93af-9b10866f869c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-833090-16', 'n-h1-833090-16'} {{(pid=128864) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 16:55:25.058808 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-e6510803-77fb-42eb-838f-1d9e20a5533b req-82c491cc-3faf-41fb-a102-5076a3d9fc07 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046705 Aug 31 16:55:25.059422 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3690/7200] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:55:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:55:25.457793 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a981a337-ec22-4348-bafe-77f01ec464e9 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:55:25.458626 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a981a337-ec22-4348-bafe-77f01ec464e9 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:55:25.466491 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a981a337-ec22-4348-bafe-77f01ec464e9 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:25.467084 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a981a337-ec22-4348-bafe-77f01ec464e9 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:25.467588 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a981a337-ec22-4348-bafe-77f01ec464e9 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:25.468353 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a981a337-ec22-4348-bafe-77f01ec464e9 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:25.469009 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a981a337-ec22-4348-bafe-77f01ec464e9 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:25.469615 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a981a337-ec22-4348-bafe-77f01ec464e9 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:25.609938 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a981a337-ec22-4348-bafe-77f01ec464e9 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:55:25.619700 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a981a337-ec22-4348-bafe-77f01ec464e9 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1729 microversion: 2.1 time: 0.166780 Aug 31 16:55:25.626999 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3511/7201] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:55:25 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:55:26.645196 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-599270ef-1ec3-4c77-8af5-adab151719a1 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:55:26.645912 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-599270ef-1ec3-4c77-8af5-adab151719a1 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:55:26.656201 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-599270ef-1ec3-4c77-8af5-adab151719a1 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:26.656994 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-599270ef-1ec3-4c77-8af5-adab151719a1 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:26.657674 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-599270ef-1ec3-4c77-8af5-adab151719a1 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:26.658854 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-599270ef-1ec3-4c77-8af5-adab151719a1 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:26.659550 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-599270ef-1ec3-4c77-8af5-adab151719a1 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:26.660270 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-599270ef-1ec3-4c77-8af5-adab151719a1 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:26.811542 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-599270ef-1ec3-4c77-8af5-adab151719a1 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:55:26.820614 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-599270ef-1ec3-4c77-8af5-adab151719a1 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1727 microversion: 2.1 time: 0.180915 Aug 31 16:55:26.821218 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3691/7202] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:55:26 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1727 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:55:27.102422 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-f2550a3d-6359-42b2-b618-00414cc930b7 req-768eb4a7-5072-465a-a24a-f3a1cda0a172 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d7ff3bf-dc43-421d-93af-9b10866f869c", "tag": "0b969e4e-9a6d-426d-a9fe-bdbee00916af"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:55:27.113497 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f2550a3d-6359-42b2-b618-00414cc930b7 req-768eb4a7-5072-465a-a24a-f3a1cda0a172 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:27.113983 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f2550a3d-6359-42b2-b618-00414cc930b7 req-768eb4a7-5072-465a-a24a-f3a1cda0a172 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:27.114465 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f2550a3d-6359-42b2-b618-00414cc930b7 req-768eb4a7-5072-465a-a24a-f3a1cda0a172 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:27.128058 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-f2550a3d-6359-42b2-b618-00414cc930b7 req-768eb4a7-5072-465a-a24a-f3a1cda0a172 service nova] Creating event network-changed:0b969e4e-9a6d-426d-a9fe-bdbee00916af for instance 6d7ff3bf-dc43-421d-93af-9b10866f869c on n-h1-833090-16 Aug 31 16:55:27.133864 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [req-f2550a3d-6359-42b2-b618-00414cc930b7 req-768eb4a7-5072-465a-a24a-f3a1cda0a172 service nova] Instance 6d7ff3bf-dc43-421d-93af-9b10866f869c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-833090-16', 'n-h1-833090-16'} {{(pid=128863) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 16:55:27.145751 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-f2550a3d-6359-42b2-b618-00414cc930b7 req-768eb4a7-5072-465a-a24a-f3a1cda0a172 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047107 Aug 31 16:55:27.146729 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3512/7203] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:55:27.842418 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5d262385-76ed-4a4c-a645-b84cd0e2ff23 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:55:27.843264 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5d262385-76ed-4a4c-a645-b84cd0e2ff23 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:55:27.850859 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5d262385-76ed-4a4c-a645-b84cd0e2ff23 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:27.851362 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5d262385-76ed-4a4c-a645-b84cd0e2ff23 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:27.851815 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5d262385-76ed-4a4c-a645-b84cd0e2ff23 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:27.852568 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5d262385-76ed-4a4c-a645-b84cd0e2ff23 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:27.853035 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5d262385-76ed-4a4c-a645-b84cd0e2ff23 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:27.853687 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5d262385-76ed-4a4c-a645-b84cd0e2ff23 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:27.998202 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5d262385-76ed-4a4c-a645-b84cd0e2ff23 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:55:28.007559 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5d262385-76ed-4a4c-a645-b84cd0e2ff23 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1727 microversion: 2.1 time: 0.169504 Aug 31 16:55:28.008167 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3692/7204] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:55:27 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1727 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:55:29.030004 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ff83955d-4046-42f7-9828-f1d7fc52590d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:55:29.030781 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ff83955d-4046-42f7-9828-f1d7fc52590d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:55:29.041895 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ff83955d-4046-42f7-9828-f1d7fc52590d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:29.042400 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ff83955d-4046-42f7-9828-f1d7fc52590d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:29.042834 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ff83955d-4046-42f7-9828-f1d7fc52590d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:29.043899 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ff83955d-4046-42f7-9828-f1d7fc52590d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:29.044355 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ff83955d-4046-42f7-9828-f1d7fc52590d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:29.044758 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ff83955d-4046-42f7-9828-f1d7fc52590d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:29.193257 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ff83955d-4046-42f7-9828-f1d7fc52590d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:55:29.202245 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ff83955d-4046-42f7-9828-f1d7fc52590d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1727 microversion: 2.1 time: 0.176842 Aug 31 16:55:29.202831 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3513/7205] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:55:29 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1727 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:55:30.224805 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-30d89417-8d2c-4877-bbd7-9303b4e480ae tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:55:30.225442 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-30d89417-8d2c-4877-bbd7-9303b4e480ae tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:55:30.233132 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-30d89417-8d2c-4877-bbd7-9303b4e480ae tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:30.233516 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-30d89417-8d2c-4877-bbd7-9303b4e480ae tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:30.233960 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-30d89417-8d2c-4877-bbd7-9303b4e480ae tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:30.234842 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-30d89417-8d2c-4877-bbd7-9303b4e480ae tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:30.235307 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-30d89417-8d2c-4877-bbd7-9303b4e480ae tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:30.235736 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-30d89417-8d2c-4877-bbd7-9303b4e480ae tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:30.384167 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-30d89417-8d2c-4877-bbd7-9303b4e480ae tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:55:30.393929 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-30d89417-8d2c-4877-bbd7-9303b4e480ae tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1727 microversion: 2.1 time: 0.173109 Aug 31 16:55:30.394568 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3693/7206] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:55:30 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1727 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:55:31.419505 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-62e29451-edac-4a9b-9073-a5b46db2313c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:55:31.420299 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-62e29451-edac-4a9b-9073-a5b46db2313c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:55:31.430348 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62e29451-edac-4a9b-9073-a5b46db2313c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:31.430967 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62e29451-edac-4a9b-9073-a5b46db2313c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:31.431513 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62e29451-edac-4a9b-9073-a5b46db2313c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:31.432899 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62e29451-edac-4a9b-9073-a5b46db2313c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:31.433505 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62e29451-edac-4a9b-9073-a5b46db2313c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:31.433934 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-62e29451-edac-4a9b-9073-a5b46db2313c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:31.587137 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-62e29451-edac-4a9b-9073-a5b46db2313c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:55:31.596705 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-62e29451-edac-4a9b-9073-a5b46db2313c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1727 microversion: 2.1 time: 0.182677 Aug 31 16:55:31.597280 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3514/7207] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:55:31 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1727 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:55:32.618622 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-59627cbd-821c-4b2f-b4cf-d399423f0220 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:55:32.619228 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-59627cbd-821c-4b2f-b4cf-d399423f0220 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:55:32.627572 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-59627cbd-821c-4b2f-b4cf-d399423f0220 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:32.627572 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-59627cbd-821c-4b2f-b4cf-d399423f0220 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:32.627983 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-59627cbd-821c-4b2f-b4cf-d399423f0220 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:32.628713 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-59627cbd-821c-4b2f-b4cf-d399423f0220 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:32.629181 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-59627cbd-821c-4b2f-b4cf-d399423f0220 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:32.629626 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-59627cbd-821c-4b2f-b4cf-d399423f0220 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:32.772761 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-59627cbd-821c-4b2f-b4cf-d399423f0220 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:55:32.785622 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-59627cbd-821c-4b2f-b4cf-d399423f0220 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1727 microversion: 2.1 time: 0.170819 Aug 31 16:55:32.786529 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3694/7208] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:55:32 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1727 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:55:33.810791 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d7a6f253-57bc-48c3-a65c-389bad660124 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:55:33.811386 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d7a6f253-57bc-48c3-a65c-389bad660124 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:55:33.819047 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7a6f253-57bc-48c3-a65c-389bad660124 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:33.819529 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7a6f253-57bc-48c3-a65c-389bad660124 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:33.819960 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7a6f253-57bc-48c3-a65c-389bad660124 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:33.820645 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7a6f253-57bc-48c3-a65c-389bad660124 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:33.821088 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7a6f253-57bc-48c3-a65c-389bad660124 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:33.821505 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d7a6f253-57bc-48c3-a65c-389bad660124 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:33.964847 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d7a6f253-57bc-48c3-a65c-389bad660124 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:55:33.974260 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d7a6f253-57bc-48c3-a65c-389bad660124 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1727 microversion: 2.1 time: 0.167614 Aug 31 16:55:33.974844 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3515/7209] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:55:33 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:55:34.996979 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9f83044e-0e8e-4c51-bcd8-afcdcb2ff9de tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:55:34.997578 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9f83044e-0e8e-4c51-bcd8-afcdcb2ff9de tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:55:35.005280 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9f83044e-0e8e-4c51-bcd8-afcdcb2ff9de tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:35.005774 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9f83044e-0e8e-4c51-bcd8-afcdcb2ff9de tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:35.006248 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9f83044e-0e8e-4c51-bcd8-afcdcb2ff9de tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:35.006950 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9f83044e-0e8e-4c51-bcd8-afcdcb2ff9de tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:35.007409 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9f83044e-0e8e-4c51-bcd8-afcdcb2ff9de tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:35.007838 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9f83044e-0e8e-4c51-bcd8-afcdcb2ff9de tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:35.162691 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9f83044e-0e8e-4c51-bcd8-afcdcb2ff9de tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:55:35.173318 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9f83044e-0e8e-4c51-bcd8-afcdcb2ff9de tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1727 microversion: 2.1 time: 0.180612 Aug 31 16:55:35.173924 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3695/7210] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:55:34 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1727 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:55:36.195869 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-016ef4e0-706e-4e7b-a22f-a2944dd4cf38 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:55:36.196485 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-016ef4e0-706e-4e7b-a22f-a2944dd4cf38 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:55:36.204373 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-016ef4e0-706e-4e7b-a22f-a2944dd4cf38 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:36.204860 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-016ef4e0-706e-4e7b-a22f-a2944dd4cf38 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:36.205298 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-016ef4e0-706e-4e7b-a22f-a2944dd4cf38 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:36.206017 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-016ef4e0-706e-4e7b-a22f-a2944dd4cf38 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:36.206470 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-016ef4e0-706e-4e7b-a22f-a2944dd4cf38 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:36.206884 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-016ef4e0-706e-4e7b-a22f-a2944dd4cf38 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:36.359290 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-016ef4e0-706e-4e7b-a22f-a2944dd4cf38 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:55:36.368003 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-016ef4e0-706e-4e7b-a22f-a2944dd4cf38 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1727 microversion: 2.1 time: 0.176229 Aug 31 16:55:36.368549 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3516/7211] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:55:36 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1727 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:55:37.389472 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7553f109-95f5-454d-8ab2-a49cabcd6b90 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:55:37.390631 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7553f109-95f5-454d-8ab2-a49cabcd6b90 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:55:37.397955 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7553f109-95f5-454d-8ab2-a49cabcd6b90 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:37.398486 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7553f109-95f5-454d-8ab2-a49cabcd6b90 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:37.398988 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7553f109-95f5-454d-8ab2-a49cabcd6b90 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:37.399653 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7553f109-95f5-454d-8ab2-a49cabcd6b90 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:37.400112 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7553f109-95f5-454d-8ab2-a49cabcd6b90 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:37.400547 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7553f109-95f5-454d-8ab2-a49cabcd6b90 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:37.552072 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7553f109-95f5-454d-8ab2-a49cabcd6b90 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:55:37.562199 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7553f109-95f5-454d-8ab2-a49cabcd6b90 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1727 microversion: 2.1 time: 0.176586 Aug 31 16:55:37.562777 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3696/7212] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:55:37 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1727 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:55:38.583467 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0695ce02-0744-4aa3-838e-f666afb24ae3 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:55:38.584121 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0695ce02-0744-4aa3-838e-f666afb24ae3 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:55:38.587154 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=33 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:55:38.592876 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0695ce02-0744-4aa3-838e-f666afb24ae3 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:38.593359 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0695ce02-0744-4aa3-838e-f666afb24ae3 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:38.593790 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0695ce02-0744-4aa3-838e-f666afb24ae3 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:38.594546 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0695ce02-0744-4aa3-838e-f666afb24ae3 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:38.595001 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0695ce02-0744-4aa3-838e-f666afb24ae3 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:38.595423 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0695ce02-0744-4aa3-838e-f666afb24ae3 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:38.598495 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:55:38.745910 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0695ce02-0744-4aa3-838e-f666afb24ae3 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:55:38.754376 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0695ce02-0744-4aa3-838e-f666afb24ae3 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1724 microversion: 2.1 time: 0.174993 Aug 31 16:55:38.754972 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3517/7213] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:55:38 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:55:38.775451 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-cc2b06ac-9063-4da0-ae7c-e928b9a53b90 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:55:38.776250 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-cc2b06ac-9063-4da0-ae7c-e928b9a53b90 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:55:38.779007 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=29 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:55:38.785685 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cc2b06ac-9063-4da0-ae7c-e928b9a53b90 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:38.786185 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cc2b06ac-9063-4da0-ae7c-e928b9a53b90 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:38.786628 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cc2b06ac-9063-4da0-ae7c-e928b9a53b90 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:38.787362 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cc2b06ac-9063-4da0-ae7c-e928b9a53b90 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:38.787947 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cc2b06ac-9063-4da0-ae7c-e928b9a53b90 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:38.788379 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cc2b06ac-9063-4da0-ae7c-e928b9a53b90 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:38.791318 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=83 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:55:38.831708 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cc2b06ac-9063-4da0-ae7c-e928b9a53b90 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:38.832119 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cc2b06ac-9063-4da0-ae7c-e928b9a53b90 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:38.832574 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cc2b06ac-9063-4da0-ae7c-e928b9a53b90 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:38.833319 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cc2b06ac-9063-4da0-ae7c-e928b9a53b90 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:38.833787 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cc2b06ac-9063-4da0-ae7c-e928b9a53b90 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:38.834257 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cc2b06ac-9063-4da0-ae7c-e928b9a53b90 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:38.860826 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-cc2b06ac-9063-4da0-ae7c-e928b9a53b90 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Getting quotas for project fce77c4128d3448885217ac4d4744765. Resources: {'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:55:38.867278 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-cc2b06ac-9063-4da0-ae7c-e928b9a53b90 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Getting quotas for user 689ff4da0acb4aafa5f44d42e68ab41d and project fce77c4128d3448885217ac4d4744765. Resources: {'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:55:38.987688 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-cc2b06ac-9063-4da0-ae7c-e928b9a53b90 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "POST /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c/action" status: 202 len: 0 microversion: 2.1 time: 0.215999 Aug 31 16:55:38.988360 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3697/7214] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:55:38 2022] POST /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 16:55:38.997496 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-edf6c264-2d25-4473-a800-926ec109c4af tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:55:38.998139 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-edf6c264-2d25-4473-a800-926ec109c4af tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:55:39.005600 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-edf6c264-2d25-4473-a800-926ec109c4af tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:39.006472 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-edf6c264-2d25-4473-a800-926ec109c4af tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:39.007202 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-edf6c264-2d25-4473-a800-926ec109c4af tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:39.007988 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-edf6c264-2d25-4473-a800-926ec109c4af tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:39.008592 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-edf6c264-2d25-4473-a800-926ec109c4af tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:39.009023 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-edf6c264-2d25-4473-a800-926ec109c4af tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:39.148092 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-edf6c264-2d25-4473-a800-926ec109c4af tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:55:39.157349 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-edf6c264-2d25-4473-a800-926ec109c4af tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1723 microversion: 2.1 time: 0.164470 Aug 31 16:55:39.157928 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3518/7215] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:55:38 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:55:40.181136 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fd34e252-31a0-4a9c-82a5-4f578f5798bd tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:55:40.181869 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fd34e252-31a0-4a9c-82a5-4f578f5798bd tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:55:40.193030 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fd34e252-31a0-4a9c-82a5-4f578f5798bd tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:40.193531 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fd34e252-31a0-4a9c-82a5-4f578f5798bd tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:40.193972 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fd34e252-31a0-4a9c-82a5-4f578f5798bd tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:40.194712 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fd34e252-31a0-4a9c-82a5-4f578f5798bd tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:40.195173 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fd34e252-31a0-4a9c-82a5-4f578f5798bd tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:40.195600 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fd34e252-31a0-4a9c-82a5-4f578f5798bd tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:40.350607 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-fd34e252-31a0-4a9c-82a5-4f578f5798bd tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:55:40.359383 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fd34e252-31a0-4a9c-82a5-4f578f5798bd tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1723 microversion: 2.1 time: 0.183711 Aug 31 16:55:40.359974 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3698/7216] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:55:40 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:55:40.929489 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-f8403d2a-b357-4a95-aea3-ce2cb0e0dd99 req-d50451c8-9c4f-4609-b76d-ae8e01c5be21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d7ff3bf-dc43-421d-93af-9b10866f869c", "name": "network-vif-plugged", "status": "completed", "tag": "0b969e4e-9a6d-426d-a9fe-bdbee00916af"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:55:40.941603 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f8403d2a-b357-4a95-aea3-ce2cb0e0dd99 req-d50451c8-9c4f-4609-b76d-ae8e01c5be21 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:40.942109 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f8403d2a-b357-4a95-aea3-ce2cb0e0dd99 req-d50451c8-9c4f-4609-b76d-ae8e01c5be21 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:40.942550 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f8403d2a-b357-4a95-aea3-ce2cb0e0dd99 req-d50451c8-9c4f-4609-b76d-ae8e01c5be21 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:40.955495 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-f8403d2a-b357-4a95-aea3-ce2cb0e0dd99 req-d50451c8-9c4f-4609-b76d-ae8e01c5be21 service nova] Creating event network-vif-plugged:0b969e4e-9a6d-426d-a9fe-bdbee00916af for instance 6d7ff3bf-dc43-421d-93af-9b10866f869c on n-h1-833090-16 Aug 31 16:55:40.961166 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [req-f8403d2a-b357-4a95-aea3-ce2cb0e0dd99 req-d50451c8-9c4f-4609-b76d-ae8e01c5be21 service nova] Instance 6d7ff3bf-dc43-421d-93af-9b10866f869c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-833090-16', 'n-h1-833090-16'} {{(pid=128863) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 16:55:40.973363 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-f8403d2a-b357-4a95-aea3-ce2cb0e0dd99 req-d50451c8-9c4f-4609-b76d-ae8e01c5be21 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048064 Aug 31 16:55:40.974348 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3519/7217] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:55:41.387655 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b5aae8e5-0011-4030-86f3-2581da69ddb0 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:55:41.388592 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b5aae8e5-0011-4030-86f3-2581da69ddb0 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:55:41.396955 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b5aae8e5-0011-4030-86f3-2581da69ddb0 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:41.397466 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b5aae8e5-0011-4030-86f3-2581da69ddb0 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:41.398016 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b5aae8e5-0011-4030-86f3-2581da69ddb0 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:41.398781 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b5aae8e5-0011-4030-86f3-2581da69ddb0 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:41.399290 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b5aae8e5-0011-4030-86f3-2581da69ddb0 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:41.399783 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b5aae8e5-0011-4030-86f3-2581da69ddb0 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:41.541584 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b5aae8e5-0011-4030-86f3-2581da69ddb0 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:55:41.551151 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b5aae8e5-0011-4030-86f3-2581da69ddb0 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1723 microversion: 2.1 time: 0.167552 Aug 31 16:55:41.551858 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3699/7218] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:55:41 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:55:42.574908 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2305ea34-426d-429b-94ac-dba6591ecadf tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:55:42.575508 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2305ea34-426d-429b-94ac-dba6591ecadf tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:55:42.582459 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2305ea34-426d-429b-94ac-dba6591ecadf tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:42.582953 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2305ea34-426d-429b-94ac-dba6591ecadf tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:42.583360 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2305ea34-426d-429b-94ac-dba6591ecadf tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:42.584567 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2305ea34-426d-429b-94ac-dba6591ecadf tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:42.585024 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2305ea34-426d-429b-94ac-dba6591ecadf tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:42.585455 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2305ea34-426d-429b-94ac-dba6591ecadf tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:42.735252 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2305ea34-426d-429b-94ac-dba6591ecadf tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:55:42.744855 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2305ea34-426d-429b-94ac-dba6591ecadf tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1723 microversion: 2.1 time: 0.175467 Aug 31 16:55:42.745489 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3520/7219] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:55:42 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:55:43.766784 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a288f7e3-9b5d-48cf-b824-ec7087d5443b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:55:43.767392 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a288f7e3-9b5d-48cf-b824-ec7087d5443b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:55:43.774692 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a288f7e3-9b5d-48cf-b824-ec7087d5443b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:43.775180 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a288f7e3-9b5d-48cf-b824-ec7087d5443b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:43.775813 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a288f7e3-9b5d-48cf-b824-ec7087d5443b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:43.776553 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a288f7e3-9b5d-48cf-b824-ec7087d5443b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:43.777009 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a288f7e3-9b5d-48cf-b824-ec7087d5443b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:43.777418 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a288f7e3-9b5d-48cf-b824-ec7087d5443b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:43.918432 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a288f7e3-9b5d-48cf-b824-ec7087d5443b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:55:43.928385 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a288f7e3-9b5d-48cf-b824-ec7087d5443b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1723 microversion: 2.1 time: 0.165595 Aug 31 16:55:43.928967 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3700/7220] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:55:43 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:55:44.356747 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-ebe40db3-9cd7-46aa-b3cc-4c72238a689a req-b45619f6-d31f-4aa3-96e9-688cf30f7735 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d7ff3bf-dc43-421d-93af-9b10866f869c", "name": "network-vif-unplugged", "status": "completed", "tag": "0b969e4e-9a6d-426d-a9fe-bdbee00916af"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:55:44.368648 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ebe40db3-9cd7-46aa-b3cc-4c72238a689a req-b45619f6-d31f-4aa3-96e9-688cf30f7735 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:44.369268 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ebe40db3-9cd7-46aa-b3cc-4c72238a689a req-b45619f6-d31f-4aa3-96e9-688cf30f7735 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:44.369793 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ebe40db3-9cd7-46aa-b3cc-4c72238a689a req-b45619f6-d31f-4aa3-96e9-688cf30f7735 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:44.383621 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-ebe40db3-9cd7-46aa-b3cc-4c72238a689a req-b45619f6-d31f-4aa3-96e9-688cf30f7735 service nova] Creating event network-vif-unplugged:0b969e4e-9a6d-426d-a9fe-bdbee00916af for instance 6d7ff3bf-dc43-421d-93af-9b10866f869c on n-h2-833090-16 Aug 31 16:55:44.389215 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [req-ebe40db3-9cd7-46aa-b3cc-4c72238a689a req-b45619f6-d31f-4aa3-96e9-688cf30f7735 service nova] Instance 6d7ff3bf-dc43-421d-93af-9b10866f869c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-833090-16', 'n-h1-833090-16'} {{(pid=128863) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 16:55:44.401819 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-ebe40db3-9cd7-46aa-b3cc-4c72238a689a req-b45619f6-d31f-4aa3-96e9-688cf30f7735 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048846 Aug 31 16:55:44.402408 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3521/7221] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:55:44.952017 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c48ff00d-99d2-4ee5-9dcf-a6a54ee8abcd tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:55:44.952750 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c48ff00d-99d2-4ee5-9dcf-a6a54ee8abcd tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:55:44.960302 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c48ff00d-99d2-4ee5-9dcf-a6a54ee8abcd tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:44.960812 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c48ff00d-99d2-4ee5-9dcf-a6a54ee8abcd tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:44.961264 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c48ff00d-99d2-4ee5-9dcf-a6a54ee8abcd tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:44.961962 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c48ff00d-99d2-4ee5-9dcf-a6a54ee8abcd tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:44.962496 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c48ff00d-99d2-4ee5-9dcf-a6a54ee8abcd tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:44.962937 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c48ff00d-99d2-4ee5-9dcf-a6a54ee8abcd tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:45.099125 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c48ff00d-99d2-4ee5-9dcf-a6a54ee8abcd tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:55:45.108110 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c48ff00d-99d2-4ee5-9dcf-a6a54ee8abcd tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1723 microversion: 2.1 time: 0.160113 Aug 31 16:55:45.108781 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3701/7222] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:55:44 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:55:46.135455 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-95aec064-4151-4f95-9044-f35598d0a152 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:55:46.136375 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-95aec064-4151-4f95-9044-f35598d0a152 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:55:46.145411 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95aec064-4151-4f95-9044-f35598d0a152 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:46.145903 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95aec064-4151-4f95-9044-f35598d0a152 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:46.146362 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95aec064-4151-4f95-9044-f35598d0a152 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:46.147060 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95aec064-4151-4f95-9044-f35598d0a152 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:46.147508 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95aec064-4151-4f95-9044-f35598d0a152 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:46.147925 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95aec064-4151-4f95-9044-f35598d0a152 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:46.290056 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-95aec064-4151-4f95-9044-f35598d0a152 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:55:46.299270 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-95aec064-4151-4f95-9044-f35598d0a152 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1723 microversion: 2.1 time: 0.171952 Aug 31 16:55:46.299945 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3522/7223] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:55:46 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:55:46.450689 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-67fa0e1e-5e26-4102-be0b-1ce4ce24cc5f req-31d580cd-67bb-422c-98f1-ec4c90d837a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d7ff3bf-dc43-421d-93af-9b10866f869c", "tag": "0b969e4e-9a6d-426d-a9fe-bdbee00916af"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:55:46.461697 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-67fa0e1e-5e26-4102-be0b-1ce4ce24cc5f req-31d580cd-67bb-422c-98f1-ec4c90d837a2 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:46.462216 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-67fa0e1e-5e26-4102-be0b-1ce4ce24cc5f req-31d580cd-67bb-422c-98f1-ec4c90d837a2 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:46.462687 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-67fa0e1e-5e26-4102-be0b-1ce4ce24cc5f req-31d580cd-67bb-422c-98f1-ec4c90d837a2 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:46.475718 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-67fa0e1e-5e26-4102-be0b-1ce4ce24cc5f req-31d580cd-67bb-422c-98f1-ec4c90d837a2 service nova] Creating event network-changed:0b969e4e-9a6d-426d-a9fe-bdbee00916af for instance 6d7ff3bf-dc43-421d-93af-9b10866f869c on n-h2-833090-16 Aug 31 16:55:46.481770 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [req-67fa0e1e-5e26-4102-be0b-1ce4ce24cc5f req-31d580cd-67bb-422c-98f1-ec4c90d837a2 service nova] Instance 6d7ff3bf-dc43-421d-93af-9b10866f869c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-833090-16', 'n-h1-833090-16'} {{(pid=128864) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 16:55:46.493320 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-67fa0e1e-5e26-4102-be0b-1ce4ce24cc5f req-31d580cd-67bb-422c-98f1-ec4c90d837a2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046383 Aug 31 16:55:46.493960 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3702/7224] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:55:47.321967 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ba2e796c-ef64-4c5c-bec4-d60fff41a619 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:55:47.322823 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ba2e796c-ef64-4c5c-bec4-d60fff41a619 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:55:47.331983 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba2e796c-ef64-4c5c-bec4-d60fff41a619 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:47.332784 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba2e796c-ef64-4c5c-bec4-d60fff41a619 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:47.333351 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba2e796c-ef64-4c5c-bec4-d60fff41a619 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:47.334173 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba2e796c-ef64-4c5c-bec4-d60fff41a619 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:47.334759 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba2e796c-ef64-4c5c-bec4-d60fff41a619 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:47.335284 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ba2e796c-ef64-4c5c-bec4-d60fff41a619 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:47.484744 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ba2e796c-ef64-4c5c-bec4-d60fff41a619 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:55:47.494785 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ba2e796c-ef64-4c5c-bec4-d60fff41a619 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1723 microversion: 2.1 time: 0.177156 Aug 31 16:55:47.503013 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3523/7225] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:55:47 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:55:48.518919 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d52f0b61-d5cc-442d-ac43-e526042faa83 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:55:48.519346 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d52f0b61-d5cc-442d-ac43-e526042faa83 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:55:48.525764 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d52f0b61-d5cc-442d-ac43-e526042faa83 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:48.526303 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d52f0b61-d5cc-442d-ac43-e526042faa83 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:48.526746 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d52f0b61-d5cc-442d-ac43-e526042faa83 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:48.527475 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d52f0b61-d5cc-442d-ac43-e526042faa83 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:48.527931 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d52f0b61-d5cc-442d-ac43-e526042faa83 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:48.528371 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d52f0b61-d5cc-442d-ac43-e526042faa83 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:48.670291 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d52f0b61-d5cc-442d-ac43-e526042faa83 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:55:48.679220 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d52f0b61-d5cc-442d-ac43-e526042faa83 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1723 microversion: 2.1 time: 0.166189 Aug 31 16:55:48.679790 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3703/7226] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:55:48 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:55:49.701456 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a5ec2461-1d58-4132-b3c8-a1f9fc6679d4 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:55:49.702082 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a5ec2461-1d58-4132-b3c8-a1f9fc6679d4 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:55:49.709696 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5ec2461-1d58-4132-b3c8-a1f9fc6679d4 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:49.710218 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5ec2461-1d58-4132-b3c8-a1f9fc6679d4 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:49.710668 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5ec2461-1d58-4132-b3c8-a1f9fc6679d4 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:49.711359 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5ec2461-1d58-4132-b3c8-a1f9fc6679d4 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:49.711812 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5ec2461-1d58-4132-b3c8-a1f9fc6679d4 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:49.712233 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a5ec2461-1d58-4132-b3c8-a1f9fc6679d4 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:49.853088 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a5ec2461-1d58-4132-b3c8-a1f9fc6679d4 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:55:49.863115 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a5ec2461-1d58-4132-b3c8-a1f9fc6679d4 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1723 microversion: 2.1 time: 0.165825 Aug 31 16:55:49.863744 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3524/7227] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:55:49 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:55:50.885777 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1961274d-047b-4c5e-8956-9a41babbeb99 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:55:50.886423 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1961274d-047b-4c5e-8956-9a41babbeb99 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:55:50.888557 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=3 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:55:50.895502 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1961274d-047b-4c5e-8956-9a41babbeb99 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:50.895999 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1961274d-047b-4c5e-8956-9a41babbeb99 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:50.896442 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1961274d-047b-4c5e-8956-9a41babbeb99 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:50.897155 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1961274d-047b-4c5e-8956-9a41babbeb99 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:50.897612 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1961274d-047b-4c5e-8956-9a41babbeb99 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:50.898037 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1961274d-047b-4c5e-8956-9a41babbeb99 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:51.047681 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1961274d-047b-4c5e-8956-9a41babbeb99 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:55:51.057042 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1961274d-047b-4c5e-8956-9a41babbeb99 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1723 microversion: 2.1 time: 0.175813 Aug 31 16:55:51.057695 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3704/7228] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:55:50 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:55:52.080123 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3442074c-8bde-45a8-9fa7-b42f999d8e0d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:55:52.080716 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3442074c-8bde-45a8-9fa7-b42f999d8e0d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:55:52.090119 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3442074c-8bde-45a8-9fa7-b42f999d8e0d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:52.090612 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3442074c-8bde-45a8-9fa7-b42f999d8e0d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:52.091050 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3442074c-8bde-45a8-9fa7-b42f999d8e0d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:52.091780 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3442074c-8bde-45a8-9fa7-b42f999d8e0d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:52.092216 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3442074c-8bde-45a8-9fa7-b42f999d8e0d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:52.092638 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3442074c-8bde-45a8-9fa7-b42f999d8e0d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:52.249505 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3442074c-8bde-45a8-9fa7-b42f999d8e0d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:55:52.258471 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3442074c-8bde-45a8-9fa7-b42f999d8e0d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1723 microversion: 2.1 time: 0.182547 Aug 31 16:55:52.259048 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3525/7229] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:55:52 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:55:53.281532 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7ba1b085-3ccd-4de5-bf9f-bf20cdcc4ef7 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:55:53.282351 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7ba1b085-3ccd-4de5-bf9f-bf20cdcc4ef7 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:55:53.290924 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ba1b085-3ccd-4de5-bf9f-bf20cdcc4ef7 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:53.291427 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ba1b085-3ccd-4de5-bf9f-bf20cdcc4ef7 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:53.291875 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ba1b085-3ccd-4de5-bf9f-bf20cdcc4ef7 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:53.292586 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ba1b085-3ccd-4de5-bf9f-bf20cdcc4ef7 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:53.293026 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ba1b085-3ccd-4de5-bf9f-bf20cdcc4ef7 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:53.293495 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ba1b085-3ccd-4de5-bf9f-bf20cdcc4ef7 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:53.442630 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7ba1b085-3ccd-4de5-bf9f-bf20cdcc4ef7 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:55:53.451414 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7ba1b085-3ccd-4de5-bf9f-bf20cdcc4ef7 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1723 microversion: 2.1 time: 0.174922 Aug 31 16:55:53.451972 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3705/7230] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:55:53 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:55:54.475001 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a7c54112-ebc7-4412-bd73-f541da7f620a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:55:54.476058 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a7c54112-ebc7-4412-bd73-f541da7f620a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:55:54.484836 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a7c54112-ebc7-4412-bd73-f541da7f620a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:54.485446 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a7c54112-ebc7-4412-bd73-f541da7f620a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:54.485886 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a7c54112-ebc7-4412-bd73-f541da7f620a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:54.486781 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a7c54112-ebc7-4412-bd73-f541da7f620a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:54.487312 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a7c54112-ebc7-4412-bd73-f541da7f620a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:54.487805 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a7c54112-ebc7-4412-bd73-f541da7f620a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:54.638440 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a7c54112-ebc7-4412-bd73-f541da7f620a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:55:54.647378 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a7c54112-ebc7-4412-bd73-f541da7f620a tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1723 microversion: 2.1 time: 0.177602 Aug 31 16:55:54.647996 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3526/7231] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:55:54 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:55:55.669840 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-bb192a71-f048-45f7-873b-a1e0fe1cd2ac tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:55:55.670447 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-bb192a71-f048-45f7-873b-a1e0fe1cd2ac tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:55:55.678219 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bb192a71-f048-45f7-873b-a1e0fe1cd2ac tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:55.678736 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bb192a71-f048-45f7-873b-a1e0fe1cd2ac tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:55.679204 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bb192a71-f048-45f7-873b-a1e0fe1cd2ac tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:55.679912 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bb192a71-f048-45f7-873b-a1e0fe1cd2ac tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:55.680373 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bb192a71-f048-45f7-873b-a1e0fe1cd2ac tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:55.681167 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bb192a71-f048-45f7-873b-a1e0fe1cd2ac tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:55.828266 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-bb192a71-f048-45f7-873b-a1e0fe1cd2ac tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:55:55.840757 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-bb192a71-f048-45f7-873b-a1e0fe1cd2ac tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1723 microversion: 2.1 time: 0.175052 Aug 31 16:55:55.841543 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3706/7232] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:55:55 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:55:56.868133 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-035c78b8-e345-4f43-bd8f-db110844c0ea tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:55:56.868750 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-035c78b8-e345-4f43-bd8f-db110844c0ea tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:55:56.876324 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-035c78b8-e345-4f43-bd8f-db110844c0ea tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:56.876815 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-035c78b8-e345-4f43-bd8f-db110844c0ea tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:56.877246 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-035c78b8-e345-4f43-bd8f-db110844c0ea tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:56.877945 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-035c78b8-e345-4f43-bd8f-db110844c0ea tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:56.878482 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-035c78b8-e345-4f43-bd8f-db110844c0ea tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:56.878851 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-035c78b8-e345-4f43-bd8f-db110844c0ea tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:57.028725 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-035c78b8-e345-4f43-bd8f-db110844c0ea tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:55:57.041876 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-035c78b8-e345-4f43-bd8f-db110844c0ea tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1723 microversion: 2.1 time: 0.178917 Aug 31 16:55:57.042493 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3527/7233] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:55:56 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:55:58.067089 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-76a04be6-f0d2-42ed-a59f-b2a208996e20 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:55:58.068094 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-76a04be6-f0d2-42ed-a59f-b2a208996e20 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:55:58.075948 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76a04be6-f0d2-42ed-a59f-b2a208996e20 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:58.076443 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76a04be6-f0d2-42ed-a59f-b2a208996e20 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:58.076894 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76a04be6-f0d2-42ed-a59f-b2a208996e20 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:58.077598 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76a04be6-f0d2-42ed-a59f-b2a208996e20 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:58.078066 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76a04be6-f0d2-42ed-a59f-b2a208996e20 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:58.078537 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76a04be6-f0d2-42ed-a59f-b2a208996e20 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:58.222411 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-76a04be6-f0d2-42ed-a59f-b2a208996e20 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:55:58.236280 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-76a04be6-f0d2-42ed-a59f-b2a208996e20 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1723 microversion: 2.1 time: 0.175210 Aug 31 16:55:58.237210 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3707/7234] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:55:58 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:55:59.260209 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ef19d5bf-bac7-4448-b885-810f4b539306 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:55:59.260901 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ef19d5bf-bac7-4448-b885-810f4b539306 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:55:59.268402 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef19d5bf-bac7-4448-b885-810f4b539306 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:59.268894 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef19d5bf-bac7-4448-b885-810f4b539306 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:59.269298 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef19d5bf-bac7-4448-b885-810f4b539306 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:59.269999 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef19d5bf-bac7-4448-b885-810f4b539306 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:59.270582 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef19d5bf-bac7-4448-b885-810f4b539306 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:59.270966 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ef19d5bf-bac7-4448-b885-810f4b539306 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:59.412065 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ef19d5bf-bac7-4448-b885-810f4b539306 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:55:59.421349 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ef19d5bf-bac7-4448-b885-810f4b539306 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1716 microversion: 2.1 time: 0.165561 Aug 31 16:55:59.421895 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3528/7235] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:55:59 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1716 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:55:59.449742 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1fa59b3c-8462-4f91-ab2a-38a2d3be378e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:55:59.450402 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1fa59b3c-8462-4f91-ab2a-38a2d3be378e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:55:59.458037 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1fa59b3c-8462-4f91-ab2a-38a2d3be378e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:59.458562 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1fa59b3c-8462-4f91-ab2a-38a2d3be378e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:59.459014 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1fa59b3c-8462-4f91-ab2a-38a2d3be378e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:59.459722 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1fa59b3c-8462-4f91-ab2a-38a2d3be378e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:59.460163 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1fa59b3c-8462-4f91-ab2a-38a2d3be378e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:59.460974 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1fa59b3c-8462-4f91-ab2a-38a2d3be378e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:59.610635 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1fa59b3c-8462-4f91-ab2a-38a2d3be378e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:55:59.619600 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1fa59b3c-8462-4f91-ab2a-38a2d3be378e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1716 microversion: 2.1 time: 0.173795 Aug 31 16:55:59.620191 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3708/7236] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:55:59 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1716 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:55:59.640955 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-eedbd774-2091-4d11-90e7-2f372d8a6708 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:55:59.641595 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-eedbd774-2091-4d11-90e7-2f372d8a6708 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:55:59.648138 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eedbd774-2091-4d11-90e7-2f372d8a6708 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:59.648730 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eedbd774-2091-4d11-90e7-2f372d8a6708 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:59.649158 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eedbd774-2091-4d11-90e7-2f372d8a6708 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:59.649852 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eedbd774-2091-4d11-90e7-2f372d8a6708 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:59.650642 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eedbd774-2091-4d11-90e7-2f372d8a6708 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:59.651070 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eedbd774-2091-4d11-90e7-2f372d8a6708 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:59.793890 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-eedbd774-2091-4d11-90e7-2f372d8a6708 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:55:59.802713 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-eedbd774-2091-4d11-90e7-2f372d8a6708 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1716 microversion: 2.1 time: 0.165825 Aug 31 16:55:59.803273 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3529/7237] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:55:59 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1716 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:55:59.823597 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-225bcb83-7c0d-461e-9978-b8a8e4b3fe0b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:55:59.824105 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-225bcb83-7c0d-461e-9978-b8a8e4b3fe0b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:55:59.830618 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-225bcb83-7c0d-461e-9978-b8a8e4b3fe0b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:59.831112 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-225bcb83-7c0d-461e-9978-b8a8e4b3fe0b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:59.831554 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-225bcb83-7c0d-461e-9978-b8a8e4b3fe0b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:59.832250 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-225bcb83-7c0d-461e-9978-b8a8e4b3fe0b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:59.832709 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-225bcb83-7c0d-461e-9978-b8a8e4b3fe0b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:59.833141 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-225bcb83-7c0d-461e-9978-b8a8e4b3fe0b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:59.867250 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-225bcb83-7c0d-461e-9978-b8a8e4b3fe0b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:55:59.923299 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:55:59.968152 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-225bcb83-7c0d-461e-9978-b8a8e4b3fe0b tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "DELETE /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 204 len: 0 microversion: 2.1 time: 0.148323 Aug 31 16:55:59.968954 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3709/7238] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:55:59 2022] DELETE /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:55:59.979621 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1ed6bc23-e743-46a4-8c93-178e81cbbddb tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:55:59.980179 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1ed6bc23-e743-46a4-8c93-178e81cbbddb tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:55:59.986416 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ed6bc23-e743-46a4-8c93-178e81cbbddb tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:59.986910 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ed6bc23-e743-46a4-8c93-178e81cbbddb tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:59.987348 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ed6bc23-e743-46a4-8c93-178e81cbbddb tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:55:59.988044 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ed6bc23-e743-46a4-8c93-178e81cbbddb tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:55:59.988509 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ed6bc23-e743-46a4-8c93-178e81cbbddb tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:55:59.988937 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1ed6bc23-e743-46a4-8c93-178e81cbbddb tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:00.149061 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1ed6bc23-e743-46a4-8c93-178e81cbbddb tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:00.160114 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1ed6bc23-e743-46a4-8c93-178e81cbbddb tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1722 microversion: 2.1 time: 0.185380 Aug 31 16:56:00.160710 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3530/7239] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:55:59 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:01.186719 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6ae3fde5-8554-4b82-b856-d1992c873b5e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:01.187443 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6ae3fde5-8554-4b82-b856-d1992c873b5e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:01.195333 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6ae3fde5-8554-4b82-b856-d1992c873b5e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:01.195671 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6ae3fde5-8554-4b82-b856-d1992c873b5e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:01.196096 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6ae3fde5-8554-4b82-b856-d1992c873b5e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:01.196795 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6ae3fde5-8554-4b82-b856-d1992c873b5e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:01.197263 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6ae3fde5-8554-4b82-b856-d1992c873b5e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:01.197699 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6ae3fde5-8554-4b82-b856-d1992c873b5e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:01.338827 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6ae3fde5-8554-4b82-b856-d1992c873b5e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:01.347718 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6ae3fde5-8554-4b82-b856-d1992c873b5e tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1722 microversion: 2.1 time: 0.165555 Aug 31 16:56:01.348300 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3710/7240] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:01 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:02.369809 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b40cc095-f10e-43db-a92d-c6c99f9b986c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:02.370562 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b40cc095-f10e-43db-a92d-c6c99f9b986c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:02.378274 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b40cc095-f10e-43db-a92d-c6c99f9b986c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:02.378846 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b40cc095-f10e-43db-a92d-c6c99f9b986c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:02.379275 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b40cc095-f10e-43db-a92d-c6c99f9b986c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:02.379975 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b40cc095-f10e-43db-a92d-c6c99f9b986c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:02.380419 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b40cc095-f10e-43db-a92d-c6c99f9b986c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:02.380849 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b40cc095-f10e-43db-a92d-c6c99f9b986c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:02.518513 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b40cc095-f10e-43db-a92d-c6c99f9b986c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:02.527446 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b40cc095-f10e-43db-a92d-c6c99f9b986c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1722 microversion: 2.1 time: 0.161897 Aug 31 16:56:02.528043 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3531/7241] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:02 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:02.846229 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-d892b239-4378-4b8d-8851-e4398ffa184c req-64016944-7fd5-4668-9752-08638a6e0e8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d7ff3bf-dc43-421d-93af-9b10866f869c", "name": "network-vif-deleted", "tag": "0b969e4e-9a6d-426d-a9fe-bdbee00916af"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:56:02.856918 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-d892b239-4378-4b8d-8851-e4398ffa184c req-64016944-7fd5-4668-9752-08638a6e0e8d service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:02.857421 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-d892b239-4378-4b8d-8851-e4398ffa184c req-64016944-7fd5-4668-9752-08638a6e0e8d service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:02.857824 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-d892b239-4378-4b8d-8851-e4398ffa184c req-64016944-7fd5-4668-9752-08638a6e0e8d service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:02.876788 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-d892b239-4378-4b8d-8851-e4398ffa184c req-64016944-7fd5-4668-9752-08638a6e0e8d service nova] Creating event network-vif-deleted:0b969e4e-9a6d-426d-a9fe-bdbee00916af for instance 6d7ff3bf-dc43-421d-93af-9b10866f869c on n-h2-833090-16 Aug 31 16:56:02.882264 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-d892b239-4378-4b8d-8851-e4398ffa184c req-64016944-7fd5-4668-9752-08638a6e0e8d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039615 Aug 31 16:56:02.882919 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3711/7242] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:56:03.549228 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-abb4ace2-0b93-443b-a069-924d905f9256 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:03.549853 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-abb4ace2-0b93-443b-a069-924d905f9256 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:03.562815 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-abb4ace2-0b93-443b-a069-924d905f9256 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:03.563314 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-abb4ace2-0b93-443b-a069-924d905f9256 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:03.563762 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-abb4ace2-0b93-443b-a069-924d905f9256 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:03.564462 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-abb4ace2-0b93-443b-a069-924d905f9256 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:03.564985 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-abb4ace2-0b93-443b-a069-924d905f9256 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:03.565409 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-abb4ace2-0b93-443b-a069-924d905f9256 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:03.637905 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-abb4ace2-0b93-443b-a069-924d905f9256 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:03.647172 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-abb4ace2-0b93-443b-a069-924d905f9256 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1369 microversion: 2.1 time: 0.101865 Aug 31 16:56:03.648414 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3532/7243] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:03 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1369 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:04.670611 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4fdb29c2-387a-4039-bfcf-851e7b3c288c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:04.671366 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4fdb29c2-387a-4039-bfcf-851e7b3c288c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:04.678461 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4fdb29c2-387a-4039-bfcf-851e7b3c288c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:04.678959 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4fdb29c2-387a-4039-bfcf-851e7b3c288c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:04.679543 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4fdb29c2-387a-4039-bfcf-851e7b3c288c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:04.680383 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4fdb29c2-387a-4039-bfcf-851e7b3c288c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:04.680866 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4fdb29c2-387a-4039-bfcf-851e7b3c288c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:04.681674 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4fdb29c2-387a-4039-bfcf-851e7b3c288c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:04.750833 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4fdb29c2-387a-4039-bfcf-851e7b3c288c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:04.760450 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4fdb29c2-387a-4039-bfcf-851e7b3c288c tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1369 microversion: 2.1 time: 0.095090 Aug 31 16:56:04.761057 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3712/7244] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:04 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:56:05.782830 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-eb03af7c-b010-49b7-91b8-fa2c4e4132ad tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:05.783702 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-eb03af7c-b010-49b7-91b8-fa2c4e4132ad tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:05.792895 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb03af7c-b010-49b7-91b8-fa2c4e4132ad tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:05.793645 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb03af7c-b010-49b7-91b8-fa2c4e4132ad tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:05.793797 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb03af7c-b010-49b7-91b8-fa2c4e4132ad tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:05.794632 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb03af7c-b010-49b7-91b8-fa2c4e4132ad tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:05.795085 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb03af7c-b010-49b7-91b8-fa2c4e4132ad tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:05.795507 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-eb03af7c-b010-49b7-91b8-fa2c4e4132ad tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:05.862604 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-eb03af7c-b010-49b7-91b8-fa2c4e4132ad tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:05.871576 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-eb03af7c-b010-49b7-91b8-fa2c4e4132ad tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1369 microversion: 2.1 time: 0.093272 Aug 31 16:56:05.872166 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3533/7245] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:05 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:06.893282 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-da40ac7c-f243-4ed5-82c0-7cbba44972a2 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:06.893903 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-da40ac7c-f243-4ed5-82c0-7cbba44972a2 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:06.904408 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-da40ac7c-f243-4ed5-82c0-7cbba44972a2 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:06.905098 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-da40ac7c-f243-4ed5-82c0-7cbba44972a2 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:06.905767 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-da40ac7c-f243-4ed5-82c0-7cbba44972a2 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:06.906995 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-da40ac7c-f243-4ed5-82c0-7cbba44972a2 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:06.907755 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-da40ac7c-f243-4ed5-82c0-7cbba44972a2 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:06.908447 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-da40ac7c-f243-4ed5-82c0-7cbba44972a2 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:06.977141 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-da40ac7c-f243-4ed5-82c0-7cbba44972a2 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689ff4da0acb4aafa5f44d42e68ab41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce77c4128d3448885217ac4d4744765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:06.986356 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-da40ac7c-f243-4ed5-82c0-7cbba44972a2 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 200 len: 1369 microversion: 2.1 time: 0.096940 Aug 31 16:56:06.986984 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3713/7246] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:06 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:08.009608 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b23ef3b7-b3b4-4ba6-a4d5-09f483425d62 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:08.010263 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b23ef3b7-b3b4-4ba6-a4d5-09f483425d62 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:08.018126 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b23ef3b7-b3b4-4ba6-a4d5-09f483425d62 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:08.018607 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b23ef3b7-b3b4-4ba6-a4d5-09f483425d62 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:08.019037 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b23ef3b7-b3b4-4ba6-a4d5-09f483425d62 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:08.019724 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b23ef3b7-b3b4-4ba6-a4d5-09f483425d62 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:08.020176 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b23ef3b7-b3b4-4ba6-a4d5-09f483425d62 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:08.020592 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b23ef3b7-b3b4-4ba6-a4d5-09f483425d62 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:08.035186 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-b23ef3b7-b3b4-4ba6-a4d5-09f483425d62 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] HTTP exception thrown: Instance 6d7ff3bf-dc43-421d-93af-9b10866f869c could not be found. Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b23ef3b7-b3b4-4ba6-a4d5-09f483425d62 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Request method failure captured: Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c HTTP/1.1 Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD5C9uAz-t5mh-r3mUMMlr2wQd9RJYBAKDGT0KvPrLTihjtZPy6-09_bJTMDpSB88huaVHBLxwU79aGS9Ig9M6XEadSxV6dHNvqYvU2MaYuMgncb9fl7PDdbiMU9wj6m6OmrQoGoaSgGYVEfgnnlWHC-gb6kVlFh35PHiKS5x0RNERSU Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: fce77c4128d3448885217ac4d4744765 Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerActionsTestJSON-1850065935 Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fce77c4128d3448885217ac4d4744765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fce77c4128d3448885217ac4d4744765"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/fce77c4128d3448885217ac4d4744765"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_fce77c4128d3448885217ac4d4744765", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServerActionsTestJSON-1850065935 Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: fce77c4128d3448885217ac4d4744765 Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerActionsTestJSON-1850065935 Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServerActionsTestJSON-1850065935-project Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 689ff4da0acb4aafa5f44d42e68ab41d Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServerActionsTestJSON-1850065935-project Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 6d7ff3bf-dc43-421d-93af-9b10866f869c could not be found. Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '6d7ff3bf-dc43-421d-93af-9b10866f869c'} Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d7ff3bf-dc43-421d-93af-9b10866f869c could not be found. Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d7ff3bf-dc43-421d-93af-9b10866f869c could not be found. Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:56:08.036843 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:56:08.041464 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:56:08.041464 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:56:08.041464 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:56:08.041464 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:56:08.041464 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:56:08.041464 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d7ff3bf-dc43-421d-93af-9b10866f869c could not be found. Aug 31 16:56:08.041464 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:56:08.041464 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b23ef3b7-b3b4-4ba6-a4d5-09f483425d62 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Returning 404 to user: Instance 6d7ff3bf-dc43-421d-93af-9b10866f869c could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:56:08.041464 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b23ef3b7-b3b4-4ba6-a4d5-09f483425d62 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 404 len: 111 microversion: 2.1 time: 0.032922 Aug 31 16:56:08.041464 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3534/7247] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:08 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:56:08.116031 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1c0b5ad5-c798-44ba-b741-847183df9b45 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:08.119073 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1c0b5ad5-c798-44ba-b741-847183df9b45 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:08.126418 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1c0b5ad5-c798-44ba-b741-847183df9b45 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:08.126919 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1c0b5ad5-c798-44ba-b741-847183df9b45 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:08.127368 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1c0b5ad5-c798-44ba-b741-847183df9b45 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:08.128081 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1c0b5ad5-c798-44ba-b741-847183df9b45 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:08.128544 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1c0b5ad5-c798-44ba-b741-847183df9b45 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:08.128977 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1c0b5ad5-c798-44ba-b741-847183df9b45 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:08.142600 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-1c0b5ad5-c798-44ba-b741-847183df9b45 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] HTTP exception thrown: Instance 6d7ff3bf-dc43-421d-93af-9b10866f869c could not be found. Aug 31 16:56:08.144340 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1c0b5ad5-c798-44ba-b741-847183df9b45 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Request method failure captured: Aug 31 16:56:08.144340 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c/os-volume_attachments HTTP/1.1 Aug 31 16:56:08.144340 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:56:08.144340 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:56:08.144340 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:56:08.144340 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:56:08.144340 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:56:08.144340 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:56:08.144340 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:56:08.144340 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:56:08.144340 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD5C9uAz-t5mh-r3mUMMlr2wQd9RJYBAKDGT0KvPrLTihjtZPy6-09_bJTMDpSB88huaVHBLxwU79aGS9Ig9M6XEadSxV6dHNvqYvU2MaYuMgncb9fl7PDdbiMU9wj6m6OmrQoGoaSgGYVEfgnnlWHC-gb6kVlFh35PHiKS5x0RNERSU Aug 31 16:56:08.144340 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:56:08.144340 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:56:08.144340 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:56:08.144340 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:56:08.144340 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:56:08.144340 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:56:08.144340 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: fce77c4128d3448885217ac4d4744765 Aug 31 16:56:08.144340 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServerActionsTestJSON-1850065935 Aug 31 16:56:08.144340 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:56:08.144340 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:56:08.144340 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fce77c4128d3448885217ac4d4744765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fce77c4128d3448885217ac4d4744765"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/fce77c4128d3448885217ac4d4744765"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_fce77c4128d3448885217ac4d4744765", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:56:08.144340 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServerActionsTestJSON-1850065935 Aug 31 16:56:08.144340 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: fce77c4128d3448885217ac4d4744765 Aug 31 16:56:08.144340 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServerActionsTestJSON-1850065935 Aug 31 16:56:08.144340 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServerActionsTestJSON-1850065935-project Aug 31 16:56:08.144340 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:56:08.144340 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:56:08.144340 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 689ff4da0acb4aafa5f44d42e68ab41d Aug 31 16:56:08.144340 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServerActionsTestJSON-1850065935-project Aug 31 16:56:08.144340 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:56:08.144340 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 6d7ff3bf-dc43-421d-93af-9b10866f869c could not be found. Aug 31 16:56:08.144340 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'server_id': '6d7ff3bf-dc43-421d-93af-9b10866f869c'} Aug 31 16:56:08.144340 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:56:08.144340 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:56:08.144340 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:56:08.144340 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:56:08.144340 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:56:08.144340 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:56:08.144340 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:56:08.144340 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:56:08.144340 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:56:08.144340 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:56:08.144340 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d7ff3bf-dc43-421d-93af-9b10866f869c could not be found. Aug 31 16:56:08.144340 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:56:08.144340 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:56:08.144340 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:56:08.144340 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:56:08.144340 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:56:08.144340 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:56:08.144340 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:56:08.144340 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:56:08.144340 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:56:08.144340 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:56:08.144340 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 16:56:08.144340 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:56:08.144340 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 31 16:56:08.144340 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:56:08.144340 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 31 16:56:08.144340 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 31 16:56:08.144340 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:56:08.144340 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:56:08.149273 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d7ff3bf-dc43-421d-93af-9b10866f869c could not be found. Aug 31 16:56:08.149273 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:56:08.149273 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:56:08.149273 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:56:08.149273 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:56:08.149273 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:56:08.149273 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:56:08.149273 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:56:08.149273 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:56:08.149273 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d7ff3bf-dc43-421d-93af-9b10866f869c could not be found. Aug 31 16:56:08.149273 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:56:08.149273 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1c0b5ad5-c798-44ba-b741-847183df9b45 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Returning 404 to user: Instance 6d7ff3bf-dc43-421d-93af-9b10866f869c could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:56:08.149273 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1c0b5ad5-c798-44ba-b741-847183df9b45 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036861 Aug 31 16:56:08.149273 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3714/7248] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:56:08 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c/os-volume_attachments => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:56:11.485426 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9184ad27-c6ce-4888-8df3-61f41bcb3eed tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:11.485958 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9184ad27-c6ce-4888-8df3-61f41bcb3eed tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:11.489172 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=36 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:56:11.495408 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9184ad27-c6ce-4888-8df3-61f41bcb3eed tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:11.495900 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9184ad27-c6ce-4888-8df3-61f41bcb3eed tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:11.496338 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9184ad27-c6ce-4888-8df3-61f41bcb3eed tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:11.497045 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9184ad27-c6ce-4888-8df3-61f41bcb3eed tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:11.497629 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9184ad27-c6ce-4888-8df3-61f41bcb3eed tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:11.498049 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9184ad27-c6ce-4888-8df3-61f41bcb3eed tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:11.500901 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:56:11.514063 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-9184ad27-c6ce-4888-8df3-61f41bcb3eed tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] HTTP exception thrown: Instance 6d7ff3bf-dc43-421d-93af-9b10866f869c could not be found. Aug 31 16:56:11.515668 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9184ad27-c6ce-4888-8df3-61f41bcb3eed tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Request method failure captured: Aug 31 16:56:11.515668 n-d-833090-16 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c HTTP/1.1 Aug 31 16:56:11.515668 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:56:11.515668 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:56:11.515668 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:56:11.515668 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:56:11.515668 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:56:11.515668 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:56:11.515668 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:56:11.515668 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:56:11.515668 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD5C9uAz-t5mh-r3mUMMlr2wQd9RJYBAKDGT0KvPrLTihjtZPy6-09_bJTMDpSB88huaVHBLxwU79aGS9Ig9M6XEadSxV6dHNvqYvU2MaYuMgncb9fl7PDdbiMU9wj6m6OmrQoGoaSgGYVEfgnnlWHC-gb6kVlFh35PHiKS5x0RNERSU Aug 31 16:56:11.515668 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:56:11.515668 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:56:11.515668 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:56:11.515668 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:56:11.515668 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:56:11.515668 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:56:11.515668 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: fce77c4128d3448885217ac4d4744765 Aug 31 16:56:11.515668 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerActionsTestJSON-1850065935 Aug 31 16:56:11.515668 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:56:11.515668 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:56:11.515668 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fce77c4128d3448885217ac4d4744765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fce77c4128d3448885217ac4d4744765"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/fce77c4128d3448885217ac4d4744765"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_fce77c4128d3448885217ac4d4744765", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:56:11.515668 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServerActionsTestJSON-1850065935 Aug 31 16:56:11.515668 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: fce77c4128d3448885217ac4d4744765 Aug 31 16:56:11.515668 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerActionsTestJSON-1850065935 Aug 31 16:56:11.515668 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServerActionsTestJSON-1850065935-project Aug 31 16:56:11.515668 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:56:11.515668 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:56:11.515668 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 689ff4da0acb4aafa5f44d42e68ab41d Aug 31 16:56:11.515668 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServerActionsTestJSON-1850065935-project Aug 31 16:56:11.515668 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:56:11.515668 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 6d7ff3bf-dc43-421d-93af-9b10866f869c could not be found. Aug 31 16:56:11.515668 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '6d7ff3bf-dc43-421d-93af-9b10866f869c'} Aug 31 16:56:11.515668 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:56:11.515668 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:56:11.515668 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:56:11.515668 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:56:11.515668 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:56:11.515668 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:56:11.515668 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:56:11.515668 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:56:11.515668 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:56:11.515668 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:56:11.515668 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d7ff3bf-dc43-421d-93af-9b10866f869c could not be found. Aug 31 16:56:11.515668 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:56:11.515668 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:56:11.515668 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:56:11.515668 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:56:11.515668 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:56:11.515668 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:56:11.515668 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:56:11.515668 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:56:11.515668 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:56:11.515668 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:56:11.515668 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:56:11.515668 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:56:11.515668 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:56:11.515668 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:56:11.515668 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:56:11.515668 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:56:11.515668 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:56:11.515668 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:56:11.519758 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d7ff3bf-dc43-421d-93af-9b10866f869c could not be found. Aug 31 16:56:11.519758 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:56:11.519758 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:56:11.519758 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:56:11.519758 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:56:11.519758 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:56:11.519758 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:56:11.519758 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:56:11.519758 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:56:11.519758 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d7ff3bf-dc43-421d-93af-9b10866f869c could not be found. Aug 31 16:56:11.519758 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:56:11.519758 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9184ad27-c6ce-4888-8df3-61f41bcb3eed tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Returning 404 to user: Instance 6d7ff3bf-dc43-421d-93af-9b10866f869c could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:56:11.519758 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9184ad27-c6ce-4888-8df3-61f41bcb3eed tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "DELETE /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 404 len: 111 microversion: 2.1 time: 0.035721 Aug 31 16:56:11.519758 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3535/7249] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:56:11 2022] DELETE /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:56:11.526728 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a789d519-ede9-400d-b61f-ed73103f0bcb tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:11.527444 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a789d519-ede9-400d-b61f-ed73103f0bcb tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 6d7ff3bf-dc43-421d-93af-9b10866f869c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:11.530889 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:56:11.536370 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a789d519-ede9-400d-b61f-ed73103f0bcb tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:11.536867 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a789d519-ede9-400d-b61f-ed73103f0bcb tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:11.537311 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a789d519-ede9-400d-b61f-ed73103f0bcb tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:11.538019 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a789d519-ede9-400d-b61f-ed73103f0bcb tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:11.538588 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a789d519-ede9-400d-b61f-ed73103f0bcb tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:11.539022 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a789d519-ede9-400d-b61f-ed73103f0bcb tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:11.554338 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-a789d519-ede9-400d-b61f-ed73103f0bcb tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] HTTP exception thrown: Instance 6d7ff3bf-dc43-421d-93af-9b10866f869c could not be found. Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a789d519-ede9-400d-b61f-ed73103f0bcb tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Request method failure captured: Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c HTTP/1.1 Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD5C9uAz-t5mh-r3mUMMlr2wQd9RJYBAKDGT0KvPrLTihjtZPy6-09_bJTMDpSB88huaVHBLxwU79aGS9Ig9M6XEadSxV6dHNvqYvU2MaYuMgncb9fl7PDdbiMU9wj6m6OmrQoGoaSgGYVEfgnnlWHC-gb6kVlFh35PHiKS5x0RNERSU Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: fce77c4128d3448885217ac4d4744765 Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServerActionsTestJSON-1850065935 Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fce77c4128d3448885217ac4d4744765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fce77c4128d3448885217ac4d4744765"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/fce77c4128d3448885217ac4d4744765"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_fce77c4128d3448885217ac4d4744765", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServerActionsTestJSON-1850065935 Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: fce77c4128d3448885217ac4d4744765 Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServerActionsTestJSON-1850065935 Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServerActionsTestJSON-1850065935-project Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 689ff4da0acb4aafa5f44d42e68ab41d Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServerActionsTestJSON-1850065935-project Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 6d7ff3bf-dc43-421d-93af-9b10866f869c could not be found. Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '6d7ff3bf-dc43-421d-93af-9b10866f869c'} Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d7ff3bf-dc43-421d-93af-9b10866f869c could not be found. Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d7ff3bf-dc43-421d-93af-9b10866f869c could not be found. Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:56:11.556455 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:56:11.564966 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:56:11.564966 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:56:11.564966 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:56:11.564966 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:56:11.564966 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:56:11.564966 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d7ff3bf-dc43-421d-93af-9b10866f869c could not be found. Aug 31 16:56:11.564966 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:56:11.564966 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a789d519-ede9-400d-b61f-ed73103f0bcb tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Returning 404 to user: Instance 6d7ff3bf-dc43-421d-93af-9b10866f869c could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:56:11.564966 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a789d519-ede9-400d-b61f-ed73103f0bcb tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c" status: 404 len: 111 microversion: 2.1 time: 0.035901 Aug 31 16:56:11.564966 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3715/7250] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:11 2022] GET /compute/v2.1/servers/6d7ff3bf-dc43-421d-93af-9b10866f869c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:56:11.568505 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2bfda4a1-648c-4856-92de-dcca9e398d57 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:11.569004 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2bfda4a1-648c-4856-92de-dcca9e398d57 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: c39c1157-f207-4ef9-a7c5-6bc88b4986dd] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:11.576023 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2bfda4a1-648c-4856-92de-dcca9e398d57 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:11.576824 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2bfda4a1-648c-4856-92de-dcca9e398d57 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:11.577259 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2bfda4a1-648c-4856-92de-dcca9e398d57 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:11.577955 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2bfda4a1-648c-4856-92de-dcca9e398d57 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:11.578446 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2bfda4a1-648c-4856-92de-dcca9e398d57 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:11.578868 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2bfda4a1-648c-4856-92de-dcca9e398d57 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:11.594574 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-2bfda4a1-648c-4856-92de-dcca9e398d57 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] HTTP exception thrown: Instance c39c1157-f207-4ef9-a7c5-6bc88b4986dd could not be found. Aug 31 16:56:11.596169 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2bfda4a1-648c-4856-92de-dcca9e398d57 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Request method failure captured: Aug 31 16:56:11.596169 n-d-833090-16 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd HTTP/1.1 Aug 31 16:56:11.596169 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:56:11.596169 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:56:11.596169 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:56:11.596169 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:56:11.596169 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:56:11.596169 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:56:11.596169 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:56:11.596169 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:56:11.596169 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD5C9uAz-t5mh-r3mUMMlr2wQd9RJYBAKDGT0KvPrLTihjtZPy6-09_bJTMDpSB88huaVHBLxwU79aGS9Ig9M6XEadSxV6dHNvqYvU2MaYuMgncb9fl7PDdbiMU9wj6m6OmrQoGoaSgGYVEfgnnlWHC-gb6kVlFh35PHiKS5x0RNERSU Aug 31 16:56:11.596169 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:56:11.596169 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:56:11.596169 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:56:11.596169 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:56:11.596169 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:56:11.596169 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:56:11.596169 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: fce77c4128d3448885217ac4d4744765 Aug 31 16:56:11.596169 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerActionsTestJSON-1850065935 Aug 31 16:56:11.596169 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:56:11.596169 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:56:11.596169 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fce77c4128d3448885217ac4d4744765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fce77c4128d3448885217ac4d4744765"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/fce77c4128d3448885217ac4d4744765"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_fce77c4128d3448885217ac4d4744765", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:56:11.596169 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServerActionsTestJSON-1850065935 Aug 31 16:56:11.596169 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: fce77c4128d3448885217ac4d4744765 Aug 31 16:56:11.596169 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerActionsTestJSON-1850065935 Aug 31 16:56:11.596169 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServerActionsTestJSON-1850065935-project Aug 31 16:56:11.596169 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:56:11.596169 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:56:11.596169 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 689ff4da0acb4aafa5f44d42e68ab41d Aug 31 16:56:11.596169 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServerActionsTestJSON-1850065935-project Aug 31 16:56:11.596169 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:56:11.596169 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance c39c1157-f207-4ef9-a7c5-6bc88b4986dd could not be found. Aug 31 16:56:11.596169 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'c39c1157-f207-4ef9-a7c5-6bc88b4986dd'} Aug 31 16:56:11.596169 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:56:11.596169 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:56:11.596169 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:56:11.596169 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:56:11.596169 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:56:11.596169 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:56:11.596169 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:56:11.596169 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:56:11.596169 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:56:11.596169 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:56:11.596169 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c39c1157-f207-4ef9-a7c5-6bc88b4986dd could not be found. Aug 31 16:56:11.596169 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:56:11.596169 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:56:11.596169 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:56:11.596169 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:56:11.596169 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:56:11.596169 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:56:11.596169 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:56:11.596169 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:56:11.596169 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:56:11.596169 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:56:11.596169 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:56:11.596169 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:56:11.596169 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:56:11.596169 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:56:11.596169 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:56:11.596169 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:56:11.596169 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:56:11.596169 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:56:11.600172 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c39c1157-f207-4ef9-a7c5-6bc88b4986dd could not be found. Aug 31 16:56:11.600172 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:56:11.600172 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:56:11.600172 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:56:11.600172 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:56:11.600172 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:56:11.600172 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:56:11.600172 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:56:11.600172 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:56:11.600172 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c39c1157-f207-4ef9-a7c5-6bc88b4986dd could not be found. Aug 31 16:56:11.600172 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:56:11.600172 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2bfda4a1-648c-4856-92de-dcca9e398d57 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Returning 404 to user: Instance c39c1157-f207-4ef9-a7c5-6bc88b4986dd could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:56:11.600172 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2bfda4a1-648c-4856-92de-dcca9e398d57 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "DELETE /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd" status: 404 len: 111 microversion: 2.1 time: 0.033092 Aug 31 16:56:11.600172 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3536/7251] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:56:11 2022] DELETE /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:56:11.606791 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f266c06f-1bb1-43f2-ae28-541134e64c34 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:11.607161 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f266c06f-1bb1-43f2-ae28-541134e64c34 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: c39c1157-f207-4ef9-a7c5-6bc88b4986dd] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:11.613809 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f266c06f-1bb1-43f2-ae28-541134e64c34 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:11.614764 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f266c06f-1bb1-43f2-ae28-541134e64c34 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:11.615208 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f266c06f-1bb1-43f2-ae28-541134e64c34 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:11.615918 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f266c06f-1bb1-43f2-ae28-541134e64c34 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:11.616377 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f266c06f-1bb1-43f2-ae28-541134e64c34 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:11.616963 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f266c06f-1bb1-43f2-ae28-541134e64c34 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:11.632217 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-f266c06f-1bb1-43f2-ae28-541134e64c34 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] HTTP exception thrown: Instance c39c1157-f207-4ef9-a7c5-6bc88b4986dd could not be found. Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f266c06f-1bb1-43f2-ae28-541134e64c34 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Request method failure captured: Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd HTTP/1.1 Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD5C9uAz-t5mh-r3mUMMlr2wQd9RJYBAKDGT0KvPrLTihjtZPy6-09_bJTMDpSB88huaVHBLxwU79aGS9Ig9M6XEadSxV6dHNvqYvU2MaYuMgncb9fl7PDdbiMU9wj6m6OmrQoGoaSgGYVEfgnnlWHC-gb6kVlFh35PHiKS5x0RNERSU Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: fce77c4128d3448885217ac4d4744765 Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServerActionsTestJSON-1850065935 Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fce77c4128d3448885217ac4d4744765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fce77c4128d3448885217ac4d4744765"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/fce77c4128d3448885217ac4d4744765"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_fce77c4128d3448885217ac4d4744765", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServerActionsTestJSON-1850065935 Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: fce77c4128d3448885217ac4d4744765 Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServerActionsTestJSON-1850065935 Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServerActionsTestJSON-1850065935-project Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 689ff4da0acb4aafa5f44d42e68ab41d Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServerActionsTestJSON-1850065935-project Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance c39c1157-f207-4ef9-a7c5-6bc88b4986dd could not be found. Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'c39c1157-f207-4ef9-a7c5-6bc88b4986dd'} Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c39c1157-f207-4ef9-a7c5-6bc88b4986dd could not be found. Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c39c1157-f207-4ef9-a7c5-6bc88b4986dd could not be found. Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:56:11.633880 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:56:11.638684 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:56:11.638684 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:56:11.638684 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:56:11.638684 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:56:11.638684 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:56:11.638684 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c39c1157-f207-4ef9-a7c5-6bc88b4986dd could not be found. Aug 31 16:56:11.638684 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:56:11.638684 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f266c06f-1bb1-43f2-ae28-541134e64c34 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Returning 404 to user: Instance c39c1157-f207-4ef9-a7c5-6bc88b4986dd could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:56:11.638684 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f266c06f-1bb1-43f2-ae28-541134e64c34 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd" status: 404 len: 111 microversion: 2.1 time: 0.033134 Aug 31 16:56:11.638684 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3716/7252] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:11 2022] GET /compute/v2.1/servers/c39c1157-f207-4ef9-a7c5-6bc88b4986dd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:56:11.644321 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b620488a-22af-4431-89a7-0f2794ca575d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:11.644841 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b620488a-22af-4431-89a7-0f2794ca575d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:11.651447 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b620488a-22af-4431-89a7-0f2794ca575d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:11.651987 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b620488a-22af-4431-89a7-0f2794ca575d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:11.652693 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b620488a-22af-4431-89a7-0f2794ca575d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:11.653327 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b620488a-22af-4431-89a7-0f2794ca575d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:11.653769 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b620488a-22af-4431-89a7-0f2794ca575d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:11.654235 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b620488a-22af-4431-89a7-0f2794ca575d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:11.668426 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-b620488a-22af-4431-89a7-0f2794ca575d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] HTTP exception thrown: Instance 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b could not be found. Aug 31 16:56:11.669968 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b620488a-22af-4431-89a7-0f2794ca575d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Request method failure captured: Aug 31 16:56:11.669968 n-d-833090-16 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b HTTP/1.1 Aug 31 16:56:11.669968 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:56:11.669968 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:56:11.669968 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:56:11.669968 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:56:11.669968 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:56:11.669968 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:56:11.669968 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:56:11.669968 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:56:11.669968 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD5C9uAz-t5mh-r3mUMMlr2wQd9RJYBAKDGT0KvPrLTihjtZPy6-09_bJTMDpSB88huaVHBLxwU79aGS9Ig9M6XEadSxV6dHNvqYvU2MaYuMgncb9fl7PDdbiMU9wj6m6OmrQoGoaSgGYVEfgnnlWHC-gb6kVlFh35PHiKS5x0RNERSU Aug 31 16:56:11.669968 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:56:11.669968 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:56:11.669968 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:56:11.669968 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:56:11.669968 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:56:11.669968 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:56:11.669968 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: fce77c4128d3448885217ac4d4744765 Aug 31 16:56:11.669968 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerActionsTestJSON-1850065935 Aug 31 16:56:11.669968 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:56:11.669968 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:56:11.669968 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fce77c4128d3448885217ac4d4744765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fce77c4128d3448885217ac4d4744765"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/fce77c4128d3448885217ac4d4744765"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_fce77c4128d3448885217ac4d4744765", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:56:11.669968 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServerActionsTestJSON-1850065935 Aug 31 16:56:11.669968 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: fce77c4128d3448885217ac4d4744765 Aug 31 16:56:11.669968 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerActionsTestJSON-1850065935 Aug 31 16:56:11.669968 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServerActionsTestJSON-1850065935-project Aug 31 16:56:11.669968 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:56:11.669968 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:56:11.669968 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 689ff4da0acb4aafa5f44d42e68ab41d Aug 31 16:56:11.669968 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServerActionsTestJSON-1850065935-project Aug 31 16:56:11.669968 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:56:11.669968 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b could not be found. Aug 31 16:56:11.669968 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '015c2ed2-16ef-4fe4-9867-ff4d28b7a60b'} Aug 31 16:56:11.669968 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:56:11.669968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:56:11.669968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:56:11.669968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:56:11.669968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:56:11.669968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:56:11.669968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:56:11.669968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:56:11.669968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:56:11.669968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:56:11.669968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b could not be found. Aug 31 16:56:11.669968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:56:11.669968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:56:11.669968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:56:11.669968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:56:11.669968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:56:11.669968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:56:11.669968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:56:11.669968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:56:11.669968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:56:11.669968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:56:11.669968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:56:11.669968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:56:11.669968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:56:11.669968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:56:11.669968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:56:11.669968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:56:11.669968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:56:11.669968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:56:11.674318 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b could not be found. Aug 31 16:56:11.674318 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:56:11.674318 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:56:11.674318 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:56:11.674318 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:56:11.674318 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:56:11.674318 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:56:11.674318 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:56:11.674318 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:56:11.674318 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b could not be found. Aug 31 16:56:11.674318 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:56:11.674318 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b620488a-22af-4431-89a7-0f2794ca575d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Returning 404 to user: Instance 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:56:11.674318 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b620488a-22af-4431-89a7-0f2794ca575d tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "DELETE /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b" status: 404 len: 111 microversion: 2.1 time: 0.031082 Aug 31 16:56:11.674318 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3537/7253] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:56:11 2022] DELETE /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:56:11.680228 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-deac9f9a-4d29-4f80-b3d5-131d7f7803c8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:11.680912 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-deac9f9a-4d29-4f80-b3d5-131d7f7803c8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:11.687687 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-deac9f9a-4d29-4f80-b3d5-131d7f7803c8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:11.688181 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-deac9f9a-4d29-4f80-b3d5-131d7f7803c8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:11.688621 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-deac9f9a-4d29-4f80-b3d5-131d7f7803c8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:11.689356 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-deac9f9a-4d29-4f80-b3d5-131d7f7803c8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:11.689818 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-deac9f9a-4d29-4f80-b3d5-131d7f7803c8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:11.690284 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-deac9f9a-4d29-4f80-b3d5-131d7f7803c8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:11.704379 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-deac9f9a-4d29-4f80-b3d5-131d7f7803c8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] HTTP exception thrown: Instance 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b could not be found. Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-deac9f9a-4d29-4f80-b3d5-131d7f7803c8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Request method failure captured: Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b HTTP/1.1 Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD5C9uAz-t5mh-r3mUMMlr2wQd9RJYBAKDGT0KvPrLTihjtZPy6-09_bJTMDpSB88huaVHBLxwU79aGS9Ig9M6XEadSxV6dHNvqYvU2MaYuMgncb9fl7PDdbiMU9wj6m6OmrQoGoaSgGYVEfgnnlWHC-gb6kVlFh35PHiKS5x0RNERSU Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: fce77c4128d3448885217ac4d4744765 Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServerActionsTestJSON-1850065935 Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fce77c4128d3448885217ac4d4744765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fce77c4128d3448885217ac4d4744765"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/fce77c4128d3448885217ac4d4744765"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_fce77c4128d3448885217ac4d4744765", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServerActionsTestJSON-1850065935 Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: fce77c4128d3448885217ac4d4744765 Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServerActionsTestJSON-1850065935 Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServerActionsTestJSON-1850065935-project Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 689ff4da0acb4aafa5f44d42e68ab41d Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServerActionsTestJSON-1850065935-project Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b could not be found. Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '015c2ed2-16ef-4fe4-9867-ff4d28b7a60b'} Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b could not be found. Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b could not be found. Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:56:11.705932 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:56:11.711459 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:56:11.711459 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:56:11.711459 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:56:11.711459 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:56:11.711459 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:56:11.711459 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b could not be found. Aug 31 16:56:11.711459 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:56:11.711459 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-deac9f9a-4d29-4f80-b3d5-131d7f7803c8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Returning 404 to user: Instance 015c2ed2-16ef-4fe4-9867-ff4d28b7a60b could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:56:11.711459 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-deac9f9a-4d29-4f80-b3d5-131d7f7803c8 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b" status: 404 len: 111 microversion: 2.1 time: 0.031154 Aug 31 16:56:11.711459 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3717/7254] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:11 2022] GET /compute/v2.1/servers/015c2ed2-16ef-4fe4-9867-ff4d28b7a60b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:56:11.716491 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e1489b70-a87e-4a71-8887-fba3048001ec tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:11.716986 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e1489b70-a87e-4a71-8887-fba3048001ec tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: b7113bf3-7742-450a-a22e-d88cd6d548d7] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:11.723720 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e1489b70-a87e-4a71-8887-fba3048001ec tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:11.724429 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e1489b70-a87e-4a71-8887-fba3048001ec tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:11.724903 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e1489b70-a87e-4a71-8887-fba3048001ec tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:11.725580 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e1489b70-a87e-4a71-8887-fba3048001ec tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:11.726137 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e1489b70-a87e-4a71-8887-fba3048001ec tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:11.726632 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e1489b70-a87e-4a71-8887-fba3048001ec tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:11.742706 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-e1489b70-a87e-4a71-8887-fba3048001ec tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] HTTP exception thrown: Instance b7113bf3-7742-450a-a22e-d88cd6d548d7 could not be found. Aug 31 16:56:11.744459 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e1489b70-a87e-4a71-8887-fba3048001ec tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Request method failure captured: Aug 31 16:56:11.744459 n-d-833090-16 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7 HTTP/1.1 Aug 31 16:56:11.744459 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:56:11.744459 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:56:11.744459 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:56:11.744459 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:56:11.744459 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:56:11.744459 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:56:11.744459 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:56:11.744459 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:56:11.744459 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD5C9uAz-t5mh-r3mUMMlr2wQd9RJYBAKDGT0KvPrLTihjtZPy6-09_bJTMDpSB88huaVHBLxwU79aGS9Ig9M6XEadSxV6dHNvqYvU2MaYuMgncb9fl7PDdbiMU9wj6m6OmrQoGoaSgGYVEfgnnlWHC-gb6kVlFh35PHiKS5x0RNERSU Aug 31 16:56:11.744459 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:56:11.744459 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:56:11.744459 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:56:11.744459 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:56:11.744459 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:56:11.744459 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:56:11.744459 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: fce77c4128d3448885217ac4d4744765 Aug 31 16:56:11.744459 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServerActionsTestJSON-1850065935 Aug 31 16:56:11.744459 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:56:11.744459 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:56:11.744459 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fce77c4128d3448885217ac4d4744765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fce77c4128d3448885217ac4d4744765"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/fce77c4128d3448885217ac4d4744765"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_fce77c4128d3448885217ac4d4744765", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:56:11.744459 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServerActionsTestJSON-1850065935 Aug 31 16:56:11.744459 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: fce77c4128d3448885217ac4d4744765 Aug 31 16:56:11.744459 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServerActionsTestJSON-1850065935 Aug 31 16:56:11.744459 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServerActionsTestJSON-1850065935-project Aug 31 16:56:11.744459 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:56:11.744459 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:56:11.744459 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 689ff4da0acb4aafa5f44d42e68ab41d Aug 31 16:56:11.744459 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServerActionsTestJSON-1850065935-project Aug 31 16:56:11.744459 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:56:11.744459 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance b7113bf3-7742-450a-a22e-d88cd6d548d7 could not be found. Aug 31 16:56:11.744459 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'b7113bf3-7742-450a-a22e-d88cd6d548d7'} Aug 31 16:56:11.744459 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:56:11.744459 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:56:11.744459 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:56:11.744459 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:56:11.744459 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:56:11.744459 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:56:11.744459 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:56:11.744459 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:56:11.744459 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:56:11.744459 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:56:11.744459 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7113bf3-7742-450a-a22e-d88cd6d548d7 could not be found. Aug 31 16:56:11.744459 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:56:11.744459 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:56:11.744459 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:56:11.744459 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:56:11.744459 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:56:11.744459 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:56:11.744459 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:56:11.744459 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:56:11.744459 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:56:11.744459 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:56:11.744459 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:56:11.744459 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:56:11.744459 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:56:11.744459 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:56:11.744459 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:56:11.744459 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:56:11.744459 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:56:11.744459 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:56:11.748457 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7113bf3-7742-450a-a22e-d88cd6d548d7 could not be found. Aug 31 16:56:11.748457 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:56:11.748457 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:56:11.748457 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:56:11.748457 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:56:11.748457 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:56:11.748457 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:56:11.748457 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:56:11.748457 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:56:11.748457 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7113bf3-7742-450a-a22e-d88cd6d548d7 could not be found. Aug 31 16:56:11.748457 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:56:11.748457 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e1489b70-a87e-4a71-8887-fba3048001ec tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Returning 404 to user: Instance b7113bf3-7742-450a-a22e-d88cd6d548d7 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:56:11.748457 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e1489b70-a87e-4a71-8887-fba3048001ec tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7" status: 404 len: 111 microversion: 2.1 time: 0.033767 Aug 31 16:56:11.749602 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3538/7255] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:56:11 2022] DELETE /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:56:11.755282 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-27a6be73-ac90-4f5a-a7e1-5f206126a393 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:11.755909 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-27a6be73-ac90-4f5a-a7e1-5f206126a393 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] [instance: b7113bf3-7742-450a-a22e-d88cd6d548d7] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:11.762660 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-27a6be73-ac90-4f5a-a7e1-5f206126a393 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:11.763163 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-27a6be73-ac90-4f5a-a7e1-5f206126a393 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:11.763573 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-27a6be73-ac90-4f5a-a7e1-5f206126a393 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:11.764314 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-27a6be73-ac90-4f5a-a7e1-5f206126a393 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:11.764769 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-27a6be73-ac90-4f5a-a7e1-5f206126a393 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:11.765198 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-27a6be73-ac90-4f5a-a7e1-5f206126a393 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:11.780506 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-27a6be73-ac90-4f5a-a7e1-5f206126a393 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] HTTP exception thrown: Instance b7113bf3-7742-450a-a22e-d88cd6d548d7 could not be found. Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-27a6be73-ac90-4f5a-a7e1-5f206126a393 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Request method failure captured: Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7 HTTP/1.1 Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD5C9uAz-t5mh-r3mUMMlr2wQd9RJYBAKDGT0KvPrLTihjtZPy6-09_bJTMDpSB88huaVHBLxwU79aGS9Ig9M6XEadSxV6dHNvqYvU2MaYuMgncb9fl7PDdbiMU9wj6m6OmrQoGoaSgGYVEfgnnlWHC-gb6kVlFh35PHiKS5x0RNERSU Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: fce77c4128d3448885217ac4d4744765 Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServerActionsTestJSON-1850065935 Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fce77c4128d3448885217ac4d4744765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fce77c4128d3448885217ac4d4744765"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/fce77c4128d3448885217ac4d4744765"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_fce77c4128d3448885217ac4d4744765", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServerActionsTestJSON-1850065935 Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: fce77c4128d3448885217ac4d4744765 Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServerActionsTestJSON-1850065935 Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServerActionsTestJSON-1850065935-project Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 689ff4da0acb4aafa5f44d42e68ab41d Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServerActionsTestJSON-1850065935-project Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance b7113bf3-7742-450a-a22e-d88cd6d548d7 could not be found. Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'b7113bf3-7742-450a-a22e-d88cd6d548d7'} Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7113bf3-7742-450a-a22e-d88cd6d548d7 could not be found. Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7113bf3-7742-450a-a22e-d88cd6d548d7 could not be found. Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:56:11.782066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:56:11.786212 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:56:11.786212 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:56:11.786212 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:56:11.786212 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:56:11.786212 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:56:11.786212 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7113bf3-7742-450a-a22e-d88cd6d548d7 could not be found. Aug 31 16:56:11.786212 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:56:11.786212 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-27a6be73-ac90-4f5a-a7e1-5f206126a393 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Returning 404 to user: Instance b7113bf3-7742-450a-a22e-d88cd6d548d7 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:56:11.786212 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-27a6be73-ac90-4f5a-a7e1-5f206126a393 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7" status: 404 len: 111 microversion: 2.1 time: 0.032270 Aug 31 16:56:11.786212 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3718/7256] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:11 2022] GET /compute/v2.1/servers/b7113bf3-7742-450a-a22e-d88cd6d548d7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:56:11.792612 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7a6006fe-8b92-4578-bb4a-95f2cae7f907 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] Calling method '.version_select at 0x7fbb4ac31310>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:11.820219 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7a6006fe-8b92-4578-bb4a-95f2cae7f907 tempest-ServerActionsTestJSON-1850065935 tempest-ServerActionsTestJSON-1850065935-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-249207011" status: 202 len: 0 microversion: 2.1 time: 0.031553 Aug 31 16:56:11.820820 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3539/7257] 10.222.0.50 () {58 vars in 1218 bytes} [Wed Aug 31 16:56:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-249207011 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:56:21.759910 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=7 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:56:21.770919 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=32,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:56:21.840555 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-64b3603a-6820-481c-8f3e-d8a33681a297 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-132013939", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "57935d11-910f-485d-b58a-84a64fe24daa"}]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:56:21.902659 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-64b3603a-6820-481c-8f3e-d8a33681a297 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] validate_networks() for [('57935d11-910f-485d-b58a-84a64fe24daa', None, None, None, None, None)] {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:56:22.317673 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-64b3603a-6820-481c-8f3e-d8a33681a297 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:56:22.318246 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-64b3603a-6820-481c-8f3e-d8a33681a297 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:56:22.318731 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-64b3603a-6820-481c-8f3e-d8a33681a297 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:56:22.319134 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-64b3603a-6820-481c-8f3e-d8a33681a297 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:56:22.319572 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-64b3603a-6820-481c-8f3e-d8a33681a297 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:56:22.329406 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-64b3603a-6820-481c-8f3e-d8a33681a297 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:22.329900 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-64b3603a-6820-481c-8f3e-d8a33681a297 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:22.330384 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-64b3603a-6820-481c-8f3e-d8a33681a297 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:22.331112 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-64b3603a-6820-481c-8f3e-d8a33681a297 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:22.331592 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-64b3603a-6820-481c-8f3e-d8a33681a297 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:22.332025 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-64b3603a-6820-481c-8f3e-d8a33681a297 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:22.350324 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-64b3603a-6820-481c-8f3e-d8a33681a297 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Getting quotas for project bf66494763e5444787ab5156ce2db4bc. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:56:22.356671 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-64b3603a-6820-481c-8f3e-d8a33681a297 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Getting quotas for user 580c62de1d3f46afbd51eb4cb49d4ca8 and project bf66494763e5444787ab5156ce2db4bc. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:56:22.370904 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-64b3603a-6820-481c-8f3e-d8a33681a297 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:56:22.373313 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-64b3603a-6820-481c-8f3e-d8a33681a297 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] [instance: 3773864e-7352-41c2-937c-d6bac5be6063] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:56:22.421757 n-d-833090-16 devstack@n-api.service[128864]: ERROR oslo.messaging._drivers.impl_rabbit [None req-64b3603a-6820-481c-8f3e-d8a33681a297 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] [f9b5357a-7b17-4db0-90cc-a76a5ade09b1] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 16:56:23.428754 n-d-833090-16 devstack@n-api.service[128864]: INFO oslo.messaging._drivers.impl_rabbit [None req-64b3603a-6820-481c-8f3e-d8a33681a297 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] [f9b5357a-7b17-4db0-90cc-a76a5ade09b1] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 49688. Aug 31 16:56:23.433698 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-64b3603a-6820-481c-8f3e-d8a33681a297 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.728598 Aug 31 16:56:23.434504 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3719/7258] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:56:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:56:23.443459 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=7 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:56:23.444849 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:56:23.449943 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6b909ca7-396b-4564-b9fc-ffa11bf1e4cc tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:23.450584 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6b909ca7-396b-4564-b9fc-ffa11bf1e4cc tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] [instance: 3773864e-7352-41c2-937c-d6bac5be6063] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:23.519349 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6b909ca7-396b-4564-b9fc-ffa11bf1e4cc tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580c62de1d3f46afbd51eb4cb49d4ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf66494763e5444787ab5156ce2db4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:23.530149 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6b909ca7-396b-4564-b9fc-ffa11bf1e4cc tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] 10.222.0.50 "GET /compute/v2.1/servers/3773864e-7352-41c2-937c-d6bac5be6063" status: 200 len: 1216 microversion: 2.1 time: 0.088499 Aug 31 16:56:23.531094 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3540/7259] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:23 2022] GET /compute/v2.1/servers/3773864e-7352-41c2-937c-d6bac5be6063 => generated 1216 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:24.552538 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-77df3439-f350-48bc-9209-8e3e2a052623 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:24.553187 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-77df3439-f350-48bc-9209-8e3e2a052623 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] [instance: 3773864e-7352-41c2-937c-d6bac5be6063] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:24.561370 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-77df3439-f350-48bc-9209-8e3e2a052623 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:24.561872 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-77df3439-f350-48bc-9209-8e3e2a052623 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:24.562352 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-77df3439-f350-48bc-9209-8e3e2a052623 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:24.563067 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-77df3439-f350-48bc-9209-8e3e2a052623 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:24.563524 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-77df3439-f350-48bc-9209-8e3e2a052623 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:24.563956 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-77df3439-f350-48bc-9209-8e3e2a052623 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:24.648598 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-77df3439-f350-48bc-9209-8e3e2a052623 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580c62de1d3f46afbd51eb4cb49d4ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf66494763e5444787ab5156ce2db4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:24.659314 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-77df3439-f350-48bc-9209-8e3e2a052623 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] 10.222.0.50 "GET /compute/v2.1/servers/3773864e-7352-41c2-937c-d6bac5be6063" status: 200 len: 1268 microversion: 2.1 time: 0.111400 Aug 31 16:56:24.659942 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3720/7260] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:24 2022] GET /compute/v2.1/servers/3773864e-7352-41c2-937c-d6bac5be6063 => generated 1268 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:25.681082 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-35179463-c375-41fa-8f92-89cd5697ceb2 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:25.681831 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-35179463-c375-41fa-8f92-89cd5697ceb2 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] [instance: 3773864e-7352-41c2-937c-d6bac5be6063] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:25.689313 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-35179463-c375-41fa-8f92-89cd5697ceb2 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:25.689920 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-35179463-c375-41fa-8f92-89cd5697ceb2 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:25.690440 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-35179463-c375-41fa-8f92-89cd5697ceb2 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:25.691140 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-35179463-c375-41fa-8f92-89cd5697ceb2 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:25.691586 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-35179463-c375-41fa-8f92-89cd5697ceb2 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:25.692009 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-35179463-c375-41fa-8f92-89cd5697ceb2 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:25.834582 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-35179463-c375-41fa-8f92-89cd5697ceb2 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580c62de1d3f46afbd51eb4cb49d4ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf66494763e5444787ab5156ce2db4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:25.843475 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-35179463-c375-41fa-8f92-89cd5697ceb2 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] 10.222.0.50 "GET /compute/v2.1/servers/3773864e-7352-41c2-937c-d6bac5be6063" status: 200 len: 1316 microversion: 2.1 time: 0.166214 Aug 31 16:56:25.844075 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3541/7261] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:25 2022] GET /compute/v2.1/servers/3773864e-7352-41c2-937c-d6bac5be6063 => generated 1316 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:26.188596 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-128e5e67-e1a1-4e8d-8a4d-2e2db395b8d5 req-9f891cee-308c-4d0f-bf40-c169aff4e5d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3773864e-7352-41c2-937c-d6bac5be6063", "tag": "9468b150-6eaa-4530-9b57-12e5c7d42d6c"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:56:26.203852 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-128e5e67-e1a1-4e8d-8a4d-2e2db395b8d5 req-9f891cee-308c-4d0f-bf40-c169aff4e5d4 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:26.204390 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-128e5e67-e1a1-4e8d-8a4d-2e2db395b8d5 req-9f891cee-308c-4d0f-bf40-c169aff4e5d4 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:26.205062 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-128e5e67-e1a1-4e8d-8a4d-2e2db395b8d5 req-9f891cee-308c-4d0f-bf40-c169aff4e5d4 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:26.217109 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-128e5e67-e1a1-4e8d-8a4d-2e2db395b8d5 req-9f891cee-308c-4d0f-bf40-c169aff4e5d4 service nova] Creating event network-changed:9468b150-6eaa-4530-9b57-12e5c7d42d6c for instance 3773864e-7352-41c2-937c-d6bac5be6063 on n-h2-833090-16 Aug 31 16:56:26.222668 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-128e5e67-e1a1-4e8d-8a4d-2e2db395b8d5 req-9f891cee-308c-4d0f-bf40-c169aff4e5d4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037706 Aug 31 16:56:26.224232 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3721/7262] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:56:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:56:26.868200 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4f097204-6244-4a22-b4ee-af8806f08951 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:26.868989 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4f097204-6244-4a22-b4ee-af8806f08951 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] [instance: 3773864e-7352-41c2-937c-d6bac5be6063] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:26.877027 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f097204-6244-4a22-b4ee-af8806f08951 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:26.877513 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f097204-6244-4a22-b4ee-af8806f08951 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:26.877946 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f097204-6244-4a22-b4ee-af8806f08951 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:26.878673 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f097204-6244-4a22-b4ee-af8806f08951 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:26.879122 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f097204-6244-4a22-b4ee-af8806f08951 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:26.879544 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4f097204-6244-4a22-b4ee-af8806f08951 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:27.022763 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4f097204-6244-4a22-b4ee-af8806f08951 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580c62de1d3f46afbd51eb4cb49d4ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf66494763e5444787ab5156ce2db4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:27.031579 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4f097204-6244-4a22-b4ee-af8806f08951 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] 10.222.0.50 "GET /compute/v2.1/servers/3773864e-7352-41c2-937c-d6bac5be6063" status: 200 len: 1316 microversion: 2.1 time: 0.169738 Aug 31 16:56:27.032276 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3542/7263] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:26 2022] GET /compute/v2.1/servers/3773864e-7352-41c2-937c-d6bac5be6063 => generated 1316 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:28.060397 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-10803a2a-978d-4e8a-a40d-b256a67be270 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:28.061502 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-10803a2a-978d-4e8a-a40d-b256a67be270 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] [instance: 3773864e-7352-41c2-937c-d6bac5be6063] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:28.072366 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-10803a2a-978d-4e8a-a40d-b256a67be270 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:28.072871 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-10803a2a-978d-4e8a-a40d-b256a67be270 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:28.073316 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-10803a2a-978d-4e8a-a40d-b256a67be270 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:28.074022 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-10803a2a-978d-4e8a-a40d-b256a67be270 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:28.074518 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-10803a2a-978d-4e8a-a40d-b256a67be270 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:28.074953 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-10803a2a-978d-4e8a-a40d-b256a67be270 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:28.232667 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-10803a2a-978d-4e8a-a40d-b256a67be270 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580c62de1d3f46afbd51eb4cb49d4ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf66494763e5444787ab5156ce2db4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:28.240783 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-10803a2a-978d-4e8a-a40d-b256a67be270 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] 10.222.0.50 "GET /compute/v2.1/servers/3773864e-7352-41c2-937c-d6bac5be6063" status: 200 len: 1316 microversion: 2.1 time: 0.189239 Aug 31 16:56:28.241364 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3722/7264] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:28 2022] GET /compute/v2.1/servers/3773864e-7352-41c2-937c-d6bac5be6063 => generated 1316 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:29.261330 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-52f38c42-a884-45a2-97a6-c947c4bbfa52 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:29.261943 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-52f38c42-a884-45a2-97a6-c947c4bbfa52 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] [instance: 3773864e-7352-41c2-937c-d6bac5be6063] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:29.269355 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-52f38c42-a884-45a2-97a6-c947c4bbfa52 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:29.269844 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-52f38c42-a884-45a2-97a6-c947c4bbfa52 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:29.270320 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-52f38c42-a884-45a2-97a6-c947c4bbfa52 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:29.271273 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-52f38c42-a884-45a2-97a6-c947c4bbfa52 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:29.271730 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-52f38c42-a884-45a2-97a6-c947c4bbfa52 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:29.272152 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-52f38c42-a884-45a2-97a6-c947c4bbfa52 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:29.434419 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-52f38c42-a884-45a2-97a6-c947c4bbfa52 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580c62de1d3f46afbd51eb4cb49d4ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf66494763e5444787ab5156ce2db4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:29.442615 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-52f38c42-a884-45a2-97a6-c947c4bbfa52 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] 10.222.0.50 "GET /compute/v2.1/servers/3773864e-7352-41c2-937c-d6bac5be6063" status: 200 len: 1316 microversion: 2.1 time: 0.185427 Aug 31 16:56:29.443199 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3543/7265] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:29 2022] GET /compute/v2.1/servers/3773864e-7352-41c2-937c-d6bac5be6063 => generated 1316 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:30.473853 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5fbe86e8-85b6-45d5-a1eb-d90f68e9c62c tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:30.474541 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5fbe86e8-85b6-45d5-a1eb-d90f68e9c62c tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] [instance: 3773864e-7352-41c2-937c-d6bac5be6063] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:30.483846 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5fbe86e8-85b6-45d5-a1eb-d90f68e9c62c tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:30.484355 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5fbe86e8-85b6-45d5-a1eb-d90f68e9c62c tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:30.484803 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5fbe86e8-85b6-45d5-a1eb-d90f68e9c62c tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:30.485643 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5fbe86e8-85b6-45d5-a1eb-d90f68e9c62c tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:30.486255 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5fbe86e8-85b6-45d5-a1eb-d90f68e9c62c tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:30.486727 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5fbe86e8-85b6-45d5-a1eb-d90f68e9c62c tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:30.644159 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5fbe86e8-85b6-45d5-a1eb-d90f68e9c62c tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580c62de1d3f46afbd51eb4cb49d4ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf66494763e5444787ab5156ce2db4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:30.652350 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5fbe86e8-85b6-45d5-a1eb-d90f68e9c62c tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] 10.222.0.50 "GET /compute/v2.1/servers/3773864e-7352-41c2-937c-d6bac5be6063" status: 200 len: 1316 microversion: 2.1 time: 0.184903 Aug 31 16:56:30.652930 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3723/7266] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:30 2022] GET /compute/v2.1/servers/3773864e-7352-41c2-937c-d6bac5be6063 => generated 1316 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:31.675742 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d64336d5-4a77-4d1f-aede-f9133d6ae8bb tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:31.676643 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d64336d5-4a77-4d1f-aede-f9133d6ae8bb tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] [instance: 3773864e-7352-41c2-937c-d6bac5be6063] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:31.687616 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d64336d5-4a77-4d1f-aede-f9133d6ae8bb tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:31.688184 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d64336d5-4a77-4d1f-aede-f9133d6ae8bb tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:31.688670 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d64336d5-4a77-4d1f-aede-f9133d6ae8bb tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:31.689663 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d64336d5-4a77-4d1f-aede-f9133d6ae8bb tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:31.690138 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d64336d5-4a77-4d1f-aede-f9133d6ae8bb tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:31.690566 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d64336d5-4a77-4d1f-aede-f9133d6ae8bb tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:31.854750 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d64336d5-4a77-4d1f-aede-f9133d6ae8bb tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580c62de1d3f46afbd51eb4cb49d4ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf66494763e5444787ab5156ce2db4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:31.864294 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d64336d5-4a77-4d1f-aede-f9133d6ae8bb tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] 10.222.0.50 "GET /compute/v2.1/servers/3773864e-7352-41c2-937c-d6bac5be6063" status: 200 len: 1316 microversion: 2.1 time: 0.194137 Aug 31 16:56:31.864878 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3544/7267] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:31 2022] GET /compute/v2.1/servers/3773864e-7352-41c2-937c-d6bac5be6063 => generated 1316 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:32.379681 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-65217a51-8c0b-41ea-8c55-83113be2621d req-668ee1ba-1b68-480e-8552-713e84934454 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3773864e-7352-41c2-937c-d6bac5be6063", "name": "network-vif-plugged", "status": "completed", "tag": "9468b150-6eaa-4530-9b57-12e5c7d42d6c"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:56:32.385798 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:56:32.386454 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=6 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:56:32.392791 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-65217a51-8c0b-41ea-8c55-83113be2621d req-668ee1ba-1b68-480e-8552-713e84934454 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:32.393281 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-65217a51-8c0b-41ea-8c55-83113be2621d req-668ee1ba-1b68-480e-8552-713e84934454 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:32.393703 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-65217a51-8c0b-41ea-8c55-83113be2621d req-668ee1ba-1b68-480e-8552-713e84934454 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:32.406936 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-65217a51-8c0b-41ea-8c55-83113be2621d req-668ee1ba-1b68-480e-8552-713e84934454 service nova] Creating event network-vif-plugged:9468b150-6eaa-4530-9b57-12e5c7d42d6c for instance 3773864e-7352-41c2-937c-d6bac5be6063 on n-h2-833090-16 Aug 31 16:56:32.412139 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-65217a51-8c0b-41ea-8c55-83113be2621d req-668ee1ba-1b68-480e-8552-713e84934454 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036374 Aug 31 16:56:32.412781 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3724/7268] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:56:32.890500 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-734aac44-e395-4b4f-8547-e4a4c91a0f65 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:32.891475 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-734aac44-e395-4b4f-8547-e4a4c91a0f65 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] [instance: 3773864e-7352-41c2-937c-d6bac5be6063] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:32.902823 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-734aac44-e395-4b4f-8547-e4a4c91a0f65 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:32.903314 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-734aac44-e395-4b4f-8547-e4a4c91a0f65 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:32.903747 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-734aac44-e395-4b4f-8547-e4a4c91a0f65 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:32.904491 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-734aac44-e395-4b4f-8547-e4a4c91a0f65 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:32.904979 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-734aac44-e395-4b4f-8547-e4a4c91a0f65 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:32.905402 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-734aac44-e395-4b4f-8547-e4a4c91a0f65 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:33.050382 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-734aac44-e395-4b4f-8547-e4a4c91a0f65 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580c62de1d3f46afbd51eb4cb49d4ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf66494763e5444787ab5156ce2db4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:33.063518 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-734aac44-e395-4b4f-8547-e4a4c91a0f65 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] 10.222.0.50 "GET /compute/v2.1/servers/3773864e-7352-41c2-937c-d6bac5be6063" status: 200 len: 1316 microversion: 2.1 time: 0.179882 Aug 31 16:56:33.064333 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3545/7269] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:32 2022] GET /compute/v2.1/servers/3773864e-7352-41c2-937c-d6bac5be6063 => generated 1316 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:34.092132 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a6e11c51-ca23-4c81-b86b-5feac34c27ca tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:34.092860 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a6e11c51-ca23-4c81-b86b-5feac34c27ca tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] [instance: 3773864e-7352-41c2-937c-d6bac5be6063] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:34.099783 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a6e11c51-ca23-4c81-b86b-5feac34c27ca tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:34.100282 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a6e11c51-ca23-4c81-b86b-5feac34c27ca tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:34.100734 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a6e11c51-ca23-4c81-b86b-5feac34c27ca tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:34.101441 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a6e11c51-ca23-4c81-b86b-5feac34c27ca tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:34.101909 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a6e11c51-ca23-4c81-b86b-5feac34c27ca tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:34.102382 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a6e11c51-ca23-4c81-b86b-5feac34c27ca tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:34.248342 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a6e11c51-ca23-4c81-b86b-5feac34c27ca tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580c62de1d3f46afbd51eb4cb49d4ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf66494763e5444787ab5156ce2db4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:34.256046 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a6e11c51-ca23-4c81-b86b-5feac34c27ca tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] 10.222.0.50 "GET /compute/v2.1/servers/3773864e-7352-41c2-937c-d6bac5be6063" status: 200 len: 1504 microversion: 2.1 time: 0.169940 Aug 31 16:56:34.256656 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3725/7270] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:34 2022] GET /compute/v2.1/servers/3773864e-7352-41c2-937c-d6bac5be6063 => generated 1504 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:34.324088 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6d17d14b-f3af-428d-8e4b-e73df53774e2 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-784773850", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "57935d11-910f-485d-b58a-84a64fe24daa"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:56:34.336215 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:56:34.391872 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-6d17d14b-f3af-428d-8e4b-e73df53774e2 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] validate_networks() for [('57935d11-910f-485d-b58a-84a64fe24daa', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:56:34.825747 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-6d17d14b-f3af-428d-8e4b-e73df53774e2 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:56:34.826298 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-6d17d14b-f3af-428d-8e4b-e73df53774e2 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:56:34.826865 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-6d17d14b-f3af-428d-8e4b-e73df53774e2 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:56:34.827506 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-6d17d14b-f3af-428d-8e4b-e73df53774e2 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:56:34.827992 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-6d17d14b-f3af-428d-8e4b-e73df53774e2 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:56:34.838178 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d17d14b-f3af-428d-8e4b-e73df53774e2 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:34.838479 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d17d14b-f3af-428d-8e4b-e73df53774e2 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:34.839054 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d17d14b-f3af-428d-8e4b-e73df53774e2 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:34.839785 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d17d14b-f3af-428d-8e4b-e73df53774e2 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:34.840239 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d17d14b-f3af-428d-8e4b-e73df53774e2 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:34.840662 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6d17d14b-f3af-428d-8e4b-e73df53774e2 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:34.861552 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-6d17d14b-f3af-428d-8e4b-e73df53774e2 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Getting quotas for project bf66494763e5444787ab5156ce2db4bc. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:56:34.867033 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-6d17d14b-f3af-428d-8e4b-e73df53774e2 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Getting quotas for user 580c62de1d3f46afbd51eb4cb49d4ca8 and project bf66494763e5444787ab5156ce2db4bc. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:56:34.879782 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6d17d14b-f3af-428d-8e4b-e73df53774e2 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:56:34.882126 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6d17d14b-f3af-428d-8e4b-e73df53774e2 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] [instance: 58ad0263-9274-439e-a4f5-f4e205fdb571] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:56:34.937701 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6d17d14b-f3af-428d-8e4b-e73df53774e2 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.620036 Aug 31 16:56:34.938555 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3546/7271] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:56:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:56:34.950164 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a580859d-a52f-4f8a-893b-63a1419c50e7 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:34.950869 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a580859d-a52f-4f8a-893b-63a1419c50e7 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] [instance: 58ad0263-9274-439e-a4f5-f4e205fdb571] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:35.008320 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a580859d-a52f-4f8a-893b-63a1419c50e7 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580c62de1d3f46afbd51eb4cb49d4ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf66494763e5444787ab5156ce2db4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:35.016102 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a580859d-a52f-4f8a-893b-63a1419c50e7 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] 10.222.0.50 "GET /compute/v2.1/servers/58ad0263-9274-439e-a4f5-f4e205fdb571" status: 200 len: 1216 microversion: 2.1 time: 0.070479 Aug 31 16:56:35.016850 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3726/7272] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:34 2022] GET /compute/v2.1/servers/58ad0263-9274-439e-a4f5-f4e205fdb571 => generated 1216 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:36.038038 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-99cab26d-2294-4357-ac3a-9954e6000798 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:36.039023 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-99cab26d-2294-4357-ac3a-9954e6000798 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] [instance: 58ad0263-9274-439e-a4f5-f4e205fdb571] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:36.046008 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99cab26d-2294-4357-ac3a-9954e6000798 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:36.046640 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99cab26d-2294-4357-ac3a-9954e6000798 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:36.047291 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99cab26d-2294-4357-ac3a-9954e6000798 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:36.048228 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99cab26d-2294-4357-ac3a-9954e6000798 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:36.048792 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99cab26d-2294-4357-ac3a-9954e6000798 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:36.049449 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99cab26d-2294-4357-ac3a-9954e6000798 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:36.119797 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-99cab26d-2294-4357-ac3a-9954e6000798 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580c62de1d3f46afbd51eb4cb49d4ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf66494763e5444787ab5156ce2db4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:36.128186 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-99cab26d-2294-4357-ac3a-9954e6000798 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] 10.222.0.50 "GET /compute/v2.1/servers/58ad0263-9274-439e-a4f5-f4e205fdb571" status: 200 len: 1276 microversion: 2.1 time: 0.094974 Aug 31 16:56:36.129154 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3547/7273] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:36 2022] GET /compute/v2.1/servers/58ad0263-9274-439e-a4f5-f4e205fdb571 => generated 1276 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:37.152167 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ed7f175f-e99a-4c2c-97e9-b4fff192ab7b tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:37.152826 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ed7f175f-e99a-4c2c-97e9-b4fff192ab7b tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] [instance: 58ad0263-9274-439e-a4f5-f4e205fdb571] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:37.161327 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ed7f175f-e99a-4c2c-97e9-b4fff192ab7b tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:37.161850 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ed7f175f-e99a-4c2c-97e9-b4fff192ab7b tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:37.162318 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ed7f175f-e99a-4c2c-97e9-b4fff192ab7b tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:37.163230 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ed7f175f-e99a-4c2c-97e9-b4fff192ab7b tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:37.163857 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ed7f175f-e99a-4c2c-97e9-b4fff192ab7b tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:37.164468 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ed7f175f-e99a-4c2c-97e9-b4fff192ab7b tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:37.303215 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ed7f175f-e99a-4c2c-97e9-b4fff192ab7b tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580c62de1d3f46afbd51eb4cb49d4ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf66494763e5444787ab5156ce2db4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:37.312367 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ed7f175f-e99a-4c2c-97e9-b4fff192ab7b tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] 10.222.0.50 "GET /compute/v2.1/servers/58ad0263-9274-439e-a4f5-f4e205fdb571" status: 200 len: 1316 microversion: 2.1 time: 0.166976 Aug 31 16:56:37.313412 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3727/7274] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:37 2022] GET /compute/v2.1/servers/58ad0263-9274-439e-a4f5-f4e205fdb571 => generated 1316 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:37.627260 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-60132c27-2572-4683-a492-c6d4e2b8e0d5 req-1e0af1e3-d004-47e2-8f32-69e68567a88a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58ad0263-9274-439e-a4f5-f4e205fdb571", "tag": "efad5c1b-5214-4455-932a-6c2f6b7c8070"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:56:37.645935 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-60132c27-2572-4683-a492-c6d4e2b8e0d5 req-1e0af1e3-d004-47e2-8f32-69e68567a88a service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:37.646592 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-60132c27-2572-4683-a492-c6d4e2b8e0d5 req-1e0af1e3-d004-47e2-8f32-69e68567a88a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:37.647033 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-60132c27-2572-4683-a492-c6d4e2b8e0d5 req-1e0af1e3-d004-47e2-8f32-69e68567a88a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:37.660399 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-60132c27-2572-4683-a492-c6d4e2b8e0d5 req-1e0af1e3-d004-47e2-8f32-69e68567a88a service nova] Creating event network-changed:efad5c1b-5214-4455-932a-6c2f6b7c8070 for instance 58ad0263-9274-439e-a4f5-f4e205fdb571 on n-h1-833090-16 Aug 31 16:56:37.665476 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-60132c27-2572-4683-a492-c6d4e2b8e0d5 req-1e0af1e3-d004-47e2-8f32-69e68567a88a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041983 Aug 31 16:56:37.667159 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3548/7275] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:56:38.336942 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-68d7f1e3-19d1-4a97-babd-784c9c88f2bb tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:38.337676 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-68d7f1e3-19d1-4a97-babd-784c9c88f2bb tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] [instance: 58ad0263-9274-439e-a4f5-f4e205fdb571] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:38.349248 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68d7f1e3-19d1-4a97-babd-784c9c88f2bb tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:38.350018 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68d7f1e3-19d1-4a97-babd-784c9c88f2bb tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:38.350764 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68d7f1e3-19d1-4a97-babd-784c9c88f2bb tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:38.351905 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68d7f1e3-19d1-4a97-babd-784c9c88f2bb tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:38.352667 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68d7f1e3-19d1-4a97-babd-784c9c88f2bb tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:38.353349 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68d7f1e3-19d1-4a97-babd-784c9c88f2bb tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:38.501694 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-68d7f1e3-19d1-4a97-babd-784c9c88f2bb tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580c62de1d3f46afbd51eb4cb49d4ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf66494763e5444787ab5156ce2db4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:38.512611 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-68d7f1e3-19d1-4a97-babd-784c9c88f2bb tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] 10.222.0.50 "GET /compute/v2.1/servers/58ad0263-9274-439e-a4f5-f4e205fdb571" status: 200 len: 1316 microversion: 2.1 time: 0.182599 Aug 31 16:56:38.513199 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3728/7276] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:38 2022] GET /compute/v2.1/servers/58ad0263-9274-439e-a4f5-f4e205fdb571 => generated 1316 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:39.535002 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-774ebd59-f934-447f-8830-fb078001bf99 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:39.535775 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-774ebd59-f934-447f-8830-fb078001bf99 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] [instance: 58ad0263-9274-439e-a4f5-f4e205fdb571] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:39.542267 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-774ebd59-f934-447f-8830-fb078001bf99 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:39.542813 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-774ebd59-f934-447f-8830-fb078001bf99 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:39.543520 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-774ebd59-f934-447f-8830-fb078001bf99 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:39.544399 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-774ebd59-f934-447f-8830-fb078001bf99 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:39.544829 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-774ebd59-f934-447f-8830-fb078001bf99 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:39.545401 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-774ebd59-f934-447f-8830-fb078001bf99 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:39.687126 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-774ebd59-f934-447f-8830-fb078001bf99 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580c62de1d3f46afbd51eb4cb49d4ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf66494763e5444787ab5156ce2db4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:39.694928 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-774ebd59-f934-447f-8830-fb078001bf99 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] 10.222.0.50 "GET /compute/v2.1/servers/58ad0263-9274-439e-a4f5-f4e205fdb571" status: 200 len: 1316 microversion: 2.1 time: 0.165114 Aug 31 16:56:39.695551 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3549/7277] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:39 2022] GET /compute/v2.1/servers/58ad0263-9274-439e-a4f5-f4e205fdb571 => generated 1316 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:40.716466 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-983cf464-8010-47a4-bb62-6f8878ae1ab4 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:40.717110 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-983cf464-8010-47a4-bb62-6f8878ae1ab4 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] [instance: 58ad0263-9274-439e-a4f5-f4e205fdb571] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:40.724929 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-983cf464-8010-47a4-bb62-6f8878ae1ab4 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:40.725444 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-983cf464-8010-47a4-bb62-6f8878ae1ab4 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:40.725897 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-983cf464-8010-47a4-bb62-6f8878ae1ab4 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:40.726651 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-983cf464-8010-47a4-bb62-6f8878ae1ab4 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:40.727127 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-983cf464-8010-47a4-bb62-6f8878ae1ab4 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:40.727663 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-983cf464-8010-47a4-bb62-6f8878ae1ab4 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:40.869046 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-983cf464-8010-47a4-bb62-6f8878ae1ab4 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580c62de1d3f46afbd51eb4cb49d4ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf66494763e5444787ab5156ce2db4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:40.878020 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-983cf464-8010-47a4-bb62-6f8878ae1ab4 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] 10.222.0.50 "GET /compute/v2.1/servers/58ad0263-9274-439e-a4f5-f4e205fdb571" status: 200 len: 1316 microversion: 2.1 time: 0.165920 Aug 31 16:56:40.878617 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3729/7278] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:40 2022] GET /compute/v2.1/servers/58ad0263-9274-439e-a4f5-f4e205fdb571 => generated 1316 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:41.240791 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-f311946a-39b2-4e44-93cb-5e1af7e9527a req-de1c60b6-623f-4879-b9e5-30728561ba10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58ad0263-9274-439e-a4f5-f4e205fdb571", "name": "network-vif-plugged", "status": "completed", "tag": "efad5c1b-5214-4455-932a-6c2f6b7c8070"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:56:41.252178 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f311946a-39b2-4e44-93cb-5e1af7e9527a req-de1c60b6-623f-4879-b9e5-30728561ba10 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:41.252680 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f311946a-39b2-4e44-93cb-5e1af7e9527a req-de1c60b6-623f-4879-b9e5-30728561ba10 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:41.253264 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f311946a-39b2-4e44-93cb-5e1af7e9527a req-de1c60b6-623f-4879-b9e5-30728561ba10 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:41.265582 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-f311946a-39b2-4e44-93cb-5e1af7e9527a req-de1c60b6-623f-4879-b9e5-30728561ba10 service nova] Creating event network-vif-plugged:efad5c1b-5214-4455-932a-6c2f6b7c8070 for instance 58ad0263-9274-439e-a4f5-f4e205fdb571 on n-h1-833090-16 Aug 31 16:56:41.271144 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-f311946a-39b2-4e44-93cb-5e1af7e9527a req-de1c60b6-623f-4879-b9e5-30728561ba10 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034085 Aug 31 16:56:41.271986 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3550/7279] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:56:41.902623 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c714e329-b5d0-41e6-8f24-1b7c670b1cab tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:41.903303 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c714e329-b5d0-41e6-8f24-1b7c670b1cab tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] [instance: 58ad0263-9274-439e-a4f5-f4e205fdb571] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:41.910913 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c714e329-b5d0-41e6-8f24-1b7c670b1cab tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:41.911420 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c714e329-b5d0-41e6-8f24-1b7c670b1cab tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:41.911875 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c714e329-b5d0-41e6-8f24-1b7c670b1cab tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:41.912609 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c714e329-b5d0-41e6-8f24-1b7c670b1cab tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:41.913063 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c714e329-b5d0-41e6-8f24-1b7c670b1cab tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:41.913500 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c714e329-b5d0-41e6-8f24-1b7c670b1cab tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:42.053086 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c714e329-b5d0-41e6-8f24-1b7c670b1cab tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580c62de1d3f46afbd51eb4cb49d4ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf66494763e5444787ab5156ce2db4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:42.065867 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c714e329-b5d0-41e6-8f24-1b7c670b1cab tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] 10.222.0.50 "GET /compute/v2.1/servers/58ad0263-9274-439e-a4f5-f4e205fdb571" status: 200 len: 1316 microversion: 2.1 time: 0.168810 Aug 31 16:56:42.066668 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3730/7280] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:41 2022] GET /compute/v2.1/servers/58ad0263-9274-439e-a4f5-f4e205fdb571 => generated 1316 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:43.092301 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c45fe486-124b-4af5-bd55-6178f452f910 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:43.093018 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c45fe486-124b-4af5-bd55-6178f452f910 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] [instance: 58ad0263-9274-439e-a4f5-f4e205fdb571] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:43.101214 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c45fe486-124b-4af5-bd55-6178f452f910 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:43.101893 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c45fe486-124b-4af5-bd55-6178f452f910 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:43.102517 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c45fe486-124b-4af5-bd55-6178f452f910 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:43.103544 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c45fe486-124b-4af5-bd55-6178f452f910 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:43.104151 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c45fe486-124b-4af5-bd55-6178f452f910 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:43.104642 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c45fe486-124b-4af5-bd55-6178f452f910 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:43.250791 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c45fe486-124b-4af5-bd55-6178f452f910 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580c62de1d3f46afbd51eb4cb49d4ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf66494763e5444787ab5156ce2db4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:43.264591 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c45fe486-124b-4af5-bd55-6178f452f910 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] 10.222.0.50 "GET /compute/v2.1/servers/58ad0263-9274-439e-a4f5-f4e205fdb571" status: 200 len: 1505 microversion: 2.1 time: 0.177511 Aug 31 16:56:43.265515 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3551/7281] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:43 2022] GET /compute/v2.1/servers/58ad0263-9274-439e-a4f5-f4e205fdb571 => generated 1505 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:43.290272 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7951ec22-af36-4789-99f2-0d4bc99c3d8a tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:43.290814 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7951ec22-af36-4789-99f2-0d4bc99c3d8a tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] [instance: 58ad0263-9274-439e-a4f5-f4e205fdb571] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:43.298127 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7951ec22-af36-4789-99f2-0d4bc99c3d8a tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:43.298651 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7951ec22-af36-4789-99f2-0d4bc99c3d8a tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:43.299100 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7951ec22-af36-4789-99f2-0d4bc99c3d8a tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:43.299806 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7951ec22-af36-4789-99f2-0d4bc99c3d8a tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:43.300264 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7951ec22-af36-4789-99f2-0d4bc99c3d8a tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:43.300696 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7951ec22-af36-4789-99f2-0d4bc99c3d8a tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:43.328237 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7951ec22-af36-4789-99f2-0d4bc99c3d8a tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] [instance: 58ad0263-9274-439e-a4f5-f4e205fdb571] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:56:43.413954 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7951ec22-af36-4789-99f2-0d4bc99c3d8a tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] 10.222.0.50 "DELETE /compute/v2.1/servers/58ad0263-9274-439e-a4f5-f4e205fdb571" status: 204 len: 0 microversion: 2.1 time: 0.127126 Aug 31 16:56:43.414801 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3731/7282] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:56:43 2022] DELETE /compute/v2.1/servers/58ad0263-9274-439e-a4f5-f4e205fdb571 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:56:43.424534 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2b3fe4a8-d5fb-480b-91f8-5506d3686f61 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:43.425152 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2b3fe4a8-d5fb-480b-91f8-5506d3686f61 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] [instance: 58ad0263-9274-439e-a4f5-f4e205fdb571] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:43.431660 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2b3fe4a8-d5fb-480b-91f8-5506d3686f61 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:43.432181 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2b3fe4a8-d5fb-480b-91f8-5506d3686f61 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:43.432612 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2b3fe4a8-d5fb-480b-91f8-5506d3686f61 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:43.433765 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2b3fe4a8-d5fb-480b-91f8-5506d3686f61 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:43.434247 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2b3fe4a8-d5fb-480b-91f8-5506d3686f61 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:43.434679 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2b3fe4a8-d5fb-480b-91f8-5506d3686f61 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:43.577394 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2b3fe4a8-d5fb-480b-91f8-5506d3686f61 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580c62de1d3f46afbd51eb4cb49d4ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf66494763e5444787ab5156ce2db4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:43.588626 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2b3fe4a8-d5fb-480b-91f8-5506d3686f61 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] 10.222.0.50 "GET /compute/v2.1/servers/58ad0263-9274-439e-a4f5-f4e205fdb571" status: 200 len: 1511 microversion: 2.1 time: 0.167957 Aug 31 16:56:43.589475 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3552/7283] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:43 2022] GET /compute/v2.1/servers/58ad0263-9274-439e-a4f5-f4e205fdb571 => generated 1511 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:44.619517 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-96a94428-e4a8-4eff-a688-8e546213c2d6 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:44.620469 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-96a94428-e4a8-4eff-a688-8e546213c2d6 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] [instance: 58ad0263-9274-439e-a4f5-f4e205fdb571] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:44.628404 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-96a94428-e4a8-4eff-a688-8e546213c2d6 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:44.628905 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-96a94428-e4a8-4eff-a688-8e546213c2d6 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:44.629354 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-96a94428-e4a8-4eff-a688-8e546213c2d6 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:44.630084 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-96a94428-e4a8-4eff-a688-8e546213c2d6 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:44.630558 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-96a94428-e4a8-4eff-a688-8e546213c2d6 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:44.631012 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-96a94428-e4a8-4eff-a688-8e546213c2d6 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:44.770592 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-96a94428-e4a8-4eff-a688-8e546213c2d6 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580c62de1d3f46afbd51eb4cb49d4ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf66494763e5444787ab5156ce2db4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:44.778925 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-96a94428-e4a8-4eff-a688-8e546213c2d6 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] 10.222.0.50 "GET /compute/v2.1/servers/58ad0263-9274-439e-a4f5-f4e205fdb571" status: 200 len: 1511 microversion: 2.1 time: 0.166481 Aug 31 16:56:44.779618 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3732/7284] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:44 2022] GET /compute/v2.1/servers/58ad0263-9274-439e-a4f5-f4e205fdb571 => generated 1511 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:45.213046 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-063f8936-6d04-40bf-a02c-34cc91ffc715 req-fab58e9e-d94f-4ef0-80a9-b69eac0edf3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58ad0263-9274-439e-a4f5-f4e205fdb571", "name": "network-vif-deleted", "tag": "efad5c1b-5214-4455-932a-6c2f6b7c8070"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:56:45.221079 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:56:45.222889 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:56:45.230814 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-063f8936-6d04-40bf-a02c-34cc91ffc715 req-fab58e9e-d94f-4ef0-80a9-b69eac0edf3f service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:45.231764 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-063f8936-6d04-40bf-a02c-34cc91ffc715 req-fab58e9e-d94f-4ef0-80a9-b69eac0edf3f service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:45.232366 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-063f8936-6d04-40bf-a02c-34cc91ffc715 req-fab58e9e-d94f-4ef0-80a9-b69eac0edf3f service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:45.246145 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-063f8936-6d04-40bf-a02c-34cc91ffc715 req-fab58e9e-d94f-4ef0-80a9-b69eac0edf3f service nova] Creating event network-vif-deleted:efad5c1b-5214-4455-932a-6c2f6b7c8070 for instance 58ad0263-9274-439e-a4f5-f4e205fdb571 on n-h1-833090-16 Aug 31 16:56:45.252326 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-063f8936-6d04-40bf-a02c-34cc91ffc715 req-fab58e9e-d94f-4ef0-80a9-b69eac0edf3f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043900 Aug 31 16:56:45.253120 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3553/7285] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:56:45.801181 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e795c1a3-f8fa-4a78-8184-03307c78c954 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:45.801812 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e795c1a3-f8fa-4a78-8184-03307c78c954 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] [instance: 58ad0263-9274-439e-a4f5-f4e205fdb571] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:45.804108 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:56:45.812343 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e795c1a3-f8fa-4a78-8184-03307c78c954 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:45.813191 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e795c1a3-f8fa-4a78-8184-03307c78c954 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:45.813968 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e795c1a3-f8fa-4a78-8184-03307c78c954 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:45.815117 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e795c1a3-f8fa-4a78-8184-03307c78c954 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:45.815790 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e795c1a3-f8fa-4a78-8184-03307c78c954 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:45.816511 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e795c1a3-f8fa-4a78-8184-03307c78c954 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:45.837360 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-e795c1a3-f8fa-4a78-8184-03307c78c954 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] HTTP exception thrown: Instance 58ad0263-9274-439e-a4f5-f4e205fdb571 could not be found. Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e795c1a3-f8fa-4a78-8184-03307c78c954 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Request method failure captured: Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/58ad0263-9274-439e-a4f5-f4e205fdb571 HTTP/1.1 Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD5K1Fv7JEovzgh4ULXTZ5a1JPCIhC-lZyeqa6UWvZwPS6Gn_LJmqBOwLpjjOZj9tHPExnsqprYQNqH1Jp3SM3MK_pM2Hx9EgZpQw5ibUtr5lksabajeauZCPlpZ2vZ4xLFcY3sCOmuWeblsrR8Jiixrr36B6e_r_EL7v3B0R2o7Vm4s Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: bf66494763e5444787ab5156ce2db4bc Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServersNegativeTestJSON-1333679805 Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bf66494763e5444787ab5156ce2db4bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bf66494763e5444787ab5156ce2db4bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/bf66494763e5444787ab5156ce2db4bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_bf66494763e5444787ab5156ce2db4bc", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServersNegativeTestJSON-1333679805 Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: bf66494763e5444787ab5156ce2db4bc Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1333679805 Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServersNegativeTestJSON-1333679805-project Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 580c62de1d3f46afbd51eb4cb49d4ca8 Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServersNegativeTestJSON-1333679805-project Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 58ad0263-9274-439e-a4f5-f4e205fdb571 could not be found. Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '58ad0263-9274-439e-a4f5-f4e205fdb571'} Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58ad0263-9274-439e-a4f5-f4e205fdb571 could not be found. Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58ad0263-9274-439e-a4f5-f4e205fdb571 could not be found. Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:56:45.839088 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:56:45.844066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:56:45.844066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:56:45.844066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:56:45.844066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:56:45.844066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:56:45.844066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58ad0263-9274-439e-a4f5-f4e205fdb571 could not be found. Aug 31 16:56:45.844066 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:56:45.844066 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e795c1a3-f8fa-4a78-8184-03307c78c954 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Returning 404 to user: Instance 58ad0263-9274-439e-a4f5-f4e205fdb571 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:56:45.844066 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e795c1a3-f8fa-4a78-8184-03307c78c954 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] 10.222.0.50 "GET /compute/v2.1/servers/58ad0263-9274-439e-a4f5-f4e205fdb571" status: 404 len: 111 microversion: 2.1 time: 0.043442 Aug 31 16:56:45.844066 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3733/7286] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:45 2022] GET /compute/v2.1/servers/58ad0263-9274-439e-a4f5-f4e205fdb571 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:56:45.851086 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c01c3d13-3009-49ee-90fb-6615ccbfdce1 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:45.851790 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c01c3d13-3009-49ee-90fb-6615ccbfdce1 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] [instance: 3773864e-7352-41c2-937c-d6bac5be6063] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:45.858824 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c01c3d13-3009-49ee-90fb-6615ccbfdce1 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:45.859302 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c01c3d13-3009-49ee-90fb-6615ccbfdce1 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:45.859776 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c01c3d13-3009-49ee-90fb-6615ccbfdce1 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:45.860441 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c01c3d13-3009-49ee-90fb-6615ccbfdce1 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:45.860884 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c01c3d13-3009-49ee-90fb-6615ccbfdce1 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:45.861301 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c01c3d13-3009-49ee-90fb-6615ccbfdce1 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:46.000260 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c01c3d13-3009-49ee-90fb-6615ccbfdce1 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580c62de1d3f46afbd51eb4cb49d4ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf66494763e5444787ab5156ce2db4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:46.008540 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c01c3d13-3009-49ee-90fb-6615ccbfdce1 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] 10.222.0.50 "GET /compute/v2.1/servers/3773864e-7352-41c2-937c-d6bac5be6063" status: 200 len: 1504 microversion: 2.1 time: 0.161772 Aug 31 16:56:46.009140 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3554/7287] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:45 2022] GET /compute/v2.1/servers/3773864e-7352-41c2-937c-d6bac5be6063 => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:46.031449 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4088723c-92c2-485d-961e-4a72b732e8fb tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:56:46.033775 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4088723c-92c2-485d-961e-4a72b732e8fb tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] [instance: 58405c68-0efd-4c57-9c97-5c7f87fc8aac] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:46.039525 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-4088723c-92c2-485d-961e-4a72b732e8fb tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] HTTP exception thrown: Instance 58405c68-0efd-4c57-9c97-5c7f87fc8aac could not be found. Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4088723c-92c2-485d-961e-4a72b732e8fb tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Request method failure captured: Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: request: POST /compute/v2.1/servers/58405c68-0efd-4c57-9c97-5c7f87fc8aac/action HTTP/1.1 Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 32 Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD5K1Fv7JEovzgh4ULXTZ5a1JPCIhC-lZyeqa6UWvZwPS6Gn_LJmqBOwLpjjOZj9tHPExnsqprYQNqH1Jp3SM3MK_pM2Hx9EgZpQw5ibUtr5lksabajeauZCPlpZ2vZ4xLFcY3sCOmuWeblsrR8Jiixrr36B6e_r_EL7v3B0R2o7Vm4s Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: bf66494763e5444787ab5156ce2db4bc Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServersNegativeTestJSON-1333679805 Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bf66494763e5444787ab5156ce2db4bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bf66494763e5444787ab5156ce2db4bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/bf66494763e5444787ab5156ce2db4bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_bf66494763e5444787ab5156ce2db4bc", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServersNegativeTestJSON-1333679805 Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: bf66494763e5444787ab5156ce2db4bc Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1333679805 Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServersNegativeTestJSON-1333679805-project Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 580c62de1d3f46afbd51eb4cb49d4ca8 Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServersNegativeTestJSON-1333679805-project Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: {"resize": {"flavorRef": "452"}} Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 58405c68-0efd-4c57-9c97-5c7f87fc8aac could not be found. Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '58405c68-0efd-4c57-9c97-5c7f87fc8aac', 'body': {'resize': {'flavorRef': '452'}}} Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58405c68-0efd-4c57-9c97-5c7f87fc8aac could not be found. Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:56:46.041134 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:56:46.045820 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58405c68-0efd-4c57-9c97-5c7f87fc8aac could not be found. Aug 31 16:56:46.045820 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:56:46.045820 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:56:46.045820 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:56:46.045820 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:56:46.045820 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:56:46.045820 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:56:46.045820 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:56:46.045820 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:56:46.045820 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58405c68-0efd-4c57-9c97-5c7f87fc8aac could not be found. Aug 31 16:56:46.045820 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:56:46.045820 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4088723c-92c2-485d-961e-4a72b732e8fb tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Returning 404 to user: Instance 58405c68-0efd-4c57-9c97-5c7f87fc8aac could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:56:46.045820 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4088723c-92c2-485d-961e-4a72b732e8fb tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] 10.222.0.50 "POST /compute/v2.1/servers/58405c68-0efd-4c57-9c97-5c7f87fc8aac/action" status: 404 len: 111 microversion: 2.1 time: 0.017163 Aug 31 16:56:46.045820 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3734/7288] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:56:46 2022] POST /compute/v2.1/servers/58405c68-0efd-4c57-9c97-5c7f87fc8aac/action => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:56:46.053988 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9265127f-03a7-45e1-84d8-351a7f54078d tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:46.054977 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9265127f-03a7-45e1-84d8-351a7f54078d tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] [instance: 3773864e-7352-41c2-937c-d6bac5be6063] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:46.063533 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9265127f-03a7-45e1-84d8-351a7f54078d tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:46.064026 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9265127f-03a7-45e1-84d8-351a7f54078d tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:46.064464 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9265127f-03a7-45e1-84d8-351a7f54078d tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:46.065166 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9265127f-03a7-45e1-84d8-351a7f54078d tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:46.065620 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9265127f-03a7-45e1-84d8-351a7f54078d tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:46.066049 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9265127f-03a7-45e1-84d8-351a7f54078d tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:46.202981 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9265127f-03a7-45e1-84d8-351a7f54078d tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580c62de1d3f46afbd51eb4cb49d4ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf66494763e5444787ab5156ce2db4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:46.211620 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9265127f-03a7-45e1-84d8-351a7f54078d tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] 10.222.0.50 "GET /compute/v2.1/servers/3773864e-7352-41c2-937c-d6bac5be6063" status: 200 len: 1504 microversion: 2.1 time: 0.163777 Aug 31 16:56:46.212225 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3555/7289] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:46 2022] GET /compute/v2.1/servers/3773864e-7352-41c2-937c-d6bac5be6063 => generated 1504 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:46.235090 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-01a6fff1-39df-4ef4-b3bd-984a7f4881d1 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:46.235933 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-01a6fff1-39df-4ef4-b3bd-984a7f4881d1 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] [instance: 3773864e-7352-41c2-937c-d6bac5be6063] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:46.243853 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01a6fff1-39df-4ef4-b3bd-984a7f4881d1 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:46.244387 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01a6fff1-39df-4ef4-b3bd-984a7f4881d1 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:46.244827 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01a6fff1-39df-4ef4-b3bd-984a7f4881d1 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:46.245551 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01a6fff1-39df-4ef4-b3bd-984a7f4881d1 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:46.246020 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01a6fff1-39df-4ef4-b3bd-984a7f4881d1 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:46.246499 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-01a6fff1-39df-4ef4-b3bd-984a7f4881d1 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:46.399478 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-01a6fff1-39df-4ef4-b3bd-984a7f4881d1 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580c62de1d3f46afbd51eb4cb49d4ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf66494763e5444787ab5156ce2db4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:46.407861 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-01a6fff1-39df-4ef4-b3bd-984a7f4881d1 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] 10.222.0.50 "GET /compute/v2.1/servers/3773864e-7352-41c2-937c-d6bac5be6063" status: 200 len: 1504 microversion: 2.1 time: 0.177586 Aug 31 16:56:46.408437 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3735/7290] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:46 2022] GET /compute/v2.1/servers/3773864e-7352-41c2-937c-d6bac5be6063 => generated 1504 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:46.428332 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ed892225-3fb4-4102-947c-951d5435ab96 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "bdecb0b5-ac0f-47ba-86ca-b96a91147acc"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:56:46.430781 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ed892225-3fb4-4102-947c-951d5435ab96 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] [instance: 3773864e-7352-41c2-937c-d6bac5be6063] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:46.439227 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed892225-3fb4-4102-947c-951d5435ab96 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:46.439724 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed892225-3fb4-4102-947c-951d5435ab96 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:46.440132 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed892225-3fb4-4102-947c-951d5435ab96 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:46.440877 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed892225-3fb4-4102-947c-951d5435ab96 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:46.441326 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed892225-3fb4-4102-947c-951d5435ab96 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:46.441745 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ed892225-3fb4-4102-947c-951d5435ab96 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:46.471289 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ed892225-3fb4-4102-947c-951d5435ab96 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '580c62de1d3f46afbd51eb4cb49d4ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf66494763e5444787ab5156ce2db4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:46.476507 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-ed892225-3fb4-4102-947c-951d5435ab96 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] HTTP exception thrown: Flavor bdecb0b5-ac0f-47ba-86ca-b96a91147acc could not be found. Aug 31 16:56:46.478521 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ed892225-3fb4-4102-947c-951d5435ab96 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Request method failure captured: Aug 31 16:56:46.478521 n-d-833090-16 devstack@n-api.service[128863]: request: POST /compute/v2.1/servers/3773864e-7352-41c2-937c-d6bac5be6063/action HTTP/1.1 Aug 31 16:56:46.478521 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:56:46.478521 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:56:46.478521 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:56:46.478521 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 65 Aug 31 16:56:46.478521 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:56:46.478521 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:56:46.478521 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:56:46.478521 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:56:46.478521 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD5K1Fv7JEovzgh4ULXTZ5a1JPCIhC-lZyeqa6UWvZwPS6Gn_LJmqBOwLpjjOZj9tHPExnsqprYQNqH1Jp3SM3MK_pM2Hx9EgZpQw5ibUtr5lksabajeauZCPlpZ2vZ4xLFcY3sCOmuWeblsrR8Jiixrr36B6e_r_EL7v3B0R2o7Vm4s Aug 31 16:56:46.478521 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:56:46.478521 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:56:46.478521 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:56:46.478521 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:56:46.478521 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:56:46.478521 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:56:46.478521 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: bf66494763e5444787ab5156ce2db4bc Aug 31 16:56:46.478521 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersNegativeTestJSON-1333679805 Aug 31 16:56:46.478521 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:56:46.478521 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:56:46.478521 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bf66494763e5444787ab5156ce2db4bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bf66494763e5444787ab5156ce2db4bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/bf66494763e5444787ab5156ce2db4bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_bf66494763e5444787ab5156ce2db4bc", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:56:46.478521 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServersNegativeTestJSON-1333679805 Aug 31 16:56:46.478521 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: bf66494763e5444787ab5156ce2db4bc Aug 31 16:56:46.478521 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1333679805 Aug 31 16:56:46.478521 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServersNegativeTestJSON-1333679805-project Aug 31 16:56:46.478521 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:56:46.478521 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:56:46.478521 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 580c62de1d3f46afbd51eb4cb49d4ca8 Aug 31 16:56:46.478521 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServersNegativeTestJSON-1333679805-project Aug 31 16:56:46.478521 n-d-833090-16 devstack@n-api.service[128863]: Aug 31 16:56:46.478521 n-d-833090-16 devstack@n-api.service[128863]: {"resize": {"flavorRef": "bdecb0b5-ac0f-47ba-86ca-b96a91147acc"}} Aug 31 16:56:46.478521 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:56:46.478521 n-d-833090-16 devstack@n-api.service[128863]: exception: Flavor bdecb0b5-ac0f-47ba-86ca-b96a91147acc could not be found. Aug 31 16:56:46.478521 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '3773864e-7352-41c2-937c-d6bac5be6063', 'body': {'resize': {'flavorRef': 'bdecb0b5-ac0f-47ba-86ca-b96a91147acc'}}} Aug 31 16:56:46.478521 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:56:46.478521 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:56:46.478521 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 31 16:56:46.478521 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 31 16:56:46.478521 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 31 16:56:46.478521 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 16:56:46.478521 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 31 16:56:46.478521 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 31 16:56:46.478521 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 31 16:56:46.478521 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 31 16:56:46.478521 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 31 16:56:46.478521 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 16:56:46.478521 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 31 16:56:46.478521 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 31 16:56:46.478521 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 31 16:56:46.478521 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 31 16:56:46.478521 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4198, in resize Aug 31 16:56:46.478521 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Aug 31 16:56:46.478521 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 31 16:56:46.478521 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 31 16:56:46.478521 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 16:56:46.478521 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 16:56:46.478521 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 31 16:56:46.478521 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 31 16:56:46.478521 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 31 16:56:46.478521 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:56:46.478521 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 31 16:56:46.483300 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 31 16:56:46.483300 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor bdecb0b5-ac0f-47ba-86ca-b96a91147acc could not be found. Aug 31 16:56:46.483300 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:56:46.483300 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:56:46.483300 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:56:46.483300 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:56:46.483300 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:56:46.483300 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:56:46.483300 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:56:46.483300 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:56:46.483300 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:56:46.483300 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:56:46.483300 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 31 16:56:46.483300 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 31 16:56:46.483300 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 31 16:56:46.483300 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 31 16:56:46.483300 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Aug 31 16:56:46.483300 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 31 16:56:46.483300 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor bdecb0b5-ac0f-47ba-86ca-b96a91147acc could not be found. Aug 31 16:56:46.483300 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:56:46.483300 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:56:46.483300 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:56:46.483300 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:56:46.483300 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:56:46.483300 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:56:46.483300 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:56:46.483300 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:56:46.483300 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor bdecb0b5-ac0f-47ba-86ca-b96a91147acc could not be found. Aug 31 16:56:46.483300 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:56:46.483300 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ed892225-3fb4-4102-947c-951d5435ab96 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Returning 400 to user: Flavor bdecb0b5-ac0f-47ba-86ca-b96a91147acc could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:56:46.483300 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ed892225-3fb4-4102-947c-951d5435ab96 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] 10.222.0.50 "POST /compute/v2.1/servers/3773864e-7352-41c2-937c-d6bac5be6063/action" status: 400 len: 107 microversion: 2.1 time: 0.055708 Aug 31 16:56:46.483300 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3556/7291] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:56:46 2022] POST /compute/v2.1/servers/3773864e-7352-41c2-937c-d6bac5be6063/action => generated 107 bytes in 57 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:56:46.490830 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0bdee621-e1b0-49e9-9262-33cc3e5e69c5 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:46.491779 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0bdee621-e1b0-49e9-9262-33cc3e5e69c5 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] [instance: 3773864e-7352-41c2-937c-d6bac5be6063] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:46.500954 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0bdee621-e1b0-49e9-9262-33cc3e5e69c5 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:46.501726 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0bdee621-e1b0-49e9-9262-33cc3e5e69c5 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:46.502528 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0bdee621-e1b0-49e9-9262-33cc3e5e69c5 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:46.503662 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0bdee621-e1b0-49e9-9262-33cc3e5e69c5 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:46.504349 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0bdee621-e1b0-49e9-9262-33cc3e5e69c5 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:46.504846 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0bdee621-e1b0-49e9-9262-33cc3e5e69c5 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:46.642540 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0bdee621-e1b0-49e9-9262-33cc3e5e69c5 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580c62de1d3f46afbd51eb4cb49d4ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf66494763e5444787ab5156ce2db4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:46.654852 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0bdee621-e1b0-49e9-9262-33cc3e5e69c5 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] 10.222.0.50 "GET /compute/v2.1/servers/3773864e-7352-41c2-937c-d6bac5be6063" status: 200 len: 1504 microversion: 2.1 time: 0.169203 Aug 31 16:56:46.655482 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3736/7292] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:46 2022] GET /compute/v2.1/servers/3773864e-7352-41c2-937c-d6bac5be6063 => generated 1504 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:46.676147 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-57b21111-7d3e-4c6f-a790-0c61c19685ce tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:46.676753 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-57b21111-7d3e-4c6f-a790-0c61c19685ce tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] [instance: 3773864e-7352-41c2-937c-d6bac5be6063] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:46.684365 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57b21111-7d3e-4c6f-a790-0c61c19685ce tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:46.685025 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57b21111-7d3e-4c6f-a790-0c61c19685ce tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:46.686118 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57b21111-7d3e-4c6f-a790-0c61c19685ce tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:46.686686 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57b21111-7d3e-4c6f-a790-0c61c19685ce tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:46.687150 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57b21111-7d3e-4c6f-a790-0c61c19685ce tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:46.687678 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-57b21111-7d3e-4c6f-a790-0c61c19685ce tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:46.826448 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-57b21111-7d3e-4c6f-a790-0c61c19685ce tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580c62de1d3f46afbd51eb4cb49d4ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf66494763e5444787ab5156ce2db4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:46.835062 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-57b21111-7d3e-4c6f-a790-0c61c19685ce tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] 10.222.0.50 "GET /compute/v2.1/servers/3773864e-7352-41c2-937c-d6bac5be6063" status: 200 len: 1504 microversion: 2.1 time: 0.162853 Aug 31 16:56:46.835625 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3557/7293] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:46 2022] GET /compute/v2.1/servers/3773864e-7352-41c2-937c-d6bac5be6063 => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:46.857906 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6207c8c5-0f0d-4bd8-8048-262b53b4305c tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6207c8c5-0f0d-4bd8-8048-262b53b4305c tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Request method failure captured: Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: request: POST /compute/v2.1/servers/3773864e-7352-41c2-937c-d6bac5be6063/action HTTP/1.1 Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 29 Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD5K1Fv7JEovzgh4ULXTZ5a1JPCIhC-lZyeqa6UWvZwPS6Gn_LJmqBOwLpjjOZj9tHPExnsqprYQNqH1Jp3SM3MK_pM2Hx9EgZpQw5ibUtr5lksabajeauZCPlpZ2vZ4xLFcY3sCOmuWeblsrR8Jiixrr36B6e_r_EL7v3B0R2o7Vm4s Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: bf66494763e5444787ab5156ce2db4bc Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServersNegativeTestJSON-1333679805 Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bf66494763e5444787ab5156ce2db4bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bf66494763e5444787ab5156ce2db4bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/bf66494763e5444787ab5156ce2db4bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_bf66494763e5444787ab5156ce2db4bc", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServersNegativeTestJSON-1333679805 Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: bf66494763e5444787ab5156ce2db4bc Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1333679805 Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServersNegativeTestJSON-1333679805-project Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 580c62de1d3f46afbd51eb4cb49d4ca8 Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServersNegativeTestJSON-1333679805-project Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: {"resize": {"flavorRef": ""}} Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '3773864e-7352-41c2-937c-d6bac5be6063', 'body': {'resize': {'flavorRef': ''}}} Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise error Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi On instance['resize']: Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi '' Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:56:46.861573 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:56:46.866484 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:56:46.866484 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:56:46.866484 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:56:46.866484 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:56:46.866484 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 31 16:56:46.866484 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 31 16:56:46.866484 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 31 16:56:46.866484 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:56:46.866484 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6207c8c5-0f0d-4bd8-8048-262b53b4305c tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:56:46.866484 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6207c8c5-0f0d-4bd8-8048-262b53b4305c tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] 10.222.0.50 "POST /compute/v2.1/servers/3773864e-7352-41c2-937c-d6bac5be6063/action" status: 400 len: 113 microversion: 2.1 time: 0.009471 Aug 31 16:56:46.867226 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3737/7294] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 16:56:46 2022] POST /compute/v2.1/servers/3773864e-7352-41c2-937c-d6bac5be6063/action => generated 113 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 16:56:46.871976 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9650550c-1487-48cf-b1dc-c2afec38d473 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:46.872678 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9650550c-1487-48cf-b1dc-c2afec38d473 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] [instance: 3773864e-7352-41c2-937c-d6bac5be6063] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:46.879087 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9650550c-1487-48cf-b1dc-c2afec38d473 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:46.879573 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9650550c-1487-48cf-b1dc-c2afec38d473 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:46.879999 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9650550c-1487-48cf-b1dc-c2afec38d473 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:46.880682 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9650550c-1487-48cf-b1dc-c2afec38d473 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:46.881129 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9650550c-1487-48cf-b1dc-c2afec38d473 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:46.881542 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9650550c-1487-48cf-b1dc-c2afec38d473 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:47.012620 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9650550c-1487-48cf-b1dc-c2afec38d473 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580c62de1d3f46afbd51eb4cb49d4ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf66494763e5444787ab5156ce2db4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:47.020820 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9650550c-1487-48cf-b1dc-c2afec38d473 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] 10.222.0.50 "GET /compute/v2.1/servers/3773864e-7352-41c2-937c-d6bac5be6063" status: 200 len: 1504 microversion: 2.1 time: 0.152857 Aug 31 16:56:47.021404 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3558/7295] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:46 2022] GET /compute/v2.1/servers/3773864e-7352-41c2-937c-d6bac5be6063 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:47.045522 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5b5dcb70-f42e-4c97-86c8-6d757266eba8 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:47.045918 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5b5dcb70-f42e-4c97-86c8-6d757266eba8 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] [instance: 58ad0263-9274-439e-a4f5-f4e205fdb571] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:47.054443 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5b5dcb70-f42e-4c97-86c8-6d757266eba8 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:47.054941 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5b5dcb70-f42e-4c97-86c8-6d757266eba8 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:47.055387 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5b5dcb70-f42e-4c97-86c8-6d757266eba8 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:47.056094 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5b5dcb70-f42e-4c97-86c8-6d757266eba8 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:47.056556 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5b5dcb70-f42e-4c97-86c8-6d757266eba8 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:47.056989 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5b5dcb70-f42e-4c97-86c8-6d757266eba8 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:47.071524 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-5b5dcb70-f42e-4c97-86c8-6d757266eba8 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] HTTP exception thrown: Instance 58ad0263-9274-439e-a4f5-f4e205fdb571 could not be found. Aug 31 16:56:47.073101 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5b5dcb70-f42e-4c97-86c8-6d757266eba8 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Request method failure captured: Aug 31 16:56:47.073101 n-d-833090-16 devstack@n-api.service[128864]: request: DELETE /compute/v2.1/servers/58ad0263-9274-439e-a4f5-f4e205fdb571 HTTP/1.1 Aug 31 16:56:47.073101 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 16:56:47.073101 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 16:56:47.073101 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 16:56:47.073101 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 16:56:47.073101 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 16:56:47.073101 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 16:56:47.073101 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 16:56:47.073101 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 16:56:47.073101 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD5K1Fv7JEovzgh4ULXTZ5a1JPCIhC-lZyeqa6UWvZwPS6Gn_LJmqBOwLpjjOZj9tHPExnsqprYQNqH1Jp3SM3MK_pM2Hx9EgZpQw5ibUtr5lksabajeauZCPlpZ2vZ4xLFcY3sCOmuWeblsrR8Jiixrr36B6e_r_EL7v3B0R2o7Vm4s Aug 31 16:56:47.073101 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 16:56:47.073101 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 16:56:47.073101 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 16:56:47.073101 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 16:56:47.073101 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 16:56:47.073101 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 16:56:47.073101 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: bf66494763e5444787ab5156ce2db4bc Aug 31 16:56:47.073101 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-ServersNegativeTestJSON-1333679805 Aug 31 16:56:47.073101 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 16:56:47.073101 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 16:56:47.073101 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bf66494763e5444787ab5156ce2db4bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bf66494763e5444787ab5156ce2db4bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/bf66494763e5444787ab5156ce2db4bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_bf66494763e5444787ab5156ce2db4bc", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:56:47.073101 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-ServersNegativeTestJSON-1333679805 Aug 31 16:56:47.073101 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: bf66494763e5444787ab5156ce2db4bc Aug 31 16:56:47.073101 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1333679805 Aug 31 16:56:47.073101 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-ServersNegativeTestJSON-1333679805-project Aug 31 16:56:47.073101 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 16:56:47.073101 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 16:56:47.073101 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 580c62de1d3f46afbd51eb4cb49d4ca8 Aug 31 16:56:47.073101 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-ServersNegativeTestJSON-1333679805-project Aug 31 16:56:47.073101 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 16:56:47.073101 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 58ad0263-9274-439e-a4f5-f4e205fdb571 could not be found. Aug 31 16:56:47.073101 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '58ad0263-9274-439e-a4f5-f4e205fdb571'} Aug 31 16:56:47.073101 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:56:47.073101 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:56:47.073101 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:56:47.073101 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:56:47.073101 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:56:47.073101 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:56:47.073101 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:56:47.073101 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:56:47.073101 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:56:47.073101 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:56:47.073101 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58ad0263-9274-439e-a4f5-f4e205fdb571 could not be found. Aug 31 16:56:47.073101 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:56:47.073101 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:56:47.073101 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:56:47.073101 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:56:47.073101 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:56:47.073101 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:56:47.073101 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:56:47.073101 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:56:47.073101 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:56:47.073101 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:56:47.073101 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 31 16:56:47.073101 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 31 16:56:47.073101 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 31 16:56:47.073101 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 31 16:56:47.073101 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:56:47.073101 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:56:47.073101 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:56:47.073101 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:56:47.078967 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58ad0263-9274-439e-a4f5-f4e205fdb571 could not be found. Aug 31 16:56:47.078967 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:56:47.078967 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:56:47.078967 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:56:47.078967 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:56:47.078967 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:56:47.078967 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:56:47.078967 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:56:47.078967 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:56:47.078967 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58ad0263-9274-439e-a4f5-f4e205fdb571 could not be found. Aug 31 16:56:47.078967 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 16:56:47.078967 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5b5dcb70-f42e-4c97-86c8-6d757266eba8 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Returning 404 to user: Instance 58ad0263-9274-439e-a4f5-f4e205fdb571 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:56:47.078967 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5b5dcb70-f42e-4c97-86c8-6d757266eba8 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] 10.222.0.50 "DELETE /compute/v2.1/servers/58ad0263-9274-439e-a4f5-f4e205fdb571" status: 404 len: 111 microversion: 2.1 time: 0.034066 Aug 31 16:56:47.078967 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3738/7296] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:56:47 2022] DELETE /compute/v2.1/servers/58ad0263-9274-439e-a4f5-f4e205fdb571 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:56:47.083950 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-05100fd4-09b0-47cc-bf47-10a2c83ef97f tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:47.084561 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-05100fd4-09b0-47cc-bf47-10a2c83ef97f tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] [instance: 58ad0263-9274-439e-a4f5-f4e205fdb571] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:47.092545 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05100fd4-09b0-47cc-bf47-10a2c83ef97f tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:47.093038 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05100fd4-09b0-47cc-bf47-10a2c83ef97f tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:47.093476 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05100fd4-09b0-47cc-bf47-10a2c83ef97f tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:47.094254 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05100fd4-09b0-47cc-bf47-10a2c83ef97f tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:47.094733 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05100fd4-09b0-47cc-bf47-10a2c83ef97f tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:47.095240 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05100fd4-09b0-47cc-bf47-10a2c83ef97f tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:47.110714 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-05100fd4-09b0-47cc-bf47-10a2c83ef97f tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] HTTP exception thrown: Instance 58ad0263-9274-439e-a4f5-f4e205fdb571 could not be found. Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-05100fd4-09b0-47cc-bf47-10a2c83ef97f tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Request method failure captured: Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/58ad0263-9274-439e-a4f5-f4e205fdb571 HTTP/1.1 Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD5K1Fv7JEovzgh4ULXTZ5a1JPCIhC-lZyeqa6UWvZwPS6Gn_LJmqBOwLpjjOZj9tHPExnsqprYQNqH1Jp3SM3MK_pM2Hx9EgZpQw5ibUtr5lksabajeauZCPlpZ2vZ4xLFcY3sCOmuWeblsrR8Jiixrr36B6e_r_EL7v3B0R2o7Vm4s Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: bf66494763e5444787ab5156ce2db4bc Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersNegativeTestJSON-1333679805 Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bf66494763e5444787ab5156ce2db4bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bf66494763e5444787ab5156ce2db4bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/bf66494763e5444787ab5156ce2db4bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_bf66494763e5444787ab5156ce2db4bc", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServersNegativeTestJSON-1333679805 Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: bf66494763e5444787ab5156ce2db4bc Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1333679805 Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServersNegativeTestJSON-1333679805-project Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 580c62de1d3f46afbd51eb4cb49d4ca8 Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServersNegativeTestJSON-1333679805-project Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 58ad0263-9274-439e-a4f5-f4e205fdb571 could not be found. Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '58ad0263-9274-439e-a4f5-f4e205fdb571'} Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58ad0263-9274-439e-a4f5-f4e205fdb571 could not be found. Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58ad0263-9274-439e-a4f5-f4e205fdb571 could not be found. Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:56:47.112288 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:56:47.116179 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:56:47.116179 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:56:47.116179 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:56:47.116179 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:56:47.116179 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:56:47.116179 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58ad0263-9274-439e-a4f5-f4e205fdb571 could not be found. Aug 31 16:56:47.116179 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:56:47.116179 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-05100fd4-09b0-47cc-bf47-10a2c83ef97f tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Returning 404 to user: Instance 58ad0263-9274-439e-a4f5-f4e205fdb571 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:56:47.116179 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-05100fd4-09b0-47cc-bf47-10a2c83ef97f tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] 10.222.0.50 "GET /compute/v2.1/servers/58ad0263-9274-439e-a4f5-f4e205fdb571" status: 404 len: 111 microversion: 2.1 time: 0.034105 Aug 31 16:56:47.116179 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3559/7297] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:47 2022] GET /compute/v2.1/servers/58ad0263-9274-439e-a4f5-f4e205fdb571 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:56:47.123952 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-bd8892a6-97e6-4163-9103-773e966100cb tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:47.124456 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-bd8892a6-97e6-4163-9103-773e966100cb tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] [instance: 3773864e-7352-41c2-937c-d6bac5be6063] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:47.131215 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bd8892a6-97e6-4163-9103-773e966100cb tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:47.131706 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bd8892a6-97e6-4163-9103-773e966100cb tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:47.132146 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bd8892a6-97e6-4163-9103-773e966100cb tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:47.132838 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bd8892a6-97e6-4163-9103-773e966100cb tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:47.133304 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bd8892a6-97e6-4163-9103-773e966100cb tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:47.133732 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bd8892a6-97e6-4163-9103-773e966100cb tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:47.160840 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-bd8892a6-97e6-4163-9103-773e966100cb tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] [instance: 3773864e-7352-41c2-937c-d6bac5be6063] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:56:47.175407 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:56:47.250851 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-bd8892a6-97e6-4163-9103-773e966100cb tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3773864e-7352-41c2-937c-d6bac5be6063" status: 204 len: 0 microversion: 2.1 time: 0.130759 Aug 31 16:56:47.251571 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3739/7298] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:56:47 2022] DELETE /compute/v2.1/servers/3773864e-7352-41c2-937c-d6bac5be6063 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:56:47.263057 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b5c8b80e-25ce-4a00-b408-2f1d4d0bd243 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:47.264585 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b5c8b80e-25ce-4a00-b408-2f1d4d0bd243 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] [instance: 3773864e-7352-41c2-937c-d6bac5be6063] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:47.270143 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5c8b80e-25ce-4a00-b408-2f1d4d0bd243 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:47.270637 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5c8b80e-25ce-4a00-b408-2f1d4d0bd243 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:47.271070 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5c8b80e-25ce-4a00-b408-2f1d4d0bd243 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:47.271750 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5c8b80e-25ce-4a00-b408-2f1d4d0bd243 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:47.272196 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5c8b80e-25ce-4a00-b408-2f1d4d0bd243 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:47.272613 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5c8b80e-25ce-4a00-b408-2f1d4d0bd243 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:47.413020 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b5c8b80e-25ce-4a00-b408-2f1d4d0bd243 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580c62de1d3f46afbd51eb4cb49d4ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf66494763e5444787ab5156ce2db4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:47.421929 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b5c8b80e-25ce-4a00-b408-2f1d4d0bd243 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] 10.222.0.50 "GET /compute/v2.1/servers/3773864e-7352-41c2-937c-d6bac5be6063" status: 200 len: 1510 microversion: 2.1 time: 0.165335 Aug 31 16:56:47.422545 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3560/7299] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:47 2022] GET /compute/v2.1/servers/3773864e-7352-41c2-937c-d6bac5be6063 => generated 1510 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:48.444697 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1ba04ee4-d575-4c2b-957f-959fecb1aa2e tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:48.445410 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1ba04ee4-d575-4c2b-957f-959fecb1aa2e tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] [instance: 3773864e-7352-41c2-937c-d6bac5be6063] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:48.453698 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1ba04ee4-d575-4c2b-957f-959fecb1aa2e tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:48.454343 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1ba04ee4-d575-4c2b-957f-959fecb1aa2e tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:48.454801 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1ba04ee4-d575-4c2b-957f-959fecb1aa2e tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:48.455775 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1ba04ee4-d575-4c2b-957f-959fecb1aa2e tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:48.456244 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1ba04ee4-d575-4c2b-957f-959fecb1aa2e tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:48.456785 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1ba04ee4-d575-4c2b-957f-959fecb1aa2e tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:48.621080 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1ba04ee4-d575-4c2b-957f-959fecb1aa2e tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580c62de1d3f46afbd51eb4cb49d4ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf66494763e5444787ab5156ce2db4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:48.629646 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1ba04ee4-d575-4c2b-957f-959fecb1aa2e tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] 10.222.0.50 "GET /compute/v2.1/servers/3773864e-7352-41c2-937c-d6bac5be6063" status: 200 len: 1510 microversion: 2.1 time: 0.189394 Aug 31 16:56:48.630279 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3740/7300] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:48 2022] GET /compute/v2.1/servers/3773864e-7352-41c2-937c-d6bac5be6063 => generated 1510 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:49.591942 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-f915aaff-7a91-440d-9bcc-b68f0dff3261 req-31f3f0e9-4904-4f25-a8f9-f63c0e2b5609 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3773864e-7352-41c2-937c-d6bac5be6063", "name": "network-vif-deleted", "tag": "9468b150-6eaa-4530-9b57-12e5c7d42d6c"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:56:49.605072 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f915aaff-7a91-440d-9bcc-b68f0dff3261 req-31f3f0e9-4904-4f25-a8f9-f63c0e2b5609 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:49.605916 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f915aaff-7a91-440d-9bcc-b68f0dff3261 req-31f3f0e9-4904-4f25-a8f9-f63c0e2b5609 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:49.606631 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-f915aaff-7a91-440d-9bcc-b68f0dff3261 req-31f3f0e9-4904-4f25-a8f9-f63c0e2b5609 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:49.618377 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=100 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:56:49.620993 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-f915aaff-7a91-440d-9bcc-b68f0dff3261 req-31f3f0e9-4904-4f25-a8f9-f63c0e2b5609 service nova] Creating event network-vif-deleted:9468b150-6eaa-4530-9b57-12e5c7d42d6c for instance 3773864e-7352-41c2-937c-d6bac5be6063 on n-h2-833090-16 Aug 31 16:56:49.628422 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-f915aaff-7a91-440d-9bcc-b68f0dff3261 req-31f3f0e9-4904-4f25-a8f9-f63c0e2b5609 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039401 Aug 31 16:56:49.628422 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3561/7301] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:56:49.651557 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-34084ff2-ea92-4456-9165-2b5df79191ce tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:49.652224 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-34084ff2-ea92-4456-9165-2b5df79191ce tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] [instance: 3773864e-7352-41c2-937c-d6bac5be6063] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:49.659426 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-34084ff2-ea92-4456-9165-2b5df79191ce tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:49.660289 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-34084ff2-ea92-4456-9165-2b5df79191ce tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:49.660805 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-34084ff2-ea92-4456-9165-2b5df79191ce tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:49.661590 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-34084ff2-ea92-4456-9165-2b5df79191ce tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:49.662149 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-34084ff2-ea92-4456-9165-2b5df79191ce tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:49.662680 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-34084ff2-ea92-4456-9165-2b5df79191ce tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:49.739063 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-34084ff2-ea92-4456-9165-2b5df79191ce tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '580c62de1d3f46afbd51eb4cb49d4ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf66494763e5444787ab5156ce2db4bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:56:49.748984 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-34084ff2-ea92-4456-9165-2b5df79191ce tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] 10.222.0.50 "GET /compute/v2.1/servers/3773864e-7352-41c2-937c-d6bac5be6063" status: 200 len: 1301 microversion: 2.1 time: 0.101396 Aug 31 16:56:49.749609 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3741/7302] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:49 2022] GET /compute/v2.1/servers/3773864e-7352-41c2-937c-d6bac5be6063 => generated 1301 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:56:50.775227 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cadc5822-2884-4a76-9d53-c2c128fa7d13 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:56:50.775931 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cadc5822-2884-4a76-9d53-c2c128fa7d13 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] [instance: 3773864e-7352-41c2-937c-d6bac5be6063] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:56:50.783900 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cadc5822-2884-4a76-9d53-c2c128fa7d13 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:50.784395 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cadc5822-2884-4a76-9d53-c2c128fa7d13 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:50.784833 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cadc5822-2884-4a76-9d53-c2c128fa7d13 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:50.785531 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cadc5822-2884-4a76-9d53-c2c128fa7d13 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:56:50.785990 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cadc5822-2884-4a76-9d53-c2c128fa7d13 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:56:50.786450 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cadc5822-2884-4a76-9d53-c2c128fa7d13 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:56:50.800658 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-cadc5822-2884-4a76-9d53-c2c128fa7d13 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] HTTP exception thrown: Instance 3773864e-7352-41c2-937c-d6bac5be6063 could not be found. Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cadc5822-2884-4a76-9d53-c2c128fa7d13 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Request method failure captured: Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/3773864e-7352-41c2-937c-d6bac5be6063 HTTP/1.1 Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD5K1Fv7JEovzgh4ULXTZ5a1JPCIhC-lZyeqa6UWvZwPS6Gn_LJmqBOwLpjjOZj9tHPExnsqprYQNqH1Jp3SM3MK_pM2Hx9EgZpQw5ibUtr5lksabajeauZCPlpZ2vZ4xLFcY3sCOmuWeblsrR8Jiixrr36B6e_r_EL7v3B0R2o7Vm4s Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: bf66494763e5444787ab5156ce2db4bc Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-ServersNegativeTestJSON-1333679805 Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bf66494763e5444787ab5156ce2db4bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bf66494763e5444787ab5156ce2db4bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/bf66494763e5444787ab5156ce2db4bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_bf66494763e5444787ab5156ce2db4bc", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-ServersNegativeTestJSON-1333679805 Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: bf66494763e5444787ab5156ce2db4bc Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1333679805 Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-ServersNegativeTestJSON-1333679805-project Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 580c62de1d3f46afbd51eb4cb49d4ca8 Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-ServersNegativeTestJSON-1333679805-project Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 3773864e-7352-41c2-937c-d6bac5be6063 could not be found. Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '3773864e-7352-41c2-937c-d6bac5be6063'} Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3773864e-7352-41c2-937c-d6bac5be6063 could not be found. Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3773864e-7352-41c2-937c-d6bac5be6063 could not be found. Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:56:50.802355 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:56:50.806977 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:56:50.806977 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:56:50.806977 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:56:50.806977 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:56:50.806977 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:56:50.806977 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3773864e-7352-41c2-937c-d6bac5be6063 could not be found. Aug 31 16:56:50.806977 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:56:50.806977 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cadc5822-2884-4a76-9d53-c2c128fa7d13 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] Returning 404 to user: Instance 3773864e-7352-41c2-937c-d6bac5be6063 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:56:50.806977 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cadc5822-2884-4a76-9d53-c2c128fa7d13 tempest-ServersNegativeTestJSON-1333679805 tempest-ServersNegativeTestJSON-1333679805-project] 10.222.0.50 "GET /compute/v2.1/servers/3773864e-7352-41c2-937c-d6bac5be6063" status: 404 len: 111 microversion: 2.1 time: 0.036839 Aug 31 16:56:50.806977 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3562/7303] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:56:50 2022] GET /compute/v2.1/servers/3773864e-7352-41c2-937c-d6bac5be6063 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:57:25.343623 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:57:25.345226 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=18,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:57:25.520302 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-73be527f-1cc5-49be-90ad-3c3bc8bcafe5 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Action: 'create', calling method: .version_select at 0x7fbb4aa648b0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1378511372", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzL8qqxu7aZBPl3MVUM/W4HWInEaNfxIHBCrsOtSRewkn4XcRcHBUMZDv2nUbQ+VShnfa6xakLcxdY/O+xVax29l5OYk2jPUCY/4Cgw9gi7M7cfn5m3wV/6J1uYKCMwpQ=="}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:57:25.538119 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-73be527f-1cc5-49be-90ad-3c3bc8bcafe5 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Getting quotas for project 4717eb8248cf443399bccb20803e9b85. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:57:25.543855 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-73be527f-1cc5-49be-90ad-3c3bc8bcafe5 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Getting quotas for user a5e27993067f4ba5afde34f0610a7829 and project 4717eb8248cf443399bccb20803e9b85. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:57:25.576405 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-73be527f-1cc5-49be-90ad-3c3bc8bcafe5 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.238459 Aug 31 16:57:25.577407 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3742/7304] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 31 16:57:25 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:57:25.643373 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4243503f-ad79-4ca5-982d-8e285ff75dce tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-371185832", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1378511372", "networks": [{"uuid": "f41ec376-a588-4557-8383-4b1ad66263a0"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:57:25.653131 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:57:25.653817 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:57:25.707331 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-4243503f-ad79-4ca5-982d-8e285ff75dce tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] validate_networks() for [('f41ec376-a588-4557-8383-4b1ad66263a0', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:57:26.130023 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-4243503f-ad79-4ca5-982d-8e285ff75dce tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:57:26.130634 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-4243503f-ad79-4ca5-982d-8e285ff75dce tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:57:26.131160 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-4243503f-ad79-4ca5-982d-8e285ff75dce tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:57:26.131799 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-4243503f-ad79-4ca5-982d-8e285ff75dce tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:57:26.132279 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-4243503f-ad79-4ca5-982d-8e285ff75dce tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:57:26.142437 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4243503f-ad79-4ca5-982d-8e285ff75dce tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:26.143626 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4243503f-ad79-4ca5-982d-8e285ff75dce tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:26.144223 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4243503f-ad79-4ca5-982d-8e285ff75dce tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:26.145042 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4243503f-ad79-4ca5-982d-8e285ff75dce tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:26.145593 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4243503f-ad79-4ca5-982d-8e285ff75dce tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:26.146120 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4243503f-ad79-4ca5-982d-8e285ff75dce tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:26.168587 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-4243503f-ad79-4ca5-982d-8e285ff75dce tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Getting quotas for project 4717eb8248cf443399bccb20803e9b85. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:57:26.175006 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-4243503f-ad79-4ca5-982d-8e285ff75dce tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Getting quotas for user a5e27993067f4ba5afde34f0610a7829 and project 4717eb8248cf443399bccb20803e9b85. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:57:26.190288 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4243503f-ad79-4ca5-982d-8e285ff75dce tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:57:26.192765 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4243503f-ad79-4ca5-982d-8e285ff75dce tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: ec81755a-ff2f-4921-a12b-d85af0b7d2d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:57:26.243635 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4243503f-ad79-4ca5-982d-8e285ff75dce tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.604311 Aug 31 16:57:26.244592 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3563/7305] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:57:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:57:26.256230 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7f387115-2269-4101-b03f-d259a15b0858 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:26.256873 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7f387115-2269-4101-b03f-d259a15b0858 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: ec81755a-ff2f-4921-a12b-d85af0b7d2d0] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:26.342080 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7f387115-2269-4101-b03f-d259a15b0858 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e27993067f4ba5afde34f0610a7829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717eb8248cf443399bccb20803e9b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:57:26.355879 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7f387115-2269-4101-b03f-d259a15b0858 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/ec81755a-ff2f-4921-a12b-d85af0b7d2d0" status: 200 len: 1262 microversion: 2.1 time: 0.104184 Aug 31 16:57:26.356567 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3743/7306] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:57:26 2022] GET /compute/v2.1/servers/ec81755a-ff2f-4921-a12b-d85af0b7d2d0 => generated 1262 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:57:27.380944 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5d2d7734-5b95-47d1-b14e-9e80f0576b55 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:27.382515 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5d2d7734-5b95-47d1-b14e-9e80f0576b55 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: ec81755a-ff2f-4921-a12b-d85af0b7d2d0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:27.392117 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d2d7734-5b95-47d1-b14e-9e80f0576b55 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:27.393701 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d2d7734-5b95-47d1-b14e-9e80f0576b55 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:27.394407 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d2d7734-5b95-47d1-b14e-9e80f0576b55 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:27.395652 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d2d7734-5b95-47d1-b14e-9e80f0576b55 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:27.396386 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d2d7734-5b95-47d1-b14e-9e80f0576b55 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:27.396844 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5d2d7734-5b95-47d1-b14e-9e80f0576b55 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:27.469757 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5d2d7734-5b95-47d1-b14e-9e80f0576b55 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e27993067f4ba5afde34f0610a7829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717eb8248cf443399bccb20803e9b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:57:27.479364 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5d2d7734-5b95-47d1-b14e-9e80f0576b55 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/ec81755a-ff2f-4921-a12b-d85af0b7d2d0" status: 200 len: 1322 microversion: 2.1 time: 0.105848 Aug 31 16:57:27.493110 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3564/7307] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:57:27 2022] GET /compute/v2.1/servers/ec81755a-ff2f-4921-a12b-d85af0b7d2d0 => generated 1322 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:57:28.505663 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-da98fd05-0106-4b97-bf81-ea1af34d5076 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:28.507090 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-da98fd05-0106-4b97-bf81-ea1af34d5076 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: ec81755a-ff2f-4921-a12b-d85af0b7d2d0] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:28.513637 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-da98fd05-0106-4b97-bf81-ea1af34d5076 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:28.514165 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-da98fd05-0106-4b97-bf81-ea1af34d5076 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:28.514726 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-da98fd05-0106-4b97-bf81-ea1af34d5076 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:28.515476 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-da98fd05-0106-4b97-bf81-ea1af34d5076 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:28.515922 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-da98fd05-0106-4b97-bf81-ea1af34d5076 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:28.516776 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-da98fd05-0106-4b97-bf81-ea1af34d5076 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:28.705372 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-da98fd05-0106-4b97-bf81-ea1af34d5076 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e27993067f4ba5afde34f0610a7829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717eb8248cf443399bccb20803e9b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:57:28.714412 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-da98fd05-0106-4b97-bf81-ea1af34d5076 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/ec81755a-ff2f-4921-a12b-d85af0b7d2d0" status: 200 len: 1362 microversion: 2.1 time: 0.216814 Aug 31 16:57:28.715362 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3744/7308] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:57:28 2022] GET /compute/v2.1/servers/ec81755a-ff2f-4921-a12b-d85af0b7d2d0 => generated 1362 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:57:29.161556 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-0519d99e-1a78-4ccf-9ffa-3d2b1f973e9e req-3b9f884b-65c2-4631-b1b0-985bbfa8a9a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec81755a-ff2f-4921-a12b-d85af0b7d2d0", "tag": "ace7c094-6814-4deb-b9c3-7615f7c095d0"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:57:29.174476 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-0519d99e-1a78-4ccf-9ffa-3d2b1f973e9e req-3b9f884b-65c2-4631-b1b0-985bbfa8a9a2 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:29.175272 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-0519d99e-1a78-4ccf-9ffa-3d2b1f973e9e req-3b9f884b-65c2-4631-b1b0-985bbfa8a9a2 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:29.175947 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-0519d99e-1a78-4ccf-9ffa-3d2b1f973e9e req-3b9f884b-65c2-4631-b1b0-985bbfa8a9a2 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:29.189569 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-0519d99e-1a78-4ccf-9ffa-3d2b1f973e9e req-3b9f884b-65c2-4631-b1b0-985bbfa8a9a2 service nova] Creating event network-changed:ace7c094-6814-4deb-b9c3-7615f7c095d0 for instance ec81755a-ff2f-4921-a12b-d85af0b7d2d0 on n-h2-833090-16 Aug 31 16:57:29.200749 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-0519d99e-1a78-4ccf-9ffa-3d2b1f973e9e req-3b9f884b-65c2-4631-b1b0-985bbfa8a9a2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044247 Aug 31 16:57:29.201472 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3565/7309] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:57:29.736508 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e841e2f3-74e1-4870-ad7f-12ea18ed0d23 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:29.737247 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e841e2f3-74e1-4870-ad7f-12ea18ed0d23 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: ec81755a-ff2f-4921-a12b-d85af0b7d2d0] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:29.745291 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e841e2f3-74e1-4870-ad7f-12ea18ed0d23 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:29.745798 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e841e2f3-74e1-4870-ad7f-12ea18ed0d23 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:29.746276 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e841e2f3-74e1-4870-ad7f-12ea18ed0d23 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:29.746988 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e841e2f3-74e1-4870-ad7f-12ea18ed0d23 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:29.747452 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e841e2f3-74e1-4870-ad7f-12ea18ed0d23 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:29.747885 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e841e2f3-74e1-4870-ad7f-12ea18ed0d23 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:29.882741 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e841e2f3-74e1-4870-ad7f-12ea18ed0d23 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e27993067f4ba5afde34f0610a7829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717eb8248cf443399bccb20803e9b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:57:29.891073 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e841e2f3-74e1-4870-ad7f-12ea18ed0d23 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/ec81755a-ff2f-4921-a12b-d85af0b7d2d0" status: 200 len: 1362 microversion: 2.1 time: 0.159148 Aug 31 16:57:29.891662 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3745/7310] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:57:29 2022] GET /compute/v2.1/servers/ec81755a-ff2f-4921-a12b-d85af0b7d2d0 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:57:30.914515 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-04fb8a11-aa02-4a0f-99f6-00c1a992c889 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:30.915258 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-04fb8a11-aa02-4a0f-99f6-00c1a992c889 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: ec81755a-ff2f-4921-a12b-d85af0b7d2d0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:30.922757 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04fb8a11-aa02-4a0f-99f6-00c1a992c889 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:30.923247 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04fb8a11-aa02-4a0f-99f6-00c1a992c889 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:30.923689 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04fb8a11-aa02-4a0f-99f6-00c1a992c889 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:30.924453 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04fb8a11-aa02-4a0f-99f6-00c1a992c889 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:30.924910 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04fb8a11-aa02-4a0f-99f6-00c1a992c889 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:30.925339 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04fb8a11-aa02-4a0f-99f6-00c1a992c889 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:31.105467 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-04fb8a11-aa02-4a0f-99f6-00c1a992c889 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e27993067f4ba5afde34f0610a7829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717eb8248cf443399bccb20803e9b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:57:31.114931 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-04fb8a11-aa02-4a0f-99f6-00c1a992c889 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/ec81755a-ff2f-4921-a12b-d85af0b7d2d0" status: 200 len: 1362 microversion: 2.1 time: 0.205658 Aug 31 16:57:31.115520 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3566/7311] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:57:30 2022] GET /compute/v2.1/servers/ec81755a-ff2f-4921-a12b-d85af0b7d2d0 => generated 1362 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:57:32.138658 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b965f9ba-0d7c-41e7-83cd-d10ad65f7206 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:32.139378 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b965f9ba-0d7c-41e7-83cd-d10ad65f7206 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: ec81755a-ff2f-4921-a12b-d85af0b7d2d0] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:32.147535 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b965f9ba-0d7c-41e7-83cd-d10ad65f7206 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:32.148710 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b965f9ba-0d7c-41e7-83cd-d10ad65f7206 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:32.149172 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b965f9ba-0d7c-41e7-83cd-d10ad65f7206 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:32.150113 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b965f9ba-0d7c-41e7-83cd-d10ad65f7206 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:32.150618 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b965f9ba-0d7c-41e7-83cd-d10ad65f7206 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:32.151028 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b965f9ba-0d7c-41e7-83cd-d10ad65f7206 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:32.296870 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b965f9ba-0d7c-41e7-83cd-d10ad65f7206 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e27993067f4ba5afde34f0610a7829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717eb8248cf443399bccb20803e9b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:57:32.305886 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b965f9ba-0d7c-41e7-83cd-d10ad65f7206 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/ec81755a-ff2f-4921-a12b-d85af0b7d2d0" status: 200 len: 1362 microversion: 2.1 time: 0.171280 Aug 31 16:57:32.306642 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3746/7312] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:57:32 2022] GET /compute/v2.1/servers/ec81755a-ff2f-4921-a12b-d85af0b7d2d0 => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:57:33.330187 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ac3463ef-0e25-4cd7-9613-594a04e762d1 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:33.331098 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ac3463ef-0e25-4cd7-9613-594a04e762d1 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: ec81755a-ff2f-4921-a12b-d85af0b7d2d0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:33.338669 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ac3463ef-0e25-4cd7-9613-594a04e762d1 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:33.339160 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ac3463ef-0e25-4cd7-9613-594a04e762d1 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:33.339596 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ac3463ef-0e25-4cd7-9613-594a04e762d1 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:33.340281 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ac3463ef-0e25-4cd7-9613-594a04e762d1 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:33.340725 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ac3463ef-0e25-4cd7-9613-594a04e762d1 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:33.341141 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ac3463ef-0e25-4cd7-9613-594a04e762d1 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:33.482379 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ac3463ef-0e25-4cd7-9613-594a04e762d1 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e27993067f4ba5afde34f0610a7829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717eb8248cf443399bccb20803e9b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:57:33.493185 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ac3463ef-0e25-4cd7-9613-594a04e762d1 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/ec81755a-ff2f-4921-a12b-d85af0b7d2d0" status: 200 len: 1362 microversion: 2.1 time: 0.168720 Aug 31 16:57:33.493787 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3567/7313] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:57:33 2022] GET /compute/v2.1/servers/ec81755a-ff2f-4921-a12b-d85af0b7d2d0 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:57:34.514397 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4d69ef7d-a59b-4b19-b6fd-272e06189ee1 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:34.515105 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4d69ef7d-a59b-4b19-b6fd-272e06189ee1 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: ec81755a-ff2f-4921-a12b-d85af0b7d2d0] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:34.523874 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4d69ef7d-a59b-4b19-b6fd-272e06189ee1 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:34.524554 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4d69ef7d-a59b-4b19-b6fd-272e06189ee1 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:34.525103 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4d69ef7d-a59b-4b19-b6fd-272e06189ee1 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:34.526051 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4d69ef7d-a59b-4b19-b6fd-272e06189ee1 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:34.526546 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4d69ef7d-a59b-4b19-b6fd-272e06189ee1 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:34.526989 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4d69ef7d-a59b-4b19-b6fd-272e06189ee1 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:34.670715 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4d69ef7d-a59b-4b19-b6fd-272e06189ee1 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e27993067f4ba5afde34f0610a7829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717eb8248cf443399bccb20803e9b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:57:34.679591 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-88db2eb9-a164-4877-a6d4-1d4972093550 req-475056ea-5a03-43f9-8de5-56c48826ce90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec81755a-ff2f-4921-a12b-d85af0b7d2d0", "name": "network-vif-plugged", "status": "completed", "tag": "ace7c094-6814-4deb-b9c3-7615f7c095d0"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:57:34.680168 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4d69ef7d-a59b-4b19-b6fd-272e06189ee1 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/ec81755a-ff2f-4921-a12b-d85af0b7d2d0" status: 200 len: 1362 microversion: 2.1 time: 0.169693 Aug 31 16:57:34.681020 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3747/7314] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:57:34 2022] GET /compute/v2.1/servers/ec81755a-ff2f-4921-a12b-d85af0b7d2d0 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:57:34.692210 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-88db2eb9-a164-4877-a6d4-1d4972093550 req-475056ea-5a03-43f9-8de5-56c48826ce90 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:34.693027 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-88db2eb9-a164-4877-a6d4-1d4972093550 req-475056ea-5a03-43f9-8de5-56c48826ce90 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:34.693521 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-88db2eb9-a164-4877-a6d4-1d4972093550 req-475056ea-5a03-43f9-8de5-56c48826ce90 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:34.705400 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-88db2eb9-a164-4877-a6d4-1d4972093550 req-475056ea-5a03-43f9-8de5-56c48826ce90 service nova] Creating event network-vif-plugged:ace7c094-6814-4deb-b9c3-7615f7c095d0 for instance ec81755a-ff2f-4921-a12b-d85af0b7d2d0 on n-h2-833090-16 Aug 31 16:57:34.710869 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-88db2eb9-a164-4877-a6d4-1d4972093550 req-475056ea-5a03-43f9-8de5-56c48826ce90 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035253 Aug 31 16:57:34.711655 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3568/7315] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:57:35.703504 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f5738932-0b28-45f0-9461-baedaeac6423 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:35.704112 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f5738932-0b28-45f0-9461-baedaeac6423 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: ec81755a-ff2f-4921-a12b-d85af0b7d2d0] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:35.712263 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f5738932-0b28-45f0-9461-baedaeac6423 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:35.712737 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f5738932-0b28-45f0-9461-baedaeac6423 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:35.713187 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f5738932-0b28-45f0-9461-baedaeac6423 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:35.713896 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f5738932-0b28-45f0-9461-baedaeac6423 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:35.714399 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f5738932-0b28-45f0-9461-baedaeac6423 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:35.714836 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f5738932-0b28-45f0-9461-baedaeac6423 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:35.866732 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f5738932-0b28-45f0-9461-baedaeac6423 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e27993067f4ba5afde34f0610a7829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717eb8248cf443399bccb20803e9b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:57:35.879181 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f5738932-0b28-45f0-9461-baedaeac6423 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/ec81755a-ff2f-4921-a12b-d85af0b7d2d0" status: 200 len: 1362 microversion: 2.1 time: 0.179275 Aug 31 16:57:35.879808 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3748/7316] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:57:35 2022] GET /compute/v2.1/servers/ec81755a-ff2f-4921-a12b-d85af0b7d2d0 => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:57:36.899490 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:57:36.900286 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:57:36.904439 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-02d963d6-86d8-427d-a963-bb436cfa4840 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:36.905167 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-02d963d6-86d8-427d-a963-bb436cfa4840 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: ec81755a-ff2f-4921-a12b-d85af0b7d2d0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:36.912749 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02d963d6-86d8-427d-a963-bb436cfa4840 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:36.913230 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02d963d6-86d8-427d-a963-bb436cfa4840 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:36.913665 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02d963d6-86d8-427d-a963-bb436cfa4840 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:36.914415 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02d963d6-86d8-427d-a963-bb436cfa4840 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:36.914870 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02d963d6-86d8-427d-a963-bb436cfa4840 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:36.915295 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02d963d6-86d8-427d-a963-bb436cfa4840 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:37.064406 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-02d963d6-86d8-427d-a963-bb436cfa4840 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e27993067f4ba5afde34f0610a7829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717eb8248cf443399bccb20803e9b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:57:37.080464 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-02d963d6-86d8-427d-a963-bb436cfa4840 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/ec81755a-ff2f-4921-a12b-d85af0b7d2d0" status: 200 len: 1554 microversion: 2.1 time: 0.182339 Aug 31 16:57:37.081395 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3569/7317] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:57:36 2022] GET /compute/v2.1/servers/ec81755a-ff2f-4921-a12b-d85af0b7d2d0 => generated 1554 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:57:37.103307 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0de960ff-08d4-44c0-bf39-d604167de1ab tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:37.103720 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0de960ff-08d4-44c0-bf39-d604167de1ab tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: ec81755a-ff2f-4921-a12b-d85af0b7d2d0] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:37.105322 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=6 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:57:37.111577 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0de960ff-08d4-44c0-bf39-d604167de1ab tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:37.112076 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0de960ff-08d4-44c0-bf39-d604167de1ab tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:37.112525 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0de960ff-08d4-44c0-bf39-d604167de1ab tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:37.113235 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0de960ff-08d4-44c0-bf39-d604167de1ab tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:37.113771 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0de960ff-08d4-44c0-bf39-d604167de1ab tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:37.114401 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0de960ff-08d4-44c0-bf39-d604167de1ab tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:37.259036 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0de960ff-08d4-44c0-bf39-d604167de1ab tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e27993067f4ba5afde34f0610a7829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717eb8248cf443399bccb20803e9b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:57:37.267516 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0de960ff-08d4-44c0-bf39-d604167de1ab tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/ec81755a-ff2f-4921-a12b-d85af0b7d2d0" status: 200 len: 1554 microversion: 2.1 time: 0.169085 Aug 31 16:57:37.268113 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3749/7318] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:57:37 2022] GET /compute/v2.1/servers/ec81755a-ff2f-4921-a12b-d85af0b7d2d0 => generated 1554 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:57:39.004036 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-70cc3607-6d98-4ba5-b661-d5b34ae425a4 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8b65a8a9-336f-4b28-8da7-94d1492b3694"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:57:39.006750 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-70cc3607-6d98-4ba5-b661-d5b34ae425a4 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: ec81755a-ff2f-4921-a12b-d85af0b7d2d0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:39.013976 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70cc3607-6d98-4ba5-b661-d5b34ae425a4 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:39.014524 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70cc3607-6d98-4ba5-b661-d5b34ae425a4 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:39.014961 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70cc3607-6d98-4ba5-b661-d5b34ae425a4 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:39.015656 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70cc3607-6d98-4ba5-b661-d5b34ae425a4 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:39.016107 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70cc3607-6d98-4ba5-b661-d5b34ae425a4 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:39.016531 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70cc3607-6d98-4ba5-b661-d5b34ae425a4 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:39.315206 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-70cc3607-6d98-4ba5-b661-d5b34ae425a4 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "POST /compute/v2.1/servers/ec81755a-ff2f-4921-a12b-d85af0b7d2d0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.315104 Aug 31 16:57:39.316905 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3570/7319] 10.222.0.50 () {60 vars in 1323 bytes} [Wed Aug 31 16:57:38 2022] POST /compute/v2.1/servers/ec81755a-ff2f-4921-a12b-d85af0b7d2d0/os-volume_attachments => generated 194 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:57:51.136708 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-424ba4a2-75ac-4e2d-9d6d-682a99cf270c tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:51.137276 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-424ba4a2-75ac-4e2d-9d6d-682a99cf270c tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: ec81755a-ff2f-4921-a12b-d85af0b7d2d0] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:51.140392 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:57:51.141197 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=36 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:57:51.148432 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-424ba4a2-75ac-4e2d-9d6d-682a99cf270c tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:51.148950 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-424ba4a2-75ac-4e2d-9d6d-682a99cf270c tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:51.149405 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-424ba4a2-75ac-4e2d-9d6d-682a99cf270c tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:51.150144 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-424ba4a2-75ac-4e2d-9d6d-682a99cf270c tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:51.150615 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-424ba4a2-75ac-4e2d-9d6d-682a99cf270c tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:51.151047 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-424ba4a2-75ac-4e2d-9d6d-682a99cf270c tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:51.244498 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-424ba4a2-75ac-4e2d-9d6d-682a99cf270c tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lazy-loading 'services' on Instance uuid ec81755a-ff2f-4921-a12b-d85af0b7d2d0 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:57:51.329177 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-424ba4a2-75ac-4e2d-9d6d-682a99cf270c tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ec81755a-ff2f-4921-a12b-d85af0b7d2d0/os-volume_attachments/8b65a8a9-336f-4b28-8da7-94d1492b3694" status: 202 len: 0 microversion: 2.1 time: 0.198923 Aug 31 16:57:51.329799 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3750/7320] 10.222.0.50 () {58 vars in 1416 bytes} [Wed Aug 31 16:57:51 2022] DELETE /compute/v2.1/servers/ec81755a-ff2f-4921-a12b-d85af0b7d2d0/os-volume_attachments/8b65a8a9-336f-4b28-8da7-94d1492b3694 => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:57:51.336721 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:57:51.337552 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:57:51.342271 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-594478a0-2e65-4b8d-a16e-2c5184fbe89a tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:51.344923 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-594478a0-2e65-4b8d-a16e-2c5184fbe89a tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: ec81755a-ff2f-4921-a12b-d85af0b7d2d0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:51.353710 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-594478a0-2e65-4b8d-a16e-2c5184fbe89a tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:51.354234 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-594478a0-2e65-4b8d-a16e-2c5184fbe89a tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:51.354673 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-594478a0-2e65-4b8d-a16e-2c5184fbe89a tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:51.355372 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-594478a0-2e65-4b8d-a16e-2c5184fbe89a tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:51.355821 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-594478a0-2e65-4b8d-a16e-2c5184fbe89a tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:51.356240 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-594478a0-2e65-4b8d-a16e-2c5184fbe89a tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:51.391398 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-594478a0-2e65-4b8d-a16e-2c5184fbe89a tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/ec81755a-ff2f-4921-a12b-d85af0b7d2d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056471 Aug 31 16:57:51.392026 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3571/7321] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:57:51 2022] GET /compute/v2.1/servers/ec81755a-ff2f-4921-a12b-d85af0b7d2d0/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:57:52.405343 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b8da640a-bd71-47fb-a745-ce009923817a tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:52.408217 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b8da640a-bd71-47fb-a745-ce009923817a tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: ec81755a-ff2f-4921-a12b-d85af0b7d2d0] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:52.415243 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b8da640a-bd71-47fb-a745-ce009923817a tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:52.415735 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b8da640a-bd71-47fb-a745-ce009923817a tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:52.416204 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b8da640a-bd71-47fb-a745-ce009923817a tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:52.416912 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b8da640a-bd71-47fb-a745-ce009923817a tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:52.417369 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b8da640a-bd71-47fb-a745-ce009923817a tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:52.417796 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b8da640a-bd71-47fb-a745-ce009923817a tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:52.451596 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b8da640a-bd71-47fb-a745-ce009923817a tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/ec81755a-ff2f-4921-a12b-d85af0b7d2d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051671 Aug 31 16:57:52.452443 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3751/7322] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:57:52 2022] GET /compute/v2.1/servers/ec81755a-ff2f-4921-a12b-d85af0b7d2d0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:57:53.466982 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-32394df1-0e3b-49cd-b5d7-24e86c89c52f tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:53.470139 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-32394df1-0e3b-49cd-b5d7-24e86c89c52f tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: ec81755a-ff2f-4921-a12b-d85af0b7d2d0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:53.480504 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-32394df1-0e3b-49cd-b5d7-24e86c89c52f tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:53.481171 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-32394df1-0e3b-49cd-b5d7-24e86c89c52f tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:53.481701 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-32394df1-0e3b-49cd-b5d7-24e86c89c52f tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:53.482796 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-32394df1-0e3b-49cd-b5d7-24e86c89c52f tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:53.483394 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-32394df1-0e3b-49cd-b5d7-24e86c89c52f tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:53.483976 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-32394df1-0e3b-49cd-b5d7-24e86c89c52f tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:53.518607 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-32394df1-0e3b-49cd-b5d7-24e86c89c52f tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/ec81755a-ff2f-4921-a12b-d85af0b7d2d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058043 Aug 31 16:57:53.519126 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3572/7323] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:57:53 2022] GET /compute/v2.1/servers/ec81755a-ff2f-4921-a12b-d85af0b7d2d0/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:57:54.532301 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-88642a13-a1ba-42a9-8989-d7ccc61de266 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:54.534961 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-88642a13-a1ba-42a9-8989-d7ccc61de266 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: ec81755a-ff2f-4921-a12b-d85af0b7d2d0] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:54.542474 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-88642a13-a1ba-42a9-8989-d7ccc61de266 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:54.542986 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-88642a13-a1ba-42a9-8989-d7ccc61de266 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:54.543431 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-88642a13-a1ba-42a9-8989-d7ccc61de266 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:54.544152 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-88642a13-a1ba-42a9-8989-d7ccc61de266 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:54.544605 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-88642a13-a1ba-42a9-8989-d7ccc61de266 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:54.545034 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-88642a13-a1ba-42a9-8989-d7ccc61de266 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:54.578434 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-88642a13-a1ba-42a9-8989-d7ccc61de266 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/ec81755a-ff2f-4921-a12b-d85af0b7d2d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050816 Aug 31 16:57:54.579263 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3752/7324] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:57:54 2022] GET /compute/v2.1/servers/ec81755a-ff2f-4921-a12b-d85af0b7d2d0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:57:55.591576 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d2cc468a-6f78-4c9b-97f2-e9a084495aa2 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:55.593807 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d2cc468a-6f78-4c9b-97f2-e9a084495aa2 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: ec81755a-ff2f-4921-a12b-d85af0b7d2d0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:55.601586 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2cc468a-6f78-4c9b-97f2-e9a084495aa2 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:55.602076 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2cc468a-6f78-4c9b-97f2-e9a084495aa2 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:55.604567 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2cc468a-6f78-4c9b-97f2-e9a084495aa2 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:55.605281 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2cc468a-6f78-4c9b-97f2-e9a084495aa2 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:55.605739 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2cc468a-6f78-4c9b-97f2-e9a084495aa2 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:55.606189 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2cc468a-6f78-4c9b-97f2-e9a084495aa2 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:55.641315 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d2cc468a-6f78-4c9b-97f2-e9a084495aa2 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/ec81755a-ff2f-4921-a12b-d85af0b7d2d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053854 Aug 31 16:57:55.641957 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3573/7325] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:57:55 2022] GET /compute/v2.1/servers/ec81755a-ff2f-4921-a12b-d85af0b7d2d0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:57:56.654915 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a97d4c73-bb4a-4c9b-af9f-1b0c1d6cba04 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:56.657358 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a97d4c73-bb4a-4c9b-af9f-1b0c1d6cba04 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: ec81755a-ff2f-4921-a12b-d85af0b7d2d0] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:56.665255 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a97d4c73-bb4a-4c9b-af9f-1b0c1d6cba04 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:56.665760 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a97d4c73-bb4a-4c9b-af9f-1b0c1d6cba04 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:56.666249 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a97d4c73-bb4a-4c9b-af9f-1b0c1d6cba04 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:56.666944 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a97d4c73-bb4a-4c9b-af9f-1b0c1d6cba04 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:56.667411 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a97d4c73-bb4a-4c9b-af9f-1b0c1d6cba04 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:56.667851 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a97d4c73-bb4a-4c9b-af9f-1b0c1d6cba04 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:56.700160 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a97d4c73-bb4a-4c9b-af9f-1b0c1d6cba04 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/ec81755a-ff2f-4921-a12b-d85af0b7d2d0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049414 Aug 31 16:57:56.700727 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3753/7326] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:57:56 2022] GET /compute/v2.1/servers/ec81755a-ff2f-4921-a12b-d85af0b7d2d0/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:57:56.712166 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8bc400a5-76e3-4ee9-bfbf-364dcb314c0e tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:57:56.712703 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8bc400a5-76e3-4ee9-bfbf-364dcb314c0e tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: ec81755a-ff2f-4921-a12b-d85af0b7d2d0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:57:56.720216 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8bc400a5-76e3-4ee9-bfbf-364dcb314c0e tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:56.720730 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8bc400a5-76e3-4ee9-bfbf-364dcb314c0e tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:56.721142 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8bc400a5-76e3-4ee9-bfbf-364dcb314c0e tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:56.721840 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8bc400a5-76e3-4ee9-bfbf-364dcb314c0e tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:57:56.722330 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8bc400a5-76e3-4ee9-bfbf-364dcb314c0e tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:57:56.722779 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8bc400a5-76e3-4ee9-bfbf-364dcb314c0e tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:57:56.809558 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-8bc400a5-76e3-4ee9-bfbf-364dcb314c0e tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] HTTP exception thrown: Instance ec81755a-ff2f-4921-a12b-d85af0b7d2d0 is not attached to volume 8b65a8a9-336f-4b28-8da7-94d1492b3694 Aug 31 16:57:56.817742 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8bc400a5-76e3-4ee9-bfbf-364dcb314c0e tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Request method failure captured: Aug 31 16:57:56.817742 n-d-833090-16 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/ec81755a-ff2f-4921-a12b-d85af0b7d2d0/os-volume_attachments/8b65a8a9-336f-4b28-8da7-94d1492b3694 HTTP/1.1 Aug 31 16:57:56.817742 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:57:56.817742 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:57:56.817742 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:57:56.817742 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:57:56.817742 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:57:56.817742 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:57:56.817742 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:57:56.817742 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:57:56.817742 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD5LwDmp3jobNFtE4uyAwxVYvJFjRljMaREe6cJ9Cbi4kQ2YMLHlE38z7o3zcni9D0S6eJ5gQ1PmOvNq5MRl4sfXJ66b68a7_MG1Bwc7deyRdriMGc70E4kOPX2-FuyfpVWT0ghtkR4MT33-EasM-0WcfnqatrMan9xqdyj9JI5BvNYQ Aug 31 16:57:56.817742 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:57:56.817742 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:57:56.817742 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:57:56.817742 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:57:56.817742 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:57:56.817742 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:57:56.817742 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 4717eb8248cf443399bccb20803e9b85 Aug 31 16:57:56.817742 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1350692395 Aug 31 16:57:56.817742 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:57:56.817742 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:57:56.817742 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4717eb8248cf443399bccb20803e9b85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4717eb8248cf443399bccb20803e9b85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4717eb8248cf443399bccb20803e9b85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4717eb8248cf443399bccb20803e9b85", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:57:56.817742 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-TestEncryptedCinderVolumes-1350692395 Aug 31 16:57:56.817742 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 4717eb8248cf443399bccb20803e9b85 Aug 31 16:57:56.817742 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1350692395 Aug 31 16:57:56.817742 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-TestEncryptedCinderVolumes-1350692395-project Aug 31 16:57:56.817742 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:57:56.817742 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:57:56.817742 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: a5e27993067f4ba5afde34f0610a7829 Aug 31 16:57:56.817742 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-TestEncryptedCinderVolumes-1350692395-project Aug 31 16:57:56.817742 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:57:56.817742 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance ec81755a-ff2f-4921-a12b-d85af0b7d2d0 is not attached to volume 8b65a8a9-336f-4b28-8da7-94d1492b3694 Aug 31 16:57:56.817742 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'server_id': 'ec81755a-ff2f-4921-a12b-d85af0b7d2d0', 'id': '8b65a8a9-336f-4b28-8da7-94d1492b3694'} Aug 31 16:57:56.817742 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:57:56.817742 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:57:56.817742 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 31 16:57:56.817742 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 31 16:57:56.817742 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 16:57:56.817742 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 16:57:56.817742 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 31 16:57:56.817742 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 31 16:57:56.817742 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 8b65a8a9-336f-4b28-8da7-94d1492b3694. Aug 31 16:57:56.817742 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:57:56.817742 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:57:56.817742 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:57:56.817742 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:57:56.817742 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:57:56.817742 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:57:56.817742 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:57:56.817742 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:57:56.817742 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:57:56.817742 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:57:56.817742 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 31 16:57:56.817742 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 31 16:57:56.817742 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec81755a-ff2f-4921-a12b-d85af0b7d2d0 is not attached to volume 8b65a8a9-336f-4b28-8da7-94d1492b3694 Aug 31 16:57:56.817742 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:57:56.817742 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:57:56.817742 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:57:56.817742 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:57:56.817742 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:57:56.817742 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:57:56.822762 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:57:56.822762 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:57:56.822762 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec81755a-ff2f-4921-a12b-d85af0b7d2d0 is not attached to volume 8b65a8a9-336f-4b28-8da7-94d1492b3694 Aug 31 16:57:56.822762 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:57:56.822762 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8bc400a5-76e3-4ee9-bfbf-364dcb314c0e tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Returning 404 to user: Instance ec81755a-ff2f-4921-a12b-d85af0b7d2d0 is not attached to volume 8b65a8a9-336f-4b28-8da7-94d1492b3694 {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:57:56.822762 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8bc400a5-76e3-4ee9-bfbf-364dcb314c0e tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ec81755a-ff2f-4921-a12b-d85af0b7d2d0/os-volume_attachments/8b65a8a9-336f-4b28-8da7-94d1492b3694" status: 404 len: 154 microversion: 2.1 time: 0.111238 Aug 31 16:57:56.822762 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3574/7327] 10.222.0.50 () {58 vars in 1416 bytes} [Wed Aug 31 16:57:56 2022] DELETE /compute/v2.1/servers/ec81755a-ff2f-4921-a12b-d85af0b7d2d0/os-volume_attachments/8b65a8a9-336f-4b28-8da7-94d1492b3694 => generated 154 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:58:00.196569 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b5fafc92-25d4-4efd-84ee-128b3434145d tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:00.197106 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b5fafc92-25d4-4efd-84ee-128b3434145d tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: ec81755a-ff2f-4921-a12b-d85af0b7d2d0] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:00.204359 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b5fafc92-25d4-4efd-84ee-128b3434145d tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:00.204855 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b5fafc92-25d4-4efd-84ee-128b3434145d tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:00.205308 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b5fafc92-25d4-4efd-84ee-128b3434145d tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:00.206014 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b5fafc92-25d4-4efd-84ee-128b3434145d tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:00.206551 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b5fafc92-25d4-4efd-84ee-128b3434145d tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:00.206994 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b5fafc92-25d4-4efd-84ee-128b3434145d tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:00.236081 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b5fafc92-25d4-4efd-84ee-128b3434145d tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: ec81755a-ff2f-4921-a12b-d85af0b7d2d0] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:58:00.327194 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b5fafc92-25d4-4efd-84ee-128b3434145d tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ec81755a-ff2f-4921-a12b-d85af0b7d2d0" status: 204 len: 0 microversion: 2.1 time: 0.134129 Aug 31 16:58:00.328053 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3754/7328] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:58:00 2022] DELETE /compute/v2.1/servers/ec81755a-ff2f-4921-a12b-d85af0b7d2d0 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:58:00.336759 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4ed06c3a-6972-449f-91f3-cc58633a933b tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:00.337706 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4ed06c3a-6972-449f-91f3-cc58633a933b tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: ec81755a-ff2f-4921-a12b-d85af0b7d2d0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:00.345504 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ed06c3a-6972-449f-91f3-cc58633a933b tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:00.346064 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ed06c3a-6972-449f-91f3-cc58633a933b tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:00.346596 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ed06c3a-6972-449f-91f3-cc58633a933b tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:00.347403 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ed06c3a-6972-449f-91f3-cc58633a933b tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:00.348025 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ed06c3a-6972-449f-91f3-cc58633a933b tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:00.348509 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4ed06c3a-6972-449f-91f3-cc58633a933b tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:00.490752 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4ed06c3a-6972-449f-91f3-cc58633a933b tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e27993067f4ba5afde34f0610a7829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717eb8248cf443399bccb20803e9b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:00.499019 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4ed06c3a-6972-449f-91f3-cc58633a933b tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/ec81755a-ff2f-4921-a12b-d85af0b7d2d0" status: 200 len: 1560 microversion: 2.1 time: 0.166212 Aug 31 16:58:00.499593 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3575/7329] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:00 2022] GET /compute/v2.1/servers/ec81755a-ff2f-4921-a12b-d85af0b7d2d0 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:01.522775 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ecdef645-a0f2-4848-955e-e0c8341b57d7 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:01.523404 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ecdef645-a0f2-4848-955e-e0c8341b57d7 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: ec81755a-ff2f-4921-a12b-d85af0b7d2d0] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:01.530957 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ecdef645-a0f2-4848-955e-e0c8341b57d7 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:01.531452 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ecdef645-a0f2-4848-955e-e0c8341b57d7 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:01.531922 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ecdef645-a0f2-4848-955e-e0c8341b57d7 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:01.532625 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ecdef645-a0f2-4848-955e-e0c8341b57d7 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:01.533084 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ecdef645-a0f2-4848-955e-e0c8341b57d7 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:01.533521 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ecdef645-a0f2-4848-955e-e0c8341b57d7 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:01.670641 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ecdef645-a0f2-4848-955e-e0c8341b57d7 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e27993067f4ba5afde34f0610a7829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717eb8248cf443399bccb20803e9b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:01.679535 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ecdef645-a0f2-4848-955e-e0c8341b57d7 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/ec81755a-ff2f-4921-a12b-d85af0b7d2d0" status: 200 len: 1560 microversion: 2.1 time: 0.161278 Aug 31 16:58:01.680123 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3755/7330] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:01 2022] GET /compute/v2.1/servers/ec81755a-ff2f-4921-a12b-d85af0b7d2d0 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:02.646070 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-d51e6509-8b1d-48e7-aae7-b8b9de5eb87e req-94ae4927-5fab-4507-9f4f-1a920be6aa9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec81755a-ff2f-4921-a12b-d85af0b7d2d0", "name": "network-vif-deleted", "tag": "ace7c094-6814-4deb-b9c3-7615f7c095d0"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:58:02.671927 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d51e6509-8b1d-48e7-aae7-b8b9de5eb87e req-94ae4927-5fab-4507-9f4f-1a920be6aa9a service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:02.672546 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d51e6509-8b1d-48e7-aae7-b8b9de5eb87e req-94ae4927-5fab-4507-9f4f-1a920be6aa9a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:02.673120 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-d51e6509-8b1d-48e7-aae7-b8b9de5eb87e req-94ae4927-5fab-4507-9f4f-1a920be6aa9a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:02.687263 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-d51e6509-8b1d-48e7-aae7-b8b9de5eb87e req-94ae4927-5fab-4507-9f4f-1a920be6aa9a service nova] Creating event network-vif-deleted:ace7c094-6814-4deb-b9c3-7615f7c095d0 for instance ec81755a-ff2f-4921-a12b-d85af0b7d2d0 on n-h2-833090-16 Aug 31 16:58:02.692716 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-d51e6509-8b1d-48e7-aae7-b8b9de5eb87e req-94ae4927-5fab-4507-9f4f-1a920be6aa9a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050938 Aug 31 16:58:02.694126 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3576/7331] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:58:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:58:02.707754 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e94d38e7-5439-4274-96b8-63e3e64cb5f3 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:02.708474 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e94d38e7-5439-4274-96b8-63e3e64cb5f3 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: ec81755a-ff2f-4921-a12b-d85af0b7d2d0] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:02.716118 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e94d38e7-5439-4274-96b8-63e3e64cb5f3 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:02.716621 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e94d38e7-5439-4274-96b8-63e3e64cb5f3 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:02.717082 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e94d38e7-5439-4274-96b8-63e3e64cb5f3 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:02.717791 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e94d38e7-5439-4274-96b8-63e3e64cb5f3 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:02.718301 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e94d38e7-5439-4274-96b8-63e3e64cb5f3 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:02.718742 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e94d38e7-5439-4274-96b8-63e3e64cb5f3 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:02.790456 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e94d38e7-5439-4274-96b8-63e3e64cb5f3 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e27993067f4ba5afde34f0610a7829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717eb8248cf443399bccb20803e9b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:02.799148 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e94d38e7-5439-4274-96b8-63e3e64cb5f3 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/ec81755a-ff2f-4921-a12b-d85af0b7d2d0" status: 200 len: 1347 microversion: 2.1 time: 0.095021 Aug 31 16:58:02.799662 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3756/7332] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:02 2022] GET /compute/v2.1/servers/ec81755a-ff2f-4921-a12b-d85af0b7d2d0 => generated 1347 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:03.825417 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7ba27d92-388f-4a21-a739-00c4f4c5d6f4 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:03.826551 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7ba27d92-388f-4a21-a739-00c4f4c5d6f4 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: ec81755a-ff2f-4921-a12b-d85af0b7d2d0] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:03.835263 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ba27d92-388f-4a21-a739-00c4f4c5d6f4 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:03.835748 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ba27d92-388f-4a21-a739-00c4f4c5d6f4 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:03.836190 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ba27d92-388f-4a21-a739-00c4f4c5d6f4 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:03.836890 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ba27d92-388f-4a21-a739-00c4f4c5d6f4 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:03.837343 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ba27d92-388f-4a21-a739-00c4f4c5d6f4 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:03.837767 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7ba27d92-388f-4a21-a739-00c4f4c5d6f4 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:03.854805 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-7ba27d92-388f-4a21-a739-00c4f4c5d6f4 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] HTTP exception thrown: Instance ec81755a-ff2f-4921-a12b-d85af0b7d2d0 could not be found. Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7ba27d92-388f-4a21-a739-00c4f4c5d6f4 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Request method failure captured: Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/ec81755a-ff2f-4921-a12b-d85af0b7d2d0 HTTP/1.1 Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD5LwDmp3jobNFtE4uyAwxVYvJFjRljMaREe6cJ9Cbi4kQ2YMLHlE38z7o3zcni9D0S6eJ5gQ1PmOvNq5MRl4sfXJ66b68a7_MG1Bwc7deyRdriMGc70E4kOPX2-FuyfpVWT0ghtkR4MT33-EasM-0WcfnqatrMan9xqdyj9JI5BvNYQ Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 4717eb8248cf443399bccb20803e9b85 Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1350692395 Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4717eb8248cf443399bccb20803e9b85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4717eb8248cf443399bccb20803e9b85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4717eb8248cf443399bccb20803e9b85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4717eb8248cf443399bccb20803e9b85", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-TestEncryptedCinderVolumes-1350692395 Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 4717eb8248cf443399bccb20803e9b85 Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1350692395 Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-TestEncryptedCinderVolumes-1350692395-project Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: a5e27993067f4ba5afde34f0610a7829 Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-TestEncryptedCinderVolumes-1350692395-project Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance ec81755a-ff2f-4921-a12b-d85af0b7d2d0 could not be found. Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'ec81755a-ff2f-4921-a12b-d85af0b7d2d0'} Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec81755a-ff2f-4921-a12b-d85af0b7d2d0 could not be found. Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec81755a-ff2f-4921-a12b-d85af0b7d2d0 could not be found. Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:58:03.856459 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:58:03.861257 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:58:03.861257 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:58:03.861257 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:58:03.861257 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:58:03.861257 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:58:03.861257 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:58:03.861257 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec81755a-ff2f-4921-a12b-d85af0b7d2d0 could not be found. Aug 31 16:58:03.861257 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:58:03.861257 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7ba27d92-388f-4a21-a739-00c4f4c5d6f4 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Returning 404 to user: Instance ec81755a-ff2f-4921-a12b-d85af0b7d2d0 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:58:03.861257 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7ba27d92-388f-4a21-a739-00c4f4c5d6f4 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/ec81755a-ff2f-4921-a12b-d85af0b7d2d0" status: 404 len: 111 microversion: 2.1 time: 0.039894 Aug 31 16:58:03.861257 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3577/7333] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:03 2022] GET /compute/v2.1/servers/ec81755a-ff2f-4921-a12b-d85af0b7d2d0 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:58:03.867253 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a63cb0d6-6cb8-4b2e-9ddb-251b91cce19b tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '.version_select at 0x7fbb4ac57160>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:03.891655 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a63cb0d6-6cb8-4b2e-9ddb-251b91cce19b tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1378511372" status: 202 len: 0 microversion: 2.1 time: 0.028256 Aug 31 16:58:03.892221 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3757/7334] 10.222.0.50 () {58 vars in 1278 bytes} [Wed Aug 31 16:58:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1378511372 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:58:03.912736 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f82d609d-82c2-422e-a2c0-84372d3c9e85 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Action: 'create', calling method: .version_select at 0x7fbb45bdaee0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1501826748", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOUw1cKwOBX4MdBtpb9a0xSAThRjU0YOFbGWUjm2hdk8TQcYT+gspLDsqVm/uCAWa2HsLOJGuhG6yCEzvwvH5mx7g8ps/1uk9RDbWSFcM8MY3QWcqKhLyfn/Ucdeh8RcSw=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:58:03.933459 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-f82d609d-82c2-422e-a2c0-84372d3c9e85 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Getting quotas for project 4717eb8248cf443399bccb20803e9b85. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:58:03.939517 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-f82d609d-82c2-422e-a2c0-84372d3c9e85 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Getting quotas for user a5e27993067f4ba5afde34f0610a7829 and project 4717eb8248cf443399bccb20803e9b85. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:58:03.964840 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f82d609d-82c2-422e-a2c0-84372d3c9e85 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.058772 Aug 31 16:58:03.965495 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3578/7335] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 31 16:58:03 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:58:04.035460 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4fbf879c-ddc5-4598-8df3-bbb1f61bae50 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-951428482", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1501826748", "networks": [{"uuid": "f41ec376-a588-4557-8383-4b1ad66263a0"}]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:58:04.100645 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-4fbf879c-ddc5-4598-8df3-bbb1f61bae50 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] validate_networks() for [('f41ec376-a588-4557-8383-4b1ad66263a0', None, None, None, None, None)] {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:58:04.543507 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-4fbf879c-ddc5-4598-8df3-bbb1f61bae50 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:58:04.544236 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-4fbf879c-ddc5-4598-8df3-bbb1f61bae50 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:58:04.545037 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-4fbf879c-ddc5-4598-8df3-bbb1f61bae50 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:58:04.545742 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-4fbf879c-ddc5-4598-8df3-bbb1f61bae50 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:58:04.546521 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-4fbf879c-ddc5-4598-8df3-bbb1f61bae50 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:58:04.557627 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4fbf879c-ddc5-4598-8df3-bbb1f61bae50 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:04.558195 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4fbf879c-ddc5-4598-8df3-bbb1f61bae50 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:04.558648 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4fbf879c-ddc5-4598-8df3-bbb1f61bae50 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:04.559396 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4fbf879c-ddc5-4598-8df3-bbb1f61bae50 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:04.559863 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4fbf879c-ddc5-4598-8df3-bbb1f61bae50 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:04.560307 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4fbf879c-ddc5-4598-8df3-bbb1f61bae50 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:04.580363 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-4fbf879c-ddc5-4598-8df3-bbb1f61bae50 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Getting quotas for project 4717eb8248cf443399bccb20803e9b85. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:58:04.586127 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-4fbf879c-ddc5-4598-8df3-bbb1f61bae50 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Getting quotas for user a5e27993067f4ba5afde34f0610a7829 and project 4717eb8248cf443399bccb20803e9b85. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:58:04.600553 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4fbf879c-ddc5-4598-8df3-bbb1f61bae50 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:58:04.603010 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4fbf879c-ddc5-4598-8df3-bbb1f61bae50 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: bff73889-574c-472f-9521-60802d6cf3c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:58:04.651806 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4fbf879c-ddc5-4598-8df3-bbb1f61bae50 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.622828 Aug 31 16:58:04.652631 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3758/7336] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:58:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:58:04.663902 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b1a2c09e-009e-4441-a0eb-3fc02027bd15 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:04.664548 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b1a2c09e-009e-4441-a0eb-3fc02027bd15 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: bff73889-574c-472f-9521-60802d6cf3c4] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:04.720820 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b1a2c09e-009e-4441-a0eb-3fc02027bd15 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e27993067f4ba5afde34f0610a7829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717eb8248cf443399bccb20803e9b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:04.729052 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b1a2c09e-009e-4441-a0eb-3fc02027bd15 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/bff73889-574c-472f-9521-60802d6cf3c4" status: 200 len: 1262 microversion: 2.1 time: 0.069254 Aug 31 16:58:04.729669 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3579/7337] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:04 2022] GET /compute/v2.1/servers/bff73889-574c-472f-9521-60802d6cf3c4 => generated 1262 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:05.750603 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5b89b3d7-4ed6-4e39-8a18-1d9bb3e1def0 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:05.751227 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5b89b3d7-4ed6-4e39-8a18-1d9bb3e1def0 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: bff73889-574c-472f-9521-60802d6cf3c4] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:05.759471 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5b89b3d7-4ed6-4e39-8a18-1d9bb3e1def0 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:05.759973 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5b89b3d7-4ed6-4e39-8a18-1d9bb3e1def0 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:05.760422 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5b89b3d7-4ed6-4e39-8a18-1d9bb3e1def0 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:05.761135 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5b89b3d7-4ed6-4e39-8a18-1d9bb3e1def0 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:05.761598 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5b89b3d7-4ed6-4e39-8a18-1d9bb3e1def0 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:05.762038 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5b89b3d7-4ed6-4e39-8a18-1d9bb3e1def0 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:05.898403 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5b89b3d7-4ed6-4e39-8a18-1d9bb3e1def0 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e27993067f4ba5afde34f0610a7829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717eb8248cf443399bccb20803e9b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:05.906633 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5b89b3d7-4ed6-4e39-8a18-1d9bb3e1def0 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/bff73889-574c-472f-9521-60802d6cf3c4" status: 200 len: 1322 microversion: 2.1 time: 0.160103 Aug 31 16:58:05.907223 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3759/7338] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:05 2022] GET /compute/v2.1/servers/bff73889-574c-472f-9521-60802d6cf3c4 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:06.929498 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-db393fc5-d2d3-4b4e-9649-3b6a0ec4d7f8 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:06.930130 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-db393fc5-d2d3-4b4e-9649-3b6a0ec4d7f8 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: bff73889-574c-472f-9521-60802d6cf3c4] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:06.937998 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db393fc5-d2d3-4b4e-9649-3b6a0ec4d7f8 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:06.938563 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db393fc5-d2d3-4b4e-9649-3b6a0ec4d7f8 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:06.939000 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db393fc5-d2d3-4b4e-9649-3b6a0ec4d7f8 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:06.940105 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db393fc5-d2d3-4b4e-9649-3b6a0ec4d7f8 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:06.940569 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db393fc5-d2d3-4b4e-9649-3b6a0ec4d7f8 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:06.941003 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db393fc5-d2d3-4b4e-9649-3b6a0ec4d7f8 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:07.121041 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-6a7950d2-437c-4351-921a-f35d5e3301ce req-67ec18f6-3163-4939-a09a-689252b220ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bff73889-574c-472f-9521-60802d6cf3c4", "tag": "09997b83-356d-4372-8af4-9033c26db1b8"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:58:07.135089 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-6a7950d2-437c-4351-921a-f35d5e3301ce req-67ec18f6-3163-4939-a09a-689252b220ce service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:07.136402 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-6a7950d2-437c-4351-921a-f35d5e3301ce req-67ec18f6-3163-4939-a09a-689252b220ce service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:07.136965 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-6a7950d2-437c-4351-921a-f35d5e3301ce req-67ec18f6-3163-4939-a09a-689252b220ce service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:07.149375 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-db393fc5-d2d3-4b4e-9649-3b6a0ec4d7f8 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e27993067f4ba5afde34f0610a7829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717eb8248cf443399bccb20803e9b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:07.150862 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-6a7950d2-437c-4351-921a-f35d5e3301ce req-67ec18f6-3163-4939-a09a-689252b220ce service nova] Creating event network-changed:09997b83-356d-4372-8af4-9033c26db1b8 for instance bff73889-574c-472f-9521-60802d6cf3c4 on n-h2-833090-16 Aug 31 16:58:07.156754 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-6a7950d2-437c-4351-921a-f35d5e3301ce req-67ec18f6-3163-4939-a09a-689252b220ce service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039772 Aug 31 16:58:07.157848 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3760/7339] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 16:58:07.160980 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-db393fc5-d2d3-4b4e-9649-3b6a0ec4d7f8 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/bff73889-574c-472f-9521-60802d6cf3c4" status: 200 len: 1362 microversion: 2.1 time: 0.235413 Aug 31 16:58:07.161764 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3580/7340] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:06 2022] GET /compute/v2.1/servers/bff73889-574c-472f-9521-60802d6cf3c4 => generated 1362 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:08.186801 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-dc5d5813-2d2b-4272-bf26-effad091c2e5 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:08.187999 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-dc5d5813-2d2b-4272-bf26-effad091c2e5 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: bff73889-574c-472f-9521-60802d6cf3c4] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:08.196677 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dc5d5813-2d2b-4272-bf26-effad091c2e5 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:08.197183 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dc5d5813-2d2b-4272-bf26-effad091c2e5 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:08.197645 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dc5d5813-2d2b-4272-bf26-effad091c2e5 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:08.202249 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dc5d5813-2d2b-4272-bf26-effad091c2e5 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:08.204793 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dc5d5813-2d2b-4272-bf26-effad091c2e5 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:08.205331 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-dc5d5813-2d2b-4272-bf26-effad091c2e5 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:08.353649 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-dc5d5813-2d2b-4272-bf26-effad091c2e5 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e27993067f4ba5afde34f0610a7829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717eb8248cf443399bccb20803e9b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:08.364766 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-dc5d5813-2d2b-4272-bf26-effad091c2e5 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/bff73889-574c-472f-9521-60802d6cf3c4" status: 200 len: 1362 microversion: 2.1 time: 0.184447 Aug 31 16:58:08.365367 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3761/7341] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:08 2022] GET /compute/v2.1/servers/bff73889-574c-472f-9521-60802d6cf3c4 => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 16:58:09.388079 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-877fc47d-412a-4469-931b-25eba50f6037 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:09.388810 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-877fc47d-412a-4469-931b-25eba50f6037 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: bff73889-574c-472f-9521-60802d6cf3c4] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:09.396230 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-877fc47d-412a-4469-931b-25eba50f6037 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:09.396713 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-877fc47d-412a-4469-931b-25eba50f6037 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:09.397162 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-877fc47d-412a-4469-931b-25eba50f6037 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:09.397863 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-877fc47d-412a-4469-931b-25eba50f6037 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:09.398428 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-877fc47d-412a-4469-931b-25eba50f6037 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:09.398856 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-877fc47d-412a-4469-931b-25eba50f6037 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:09.547911 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-877fc47d-412a-4469-931b-25eba50f6037 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e27993067f4ba5afde34f0610a7829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717eb8248cf443399bccb20803e9b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:09.556410 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-877fc47d-412a-4469-931b-25eba50f6037 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/bff73889-574c-472f-9521-60802d6cf3c4" status: 200 len: 1362 microversion: 2.1 time: 0.174058 Aug 31 16:58:09.556999 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3581/7342] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:09 2022] GET /compute/v2.1/servers/bff73889-574c-472f-9521-60802d6cf3c4 => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:10.580348 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-93eedbdb-2b79-481b-9221-05b9dfaeda53 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:10.580919 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-93eedbdb-2b79-481b-9221-05b9dfaeda53 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: bff73889-574c-472f-9521-60802d6cf3c4] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:10.588216 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-93eedbdb-2b79-481b-9221-05b9dfaeda53 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:10.588751 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-93eedbdb-2b79-481b-9221-05b9dfaeda53 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:10.589202 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-93eedbdb-2b79-481b-9221-05b9dfaeda53 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:10.589911 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-93eedbdb-2b79-481b-9221-05b9dfaeda53 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:10.590407 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-93eedbdb-2b79-481b-9221-05b9dfaeda53 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:10.590849 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-93eedbdb-2b79-481b-9221-05b9dfaeda53 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:10.729739 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-93eedbdb-2b79-481b-9221-05b9dfaeda53 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e27993067f4ba5afde34f0610a7829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717eb8248cf443399bccb20803e9b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:10.739281 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-93eedbdb-2b79-481b-9221-05b9dfaeda53 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/bff73889-574c-472f-9521-60802d6cf3c4" status: 200 len: 1362 microversion: 2.1 time: 0.165242 Aug 31 16:58:10.739859 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3762/7343] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:10 2022] GET /compute/v2.1/servers/bff73889-574c-472f-9521-60802d6cf3c4 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:11.763851 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b73d0085-ed4c-4983-9e41-ebb384541308 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:11.764443 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b73d0085-ed4c-4983-9e41-ebb384541308 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: bff73889-574c-472f-9521-60802d6cf3c4] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:11.775863 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b73d0085-ed4c-4983-9e41-ebb384541308 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:11.776503 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b73d0085-ed4c-4983-9e41-ebb384541308 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:11.777139 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b73d0085-ed4c-4983-9e41-ebb384541308 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:11.777858 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b73d0085-ed4c-4983-9e41-ebb384541308 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:11.778357 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b73d0085-ed4c-4983-9e41-ebb384541308 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:11.778849 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b73d0085-ed4c-4983-9e41-ebb384541308 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:11.930972 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b73d0085-ed4c-4983-9e41-ebb384541308 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e27993067f4ba5afde34f0610a7829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717eb8248cf443399bccb20803e9b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:11.940291 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b73d0085-ed4c-4983-9e41-ebb384541308 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/bff73889-574c-472f-9521-60802d6cf3c4" status: 200 len: 1362 microversion: 2.1 time: 0.183021 Aug 31 16:58:11.940885 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3582/7344] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:11 2022] GET /compute/v2.1/servers/bff73889-574c-472f-9521-60802d6cf3c4 => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:12.866923 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-92fd8ebe-03ca-496c-a7b9-96e08d2fbbe7 req-2d7b84dd-e5fa-4531-a09a-7bfeb936e9d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bff73889-574c-472f-9521-60802d6cf3c4", "name": "network-vif-plugged", "status": "completed", "tag": "09997b83-356d-4372-8af4-9033c26db1b8"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:58:12.878775 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-92fd8ebe-03ca-496c-a7b9-96e08d2fbbe7 req-2d7b84dd-e5fa-4531-a09a-7bfeb936e9d2 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:12.879921 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-92fd8ebe-03ca-496c-a7b9-96e08d2fbbe7 req-2d7b84dd-e5fa-4531-a09a-7bfeb936e9d2 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:12.880182 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-92fd8ebe-03ca-496c-a7b9-96e08d2fbbe7 req-2d7b84dd-e5fa-4531-a09a-7bfeb936e9d2 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:12.895484 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-92fd8ebe-03ca-496c-a7b9-96e08d2fbbe7 req-2d7b84dd-e5fa-4531-a09a-7bfeb936e9d2 service nova] Creating event network-vif-plugged:09997b83-356d-4372-8af4-9033c26db1b8 for instance bff73889-574c-472f-9521-60802d6cf3c4 on n-h2-833090-16 Aug 31 16:58:12.901082 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-92fd8ebe-03ca-496c-a7b9-96e08d2fbbe7 req-2d7b84dd-e5fa-4531-a09a-7bfeb936e9d2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037948 Aug 31 16:58:12.901799 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3763/7345] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:58:12.962164 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e959a7f5-0dd1-4497-8fd1-a41d7cc5b2b9 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:12.962946 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e959a7f5-0dd1-4497-8fd1-a41d7cc5b2b9 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: bff73889-574c-472f-9521-60802d6cf3c4] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:12.970133 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e959a7f5-0dd1-4497-8fd1-a41d7cc5b2b9 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:12.970634 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e959a7f5-0dd1-4497-8fd1-a41d7cc5b2b9 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:12.971100 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e959a7f5-0dd1-4497-8fd1-a41d7cc5b2b9 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:12.971834 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e959a7f5-0dd1-4497-8fd1-a41d7cc5b2b9 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:12.972288 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e959a7f5-0dd1-4497-8fd1-a41d7cc5b2b9 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:12.972697 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e959a7f5-0dd1-4497-8fd1-a41d7cc5b2b9 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:13.108490 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e959a7f5-0dd1-4497-8fd1-a41d7cc5b2b9 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e27993067f4ba5afde34f0610a7829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717eb8248cf443399bccb20803e9b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:13.116955 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e959a7f5-0dd1-4497-8fd1-a41d7cc5b2b9 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/bff73889-574c-472f-9521-60802d6cf3c4" status: 200 len: 1362 microversion: 2.1 time: 0.159097 Aug 31 16:58:13.117550 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3583/7346] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:12 2022] GET /compute/v2.1/servers/bff73889-574c-472f-9521-60802d6cf3c4 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:14.142512 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-184386f9-149b-44b2-9e93-93394a113b0c tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:14.143584 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-184386f9-149b-44b2-9e93-93394a113b0c tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: bff73889-574c-472f-9521-60802d6cf3c4] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:14.150998 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-184386f9-149b-44b2-9e93-93394a113b0c tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:14.151496 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-184386f9-149b-44b2-9e93-93394a113b0c tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:14.151932 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-184386f9-149b-44b2-9e93-93394a113b0c tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:14.152649 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-184386f9-149b-44b2-9e93-93394a113b0c tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:14.153118 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-184386f9-149b-44b2-9e93-93394a113b0c tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:14.153538 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-184386f9-149b-44b2-9e93-93394a113b0c tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:14.301714 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-184386f9-149b-44b2-9e93-93394a113b0c tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e27993067f4ba5afde34f0610a7829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717eb8248cf443399bccb20803e9b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:14.310385 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-184386f9-149b-44b2-9e93-93394a113b0c tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/bff73889-574c-472f-9521-60802d6cf3c4" status: 200 len: 1362 microversion: 2.1 time: 0.176613 Aug 31 16:58:14.311065 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3764/7347] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:14 2022] GET /compute/v2.1/servers/bff73889-574c-472f-9521-60802d6cf3c4 => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:15.336359 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fc0ad58e-cc62-4d42-be30-31aeab568765 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:15.337201 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fc0ad58e-cc62-4d42-be30-31aeab568765 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: bff73889-574c-472f-9521-60802d6cf3c4] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:15.339806 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:58:15.346744 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc0ad58e-cc62-4d42-be30-31aeab568765 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:15.347231 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc0ad58e-cc62-4d42-be30-31aeab568765 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:15.347659 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc0ad58e-cc62-4d42-be30-31aeab568765 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:15.348360 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc0ad58e-cc62-4d42-be30-31aeab568765 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:15.348828 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc0ad58e-cc62-4d42-be30-31aeab568765 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:15.349223 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc0ad58e-cc62-4d42-be30-31aeab568765 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:15.514838 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fc0ad58e-cc62-4d42-be30-31aeab568765 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e27993067f4ba5afde34f0610a7829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717eb8248cf443399bccb20803e9b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:15.527718 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fc0ad58e-cc62-4d42-be30-31aeab568765 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/bff73889-574c-472f-9521-60802d6cf3c4" status: 200 len: 1555 microversion: 2.1 time: 0.197957 Aug 31 16:58:15.528663 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3584/7348] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:15 2022] GET /compute/v2.1/servers/bff73889-574c-472f-9521-60802d6cf3c4 => generated 1555 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:15.551325 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-69775b03-5ad8-4f89-9a14-98c4653e2d7b tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:15.552221 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-69775b03-5ad8-4f89-9a14-98c4653e2d7b tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: bff73889-574c-472f-9521-60802d6cf3c4] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:15.554284 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:58:15.555158 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=6 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:58:15.563110 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69775b03-5ad8-4f89-9a14-98c4653e2d7b tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:15.563613 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69775b03-5ad8-4f89-9a14-98c4653e2d7b tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:15.564073 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69775b03-5ad8-4f89-9a14-98c4653e2d7b tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:15.564934 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69775b03-5ad8-4f89-9a14-98c4653e2d7b tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:15.565436 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69775b03-5ad8-4f89-9a14-98c4653e2d7b tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:15.565882 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-69775b03-5ad8-4f89-9a14-98c4653e2d7b tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:15.702657 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-69775b03-5ad8-4f89-9a14-98c4653e2d7b tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e27993067f4ba5afde34f0610a7829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717eb8248cf443399bccb20803e9b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:15.711945 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-69775b03-5ad8-4f89-9a14-98c4653e2d7b tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/bff73889-574c-472f-9521-60802d6cf3c4" status: 200 len: 1555 microversion: 2.1 time: 0.165235 Aug 31 16:58:15.712517 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3765/7349] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:15 2022] GET /compute/v2.1/servers/bff73889-574c-472f-9521-60802d6cf3c4 => generated 1555 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:17.228920 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-76a2e746-4457-40de-ba1b-0885c11e7361 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c0a99b8e-2189-4a36-95bc-ad1581d1cf1f"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:58:17.231414 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-76a2e746-4457-40de-ba1b-0885c11e7361 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: bff73889-574c-472f-9521-60802d6cf3c4] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:17.240939 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76a2e746-4457-40de-ba1b-0885c11e7361 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:17.241580 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76a2e746-4457-40de-ba1b-0885c11e7361 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:17.242313 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76a2e746-4457-40de-ba1b-0885c11e7361 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:17.243395 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76a2e746-4457-40de-ba1b-0885c11e7361 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:17.244083 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76a2e746-4457-40de-ba1b-0885c11e7361 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:17.244724 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76a2e746-4457-40de-ba1b-0885c11e7361 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:17.567798 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-76a2e746-4457-40de-ba1b-0885c11e7361 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "POST /compute/v2.1/servers/bff73889-574c-472f-9521-60802d6cf3c4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.342714 Aug 31 16:58:17.568459 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3585/7350] 10.222.0.50 () {60 vars in 1323 bytes} [Wed Aug 31 16:58:17 2022] POST /compute/v2.1/servers/bff73889-574c-472f-9521-60802d6cf3c4/os-volume_attachments => generated 194 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:58:28.331375 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5805d43b-f4ea-4691-bf5d-3014ec6a5139 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:28.331989 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5805d43b-f4ea-4691-bf5d-3014ec6a5139 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: bff73889-574c-472f-9521-60802d6cf3c4] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:28.334958 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:58:28.335898 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:58:28.341839 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5805d43b-f4ea-4691-bf5d-3014ec6a5139 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:28.342368 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5805d43b-f4ea-4691-bf5d-3014ec6a5139 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:28.342837 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5805d43b-f4ea-4691-bf5d-3014ec6a5139 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:28.343560 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5805d43b-f4ea-4691-bf5d-3014ec6a5139 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:28.344052 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5805d43b-f4ea-4691-bf5d-3014ec6a5139 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:28.344488 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5805d43b-f4ea-4691-bf5d-3014ec6a5139 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:28.437046 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-5805d43b-f4ea-4691-bf5d-3014ec6a5139 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lazy-loading 'services' on Instance uuid bff73889-574c-472f-9521-60802d6cf3c4 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:58:28.511993 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5805d43b-f4ea-4691-bf5d-3014ec6a5139 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "DELETE /compute/v2.1/servers/bff73889-574c-472f-9521-60802d6cf3c4/os-volume_attachments/c0a99b8e-2189-4a36-95bc-ad1581d1cf1f" status: 202 len: 0 microversion: 2.1 time: 0.184596 Aug 31 16:58:28.512602 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3766/7351] 10.222.0.50 () {58 vars in 1416 bytes} [Wed Aug 31 16:58:28 2022] DELETE /compute/v2.1/servers/bff73889-574c-472f-9521-60802d6cf3c4/os-volume_attachments/c0a99b8e-2189-4a36-95bc-ad1581d1cf1f => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:58:28.521989 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b43330c4-4560-4818-befc-301fd7071c4e tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:28.524549 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b43330c4-4560-4818-befc-301fd7071c4e tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: bff73889-574c-472f-9521-60802d6cf3c4] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:28.527745 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:58:28.528468 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:58:28.535142 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b43330c4-4560-4818-befc-301fd7071c4e tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:28.535838 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b43330c4-4560-4818-befc-301fd7071c4e tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:28.536148 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b43330c4-4560-4818-befc-301fd7071c4e tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:28.536929 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b43330c4-4560-4818-befc-301fd7071c4e tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:28.537392 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b43330c4-4560-4818-befc-301fd7071c4e tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:28.537811 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b43330c4-4560-4818-befc-301fd7071c4e tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:28.572086 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b43330c4-4560-4818-befc-301fd7071c4e tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/bff73889-574c-472f-9521-60802d6cf3c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054501 Aug 31 16:58:28.572550 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3586/7352] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:58:28 2022] GET /compute/v2.1/servers/bff73889-574c-472f-9521-60802d6cf3c4/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:58:29.587417 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-caa16d8b-5058-4789-870b-032628c7e704 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:29.589846 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-caa16d8b-5058-4789-870b-032628c7e704 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: bff73889-574c-472f-9521-60802d6cf3c4] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:29.596941 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-caa16d8b-5058-4789-870b-032628c7e704 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:29.597977 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-caa16d8b-5058-4789-870b-032628c7e704 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:29.598464 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-caa16d8b-5058-4789-870b-032628c7e704 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:29.599196 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-caa16d8b-5058-4789-870b-032628c7e704 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:29.599740 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-caa16d8b-5058-4789-870b-032628c7e704 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:29.600186 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-caa16d8b-5058-4789-870b-032628c7e704 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:29.635122 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-caa16d8b-5058-4789-870b-032628c7e704 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/bff73889-574c-472f-9521-60802d6cf3c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053676 Aug 31 16:58:29.635722 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3767/7353] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:58:29 2022] GET /compute/v2.1/servers/bff73889-574c-472f-9521-60802d6cf3c4/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:58:30.647716 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2d25e1ed-e474-4f8e-ae4b-017e664fba48 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:30.649918 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2d25e1ed-e474-4f8e-ae4b-017e664fba48 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: bff73889-574c-472f-9521-60802d6cf3c4] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:30.657830 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d25e1ed-e474-4f8e-ae4b-017e664fba48 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:30.658359 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d25e1ed-e474-4f8e-ae4b-017e664fba48 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:30.658803 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d25e1ed-e474-4f8e-ae4b-017e664fba48 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:30.659502 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d25e1ed-e474-4f8e-ae4b-017e664fba48 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:30.659958 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d25e1ed-e474-4f8e-ae4b-017e664fba48 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:30.660378 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2d25e1ed-e474-4f8e-ae4b-017e664fba48 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:30.693900 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2d25e1ed-e474-4f8e-ae4b-017e664fba48 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/bff73889-574c-472f-9521-60802d6cf3c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050239 Aug 31 16:58:30.694522 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3587/7354] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:58:30 2022] GET /compute/v2.1/servers/bff73889-574c-472f-9521-60802d6cf3c4/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:58:31.706798 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-53643b9e-5fe4-4919-b22f-643bec1908b7 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:31.709147 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-53643b9e-5fe4-4919-b22f-643bec1908b7 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: bff73889-574c-472f-9521-60802d6cf3c4] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:31.716758 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-53643b9e-5fe4-4919-b22f-643bec1908b7 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:31.717440 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-53643b9e-5fe4-4919-b22f-643bec1908b7 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:31.718022 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-53643b9e-5fe4-4919-b22f-643bec1908b7 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:31.718789 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-53643b9e-5fe4-4919-b22f-643bec1908b7 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:31.719263 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-53643b9e-5fe4-4919-b22f-643bec1908b7 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:31.719728 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-53643b9e-5fe4-4919-b22f-643bec1908b7 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:31.753226 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-53643b9e-5fe4-4919-b22f-643bec1908b7 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/bff73889-574c-472f-9521-60802d6cf3c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050530 Aug 31 16:58:31.754242 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3768/7355] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:58:31 2022] GET /compute/v2.1/servers/bff73889-574c-472f-9521-60802d6cf3c4/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:58:32.766508 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b51fb2a0-e0d1-4489-a34f-6c863524f389 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:32.768688 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b51fb2a0-e0d1-4489-a34f-6c863524f389 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: bff73889-574c-472f-9521-60802d6cf3c4] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:32.778049 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b51fb2a0-e0d1-4489-a34f-6c863524f389 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:32.778577 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b51fb2a0-e0d1-4489-a34f-6c863524f389 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:32.779987 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b51fb2a0-e0d1-4489-a34f-6c863524f389 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:32.781095 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b51fb2a0-e0d1-4489-a34f-6c863524f389 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:32.781571 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b51fb2a0-e0d1-4489-a34f-6c863524f389 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:32.782159 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b51fb2a0-e0d1-4489-a34f-6c863524f389 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:32.826445 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b51fb2a0-e0d1-4489-a34f-6c863524f389 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/bff73889-574c-472f-9521-60802d6cf3c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063683 Aug 31 16:58:32.827218 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3588/7356] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:58:32 2022] GET /compute/v2.1/servers/bff73889-574c-472f-9521-60802d6cf3c4/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:58:33.842255 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9964ef93-53bc-4588-ae94-433f6fe0fca3 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:33.844474 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9964ef93-53bc-4588-ae94-433f6fe0fca3 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: bff73889-574c-472f-9521-60802d6cf3c4] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:33.852726 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9964ef93-53bc-4588-ae94-433f6fe0fca3 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:33.853266 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9964ef93-53bc-4588-ae94-433f6fe0fca3 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:33.853754 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9964ef93-53bc-4588-ae94-433f6fe0fca3 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:33.854597 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9964ef93-53bc-4588-ae94-433f6fe0fca3 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:33.855103 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9964ef93-53bc-4588-ae94-433f6fe0fca3 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:33.855586 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9964ef93-53bc-4588-ae94-433f6fe0fca3 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:33.890027 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9964ef93-53bc-4588-ae94-433f6fe0fca3 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/bff73889-574c-472f-9521-60802d6cf3c4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051792 Aug 31 16:58:33.890533 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3769/7357] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:58:33 2022] GET /compute/v2.1/servers/bff73889-574c-472f-9521-60802d6cf3c4/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:58:33.902562 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7cf59a75-6a68-4f9c-875c-53d6a0d33cf3 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:33.903131 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7cf59a75-6a68-4f9c-875c-53d6a0d33cf3 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: bff73889-574c-472f-9521-60802d6cf3c4] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:33.911702 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cf59a75-6a68-4f9c-875c-53d6a0d33cf3 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:33.912246 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cf59a75-6a68-4f9c-875c-53d6a0d33cf3 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:33.912820 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cf59a75-6a68-4f9c-875c-53d6a0d33cf3 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:33.913828 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cf59a75-6a68-4f9c-875c-53d6a0d33cf3 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:33.914373 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cf59a75-6a68-4f9c-875c-53d6a0d33cf3 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:33.914830 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7cf59a75-6a68-4f9c-875c-53d6a0d33cf3 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:34.003442 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-7cf59a75-6a68-4f9c-875c-53d6a0d33cf3 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] HTTP exception thrown: Instance bff73889-574c-472f-9521-60802d6cf3c4 is not attached to volume c0a99b8e-2189-4a36-95bc-ad1581d1cf1f Aug 31 16:58:34.005559 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7cf59a75-6a68-4f9c-875c-53d6a0d33cf3 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Request method failure captured: Aug 31 16:58:34.005559 n-d-833090-16 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/bff73889-574c-472f-9521-60802d6cf3c4/os-volume_attachments/c0a99b8e-2189-4a36-95bc-ad1581d1cf1f HTTP/1.1 Aug 31 16:58:34.005559 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:58:34.005559 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:58:34.005559 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:58:34.005559 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:58:34.005559 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:58:34.005559 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:58:34.005559 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:58:34.005559 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:58:34.005559 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD5LwDmp3jobNFtE4uyAwxVYvJFjRljMaREe6cJ9Cbi4kQ2YMLHlE38z7o3zcni9D0S6eJ5gQ1PmOvNq5MRl4sfXJ66b68a7_MG1Bwc7deyRdriMGc70E4kOPX2-FuyfpVWT0ghtkR4MT33-EasM-0WcfnqatrMan9xqdyj9JI5BvNYQ Aug 31 16:58:34.005559 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:58:34.005559 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:58:34.005559 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:58:34.005559 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:58:34.005559 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:58:34.005559 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:58:34.005559 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 4717eb8248cf443399bccb20803e9b85 Aug 31 16:58:34.005559 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1350692395 Aug 31 16:58:34.005559 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:58:34.005559 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:58:34.005559 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4717eb8248cf443399bccb20803e9b85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4717eb8248cf443399bccb20803e9b85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4717eb8248cf443399bccb20803e9b85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4717eb8248cf443399bccb20803e9b85", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:58:34.005559 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-TestEncryptedCinderVolumes-1350692395 Aug 31 16:58:34.005559 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 4717eb8248cf443399bccb20803e9b85 Aug 31 16:58:34.005559 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1350692395 Aug 31 16:58:34.005559 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-TestEncryptedCinderVolumes-1350692395-project Aug 31 16:58:34.005559 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:58:34.005559 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:58:34.005559 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: a5e27993067f4ba5afde34f0610a7829 Aug 31 16:58:34.005559 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-TestEncryptedCinderVolumes-1350692395-project Aug 31 16:58:34.005559 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:58:34.005559 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance bff73889-574c-472f-9521-60802d6cf3c4 is not attached to volume c0a99b8e-2189-4a36-95bc-ad1581d1cf1f Aug 31 16:58:34.005559 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'server_id': 'bff73889-574c-472f-9521-60802d6cf3c4', 'id': 'c0a99b8e-2189-4a36-95bc-ad1581d1cf1f'} Aug 31 16:58:34.005559 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:58:34.005559 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:58:34.005559 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 31 16:58:34.005559 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 31 16:58:34.005559 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 16:58:34.005559 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 16:58:34.005559 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 31 16:58:34.005559 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 31 16:58:34.005559 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id c0a99b8e-2189-4a36-95bc-ad1581d1cf1f. Aug 31 16:58:34.005559 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:58:34.005559 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:58:34.005559 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:58:34.005559 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:58:34.005559 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:58:34.005559 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:58:34.005559 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:58:34.005559 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:58:34.005559 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:58:34.005559 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:58:34.005559 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 31 16:58:34.005559 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 31 16:58:34.005559 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bff73889-574c-472f-9521-60802d6cf3c4 is not attached to volume c0a99b8e-2189-4a36-95bc-ad1581d1cf1f Aug 31 16:58:34.005559 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:58:34.005559 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:58:34.005559 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:58:34.005559 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:58:34.005559 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:58:34.005559 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:58:34.009842 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:58:34.009842 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:58:34.009842 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bff73889-574c-472f-9521-60802d6cf3c4 is not attached to volume c0a99b8e-2189-4a36-95bc-ad1581d1cf1f Aug 31 16:58:34.009842 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:58:34.009842 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7cf59a75-6a68-4f9c-875c-53d6a0d33cf3 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Returning 404 to user: Instance bff73889-574c-472f-9521-60802d6cf3c4 is not attached to volume c0a99b8e-2189-4a36-95bc-ad1581d1cf1f {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:58:34.009842 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7cf59a75-6a68-4f9c-875c-53d6a0d33cf3 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "DELETE /compute/v2.1/servers/bff73889-574c-472f-9521-60802d6cf3c4/os-volume_attachments/c0a99b8e-2189-4a36-95bc-ad1581d1cf1f" status: 404 len: 154 microversion: 2.1 time: 0.109766 Aug 31 16:58:34.009842 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3589/7358] 10.222.0.50 () {58 vars in 1416 bytes} [Wed Aug 31 16:58:33 2022] DELETE /compute/v2.1/servers/bff73889-574c-472f-9521-60802d6cf3c4/os-volume_attachments/c0a99b8e-2189-4a36-95bc-ad1581d1cf1f => generated 154 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:58:37.368913 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2935e09c-4703-4910-9917-0c957fc7aab3 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:37.369501 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2935e09c-4703-4910-9917-0c957fc7aab3 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: bff73889-574c-472f-9521-60802d6cf3c4] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:37.376415 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2935e09c-4703-4910-9917-0c957fc7aab3 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:37.376912 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2935e09c-4703-4910-9917-0c957fc7aab3 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:37.377360 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2935e09c-4703-4910-9917-0c957fc7aab3 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:37.378063 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2935e09c-4703-4910-9917-0c957fc7aab3 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:37.378552 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2935e09c-4703-4910-9917-0c957fc7aab3 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:37.379011 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2935e09c-4703-4910-9917-0c957fc7aab3 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:37.406114 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2935e09c-4703-4910-9917-0c957fc7aab3 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: bff73889-574c-472f-9521-60802d6cf3c4] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:58:37.495941 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2935e09c-4703-4910-9917-0c957fc7aab3 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "DELETE /compute/v2.1/servers/bff73889-574c-472f-9521-60802d6cf3c4" status: 204 len: 0 microversion: 2.1 time: 0.130897 Aug 31 16:58:37.499784 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3770/7359] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:58:37 2022] DELETE /compute/v2.1/servers/bff73889-574c-472f-9521-60802d6cf3c4 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:58:37.505733 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fa12abf7-cf86-435f-b1de-6a79b30681a4 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:37.507146 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fa12abf7-cf86-435f-b1de-6a79b30681a4 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: bff73889-574c-472f-9521-60802d6cf3c4] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:37.517097 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa12abf7-cf86-435f-b1de-6a79b30681a4 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:37.517589 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa12abf7-cf86-435f-b1de-6a79b30681a4 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:37.518025 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa12abf7-cf86-435f-b1de-6a79b30681a4 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:37.518771 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa12abf7-cf86-435f-b1de-6a79b30681a4 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:37.519513 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa12abf7-cf86-435f-b1de-6a79b30681a4 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:37.519671 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa12abf7-cf86-435f-b1de-6a79b30681a4 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:37.664048 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fa12abf7-cf86-435f-b1de-6a79b30681a4 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e27993067f4ba5afde34f0610a7829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717eb8248cf443399bccb20803e9b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:37.672438 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fa12abf7-cf86-435f-b1de-6a79b30681a4 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/bff73889-574c-472f-9521-60802d6cf3c4" status: 200 len: 1561 microversion: 2.1 time: 0.171349 Aug 31 16:58:37.672996 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3590/7360] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:37 2022] GET /compute/v2.1/servers/bff73889-574c-472f-9521-60802d6cf3c4 => generated 1561 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:38.697379 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3f0844a0-4c3b-406e-85e6-dcec4f185a42 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:38.698174 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3f0844a0-4c3b-406e-85e6-dcec4f185a42 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: bff73889-574c-472f-9521-60802d6cf3c4] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:38.706162 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3f0844a0-4c3b-406e-85e6-dcec4f185a42 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:38.706747 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3f0844a0-4c3b-406e-85e6-dcec4f185a42 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:38.707220 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3f0844a0-4c3b-406e-85e6-dcec4f185a42 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:38.707960 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3f0844a0-4c3b-406e-85e6-dcec4f185a42 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:38.708412 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3f0844a0-4c3b-406e-85e6-dcec4f185a42 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:38.708892 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3f0844a0-4c3b-406e-85e6-dcec4f185a42 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:38.865492 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3f0844a0-4c3b-406e-85e6-dcec4f185a42 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e27993067f4ba5afde34f0610a7829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717eb8248cf443399bccb20803e9b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:38.878773 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3f0844a0-4c3b-406e-85e6-dcec4f185a42 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/bff73889-574c-472f-9521-60802d6cf3c4" status: 200 len: 1561 microversion: 2.1 time: 0.187564 Aug 31 16:58:38.879710 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3771/7361] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:38 2022] GET /compute/v2.1/servers/bff73889-574c-472f-9521-60802d6cf3c4 => generated 1561 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:39.822604 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-7ae03eed-f79c-4eeb-bb9a-bf872607539f req-8e4a8476-eb35-40e4-b158-b7908f64ad43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bff73889-574c-472f-9521-60802d6cf3c4", "name": "network-vif-deleted", "tag": "09997b83-356d-4372-8af4-9033c26db1b8"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:58:39.832816 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7ae03eed-f79c-4eeb-bb9a-bf872607539f req-8e4a8476-eb35-40e4-b158-b7908f64ad43 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:39.833616 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7ae03eed-f79c-4eeb-bb9a-bf872607539f req-8e4a8476-eb35-40e4-b158-b7908f64ad43 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:39.834042 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7ae03eed-f79c-4eeb-bb9a-bf872607539f req-8e4a8476-eb35-40e4-b158-b7908f64ad43 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:39.849174 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-7ae03eed-f79c-4eeb-bb9a-bf872607539f req-8e4a8476-eb35-40e4-b158-b7908f64ad43 service nova] Creating event network-vif-deleted:09997b83-356d-4372-8af4-9033c26db1b8 for instance bff73889-574c-472f-9521-60802d6cf3c4 on n-h2-833090-16 Aug 31 16:58:39.854885 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-7ae03eed-f79c-4eeb-bb9a-bf872607539f req-8e4a8476-eb35-40e4-b158-b7908f64ad43 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104222 Aug 31 16:58:39.855866 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3591/7362] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:58:39.900376 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-91f79f9a-c723-469f-aacb-5b28f9ebb050 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:39.901607 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-91f79f9a-c723-469f-aacb-5b28f9ebb050 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: bff73889-574c-472f-9521-60802d6cf3c4] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:39.909065 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91f79f9a-c723-469f-aacb-5b28f9ebb050 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:39.909557 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91f79f9a-c723-469f-aacb-5b28f9ebb050 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:39.909998 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91f79f9a-c723-469f-aacb-5b28f9ebb050 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:39.910729 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91f79f9a-c723-469f-aacb-5b28f9ebb050 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:39.911193 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91f79f9a-c723-469f-aacb-5b28f9ebb050 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:39.911622 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91f79f9a-c723-469f-aacb-5b28f9ebb050 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:39.945280 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91f79f9a-c723-469f-aacb-5b28f9ebb050 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:39.945901 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91f79f9a-c723-469f-aacb-5b28f9ebb050 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:39.946366 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-91f79f9a-c723-469f-aacb-5b28f9ebb050 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:39.946835 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-91f79f9a-c723-469f-aacb-5b28f9ebb050 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lazy-loading 'fault' on Instance uuid bff73889-574c-472f-9521-60802d6cf3c4 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:58:39.992707 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-91f79f9a-c723-469f-aacb-5b28f9ebb050 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e27993067f4ba5afde34f0610a7829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717eb8248cf443399bccb20803e9b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:40.002465 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-91f79f9a-c723-469f-aacb-5b28f9ebb050 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/bff73889-574c-472f-9521-60802d6cf3c4" status: 200 len: 1352 microversion: 2.1 time: 0.106115 Aug 31 16:58:40.003065 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3772/7363] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:39 2022] GET /compute/v2.1/servers/bff73889-574c-472f-9521-60802d6cf3c4 => generated 1352 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:41.029400 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a9f4eec8-493a-4c88-9edb-d0e6190abcc8 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:41.030055 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a9f4eec8-493a-4c88-9edb-d0e6190abcc8 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: bff73889-574c-472f-9521-60802d6cf3c4] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:41.038631 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9f4eec8-493a-4c88-9edb-d0e6190abcc8 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:41.039097 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9f4eec8-493a-4c88-9edb-d0e6190abcc8 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:41.039604 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9f4eec8-493a-4c88-9edb-d0e6190abcc8 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:41.040311 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9f4eec8-493a-4c88-9edb-d0e6190abcc8 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:41.040761 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9f4eec8-493a-4c88-9edb-d0e6190abcc8 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:41.041181 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a9f4eec8-493a-4c88-9edb-d0e6190abcc8 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:41.055946 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-a9f4eec8-493a-4c88-9edb-d0e6190abcc8 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] HTTP exception thrown: Instance bff73889-574c-472f-9521-60802d6cf3c4 could not be found. Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a9f4eec8-493a-4c88-9edb-d0e6190abcc8 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Request method failure captured: Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/bff73889-574c-472f-9521-60802d6cf3c4 HTTP/1.1 Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD5LwDmp3jobNFtE4uyAwxVYvJFjRljMaREe6cJ9Cbi4kQ2YMLHlE38z7o3zcni9D0S6eJ5gQ1PmOvNq5MRl4sfXJ66b68a7_MG1Bwc7deyRdriMGc70E4kOPX2-FuyfpVWT0ghtkR4MT33-EasM-0WcfnqatrMan9xqdyj9JI5BvNYQ Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 4717eb8248cf443399bccb20803e9b85 Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1350692395 Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4717eb8248cf443399bccb20803e9b85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4717eb8248cf443399bccb20803e9b85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4717eb8248cf443399bccb20803e9b85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4717eb8248cf443399bccb20803e9b85", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-TestEncryptedCinderVolumes-1350692395 Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 4717eb8248cf443399bccb20803e9b85 Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1350692395 Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-TestEncryptedCinderVolumes-1350692395-project Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: a5e27993067f4ba5afde34f0610a7829 Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-TestEncryptedCinderVolumes-1350692395-project Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance bff73889-574c-472f-9521-60802d6cf3c4 could not be found. Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'bff73889-574c-472f-9521-60802d6cf3c4'} Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bff73889-574c-472f-9521-60802d6cf3c4 could not be found. Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bff73889-574c-472f-9521-60802d6cf3c4 could not be found. Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:58:41.057968 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:58:41.062791 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:58:41.062791 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:58:41.062791 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:58:41.062791 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:58:41.062791 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:58:41.062791 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:58:41.062791 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bff73889-574c-472f-9521-60802d6cf3c4 could not be found. Aug 31 16:58:41.062791 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:58:41.062791 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a9f4eec8-493a-4c88-9edb-d0e6190abcc8 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Returning 404 to user: Instance bff73889-574c-472f-9521-60802d6cf3c4 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:58:41.062791 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a9f4eec8-493a-4c88-9edb-d0e6190abcc8 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/bff73889-574c-472f-9521-60802d6cf3c4" status: 404 len: 111 microversion: 2.1 time: 0.038057 Aug 31 16:58:41.062791 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3592/7364] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:41 2022] GET /compute/v2.1/servers/bff73889-574c-472f-9521-60802d6cf3c4 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:58:41.068818 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7e66f376-3669-4c3f-90ee-d0d98de679cf tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '.version_select at 0x7fbb46f67af0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:41.092122 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7e66f376-3669-4c3f-90ee-d0d98de679cf tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1501826748" status: 202 len: 0 microversion: 2.1 time: 0.027151 Aug 31 16:58:41.093045 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3773/7365] 10.222.0.50 () {58 vars in 1278 bytes} [Wed Aug 31 16:58:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1501826748 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:58:41.108181 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-954376e1-6549-4d56-bf9b-8d328813b22c tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Action: 'create', calling method: .version_select at 0x7fbb45c703a0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1393157594", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPoXSvWZEOtQj4CvZeImdwDUPTf4bDge0Sl3UE0xX1Dw4oJgtIFLH5TvDFgaX4UisTR8jkfxfSUvrPmVfqz9Aq2Po0APtaLzjJAFPmPHMuleWBoCFjG5/gd9x+HTDI2NbQ=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:58:41.124097 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-954376e1-6549-4d56-bf9b-8d328813b22c tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Getting quotas for project 4717eb8248cf443399bccb20803e9b85. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:58:41.132015 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-954376e1-6549-4d56-bf9b-8d328813b22c tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Getting quotas for user a5e27993067f4ba5afde34f0610a7829 and project 4717eb8248cf443399bccb20803e9b85. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:58:41.164565 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-954376e1-6549-4d56-bf9b-8d328813b22c tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.060246 Aug 31 16:58:41.165281 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3593/7366] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 31 16:58:41 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:58:41.220646 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b373675f-6891-4a0c-aaeb-22c1260c85ee tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1511242599", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1393157594", "networks": [{"uuid": "f41ec376-a588-4557-8383-4b1ad66263a0"}]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:58:41.283749 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-b373675f-6891-4a0c-aaeb-22c1260c85ee tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] validate_networks() for [('f41ec376-a588-4557-8383-4b1ad66263a0', None, None, None, None, None)] {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:58:41.744944 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-b373675f-6891-4a0c-aaeb-22c1260c85ee tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:58:41.745524 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-b373675f-6891-4a0c-aaeb-22c1260c85ee tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:58:41.746252 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-b373675f-6891-4a0c-aaeb-22c1260c85ee tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:58:41.746873 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-b373675f-6891-4a0c-aaeb-22c1260c85ee tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:58:41.747528 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-b373675f-6891-4a0c-aaeb-22c1260c85ee tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:58:41.760564 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b373675f-6891-4a0c-aaeb-22c1260c85ee tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:41.761072 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b373675f-6891-4a0c-aaeb-22c1260c85ee tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:41.761558 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b373675f-6891-4a0c-aaeb-22c1260c85ee tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:41.762343 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b373675f-6891-4a0c-aaeb-22c1260c85ee tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:41.762816 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b373675f-6891-4a0c-aaeb-22c1260c85ee tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:41.763258 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b373675f-6891-4a0c-aaeb-22c1260c85ee tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:41.784366 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-b373675f-6891-4a0c-aaeb-22c1260c85ee tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Getting quotas for project 4717eb8248cf443399bccb20803e9b85. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:58:41.792431 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-b373675f-6891-4a0c-aaeb-22c1260c85ee tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Getting quotas for user a5e27993067f4ba5afde34f0610a7829 and project 4717eb8248cf443399bccb20803e9b85. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:58:41.806656 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b373675f-6891-4a0c-aaeb-22c1260c85ee tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:58:41.809078 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b373675f-6891-4a0c-aaeb-22c1260c85ee tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: a4beebd2-ff89-4c2d-8670-ce85ce8e123c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:58:41.862647 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b373675f-6891-4a0c-aaeb-22c1260c85ee tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.646054 Aug 31 16:58:41.863311 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3774/7367] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:58:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:58:41.875001 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-46dd3a97-7156-49e7-a8c2-0fe964ae3ed8 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:41.875611 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-46dd3a97-7156-49e7-a8c2-0fe964ae3ed8 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: a4beebd2-ff89-4c2d-8670-ce85ce8e123c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:41.935311 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-46dd3a97-7156-49e7-a8c2-0fe964ae3ed8 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e27993067f4ba5afde34f0610a7829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717eb8248cf443399bccb20803e9b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:41.943899 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-46dd3a97-7156-49e7-a8c2-0fe964ae3ed8 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/a4beebd2-ff89-4c2d-8670-ce85ce8e123c" status: 200 len: 1263 microversion: 2.1 time: 0.072837 Aug 31 16:58:41.944518 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3594/7368] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:41 2022] GET /compute/v2.1/servers/a4beebd2-ff89-4c2d-8670-ce85ce8e123c => generated 1263 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:42.966932 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-61c0d7cd-b022-49dd-969a-7f72e342211a tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:42.967523 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-61c0d7cd-b022-49dd-969a-7f72e342211a tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: a4beebd2-ff89-4c2d-8670-ce85ce8e123c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:42.976041 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-61c0d7cd-b022-49dd-969a-7f72e342211a tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:42.976551 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-61c0d7cd-b022-49dd-969a-7f72e342211a tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:42.977868 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-61c0d7cd-b022-49dd-969a-7f72e342211a tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:42.979050 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-61c0d7cd-b022-49dd-969a-7f72e342211a tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:42.979439 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-61c0d7cd-b022-49dd-969a-7f72e342211a tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:42.979895 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-61c0d7cd-b022-49dd-969a-7f72e342211a tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:43.053111 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-61c0d7cd-b022-49dd-969a-7f72e342211a tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e27993067f4ba5afde34f0610a7829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717eb8248cf443399bccb20803e9b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:43.062374 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-61c0d7cd-b022-49dd-969a-7f72e342211a tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/a4beebd2-ff89-4c2d-8670-ce85ce8e123c" status: 200 len: 1323 microversion: 2.1 time: 0.100702 Aug 31 16:58:43.063180 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3775/7369] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:42 2022] GET /compute/v2.1/servers/a4beebd2-ff89-4c2d-8670-ce85ce8e123c => generated 1323 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:44.085127 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9289bbce-9106-49ab-9b8b-6e3f07c4810f tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:44.085698 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9289bbce-9106-49ab-9b8b-6e3f07c4810f tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: a4beebd2-ff89-4c2d-8670-ce85ce8e123c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:44.094487 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9289bbce-9106-49ab-9b8b-6e3f07c4810f tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:44.095276 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9289bbce-9106-49ab-9b8b-6e3f07c4810f tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:44.095692 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9289bbce-9106-49ab-9b8b-6e3f07c4810f tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:44.096858 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9289bbce-9106-49ab-9b8b-6e3f07c4810f tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:44.097290 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9289bbce-9106-49ab-9b8b-6e3f07c4810f tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:44.098067 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9289bbce-9106-49ab-9b8b-6e3f07c4810f tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:44.240048 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9289bbce-9106-49ab-9b8b-6e3f07c4810f tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e27993067f4ba5afde34f0610a7829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717eb8248cf443399bccb20803e9b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:44.248392 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9289bbce-9106-49ab-9b8b-6e3f07c4810f tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/a4beebd2-ff89-4c2d-8670-ce85ce8e123c" status: 200 len: 1363 microversion: 2.1 time: 0.167717 Aug 31 16:58:44.248945 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3595/7370] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:44 2022] GET /compute/v2.1/servers/a4beebd2-ff89-4c2d-8670-ce85ce8e123c => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:44.663734 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-3d2a583b-0a58-4324-8af6-550003c7756c req-dd69d3e0-c253-4af1-b802-937e8bf2eefc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4beebd2-ff89-4c2d-8670-ce85ce8e123c", "tag": "69f751c2-894a-45e2-b907-a05354c74e42"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:58:44.675481 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-3d2a583b-0a58-4324-8af6-550003c7756c req-dd69d3e0-c253-4af1-b802-937e8bf2eefc service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:44.676446 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-3d2a583b-0a58-4324-8af6-550003c7756c req-dd69d3e0-c253-4af1-b802-937e8bf2eefc service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:44.676970 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-3d2a583b-0a58-4324-8af6-550003c7756c req-dd69d3e0-c253-4af1-b802-937e8bf2eefc service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:44.695108 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-3d2a583b-0a58-4324-8af6-550003c7756c req-dd69d3e0-c253-4af1-b802-937e8bf2eefc service nova] Creating event network-changed:69f751c2-894a-45e2-b907-a05354c74e42 for instance a4beebd2-ff89-4c2d-8670-ce85ce8e123c on n-h2-833090-16 Aug 31 16:58:44.700472 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-3d2a583b-0a58-4324-8af6-550003c7756c req-dd69d3e0-c253-4af1-b802-937e8bf2eefc service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041200 Aug 31 16:58:44.701402 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3776/7371] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:58:45.269480 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e06e4f3c-f38c-4ad6-906e-bfcb832610d9 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:45.270081 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e06e4f3c-f38c-4ad6-906e-bfcb832610d9 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: a4beebd2-ff89-4c2d-8670-ce85ce8e123c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:45.278051 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e06e4f3c-f38c-4ad6-906e-bfcb832610d9 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:45.278587 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e06e4f3c-f38c-4ad6-906e-bfcb832610d9 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:45.279026 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e06e4f3c-f38c-4ad6-906e-bfcb832610d9 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:45.279728 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e06e4f3c-f38c-4ad6-906e-bfcb832610d9 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:45.280182 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e06e4f3c-f38c-4ad6-906e-bfcb832610d9 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:45.280641 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e06e4f3c-f38c-4ad6-906e-bfcb832610d9 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:45.427465 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e06e4f3c-f38c-4ad6-906e-bfcb832610d9 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e27993067f4ba5afde34f0610a7829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717eb8248cf443399bccb20803e9b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:45.440428 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e06e4f3c-f38c-4ad6-906e-bfcb832610d9 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/a4beebd2-ff89-4c2d-8670-ce85ce8e123c" status: 200 len: 1363 microversion: 2.1 time: 0.174792 Aug 31 16:58:45.441302 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3596/7372] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:45 2022] GET /compute/v2.1/servers/a4beebd2-ff89-4c2d-8670-ce85ce8e123c => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:46.465355 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-73ff8e33-979e-4638-a126-a4eebfde26fb tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:46.466076 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-73ff8e33-979e-4638-a126-a4eebfde26fb tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: a4beebd2-ff89-4c2d-8670-ce85ce8e123c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:46.473348 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-73ff8e33-979e-4638-a126-a4eebfde26fb tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:46.473845 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-73ff8e33-979e-4638-a126-a4eebfde26fb tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:46.474327 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-73ff8e33-979e-4638-a126-a4eebfde26fb tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:46.475020 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-73ff8e33-979e-4638-a126-a4eebfde26fb tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:46.475510 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-73ff8e33-979e-4638-a126-a4eebfde26fb tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:46.475960 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-73ff8e33-979e-4638-a126-a4eebfde26fb tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:46.627162 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-73ff8e33-979e-4638-a126-a4eebfde26fb tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e27993067f4ba5afde34f0610a7829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717eb8248cf443399bccb20803e9b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:46.639932 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-73ff8e33-979e-4638-a126-a4eebfde26fb tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/a4beebd2-ff89-4c2d-8670-ce85ce8e123c" status: 200 len: 1363 microversion: 2.1 time: 0.179861 Aug 31 16:58:46.640769 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3777/7373] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:46 2022] GET /compute/v2.1/servers/a4beebd2-ff89-4c2d-8670-ce85ce8e123c => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:47.667598 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-79d063f8-963c-4bdc-aeb9-e535bc519f62 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:47.668228 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-79d063f8-963c-4bdc-aeb9-e535bc519f62 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: a4beebd2-ff89-4c2d-8670-ce85ce8e123c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:47.675507 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79d063f8-963c-4bdc-aeb9-e535bc519f62 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:47.675994 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79d063f8-963c-4bdc-aeb9-e535bc519f62 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:47.676407 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79d063f8-963c-4bdc-aeb9-e535bc519f62 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:47.677108 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79d063f8-963c-4bdc-aeb9-e535bc519f62 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:47.677599 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79d063f8-963c-4bdc-aeb9-e535bc519f62 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:47.678025 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79d063f8-963c-4bdc-aeb9-e535bc519f62 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:47.814564 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-79d063f8-963c-4bdc-aeb9-e535bc519f62 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e27993067f4ba5afde34f0610a7829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717eb8248cf443399bccb20803e9b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:47.823053 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-79d063f8-963c-4bdc-aeb9-e535bc519f62 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/a4beebd2-ff89-4c2d-8670-ce85ce8e123c" status: 200 len: 1363 microversion: 2.1 time: 0.161670 Aug 31 16:58:47.823641 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3597/7374] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:47 2022] GET /compute/v2.1/servers/a4beebd2-ff89-4c2d-8670-ce85ce8e123c => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:48.846539 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a5269630-d345-41ba-900e-b73211482589 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:48.847177 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a5269630-d345-41ba-900e-b73211482589 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: a4beebd2-ff89-4c2d-8670-ce85ce8e123c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:48.857139 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5269630-d345-41ba-900e-b73211482589 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:48.857803 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5269630-d345-41ba-900e-b73211482589 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:48.858415 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5269630-d345-41ba-900e-b73211482589 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:48.859301 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5269630-d345-41ba-900e-b73211482589 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:48.859872 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5269630-d345-41ba-900e-b73211482589 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:48.860481 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5269630-d345-41ba-900e-b73211482589 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:49.004819 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a5269630-d345-41ba-900e-b73211482589 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e27993067f4ba5afde34f0610a7829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717eb8248cf443399bccb20803e9b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:49.013662 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a5269630-d345-41ba-900e-b73211482589 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/a4beebd2-ff89-4c2d-8670-ce85ce8e123c" status: 200 len: 1363 microversion: 2.1 time: 0.172266 Aug 31 16:58:49.014515 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3778/7375] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:48 2022] GET /compute/v2.1/servers/a4beebd2-ff89-4c2d-8670-ce85ce8e123c => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:50.040490 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0b678313-1a10-46d9-a9b0-5825ccd17384 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:50.041509 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0b678313-1a10-46d9-a9b0-5825ccd17384 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: a4beebd2-ff89-4c2d-8670-ce85ce8e123c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:50.052952 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0b678313-1a10-46d9-a9b0-5825ccd17384 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:50.053759 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0b678313-1a10-46d9-a9b0-5825ccd17384 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:50.054586 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0b678313-1a10-46d9-a9b0-5825ccd17384 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:50.055865 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0b678313-1a10-46d9-a9b0-5825ccd17384 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:50.056800 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0b678313-1a10-46d9-a9b0-5825ccd17384 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:50.057240 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0b678313-1a10-46d9-a9b0-5825ccd17384 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:50.209342 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0b678313-1a10-46d9-a9b0-5825ccd17384 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e27993067f4ba5afde34f0610a7829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717eb8248cf443399bccb20803e9b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:50.218648 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0b678313-1a10-46d9-a9b0-5825ccd17384 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/a4beebd2-ff89-4c2d-8670-ce85ce8e123c" status: 200 len: 1363 microversion: 2.1 time: 0.186073 Aug 31 16:58:50.219233 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3598/7376] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:50 2022] GET /compute/v2.1/servers/a4beebd2-ff89-4c2d-8670-ce85ce8e123c => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:51.152557 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-2e7031a2-843b-4091-a549-5a4b8df47837 req-f525b099-b3c3-42c2-8899-c6b4bc58e2d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4beebd2-ff89-4c2d-8670-ce85ce8e123c", "name": "network-vif-plugged", "status": "completed", "tag": "69f751c2-894a-45e2-b907-a05354c74e42"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:58:51.163518 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-2e7031a2-843b-4091-a549-5a4b8df47837 req-f525b099-b3c3-42c2-8899-c6b4bc58e2d4 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:51.164430 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-2e7031a2-843b-4091-a549-5a4b8df47837 req-f525b099-b3c3-42c2-8899-c6b4bc58e2d4 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:51.164523 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-2e7031a2-843b-4091-a549-5a4b8df47837 req-f525b099-b3c3-42c2-8899-c6b4bc58e2d4 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:51.177407 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-2e7031a2-843b-4091-a549-5a4b8df47837 req-f525b099-b3c3-42c2-8899-c6b4bc58e2d4 service nova] Creating event network-vif-plugged:69f751c2-894a-45e2-b907-a05354c74e42 for instance a4beebd2-ff89-4c2d-8670-ce85ce8e123c on n-h2-833090-16 Aug 31 16:58:51.182564 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-2e7031a2-843b-4091-a549-5a4b8df47837 req-f525b099-b3c3-42c2-8899-c6b4bc58e2d4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100340 Aug 31 16:58:51.183248 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3779/7377] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:58:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:58:51.240279 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f62e94db-1e3a-4081-a6f0-7d36e0bacf40 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:51.240986 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f62e94db-1e3a-4081-a6f0-7d36e0bacf40 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: a4beebd2-ff89-4c2d-8670-ce85ce8e123c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:51.248371 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f62e94db-1e3a-4081-a6f0-7d36e0bacf40 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:51.248883 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f62e94db-1e3a-4081-a6f0-7d36e0bacf40 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:51.249562 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f62e94db-1e3a-4081-a6f0-7d36e0bacf40 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:51.250502 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f62e94db-1e3a-4081-a6f0-7d36e0bacf40 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:51.251128 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f62e94db-1e3a-4081-a6f0-7d36e0bacf40 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:51.252547 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f62e94db-1e3a-4081-a6f0-7d36e0bacf40 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:51.397319 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f62e94db-1e3a-4081-a6f0-7d36e0bacf40 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e27993067f4ba5afde34f0610a7829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717eb8248cf443399bccb20803e9b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:51.407129 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f62e94db-1e3a-4081-a6f0-7d36e0bacf40 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/a4beebd2-ff89-4c2d-8670-ce85ce8e123c" status: 200 len: 1363 microversion: 2.1 time: 0.171041 Aug 31 16:58:51.407719 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3599/7378] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:51 2022] GET /compute/v2.1/servers/a4beebd2-ff89-4c2d-8670-ce85ce8e123c => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:52.429002 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:58:52.430158 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=6 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:58:52.436273 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-537270b7-3217-4716-877f-f99f0ecfd6b8 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:52.437046 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-537270b7-3217-4716-877f-f99f0ecfd6b8 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: a4beebd2-ff89-4c2d-8670-ce85ce8e123c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:52.445112 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-537270b7-3217-4716-877f-f99f0ecfd6b8 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:52.445603 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-537270b7-3217-4716-877f-f99f0ecfd6b8 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:52.446061 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-537270b7-3217-4716-877f-f99f0ecfd6b8 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:52.446857 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-537270b7-3217-4716-877f-f99f0ecfd6b8 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:52.447895 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-537270b7-3217-4716-877f-f99f0ecfd6b8 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:52.448338 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-537270b7-3217-4716-877f-f99f0ecfd6b8 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:52.584364 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-537270b7-3217-4716-877f-f99f0ecfd6b8 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e27993067f4ba5afde34f0610a7829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717eb8248cf443399bccb20803e9b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:52.593197 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-537270b7-3217-4716-877f-f99f0ecfd6b8 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/a4beebd2-ff89-4c2d-8670-ce85ce8e123c" status: 200 len: 1363 microversion: 2.1 time: 0.166268 Aug 31 16:58:52.593768 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3780/7379] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:52 2022] GET /compute/v2.1/servers/a4beebd2-ff89-4c2d-8670-ce85ce8e123c => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:53.614593 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dc4cdd6e-29b2-4518-82c8-a57c5190a42c tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:53.615272 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dc4cdd6e-29b2-4518-82c8-a57c5190a42c tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: a4beebd2-ff89-4c2d-8670-ce85ce8e123c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:53.617325 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:58:53.624268 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc4cdd6e-29b2-4518-82c8-a57c5190a42c tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:53.624764 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc4cdd6e-29b2-4518-82c8-a57c5190a42c tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:53.625199 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc4cdd6e-29b2-4518-82c8-a57c5190a42c tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:53.625903 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc4cdd6e-29b2-4518-82c8-a57c5190a42c tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:53.626379 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc4cdd6e-29b2-4518-82c8-a57c5190a42c tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:53.626803 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dc4cdd6e-29b2-4518-82c8-a57c5190a42c tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:53.767411 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dc4cdd6e-29b2-4518-82c8-a57c5190a42c tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e27993067f4ba5afde34f0610a7829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717eb8248cf443399bccb20803e9b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:53.775683 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dc4cdd6e-29b2-4518-82c8-a57c5190a42c tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/a4beebd2-ff89-4c2d-8670-ce85ce8e123c" status: 200 len: 1556 microversion: 2.1 time: 0.164985 Aug 31 16:58:53.776447 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3600/7380] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:53 2022] GET /compute/v2.1/servers/a4beebd2-ff89-4c2d-8670-ce85ce8e123c => generated 1556 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:53.796586 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0d05b0c6-ed36-45aa-a5bf-7a0ca388d896 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:58:53.797343 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0d05b0c6-ed36-45aa-a5bf-7a0ca388d896 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: a4beebd2-ff89-4c2d-8670-ce85ce8e123c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:53.804771 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0d05b0c6-ed36-45aa-a5bf-7a0ca388d896 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:53.805199 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0d05b0c6-ed36-45aa-a5bf-7a0ca388d896 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:53.805674 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0d05b0c6-ed36-45aa-a5bf-7a0ca388d896 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:53.806475 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0d05b0c6-ed36-45aa-a5bf-7a0ca388d896 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:53.806951 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0d05b0c6-ed36-45aa-a5bf-7a0ca388d896 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:53.807376 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0d05b0c6-ed36-45aa-a5bf-7a0ca388d896 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:53.942280 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0d05b0c6-ed36-45aa-a5bf-7a0ca388d896 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e27993067f4ba5afde34f0610a7829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717eb8248cf443399bccb20803e9b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:58:53.955057 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0d05b0c6-ed36-45aa-a5bf-7a0ca388d896 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/a4beebd2-ff89-4c2d-8670-ce85ce8e123c" status: 200 len: 1556 microversion: 2.1 time: 0.162155 Aug 31 16:58:53.955843 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3781/7381] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:58:53 2022] GET /compute/v2.1/servers/a4beebd2-ff89-4c2d-8670-ce85ce8e123c => generated 1556 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:58:55.500878 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-31a29779-2484-43dc-9d80-e78aaa2256f6 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ded3072b-b6af-4899-8d34-46ec89309846"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:58:55.503238 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-31a29779-2484-43dc-9d80-e78aaa2256f6 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: a4beebd2-ff89-4c2d-8670-ce85ce8e123c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:58:55.511060 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31a29779-2484-43dc-9d80-e78aaa2256f6 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:55.511543 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31a29779-2484-43dc-9d80-e78aaa2256f6 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:55.512011 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31a29779-2484-43dc-9d80-e78aaa2256f6 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:55.512775 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31a29779-2484-43dc-9d80-e78aaa2256f6 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:58:55.513270 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31a29779-2484-43dc-9d80-e78aaa2256f6 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:58:55.513722 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-31a29779-2484-43dc-9d80-e78aaa2256f6 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:58:55.797313 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-31a29779-2484-43dc-9d80-e78aaa2256f6 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "POST /compute/v2.1/servers/a4beebd2-ff89-4c2d-8670-ce85ce8e123c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.300490 Aug 31 16:58:55.797964 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3601/7382] 10.222.0.50 () {60 vars in 1323 bytes} [Wed Aug 31 16:58:55 2022] POST /compute/v2.1/servers/a4beebd2-ff89-4c2d-8670-ce85ce8e123c/os-volume_attachments => generated 194 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:59:07.622367 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5a78dfe2-43db-4d17-8464-131cbd93893d tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:59:07.622950 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5a78dfe2-43db-4d17-8464-131cbd93893d tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: a4beebd2-ff89-4c2d-8670-ce85ce8e123c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:59:07.626072 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:59:07.626777 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:59:07.633549 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5a78dfe2-43db-4d17-8464-131cbd93893d tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:07.634059 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5a78dfe2-43db-4d17-8464-131cbd93893d tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:07.634535 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5a78dfe2-43db-4d17-8464-131cbd93893d tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:07.635253 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5a78dfe2-43db-4d17-8464-131cbd93893d tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:07.635712 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5a78dfe2-43db-4d17-8464-131cbd93893d tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:07.636148 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5a78dfe2-43db-4d17-8464-131cbd93893d tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:07.737898 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-5a78dfe2-43db-4d17-8464-131cbd93893d tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lazy-loading 'services' on Instance uuid a4beebd2-ff89-4c2d-8670-ce85ce8e123c {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 16:59:07.816928 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5a78dfe2-43db-4d17-8464-131cbd93893d tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a4beebd2-ff89-4c2d-8670-ce85ce8e123c/os-volume_attachments/ded3072b-b6af-4899-8d34-46ec89309846" status: 202 len: 0 microversion: 2.1 time: 0.198797 Aug 31 16:59:07.817568 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3782/7383] 10.222.0.50 () {58 vars in 1416 bytes} [Wed Aug 31 16:59:07 2022] DELETE /compute/v2.1/servers/a4beebd2-ff89-4c2d-8670-ce85ce8e123c/os-volume_attachments/ded3072b-b6af-4899-8d34-46ec89309846 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:59:07.830027 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e788fd99-4e8c-4656-b3d9-d9c3d69ada74 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:59:07.834402 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e788fd99-4e8c-4656-b3d9-d9c3d69ada74 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: a4beebd2-ff89-4c2d-8670-ce85ce8e123c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:59:07.840589 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:59:07.841448 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:59:07.850429 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e788fd99-4e8c-4656-b3d9-d9c3d69ada74 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:07.850918 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e788fd99-4e8c-4656-b3d9-d9c3d69ada74 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:07.851352 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e788fd99-4e8c-4656-b3d9-d9c3d69ada74 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:07.852049 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e788fd99-4e8c-4656-b3d9-d9c3d69ada74 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:07.852498 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e788fd99-4e8c-4656-b3d9-d9c3d69ada74 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:07.852916 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e788fd99-4e8c-4656-b3d9-d9c3d69ada74 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:07.889248 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e788fd99-4e8c-4656-b3d9-d9c3d69ada74 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/a4beebd2-ff89-4c2d-8670-ce85ce8e123c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065658 Aug 31 16:59:07.889879 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3602/7384] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:59:07 2022] GET /compute/v2.1/servers/a4beebd2-ff89-4c2d-8670-ce85ce8e123c/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:59:08.903115 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fa5d6948-62b5-4a84-8aca-53ec21cd6e91 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:59:08.905592 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fa5d6948-62b5-4a84-8aca-53ec21cd6e91 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: a4beebd2-ff89-4c2d-8670-ce85ce8e123c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:59:08.912705 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fa5d6948-62b5-4a84-8aca-53ec21cd6e91 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:08.913204 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fa5d6948-62b5-4a84-8aca-53ec21cd6e91 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:08.913636 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fa5d6948-62b5-4a84-8aca-53ec21cd6e91 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:08.914487 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fa5d6948-62b5-4a84-8aca-53ec21cd6e91 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:08.914886 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fa5d6948-62b5-4a84-8aca-53ec21cd6e91 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:08.915316 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fa5d6948-62b5-4a84-8aca-53ec21cd6e91 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:08.948560 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fa5d6948-62b5-4a84-8aca-53ec21cd6e91 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/a4beebd2-ff89-4c2d-8670-ce85ce8e123c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051130 Aug 31 16:59:08.949343 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3783/7385] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:59:08 2022] GET /compute/v2.1/servers/a4beebd2-ff89-4c2d-8670-ce85ce8e123c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:59:09.960850 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3028c905-1878-4c6f-b8c1-a236f1bf5a41 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:59:09.963269 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3028c905-1878-4c6f-b8c1-a236f1bf5a41 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: a4beebd2-ff89-4c2d-8670-ce85ce8e123c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:59:09.970947 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3028c905-1878-4c6f-b8c1-a236f1bf5a41 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:09.971435 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3028c905-1878-4c6f-b8c1-a236f1bf5a41 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:09.971847 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3028c905-1878-4c6f-b8c1-a236f1bf5a41 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:09.972543 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3028c905-1878-4c6f-b8c1-a236f1bf5a41 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:09.972987 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3028c905-1878-4c6f-b8c1-a236f1bf5a41 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:09.973437 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3028c905-1878-4c6f-b8c1-a236f1bf5a41 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:10.006178 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3028c905-1878-4c6f-b8c1-a236f1bf5a41 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/a4beebd2-ff89-4c2d-8670-ce85ce8e123c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049452 Aug 31 16:59:10.006781 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3603/7386] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:59:09 2022] GET /compute/v2.1/servers/a4beebd2-ff89-4c2d-8670-ce85ce8e123c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:59:11.018636 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-78142168-f368-42d0-8e37-7af3768c4c91 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:59:11.021101 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-78142168-f368-42d0-8e37-7af3768c4c91 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: a4beebd2-ff89-4c2d-8670-ce85ce8e123c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:59:11.028627 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-78142168-f368-42d0-8e37-7af3768c4c91 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:11.029123 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-78142168-f368-42d0-8e37-7af3768c4c91 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:11.029565 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-78142168-f368-42d0-8e37-7af3768c4c91 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:11.030315 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-78142168-f368-42d0-8e37-7af3768c4c91 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:11.030780 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-78142168-f368-42d0-8e37-7af3768c4c91 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:11.031209 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-78142168-f368-42d0-8e37-7af3768c4c91 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:11.063155 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-78142168-f368-42d0-8e37-7af3768c4c91 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/a4beebd2-ff89-4c2d-8670-ce85ce8e123c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048630 Aug 31 16:59:11.063730 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3784/7387] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:59:11 2022] GET /compute/v2.1/servers/a4beebd2-ff89-4c2d-8670-ce85ce8e123c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:59:12.076623 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3936fb40-7f2f-43eb-9c0f-95f5d2f074fb tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:59:12.078796 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3936fb40-7f2f-43eb-9c0f-95f5d2f074fb tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: a4beebd2-ff89-4c2d-8670-ce85ce8e123c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:59:12.086484 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3936fb40-7f2f-43eb-9c0f-95f5d2f074fb tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:12.086971 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3936fb40-7f2f-43eb-9c0f-95f5d2f074fb tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:12.087416 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3936fb40-7f2f-43eb-9c0f-95f5d2f074fb tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:12.088106 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3936fb40-7f2f-43eb-9c0f-95f5d2f074fb tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:12.088556 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3936fb40-7f2f-43eb-9c0f-95f5d2f074fb tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:12.088981 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3936fb40-7f2f-43eb-9c0f-95f5d2f074fb tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:12.120460 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3936fb40-7f2f-43eb-9c0f-95f5d2f074fb tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/a4beebd2-ff89-4c2d-8670-ce85ce8e123c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048060 Aug 31 16:59:12.121469 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3604/7388] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:59:12 2022] GET /compute/v2.1/servers/a4beebd2-ff89-4c2d-8670-ce85ce8e123c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:59:13.135921 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8b9e7de3-42d4-4b6d-9042-9d2c682493cc tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:59:13.138510 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8b9e7de3-42d4-4b6d-9042-9d2c682493cc tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: a4beebd2-ff89-4c2d-8670-ce85ce8e123c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:59:13.146080 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b9e7de3-42d4-4b6d-9042-9d2c682493cc tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:13.146603 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b9e7de3-42d4-4b6d-9042-9d2c682493cc tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:13.147048 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b9e7de3-42d4-4b6d-9042-9d2c682493cc tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:13.147727 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b9e7de3-42d4-4b6d-9042-9d2c682493cc tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:13.148184 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b9e7de3-42d4-4b6d-9042-9d2c682493cc tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:13.148861 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8b9e7de3-42d4-4b6d-9042-9d2c682493cc tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:13.179178 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8b9e7de3-42d4-4b6d-9042-9d2c682493cc tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/a4beebd2-ff89-4c2d-8670-ce85ce8e123c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048392 Aug 31 16:59:13.179748 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3785/7389] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 16:59:13 2022] GET /compute/v2.1/servers/a4beebd2-ff89-4c2d-8670-ce85ce8e123c/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 16:59:13.191970 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9ee5cd37-1117-40b1-89e7-9cfe16709bdb tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:59:13.192709 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9ee5cd37-1117-40b1-89e7-9cfe16709bdb tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: a4beebd2-ff89-4c2d-8670-ce85ce8e123c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:59:13.199843 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9ee5cd37-1117-40b1-89e7-9cfe16709bdb tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:13.200345 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9ee5cd37-1117-40b1-89e7-9cfe16709bdb tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:13.200795 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9ee5cd37-1117-40b1-89e7-9cfe16709bdb tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:13.201477 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9ee5cd37-1117-40b1-89e7-9cfe16709bdb tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:13.201926 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9ee5cd37-1117-40b1-89e7-9cfe16709bdb tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:13.202385 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9ee5cd37-1117-40b1-89e7-9cfe16709bdb tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:13.298264 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-9ee5cd37-1117-40b1-89e7-9cfe16709bdb tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] HTTP exception thrown: Instance a4beebd2-ff89-4c2d-8670-ce85ce8e123c is not attached to volume ded3072b-b6af-4899-8d34-46ec89309846 Aug 31 16:59:13.299918 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9ee5cd37-1117-40b1-89e7-9cfe16709bdb tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Request method failure captured: Aug 31 16:59:13.299918 n-d-833090-16 devstack@n-api.service[128863]: request: DELETE /compute/v2.1/servers/a4beebd2-ff89-4c2d-8670-ce85ce8e123c/os-volume_attachments/ded3072b-b6af-4899-8d34-46ec89309846 HTTP/1.1 Aug 31 16:59:13.299918 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:59:13.299918 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:59:13.299918 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:59:13.299918 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:59:13.299918 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:59:13.299918 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:59:13.299918 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:59:13.299918 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:59:13.299918 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD5LwDmp3jobNFtE4uyAwxVYvJFjRljMaREe6cJ9Cbi4kQ2YMLHlE38z7o3zcni9D0S6eJ5gQ1PmOvNq5MRl4sfXJ66b68a7_MG1Bwc7deyRdriMGc70E4kOPX2-FuyfpVWT0ghtkR4MT33-EasM-0WcfnqatrMan9xqdyj9JI5BvNYQ Aug 31 16:59:13.299918 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:59:13.299918 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:59:13.299918 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:59:13.299918 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:59:13.299918 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:59:13.299918 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:59:13.299918 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 4717eb8248cf443399bccb20803e9b85 Aug 31 16:59:13.299918 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1350692395 Aug 31 16:59:13.299918 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:59:13.299918 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:59:13.299918 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4717eb8248cf443399bccb20803e9b85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4717eb8248cf443399bccb20803e9b85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4717eb8248cf443399bccb20803e9b85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4717eb8248cf443399bccb20803e9b85", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:59:13.299918 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-TestEncryptedCinderVolumes-1350692395 Aug 31 16:59:13.299918 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 4717eb8248cf443399bccb20803e9b85 Aug 31 16:59:13.299918 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1350692395 Aug 31 16:59:13.299918 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-TestEncryptedCinderVolumes-1350692395-project Aug 31 16:59:13.299918 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:59:13.299918 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:59:13.299918 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: a5e27993067f4ba5afde34f0610a7829 Aug 31 16:59:13.299918 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-TestEncryptedCinderVolumes-1350692395-project Aug 31 16:59:13.299918 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:59:13.299918 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance a4beebd2-ff89-4c2d-8670-ce85ce8e123c is not attached to volume ded3072b-b6af-4899-8d34-46ec89309846 Aug 31 16:59:13.299918 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'server_id': 'a4beebd2-ff89-4c2d-8670-ce85ce8e123c', 'id': 'ded3072b-b6af-4899-8d34-46ec89309846'} Aug 31 16:59:13.299918 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:59:13.299918 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:59:13.299918 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 31 16:59:13.299918 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 31 16:59:13.299918 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 16:59:13.299918 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 16:59:13.299918 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 31 16:59:13.299918 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 31 16:59:13.299918 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ded3072b-b6af-4899-8d34-46ec89309846. Aug 31 16:59:13.299918 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:59:13.299918 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:59:13.299918 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:59:13.299918 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:59:13.299918 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:59:13.299918 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:59:13.299918 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:59:13.299918 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:59:13.299918 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:59:13.299918 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:59:13.299918 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 31 16:59:13.299918 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 31 16:59:13.299918 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4beebd2-ff89-4c2d-8670-ce85ce8e123c is not attached to volume ded3072b-b6af-4899-8d34-46ec89309846 Aug 31 16:59:13.299918 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:59:13.299918 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:59:13.299918 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:59:13.299918 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:59:13.299918 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:59:13.299918 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:59:13.305072 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:59:13.305072 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:59:13.305072 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4beebd2-ff89-4c2d-8670-ce85ce8e123c is not attached to volume ded3072b-b6af-4899-8d34-46ec89309846 Aug 31 16:59:13.305072 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:59:13.305072 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9ee5cd37-1117-40b1-89e7-9cfe16709bdb tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Returning 404 to user: Instance a4beebd2-ff89-4c2d-8670-ce85ce8e123c is not attached to volume ded3072b-b6af-4899-8d34-46ec89309846 {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:59:13.305072 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9ee5cd37-1117-40b1-89e7-9cfe16709bdb tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a4beebd2-ff89-4c2d-8670-ce85ce8e123c/os-volume_attachments/ded3072b-b6af-4899-8d34-46ec89309846" status: 404 len: 154 microversion: 2.1 time: 0.114486 Aug 31 16:59:13.305072 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3605/7390] 10.222.0.50 () {58 vars in 1416 bytes} [Wed Aug 31 16:59:13 2022] DELETE /compute/v2.1/servers/a4beebd2-ff89-4c2d-8670-ce85ce8e123c/os-volume_attachments/ded3072b-b6af-4899-8d34-46ec89309846 => generated 154 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:59:16.664728 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c7055918-b495-4f74-b04c-d9678814a7eb tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:59:16.665266 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c7055918-b495-4f74-b04c-d9678814a7eb tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: a4beebd2-ff89-4c2d-8670-ce85ce8e123c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:59:16.672611 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c7055918-b495-4f74-b04c-d9678814a7eb tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:16.673114 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c7055918-b495-4f74-b04c-d9678814a7eb tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:16.673561 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c7055918-b495-4f74-b04c-d9678814a7eb tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:16.674333 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c7055918-b495-4f74-b04c-d9678814a7eb tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:16.674805 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c7055918-b495-4f74-b04c-d9678814a7eb tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:16.675240 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c7055918-b495-4f74-b04c-d9678814a7eb tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:16.703404 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c7055918-b495-4f74-b04c-d9678814a7eb tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: a4beebd2-ff89-4c2d-8670-ce85ce8e123c] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 16:59:16.793487 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c7055918-b495-4f74-b04c-d9678814a7eb tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a4beebd2-ff89-4c2d-8670-ce85ce8e123c" status: 204 len: 0 microversion: 2.1 time: 0.132441 Aug 31 16:59:16.797793 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3786/7391] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 16:59:16 2022] DELETE /compute/v2.1/servers/a4beebd2-ff89-4c2d-8670-ce85ce8e123c => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 16:59:16.803035 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ec62582e-0613-4232-8a2d-fc48401bb33b tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:59:16.803728 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ec62582e-0613-4232-8a2d-fc48401bb33b tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: a4beebd2-ff89-4c2d-8670-ce85ce8e123c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:59:16.811300 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ec62582e-0613-4232-8a2d-fc48401bb33b tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:16.811914 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ec62582e-0613-4232-8a2d-fc48401bb33b tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:16.812418 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ec62582e-0613-4232-8a2d-fc48401bb33b tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:16.813190 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ec62582e-0613-4232-8a2d-fc48401bb33b tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:16.813702 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ec62582e-0613-4232-8a2d-fc48401bb33b tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:16.814212 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ec62582e-0613-4232-8a2d-fc48401bb33b tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:16.949127 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ec62582e-0613-4232-8a2d-fc48401bb33b tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e27993067f4ba5afde34f0610a7829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717eb8248cf443399bccb20803e9b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:59:16.957824 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ec62582e-0613-4232-8a2d-fc48401bb33b tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/a4beebd2-ff89-4c2d-8670-ce85ce8e123c" status: 200 len: 1562 microversion: 2.1 time: 0.158621 Aug 31 16:59:16.958535 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3606/7392] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:59:16 2022] GET /compute/v2.1/servers/a4beebd2-ff89-4c2d-8670-ce85ce8e123c => generated 1562 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:59:17.980074 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-25160374-e418-4dec-9e51-0020cfca1886 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:59:17.980835 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-25160374-e418-4dec-9e51-0020cfca1886 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: a4beebd2-ff89-4c2d-8670-ce85ce8e123c] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:59:17.988509 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-25160374-e418-4dec-9e51-0020cfca1886 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:17.989014 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-25160374-e418-4dec-9e51-0020cfca1886 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:17.989461 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-25160374-e418-4dec-9e51-0020cfca1886 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:17.990214 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-25160374-e418-4dec-9e51-0020cfca1886 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:17.990669 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-25160374-e418-4dec-9e51-0020cfca1886 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:17.991101 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-25160374-e418-4dec-9e51-0020cfca1886 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:18.135646 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-25160374-e418-4dec-9e51-0020cfca1886 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e27993067f4ba5afde34f0610a7829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717eb8248cf443399bccb20803e9b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:59:18.143991 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-25160374-e418-4dec-9e51-0020cfca1886 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/a4beebd2-ff89-4c2d-8670-ce85ce8e123c" status: 200 len: 1562 microversion: 2.1 time: 0.168310 Aug 31 16:59:18.144556 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3787/7393] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:59:17 2022] GET /compute/v2.1/servers/a4beebd2-ff89-4c2d-8670-ce85ce8e123c => generated 1562 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:59:19.167122 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fe821e6e-e58f-4258-99b1-3acdff223111 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:59:19.167748 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fe821e6e-e58f-4258-99b1-3acdff223111 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: a4beebd2-ff89-4c2d-8670-ce85ce8e123c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:59:19.176534 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe821e6e-e58f-4258-99b1-3acdff223111 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:19.177027 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe821e6e-e58f-4258-99b1-3acdff223111 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:19.177461 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe821e6e-e58f-4258-99b1-3acdff223111 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:19.178308 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe821e6e-e58f-4258-99b1-3acdff223111 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:19.178784 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe821e6e-e58f-4258-99b1-3acdff223111 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:19.179216 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe821e6e-e58f-4258-99b1-3acdff223111 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:19.262453 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fe821e6e-e58f-4258-99b1-3acdff223111 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5e27993067f4ba5afde34f0610a7829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4717eb8248cf443399bccb20803e9b85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:59:19.263061 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-cc5e1d77-222d-449b-a083-6072ff77d453 req-48199d55-c1b2-411f-a797-ac243dd49fef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4beebd2-ff89-4c2d-8670-ce85ce8e123c", "name": "network-vif-deleted", "tag": "69f751c2-894a-45e2-b907-a05354c74e42"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:59:19.270882 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fe821e6e-e58f-4258-99b1-3acdff223111 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/a4beebd2-ff89-4c2d-8670-ce85ce8e123c" status: 200 len: 1520 microversion: 2.1 time: 0.109323 Aug 31 16:59:19.271537 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3607/7394] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:59:19 2022] GET /compute/v2.1/servers/a4beebd2-ff89-4c2d-8670-ce85ce8e123c => generated 1520 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:59:19.279774 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-cc5e1d77-222d-449b-a083-6072ff77d453 req-48199d55-c1b2-411f-a797-ac243dd49fef service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:19.280347 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-cc5e1d77-222d-449b-a083-6072ff77d453 req-48199d55-c1b2-411f-a797-ac243dd49fef service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:19.280844 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-cc5e1d77-222d-449b-a083-6072ff77d453 req-48199d55-c1b2-411f-a797-ac243dd49fef service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:19.300372 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-cc5e1d77-222d-449b-a083-6072ff77d453 req-48199d55-c1b2-411f-a797-ac243dd49fef service nova] Creating event network-vif-deleted:69f751c2-894a-45e2-b907-a05354c74e42 for instance a4beebd2-ff89-4c2d-8670-ce85ce8e123c on n-h2-833090-16 Aug 31 16:59:19.306264 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-cc5e1d77-222d-449b-a083-6072ff77d453 req-48199d55-c1b2-411f-a797-ac243dd49fef service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046620 Aug 31 16:59:19.307260 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3788/7395] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 16:59:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:59:20.293691 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e20f5299-e137-4927-8be8-e119fe7994f0 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:59:20.294355 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e20f5299-e137-4927-8be8-e119fe7994f0 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] [instance: a4beebd2-ff89-4c2d-8670-ce85ce8e123c] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:59:20.302561 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e20f5299-e137-4927-8be8-e119fe7994f0 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:20.303202 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e20f5299-e137-4927-8be8-e119fe7994f0 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:20.303785 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e20f5299-e137-4927-8be8-e119fe7994f0 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:20.304714 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e20f5299-e137-4927-8be8-e119fe7994f0 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:20.305212 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e20f5299-e137-4927-8be8-e119fe7994f0 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:20.305785 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e20f5299-e137-4927-8be8-e119fe7994f0 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:20.322723 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-e20f5299-e137-4927-8be8-e119fe7994f0 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] HTTP exception thrown: Instance a4beebd2-ff89-4c2d-8670-ce85ce8e123c could not be found. Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e20f5299-e137-4927-8be8-e119fe7994f0 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Request method failure captured: Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/a4beebd2-ff89-4c2d-8670-ce85ce8e123c HTTP/1.1 Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD5LwDmp3jobNFtE4uyAwxVYvJFjRljMaREe6cJ9Cbi4kQ2YMLHlE38z7o3zcni9D0S6eJ5gQ1PmOvNq5MRl4sfXJ66b68a7_MG1Bwc7deyRdriMGc70E4kOPX2-FuyfpVWT0ghtkR4MT33-EasM-0WcfnqatrMan9xqdyj9JI5BvNYQ Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 4717eb8248cf443399bccb20803e9b85 Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1350692395 Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4717eb8248cf443399bccb20803e9b85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4717eb8248cf443399bccb20803e9b85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4717eb8248cf443399bccb20803e9b85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4717eb8248cf443399bccb20803e9b85", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-TestEncryptedCinderVolumes-1350692395 Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 4717eb8248cf443399bccb20803e9b85 Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1350692395 Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-TestEncryptedCinderVolumes-1350692395-project Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: a5e27993067f4ba5afde34f0610a7829 Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-TestEncryptedCinderVolumes-1350692395-project Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance a4beebd2-ff89-4c2d-8670-ce85ce8e123c could not be found. Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'a4beebd2-ff89-4c2d-8670-ce85ce8e123c'} Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4beebd2-ff89-4c2d-8670-ce85ce8e123c could not be found. Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4beebd2-ff89-4c2d-8670-ce85ce8e123c could not be found. Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:59:20.324279 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 16:59:20.328770 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:59:20.328770 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 16:59:20.328770 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 16:59:20.328770 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 16:59:20.328770 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 16:59:20.328770 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 16:59:20.328770 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4beebd2-ff89-4c2d-8670-ce85ce8e123c could not be found. Aug 31 16:59:20.328770 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 16:59:20.328770 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e20f5299-e137-4927-8be8-e119fe7994f0 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Returning 404 to user: Instance a4beebd2-ff89-4c2d-8670-ce85ce8e123c could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 16:59:20.328770 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e20f5299-e137-4927-8be8-e119fe7994f0 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "GET /compute/v2.1/servers/a4beebd2-ff89-4c2d-8670-ce85ce8e123c" status: 404 len: 111 microversion: 2.1 time: 0.036006 Aug 31 16:59:20.328770 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3608/7396] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:59:20 2022] GET /compute/v2.1/servers/a4beebd2-ff89-4c2d-8670-ce85ce8e123c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 16:59:20.339040 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ace0b660-7738-48f9-8a66-e8e07a7e8b58 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] Calling method '.version_select at 0x7fbb46857280>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:59:20.363773 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ace0b660-7738-48f9-8a66-e8e07a7e8b58 tempest-TestEncryptedCinderVolumes-1350692395 tempest-TestEncryptedCinderVolumes-1350692395-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1393157594" status: 202 len: 0 microversion: 2.1 time: 0.032020 Aug 31 16:59:20.364367 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3789/7397] 10.222.0.50 () {58 vars in 1278 bytes} [Wed Aug 31 16:59:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1393157594 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 16:59:48.338064 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a34911b2-bb53-4d4f-bdb3-8f1333934eac tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Action: 'create', calling method: .version_select at 0x7fbb4aa9cee0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-412871823", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPxEREiiYd5LPxnkJs+YvGpM+2R6DO7WowVPnILelp4cc9+PXB4ljmAy5hdHY/KvOZuO7wApV4/0DRQaTTWG+VxQOqKRxAa9Y/uklpvbXgTSkFlrOB0sO+NXYY6MBNcEWg=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:59:48.346846 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=14 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:59:48.348157 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=38 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:59:48.363059 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-a34911b2-bb53-4d4f-bdb3-8f1333934eac tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Getting quotas for project 36bab34a3a6149669d1ea4ee11dcd817. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:59:48.369597 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-a34911b2-bb53-4d4f-bdb3-8f1333934eac tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Getting quotas for user 84b2ea344f1e44a3b892232c88a98680 and project 36bab34a3a6149669d1ea4ee11dcd817. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:59:48.397980 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a34911b2-bb53-4d4f-bdb3-8f1333934eac tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.064071 Aug 31 16:59:48.398878 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3609/7398] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 31 16:59:48 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 16:59:48.450524 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=49,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:59:48.451395 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:59:48.455646 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9da30152-9c9f-42e3-b940-15572ec2b145 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1725431305", "imageRef": "ec1e7b78-8459-4b24-8b8a-8f2fb98b7f3b", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-412871823", "networks": [{"uuid": "c80594e6-3ade-4f43-b24d-1bc0bf830506"}]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 16:59:48.512392 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-9da30152-9c9f-42e3-b940-15572ec2b145 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] validate_networks() for [('c80594e6-3ade-4f43-b24d-1bc0bf830506', None, None, None, None, None)] {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 16:59:48.914815 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-9da30152-9c9f-42e3-b940-15572ec2b145 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 16:59:48.915376 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-9da30152-9c9f-42e3-b940-15572ec2b145 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 16:59:48.915861 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-9da30152-9c9f-42e3-b940-15572ec2b145 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 16:59:48.916270 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-9da30152-9c9f-42e3-b940-15572ec2b145 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 16:59:48.916696 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-9da30152-9c9f-42e3-b940-15572ec2b145 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 16:59:48.927238 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9da30152-9c9f-42e3-b940-15572ec2b145 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:48.927723 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9da30152-9c9f-42e3-b940-15572ec2b145 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:48.928316 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9da30152-9c9f-42e3-b940-15572ec2b145 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:48.929049 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9da30152-9c9f-42e3-b940-15572ec2b145 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:48.929503 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9da30152-9c9f-42e3-b940-15572ec2b145 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:48.929931 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9da30152-9c9f-42e3-b940-15572ec2b145 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:48.947817 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-9da30152-9c9f-42e3-b940-15572ec2b145 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Getting quotas for project 36bab34a3a6149669d1ea4ee11dcd817. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 16:59:48.953689 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-9da30152-9c9f-42e3-b940-15572ec2b145 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Getting quotas for user 84b2ea344f1e44a3b892232c88a98680 and project 36bab34a3a6149669d1ea4ee11dcd817. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 16:59:48.966766 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9da30152-9c9f-42e3-b940-15572ec2b145 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 16:59:48.969207 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9da30152-9c9f-42e3-b940-15572ec2b145 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: a0d4ed01-4eea-44b1-8103-73a0c174270a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ec1e7b78-8459-4b24-8b8a-8f2fb98b7f3b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 16:59:49.017722 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9da30152-9c9f-42e3-b940-15572ec2b145 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.569383 Aug 31 16:59:49.018409 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3790/7399] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 16:59:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 16:59:49.035295 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e43f37d6-fef2-4cc7-a120-ca1d3d41404f tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:59:49.036333 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e43f37d6-fef2-4cc7-a120-ca1d3d41404f tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: a0d4ed01-4eea-44b1-8103-73a0c174270a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:59:49.097969 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e43f37d6-fef2-4cc7-a120-ca1d3d41404f tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:59:49.105326 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e43f37d6-fef2-4cc7-a120-ca1d3d41404f tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a" status: 200 len: 1258 microversion: 2.1 time: 0.079981 Aug 31 16:59:49.105927 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3610/7400] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:59:49 2022] GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a => generated 1258 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:59:50.127333 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-30e86046-0f2b-4d16-8df8-15acbfbb6a64 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:59:50.128025 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-30e86046-0f2b-4d16-8df8-15acbfbb6a64 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: a0d4ed01-4eea-44b1-8103-73a0c174270a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:59:50.135653 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-30e86046-0f2b-4d16-8df8-15acbfbb6a64 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:50.136147 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-30e86046-0f2b-4d16-8df8-15acbfbb6a64 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:50.136586 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-30e86046-0f2b-4d16-8df8-15acbfbb6a64 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:50.137283 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-30e86046-0f2b-4d16-8df8-15acbfbb6a64 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:50.137732 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-30e86046-0f2b-4d16-8df8-15acbfbb6a64 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:50.138311 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-30e86046-0f2b-4d16-8df8-15acbfbb6a64 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:50.212662 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-30e86046-0f2b-4d16-8df8-15acbfbb6a64 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:59:50.222443 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-30e86046-0f2b-4d16-8df8-15acbfbb6a64 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a" status: 200 len: 1318 microversion: 2.1 time: 0.099484 Aug 31 16:59:50.236313 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3791/7401] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:59:50 2022] GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a => generated 1318 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:59:51.245647 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c3c6a0da-bf76-4d5b-9e68-aa2c221ff8b1 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:59:51.246307 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c3c6a0da-bf76-4d5b-9e68-aa2c221ff8b1 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: a0d4ed01-4eea-44b1-8103-73a0c174270a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:59:51.257826 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3c6a0da-bf76-4d5b-9e68-aa2c221ff8b1 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:51.262123 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3c6a0da-bf76-4d5b-9e68-aa2c221ff8b1 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:51.262801 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3c6a0da-bf76-4d5b-9e68-aa2c221ff8b1 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:51.263752 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3c6a0da-bf76-4d5b-9e68-aa2c221ff8b1 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:51.265770 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3c6a0da-bf76-4d5b-9e68-aa2c221ff8b1 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:51.266428 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3c6a0da-bf76-4d5b-9e68-aa2c221ff8b1 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:51.440214 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c3c6a0da-bf76-4d5b-9e68-aa2c221ff8b1 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:59:51.456240 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c3c6a0da-bf76-4d5b-9e68-aa2c221ff8b1 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a" status: 200 len: 1358 microversion: 2.1 time: 0.215376 Aug 31 16:59:51.456835 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3611/7402] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:59:51 2022] GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a => generated 1358 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:59:52.480907 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1aaab35b-4a79-4e42-bd4f-da63ff163269 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:59:52.481622 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1aaab35b-4a79-4e42-bd4f-da63ff163269 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: a0d4ed01-4eea-44b1-8103-73a0c174270a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:59:52.490394 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1aaab35b-4a79-4e42-bd4f-da63ff163269 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:52.491554 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1aaab35b-4a79-4e42-bd4f-da63ff163269 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:52.492031 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1aaab35b-4a79-4e42-bd4f-da63ff163269 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:52.493027 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1aaab35b-4a79-4e42-bd4f-da63ff163269 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:52.493546 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1aaab35b-4a79-4e42-bd4f-da63ff163269 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:52.494018 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1aaab35b-4a79-4e42-bd4f-da63ff163269 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:52.651050 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1aaab35b-4a79-4e42-bd4f-da63ff163269 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:59:52.661142 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1aaab35b-4a79-4e42-bd4f-da63ff163269 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a" status: 200 len: 1358 microversion: 2.1 time: 0.185971 Aug 31 16:59:52.661843 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3792/7403] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:59:52 2022] GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:59:53.683910 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-39e32ee2-d91a-48fe-8e28-0e28595a0aa7 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:59:53.684646 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-39e32ee2-d91a-48fe-8e28-0e28595a0aa7 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: a0d4ed01-4eea-44b1-8103-73a0c174270a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:59:53.693525 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39e32ee2-d91a-48fe-8e28-0e28595a0aa7 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:53.694037 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39e32ee2-d91a-48fe-8e28-0e28595a0aa7 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:53.694715 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39e32ee2-d91a-48fe-8e28-0e28595a0aa7 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:53.695657 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39e32ee2-d91a-48fe-8e28-0e28595a0aa7 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:53.696496 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39e32ee2-d91a-48fe-8e28-0e28595a0aa7 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:53.697217 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-39e32ee2-d91a-48fe-8e28-0e28595a0aa7 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:53.848412 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-39e32ee2-d91a-48fe-8e28-0e28595a0aa7 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:59:53.863309 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-39e32ee2-d91a-48fe-8e28-0e28595a0aa7 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a" status: 200 len: 1358 microversion: 2.1 time: 0.183890 Aug 31 16:59:53.863938 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3612/7404] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:59:53 2022] GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:59:54.886343 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3de36f76-a032-453d-885e-9674310b5bde tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:59:54.887095 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3de36f76-a032-453d-885e-9674310b5bde tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: a0d4ed01-4eea-44b1-8103-73a0c174270a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:59:54.895124 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3de36f76-a032-453d-885e-9674310b5bde tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:54.896144 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3de36f76-a032-453d-885e-9674310b5bde tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:54.896144 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3de36f76-a032-453d-885e-9674310b5bde tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:54.897142 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3de36f76-a032-453d-885e-9674310b5bde tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:54.897724 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3de36f76-a032-453d-885e-9674310b5bde tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:54.898420 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3de36f76-a032-453d-885e-9674310b5bde tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:55.070412 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3de36f76-a032-453d-885e-9674310b5bde tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:59:55.083939 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3de36f76-a032-453d-885e-9674310b5bde tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a" status: 200 len: 1358 microversion: 2.1 time: 0.202425 Aug 31 16:59:55.090157 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3793/7405] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:59:54 2022] GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a => generated 1358 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:59:56.119733 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5beb5bfa-803d-4588-9dd7-0f74d996ccf3 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:59:56.120413 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5beb5bfa-803d-4588-9dd7-0f74d996ccf3 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: a0d4ed01-4eea-44b1-8103-73a0c174270a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:59:56.131498 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5beb5bfa-803d-4588-9dd7-0f74d996ccf3 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:56.132136 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5beb5bfa-803d-4588-9dd7-0f74d996ccf3 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:56.132673 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5beb5bfa-803d-4588-9dd7-0f74d996ccf3 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:56.133430 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5beb5bfa-803d-4588-9dd7-0f74d996ccf3 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:56.133952 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5beb5bfa-803d-4588-9dd7-0f74d996ccf3 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:56.135025 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5beb5bfa-803d-4588-9dd7-0f74d996ccf3 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:56.304749 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5beb5bfa-803d-4588-9dd7-0f74d996ccf3 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:59:56.314356 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5beb5bfa-803d-4588-9dd7-0f74d996ccf3 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a" status: 200 len: 1358 microversion: 2.1 time: 0.201797 Aug 31 16:59:56.315176 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3613/7406] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:59:56 2022] GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a => generated 1358 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:59:57.337474 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0fca77ec-077b-4f17-b5f2-668711226e04 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:59:57.338211 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0fca77ec-077b-4f17-b5f2-668711226e04 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: a0d4ed01-4eea-44b1-8103-73a0c174270a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:59:57.346580 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0fca77ec-077b-4f17-b5f2-668711226e04 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:57.347104 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0fca77ec-077b-4f17-b5f2-668711226e04 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:57.347565 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0fca77ec-077b-4f17-b5f2-668711226e04 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:57.348361 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0fca77ec-077b-4f17-b5f2-668711226e04 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:57.348774 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0fca77ec-077b-4f17-b5f2-668711226e04 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:57.349216 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0fca77ec-077b-4f17-b5f2-668711226e04 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:57.517755 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0fca77ec-077b-4f17-b5f2-668711226e04 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:59:57.526400 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0fca77ec-077b-4f17-b5f2-668711226e04 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a" status: 200 len: 1358 microversion: 2.1 time: 0.192873 Aug 31 16:59:57.527271 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3794/7407] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:59:57 2022] GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a => generated 1358 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:59:58.548489 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-463a283f-667e-488c-a394-e01a70a1cd50 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:59:58.549125 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-463a283f-667e-488c-a394-e01a70a1cd50 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: a0d4ed01-4eea-44b1-8103-73a0c174270a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:59:58.556946 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-463a283f-667e-488c-a394-e01a70a1cd50 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:58.557431 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-463a283f-667e-488c-a394-e01a70a1cd50 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:58.557866 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-463a283f-667e-488c-a394-e01a70a1cd50 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:58.558593 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-463a283f-667e-488c-a394-e01a70a1cd50 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:58.559044 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-463a283f-667e-488c-a394-e01a70a1cd50 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:58.559469 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-463a283f-667e-488c-a394-e01a70a1cd50 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:58.694252 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-463a283f-667e-488c-a394-e01a70a1cd50 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:59:58.702264 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-463a283f-667e-488c-a394-e01a70a1cd50 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a" status: 200 len: 1358 microversion: 2.1 time: 0.157845 Aug 31 16:59:58.702855 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3614/7408] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:59:58 2022] GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 16:59:59.723709 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-679d0465-ca85-4fa4-aed8-de71cfb52d66 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 16:59:59.724300 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-679d0465-ca85-4fa4-aed8-de71cfb52d66 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: a0d4ed01-4eea-44b1-8103-73a0c174270a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 16:59:59.727204 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:59:59.727915 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=6 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 16:59:59.734201 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-679d0465-ca85-4fa4-aed8-de71cfb52d66 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:59.734708 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-679d0465-ca85-4fa4-aed8-de71cfb52d66 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:59.735157 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-679d0465-ca85-4fa4-aed8-de71cfb52d66 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:59.735892 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-679d0465-ca85-4fa4-aed8-de71cfb52d66 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 16:59:59.736362 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-679d0465-ca85-4fa4-aed8-de71cfb52d66 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 16:59:59.736826 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-679d0465-ca85-4fa4-aed8-de71cfb52d66 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 16:59:59.883339 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-679d0465-ca85-4fa4-aed8-de71cfb52d66 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 16:59:59.892237 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-679d0465-ca85-4fa4-aed8-de71cfb52d66 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a" status: 200 len: 1358 microversion: 2.1 time: 0.172684 Aug 31 16:59:59.892830 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3795/7409] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 16:59:59 2022] GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:00:00.913332 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0f2089c5-1bbd-47d5-8cd8-c0389fad5a57 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:00:00.913981 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0f2089c5-1bbd-47d5-8cd8-c0389fad5a57 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: a0d4ed01-4eea-44b1-8103-73a0c174270a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:00:00.915881 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:00:00.922660 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f2089c5-1bbd-47d5-8cd8-c0389fad5a57 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:00:00.923152 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f2089c5-1bbd-47d5-8cd8-c0389fad5a57 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:00:00.923573 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f2089c5-1bbd-47d5-8cd8-c0389fad5a57 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:00:00.924265 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f2089c5-1bbd-47d5-8cd8-c0389fad5a57 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:00:00.924728 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f2089c5-1bbd-47d5-8cd8-c0389fad5a57 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:00:00.926217 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f2089c5-1bbd-47d5-8cd8-c0389fad5a57 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:00:01.066419 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0f2089c5-1bbd-47d5-8cd8-c0389fad5a57 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:00:01.074908 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0f2089c5-1bbd-47d5-8cd8-c0389fad5a57 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a" status: 200 len: 1358 microversion: 2.1 time: 0.165608 Aug 31 17:00:01.075474 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3615/7410] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:00:00 2022] GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:00:02.096215 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f1d111f6-d949-48c7-8293-3842662ecc04 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:00:02.096991 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f1d111f6-d949-48c7-8293-3842662ecc04 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: a0d4ed01-4eea-44b1-8103-73a0c174270a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:00:02.104317 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f1d111f6-d949-48c7-8293-3842662ecc04 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:00:02.104821 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f1d111f6-d949-48c7-8293-3842662ecc04 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:00:02.105253 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f1d111f6-d949-48c7-8293-3842662ecc04 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:00:02.105972 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f1d111f6-d949-48c7-8293-3842662ecc04 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:00:02.106474 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f1d111f6-d949-48c7-8293-3842662ecc04 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:00:02.106911 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f1d111f6-d949-48c7-8293-3842662ecc04 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:00:02.250688 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f1d111f6-d949-48c7-8293-3842662ecc04 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:00:02.258831 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f1d111f6-d949-48c7-8293-3842662ecc04 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a" status: 200 len: 1358 microversion: 2.1 time: 0.166684 Aug 31 17:00:02.259433 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3796/7411] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:00:02 2022] GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:00:02.575900 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-a4be9fe4-a4aa-4cd5-9c3a-8c3d275503a7 req-1b8992a6-fd2b-424c-b261-4d65dc162129 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0d4ed01-4eea-44b1-8103-73a0c174270a", "tag": "8c8aeaaf-8d01-4105-8515-a74f1d568a38"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:00:02.588088 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a4be9fe4-a4aa-4cd5-9c3a-8c3d275503a7 req-1b8992a6-fd2b-424c-b261-4d65dc162129 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:00:02.588687 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a4be9fe4-a4aa-4cd5-9c3a-8c3d275503a7 req-1b8992a6-fd2b-424c-b261-4d65dc162129 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:00:02.590171 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a4be9fe4-a4aa-4cd5-9c3a-8c3d275503a7 req-1b8992a6-fd2b-424c-b261-4d65dc162129 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:00:02.604080 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-a4be9fe4-a4aa-4cd5-9c3a-8c3d275503a7 req-1b8992a6-fd2b-424c-b261-4d65dc162129 service nova] Creating event network-changed:8c8aeaaf-8d01-4105-8515-a74f1d568a38 for instance a0d4ed01-4eea-44b1-8103-73a0c174270a on n-h2-833090-16 Aug 31 17:00:02.615404 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-a4be9fe4-a4aa-4cd5-9c3a-8c3d275503a7 req-1b8992a6-fd2b-424c-b261-4d65dc162129 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043629 Aug 31 17:00:02.617430 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3616/7412] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:00:03.280292 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a9fa56cb-7656-4870-ac81-65fe9f763e7a tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:00:03.280975 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a9fa56cb-7656-4870-ac81-65fe9f763e7a tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: a0d4ed01-4eea-44b1-8103-73a0c174270a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:00:03.288300 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a9fa56cb-7656-4870-ac81-65fe9f763e7a tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:00:03.288796 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a9fa56cb-7656-4870-ac81-65fe9f763e7a tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:00:03.289241 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a9fa56cb-7656-4870-ac81-65fe9f763e7a tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:00:03.289984 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a9fa56cb-7656-4870-ac81-65fe9f763e7a tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:00:03.290543 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a9fa56cb-7656-4870-ac81-65fe9f763e7a tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:00:03.291149 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a9fa56cb-7656-4870-ac81-65fe9f763e7a tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:00:03.434032 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a9fa56cb-7656-4870-ac81-65fe9f763e7a tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:00:03.443306 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a9fa56cb-7656-4870-ac81-65fe9f763e7a tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a" status: 200 len: 1358 microversion: 2.1 time: 0.166978 Aug 31 17:00:03.443940 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3797/7413] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:00:03 2022] GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:00:04.465542 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-650060c6-e12b-4672-a7b3-af5c8431d9a8 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:00:04.466299 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-650060c6-e12b-4672-a7b3-af5c8431d9a8 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: a0d4ed01-4eea-44b1-8103-73a0c174270a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:00:04.473720 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-650060c6-e12b-4672-a7b3-af5c8431d9a8 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:00:04.474243 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-650060c6-e12b-4672-a7b3-af5c8431d9a8 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:00:04.474672 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-650060c6-e12b-4672-a7b3-af5c8431d9a8 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:00:04.475364 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-650060c6-e12b-4672-a7b3-af5c8431d9a8 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:00:04.475808 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-650060c6-e12b-4672-a7b3-af5c8431d9a8 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:00:04.476228 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-650060c6-e12b-4672-a7b3-af5c8431d9a8 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:00:04.630687 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-650060c6-e12b-4672-a7b3-af5c8431d9a8 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:00:04.642355 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-650060c6-e12b-4672-a7b3-af5c8431d9a8 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a" status: 200 len: 1358 microversion: 2.1 time: 0.181920 Aug 31 17:00:04.642942 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3617/7414] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:00:04 2022] GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:00:05.663945 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-33e7b7a5-6ea8-42c1-a942-09dd5e9f9eea tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:00:05.664589 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-33e7b7a5-6ea8-42c1-a942-09dd5e9f9eea tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: a0d4ed01-4eea-44b1-8103-73a0c174270a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:00:05.674024 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33e7b7a5-6ea8-42c1-a942-09dd5e9f9eea tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:00:05.674557 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33e7b7a5-6ea8-42c1-a942-09dd5e9f9eea tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:00:05.675008 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33e7b7a5-6ea8-42c1-a942-09dd5e9f9eea tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:00:05.675729 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33e7b7a5-6ea8-42c1-a942-09dd5e9f9eea tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:00:05.676198 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33e7b7a5-6ea8-42c1-a942-09dd5e9f9eea tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:00:05.676635 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33e7b7a5-6ea8-42c1-a942-09dd5e9f9eea tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:00:05.824522 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-33e7b7a5-6ea8-42c1-a942-09dd5e9f9eea tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:00:05.834405 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-33e7b7a5-6ea8-42c1-a942-09dd5e9f9eea tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a" status: 200 len: 1358 microversion: 2.1 time: 0.174523 Aug 31 17:00:05.835242 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3798/7415] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:00:05 2022] GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:00:06.859523 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-50beb4b0-8036-4490-8e77-25d888bb125c tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:00:06.860127 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-50beb4b0-8036-4490-8e77-25d888bb125c tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: a0d4ed01-4eea-44b1-8103-73a0c174270a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:00:06.867863 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50beb4b0-8036-4490-8e77-25d888bb125c tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:00:06.868351 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50beb4b0-8036-4490-8e77-25d888bb125c tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:00:06.868782 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50beb4b0-8036-4490-8e77-25d888bb125c tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:00:06.869484 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50beb4b0-8036-4490-8e77-25d888bb125c tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:00:06.869935 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50beb4b0-8036-4490-8e77-25d888bb125c tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:00:06.870393 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-50beb4b0-8036-4490-8e77-25d888bb125c tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:00:07.011989 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-50beb4b0-8036-4490-8e77-25d888bb125c tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:00:07.020332 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-50beb4b0-8036-4490-8e77-25d888bb125c tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a" status: 200 len: 1358 microversion: 2.1 time: 0.166963 Aug 31 17:00:07.020909 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3618/7416] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:00:06 2022] GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:00:07.357949 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-ae8310d0-0e67-4a76-8a19-1d9219ee5dbf req-d36ccf0b-af23-4c94-acae-e735865e1de7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0d4ed01-4eea-44b1-8103-73a0c174270a", "name": "network-vif-plugged", "status": "completed", "tag": "8c8aeaaf-8d01-4105-8515-a74f1d568a38"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:00:07.371519 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-ae8310d0-0e67-4a76-8a19-1d9219ee5dbf req-d36ccf0b-af23-4c94-acae-e735865e1de7 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:00:07.372047 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-ae8310d0-0e67-4a76-8a19-1d9219ee5dbf req-d36ccf0b-af23-4c94-acae-e735865e1de7 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:00:07.372514 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-ae8310d0-0e67-4a76-8a19-1d9219ee5dbf req-d36ccf0b-af23-4c94-acae-e735865e1de7 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:00:07.385473 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-ae8310d0-0e67-4a76-8a19-1d9219ee5dbf req-d36ccf0b-af23-4c94-acae-e735865e1de7 service nova] Creating event network-vif-plugged:8c8aeaaf-8d01-4105-8515-a74f1d568a38 for instance a0d4ed01-4eea-44b1-8103-73a0c174270a on n-h2-833090-16 Aug 31 17:00:07.390991 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-ae8310d0-0e67-4a76-8a19-1d9219ee5dbf req-d36ccf0b-af23-4c94-acae-e735865e1de7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036768 Aug 31 17:00:07.392114 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3799/7417] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:00:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:00:08.041089 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cf0f4e4b-9513-4ced-b14a-135b726a06ea tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:00:08.041703 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cf0f4e4b-9513-4ced-b14a-135b726a06ea tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: a0d4ed01-4eea-44b1-8103-73a0c174270a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:00:08.049437 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf0f4e4b-9513-4ced-b14a-135b726a06ea tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:00:08.049909 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf0f4e4b-9513-4ced-b14a-135b726a06ea tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:00:08.050390 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf0f4e4b-9513-4ced-b14a-135b726a06ea tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:00:08.051132 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf0f4e4b-9513-4ced-b14a-135b726a06ea tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:00:08.051591 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf0f4e4b-9513-4ced-b14a-135b726a06ea tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:00:08.052020 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cf0f4e4b-9513-4ced-b14a-135b726a06ea tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:00:08.214303 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cf0f4e4b-9513-4ced-b14a-135b726a06ea tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:00:08.225113 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cf0f4e4b-9513-4ced-b14a-135b726a06ea tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a" status: 200 len: 1358 microversion: 2.1 time: 0.187379 Aug 31 17:00:08.225113 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3619/7418] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:00:08 2022] GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:00:09.247219 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-226a5c9f-75f0-4c17-8535-a4e1f4de3288 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:00:09.247798 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-226a5c9f-75f0-4c17-8535-a4e1f4de3288 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: a0d4ed01-4eea-44b1-8103-73a0c174270a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:00:09.254987 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-226a5c9f-75f0-4c17-8535-a4e1f4de3288 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:00:09.255485 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-226a5c9f-75f0-4c17-8535-a4e1f4de3288 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:00:09.255932 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-226a5c9f-75f0-4c17-8535-a4e1f4de3288 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:00:09.256633 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-226a5c9f-75f0-4c17-8535-a4e1f4de3288 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:00:09.257098 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-226a5c9f-75f0-4c17-8535-a4e1f4de3288 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:00:09.257512 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-226a5c9f-75f0-4c17-8535-a4e1f4de3288 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:00:09.406075 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-226a5c9f-75f0-4c17-8535-a4e1f4de3288 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:00:09.414952 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-226a5c9f-75f0-4c17-8535-a4e1f4de3288 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a" status: 200 len: 1549 microversion: 2.1 time: 0.173297 Aug 31 17:00:09.415547 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3800/7419] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:00:09 2022] GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a => generated 1549 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:00:09.435668 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-086f55a6-f45b-4102-b4f5-1f5c8cd3584d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:00:09.436282 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-086f55a6-f45b-4102-b4f5-1f5c8cd3584d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: a0d4ed01-4eea-44b1-8103-73a0c174270a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:00:09.443928 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-086f55a6-f45b-4102-b4f5-1f5c8cd3584d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:00:09.444408 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-086f55a6-f45b-4102-b4f5-1f5c8cd3584d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:00:09.444838 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-086f55a6-f45b-4102-b4f5-1f5c8cd3584d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:00:09.445524 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-086f55a6-f45b-4102-b4f5-1f5c8cd3584d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:00:09.445968 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-086f55a6-f45b-4102-b4f5-1f5c8cd3584d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:00:09.446427 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-086f55a6-f45b-4102-b4f5-1f5c8cd3584d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:00:09.598544 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-086f55a6-f45b-4102-b4f5-1f5c8cd3584d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:00:09.607065 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-086f55a6-f45b-4102-b4f5-1f5c8cd3584d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a" status: 200 len: 1549 microversion: 2.1 time: 0.175355 Aug 31 17:00:09.607673 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3620/7420] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:00:09 2022] GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a => generated 1549 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:00:09.627427 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9df39c8a-9f3a-43aa-a956-7dbadc6ae1bf tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:00:09.632199 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9df39c8a-9f3a-43aa-a956-7dbadc6ae1bf tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:00:09.633266 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9df39c8a-9f3a-43aa-a956-7dbadc6ae1bf tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Searching by: {'deleted': False, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817'} {{(pid=128864) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 17:00:09.639465 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9df39c8a-9f3a-43aa-a956-7dbadc6ae1bf tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:00:09.639948 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9df39c8a-9f3a-43aa-a956-7dbadc6ae1bf tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:00:09.640384 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9df39c8a-9f3a-43aa-a956-7dbadc6ae1bf tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:00:09.641103 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9df39c8a-9f3a-43aa-a956-7dbadc6ae1bf tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:00:09.641554 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9df39c8a-9f3a-43aa-a956-7dbadc6ae1bf tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:00:09.641981 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9df39c8a-9f3a-43aa-a956-7dbadc6ae1bf tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:00:09.668610 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.multi_cell_list [None req-9df39c8a-9f3a-43aa-a956-7dbadc6ae1bf tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128864) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 17:00:09.697020 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9df39c8a-9f3a-43aa-a956-7dbadc6ae1bf tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.073527 Aug 31 17:00:09.697599 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3801/7421] 10.222.0.50 () {58 vars in 1125 bytes} [Wed Aug 31 17:00:09 2022] GET /compute/v2.1/servers => generated 343 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:00:09.714132 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-aa68121b-cb6e-4b89-b896-fd625108043e tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:00:09.714742 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-aa68121b-cb6e-4b89-b896-fd625108043e tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: a0d4ed01-4eea-44b1-8103-73a0c174270a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:00:09.721691 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa68121b-cb6e-4b89-b896-fd625108043e tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:00:09.722201 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa68121b-cb6e-4b89-b896-fd625108043e tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:00:09.722634 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa68121b-cb6e-4b89-b896-fd625108043e tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:00:09.723315 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa68121b-cb6e-4b89-b896-fd625108043e tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:00:09.723758 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa68121b-cb6e-4b89-b896-fd625108043e tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:00:09.724168 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-aa68121b-cb6e-4b89-b896-fd625108043e tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:00:09.872248 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-aa68121b-cb6e-4b89-b896-fd625108043e tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:00:09.883666 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-aa68121b-cb6e-4b89-b896-fd625108043e tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a" status: 200 len: 1549 microversion: 2.1 time: 0.173174 Aug 31 17:00:09.884453 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3621/7422] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:00:09 2022] GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a => generated 1549 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:00:11.453886 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3a8867bd-029a-4090-8833-b54733c9ba04 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8faf18be-8a8d-4037-b1fd-33a974f63786"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:00:11.456512 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3a8867bd-029a-4090-8833-b54733c9ba04 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: a0d4ed01-4eea-44b1-8103-73a0c174270a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:00:11.463664 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3a8867bd-029a-4090-8833-b54733c9ba04 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:00:11.464160 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3a8867bd-029a-4090-8833-b54733c9ba04 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:00:11.464607 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3a8867bd-029a-4090-8833-b54733c9ba04 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:00:11.465324 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3a8867bd-029a-4090-8833-b54733c9ba04 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:00:11.465794 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3a8867bd-029a-4090-8833-b54733c9ba04 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:00:11.466267 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3a8867bd-029a-4090-8833-b54733c9ba04 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:00:11.755637 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3a8867bd-029a-4090-8833-b54733c9ba04 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "POST /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.305694 Aug 31 17:00:11.756406 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3802/7423] 10.222.0.50 () {60 vars in 1323 bytes} [Wed Aug 31 17:00:11 2022] POST /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a/os-volume_attachments => generated 194 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:00:24.924323 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-989f67da-b257-4c87-b297-e2e44bf3b1f4 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:00:24.925072 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-989f67da-b257-4c87-b297-e2e44bf3b1f4 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: a0d4ed01-4eea-44b1-8103-73a0c174270a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:00:24.928644 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:00:24.929630 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=62 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:00:24.939564 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-989f67da-b257-4c87-b297-e2e44bf3b1f4 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:00:24.940252 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-989f67da-b257-4c87-b297-e2e44bf3b1f4 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:00:24.940874 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-989f67da-b257-4c87-b297-e2e44bf3b1f4 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:00:24.942274 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-989f67da-b257-4c87-b297-e2e44bf3b1f4 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:00:24.942734 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-989f67da-b257-4c87-b297-e2e44bf3b1f4 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:00:24.943162 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-989f67da-b257-4c87-b297-e2e44bf3b1f4 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:00:25.100242 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-989f67da-b257-4c87-b297-e2e44bf3b1f4 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:00:25.109482 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-989f67da-b257-4c87-b297-e2e44bf3b1f4 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a" status: 200 len: 1595 microversion: 2.1 time: 0.189383 Aug 31 17:00:25.110106 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3622/7424] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:00:24 2022] GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a => generated 1595 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:00:26.992624 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:00:26.993485 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:00:27.000150 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:00:27.151656 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-889fa2dc-533f-4b45-a416-002f6d7446d3 req-bacb5364-48c3-4c1d-9fc5-d89f62fc9454 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0d4ed01-4eea-44b1-8103-73a0c174270a", "tag": "8c8aeaaf-8d01-4105-8515-a74f1d568a38"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:00:27.172519 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-889fa2dc-533f-4b45-a416-002f6d7446d3 req-bacb5364-48c3-4c1d-9fc5-d89f62fc9454 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:00:27.173054 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-889fa2dc-533f-4b45-a416-002f6d7446d3 req-bacb5364-48c3-4c1d-9fc5-d89f62fc9454 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:00:27.173507 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-889fa2dc-533f-4b45-a416-002f6d7446d3 req-bacb5364-48c3-4c1d-9fc5-d89f62fc9454 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:00:27.186340 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-889fa2dc-533f-4b45-a416-002f6d7446d3 req-bacb5364-48c3-4c1d-9fc5-d89f62fc9454 service nova] Creating event network-changed:8c8aeaaf-8d01-4105-8515-a74f1d568a38 for instance a0d4ed01-4eea-44b1-8103-73a0c174270a on n-h2-833090-16 Aug 31 17:00:27.191946 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-889fa2dc-533f-4b45-a416-002f6d7446d3 req-bacb5364-48c3-4c1d-9fc5-d89f62fc9454 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.201306 Aug 31 17:00:27.192959 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3803/7425] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:00:28.448626 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e68e48bc-61b3-4410-b819-4f06d22df3f2 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-810943741"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:00:28.449270 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e68e48bc-61b3-4410-b819-4f06d22df3f2 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: a0d4ed01-4eea-44b1-8103-73a0c174270a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:00:28.456519 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e68e48bc-61b3-4410-b819-4f06d22df3f2 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:00:28.457016 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e68e48bc-61b3-4410-b819-4f06d22df3f2 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:00:28.457431 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e68e48bc-61b3-4410-b819-4f06d22df3f2 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:00:28.458122 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e68e48bc-61b3-4410-b819-4f06d22df3f2 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:00:28.458614 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e68e48bc-61b3-4410-b819-4f06d22df3f2 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:00:28.459011 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e68e48bc-61b3-4410-b819-4f06d22df3f2 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:00:28.590534 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.network.security_group_api [None req-e68e48bc-61b3-4410-b819-4f06d22df3f2 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Adding security group 2eeac13c-4456-4556-ac6a-e178e05e0800 to port 8c8aeaaf-8d01-4105-8515-a74f1d568a38 Aug 31 17:00:29.254532 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e68e48bc-61b3-4410-b819-4f06d22df3f2 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "POST /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a/action" status: 202 len: 0 microversion: 2.1 time: 0.809854 Aug 31 17:00:29.255178 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3623/7426] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 17:00:28 2022] POST /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a/action => generated 0 bytes in 812 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:00:29.263897 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-05f273fa-8ac2-46b9-b4c6-b42eeb6aba5d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:00:29.264632 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-05f273fa-8ac2-46b9-b4c6-b42eeb6aba5d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: a0d4ed01-4eea-44b1-8103-73a0c174270a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:00:29.265307 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-045d69f5-d430-42e0-826c-f77fb1247494 req-d366a8bb-9429-4264-ba6c-7df6634b486b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0d4ed01-4eea-44b1-8103-73a0c174270a", "tag": "8c8aeaaf-8d01-4105-8515-a74f1d568a38"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:00:29.271172 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05f273fa-8ac2-46b9-b4c6-b42eeb6aba5d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:00:29.271694 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05f273fa-8ac2-46b9-b4c6-b42eeb6aba5d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:00:29.272638 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05f273fa-8ac2-46b9-b4c6-b42eeb6aba5d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:00:29.273170 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05f273fa-8ac2-46b9-b4c6-b42eeb6aba5d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:00:29.273625 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05f273fa-8ac2-46b9-b4c6-b42eeb6aba5d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:00:29.274038 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05f273fa-8ac2-46b9-b4c6-b42eeb6aba5d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:00:29.276068 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-045d69f5-d430-42e0-826c-f77fb1247494 req-d366a8bb-9429-4264-ba6c-7df6634b486b service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:00:29.278656 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-045d69f5-d430-42e0-826c-f77fb1247494 req-d366a8bb-9429-4264-ba6c-7df6634b486b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:00:29.279183 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-045d69f5-d430-42e0-826c-f77fb1247494 req-d366a8bb-9429-4264-ba6c-7df6634b486b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:00:29.305522 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-045d69f5-d430-42e0-826c-f77fb1247494 req-d366a8bb-9429-4264-ba6c-7df6634b486b service nova] Creating event network-changed:8c8aeaaf-8d01-4105-8515-a74f1d568a38 for instance a0d4ed01-4eea-44b1-8103-73a0c174270a on n-h2-833090-16 Aug 31 17:00:29.315872 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-045d69f5-d430-42e0-826c-f77fb1247494 req-d366a8bb-9429-4264-ba6c-7df6634b486b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055417 Aug 31 17:00:29.319843 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3804/7427] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:00:29.470490 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-05f273fa-8ac2-46b9-b4c6-b42eeb6aba5d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:00:29.480563 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-05f273fa-8ac2-46b9-b4c6-b42eeb6aba5d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a" status: 200 len: 1758 microversion: 2.1 time: 0.220556 Aug 31 17:00:29.481378 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3624/7428] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:00:29 2022] GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a => generated 1758 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:02:50.615829 n-d-833090-16 devstack@n-api.service[128864]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4f3e0afc-1d0e-4db3-9143-6185c0e157a7] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 31 17:02:50.616669 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=4 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:02:50.617458 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=4 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:02:50.618704 n-d-833090-16 devstack@n-api.service[128864]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 17:02:50.618869 n-d-833090-16 devstack@n-api.service[128864]: Wed Aug 31 17:02:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a/action (ip 10.222.0.50) !!! Aug 31 17:02:50.621172 n-d-833090-16 devstack@n-api.service[128864]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 17:02:50.621349 n-d-833090-16 devstack@n-api.service[128864]: Wed Aug 31 17:02:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a/action (ip 10.222.0.50) !!! Aug 31 17:02:50.627143 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-de01a731-8a2a-46c4-987f-2bc13f72c636 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:02:50.629360 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-de01a731-8a2a-46c4-987f-2bc13f72c636 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: a0d4ed01-4eea-44b1-8103-73a0c174270a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:02:50.641836 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-de01a731-8a2a-46c4-987f-2bc13f72c636 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:02:50.642381 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-de01a731-8a2a-46c4-987f-2bc13f72c636 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:02:50.642823 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-de01a731-8a2a-46c4-987f-2bc13f72c636 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:02:50.643522 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-de01a731-8a2a-46c4-987f-2bc13f72c636 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:02:50.643978 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-de01a731-8a2a-46c4-987f-2bc13f72c636 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:02:50.644405 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-de01a731-8a2a-46c4-987f-2bc13f72c636 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:02:50.724027 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-de01a731-8a2a-46c4-987f-2bc13f72c636 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "POST /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a/action" status: 202 len: 0 microversion: 2.1 time: 0.110140 Aug 31 17:02:50.724724 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3805/7429] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 17:02:50 2022] POST /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:02:50.731848 n-d-833090-16 devstack@n-api.service[128863]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6edb9245-c569-4b8e-9560-fba55d2b56a3] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 31 17:02:50.733106 n-d-833090-16 devstack@n-api.service[128863]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a572ecc8-7c5f-4ee8-b179-c0e5cc05c499] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 31 17:02:50.733608 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:02:50.734417 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=16 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:02:50.736211 n-d-833090-16 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 17:02:50.736400 n-d-833090-16 devstack@n-api.service[128863]: Wed Aug 31 17:02:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a (ip 10.222.0.50) !!! Aug 31 17:02:50.738035 n-d-833090-16 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 17:02:50.738240 n-d-833090-16 devstack@n-api.service[128863]: Wed Aug 31 17:02:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a (ip 10.222.0.50) !!! Aug 31 17:02:50.746893 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6fa471ea-2444-4bc5-baa7-11a278c58aa0 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:02:50.747546 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6fa471ea-2444-4bc5-baa7-11a278c58aa0 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: a0d4ed01-4eea-44b1-8103-73a0c174270a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:02:50.761540 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6fa471ea-2444-4bc5-baa7-11a278c58aa0 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:02:50.762023 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6fa471ea-2444-4bc5-baa7-11a278c58aa0 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:02:50.762489 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6fa471ea-2444-4bc5-baa7-11a278c58aa0 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:02:50.763213 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6fa471ea-2444-4bc5-baa7-11a278c58aa0 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:02:50.763661 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6fa471ea-2444-4bc5-baa7-11a278c58aa0 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:02:50.764077 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6fa471ea-2444-4bc5-baa7-11a278c58aa0 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:02:50.912004 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6fa471ea-2444-4bc5-baa7-11a278c58aa0 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:02:50.920877 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6fa471ea-2444-4bc5-baa7-11a278c58aa0 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a" status: 200 len: 1760 microversion: 2.1 time: 0.191684 Aug 31 17:02:50.921493 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3625/7430] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:02:50 2022] GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a => generated 1760 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:02:51.940772 n-d-833090-16 devstack@n-api.service[128864]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0684e720-ea0e-4737-a458-87e19068aaad] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 17:02:51.945552 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5efb0428-f6b4-4119-9b76-4ead5df7a43c tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:02:51.946308 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5efb0428-f6b4-4119-9b76-4ead5df7a43c tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: a0d4ed01-4eea-44b1-8103-73a0c174270a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:02:51.955526 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5efb0428-f6b4-4119-9b76-4ead5df7a43c tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:02:51.955526 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5efb0428-f6b4-4119-9b76-4ead5df7a43c tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:02:51.955526 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5efb0428-f6b4-4119-9b76-4ead5df7a43c tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:02:51.956135 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5efb0428-f6b4-4119-9b76-4ead5df7a43c tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:02:51.956594 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5efb0428-f6b4-4119-9b76-4ead5df7a43c tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:02:51.957018 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5efb0428-f6b4-4119-9b76-4ead5df7a43c tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:02:51.964393 n-d-833090-16 devstack@n-api.service[128864]: INFO oslo.messaging._drivers.impl_rabbit [-] [4f3e0afc-1d0e-4db3-9143-6185c0e157a7] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 50922. Aug 31 17:02:52.131851 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5efb0428-f6b4-4119-9b76-4ead5df7a43c tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:02:52.140708 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5efb0428-f6b4-4119-9b76-4ead5df7a43c tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a" status: 200 len: 1765 microversion: 2.1 time: 0.201536 Aug 31 17:02:52.141283 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3806/7431] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:02:51 2022] GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a => generated 1765 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:02:53.162359 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-87c2c7eb-48f1-4567-bbf7-ca18c937e8c6 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:02:53.162969 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-87c2c7eb-48f1-4567-bbf7-ca18c937e8c6 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: a0d4ed01-4eea-44b1-8103-73a0c174270a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:02:53.176601 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-87c2c7eb-48f1-4567-bbf7-ca18c937e8c6 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:02:53.177088 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-87c2c7eb-48f1-4567-bbf7-ca18c937e8c6 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:02:53.177524 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-87c2c7eb-48f1-4567-bbf7-ca18c937e8c6 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:02:53.178226 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-87c2c7eb-48f1-4567-bbf7-ca18c937e8c6 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:02:53.178682 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-87c2c7eb-48f1-4567-bbf7-ca18c937e8c6 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:02:53.179111 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-87c2c7eb-48f1-4567-bbf7-ca18c937e8c6 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:02:53.186387 n-d-833090-16 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] [6edb9245-c569-4b8e-9560-fba55d2b56a3] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 50926. Aug 31 17:02:53.190359 n-d-833090-16 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] [a572ecc8-7c5f-4ee8-b179-c0e5cc05c499] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 50928. Aug 31 17:02:53.330774 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-87c2c7eb-48f1-4567-bbf7-ca18c937e8c6 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:02:53.339526 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-87c2c7eb-48f1-4567-bbf7-ca18c937e8c6 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a" status: 200 len: 1758 microversion: 2.1 time: 0.181050 Aug 31 17:02:53.340108 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3626/7432] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:02:53 2022] GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a => generated 1758 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:04:32.834876 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=4 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:04:32.835645 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:04:32.841294 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-83ec7e33-d351-4e30-8681-0c207ea47801 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-810943741"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:04:32.841832 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-83ec7e33-d351-4e30-8681-0c207ea47801 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: a0d4ed01-4eea-44b1-8103-73a0c174270a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:04:32.850716 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83ec7e33-d351-4e30-8681-0c207ea47801 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:04:32.851204 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83ec7e33-d351-4e30-8681-0c207ea47801 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:04:32.851618 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83ec7e33-d351-4e30-8681-0c207ea47801 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:04:32.852328 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83ec7e33-d351-4e30-8681-0c207ea47801 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:04:32.852777 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83ec7e33-d351-4e30-8681-0c207ea47801 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:04:32.853205 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83ec7e33-d351-4e30-8681-0c207ea47801 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:04:32.859821 n-d-833090-16 devstack@n-api.service[128864]: INFO oslo.messaging._drivers.impl_rabbit [-] [0684e720-ea0e-4737-a458-87e19068aaad] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 50972. Aug 31 17:04:33.085232 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.network.security_group_api [None req-83ec7e33-d351-4e30-8681-0c207ea47801 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Removing security group 2eeac13c-4456-4556-ac6a-e178e05e0800 from port 8c8aeaaf-8d01-4105-8515-a74f1d568a38 Aug 31 17:04:33.426403 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-83ec7e33-d351-4e30-8681-0c207ea47801 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "POST /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a/action" status: 202 len: 0 microversion: 2.1 time: 0.593981 Aug 31 17:04:33.427048 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3807/7433] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 17:04:32 2022] POST /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a/action => generated 0 bytes in 595 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:04:33.434123 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:04:33.434919 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=12 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:04:33.435937 n-d-833090-16 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 17:04:33.436074 n-d-833090-16 devstack@n-api.service[128863]: Wed Aug 31 17:04:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.50) !!! Aug 31 17:04:33.445114 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-bf3d3d79-db66-4c43-b22a-86580f5e08cc req-a07f3da7-33d6-44bb-8935-b451718ce034 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0d4ed01-4eea-44b1-8103-73a0c174270a", "tag": "8c8aeaaf-8d01-4105-8515-a74f1d568a38"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:04:33.457916 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-bf3d3d79-db66-4c43-b22a-86580f5e08cc req-a07f3da7-33d6-44bb-8935-b451718ce034 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:04:33.458654 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-bf3d3d79-db66-4c43-b22a-86580f5e08cc req-a07f3da7-33d6-44bb-8935-b451718ce034 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:04:33.459735 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-bf3d3d79-db66-4c43-b22a-86580f5e08cc req-a07f3da7-33d6-44bb-8935-b451718ce034 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:04:33.479342 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-bf3d3d79-db66-4c43-b22a-86580f5e08cc req-a07f3da7-33d6-44bb-8935-b451718ce034 service nova] Creating event network-changed:8c8aeaaf-8d01-4105-8515-a74f1d568a38 for instance a0d4ed01-4eea-44b1-8103-73a0c174270a on n-h2-833090-16 Aug 31 17:04:33.486677 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-bf3d3d79-db66-4c43-b22a-86580f5e08cc req-a07f3da7-33d6-44bb-8935-b451718ce034 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053960 Aug 31 17:04:33.488112 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3627/7434] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:04:34.632646 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0a99dfac-9465-4311-9d69-5c7068d0cc47 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:04:34.633225 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0a99dfac-9465-4311-9d69-5c7068d0cc47 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: a0d4ed01-4eea-44b1-8103-73a0c174270a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:04:34.640240 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0a99dfac-9465-4311-9d69-5c7068d0cc47 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:04:34.640748 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0a99dfac-9465-4311-9d69-5c7068d0cc47 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:04:34.641397 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0a99dfac-9465-4311-9d69-5c7068d0cc47 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:04:34.642263 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0a99dfac-9465-4311-9d69-5c7068d0cc47 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:04:34.642732 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0a99dfac-9465-4311-9d69-5c7068d0cc47 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:04:34.643168 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0a99dfac-9465-4311-9d69-5c7068d0cc47 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:04:34.731311 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-0a99dfac-9465-4311-9d69-5c7068d0cc47 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lazy-loading 'services' on Instance uuid a0d4ed01-4eea-44b1-8103-73a0c174270a {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 17:04:34.813463 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0a99dfac-9465-4311-9d69-5c7068d0cc47 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a/os-volume_attachments/8faf18be-8a8d-4037-b1fd-33a974f63786" status: 202 len: 0 microversion: 2.1 time: 0.185889 Aug 31 17:04:34.814657 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3808/7435] 10.222.0.50 () {58 vars in 1416 bytes} [Wed Aug 31 17:04:34 2022] DELETE /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a/os-volume_attachments/8faf18be-8a8d-4037-b1fd-33a974f63786 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:04:34.825930 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-60c538f3-3892-4136-85b0-c386d4c92bc9 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:04:34.828582 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-60c538f3-3892-4136-85b0-c386d4c92bc9 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: a0d4ed01-4eea-44b1-8103-73a0c174270a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:04:34.835930 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60c538f3-3892-4136-85b0-c386d4c92bc9 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:04:34.836413 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60c538f3-3892-4136-85b0-c386d4c92bc9 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:04:34.836858 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60c538f3-3892-4136-85b0-c386d4c92bc9 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:04:34.837585 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60c538f3-3892-4136-85b0-c386d4c92bc9 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:04:34.838023 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60c538f3-3892-4136-85b0-c386d4c92bc9 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:04:34.838466 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-60c538f3-3892-4136-85b0-c386d4c92bc9 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:04:34.874403 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-60c538f3-3892-4136-85b0-c386d4c92bc9 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054465 Aug 31 17:04:34.875028 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3628/7436] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 17:04:34 2022] GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 17:04:35.503036 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-81a8d9a7-14cb-4014-a5f4-996e41765491 req-e91797c9-9d8b-4d81-8208-46f9e6f02b69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0d4ed01-4eea-44b1-8103-73a0c174270a", "tag": "8c8aeaaf-8d01-4105-8515-a74f1d568a38"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:04:35.519647 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-81a8d9a7-14cb-4014-a5f4-996e41765491 req-e91797c9-9d8b-4d81-8208-46f9e6f02b69 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:04:35.520139 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-81a8d9a7-14cb-4014-a5f4-996e41765491 req-e91797c9-9d8b-4d81-8208-46f9e6f02b69 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:04:35.520585 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-81a8d9a7-14cb-4014-a5f4-996e41765491 req-e91797c9-9d8b-4d81-8208-46f9e6f02b69 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:04:35.532171 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-81a8d9a7-14cb-4014-a5f4-996e41765491 req-e91797c9-9d8b-4d81-8208-46f9e6f02b69 service nova] Creating event network-changed:8c8aeaaf-8d01-4105-8515-a74f1d568a38 for instance a0d4ed01-4eea-44b1-8103-73a0c174270a on n-h2-833090-16 Aug 31 17:04:35.537740 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-81a8d9a7-14cb-4014-a5f4-996e41765491 req-e91797c9-9d8b-4d81-8208-46f9e6f02b69 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039239 Aug 31 17:04:35.539043 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3809/7437] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:04:35.888166 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-83163996-a60c-4c0c-971a-430fcb80a1fc tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:04:35.891004 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-83163996-a60c-4c0c-971a-430fcb80a1fc tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: a0d4ed01-4eea-44b1-8103-73a0c174270a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:04:35.898677 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83163996-a60c-4c0c-971a-430fcb80a1fc tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:04:35.899400 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83163996-a60c-4c0c-971a-430fcb80a1fc tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:04:35.899848 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83163996-a60c-4c0c-971a-430fcb80a1fc tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:04:35.900563 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83163996-a60c-4c0c-971a-430fcb80a1fc tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:04:35.901002 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83163996-a60c-4c0c-971a-430fcb80a1fc tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:04:35.901611 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-83163996-a60c-4c0c-971a-430fcb80a1fc tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:04:35.937621 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-83163996-a60c-4c0c-971a-430fcb80a1fc tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053634 Aug 31 17:04:35.940046 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3629/7438] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 17:04:35 2022] GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:04:36.953191 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d68cd3a9-03af-41e5-b456-918a8bbfbe00 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:04:36.956357 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d68cd3a9-03af-41e5-b456-918a8bbfbe00 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: a0d4ed01-4eea-44b1-8103-73a0c174270a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:04:36.963309 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d68cd3a9-03af-41e5-b456-918a8bbfbe00 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:04:36.963811 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d68cd3a9-03af-41e5-b456-918a8bbfbe00 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:04:36.964266 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d68cd3a9-03af-41e5-b456-918a8bbfbe00 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:04:36.964980 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d68cd3a9-03af-41e5-b456-918a8bbfbe00 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:04:36.965446 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d68cd3a9-03af-41e5-b456-918a8bbfbe00 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:04:36.965883 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d68cd3a9-03af-41e5-b456-918a8bbfbe00 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:04:36.998716 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d68cd3a9-03af-41e5-b456-918a8bbfbe00 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051270 Aug 31 17:04:36.999300 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3810/7439] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 17:04:36 2022] GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:04:38.076492 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-474f2a35-fdb9-4a6f-bbc8-9d4cf1b96561 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:04:38.079170 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-474f2a35-fdb9-4a6f-bbc8-9d4cf1b96561 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: a0d4ed01-4eea-44b1-8103-73a0c174270a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:04:38.085781 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-474f2a35-fdb9-4a6f-bbc8-9d4cf1b96561 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:04:38.086312 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-474f2a35-fdb9-4a6f-bbc8-9d4cf1b96561 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:04:38.086827 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-474f2a35-fdb9-4a6f-bbc8-9d4cf1b96561 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:04:38.087524 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-474f2a35-fdb9-4a6f-bbc8-9d4cf1b96561 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:04:38.087968 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-474f2a35-fdb9-4a6f-bbc8-9d4cf1b96561 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:04:38.088603 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-474f2a35-fdb9-4a6f-bbc8-9d4cf1b96561 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:04:38.125659 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-474f2a35-fdb9-4a6f-bbc8-9d4cf1b96561 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117435 Aug 31 17:04:38.126368 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3630/7440] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 17:04:38 2022] GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:04:39.138403 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-35fa2417-6925-4809-adbc-0b7adbcc805a tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:04:39.140743 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-35fa2417-6925-4809-adbc-0b7adbcc805a tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: a0d4ed01-4eea-44b1-8103-73a0c174270a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:04:39.149381 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-35fa2417-6925-4809-adbc-0b7adbcc805a tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:04:39.149812 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-35fa2417-6925-4809-adbc-0b7adbcc805a tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:04:39.150304 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-35fa2417-6925-4809-adbc-0b7adbcc805a tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:04:39.151027 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-35fa2417-6925-4809-adbc-0b7adbcc805a tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:04:39.151479 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-35fa2417-6925-4809-adbc-0b7adbcc805a tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:04:39.151931 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-35fa2417-6925-4809-adbc-0b7adbcc805a tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:04:39.184539 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-35fa2417-6925-4809-adbc-0b7adbcc805a tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050518 Aug 31 17:04:39.185103 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3811/7441] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 17:04:39 2022] GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:04:40.197914 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e9f03e28-b372-46ce-8117-2ea418fa7a1d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:04:40.200064 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e9f03e28-b372-46ce-8117-2ea418fa7a1d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: a0d4ed01-4eea-44b1-8103-73a0c174270a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:04:40.207608 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9f03e28-b372-46ce-8117-2ea418fa7a1d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:04:40.208098 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9f03e28-b372-46ce-8117-2ea418fa7a1d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:04:40.208537 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9f03e28-b372-46ce-8117-2ea418fa7a1d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:04:40.209243 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9f03e28-b372-46ce-8117-2ea418fa7a1d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:04:40.209703 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9f03e28-b372-46ce-8117-2ea418fa7a1d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:04:40.210238 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e9f03e28-b372-46ce-8117-2ea418fa7a1d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:04:40.243724 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e9f03e28-b372-46ce-8117-2ea418fa7a1d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050302 Aug 31 17:04:40.244321 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3631/7442] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 17:04:40 2022] GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 17:04:40.256406 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c17f0128-d2f0-4f41-a306-f81974c6b52e tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:04:40.256968 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c17f0128-d2f0-4f41-a306-f81974c6b52e tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: a0d4ed01-4eea-44b1-8103-73a0c174270a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:04:40.264719 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c17f0128-d2f0-4f41-a306-f81974c6b52e tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:04:40.265283 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c17f0128-d2f0-4f41-a306-f81974c6b52e tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:04:40.265732 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c17f0128-d2f0-4f41-a306-f81974c6b52e tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:04:40.266524 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c17f0128-d2f0-4f41-a306-f81974c6b52e tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:04:40.266987 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c17f0128-d2f0-4f41-a306-f81974c6b52e tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:04:40.267423 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c17f0128-d2f0-4f41-a306-f81974c6b52e tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:04:40.354920 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-c17f0128-d2f0-4f41-a306-f81974c6b52e tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] HTTP exception thrown: Instance a0d4ed01-4eea-44b1-8103-73a0c174270a is not attached to volume 8faf18be-8a8d-4037-b1fd-33a974f63786 Aug 31 17:04:40.356908 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c17f0128-d2f0-4f41-a306-f81974c6b52e tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Request method failure captured: Aug 31 17:04:40.356908 n-d-833090-16 devstack@n-api.service[128864]: request: DELETE /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a/os-volume_attachments/8faf18be-8a8d-4037-b1fd-33a974f63786 HTTP/1.1 Aug 31 17:04:40.356908 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 17:04:40.356908 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 17:04:40.356908 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 17:04:40.356908 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 17:04:40.356908 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 17:04:40.356908 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 17:04:40.356908 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 17:04:40.356908 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 17:04:40.356908 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD5N1GwgTzVD7-vjIKEVcRhDunxw5NJvwikA_v7pt8hrSW0e5qF6namwvz8IOw6N_8-aQ3Rw8C4eIN9xtCDdjrTZCIl0W-QbMYFTPezT63xP5nvkaSm_Pw0-QPXQk2ip7fDezMlVlbI9V4OC3-w02DlMfBVzTQzZvi8oKn9fbPogl8kM Aug 31 17:04:40.356908 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 17:04:40.356908 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 17:04:40.356908 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 17:04:40.356908 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 17:04:40.356908 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 17:04:40.356908 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 17:04:40.356908 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 36bab34a3a6149669d1ea4ee11dcd817 Aug 31 17:04:40.356908 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-TestMinimumBasicScenario-1099280205 Aug 31 17:04:40.356908 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 17:04:40.356908 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 17:04:40.356908 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/36bab34a3a6149669d1ea4ee11dcd817"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/36bab34a3a6149669d1ea4ee11dcd817"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/36bab34a3a6149669d1ea4ee11dcd817"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_36bab34a3a6149669d1ea4ee11dcd817", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 17:04:40.356908 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-TestMinimumBasicScenario-1099280205 Aug 31 17:04:40.356908 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 36bab34a3a6149669d1ea4ee11dcd817 Aug 31 17:04:40.356908 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1099280205 Aug 31 17:04:40.356908 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-TestMinimumBasicScenario-1099280205-project Aug 31 17:04:40.356908 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 17:04:40.356908 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 17:04:40.356908 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 84b2ea344f1e44a3b892232c88a98680 Aug 31 17:04:40.356908 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-TestMinimumBasicScenario-1099280205-project Aug 31 17:04:40.356908 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 17:04:40.356908 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance a0d4ed01-4eea-44b1-8103-73a0c174270a is not attached to volume 8faf18be-8a8d-4037-b1fd-33a974f63786 Aug 31 17:04:40.356908 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'server_id': 'a0d4ed01-4eea-44b1-8103-73a0c174270a', 'id': '8faf18be-8a8d-4037-b1fd-33a974f63786'} Aug 31 17:04:40.356908 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 17:04:40.356908 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:04:40.356908 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 31 17:04:40.356908 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 31 17:04:40.356908 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 17:04:40.356908 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 17:04:40.356908 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 31 17:04:40.356908 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 31 17:04:40.356908 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 8faf18be-8a8d-4037-b1fd-33a974f63786. Aug 31 17:04:40.356908 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 17:04:40.356908 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:04:40.356908 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 17:04:40.356908 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:04:40.356908 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:04:40.356908 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:04:40.356908 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 17:04:40.356908 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 17:04:40.356908 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 17:04:40.356908 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 17:04:40.356908 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 31 17:04:40.356908 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 31 17:04:40.356908 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0d4ed01-4eea-44b1-8103-73a0c174270a is not attached to volume 8faf18be-8a8d-4037-b1fd-33a974f63786 Aug 31 17:04:40.356908 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 17:04:40.356908 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:04:40.356908 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 17:04:40.356908 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:04:40.356908 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:04:40.356908 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:04:40.361905 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 17:04:40.361905 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 17:04:40.361905 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0d4ed01-4eea-44b1-8103-73a0c174270a is not attached to volume 8faf18be-8a8d-4037-b1fd-33a974f63786 Aug 31 17:04:40.361905 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 17:04:40.361905 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c17f0128-d2f0-4f41-a306-f81974c6b52e tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Returning 404 to user: Instance a0d4ed01-4eea-44b1-8103-73a0c174270a is not attached to volume 8faf18be-8a8d-4037-b1fd-33a974f63786 {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 17:04:40.361905 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c17f0128-d2f0-4f41-a306-f81974c6b52e tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a/os-volume_attachments/8faf18be-8a8d-4037-b1fd-33a974f63786" status: 404 len: 154 microversion: 2.1 time: 0.106779 Aug 31 17:04:40.361905 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3812/7443] 10.222.0.50 () {58 vars in 1416 bytes} [Wed Aug 31 17:04:40 2022] DELETE /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a/os-volume_attachments/8faf18be-8a8d-4037-b1fd-33a974f63786 => generated 154 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 17:04:43.640023 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-10cd26a1-a033-4516-a7d4-3de674b15b5a tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:04:43.640546 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-10cd26a1-a033-4516-a7d4-3de674b15b5a tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: a0d4ed01-4eea-44b1-8103-73a0c174270a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:04:43.648380 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10cd26a1-a033-4516-a7d4-3de674b15b5a tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:04:43.648871 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10cd26a1-a033-4516-a7d4-3de674b15b5a tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:04:43.649287 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10cd26a1-a033-4516-a7d4-3de674b15b5a tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:04:43.649991 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10cd26a1-a033-4516-a7d4-3de674b15b5a tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:04:43.650564 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10cd26a1-a033-4516-a7d4-3de674b15b5a tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:04:43.650996 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10cd26a1-a033-4516-a7d4-3de674b15b5a tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:04:43.678336 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-10cd26a1-a033-4516-a7d4-3de674b15b5a tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: a0d4ed01-4eea-44b1-8103-73a0c174270a] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 17:04:43.762977 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-10cd26a1-a033-4516-a7d4-3de674b15b5a tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a" status: 204 len: 0 microversion: 2.1 time: 0.126572 Aug 31 17:04:43.763763 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3632/7444] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 17:04:43 2022] DELETE /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 17:04:43.773913 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b0fee5fa-4028-46a7-8510-dd8a56d071f1 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:04:43.774853 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b0fee5fa-4028-46a7-8510-dd8a56d071f1 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: a0d4ed01-4eea-44b1-8103-73a0c174270a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:04:43.783100 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b0fee5fa-4028-46a7-8510-dd8a56d071f1 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:04:43.784278 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b0fee5fa-4028-46a7-8510-dd8a56d071f1 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:04:43.784911 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b0fee5fa-4028-46a7-8510-dd8a56d071f1 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:04:43.785465 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b0fee5fa-4028-46a7-8510-dd8a56d071f1 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:04:43.785930 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b0fee5fa-4028-46a7-8510-dd8a56d071f1 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:04:43.786588 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b0fee5fa-4028-46a7-8510-dd8a56d071f1 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:04:43.931506 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b0fee5fa-4028-46a7-8510-dd8a56d071f1 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:04:43.940360 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b0fee5fa-4028-46a7-8510-dd8a56d071f1 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a" status: 200 len: 1555 microversion: 2.1 time: 0.171693 Aug 31 17:04:43.941608 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3813/7445] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:04:43 2022] GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a => generated 1555 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:04:44.964839 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8d4c9581-460f-4926-9e66-4d33639304be tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:04:44.965544 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8d4c9581-460f-4926-9e66-4d33639304be tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: a0d4ed01-4eea-44b1-8103-73a0c174270a] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:04:44.974224 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d4c9581-460f-4926-9e66-4d33639304be tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:04:44.974741 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d4c9581-460f-4926-9e66-4d33639304be tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:04:44.975190 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d4c9581-460f-4926-9e66-4d33639304be tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:04:44.976398 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d4c9581-460f-4926-9e66-4d33639304be tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:04:44.976722 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d4c9581-460f-4926-9e66-4d33639304be tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:04:44.977149 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d4c9581-460f-4926-9e66-4d33639304be tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:04:45.199139 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8d4c9581-460f-4926-9e66-4d33639304be tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:04:45.210898 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8d4c9581-460f-4926-9e66-4d33639304be tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a" status: 200 len: 1555 microversion: 2.1 time: 0.250617 Aug 31 17:04:45.211503 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3633/7446] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:04:44 2022] GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a => generated 1555 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:04:46.236844 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1721cccd-6332-477e-8a50-20282dffdd82 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:04:46.237483 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1721cccd-6332-477e-8a50-20282dffdd82 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: a0d4ed01-4eea-44b1-8103-73a0c174270a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:04:46.245012 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1721cccd-6332-477e-8a50-20282dffdd82 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:04:46.245520 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1721cccd-6332-477e-8a50-20282dffdd82 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:04:46.245964 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1721cccd-6332-477e-8a50-20282dffdd82 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:04:46.247241 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1721cccd-6332-477e-8a50-20282dffdd82 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:04:46.247241 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1721cccd-6332-477e-8a50-20282dffdd82 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:04:46.247601 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1721cccd-6332-477e-8a50-20282dffdd82 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:04:46.333833 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1721cccd-6332-477e-8a50-20282dffdd82 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:04:46.351746 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1721cccd-6332-477e-8a50-20282dffdd82 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a" status: 200 len: 1513 microversion: 2.1 time: 0.122982 Aug 31 17:04:46.352795 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3814/7447] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:04:46 2022] GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a => generated 1513 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:04:46.403554 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-ee8af985-ad31-4de8-931d-bb778ceda0b6 req-964e8db6-377e-443e-9034-ee1d8d1199a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0d4ed01-4eea-44b1-8103-73a0c174270a", "name": "network-vif-deleted", "tag": "8c8aeaaf-8d01-4105-8515-a74f1d568a38"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:04:46.419630 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ee8af985-ad31-4de8-931d-bb778ceda0b6 req-964e8db6-377e-443e-9034-ee1d8d1199a6 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:04:46.420113 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ee8af985-ad31-4de8-931d-bb778ceda0b6 req-964e8db6-377e-443e-9034-ee1d8d1199a6 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:04:46.420880 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-ee8af985-ad31-4de8-931d-bb778ceda0b6 req-964e8db6-377e-443e-9034-ee1d8d1199a6 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:04:46.434731 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-ee8af985-ad31-4de8-931d-bb778ceda0b6 req-964e8db6-377e-443e-9034-ee1d8d1199a6 service nova] Creating event network-vif-deleted:8c8aeaaf-8d01-4105-8515-a74f1d568a38 for instance a0d4ed01-4eea-44b1-8103-73a0c174270a on n-h2-833090-16 Aug 31 17:04:46.439859 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-ee8af985-ad31-4de8-931d-bb778ceda0b6 req-964e8db6-377e-443e-9034-ee1d8d1199a6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113951 Aug 31 17:04:46.440558 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3634/7448] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 17:04:47.373470 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5e712bc9-11f7-4832-86e0-c998226c1efb tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:04:47.374040 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5e712bc9-11f7-4832-86e0-c998226c1efb tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: a0d4ed01-4eea-44b1-8103-73a0c174270a] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:04:47.381367 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e712bc9-11f7-4832-86e0-c998226c1efb tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:04:47.381874 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e712bc9-11f7-4832-86e0-c998226c1efb tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:04:47.382354 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e712bc9-11f7-4832-86e0-c998226c1efb tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:04:47.383055 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e712bc9-11f7-4832-86e0-c998226c1efb tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:04:47.383512 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e712bc9-11f7-4832-86e0-c998226c1efb tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:04:47.383939 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e712bc9-11f7-4832-86e0-c998226c1efb tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:04:47.398509 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-5e712bc9-11f7-4832-86e0-c998226c1efb tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] HTTP exception thrown: Instance a0d4ed01-4eea-44b1-8103-73a0c174270a could not be found. Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5e712bc9-11f7-4832-86e0-c998226c1efb tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Request method failure captured: Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a HTTP/1.1 Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD5N1GwgTzVD7-vjIKEVcRhDunxw5NJvwikA_v7pt8hrSW0e5qF6namwvz8IOw6N_8-aQ3Rw8C4eIN9xtCDdjrTZCIl0W-QbMYFTPezT63xP5nvkaSm_Pw0-QPXQk2ip7fDezMlVlbI9V4OC3-w02DlMfBVzTQzZvi8oKn9fbPogl8kM Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 36bab34a3a6149669d1ea4ee11dcd817 Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-TestMinimumBasicScenario-1099280205 Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/36bab34a3a6149669d1ea4ee11dcd817"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/36bab34a3a6149669d1ea4ee11dcd817"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/36bab34a3a6149669d1ea4ee11dcd817"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_36bab34a3a6149669d1ea4ee11dcd817", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-TestMinimumBasicScenario-1099280205 Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 36bab34a3a6149669d1ea4ee11dcd817 Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1099280205 Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-TestMinimumBasicScenario-1099280205-project Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 84b2ea344f1e44a3b892232c88a98680 Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-TestMinimumBasicScenario-1099280205-project Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance a0d4ed01-4eea-44b1-8103-73a0c174270a could not be found. Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'a0d4ed01-4eea-44b1-8103-73a0c174270a'} Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0d4ed01-4eea-44b1-8103-73a0c174270a could not be found. Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0d4ed01-4eea-44b1-8103-73a0c174270a could not be found. Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:04:47.400125 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 17:04:47.404701 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:04:47.404701 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:04:47.404701 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:04:47.404701 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 17:04:47.404701 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 17:04:47.404701 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0d4ed01-4eea-44b1-8103-73a0c174270a could not be found. Aug 31 17:04:47.404701 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 17:04:47.404701 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5e712bc9-11f7-4832-86e0-c998226c1efb tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Returning 404 to user: Instance a0d4ed01-4eea-44b1-8103-73a0c174270a could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 17:04:47.404701 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5e712bc9-11f7-4832-86e0-c998226c1efb tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a" status: 404 len: 111 microversion: 2.1 time: 0.032150 Aug 31 17:04:47.404701 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3815/7449] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:04:47 2022] GET /compute/v2.1/servers/a0d4ed01-4eea-44b1-8103-73a0c174270a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 17:04:47.412829 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7e271e8d-ac1c-4e0f-870a-55d35d37e169 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '.version_select at 0x7fbb464113a0>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:04:47.443481 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7e271e8d-ac1c-4e0f-870a-55d35d37e169 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-412871823" status: 202 len: 0 microversion: 2.1 time: 0.036286 Aug 31 17:04:47.444325 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3635/7450] 10.222.0.50 () {58 vars in 1269 bytes} [Wed Aug 31 17:04:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-412871823 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:04:56.613821 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4db981d5-65e7-4183-9464-283a7a2590ac tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Action: 'create', calling method: .version_select at 0x7fbb4672b790>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-417808966", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBIRaValcgdjPOHD3zIis74tWqF6Tn6qCUU603ztTGCnmlFHu7A5C89hScg/ZWGmq8cmnK1oWj9mtLD+AROS69bOqIQrDx+esM16mHLP2kkjlSdg17t/WaBocK8WG1+Xjw=="}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:04:56.632777 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-4db981d5-65e7-4183-9464-283a7a2590ac tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Getting quotas for project 36bab34a3a6149669d1ea4ee11dcd817. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 17:04:56.641987 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-4db981d5-65e7-4183-9464-283a7a2590ac tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Getting quotas for user 84b2ea344f1e44a3b892232c88a98680 and project 36bab34a3a6149669d1ea4ee11dcd817. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 17:04:56.673177 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4db981d5-65e7-4183-9464-283a7a2590ac tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.063326 Aug 31 17:04:56.673800 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3816/7451] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 31 17:04:56 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:04:56.726617 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:04:56.730742 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d6dad625-1f78-4c1a-b1a4-5a70dbb2ea91 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-906828756", "imageRef": "05e03bcc-1bd5-42dc-b90b-f583f2cafc2c", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-417808966", "networks": [{"uuid": "c80594e6-3ade-4f43-b24d-1bc0bf830506"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:04:56.788321 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-d6dad625-1f78-4c1a-b1a4-5a70dbb2ea91 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] validate_networks() for [('c80594e6-3ade-4f43-b24d-1bc0bf830506', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 17:04:57.269922 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-d6dad625-1f78-4c1a-b1a4-5a70dbb2ea91 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 17:04:57.270467 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-d6dad625-1f78-4c1a-b1a4-5a70dbb2ea91 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 17:04:57.271157 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-d6dad625-1f78-4c1a-b1a4-5a70dbb2ea91 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 17:04:57.272522 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-d6dad625-1f78-4c1a-b1a4-5a70dbb2ea91 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 17:04:57.272522 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-d6dad625-1f78-4c1a-b1a4-5a70dbb2ea91 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 17:04:57.286711 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6dad625-1f78-4c1a-b1a4-5a70dbb2ea91 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:04:57.287479 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6dad625-1f78-4c1a-b1a4-5a70dbb2ea91 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:04:57.287884 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6dad625-1f78-4c1a-b1a4-5a70dbb2ea91 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:04:57.288631 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6dad625-1f78-4c1a-b1a4-5a70dbb2ea91 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:04:57.289081 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6dad625-1f78-4c1a-b1a4-5a70dbb2ea91 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:04:57.289476 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6dad625-1f78-4c1a-b1a4-5a70dbb2ea91 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:04:57.307949 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-d6dad625-1f78-4c1a-b1a4-5a70dbb2ea91 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Getting quotas for project 36bab34a3a6149669d1ea4ee11dcd817. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 17:04:57.313337 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-d6dad625-1f78-4c1a-b1a4-5a70dbb2ea91 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Getting quotas for user 84b2ea344f1e44a3b892232c88a98680 and project 36bab34a3a6149669d1ea4ee11dcd817. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 17:04:57.327028 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d6dad625-1f78-4c1a-b1a4-5a70dbb2ea91 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 17:04:57.329399 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d6dad625-1f78-4c1a-b1a4-5a70dbb2ea91 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: 1d3e0c5b-9b58-4583-95b8-a60bac19db59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='05e03bcc-1bd5-42dc-b90b-f583f2cafc2c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 17:04:57.379216 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d6dad625-1f78-4c1a-b1a4-5a70dbb2ea91 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.654499 Aug 31 17:04:57.380143 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3636/7452] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 17:04:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 17:04:57.391228 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f500e35a-47dd-4e93-af89-1085049cd631 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:04:57.392238 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f500e35a-47dd-4e93-af89-1085049cd631 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: 1d3e0c5b-9b58-4583-95b8-a60bac19db59] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:04:57.395109 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:04:57.458436 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f500e35a-47dd-4e93-af89-1085049cd631 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:04:57.467361 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f500e35a-47dd-4e93-af89-1085049cd631 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59" status: 200 len: 1257 microversion: 2.1 time: 0.080347 Aug 31 17:04:57.467962 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3817/7453] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:04:57 2022] GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59 => generated 1257 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:04:58.494468 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2bb7c84d-db2d-45db-a74b-0731db49ae91 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:04:58.495036 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2bb7c84d-db2d-45db-a74b-0731db49ae91 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: 1d3e0c5b-9b58-4583-95b8-a60bac19db59] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:04:58.505494 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2bb7c84d-db2d-45db-a74b-0731db49ae91 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:04:58.506060 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2bb7c84d-db2d-45db-a74b-0731db49ae91 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:04:58.507341 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2bb7c84d-db2d-45db-a74b-0731db49ae91 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:04:58.507341 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2bb7c84d-db2d-45db-a74b-0731db49ae91 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:04:58.507623 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2bb7c84d-db2d-45db-a74b-0731db49ae91 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:04:58.508034 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2bb7c84d-db2d-45db-a74b-0731db49ae91 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:04:58.573737 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2bb7c84d-db2d-45db-a74b-0731db49ae91 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:04:58.583266 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2bb7c84d-db2d-45db-a74b-0731db49ae91 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59" status: 200 len: 1317 microversion: 2.1 time: 0.096888 Aug 31 17:04:58.583923 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3637/7454] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:04:58 2022] GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59 => generated 1317 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:04:59.606837 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-59369f16-76ad-4a9d-851e-2ede4edc9c4f tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:04:59.608315 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-59369f16-76ad-4a9d-851e-2ede4edc9c4f tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: 1d3e0c5b-9b58-4583-95b8-a60bac19db59] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:04:59.623048 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-59369f16-76ad-4a9d-851e-2ede4edc9c4f tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:04:59.624186 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-59369f16-76ad-4a9d-851e-2ede4edc9c4f tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:04:59.624835 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-59369f16-76ad-4a9d-851e-2ede4edc9c4f tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:04:59.626078 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-59369f16-76ad-4a9d-851e-2ede4edc9c4f tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:04:59.626864 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-59369f16-76ad-4a9d-851e-2ede4edc9c4f tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:04:59.628459 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-59369f16-76ad-4a9d-851e-2ede4edc9c4f tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:04:59.853344 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-59369f16-76ad-4a9d-851e-2ede4edc9c4f tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:04:59.862271 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-59369f16-76ad-4a9d-851e-2ede4edc9c4f tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59" status: 200 len: 1357 microversion: 2.1 time: 0.261517 Aug 31 17:04:59.862879 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3818/7455] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:04:59 2022] GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59 => generated 1357 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:05:00.884787 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-10871227-137f-4bc0-b3bd-f4ebd0413313 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:00.885372 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-10871227-137f-4bc0-b3bd-f4ebd0413313 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: 1d3e0c5b-9b58-4583-95b8-a60bac19db59] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:00.893118 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10871227-137f-4bc0-b3bd-f4ebd0413313 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:00.893616 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10871227-137f-4bc0-b3bd-f4ebd0413313 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:00.894053 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10871227-137f-4bc0-b3bd-f4ebd0413313 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:00.894789 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10871227-137f-4bc0-b3bd-f4ebd0413313 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:00.895247 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10871227-137f-4bc0-b3bd-f4ebd0413313 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:00.895668 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10871227-137f-4bc0-b3bd-f4ebd0413313 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:01.045313 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-10871227-137f-4bc0-b3bd-f4ebd0413313 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:01.054042 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-10871227-137f-4bc0-b3bd-f4ebd0413313 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59" status: 200 len: 1357 microversion: 2.1 time: 0.173460 Aug 31 17:05:01.054952 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3638/7456] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:00 2022] GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59 => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:05:02.076838 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0167d1cc-1e57-4db4-98d7-64949bfce125 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:02.078694 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0167d1cc-1e57-4db4-98d7-64949bfce125 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: 1d3e0c5b-9b58-4583-95b8-a60bac19db59] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:02.090586 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0167d1cc-1e57-4db4-98d7-64949bfce125 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:02.091696 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0167d1cc-1e57-4db4-98d7-64949bfce125 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:02.092554 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0167d1cc-1e57-4db4-98d7-64949bfce125 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:02.094215 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0167d1cc-1e57-4db4-98d7-64949bfce125 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:02.095190 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0167d1cc-1e57-4db4-98d7-64949bfce125 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:02.096002 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0167d1cc-1e57-4db4-98d7-64949bfce125 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:02.251445 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0167d1cc-1e57-4db4-98d7-64949bfce125 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:02.261373 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0167d1cc-1e57-4db4-98d7-64949bfce125 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59" status: 200 len: 1357 microversion: 2.1 time: 0.189818 Aug 31 17:05:02.261995 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3819/7457] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:02 2022] GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59 => generated 1357 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:05:03.283821 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a50eb530-4085-4d4a-bdad-0ce0e5ed876f tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:03.284462 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a50eb530-4085-4d4a-bdad-0ce0e5ed876f tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: 1d3e0c5b-9b58-4583-95b8-a60bac19db59] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:03.292065 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a50eb530-4085-4d4a-bdad-0ce0e5ed876f tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:03.292581 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a50eb530-4085-4d4a-bdad-0ce0e5ed876f tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:03.293014 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a50eb530-4085-4d4a-bdad-0ce0e5ed876f tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:03.293721 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a50eb530-4085-4d4a-bdad-0ce0e5ed876f tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:03.294218 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a50eb530-4085-4d4a-bdad-0ce0e5ed876f tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:03.294645 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a50eb530-4085-4d4a-bdad-0ce0e5ed876f tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:03.449512 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a50eb530-4085-4d4a-bdad-0ce0e5ed876f tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:03.458162 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a50eb530-4085-4d4a-bdad-0ce0e5ed876f tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59" status: 200 len: 1357 microversion: 2.1 time: 0.178362 Aug 31 17:05:03.458989 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3639/7458] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:03 2022] GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59 => generated 1357 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:05:04.480391 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-81ae3943-27c2-4a9d-bef4-2e141f48fe04 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:04.481052 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-81ae3943-27c2-4a9d-bef4-2e141f48fe04 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: 1d3e0c5b-9b58-4583-95b8-a60bac19db59] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:04.484926 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:05:04.490612 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-81ae3943-27c2-4a9d-bef4-2e141f48fe04 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:04.491118 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-81ae3943-27c2-4a9d-bef4-2e141f48fe04 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:04.491600 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-81ae3943-27c2-4a9d-bef4-2e141f48fe04 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:04.492376 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-81ae3943-27c2-4a9d-bef4-2e141f48fe04 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:04.492847 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-81ae3943-27c2-4a9d-bef4-2e141f48fe04 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:04.493282 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-81ae3943-27c2-4a9d-bef4-2e141f48fe04 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:04.650866 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-81ae3943-27c2-4a9d-bef4-2e141f48fe04 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:04.659661 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-81ae3943-27c2-4a9d-bef4-2e141f48fe04 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59" status: 200 len: 1357 microversion: 2.1 time: 0.183633 Aug 31 17:05:04.660190 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3820/7459] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:04 2022] GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59 => generated 1357 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:05:05.681196 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5c698d72-f639-4e7d-8113-1c4fbbbe2536 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:05.681892 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5c698d72-f639-4e7d-8113-1c4fbbbe2536 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: 1d3e0c5b-9b58-4583-95b8-a60bac19db59] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:05.684721 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:05:05.690387 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c698d72-f639-4e7d-8113-1c4fbbbe2536 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:05.691118 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c698d72-f639-4e7d-8113-1c4fbbbe2536 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:05.691575 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c698d72-f639-4e7d-8113-1c4fbbbe2536 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:05.692279 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c698d72-f639-4e7d-8113-1c4fbbbe2536 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:05.692728 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c698d72-f639-4e7d-8113-1c4fbbbe2536 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:05.693144 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c698d72-f639-4e7d-8113-1c4fbbbe2536 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:05.851278 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5c698d72-f639-4e7d-8113-1c4fbbbe2536 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:05.860604 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5c698d72-f639-4e7d-8113-1c4fbbbe2536 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59" status: 200 len: 1357 microversion: 2.1 time: 0.183410 Aug 31 17:05:05.861582 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3640/7460] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:05 2022] GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59 => generated 1357 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:05:06.883932 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9b228b0d-b43a-4e7e-b504-077dc9936c0a tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:06.884598 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9b228b0d-b43a-4e7e-b504-077dc9936c0a tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: 1d3e0c5b-9b58-4583-95b8-a60bac19db59] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:06.892465 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9b228b0d-b43a-4e7e-b504-077dc9936c0a tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:06.892975 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9b228b0d-b43a-4e7e-b504-077dc9936c0a tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:06.893462 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9b228b0d-b43a-4e7e-b504-077dc9936c0a tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:06.894224 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9b228b0d-b43a-4e7e-b504-077dc9936c0a tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:06.894694 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9b228b0d-b43a-4e7e-b504-077dc9936c0a tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:06.895133 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9b228b0d-b43a-4e7e-b504-077dc9936c0a tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:07.037288 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9b228b0d-b43a-4e7e-b504-077dc9936c0a tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:07.045897 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9b228b0d-b43a-4e7e-b504-077dc9936c0a tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59" status: 200 len: 1357 microversion: 2.1 time: 0.166591 Aug 31 17:05:07.046556 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3821/7461] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:06 2022] GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59 => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:05:07.409255 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-fa9d1eaf-2100-49d3-bf75-ff71c90f87a2 req-12a8a1b8-590b-41bd-9575-394e5f900b40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d3e0c5b-9b58-4583-95b8-a60bac19db59", "tag": "0a814d5b-5e26-412d-a74d-3b0a8eb316fe"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:05:07.415736 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:05:07.416498 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:05:07.423301 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-fa9d1eaf-2100-49d3-bf75-ff71c90f87a2 req-12a8a1b8-590b-41bd-9575-394e5f900b40 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:07.423786 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-fa9d1eaf-2100-49d3-bf75-ff71c90f87a2 req-12a8a1b8-590b-41bd-9575-394e5f900b40 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:07.424218 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-fa9d1eaf-2100-49d3-bf75-ff71c90f87a2 req-12a8a1b8-590b-41bd-9575-394e5f900b40 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:07.436509 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-fa9d1eaf-2100-49d3-bf75-ff71c90f87a2 req-12a8a1b8-590b-41bd-9575-394e5f900b40 service nova] Creating event network-changed:0a814d5b-5e26-412d-a74d-3b0a8eb316fe for instance 1d3e0c5b-9b58-4583-95b8-a60bac19db59 on n-h1-833090-16 Aug 31 17:05:07.442468 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-fa9d1eaf-2100-49d3-bf75-ff71c90f87a2 req-12a8a1b8-590b-41bd-9575-394e5f900b40 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037805 Aug 31 17:05:07.443107 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3641/7462] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:05:08.072178 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7c09c153-158c-4b93-876c-bbdd578c7653 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:08.073460 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7c09c153-158c-4b93-876c-bbdd578c7653 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: 1d3e0c5b-9b58-4583-95b8-a60bac19db59] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:08.076406 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=6 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:05:08.086580 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7c09c153-158c-4b93-876c-bbdd578c7653 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:08.087086 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7c09c153-158c-4b93-876c-bbdd578c7653 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:08.087538 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7c09c153-158c-4b93-876c-bbdd578c7653 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:08.088248 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7c09c153-158c-4b93-876c-bbdd578c7653 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:08.088827 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7c09c153-158c-4b93-876c-bbdd578c7653 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:08.089294 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7c09c153-158c-4b93-876c-bbdd578c7653 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:08.223629 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7c09c153-158c-4b93-876c-bbdd578c7653 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:08.232477 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7c09c153-158c-4b93-876c-bbdd578c7653 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59" status: 200 len: 1357 microversion: 2.1 time: 0.167594 Aug 31 17:05:08.233059 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3822/7463] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:08 2022] GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59 => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:05:09.255659 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8337f76a-ab0e-40ab-b367-63c7e7467a1c tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:09.256519 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8337f76a-ab0e-40ab-b367-63c7e7467a1c tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: 1d3e0c5b-9b58-4583-95b8-a60bac19db59] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:09.264283 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8337f76a-ab0e-40ab-b367-63c7e7467a1c tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:09.264831 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8337f76a-ab0e-40ab-b367-63c7e7467a1c tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:09.265302 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8337f76a-ab0e-40ab-b367-63c7e7467a1c tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:09.266079 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8337f76a-ab0e-40ab-b367-63c7e7467a1c tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:09.266704 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8337f76a-ab0e-40ab-b367-63c7e7467a1c tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:09.267157 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8337f76a-ab0e-40ab-b367-63c7e7467a1c tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:09.413775 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8337f76a-ab0e-40ab-b367-63c7e7467a1c tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:09.425643 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8337f76a-ab0e-40ab-b367-63c7e7467a1c tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59" status: 200 len: 1357 microversion: 2.1 time: 0.175405 Aug 31 17:05:09.426497 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3642/7464] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:09 2022] GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59 => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:05:10.448324 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-33a3953d-ca9c-4240-af26-7a77208bc755 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:10.448967 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-33a3953d-ca9c-4240-af26-7a77208bc755 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: 1d3e0c5b-9b58-4583-95b8-a60bac19db59] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:10.456530 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33a3953d-ca9c-4240-af26-7a77208bc755 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:10.457033 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33a3953d-ca9c-4240-af26-7a77208bc755 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:10.457488 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33a3953d-ca9c-4240-af26-7a77208bc755 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:10.458235 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33a3953d-ca9c-4240-af26-7a77208bc755 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:10.458708 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33a3953d-ca9c-4240-af26-7a77208bc755 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:10.459148 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-33a3953d-ca9c-4240-af26-7a77208bc755 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:10.607188 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-33a3953d-ca9c-4240-af26-7a77208bc755 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:10.617636 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-33a3953d-ca9c-4240-af26-7a77208bc755 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59" status: 200 len: 1357 microversion: 2.1 time: 0.173666 Aug 31 17:05:10.618577 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3823/7465] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:10 2022] GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59 => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:05:11.643262 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-28fb4eb0-d252-429e-a879-244524386482 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:11.643844 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-28fb4eb0-d252-429e-a879-244524386482 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: 1d3e0c5b-9b58-4583-95b8-a60bac19db59] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:11.654140 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28fb4eb0-d252-429e-a879-244524386482 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:11.654695 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28fb4eb0-d252-429e-a879-244524386482 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:11.655125 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28fb4eb0-d252-429e-a879-244524386482 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:11.655857 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28fb4eb0-d252-429e-a879-244524386482 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:11.656327 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28fb4eb0-d252-429e-a879-244524386482 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:11.656739 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28fb4eb0-d252-429e-a879-244524386482 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:11.801905 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-28fb4eb0-d252-429e-a879-244524386482 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:11.811058 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-28fb4eb0-d252-429e-a879-244524386482 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59" status: 200 len: 1357 microversion: 2.1 time: 0.172211 Aug 31 17:05:11.811653 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3643/7466] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:11 2022] GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59 => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:05:12.833588 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0da19966-8d14-4435-8410-3112c5af721d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:12.834201 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0da19966-8d14-4435-8410-3112c5af721d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: 1d3e0c5b-9b58-4583-95b8-a60bac19db59] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:12.842013 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0da19966-8d14-4435-8410-3112c5af721d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:12.842546 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0da19966-8d14-4435-8410-3112c5af721d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:12.843003 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0da19966-8d14-4435-8410-3112c5af721d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:12.843724 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0da19966-8d14-4435-8410-3112c5af721d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:12.844191 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0da19966-8d14-4435-8410-3112c5af721d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:12.844634 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0da19966-8d14-4435-8410-3112c5af721d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:12.993403 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0da19966-8d14-4435-8410-3112c5af721d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:13.002716 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0da19966-8d14-4435-8410-3112c5af721d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59" status: 200 len: 1357 microversion: 2.1 time: 0.173240 Aug 31 17:05:13.003306 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3824/7467] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:12 2022] GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59 => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:05:13.449204 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-39a02024-186e-4ce8-9398-8c81fc4200ee req-302c51c4-21b4-4bee-86cc-2220148210fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d3e0c5b-9b58-4583-95b8-a60bac19db59", "name": "network-vif-plugged", "status": "completed", "tag": "0a814d5b-5e26-412d-a74d-3b0a8eb316fe"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:05:13.459854 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-39a02024-186e-4ce8-9398-8c81fc4200ee req-302c51c4-21b4-4bee-86cc-2220148210fc service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:13.460332 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-39a02024-186e-4ce8-9398-8c81fc4200ee req-302c51c4-21b4-4bee-86cc-2220148210fc service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:13.460757 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-39a02024-186e-4ce8-9398-8c81fc4200ee req-302c51c4-21b4-4bee-86cc-2220148210fc service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:13.475457 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-39a02024-186e-4ce8-9398-8c81fc4200ee req-302c51c4-21b4-4bee-86cc-2220148210fc service nova] Creating event network-vif-plugged:0a814d5b-5e26-412d-a74d-3b0a8eb316fe for instance 1d3e0c5b-9b58-4583-95b8-a60bac19db59 on n-h1-833090-16 Aug 31 17:05:13.481366 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-39a02024-186e-4ce8-9398-8c81fc4200ee req-302c51c4-21b4-4bee-86cc-2220148210fc service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095796 Aug 31 17:05:13.482167 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3644/7468] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:05:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:05:14.024408 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-45b7ce13-574d-49f1-a7b4-0ec34048f642 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:14.025039 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-45b7ce13-574d-49f1-a7b4-0ec34048f642 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: 1d3e0c5b-9b58-4583-95b8-a60bac19db59] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:14.032859 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-45b7ce13-574d-49f1-a7b4-0ec34048f642 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:14.033501 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-45b7ce13-574d-49f1-a7b4-0ec34048f642 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:14.033962 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-45b7ce13-574d-49f1-a7b4-0ec34048f642 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:14.034701 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-45b7ce13-574d-49f1-a7b4-0ec34048f642 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:14.035175 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-45b7ce13-574d-49f1-a7b4-0ec34048f642 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:14.035610 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-45b7ce13-574d-49f1-a7b4-0ec34048f642 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:14.175558 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-45b7ce13-574d-49f1-a7b4-0ec34048f642 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:14.183947 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-45b7ce13-574d-49f1-a7b4-0ec34048f642 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59" status: 200 len: 1357 microversion: 2.1 time: 0.163589 Aug 31 17:05:14.184486 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3825/7469] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:14 2022] GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59 => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:05:15.209179 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8d1ce4f6-d31a-4ed7-bc4b-5afb84799cbf tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:15.210123 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8d1ce4f6-d31a-4ed7-bc4b-5afb84799cbf tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: 1d3e0c5b-9b58-4583-95b8-a60bac19db59] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:15.218598 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d1ce4f6-d31a-4ed7-bc4b-5afb84799cbf tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:15.219080 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d1ce4f6-d31a-4ed7-bc4b-5afb84799cbf tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:15.219504 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d1ce4f6-d31a-4ed7-bc4b-5afb84799cbf tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:15.220188 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d1ce4f6-d31a-4ed7-bc4b-5afb84799cbf tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:15.220637 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d1ce4f6-d31a-4ed7-bc4b-5afb84799cbf tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:15.221048 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8d1ce4f6-d31a-4ed7-bc4b-5afb84799cbf tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:15.372944 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8d1ce4f6-d31a-4ed7-bc4b-5afb84799cbf tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:15.381706 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8d1ce4f6-d31a-4ed7-bc4b-5afb84799cbf tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59" status: 200 len: 1547 microversion: 2.1 time: 0.179520 Aug 31 17:05:15.382329 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3645/7470] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:15 2022] GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59 => generated 1547 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:05:15.405213 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-19d23e15-e774-4167-97cc-61b1b6f12236 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:15.405827 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-19d23e15-e774-4167-97cc-61b1b6f12236 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: 1d3e0c5b-9b58-4583-95b8-a60bac19db59] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:15.413319 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-19d23e15-e774-4167-97cc-61b1b6f12236 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:15.413814 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-19d23e15-e774-4167-97cc-61b1b6f12236 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:15.414308 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-19d23e15-e774-4167-97cc-61b1b6f12236 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:15.415026 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-19d23e15-e774-4167-97cc-61b1b6f12236 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:15.415492 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-19d23e15-e774-4167-97cc-61b1b6f12236 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:15.415932 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-19d23e15-e774-4167-97cc-61b1b6f12236 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:15.559348 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-19d23e15-e774-4167-97cc-61b1b6f12236 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:15.571626 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-19d23e15-e774-4167-97cc-61b1b6f12236 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59" status: 200 len: 1547 microversion: 2.1 time: 0.172927 Aug 31 17:05:15.572441 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3826/7471] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:15 2022] GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59 => generated 1547 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:05:15.592855 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d9fe6f6c-0e8e-4925-884c-da9ec5c868eb tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:15.597542 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d9fe6f6c-0e8e-4925-884c-da9ec5c868eb tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:15.598359 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d9fe6f6c-0e8e-4925-884c-da9ec5c868eb tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Searching by: {'deleted': False, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817'} {{(pid=128863) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 31 17:05:15.604355 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9fe6f6c-0e8e-4925-884c-da9ec5c868eb tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:15.606639 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9fe6f6c-0e8e-4925-884c-da9ec5c868eb tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:15.607123 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9fe6f6c-0e8e-4925-884c-da9ec5c868eb tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:15.608323 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9fe6f6c-0e8e-4925-884c-da9ec5c868eb tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:15.608785 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9fe6f6c-0e8e-4925-884c-da9ec5c868eb tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:15.609210 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9fe6f6c-0e8e-4925-884c-da9ec5c868eb tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:15.635317 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.multi_cell_list [None req-d9fe6f6c-0e8e-4925-884c-da9ec5c868eb tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128863) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 31 17:05:15.662562 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d9fe6f6c-0e8e-4925-884c-da9ec5c868eb tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.073525 Aug 31 17:05:15.663155 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3646/7472] 10.222.0.50 () {58 vars in 1125 bytes} [Wed Aug 31 17:05:15 2022] GET /compute/v2.1/servers => generated 342 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:05:15.674700 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e5661e63-c9f6-49fc-9980-213c8e8cad29 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:15.675319 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e5661e63-c9f6-49fc-9980-213c8e8cad29 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: 1d3e0c5b-9b58-4583-95b8-a60bac19db59] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:15.681878 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e5661e63-c9f6-49fc-9980-213c8e8cad29 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:15.682393 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e5661e63-c9f6-49fc-9980-213c8e8cad29 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:15.682837 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e5661e63-c9f6-49fc-9980-213c8e8cad29 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:15.683525 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e5661e63-c9f6-49fc-9980-213c8e8cad29 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:15.683978 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e5661e63-c9f6-49fc-9980-213c8e8cad29 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:15.684415 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e5661e63-c9f6-49fc-9980-213c8e8cad29 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:15.832083 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e5661e63-c9f6-49fc-9980-213c8e8cad29 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:15.840454 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e5661e63-c9f6-49fc-9980-213c8e8cad29 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59" status: 200 len: 1547 microversion: 2.1 time: 0.169718 Aug 31 17:05:15.841041 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3827/7473] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:15 2022] GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59 => generated 1547 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:05:17.402850 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-46d45602-3444-48ba-be9e-15ae316d2b61 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "79d29aef-87d4-4616-9838-4da5a43adad1"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:05:17.405330 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-46d45602-3444-48ba-be9e-15ae316d2b61 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: 1d3e0c5b-9b58-4583-95b8-a60bac19db59] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:17.412455 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46d45602-3444-48ba-be9e-15ae316d2b61 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:17.412925 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46d45602-3444-48ba-be9e-15ae316d2b61 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:17.413351 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46d45602-3444-48ba-be9e-15ae316d2b61 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:17.414030 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46d45602-3444-48ba-be9e-15ae316d2b61 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:17.414500 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46d45602-3444-48ba-be9e-15ae316d2b61 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:17.414911 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-46d45602-3444-48ba-be9e-15ae316d2b61 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:17.695427 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-46d45602-3444-48ba-be9e-15ae316d2b61 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "POST /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296635 Aug 31 17:05:17.696092 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3647/7474] 10.222.0.50 () {60 vars in 1323 bytes} [Wed Aug 31 17:05:17 2022] POST /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:05:28.535577 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6d061b62-2561-4242-942e-4bd66422945d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:28.536356 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6d061b62-2561-4242-942e-4bd66422945d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: 1d3e0c5b-9b58-4583-95b8-a60bac19db59] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:28.539191 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=15 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:05:28.539873 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=60 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:05:28.546640 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d061b62-2561-4242-942e-4bd66422945d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:28.547172 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d061b62-2561-4242-942e-4bd66422945d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:28.547628 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d061b62-2561-4242-942e-4bd66422945d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:28.548372 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d061b62-2561-4242-942e-4bd66422945d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:28.548840 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d061b62-2561-4242-942e-4bd66422945d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:28.549285 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6d061b62-2561-4242-942e-4bd66422945d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:28.696128 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6d061b62-2561-4242-942e-4bd66422945d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:28.705622 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6d061b62-2561-4242-942e-4bd66422945d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59" status: 200 len: 1593 microversion: 2.1 time: 0.174138 Aug 31 17:05:28.706247 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3828/7475] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:28 2022] GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59 => generated 1593 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:05:30.769988 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:05:30.771797 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=15 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:05:30.773159 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:05:30.779685 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-21e35d1f-d8f6-476c-b9a7-ebf7e716aa73 req-8e49d0b5-60fc-4df5-a6c4-b540eb385fb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d3e0c5b-9b58-4583-95b8-a60bac19db59", "tag": "0a814d5b-5e26-412d-a74d-3b0a8eb316fe"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:05:30.797494 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-21e35d1f-d8f6-476c-b9a7-ebf7e716aa73 req-8e49d0b5-60fc-4df5-a6c4-b540eb385fb3 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:30.798769 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-21e35d1f-d8f6-476c-b9a7-ebf7e716aa73 req-8e49d0b5-60fc-4df5-a6c4-b540eb385fb3 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:30.799421 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-21e35d1f-d8f6-476c-b9a7-ebf7e716aa73 req-8e49d0b5-60fc-4df5-a6c4-b540eb385fb3 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:30.814111 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-21e35d1f-d8f6-476c-b9a7-ebf7e716aa73 req-8e49d0b5-60fc-4df5-a6c4-b540eb385fb3 service nova] Creating event network-changed:0a814d5b-5e26-412d-a74d-3b0a8eb316fe for instance 1d3e0c5b-9b58-4583-95b8-a60bac19db59 on n-h1-833090-16 Aug 31 17:05:30.819919 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-21e35d1f-d8f6-476c-b9a7-ebf7e716aa73 req-8e49d0b5-60fc-4df5-a6c4-b540eb385fb3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052186 Aug 31 17:05:30.820876 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3648/7476] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:05:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:05:31.800515 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-54c22141-ceb0-4867-bd06-96e2ce7bec70 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1648025818"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:05:31.801163 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-54c22141-ceb0-4867-bd06-96e2ce7bec70 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: 1d3e0c5b-9b58-4583-95b8-a60bac19db59] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:31.808931 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-54c22141-ceb0-4867-bd06-96e2ce7bec70 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:31.809705 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-54c22141-ceb0-4867-bd06-96e2ce7bec70 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:31.810215 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-54c22141-ceb0-4867-bd06-96e2ce7bec70 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:31.810998 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-54c22141-ceb0-4867-bd06-96e2ce7bec70 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:31.811470 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-54c22141-ceb0-4867-bd06-96e2ce7bec70 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:31.811910 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-54c22141-ceb0-4867-bd06-96e2ce7bec70 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:31.949701 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.network.security_group_api [None req-54c22141-ceb0-4867-bd06-96e2ce7bec70 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Adding security group b80ebb8c-860d-4104-92b7-e14b5781a17f to port 0a814d5b-5e26-412d-a74d-3b0a8eb316fe Aug 31 17:05:32.293088 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-54c22141-ceb0-4867-bd06-96e2ce7bec70 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "POST /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59/action" status: 202 len: 0 microversion: 2.1 time: 0.496434 Aug 31 17:05:32.296647 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3829/7477] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 17:05:31 2022] POST /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59/action => generated 0 bytes in 498 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:05:32.305023 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d6df5fd7-5587-42bd-adb8-733f613b2643 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:32.305693 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d6df5fd7-5587-42bd-adb8-733f613b2643 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: 1d3e0c5b-9b58-4583-95b8-a60bac19db59] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:32.315032 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6df5fd7-5587-42bd-adb8-733f613b2643 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:32.315681 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6df5fd7-5587-42bd-adb8-733f613b2643 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:32.316476 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6df5fd7-5587-42bd-adb8-733f613b2643 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:32.317482 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6df5fd7-5587-42bd-adb8-733f613b2643 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:32.318115 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6df5fd7-5587-42bd-adb8-733f613b2643 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:32.318687 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d6df5fd7-5587-42bd-adb8-733f613b2643 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:32.374695 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-8c9de721-cbb8-459b-b731-4837c77e0bb8 req-b10233c7-380b-464b-a28a-8f585120498a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d3e0c5b-9b58-4583-95b8-a60bac19db59", "tag": "0a814d5b-5e26-412d-a74d-3b0a8eb316fe"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:05:32.385855 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-8c9de721-cbb8-459b-b731-4837c77e0bb8 req-b10233c7-380b-464b-a28a-8f585120498a service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:32.386724 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-8c9de721-cbb8-459b-b731-4837c77e0bb8 req-b10233c7-380b-464b-a28a-8f585120498a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:32.387391 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-8c9de721-cbb8-459b-b731-4837c77e0bb8 req-b10233c7-380b-464b-a28a-8f585120498a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:32.400911 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-8c9de721-cbb8-459b-b731-4837c77e0bb8 req-b10233c7-380b-464b-a28a-8f585120498a service nova] Creating event network-changed:0a814d5b-5e26-412d-a74d-3b0a8eb316fe for instance 1d3e0c5b-9b58-4583-95b8-a60bac19db59 on n-h1-833090-16 Aug 31 17:05:32.407029 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-8c9de721-cbb8-459b-b731-4837c77e0bb8 req-b10233c7-380b-464b-a28a-8f585120498a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108470 Aug 31 17:05:32.407739 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3830/7478] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:05:32.506413 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d6df5fd7-5587-42bd-adb8-733f613b2643 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:32.515233 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d6df5fd7-5587-42bd-adb8-733f613b2643 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59" status: 200 len: 1759 microversion: 2.1 time: 0.216738 Aug 31 17:05:32.516336 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3649/7479] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:32 2022] GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59 => generated 1759 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:05:47.441458 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=6 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:05:47.442310 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=12 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:05:47.447355 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-776cb985-3163-4ee2-b8a9-cb2b35abeef6 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:05:47.450466 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-776cb985-3163-4ee2-b8a9-cb2b35abeef6 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: 1d3e0c5b-9b58-4583-95b8-a60bac19db59] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:47.459124 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-776cb985-3163-4ee2-b8a9-cb2b35abeef6 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:47.459703 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-776cb985-3163-4ee2-b8a9-cb2b35abeef6 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:47.460250 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-776cb985-3163-4ee2-b8a9-cb2b35abeef6 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:47.461081 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-776cb985-3163-4ee2-b8a9-cb2b35abeef6 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:47.461623 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-776cb985-3163-4ee2-b8a9-cb2b35abeef6 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:47.462164 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-776cb985-3163-4ee2-b8a9-cb2b35abeef6 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:47.543597 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-776cb985-3163-4ee2-b8a9-cb2b35abeef6 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "POST /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59/action" status: 202 len: 0 microversion: 2.1 time: 0.104472 Aug 31 17:05:47.544479 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3831/7480] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 17:05:47 2022] POST /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:05:47.552682 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f5df8e68-80e7-4171-9e55-5d76d5d0c70a tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:47.553689 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f5df8e68-80e7-4171-9e55-5d76d5d0c70a tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: 1d3e0c5b-9b58-4583-95b8-a60bac19db59] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:47.557762 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:05:47.558915 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=8 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:05:47.562546 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5df8e68-80e7-4171-9e55-5d76d5d0c70a tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:47.563097 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5df8e68-80e7-4171-9e55-5d76d5d0c70a tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:47.563531 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5df8e68-80e7-4171-9e55-5d76d5d0c70a tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:47.564263 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5df8e68-80e7-4171-9e55-5d76d5d0c70a tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:47.564712 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5df8e68-80e7-4171-9e55-5d76d5d0c70a tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:47.565149 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f5df8e68-80e7-4171-9e55-5d76d5d0c70a tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:47.725585 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f5df8e68-80e7-4171-9e55-5d76d5d0c70a tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:47.736872 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f5df8e68-80e7-4171-9e55-5d76d5d0c70a tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59" status: 200 len: 1751 microversion: 2.1 time: 0.187983 Aug 31 17:05:47.737830 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3650/7481] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:47 2022] GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59 => generated 1751 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:05:48.765943 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8db931c8-7b52-4562-b70a-6c780bff362e tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:48.766954 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8db931c8-7b52-4562-b70a-6c780bff362e tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: 1d3e0c5b-9b58-4583-95b8-a60bac19db59] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:48.776945 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8db931c8-7b52-4562-b70a-6c780bff362e tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:48.777929 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8db931c8-7b52-4562-b70a-6c780bff362e tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:48.778629 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8db931c8-7b52-4562-b70a-6c780bff362e tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:48.779477 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8db931c8-7b52-4562-b70a-6c780bff362e tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:48.779935 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8db931c8-7b52-4562-b70a-6c780bff362e tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:48.780360 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8db931c8-7b52-4562-b70a-6c780bff362e tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:48.934846 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8db931c8-7b52-4562-b70a-6c780bff362e tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:48.944230 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8db931c8-7b52-4562-b70a-6c780bff362e tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59" status: 200 len: 1756 microversion: 2.1 time: 0.186768 Aug 31 17:05:48.944811 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3832/7482] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:48 2022] GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59 => generated 1756 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:05:49.969782 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fe650cbd-113e-430e-97dd-417d156e199f tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:49.970553 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fe650cbd-113e-430e-97dd-417d156e199f tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: 1d3e0c5b-9b58-4583-95b8-a60bac19db59] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:49.980935 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe650cbd-113e-430e-97dd-417d156e199f tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:49.981586 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe650cbd-113e-430e-97dd-417d156e199f tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:49.982244 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe650cbd-113e-430e-97dd-417d156e199f tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:49.982926 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe650cbd-113e-430e-97dd-417d156e199f tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:49.983369 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe650cbd-113e-430e-97dd-417d156e199f tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:49.983788 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe650cbd-113e-430e-97dd-417d156e199f tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:50.141828 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fe650cbd-113e-430e-97dd-417d156e199f tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:50.154814 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fe650cbd-113e-430e-97dd-417d156e199f tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59" status: 200 len: 1756 microversion: 2.1 time: 0.190524 Aug 31 17:05:50.155441 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3651/7483] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:49 2022] GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59 => generated 1756 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:05:51.180033 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-421d4a7d-976a-4d8e-8040-9f6cb8601c4d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:51.180688 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-421d4a7d-976a-4d8e-8040-9f6cb8601c4d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: 1d3e0c5b-9b58-4583-95b8-a60bac19db59] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:51.190269 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-421d4a7d-976a-4d8e-8040-9f6cb8601c4d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:51.190774 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-421d4a7d-976a-4d8e-8040-9f6cb8601c4d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:51.191225 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-421d4a7d-976a-4d8e-8040-9f6cb8601c4d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:51.191940 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-421d4a7d-976a-4d8e-8040-9f6cb8601c4d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:51.192399 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-421d4a7d-976a-4d8e-8040-9f6cb8601c4d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:51.192878 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-421d4a7d-976a-4d8e-8040-9f6cb8601c4d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:51.354259 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-421d4a7d-976a-4d8e-8040-9f6cb8601c4d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:51.363879 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-421d4a7d-976a-4d8e-8040-9f6cb8601c4d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59" status: 200 len: 1756 microversion: 2.1 time: 0.190538 Aug 31 17:05:51.364498 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3833/7484] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:51 2022] GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59 => generated 1756 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:05:52.393849 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b626db7f-d442-4de5-baae-e44ee4db8608 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:52.394502 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b626db7f-d442-4de5-baae-e44ee4db8608 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: 1d3e0c5b-9b58-4583-95b8-a60bac19db59] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:52.401671 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b626db7f-d442-4de5-baae-e44ee4db8608 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:52.402197 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b626db7f-d442-4de5-baae-e44ee4db8608 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:52.402636 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b626db7f-d442-4de5-baae-e44ee4db8608 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:52.403328 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b626db7f-d442-4de5-baae-e44ee4db8608 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:52.403812 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b626db7f-d442-4de5-baae-e44ee4db8608 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:52.404238 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b626db7f-d442-4de5-baae-e44ee4db8608 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:52.579102 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b626db7f-d442-4de5-baae-e44ee4db8608 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:52.592962 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b626db7f-d442-4de5-baae-e44ee4db8608 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59" status: 200 len: 1756 microversion: 2.1 time: 0.203192 Aug 31 17:05:52.593538 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3652/7485] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:52 2022] GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59 => generated 1756 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:05:53.616663 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e6b4c1d9-6dd5-42c2-ac81-1c39d1066a09 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:53.617241 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e6b4c1d9-6dd5-42c2-ac81-1c39d1066a09 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: 1d3e0c5b-9b58-4583-95b8-a60bac19db59] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:53.624925 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6b4c1d9-6dd5-42c2-ac81-1c39d1066a09 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:53.625437 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6b4c1d9-6dd5-42c2-ac81-1c39d1066a09 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:53.625877 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6b4c1d9-6dd5-42c2-ac81-1c39d1066a09 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:53.627135 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6b4c1d9-6dd5-42c2-ac81-1c39d1066a09 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:53.627135 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6b4c1d9-6dd5-42c2-ac81-1c39d1066a09 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:53.627656 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6b4c1d9-6dd5-42c2-ac81-1c39d1066a09 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:53.781342 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e6b4c1d9-6dd5-42c2-ac81-1c39d1066a09 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:53.794651 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e6b4c1d9-6dd5-42c2-ac81-1c39d1066a09 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59" status: 200 len: 1756 microversion: 2.1 time: 0.182972 Aug 31 17:05:53.795654 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3834/7486] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:53 2022] GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59 => generated 1756 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:05:54.817836 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c8c2f469-ea3f-4e52-87ca-1224c22500ae tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:54.818482 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c8c2f469-ea3f-4e52-87ca-1224c22500ae tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: 1d3e0c5b-9b58-4583-95b8-a60bac19db59] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:54.826121 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8c2f469-ea3f-4e52-87ca-1224c22500ae tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:54.826610 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8c2f469-ea3f-4e52-87ca-1224c22500ae tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:54.827033 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8c2f469-ea3f-4e52-87ca-1224c22500ae tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:54.827711 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8c2f469-ea3f-4e52-87ca-1224c22500ae tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:54.828303 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8c2f469-ea3f-4e52-87ca-1224c22500ae tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:54.828942 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c8c2f469-ea3f-4e52-87ca-1224c22500ae tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:54.986673 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c8c2f469-ea3f-4e52-87ca-1224c22500ae tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:54.995355 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c8c2f469-ea3f-4e52-87ca-1224c22500ae tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59" status: 200 len: 1756 microversion: 2.1 time: 0.182024 Aug 31 17:05:54.995936 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3653/7487] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:54 2022] GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59 => generated 1756 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:05:56.027369 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1e806874-7f95-4fd8-a916-a62f1db65ce6 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:56.028009 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1e806874-7f95-4fd8-a916-a62f1db65ce6 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: 1d3e0c5b-9b58-4583-95b8-a60bac19db59] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:56.037811 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e806874-7f95-4fd8-a916-a62f1db65ce6 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:56.038522 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e806874-7f95-4fd8-a916-a62f1db65ce6 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:56.039140 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e806874-7f95-4fd8-a916-a62f1db65ce6 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:56.040144 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e806874-7f95-4fd8-a916-a62f1db65ce6 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:56.040759 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e806874-7f95-4fd8-a916-a62f1db65ce6 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:56.041340 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1e806874-7f95-4fd8-a916-a62f1db65ce6 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:56.199126 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1e806874-7f95-4fd8-a916-a62f1db65ce6 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:56.207914 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1e806874-7f95-4fd8-a916-a62f1db65ce6 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59" status: 200 len: 1756 microversion: 2.1 time: 0.186868 Aug 31 17:05:56.208479 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3835/7488] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:56 2022] GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59 => generated 1756 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:05:57.231031 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-578eb446-0c99-4ec7-b312-4299df6ae3db tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:57.231655 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-578eb446-0c99-4ec7-b312-4299df6ae3db tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: 1d3e0c5b-9b58-4583-95b8-a60bac19db59] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:57.239949 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-578eb446-0c99-4ec7-b312-4299df6ae3db tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:57.240454 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-578eb446-0c99-4ec7-b312-4299df6ae3db tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:57.240970 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-578eb446-0c99-4ec7-b312-4299df6ae3db tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:57.241728 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-578eb446-0c99-4ec7-b312-4299df6ae3db tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:57.242284 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-578eb446-0c99-4ec7-b312-4299df6ae3db tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:57.242737 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-578eb446-0c99-4ec7-b312-4299df6ae3db tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:57.409848 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-578eb446-0c99-4ec7-b312-4299df6ae3db tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:57.423349 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-578eb446-0c99-4ec7-b312-4299df6ae3db tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59" status: 200 len: 1756 microversion: 2.1 time: 0.195986 Aug 31 17:05:57.424262 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3654/7489] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:57 2022] GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59 => generated 1756 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:05:58.455289 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-654d9120-c932-467a-a95b-20160a5d5bc1 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:58.455905 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-654d9120-c932-467a-a95b-20160a5d5bc1 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: 1d3e0c5b-9b58-4583-95b8-a60bac19db59] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:58.467568 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-654d9120-c932-467a-a95b-20160a5d5bc1 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:58.468235 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-654d9120-c932-467a-a95b-20160a5d5bc1 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:58.468890 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-654d9120-c932-467a-a95b-20160a5d5bc1 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:58.469956 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-654d9120-c932-467a-a95b-20160a5d5bc1 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:58.470690 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-654d9120-c932-467a-a95b-20160a5d5bc1 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:58.471292 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-654d9120-c932-467a-a95b-20160a5d5bc1 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:58.643517 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-654d9120-c932-467a-a95b-20160a5d5bc1 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:58.652782 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-654d9120-c932-467a-a95b-20160a5d5bc1 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59" status: 200 len: 1756 microversion: 2.1 time: 0.203820 Aug 31 17:05:58.653386 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3836/7490] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:58 2022] GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59 => generated 1756 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:05:59.675226 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-02e8adc1-d2c6-490e-82e4-bde8d7ca0ecb tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:05:59.675857 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-02e8adc1-d2c6-490e-82e4-bde8d7ca0ecb tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: 1d3e0c5b-9b58-4583-95b8-a60bac19db59] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:05:59.683541 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02e8adc1-d2c6-490e-82e4-bde8d7ca0ecb tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:59.684025 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02e8adc1-d2c6-490e-82e4-bde8d7ca0ecb tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:59.684471 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02e8adc1-d2c6-490e-82e4-bde8d7ca0ecb tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:59.685149 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02e8adc1-d2c6-490e-82e4-bde8d7ca0ecb tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:05:59.685669 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02e8adc1-d2c6-490e-82e4-bde8d7ca0ecb tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:05:59.686132 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-02e8adc1-d2c6-490e-82e4-bde8d7ca0ecb tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:05:59.845151 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-02e8adc1-d2c6-490e-82e4-bde8d7ca0ecb tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:05:59.855475 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-02e8adc1-d2c6-490e-82e4-bde8d7ca0ecb tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59" status: 200 len: 1759 microversion: 2.1 time: 0.184380 Aug 31 17:05:59.856023 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3655/7491] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:05:59 2022] GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59 => generated 1759 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:06:32.259978 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-42fd1f12-1d6a-4f9b-a32a-2419fdfba40a tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1648025818"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:06:32.260647 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-42fd1f12-1d6a-4f9b-a32a-2419fdfba40a tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: 1d3e0c5b-9b58-4583-95b8-a60bac19db59] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:06:32.262774 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=12 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:06:32.263469 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:06:32.264884 n-d-833090-16 devstack@n-api.service[128864]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 17:06:32.265030 n-d-833090-16 devstack@n-api.service[128864]: Wed Aug 31 17:06:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59/action (ip 10.222.0.50) !!! Aug 31 17:06:32.276821 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-42fd1f12-1d6a-4f9b-a32a-2419fdfba40a tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:06:32.277324 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-42fd1f12-1d6a-4f9b-a32a-2419fdfba40a tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:06:32.277780 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-42fd1f12-1d6a-4f9b-a32a-2419fdfba40a tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:06:32.278533 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-42fd1f12-1d6a-4f9b-a32a-2419fdfba40a tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:06:32.278997 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-42fd1f12-1d6a-4f9b-a32a-2419fdfba40a tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:06:32.279437 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-42fd1f12-1d6a-4f9b-a32a-2419fdfba40a tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:06:32.428400 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.network.security_group_api [None req-42fd1f12-1d6a-4f9b-a32a-2419fdfba40a tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Removing security group b80ebb8c-860d-4104-92b7-e14b5781a17f from port 0a814d5b-5e26-412d-a74d-3b0a8eb316fe Aug 31 17:06:32.767880 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-42fd1f12-1d6a-4f9b-a32a-2419fdfba40a tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "POST /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59/action" status: 202 len: 0 microversion: 2.1 time: 0.512152 Aug 31 17:06:32.768932 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3837/7492] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 17:06:32 2022] POST /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59/action => generated 0 bytes in 514 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:06:32.781746 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-9c5b1f63-824b-46fc-b20b-feff5321dc30 req-801128b1-fa4a-48c0-9c61-d84f04f5614c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d3e0c5b-9b58-4583-95b8-a60bac19db59", "tag": "0a814d5b-5e26-412d-a74d-3b0a8eb316fe"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:06:32.792086 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=12 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:06:32.793941 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=36 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:06:32.797421 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9c5b1f63-824b-46fc-b20b-feff5321dc30 req-801128b1-fa4a-48c0-9c61-d84f04f5614c service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:06:32.797887 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9c5b1f63-824b-46fc-b20b-feff5321dc30 req-801128b1-fa4a-48c0-9c61-d84f04f5614c service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:06:32.798405 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9c5b1f63-824b-46fc-b20b-feff5321dc30 req-801128b1-fa4a-48c0-9c61-d84f04f5614c service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:06:32.813739 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-9c5b1f63-824b-46fc-b20b-feff5321dc30 req-801128b1-fa4a-48c0-9c61-d84f04f5614c service nova] Creating event network-changed:0a814d5b-5e26-412d-a74d-3b0a8eb316fe for instance 1d3e0c5b-9b58-4583-95b8-a60bac19db59 on n-h1-833090-16 Aug 31 17:06:32.820252 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-9c5b1f63-824b-46fc-b20b-feff5321dc30 req-801128b1-fa4a-48c0-9c61-d84f04f5614c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044883 Aug 31 17:06:32.821141 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3656/7493] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:06:34.329716 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0e8807ea-52d4-4068-a89f-fb2a939d749d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:06:34.330307 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0e8807ea-52d4-4068-a89f-fb2a939d749d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: 1d3e0c5b-9b58-4583-95b8-a60bac19db59] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:06:34.336475 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0e8807ea-52d4-4068-a89f-fb2a939d749d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:06:34.337174 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0e8807ea-52d4-4068-a89f-fb2a939d749d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:06:34.337627 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0e8807ea-52d4-4068-a89f-fb2a939d749d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:06:34.338386 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0e8807ea-52d4-4068-a89f-fb2a939d749d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:06:34.338845 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0e8807ea-52d4-4068-a89f-fb2a939d749d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:06:34.339278 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0e8807ea-52d4-4068-a89f-fb2a939d749d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:06:34.424223 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-0e8807ea-52d4-4068-a89f-fb2a939d749d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lazy-loading 'services' on Instance uuid 1d3e0c5b-9b58-4583-95b8-a60bac19db59 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 17:06:34.511785 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0e8807ea-52d4-4068-a89f-fb2a939d749d tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "DELETE /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59/os-volume_attachments/79d29aef-87d4-4616-9838-4da5a43adad1" status: 202 len: 0 microversion: 2.1 time: 0.186716 Aug 31 17:06:34.516077 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3838/7494] 10.222.0.50 () {58 vars in 1416 bytes} [Wed Aug 31 17:06:34 2022] DELETE /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59/os-volume_attachments/79d29aef-87d4-4616-9838-4da5a43adad1 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:06:34.523004 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ad468f88-9b17-44a0-a81f-c3fe862fa971 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:06:34.525481 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ad468f88-9b17-44a0-a81f-c3fe862fa971 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: 1d3e0c5b-9b58-4583-95b8-a60bac19db59] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:06:34.532204 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ad468f88-9b17-44a0-a81f-c3fe862fa971 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:06:34.532680 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ad468f88-9b17-44a0-a81f-c3fe862fa971 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:06:34.533294 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ad468f88-9b17-44a0-a81f-c3fe862fa971 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:06:34.534011 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ad468f88-9b17-44a0-a81f-c3fe862fa971 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:06:34.534512 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ad468f88-9b17-44a0-a81f-c3fe862fa971 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:06:34.534949 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ad468f88-9b17-44a0-a81f-c3fe862fa971 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:06:34.571175 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ad468f88-9b17-44a0-a81f-c3fe862fa971 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053825 Aug 31 17:06:34.571839 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3657/7495] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 17:06:34 2022] GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:06:34.840525 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-25834fe2-09c1-41a3-a2ed-782da702d9db req-72d85c2f-addb-4b8b-a721-47f70d730d74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d3e0c5b-9b58-4583-95b8-a60bac19db59", "tag": "0a814d5b-5e26-412d-a74d-3b0a8eb316fe"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:06:34.851120 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-25834fe2-09c1-41a3-a2ed-782da702d9db req-72d85c2f-addb-4b8b-a721-47f70d730d74 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:06:34.851615 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-25834fe2-09c1-41a3-a2ed-782da702d9db req-72d85c2f-addb-4b8b-a721-47f70d730d74 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:06:34.852063 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-25834fe2-09c1-41a3-a2ed-782da702d9db req-72d85c2f-addb-4b8b-a721-47f70d730d74 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:06:34.864203 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-25834fe2-09c1-41a3-a2ed-782da702d9db req-72d85c2f-addb-4b8b-a721-47f70d730d74 service nova] Creating event network-changed:0a814d5b-5e26-412d-a74d-3b0a8eb316fe for instance 1d3e0c5b-9b58-4583-95b8-a60bac19db59 on n-h1-833090-16 Aug 31 17:06:34.873041 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-25834fe2-09c1-41a3-a2ed-782da702d9db req-72d85c2f-addb-4b8b-a721-47f70d730d74 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036683 Aug 31 17:06:34.873702 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3839/7496] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:06:35.584814 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3e560c80-0ec2-46a8-b3e9-6efc655986bb tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:06:35.587050 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3e560c80-0ec2-46a8-b3e9-6efc655986bb tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: 1d3e0c5b-9b58-4583-95b8-a60bac19db59] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:06:35.594915 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e560c80-0ec2-46a8-b3e9-6efc655986bb tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:06:35.595429 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e560c80-0ec2-46a8-b3e9-6efc655986bb tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:06:35.595845 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e560c80-0ec2-46a8-b3e9-6efc655986bb tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:06:35.596517 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e560c80-0ec2-46a8-b3e9-6efc655986bb tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:06:35.596956 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e560c80-0ec2-46a8-b3e9-6efc655986bb tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:06:35.597366 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3e560c80-0ec2-46a8-b3e9-6efc655986bb tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:06:35.630285 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3e560c80-0ec2-46a8-b3e9-6efc655986bb tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049595 Aug 31 17:06:35.630918 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3658/7497] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 17:06:35 2022] GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:06:36.645513 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-64fd815f-dcac-49d8-ac37-c3d95d3db74b tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:06:36.647912 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-64fd815f-dcac-49d8-ac37-c3d95d3db74b tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: 1d3e0c5b-9b58-4583-95b8-a60bac19db59] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:06:36.655202 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-64fd815f-dcac-49d8-ac37-c3d95d3db74b tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:06:36.655666 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-64fd815f-dcac-49d8-ac37-c3d95d3db74b tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:06:36.656118 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-64fd815f-dcac-49d8-ac37-c3d95d3db74b tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:06:36.656849 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-64fd815f-dcac-49d8-ac37-c3d95d3db74b tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:06:36.657309 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-64fd815f-dcac-49d8-ac37-c3d95d3db74b tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:06:36.657747 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-64fd815f-dcac-49d8-ac37-c3d95d3db74b tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:06:36.690051 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-64fd815f-dcac-49d8-ac37-c3d95d3db74b tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049827 Aug 31 17:06:36.690726 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3840/7498] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 17:06:36 2022] GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:06:37.703849 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0a0d2d3f-0866-41d3-9404-2bb2f24c4b50 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:06:37.706020 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0a0d2d3f-0866-41d3-9404-2bb2f24c4b50 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: 1d3e0c5b-9b58-4583-95b8-a60bac19db59] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:06:37.714076 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a0d2d3f-0866-41d3-9404-2bb2f24c4b50 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:06:37.714725 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a0d2d3f-0866-41d3-9404-2bb2f24c4b50 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:06:37.715213 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a0d2d3f-0866-41d3-9404-2bb2f24c4b50 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:06:37.716049 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a0d2d3f-0866-41d3-9404-2bb2f24c4b50 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:06:37.716501 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a0d2d3f-0866-41d3-9404-2bb2f24c4b50 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:06:37.716920 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0a0d2d3f-0866-41d3-9404-2bb2f24c4b50 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:06:37.749206 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0a0d2d3f-0866-41d3-9404-2bb2f24c4b50 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048286 Aug 31 17:06:37.749843 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3659/7499] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 17:06:37 2022] GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:06:38.761574 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-665224ff-ed35-41ae-b92b-cfedff60597c tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:06:38.763893 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-665224ff-ed35-41ae-b92b-cfedff60597c tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: 1d3e0c5b-9b58-4583-95b8-a60bac19db59] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:06:38.771119 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-665224ff-ed35-41ae-b92b-cfedff60597c tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:06:38.771608 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-665224ff-ed35-41ae-b92b-cfedff60597c tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:06:38.772055 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-665224ff-ed35-41ae-b92b-cfedff60597c tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:06:38.772775 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-665224ff-ed35-41ae-b92b-cfedff60597c tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:06:38.773250 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-665224ff-ed35-41ae-b92b-cfedff60597c tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:06:38.773726 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-665224ff-ed35-41ae-b92b-cfedff60597c tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:06:38.804679 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-665224ff-ed35-41ae-b92b-cfedff60597c tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047342 Aug 31 17:06:38.805435 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3841/7500] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 17:06:38 2022] GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:06:39.819917 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c2727ae9-93dc-4266-958e-ffcfb123f8db tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:06:39.822488 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c2727ae9-93dc-4266-958e-ffcfb123f8db tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: 1d3e0c5b-9b58-4583-95b8-a60bac19db59] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:06:39.833332 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2727ae9-93dc-4266-958e-ffcfb123f8db tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:06:39.833871 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2727ae9-93dc-4266-958e-ffcfb123f8db tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:06:39.834345 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2727ae9-93dc-4266-958e-ffcfb123f8db tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:06:39.835295 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2727ae9-93dc-4266-958e-ffcfb123f8db tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:06:39.835892 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2727ae9-93dc-4266-958e-ffcfb123f8db tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:06:39.836325 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2727ae9-93dc-4266-958e-ffcfb123f8db tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:06:39.868065 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c2727ae9-93dc-4266-958e-ffcfb123f8db tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054152 Aug 31 17:06:39.869005 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3660/7501] 10.222.0.50 () {58 vars in 1302 bytes} [Wed Aug 31 17:06:39 2022] GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 17:06:39.881015 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5a3e8d65-5c9e-4b4e-9dfc-eb965ac67631 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:06:39.881578 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5a3e8d65-5c9e-4b4e-9dfc-eb965ac67631 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: 1d3e0c5b-9b58-4583-95b8-a60bac19db59] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:06:39.889079 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5a3e8d65-5c9e-4b4e-9dfc-eb965ac67631 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:06:39.889617 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5a3e8d65-5c9e-4b4e-9dfc-eb965ac67631 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:06:39.890062 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5a3e8d65-5c9e-4b4e-9dfc-eb965ac67631 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:06:39.890796 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5a3e8d65-5c9e-4b4e-9dfc-eb965ac67631 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:06:39.891250 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5a3e8d65-5c9e-4b4e-9dfc-eb965ac67631 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:06:39.891674 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5a3e8d65-5c9e-4b4e-9dfc-eb965ac67631 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:06:39.983138 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-5a3e8d65-5c9e-4b4e-9dfc-eb965ac67631 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] HTTP exception thrown: Instance 1d3e0c5b-9b58-4583-95b8-a60bac19db59 is not attached to volume 79d29aef-87d4-4616-9838-4da5a43adad1 Aug 31 17:06:39.984877 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5a3e8d65-5c9e-4b4e-9dfc-eb965ac67631 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Request method failure captured: Aug 31 17:06:39.984877 n-d-833090-16 devstack@n-api.service[128864]: request: DELETE /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59/os-volume_attachments/79d29aef-87d4-4616-9838-4da5a43adad1 HTTP/1.1 Aug 31 17:06:39.984877 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 17:06:39.984877 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 17:06:39.984877 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 17:06:39.984877 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 17:06:39.984877 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 17:06:39.984877 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 17:06:39.984877 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 17:06:39.984877 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 17:06:39.984877 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD5N1GwgTzVD7-vjIKEVcRhDunxw5NJvwikA_v7pt8hrSW0e5qF6namwvz8IOw6N_8-aQ3Rw8C4eIN9xtCDdjrTZCIl0W-QbMYFTPezT63xP5nvkaSm_Pw0-QPXQk2ip7fDezMlVlbI9V4OC3-w02DlMfBVzTQzZvi8oKn9fbPogl8kM Aug 31 17:06:39.984877 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 17:06:39.984877 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 17:06:39.984877 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 17:06:39.984877 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 17:06:39.984877 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 17:06:39.984877 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 17:06:39.984877 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 36bab34a3a6149669d1ea4ee11dcd817 Aug 31 17:06:39.984877 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-TestMinimumBasicScenario-1099280205 Aug 31 17:06:39.984877 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 17:06:39.984877 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 17:06:39.984877 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/36bab34a3a6149669d1ea4ee11dcd817"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/36bab34a3a6149669d1ea4ee11dcd817"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/36bab34a3a6149669d1ea4ee11dcd817"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_36bab34a3a6149669d1ea4ee11dcd817", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 17:06:39.984877 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-TestMinimumBasicScenario-1099280205 Aug 31 17:06:39.984877 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 36bab34a3a6149669d1ea4ee11dcd817 Aug 31 17:06:39.984877 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1099280205 Aug 31 17:06:39.984877 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-TestMinimumBasicScenario-1099280205-project Aug 31 17:06:39.984877 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 17:06:39.984877 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 17:06:39.984877 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 84b2ea344f1e44a3b892232c88a98680 Aug 31 17:06:39.984877 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-TestMinimumBasicScenario-1099280205-project Aug 31 17:06:39.984877 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 17:06:39.984877 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 1d3e0c5b-9b58-4583-95b8-a60bac19db59 is not attached to volume 79d29aef-87d4-4616-9838-4da5a43adad1 Aug 31 17:06:39.984877 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'server_id': '1d3e0c5b-9b58-4583-95b8-a60bac19db59', 'id': '79d29aef-87d4-4616-9838-4da5a43adad1'} Aug 31 17:06:39.984877 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 17:06:39.984877 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:06:39.984877 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 31 17:06:39.984877 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 31 17:06:39.984877 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 31 17:06:39.984877 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 31 17:06:39.984877 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 31 17:06:39.984877 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 31 17:06:39.984877 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 79d29aef-87d4-4616-9838-4da5a43adad1. Aug 31 17:06:39.984877 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 17:06:39.984877 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:06:39.984877 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 17:06:39.984877 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:06:39.984877 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:06:39.984877 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:06:39.984877 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 17:06:39.984877 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 17:06:39.984877 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 17:06:39.984877 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 17:06:39.984877 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 31 17:06:39.984877 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 31 17:06:39.984877 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d3e0c5b-9b58-4583-95b8-a60bac19db59 is not attached to volume 79d29aef-87d4-4616-9838-4da5a43adad1 Aug 31 17:06:39.984877 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 17:06:39.984877 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:06:39.984877 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 17:06:39.984877 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:06:39.984877 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:06:39.984877 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:06:39.989677 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 17:06:39.989677 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 17:06:39.989677 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d3e0c5b-9b58-4583-95b8-a60bac19db59 is not attached to volume 79d29aef-87d4-4616-9838-4da5a43adad1 Aug 31 17:06:39.989677 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 17:06:39.989677 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5a3e8d65-5c9e-4b4e-9dfc-eb965ac67631 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Returning 404 to user: Instance 1d3e0c5b-9b58-4583-95b8-a60bac19db59 is not attached to volume 79d29aef-87d4-4616-9838-4da5a43adad1 {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 17:06:39.989677 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5a3e8d65-5c9e-4b4e-9dfc-eb965ac67631 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "DELETE /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59/os-volume_attachments/79d29aef-87d4-4616-9838-4da5a43adad1" status: 404 len: 154 microversion: 2.1 time: 0.110975 Aug 31 17:06:39.989677 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3842/7502] 10.222.0.50 () {58 vars in 1416 bytes} [Wed Aug 31 17:06:39 2022] DELETE /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59/os-volume_attachments/79d29aef-87d4-4616-9838-4da5a43adad1 => generated 154 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 17:06:43.266082 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e69068f6-1b76-4c3b-be27-176e6e22cfbf tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:06:43.266680 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e69068f6-1b76-4c3b-be27-176e6e22cfbf tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: 1d3e0c5b-9b58-4583-95b8-a60bac19db59] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:06:43.274524 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e69068f6-1b76-4c3b-be27-176e6e22cfbf tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:06:43.275005 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e69068f6-1b76-4c3b-be27-176e6e22cfbf tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:06:43.275445 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e69068f6-1b76-4c3b-be27-176e6e22cfbf tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:06:43.276291 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e69068f6-1b76-4c3b-be27-176e6e22cfbf tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:06:43.277042 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e69068f6-1b76-4c3b-be27-176e6e22cfbf tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:06:43.277475 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e69068f6-1b76-4c3b-be27-176e6e22cfbf tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:06:43.303824 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e69068f6-1b76-4c3b-be27-176e6e22cfbf tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: 1d3e0c5b-9b58-4583-95b8-a60bac19db59] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 17:06:43.392413 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e69068f6-1b76-4c3b-be27-176e6e22cfbf tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "DELETE /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59" status: 204 len: 0 microversion: 2.1 time: 0.130034 Aug 31 17:06:43.393167 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3661/7503] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 17:06:43 2022] DELETE /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 17:06:43.403016 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0bef2326-5ee8-4739-a527-29ed08c601dd tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:06:43.403651 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0bef2326-5ee8-4739-a527-29ed08c601dd tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: 1d3e0c5b-9b58-4583-95b8-a60bac19db59] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:06:43.411615 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0bef2326-5ee8-4739-a527-29ed08c601dd tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:06:43.412102 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0bef2326-5ee8-4739-a527-29ed08c601dd tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:06:43.412553 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0bef2326-5ee8-4739-a527-29ed08c601dd tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:06:43.413267 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0bef2326-5ee8-4739-a527-29ed08c601dd tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:06:43.413728 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0bef2326-5ee8-4739-a527-29ed08c601dd tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:06:43.414190 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0bef2326-5ee8-4739-a527-29ed08c601dd tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:06:43.552899 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0bef2326-5ee8-4739-a527-29ed08c601dd tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:06:43.561455 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0bef2326-5ee8-4739-a527-29ed08c601dd tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59" status: 200 len: 1553 microversion: 2.1 time: 0.162972 Aug 31 17:06:43.561997 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3843/7504] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:06:43 2022] GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59 => generated 1553 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:06:44.585402 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5158fa3a-9f96-4298-b186-ca7a73c3b728 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:06:44.586062 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5158fa3a-9f96-4298-b186-ca7a73c3b728 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: 1d3e0c5b-9b58-4583-95b8-a60bac19db59] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:06:44.594736 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5158fa3a-9f96-4298-b186-ca7a73c3b728 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:06:44.595210 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5158fa3a-9f96-4298-b186-ca7a73c3b728 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:06:44.595637 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5158fa3a-9f96-4298-b186-ca7a73c3b728 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:06:44.596360 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5158fa3a-9f96-4298-b186-ca7a73c3b728 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:06:44.596804 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5158fa3a-9f96-4298-b186-ca7a73c3b728 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:06:44.597227 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5158fa3a-9f96-4298-b186-ca7a73c3b728 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:06:44.746909 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5158fa3a-9f96-4298-b186-ca7a73c3b728 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:06:44.755323 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5158fa3a-9f96-4298-b186-ca7a73c3b728 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59" status: 200 len: 1553 microversion: 2.1 time: 0.174361 Aug 31 17:06:44.755910 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3662/7505] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:06:44 2022] GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59 => generated 1553 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:06:45.595671 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-7fa936ed-9de5-4b67-acc0-eed44cbbd29f req-c48f9b7f-411c-4bc2-b746-dc06548336e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d3e0c5b-9b58-4583-95b8-a60bac19db59", "name": "network-vif-deleted", "tag": "0a814d5b-5e26-412d-a74d-3b0a8eb316fe"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:06:45.609884 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7fa936ed-9de5-4b67-acc0-eed44cbbd29f req-c48f9b7f-411c-4bc2-b746-dc06548336e9 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:06:45.610403 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7fa936ed-9de5-4b67-acc0-eed44cbbd29f req-c48f9b7f-411c-4bc2-b746-dc06548336e9 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:06:45.611100 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7fa936ed-9de5-4b67-acc0-eed44cbbd29f req-c48f9b7f-411c-4bc2-b746-dc06548336e9 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:06:45.627377 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-7fa936ed-9de5-4b67-acc0-eed44cbbd29f req-c48f9b7f-411c-4bc2-b746-dc06548336e9 service nova] Creating event network-vif-deleted:0a814d5b-5e26-412d-a74d-3b0a8eb316fe for instance 1d3e0c5b-9b58-4583-95b8-a60bac19db59 on n-h1-833090-16 Aug 31 17:06:45.633589 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-7fa936ed-9de5-4b67-acc0-eed44cbbd29f req-c48f9b7f-411c-4bc2-b746-dc06548336e9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041571 Aug 31 17:06:45.635100 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3844/7506] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:06:45.777541 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3825f09b-3c1c-4cd2-9858-233e490e8e18 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:06:45.778223 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3825f09b-3c1c-4cd2-9858-233e490e8e18 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: 1d3e0c5b-9b58-4583-95b8-a60bac19db59] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:06:45.785244 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3825f09b-3c1c-4cd2-9858-233e490e8e18 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:06:45.785731 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3825f09b-3c1c-4cd2-9858-233e490e8e18 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:06:45.786191 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3825f09b-3c1c-4cd2-9858-233e490e8e18 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:06:45.786885 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3825f09b-3c1c-4cd2-9858-233e490e8e18 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:06:45.787334 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3825f09b-3c1c-4cd2-9858-233e490e8e18 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:06:45.787752 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3825f09b-3c1c-4cd2-9858-233e490e8e18 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:06:45.825239 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3825f09b-3c1c-4cd2-9858-233e490e8e18 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:06:45.825633 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3825f09b-3c1c-4cd2-9858-233e490e8e18 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:06:45.826080 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3825f09b-3c1c-4cd2-9858-233e490e8e18 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:06:45.826566 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-3825f09b-3c1c-4cd2-9858-233e490e8e18 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lazy-loading 'fault' on Instance uuid 1d3e0c5b-9b58-4583-95b8-a60bac19db59 {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 17:06:45.870651 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3825f09b-3c1c-4cd2-9858-233e490e8e18 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84b2ea344f1e44a3b892232c88a98680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bab34a3a6149669d1ea4ee11dcd817', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:06:45.879112 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3825f09b-3c1c-4cd2-9858-233e490e8e18 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59" status: 200 len: 1347 microversion: 2.1 time: 0.106277 Aug 31 17:06:45.879687 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3663/7507] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:06:45 2022] GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59 => generated 1347 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:06:46.903571 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6387499c-7216-4af0-a733-17cd937db700 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:06:46.904218 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6387499c-7216-4af0-a733-17cd937db700 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] [instance: 1d3e0c5b-9b58-4583-95b8-a60bac19db59] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:06:46.912112 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6387499c-7216-4af0-a733-17cd937db700 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:06:46.912714 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6387499c-7216-4af0-a733-17cd937db700 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:06:46.913177 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6387499c-7216-4af0-a733-17cd937db700 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:06:46.913894 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6387499c-7216-4af0-a733-17cd937db700 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:06:46.914390 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6387499c-7216-4af0-a733-17cd937db700 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:06:46.914829 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6387499c-7216-4af0-a733-17cd937db700 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:06:46.929322 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-6387499c-7216-4af0-a733-17cd937db700 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] HTTP exception thrown: Instance 1d3e0c5b-9b58-4583-95b8-a60bac19db59 could not be found. Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6387499c-7216-4af0-a733-17cd937db700 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Request method failure captured: Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59 HTTP/1.1 Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD5N1GwgTzVD7-vjIKEVcRhDunxw5NJvwikA_v7pt8hrSW0e5qF6namwvz8IOw6N_8-aQ3Rw8C4eIN9xtCDdjrTZCIl0W-QbMYFTPezT63xP5nvkaSm_Pw0-QPXQk2ip7fDezMlVlbI9V4OC3-w02DlMfBVzTQzZvi8oKn9fbPogl8kM Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 36bab34a3a6149669d1ea4ee11dcd817 Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-TestMinimumBasicScenario-1099280205 Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/36bab34a3a6149669d1ea4ee11dcd817"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/36bab34a3a6149669d1ea4ee11dcd817"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/36bab34a3a6149669d1ea4ee11dcd817"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_36bab34a3a6149669d1ea4ee11dcd817", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-TestMinimumBasicScenario-1099280205 Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 36bab34a3a6149669d1ea4ee11dcd817 Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1099280205 Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-TestMinimumBasicScenario-1099280205-project Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 84b2ea344f1e44a3b892232c88a98680 Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-TestMinimumBasicScenario-1099280205-project Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 1d3e0c5b-9b58-4583-95b8-a60bac19db59 could not be found. Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '1d3e0c5b-9b58-4583-95b8-a60bac19db59'} Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d3e0c5b-9b58-4583-95b8-a60bac19db59 could not be found. Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d3e0c5b-9b58-4583-95b8-a60bac19db59 could not be found. Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:06:46.931421 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 17:06:46.935977 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:06:46.935977 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:06:46.935977 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:06:46.935977 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 17:06:46.935977 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 17:06:46.935977 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d3e0c5b-9b58-4583-95b8-a60bac19db59 could not be found. Aug 31 17:06:46.935977 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 17:06:46.935977 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6387499c-7216-4af0-a733-17cd937db700 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Returning 404 to user: Instance 1d3e0c5b-9b58-4583-95b8-a60bac19db59 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 17:06:46.935977 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6387499c-7216-4af0-a733-17cd937db700 tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59" status: 404 len: 111 microversion: 2.1 time: 0.034203 Aug 31 17:06:46.935977 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3845/7508] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:06:46 2022] GET /compute/v2.1/servers/1d3e0c5b-9b58-4583-95b8-a60bac19db59 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 17:06:46.942106 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-adf4c7ee-dddb-401e-bbc3-ca5657d3546e tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] Calling method '.version_select at 0x7fbb4678c310>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:06:46.964059 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-adf4c7ee-dddb-401e-bbc3-ca5657d3546e tempest-TestMinimumBasicScenario-1099280205 tempest-TestMinimumBasicScenario-1099280205-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-417808966" status: 202 len: 0 microversion: 2.1 time: 0.025827 Aug 31 17:06:46.964649 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3664/7509] 10.222.0.50 () {58 vars in 1269 bytes} [Wed Aug 31 17:06:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-417808966 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 17:06:56.909543 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=18 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:06:56.920034 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:06:56.933291 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-bea3b0a8-18c4-4836-a741-b4f33baa78ce tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Action: 'create', calling method: .version_select at 0x7fbb45f7a700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-853897660", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdniqMBxsGnAI2I5x9FRvjZq6y0iuejLGO2kqbdxR13fdO63hd80sgpBfXCPsxa/KM5biRzWrCKeaMNImDomdXU29OU6liI0AIp8y7q9d7LJNiE9t8y3ICeWEt0xvexgg=="}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:06:56.951226 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-bea3b0a8-18c4-4836-a741-b4f33baa78ce tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Getting quotas for project a6f813017c8c40d5978c8550f188dbf7. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 17:06:56.957131 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-bea3b0a8-18c4-4836-a741-b4f33baa78ce tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Getting quotas for user a18fb2c4e622474d943a72025236cca7 and project a6f813017c8c40d5978c8550f188dbf7. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 17:06:56.987454 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-bea3b0a8-18c4-4836-a741-b4f33baa78ce tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.249231 Aug 31 17:06:56.988381 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3846/7510] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 31 17:06:56 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:07:03.047036 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:07:03.047806 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:07:03.051993 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0faa79b4-7a8e-438e-bd87-ad69476dd7bd tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1988916137", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "25dd7df0-2f78-4ac5-af39-d7c53be92992"}], "key_name": "tempest-TestNetworkAdvancedServerOps-853897660", "security_groups": [{"name": "tempest-secgroup-smoke-614349502"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:07:03.178861 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-0faa79b4-7a8e-438e-bd87-ad69476dd7bd tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] validate_networks() for [('25dd7df0-2f78-4ac5-af39-d7c53be92992', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 17:07:03.649057 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-0faa79b4-7a8e-438e-bd87-ad69476dd7bd tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 17:07:03.649405 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-0faa79b4-7a8e-438e-bd87-ad69476dd7bd tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 17:07:03.649884 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-0faa79b4-7a8e-438e-bd87-ad69476dd7bd tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 17:07:03.650510 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-0faa79b4-7a8e-438e-bd87-ad69476dd7bd tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 17:07:03.650928 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-0faa79b4-7a8e-438e-bd87-ad69476dd7bd tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 17:07:03.664003 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0faa79b4-7a8e-438e-bd87-ad69476dd7bd tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:03.665163 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0faa79b4-7a8e-438e-bd87-ad69476dd7bd tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:03.675977 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0faa79b4-7a8e-438e-bd87-ad69476dd7bd tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:03.677498 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0faa79b4-7a8e-438e-bd87-ad69476dd7bd tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:03.680478 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0faa79b4-7a8e-438e-bd87-ad69476dd7bd tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:03.681150 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0faa79b4-7a8e-438e-bd87-ad69476dd7bd tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:03.706531 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-0faa79b4-7a8e-438e-bd87-ad69476dd7bd tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Getting quotas for project a6f813017c8c40d5978c8550f188dbf7. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 17:07:03.712836 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-0faa79b4-7a8e-438e-bd87-ad69476dd7bd tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Getting quotas for user a18fb2c4e622474d943a72025236cca7 and project a6f813017c8c40d5978c8550f188dbf7. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 17:07:03.728783 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0faa79b4-7a8e-438e-bd87-ad69476dd7bd tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 17:07:03.732818 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0faa79b4-7a8e-438e-bd87-ad69476dd7bd tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ed3b1401-af99-49c7-b413-8b8c61f5222f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 17:07:03.818473 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0faa79b4-7a8e-438e-bd87-ad69476dd7bd tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.773407 Aug 31 17:07:03.822048 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3665/7511] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 17:07:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 778 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 17:07:03.834840 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f2912644-a172-4b29-8d9b-6d8ac3e6858a tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:07:03.838760 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f2912644-a172-4b29-8d9b-6d8ac3e6858a tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ed3b1401-af99-49c7-b413-8b8c61f5222f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:03.973042 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f2912644-a172-4b29-8d9b-6d8ac3e6858a tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:07:03.986326 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f2912644-a172-4b29-8d9b-6d8ac3e6858a tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/ed3b1401-af99-49c7-b413-8b8c61f5222f" status: 200 len: 1266 microversion: 2.1 time: 0.155931 Aug 31 17:07:03.990539 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3847/7512] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:07:03 2022] GET /compute/v2.1/servers/ed3b1401-af99-49c7-b413-8b8c61f5222f => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:07:05.008576 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3a66c011-54a8-4935-b6f0-80d8a1451828 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:07:05.009396 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3a66c011-54a8-4935-b6f0-80d8a1451828 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ed3b1401-af99-49c7-b413-8b8c61f5222f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:05.018275 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a66c011-54a8-4935-b6f0-80d8a1451828 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:05.018812 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a66c011-54a8-4935-b6f0-80d8a1451828 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:05.019370 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a66c011-54a8-4935-b6f0-80d8a1451828 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:05.020119 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a66c011-54a8-4935-b6f0-80d8a1451828 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:05.020628 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a66c011-54a8-4935-b6f0-80d8a1451828 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:05.021122 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3a66c011-54a8-4935-b6f0-80d8a1451828 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:05.113515 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3a66c011-54a8-4935-b6f0-80d8a1451828 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:07:05.121911 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3a66c011-54a8-4935-b6f0-80d8a1451828 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/ed3b1401-af99-49c7-b413-8b8c61f5222f" status: 200 len: 1318 microversion: 2.1 time: 0.117961 Aug 31 17:07:05.123219 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3666/7513] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:07:05 2022] GET /compute/v2.1/servers/ed3b1401-af99-49c7-b413-8b8c61f5222f => generated 1318 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:07:06.143766 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-29a7e8e5-25f9-492d-921d-4f42d5f78da7 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:07:06.145006 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-29a7e8e5-25f9-492d-921d-4f42d5f78da7 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ed3b1401-af99-49c7-b413-8b8c61f5222f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:06.155107 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-29a7e8e5-25f9-492d-921d-4f42d5f78da7 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:06.155903 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-29a7e8e5-25f9-492d-921d-4f42d5f78da7 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:06.156514 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-29a7e8e5-25f9-492d-921d-4f42d5f78da7 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:06.157410 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-29a7e8e5-25f9-492d-921d-4f42d5f78da7 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:06.158023 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-29a7e8e5-25f9-492d-921d-4f42d5f78da7 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:06.158637 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-29a7e8e5-25f9-492d-921d-4f42d5f78da7 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:06.319939 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-29a7e8e5-25f9-492d-921d-4f42d5f78da7 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:07:06.329985 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-29a7e8e5-25f9-492d-921d-4f42d5f78da7 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/ed3b1401-af99-49c7-b413-8b8c61f5222f" status: 200 len: 1391 microversion: 2.1 time: 0.190271 Aug 31 17:07:06.337198 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3848/7514] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:07:06 2022] GET /compute/v2.1/servers/ed3b1401-af99-49c7-b413-8b8c61f5222f => generated 1391 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:07:06.734456 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-2dc9137b-2138-4c31-b8d2-3caf1aa8ad17 req-bf1a8036-e9bc-4f93-a318-c2f52863f63b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed3b1401-af99-49c7-b413-8b8c61f5222f", "tag": "62d0c9b1-0c5f-4734-850c-831f3752e37b"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:07:06.747340 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2dc9137b-2138-4c31-b8d2-3caf1aa8ad17 req-bf1a8036-e9bc-4f93-a318-c2f52863f63b service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:06.747978 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2dc9137b-2138-4c31-b8d2-3caf1aa8ad17 req-bf1a8036-e9bc-4f93-a318-c2f52863f63b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:06.748419 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-2dc9137b-2138-4c31-b8d2-3caf1aa8ad17 req-bf1a8036-e9bc-4f93-a318-c2f52863f63b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:06.760373 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-2dc9137b-2138-4c31-b8d2-3caf1aa8ad17 req-bf1a8036-e9bc-4f93-a318-c2f52863f63b service nova] Creating event network-changed:62d0c9b1-0c5f-4734-850c-831f3752e37b for instance ed3b1401-af99-49c7-b413-8b8c61f5222f on n-h2-833090-16 Aug 31 17:07:06.765733 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-2dc9137b-2138-4c31-b8d2-3caf1aa8ad17 req-bf1a8036-e9bc-4f93-a318-c2f52863f63b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035255 Aug 31 17:07:06.766673 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3667/7515] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:07:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:07:07.354698 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fafd0424-a97b-4bf1-b021-165e5cb023a0 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:07:07.356051 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fafd0424-a97b-4bf1-b021-165e5cb023a0 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ed3b1401-af99-49c7-b413-8b8c61f5222f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:07.364063 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fafd0424-a97b-4bf1-b021-165e5cb023a0 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:07.364637 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fafd0424-a97b-4bf1-b021-165e5cb023a0 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:07.365207 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fafd0424-a97b-4bf1-b021-165e5cb023a0 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:07.366153 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fafd0424-a97b-4bf1-b021-165e5cb023a0 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:07.366614 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fafd0424-a97b-4bf1-b021-165e5cb023a0 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:07.367037 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fafd0424-a97b-4bf1-b021-165e5cb023a0 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:07.513738 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-fafd0424-a97b-4bf1-b021-165e5cb023a0 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:07:07.525352 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fafd0424-a97b-4bf1-b021-165e5cb023a0 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/ed3b1401-af99-49c7-b413-8b8c61f5222f" status: 200 len: 1391 microversion: 2.1 time: 0.176933 Aug 31 17:07:07.526212 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3849/7516] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:07:07 2022] GET /compute/v2.1/servers/ed3b1401-af99-49c7-b413-8b8c61f5222f => generated 1391 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:07:08.548516 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-59feabee-acd5-4574-82e8-3b9b9268a5b6 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:07:08.549242 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-59feabee-acd5-4574-82e8-3b9b9268a5b6 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ed3b1401-af99-49c7-b413-8b8c61f5222f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:08.556212 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-59feabee-acd5-4574-82e8-3b9b9268a5b6 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:08.556680 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-59feabee-acd5-4574-82e8-3b9b9268a5b6 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:08.557119 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-59feabee-acd5-4574-82e8-3b9b9268a5b6 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:08.557814 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-59feabee-acd5-4574-82e8-3b9b9268a5b6 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:08.558304 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-59feabee-acd5-4574-82e8-3b9b9268a5b6 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:08.558733 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-59feabee-acd5-4574-82e8-3b9b9268a5b6 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:08.707783 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-59feabee-acd5-4574-82e8-3b9b9268a5b6 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:07:08.719830 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-59feabee-acd5-4574-82e8-3b9b9268a5b6 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/ed3b1401-af99-49c7-b413-8b8c61f5222f" status: 200 len: 1391 microversion: 2.1 time: 0.176207 Aug 31 17:07:08.720585 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3668/7517] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:07:08 2022] GET /compute/v2.1/servers/ed3b1401-af99-49c7-b413-8b8c61f5222f => generated 1391 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:07:09.743289 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-469eb664-83a0-4e4b-9ff0-32da46aa95c2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:07:09.744763 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-469eb664-83a0-4e4b-9ff0-32da46aa95c2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ed3b1401-af99-49c7-b413-8b8c61f5222f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:09.753353 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-469eb664-83a0-4e4b-9ff0-32da46aa95c2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:09.754064 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-469eb664-83a0-4e4b-9ff0-32da46aa95c2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:09.754552 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-469eb664-83a0-4e4b-9ff0-32da46aa95c2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:09.755395 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-469eb664-83a0-4e4b-9ff0-32da46aa95c2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:09.755861 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-469eb664-83a0-4e4b-9ff0-32da46aa95c2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:09.756289 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-469eb664-83a0-4e4b-9ff0-32da46aa95c2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:09.912175 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-469eb664-83a0-4e4b-9ff0-32da46aa95c2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:07:09.921752 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-469eb664-83a0-4e4b-9ff0-32da46aa95c2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/ed3b1401-af99-49c7-b413-8b8c61f5222f" status: 200 len: 1391 microversion: 2.1 time: 0.183879 Aug 31 17:07:09.922430 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3850/7518] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:07:09 2022] GET /compute/v2.1/servers/ed3b1401-af99-49c7-b413-8b8c61f5222f => generated 1391 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:07:10.944103 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b4179d6f-41bd-401d-ad02-d3dc92ea2342 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:07:10.944808 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b4179d6f-41bd-401d-ad02-d3dc92ea2342 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ed3b1401-af99-49c7-b413-8b8c61f5222f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:10.953451 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4179d6f-41bd-401d-ad02-d3dc92ea2342 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:10.953940 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4179d6f-41bd-401d-ad02-d3dc92ea2342 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:10.954413 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4179d6f-41bd-401d-ad02-d3dc92ea2342 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:10.955120 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4179d6f-41bd-401d-ad02-d3dc92ea2342 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:10.955575 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4179d6f-41bd-401d-ad02-d3dc92ea2342 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:10.956003 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b4179d6f-41bd-401d-ad02-d3dc92ea2342 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:11.098528 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b4179d6f-41bd-401d-ad02-d3dc92ea2342 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:07:11.106624 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b4179d6f-41bd-401d-ad02-d3dc92ea2342 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/ed3b1401-af99-49c7-b413-8b8c61f5222f" status: 200 len: 1391 microversion: 2.1 time: 0.167125 Aug 31 17:07:11.107671 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3669/7519] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:07:10 2022] GET /compute/v2.1/servers/ed3b1401-af99-49c7-b413-8b8c61f5222f => generated 1391 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:07:12.129255 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-498e92d0-ba1d-48e1-91f8-7dec19a92fb0 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:07:12.129892 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-498e92d0-ba1d-48e1-91f8-7dec19a92fb0 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ed3b1401-af99-49c7-b413-8b8c61f5222f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:12.136519 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-498e92d0-ba1d-48e1-91f8-7dec19a92fb0 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:12.137017 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-498e92d0-ba1d-48e1-91f8-7dec19a92fb0 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:12.137461 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-498e92d0-ba1d-48e1-91f8-7dec19a92fb0 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:12.138200 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-498e92d0-ba1d-48e1-91f8-7dec19a92fb0 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:12.138634 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-498e92d0-ba1d-48e1-91f8-7dec19a92fb0 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:12.139073 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-498e92d0-ba1d-48e1-91f8-7dec19a92fb0 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:12.289525 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-498e92d0-ba1d-48e1-91f8-7dec19a92fb0 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:07:12.297715 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-498e92d0-ba1d-48e1-91f8-7dec19a92fb0 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/ed3b1401-af99-49c7-b413-8b8c61f5222f" status: 200 len: 1391 microversion: 2.1 time: 0.173403 Aug 31 17:07:12.298367 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3851/7520] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:07:12 2022] GET /compute/v2.1/servers/ed3b1401-af99-49c7-b413-8b8c61f5222f => generated 1391 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:07:13.216106 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-1dd63b0d-72a0-468c-913e-6617dddb3256 req-d8886a0c-59cc-4d2e-b66e-3de8fb1a5321 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed3b1401-af99-49c7-b413-8b8c61f5222f", "name": "network-vif-plugged", "status": "completed", "tag": "62d0c9b1-0c5f-4734-850c-831f3752e37b"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:07:13.228531 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-1dd63b0d-72a0-468c-913e-6617dddb3256 req-d8886a0c-59cc-4d2e-b66e-3de8fb1a5321 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:13.229142 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-1dd63b0d-72a0-468c-913e-6617dddb3256 req-d8886a0c-59cc-4d2e-b66e-3de8fb1a5321 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:13.229570 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-1dd63b0d-72a0-468c-913e-6617dddb3256 req-d8886a0c-59cc-4d2e-b66e-3de8fb1a5321 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:13.241913 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-1dd63b0d-72a0-468c-913e-6617dddb3256 req-d8886a0c-59cc-4d2e-b66e-3de8fb1a5321 service nova] Creating event network-vif-plugged:62d0c9b1-0c5f-4734-850c-831f3752e37b for instance ed3b1401-af99-49c7-b413-8b8c61f5222f on n-h2-833090-16 Aug 31 17:07:13.248053 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-1dd63b0d-72a0-468c-913e-6617dddb3256 req-d8886a0c-59cc-4d2e-b66e-3de8fb1a5321 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035778 Aug 31 17:07:13.248903 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3670/7521] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:07:13.322814 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-71c329c4-2147-457d-859f-80e2711aa8da tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:07:13.323612 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-71c329c4-2147-457d-859f-80e2711aa8da tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ed3b1401-af99-49c7-b413-8b8c61f5222f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:13.332398 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-71c329c4-2147-457d-859f-80e2711aa8da tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:13.332795 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-71c329c4-2147-457d-859f-80e2711aa8da tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:13.333447 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-71c329c4-2147-457d-859f-80e2711aa8da tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:13.334219 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-71c329c4-2147-457d-859f-80e2711aa8da tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:13.334690 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-71c329c4-2147-457d-859f-80e2711aa8da tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:13.335130 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-71c329c4-2147-457d-859f-80e2711aa8da tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:13.486270 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-71c329c4-2147-457d-859f-80e2711aa8da tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:07:13.497268 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-71c329c4-2147-457d-859f-80e2711aa8da tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/ed3b1401-af99-49c7-b413-8b8c61f5222f" status: 200 len: 1391 microversion: 2.1 time: 0.181586 Aug 31 17:07:13.498021 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3852/7522] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:07:13 2022] GET /compute/v2.1/servers/ed3b1401-af99-49c7-b413-8b8c61f5222f => generated 1391 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:07:14.518181 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:07:14.518988 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:07:14.526274 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a0f954f2-742d-4b26-be63-e17fcaf3bdce tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:07:14.527172 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a0f954f2-742d-4b26-be63-e17fcaf3bdce tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ed3b1401-af99-49c7-b413-8b8c61f5222f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:14.535213 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a0f954f2-742d-4b26-be63-e17fcaf3bdce tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:14.536007 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a0f954f2-742d-4b26-be63-e17fcaf3bdce tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:14.536467 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a0f954f2-742d-4b26-be63-e17fcaf3bdce tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:14.537167 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a0f954f2-742d-4b26-be63-e17fcaf3bdce tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:14.537623 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a0f954f2-742d-4b26-be63-e17fcaf3bdce tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:14.538055 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a0f954f2-742d-4b26-be63-e17fcaf3bdce tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:14.684039 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a0f954f2-742d-4b26-be63-e17fcaf3bdce tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:07:14.692999 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a0f954f2-742d-4b26-be63-e17fcaf3bdce tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/ed3b1401-af99-49c7-b413-8b8c61f5222f" status: 200 len: 1391 microversion: 2.1 time: 0.175882 Aug 31 17:07:14.693585 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3671/7523] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:07:14 2022] GET /compute/v2.1/servers/ed3b1401-af99-49c7-b413-8b8c61f5222f => generated 1391 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:07:15.714751 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3919787e-460c-4e8e-983e-890fe68e6e1c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:07:15.715345 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3919787e-460c-4e8e-983e-890fe68e6e1c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ed3b1401-af99-49c7-b413-8b8c61f5222f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:15.717432 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=6 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:07:15.724099 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3919787e-460c-4e8e-983e-890fe68e6e1c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:15.724601 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3919787e-460c-4e8e-983e-890fe68e6e1c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:15.725049 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3919787e-460c-4e8e-983e-890fe68e6e1c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:15.725835 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3919787e-460c-4e8e-983e-890fe68e6e1c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:15.726340 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3919787e-460c-4e8e-983e-890fe68e6e1c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:15.726778 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3919787e-460c-4e8e-983e-890fe68e6e1c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:15.875717 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3919787e-460c-4e8e-983e-890fe68e6e1c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:07:15.889043 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3919787e-460c-4e8e-983e-890fe68e6e1c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/ed3b1401-af99-49c7-b413-8b8c61f5222f" status: 200 len: 1563 microversion: 2.1 time: 0.177978 Aug 31 17:07:15.889805 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3853/7524] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:07:15 2022] GET /compute/v2.1/servers/ed3b1401-af99-49c7-b413-8b8c61f5222f => generated 1563 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:07:15.913945 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-341a2250-c85e-49ee-854e-7c55b7cf96a2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:07:15.914867 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-341a2250-c85e-49ee-854e-7c55b7cf96a2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ed3b1401-af99-49c7-b413-8b8c61f5222f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:15.922491 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-341a2250-c85e-49ee-854e-7c55b7cf96a2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:15.922967 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-341a2250-c85e-49ee-854e-7c55b7cf96a2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:15.923391 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-341a2250-c85e-49ee-854e-7c55b7cf96a2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:15.924114 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-341a2250-c85e-49ee-854e-7c55b7cf96a2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:15.924682 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-341a2250-c85e-49ee-854e-7c55b7cf96a2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:15.925154 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-341a2250-c85e-49ee-854e-7c55b7cf96a2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:16.073314 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-341a2250-c85e-49ee-854e-7c55b7cf96a2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:07:16.082121 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-341a2250-c85e-49ee-854e-7c55b7cf96a2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/ed3b1401-af99-49c7-b413-8b8c61f5222f" status: 200 len: 1563 microversion: 2.1 time: 0.172093 Aug 31 17:07:16.082735 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3672/7525] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:07:15 2022] GET /compute/v2.1/servers/ed3b1401-af99-49c7-b413-8b8c61f5222f => generated 1563 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:07:18.128989 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5e011ec4-72dc-48ff-bfac-cc60fddc415d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:07:18.129661 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5e011ec4-72dc-48ff-bfac-cc60fddc415d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ed3b1401-af99-49c7-b413-8b8c61f5222f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:18.131970 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-4e3824a9-45d1-4155-be51-3942035cad90 req-876024af-f954-49b1-825a-cfcc18670c31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed3b1401-af99-49c7-b413-8b8c61f5222f", "tag": "62d0c9b1-0c5f-4734-850c-831f3752e37b"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:07:18.141493 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e011ec4-72dc-48ff-bfac-cc60fddc415d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:18.142006 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e011ec4-72dc-48ff-bfac-cc60fddc415d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:18.142489 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e011ec4-72dc-48ff-bfac-cc60fddc415d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:18.144813 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4e3824a9-45d1-4155-be51-3942035cad90 req-876024af-f954-49b1-825a-cfcc18670c31 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:18.145398 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4e3824a9-45d1-4155-be51-3942035cad90 req-876024af-f954-49b1-825a-cfcc18670c31 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:18.145706 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e011ec4-72dc-48ff-bfac-cc60fddc415d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:18.145994 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4e3824a9-45d1-4155-be51-3942035cad90 req-876024af-f954-49b1-825a-cfcc18670c31 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:18.146230 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e011ec4-72dc-48ff-bfac-cc60fddc415d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:18.146680 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5e011ec4-72dc-48ff-bfac-cc60fddc415d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:18.160997 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-4e3824a9-45d1-4155-be51-3942035cad90 req-876024af-f954-49b1-825a-cfcc18670c31 service nova] Creating event network-changed:62d0c9b1-0c5f-4734-850c-831f3752e37b for instance ed3b1401-af99-49c7-b413-8b8c61f5222f on n-h2-833090-16 Aug 31 17:07:18.169711 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-4e3824a9-45d1-4155-be51-3942035cad90 req-876024af-f954-49b1-825a-cfcc18670c31 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041828 Aug 31 17:07:18.170785 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3673/7526] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:07:18.303005 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5e011ec4-72dc-48ff-bfac-cc60fddc415d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:07:18.316214 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5e011ec4-72dc-48ff-bfac-cc60fddc415d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/ed3b1401-af99-49c7-b413-8b8c61f5222f" status: 200 len: 1563 microversion: 2.1 time: 0.191135 Aug 31 17:07:18.317910 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3854/7527] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:07:18 2022] GET /compute/v2.1/servers/ed3b1401-af99-49c7-b413-8b8c61f5222f => generated 1563 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:07:50.742887 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:07:50.743713 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=38 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:07:50.748359 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7787194d-a45d-43ce-9a10-60c33927d357 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:07:50.750659 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7787194d-a45d-43ce-9a10-60c33927d357 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ed3b1401-af99-49c7-b413-8b8c61f5222f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:07:50.758423 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7787194d-a45d-43ce-9a10-60c33927d357 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:50.758899 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7787194d-a45d-43ce-9a10-60c33927d357 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:50.759325 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7787194d-a45d-43ce-9a10-60c33927d357 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:50.760003 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7787194d-a45d-43ce-9a10-60c33927d357 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:07:50.760442 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7787194d-a45d-43ce-9a10-60c33927d357 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:07:50.760852 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7787194d-a45d-43ce-9a10-60c33927d357 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:07:50.829682 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7787194d-a45d-43ce-9a10-60c33927d357 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "POST /compute/v2.1/servers/ed3b1401-af99-49c7-b413-8b8c61f5222f/action" status: 200 len: 24570 microversion: 2.1 time: 0.089001 Aug 31 17:07:50.830352 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3674/7528] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 17:07:50 2022] POST /compute/v2.1/servers/ed3b1401-af99-49c7-b413-8b8c61f5222f/action => generated 24570 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 17:08:29.641031 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:08:29.641904 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=42 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:08:29.649130 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4945f57f-14a5-4b06-974a-a463aedbd6d0 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:08:29.649664 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4945f57f-14a5-4b06-974a-a463aedbd6d0 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ed3b1401-af99-49c7-b413-8b8c61f5222f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:29.657498 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4945f57f-14a5-4b06-974a-a463aedbd6d0 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:29.657989 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4945f57f-14a5-4b06-974a-a463aedbd6d0 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:29.658455 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4945f57f-14a5-4b06-974a-a463aedbd6d0 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:29.659149 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4945f57f-14a5-4b06-974a-a463aedbd6d0 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:29.659605 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4945f57f-14a5-4b06-974a-a463aedbd6d0 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:29.660033 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4945f57f-14a5-4b06-974a-a463aedbd6d0 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:29.737390 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4945f57f-14a5-4b06-974a-a463aedbd6d0 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "POST /compute/v2.1/servers/ed3b1401-af99-49c7-b413-8b8c61f5222f/action" status: 202 len: 0 microversion: 2.1 time: 0.098078 Aug 31 17:08:29.738502 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3855/7529] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 17:08:29 2022] POST /compute/v2.1/servers/ed3b1401-af99-49c7-b413-8b8c61f5222f/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:08:29.749821 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4aa331d8-93f8-407e-acee-c14ee5a1c2c9 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:29.751138 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4aa331d8-93f8-407e-acee-c14ee5a1c2c9 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ed3b1401-af99-49c7-b413-8b8c61f5222f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:29.754544 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:08:29.755674 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:08:29.766997 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4aa331d8-93f8-407e-acee-c14ee5a1c2c9 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:29.767485 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4aa331d8-93f8-407e-acee-c14ee5a1c2c9 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:29.767923 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4aa331d8-93f8-407e-acee-c14ee5a1c2c9 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:29.768628 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4aa331d8-93f8-407e-acee-c14ee5a1c2c9 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:29.769089 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4aa331d8-93f8-407e-acee-c14ee5a1c2c9 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:29.769517 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4aa331d8-93f8-407e-acee-c14ee5a1c2c9 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:29.917289 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4aa331d8-93f8-407e-acee-c14ee5a1c2c9 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:08:29.930413 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4aa331d8-93f8-407e-acee-c14ee5a1c2c9 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/ed3b1401-af99-49c7-b413-8b8c61f5222f" status: 200 len: 1687 microversion: 2.1 time: 0.186162 Aug 31 17:08:29.930979 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3675/7530] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:29 2022] GET /compute/v2.1/servers/ed3b1401-af99-49c7-b413-8b8c61f5222f => generated 1687 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:08:30.959283 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-cb18a82e-4c3b-4db2-8783-acde79306e55 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:30.960456 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-cb18a82e-4c3b-4db2-8783-acde79306e55 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ed3b1401-af99-49c7-b413-8b8c61f5222f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:30.972194 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb18a82e-4c3b-4db2-8783-acde79306e55 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:30.973024 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb18a82e-4c3b-4db2-8783-acde79306e55 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:30.973773 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb18a82e-4c3b-4db2-8783-acde79306e55 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:30.975037 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb18a82e-4c3b-4db2-8783-acde79306e55 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:30.975815 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb18a82e-4c3b-4db2-8783-acde79306e55 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:30.976542 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb18a82e-4c3b-4db2-8783-acde79306e55 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:31.127429 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-cb18a82e-4c3b-4db2-8783-acde79306e55 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:08:31.136415 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-cb18a82e-4c3b-4db2-8783-acde79306e55 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/ed3b1401-af99-49c7-b413-8b8c61f5222f" status: 200 len: 1667 microversion: 2.1 time: 0.186078 Aug 31 17:08:31.136996 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3856/7531] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:30 2022] GET /compute/v2.1/servers/ed3b1401-af99-49c7-b413-8b8c61f5222f => generated 1667 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:08:32.249596 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c85dd163-57c1-47c6-b91e-0a13cea1606c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:08:32.251889 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c85dd163-57c1-47c6-b91e-0a13cea1606c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ed3b1401-af99-49c7-b413-8b8c61f5222f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:32.260301 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c85dd163-57c1-47c6-b91e-0a13cea1606c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:32.260794 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c85dd163-57c1-47c6-b91e-0a13cea1606c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:32.261232 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c85dd163-57c1-47c6-b91e-0a13cea1606c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:32.261932 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c85dd163-57c1-47c6-b91e-0a13cea1606c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:32.262422 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c85dd163-57c1-47c6-b91e-0a13cea1606c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:32.262845 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c85dd163-57c1-47c6-b91e-0a13cea1606c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:32.331308 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c85dd163-57c1-47c6-b91e-0a13cea1606c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "POST /compute/v2.1/servers/ed3b1401-af99-49c7-b413-8b8c61f5222f/action" status: 200 len: 32637 microversion: 2.1 time: 0.085035 Aug 31 17:08:32.332133 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3676/7532] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 17:08:32 2022] POST /compute/v2.1/servers/ed3b1401-af99-49c7-b413-8b8c61f5222f/action => generated 32637 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 17:08:32.346230 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8f0d54cf-f795-4953-b9ee-7bcedc9e4993 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:08:32.346999 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8f0d54cf-f795-4953-b9ee-7bcedc9e4993 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ed3b1401-af99-49c7-b413-8b8c61f5222f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:32.357596 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8f0d54cf-f795-4953-b9ee-7bcedc9e4993 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:32.358370 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8f0d54cf-f795-4953-b9ee-7bcedc9e4993 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:32.359232 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8f0d54cf-f795-4953-b9ee-7bcedc9e4993 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:32.359680 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8f0d54cf-f795-4953-b9ee-7bcedc9e4993 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:32.360177 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8f0d54cf-f795-4953-b9ee-7bcedc9e4993 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:32.360808 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8f0d54cf-f795-4953-b9ee-7bcedc9e4993 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:32.435258 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8f0d54cf-f795-4953-b9ee-7bcedc9e4993 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "POST /compute/v2.1/servers/ed3b1401-af99-49c7-b413-8b8c61f5222f/action" status: 202 len: 0 microversion: 2.1 time: 0.094771 Aug 31 17:08:32.436107 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3857/7533] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 17:08:32 2022] POST /compute/v2.1/servers/ed3b1401-af99-49c7-b413-8b8c61f5222f/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:08:32.445140 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-95c7f0dd-c993-46db-9f61-bcaf578b1b45 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:32.446687 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-95c7f0dd-c993-46db-9f61-bcaf578b1b45 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ed3b1401-af99-49c7-b413-8b8c61f5222f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:32.455283 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95c7f0dd-c993-46db-9f61-bcaf578b1b45 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:32.455878 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95c7f0dd-c993-46db-9f61-bcaf578b1b45 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:32.456433 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95c7f0dd-c993-46db-9f61-bcaf578b1b45 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:32.457214 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95c7f0dd-c993-46db-9f61-bcaf578b1b45 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:32.457704 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95c7f0dd-c993-46db-9f61-bcaf578b1b45 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:32.458399 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-95c7f0dd-c993-46db-9f61-bcaf578b1b45 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:32.620341 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-95c7f0dd-c993-46db-9f61-bcaf578b1b45 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:08:32.630307 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-95c7f0dd-c993-46db-9f61-bcaf578b1b45 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/ed3b1401-af99-49c7-b413-8b8c61f5222f" status: 200 len: 1674 microversion: 2.1 time: 0.189375 Aug 31 17:08:32.630927 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3677/7534] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:32 2022] GET /compute/v2.1/servers/ed3b1401-af99-49c7-b413-8b8c61f5222f => generated 1674 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:08:33.655766 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6c00acf2-dd7a-4ed1-9ada-97a99875996e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:33.656484 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6c00acf2-dd7a-4ed1-9ada-97a99875996e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ed3b1401-af99-49c7-b413-8b8c61f5222f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:33.663247 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6c00acf2-dd7a-4ed1-9ada-97a99875996e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:33.663746 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6c00acf2-dd7a-4ed1-9ada-97a99875996e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:33.664227 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6c00acf2-dd7a-4ed1-9ada-97a99875996e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:33.665414 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6c00acf2-dd7a-4ed1-9ada-97a99875996e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:33.665900 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6c00acf2-dd7a-4ed1-9ada-97a99875996e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:33.666367 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6c00acf2-dd7a-4ed1-9ada-97a99875996e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:33.822048 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6c00acf2-dd7a-4ed1-9ada-97a99875996e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:08:33.833154 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6c00acf2-dd7a-4ed1-9ada-97a99875996e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/ed3b1401-af99-49c7-b413-8b8c61f5222f" status: 200 len: 1682 microversion: 2.1 time: 0.182921 Aug 31 17:08:33.833747 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3858/7535] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:33 2022] GET /compute/v2.1/servers/ed3b1401-af99-49c7-b413-8b8c61f5222f => generated 1682 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:08:33.932610 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e21c2a99-4412-4745-b53f-cc021826628c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:08:33.934855 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e21c2a99-4412-4745-b53f-cc021826628c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ed3b1401-af99-49c7-b413-8b8c61f5222f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:33.942719 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e21c2a99-4412-4745-b53f-cc021826628c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:33.943204 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e21c2a99-4412-4745-b53f-cc021826628c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:33.943640 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e21c2a99-4412-4745-b53f-cc021826628c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:33.944329 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e21c2a99-4412-4745-b53f-cc021826628c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:33.944785 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e21c2a99-4412-4745-b53f-cc021826628c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:33.945225 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e21c2a99-4412-4745-b53f-cc021826628c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:34.028776 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e21c2a99-4412-4745-b53f-cc021826628c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "POST /compute/v2.1/servers/ed3b1401-af99-49c7-b413-8b8c61f5222f/action" status: 200 len: 38371 microversion: 2.1 time: 0.100000 Aug 31 17:08:34.030210 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3678/7536] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 17:08:33 2022] POST /compute/v2.1/servers/ed3b1401-af99-49c7-b413-8b8c61f5222f/action => generated 38371 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 17:08:35.093474 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5041b0f2-03bf-4aec-b8a0-e3a8e094fd0b tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:35.094018 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5041b0f2-03bf-4aec-b8a0-e3a8e094fd0b tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ed3b1401-af99-49c7-b413-8b8c61f5222f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:35.095011 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-bd6a8034-7bb9-4739-b241-1663bd33d5a3 req-3f395494-2a9a-4ac1-85cf-284b478b1ae8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed3b1401-af99-49c7-b413-8b8c61f5222f", "tag": "62d0c9b1-0c5f-4734-850c-831f3752e37b"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:08:35.101225 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5041b0f2-03bf-4aec-b8a0-e3a8e094fd0b tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:35.102582 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5041b0f2-03bf-4aec-b8a0-e3a8e094fd0b tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:35.103598 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5041b0f2-03bf-4aec-b8a0-e3a8e094fd0b tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:35.104569 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5041b0f2-03bf-4aec-b8a0-e3a8e094fd0b tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:35.105037 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5041b0f2-03bf-4aec-b8a0-e3a8e094fd0b tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:35.105476 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5041b0f2-03bf-4aec-b8a0-e3a8e094fd0b tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:35.107562 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-bd6a8034-7bb9-4739-b241-1663bd33d5a3 req-3f395494-2a9a-4ac1-85cf-284b478b1ae8 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:35.108037 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-bd6a8034-7bb9-4739-b241-1663bd33d5a3 req-3f395494-2a9a-4ac1-85cf-284b478b1ae8 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:35.108747 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-bd6a8034-7bb9-4739-b241-1663bd33d5a3 req-3f395494-2a9a-4ac1-85cf-284b478b1ae8 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:35.121100 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-bd6a8034-7bb9-4739-b241-1663bd33d5a3 req-3f395494-2a9a-4ac1-85cf-284b478b1ae8 service nova] Creating event network-changed:62d0c9b1-0c5f-4734-850c-831f3752e37b for instance ed3b1401-af99-49c7-b413-8b8c61f5222f on n-h2-833090-16 Aug 31 17:08:35.125838 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-bd6a8034-7bb9-4739-b241-1663bd33d5a3 req-3f395494-2a9a-4ac1-85cf-284b478b1ae8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034998 Aug 31 17:08:35.126785 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3679/7537] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:08:35.134292 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5041b0f2-03bf-4aec-b8a0-e3a8e094fd0b tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ed3b1401-af99-49c7-b413-8b8c61f5222f] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 17:08:35.226493 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5041b0f2-03bf-4aec-b8a0-e3a8e094fd0b tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ed3b1401-af99-49c7-b413-8b8c61f5222f" status: 204 len: 0 microversion: 2.1 time: 0.137151 Aug 31 17:08:35.227114 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3859/7538] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 17:08:35 2022] DELETE /compute/v2.1/servers/ed3b1401-af99-49c7-b413-8b8c61f5222f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 17:08:35.237291 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b8191fb2-e34e-475f-9754-1318eb6b344b tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:35.237958 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b8191fb2-e34e-475f-9754-1318eb6b344b tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ed3b1401-af99-49c7-b413-8b8c61f5222f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:35.246692 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8191fb2-e34e-475f-9754-1318eb6b344b tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:35.247181 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8191fb2-e34e-475f-9754-1318eb6b344b tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:35.247855 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8191fb2-e34e-475f-9754-1318eb6b344b tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:35.248504 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8191fb2-e34e-475f-9754-1318eb6b344b tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:35.248993 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8191fb2-e34e-475f-9754-1318eb6b344b tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:35.249418 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8191fb2-e34e-475f-9754-1318eb6b344b tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:35.391516 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b8191fb2-e34e-475f-9754-1318eb6b344b tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:08:35.400002 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b8191fb2-e34e-475f-9754-1318eb6b344b tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/ed3b1401-af99-49c7-b413-8b8c61f5222f" status: 200 len: 1688 microversion: 2.1 time: 0.167467 Aug 31 17:08:35.400596 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3680/7539] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:35 2022] GET /compute/v2.1/servers/ed3b1401-af99-49c7-b413-8b8c61f5222f => generated 1688 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:08:36.425013 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-280a0ceb-9dde-47b0-a149-7371e01a6b0d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:36.425840 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-280a0ceb-9dde-47b0-a149-7371e01a6b0d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ed3b1401-af99-49c7-b413-8b8c61f5222f] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:36.434333 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-280a0ceb-9dde-47b0-a149-7371e01a6b0d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:36.434923 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-280a0ceb-9dde-47b0-a149-7371e01a6b0d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:36.435458 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-280a0ceb-9dde-47b0-a149-7371e01a6b0d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:36.436296 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-280a0ceb-9dde-47b0-a149-7371e01a6b0d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:36.436846 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-280a0ceb-9dde-47b0-a149-7371e01a6b0d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:36.437347 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-280a0ceb-9dde-47b0-a149-7371e01a6b0d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:36.585105 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-280a0ceb-9dde-47b0-a149-7371e01a6b0d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:08:36.594405 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-280a0ceb-9dde-47b0-a149-7371e01a6b0d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/ed3b1401-af99-49c7-b413-8b8c61f5222f" status: 200 len: 1688 microversion: 2.1 time: 0.174444 Aug 31 17:08:36.595183 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3860/7540] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:36 2022] GET /compute/v2.1/servers/ed3b1401-af99-49c7-b413-8b8c61f5222f => generated 1688 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:08:37.615776 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5b72bfb6-93bc-43da-ae02-b511b8a1805c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:37.616400 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5b72bfb6-93bc-43da-ae02-b511b8a1805c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ed3b1401-af99-49c7-b413-8b8c61f5222f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:37.623908 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b72bfb6-93bc-43da-ae02-b511b8a1805c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:37.624399 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b72bfb6-93bc-43da-ae02-b511b8a1805c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:37.625073 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b72bfb6-93bc-43da-ae02-b511b8a1805c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:37.625781 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b72bfb6-93bc-43da-ae02-b511b8a1805c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:37.626265 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b72bfb6-93bc-43da-ae02-b511b8a1805c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:37.626684 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5b72bfb6-93bc-43da-ae02-b511b8a1805c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:37.692074 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-aaac0d04-7cfb-43a8-a619-3f1395b1a54d req-7ff28d47-8a7d-40fd-af4f-5d113eeef120 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed3b1401-af99-49c7-b413-8b8c61f5222f", "name": "network-vif-deleted", "tag": "62d0c9b1-0c5f-4734-850c-831f3752e37b"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:08:37.708157 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-aaac0d04-7cfb-43a8-a619-3f1395b1a54d req-7ff28d47-8a7d-40fd-af4f-5d113eeef120 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:37.708927 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-aaac0d04-7cfb-43a8-a619-3f1395b1a54d req-7ff28d47-8a7d-40fd-af4f-5d113eeef120 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:37.709405 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-aaac0d04-7cfb-43a8-a619-3f1395b1a54d req-7ff28d47-8a7d-40fd-af4f-5d113eeef120 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:37.715594 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5b72bfb6-93bc-43da-ae02-b511b8a1805c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:08:37.724280 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-aaac0d04-7cfb-43a8-a619-3f1395b1a54d req-7ff28d47-8a7d-40fd-af4f-5d113eeef120 service nova] Creating event network-vif-deleted:62d0c9b1-0c5f-4734-850c-831f3752e37b for instance ed3b1401-af99-49c7-b413-8b8c61f5222f on n-h2-833090-16 Aug 31 17:08:37.725202 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5b72bfb6-93bc-43da-ae02-b511b8a1805c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/ed3b1401-af99-49c7-b413-8b8c61f5222f" status: 200 len: 1502 microversion: 2.1 time: 0.113295 Aug 31 17:08:37.725825 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3681/7541] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:37 2022] GET /compute/v2.1/servers/ed3b1401-af99-49c7-b413-8b8c61f5222f => generated 1502 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:08:37.740261 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-aaac0d04-7cfb-43a8-a619-3f1395b1a54d req-7ff28d47-8a7d-40fd-af4f-5d113eeef120 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052231 Aug 31 17:08:37.740994 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3861/7542] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:08:38.747791 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-359f01c3-08ca-4d76-8caf-e2b1aeb76aab tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:38.748769 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-359f01c3-08ca-4d76-8caf-e2b1aeb76aab tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ed3b1401-af99-49c7-b413-8b8c61f5222f] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:38.756042 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-359f01c3-08ca-4d76-8caf-e2b1aeb76aab tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:38.756526 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-359f01c3-08ca-4d76-8caf-e2b1aeb76aab tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:38.756953 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-359f01c3-08ca-4d76-8caf-e2b1aeb76aab tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:38.757637 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-359f01c3-08ca-4d76-8caf-e2b1aeb76aab tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:38.758122 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-359f01c3-08ca-4d76-8caf-e2b1aeb76aab tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:38.758881 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-359f01c3-08ca-4d76-8caf-e2b1aeb76aab tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:38.772803 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-359f01c3-08ca-4d76-8caf-e2b1aeb76aab tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] HTTP exception thrown: Instance ed3b1401-af99-49c7-b413-8b8c61f5222f could not be found. Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-359f01c3-08ca-4d76-8caf-e2b1aeb76aab tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Request method failure captured: Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/ed3b1401-af99-49c7-b413-8b8c61f5222f HTTP/1.1 Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD5UwnC35Vn5evFApyVfskHdEHcvv0VSRxaZ9pzKW96Fqt51iHq5jLe56IGhM36ZgCFwb3_2IfN9Wxbd_wUAkzwS08XpxCxoP856myVMcw20sYLpddPhTMaAFpoi0Qlpqj4GXCEBMwRUEqexdDDa6EuUjH1_09epMJ_p9WzfxJnmlCRg Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: a6f813017c8c40d5978c8550f188dbf7 Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1147621593 Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a6f813017c8c40d5978c8550f188dbf7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a6f813017c8c40d5978c8550f188dbf7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a6f813017c8c40d5978c8550f188dbf7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a6f813017c8c40d5978c8550f188dbf7", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1147621593 Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: a6f813017c8c40d5978c8550f188dbf7 Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1147621593 Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-TestNetworkAdvancedServerOps-1147621593-project Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: a18fb2c4e622474d943a72025236cca7 Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1147621593-project Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance ed3b1401-af99-49c7-b413-8b8c61f5222f could not be found. Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'ed3b1401-af99-49c7-b413-8b8c61f5222f'} Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed3b1401-af99-49c7-b413-8b8c61f5222f could not be found. Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed3b1401-af99-49c7-b413-8b8c61f5222f could not be found. Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 17:08:38.774836 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:08:38.779919 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 17:08:38.779919 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:08:38.779919 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:08:38.779919 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:08:38.779919 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 17:08:38.779919 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 17:08:38.779919 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed3b1401-af99-49c7-b413-8b8c61f5222f could not be found. Aug 31 17:08:38.779919 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 17:08:38.779919 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-359f01c3-08ca-4d76-8caf-e2b1aeb76aab tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Returning 404 to user: Instance ed3b1401-af99-49c7-b413-8b8c61f5222f could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 17:08:38.779919 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-359f01c3-08ca-4d76-8caf-e2b1aeb76aab tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/ed3b1401-af99-49c7-b413-8b8c61f5222f" status: 404 len: 111 microversion: 2.1 time: 0.032506 Aug 31 17:08:38.779919 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3682/7543] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:38 2022] GET /compute/v2.1/servers/ed3b1401-af99-49c7-b413-8b8c61f5222f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 17:08:42.250432 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7d07da72-91a4-423f-8ab6-0b7a08fe27b2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '.version_select at 0x7fbb46800ee0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:42.288258 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7d07da72-91a4-423f-8ab6-0b7a08fe27b2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-853897660" status: 202 len: 0 microversion: 2.1 time: 0.042861 Aug 31 17:08:42.289169 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3862/7544] 10.222.0.50 () {58 vars in 1281 bytes} [Wed Aug 31 17:08:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-853897660 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:08:42.321153 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b4efc80c-08b5-4047-8e12-47b22cfeb2a0 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Action: 'create', calling method: .version_select at 0x7fbb4aa439d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-784831011", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNylCQw07osLOwGyp007/ixoseaYYUFpVnhM8eLAspjgF95cqPXG3YEtW1Rwtirr+VosA12UBOjobvYdXrgjpkF+yEChok+UjNn3rh1aGOfgLJTHmDVXFVip4Pp/tzMQuQ=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:08:42.341052 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-b4efc80c-08b5-4047-8e12-47b22cfeb2a0 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Getting quotas for project a6f813017c8c40d5978c8550f188dbf7. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 17:08:42.348863 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-b4efc80c-08b5-4047-8e12-47b22cfeb2a0 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Getting quotas for user a18fb2c4e622474d943a72025236cca7 and project a6f813017c8c40d5978c8550f188dbf7. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 17:08:42.376668 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b4efc80c-08b5-4047-8e12-47b22cfeb2a0 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.062762 Aug 31 17:08:42.377301 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3683/7545] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 31 17:08:42 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 17:08:48.358700 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-72b40e99-a7f6-47fa-b2b0-e105759c841e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1498667273", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "495e7117-4be4-4315-aa99-2d3f4a69278f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-784831011", "security_groups": [{"name": "tempest-secgroup-smoke-980722942"}]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:08:48.379612 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:08:48.511681 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-72b40e99-a7f6-47fa-b2b0-e105759c841e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] validate_networks() for [('495e7117-4be4-4315-aa99-2d3f4a69278f', None, None, None, None, None)] {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 17:08:49.007306 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-72b40e99-a7f6-47fa-b2b0-e105759c841e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 17:08:49.007725 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-72b40e99-a7f6-47fa-b2b0-e105759c841e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 17:08:49.008343 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-72b40e99-a7f6-47fa-b2b0-e105759c841e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 17:08:49.009066 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-72b40e99-a7f6-47fa-b2b0-e105759c841e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 17:08:49.009603 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-72b40e99-a7f6-47fa-b2b0-e105759c841e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 17:08:49.018832 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-72b40e99-a7f6-47fa-b2b0-e105759c841e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:49.019326 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-72b40e99-a7f6-47fa-b2b0-e105759c841e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:49.019777 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-72b40e99-a7f6-47fa-b2b0-e105759c841e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:49.020517 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-72b40e99-a7f6-47fa-b2b0-e105759c841e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:49.020984 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-72b40e99-a7f6-47fa-b2b0-e105759c841e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:49.021421 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-72b40e99-a7f6-47fa-b2b0-e105759c841e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:49.041340 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-72b40e99-a7f6-47fa-b2b0-e105759c841e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Getting quotas for project a6f813017c8c40d5978c8550f188dbf7. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 17:08:49.047136 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-72b40e99-a7f6-47fa-b2b0-e105759c841e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Getting quotas for user a18fb2c4e622474d943a72025236cca7 and project a6f813017c8c40d5978c8550f188dbf7. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 17:08:49.060455 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-72b40e99-a7f6-47fa-b2b0-e105759c841e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 17:08:49.063129 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-72b40e99-a7f6-47fa-b2b0-e105759c841e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 459cf2b9-c7f6-4c4b-8686-804ac69dfe7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 17:08:49.116949 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-72b40e99-a7f6-47fa-b2b0-e105759c841e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.764208 Aug 31 17:08:49.124176 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3863/7546] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 17:08:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 17:08:49.126600 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=36 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:08:49.130991 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8139d556-bd77-4a86-bc70-91900c590182 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:49.131606 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8139d556-bd77-4a86-bc70-91900c590182 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 459cf2b9-c7f6-4c4b-8686-804ac69dfe7d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:49.535254 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8139d556-bd77-4a86-bc70-91900c590182 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:08:49.544094 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8139d556-bd77-4a86-bc70-91900c590182 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d" status: 200 len: 1266 microversion: 2.1 time: 0.419226 Aug 31 17:08:49.544732 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3684/7547] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:49 2022] GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d => generated 1266 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:08:50.566396 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e8b66bff-18c1-44f1-887b-45e7988ce129 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:50.567733 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e8b66bff-18c1-44f1-887b-45e7988ce129 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 459cf2b9-c7f6-4c4b-8686-804ac69dfe7d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:50.577689 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e8b66bff-18c1-44f1-887b-45e7988ce129 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:50.578215 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e8b66bff-18c1-44f1-887b-45e7988ce129 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:50.578654 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e8b66bff-18c1-44f1-887b-45e7988ce129 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:50.579380 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e8b66bff-18c1-44f1-887b-45e7988ce129 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:50.579820 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e8b66bff-18c1-44f1-887b-45e7988ce129 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:50.580457 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e8b66bff-18c1-44f1-887b-45e7988ce129 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:50.652118 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e8b66bff-18c1-44f1-887b-45e7988ce129 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:08:50.660959 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e8b66bff-18c1-44f1-887b-45e7988ce129 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d" status: 200 len: 1324 microversion: 2.1 time: 0.099566 Aug 31 17:08:50.668569 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3864/7548] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:50 2022] GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d => generated 1324 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:08:51.682954 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3f7c18e5-3d31-41cd-94e3-caf9364de5cb tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:51.683671 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3f7c18e5-3d31-41cd-94e3-caf9364de5cb tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 459cf2b9-c7f6-4c4b-8686-804ac69dfe7d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:51.691729 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f7c18e5-3d31-41cd-94e3-caf9364de5cb tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:51.692350 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f7c18e5-3d31-41cd-94e3-caf9364de5cb tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:51.692921 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f7c18e5-3d31-41cd-94e3-caf9364de5cb tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:51.693769 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f7c18e5-3d31-41cd-94e3-caf9364de5cb tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:51.694244 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f7c18e5-3d31-41cd-94e3-caf9364de5cb tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:51.694720 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f7c18e5-3d31-41cd-94e3-caf9364de5cb tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:51.784556 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-215c80f9-ac5a-4693-86ce-efe5198ff75a req-a3103e93-c795-462a-b1a3-00096fac16f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "459cf2b9-c7f6-4c4b-8686-804ac69dfe7d", "tag": "f56208e8-bc93-42bb-9067-2b4eff9dd422"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:08:51.806674 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-215c80f9-ac5a-4693-86ce-efe5198ff75a req-a3103e93-c795-462a-b1a3-00096fac16f3 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:51.807318 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-215c80f9-ac5a-4693-86ce-efe5198ff75a req-a3103e93-c795-462a-b1a3-00096fac16f3 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:51.807829 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-215c80f9-ac5a-4693-86ce-efe5198ff75a req-a3103e93-c795-462a-b1a3-00096fac16f3 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:51.833297 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-215c80f9-ac5a-4693-86ce-efe5198ff75a req-a3103e93-c795-462a-b1a3-00096fac16f3 service nova] Creating event network-changed:f56208e8-bc93-42bb-9067-2b4eff9dd422 for instance 459cf2b9-c7f6-4c4b-8686-804ac69dfe7d on n-h2-833090-16 Aug 31 17:08:51.840976 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-215c80f9-ac5a-4693-86ce-efe5198ff75a req-a3103e93-c795-462a-b1a3-00096fac16f3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067012 Aug 31 17:08:51.842752 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3865/7549] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:08:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 17:08:51.870572 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3f7c18e5-3d31-41cd-94e3-caf9364de5cb tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:08:51.880421 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3f7c18e5-3d31-41cd-94e3-caf9364de5cb tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d" status: 200 len: 1391 microversion: 2.1 time: 0.201817 Aug 31 17:08:51.881307 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3685/7550] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:51 2022] GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d => generated 1391 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:08:52.903859 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a6afdf44-b52c-4a0a-98ad-00f2cd353c2c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:52.904712 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a6afdf44-b52c-4a0a-98ad-00f2cd353c2c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 459cf2b9-c7f6-4c4b-8686-804ac69dfe7d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:52.911746 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a6afdf44-b52c-4a0a-98ad-00f2cd353c2c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:52.912240 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a6afdf44-b52c-4a0a-98ad-00f2cd353c2c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:52.912680 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a6afdf44-b52c-4a0a-98ad-00f2cd353c2c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:52.913374 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a6afdf44-b52c-4a0a-98ad-00f2cd353c2c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:52.913829 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a6afdf44-b52c-4a0a-98ad-00f2cd353c2c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:52.914373 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a6afdf44-b52c-4a0a-98ad-00f2cd353c2c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:53.069897 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a6afdf44-b52c-4a0a-98ad-00f2cd353c2c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:08:53.083737 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a6afdf44-b52c-4a0a-98ad-00f2cd353c2c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d" status: 200 len: 1391 microversion: 2.1 time: 0.185320 Aug 31 17:08:53.084532 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3866/7551] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:52 2022] GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d => generated 1391 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:08:54.107495 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5c23ab2d-d1a4-4772-919b-3a4739a04687 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:54.108053 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5c23ab2d-d1a4-4772-919b-3a4739a04687 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 459cf2b9-c7f6-4c4b-8686-804ac69dfe7d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:54.115458 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c23ab2d-d1a4-4772-919b-3a4739a04687 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:54.115948 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c23ab2d-d1a4-4772-919b-3a4739a04687 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:54.116382 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c23ab2d-d1a4-4772-919b-3a4739a04687 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:54.117074 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c23ab2d-d1a4-4772-919b-3a4739a04687 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:54.117524 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c23ab2d-d1a4-4772-919b-3a4739a04687 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:54.117948 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5c23ab2d-d1a4-4772-919b-3a4739a04687 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:54.253277 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5c23ab2d-d1a4-4772-919b-3a4739a04687 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:08:54.261602 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5c23ab2d-d1a4-4772-919b-3a4739a04687 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d" status: 200 len: 1391 microversion: 2.1 time: 0.159326 Aug 31 17:08:54.262204 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3686/7552] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:54 2022] GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:08:55.287231 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d3e39ea9-881a-4278-8e58-ceba09237d88 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:55.287934 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d3e39ea9-881a-4278-8e58-ceba09237d88 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 459cf2b9-c7f6-4c4b-8686-804ac69dfe7d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:55.297884 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d3e39ea9-881a-4278-8e58-ceba09237d88 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:55.298591 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d3e39ea9-881a-4278-8e58-ceba09237d88 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:55.299181 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d3e39ea9-881a-4278-8e58-ceba09237d88 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:55.300099 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d3e39ea9-881a-4278-8e58-ceba09237d88 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:55.300727 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d3e39ea9-881a-4278-8e58-ceba09237d88 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:55.301293 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d3e39ea9-881a-4278-8e58-ceba09237d88 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:55.451801 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d3e39ea9-881a-4278-8e58-ceba09237d88 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:08:55.460074 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d3e39ea9-881a-4278-8e58-ceba09237d88 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d" status: 200 len: 1391 microversion: 2.1 time: 0.180441 Aug 31 17:08:55.461268 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3867/7553] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:55 2022] GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d => generated 1391 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:08:56.483599 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8c2d2874-f05c-433c-bc5b-668e043f3f4b tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:56.484241 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8c2d2874-f05c-433c-bc5b-668e043f3f4b tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 459cf2b9-c7f6-4c4b-8686-804ac69dfe7d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:56.491591 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c2d2874-f05c-433c-bc5b-668e043f3f4b tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:56.492086 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c2d2874-f05c-433c-bc5b-668e043f3f4b tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:56.492521 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c2d2874-f05c-433c-bc5b-668e043f3f4b tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:56.493220 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c2d2874-f05c-433c-bc5b-668e043f3f4b tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:56.493673 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c2d2874-f05c-433c-bc5b-668e043f3f4b tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:56.494124 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8c2d2874-f05c-433c-bc5b-668e043f3f4b tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:56.639438 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8c2d2874-f05c-433c-bc5b-668e043f3f4b tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:08:56.647671 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8c2d2874-f05c-433c-bc5b-668e043f3f4b tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d" status: 200 len: 1391 microversion: 2.1 time: 0.169187 Aug 31 17:08:56.648261 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3687/7554] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:56 2022] GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d => generated 1391 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:08:57.601360 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-93a035a8-7b8b-4fc8-b8be-118e76dcd609 req-c87954ed-ad05-440a-bb06-00cd1a4512ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "459cf2b9-c7f6-4c4b-8686-804ac69dfe7d", "name": "network-vif-plugged", "status": "completed", "tag": "f56208e8-bc93-42bb-9067-2b4eff9dd422"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:08:57.613526 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-93a035a8-7b8b-4fc8-b8be-118e76dcd609 req-c87954ed-ad05-440a-bb06-00cd1a4512ab service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:57.614140 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-93a035a8-7b8b-4fc8-b8be-118e76dcd609 req-c87954ed-ad05-440a-bb06-00cd1a4512ab service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:57.614499 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-93a035a8-7b8b-4fc8-b8be-118e76dcd609 req-c87954ed-ad05-440a-bb06-00cd1a4512ab service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:57.627632 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-93a035a8-7b8b-4fc8-b8be-118e76dcd609 req-c87954ed-ad05-440a-bb06-00cd1a4512ab service nova] Creating event network-vif-plugged:f56208e8-bc93-42bb-9067-2b4eff9dd422 for instance 459cf2b9-c7f6-4c4b-8686-804ac69dfe7d on n-h2-833090-16 Aug 31 17:08:57.632582 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-93a035a8-7b8b-4fc8-b8be-118e76dcd609 req-c87954ed-ad05-440a-bb06-00cd1a4512ab service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034953 Aug 31 17:08:57.633171 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3868/7555] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:08:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:08:57.670779 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-058dd4d1-0f54-40a3-a227-bd383a29de87 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:57.671812 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-058dd4d1-0f54-40a3-a227-bd383a29de87 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 459cf2b9-c7f6-4c4b-8686-804ac69dfe7d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:57.679118 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-058dd4d1-0f54-40a3-a227-bd383a29de87 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:57.679556 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-058dd4d1-0f54-40a3-a227-bd383a29de87 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:57.679991 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-058dd4d1-0f54-40a3-a227-bd383a29de87 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:57.680717 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-058dd4d1-0f54-40a3-a227-bd383a29de87 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:57.681153 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-058dd4d1-0f54-40a3-a227-bd383a29de87 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:57.681576 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-058dd4d1-0f54-40a3-a227-bd383a29de87 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:57.831377 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-058dd4d1-0f54-40a3-a227-bd383a29de87 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:08:57.839589 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-058dd4d1-0f54-40a3-a227-bd383a29de87 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d" status: 200 len: 1391 microversion: 2.1 time: 0.174534 Aug 31 17:08:57.840182 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3688/7556] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:57 2022] GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d => generated 1391 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:08:58.862377 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-35618afd-71f1-4d80-8297-41febe0cf225 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:08:58.863046 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-35618afd-71f1-4d80-8297-41febe0cf225 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 459cf2b9-c7f6-4c4b-8686-804ac69dfe7d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:08:58.870694 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-35618afd-71f1-4d80-8297-41febe0cf225 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:58.872731 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-35618afd-71f1-4d80-8297-41febe0cf225 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:58.873227 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-35618afd-71f1-4d80-8297-41febe0cf225 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:58.874013 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-35618afd-71f1-4d80-8297-41febe0cf225 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:08:58.874505 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-35618afd-71f1-4d80-8297-41febe0cf225 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:08:58.875025 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-35618afd-71f1-4d80-8297-41febe0cf225 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:08:59.017538 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-35618afd-71f1-4d80-8297-41febe0cf225 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:08:59.029786 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:08:59.032815 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-35618afd-71f1-4d80-8297-41febe0cf225 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d" status: 200 len: 1391 microversion: 2.1 time: 0.175625 Aug 31 17:08:59.033386 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3869/7557] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:08:58 2022] GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d => generated 1391 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:09:00.064195 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-13967ccb-9ee1-4248-b5c6-eba551265faf tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:09:00.064969 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-13967ccb-9ee1-4248-b5c6-eba551265faf tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 459cf2b9-c7f6-4c4b-8686-804ac69dfe7d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:09:00.068313 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:09:00.069149 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:09:00.078057 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13967ccb-9ee1-4248-b5c6-eba551265faf tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:00.078677 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13967ccb-9ee1-4248-b5c6-eba551265faf tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:00.079119 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13967ccb-9ee1-4248-b5c6-eba551265faf tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:00.079826 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13967ccb-9ee1-4248-b5c6-eba551265faf tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:00.080289 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13967ccb-9ee1-4248-b5c6-eba551265faf tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:00.080708 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-13967ccb-9ee1-4248-b5c6-eba551265faf tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:00.234633 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-13967ccb-9ee1-4248-b5c6-eba551265faf tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:09:00.242891 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-13967ccb-9ee1-4248-b5c6-eba551265faf tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d" status: 200 len: 1563 microversion: 2.1 time: 0.183837 Aug 31 17:09:00.243478 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3689/7558] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:09:00 2022] GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d => generated 1563 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:09:00.263618 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e863973e-7da1-44ab-b4a1-de3e21992648 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:09:00.264216 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e863973e-7da1-44ab-b4a1-de3e21992648 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 459cf2b9-c7f6-4c4b-8686-804ac69dfe7d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:09:00.266127 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=6 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:09:00.267680 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:09:00.273713 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e863973e-7da1-44ab-b4a1-de3e21992648 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:00.274277 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e863973e-7da1-44ab-b4a1-de3e21992648 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:00.274730 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e863973e-7da1-44ab-b4a1-de3e21992648 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:00.275438 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e863973e-7da1-44ab-b4a1-de3e21992648 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:00.275906 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e863973e-7da1-44ab-b4a1-de3e21992648 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:00.276348 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e863973e-7da1-44ab-b4a1-de3e21992648 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:00.426620 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e863973e-7da1-44ab-b4a1-de3e21992648 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:09:00.438689 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e863973e-7da1-44ab-b4a1-de3e21992648 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d" status: 200 len: 1563 microversion: 2.1 time: 0.179174 Aug 31 17:09:00.439475 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3870/7559] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:09:00 2022] GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d => generated 1563 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:09:02.540705 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-92da2a34-5362-496f-a7ff-689ad2c37f60 req-8ccda53e-db19-4b93-9c3f-6a045cd490c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "459cf2b9-c7f6-4c4b-8686-804ac69dfe7d", "tag": "f56208e8-bc93-42bb-9067-2b4eff9dd422"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:09:02.542402 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-572da6ee-0701-46dc-a06f-1421d5eab3d1 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:09:02.543148 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-572da6ee-0701-46dc-a06f-1421d5eab3d1 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 459cf2b9-c7f6-4c4b-8686-804ac69dfe7d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:09:02.555875 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-572da6ee-0701-46dc-a06f-1421d5eab3d1 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:02.556354 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-572da6ee-0701-46dc-a06f-1421d5eab3d1 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:02.557736 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-572da6ee-0701-46dc-a06f-1421d5eab3d1 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:02.561868 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-92da2a34-5362-496f-a7ff-689ad2c37f60 req-8ccda53e-db19-4b93-9c3f-6a045cd490c2 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:02.562376 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-92da2a34-5362-496f-a7ff-689ad2c37f60 req-8ccda53e-db19-4b93-9c3f-6a045cd490c2 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:02.562818 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-92da2a34-5362-496f-a7ff-689ad2c37f60 req-8ccda53e-db19-4b93-9c3f-6a045cd490c2 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:02.565331 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-572da6ee-0701-46dc-a06f-1421d5eab3d1 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:02.565830 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-572da6ee-0701-46dc-a06f-1421d5eab3d1 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:02.567792 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-572da6ee-0701-46dc-a06f-1421d5eab3d1 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:02.593844 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-92da2a34-5362-496f-a7ff-689ad2c37f60 req-8ccda53e-db19-4b93-9c3f-6a045cd490c2 service nova] Creating event network-changed:f56208e8-bc93-42bb-9067-2b4eff9dd422 for instance 459cf2b9-c7f6-4c4b-8686-804ac69dfe7d on n-h2-833090-16 Aug 31 17:09:02.599476 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-92da2a34-5362-496f-a7ff-689ad2c37f60 req-8ccda53e-db19-4b93-9c3f-6a045cd490c2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062938 Aug 31 17:09:02.600758 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3871/7560] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 17:09:02.730690 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-572da6ee-0701-46dc-a06f-1421d5eab3d1 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:09:02.739392 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-572da6ee-0701-46dc-a06f-1421d5eab3d1 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d" status: 200 len: 1563 microversion: 2.1 time: 0.208267 Aug 31 17:09:02.743113 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3690/7561] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:09:02 2022] GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d => generated 1563 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:09:36.068795 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=3 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:09:36.069574 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=38 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:09:36.074468 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a217b02b-0a76-4fa6-af05-0b753486452a tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:09:36.077097 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a217b02b-0a76-4fa6-af05-0b753486452a tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 459cf2b9-c7f6-4c4b-8686-804ac69dfe7d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:09:36.084490 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a217b02b-0a76-4fa6-af05-0b753486452a tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:36.084981 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a217b02b-0a76-4fa6-af05-0b753486452a tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:36.085422 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a217b02b-0a76-4fa6-af05-0b753486452a tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:36.086110 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a217b02b-0a76-4fa6-af05-0b753486452a tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:09:36.086655 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a217b02b-0a76-4fa6-af05-0b753486452a tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:09:36.087117 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a217b02b-0a76-4fa6-af05-0b753486452a tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:09:36.157275 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a217b02b-0a76-4fa6-af05-0b753486452a tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "POST /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d/action" status: 200 len: 24572 microversion: 2.1 time: 0.090876 Aug 31 17:09:36.158041 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3872/7562] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 17:09:36 2022] POST /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d/action => generated 24572 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 17:10:15.231513 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:10:15.232277 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=36 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:10:15.233166 n-d-833090-16 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 17:10:15.233324 n-d-833090-16 devstack@n-api.service[128863]: Wed Aug 31 17:10:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d/action (ip 10.222.0.50) !!! Aug 31 17:10:15.238854 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2ed8553a-def4-480d-b22c-4858059b01c6 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:10:15.241098 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2ed8553a-def4-480d-b22c-4858059b01c6 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 459cf2b9-c7f6-4c4b-8686-804ac69dfe7d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:10:15.250322 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ed8553a-def4-480d-b22c-4858059b01c6 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:15.250812 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ed8553a-def4-480d-b22c-4858059b01c6 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:15.251229 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ed8553a-def4-480d-b22c-4858059b01c6 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:15.251926 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ed8553a-def4-480d-b22c-4858059b01c6 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:15.252405 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ed8553a-def4-480d-b22c-4858059b01c6 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:15.252827 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ed8553a-def4-480d-b22c-4858059b01c6 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:15.333433 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2ed8553a-def4-480d-b22c-4858059b01c6 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "POST /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d/action" status: 202 len: 0 microversion: 2.1 time: 0.104787 Aug 31 17:10:15.334201 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3691/7563] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 17:10:15 2022] POST /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:10:15.346279 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f2a0523c-e9ae-4967-a01e-f7aee13c4f62 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:10:15.347005 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f2a0523c-e9ae-4967-a01e-f7aee13c4f62 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 459cf2b9-c7f6-4c4b-8686-804ac69dfe7d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:10:15.349782 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:10:15.350489 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=4 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:10:15.363236 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f2a0523c-e9ae-4967-a01e-f7aee13c4f62 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:15.363738 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f2a0523c-e9ae-4967-a01e-f7aee13c4f62 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:15.364187 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f2a0523c-e9ae-4967-a01e-f7aee13c4f62 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:15.364970 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f2a0523c-e9ae-4967-a01e-f7aee13c4f62 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:15.365433 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f2a0523c-e9ae-4967-a01e-f7aee13c4f62 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:15.365870 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f2a0523c-e9ae-4967-a01e-f7aee13c4f62 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:15.572857 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f2a0523c-e9ae-4967-a01e-f7aee13c4f62 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:10:15.581985 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f2a0523c-e9ae-4967-a01e-f7aee13c4f62 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d" status: 200 len: 1674 microversion: 2.1 time: 0.240150 Aug 31 17:10:15.586187 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3873/7564] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:10:15 2022] GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d => generated 1674 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:10:16.606678 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8a155ad1-8faf-487b-a48e-f26686136780 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:10:16.607423 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8a155ad1-8faf-487b-a48e-f26686136780 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 459cf2b9-c7f6-4c4b-8686-804ac69dfe7d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:10:16.614419 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a155ad1-8faf-487b-a48e-f26686136780 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:16.614949 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a155ad1-8faf-487b-a48e-f26686136780 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:16.615510 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a155ad1-8faf-487b-a48e-f26686136780 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:16.616332 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a155ad1-8faf-487b-a48e-f26686136780 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:16.616862 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a155ad1-8faf-487b-a48e-f26686136780 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:16.617356 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a155ad1-8faf-487b-a48e-f26686136780 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:16.831234 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8a155ad1-8faf-487b-a48e-f26686136780 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:10:16.842405 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8a155ad1-8faf-487b-a48e-f26686136780 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d" status: 200 len: 1679 microversion: 2.1 time: 0.243065 Aug 31 17:10:16.842996 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3692/7565] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:10:16 2022] GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d => generated 1679 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:10:17.872935 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e37abe3e-4dab-42a9-a4ad-bb2a63e19a8d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:10:17.876656 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e37abe3e-4dab-42a9-a4ad-bb2a63e19a8d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 459cf2b9-c7f6-4c4b-8686-804ac69dfe7d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:10:17.882463 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e37abe3e-4dab-42a9-a4ad-bb2a63e19a8d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:17.882972 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e37abe3e-4dab-42a9-a4ad-bb2a63e19a8d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:17.883430 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e37abe3e-4dab-42a9-a4ad-bb2a63e19a8d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:17.884155 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e37abe3e-4dab-42a9-a4ad-bb2a63e19a8d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:17.884622 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e37abe3e-4dab-42a9-a4ad-bb2a63e19a8d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:17.885062 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e37abe3e-4dab-42a9-a4ad-bb2a63e19a8d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:18.023946 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e37abe3e-4dab-42a9-a4ad-bb2a63e19a8d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:10:18.033954 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e37abe3e-4dab-42a9-a4ad-bb2a63e19a8d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d" status: 200 len: 1679 microversion: 2.1 time: 0.164959 Aug 31 17:10:18.034816 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3874/7566] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:10:17 2022] GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:10:19.059577 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-79f8545a-f7bd-4a01-9a4e-e8c2331df9f1 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:10:19.060185 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-79f8545a-f7bd-4a01-9a4e-e8c2331df9f1 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 459cf2b9-c7f6-4c4b-8686-804ac69dfe7d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:10:19.067553 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79f8545a-f7bd-4a01-9a4e-e8c2331df9f1 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:19.068041 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79f8545a-f7bd-4a01-9a4e-e8c2331df9f1 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:19.068483 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79f8545a-f7bd-4a01-9a4e-e8c2331df9f1 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:19.069169 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79f8545a-f7bd-4a01-9a4e-e8c2331df9f1 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:19.069655 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79f8545a-f7bd-4a01-9a4e-e8c2331df9f1 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:19.070073 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79f8545a-f7bd-4a01-9a4e-e8c2331df9f1 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:19.220822 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-79f8545a-f7bd-4a01-9a4e-e8c2331df9f1 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:10:19.232784 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-79f8545a-f7bd-4a01-9a4e-e8c2331df9f1 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d" status: 200 len: 1679 microversion: 2.1 time: 0.178947 Aug 31 17:10:19.233656 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3693/7567] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:10:19 2022] GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d => generated 1679 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:10:20.262404 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-cdffa384-4743-4476-a4f6-6695f9dbb736 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:10:20.263229 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-cdffa384-4743-4476-a4f6-6695f9dbb736 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 459cf2b9-c7f6-4c4b-8686-804ac69dfe7d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:10:20.271791 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cdffa384-4743-4476-a4f6-6695f9dbb736 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:20.272466 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cdffa384-4743-4476-a4f6-6695f9dbb736 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:20.273185 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cdffa384-4743-4476-a4f6-6695f9dbb736 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:20.274457 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cdffa384-4743-4476-a4f6-6695f9dbb736 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:20.274965 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cdffa384-4743-4476-a4f6-6695f9dbb736 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:20.275409 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cdffa384-4743-4476-a4f6-6695f9dbb736 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:20.439996 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-cdffa384-4743-4476-a4f6-6695f9dbb736 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:10:20.449045 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-cdffa384-4743-4476-a4f6-6695f9dbb736 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d" status: 200 len: 1679 microversion: 2.1 time: 0.192762 Aug 31 17:10:20.449706 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3875/7568] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:10:20 2022] GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d => generated 1679 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:10:21.475464 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0ebc3a79-200b-489f-943e-3cf8c1841080 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:10:21.476097 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0ebc3a79-200b-489f-943e-3cf8c1841080 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 459cf2b9-c7f6-4c4b-8686-804ac69dfe7d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:10:21.484134 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ebc3a79-200b-489f-943e-3cf8c1841080 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:21.484676 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ebc3a79-200b-489f-943e-3cf8c1841080 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:21.485112 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ebc3a79-200b-489f-943e-3cf8c1841080 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:21.485957 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ebc3a79-200b-489f-943e-3cf8c1841080 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:21.486448 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ebc3a79-200b-489f-943e-3cf8c1841080 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:21.486872 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0ebc3a79-200b-489f-943e-3cf8c1841080 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:21.627921 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0ebc3a79-200b-489f-943e-3cf8c1841080 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:10:21.636033 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0ebc3a79-200b-489f-943e-3cf8c1841080 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d" status: 200 len: 1679 microversion: 2.1 time: 0.164594 Aug 31 17:10:21.636668 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3694/7569] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:10:21 2022] GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:10:22.659387 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-981b2a33-8724-4eba-8a94-65c814e1a9c4 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:10:22.660054 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-981b2a33-8724-4eba-8a94-65c814e1a9c4 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 459cf2b9-c7f6-4c4b-8686-804ac69dfe7d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:10:22.667195 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-981b2a33-8724-4eba-8a94-65c814e1a9c4 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:22.667666 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-981b2a33-8724-4eba-8a94-65c814e1a9c4 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:22.668108 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-981b2a33-8724-4eba-8a94-65c814e1a9c4 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:22.669029 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-981b2a33-8724-4eba-8a94-65c814e1a9c4 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:22.669270 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-981b2a33-8724-4eba-8a94-65c814e1a9c4 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:22.669691 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-981b2a33-8724-4eba-8a94-65c814e1a9c4 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:22.815291 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-981b2a33-8724-4eba-8a94-65c814e1a9c4 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:10:22.823934 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-981b2a33-8724-4eba-8a94-65c814e1a9c4 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d" status: 200 len: 1679 microversion: 2.1 time: 0.168748 Aug 31 17:10:22.824798 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3876/7570] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:10:22 2022] GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:10:23.849497 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-89cba8a2-b942-4be3-a71c-4f5defa2b860 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:10:23.850320 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-89cba8a2-b942-4be3-a71c-4f5defa2b860 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 459cf2b9-c7f6-4c4b-8686-804ac69dfe7d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:10:23.860090 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-89cba8a2-b942-4be3-a71c-4f5defa2b860 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:23.860999 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-89cba8a2-b942-4be3-a71c-4f5defa2b860 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:23.861439 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-89cba8a2-b942-4be3-a71c-4f5defa2b860 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:23.862148 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-89cba8a2-b942-4be3-a71c-4f5defa2b860 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:23.862609 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-89cba8a2-b942-4be3-a71c-4f5defa2b860 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:23.863048 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-89cba8a2-b942-4be3-a71c-4f5defa2b860 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:24.011612 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-89cba8a2-b942-4be3-a71c-4f5defa2b860 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:10:24.021407 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-89cba8a2-b942-4be3-a71c-4f5defa2b860 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d" status: 200 len: 1679 microversion: 2.1 time: 0.179302 Aug 31 17:10:24.021988 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3695/7571] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:10:23 2022] GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d => generated 1679 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:10:25.126506 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c20c7624-244f-41f3-be5d-f2e0fdf2f0be tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:10:25.127133 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c20c7624-244f-41f3-be5d-f2e0fdf2f0be tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 459cf2b9-c7f6-4c4b-8686-804ac69dfe7d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:10:25.134689 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c20c7624-244f-41f3-be5d-f2e0fdf2f0be tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:25.135186 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c20c7624-244f-41f3-be5d-f2e0fdf2f0be tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:25.135629 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c20c7624-244f-41f3-be5d-f2e0fdf2f0be tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:25.136341 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c20c7624-244f-41f3-be5d-f2e0fdf2f0be tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:25.136805 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c20c7624-244f-41f3-be5d-f2e0fdf2f0be tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:25.137232 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c20c7624-244f-41f3-be5d-f2e0fdf2f0be tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:25.293702 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c20c7624-244f-41f3-be5d-f2e0fdf2f0be tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:10:25.303054 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c20c7624-244f-41f3-be5d-f2e0fdf2f0be tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d" status: 200 len: 1679 microversion: 2.1 time: 0.180601 Aug 31 17:10:25.303892 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3877/7572] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:10:25 2022] GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d => generated 1679 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:10:26.325723 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-58d02991-a2bb-4f7b-a22b-7ac5580ea9c4 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:10:26.326418 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-58d02991-a2bb-4f7b-a22b-7ac5580ea9c4 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 459cf2b9-c7f6-4c4b-8686-804ac69dfe7d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:10:26.334261 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58d02991-a2bb-4f7b-a22b-7ac5580ea9c4 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:26.334742 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58d02991-a2bb-4f7b-a22b-7ac5580ea9c4 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:26.335176 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58d02991-a2bb-4f7b-a22b-7ac5580ea9c4 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:26.335865 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58d02991-a2bb-4f7b-a22b-7ac5580ea9c4 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:26.336314 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58d02991-a2bb-4f7b-a22b-7ac5580ea9c4 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:26.336728 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-58d02991-a2bb-4f7b-a22b-7ac5580ea9c4 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:26.472967 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-58d02991-a2bb-4f7b-a22b-7ac5580ea9c4 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:10:26.481264 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-58d02991-a2bb-4f7b-a22b-7ac5580ea9c4 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d" status: 200 len: 1679 microversion: 2.1 time: 0.159990 Aug 31 17:10:26.481837 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3696/7573] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:10:26 2022] GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:10:27.503731 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c0d4e4eb-6448-4579-af7a-027d2d3b9189 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:10:27.504793 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c0d4e4eb-6448-4579-af7a-027d2d3b9189 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 459cf2b9-c7f6-4c4b-8686-804ac69dfe7d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:10:27.511886 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c0d4e4eb-6448-4579-af7a-027d2d3b9189 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:27.512385 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c0d4e4eb-6448-4579-af7a-027d2d3b9189 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:27.512829 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c0d4e4eb-6448-4579-af7a-027d2d3b9189 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:27.513539 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c0d4e4eb-6448-4579-af7a-027d2d3b9189 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:27.514005 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c0d4e4eb-6448-4579-af7a-027d2d3b9189 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:27.514473 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c0d4e4eb-6448-4579-af7a-027d2d3b9189 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:27.653162 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c0d4e4eb-6448-4579-af7a-027d2d3b9189 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:10:27.661967 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c0d4e4eb-6448-4579-af7a-027d2d3b9189 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d" status: 200 len: 1679 microversion: 2.1 time: 0.162416 Aug 31 17:10:27.662587 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3878/7574] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:10:27 2022] GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:10:28.684532 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cb812227-d094-4dd1-8b32-024e7e6e1533 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:10:28.685131 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cb812227-d094-4dd1-8b32-024e7e6e1533 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 459cf2b9-c7f6-4c4b-8686-804ac69dfe7d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:10:28.693318 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb812227-d094-4dd1-8b32-024e7e6e1533 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:28.693799 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb812227-d094-4dd1-8b32-024e7e6e1533 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:28.694280 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb812227-d094-4dd1-8b32-024e7e6e1533 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:28.694980 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb812227-d094-4dd1-8b32-024e7e6e1533 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:28.695473 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb812227-d094-4dd1-8b32-024e7e6e1533 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:28.695896 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb812227-d094-4dd1-8b32-024e7e6e1533 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:28.841814 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cb812227-d094-4dd1-8b32-024e7e6e1533 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:10:28.849989 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cb812227-d094-4dd1-8b32-024e7e6e1533 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d" status: 200 len: 1679 microversion: 2.1 time: 0.169492 Aug 31 17:10:28.850636 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3697/7575] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:10:28 2022] GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:10:29.872554 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e6d1d07a-000b-486f-9401-90766cbc18c8 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:10:29.873176 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e6d1d07a-000b-486f-9401-90766cbc18c8 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 459cf2b9-c7f6-4c4b-8686-804ac69dfe7d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:10:29.880917 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6d1d07a-000b-486f-9401-90766cbc18c8 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:29.881421 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6d1d07a-000b-486f-9401-90766cbc18c8 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:29.881866 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6d1d07a-000b-486f-9401-90766cbc18c8 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:29.882618 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6d1d07a-000b-486f-9401-90766cbc18c8 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:29.883085 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6d1d07a-000b-486f-9401-90766cbc18c8 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:29.883524 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6d1d07a-000b-486f-9401-90766cbc18c8 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:30.028239 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e6d1d07a-000b-486f-9401-90766cbc18c8 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:10:30.036541 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e6d1d07a-000b-486f-9401-90766cbc18c8 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d" status: 200 len: 1679 microversion: 2.1 time: 0.168365 Aug 31 17:10:30.037296 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3879/7576] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:10:29 2022] GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:10:31.059647 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-70272329-2cd5-4dd6-8d2a-cc4698a0238e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:10:31.060287 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-70272329-2cd5-4dd6-8d2a-cc4698a0238e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 459cf2b9-c7f6-4c4b-8686-804ac69dfe7d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:10:31.071178 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70272329-2cd5-4dd6-8d2a-cc4698a0238e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:31.071687 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70272329-2cd5-4dd6-8d2a-cc4698a0238e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:31.072100 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70272329-2cd5-4dd6-8d2a-cc4698a0238e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:31.072845 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70272329-2cd5-4dd6-8d2a-cc4698a0238e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:31.073310 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70272329-2cd5-4dd6-8d2a-cc4698a0238e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:31.073732 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70272329-2cd5-4dd6-8d2a-cc4698a0238e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:31.230875 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-70272329-2cd5-4dd6-8d2a-cc4698a0238e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:10:31.239070 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-70272329-2cd5-4dd6-8d2a-cc4698a0238e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d" status: 200 len: 1679 microversion: 2.1 time: 0.183479 Aug 31 17:10:31.239650 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3698/7577] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:10:31 2022] GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d => generated 1679 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:10:32.262612 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c3df144d-965c-4595-9c14-254d6b389a10 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:10:32.263462 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c3df144d-965c-4595-9c14-254d6b389a10 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 459cf2b9-c7f6-4c4b-8686-804ac69dfe7d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:10:32.271565 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3df144d-965c-4595-9c14-254d6b389a10 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:32.272061 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3df144d-965c-4595-9c14-254d6b389a10 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:32.272513 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3df144d-965c-4595-9c14-254d6b389a10 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:32.273198 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3df144d-965c-4595-9c14-254d6b389a10 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:10:32.273655 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3df144d-965c-4595-9c14-254d6b389a10 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:10:32.274082 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3df144d-965c-4595-9c14-254d6b389a10 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:10:32.411801 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c3df144d-965c-4595-9c14-254d6b389a10 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:10:32.420042 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c3df144d-965c-4595-9c14-254d6b389a10 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d" status: 200 len: 1682 microversion: 2.1 time: 0.161534 Aug 31 17:10:32.420671 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3880/7578] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:10:32 2022] GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:11:06.683145 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9a9cd005-c3be-4ff7-81b6-faf06224281a tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:11:06.685670 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9a9cd005-c3be-4ff7-81b6-faf06224281a tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 459cf2b9-c7f6-4c4b-8686-804ac69dfe7d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:11:06.688086 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=16 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:11:06.688776 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:11:06.694912 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a9cd005-c3be-4ff7-81b6-faf06224281a tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:06.695390 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a9cd005-c3be-4ff7-81b6-faf06224281a tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:06.695818 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a9cd005-c3be-4ff7-81b6-faf06224281a tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:06.696505 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a9cd005-c3be-4ff7-81b6-faf06224281a tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:06.696949 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a9cd005-c3be-4ff7-81b6-faf06224281a tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:06.697359 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9a9cd005-c3be-4ff7-81b6-faf06224281a tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:06.772709 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9a9cd005-c3be-4ff7-81b6-faf06224281a tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "POST /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d/action" status: 200 len: 69134 microversion: 2.1 time: 0.093412 Aug 31 17:11:06.773533 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3699/7579] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 17:11:06 2022] POST /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d/action => generated 69134 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 17:11:30.701100 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2eda06b1-8748-4f75-b7e1-ff750969e760 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:11:30.701646 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2eda06b1-8748-4f75-b7e1-ff750969e760 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 459cf2b9-c7f6-4c4b-8686-804ac69dfe7d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:11:30.706560 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=16 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:11:30.707478 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=48 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:11:30.710352 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:11:30.712429 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:11:30.712669 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2eda06b1-8748-4f75-b7e1-ff750969e760 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:30.713367 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2eda06b1-8748-4f75-b7e1-ff750969e760 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:30.713896 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2eda06b1-8748-4f75-b7e1-ff750969e760 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:30.714704 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2eda06b1-8748-4f75-b7e1-ff750969e760 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:30.715353 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2eda06b1-8748-4f75-b7e1-ff750969e760 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:30.715904 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2eda06b1-8748-4f75-b7e1-ff750969e760 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:30.743149 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2eda06b1-8748-4f75-b7e1-ff750969e760 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 459cf2b9-c7f6-4c4b-8686-804ac69dfe7d] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 17:11:30.770685 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-343f210c-e91e-4bf0-8c67-3927813ff2e0 req-ec62e9c6-5043-437c-b4e3-ad3766f2fe16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "459cf2b9-c7f6-4c4b-8686-804ac69dfe7d", "tag": "f56208e8-bc93-42bb-9067-2b4eff9dd422"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:11:30.783153 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-343f210c-e91e-4bf0-8c67-3927813ff2e0 req-ec62e9c6-5043-437c-b4e3-ad3766f2fe16 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:30.783660 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-343f210c-e91e-4bf0-8c67-3927813ff2e0 req-ec62e9c6-5043-437c-b4e3-ad3766f2fe16 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:30.784264 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-343f210c-e91e-4bf0-8c67-3927813ff2e0 req-ec62e9c6-5043-437c-b4e3-ad3766f2fe16 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:30.796869 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-343f210c-e91e-4bf0-8c67-3927813ff2e0 req-ec62e9c6-5043-437c-b4e3-ad3766f2fe16 service nova] Creating event network-changed:f56208e8-bc93-42bb-9067-2b4eff9dd422 for instance 459cf2b9-c7f6-4c4b-8686-804ac69dfe7d on n-h2-833090-16 Aug 31 17:11:30.803433 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-343f210c-e91e-4bf0-8c67-3927813ff2e0 req-ec62e9c6-5043-437c-b4e3-ad3766f2fe16 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098433 Aug 31 17:11:30.804253 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3700/7580] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:11:30.827004 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2eda06b1-8748-4f75-b7e1-ff750969e760 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "DELETE /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d" status: 204 len: 0 microversion: 2.1 time: 0.130297 Aug 31 17:11:30.827608 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3881/7581] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 17:11:30 2022] DELETE /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 17:11:30.839313 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2fee2689-ac91-46e1-a710-c4d8b5060f07 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:11:30.841429 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2fee2689-ac91-46e1-a710-c4d8b5060f07 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 459cf2b9-c7f6-4c4b-8686-804ac69dfe7d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:11:30.848810 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2fee2689-ac91-46e1-a710-c4d8b5060f07 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:30.849596 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2fee2689-ac91-46e1-a710-c4d8b5060f07 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:30.850350 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2fee2689-ac91-46e1-a710-c4d8b5060f07 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:30.851214 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2fee2689-ac91-46e1-a710-c4d8b5060f07 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:30.851953 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2fee2689-ac91-46e1-a710-c4d8b5060f07 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:30.852081 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2fee2689-ac91-46e1-a710-c4d8b5060f07 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:30.996966 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2fee2689-ac91-46e1-a710-c4d8b5060f07 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:11:31.005203 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2fee2689-ac91-46e1-a710-c4d8b5060f07 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d" status: 200 len: 1688 microversion: 2.1 time: 0.171994 Aug 31 17:11:31.006085 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3701/7582] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:11:30 2022] GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d => generated 1688 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:11:32.029946 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ade5ac6a-2aeb-4da9-b637-dfbe422b4195 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:11:32.030565 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ade5ac6a-2aeb-4da9-b637-dfbe422b4195 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 459cf2b9-c7f6-4c4b-8686-804ac69dfe7d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:11:32.038389 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ade5ac6a-2aeb-4da9-b637-dfbe422b4195 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:32.038887 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ade5ac6a-2aeb-4da9-b637-dfbe422b4195 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:32.039334 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ade5ac6a-2aeb-4da9-b637-dfbe422b4195 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:32.040042 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ade5ac6a-2aeb-4da9-b637-dfbe422b4195 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:32.040504 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ade5ac6a-2aeb-4da9-b637-dfbe422b4195 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:32.040939 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ade5ac6a-2aeb-4da9-b637-dfbe422b4195 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:32.189334 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ade5ac6a-2aeb-4da9-b637-dfbe422b4195 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:11:32.203451 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ade5ac6a-2aeb-4da9-b637-dfbe422b4195 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d" status: 200 len: 1688 microversion: 2.1 time: 0.178050 Aug 31 17:11:32.204230 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3882/7583] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:11:32 2022] GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d => generated 1688 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:11:33.229184 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-38f57265-931d-4b68-b193-ce7d1af95d87 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:11:33.229760 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-38f57265-931d-4b68-b193-ce7d1af95d87 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 459cf2b9-c7f6-4c4b-8686-804ac69dfe7d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:11:33.238223 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38f57265-931d-4b68-b193-ce7d1af95d87 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:33.238879 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38f57265-931d-4b68-b193-ce7d1af95d87 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:33.239141 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38f57265-931d-4b68-b193-ce7d1af95d87 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:33.242499 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38f57265-931d-4b68-b193-ce7d1af95d87 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:33.242499 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38f57265-931d-4b68-b193-ce7d1af95d87 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:33.242499 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-38f57265-931d-4b68-b193-ce7d1af95d87 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:33.309568 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-38f57265-931d-4b68-b193-ce7d1af95d87 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:11:33.318981 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-38f57265-931d-4b68-b193-ce7d1af95d87 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d" status: 200 len: 1502 microversion: 2.1 time: 0.093240 Aug 31 17:11:33.319749 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3702/7584] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:11:33 2022] GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d => generated 1502 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:11:33.379665 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-c03b32a3-8400-474f-9faa-73e3520a8e58 req-0f0d9104-b736-48e8-acf9-d6e619a0b028 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "459cf2b9-c7f6-4c4b-8686-804ac69dfe7d", "name": "network-vif-deleted", "tag": "f56208e8-bc93-42bb-9067-2b4eff9dd422"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:11:33.390019 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-c03b32a3-8400-474f-9faa-73e3520a8e58 req-0f0d9104-b736-48e8-acf9-d6e619a0b028 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:33.390450 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-c03b32a3-8400-474f-9faa-73e3520a8e58 req-0f0d9104-b736-48e8-acf9-d6e619a0b028 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:33.390926 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-c03b32a3-8400-474f-9faa-73e3520a8e58 req-0f0d9104-b736-48e8-acf9-d6e619a0b028 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:33.403325 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-c03b32a3-8400-474f-9faa-73e3520a8e58 req-0f0d9104-b736-48e8-acf9-d6e619a0b028 service nova] Creating event network-vif-deleted:f56208e8-bc93-42bb-9067-2b4eff9dd422 for instance 459cf2b9-c7f6-4c4b-8686-804ac69dfe7d on n-h2-833090-16 Aug 31 17:11:33.409056 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-c03b32a3-8400-474f-9faa-73e3520a8e58 req-0f0d9104-b736-48e8-acf9-d6e619a0b028 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100978 Aug 31 17:11:33.409678 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3883/7585] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:11:34.344497 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a1bd59d3-f1a1-4e01-a523-8584bfa96ea4 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:11:34.345133 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a1bd59d3-f1a1-4e01-a523-8584bfa96ea4 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 459cf2b9-c7f6-4c4b-8686-804ac69dfe7d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:11:34.352467 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1bd59d3-f1a1-4e01-a523-8584bfa96ea4 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:34.352947 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1bd59d3-f1a1-4e01-a523-8584bfa96ea4 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:34.353408 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1bd59d3-f1a1-4e01-a523-8584bfa96ea4 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:34.354126 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1bd59d3-f1a1-4e01-a523-8584bfa96ea4 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:34.354663 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1bd59d3-f1a1-4e01-a523-8584bfa96ea4 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:34.355084 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a1bd59d3-f1a1-4e01-a523-8584bfa96ea4 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:34.369586 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-a1bd59d3-f1a1-4e01-a523-8584bfa96ea4 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] HTTP exception thrown: Instance 459cf2b9-c7f6-4c4b-8686-804ac69dfe7d could not be found. Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a1bd59d3-f1a1-4e01-a523-8584bfa96ea4 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Request method failure captured: Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d HTTP/1.1 Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD5UwnC35Vn5evFApyVfskHdEHcvv0VSRxaZ9pzKW96Fqt51iHq5jLe56IGhM36ZgCFwb3_2IfN9Wxbd_wUAkzwS08XpxCxoP856myVMcw20sYLpddPhTMaAFpoi0Qlpqj4GXCEBMwRUEqexdDDa6EuUjH1_09epMJ_p9WzfxJnmlCRg Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: a6f813017c8c40d5978c8550f188dbf7 Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1147621593 Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a6f813017c8c40d5978c8550f188dbf7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a6f813017c8c40d5978c8550f188dbf7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a6f813017c8c40d5978c8550f188dbf7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a6f813017c8c40d5978c8550f188dbf7", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1147621593 Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: a6f813017c8c40d5978c8550f188dbf7 Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1147621593 Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-TestNetworkAdvancedServerOps-1147621593-project Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: a18fb2c4e622474d943a72025236cca7 Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1147621593-project Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 459cf2b9-c7f6-4c4b-8686-804ac69dfe7d could not be found. Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '459cf2b9-c7f6-4c4b-8686-804ac69dfe7d'} Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 459cf2b9-c7f6-4c4b-8686-804ac69dfe7d could not be found. Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 459cf2b9-c7f6-4c4b-8686-804ac69dfe7d could not be found. Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 17:11:34.371294 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:11:34.376440 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 17:11:34.376440 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:11:34.376440 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:11:34.376440 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:11:34.376440 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 17:11:34.376440 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 17:11:34.376440 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 459cf2b9-c7f6-4c4b-8686-804ac69dfe7d could not be found. Aug 31 17:11:34.376440 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 17:11:34.376440 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a1bd59d3-f1a1-4e01-a523-8584bfa96ea4 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Returning 404 to user: Instance 459cf2b9-c7f6-4c4b-8686-804ac69dfe7d could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 17:11:34.376440 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a1bd59d3-f1a1-4e01-a523-8584bfa96ea4 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d" status: 404 len: 111 microversion: 2.1 time: 0.033838 Aug 31 17:11:34.376440 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3703/7586] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:11:34 2022] GET /compute/v2.1/servers/459cf2b9-c7f6-4c4b-8686-804ac69dfe7d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 17:11:37.802375 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-79c9dce4-1520-4fb3-8de8-7969223c2ec3 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '.version_select at 0x7fbb46184d30>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:11:37.807442 n-d-833090-16 devstack@n-api.service[128864]: ERROR oslo.messaging._drivers.impl_rabbit [None req-79c9dce4-1520-4fb3-8de8-7969223c2ec3 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [178b73f2-a464-4c5c-bbc3-290eb235843a] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 17:11:38.818780 n-d-833090-16 devstack@n-api.service[128864]: INFO oslo.messaging._drivers.impl_rabbit [None req-79c9dce4-1520-4fb3-8de8-7969223c2ec3 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [178b73f2-a464-4c5c-bbc3-290eb235843a] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 51946. Aug 31 17:11:38.844636 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-79c9dce4-1520-4fb3-8de8-7969223c2ec3 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-784831011" status: 202 len: 0 microversion: 2.1 time: 1.046172 Aug 31 17:11:38.845827 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3884/7587] 10.222.0.50 () {58 vars in 1281 bytes} [Wed Aug 31 17:11:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-784831011 => generated 0 bytes in 1049 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:11:38.875224 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d6033312-4acb-4644-b126-1c02dd987d10 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Action: 'create', calling method: .version_select at 0x7fbb466bb9d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1534874461", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPidpo4XI74bBCMP3PQrmUX6AI+EyY5+RkjfyMrUeG0ZVkX3s4FyX9noX+EKiKe0W+p8Aciv2nmCnesrNDpl+38+aopnMk/JJimlbGMVpfwlokkGzHNmJrXPVLh81FKGw=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:11:38.893282 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-d6033312-4acb-4644-b126-1c02dd987d10 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Getting quotas for project a6f813017c8c40d5978c8550f188dbf7. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 17:11:38.899884 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-d6033312-4acb-4644-b126-1c02dd987d10 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Getting quotas for user a18fb2c4e622474d943a72025236cca7 and project a6f813017c8c40d5978c8550f188dbf7. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 17:11:38.914715 n-d-833090-16 devstack@n-api.service[128863]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d6033312-4acb-4644-b126-1c02dd987d10 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [20597d35-4b4e-4ea0-93ee-0a08dc793a48] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 17:11:39.923118 n-d-833090-16 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [None req-d6033312-4acb-4644-b126-1c02dd987d10 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [20597d35-4b4e-4ea0-93ee-0a08dc793a48] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 51950. Aug 31 17:11:39.940528 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d6033312-4acb-4644-b126-1c02dd987d10 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 1.069867 Aug 31 17:11:39.941137 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3704/7588] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 31 17:11:38 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:11:45.944402 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:11:45.949094 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c8e09f00-a82f-45e2-ba64-073afb016130 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1250080308", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "91bd832a-a7a1-4bf6-852a-840fe00f72b5"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1534874461", "security_groups": [{"name": "tempest-secgroup-smoke-1038122713"}]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:11:46.070232 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-c8e09f00-a82f-45e2-ba64-073afb016130 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] validate_networks() for [('91bd832a-a7a1-4bf6-852a-840fe00f72b5', None, None, None, None, None)] {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 17:11:46.535960 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-c8e09f00-a82f-45e2-ba64-073afb016130 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 17:11:46.536393 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-c8e09f00-a82f-45e2-ba64-073afb016130 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 17:11:46.536868 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-c8e09f00-a82f-45e2-ba64-073afb016130 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 17:11:46.537281 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-c8e09f00-a82f-45e2-ba64-073afb016130 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 17:11:46.537701 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-c8e09f00-a82f-45e2-ba64-073afb016130 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 17:11:46.551816 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8e09f00-a82f-45e2-ba64-073afb016130 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:46.552595 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8e09f00-a82f-45e2-ba64-073afb016130 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:46.553135 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8e09f00-a82f-45e2-ba64-073afb016130 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:46.554020 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8e09f00-a82f-45e2-ba64-073afb016130 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:46.554775 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8e09f00-a82f-45e2-ba64-073afb016130 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:46.555474 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c8e09f00-a82f-45e2-ba64-073afb016130 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:46.574528 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-c8e09f00-a82f-45e2-ba64-073afb016130 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Getting quotas for project a6f813017c8c40d5978c8550f188dbf7. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 17:11:46.582246 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-c8e09f00-a82f-45e2-ba64-073afb016130 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Getting quotas for user a18fb2c4e622474d943a72025236cca7 and project a6f813017c8c40d5978c8550f188dbf7. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 17:11:46.596985 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c8e09f00-a82f-45e2-ba64-073afb016130 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 17:11:46.599482 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c8e09f00-a82f-45e2-ba64-073afb016130 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ffe37a38-8054-4a4a-acd7-4ee824fb6e1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 17:11:46.649408 n-d-833090-16 devstack@n-api.service[128864]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c8e09f00-a82f-45e2-ba64-073afb016130 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [f9b5357a-7b17-4db0-90cc-a76a5ade09b1] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 17:11:47.657931 n-d-833090-16 devstack@n-api.service[128864]: INFO oslo.messaging._drivers.impl_rabbit [None req-c8e09f00-a82f-45e2-ba64-073afb016130 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [f9b5357a-7b17-4db0-90cc-a76a5ade09b1] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 51996. Aug 31 17:11:47.663108 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c8e09f00-a82f-45e2-ba64-073afb016130 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.720703 Aug 31 17:11:47.664571 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3885/7589] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 17:11:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 1723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 17:11:47.676320 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f7347933-dd50-40ee-8dbe-be2208aa7ca4 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:11:47.677427 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f7347933-dd50-40ee-8dbe-be2208aa7ca4 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ffe37a38-8054-4a4a-acd7-4ee824fb6e1d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:11:47.683867 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=16 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:11:47.739328 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f7347933-dd50-40ee-8dbe-be2208aa7ca4 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:11:47.748196 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f7347933-dd50-40ee-8dbe-be2208aa7ca4 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d" status: 200 len: 1267 microversion: 2.1 time: 0.076015 Aug 31 17:11:47.748562 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3705/7590] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:11:47 2022] GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d => generated 1267 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:11:48.769026 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a5d63588-8cd8-4857-b54c-61dc00609701 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:11:48.769691 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a5d63588-8cd8-4857-b54c-61dc00609701 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ffe37a38-8054-4a4a-acd7-4ee824fb6e1d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:11:48.831293 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a5d63588-8cd8-4857-b54c-61dc00609701 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:11:48.838813 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a5d63588-8cd8-4857-b54c-61dc00609701 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d" status: 200 len: 1267 microversion: 2.1 time: 0.073766 Aug 31 17:11:48.839414 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3886/7591] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:11:48 2022] GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d => generated 1267 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:11:49.860095 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dcc1f90b-2fe6-4bb0-bdeb-16eff3da94d4 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:11:49.861158 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dcc1f90b-2fe6-4bb0-bdeb-16eff3da94d4 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ffe37a38-8054-4a4a-acd7-4ee824fb6e1d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:11:49.925031 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dcc1f90b-2fe6-4bb0-bdeb-16eff3da94d4 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:11:49.932605 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dcc1f90b-2fe6-4bb0-bdeb-16eff3da94d4 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d" status: 200 len: 1267 microversion: 2.1 time: 0.076482 Aug 31 17:11:49.933438 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3706/7592] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:11:49 2022] GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d => generated 1267 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:11:50.959397 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fb718f32-ec72-4c11-a94a-6413c43e46a8 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:11:50.960350 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fb718f32-ec72-4c11-a94a-6413c43e46a8 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ffe37a38-8054-4a4a-acd7-4ee824fb6e1d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:11:51.025712 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-fb718f32-ec72-4c11-a94a-6413c43e46a8 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:11:51.033127 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fb718f32-ec72-4c11-a94a-6413c43e46a8 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d" status: 200 len: 1267 microversion: 2.1 time: 0.080777 Aug 31 17:11:51.034401 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3887/7593] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:11:50 2022] GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d => generated 1267 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:11:52.055039 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-79cd0083-479f-4d7e-8a95-b9ff6506750e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:11:52.055653 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-79cd0083-479f-4d7e-8a95-b9ff6506750e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ffe37a38-8054-4a4a-acd7-4ee824fb6e1d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:11:52.064293 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79cd0083-479f-4d7e-8a95-b9ff6506750e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:52.065046 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79cd0083-479f-4d7e-8a95-b9ff6506750e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:52.065592 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79cd0083-479f-4d7e-8a95-b9ff6506750e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:52.066805 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79cd0083-479f-4d7e-8a95-b9ff6506750e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:52.067521 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79cd0083-479f-4d7e-8a95-b9ff6506750e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:52.068167 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-79cd0083-479f-4d7e-8a95-b9ff6506750e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:52.137728 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-79cd0083-479f-4d7e-8a95-b9ff6506750e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:11:52.147116 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-79cd0083-479f-4d7e-8a95-b9ff6506750e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d" status: 200 len: 1271 microversion: 2.1 time: 0.096193 Aug 31 17:11:52.147726 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3707/7594] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:11:52 2022] GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d => generated 1271 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:11:53.168969 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2cf6d98c-6db1-4271-9e9d-c90ebc3d37fe tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:11:53.169593 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2cf6d98c-6db1-4271-9e9d-c90ebc3d37fe tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ffe37a38-8054-4a4a-acd7-4ee824fb6e1d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:11:53.178302 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2cf6d98c-6db1-4271-9e9d-c90ebc3d37fe tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:53.179277 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2cf6d98c-6db1-4271-9e9d-c90ebc3d37fe tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:53.179764 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2cf6d98c-6db1-4271-9e9d-c90ebc3d37fe tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:53.180490 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2cf6d98c-6db1-4271-9e9d-c90ebc3d37fe tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:53.181118 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2cf6d98c-6db1-4271-9e9d-c90ebc3d37fe tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:53.181713 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2cf6d98c-6db1-4271-9e9d-c90ebc3d37fe tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:53.254457 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2cf6d98c-6db1-4271-9e9d-c90ebc3d37fe tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:11:53.262643 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2cf6d98c-6db1-4271-9e9d-c90ebc3d37fe tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d" status: 200 len: 1325 microversion: 2.1 time: 0.097938 Aug 31 17:11:53.263226 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3888/7595] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:11:53 2022] GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d => generated 1325 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:11:54.284764 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f576e42b-6711-4f39-ad8b-f33c097794ab tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:11:54.285398 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f576e42b-6711-4f39-ad8b-f33c097794ab tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ffe37a38-8054-4a4a-acd7-4ee824fb6e1d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:11:54.292098 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f576e42b-6711-4f39-ad8b-f33c097794ab tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:54.292591 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f576e42b-6711-4f39-ad8b-f33c097794ab tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:54.293035 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f576e42b-6711-4f39-ad8b-f33c097794ab tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:54.293706 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f576e42b-6711-4f39-ad8b-f33c097794ab tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:54.294169 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f576e42b-6711-4f39-ad8b-f33c097794ab tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:54.294590 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f576e42b-6711-4f39-ad8b-f33c097794ab tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:54.433413 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f576e42b-6711-4f39-ad8b-f33c097794ab tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:11:54.442521 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f576e42b-6711-4f39-ad8b-f33c097794ab tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d" status: 200 len: 1393 microversion: 2.1 time: 0.161664 Aug 31 17:11:54.443168 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3708/7596] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:11:54 2022] GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d => generated 1393 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:11:54.601427 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-c4e91072-8836-4e6d-9229-1e91897b044b req-8878c64f-67e4-48ee-92fc-e0f7f9189acb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffe37a38-8054-4a4a-acd7-4ee824fb6e1d", "tag": "e0fd9522-ff37-4867-a550-f9d9d497dd7d"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:11:54.613918 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-c4e91072-8836-4e6d-9229-1e91897b044b req-8878c64f-67e4-48ee-92fc-e0f7f9189acb service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:54.614716 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-c4e91072-8836-4e6d-9229-1e91897b044b req-8878c64f-67e4-48ee-92fc-e0f7f9189acb service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:54.615259 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-c4e91072-8836-4e6d-9229-1e91897b044b req-8878c64f-67e4-48ee-92fc-e0f7f9189acb service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:54.629459 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-c4e91072-8836-4e6d-9229-1e91897b044b req-8878c64f-67e4-48ee-92fc-e0f7f9189acb service nova] Creating event network-changed:e0fd9522-ff37-4867-a550-f9d9d497dd7d for instance ffe37a38-8054-4a4a-acd7-4ee824fb6e1d on n-h2-833090-16 Aug 31 17:11:54.634714 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-c4e91072-8836-4e6d-9229-1e91897b044b req-8878c64f-67e4-48ee-92fc-e0f7f9189acb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038855 Aug 31 17:11:54.635348 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3889/7597] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:11:55.467505 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fd3f2834-aa72-4964-9178-493d643fccd3 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:11:55.468147 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fd3f2834-aa72-4964-9178-493d643fccd3 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ffe37a38-8054-4a4a-acd7-4ee824fb6e1d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:11:55.478288 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd3f2834-aa72-4964-9178-493d643fccd3 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:55.478776 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd3f2834-aa72-4964-9178-493d643fccd3 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:55.479209 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd3f2834-aa72-4964-9178-493d643fccd3 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:55.479917 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd3f2834-aa72-4964-9178-493d643fccd3 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:55.480363 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd3f2834-aa72-4964-9178-493d643fccd3 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:55.480780 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fd3f2834-aa72-4964-9178-493d643fccd3 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:55.620158 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fd3f2834-aa72-4964-9178-493d643fccd3 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:11:55.631952 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fd3f2834-aa72-4964-9178-493d643fccd3 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d" status: 200 len: 1393 microversion: 2.1 time: 0.170327 Aug 31 17:11:55.632848 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3709/7598] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:11:55 2022] GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d => generated 1393 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:11:56.660009 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:11:56.709240 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-927e6f2f-be2e-4e39-b33e-d5e965d7f2de tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:11:56.709967 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-927e6f2f-be2e-4e39-b33e-d5e965d7f2de tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ffe37a38-8054-4a4a-acd7-4ee824fb6e1d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:11:56.716524 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-927e6f2f-be2e-4e39-b33e-d5e965d7f2de tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:56.717027 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-927e6f2f-be2e-4e39-b33e-d5e965d7f2de tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:56.717478 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-927e6f2f-be2e-4e39-b33e-d5e965d7f2de tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:56.718219 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-927e6f2f-be2e-4e39-b33e-d5e965d7f2de tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:56.718687 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-927e6f2f-be2e-4e39-b33e-d5e965d7f2de tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:56.719131 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-927e6f2f-be2e-4e39-b33e-d5e965d7f2de tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:56.872533 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-927e6f2f-be2e-4e39-b33e-d5e965d7f2de tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:11:56.881101 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-927e6f2f-be2e-4e39-b33e-d5e965d7f2de tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d" status: 200 len: 1393 microversion: 2.1 time: 0.227497 Aug 31 17:11:56.881678 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3890/7599] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:11:56 2022] GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d => generated 1393 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:11:57.904032 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d67ce3d5-5e96-4360-8ac9-82ced2a6ff30 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:11:57.905233 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d67ce3d5-5e96-4360-8ac9-82ced2a6ff30 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ffe37a38-8054-4a4a-acd7-4ee824fb6e1d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:11:57.914025 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d67ce3d5-5e96-4360-8ac9-82ced2a6ff30 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:57.914547 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d67ce3d5-5e96-4360-8ac9-82ced2a6ff30 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:57.914995 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d67ce3d5-5e96-4360-8ac9-82ced2a6ff30 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:57.915705 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d67ce3d5-5e96-4360-8ac9-82ced2a6ff30 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:57.916327 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d67ce3d5-5e96-4360-8ac9-82ced2a6ff30 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:57.916915 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d67ce3d5-5e96-4360-8ac9-82ced2a6ff30 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:58.067544 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d67ce3d5-5e96-4360-8ac9-82ced2a6ff30 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:11:58.076001 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d67ce3d5-5e96-4360-8ac9-82ced2a6ff30 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d" status: 200 len: 1393 microversion: 2.1 time: 0.176364 Aug 31 17:11:58.076603 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3710/7600] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:11:57 2022] GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d => generated 1393 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:11:59.098479 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6bf547e5-ffb5-416e-9d2e-92873c239221 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:11:59.099157 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6bf547e5-ffb5-416e-9d2e-92873c239221 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ffe37a38-8054-4a4a-acd7-4ee824fb6e1d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:11:59.106463 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6bf547e5-ffb5-416e-9d2e-92873c239221 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:59.106960 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6bf547e5-ffb5-416e-9d2e-92873c239221 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:59.107403 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6bf547e5-ffb5-416e-9d2e-92873c239221 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:59.108113 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6bf547e5-ffb5-416e-9d2e-92873c239221 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:11:59.108573 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6bf547e5-ffb5-416e-9d2e-92873c239221 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:11:59.109001 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6bf547e5-ffb5-416e-9d2e-92873c239221 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:11:59.258422 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6bf547e5-ffb5-416e-9d2e-92873c239221 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:11:59.270423 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6bf547e5-ffb5-416e-9d2e-92873c239221 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d" status: 200 len: 1393 microversion: 2.1 time: 0.176387 Aug 31 17:11:59.270999 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3891/7601] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:11:59 2022] GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d => generated 1393 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:12:00.292359 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-78d1dba6-809f-4687-ae7f-96af90a96dbe tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:12:00.292975 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-78d1dba6-809f-4687-ae7f-96af90a96dbe tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ffe37a38-8054-4a4a-acd7-4ee824fb6e1d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:12:00.296146 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=8 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:12:00.301821 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78d1dba6-809f-4687-ae7f-96af90a96dbe tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:00.302345 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78d1dba6-809f-4687-ae7f-96af90a96dbe tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:00.302787 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78d1dba6-809f-4687-ae7f-96af90a96dbe tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:00.303498 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78d1dba6-809f-4687-ae7f-96af90a96dbe tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:00.303953 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78d1dba6-809f-4687-ae7f-96af90a96dbe tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:00.304379 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-78d1dba6-809f-4687-ae7f-96af90a96dbe tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:00.443311 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-78d1dba6-809f-4687-ae7f-96af90a96dbe tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:12:00.452653 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-78d1dba6-809f-4687-ae7f-96af90a96dbe tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d" status: 200 len: 1393 microversion: 2.1 time: 0.164299 Aug 31 17:12:00.458258 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3711/7602] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:12:00 2022] GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d => generated 1393 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:12:00.516832 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-d58fb245-552c-4fef-9286-394d7216ef03 req-a4a1ff00-0f56-410c-9ca3-dbc8d7ced124 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffe37a38-8054-4a4a-acd7-4ee824fb6e1d", "name": "network-vif-plugged", "status": "completed", "tag": "e0fd9522-ff37-4867-a550-f9d9d497dd7d"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:12:00.527118 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-d58fb245-552c-4fef-9286-394d7216ef03 req-a4a1ff00-0f56-410c-9ca3-dbc8d7ced124 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:00.527608 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-d58fb245-552c-4fef-9286-394d7216ef03 req-a4a1ff00-0f56-410c-9ca3-dbc8d7ced124 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:00.528051 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-d58fb245-552c-4fef-9286-394d7216ef03 req-a4a1ff00-0f56-410c-9ca3-dbc8d7ced124 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:00.539496 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-d58fb245-552c-4fef-9286-394d7216ef03 req-a4a1ff00-0f56-410c-9ca3-dbc8d7ced124 service nova] Creating event network-vif-plugged:e0fd9522-ff37-4867-a550-f9d9d497dd7d for instance ffe37a38-8054-4a4a-acd7-4ee824fb6e1d on n-h2-833090-16 Aug 31 17:12:00.544656 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-d58fb245-552c-4fef-9286-394d7216ef03 req-a4a1ff00-0f56-410c-9ca3-dbc8d7ced124 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095724 Aug 31 17:12:00.545268 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3892/7603] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:12:01.475619 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b8499fa7-f140-4f28-8052-34f8f323db75 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:12:01.476273 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b8499fa7-f140-4f28-8052-34f8f323db75 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ffe37a38-8054-4a4a-acd7-4ee824fb6e1d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:12:01.479077 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:12:01.485264 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8499fa7-f140-4f28-8052-34f8f323db75 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:01.485264 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8499fa7-f140-4f28-8052-34f8f323db75 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:01.485587 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8499fa7-f140-4f28-8052-34f8f323db75 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:01.486408 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8499fa7-f140-4f28-8052-34f8f323db75 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:01.486789 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8499fa7-f140-4f28-8052-34f8f323db75 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:01.487212 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b8499fa7-f140-4f28-8052-34f8f323db75 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:01.634716 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b8499fa7-f140-4f28-8052-34f8f323db75 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:12:01.643370 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b8499fa7-f140-4f28-8052-34f8f323db75 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d" status: 200 len: 1393 microversion: 2.1 time: 0.173029 Aug 31 17:12:01.643930 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3712/7604] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:12:01 2022] GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d => generated 1393 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:12:02.662764 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=10 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:12:02.668610 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-929d9330-3fce-4843-bd92-767713b5ff48 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:12:02.669371 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-929d9330-3fce-4843-bd92-767713b5ff48 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ffe37a38-8054-4a4a-acd7-4ee824fb6e1d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:12:02.671333 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:12:02.677761 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-929d9330-3fce-4843-bd92-767713b5ff48 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:02.678410 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-929d9330-3fce-4843-bd92-767713b5ff48 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:02.678872 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-929d9330-3fce-4843-bd92-767713b5ff48 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:02.679589 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-929d9330-3fce-4843-bd92-767713b5ff48 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:02.680055 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-929d9330-3fce-4843-bd92-767713b5ff48 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:02.680493 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-929d9330-3fce-4843-bd92-767713b5ff48 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:02.826236 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-929d9330-3fce-4843-bd92-767713b5ff48 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:12:02.834601 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-929d9330-3fce-4843-bd92-767713b5ff48 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d" status: 200 len: 1564 microversion: 2.1 time: 0.172967 Aug 31 17:12:02.835259 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3893/7605] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:12:02 2022] GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d => generated 1564 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:12:02.855673 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6bfd28d0-b403-4db9-97b4-d4add19c6e20 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:12:02.856250 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6bfd28d0-b403-4db9-97b4-d4add19c6e20 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ffe37a38-8054-4a4a-acd7-4ee824fb6e1d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:12:02.864064 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6bfd28d0-b403-4db9-97b4-d4add19c6e20 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:02.864471 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6bfd28d0-b403-4db9-97b4-d4add19c6e20 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:02.864985 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6bfd28d0-b403-4db9-97b4-d4add19c6e20 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:02.865705 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6bfd28d0-b403-4db9-97b4-d4add19c6e20 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:02.866177 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6bfd28d0-b403-4db9-97b4-d4add19c6e20 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:02.866599 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6bfd28d0-b403-4db9-97b4-d4add19c6e20 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:03.007159 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6bfd28d0-b403-4db9-97b4-d4add19c6e20 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:12:03.017550 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6bfd28d0-b403-4db9-97b4-d4add19c6e20 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d" status: 200 len: 1564 microversion: 2.1 time: 0.165822 Aug 31 17:12:03.018159 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3713/7606] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:12:02 2022] GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d => generated 1564 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:12:05.079791 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7fe12c86-a7df-47e8-9139-8a80777ec1cd tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:12:05.080585 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7fe12c86-a7df-47e8-9139-8a80777ec1cd tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ffe37a38-8054-4a4a-acd7-4ee824fb6e1d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:12:05.082539 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-5f67361d-b5e8-4f14-b292-98ce980422ef req-e57fdbdf-8121-4374-8fa0-7597aaa54ea1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffe37a38-8054-4a4a-acd7-4ee824fb6e1d", "tag": "e0fd9522-ff37-4867-a550-f9d9d497dd7d"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:12:05.088014 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7fe12c86-a7df-47e8-9139-8a80777ec1cd tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:05.088888 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7fe12c86-a7df-47e8-9139-8a80777ec1cd tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:05.089326 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7fe12c86-a7df-47e8-9139-8a80777ec1cd tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:05.090359 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7fe12c86-a7df-47e8-9139-8a80777ec1cd tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:05.091175 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7fe12c86-a7df-47e8-9139-8a80777ec1cd tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:05.091592 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7fe12c86-a7df-47e8-9139-8a80777ec1cd tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:05.095407 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5f67361d-b5e8-4f14-b292-98ce980422ef req-e57fdbdf-8121-4374-8fa0-7597aaa54ea1 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:05.096018 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5f67361d-b5e8-4f14-b292-98ce980422ef req-e57fdbdf-8121-4374-8fa0-7597aaa54ea1 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:05.096662 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-5f67361d-b5e8-4f14-b292-98ce980422ef req-e57fdbdf-8121-4374-8fa0-7597aaa54ea1 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:05.109026 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-5f67361d-b5e8-4f14-b292-98ce980422ef req-e57fdbdf-8121-4374-8fa0-7597aaa54ea1 service nova] Creating event network-changed:e0fd9522-ff37-4867-a550-f9d9d497dd7d for instance ffe37a38-8054-4a4a-acd7-4ee824fb6e1d on n-h2-833090-16 Aug 31 17:12:05.115692 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-5f67361d-b5e8-4f14-b292-98ce980422ef req-e57fdbdf-8121-4374-8fa0-7597aaa54ea1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036605 Aug 31 17:12:05.116425 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3714/7607] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:12:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:12:05.241889 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7fe12c86-a7df-47e8-9139-8a80777ec1cd tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:12:05.250934 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7fe12c86-a7df-47e8-9139-8a80777ec1cd tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d" status: 200 len: 1564 microversion: 2.1 time: 0.175856 Aug 31 17:12:05.251594 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3894/7608] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:12:05 2022] GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d => generated 1564 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:12:38.582422 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=5 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:12:38.583355 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=44 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:12:38.588980 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-511bb1c8-99ab-4286-86df-022716131941 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:12:38.591858 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-511bb1c8-99ab-4286-86df-022716131941 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ffe37a38-8054-4a4a-acd7-4ee824fb6e1d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:12:38.600250 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-511bb1c8-99ab-4286-86df-022716131941 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:38.600741 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-511bb1c8-99ab-4286-86df-022716131941 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:38.601152 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-511bb1c8-99ab-4286-86df-022716131941 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:38.601878 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-511bb1c8-99ab-4286-86df-022716131941 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:12:38.602369 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-511bb1c8-99ab-4286-86df-022716131941 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:12:38.602793 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-511bb1c8-99ab-4286-86df-022716131941 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:12:38.677346 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-511bb1c8-99ab-4286-86df-022716131941 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "POST /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d/action" status: 200 len: 24571 microversion: 2.1 time: 0.098019 Aug 31 17:12:38.678021 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3715/7609] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 17:12:38 2022] POST /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d/action => generated 24571 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 17:13:09.093643 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=3 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:13:09.094367 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=36 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:13:09.098948 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c9e3d70d-f4cd-4d8e-b229-55955858c04e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:13:09.101585 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c9e3d70d-f4cd-4d8e-b229-55955858c04e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ffe37a38-8054-4a4a-acd7-4ee824fb6e1d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:13:09.111309 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c9e3d70d-f4cd-4d8e-b229-55955858c04e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:13:09.111814 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c9e3d70d-f4cd-4d8e-b229-55955858c04e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:13:09.112262 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c9e3d70d-f4cd-4d8e-b229-55955858c04e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:13:09.112982 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c9e3d70d-f4cd-4d8e-b229-55955858c04e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:13:09.113454 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c9e3d70d-f4cd-4d8e-b229-55955858c04e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:13:09.113891 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c9e3d70d-f4cd-4d8e-b229-55955858c04e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:13:09.163961 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c9e3d70d-f4cd-4d8e-b229-55955858c04e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:13:09.171636 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c9e3d70d-f4cd-4d8e-b229-55955858c04e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ffe37a38-8054-4a4a-acd7-4ee824fb6e1d] Old instance type m1.heat2, new instance type m1.heat {{(pid=128864) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 31 17:13:09.178424 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-c9e3d70d-f4cd-4d8e-b229-55955858c04e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 17:13:09.178854 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-c9e3d70d-f4cd-4d8e-b229-55955858c04e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 17:13:09.179333 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-c9e3d70d-f4cd-4d8e-b229-55955858c04e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 17:13:09.179745 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-c9e3d70d-f4cd-4d8e-b229-55955858c04e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 17:13:09.180168 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-c9e3d70d-f4cd-4d8e-b229-55955858c04e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 17:13:09.248543 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c9e3d70d-f4cd-4d8e-b229-55955858c04e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "POST /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d/action" status: 202 len: 0 microversion: 2.1 time: 0.156661 Aug 31 17:13:09.249301 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3895/7610] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 17:13:09 2022] POST /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:13:09.258202 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2ead3dcd-b070-48f9-a80f-a7bbb487c490 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:13:09.258984 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2ead3dcd-b070-48f9-a80f-a7bbb487c490 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ffe37a38-8054-4a4a-acd7-4ee824fb6e1d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:13:09.261674 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:13:09.262764 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:13:09.269638 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ead3dcd-b070-48f9-a80f-a7bbb487c490 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:13:09.270158 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ead3dcd-b070-48f9-a80f-a7bbb487c490 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:13:09.270598 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ead3dcd-b070-48f9-a80f-a7bbb487c490 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:13:09.271304 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ead3dcd-b070-48f9-a80f-a7bbb487c490 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:13:09.271757 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ead3dcd-b070-48f9-a80f-a7bbb487c490 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:13:09.272181 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2ead3dcd-b070-48f9-a80f-a7bbb487c490 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:13:09.426379 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2ead3dcd-b070-48f9-a80f-a7bbb487c490 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:13:09.435720 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2ead3dcd-b070-48f9-a80f-a7bbb487c490 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d" status: 200 len: 1691 microversion: 2.1 time: 0.181722 Aug 31 17:13:09.448964 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3716/7611] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:13:09 2022] GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d => generated 1691 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:13:10.459245 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-bd4cfc32-ee21-43d7-b777-cb50610cd7f7 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:13:10.460082 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-bd4cfc32-ee21-43d7-b777-cb50610cd7f7 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ffe37a38-8054-4a4a-acd7-4ee824fb6e1d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:13:10.467803 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bd4cfc32-ee21-43d7-b777-cb50610cd7f7 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:13:10.468321 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bd4cfc32-ee21-43d7-b777-cb50610cd7f7 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:13:10.468792 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bd4cfc32-ee21-43d7-b777-cb50610cd7f7 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:13:10.469497 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bd4cfc32-ee21-43d7-b777-cb50610cd7f7 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:13:10.469952 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bd4cfc32-ee21-43d7-b777-cb50610cd7f7 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:13:10.470403 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bd4cfc32-ee21-43d7-b777-cb50610cd7f7 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:13:10.634012 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-bd4cfc32-ee21-43d7-b777-cb50610cd7f7 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:13:10.642463 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-bd4cfc32-ee21-43d7-b777-cb50610cd7f7 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d" status: 200 len: 1691 microversion: 2.1 time: 0.187328 Aug 31 17:13:10.643047 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3896/7612] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:13:10 2022] GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d => generated 1691 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:13:11.665064 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3c522dbc-d829-461f-a9eb-06f8e480e659 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:13:11.665669 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3c522dbc-d829-461f-a9eb-06f8e480e659 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ffe37a38-8054-4a4a-acd7-4ee824fb6e1d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:13:11.674160 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c522dbc-d829-461f-a9eb-06f8e480e659 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:13:11.674496 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c522dbc-d829-461f-a9eb-06f8e480e659 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:13:11.674931 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c522dbc-d829-461f-a9eb-06f8e480e659 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:13:11.675777 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c522dbc-d829-461f-a9eb-06f8e480e659 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:13:11.676241 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c522dbc-d829-461f-a9eb-06f8e480e659 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:13:11.676667 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3c522dbc-d829-461f-a9eb-06f8e480e659 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:13:11.821695 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3c522dbc-d829-461f-a9eb-06f8e480e659 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:13:11.831007 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3c522dbc-d829-461f-a9eb-06f8e480e659 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d" status: 200 len: 1696 microversion: 2.1 time: 0.169884 Aug 31 17:13:11.831601 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3717/7613] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:13:11 2022] GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d => generated 1696 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:13:12.854885 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-667572a1-f3ec-4fc4-a1cc-bff30706093a tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:13:12.855449 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-667572a1-f3ec-4fc4-a1cc-bff30706093a tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ffe37a38-8054-4a4a-acd7-4ee824fb6e1d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:13:12.863218 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-667572a1-f3ec-4fc4-a1cc-bff30706093a tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:13:12.863724 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-667572a1-f3ec-4fc4-a1cc-bff30706093a tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:13:12.864175 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-667572a1-f3ec-4fc4-a1cc-bff30706093a tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:13:12.864889 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-667572a1-f3ec-4fc4-a1cc-bff30706093a tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:13:12.865359 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-667572a1-f3ec-4fc4-a1cc-bff30706093a tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:13:12.865799 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-667572a1-f3ec-4fc4-a1cc-bff30706093a tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:13:13.022990 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-667572a1-f3ec-4fc4-a1cc-bff30706093a tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:13:13.035785 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-667572a1-f3ec-4fc4-a1cc-bff30706093a tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d" status: 200 len: 1696 microversion: 2.1 time: 0.184683 Aug 31 17:13:13.036618 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3897/7614] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:13:12 2022] GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d => generated 1696 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:13:14.061324 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2b7b1a8c-2436-46ee-a6ff-17e26bf13d12 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:13:14.061957 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2b7b1a8c-2436-46ee-a6ff-17e26bf13d12 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ffe37a38-8054-4a4a-acd7-4ee824fb6e1d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:13:14.069519 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2b7b1a8c-2436-46ee-a6ff-17e26bf13d12 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:13:14.069986 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2b7b1a8c-2436-46ee-a6ff-17e26bf13d12 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:13:14.070453 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2b7b1a8c-2436-46ee-a6ff-17e26bf13d12 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:13:14.071139 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2b7b1a8c-2436-46ee-a6ff-17e26bf13d12 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:13:14.071583 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2b7b1a8c-2436-46ee-a6ff-17e26bf13d12 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:13:14.071996 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2b7b1a8c-2436-46ee-a6ff-17e26bf13d12 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:13:14.214072 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2b7b1a8c-2436-46ee-a6ff-17e26bf13d12 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:13:14.226346 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2b7b1a8c-2436-46ee-a6ff-17e26bf13d12 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d" status: 200 len: 1696 microversion: 2.1 time: 0.170202 Aug 31 17:13:14.227125 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3718/7615] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:13:14 2022] GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d => generated 1696 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:13:15.252697 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-96b8742d-c035-4199-8a63-a9f0a01697b2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:13:15.253311 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-96b8742d-c035-4199-8a63-a9f0a01697b2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ffe37a38-8054-4a4a-acd7-4ee824fb6e1d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:13:15.263954 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-96b8742d-c035-4199-8a63-a9f0a01697b2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:13:15.264441 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-96b8742d-c035-4199-8a63-a9f0a01697b2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:13:15.264915 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-96b8742d-c035-4199-8a63-a9f0a01697b2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:13:15.265628 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-96b8742d-c035-4199-8a63-a9f0a01697b2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:13:15.266121 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-96b8742d-c035-4199-8a63-a9f0a01697b2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:13:15.266562 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-96b8742d-c035-4199-8a63-a9f0a01697b2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:13:15.414131 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-96b8742d-c035-4199-8a63-a9f0a01697b2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:13:15.427527 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-96b8742d-c035-4199-8a63-a9f0a01697b2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d" status: 200 len: 1696 microversion: 2.1 time: 0.181131 Aug 31 17:13:15.428372 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3898/7616] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:13:15 2022] GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d => generated 1696 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:13:16.452510 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4aeed064-a802-4ca5-a544-bbeca8e1c668 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:13:16.453204 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4aeed064-a802-4ca5-a544-bbeca8e1c668 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ffe37a38-8054-4a4a-acd7-4ee824fb6e1d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:13:16.460447 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4aeed064-a802-4ca5-a544-bbeca8e1c668 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:13:16.460945 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4aeed064-a802-4ca5-a544-bbeca8e1c668 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:13:16.461374 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4aeed064-a802-4ca5-a544-bbeca8e1c668 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:13:16.462060 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4aeed064-a802-4ca5-a544-bbeca8e1c668 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:13:16.462548 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4aeed064-a802-4ca5-a544-bbeca8e1c668 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:13:16.462995 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4aeed064-a802-4ca5-a544-bbeca8e1c668 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:13:16.606456 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4aeed064-a802-4ca5-a544-bbeca8e1c668 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:13:16.614538 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4aeed064-a802-4ca5-a544-bbeca8e1c668 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d" status: 200 len: 1696 microversion: 2.1 time: 0.166309 Aug 31 17:13:16.615124 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3719/7617] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:13:16 2022] GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d => generated 1696 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:13:17.640597 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f28d8014-4fcc-448a-88bb-b779027ed414 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:13:17.641653 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f28d8014-4fcc-448a-88bb-b779027ed414 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ffe37a38-8054-4a4a-acd7-4ee824fb6e1d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:13:17.653520 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f28d8014-4fcc-448a-88bb-b779027ed414 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:13:17.654010 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f28d8014-4fcc-448a-88bb-b779027ed414 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:13:17.654492 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f28d8014-4fcc-448a-88bb-b779027ed414 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:13:17.655196 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f28d8014-4fcc-448a-88bb-b779027ed414 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:13:17.655662 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f28d8014-4fcc-448a-88bb-b779027ed414 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:13:17.656089 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f28d8014-4fcc-448a-88bb-b779027ed414 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:13:17.809790 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f28d8014-4fcc-448a-88bb-b779027ed414 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:13:17.820125 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f28d8014-4fcc-448a-88bb-b779027ed414 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d" status: 200 len: 1696 microversion: 2.1 time: 0.186363 Aug 31 17:13:17.820734 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3899/7618] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:13:17 2022] GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d => generated 1696 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:13:18.846209 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-22dc0036-5a24-446a-aa4d-f8f4ab8b2bd2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:13:18.846878 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-22dc0036-5a24-446a-aa4d-f8f4ab8b2bd2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ffe37a38-8054-4a4a-acd7-4ee824fb6e1d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:13:18.854444 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-22dc0036-5a24-446a-aa4d-f8f4ab8b2bd2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:13:18.855173 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-22dc0036-5a24-446a-aa4d-f8f4ab8b2bd2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:13:18.855587 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-22dc0036-5a24-446a-aa4d-f8f4ab8b2bd2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:13:18.856599 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-22dc0036-5a24-446a-aa4d-f8f4ab8b2bd2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:13:18.857083 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-22dc0036-5a24-446a-aa4d-f8f4ab8b2bd2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:13:18.857633 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-22dc0036-5a24-446a-aa4d-f8f4ab8b2bd2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:13:18.999279 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-22dc0036-5a24-446a-aa4d-f8f4ab8b2bd2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:13:19.007838 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-22dc0036-5a24-446a-aa4d-f8f4ab8b2bd2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d" status: 200 len: 1696 microversion: 2.1 time: 0.166354 Aug 31 17:13:19.008449 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3720/7619] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:13:18 2022] GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d => generated 1696 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:13:20.032813 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ae9144ea-96ec-45b5-8c1e-d404878be78f tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:13:20.033435 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ae9144ea-96ec-45b5-8c1e-d404878be78f tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ffe37a38-8054-4a4a-acd7-4ee824fb6e1d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:13:20.041153 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ae9144ea-96ec-45b5-8c1e-d404878be78f tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:13:20.041651 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ae9144ea-96ec-45b5-8c1e-d404878be78f tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:13:20.042124 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ae9144ea-96ec-45b5-8c1e-d404878be78f tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:13:20.042812 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ae9144ea-96ec-45b5-8c1e-d404878be78f tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:13:20.043271 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ae9144ea-96ec-45b5-8c1e-d404878be78f tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:13:20.043695 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ae9144ea-96ec-45b5-8c1e-d404878be78f tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:13:20.182786 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ae9144ea-96ec-45b5-8c1e-d404878be78f tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:13:20.194820 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ae9144ea-96ec-45b5-8c1e-d404878be78f tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d" status: 200 len: 1696 microversion: 2.1 time: 0.167652 Aug 31 17:13:20.195866 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3900/7620] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:13:20 2022] GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d => generated 1696 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:13:21.223897 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-996a9382-fb96-4f26-b83b-94986d500efc tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:13:21.224762 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-996a9382-fb96-4f26-b83b-94986d500efc tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ffe37a38-8054-4a4a-acd7-4ee824fb6e1d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:13:21.234716 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-996a9382-fb96-4f26-b83b-94986d500efc tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:13:21.235204 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-996a9382-fb96-4f26-b83b-94986d500efc tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:13:21.235632 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-996a9382-fb96-4f26-b83b-94986d500efc tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:13:21.236327 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-996a9382-fb96-4f26-b83b-94986d500efc tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:13:21.236784 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-996a9382-fb96-4f26-b83b-94986d500efc tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:13:21.237209 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-996a9382-fb96-4f26-b83b-94986d500efc tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:13:21.381935 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-996a9382-fb96-4f26-b83b-94986d500efc tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:13:21.395104 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-996a9382-fb96-4f26-b83b-94986d500efc tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d" status: 200 len: 1696 microversion: 2.1 time: 0.178123 Aug 31 17:13:21.396037 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3721/7621] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:13:21 2022] GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d => generated 1696 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:13:22.420666 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3c357d33-d622-46e9-acd5-fc47ab13a262 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:13:22.421295 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3c357d33-d622-46e9-acd5-fc47ab13a262 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ffe37a38-8054-4a4a-acd7-4ee824fb6e1d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:13:22.428365 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3c357d33-d622-46e9-acd5-fc47ab13a262 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:13:22.428872 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3c357d33-d622-46e9-acd5-fc47ab13a262 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:13:22.429321 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3c357d33-d622-46e9-acd5-fc47ab13a262 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:13:22.430038 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3c357d33-d622-46e9-acd5-fc47ab13a262 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:13:22.430539 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3c357d33-d622-46e9-acd5-fc47ab13a262 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:13:22.430984 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3c357d33-d622-46e9-acd5-fc47ab13a262 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:13:22.577716 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3c357d33-d622-46e9-acd5-fc47ab13a262 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:13:22.586209 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3c357d33-d622-46e9-acd5-fc47ab13a262 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d" status: 200 len: 1696 microversion: 2.1 time: 0.171531 Aug 31 17:13:22.587112 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3901/7622] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:13:22 2022] GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d => generated 1696 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:13:23.609591 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0dffa773-2f96-4100-b0a2-daf0c7938075 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:13:23.610298 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0dffa773-2f96-4100-b0a2-daf0c7938075 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ffe37a38-8054-4a4a-acd7-4ee824fb6e1d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:13:23.616863 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0dffa773-2f96-4100-b0a2-daf0c7938075 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:13:23.617398 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0dffa773-2f96-4100-b0a2-daf0c7938075 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:13:23.617875 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0dffa773-2f96-4100-b0a2-daf0c7938075 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:13:23.618601 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0dffa773-2f96-4100-b0a2-daf0c7938075 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:13:23.619054 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0dffa773-2f96-4100-b0a2-daf0c7938075 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:13:23.619445 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0dffa773-2f96-4100-b0a2-daf0c7938075 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:13:23.761686 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0dffa773-2f96-4100-b0a2-daf0c7938075 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:13:23.772729 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0dffa773-2f96-4100-b0a2-daf0c7938075 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d" status: 200 len: 1695 microversion: 2.1 time: 0.167685 Aug 31 17:13:23.773326 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3722/7623] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:13:23 2022] GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d => generated 1695 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:13:24.065703 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-ec2eaae1-71e5-4201-9e71-72c1c009c89a req-8aaeee1d-cfdb-4f64-83de-48005cec36ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffe37a38-8054-4a4a-acd7-4ee824fb6e1d", "name": "network-vif-unplugged", "status": "completed", "tag": "e0fd9522-ff37-4867-a550-f9d9d497dd7d"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:13:24.077416 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-ec2eaae1-71e5-4201-9e71-72c1c009c89a req-8aaeee1d-cfdb-4f64-83de-48005cec36ef service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:13:24.078132 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-ec2eaae1-71e5-4201-9e71-72c1c009c89a req-8aaeee1d-cfdb-4f64-83de-48005cec36ef service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:13:24.078623 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-ec2eaae1-71e5-4201-9e71-72c1c009c89a req-8aaeee1d-cfdb-4f64-83de-48005cec36ef service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:13:24.092980 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-ec2eaae1-71e5-4201-9e71-72c1c009c89a req-8aaeee1d-cfdb-4f64-83de-48005cec36ef service nova] Creating event network-vif-unplugged:e0fd9522-ff37-4867-a550-f9d9d497dd7d for instance ffe37a38-8054-4a4a-acd7-4ee824fb6e1d on n-h1-833090-16 Aug 31 17:13:24.098859 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [req-ec2eaae1-71e5-4201-9e71-72c1c009c89a req-8aaeee1d-cfdb-4f64-83de-48005cec36ef service nova] Instance ffe37a38-8054-4a4a-acd7-4ee824fb6e1d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-833090-16', 'n-h1-833090-16'} {{(pid=128864) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 17:13:24.110821 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-ec2eaae1-71e5-4201-9e71-72c1c009c89a req-8aaeee1d-cfdb-4f64-83de-48005cec36ef service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048771 Aug 31 17:13:24.111766 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3902/7624] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:13:24.794915 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c902de36-47f9-4bbf-b59c-579856ece2b3 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:13:24.795606 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c902de36-47f9-4bbf-b59c-579856ece2b3 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ffe37a38-8054-4a4a-acd7-4ee824fb6e1d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:13:24.803614 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c902de36-47f9-4bbf-b59c-579856ece2b3 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:13:24.804127 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c902de36-47f9-4bbf-b59c-579856ece2b3 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:13:24.804604 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c902de36-47f9-4bbf-b59c-579856ece2b3 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:13:24.805468 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c902de36-47f9-4bbf-b59c-579856ece2b3 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:13:24.805915 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c902de36-47f9-4bbf-b59c-579856ece2b3 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:13:24.806405 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c902de36-47f9-4bbf-b59c-579856ece2b3 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:13:24.948327 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c902de36-47f9-4bbf-b59c-579856ece2b3 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:13:24.957085 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c902de36-47f9-4bbf-b59c-579856ece2b3 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d" status: 200 len: 1695 microversion: 2.1 time: 0.166240 Aug 31 17:13:24.957690 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3723/7625] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:13:24 2022] GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d => generated 1695 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:13:25.982937 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7ff9d221-de99-41fb-a8a1-9167970432fb tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:13:25.983532 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7ff9d221-de99-41fb-a8a1-9167970432fb tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ffe37a38-8054-4a4a-acd7-4ee824fb6e1d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:13:25.990348 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ff9d221-de99-41fb-a8a1-9167970432fb tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:13:25.990880 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ff9d221-de99-41fb-a8a1-9167970432fb tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:13:25.991334 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ff9d221-de99-41fb-a8a1-9167970432fb tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:13:25.992046 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ff9d221-de99-41fb-a8a1-9167970432fb tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:13:25.992513 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ff9d221-de99-41fb-a8a1-9167970432fb tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:13:25.992952 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7ff9d221-de99-41fb-a8a1-9167970432fb tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:13:26.126996 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-a425018c-1e64-467c-bbd9-56dea795b190 req-e4ae73c2-dc67-46db-981e-1f9ba2674e00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffe37a38-8054-4a4a-acd7-4ee824fb6e1d", "tag": "e0fd9522-ff37-4867-a550-f9d9d497dd7d"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:13:26.137717 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a425018c-1e64-467c-bbd9-56dea795b190 req-e4ae73c2-dc67-46db-981e-1f9ba2674e00 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:13:26.138303 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a425018c-1e64-467c-bbd9-56dea795b190 req-e4ae73c2-dc67-46db-981e-1f9ba2674e00 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:13:26.138896 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a425018c-1e64-467c-bbd9-56dea795b190 req-e4ae73c2-dc67-46db-981e-1f9ba2674e00 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:13:26.151365 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-a425018c-1e64-467c-bbd9-56dea795b190 req-e4ae73c2-dc67-46db-981e-1f9ba2674e00 service nova] Creating event network-changed:e0fd9522-ff37-4867-a550-f9d9d497dd7d for instance ffe37a38-8054-4a4a-acd7-4ee824fb6e1d on n-h1-833090-16 Aug 31 17:13:26.155238 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7ff9d221-de99-41fb-a8a1-9167970432fb tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:13:26.157412 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [req-a425018c-1e64-467c-bbd9-56dea795b190 req-e4ae73c2-dc67-46db-981e-1f9ba2674e00 service nova] Instance ffe37a38-8054-4a4a-acd7-4ee824fb6e1d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-833090-16', 'n-h1-833090-16'} {{(pid=128863) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 31 17:13:26.164173 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7ff9d221-de99-41fb-a8a1-9167970432fb tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d" status: 200 len: 1693 microversion: 2.1 time: 0.188570 Aug 31 17:13:26.164764 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3903/7626] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:13:25 2022] GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d => generated 1693 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:13:26.180367 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-a425018c-1e64-467c-bbd9-56dea795b190 req-e4ae73c2-dc67-46db-981e-1f9ba2674e00 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056942 Aug 31 17:13:26.180991 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3724/7627] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:13:27.185287 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-947a0e96-e9d6-4034-887c-c50cf2119d98 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:13:27.185947 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-947a0e96-e9d6-4034-887c-c50cf2119d98 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ffe37a38-8054-4a4a-acd7-4ee824fb6e1d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:13:27.193498 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-947a0e96-e9d6-4034-887c-c50cf2119d98 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:13:27.194018 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-947a0e96-e9d6-4034-887c-c50cf2119d98 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:13:27.194510 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-947a0e96-e9d6-4034-887c-c50cf2119d98 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:13:27.195231 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-947a0e96-e9d6-4034-887c-c50cf2119d98 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:13:27.195700 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-947a0e96-e9d6-4034-887c-c50cf2119d98 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:13:27.196139 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-947a0e96-e9d6-4034-887c-c50cf2119d98 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:13:27.340047 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-947a0e96-e9d6-4034-887c-c50cf2119d98 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:13:27.348482 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-947a0e96-e9d6-4034-887c-c50cf2119d98 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d" status: 200 len: 1690 microversion: 2.1 time: 0.167349 Aug 31 17:13:27.349115 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3904/7628] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:13:27 2022] GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d => generated 1690 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:13:27.371878 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-70546b8d-245a-456e-90c9-618608edee9f tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:13:27.372535 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-70546b8d-245a-456e-90c9-618608edee9f tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ffe37a38-8054-4a4a-acd7-4ee824fb6e1d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:13:27.379076 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70546b8d-245a-456e-90c9-618608edee9f tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:13:27.379559 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70546b8d-245a-456e-90c9-618608edee9f tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:13:27.379966 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70546b8d-245a-456e-90c9-618608edee9f tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:13:27.380690 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70546b8d-245a-456e-90c9-618608edee9f tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:13:27.381137 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70546b8d-245a-456e-90c9-618608edee9f tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:13:27.381557 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-70546b8d-245a-456e-90c9-618608edee9f tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:13:27.442674 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-70546b8d-245a-456e-90c9-618608edee9f tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "POST /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d/action" status: 204 len: 0 microversion: 2.1 time: 0.075979 Aug 31 17:13:27.443379 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3725/7629] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 17:13:27 2022] POST /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d/action => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 17:13:27.453528 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-282c6800-aa72-45cd-86a0-299b95c5eecf tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:13:27.454196 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-282c6800-aa72-45cd-86a0-299b95c5eecf tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ffe37a38-8054-4a4a-acd7-4ee824fb6e1d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:13:27.460696 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-282c6800-aa72-45cd-86a0-299b95c5eecf tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:13:27.461413 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-282c6800-aa72-45cd-86a0-299b95c5eecf tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:13:27.462021 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-282c6800-aa72-45cd-86a0-299b95c5eecf tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:13:27.462797 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-282c6800-aa72-45cd-86a0-299b95c5eecf tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:13:27.463263 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-282c6800-aa72-45cd-86a0-299b95c5eecf tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:13:27.463725 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-282c6800-aa72-45cd-86a0-299b95c5eecf tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:13:27.603312 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-282c6800-aa72-45cd-86a0-299b95c5eecf tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:13:27.617288 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-282c6800-aa72-45cd-86a0-299b95c5eecf tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d" status: 200 len: 1690 microversion: 2.1 time: 0.168542 Aug 31 17:13:27.617877 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3905/7630] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:13:27 2022] GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d => generated 1690 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:13:27.639251 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-9d962c6f-9532-46fb-803b-57a75b600596 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:13:27.639980 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-9d962c6f-9532-46fb-803b-57a75b600596 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ffe37a38-8054-4a4a-acd7-4ee824fb6e1d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:13:27.646661 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d962c6f-9532-46fb-803b-57a75b600596 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:13:27.647151 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d962c6f-9532-46fb-803b-57a75b600596 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:13:27.647590 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d962c6f-9532-46fb-803b-57a75b600596 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:13:27.648268 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d962c6f-9532-46fb-803b-57a75b600596 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:13:27.648926 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d962c6f-9532-46fb-803b-57a75b600596 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:13:27.649349 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-9d962c6f-9532-46fb-803b-57a75b600596 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:13:27.800414 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-9d962c6f-9532-46fb-803b-57a75b600596 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:13:27.810446 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-9d962c6f-9532-46fb-803b-57a75b600596 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d" status: 200 len: 1690 microversion: 2.1 time: 0.175546 Aug 31 17:13:27.811290 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3726/7631] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:13:27 2022] GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d => generated 1690 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:13:28.832096 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-58a6ac3d-cc3e-466a-a6c0-10200b78eab8 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:13:28.833423 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-58a6ac3d-cc3e-466a-a6c0-10200b78eab8 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ffe37a38-8054-4a4a-acd7-4ee824fb6e1d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:13:28.840471 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-58a6ac3d-cc3e-466a-a6c0-10200b78eab8 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:13:28.840969 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-58a6ac3d-cc3e-466a-a6c0-10200b78eab8 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:13:28.841427 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-58a6ac3d-cc3e-466a-a6c0-10200b78eab8 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:13:28.842160 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-58a6ac3d-cc3e-466a-a6c0-10200b78eab8 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:13:28.842694 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-58a6ac3d-cc3e-466a-a6c0-10200b78eab8 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:13:28.843157 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-58a6ac3d-cc3e-466a-a6c0-10200b78eab8 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:13:28.988339 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-58a6ac3d-cc3e-466a-a6c0-10200b78eab8 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:13:28.996151 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-58a6ac3d-cc3e-466a-a6c0-10200b78eab8 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d" status: 200 len: 1682 microversion: 2.1 time: 0.168036 Aug 31 17:13:28.996722 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3906/7632] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:13:28 2022] GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:13:29.723281 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-58af730a-07c1-4827-8c93-4a173e046e96 req-51ec99dc-cf2f-418d-a287-c7c10f5f337c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffe37a38-8054-4a4a-acd7-4ee824fb6e1d", "name": "network-vif-plugged", "status": "completed", "tag": "e0fd9522-ff37-4867-a550-f9d9d497dd7d"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:13:29.737034 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-58af730a-07c1-4827-8c93-4a173e046e96 req-51ec99dc-cf2f-418d-a287-c7c10f5f337c service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:13:29.737525 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-58af730a-07c1-4827-8c93-4a173e046e96 req-51ec99dc-cf2f-418d-a287-c7c10f5f337c service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:13:29.737955 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-58af730a-07c1-4827-8c93-4a173e046e96 req-51ec99dc-cf2f-418d-a287-c7c10f5f337c service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:13:29.749594 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-58af730a-07c1-4827-8c93-4a173e046e96 req-51ec99dc-cf2f-418d-a287-c7c10f5f337c service nova] Creating event network-vif-plugged:e0fd9522-ff37-4867-a550-f9d9d497dd7d for instance ffe37a38-8054-4a4a-acd7-4ee824fb6e1d on n-h1-833090-16 Aug 31 17:13:29.755045 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-58af730a-07c1-4827-8c93-4a173e046e96 req-51ec99dc-cf2f-418d-a287-c7c10f5f337c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035499 Aug 31 17:13:29.756245 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3727/7633] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:13:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 17:13:51.208349 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-56f5b886-1fd8-4134-a175-33f827e2ea40 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:13:51.210642 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-56f5b886-1fd8-4134-a175-33f827e2ea40 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ffe37a38-8054-4a4a-acd7-4ee824fb6e1d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:13:51.214380 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=28 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:13:51.215413 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:13:51.222246 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-56f5b886-1fd8-4134-a175-33f827e2ea40 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:13:51.222765 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-56f5b886-1fd8-4134-a175-33f827e2ea40 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:13:51.223202 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-56f5b886-1fd8-4134-a175-33f827e2ea40 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:13:51.223957 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-56f5b886-1fd8-4134-a175-33f827e2ea40 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:13:51.224425 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-56f5b886-1fd8-4134-a175-33f827e2ea40 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:13:51.224857 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-56f5b886-1fd8-4134-a175-33f827e2ea40 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:13:51.282730 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-56f5b886-1fd8-4134-a175-33f827e2ea40 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "POST /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d/action" status: 200 len: 24576 microversion: 2.1 time: 0.078341 Aug 31 17:13:51.283385 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3907/7634] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 17:13:51 2022] POST /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d/action => generated 24576 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 17:13:58.366232 n-d-833090-16 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Aug 31 17:13:58.369232 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-4e811e66-40f9-418e-aed4-833523dfc501 req-86fee180-4ae1-4110-93e9-bd8374fb044f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffe37a38-8054-4a4a-acd7-4ee824fb6e1d", "tag": "e0fd9522-ff37-4867-a550-f9d9d497dd7d"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:13:58.370606 n-d-833090-16 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 17:13:58.370939 n-d-833090-16 devstack@n-api.service[128863]: Wed Aug 31 17:13:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d (ip 10.222.0.50) !!! Aug 31 17:13:58.372264 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=24 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:13:58.373099 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:13:58.378339 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b3aeded4-cfbd-4ed4-afe8-498f6c45e189 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:13:58.379242 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b3aeded4-cfbd-4ed4-afe8-498f6c45e189 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ffe37a38-8054-4a4a-acd7-4ee824fb6e1d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:13:58.381348 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-4e811e66-40f9-418e-aed4-833523dfc501 req-86fee180-4ae1-4110-93e9-bd8374fb044f service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:13:58.382132 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-4e811e66-40f9-418e-aed4-833523dfc501 req-86fee180-4ae1-4110-93e9-bd8374fb044f service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:13:58.382652 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-4e811e66-40f9-418e-aed4-833523dfc501 req-86fee180-4ae1-4110-93e9-bd8374fb044f service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:13:58.388010 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3aeded4-cfbd-4ed4-afe8-498f6c45e189 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:13:58.388908 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3aeded4-cfbd-4ed4-afe8-498f6c45e189 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:13:58.389549 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3aeded4-cfbd-4ed4-afe8-498f6c45e189 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:13:58.390266 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3aeded4-cfbd-4ed4-afe8-498f6c45e189 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:13:58.390900 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3aeded4-cfbd-4ed4-afe8-498f6c45e189 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:13:58.391307 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3aeded4-cfbd-4ed4-afe8-498f6c45e189 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:13:58.396317 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-4e811e66-40f9-418e-aed4-833523dfc501 req-86fee180-4ae1-4110-93e9-bd8374fb044f service nova] Creating event network-changed:e0fd9522-ff37-4867-a550-f9d9d497dd7d for instance ffe37a38-8054-4a4a-acd7-4ee824fb6e1d on n-h1-833090-16 Aug 31 17:13:58.402432 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-4e811e66-40f9-418e-aed4-833523dfc501 req-86fee180-4ae1-4110-93e9-bd8374fb044f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037484 Aug 31 17:13:58.403864 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3908/7635] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:13:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:13:58.430320 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b3aeded4-cfbd-4ed4-afe8-498f6c45e189 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ffe37a38-8054-4a4a-acd7-4ee824fb6e1d] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 17:13:58.523468 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b3aeded4-cfbd-4ed4-afe8-498f6c45e189 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d" status: 204 len: 0 microversion: 2.1 time: 0.160345 Aug 31 17:13:58.524550 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3728/7636] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 17:13:58 2022] DELETE /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 17:13:58.533656 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1b066887-da87-48ff-9aaa-7c5ecc1acb6d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:13:58.534453 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1b066887-da87-48ff-9aaa-7c5ecc1acb6d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ffe37a38-8054-4a4a-acd7-4ee824fb6e1d] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:13:58.541559 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1b066887-da87-48ff-9aaa-7c5ecc1acb6d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:13:58.542359 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1b066887-da87-48ff-9aaa-7c5ecc1acb6d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:13:58.542809 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1b066887-da87-48ff-9aaa-7c5ecc1acb6d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:13:58.543511 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1b066887-da87-48ff-9aaa-7c5ecc1acb6d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:13:58.544132 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1b066887-da87-48ff-9aaa-7c5ecc1acb6d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:13:58.544625 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1b066887-da87-48ff-9aaa-7c5ecc1acb6d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:13:58.690470 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1b066887-da87-48ff-9aaa-7c5ecc1acb6d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:13:58.698956 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1b066887-da87-48ff-9aaa-7c5ecc1acb6d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d" status: 200 len: 1688 microversion: 2.1 time: 0.169790 Aug 31 17:13:58.699544 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3909/7637] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:13:58 2022] GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d => generated 1688 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:13:59.723054 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-28afdcc2-00a0-4247-91f1-dc358e40d4c3 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:13:59.723626 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-28afdcc2-00a0-4247-91f1-dc358e40d4c3 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ffe37a38-8054-4a4a-acd7-4ee824fb6e1d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:13:59.731013 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28afdcc2-00a0-4247-91f1-dc358e40d4c3 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:13:59.731503 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28afdcc2-00a0-4247-91f1-dc358e40d4c3 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:13:59.731971 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28afdcc2-00a0-4247-91f1-dc358e40d4c3 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:13:59.732886 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28afdcc2-00a0-4247-91f1-dc358e40d4c3 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:13:59.733901 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28afdcc2-00a0-4247-91f1-dc358e40d4c3 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:13:59.734363 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-28afdcc2-00a0-4247-91f1-dc358e40d4c3 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:13:59.890066 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-28afdcc2-00a0-4247-91f1-dc358e40d4c3 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:13:59.898063 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-28afdcc2-00a0-4247-91f1-dc358e40d4c3 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d" status: 200 len: 1688 microversion: 2.1 time: 0.179639 Aug 31 17:13:59.910122 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3729/7638] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:13:59 2022] GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d => generated 1688 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:14:00.379112 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-223ec585-4e78-4d0b-9537-02be5082cfcf req-47d10726-dd0f-44cd-835a-206c3b5a0168 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffe37a38-8054-4a4a-acd7-4ee824fb6e1d", "name": "network-vif-deleted", "tag": "e0fd9522-ff37-4867-a550-f9d9d497dd7d"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:14:00.392533 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-223ec585-4e78-4d0b-9537-02be5082cfcf req-47d10726-dd0f-44cd-835a-206c3b5a0168 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:14:00.393148 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-223ec585-4e78-4d0b-9537-02be5082cfcf req-47d10726-dd0f-44cd-835a-206c3b5a0168 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:14:00.393655 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-223ec585-4e78-4d0b-9537-02be5082cfcf req-47d10726-dd0f-44cd-835a-206c3b5a0168 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:14:00.407256 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-223ec585-4e78-4d0b-9537-02be5082cfcf req-47d10726-dd0f-44cd-835a-206c3b5a0168 service nova] Creating event network-vif-deleted:e0fd9522-ff37-4867-a550-f9d9d497dd7d for instance ffe37a38-8054-4a4a-acd7-4ee824fb6e1d on n-h1-833090-16 Aug 31 17:14:00.412320 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-223ec585-4e78-4d0b-9537-02be5082cfcf req-47d10726-dd0f-44cd-835a-206c3b5a0168 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037055 Aug 31 17:14:00.413173 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3910/7639] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:14:00.923635 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cbff102d-552e-47d0-b817-90bf6a83b8c7 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:14:00.924352 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cbff102d-552e-47d0-b817-90bf6a83b8c7 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: ffe37a38-8054-4a4a-acd7-4ee824fb6e1d] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:14:00.931267 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbff102d-552e-47d0-b817-90bf6a83b8c7 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:14:00.931748 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbff102d-552e-47d0-b817-90bf6a83b8c7 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:14:00.932201 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbff102d-552e-47d0-b817-90bf6a83b8c7 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:14:00.932869 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbff102d-552e-47d0-b817-90bf6a83b8c7 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:14:00.933314 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbff102d-552e-47d0-b817-90bf6a83b8c7 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:14:00.933730 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbff102d-552e-47d0-b817-90bf6a83b8c7 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:14:00.947435 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-cbff102d-552e-47d0-b817-90bf6a83b8c7 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] HTTP exception thrown: Instance ffe37a38-8054-4a4a-acd7-4ee824fb6e1d could not be found. Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cbff102d-552e-47d0-b817-90bf6a83b8c7 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Request method failure captured: Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d HTTP/1.1 Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD5UwnC35Vn5evFApyVfskHdEHcvv0VSRxaZ9pzKW96Fqt51iHq5jLe56IGhM36ZgCFwb3_2IfN9Wxbd_wUAkzwS08XpxCxoP856myVMcw20sYLpddPhTMaAFpoi0Qlpqj4GXCEBMwRUEqexdDDa6EuUjH1_09epMJ_p9WzfxJnmlCRg Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: a6f813017c8c40d5978c8550f188dbf7 Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1147621593 Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a6f813017c8c40d5978c8550f188dbf7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a6f813017c8c40d5978c8550f188dbf7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a6f813017c8c40d5978c8550f188dbf7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a6f813017c8c40d5978c8550f188dbf7", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1147621593 Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: a6f813017c8c40d5978c8550f188dbf7 Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1147621593 Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-TestNetworkAdvancedServerOps-1147621593-project Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: a18fb2c4e622474d943a72025236cca7 Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1147621593-project Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance ffe37a38-8054-4a4a-acd7-4ee824fb6e1d could not be found. Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'ffe37a38-8054-4a4a-acd7-4ee824fb6e1d'} Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffe37a38-8054-4a4a-acd7-4ee824fb6e1d could not be found. Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffe37a38-8054-4a4a-acd7-4ee824fb6e1d could not be found. Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 17:14:00.949114 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:14:00.954970 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 17:14:00.954970 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:14:00.954970 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:14:00.954970 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:14:00.954970 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 17:14:00.954970 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 17:14:00.954970 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffe37a38-8054-4a4a-acd7-4ee824fb6e1d could not be found. Aug 31 17:14:00.954970 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 17:14:00.954970 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cbff102d-552e-47d0-b817-90bf6a83b8c7 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Returning 404 to user: Instance ffe37a38-8054-4a4a-acd7-4ee824fb6e1d could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 17:14:00.954970 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cbff102d-552e-47d0-b817-90bf6a83b8c7 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d" status: 404 len: 111 microversion: 2.1 time: 0.031320 Aug 31 17:14:00.954970 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3730/7640] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:14:00 2022] GET /compute/v2.1/servers/ffe37a38-8054-4a4a-acd7-4ee824fb6e1d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 17:14:04.372901 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-940a3057-3436-4230-9d50-a4c12629d0d6 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '.version_select at 0x7fbb4565d3a0>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:14:04.395792 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-940a3057-3436-4230-9d50-a4c12629d0d6 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1534874461" status: 202 len: 0 microversion: 2.1 time: 0.029548 Aug 31 17:14:04.396647 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3911/7641] 10.222.0.50 () {58 vars in 1284 bytes} [Wed Aug 31 17:14:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1534874461 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:14:04.424704 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-606f516e-4ca1-4b29-94ab-c707eee51728 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Action: 'create', calling method: .version_select at 0x7fbb45ceadc0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1818596774", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdzSoR9vWgKX+3N0kcKj9MHbEwusTtJqJHeMCb+LkMX+9Sm5ytg5mcVvdDK1HRqmdIurxL9pq3VXwdJD5SRi93+mb2Rrjpv3ej2ZyOX/3Sx2JESOsGlPxaYzAD40HcoXw=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:14:04.440968 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-606f516e-4ca1-4b29-94ab-c707eee51728 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Getting quotas for project a6f813017c8c40d5978c8550f188dbf7. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 17:14:04.446910 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-606f516e-4ca1-4b29-94ab-c707eee51728 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Getting quotas for user a18fb2c4e622474d943a72025236cca7 and project a6f813017c8c40d5978c8550f188dbf7. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 17:14:04.475806 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-606f516e-4ca1-4b29-94ab-c707eee51728 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.055051 Aug 31 17:14:04.476414 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3731/7642] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 31 17:14:04 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:14:10.336212 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4f3059ed-0d08-4cd6-bc4d-d8e3151c4b36 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1796635056", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "a49081bd-7a27-44af-ae72-51163aca600e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1818596774", "security_groups": [{"name": "tempest-secgroup-smoke-551701868"}]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:14:10.400471 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=14 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:14:10.490838 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-4f3059ed-0d08-4cd6-bc4d-d8e3151c4b36 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] validate_networks() for [('a49081bd-7a27-44af-ae72-51163aca600e', None, None, None, None, None)] {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 17:14:11.024183 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-4f3059ed-0d08-4cd6-bc4d-d8e3151c4b36 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 17:14:11.024623 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-4f3059ed-0d08-4cd6-bc4d-d8e3151c4b36 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 17:14:11.025109 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-4f3059ed-0d08-4cd6-bc4d-d8e3151c4b36 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 17:14:11.025530 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-4f3059ed-0d08-4cd6-bc4d-d8e3151c4b36 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 17:14:11.026240 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-4f3059ed-0d08-4cd6-bc4d-d8e3151c4b36 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 17:14:11.036346 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4f3059ed-0d08-4cd6-bc4d-d8e3151c4b36 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:14:11.036775 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4f3059ed-0d08-4cd6-bc4d-d8e3151c4b36 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:14:11.037225 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4f3059ed-0d08-4cd6-bc4d-d8e3151c4b36 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:14:11.037964 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4f3059ed-0d08-4cd6-bc4d-d8e3151c4b36 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:14:11.038493 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4f3059ed-0d08-4cd6-bc4d-d8e3151c4b36 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:14:11.038933 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4f3059ed-0d08-4cd6-bc4d-d8e3151c4b36 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:14:11.064458 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-4f3059ed-0d08-4cd6-bc4d-d8e3151c4b36 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Getting quotas for project a6f813017c8c40d5978c8550f188dbf7. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 17:14:11.066042 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-4f3059ed-0d08-4cd6-bc4d-d8e3151c4b36 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Getting quotas for user a18fb2c4e622474d943a72025236cca7 and project a6f813017c8c40d5978c8550f188dbf7. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 17:14:11.081208 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4f3059ed-0d08-4cd6-bc4d-d8e3151c4b36 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 17:14:11.083777 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4f3059ed-0d08-4cd6-bc4d-d8e3151c4b36 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 8c1ef2aa-2eaf-45f8-9389-e90c75c18140] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 17:14:11.137578 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4f3059ed-0d08-4cd6-bc4d-d8e3151c4b36 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.805343 Aug 31 17:14:11.139394 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3912/7643] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 17:14:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 17:14:11.154446 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c99d6157-025b-463c-bc2a-27b26ed21c8b tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:14:11.155135 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c99d6157-025b-463c-bc2a-27b26ed21c8b tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 8c1ef2aa-2eaf-45f8-9389-e90c75c18140] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:14:11.158320 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:14:11.241287 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c99d6157-025b-463c-bc2a-27b26ed21c8b tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:14:11.249924 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c99d6157-025b-463c-bc2a-27b26ed21c8b tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140" status: 200 len: 1267 microversion: 2.1 time: 0.099459 Aug 31 17:14:11.251359 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3732/7644] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:14:11 2022] GET /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140 => generated 1267 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:14:12.281990 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d8b6d6a9-7ef2-44d5-bbb6-e54ab90de35a tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:14:12.282861 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d8b6d6a9-7ef2-44d5-bbb6-e54ab90de35a tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 8c1ef2aa-2eaf-45f8-9389-e90c75c18140] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:14:12.292121 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d8b6d6a9-7ef2-44d5-bbb6-e54ab90de35a tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:14:12.292839 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d8b6d6a9-7ef2-44d5-bbb6-e54ab90de35a tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:14:12.293354 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d8b6d6a9-7ef2-44d5-bbb6-e54ab90de35a tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:14:12.294166 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d8b6d6a9-7ef2-44d5-bbb6-e54ab90de35a tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:14:12.294693 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d8b6d6a9-7ef2-44d5-bbb6-e54ab90de35a tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:14:12.295439 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d8b6d6a9-7ef2-44d5-bbb6-e54ab90de35a tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:14:12.373706 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d8b6d6a9-7ef2-44d5-bbb6-e54ab90de35a tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:14:12.381738 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d8b6d6a9-7ef2-44d5-bbb6-e54ab90de35a tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140" status: 200 len: 1327 microversion: 2.1 time: 0.104315 Aug 31 17:14:12.382962 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3913/7645] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:14:12 2022] GET /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140 => generated 1327 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:14:13.404757 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c4c87ec9-6931-4c2d-ba81-269a2f6e54c6 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:14:13.406143 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c4c87ec9-6931-4c2d-ba81-269a2f6e54c6 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 8c1ef2aa-2eaf-45f8-9389-e90c75c18140] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:14:13.413960 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4c87ec9-6931-4c2d-ba81-269a2f6e54c6 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:14:13.414746 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4c87ec9-6931-4c2d-ba81-269a2f6e54c6 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:14:13.415351 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4c87ec9-6931-4c2d-ba81-269a2f6e54c6 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:14:13.416271 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4c87ec9-6931-4c2d-ba81-269a2f6e54c6 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:14:13.416886 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4c87ec9-6931-4c2d-ba81-269a2f6e54c6 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:14:13.417481 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c4c87ec9-6931-4c2d-ba81-269a2f6e54c6 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:14:13.592378 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c4c87ec9-6931-4c2d-ba81-269a2f6e54c6 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:14:13.600940 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c4c87ec9-6931-4c2d-ba81-269a2f6e54c6 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140" status: 200 len: 1392 microversion: 2.1 time: 0.200058 Aug 31 17:14:13.601853 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3733/7646] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:14:13 2022] GET /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140 => generated 1392 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:14:13.823287 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-8f96540e-db11-4f36-ba0f-9da0cde41513 req-98ee7437-2cc4-4858-8f2f-d9b24873d7a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c1ef2aa-2eaf-45f8-9389-e90c75c18140", "tag": "21b25c89-4466-4117-9663-5953b8832a0b"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:14:13.837629 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-8f96540e-db11-4f36-ba0f-9da0cde41513 req-98ee7437-2cc4-4858-8f2f-d9b24873d7a2 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:14:13.838569 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-8f96540e-db11-4f36-ba0f-9da0cde41513 req-98ee7437-2cc4-4858-8f2f-d9b24873d7a2 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:14:13.839337 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-8f96540e-db11-4f36-ba0f-9da0cde41513 req-98ee7437-2cc4-4858-8f2f-d9b24873d7a2 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:14:13.858058 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-8f96540e-db11-4f36-ba0f-9da0cde41513 req-98ee7437-2cc4-4858-8f2f-d9b24873d7a2 service nova] Creating event network-changed:21b25c89-4466-4117-9663-5953b8832a0b for instance 8c1ef2aa-2eaf-45f8-9389-e90c75c18140 on n-h1-833090-16 Aug 31 17:14:13.865356 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-8f96540e-db11-4f36-ba0f-9da0cde41513 req-98ee7437-2cc4-4858-8f2f-d9b24873d7a2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046420 Aug 31 17:14:13.866365 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3914/7647] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:14:14.623594 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-405f69ea-a118-4a36-a68f-ea5b3a4b82cf tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:14:14.624443 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-405f69ea-a118-4a36-a68f-ea5b3a4b82cf tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 8c1ef2aa-2eaf-45f8-9389-e90c75c18140] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:14:14.632550 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-405f69ea-a118-4a36-a68f-ea5b3a4b82cf tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:14:14.633046 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-405f69ea-a118-4a36-a68f-ea5b3a4b82cf tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:14:14.633513 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-405f69ea-a118-4a36-a68f-ea5b3a4b82cf tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:14:14.634240 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-405f69ea-a118-4a36-a68f-ea5b3a4b82cf tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:14:14.634695 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-405f69ea-a118-4a36-a68f-ea5b3a4b82cf tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:14:14.635118 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-405f69ea-a118-4a36-a68f-ea5b3a4b82cf tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:14:14.777235 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-405f69ea-a118-4a36-a68f-ea5b3a4b82cf tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:14:14.785747 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-405f69ea-a118-4a36-a68f-ea5b3a4b82cf tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140" status: 200 len: 1392 microversion: 2.1 time: 0.166360 Aug 31 17:14:14.786391 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3734/7648] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:14:14 2022] GET /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140 => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:14:15.808372 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-185014ba-11fd-47fc-96e8-20e69d11d088 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:14:15.809342 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-185014ba-11fd-47fc-96e8-20e69d11d088 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 8c1ef2aa-2eaf-45f8-9389-e90c75c18140] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:14:15.817305 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-185014ba-11fd-47fc-96e8-20e69d11d088 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:14:15.817763 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-185014ba-11fd-47fc-96e8-20e69d11d088 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:14:15.818272 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-185014ba-11fd-47fc-96e8-20e69d11d088 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:14:15.818996 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-185014ba-11fd-47fc-96e8-20e69d11d088 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:14:15.819464 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-185014ba-11fd-47fc-96e8-20e69d11d088 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:14:15.819899 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-185014ba-11fd-47fc-96e8-20e69d11d088 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:14:15.990375 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-185014ba-11fd-47fc-96e8-20e69d11d088 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:14:15.999039 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-185014ba-11fd-47fc-96e8-20e69d11d088 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140" status: 200 len: 1392 microversion: 2.1 time: 0.195437 Aug 31 17:14:15.999663 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3915/7649] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:14:15 2022] GET /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140 => generated 1392 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:14:17.020898 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-257f0537-00a5-466f-b0c2-a89e120b6594 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:14:17.021533 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-257f0537-00a5-466f-b0c2-a89e120b6594 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 8c1ef2aa-2eaf-45f8-9389-e90c75c18140] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:14:17.028968 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-257f0537-00a5-466f-b0c2-a89e120b6594 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:14:17.029726 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-257f0537-00a5-466f-b0c2-a89e120b6594 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:14:17.029905 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-257f0537-00a5-466f-b0c2-a89e120b6594 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:14:17.030610 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-257f0537-00a5-466f-b0c2-a89e120b6594 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:14:17.031072 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-257f0537-00a5-466f-b0c2-a89e120b6594 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:14:17.031496 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-257f0537-00a5-466f-b0c2-a89e120b6594 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:14:17.178457 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-257f0537-00a5-466f-b0c2-a89e120b6594 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:14:17.191260 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-257f0537-00a5-466f-b0c2-a89e120b6594 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140" status: 200 len: 1392 microversion: 2.1 time: 0.174077 Aug 31 17:14:17.192113 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3735/7650] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:14:17 2022] GET /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140 => generated 1392 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:14:18.217778 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-668e18a8-d083-45cd-be3a-4e087ece1e92 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:14:18.218715 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-668e18a8-d083-45cd-be3a-4e087ece1e92 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 8c1ef2aa-2eaf-45f8-9389-e90c75c18140] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:14:18.227325 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-668e18a8-d083-45cd-be3a-4e087ece1e92 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:14:18.227838 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-668e18a8-d083-45cd-be3a-4e087ece1e92 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:14:18.228264 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-668e18a8-d083-45cd-be3a-4e087ece1e92 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:14:18.229225 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-668e18a8-d083-45cd-be3a-4e087ece1e92 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:14:18.229678 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-668e18a8-d083-45cd-be3a-4e087ece1e92 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:14:18.230388 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-668e18a8-d083-45cd-be3a-4e087ece1e92 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:14:18.387111 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-668e18a8-d083-45cd-be3a-4e087ece1e92 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:14:18.396709 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-668e18a8-d083-45cd-be3a-4e087ece1e92 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140" status: 200 len: 1392 microversion: 2.1 time: 0.183242 Aug 31 17:14:18.397905 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3916/7651] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:14:18 2022] GET /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140 => generated 1392 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:14:19.422144 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f8bf56dc-8cd7-442b-9471-59a2f4b6dac5 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:14:19.422794 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f8bf56dc-8cd7-442b-9471-59a2f4b6dac5 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 8c1ef2aa-2eaf-45f8-9389-e90c75c18140] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:14:19.430440 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8bf56dc-8cd7-442b-9471-59a2f4b6dac5 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:14:19.430826 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8bf56dc-8cd7-442b-9471-59a2f4b6dac5 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:14:19.431267 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8bf56dc-8cd7-442b-9471-59a2f4b6dac5 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:14:19.431964 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8bf56dc-8cd7-442b-9471-59a2f4b6dac5 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:14:19.432415 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8bf56dc-8cd7-442b-9471-59a2f4b6dac5 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:14:19.432835 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f8bf56dc-8cd7-442b-9471-59a2f4b6dac5 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:14:19.576548 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f8bf56dc-8cd7-442b-9471-59a2f4b6dac5 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:14:19.585370 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f8bf56dc-8cd7-442b-9471-59a2f4b6dac5 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140" status: 200 len: 1392 microversion: 2.1 time: 0.168542 Aug 31 17:14:19.585934 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3736/7652] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:14:19 2022] GET /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140 => generated 1392 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:14:20.008730 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-46598c30-d21c-4463-92a4-65b985e1700a req-6cc70c00-5bad-4c82-9160-9a50c67358df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c1ef2aa-2eaf-45f8-9389-e90c75c18140", "name": "network-vif-plugged", "status": "completed", "tag": "21b25c89-4466-4117-9663-5953b8832a0b"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:14:20.021023 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-46598c30-d21c-4463-92a4-65b985e1700a req-6cc70c00-5bad-4c82-9160-9a50c67358df service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:14:20.021770 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-46598c30-d21c-4463-92a4-65b985e1700a req-6cc70c00-5bad-4c82-9160-9a50c67358df service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:14:20.022255 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-46598c30-d21c-4463-92a4-65b985e1700a req-6cc70c00-5bad-4c82-9160-9a50c67358df service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:14:20.033642 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-46598c30-d21c-4463-92a4-65b985e1700a req-6cc70c00-5bad-4c82-9160-9a50c67358df service nova] Creating event network-vif-plugged:21b25c89-4466-4117-9663-5953b8832a0b for instance 8c1ef2aa-2eaf-45f8-9389-e90c75c18140 on n-h1-833090-16 Aug 31 17:14:20.038656 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-46598c30-d21c-4463-92a4-65b985e1700a req-6cc70c00-5bad-4c82-9160-9a50c67358df service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033852 Aug 31 17:14:20.039275 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3917/7653] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:14:20.610835 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-76444d67-9a21-4a14-956a-f1794a18cac9 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:14:20.611471 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-76444d67-9a21-4a14-956a-f1794a18cac9 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 8c1ef2aa-2eaf-45f8-9389-e90c75c18140] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:14:20.619785 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76444d67-9a21-4a14-956a-f1794a18cac9 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:14:20.619785 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76444d67-9a21-4a14-956a-f1794a18cac9 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:14:20.620162 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76444d67-9a21-4a14-956a-f1794a18cac9 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:14:20.620820 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76444d67-9a21-4a14-956a-f1794a18cac9 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:14:20.621314 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76444d67-9a21-4a14-956a-f1794a18cac9 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:14:20.621733 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-76444d67-9a21-4a14-956a-f1794a18cac9 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:14:20.774822 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-76444d67-9a21-4a14-956a-f1794a18cac9 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:14:20.783808 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-76444d67-9a21-4a14-956a-f1794a18cac9 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140" status: 200 len: 1392 microversion: 2.1 time: 0.179570 Aug 31 17:14:20.784375 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3737/7654] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:14:20 2022] GET /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140 => generated 1392 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:14:21.812553 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-99855ad5-8928-419f-bb9e-55db0946641c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:14:21.813558 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-99855ad5-8928-419f-bb9e-55db0946641c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 8c1ef2aa-2eaf-45f8-9389-e90c75c18140] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:14:21.817259 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:14:21.817951 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=6 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:14:21.818771 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:14:21.827324 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-99855ad5-8928-419f-bb9e-55db0946641c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:14:21.827821 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-99855ad5-8928-419f-bb9e-55db0946641c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:14:21.828261 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-99855ad5-8928-419f-bb9e-55db0946641c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:14:21.828970 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-99855ad5-8928-419f-bb9e-55db0946641c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:14:21.829442 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-99855ad5-8928-419f-bb9e-55db0946641c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:14:21.829880 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-99855ad5-8928-419f-bb9e-55db0946641c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:14:21.987674 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-99855ad5-8928-419f-bb9e-55db0946641c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:14:21.999750 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-99855ad5-8928-419f-bb9e-55db0946641c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140" status: 200 len: 1565 microversion: 2.1 time: 0.192135 Aug 31 17:14:22.000851 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3918/7655] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:14:21 2022] GET /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140 => generated 1565 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:14:22.034920 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d509273e-1b08-459f-a468-a4f8efc04c25 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:14:22.035511 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d509273e-1b08-459f-a468-a4f8efc04c25 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 8c1ef2aa-2eaf-45f8-9389-e90c75c18140] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:14:22.037510 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:14:22.044143 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d509273e-1b08-459f-a468-a4f8efc04c25 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:14:22.044628 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d509273e-1b08-459f-a468-a4f8efc04c25 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:14:22.045052 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d509273e-1b08-459f-a468-a4f8efc04c25 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:14:22.045745 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d509273e-1b08-459f-a468-a4f8efc04c25 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:14:22.046232 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d509273e-1b08-459f-a468-a4f8efc04c25 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:14:22.046650 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d509273e-1b08-459f-a468-a4f8efc04c25 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:14:22.185949 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d509273e-1b08-459f-a468-a4f8efc04c25 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:14:22.194431 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d509273e-1b08-459f-a468-a4f8efc04c25 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140" status: 200 len: 1565 microversion: 2.1 time: 0.164116 Aug 31 17:14:22.195025 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3738/7656] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:14:22 2022] GET /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140 => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:14:23.947953 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3cf89541-e206-4af1-a34a-89026895a83e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:14:23.949098 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3cf89541-e206-4af1-a34a-89026895a83e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 8c1ef2aa-2eaf-45f8-9389-e90c75c18140] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:14:23.950143 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-7cf2f3c4-97ac-401e-956c-8cd31fcea573 req-0b120600-83e6-4397-a1df-2d356a73d41b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c1ef2aa-2eaf-45f8-9389-e90c75c18140", "tag": "21b25c89-4466-4117-9663-5953b8832a0b"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:14:23.960836 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3cf89541-e206-4af1-a34a-89026895a83e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:14:23.961915 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3cf89541-e206-4af1-a34a-89026895a83e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:14:23.962759 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3cf89541-e206-4af1-a34a-89026895a83e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:14:23.964003 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3cf89541-e206-4af1-a34a-89026895a83e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:14:23.964911 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3cf89541-e206-4af1-a34a-89026895a83e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:14:23.965736 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3cf89541-e206-4af1-a34a-89026895a83e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:14:23.967692 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7cf2f3c4-97ac-401e-956c-8cd31fcea573 req-0b120600-83e6-4397-a1df-2d356a73d41b service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:14:23.968507 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7cf2f3c4-97ac-401e-956c-8cd31fcea573 req-0b120600-83e6-4397-a1df-2d356a73d41b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:14:23.969837 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7cf2f3c4-97ac-401e-956c-8cd31fcea573 req-0b120600-83e6-4397-a1df-2d356a73d41b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:14:23.989786 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-7cf2f3c4-97ac-401e-956c-8cd31fcea573 req-0b120600-83e6-4397-a1df-2d356a73d41b service nova] Creating event network-changed:21b25c89-4466-4117-9663-5953b8832a0b for instance 8c1ef2aa-2eaf-45f8-9389-e90c75c18140 on n-h1-833090-16 Aug 31 17:14:23.998376 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-7cf2f3c4-97ac-401e-956c-8cd31fcea573 req-0b120600-83e6-4397-a1df-2d356a73d41b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054343 Aug 31 17:14:23.999209 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3739/7657] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:14:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:14:24.128086 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3cf89541-e206-4af1-a34a-89026895a83e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:14:24.137331 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3cf89541-e206-4af1-a34a-89026895a83e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140" status: 200 len: 1565 microversion: 2.1 time: 0.196018 Aug 31 17:14:24.143496 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3919/7658] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:14:23 2022] GET /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140 => generated 1565 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:14:45.418070 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:14:45.418866 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=38 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:14:45.423501 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-10cff93d-f2c3-421a-8274-c83bc0f7b90f tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:14:45.425818 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-10cff93d-f2c3-421a-8274-c83bc0f7b90f tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 8c1ef2aa-2eaf-45f8-9389-e90c75c18140] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:14:45.433451 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10cff93d-f2c3-421a-8274-c83bc0f7b90f tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:14:45.433933 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10cff93d-f2c3-421a-8274-c83bc0f7b90f tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:14:45.434402 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10cff93d-f2c3-421a-8274-c83bc0f7b90f tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:14:45.435100 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10cff93d-f2c3-421a-8274-c83bc0f7b90f tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:14:45.435554 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10cff93d-f2c3-421a-8274-c83bc0f7b90f tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:14:45.435974 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-10cff93d-f2c3-421a-8274-c83bc0f7b90f tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:14:45.492111 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-10cff93d-f2c3-421a-8274-c83bc0f7b90f tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "POST /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140/action" status: 200 len: 24566 microversion: 2.1 time: 0.075349 Aug 31 17:14:45.493484 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3740/7659] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 17:14:45 2022] POST /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140/action => generated 24566 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 17:14:56.199169 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e465e894-3ac6-4047-a244-c1f4f25d2a3e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:14:56.201751 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=3 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:14:56.202463 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=36 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:14:56.211605 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e465e894-3ac6-4047-a244-c1f4f25d2a3e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:14:56.212404 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e465e894-3ac6-4047-a244-c1f4f25d2a3e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:14:56.212980 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e465e894-3ac6-4047-a244-c1f4f25d2a3e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:14:56.244019 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e465e894-3ac6-4047-a244-c1f4f25d2a3e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 8c1ef2aa-2eaf-45f8-9389-e90c75c18140] Going to try to stop instance {{(pid=128864) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 31 17:14:56.299803 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e465e894-3ac6-4047-a244-c1f4f25d2a3e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "POST /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140/action" status: 202 len: 0 microversion: 2.1 time: 0.104191 Aug 31 17:14:56.300751 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3920/7660] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 17:14:56 2022] POST /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:14:56.311234 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8bc915ca-d91b-40d3-9da7-544650c961b2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:14:56.312042 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8bc915ca-d91b-40d3-9da7-544650c961b2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 8c1ef2aa-2eaf-45f8-9389-e90c75c18140] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:14:56.315984 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:14:56.316753 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:14:56.323610 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8bc915ca-d91b-40d3-9da7-544650c961b2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:14:56.324097 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8bc915ca-d91b-40d3-9da7-544650c961b2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:14:56.324528 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8bc915ca-d91b-40d3-9da7-544650c961b2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:14:56.325234 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8bc915ca-d91b-40d3-9da7-544650c961b2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:14:56.326043 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8bc915ca-d91b-40d3-9da7-544650c961b2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:14:56.326493 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8bc915ca-d91b-40d3-9da7-544650c961b2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:14:56.468370 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8bc915ca-d91b-40d3-9da7-544650c961b2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:14:56.476433 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8bc915ca-d91b-40d3-9da7-544650c961b2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140" status: 200 len: 1693 microversion: 2.1 time: 0.170355 Aug 31 17:14:56.477037 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3741/7661] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:14:56 2022] GET /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140 => generated 1693 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:14:57.500213 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ffca144f-13b8-43a2-bec6-ab731c2ea04a tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:14:57.500904 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ffca144f-13b8-43a2-bec6-ab731c2ea04a tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 8c1ef2aa-2eaf-45f8-9389-e90c75c18140] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:14:57.507975 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ffca144f-13b8-43a2-bec6-ab731c2ea04a tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:14:57.508470 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ffca144f-13b8-43a2-bec6-ab731c2ea04a tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:14:57.508912 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ffca144f-13b8-43a2-bec6-ab731c2ea04a tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:14:57.509614 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ffca144f-13b8-43a2-bec6-ab731c2ea04a tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:14:57.510070 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ffca144f-13b8-43a2-bec6-ab731c2ea04a tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:14:57.510548 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ffca144f-13b8-43a2-bec6-ab731c2ea04a tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:14:57.653599 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ffca144f-13b8-43a2-bec6-ab731c2ea04a tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:14:57.661855 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ffca144f-13b8-43a2-bec6-ab731c2ea04a tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140" status: 200 len: 1693 microversion: 2.1 time: 0.167376 Aug 31 17:14:57.662498 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3921/7662] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:14:57 2022] GET /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140 => generated 1693 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:14:58.692376 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4b5cad45-ef14-4a12-b7f9-07b6c8b03a81 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:14:58.692956 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4b5cad45-ef14-4a12-b7f9-07b6c8b03a81 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 8c1ef2aa-2eaf-45f8-9389-e90c75c18140] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:14:58.701498 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b5cad45-ef14-4a12-b7f9-07b6c8b03a81 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:14:58.701982 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b5cad45-ef14-4a12-b7f9-07b6c8b03a81 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:14:58.702960 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b5cad45-ef14-4a12-b7f9-07b6c8b03a81 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:14:58.703683 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b5cad45-ef14-4a12-b7f9-07b6c8b03a81 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:14:58.704454 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b5cad45-ef14-4a12-b7f9-07b6c8b03a81 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:14:58.704888 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4b5cad45-ef14-4a12-b7f9-07b6c8b03a81 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:14:58.871238 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4b5cad45-ef14-4a12-b7f9-07b6c8b03a81 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:14:58.882906 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4b5cad45-ef14-4a12-b7f9-07b6c8b03a81 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140" status: 200 len: 1693 microversion: 2.1 time: 0.194673 Aug 31 17:14:58.883709 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3742/7663] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:14:58 2022] GET /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140 => generated 1693 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:14:59.915099 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-db128323-7e96-4bd9-9fde-3ef2d754ccb1 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:14:59.915688 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-db128323-7e96-4bd9-9fde-3ef2d754ccb1 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 8c1ef2aa-2eaf-45f8-9389-e90c75c18140] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:14:59.923948 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db128323-7e96-4bd9-9fde-3ef2d754ccb1 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:14:59.924525 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db128323-7e96-4bd9-9fde-3ef2d754ccb1 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:14:59.924975 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db128323-7e96-4bd9-9fde-3ef2d754ccb1 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:14:59.925701 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db128323-7e96-4bd9-9fde-3ef2d754ccb1 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:14:59.926181 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db128323-7e96-4bd9-9fde-3ef2d754ccb1 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:14:59.926649 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-db128323-7e96-4bd9-9fde-3ef2d754ccb1 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:15:00.072020 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-db128323-7e96-4bd9-9fde-3ef2d754ccb1 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:15:00.081232 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-db128323-7e96-4bd9-9fde-3ef2d754ccb1 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140" status: 200 len: 1693 microversion: 2.1 time: 0.170887 Aug 31 17:15:00.081824 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3922/7664] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:14:59 2022] GET /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140 => generated 1693 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:15:01.106720 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-340a91ae-c657-4454-9f5e-f1cd9c1dbf86 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:15:01.107415 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-340a91ae-c657-4454-9f5e-f1cd9c1dbf86 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 8c1ef2aa-2eaf-45f8-9389-e90c75c18140] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:15:01.115465 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-340a91ae-c657-4454-9f5e-f1cd9c1dbf86 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:15:01.116009 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-340a91ae-c657-4454-9f5e-f1cd9c1dbf86 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:15:01.116491 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-340a91ae-c657-4454-9f5e-f1cd9c1dbf86 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:15:01.117265 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-340a91ae-c657-4454-9f5e-f1cd9c1dbf86 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:15:01.117767 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-340a91ae-c657-4454-9f5e-f1cd9c1dbf86 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:15:01.118279 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-340a91ae-c657-4454-9f5e-f1cd9c1dbf86 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:15:01.261640 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-340a91ae-c657-4454-9f5e-f1cd9c1dbf86 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:15:01.273402 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-340a91ae-c657-4454-9f5e-f1cd9c1dbf86 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140" status: 200 len: 1693 microversion: 2.1 time: 0.172690 Aug 31 17:15:01.274252 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3743/7665] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:15:01 2022] GET /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140 => generated 1693 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:15:02.298781 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f45192cd-c726-4947-9a00-088544d8d8dc tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:15:02.299598 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f45192cd-c726-4947-9a00-088544d8d8dc tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 8c1ef2aa-2eaf-45f8-9389-e90c75c18140] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:15:02.309579 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f45192cd-c726-4947-9a00-088544d8d8dc tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:15:02.310071 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f45192cd-c726-4947-9a00-088544d8d8dc tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:15:02.310542 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f45192cd-c726-4947-9a00-088544d8d8dc tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:15:02.311246 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f45192cd-c726-4947-9a00-088544d8d8dc tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:15:02.311700 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f45192cd-c726-4947-9a00-088544d8d8dc tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:15:02.312130 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f45192cd-c726-4947-9a00-088544d8d8dc tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:15:02.467940 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f45192cd-c726-4947-9a00-088544d8d8dc tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:15:02.480249 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f45192cd-c726-4947-9a00-088544d8d8dc tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140" status: 200 len: 1693 microversion: 2.1 time: 0.187635 Aug 31 17:15:02.480845 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3923/7666] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:15:02 2022] GET /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140 => generated 1693 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:15:03.502601 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6df13c12-ed2a-42a6-af28-161ff9fbd820 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:15:03.503253 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6df13c12-ed2a-42a6-af28-161ff9fbd820 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 8c1ef2aa-2eaf-45f8-9389-e90c75c18140] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:15:03.511336 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6df13c12-ed2a-42a6-af28-161ff9fbd820 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:15:03.511984 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6df13c12-ed2a-42a6-af28-161ff9fbd820 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:15:03.512481 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6df13c12-ed2a-42a6-af28-161ff9fbd820 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:15:03.513282 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6df13c12-ed2a-42a6-af28-161ff9fbd820 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:15:03.513812 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6df13c12-ed2a-42a6-af28-161ff9fbd820 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:15:03.514316 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6df13c12-ed2a-42a6-af28-161ff9fbd820 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:15:03.657592 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6df13c12-ed2a-42a6-af28-161ff9fbd820 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:15:03.665751 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6df13c12-ed2a-42a6-af28-161ff9fbd820 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140" status: 200 len: 1693 microversion: 2.1 time: 0.167584 Aug 31 17:15:03.666363 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3744/7667] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:15:03 2022] GET /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140 => generated 1693 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:15:04.687789 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-83f99b60-c6a8-4df6-8473-e71ebf99aa11 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:15:04.688368 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-83f99b60-c6a8-4df6-8473-e71ebf99aa11 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 8c1ef2aa-2eaf-45f8-9389-e90c75c18140] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:15:04.695436 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83f99b60-c6a8-4df6-8473-e71ebf99aa11 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:15:04.695934 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83f99b60-c6a8-4df6-8473-e71ebf99aa11 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:15:04.696384 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83f99b60-c6a8-4df6-8473-e71ebf99aa11 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:15:04.697129 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83f99b60-c6a8-4df6-8473-e71ebf99aa11 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:15:04.697592 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83f99b60-c6a8-4df6-8473-e71ebf99aa11 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:15:04.698140 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-83f99b60-c6a8-4df6-8473-e71ebf99aa11 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:15:04.833668 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-83f99b60-c6a8-4df6-8473-e71ebf99aa11 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:15:04.842150 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-83f99b60-c6a8-4df6-8473-e71ebf99aa11 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140" status: 200 len: 1693 microversion: 2.1 time: 0.158725 Aug 31 17:15:04.842735 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3924/7668] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:15:04 2022] GET /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140 => generated 1693 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:15:05.866763 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7da2b852-c45e-4ef4-8e67-c4366ab885a7 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:15:05.867387 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7da2b852-c45e-4ef4-8e67-c4366ab885a7 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 8c1ef2aa-2eaf-45f8-9389-e90c75c18140] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:15:05.876013 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7da2b852-c45e-4ef4-8e67-c4366ab885a7 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:15:05.876499 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7da2b852-c45e-4ef4-8e67-c4366ab885a7 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:15:05.876929 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7da2b852-c45e-4ef4-8e67-c4366ab885a7 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:15:05.877620 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7da2b852-c45e-4ef4-8e67-c4366ab885a7 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:15:05.878070 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7da2b852-c45e-4ef4-8e67-c4366ab885a7 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:15:05.878522 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7da2b852-c45e-4ef4-8e67-c4366ab885a7 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:15:06.025397 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7da2b852-c45e-4ef4-8e67-c4366ab885a7 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:15:06.034687 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7da2b852-c45e-4ef4-8e67-c4366ab885a7 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140" status: 200 len: 1693 microversion: 2.1 time: 0.174324 Aug 31 17:15:06.035302 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3745/7669] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:15:05 2022] GET /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140 => generated 1693 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:15:07.058057 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-70e11109-ae43-4d7b-82fa-7bb867c76463 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:15:07.059221 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-70e11109-ae43-4d7b-82fa-7bb867c76463 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 8c1ef2aa-2eaf-45f8-9389-e90c75c18140] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:15:07.066875 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-70e11109-ae43-4d7b-82fa-7bb867c76463 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:15:07.067377 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-70e11109-ae43-4d7b-82fa-7bb867c76463 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:15:07.067831 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-70e11109-ae43-4d7b-82fa-7bb867c76463 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:15:07.068541 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-70e11109-ae43-4d7b-82fa-7bb867c76463 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:15:07.069012 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-70e11109-ae43-4d7b-82fa-7bb867c76463 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:15:07.069495 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-70e11109-ae43-4d7b-82fa-7bb867c76463 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:15:07.212207 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-70e11109-ae43-4d7b-82fa-7bb867c76463 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:15:07.222036 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-70e11109-ae43-4d7b-82fa-7bb867c76463 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140" status: 200 len: 1670 microversion: 2.1 time: 0.167874 Aug 31 17:15:07.222691 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3925/7670] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:15:07 2022] GET /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140 => generated 1670 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:15:08.331465 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-751b7485-e1ed-41ac-8a3e-c5d83bd1e452 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:15:08.333602 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-751b7485-e1ed-41ac-8a3e-c5d83bd1e452 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 8c1ef2aa-2eaf-45f8-9389-e90c75c18140] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:15:08.341668 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-751b7485-e1ed-41ac-8a3e-c5d83bd1e452 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:15:08.342234 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-751b7485-e1ed-41ac-8a3e-c5d83bd1e452 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:15:08.342676 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-751b7485-e1ed-41ac-8a3e-c5d83bd1e452 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:15:08.343386 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-751b7485-e1ed-41ac-8a3e-c5d83bd1e452 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:15:08.343844 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-751b7485-e1ed-41ac-8a3e-c5d83bd1e452 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:15:08.344267 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-751b7485-e1ed-41ac-8a3e-c5d83bd1e452 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:15:08.397120 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-751b7485-e1ed-41ac-8a3e-c5d83bd1e452 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "POST /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140/action" status: 200 len: 38380 microversion: 2.1 time: 0.069693 Aug 31 17:15:08.397820 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3746/7671] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 17:15:08 2022] POST /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140/action => generated 38380 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 17:15:08.411952 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d7c19d46-9f45-47d1-8035-a5911db4c92e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:15:08.419884 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d7c19d46-9f45-47d1-8035-a5911db4c92e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:15:08.420399 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d7c19d46-9f45-47d1-8035-a5911db4c92e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:15:08.420852 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d7c19d46-9f45-47d1-8035-a5911db4c92e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:15:08.445918 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d7c19d46-9f45-47d1-8035-a5911db4c92e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 8c1ef2aa-2eaf-45f8-9389-e90c75c18140] Going to try to start instance {{(pid=128864) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 31 17:15:08.491026 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d7c19d46-9f45-47d1-8035-a5911db4c92e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "POST /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140/action" status: 202 len: 0 microversion: 2.1 time: 0.083193 Aug 31 17:15:08.491638 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3926/7672] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 17:15:08 2022] POST /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:15:08.501658 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-03386910-18ec-46f4-b029-cb79c07a01f4 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:15:08.502396 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-03386910-18ec-46f4-b029-cb79c07a01f4 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 8c1ef2aa-2eaf-45f8-9389-e90c75c18140] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:15:08.509548 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03386910-18ec-46f4-b029-cb79c07a01f4 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:15:08.510446 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03386910-18ec-46f4-b029-cb79c07a01f4 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:15:08.510875 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03386910-18ec-46f4-b029-cb79c07a01f4 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:15:08.511569 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03386910-18ec-46f4-b029-cb79c07a01f4 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:15:08.512064 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03386910-18ec-46f4-b029-cb79c07a01f4 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:15:08.512461 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-03386910-18ec-46f4-b029-cb79c07a01f4 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:15:08.659593 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-03386910-18ec-46f4-b029-cb79c07a01f4 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:15:08.667928 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-03386910-18ec-46f4-b029-cb79c07a01f4 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140" status: 200 len: 1679 microversion: 2.1 time: 0.170714 Aug 31 17:15:08.668830 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3747/7673] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:15:08 2022] GET /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140 => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:15:09.698988 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-49ce49c8-6392-4b54-8f53-cdb0f1f2804e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:15:09.699668 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-49ce49c8-6392-4b54-8f53-cdb0f1f2804e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 8c1ef2aa-2eaf-45f8-9389-e90c75c18140] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:15:09.710301 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-49ce49c8-6392-4b54-8f53-cdb0f1f2804e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:15:09.710979 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-49ce49c8-6392-4b54-8f53-cdb0f1f2804e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:15:09.711679 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-49ce49c8-6392-4b54-8f53-cdb0f1f2804e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:15:09.712716 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-49ce49c8-6392-4b54-8f53-cdb0f1f2804e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:15:09.713359 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-49ce49c8-6392-4b54-8f53-cdb0f1f2804e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:15:09.713905 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-49ce49c8-6392-4b54-8f53-cdb0f1f2804e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:15:09.855171 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-49ce49c8-6392-4b54-8f53-cdb0f1f2804e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:15:09.864845 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-49ce49c8-6392-4b54-8f53-cdb0f1f2804e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140" status: 200 len: 1683 microversion: 2.1 time: 0.177900 Aug 31 17:15:09.865645 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3927/7674] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:15:09 2022] GET /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140 => generated 1683 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:15:34.113461 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d9282748-41cb-4beb-9f3b-367bb2f6ab31 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:15:34.115711 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d9282748-41cb-4beb-9f3b-367bb2f6ab31 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 8c1ef2aa-2eaf-45f8-9389-e90c75c18140] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:15:34.118493 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=14 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:15:34.119163 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=40 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:15:34.125183 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9282748-41cb-4beb-9f3b-367bb2f6ab31 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:15:34.125672 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9282748-41cb-4beb-9f3b-367bb2f6ab31 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:15:34.126118 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9282748-41cb-4beb-9f3b-367bb2f6ab31 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:15:34.126903 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9282748-41cb-4beb-9f3b-367bb2f6ab31 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:15:34.127343 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9282748-41cb-4beb-9f3b-367bb2f6ab31 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:15:34.127774 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d9282748-41cb-4beb-9f3b-367bb2f6ab31 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:15:34.183935 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d9282748-41cb-4beb-9f3b-367bb2f6ab31 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "POST /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140/action" status: 200 len: 62941 microversion: 2.1 time: 0.074367 Aug 31 17:15:34.184545 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3748/7675] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 17:15:34 2022] POST /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140/action => generated 62941 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 17:15:41.595118 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-bf17b192-be7b-402c-937a-577e9f5e691f tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:15:41.596391 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-bf17b192-be7b-402c-937a-577e9f5e691f tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 8c1ef2aa-2eaf-45f8-9389-e90c75c18140] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:15:41.597629 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-8509846a-75a9-4718-bb54-8e7b44f90f66 req-12aba0ad-ccc7-4fd9-9997-ee6054bc8a9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c1ef2aa-2eaf-45f8-9389-e90c75c18140", "tag": "21b25c89-4466-4117-9663-5953b8832a0b"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:15:41.601024 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=16 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:15:41.602460 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:15:41.609744 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bf17b192-be7b-402c-937a-577e9f5e691f tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:15:41.610618 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bf17b192-be7b-402c-937a-577e9f5e691f tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:15:41.611070 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bf17b192-be7b-402c-937a-577e9f5e691f tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:15:41.611824 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bf17b192-be7b-402c-937a-577e9f5e691f tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:15:41.612470 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bf17b192-be7b-402c-937a-577e9f5e691f tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:15:41.613099 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bf17b192-be7b-402c-937a-577e9f5e691f tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:15:41.615159 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8509846a-75a9-4718-bb54-8e7b44f90f66 req-12aba0ad-ccc7-4fd9-9997-ee6054bc8a9d service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:15:41.615524 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8509846a-75a9-4718-bb54-8e7b44f90f66 req-12aba0ad-ccc7-4fd9-9997-ee6054bc8a9d service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:15:41.615957 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-8509846a-75a9-4718-bb54-8e7b44f90f66 req-12aba0ad-ccc7-4fd9-9997-ee6054bc8a9d service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:15:41.629399 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-8509846a-75a9-4718-bb54-8e7b44f90f66 req-12aba0ad-ccc7-4fd9-9997-ee6054bc8a9d service nova] Creating event network-changed:21b25c89-4466-4117-9663-5953b8832a0b for instance 8c1ef2aa-2eaf-45f8-9389-e90c75c18140 on n-h1-833090-16 Aug 31 17:15:41.634921 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-8509846a-75a9-4718-bb54-8e7b44f90f66 req-12aba0ad-ccc7-4fd9-9997-ee6054bc8a9d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041279 Aug 31 17:15:41.639020 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3749/7676] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:15:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:15:41.649476 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-bf17b192-be7b-402c-937a-577e9f5e691f tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 8c1ef2aa-2eaf-45f8-9389-e90c75c18140] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 17:15:41.741477 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-bf17b192-be7b-402c-937a-577e9f5e691f tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "DELETE /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140" status: 204 len: 0 microversion: 2.1 time: 0.150100 Aug 31 17:15:41.743087 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3928/7677] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 17:15:41 2022] DELETE /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 17:15:41.752799 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6173f393-327c-4192-8122-1cb157ab77e2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:15:41.753508 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6173f393-327c-4192-8122-1cb157ab77e2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 8c1ef2aa-2eaf-45f8-9389-e90c75c18140] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:15:41.760215 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6173f393-327c-4192-8122-1cb157ab77e2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:15:41.760960 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6173f393-327c-4192-8122-1cb157ab77e2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:15:41.761660 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6173f393-327c-4192-8122-1cb157ab77e2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:15:41.762498 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6173f393-327c-4192-8122-1cb157ab77e2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:15:41.763035 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6173f393-327c-4192-8122-1cb157ab77e2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:15:41.763855 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6173f393-327c-4192-8122-1cb157ab77e2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:15:41.974827 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6173f393-327c-4192-8122-1cb157ab77e2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:15:41.982757 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6173f393-327c-4192-8122-1cb157ab77e2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140" status: 200 len: 1689 microversion: 2.1 time: 0.234839 Aug 31 17:15:41.983364 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3750/7678] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:15:41 2022] GET /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140 => generated 1689 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:15:43.006332 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-aaefaebb-7f4b-4e09-8ea8-81dc264010e3 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:15:43.007059 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-aaefaebb-7f4b-4e09-8ea8-81dc264010e3 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 8c1ef2aa-2eaf-45f8-9389-e90c75c18140] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:15:43.014721 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aaefaebb-7f4b-4e09-8ea8-81dc264010e3 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:15:43.015220 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aaefaebb-7f4b-4e09-8ea8-81dc264010e3 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:15:43.015670 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aaefaebb-7f4b-4e09-8ea8-81dc264010e3 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:15:43.016379 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aaefaebb-7f4b-4e09-8ea8-81dc264010e3 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:15:43.016854 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aaefaebb-7f4b-4e09-8ea8-81dc264010e3 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:15:43.017289 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aaefaebb-7f4b-4e09-8ea8-81dc264010e3 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:15:43.207336 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-aaefaebb-7f4b-4e09-8ea8-81dc264010e3 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:15:43.215694 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-aaefaebb-7f4b-4e09-8ea8-81dc264010e3 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140" status: 200 len: 1689 microversion: 2.1 time: 0.213962 Aug 31 17:15:43.216560 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3929/7679] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:15:43 2022] GET /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140 => generated 1689 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:15:43.794652 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-109e62ce-883f-443a-ae53-41f4e22332bf req-d872ad03-582f-4e2b-8c59-374a325c0d04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c1ef2aa-2eaf-45f8-9389-e90c75c18140", "name": "network-vif-deleted", "tag": "21b25c89-4466-4117-9663-5953b8832a0b"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:15:43.808051 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-109e62ce-883f-443a-ae53-41f4e22332bf req-d872ad03-582f-4e2b-8c59-374a325c0d04 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:15:43.808525 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-109e62ce-883f-443a-ae53-41f4e22332bf req-d872ad03-582f-4e2b-8c59-374a325c0d04 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:15:43.808950 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-109e62ce-883f-443a-ae53-41f4e22332bf req-d872ad03-582f-4e2b-8c59-374a325c0d04 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:15:43.822030 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-109e62ce-883f-443a-ae53-41f4e22332bf req-d872ad03-582f-4e2b-8c59-374a325c0d04 service nova] Creating event network-vif-deleted:21b25c89-4466-4117-9663-5953b8832a0b for instance 8c1ef2aa-2eaf-45f8-9389-e90c75c18140 on n-h1-833090-16 Aug 31 17:15:43.828168 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-109e62ce-883f-443a-ae53-41f4e22332bf req-d872ad03-582f-4e2b-8c59-374a325c0d04 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037149 Aug 31 17:15:43.828924 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3751/7680] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 17:15:44.239173 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0114bc5a-95f7-477d-83cf-3cf003535782 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:15:44.240990 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0114bc5a-95f7-477d-83cf-3cf003535782 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 8c1ef2aa-2eaf-45f8-9389-e90c75c18140] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:15:44.248528 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0114bc5a-95f7-477d-83cf-3cf003535782 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:15:44.249186 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0114bc5a-95f7-477d-83cf-3cf003535782 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:15:44.249647 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0114bc5a-95f7-477d-83cf-3cf003535782 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:15:44.250387 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0114bc5a-95f7-477d-83cf-3cf003535782 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:15:44.250877 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0114bc5a-95f7-477d-83cf-3cf003535782 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:15:44.251320 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0114bc5a-95f7-477d-83cf-3cf003535782 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:15:44.286125 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0114bc5a-95f7-477d-83cf-3cf003535782 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:15:44.286746 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0114bc5a-95f7-477d-83cf-3cf003535782 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:15:44.287292 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0114bc5a-95f7-477d-83cf-3cf003535782 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:15:44.287803 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-0114bc5a-95f7-477d-83cf-3cf003535782 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lazy-loading 'fault' on Instance uuid 8c1ef2aa-2eaf-45f8-9389-e90c75c18140 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 17:15:44.334440 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0114bc5a-95f7-477d-83cf-3cf003535782 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:15:44.342591 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0114bc5a-95f7-477d-83cf-3cf003535782 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140" status: 200 len: 1357 microversion: 2.1 time: 0.107480 Aug 31 17:15:44.343221 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3930/7681] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:15:44 2022] GET /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140 => generated 1357 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:15:45.373468 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4254ae52-a718-41da-8ddf-63e45eb61c2d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:15:45.374379 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4254ae52-a718-41da-8ddf-63e45eb61c2d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: 8c1ef2aa-2eaf-45f8-9389-e90c75c18140] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:15:45.384739 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4254ae52-a718-41da-8ddf-63e45eb61c2d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:15:45.385234 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4254ae52-a718-41da-8ddf-63e45eb61c2d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:15:45.385697 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4254ae52-a718-41da-8ddf-63e45eb61c2d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:15:45.386441 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4254ae52-a718-41da-8ddf-63e45eb61c2d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:15:45.386892 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4254ae52-a718-41da-8ddf-63e45eb61c2d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:15:45.387314 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4254ae52-a718-41da-8ddf-63e45eb61c2d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:15:45.403878 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-4254ae52-a718-41da-8ddf-63e45eb61c2d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] HTTP exception thrown: Instance 8c1ef2aa-2eaf-45f8-9389-e90c75c18140 could not be found. Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4254ae52-a718-41da-8ddf-63e45eb61c2d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Request method failure captured: Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140 HTTP/1.1 Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD5UwnC35Vn5evFApyVfskHdEHcvv0VSRxaZ9pzKW96Fqt51iHq5jLe56IGhM36ZgCFwb3_2IfN9Wxbd_wUAkzwS08XpxCxoP856myVMcw20sYLpddPhTMaAFpoi0Qlpqj4GXCEBMwRUEqexdDDa6EuUjH1_09epMJ_p9WzfxJnmlCRg Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: a6f813017c8c40d5978c8550f188dbf7 Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1147621593 Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a6f813017c8c40d5978c8550f188dbf7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a6f813017c8c40d5978c8550f188dbf7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a6f813017c8c40d5978c8550f188dbf7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a6f813017c8c40d5978c8550f188dbf7", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1147621593 Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: a6f813017c8c40d5978c8550f188dbf7 Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1147621593 Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-TestNetworkAdvancedServerOps-1147621593-project Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: a18fb2c4e622474d943a72025236cca7 Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1147621593-project Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 8c1ef2aa-2eaf-45f8-9389-e90c75c18140 could not be found. Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '8c1ef2aa-2eaf-45f8-9389-e90c75c18140'} Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c1ef2aa-2eaf-45f8-9389-e90c75c18140 could not be found. Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c1ef2aa-2eaf-45f8-9389-e90c75c18140 could not be found. Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 17:15:45.405580 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:15:45.412255 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 17:15:45.412255 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:15:45.412255 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:15:45.412255 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:15:45.412255 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 17:15:45.412255 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 17:15:45.412255 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c1ef2aa-2eaf-45f8-9389-e90c75c18140 could not be found. Aug 31 17:15:45.412255 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 17:15:45.412255 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4254ae52-a718-41da-8ddf-63e45eb61c2d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Returning 404 to user: Instance 8c1ef2aa-2eaf-45f8-9389-e90c75c18140 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 17:15:45.412255 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4254ae52-a718-41da-8ddf-63e45eb61c2d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140" status: 404 len: 111 microversion: 2.1 time: 0.041929 Aug 31 17:15:45.412255 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3752/7682] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:15:45 2022] GET /compute/v2.1/servers/8c1ef2aa-2eaf-45f8-9389-e90c75c18140 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 17:15:48.939517 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-bfab5435-d3c1-46a8-87d2-862f9a70d04d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '.version_select at 0x7fbb4551a670>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:15:48.963462 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-bfab5435-d3c1-46a8-87d2-862f9a70d04d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1818596774" status: 202 len: 0 microversion: 2.1 time: 0.027850 Aug 31 17:15:48.964177 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3931/7683] 10.222.0.50 () {58 vars in 1284 bytes} [Wed Aug 31 17:15:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1818596774 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:15:48.998074 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-87b108e2-1ef5-49f2-9903-24b4d23cf054 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Action: 'create', calling method: .version_select at 0x7fbb4aa5caf0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1072663085", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0EjKpHeoBK4rhBXBhm9XLNaDZe6H2ZvLWjHYiOzDxpbd/PrpCHpsOtbMp3akzZatyL1kIZvrC05RUX8Uo2gU0iw1rFawCW2YeIflbSeRA6VxTuyMO/j3pF5fSRK6FPLw=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:15:49.015512 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-87b108e2-1ef5-49f2-9903-24b4d23cf054 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Getting quotas for project a6f813017c8c40d5978c8550f188dbf7. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 17:15:49.021589 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-87b108e2-1ef5-49f2-9903-24b4d23cf054 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Getting quotas for user a18fb2c4e622474d943a72025236cca7 and project a6f813017c8c40d5978c8550f188dbf7. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 17:15:49.048368 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-87b108e2-1ef5-49f2-9903-24b4d23cf054 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.054313 Aug 31 17:15:49.049009 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3753/7684] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 31 17:15:48 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:15:54.961916 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:15:54.967690 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-76f5b8f0-3da4-4f0d-91d1-26515baf8a4d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-397161169", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "networks": [{"uuid": "aa94267a-64f1-4a8e-b9b1-c7d6c6aa9a84"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1072663085", "security_groups": [{"name": "tempest-secgroup-smoke-193569182"}]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:15:55.102390 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-76f5b8f0-3da4-4f0d-91d1-26515baf8a4d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] validate_networks() for [('aa94267a-64f1-4a8e-b9b1-c7d6c6aa9a84', None, None, None, None, None)] {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 17:15:55.538906 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-76f5b8f0-3da4-4f0d-91d1-26515baf8a4d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 17:15:55.539539 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-76f5b8f0-3da4-4f0d-91d1-26515baf8a4d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 17:15:55.540381 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-76f5b8f0-3da4-4f0d-91d1-26515baf8a4d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 17:15:55.540924 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-76f5b8f0-3da4-4f0d-91d1-26515baf8a4d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 17:15:55.541470 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-76f5b8f0-3da4-4f0d-91d1-26515baf8a4d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 17:15:55.553707 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76f5b8f0-3da4-4f0d-91d1-26515baf8a4d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:15:55.554231 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76f5b8f0-3da4-4f0d-91d1-26515baf8a4d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:15:55.554697 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76f5b8f0-3da4-4f0d-91d1-26515baf8a4d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:15:55.555451 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76f5b8f0-3da4-4f0d-91d1-26515baf8a4d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:15:55.555897 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76f5b8f0-3da4-4f0d-91d1-26515baf8a4d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:15:55.556327 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-76f5b8f0-3da4-4f0d-91d1-26515baf8a4d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:15:55.577625 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-76f5b8f0-3da4-4f0d-91d1-26515baf8a4d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Getting quotas for project a6f813017c8c40d5978c8550f188dbf7. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 17:15:55.585986 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-76f5b8f0-3da4-4f0d-91d1-26515baf8a4d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Getting quotas for user a18fb2c4e622474d943a72025236cca7 and project a6f813017c8c40d5978c8550f188dbf7. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 17:15:55.600692 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-76f5b8f0-3da4-4f0d-91d1-26515baf8a4d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 17:15:55.603762 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-76f5b8f0-3da4-4f0d-91d1-26515baf8a4d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: a30cb5ea-4df7-404e-9d02-07ec9fd28273] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 17:15:55.672300 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-76f5b8f0-3da4-4f0d-91d1-26515baf8a4d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.712068 Aug 31 17:15:55.678246 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3932/7685] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 17:15:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 17:15:55.686172 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-72992f1a-0207-402c-bdce-cf0971d0b9fa tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:15:55.686172 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-72992f1a-0207-402c-bdce-cf0971d0b9fa tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: a30cb5ea-4df7-404e-9d02-07ec9fd28273] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:15:55.690035 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=16 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:15:55.749770 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-72992f1a-0207-402c-bdce-cf0971d0b9fa tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:15:55.757561 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-72992f1a-0207-402c-bdce-cf0971d0b9fa tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273" status: 200 len: 1266 microversion: 2.1 time: 0.076814 Aug 31 17:15:55.758708 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3754/7686] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:15:55 2022] GET /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273 => generated 1266 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:15:56.780275 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-23070802-ecdf-4e80-ac65-400630ccbea1 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:15:56.781534 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-23070802-ecdf-4e80-ac65-400630ccbea1 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: a30cb5ea-4df7-404e-9d02-07ec9fd28273] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:15:56.838290 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-23070802-ecdf-4e80-ac65-400630ccbea1 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:15:56.845956 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-23070802-ecdf-4e80-ac65-400630ccbea1 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273" status: 200 len: 1266 microversion: 2.1 time: 0.070708 Aug 31 17:15:56.846626 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3933/7687] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:15:56 2022] GET /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273 => generated 1266 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:15:57.870905 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-48d7268e-c227-4b57-84cf-fc84e0072abf tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:15:57.871532 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-48d7268e-c227-4b57-84cf-fc84e0072abf tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: a30cb5ea-4df7-404e-9d02-07ec9fd28273] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:15:57.944918 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-48d7268e-c227-4b57-84cf-fc84e0072abf tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:15:57.963603 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-48d7268e-c227-4b57-84cf-fc84e0072abf tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273" status: 200 len: 1266 microversion: 2.1 time: 0.096970 Aug 31 17:15:57.965726 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3755/7688] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:15:57 2022] GET /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273 => generated 1266 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:15:58.986579 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e6ef9eee-aa5e-4eb9-9681-759c4bf577d1 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:15:58.987178 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e6ef9eee-aa5e-4eb9-9681-759c4bf577d1 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: a30cb5ea-4df7-404e-9d02-07ec9fd28273] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:15:58.995434 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6ef9eee-aa5e-4eb9-9681-759c4bf577d1 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:15:58.995936 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6ef9eee-aa5e-4eb9-9681-759c4bf577d1 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:15:58.996392 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6ef9eee-aa5e-4eb9-9681-759c4bf577d1 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:15:58.997105 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6ef9eee-aa5e-4eb9-9681-759c4bf577d1 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:15:58.997557 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6ef9eee-aa5e-4eb9-9681-759c4bf577d1 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:15:58.998029 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e6ef9eee-aa5e-4eb9-9681-759c4bf577d1 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:15:59.072684 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e6ef9eee-aa5e-4eb9-9681-759c4bf577d1 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:15:59.081590 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e6ef9eee-aa5e-4eb9-9681-759c4bf577d1 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273" status: 200 len: 1270 microversion: 2.1 time: 0.099217 Aug 31 17:15:59.082196 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3934/7689] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:15:58 2022] GET /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273 => generated 1270 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:16:00.102157 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-12137203-c236-4aac-938b-15236d50a2bc tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:16:00.103140 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-12137203-c236-4aac-938b-15236d50a2bc tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: a30cb5ea-4df7-404e-9d02-07ec9fd28273] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:16:00.110433 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12137203-c236-4aac-938b-15236d50a2bc tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:16:00.110931 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12137203-c236-4aac-938b-15236d50a2bc tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:16:00.111371 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12137203-c236-4aac-938b-15236d50a2bc tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:16:00.112087 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12137203-c236-4aac-938b-15236d50a2bc tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:16:00.112625 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12137203-c236-4aac-938b-15236d50a2bc tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:16:00.113108 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-12137203-c236-4aac-938b-15236d50a2bc tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:16:00.182115 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-12137203-c236-4aac-938b-15236d50a2bc tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:16:00.190141 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-12137203-c236-4aac-938b-15236d50a2bc tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273" status: 200 len: 1324 microversion: 2.1 time: 0.091954 Aug 31 17:16:00.190952 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3756/7690] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:16:00 2022] GET /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273 => generated 1324 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:16:01.214239 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-187251fc-1bac-4934-a66c-eef820b090f8 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:16:01.214980 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-187251fc-1bac-4934-a66c-eef820b090f8 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: a30cb5ea-4df7-404e-9d02-07ec9fd28273] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:16:01.222989 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-187251fc-1bac-4934-a66c-eef820b090f8 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:16:01.223605 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-187251fc-1bac-4934-a66c-eef820b090f8 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:16:01.224282 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-187251fc-1bac-4934-a66c-eef820b090f8 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:16:01.225235 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-187251fc-1bac-4934-a66c-eef820b090f8 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:16:01.225728 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-187251fc-1bac-4934-a66c-eef820b090f8 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:16:01.226192 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-187251fc-1bac-4934-a66c-eef820b090f8 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:16:01.360182 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-483b5e59-4dc6-4f8c-a9eb-d054399d4d83 req-f7ca913a-d069-4d98-ab39-6d9663514526 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a30cb5ea-4df7-404e-9d02-07ec9fd28273", "tag": "860fa1b8-0663-4ae8-8114-93fff1fb96b2"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:16:01.371583 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-483b5e59-4dc6-4f8c-a9eb-d054399d4d83 req-f7ca913a-d069-4d98-ab39-6d9663514526 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:16:01.372083 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-483b5e59-4dc6-4f8c-a9eb-d054399d4d83 req-f7ca913a-d069-4d98-ab39-6d9663514526 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:16:01.372464 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-483b5e59-4dc6-4f8c-a9eb-d054399d4d83 req-f7ca913a-d069-4d98-ab39-6d9663514526 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:16:01.382061 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-187251fc-1bac-4934-a66c-eef820b090f8 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:16:01.384337 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-483b5e59-4dc6-4f8c-a9eb-d054399d4d83 req-f7ca913a-d069-4d98-ab39-6d9663514526 service nova] Creating event network-changed:860fa1b8-0663-4ae8-8114-93fff1fb96b2 for instance a30cb5ea-4df7-404e-9d02-07ec9fd28273 on n-h2-833090-16 Aug 31 17:16:01.390761 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-483b5e59-4dc6-4f8c-a9eb-d054399d4d83 req-f7ca913a-d069-4d98-ab39-6d9663514526 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034809 Aug 31 17:16:01.391377 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3757/7691] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 17:16:01.393393 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-187251fc-1bac-4934-a66c-eef820b090f8 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273" status: 200 len: 1391 microversion: 2.1 time: 0.182441 Aug 31 17:16:01.393999 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3935/7692] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:16:01 2022] GET /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273 => generated 1391 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:16:02.417497 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8cf1840d-f8fb-49dd-a91d-0d75e3e759b9 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:16:02.418178 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8cf1840d-f8fb-49dd-a91d-0d75e3e759b9 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: a30cb5ea-4df7-404e-9d02-07ec9fd28273] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:16:02.425215 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8cf1840d-f8fb-49dd-a91d-0d75e3e759b9 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:16:02.425709 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8cf1840d-f8fb-49dd-a91d-0d75e3e759b9 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:16:02.426179 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8cf1840d-f8fb-49dd-a91d-0d75e3e759b9 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:16:02.426888 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8cf1840d-f8fb-49dd-a91d-0d75e3e759b9 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:16:02.427338 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8cf1840d-f8fb-49dd-a91d-0d75e3e759b9 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:16:02.427766 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8cf1840d-f8fb-49dd-a91d-0d75e3e759b9 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:16:02.571010 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8cf1840d-f8fb-49dd-a91d-0d75e3e759b9 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:16:02.580111 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8cf1840d-f8fb-49dd-a91d-0d75e3e759b9 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273" status: 200 len: 1391 microversion: 2.1 time: 0.168142 Aug 31 17:16:02.580699 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3758/7693] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:16:02 2022] GET /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273 => generated 1391 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:16:03.602843 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-bb654f74-4794-4f75-a5f4-d1b5df43bfe9 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:16:03.603453 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-bb654f74-4794-4f75-a5f4-d1b5df43bfe9 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: a30cb5ea-4df7-404e-9d02-07ec9fd28273] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:16:03.611179 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bb654f74-4794-4f75-a5f4-d1b5df43bfe9 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:16:03.611721 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bb654f74-4794-4f75-a5f4-d1b5df43bfe9 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:16:03.612173 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bb654f74-4794-4f75-a5f4-d1b5df43bfe9 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:16:03.612930 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bb654f74-4794-4f75-a5f4-d1b5df43bfe9 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:16:03.613403 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bb654f74-4794-4f75-a5f4-d1b5df43bfe9 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:16:03.613841 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bb654f74-4794-4f75-a5f4-d1b5df43bfe9 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:16:03.761319 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-bb654f74-4794-4f75-a5f4-d1b5df43bfe9 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:16:03.771972 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-bb654f74-4794-4f75-a5f4-d1b5df43bfe9 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273" status: 200 len: 1391 microversion: 2.1 time: 0.173432 Aug 31 17:16:03.772549 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3936/7694] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:16:03 2022] GET /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273 => generated 1391 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:16:04.793841 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d2bb8e9c-254c-4f26-a716-682fd10d0181 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:16:04.794802 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d2bb8e9c-254c-4f26-a716-682fd10d0181 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: a30cb5ea-4df7-404e-9d02-07ec9fd28273] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:16:04.797594 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:16:04.813428 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2bb8e9c-254c-4f26-a716-682fd10d0181 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:16:04.813933 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2bb8e9c-254c-4f26-a716-682fd10d0181 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:16:04.814404 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2bb8e9c-254c-4f26-a716-682fd10d0181 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:16:04.815117 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2bb8e9c-254c-4f26-a716-682fd10d0181 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:16:04.815568 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2bb8e9c-254c-4f26-a716-682fd10d0181 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:16:04.815988 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d2bb8e9c-254c-4f26-a716-682fd10d0181 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:16:04.974798 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d2bb8e9c-254c-4f26-a716-682fd10d0181 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:16:04.986206 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d2bb8e9c-254c-4f26-a716-682fd10d0181 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273" status: 200 len: 1391 microversion: 2.1 time: 0.196169 Aug 31 17:16:04.986977 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3759/7695] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:16:04 2022] GET /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273 => generated 1391 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:16:06.008131 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-98afe075-17c2-4ec6-99fb-bbdfe7f53953 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:16:06.008790 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-98afe075-17c2-4ec6-99fb-bbdfe7f53953 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: a30cb5ea-4df7-404e-9d02-07ec9fd28273] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:16:06.011770 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:16:06.018008 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-98afe075-17c2-4ec6-99fb-bbdfe7f53953 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:16:06.018536 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-98afe075-17c2-4ec6-99fb-bbdfe7f53953 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:16:06.018987 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-98afe075-17c2-4ec6-99fb-bbdfe7f53953 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:16:06.019716 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-98afe075-17c2-4ec6-99fb-bbdfe7f53953 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:16:06.020185 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-98afe075-17c2-4ec6-99fb-bbdfe7f53953 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:16:06.020624 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-98afe075-17c2-4ec6-99fb-bbdfe7f53953 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:16:06.163721 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-98afe075-17c2-4ec6-99fb-bbdfe7f53953 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:16:06.178640 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-98afe075-17c2-4ec6-99fb-bbdfe7f53953 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273" status: 200 len: 1391 microversion: 2.1 time: 0.174505 Aug 31 17:16:06.179231 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3937/7696] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:16:06 2022] GET /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273 => generated 1391 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:16:07.201734 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-33148e20-b71a-4b39-90eb-99edeb4aecda tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:16:07.202394 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-33148e20-b71a-4b39-90eb-99edeb4aecda tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: a30cb5ea-4df7-404e-9d02-07ec9fd28273] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:16:07.209790 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33148e20-b71a-4b39-90eb-99edeb4aecda tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:16:07.210318 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33148e20-b71a-4b39-90eb-99edeb4aecda tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:16:07.210749 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33148e20-b71a-4b39-90eb-99edeb4aecda tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:16:07.211438 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33148e20-b71a-4b39-90eb-99edeb4aecda tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:16:07.211889 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33148e20-b71a-4b39-90eb-99edeb4aecda tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:16:07.212310 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-33148e20-b71a-4b39-90eb-99edeb4aecda tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:16:07.364259 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-33148e20-b71a-4b39-90eb-99edeb4aecda tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:16:07.374068 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-33148e20-b71a-4b39-90eb-99edeb4aecda tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273" status: 200 len: 1391 microversion: 2.1 time: 0.177453 Aug 31 17:16:07.374729 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3760/7697] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:16:07 2022] GET /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273 => generated 1391 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:16:08.396236 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f36de1c7-dc3f-402a-9a4f-316e16cfe175 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:16:08.396901 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f36de1c7-dc3f-402a-9a4f-316e16cfe175 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: a30cb5ea-4df7-404e-9d02-07ec9fd28273] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:16:08.398940 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=8 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:16:08.406252 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f36de1c7-dc3f-402a-9a4f-316e16cfe175 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:16:08.406770 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f36de1c7-dc3f-402a-9a4f-316e16cfe175 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:16:08.407226 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f36de1c7-dc3f-402a-9a4f-316e16cfe175 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:16:08.407951 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f36de1c7-dc3f-402a-9a4f-316e16cfe175 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:16:08.408419 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f36de1c7-dc3f-402a-9a4f-316e16cfe175 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:16:08.408863 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f36de1c7-dc3f-402a-9a4f-316e16cfe175 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:16:08.551109 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f36de1c7-dc3f-402a-9a4f-316e16cfe175 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:16:08.559672 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f36de1c7-dc3f-402a-9a4f-316e16cfe175 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273" status: 200 len: 1391 microversion: 2.1 time: 0.167540 Aug 31 17:16:08.560264 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3938/7698] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:16:08 2022] GET /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273 => generated 1391 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:16:09.565430 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-16ce0fc8-996f-4534-93c4-6db2551e3a1c req-f9420fce-361c-41fd-a05f-bf4cecbe1496 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a30cb5ea-4df7-404e-9d02-07ec9fd28273", "name": "network-vif-plugged", "status": "completed", "tag": "860fa1b8-0663-4ae8-8114-93fff1fb96b2"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:16:09.570634 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=8 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:16:09.579729 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-16ce0fc8-996f-4534-93c4-6db2551e3a1c req-f9420fce-361c-41fd-a05f-bf4cecbe1496 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:16:09.580280 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-16ce0fc8-996f-4534-93c4-6db2551e3a1c req-f9420fce-361c-41fd-a05f-bf4cecbe1496 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:16:09.580789 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-16ce0fc8-996f-4534-93c4-6db2551e3a1c req-f9420fce-361c-41fd-a05f-bf4cecbe1496 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:16:09.585618 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c3820174-3e2f-4c22-8ced-ee4450bf6dc9 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:16:09.586331 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c3820174-3e2f-4c22-8ced-ee4450bf6dc9 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: a30cb5ea-4df7-404e-9d02-07ec9fd28273] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:16:09.594018 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-16ce0fc8-996f-4534-93c4-6db2551e3a1c req-f9420fce-361c-41fd-a05f-bf4cecbe1496 service nova] Creating event network-vif-plugged:860fa1b8-0663-4ae8-8114-93fff1fb96b2 for instance a30cb5ea-4df7-404e-9d02-07ec9fd28273 on n-h2-833090-16 Aug 31 17:16:09.594272 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3820174-3e2f-4c22-8ced-ee4450bf6dc9 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:16:09.594920 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3820174-3e2f-4c22-8ced-ee4450bf6dc9 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:16:09.595552 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3820174-3e2f-4c22-8ced-ee4450bf6dc9 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:16:09.596444 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3820174-3e2f-4c22-8ced-ee4450bf6dc9 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:16:09.597066 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3820174-3e2f-4c22-8ced-ee4450bf6dc9 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:16:09.597697 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c3820174-3e2f-4c22-8ced-ee4450bf6dc9 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:16:09.599720 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-16ce0fc8-996f-4534-93c4-6db2551e3a1c req-f9420fce-361c-41fd-a05f-bf4cecbe1496 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038071 Aug 31 17:16:09.600736 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3761/7699] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:16:09.753014 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c3820174-3e2f-4c22-8ced-ee4450bf6dc9 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:16:09.760907 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c3820174-3e2f-4c22-8ced-ee4450bf6dc9 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273" status: 200 len: 1391 microversion: 2.1 time: 0.179185 Aug 31 17:16:09.761502 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3939/7700] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:16:09 2022] GET /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273 => generated 1391 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:16:10.783397 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c57c16ca-3914-4d8a-a0c6-8b543c004cf0 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:16:10.784070 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c57c16ca-3914-4d8a-a0c6-8b543c004cf0 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: a30cb5ea-4df7-404e-9d02-07ec9fd28273] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:16:10.790960 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c57c16ca-3914-4d8a-a0c6-8b543c004cf0 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:16:10.791433 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c57c16ca-3914-4d8a-a0c6-8b543c004cf0 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:16:10.791864 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c57c16ca-3914-4d8a-a0c6-8b543c004cf0 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:16:10.792676 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c57c16ca-3914-4d8a-a0c6-8b543c004cf0 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:16:10.793114 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c57c16ca-3914-4d8a-a0c6-8b543c004cf0 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:16:10.793530 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c57c16ca-3914-4d8a-a0c6-8b543c004cf0 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:16:10.950118 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c57c16ca-3914-4d8a-a0c6-8b543c004cf0 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:16:10.959278 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c57c16ca-3914-4d8a-a0c6-8b543c004cf0 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273" status: 200 len: 1391 microversion: 2.1 time: 0.181056 Aug 31 17:16:10.959869 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3762/7701] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:16:10 2022] GET /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273 => generated 1391 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:16:11.981573 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4fd36a76-453f-4aa7-8b32-5ae0cb446e3b tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:16:11.982201 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4fd36a76-453f-4aa7-8b32-5ae0cb446e3b tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: a30cb5ea-4df7-404e-9d02-07ec9fd28273] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:16:11.985013 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:16:11.990902 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4fd36a76-453f-4aa7-8b32-5ae0cb446e3b tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:16:11.991406 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4fd36a76-453f-4aa7-8b32-5ae0cb446e3b tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:16:11.991866 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4fd36a76-453f-4aa7-8b32-5ae0cb446e3b tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:16:11.992578 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4fd36a76-453f-4aa7-8b32-5ae0cb446e3b tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:16:11.993050 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4fd36a76-453f-4aa7-8b32-5ae0cb446e3b tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:16:11.993488 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4fd36a76-453f-4aa7-8b32-5ae0cb446e3b tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:16:12.132898 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4fd36a76-453f-4aa7-8b32-5ae0cb446e3b tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:16:12.142444 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4fd36a76-453f-4aa7-8b32-5ae0cb446e3b tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273" status: 200 len: 1564 microversion: 2.1 time: 0.165072 Aug 31 17:16:12.143287 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3940/7702] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:16:11 2022] GET /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273 => generated 1564 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:16:12.166664 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-6254f33b-d59f-472e-9ed5-a85cf0d3ccb1 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:16:12.167336 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-6254f33b-d59f-472e-9ed5-a85cf0d3ccb1 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: a30cb5ea-4df7-404e-9d02-07ec9fd28273] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:16:12.175308 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6254f33b-d59f-472e-9ed5-a85cf0d3ccb1 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:16:12.175799 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6254f33b-d59f-472e-9ed5-a85cf0d3ccb1 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:16:12.176232 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6254f33b-d59f-472e-9ed5-a85cf0d3ccb1 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:16:12.176933 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6254f33b-d59f-472e-9ed5-a85cf0d3ccb1 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:16:12.177390 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6254f33b-d59f-472e-9ed5-a85cf0d3ccb1 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:16:12.177814 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-6254f33b-d59f-472e-9ed5-a85cf0d3ccb1 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:16:12.329052 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-6254f33b-d59f-472e-9ed5-a85cf0d3ccb1 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:16:12.338732 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-6254f33b-d59f-472e-9ed5-a85cf0d3ccb1 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273" status: 200 len: 1564 microversion: 2.1 time: 0.175826 Aug 31 17:16:12.339339 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3763/7703] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:16:12 2022] GET /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273 => generated 1564 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:16:14.540323 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-138d51ba-ec51-4ae2-a826-e4657e108de2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:16:14.541569 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-138d51ba-ec51-4ae2-a826-e4657e108de2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: a30cb5ea-4df7-404e-9d02-07ec9fd28273] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:16:14.542171 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-fb74d2cd-1dd3-4ee4-97cd-b6e3578c26dd req-6735d2d5-c5a4-489f-810f-c9e75e0fa138 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a30cb5ea-4df7-404e-9d02-07ec9fd28273", "tag": "860fa1b8-0663-4ae8-8114-93fff1fb96b2"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:16:14.549379 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-138d51ba-ec51-4ae2-a826-e4657e108de2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:16:14.549855 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-138d51ba-ec51-4ae2-a826-e4657e108de2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:16:14.550324 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-138d51ba-ec51-4ae2-a826-e4657e108de2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:16:14.551041 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-138d51ba-ec51-4ae2-a826-e4657e108de2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:16:14.551712 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-138d51ba-ec51-4ae2-a826-e4657e108de2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:16:14.552119 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-138d51ba-ec51-4ae2-a826-e4657e108de2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:16:14.555271 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-fb74d2cd-1dd3-4ee4-97cd-b6e3578c26dd req-6735d2d5-c5a4-489f-810f-c9e75e0fa138 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:16:14.555741 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-fb74d2cd-1dd3-4ee4-97cd-b6e3578c26dd req-6735d2d5-c5a4-489f-810f-c9e75e0fa138 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:16:14.556157 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-fb74d2cd-1dd3-4ee4-97cd-b6e3578c26dd req-6735d2d5-c5a4-489f-810f-c9e75e0fa138 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:16:14.568626 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-fb74d2cd-1dd3-4ee4-97cd-b6e3578c26dd req-6735d2d5-c5a4-489f-810f-c9e75e0fa138 service nova] Creating event network-changed:860fa1b8-0663-4ae8-8114-93fff1fb96b2 for instance a30cb5ea-4df7-404e-9d02-07ec9fd28273 on n-h2-833090-16 Aug 31 17:16:14.574933 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-fb74d2cd-1dd3-4ee4-97cd-b6e3578c26dd req-6735d2d5-c5a4-489f-810f-c9e75e0fa138 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035905 Aug 31 17:16:14.576283 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3764/7704] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:16:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:16:14.708584 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-138d51ba-ec51-4ae2-a826-e4657e108de2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:16:14.719660 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-138d51ba-ec51-4ae2-a826-e4657e108de2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273" status: 200 len: 1564 microversion: 2.1 time: 0.183284 Aug 31 17:16:14.720638 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3941/7705] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:16:14 2022] GET /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273 => generated 1564 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:16:50.042438 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-bc5cbf6c-623f-450c-947c-0def548ff7de tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:16:50.044727 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-bc5cbf6c-623f-450c-947c-0def548ff7de tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: a30cb5ea-4df7-404e-9d02-07ec9fd28273] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:16:50.047240 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=11 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:16:50.047870 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=42 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:16:50.054420 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc5cbf6c-623f-450c-947c-0def548ff7de tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:16:50.054913 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc5cbf6c-623f-450c-947c-0def548ff7de tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:16:50.055347 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc5cbf6c-623f-450c-947c-0def548ff7de tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:16:50.056048 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc5cbf6c-623f-450c-947c-0def548ff7de tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:16:50.056503 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc5cbf6c-623f-450c-947c-0def548ff7de tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:16:50.056922 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-bc5cbf6c-623f-450c-947c-0def548ff7de tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:16:50.129898 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-bc5cbf6c-623f-450c-947c-0def548ff7de tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "POST /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273/action" status: 200 len: 24570 microversion: 2.1 time: 0.091819 Aug 31 17:16:50.130590 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3765/7706] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 17:16:50 2022] POST /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273/action => generated 24570 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 17:17:28.915789 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=3 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:17:28.916659 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=50 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:17:29.180959 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5c7bd298-6f13-4263-8417-94af1fa7c8fc tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:17:29.181513 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5c7bd298-6f13-4263-8417-94af1fa7c8fc tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: a30cb5ea-4df7-404e-9d02-07ec9fd28273] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:17:29.188129 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5c7bd298-6f13-4263-8417-94af1fa7c8fc tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:29.188617 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5c7bd298-6f13-4263-8417-94af1fa7c8fc tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:29.189067 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5c7bd298-6f13-4263-8417-94af1fa7c8fc tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:29.189769 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5c7bd298-6f13-4263-8417-94af1fa7c8fc tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:29.190388 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5c7bd298-6f13-4263-8417-94af1fa7c8fc tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:29.190889 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5c7bd298-6f13-4263-8417-94af1fa7c8fc tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:29.215130 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-5c7bd298-6f13-4263-8417-94af1fa7c8fc tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lazy-loading 'flavor' on Instance uuid a30cb5ea-4df7-404e-9d02-07ec9fd28273 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 17:17:29.288685 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5c7bd298-6f13-4263-8417-94af1fa7c8fc tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "POST /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273/action" status: 202 len: 0 microversion: 2.1 time: 0.374835 Aug 31 17:17:29.289675 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3942/7707] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 17:17:28 2022] POST /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273/action => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:17:29.298539 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4a669a14-9c03-4c35-9bce-55c0b06e39f5 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:17:29.299998 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4a669a14-9c03-4c35-9bce-55c0b06e39f5 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: a30cb5ea-4df7-404e-9d02-07ec9fd28273] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:17:29.302506 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:17:29.303161 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:17:29.304481 n-d-833090-16 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 17:17:29.304619 n-d-833090-16 devstack@n-api.service[128863]: Wed Aug 31 17:17:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273 (ip 10.222.0.50) !!! Aug 31 17:17:29.314023 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a669a14-9c03-4c35-9bce-55c0b06e39f5 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:29.314529 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a669a14-9c03-4c35-9bce-55c0b06e39f5 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:29.314985 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a669a14-9c03-4c35-9bce-55c0b06e39f5 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:29.316191 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a669a14-9c03-4c35-9bce-55c0b06e39f5 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:29.316191 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a669a14-9c03-4c35-9bce-55c0b06e39f5 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:29.316550 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a669a14-9c03-4c35-9bce-55c0b06e39f5 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:29.466126 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4a669a14-9c03-4c35-9bce-55c0b06e39f5 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:17:29.475032 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4a669a14-9c03-4c35-9bce-55c0b06e39f5 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273" status: 200 len: 1690 microversion: 2.1 time: 0.180971 Aug 31 17:17:29.475676 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3766/7708] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:17:29 2022] GET /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273 => generated 1690 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:17:30.501735 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4acf4f3b-d0f8-4362-8afc-5d327755d42d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:17:30.502726 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4acf4f3b-d0f8-4362-8afc-5d327755d42d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: a30cb5ea-4df7-404e-9d02-07ec9fd28273] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:17:30.511877 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4acf4f3b-d0f8-4362-8afc-5d327755d42d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:30.512378 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4acf4f3b-d0f8-4362-8afc-5d327755d42d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:30.512836 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4acf4f3b-d0f8-4362-8afc-5d327755d42d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:30.513562 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4acf4f3b-d0f8-4362-8afc-5d327755d42d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:30.514067 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4acf4f3b-d0f8-4362-8afc-5d327755d42d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:30.514550 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4acf4f3b-d0f8-4362-8afc-5d327755d42d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:30.663570 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4acf4f3b-d0f8-4362-8afc-5d327755d42d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:17:30.671797 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4acf4f3b-d0f8-4362-8afc-5d327755d42d tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273" status: 200 len: 1690 microversion: 2.1 time: 0.176357 Aug 31 17:17:30.672396 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3943/7709] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:17:30 2022] GET /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273 => generated 1690 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:17:31.696666 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e77a7dec-cbe1-42bd-9e83-ef803d9d5914 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:17:31.697268 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e77a7dec-cbe1-42bd-9e83-ef803d9d5914 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: a30cb5ea-4df7-404e-9d02-07ec9fd28273] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:17:31.707899 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e77a7dec-cbe1-42bd-9e83-ef803d9d5914 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:31.708388 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e77a7dec-cbe1-42bd-9e83-ef803d9d5914 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:31.708819 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e77a7dec-cbe1-42bd-9e83-ef803d9d5914 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:31.709518 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e77a7dec-cbe1-42bd-9e83-ef803d9d5914 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:31.709961 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e77a7dec-cbe1-42bd-9e83-ef803d9d5914 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:31.710422 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e77a7dec-cbe1-42bd-9e83-ef803d9d5914 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:31.863683 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e77a7dec-cbe1-42bd-9e83-ef803d9d5914 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:17:31.875149 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e77a7dec-cbe1-42bd-9e83-ef803d9d5914 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273" status: 200 len: 1673 microversion: 2.1 time: 0.184906 Aug 31 17:17:31.875716 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3767/7710] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:17:31 2022] GET /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273 => generated 1673 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:17:32.979128 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f6bf6cb6-5f37-447d-8c42-ce85ae32a38b tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:17:32.981397 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f6bf6cb6-5f37-447d-8c42-ce85ae32a38b tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: a30cb5ea-4df7-404e-9d02-07ec9fd28273] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:17:32.988652 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f6bf6cb6-5f37-447d-8c42-ce85ae32a38b tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:32.989355 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f6bf6cb6-5f37-447d-8c42-ce85ae32a38b tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:32.989812 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f6bf6cb6-5f37-447d-8c42-ce85ae32a38b tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:32.990585 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f6bf6cb6-5f37-447d-8c42-ce85ae32a38b tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:32.991052 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f6bf6cb6-5f37-447d-8c42-ce85ae32a38b tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:32.991489 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f6bf6cb6-5f37-447d-8c42-ce85ae32a38b tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:33.055156 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f6bf6cb6-5f37-447d-8c42-ce85ae32a38b tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "POST /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273/action" status: 200 len: 38261 microversion: 2.1 time: 0.079855 Aug 31 17:17:33.055885 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3944/7711] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 17:17:32 2022] POST /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273/action => generated 38261 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 17:17:33.072228 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-86933722-d602-492d-80e5-72e922f1ff81 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:17:33.072827 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-86933722-d602-492d-80e5-72e922f1ff81 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: a30cb5ea-4df7-404e-9d02-07ec9fd28273] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:17:33.083780 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86933722-d602-492d-80e5-72e922f1ff81 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:33.084272 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86933722-d602-492d-80e5-72e922f1ff81 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:33.084712 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86933722-d602-492d-80e5-72e922f1ff81 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:33.085407 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86933722-d602-492d-80e5-72e922f1ff81 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:33.085863 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86933722-d602-492d-80e5-72e922f1ff81 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:33.086324 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-86933722-d602-492d-80e5-72e922f1ff81 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:33.161985 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-86933722-d602-492d-80e5-72e922f1ff81 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "POST /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273/action" status: 202 len: 0 microversion: 2.1 time: 0.096470 Aug 31 17:17:33.162679 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3768/7712] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 17:17:33 2022] POST /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:17:33.171666 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6c740116-116e-4db0-9522-f1d00182bf8f tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:17:33.172406 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6c740116-116e-4db0-9522-f1d00182bf8f tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: a30cb5ea-4df7-404e-9d02-07ec9fd28273] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:17:33.180222 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6c740116-116e-4db0-9522-f1d00182bf8f tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:33.180732 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6c740116-116e-4db0-9522-f1d00182bf8f tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:33.181692 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6c740116-116e-4db0-9522-f1d00182bf8f tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:33.182443 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6c740116-116e-4db0-9522-f1d00182bf8f tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:33.182902 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6c740116-116e-4db0-9522-f1d00182bf8f tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:33.183522 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6c740116-116e-4db0-9522-f1d00182bf8f tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:33.323802 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6c740116-116e-4db0-9522-f1d00182bf8f tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:17:33.332715 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6c740116-116e-4db0-9522-f1d00182bf8f tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273" status: 200 len: 1679 microversion: 2.1 time: 0.165203 Aug 31 17:17:33.333358 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3945/7713] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:17:33 2022] GET /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:17:34.356295 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0c2b3429-e4a3-4d1b-b738-13fd9206ce7e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:17:34.357019 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0c2b3429-e4a3-4d1b-b738-13fd9206ce7e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: a30cb5ea-4df7-404e-9d02-07ec9fd28273] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:17:34.364635 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c2b3429-e4a3-4d1b-b738-13fd9206ce7e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:34.365117 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c2b3429-e4a3-4d1b-b738-13fd9206ce7e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:34.365549 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c2b3429-e4a3-4d1b-b738-13fd9206ce7e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:34.366275 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c2b3429-e4a3-4d1b-b738-13fd9206ce7e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:34.366730 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c2b3429-e4a3-4d1b-b738-13fd9206ce7e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:34.367153 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0c2b3429-e4a3-4d1b-b738-13fd9206ce7e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:34.513194 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0c2b3429-e4a3-4d1b-b738-13fd9206ce7e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:17:34.521940 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0c2b3429-e4a3-4d1b-b738-13fd9206ce7e tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273" status: 200 len: 1679 microversion: 2.1 time: 0.170077 Aug 31 17:17:34.522528 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3769/7714] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:17:34 2022] GET /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273 => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:17:35.547748 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d8ab15ee-71ca-4e6e-a5ef-ef0a7f2738d2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:17:35.548594 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d8ab15ee-71ca-4e6e-a5ef-ef0a7f2738d2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: a30cb5ea-4df7-404e-9d02-07ec9fd28273] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:17:35.557288 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d8ab15ee-71ca-4e6e-a5ef-ef0a7f2738d2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:35.557776 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d8ab15ee-71ca-4e6e-a5ef-ef0a7f2738d2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:35.558253 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d8ab15ee-71ca-4e6e-a5ef-ef0a7f2738d2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:35.558959 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d8ab15ee-71ca-4e6e-a5ef-ef0a7f2738d2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:35.559415 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d8ab15ee-71ca-4e6e-a5ef-ef0a7f2738d2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:35.559848 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d8ab15ee-71ca-4e6e-a5ef-ef0a7f2738d2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:35.718214 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d8ab15ee-71ca-4e6e-a5ef-ef0a7f2738d2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:17:35.728589 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d8ab15ee-71ca-4e6e-a5ef-ef0a7f2738d2 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273" status: 200 len: 1682 microversion: 2.1 time: 0.187436 Aug 31 17:17:35.729130 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3946/7715] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:17:35 2022] GET /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273 => generated 1682 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:17:35.846985 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-982ae0d1-06b7-44fb-a683-cf85a2b9a733 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:17:35.849595 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-982ae0d1-06b7-44fb-a683-cf85a2b9a733 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: a30cb5ea-4df7-404e-9d02-07ec9fd28273] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:17:35.857176 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-982ae0d1-06b7-44fb-a683-cf85a2b9a733 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:35.857664 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-982ae0d1-06b7-44fb-a683-cf85a2b9a733 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:35.858124 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-982ae0d1-06b7-44fb-a683-cf85a2b9a733 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:35.858832 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-982ae0d1-06b7-44fb-a683-cf85a2b9a733 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:35.859285 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-982ae0d1-06b7-44fb-a683-cf85a2b9a733 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:35.859706 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-982ae0d1-06b7-44fb-a683-cf85a2b9a733 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:35.922701 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-982ae0d1-06b7-44fb-a683-cf85a2b9a733 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "POST /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273/action" status: 200 len: 38261 microversion: 2.1 time: 0.079643 Aug 31 17:17:35.923349 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3770/7716] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 17:17:35 2022] POST /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273/action => generated 38261 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 17:17:36.958195 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-80d95159-2a64-4342-bb73-463bae0d7ff8 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:17:36.958841 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-80d95159-2a64-4342-bb73-463bae0d7ff8 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: a30cb5ea-4df7-404e-9d02-07ec9fd28273] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:17:36.966989 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-80d95159-2a64-4342-bb73-463bae0d7ff8 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:36.967494 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-80d95159-2a64-4342-bb73-463bae0d7ff8 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:36.967968 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-80d95159-2a64-4342-bb73-463bae0d7ff8 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:36.968668 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-80d95159-2a64-4342-bb73-463bae0d7ff8 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:36.969132 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-80d95159-2a64-4342-bb73-463bae0d7ff8 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:36.969570 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-80d95159-2a64-4342-bb73-463bae0d7ff8 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:36.997662 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-80d95159-2a64-4342-bb73-463bae0d7ff8 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: a30cb5ea-4df7-404e-9d02-07ec9fd28273] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 17:17:37.020247 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-19aeb797-097e-40f1-9812-c1414dbfa08d req-8a00196b-961d-42e6-a87c-b533ad8da726 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a30cb5ea-4df7-404e-9d02-07ec9fd28273", "tag": "860fa1b8-0663-4ae8-8114-93fff1fb96b2"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:17:37.031725 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-19aeb797-097e-40f1-9812-c1414dbfa08d req-8a00196b-961d-42e6-a87c-b533ad8da726 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:37.032489 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-19aeb797-097e-40f1-9812-c1414dbfa08d req-8a00196b-961d-42e6-a87c-b533ad8da726 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:37.033199 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-19aeb797-097e-40f1-9812-c1414dbfa08d req-8a00196b-961d-42e6-a87c-b533ad8da726 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:37.057761 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-19aeb797-097e-40f1-9812-c1414dbfa08d req-8a00196b-961d-42e6-a87c-b533ad8da726 service nova] Creating event network-changed:860fa1b8-0663-4ae8-8114-93fff1fb96b2 for instance a30cb5ea-4df7-404e-9d02-07ec9fd28273 on n-h2-833090-16 Aug 31 17:17:37.063804 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-19aeb797-097e-40f1-9812-c1414dbfa08d req-8a00196b-961d-42e6-a87c-b533ad8da726 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105989 Aug 31 17:17:37.071965 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3771/7717] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:17:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:17:37.094562 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-80d95159-2a64-4342-bb73-463bae0d7ff8 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273" status: 204 len: 0 microversion: 2.1 time: 0.140044 Aug 31 17:17:37.095449 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3947/7718] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 17:17:36 2022] DELETE /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 17:17:37.105601 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3f43249b-9d06-488c-a78e-965136d84c59 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:17:37.106429 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3f43249b-9d06-488c-a78e-965136d84c59 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: a30cb5ea-4df7-404e-9d02-07ec9fd28273] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:17:37.113086 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f43249b-9d06-488c-a78e-965136d84c59 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:37.113649 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f43249b-9d06-488c-a78e-965136d84c59 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:37.114269 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f43249b-9d06-488c-a78e-965136d84c59 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:37.115922 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f43249b-9d06-488c-a78e-965136d84c59 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:37.116423 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f43249b-9d06-488c-a78e-965136d84c59 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:37.117007 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f43249b-9d06-488c-a78e-965136d84c59 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:37.259134 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3f43249b-9d06-488c-a78e-965136d84c59 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:17:37.267235 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3f43249b-9d06-488c-a78e-965136d84c59 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273" status: 200 len: 1688 microversion: 2.1 time: 0.166472 Aug 31 17:17:37.267887 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3772/7719] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:17:37 2022] GET /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273 => generated 1688 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:17:38.291288 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c489a546-0e66-461c-8fb8-bda517201f7c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:17:38.291995 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c489a546-0e66-461c-8fb8-bda517201f7c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: a30cb5ea-4df7-404e-9d02-07ec9fd28273] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:17:38.301063 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c489a546-0e66-461c-8fb8-bda517201f7c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:38.301641 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c489a546-0e66-461c-8fb8-bda517201f7c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:38.302192 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c489a546-0e66-461c-8fb8-bda517201f7c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:38.303108 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c489a546-0e66-461c-8fb8-bda517201f7c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:38.303672 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c489a546-0e66-461c-8fb8-bda517201f7c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:38.304107 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c489a546-0e66-461c-8fb8-bda517201f7c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:38.462937 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c489a546-0e66-461c-8fb8-bda517201f7c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:17:38.471166 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c489a546-0e66-461c-8fb8-bda517201f7c tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273" status: 200 len: 1688 microversion: 2.1 time: 0.185221 Aug 31 17:17:38.471951 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3948/7720] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:17:38 2022] GET /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273 => generated 1688 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:17:39.493510 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-07c07b55-8e7c-405b-a25b-b0d8c14db933 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:17:39.494224 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-07c07b55-8e7c-405b-a25b-b0d8c14db933 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: a30cb5ea-4df7-404e-9d02-07ec9fd28273] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:17:39.505692 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-07c07b55-8e7c-405b-a25b-b0d8c14db933 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:39.506711 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-07c07b55-8e7c-405b-a25b-b0d8c14db933 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:39.507542 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-07c07b55-8e7c-405b-a25b-b0d8c14db933 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:39.508445 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-07c07b55-8e7c-405b-a25b-b0d8c14db933 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:39.509242 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-07c07b55-8e7c-405b-a25b-b0d8c14db933 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:39.509863 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-07c07b55-8e7c-405b-a25b-b0d8c14db933 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:39.596822 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-07c07b55-8e7c-405b-a25b-b0d8c14db933 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a18fb2c4e622474d943a72025236cca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6f813017c8c40d5978c8550f188dbf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:17:39.607897 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-07c07b55-8e7c-405b-a25b-b0d8c14db933 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273" status: 200 len: 1503 microversion: 2.1 time: 0.117708 Aug 31 17:17:39.607897 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3773/7721] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:17:39 2022] GET /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273 => generated 1503 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:17:39.653740 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-c38e4a76-e92d-451c-a551-399f688ca35f req-08d403ae-89ce-4c0b-a217-ce878542083f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a30cb5ea-4df7-404e-9d02-07ec9fd28273", "name": "network-vif-deleted", "tag": "860fa1b8-0663-4ae8-8114-93fff1fb96b2"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:17:39.663898 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-c38e4a76-e92d-451c-a551-399f688ca35f req-08d403ae-89ce-4c0b-a217-ce878542083f service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:39.664389 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-c38e4a76-e92d-451c-a551-399f688ca35f req-08d403ae-89ce-4c0b-a217-ce878542083f service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:39.664834 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-c38e4a76-e92d-451c-a551-399f688ca35f req-08d403ae-89ce-4c0b-a217-ce878542083f service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:39.676646 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-c38e4a76-e92d-451c-a551-399f688ca35f req-08d403ae-89ce-4c0b-a217-ce878542083f service nova] Creating event network-vif-deleted:860fa1b8-0663-4ae8-8114-93fff1fb96b2 for instance a30cb5ea-4df7-404e-9d02-07ec9fd28273 on n-h2-833090-16 Aug 31 17:17:39.682071 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-c38e4a76-e92d-451c-a551-399f688ca35f req-08d403ae-89ce-4c0b-a217-ce878542083f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088824 Aug 31 17:17:39.682777 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3949/7722] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:17:40.630176 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e25ddd02-b09e-4b10-8179-fc2d9ed75104 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:17:40.630897 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e25ddd02-b09e-4b10-8179-fc2d9ed75104 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] [instance: a30cb5ea-4df7-404e-9d02-07ec9fd28273] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:17:40.638626 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e25ddd02-b09e-4b10-8179-fc2d9ed75104 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:40.639118 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e25ddd02-b09e-4b10-8179-fc2d9ed75104 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:40.639548 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e25ddd02-b09e-4b10-8179-fc2d9ed75104 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:40.640246 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e25ddd02-b09e-4b10-8179-fc2d9ed75104 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:40.640699 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e25ddd02-b09e-4b10-8179-fc2d9ed75104 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:40.641124 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e25ddd02-b09e-4b10-8179-fc2d9ed75104 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:40.658660 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-e25ddd02-b09e-4b10-8179-fc2d9ed75104 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] HTTP exception thrown: Instance a30cb5ea-4df7-404e-9d02-07ec9fd28273 could not be found. Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e25ddd02-b09e-4b10-8179-fc2d9ed75104 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Request method failure captured: Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273 HTTP/1.1 Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD5UwnC35Vn5evFApyVfskHdEHcvv0VSRxaZ9pzKW96Fqt51iHq5jLe56IGhM36ZgCFwb3_2IfN9Wxbd_wUAkzwS08XpxCxoP856myVMcw20sYLpddPhTMaAFpoi0Qlpqj4GXCEBMwRUEqexdDDa6EuUjH1_09epMJ_p9WzfxJnmlCRg Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: a6f813017c8c40d5978c8550f188dbf7 Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1147621593 Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a6f813017c8c40d5978c8550f188dbf7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a6f813017c8c40d5978c8550f188dbf7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a6f813017c8c40d5978c8550f188dbf7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a6f813017c8c40d5978c8550f188dbf7", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1147621593 Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: a6f813017c8c40d5978c8550f188dbf7 Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1147621593 Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-TestNetworkAdvancedServerOps-1147621593-project Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: a18fb2c4e622474d943a72025236cca7 Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1147621593-project Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance a30cb5ea-4df7-404e-9d02-07ec9fd28273 could not be found. Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': 'a30cb5ea-4df7-404e-9d02-07ec9fd28273'} Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a30cb5ea-4df7-404e-9d02-07ec9fd28273 could not be found. Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a30cb5ea-4df7-404e-9d02-07ec9fd28273 could not be found. Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 17:17:40.660335 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:17:40.664823 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 17:17:40.664823 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:17:40.664823 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:17:40.664823 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:17:40.664823 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 17:17:40.664823 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 17:17:40.664823 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a30cb5ea-4df7-404e-9d02-07ec9fd28273 could not be found. Aug 31 17:17:40.664823 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 17:17:40.664823 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e25ddd02-b09e-4b10-8179-fc2d9ed75104 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Returning 404 to user: Instance a30cb5ea-4df7-404e-9d02-07ec9fd28273 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 17:17:40.664823 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e25ddd02-b09e-4b10-8179-fc2d9ed75104 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "GET /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273" status: 404 len: 111 microversion: 2.1 time: 0.035563 Aug 31 17:17:40.664823 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3774/7723] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:17:40 2022] GET /compute/v2.1/servers/a30cb5ea-4df7-404e-9d02-07ec9fd28273 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 17:17:43.794358 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-29f0fc6d-19a0-4ebd-acc7-43c3efff1f05 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] Calling method '.version_select at 0x7fbb46800c10>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:17:43.821285 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-29f0fc6d-19a0-4ebd-acc7-43c3efff1f05 tempest-TestNetworkAdvancedServerOps-1147621593 tempest-TestNetworkAdvancedServerOps-1147621593-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1072663085" status: 202 len: 0 microversion: 2.1 time: 0.043554 Aug 31 17:17:43.821901 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3950/7724] 10.222.0.50 () {58 vars in 1284 bytes} [Wed Aug 31 17:17:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1072663085 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:17:55.953301 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=18 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:17:55.954058 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:17:56.145833 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3353d219-ed27-4d4d-8302-e6ccbca47267 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Action: 'create', calling method: .version_select at 0x7fbb4ab6aca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-570700056", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqTgs4IyMfLxfsOowaNRzQPT5Oc3RdLwJZbZ9Q9jtsLLrGBPT6m3FBGki4iu3OYigyVRPPqGuunfBHeLK1HP688RmFhcU7fXyJfTRmw77RU81vE+ICfnk/HA9tAscIJdw=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:17:56.164316 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-3353d219-ed27-4d4d-8302-e6ccbca47267 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Getting quotas for project 4eb52c4e2557425c96d32a9163749d81. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 17:17:56.170663 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-3353d219-ed27-4d4d-8302-e6ccbca47267 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Getting quotas for user 30ba0f75d33b4dc68d6dbce8dce75686 and project 4eb52c4e2557425c96d32a9163749d81. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 17:17:56.204893 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3353d219-ed27-4d4d-8302-e6ccbca47267 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.257231 Aug 31 17:17:56.205914 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3775/7725] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 31 17:17:55 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:17:57.381821 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e042f591-bcad-48d0-b75c-cb6a3d4a8898 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-360643704", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-570700056", "security_groups": [{"name": "tempest-secgroup-smoke-1990026300"}], "networks": [{"uuid": "06ada3e9-c923-49cc-a6dc-d43a7b9dedfe"}]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:17:57.394180 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:17:57.394926 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:17:57.521751 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-e042f591-bcad-48d0-b75c-cb6a3d4a8898 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] validate_networks() for [('06ada3e9-c923-49cc-a6dc-d43a7b9dedfe', None, None, None, None, None)] {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 17:17:57.959139 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-e042f591-bcad-48d0-b75c-cb6a3d4a8898 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 17:17:57.959604 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-e042f591-bcad-48d0-b75c-cb6a3d4a8898 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 17:17:57.960069 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-e042f591-bcad-48d0-b75c-cb6a3d4a8898 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 17:17:57.960487 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-e042f591-bcad-48d0-b75c-cb6a3d4a8898 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 17:17:57.960907 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-e042f591-bcad-48d0-b75c-cb6a3d4a8898 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 17:17:57.971621 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e042f591-bcad-48d0-b75c-cb6a3d4a8898 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:57.972156 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e042f591-bcad-48d0-b75c-cb6a3d4a8898 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:57.972586 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e042f591-bcad-48d0-b75c-cb6a3d4a8898 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:57.973320 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e042f591-bcad-48d0-b75c-cb6a3d4a8898 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:57.973790 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e042f591-bcad-48d0-b75c-cb6a3d4a8898 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:57.974254 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e042f591-bcad-48d0-b75c-cb6a3d4a8898 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:57.992350 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-e042f591-bcad-48d0-b75c-cb6a3d4a8898 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Getting quotas for project 4eb52c4e2557425c96d32a9163749d81. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 17:17:57.999171 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-e042f591-bcad-48d0-b75c-cb6a3d4a8898 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Getting quotas for user 30ba0f75d33b4dc68d6dbce8dce75686 and project 4eb52c4e2557425c96d32a9163749d81. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 17:17:58.014573 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e042f591-bcad-48d0-b75c-cb6a3d4a8898 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 17:17:58.017223 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e042f591-bcad-48d0-b75c-cb6a3d4a8898 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 17:17:58.068846 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e042f591-bcad-48d0-b75c-cb6a3d4a8898 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.691163 Aug 31 17:17:58.069704 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3951/7726] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 17:17:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 17:17:58.083376 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c6ade0f9-9e06-4e61-acc8-81f613d2130e tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:17:58.084098 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c6ade0f9-9e06-4e61-acc8-81f613d2130e tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:17:58.151522 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c6ade0f9-9e06-4e61-acc8-81f613d2130e tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:17:58.161082 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c6ade0f9-9e06-4e61-acc8-81f613d2130e tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1245 microversion: 2.1 time: 0.083516 Aug 31 17:17:58.161961 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3776/7727] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:17:58 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:17:59.187481 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6f4938c1-be4e-4484-a603-01b7a1f9ee79 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:17:59.190014 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6f4938c1-be4e-4484-a603-01b7a1f9ee79 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:17:59.203326 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f4938c1-be4e-4484-a603-01b7a1f9ee79 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:59.203842 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f4938c1-be4e-4484-a603-01b7a1f9ee79 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:59.204299 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f4938c1-be4e-4484-a603-01b7a1f9ee79 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:59.205030 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f4938c1-be4e-4484-a603-01b7a1f9ee79 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:17:59.205622 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f4938c1-be4e-4484-a603-01b7a1f9ee79 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:17:59.206069 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6f4938c1-be4e-4484-a603-01b7a1f9ee79 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:17:59.273633 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6f4938c1-be4e-4484-a603-01b7a1f9ee79 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:17:59.282803 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6f4938c1-be4e-4484-a603-01b7a1f9ee79 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1297 microversion: 2.1 time: 0.103524 Aug 31 17:17:59.283292 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3952/7728] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:17:59 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1297 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:18:00.303501 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-a02ef2f2-8d40-4055-baeb-fa41e8ce749c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:18:00.304266 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-a02ef2f2-8d40-4055-baeb-fa41e8ce749c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:18:00.314169 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a02ef2f2-8d40-4055-baeb-fa41e8ce749c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:18:00.315745 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a02ef2f2-8d40-4055-baeb-fa41e8ce749c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:18:00.321208 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a02ef2f2-8d40-4055-baeb-fa41e8ce749c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:18:00.322380 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a02ef2f2-8d40-4055-baeb-fa41e8ce749c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:18:00.323119 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a02ef2f2-8d40-4055-baeb-fa41e8ce749c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:18:00.323782 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-a02ef2f2-8d40-4055-baeb-fa41e8ce749c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:18:00.551356 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-a02ef2f2-8d40-4055-baeb-fa41e8ce749c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:18:00.560312 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-a02ef2f2-8d40-4055-baeb-fa41e8ce749c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1371 microversion: 2.1 time: 0.260649 Aug 31 17:18:00.560988 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3777/7729] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:18:00 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1371 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:18:00.847952 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-0a3dbfcf-89a2-4534-81a2-87af8fcdf417 req-5020d3dd-af9a-4278-b292-9670db062b99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3351fdc2-a112-4d61-8ffa-6a4f590e4433", "tag": "ecc7a4a6-52c0-48c1-b922-83e59b645f00"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:18:00.859863 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-0a3dbfcf-89a2-4534-81a2-87af8fcdf417 req-5020d3dd-af9a-4278-b292-9670db062b99 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:18:00.860409 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-0a3dbfcf-89a2-4534-81a2-87af8fcdf417 req-5020d3dd-af9a-4278-b292-9670db062b99 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:18:00.860854 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-0a3dbfcf-89a2-4534-81a2-87af8fcdf417 req-5020d3dd-af9a-4278-b292-9670db062b99 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:18:00.872913 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-0a3dbfcf-89a2-4534-81a2-87af8fcdf417 req-5020d3dd-af9a-4278-b292-9670db062b99 service nova] Creating event network-changed:ecc7a4a6-52c0-48c1-b922-83e59b645f00 for instance 3351fdc2-a112-4d61-8ffa-6a4f590e4433 on n-h2-833090-16 Aug 31 17:18:00.878080 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-0a3dbfcf-89a2-4534-81a2-87af8fcdf417 req-5020d3dd-af9a-4278-b292-9670db062b99 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034146 Aug 31 17:18:00.879138 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3953/7730] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:18:01.582832 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-88841a6a-4b4f-4b09-8965-77485f3cf9a5 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:18:01.583466 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-88841a6a-4b4f-4b09-8965-77485f3cf9a5 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:18:01.591864 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88841a6a-4b4f-4b09-8965-77485f3cf9a5 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:18:01.592393 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88841a6a-4b4f-4b09-8965-77485f3cf9a5 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:18:01.592793 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88841a6a-4b4f-4b09-8965-77485f3cf9a5 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:18:01.595521 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88841a6a-4b4f-4b09-8965-77485f3cf9a5 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:18:01.595521 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88841a6a-4b4f-4b09-8965-77485f3cf9a5 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:18:01.595521 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88841a6a-4b4f-4b09-8965-77485f3cf9a5 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:18:01.740415 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-88841a6a-4b4f-4b09-8965-77485f3cf9a5 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:18:01.752193 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-88841a6a-4b4f-4b09-8965-77485f3cf9a5 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1371 microversion: 2.1 time: 0.172990 Aug 31 17:18:01.752879 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3778/7731] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:18:01 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1371 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:18:02.778350 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a4144bbe-837f-4158-aacb-da9655390146 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:18:02.779037 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a4144bbe-837f-4158-aacb-da9655390146 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:18:02.786862 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a4144bbe-837f-4158-aacb-da9655390146 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:18:02.787360 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a4144bbe-837f-4158-aacb-da9655390146 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:18:02.787813 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a4144bbe-837f-4158-aacb-da9655390146 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:18:02.788521 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a4144bbe-837f-4158-aacb-da9655390146 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:18:02.789014 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a4144bbe-837f-4158-aacb-da9655390146 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:18:02.789445 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a4144bbe-837f-4158-aacb-da9655390146 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:18:02.933498 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a4144bbe-837f-4158-aacb-da9655390146 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:18:02.941699 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a4144bbe-837f-4158-aacb-da9655390146 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1371 microversion: 2.1 time: 0.169156 Aug 31 17:18:02.942283 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3954/7732] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:18:02 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:18:03.963922 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0979d35b-b521-4bfe-bfbb-510ac83f6a8f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:18:03.964686 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0979d35b-b521-4bfe-bfbb-510ac83f6a8f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:18:03.972418 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0979d35b-b521-4bfe-bfbb-510ac83f6a8f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:18:03.972910 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0979d35b-b521-4bfe-bfbb-510ac83f6a8f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:18:03.973343 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0979d35b-b521-4bfe-bfbb-510ac83f6a8f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:18:03.974041 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0979d35b-b521-4bfe-bfbb-510ac83f6a8f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:18:03.974520 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0979d35b-b521-4bfe-bfbb-510ac83f6a8f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:18:03.974932 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0979d35b-b521-4bfe-bfbb-510ac83f6a8f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:18:04.199094 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0979d35b-b521-4bfe-bfbb-510ac83f6a8f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:18:04.208102 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0979d35b-b521-4bfe-bfbb-510ac83f6a8f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1371 microversion: 2.1 time: 0.248434 Aug 31 17:18:04.209129 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3779/7733] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:18:03 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1371 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:18:05.230778 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2ea74f06-0d62-4ca7-b4a1-b428a4ea17e3 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:18:05.231393 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2ea74f06-0d62-4ca7-b4a1-b428a4ea17e3 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:18:05.238874 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2ea74f06-0d62-4ca7-b4a1-b428a4ea17e3 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:18:05.239378 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2ea74f06-0d62-4ca7-b4a1-b428a4ea17e3 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:18:05.239820 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2ea74f06-0d62-4ca7-b4a1-b428a4ea17e3 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:18:05.240534 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2ea74f06-0d62-4ca7-b4a1-b428a4ea17e3 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:18:05.240998 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2ea74f06-0d62-4ca7-b4a1-b428a4ea17e3 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:18:05.241411 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2ea74f06-0d62-4ca7-b4a1-b428a4ea17e3 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:18:05.407715 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2ea74f06-0d62-4ca7-b4a1-b428a4ea17e3 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:18:05.417253 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2ea74f06-0d62-4ca7-b4a1-b428a4ea17e3 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1371 microversion: 2.1 time: 0.190178 Aug 31 17:18:05.417871 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3955/7734] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:18:05 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1371 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:18:06.439399 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f40cdf28-8980-4a98-868b-c75b9710a82e tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:18:06.440006 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f40cdf28-8980-4a98-868b-c75b9710a82e tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:18:06.447823 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f40cdf28-8980-4a98-868b-c75b9710a82e tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:18:06.448937 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f40cdf28-8980-4a98-868b-c75b9710a82e tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:18:06.449414 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f40cdf28-8980-4a98-868b-c75b9710a82e tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:18:06.450911 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f40cdf28-8980-4a98-868b-c75b9710a82e tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:18:06.451374 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f40cdf28-8980-4a98-868b-c75b9710a82e tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:18:06.451800 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f40cdf28-8980-4a98-868b-c75b9710a82e tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:18:06.598756 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f40cdf28-8980-4a98-868b-c75b9710a82e tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:18:06.608038 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f40cdf28-8980-4a98-868b-c75b9710a82e tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1371 microversion: 2.1 time: 0.172950 Aug 31 17:18:06.609318 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3780/7735] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:18:06 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1371 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:18:07.629196 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b2603841-c6f5-42dd-860b-d9cdfb57e66d tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:18:07.629823 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b2603841-c6f5-42dd-860b-d9cdfb57e66d tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:18:07.637349 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b2603841-c6f5-42dd-860b-d9cdfb57e66d tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:18:07.637820 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b2603841-c6f5-42dd-860b-d9cdfb57e66d tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:18:07.638311 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b2603841-c6f5-42dd-860b-d9cdfb57e66d tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:18:07.639056 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b2603841-c6f5-42dd-860b-d9cdfb57e66d tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:18:07.639509 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b2603841-c6f5-42dd-860b-d9cdfb57e66d tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:18:07.639939 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b2603841-c6f5-42dd-860b-d9cdfb57e66d tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:18:07.783365 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b2603841-c6f5-42dd-860b-d9cdfb57e66d tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:18:07.795361 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b2603841-c6f5-42dd-860b-d9cdfb57e66d tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1371 microversion: 2.1 time: 0.170057 Aug 31 17:18:07.795982 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3956/7736] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:18:07 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:18:08.097842 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-6ff9e654-b127-4f20-8760-e22984137d24 req-e42d95d0-9b2c-486b-8417-ac5edcadcf87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3351fdc2-a112-4d61-8ffa-6a4f590e4433", "name": "network-vif-plugged", "status": "completed", "tag": "ecc7a4a6-52c0-48c1-b922-83e59b645f00"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:18:08.107711 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-6ff9e654-b127-4f20-8760-e22984137d24 req-e42d95d0-9b2c-486b-8417-ac5edcadcf87 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:18:08.108182 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-6ff9e654-b127-4f20-8760-e22984137d24 req-e42d95d0-9b2c-486b-8417-ac5edcadcf87 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:18:08.108844 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-6ff9e654-b127-4f20-8760-e22984137d24 req-e42d95d0-9b2c-486b-8417-ac5edcadcf87 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:18:08.120523 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-6ff9e654-b127-4f20-8760-e22984137d24 req-e42d95d0-9b2c-486b-8417-ac5edcadcf87 service nova] Creating event network-vif-plugged:ecc7a4a6-52c0-48c1-b922-83e59b645f00 for instance 3351fdc2-a112-4d61-8ffa-6a4f590e4433 on n-h2-833090-16 Aug 31 17:18:08.125618 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-6ff9e654-b127-4f20-8760-e22984137d24 req-e42d95d0-9b2c-486b-8417-ac5edcadcf87 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087492 Aug 31 17:18:08.126399 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3781/7737] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:18:08.821635 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-02031e6a-9fb2-4435-b191-4e620c30923f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:18:08.822451 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-02031e6a-9fb2-4435-b191-4e620c30923f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:18:08.825814 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:18:08.827372 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=6 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:18:08.837374 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-02031e6a-9fb2-4435-b191-4e620c30923f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:18:08.838056 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-02031e6a-9fb2-4435-b191-4e620c30923f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:18:08.838710 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-02031e6a-9fb2-4435-b191-4e620c30923f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:18:08.839666 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-02031e6a-9fb2-4435-b191-4e620c30923f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:18:08.840296 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-02031e6a-9fb2-4435-b191-4e620c30923f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:18:08.840967 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-02031e6a-9fb2-4435-b191-4e620c30923f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:18:08.986256 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-02031e6a-9fb2-4435-b191-4e620c30923f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:18:08.994302 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-02031e6a-9fb2-4435-b191-4e620c30923f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1371 microversion: 2.1 time: 0.180400 Aug 31 17:18:08.994879 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3957/7738] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:18:08 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1371 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:18:10.014065 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:18:10.020843 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4013231a-fda6-49c2-9cbe-29fa748ebe89 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:18:10.021868 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4013231a-fda6-49c2-9cbe-29fa748ebe89 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:18:10.031279 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4013231a-fda6-49c2-9cbe-29fa748ebe89 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:18:10.031916 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4013231a-fda6-49c2-9cbe-29fa748ebe89 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:18:10.032408 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4013231a-fda6-49c2-9cbe-29fa748ebe89 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:18:10.033429 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4013231a-fda6-49c2-9cbe-29fa748ebe89 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:18:10.034005 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4013231a-fda6-49c2-9cbe-29fa748ebe89 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:18:10.034602 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4013231a-fda6-49c2-9cbe-29fa748ebe89 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:18:10.181146 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4013231a-fda6-49c2-9cbe-29fa748ebe89 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:18:10.189550 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4013231a-fda6-49c2-9cbe-29fa748ebe89 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1555 microversion: 2.1 time: 0.176985 Aug 31 17:18:10.190154 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3782/7739] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:18:10 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1555 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:18:10.211546 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-e4452eea-c4db-4fc8-9e30-f898c7a0a83e tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:18:10.212144 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-e4452eea-c4db-4fc8-9e30-f898c7a0a83e tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:18:10.220233 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4452eea-c4db-4fc8-9e30-f898c7a0a83e tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:18:10.220749 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4452eea-c4db-4fc8-9e30-f898c7a0a83e tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:18:10.221579 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4452eea-c4db-4fc8-9e30-f898c7a0a83e tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:18:10.222373 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4452eea-c4db-4fc8-9e30-f898c7a0a83e tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:18:10.222873 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4452eea-c4db-4fc8-9e30-f898c7a0a83e tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:18:10.223395 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-e4452eea-c4db-4fc8-9e30-f898c7a0a83e tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:18:10.367068 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-e4452eea-c4db-4fc8-9e30-f898c7a0a83e tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:18:10.375888 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-e4452eea-c4db-4fc8-9e30-f898c7a0a83e tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1555 microversion: 2.1 time: 0.168715 Aug 31 17:18:10.376484 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3958/7740] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:18:10 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1555 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:18:12.181214 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-53567871-80a9-4717-9ef2-376b84800a9d req-338812fd-4f82-4ad6-9697-858740edcd9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3351fdc2-a112-4d61-8ffa-6a4f590e4433", "tag": "ecc7a4a6-52c0-48c1-b922-83e59b645f00"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:18:12.192997 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-53567871-80a9-4717-9ef2-376b84800a9d req-338812fd-4f82-4ad6-9697-858740edcd9f service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:18:12.193606 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-53567871-80a9-4717-9ef2-376b84800a9d req-338812fd-4f82-4ad6-9697-858740edcd9f service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:18:12.194036 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-53567871-80a9-4717-9ef2-376b84800a9d req-338812fd-4f82-4ad6-9697-858740edcd9f service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:18:12.206760 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-53567871-80a9-4717-9ef2-376b84800a9d req-338812fd-4f82-4ad6-9697-858740edcd9f service nova] Creating event network-changed:ecc7a4a6-52c0-48c1-b922-83e59b645f00 for instance 3351fdc2-a112-4d61-8ffa-6a4f590e4433 on n-h2-833090-16 Aug 31 17:18:12.211919 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-53567871-80a9-4717-9ef2-376b84800a9d req-338812fd-4f82-4ad6-9697-858740edcd9f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036192 Aug 31 17:18:12.212562 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3783/7741] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:20:49.128879 n-d-833090-16 devstack@n-api.service[128864]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0684e720-ea0e-4737-a458-87e19068aaad] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 31 17:20:49.130084 n-d-833090-16 devstack@n-api.service[128864]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4f3e0afc-1d0e-4db3-9143-6185c0e157a7] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 31 17:20:49.130688 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:20:49.131494 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=40 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:20:49.132801 n-d-833090-16 devstack@n-api.service[128864]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 17:20:49.133226 n-d-833090-16 devstack@n-api.service[128864]: Wed Aug 31 17:20:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433/action (ip 10.222.0.50) !!! Aug 31 17:20:49.134309 n-d-833090-16 devstack@n-api.service[128864]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 17:20:49.134550 n-d-833090-16 devstack@n-api.service[128864]: Wed Aug 31 17:20:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433/action (ip 10.222.0.50) !!! Aug 31 17:20:49.135518 n-d-833090-16 devstack@n-api.service[128864]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 17:20:49.135633 n-d-833090-16 devstack@n-api.service[128864]: Wed Aug 31 17:20:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433/action (ip 10.222.0.50) !!! Aug 31 17:20:49.141754 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d0c8d82e-967e-4597-8514-70ac9e3029be tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:20:49.142337 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d0c8d82e-967e-4597-8514-70ac9e3029be tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:20:49.153151 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d0c8d82e-967e-4597-8514-70ac9e3029be tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:49.153692 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d0c8d82e-967e-4597-8514-70ac9e3029be tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:49.154138 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d0c8d82e-967e-4597-8514-70ac9e3029be tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:49.154968 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d0c8d82e-967e-4597-8514-70ac9e3029be tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:49.155676 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d0c8d82e-967e-4597-8514-70ac9e3029be tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:49.155887 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d0c8d82e-967e-4597-8514-70ac9e3029be tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:49.182387 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-d0c8d82e-967e-4597-8514-70ac9e3029be tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lazy-loading 'flavor' on Instance uuid 3351fdc2-a112-4d61-8ffa-6a4f590e4433 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 17:20:49.552755 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d0c8d82e-967e-4597-8514-70ac9e3029be tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "POST /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433/action" status: 202 len: 0 microversion: 2.1 time: 0.425474 Aug 31 17:20:49.553540 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3959/7742] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 17:20:49 2022] POST /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433/action => generated 0 bytes in 428 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:20:49.561793 n-d-833090-16 devstack@n-api.service[128863]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6edb9245-c569-4b8e-9560-fba55d2b56a3] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 17:20:49.562555 n-d-833090-16 devstack@n-api.service[128863]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a572ecc8-7c5f-4ee8-b179-c0e5cc05c499] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 17:20:49.563151 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:20:49.565290 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=34 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:20:49.565488 n-d-833090-16 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 17:20:49.565645 n-d-833090-16 devstack@n-api.service[128863]: Wed Aug 31 17:20:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 (ip 10.222.0.50) !!! Aug 31 17:20:49.568263 n-d-833090-16 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 17:20:49.568263 n-d-833090-16 devstack@n-api.service[128863]: Wed Aug 31 17:20:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 (ip 10.222.0.50) !!! Aug 31 17:20:49.568640 n-d-833090-16 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 17:20:49.568773 n-d-833090-16 devstack@n-api.service[128863]: Wed Aug 31 17:20:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 (ip 10.222.0.50) !!! Aug 31 17:20:49.575948 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ec19195e-2e75-44c3-8032-dcb69f6ca986 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:20:49.576895 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ec19195e-2e75-44c3-8032-dcb69f6ca986 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:20:49.589108 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ec19195e-2e75-44c3-8032-dcb69f6ca986 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:49.589703 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ec19195e-2e75-44c3-8032-dcb69f6ca986 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:49.590259 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ec19195e-2e75-44c3-8032-dcb69f6ca986 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:49.590975 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ec19195e-2e75-44c3-8032-dcb69f6ca986 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:49.591465 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ec19195e-2e75-44c3-8032-dcb69f6ca986 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:49.591890 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ec19195e-2e75-44c3-8032-dcb69f6ca986 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:49.801516 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ec19195e-2e75-44c3-8032-dcb69f6ca986 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:20:49.810564 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ec19195e-2e75-44c3-8032-dcb69f6ca986 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1679 microversion: 2.1 time: 0.250935 Aug 31 17:20:49.811335 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3784/7743] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:20:49 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1679 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:20:50.837781 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1cff1b02-b5a8-42ee-aea2-415f8ff798dd tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:20:50.838544 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1cff1b02-b5a8-42ee-aea2-415f8ff798dd tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:20:50.849538 n-d-833090-16 devstack@n-api.service[128864]: INFO oslo.messaging._drivers.impl_rabbit [-] [0684e720-ea0e-4737-a458-87e19068aaad] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 52858. Aug 31 17:20:50.851816 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1cff1b02-b5a8-42ee-aea2-415f8ff798dd tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:50.852319 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1cff1b02-b5a8-42ee-aea2-415f8ff798dd tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:50.852771 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1cff1b02-b5a8-42ee-aea2-415f8ff798dd tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:50.853486 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1cff1b02-b5a8-42ee-aea2-415f8ff798dd tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:50.853961 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1cff1b02-b5a8-42ee-aea2-415f8ff798dd tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:50.854431 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1cff1b02-b5a8-42ee-aea2-415f8ff798dd tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:50.855047 n-d-833090-16 devstack@n-api.service[128864]: INFO oslo.messaging._drivers.impl_rabbit [-] [4f3e0afc-1d0e-4db3-9143-6185c0e157a7] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 52860. Aug 31 17:20:50.994337 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1cff1b02-b5a8-42ee-aea2-415f8ff798dd tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:20:51.002686 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1cff1b02-b5a8-42ee-aea2-415f8ff798dd tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1679 microversion: 2.1 time: 0.174176 Aug 31 17:20:51.003264 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3960/7744] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:20:50 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1679 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:20:52.025128 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dee6cbc4-12ad-4f2e-a4a9-7a5edb430d1c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:20:52.025823 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dee6cbc4-12ad-4f2e-a4a9-7a5edb430d1c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:20:52.036351 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dee6cbc4-12ad-4f2e-a4a9-7a5edb430d1c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:52.036840 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dee6cbc4-12ad-4f2e-a4a9-7a5edb430d1c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:52.037274 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dee6cbc4-12ad-4f2e-a4a9-7a5edb430d1c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:52.038011 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dee6cbc4-12ad-4f2e-a4a9-7a5edb430d1c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:52.038508 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dee6cbc4-12ad-4f2e-a4a9-7a5edb430d1c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:52.038934 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dee6cbc4-12ad-4f2e-a4a9-7a5edb430d1c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:52.043554 n-d-833090-16 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] [6edb9245-c569-4b8e-9560-fba55d2b56a3] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 52864. Aug 31 17:20:52.047282 n-d-833090-16 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] [a572ecc8-7c5f-4ee8-b179-c0e5cc05c499] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 52866. Aug 31 17:20:52.185008 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-dee6cbc4-12ad-4f2e-a4a9-7a5edb430d1c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:20:52.193490 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dee6cbc4-12ad-4f2e-a4a9-7a5edb430d1c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1679 microversion: 2.1 time: 0.172363 Aug 31 17:20:52.194073 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3785/7745] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:20:52 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:20:53.215958 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-243ece60-1072-41b2-b2d6-ee228b31b159 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:20:53.216561 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-243ece60-1072-41b2-b2d6-ee228b31b159 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:20:53.224292 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-243ece60-1072-41b2-b2d6-ee228b31b159 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:53.224782 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-243ece60-1072-41b2-b2d6-ee228b31b159 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:53.225222 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-243ece60-1072-41b2-b2d6-ee228b31b159 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:53.225929 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-243ece60-1072-41b2-b2d6-ee228b31b159 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:53.226422 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-243ece60-1072-41b2-b2d6-ee228b31b159 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:53.226853 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-243ece60-1072-41b2-b2d6-ee228b31b159 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:53.373630 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-243ece60-1072-41b2-b2d6-ee228b31b159 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:20:53.382633 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-243ece60-1072-41b2-b2d6-ee228b31b159 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1679 microversion: 2.1 time: 0.171062 Aug 31 17:20:53.383246 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3961/7746] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:20:53 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:20:54.408409 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-022b84ed-05f7-4877-98f6-afeef68c4239 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:20:54.409035 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-022b84ed-05f7-4877-98f6-afeef68c4239 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:20:54.416420 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-022b84ed-05f7-4877-98f6-afeef68c4239 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:54.416928 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-022b84ed-05f7-4877-98f6-afeef68c4239 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:54.417359 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-022b84ed-05f7-4877-98f6-afeef68c4239 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:54.418056 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-022b84ed-05f7-4877-98f6-afeef68c4239 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:54.418539 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-022b84ed-05f7-4877-98f6-afeef68c4239 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:54.418967 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-022b84ed-05f7-4877-98f6-afeef68c4239 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:54.574826 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-022b84ed-05f7-4877-98f6-afeef68c4239 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:20:54.583098 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-022b84ed-05f7-4877-98f6-afeef68c4239 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1679 microversion: 2.1 time: 0.180380 Aug 31 17:20:54.583688 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3786/7747] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:20:54 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1679 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:20:55.608887 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fa750486-cf04-498c-8b2b-e9662a5e19ca tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:20:55.610077 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fa750486-cf04-498c-8b2b-e9662a5e19ca tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:20:55.617932 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fa750486-cf04-498c-8b2b-e9662a5e19ca tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:55.618753 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fa750486-cf04-498c-8b2b-e9662a5e19ca tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:55.619304 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fa750486-cf04-498c-8b2b-e9662a5e19ca tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:55.620222 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fa750486-cf04-498c-8b2b-e9662a5e19ca tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:55.620834 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fa750486-cf04-498c-8b2b-e9662a5e19ca tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:55.621393 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fa750486-cf04-498c-8b2b-e9662a5e19ca tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:55.777816 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-fa750486-cf04-498c-8b2b-e9662a5e19ca tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:20:55.787899 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fa750486-cf04-498c-8b2b-e9662a5e19ca tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1679 microversion: 2.1 time: 0.184231 Aug 31 17:20:55.788483 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3962/7748] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:20:55 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1679 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:20:56.809405 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fcb7d3d4-5f44-4216-83a1-459b92399ad7 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:20:56.810049 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fcb7d3d4-5f44-4216-83a1-459b92399ad7 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:20:56.818432 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fcb7d3d4-5f44-4216-83a1-459b92399ad7 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:56.818929 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fcb7d3d4-5f44-4216-83a1-459b92399ad7 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:56.819349 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fcb7d3d4-5f44-4216-83a1-459b92399ad7 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:56.820062 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fcb7d3d4-5f44-4216-83a1-459b92399ad7 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:56.820685 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fcb7d3d4-5f44-4216-83a1-459b92399ad7 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:56.821256 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fcb7d3d4-5f44-4216-83a1-459b92399ad7 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:56.973855 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fcb7d3d4-5f44-4216-83a1-459b92399ad7 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:20:56.983047 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fcb7d3d4-5f44-4216-83a1-459b92399ad7 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1679 microversion: 2.1 time: 0.177342 Aug 31 17:20:56.983921 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3787/7749] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:20:56 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1679 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:20:58.005934 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-94d36776-2588-45d5-9432-e1123e85261d tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:20:58.006665 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-94d36776-2588-45d5-9432-e1123e85261d tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:20:58.014732 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-94d36776-2588-45d5-9432-e1123e85261d tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:58.015271 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-94d36776-2588-45d5-9432-e1123e85261d tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:58.015755 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-94d36776-2588-45d5-9432-e1123e85261d tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:58.016525 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-94d36776-2588-45d5-9432-e1123e85261d tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:58.017091 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-94d36776-2588-45d5-9432-e1123e85261d tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:58.017549 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-94d36776-2588-45d5-9432-e1123e85261d tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:58.169461 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-94d36776-2588-45d5-9432-e1123e85261d tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:20:58.177833 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-94d36776-2588-45d5-9432-e1123e85261d tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1679 microversion: 2.1 time: 0.176434 Aug 31 17:20:58.178500 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3963/7750] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:20:58 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1679 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:20:59.203382 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-055c82cf-062f-4d6e-aa72-b2c99dad41ed tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:20:59.204144 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-055c82cf-062f-4d6e-aa72-b2c99dad41ed tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:20:59.212670 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-055c82cf-062f-4d6e-aa72-b2c99dad41ed tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:59.213143 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-055c82cf-062f-4d6e-aa72-b2c99dad41ed tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:59.213567 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-055c82cf-062f-4d6e-aa72-b2c99dad41ed tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:59.214327 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-055c82cf-062f-4d6e-aa72-b2c99dad41ed tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:20:59.214763 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-055c82cf-062f-4d6e-aa72-b2c99dad41ed tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:20:59.215484 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-055c82cf-062f-4d6e-aa72-b2c99dad41ed tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:20:59.361119 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-055c82cf-062f-4d6e-aa72-b2c99dad41ed tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:20:59.371567 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-055c82cf-062f-4d6e-aa72-b2c99dad41ed tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1679 microversion: 2.1 time: 0.175572 Aug 31 17:20:59.372180 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3788/7751] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:20:59 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1679 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:21:00.394214 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5b644bdb-f24d-4194-a133-04ba41986048 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:21:00.394835 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5b644bdb-f24d-4194-a133-04ba41986048 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:21:00.402983 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5b644bdb-f24d-4194-a133-04ba41986048 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:00.403866 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5b644bdb-f24d-4194-a133-04ba41986048 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:00.404370 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5b644bdb-f24d-4194-a133-04ba41986048 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:00.405156 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5b644bdb-f24d-4194-a133-04ba41986048 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:00.405711 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5b644bdb-f24d-4194-a133-04ba41986048 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:00.406157 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5b644bdb-f24d-4194-a133-04ba41986048 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:00.567520 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5b644bdb-f24d-4194-a133-04ba41986048 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:21:00.580467 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5b644bdb-f24d-4194-a133-04ba41986048 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1679 microversion: 2.1 time: 0.190816 Aug 31 17:21:00.581062 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3964/7752] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:21:00 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1679 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:21:01.604222 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1e15dc07-d965-44ed-9c64-426f11e85700 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:21:01.604867 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1e15dc07-d965-44ed-9c64-426f11e85700 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:21:01.612755 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e15dc07-d965-44ed-9c64-426f11e85700 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:01.613676 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e15dc07-d965-44ed-9c64-426f11e85700 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:01.614154 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e15dc07-d965-44ed-9c64-426f11e85700 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:01.614932 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e15dc07-d965-44ed-9c64-426f11e85700 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:01.615437 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e15dc07-d965-44ed-9c64-426f11e85700 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:01.615869 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e15dc07-d965-44ed-9c64-426f11e85700 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:01.765306 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1e15dc07-d965-44ed-9c64-426f11e85700 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:21:01.776357 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1e15dc07-d965-44ed-9c64-426f11e85700 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1700 microversion: 2.1 time: 0.175591 Aug 31 17:21:01.777525 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3789/7753] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:21:01 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1700 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:21:02.803591 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5d7f14d9-9b5e-474b-bdca-07b086a92fc6 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:21:02.804195 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5d7f14d9-9b5e-474b-bdca-07b086a92fc6 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:21:02.811757 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5d7f14d9-9b5e-474b-bdca-07b086a92fc6 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:02.812262 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5d7f14d9-9b5e-474b-bdca-07b086a92fc6 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:02.812707 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5d7f14d9-9b5e-474b-bdca-07b086a92fc6 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:02.813427 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5d7f14d9-9b5e-474b-bdca-07b086a92fc6 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:02.813894 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5d7f14d9-9b5e-474b-bdca-07b086a92fc6 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:02.814363 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5d7f14d9-9b5e-474b-bdca-07b086a92fc6 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:02.978768 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5d7f14d9-9b5e-474b-bdca-07b086a92fc6 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:21:02.987449 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5d7f14d9-9b5e-474b-bdca-07b086a92fc6 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1700 microversion: 2.1 time: 0.189852 Aug 31 17:21:02.988057 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3965/7754] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:21:02 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1700 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:21:04.010623 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b5035c7c-a4a5-421d-ae47-bd086bd052b9 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:21:04.011199 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b5035c7c-a4a5-421d-ae47-bd086bd052b9 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:21:04.019200 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5035c7c-a4a5-421d-ae47-bd086bd052b9 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:04.019714 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5035c7c-a4a5-421d-ae47-bd086bd052b9 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:04.020146 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5035c7c-a4a5-421d-ae47-bd086bd052b9 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:04.020842 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5035c7c-a4a5-421d-ae47-bd086bd052b9 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:04.021292 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5035c7c-a4a5-421d-ae47-bd086bd052b9 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:04.021738 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b5035c7c-a4a5-421d-ae47-bd086bd052b9 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:04.165799 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b5035c7c-a4a5-421d-ae47-bd086bd052b9 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:21:04.177851 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b5035c7c-a4a5-421d-ae47-bd086bd052b9 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1700 microversion: 2.1 time: 0.171069 Aug 31 17:21:04.178477 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3790/7755] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:21:04 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1700 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:21:04.931810 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-5c4e257d-c679-4dc9-9811-aa0e28bc5dd3 req-d53c9271-89dd-4547-9aee-82de5934e24a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3351fdc2-a112-4d61-8ffa-6a4f590e4433", "name": "network-vif-plugged", "status": "completed", "tag": "ecc7a4a6-52c0-48c1-b922-83e59b645f00"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:21:04.943419 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-5c4e257d-c679-4dc9-9811-aa0e28bc5dd3 req-d53c9271-89dd-4547-9aee-82de5934e24a service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:04.943907 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-5c4e257d-c679-4dc9-9811-aa0e28bc5dd3 req-d53c9271-89dd-4547-9aee-82de5934e24a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:04.944343 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-5c4e257d-c679-4dc9-9811-aa0e28bc5dd3 req-d53c9271-89dd-4547-9aee-82de5934e24a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:04.956162 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-5c4e257d-c679-4dc9-9811-aa0e28bc5dd3 req-d53c9271-89dd-4547-9aee-82de5934e24a service nova] Creating event network-vif-plugged:ecc7a4a6-52c0-48c1-b922-83e59b645f00 for instance 3351fdc2-a112-4d61-8ffa-6a4f590e4433 on n-h2-833090-16 Aug 31 17:21:04.961435 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-5c4e257d-c679-4dc9-9811-aa0e28bc5dd3 req-d53c9271-89dd-4547-9aee-82de5934e24a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033486 Aug 31 17:21:04.962230 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3966/7756] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:21:05.213493 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b80a2c8e-18f6-4e64-9774-611d2552c39a tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:21:05.214497 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b80a2c8e-18f6-4e64-9774-611d2552c39a tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:21:05.225376 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b80a2c8e-18f6-4e64-9774-611d2552c39a tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:05.225867 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b80a2c8e-18f6-4e64-9774-611d2552c39a tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:05.226447 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b80a2c8e-18f6-4e64-9774-611d2552c39a tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:05.227178 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b80a2c8e-18f6-4e64-9774-611d2552c39a tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:05.227634 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b80a2c8e-18f6-4e64-9774-611d2552c39a tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:05.228054 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b80a2c8e-18f6-4e64-9774-611d2552c39a tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:05.385077 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-b80a2c8e-18f6-4e64-9774-611d2552c39a tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:21:05.393264 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b80a2c8e-18f6-4e64-9774-611d2552c39a tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1700 microversion: 2.1 time: 0.186907 Aug 31 17:21:05.393858 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3791/7757] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:21:05 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1700 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:21:06.416838 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-23fe630e-e1ab-4006-96f1-94c8266d1753 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:21:06.417525 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-23fe630e-e1ab-4006-96f1-94c8266d1753 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:21:06.424870 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-23fe630e-e1ab-4006-96f1-94c8266d1753 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:06.425366 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-23fe630e-e1ab-4006-96f1-94c8266d1753 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:06.425853 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-23fe630e-e1ab-4006-96f1-94c8266d1753 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:06.426593 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-23fe630e-e1ab-4006-96f1-94c8266d1753 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:06.427056 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-23fe630e-e1ab-4006-96f1-94c8266d1753 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:06.427521 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-23fe630e-e1ab-4006-96f1-94c8266d1753 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:06.573696 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-23fe630e-e1ab-4006-96f1-94c8266d1753 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:21:06.582512 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-23fe630e-e1ab-4006-96f1-94c8266d1753 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1700 microversion: 2.1 time: 0.171223 Aug 31 17:21:06.583097 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3967/7758] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:21:06 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1700 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:21:07.605333 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5136ef31-6b5f-4ab8-aa9c-c5856888664a tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:21:07.605932 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5136ef31-6b5f-4ab8-aa9c-c5856888664a tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:21:07.613813 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5136ef31-6b5f-4ab8-aa9c-c5856888664a tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:07.614353 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5136ef31-6b5f-4ab8-aa9c-c5856888664a tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:07.614790 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5136ef31-6b5f-4ab8-aa9c-c5856888664a tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:07.615492 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5136ef31-6b5f-4ab8-aa9c-c5856888664a tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:07.615948 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5136ef31-6b5f-4ab8-aa9c-c5856888664a tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:07.616419 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5136ef31-6b5f-4ab8-aa9c-c5856888664a tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:07.775439 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5136ef31-6b5f-4ab8-aa9c-c5856888664a tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:21:07.787725 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5136ef31-6b5f-4ab8-aa9c-c5856888664a tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1700 microversion: 2.1 time: 0.186532 Aug 31 17:21:07.788818 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3792/7759] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:21:07 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1700 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:21:08.815355 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7cecedbc-f4a7-49fa-b07a-a118739d0b98 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:21:08.816639 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7cecedbc-f4a7-49fa-b07a-a118739d0b98 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:21:08.824794 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7cecedbc-f4a7-49fa-b07a-a118739d0b98 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:08.825318 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7cecedbc-f4a7-49fa-b07a-a118739d0b98 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:08.825778 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7cecedbc-f4a7-49fa-b07a-a118739d0b98 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:08.826524 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7cecedbc-f4a7-49fa-b07a-a118739d0b98 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:08.826992 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7cecedbc-f4a7-49fa-b07a-a118739d0b98 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:08.827439 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7cecedbc-f4a7-49fa-b07a-a118739d0b98 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:08.983176 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7cecedbc-f4a7-49fa-b07a-a118739d0b98 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:21:08.992123 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7cecedbc-f4a7-49fa-b07a-a118739d0b98 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1695 microversion: 2.1 time: 0.180768 Aug 31 17:21:08.992963 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3968/7760] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:21:08 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1695 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:21:10.016412 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e68d1ec3-2853-4765-94db-4bcd3cc8b317 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:21:10.017080 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e68d1ec3-2853-4765-94db-4bcd3cc8b317 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:21:10.024684 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e68d1ec3-2853-4765-94db-4bcd3cc8b317 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:10.025446 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e68d1ec3-2853-4765-94db-4bcd3cc8b317 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:10.026085 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e68d1ec3-2853-4765-94db-4bcd3cc8b317 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:10.026802 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e68d1ec3-2853-4765-94db-4bcd3cc8b317 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:10.027247 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e68d1ec3-2853-4765-94db-4bcd3cc8b317 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:10.027669 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e68d1ec3-2853-4765-94db-4bcd3cc8b317 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:10.186105 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e68d1ec3-2853-4765-94db-4bcd3cc8b317 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:21:10.199929 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e68d1ec3-2853-4765-94db-4bcd3cc8b317 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1695 microversion: 2.1 time: 0.186895 Aug 31 17:21:10.201159 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3793/7761] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:21:10 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1695 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:21:11.222765 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-982f1c61-1c5e-428e-af30-a319fad16fa1 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:21:11.223466 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-982f1c61-1c5e-428e-af30-a319fad16fa1 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:21:11.232216 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-982f1c61-1c5e-428e-af30-a319fad16fa1 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:11.232687 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-982f1c61-1c5e-428e-af30-a319fad16fa1 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:11.233173 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-982f1c61-1c5e-428e-af30-a319fad16fa1 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:11.233917 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-982f1c61-1c5e-428e-af30-a319fad16fa1 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:11.234483 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-982f1c61-1c5e-428e-af30-a319fad16fa1 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:11.234904 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-982f1c61-1c5e-428e-af30-a319fad16fa1 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:11.415422 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-982f1c61-1c5e-428e-af30-a319fad16fa1 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:21:11.423889 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-982f1c61-1c5e-428e-af30-a319fad16fa1 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1695 microversion: 2.1 time: 0.205385 Aug 31 17:21:11.426813 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3969/7762] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:21:11 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1695 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:21:12.450171 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c3f31c67-eb57-47b6-a1f6-163669c4cf70 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:21:12.451241 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c3f31c67-eb57-47b6-a1f6-163669c4cf70 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:21:12.459620 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3f31c67-eb57-47b6-a1f6-163669c4cf70 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:12.460107 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3f31c67-eb57-47b6-a1f6-163669c4cf70 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:12.460545 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3f31c67-eb57-47b6-a1f6-163669c4cf70 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:12.461241 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3f31c67-eb57-47b6-a1f6-163669c4cf70 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:12.461688 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3f31c67-eb57-47b6-a1f6-163669c4cf70 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:12.462124 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c3f31c67-eb57-47b6-a1f6-163669c4cf70 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:12.618231 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c3f31c67-eb57-47b6-a1f6-163669c4cf70 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:21:12.627481 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c3f31c67-eb57-47b6-a1f6-163669c4cf70 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1695 microversion: 2.1 time: 0.182866 Aug 31 17:21:12.628364 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3794/7763] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:21:12 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1695 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:21:13.650184 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8c1ced21-e8b5-4bee-bc7d-885829c95210 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:21:13.650793 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8c1ced21-e8b5-4bee-bc7d-885829c95210 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:21:13.658199 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8c1ced21-e8b5-4bee-bc7d-885829c95210 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:13.658964 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8c1ced21-e8b5-4bee-bc7d-885829c95210 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:13.659419 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8c1ced21-e8b5-4bee-bc7d-885829c95210 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:13.660139 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8c1ced21-e8b5-4bee-bc7d-885829c95210 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:13.660612 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8c1ced21-e8b5-4bee-bc7d-885829c95210 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:13.661067 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8c1ced21-e8b5-4bee-bc7d-885829c95210 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:13.812036 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8c1ced21-e8b5-4bee-bc7d-885829c95210 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:21:13.823485 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8c1ced21-e8b5-4bee-bc7d-885829c95210 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1695 microversion: 2.1 time: 0.177804 Aug 31 17:21:13.824254 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3970/7764] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:21:13 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1695 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:21:14.847131 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-06d2e07f-d251-4945-8588-23b4d08d3ed4 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:21:14.848561 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-06d2e07f-d251-4945-8588-23b4d08d3ed4 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:21:14.862338 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06d2e07f-d251-4945-8588-23b4d08d3ed4 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:14.862845 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06d2e07f-d251-4945-8588-23b4d08d3ed4 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:14.868326 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06d2e07f-d251-4945-8588-23b4d08d3ed4 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:14.869389 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06d2e07f-d251-4945-8588-23b4d08d3ed4 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:14.870055 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06d2e07f-d251-4945-8588-23b4d08d3ed4 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:14.870700 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-06d2e07f-d251-4945-8588-23b4d08d3ed4 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:15.047697 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-06d2e07f-d251-4945-8588-23b4d08d3ed4 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:21:15.056981 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-06d2e07f-d251-4945-8588-23b4d08d3ed4 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1695 microversion: 2.1 time: 0.214290 Aug 31 17:21:15.057834 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3795/7765] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:21:14 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1695 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:21:16.082026 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-79b3f0c9-2a50-444f-a8d1-38c7541078df tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:21:16.083499 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-79b3f0c9-2a50-444f-a8d1-38c7541078df tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:21:16.090311 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-79b3f0c9-2a50-444f-a8d1-38c7541078df tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:16.091094 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-79b3f0c9-2a50-444f-a8d1-38c7541078df tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:16.091511 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-79b3f0c9-2a50-444f-a8d1-38c7541078df tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:16.092457 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-79b3f0c9-2a50-444f-a8d1-38c7541078df tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:16.092992 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-79b3f0c9-2a50-444f-a8d1-38c7541078df tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:16.093432 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-79b3f0c9-2a50-444f-a8d1-38c7541078df tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:16.267573 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-79b3f0c9-2a50-444f-a8d1-38c7541078df tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:21:16.277019 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-79b3f0c9-2a50-444f-a8d1-38c7541078df tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1695 microversion: 2.1 time: 0.200970 Aug 31 17:21:16.279142 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3971/7766] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:21:16 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1695 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:21:17.301913 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-16c8c435-5e44-42de-9911-e5cdeb45610d tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:21:17.303108 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-16c8c435-5e44-42de-9911-e5cdeb45610d tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:21:17.310376 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16c8c435-5e44-42de-9911-e5cdeb45610d tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:17.310862 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16c8c435-5e44-42de-9911-e5cdeb45610d tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:17.311286 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16c8c435-5e44-42de-9911-e5cdeb45610d tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:17.311976 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16c8c435-5e44-42de-9911-e5cdeb45610d tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:17.312399 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16c8c435-5e44-42de-9911-e5cdeb45610d tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:17.312808 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-16c8c435-5e44-42de-9911-e5cdeb45610d tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:17.461857 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-16c8c435-5e44-42de-9911-e5cdeb45610d tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:21:17.473973 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-16c8c435-5e44-42de-9911-e5cdeb45610d tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1695 microversion: 2.1 time: 0.176013 Aug 31 17:21:17.474842 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3796/7767] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:21:17 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1695 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:21:18.496589 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8e4dc5b4-3ca6-4f99-aa9a-4ef1599d28c3 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:21:18.497168 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8e4dc5b4-3ca6-4f99-aa9a-4ef1599d28c3 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:21:18.504684 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8e4dc5b4-3ca6-4f99-aa9a-4ef1599d28c3 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:18.505179 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8e4dc5b4-3ca6-4f99-aa9a-4ef1599d28c3 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:18.505617 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8e4dc5b4-3ca6-4f99-aa9a-4ef1599d28c3 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:18.506366 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8e4dc5b4-3ca6-4f99-aa9a-4ef1599d28c3 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:18.506858 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8e4dc5b4-3ca6-4f99-aa9a-4ef1599d28c3 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:18.507331 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8e4dc5b4-3ca6-4f99-aa9a-4ef1599d28c3 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:18.659919 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8e4dc5b4-3ca6-4f99-aa9a-4ef1599d28c3 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:21:18.668345 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8e4dc5b4-3ca6-4f99-aa9a-4ef1599d28c3 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1695 microversion: 2.1 time: 0.176333 Aug 31 17:21:18.668960 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3972/7768] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:21:18 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1695 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:21:19.690521 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-7c55c3cc-cfee-470c-9325-3005aa457ca0 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:21:19.691165 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-7c55c3cc-cfee-470c-9325-3005aa457ca0 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:21:19.695270 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=27 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:21:19.701914 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c55c3cc-cfee-470c-9325-3005aa457ca0 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:19.702435 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c55c3cc-cfee-470c-9325-3005aa457ca0 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:19.702874 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c55c3cc-cfee-470c-9325-3005aa457ca0 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:19.703600 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c55c3cc-cfee-470c-9325-3005aa457ca0 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:19.704098 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c55c3cc-cfee-470c-9325-3005aa457ca0 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:19.704568 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-7c55c3cc-cfee-470c-9325-3005aa457ca0 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:19.707376 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=79 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:21:19.857046 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-7c55c3cc-cfee-470c-9325-3005aa457ca0 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:21:19.868191 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-7c55c3cc-cfee-470c-9325-3005aa457ca0 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1677 microversion: 2.1 time: 0.182051 Aug 31 17:21:19.868785 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3797/7769] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:21:19 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1677 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:21:20.889510 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-36eb4bbe-5735-40e1-a9f7-cdd167a8e080 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:21:20.890153 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-36eb4bbe-5735-40e1-a9f7-cdd167a8e080 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:21:20.892238 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=29 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:21:20.898359 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-36eb4bbe-5735-40e1-a9f7-cdd167a8e080 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:20.899129 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-36eb4bbe-5735-40e1-a9f7-cdd167a8e080 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:20.899651 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-36eb4bbe-5735-40e1-a9f7-cdd167a8e080 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:20.900414 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-36eb4bbe-5735-40e1-a9f7-cdd167a8e080 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:20.900856 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-36eb4bbe-5735-40e1-a9f7-cdd167a8e080 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:20.901309 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-36eb4bbe-5735-40e1-a9f7-cdd167a8e080 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:20.904374 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:21:21.062442 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-36eb4bbe-5735-40e1-a9f7-cdd167a8e080 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:21:21.075040 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-36eb4bbe-5735-40e1-a9f7-cdd167a8e080 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1677 microversion: 2.1 time: 0.189015 Aug 31 17:21:21.075833 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3973/7770] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:21:20 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1677 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:21:22.100959 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1dac6876-1fa0-4aff-bea0-230a1307460c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:21:22.101767 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1dac6876-1fa0-4aff-bea0-230a1307460c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:21:22.108808 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1dac6876-1fa0-4aff-bea0-230a1307460c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:22.109292 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1dac6876-1fa0-4aff-bea0-230a1307460c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:22.109717 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1dac6876-1fa0-4aff-bea0-230a1307460c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:22.110444 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1dac6876-1fa0-4aff-bea0-230a1307460c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:22.110889 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1dac6876-1fa0-4aff-bea0-230a1307460c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:22.111288 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1dac6876-1fa0-4aff-bea0-230a1307460c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:22.254749 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1dac6876-1fa0-4aff-bea0-230a1307460c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:21:22.263207 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1dac6876-1fa0-4aff-bea0-230a1307460c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1620 microversion: 2.1 time: 0.166443 Aug 31 17:21:22.263829 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3798/7771] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:21:22 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1620 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:21:22.284271 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-26e8ebae-0cd6-4b16-bf24-ad3439182cff tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:21:22.284820 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-26e8ebae-0cd6-4b16-bf24-ad3439182cff tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:21:22.292564 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26e8ebae-0cd6-4b16-bf24-ad3439182cff tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:22.293111 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26e8ebae-0cd6-4b16-bf24-ad3439182cff tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:22.293497 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26e8ebae-0cd6-4b16-bf24-ad3439182cff tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:22.294224 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26e8ebae-0cd6-4b16-bf24-ad3439182cff tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:22.294693 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26e8ebae-0cd6-4b16-bf24-ad3439182cff tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:22.295122 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-26e8ebae-0cd6-4b16-bf24-ad3439182cff tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:22.416846 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-26e8ebae-0cd6-4b16-bf24-ad3439182cff tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128864) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 17:21:22.503849 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-26e8ebae-0cd6-4b16-bf24-ad3439182cff tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "POST /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433/action" status: 202 len: 0 microversion: 2.1 time: 0.223558 Aug 31 17:21:22.504491 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3974/7772] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 17:21:22 2022] POST /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:21:22.513100 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-887877cb-9500-465e-88b4-48c6aa782928 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:21:22.513691 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-887877cb-9500-465e-88b4-48c6aa782928 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:21:22.519939 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-887877cb-9500-465e-88b4-48c6aa782928 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:22.520410 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-887877cb-9500-465e-88b4-48c6aa782928 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:22.520832 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-887877cb-9500-465e-88b4-48c6aa782928 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:22.521528 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-887877cb-9500-465e-88b4-48c6aa782928 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:22.521999 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-887877cb-9500-465e-88b4-48c6aa782928 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:22.522471 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-887877cb-9500-465e-88b4-48c6aa782928 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:22.669691 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-887877cb-9500-465e-88b4-48c6aa782928 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:21:22.677520 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-887877cb-9500-465e-88b4-48c6aa782928 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1628 microversion: 2.1 time: 0.168288 Aug 31 17:21:22.678110 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3799/7773] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:21:22 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1628 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:21:22.933630 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-bdeef30f-4d44-4fa6-a7df-23b4a0f5c4db req-82685536-dab5-4d8a-8836-e617749ffc4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3351fdc2-a112-4d61-8ffa-6a4f590e4433", "name": "network-vif-unplugged", "status": "completed", "tag": "ecc7a4a6-52c0-48c1-b922-83e59b645f00"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:21:22.945103 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-bdeef30f-4d44-4fa6-a7df-23b4a0f5c4db req-82685536-dab5-4d8a-8836-e617749ffc4c service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:22.945750 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-bdeef30f-4d44-4fa6-a7df-23b4a0f5c4db req-82685536-dab5-4d8a-8836-e617749ffc4c service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:22.946481 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-bdeef30f-4d44-4fa6-a7df-23b4a0f5c4db req-82685536-dab5-4d8a-8836-e617749ffc4c service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:22.960467 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.compute.server_external_events [req-bdeef30f-4d44-4fa6-a7df-23b4a0f5c4db req-82685536-dab5-4d8a-8836-e617749ffc4c service nova] Unable to find a host for instance 3351fdc2-a112-4d61-8ffa-6a4f590e4433. Dropping event network-vif-unplugged {{(pid=128864) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 31 17:21:22.961430 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-bdeef30f-4d44-4fa6-a7df-23b4a0f5c4db req-82685536-dab5-4d8a-8836-e617749ffc4c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031932 Aug 31 17:21:22.962661 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3975/7774] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 31 17:21:23.701741 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-27bba867-f07b-4364-bcbc-6317ed093ff8 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:21:23.702431 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-27bba867-f07b-4364-bcbc-6317ed093ff8 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:21:23.709515 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27bba867-f07b-4364-bcbc-6317ed093ff8 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:23.710037 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27bba867-f07b-4364-bcbc-6317ed093ff8 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:23.710507 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27bba867-f07b-4364-bcbc-6317ed093ff8 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:23.711201 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27bba867-f07b-4364-bcbc-6317ed093ff8 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:23.711658 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27bba867-f07b-4364-bcbc-6317ed093ff8 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:23.712158 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-27bba867-f07b-4364-bcbc-6317ed093ff8 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:23.856382 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-27bba867-f07b-4364-bcbc-6317ed093ff8 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:21:23.864878 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-27bba867-f07b-4364-bcbc-6317ed093ff8 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1686 microversion: 2.1 time: 0.168325 Aug 31 17:21:23.865471 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3800/7775] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:21:23 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1686 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:21:24.887935 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-edb04ae6-377d-41e8-ba83-044e72c012ee tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:21:24.888788 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-edb04ae6-377d-41e8-ba83-044e72c012ee tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:21:24.914625 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-edb04ae6-377d-41e8-ba83-044e72c012ee tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:24.915953 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-edb04ae6-377d-41e8-ba83-044e72c012ee tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:24.917073 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-edb04ae6-377d-41e8-ba83-044e72c012ee tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:24.921492 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-edb04ae6-377d-41e8-ba83-044e72c012ee tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:24.922674 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-edb04ae6-377d-41e8-ba83-044e72c012ee tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:24.923454 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-edb04ae6-377d-41e8-ba83-044e72c012ee tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:25.462860 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-edb04ae6-377d-41e8-ba83-044e72c012ee tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:21:25.471282 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-edb04ae6-377d-41e8-ba83-044e72c012ee tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1686 microversion: 2.1 time: 0.587766 Aug 31 17:21:25.472111 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3976/7776] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:21:24 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1686 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:21:26.493038 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-47c11ce2-b254-4937-bca2-199db0198cdc tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:21:26.493800 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-47c11ce2-b254-4937-bca2-199db0198cdc tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:21:26.501478 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47c11ce2-b254-4937-bca2-199db0198cdc tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:26.501999 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47c11ce2-b254-4937-bca2-199db0198cdc tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:26.502463 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47c11ce2-b254-4937-bca2-199db0198cdc tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:26.503166 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47c11ce2-b254-4937-bca2-199db0198cdc tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:26.503644 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47c11ce2-b254-4937-bca2-199db0198cdc tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:26.504028 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-47c11ce2-b254-4937-bca2-199db0198cdc tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:26.657448 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-47c11ce2-b254-4937-bca2-199db0198cdc tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:21:26.670652 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-47c11ce2-b254-4937-bca2-199db0198cdc tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1686 microversion: 2.1 time: 0.181522 Aug 31 17:21:26.671761 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3801/7777] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:21:26 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1686 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:21:27.692946 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f3b014cf-cb1a-4128-a697-c89ed0a142ab tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:21:27.693571 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f3b014cf-cb1a-4128-a697-c89ed0a142ab tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:21:27.701752 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f3b014cf-cb1a-4128-a697-c89ed0a142ab tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:27.702289 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f3b014cf-cb1a-4128-a697-c89ed0a142ab tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:27.702743 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f3b014cf-cb1a-4128-a697-c89ed0a142ab tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:27.703449 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f3b014cf-cb1a-4128-a697-c89ed0a142ab tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:27.703954 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f3b014cf-cb1a-4128-a697-c89ed0a142ab tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:27.704375 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f3b014cf-cb1a-4128-a697-c89ed0a142ab tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:27.855041 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f3b014cf-cb1a-4128-a697-c89ed0a142ab tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:21:27.864006 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f3b014cf-cb1a-4128-a697-c89ed0a142ab tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1686 microversion: 2.1 time: 0.175133 Aug 31 17:21:27.864810 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3977/7778] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:21:27 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1686 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:21:28.886535 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-90d15bbb-ce44-4a73-9ad7-df42d38bb0df tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:21:28.887376 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-90d15bbb-ce44-4a73-9ad7-df42d38bb0df tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:21:28.901018 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-90d15bbb-ce44-4a73-9ad7-df42d38bb0df tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:28.901665 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-90d15bbb-ce44-4a73-9ad7-df42d38bb0df tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:28.902276 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-90d15bbb-ce44-4a73-9ad7-df42d38bb0df tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:28.903201 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-90d15bbb-ce44-4a73-9ad7-df42d38bb0df tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:28.903928 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-90d15bbb-ce44-4a73-9ad7-df42d38bb0df tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:28.904442 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-90d15bbb-ce44-4a73-9ad7-df42d38bb0df tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:29.050776 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-90d15bbb-ce44-4a73-9ad7-df42d38bb0df tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:21:29.059845 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-90d15bbb-ce44-4a73-9ad7-df42d38bb0df tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1686 microversion: 2.1 time: 0.178123 Aug 31 17:21:29.060600 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3802/7779] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:21:28 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1686 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:21:30.081520 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a5ea6d52-51f1-4fab-8b80-c41d1146489a tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:21:30.082202 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a5ea6d52-51f1-4fab-8b80-c41d1146489a tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:21:30.089688 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5ea6d52-51f1-4fab-8b80-c41d1146489a tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:30.090202 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5ea6d52-51f1-4fab-8b80-c41d1146489a tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:30.090654 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5ea6d52-51f1-4fab-8b80-c41d1146489a tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:30.091346 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5ea6d52-51f1-4fab-8b80-c41d1146489a tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:30.091812 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5ea6d52-51f1-4fab-8b80-c41d1146489a tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:30.092250 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a5ea6d52-51f1-4fab-8b80-c41d1146489a tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:30.249918 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a5ea6d52-51f1-4fab-8b80-c41d1146489a tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:21:30.265415 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a5ea6d52-51f1-4fab-8b80-c41d1146489a tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1686 microversion: 2.1 time: 0.186115 Aug 31 17:21:30.275165 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3978/7780] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:21:30 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1686 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:21:31.288127 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c0349ffe-a959-43b4-af00-77869b6b311b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:21:31.288826 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c0349ffe-a959-43b4-af00-77869b6b311b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:21:31.297192 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0349ffe-a959-43b4-af00-77869b6b311b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:31.297726 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0349ffe-a959-43b4-af00-77869b6b311b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:31.298256 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0349ffe-a959-43b4-af00-77869b6b311b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:31.299093 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0349ffe-a959-43b4-af00-77869b6b311b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:31.299689 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0349ffe-a959-43b4-af00-77869b6b311b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:31.300269 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0349ffe-a959-43b4-af00-77869b6b311b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:31.448501 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c0349ffe-a959-43b4-af00-77869b6b311b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:21:31.457642 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c0349ffe-a959-43b4-af00-77869b6b311b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1686 microversion: 2.1 time: 0.173614 Aug 31 17:21:31.458457 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3803/7781] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:21:31 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1686 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:21:32.481487 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b7723f20-4ebc-4696-930c-e9ec81136d8f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:21:32.482224 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b7723f20-4ebc-4696-930c-e9ec81136d8f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:21:32.490131 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b7723f20-4ebc-4696-930c-e9ec81136d8f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:32.490648 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b7723f20-4ebc-4696-930c-e9ec81136d8f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:32.491097 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b7723f20-4ebc-4696-930c-e9ec81136d8f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:32.491835 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b7723f20-4ebc-4696-930c-e9ec81136d8f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:32.492306 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b7723f20-4ebc-4696-930c-e9ec81136d8f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:32.492743 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b7723f20-4ebc-4696-930c-e9ec81136d8f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:32.641418 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b7723f20-4ebc-4696-930c-e9ec81136d8f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:21:32.653956 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b7723f20-4ebc-4696-930c-e9ec81136d8f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1686 microversion: 2.1 time: 0.177124 Aug 31 17:21:32.654828 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3979/7782] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:21:32 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1686 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:21:33.684547 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-674b8ac7-844a-485f-9c58-6fe1ee67aa15 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:21:33.685239 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-674b8ac7-844a-485f-9c58-6fe1ee67aa15 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:21:33.692903 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-674b8ac7-844a-485f-9c58-6fe1ee67aa15 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:33.693386 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-674b8ac7-844a-485f-9c58-6fe1ee67aa15 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:33.693812 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-674b8ac7-844a-485f-9c58-6fe1ee67aa15 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:33.694528 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-674b8ac7-844a-485f-9c58-6fe1ee67aa15 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:33.694976 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-674b8ac7-844a-485f-9c58-6fe1ee67aa15 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:33.695392 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-674b8ac7-844a-485f-9c58-6fe1ee67aa15 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:33.856749 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-674b8ac7-844a-485f-9c58-6fe1ee67aa15 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:21:33.868942 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-674b8ac7-844a-485f-9c58-6fe1ee67aa15 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1686 microversion: 2.1 time: 0.190104 Aug 31 17:21:33.869863 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3804/7783] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:21:33 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1686 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:21:34.892503 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-454e14e4-9a62-491c-9e5f-9813bd584c75 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:21:34.893111 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-454e14e4-9a62-491c-9e5f-9813bd584c75 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:21:34.900463 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-454e14e4-9a62-491c-9e5f-9813bd584c75 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:34.900953 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-454e14e4-9a62-491c-9e5f-9813bd584c75 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:34.901602 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-454e14e4-9a62-491c-9e5f-9813bd584c75 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:34.902130 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-454e14e4-9a62-491c-9e5f-9813bd584c75 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:34.902767 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-454e14e4-9a62-491c-9e5f-9813bd584c75 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:34.903435 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-454e14e4-9a62-491c-9e5f-9813bd584c75 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:35.040709 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-454e14e4-9a62-491c-9e5f-9813bd584c75 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:21:35.049743 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-454e14e4-9a62-491c-9e5f-9813bd584c75 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1686 microversion: 2.1 time: 0.161237 Aug 31 17:21:35.050344 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3980/7784] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:21:34 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1686 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:21:36.072236 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-64ac4f70-4946-425f-9e91-cd3bd064565f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:21:36.072902 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-64ac4f70-4946-425f-9e91-cd3bd064565f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:21:36.081874 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64ac4f70-4946-425f-9e91-cd3bd064565f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:36.082384 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64ac4f70-4946-425f-9e91-cd3bd064565f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:36.082842 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64ac4f70-4946-425f-9e91-cd3bd064565f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:36.083549 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64ac4f70-4946-425f-9e91-cd3bd064565f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:36.083993 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64ac4f70-4946-425f-9e91-cd3bd064565f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:36.084424 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-64ac4f70-4946-425f-9e91-cd3bd064565f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:36.234154 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-64ac4f70-4946-425f-9e91-cd3bd064565f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:21:36.244205 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-64ac4f70-4946-425f-9e91-cd3bd064565f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1686 microversion: 2.1 time: 0.176051 Aug 31 17:21:36.244783 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3805/7785] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:21:36 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1686 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:21:37.266276 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-3b5e8eac-c42d-457f-93f6-f151df8709f0 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:21:37.267007 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-3b5e8eac-c42d-457f-93f6-f151df8709f0 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:21:37.274764 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3b5e8eac-c42d-457f-93f6-f151df8709f0 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:37.275256 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3b5e8eac-c42d-457f-93f6-f151df8709f0 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:37.275698 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3b5e8eac-c42d-457f-93f6-f151df8709f0 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:37.276388 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3b5e8eac-c42d-457f-93f6-f151df8709f0 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:37.276846 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3b5e8eac-c42d-457f-93f6-f151df8709f0 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:37.277543 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-3b5e8eac-c42d-457f-93f6-f151df8709f0 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:37.425749 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-3b5e8eac-c42d-457f-93f6-f151df8709f0 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:21:37.434555 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-3b5e8eac-c42d-457f-93f6-f151df8709f0 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1686 microversion: 2.1 time: 0.172684 Aug 31 17:21:37.435152 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3981/7786] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:21:37 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1686 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:21:38.456722 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-db8682d8-5f60-414b-922f-2d27e3891b1c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:21:38.457489 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-db8682d8-5f60-414b-922f-2d27e3891b1c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:21:38.465213 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db8682d8-5f60-414b-922f-2d27e3891b1c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:38.465679 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db8682d8-5f60-414b-922f-2d27e3891b1c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:38.466145 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db8682d8-5f60-414b-922f-2d27e3891b1c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:38.466867 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db8682d8-5f60-414b-922f-2d27e3891b1c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:38.467353 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db8682d8-5f60-414b-922f-2d27e3891b1c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:38.467777 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-db8682d8-5f60-414b-922f-2d27e3891b1c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:38.608235 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-db8682d8-5f60-414b-922f-2d27e3891b1c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:21:38.616942 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-db8682d8-5f60-414b-922f-2d27e3891b1c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1686 microversion: 2.1 time: 0.164140 Aug 31 17:21:38.617546 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3806/7787] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:21:38 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1686 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:21:39.641389 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ec0051ed-1b69-476c-8f1f-aaf129ed9033 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:21:39.641988 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ec0051ed-1b69-476c-8f1f-aaf129ed9033 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:21:39.649741 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ec0051ed-1b69-476c-8f1f-aaf129ed9033 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:39.650278 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ec0051ed-1b69-476c-8f1f-aaf129ed9033 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:39.650712 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ec0051ed-1b69-476c-8f1f-aaf129ed9033 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:39.651419 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ec0051ed-1b69-476c-8f1f-aaf129ed9033 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:39.651881 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ec0051ed-1b69-476c-8f1f-aaf129ed9033 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:39.652315 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ec0051ed-1b69-476c-8f1f-aaf129ed9033 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:39.811119 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ec0051ed-1b69-476c-8f1f-aaf129ed9033 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:21:39.819063 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ec0051ed-1b69-476c-8f1f-aaf129ed9033 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1686 microversion: 2.1 time: 0.183432 Aug 31 17:21:39.819639 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3982/7788] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:21:39 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1686 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:21:40.844567 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2acfd6cc-d5bd-40f0-8f76-77f751f22d13 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:21:40.845206 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2acfd6cc-d5bd-40f0-8f76-77f751f22d13 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:21:40.852565 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2acfd6cc-d5bd-40f0-8f76-77f751f22d13 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:40.853050 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2acfd6cc-d5bd-40f0-8f76-77f751f22d13 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:40.853482 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2acfd6cc-d5bd-40f0-8f76-77f751f22d13 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:40.854207 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2acfd6cc-d5bd-40f0-8f76-77f751f22d13 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:40.854649 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2acfd6cc-d5bd-40f0-8f76-77f751f22d13 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:40.855073 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2acfd6cc-d5bd-40f0-8f76-77f751f22d13 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:40.998113 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2acfd6cc-d5bd-40f0-8f76-77f751f22d13 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:21:41.007203 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2acfd6cc-d5bd-40f0-8f76-77f751f22d13 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1686 microversion: 2.1 time: 0.168725 Aug 31 17:21:41.007811 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3807/7789] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:21:40 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1686 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:21:42.032316 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-70664b12-00c7-4eae-9b8d-6a639fe806a5 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:21:42.033398 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-70664b12-00c7-4eae-9b8d-6a639fe806a5 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:21:42.045306 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-70664b12-00c7-4eae-9b8d-6a639fe806a5 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:42.046374 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-70664b12-00c7-4eae-9b8d-6a639fe806a5 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:42.046974 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-70664b12-00c7-4eae-9b8d-6a639fe806a5 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:42.047492 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-70664b12-00c7-4eae-9b8d-6a639fe806a5 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:42.047962 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-70664b12-00c7-4eae-9b8d-6a639fe806a5 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:42.048400 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-70664b12-00c7-4eae-9b8d-6a639fe806a5 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:42.201853 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-70664b12-00c7-4eae-9b8d-6a639fe806a5 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:21:42.210582 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-70664b12-00c7-4eae-9b8d-6a639fe806a5 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1686 microversion: 2.1 time: 0.185019 Aug 31 17:21:42.211155 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3983/7790] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:21:42 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1686 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:21:43.236197 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-88f19162-ba04-4794-8f60-cec2edccd64e tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:21:43.236827 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-88f19162-ba04-4794-8f60-cec2edccd64e tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:21:43.244889 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88f19162-ba04-4794-8f60-cec2edccd64e tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:43.245418 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88f19162-ba04-4794-8f60-cec2edccd64e tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:43.245903 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88f19162-ba04-4794-8f60-cec2edccd64e tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:43.246703 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88f19162-ba04-4794-8f60-cec2edccd64e tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:43.247224 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88f19162-ba04-4794-8f60-cec2edccd64e tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:43.247686 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-88f19162-ba04-4794-8f60-cec2edccd64e tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:43.396184 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-88f19162-ba04-4794-8f60-cec2edccd64e tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:21:43.404393 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-88f19162-ba04-4794-8f60-cec2edccd64e tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1686 microversion: 2.1 time: 0.173187 Aug 31 17:21:43.404978 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3808/7791] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:21:43 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1686 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:21:44.426837 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2b80fa4a-33aa-4777-b0be-4ba7d86cb113 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:21:44.427650 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2b80fa4a-33aa-4777-b0be-4ba7d86cb113 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:21:44.438982 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b80fa4a-33aa-4777-b0be-4ba7d86cb113 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:44.439484 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b80fa4a-33aa-4777-b0be-4ba7d86cb113 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:44.439936 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b80fa4a-33aa-4777-b0be-4ba7d86cb113 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:44.440649 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b80fa4a-33aa-4777-b0be-4ba7d86cb113 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:44.441107 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b80fa4a-33aa-4777-b0be-4ba7d86cb113 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:44.441538 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b80fa4a-33aa-4777-b0be-4ba7d86cb113 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:44.578965 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2b80fa4a-33aa-4777-b0be-4ba7d86cb113 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:21:44.587159 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2b80fa4a-33aa-4777-b0be-4ba7d86cb113 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1686 microversion: 2.1 time: 0.164932 Aug 31 17:21:44.587788 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3984/7792] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:21:44 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1686 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:21:45.078259 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-7ca155dd-66e2-4445-97fe-4d830bc905ad req-e39f56b0-af9a-4d9b-adce-4b0782fed48b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3351fdc2-a112-4d61-8ffa-6a4f590e4433", "name": "network-vif-plugged", "status": "completed", "tag": "ecc7a4a6-52c0-48c1-b922-83e59b645f00"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:21:45.089437 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7ca155dd-66e2-4445-97fe-4d830bc905ad req-e39f56b0-af9a-4d9b-adce-4b0782fed48b service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:45.089952 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7ca155dd-66e2-4445-97fe-4d830bc905ad req-e39f56b0-af9a-4d9b-adce-4b0782fed48b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:45.090408 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-7ca155dd-66e2-4445-97fe-4d830bc905ad req-e39f56b0-af9a-4d9b-adce-4b0782fed48b service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:45.102256 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-7ca155dd-66e2-4445-97fe-4d830bc905ad req-e39f56b0-af9a-4d9b-adce-4b0782fed48b service nova] Creating event network-vif-plugged:ecc7a4a6-52c0-48c1-b922-83e59b645f00 for instance 3351fdc2-a112-4d61-8ffa-6a4f590e4433 on n-h2-833090-16 Aug 31 17:21:45.108453 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-7ca155dd-66e2-4445-97fe-4d830bc905ad req-e39f56b0-af9a-4d9b-adce-4b0782fed48b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034359 Aug 31 17:21:45.109361 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3809/7793] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:21:45.610250 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-affbbb04-fbef-49f1-a41f-8d280de33e70 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:21:45.610866 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-affbbb04-fbef-49f1-a41f-8d280de33e70 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:21:45.618469 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-affbbb04-fbef-49f1-a41f-8d280de33e70 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:45.618894 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-affbbb04-fbef-49f1-a41f-8d280de33e70 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:45.619341 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-affbbb04-fbef-49f1-a41f-8d280de33e70 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:45.620060 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-affbbb04-fbef-49f1-a41f-8d280de33e70 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:45.620532 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-affbbb04-fbef-49f1-a41f-8d280de33e70 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:45.620999 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-affbbb04-fbef-49f1-a41f-8d280de33e70 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:45.786521 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-affbbb04-fbef-49f1-a41f-8d280de33e70 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:21:45.798346 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-affbbb04-fbef-49f1-a41f-8d280de33e70 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1686 microversion: 2.1 time: 0.192749 Aug 31 17:21:45.798937 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3985/7794] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:21:45 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1686 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:21:46.832338 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-df1b82ae-5dac-4afd-9cfb-0a999120effe tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:21:46.833235 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-df1b82ae-5dac-4afd-9cfb-0a999120effe tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:21:46.842736 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df1b82ae-5dac-4afd-9cfb-0a999120effe tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:46.843516 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df1b82ae-5dac-4afd-9cfb-0a999120effe tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:46.843912 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df1b82ae-5dac-4afd-9cfb-0a999120effe tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:46.844626 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df1b82ae-5dac-4afd-9cfb-0a999120effe tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:46.845069 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df1b82ae-5dac-4afd-9cfb-0a999120effe tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:46.845489 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-df1b82ae-5dac-4afd-9cfb-0a999120effe tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:46.992972 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-df1b82ae-5dac-4afd-9cfb-0a999120effe tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:21:47.001697 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-df1b82ae-5dac-4afd-9cfb-0a999120effe tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1686 microversion: 2.1 time: 0.177207 Aug 31 17:21:47.002330 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3810/7795] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:21:46 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1686 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:21:48.027230 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-bf4b3a00-ba43-4fc6-aecf-390344b8e76f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:21:48.028073 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-bf4b3a00-ba43-4fc6-aecf-390344b8e76f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:21:48.037284 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bf4b3a00-ba43-4fc6-aecf-390344b8e76f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:48.038476 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bf4b3a00-ba43-4fc6-aecf-390344b8e76f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:48.039152 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bf4b3a00-ba43-4fc6-aecf-390344b8e76f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:48.040252 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bf4b3a00-ba43-4fc6-aecf-390344b8e76f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:21:48.040819 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bf4b3a00-ba43-4fc6-aecf-390344b8e76f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:21:48.041246 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bf4b3a00-ba43-4fc6-aecf-390344b8e76f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:21:48.197801 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-bf4b3a00-ba43-4fc6-aecf-390344b8e76f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:21:48.209749 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-bf4b3a00-ba43-4fc6-aecf-390344b8e76f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1673 microversion: 2.1 time: 0.188591 Aug 31 17:21:48.210554 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3986/7796] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:21:48 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1673 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:23:46.663642 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-953938d4-5e8a-43ee-acfa-e4b6a95075a5 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:23:46.664220 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:23:46.664653 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-953938d4-5e8a-43ee-acfa-e4b6a95075a5 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:23:46.664944 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:23:46.667157 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=27 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:23:46.667813 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=79 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:23:46.686475 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-953938d4-5e8a-43ee-acfa-e4b6a95075a5 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:23:46.686980 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-953938d4-5e8a-43ee-acfa-e4b6a95075a5 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:23:46.687413 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-953938d4-5e8a-43ee-acfa-e4b6a95075a5 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:23:46.688250 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-953938d4-5e8a-43ee-acfa-e4b6a95075a5 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:23:46.688537 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-953938d4-5e8a-43ee-acfa-e4b6a95075a5 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:23:46.688983 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-953938d4-5e8a-43ee-acfa-e4b6a95075a5 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:23:46.717035 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-953938d4-5e8a-43ee-acfa-e4b6a95075a5 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 17:23:46.738252 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-b86ebfc6-031d-46cf-bef2-b59af38e1176 req-5c64aedb-8dc7-4ced-8265-12a1df68fd86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3351fdc2-a112-4d61-8ffa-6a4f590e4433", "tag": "ecc7a4a6-52c0-48c1-b922-83e59b645f00"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:23:46.751551 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-b86ebfc6-031d-46cf-bef2-b59af38e1176 req-5c64aedb-8dc7-4ced-8265-12a1df68fd86 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:23:46.752774 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-b86ebfc6-031d-46cf-bef2-b59af38e1176 req-5c64aedb-8dc7-4ced-8265-12a1df68fd86 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:23:46.752774 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-b86ebfc6-031d-46cf-bef2-b59af38e1176 req-5c64aedb-8dc7-4ced-8265-12a1df68fd86 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:23:46.764570 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-b86ebfc6-031d-46cf-bef2-b59af38e1176 req-5c64aedb-8dc7-4ced-8265-12a1df68fd86 service nova] Creating event network-changed:ecc7a4a6-52c0-48c1-b922-83e59b645f00 for instance 3351fdc2-a112-4d61-8ffa-6a4f590e4433 on n-h2-833090-16 Aug 31 17:23:46.770221 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-b86ebfc6-031d-46cf-bef2-b59af38e1176 req-5c64aedb-8dc7-4ced-8265-12a1df68fd86 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108509 Aug 31 17:23:46.771075 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3987/7797] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:23:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 17:23:46.803126 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-953938d4-5e8a-43ee-acfa-e4b6a95075a5 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 204 len: 0 microversion: 2.1 time: 0.143875 Aug 31 17:23:46.804778 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3811/7798] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 17:23:46 2022] DELETE /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 17:23:46.815550 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-940ecf0d-0498-4ddb-8a91-dd7d5f1350c2 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:23:46.816934 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-940ecf0d-0498-4ddb-8a91-dd7d5f1350c2 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:23:46.824789 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-940ecf0d-0498-4ddb-8a91-dd7d5f1350c2 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:23:46.825428 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-940ecf0d-0498-4ddb-8a91-dd7d5f1350c2 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:23:46.825972 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-940ecf0d-0498-4ddb-8a91-dd7d5f1350c2 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:23:46.826988 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-940ecf0d-0498-4ddb-8a91-dd7d5f1350c2 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:23:46.827519 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-940ecf0d-0498-4ddb-8a91-dd7d5f1350c2 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:23:46.828024 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-940ecf0d-0498-4ddb-8a91-dd7d5f1350c2 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:23:46.971709 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-940ecf0d-0498-4ddb-8a91-dd7d5f1350c2 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:23:46.980419 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-940ecf0d-0498-4ddb-8a91-dd7d5f1350c2 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1679 microversion: 2.1 time: 0.170173 Aug 31 17:23:46.981029 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3988/7799] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:23:46 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:23:48.003607 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c1dabf18-49fa-4252-8217-ea56d1bf37a6 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:23:48.004836 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c1dabf18-49fa-4252-8217-ea56d1bf37a6 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:23:48.012566 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c1dabf18-49fa-4252-8217-ea56d1bf37a6 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:23:48.013049 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c1dabf18-49fa-4252-8217-ea56d1bf37a6 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:23:48.013474 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c1dabf18-49fa-4252-8217-ea56d1bf37a6 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:23:48.014187 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c1dabf18-49fa-4252-8217-ea56d1bf37a6 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:23:48.014626 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c1dabf18-49fa-4252-8217-ea56d1bf37a6 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:23:48.015038 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c1dabf18-49fa-4252-8217-ea56d1bf37a6 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:23:48.158280 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c1dabf18-49fa-4252-8217-ea56d1bf37a6 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:23:48.166491 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c1dabf18-49fa-4252-8217-ea56d1bf37a6 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1679 microversion: 2.1 time: 0.167444 Aug 31 17:23:48.167261 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3812/7800] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:23:47 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:23:49.193894 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-51982d52-fefc-4668-9d3a-ab15aa1a5082 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:23:49.194705 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-51982d52-fefc-4668-9d3a-ab15aa1a5082 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:23:49.206811 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51982d52-fefc-4668-9d3a-ab15aa1a5082 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:23:49.207844 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51982d52-fefc-4668-9d3a-ab15aa1a5082 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:23:49.208299 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51982d52-fefc-4668-9d3a-ab15aa1a5082 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:23:49.209045 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51982d52-fefc-4668-9d3a-ab15aa1a5082 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:23:49.209598 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51982d52-fefc-4668-9d3a-ab15aa1a5082 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:23:49.219353 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51982d52-fefc-4668-9d3a-ab15aa1a5082 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:23:49.256382 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-a7ea7fdb-587d-4a81-8594-20e916299c30 req-1df59987-7278-4bc4-b870-9833f35d6f3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3351fdc2-a112-4d61-8ffa-6a4f590e4433", "name": "network-vif-deleted", "tag": "ecc7a4a6-52c0-48c1-b922-83e59b645f00"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:23:49.268814 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a7ea7fdb-587d-4a81-8594-20e916299c30 req-1df59987-7278-4bc4-b870-9833f35d6f3f service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:23:49.269290 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a7ea7fdb-587d-4a81-8594-20e916299c30 req-1df59987-7278-4bc4-b870-9833f35d6f3f service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:23:49.269714 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a7ea7fdb-587d-4a81-8594-20e916299c30 req-1df59987-7278-4bc4-b870-9833f35d6f3f service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:23:49.281828 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-a7ea7fdb-587d-4a81-8594-20e916299c30 req-1df59987-7278-4bc4-b870-9833f35d6f3f service nova] Creating event network-vif-deleted:ecc7a4a6-52c0-48c1-b922-83e59b645f00 for instance 3351fdc2-a112-4d61-8ffa-6a4f590e4433 on n-h2-833090-16 Aug 31 17:23:49.288205 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-a7ea7fdb-587d-4a81-8594-20e916299c30 req-1df59987-7278-4bc4-b870-9833f35d6f3f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035642 Aug 31 17:23:49.289267 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3813/7801] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 17:23:49.296580 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-51982d52-fefc-4668-9d3a-ab15aa1a5082 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:23:49.304536 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-51982d52-fefc-4668-9d3a-ab15aa1a5082 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 200 len: 1493 microversion: 2.1 time: 0.119809 Aug 31 17:23:49.305103 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3989/7802] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:23:49 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 1493 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:23:50.327438 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5f48adfd-7708-40ad-aa45-d9eee7c1aae7 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:23:50.328274 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5f48adfd-7708-40ad-aa45-d9eee7c1aae7 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 3351fdc2-a112-4d61-8ffa-6a4f590e4433] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:23:50.335297 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f48adfd-7708-40ad-aa45-d9eee7c1aae7 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:23:50.335837 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f48adfd-7708-40ad-aa45-d9eee7c1aae7 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:23:50.336250 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f48adfd-7708-40ad-aa45-d9eee7c1aae7 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:23:50.336936 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f48adfd-7708-40ad-aa45-d9eee7c1aae7 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:23:50.337392 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f48adfd-7708-40ad-aa45-d9eee7c1aae7 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:23:50.337814 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5f48adfd-7708-40ad-aa45-d9eee7c1aae7 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:23:50.354382 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-5f48adfd-7708-40ad-aa45-d9eee7c1aae7 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] HTTP exception thrown: Instance 3351fdc2-a112-4d61-8ffa-6a4f590e4433 could not be found. Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5f48adfd-7708-40ad-aa45-d9eee7c1aae7 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Request method failure captured: Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 HTTP/1.1 Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD5e-hBBXuK4K7kpgy24k5LmM7itR-gTAEQs-FOVfCroYieSr5lAHzQ-xEWCWI2w8JOdyuNh2q2WGqLWb-QV-ztP8lza-DXicZwYL4byH6Adrfb0ZTy6b-nT0biOYS_i33IbRJA1zxHFDLYeJr_N20x8c40Y-TgaXGoz-oJ55BSfkk8A Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 4eb52c4e2557425c96d32a9163749d81 Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-TestShelveInstance-968532960 Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4eb52c4e2557425c96d32a9163749d81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4eb52c4e2557425c96d32a9163749d81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4eb52c4e2557425c96d32a9163749d81"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4eb52c4e2557425c96d32a9163749d81", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-TestShelveInstance-968532960 Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 4eb52c4e2557425c96d32a9163749d81 Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TestShelveInstance-968532960 Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-TestShelveInstance-968532960-project Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 30ba0f75d33b4dc68d6dbce8dce75686 Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-TestShelveInstance-968532960-project Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 3351fdc2-a112-4d61-8ffa-6a4f590e4433 could not be found. Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '3351fdc2-a112-4d61-8ffa-6a4f590e4433'} Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3351fdc2-a112-4d61-8ffa-6a4f590e4433 could not be found. Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3351fdc2-a112-4d61-8ffa-6a4f590e4433 could not be found. Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:23:50.356240 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 17:23:50.361789 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:23:50.361789 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:23:50.361789 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:23:50.361789 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 17:23:50.361789 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 17:23:50.361789 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3351fdc2-a112-4d61-8ffa-6a4f590e4433 could not be found. Aug 31 17:23:50.361789 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 17:23:50.361789 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5f48adfd-7708-40ad-aa45-d9eee7c1aae7 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Returning 404 to user: Instance 3351fdc2-a112-4d61-8ffa-6a4f590e4433 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 17:23:50.361789 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5f48adfd-7708-40ad-aa45-d9eee7c1aae7 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433" status: 404 len: 111 microversion: 2.1 time: 0.036280 Aug 31 17:23:50.361789 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3814/7803] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:23:50 2022] GET /compute/v2.1/servers/3351fdc2-a112-4d61-8ffa-6a4f590e4433 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 17:23:50.542510 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-004ec8dc-d7a5-41bc-9a26-d72ea4a8c7df tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '.version_select at 0x7fbb454c8c10>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:23:50.550943 n-d-833090-16 devstack@n-api.service[128864]: ERROR oslo.messaging._drivers.impl_rabbit [None req-004ec8dc-d7a5-41bc-9a26-d72ea4a8c7df tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [178b73f2-a464-4c5c-bbc3-290eb235843a] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 17:23:51.559693 n-d-833090-16 devstack@n-api.service[128864]: INFO oslo.messaging._drivers.impl_rabbit [None req-004ec8dc-d7a5-41bc-9a26-d72ea4a8c7df tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [178b73f2-a464-4c5c-bbc3-290eb235843a] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 53166. Aug 31 17:23:51.584440 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-004ec8dc-d7a5-41bc-9a26-d72ea4a8c7df tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-570700056" status: 202 len: 0 microversion: 2.1 time: 1.049830 Aug 31 17:23:51.585034 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3990/7804] 10.222.0.50 () {58 vars in 1251 bytes} [Wed Aug 31 17:23:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-570700056 => generated 0 bytes in 1052 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:23:51.616748 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-162a7239-3e83-4a88-9e9c-7944dfcc33f2 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Action: 'create', calling method: .version_select at 0x7fbb45423e50>, body: {"keypair": {"name": "tempest-TestShelveInstance-1744021713", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHCzssj9LpQhprpzWDs68NdN83uSgaSoL8wfyTCCN6MfzFRFEoX+cwDtqkOXDT0KH6qxUaUmmZVsQ6QaM1UvNPYkxnrS5tHojZFSwjvciF3kPzrdheiW0WAXQ79t26log=="}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:23:51.634245 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-162a7239-3e83-4a88-9e9c-7944dfcc33f2 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Getting quotas for project 4eb52c4e2557425c96d32a9163749d81. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 17:23:51.640835 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-162a7239-3e83-4a88-9e9c-7944dfcc33f2 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Getting quotas for user 30ba0f75d33b4dc68d6dbce8dce75686 and project 4eb52c4e2557425c96d32a9163749d81. Resources: {'key_pairs'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 17:23:51.655192 n-d-833090-16 devstack@n-api.service[128863]: ERROR oslo.messaging._drivers.impl_rabbit [None req-162a7239-3e83-4a88-9e9c-7944dfcc33f2 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [20597d35-4b4e-4ea0-93ee-0a08dc793a48] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 17:23:52.668631 n-d-833090-16 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [None req-162a7239-3e83-4a88-9e9c-7944dfcc33f2 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [20597d35-4b4e-4ea0-93ee-0a08dc793a48] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 53170. Aug 31 17:23:52.685421 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-162a7239-3e83-4a88-9e9c-7944dfcc33f2 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 1.072524 Aug 31 17:23:52.686420 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3815/7805] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 31 17:23:51 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:24:10.072056 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=14 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:24:10.072860 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:24:10.078027 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1baafa02-9ae6-45df-b662-2bca4095eaa9 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1048340654", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1744021713", "security_groups": [{"name": "tempest-secgroup-smoke-264005847"}], "networks": [{"uuid": "06ada3e9-c923-49cc-a6dc-d43a7b9dedfe"}], "block_device_mapping_v2": [{"uuid": "5eae8318-bf49-4b2c-93fb-8435dfc3e6b3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:24:10.214878 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.network.neutron [None req-1baafa02-9ae6-45df-b662-2bca4095eaa9 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] validate_networks() for [('06ada3e9-c923-49cc-a6dc-d43a7b9dedfe', None, None, None, None, None)] {{(pid=128864) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 17:24:10.638461 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-1baafa02-9ae6-45df-b662-2bca4095eaa9 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Flavor limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 17:24:10.639144 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-1baafa02-9ae6-45df-b662-2bca4095eaa9 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Image limits 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 17:24:10.639952 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-1baafa02-9ae6-45df-b662-2bca4095eaa9 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Flavor pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 17:24:10.640564 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-1baafa02-9ae6-45df-b662-2bca4095eaa9 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Image pref 0:0:0 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 17:24:10.641254 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.virt.hardware [None req-1baafa02-9ae6-45df-b662-2bca4095eaa9 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128864) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 17:24:10.656026 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1baafa02-9ae6-45df-b662-2bca4095eaa9 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:24:10.656752 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1baafa02-9ae6-45df-b662-2bca4095eaa9 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:24:10.657472 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1baafa02-9ae6-45df-b662-2bca4095eaa9 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:24:10.658642 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1baafa02-9ae6-45df-b662-2bca4095eaa9 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:24:10.659359 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1baafa02-9ae6-45df-b662-2bca4095eaa9 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:24:10.660024 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1baafa02-9ae6-45df-b662-2bca4095eaa9 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:24:10.679293 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-1baafa02-9ae6-45df-b662-2bca4095eaa9 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Getting quotas for project 4eb52c4e2557425c96d32a9163749d81. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 17:24:10.684904 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-1baafa02-9ae6-45df-b662-2bca4095eaa9 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Getting quotas for user 30ba0f75d33b4dc68d6dbce8dce75686 and project 4eb52c4e2557425c96d32a9163749d81. Resources: {'instances', 'cores', 'ram'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 17:24:10.755072 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1baafa02-9ae6-45df-b662-2bca4095eaa9 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Going to run 1 instances... {{(pid=128864) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 17:24:10.757846 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1baafa02-9ae6-45df-b662-2bca4095eaa9 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 8c9b2484-16d6-4ab8-b746-72f0e64f30ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5eae8318-bf49-4b2c-93fb-8435dfc3e6b3',volume_size=None,volume_type=None)] {{(pid=128864) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 17:24:10.897861 n-d-833090-16 devstack@n-api.service[128864]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1baafa02-9ae6-45df-b662-2bca4095eaa9 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [f9b5357a-7b17-4db0-90cc-a76a5ade09b1] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 17:24:11.908161 n-d-833090-16 devstack@n-api.service[128864]: INFO oslo.messaging._drivers.impl_rabbit [None req-1baafa02-9ae6-45df-b662-2bca4095eaa9 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [f9b5357a-7b17-4db0-90cc-a76a5ade09b1] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 53334. Aug 31 17:24:11.914624 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1baafa02-9ae6-45df-b662-2bca4095eaa9 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.844538 Aug 31 17:24:11.915520 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3991/7806] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 17:24:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 1846 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 17:24:11.928060 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:24:11.928937 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=4 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:24:11.929569 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:24:11.934079 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0d251e97-0a93-408c-87ce-ed9aeeb3070e tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:24:11.934767 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0d251e97-0a93-408c-87ce-ed9aeeb3070e tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 8c9b2484-16d6-4ab8-b746-72f0e64f30ae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:24:11.996468 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0d251e97-0a93-408c-87ce-ed9aeeb3070e tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:24:12.003596 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0d251e97-0a93-408c-87ce-ed9aeeb3070e tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae" status: 200 len: 1089 microversion: 2.1 time: 0.078534 Aug 31 17:24:12.004169 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3816/7807] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:24:11 2022] GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae => generated 1089 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:24:13.028472 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-98a0cc61-d206-4c7d-9d66-b896adcab95b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:24:13.029147 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-98a0cc61-d206-4c7d-9d66-b896adcab95b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 8c9b2484-16d6-4ab8-b746-72f0e64f30ae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:24:13.036562 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-98a0cc61-d206-4c7d-9d66-b896adcab95b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:24:13.037066 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-98a0cc61-d206-4c7d-9d66-b896adcab95b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:24:13.037522 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-98a0cc61-d206-4c7d-9d66-b896adcab95b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:24:13.038266 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-98a0cc61-d206-4c7d-9d66-b896adcab95b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:24:13.048631 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-98a0cc61-d206-4c7d-9d66-b896adcab95b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:24:13.049999 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-98a0cc61-d206-4c7d-9d66-b896adcab95b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:24:13.119921 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-98a0cc61-d206-4c7d-9d66-b896adcab95b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:24:13.129567 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-98a0cc61-d206-4c7d-9d66-b896adcab95b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae" status: 200 len: 1195 microversion: 2.1 time: 0.105078 Aug 31 17:24:13.130265 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3992/7808] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:24:13 2022] GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae => generated 1195 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:24:14.152528 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1bd2bb02-771d-454c-8480-2107dbc19c95 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:24:14.153473 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1bd2bb02-771d-454c-8480-2107dbc19c95 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 8c9b2484-16d6-4ab8-b746-72f0e64f30ae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:24:14.161494 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1bd2bb02-771d-454c-8480-2107dbc19c95 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:24:14.162120 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1bd2bb02-771d-454c-8480-2107dbc19c95 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:24:14.162839 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1bd2bb02-771d-454c-8480-2107dbc19c95 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:24:14.163741 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1bd2bb02-771d-454c-8480-2107dbc19c95 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:24:14.164198 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1bd2bb02-771d-454c-8480-2107dbc19c95 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:24:14.164658 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1bd2bb02-771d-454c-8480-2107dbc19c95 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:24:14.311791 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1bd2bb02-771d-454c-8480-2107dbc19c95 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:24:14.322372 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1bd2bb02-771d-454c-8480-2107dbc19c95 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae" status: 200 len: 1272 microversion: 2.1 time: 0.174957 Aug 31 17:24:14.324583 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3817/7809] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:24:14 2022] GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae => generated 1272 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:24:14.485778 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-1dba0e90-14cc-4ced-8e14-50901498983f req-bc73fa29-56ee-4ce4-90d8-2352c60976d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c9b2484-16d6-4ab8-b746-72f0e64f30ae", "tag": "7ad7925b-9d41-4ee8-b9de-b8f0069c120c"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:24:14.500041 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-1dba0e90-14cc-4ced-8e14-50901498983f req-bc73fa29-56ee-4ce4-90d8-2352c60976d3 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:24:14.500870 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-1dba0e90-14cc-4ced-8e14-50901498983f req-bc73fa29-56ee-4ce4-90d8-2352c60976d3 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:24:14.501579 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-1dba0e90-14cc-4ced-8e14-50901498983f req-bc73fa29-56ee-4ce4-90d8-2352c60976d3 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:24:14.521868 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-1dba0e90-14cc-4ced-8e14-50901498983f req-bc73fa29-56ee-4ce4-90d8-2352c60976d3 service nova] Creating event network-changed:7ad7925b-9d41-4ee8-b9de-b8f0069c120c for instance 8c9b2484-16d6-4ab8-b746-72f0e64f30ae on n-h1-833090-16 Aug 31 17:24:14.527159 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-1dba0e90-14cc-4ced-8e14-50901498983f req-bc73fa29-56ee-4ce4-90d8-2352c60976d3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045466 Aug 31 17:24:14.528367 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3993/7810] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:24:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:24:15.344392 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cd3ce828-ef26-4903-8444-096e68854fe1 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:24:15.345181 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cd3ce828-ef26-4903-8444-096e68854fe1 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 8c9b2484-16d6-4ab8-b746-72f0e64f30ae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:24:15.353940 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd3ce828-ef26-4903-8444-096e68854fe1 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:24:15.354466 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd3ce828-ef26-4903-8444-096e68854fe1 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:24:15.354900 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd3ce828-ef26-4903-8444-096e68854fe1 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:24:15.355653 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd3ce828-ef26-4903-8444-096e68854fe1 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:24:15.356105 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd3ce828-ef26-4903-8444-096e68854fe1 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:24:15.356532 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cd3ce828-ef26-4903-8444-096e68854fe1 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:24:15.507594 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cd3ce828-ef26-4903-8444-096e68854fe1 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:24:15.516306 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cd3ce828-ef26-4903-8444-096e68854fe1 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae" status: 200 len: 1272 microversion: 2.1 time: 0.176182 Aug 31 17:24:15.519624 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3818/7811] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:24:15 2022] GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae => generated 1272 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:24:16.540766 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fa8bc2e8-461f-42bc-83d2-ee0c62f17c1b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:24:16.541351 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fa8bc2e8-461f-42bc-83d2-ee0c62f17c1b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 8c9b2484-16d6-4ab8-b746-72f0e64f30ae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:24:16.548433 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fa8bc2e8-461f-42bc-83d2-ee0c62f17c1b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:24:16.548934 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fa8bc2e8-461f-42bc-83d2-ee0c62f17c1b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:24:16.549380 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fa8bc2e8-461f-42bc-83d2-ee0c62f17c1b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:24:16.550120 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fa8bc2e8-461f-42bc-83d2-ee0c62f17c1b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:24:16.550601 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fa8bc2e8-461f-42bc-83d2-ee0c62f17c1b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:24:16.551034 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fa8bc2e8-461f-42bc-83d2-ee0c62f17c1b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:24:16.699886 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-fa8bc2e8-461f-42bc-83d2-ee0c62f17c1b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:24:16.708325 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fa8bc2e8-461f-42bc-83d2-ee0c62f17c1b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae" status: 200 len: 1272 microversion: 2.1 time: 0.173018 Aug 31 17:24:16.708924 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3994/7812] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:24:16 2022] GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae => generated 1272 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:24:17.729972 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e687c7fe-fd88-4a1e-9341-c5ebeff1e4c9 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:24:17.730659 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e687c7fe-fd88-4a1e-9341-c5ebeff1e4c9 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 8c9b2484-16d6-4ab8-b746-72f0e64f30ae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:24:17.738316 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e687c7fe-fd88-4a1e-9341-c5ebeff1e4c9 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:24:17.738805 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e687c7fe-fd88-4a1e-9341-c5ebeff1e4c9 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:24:17.739245 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e687c7fe-fd88-4a1e-9341-c5ebeff1e4c9 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:24:17.739946 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e687c7fe-fd88-4a1e-9341-c5ebeff1e4c9 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:24:17.740392 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e687c7fe-fd88-4a1e-9341-c5ebeff1e4c9 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:24:17.740816 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e687c7fe-fd88-4a1e-9341-c5ebeff1e4c9 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:24:17.892109 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e687c7fe-fd88-4a1e-9341-c5ebeff1e4c9 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:24:17.900601 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e687c7fe-fd88-4a1e-9341-c5ebeff1e4c9 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae" status: 200 len: 1272 microversion: 2.1 time: 0.175339 Aug 31 17:24:17.914145 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3819/7813] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:24:17 2022] GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae => generated 1272 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:24:18.930434 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-51ff7e1a-78aa-4dfa-be0f-91751bbd402b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:24:18.931082 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-51ff7e1a-78aa-4dfa-be0f-91751bbd402b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 8c9b2484-16d6-4ab8-b746-72f0e64f30ae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:24:18.938621 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51ff7e1a-78aa-4dfa-be0f-91751bbd402b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:24:18.939124 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51ff7e1a-78aa-4dfa-be0f-91751bbd402b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:24:18.939571 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51ff7e1a-78aa-4dfa-be0f-91751bbd402b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:24:18.940263 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51ff7e1a-78aa-4dfa-be0f-91751bbd402b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:24:18.940732 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51ff7e1a-78aa-4dfa-be0f-91751bbd402b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:24:18.941170 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-51ff7e1a-78aa-4dfa-be0f-91751bbd402b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:24:19.079950 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-51ff7e1a-78aa-4dfa-be0f-91751bbd402b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:24:19.088886 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-51ff7e1a-78aa-4dfa-be0f-91751bbd402b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae" status: 200 len: 1260 microversion: 2.1 time: 0.162983 Aug 31 17:24:19.089476 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3995/7814] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:24:18 2022] GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:24:20.114171 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1e922dd1-f49b-40ee-9f4f-4114bb002f5a tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:24:20.114771 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1e922dd1-f49b-40ee-9f4f-4114bb002f5a tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 8c9b2484-16d6-4ab8-b746-72f0e64f30ae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:24:20.122408 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e922dd1-f49b-40ee-9f4f-4114bb002f5a tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:24:20.122919 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e922dd1-f49b-40ee-9f4f-4114bb002f5a tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:24:20.123327 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e922dd1-f49b-40ee-9f4f-4114bb002f5a tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:24:20.124020 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e922dd1-f49b-40ee-9f4f-4114bb002f5a tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:24:20.124472 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e922dd1-f49b-40ee-9f4f-4114bb002f5a tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:24:20.124899 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1e922dd1-f49b-40ee-9f4f-4114bb002f5a tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:24:20.269852 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1e922dd1-f49b-40ee-9f4f-4114bb002f5a tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:24:20.278656 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1e922dd1-f49b-40ee-9f4f-4114bb002f5a tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae" status: 200 len: 1260 microversion: 2.1 time: 0.169053 Aug 31 17:24:20.279243 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3820/7815] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:24:20 2022] GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:24:21.304127 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ff35cd24-023d-40f5-9450-4783c0073fad tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:24:21.305542 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ff35cd24-023d-40f5-9450-4783c0073fad tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 8c9b2484-16d6-4ab8-b746-72f0e64f30ae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:24:21.309062 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:24:21.310207 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=6 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:24:21.321461 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ff35cd24-023d-40f5-9450-4783c0073fad tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:24:21.322233 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ff35cd24-023d-40f5-9450-4783c0073fad tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:24:21.322944 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ff35cd24-023d-40f5-9450-4783c0073fad tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:24:21.324168 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ff35cd24-023d-40f5-9450-4783c0073fad tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:24:21.324893 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ff35cd24-023d-40f5-9450-4783c0073fad tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:24:21.325556 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ff35cd24-023d-40f5-9450-4783c0073fad tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:24:21.480060 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ff35cd24-023d-40f5-9450-4783c0073fad tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:24:21.492957 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ff35cd24-023d-40f5-9450-4783c0073fad tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae" status: 200 len: 1260 microversion: 2.1 time: 0.195940 Aug 31 17:24:21.493540 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3996/7816] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:24:21 2022] GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae => generated 1260 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:24:22.518040 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-20ea2cc6-40c7-4b36-8eed-f5f440aec427 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:24:22.518678 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-20ea2cc6-40c7-4b36-8eed-f5f440aec427 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 8c9b2484-16d6-4ab8-b746-72f0e64f30ae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:24:22.521867 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:24:22.530945 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20ea2cc6-40c7-4b36-8eed-f5f440aec427 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:24:22.531726 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20ea2cc6-40c7-4b36-8eed-f5f440aec427 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:24:22.532361 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20ea2cc6-40c7-4b36-8eed-f5f440aec427 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:24:22.533469 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20ea2cc6-40c7-4b36-8eed-f5f440aec427 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:24:22.534235 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20ea2cc6-40c7-4b36-8eed-f5f440aec427 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:24:22.534891 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-20ea2cc6-40c7-4b36-8eed-f5f440aec427 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:24:22.691433 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-20ea2cc6-40c7-4b36-8eed-f5f440aec427 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:24:22.701442 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-20ea2cc6-40c7-4b36-8eed-f5f440aec427 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae" status: 200 len: 1260 microversion: 2.1 time: 0.190139 Aug 31 17:24:22.702027 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3821/7817] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:24:22 2022] GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae => generated 1260 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:24:23.722528 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-34464ca9-2200-4128-a3d4-ef91329e75ca tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:24:23.723210 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-34464ca9-2200-4128-a3d4-ef91329e75ca tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 8c9b2484-16d6-4ab8-b746-72f0e64f30ae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:24:23.730707 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-34464ca9-2200-4128-a3d4-ef91329e75ca tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:24:23.731232 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-34464ca9-2200-4128-a3d4-ef91329e75ca tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:24:23.731672 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-34464ca9-2200-4128-a3d4-ef91329e75ca tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:24:23.732457 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-34464ca9-2200-4128-a3d4-ef91329e75ca tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:24:23.732911 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-34464ca9-2200-4128-a3d4-ef91329e75ca tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:24:23.733342 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-34464ca9-2200-4128-a3d4-ef91329e75ca tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:24:23.879304 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-34464ca9-2200-4128-a3d4-ef91329e75ca tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:24:23.891073 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-34464ca9-2200-4128-a3d4-ef91329e75ca tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae" status: 200 len: 1260 microversion: 2.1 time: 0.172698 Aug 31 17:24:23.891889 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3997/7818] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:24:23 2022] GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:24:24.914988 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-04d79d2a-a072-451a-8a6c-44b85f7a60a1 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:24:24.915600 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-04d79d2a-a072-451a-8a6c-44b85f7a60a1 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 8c9b2484-16d6-4ab8-b746-72f0e64f30ae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:24:24.924294 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04d79d2a-a072-451a-8a6c-44b85f7a60a1 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:24:24.924794 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04d79d2a-a072-451a-8a6c-44b85f7a60a1 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:24:24.925340 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04d79d2a-a072-451a-8a6c-44b85f7a60a1 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:24:24.926126 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04d79d2a-a072-451a-8a6c-44b85f7a60a1 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:24:24.926627 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04d79d2a-a072-451a-8a6c-44b85f7a60a1 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:24:24.927043 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-04d79d2a-a072-451a-8a6c-44b85f7a60a1 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:24:25.076757 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-04d79d2a-a072-451a-8a6c-44b85f7a60a1 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:24:25.085044 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-04d79d2a-a072-451a-8a6c-44b85f7a60a1 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae" status: 200 len: 1260 microversion: 2.1 time: 0.174148 Aug 31 17:24:25.085638 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3822/7819] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:24:24 2022] GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:24:26.108736 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d75762f5-29cb-405e-880b-94d11e5f89d4 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:24:26.109357 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d75762f5-29cb-405e-880b-94d11e5f89d4 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 8c9b2484-16d6-4ab8-b746-72f0e64f30ae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:24:26.116748 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d75762f5-29cb-405e-880b-94d11e5f89d4 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:24:26.117251 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d75762f5-29cb-405e-880b-94d11e5f89d4 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:24:26.117700 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d75762f5-29cb-405e-880b-94d11e5f89d4 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:24:26.118445 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d75762f5-29cb-405e-880b-94d11e5f89d4 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:24:26.118913 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d75762f5-29cb-405e-880b-94d11e5f89d4 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:24:26.119353 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d75762f5-29cb-405e-880b-94d11e5f89d4 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:24:26.270911 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d75762f5-29cb-405e-880b-94d11e5f89d4 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:24:26.283612 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d75762f5-29cb-405e-880b-94d11e5f89d4 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae" status: 200 len: 1260 microversion: 2.1 time: 0.179423 Aug 31 17:24:26.284383 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3998/7820] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:24:26 2022] GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae => generated 1260 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:24:27.234813 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-9d8c8359-91eb-4d49-a920-10ecfdd9ec4b req-bdebf233-3dce-47e8-8075-e039b3bcd6bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c9b2484-16d6-4ab8-b746-72f0e64f30ae", "name": "network-vif-plugged", "status": "completed", "tag": "7ad7925b-9d41-4ee8-b9de-b8f0069c120c"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:24:27.246428 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9d8c8359-91eb-4d49-a920-10ecfdd9ec4b req-bdebf233-3dce-47e8-8075-e039b3bcd6bd service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:24:27.247158 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9d8c8359-91eb-4d49-a920-10ecfdd9ec4b req-bdebf233-3dce-47e8-8075-e039b3bcd6bd service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:24:27.248387 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9d8c8359-91eb-4d49-a920-10ecfdd9ec4b req-bdebf233-3dce-47e8-8075-e039b3bcd6bd service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:24:27.261380 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-9d8c8359-91eb-4d49-a920-10ecfdd9ec4b req-bdebf233-3dce-47e8-8075-e039b3bcd6bd service nova] Creating event network-vif-plugged:7ad7925b-9d41-4ee8-b9de-b8f0069c120c for instance 8c9b2484-16d6-4ab8-b746-72f0e64f30ae on n-h1-833090-16 Aug 31 17:24:27.266665 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-9d8c8359-91eb-4d49-a920-10ecfdd9ec4b req-bdebf233-3dce-47e8-8075-e039b3bcd6bd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088860 Aug 31 17:24:27.267643 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3823/7821] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:24:27.307637 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-d6957654-00bb-4119-a12e-5bb44c5b2cec tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:24:27.308586 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-d6957654-00bb-4119-a12e-5bb44c5b2cec tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 8c9b2484-16d6-4ab8-b746-72f0e64f30ae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:24:27.315974 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d6957654-00bb-4119-a12e-5bb44c5b2cec tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:24:27.316479 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d6957654-00bb-4119-a12e-5bb44c5b2cec tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:24:27.316911 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d6957654-00bb-4119-a12e-5bb44c5b2cec tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:24:27.317610 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d6957654-00bb-4119-a12e-5bb44c5b2cec tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:24:27.318866 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d6957654-00bb-4119-a12e-5bb44c5b2cec tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:24:27.319306 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-d6957654-00bb-4119-a12e-5bb44c5b2cec tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:24:27.468740 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-d6957654-00bb-4119-a12e-5bb44c5b2cec tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:24:27.478769 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-d6957654-00bb-4119-a12e-5bb44c5b2cec tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae" status: 200 len: 1260 microversion: 2.1 time: 0.175448 Aug 31 17:24:27.479384 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 3999/7822] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:24:27 2022] GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:24:28.500542 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-419e0853-5409-432d-9502-a7fa62d7b211 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:24:28.501488 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-419e0853-5409-432d-9502-a7fa62d7b211 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 8c9b2484-16d6-4ab8-b746-72f0e64f30ae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:24:28.509390 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-419e0853-5409-432d-9502-a7fa62d7b211 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:24:28.509881 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-419e0853-5409-432d-9502-a7fa62d7b211 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:24:28.510345 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-419e0853-5409-432d-9502-a7fa62d7b211 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:24:28.511139 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-419e0853-5409-432d-9502-a7fa62d7b211 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:24:28.511589 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-419e0853-5409-432d-9502-a7fa62d7b211 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:24:28.512019 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-419e0853-5409-432d-9502-a7fa62d7b211 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:24:28.666156 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-419e0853-5409-432d-9502-a7fa62d7b211 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:24:28.675716 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-419e0853-5409-432d-9502-a7fa62d7b211 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae" status: 200 len: 1260 microversion: 2.1 time: 0.179961 Aug 31 17:24:28.676224 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3824/7823] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:24:28 2022] GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae => generated 1260 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:24:29.700000 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1fdd1ff2-17a6-4e10-9339-c1c33292f548 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:24:29.700601 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1fdd1ff2-17a6-4e10-9339-c1c33292f548 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 8c9b2484-16d6-4ab8-b746-72f0e64f30ae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:24:29.708216 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1fdd1ff2-17a6-4e10-9339-c1c33292f548 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:24:29.708706 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1fdd1ff2-17a6-4e10-9339-c1c33292f548 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:24:29.709156 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1fdd1ff2-17a6-4e10-9339-c1c33292f548 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:24:29.709847 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1fdd1ff2-17a6-4e10-9339-c1c33292f548 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:24:29.710358 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1fdd1ff2-17a6-4e10-9339-c1c33292f548 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:24:29.710783 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1fdd1ff2-17a6-4e10-9339-c1c33292f548 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:24:29.849252 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1fdd1ff2-17a6-4e10-9339-c1c33292f548 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:24:29.860623 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1fdd1ff2-17a6-4e10-9339-c1c33292f548 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae" status: 200 len: 1444 microversion: 2.1 time: 0.166668 Aug 31 17:24:29.861213 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 4000/7824] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:24:29 2022] GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae => generated 1444 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:24:29.887986 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-05f79642-18a9-4e81-ab50-d75ebc467e64 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:24:29.888556 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-05f79642-18a9-4e81-ab50-d75ebc467e64 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 8c9b2484-16d6-4ab8-b746-72f0e64f30ae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:24:29.895951 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05f79642-18a9-4e81-ab50-d75ebc467e64 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:24:29.896439 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05f79642-18a9-4e81-ab50-d75ebc467e64 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:24:29.896872 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05f79642-18a9-4e81-ab50-d75ebc467e64 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:24:29.897574 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05f79642-18a9-4e81-ab50-d75ebc467e64 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:24:29.898026 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05f79642-18a9-4e81-ab50-d75ebc467e64 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:24:29.898475 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-05f79642-18a9-4e81-ab50-d75ebc467e64 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:24:30.052756 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-05f79642-18a9-4e81-ab50-d75ebc467e64 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:24:30.066138 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-05f79642-18a9-4e81-ab50-d75ebc467e64 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae" status: 200 len: 1444 microversion: 2.1 time: 0.185979 Aug 31 17:24:30.067111 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3825/7825] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:24:29 2022] GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae => generated 1444 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:24:31.933576 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-96babd07-88e4-4626-95d5-149018f6511e req-9fc58768-d412-4fa0-801d-82eead9a4e27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c9b2484-16d6-4ab8-b746-72f0e64f30ae", "tag": "7ad7925b-9d41-4ee8-b9de-b8f0069c120c"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:24:31.944297 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-96babd07-88e4-4626-95d5-149018f6511e req-9fc58768-d412-4fa0-801d-82eead9a4e27 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:24:31.944788 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-96babd07-88e4-4626-95d5-149018f6511e req-9fc58768-d412-4fa0-801d-82eead9a4e27 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:24:31.945539 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-96babd07-88e4-4626-95d5-149018f6511e req-9fc58768-d412-4fa0-801d-82eead9a4e27 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:24:31.960478 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-96babd07-88e4-4626-95d5-149018f6511e req-9fc58768-d412-4fa0-801d-82eead9a4e27 service nova] Creating event network-changed:7ad7925b-9d41-4ee8-b9de-b8f0069c120c for instance 8c9b2484-16d6-4ab8-b746-72f0e64f30ae on n-h1-833090-16 Aug 31 17:24:31.965941 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-96babd07-88e4-4626-95d5-149018f6511e req-9fc58768-d412-4fa0-801d-82eead9a4e27 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101664 Aug 31 17:24:31.966637 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 4001/7826] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:24:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:26:27.063702 n-d-833090-16 devstack@n-api.service[128863]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a572ecc8-7c5f-4ee8-b179-c0e5cc05c499] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 31 17:26:27.064944 n-d-833090-16 devstack@n-api.service[128863]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6edb9245-c569-4b8e-9560-fba55d2b56a3] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 31 17:26:27.065952 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=22 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:26:27.067301 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=50 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:26:27.068978 n-d-833090-16 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 17:26:27.069163 n-d-833090-16 devstack@n-api.service[128863]: Wed Aug 31 17:26:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae/action (ip 10.222.0.50) !!! Aug 31 17:26:27.074634 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3969842b-871e-471a-b718-a27a37990ee0 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:26:27.075148 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3969842b-871e-471a-b718-a27a37990ee0 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 8c9b2484-16d6-4ab8-b746-72f0e64f30ae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:26:27.084525 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3969842b-871e-471a-b718-a27a37990ee0 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:27.085005 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3969842b-871e-471a-b718-a27a37990ee0 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:27.085443 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3969842b-871e-471a-b718-a27a37990ee0 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:27.086122 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3969842b-871e-471a-b718-a27a37990ee0 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:27.086608 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3969842b-871e-471a-b718-a27a37990ee0 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:27.087028 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3969842b-871e-471a-b718-a27a37990ee0 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:27.111731 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-3969842b-871e-471a-b718-a27a37990ee0 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lazy-loading 'flavor' on Instance uuid 8c9b2484-16d6-4ab8-b746-72f0e64f30ae {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 17:26:27.187351 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3969842b-871e-471a-b718-a27a37990ee0 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "POST /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae/action" status: 202 len: 0 microversion: 2.1 time: 0.125876 Aug 31 17:26:27.188986 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3826/7827] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 17:26:27 2022] POST /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 17:26:27.196194 n-d-833090-16 devstack@n-api.service[128864]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4f3e0afc-1d0e-4db3-9143-6185c0e157a7] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 17:26:27.197142 n-d-833090-16 devstack@n-api.service[128864]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0684e720-ea0e-4737-a458-87e19068aaad] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 17:26:27.197820 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:26:27.198677 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=54 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:26:27.205664 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f1717df4-772d-4994-90ad-c52d07405f4e tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:26:27.206486 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f1717df4-772d-4994-90ad-c52d07405f4e tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 8c9b2484-16d6-4ab8-b746-72f0e64f30ae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:26:27.214177 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f1717df4-772d-4994-90ad-c52d07405f4e tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:27.214767 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f1717df4-772d-4994-90ad-c52d07405f4e tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:27.215101 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f1717df4-772d-4994-90ad-c52d07405f4e tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:27.215798 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f1717df4-772d-4994-90ad-c52d07405f4e tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:27.216260 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f1717df4-772d-4994-90ad-c52d07405f4e tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:27.216684 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f1717df4-772d-4994-90ad-c52d07405f4e tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:27.440447 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f1717df4-772d-4994-90ad-c52d07405f4e tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:26:27.448873 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f1717df4-772d-4994-90ad-c52d07405f4e tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae" status: 200 len: 1568 microversion: 2.1 time: 0.254795 Aug 31 17:26:27.449463 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 4002/7828] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:26:27 2022] GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae => generated 1568 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:26:28.478587 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3f8d959f-3eec-4d03-b0bf-9c13555c5d17 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:26:28.479298 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3f8d959f-3eec-4d03-b0bf-9c13555c5d17 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 8c9b2484-16d6-4ab8-b746-72f0e64f30ae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:26:28.489075 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f8d959f-3eec-4d03-b0bf-9c13555c5d17 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:28.489564 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f8d959f-3eec-4d03-b0bf-9c13555c5d17 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:28.490006 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f8d959f-3eec-4d03-b0bf-9c13555c5d17 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:28.490737 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f8d959f-3eec-4d03-b0bf-9c13555c5d17 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:28.491190 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f8d959f-3eec-4d03-b0bf-9c13555c5d17 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:28.491614 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3f8d959f-3eec-4d03-b0bf-9c13555c5d17 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:28.496441 n-d-833090-16 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] [a572ecc8-7c5f-4ee8-b179-c0e5cc05c499] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 53446. Aug 31 17:26:28.499613 n-d-833090-16 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] [6edb9245-c569-4b8e-9560-fba55d2b56a3] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 53448. Aug 31 17:26:28.680681 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3f8d959f-3eec-4d03-b0bf-9c13555c5d17 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:26:28.688928 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3f8d959f-3eec-4d03-b0bf-9c13555c5d17 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae" status: 200 len: 1568 microversion: 2.1 time: 0.220915 Aug 31 17:26:28.689517 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3827/7829] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:26:28 2022] GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae => generated 1568 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:26:29.715903 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-13ade516-7f95-4efe-9684-b1dcada5d1ff tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:26:29.716595 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-13ade516-7f95-4efe-9684-b1dcada5d1ff tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 8c9b2484-16d6-4ab8-b746-72f0e64f30ae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:26:29.733209 n-d-833090-16 devstack@n-api.service[128864]: INFO oslo.messaging._drivers.impl_rabbit [-] [0684e720-ea0e-4737-a458-87e19068aaad] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 53458. Aug 31 17:26:29.736193 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-13ade516-7f95-4efe-9684-b1dcada5d1ff tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:29.736693 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-13ade516-7f95-4efe-9684-b1dcada5d1ff tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:29.737169 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-13ade516-7f95-4efe-9684-b1dcada5d1ff tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:29.737931 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-13ade516-7f95-4efe-9684-b1dcada5d1ff tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:29.738487 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-13ade516-7f95-4efe-9684-b1dcada5d1ff tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:29.738922 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-13ade516-7f95-4efe-9684-b1dcada5d1ff tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:29.739558 n-d-833090-16 devstack@n-api.service[128864]: INFO oslo.messaging._drivers.impl_rabbit [-] [4f3e0afc-1d0e-4db3-9143-6185c0e157a7] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 53456. Aug 31 17:26:29.882293 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-13ade516-7f95-4efe-9684-b1dcada5d1ff tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:26:29.895518 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-13ade516-7f95-4efe-9684-b1dcada5d1ff tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae" status: 200 len: 1568 microversion: 2.1 time: 0.183304 Aug 31 17:26:29.896443 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 4003/7830] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:26:29 2022] GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae => generated 1568 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:26:30.921951 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-0f02683f-075a-4455-b508-026f230c74af tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:26:30.922567 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-0f02683f-075a-4455-b508-026f230c74af tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 8c9b2484-16d6-4ab8-b746-72f0e64f30ae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:26:30.929825 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f02683f-075a-4455-b508-026f230c74af tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:30.930335 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f02683f-075a-4455-b508-026f230c74af tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:30.930763 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f02683f-075a-4455-b508-026f230c74af tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:30.931449 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f02683f-075a-4455-b508-026f230c74af tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:30.931895 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f02683f-075a-4455-b508-026f230c74af tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:30.932309 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-0f02683f-075a-4455-b508-026f230c74af tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:31.080433 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-0f02683f-075a-4455-b508-026f230c74af tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:26:31.096024 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-0f02683f-075a-4455-b508-026f230c74af tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae" status: 200 len: 1568 microversion: 2.1 time: 0.176066 Aug 31 17:26:31.096636 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3828/7831] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:26:30 2022] GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:26:32.119413 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b9e6a9cb-48f9-44cf-9707-394695ab45c4 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:26:32.120025 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b9e6a9cb-48f9-44cf-9707-394695ab45c4 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 8c9b2484-16d6-4ab8-b746-72f0e64f30ae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:26:32.127338 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b9e6a9cb-48f9-44cf-9707-394695ab45c4 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:32.127844 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b9e6a9cb-48f9-44cf-9707-394695ab45c4 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:32.128284 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b9e6a9cb-48f9-44cf-9707-394695ab45c4 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:32.129079 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b9e6a9cb-48f9-44cf-9707-394695ab45c4 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:32.129559 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b9e6a9cb-48f9-44cf-9707-394695ab45c4 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:32.130477 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b9e6a9cb-48f9-44cf-9707-394695ab45c4 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:32.284455 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b9e6a9cb-48f9-44cf-9707-394695ab45c4 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:26:32.295019 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b9e6a9cb-48f9-44cf-9707-394695ab45c4 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae" status: 200 len: 1568 microversion: 2.1 time: 0.179407 Aug 31 17:26:32.295781 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 4004/7832] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:26:32 2022] GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:26:33.319742 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f83f1181-4193-4dbd-8608-a3f1df5a2b86 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:26:33.320593 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-f83f1181-4193-4dbd-8608-a3f1df5a2b86 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 8c9b2484-16d6-4ab8-b746-72f0e64f30ae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:26:33.330182 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f83f1181-4193-4dbd-8608-a3f1df5a2b86 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:33.330889 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f83f1181-4193-4dbd-8608-a3f1df5a2b86 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:33.331525 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f83f1181-4193-4dbd-8608-a3f1df5a2b86 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:33.332476 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f83f1181-4193-4dbd-8608-a3f1df5a2b86 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:33.332940 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f83f1181-4193-4dbd-8608-a3f1df5a2b86 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:33.333364 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-f83f1181-4193-4dbd-8608-a3f1df5a2b86 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:33.511792 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-f83f1181-4193-4dbd-8608-a3f1df5a2b86 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:26:33.520476 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f83f1181-4193-4dbd-8608-a3f1df5a2b86 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae" status: 200 len: 1568 microversion: 2.1 time: 0.206713 Aug 31 17:26:33.521060 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3829/7833] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:26:33 2022] GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae => generated 1568 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:26:34.553266 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-68a5889c-f0c2-4a3f-b308-878d4c23d28a tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:26:34.555091 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-68a5889c-f0c2-4a3f-b308-878d4c23d28a tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 8c9b2484-16d6-4ab8-b746-72f0e64f30ae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:26:34.561665 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68a5889c-f0c2-4a3f-b308-878d4c23d28a tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:34.562236 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68a5889c-f0c2-4a3f-b308-878d4c23d28a tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:34.562685 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68a5889c-f0c2-4a3f-b308-878d4c23d28a tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:34.563408 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68a5889c-f0c2-4a3f-b308-878d4c23d28a tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:34.563871 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68a5889c-f0c2-4a3f-b308-878d4c23d28a tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:34.564308 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-68a5889c-f0c2-4a3f-b308-878d4c23d28a tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:34.702963 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-68a5889c-f0c2-4a3f-b308-878d4c23d28a tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:26:34.711616 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-68a5889c-f0c2-4a3f-b308-878d4c23d28a tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae" status: 200 len: 1568 microversion: 2.1 time: 0.168380 Aug 31 17:26:34.712211 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 4005/7834] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:26:34 2022] GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:26:35.737140 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fc68ce94-e9de-4c23-9264-7f210e138eef tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:26:35.738271 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fc68ce94-e9de-4c23-9264-7f210e138eef tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 8c9b2484-16d6-4ab8-b746-72f0e64f30ae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:26:35.745970 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc68ce94-e9de-4c23-9264-7f210e138eef tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:35.746490 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc68ce94-e9de-4c23-9264-7f210e138eef tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:35.746931 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc68ce94-e9de-4c23-9264-7f210e138eef tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:35.747626 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc68ce94-e9de-4c23-9264-7f210e138eef tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:35.748099 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc68ce94-e9de-4c23-9264-7f210e138eef tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:35.748524 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fc68ce94-e9de-4c23-9264-7f210e138eef tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:35.903102 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fc68ce94-e9de-4c23-9264-7f210e138eef tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:26:35.911701 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fc68ce94-e9de-4c23-9264-7f210e138eef tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae" status: 200 len: 1568 microversion: 2.1 time: 0.181280 Aug 31 17:26:35.912305 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3830/7835] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:26:35 2022] GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:26:36.935262 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-0cd6f25b-8b25-4c82-aff8-2aa3bed9ee06 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:26:36.936150 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-0cd6f25b-8b25-4c82-aff8-2aa3bed9ee06 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 8c9b2484-16d6-4ab8-b746-72f0e64f30ae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:26:36.945421 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0cd6f25b-8b25-4c82-aff8-2aa3bed9ee06 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:36.945919 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0cd6f25b-8b25-4c82-aff8-2aa3bed9ee06 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:36.946403 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0cd6f25b-8b25-4c82-aff8-2aa3bed9ee06 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:36.947119 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0cd6f25b-8b25-4c82-aff8-2aa3bed9ee06 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:36.947564 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0cd6f25b-8b25-4c82-aff8-2aa3bed9ee06 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:36.948005 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-0cd6f25b-8b25-4c82-aff8-2aa3bed9ee06 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:37.091546 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-0cd6f25b-8b25-4c82-aff8-2aa3bed9ee06 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:26:37.100009 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-0cd6f25b-8b25-4c82-aff8-2aa3bed9ee06 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae" status: 200 len: 1568 microversion: 2.1 time: 0.169785 Aug 31 17:26:37.100591 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 4006/7836] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:26:36 2022] GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:26:38.125397 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c2eeeda2-fdbf-4af4-bcac-b40d8cff23b2 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:26:38.125977 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c2eeeda2-fdbf-4af4-bcac-b40d8cff23b2 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 8c9b2484-16d6-4ab8-b746-72f0e64f30ae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:26:38.136676 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2eeeda2-fdbf-4af4-bcac-b40d8cff23b2 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:38.137471 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2eeeda2-fdbf-4af4-bcac-b40d8cff23b2 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:38.138189 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2eeeda2-fdbf-4af4-bcac-b40d8cff23b2 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:38.139354 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2eeeda2-fdbf-4af4-bcac-b40d8cff23b2 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:38.140090 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2eeeda2-fdbf-4af4-bcac-b40d8cff23b2 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:38.140784 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c2eeeda2-fdbf-4af4-bcac-b40d8cff23b2 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:38.307523 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c2eeeda2-fdbf-4af4-bcac-b40d8cff23b2 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:26:38.316597 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c2eeeda2-fdbf-4af4-bcac-b40d8cff23b2 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae" status: 200 len: 1568 microversion: 2.1 time: 0.197227 Aug 31 17:26:38.317120 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3831/7837] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:26:38 2022] GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae => generated 1568 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:26:39.339801 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-2b2f86d4-2435-4d07-8596-592e37f24075 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:26:39.340408 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-2b2f86d4-2435-4d07-8596-592e37f24075 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 8c9b2484-16d6-4ab8-b746-72f0e64f30ae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:26:39.350352 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b2f86d4-2435-4d07-8596-592e37f24075 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:39.350845 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b2f86d4-2435-4d07-8596-592e37f24075 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:39.351275 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b2f86d4-2435-4d07-8596-592e37f24075 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:39.351984 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b2f86d4-2435-4d07-8596-592e37f24075 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:39.352440 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b2f86d4-2435-4d07-8596-592e37f24075 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:39.352862 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-2b2f86d4-2435-4d07-8596-592e37f24075 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:39.496240 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-2b2f86d4-2435-4d07-8596-592e37f24075 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:26:39.505944 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-2b2f86d4-2435-4d07-8596-592e37f24075 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae" status: 200 len: 1568 microversion: 2.1 time: 0.172256 Aug 31 17:26:39.506583 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 4007/7838] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:26:39 2022] GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:26:40.539721 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5161b281-b0fd-4438-bd1e-ca5b98c7a7c8 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:26:40.541046 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5161b281-b0fd-4438-bd1e-ca5b98c7a7c8 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 8c9b2484-16d6-4ab8-b746-72f0e64f30ae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:26:40.548605 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5161b281-b0fd-4438-bd1e-ca5b98c7a7c8 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:40.548974 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5161b281-b0fd-4438-bd1e-ca5b98c7a7c8 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:40.549407 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5161b281-b0fd-4438-bd1e-ca5b98c7a7c8 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:40.550122 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5161b281-b0fd-4438-bd1e-ca5b98c7a7c8 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:40.550635 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5161b281-b0fd-4438-bd1e-ca5b98c7a7c8 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:40.551036 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5161b281-b0fd-4438-bd1e-ca5b98c7a7c8 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:40.687282 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5161b281-b0fd-4438-bd1e-ca5b98c7a7c8 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:26:40.696394 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5161b281-b0fd-4438-bd1e-ca5b98c7a7c8 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae" status: 200 len: 1568 microversion: 2.1 time: 0.160885 Aug 31 17:26:40.696965 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3832/7839] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:26:40 2022] GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:26:41.718478 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-6fa766b4-2525-4815-ac45-b24301c7ed53 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:26:41.719107 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-6fa766b4-2525-4815-ac45-b24301c7ed53 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 8c9b2484-16d6-4ab8-b746-72f0e64f30ae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:26:41.727658 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6fa766b4-2525-4815-ac45-b24301c7ed53 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:41.728269 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6fa766b4-2525-4815-ac45-b24301c7ed53 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:41.728725 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6fa766b4-2525-4815-ac45-b24301c7ed53 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:41.729446 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6fa766b4-2525-4815-ac45-b24301c7ed53 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:41.729917 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6fa766b4-2525-4815-ac45-b24301c7ed53 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:41.730389 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-6fa766b4-2525-4815-ac45-b24301c7ed53 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:41.843688 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-a6f20d59-53bb-42f2-9ff7-bb3d387a28ff req-171ec71a-f808-4906-85d4-84a49e1e45ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c9b2484-16d6-4ab8-b746-72f0e64f30ae", "name": "network-vif-unplugged", "status": "completed", "tag": "7ad7925b-9d41-4ee8-b9de-b8f0069c120c"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:26:41.855970 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a6f20d59-53bb-42f2-9ff7-bb3d387a28ff req-171ec71a-f808-4906-85d4-84a49e1e45ab service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:41.855970 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a6f20d59-53bb-42f2-9ff7-bb3d387a28ff req-171ec71a-f808-4906-85d4-84a49e1e45ab service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:41.856348 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a6f20d59-53bb-42f2-9ff7-bb3d387a28ff req-171ec71a-f808-4906-85d4-84a49e1e45ab service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:41.871430 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.compute.server_external_events [req-a6f20d59-53bb-42f2-9ff7-bb3d387a28ff req-171ec71a-f808-4906-85d4-84a49e1e45ab service nova] Unable to find a host for instance 8c9b2484-16d6-4ab8-b746-72f0e64f30ae. Dropping event network-vif-unplugged {{(pid=128863) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 31 17:26:41.872327 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-a6f20d59-53bb-42f2-9ff7-bb3d387a28ff req-171ec71a-f808-4906-85d4-84a49e1e45ab service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033760 Aug 31 17:26:41.872937 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3833/7840] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:26:41 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 31 17:26:41.874410 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-6fa766b4-2525-4815-ac45-b24301c7ed53 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:26:41.885331 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-6fa766b4-2525-4815-ac45-b24301c7ed53 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae" status: 200 len: 1509 microversion: 2.1 time: 0.170842 Aug 31 17:26:41.885935 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 4008/7841] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:26:41 2022] GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:26:41.907090 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d26ad921-8d58-4c41-a2cb-0327d22a5e52 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:26:41.907688 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d26ad921-8d58-4c41-a2cb-0327d22a5e52 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 8c9b2484-16d6-4ab8-b746-72f0e64f30ae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:26:41.913895 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d26ad921-8d58-4c41-a2cb-0327d22a5e52 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:41.914427 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d26ad921-8d58-4c41-a2cb-0327d22a5e52 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:41.914871 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d26ad921-8d58-4c41-a2cb-0327d22a5e52 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:41.915568 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d26ad921-8d58-4c41-a2cb-0327d22a5e52 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:41.916093 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d26ad921-8d58-4c41-a2cb-0327d22a5e52 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:41.916517 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d26ad921-8d58-4c41-a2cb-0327d22a5e52 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:42.007274 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d26ad921-8d58-4c41-a2cb-0327d22a5e52 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 8c9b2484-16d6-4ab8-b746-72f0e64f30ae] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128863) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 31 17:26:42.093023 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d26ad921-8d58-4c41-a2cb-0327d22a5e52 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "POST /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae/action" status: 202 len: 0 microversion: 2.1 time: 0.190020 Aug 31 17:26:42.097139 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3834/7842] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 17:26:41 2022] POST /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 17:26:42.102652 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-1fc0f62d-59cd-4359-8849-13617780813f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:26:42.103354 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-1fc0f62d-59cd-4359-8849-13617780813f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 8c9b2484-16d6-4ab8-b746-72f0e64f30ae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:26:42.110603 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1fc0f62d-59cd-4359-8849-13617780813f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:42.111192 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1fc0f62d-59cd-4359-8849-13617780813f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:42.111640 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1fc0f62d-59cd-4359-8849-13617780813f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:42.112362 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1fc0f62d-59cd-4359-8849-13617780813f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:42.112826 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1fc0f62d-59cd-4359-8849-13617780813f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:42.113332 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-1fc0f62d-59cd-4359-8849-13617780813f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:42.255208 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-1fc0f62d-59cd-4359-8849-13617780813f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:26:42.263703 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-1fc0f62d-59cd-4359-8849-13617780813f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae" status: 200 len: 1517 microversion: 2.1 time: 0.165251 Aug 31 17:26:42.264395 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 4009/7843] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:26:42 2022] GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae => generated 1517 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:26:43.286127 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fe768c37-f943-4c55-a3be-ecc4c6580f4c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:26:43.287164 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fe768c37-f943-4c55-a3be-ecc4c6580f4c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 8c9b2484-16d6-4ab8-b746-72f0e64f30ae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:26:43.293742 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe768c37-f943-4c55-a3be-ecc4c6580f4c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:43.294265 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe768c37-f943-4c55-a3be-ecc4c6580f4c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:43.294703 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe768c37-f943-4c55-a3be-ecc4c6580f4c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:43.295406 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe768c37-f943-4c55-a3be-ecc4c6580f4c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:43.295856 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe768c37-f943-4c55-a3be-ecc4c6580f4c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:43.296282 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fe768c37-f943-4c55-a3be-ecc4c6580f4c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:43.445178 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fe768c37-f943-4c55-a3be-ecc4c6580f4c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:26:43.453750 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fe768c37-f943-4c55-a3be-ecc4c6580f4c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae" status: 200 len: 1519 microversion: 2.1 time: 0.172623 Aug 31 17:26:43.454379 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3835/7844] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:26:43 2022] GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae => generated 1519 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:26:44.476589 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5c3c46f4-a552-4a51-92c1-dac2d7394a73 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:26:44.477192 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5c3c46f4-a552-4a51-92c1-dac2d7394a73 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 8c9b2484-16d6-4ab8-b746-72f0e64f30ae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:26:44.484963 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5c3c46f4-a552-4a51-92c1-dac2d7394a73 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:44.485472 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5c3c46f4-a552-4a51-92c1-dac2d7394a73 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:44.485915 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5c3c46f4-a552-4a51-92c1-dac2d7394a73 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:44.486652 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5c3c46f4-a552-4a51-92c1-dac2d7394a73 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:44.487177 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5c3c46f4-a552-4a51-92c1-dac2d7394a73 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:44.487639 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5c3c46f4-a552-4a51-92c1-dac2d7394a73 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:44.627696 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5c3c46f4-a552-4a51-92c1-dac2d7394a73 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:26:44.636070 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5c3c46f4-a552-4a51-92c1-dac2d7394a73 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae" status: 200 len: 1519 microversion: 2.1 time: 0.163967 Aug 31 17:26:44.636847 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 4010/7845] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:26:44 2022] GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:26:45.657079 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-99c2ca99-3b8f-4e90-b49d-9931b7fc994c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:26:45.657763 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-99c2ca99-3b8f-4e90-b49d-9931b7fc994c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 8c9b2484-16d6-4ab8-b746-72f0e64f30ae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:26:45.665274 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99c2ca99-3b8f-4e90-b49d-9931b7fc994c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:45.665762 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99c2ca99-3b8f-4e90-b49d-9931b7fc994c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:45.666230 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99c2ca99-3b8f-4e90-b49d-9931b7fc994c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:45.666925 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99c2ca99-3b8f-4e90-b49d-9931b7fc994c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:45.667405 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99c2ca99-3b8f-4e90-b49d-9931b7fc994c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:45.667827 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-99c2ca99-3b8f-4e90-b49d-9931b7fc994c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:45.804030 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-99c2ca99-3b8f-4e90-b49d-9931b7fc994c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:26:45.812412 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-99c2ca99-3b8f-4e90-b49d-9931b7fc994c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae" status: 200 len: 1519 microversion: 2.1 time: 0.159249 Aug 31 17:26:45.812996 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3836/7846] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:26:45 2022] GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:26:46.834470 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-737dfb14-a446-4541-9d8f-940428bada1c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:26:46.835075 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-737dfb14-a446-4541-9d8f-940428bada1c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 8c9b2484-16d6-4ab8-b746-72f0e64f30ae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:26:46.842587 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-737dfb14-a446-4541-9d8f-940428bada1c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:46.843078 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-737dfb14-a446-4541-9d8f-940428bada1c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:46.843533 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-737dfb14-a446-4541-9d8f-940428bada1c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:46.844249 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-737dfb14-a446-4541-9d8f-940428bada1c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:46.844954 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-737dfb14-a446-4541-9d8f-940428bada1c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:46.845646 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-737dfb14-a446-4541-9d8f-940428bada1c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:46.980583 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-737dfb14-a446-4541-9d8f-940428bada1c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:26:46.988981 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-737dfb14-a446-4541-9d8f-940428bada1c tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae" status: 200 len: 1519 microversion: 2.1 time: 0.158931 Aug 31 17:26:46.989599 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 4011/7847] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:26:46 2022] GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:26:48.010449 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cb8cd35a-6f7a-488c-ba46-cfdfcd31c4d4 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:26:48.011057 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cb8cd35a-6f7a-488c-ba46-cfdfcd31c4d4 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 8c9b2484-16d6-4ab8-b746-72f0e64f30ae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:26:48.018136 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb8cd35a-6f7a-488c-ba46-cfdfcd31c4d4 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:48.018620 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb8cd35a-6f7a-488c-ba46-cfdfcd31c4d4 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:48.019048 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb8cd35a-6f7a-488c-ba46-cfdfcd31c4d4 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:48.019730 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb8cd35a-6f7a-488c-ba46-cfdfcd31c4d4 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:48.020262 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb8cd35a-6f7a-488c-ba46-cfdfcd31c4d4 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:48.020930 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cb8cd35a-6f7a-488c-ba46-cfdfcd31c4d4 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:48.161932 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-cb8cd35a-6f7a-488c-ba46-cfdfcd31c4d4 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:26:48.170372 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cb8cd35a-6f7a-488c-ba46-cfdfcd31c4d4 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae" status: 200 len: 1575 microversion: 2.1 time: 0.163855 Aug 31 17:26:48.170963 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3837/7848] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:26:48 2022] GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:26:49.150288 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-edd25298-de8c-4de5-8b69-60983c85ba75 req-3de2c31c-01a0-4494-aa6c-5f20b50d698e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c9b2484-16d6-4ab8-b746-72f0e64f30ae", "tag": "7ad7925b-9d41-4ee8-b9de-b8f0069c120c"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:26:49.161726 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-edd25298-de8c-4de5-8b69-60983c85ba75 req-3de2c31c-01a0-4494-aa6c-5f20b50d698e service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:49.162249 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-edd25298-de8c-4de5-8b69-60983c85ba75 req-3de2c31c-01a0-4494-aa6c-5f20b50d698e service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:49.162673 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-edd25298-de8c-4de5-8b69-60983c85ba75 req-3de2c31c-01a0-4494-aa6c-5f20b50d698e service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:49.176479 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-edd25298-de8c-4de5-8b69-60983c85ba75 req-3de2c31c-01a0-4494-aa6c-5f20b50d698e service nova] Creating event network-changed:7ad7925b-9d41-4ee8-b9de-b8f0069c120c for instance 8c9b2484-16d6-4ab8-b746-72f0e64f30ae on n-h2-833090-16 Aug 31 17:26:49.180103 n-d-833090-16 devstack@n-api.service[128864]: ERROR oslo.messaging._drivers.impl_rabbit [req-edd25298-de8c-4de5-8b69-60983c85ba75 req-3de2c31c-01a0-4494-aa6c-5f20b50d698e service nova] [a12544ad-4b80-4392-a45b-594433d1d5ee] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 17:26:49.192267 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e3b735bd-c026-4356-9f90-ee8149b17fff tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:26:49.193178 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e3b735bd-c026-4356-9f90-ee8149b17fff tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 8c9b2484-16d6-4ab8-b746-72f0e64f30ae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:26:49.200599 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3b735bd-c026-4356-9f90-ee8149b17fff tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:49.201094 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3b735bd-c026-4356-9f90-ee8149b17fff tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:49.201528 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3b735bd-c026-4356-9f90-ee8149b17fff tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:49.202350 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3b735bd-c026-4356-9f90-ee8149b17fff tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:49.202807 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3b735bd-c026-4356-9f90-ee8149b17fff tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:49.203229 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e3b735bd-c026-4356-9f90-ee8149b17fff tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:49.350004 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e3b735bd-c026-4356-9f90-ee8149b17fff tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:26:49.358294 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e3b735bd-c026-4356-9f90-ee8149b17fff tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae" status: 200 len: 1575 microversion: 2.1 time: 0.170942 Aug 31 17:26:49.359210 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3838/7849] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:26:49 2022] GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae => generated 1575 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:26:50.193314 n-d-833090-16 devstack@n-api.service[128864]: INFO oslo.messaging._drivers.impl_rabbit [req-edd25298-de8c-4de5-8b69-60983c85ba75 req-3de2c31c-01a0-4494-aa6c-5f20b50d698e service nova] [a12544ad-4b80-4392-a45b-594433d1d5ee] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 53518. Aug 31 17:26:50.200198 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-edd25298-de8c-4de5-8b69-60983c85ba75 req-3de2c31c-01a0-4494-aa6c-5f20b50d698e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.054528 Aug 31 17:26:50.201279 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 4012/7850] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:26:50.383176 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5e87c752-3863-40a2-847a-847c50f7f182 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:26:50.383744 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5e87c752-3863-40a2-847a-847c50f7f182 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 8c9b2484-16d6-4ab8-b746-72f0e64f30ae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:26:50.391410 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5e87c752-3863-40a2-847a-847c50f7f182 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:50.391895 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5e87c752-3863-40a2-847a-847c50f7f182 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:50.392334 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5e87c752-3863-40a2-847a-847c50f7f182 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:50.393023 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5e87c752-3863-40a2-847a-847c50f7f182 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:50.393477 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5e87c752-3863-40a2-847a-847c50f7f182 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:50.393898 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5e87c752-3863-40a2-847a-847c50f7f182 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:50.528261 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-5e87c752-3863-40a2-847a-847c50f7f182 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:26:50.536441 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5e87c752-3863-40a2-847a-847c50f7f182 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae" status: 200 len: 1575 microversion: 2.1 time: 0.157731 Aug 31 17:26:50.537106 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3839/7851] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:26:50 2022] GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:26:51.566401 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-9e7f4244-3307-43d5-bc42-b6f9b67ee838 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:26:51.567157 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-9e7f4244-3307-43d5-bc42-b6f9b67ee838 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 8c9b2484-16d6-4ab8-b746-72f0e64f30ae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:26:51.574883 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9e7f4244-3307-43d5-bc42-b6f9b67ee838 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:51.575391 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9e7f4244-3307-43d5-bc42-b6f9b67ee838 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:51.575832 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9e7f4244-3307-43d5-bc42-b6f9b67ee838 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:51.576533 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9e7f4244-3307-43d5-bc42-b6f9b67ee838 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:51.576992 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9e7f4244-3307-43d5-bc42-b6f9b67ee838 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:51.577420 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-9e7f4244-3307-43d5-bc42-b6f9b67ee838 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:52.039533 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-9e7f4244-3307-43d5-bc42-b6f9b67ee838 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:26:52.047586 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-9e7f4244-3307-43d5-bc42-b6f9b67ee838 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae" status: 200 len: 1575 microversion: 2.1 time: 0.486737 Aug 31 17:26:52.048160 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 4013/7852] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:26:51 2022] GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae => generated 1575 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:26:53.069606 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1afb09fb-1f4c-49fd-8f46-5b41664ba569 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:26:53.070298 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1afb09fb-1f4c-49fd-8f46-5b41664ba569 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 8c9b2484-16d6-4ab8-b746-72f0e64f30ae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:26:53.078387 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1afb09fb-1f4c-49fd-8f46-5b41664ba569 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:53.078922 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1afb09fb-1f4c-49fd-8f46-5b41664ba569 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:53.079400 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1afb09fb-1f4c-49fd-8f46-5b41664ba569 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:53.080162 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1afb09fb-1f4c-49fd-8f46-5b41664ba569 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:53.080670 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1afb09fb-1f4c-49fd-8f46-5b41664ba569 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:53.081137 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1afb09fb-1f4c-49fd-8f46-5b41664ba569 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:53.085720 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:26:53.224790 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1afb09fb-1f4c-49fd-8f46-5b41664ba569 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:26:53.233999 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1afb09fb-1f4c-49fd-8f46-5b41664ba569 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae" status: 200 len: 1575 microversion: 2.1 time: 0.169403 Aug 31 17:26:53.234629 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3840/7853] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:26:53 2022] GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:26:54.258525 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-5ad359bf-fbdb-4c9f-a3e7-ae4b7ea3f4ea tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:26:54.259315 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-5ad359bf-fbdb-4c9f-a3e7-ae4b7ea3f4ea tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 8c9b2484-16d6-4ab8-b746-72f0e64f30ae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:26:54.266541 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5ad359bf-fbdb-4c9f-a3e7-ae4b7ea3f4ea tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:54.267039 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5ad359bf-fbdb-4c9f-a3e7-ae4b7ea3f4ea tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:54.267482 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5ad359bf-fbdb-4c9f-a3e7-ae4b7ea3f4ea tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:54.268187 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5ad359bf-fbdb-4c9f-a3e7-ae4b7ea3f4ea tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:54.268646 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5ad359bf-fbdb-4c9f-a3e7-ae4b7ea3f4ea tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:54.269078 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-5ad359bf-fbdb-4c9f-a3e7-ae4b7ea3f4ea tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:54.419895 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-5ad359bf-fbdb-4c9f-a3e7-ae4b7ea3f4ea tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:26:54.428543 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-5ad359bf-fbdb-4c9f-a3e7-ae4b7ea3f4ea tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae" status: 200 len: 1575 microversion: 2.1 time: 0.175857 Aug 31 17:26:54.429185 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 4014/7854] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:26:54 2022] GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae => generated 1575 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:26:55.462038 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8a6fec4b-276a-43c7-adba-a9b3745429d7 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:26:55.463045 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8a6fec4b-276a-43c7-adba-a9b3745429d7 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 8c9b2484-16d6-4ab8-b746-72f0e64f30ae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:26:55.474997 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a6fec4b-276a-43c7-adba-a9b3745429d7 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:55.475802 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a6fec4b-276a-43c7-adba-a9b3745429d7 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:55.476961 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a6fec4b-276a-43c7-adba-a9b3745429d7 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:55.477669 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a6fec4b-276a-43c7-adba-a9b3745429d7 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:55.478141 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a6fec4b-276a-43c7-adba-a9b3745429d7 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:55.478572 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8a6fec4b-276a-43c7-adba-a9b3745429d7 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:55.631094 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8a6fec4b-276a-43c7-adba-a9b3745429d7 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:26:55.639980 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8a6fec4b-276a-43c7-adba-a9b3745429d7 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae" status: 200 len: 1575 microversion: 2.1 time: 0.185321 Aug 31 17:26:55.640572 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3841/7855] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:26:55 2022] GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae => generated 1575 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:26:56.661915 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-cb03cda6-cfef-4573-aefc-2347a240f148 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:26:56.662597 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-cb03cda6-cfef-4573-aefc-2347a240f148 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 8c9b2484-16d6-4ab8-b746-72f0e64f30ae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:26:56.670632 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb03cda6-cfef-4573-aefc-2347a240f148 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:56.671132 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb03cda6-cfef-4573-aefc-2347a240f148 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:56.671583 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb03cda6-cfef-4573-aefc-2347a240f148 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:56.672292 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb03cda6-cfef-4573-aefc-2347a240f148 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:56.672771 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb03cda6-cfef-4573-aefc-2347a240f148 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:56.673207 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-cb03cda6-cfef-4573-aefc-2347a240f148 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:56.817189 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-cb03cda6-cfef-4573-aefc-2347a240f148 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:26:56.825450 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-cb03cda6-cfef-4573-aefc-2347a240f148 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae" status: 200 len: 1575 microversion: 2.1 time: 0.167538 Aug 31 17:26:56.826071 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 4015/7856] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:26:56 2022] GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:26:57.848298 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-3d7b9dda-3304-438e-ba3f-4c8dd009c12f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:26:57.848862 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-3d7b9dda-3304-438e-ba3f-4c8dd009c12f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 8c9b2484-16d6-4ab8-b746-72f0e64f30ae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:26:57.851763 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:26:57.857143 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d7b9dda-3304-438e-ba3f-4c8dd009c12f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:57.857638 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d7b9dda-3304-438e-ba3f-4c8dd009c12f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:57.858041 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d7b9dda-3304-438e-ba3f-4c8dd009c12f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:57.858764 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d7b9dda-3304-438e-ba3f-4c8dd009c12f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:57.859211 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d7b9dda-3304-438e-ba3f-4c8dd009c12f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:57.859627 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-3d7b9dda-3304-438e-ba3f-4c8dd009c12f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:58.004609 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-3d7b9dda-3304-438e-ba3f-4c8dd009c12f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:26:58.013472 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-3d7b9dda-3304-438e-ba3f-4c8dd009c12f tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae" status: 200 len: 1575 microversion: 2.1 time: 0.169161 Aug 31 17:26:58.014065 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3842/7857] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:26:57 2022] GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae => generated 1575 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:26:59.044621 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fb5e6eea-6a69-4000-9cd4-9c0babd3fe59 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:26:59.045335 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fb5e6eea-6a69-4000-9cd4-9c0babd3fe59 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 8c9b2484-16d6-4ab8-b746-72f0e64f30ae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:26:59.047572 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=29 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:26:59.055682 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb5e6eea-6a69-4000-9cd4-9c0babd3fe59 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:59.056190 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb5e6eea-6a69-4000-9cd4-9c0babd3fe59 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:59.056634 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb5e6eea-6a69-4000-9cd4-9c0babd3fe59 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:59.057373 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb5e6eea-6a69-4000-9cd4-9c0babd3fe59 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:26:59.057796 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb5e6eea-6a69-4000-9cd4-9c0babd3fe59 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:26:59.058263 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fb5e6eea-6a69-4000-9cd4-9c0babd3fe59 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:26:59.060996 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=81 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:26:59.201585 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-fb5e6eea-6a69-4000-9cd4-9c0babd3fe59 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:26:59.209959 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fb5e6eea-6a69-4000-9cd4-9c0babd3fe59 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae" status: 200 len: 1575 microversion: 2.1 time: 0.170834 Aug 31 17:26:59.210584 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 4016/7858] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:26:59 2022] GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae => generated 1575 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:27:00.232411 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4a08a070-1e07-4624-b7f1-48bc69f3c565 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:27:00.233004 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4a08a070-1e07-4624-b7f1-48bc69f3c565 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 8c9b2484-16d6-4ab8-b746-72f0e64f30ae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:27:00.240199 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a08a070-1e07-4624-b7f1-48bc69f3c565 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:27:00.240671 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a08a070-1e07-4624-b7f1-48bc69f3c565 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:27:00.241101 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a08a070-1e07-4624-b7f1-48bc69f3c565 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:27:00.241783 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a08a070-1e07-4624-b7f1-48bc69f3c565 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:27:00.242264 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a08a070-1e07-4624-b7f1-48bc69f3c565 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:27:00.242697 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4a08a070-1e07-4624-b7f1-48bc69f3c565 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:27:00.385377 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4a08a070-1e07-4624-b7f1-48bc69f3c565 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:27:00.393681 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4a08a070-1e07-4624-b7f1-48bc69f3c565 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae" status: 200 len: 1575 microversion: 2.1 time: 0.165260 Aug 31 17:27:00.394292 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3843/7859] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:27:00 2022] GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:27:00.714704 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-42550929-6b4a-4e07-a11d-128d0fef430d req-cd1c3ea4-78c3-482d-b2f0-1479b2c1d1ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c9b2484-16d6-4ab8-b746-72f0e64f30ae", "name": "network-vif-plugged", "status": "completed", "tag": "7ad7925b-9d41-4ee8-b9de-b8f0069c120c"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:27:00.726276 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-42550929-6b4a-4e07-a11d-128d0fef430d req-cd1c3ea4-78c3-482d-b2f0-1479b2c1d1ae service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:27:00.726913 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-42550929-6b4a-4e07-a11d-128d0fef430d req-cd1c3ea4-78c3-482d-b2f0-1479b2c1d1ae service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:27:00.727423 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-42550929-6b4a-4e07-a11d-128d0fef430d req-cd1c3ea4-78c3-482d-b2f0-1479b2c1d1ae service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:27:00.739623 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-42550929-6b4a-4e07-a11d-128d0fef430d req-cd1c3ea4-78c3-482d-b2f0-1479b2c1d1ae service nova] Creating event network-vif-plugged:7ad7925b-9d41-4ee8-b9de-b8f0069c120c for instance 8c9b2484-16d6-4ab8-b746-72f0e64f30ae on n-h2-833090-16 Aug 31 17:27:00.745025 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-42550929-6b4a-4e07-a11d-128d0fef430d req-cd1c3ea4-78c3-482d-b2f0-1479b2c1d1ae service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034710 Aug 31 17:27:00.745861 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 4017/7860] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 17:27:01.419398 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fa2941c2-2658-49e0-983c-c327e102449b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:27:01.420266 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fa2941c2-2658-49e0-983c-c327e102449b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 8c9b2484-16d6-4ab8-b746-72f0e64f30ae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:27:01.430898 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa2941c2-2658-49e0-983c-c327e102449b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:27:01.431436 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa2941c2-2658-49e0-983c-c327e102449b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:27:01.431866 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa2941c2-2658-49e0-983c-c327e102449b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:27:01.432547 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa2941c2-2658-49e0-983c-c327e102449b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:27:01.432991 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa2941c2-2658-49e0-983c-c327e102449b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:27:01.433401 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fa2941c2-2658-49e0-983c-c327e102449b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:27:01.574039 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fa2941c2-2658-49e0-983c-c327e102449b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:27:01.582423 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fa2941c2-2658-49e0-983c-c327e102449b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae" status: 200 len: 1575 microversion: 2.1 time: 0.169297 Aug 31 17:27:01.583006 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3844/7861] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:27:01 2022] GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:27:02.606572 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-93b2d296-cc1e-4082-b4c5-f6863cf60873 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:27:02.607186 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-93b2d296-cc1e-4082-b4c5-f6863cf60873 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 8c9b2484-16d6-4ab8-b746-72f0e64f30ae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:27:02.614432 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-93b2d296-cc1e-4082-b4c5-f6863cf60873 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:27:02.614943 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-93b2d296-cc1e-4082-b4c5-f6863cf60873 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:27:02.615383 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-93b2d296-cc1e-4082-b4c5-f6863cf60873 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:27:02.616093 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-93b2d296-cc1e-4082-b4c5-f6863cf60873 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:27:02.616553 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-93b2d296-cc1e-4082-b4c5-f6863cf60873 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:27:02.616986 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-93b2d296-cc1e-4082-b4c5-f6863cf60873 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:27:02.761937 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-93b2d296-cc1e-4082-b4c5-f6863cf60873 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:27:02.770708 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-93b2d296-cc1e-4082-b4c5-f6863cf60873 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae" status: 200 len: 1562 microversion: 2.1 time: 0.169909 Aug 31 17:27:02.771296 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 4018/7862] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:27:02 2022] GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae => generated 1562 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:28:19.257803 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=5 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:28:19.262930 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-a8bff53b-47f8-4061-a09c-e837d0e479b4 req-756b5725-42e9-467d-bcf8-c5233ba31584 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c9b2484-16d6-4ab8-b746-72f0e64f30ae", "tag": "7ad7925b-9d41-4ee8-b9de-b8f0069c120c"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:28:19.264759 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=28 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:28:19.265657 n-d-833090-16 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 17:28:19.265799 n-d-833090-16 devstack@n-api.service[128863]: Wed Aug 31 17:28:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae (ip 10.222.0.50) !!! Aug 31 17:28:19.271095 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-53a3edea-0fc7-4c86-843f-b88cef51942a tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:28:19.271593 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-53a3edea-0fc7-4c86-843f-b88cef51942a tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 8c9b2484-16d6-4ab8-b746-72f0e64f30ae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:28:19.279268 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=5 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:28:19.279929 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=13 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:28:19.280764 n-d-833090-16 devstack@n-api.service[128864]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 17:28:19.280898 n-d-833090-16 devstack@n-api.service[128864]: Wed Aug 31 17:28:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.50) !!! Aug 31 17:28:19.282489 n-d-833090-16 devstack@n-api.service[128864]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 17:28:19.282808 n-d-833090-16 devstack@n-api.service[128864]: Wed Aug 31 17:28:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.50) !!! Aug 31 17:28:19.293982 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-a8bff53b-47f8-4061-a09c-e837d0e479b4 req-756b5725-42e9-467d-bcf8-c5233ba31584 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:19.294755 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-a8bff53b-47f8-4061-a09c-e837d0e479b4 req-756b5725-42e9-467d-bcf8-c5233ba31584 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:19.295453 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-a8bff53b-47f8-4061-a09c-e837d0e479b4 req-756b5725-42e9-467d-bcf8-c5233ba31584 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:19.296198 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-53a3edea-0fc7-4c86-843f-b88cef51942a tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:19.296677 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-53a3edea-0fc7-4c86-843f-b88cef51942a tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:19.297576 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-53a3edea-0fc7-4c86-843f-b88cef51942a tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:19.298308 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-53a3edea-0fc7-4c86-843f-b88cef51942a tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:19.298969 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-53a3edea-0fc7-4c86-843f-b88cef51942a tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:19.299433 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-53a3edea-0fc7-4c86-843f-b88cef51942a tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:19.308190 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-a8bff53b-47f8-4061-a09c-e837d0e479b4 req-756b5725-42e9-467d-bcf8-c5233ba31584 service nova] Creating event network-changed:7ad7925b-9d41-4ee8-b9de-b8f0069c120c for instance 8c9b2484-16d6-4ab8-b746-72f0e64f30ae on n-h2-833090-16 Aug 31 17:28:19.313841 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-a8bff53b-47f8-4061-a09c-e837d0e479b4 req-756b5725-42e9-467d-bcf8-c5233ba31584 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058124 Aug 31 17:28:19.314555 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 4019/7863] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:28:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:28:19.330459 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-53a3edea-0fc7-4c86-843f-b88cef51942a tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 8c9b2484-16d6-4ab8-b746-72f0e64f30ae] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 17:28:19.422820 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-53a3edea-0fc7-4c86-843f-b88cef51942a tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "DELETE /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae" status: 204 len: 0 microversion: 2.1 time: 0.169432 Aug 31 17:28:19.423912 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3845/7864] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 17:28:19 2022] DELETE /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 17:28:19.433375 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-085aa4d3-2661-4bea-a79e-ff0dcc44d292 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:28:19.434842 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-085aa4d3-2661-4bea-a79e-ff0dcc44d292 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 8c9b2484-16d6-4ab8-b746-72f0e64f30ae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:28:19.443323 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-085aa4d3-2661-4bea-a79e-ff0dcc44d292 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:19.444406 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-085aa4d3-2661-4bea-a79e-ff0dcc44d292 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:19.446007 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-085aa4d3-2661-4bea-a79e-ff0dcc44d292 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:19.447438 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-085aa4d3-2661-4bea-a79e-ff0dcc44d292 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:19.448158 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-085aa4d3-2661-4bea-a79e-ff0dcc44d292 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:19.448798 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-085aa4d3-2661-4bea-a79e-ff0dcc44d292 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:19.607202 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-085aa4d3-2661-4bea-a79e-ff0dcc44d292 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:28:19.619968 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-085aa4d3-2661-4bea-a79e-ff0dcc44d292 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae" status: 200 len: 1568 microversion: 2.1 time: 0.191318 Aug 31 17:28:19.620916 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 4020/7865] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:28:19 2022] GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae => generated 1568 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:28:20.643815 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-63761e89-a0e1-405b-a1c1-fc286bb39dc6 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:28:20.644552 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-63761e89-a0e1-405b-a1c1-fc286bb39dc6 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 8c9b2484-16d6-4ab8-b746-72f0e64f30ae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:28:20.652020 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-63761e89-a0e1-405b-a1c1-fc286bb39dc6 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:20.652511 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-63761e89-a0e1-405b-a1c1-fc286bb39dc6 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:20.652948 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-63761e89-a0e1-405b-a1c1-fc286bb39dc6 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:20.653645 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-63761e89-a0e1-405b-a1c1-fc286bb39dc6 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:20.654126 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-63761e89-a0e1-405b-a1c1-fc286bb39dc6 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:20.654553 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-63761e89-a0e1-405b-a1c1-fc286bb39dc6 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:20.798866 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-63761e89-a0e1-405b-a1c1-fc286bb39dc6 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:28:20.808397 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-63761e89-a0e1-405b-a1c1-fc286bb39dc6 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae" status: 200 len: 1568 microversion: 2.1 time: 0.168948 Aug 31 17:28:20.809166 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3846/7866] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:28:20 2022] GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:28:21.830621 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-bc2280df-858e-4a47-92aa-079be1dacd00 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:28:21.831446 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-bc2280df-858e-4a47-92aa-079be1dacd00 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 8c9b2484-16d6-4ab8-b746-72f0e64f30ae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:28:21.838991 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bc2280df-858e-4a47-92aa-079be1dacd00 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:21.839489 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bc2280df-858e-4a47-92aa-079be1dacd00 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:21.839926 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bc2280df-858e-4a47-92aa-079be1dacd00 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:21.840623 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bc2280df-858e-4a47-92aa-079be1dacd00 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:21.841079 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bc2280df-858e-4a47-92aa-079be1dacd00 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:21.841517 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bc2280df-858e-4a47-92aa-079be1dacd00 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:21.920176 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-450732c0-2a17-4e1f-8b90-a6d8dc0011c9 req-64cc43b5-76aa-4949-adaf-6512801f9e30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c9b2484-16d6-4ab8-b746-72f0e64f30ae", "name": "network-vif-deleted", "tag": "7ad7925b-9d41-4ee8-b9de-b8f0069c120c"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:28:21.932821 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-450732c0-2a17-4e1f-8b90-a6d8dc0011c9 req-64cc43b5-76aa-4949-adaf-6512801f9e30 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:21.933160 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-450732c0-2a17-4e1f-8b90-a6d8dc0011c9 req-64cc43b5-76aa-4949-adaf-6512801f9e30 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:21.933565 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-450732c0-2a17-4e1f-8b90-a6d8dc0011c9 req-64cc43b5-76aa-4949-adaf-6512801f9e30 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:21.935442 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-bc2280df-858e-4a47-92aa-079be1dacd00 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:28:21.946803 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-bc2280df-858e-4a47-92aa-079be1dacd00 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae" status: 200 len: 1383 microversion: 2.1 time: 0.120099 Aug 31 17:28:21.948018 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 4021/7867] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:28:21 2022] GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae => generated 1383 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:28:21.948150 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-450732c0-2a17-4e1f-8b90-a6d8dc0011c9 req-64cc43b5-76aa-4949-adaf-6512801f9e30 service nova] Creating event network-vif-deleted:7ad7925b-9d41-4ee8-b9de-b8f0069c120c for instance 8c9b2484-16d6-4ab8-b746-72f0e64f30ae on n-h2-833090-16 Aug 31 17:28:21.954238 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-450732c0-2a17-4e1f-8b90-a6d8dc0011c9 req-64cc43b5-76aa-4949-adaf-6512801f9e30 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038062 Aug 31 17:28:21.955674 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3847/7868] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:28:22.968860 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-126a19ec-e998-4f24-84cd-bc962e77b9f7 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:28:22.969497 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-126a19ec-e998-4f24-84cd-bc962e77b9f7 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 8c9b2484-16d6-4ab8-b746-72f0e64f30ae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:28:22.977421 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-126a19ec-e998-4f24-84cd-bc962e77b9f7 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:22.978278 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-126a19ec-e998-4f24-84cd-bc962e77b9f7 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:22.978754 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-126a19ec-e998-4f24-84cd-bc962e77b9f7 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:22.979451 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-126a19ec-e998-4f24-84cd-bc962e77b9f7 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:22.979938 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-126a19ec-e998-4f24-84cd-bc962e77b9f7 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:22.980398 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-126a19ec-e998-4f24-84cd-bc962e77b9f7 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:23.048632 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-126a19ec-e998-4f24-84cd-bc962e77b9f7 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:28:23.056974 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-126a19ec-e998-4f24-84cd-bc962e77b9f7 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae" status: 200 len: 1220 microversion: 2.1 time: 0.092138 Aug 31 17:28:23.057604 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 4022/7869] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:28:22 2022] GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:28:24.080482 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8fa2e51e-88f9-4a81-8d9e-2b24f16a7dc9 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:28:24.081676 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8fa2e51e-88f9-4a81-8d9e-2b24f16a7dc9 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 8c9b2484-16d6-4ab8-b746-72f0e64f30ae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:28:24.089849 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8fa2e51e-88f9-4a81-8d9e-2b24f16a7dc9 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:24.090369 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8fa2e51e-88f9-4a81-8d9e-2b24f16a7dc9 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:24.090801 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8fa2e51e-88f9-4a81-8d9e-2b24f16a7dc9 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:24.091510 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8fa2e51e-88f9-4a81-8d9e-2b24f16a7dc9 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:24.091964 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8fa2e51e-88f9-4a81-8d9e-2b24f16a7dc9 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:24.092390 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8fa2e51e-88f9-4a81-8d9e-2b24f16a7dc9 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:24.161024 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8fa2e51e-88f9-4a81-8d9e-2b24f16a7dc9 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:28:24.169298 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8fa2e51e-88f9-4a81-8d9e-2b24f16a7dc9 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae" status: 200 len: 1220 microversion: 2.1 time: 0.093345 Aug 31 17:28:24.169887 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3848/7870] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:28:24 2022] GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:28:25.191405 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-27d2eb13-95c8-490b-9699-dd54edb9e320 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:28:25.192015 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-27d2eb13-95c8-490b-9699-dd54edb9e320 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 8c9b2484-16d6-4ab8-b746-72f0e64f30ae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:28:25.199248 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-27d2eb13-95c8-490b-9699-dd54edb9e320 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:25.199751 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-27d2eb13-95c8-490b-9699-dd54edb9e320 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:25.200194 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-27d2eb13-95c8-490b-9699-dd54edb9e320 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:25.200874 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-27d2eb13-95c8-490b-9699-dd54edb9e320 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:25.201336 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-27d2eb13-95c8-490b-9699-dd54edb9e320 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:25.201770 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-27d2eb13-95c8-490b-9699-dd54edb9e320 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:25.267731 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-27d2eb13-95c8-490b-9699-dd54edb9e320 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:28:25.276481 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-27d2eb13-95c8-490b-9699-dd54edb9e320 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae" status: 200 len: 1220 microversion: 2.1 time: 0.089402 Aug 31 17:28:25.277169 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 4023/7871] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:28:25 2022] GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:28:26.297867 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-4e69d803-6ec3-4956-a339-89252453ea3b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:28:26.298795 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-4e69d803-6ec3-4956-a339-89252453ea3b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 8c9b2484-16d6-4ab8-b746-72f0e64f30ae] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:28:26.307169 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e69d803-6ec3-4956-a339-89252453ea3b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:26.307663 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e69d803-6ec3-4956-a339-89252453ea3b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:26.308134 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e69d803-6ec3-4956-a339-89252453ea3b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:26.309009 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e69d803-6ec3-4956-a339-89252453ea3b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:26.309527 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e69d803-6ec3-4956-a339-89252453ea3b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:26.309997 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e69d803-6ec3-4956-a339-89252453ea3b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:26.348972 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e69d803-6ec3-4956-a339-89252453ea3b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:26.349468 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e69d803-6ec3-4956-a339-89252453ea3b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:26.349900 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-4e69d803-6ec3-4956-a339-89252453ea3b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:26.350386 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.objects.instance [None req-4e69d803-6ec3-4956-a339-89252453ea3b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lazy-loading 'fault' on Instance uuid 8c9b2484-16d6-4ab8-b746-72f0e64f30ae {{(pid=128863) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 17:28:26.395904 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-4e69d803-6ec3-4956-a339-89252453ea3b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30ba0f75d33b4dc68d6dbce8dce75686', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb52c4e2557425c96d32a9163749d81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:28:26.404183 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-4e69d803-6ec3-4956-a339-89252453ea3b tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae" status: 200 len: 1225 microversion: 2.1 time: 0.110997 Aug 31 17:28:26.404856 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3849/7872] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:28:26 2022] GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae => generated 1225 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:28:27.425557 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-48ebf7fc-fa5f-4180-90c8-8fe0e1182f39 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:28:27.426478 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-48ebf7fc-fa5f-4180-90c8-8fe0e1182f39 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] [instance: 8c9b2484-16d6-4ab8-b746-72f0e64f30ae] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:28:27.433909 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-48ebf7fc-fa5f-4180-90c8-8fe0e1182f39 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:27.434440 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-48ebf7fc-fa5f-4180-90c8-8fe0e1182f39 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:27.434879 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-48ebf7fc-fa5f-4180-90c8-8fe0e1182f39 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:27.435588 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-48ebf7fc-fa5f-4180-90c8-8fe0e1182f39 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:27.436072 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-48ebf7fc-fa5f-4180-90c8-8fe0e1182f39 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:27.436502 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-48ebf7fc-fa5f-4180-90c8-8fe0e1182f39 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:27.450579 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-48ebf7fc-fa5f-4180-90c8-8fe0e1182f39 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] HTTP exception thrown: Instance 8c9b2484-16d6-4ab8-b746-72f0e64f30ae could not be found. Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-48ebf7fc-fa5f-4180-90c8-8fe0e1182f39 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Request method failure captured: Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae HTTP/1.1 Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD5e-hBBXuK4K7kpgy24k5LmM7itR-gTAEQs-FOVfCroYieSr5lAHzQ-xEWCWI2w8JOdyuNh2q2WGqLWb-QV-ztP8lza-DXicZwYL4byH6Adrfb0ZTy6b-nT0biOYS_i33IbRJA1zxHFDLYeJr_N20x8c40Y-TgaXGoz-oJ55BSfkk8A Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 4eb52c4e2557425c96d32a9163749d81 Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-TestShelveInstance-968532960 Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4eb52c4e2557425c96d32a9163749d81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4eb52c4e2557425c96d32a9163749d81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4eb52c4e2557425c96d32a9163749d81"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4eb52c4e2557425c96d32a9163749d81", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-TestShelveInstance-968532960 Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 4eb52c4e2557425c96d32a9163749d81 Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-TestShelveInstance-968532960 Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-TestShelveInstance-968532960-project Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 30ba0f75d33b4dc68d6dbce8dce75686 Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-TestShelveInstance-968532960-project Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance 8c9b2484-16d6-4ab8-b746-72f0e64f30ae could not be found. Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': '8c9b2484-16d6-4ab8-b746-72f0e64f30ae'} Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c9b2484-16d6-4ab8-b746-72f0e64f30ae could not be found. Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c9b2484-16d6-4ab8-b746-72f0e64f30ae could not be found. Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:28:27.452251 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 17:28:27.458501 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:28:27.458501 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:28:27.458501 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:28:27.458501 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 17:28:27.458501 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 17:28:27.458501 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c9b2484-16d6-4ab8-b746-72f0e64f30ae could not be found. Aug 31 17:28:27.458501 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 17:28:27.458501 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-48ebf7fc-fa5f-4180-90c8-8fe0e1182f39 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Returning 404 to user: Instance 8c9b2484-16d6-4ab8-b746-72f0e64f30ae could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 17:28:27.458501 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-48ebf7fc-fa5f-4180-90c8-8fe0e1182f39 tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae" status: 404 len: 111 microversion: 2.1 time: 0.032568 Aug 31 17:28:27.466433 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 4024/7873] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:28:27 2022] GET /compute/v2.1/servers/8c9b2484-16d6-4ab8-b746-72f0e64f30ae => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 17:28:27.631433 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8a2f5ddf-79e6-49f1-9382-190141cbaa3d tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] Calling method '.version_select at 0x7fbb452bed30>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:28:27.660490 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8a2f5ddf-79e6-49f1-9382-190141cbaa3d tempest-TestShelveInstance-968532960 tempest-TestShelveInstance-968532960-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1744021713" status: 202 len: 0 microversion: 2.1 time: 0.033761 Aug 31 17:28:27.661116 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3850/7874] 10.222.0.50 () {58 vars in 1254 bytes} [Wed Aug 31 17:28:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1744021713 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 17:28:45.890255 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=12 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:28:45.891118 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=28 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:28:46.078633 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-175e8d67-4f70-4c8b-b9e1-d8376b44db66 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Action: 'create', calling method: .version_select at 0x7fbb44348e50>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1305527331", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGNbEJxOBWmFegSjoeH5By8QLByYOVHmJ0ABLBOYn0NjMrxpt6cP5j8IMto+EgysMK1jvxsVP5PxzY7pu2V9V79TAWwxpUd3ZNEDSV9Ut7AvCaHTh7XVNu9Apt+otsyaig=="}} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:28:46.095277 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-175e8d67-4f70-4c8b-b9e1-d8376b44db66 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Getting quotas for project 4f95065659944050a484f98b738b0f2b. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 17:28:46.101676 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.quota [None req-175e8d67-4f70-4c8b-b9e1-d8376b44db66 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Getting quotas for user 0cf077c7c1794aa5a51d730f2a0c9162 and project 4f95065659944050a484f98b738b0f2b. Resources: {'key_pairs'} {{(pid=128864) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 17:28:46.132003 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-175e8d67-4f70-4c8b-b9e1-d8376b44db66 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.246702 Aug 31 17:28:46.132615 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 4025/7875] 10.222.0.50 () {60 vars in 1159 bytes} [Wed Aug 31 17:28:45 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:28:47.188078 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:28:47.188934 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:28:47.193505 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-5ace9b87-90b9-4239-9bb4-cb61bb79e871 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-87850616", "imageRef": "d715a41c-0e56-494a-a102-cac65831f6bd", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1305527331", "security_groups": [{"name": "tempest-secgroup-smoke-224360575"}], "networks": [{"uuid": "0ff334ea-d1d3-4b59-bdcf-8dbc2b5079f7"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:28:47.310439 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-5ace9b87-90b9-4239-9bb4-cb61bb79e871 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] validate_networks() for [('0ff334ea-d1d3-4b59-bdcf-8dbc2b5079f7', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 17:28:47.722004 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-5ace9b87-90b9-4239-9bb4-cb61bb79e871 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 17:28:47.722509 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-5ace9b87-90b9-4239-9bb4-cb61bb79e871 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 17:28:47.722984 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-5ace9b87-90b9-4239-9bb4-cb61bb79e871 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 17:28:47.723394 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-5ace9b87-90b9-4239-9bb4-cb61bb79e871 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 17:28:47.723804 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-5ace9b87-90b9-4239-9bb4-cb61bb79e871 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 17:28:47.732910 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ace9b87-90b9-4239-9bb4-cb61bb79e871 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:47.733393 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ace9b87-90b9-4239-9bb4-cb61bb79e871 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:47.733825 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ace9b87-90b9-4239-9bb4-cb61bb79e871 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:47.734576 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ace9b87-90b9-4239-9bb4-cb61bb79e871 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:47.735026 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ace9b87-90b9-4239-9bb4-cb61bb79e871 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:47.735449 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-5ace9b87-90b9-4239-9bb4-cb61bb79e871 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:47.752434 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-5ace9b87-90b9-4239-9bb4-cb61bb79e871 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Getting quotas for project 4f95065659944050a484f98b738b0f2b. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 17:28:47.758263 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-5ace9b87-90b9-4239-9bb4-cb61bb79e871 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Getting quotas for user 0cf077c7c1794aa5a51d730f2a0c9162 and project 4f95065659944050a484f98b738b0f2b. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 17:28:47.772197 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5ace9b87-90b9-4239-9bb4-cb61bb79e871 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 17:28:47.774581 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-5ace9b87-90b9-4239-9bb4-cb61bb79e871 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] [instance: bbec5318-32b0-45cd-92d1-155f8a38ab77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d715a41c-0e56-494a-a102-cac65831f6bd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 17:28:47.825590 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-5ace9b87-90b9-4239-9bb4-cb61bb79e871 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.639939 Aug 31 17:28:47.826568 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3851/7876] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 17:28:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 17:28:47.839365 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-faf85169-809b-47a5-a890-97f2448934cf tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:28:47.840616 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-faf85169-809b-47a5-a890-97f2448934cf tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] [instance: bbec5318-32b0-45cd-92d1-155f8a38ab77] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:28:47.904487 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-faf85169-809b-47a5-a890-97f2448934cf tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf077c7c1794aa5a51d730f2a0c9162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f95065659944050a484f98b738b0f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:28:47.913223 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-faf85169-809b-47a5-a890-97f2448934cf tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] 10.222.0.50 "GET /compute/v2.1/servers/bbec5318-32b0-45cd-92d1-155f8a38ab77" status: 200 len: 1247 microversion: 2.1 time: 0.078837 Aug 31 17:28:47.913825 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 4026/7877] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:28:47 2022] GET /compute/v2.1/servers/bbec5318-32b0-45cd-92d1-155f8a38ab77 => generated 1247 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:28:48.936284 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-1fa2d667-f261-4b9d-98fe-297d10888b86 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:28:48.939032 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-1fa2d667-f261-4b9d-98fe-297d10888b86 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] [instance: bbec5318-32b0-45cd-92d1-155f8a38ab77] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:28:48.946076 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1fa2d667-f261-4b9d-98fe-297d10888b86 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:48.946884 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1fa2d667-f261-4b9d-98fe-297d10888b86 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:48.947502 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1fa2d667-f261-4b9d-98fe-297d10888b86 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:48.948370 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1fa2d667-f261-4b9d-98fe-297d10888b86 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:48.948984 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1fa2d667-f261-4b9d-98fe-297d10888b86 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:48.949624 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-1fa2d667-f261-4b9d-98fe-297d10888b86 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:49.026964 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-1fa2d667-f261-4b9d-98fe-297d10888b86 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf077c7c1794aa5a51d730f2a0c9162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f95065659944050a484f98b738b0f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:28:49.036035 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-1fa2d667-f261-4b9d-98fe-297d10888b86 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] 10.222.0.50 "GET /compute/v2.1/servers/bbec5318-32b0-45cd-92d1-155f8a38ab77" status: 200 len: 1299 microversion: 2.1 time: 0.104730 Aug 31 17:28:49.036733 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3852/7878] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:28:48 2022] GET /compute/v2.1/servers/bbec5318-32b0-45cd-92d1-155f8a38ab77 => generated 1299 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:28:50.058732 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-20a6aae3-f45a-4467-849f-83074bfa106e tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:28:50.059359 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-20a6aae3-f45a-4467-849f-83074bfa106e tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] [instance: bbec5318-32b0-45cd-92d1-155f8a38ab77] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:28:50.073293 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-20a6aae3-f45a-4467-849f-83074bfa106e tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:50.074245 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-20a6aae3-f45a-4467-849f-83074bfa106e tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:50.075032 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-20a6aae3-f45a-4467-849f-83074bfa106e tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:50.075834 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-20a6aae3-f45a-4467-849f-83074bfa106e tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:50.076317 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-20a6aae3-f45a-4467-849f-83074bfa106e tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:50.076815 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-20a6aae3-f45a-4467-849f-83074bfa106e tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:50.291955 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-20a6aae3-f45a-4467-849f-83074bfa106e tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf077c7c1794aa5a51d730f2a0c9162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f95065659944050a484f98b738b0f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:28:50.300438 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-20a6aae3-f45a-4467-849f-83074bfa106e tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] 10.222.0.50 "GET /compute/v2.1/servers/bbec5318-32b0-45cd-92d1-155f8a38ab77" status: 200 len: 1372 microversion: 2.1 time: 0.246242 Aug 31 17:28:50.314251 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 4027/7879] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:28:50 2022] GET /compute/v2.1/servers/bbec5318-32b0-45cd-92d1-155f8a38ab77 => generated 1372 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:28:50.633831 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-4ada4a64-7926-4df0-b233-662e03e2923e req-944930c6-a861-4ad9-8865-2ab875ffc44a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbec5318-32b0-45cd-92d1-155f8a38ab77", "tag": "9b9edf17-9b80-4f26-8d16-491f25e711cd"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:28:50.652030 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4ada4a64-7926-4df0-b233-662e03e2923e req-944930c6-a861-4ad9-8865-2ab875ffc44a service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:50.652866 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4ada4a64-7926-4df0-b233-662e03e2923e req-944930c6-a861-4ad9-8865-2ab875ffc44a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:50.653286 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-4ada4a64-7926-4df0-b233-662e03e2923e req-944930c6-a861-4ad9-8865-2ab875ffc44a service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:50.667580 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-4ada4a64-7926-4df0-b233-662e03e2923e req-944930c6-a861-4ad9-8865-2ab875ffc44a service nova] Creating event network-changed:9b9edf17-9b80-4f26-8d16-491f25e711cd for instance bbec5318-32b0-45cd-92d1-155f8a38ab77 on n-h2-833090-16 Aug 31 17:28:50.676646 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-4ada4a64-7926-4df0-b233-662e03e2923e req-944930c6-a861-4ad9-8865-2ab875ffc44a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048163 Aug 31 17:28:50.678796 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3853/7880] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:28:51.323689 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c18e0177-6446-445f-9cfe-e3113cdbba6f tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:28:51.324307 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c18e0177-6446-445f-9cfe-e3113cdbba6f tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] [instance: bbec5318-32b0-45cd-92d1-155f8a38ab77] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:28:51.332614 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c18e0177-6446-445f-9cfe-e3113cdbba6f tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:51.333143 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c18e0177-6446-445f-9cfe-e3113cdbba6f tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:51.333583 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c18e0177-6446-445f-9cfe-e3113cdbba6f tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:51.334406 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c18e0177-6446-445f-9cfe-e3113cdbba6f tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:51.335028 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c18e0177-6446-445f-9cfe-e3113cdbba6f tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:51.335461 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c18e0177-6446-445f-9cfe-e3113cdbba6f tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:51.474340 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c18e0177-6446-445f-9cfe-e3113cdbba6f tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf077c7c1794aa5a51d730f2a0c9162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f95065659944050a484f98b738b0f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:28:51.482316 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c18e0177-6446-445f-9cfe-e3113cdbba6f tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] 10.222.0.50 "GET /compute/v2.1/servers/bbec5318-32b0-45cd-92d1-155f8a38ab77" status: 200 len: 1372 microversion: 2.1 time: 0.163901 Aug 31 17:28:51.482884 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 4028/7881] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:28:51 2022] GET /compute/v2.1/servers/bbec5318-32b0-45cd-92d1-155f8a38ab77 => generated 1372 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:28:52.504522 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-465b0138-9552-4f7e-bc1b-107af2b80651 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:28:52.505266 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-465b0138-9552-4f7e-bc1b-107af2b80651 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] [instance: bbec5318-32b0-45cd-92d1-155f8a38ab77] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:28:52.512977 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-465b0138-9552-4f7e-bc1b-107af2b80651 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:52.513470 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-465b0138-9552-4f7e-bc1b-107af2b80651 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:52.514211 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-465b0138-9552-4f7e-bc1b-107af2b80651 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:52.514941 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-465b0138-9552-4f7e-bc1b-107af2b80651 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:52.515413 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-465b0138-9552-4f7e-bc1b-107af2b80651 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:52.515841 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-465b0138-9552-4f7e-bc1b-107af2b80651 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:52.663102 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-465b0138-9552-4f7e-bc1b-107af2b80651 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf077c7c1794aa5a51d730f2a0c9162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f95065659944050a484f98b738b0f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:28:52.671331 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-465b0138-9552-4f7e-bc1b-107af2b80651 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] 10.222.0.50 "GET /compute/v2.1/servers/bbec5318-32b0-45cd-92d1-155f8a38ab77" status: 200 len: 1372 microversion: 2.1 time: 0.171829 Aug 31 17:28:52.671938 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3854/7882] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:28:52 2022] GET /compute/v2.1/servers/bbec5318-32b0-45cd-92d1-155f8a38ab77 => generated 1372 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:28:53.696877 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-aed0a04e-b022-4912-b1d8-ca3a038d9f54 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:28:53.698697 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-aed0a04e-b022-4912-b1d8-ca3a038d9f54 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] [instance: bbec5318-32b0-45cd-92d1-155f8a38ab77] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:28:53.708575 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aed0a04e-b022-4912-b1d8-ca3a038d9f54 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:53.709315 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aed0a04e-b022-4912-b1d8-ca3a038d9f54 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:53.709846 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aed0a04e-b022-4912-b1d8-ca3a038d9f54 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:53.710755 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aed0a04e-b022-4912-b1d8-ca3a038d9f54 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:53.711323 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aed0a04e-b022-4912-b1d8-ca3a038d9f54 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:53.711872 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-aed0a04e-b022-4912-b1d8-ca3a038d9f54 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:53.930880 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-aed0a04e-b022-4912-b1d8-ca3a038d9f54 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf077c7c1794aa5a51d730f2a0c9162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f95065659944050a484f98b738b0f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:28:53.940555 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-aed0a04e-b022-4912-b1d8-ca3a038d9f54 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] 10.222.0.50 "GET /compute/v2.1/servers/bbec5318-32b0-45cd-92d1-155f8a38ab77" status: 200 len: 1372 microversion: 2.1 time: 0.251320 Aug 31 17:28:53.941162 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 4029/7883] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:28:53 2022] GET /compute/v2.1/servers/bbec5318-32b0-45cd-92d1-155f8a38ab77 => generated 1372 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 17:28:54.964294 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-016b98fd-14c6-41a6-b32b-d27a5ed3a59c tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:28:54.964871 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-016b98fd-14c6-41a6-b32b-d27a5ed3a59c tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] [instance: bbec5318-32b0-45cd-92d1-155f8a38ab77] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:28:54.972228 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-016b98fd-14c6-41a6-b32b-d27a5ed3a59c tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:54.972856 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-016b98fd-14c6-41a6-b32b-d27a5ed3a59c tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:54.973304 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-016b98fd-14c6-41a6-b32b-d27a5ed3a59c tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:54.974000 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-016b98fd-14c6-41a6-b32b-d27a5ed3a59c tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:54.974481 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-016b98fd-14c6-41a6-b32b-d27a5ed3a59c tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:54.974912 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-016b98fd-14c6-41a6-b32b-d27a5ed3a59c tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:55.118128 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-016b98fd-14c6-41a6-b32b-d27a5ed3a59c tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf077c7c1794aa5a51d730f2a0c9162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f95065659944050a484f98b738b0f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:28:55.126238 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-016b98fd-14c6-41a6-b32b-d27a5ed3a59c tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] 10.222.0.50 "GET /compute/v2.1/servers/bbec5318-32b0-45cd-92d1-155f8a38ab77" status: 200 len: 1372 microversion: 2.1 time: 0.167824 Aug 31 17:28:55.127084 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3855/7884] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:28:54 2022] GET /compute/v2.1/servers/bbec5318-32b0-45cd-92d1-155f8a38ab77 => generated 1372 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:28:56.147394 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-ff2449e1-4bb4-4a7c-b92c-a6cb1bdae05d tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:28:56.147978 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-ff2449e1-4bb4-4a7c-b92c-a6cb1bdae05d tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] [instance: bbec5318-32b0-45cd-92d1-155f8a38ab77] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:28:56.155448 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ff2449e1-4bb4-4a7c-b92c-a6cb1bdae05d tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:56.155932 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ff2449e1-4bb4-4a7c-b92c-a6cb1bdae05d tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:56.156407 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ff2449e1-4bb4-4a7c-b92c-a6cb1bdae05d tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:56.157122 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ff2449e1-4bb4-4a7c-b92c-a6cb1bdae05d tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:56.157596 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ff2449e1-4bb4-4a7c-b92c-a6cb1bdae05d tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:56.158035 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-ff2449e1-4bb4-4a7c-b92c-a6cb1bdae05d tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:56.306840 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-ff2449e1-4bb4-4a7c-b92c-a6cb1bdae05d tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf077c7c1794aa5a51d730f2a0c9162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f95065659944050a484f98b738b0f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:28:56.315771 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-ff2449e1-4bb4-4a7c-b92c-a6cb1bdae05d tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] 10.222.0.50 "GET /compute/v2.1/servers/bbec5318-32b0-45cd-92d1-155f8a38ab77" status: 200 len: 1372 microversion: 2.1 time: 0.172836 Aug 31 17:28:56.316376 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 4030/7885] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:28:56 2022] GET /compute/v2.1/servers/bbec5318-32b0-45cd-92d1-155f8a38ab77 => generated 1372 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:28:57.178064 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-3eb45d26-44d3-4ddd-b3ad-a4ba1babb140 req-12919e03-ba3d-4974-b587-de427078a83c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbec5318-32b0-45cd-92d1-155f8a38ab77", "name": "network-vif-plugged", "status": "completed", "tag": "9b9edf17-9b80-4f26-8d16-491f25e711cd"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:28:57.192740 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3eb45d26-44d3-4ddd-b3ad-a4ba1babb140 req-12919e03-ba3d-4974-b587-de427078a83c service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:57.193241 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3eb45d26-44d3-4ddd-b3ad-a4ba1babb140 req-12919e03-ba3d-4974-b587-de427078a83c service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:57.193677 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-3eb45d26-44d3-4ddd-b3ad-a4ba1babb140 req-12919e03-ba3d-4974-b587-de427078a83c service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:57.205470 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-3eb45d26-44d3-4ddd-b3ad-a4ba1babb140 req-12919e03-ba3d-4974-b587-de427078a83c service nova] Creating event network-vif-plugged:9b9edf17-9b80-4f26-8d16-491f25e711cd for instance bbec5318-32b0-45cd-92d1-155f8a38ab77 on n-h2-833090-16 Aug 31 17:28:57.211488 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-3eb45d26-44d3-4ddd-b3ad-a4ba1babb140 req-12919e03-ba3d-4974-b587-de427078a83c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039133 Aug 31 17:28:57.212242 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3856/7886] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:28:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:28:57.339988 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-719ab129-dc9d-4488-8b27-877d194959fc tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:28:57.341016 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-719ab129-dc9d-4488-8b27-877d194959fc tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] [instance: bbec5318-32b0-45cd-92d1-155f8a38ab77] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:28:57.351506 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-719ab129-dc9d-4488-8b27-877d194959fc tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:57.352003 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-719ab129-dc9d-4488-8b27-877d194959fc tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:57.352441 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-719ab129-dc9d-4488-8b27-877d194959fc tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:57.353156 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-719ab129-dc9d-4488-8b27-877d194959fc tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:57.353618 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-719ab129-dc9d-4488-8b27-877d194959fc tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:57.354048 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-719ab129-dc9d-4488-8b27-877d194959fc tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:57.542367 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-719ab129-dc9d-4488-8b27-877d194959fc tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf077c7c1794aa5a51d730f2a0c9162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f95065659944050a484f98b738b0f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:28:57.554128 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-719ab129-dc9d-4488-8b27-877d194959fc tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] 10.222.0.50 "GET /compute/v2.1/servers/bbec5318-32b0-45cd-92d1-155f8a38ab77" status: 200 len: 1372 microversion: 2.1 time: 0.220976 Aug 31 17:28:57.554759 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 4031/7887] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:28:57 2022] GET /compute/v2.1/servers/bbec5318-32b0-45cd-92d1-155f8a38ab77 => generated 1372 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:28:58.576454 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e8416646-563f-4748-9248-736ff7ec8282 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:28:58.577051 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e8416646-563f-4748-9248-736ff7ec8282 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] [instance: bbec5318-32b0-45cd-92d1-155f8a38ab77] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:28:58.579252 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:28:58.579909 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:28:58.586977 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8416646-563f-4748-9248-736ff7ec8282 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:58.587457 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8416646-563f-4748-9248-736ff7ec8282 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:58.587884 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8416646-563f-4748-9248-736ff7ec8282 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:58.588584 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8416646-563f-4748-9248-736ff7ec8282 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:58.589012 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8416646-563f-4748-9248-736ff7ec8282 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:58.589426 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e8416646-563f-4748-9248-736ff7ec8282 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:58.736621 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-e8416646-563f-4748-9248-736ff7ec8282 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf077c7c1794aa5a51d730f2a0c9162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f95065659944050a484f98b738b0f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:28:58.744765 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e8416646-563f-4748-9248-736ff7ec8282 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] 10.222.0.50 "GET /compute/v2.1/servers/bbec5318-32b0-45cd-92d1-155f8a38ab77" status: 200 len: 1372 microversion: 2.1 time: 0.172983 Aug 31 17:28:58.745387 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3857/7888] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:28:58 2022] GET /compute/v2.1/servers/bbec5318-32b0-45cd-92d1-155f8a38ab77 => generated 1372 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:28:59.765674 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4b429f7d-6b55-40d1-a2d8-44822073b69c tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:28:59.766361 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4b429f7d-6b55-40d1-a2d8-44822073b69c tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] [instance: bbec5318-32b0-45cd-92d1-155f8a38ab77] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:28:59.768287 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=6 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:28:59.774774 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4b429f7d-6b55-40d1-a2d8-44822073b69c tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:59.775275 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4b429f7d-6b55-40d1-a2d8-44822073b69c tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:59.775727 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4b429f7d-6b55-40d1-a2d8-44822073b69c tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:59.776433 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4b429f7d-6b55-40d1-a2d8-44822073b69c tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:59.776898 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4b429f7d-6b55-40d1-a2d8-44822073b69c tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:59.777336 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4b429f7d-6b55-40d1-a2d8-44822073b69c tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:59.926426 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4b429f7d-6b55-40d1-a2d8-44822073b69c tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf077c7c1794aa5a51d730f2a0c9162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f95065659944050a484f98b738b0f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:28:59.937226 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4b429f7d-6b55-40d1-a2d8-44822073b69c tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] 10.222.0.50 "GET /compute/v2.1/servers/bbec5318-32b0-45cd-92d1-155f8a38ab77" status: 200 len: 1557 microversion: 2.1 time: 0.175591 Aug 31 17:28:59.938401 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 4032/7889] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:28:59 2022] GET /compute/v2.1/servers/bbec5318-32b0-45cd-92d1-155f8a38ab77 => generated 1557 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:28:59.964716 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d657a778-34c9-483d-928f-c956871f6d3b tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:28:59.965369 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d657a778-34c9-483d-928f-c956871f6d3b tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] [instance: bbec5318-32b0-45cd-92d1-155f8a38ab77] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:28:59.972741 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d657a778-34c9-483d-928f-c956871f6d3b tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:59.973233 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d657a778-34c9-483d-928f-c956871f6d3b tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:59.973668 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d657a778-34c9-483d-928f-c956871f6d3b tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:28:59.974398 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d657a778-34c9-483d-928f-c956871f6d3b tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:28:59.974964 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d657a778-34c9-483d-928f-c956871f6d3b tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:28:59.975394 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d657a778-34c9-483d-928f-c956871f6d3b tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:29:00.394504 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d657a778-34c9-483d-928f-c956871f6d3b tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf077c7c1794aa5a51d730f2a0c9162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f95065659944050a484f98b738b0f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:29:00.407921 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d657a778-34c9-483d-928f-c956871f6d3b tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] 10.222.0.50 "GET /compute/v2.1/servers/bbec5318-32b0-45cd-92d1-155f8a38ab77" status: 200 len: 1557 microversion: 2.1 time: 0.446855 Aug 31 17:29:00.408836 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3858/7890] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:28:59 2022] GET /compute/v2.1/servers/bbec5318-32b0-45cd-92d1-155f8a38ab77 => generated 1557 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:29:02.551271 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-12793ead-0795-4cbb-a32d-faff70723f30 req-bc09df2e-2485-49cd-97fd-593fd1aa8064 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbec5318-32b0-45cd-92d1-155f8a38ab77", "tag": "9b9edf17-9b80-4f26-8d16-491f25e711cd"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:29:02.561842 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-12793ead-0795-4cbb-a32d-faff70723f30 req-bc09df2e-2485-49cd-97fd-593fd1aa8064 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:29:02.562729 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-12793ead-0795-4cbb-a32d-faff70723f30 req-bc09df2e-2485-49cd-97fd-593fd1aa8064 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:29:02.563167 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-12793ead-0795-4cbb-a32d-faff70723f30 req-bc09df2e-2485-49cd-97fd-593fd1aa8064 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:29:02.575666 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-12793ead-0795-4cbb-a32d-faff70723f30 req-bc09df2e-2485-49cd-97fd-593fd1aa8064 service nova] Creating event network-changed:9b9edf17-9b80-4f26-8d16-491f25e711cd for instance bbec5318-32b0-45cd-92d1-155f8a38ab77 on n-h2-833090-16 Aug 31 17:29:02.581370 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-12793ead-0795-4cbb-a32d-faff70723f30 req-bc09df2e-2485-49cd-97fd-593fd1aa8064 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033824 Aug 31 17:29:02.582179 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 4033/7891] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:31:39.484738 n-d-833090-16 devstack@n-api.service[128863]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6edb9245-c569-4b8e-9560-fba55d2b56a3] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 31 17:31:39.485642 n-d-833090-16 devstack@n-api.service[128863]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a572ecc8-7c5f-4ee8-b179-c0e5cc05c499] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 31 17:31:39.486235 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:31:39.487046 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=36 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:31:39.488519 n-d-833090-16 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 17:31:39.488746 n-d-833090-16 devstack@n-api.service[128863]: Wed Aug 31 17:31:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bbec5318-32b0-45cd-92d1-155f8a38ab77/action (ip 10.222.0.50) !!! Aug 31 17:31:39.491419 n-d-833090-16 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 17:31:39.491593 n-d-833090-16 devstack@n-api.service[128863]: Wed Aug 31 17:31:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bbec5318-32b0-45cd-92d1-155f8a38ab77/action (ip 10.222.0.50) !!! Aug 31 17:31:39.496812 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-e5e6ed8a-fefe-4486-8b0e-1aabf14f8a97 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1419083547"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:31:39.499113 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-e5e6ed8a-fefe-4486-8b0e-1aabf14f8a97 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] [instance: bbec5318-32b0-45cd-92d1-155f8a38ab77] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:31:39.512501 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e5e6ed8a-fefe-4486-8b0e-1aabf14f8a97 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:31:39.513034 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e5e6ed8a-fefe-4486-8b0e-1aabf14f8a97 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:31:39.513464 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e5e6ed8a-fefe-4486-8b0e-1aabf14f8a97 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:31:39.514199 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e5e6ed8a-fefe-4486-8b0e-1aabf14f8a97 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:31:39.514653 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e5e6ed8a-fefe-4486-8b0e-1aabf14f8a97 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:31:39.515071 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-e5e6ed8a-fefe-4486-8b0e-1aabf14f8a97 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:31:39.876775 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-e5e6ed8a-fefe-4486-8b0e-1aabf14f8a97 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] 10.222.0.50 "POST /compute/v2.1/servers/bbec5318-32b0-45cd-92d1-155f8a38ab77/action" status: 202 len: 0 microversion: 2.1 time: 0.393885 Aug 31 17:31:39.877416 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3859/7892] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 17:31:39 2022] POST /compute/v2.1/servers/bbec5318-32b0-45cd-92d1-155f8a38ab77/action => generated 0 bytes in 395 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 31 17:31:48.138527 n-d-833090-16 devstack@n-api.service[128864]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4f3e0afc-1d0e-4db3-9143-6185c0e157a7] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 17:31:48.139346 n-d-833090-16 devstack@n-api.service[128864]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0684e720-ea0e-4737-a458-87e19068aaad] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 17:31:48.139967 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:31:48.141191 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=38 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:31:48.142648 n-d-833090-16 devstack@n-api.service[128864]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 17:31:48.142787 n-d-833090-16 devstack@n-api.service[128864]: Wed Aug 31 17:31:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.50) !!! Aug 31 17:31:48.145345 n-d-833090-16 devstack@n-api.service[128864]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 31 17:31:48.145476 n-d-833090-16 devstack@n-api.service[128864]: Wed Aug 31 17:31:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.50) !!! Aug 31 17:31:48.221493 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-1231f38a-5447-4ad6-be6d-c523f94e4376 req-b4807cd8-02a7-438f-97f0-642fec22b3ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbec5318-32b0-45cd-92d1-155f8a38ab77", "name": "network-vif-plugged", "status": "completed", "tag": "9b9edf17-9b80-4f26-8d16-491f25e711cd"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:31:48.231881 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-1231f38a-5447-4ad6-be6d-c523f94e4376 req-b4807cd8-02a7-438f-97f0-642fec22b3ca service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:31:48.232357 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-1231f38a-5447-4ad6-be6d-c523f94e4376 req-b4807cd8-02a7-438f-97f0-642fec22b3ca service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:31:48.232788 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-1231f38a-5447-4ad6-be6d-c523f94e4376 req-b4807cd8-02a7-438f-97f0-642fec22b3ca service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:31:48.243297 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-1231f38a-5447-4ad6-be6d-c523f94e4376 req-b4807cd8-02a7-438f-97f0-642fec22b3ca service nova] Creating event network-vif-plugged:9b9edf17-9b80-4f26-8d16-491f25e711cd for instance bbec5318-32b0-45cd-92d1-155f8a38ab77 on n-h2-833090-16 Aug 31 17:31:48.248697 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-1231f38a-5447-4ad6-be6d-c523f94e4376 req-b4807cd8-02a7-438f-97f0-642fec22b3ca service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112131 Aug 31 17:31:48.249390 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 4034/7893] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:31:59.628297 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:31:59.629097 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:31:59.633832 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-b3904ec7-2452-4d55-8937-da20b1c84d45 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1379027894", "imageRef": "02405dd7-b722-4e2e-92a9-9cac343cd773", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1305527331", "security_groups": [{"name": "tempest-secgroup-smoke-224360575"}], "networks": [{"uuid": "0ff334ea-d1d3-4b59-bdcf-8dbc2b5079f7"}]}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:31:59.660506 n-d-833090-16 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] [a572ecc8-7c5f-4ee8-b179-c0e5cc05c499] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 54006. Aug 31 17:31:59.661093 n-d-833090-16 devstack@n-api.service[128863]: INFO oslo.messaging._drivers.impl_rabbit [-] [6edb9245-c569-4b8e-9560-fba55d2b56a3] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 54004. Aug 31 17:31:59.755992 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.network.neutron [None req-b3904ec7-2452-4d55-8937-da20b1c84d45 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] validate_networks() for [('0ff334ea-d1d3-4b59-bdcf-8dbc2b5079f7', None, None, None, None, None)] {{(pid=128863) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 31 17:32:00.244608 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b3904ec7-2452-4d55-8937-da20b1c84d45 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Flavor limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 17:32:00.245315 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b3904ec7-2452-4d55-8937-da20b1c84d45 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Image limits 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 17:32:00.246083 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b3904ec7-2452-4d55-8937-da20b1c84d45 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Flavor pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 17:32:00.246909 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b3904ec7-2452-4d55-8937-da20b1c84d45 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Image pref 0:0:0 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 17:32:00.247537 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.virt.hardware [None req-b3904ec7-2452-4d55-8937-da20b1c84d45 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128863) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 17:32:00.257807 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3904ec7-2452-4d55-8937-da20b1c84d45 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:00.258348 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3904ec7-2452-4d55-8937-da20b1c84d45 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:00.258786 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3904ec7-2452-4d55-8937-da20b1c84d45 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:00.259515 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3904ec7-2452-4d55-8937-da20b1c84d45 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:00.259977 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3904ec7-2452-4d55-8937-da20b1c84d45 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:00.260405 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-b3904ec7-2452-4d55-8937-da20b1c84d45 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:00.278572 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-b3904ec7-2452-4d55-8937-da20b1c84d45 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Getting quotas for project 4f95065659944050a484f98b738b0f2b. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 31 17:32:00.284163 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.quota [None req-b3904ec7-2452-4d55-8937-da20b1c84d45 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Getting quotas for user 0cf077c7c1794aa5a51d730f2a0c9162 and project 4f95065659944050a484f98b738b0f2b. Resources: {'instances', 'cores', 'ram'} {{(pid=128863) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 31 17:32:00.297025 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b3904ec7-2452-4d55-8937-da20b1c84d45 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Going to run 1 instances... {{(pid=128863) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 31 17:32:00.299605 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-b3904ec7-2452-4d55-8937-da20b1c84d45 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] [instance: 58e28c4e-7356-462d-af7f-9862c5c86b43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='02405dd7-b722-4e2e-92a9-9cac343cd773',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128863) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 31 17:32:00.358086 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-b3904ec7-2452-4d55-8937-da20b1c84d45 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.731842 Aug 31 17:32:00.359576 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3860/7894] 10.222.0.50 () {60 vars in 1147 bytes} [Wed Aug 31 17:31:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 17:32:00.370803 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-debac166-6b4e-49d6-9861-907e9d78fc61 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:32:00.371519 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-debac166-6b4e-49d6-9861-907e9d78fc61 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] [instance: 58e28c4e-7356-462d-af7f-9862c5c86b43] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:32:00.377470 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:32:00.378751 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:32:00.393753 n-d-833090-16 devstack@n-api.service[128864]: INFO oslo.messaging._drivers.impl_rabbit [-] [0684e720-ea0e-4737-a458-87e19068aaad] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 54022. Aug 31 17:32:00.403541 n-d-833090-16 devstack@n-api.service[128864]: INFO oslo.messaging._drivers.impl_rabbit [-] [4f3e0afc-1d0e-4db3-9143-6185c0e157a7] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 54020. Aug 31 17:32:00.507400 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-debac166-6b4e-49d6-9861-907e9d78fc61 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf077c7c1794aa5a51d730f2a0c9162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f95065659944050a484f98b738b0f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:32:00.515632 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-debac166-6b4e-49d6-9861-907e9d78fc61 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] 10.222.0.50 "GET /compute/v2.1/servers/58e28c4e-7356-462d-af7f-9862c5c86b43" status: 200 len: 1249 microversion: 2.1 time: 0.149434 Aug 31 17:32:00.516214 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 4035/7895] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:32:00 2022] GET /compute/v2.1/servers/58e28c4e-7356-462d-af7f-9862c5c86b43 => generated 1249 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:32:01.536525 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2e2e2b37-df2e-4e91-936b-926038626540 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:32:01.537076 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2e2e2b37-df2e-4e91-936b-926038626540 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] [instance: 58e28c4e-7356-462d-af7f-9862c5c86b43] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:32:01.544536 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e2e2b37-df2e-4e91-936b-926038626540 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:01.545085 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e2e2b37-df2e-4e91-936b-926038626540 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:01.545523 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e2e2b37-df2e-4e91-936b-926038626540 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:01.546270 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e2e2b37-df2e-4e91-936b-926038626540 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:01.546794 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e2e2b37-df2e-4e91-936b-926038626540 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:01.547255 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2e2e2b37-df2e-4e91-936b-926038626540 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:01.628633 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2e2e2b37-df2e-4e91-936b-926038626540 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf077c7c1794aa5a51d730f2a0c9162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f95065659944050a484f98b738b0f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:32:01.637792 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2e2e2b37-df2e-4e91-936b-926038626540 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] 10.222.0.50 "GET /compute/v2.1/servers/58e28c4e-7356-462d-af7f-9862c5c86b43" status: 200 len: 1309 microversion: 2.1 time: 0.105231 Aug 31 17:32:01.638760 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3861/7896] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:32:01 2022] GET /compute/v2.1/servers/58e28c4e-7356-462d-af7f-9862c5c86b43 => generated 1309 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:32:02.659775 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-f8f3923d-ed79-4035-83ee-06ef0ff44c66 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:32:02.661378 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-f8f3923d-ed79-4035-83ee-06ef0ff44c66 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] [instance: 58e28c4e-7356-462d-af7f-9862c5c86b43] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:32:02.670678 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f8f3923d-ed79-4035-83ee-06ef0ff44c66 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:02.672131 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f8f3923d-ed79-4035-83ee-06ef0ff44c66 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:02.674545 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f8f3923d-ed79-4035-83ee-06ef0ff44c66 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:02.677200 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f8f3923d-ed79-4035-83ee-06ef0ff44c66 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:02.687371 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f8f3923d-ed79-4035-83ee-06ef0ff44c66 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:02.688122 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-f8f3923d-ed79-4035-83ee-06ef0ff44c66 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:02.873195 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-f8f3923d-ed79-4035-83ee-06ef0ff44c66 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf077c7c1794aa5a51d730f2a0c9162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f95065659944050a484f98b738b0f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:32:02.882626 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-f8f3923d-ed79-4035-83ee-06ef0ff44c66 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] 10.222.0.50 "GET /compute/v2.1/servers/58e28c4e-7356-462d-af7f-9862c5c86b43" status: 200 len: 1374 microversion: 2.1 time: 0.227229 Aug 31 17:32:02.897576 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 4036/7897] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:32:02 2022] GET /compute/v2.1/servers/58e28c4e-7356-462d-af7f-9862c5c86b43 => generated 1374 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:32:03.905786 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-ecd08cac-3616-4a92-8784-756206b0a817 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:32:03.906585 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-ecd08cac-3616-4a92-8784-756206b0a817 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] [instance: 58e28c4e-7356-462d-af7f-9862c5c86b43] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:32:03.914151 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ecd08cac-3616-4a92-8784-756206b0a817 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:03.914672 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ecd08cac-3616-4a92-8784-756206b0a817 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:03.915130 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ecd08cac-3616-4a92-8784-756206b0a817 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:03.915843 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ecd08cac-3616-4a92-8784-756206b0a817 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:03.916324 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ecd08cac-3616-4a92-8784-756206b0a817 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:03.916753 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-ecd08cac-3616-4a92-8784-756206b0a817 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:04.067279 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-ecd08cac-3616-4a92-8784-756206b0a817 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf077c7c1794aa5a51d730f2a0c9162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f95065659944050a484f98b738b0f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:32:04.081598 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-ecd08cac-3616-4a92-8784-756206b0a817 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] 10.222.0.50 "GET /compute/v2.1/servers/58e28c4e-7356-462d-af7f-9862c5c86b43" status: 200 len: 1374 microversion: 2.1 time: 0.180336 Aug 31 17:32:04.083008 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3862/7898] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:32:03 2022] GET /compute/v2.1/servers/58e28c4e-7356-462d-af7f-9862c5c86b43 => generated 1374 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:32:04.197714 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-99a91351-57c2-4f60-a7fa-aa16f6ad84c8 req-2727c265-a2ca-4a82-9662-0dec79c19613 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbec5318-32b0-45cd-92d1-155f8a38ab77", "name": "network-vif-unplugged", "status": "completed", "tag": "9b9edf17-9b80-4f26-8d16-491f25e711cd"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:32:04.214058 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-99a91351-57c2-4f60-a7fa-aa16f6ad84c8 req-2727c265-a2ca-4a82-9662-0dec79c19613 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:04.215371 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-99a91351-57c2-4f60-a7fa-aa16f6ad84c8 req-2727c265-a2ca-4a82-9662-0dec79c19613 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:04.216054 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-99a91351-57c2-4f60-a7fa-aa16f6ad84c8 req-2727c265-a2ca-4a82-9662-0dec79c19613 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:04.229661 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-99a91351-57c2-4f60-a7fa-aa16f6ad84c8 req-2727c265-a2ca-4a82-9662-0dec79c19613 service nova] Creating event network-vif-unplugged:9b9edf17-9b80-4f26-8d16-491f25e711cd for instance bbec5318-32b0-45cd-92d1-155f8a38ab77 on n-h2-833090-16 Aug 31 17:32:04.235875 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-99a91351-57c2-4f60-a7fa-aa16f6ad84c8 req-2727c265-a2ca-4a82-9662-0dec79c19613 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042061 Aug 31 17:32:04.238749 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 4037/7899] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:32:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:32:05.105093 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2b2a3d9a-bb48-4acf-8994-bfbf6740d464 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:32:05.106552 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2b2a3d9a-bb48-4acf-8994-bfbf6740d464 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] [instance: 58e28c4e-7356-462d-af7f-9862c5c86b43] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:32:05.115120 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2b2a3d9a-bb48-4acf-8994-bfbf6740d464 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:05.115989 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2b2a3d9a-bb48-4acf-8994-bfbf6740d464 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:05.116669 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2b2a3d9a-bb48-4acf-8994-bfbf6740d464 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:05.117617 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2b2a3d9a-bb48-4acf-8994-bfbf6740d464 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:05.118407 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2b2a3d9a-bb48-4acf-8994-bfbf6740d464 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:05.119128 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2b2a3d9a-bb48-4acf-8994-bfbf6740d464 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:05.276514 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2b2a3d9a-bb48-4acf-8994-bfbf6740d464 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf077c7c1794aa5a51d730f2a0c9162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f95065659944050a484f98b738b0f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:32:05.285702 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2b2a3d9a-bb48-4acf-8994-bfbf6740d464 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] 10.222.0.50 "GET /compute/v2.1/servers/58e28c4e-7356-462d-af7f-9862c5c86b43" status: 200 len: 1374 microversion: 2.1 time: 0.184481 Aug 31 17:32:05.286336 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3863/7900] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:32:05 2022] GET /compute/v2.1/servers/58e28c4e-7356-462d-af7f-9862c5c86b43 => generated 1374 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:32:06.308154 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-a38eb5b3-fcda-460d-bee7-c3545d62641a tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:32:06.309241 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-a38eb5b3-fcda-460d-bee7-c3545d62641a tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] [instance: 58e28c4e-7356-462d-af7f-9862c5c86b43] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:32:06.318724 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a38eb5b3-fcda-460d-bee7-c3545d62641a tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:06.318848 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a38eb5b3-fcda-460d-bee7-c3545d62641a tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:06.319250 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a38eb5b3-fcda-460d-bee7-c3545d62641a tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:06.320005 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a38eb5b3-fcda-460d-bee7-c3545d62641a tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:06.320449 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a38eb5b3-fcda-460d-bee7-c3545d62641a tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:06.320942 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-a38eb5b3-fcda-460d-bee7-c3545d62641a tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:06.768488 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-a38eb5b3-fcda-460d-bee7-c3545d62641a tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf077c7c1794aa5a51d730f2a0c9162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f95065659944050a484f98b738b0f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:32:06.776685 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-a38eb5b3-fcda-460d-bee7-c3545d62641a tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] 10.222.0.50 "GET /compute/v2.1/servers/58e28c4e-7356-462d-af7f-9862c5c86b43" status: 200 len: 1374 microversion: 2.1 time: 0.473375 Aug 31 17:32:06.777500 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 4038/7901] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:32:06 2022] GET /compute/v2.1/servers/58e28c4e-7356-462d-af7f-9862c5c86b43 => generated 1374 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:32:07.798380 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-c0f49b12-d793-4e4f-8438-cb2851b6df6c tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:32:07.799061 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-c0f49b12-d793-4e4f-8438-cb2851b6df6c tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] [instance: 58e28c4e-7356-462d-af7f-9862c5c86b43] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:32:07.806711 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0f49b12-d793-4e4f-8438-cb2851b6df6c tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:07.807198 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0f49b12-d793-4e4f-8438-cb2851b6df6c tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:07.807636 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0f49b12-d793-4e4f-8438-cb2851b6df6c tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:07.808712 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0f49b12-d793-4e4f-8438-cb2851b6df6c tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:07.809166 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0f49b12-d793-4e4f-8438-cb2851b6df6c tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:07.809604 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-c0f49b12-d793-4e4f-8438-cb2851b6df6c tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:07.955896 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-c0f49b12-d793-4e4f-8438-cb2851b6df6c tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf077c7c1794aa5a51d730f2a0c9162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f95065659944050a484f98b738b0f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:32:07.964481 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-c0f49b12-d793-4e4f-8438-cb2851b6df6c tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] 10.222.0.50 "GET /compute/v2.1/servers/58e28c4e-7356-462d-af7f-9862c5c86b43" status: 200 len: 1374 microversion: 2.1 time: 0.170574 Aug 31 17:32:07.965173 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3864/7902] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:32:07 2022] GET /compute/v2.1/servers/58e28c4e-7356-462d-af7f-9862c5c86b43 => generated 1374 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:32:08.987994 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-8544acd1-c32d-455f-8624-bb1d7d411086 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:32:08.989029 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-8544acd1-c32d-455f-8624-bb1d7d411086 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] [instance: 58e28c4e-7356-462d-af7f-9862c5c86b43] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:32:08.996286 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8544acd1-c32d-455f-8624-bb1d7d411086 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:08.996798 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8544acd1-c32d-455f-8624-bb1d7d411086 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:08.997422 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8544acd1-c32d-455f-8624-bb1d7d411086 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:08.999122 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8544acd1-c32d-455f-8624-bb1d7d411086 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:08.999620 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8544acd1-c32d-455f-8624-bb1d7d411086 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:09.000055 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-8544acd1-c32d-455f-8624-bb1d7d411086 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:09.185095 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-8544acd1-c32d-455f-8624-bb1d7d411086 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf077c7c1794aa5a51d730f2a0c9162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f95065659944050a484f98b738b0f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:32:09.193554 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-8544acd1-c32d-455f-8624-bb1d7d411086 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] 10.222.0.50 "GET /compute/v2.1/servers/58e28c4e-7356-462d-af7f-9862c5c86b43" status: 200 len: 1374 microversion: 2.1 time: 0.209900 Aug 31 17:32:09.194256 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 4039/7903] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:32:08 2022] GET /compute/v2.1/servers/58e28c4e-7356-462d-af7f-9862c5c86b43 => generated 1374 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:32:10.218159 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-d89131a2-6f8f-402a-a524-287669c41159 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:32:10.218771 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-d89131a2-6f8f-402a-a524-287669c41159 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] [instance: 58e28c4e-7356-462d-af7f-9862c5c86b43] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:32:10.228721 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d89131a2-6f8f-402a-a524-287669c41159 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:10.229417 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d89131a2-6f8f-402a-a524-287669c41159 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:10.230196 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d89131a2-6f8f-402a-a524-287669c41159 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:10.231283 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d89131a2-6f8f-402a-a524-287669c41159 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:10.232046 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d89131a2-6f8f-402a-a524-287669c41159 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:10.232600 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-d89131a2-6f8f-402a-a524-287669c41159 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:10.268288 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:32:10.290741 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell0:SELECT=6 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:32:10.373637 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-d89131a2-6f8f-402a-a524-287669c41159 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf077c7c1794aa5a51d730f2a0c9162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f95065659944050a484f98b738b0f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:32:10.381610 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-d89131a2-6f8f-402a-a524-287669c41159 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] 10.222.0.50 "GET /compute/v2.1/servers/58e28c4e-7356-462d-af7f-9862c5c86b43" status: 200 len: 1374 microversion: 2.1 time: 0.169407 Aug 31 17:32:10.382403 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3865/7904] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:32:10 2022] GET /compute/v2.1/servers/58e28c4e-7356-462d-af7f-9862c5c86b43 => generated 1374 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:32:10.500878 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-8bb8366f-89b7-4281-b2cc-40869b2de43e req-b0f5956a-0623-4f8d-96e8-82ec7bfb10c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58e28c4e-7356-462d-af7f-9862c5c86b43", "tag": "43bdcfa7-75d7-4c3c-972b-c983f6a01b8e"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:32:10.511898 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-8bb8366f-89b7-4281-b2cc-40869b2de43e req-b0f5956a-0623-4f8d-96e8-82ec7bfb10c8 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:10.512383 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-8bb8366f-89b7-4281-b2cc-40869b2de43e req-b0f5956a-0623-4f8d-96e8-82ec7bfb10c8 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:10.512817 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-8bb8366f-89b7-4281-b2cc-40869b2de43e req-b0f5956a-0623-4f8d-96e8-82ec7bfb10c8 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:10.515746 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell0:SELECT=2 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:32:10.525690 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-8bb8366f-89b7-4281-b2cc-40869b2de43e req-b0f5956a-0623-4f8d-96e8-82ec7bfb10c8 service nova] Creating event network-changed:43bdcfa7-75d7-4c3c-972b-c983f6a01b8e for instance 58e28c4e-7356-462d-af7f-9862c5c86b43 on n-h1-833090-16 Aug 31 17:32:10.531542 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-8bb8366f-89b7-4281-b2cc-40869b2de43e req-b0f5956a-0623-4f8d-96e8-82ec7bfb10c8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096600 Aug 31 17:32:10.532789 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 4040/7905] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:32:11.403842 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-fefeb335-e55f-4213-aa0d-a89444feb74b tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:32:11.404441 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-fefeb335-e55f-4213-aa0d-a89444feb74b tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] [instance: 58e28c4e-7356-462d-af7f-9862c5c86b43] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:32:11.412023 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fefeb335-e55f-4213-aa0d-a89444feb74b tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:11.412521 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fefeb335-e55f-4213-aa0d-a89444feb74b tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:11.412967 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fefeb335-e55f-4213-aa0d-a89444feb74b tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:11.413686 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fefeb335-e55f-4213-aa0d-a89444feb74b tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:11.414150 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fefeb335-e55f-4213-aa0d-a89444feb74b tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:11.414608 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-fefeb335-e55f-4213-aa0d-a89444feb74b tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:11.554617 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-fefeb335-e55f-4213-aa0d-a89444feb74b tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf077c7c1794aa5a51d730f2a0c9162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f95065659944050a484f98b738b0f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:32:11.566421 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-fefeb335-e55f-4213-aa0d-a89444feb74b tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] 10.222.0.50 "GET /compute/v2.1/servers/58e28c4e-7356-462d-af7f-9862c5c86b43" status: 200 len: 1374 microversion: 2.1 time: 0.166653 Aug 31 17:32:11.567018 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3866/7906] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:32:11 2022] GET /compute/v2.1/servers/58e28c4e-7356-462d-af7f-9862c5c86b43 => generated 1374 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:32:12.589203 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-4654d71e-cb96-48ff-8e9d-b698e25d7abe tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:32:12.589926 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-4654d71e-cb96-48ff-8e9d-b698e25d7abe tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] [instance: 58e28c4e-7356-462d-af7f-9862c5c86b43] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:32:12.597093 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4654d71e-cb96-48ff-8e9d-b698e25d7abe tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:12.597604 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4654d71e-cb96-48ff-8e9d-b698e25d7abe tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:12.598052 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4654d71e-cb96-48ff-8e9d-b698e25d7abe tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:12.598792 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4654d71e-cb96-48ff-8e9d-b698e25d7abe tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:12.599260 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4654d71e-cb96-48ff-8e9d-b698e25d7abe tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:12.599695 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-4654d71e-cb96-48ff-8e9d-b698e25d7abe tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:12.745277 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-4654d71e-cb96-48ff-8e9d-b698e25d7abe tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf077c7c1794aa5a51d730f2a0c9162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f95065659944050a484f98b738b0f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:32:12.754320 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-4654d71e-cb96-48ff-8e9d-b698e25d7abe tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] 10.222.0.50 "GET /compute/v2.1/servers/58e28c4e-7356-462d-af7f-9862c5c86b43" status: 200 len: 1374 microversion: 2.1 time: 0.170282 Aug 31 17:32:12.754872 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 4041/7907] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:32:12 2022] GET /compute/v2.1/servers/58e28c4e-7356-462d-af7f-9862c5c86b43 => generated 1374 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:32:13.777316 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-2bbaa7b0-2b99-4f2a-924c-450b5ff06583 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:32:13.778048 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-2bbaa7b0-2b99-4f2a-924c-450b5ff06583 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] [instance: 58e28c4e-7356-462d-af7f-9862c5c86b43] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:32:13.786234 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2bbaa7b0-2b99-4f2a-924c-450b5ff06583 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:13.786734 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2bbaa7b0-2b99-4f2a-924c-450b5ff06583 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:13.787166 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2bbaa7b0-2b99-4f2a-924c-450b5ff06583 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:13.787883 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2bbaa7b0-2b99-4f2a-924c-450b5ff06583 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:13.788338 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2bbaa7b0-2b99-4f2a-924c-450b5ff06583 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:13.788796 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-2bbaa7b0-2b99-4f2a-924c-450b5ff06583 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:13.930050 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-2bbaa7b0-2b99-4f2a-924c-450b5ff06583 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf077c7c1794aa5a51d730f2a0c9162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f95065659944050a484f98b738b0f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:32:13.941205 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-2bbaa7b0-2b99-4f2a-924c-450b5ff06583 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] 10.222.0.50 "GET /compute/v2.1/servers/58e28c4e-7356-462d-af7f-9862c5c86b43" status: 200 len: 1374 microversion: 2.1 time: 0.168533 Aug 31 17:32:13.941795 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3867/7908] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:32:13 2022] GET /compute/v2.1/servers/58e28c4e-7356-462d-af7f-9862c5c86b43 => generated 1374 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:32:14.963721 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-b33e4c40-7a7c-4a8a-a4ac-dd612cd84269 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:32:14.964386 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-b33e4c40-7a7c-4a8a-a4ac-dd612cd84269 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] [instance: 58e28c4e-7356-462d-af7f-9862c5c86b43] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:32:14.972172 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b33e4c40-7a7c-4a8a-a4ac-dd612cd84269 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:14.972664 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b33e4c40-7a7c-4a8a-a4ac-dd612cd84269 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:14.973107 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b33e4c40-7a7c-4a8a-a4ac-dd612cd84269 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:14.973810 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b33e4c40-7a7c-4a8a-a4ac-dd612cd84269 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:14.974327 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b33e4c40-7a7c-4a8a-a4ac-dd612cd84269 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:14.974760 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-b33e4c40-7a7c-4a8a-a4ac-dd612cd84269 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:15.121614 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-b33e4c40-7a7c-4a8a-a4ac-dd612cd84269 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf077c7c1794aa5a51d730f2a0c9162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f95065659944050a484f98b738b0f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:32:15.130254 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-b33e4c40-7a7c-4a8a-a4ac-dd612cd84269 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] 10.222.0.50 "GET /compute/v2.1/servers/58e28c4e-7356-462d-af7f-9862c5c86b43" status: 200 len: 1374 microversion: 2.1 time: 0.170676 Aug 31 17:32:15.130853 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 4042/7909] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:32:14 2022] GET /compute/v2.1/servers/58e28c4e-7356-462d-af7f-9862c5c86b43 => generated 1374 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:32:16.155834 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-8515659d-b283-45e3-82f8-97657c5236bd tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:32:16.156775 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-8515659d-b283-45e3-82f8-97657c5236bd tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] [instance: 58e28c4e-7356-462d-af7f-9862c5c86b43] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:32:16.168650 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8515659d-b283-45e3-82f8-97657c5236bd tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:16.169539 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8515659d-b283-45e3-82f8-97657c5236bd tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:16.169999 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8515659d-b283-45e3-82f8-97657c5236bd tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:16.170726 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8515659d-b283-45e3-82f8-97657c5236bd tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:16.171182 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8515659d-b283-45e3-82f8-97657c5236bd tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:16.171569 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-8515659d-b283-45e3-82f8-97657c5236bd tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:16.319423 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-8515659d-b283-45e3-82f8-97657c5236bd tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf077c7c1794aa5a51d730f2a0c9162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f95065659944050a484f98b738b0f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:32:16.328100 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-8515659d-b283-45e3-82f8-97657c5236bd tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] 10.222.0.50 "GET /compute/v2.1/servers/58e28c4e-7356-462d-af7f-9862c5c86b43" status: 200 len: 1374 microversion: 2.1 time: 0.179002 Aug 31 17:32:16.328895 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3868/7910] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:32:16 2022] GET /compute/v2.1/servers/58e28c4e-7356-462d-af7f-9862c5c86b43 => generated 1374 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:32:17.349439 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-c91c5764-5952-4da9-b613-7c3f68d00a83 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:32:17.350078 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-c91c5764-5952-4da9-b613-7c3f68d00a83 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] [instance: 58e28c4e-7356-462d-af7f-9862c5c86b43] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:32:17.357562 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c91c5764-5952-4da9-b613-7c3f68d00a83 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:17.358400 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c91c5764-5952-4da9-b613-7c3f68d00a83 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:17.358553 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c91c5764-5952-4da9-b613-7c3f68d00a83 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:17.359282 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c91c5764-5952-4da9-b613-7c3f68d00a83 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:17.359755 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c91c5764-5952-4da9-b613-7c3f68d00a83 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:17.360196 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-c91c5764-5952-4da9-b613-7c3f68d00a83 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:17.385711 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-32930c49-47a7-4da1-b67b-314a3c7ba074 req-23580639-4d0a-47f3-8334-46cb5f12d7c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58e28c4e-7356-462d-af7f-9862c5c86b43", "name": "network-vif-plugged", "status": "completed", "tag": "43bdcfa7-75d7-4c3c-972b-c983f6a01b8e"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:32:17.397868 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-32930c49-47a7-4da1-b67b-314a3c7ba074 req-23580639-4d0a-47f3-8334-46cb5f12d7c3 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:17.398379 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-32930c49-47a7-4da1-b67b-314a3c7ba074 req-23580639-4d0a-47f3-8334-46cb5f12d7c3 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:17.398806 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-32930c49-47a7-4da1-b67b-314a3c7ba074 req-23580639-4d0a-47f3-8334-46cb5f12d7c3 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:17.416371 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-32930c49-47a7-4da1-b67b-314a3c7ba074 req-23580639-4d0a-47f3-8334-46cb5f12d7c3 service nova] Creating event network-vif-plugged:43bdcfa7-75d7-4c3c-972b-c983f6a01b8e for instance 58e28c4e-7356-462d-af7f-9862c5c86b43 on n-h1-833090-16 Aug 31 17:32:17.421814 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-32930c49-47a7-4da1-b67b-314a3c7ba074 req-23580639-4d0a-47f3-8334-46cb5f12d7c3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039814 Aug 31 17:32:17.423024 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3869/7911] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:32:17.512500 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-c91c5764-5952-4da9-b613-7c3f68d00a83 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf077c7c1794aa5a51d730f2a0c9162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f95065659944050a484f98b738b0f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:32:17.520585 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-c91c5764-5952-4da9-b613-7c3f68d00a83 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] 10.222.0.50 "GET /compute/v2.1/servers/58e28c4e-7356-462d-af7f-9862c5c86b43" status: 200 len: 1374 microversion: 2.1 time: 0.175169 Aug 31 17:32:17.521173 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 4043/7912] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:32:17 2022] GET /compute/v2.1/servers/58e28c4e-7356-462d-af7f-9862c5c86b43 => generated 1374 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:32:18.543027 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-605be403-3707-468e-9e68-559feea268e9 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:32:18.543715 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-605be403-3707-468e-9e68-559feea268e9 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] [instance: 58e28c4e-7356-462d-af7f-9862c5c86b43] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:32:18.551471 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-605be403-3707-468e-9e68-559feea268e9 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:18.551963 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-605be403-3707-468e-9e68-559feea268e9 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:18.552399 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-605be403-3707-468e-9e68-559feea268e9 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:18.553104 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-605be403-3707-468e-9e68-559feea268e9 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:18.553557 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-605be403-3707-468e-9e68-559feea268e9 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:18.553985 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-605be403-3707-468e-9e68-559feea268e9 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:18.715006 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-605be403-3707-468e-9e68-559feea268e9 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf077c7c1794aa5a51d730f2a0c9162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f95065659944050a484f98b738b0f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:32:18.723194 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-605be403-3707-468e-9e68-559feea268e9 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] 10.222.0.50 "GET /compute/v2.1/servers/58e28c4e-7356-462d-af7f-9862c5c86b43" status: 200 len: 1374 microversion: 2.1 time: 0.185541 Aug 31 17:32:18.723774 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3870/7913] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:32:18 2022] GET /compute/v2.1/servers/58e28c4e-7356-462d-af7f-9862c5c86b43 => generated 1374 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:32:19.746698 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-075c0174-9d17-4528-a8c5-8c1dbf0193f8 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:32:19.747381 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-075c0174-9d17-4528-a8c5-8c1dbf0193f8 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] [instance: 58e28c4e-7356-462d-af7f-9862c5c86b43] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:32:19.756418 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-075c0174-9d17-4528-a8c5-8c1dbf0193f8 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:19.756926 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-075c0174-9d17-4528-a8c5-8c1dbf0193f8 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:19.757373 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-075c0174-9d17-4528-a8c5-8c1dbf0193f8 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:19.758128 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-075c0174-9d17-4528-a8c5-8c1dbf0193f8 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:19.758576 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-075c0174-9d17-4528-a8c5-8c1dbf0193f8 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:19.759034 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-075c0174-9d17-4528-a8c5-8c1dbf0193f8 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:19.902736 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-075c0174-9d17-4528-a8c5-8c1dbf0193f8 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf077c7c1794aa5a51d730f2a0c9162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f95065659944050a484f98b738b0f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:32:19.916015 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-075c0174-9d17-4528-a8c5-8c1dbf0193f8 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] 10.222.0.50 "GET /compute/v2.1/servers/58e28c4e-7356-462d-af7f-9862c5c86b43" status: 200 len: 1559 microversion: 2.1 time: 0.174196 Aug 31 17:32:19.916853 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 4044/7914] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:32:19 2022] GET /compute/v2.1/servers/58e28c4e-7356-462d-af7f-9862c5c86b43 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:32:19.940138 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-715ddd84-d089-4396-94ea-4577ff7a62ee tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:32:19.940928 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-715ddd84-d089-4396-94ea-4577ff7a62ee tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] [instance: 58e28c4e-7356-462d-af7f-9862c5c86b43] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:32:19.948387 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-715ddd84-d089-4396-94ea-4577ff7a62ee tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:19.948871 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-715ddd84-d089-4396-94ea-4577ff7a62ee tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:19.949301 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-715ddd84-d089-4396-94ea-4577ff7a62ee tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:19.949984 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-715ddd84-d089-4396-94ea-4577ff7a62ee tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:19.950646 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-715ddd84-d089-4396-94ea-4577ff7a62ee tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:19.951096 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-715ddd84-d089-4396-94ea-4577ff7a62ee tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:20.106756 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-715ddd84-d089-4396-94ea-4577ff7a62ee tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf077c7c1794aa5a51d730f2a0c9162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f95065659944050a484f98b738b0f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:32:20.116195 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-715ddd84-d089-4396-94ea-4577ff7a62ee tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] 10.222.0.50 "GET /compute/v2.1/servers/58e28c4e-7356-462d-af7f-9862c5c86b43" status: 200 len: 1559 microversion: 2.1 time: 0.180162 Aug 31 17:32:20.116782 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3871/7915] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:32:19 2022] GET /compute/v2.1/servers/58e28c4e-7356-462d-af7f-9862c5c86b43 => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:32:22.220665 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-739079d4-f9b4-40ea-8de4-27d381c0ee93 req-bf03a59c-7df6-4a75-8da8-58325600c268 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58e28c4e-7356-462d-af7f-9862c5c86b43", "tag": "43bdcfa7-75d7-4c3c-972b-c983f6a01b8e"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:32:22.230469 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-739079d4-f9b4-40ea-8de4-27d381c0ee93 req-bf03a59c-7df6-4a75-8da8-58325600c268 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:32:22.231036 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-739079d4-f9b4-40ea-8de4-27d381c0ee93 req-bf03a59c-7df6-4a75-8da8-58325600c268 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:32:22.231692 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-739079d4-f9b4-40ea-8de4-27d381c0ee93 req-bf03a59c-7df6-4a75-8da8-58325600c268 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:32:22.246417 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-739079d4-f9b4-40ea-8de4-27d381c0ee93 req-bf03a59c-7df6-4a75-8da8-58325600c268 service nova] Creating event network-changed:43bdcfa7-75d7-4c3c-972b-c983f6a01b8e for instance 58e28c4e-7356-462d-af7f-9862c5c86b43 on n-h1-833090-16 Aug 31 17:32:22.252042 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-739079d4-f9b4-40ea-8de4-27d381c0ee93 req-bf03a59c-7df6-4a75-8da8-58325600c268 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092138 Aug 31 17:32:22.252690 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 4045/7916] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:32:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:34:00.927947 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:34:00.928726 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=64 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:34:00.991439 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-cbdb1869-3951-4e12-8734-95c6c8a2e602 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-128682323"}} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:34:00.994324 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-cbdb1869-3951-4e12-8734-95c6c8a2e602 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] [instance: 58e28c4e-7356-462d-af7f-9862c5c86b43] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:34:01.001035 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbdb1869-3951-4e12-8734-95c6c8a2e602 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:34:01.001525 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbdb1869-3951-4e12-8734-95c6c8a2e602 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:34:01.001963 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbdb1869-3951-4e12-8734-95c6c8a2e602 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:34:01.002696 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbdb1869-3951-4e12-8734-95c6c8a2e602 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:34:01.003148 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbdb1869-3951-4e12-8734-95c6c8a2e602 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:34:01.003569 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-cbdb1869-3951-4e12-8734-95c6c8a2e602 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:34:01.218781 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-cbdb1869-3951-4e12-8734-95c6c8a2e602 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] 10.222.0.50 "POST /compute/v2.1/servers/58e28c4e-7356-462d-af7f-9862c5c86b43/action" status: 202 len: 0 microversion: 2.1 time: 0.293164 Aug 31 17:34:01.219336 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3872/7917] 10.222.0.50 () {60 vars in 1278 bytes} [Wed Aug 31 17:34:00 2022] POST /compute/v2.1/servers/58e28c4e-7356-462d-af7f-9862c5c86b43/action => generated 0 bytes in 295 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 31 17:34:07.941191 n-d-833090-16 devstack@n-api.service[128864]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0684e720-ea0e-4737-a458-87e19068aaad] AMQP server on 10.222.0.50:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 31 17:34:07.943466 n-d-833090-16 devstack@n-api.service[128864]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4f3e0afc-1d0e-4db3-9143-6185c0e157a7] AMQP server on 10.222.0.50:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 31 17:34:07.944155 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_api:SELECT=24 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:34:07.945896 n-d-833090-16 devstack@n-api.service[128864]: DEBUG dbcounter [-] [128864] Writing DB stats nova_cell1:SELECT=48 {{(pid=128864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:34:07.956802 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-adca3a79-ae08-4da9-ac36-d7473cb21cc1 req-54e6779d-c1f2-44e2-b16a-419ddacb6e1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58e28c4e-7356-462d-af7f-9862c5c86b43", "name": "network-vif-plugged", "status": "completed", "tag": "43bdcfa7-75d7-4c3c-972b-c983f6a01b8e"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:34:07.970234 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-adca3a79-ae08-4da9-ac36-d7473cb21cc1 req-54e6779d-c1f2-44e2-b16a-419ddacb6e1e service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:34:07.973189 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-adca3a79-ae08-4da9-ac36-d7473cb21cc1 req-54e6779d-c1f2-44e2-b16a-419ddacb6e1e service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:34:07.973894 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-adca3a79-ae08-4da9-ac36-d7473cb21cc1 req-54e6779d-c1f2-44e2-b16a-419ddacb6e1e service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:34:07.987018 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-adca3a79-ae08-4da9-ac36-d7473cb21cc1 req-54e6779d-c1f2-44e2-b16a-419ddacb6e1e service nova] Creating event network-vif-plugged:43bdcfa7-75d7-4c3c-972b-c983f6a01b8e for instance 58e28c4e-7356-462d-af7f-9862c5c86b43 on n-h1-833090-16 Aug 31 17:34:07.996708 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-adca3a79-ae08-4da9-ac36-d7473cb21cc1 req-54e6779d-c1f2-44e2-b16a-419ddacb6e1e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059176 Aug 31 17:34:07.998201 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 4046/7918] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:34:16.046614 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-edf1c94b-6f04-4c98-abe2-9da7492da6d2 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:34:16.047281 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-edf1c94b-6f04-4c98-abe2-9da7492da6d2 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] [instance: 58e28c4e-7356-462d-af7f-9862c5c86b43] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:34:16.048586 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-a4510fc0-3639-46bf-9516-51b9a6da7131 req-fbbb3df7-f206-4d0e-a539-0d219b58c501 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58e28c4e-7356-462d-af7f-9862c5c86b43", "tag": "43bdcfa7-75d7-4c3c-972b-c983f6a01b8e"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:34:16.051989 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_api:SELECT=2 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:34:16.052687 n-d-833090-16 devstack@n-api.service[128863]: DEBUG dbcounter [-] [128863] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 17:34:16.059115 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-edf1c94b-6f04-4c98-abe2-9da7492da6d2 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:34:16.061598 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-edf1c94b-6f04-4c98-abe2-9da7492da6d2 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:34:16.062053 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-edf1c94b-6f04-4c98-abe2-9da7492da6d2 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:34:16.063484 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-edf1c94b-6f04-4c98-abe2-9da7492da6d2 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:34:16.064146 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-edf1c94b-6f04-4c98-abe2-9da7492da6d2 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:34:16.064681 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-edf1c94b-6f04-4c98-abe2-9da7492da6d2 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:34:16.065418 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-a4510fc0-3639-46bf-9516-51b9a6da7131 req-fbbb3df7-f206-4d0e-a539-0d219b58c501 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:34:16.066187 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-a4510fc0-3639-46bf-9516-51b9a6da7131 req-fbbb3df7-f206-4d0e-a539-0d219b58c501 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:34:16.066640 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-a4510fc0-3639-46bf-9516-51b9a6da7131 req-fbbb3df7-f206-4d0e-a539-0d219b58c501 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:34:16.081738 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-a4510fc0-3639-46bf-9516-51b9a6da7131 req-fbbb3df7-f206-4d0e-a539-0d219b58c501 service nova] Creating event network-changed:43bdcfa7-75d7-4c3c-972b-c983f6a01b8e for instance 58e28c4e-7356-462d-af7f-9862c5c86b43 on n-h1-833090-16 Aug 31 17:34:16.087885 n-d-833090-16 devstack@n-api.service[128864]: INFO oslo.messaging._drivers.impl_rabbit [-] [0684e720-ea0e-4737-a458-87e19068aaad] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 54326. Aug 31 17:34:16.090037 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-a4510fc0-3639-46bf-9516-51b9a6da7131 req-fbbb3df7-f206-4d0e-a539-0d219b58c501 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046081 Aug 31 17:34:16.091363 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 4047/7919] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:34:16.101536 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-edf1c94b-6f04-4c98-abe2-9da7492da6d2 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] [instance: 58e28c4e-7356-462d-af7f-9862c5c86b43] Going to try to terminate instance {{(pid=128863) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 17:34:16.193893 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-edf1c94b-6f04-4c98-abe2-9da7492da6d2 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] 10.222.0.50 "DELETE /compute/v2.1/servers/58e28c4e-7356-462d-af7f-9862c5c86b43" status: 204 len: 0 microversion: 2.1 time: 0.151557 Aug 31 17:34:16.195067 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3873/7920] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 17:34:16 2022] DELETE /compute/v2.1/servers/58e28c4e-7356-462d-af7f-9862c5c86b43 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 17:34:16.205152 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-fafcc364-46cd-4de4-a9f5-cf6f15f456f4 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:34:16.205909 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-fafcc364-46cd-4de4-a9f5-cf6f15f456f4 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] [instance: 58e28c4e-7356-462d-af7f-9862c5c86b43] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:34:16.209109 n-d-833090-16 devstack@n-api.service[128864]: INFO oslo.messaging._drivers.impl_rabbit [-] [4f3e0afc-1d0e-4db3-9143-6185c0e157a7] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 54328. Aug 31 17:34:16.214270 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fafcc364-46cd-4de4-a9f5-cf6f15f456f4 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:34:16.214772 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fafcc364-46cd-4de4-a9f5-cf6f15f456f4 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:34:16.215291 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fafcc364-46cd-4de4-a9f5-cf6f15f456f4 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:34:16.216011 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fafcc364-46cd-4de4-a9f5-cf6f15f456f4 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:34:16.216483 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fafcc364-46cd-4de4-a9f5-cf6f15f456f4 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:34:16.216922 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-fafcc364-46cd-4de4-a9f5-cf6f15f456f4 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:34:16.357452 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-fafcc364-46cd-4de4-a9f5-cf6f15f456f4 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf077c7c1794aa5a51d730f2a0c9162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f95065659944050a484f98b738b0f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:34:16.365563 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-fafcc364-46cd-4de4-a9f5-cf6f15f456f4 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] 10.222.0.50 "GET /compute/v2.1/servers/58e28c4e-7356-462d-af7f-9862c5c86b43" status: 200 len: 1684 microversion: 2.1 time: 0.165268 Aug 31 17:34:16.366268 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 4048/7921] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:34:16 2022] GET /compute/v2.1/servers/58e28c4e-7356-462d-af7f-9862c5c86b43 => generated 1684 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:34:17.389433 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-331aa3bc-0981-44bb-aa32-c2db88344f75 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:34:17.390135 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-331aa3bc-0981-44bb-aa32-c2db88344f75 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] [instance: 58e28c4e-7356-462d-af7f-9862c5c86b43] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:34:17.397956 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-331aa3bc-0981-44bb-aa32-c2db88344f75 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:34:17.398516 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-331aa3bc-0981-44bb-aa32-c2db88344f75 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:34:17.399040 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-331aa3bc-0981-44bb-aa32-c2db88344f75 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:34:17.400126 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-331aa3bc-0981-44bb-aa32-c2db88344f75 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:34:17.400630 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-331aa3bc-0981-44bb-aa32-c2db88344f75 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:34:17.401081 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-331aa3bc-0981-44bb-aa32-c2db88344f75 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:34:17.548475 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-331aa3bc-0981-44bb-aa32-c2db88344f75 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf077c7c1794aa5a51d730f2a0c9162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f95065659944050a484f98b738b0f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:34:17.557048 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-331aa3bc-0981-44bb-aa32-c2db88344f75 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] 10.222.0.50 "GET /compute/v2.1/servers/58e28c4e-7356-462d-af7f-9862c5c86b43" status: 200 len: 1684 microversion: 2.1 time: 0.172551 Aug 31 17:34:17.557636 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3874/7922] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:34:17 2022] GET /compute/v2.1/servers/58e28c4e-7356-462d-af7f-9862c5c86b43 => generated 1684 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:34:17.975134 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [req-7b0c58f2-365b-448b-b94c-ebfe57ee78b4 req-4c433435-dcfc-4137-9145-49724da5269e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58e28c4e-7356-462d-af7f-9862c5c86b43", "name": "network-vif-unplugged", "status": "completed", "tag": "43bdcfa7-75d7-4c3c-972b-c983f6a01b8e"}]} {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:34:17.987449 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7b0c58f2-365b-448b-b94c-ebfe57ee78b4 req-4c433435-dcfc-4137-9145-49724da5269e service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:34:17.987925 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7b0c58f2-365b-448b-b94c-ebfe57ee78b4 req-4c433435-dcfc-4137-9145-49724da5269e service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:34:17.988358 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [req-7b0c58f2-365b-448b-b94c-ebfe57ee78b4 req-4c433435-dcfc-4137-9145-49724da5269e service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:34:18.002528 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.compute.server_external_events [req-7b0c58f2-365b-448b-b94c-ebfe57ee78b4 req-4c433435-dcfc-4137-9145-49724da5269e service nova] Creating event network-vif-unplugged:43bdcfa7-75d7-4c3c-972b-c983f6a01b8e for instance 58e28c4e-7356-462d-af7f-9862c5c86b43 on n-h1-833090-16 Aug 31 17:34:18.009271 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [req-7b0c58f2-365b-448b-b94c-ebfe57ee78b4 req-4c433435-dcfc-4137-9145-49724da5269e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036996 Aug 31 17:34:18.010304 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 4049/7923] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:34:18.323505 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-9136a762-568b-47aa-9aea-7469e7671f47 req-c94bf66d-bd80-402f-b554-6722e0d201ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58e28c4e-7356-462d-af7f-9862c5c86b43", "name": "network-vif-deleted", "tag": "43bdcfa7-75d7-4c3c-972b-c983f6a01b8e"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:34:18.334388 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9136a762-568b-47aa-9aea-7469e7671f47 req-c94bf66d-bd80-402f-b554-6722e0d201ad service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:34:18.334982 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9136a762-568b-47aa-9aea-7469e7671f47 req-c94bf66d-bd80-402f-b554-6722e0d201ad service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:34:18.335544 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-9136a762-568b-47aa-9aea-7469e7671f47 req-c94bf66d-bd80-402f-b554-6722e0d201ad service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:34:18.352019 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-9136a762-568b-47aa-9aea-7469e7671f47 req-c94bf66d-bd80-402f-b554-6722e0d201ad service nova] Creating event network-vif-deleted:43bdcfa7-75d7-4c3c-972b-c983f6a01b8e for instance 58e28c4e-7356-462d-af7f-9862c5c86b43 on n-h1-833090-16 Aug 31 17:34:18.360494 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-9136a762-568b-47aa-9aea-7469e7671f47 req-c94bf66d-bd80-402f-b554-6722e0d201ad service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041351 Aug 31 17:34:18.362056 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3875/7924] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:34:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 17:34:18.580074 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-bb07ec5a-73d9-49ec-bf89-b435c6fd46e5 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:34:18.580892 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-bb07ec5a-73d9-49ec-bf89-b435c6fd46e5 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] [instance: 58e28c4e-7356-462d-af7f-9862c5c86b43] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:34:18.589854 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bb07ec5a-73d9-49ec-bf89-b435c6fd46e5 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:34:18.590489 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bb07ec5a-73d9-49ec-bf89-b435c6fd46e5 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:34:18.591178 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bb07ec5a-73d9-49ec-bf89-b435c6fd46e5 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:34:18.592312 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bb07ec5a-73d9-49ec-bf89-b435c6fd46e5 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:34:18.592751 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bb07ec5a-73d9-49ec-bf89-b435c6fd46e5 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:34:18.593697 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bb07ec5a-73d9-49ec-bf89-b435c6fd46e5 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:34:18.631300 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bb07ec5a-73d9-49ec-bf89-b435c6fd46e5 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:34:18.632034 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bb07ec5a-73d9-49ec-bf89-b435c6fd46e5 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:34:18.632655 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-bb07ec5a-73d9-49ec-bf89-b435c6fd46e5 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:34:18.633447 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.objects.instance [None req-bb07ec5a-73d9-49ec-bf89-b435c6fd46e5 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lazy-loading 'fault' on Instance uuid 58e28c4e-7356-462d-af7f-9862c5c86b43 {{(pid=128864) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 31 17:34:18.679704 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-bb07ec5a-73d9-49ec-bf89-b435c6fd46e5 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf077c7c1794aa5a51d730f2a0c9162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f95065659944050a484f98b738b0f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:34:18.689327 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-bb07ec5a-73d9-49ec-bf89-b435c6fd46e5 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] 10.222.0.50 "GET /compute/v2.1/servers/58e28c4e-7356-462d-af7f-9862c5c86b43" status: 200 len: 1339 microversion: 2.1 time: 0.114479 Aug 31 17:34:18.690304 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 4050/7925] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:34:18 2022] GET /compute/v2.1/servers/58e28c4e-7356-462d-af7f-9862c5c86b43 => generated 1339 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:34:19.714189 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dd60cecf-8147-44f8-9996-0541270e8683 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:34:19.714838 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-dd60cecf-8147-44f8-9996-0541270e8683 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] [instance: 58e28c4e-7356-462d-af7f-9862c5c86b43] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:34:19.721955 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd60cecf-8147-44f8-9996-0541270e8683 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:34:19.722477 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd60cecf-8147-44f8-9996-0541270e8683 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:34:19.722902 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd60cecf-8147-44f8-9996-0541270e8683 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:34:19.723591 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd60cecf-8147-44f8-9996-0541270e8683 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:34:19.724039 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd60cecf-8147-44f8-9996-0541270e8683 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:34:19.724456 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-dd60cecf-8147-44f8-9996-0541270e8683 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:34:19.738591 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.wsgi [None req-dd60cecf-8147-44f8-9996-0541270e8683 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] HTTP exception thrown: Instance 58e28c4e-7356-462d-af7f-9862c5c86b43 could not be found. Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dd60cecf-8147-44f8-9996-0541270e8683 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Request method failure captured: Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: request: GET /compute/v2.1/servers/58e28c4e-7356-462d-af7f-9862c5c86b43 HTTP/1.1 Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: Accept: application/json Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: Accept-Encoding: identity Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: Connection: close Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: Content-Length: 0 Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: Content-Type: application/json Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: Host: 10.222.0.50 Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: Openstack-System-Scope: None Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: User-Agent: python-urllib3/1.26.12 Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: X-Auth-Token: gAAAAABjD5pIffCo-6aw_fLy-KjZnfaUaYWjL4DlrP43f4LIHsTbZkuxNLO45k0oFGO_DpQunko10c8k-KUYsyqEWvCo-_fE0nopzG2fQqDOdRfiSHpzz3XVDfReN-XG3iCJoVc2AUs8jguwfz8PwEJ00s7dUZFT2LOZitqFRvooXVTKBl_9UBE Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Id: None Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: X-Domain-Name: None Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: X-Identity-Status: Confirmed Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: X-Is-Admin-Project: True Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Id: default Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Domain-Name: Default Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Id: 4f95065659944050a484f98b738b0f2b Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: X-Project-Name: tempest-TestSnapshotPattern-742441091 Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: X-Role: reader,member Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: X-Roles: reader,member Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4f95065659944050a484f98b738b0f2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4f95065659944050a484f98b738b0f2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4f95065659944050a484f98b738b0f2b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4f95065659944050a484f98b738b0f2b", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant: tempest-TestSnapshotPattern-742441091 Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Id: 4f95065659944050a484f98b738b0f2b Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: X-Tenant-Name: tempest-TestSnapshotPattern-742441091 Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: X-User: tempest-TestSnapshotPattern-742441091-project Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Id: default Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: X-User-Domain-Name: Default Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: X-User-Id: 0cf077c7c1794aa5a51d730f2a0c9162 Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: X-User-Name: tempest-TestSnapshotPattern-742441091-project Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: method: > Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: exception: Instance 58e28c4e-7356-462d-af7f-9862c5c86b43 could not be found. Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: action_args: {'id': '58e28c4e-7356-462d-af7f-9862c5c86b43'} Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58e28c4e-7356-462d-af7f-9862c5c86b43 could not be found. Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58e28c4e-7356-462d-af7f-9862c5c86b43 could not be found. Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:34:19.740280 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 17:34:19.745416 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:34:19.745416 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:34:19.745416 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:34:19.745416 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 17:34:19.745416 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 17:34:19.745416 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58e28c4e-7356-462d-af7f-9862c5c86b43 could not be found. Aug 31 17:34:19.745416 n-d-833090-16 devstack@n-api.service[128863]: ERROR nova.api.openstack.wsgi Aug 31 17:34:19.745416 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-dd60cecf-8147-44f8-9996-0541270e8683 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Returning 404 to user: Instance 58e28c4e-7356-462d-af7f-9862c5c86b43 could not be found. {{(pid=128863) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 17:34:19.745416 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-dd60cecf-8147-44f8-9996-0541270e8683 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] 10.222.0.50 "GET /compute/v2.1/servers/58e28c4e-7356-462d-af7f-9862c5c86b43" status: 404 len: 111 microversion: 2.1 time: 0.032896 Aug 31 17:34:19.745416 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3876/7926] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:34:19 2022] GET /compute/v2.1/servers/58e28c4e-7356-462d-af7f-9862c5c86b43 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 17:34:21.506520 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7716a628-f94b-4346-ac83-20a010572c09 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:34:21.507059 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7716a628-f94b-4346-ac83-20a010572c09 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] [instance: bbec5318-32b0-45cd-92d1-155f8a38ab77] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:34:21.509581 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-a5bb6baa-584a-4bdb-94a0-345818e9aebf req-ff8ab9e3-4c36-4c02-b5fc-779f85481eaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbec5318-32b0-45cd-92d1-155f8a38ab77", "tag": "9b9edf17-9b80-4f26-8d16-491f25e711cd"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:34:21.514153 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7716a628-f94b-4346-ac83-20a010572c09 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:34:21.514909 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7716a628-f94b-4346-ac83-20a010572c09 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:34:21.515354 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7716a628-f94b-4346-ac83-20a010572c09 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:34:21.516070 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7716a628-f94b-4346-ac83-20a010572c09 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:34:21.516493 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7716a628-f94b-4346-ac83-20a010572c09 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:34:21.517087 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7716a628-f94b-4346-ac83-20a010572c09 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:34:21.520019 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a5bb6baa-584a-4bdb-94a0-345818e9aebf req-ff8ab9e3-4c36-4c02-b5fc-779f85481eaa service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:34:21.520496 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a5bb6baa-584a-4bdb-94a0-345818e9aebf req-ff8ab9e3-4c36-4c02-b5fc-779f85481eaa service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:34:21.520922 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-a5bb6baa-584a-4bdb-94a0-345818e9aebf req-ff8ab9e3-4c36-4c02-b5fc-779f85481eaa service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:34:21.533342 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-a5bb6baa-584a-4bdb-94a0-345818e9aebf req-ff8ab9e3-4c36-4c02-b5fc-779f85481eaa service nova] Creating event network-changed:9b9edf17-9b80-4f26-8d16-491f25e711cd for instance bbec5318-32b0-45cd-92d1-155f8a38ab77 on n-h2-833090-16 Aug 31 17:34:21.539472 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-a5bb6baa-584a-4bdb-94a0-345818e9aebf req-ff8ab9e3-4c36-4c02-b5fc-779f85481eaa service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033686 Aug 31 17:34:21.540564 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3877/7927] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:34:21.546726 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7716a628-f94b-4346-ac83-20a010572c09 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] [instance: bbec5318-32b0-45cd-92d1-155f8a38ab77] Going to try to terminate instance {{(pid=128864) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 31 17:34:21.668032 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7716a628-f94b-4346-ac83-20a010572c09 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] 10.222.0.50 "DELETE /compute/v2.1/servers/bbec5318-32b0-45cd-92d1-155f8a38ab77" status: 204 len: 0 microversion: 2.1 time: 0.165522 Aug 31 17:34:21.668815 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 4051/7928] 10.222.0.50 () {58 vars in 1239 bytes} [Wed Aug 31 17:34:21 2022] DELETE /compute/v2.1/servers/bbec5318-32b0-45cd-92d1-155f8a38ab77 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 17:34:21.678338 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-612a3f2b-a194-49a7-8949-a0e95f38e7fe tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Calling method '>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:34:21.679172 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.compute.api [None req-612a3f2b-a194-49a7-8949-a0e95f38e7fe tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] [instance: bbec5318-32b0-45cd-92d1-155f8a38ab77] Fetching instance by UUID {{(pid=128863) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:34:21.686691 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-612a3f2b-a194-49a7-8949-a0e95f38e7fe tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:34:21.687570 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-612a3f2b-a194-49a7-8949-a0e95f38e7fe tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:34:21.688095 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-612a3f2b-a194-49a7-8949-a0e95f38e7fe tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:34:21.688917 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-612a3f2b-a194-49a7-8949-a0e95f38e7fe tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:34:21.689458 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-612a3f2b-a194-49a7-8949-a0e95f38e7fe tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:34:21.689999 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [None req-612a3f2b-a194-49a7-8949-a0e95f38e7fe tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:34:21.851259 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.policy [None req-612a3f2b-a194-49a7-8949-a0e95f38e7fe tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf077c7c1794aa5a51d730f2a0c9162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f95065659944050a484f98b738b0f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128863) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:34:21.859598 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-612a3f2b-a194-49a7-8949-a0e95f38e7fe tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] 10.222.0.50 "GET /compute/v2.1/servers/bbec5318-32b0-45cd-92d1-155f8a38ab77" status: 200 len: 1681 microversion: 2.1 time: 0.186186 Aug 31 17:34:21.860231 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3878/7929] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:34:21 2022] GET /compute/v2.1/servers/bbec5318-32b0-45cd-92d1-155f8a38ab77 => generated 1681 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:34:22.883196 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-7f0690bf-ffe7-4117-a87c-7d3559091577 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:34:22.884450 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-7f0690bf-ffe7-4117-a87c-7d3559091577 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] [instance: bbec5318-32b0-45cd-92d1-155f8a38ab77] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:34:22.892491 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f0690bf-ffe7-4117-a87c-7d3559091577 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:34:22.893132 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f0690bf-ffe7-4117-a87c-7d3559091577 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:34:22.893591 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f0690bf-ffe7-4117-a87c-7d3559091577 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:34:22.894344 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f0690bf-ffe7-4117-a87c-7d3559091577 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:34:22.894980 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f0690bf-ffe7-4117-a87c-7d3559091577 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:34:22.895240 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-7f0690bf-ffe7-4117-a87c-7d3559091577 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:34:23.100239 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.policy [None req-7f0690bf-ffe7-4117-a87c-7d3559091577 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cf077c7c1794aa5a51d730f2a0c9162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f95065659944050a484f98b738b0f2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128864) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 17:34:23.108547 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-7f0690bf-ffe7-4117-a87c-7d3559091577 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] 10.222.0.50 "GET /compute/v2.1/servers/bbec5318-32b0-45cd-92d1-155f8a38ab77" status: 200 len: 1563 microversion: 2.1 time: 0.231098 Aug 31 17:34:23.109142 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 4052/7930] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:34:22 2022] GET /compute/v2.1/servers/bbec5318-32b0-45cd-92d1-155f8a38ab77 => generated 1563 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 17:34:23.557520 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [req-10119643-a958-4146-9ca5-e0920056be2d req-ed96bdcf-c662-4018-aa28-c88219024478 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbec5318-32b0-45cd-92d1-155f8a38ab77", "name": "network-vif-deleted", "tag": "9b9edf17-9b80-4f26-8d16-491f25e711cd"}]} {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 17:34:23.568968 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-10119643-a958-4146-9ca5-e0920056be2d req-ed96bdcf-c662-4018-aa28-c88219024478 service nova] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:34:23.569659 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-10119643-a958-4146-9ca5-e0920056be2d req-ed96bdcf-c662-4018-aa28-c88219024478 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:34:23.569978 n-d-833090-16 devstack@n-api.service[128863]: DEBUG oslo_concurrency.lockutils [req-10119643-a958-4146-9ca5-e0920056be2d req-ed96bdcf-c662-4018-aa28-c88219024478 service nova] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128863) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:34:23.582844 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.compute.server_external_events [req-10119643-a958-4146-9ca5-e0920056be2d req-ed96bdcf-c662-4018-aa28-c88219024478 service nova] Creating event network-vif-deleted:9b9edf17-9b80-4f26-8d16-491f25e711cd for instance bbec5318-32b0-45cd-92d1-155f8a38ab77 on n-h2-833090-16 Aug 31 17:34:23.588200 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [req-10119643-a958-4146-9ca5-e0920056be2d req-ed96bdcf-c662-4018-aa28-c88219024478 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035212 Aug 31 17:34:23.588923 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3879/7931] 10.222.0.50 () {64 vars in 1317 bytes} [Wed Aug 31 17:34:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 17:34:24.134288 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-696b9476-2c95-425a-90bb-3fddcb5ba244 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Calling method '>' {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:34:24.134926 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.compute.api [None req-696b9476-2c95-425a-90bb-3fddcb5ba244 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] [instance: bbec5318-32b0-45cd-92d1-155f8a38ab77] Fetching instance by UUID {{(pid=128864) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 31 17:34:24.142345 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-696b9476-2c95-425a-90bb-3fddcb5ba244 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:34:24.142849 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-696b9476-2c95-425a-90bb-3fddcb5ba244 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:34:24.143294 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-696b9476-2c95-425a-90bb-3fddcb5ba244 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:34:24.144002 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-696b9476-2c95-425a-90bb-3fddcb5ba244 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Acquiring lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 31 17:34:24.144563 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-696b9476-2c95-425a-90bb-3fddcb5ba244 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 31 17:34:24.145002 n-d-833090-16 devstack@n-api.service[128864]: DEBUG oslo_concurrency.lockutils [None req-696b9476-2c95-425a-90bb-3fddcb5ba244 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Lock "ff6ab154-5f51-4e0d-922a-904eb5aa20da" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 31 17:34:24.158934 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.wsgi [None req-696b9476-2c95-425a-90bb-3fddcb5ba244 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] HTTP exception thrown: Instance bbec5318-32b0-45cd-92d1-155f8a38ab77 could not be found. Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-696b9476-2c95-425a-90bb-3fddcb5ba244 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Request method failure captured: Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: request: GET /compute/v2.1/servers/bbec5318-32b0-45cd-92d1-155f8a38ab77 HTTP/1.1 Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: Accept: application/json Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: Accept-Encoding: identity Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: Connection: close Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: Content-Length: 0 Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: Content-Type: application/json Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: Host: 10.222.0.50 Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: Openstack-System-Scope: None Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: User-Agent: python-urllib3/1.26.12 Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: X-Auth-Token: gAAAAABjD5pIffCo-6aw_fLy-KjZnfaUaYWjL4DlrP43f4LIHsTbZkuxNLO45k0oFGO_DpQunko10c8k-KUYsyqEWvCo-_fE0nopzG2fQqDOdRfiSHpzz3XVDfReN-XG3iCJoVc2AUs8jguwfz8PwEJ00s7dUZFT2LOZitqFRvooXVTKBl_9UBE Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Id: None Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: X-Domain-Name: None Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: X-Identity-Status: Confirmed Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: X-Is-Admin-Project: True Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Id: default Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Domain-Name: Default Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Id: 4f95065659944050a484f98b738b0f2b Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: X-Project-Name: tempest-TestSnapshotPattern-742441091 Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: X-Role: reader,member Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: X-Roles: reader,member Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4f95065659944050a484f98b738b0f2b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4f95065659944050a484f98b738b0f2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4f95065659944050a484f98b738b0f2b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4f95065659944050a484f98b738b0f2b", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}] Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant: tempest-TestSnapshotPattern-742441091 Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Id: 4f95065659944050a484f98b738b0f2b Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: X-Tenant-Name: tempest-TestSnapshotPattern-742441091 Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: X-User: tempest-TestSnapshotPattern-742441091-project Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Id: default Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: X-User-Domain-Name: Default Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: X-User-Id: 0cf077c7c1794aa5a51d730f2a0c9162 Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: X-User-Name: tempest-TestSnapshotPattern-742441091-project Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: method: > Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: exception: Instance bbec5318-32b0-45cd-92d1-155f8a38ab77 could not be found. Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: action_args: {'id': 'bbec5318-32b0-45cd-92d1-155f8a38ab77'} Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: {{(pid=128864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbec5318-32b0-45cd-92d1-155f8a38ab77 could not be found. Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbec5318-32b0-45cd-92d1-155f8a38ab77 could not be found. Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 31 17:34:24.160799 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 17:34:24.166637 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 31 17:34:24.166637 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 31 17:34:24.166637 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 31 17:34:24.166637 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 31 17:34:24.166637 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 31 17:34:24.166637 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbec5318-32b0-45cd-92d1-155f8a38ab77 could not be found. Aug 31 17:34:24.166637 n-d-833090-16 devstack@n-api.service[128864]: ERROR nova.api.openstack.wsgi Aug 31 17:34:24.166637 n-d-833090-16 devstack@n-api.service[128864]: DEBUG nova.api.openstack.wsgi [None req-696b9476-2c95-425a-90bb-3fddcb5ba244 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Returning 404 to user: Instance bbec5318-32b0-45cd-92d1-155f8a38ab77 could not be found. {{(pid=128864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 31 17:34:24.166637 n-d-833090-16 devstack@n-api.service[128864]: INFO nova.api.openstack.requestlog [None req-696b9476-2c95-425a-90bb-3fddcb5ba244 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] 10.222.0.50 "GET /compute/v2.1/servers/bbec5318-32b0-45cd-92d1-155f8a38ab77" status: 404 len: 111 microversion: 2.1 time: 0.034677 Aug 31 17:34:24.166637 n-d-833090-16 devstack@n-api.service[128864]: [pid: 128864|app: 0|req: 4053/7932] 10.222.0.50 () {58 vars in 1236 bytes} [Wed Aug 31 17:34:24 2022] GET /compute/v2.1/servers/bbec5318-32b0-45cd-92d1-155f8a38ab77 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 17:34:24.352737 n-d-833090-16 devstack@n-api.service[128863]: DEBUG nova.api.openstack.wsgi [None req-f4218881-6ef7-4d8d-8b18-8e43797e7927 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] Calling method '.version_select at 0x7fbb45252b80>' {{(pid=128863) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 17:34:24.382299 n-d-833090-16 devstack@n-api.service[128863]: INFO nova.api.openstack.requestlog [None req-f4218881-6ef7-4d8d-8b18-8e43797e7927 tempest-TestSnapshotPattern-742441091 tempest-TestSnapshotPattern-742441091-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1305527331" status: 202 len: 0 microversion: 2.1 time: 0.033924 Aug 31 17:34:24.386733 n-d-833090-16 devstack@n-api.service[128863]: [pid: 128863|app: 0|req: 3880/7933] 10.222.0.50 () {58 vars in 1257 bytes} [Wed Aug 31 17:34:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1305527331 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)